2024-09-13T21:58:47.963 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T21:58:47.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T21:58:48.076 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904268 branch: squid description: orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904268' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum log-only-match: - CEPHADM_ sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - mon.a - mgr.a - osd.0 - - host.b - mon.b - mgr.b - osd.1 - - host.c - mon.c - osd.2 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEoHgJGYmFklsd+WWFsuLgtvCxdOmMGbPNooHfIqyN2tasgwQcc5jBQ4/sxTXc/XwKMsQ69nMbBYY8BR4TF9yEk= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH77moxtoLFv09hJ3ir5kbW2FLbNLNAYw/1Kc6DfxDXuCsLWlASTeKU3TP1tHrd4k2gun5dWi2C5caqCNCn5Mro= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCD1/u7AiTcyU6JWOtDVCBOp7s1K/gXPFvSCmg6OkdYwoqCzH9os2Q83Jslc5xz+ESGxoJ8EIzhVOLpV7M9nBvY= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph mgr module enable rgw - rgw_module.apply: specs: - rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 - cephadm.shell: host.a: - 'set -e set -x while true; do TOKEN=$(ceph rgw realm tokens | jq -r ''.[0].token''); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done TOKENS=$(ceph rgw realm tokens) echo $TOKENS | jq --exit-status ''.[0].realm == "myrealm1"'' echo $TOKENS | jq --exit-status ''.[0].token'' TOKEN_JSON=$(ceph rgw realm tokens | jq -r ''.[0].token'' | base64 --decode) echo $TOKEN_JSON | jq --exit-status ''.realm_name == "myrealm1"'' echo $TOKEN_JSON | jq --exit-status ''.endpoint | test("http://.+:\\d+")'' echo $TOKEN_JSON | jq --exit-status ''.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'' echo $TOKEN_JSON | jq --exit-status ''.access_key'' echo $TOKEN_JSON | jq --exit-status ''.secret'' ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T21:58:48.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T21:58:48.077 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T21:58:48.077 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T21:58:48.079 INFO:teuthology.task.internal:Checking packages... 2024-09-13T21:58:48.101 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T21:58:48.101 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T21:58:48.101 INFO:teuthology.packaging:ref: None 2024-09-13T21:58:48.101 INFO:teuthology.packaging:tag: None 2024-09-13T21:58:48.101 INFO:teuthology.packaging:branch: squid 2024-09-13T21:58:48.102 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T21:58:48.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-13T21:58:48.339 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324-gecab7be5-1jammy 2024-09-13T21:58:48.340 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T21:58:48.349 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T21:58:48.349 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T21:58:48.355 INFO:teuthology.task.internal:Saving configuration 2024-09-13T21:58:48.368 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T21:58:48.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T21:58:48.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:52:48.136328', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE1PPXiSN9CTEaJtCLCR6olAmIbZOVs9vO+zNejS3Xph'} 2024-09-13T21:58:48.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:52:48.138300', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG+PahLaGAHzlijoPaNMgXc54xJGRyk7wSfhZxt9uxKK'} 2024-09-13T21:58:48.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 21:52:48.139812', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGYGe8hV6KTHdOE/ctJtqNdgaruUf+wSvR+ktL7ZzyU0'} 2024-09-13T21:58:48.467 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T21:58:48.473 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0'] 2024-09-13T21:58:48.474 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1'] 2024-09-13T21:58:48.474 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2'] 2024-09-13T21:58:48.474 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T21:58:48.581 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fabfcb0f370>, signals=[15]) 2024-09-13T21:58:48.581 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T21:58:48.588 INFO:teuthology.task.internal:Opening connections... 2024-09-13T21:58:48.588 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T21:58:48.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:58:48.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-13T21:58:48.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:58:48.775 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-13T21:58:48.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T21:58:48.862 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T21:58:48.871 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-13T21:58:48.877 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-13T21:58:48.877 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-13T21:58:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T21:58:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2024-09-13T21:58:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="22.04" 2024-09-13T21:58:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T21:58:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=jammy 2024-09-13T21:58:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2024-09-13T21:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2024-09-13T21:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T21:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T21:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T21:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T21:58:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=jammy 2024-09-13T21:58:48.929 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-13T21:58:48.963 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-13T21:58:48.970 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-13T21:58:48.970 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-13T21:58:49.016 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T21:58:49.016 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-09-13T21:58:49.016 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-09-13T21:58:49.016 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T21:58:49.016 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T21:58:49.017 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-09-13T21:58:49.017 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-13T21:58:49.054 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-13T21:58:49.060 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-13T21:58:49.060 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-13T21:58:49.106 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T21:58:49.107 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2024-09-13T21:58:49.108 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-13T21:58:49.137 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T21:58:49.146 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T21:58:49.151 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T21:58:49.151 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:58:49.158 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:58:49.160 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-13T21:58:49.165 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T21:58:49.171 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T21:58:49.171 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:58:49.203 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:58:49.209 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-13T21:58:49.233 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T21:58:49.341 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T21:58:49.368 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T21:58:49.369 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}, 'host.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T21:58:49.370 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:58:49.371 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:58:49.371 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T21:58:49.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:58:49.376 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-13T21:58:49.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:58:49.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T21:58:49.378 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-13T21:58:49.378 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T21:58:49.425 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-56-generic 2024-09-13T21:58:49.425 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.15.0-56-generic 2024-09-13T21:58:49.425 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-09-13T21:58:49.426 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-56-generic 2024-09-13T21:58:49.427 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.15.0-56-generic 2024-09-13T21:58:49.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-09-13T21:58:49.428 INFO:teuthology.orchestra.run.smithi007.stdout:5.15.0-56-generic 2024-09-13T21:58:49.428 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.15.0-56-generic 2024-09-13T21:58:49.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-09-13T21:58:49.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-13T21:58:49.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-13T21:58:49.592 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-13T21:58:49.702 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:58:49.727 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:58:49.736 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T21:58:49.739 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T21:58:49.748 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T21:58:49.805 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T21:58:49.817 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T21:58:49.826 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:58:49.839 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T21:58:49.845 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T21:58:49.908 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T21:58:49.939 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T21:58:49.949 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T21:58:49.950 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T21:58:50.020 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T21:58:50.031 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T21:58:50.037 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T21:58:50.039 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T21:58:50.040 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T21:58:50.041 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T21:58:50.043 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T21:58:50.048 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T21:58:50.050 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T21:58:50.051 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T21:58:50.051 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T21:58:50.058 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T21:58:50.059 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T21:58:50.060 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T21:58:50.060 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T21:58:50.061 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T21:58:50.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T21:58:50.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T21:58:50.068 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T21:58:50.071 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T21:58:50.072 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T21:58:50.072 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T21:58:50.076 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T21:58:50.077 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T21:58:50.079 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T21:58:50.079 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T21:58:50.080 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T21:58:50.083 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T21:58:50.084 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T21:58:50.084 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T21:58:50.085 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T21:58:50.086 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T21:58:50.086 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T21:58:50.089 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T21:58:50.097 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T21:58:50.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T21:58:50.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T21:58:50.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T21:58:50.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T21:58:50.104 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T21:58:50.104 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T21:58:50.104 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T21:58:50.104 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T21:58:50.105 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T21:58:50.107 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T21:58:50.108 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T21:58:50.108 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T21:58:50.111 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T21:58:50.112 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T21:58:50.113 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T21:58:50.113 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T21:58:50.113 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T21:58:50.114 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T21:58:50.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T21:58:50.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T21:58:50.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T21:58:50.124 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T21:58:50.125 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T21:58:50.125 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T21:58:50.135 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T21:58:50.135 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T21:58:50.262 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T21:58:50.270 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T21:58:50.291 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T21:58:50.400 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T21:58:50.555 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T21:58:50.576 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T21:58:50.716 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T21:58:50.727 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T21:58:50.740 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T21:58:50.741 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T21:58:50.749 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T21:58:50.751 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T21:58:50.761 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T21:58:50.762 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T21:58:50.765 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T21:58:50.766 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T21:58:50.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T21:58:50.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T21:58:50.835 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T21:58:50.835 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T21:58:50.835 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T21:58:50.836 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T21:58:50.847 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T21:58:50.848 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T21:58:50.853 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T21:58:50.853 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T21:58:50.856 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T21:58:50.856 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T21:58:50.862 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T21:58:50.884 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T21:58:50.886 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T21:58:50.887 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T21:58:50.892 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T21:58:50.893 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T21:58:50.893 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T21:58:50.903 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T21:58:50.907 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T21:58:50.909 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T21:58:50.909 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T21:58:50.911 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T21:58:50.912 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T21:58:50.912 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T21:58:50.913 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T21:58:50.960 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T21:58:50.961 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T21:58:50.961 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T21:58:50.963 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T21:58:50.973 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T21:58:50.973 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T21:58:50.993 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T21:58:50.994 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T21:58:50.994 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T21:58:50.994 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T21:58:50.994 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T21:58:50.995 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T21:58:50.995 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T21:58:51.042 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T21:58:56.461 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 16.0 MB in 2s (7,539 kB/s) 2024-09-13T21:58:56.464 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 16.0 MB in 2s (7,495 kB/s) 2024-09-13T21:58:56.835 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 16.0 MB in 2s (7,177 kB/s) 2024-09-13T21:58:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T21:58:57.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:58:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T21:58:58.063 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T21:58:58.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:58:58.141 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T21:58:58.175 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-13T21:58:58.176 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-13T21:58:58.349 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-13T21:58:58.349 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-13T21:58:58.366 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:58:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:58:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:58:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:58:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T21:58:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-09-13T21:58:58.367 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:58:58.369 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-13T21:58:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T21:58:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.371 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-13T21:58:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T21:58:58.371 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-09-13T21:58:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: thermald 2024-09-13T21:58:58.380 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T21:58:58.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:58:58.424 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-13T21:58:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T21:58:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.426 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-09-13T21:58:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T21:58:58.466 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T21:58:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:58:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 113 MB of archives. 2024-09-13T21:58:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T21:58:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T21:58:58.528 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:58:58.528 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:58:58.528 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:58:58.529 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:58:58.529 INFO:teuthology.orchestra.run.smithi171.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T21:58:58.529 INFO:teuthology.orchestra.run.smithi171.stdout: python2.7-minimal 2024-09-13T21:58:58.529 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:58:58.530 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-09-13T21:58:58.530 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.531 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T21:58:58.531 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.532 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-09-13T21:58:58.532 INFO:teuthology.orchestra.run.smithi171.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T21:58:58.532 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-09-13T21:58:58.532 INFO:teuthology.orchestra.run.smithi171.stdout: thermald 2024-09-13T21:58:58.574 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-09-13T21:58:58.574 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.574 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T21:58:58.575 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.576 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2024-09-13T21:58:58.577 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T21:58:58.627 INFO:teuthology.orchestra.run.smithi171.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:58:58.627 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 113 MB of archives. 2024-09-13T21:58:58.627 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T21:58:58.627 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T21:58:58.678 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-13T21:58:58.679 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-13T21:58:58.876 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:58:58.876 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:58:58.876 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:58:58.877 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:58:58.877 INFO:teuthology.orchestra.run.smithi007.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T21:58:58.877 INFO:teuthology.orchestra.run.smithi007.stdout: python2.7-minimal 2024-09-13T21:58:58.877 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:58:58.878 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-13T21:58:58.879 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.879 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T21:58:58.879 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-13T21:58:58.881 INFO:teuthology.orchestra.run.smithi007.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T21:58:58.881 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-09-13T21:58:58.881 INFO:teuthology.orchestra.run.smithi007.stdout: thermald 2024-09-13T21:58:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T21:58:58.927 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-13T21:58:58.927 INFO:teuthology.orchestra.run.smithi007.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T21:58:58.927 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T21:58:58.928 INFO:teuthology.orchestra.run.smithi007.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T21:58:58.929 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-09-13T21:58:58.929 INFO:teuthology.orchestra.run.smithi007.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T21:58:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T21:58:59.110 INFO:teuthology.orchestra.run.smithi007.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:58:59.110 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 113 MB of archives. 2024-09-13T21:58:59.110 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T21:58:59.110 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T21:58:59.127 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T21:58:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T21:58:59.821 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T21:58:59.821 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T21:58:59.821 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T21:58:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T21:58:59.959 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T21:59:00.013 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T21:59:00.016 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T21:59:00.016 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T21:59:00.133 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T21:59:00.263 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T21:59:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 113 MB in 2s (74.2 MB/s) 2024-09-13T21:59:00.510 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T21:59:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T21:59:00.599 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 113 MB in 2s (67.5 MB/s) 2024-09-13T21:59:00.865 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T21:59:00.902 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T21:59:02.465 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T21:59:02.469 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:02.547 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:03.061 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T21:59:03.064 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T21:59:03.064 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T21:59:03.064 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T21:59:03.065 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:03.235 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:03.411 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T21:59:03.490 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T21:59:03.917 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-13T21:59:04.116 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T21:59:04.616 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T21:59:04.637 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:04.721 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:05.202 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T21:59:05.223 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:05.260 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:05.534 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T21:59:05.556 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:05.640 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:06.191 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T21:59:06.195 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:06.347 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:06.521 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T21:59:06.542 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:06.580 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:08.650 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T21:59:08.663 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:08.755 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:09.286 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T21:59:09.307 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:09.344 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:12.037 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:12.140 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:12.472 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:12.593 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:12.905 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T21:59:12.927 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T21:59:12.972 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:13.263 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:13.380 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:13.739 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:13.893 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:14.213 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T21:59:14.236 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T21:59:14.280 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:17.105 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:17.241 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:17.599 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:17.753 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:18.064 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T21:59:18.087 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T21:59:18.147 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:18.706 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T21:59:18.743 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:18.781 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:20.053 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T21:59:20.090 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:20.120 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:21.496 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:21.618 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:21.960 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:22.082 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:22.208 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T21:59:22.336 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:23.450 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:23.589 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:23.643 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:23.643 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:23.643 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:23.643 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:23.793 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:23.963 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:24.060 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:24.194 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T21:59:24.322 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:24.564 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T21:59:24.602 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T21:59:24.639 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:25.750 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:25.750 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:25.750 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:25.751 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:25.970 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:27.442 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T21:59:27.551 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T21:59:27.568 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:27.652 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:27.715 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T21:59:27.715 INFO:teuthology.orchestra.run.smithi131.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:28.435 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T21:59:28.575 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T21:59:28.967 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T21:59:28.969 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T21:59:29.096 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:29.112 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T21:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:29.238 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T21:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T21:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:29.358 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:30.790 INFO:teuthology.orchestra.run.smithi007.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:30.790 INFO:teuthology.orchestra.run.smithi007.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:30.790 INFO:teuthology.orchestra.run.smithi007.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:30.790 INFO:teuthology.orchestra.run.smithi007.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:30.944 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:33.087 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:34.530 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T21:59:34.673 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T21:59:34.816 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T21:59:34.883 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T21:59:34.883 INFO:teuthology.orchestra.run.smithi007.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T21:59:42.433 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub' 2024-09-13T21:59:42.450 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:42.468 INFO:teuthology.orchestra.run.smithi131.stdout:Generating grub configuration file ... 2024-09-13T21:59:42.759 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:42.780 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:43.084 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:43.090 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:43.160 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:43.165 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:43.334 INFO:teuthology.orchestra.run.smithi131.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:43.334 INFO:teuthology.orchestra.run.smithi131.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:43.334 INFO:teuthology.orchestra.run.smithi131.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:43.380 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-09-13T21:59:43.545 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T21:59:43.546 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub' 2024-09-13T21:59:43.566 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:43.593 INFO:teuthology.orchestra.run.smithi171.stdout:Generating grub configuration file ... 2024-09-13T21:59:43.857 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-09-13T21:59:43.928 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-09-13T21:59:43.928 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-09-13T21:59:43.928 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:43.929 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-09-13T21:59:43.930 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T21:59:43.930 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:59:43.930 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:59:43.930 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T21:59:43.930 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:59:43.930 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-09-13T21:59:43.946 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:43.969 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:44.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-13T21:59:44.199 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:59:44.200 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T21:59:44.217 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T21:59:44.312 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T21:59:44.335 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:44.341 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:44.416 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:44.421 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:44.592 INFO:teuthology.orchestra.run.smithi171.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:44.592 INFO:teuthology.orchestra.run.smithi171.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:44.592 INFO:teuthology.orchestra.run.smithi171.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:44.626 INFO:teuthology.orchestra.run.smithi171.stdout:done 2024-09-13T21:59:45.118 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:45.145 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-09-13T21:59:45.145 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:45.145 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:45.145 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-09-13T21:59:45.145 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T21:59:45.145 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:59:45.145 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:59:45.145 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-09-13T21:59:45.145 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:59:45.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-09-13T21:59:45.329 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-13T21:59:45.464 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:59:45.474 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T21:59:45.491 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T21:59:45.584 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T21:59:45.641 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T21:59:45.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:59:45.712 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T21:59:45.898 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-13T21:59:45.899 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-13T21:59:46.064 INFO:teuthology.orchestra.run.smithi131.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T21:59:46.064 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:59:46.064 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:59:46.064 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:59:46.064 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:59:46.065 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T21:59:46.065 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T21:59:46.065 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:59:46.105 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:59:46.106 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-09-13T21:59:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-09-13T21:59:46.163 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-13T21:59:46.211 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.uVC9RYoPlb 2024-09-13T21:59:46.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uVC9RYoPlb 2024-09-13T21:59:46.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.uVC9RYoPlb 2024-09-13T21:59:46.382 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.uVC9RYoPlb is 10KB 2024-09-13T21:59:46.394 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.uVC9RYoPlb 2024-09-13T21:59:46.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:46.459 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T21:59:46.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T21:59:46.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:46.527 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T21:59:46.527 DEBUG:teuthology.orchestra.run.smithi131:> sudo update-grub 2024-09-13T21:59:46.906 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T21:59:46.924 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:59:46.976 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T21:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-13T21:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-13T21:59:47.333 INFO:teuthology.orchestra.run.smithi171.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T21:59:47.333 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:59:47.333 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:59:47.333 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:59:47.333 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:59:47.334 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T21:59:47.334 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T21:59:47.334 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:59:47.374 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:59:47.376 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-09-13T21:59:47.431 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:47.432 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-09-13T21:59:47.433 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:47.433 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:47.433 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-09-13T21:59:47.433 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-13T21:59:47.478 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.dvnKyNvrvB 2024-09-13T21:59:47.478 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dvnKyNvrvB 2024-09-13T21:59:47.535 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.dvnKyNvrvB 2024-09-13T21:59:47.662 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.dvnKyNvrvB is 10KB 2024-09-13T21:59:47.673 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.dvnKyNvrvB 2024-09-13T21:59:47.678 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:47.733 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T21:59:47.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T21:59:47.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:47.799 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-09-13T21:59:47.800 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:47.802 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-13T21:59:47.819 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T21:59:47.820 DEBUG:teuthology.orchestra.run.smithi171:> sudo update-grub 2024-09-13T21:59:47.992 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:47.998 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:48.227 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:48.232 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:48.275 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:48.280 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:48.396 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:48.396 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:48.396 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:48.414 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-13T21:59:48.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-09-13T21:59:49.237 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2024-09-13T21:59:49.238 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:49.250 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-09-13T21:59:49.455 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:49.461 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:49.737 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:49.742 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:49.783 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:49.789 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:49.806 INFO:teuthology.orchestra.run.smithi007.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T21:59:49.806 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub' 2024-09-13T21:59:49.839 INFO:teuthology.orchestra.run.smithi007.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:49.861 INFO:teuthology.orchestra.run.smithi007.stdout:Generating grub configuration file ... 2024-09-13T21:59:49.928 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:49.928 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:49.928 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:49.938 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-09-13T21:59:49.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-09-13T21:59:50.203 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:50.232 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:50.670 INFO:teuthology.orchestra.run.smithi007.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:50.676 INFO:teuthology.orchestra.run.smithi007.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:50.848 INFO:teuthology.orchestra.run.smithi007.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:50.848 INFO:teuthology.orchestra.run.smithi007.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:50.848 INFO:teuthology.orchestra.run.smithi007.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:50.883 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-09-13T21:59:51.413 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-09-13T21:59:51.435 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-09-13T21:59:51.435 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-09-13T21:59:51.435 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 21 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-09-13T21:59:51.437 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T21:59:51.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T21:59:51.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T21:59:51.437 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T21:59:51.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T21:59:51.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2024-09-13T21:59:51.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-13T21:59:51.748 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T21:59:51.756 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T21:59:51.774 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T21:59:51.866 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T21:59:53.269 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T21:59:53.288 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T21:59:53.351 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T21:59:53.569 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-13T21:59:53.570 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-13T21:59:53.774 INFO:teuthology.orchestra.run.smithi007.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T21:59:53.774 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T21:59:53.774 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T21:59:53.774 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T21:59:53.774 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T21:59:53.775 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T21:59:53.775 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T21:59:53.775 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T21:59:53.821 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T21:59:53.823 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2024-09-13T21:59:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2024-09-13T21:59:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2024-09-13T21:59:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 21 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2024-09-13T21:59:53.841 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 5.15.0.121.121 2024-09-13T21:59:53.842 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T21:59:53.842 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T21:59:53.843 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2024-09-13T21:59:53.843 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2024-09-13T21:59:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2024-09-13T21:59:53.844 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2024-09-13T21:59:53.845 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-13T21:59:53.886 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.KUJg0TGMoM 2024-09-13T21:59:53.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KUJg0TGMoM 2024-09-13T21:59:53.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.KUJg0TGMoM 2024-09-13T21:59:54.070 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.KUJg0TGMoM is 10KB 2024-09-13T21:59:54.084 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.KUJg0TGMoM 2024-09-13T21:59:54.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:54.146 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T21:59:54.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T21:59:54.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T21:59:54.213 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T21:59:54.213 DEBUG:teuthology.orchestra.run.smithi007:> sudo update-grub 2024-09-13T21:59:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub' 2024-09-13T21:59:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T21:59:55.746 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-13T21:59:55.978 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T21:59:55.985 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T21:59:56.260 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T21:59:56.266 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T21:59:56.309 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T21:59:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T21:59:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T21:59:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T21:59:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T21:59:56.478 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-13T21:59:56.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-13T22:00:18.453 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T22:00:18.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T22:00:18.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:00:19.989 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-09-13T22:00:19.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:00:19.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:00:26.529 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T22:00:26.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:00:26.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:00:44.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-13T22:00:53.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:00:53.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:00:54.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-13T22:01:03.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:01:03.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:01:18.478 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:01:27.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T22:01:27.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:01:28.615 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-13T22:01:29.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T22:01:29.350 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-121-generic"... 2024-09-13T22:01:29.351 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-13T22:01:29.397 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-121-generic 2024-09-13T22:01:29.397 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T22:01:29.397 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:01:29.397 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T22:01:30.398 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T22:01:30.398 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:01:30.472 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-09-13T22:01:30.486 DEBUG:teuthology.parallel:result is None 2024-09-13T22:01:53.881 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:02:03.609 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:02:05.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:02:05.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:02:06.114 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T22:02:06.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:02:06.845 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-121-generic"... 2024-09-13T22:02:06.845 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T22:02:06.892 INFO:teuthology.orchestra.run.smithi007.stdout:5.15.0-121-generic 2024-09-13T22:02:06.892 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T22:02:06.892 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:02:06.893 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T22:02:07.894 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T22:02:07.894 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:02:07.971 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2024-09-13T22:02:07.990 DEBUG:teuthology.parallel:result is None 2024-09-13T22:02:15.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:02:15.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:02:15.986 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-13T22:02:16.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:02:16.609 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.15.0-121-generic"... 2024-09-13T22:02:16.609 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-13T22:02:16.655 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-121-generic 2024-09-13T22:02:16.656 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T22:02:16.656 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:02:16.656 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T22:02:17.657 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-09-13T22:02:17.657 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:02:18.031 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-09-13T22:02:18.065 DEBUG:teuthology.parallel:result is None 2024-09-13T22:02:18.066 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T22:02:18.072 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T22:02:18.072 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:02:18.075 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:02:18.078 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:02:18.084 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T22:02:18.203 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T22:02:18.210 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T22:02:18.210 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:02:18.213 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:02:18.215 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:02:18.318 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T22:02:18.324 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T22:02:18.325 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:02:18.327 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:02:18.329 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:02:18.345 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.349 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.352 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.353 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.358 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.359 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:02:18.361 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T22:02:18.368 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T22:02:18.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:02:18.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:02:18.408 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:02:18.424 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T22:02:18.434 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T22:02:18.435 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:02:18.466 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:02:18.469 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:02:18.474 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:02:18.517 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:02:18.565 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:02:18.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:02:18.631 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:02:18.637 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:02:18.685 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:02:18.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:02:18.754 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:02:18.760 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:02:18.808 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:02:18.808 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:02:18.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-13T22:02:18.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-13T22:02:18.881 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-13T22:02:18.948 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T22:02:18.956 INFO:teuthology.task.internal:Starting timer... 2024-09-13T22:02:18.956 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T22:02:18.967 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T22:02:18.975 DEBUG:teuthology.task.selinux:Excluding smithi007: OS 'ubuntu' does not support SELinux 2024-09-13T22:02:18.975 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-09-13T22:02:18.975 DEBUG:teuthology.task.selinux:Excluding smithi171: OS 'ubuntu' does not support SELinux 2024-09-13T22:02:18.976 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T22:02:18.976 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T22:02:18.976 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T22:02:18.976 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T22:02:18.984 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T22:02:18.997 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T22:02:18.998 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi131.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T22:09:56.205 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-13T22:09:56.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:09:56.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:09:56.305 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T22:09:56.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T22:09:56.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T22:09:56.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:09:56.477 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-13T22:09:56.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T22:09:56.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:09:56.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:09:56.661 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-13T22:09:56.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-13T22:09:56.738 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T22:09:56.749 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T22:09:56.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:09:56.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:09:56.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:09:56.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:09:56.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:09:56.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:09:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T22:09:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Command line: ntpd -gq 2024-09-13T22:09:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: ---------------------------------------------------- 2024-09-13T22:09:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T22:09:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T22:09:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: corporation. Support and training for ntp-4 are 2024-09-13T22:09:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: available at https://www.nwtime.org/support 2024-09-13T22:09:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: ---------------------------------------------------- 2024-09-13T22:09:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: proto: precision = 0.046 usec (-24) 2024-09-13T22:09:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: basedate set to 2022-02-04 2024-09-13T22:09:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: gps base set to 2022-02-06 (week 2196) 2024-09-13T22:09:56.782 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.782 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T22:09:56.782 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Command line: ntpd -gq 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: ---------------------------------------------------- 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: corporation. Support and training for ntp-4 are 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: available at https://www.nwtime.org/support 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: ---------------------------------------------------- 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: proto: precision = 0.046 usec (-24) 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: basedate set to 2022-02-04 2024-09-13T22:09:56.783 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: gps base set to 2022-02-06 (week 2196) 2024-09-13T22:09:56.784 INFO:teuthology.orchestra.run.smithi007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.785 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.785 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.785 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.786 INFO:teuthology.orchestra.run.smithi007.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T22:09:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen normally on 4 lo [::1]:123 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:09:56 ntpd[18512]: Listening on routing socket on fd #22 for interface updates 2024-09-13T22:09:56.789 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen normally on 3 ens1f0 172.21.15.7:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen normally on 4 lo [::1]:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15ea%3]:123 2024-09-13T22:09:56.790 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:09:56 ntpd[18409]: Listening on routing socket on fd #22 for interface updates 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Command line: ntpd -gq 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: ---------------------------------------------------- 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: corporation. Support and training for ntp-4 are 2024-09-13T22:09:56.810 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: available at https://www.nwtime.org/support 2024-09-13T22:09:56.811 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: ---------------------------------------------------- 2024-09-13T22:09:56.811 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: proto: precision = 0.045 usec (-24) 2024-09-13T22:09:56.811 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: basedate set to 2022-02-04 2024-09-13T22:09:56.811 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: gps base set to 2022-02-06 (week 2196) 2024-09-13T22:09:56.812 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.812 INFO:teuthology.orchestra.run.smithi171.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T22:09:56.812 INFO:teuthology.orchestra.run.smithi171.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen normally on 3 enp3s0f1 172.21.15.171:123 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen normally on 4 lo [::1]:123 2024-09-13T22:09:56.813 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f6d%5]:123 2024-09-13T22:09:56.814 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:09:56 ntpd[18480]: Listening on routing socket on fd #22 for interface updates 2024-09-13T22:09:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:57.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:57 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:57.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:57 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:58 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:59.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:59.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:09:59 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:09:59 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:09:59.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:09:59 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:00.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:00.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:00 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:00.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:00 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:01 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:01 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:01.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:01 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:02.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:02.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:02.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:02.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:02 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:02.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:02.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:02.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:02.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:02 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.781 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stdout:13 Sep 22:10:03 ntpd[18512]: ntpd: time slew -0.000782 s 2024-09-13T22:10:03.782 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew -0.000782s 2024-09-13T22:10:03.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T22:10:03.783 INFO:teuthology.orchestra.run.smithi131.stderr:13 Sep 22:10:03 ntpd[18512]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T22:10:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:03.784 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:03 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:03.811 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stdout:13 Sep 22:10:03 ntpd[18480]: ntpd: time slew -0.000034 s 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stdout:ntpd: time slew -0.000034s 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T22:10:03.812 INFO:teuthology.orchestra.run.smithi171.stderr:13 Sep 22:10:03 ntpd[18480]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T22:10:03.834 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T22:10:03.835 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-09-13T22:10:03.835 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.835 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.835 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.835 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.865 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T22:10:03.865 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-09-13T22:10:03.865 INFO:teuthology.orchestra.run.smithi171.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.865 INFO:teuthology.orchestra.run.smithi171.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.866 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:03.866 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T22:10:04.782 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 22:10:04 ntpd[18409]: ntpd: time slew -0.001698 s 2024-09-13T22:10:04.783 INFO:teuthology.orchestra.run.smithi007.stdout:ntpd: time slew -0.001698s 2024-09-13T22:10:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T22:10:04.783 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 22:10:04 ntpd[18409]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T22:10:04.830 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T22:10:04.830 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-09-13T22:10:04.831 INFO:teuthology.orchestra.run.smithi007.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:04.831 INFO:teuthology.orchestra.run.smithi007.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:04.831 INFO:teuthology.orchestra.run.smithi007.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:04.831 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T22:10:04.832 INFO:teuthology.run_tasks:Running task install... 2024-09-13T22:10:04.841 DEBUG:teuthology.task.install:project ceph 2024-09-13T22:10:04.841 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T22:10:04.841 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:10:04.841 INFO:teuthology.task.install:Using flavor: default 2024-09-13T22:10:04.847 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T22:10:04.847 INFO:teuthology.task.install:extra packages: [] 2024-09-13T22:10:04.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-key list | grep Ceph 2024-09-13T22:10:04.848 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-09-13T22:10:04.848 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-key list | grep Ceph 2024-09-13T22:10:04.912 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T22:10:04.916 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T22:10:04.930 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T22:10:04.938 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T22:10:04.938 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T22:10:04.939 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T22:10:04.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:10:04.953 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T22:10:04.953 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T22:10:04.953 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T22:10:04.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:10:04.965 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T22:10:04.968 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T22:10:04.968 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T22:10:04.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:10:05.101 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default/ 2024-09-13T22:10:05.101 INFO:teuthology.task.install.deb:Package version is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:05.113 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default/ 2024-09-13T22:10:05.113 INFO:teuthology.task.install.deb:Package version is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:05.124 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default/ 2024-09-13T22:10:05.124 INFO:teuthology.task.install.deb:Package version is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:05.259 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:10:05.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T22:10:05.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-09-13T22:10:05.275 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:10:05.276 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T22:10:05.285 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:10:05.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T22:10:05.290 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-13T22:10:05.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-13T22:10:05.460 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T22:10:05.471 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T22:10:05.488 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T22:10:05.526 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T22:10:05.546 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T22:10:05.547 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T22:10:05.549 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T22:10:05.569 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T22:10:05.570 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T22:10:05.570 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T22:10:05.570 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T22:10:05.571 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T22:10:05.583 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T22:10:05.591 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T22:10:05.592 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-13T22:10:05.597 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T22:10:05.597 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T22:10:05.598 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T22:10:05.612 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-13T22:10:05.620 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T22:10:05.620 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-13T22:10:05.641 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T22:10:05.642 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T22:10:05.648 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T22:10:05.669 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T22:10:05.723 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T22:10:05.751 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T22:10:05.823 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 29.0 kB in 0s (82.6 kB/s) 2024-09-13T22:10:05.940 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 29.0 kB in 0s (59.6 kB/s) 2024-09-13T22:10:05.961 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 29.0 kB in 0s (60.1 kB/s) 2024-09-13T22:10:06.795 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T22:10:06.810 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-324-gecab7be5-1jammy cephadm=19.1.1-324-gecab7be5-1jammy ceph-mds=19.1.1-324-gecab7be5-1jammy ceph-mgr=19.1.1-324-gecab7be5-1jammy ceph-common=19.1.1-324-gecab7be5-1jammy ceph-fuse=19.1.1-324-gecab7be5-1jammy ceph-test=19.1.1-324-gecab7be5-1jammy ceph-volume=19.1.1-324-gecab7be5-1jammy radosgw=19.1.1-324-gecab7be5-1jammy python3-rados=19.1.1-324-gecab7be5-1jammy python3-rgw=19.1.1-324-gecab7be5-1jammy python3-cephfs=19.1.1-324-gecab7be5-1jammy python3-rbd=19.1.1-324-gecab7be5-1jammy libcephfs2=19.1.1-324-gecab7be5-1jammy libcephfs-dev=19.1.1-324-gecab7be5-1jammy librados2=19.1.1-324-gecab7be5-1jammy librbd1=19.1.1-324-gecab7be5-1jammy rbd-fuse=19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:06.873 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-13T22:10:06.956 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T22:10:06.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-324-gecab7be5-1jammy cephadm=19.1.1-324-gecab7be5-1jammy ceph-mds=19.1.1-324-gecab7be5-1jammy ceph-mgr=19.1.1-324-gecab7be5-1jammy ceph-common=19.1.1-324-gecab7be5-1jammy ceph-fuse=19.1.1-324-gecab7be5-1jammy ceph-test=19.1.1-324-gecab7be5-1jammy ceph-volume=19.1.1-324-gecab7be5-1jammy radosgw=19.1.1-324-gecab7be5-1jammy python3-rados=19.1.1-324-gecab7be5-1jammy python3-rgw=19.1.1-324-gecab7be5-1jammy python3-cephfs=19.1.1-324-gecab7be5-1jammy python3-rbd=19.1.1-324-gecab7be5-1jammy libcephfs2=19.1.1-324-gecab7be5-1jammy libcephfs-dev=19.1.1-324-gecab7be5-1jammy librados2=19.1.1-324-gecab7be5-1jammy librbd1=19.1.1-324-gecab7be5-1jammy rbd-fuse=19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:06.991 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T22:10:07.009 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-324-gecab7be5-1jammy cephadm=19.1.1-324-gecab7be5-1jammy ceph-mds=19.1.1-324-gecab7be5-1jammy ceph-mgr=19.1.1-324-gecab7be5-1jammy ceph-common=19.1.1-324-gecab7be5-1jammy ceph-fuse=19.1.1-324-gecab7be5-1jammy ceph-test=19.1.1-324-gecab7be5-1jammy ceph-volume=19.1.1-324-gecab7be5-1jammy radosgw=19.1.1-324-gecab7be5-1jammy python3-rados=19.1.1-324-gecab7be5-1jammy python3-rgw=19.1.1-324-gecab7be5-1jammy python3-cephfs=19.1.1-324-gecab7be5-1jammy python3-rbd=19.1.1-324-gecab7be5-1jammy libcephfs2=19.1.1-324-gecab7be5-1jammy libcephfs-dev=19.1.1-324-gecab7be5-1jammy librados2=19.1.1-324-gecab7be5-1jammy librbd1=19.1.1-324-gecab7be5-1jammy rbd-fuse=19.1.1-324-gecab7be5-1jammy 2024-09-13T22:10:07.041 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T22:10:07.061 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-09-13T22:10:07.083 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-13T22:10:07.084 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-13T22:10:07.248 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-09-13T22:10:07.248 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-09-13T22:10:07.255 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-13T22:10:07.256 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-13T22:10:07.277 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T22:10:07.277 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T22:10:07.278 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T22:10:07.278 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T22:10:07.278 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T22:10:07.278 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T22:10:07.278 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T22:10:07.279 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-09-13T22:10:07.279 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T22:10:07.279 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T22:10:07.279 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T22:10:07.279 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T22:10:07.280 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T22:10:07.280 INFO:teuthology.orchestra.run.smithi171.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T22:10:07.281 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet zip 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T22:10:07.282 INFO:teuthology.orchestra.run.smithi171.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-09-13T22:10:07.283 INFO:teuthology.orchestra.run.smithi171.stdout: btrfs-tools 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T22:10:07.385 INFO:teuthology.orchestra.run.smithi171.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T22:10:07.386 INFO:teuthology.orchestra.run.smithi171.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T22:10:07.386 INFO:teuthology.orchestra.run.smithi171.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T22:10:07.386 INFO:teuthology.orchestra.run.smithi171.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T22:10:07.386 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T22:10:07.387 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T22:10:07.388 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T22:10:07.388 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T22:10:07.388 INFO:teuthology.orchestra.run.smithi171.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T22:10:07.434 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T22:10:07.434 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T22:10:07.434 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T22:10:07.434 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T22:10:07.434 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T22:10:07.435 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T22:10:07.435 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T22:10:07.435 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-09-13T22:10:07.435 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T22:10:07.435 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.437 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T22:10:07.438 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet zip 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-09-13T22:10:07.439 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-09-13T22:10:07.472 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T22:10:07.472 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T22:10:07.472 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T22:10:07.472 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T22:10:07.473 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T22:10:07.473 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T22:10:07.473 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T22:10:07.474 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-13T22:10:07.474 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T22:10:07.474 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T22:10:07.474 INFO:teuthology.orchestra.run.smithi007.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T22:10:07.474 INFO:teuthology.orchestra.run.smithi007.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T22:10:07.475 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T22:10:07.476 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet zip 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T22:10:07.477 INFO:teuthology.orchestra.run.smithi007.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-09-13T22:10:07.478 INFO:teuthology.orchestra.run.smithi007.stdout: btrfs-tools 2024-09-13T22:10:07.531 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T22:10:07.531 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 181 MB of archives. 2024-09-13T22:10:07.531 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T22:10:07.531 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-324-gecab7be5-1jammy [3,591 kB] 2024-09-13T22:10:07.542 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-09-13T22:10:07.542 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T22:10:07.542 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T22:10:07.542 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.544 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T22:10:07.545 INFO:teuthology.orchestra.run.smithi131.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T22:10:07.575 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T22:10:07.587 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-13T22:10:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T22:10:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T22:10:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T22:10:07.589 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T22:10:07.590 INFO:teuthology.orchestra.run.smithi007.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T22:10:07.605 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T22:10:07.605 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 181 MB of archives. 2024-09-13T22:10:07.605 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T22:10:07.605 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T22:10:07.652 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T22:10:07.652 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 181 MB of archives. 2024-09-13T22:10:07.652 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T22:10:07.652 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T22:10:07.689 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-324-gecab7be5-1jammy [3,591 kB] 2024-09-13T22:10:07.693 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T22:10:07.696 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T22:10:07.711 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-324-gecab7be5-1jammy [3,241 kB] 2024-09-13T22:10:07.713 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T22:10:07.741 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T22:10:07.744 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T22:10:07.758 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-324-gecab7be5-1jammy [718 kB] 2024-09-13T22:10:07.761 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T22:10:07.769 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-324-gecab7be5-1jammy [356 kB] 2024-09-13T22:10:07.772 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T22:10:07.775 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-324-gecab7be5-1jammy [32.8 kB] 2024-09-13T22:10:07.776 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-324-gecab7be5-1jammy [180 kB] 2024-09-13T22:10:07.776 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T22:10:07.778 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-324-gecab7be5-1jammy [67.8 kB] 2024-09-13T22:10:07.779 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-324-gecab7be5-1jammy [333 kB] 2024-09-13T22:10:07.781 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-324-gecab7be5-1jammy [3,591 kB] 2024-09-13T22:10:07.787 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-324-gecab7be5-1jammy [6,875 kB] 2024-09-13T22:10:07.789 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T22:10:07.793 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T22:10:07.793 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T22:10:07.794 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T22:10:07.803 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T22:10:07.805 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T22:10:07.807 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T22:10:07.808 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T22:10:07.810 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T22:10:07.812 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T22:10:07.822 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T22:10:07.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T22:10:07.827 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T22:10:07.828 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T22:10:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T22:10:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T22:10:07.830 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T22:10:07.831 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T22:10:07.831 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T22:10:07.831 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T22:10:07.839 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T22:10:07.844 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T22:10:07.844 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T22:10:07.845 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T22:10:07.853 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T22:10:07.853 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T22:10:07.854 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T22:10:07.856 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T22:10:07.858 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T22:10:07.860 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T22:10:07.861 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T22:10:07.864 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T22:10:07.870 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T22:10:07.875 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T22:10:07.876 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T22:10:07.877 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T22:10:07.878 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T22:10:07.878 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T22:10:07.879 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T22:10:07.880 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T22:10:07.880 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T22:10:07.881 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T22:10:07.881 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T22:10:07.881 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T22:10:07.883 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T22:10:07.883 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T22:10:07.883 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T22:10:07.883 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T22:10:07.888 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T22:10:07.889 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T22:10:07.896 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T22:10:07.896 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T22:10:07.905 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T22:10:07.909 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-324-gecab7be5-1jammy [112 kB] 2024-09-13T22:10:07.911 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-324-gecab7be5-1jammy [472 kB] 2024-09-13T22:10:07.913 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T22:10:07.915 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T22:10:07.915 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T22:10:07.916 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T22:10:07.916 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T22:10:07.917 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-324-gecab7be5-1jammy [25.9 MB] 2024-09-13T22:10:07.917 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T22:10:07.918 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T22:10:07.918 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T22:10:07.918 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T22:10:07.919 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T22:10:07.919 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T22:10:07.919 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T22:10:07.920 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T22:10:07.923 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T22:10:07.924 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T22:10:07.927 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T22:10:07.928 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T22:10:07.931 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T22:10:07.932 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T22:10:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T22:10:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T22:10:07.942 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T22:10:07.946 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T22:10:07.948 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T22:10:07.956 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T22:10:07.956 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T22:10:07.956 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T22:10:07.956 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T22:10:07.957 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T22:10:07.959 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T22:10:07.960 INFO:teuthology.orchestra.run.smithi007.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T22:10:07.966 INFO:teuthology.orchestra.run.smithi007.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T22:10:07.967 INFO:teuthology.orchestra.run.smithi007.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T22:10:07.983 INFO:teuthology.orchestra.run.smithi007.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T22:10:07.984 INFO:teuthology.orchestra.run.smithi007.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T22:10:07.985 INFO:teuthology.orchestra.run.smithi007.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T22:10:07.987 INFO:teuthology.orchestra.run.smithi007.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T22:10:07.996 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T22:10:08.008 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T22:10:08.013 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T22:10:08.014 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T22:10:08.015 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T22:10:08.015 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T22:10:08.016 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T22:10:08.034 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T22:10:08.035 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T22:10:08.035 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T22:10:08.042 INFO:teuthology.orchestra.run.smithi007.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T22:10:08.043 INFO:teuthology.orchestra.run.smithi007.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T22:10:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T22:10:08.044 INFO:teuthology.orchestra.run.smithi007.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T22:10:08.045 INFO:teuthology.orchestra.run.smithi007.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T22:10:08.050 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T22:10:08.050 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T22:10:08.050 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T22:10:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T22:10:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T22:10:08.052 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T22:10:08.063 INFO:teuthology.orchestra.run.smithi007.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T22:10:08.065 INFO:teuthology.orchestra.run.smithi007.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T22:10:08.065 INFO:teuthology.orchestra.run.smithi007.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T22:10:08.066 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T22:10:08.067 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T22:10:08.070 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T22:10:08.080 INFO:teuthology.orchestra.run.smithi007.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T22:10:08.080 INFO:teuthology.orchestra.run.smithi007.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T22:10:08.081 INFO:teuthology.orchestra.run.smithi007.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T22:10:08.081 INFO:teuthology.orchestra.run.smithi007.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T22:10:08.082 INFO:teuthology.orchestra.run.smithi007.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T22:10:08.082 INFO:teuthology.orchestra.run.smithi007.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T22:10:08.083 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T22:10:08.085 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T22:10:08.085 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T22:10:08.088 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T22:10:08.090 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T22:10:08.090 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T22:10:08.091 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T22:10:08.091 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T22:10:08.095 INFO:teuthology.orchestra.run.smithi007.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T22:10:08.096 INFO:teuthology.orchestra.run.smithi007.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T22:10:08.099 INFO:teuthology.orchestra.run.smithi007.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T22:10:08.103 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T22:10:08.103 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T22:10:08.106 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T22:10:08.113 INFO:teuthology.orchestra.run.smithi007.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T22:10:08.114 INFO:teuthology.orchestra.run.smithi007.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T22:10:08.114 INFO:teuthology.orchestra.run.smithi007.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T22:10:08.118 INFO:teuthology.orchestra.run.smithi007.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T22:10:08.120 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T22:10:08.120 INFO:teuthology.orchestra.run.smithi007.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T22:10:08.121 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T22:10:08.121 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T22:10:08.121 INFO:teuthology.orchestra.run.smithi007.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T22:10:08.121 INFO:teuthology.orchestra.run.smithi007.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T22:10:08.122 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T22:10:08.123 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T22:10:08.129 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T22:10:08.129 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T22:10:08.130 INFO:teuthology.orchestra.run.smithi007.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T22:10:08.131 INFO:teuthology.orchestra.run.smithi007.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T22:10:08.134 INFO:teuthology.orchestra.run.smithi007.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T22:10:08.137 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T22:10:08.139 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T22:10:08.139 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T22:10:08.148 INFO:teuthology.orchestra.run.smithi007.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T22:10:08.149 INFO:teuthology.orchestra.run.smithi007.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T22:10:08.149 INFO:teuthology.orchestra.run.smithi007.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T22:10:08.150 INFO:teuthology.orchestra.run.smithi007.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T22:10:08.151 INFO:teuthology.orchestra.run.smithi007.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T22:10:08.157 INFO:teuthology.orchestra.run.smithi007.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T22:10:08.157 INFO:teuthology.orchestra.run.smithi007.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T22:10:08.166 INFO:teuthology.orchestra.run.smithi007.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T22:10:08.168 INFO:teuthology.orchestra.run.smithi007.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T22:10:08.168 INFO:teuthology.orchestra.run.smithi007.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T22:10:08.319 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T22:10:08.330 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T22:10:08.360 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T22:10:08.368 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T22:10:08.369 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T22:10:08.370 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T22:10:08.389 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T22:10:08.393 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T22:10:08.461 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T22:10:08.525 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T22:10:08.525 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-324-gecab7be5-1jammy [5,145 kB] 2024-09-13T22:10:08.525 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T22:10:08.530 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T22:10:08.534 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T22:10:08.537 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T22:10:08.539 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T22:10:08.539 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T22:10:08.542 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T22:10:08.545 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-324-gecab7be5-1jammy [3,241 kB] 2024-09-13T22:10:08.595 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-324-gecab7be5-1jammy [245 kB] 2024-09-13T22:10:08.597 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-324-gecab7be5-1jammy [124 kB] 2024-09-13T22:10:08.598 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-324-gecab7be5-1jammy [1,555 kB] 2024-09-13T22:10:08.607 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T22:10:08.613 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-324-gecab7be5-1jammy [6,143 kB] 2024-09-13T22:10:08.624 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T22:10:08.625 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T22:10:08.625 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T22:10:08.626 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T22:10:08.627 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T22:10:08.632 INFO:teuthology.orchestra.run.smithi171.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T22:10:08.633 INFO:teuthology.orchestra.run.smithi171.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T22:10:08.677 INFO:teuthology.orchestra.run.smithi007.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-324-gecab7be5-1jammy [3,241 kB] 2024-09-13T22:10:08.689 INFO:teuthology.orchestra.run.smithi171.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T22:10:08.690 INFO:teuthology.orchestra.run.smithi171.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T22:10:08.732 INFO:teuthology.orchestra.run.smithi171.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-324-gecab7be5-1jammy [22.8 MB] 2024-09-13T22:10:08.770 INFO:teuthology.orchestra.run.smithi171.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T22:10:08.770 INFO:teuthology.orchestra.run.smithi171.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T22:10:08.771 INFO:teuthology.orchestra.run.smithi171.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T22:10:08.774 INFO:teuthology.orchestra.run.smithi171.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T22:10:08.775 INFO:teuthology.orchestra.run.smithi171.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T22:10:08.776 INFO:teuthology.orchestra.run.smithi171.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T22:10:08.787 INFO:teuthology.orchestra.run.smithi171.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T22:10:08.851 INFO:teuthology.orchestra.run.smithi171.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T22:10:08.852 INFO:teuthology.orchestra.run.smithi171.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T22:10:08.853 INFO:teuthology.orchestra.run.smithi171.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T22:10:08.933 INFO:teuthology.orchestra.run.smithi171.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T22:10:08.937 INFO:teuthology.orchestra.run.smithi171.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T22:10:08.939 INFO:teuthology.orchestra.run.smithi171.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T22:10:08.942 INFO:teuthology.orchestra.run.smithi171.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T22:10:08.943 INFO:teuthology.orchestra.run.smithi171.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T22:10:08.948 INFO:teuthology.orchestra.run.smithi171.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T22:10:08.949 INFO:teuthology.orchestra.run.smithi171.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T22:10:08.959 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-324-gecab7be5-1jammy [718 kB] 2024-09-13T22:10:09.014 INFO:teuthology.orchestra.run.smithi171.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T22:10:09.019 INFO:teuthology.orchestra.run.smithi171.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T22:10:09.052 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-324-gecab7be5-1jammy [356 kB] 2024-09-13T22:10:09.091 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-324-gecab7be5-1jammy [32.8 kB] 2024-09-13T22:10:09.114 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-324-gecab7be5-1jammy [180 kB] 2024-09-13T22:10:09.125 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-324-gecab7be5-1jammy [67.8 kB] 2024-09-13T22:10:09.149 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-324-gecab7be5-1jammy [333 kB] 2024-09-13T22:10:09.181 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-324-gecab7be5-1jammy [6,875 kB] 2024-09-13T22:10:09.182 INFO:teuthology.orchestra.run.smithi171.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T22:10:09.184 INFO:teuthology.orchestra.run.smithi171.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T22:10:09.187 INFO:teuthology.orchestra.run.smithi171.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T22:10:09.187 INFO:teuthology.orchestra.run.smithi171.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T22:10:09.189 INFO:teuthology.orchestra.run.smithi171.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T22:10:09.191 INFO:teuthology.orchestra.run.smithi007.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-324-gecab7be5-1jammy [718 kB] 2024-09-13T22:10:09.297 INFO:teuthology.orchestra.run.smithi007.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-324-gecab7be5-1jammy [356 kB] 2024-09-13T22:10:09.310 INFO:teuthology.orchestra.run.smithi171.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T22:10:09.311 INFO:teuthology.orchestra.run.smithi171.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-324-gecab7be5-1jammy [14.1 kB] 2024-09-13T22:10:09.312 INFO:teuthology.orchestra.run.smithi171.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-324-gecab7be5-1jammy [877 kB] 2024-09-13T22:10:09.313 INFO:teuthology.orchestra.run.smithi171.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T22:10:09.314 INFO:teuthology.orchestra.run.smithi171.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T22:10:09.316 INFO:teuthology.orchestra.run.smithi007.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-324-gecab7be5-1jammy [32.8 kB] 2024-09-13T22:10:09.318 INFO:teuthology.orchestra.run.smithi007.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-324-gecab7be5-1jammy [180 kB] 2024-09-13T22:10:09.322 INFO:teuthology.orchestra.run.smithi007.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-324-gecab7be5-1jammy [67.8 kB] 2024-09-13T22:10:09.323 INFO:teuthology.orchestra.run.smithi007.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-324-gecab7be5-1jammy [333 kB] 2024-09-13T22:10:09.325 INFO:teuthology.orchestra.run.smithi171.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-324-gecab7be5-1jammy [2,462 kB] 2024-09-13T22:10:09.339 INFO:teuthology.orchestra.run.smithi171.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T22:10:09.339 INFO:teuthology.orchestra.run.smithi171.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T22:10:09.343 INFO:teuthology.orchestra.run.smithi007.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-324-gecab7be5-1jammy [6,875 kB] 2024-09-13T22:10:09.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-324-gecab7be5-1jammy [794 kB] 2024-09-13T22:10:09.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T22:10:09.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T22:10:09.415 INFO:teuthology.orchestra.run.smithi171.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T22:10:09.416 INFO:teuthology.orchestra.run.smithi171.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T22:10:09.424 INFO:teuthology.orchestra.run.smithi171.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-324-gecab7be5-1jammy [152 kB] 2024-09-13T22:10:09.426 INFO:teuthology.orchestra.run.smithi171.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-324-gecab7be5-1jammy [2,275 kB] 2024-09-13T22:10:09.431 INFO:teuthology.orchestra.run.smithi171.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T22:10:09.432 INFO:teuthology.orchestra.run.smithi171.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T22:10:09.438 INFO:teuthology.orchestra.run.smithi171.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T22:10:09.440 INFO:teuthology.orchestra.run.smithi171.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T22:10:09.453 INFO:teuthology.orchestra.run.smithi171.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-324-gecab7be5-1jammy [8,625 kB] 2024-09-13T22:10:09.513 INFO:teuthology.orchestra.run.smithi171.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T22:10:09.514 INFO:teuthology.orchestra.run.smithi171.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T22:10:09.523 INFO:teuthology.orchestra.run.smithi171.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T22:10:09.530 INFO:teuthology.orchestra.run.smithi171.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T22:10:09.533 INFO:teuthology.orchestra.run.smithi171.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T22:10:09.534 INFO:teuthology.orchestra.run.smithi171.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T22:10:09.595 INFO:teuthology.orchestra.run.smithi171.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T22:10:09.596 INFO:teuthology.orchestra.run.smithi171.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T22:10:09.604 INFO:teuthology.orchestra.run.smithi171.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T22:10:09.605 INFO:teuthology.orchestra.run.smithi171.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T22:10:09.647 INFO:teuthology.orchestra.run.smithi171.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-324-gecab7be5-1jammy [14.2 kB] 2024-09-13T22:10:09.647 INFO:teuthology.orchestra.run.smithi171.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-324-gecab7be5-1jammy [51.4 MB] 2024-09-13T22:10:09.663 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-324-gecab7be5-1jammy [112 kB] 2024-09-13T22:10:09.665 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-324-gecab7be5-1jammy [472 kB] 2024-09-13T22:10:09.676 INFO:teuthology.orchestra.run.smithi171.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T22:10:09.677 INFO:teuthology.orchestra.run.smithi171.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T22:10:09.681 INFO:teuthology.orchestra.run.smithi171.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T22:10:09.684 INFO:teuthology.orchestra.run.smithi171.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T22:10:09.701 INFO:teuthology.orchestra.run.smithi171.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T22:10:09.702 INFO:teuthology.orchestra.run.smithi171.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T22:10:09.728 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-324-gecab7be5-1jammy [25.9 MB] 2024-09-13T22:10:09.758 INFO:teuthology.orchestra.run.smithi171.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T22:10:09.763 INFO:teuthology.orchestra.run.smithi171.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T22:10:09.765 INFO:teuthology.orchestra.run.smithi171.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T22:10:10.005 INFO:teuthology.orchestra.run.smithi007.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-324-gecab7be5-1jammy [112 kB] 2024-09-13T22:10:10.008 INFO:teuthology.orchestra.run.smithi007.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-324-gecab7be5-1jammy [472 kB] 2024-09-13T22:10:10.022 INFO:teuthology.orchestra.run.smithi007.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-324-gecab7be5-1jammy [25.9 MB] 2024-09-13T22:10:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-324-gecab7be5-1jammy [130 kB] 2024-09-13T22:10:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-324-gecab7be5-1jammy [39.0 kB] 2024-09-13T22:10:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-324-gecab7be5-1jammy [13.6 MB] 2024-09-13T22:10:11.419 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-324-gecab7be5-1jammy [5,145 kB] 2024-09-13T22:10:11.610 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-324-gecab7be5-1jammy [245 kB] 2024-09-13T22:10:11.655 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-324-gecab7be5-1jammy [124 kB] 2024-09-13T22:10:11.658 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-324-gecab7be5-1jammy [1,555 kB] 2024-09-13T22:10:11.731 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-324-gecab7be5-1jammy [6,143 kB] 2024-09-13T22:10:11.739 INFO:teuthology.orchestra.run.smithi171.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-324-gecab7be5-1jammy [91.7 kB] 2024-09-13T22:10:11.896 INFO:teuthology.orchestra.run.smithi007.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-324-gecab7be5-1jammy [5,145 kB] 2024-09-13T22:10:11.904 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-324-gecab7be5-1jammy [22.8 MB] 2024-09-13T22:10:12.030 INFO:teuthology.orchestra.run.smithi007.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-324-gecab7be5-1jammy [245 kB] 2024-09-13T22:10:12.046 INFO:teuthology.orchestra.run.smithi007.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-324-gecab7be5-1jammy [124 kB] 2024-09-13T22:10:12.049 INFO:teuthology.orchestra.run.smithi007.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-324-gecab7be5-1jammy [1,555 kB] 2024-09-13T22:10:12.105 INFO:teuthology.orchestra.run.smithi007.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-324-gecab7be5-1jammy [6,143 kB] 2024-09-13T22:10:12.310 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 181 MB in 4s (41.6 MB/s) 2024-09-13T22:10:12.330 INFO:teuthology.orchestra.run.smithi007.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-324-gecab7be5-1jammy [22.8 MB] 2024-09-13T22:10:12.475 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T22:10:12.576 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T22:10:12.581 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T22:10:12.665 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:10:12.667 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-324-gecab7be5-1jammy [14.1 kB] 2024-09-13T22:10:12.667 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-324-gecab7be5-1jammy [877 kB] 2024-09-13T22:10:12.684 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-324-gecab7be5-1jammy [2,462 kB] 2024-09-13T22:10:12.727 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-324-gecab7be5-1jammy [794 kB] 2024-09-13T22:10:12.740 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-324-gecab7be5-1jammy [152 kB] 2024-09-13T22:10:12.743 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-324-gecab7be5-1jammy [2,275 kB] 2024-09-13T22:10:12.809 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-324-gecab7be5-1jammy [8,625 kB] 2024-09-13T22:10:13.011 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T22:10:13.036 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T22:10:13.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-324-gecab7be5-1jammy [14.2 kB] 2024-09-13T22:10:13.064 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-324-gecab7be5-1jammy [51.4 MB] 2024-09-13T22:10:13.077 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:10:13.239 INFO:teuthology.orchestra.run.smithi007.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-324-gecab7be5-1jammy [14.1 kB] 2024-09-13T22:10:13.240 INFO:teuthology.orchestra.run.smithi007.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-324-gecab7be5-1jammy [877 kB] 2024-09-13T22:10:13.257 INFO:teuthology.orchestra.run.smithi007.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-324-gecab7be5-1jammy [2,462 kB] 2024-09-13T22:10:13.300 INFO:teuthology.orchestra.run.smithi007.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-324-gecab7be5-1jammy [794 kB] 2024-09-13T22:10:13.317 INFO:teuthology.orchestra.run.smithi007.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-324-gecab7be5-1jammy [152 kB] 2024-09-13T22:10:13.320 INFO:teuthology.orchestra.run.smithi007.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-324-gecab7be5-1jammy [2,275 kB] 2024-09-13T22:10:13.406 INFO:teuthology.orchestra.run.smithi007.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-324-gecab7be5-1jammy [8,625 kB] 2024-09-13T22:10:13.455 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T22:10:13.481 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T22:10:13.513 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:10:13.729 INFO:teuthology.orchestra.run.smithi007.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-324-gecab7be5-1jammy [14.2 kB] 2024-09-13T22:10:13.729 INFO:teuthology.orchestra.run.smithi007.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-324-gecab7be5-1jammy [51.4 MB] 2024-09-13T22:10:14.134 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T22:10:14.160 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:14.208 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:14.629 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T22:10:14.657 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:14.695 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:14.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-324-gecab7be5-1jammy [130 kB] 2024-09-13T22:10:14.828 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-324-gecab7be5-1jammy [39.0 kB] 2024-09-13T22:10:14.829 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-324-gecab7be5-1jammy [13.6 MB] 2024-09-13T22:10:14.998 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T22:10:15.025 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:15.057 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:15.205 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-324-gecab7be5-1jammy [91.7 kB] 2024-09-13T22:10:15.393 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T22:10:15.419 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T22:10:15.459 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:10:15.777 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 181 MB in 8s (23.6 MB/s) 2024-09-13T22:10:15.787 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librados2. 2024-09-13T22:10:15.814 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../007-librados2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:15.819 INFO:teuthology.orchestra.run.smithi007.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-324-gecab7be5-1jammy [130 kB] 2024-09-13T22:10:15.821 INFO:teuthology.orchestra.run.smithi007.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-324-gecab7be5-1jammy [39.0 kB] 2024-09-13T22:10:15.823 INFO:teuthology.orchestra.run.smithi007.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-324-gecab7be5-1jammy [13.6 MB] 2024-09-13T22:10:15.854 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:15.941 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T22:10:16.039 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T22:10:16.044 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T22:10:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:10:16.282 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librbd1. 2024-09-13T22:10:16.308 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../008-librbd1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:16.326 INFO:teuthology.orchestra.run.smithi007.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-324-gecab7be5-1jammy [91.7 kB] 2024-09-13T22:10:16.348 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:16.458 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T22:10:16.484 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T22:10:16.524 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:10:16.801 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T22:10:16.827 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:16.827 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T22:10:16.842 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T22:10:16.859 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:16.877 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:10:16.924 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 181 MB in 9s (20.7 MB/s) 2024-09-13T22:10:17.083 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T22:10:17.112 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rados. 2024-09-13T22:10:17.127 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../010-python3-rados_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:17.170 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:17.183 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T22:10:17.189 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T22:10:17.273 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:10:17.298 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T22:10:17.324 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:17.373 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:17.506 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T22:10:17.532 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:17.573 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:17.594 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T22:10:17.620 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T22:10:17.660 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:10:17.776 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T22:10:17.802 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:17.843 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:17.850 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T22:10:17.865 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:17.908 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:17.955 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T22:10:17.972 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T22:10:18.005 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:10:18.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T22:10:18.189 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:18.203 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T22:10:18.229 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:18.229 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:18.261 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:18.434 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T22:10:18.461 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:18.508 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:18.539 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T22:10:18.565 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T22:10:18.566 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T22:10:18.592 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T22:10:18.597 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:10:18.633 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:10:18.917 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T22:10:18.943 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T22:10:18.954 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T22:10:18.969 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-09-13T22:10:18.980 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:18.983 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T22:10:18.995 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-librados2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:19.020 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:19.052 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:19.228 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T22:10:19.255 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:19.295 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:19.307 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T22:10:19.334 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T22:10:19.373 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:10:19.472 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-09-13T22:10:19.498 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-librbd1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:19.530 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:19.631 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T22:10:19.657 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T22:10:19.697 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:10:19.718 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T22:10:19.734 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T22:10:19.776 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:10:19.975 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T22:10:19.983 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T22:10:19.999 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T22:10:20.001 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:20.041 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:10:20.045 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:20.113 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librados2. 2024-09-13T22:10:20.140 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../007-librados2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:20.179 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:20.319 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-09-13T22:10:20.343 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-python3-rados_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:20.344 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T22:10:20.370 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T22:10:20.385 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:20.411 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:10:20.566 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librbd1. 2024-09-13T22:10:20.582 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../008-librbd1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:20.616 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:20.689 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T22:10:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:20.722 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua5.1. 2024-09-13T22:10:20.747 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:20.749 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T22:10:20.789 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:10:20.958 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T22:10:20.973 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:21.016 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:21.043 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T22:10:21.070 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:21.100 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-any. 2024-09-13T22:10:21.119 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:21.127 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T22:10:21.167 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T22:10:21.336 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T22:10:21.362 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:21.402 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:21.404 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rados. 2024-09-13T22:10:21.419 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package zip. 2024-09-13T22:10:21.432 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../010-python3-rados_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:21.434 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T22:10:21.471 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:21.486 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T22:10:21.731 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T22:10:21.757 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T22:10:21.757 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T22:10:21.773 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:21.798 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package unzip. 2024-09-13T22:10:21.798 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:10:21.807 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:21.824 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T22:10:21.864 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:10:22.026 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T22:10:22.053 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:22.092 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T22:10:22.093 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:22.118 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T22:10:22.159 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T22:10:22.268 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package luarocks. 2024-09-13T22:10:22.295 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T22:10:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:10:22.386 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T22:10:22.413 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:22.438 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T22:10:22.453 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:22.465 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:22.504 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:22.720 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librgw2. 2024-09-13T22:10:22.744 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../025-librgw2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:22.781 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T22:10:22.783 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:22.808 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T22:10:22.832 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T22:10:22.848 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:10:22.859 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T22:10:22.899 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:10:23.151 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T22:10:23.169 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T22:10:23.177 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T22:10:23.196 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T22:10:23.217 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:10:23.237 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T22:10:23.498 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T22:10:23.514 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:23.520 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T22:10:23.535 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T22:10:23.556 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:23.604 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:10:23.620 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T22:10:23.646 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:23.695 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:23.891 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-09-13T22:10:23.901 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T22:10:23.917 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T22:10:23.928 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T22:10:23.949 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:10:23.964 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T22:10:23.967 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:10:23.991 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T22:10:24.022 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:10:24.228 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T22:10:24.244 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T22:10:24.269 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-09-13T22:10:24.278 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:10:24.284 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T22:10:24.325 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T22:10:24.327 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T22:10:24.352 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:24.392 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:24.580 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-09-13T22:10:24.595 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T22:10:24.598 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T22:10:24.625 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T22:10:24.638 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T22:10:24.664 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:10:24.829 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-common. 2024-09-13T22:10:24.855 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../029-ceph-common_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:24.895 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:24.917 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-09-13T22:10:24.943 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T22:10:24.975 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:10:25.082 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua5.1. 2024-09-13T22:10:25.109 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T22:10:25.251 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:10:25.371 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-09-13T22:10:25.397 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T22:10:25.437 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:10:25.562 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-any. 2024-09-13T22:10:25.578 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T22:10:25.612 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T22:10:25.804 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-09-13T22:10:25.830 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-librgw2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:25.831 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package zip. 2024-09-13T22:10:25.847 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T22:10:25.870 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:25.890 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T22:10:26.184 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package unzip. 2024-09-13T22:10:26.211 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T22:10:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-base. 2024-09-13T22:10:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../030-ceph-base_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:26.276 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:10:26.284 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:26.408 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T22:10:26.424 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:26.467 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:26.671 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package luarocks. 2024-09-13T22:10:26.699 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T22:10:26.738 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:10:26.811 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T22:10:26.813 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T22:10:26.828 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T22:10:26.838 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T22:10:26.863 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:10:26.878 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:10:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librgw2. 2024-09-13T22:10:27.148 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../025-librgw2_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:27.149 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T22:10:27.176 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T22:10:27.187 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:27.216 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:10:27.223 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T22:10:27.249 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:27.289 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:27.535 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T22:10:27.561 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T22:10:27.611 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:10:27.626 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-09-13T22:10:27.653 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-ceph-common_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:27.701 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:27.714 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T22:10:27.731 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:27.764 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:27.897 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T22:10:27.923 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T22:10:27.963 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:10:28.101 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T22:10:28.128 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T22:10:28.167 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:10:28.249 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T22:10:28.275 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T22:10:28.316 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:10:28.478 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T22:10:28.505 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:28.545 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:28.619 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T22:10:28.645 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T22:10:28.685 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T22:10:28.915 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-common. 2024-09-13T22:10:28.942 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../029-ceph-common_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:28.947 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-portend. 2024-09-13T22:10:28.973 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:28.973 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T22:10:29.005 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T22:10:29.207 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-09-13T22:10:29.253 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-ceph-base_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:29.291 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:29.307 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T22:10:29.334 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T22:10:29.374 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T22:10:29.677 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T22:10:29.703 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T22:10:29.743 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:10:29.853 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T22:10:29.879 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T22:10:29.920 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:10:30.089 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T22:10:30.115 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T22:10:30.155 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T22:10:30.189 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T22:10:30.215 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T22:10:30.247 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:10:30.467 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T22:10:30.493 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T22:10:30.509 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T22:10:30.533 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T22:10:30.535 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T22:10:30.576 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:10:30.703 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-base. 2024-09-13T22:10:30.730 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../030-ceph-base_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:30.780 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:30.853 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T22:10:30.862 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T22:10:30.879 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T22:10:30.888 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T22:10:30.919 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:10:30.928 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:10:31.205 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-mako. 2024-09-13T22:10:31.221 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T22:10:31.253 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T22:10:31.256 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:10:31.279 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T22:10:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:10:31.324 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T22:10:31.351 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T22:10:31.390 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:10:31.542 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T22:10:31.557 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T22:10:31.576 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T22:10:31.592 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:10:31.603 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T22:10:31.634 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T22:10:31.676 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T22:10:31.703 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T22:10:31.743 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:10:31.887 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T22:10:31.913 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T22:10:31.938 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-09-13T22:10:31.953 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:10:31.964 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T22:10:32.004 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T22:10:32.071 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T22:10:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T22:10:32.138 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:10:32.264 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webob. 2024-09-13T22:10:32.291 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T22:10:32.299 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T22:10:32.325 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T22:10:32.331 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:10:32.365 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T22:10:32.390 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T22:10:32.417 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T22:10:32.457 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:10:32.627 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T22:10:32.650 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T22:10:32.650 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T22:10:32.677 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T22:10:32.693 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:10:32.720 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:10:32.760 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T22:10:32.786 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T22:10:32.826 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:10:33.011 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T22:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T22:10:33.039 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T22:10:33.065 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T22:10:33.078 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:10:33.105 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T22:10:33.112 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T22:10:33.139 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T22:10:33.179 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T22:10:33.356 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-paste. 2024-09-13T22:10:33.382 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T22:10:33.401 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T22:10:33.423 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:10:33.427 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T22:10:33.448 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-portend. 2024-09-13T22:10:33.459 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T22:10:33.464 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T22:10:33.498 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T22:10:33.737 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T22:10:33.763 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T22:10:33.776 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T22:10:33.796 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T22:10:33.803 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T22:10:33.803 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:10:33.823 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T22:10:33.842 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T22:10:34.067 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:10:34.106 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-09-13T22:10:34.133 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T22:10:34.173 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:10:34.179 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T22:10:34.206 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T22:10:34.245 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:10:34.328 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T22:10:34.343 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T22:10:34.378 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:10:34.510 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T22:10:34.537 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T22:10:34.549 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T22:10:34.565 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T22:10:34.576 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:10:34.599 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T22:10:34.665 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T22:10:34.691 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T22:10:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T22:10:34.871 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T22:10:34.894 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T22:10:34.897 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T22:10:34.920 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T22:10:34.937 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:10:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T22:10:35.068 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T22:10:35.094 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T22:10:35.134 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:10:35.263 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T22:10:35.266 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-09-13T22:10:35.290 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T22:10:35.293 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T22:10:35.338 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:10:35.357 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:10:35.497 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T22:10:35.524 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T22:10:35.564 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T22:10:35.649 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-mako. 2024-09-13T22:10:35.676 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T22:10:35.715 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:10:35.719 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T22:10:35.745 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T22:10:35.789 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:10:35.892 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-idna. 2024-09-13T22:10:35.918 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T22:10:35.958 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:10:36.044 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T22:10:36.060 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T22:10:36.097 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T22:10:36.102 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:10:36.123 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T22:10:36.163 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:10:36.220 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T22:10:36.246 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T22:10:36.278 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:10:36.380 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T22:10:36.407 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T22:10:36.446 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:10:36.475 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-09-13T22:10:36.502 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T22:10:36.542 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:10:36.547 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests. 2024-09-13T22:10:36.560 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T22:10:36.589 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:10:36.741 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webob. 2024-09-13T22:10:36.768 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T22:10:36.807 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:10:36.842 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T22:10:36.869 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T22:10:36.870 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T22:10:36.897 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T22:10:36.900 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:10:36.936 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:10:37.152 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T22:10:37.170 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T22:10:37.179 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T22:10:37.196 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:37.222 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:10:37.236 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:37.239 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T22:10:37.267 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T22:10:37.306 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:10:37.530 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T22:10:37.551 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T22:10:37.557 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T22:10:37.567 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T22:10:37.591 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T22:10:37.596 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:10:37.601 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T22:10:37.618 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:37.658 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:37.871 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T22:10:37.898 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T22:10:37.899 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-paste. 2024-09-13T22:10:37.926 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T22:10:37.946 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:10:37.957 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:10:37.986 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T22:10:38.012 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T22:10:38.052 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:10:38.276 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T22:10:38.277 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T22:10:38.303 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T22:10:38.304 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T22:10:38.342 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T22:10:38.344 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:10:38.355 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T22:10:38.382 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T22:10:38.422 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T22:10:38.647 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T22:10:38.662 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-09-13T22:10:38.673 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T22:10:38.689 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T22:10:38.700 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T22:10:38.715 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:38.721 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:10:38.728 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:10:38.749 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:38.983 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T22:10:39.010 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T22:10:39.040 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T22:10:39.041 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T22:10:39.067 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T22:10:39.106 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:10:39.128 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T22:10:39.154 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:39.194 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:39.310 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T22:10:39.337 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T22:10:39.377 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:10:39.418 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-09-13T22:10:39.445 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T22:10:39.485 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:10:39.715 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T22:10:39.742 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T22:10:39.782 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T22:10:40.101 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-idna. 2024-09-13T22:10:40.129 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T22:10:40.168 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:10:40.479 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T22:10:40.508 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T22:10:40.545 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:10:40.607 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T22:10:40.626 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T22:10:40.634 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T22:10:40.653 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:40.672 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:10:40.683 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:40.942 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T22:10:40.970 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:41.000 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:41.364 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T22:10:41.391 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:41.430 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:41.717 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T22:10:41.737 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph. 2024-09-13T22:10:41.744 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T22:10:41.752 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../066-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:41.775 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:10:41.795 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.028 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T22:10:42.055 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T22:10:42.074 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests. 2024-09-13T22:10:42.094 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T22:10:42.101 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T22:10:42.122 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T22:10:42.140 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:10:42.149 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:42.189 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.410 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T22:10:42.437 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T22:10:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T22:10:42.467 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:42.468 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:10:42.506 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.526 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T22:10:42.552 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:42.592 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.754 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T22:10:42.781 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:42.821 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.910 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T22:10:42.936 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:42.976 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:42.987 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephadm. 2024-09-13T22:10:43.013 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../069-cephadm_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:43.053 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:43.201 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T22:10:43.228 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:43.267 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:43.347 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T22:10:43.374 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T22:10:43.414 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T22:10:43.513 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T22:10:43.540 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:43.578 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T22:10:43.579 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:43.605 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T22:10:43.686 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:10:43.767 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T22:10:43.793 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:43.833 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:43.956 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T22:10:43.983 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T22:10:44.014 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T22:10:44.334 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T22:10:44.361 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:44.400 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:44.675 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-09-13T22:10:44.691 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:44.733 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:44.795 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T22:10:44.804 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-babel. 2024-09-13T22:10:44.820 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:44.822 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:44.861 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:44.863 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:45.061 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T22:10:45.088 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:45.127 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:45.149 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T22:10:45.165 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T22:10:45.199 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:10:45.398 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T22:10:45.414 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T22:10:45.426 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:45.427 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:45.456 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:45.464 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:45.493 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T22:10:45.509 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:45.577 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:45.867 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-09-13T22:10:45.894 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-cephadm_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:45.913 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T22:10:45.934 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:45.940 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T22:10:45.980 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T22:10:46.245 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T22:10:46.266 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-routes. 2024-09-13T22:10:46.272 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T22:10:46.293 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T22:10:46.312 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T22:10:46.333 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:10:46.510 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph. 2024-09-13T22:10:46.537 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../066-ceph_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:46.568 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:46.615 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T22:10:46.642 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:46.669 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T22:10:46.681 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:46.696 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:46.735 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:46.904 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T22:10:46.931 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:46.970 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:47.340 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T22:10:47.367 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:47.407 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:47.728 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-09-13T22:10:47.755 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:47.768 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephadm. 2024-09-13T22:10:47.795 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:47.795 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../069-cephadm_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:47.826 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:47.974 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T22:10:47.998 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T22:10:48.040 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:10:48.106 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T22:10:48.112 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T22:10:48.133 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T22:10:48.139 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T22:10:48.173 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:10:48.178 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T22:10:48.473 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T22:10:48.500 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:48.502 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T22:10:48.518 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T22:10:48.525 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T22:10:48.531 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:48.544 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:48.560 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:10:48.584 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:48.922 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T22:10:48.946 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T22:10:48.949 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T22:10:48.973 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T22:10:48.988 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:10:49.012 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T22:10:49.291 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T22:10:49.316 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-09-13T22:10:49.318 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T22:10:49.342 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T22:10:49.357 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:10:49.382 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:10:49.603 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-babel. 2024-09-13T22:10:49.630 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T22:10:49.669 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:10:49.719 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T22:10:49.746 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:49.785 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:49.989 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T22:10:49.991 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T22:10:50.018 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:50.021 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T22:10:50.064 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:10:50.134 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:50.409 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T22:10:50.422 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:50.467 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:50.811 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T22:10:50.839 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T22:10:50.878 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T22:10:51.016 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T22:10:51.031 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T22:10:51.037 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T22:10:51.065 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T22:10:51.074 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:10:51.104 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T22:10:51.156 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-routes. 2024-09-13T22:10:51.183 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T22:10:51.214 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:10:51.374 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T22:10:51.401 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T22:10:51.440 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:10:51.542 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T22:10:51.553 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T22:10:51.569 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:51.580 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T22:10:51.608 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:51.619 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:10:51.760 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T22:10:51.788 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T22:10:51.827 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:10:52.023 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T22:10:52.038 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T22:10:52.081 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:10:52.121 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T22:10:52.137 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T22:10:52.172 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T22:10:52.384 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T22:10:52.411 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T22:10:52.450 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:10:52.542 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T22:10:52.569 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T22:10:52.608 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T22:10:52.789 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T22:10:52.805 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T22:10:52.847 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:10:52.911 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T22:10:52.938 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T22:10:52.977 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:10:53.110 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T22:10:53.138 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:53.254 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:53.289 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T22:10:53.308 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T22:10:53.316 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T22:10:53.324 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T22:10:53.355 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T22:10:53.358 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:10:53.667 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T22:10:53.694 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T22:10:53.733 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:10:53.745 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T22:10:53.772 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T22:10:53.811 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:10:54.048 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T22:10:54.075 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T22:10:54.106 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:10:54.499 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T22:10:54.526 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T22:10:54.565 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T22:10:54.672 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T22:10:54.700 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:54.739 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:54.835 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T22:10:54.839 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T22:10:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T22:10:54.867 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:10:54.991 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:55.075 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T22:10:55.102 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T22:10:55.141 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:10:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T22:10:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T22:10:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:10:55.436 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T22:10:55.452 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:10:55.486 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:10:55.609 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T22:10:55.636 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T22:10:55.683 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T22:10:55.730 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package jq. 2024-09-13T22:10:55.746 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:10:55.788 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T22:10:55.870 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T22:10:55.886 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T22:10:55.928 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T22:10:56.013 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T22:10:56.040 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T22:10:56.041 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package socat. 2024-09-13T22:10:56.069 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T22:10:56.079 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T22:10:56.108 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:10:56.239 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T22:10:56.267 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T22:10:56.306 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:10:56.383 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T22:10:56.410 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T22:10:56.419 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T22:10:56.440 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:10:56.446 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T22:10:56.486 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:10:56.634 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T22:10:56.661 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T22:10:56.700 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:10:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T22:10:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T22:10:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T22:10:56.857 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-test. 2024-09-13T22:10:56.884 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../097-ceph-test_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:57.012 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T22:10:57.039 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T22:10:57.078 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T22:10:57.122 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T22:10:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T22:10:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:10:57.382 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T22:10:57.410 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T22:10:57.440 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T22:10:57.752 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T22:10:57.780 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T22:10:57.818 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:10:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T22:10:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:58.113 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T22:10:58.141 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T22:10:58.179 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T22:10:58.289 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T22:10:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T22:10:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:10:58.491 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T22:10:58.520 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T22:10:58.557 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:10:58.651 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T22:10:58.678 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:10:58.709 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:10:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-09-13T22:10:58.969 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:10:59.012 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T22:10:59.094 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T22:10:59.121 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:59.160 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:59.212 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T22:10:59.229 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:10:59.265 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-09-13T22:10:59.270 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T22:10:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:10:59.447 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T22:10:59.463 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:10:59.497 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:10:59.549 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T22:10:59.576 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T22:10:59.606 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:10:59.741 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T22:10:59.757 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T22:10:59.800 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:10:59.809 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T22:10:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T22:10:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:10:59.943 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T22:10:59.971 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:11:00.009 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:11:00.079 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T22:11:00.107 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T22:11:00.145 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-09-13T22:11:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-ceph-test_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:00.270 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package jq. 2024-09-13T22:11:00.287 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T22:11:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:00.328 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T22:11:00.590 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package socat. 2024-09-13T22:11:00.592 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T22:11:00.618 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T22:11:00.619 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T22:11:00.656 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:11:00.666 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:00.959 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T22:11:00.987 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T22:11:01.017 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:11:01.271 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pkg-config. 2024-09-13T22:11:01.299 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T22:11:01.329 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:01.405 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-test. 2024-09-13T22:11:01.421 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../097-ceph-test_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:01.463 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:01.591 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T22:11:01.607 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T22:11:01.649 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:02.086 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T22:11:02.113 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T22:11:02.152 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:02.463 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T22:11:02.490 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T22:11:02.529 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:02.619 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T22:11:02.646 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:11:02.685 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:02.858 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T22:11:02.885 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T22:11:02.924 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:02.956 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T22:11:02.972 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:03.005 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:03.186 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T22:11:03.213 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T22:11:03.244 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:03.309 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T22:11:03.336 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T22:11:03.375 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:11:03.555 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-py. 2024-09-13T22:11:03.582 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T22:11:03.613 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T22:11:03.697 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T22:11:03.724 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T22:11:03.763 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:03.828 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T22:11:03.856 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-324-gecab7be5-1jammy_all.deb ... 2024-09-13T22:11:03.894 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:03.917 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T22:11:03.944 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T22:11:03.983 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:04.134 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T22:11:04.166 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T22:11:04.190 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T22:11:04.201 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:04.207 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:04.248 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:04.454 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T22:11:04.481 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T22:11:04.520 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:04.568 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T22:11:04.596 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T22:11:04.615 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-09-13T22:11:04.634 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:11:04.642 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T22:11:04.681 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:04.765 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-toml. 2024-09-13T22:11:04.792 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T22:11:04.823 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T22:11:04.925 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T22:11:04.942 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T22:11:04.973 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T22:11:04.986 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:05.001 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T22:11:05.039 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:05.118 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T22:11:05.145 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T22:11:05.184 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:05.402 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T22:11:05.414 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T22:11:05.430 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T22:11:05.441 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T22:11:05.468 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:05.471 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T22:11:05.480 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:05.498 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T22:11:05.537 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:05.758 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T22:11:05.764 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T22:11:05.774 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T22:11:05.780 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T22:11:05.814 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:05.816 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:05.882 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package pkg-config. 2024-09-13T22:11:05.910 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T22:11:06.040 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:06.094 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T22:11:06.110 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T22:11:06.144 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:06.310 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T22:11:06.326 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T22:11:06.368 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:06.430 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T22:11:06.455 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T22:11:06.497 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:06.535 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package radosgw. 2024-09-13T22:11:06.563 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../116-radosgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:06.602 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:06.738 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T22:11:06.766 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T22:11:06.804 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:06.833 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-09-13T22:11:06.860 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T22:11:06.899 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T22:11:07.107 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T22:11:07.135 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T22:11:07.173 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:07.178 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T22:11:07.194 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T22:11:07.227 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:07.405 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T22:11:07.421 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:07.463 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:07.519 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T22:11:07.547 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T22:11:07.585 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:07.632 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T22:11:07.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T22:11:07.698 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:07.759 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:07.897 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T22:11:07.925 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T22:11:07.963 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:08.009 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-09-13T22:11:08.009 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:11:08.037 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T22:11:08.075 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T22:11:08.136 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:08.309 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-py. 2024-09-13T22:11:08.336 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T22:11:08.375 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T22:11:08.398 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T22:11:08.420 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T22:11:08.448 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T22:11:08.486 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:08.695 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T22:11:08.723 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T22:11:08.723 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T22:11:08.795 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:08.823 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T22:11:08.851 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T22:11:08.889 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:09.159 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T22:11:09.186 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T22:11:09.190 INFO:teuthology.orchestra.run.smithi171.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T22:11:09.225 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:09.254 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:09.283 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T22:11:09.311 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T22:11:09.358 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:09.652 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-toml. 2024-09-13T22:11:09.680 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T22:11:09.718 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T22:11:09.761 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user cephadm....done 2024-09-13T22:11:09.926 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:11:09.988 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-09-13T22:11:10.016 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-radosgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:10.022 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T22:11:10.050 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T22:11:10.054 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:10.088 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:10.196 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:11:10.425 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T22:11:10.445 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:10.453 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T22:11:10.491 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:10.571 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:11:10.769 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T22:11:10.797 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T22:11:10.836 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:10.839 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T22:11:10.873 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T22:11:10.890 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:10.932 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:11.082 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:11:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T22:11:11.219 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:11.503 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:11:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:11:11.540 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package radosgw. 2024-09-13T22:11:11.568 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../116-radosgw_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:11.606 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:11.612 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:11.853 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T22:11:11.878 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T22:11:12.137 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T22:11:12.180 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T22:11:12.414 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:11:12.435 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T22:11:12.451 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-324-gecab7be5-1jammy_amd64.deb ... 2024-09-13T22:11:12.493 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:12.625 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T22:11:12.649 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:11:12.706 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:13.090 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T22:11:13.151 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:11:13.197 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-09-13T22:11:13.356 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T22:11:13.410 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:13.430 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:11:13.482 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T22:11:13.756 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T22:11:13.792 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:11:13.803 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:11:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:11:14.055 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:11:14.130 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T22:11:14.138 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:14.172 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:11:14.339 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:11:14.423 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:11:14.554 INFO:teuthology.orchestra.run.smithi007.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T22:11:14.618 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:14.651 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T22:11:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T22:11:14.805 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T22:11:14.868 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:11:14.910 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:11:15.036 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T22:11:15.199 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:15.251 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user cephadm....done 2024-09-13T22:11:15.313 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:11:15.407 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T22:11:15.692 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T22:11:15.749 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T22:11:15.770 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:15.880 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T22:11:15.935 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T22:11:16.025 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T22:11:16.061 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T22:11:16.147 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:11:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:11:16.371 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T22:11:16.407 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:16.544 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:11:16.664 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T22:11:16.692 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T22:11:16.790 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T22:11:16.803 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:16.817 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:17.063 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:11:17.133 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T22:11:17.297 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:17.469 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:11:17.535 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T22:11:17.556 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:11:17.682 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:11:17.720 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:11:17.770 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T22:11:17.809 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:11:17.846 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:17.934 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:11:17.964 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:11:18.055 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T22:11:18.210 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:11:18.248 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T22:11:18.306 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T22:11:18.565 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T22:11:18.583 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T22:11:18.616 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T22:11:18.624 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T22:11:18.680 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:11:18.806 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:18.842 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T22:11:18.876 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:11:19.084 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-argparse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:19.182 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:19.252 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:11:19.308 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T22:11:19.335 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T22:11:19.436 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T22:11:19.528 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:11:19.562 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T22:11:19.584 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:11:19.688 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T22:11:19.843 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:19.871 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:11:19.948 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T22:11:20.114 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:11:20.232 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:20.233 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T22:11:20.346 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T22:11:20.396 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T22:11:20.443 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T22:11:20.525 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:11:20.564 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T22:11:20.654 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:20.842 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:11:20.945 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:21.071 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T22:11:21.331 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:11:21.339 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T22:11:21.590 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:11:21.615 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T22:11:21.716 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:21.842 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:11:21.917 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T22:11:22.018 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T22:11:22.064 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:22.143 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T22:11:22.308 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T22:11:22.511 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T22:11:22.703 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T22:11:22.710 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:11:22.737 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:11:22.836 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:11:22.971 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T22:11:22.978 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:11:23.097 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T22:11:23.105 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:11:23.223 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T22:11:23.272 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:23.390 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:11:23.506 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T22:11:23.532 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T22:11:23.741 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:11:23.748 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:23.875 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:11:23.934 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T22:11:24.009 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:11:24.135 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:24.168 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:11:24.176 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T22:11:24.419 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T22:11:24.444 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:11:24.586 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T22:11:24.695 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T22:11:24.770 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:11:24.888 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T22:11:24.954 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:11:25.188 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T22:11:25.256 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T22:11:25.515 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T22:11:25.633 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:11:25.650 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:25.757 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T22:11:25.943 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:26.042 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:11:26.043 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T22:11:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:11:26.185 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:26.295 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T22:11:26.352 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T22:11:26.460 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:11:26.580 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:11:26.706 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:11:26.778 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:11:26.831 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:11:27.037 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:11:27.133 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:27.138 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:27.266 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:27.354 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T22:11:27.392 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T22:11:27.534 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T22:11:27.583 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:11:27.643 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:27.709 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:27.752 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:27.761 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:11:27.886 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T22:11:28.046 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:11:28.102 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:11:28.170 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T22:11:28.297 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T22:11:28.297 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T22:11:28.370 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T22:11:28.422 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T22:11:28.496 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T22:11:28.556 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T22:11:28.724 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T22:11:28.747 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:28.840 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:11:28.856 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:11:28.975 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T22:11:29.091 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T22:11:29.176 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:11:29.201 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:29.302 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T22:11:29.351 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:11:29.477 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T22:11:29.477 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:11:29.604 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T22:11:29.736 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:11:29.754 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T22:11:29.837 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:11:29.863 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T22:11:29.864 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T22:11:30.115 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T22:11:30.123 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T22:11:30.130 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:11:30.391 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T22:11:30.391 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:11:30.431 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:11:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T22:11:30.690 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:11:30.745 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:11:30.816 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:30.910 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T22:11:31.036 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T22:11:31.123 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:31.134 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:31.224 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T22:11:31.337 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T22:11:31.391 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:11:31.460 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:11:31.463 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T22:11:31.586 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:31.755 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T22:11:31.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:11:31.887 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:31.963 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:11:32.005 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:32.090 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T22:11:32.106 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:11:32.214 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T22:11:32.340 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T22:11:32.350 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T22:11:32.444 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:32.467 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T22:11:32.568 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T22:11:32.570 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:32.599 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:32.640 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T22:11:32.696 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T22:11:32.750 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:11:32.870 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T22:11:32.964 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:32.996 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T22:11:33.059 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:11:33.074 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:33.201 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:33.335 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:11:33.389 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T22:11:33.412 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:33.412 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:33.587 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T22:11:33.674 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T22:11:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T22:11:33.800 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T22:11:33.903 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T22:11:34.029 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:34.051 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T22:11:34.155 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:34.169 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T22:11:34.248 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:11:34.265 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:11:34.495 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T22:11:34.610 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:11:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T22:11:34.970 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:35.114 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T22:11:35.238 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:11:35.240 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T22:11:35.470 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.508 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T22:11:35.573 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:11:35.587 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.689 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.699 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.759 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T22:11:35.790 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.825 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.916 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:35.952 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:11:36.088 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T22:11:36.238 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:36.364 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:36.481 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T22:11:36.490 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T22:11:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:Adding group ceph....done 2024-09-13T22:11:36.774 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T22:11:36.798 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:36.922 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user ceph....done 2024-09-13T22:11:36.925 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.035 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.073 INFO:teuthology.orchestra.run.smithi171.stdout:Setting system user ceph properties....done 2024-09-13T22:11:37.091 INFO:teuthology.orchestra.run.smithi171.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T22:11:37.127 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T22:11:37.227 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T22:11:37.232 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:37.232 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librados2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.396 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libsqlite3-mod-ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.522 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T22:11:37.587 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T22:11:37.687 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.812 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.842 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.938 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:37.943 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libradosstriper1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.061 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T22:11:38.064 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:11:38.305 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.345 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librbd1 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.406 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.472 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-modules-core (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.598 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T22:11:38.971 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:38.971 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:39.268 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.283 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs-dev (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.384 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rados (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.385 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.475 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.496 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.510 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librgw2 (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.604 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.636 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T22:11:39.730 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:39.814 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T22:11:40.264 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-09-13T22:11:40.294 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:40.555 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:40.555 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:40.633 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-09-13T22:11:40.793 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-09-13T22:11:40.811 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T22:11:40.848 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rbd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:40.946 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T22:11:40.974 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up rbd-fuse (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.092 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.193 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cephfs (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.262 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T22:11:41.294 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-common (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.376 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.607 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:41.608 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:41.789 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:41.845 INFO:teuthology.orchestra.run.smithi007.stdout:Adding group ceph....done 2024-09-13T22:11:41.915 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:42.094 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:42.214 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user ceph....done 2024-09-13T22:11:42.332 INFO:teuthology.orchestra.run.smithi007.stdout:Setting system user ceph properties....done 2024-09-13T22:11:42.347 INFO:teuthology.orchestra.run.smithi007.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T22:11:42.370 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:42.371 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:42.391 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:42.391 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:42.491 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T22:11:42.851 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T22:11:42.863 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:42.875 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:42.989 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.140 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.207 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T22:11:43.352 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:43.352 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:43.356 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-test (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.480 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up radosgw (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.627 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.825 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:43.847 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:43.847 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:43.968 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:44.094 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:44.237 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:44.249 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:44.250 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:11:44.337 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:44.534 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:44.534 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:44.574 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T22:11:44.707 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-base (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:44.717 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T22:11:44.862 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T22:11:45.063 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:45.067 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T22:11:45.339 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:45.339 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:45.562 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mds (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:45.823 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:45.910 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:45.910 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T22:11:45.939 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T22:11:45.949 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:46.100 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:46.312 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:46.312 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:46.413 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:46.632 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T22:11:46.639 DEBUG:teuthology.parallel:result is None 2024-09-13T22:11:46.640 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:46.640 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T22:11:46.764 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:46.915 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:47.041 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:47.182 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-osd (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:47.183 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:47.464 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T22:11:47.553 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T22:11:47.654 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T22:11:47.798 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T22:11:47.917 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-k8sevents (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:48.043 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:48.194 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mon (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:48.417 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:48.417 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T22:11:48.814 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T22:11:48.963 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-cephadm (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:49.240 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-dashboard (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:49.400 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-volume (19.1.1-324-gecab7be5-1jammy) ... 2024-09-13T22:11:49.479 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T22:11:49.485 DEBUG:teuthology.parallel:result is None 2024-09-13T22:11:49.762 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T22:11:49.870 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T22:11:50.023 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T22:11:50.758 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T22:11:51.455 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T22:11:51.460 DEBUG:teuthology.parallel:result is None 2024-09-13T22:11:51.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:51.607 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-query -W -f '${Version}' ceph 2024-09-13T22:11:51.627 INFO:teuthology.orchestra.run.smithi007.stdout:19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.627 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.628 INFO:teuthology.task.install:The correct ceph version 19.1.1-324-gecab7be5-1jammy is installed. 2024-09-13T22:11:51.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:51.773 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-09-13T22:11:51.792 INFO:teuthology.orchestra.run.smithi131.stdout:19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.793 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.793 INFO:teuthology.task.install:The correct ceph version 19.1.1-324-gecab7be5-1jammy is installed. 2024-09-13T22:11:51.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:51.937 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-query -W -f '${Version}' ceph 2024-09-13T22:11:51.957 INFO:teuthology.orchestra.run.smithi171.stdout:19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.957 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324-gecab7be5-1jammy 2024-09-13T22:11:51.957 INFO:teuthology.task.install:The correct ceph version 19.1.1-324-gecab7be5-1jammy is installed. 2024-09-13T22:11:51.959 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T22:11:51.959 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:11:51.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:11:51.974 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:11:51.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:11:51.989 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:11:51.989 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:11:52.013 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T22:11:52.013 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:11:52.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:11:52.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:11:52.086 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:11:52.086 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:11:52.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:11:52.153 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:11:52.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:11:52.166 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:11:52.220 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T22:11:52.220 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:11:52.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:11:52.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:11:52.290 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:11:52.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:11:52.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:11:52.356 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:11:52.357 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:11:52.370 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:11:52.424 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T22:11:52.424 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:11:52.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:11:52.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:11:52.496 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:11:52.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:11:52.510 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:11:52.564 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:11:52.564 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:11:52.578 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:11:52.632 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T22:11:52.728 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum'], 'log-only-match': ['CEPHADM_'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:11:52.728 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:52.729 INFO:tasks.cephadm:Cluster fsid is 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:11:52.729 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T22:11:52.729 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.131', 'mon.c': '172.21.15.171'} 2024-09-13T22:11:52.729 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-13T22:11:52.730 INFO:tasks.cephadm:First mgr is a 2024-09-13T22:11:52.730 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T22:11:52.730 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-13T22:11:52.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2024-09-13T22:11:52.758 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname $(hostname -s) 2024-09-13T22:11:52.773 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T22:11:52.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:52.919 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/56074/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-324-gecab7be5', 'node_name': '172.21.2.17+braggi17', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-324-gecab7be5-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-13 19:22:31.141342', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-13T22:11:53.073 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 ecab7be58963a5bd03910cd73eef66405d7fdd50 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:11:53.074 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-13T22:11:53.075 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-13T22:11:53.075 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:53.520 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791838 Sep 13 22:11 /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:53.520 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:53.977 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791838 Sep 13 22:11 /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:53.978 DEBUG:teuthology.orchestra.run.smithi171:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:54.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791838 Sep 13 22:11 /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:54.443 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:54.451 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:54.459 DEBUG:teuthology.orchestra.run.smithi171:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:11:54.476 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 on all hosts... 2024-09-13T22:11:54.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 pull 2024-09-13T22:11:54.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 pull 2024-09-13T22:11:54.502 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 pull 2024-09-13T22:11:54.682 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50... 2024-09-13T22:11:54.686 INFO:teuthology.orchestra.run.smithi131.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50... 2024-09-13T22:11:54.690 INFO:teuthology.orchestra.run.smithi171.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50... 2024-09-13T22:14:12.360 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T22:14:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)", 2024-09-13T22:14:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34", 2024-09-13T22:14:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-13T22:14:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808" 2024-09-13T22:14:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T22:14:12.361 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)", 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout: "image_id": "0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34", 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout: "repo_digests": [ 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808" 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-09-13T22:14:23.093 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)", 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout: "image_id": "0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34", 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout: "repo_digests": [ 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808" 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-09-13T22:14:29.565 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-09-13T22:14:29.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-13T22:14:29.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2024-09-13T22:14:29.644 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph 2024-09-13T22:14:29.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-13T22:14:29.686 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2024-09-13T22:14:29.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /etc/ceph 2024-09-13T22:14:29.716 INFO:tasks.cephadm:Writing seed config... 2024-09-13T22:14:29.719 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-13T22:14:29.719 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T22:14:29.719 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T22:14:29.719 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2024-09-13T22:14:29.719 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T22:14:29.720 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T22:14:29.720 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T22:14:29.720 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T22:14:29.720 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T22:14:29.721 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:14:29.721 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T22:14:29.734 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2e3f4ff4-721d-11ef-bceb-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-13T22:14:29.735 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T22:14:29.780 DEBUG:teuthology.orchestra.run.smithi007:mgr.a> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.a.service 2024-09-13T22:14:29.823 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T22:14:29.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 -v bootstrap --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:14:30.048 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:14:30.049 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50', '-v', 'bootstrap', '--fsid', '2e3f4ff4-721d-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-13T22:14:30.049 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T22:14:30.050 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-13T22:14:30.050 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-13T22:14:30.050 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-13T22:14:30.055 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:14:30.055 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:14:30.059 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:14:30.060 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.064 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-13T22:14:30.064 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-13T22:14:30.067 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-13T22:14:30.067 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.072 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-13T22:14:30.072 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout masked 2024-09-13T22:14:30.076 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-13T22:14:30.076 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.079 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-13T22:14:30.079 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-13T22:14:30.083 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-13T22:14:30.083 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.088 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:Unit ntp.service is enabled and running 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:docker (/usr/bin/docker) is present 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-13T22:14:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-13T22:14:30.096 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:14:30.096 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:14:30.099 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:14:30.100 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.103 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-13T22:14:30.103 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-13T22:14:30.107 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-13T22:14:30.107 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-13T22:14:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout masked 2024-09-13T22:14:30.115 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-13T22:14:30.115 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.118 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-13T22:14:30.118 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-13T22:14:30.122 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-13T22:14:30.122 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T22:14:30.126 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-13T22:14:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-13T22:14:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:Unit ntp.service is enabled and running 2024-09-13T22:14:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-13T22:14:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 140313904708432 on /run/cephadm/2e3f4ff4-721d-11ef-bceb-c7b262605968.lock 2024-09-13T22:14:30.132 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 140313904708432 acquired on /run/cephadm/2e3f4ff4-721d-11ef-bceb-c7b262605968.lock 2024-09-13T22:14:30.132 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-13T22:14:30.132 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-13T22:14:30.132 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-13T22:14:30.133 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-09-13T22:14:30.133 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-13T22:14:30.134 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 2024-09-13T22:14:30.136 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T22:14:30.136 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T22:14:30.136 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1775sec hoplimit 64 pref medium 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-13T22:14:30.138 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:14:30.139 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-13T22:14:30.139 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-13T22:14:30.139 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T22:14:30.139 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T22:14:30.140 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50... 2024-09-13T22:14:30.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/docker: stdout ecab7be58963a5bd03910cd73eef66405d7fdd50: Pulling from ceph-ci/ceph 2024-09-13T22:14:30.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/docker: stdout Digest: sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:14:30.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:14:30.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:14:31.921 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable) 2024-09-13T22:14:31.921 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable) 2024-09-13T22:14:31.921 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T22:14:33.268 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-13T22:14:33.269 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-13T22:14:34.641 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBKueRmb4ECCBAA+sNQiwNzCZbCkKy1tLFGag== 2024-09-13T22:14:35.964 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBLueRmsHMWHRAAhs2jYRwjRk/fR/TGSBHCRg== 2024-09-13T22:14:37.378 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBMueRmsF1VNhAAYjO1qJeQ1EoyuYBdDl4gaA== 2024-09-13T22:14:37.379 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-13T22:14:38.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:38.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:14:38.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:14:38.822 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-13T22:14:40.399 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.700+0000 7f669b07ec80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:14:40.399 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.700+0000 7f669b07ec80 1 imported monmap: 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-13T22:14:40.400 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.700+0000 7f669b07ec80 0 /usr/bin/ceph-mon: set fsid to 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Git sha 0 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: DB SUMMARY 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.401 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: DB Session ID: R2IVRXDT638GIVJB5QFG 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.create_if_missing: 1 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T22:14:40.402 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.env: 0x5594d0f28940 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.info_log: 0x5594d291abc0 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.statistics: (nil) 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.use_fsync: 0 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T22:14:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:14:40.404 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.db_log_dir: 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.wal_dir: 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:14:40.405 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:14:40.406 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.write_buffer_manager: 0x5594d29214a0 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:14:40.407 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.unordered_write: 0 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:14:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:14:40.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:14:40.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:14:40.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.row_cache: None 2024-09-13T22:14:40.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.wal_filter: None 2024-09-13T22:14:40.409 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.wal_compression: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T22:14:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T22:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T22:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_open_files: -1 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Compression algorithms supported: 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kZSTD supported: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.merge_operator: 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_filter: None 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5594d291a800) 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-13T22:14:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x5594d29051f0 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-13T22:14:40.417 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-13T22:14:40.418 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-13T22:14:40.418 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-13T22:14:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-13T22:14:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-13T22:14:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-13T22:14:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-13T22:14:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.421 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression: NoCompression 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.num_levels: 7 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:14:40.422 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:14:40.423 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:14:40.424 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:14:40.425 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:14:40.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:14:40.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.ttl: 2592000 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T22:14:40.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 402297d5-cec0-4305-9712-4ec4ce739d96 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.704+0000 7f669b07ec80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f669b07ec80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5594d2932e00 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f669b07ec80 4 rocksdb: DB pointer 0x5594d2a0c000 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f6692809640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f6692809640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:40.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:14:40.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:14:40.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x5594d29051f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f669b07ec80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f669b07ec80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-13T22:14:39.708+0000 7f669b07ec80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-13T22:14:40.433 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-13T22:14:40.641 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-13T22:14:40.876 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-13T22:14:41.099 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target. 2024-09-13T22:14:41.099 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target. 2024-09-13T22:14:41.361 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a 2024-09-13T22:14:41.361 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T22:14:41.552 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target.wants/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service. 2024-09-13T22:14:41.562 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld does not appear to be present 2024-09-13T22:14:41.562 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:14:41.562 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-13T22:14:41.563 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-13T22:14:43.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:43 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.142743+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T22:14:43.807 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.140789s) 2024-09-13T22:14:43.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-13T22:14:43.809 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T22:14:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.145969+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T22:14:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146111+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-13T22:14:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146123+0000 mon.a (mon.0) 4 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146137+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146150+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146162+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146173+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.146184+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.148135+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.150301+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: cluster 2024-09-13T22:14:43.150757+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T22:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:44 smithi007 bash[22240]: audit 2024-09-13T22:14:43.286706+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.7:0/2557303134' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T22:14:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:45 smithi007 bash[22240]: audit 2024-09-13T22:14:45.056709+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.7:0/1360244136' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:14:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:45 smithi007 bash[22240]: audit 2024-09-13T22:14:45.060514+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.7:0/1360244136' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T22:14:45.647 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:14:45.648 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:45.649 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:14:45.649 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:14:45.649 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:14:45.649 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-13T22:14:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:46 smithi007 bash[22240]: audit 2024-09-13T22:14:46.669429+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.7:0/4214889876' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:14:47.153 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-13T22:14:47.431 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 systemd[1]: Stopping Ceph mon.a for 2e3f4ff4-721d-11ef-bceb-c7b262605968... 2024-09-13T22:14:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 bash[22240]: debug 2024-09-13T22:14:47.272+0000 7fddb2e58640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-13T22:14:47.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 bash[22240]: debug 2024-09-13T22:14:47.272+0000 7fddb2e58640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T22:14:47.965 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T22:14:48.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 bash[22624]: ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968-mon-a 2024-09-13T22:14:48.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 bash[22683]: ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968-mon-a 2024-09-13T22:14:48.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 systemd[1]: ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T22:14:48.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 systemd[1]: Stopped Ceph mon.a for 2e3f4ff4-721d-11ef-bceb-c7b262605968. 2024-09-13T22:14:48.077 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:47 smithi007 systemd[1]: Started Ceph mon.a for 2e3f4ff4-721d-11ef-bceb-c7b262605968. 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.336+0000 7f8075340c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.336+0000 7f8075340c80 0 ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 7 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.336+0000 7f8075340c80 0 pidfile_write: ignore empty --pid-file 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.336+0000 7f8075340c80 0 load: jerasure load: lrc 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Git sha 0 2024-09-13T22:14:49.588 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: DB SUMMARY 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: DB Session ID: 8UQ9K33YH2O13M039Q03 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: CURRENT file: CURRENT 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88753 ; 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.create_if_missing: 0 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:14:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.env: 0x564df9fe1940 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.info_log: 0x564dfc1836e0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.statistics: (nil) 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.use_fsync: 0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:14:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.db_log_dir: 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.wal_dir: 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:14:49.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.write_buffer_manager: 0x564dfc192dc0 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:14:49.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.unordered_write: 0 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.row_cache: None 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.wal_filter: None 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:14:49.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.wal_compression: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:14:49.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:14:49.597 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_open_files: -1 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Compression algorithms supported: 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kZSTD supported: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T22:14:49.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.merge_operator: 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_filter: None 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564dfc183320) 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cache_index_and_filter_blocks: 1 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: pin_top_level_index_and_filter: 1 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: index_type: 0 2024-09-13T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: data_block_index_type: 0 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: index_shortening: 1 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: checksum: 4 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: no_block_cache: 0 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_cache: 0x564dfc1791f0 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_cache_name: BinnedLRUCache 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_cache_options: 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: capacity : 536870912 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: num_shard_bits : 4 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: strict_capacity_limit : 0 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: high_pri_pool_ratio: 0.000 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_cache_compressed: (nil) 2024-09-13T22:14:49.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: persistent_cache: (nil) 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_size: 4096 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_size_deviation: 10 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_restart_interval: 16 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: index_block_restart_interval: 1 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: metadata_block_size: 4096 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: partition_filters: 0 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: use_delta_encoding: 1 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: filter_policy: bloomfilter 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: whole_key_filtering: 1 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: verify_compression: 0 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: read_amp_bytes_per_bit: 0 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: format_version: 5 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: enable_index_compression: 1 2024-09-13T22:14:49.602 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: block_align: 0 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: max_auto_readahead_size: 262144 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: prepopulate_block_cache: 0 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: initial_auto_readahead_size: 8192 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: num_file_reads_for_auto_readahead: 2 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression: NoCompression 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.num_levels: 7 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:14:49.603 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:14:49.604 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:14:49.605 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:14:49.606 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:14:49.607 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:14:49.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:14:49.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 402297d5-cec0-4305-9712-4ec4ce739d96 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265689344329, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265689345317, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 258, "table_properties": {"data_size": 83517, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10201, "raw_average_key_size": 47, "raw_value_size": 77724, "raw_average_value_size": 358, "num_data_blocks": 11, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726265689, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "402297d5-cec0-4305-9712-4ec4ce739d96", "db_session_id": "8UQ9K33YH2O13M039Q03", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265689345430, "job": 1, "event": "recovery_finished"} 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.340+0000 7f8075340c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564dfc1a4e00 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 4 rocksdb: DB pointer 0x564dfc2a4000 2024-09-13T22:14:49.610 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f806b109640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f806b109640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: ** DB Stats ** 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: ** Compaction Stats [default] ** 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: L0 2/0 85.23 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:14:49.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Sum 2/0 85.23 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 130.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: ** Compaction Stats [default] ** 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 130.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Cumulative compaction: 0.00 GB write, 21.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:14:49.612 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Interval compaction: 0.00 GB write, 21.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Block cache BinnedLRUCache@0x564dfc1791f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 1 mon.a@-1(???) e1 preinit fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).mds e1 new map 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).mds e1 print_map 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: e1 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: btime 2024-09-13T22:14:43:146571+0000 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T22:14:49.613 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: legacy client fscid: -1 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: No filesystems configured 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: debug 2024-09-13T22:14:49.344+0000 7f8075340c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370779+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370903+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370921+0000 mon.a (mon.0) 3 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370931+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370955+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:14:49.614 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370968+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:14:49.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370980+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-13T22:14:49.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.370994+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:14:49.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.390769+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-13T22:14:49.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.390816+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:14:49.615 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:49 smithi007 bash[22722]: cluster 2024-09-13T22:14:49.391267+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-13T22:14:50.098 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T22:14:50.115 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:14:50.116 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-13T22:14:50.116 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T22:14:50.116 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T22:14:50.407 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.a 2024-09-13T22:14:50.408 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.a.service: Unit ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.a.service not loaded. 2024-09-13T22:14:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:50 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:14:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968.target.wants/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.a.service -> /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service. 2024-09-13T22:14:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld does not appear to be present 2024-09-13T22:14:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:14:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld does not appear to be present 2024-09-13T22:14:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T22:14:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-13T22:14:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-13T22:14:50.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:50 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:14:50.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:50 smithi007 bash[22722]: audit 2024-09-13T22:14:49.575442+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.7:0/1367607436' entity='client.admin' 2024-09-13T22:14:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:52 smithi007 bash[22722]: audit 2024-09-13T22:14:52.554303+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.7:0/3049250085' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:14:52.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:52 smithi007 bash[22972]: debug 2024-09-13T22:14:52.503+0000 7f616db92040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "2e3f4ff4-721d-11ef-bceb-c7b262605968", 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:14:53.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:14:53.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.125 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T22:14:43:146571+0000", 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:14:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:14:43.147266+0000", 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:14:53.127 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-13T22:14:54.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:53 smithi007 bash[22972]: debug 2024-09-13T22:14:53.751+0000 7f616db92040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:14:54.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:53 smithi007 bash[22972]: debug 2024-09-13T22:14:53.819+0000 7f616db92040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:14:54.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:53 smithi007 bash[22972]: debug 2024-09-13T22:14:53.975+0000 7f616db92040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:14:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:54 smithi007 bash[22972]: debug 2024-09-13T22:14:54.655+0000 7f616db92040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:14:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:54 smithi007 bash[22972]: debug 2024-09-13T22:14:54.727+0000 7f616db92040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:14:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:54 smithi007 bash[22972]: debug 2024-09-13T22:14:54.799+0000 7f616db92040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:14:55.416 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:54 smithi007 bash[22972]: debug 2024-09-13T22:14:54.991+0000 7f616db92040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:14:55.417 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.071+0000 7f616db92040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:14:55.417 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.143+0000 7f616db92040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:14:55.692 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.411+0000 7f616db92040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:14:55.692 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.483+0000 7f616db92040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:14:55.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.687+0000 7f616db92040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:14:55.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:55 smithi007 bash[22972]: debug 2024-09-13T22:14:55.767+0000 7f616db92040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:14:56.319 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22972]: debug 2024-09-13T22:14:56.035+0000 7f616db92040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:14:56.319 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22972]: debug 2024-09-13T22:14:56.223+0000 7f616db92040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:14:56.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22722]: audit 2024-09-13T22:14:56.308178+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.7:0/2977683601' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:14:56.674 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22972]: debug 2024-09-13T22:14:56.399+0000 7f616db92040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:14:56.675 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22972]: debug 2024-09-13T22:14:56.483+0000 7f616db92040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:14:56.675 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:56 smithi007 bash[22972]: debug 2024-09-13T22:14:56.667+0000 7f616db92040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:14:56.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:14:56.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:14:56.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "2e3f4ff4-721d-11ef-bceb-c7b262605968", 2024-09-13T22:14:56.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T22:14:56.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:14:56.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:14:56.868 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T22:14:43:146571+0000", 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:14:56.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:14:43.147266+0000", 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:14:56.870 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-13T22:14:57.824 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:57 smithi007 bash[22972]: debug 2024-09-13T22:14:57.507+0000 7f616db92040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:14:57.824 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:57 smithi007 bash[22972]: debug 2024-09-13T22:14:57.587+0000 7f616db92040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:14:57.825 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:57 smithi007 bash[22972]: debug 2024-09-13T22:14:57.819+0000 7f616db92040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:14:58.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:57 smithi007 bash[22972]: debug 2024-09-13T22:14:57.895+0000 7f616db92040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:14:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22972]: debug 2024-09-13T22:14:58.303+0000 7f616db92040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:14:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22972]: debug 2024-09-13T22:14:58.387+0000 7f616db92040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:14:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: cluster 2024-09-13T22:14:58.412477+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon a 2024-09-13T22:14:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: cluster 2024-09-13T22:14:58.419144+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: a(active, starting, since 0.00686713s) 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.420759+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.420905+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.421028+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.421159+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.422748+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: cluster 2024-09-13T22:14:58.448137+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon a is now available 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.460601+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:14:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:58 smithi007 bash[22722]: audit 2024-09-13T22:14:58.462352+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:14:59.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:59 smithi007 bash[22722]: audit 2024-09-13T22:14:58.465324+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' 2024-09-13T22:14:59.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:59 smithi007 bash[22722]: audit 2024-09-13T22:14:58.469505+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' 2024-09-13T22:14:59.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:59 smithi007 bash[22722]: audit 2024-09-13T22:14:58.471343+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.7:0/933653231' entity='mgr.a' 2024-09-13T22:14:59.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:14:59 smithi007 bash[22722]: cluster 2024-09-13T22:14:59.427439+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: a(active, since 1.01516s) 2024-09-13T22:15:01.062 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "2e3f4ff4-721d-11ef-bceb-c7b262605968", 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:15:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:15:01.064 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:15:01.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-13T22:14:43:146571+0000", 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:15:01.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:15:01.068 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.068 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:15:01.068 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:14:43.147266+0000", 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:15:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:15:01.070 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:15:01.070 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-13T22:15:01.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:01 smithi007 bash[22722]: cluster 2024-09-13T22:15:00.474134+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: a(active, since 2s) 2024-09-13T22:15:01.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:01 smithi007 bash[22722]: audit 2024-09-13T22:15:00.498013+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.7:0/1138085027' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:15:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:02 smithi007 bash[22722]: audit 2024-09-13T22:15:02.376591+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.7:0/2571569321' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:15:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:02 smithi007 bash[22722]: audit 2024-09-13T22:15:02.380636+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.7:0/2571569321' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T22:15:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:15:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:15:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-13T22:15:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:15:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-13T22:15:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:04 smithi007 bash[22722]: audit 2024-09-13T22:15:04.373360+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.7:0/2988356053' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T22:15:04.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:04 smithi007 bash[22972]: ignoring --setuser ceph since I am not root 2024-09-13T22:15:04.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:04 smithi007 bash[22972]: ignoring --setgroup ceph since I am not root 2024-09-13T22:15:04.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:04 smithi007 bash[22972]: debug 2024-09-13T22:15:04.575+0000 7ffb8f5a6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:15:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:05 smithi007 bash[22722]: audit 2024-09-13T22:15:04.425375+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.7:0/2988356053' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T22:15:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:05 smithi007 bash[22722]: cluster 2024-09-13T22:15:04.431256+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: a(active, since 6s) 2024-09-13T22:15:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:05 smithi007 bash[22972]: debug 2024-09-13T22:15:05.827+0000 7ffb8f5a6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:15:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:05 smithi007 bash[22972]: debug 2024-09-13T22:15:05.895+0000 7ffb8f5a6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:15:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:06 smithi007 bash[22972]: debug 2024-09-13T22:15:06.059+0000 7ffb8f5a6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:15:06.748 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:06 smithi007 bash[22722]: audit 2024-09-13T22:15:06.476888+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.7:0/3146094561' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-13T22:15:07.037 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-13T22:15:07.087 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:06 smithi007 bash[22972]: debug 2024-09-13T22:15:06.743+0000 7ffb8f5a6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:15:07.087 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:06 smithi007 bash[22972]: debug 2024-09-13T22:15:06.815+0000 7ffb8f5a6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:15:07.087 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:06 smithi007 bash[22972]: debug 2024-09-13T22:15:06.887+0000 7ffb8f5a6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:15:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.083+0000 7ffb8f5a6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:15:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.163+0000 7ffb8f5a6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:15:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.235+0000 7ffb8f5a6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:15:07.783 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.503+0000 7ffb8f5a6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:15:07.783 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.571+0000 7ffb8f5a6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:15:08.131 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.779+0000 7ffb8f5a6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:15:08.131 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:07 smithi007 bash[22972]: debug 2024-09-13T22:15:07.859+0000 7ffb8f5a6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:15:08.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:08 smithi007 bash[22972]: debug 2024-09-13T22:15:08.127+0000 7ffb8f5a6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:15:08.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:08 smithi007 bash[22972]: debug 2024-09-13T22:15:08.311+0000 7ffb8f5a6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:15:08.755 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:08 smithi007 bash[22972]: debug 2024-09-13T22:15:08.483+0000 7ffb8f5a6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:15:08.755 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:08 smithi007 bash[22972]: debug 2024-09-13T22:15:08.563+0000 7ffb8f5a6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:15:09.903 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:08 smithi007 bash[22972]: debug 2024-09-13T22:15:08.751+0000 7ffb8f5a6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:15:09.903 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:09 smithi007 bash[22972]: debug 2024-09-13T22:15:09.587+0000 7ffb8f5a6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:15:09.903 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:09 smithi007 bash[22972]: debug 2024-09-13T22:15:09.663+0000 7ffb8f5a6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:15:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:09 smithi007 bash[22972]: debug 2024-09-13T22:15:09.899+0000 7ffb8f5a6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:15:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:09 smithi007 bash[22972]: debug 2024-09-13T22:15:09.975+0000 7ffb8f5a6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22972]: debug 2024-09-13T22:15:10.383+0000 7ffb8f5a6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22972]: debug 2024-09-13T22:15:10.463+0000 7ffb8f5a6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: cluster 2024-09-13T22:15:10.487767+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon a restarted 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: cluster 2024-09-13T22:15:10.488209+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon a 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: cluster 2024-09-13T22:15:10.491558+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: cluster 2024-09-13T22:15:10.491663+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: a(active, starting, since 0.00363058s) 2024-09-13T22:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.494724+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.495770+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.496706+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.496887+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.497059+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: cluster 2024-09-13T22:15:10.520490+0000 mon.a (mon.0) 46 : cluster [INF] Manager daemon a is now available 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.534672+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:10 smithi007 bash[22722]: audit 2024-09-13T22:15:10.536857+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: cephadm 2024-09-13T22:15:10.532436+0000 mgr.a (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: audit 2024-09-13T22:15:10.542139+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: audit 2024-09-13T22:15:10.544215+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: audit 2024-09-13T22:15:10.553278+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: audit 2024-09-13T22:15:10.555322+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:11 smithi007 bash[22722]: cluster 2024-09-13T22:15:11.498939+0000 mon.a (mon.0) 53 : cluster [DBG] mgrmap e7: a(active, since 1.01088s) 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-13T22:15:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-13T22:15:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:12 smithi007 bash[22722]: audit 2024-09-13T22:15:11.498607+0000 mgr.a (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:15:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:12 smithi007 bash[22722]: audit 2024-09-13T22:15:11.512996+0000 mgr.a (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: cluster 2024-09-13T22:15:12.546894+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e8: a(active, since 2s) 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: audit 2024-09-13T22:15:12.554666+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: audit 2024-09-13T22:15:12.559488+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: audit 2024-09-13T22:15:13.451420+0000 mgr.a (mgr.14118) 4 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: audit 2024-09-13T22:15:13.455963+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:13 smithi007 bash[22722]: audit 2024-09-13T22:15:13.470226+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22722]: cephadm 2024-09-13T22:15:14.363570+0000 mgr.a (mgr.14118) 5 : cephadm [INF] [13/Sep/2024:22:15:14] ENGINE Bus STARTING 2024-09-13T22:15:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22722]: cephadm 2024-09-13T22:15:14.465357+0000 mgr.a (mgr.14118) 6 : cephadm [INF] [13/Sep/2024:22:15:14] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T22:15:14.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: debug 2024-09-13T22:15:14.587+0000 7ffaf68a5640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:22:15:14] ENGINE Error in HTTPServer.serve 2024-09-13T22:15:14.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: Traceback (most recent call last): 2024-09-13T22:15:14.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:15:14.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: self._connections.run(self.expiration_interval) 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: self._run(expiration_interval) 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:15:14.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: s = self.context.wrap_socket( 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: return self.sslsocket_class._create( 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:15:14.957 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: self.do_handshake() 2024-09-13T22:15:14.958 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:15:14.958 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: self._sslobj.do_handshake() 2024-09-13T22:15:14.958 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:14 smithi007 bash[22972]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:15:15.707 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T22:15:15.708 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-13T22:15:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: cephadm 2024-09-13T22:15:14.590073+0000 mgr.a (mgr.14118) 7 : cephadm [INF] [13/Sep/2024:22:15:14] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: cephadm 2024-09-13T22:15:14.590249+0000 mgr.a (mgr.14118) 8 : cephadm [INF] [13/Sep/2024:22:15:14] ENGINE Bus STARTED 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: audit 2024-09-13T22:15:14.591365+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: cephadm 2024-09-13T22:15:14.593063+0000 mgr.a (mgr.14118) 9 : cephadm [ERR] [13/Sep/2024:22:15:14] ENGINE Error in HTTPServer.serve 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: Traceback (most recent call last): 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: self._connections.run(self.expiration_interval) 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: self._run(expiration_interval) 2024-09-13T22:15:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: s = self.context.wrap_socket( 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: return self.sslsocket_class._create( 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: self.do_handshake() 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: self._sslobj.do_handshake() 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:15:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:15 smithi007 bash[22722]: audit 2024-09-13T22:15:15.174328+0000 mgr.a (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: Generating public/private rsa key pair. 2024-09-13T22:15:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: Your identification has been saved in /tmp/tmpan5esx8j/key 2024-09-13T22:15:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: Your public key has been saved in /tmp/tmpan5esx8j/key.pub 2024-09-13T22:15:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: The key fingerprint is: 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: SHA256:OWW5MKtVcxVZPXGl3bbemjre9YXsK9V3ImJSIzerjZE ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: The key's randomart image is: 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: +---[RSA 3072]----+ 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | o=B| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | . ..++| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | o * . . =| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | .O=+ ..| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | S=.+ o | 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | oE.+ ..+.=| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | . B . ooo*| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | o . oo +o| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: | .o+*..| 2024-09-13T22:15:17.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:17 smithi007 bash[22972]: +----[SHA256]-----+ 2024-09-13T22:15:18.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:18 smithi007 bash[22722]: audit 2024-09-13T22:15:17.093726+0000 mgr.a (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:18.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:18 smithi007 bash[22722]: cephadm 2024-09-13T22:15:17.094128+0000 mgr.a (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-13T22:15:18.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:18 smithi007 bash[22722]: audit 2024-09-13T22:15:17.289517+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:18.601 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:18 smithi007 bash[22722]: audit 2024-09-13T22:15:17.293628+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:19.636 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:19.637 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:15:19.637 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T22:15:19.637 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-13T22:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:19 smithi007 bash[22722]: audit 2024-09-13T22:15:19.106138+0000 mgr.a (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:21.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:21 smithi007 bash[22722]: audit 2024-09-13T22:15:21.014178+0000 mgr.a (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:22.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:22 smithi007 bash[22722]: cephadm 2024-09-13T22:15:22.313568+0000 mgr.a (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi007 2024-09-13T22:15:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-13T22:15:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-13T22:15:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:26 smithi007 bash[22722]: audit 2024-09-13T22:15:25.906771+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:26 smithi007 bash[22722]: cephadm 2024-09-13T22:15:25.907261+0000 mgr.a (mgr.14118) 16 : cephadm [INF] Added host smithi007 2024-09-13T22:15:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:26 smithi007 bash[22722]: audit 2024-09-13T22:15:25.907846+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:29.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T22:15:29.525 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-13T22:15:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:29 smithi007 bash[22722]: audit 2024-09-13T22:15:28.831703+0000 mgr.a (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:29 smithi007 bash[22722]: cephadm 2024-09-13T22:15:28.833980+0000 mgr.a (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-13T22:15:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:29 smithi007 bash[22722]: audit 2024-09-13T22:15:28.837563+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:29 smithi007 bash[22722]: audit 2024-09-13T22:15:29.248282+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:31.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:30 smithi007 bash[22722]: audit 2024-09-13T22:15:29.837388+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:31.508 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T22:15:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:31 smithi007 bash[22722]: cluster 2024-09-13T22:15:30.498193+0000 mgr.a (mgr.14118) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:15:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:31 smithi007 bash[22722]: audit 2024-09-13T22:15:30.947941+0000 mgr.a (mgr.14118) 20 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:31 smithi007 bash[22722]: cephadm 2024-09-13T22:15:30.950144+0000 mgr.a (mgr.14118) 21 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-13T22:15:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:31 smithi007 bash[22722]: audit 2024-09-13T22:15:30.954548+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.7:0/4208422563' entity='mgr.a' 2024-09-13T22:15:34.014 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:33 smithi007 bash[22722]: cluster 2024-09-13T22:15:32.498549+0000 mgr.a (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:15:34.015 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:33 smithi007 bash[22722]: audit 2024-09-13T22:15:32.750289+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.7:0/1163526196' entity='client.admin' 2024-09-13T22:15:35.046 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-13T22:15:35.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:35 smithi007 bash[22722]: cluster 2024-09-13T22:15:34.498928+0000 mgr.a (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:15:35.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:35 smithi007 bash[22722]: audit 2024-09-13T22:15:34.534601+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.7:0/1440400257' entity='client.admin' 2024-09-13T22:15:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:36 smithi007 bash[22972]: ignoring --setuser ceph since I am not root 2024-09-13T22:15:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:36 smithi007 bash[22972]: ignoring --setgroup ceph since I am not root 2024-09-13T22:15:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:36 smithi007 bash[22972]: debug 2024-09-13T22:15:36.699+0000 7f1929fc4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:15:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:36 smithi007 bash[22722]: audit 2024-09-13T22:15:36.492000+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.7:0/1783580472' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T22:15:37.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:37 smithi007 bash[22722]: audit 2024-09-13T22:15:36.536583+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.7:0/1783580472' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T22:15:37.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:37 smithi007 bash[22722]: cluster 2024-09-13T22:15:36.540991+0000 mon.a (mon.0) 72 : cluster [DBG] mgrmap e9: a(active, since 26s) 2024-09-13T22:15:38.054 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:37 smithi007 bash[22972]: debug 2024-09-13T22:15:37.979+0000 7f1929fc4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:15:38.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:38 smithi007 bash[22972]: debug 2024-09-13T22:15:38.047+0000 7f1929fc4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:15:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:38 smithi007 bash[22972]: debug 2024-09-13T22:15:38.207+0000 7f1929fc4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:15:38.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:38 smithi007 bash[22722]: audit 2024-09-13T22:15:38.545339+0000 mon.a (mon.0) 73 : audit [DBG] from='client.? 172.21.15.7:0/388362609' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:15:39.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-13T22:15:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-09-13T22:15:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:38 smithi007 bash[22972]: debug 2024-09-13T22:15:38.895+0000 7f1929fc4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:15:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:38 smithi007 bash[22972]: debug 2024-09-13T22:15:38.967+0000 7f1929fc4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:15:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.039+0000 7f1929fc4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:15:39.664 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.239+0000 7f1929fc4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:15:39.664 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.319+0000 7f1929fc4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:15:39.664 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.391+0000 7f1929fc4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:15:39.664 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.659+0000 7f1929fc4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:15:39.940 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.731+0000 7f1929fc4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:15:40.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:39 smithi007 bash[22972]: debug 2024-09-13T22:15:39.935+0000 7f1929fc4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:15:40.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.023+0000 7f1929fc4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:15:40.647 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.283+0000 7f1929fc4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:15:40.647 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.471+0000 7f1929fc4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:15:40.918 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.643+0000 7f1929fc4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:15:40.918 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.723+0000 7f1929fc4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:15:41.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:40 smithi007 bash[22972]: debug 2024-09-13T22:15:40.911+0000 7f1929fc4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:15:42.084 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:41 smithi007 bash[22972]: debug 2024-09-13T22:15:41.767+0000 7f1929fc4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:15:42.084 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:41 smithi007 bash[22972]: debug 2024-09-13T22:15:41.847+0000 7f1929fc4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:15:42.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22972]: debug 2024-09-13T22:15:42.079+0000 7f1929fc4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:15:42.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22972]: debug 2024-09-13T22:15:42.155+0000 7f1929fc4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22972]: debug 2024-09-13T22:15:42.563+0000 7f1929fc4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22972]: debug 2024-09-13T22:15:42.647+0000 7f1929fc4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: cluster 2024-09-13T22:15:42.672552+0000 mon.a (mon.0) 74 : cluster [INF] Active manager daemon a restarted 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: cluster 2024-09-13T22:15:42.673147+0000 mon.a (mon.0) 75 : cluster [INF] Activating manager daemon a 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: cluster 2024-09-13T22:15:42.680035+0000 mon.a (mon.0) 76 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-13T22:15:42.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: cluster 2024-09-13T22:15:42.680279+0000 mon.a (mon.0) 77 : cluster [DBG] mgrmap e10: a(active, starting, since 0.0073175s) 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: audit 2024-09-13T22:15:42.682916+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: audit 2024-09-13T22:15:42.684373+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: audit 2024-09-13T22:15:42.685721+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: audit 2024-09-13T22:15:42.685923+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: audit 2024-09-13T22:15:42.686090+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:15:42.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:42 smithi007 bash[22722]: cluster 2024-09-13T22:15:42.712687+0000 mon.a (mon.0) 83 : cluster [INF] Manager daemon a is now available 2024-09-13T22:15:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:43 smithi007 bash[22722]: audit 2024-09-13T22:15:42.737030+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:15:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:43 smithi007 bash[22722]: audit 2024-09-13T22:15:42.753795+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:15:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:43 smithi007 bash[22722]: audit 2024-09-13T22:15:42.756362+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:15:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:43 smithi007 bash[22722]: cluster 2024-09-13T22:15:43.684708+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e11: a(active, since 1.01175s) 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-09-13T22:15:44.258 INFO:teuthology.orchestra.run.smithi007.stdout:Generating a dashboard self-signed certificate... 2024-09-13T22:15:45.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:44 smithi007 bash[22722]: audit 2024-09-13T22:15:43.683320+0000 mgr.a (mgr.14150) 1 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:15:45.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:44 smithi007 bash[22722]: audit 2024-09-13T22:15:43.697558+0000 mgr.a (mgr.14150) 2 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: debug 2024-09-13T22:15:45.503+0000 7f188fa80640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:22:15:45] ENGINE Error in HTTPServer.serve 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: Traceback (most recent call last): 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: self._connections.run(self.expiration_interval) 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: self._run(expiration_interval) 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:15:45.857 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: s = self.context.wrap_socket( 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: return self.sslsocket_class._create( 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: self.do_handshake() 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: self._sslobj.do_handshake() 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22972]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cluster 2024-09-13T22:15:44.732140+0000 mon.a (mon.0) 88 : cluster [DBG] mgrmap e12: a(active, since 2s) 2024-09-13T22:15:45.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cephadm 2024-09-13T22:15:45.277273+0000 mgr.a (mgr.14150) 3 : cephadm [INF] [13/Sep/2024:22:15:45] ENGINE Bus STARTING 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cephadm 2024-09-13T22:15:45.379083+0000 mgr.a (mgr.14150) 4 : cephadm [INF] [13/Sep/2024:22:15:45] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: audit 2024-09-13T22:15:45.493285+0000 mgr.a (mgr.14150) 5 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cephadm 2024-09-13T22:15:45.503653+0000 mgr.a (mgr.14150) 6 : cephadm [INF] [13/Sep/2024:22:15:45] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cephadm 2024-09-13T22:15:45.504068+0000 mgr.a (mgr.14150) 7 : cephadm [INF] [13/Sep/2024:22:15:45] ENGINE Bus STARTED 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: cephadm 2024-09-13T22:15:45.506566+0000 mgr.a (mgr.14150) 8 : cephadm [ERR] [13/Sep/2024:22:15:45] ENGINE Error in HTTPServer.serve 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: Traceback (most recent call last): 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: self._connections.run(self.expiration_interval) 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: self._run(expiration_interval) 2024-09-13T22:15:45.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: s = self.context.wrap_socket( 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: return self.sslsocket_class._create( 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: self.do_handshake() 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: self._sslobj.do_handshake() 2024-09-13T22:15:45.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:15:45.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: audit 2024-09-13T22:15:45.643734+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:15:45.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:45 smithi007 bash[22722]: audit 2024-09-13T22:15:45.648584+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:15:46.240 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T22:15:46.240 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-13T22:15:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:47 smithi007 bash[22722]: audit 2024-09-13T22:15:47.521594+0000 mgr.a (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:15:48.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$mHlzXvqGcuhfCdg.LwtUP.s9ieIUiqcvxp5K/9qauxjT2qUtalsWS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726265747, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T22:15:48.347 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-13T22:15:49.111 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:48 smithi007 bash[22722]: audit 2024-09-13T22:15:47.781469+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:15:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:49 smithi007 bash[22722]: cluster 2024-09-13T22:15:48.790326+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e13: a(active, since 6s) 2024-09-13T22:15:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:49 smithi007 bash[22722]: audit 2024-09-13T22:15:49.439281+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:15:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:49 smithi007 bash[22722]: audit 2024-09-13T22:15:49.667584+0000 mon.a (mon.0) 94 : audit [DBG] from='client.? 172.21.15.7:0/4197494721' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T22:15:50.239 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T22:15:50.239 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld does not appear to be present 2024-09-13T22:15:50.240 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: Password: 01aasci3gv 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:50.241 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config directory 2024-09-13T22:15:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:51 smithi007 bash[22722]: audit 2024-09-13T22:15:50.729564+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T22:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:15:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-13T22:15:52.360 INFO:tasks.cephadm:Fetching config... 2024-09-13T22:15:52.360 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:15:52.360 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T22:15:52.366 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T22:15:52.366 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:15:52.366 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T22:15:52.415 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T22:15:52.415 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:15:52.415 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T22:15:52.470 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T22:15:52.471 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:15:52.471 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T22:15:52.519 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T22:15:52.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:15:52.584 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:52.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:15:52.617 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:52.626 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:15:52.650 INFO:teuthology.orchestra.run.smithi171.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcWcMGRSfk7BzFrmn2ol6NUMWPaZJWQXCVn5cbALIDkBdxWSjIHa2a1pJ397Cnl/oIqF9WK7r9ZlucTRnTYY1wKnhaMjhxZL0qCgOHdtXff0X57xv+auj2ltBvPBZFVcIOZvSNa8bXKNt5+HnPzaI3POrRzie+T3tQoC82rzSQo9YjWvF7grKEXNHsTcPwN3/1CE/hKp4mibdtqczEVz7s+euRtW3K9Djq62VXCMU0tWClQ1kym25IacQI46Y8efW+wVMUBG/fqPTWOOC+e8wuBfBKDtAwkMxemEcxAcCp8HYvq/I2iIyzCyDXEbsa/uaEVjqpfnoqKr15IJX+a9fyG238cg10Y5ZbJKqgIK7/8LB5c1jUN1xwOBuMuMUBHDy/7AK2Gt8GYVGl7fHIdTB6ue/GMhymFJ9BoK5q207OXlm62HOgaUd42/jb1GJt8MjqZC8AYEdzPGSYqnJ+aye//rBn+WuNxUsDpf69tpv7CdKHO98Y8Nd4vyC4/LbqoFU= ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:15:52.660 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T22:15:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:52 smithi007 bash[22722]: audit 2024-09-13T22:15:51.800581+0000 mon.a (mon.0) 96 : audit [INF] from='client.? 172.21.15.7:0/3441468785' entity='client.admin' 2024-09-13T22:15:56.829 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:15:59.485 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T22:15:59.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T22:16:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:15:59 smithi007 bash[22722]: audit 2024-09-13T22:15:58.775014+0000 mon.a (mon.0) 97 : audit [INF] from='client.? 172.21.15.7:0/600560106' entity='client.admin' 2024-09-13T22:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.868844+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.874047+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.876187+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.883232+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.913965+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:01 smithi007 bash[22722]: audit 2024-09-13T22:16:00.922737+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:03 smithi007 bash[22722]: cluster 2024-09-13T22:16:02.687398+0000 mgr.a (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:04.338 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:05 smithi007 bash[22722]: cluster 2024-09-13T22:16:04.687818+0000 mgr.a (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:05 smithi007 bash[22722]: audit 2024-09-13T22:16:05.694928+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:05 smithi007 bash[22722]: audit 2024-09-13T22:16:05.695823+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:05 smithi007 bash[22722]: audit 2024-09-13T22:16:05.698330+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:05 smithi007 bash[22722]: audit 2024-09-13T22:16:05.699617+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:06.353 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2024-09-13T22:16:06.354 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:16:06.354 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2024-09-13T22:16:06.360 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:16:06.360 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:16:06.408 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2024-09-13T22:16:06.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch host add smithi131 2024-09-13T22:16:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: audit 2024-09-13T22:16:05.691075+0000 mgr.a (mgr.14150) 12 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: cephadm 2024-09-13T22:16:05.701037+0000 mgr.a (mgr.14150) 13 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: cephadm 2024-09-13T22:16:05.792841+0000 mgr.a (mgr.14150) 14 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: cephadm 2024-09-13T22:16:05.875040+0000 mgr.a (mgr.14150) 15 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: cephadm 2024-09-13T22:16:05.961844+0000 mgr.a (mgr.14150) 16 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: audit 2024-09-13T22:16:06.063879+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: audit 2024-09-13T22:16:06.066180+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:07.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:07 smithi007 bash[22722]: audit 2024-09-13T22:16:06.068826+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:08 smithi007 bash[22722]: cluster 2024-09-13T22:16:06.688162+0000 mgr.a (mgr.14150) 17 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:10 smithi007 bash[22722]: cluster 2024-09-13T22:16:08.688525+0000 mgr.a (mgr.14150) 18 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:11.144 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:12 smithi007 bash[22722]: cluster 2024-09-13T22:16:10.688952+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:13 smithi007 bash[22722]: audit 2024-09-13T22:16:12.526077+0000 mgr.a (mgr.14150) 20 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:14 smithi007 bash[22722]: cluster 2024-09-13T22:16:12.689322+0000 mgr.a (mgr.14150) 21 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:15 smithi007 bash[22722]: cephadm 2024-09-13T22:16:13.818576+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi131 2024-09-13T22:16:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:16 smithi007 bash[22722]: cluster 2024-09-13T22:16:14.689677+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:17.521 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi131' with addr '172.21.15.131' 2024-09-13T22:16:18.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T22:16:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:18 smithi007 bash[22722]: cluster 2024-09-13T22:16:16.690035+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:18 smithi007 bash[22722]: audit 2024-09-13T22:16:17.518206+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:18 smithi007 bash[22722]: cephadm 2024-09-13T22:16:17.519035+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi131 2024-09-13T22:16:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:18 smithi007 bash[22722]: audit 2024-09-13T22:16:17.519881+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:18 smithi007 bash[22722]: audit 2024-09-13T22:16:18.024969+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:20 smithi007 bash[22722]: cluster 2024-09-13T22:16:18.690498+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:20 smithi007 bash[22722]: audit 2024-09-13T22:16:19.553085+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:21 smithi007 bash[22722]: cluster 2024-09-13T22:16:20.690902+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:21 smithi007 bash[22722]: audit 2024-09-13T22:16:20.760087+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:22.874 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:16:24.190 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}] 2024-09-13T22:16:24.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:23 smithi007 bash[22722]: cluster 2024-09-13T22:16:22.691286+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:24.722 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi171 2024-09-13T22:16:24.722 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:16:24.722 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.conf 2024-09-13T22:16:24.729 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:16:24.729 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:16:24.777 INFO:tasks.cephadm:Adding host smithi171 to orchestrator... 2024-09-13T22:16:24.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch host add smithi171 2024-09-13T22:16:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:24 smithi007 bash[22722]: audit 2024-09-13T22:16:24.189419+0000 mgr.a (mgr.14150) 29 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:16:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:25 smithi007 bash[22722]: cluster 2024-09-13T22:16:24.691666+0000 mgr.a (mgr.14150) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.214735+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.219766+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.225429+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.230390+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.232014+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.233984+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.235685+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: cephadm 2024-09-13T22:16:26.238023+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: cephadm 2024-09-13T22:16:26.422485+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: cephadm 2024-09-13T22:16:26.579773+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.884074+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.889659+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:27 smithi007 bash[22722]: audit 2024-09-13T22:16:26.895891+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:28 smithi007 bash[22722]: cluster 2024-09-13T22:16:26.692021+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:28 smithi007 bash[22722]: cephadm 2024-09-13T22:16:26.731509+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:16:29.512 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:30.491 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:30 smithi007 bash[22722]: cluster 2024-09-13T22:16:28.692409+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:32 smithi007 bash[22722]: cluster 2024-09-13T22:16:30.692711+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:32 smithi007 bash[22722]: audit 2024-09-13T22:16:30.809753+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:33 smithi007 bash[22722]: cephadm 2024-09-13T22:16:32.154638+0000 mgr.a (mgr.14150) 39 : cephadm [INF] Deploying cephadm binary to smithi171 2024-09-13T22:16:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:34 smithi007 bash[22722]: cluster 2024-09-13T22:16:32.693063+0000 mgr.a (mgr.14150) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:35.853 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi171' with addr '172.21.15.171' 2024-09-13T22:16:36.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T22:16:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:36 smithi007 bash[22722]: cluster 2024-09-13T22:16:34.693432+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:36 smithi007 bash[22722]: audit 2024-09-13T22:16:35.851225+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:36 smithi007 bash[22722]: audit 2024-09-13T22:16:35.852834+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:37 smithi007 bash[22722]: cephadm 2024-09-13T22:16:35.852075+0000 mgr.a (mgr.14150) 42 : cephadm [INF] Added host smithi171 2024-09-13T22:16:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:37 smithi007 bash[22722]: audit 2024-09-13T22:16:36.400699+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:38 smithi007 bash[22722]: cluster 2024-09-13T22:16:36.693756+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:38 smithi007 bash[22722]: audit 2024-09-13T22:16:37.920534+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:40 smithi007 bash[22722]: cluster 2024-09-13T22:16:38.694171+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:40 smithi007 bash[22722]: audit 2024-09-13T22:16:39.228170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:41.168 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:42 smithi007 bash[22722]: cluster 2024-09-13T22:16:40.694606+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:42.469 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:16:42.469 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}, {"addr": "172.21.15.171", "hostname": "smithi171", "labels": [], "status": ""}] 2024-09-13T22:16:43.120 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T22:16:43.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T22:16:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:43 smithi007 bash[22722]: audit 2024-09-13T22:16:42.468874+0000 mgr.a (mgr.14150) 46 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:16:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:44 smithi007 bash[22722]: cluster 2024-09-13T22:16:42.695008+0000 mgr.a (mgr.14150) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: cluster 2024-09-13T22:16:44.695469+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.745411+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.750368+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.756488+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.761369+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.763139+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.765188+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:44.767134+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: cephadm 2024-09-13T22:16:44.769724+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: cephadm 2024-09-13T22:16:44.956922+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: cephadm 2024-09-13T22:16:45.116969+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:16:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: cephadm 2024-09-13T22:16:45.265405+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:16:46.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:45.413102+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:45.418826+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:46.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:45 smithi007 bash[22722]: audit 2024-09-13T22:16:45.424462+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:47.855 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:16:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:47 smithi007 bash[22722]: cluster 2024-09-13T22:16:46.695889+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:49.753 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-13T22:16:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:49 smithi007 bash[22722]: cluster 2024-09-13T22:16:48.696293+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:49 smithi007 bash[22722]: audit 2024-09-13T22:16:49.170870+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:16:50.403 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-13T22:16:50.403 INFO:tasks.cephadm:Adding mon.b on smithi131 2024-09-13T22:16:50.403 INFO:tasks.cephadm:Adding mon.c on smithi171 2024-09-13T22:16:50.403 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c' 2024-09-13T22:16:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:50 smithi007 bash[22722]: audit 2024-09-13T22:16:49.752868+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:16:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:50 smithi007 bash[22722]: cluster 2024-09-13T22:16:49.755951+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:16:51.632 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:16:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:51 smithi007 bash[22722]: cluster 2024-09-13T22:16:50.696711+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:52.939 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mon update... 2024-09-13T22:16:53.571 DEBUG:teuthology.orchestra.run.smithi131:mon.b> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T22:16:53.573 DEBUG:teuthology.orchestra.run.smithi171:mon.c> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T22:16:53.576 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T22:16:53.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: cluster 2024-09-13T22:16:52.697122+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:52.928469+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: cephadm 2024-09-13T22:16:52.933677+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c;count:3 2024-09-13T22:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:52.938599+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:52.940273+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:16:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:53.642513+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:53.644223+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:16:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:53.651983+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:16:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:53.656023+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:16:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:53 smithi007 bash[22722]: audit 2024-09-13T22:16:53.657572+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:16:54.841 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:16:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:54 smithi007 bash[22722]: cephadm 2024-09-13T22:16:53.659269+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi171 2024-09-13T22:16:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:55 smithi007 bash[22722]: cluster 2024-09-13T22:16:54.697504+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:56.337 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-13T22:16:56.338 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","modified":"2024-09-13T22:14:38.286464Z","created":"2024-09-13T22:14:38.286464Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:16:56.338 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-09-13T22:16:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:56 smithi007 bash[22722]: audit 2024-09-13T22:16:56.337255+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.171:0/1980002927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:16:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:16:57 smithi007 bash[22722]: cluster 2024-09-13T22:16:56.697905+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:16:58.299 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T22:16:58.299 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:16:59.524 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T22:16:59.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:16:59 smithi171 systemd[1]: Started Ceph mon.c for 2e3f4ff4-721d-11ef-bceb-c7b262605968. 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: cluster 2024-09-13T22:16:58.698257+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: audit 2024-09-13T22:16:59.545296+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: audit 2024-09-13T22:16:59.550837+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: audit 2024-09-13T22:16:59.556868+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: audit 2024-09-13T22:16:59.558263+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: audit 2024-09-13T22:16:59.560300+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:00 smithi007 bash[22722]: cephadm 2024-09-13T22:16:59.562484+0000 mgr.a (mgr.14150) 63 : cephadm [INF] Deploying daemon mon.b on smithi131 2024-09-13T22:17:00.977 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.955+0000 7f381a369c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:17:00.977 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.955+0000 7f381a369c80 0 ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 7 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.955+0000 7f381a369c80 0 pidfile_write: ignore empty --pid-file 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.959+0000 7f381a369c80 0 load: jerasure load: lrc 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Git sha 0 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: DB SUMMARY 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: DB Session ID: 6QEGZ8N1KV40NDKXAHML 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: CURRENT file: CURRENT 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T22:17:00.978 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.error_if_exists: 0 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.create_if_missing: 0 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.env: 0x563f32912940 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.info_log: 0x563f346376e0 2024-09-13T22:17:00.979 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.statistics: (nil) 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.use_fsync: 0 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-13T22:17:00.980 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.db_log_dir: 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.wal_dir: 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:17:00.981 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.write_buffer_manager: 0x563f34646dc0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:17:00.982 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.unordered_write: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.row_cache: None 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.wal_filter: None 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.two_write_queues: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.wal_compression: 0 2024-09-13T22:17:00.983 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.atomic_flush: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-13T22:17:00.984 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:17:00.986 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_open_files: -1 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:17:00.987 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Compression algorithms supported: 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kZSTD supported: 0 2024-09-13T22:17:00.988 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kXpressCompression supported: 0 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kZlibCompression supported: 1 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.merge_operator: 2024-09-13T22:17:00.989 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_filter: None 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563f34637320) 2024-09-13T22:17:00.990 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cache_index_and_filter_blocks: 1 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: pin_top_level_index_and_filter: 1 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: index_type: 0 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: data_block_index_type: 0 2024-09-13T22:17:00.991 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: index_shortening: 1 2024-09-13T22:17:00.992 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:17:00.992 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: checksum: 4 2024-09-13T22:17:00.992 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: no_block_cache: 0 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_cache: 0x563f3462d1f0 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_cache_name: BinnedLRUCache 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_cache_options: 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: capacity : 536870912 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: num_shard_bits : 4 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: strict_capacity_limit : 0 2024-09-13T22:17:00.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: high_pri_pool_ratio: 0.000 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_cache_compressed: (nil) 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: persistent_cache: (nil) 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_size: 4096 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_size_deviation: 10 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_restart_interval: 16 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: index_block_restart_interval: 1 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: metadata_block_size: 4096 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: partition_filters: 0 2024-09-13T22:17:00.994 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: use_delta_encoding: 1 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: filter_policy: bloomfilter 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: whole_key_filtering: 1 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: verify_compression: 0 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: read_amp_bytes_per_bit: 0 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: format_version: 5 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: enable_index_compression: 1 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: block_align: 0 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: max_auto_readahead_size: 262144 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: prepopulate_block_cache: 0 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: initial_auto_readahead_size: 8192 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: num_file_reads_for_auto_readahead: 2 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:17:00.995 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression: NoCompression 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.num_levels: 7 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:17:00.996 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:17:00.997 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:17:00.998 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:17:00.999 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:17:01.000 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:17:01.001 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:17:01.002 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 05b8d9bb-5081-4f41-935a-b20dc850f4d4 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265820967232, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T22:17:01.003 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265820967645, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726265820, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "05b8d9bb-5081-4f41-935a-b20dc850f4d4", "db_session_id": "6QEGZ8N1KV40NDKXAHML", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265820967748, "job": 1, "event": "recovery_finished"} 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563f34658e00 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 4 rocksdb: DB pointer 0x563f34758000 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f3810132640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f3810132640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: ** DB Stats ** 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:17:01.004 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: ** Compaction Stats [default] ** 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: ** Compaction Stats [default] ** 2024-09-13T22:17:01.005 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:17:01.006 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Block cache BinnedLRUCache@0x563f3462d1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.963+0000 7f381a369c80 0 using public_addr v2:172.21.15.171:0/0 -> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.967+0000 7f381a369c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] at bind addrs [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:01.007 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.967+0000 7f381a369c80 1 mon.c@-1(???) e0 preinit fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:01.148 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-13T22:17:01.148 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: e1 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: btime 2024-09-13T22:14:43:146571+0000 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: legacy client fscid: -1 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: No filesystems configured 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T22:17:01.149 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:10.688952+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:12.526077+0000 mgr.a (mgr.14150) 20 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:01.150 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:12.689322+0000 mgr.a (mgr.14150) 21 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:13.818576+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi131 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:14.689677+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:16.690035+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:17.518206+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:17.519035+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi131 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:17.519881+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:18.024969+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:18.690498+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:19.553085+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:20.690902+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:20.760087+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:22.691286+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.151 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:24.189419+0000 mgr.a (mgr.14150) 29 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:24.691666+0000 mgr.a (mgr.14150) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.214735+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.219766+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.225429+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.230390+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.232014+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.233984+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.235685+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:26.238023+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:26.422485+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:26.579773+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.884074+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.152 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.889659+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:26.895891+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:26.692021+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:26.731509+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:28.692409+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:30.692711+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:30.809753+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:32.154638+0000 mgr.a (mgr.14150) 39 : cephadm [INF] Deploying cephadm binary to smithi171 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:32.693063+0000 mgr.a (mgr.14150) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:34.693432+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:35.851225+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:35.852834+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:35.852075+0000 mgr.a (mgr.14150) 42 : cephadm [INF] Added host smithi171 2024-09-13T22:17:01.153 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:36.400699+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:36.693756+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:37.920534+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:38.694171+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:39.228170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:40.694606+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:42.468874+0000 mgr.a (mgr.14150) 46 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:42.695008+0000 mgr.a (mgr.14150) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:44.695469+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.745411+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.154 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.750368+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.756488+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.761369+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.763139+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.765188+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:44.767134+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:44.769724+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:44.956922+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:45.116969+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:01.155 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:45.265405+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:45.413102+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:45.418826+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:45.424462+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:46.695889+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:48.696293+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:49.170870+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:49.752868+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:49.755951+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:50.696711+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:52.697122+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:52.928469+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:52.933677+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c;count:3 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:52.938599+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.156 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:52.940273+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:53.642513+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:53.644223+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:53.651983+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:53.656023+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:53.657572+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:53.659269+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi171 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:54.697504+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:56.337255+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.171:0/1980002927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:56.697905+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.157 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cluster 2024-09-13T22:16:58.698257+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:59.545296+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:59.550837+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:59.556868+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:59.558263+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: audit 2024-09-13T22:16:59.560300+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: cephadm 2024-09-13T22:16:59.562484+0000 mgr.a (mgr.14150) 63 : cephadm [INF] Deploying daemon mon.b on smithi131 2024-09-13T22:17:01.158 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:00 smithi171 bash[25040]: debug 2024-09-13T22:17:00.991+0000 7f3813138640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T22:17:05.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:17:05.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:17:05.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:17:05.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:17:05.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:17:05.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:17:05.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:17:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:17:05.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:17:05.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.bloom_locality: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.ttl: 2592000 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.enable_blob_files: false 2024-09-13T22:17:05.787 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.min_blob_size: 0 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 45450d89-2d39-4303-bd6b-2c97216e3189 2024-09-13T22:17:05.788 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265825527867, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265825528338, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726265825, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "45450d89-2d39-4303-bd6b-2c97216e3189", "db_session_id": "ZM5B4YKR2IZNXKY7GDW3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726265825528464, "job": 1, "event": "recovery_finished"} 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af524d0e00 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 4 rocksdb: DB pointer 0x55af525d0000 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f5310acb640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f5310acb640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: ** DB Stats ** 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:05.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: ** Compaction Stats [default] ** 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: ** Compaction Stats [default] ** 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:17:05.790 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Block cache BinnedLRUCache@0x55af524a51f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:17:05.791 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.523+0000 7f531ad02c80 0 using public_addr v2:172.21.15.131:0/0 -> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.527+0000 7f531ad02c80 0 starting mon.b rank -1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.527+0000 7f531ad02c80 1 mon.b@-1(???) e0 preinit fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: e1 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: btime 2024-09-13T22:14:43:146571+0000 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: legacy client fscid: -1 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: 2024-09-13T22:17:05.792 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: No filesystems configured 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.547+0000 7f5313ad1640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:10.688952+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:12.526077+0000 mgr.a (mgr.14150) 20 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:05.793 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:12.689322+0000 mgr.a (mgr.14150) 21 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:13.818576+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi131 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:14.689677+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:16.690035+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:17.518206+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:17.519035+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi131 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:17.519881+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:18.024969+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:18.690498+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:19.553085+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:20.690902+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:20.760087+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:22.691286+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.794 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:24.189419+0000 mgr.a (mgr.14150) 29 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:17:05.795 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:24.691666+0000 mgr.a (mgr.14150) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.795 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.214735+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.795 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.219766+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.795 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.225429+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.795 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.230390+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.232014+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.233984+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.235685+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:26.238023+0000 mgr.a (mgr.14150) 31 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:26.422485+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:26.579773+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.884074+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.889659+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:26.895891+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.796 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:26.692021+0000 mgr.a (mgr.14150) 34 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:26.731509+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:28.692409+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:30.692711+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:30.809753+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:32.154638+0000 mgr.a (mgr.14150) 39 : cephadm [INF] Deploying cephadm binary to smithi171 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:32.693063+0000 mgr.a (mgr.14150) 40 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:34.693432+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:35.851225+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:35.852834+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:35.852075+0000 mgr.a (mgr.14150) 42 : cephadm [INF] Added host smithi171 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:36.400699+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:36.693756+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.797 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:37.920534+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:38.694171+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:39.228170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:40.694606+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:42.468874+0000 mgr.a (mgr.14150) 46 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:42.695008+0000 mgr.a (mgr.14150) 47 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:44.695469+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.745411+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.750368+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.756488+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.761369+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.763139+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.765188+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:05.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:44.767134+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:44.769724+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:44.956922+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:45.116969+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:45.265405+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:45.413102+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:45.418826+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:45.424462+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:46.695889+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:48.696293+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:49.170870+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:49.752868+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.7:0/2405896304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:49.755951+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:05.799 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:50.696711+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:52.697122+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:52.928469+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:52.933677+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi007:172.21.15.7=a;smithi131:172.21.15.131=b;smithi171:172.21.15.171=c;count:3 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:52.938599+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:52.940273+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:53.642513+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:53.644223+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:53.651983+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:53.656023+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:53.657572+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:53.659269+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi171 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:54.697504+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.800 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:56.337255+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.171:0/1980002927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:56.697905+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cluster 2024-09-13T22:16:58.698257+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:59.545296+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:59.550837+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:59.556868+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:59.558263+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: audit 2024-09-13T22:16:59.560300+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: cephadm 2024-09-13T22:16:59.562484+0000 mgr.a (mgr.14150) 63 : cephadm [INF] Deploying daemon mon.b on smithi131 2024-09-13T22:17:05.801 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:05 smithi131 bash[24745]: debug 2024-09-13T22:17:05.551+0000 7f5313ad1640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T22:17:06.061 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-09-13T22:17:06.061 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-13T22:17:06.061 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","modified":"2024-09-13T22:17:01.006186Z","created":"2024-09-13T22:14:38.286464Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T22:17:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:00.698647+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:01.011917+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:01.012282+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:01.031528+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:01.249715+0000 mon.a (mon.0) 161 : audit [DBG] from='client.? 172.21.15.171:0/3075950726' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:02.001314+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:02.699061+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:03.001262+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:03.002778+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:04.001327+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:04.699455+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:05.001460+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:05.560125+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:06.001399+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.051832+0000 mon.a (mon.0) 168 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058209+0000 mon.a (mon.0) 169 : cluster [DBG] monmap epoch 2 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058241+0000 mon.a (mon.0) 170 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058283+0000 mon.a (mon.0) 171 : cluster [DBG] last_changed 2024-09-13T22:17:01.006186+0000 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058336+0000 mon.a (mon.0) 172 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058356+0000 mon.a (mon.0) 173 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058374+0000 mon.a (mon.0) 174 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058389+0000 mon.a (mon.0) 175 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:06.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.058407+0000 mon.a (mon.0) 176 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.059427+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.059481+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.059772+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.060021+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:06.067135+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:06.073751+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:06.081337+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:06 smithi007 bash[22722]: audit 2024-09-13T22:17:06.088054+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:00.698647+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:01.011917+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:01.012282+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:01.031528+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:01.249715+0000 mon.a (mon.0) 161 : audit [DBG] from='client.? 172.21.15.171:0/3075950726' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:02.001314+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:02.699061+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:03.001262+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:03.002778+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:04.001327+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:04.699455+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:05.001460+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:05.560125+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:06.001399+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.051832+0000 mon.a (mon.0) 168 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058209+0000 mon.a (mon.0) 169 : cluster [DBG] monmap epoch 2 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058241+0000 mon.a (mon.0) 170 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058283+0000 mon.a (mon.0) 171 : cluster [DBG] last_changed 2024-09-13T22:17:01.006186+0000 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058336+0000 mon.a (mon.0) 172 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058356+0000 mon.a (mon.0) 173 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058374+0000 mon.a (mon.0) 174 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058389+0000 mon.a (mon.0) 175 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.058407+0000 mon.a (mon.0) 176 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.059427+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.059481+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.059772+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.060021+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:06.067135+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:06.073751+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:06.081337+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:06.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:06 smithi171 bash[25040]: audit 2024-09-13T22:17:06.088054+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:07 smithi007 bash[22722]: audit 2024-09-13T22:17:06.177813+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:07 smithi007 bash[22722]: audit 2024-09-13T22:17:06.560176+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:07 smithi007 bash[22722]: audit 2024-09-13T22:17:07.001739+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:07 smithi171 bash[25040]: audit 2024-09-13T22:17:06.177813+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:07 smithi171 bash[25040]: audit 2024-09-13T22:17:06.560176+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:07 smithi171 bash[25040]: audit 2024-09-13T22:17:07.001739+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:07.820 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T22:17:07.821 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:17:12.210 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T22:17:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:06.699850+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:07.566867+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:07.567493+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:07.567675+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:07.587647+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:07.587891+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:08.560645+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:08.700231+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:09.560919+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:10.560785+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:10.700612+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:11.561033+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.561014+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.587725+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594139+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594171+0000 mon.a (mon.0) 200 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594188+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594209+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594230+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594249+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594265+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594282+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.594326+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.615254+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.615307+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.615572+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 89s) 2024-09-13T22:17:12.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.615872+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.623177+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.623233+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.623275+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] is down (out of quorum) 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.628067+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.634114+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.640119+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.646218+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.651592+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.653141+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:12.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:12 smithi007 bash[22722]: audit 2024-09-13T22:17:12.654774+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:06.699850+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:07.566867+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:07.567493+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:07.567675+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:07.587647+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:07.587891+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:08.560645+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:08.700231+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:09.560919+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:10.560785+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:10.700612+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:11.561033+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.561014+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.587725+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594139+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594171+0000 mon.a (mon.0) 200 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594188+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594209+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594230+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594249+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594265+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594282+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:13.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.594326+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.615254+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.615307+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.615572+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 89s) 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.615872+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.623177+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.623233+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.623275+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] is down (out of quorum) 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.628067+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.634114+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.640119+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.646218+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.651592+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.653141+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:12 smithi171 bash[25040]: audit 2024-09-13T22:17:12.654774+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:13.724 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 3 2024-09-13T22:17:13.725 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-13T22:17:13.725 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":3,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","modified":"2024-09-13T22:17:07.560190Z","created":"2024-09-13T22:14:38.286464Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T22:17:14.272 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T22:17:14.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T22:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.657239+0000 mgr.a (mgr.14150) 70 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.658075+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.659830+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cluster 2024-09-13T22:17:12.700999+0000 mgr.a (mgr.14150) 73 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.923264+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.923761+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:12.924347+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.125451+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.128766+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.131749+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.135035+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.137760+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.140492+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.144581+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.199840+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.205230+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.210629+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.215873+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:13.216341+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.216752+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.217953+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.219117+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: cephadm 2024-09-13T22:17:13.220278+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring daemon mon.a on smithi007 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.561463+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:14 smithi007 bash[22722]: audit 2024-09-13T22:17:13.724139+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.171:0/668998554' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.657239+0000 mgr.a (mgr.14150) 70 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:17:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.658075+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:17:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.659830+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:17:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cluster 2024-09-13T22:17:12.700999+0000 mgr.a (mgr.14150) 73 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.923264+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.923761+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:12.924347+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.125451+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.128766+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.131749+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.135035+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.137760+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.140492+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.144581+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.199840+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.205230+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.210629+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.215873+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:13.216341+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.216752+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.217953+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.219117+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: cephadm 2024-09-13T22:17:13.220278+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring daemon mon.a on smithi007 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.561463+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:14.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:14 smithi171 bash[25040]: audit 2024-09-13T22:17:13.724139+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.171:0/668998554' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:00.698647+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:01.011917+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:01.012282+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:01.031528+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:01.249715+0000 mon.a (mon.0) 161 : audit [DBG] from='client.? 172.21.15.171:0/3075950726' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:02.001314+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:02.699061+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:03.001262+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:03.002778+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:04.001327+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:04.699455+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:05.001460+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:05.560125+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.001399+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.051832+0000 mon.a (mon.0) 168 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058209+0000 mon.a (mon.0) 169 : cluster [DBG] monmap epoch 2 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058241+0000 mon.a (mon.0) 170 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058283+0000 mon.a (mon.0) 171 : cluster [DBG] last_changed 2024-09-13T22:17:01.006186+0000 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058336+0000 mon.a (mon.0) 172 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058356+0000 mon.a (mon.0) 173 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058374+0000 mon.a (mon.0) 174 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:15.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058389+0000 mon.a (mon.0) 175 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.058407+0000 mon.a (mon.0) 176 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.059427+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.059481+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.059772+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.060021+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:15.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.067135+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.073751+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.081337+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.088054+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.177813+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:06.560176+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:07.001739+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:06.699850+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:07.566867+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:07.567493+0000 mon.a (mon.0) 190 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:07.567675+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:07.587647+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:07.587891+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:17:15.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:08.560645+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:08.700231+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:09.560919+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:10.560785+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:10.700612+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:11.561033+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.561014+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.587725+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594139+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594171+0000 mon.a (mon.0) 200 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594188+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594209+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594230+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:15.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594249+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594265+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594282+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.594326+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.615254+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.615307+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.615572+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 89s) 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.615872+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.623177+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.623233+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.623275+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] is down (out of quorum) 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.628067+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.634114+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.640119+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.646218+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.651592+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.653141+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:12.654774+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.657239+0000 mgr.a (mgr.14150) 70 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.658075+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.659830+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cluster 2024-09-13T22:17:12.700999+0000 mgr.a (mgr.14150) 73 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.923264+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.923761+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:12.924347+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:17:15.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.125451+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.128766+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.131749+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.135035+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.137760+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.140492+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.144581+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.199840+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.205230+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.210629+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.215873+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:13.216341+0000 mgr.a (mgr.14150) 77 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.216752+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:15.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.217953+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:15.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.219117+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:15.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: cephadm 2024-09-13T22:17:13.220278+0000 mgr.a (mgr.14150) 78 : cephadm [INF] Reconfiguring daemon mon.a on smithi007 2024-09-13T22:17:15.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.561463+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:15.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:14 smithi131 bash[24745]: audit 2024-09-13T22:17:13.724139+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.15.171:0/668998554' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:17:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:09.562446+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.599944+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.600481+0000 mon.a (mon.0) 239 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.600756+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.621743+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635103+0000 mon.a (mon.0) 241 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635131+0000 mon.a (mon.0) 242 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635152+0000 mon.a (mon.0) 243 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635167+0000 mon.a (mon.0) 244 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635185+0000 mon.a (mon.0) 245 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635203+0000 mon.a (mon.0) 246 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635225+0000 mon.a (mon.0) 247 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635246+0000 mon.a (mon.0) 248 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.635266+0000 mon.a (mon.0) 249 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.636270+0000 mon.a (mon.0) 250 : cluster [DBG] fsmap 2024-09-13T22:17:15.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.636323+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:15.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.636587+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-13T22:17:15.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.636872+0000 mon.a (mon.0) 253 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T22:17:15.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.636908+0000 mon.a (mon.0) 254 : cluster [INF] Cluster is now healthy 2024-09-13T22:17:15.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:15 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.642596+0000 mon.a (mon.0) 255 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:09.562446+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.599944+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.600481+0000 mon.a (mon.0) 239 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.600756+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.621743+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635103+0000 mon.a (mon.0) 241 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635131+0000 mon.a (mon.0) 242 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635152+0000 mon.a (mon.0) 243 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635167+0000 mon.a (mon.0) 244 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635185+0000 mon.a (mon.0) 245 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635203+0000 mon.a (mon.0) 246 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635225+0000 mon.a (mon.0) 247 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635246+0000 mon.a (mon.0) 248 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.635266+0000 mon.a (mon.0) 249 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.636270+0000 mon.a (mon.0) 250 : cluster [DBG] fsmap 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.636323+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:15.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.636587+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-13T22:17:15.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.636872+0000 mon.a (mon.0) 253 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T22:17:15.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.636908+0000 mon.a (mon.0) 254 : cluster [INF] Cluster is now healthy 2024-09-13T22:17:15.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:15 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.642596+0000 mon.a (mon.0) 255 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:09.562446+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.599944+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.600481+0000 mon.a (mon.0) 239 : cluster [INF] mon.a calling monitor election 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.600756+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.621743+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635103+0000 mon.a (mon.0) 241 : cluster [DBG] monmap epoch 3 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635131+0000 mon.a (mon.0) 242 : cluster [DBG] fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635152+0000 mon.a (mon.0) 243 : cluster [DBG] last_changed 2024-09-13T22:17:07.560190+0000 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635167+0000 mon.a (mon.0) 244 : cluster [DBG] created 2024-09-13T22:14:38.286464+0000 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635185+0000 mon.a (mon.0) 245 : cluster [DBG] min_mon_release 19 (squid) 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635203+0000 mon.a (mon.0) 246 : cluster [DBG] election_strategy: 1 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635225+0000 mon.a (mon.0) 247 : cluster [DBG] 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635246+0000 mon.a (mon.0) 248 : cluster [DBG] 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-09-13T22:17:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.635266+0000 mon.a (mon.0) 249 : cluster [DBG] 2: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.636270+0000 mon.a (mon.0) 250 : cluster [DBG] fsmap 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.636323+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.636587+0000 mon.a (mon.0) 252 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.636872+0000 mon.a (mon.0) 253 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.636908+0000 mon.a (mon.0) 254 : cluster [INF] Cluster is now healthy 2024-09-13T22:17:15.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:15 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.642596+0000 mon.a (mon.0) 255 : cluster [INF] overall HEALTH_OK 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: cluster 2024-09-13T22:17:14.701422+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.561659+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.659035+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.665621+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.667515+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.668946+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:16 smithi171 bash[25040]: audit 2024-09-13T22:17:15.670263+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: cluster 2024-09-13T22:17:14.701422+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.561659+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.659035+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.665621+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.667515+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.668946+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:16 smithi007 bash[22722]: audit 2024-09-13T22:17:15.670263+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: cluster 2024-09-13T22:17:14.701422+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.561659+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.659035+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.665621+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.667515+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.668946+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:16 smithi131 bash[24745]: audit 2024-09-13T22:17:15.670263+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:17 smithi131 bash[24745]: cephadm 2024-09-13T22:17:15.666973+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T22:17:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:17 smithi131 bash[24745]: cephadm 2024-09-13T22:17:15.672013+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi131 2024-09-13T22:17:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:17 smithi007 bash[22722]: cephadm 2024-09-13T22:17:15.666973+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T22:17:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:17 smithi007 bash[22722]: cephadm 2024-09-13T22:17:15.672013+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi131 2024-09-13T22:17:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:17 smithi171 bash[25040]: cephadm 2024-09-13T22:17:15.666973+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-13T22:17:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:17 smithi171 bash[25040]: cephadm 2024-09-13T22:17:15.672013+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi131 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: cluster 2024-09-13T22:17:16.701885+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: audit 2024-09-13T22:17:17.916836+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: audit 2024-09-13T22:17:17.923678+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: audit 2024-09-13T22:17:17.925686+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: audit 2024-09-13T22:17:17.927359+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:18 smithi171 bash[25040]: audit 2024-09-13T22:17:17.929042+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: cluster 2024-09-13T22:17:16.701885+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: audit 2024-09-13T22:17:17.916836+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: audit 2024-09-13T22:17:17.923678+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: audit 2024-09-13T22:17:17.925686+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: audit 2024-09-13T22:17:17.927359+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:18 smithi007 bash[22722]: audit 2024-09-13T22:17:17.929042+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:19.011 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:17:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: cluster 2024-09-13T22:17:16.701885+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: audit 2024-09-13T22:17:17.916836+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: audit 2024-09-13T22:17:17.923678+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: audit 2024-09-13T22:17:17.925686+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:17:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: audit 2024-09-13T22:17:17.927359+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:17:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:18 smithi131 bash[24745]: audit 2024-09-13T22:17:17.929042+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:19 smithi171 bash[25040]: cephadm 2024-09-13T22:17:17.925108+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T22:17:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:19 smithi171 bash[25040]: cephadm 2024-09-13T22:17:17.931030+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi171 2024-09-13T22:17:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:19 smithi007 bash[22722]: cephadm 2024-09-13T22:17:17.925108+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T22:17:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:19 smithi007 bash[22722]: cephadm 2024-09-13T22:17:17.931030+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi171 2024-09-13T22:17:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:19 smithi131 bash[24745]: cephadm 2024-09-13T22:17:17.925108+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-13T22:17:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:19 smithi131 bash[24745]: cephadm 2024-09-13T22:17:17.931030+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi171 2024-09-13T22:17:20.318 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:20.318 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-13T22:17:20.318 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 2e3f4ff4-721d-11ef-bceb-c7b262605968 2024-09-13T22:17:20.319 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: cluster 2024-09-13T22:17:18.702360+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.262699+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.269164+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.271369+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.274551+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.276220+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.284875+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:20 smithi007 bash[22722]: audit 2024-09-13T22:17:20.318617+0000 mon.a (mon.0) 273 : audit [DBG] from='client.? 172.21.15.7:0/1659447668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:20.942 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T22:17:20.943 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:17:20.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:17:20.957 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:17:20.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:21.014 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:17:21.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: cluster 2024-09-13T22:17:18.702360+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.262699+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.269164+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.271369+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.274551+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.276220+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.284875+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:20 smithi131 bash[24745]: audit 2024-09-13T22:17:20.318617+0000 mon.a (mon.0) 273 : audit [DBG] from='client.? 172.21.15.7:0/1659447668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:21.028 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:17:21.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: cluster 2024-09-13T22:17:18.702360+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.262699+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.269164+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.271369+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.274551+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.276220+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.284875+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:20 smithi171 bash[25040]: audit 2024-09-13T22:17:20.318617+0000 mon.a (mon.0) 273 : audit [DBG] from='client.? 172.21.15.7:0/1659447668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:21.082 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:17:21.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:17:21.097 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:17:21.097 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:17:21.153 INFO:tasks.cephadm:Adding mgr.a on smithi007 2024-09-13T22:17:21.153 INFO:tasks.cephadm:Adding mgr.b on smithi131 2024-09-13T22:17:21.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi007=a;smithi131=b' 2024-09-13T22:17:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:22 smithi007 bash[22722]: cluster 2024-09-13T22:17:20.702708+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:22 smithi131 bash[24745]: cluster 2024-09-13T22:17:20.702708+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:22 smithi171 bash[25040]: cluster 2024-09-13T22:17:20.702708+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:24.911 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T22:17:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:24 smithi007 bash[22722]: cluster 2024-09-13T22:17:22.703138+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:25.014 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:24 smithi171 bash[25040]: cluster 2024-09-13T22:17:22.703138+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:24 smithi131 bash[24745]: cluster 2024-09-13T22:17:22.703138+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:26.329 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mgr update... 2024-09-13T22:17:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:26 smithi171 bash[25040]: cluster 2024-09-13T22:17:24.703555+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:26 smithi171 bash[25040]: audit 2024-09-13T22:17:26.328323+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:26 smithi171 bash[25040]: audit 2024-09-13T22:17:26.330091+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:26.887 DEBUG:teuthology.orchestra.run.smithi131:mgr.b> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@mgr.b.service 2024-09-13T22:17:26.888 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T22:17:26.889 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T22:17:26.889 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:17:26.894 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:26 smithi131 bash[24745]: cluster 2024-09-13T22:17:24.703555+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:26.894 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:26 smithi131 bash[24745]: audit 2024-09-13T22:17:26.328323+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:26.895 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:26 smithi131 bash[24745]: audit 2024-09-13T22:17:26.330091+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:26.896 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:17:26.896 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 22:06:22.335279694 +0000 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 22:06:22.331279730 +0000 2024-09-13T22:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 22:06:22.331279730 +0000 2024-09-13T22:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-13T22:17:26.944 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:17:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:26 smithi007 bash[22722]: cluster 2024-09-13T22:17:24.703555+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:26 smithi007 bash[22722]: audit 2024-09-13T22:17:26.328323+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:26 smithi007 bash[22722]: audit 2024-09-13T22:17:26.330091+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:26.966 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T22:17:26.966 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T22:17:26.966 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000260968 s, 2.0 MB/s 2024-09-13T22:17:26.967 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:17:27.015 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-13T22:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 22:06:23.127272620 +0000 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 22:06:22.851275085 +0000 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 22:06:22.851275085 +0000 2024-09-13T22:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-13T22:17:27.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:17:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T22:17:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T22:17:27.121 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000253001 s, 2.0 MB/s 2024-09-13T22:17:27.122 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:17:27.172 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 22:06:23.611268296 +0000 2024-09-13T22:17:27.218 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 22:06:23.363270512 +0000 2024-09-13T22:17:27.219 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 22:06:23.363270512 +0000 2024-09-13T22:17:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-13T22:17:27.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:17:27.273 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T22:17:27.273 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T22:17:27.273 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000313338 s, 1.6 MB/s 2024-09-13T22:17:27.274 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:17:27.323 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-13T22:17:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:17:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.370 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-13T22:17:27.370 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.370 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 22:06:24.099263937 +0000 2024-09-13T22:17:27.371 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 22:06:23.843266224 +0000 2024-09-13T22:17:27.371 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 22:06:23.843266224 +0000 2024-09-13T22:17:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2024-09-13T22:17:27.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:17:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T22:17:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T22:17:27.425 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000297068 s, 1.7 MB/s 2024-09-13T22:17:27.427 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:17:27.479 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T22:17:27.479 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:17:27.484 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:17:27.485 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-13T22:17:27.530 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:17:27.530 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.530 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-13T22:17:27.530 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.531 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 22:06:20.762087360 +0000 2024-09-13T22:17:27.531 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 22:06:20.514089570 +0000 2024-09-13T22:17:27.531 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 22:06:20.514089570 +0000 2024-09-13T22:17:27.531 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-13T22:17:27.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:17:27.581 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T22:17:27.582 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T22:17:27.582 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000255381 s, 2.0 MB/s 2024-09-13T22:17:27.583 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:17:27.631 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 22:06:21.258082941 +0000 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 22:06:20.994085293 +0000 2024-09-13T22:17:27.680 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 22:06:20.994085293 +0000 2024-09-13T22:17:27.681 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-13T22:17:27.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:17:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T22:17:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T22:17:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000231655 s, 2.2 MB/s 2024-09-13T22:17:27.731 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:17:27.779 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-13T22:17:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:26.319083+0000 mgr.a (mgr.14150) 89 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=a;smithi131=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: cephadm 2024-09-13T22:17:26.322108+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Saving service mgr spec with placement smithi007=a;smithi131=b;count:2 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.045392+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.046520+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.052353+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.054124+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.055864+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.058266+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:27 smithi131 bash[24745]: audit 2024-09-13T22:17:27.059435+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 22:06:21.746078594 +0000 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 22:06:21.486080910 +0000 2024-09-13T22:17:27.787 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 22:06:21.486080910 +0000 2024-09-13T22:17:27.788 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-13T22:17:27.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:17:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T22:17:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T22:17:27.838 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000310183 s, 1.7 MB/s 2024-09-13T22:17:27.839 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:17:27.887 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 22:06:22.274073889 +0000 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 22:06:21.986076455 +0000 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 22:06:21.986076455 +0000 2024-09-13T22:17:27.934 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-09-13T22:17:27.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:26.319083+0000 mgr.a (mgr.14150) 89 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=a;smithi131=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: cephadm 2024-09-13T22:17:26.322108+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Saving service mgr spec with placement smithi007=a;smithi131=b;count:2 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.045392+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.046520+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.052353+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.054124+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.055864+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.058266+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:27 smithi007 bash[22722]: audit 2024-09-13T22:17:27.059435+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:27.988 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T22:17:27.989 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T22:17:27.989 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000343392 s, 1.5 MB/s 2024-09-13T22:17:27.989 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:17:28.040 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-13T22:17:28.040 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:17:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:26.319083+0000 mgr.a (mgr.14150) 89 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi007=a;smithi131=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: cephadm 2024-09-13T22:17:26.322108+0000 mgr.a (mgr.14150) 90 : cephadm [INF] Saving service mgr spec with placement smithi007=a;smithi131=b;count:2 2024-09-13T22:17:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.045392+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.046520+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.052353+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.054124+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.055864+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:17:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.058266+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:27 smithi171 bash[25040]: audit 2024-09-13T22:17:27.059435+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:28.047 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:17:28.047 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-13T22:17:28.094 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:17:28.094 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:28.094 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-09-13T22:17:28.095 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:28.095 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-13 22:06:21.748532070 +0000 2024-09-13T22:17:28.095 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-13 22:06:21.504534249 +0000 2024-09-13T22:17:28.095 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-13 22:06:21.504534249 +0000 2024-09-13T22:17:28.095 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-13T22:17:28.095 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:17:28.148 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-13T22:17:28.149 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-13T22:17:28.149 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000431129 s, 1.2 MB/s 2024-09-13T22:17:28.150 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:17:28.199 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-13 22:06:22.228527783 +0000 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-13 22:06:21.980529998 +0000 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-13 22:06:21.980529998 +0000 2024-09-13T22:17:28.246 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-13T22:17:28.246 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:17:28.300 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-13T22:17:28.301 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-13T22:17:28.301 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000370404 s, 1.4 MB/s 2024-09-13T22:17:28.302 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:17:28.351 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-13T22:17:28.397 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:17:28.397 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:28.397 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-13T22:17:28.397 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:28.398 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-13 22:06:22.736523245 +0000 2024-09-13T22:17:28.398 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-13 22:06:22.476525568 +0000 2024-09-13T22:17:28.398 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-13 22:06:22.476525568 +0000 2024-09-13T22:17:28.398 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-13T22:17:28.398 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:17:28.452 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-13T22:17:28.452 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-13T22:17:28.452 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000432949 s, 1.2 MB/s 2024-09-13T22:17:28.453 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:17:28.504 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-13 22:06:23.228518850 +0000 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-13 22:06:22.968521173 +0000 2024-09-13T22:17:28.553 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-13 22:06:22.968521173 +0000 2024-09-13T22:17:28.554 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-13T22:17:28.554 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:17:28.608 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-13T22:17:28.608 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-13T22:17:28.608 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000351896 s, 1.5 MB/s 2024-09-13T22:17:28.610 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:17:28.658 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-13T22:17:28.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:17:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:28 smithi171 bash[25040]: cluster 2024-09-13T22:17:26.703935+0000 mgr.a (mgr.14150) 91 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:28 smithi171 bash[25040]: cephadm 2024-09-13T22:17:27.060820+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi131 2024-09-13T22:17:28.829 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:28 smithi131 bash[24745]: cluster 2024-09-13T22:17:26.703935+0000 mgr.a (mgr.14150) 91 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:28.829 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:28 smithi131 bash[24745]: cephadm 2024-09-13T22:17:27.060820+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi131 2024-09-13T22:17:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:28 smithi007 bash[22722]: cluster 2024-09-13T22:17:26.703935+0000 mgr.a (mgr.14150) 91 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:28 smithi007 bash[22722]: cephadm 2024-09-13T22:17:27.060820+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi131 2024-09-13T22:17:29.562 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:29 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:17:29.921 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:29 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:17:29.921 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:29 smithi131 systemd[1]: Started Ceph mgr.b for 2e3f4ff4-721d-11ef-bceb-c7b262605968. 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[25250]: debug 2024-09-13T22:17:30.803+0000 7fbe2a049640 1 -- 172.21.15.131:0/3836256798 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56377a2d90e0 con 0x56377a2db800 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[25250]: debug 2024-09-13T22:17:30.915+0000 7fbe2c8b3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: cluster 2024-09-13T22:17:28.704324+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: audit 2024-09-13T22:17:29.853142+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: audit 2024-09-13T22:17:29.859858+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: audit 2024-09-13T22:17:29.866808+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: audit 2024-09-13T22:17:29.873203+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.920 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:30 smithi131 bash[24745]: audit 2024-09-13T22:17:29.962186+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: cluster 2024-09-13T22:17:28.704324+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: audit 2024-09-13T22:17:29.853142+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: audit 2024-09-13T22:17:29.859858+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: audit 2024-09-13T22:17:29.866808+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: audit 2024-09-13T22:17:29.873203+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:30 smithi007 bash[22722]: audit 2024-09-13T22:17:29.962186+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: cluster 2024-09-13T22:17:28.704324+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: audit 2024-09-13T22:17:29.853142+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: audit 2024-09-13T22:17:29.859858+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: audit 2024-09-13T22:17:29.866808+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: audit 2024-09-13T22:17:29.873203+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:30 smithi171 bash[25040]: audit 2024-09-13T22:17:29.962186+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:32.532 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:32 smithi131 bash[25250]: debug 2024-09-13T22:17:32.095+0000 7fbe2c8b3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:17:32.532 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:32 smithi131 bash[25250]: debug 2024-09-13T22:17:32.159+0000 7fbe2c8b3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:17:32.533 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:32 smithi131 bash[25250]: debug 2024-09-13T22:17:32.307+0000 7fbe2c8b3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:17:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:32 smithi007 bash[22722]: cluster 2024-09-13T22:17:30.704703+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:32.958 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:32 smithi131 bash[24745]: cluster 2024-09-13T22:17:30.704703+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:32 smithi171 bash[25040]: cluster 2024-09-13T22:17:30.704703+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:33.282 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:32 smithi131 bash[25250]: debug 2024-09-13T22:17:32.955+0000 7fbe2c8b3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:17:33.282 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.027+0000 7fbe2c8b3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:17:33.283 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.095+0000 7fbe2c8b3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:17:33.394 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:17:33.640 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.279+0000 7fbe2c8b3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:17:33.640 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.355+0000 7fbe2c8b3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:17:33.640 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.423+0000 7fbe2c8b3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:17:33.942 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[24745]: audit 2024-09-13T22:17:32.635289+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:33.942 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[24745]: cluster 2024-09-13T22:17:32.705093+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:33.942 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.675+0000 7fbe2c8b3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:17:33.942 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.743+0000 7fbe2c8b3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:17:33.942 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:33 smithi131 bash[25250]: debug 2024-09-13T22:17:33.935+0000 7fbe2c8b3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:17:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:33 smithi007 bash[22722]: audit 2024-09-13T22:17:32.635289+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:33 smithi007 bash[22722]: cluster 2024-09-13T22:17:32.705093+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:33 smithi171 bash[25040]: audit 2024-09-13T22:17:32.635289+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:33 smithi171 bash[25040]: cluster 2024-09-13T22:17:32.705093+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:34.265 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.015+0000 7fbe2c8b3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:17:34.533 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.259+0000 7fbe2c8b3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:17:34.533 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.435+0000 7fbe2c8b3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:17:34.858 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.599+0000 7fbe2c8b3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:17:34.859 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.675+0000 7fbe2c8b3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:17:34.859 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:34 smithi131 bash[25250]: debug 2024-09-13T22:17:34.855+0000 7fbe2c8b3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:17:35.954 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:35 smithi131 bash[25250]: debug 2024-09-13T22:17:35.651+0000 7fbe2c8b3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:17:35.954 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:35 smithi131 bash[25250]: debug 2024-09-13T22:17:35.727+0000 7fbe2c8b3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:17:36.282 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:35 smithi131 bash[25250]: debug 2024-09-13T22:17:35.951+0000 7fbe2c8b3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:17:36.282 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[25250]: debug 2024-09-13T22:17:36.023+0000 7fbe2c8b3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: cluster 2024-09-13T22:17:34.705501+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.187884+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.195070+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.196735+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.198403+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.207312+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: cephadm 2024-09-13T22:17:35.272070+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.272660+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.273830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: audit 2024-09-13T22:17:35.274797+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[24745]: cephadm 2024-09-13T22:17:35.275917+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi007 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: cluster 2024-09-13T22:17:34.705501+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.187884+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.195070+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.196735+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.198403+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.207312+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: cephadm 2024-09-13T22:17:35.272070+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-13T22:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.272660+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.273830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: audit 2024-09-13T22:17:35.274797+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:36 smithi007 bash[22722]: cephadm 2024-09-13T22:17:35.275917+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi007 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: cluster 2024-09-13T22:17:34.705501+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.187884+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.195070+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.196735+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.198403+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.207312+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: cephadm 2024-09-13T22:17:35.272070+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-13T22:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.272660+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.273830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: audit 2024-09-13T22:17:35.274797+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:36 smithi171 bash[25040]: cephadm 2024-09-13T22:17:35.275917+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi007 2024-09-13T22:17:36.782 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[25250]: debug 2024-09-13T22:17:36.411+0000 7fbe2c8b3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:17:36.782 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:17:36 smithi131 bash[25250]: debug 2024-09-13T22:17:36.487+0000 7fbe2c8b3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:17:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:17:37.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-13T22:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:37 smithi007 bash[22722]: cluster 2024-09-13T22:17:36.513800+0000 mon.a (mon.0) 297 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:37 smithi007 bash[22722]: audit 2024-09-13T22:17:36.516008+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:37 smithi007 bash[22722]: audit 2024-09-13T22:17:36.516736+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:37 smithi007 bash[22722]: audit 2024-09-13T22:17:36.517878+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:37 smithi007 bash[22722]: audit 2024-09-13T22:17:36.518409+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:17:37.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:37 smithi131 bash[24745]: cluster 2024-09-13T22:17:36.513800+0000 mon.a (mon.0) 297 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:37 smithi131 bash[24745]: audit 2024-09-13T22:17:36.516008+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:37 smithi131 bash[24745]: audit 2024-09-13T22:17:36.516736+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:37 smithi131 bash[24745]: audit 2024-09-13T22:17:36.517878+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:37 smithi131 bash[24745]: audit 2024-09-13T22:17:36.518409+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:37 smithi171 bash[25040]: cluster 2024-09-13T22:17:36.513800+0000 mon.a (mon.0) 297 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:37 smithi171 bash[25040]: audit 2024-09-13T22:17:36.516008+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:37 smithi171 bash[25040]: audit 2024-09-13T22:17:36.516736+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:37 smithi171 bash[25040]: audit 2024-09-13T22:17:36.517878+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:37 smithi171 bash[25040]: audit 2024-09-13T22:17:36.518409+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.131:0/3310553639' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:17:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:38 smithi007 bash[22722]: cluster 2024-09-13T22:17:36.705870+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:38 smithi007 bash[22722]: cluster 2024-09-13T22:17:37.206193+0000 mon.a (mon.0) 298 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-13T22:17:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:38 smithi007 bash[22722]: audit 2024-09-13T22:17:37.206774+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:17:38.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:38 smithi131 bash[24745]: cluster 2024-09-13T22:17:36.705870+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:38.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:38 smithi131 bash[24745]: cluster 2024-09-13T22:17:37.206193+0000 mon.a (mon.0) 298 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-13T22:17:38.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:38 smithi131 bash[24745]: audit 2024-09-13T22:17:37.206774+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:17:38.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:38 smithi171 bash[25040]: cluster 2024-09-13T22:17:36.705870+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:38 smithi171 bash[25040]: cluster 2024-09-13T22:17:37.206193+0000 mon.a (mon.0) 298 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-13T22:17:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:38 smithi171 bash[25040]: audit 2024-09-13T22:17:37.206774+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: cluster 2024-09-13T22:17:38.706281+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.111321+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.118747+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.121650+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.835648+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.837386+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:40 smithi007 bash[22722]: audit 2024-09-13T22:17:39.847651+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: cluster 2024-09-13T22:17:38.706281+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:40.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.111321+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.118747+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.121650+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.835648+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.837386+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:40 smithi131 bash[24745]: audit 2024-09-13T22:17:39.847651+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: cluster 2024-09-13T22:17:38.706281+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.111321+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.118747+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.121650+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.835648+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.837386+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:40 smithi171 bash[25040]: audit 2024-09-13T22:17:39.847651+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:17:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:17:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:42 smithi007 bash[22722]: cluster 2024-09-13T22:17:40.706715+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:42.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:42 smithi131 bash[24745]: cluster 2024-09-13T22:17:40.706715+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:42.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:42 smithi171 bash[25040]: cluster 2024-09-13T22:17:40.706715+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:44 smithi007 bash[22722]: cluster 2024-09-13T22:17:42.707147+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:44 smithi007 bash[22722]: audit 2024-09-13T22:17:43.275669+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:44 smithi007 bash[22722]: audit 2024-09-13T22:17:43.282444+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:44 smithi007 bash[22722]: audit 2024-09-13T22:17:43.285562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:44 smithi007 bash[22722]: audit 2024-09-13T22:17:43.286712+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:44.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:44 smithi131 bash[24745]: cluster 2024-09-13T22:17:42.707147+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:44.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:44 smithi131 bash[24745]: audit 2024-09-13T22:17:43.275669+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:44 smithi131 bash[24745]: audit 2024-09-13T22:17:43.282444+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:44 smithi131 bash[24745]: audit 2024-09-13T22:17:43.285562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:44 smithi131 bash[24745]: audit 2024-09-13T22:17:43.286712+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:44 smithi171 bash[25040]: cluster 2024-09-13T22:17:42.707147+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:44 smithi171 bash[25040]: audit 2024-09-13T22:17:43.275669+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:44 smithi171 bash[25040]: audit 2024-09-13T22:17:43.282444+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:44 smithi171 bash[25040]: audit 2024-09-13T22:17:43.285562+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:17:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:44 smithi171 bash[25040]: audit 2024-09-13T22:17:43.286712+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:17:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:46 smithi007 bash[22722]: cluster 2024-09-13T22:17:44.707591+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:46.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:46 smithi131 bash[24745]: cluster 2024-09-13T22:17:44.707591+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:46 smithi171 bash[25040]: cluster 2024-09-13T22:17:44.707591+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:48.403 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:48 smithi007 bash[22722]: cluster 2024-09-13T22:17:46.708006+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:48 smithi131 bash[24745]: cluster 2024-09-13T22:17:46.708006+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:48 smithi171 bash[25040]: cluster 2024-09-13T22:17:46.708006+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:50 smithi007 bash[22722]: cluster 2024-09-13T22:17:48.708403+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:50.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:50 smithi131 bash[24745]: cluster 2024-09-13T22:17:48.708403+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:50.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:50 smithi171 bash[25040]: cluster 2024-09-13T22:17:48.708403+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:52 smithi007 bash[22722]: cluster 2024-09-13T22:17:50.708825+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:52 smithi007 bash[22722]: audit 2024-09-13T22:17:51.574952+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]: dispatch 2024-09-13T22:17:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:52 smithi007 bash[22722]: audit 2024-09-13T22:17:51.577493+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]': finished 2024-09-13T22:17:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:52 smithi007 bash[22722]: cluster 2024-09-13T22:17:51.582115+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-13T22:17:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:52 smithi007 bash[22722]: audit 2024-09-13T22:17:51.582388+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:17:52.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:52 smithi131 bash[24745]: cluster 2024-09-13T22:17:50.708825+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:52.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:52 smithi131 bash[24745]: audit 2024-09-13T22:17:51.574952+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]: dispatch 2024-09-13T22:17:52.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:52 smithi131 bash[24745]: audit 2024-09-13T22:17:51.577493+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]': finished 2024-09-13T22:17:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:52 smithi131 bash[24745]: cluster 2024-09-13T22:17:51.582115+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-13T22:17:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:52 smithi131 bash[24745]: audit 2024-09-13T22:17:51.582388+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:17:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:52 smithi171 bash[25040]: cluster 2024-09-13T22:17:50.708825+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:52 smithi171 bash[25040]: audit 2024-09-13T22:17:51.574952+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]: dispatch 2024-09-13T22:17:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:52 smithi171 bash[25040]: audit 2024-09-13T22:17:51.577493+0000 mon.a (mon.0) 310 : audit [INF] from='client.? 172.21.15.7:0/3813400614' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "242765ed-7d6f-4d63-be4c-579bbbc38739"}]': finished 2024-09-13T22:17:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:52 smithi171 bash[25040]: cluster 2024-09-13T22:17:51.582115+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-13T22:17:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:52 smithi171 bash[25040]: audit 2024-09-13T22:17:51.582388+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:17:53.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:53 smithi007 bash[22722]: audit 2024-09-13T22:17:52.184982+0000 mon.a (mon.0) 313 : audit [DBG] from='client.? 172.21.15.7:0/2573902340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:17:53.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:53 smithi131 bash[24745]: audit 2024-09-13T22:17:52.184982+0000 mon.a (mon.0) 313 : audit [DBG] from='client.? 172.21.15.7:0/2573902340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:17:53.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:53 smithi171 bash[25040]: audit 2024-09-13T22:17:52.184982+0000 mon.a (mon.0) 313 : audit [DBG] from='client.? 172.21.15.7:0/2573902340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:17:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:54 smithi007 bash[22722]: cluster 2024-09-13T22:17:52.709220+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:54.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:54 smithi131 bash[24745]: cluster 2024-09-13T22:17:52.709220+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:54.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:54 smithi171 bash[25040]: cluster 2024-09-13T22:17:52.709220+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:56 smithi007 bash[22722]: cluster 2024-09-13T22:17:54.709621+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:56.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:56 smithi131 bash[24745]: cluster 2024-09-13T22:17:54.709621+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:56.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:56 smithi171 bash[25040]: cluster 2024-09-13T22:17:54.709621+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:17:58 smithi007 bash[22722]: cluster 2024-09-13T22:17:56.709926+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:58.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:17:58 smithi131 bash[24745]: cluster 2024-09-13T22:17:56.709926+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:17:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:17:58 smithi171 bash[25040]: cluster 2024-09-13T22:17:56.709926+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:00 smithi007 bash[22722]: cluster 2024-09-13T22:17:58.710340+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:00 smithi131 bash[24745]: cluster 2024-09-13T22:17:58.710340+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:00 smithi171 bash[25040]: cluster 2024-09-13T22:17:58.710340+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:02.449 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:02 smithi007 bash[22722]: cluster 2024-09-13T22:18:00.710759+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:02.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:02 smithi131 bash[24745]: cluster 2024-09-13T22:18:00.710759+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:02.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:02 smithi171 bash[25040]: cluster 2024-09-13T22:18:00.710759+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:04 smithi007 bash[22722]: cluster 2024-09-13T22:18:02.711167+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:04 smithi131 bash[24745]: cluster 2024-09-13T22:18:02.711167+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:04 smithi171 bash[25040]: cluster 2024-09-13T22:18:02.711167+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:05.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:05 smithi007 bash[22722]: audit 2024-09-13T22:18:04.720515+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:18:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:05 smithi007 bash[22722]: audit 2024-09-13T22:18:04.722256+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:05 smithi131 bash[24745]: audit 2024-09-13T22:18:04.720515+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:18:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:05 smithi131 bash[24745]: audit 2024-09-13T22:18:04.722256+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:05.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:05 smithi171 bash[25040]: audit 2024-09-13T22:18:04.720515+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:18:05.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:05 smithi171 bash[25040]: audit 2024-09-13T22:18:04.722256+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:06 smithi007 bash[22722]: cluster 2024-09-13T22:18:04.711616+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:06 smithi007 bash[22722]: cephadm 2024-09-13T22:18:04.723910+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi007 2024-09-13T22:18:06.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:06 smithi131 bash[24745]: cluster 2024-09-13T22:18:04.711616+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:06.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:06 smithi131 bash[24745]: cephadm 2024-09-13T22:18:04.723910+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi007 2024-09-13T22:18:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:06 smithi171 bash[25040]: cluster 2024-09-13T22:18:04.711616+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:06 smithi171 bash[25040]: cephadm 2024-09-13T22:18:04.723910+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi007 2024-09-13T22:18:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:08 smithi007 bash[22722]: cluster 2024-09-13T22:18:06.712032+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:08.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:08 smithi131 bash[24745]: cluster 2024-09-13T22:18:06.712032+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:08 smithi171 bash[25040]: cluster 2024-09-13T22:18:06.712032+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:09.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:08 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:18:09.042 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:18:08 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:18:09.380 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:18:09 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:18:09.381 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:09 smithi007 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:18:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:10 smithi007 bash[22722]: cluster 2024-09-13T22:18:08.712474+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:10 smithi007 bash[22722]: audit 2024-09-13T22:18:09.303304+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:10 smithi007 bash[22722]: audit 2024-09-13T22:18:09.307417+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:10 smithi007 bash[22722]: audit 2024-09-13T22:18:09.311756+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:10 smithi131 bash[24745]: cluster 2024-09-13T22:18:08.712474+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:10 smithi131 bash[24745]: audit 2024-09-13T22:18:09.303304+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:10 smithi131 bash[24745]: audit 2024-09-13T22:18:09.307417+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:10 smithi131 bash[24745]: audit 2024-09-13T22:18:09.311756+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:10 smithi171 bash[25040]: cluster 2024-09-13T22:18:08.712474+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:10 smithi171 bash[25040]: audit 2024-09-13T22:18:09.303304+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:10 smithi171 bash[25040]: audit 2024-09-13T22:18:09.307417+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:10 smithi171 bash[25040]: audit 2024-09-13T22:18:09.311756+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:12 smithi007 bash[22722]: cluster 2024-09-13T22:18:10.712865+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:12.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:12 smithi131 bash[24745]: cluster 2024-09-13T22:18:10.712865+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:12 smithi171 bash[25040]: cluster 2024-09-13T22:18:10.712865+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:14.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:14 smithi007 bash[22722]: cluster 2024-09-13T22:18:12.713227+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:14.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:14 smithi131 bash[24745]: cluster 2024-09-13T22:18:12.713227+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:14 smithi171 bash[25040]: cluster 2024-09-13T22:18:12.713227+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:15.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:15 smithi007 bash[22722]: audit 2024-09-13T22:18:14.583780+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:15.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:15 smithi007 bash[22722]: audit 2024-09-13T22:18:14.587717+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:15.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:15 smithi007 bash[22722]: audit 2024-09-13T22:18:15.258635+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:15.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:15 smithi007 bash[22722]: audit 2024-09-13T22:18:15.259802+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:15.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:15 smithi007 bash[22722]: audit 2024-09-13T22:18:15.269008+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:15 smithi131 bash[24745]: audit 2024-09-13T22:18:14.583780+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:15 smithi131 bash[24745]: audit 2024-09-13T22:18:14.587717+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:15 smithi131 bash[24745]: audit 2024-09-13T22:18:15.258635+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:15 smithi131 bash[24745]: audit 2024-09-13T22:18:15.259802+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:15 smithi131 bash[24745]: audit 2024-09-13T22:18:15.269008+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:15 smithi171 bash[25040]: audit 2024-09-13T22:18:14.583780+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:15 smithi171 bash[25040]: audit 2024-09-13T22:18:14.587717+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:15 smithi171 bash[25040]: audit 2024-09-13T22:18:15.258635+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:15 smithi171 bash[25040]: audit 2024-09-13T22:18:15.259802+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:15 smithi171 bash[25040]: audit 2024-09-13T22:18:15.269008+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:16 smithi007 bash[22722]: cluster 2024-09-13T22:18:14.713623+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:16 smithi131 bash[24745]: cluster 2024-09-13T22:18:14.713623+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:16 smithi171 bash[25040]: cluster 2024-09-13T22:18:14.713623+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:18 smithi007 bash[22722]: cluster 2024-09-13T22:18:16.714038+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:18 smithi131 bash[24745]: cluster 2024-09-13T22:18:16.714038+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:19.041 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-13T22:18:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:18 smithi171 bash[25040]: cluster 2024-09-13T22:18:16.714038+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:19.694 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T22:18:19.696 INFO:tasks.cephadm:Deploying osd.1 on smithi131 with /dev/vg_nvme/lv_4... 2024-09-13T22:18:19.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:18:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:19 smithi007 bash[22722]: audit 2024-09-13T22:18:18.857538+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:18:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:19 smithi007 bash[22722]: audit 2024-09-13T22:18:19.022475+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:19 smithi007 bash[22722]: audit 2024-09-13T22:18:19.029334+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:19 smithi007 bash[22722]: audit 2024-09-13T22:18:19.036743+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:19 smithi131 bash[24745]: audit 2024-09-13T22:18:18.857538+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:19 smithi131 bash[24745]: audit 2024-09-13T22:18:19.022475+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:19 smithi131 bash[24745]: audit 2024-09-13T22:18:19.029334+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:19 smithi131 bash[24745]: audit 2024-09-13T22:18:19.036743+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:19 smithi171 bash[25040]: audit 2024-09-13T22:18:18.857538+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:18:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:19 smithi171 bash[25040]: audit 2024-09-13T22:18:19.022475+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:18:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:19 smithi171 bash[25040]: audit 2024-09-13T22:18:19.029334+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:19 smithi171 bash[25040]: audit 2024-09-13T22:18:19.036743+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:20.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[22722]: cluster 2024-09-13T22:18:18.714507+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:20.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[22722]: audit 2024-09-13T22:18:19.604399+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:18:20.940 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[22722]: cluster 2024-09-13T22:18:19.608445+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:18:20.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[22722]: audit 2024-09-13T22:18:19.608747+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T22:18:20.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[22722]: audit 2024-09-13T22:18:19.609115+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:20 smithi131 bash[24745]: cluster 2024-09-13T22:18:18.714507+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:20 smithi131 bash[24745]: audit 2024-09-13T22:18:19.604399+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:18:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:20 smithi131 bash[24745]: cluster 2024-09-13T22:18:19.608445+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:18:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:20 smithi131 bash[24745]: audit 2024-09-13T22:18:19.608747+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T22:18:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:20 smithi131 bash[24745]: audit 2024-09-13T22:18:19.609115+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:20 smithi171 bash[25040]: cluster 2024-09-13T22:18:18.714507+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:20 smithi171 bash[25040]: audit 2024-09-13T22:18:19.604399+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:18:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:20 smithi171 bash[25040]: cluster 2024-09-13T22:18:19.608445+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:18:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:20 smithi171 bash[25040]: audit 2024-09-13T22:18:19.608747+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T22:18:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:20 smithi171 bash[25040]: audit 2024-09-13T22:18:19.609115+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:21.204 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[32105]: debug 2024-09-13T22:18:20.937+0000 7f951481c640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T22:18:21.204 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 22:18:20 smithi007 bash[32105]: debug 2024-09-13T22:18:20.965+0000 7f950be28640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:18:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:21 smithi007 bash[22722]: audit 2024-09-13T22:18:20.606765+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T22:18:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:21 smithi007 bash[22722]: cluster 2024-09-13T22:18:20.611556+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:18:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:21 smithi007 bash[22722]: audit 2024-09-13T22:18:20.613228+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:21 smithi007 bash[22722]: audit 2024-09-13T22:18:20.623204+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:21 smithi007 bash[22722]: audit 2024-09-13T22:18:20.945345+0000 mon.a (mon.0) 336 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' 2024-09-13T22:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:21 smithi131 bash[24745]: audit 2024-09-13T22:18:20.606765+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T22:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:21 smithi131 bash[24745]: cluster 2024-09-13T22:18:20.611556+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:21 smithi131 bash[24745]: audit 2024-09-13T22:18:20.613228+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:21 smithi131 bash[24745]: audit 2024-09-13T22:18:20.623204+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:21 smithi131 bash[24745]: audit 2024-09-13T22:18:20.945345+0000 mon.a (mon.0) 336 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' 2024-09-13T22:18:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:21 smithi171 bash[25040]: audit 2024-09-13T22:18:20.606765+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T22:18:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:21 smithi171 bash[25040]: cluster 2024-09-13T22:18:20.611556+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:18:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:21 smithi171 bash[25040]: audit 2024-09-13T22:18:20.613228+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:21 smithi171 bash[25040]: audit 2024-09-13T22:18:20.623204+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:21 smithi171 bash[25040]: audit 2024-09-13T22:18:20.945345+0000 mon.a (mon.0) 336 : audit [INF] from='osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678]' entity='osd.0' 2024-09-13T22:18:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: cluster 2024-09-13T22:18:19.826546+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: cluster 2024-09-13T22:18:19.826676+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: cluster 2024-09-13T22:18:20.714874+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: audit 2024-09-13T22:18:21.621686+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: cluster 2024-09-13T22:18:21.950140+0000 mon.a (mon.0) 338 : cluster [INF] osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678] boot 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: cluster 2024-09-13T22:18:21.950190+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-13T22:18:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:22 smithi007 bash[22722]: audit 2024-09-13T22:18:21.950412+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: cluster 2024-09-13T22:18:19.826546+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:18:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: cluster 2024-09-13T22:18:19.826676+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:18:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: cluster 2024-09-13T22:18:20.714874+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: audit 2024-09-13T22:18:21.621686+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: cluster 2024-09-13T22:18:21.950140+0000 mon.a (mon.0) 338 : cluster [INF] osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678] boot 2024-09-13T22:18:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: cluster 2024-09-13T22:18:21.950190+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-13T22:18:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:22 smithi131 bash[24745]: audit 2024-09-13T22:18:21.950412+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: cluster 2024-09-13T22:18:19.826546+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:18:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: cluster 2024-09-13T22:18:19.826676+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:18:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: cluster 2024-09-13T22:18:20.714874+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:18:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: audit 2024-09-13T22:18:21.621686+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: cluster 2024-09-13T22:18:21.950140+0000 mon.a (mon.0) 338 : cluster [INF] osd.0 [v2:172.21.15.7:6802/1851628678,v1:172.21.15.7:6803/1851628678] boot 2024-09-13T22:18:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: cluster 2024-09-13T22:18:21.950190+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-13T22:18:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:22 smithi171 bash[25040]: audit 2024-09-13T22:18:21.950412+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:18:24.425 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T22:18:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:24 smithi131 bash[24745]: cluster 2024-09-13T22:18:22.715365+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:24 smithi131 bash[24745]: cluster 2024-09-13T22:18:23.636972+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:18:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:24 smithi007 bash[22722]: cluster 2024-09-13T22:18:22.715365+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:24 smithi007 bash[22722]: cluster 2024-09-13T22:18:23.636972+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:18:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:24 smithi171 bash[25040]: cluster 2024-09-13T22:18:22.715365+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:24 smithi171 bash[25040]: cluster 2024-09-13T22:18:23.636972+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:18:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:25 smithi007 bash[22722]: cluster 2024-09-13T22:18:24.715819+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:25 smithi131 bash[24745]: cluster 2024-09-13T22:18:24.715819+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:25 smithi171 bash[25040]: cluster 2024-09-13T22:18:24.715819+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:28.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:27 smithi131 bash[24745]: cluster 2024-09-13T22:18:26.716322+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:27 smithi171 bash[25040]: cluster 2024-09-13T22:18:26.716322+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:28.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:27 smithi007 bash[22722]: cluster 2024-09-13T22:18:26.716322+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:28.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T22:18:28.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: cluster 2024-09-13T22:18:28.716790+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: cephadm 2024-09-13T22:18:28.794687+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi007 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.801562+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.808284+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.810598+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: cephadm 2024-09-13T22:18:28.812032+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi007 to 17269M 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.816526+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.819505+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.821100+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:29 smithi007 bash[22722]: audit 2024-09-13T22:18:28.830600+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: cluster 2024-09-13T22:18:28.716790+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: cephadm 2024-09-13T22:18:28.794687+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi007 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.801562+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.808284+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.810598+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: cephadm 2024-09-13T22:18:28.812032+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi007 to 17269M 2024-09-13T22:18:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.816526+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.819505+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.821100+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:29 smithi131 bash[24745]: audit 2024-09-13T22:18:28.830600+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: cluster 2024-09-13T22:18:28.716790+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: cephadm 2024-09-13T22:18:28.794687+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi007 2024-09-13T22:18:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.801562+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.808284+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.810598+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: cephadm 2024-09-13T22:18:28.812032+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi007 to 17269M 2024-09-13T22:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.816526+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.819505+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.821100+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:29 smithi171 bash[25040]: audit 2024-09-13T22:18:28.830600+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:18:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:31 smithi007 bash[22722]: cluster 2024-09-13T22:18:30.717302+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:32.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:31 smithi131 bash[24745]: cluster 2024-09-13T22:18:30.717302+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:32.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:31 smithi171 bash[25040]: cluster 2024-09-13T22:18:30.717302+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:32.882 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T22:18:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:33 smithi007 bash[22722]: cluster 2024-09-13T22:18:32.717791+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:34.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:33 smithi131 bash[24745]: cluster 2024-09-13T22:18:32.717791+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:34.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:33 smithi171 bash[25040]: cluster 2024-09-13T22:18:32.717791+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:35.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:34 smithi007 bash[22722]: audit 2024-09-13T22:18:34.339926+0000 mgr.a (mgr.14150) 132 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:35.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:34 smithi007 bash[22722]: audit 2024-09-13T22:18:34.346777+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:18:35.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:34 smithi007 bash[22722]: audit 2024-09-13T22:18:34.353117+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:18:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:34 smithi007 bash[22722]: audit 2024-09-13T22:18:34.354990+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:35.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:34 smithi131 bash[24745]: audit 2024-09-13T22:18:34.339926+0000 mgr.a (mgr.14150) 132 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:35.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:34 smithi131 bash[24745]: audit 2024-09-13T22:18:34.346777+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:18:35.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:34 smithi131 bash[24745]: audit 2024-09-13T22:18:34.353117+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:18:35.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:34 smithi131 bash[24745]: audit 2024-09-13T22:18:34.354990+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:34 smithi171 bash[25040]: audit 2024-09-13T22:18:34.339926+0000 mgr.a (mgr.14150) 132 : audit [DBG] from='client.24128 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:18:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:34 smithi171 bash[25040]: audit 2024-09-13T22:18:34.346777+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:18:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:34 smithi171 bash[25040]: audit 2024-09-13T22:18:34.353117+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:18:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:34 smithi171 bash[25040]: audit 2024-09-13T22:18:34.354990+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:35 smithi007 bash[22722]: cluster 2024-09-13T22:18:34.718217+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:36.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:35 smithi131 bash[24745]: cluster 2024-09-13T22:18:34.718217+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:36.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:35 smithi171 bash[25040]: cluster 2024-09-13T22:18:34.718217+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:37 smithi007 bash[22722]: cluster 2024-09-13T22:18:36.718678+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:38.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:37 smithi131 bash[24745]: cluster 2024-09-13T22:18:36.718678+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:38.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:37 smithi171 bash[25040]: cluster 2024-09-13T22:18:36.718678+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:39 smithi007 bash[22722]: cluster 2024-09-13T22:18:38.719135+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:40.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:39 smithi131 bash[24745]: cluster 2024-09-13T22:18:38.719135+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:40.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:39 smithi171 bash[25040]: cluster 2024-09-13T22:18:38.719135+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:41 smithi007 bash[22722]: cluster 2024-09-13T22:18:40.719577+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:42.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:41 smithi131 bash[24745]: cluster 2024-09-13T22:18:40.719577+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:42.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:41 smithi171 bash[25040]: cluster 2024-09-13T22:18:40.719577+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:42 smithi007 bash[22722]: audit 2024-09-13T22:18:42.806239+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.131:0/3088382130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:42 smithi007 bash[22722]: audit 2024-09-13T22:18:42.806515+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:42 smithi007 bash[22722]: audit 2024-09-13T22:18:42.809542+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]': finished 2024-09-13T22:18:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:42 smithi007 bash[22722]: cluster 2024-09-13T22:18:42.814717+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-13T22:18:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:42 smithi007 bash[22722]: audit 2024-09-13T22:18:42.815091+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:42 smithi131 bash[24745]: audit 2024-09-13T22:18:42.806239+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.131:0/3088382130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:42 smithi131 bash[24745]: audit 2024-09-13T22:18:42.806515+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:42 smithi131 bash[24745]: audit 2024-09-13T22:18:42.809542+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]': finished 2024-09-13T22:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:42 smithi131 bash[24745]: cluster 2024-09-13T22:18:42.814717+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-13T22:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:42 smithi131 bash[24745]: audit 2024-09-13T22:18:42.815091+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:42 smithi171 bash[25040]: audit 2024-09-13T22:18:42.806239+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.131:0/3088382130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:42 smithi171 bash[25040]: audit 2024-09-13T22:18:42.806515+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]: dispatch 2024-09-13T22:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:42 smithi171 bash[25040]: audit 2024-09-13T22:18:42.809542+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2aafa51e-6991-4922-aa69-6e197882c396"}]': finished 2024-09-13T22:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:42 smithi171 bash[25040]: cluster 2024-09-13T22:18:42.814717+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-13T22:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:42 smithi171 bash[25040]: audit 2024-09-13T22:18:42.815091+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:18:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:43 smithi007 bash[22722]: cluster 2024-09-13T22:18:42.720008+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:43 smithi007 bash[22722]: audit 2024-09-13T22:18:43.441302+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.131:0/4233206106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:18:44.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:43 smithi131 bash[24745]: cluster 2024-09-13T22:18:42.720008+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:44.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:43 smithi131 bash[24745]: audit 2024-09-13T22:18:43.441302+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.131:0/4233206106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:18:44.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:43 smithi171 bash[25040]: cluster 2024-09-13T22:18:42.720008+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:44.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:43 smithi171 bash[25040]: audit 2024-09-13T22:18:43.441302+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.131:0/4233206106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:18:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:45 smithi007 bash[22722]: cluster 2024-09-13T22:18:44.720494+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:46.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:45 smithi131 bash[24745]: cluster 2024-09-13T22:18:44.720494+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:46.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:45 smithi171 bash[25040]: cluster 2024-09-13T22:18:44.720494+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:47 smithi007 bash[22722]: cluster 2024-09-13T22:18:46.720930+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:48.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:47 smithi131 bash[24745]: cluster 2024-09-13T22:18:46.720930+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:48.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:47 smithi171 bash[25040]: cluster 2024-09-13T22:18:46.720930+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:49 smithi007 bash[22722]: cluster 2024-09-13T22:18:48.721374+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:50.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:49 smithi131 bash[24745]: cluster 2024-09-13T22:18:48.721374+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:50.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:49 smithi171 bash[25040]: cluster 2024-09-13T22:18:48.721374+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:51 smithi007 bash[22722]: cluster 2024-09-13T22:18:50.721816+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:52.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:51 smithi131 bash[24745]: cluster 2024-09-13T22:18:50.721816+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:52.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:51 smithi171 bash[25040]: cluster 2024-09-13T22:18:50.721816+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:53 smithi007 bash[22722]: cluster 2024-09-13T22:18:52.722288+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:54.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:53 smithi131 bash[24745]: cluster 2024-09-13T22:18:52.722288+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:54.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:53 smithi171 bash[25040]: cluster 2024-09-13T22:18:52.722288+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:55 smithi007 bash[22722]: cluster 2024-09-13T22:18:54.722738+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:56.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:55 smithi131 bash[24745]: cluster 2024-09-13T22:18:54.722738+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:56.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:55 smithi171 bash[25040]: cluster 2024-09-13T22:18:54.722738+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:56 smithi007 bash[22722]: audit 2024-09-13T22:18:56.093616+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:18:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:56 smithi007 bash[22722]: audit 2024-09-13T22:18:56.095473+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:56 smithi007 bash[22722]: cephadm 2024-09-13T22:18:56.097139+0000 mgr.a (mgr.14150) 144 : cephadm [INF] Deploying daemon osd.1 on smithi131 2024-09-13T22:18:57.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:56 smithi131 bash[24745]: audit 2024-09-13T22:18:56.093616+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:18:57.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:56 smithi131 bash[24745]: audit 2024-09-13T22:18:56.095473+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:57.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:56 smithi131 bash[24745]: cephadm 2024-09-13T22:18:56.097139+0000 mgr.a (mgr.14150) 144 : cephadm [INF] Deploying daemon osd.1 on smithi131 2024-09-13T22:18:57.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:56 smithi171 bash[25040]: audit 2024-09-13T22:18:56.093616+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:18:57.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:56 smithi171 bash[25040]: audit 2024-09-13T22:18:56.095473+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:18:57.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:56 smithi171 bash[25040]: cephadm 2024-09-13T22:18:56.097139+0000 mgr.a (mgr.14150) 144 : cephadm [INF] Deploying daemon osd.1 on smithi131 2024-09-13T22:18:57.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:57 smithi131 bash[24745]: cluster 2024-09-13T22:18:56.723166+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:57 smithi007 bash[22722]: cluster 2024-09-13T22:18:56.723166+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:18:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:57 smithi171 bash[25040]: cluster 2024-09-13T22:18:56.723166+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:18:59 smithi131 bash[24745]: cluster 2024-09-13T22:18:58.723614+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:18:59 smithi007 bash[22722]: cluster 2024-09-13T22:18:58.723614+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:00.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:18:59 smithi171 bash[25040]: cluster 2024-09-13T22:18:58.723614+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:00 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:00.531 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:19:00 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:00.878 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:19:00 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:00.879 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:00 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:00 smithi007 bash[22722]: audit 2024-09-13T22:19:00.698145+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:00 smithi007 bash[22722]: audit 2024-09-13T22:19:00.705302+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:00 smithi007 bash[22722]: audit 2024-09-13T22:19:00.712893+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:00 smithi131 bash[24745]: audit 2024-09-13T22:19:00.698145+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:00 smithi131 bash[24745]: audit 2024-09-13T22:19:00.705302+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:00 smithi131 bash[24745]: audit 2024-09-13T22:19:00.712893+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:01.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:00 smithi171 bash[25040]: audit 2024-09-13T22:19:00.698145+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:01.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:00 smithi171 bash[25040]: audit 2024-09-13T22:19:00.705302+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:01.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:00 smithi171 bash[25040]: audit 2024-09-13T22:19:00.712893+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:01 smithi131 bash[24745]: cluster 2024-09-13T22:19:00.724041+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:01 smithi007 bash[22722]: cluster 2024-09-13T22:19:00.724041+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:01 smithi171 bash[25040]: cluster 2024-09-13T22:19:00.724041+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:03 smithi007 bash[22722]: cluster 2024-09-13T22:19:02.724477+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:03 smithi131 bash[24745]: cluster 2024-09-13T22:19:02.724477+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:03 smithi171 bash[25040]: cluster 2024-09-13T22:19:02.724477+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:05 smithi007 bash[22722]: cluster 2024-09-13T22:19:04.724923+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:05 smithi131 bash[24745]: cluster 2024-09-13T22:19:04.724923+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:06.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:05 smithi171 bash[25040]: cluster 2024-09-13T22:19:04.724923+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:07 smithi171 bash[25040]: audit 2024-09-13T22:19:06.033828+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:07 smithi171 bash[25040]: audit 2024-09-13T22:19:06.042013+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:07 smithi171 bash[25040]: audit 2024-09-13T22:19:06.729500+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:07 smithi171 bash[25040]: audit 2024-09-13T22:19:06.731172+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:07 smithi171 bash[25040]: audit 2024-09-13T22:19:06.740559+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:07 smithi007 bash[22722]: audit 2024-09-13T22:19:06.033828+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:07 smithi007 bash[22722]: audit 2024-09-13T22:19:06.042013+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:07 smithi007 bash[22722]: audit 2024-09-13T22:19:06.729500+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:07 smithi007 bash[22722]: audit 2024-09-13T22:19:06.731172+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:07 smithi007 bash[22722]: audit 2024-09-13T22:19:06.740559+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:07 smithi131 bash[24745]: audit 2024-09-13T22:19:06.033828+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:07 smithi131 bash[24745]: audit 2024-09-13T22:19:06.042013+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:07 smithi131 bash[24745]: audit 2024-09-13T22:19:06.729500+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:07 smithi131 bash[24745]: audit 2024-09-13T22:19:06.731172+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:07 smithi131 bash[24745]: audit 2024-09-13T22:19:06.740559+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:08.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:08 smithi171 bash[25040]: cluster 2024-09-13T22:19:06.725346+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:08.449 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:08 smithi131 bash[24745]: cluster 2024-09-13T22:19:06.725346+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:08 smithi007 bash[22722]: cluster 2024-09-13T22:19:06.725346+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:10.398 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 1 on host 'smithi131' 2024-09-13T22:19:10.415 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:10 smithi131 bash[24745]: cluster 2024-09-13T22:19:08.725794+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:10 smithi007 bash[22722]: cluster 2024-09-13T22:19:08.725794+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:10 smithi171 bash[25040]: cluster 2024-09-13T22:19:08.725794+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:11.006 DEBUG:teuthology.orchestra.run.smithi131:osd.1> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T22:19:11.008 INFO:tasks.cephadm:Deploying osd.2 on smithi171 with /dev/vg_nvme/lv_4... 2024-09-13T22:19:11.009 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:19:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:11 smithi131 bash[24745]: audit 2024-09-13T22:19:10.379697+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:11 smithi131 bash[24745]: audit 2024-09-13T22:19:10.386627+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:11 smithi131 bash[24745]: audit 2024-09-13T22:19:10.394143+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:11 smithi131 bash[24745]: audit 2024-09-13T22:19:10.752336+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:11 smithi131 bash[24745]: audit 2024-09-13T22:19:10.752432+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:11 smithi171 bash[25040]: audit 2024-09-13T22:19:10.379697+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:11 smithi171 bash[25040]: audit 2024-09-13T22:19:10.386627+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:11 smithi171 bash[25040]: audit 2024-09-13T22:19:10.394143+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:11 smithi171 bash[25040]: audit 2024-09-13T22:19:10.752336+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:11 smithi171 bash[25040]: audit 2024-09-13T22:19:10.752432+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:11.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:11 smithi007 bash[22722]: audit 2024-09-13T22:19:10.379697+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:11.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:11 smithi007 bash[22722]: audit 2024-09-13T22:19:10.386627+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:11 smithi007 bash[22722]: audit 2024-09-13T22:19:10.394143+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:11 smithi007 bash[22722]: audit 2024-09-13T22:19:10.752336+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:11 smithi007 bash[22722]: audit 2024-09-13T22:19:10.752432+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:19:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: cluster 2024-09-13T22:19:10.726271+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: audit 2024-09-13T22:19:11.398414+0000 mon.a (mon.0) 370 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:19:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: cluster 2024-09-13T22:19:11.402763+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:19:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: audit 2024-09-13T22:19:11.403278+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: audit 2024-09-13T22:19:11.404213+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:12 smithi007 bash[22722]: audit 2024-09-13T22:19:11.404309+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: cluster 2024-09-13T22:19:10.726271+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: audit 2024-09-13T22:19:11.398414+0000 mon.a (mon.0) 370 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:19:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: cluster 2024-09-13T22:19:11.402763+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:19:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: audit 2024-09-13T22:19:11.403278+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: audit 2024-09-13T22:19:11.404213+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[24745]: audit 2024-09-13T22:19:11.404309+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:12.782 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[27723]: debug 2024-09-13T22:19:12.434+0000 7f3abaf34640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T22:19:12.782 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 13 22:19:12 smithi131 bash[27723]: debug 2024-09-13T22:19:12.438+0000 7f3ab6d5c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: cluster 2024-09-13T22:19:10.726271+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: audit 2024-09-13T22:19:11.398414+0000 mon.a (mon.0) 370 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: cluster 2024-09-13T22:19:11.402763+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: audit 2024-09-13T22:19:11.403278+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: audit 2024-09-13T22:19:11.404213+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:12.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:12 smithi171 bash[25040]: audit 2024-09-13T22:19:11.404309+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T22:19:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:13 smithi007 bash[22722]: audit 2024-09-13T22:19:12.400965+0000 mon.a (mon.0) 374 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T22:19:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:13 smithi007 bash[22722]: cluster 2024-09-13T22:19:12.405755+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:19:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:13 smithi007 bash[22722]: audit 2024-09-13T22:19:12.406549+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:13 smithi007 bash[22722]: audit 2024-09-13T22:19:12.416220+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:13 smithi131 bash[24745]: audit 2024-09-13T22:19:12.400965+0000 mon.a (mon.0) 374 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T22:19:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:13 smithi131 bash[24745]: cluster 2024-09-13T22:19:12.405755+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:19:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:13 smithi131 bash[24745]: audit 2024-09-13T22:19:12.406549+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:13 smithi131 bash[24745]: audit 2024-09-13T22:19:12.416220+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:13.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:13 smithi171 bash[25040]: audit 2024-09-13T22:19:12.400965+0000 mon.a (mon.0) 374 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T22:19:13.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:13 smithi171 bash[25040]: cluster 2024-09-13T22:19:12.405755+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:19:13.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:13 smithi171 bash[25040]: audit 2024-09-13T22:19:12.406549+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:13.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:13 smithi171 bash[25040]: audit 2024-09-13T22:19:12.416220+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: cluster 2024-09-13T22:19:11.758955+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:19:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: cluster 2024-09-13T22:19:11.759053+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:19:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: cluster 2024-09-13T22:19:12.726807+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: cluster 2024-09-13T22:19:13.415944+0000 mon.a (mon.0) 378 : cluster [INF] osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511] boot 2024-09-13T22:19:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: cluster 2024-09-13T22:19:13.416028+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-13T22:19:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:14 smithi007 bash[22722]: audit 2024-09-13T22:19:13.416644+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:14.727 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T22:19:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: cluster 2024-09-13T22:19:11.758955+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:19:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: cluster 2024-09-13T22:19:11.759053+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:19:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: cluster 2024-09-13T22:19:12.726807+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: cluster 2024-09-13T22:19:13.415944+0000 mon.a (mon.0) 378 : cluster [INF] osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511] boot 2024-09-13T22:19:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: cluster 2024-09-13T22:19:13.416028+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-13T22:19:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:14 smithi131 bash[24745]: audit 2024-09-13T22:19:13.416644+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: cluster 2024-09-13T22:19:11.758955+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: cluster 2024-09-13T22:19:11.759053+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: cluster 2024-09-13T22:19:12.726807+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: cluster 2024-09-13T22:19:13.415944+0000 mon.a (mon.0) 378 : cluster [INF] osd.1 [v2:172.21.15.131:6800/2485448511,v1:172.21.15.131:6801/2485448511] boot 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: cluster 2024-09-13T22:19:13.416028+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-13T22:19:14.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:14 smithi171 bash[25040]: audit 2024-09-13T22:19:13.416644+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:19:15.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:15 smithi007 bash[22722]: cluster 2024-09-13T22:19:14.431201+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:19:15.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:15 smithi131 bash[24745]: cluster 2024-09-13T22:19:14.431201+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:19:15.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:15 smithi171 bash[25040]: cluster 2024-09-13T22:19:14.431201+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:19:16.700 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:16 smithi171 bash[25040]: cluster 2024-09-13T22:19:14.727277+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:16 smithi007 bash[22722]: cluster 2024-09-13T22:19:14.727277+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:16.770 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:16 smithi131 bash[24745]: cluster 2024-09-13T22:19:14.727277+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:18.589 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-13T22:19:18.640 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_4 2024-09-13T22:19:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:18 smithi007 bash[22722]: cluster 2024-09-13T22:19:16.727723+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:18 smithi131 bash[24745]: cluster 2024-09-13T22:19:16.727723+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:18 smithi171 bash[25040]: cluster 2024-09-13T22:19:16.727723+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: cluster 2024-09-13T22:19:18.728168+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.781934+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.789994+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.792550+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.800082+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.803937+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.805594+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:20 smithi007 bash[22722]: audit 2024-09-13T22:19:19.815457+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: cluster 2024-09-13T22:19:18.728168+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.781934+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.789994+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.792550+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.800082+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.803937+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.805594+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:20 smithi131 bash[24745]: audit 2024-09-13T22:19:19.815457+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: cluster 2024-09-13T22:19:18.728168+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.781934+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.789994+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.792550+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.800082+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.803937+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.805594+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:20 smithi171 bash[25040]: audit 2024-09-13T22:19:19.815457+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:21 smithi131 bash[24745]: cephadm 2024-09-13T22:19:19.773744+0000 mgr.a (mgr.14150) 157 : cephadm [INF] Detected new or changed devices on smithi131 2024-09-13T22:19:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:21 smithi131 bash[24745]: cephadm 2024-09-13T22:19:19.793954+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 17265M 2024-09-13T22:19:21.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:21 smithi171 bash[25040]: cephadm 2024-09-13T22:19:19.773744+0000 mgr.a (mgr.14150) 157 : cephadm [INF] Detected new or changed devices on smithi131 2024-09-13T22:19:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:21 smithi171 bash[25040]: cephadm 2024-09-13T22:19:19.793954+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 17265M 2024-09-13T22:19:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:21 smithi007 bash[22722]: cephadm 2024-09-13T22:19:19.773744+0000 mgr.a (mgr.14150) 157 : cephadm [INF] Detected new or changed devices on smithi131 2024-09-13T22:19:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:21 smithi007 bash[22722]: cephadm 2024-09-13T22:19:19.793954+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 17265M 2024-09-13T22:19:22.357 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T22:19:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:22 smithi131 bash[24745]: cluster 2024-09-13T22:19:20.728616+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:22.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:22 smithi171 bash[25040]: cluster 2024-09-13T22:19:20.728616+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:22 smithi007 bash[22722]: cluster 2024-09-13T22:19:20.728616+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:24 smithi131 bash[24745]: cluster 2024-09-13T22:19:22.729089+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:24 smithi131 bash[24745]: audit 2024-09-13T22:19:23.710182+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:19:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:24 smithi131 bash[24745]: audit 2024-09-13T22:19:23.716804+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:19:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:24 smithi131 bash[24745]: audit 2024-09-13T22:19:23.718573+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:24 smithi171 bash[25040]: cluster 2024-09-13T22:19:22.729089+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:24 smithi171 bash[25040]: audit 2024-09-13T22:19:23.710182+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:19:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:24 smithi171 bash[25040]: audit 2024-09-13T22:19:23.716804+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:19:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:24 smithi171 bash[25040]: audit 2024-09-13T22:19:23.718573+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:24 smithi007 bash[22722]: cluster 2024-09-13T22:19:22.729089+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:24 smithi007 bash[22722]: audit 2024-09-13T22:19:23.710182+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:19:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:24 smithi007 bash[22722]: audit 2024-09-13T22:19:23.716804+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:19:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:24 smithi007 bash[22722]: audit 2024-09-13T22:19:23.718573+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:25.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:25 smithi131 bash[24745]: audit 2024-09-13T22:19:23.703386+0000 mgr.a (mgr.14150) 161 : audit [DBG] from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:19:25.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:25 smithi171 bash[25040]: audit 2024-09-13T22:19:23.703386+0000 mgr.a (mgr.14150) 161 : audit [DBG] from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:19:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:25 smithi007 bash[22722]: audit 2024-09-13T22:19:23.703386+0000 mgr.a (mgr.14150) 161 : audit [DBG] from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:19:26.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:26 smithi131 bash[24745]: cluster 2024-09-13T22:19:24.729543+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:26 smithi171 bash[25040]: cluster 2024-09-13T22:19:24.729543+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:26 smithi007 bash[22722]: cluster 2024-09-13T22:19:24.729543+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:28.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:28 smithi131 bash[24745]: cluster 2024-09-13T22:19:26.730076+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:28 smithi171 bash[25040]: cluster 2024-09-13T22:19:26.730076+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:28 smithi007 bash[22722]: cluster 2024-09-13T22:19:26.730076+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:30 smithi131 bash[24745]: cluster 2024-09-13T22:19:28.730669+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:30 smithi171 bash[25040]: cluster 2024-09-13T22:19:28.730669+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:30 smithi007 bash[22722]: cluster 2024-09-13T22:19:28.730669+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: cluster 2024-09-13T22:19:30.731294+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: audit 2024-09-13T22:19:32.191415+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.171:0/1540812155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: audit 2024-09-13T22:19:32.191488+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: audit 2024-09-13T22:19:32.194748+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]': finished 2024-09-13T22:19:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: cluster 2024-09-13T22:19:32.199344+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-13T22:19:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:32 smithi131 bash[24745]: audit 2024-09-13T22:19:32.199838+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:19:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: cluster 2024-09-13T22:19:30.731294+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: audit 2024-09-13T22:19:32.191415+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.171:0/1540812155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: audit 2024-09-13T22:19:32.191488+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: audit 2024-09-13T22:19:32.194748+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]': finished 2024-09-13T22:19:32.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: cluster 2024-09-13T22:19:32.199344+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-13T22:19:32.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:32 smithi171 bash[25040]: audit 2024-09-13T22:19:32.199838+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: cluster 2024-09-13T22:19:30.731294+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: audit 2024-09-13T22:19:32.191415+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.171:0/1540812155' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: audit 2024-09-13T22:19:32.191488+0000 mon.a (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]: dispatch 2024-09-13T22:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: audit 2024-09-13T22:19:32.194748+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71befba7-2c66-4acf-93fa-8073eee6a78a"}]': finished 2024-09-13T22:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: cluster 2024-09-13T22:19:32.199344+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-13T22:19:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:32 smithi007 bash[22722]: audit 2024-09-13T22:19:32.199838+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:19:33.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:33 smithi131 bash[24745]: audit 2024-09-13T22:19:32.833811+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.171:0/257033654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:19:33.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:33 smithi171 bash[25040]: audit 2024-09-13T22:19:32.833811+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.171:0/257033654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:19:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:33 smithi007 bash[22722]: audit 2024-09-13T22:19:32.833811+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.171:0/257033654' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:19:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:34 smithi131 bash[24745]: cluster 2024-09-13T22:19:32.731857+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:34 smithi171 bash[25040]: cluster 2024-09-13T22:19:32.731857+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:34 smithi007 bash[22722]: cluster 2024-09-13T22:19:32.731857+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:36 smithi131 bash[24745]: cluster 2024-09-13T22:19:34.732438+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:36 smithi171 bash[25040]: cluster 2024-09-13T22:19:34.732438+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:36 smithi007 bash[22722]: cluster 2024-09-13T22:19:34.732438+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:38 smithi131 bash[24745]: cluster 2024-09-13T22:19:36.733001+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:38 smithi171 bash[25040]: cluster 2024-09-13T22:19:36.733001+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:38 smithi007 bash[22722]: cluster 2024-09-13T22:19:36.733001+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:40 smithi131 bash[24745]: cluster 2024-09-13T22:19:38.733595+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:40 smithi171 bash[25040]: cluster 2024-09-13T22:19:38.733595+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:40 smithi007 bash[22722]: cluster 2024-09-13T22:19:38.733595+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:42 smithi131 bash[24745]: cluster 2024-09-13T22:19:40.734211+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:42 smithi171 bash[25040]: cluster 2024-09-13T22:19:40.734211+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:42 smithi007 bash[22722]: cluster 2024-09-13T22:19:40.734211+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:44 smithi131 bash[24745]: cluster 2024-09-13T22:19:42.734802+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:44 smithi171 bash[25040]: cluster 2024-09-13T22:19:42.734802+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:44 smithi007 bash[22722]: cluster 2024-09-13T22:19:42.734802+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:46 smithi131 bash[24745]: cluster 2024-09-13T22:19:44.735380+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:46 smithi131 bash[24745]: audit 2024-09-13T22:19:45.617108+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:19:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:46 smithi131 bash[24745]: audit 2024-09-13T22:19:45.618930+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:46 smithi131 bash[24745]: cephadm 2024-09-13T22:19:45.620611+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Deploying daemon osd.2 on smithi171 2024-09-13T22:19:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:46 smithi171 bash[25040]: cluster 2024-09-13T22:19:44.735380+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:46 smithi171 bash[25040]: audit 2024-09-13T22:19:45.617108+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:19:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:46 smithi171 bash[25040]: audit 2024-09-13T22:19:45.618930+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:46 smithi171 bash[25040]: cephadm 2024-09-13T22:19:45.620611+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Deploying daemon osd.2 on smithi171 2024-09-13T22:19:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:46 smithi007 bash[22722]: cluster 2024-09-13T22:19:44.735380+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:46 smithi007 bash[22722]: audit 2024-09-13T22:19:45.617108+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:19:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:46 smithi007 bash[22722]: audit 2024-09-13T22:19:45.618930+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:46 smithi007 bash[22722]: cephadm 2024-09-13T22:19:45.620611+0000 mgr.a (mgr.14150) 173 : cephadm [INF] Deploying daemon osd.2 on smithi171 2024-09-13T22:19:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:48 smithi131 bash[24745]: cluster 2024-09-13T22:19:46.735882+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:48 smithi171 bash[25040]: cluster 2024-09-13T22:19:46.735882+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:48 smithi007 bash[22722]: cluster 2024-09-13T22:19:46.735882+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:49.968 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:49 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:50.230 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:50 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:19:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:50 smithi131 bash[24745]: cluster 2024-09-13T22:19:48.736357+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:50 smithi131 bash[24745]: audit 2024-09-13T22:19:50.275194+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:50 smithi131 bash[24745]: audit 2024-09-13T22:19:50.282876+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:50 smithi131 bash[24745]: audit 2024-09-13T22:19:50.290134+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:50 smithi171 bash[25040]: cluster 2024-09-13T22:19:48.736357+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:50 smithi171 bash[25040]: audit 2024-09-13T22:19:50.275194+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:50 smithi171 bash[25040]: audit 2024-09-13T22:19:50.282876+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:50 smithi171 bash[25040]: audit 2024-09-13T22:19:50.290134+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:50 smithi007 bash[22722]: cluster 2024-09-13T22:19:48.736357+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:50 smithi007 bash[22722]: audit 2024-09-13T22:19:50.275194+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:19:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:50 smithi007 bash[22722]: audit 2024-09-13T22:19:50.282876+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:50 smithi007 bash[22722]: audit 2024-09-13T22:19:50.290134+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:52.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:52 smithi131 bash[24745]: cluster 2024-09-13T22:19:50.736891+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:52 smithi171 bash[25040]: cluster 2024-09-13T22:19:50.736891+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:52 smithi007 bash[22722]: cluster 2024-09-13T22:19:50.736891+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:54 smithi171 bash[25040]: cluster 2024-09-13T22:19:52.737421+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:54 smithi007 bash[22722]: cluster 2024-09-13T22:19:52.737421+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:54 smithi131 bash[24745]: cluster 2024-09-13T22:19:52.737421+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:56 smithi007 bash[22722]: cluster 2024-09-13T22:19:54.737896+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:56 smithi131 bash[24745]: cluster 2024-09-13T22:19:54.737896+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:56 smithi171 bash[25040]: cluster 2024-09-13T22:19:54.737896+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: audit 2024-09-13T22:19:56.667894+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: audit 2024-09-13T22:19:56.675732+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: audit 2024-09-13T22:19:56.677255+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: audit 2024-09-13T22:19:56.679048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: audit 2024-09-13T22:19:56.688268+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.872 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:57 smithi171 bash[25040]: cluster 2024-09-13T22:19:56.738376+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: audit 2024-09-13T22:19:56.667894+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: audit 2024-09-13T22:19:56.675732+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: audit 2024-09-13T22:19:56.677255+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: audit 2024-09-13T22:19:56.679048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: audit 2024-09-13T22:19:56.688268+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:57 smithi007 bash[22722]: cluster 2024-09-13T22:19:56.738376+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:19:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: audit 2024-09-13T22:19:56.667894+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: audit 2024-09-13T22:19:56.675732+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: audit 2024-09-13T22:19:56.677255+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:19:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: audit 2024-09-13T22:19:56.679048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:19:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: audit 2024-09-13T22:19:56.688268+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:19:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:57 smithi131 bash[24745]: cluster 2024-09-13T22:19:56.738376+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:59 smithi007 bash[22722]: cluster 2024-09-13T22:19:58.738858+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:59 smithi007 bash[22722]: audit 2024-09-13T22:19:59.495699+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:19:59 smithi007 bash[22722]: audit 2024-09-13T22:19:59.495728+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:00.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:59 smithi131 bash[24745]: cluster 2024-09-13T22:19:58.738858+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:00.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:59 smithi131 bash[24745]: audit 2024-09-13T22:19:59.495699+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:00.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:19:59 smithi131 bash[24745]: audit 2024-09-13T22:19:59.495728+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:59 smithi171 bash[25040]: cluster 2024-09-13T22:19:58.738858+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:59 smithi171 bash[25040]: audit 2024-09-13T22:19:59.495699+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:19:59 smithi171 bash[25040]: audit 2024-09-13T22:19:59.495728+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:20:01.179 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 2 on host 'smithi171' 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: audit 2024-09-13T22:19:59.794540+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: audit 2024-09-13T22:19:59.799709+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: cluster 2024-09-13T22:19:59.799938+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: audit 2024-09-13T22:19:59.801019+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: audit 2024-09-13T22:19:59.801575+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: cluster 2024-09-13T22:20:00.000148+0000 mon.a (mon.0) 411 : cluster [INF] overall HEALTH_OK 2024-09-13T22:20:01.196 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:00 smithi171 bash[25040]: audit 2024-09-13T22:20:00.796962+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: audit 2024-09-13T22:19:59.794540+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: audit 2024-09-13T22:19:59.799709+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: cluster 2024-09-13T22:19:59.799938+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: audit 2024-09-13T22:19:59.801019+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: audit 2024-09-13T22:19:59.801575+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: cluster 2024-09-13T22:20:00.000148+0000 mon.a (mon.0) 411 : cluster [INF] overall HEALTH_OK 2024-09-13T22:20:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:00 smithi007 bash[22722]: audit 2024-09-13T22:20:00.796962+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: audit 2024-09-13T22:19:59.794540+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: audit 2024-09-13T22:19:59.799709+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: cluster 2024-09-13T22:19:59.799938+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: audit 2024-09-13T22:19:59.801019+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: audit 2024-09-13T22:19:59.801575+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-09-13T22:20:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: cluster 2024-09-13T22:20:00.000148+0000 mon.a (mon.0) 411 : cluster [INF] overall HEALTH_OK 2024-09-13T22:20:01.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:00 smithi131 bash[24745]: audit 2024-09-13T22:20:00.796962+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-09-13T22:20:01.801 DEBUG:teuthology.orchestra.run.smithi171:osd.2> sudo journalctl -f -n 0 -u ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T22:20:01.803 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2024-09-13T22:20:01.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T22:20:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: cluster 2024-09-13T22:20:00.739333+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: cluster 2024-09-13T22:20:00.802244+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:20:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:00.803260+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:00.818894+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:01.160698+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:20:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:01.167809+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:01.175502+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:01 smithi007 bash[22722]: audit 2024-09-13T22:20:01.811327+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: cluster 2024-09-13T22:20:00.739333+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: cluster 2024-09-13T22:20:00.802244+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:00.803260+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:00.818894+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:01.160698+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:01.167809+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:01.175502+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:01 smithi131 bash[24745]: audit 2024-09-13T22:20:01.811327+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: cluster 2024-09-13T22:20:00.739333+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: cluster 2024-09-13T22:20:00.802244+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:00.803260+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:00.818894+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:01.160698+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:01.167809+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:01.175502+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:01 smithi171 bash[25040]: audit 2024-09-13T22:20:01.811327+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:02 smithi007 bash[22722]: cluster 2024-09-13T22:20:00.495711+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:20:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:02 smithi007 bash[22722]: cluster 2024-09-13T22:20:00.495801+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:20:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:02 smithi007 bash[22722]: cluster 2024-09-13T22:20:01.820230+0000 mon.a (mon.0) 420 : cluster [INF] osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744] boot 2024-09-13T22:20:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:02 smithi007 bash[22722]: cluster 2024-09-13T22:20:01.820324+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-13T22:20:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:02 smithi007 bash[22722]: audit 2024-09-13T22:20:01.820985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:02 smithi131 bash[24745]: cluster 2024-09-13T22:20:00.495711+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:20:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:02 smithi131 bash[24745]: cluster 2024-09-13T22:20:00.495801+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:20:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:02 smithi131 bash[24745]: cluster 2024-09-13T22:20:01.820230+0000 mon.a (mon.0) 420 : cluster [INF] osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744] boot 2024-09-13T22:20:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:02 smithi131 bash[24745]: cluster 2024-09-13T22:20:01.820324+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-13T22:20:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:02 smithi131 bash[24745]: audit 2024-09-13T22:20:01.820985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:02 smithi171 bash[25040]: cluster 2024-09-13T22:20:00.495711+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-13T22:20:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:02 smithi171 bash[25040]: cluster 2024-09-13T22:20:00.495801+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-13T22:20:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:02 smithi171 bash[25040]: cluster 2024-09-13T22:20:01.820230+0000 mon.a (mon.0) 420 : cluster [INF] osd.2 [v2:172.21.15.171:6800/2004928744,v1:172.21.15.171:6801/2004928744] boot 2024-09-13T22:20:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:02 smithi171 bash[25040]: cluster 2024-09-13T22:20:01.820324+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-13T22:20:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:02 smithi171 bash[25040]: audit 2024-09-13T22:20:01.820985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:20:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:03 smithi007 bash[22722]: cluster 2024-09-13T22:20:02.739937+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:03 smithi007 bash[22722]: cluster 2024-09-13T22:20:02.837100+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:20:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:03 smithi007 bash[22722]: audit 2024-09-13T22:20:02.862681+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:03 smithi131 bash[24745]: cluster 2024-09-13T22:20:02.739937+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:03 smithi131 bash[24745]: cluster 2024-09-13T22:20:02.837100+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:20:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:03 smithi131 bash[24745]: audit 2024-09-13T22:20:02.862681+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:03 smithi171 bash[25040]: cluster 2024-09-13T22:20:02.739937+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:20:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:03 smithi171 bash[25040]: cluster 2024-09-13T22:20:02.837100+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:20:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:03 smithi171 bash[25040]: audit 2024-09-13T22:20:02.862681+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:04 smithi007 bash[22722]: audit 2024-09-13T22:20:03.841485+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:04 smithi007 bash[22722]: cluster 2024-09-13T22:20:03.846118+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:20:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:04 smithi007 bash[22722]: audit 2024-09-13T22:20:03.848067+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:04 smithi131 bash[24745]: audit 2024-09-13T22:20:03.841485+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:04 smithi131 bash[24745]: cluster 2024-09-13T22:20:03.846118+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:20:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:04 smithi131 bash[24745]: audit 2024-09-13T22:20:03.848067+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:05.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:04 smithi171 bash[25040]: audit 2024-09-13T22:20:03.841485+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:05.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:04 smithi171 bash[25040]: cluster 2024-09-13T22:20:03.846118+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:20:05.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:04 smithi171 bash[25040]: audit 2024-09-13T22:20:03.848067+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:20:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:05 smithi007 bash[22722]: cluster 2024-09-13T22:20:04.740544+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:05 smithi007 bash[22722]: cluster 2024-09-13T22:20:04.841426+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:20:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:05 smithi007 bash[22722]: audit 2024-09-13T22:20:04.850623+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:05 smithi007 bash[22722]: cluster 2024-09-13T22:20:04.857089+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:20:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:05 smithi131 bash[24745]: cluster 2024-09-13T22:20:04.740544+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:05 smithi131 bash[24745]: cluster 2024-09-13T22:20:04.841426+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:20:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:05 smithi131 bash[24745]: audit 2024-09-13T22:20:04.850623+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:05 smithi131 bash[24745]: cluster 2024-09-13T22:20:04.857089+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:20:06.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:05 smithi171 bash[25040]: cluster 2024-09-13T22:20:04.740544+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v141: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:06.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:05 smithi171 bash[25040]: cluster 2024-09-13T22:20:04.841426+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:20:06.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:05 smithi171 bash[25040]: audit 2024-09-13T22:20:04.850623+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:20:06.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:05 smithi171 bash[25040]: cluster 2024-09-13T22:20:04.857089+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:20:06.547 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:06 smithi007 bash[22722]: cluster 2024-09-13T22:20:05.873357+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:20:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:06 smithi007 bash[22722]: cluster 2024-09-13T22:20:05.873984+0000 mon.a (mon.0) 432 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-13T22:20:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:06 smithi007 bash[22722]: audit 2024-09-13T22:20:06.028321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:07.185 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:06 smithi171 bash[25040]: cluster 2024-09-13T22:20:05.873357+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:20:07.185 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:06 smithi171 bash[25040]: cluster 2024-09-13T22:20:05.873984+0000 mon.a (mon.0) 432 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-13T22:20:07.185 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:06 smithi171 bash[25040]: audit 2024-09-13T22:20:06.028321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:07.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:06 smithi131 bash[24745]: cluster 2024-09-13T22:20:05.873357+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:20:07.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:06 smithi131 bash[24745]: cluster 2024-09-13T22:20:05.873984+0000 mon.a (mon.0) 432 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-13T22:20:07.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:06 smithi131 bash[24745]: audit 2024-09-13T22:20:06.028321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:07 smithi007 bash[22722]: cluster 2024-09-13T22:20:06.741055+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:07 smithi007 bash[22722]: audit 2024-09-13T22:20:06.973068+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:07 smithi007 bash[22722]: cluster 2024-09-13T22:20:07.024352+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:20:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:07 smithi007 bash[22722]: cluster 2024-09-13T22:20:07.024393+0000 mon.a (mon.0) 436 : cluster [INF] Cluster is now healthy 2024-09-13T22:20:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:07 smithi131 bash[24745]: cluster 2024-09-13T22:20:06.741055+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:07 smithi131 bash[24745]: audit 2024-09-13T22:20:06.973068+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:07 smithi131 bash[24745]: cluster 2024-09-13T22:20:07.024352+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:20:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:07 smithi131 bash[24745]: cluster 2024-09-13T22:20:07.024393+0000 mon.a (mon.0) 436 : cluster [INF] Cluster is now healthy 2024-09-13T22:20:08.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:07 smithi171 bash[25040]: cluster 2024-09-13T22:20:06.741055+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v144: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:08.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:07 smithi171 bash[25040]: audit 2024-09-13T22:20:06.973068+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:08.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:07 smithi171 bash[25040]: cluster 2024-09-13T22:20:07.024352+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:20:08.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:07 smithi171 bash[25040]: cluster 2024-09-13T22:20:07.024393+0000 mon.a (mon.0) 436 : cluster [INF] Cluster is now healthy 2024-09-13T22:20:09.135 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:20:09.874 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"num_osds":3,"num_up_osds":3,"osd_up_since":1726266001,"num_in_osds":3,"osd_in_since":1726265972,"num_remapped_pgs":0} 2024-09-13T22:20:09.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:20:10.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:07.978610+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:07.980351+0000 mon.a (mon.0) 438 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.913936+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.915474+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.916017+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.916696+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.933225+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.933707+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:09 smithi171 bash[25040]: audit 2024-09-13T22:20:08.934192+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:07.978610+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:07.980351+0000 mon.a (mon.0) 438 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.913936+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.915474+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.916017+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.916696+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.933225+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.933707+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:09 smithi007 bash[22722]: audit 2024-09-13T22:20:08.934192+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:10.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:07.978610+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:07.980351+0000 mon.a (mon.0) 438 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.913936+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.915474+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.916017+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.916696+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.933225+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.933707+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:09 smithi131 bash[24745]: audit 2024-09-13T22:20:08.934192+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:11.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: cluster 2024-09-13T22:20:08.741538+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:11.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:08.922105+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.135590+0000 mon.a (mon.0) 446 : audit [DBG] from='client.? 172.21.15.7:0/717330458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.796391+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.804562+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.805921+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.806332+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:09.806666+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: cephadm 2024-09-13T22:20:10.346798+0000 mgr.a (mgr.14150) 186 : cephadm [INF] Detected new or changed devices on smithi171 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.679816+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.693081+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.701361+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.703880+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:20:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.711231+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.715538+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:20:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.717153+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:20:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:10 smithi007 bash[22722]: audit 2024-09-13T22:20:10.727808+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: cluster 2024-09-13T22:20:08.741538+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:08.922105+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.135590+0000 mon.a (mon.0) 446 : audit [DBG] from='client.? 172.21.15.7:0/717330458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.796391+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.804562+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.805921+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.806332+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:09.806666+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: cephadm 2024-09-13T22:20:10.346798+0000 mgr.a (mgr.14150) 186 : cephadm [INF] Detected new or changed devices on smithi171 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.679816+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.693081+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.701361+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.703880+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.711231+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.715538+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.717153+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:20:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:10 smithi131 bash[24745]: audit 2024-09-13T22:20:10.727808+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: cluster 2024-09-13T22:20:08.741538+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:08.922105+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.135590+0000 mon.a (mon.0) 446 : audit [DBG] from='client.? 172.21.15.7:0/717330458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.796391+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.804562+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.805921+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.806332+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:09.806666+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: cephadm 2024-09-13T22:20:10.346798+0000 mgr.a (mgr.14150) 186 : cephadm [INF] Detected new or changed devices on smithi171 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.679816+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:20:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.693081+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.701361+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.703880+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.711231+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.715538+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.717153+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:10 smithi171 bash[25040]: audit 2024-09-13T22:20:10.727808+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:20:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:11 smithi007 bash[22722]: cephadm 2024-09-13T22:20:10.705196+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 21361M 2024-09-13T22:20:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:11 smithi007 bash[22722]: cluster 2024-09-13T22:20:10.742065+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:11 smithi131 bash[24745]: cephadm 2024-09-13T22:20:10.705196+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 21361M 2024-09-13T22:20:12.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:11 smithi131 bash[24745]: cluster 2024-09-13T22:20:10.742065+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:11 smithi171 bash[25040]: cephadm 2024-09-13T22:20:10.705196+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 21361M 2024-09-13T22:20:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:11 smithi171 bash[25040]: cluster 2024-09-13T22:20:10.742065+0000 mgr.a (mgr.14150) 188 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:13 smithi007 bash[22722]: cluster 2024-09-13T22:20:12.742618+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:14.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:13 smithi131 bash[24745]: cluster 2024-09-13T22:20:12.742618+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:14.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:13 smithi171 bash[25040]: cluster 2024-09-13T22:20:12.742618+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:14.621 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:16.080 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:20:16.081 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","created":"2024-09-13T22:14:43.146744+0000","modified":"2024-09-13T22:20:05.850957+0000","last_up_change":"2024-09-13T22:20:01.812218+0000","last_in_change":"2024-09-13T22:19:32.192452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:20:03.310387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"242765ed-7d6f-4d63-be4c-579bbbc38739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6803","nonce":1851628678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6805","nonce":1851628678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6809","nonce":1851628678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6807","nonce":1851628678}]},"public_addr":"172.21.15.7:6803/1851628678","cluster_addr":"172.21.15.7:6805/1851628678","heartbeat_back_addr":"172.21.15.7:6809/1851628678","heartbeat_front_addr":"172.21.15.7:6807/1851628678","state":["exists","up"]},{"osd":1,"uuid":"2aafa51e-6991-4922-aa69-6e197882c396","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6801","nonce":2485448511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6803","nonce":2485448511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6807","nonce":2485448511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6805","nonce":2485448511}]},"public_addr":"172.21.15.131:6801/2485448511","cluster_addr":"172.21.15.131:6803/2485448511","heartbeat_back_addr":"172.21.15.131:6807/2485448511","heartbeat_front_addr":"172.21.15.131:6805/2485448511","state":["exists","up"]},{"osd":2,"uuid":"71befba7-2c66-4acf-93fa-8073eee6a78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6801","nonce":2004928744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6803","nonce":2004928744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6807","nonce":2004928744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6805","nonce":2004928744}]},"public_addr":"172.21.15.171:6801/2004928744","cluster_addr":"172.21.15.171:6803/2004928744","heartbeat_back_addr":"172.21.15.171:6807/2004928744","heartbeat_front_addr":"172.21.15.171:6805/2004928744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:18:19.826681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:19:11.759057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:20:00.495805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2755439784":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:0/3824878402":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/2336806744":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1541630546":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1361848955":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1321468164":"2024-09-14T22:15:10.487799+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:20:16.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:15 smithi007 bash[22722]: cluster 2024-09-13T22:20:14.743214+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-13T22:20:16.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:15 smithi131 bash[24745]: cluster 2024-09-13T22:20:14.743214+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-13T22:20:16.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:15 smithi171 bash[25040]: cluster 2024-09-13T22:20:14.743214+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-13T22:20:16.774 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T22:20:03.310387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T22:20:16.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T22:20:17.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:16 smithi007 bash[22722]: audit 2024-09-13T22:20:16.080559+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.7:0/504610497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:17.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:16 smithi131 bash[24745]: audit 2024-09-13T22:20:16.080559+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.7:0/504610497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:17.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:16 smithi171 bash[25040]: audit 2024-09-13T22:20:16.080559+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.7:0/504610497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:17 smithi007 bash[22722]: cluster 2024-09-13T22:20:16.743779+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-13T22:20:18.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:17 smithi131 bash[24745]: cluster 2024-09-13T22:20:16.743779+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-13T22:20:18.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:17 smithi171 bash[25040]: cluster 2024-09-13T22:20:16.743779+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-13T22:20:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:19 smithi007 bash[22722]: cluster 2024-09-13T22:20:18.744336+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-13T22:20:20.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:19 smithi131 bash[24745]: cluster 2024-09-13T22:20:18.744336+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-13T22:20:20.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:19 smithi171 bash[25040]: cluster 2024-09-13T22:20:18.744336+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-13T22:20:21.521 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:21 smithi007 bash[22722]: cluster 2024-09-13T22:20:20.744856+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-13T22:20:22.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:21 smithi131 bash[24745]: cluster 2024-09-13T22:20:20.744856+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-13T22:20:22.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:21 smithi171 bash[25040]: cluster 2024-09-13T22:20:20.744856+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-13T22:20:22.968 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T22:20:23.580 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T22:20:23.681 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T22:20:23.682 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T22:20:23.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T22:20:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:23 smithi007 bash[22722]: cluster 2024-09-13T22:20:22.745277+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:23 smithi007 bash[22722]: audit 2024-09-13T22:20:22.968874+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.7:0/2330181549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:20:24.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:23 smithi131 bash[24745]: cluster 2024-09-13T22:20:22.745277+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:24.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:23 smithi131 bash[24745]: audit 2024-09-13T22:20:22.968874+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.7:0/2330181549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:20:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:23 smithi171 bash[25040]: cluster 2024-09-13T22:20:22.745277+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:23 smithi171 bash[25040]: audit 2024-09-13T22:20:22.968874+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.7:0/2330181549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:20:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:25 smithi007 bash[22722]: cluster 2024-09-13T22:20:24.745902+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:26.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:25 smithi131 bash[24745]: cluster 2024-09-13T22:20:24.745902+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:26.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:25 smithi171 bash[25040]: cluster 2024-09-13T22:20:24.745902+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-13T22:20:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:27 smithi007 bash[22722]: cluster 2024-09-13T22:20:26.746585+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:28.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:27 smithi131 bash[24745]: cluster 2024-09-13T22:20:26.746585+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:28.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:27 smithi171 bash[25040]: cluster 2024-09-13T22:20:26.746585+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:28.430 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:29.858 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:20:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:29 smithi007 bash[22722]: cluster 2024-09-13T22:20:28.747282+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:30.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:29 smithi131 bash[24745]: cluster 2024-09-13T22:20:28.747282+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:30.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:29 smithi171 bash[25040]: cluster 2024-09-13T22:20:28.747282+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:30.587 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":711270757},{"type":"v1","addr":"172.21.15.7:6801","nonce":711270757}]},"active_addr":"172.21.15.7:6801/711270757","active_change":"2024-09-13T22:15:42.672939+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24107,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3407459769}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":4075773127}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2238686145}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3174726855}]}]} 2024-09-13T22:20:30.592 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T22:20:30.593 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T22:20:30.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:20:31.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:30 smithi007 bash[22722]: audit 2024-09-13T22:20:29.853577+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.7:0/1049513358' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:20:31.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:30 smithi131 bash[24745]: audit 2024-09-13T22:20:29.853577+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.7:0/1049513358' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:20:31.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:30 smithi171 bash[25040]: audit 2024-09-13T22:20:29.853577+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.7:0/1049513358' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:20:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:31 smithi007 bash[22722]: cluster 2024-09-13T22:20:30.747821+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:32.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:31 smithi131 bash[24745]: cluster 2024-09-13T22:20:30.747821+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:32.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:31 smithi171 bash[25040]: cluster 2024-09-13T22:20:30.747821+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:33 smithi007 bash[22722]: cluster 2024-09-13T22:20:32.748466+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:34.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:33 smithi131 bash[24745]: cluster 2024-09-13T22:20:32.748466+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:33 smithi171 bash[25040]: cluster 2024-09-13T22:20:32.748466+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:35.336 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:35 smithi007 bash[22722]: cluster 2024-09-13T22:20:34.749144+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:36.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:35 smithi131 bash[24745]: cluster 2024-09-13T22:20:34.749144+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:36.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:35 smithi171 bash[25040]: cluster 2024-09-13T22:20:34.749144+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:20:36.768 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","created":"2024-09-13T22:14:43.146744+0000","modified":"2024-09-13T22:20:05.850957+0000","last_up_change":"2024-09-13T22:20:01.812218+0000","last_in_change":"2024-09-13T22:19:32.192452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:20:03.310387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"242765ed-7d6f-4d63-be4c-579bbbc38739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6803","nonce":1851628678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6805","nonce":1851628678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6809","nonce":1851628678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6807","nonce":1851628678}]},"public_addr":"172.21.15.7:6803/1851628678","cluster_addr":"172.21.15.7:6805/1851628678","heartbeat_back_addr":"172.21.15.7:6809/1851628678","heartbeat_front_addr":"172.21.15.7:6807/1851628678","state":["exists","up"]},{"osd":1,"uuid":"2aafa51e-6991-4922-aa69-6e197882c396","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6801","nonce":2485448511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6803","nonce":2485448511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6807","nonce":2485448511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6805","nonce":2485448511}]},"public_addr":"172.21.15.131:6801/2485448511","cluster_addr":"172.21.15.131:6803/2485448511","heartbeat_back_addr":"172.21.15.131:6807/2485448511","heartbeat_front_addr":"172.21.15.131:6805/2485448511","state":["exists","up"]},{"osd":2,"uuid":"71befba7-2c66-4acf-93fa-8073eee6a78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6801","nonce":2004928744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6803","nonce":2004928744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6807","nonce":2004928744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6805","nonce":2004928744}]},"public_addr":"172.21.15.171:6801/2004928744","cluster_addr":"172.21.15.171:6803/2004928744","heartbeat_back_addr":"172.21.15.171:6807/2004928744","heartbeat_front_addr":"172.21.15.171:6805/2004928744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:18:19.826681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:19:11.759057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:20:00.495805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2755439784":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:0/3824878402":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/2336806744":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1541630546":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1361848955":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1321468164":"2024-09-14T22:15:10.487799+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:20:37.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:36 smithi007 bash[22722]: audit 2024-09-13T22:20:36.767850+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.7:0/696808859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:37.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:36 smithi131 bash[24745]: audit 2024-09-13T22:20:36.767850+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.7:0/696808859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:37.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:36 smithi171 bash[25040]: audit 2024-09-13T22:20:36.767850+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.7:0/696808859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:37.470 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T22:20:37.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:20:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:37 smithi007 bash[22722]: cluster 2024-09-13T22:20:36.749688+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:38.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:37 smithi131 bash[24745]: cluster 2024-09-13T22:20:36.749688+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:38.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:37 smithi171 bash[25040]: cluster 2024-09-13T22:20:36.749688+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:39 smithi007 bash[22722]: cluster 2024-09-13T22:20:38.750201+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:40.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:39 smithi131 bash[24745]: cluster 2024-09-13T22:20:38.750201+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:39 smithi171 bash[25040]: cluster 2024-09-13T22:20:38.750201+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:42.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:41 smithi007 bash[22722]: cluster 2024-09-13T22:20:40.750679+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:42.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:41 smithi131 bash[24745]: cluster 2024-09-13T22:20:40.750679+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:42.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:41 smithi171 bash[25040]: cluster 2024-09-13T22:20:40.750679+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:43.561 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:20:43.561 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"fsid":"2e3f4ff4-721d-11ef-bceb-c7b262605968","created":"2024-09-13T22:14:43.146744+0000","modified":"2024-09-13T22:20:05.850957+0000","last_up_change":"2024-09-13T22:20:01.812218+0000","last_in_change":"2024-09-13T22:19:32.192452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:20:03.310387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"242765ed-7d6f-4d63-be4c-579bbbc38739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6803","nonce":1851628678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6805","nonce":1851628678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6809","nonce":1851628678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1851628678},{"type":"v1","addr":"172.21.15.7:6807","nonce":1851628678}]},"public_addr":"172.21.15.7:6803/1851628678","cluster_addr":"172.21.15.7:6805/1851628678","heartbeat_back_addr":"172.21.15.7:6809/1851628678","heartbeat_front_addr":"172.21.15.7:6807/1851628678","state":["exists","up"]},{"osd":1,"uuid":"2aafa51e-6991-4922-aa69-6e197882c396","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6801","nonce":2485448511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6803","nonce":2485448511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6807","nonce":2485448511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2485448511},{"type":"v1","addr":"172.21.15.131:6805","nonce":2485448511}]},"public_addr":"172.21.15.131:6801/2485448511","cluster_addr":"172.21.15.131:6803/2485448511","heartbeat_back_addr":"172.21.15.131:6807/2485448511","heartbeat_front_addr":"172.21.15.131:6805/2485448511","state":["exists","up"]},{"osd":2,"uuid":"71befba7-2c66-4acf-93fa-8073eee6a78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6801","nonce":2004928744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6803","nonce":2004928744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6807","nonce":2004928744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2004928744},{"type":"v1","addr":"172.21.15.171:6805","nonce":2004928744}]},"public_addr":"172.21.15.171:6801/2004928744","cluster_addr":"172.21.15.171:6803/2004928744","heartbeat_back_addr":"172.21.15.171:6807/2004928744","heartbeat_front_addr":"172.21.15.171:6805/2004928744","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:18:19.826681+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:19:11.759057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:20:00.495805+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2755439784":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/358058775":"2024-09-14T22:15:42.672607+0000","172.21.15.7:0/3824878402":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6801/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/2336806744":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1541630546":"2024-09-14T22:15:42.672607+0000","172.21.15.7:6800/1200270219":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1361848955":"2024-09-14T22:15:10.487799+0000","172.21.15.7:0/1321468164":"2024-09-14T22:15:10.487799+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:20:44.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:43 smithi007 bash[22722]: cluster 2024-09-13T22:20:42.751134+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:44.169 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:43 smithi007 bash[22722]: audit 2024-09-13T22:20:43.561002+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.7:0/560686954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:44.170 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T22:20:44.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T22:20:44.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T22:20:44.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:43 smithi131 bash[24745]: cluster 2024-09-13T22:20:42.751134+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:44.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:43 smithi131 bash[24745]: audit 2024-09-13T22:20:43.561002+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.7:0/560686954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:44.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:43 smithi171 bash[25040]: cluster 2024-09-13T22:20:42.751134+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:44.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:43 smithi171 bash[25040]: audit 2024-09-13T22:20:43.561002+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.7:0/560686954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:20:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:45 smithi007 bash[22722]: cluster 2024-09-13T22:20:44.751688+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:46.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:45 smithi131 bash[24745]: cluster 2024-09-13T22:20:44.751688+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:46.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:45 smithi171 bash[25040]: cluster 2024-09-13T22:20:44.751688+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:47 smithi007 bash[22722]: cluster 2024-09-13T22:20:46.752215+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:48.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:47 smithi131 bash[24745]: cluster 2024-09-13T22:20:46.752215+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:48.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:47 smithi171 bash[25040]: cluster 2024-09-13T22:20:46.752215+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:48.910 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:49 smithi007 bash[22722]: cluster 2024-09-13T22:20:48.752761+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:50.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:49 smithi131 bash[24745]: cluster 2024-09-13T22:20:48.752761+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:50.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:49 smithi171 bash[25040]: cluster 2024-09-13T22:20:48.752761+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:51.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:51 smithi007 bash[22722]: cluster 2024-09-13T22:20:50.753636+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:52.128 INFO:teuthology.orchestra.run.smithi007.stdout:77309411341 2024-09-13T22:20:52.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T22:20:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:51 smithi131 bash[24745]: cluster 2024-09-13T22:20:50.753636+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:52.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:51 smithi171 bash[25040]: cluster 2024-09-13T22:20:50.753636+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:52.309 INFO:teuthology.orchestra.run.smithi007.stdout:55834574871 2024-09-13T22:20:52.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T22:20:52.345 INFO:teuthology.orchestra.run.smithi007.stdout:34359738401 2024-09-13T22:20:52.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T22:20:54.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:53 smithi007 bash[22722]: cluster 2024-09-13T22:20:52.754256+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:54.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:53 smithi131 bash[24745]: cluster 2024-09-13T22:20:52.754256+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:54.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:53 smithi171 bash[25040]: cluster 2024-09-13T22:20:52.754256+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:55 smithi007 bash[22722]: cluster 2024-09-13T22:20:54.754776+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:56.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:55 smithi131 bash[24745]: cluster 2024-09-13T22:20:54.754776+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:56.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:55 smithi171 bash[25040]: cluster 2024-09-13T22:20:54.754776+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:56.893 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:56.893 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:20:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:57 smithi007 bash[22722]: cluster 2024-09-13T22:20:56.755272+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:58.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:57 smithi131 bash[24745]: cluster 2024-09-13T22:20:56.755272+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:58.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:57 smithi171 bash[25040]: cluster 2024-09-13T22:20:56.755272+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:20:59.344 INFO:teuthology.orchestra.run.smithi007.stdout:34359738403 2024-09-13T22:20:59.347 INFO:teuthology.orchestra.run.smithi007.stdout:55834574872 2024-09-13T22:20:59.384 INFO:teuthology.orchestra.run.smithi007.stdout:77309411343 2024-09-13T22:21:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:59 smithi007 bash[22722]: cluster 2024-09-13T22:20:58.755733+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:59 smithi007 bash[22722]: audit 2024-09-13T22:20:59.345878+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.7:0/805206992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:21:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:59 smithi007 bash[22722]: audit 2024-09-13T22:20:59.348379+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.7:0/3628170065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:21:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:20:59 smithi007 bash[22722]: audit 2024-09-13T22:20:59.385306+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.7:0/31654314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:21:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:59 smithi131 bash[24745]: cluster 2024-09-13T22:20:58.755733+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:59 smithi131 bash[24745]: audit 2024-09-13T22:20:59.345878+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.7:0/805206992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:21:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:59 smithi131 bash[24745]: audit 2024-09-13T22:20:59.348379+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.7:0/3628170065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:21:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:20:59 smithi131 bash[24745]: audit 2024-09-13T22:20:59.385306+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.7:0/31654314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:21:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:59 smithi171 bash[25040]: cluster 2024-09-13T22:20:58.755733+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:59 smithi171 bash[25040]: audit 2024-09-13T22:20:59.345878+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.7:0/805206992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:21:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:59 smithi171 bash[25040]: audit 2024-09-13T22:20:59.348379+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.7:0/3628170065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:21:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:20:59 smithi171 bash[25040]: audit 2024-09-13T22:20:59.385306+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.7:0/31654314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:21:00.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574871 got 55834574872 for osd.1 2024-09-13T22:21:00.638 DEBUG:teuthology.parallel:result is None 2024-09-13T22:21:00.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411341 got 77309411343 for osd.2 2024-09-13T22:21:00.800 DEBUG:teuthology.parallel:result is None 2024-09-13T22:21:00.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738401 got 34359738403 for osd.0 2024-09-13T22:21:00.848 DEBUG:teuthology.parallel:result is None 2024-09-13T22:21:00.848 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T22:21:00.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:21:02.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:01 smithi007 bash[22722]: cluster 2024-09-13T22:21:00.756268+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:02.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:01 smithi131 bash[24745]: cluster 2024-09-13T22:21:00.756268+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:02.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:01 smithi171 bash[25040]: cluster 2024-09-13T22:21:00.756268+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:04.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:03 smithi007 bash[22722]: cluster 2024-09-13T22:21:02.756806+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:03 smithi131 bash[24745]: cluster 2024-09-13T22:21:02.756806+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:03 smithi171 bash[25040]: cluster 2024-09-13T22:21:02.756806+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:05.592 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:05 smithi007 bash[22722]: cluster 2024-09-13T22:21:04.757337+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:06.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:05 smithi131 bash[24745]: cluster 2024-09-13T22:21:04.757337+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:06.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:05 smithi171 bash[25040]: cluster 2024-09-13T22:21:04.757337+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:07.106 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T22:21:07.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:21:07.743 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-13T22:21:06.757651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":88772,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":281146684,"statfs":{"total":287985106944,"available":287894204416,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003146"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T22:20:10.699761+0000","last_change":"2024-09-13T22:20:04.864397+0000","last_active":"2024-09-13T22:20:10.699761+0000","last_peered":"2024-09-13T22:20:10.699761+0000","last_clean":"2024-09-13T22:20:10.699761+0000","last_became_active":"2024-09-13T22:20:04.863275+0000","last_became_peered":"2024-09-13T22:20:04.863275+0000","last_unstale":"2024-09-13T22:20:10.699761+0000","last_undegraded":"2024-09-13T22:20:10.699761+0000","last_fullsized":"2024-09-13T22:20:10.699761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:20:03.831833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:20:03.831833+0000","last_clean_scrub_stamp":"2024-09-13T22:20:03.831833+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:10.292463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:21:07.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:21:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:07 smithi007 bash[22722]: cluster 2024-09-13T22:21:06.757886+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:07 smithi007 bash[22722]: audit 2024-09-13T22:21:07.105662+0000 mgr.a (mgr.14150) 217 : audit [DBG] from='client.14331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:08.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:07 smithi131 bash[24745]: cluster 2024-09-13T22:21:06.757886+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:08.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:07 smithi131 bash[24745]: audit 2024-09-13T22:21:07.105662+0000 mgr.a (mgr.14150) 217 : audit [DBG] from='client.14331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:08.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:07 smithi171 bash[25040]: cluster 2024-09-13T22:21:06.757886+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:08.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:07 smithi171 bash[25040]: audit 2024-09-13T22:21:07.105662+0000 mgr.a (mgr.14150) 217 : audit [DBG] from='client.14331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:09 smithi007 bash[22722]: cluster 2024-09-13T22:21:08.758464+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:10.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:09 smithi131 bash[24745]: cluster 2024-09-13T22:21:08.758464+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:10.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:09 smithi171 bash[25040]: cluster 2024-09-13T22:21:08.758464+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:11.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:10 smithi007 bash[22722]: audit 2024-09-13T22:21:10.823799+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:11.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:10 smithi131 bash[24745]: audit 2024-09-13T22:21:10.823799+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:11.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:10 smithi171 bash[25040]: audit 2024-09-13T22:21:10.823799+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:11 smithi007 bash[22722]: cluster 2024-09-13T22:21:10.758992+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:11 smithi007 bash[22722]: audit 2024-09-13T22:21:11.672180+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:11 smithi007 bash[22722]: audit 2024-09-13T22:21:11.673497+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:11 smithi007 bash[22722]: audit 2024-09-13T22:21:11.682267+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:21:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:11 smithi131 bash[24745]: cluster 2024-09-13T22:21:10.758992+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:11 smithi131 bash[24745]: audit 2024-09-13T22:21:11.672180+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:11 smithi131 bash[24745]: audit 2024-09-13T22:21:11.673497+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:11 smithi131 bash[24745]: audit 2024-09-13T22:21:11.682267+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:21:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:11 smithi171 bash[25040]: cluster 2024-09-13T22:21:10.758992+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:11 smithi171 bash[25040]: audit 2024-09-13T22:21:11.672180+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:11 smithi171 bash[25040]: audit 2024-09-13T22:21:11.673497+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:11 smithi171 bash[25040]: audit 2024-09-13T22:21:11.682267+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.7:0/1172627533' entity='mgr.a' 2024-09-13T22:21:12.487 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:13.941 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T22:21:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:21:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:13 smithi007 bash[22722]: cluster 2024-09-13T22:21:12.759511+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:14.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:13 smithi131 bash[24745]: cluster 2024-09-13T22:21:12.759511+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:14.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:13 smithi171 bash[25040]: cluster 2024-09-13T22:21:12.759511+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:14.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-13T22:21:12.759272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":88772,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":281146684,"statfs":{"total":287985106944,"available":287894204416,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003285"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T22:20:10.699761+0000","last_change":"2024-09-13T22:20:04.864397+0000","last_active":"2024-09-13T22:20:10.699761+0000","last_peered":"2024-09-13T22:20:10.699761+0000","last_clean":"2024-09-13T22:20:10.699761+0000","last_became_active":"2024-09-13T22:20:04.863275+0000","last_became_peered":"2024-09-13T22:20:04.863275+0000","last_unstale":"2024-09-13T22:20:10.699761+0000","last_undegraded":"2024-09-13T22:20:10.699761+0000","last_fullsized":"2024-09-13T22:20:10.699761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:20:03.831833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:20:03.831833+0000","last_clean_scrub_stamp":"2024-09-13T22:20:03.831833+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:10.292463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:21:14.567 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T22:21:14.567 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T22:21:14.567 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T22:21:14.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T22:21:15.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:14 smithi131 bash[24745]: audit 2024-09-13T22:21:13.942081+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14337 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:15.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:14 smithi171 bash[25040]: audit 2024-09-13T22:21:13.942081+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14337 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:15.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:14 smithi007 bash[22722]: audit 2024-09-13T22:21:13.942081+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14337 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:21:16.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:15 smithi131 bash[24745]: cluster 2024-09-13T22:21:14.759861+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:16.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:15 smithi171 bash[25040]: cluster 2024-09-13T22:21:14.759861+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:16.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:15 smithi007 bash[22722]: cluster 2024-09-13T22:21:14.759861+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:18.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:17 smithi131 bash[24745]: cluster 2024-09-13T22:21:16.760326+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:18.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:17 smithi171 bash[25040]: cluster 2024-09-13T22:21:16.760326+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:17 smithi007 bash[22722]: cluster 2024-09-13T22:21:16.760326+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:19.311 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:20.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:19 smithi131 bash[24745]: cluster 2024-09-13T22:21:18.760815+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:20.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:19 smithi171 bash[25040]: cluster 2024-09-13T22:21:18.760815+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:20.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:19 smithi007 bash[22722]: cluster 2024-09-13T22:21:18.760815+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T22:21:20.709 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T22:21:21.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:20 smithi131 bash[24745]: audit 2024-09-13T22:21:20.710537+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.7:0/2146482278' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:21:21.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:20 smithi171 bash[25040]: audit 2024-09-13T22:21:20.710537+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.7:0/2146482278' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:21:21.432 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:20 smithi007 bash[22722]: audit 2024-09-13T22:21:20.710537+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.7:0/2146482278' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:21:21.433 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T22:21:21.433 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T22:21:21.433 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:21:21.445 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T22:21:21.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- bash -c 'ceph mgr module enable rgw' 2024-09-13T22:21:22.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:21 smithi131 bash[24745]: cluster 2024-09-13T22:21:20.761144+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:22.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:21 smithi171 bash[25040]: cluster 2024-09-13T22:21:20.761144+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:22.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:21 smithi007 bash[22722]: cluster 2024-09-13T22:21:20.761144+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:24.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:23 smithi131 bash[24745]: cluster 2024-09-13T22:21:22.761560+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:23 smithi171 bash[25040]: cluster 2024-09-13T22:21:22.761560+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:23 smithi007 bash[22722]: cluster 2024-09-13T22:21:22.761560+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:26.187 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:26.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:25 smithi131 bash[24745]: cluster 2024-09-13T22:21:24.762134+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:26.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:25 smithi171 bash[25040]: cluster 2024-09-13T22:21:24.762134+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:26.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:25 smithi007 bash[22722]: cluster 2024-09-13T22:21:24.762134+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:28.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:27 smithi131 bash[24745]: cluster 2024-09-13T22:21:26.762668+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:28.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:27 smithi131 bash[24745]: audit 2024-09-13T22:21:27.628376+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-13T22:21:28.280 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:28 smithi131 bash[25250]: ignoring --setuser ceph since I am not root 2024-09-13T22:21:28.280 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:28 smithi131 bash[25250]: ignoring --setgroup ceph since I am not root 2024-09-13T22:21:28.281 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:28 smithi131 bash[25250]: debug 2024-09-13T22:21:28.065+0000 7f4dd0123640 1 -- 172.21.15.131:0/1448239226 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55693f0070e0 con 0x55693f009400 2024-09-13T22:21:28.281 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:28 smithi131 bash[25250]: debug 2024-09-13T22:21:28.177+0000 7f4dd297f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:21:28.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:27 smithi171 bash[25040]: cluster 2024-09-13T22:21:26.762668+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:28.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:27 smithi171 bash[25040]: audit 2024-09-13T22:21:27.628376+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-13T22:21:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:27 smithi007 bash[22722]: cluster 2024-09-13T22:21:26.762668+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:27 smithi007 bash[22722]: audit 2024-09-13T22:21:27.628376+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-13T22:21:28.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:28 smithi007 bash[22972]: ignoring --setuser ceph since I am not root 2024-09-13T22:21:28.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:28 smithi007 bash[22972]: ignoring --setgroup ceph since I am not root 2024-09-13T22:21:28.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:28 smithi007 bash[22972]: debug 2024-09-13T22:21:28.171+0000 7f40e592e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T22:21:28.735 INFO:teuthology.run_tasks:Running task rgw_module.apply... 2024-09-13T22:21:28.747 INFO:tasks.rgw_module:Applying spec(s): rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 2024-09-13T22:21:28.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- ceph rgw realm bootstrap -i - 2024-09-13T22:21:29.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:29 smithi131 bash[24745]: audit 2024-09-13T22:21:27.997387+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-13T22:21:29.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:29 smithi131 bash[24745]: cluster 2024-09-13T22:21:28.006803+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-13T22:21:29.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:29 smithi171 bash[25040]: audit 2024-09-13T22:21:27.997387+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-13T22:21:29.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:29 smithi171 bash[25040]: cluster 2024-09-13T22:21:28.006803+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-13T22:21:29.416 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:28 smithi007 bash[22722]: audit 2024-09-13T22:21:27.997387+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.7:0/3899313863' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-13T22:21:29.416 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:28 smithi007 bash[22722]: cluster 2024-09-13T22:21:28.006803+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-13T22:21:29.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:29 smithi007 bash[22972]: debug 2024-09-13T22:21:29.411+0000 7f40e592e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:21:29.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:29 smithi007 bash[22972]: debug 2024-09-13T22:21:29.479+0000 7f40e592e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:21:29.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:29 smithi007 bash[22972]: debug 2024-09-13T22:21:29.635+0000 7f40e592e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:21:29.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:29 smithi131 bash[25250]: debug 2024-09-13T22:21:29.349+0000 7f4dd297f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T22:21:29.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:29 smithi131 bash[25250]: debug 2024-09-13T22:21:29.413+0000 7f4dd297f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T22:21:29.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:29 smithi131 bash[25250]: debug 2024-09-13T22:21:29.565+0000 7f4dd297f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T22:21:30.527 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.204+0000 7f4dd297f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:21:30.527 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.276+0000 7f4dd297f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:21:30.527 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.344+0000 7f4dd297f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:21:30.653 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.311+0000 7f40e592e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T22:21:30.654 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.387+0000 7f40e592e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T22:21:30.654 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.455+0000 7f40e592e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T22:21:30.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.524+0000 7f4dd297f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:21:30.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.600+0000 7f4dd297f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:21:30.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.668+0000 7f4dd297f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:21:30.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.651+0000 7f40e592e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T22:21:30.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.731+0000 7f40e592e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T22:21:30.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:30 smithi007 bash[22972]: debug 2024-09-13T22:21:30.799+0000 7f40e592e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T22:21:31.185 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.924+0000 7f4dd297f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:21:31.186 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:30 smithi131 bash[25250]: debug 2024-09-13T22:21:30.992+0000 7f4dd297f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:21:31.186 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.184+0000 7f4dd297f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:21:31.346 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.067+0000 7f40e592e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T22:21:31.346 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.139+0000 7f40e592e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T22:21:31.509 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.260+0000 7f4dd297f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:21:31.690 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.343+0000 7f40e592e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T22:21:31.691 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.423+0000 7f40e592e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T22:21:31.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.508+0000 7f4dd297f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:21:31.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.684+0000 7f4dd297f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:21:31.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.687+0000 7f40e592e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T22:21:31.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:31 smithi007 bash[22972]: debug 2024-09-13T22:21:31.871+0000 7f40e592e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:21:32.101 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.844+0000 7f4dd297f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:21:32.101 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:31 smithi131 bash[25250]: debug 2024-09-13T22:21:31.920+0000 7f4dd297f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:21:32.101 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:32 smithi131 bash[25250]: debug 2024-09-13T22:21:32.100+0000 7f4dd297f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:21:32.315 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:32 smithi007 bash[22972]: debug 2024-09-13T22:21:32.043+0000 7f40e592e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T22:21:32.315 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:32 smithi007 bash[22972]: debug 2024-09-13T22:21:32.123+0000 7f40e592e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T22:21:32.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:32 smithi007 bash[22972]: debug 2024-09-13T22:21:32.311+0000 7f40e592e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T22:21:33.204 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:32 smithi131 bash[25250]: debug 2024-09-13T22:21:32.904+0000 7f4dd297f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:21:33.204 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:32 smithi131 bash[25250]: debug 2024-09-13T22:21:32.980+0000 7f4dd297f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:21:33.204 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[25250]: debug 2024-09-13T22:21:33.204+0000 7f4dd297f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:21:33.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22972]: debug 2024-09-13T22:21:33.170+0000 7f40e592e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T22:21:33.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22972]: debug 2024-09-13T22:21:33.250+0000 7f40e592e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T22:21:33.476 INFO:teuthology.orchestra.run.smithi007.stdout:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:33.530 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[25250]: debug 2024-09-13T22:21:33.276+0000 7f4dd297f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:21:33.826 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22972]: debug 2024-09-13T22:21:33.482+0000 7f40e592e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T22:21:33.827 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22972]: debug 2024-09-13T22:21:33.562+0000 7f40e592e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[25250]: debug 2024-09-13T22:21:33.660+0000 7f4dd297f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[25250]: debug 2024-09-13T22:21:33.740+0000 7f4dd297f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: cluster 2024-09-13T22:21:33.764380+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: cluster 2024-09-13T22:21:33.764573+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: audit 2024-09-13T22:21:33.767343+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:21:34.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: audit 2024-09-13T22:21:33.768022+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:21:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: audit 2024-09-13T22:21:33.769129+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:21:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:33 smithi131 bash[24745]: audit 2024-09-13T22:21:33.769669+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:21:34.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22972]: debug 2024-09-13T22:21:33.970+0000 7f40e592e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T22:21:34.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22972]: debug 2024-09-13T22:21:34.054+0000 7f40e592e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: cluster 2024-09-13T22:21:33.764380+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: cluster 2024-09-13T22:21:33.764573+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: audit 2024-09-13T22:21:33.767343+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: audit 2024-09-13T22:21:33.768022+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: audit 2024-09-13T22:21:33.769129+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:21:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:33 smithi007 bash[22722]: audit 2024-09-13T22:21:33.769669+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: cluster 2024-09-13T22:21:33.764380+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: cluster 2024-09-13T22:21:33.764573+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: audit 2024-09-13T22:21:33.767343+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: audit 2024-09-13T22:21:33.768022+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: audit 2024-09-13T22:21:33.769129+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-13T22:21:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:33 smithi171 bash[25040]: audit 2024-09-13T22:21:33.769669+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.131:0/4186855421' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:33.825901+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:34.080364+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:34.081282+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:34.094729+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:34.095214+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.014293s), standbys: b 2024-09-13T22:21:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.097701+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.098221+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.098755+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.099932+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.100384+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.100735+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.101414+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.101921+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.102429+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.102782+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.103399+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: cluster 2024-09-13T22:21:34.128374+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-09-13T22:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.150684+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.180655+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:21:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:34 smithi007 bash[22722]: audit 2024-09-13T22:21:34.185775+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:21:35.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:33.825901+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-13T22:21:35.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:34.080364+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:34.081282+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:34.094729+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:34.095214+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.014293s), standbys: b 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.097701+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.098221+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.098755+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.099932+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:21:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.100384+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.100735+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.101414+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.101921+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.102429+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.102782+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.103399+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: cluster 2024-09-13T22:21:34.128374+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.150684+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.180655+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:21:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:34 smithi131 bash[24745]: audit 2024-09-13T22:21:34.185775+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:21:35.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:33.825901+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-13T22:21:35.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:34.080364+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-09-13T22:21:35.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:34.081282+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:34.094729+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:34.095214+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.014293s), standbys: b 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.097701+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.098221+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.098755+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.099932+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.100384+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.100735+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.101414+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.101921+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.102429+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:21:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.102782+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.103399+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: cluster 2024-09-13T22:21:34.128374+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-09-13T22:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.150684+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.180655+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:34 smithi171 bash[25040]: audit 2024-09-13T22:21:34.185775+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-13T22:21:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:36 smithi007 bash[22722]: audit 2024-09-13T22:21:35.100185+0000 mgr.a (mgr.14355) 1 : audit [DBG] from='client.14385 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:36 smithi007 bash[22722]: cluster 2024-09-13T22:21:35.101315+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02039s), standbys: b 2024-09-13T22:21:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:36 smithi007 bash[22722]: cluster 2024-09-13T22:21:35.112658+0000 mgr.a (mgr.14355) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:36.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:36 smithi131 bash[24745]: audit 2024-09-13T22:21:35.100185+0000 mgr.a (mgr.14355) 1 : audit [DBG] from='client.14385 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:36.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:36 smithi131 bash[24745]: cluster 2024-09-13T22:21:35.101315+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02039s), standbys: b 2024-09-13T22:21:36.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:36 smithi131 bash[24745]: cluster 2024-09-13T22:21:35.112658+0000 mgr.a (mgr.14355) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:36 smithi171 bash[25040]: audit 2024-09-13T22:21:35.100185+0000 mgr.a (mgr.14355) 1 : audit [DBG] from='client.14385 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:36 smithi171 bash[25040]: cluster 2024-09-13T22:21:35.101315+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02039s), standbys: b 2024-09-13T22:21:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:36 smithi171 bash[25040]: cluster 2024-09-13T22:21:35.112658+0000 mgr.a (mgr.14355) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22722]: cluster 2024-09-13T22:21:36.101351+0000 mgr.a (mgr.14355) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22722]: cluster 2024-09-13T22:21:36.107202+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-13T22:21:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22722]: audit 2024-09-13T22:21:36.108925+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-13T22:21:37.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:37 smithi131 bash[24745]: cluster 2024-09-13T22:21:36.101351+0000 mgr.a (mgr.14355) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:37.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:37 smithi131 bash[24745]: cluster 2024-09-13T22:21:36.107202+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-13T22:21:37.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:37 smithi131 bash[24745]: audit 2024-09-13T22:21:36.108925+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-13T22:21:37.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:37 smithi171 bash[25040]: cluster 2024-09-13T22:21:36.101351+0000 mgr.a (mgr.14355) 3 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:37.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:37 smithi171 bash[25040]: cluster 2024-09-13T22:21:36.107202+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-13T22:21:37.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:37 smithi171 bash[25040]: audit 2024-09-13T22:21:36.108925+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-13T22:21:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: debug 2024-09-13T22:21:37.614+0000 7f40439ab640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:22:21:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:21:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: Traceback (most recent call last): 2024-09-13T22:21:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:21:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: self._connections.run(self.expiration_interval) 2024-09-13T22:21:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: self._run(expiration_interval) 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:21:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: s = self.context.wrap_socket( 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: return self.sslsocket_class._create( 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: self.do_handshake() 2024-09-13T22:21:37.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:21:37.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: self._sslobj.do_handshake() 2024-09-13T22:21:37.956 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:37 smithi007 bash[22972]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:21:38.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:38 smithi131 bash[24745]: cluster 2024-09-13T22:21:37.112131+0000 mon.a (mon.0) 498 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-13T22:21:38.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:38 smithi131 bash[24745]: audit 2024-09-13T22:21:37.114219+0000 mon.a (mon.0) 499 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-13T22:21:38.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:38 smithi131 bash[24745]: cluster 2024-09-13T22:21:37.118782+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-13T22:21:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:38 smithi171 bash[25040]: cluster 2024-09-13T22:21:37.112131+0000 mon.a (mon.0) 498 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-13T22:21:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:38 smithi171 bash[25040]: audit 2024-09-13T22:21:37.114219+0000 mon.a (mon.0) 499 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-13T22:21:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:38 smithi171 bash[25040]: cluster 2024-09-13T22:21:37.118782+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-13T22:21:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:38 smithi007 bash[22722]: cluster 2024-09-13T22:21:37.112131+0000 mon.a (mon.0) 498 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-13T22:21:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:38 smithi007 bash[22722]: audit 2024-09-13T22:21:37.114219+0000 mon.a (mon.0) 499 : audit [INF] from='client.? 172.21.15.7:0/1342525720' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-13T22:21:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:38 smithi007 bash[22722]: cluster 2024-09-13T22:21:37.118782+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-13T22:21:39.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cephadm 2024-09-13T22:21:37.483387+0000 mgr.a (mgr.14355) 4 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTING 2024-09-13T22:21:39.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cephadm 2024-09-13T22:21:37.607269+0000 mgr.a (mgr.14355) 5 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cephadm 2024-09-13T22:21:37.619850+0000 mgr.a (mgr.14355) 6 : cephadm [ERR] [13/Sep/2024:22:21:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: Traceback (most recent call last): 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: self._connections.run(self.expiration_interval) 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: self._run(expiration_interval) 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:21:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: s = self.context.wrap_socket( 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: return self.sslsocket_class._create( 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: self.do_handshake() 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: self._sslobj.do_handshake() 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cephadm 2024-09-13T22:21:37.709009+0000 mgr.a (mgr.14355) 7 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cephadm 2024-09-13T22:21:37.709398+0000 mgr.a (mgr.14355) 8 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTED 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cluster 2024-09-13T22:21:38.101903+0000 mgr.a (mgr.14355) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cluster 2024-09-13T22:21:38.470426+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: audit 2024-09-13T22:21:38.472853+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:39 smithi131 bash[24745]: cluster 2024-09-13T22:21:38.526496+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cephadm 2024-09-13T22:21:37.483387+0000 mgr.a (mgr.14355) 4 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTING 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cephadm 2024-09-13T22:21:37.607269+0000 mgr.a (mgr.14355) 5 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cephadm 2024-09-13T22:21:37.619850+0000 mgr.a (mgr.14355) 6 : cephadm [ERR] [13/Sep/2024:22:21:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: Traceback (most recent call last): 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: self._connections.run(self.expiration_interval) 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: self._run(expiration_interval) 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:21:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: s = self.context.wrap_socket( 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: return self.sslsocket_class._create( 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: self.do_handshake() 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: self._sslobj.do_handshake() 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cephadm 2024-09-13T22:21:37.709009+0000 mgr.a (mgr.14355) 7 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cephadm 2024-09-13T22:21:37.709398+0000 mgr.a (mgr.14355) 8 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTED 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cluster 2024-09-13T22:21:38.101903+0000 mgr.a (mgr.14355) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cluster 2024-09-13T22:21:38.470426+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-13T22:21:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: audit 2024-09-13T22:21:38.472853+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:39 smithi171 bash[25040]: cluster 2024-09-13T22:21:38.526496+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-13T22:21:39.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cephadm 2024-09-13T22:21:37.483387+0000 mgr.a (mgr.14355) 4 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTING 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cephadm 2024-09-13T22:21:37.607269+0000 mgr.a (mgr.14355) 5 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cephadm 2024-09-13T22:21:37.619850+0000 mgr.a (mgr.14355) 6 : cephadm [ERR] [13/Sep/2024:22:21:37] ENGINE Error in HTTPServer.serve 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: Traceback (most recent call last): 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: self._connections.run(self.expiration_interval) 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: self._run(expiration_interval) 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: s = self.context.wrap_socket( 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: return self.sslsocket_class._create( 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: self.do_handshake() 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: self._sslobj.do_handshake() 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cephadm 2024-09-13T22:21:37.709009+0000 mgr.a (mgr.14355) 7 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cephadm 2024-09-13T22:21:37.709398+0000 mgr.a (mgr.14355) 8 : cephadm [INF] [13/Sep/2024:22:21:37] ENGINE Bus STARTED 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cluster 2024-09-13T22:21:38.101903+0000 mgr.a (mgr.14355) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cluster 2024-09-13T22:21:38.470426+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-13T22:21:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: audit 2024-09-13T22:21:38.472853+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:39 smithi007 bash[22722]: cluster 2024-09-13T22:21:38.526496+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-13T22:21:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:39.469555+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: cluster 2024-09-13T22:21:39.475022+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-13T22:21:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:39.956589+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:39.960490+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:40.014317+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:40.021010+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:40.027958+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:40 smithi131 bash[24745]: audit 2024-09-13T22:21:40.035563+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:39.469555+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: cluster 2024-09-13T22:21:39.475022+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:39.956589+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:39.960490+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:40.014317+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:40.021010+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:40.027958+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:40 smithi171 bash[25040]: audit 2024-09-13T22:21:40.035563+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:39.469555+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: cluster 2024-09-13T22:21:39.475022+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-13T22:21:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:39.956589+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:39.960490+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:40.014317+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:40.021010+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:40.027958+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:40 smithi007 bash[22722]: audit 2024-09-13T22:21:40.035563+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: cluster 2024-09-13T22:21:40.102368+0000 mgr.a (mgr.14355) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 767 B/s wr, 2 op/s 2024-09-13T22:21:41.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: cluster 2024-09-13T22:21:40.476882+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-13T22:21:41.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:40.480264+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.241645+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.247157+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.252217+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.257258+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.262450+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.268058+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.269964+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.270885+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: audit 2024-09-13T22:21:41.474365+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:41 smithi131 bash[24745]: cluster 2024-09-13T22:21:41.478510+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: cluster 2024-09-13T22:21:40.102368+0000 mgr.a (mgr.14355) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 767 B/s wr, 2 op/s 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: cluster 2024-09-13T22:21:40.476882+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:40.480264+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.241645+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.247157+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.252217+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.257258+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.262450+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.268058+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.269964+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.270885+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: audit 2024-09-13T22:21:41.474365+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:41 smithi171 bash[25040]: cluster 2024-09-13T22:21:41.478510+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-13T22:21:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: cluster 2024-09-13T22:21:40.102368+0000 mgr.a (mgr.14355) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 767 B/s wr, 2 op/s 2024-09-13T22:21:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: cluster 2024-09-13T22:21:40.476882+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-13T22:21:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:40.480264+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.241645+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.247157+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.252217+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.257258+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.262450+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.268058+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.269964+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.270885+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: audit 2024-09-13T22:21:41.474365+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:41 smithi007 bash[22722]: cluster 2024-09-13T22:21:41.478510+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-13T22:21:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.272403+0000 mgr.a (mgr.14355) 11 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.272748+0000 mgr.a (mgr.14355) 12 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.272851+0000 mgr.a (mgr.14355) 13 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.495306+0000 mgr.a (mgr.14355) 14 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.495646+0000 mgr.a (mgr.14355) 15 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.511394+0000 mgr.a (mgr.14355) 16 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.697193+0000 mgr.a (mgr.14355) 17 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.697623+0000 mgr.a (mgr.14355) 18 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.708059+0000 mgr.a (mgr.14355) 19 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.887253+0000 mgr.a (mgr.14355) 20 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.887539+0000 mgr.a (mgr.14355) 21 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: cephadm 2024-09-13T22:21:41.897911+0000 mgr.a (mgr.14355) 22 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.078696+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.083441+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.088555+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.093804+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.099037+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.104017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.110769+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.159256+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.161152+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.161962+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:42.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:42 smithi131 bash[24745]: audit 2024-09-13T22:21:42.169246+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.272403+0000 mgr.a (mgr.14355) 11 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:21:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.272748+0000 mgr.a (mgr.14355) 12 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:21:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.272851+0000 mgr.a (mgr.14355) 13 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.495306+0000 mgr.a (mgr.14355) 14 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.495646+0000 mgr.a (mgr.14355) 15 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.511394+0000 mgr.a (mgr.14355) 16 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.697193+0000 mgr.a (mgr.14355) 17 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.697623+0000 mgr.a (mgr.14355) 18 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.708059+0000 mgr.a (mgr.14355) 19 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.887253+0000 mgr.a (mgr.14355) 20 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.887539+0000 mgr.a (mgr.14355) 21 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: cephadm 2024-09-13T22:21:41.897911+0000 mgr.a (mgr.14355) 22 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.078696+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.083441+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.088555+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.093804+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.099037+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.104017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.110769+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.159256+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.161152+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.161962+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:42 smithi171 bash[25040]: audit 2024-09-13T22:21:42.169246+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.272403+0000 mgr.a (mgr.14355) 11 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T22:21:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.272748+0000 mgr.a (mgr.14355) 12 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T22:21:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.272851+0000 mgr.a (mgr.14355) 13 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.conf 2024-09-13T22:21:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.495306+0000 mgr.a (mgr.14355) 14 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.495646+0000 mgr.a (mgr.14355) 15 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.511394+0000 mgr.a (mgr.14355) 16 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.697193+0000 mgr.a (mgr.14355) 17 : cephadm [INF] Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.697623+0000 mgr.a (mgr.14355) 18 : cephadm [INF] Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.708059+0000 mgr.a (mgr.14355) 19 : cephadm [INF] Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.887253+0000 mgr.a (mgr.14355) 20 : cephadm [INF] Updating smithi131:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.887539+0000 mgr.a (mgr.14355) 21 : cephadm [INF] Updating smithi171:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: cephadm 2024-09-13T22:21:41.897911+0000 mgr.a (mgr.14355) 22 : cephadm [INF] Updating smithi007:/var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.078696+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.083441+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.088555+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.093804+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.099037+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.104017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.110769+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.159256+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.161152+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.161962+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:42 smithi007 bash[22722]: audit 2024-09-13T22:21:42.169246+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:43.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:43 smithi131 bash[24745]: cluster 2024-09-13T22:21:42.102923+0000 mgr.a (mgr.14355) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-13T22:21:43.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:43 smithi131 bash[24745]: cluster 2024-09-13T22:21:42.503467+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-13T22:21:43.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:43 smithi131 bash[24745]: audit 2024-09-13T22:21:42.506106+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:43 smithi171 bash[25040]: cluster 2024-09-13T22:21:42.102923+0000 mgr.a (mgr.14355) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-13T22:21:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:43 smithi171 bash[25040]: cluster 2024-09-13T22:21:42.503467+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-13T22:21:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:43 smithi171 bash[25040]: audit 2024-09-13T22:21:42.506106+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:43.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:43 smithi007 bash[22722]: cluster 2024-09-13T22:21:42.102923+0000 mgr.a (mgr.14355) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-13T22:21:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:43 smithi007 bash[22722]: cluster 2024-09-13T22:21:42.503467+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-13T22:21:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:43 smithi007 bash[22722]: audit 2024-09-13T22:21:42.506106+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:44.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:44 smithi131 bash[24745]: audit 2024-09-13T22:21:43.509683+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:44.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:44 smithi131 bash[24745]: cluster 2024-09-13T22:21:43.515494+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-13T22:21:44.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:44 smithi131 bash[24745]: audit 2024-09-13T22:21:43.518703+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:44 smithi171 bash[25040]: audit 2024-09-13T22:21:43.509683+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:44 smithi171 bash[25040]: cluster 2024-09-13T22:21:43.515494+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-13T22:21:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:44 smithi171 bash[25040]: audit 2024-09-13T22:21:43.518703+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:44.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:44 smithi007 bash[22722]: audit 2024-09-13T22:21:43.509683+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:44.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:44 smithi007 bash[22722]: cluster 2024-09-13T22:21:43.515494+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-13T22:21:44.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:44 smithi007 bash[22722]: audit 2024-09-13T22:21:43.518703+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:45.428 INFO:teuthology.orchestra.run.smithi007.stdout:Realm(s) created correctly. Please, use 'ceph rgw realm tokens' to get the token. 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: cluster 2024-09-13T22:21:44.103593+0000 mgr.a (mgr.14355) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 40 op/s 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:44.518800+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: cluster 2024-09-13T22:21:44.525957+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.428635+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.429984+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.432523+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.433552+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.439498+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.442810+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.444689+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.451602+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:45 smithi007 bash[22722]: audit 2024-09-13T22:21:45.453521+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:45.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: cluster 2024-09-13T22:21:44.103593+0000 mgr.a (mgr.14355) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 40 op/s 2024-09-13T22:21:45.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:44.518800+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:45.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: cluster 2024-09-13T22:21:44.525957+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-13T22:21:45.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.428635+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.429984+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.432523+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.433552+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.439498+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.442810+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.444689+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.451602+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:45 smithi131 bash[24745]: audit 2024-09-13T22:21:45.453521+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: cluster 2024-09-13T22:21:44.103593+0000 mgr.a (mgr.14355) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 40 op/s 2024-09-13T22:21:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:44.518800+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.7:0/917861098' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: cluster 2024-09-13T22:21:44.525957+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-13T22:21:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.428635+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.429984+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.432523+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.433552+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.439498+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.442810+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.444689+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi131.waxnqe", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.451602+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:45 smithi171 bash[25040]: audit 2024-09-13T22:21:45.453521+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:46.350 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:21:46.366 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T22:21:46.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f4ff4-721d-11ef-bceb-c7b262605968 -- bash -c 'set -e 2024-09-13T22:21:46.366 DEBUG:teuthology.orchestra.run.smithi007:> set -x 2024-09-13T22:21:46.366 DEBUG:teuthology.orchestra.run.smithi007:> while true; do TOKEN=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> TOKENS=$(ceph rgw realm tokens) 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKENS | jq --exit-status '"'"'.[0].realm == "myrealm1"'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKENS | jq --exit-status '"'"'.[0].token'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> TOKEN_JSON=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"' | base64 --decode) 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_name == "myrealm1"'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKEN_JSON | jq --exit-status '"'"'.endpoint | test("http://.+:\\d+")'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKEN_JSON | jq --exit-status '"'"'.access_key'"'"' 2024-09-13T22:21:46.367 DEBUG:teuthology.orchestra.run.smithi007:> echo $TOKEN_JSON | jq --exit-status '"'"'.secret'"'"' 2024-09-13T22:21:46.368 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-09-13T22:21:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:46 smithi007 bash[22722]: cephadm 2024-09-13T22:21:45.423641+0000 mgr.a (mgr.14355) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:46 smithi007 bash[22722]: cephadm 2024-09-13T22:21:45.454675+0000 mgr.a (mgr.14355) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi131.waxnqe on smithi131 2024-09-13T22:21:46.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:46 smithi131 bash[24745]: cephadm 2024-09-13T22:21:45.423641+0000 mgr.a (mgr.14355) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:46.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:46 smithi131 bash[24745]: cephadm 2024-09-13T22:21:45.454675+0000 mgr.a (mgr.14355) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi131.waxnqe on smithi131 2024-09-13T22:21:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:46 smithi171 bash[25040]: cephadm 2024-09-13T22:21:45.423641+0000 mgr.a (mgr.14355) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:46 smithi171 bash[25040]: cephadm 2024-09-13T22:21:45.454675+0000 mgr.a (mgr.14355) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi131.waxnqe on smithi131 2024-09-13T22:21:47.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:47 smithi171 bash[25040]: cluster 2024-09-13T22:21:46.105253+0000 mgr.a (mgr.14355) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-13T22:21:47.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:47 smithi007 bash[22722]: cluster 2024-09-13T22:21:46.105253+0000 mgr.a (mgr.14355) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-13T22:21:48.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:47 smithi131 bash[24745]: cluster 2024-09-13T22:21:46.105253+0000 mgr.a (mgr.14355) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-13T22:21:48.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:48.280 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:48.280 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:48.780 INFO:journalctl@ceph.mgr.b.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:48.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:48.780 INFO:journalctl@ceph.osd.1.smithi131.stdout:Sep 13 22:21:48 smithi131 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:49.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: cluster 2024-09-13T22:21:48.105959+0000 mgr.a (mgr.14355) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-13T22:21:49.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.545401+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.553269+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.561137+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.562608+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.565602+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.575790+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: audit 2024-09-13T22:21:48.579461+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:49 smithi131 bash[24745]: cephadm 2024-09-13T22:21:48.581267+0000 mgr.a (mgr.14355) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi171.bviyby on smithi171 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: cluster 2024-09-13T22:21:48.105959+0000 mgr.a (mgr.14355) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.545401+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.553269+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.561137+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.562608+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.565602+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.575790+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: audit 2024-09-13T22:21:48.579461+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:49 smithi007 bash[22722]: cephadm 2024-09-13T22:21:48.581267+0000 mgr.a (mgr.14355) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi171.bviyby on smithi171 2024-09-13T22:21:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: cluster 2024-09-13T22:21:48.105959+0000 mgr.a (mgr.14355) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-13T22:21:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.545401+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.553269+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.561137+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.562608+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-13T22:21:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.565602+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi171.bviyby", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-13T22:21:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.575790+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: audit 2024-09-13T22:21:48.579461+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:21:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:49 smithi171 bash[25040]: cephadm 2024-09-13T22:21:48.581267+0000 mgr.a (mgr.14355) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi171.bviyby on smithi171 2024-09-13T22:21:51.113 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/2e3f4ff4-721d-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T22:21:51.257 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:51.258 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 13 22:21:51 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:51.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:51.543 INFO:journalctl@ceph.osd.2.smithi171.stdout:Sep 13 22:21:51 smithi171 systemd[1]: /etc/systemd/system/ceph-2e3f4ff4-721d-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-13T22:21:51.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:51 smithi007 bash[22722]: cluster 2024-09-13T22:21:50.107041+0000 mgr.a (mgr.14355) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 583 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-13T22:21:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:51 smithi007 bash[22722]: cluster 2024-09-13T22:21:50.558995+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-13T22:21:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:51 smithi007 bash[22722]: audit 2024-09-13T22:21:50.563509+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:51 smithi007 bash[22722]: audit 2024-09-13T22:21:50.564528+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:51 smithi007 bash[22722]: audit 2024-09-13T22:21:51.548873+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:51 smithi131 bash[24745]: cluster 2024-09-13T22:21:50.107041+0000 mgr.a (mgr.14355) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 583 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-13T22:21:52.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:51 smithi131 bash[24745]: cluster 2024-09-13T22:21:50.558995+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-13T22:21:52.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:51 smithi131 bash[24745]: audit 2024-09-13T22:21:50.563509+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:52.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:51 smithi131 bash[24745]: audit 2024-09-13T22:21:50.564528+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:52.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:51 smithi131 bash[24745]: audit 2024-09-13T22:21:51.548873+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 bash[25040]: cluster 2024-09-13T22:21:50.107041+0000 mgr.a (mgr.14355) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 583 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-09-13T22:21:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 bash[25040]: cluster 2024-09-13T22:21:50.558995+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-13T22:21:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 bash[25040]: audit 2024-09-13T22:21:50.563509+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 bash[25040]: audit 2024-09-13T22:21:50.564528+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-13T22:21:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:51 smithi171 bash[25040]: audit 2024-09-13T22:21:51.548873+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:21:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:21:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:21:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: audit 2024-09-13T22:21:51.557170+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: audit 2024-09-13T22:21:51.561024+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: cluster 2024-09-13T22:21:51.566451+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-13T22:21:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: audit 2024-09-13T22:21:51.581183+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: audit 2024-09-13T22:21:51.583776+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:52 smithi007 bash[22722]: audit 2024-09-13T22:21:51.587075+0000 mgr.a (mgr.14355) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: audit 2024-09-13T22:21:51.557170+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: audit 2024-09-13T22:21:51.561024+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: cluster 2024-09-13T22:21:51.566451+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: audit 2024-09-13T22:21:51.581183+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: audit 2024-09-13T22:21:51.583776+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:52 smithi171 bash[25040]: audit 2024-09-13T22:21:51.587075+0000 mgr.a (mgr.14355) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: audit 2024-09-13T22:21:51.557170+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: audit 2024-09-13T22:21:51.561024+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: cluster 2024-09-13T22:21:51.566451+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: audit 2024-09-13T22:21:51.581183+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: audit 2024-09-13T22:21:51.583776+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:53.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:52 smithi131 bash[24745]: audit 2024-09-13T22:21:51.587075+0000 mgr.a (mgr.14355) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:21:53.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:53 smithi007 bash[22722]: cluster 2024-09-13T22:21:52.107500+0000 mgr.a (mgr.14355) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-13T22:21:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:53 smithi007 bash[22722]: cluster 2024-09-13T22:21:52.583769+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-13T22:21:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:53 smithi007 bash[22722]: audit 2024-09-13T22:21:52.592339+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:53 smithi007 bash[22722]: audit 2024-09-13T22:21:52.593318+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:53 smithi007 bash[22722]: audit 2024-09-13T22:21:52.774913+0000 mgr.a (mgr.14355) 33 : audit [DBG] from='client.14745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:53 smithi131 bash[24745]: cluster 2024-09-13T22:21:52.107500+0000 mgr.a (mgr.14355) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-13T22:21:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:53 smithi131 bash[24745]: cluster 2024-09-13T22:21:52.583769+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-13T22:21:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:53 smithi131 bash[24745]: audit 2024-09-13T22:21:52.592339+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:53 smithi131 bash[24745]: audit 2024-09-13T22:21:52.593318+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:53 smithi131 bash[24745]: audit 2024-09-13T22:21:52.774913+0000 mgr.a (mgr.14355) 33 : audit [DBG] from='client.14745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:53 smithi171 bash[25040]: cluster 2024-09-13T22:21:52.107500+0000 mgr.a (mgr.14355) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-13T22:21:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:53 smithi171 bash[25040]: cluster 2024-09-13T22:21:52.583769+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-13T22:21:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:53 smithi171 bash[25040]: audit 2024-09-13T22:21:52.592339+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:53 smithi171 bash[25040]: audit 2024-09-13T22:21:52.593318+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-13T22:21:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:53 smithi171 bash[25040]: audit 2024-09-13T22:21:52.774913+0000 mgr.a (mgr.14355) 33 : audit [DBG] from='client.14745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:21:54.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:54 smithi007 bash[22722]: audit 2024-09-13T22:21:53.590554+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:54 smithi007 bash[22722]: cluster 2024-09-13T22:21:53.595861+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-13T22:21:55.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:54 smithi131 bash[24745]: audit 2024-09-13T22:21:53.590554+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:55.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:54 smithi131 bash[24745]: cluster 2024-09-13T22:21:53.595861+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-13T22:21:55.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:54 smithi171 bash[25040]: audit 2024-09-13T22:21:53.590554+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-13T22:21:55.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:54 smithi171 bash[25040]: cluster 2024-09-13T22:21:53.595861+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-13T22:21:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: cluster 2024-09-13T22:21:54.108229+0000 mgr.a (mgr.14355) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T22:21:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: cluster 2024-09-13T22:21:54.646095+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-13T22:21:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: audit 2024-09-13T22:21:54.648067+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: audit 2024-09-13T22:21:54.648873+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: audit 2024-09-13T22:21:54.649364+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: audit 2024-09-13T22:21:54.649776+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:55 smithi007 bash[22722]: audit 2024-09-13T22:21:54.649967+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: cluster 2024-09-13T22:21:54.108229+0000 mgr.a (mgr.14355) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: cluster 2024-09-13T22:21:54.646095+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: audit 2024-09-13T22:21:54.648067+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: audit 2024-09-13T22:21:54.648873+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: audit 2024-09-13T22:21:54.649364+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: audit 2024-09-13T22:21:54.649776+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:55 smithi131 bash[24745]: audit 2024-09-13T22:21:54.649967+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: cluster 2024-09-13T22:21:54.108229+0000 mgr.a (mgr.14355) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: cluster 2024-09-13T22:21:54.646095+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: audit 2024-09-13T22:21:54.648067+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: audit 2024-09-13T22:21:54.648873+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: audit 2024-09-13T22:21:54.649364+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: audit 2024-09-13T22:21:54.649776+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:55 smithi171 bash[25040]: audit 2024-09-13T22:21:54.649967+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-13T22:21:56.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22972]: debug 2024-09-13T22:21:56.750+0000 7f405dc4f640 -1 mgr.server reply reply (152) Unknown error 152 2024-09-13T22:21:56.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22972]: debug 2024-09-13T22:21:56.762+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.643857+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.643979+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.644121+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: cluster 2024-09-13T22:21:55.650536+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.653813+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.654344+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.665461+0000 mon.a (mon.0) 579 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.668190+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:55.668258+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:56.646640+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:56.646825+0000 mon.a (mon.0) 582 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: audit 2024-09-13T22:21:56.646922+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:56 smithi007 bash[22722]: cluster 2024-09-13T22:21:56.653114+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.643857+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.643979+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.644121+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: cluster 2024-09-13T22:21:55.650536+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.653813+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.654344+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.665461+0000 mon.a (mon.0) 579 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.668190+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:55.668258+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:56.646640+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:56.646825+0000 mon.a (mon.0) 582 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: audit 2024-09-13T22:21:56.646922+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:56 smithi131 bash[24745]: cluster 2024-09-13T22:21:56.653114+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.643857+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.643979+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.644121+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: cluster 2024-09-13T22:21:55.650536+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.653813+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.654344+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.131:0/1323868308' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.665461+0000 mon.a (mon.0) 579 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.668190+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:55.668258+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.171:0/4279304594' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-13T22:21:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:56.646640+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi131.waxnqe' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:56.646825+0000 mon.a (mon.0) 582 : audit [INF] from='client.? 172.21.15.7:0/1624872857' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: audit 2024-09-13T22:21:56.646922+0000 mon.a (mon.0) 583 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi171.bviyby' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-13T22:21:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:56 smithi171 bash[25040]: cluster 2024-09-13T22:21:56.653114+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-13T22:21:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:21:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:21:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:21:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:21:57.247 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: cluster 2024-09-13T22:21:56.109027+0000 mgr.a (mgr.14355) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: cephadm 2024-09-13T22:21:56.769127+0000 mgr.a (mgr.14355) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: cluster 2024-09-13T22:21:56.770570+0000 mgr.a (mgr.14355) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.776708+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.784589+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.791418+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: cephadm 2024-09-13T22:21:56.793635+0000 mgr.a (mgr.14355) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.798681+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.804220+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: audit 2024-09-13T22:21:56.860652+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:57 smithi131 bash[24745]: cluster 2024-09-13T22:21:57.666565+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: cluster 2024-09-13T22:21:56.109027+0000 mgr.a (mgr.14355) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: cephadm 2024-09-13T22:21:56.769127+0000 mgr.a (mgr.14355) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: cluster 2024-09-13T22:21:56.770570+0000 mgr.a (mgr.14355) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.776708+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.784589+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.791418+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: cephadm 2024-09-13T22:21:56.793635+0000 mgr.a (mgr.14355) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.798681+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.804220+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: audit 2024-09-13T22:21:56.860652+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:57 smithi171 bash[25040]: cluster 2024-09-13T22:21:57.666565+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: cluster 2024-09-13T22:21:56.109027+0000 mgr.a (mgr.14355) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: cephadm 2024-09-13T22:21:56.769127+0000 mgr.a (mgr.14355) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: cluster 2024-09-13T22:21:56.770570+0000 mgr.a (mgr.14355) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.776708+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.784589+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.791418+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: cephadm 2024-09-13T22:21:56.793635+0000 mgr.a (mgr.14355) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.798681+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.804220+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:21:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: audit 2024-09-13T22:21:56.860652+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:21:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:57 smithi007 bash[22722]: cluster 2024-09-13T22:21:57.666565+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-13T22:22:00.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:59 smithi171 bash[25040]: cluster 2024-09-13T22:21:58.771517+0000 mgr.a (mgr.14355) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-13T22:22:00.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:21:59 smithi171 bash[25040]: audit 2024-09-13T22:21:59.188033+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:00.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:59 smithi007 bash[22722]: cluster 2024-09-13T22:21:58.771517+0000 mgr.a (mgr.14355) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-13T22:22:00.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:21:59 smithi007 bash[22722]: audit 2024-09-13T22:21:59.188033+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:59 smithi131 bash[24745]: cluster 2024-09-13T22:21:58.771517+0000 mgr.a (mgr.14355) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2024-09-13T22:22:00.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:21:59 smithi131 bash[24745]: audit 2024-09-13T22:21:59.188033+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:02.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:01 smithi171 bash[25040]: cluster 2024-09-13T22:22:00.773835+0000 mgr.a (mgr.14355) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 139 KiB/s rd, 6.5 KiB/s wr, 270 op/s 2024-09-13T22:22:02.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:01 smithi007 bash[22722]: cluster 2024-09-13T22:22:00.773835+0000 mgr.a (mgr.14355) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 139 KiB/s rd, 6.5 KiB/s wr, 270 op/s 2024-09-13T22:22:02.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:02.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:02.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:02.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:01 smithi131 bash[24745]: cluster 2024-09-13T22:22:00.773835+0000 mgr.a (mgr.14355) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 139 KiB/s rd, 6.5 KiB/s wr, 270 op/s 2024-09-13T22:22:03.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:03.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.169090+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.182185+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.207557+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.215726+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.218211+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.220243+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: cephadm 2024-09-13T22:22:02.232147+0000 mgr.a (mgr.14355) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.600359+0000 mgr.a (mgr.14355) 42 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.713182+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.720518+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.730565+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.734610+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: audit 2024-09-13T22:22:02.735602+0000 mgr.a (mgr.14355) 43 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22722]: cluster 2024-09-13T22:22:02.774437+0000 mgr.a (mgr.14355) 44 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 4.9 KiB/s wr, 221 op/s 2024-09-13T22:22:03.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.169090+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.182185+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.207557+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.215726+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.218211+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.220243+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: cephadm 2024-09-13T22:22:02.232147+0000 mgr.a (mgr.14355) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.600359+0000 mgr.a (mgr.14355) 42 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.713182+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.720518+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.730565+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.734610+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: audit 2024-09-13T22:22:02.735602+0000 mgr.a (mgr.14355) 43 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:03 smithi131 bash[24745]: cluster 2024-09-13T22:22:02.774437+0000 mgr.a (mgr.14355) 44 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 4.9 KiB/s wr, 221 op/s 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.169090+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.182185+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.207557+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.215726+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.218211+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:03.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.220243+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: cephadm 2024-09-13T22:22:02.232147+0000 mgr.a (mgr.14355) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.600359+0000 mgr.a (mgr.14355) 42 : audit [DBG] from='client.14868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.713182+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.720518+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.730565+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.734610+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: audit 2024-09-13T22:22:02.735602+0000 mgr.a (mgr.14355) 43 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:03 smithi171 bash[25040]: cluster 2024-09-13T22:22:02.774437+0000 mgr.a (mgr.14355) 44 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 4.9 KiB/s wr, 221 op/s 2024-09-13T22:22:03.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22972]: debug 2024-09-13T22:22:03.690+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:03.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:22:03 smithi007 bash[22972]: debug 2024-09-13T22:22:03.694+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:03.697236+0000 mgr.a (mgr.14355) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:05.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: cephadm 2024-09-13T22:22:03.698425+0000 mgr.a (mgr.14355) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: cluster 2024-09-13T22:22:03.699012+0000 mgr.a (mgr.14355) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 103 KiB/s rd, 4.6 KiB/s wr, 208 op/s 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:03.762900+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:03.766229+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:03.767432+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: cephadm 2024-09-13T22:22:03.773018+0000 mgr.a (mgr.14355) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:04.044571+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:04.046831+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:04 smithi131 bash[24745]: audit 2024-09-13T22:22:04.047777+0000 mgr.a (mgr.14355) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:03.697236+0000 mgr.a (mgr.14355) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: cephadm 2024-09-13T22:22:03.698425+0000 mgr.a (mgr.14355) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: cluster 2024-09-13T22:22:03.699012+0000 mgr.a (mgr.14355) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 103 KiB/s rd, 4.6 KiB/s wr, 208 op/s 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:03.762900+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:03.766229+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:03.767432+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: cephadm 2024-09-13T22:22:03.773018+0000 mgr.a (mgr.14355) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:04.044571+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:04.046831+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:04 smithi171 bash[25040]: audit 2024-09-13T22:22:04.047777+0000 mgr.a (mgr.14355) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:05.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22972]: debug 2024-09-13T22:22:04.722+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22972]: debug 2024-09-13T22:22:04.722+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:03.697236+0000 mgr.a (mgr.14355) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: cephadm 2024-09-13T22:22:03.698425+0000 mgr.a (mgr.14355) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: cluster 2024-09-13T22:22:03.699012+0000 mgr.a (mgr.14355) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 103 KiB/s rd, 4.6 KiB/s wr, 208 op/s 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:03.762900+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:03.766229+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:03.767432+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:22:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: cephadm 2024-09-13T22:22:03.773018+0000 mgr.a (mgr.14355) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-13T22:22:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:04.044571+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:04.046831+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:04 smithi007 bash[22722]: audit 2024-09-13T22:22:04.047777+0000 mgr.a (mgr.14355) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:22:06.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:05 smithi131 bash[24745]: audit 2024-09-13T22:22:04.726461+0000 mgr.a (mgr.14355) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:06.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:05 smithi131 bash[24745]: cephadm 2024-09-13T22:22:04.728343+0000 mgr.a (mgr.14355) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:06.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:05 smithi171 bash[25040]: audit 2024-09-13T22:22:04.726461+0000 mgr.a (mgr.14355) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:06.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:05 smithi171 bash[25040]: cephadm 2024-09-13T22:22:04.728343+0000 mgr.a (mgr.14355) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:05 smithi007 bash[22722]: audit 2024-09-13T22:22:04.726461+0000 mgr.a (mgr.14355) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:22:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:05 smithi007 bash[22722]: cephadm 2024-09-13T22:22:04.728343+0000 mgr.a (mgr.14355) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:22:07.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:06 smithi131 bash[24745]: cluster 2024-09-13T22:22:05.701305+0000 mgr.a (mgr.14355) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 5.2 KiB/s wr, 197 op/s 2024-09-13T22:22:07.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:06 smithi171 bash[25040]: cluster 2024-09-13T22:22:05.701305+0000 mgr.a (mgr.14355) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 5.2 KiB/s wr, 197 op/s 2024-09-13T22:22:07.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:06 smithi007 bash[22722]: cluster 2024-09-13T22:22:05.701305+0000 mgr.a (mgr.14355) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 110 KiB/s rd, 5.2 KiB/s wr, 197 op/s 2024-09-13T22:22:08.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:08.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:08.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:08.784 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:09.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:08 smithi131 bash[24745]: cluster 2024-09-13T22:22:07.702140+0000 mgr.a (mgr.14355) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:09.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:08 smithi171 bash[25040]: cluster 2024-09-13T22:22:07.702140+0000 mgr.a (mgr.14355) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:09.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:08 smithi007 bash[22722]: cluster 2024-09-13T22:22:07.702140+0000 mgr.a (mgr.14355) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:10.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:09 smithi131 bash[24745]: audit 2024-09-13T22:22:08.352298+0000 mgr.a (mgr.14355) 54 : audit [DBG] from='client.15228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:10.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:09 smithi131 bash[24745]: audit 2024-09-13T22:22:09.201433+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:10.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:09 smithi171 bash[25040]: audit 2024-09-13T22:22:08.352298+0000 mgr.a (mgr.14355) 54 : audit [DBG] from='client.15228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:10.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:09 smithi171 bash[25040]: audit 2024-09-13T22:22:09.201433+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:09 smithi007 bash[22722]: audit 2024-09-13T22:22:08.352298+0000 mgr.a (mgr.14355) 54 : audit [DBG] from='client.15228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:09 smithi007 bash[22722]: audit 2024-09-13T22:22:09.201433+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:22:11.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:10 smithi131 bash[24745]: cluster 2024-09-13T22:22:09.703106+0000 mgr.a (mgr.14355) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:11.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:10 smithi171 bash[25040]: cluster 2024-09-13T22:22:09.703106+0000 mgr.a (mgr.14355) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:11.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:10 smithi007 bash[22722]: cluster 2024-09-13T22:22:09.703106+0000 mgr.a (mgr.14355) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 4.3 KiB/s wr, 163 op/s 2024-09-13T22:22:13.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:12 smithi131 bash[24745]: cluster 2024-09-13T22:22:11.705382+0000 mgr.a (mgr.14355) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:12 smithi171 bash[25040]: cluster 2024-09-13T22:22:11.705382+0000 mgr.a (mgr.14355) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:13.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:12 smithi007 bash[22722]: cluster 2024-09-13T22:22:11.705382+0000 mgr.a (mgr.14355) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:13.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:13.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:13.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:14.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:14.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:14.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:14.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:14.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:15.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:14 smithi131 bash[24745]: cluster 2024-09-13T22:22:13.706175+0000 mgr.a (mgr.14355) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:15.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:14 smithi171 bash[25040]: cluster 2024-09-13T22:22:13.706175+0000 mgr.a (mgr.14355) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:15.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:14 smithi007 bash[22722]: cluster 2024-09-13T22:22:13.706175+0000 mgr.a (mgr.14355) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-13T22:22:16.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:15 smithi131 bash[24745]: audit 2024-09-13T22:22:14.121002+0000 mgr.a (mgr.14355) 58 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:16.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:15 smithi171 bash[25040]: audit 2024-09-13T22:22:14.121002+0000 mgr.a (mgr.14355) 58 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:16.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:15 smithi007 bash[22722]: audit 2024-09-13T22:22:14.121002+0000 mgr.a (mgr.14355) 58 : audit [DBG] from='client.15303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:17.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:16 smithi131 bash[24745]: cluster 2024-09-13T22:22:15.708460+0000 mgr.a (mgr.14355) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-13T22:22:17.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:16 smithi171 bash[25040]: cluster 2024-09-13T22:22:15.708460+0000 mgr.a (mgr.14355) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-13T22:22:17.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:16 smithi007 bash[22722]: cluster 2024-09-13T22:22:15.708460+0000 mgr.a (mgr.14355) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-13T22:22:19.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:18 smithi131 bash[24745]: cluster 2024-09-13T22:22:17.709252+0000 mgr.a (mgr.14355) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:19.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:18 smithi171 bash[25040]: cluster 2024-09-13T22:22:17.709252+0000 mgr.a (mgr.14355) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:19.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:18 smithi007 bash[22722]: cluster 2024-09-13T22:22:17.709252+0000 mgr.a (mgr.14355) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:19.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:20.294 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:21.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:20 smithi131 bash[24745]: cluster 2024-09-13T22:22:19.710004+0000 mgr.a (mgr.14355) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:21.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:20 smithi131 bash[24745]: audit 2024-09-13T22:22:19.889269+0000 mgr.a (mgr.14355) 62 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:21.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:20 smithi171 bash[25040]: cluster 2024-09-13T22:22:19.710004+0000 mgr.a (mgr.14355) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:20 smithi171 bash[25040]: audit 2024-09-13T22:22:19.889269+0000 mgr.a (mgr.14355) 62 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:21.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:20 smithi007 bash[22722]: cluster 2024-09-13T22:22:19.710004+0000 mgr.a (mgr.14355) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:21.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:20 smithi007 bash[22722]: audit 2024-09-13T22:22:19.889269+0000 mgr.a (mgr.14355) 62 : audit [DBG] from='client.15381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:23.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:22 smithi171 bash[25040]: cluster 2024-09-13T22:22:21.712666+0000 mgr.a (mgr.14355) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:22:23.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:22 smithi007 bash[22722]: cluster 2024-09-13T22:22:21.712666+0000 mgr.a (mgr.14355) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:22:23.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:22 smithi131 bash[24745]: cluster 2024-09-13T22:22:21.712666+0000 mgr.a (mgr.14355) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:22:25.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:24 smithi171 bash[25040]: cluster 2024-09-13T22:22:23.713483+0000 mgr.a (mgr.14355) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:22:25.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:24 smithi007 bash[22722]: cluster 2024-09-13T22:22:23.713483+0000 mgr.a (mgr.14355) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:22:25.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:24 smithi131 bash[24745]: cluster 2024-09-13T22:22:23.713483+0000 mgr.a (mgr.14355) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:22:25.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:25.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:25.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:26.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:26.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:26.074 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:26 smithi171 bash[25040]: audit 2024-09-13T22:22:25.637721+0000 mgr.a (mgr.14355) 65 : audit [DBG] from='client.15456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:27.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:26 smithi171 bash[25040]: cluster 2024-09-13T22:22:25.714822+0000 mgr.a (mgr.14355) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:26 smithi007 bash[22722]: audit 2024-09-13T22:22:25.637721+0000 mgr.a (mgr.14355) 65 : audit [DBG] from='client.15456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:26 smithi007 bash[22722]: cluster 2024-09-13T22:22:25.714822+0000 mgr.a (mgr.14355) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:27.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:26 smithi131 bash[24745]: audit 2024-09-13T22:22:25.637721+0000 mgr.a (mgr.14355) 65 : audit [DBG] from='client.15456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:27.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:26 smithi131 bash[24745]: cluster 2024-09-13T22:22:25.714822+0000 mgr.a (mgr.14355) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:28 smithi007 bash[22722]: cluster 2024-09-13T22:22:27.715741+0000 mgr.a (mgr.14355) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:22:29.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:28 smithi131 bash[24745]: cluster 2024-09-13T22:22:27.715741+0000 mgr.a (mgr.14355) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:22:29.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:28 smithi171 bash[25040]: cluster 2024-09-13T22:22:27.715741+0000 mgr.a (mgr.14355) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:22:31.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:31.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:30 smithi007 bash[22722]: cluster 2024-09-13T22:22:29.716525+0000 mgr.a (mgr.14355) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:22:31.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:30 smithi131 bash[24745]: cluster 2024-09-13T22:22:29.716525+0000 mgr.a (mgr.14355) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:22:31.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:30 smithi171 bash[25040]: cluster 2024-09-13T22:22:29.716525+0000 mgr.a (mgr.14355) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:32 smithi007 bash[22722]: audit 2024-09-13T22:22:31.411064+0000 mgr.a (mgr.14355) 69 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:32 smithi007 bash[22722]: cluster 2024-09-13T22:22:31.717683+0000 mgr.a (mgr.14355) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:33.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:32 smithi131 bash[24745]: audit 2024-09-13T22:22:31.411064+0000 mgr.a (mgr.14355) 69 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:33.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:32 smithi131 bash[24745]: cluster 2024-09-13T22:22:31.717683+0000 mgr.a (mgr.14355) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:33.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:32 smithi171 bash[25040]: audit 2024-09-13T22:22:31.411064+0000 mgr.a (mgr.14355) 69 : audit [DBG] from='client.15534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:33.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:32 smithi171 bash[25040]: cluster 2024-09-13T22:22:31.717683+0000 mgr.a (mgr.14355) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:35.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:34 smithi007 bash[22722]: cluster 2024-09-13T22:22:33.718570+0000 mgr.a (mgr.14355) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:22:35.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:34 smithi131 bash[24745]: cluster 2024-09-13T22:22:33.718570+0000 mgr.a (mgr.14355) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:22:35.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:34 smithi171 bash[25040]: cluster 2024-09-13T22:22:33.718570+0000 mgr.a (mgr.14355) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:22:36.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:36.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:36.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:37.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:36 smithi007 bash[22722]: cluster 2024-09-13T22:22:35.720804+0000 mgr.a (mgr.14355) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:22:37.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:36 smithi131 bash[24745]: cluster 2024-09-13T22:22:35.720804+0000 mgr.a (mgr.14355) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:22:37.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:36 smithi171 bash[25040]: cluster 2024-09-13T22:22:35.720804+0000 mgr.a (mgr.14355) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:22:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:37.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:37.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:37.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:37.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:39.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:38 smithi007 bash[22722]: audit 2024-09-13T22:22:37.185645+0000 mgr.a (mgr.14355) 73 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:39.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:38 smithi007 bash[22722]: cluster 2024-09-13T22:22:37.721743+0000 mgr.a (mgr.14355) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:39.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:38 smithi131 bash[24745]: audit 2024-09-13T22:22:37.185645+0000 mgr.a (mgr.14355) 73 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:39.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:38 smithi131 bash[24745]: cluster 2024-09-13T22:22:37.721743+0000 mgr.a (mgr.14355) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:39.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:38 smithi171 bash[25040]: audit 2024-09-13T22:22:37.185645+0000 mgr.a (mgr.14355) 73 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:39.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:38 smithi171 bash[25040]: cluster 2024-09-13T22:22:37.721743+0000 mgr.a (mgr.14355) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:41.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:40 smithi007 bash[22722]: cluster 2024-09-13T22:22:39.722606+0000 mgr.a (mgr.14355) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:41.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:40 smithi131 bash[24745]: cluster 2024-09-13T22:22:39.722606+0000 mgr.a (mgr.14355) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:41.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:40 smithi171 bash[25040]: cluster 2024-09-13T22:22:39.722606+0000 mgr.a (mgr.14355) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:43.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:42 smithi007 bash[22722]: cluster 2024-09-13T22:22:41.724789+0000 mgr.a (mgr.14355) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:43.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:42 smithi131 bash[24745]: cluster 2024-09-13T22:22:41.724789+0000 mgr.a (mgr.14355) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:43.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:42 smithi171 bash[25040]: cluster 2024-09-13T22:22:41.724789+0000 mgr.a (mgr.14355) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:43.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:44.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:43 smithi007 bash[22722]: audit 2024-09-13T22:22:42.957024+0000 mgr.a (mgr.14355) 77 : audit [DBG] from='client.15687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:44.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:43 smithi131 bash[24745]: audit 2024-09-13T22:22:42.957024+0000 mgr.a (mgr.14355) 77 : audit [DBG] from='client.15687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:44.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:43 smithi171 bash[25040]: audit 2024-09-13T22:22:42.957024+0000 mgr.a (mgr.14355) 77 : audit [DBG] from='client.15687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:45.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:44 smithi007 bash[22722]: cluster 2024-09-13T22:22:43.725890+0000 mgr.a (mgr.14355) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:45.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:44 smithi131 bash[24745]: cluster 2024-09-13T22:22:43.725890+0000 mgr.a (mgr.14355) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:45.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:44 smithi171 bash[25040]: cluster 2024-09-13T22:22:43.725890+0000 mgr.a (mgr.14355) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:47.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:46 smithi007 bash[22722]: cluster 2024-09-13T22:22:45.728225+0000 mgr.a (mgr.14355) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:47.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:46 smithi131 bash[24745]: cluster 2024-09-13T22:22:45.728225+0000 mgr.a (mgr.14355) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:47.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:46 smithi171 bash[25040]: cluster 2024-09-13T22:22:45.728225+0000 mgr.a (mgr.14355) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:48.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:48.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:49.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:49.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:48 smithi007 bash[22722]: cluster 2024-09-13T22:22:47.729005+0000 mgr.a (mgr.14355) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:49.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:48 smithi131 bash[24745]: cluster 2024-09-13T22:22:47.729005+0000 mgr.a (mgr.14355) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:49.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:48 smithi171 bash[25040]: cluster 2024-09-13T22:22:47.729005+0000 mgr.a (mgr.14355) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:50.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:49 smithi007 bash[22722]: audit 2024-09-13T22:22:48.711204+0000 mgr.a (mgr.14355) 81 : audit [DBG] from='client.15765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:50.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:49 smithi131 bash[24745]: audit 2024-09-13T22:22:48.711204+0000 mgr.a (mgr.14355) 81 : audit [DBG] from='client.15765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:50.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:49 smithi171 bash[25040]: audit 2024-09-13T22:22:48.711204+0000 mgr.a (mgr.14355) 81 : audit [DBG] from='client.15765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:51.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:50 smithi007 bash[22722]: cluster 2024-09-13T22:22:49.729942+0000 mgr.a (mgr.14355) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:51.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:50 smithi131 bash[24745]: cluster 2024-09-13T22:22:49.729942+0000 mgr.a (mgr.14355) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:51.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:50 smithi171 bash[25040]: cluster 2024-09-13T22:22:49.729942+0000 mgr.a (mgr.14355) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:53.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:52 smithi007 bash[22722]: cluster 2024-09-13T22:22:51.732358+0000 mgr.a (mgr.14355) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:53.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:52 smithi131 bash[24745]: cluster 2024-09-13T22:22:51.732358+0000 mgr.a (mgr.14355) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:52 smithi171 bash[25040]: cluster 2024-09-13T22:22:51.732358+0000 mgr.a (mgr.14355) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:54.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:54.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:54.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:22:54.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:22:54.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:22:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:22:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:22:54.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:22:55.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:54 smithi007 bash[22722]: cluster 2024-09-13T22:22:53.733272+0000 mgr.a (mgr.14355) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:55.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:54 smithi131 bash[24745]: cluster 2024-09-13T22:22:53.733272+0000 mgr.a (mgr.14355) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:55.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:54 smithi171 bash[25040]: cluster 2024-09-13T22:22:53.733272+0000 mgr.a (mgr.14355) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:56.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:55 smithi007 bash[22722]: audit 2024-09-13T22:22:54.481344+0000 mgr.a (mgr.14355) 85 : audit [DBG] from='client.15840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:56.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:55 smithi131 bash[24745]: audit 2024-09-13T22:22:54.481344+0000 mgr.a (mgr.14355) 85 : audit [DBG] from='client.15840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:56.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:55 smithi171 bash[25040]: audit 2024-09-13T22:22:54.481344+0000 mgr.a (mgr.14355) 85 : audit [DBG] from='client.15840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:22:57.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:56 smithi007 bash[22722]: cluster 2024-09-13T22:22:55.735592+0000 mgr.a (mgr.14355) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:57.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:56 smithi131 bash[24745]: cluster 2024-09-13T22:22:55.735592+0000 mgr.a (mgr.14355) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:57.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:56 smithi171 bash[25040]: cluster 2024-09-13T22:22:55.735592+0000 mgr.a (mgr.14355) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:22:59.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:22:58 smithi007 bash[22722]: cluster 2024-09-13T22:22:57.736333+0000 mgr.a (mgr.14355) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:59.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:22:58 smithi131 bash[24745]: cluster 2024-09-13T22:22:57.736333+0000 mgr.a (mgr.14355) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:59.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:22:58 smithi171 bash[25040]: cluster 2024-09-13T22:22:57.736333+0000 mgr.a (mgr.14355) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:22:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:22:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:22:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:00.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:00.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:00.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:00.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:00.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:01.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:00 smithi007 bash[22722]: cluster 2024-09-13T22:22:59.737134+0000 mgr.a (mgr.14355) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:01.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:00 smithi131 bash[24745]: cluster 2024-09-13T22:22:59.737134+0000 mgr.a (mgr.14355) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:01.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:00 smithi171 bash[25040]: cluster 2024-09-13T22:22:59.737134+0000 mgr.a (mgr.14355) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:02.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:01 smithi007 bash[22722]: audit 2024-09-13T22:23:00.221714+0000 mgr.a (mgr.14355) 89 : audit [DBG] from='client.15918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:02.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:01 smithi131 bash[24745]: audit 2024-09-13T22:23:00.221714+0000 mgr.a (mgr.14355) 89 : audit [DBG] from='client.15918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:02.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:01 smithi171 bash[25040]: audit 2024-09-13T22:23:00.221714+0000 mgr.a (mgr.14355) 89 : audit [DBG] from='client.15918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:03.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:02 smithi007 bash[22722]: cluster 2024-09-13T22:23:01.739780+0000 mgr.a (mgr.14355) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:03.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:02 smithi131 bash[24745]: cluster 2024-09-13T22:23:01.739780+0000 mgr.a (mgr.14355) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:03.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:02 smithi171 bash[25040]: cluster 2024-09-13T22:23:01.739780+0000 mgr.a (mgr.14355) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:05.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:04 smithi007 bash[22722]: cluster 2024-09-13T22:23:03.740542+0000 mgr.a (mgr.14355) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:05.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:04 smithi007 bash[22722]: audit 2024-09-13T22:23:04.800395+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:23:05.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:04 smithi131 bash[24745]: cluster 2024-09-13T22:23:03.740542+0000 mgr.a (mgr.14355) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:05.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:04 smithi131 bash[24745]: audit 2024-09-13T22:23:04.800395+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:23:05.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:04 smithi171 bash[25040]: cluster 2024-09-13T22:23:03.740542+0000 mgr.a (mgr.14355) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:05.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:04 smithi171 bash[25040]: audit 2024-09-13T22:23:04.800395+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:23:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:05 smithi007 bash[22722]: audit 2024-09-13T22:23:05.646790+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:23:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:05 smithi007 bash[22722]: audit 2024-09-13T22:23:05.648068+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:23:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:05 smithi007 bash[22722]: audit 2024-09-13T22:23:05.654431+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:23:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:05 smithi007 bash[22722]: audit 2024-09-13T22:23:05.656503+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:06.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:05 smithi131 bash[24745]: audit 2024-09-13T22:23:05.646790+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:23:06.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:05 smithi131 bash[24745]: audit 2024-09-13T22:23:05.648068+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:23:06.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:05 smithi131 bash[24745]: audit 2024-09-13T22:23:05.654431+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:23:06.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:05 smithi131 bash[24745]: audit 2024-09-13T22:23:05.656503+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:05 smithi171 bash[25040]: audit 2024-09-13T22:23:05.646790+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:23:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:05 smithi171 bash[25040]: audit 2024-09-13T22:23:05.648068+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:23:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:05 smithi171 bash[25040]: audit 2024-09-13T22:23:05.654431+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:23:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:05 smithi171 bash[25040]: audit 2024-09-13T22:23:05.656503+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:06.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:23:06 smithi007 bash[22972]: debug 2024-09-13T22:23:06.369+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:23:06.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:23:06 smithi007 bash[22972]: debug 2024-09-13T22:23:06.381+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:23:06.758 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:07.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:06 smithi007 bash[22722]: audit 2024-09-13T22:23:05.657695+0000 mgr.a (mgr.14355) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:07.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:06 smithi007 bash[22722]: cluster 2024-09-13T22:23:05.741773+0000 mgr.a (mgr.14355) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:07.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:06 smithi007 bash[22722]: audit 2024-09-13T22:23:05.982833+0000 mgr.a (mgr.14355) 94 : audit [DBG] from='client.16002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:07.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:06 smithi131 bash[24745]: audit 2024-09-13T22:23:05.657695+0000 mgr.a (mgr.14355) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:07.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:06 smithi131 bash[24745]: cluster 2024-09-13T22:23:05.741773+0000 mgr.a (mgr.14355) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:07.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:06 smithi131 bash[24745]: audit 2024-09-13T22:23:05.982833+0000 mgr.a (mgr.14355) 94 : audit [DBG] from='client.16002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:07.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:06 smithi171 bash[25040]: audit 2024-09-13T22:23:05.657695+0000 mgr.a (mgr.14355) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:23:07.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:06 smithi171 bash[25040]: cluster 2024-09-13T22:23:05.741773+0000 mgr.a (mgr.14355) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:07.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:06 smithi171 bash[25040]: audit 2024-09-13T22:23:05.982833+0000 mgr.a (mgr.14355) 94 : audit [DBG] from='client.16002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:07 smithi007 bash[22722]: audit 2024-09-13T22:23:06.373031+0000 mgr.a (mgr.14355) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:23:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:07 smithi007 bash[22722]: cephadm 2024-09-13T22:23:06.384477+0000 mgr.a (mgr.14355) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:23:08.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:07 smithi131 bash[24745]: audit 2024-09-13T22:23:06.373031+0000 mgr.a (mgr.14355) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:23:08.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:07 smithi131 bash[24745]: cephadm 2024-09-13T22:23:06.384477+0000 mgr.a (mgr.14355) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:23:08.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:07 smithi171 bash[25040]: audit 2024-09-13T22:23:06.373031+0000 mgr.a (mgr.14355) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:23:08.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:07 smithi171 bash[25040]: cephadm 2024-09-13T22:23:06.384477+0000 mgr.a (mgr.14355) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:23:09.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:08 smithi007 bash[22722]: cluster 2024-09-13T22:23:07.742775+0000 mgr.a (mgr.14355) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:08 smithi131 bash[24745]: cluster 2024-09-13T22:23:07.742775+0000 mgr.a (mgr.14355) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:09.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:08 smithi171 bash[25040]: cluster 2024-09-13T22:23:07.742775+0000 mgr.a (mgr.14355) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:11.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:10 smithi007 bash[22722]: cluster 2024-09-13T22:23:09.743710+0000 mgr.a (mgr.14355) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:11.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:10 smithi131 bash[24745]: cluster 2024-09-13T22:23:09.743710+0000 mgr.a (mgr.14355) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:11.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:10 smithi171 bash[25040]: cluster 2024-09-13T22:23:09.743710+0000 mgr.a (mgr.14355) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:12.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:12.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:13.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:12 smithi007 bash[22722]: cluster 2024-09-13T22:23:11.745879+0000 mgr.a (mgr.14355) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:13.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:12 smithi131 bash[24745]: cluster 2024-09-13T22:23:11.745879+0000 mgr.a (mgr.14355) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:13.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:12 smithi171 bash[25040]: cluster 2024-09-13T22:23:11.745879+0000 mgr.a (mgr.14355) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:13 smithi007 bash[22722]: audit 2024-09-13T22:23:12.097278+0000 mgr.a (mgr.14355) 100 : audit [DBG] from='client.16179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:14.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:13 smithi131 bash[24745]: audit 2024-09-13T22:23:12.097278+0000 mgr.a (mgr.14355) 100 : audit [DBG] from='client.16179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:14.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:13 smithi171 bash[25040]: audit 2024-09-13T22:23:12.097278+0000 mgr.a (mgr.14355) 100 : audit [DBG] from='client.16179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:15.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:14 smithi007 bash[22722]: cluster 2024-09-13T22:23:13.746783+0000 mgr.a (mgr.14355) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:15.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:14 smithi131 bash[24745]: cluster 2024-09-13T22:23:13.746783+0000 mgr.a (mgr.14355) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:15.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:14 smithi171 bash[25040]: cluster 2024-09-13T22:23:13.746783+0000 mgr.a (mgr.14355) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:17.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:16 smithi007 bash[22722]: cluster 2024-09-13T22:23:15.748940+0000 mgr.a (mgr.14355) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:17.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:16 smithi131 bash[24745]: cluster 2024-09-13T22:23:15.748940+0000 mgr.a (mgr.14355) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:17.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:16 smithi171 bash[25040]: cluster 2024-09-13T22:23:15.748940+0000 mgr.a (mgr.14355) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:17.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:17.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:18.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:18.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:19.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:18 smithi007 bash[22722]: cluster 2024-09-13T22:23:17.749797+0000 mgr.a (mgr.14355) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:19.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:18 smithi007 bash[22722]: audit 2024-09-13T22:23:17.850017+0000 mgr.a (mgr.14355) 104 : audit [DBG] from='client.16254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:19.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:18 smithi131 bash[24745]: cluster 2024-09-13T22:23:17.749797+0000 mgr.a (mgr.14355) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:19.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:18 smithi131 bash[24745]: audit 2024-09-13T22:23:17.850017+0000 mgr.a (mgr.14355) 104 : audit [DBG] from='client.16254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:19.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:18 smithi171 bash[25040]: cluster 2024-09-13T22:23:17.749797+0000 mgr.a (mgr.14355) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:19.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:18 smithi171 bash[25040]: audit 2024-09-13T22:23:17.850017+0000 mgr.a (mgr.14355) 104 : audit [DBG] from='client.16254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:21.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:20 smithi007 bash[22722]: cluster 2024-09-13T22:23:19.750745+0000 mgr.a (mgr.14355) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:21.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:20 smithi131 bash[24745]: cluster 2024-09-13T22:23:19.750745+0000 mgr.a (mgr.14355) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:21.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:20 smithi171 bash[25040]: cluster 2024-09-13T22:23:19.750745+0000 mgr.a (mgr.14355) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:23.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:22 smithi131 bash[24745]: cluster 2024-09-13T22:23:21.752982+0000 mgr.a (mgr.14355) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:23.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:23.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:22 smithi171 bash[25040]: cluster 2024-09-13T22:23:21.752982+0000 mgr.a (mgr.14355) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:23.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:22 smithi007 bash[22722]: cluster 2024-09-13T22:23:21.752982+0000 mgr.a (mgr.14355) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:23:24.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:24.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:25.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:24 smithi131 bash[24745]: audit 2024-09-13T22:23:23.621667+0000 mgr.a (mgr.14355) 107 : audit [DBG] from='client.16329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:25.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:24 smithi131 bash[24745]: cluster 2024-09-13T22:23:23.761712+0000 mgr.a (mgr.14355) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:25.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:24 smithi171 bash[25040]: audit 2024-09-13T22:23:23.621667+0000 mgr.a (mgr.14355) 107 : audit [DBG] from='client.16329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:25.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:24 smithi171 bash[25040]: cluster 2024-09-13T22:23:23.761712+0000 mgr.a (mgr.14355) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:25.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:24 smithi007 bash[22722]: audit 2024-09-13T22:23:23.621667+0000 mgr.a (mgr.14355) 107 : audit [DBG] from='client.16329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:25.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:24 smithi007 bash[22722]: cluster 2024-09-13T22:23:23.761712+0000 mgr.a (mgr.14355) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:27.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:26 smithi131 bash[24745]: cluster 2024-09-13T22:23:25.764121+0000 mgr.a (mgr.14355) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:27.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:26 smithi171 bash[25040]: cluster 2024-09-13T22:23:25.764121+0000 mgr.a (mgr.14355) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:27.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:26 smithi007 bash[22722]: cluster 2024-09-13T22:23:25.764121+0000 mgr.a (mgr.14355) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:29.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:28 smithi131 bash[24745]: cluster 2024-09-13T22:23:27.764881+0000 mgr.a (mgr.14355) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:29.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:28 smithi171 bash[25040]: cluster 2024-09-13T22:23:27.764881+0000 mgr.a (mgr.14355) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:29.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:28 smithi007 bash[22722]: cluster 2024-09-13T22:23:27.764881+0000 mgr.a (mgr.14355) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:29.818 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:29.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:31.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:30 smithi131 bash[24745]: audit 2024-09-13T22:23:29.388743+0000 mgr.a (mgr.14355) 111 : audit [DBG] from='client.16407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:31.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:30 smithi131 bash[24745]: cluster 2024-09-13T22:23:29.765424+0000 mgr.a (mgr.14355) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:31.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:30 smithi171 bash[25040]: audit 2024-09-13T22:23:29.388743+0000 mgr.a (mgr.14355) 111 : audit [DBG] from='client.16407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:31.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:30 smithi171 bash[25040]: cluster 2024-09-13T22:23:29.765424+0000 mgr.a (mgr.14355) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:31.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:30 smithi007 bash[22722]: audit 2024-09-13T22:23:29.388743+0000 mgr.a (mgr.14355) 111 : audit [DBG] from='client.16407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:31.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:30 smithi007 bash[22722]: cluster 2024-09-13T22:23:29.765424+0000 mgr.a (mgr.14355) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:33.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:32 smithi131 bash[24745]: cluster 2024-09-13T22:23:31.767653+0000 mgr.a (mgr.14355) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:33.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:32 smithi171 bash[25040]: cluster 2024-09-13T22:23:31.767653+0000 mgr.a (mgr.14355) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:33.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:32 smithi007 bash[22722]: cluster 2024-09-13T22:23:31.767653+0000 mgr.a (mgr.14355) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:35.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:34 smithi131 bash[24745]: cluster 2024-09-13T22:23:33.768410+0000 mgr.a (mgr.14355) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:35.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:34 smithi171 bash[25040]: cluster 2024-09-13T22:23:33.768410+0000 mgr.a (mgr.14355) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:34 smithi007 bash[22722]: cluster 2024-09-13T22:23:33.768410+0000 mgr.a (mgr.14355) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:35.575 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:37.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:36 smithi131 bash[24745]: audit 2024-09-13T22:23:35.160194+0000 mgr.a (mgr.14355) 115 : audit [DBG] from='client.16479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:37.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:36 smithi131 bash[24745]: cluster 2024-09-13T22:23:35.771184+0000 mgr.a (mgr.14355) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:37.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:36 smithi171 bash[25040]: audit 2024-09-13T22:23:35.160194+0000 mgr.a (mgr.14355) 115 : audit [DBG] from='client.16479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:37.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:36 smithi171 bash[25040]: cluster 2024-09-13T22:23:35.771184+0000 mgr.a (mgr.14355) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:37.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:36 smithi007 bash[22722]: audit 2024-09-13T22:23:35.160194+0000 mgr.a (mgr.14355) 115 : audit [DBG] from='client.16479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:37.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:36 smithi007 bash[22722]: cluster 2024-09-13T22:23:35.771184+0000 mgr.a (mgr.14355) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:39.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:38 smithi131 bash[24745]: cluster 2024-09-13T22:23:37.771983+0000 mgr.a (mgr.14355) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:39.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:38 smithi171 bash[25040]: cluster 2024-09-13T22:23:37.771983+0000 mgr.a (mgr.14355) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:39.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:38 smithi007 bash[22722]: cluster 2024-09-13T22:23:37.771983+0000 mgr.a (mgr.14355) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:40.577 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:41.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:40 smithi131 bash[24745]: cluster 2024-09-13T22:23:39.772762+0000 mgr.a (mgr.14355) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:41.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:40 smithi171 bash[25040]: cluster 2024-09-13T22:23:39.772762+0000 mgr.a (mgr.14355) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:41.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:41.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:40 smithi007 bash[22722]: cluster 2024-09-13T22:23:39.772762+0000 mgr.a (mgr.14355) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:23:42.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:41 smithi131 bash[24745]: audit 2024-09-13T22:23:40.917845+0000 mgr.a (mgr.14355) 119 : audit [DBG] from='client.16554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:42.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:41 smithi171 bash[25040]: audit 2024-09-13T22:23:40.917845+0000 mgr.a (mgr.14355) 119 : audit [DBG] from='client.16554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:41 smithi007 bash[22722]: audit 2024-09-13T22:23:40.917845+0000 mgr.a (mgr.14355) 119 : audit [DBG] from='client.16554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:43.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:43 smithi131 bash[24745]: cluster 2024-09-13T22:23:41.775559+0000 mgr.a (mgr.14355) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:43.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:43 smithi171 bash[25040]: cluster 2024-09-13T22:23:41.775559+0000 mgr.a (mgr.14355) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:43 smithi007 bash[22722]: cluster 2024-09-13T22:23:41.775559+0000 mgr.a (mgr.14355) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:45.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:45 smithi131 bash[24745]: cluster 2024-09-13T22:23:43.776365+0000 mgr.a (mgr.14355) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:45.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:45 smithi171 bash[25040]: cluster 2024-09-13T22:23:43.776365+0000 mgr.a (mgr.14355) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:45.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:45 smithi007 bash[22722]: cluster 2024-09-13T22:23:43.776365+0000 mgr.a (mgr.14355) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:23:46.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:46.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:46.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:47.068 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:47.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:47 smithi131 bash[24745]: cluster 2024-09-13T22:23:45.778343+0000 mgr.a (mgr.14355) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:47.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:47 smithi171 bash[25040]: cluster 2024-09-13T22:23:45.778343+0000 mgr.a (mgr.14355) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:47.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:47 smithi007 bash[22722]: cluster 2024-09-13T22:23:45.778343+0000 mgr.a (mgr.14355) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:48.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:48 smithi131 bash[24745]: audit 2024-09-13T22:23:46.666836+0000 mgr.a (mgr.14355) 123 : audit [DBG] from='client.16629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:48.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:48 smithi171 bash[25040]: audit 2024-09-13T22:23:46.666836+0000 mgr.a (mgr.14355) 123 : audit [DBG] from='client.16629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:48.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:48 smithi007 bash[22722]: audit 2024-09-13T22:23:46.666836+0000 mgr.a (mgr.14355) 123 : audit [DBG] from='client.16629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:49.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:49 smithi131 bash[24745]: cluster 2024-09-13T22:23:47.779205+0000 mgr.a (mgr.14355) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:49.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:49 smithi171 bash[25040]: cluster 2024-09-13T22:23:47.779205+0000 mgr.a (mgr.14355) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:49.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:49 smithi007 bash[22722]: cluster 2024-09-13T22:23:47.779205+0000 mgr.a (mgr.14355) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:51.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:51 smithi131 bash[24745]: cluster 2024-09-13T22:23:49.780001+0000 mgr.a (mgr.14355) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:51.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:51 smithi171 bash[25040]: cluster 2024-09-13T22:23:49.780001+0000 mgr.a (mgr.14355) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:51.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:51 smithi007 bash[22722]: cluster 2024-09-13T22:23:49.780001+0000 mgr.a (mgr.14355) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:52.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:52.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:53.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:53 smithi131 bash[24745]: cluster 2024-09-13T22:23:51.782221+0000 mgr.a (mgr.14355) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:53 smithi171 bash[25040]: cluster 2024-09-13T22:23:51.782221+0000 mgr.a (mgr.14355) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:53.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:53 smithi007 bash[22722]: cluster 2024-09-13T22:23:51.782221+0000 mgr.a (mgr.14355) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:54.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:54 smithi171 bash[25040]: audit 2024-09-13T22:23:52.404847+0000 mgr.a (mgr.14355) 127 : audit [DBG] from='client.16707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:54 smithi007 bash[22722]: audit 2024-09-13T22:23:52.404847+0000 mgr.a (mgr.14355) 127 : audit [DBG] from='client.16707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:54.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:54 smithi131 bash[24745]: audit 2024-09-13T22:23:52.404847+0000 mgr.a (mgr.14355) 127 : audit [DBG] from='client.16707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:23:55.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:55 smithi171 bash[25040]: cluster 2024-09-13T22:23:53.783029+0000 mgr.a (mgr.14355) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:55.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:55 smithi007 bash[22722]: cluster 2024-09-13T22:23:53.783029+0000 mgr.a (mgr.14355) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:55.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:55 smithi131 bash[24745]: cluster 2024-09-13T22:23:53.783029+0000 mgr.a (mgr.14355) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:57 smithi007 bash[22722]: cluster 2024-09-13T22:23:55.785211+0000 mgr.a (mgr.14355) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:57.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:57 smithi131 bash[24745]: cluster 2024-09-13T22:23:55.785211+0000 mgr.a (mgr.14355) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:57.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:57 smithi171 bash[25040]: cluster 2024-09-13T22:23:55.785211+0000 mgr.a (mgr.14355) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:23:57.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:23:57.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:23:57.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:23:58.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:23:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:23:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:23:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:23:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:23:59.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:23:59 smithi007 bash[22722]: cluster 2024-09-13T22:23:57.785972+0000 mgr.a (mgr.14355) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:59.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:23:59 smithi131 bash[24745]: cluster 2024-09-13T22:23:57.785972+0000 mgr.a (mgr.14355) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:23:59.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:23:59 smithi171 bash[25040]: cluster 2024-09-13T22:23:57.785972+0000 mgr.a (mgr.14355) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:00 smithi007 bash[22722]: audit 2024-09-13T22:23:58.177612+0000 mgr.a (mgr.14355) 131 : audit [DBG] from='client.16785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:00.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:00 smithi131 bash[24745]: audit 2024-09-13T22:23:58.177612+0000 mgr.a (mgr.14355) 131 : audit [DBG] from='client.16785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:00.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:00 smithi171 bash[25040]: audit 2024-09-13T22:23:58.177612+0000 mgr.a (mgr.14355) 131 : audit [DBG] from='client.16785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:01.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:01 smithi007 bash[22722]: cluster 2024-09-13T22:23:59.786890+0000 mgr.a (mgr.14355) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:01.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:01 smithi131 bash[24745]: cluster 2024-09-13T22:23:59.786890+0000 mgr.a (mgr.14355) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:01.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:01 smithi171 bash[25040]: cluster 2024-09-13T22:23:59.786890+0000 mgr.a (mgr.14355) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:03 smithi007 bash[22722]: cluster 2024-09-13T22:24:01.789199+0000 mgr.a (mgr.14355) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:03.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:03 smithi131 bash[24745]: cluster 2024-09-13T22:24:01.789199+0000 mgr.a (mgr.14355) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:03.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:03 smithi171 bash[25040]: cluster 2024-09-13T22:24:01.789199+0000 mgr.a (mgr.14355) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:04.317 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:04.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:04.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:05.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:05 smithi007 bash[22722]: cluster 2024-09-13T22:24:03.789962+0000 mgr.a (mgr.14355) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:05.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:05 smithi007 bash[22722]: audit 2024-09-13T22:24:03.923296+0000 mgr.a (mgr.14355) 135 : audit [DBG] from='client.16863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:05.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:05 smithi131 bash[24745]: cluster 2024-09-13T22:24:03.789962+0000 mgr.a (mgr.14355) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:05.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:05 smithi131 bash[24745]: audit 2024-09-13T22:24:03.923296+0000 mgr.a (mgr.14355) 135 : audit [DBG] from='client.16863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:05.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:05 smithi171 bash[25040]: cluster 2024-09-13T22:24:03.789962+0000 mgr.a (mgr.14355) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:05.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:05 smithi171 bash[25040]: audit 2024-09-13T22:24:03.923296+0000 mgr.a (mgr.14355) 135 : audit [DBG] from='client.16863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:07.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:07 smithi007 bash[22722]: cluster 2024-09-13T22:24:05.792304+0000 mgr.a (mgr.14355) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:07.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:07 smithi007 bash[22722]: audit 2024-09-13T22:24:06.437788+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:24:07.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:07 smithi131 bash[24745]: cluster 2024-09-13T22:24:05.792304+0000 mgr.a (mgr.14355) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:07.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:07 smithi131 bash[24745]: audit 2024-09-13T22:24:06.437788+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:24:07.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:07 smithi171 bash[25040]: cluster 2024-09-13T22:24:05.792304+0000 mgr.a (mgr.14355) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:07.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:07 smithi171 bash[25040]: audit 2024-09-13T22:24:06.437788+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:24:08.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:24:07 smithi007 bash[22972]: debug 2024-09-13T22:24:07.989+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:24:08.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:24:07 smithi007 bash[22972]: debug 2024-09-13T22:24:07.993+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:24:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:08 smithi007 bash[22722]: audit 2024-09-13T22:24:07.268026+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:24:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:08 smithi007 bash[22722]: audit 2024-09-13T22:24:07.269748+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:24:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:08 smithi007 bash[22722]: audit 2024-09-13T22:24:07.280378+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:24:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:08 smithi007 bash[22722]: audit 2024-09-13T22:24:07.285259+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:08 smithi131 bash[24745]: audit 2024-09-13T22:24:07.268026+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:24:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:08 smithi131 bash[24745]: audit 2024-09-13T22:24:07.269748+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:24:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:08 smithi131 bash[24745]: audit 2024-09-13T22:24:07.280378+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:24:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:08 smithi131 bash[24745]: audit 2024-09-13T22:24:07.285259+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:08.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:08 smithi171 bash[25040]: audit 2024-09-13T22:24:07.268026+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:24:08.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:08 smithi171 bash[25040]: audit 2024-09-13T22:24:07.269748+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:24:08.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:08 smithi171 bash[25040]: audit 2024-09-13T22:24:07.280378+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:24:08.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:08 smithi171 bash[25040]: audit 2024-09-13T22:24:07.285259+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:09.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:09.319 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:09.319 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:09 smithi007 bash[22722]: audit 2024-09-13T22:24:07.287493+0000 mgr.a (mgr.14355) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:09 smithi007 bash[22722]: cluster 2024-09-13T22:24:07.799625+0000 mgr.a (mgr.14355) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:09 smithi007 bash[22722]: audit 2024-09-13T22:24:07.993774+0000 mgr.a (mgr.14355) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:24:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:09 smithi007 bash[22722]: cephadm 2024-09-13T22:24:07.995030+0000 mgr.a (mgr.14355) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:24:09.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:09 smithi131 bash[24745]: audit 2024-09-13T22:24:07.287493+0000 mgr.a (mgr.14355) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:09.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:09 smithi131 bash[24745]: cluster 2024-09-13T22:24:07.799625+0000 mgr.a (mgr.14355) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:09.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:09 smithi131 bash[24745]: audit 2024-09-13T22:24:07.993774+0000 mgr.a (mgr.14355) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:24:09.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:09 smithi131 bash[24745]: cephadm 2024-09-13T22:24:07.995030+0000 mgr.a (mgr.14355) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:24:09.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:09 smithi171 bash[25040]: audit 2024-09-13T22:24:07.287493+0000 mgr.a (mgr.14355) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:24:09.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:09 smithi171 bash[25040]: cluster 2024-09-13T22:24:07.799625+0000 mgr.a (mgr.14355) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:09.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:09 smithi171 bash[25040]: audit 2024-09-13T22:24:07.993774+0000 mgr.a (mgr.14355) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:24:09.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:09 smithi171 bash[25040]: cephadm 2024-09-13T22:24:07.995030+0000 mgr.a (mgr.14355) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:24:10.063 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:11 smithi007 bash[22722]: audit 2024-09-13T22:24:09.646863+0000 mgr.a (mgr.14355) 141 : audit [DBG] from='client.17049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:11 smithi007 bash[22722]: cluster 2024-09-13T22:24:09.800191+0000 mgr.a (mgr.14355) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:11.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:11 smithi131 bash[24745]: audit 2024-09-13T22:24:09.646863+0000 mgr.a (mgr.14355) 141 : audit [DBG] from='client.17049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:11.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:11 smithi131 bash[24745]: cluster 2024-09-13T22:24:09.800191+0000 mgr.a (mgr.14355) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:11.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:11 smithi171 bash[25040]: audit 2024-09-13T22:24:09.646863+0000 mgr.a (mgr.14355) 141 : audit [DBG] from='client.17049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:11.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:11 smithi171 bash[25040]: cluster 2024-09-13T22:24:09.800191+0000 mgr.a (mgr.14355) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:13.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:13 smithi007 bash[22722]: cluster 2024-09-13T22:24:11.802533+0000 mgr.a (mgr.14355) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:13.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:13 smithi131 bash[24745]: cluster 2024-09-13T22:24:11.802533+0000 mgr.a (mgr.14355) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:13 smithi171 bash[25040]: cluster 2024-09-13T22:24:11.802533+0000 mgr.a (mgr.14355) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:15 smithi007 bash[22722]: cluster 2024-09-13T22:24:13.803353+0000 mgr.a (mgr.14355) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:15.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:15 smithi131 bash[24745]: cluster 2024-09-13T22:24:13.803353+0000 mgr.a (mgr.14355) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:15.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:15 smithi171 bash[25040]: cluster 2024-09-13T22:24:13.803353+0000 mgr.a (mgr.14355) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:15.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:17 smithi007 bash[22722]: audit 2024-09-13T22:24:15.405012+0000 mgr.a (mgr.14355) 145 : audit [DBG] from='client.17127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:17 smithi007 bash[22722]: cluster 2024-09-13T22:24:15.804810+0000 mgr.a (mgr.14355) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:17.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:17 smithi131 bash[24745]: audit 2024-09-13T22:24:15.405012+0000 mgr.a (mgr.14355) 145 : audit [DBG] from='client.17127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:17.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:17 smithi131 bash[24745]: cluster 2024-09-13T22:24:15.804810+0000 mgr.a (mgr.14355) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:17.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:17 smithi171 bash[25040]: audit 2024-09-13T22:24:15.405012+0000 mgr.a (mgr.14355) 145 : audit [DBG] from='client.17127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:17.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:17 smithi171 bash[25040]: cluster 2024-09-13T22:24:15.804810+0000 mgr.a (mgr.14355) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:19.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:19 smithi007 bash[22722]: cluster 2024-09-13T22:24:17.805531+0000 mgr.a (mgr.14355) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:19.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:19 smithi131 bash[24745]: cluster 2024-09-13T22:24:17.805531+0000 mgr.a (mgr.14355) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:19.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:19 smithi171 bash[25040]: cluster 2024-09-13T22:24:17.805531+0000 mgr.a (mgr.14355) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:20.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:20.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:21 smithi007 bash[22722]: cluster 2024-09-13T22:24:19.806289+0000 mgr.a (mgr.14355) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:21.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:21 smithi131 bash[24745]: cluster 2024-09-13T22:24:19.806289+0000 mgr.a (mgr.14355) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:21.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:21 smithi171 bash[25040]: cluster 2024-09-13T22:24:19.806289+0000 mgr.a (mgr.14355) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:24:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:21.584 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:22 smithi007 bash[22722]: audit 2024-09-13T22:24:21.172697+0000 mgr.a (mgr.14355) 149 : audit [DBG] from='client.17205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:22 smithi007 bash[22722]: cluster 2024-09-13T22:24:21.808979+0000 mgr.a (mgr.14355) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:22.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:22 smithi131 bash[24745]: audit 2024-09-13T22:24:21.172697+0000 mgr.a (mgr.14355) 149 : audit [DBG] from='client.17205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:22.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:22 smithi131 bash[24745]: cluster 2024-09-13T22:24:21.808979+0000 mgr.a (mgr.14355) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:22.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:22 smithi171 bash[25040]: audit 2024-09-13T22:24:21.172697+0000 mgr.a (mgr.14355) 149 : audit [DBG] from='client.17205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:22.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:22 smithi171 bash[25040]: cluster 2024-09-13T22:24:21.808979+0000 mgr.a (mgr.14355) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:24:25.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:24 smithi007 bash[22722]: cluster 2024-09-13T22:24:23.809922+0000 mgr.a (mgr.14355) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:25.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:24 smithi131 bash[24745]: cluster 2024-09-13T22:24:23.809922+0000 mgr.a (mgr.14355) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:25.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:24 smithi171 bash[25040]: cluster 2024-09-13T22:24:23.809922+0000 mgr.a (mgr.14355) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:26.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:26.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:27.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:26 smithi007 bash[22722]: cluster 2024-09-13T22:24:25.811928+0000 mgr.a (mgr.14355) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:27.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:26 smithi131 bash[24745]: cluster 2024-09-13T22:24:25.811928+0000 mgr.a (mgr.14355) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:27.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:26 smithi171 bash[25040]: cluster 2024-09-13T22:24:25.811928+0000 mgr.a (mgr.14355) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:27.350 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:27.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:28.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:27 smithi007 bash[22722]: audit 2024-09-13T22:24:26.921283+0000 mgr.a (mgr.14355) 153 : audit [DBG] from='client.17280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:28.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:27 smithi131 bash[24745]: audit 2024-09-13T22:24:26.921283+0000 mgr.a (mgr.14355) 153 : audit [DBG] from='client.17280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:28.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:27 smithi171 bash[25040]: audit 2024-09-13T22:24:26.921283+0000 mgr.a (mgr.14355) 153 : audit [DBG] from='client.17280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:29.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:28 smithi007 bash[22722]: cluster 2024-09-13T22:24:27.812849+0000 mgr.a (mgr.14355) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:29.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:28 smithi131 bash[24745]: cluster 2024-09-13T22:24:27.812849+0000 mgr.a (mgr.14355) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:29.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:28 smithi171 bash[25040]: cluster 2024-09-13T22:24:27.812849+0000 mgr.a (mgr.14355) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:31.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:30 smithi007 bash[22722]: cluster 2024-09-13T22:24:29.813660+0000 mgr.a (mgr.14355) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:31.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:30 smithi131 bash[24745]: cluster 2024-09-13T22:24:29.813660+0000 mgr.a (mgr.14355) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:31.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:30 smithi171 bash[25040]: cluster 2024-09-13T22:24:29.813660+0000 mgr.a (mgr.14355) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:32.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:33.122 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:33.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:33.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:32 smithi007 bash[22722]: cluster 2024-09-13T22:24:31.815890+0000 mgr.a (mgr.14355) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:33.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:32 smithi131 bash[24745]: cluster 2024-09-13T22:24:31.815890+0000 mgr.a (mgr.14355) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:33.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:32 smithi171 bash[25040]: cluster 2024-09-13T22:24:31.815890+0000 mgr.a (mgr.14355) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:34.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:33 smithi007 bash[22722]: audit 2024-09-13T22:24:32.694414+0000 mgr.a (mgr.14355) 157 : audit [DBG] from='client.17355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:34.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:33 smithi131 bash[24745]: audit 2024-09-13T22:24:32.694414+0000 mgr.a (mgr.14355) 157 : audit [DBG] from='client.17355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:34.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:33 smithi171 bash[25040]: audit 2024-09-13T22:24:32.694414+0000 mgr.a (mgr.14355) 157 : audit [DBG] from='client.17355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:35.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:34 smithi007 bash[22722]: cluster 2024-09-13T22:24:33.816828+0000 mgr.a (mgr.14355) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:35.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:34 smithi131 bash[24745]: cluster 2024-09-13T22:24:33.816828+0000 mgr.a (mgr.14355) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:35.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:34 smithi171 bash[25040]: cluster 2024-09-13T22:24:33.816828+0000 mgr.a (mgr.14355) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:37.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:36 smithi007 bash[22722]: cluster 2024-09-13T22:24:35.819014+0000 mgr.a (mgr.14355) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:37.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:36 smithi131 bash[24745]: cluster 2024-09-13T22:24:35.819014+0000 mgr.a (mgr.14355) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:37.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:36 smithi171 bash[25040]: cluster 2024-09-13T22:24:35.819014+0000 mgr.a (mgr.14355) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:38.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:38.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:38.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:38.862 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:38.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:38.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:39.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:38 smithi007 bash[22722]: cluster 2024-09-13T22:24:37.819772+0000 mgr.a (mgr.14355) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:39.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:38 smithi131 bash[24745]: cluster 2024-09-13T22:24:37.819772+0000 mgr.a (mgr.14355) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:39.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:38 smithi171 bash[25040]: cluster 2024-09-13T22:24:37.819772+0000 mgr.a (mgr.14355) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:40.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:39 smithi007 bash[22722]: audit 2024-09-13T22:24:38.455633+0000 mgr.a (mgr.14355) 161 : audit [DBG] from='client.17433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:40.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:39 smithi131 bash[24745]: audit 2024-09-13T22:24:38.455633+0000 mgr.a (mgr.14355) 161 : audit [DBG] from='client.17433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:40.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:39 smithi171 bash[25040]: audit 2024-09-13T22:24:38.455633+0000 mgr.a (mgr.14355) 161 : audit [DBG] from='client.17433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:41.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:40 smithi007 bash[22722]: cluster 2024-09-13T22:24:39.820697+0000 mgr.a (mgr.14355) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:41.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:40 smithi131 bash[24745]: cluster 2024-09-13T22:24:39.820697+0000 mgr.a (mgr.14355) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:41.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:40 smithi171 bash[25040]: cluster 2024-09-13T22:24:39.820697+0000 mgr.a (mgr.14355) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:43.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:42 smithi007 bash[22722]: cluster 2024-09-13T22:24:41.822986+0000 mgr.a (mgr.14355) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:43.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:42 smithi131 bash[24745]: cluster 2024-09-13T22:24:41.822986+0000 mgr.a (mgr.14355) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:43.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:42 smithi171 bash[25040]: cluster 2024-09-13T22:24:41.822986+0000 mgr.a (mgr.14355) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:43.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:44.609 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:44.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:44.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:44.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:44.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:45.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:44 smithi007 bash[22722]: cluster 2024-09-13T22:24:43.823714+0000 mgr.a (mgr.14355) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:45.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:44 smithi131 bash[24745]: cluster 2024-09-13T22:24:43.823714+0000 mgr.a (mgr.14355) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:45.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:44 smithi171 bash[25040]: cluster 2024-09-13T22:24:43.823714+0000 mgr.a (mgr.14355) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:46.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:45 smithi007 bash[22722]: audit 2024-09-13T22:24:44.201730+0000 mgr.a (mgr.14355) 165 : audit [DBG] from='client.17505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:46.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:45 smithi131 bash[24745]: audit 2024-09-13T22:24:44.201730+0000 mgr.a (mgr.14355) 165 : audit [DBG] from='client.17505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:46.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:45 smithi171 bash[25040]: audit 2024-09-13T22:24:44.201730+0000 mgr.a (mgr.14355) 165 : audit [DBG] from='client.17505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:47.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:46 smithi007 bash[22722]: cluster 2024-09-13T22:24:45.826070+0000 mgr.a (mgr.14355) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:47.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:46 smithi131 bash[24745]: cluster 2024-09-13T22:24:45.826070+0000 mgr.a (mgr.14355) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:47.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:46 smithi171 bash[25040]: cluster 2024-09-13T22:24:45.826070+0000 mgr.a (mgr.14355) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:24:49.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:48 smithi007 bash[22722]: cluster 2024-09-13T22:24:47.826992+0000 mgr.a (mgr.14355) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:49.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:48 smithi131 bash[24745]: cluster 2024-09-13T22:24:47.826992+0000 mgr.a (mgr.14355) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:49.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:48 smithi171 bash[25040]: cluster 2024-09-13T22:24:47.826992+0000 mgr.a (mgr.14355) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:49.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:49.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:50.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:51.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:50 smithi007 bash[22722]: cluster 2024-09-13T22:24:49.827891+0000 mgr.a (mgr.14355) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:51.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:50 smithi007 bash[22722]: audit 2024-09-13T22:24:49.948644+0000 mgr.a (mgr.14355) 169 : audit [DBG] from='client.17583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:51.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:50 smithi131 bash[24745]: cluster 2024-09-13T22:24:49.827891+0000 mgr.a (mgr.14355) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:51.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:50 smithi131 bash[24745]: audit 2024-09-13T22:24:49.948644+0000 mgr.a (mgr.14355) 169 : audit [DBG] from='client.17583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:51.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:50 smithi171 bash[25040]: cluster 2024-09-13T22:24:49.827891+0000 mgr.a (mgr.14355) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:51.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:50 smithi171 bash[25040]: audit 2024-09-13T22:24:49.948644+0000 mgr.a (mgr.14355) 169 : audit [DBG] from='client.17583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:53.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:52 smithi007 bash[22722]: cluster 2024-09-13T22:24:51.830701+0000 mgr.a (mgr.14355) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:53.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:52 smithi131 bash[24745]: cluster 2024-09-13T22:24:51.830701+0000 mgr.a (mgr.14355) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:53.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:52 smithi171 bash[25040]: cluster 2024-09-13T22:24:51.830701+0000 mgr.a (mgr.14355) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:55.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:54 smithi131 bash[24745]: cluster 2024-09-13T22:24:53.831454+0000 mgr.a (mgr.14355) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:55.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:54 smithi171 bash[25040]: cluster 2024-09-13T22:24:53.831454+0000 mgr.a (mgr.14355) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:55.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:24:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:24:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:24:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:54 smithi007 bash[22722]: cluster 2024-09-13T22:24:53.831454+0000 mgr.a (mgr.14355) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:56.136 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:24:56.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:24:56.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:24:56.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:24:56.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:24:57.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:56 smithi131 bash[24745]: audit 2024-09-13T22:24:55.705563+0000 mgr.a (mgr.14355) 172 : audit [DBG] from='client.17661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:57.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:56 smithi131 bash[24745]: cluster 2024-09-13T22:24:55.832703+0000 mgr.a (mgr.14355) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:57.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:56 smithi171 bash[25040]: audit 2024-09-13T22:24:55.705563+0000 mgr.a (mgr.14355) 172 : audit [DBG] from='client.17661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:57.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:56 smithi171 bash[25040]: cluster 2024-09-13T22:24:55.832703+0000 mgr.a (mgr.14355) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:56 smithi007 bash[22722]: audit 2024-09-13T22:24:55.705563+0000 mgr.a (mgr.14355) 172 : audit [DBG] from='client.17661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:24:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:56 smithi007 bash[22722]: cluster 2024-09-13T22:24:55.832703+0000 mgr.a (mgr.14355) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:24:59.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:24:58 smithi131 bash[24745]: cluster 2024-09-13T22:24:57.833560+0000 mgr.a (mgr.14355) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:59.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:24:58 smithi171 bash[25040]: cluster 2024-09-13T22:24:57.833560+0000 mgr.a (mgr.14355) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:24:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:24:58 smithi007 bash[22722]: cluster 2024-09-13T22:24:57.833560+0000 mgr.a (mgr.14355) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:01.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:01.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:01.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:00 smithi131 bash[24745]: cluster 2024-09-13T22:24:59.834386+0000 mgr.a (mgr.14355) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:01.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:00 smithi171 bash[25040]: cluster 2024-09-13T22:24:59.834386+0000 mgr.a (mgr.14355) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:00 smithi007 bash[22722]: cluster 2024-09-13T22:24:59.834386+0000 mgr.a (mgr.14355) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:01.906 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:01.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:01.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:01.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:01.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:03.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:02 smithi131 bash[24745]: audit 2024-09-13T22:25:01.476775+0000 mgr.a (mgr.14355) 176 : audit [DBG] from='client.17739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:03.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:02 smithi131 bash[24745]: cluster 2024-09-13T22:25:01.835685+0000 mgr.a (mgr.14355) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:03.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:02 smithi171 bash[25040]: audit 2024-09-13T22:25:01.476775+0000 mgr.a (mgr.14355) 176 : audit [DBG] from='client.17739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:03.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:02 smithi171 bash[25040]: cluster 2024-09-13T22:25:01.835685+0000 mgr.a (mgr.14355) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:02 smithi007 bash[22722]: audit 2024-09-13T22:25:01.476775+0000 mgr.a (mgr.14355) 176 : audit [DBG] from='client.17739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:02 smithi007 bash[22722]: cluster 2024-09-13T22:25:01.835685+0000 mgr.a (mgr.14355) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:05.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:04 smithi131 bash[24745]: cluster 2024-09-13T22:25:03.836415+0000 mgr.a (mgr.14355) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:05.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:04 smithi171 bash[25040]: cluster 2024-09-13T22:25:03.836415+0000 mgr.a (mgr.14355) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:04 smithi007 bash[22722]: cluster 2024-09-13T22:25:03.836415+0000 mgr.a (mgr.14355) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:07.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:06 smithi131 bash[24745]: cluster 2024-09-13T22:25:05.838357+0000 mgr.a (mgr.14355) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:07.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:06 smithi171 bash[25040]: cluster 2024-09-13T22:25:05.838357+0000 mgr.a (mgr.14355) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:06 smithi007 bash[22722]: cluster 2024-09-13T22:25:05.838357+0000 mgr.a (mgr.14355) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:07.669 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:07.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:09.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:07.248109+0000 mgr.a (mgr.14355) 180 : audit [DBG] from='client.17811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: cluster 2024-09-13T22:25:07.839265+0000 mgr.a (mgr.14355) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:08.045809+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:08.877756+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:08.879593+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:08.890089+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:25:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:08 smithi131 bash[24745]: audit 2024-09-13T22:25:08.894909+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:09.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:07.248109+0000 mgr.a (mgr.14355) 180 : audit [DBG] from='client.17811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:09.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: cluster 2024-09-13T22:25:07.839265+0000 mgr.a (mgr.14355) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:09.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:08.045809+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:25:09.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:08.877756+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:25:09.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:08.879593+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:25:09.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:08.890089+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:25:09.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:08 smithi171 bash[25040]: audit 2024-09-13T22:25:08.894909+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:07.248109+0000 mgr.a (mgr.14355) 180 : audit [DBG] from='client.17811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: cluster 2024-09-13T22:25:07.839265+0000 mgr.a (mgr.14355) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:08.045809+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:25:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:08.877756+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:25:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:08.879593+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:25:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:08.890089+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:25:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:08 smithi007 bash[22722]: audit 2024-09-13T22:25:08.894909+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:09.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:25:09 smithi007 bash[22972]: debug 2024-09-13T22:25:09.604+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:25:09.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:25:09 smithi007 bash[22972]: debug 2024-09-13T22:25:09.604+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:25:10.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:09 smithi131 bash[24745]: audit 2024-09-13T22:25:08.897253+0000 mgr.a (mgr.14355) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:10.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:09 smithi171 bash[25040]: audit 2024-09-13T22:25:08.897253+0000 mgr.a (mgr.14355) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:09 smithi007 bash[22722]: audit 2024-09-13T22:25:08.897253+0000 mgr.a (mgr.14355) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:25:11.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:10 smithi131 bash[24745]: audit 2024-09-13T22:25:09.606708+0000 mgr.a (mgr.14355) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:25:11.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:10 smithi131 bash[24745]: cephadm 2024-09-13T22:25:09.608305+0000 mgr.a (mgr.14355) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:25:11.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:10 smithi131 bash[24745]: cluster 2024-09-13T22:25:09.840194+0000 mgr.a (mgr.14355) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:10 smithi171 bash[25040]: audit 2024-09-13T22:25:09.606708+0000 mgr.a (mgr.14355) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:25:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:10 smithi171 bash[25040]: cephadm 2024-09-13T22:25:09.608305+0000 mgr.a (mgr.14355) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:25:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:10 smithi171 bash[25040]: cluster 2024-09-13T22:25:09.840194+0000 mgr.a (mgr.14355) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:10 smithi007 bash[22722]: audit 2024-09-13T22:25:09.606708+0000 mgr.a (mgr.14355) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:25:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:10 smithi007 bash[22722]: cephadm 2024-09-13T22:25:09.608305+0000 mgr.a (mgr.14355) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:25:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:10 smithi007 bash[22722]: cluster 2024-09-13T22:25:09.840194+0000 mgr.a (mgr.14355) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:12.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:12.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:13.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:13 smithi131 bash[24745]: cluster 2024-09-13T22:25:11.842509+0000 mgr.a (mgr.14355) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:13.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:13 smithi171 bash[25040]: cluster 2024-09-13T22:25:11.842509+0000 mgr.a (mgr.14355) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:13.438 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:13.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:13.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:13.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:13 smithi007 bash[22722]: cluster 2024-09-13T22:25:11.842509+0000 mgr.a (mgr.14355) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:14.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:14 smithi131 bash[24745]: audit 2024-09-13T22:25:13.007447+0000 mgr.a (mgr.14355) 187 : audit [DBG] from='client.17994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:14.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:14 smithi171 bash[25040]: audit 2024-09-13T22:25:13.007447+0000 mgr.a (mgr.14355) 187 : audit [DBG] from='client.17994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:14 smithi007 bash[22722]: audit 2024-09-13T22:25:13.007447+0000 mgr.a (mgr.14355) 187 : audit [DBG] from='client.17994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:15.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:15 smithi131 bash[24745]: cluster 2024-09-13T22:25:13.843579+0000 mgr.a (mgr.14355) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:15.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:15 smithi171 bash[25040]: cluster 2024-09-13T22:25:13.843579+0000 mgr.a (mgr.14355) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:15 smithi007 bash[22722]: cluster 2024-09-13T22:25:13.843579+0000 mgr.a (mgr.14355) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:17.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:17 smithi131 bash[24745]: cluster 2024-09-13T22:25:15.845813+0000 mgr.a (mgr.14355) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:17.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:17 smithi171 bash[25040]: cluster 2024-09-13T22:25:15.845813+0000 mgr.a (mgr.14355) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:17 smithi007 bash[22722]: cluster 2024-09-13T22:25:15.845813+0000 mgr.a (mgr.14355) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:18.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:19.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:19.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:19 smithi131 bash[24745]: cluster 2024-09-13T22:25:17.846597+0000 mgr.a (mgr.14355) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:19.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:19 smithi171 bash[25040]: cluster 2024-09-13T22:25:17.846597+0000 mgr.a (mgr.14355) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:19.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:19 smithi007 bash[22722]: cluster 2024-09-13T22:25:17.846597+0000 mgr.a (mgr.14355) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:20.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:20 smithi131 bash[24745]: audit 2024-09-13T22:25:18.778531+0000 mgr.a (mgr.14355) 191 : audit [DBG] from='client.18072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:20.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:20 smithi171 bash[25040]: audit 2024-09-13T22:25:18.778531+0000 mgr.a (mgr.14355) 191 : audit [DBG] from='client.18072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:20.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:20 smithi007 bash[22722]: audit 2024-09-13T22:25:18.778531+0000 mgr.a (mgr.14355) 191 : audit [DBG] from='client.18072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:21.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:21 smithi171 bash[25040]: cluster 2024-09-13T22:25:19.847530+0000 mgr.a (mgr.14355) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:21 smithi007 bash[22722]: cluster 2024-09-13T22:25:19.847530+0000 mgr.a (mgr.14355) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:21 smithi131 bash[24745]: cluster 2024-09-13T22:25:19.847530+0000 mgr.a (mgr.14355) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:23.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:23 smithi171 bash[25040]: cluster 2024-09-13T22:25:21.849792+0000 mgr.a (mgr.14355) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:23 smithi007 bash[22722]: cluster 2024-09-13T22:25:21.849792+0000 mgr.a (mgr.14355) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:23 smithi131 bash[24745]: cluster 2024-09-13T22:25:21.849792+0000 mgr.a (mgr.14355) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:25:24.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:24.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:24.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:24.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:24.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:25 smithi007 bash[22722]: cluster 2024-09-13T22:25:23.850569+0000 mgr.a (mgr.14355) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:25 smithi131 bash[24745]: cluster 2024-09-13T22:25:23.850569+0000 mgr.a (mgr.14355) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:25.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:25 smithi171 bash[25040]: cluster 2024-09-13T22:25:23.850569+0000 mgr.a (mgr.14355) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:26.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:26 smithi007 bash[22722]: audit 2024-09-13T22:25:24.543370+0000 mgr.a (mgr.14355) 195 : audit [DBG] from='client.18150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:26.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:26 smithi131 bash[24745]: audit 2024-09-13T22:25:24.543370+0000 mgr.a (mgr.14355) 195 : audit [DBG] from='client.18150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:26.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:26 smithi171 bash[25040]: audit 2024-09-13T22:25:24.543370+0000 mgr.a (mgr.14355) 195 : audit [DBG] from='client.18150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:27 smithi007 bash[22722]: cluster 2024-09-13T22:25:25.852907+0000 mgr.a (mgr.14355) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:27 smithi131 bash[24745]: cluster 2024-09-13T22:25:25.852907+0000 mgr.a (mgr.14355) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:27.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:27 smithi171 bash[25040]: cluster 2024-09-13T22:25:25.852907+0000 mgr.a (mgr.14355) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:29 smithi007 bash[22722]: cluster 2024-09-13T22:25:27.853688+0000 mgr.a (mgr.14355) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:29 smithi131 bash[24745]: cluster 2024-09-13T22:25:27.853688+0000 mgr.a (mgr.14355) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:29.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:29 smithi171 bash[25040]: cluster 2024-09-13T22:25:27.853688+0000 mgr.a (mgr.14355) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:29.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:29.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:30.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:31 smithi007 bash[22722]: cluster 2024-09-13T22:25:29.854491+0000 mgr.a (mgr.14355) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:31.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:31 smithi131 bash[24745]: cluster 2024-09-13T22:25:29.854491+0000 mgr.a (mgr.14355) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:31.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:31 smithi171 bash[25040]: cluster 2024-09-13T22:25:29.854491+0000 mgr.a (mgr.14355) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:32.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:32 smithi007 bash[22722]: audit 2024-09-13T22:25:30.314799+0000 mgr.a (mgr.14355) 199 : audit [DBG] from='client.18222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:32.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:32 smithi131 bash[24745]: audit 2024-09-13T22:25:30.314799+0000 mgr.a (mgr.14355) 199 : audit [DBG] from='client.18222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:32.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:32 smithi171 bash[25040]: audit 2024-09-13T22:25:30.314799+0000 mgr.a (mgr.14355) 199 : audit [DBG] from='client.18222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:33 smithi007 bash[22722]: cluster 2024-09-13T22:25:31.857202+0000 mgr.a (mgr.14355) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:33 smithi131 bash[24745]: cluster 2024-09-13T22:25:31.857202+0000 mgr.a (mgr.14355) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:33.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:33 smithi171 bash[25040]: cluster 2024-09-13T22:25:31.857202+0000 mgr.a (mgr.14355) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:35 smithi007 bash[22722]: cluster 2024-09-13T22:25:33.857979+0000 mgr.a (mgr.14355) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:35 smithi131 bash[24745]: cluster 2024-09-13T22:25:33.857979+0000 mgr.a (mgr.14355) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:35.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:35 smithi171 bash[25040]: cluster 2024-09-13T22:25:33.857979+0000 mgr.a (mgr.14355) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:35.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:35.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:35.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:36.511 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:37 smithi007 bash[22722]: cluster 2024-09-13T22:25:35.859184+0000 mgr.a (mgr.14355) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:37 smithi007 bash[22722]: audit 2024-09-13T22:25:36.071590+0000 mgr.a (mgr.14355) 203 : audit [DBG] from='client.18300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:37 smithi131 bash[24745]: cluster 2024-09-13T22:25:35.859184+0000 mgr.a (mgr.14355) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:37 smithi131 bash[24745]: audit 2024-09-13T22:25:36.071590+0000 mgr.a (mgr.14355) 203 : audit [DBG] from='client.18300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:37.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:37 smithi171 bash[25040]: cluster 2024-09-13T22:25:35.859184+0000 mgr.a (mgr.14355) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:37.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:37 smithi171 bash[25040]: audit 2024-09-13T22:25:36.071590+0000 mgr.a (mgr.14355) 203 : audit [DBG] from='client.18300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:39 smithi007 bash[22722]: cluster 2024-09-13T22:25:37.860156+0000 mgr.a (mgr.14355) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:39 smithi131 bash[24745]: cluster 2024-09-13T22:25:37.860156+0000 mgr.a (mgr.14355) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:39.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:39 smithi171 bash[25040]: cluster 2024-09-13T22:25:37.860156+0000 mgr.a (mgr.14355) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:25:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:41 smithi007 bash[22722]: cluster 2024-09-13T22:25:39.860993+0000 mgr.a (mgr.14355) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:41.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:41 smithi131 bash[24745]: cluster 2024-09-13T22:25:39.860993+0000 mgr.a (mgr.14355) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:41.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:41 smithi171 bash[25040]: cluster 2024-09-13T22:25:39.860993+0000 mgr.a (mgr.14355) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:25:42.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:43 smithi007 bash[22722]: audit 2024-09-13T22:25:41.849544+0000 mgr.a (mgr.14355) 206 : audit [DBG] from='client.18375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:43 smithi007 bash[22722]: cluster 2024-09-13T22:25:41.867649+0000 mgr.a (mgr.14355) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:43 smithi131 bash[24745]: audit 2024-09-13T22:25:41.849544+0000 mgr.a (mgr.14355) 206 : audit [DBG] from='client.18375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:43 smithi131 bash[24745]: cluster 2024-09-13T22:25:41.867649+0000 mgr.a (mgr.14355) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:43.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:43 smithi171 bash[25040]: audit 2024-09-13T22:25:41.849544+0000 mgr.a (mgr.14355) 206 : audit [DBG] from='client.18375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:43.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:43 smithi171 bash[25040]: cluster 2024-09-13T22:25:41.867649+0000 mgr.a (mgr.14355) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:45 smithi007 bash[22722]: cluster 2024-09-13T22:25:43.868521+0000 mgr.a (mgr.14355) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:45 smithi131 bash[24745]: cluster 2024-09-13T22:25:43.868521+0000 mgr.a (mgr.14355) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:45.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:45 smithi171 bash[25040]: cluster 2024-09-13T22:25:43.868521+0000 mgr.a (mgr.14355) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:47 smithi007 bash[22722]: cluster 2024-09-13T22:25:45.870720+0000 mgr.a (mgr.14355) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:47 smithi131 bash[24745]: cluster 2024-09-13T22:25:45.870720+0000 mgr.a (mgr.14355) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:47.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:47 smithi171 bash[25040]: cluster 2024-09-13T22:25:45.870720+0000 mgr.a (mgr.14355) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:47.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:47.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:47.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:47.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:49 smithi007 bash[22722]: audit 2024-09-13T22:25:47.593844+0000 mgr.a (mgr.14355) 210 : audit [DBG] from='client.18450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:49 smithi007 bash[22722]: cluster 2024-09-13T22:25:47.871289+0000 mgr.a (mgr.14355) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:49 smithi131 bash[24745]: audit 2024-09-13T22:25:47.593844+0000 mgr.a (mgr.14355) 210 : audit [DBG] from='client.18450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:49 smithi131 bash[24745]: cluster 2024-09-13T22:25:47.871289+0000 mgr.a (mgr.14355) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:49.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:49 smithi171 bash[25040]: audit 2024-09-13T22:25:47.593844+0000 mgr.a (mgr.14355) 210 : audit [DBG] from='client.18450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:49.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:49 smithi171 bash[25040]: cluster 2024-09-13T22:25:47.871289+0000 mgr.a (mgr.14355) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:51 smithi007 bash[22722]: cluster 2024-09-13T22:25:49.872108+0000 mgr.a (mgr.14355) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:51 smithi131 bash[24745]: cluster 2024-09-13T22:25:49.872108+0000 mgr.a (mgr.14355) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:51.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:51 smithi171 bash[25040]: cluster 2024-09-13T22:25:49.872108+0000 mgr.a (mgr.14355) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:52.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:52.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:52.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:53 smithi007 bash[22722]: cluster 2024-09-13T22:25:51.874343+0000 mgr.a (mgr.14355) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:53 smithi131 bash[24745]: cluster 2024-09-13T22:25:51.874343+0000 mgr.a (mgr.14355) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:53.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:53 smithi171 bash[25040]: cluster 2024-09-13T22:25:51.874343+0000 mgr.a (mgr.14355) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:53.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:55 smithi007 bash[22722]: audit 2024-09-13T22:25:53.334783+0000 mgr.a (mgr.14355) 214 : audit [DBG] from='client.18528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:55 smithi007 bash[22722]: cluster 2024-09-13T22:25:53.875242+0000 mgr.a (mgr.14355) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:55 smithi131 bash[24745]: audit 2024-09-13T22:25:53.334783+0000 mgr.a (mgr.14355) 214 : audit [DBG] from='client.18528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:55 smithi131 bash[24745]: cluster 2024-09-13T22:25:53.875242+0000 mgr.a (mgr.14355) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:55.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:55 smithi171 bash[25040]: audit 2024-09-13T22:25:53.334783+0000 mgr.a (mgr.14355) 214 : audit [DBG] from='client.18528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:55.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:55 smithi171 bash[25040]: cluster 2024-09-13T22:25:53.875242+0000 mgr.a (mgr.14355) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:57 smithi007 bash[22722]: cluster 2024-09-13T22:25:55.877425+0000 mgr.a (mgr.14355) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:57 smithi131 bash[24745]: cluster 2024-09-13T22:25:55.877425+0000 mgr.a (mgr.14355) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:57.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:57 smithi171 bash[25040]: cluster 2024-09-13T22:25:55.877425+0000 mgr.a (mgr.14355) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:25:58.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:58 smithi007 bash[22722]: cluster 2024-09-13T22:25:57.878237+0000 mgr.a (mgr.14355) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:58.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:58 smithi131 bash[24745]: cluster 2024-09-13T22:25:57.878237+0000 mgr.a (mgr.14355) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:58.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:58 smithi171 bash[25040]: cluster 2024-09-13T22:25:57.878237+0000 mgr.a (mgr.14355) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:25:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:25:58.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:25:58.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:25:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:25:59 smithi007 bash[22722]: audit 2024-09-13T22:25:59.112176+0000 mgr.a (mgr.14355) 218 : audit [DBG] from='client.18603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:59.513 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:25:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:25:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:25:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:25:59.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:25:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:25:59 smithi131 bash[24745]: audit 2024-09-13T22:25:59.112176+0000 mgr.a (mgr.14355) 218 : audit [DBG] from='client.18603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:25:59.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:25:59 smithi171 bash[25040]: audit 2024-09-13T22:25:59.112176+0000 mgr.a (mgr.14355) 218 : audit [DBG] from='client.18603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:00 smithi007 bash[22722]: cluster 2024-09-13T22:25:59.879196+0000 mgr.a (mgr.14355) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:00 smithi131 bash[24745]: cluster 2024-09-13T22:25:59.879196+0000 mgr.a (mgr.14355) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:00 smithi171 bash[25040]: cluster 2024-09-13T22:25:59.879196+0000 mgr.a (mgr.14355) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:03.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:02 smithi007 bash[22722]: cluster 2024-09-13T22:26:01.881407+0000 mgr.a (mgr.14355) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:03.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:02 smithi131 bash[24745]: cluster 2024-09-13T22:26:01.881407+0000 mgr.a (mgr.14355) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:03.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:02 smithi171 bash[25040]: cluster 2024-09-13T22:26:01.881407+0000 mgr.a (mgr.14355) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:04.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:04.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:04.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:05.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:04 smithi007 bash[22722]: cluster 2024-09-13T22:26:03.882171+0000 mgr.a (mgr.14355) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:05.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:04 smithi131 bash[24745]: cluster 2024-09-13T22:26:03.882171+0000 mgr.a (mgr.14355) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:05.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:04 smithi171 bash[25040]: cluster 2024-09-13T22:26:03.882171+0000 mgr.a (mgr.14355) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:05.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:06.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:05 smithi007 bash[22722]: audit 2024-09-13T22:26:04.859779+0000 mgr.a (mgr.14355) 222 : audit [DBG] from='client.18681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:06.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:05 smithi131 bash[24745]: audit 2024-09-13T22:26:04.859779+0000 mgr.a (mgr.14355) 222 : audit [DBG] from='client.18681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:06.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:05 smithi171 bash[25040]: audit 2024-09-13T22:26:04.859779+0000 mgr.a (mgr.14355) 222 : audit [DBG] from='client.18681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:07.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:06 smithi131 bash[24745]: cluster 2024-09-13T22:26:05.884953+0000 mgr.a (mgr.14355) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:26:07.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:06 smithi171 bash[25040]: cluster 2024-09-13T22:26:05.884953+0000 mgr.a (mgr.14355) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:26:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:06 smithi007 bash[22722]: cluster 2024-09-13T22:26:05.884953+0000 mgr.a (mgr.14355) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:26:09.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:08 smithi131 bash[24745]: cluster 2024-09-13T22:26:07.885757+0000 mgr.a (mgr.14355) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:09.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:08 smithi171 bash[25040]: cluster 2024-09-13T22:26:07.885757+0000 mgr.a (mgr.14355) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:08 smithi007 bash[22722]: cluster 2024-09-13T22:26:07.885757+0000 mgr.a (mgr.14355) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:10.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:09 smithi131 bash[24745]: audit 2024-09-13T22:26:09.663373+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:26:10.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:09 smithi171 bash[25040]: audit 2024-09-13T22:26:09.663373+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:26:10.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:10.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:10.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:09 smithi007 bash[22722]: audit 2024-09-13T22:26:09.663373+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:26:11.070 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:11.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:11.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:11.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:11.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:11.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:10 smithi131 bash[24745]: cluster 2024-09-13T22:26:09.886508+0000 mgr.a (mgr.14355) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:11.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:10 smithi131 bash[24745]: audit 2024-09-13T22:26:10.287982+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:11.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:10 smithi131 bash[24745]: audit 2024-09-13T22:26:10.291402+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:11.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:10 smithi171 bash[25040]: cluster 2024-09-13T22:26:09.886508+0000 mgr.a (mgr.14355) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:10 smithi171 bash[25040]: audit 2024-09-13T22:26:10.287982+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:10 smithi171 bash[25040]: audit 2024-09-13T22:26:10.291402+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:10 smithi007 bash[22722]: cluster 2024-09-13T22:26:09.886508+0000 mgr.a (mgr.14355) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:26:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:10 smithi007 bash[22722]: audit 2024-09-13T22:26:10.287982+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:10 smithi007 bash[22722]: audit 2024-09-13T22:26:10.291402+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:12.201 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22972]: debug 2024-09-13T22:26:11.751+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22972]: debug 2024-09-13T22:26:11.751+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:10.650153+0000 mgr.a (mgr.14355) 226 : audit [DBG] from='client.18759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:11.071302+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:11.072121+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:11.077400+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:11.079417+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:11 smithi007 bash[22722]: audit 2024-09-13T22:26:11.080383+0000 mgr.a (mgr.14355) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:10.650153+0000 mgr.a (mgr.14355) 226 : audit [DBG] from='client.18759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:11.071302+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:11.072121+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:11.077400+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:11.079417+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:12.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:11 smithi131 bash[24745]: audit 2024-09-13T22:26:11.080383+0000 mgr.a (mgr.14355) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:10.650153+0000 mgr.a (mgr.14355) 226 : audit [DBG] from='client.18759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:11.071302+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:11.072121+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:11.077400+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:11.079417+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:11 smithi171 bash[25040]: audit 2024-09-13T22:26:11.080383+0000 mgr.a (mgr.14355) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:26:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:13 smithi007 bash[22722]: audit 2024-09-13T22:26:11.755085+0000 mgr.a (mgr.14355) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:26:13.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:13 smithi007 bash[22722]: cephadm 2024-09-13T22:26:11.756227+0000 mgr.a (mgr.14355) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:26:13.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:13 smithi007 bash[22722]: cluster 2024-09-13T22:26:11.889146+0000 mgr.a (mgr.14355) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:13 smithi131 bash[24745]: audit 2024-09-13T22:26:11.755085+0000 mgr.a (mgr.14355) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:26:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:13 smithi131 bash[24745]: cephadm 2024-09-13T22:26:11.756227+0000 mgr.a (mgr.14355) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:26:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:13 smithi131 bash[24745]: cluster 2024-09-13T22:26:11.889146+0000 mgr.a (mgr.14355) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:13 smithi171 bash[25040]: audit 2024-09-13T22:26:11.755085+0000 mgr.a (mgr.14355) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:26:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:13 smithi171 bash[25040]: cephadm 2024-09-13T22:26:11.756227+0000 mgr.a (mgr.14355) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:26:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:13 smithi171 bash[25040]: cluster 2024-09-13T22:26:11.889146+0000 mgr.a (mgr.14355) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:15 smithi007 bash[22722]: cluster 2024-09-13T22:26:13.889913+0000 mgr.a (mgr.14355) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:15 smithi131 bash[24745]: cluster 2024-09-13T22:26:13.889913+0000 mgr.a (mgr.14355) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:15 smithi171 bash[25040]: cluster 2024-09-13T22:26:13.889913+0000 mgr.a (mgr.14355) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:16.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:16.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:16.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:16.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:16.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:16.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:16.821 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:17 smithi007 bash[22722]: cluster 2024-09-13T22:26:15.891935+0000 mgr.a (mgr.14355) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:17 smithi131 bash[24745]: cluster 2024-09-13T22:26:15.891935+0000 mgr.a (mgr.14355) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:17 smithi171 bash[25040]: cluster 2024-09-13T22:26:15.891935+0000 mgr.a (mgr.14355) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:18 smithi007 bash[22722]: audit 2024-09-13T22:26:16.403733+0000 mgr.a (mgr.14355) 233 : audit [DBG] from='client.18942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:18 smithi131 bash[24745]: audit 2024-09-13T22:26:16.403733+0000 mgr.a (mgr.14355) 233 : audit [DBG] from='client.18942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:18 smithi171 bash[25040]: audit 2024-09-13T22:26:16.403733+0000 mgr.a (mgr.14355) 233 : audit [DBG] from='client.18942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:19 smithi007 bash[22722]: cluster 2024-09-13T22:26:17.892849+0000 mgr.a (mgr.14355) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:19.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:19 smithi131 bash[24745]: cluster 2024-09-13T22:26:17.892849+0000 mgr.a (mgr.14355) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:19 smithi171 bash[25040]: cluster 2024-09-13T22:26:17.892849+0000 mgr.a (mgr.14355) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:21 smithi007 bash[22722]: cluster 2024-09-13T22:26:19.893648+0000 mgr.a (mgr.14355) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:21.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:21 smithi131 bash[24745]: cluster 2024-09-13T22:26:19.893648+0000 mgr.a (mgr.14355) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:21 smithi171 bash[25040]: cluster 2024-09-13T22:26:19.893648+0000 mgr.a (mgr.14355) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:26:21.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:21.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:21.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:22.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:22.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:22.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:22.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:22.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:23 smithi007 bash[22722]: cluster 2024-09-13T22:26:21.895878+0000 mgr.a (mgr.14355) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:23 smithi131 bash[24745]: cluster 2024-09-13T22:26:21.895878+0000 mgr.a (mgr.14355) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:23.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:23 smithi171 bash[25040]: cluster 2024-09-13T22:26:21.895878+0000 mgr.a (mgr.14355) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:24.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:24 smithi007 bash[22722]: audit 2024-09-13T22:26:22.163095+0000 mgr.a (mgr.14355) 237 : audit [DBG] from='client.19020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:24.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:24 smithi131 bash[24745]: audit 2024-09-13T22:26:22.163095+0000 mgr.a (mgr.14355) 237 : audit [DBG] from='client.19020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:24.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:24 smithi171 bash[25040]: audit 2024-09-13T22:26:22.163095+0000 mgr.a (mgr.14355) 237 : audit [DBG] from='client.19020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:25 smithi007 bash[22722]: cluster 2024-09-13T22:26:23.896780+0000 mgr.a (mgr.14355) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:25 smithi131 bash[24745]: cluster 2024-09-13T22:26:23.896780+0000 mgr.a (mgr.14355) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:25.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:25 smithi171 bash[25040]: cluster 2024-09-13T22:26:23.896780+0000 mgr.a (mgr.14355) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:27 smithi007 bash[22722]: cluster 2024-09-13T22:26:25.899048+0000 mgr.a (mgr.14355) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:27 smithi131 bash[24745]: cluster 2024-09-13T22:26:25.899048+0000 mgr.a (mgr.14355) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:27.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:27 smithi171 bash[25040]: cluster 2024-09-13T22:26:25.899048+0000 mgr.a (mgr.14355) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:26:27.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:28.322 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:28.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:28.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:28.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:28.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:29 smithi007 bash[22722]: cluster 2024-09-13T22:26:27.899770+0000 mgr.a (mgr.14355) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:29 smithi007 bash[22722]: audit 2024-09-13T22:26:27.910070+0000 mgr.a (mgr.14355) 241 : audit [DBG] from='client.19095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:29 smithi131 bash[24745]: cluster 2024-09-13T22:26:27.899770+0000 mgr.a (mgr.14355) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:29 smithi131 bash[24745]: audit 2024-09-13T22:26:27.910070+0000 mgr.a (mgr.14355) 241 : audit [DBG] from='client.19095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:29.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:29 smithi171 bash[25040]: cluster 2024-09-13T22:26:27.899770+0000 mgr.a (mgr.14355) 240 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:29.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:29 smithi171 bash[25040]: audit 2024-09-13T22:26:27.910070+0000 mgr.a (mgr.14355) 241 : audit [DBG] from='client.19095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:31 smithi007 bash[22722]: cluster 2024-09-13T22:26:29.900682+0000 mgr.a (mgr.14355) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:31.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:31 smithi131 bash[24745]: cluster 2024-09-13T22:26:29.900682+0000 mgr.a (mgr.14355) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:31.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:31 smithi171 bash[25040]: cluster 2024-09-13T22:26:29.900682+0000 mgr.a (mgr.14355) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:33.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:33 smithi007 bash[22722]: cluster 2024-09-13T22:26:31.902979+0000 mgr.a (mgr.14355) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:33.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:33 smithi131 bash[24745]: cluster 2024-09-13T22:26:31.902979+0000 mgr.a (mgr.14355) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:33.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:33 smithi171 bash[25040]: cluster 2024-09-13T22:26:31.902979+0000 mgr.a (mgr.14355) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:34.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:34 smithi007 bash[22722]: audit 2024-09-13T22:26:33.664124+0000 mgr.a (mgr.14355) 244 : audit [DBG] from='client.19173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:34 smithi007 bash[22722]: cluster 2024-09-13T22:26:33.903609+0000 mgr.a (mgr.14355) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:34 smithi131 bash[24745]: audit 2024-09-13T22:26:33.664124+0000 mgr.a (mgr.14355) 244 : audit [DBG] from='client.19173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:34.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:34 smithi131 bash[24745]: cluster 2024-09-13T22:26:33.903609+0000 mgr.a (mgr.14355) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:34.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:34 smithi171 bash[25040]: audit 2024-09-13T22:26:33.664124+0000 mgr.a (mgr.14355) 244 : audit [DBG] from='client.19173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:34.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:34 smithi171 bash[25040]: cluster 2024-09-13T22:26:33.903609+0000 mgr.a (mgr.14355) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:37.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:36 smithi131 bash[24745]: cluster 2024-09-13T22:26:35.905881+0000 mgr.a (mgr.14355) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:37.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:36 smithi171 bash[25040]: cluster 2024-09-13T22:26:35.905881+0000 mgr.a (mgr.14355) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:36 smithi007 bash[22722]: cluster 2024-09-13T22:26:35.905881+0000 mgr.a (mgr.14355) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:39.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:39.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:39.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:38 smithi131 bash[24745]: cluster 2024-09-13T22:26:37.906607+0000 mgr.a (mgr.14355) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:39.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:38 smithi171 bash[25040]: cluster 2024-09-13T22:26:37.906607+0000 mgr.a (mgr.14355) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:38 smithi007 bash[22722]: cluster 2024-09-13T22:26:37.906607+0000 mgr.a (mgr.14355) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:39.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:41.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:40 smithi131 bash[24745]: audit 2024-09-13T22:26:39.432749+0000 mgr.a (mgr.14355) 248 : audit [DBG] from='client.19248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:41.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:40 smithi131 bash[24745]: cluster 2024-09-13T22:26:39.907331+0000 mgr.a (mgr.14355) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:41.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:40 smithi171 bash[25040]: audit 2024-09-13T22:26:39.432749+0000 mgr.a (mgr.14355) 248 : audit [DBG] from='client.19248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:41.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:40 smithi171 bash[25040]: cluster 2024-09-13T22:26:39.907331+0000 mgr.a (mgr.14355) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:40 smithi007 bash[22722]: audit 2024-09-13T22:26:39.432749+0000 mgr.a (mgr.14355) 248 : audit [DBG] from='client.19248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:40 smithi007 bash[22722]: cluster 2024-09-13T22:26:39.907331+0000 mgr.a (mgr.14355) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:43.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:42 smithi131 bash[24745]: cluster 2024-09-13T22:26:41.909510+0000 mgr.a (mgr.14355) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:42 smithi171 bash[25040]: cluster 2024-09-13T22:26:41.909510+0000 mgr.a (mgr.14355) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:43.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:42 smithi007 bash[22722]: cluster 2024-09-13T22:26:41.909510+0000 mgr.a (mgr.14355) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:26:44.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:44.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:44.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:45.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:44 smithi131 bash[24745]: cluster 2024-09-13T22:26:43.910264+0000 mgr.a (mgr.14355) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:45.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:44 smithi171 bash[25040]: cluster 2024-09-13T22:26:43.910264+0000 mgr.a (mgr.14355) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:44 smithi007 bash[22722]: cluster 2024-09-13T22:26:43.910264+0000 mgr.a (mgr.14355) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:47.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:46 smithi131 bash[24745]: audit 2024-09-13T22:26:45.200297+0000 mgr.a (mgr.14355) 252 : audit [DBG] from='client.19320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:47.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:46 smithi131 bash[24745]: cluster 2024-09-13T22:26:45.913034+0000 mgr.a (mgr.14355) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:47.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:46 smithi171 bash[25040]: audit 2024-09-13T22:26:45.200297+0000 mgr.a (mgr.14355) 252 : audit [DBG] from='client.19320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:47.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:46 smithi171 bash[25040]: cluster 2024-09-13T22:26:45.913034+0000 mgr.a (mgr.14355) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:46 smithi007 bash[22722]: audit 2024-09-13T22:26:45.200297+0000 mgr.a (mgr.14355) 252 : audit [DBG] from='client.19320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:46 smithi007 bash[22722]: cluster 2024-09-13T22:26:45.913034+0000 mgr.a (mgr.14355) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:49.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:48 smithi131 bash[24745]: cluster 2024-09-13T22:26:47.913855+0000 mgr.a (mgr.14355) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:49.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:48 smithi171 bash[25040]: cluster 2024-09-13T22:26:47.913855+0000 mgr.a (mgr.14355) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:48 smithi007 bash[22722]: cluster 2024-09-13T22:26:47.913855+0000 mgr.a (mgr.14355) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:50.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:50.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:50.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:51.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:50 smithi131 bash[24745]: cluster 2024-09-13T22:26:49.914618+0000 mgr.a (mgr.14355) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:26:51.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:50 smithi171 bash[25040]: cluster 2024-09-13T22:26:49.914618+0000 mgr.a (mgr.14355) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:26:51.373 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:50 smithi007 bash[22722]: cluster 2024-09-13T22:26:49.914618+0000 mgr.a (mgr.14355) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:26:52.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:51 smithi131 bash[24745]: audit 2024-09-13T22:26:50.969872+0000 mgr.a (mgr.14355) 256 : audit [DBG] from='client.19398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:52.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:51 smithi171 bash[25040]: audit 2024-09-13T22:26:50.969872+0000 mgr.a (mgr.14355) 256 : audit [DBG] from='client.19398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:52.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:51 smithi007 bash[22722]: audit 2024-09-13T22:26:50.969872+0000 mgr.a (mgr.14355) 256 : audit [DBG] from='client.19398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:53.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:53 smithi131 bash[24745]: cluster 2024-09-13T22:26:51.917391+0000 mgr.a (mgr.14355) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:53.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:53 smithi171 bash[25040]: cluster 2024-09-13T22:26:51.917391+0000 mgr.a (mgr.14355) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:53 smithi007 bash[22722]: cluster 2024-09-13T22:26:51.917391+0000 mgr.a (mgr.14355) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:55.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:55 smithi131 bash[24745]: cluster 2024-09-13T22:26:53.918182+0000 mgr.a (mgr.14355) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:55.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:55 smithi171 bash[25040]: cluster 2024-09-13T22:26:53.918182+0000 mgr.a (mgr.14355) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:55 smithi007 bash[22722]: cluster 2024-09-13T22:26:53.918182+0000 mgr.a (mgr.14355) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:26:56.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:26:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:26:56.376 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:26:57.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:26:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:26:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:26:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:26:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:26:57.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:57 smithi131 bash[24745]: cluster 2024-09-13T22:26:55.920155+0000 mgr.a (mgr.14355) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:57.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:57 smithi171 bash[25040]: cluster 2024-09-13T22:26:55.920155+0000 mgr.a (mgr.14355) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:57 smithi007 bash[22722]: cluster 2024-09-13T22:26:55.920155+0000 mgr.a (mgr.14355) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:58.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:58 smithi131 bash[24745]: audit 2024-09-13T22:26:56.709949+0000 mgr.a (mgr.14355) 260 : audit [DBG] from='client.19476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:58.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:58 smithi171 bash[25040]: audit 2024-09-13T22:26:56.709949+0000 mgr.a (mgr.14355) 260 : audit [DBG] from='client.19476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:58.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:58 smithi007 bash[22722]: audit 2024-09-13T22:26:56.709949+0000 mgr.a (mgr.14355) 260 : audit [DBG] from='client.19476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:26:59.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:26:59 smithi131 bash[24745]: cluster 2024-09-13T22:26:57.921052+0000 mgr.a (mgr.14355) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:59.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:26:59 smithi171 bash[25040]: cluster 2024-09-13T22:26:57.921052+0000 mgr.a (mgr.14355) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:26:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:26:59 smithi007 bash[22722]: cluster 2024-09-13T22:26:57.921052+0000 mgr.a (mgr.14355) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:01.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:01 smithi131 bash[24745]: cluster 2024-09-13T22:26:59.921882+0000 mgr.a (mgr.14355) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:01.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:01 smithi171 bash[25040]: cluster 2024-09-13T22:26:59.921882+0000 mgr.a (mgr.14355) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:01 smithi007 bash[22722]: cluster 2024-09-13T22:26:59.921882+0000 mgr.a (mgr.14355) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:02.892 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:02.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:02.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:02.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:02.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:03.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:03 smithi171 bash[25040]: cluster 2024-09-13T22:27:01.924148+0000 mgr.a (mgr.14355) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:03.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:03 smithi007 bash[22722]: cluster 2024-09-13T22:27:01.924148+0000 mgr.a (mgr.14355) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:03 smithi131 bash[24745]: cluster 2024-09-13T22:27:01.924148+0000 mgr.a (mgr.14355) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:04.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:04 smithi171 bash[25040]: audit 2024-09-13T22:27:02.477374+0000 mgr.a (mgr.14355) 264 : audit [DBG] from='client.19554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:04.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:04 smithi007 bash[22722]: audit 2024-09-13T22:27:02.477374+0000 mgr.a (mgr.14355) 264 : audit [DBG] from='client.19554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:04.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:04 smithi131 bash[24745]: audit 2024-09-13T22:27:02.477374+0000 mgr.a (mgr.14355) 264 : audit [DBG] from='client.19554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:05 smithi007 bash[22722]: cluster 2024-09-13T22:27:03.925004+0000 mgr.a (mgr.14355) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:05.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:05 smithi131 bash[24745]: cluster 2024-09-13T22:27:03.925004+0000 mgr.a (mgr.14355) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:05.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:05 smithi171 bash[25040]: cluster 2024-09-13T22:27:03.925004+0000 mgr.a (mgr.14355) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:07 smithi007 bash[22722]: cluster 2024-09-13T22:27:05.927245+0000 mgr.a (mgr.14355) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:07 smithi131 bash[24745]: cluster 2024-09-13T22:27:05.927245+0000 mgr.a (mgr.14355) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:07.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:07 smithi171 bash[25040]: cluster 2024-09-13T22:27:05.927245+0000 mgr.a (mgr.14355) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:07.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:08.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:08.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:08.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:08.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:08.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:09 smithi007 bash[22722]: cluster 2024-09-13T22:27:07.927802+0000 mgr.a (mgr.14355) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:09.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:09 smithi131 bash[24745]: cluster 2024-09-13T22:27:07.927802+0000 mgr.a (mgr.14355) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:09.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:09 smithi171 bash[25040]: cluster 2024-09-13T22:27:07.927802+0000 mgr.a (mgr.14355) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:10 smithi007 bash[22722]: audit 2024-09-13T22:27:08.229977+0000 mgr.a (mgr.14355) 268 : audit [DBG] from='client.19632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:10.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:10 smithi131 bash[24745]: audit 2024-09-13T22:27:08.229977+0000 mgr.a (mgr.14355) 268 : audit [DBG] from='client.19632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:10.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:10 smithi171 bash[25040]: audit 2024-09-13T22:27:08.229977+0000 mgr.a (mgr.14355) 268 : audit [DBG] from='client.19632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:11 smithi007 bash[22722]: cluster 2024-09-13T22:27:09.928677+0000 mgr.a (mgr.14355) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:11 smithi131 bash[24745]: cluster 2024-09-13T22:27:09.928677+0000 mgr.a (mgr.14355) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:11.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:11 smithi171 bash[25040]: cluster 2024-09-13T22:27:09.928677+0000 mgr.a (mgr.14355) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:12.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:12 smithi007 bash[22722]: audit 2024-09-13T22:27:11.806530+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:27:12.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:12 smithi131 bash[24745]: audit 2024-09-13T22:27:11.806530+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:27:12.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:12 smithi171 bash[25040]: audit 2024-09-13T22:27:11.806530+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:27:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22722]: cluster 2024-09-13T22:27:11.930916+0000 mgr.a (mgr.14355) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22722]: audit 2024-09-13T22:27:12.422326+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22722]: audit 2024-09-13T22:27:12.426558+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22722]: audit 2024-09-13T22:27:12.433840+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22722]: audit 2024-09-13T22:27:12.441049+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:13 smithi131 bash[24745]: cluster 2024-09-13T22:27:11.930916+0000 mgr.a (mgr.14355) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:13 smithi131 bash[24745]: audit 2024-09-13T22:27:12.422326+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:13 smithi131 bash[24745]: audit 2024-09-13T22:27:12.426558+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:13 smithi131 bash[24745]: audit 2024-09-13T22:27:12.433840+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:13 smithi131 bash[24745]: audit 2024-09-13T22:27:12.441049+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:13 smithi171 bash[25040]: cluster 2024-09-13T22:27:11.930916+0000 mgr.a (mgr.14355) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:13.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:13 smithi171 bash[25040]: audit 2024-09-13T22:27:12.422326+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:13 smithi171 bash[25040]: audit 2024-09-13T22:27:12.426558+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:13 smithi171 bash[25040]: audit 2024-09-13T22:27:12.433840+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:13 smithi171 bash[25040]: audit 2024-09-13T22:27:12.441049+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:13.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:13.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:13.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:14.070 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22972]: debug 2024-09-13T22:27:13.814+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:27:14.071 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:27:13 smithi007 bash[22972]: debug 2024-09-13T22:27:13.818+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:27:14.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:14 smithi007 bash[22722]: audit 2024-09-13T22:27:13.092247+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:27:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:14 smithi007 bash[22722]: audit 2024-09-13T22:27:13.093698+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:27:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:14 smithi007 bash[22722]: audit 2024-09-13T22:27:13.103350+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:14 smithi007 bash[22722]: audit 2024-09-13T22:27:13.108346+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:14 smithi007 bash[22722]: audit 2024-09-13T22:27:13.110529+0000 mgr.a (mgr.14355) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:14 smithi131 bash[24745]: audit 2024-09-13T22:27:13.092247+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:27:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:14 smithi131 bash[24745]: audit 2024-09-13T22:27:13.093698+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:27:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:14 smithi131 bash[24745]: audit 2024-09-13T22:27:13.103350+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:14 smithi131 bash[24745]: audit 2024-09-13T22:27:13.108346+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:14 smithi131 bash[24745]: audit 2024-09-13T22:27:13.110529+0000 mgr.a (mgr.14355) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:14.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:14 smithi171 bash[25040]: audit 2024-09-13T22:27:13.092247+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:27:14.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:14 smithi171 bash[25040]: audit 2024-09-13T22:27:13.093698+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:27:14.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:14 smithi171 bash[25040]: audit 2024-09-13T22:27:13.103350+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:27:14.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:14 smithi171 bash[25040]: audit 2024-09-13T22:27:13.108346+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:14 smithi171 bash[25040]: audit 2024-09-13T22:27:13.110529+0000 mgr.a (mgr.14355) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:27:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:15 smithi007 bash[22722]: audit 2024-09-13T22:27:13.821284+0000 mgr.a (mgr.14355) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:27:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:15 smithi007 bash[22722]: cephadm 2024-09-13T22:27:13.822469+0000 mgr.a (mgr.14355) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:27:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:15 smithi007 bash[22722]: cluster 2024-09-13T22:27:13.931379+0000 mgr.a (mgr.14355) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:15.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:15 smithi007 bash[22722]: audit 2024-09-13T22:27:13.996867+0000 mgr.a (mgr.14355) 275 : audit [DBG] from='client.19815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:15 smithi131 bash[24745]: audit 2024-09-13T22:27:13.821284+0000 mgr.a (mgr.14355) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:27:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:15 smithi131 bash[24745]: cephadm 2024-09-13T22:27:13.822469+0000 mgr.a (mgr.14355) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:27:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:15 smithi131 bash[24745]: cluster 2024-09-13T22:27:13.931379+0000 mgr.a (mgr.14355) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:15 smithi131 bash[24745]: audit 2024-09-13T22:27:13.996867+0000 mgr.a (mgr.14355) 275 : audit [DBG] from='client.19815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:15 smithi171 bash[25040]: audit 2024-09-13T22:27:13.821284+0000 mgr.a (mgr.14355) 272 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:27:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:15 smithi171 bash[25040]: cephadm 2024-09-13T22:27:13.822469+0000 mgr.a (mgr.14355) 273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:27:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:15 smithi171 bash[25040]: cluster 2024-09-13T22:27:13.931379+0000 mgr.a (mgr.14355) 274 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:15 smithi171 bash[25040]: audit 2024-09-13T22:27:13.996867+0000 mgr.a (mgr.14355) 275 : audit [DBG] from='client.19815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:17 smithi007 bash[22722]: cluster 2024-09-13T22:27:15.933697+0000 mgr.a (mgr.14355) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:17 smithi131 bash[24745]: cluster 2024-09-13T22:27:15.933697+0000 mgr.a (mgr.14355) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:17 smithi171 bash[25040]: cluster 2024-09-13T22:27:15.933697+0000 mgr.a (mgr.14355) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:19.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:19.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:19 smithi007 bash[22722]: cluster 2024-09-13T22:27:17.934487+0000 mgr.a (mgr.14355) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:19.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:19 smithi131 bash[24745]: cluster 2024-09-13T22:27:17.934487+0000 mgr.a (mgr.14355) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:19 smithi171 bash[25040]: cluster 2024-09-13T22:27:17.934487+0000 mgr.a (mgr.14355) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:20.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:20.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:20.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:20.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:20.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:21 smithi007 bash[22722]: audit 2024-09-13T22:27:19.736807+0000 mgr.a (mgr.14355) 278 : audit [DBG] from='client.19893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:21 smithi007 bash[22722]: cluster 2024-09-13T22:27:19.935027+0000 mgr.a (mgr.14355) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:21 smithi131 bash[24745]: audit 2024-09-13T22:27:19.736807+0000 mgr.a (mgr.14355) 278 : audit [DBG] from='client.19893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:21 smithi131 bash[24745]: cluster 2024-09-13T22:27:19.935027+0000 mgr.a (mgr.14355) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:21 smithi171 bash[25040]: audit 2024-09-13T22:27:19.736807+0000 mgr.a (mgr.14355) 278 : audit [DBG] from='client.19893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:21 smithi171 bash[25040]: cluster 2024-09-13T22:27:19.935027+0000 mgr.a (mgr.14355) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:23 smithi007 bash[22722]: cluster 2024-09-13T22:27:21.937339+0000 mgr.a (mgr.14355) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:23 smithi131 bash[24745]: cluster 2024-09-13T22:27:21.937339+0000 mgr.a (mgr.14355) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:23.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:23 smithi171 bash[25040]: cluster 2024-09-13T22:27:21.937339+0000 mgr.a (mgr.14355) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:25.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:25.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:25.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:25 smithi007 bash[22722]: cluster 2024-09-13T22:27:23.938114+0000 mgr.a (mgr.14355) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:25.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:25 smithi131 bash[24745]: cluster 2024-09-13T22:27:23.938114+0000 mgr.a (mgr.14355) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:25.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:25 smithi171 bash[25040]: cluster 2024-09-13T22:27:23.938114+0000 mgr.a (mgr.14355) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:25.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:25.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:25.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:25.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:25.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:27.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:27 smithi007 bash[22722]: audit 2024-09-13T22:27:25.496263+0000 mgr.a (mgr.14355) 282 : audit [DBG] from='client.19971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:27.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:27 smithi007 bash[22722]: cluster 2024-09-13T22:27:25.939315+0000 mgr.a (mgr.14355) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:27 smithi131 bash[24745]: audit 2024-09-13T22:27:25.496263+0000 mgr.a (mgr.14355) 282 : audit [DBG] from='client.19971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:27 smithi131 bash[24745]: cluster 2024-09-13T22:27:25.939315+0000 mgr.a (mgr.14355) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:27.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:27 smithi171 bash[25040]: audit 2024-09-13T22:27:25.496263+0000 mgr.a (mgr.14355) 282 : audit [DBG] from='client.19971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:27.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:27 smithi171 bash[25040]: cluster 2024-09-13T22:27:25.939315+0000 mgr.a (mgr.14355) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:27:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:29 smithi007 bash[22722]: cluster 2024-09-13T22:27:27.940037+0000 mgr.a (mgr.14355) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:29 smithi131 bash[24745]: cluster 2024-09-13T22:27:27.940037+0000 mgr.a (mgr.14355) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:29.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:29 smithi171 bash[25040]: cluster 2024-09-13T22:27:27.940037+0000 mgr.a (mgr.14355) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:30.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:30.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:30.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:31 smithi007 bash[22722]: cluster 2024-09-13T22:27:29.940843+0000 mgr.a (mgr.14355) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:31.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:31 smithi131 bash[24745]: cluster 2024-09-13T22:27:29.940843+0000 mgr.a (mgr.14355) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:31.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:31 smithi171 bash[25040]: cluster 2024-09-13T22:27:29.940843+0000 mgr.a (mgr.14355) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:31.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:31.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:33 smithi007 bash[22722]: audit 2024-09-13T22:27:31.248835+0000 mgr.a (mgr.14355) 286 : audit [DBG] from='client.20049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:33 smithi007 bash[22722]: cluster 2024-09-13T22:27:31.943526+0000 mgr.a (mgr.14355) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:33 smithi131 bash[24745]: audit 2024-09-13T22:27:31.248835+0000 mgr.a (mgr.14355) 286 : audit [DBG] from='client.20049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:33 smithi131 bash[24745]: cluster 2024-09-13T22:27:31.943526+0000 mgr.a (mgr.14355) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:33.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:33 smithi171 bash[25040]: audit 2024-09-13T22:27:31.248835+0000 mgr.a (mgr.14355) 286 : audit [DBG] from='client.20049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:33.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:33 smithi171 bash[25040]: cluster 2024-09-13T22:27:31.943526+0000 mgr.a (mgr.14355) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:35 smithi007 bash[22722]: cluster 2024-09-13T22:27:33.944290+0000 mgr.a (mgr.14355) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:35 smithi131 bash[24745]: cluster 2024-09-13T22:27:33.944290+0000 mgr.a (mgr.14355) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:35.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:35 smithi171 bash[25040]: cluster 2024-09-13T22:27:33.944290+0000 mgr.a (mgr.14355) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:27:36.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:36.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:36.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:37.449 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:37.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:37.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:37.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:37.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:37 smithi007 bash[22722]: cluster 2024-09-13T22:27:35.946270+0000 mgr.a (mgr.14355) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:37 smithi131 bash[24745]: cluster 2024-09-13T22:27:35.946270+0000 mgr.a (mgr.14355) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:37.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:37 smithi171 bash[25040]: cluster 2024-09-13T22:27:35.946270+0000 mgr.a (mgr.14355) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:38.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:38 smithi007 bash[22722]: audit 2024-09-13T22:27:37.015025+0000 mgr.a (mgr.14355) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:38.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:38 smithi007 bash[22722]: cluster 2024-09-13T22:27:37.947178+0000 mgr.a (mgr.14355) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:38.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:38 smithi131 bash[24745]: audit 2024-09-13T22:27:37.015025+0000 mgr.a (mgr.14355) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:38.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:38 smithi131 bash[24745]: cluster 2024-09-13T22:27:37.947178+0000 mgr.a (mgr.14355) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:38.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:38 smithi171 bash[25040]: audit 2024-09-13T22:27:37.015025+0000 mgr.a (mgr.14355) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:38.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:38 smithi171 bash[25040]: cluster 2024-09-13T22:27:37.947178+0000 mgr.a (mgr.14355) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:41.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:41 smithi131 bash[24745]: cluster 2024-09-13T22:27:39.947954+0000 mgr.a (mgr.14355) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:41.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:41 smithi171 bash[25040]: cluster 2024-09-13T22:27:39.947954+0000 mgr.a (mgr.14355) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:41.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:41 smithi007 bash[22722]: cluster 2024-09-13T22:27:39.947954+0000 mgr.a (mgr.14355) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:42.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:42.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:43.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:43.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:43.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:43 smithi131 bash[24745]: cluster 2024-09-13T22:27:41.950170+0000 mgr.a (mgr.14355) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:43 smithi171 bash[25040]: cluster 2024-09-13T22:27:41.950170+0000 mgr.a (mgr.14355) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:43 smithi007 bash[22722]: cluster 2024-09-13T22:27:41.950170+0000 mgr.a (mgr.14355) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:44.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:44 smithi131 bash[24745]: audit 2024-09-13T22:27:42.787553+0000 mgr.a (mgr.14355) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:44.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:44 smithi171 bash[25040]: audit 2024-09-13T22:27:42.787553+0000 mgr.a (mgr.14355) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:44.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:44 smithi007 bash[22722]: audit 2024-09-13T22:27:42.787553+0000 mgr.a (mgr.14355) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:45.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:45 smithi131 bash[24745]: cluster 2024-09-13T22:27:43.951176+0000 mgr.a (mgr.14355) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:45.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:45 smithi171 bash[25040]: cluster 2024-09-13T22:27:43.951176+0000 mgr.a (mgr.14355) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:45 smithi007 bash[22722]: cluster 2024-09-13T22:27:43.951176+0000 mgr.a (mgr.14355) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:47.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:47 smithi131 bash[24745]: cluster 2024-09-13T22:27:45.953428+0000 mgr.a (mgr.14355) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:47.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:47 smithi171 bash[25040]: cluster 2024-09-13T22:27:45.953428+0000 mgr.a (mgr.14355) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:47 smithi007 bash[22722]: cluster 2024-09-13T22:27:45.953428+0000 mgr.a (mgr.14355) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:48.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:48.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:48.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:48.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:49.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:49 smithi131 bash[24745]: cluster 2024-09-13T22:27:47.954218+0000 mgr.a (mgr.14355) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:49.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:49 smithi171 bash[25040]: cluster 2024-09-13T22:27:47.954218+0000 mgr.a (mgr.14355) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:49.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:49 smithi007 bash[22722]: cluster 2024-09-13T22:27:47.954218+0000 mgr.a (mgr.14355) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:50.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:50 smithi171 bash[25040]: audit 2024-09-13T22:27:48.556787+0000 mgr.a (mgr.14355) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:50.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:50 smithi007 bash[22722]: audit 2024-09-13T22:27:48.556787+0000 mgr.a (mgr.14355) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:50.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:50 smithi131 bash[24745]: audit 2024-09-13T22:27:48.556787+0000 mgr.a (mgr.14355) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:51.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:51 smithi171 bash[25040]: cluster 2024-09-13T22:27:49.955046+0000 mgr.a (mgr.14355) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:51 smithi007 bash[22722]: cluster 2024-09-13T22:27:49.955046+0000 mgr.a (mgr.14355) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:51 smithi131 bash[24745]: cluster 2024-09-13T22:27:49.955046+0000 mgr.a (mgr.14355) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:53 smithi007 bash[22722]: cluster 2024-09-13T22:27:51.957280+0000 mgr.a (mgr.14355) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:53 smithi131 bash[24745]: cluster 2024-09-13T22:27:51.957280+0000 mgr.a (mgr.14355) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:53.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:53 smithi171 bash[25040]: cluster 2024-09-13T22:27:51.957280+0000 mgr.a (mgr.14355) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:53.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:53.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:53.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:27:54.741 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:27:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:27:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:27:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:27:54.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:27:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:55 smithi007 bash[22722]: cluster 2024-09-13T22:27:53.958005+0000 mgr.a (mgr.14355) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:55 smithi131 bash[24745]: cluster 2024-09-13T22:27:53.958005+0000 mgr.a (mgr.14355) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:55.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:55 smithi171 bash[25040]: cluster 2024-09-13T22:27:53.958005+0000 mgr.a (mgr.14355) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:56.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:56 smithi007 bash[22722]: audit 2024-09-13T22:27:54.323980+0000 mgr.a (mgr.14355) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:56.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:56 smithi131 bash[24745]: audit 2024-09-13T22:27:54.323980+0000 mgr.a (mgr.14355) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:56.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:56 smithi171 bash[25040]: audit 2024-09-13T22:27:54.323980+0000 mgr.a (mgr.14355) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:27:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:57 smithi007 bash[22722]: cluster 2024-09-13T22:27:55.960353+0000 mgr.a (mgr.14355) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:57 smithi131 bash[24745]: cluster 2024-09-13T22:27:55.960353+0000 mgr.a (mgr.14355) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:57.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:57 smithi171 bash[25040]: cluster 2024-09-13T22:27:55.960353+0000 mgr.a (mgr.14355) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:27:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:27:59 smithi007 bash[22722]: cluster 2024-09-13T22:27:57.961080+0000 mgr.a (mgr.14355) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:27:59 smithi131 bash[24745]: cluster 2024-09-13T22:27:57.961080+0000 mgr.a (mgr.14355) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:27:59 smithi171 bash[25040]: cluster 2024-09-13T22:27:57.961080+0000 mgr.a (mgr.14355) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:27:59.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:27:59.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:27:59.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:00.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:00.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:00.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:01 smithi007 bash[22722]: cluster 2024-09-13T22:27:59.961769+0000 mgr.a (mgr.14355) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:01 smithi007 bash[22722]: audit 2024-09-13T22:28:00.083511+0000 mgr.a (mgr.14355) 306 : audit [DBG] from='client.20433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:01 smithi131 bash[24745]: cluster 2024-09-13T22:27:59.961769+0000 mgr.a (mgr.14355) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:01 smithi131 bash[24745]: audit 2024-09-13T22:28:00.083511+0000 mgr.a (mgr.14355) 306 : audit [DBG] from='client.20433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:01.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:01 smithi171 bash[25040]: cluster 2024-09-13T22:27:59.961769+0000 mgr.a (mgr.14355) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:01.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:01 smithi171 bash[25040]: audit 2024-09-13T22:28:00.083511+0000 mgr.a (mgr.14355) 306 : audit [DBG] from='client.20433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:03.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:03 smithi007 bash[22722]: cluster 2024-09-13T22:28:01.964403+0000 mgr.a (mgr.14355) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:03 smithi131 bash[24745]: cluster 2024-09-13T22:28:01.964403+0000 mgr.a (mgr.14355) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:03.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:03 smithi171 bash[25040]: cluster 2024-09-13T22:28:01.964403+0000 mgr.a (mgr.14355) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:05.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:05 smithi007 bash[22722]: cluster 2024-09-13T22:28:03.965164+0000 mgr.a (mgr.14355) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:05.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:05.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:05.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:05 smithi131 bash[24745]: cluster 2024-09-13T22:28:03.965164+0000 mgr.a (mgr.14355) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:05.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:05 smithi171 bash[25040]: cluster 2024-09-13T22:28:03.965164+0000 mgr.a (mgr.14355) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:06.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:06.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:07 smithi007 bash[22722]: audit 2024-09-13T22:28:05.861217+0000 mgr.a (mgr.14355) 309 : audit [DBG] from='client.20508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:07 smithi007 bash[22722]: cluster 2024-09-13T22:28:05.966472+0000 mgr.a (mgr.14355) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:07 smithi131 bash[24745]: audit 2024-09-13T22:28:05.861217+0000 mgr.a (mgr.14355) 309 : audit [DBG] from='client.20508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:07 smithi131 bash[24745]: cluster 2024-09-13T22:28:05.966472+0000 mgr.a (mgr.14355) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:07.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:07 smithi171 bash[25040]: audit 2024-09-13T22:28:05.861217+0000 mgr.a (mgr.14355) 309 : audit [DBG] from='client.20508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:07.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:07 smithi171 bash[25040]: cluster 2024-09-13T22:28:05.966472+0000 mgr.a (mgr.14355) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:09 smithi007 bash[22722]: cluster 2024-09-13T22:28:07.967309+0000 mgr.a (mgr.14355) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:09.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:09 smithi131 bash[24745]: cluster 2024-09-13T22:28:07.967309+0000 mgr.a (mgr.14355) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:09.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:09 smithi171 bash[25040]: cluster 2024-09-13T22:28:07.967309+0000 mgr.a (mgr.14355) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:11.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:11 smithi007 bash[22722]: cluster 2024-09-13T22:28:09.968112+0000 mgr.a (mgr.14355) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:11 smithi131 bash[24745]: cluster 2024-09-13T22:28:09.968112+0000 mgr.a (mgr.14355) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:11.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:11 smithi171 bash[25040]: cluster 2024-09-13T22:28:09.968112+0000 mgr.a (mgr.14355) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:12.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:12.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:13 smithi007 bash[22722]: audit 2024-09-13T22:28:11.627688+0000 mgr.a (mgr.14355) 313 : audit [DBG] from='client.20580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:13 smithi007 bash[22722]: cluster 2024-09-13T22:28:11.969479+0000 mgr.a (mgr.14355) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:13 smithi131 bash[24745]: audit 2024-09-13T22:28:11.627688+0000 mgr.a (mgr.14355) 313 : audit [DBG] from='client.20580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:13 smithi131 bash[24745]: cluster 2024-09-13T22:28:11.969479+0000 mgr.a (mgr.14355) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:13 smithi171 bash[25040]: audit 2024-09-13T22:28:11.627688+0000 mgr.a (mgr.14355) 313 : audit [DBG] from='client.20580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:13 smithi171 bash[25040]: cluster 2024-09-13T22:28:11.969479+0000 mgr.a (mgr.14355) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:14 smithi007 bash[22722]: audit 2024-09-13T22:28:13.880895+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:28:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:14 smithi131 bash[24745]: audit 2024-09-13T22:28:13.880895+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:28:14.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:14 smithi171 bash[25040]: audit 2024-09-13T22:28:13.880895+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:28:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22722]: cluster 2024-09-13T22:28:13.970241+0000 mgr.a (mgr.14355) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22722]: audit 2024-09-13T22:28:14.724512+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:28:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22722]: audit 2024-09-13T22:28:14.726408+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:28:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22722]: audit 2024-09-13T22:28:14.737074+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:28:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22722]: audit 2024-09-13T22:28:14.741788+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:15 smithi131 bash[24745]: cluster 2024-09-13T22:28:13.970241+0000 mgr.a (mgr.14355) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:15 smithi131 bash[24745]: audit 2024-09-13T22:28:14.724512+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:28:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:15 smithi131 bash[24745]: audit 2024-09-13T22:28:14.726408+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:28:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:15 smithi131 bash[24745]: audit 2024-09-13T22:28:14.737074+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:28:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:15 smithi131 bash[24745]: audit 2024-09-13T22:28:14.741788+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:15.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:15 smithi171 bash[25040]: cluster 2024-09-13T22:28:13.970241+0000 mgr.a (mgr.14355) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:15.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:15 smithi171 bash[25040]: audit 2024-09-13T22:28:14.724512+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:28:15.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:15 smithi171 bash[25040]: audit 2024-09-13T22:28:14.726408+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:28:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:15 smithi171 bash[25040]: audit 2024-09-13T22:28:14.737074+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:28:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:15 smithi171 bash[25040]: audit 2024-09-13T22:28:14.741788+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:15.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22972]: debug 2024-09-13T22:28:15.477+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:28:15.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:28:15 smithi007 bash[22972]: debug 2024-09-13T22:28:15.481+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:28:16.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:16 smithi007 bash[22722]: audit 2024-09-13T22:28:14.744127+0000 mgr.a (mgr.14355) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:16.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:16 smithi131 bash[24745]: audit 2024-09-13T22:28:14.744127+0000 mgr.a (mgr.14355) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:16.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:16 smithi171 bash[25040]: audit 2024-09-13T22:28:14.744127+0000 mgr.a (mgr.14355) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:28:17.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:17.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:17 smithi007 bash[22722]: audit 2024-09-13T22:28:15.481253+0000 mgr.a (mgr.14355) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:28:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:17 smithi007 bash[22722]: cephadm 2024-09-13T22:28:15.482897+0000 mgr.a (mgr.14355) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:28:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:17 smithi007 bash[22722]: cluster 2024-09-13T22:28:15.972953+0000 mgr.a (mgr.14355) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:28:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:17 smithi131 bash[24745]: audit 2024-09-13T22:28:15.481253+0000 mgr.a (mgr.14355) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:28:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:17 smithi131 bash[24745]: cephadm 2024-09-13T22:28:15.482897+0000 mgr.a (mgr.14355) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:28:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:17 smithi131 bash[24745]: cluster 2024-09-13T22:28:15.972953+0000 mgr.a (mgr.14355) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:28:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:17 smithi171 bash[25040]: audit 2024-09-13T22:28:15.481253+0000 mgr.a (mgr.14355) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:28:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:17 smithi171 bash[25040]: cephadm 2024-09-13T22:28:15.482897+0000 mgr.a (mgr.14355) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:28:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:17 smithi171 bash[25040]: cluster 2024-09-13T22:28:15.972953+0000 mgr.a (mgr.14355) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:28:17.824 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:19 smithi007 bash[22722]: audit 2024-09-13T22:28:17.399352+0000 mgr.a (mgr.14355) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:19 smithi007 bash[22722]: cluster 2024-09-13T22:28:17.973863+0000 mgr.a (mgr.14355) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:19 smithi131 bash[24745]: audit 2024-09-13T22:28:17.399352+0000 mgr.a (mgr.14355) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:19 smithi131 bash[24745]: cluster 2024-09-13T22:28:17.973863+0000 mgr.a (mgr.14355) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:19.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:19 smithi171 bash[25040]: audit 2024-09-13T22:28:17.399352+0000 mgr.a (mgr.14355) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:19.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:19 smithi171 bash[25040]: cluster 2024-09-13T22:28:17.973863+0000 mgr.a (mgr.14355) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:21 smithi007 bash[22722]: cluster 2024-09-13T22:28:19.974718+0000 mgr.a (mgr.14355) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:21 smithi131 bash[24745]: cluster 2024-09-13T22:28:19.974718+0000 mgr.a (mgr.14355) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:21.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:21 smithi171 bash[25040]: cluster 2024-09-13T22:28:19.974718+0000 mgr.a (mgr.14355) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:28:22.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:22.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:23 smithi007 bash[22722]: cluster 2024-09-13T22:28:21.976980+0000 mgr.a (mgr.14355) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:23 smithi131 bash[24745]: cluster 2024-09-13T22:28:21.976980+0000 mgr.a (mgr.14355) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:23.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:23 smithi171 bash[25040]: cluster 2024-09-13T22:28:21.976980+0000 mgr.a (mgr.14355) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:23.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:23.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:23.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:23.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:23.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:25 smithi007 bash[22722]: audit 2024-09-13T22:28:23.163045+0000 mgr.a (mgr.14355) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:25 smithi007 bash[22722]: cluster 2024-09-13T22:28:23.978048+0000 mgr.a (mgr.14355) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:25 smithi131 bash[24745]: audit 2024-09-13T22:28:23.163045+0000 mgr.a (mgr.14355) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:25 smithi131 bash[24745]: cluster 2024-09-13T22:28:23.978048+0000 mgr.a (mgr.14355) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:25.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:25 smithi171 bash[25040]: audit 2024-09-13T22:28:23.163045+0000 mgr.a (mgr.14355) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:25.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:25 smithi171 bash[25040]: cluster 2024-09-13T22:28:23.978048+0000 mgr.a (mgr.14355) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:27 smithi007 bash[22722]: cluster 2024-09-13T22:28:25.980347+0000 mgr.a (mgr.14355) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:27 smithi131 bash[24745]: cluster 2024-09-13T22:28:25.980347+0000 mgr.a (mgr.14355) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:27.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:27 smithi171 bash[25040]: cluster 2024-09-13T22:28:25.980347+0000 mgr.a (mgr.14355) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:28:28.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:29.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:29.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:29.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:29.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:29.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:29 smithi007 bash[22722]: cluster 2024-09-13T22:28:27.981155+0000 mgr.a (mgr.14355) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:29 smithi131 bash[24745]: cluster 2024-09-13T22:28:27.981155+0000 mgr.a (mgr.14355) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:29.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:29 smithi171 bash[25040]: cluster 2024-09-13T22:28:27.981155+0000 mgr.a (mgr.14355) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:30.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:30 smithi007 bash[22722]: audit 2024-09-13T22:28:28.931281+0000 mgr.a (mgr.14355) 328 : audit [DBG] from='client.20913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:30.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:30 smithi131 bash[24745]: audit 2024-09-13T22:28:28.931281+0000 mgr.a (mgr.14355) 328 : audit [DBG] from='client.20913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:30.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:30 smithi171 bash[25040]: audit 2024-09-13T22:28:28.931281+0000 mgr.a (mgr.14355) 328 : audit [DBG] from='client.20913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:31 smithi007 bash[22722]: cluster 2024-09-13T22:28:29.982117+0000 mgr.a (mgr.14355) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:31.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:31 smithi131 bash[24745]: cluster 2024-09-13T22:28:29.982117+0000 mgr.a (mgr.14355) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:31.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:31 smithi171 bash[25040]: cluster 2024-09-13T22:28:29.982117+0000 mgr.a (mgr.14355) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:28:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:33 smithi007 bash[22722]: cluster 2024-09-13T22:28:31.984437+0000 mgr.a (mgr.14355) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:28:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:33 smithi131 bash[24745]: cluster 2024-09-13T22:28:31.984437+0000 mgr.a (mgr.14355) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:28:33.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:33 smithi171 bash[25040]: cluster 2024-09-13T22:28:31.984437+0000 mgr.a (mgr.14355) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:28:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:34.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:35.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:35 smithi007 bash[22722]: cluster 2024-09-13T22:28:33.985146+0000 mgr.a (mgr.14355) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:35 smithi131 bash[24745]: cluster 2024-09-13T22:28:33.985146+0000 mgr.a (mgr.14355) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:35.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:35 smithi171 bash[25040]: cluster 2024-09-13T22:28:33.985146+0000 mgr.a (mgr.14355) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:36.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:36 smithi007 bash[22722]: audit 2024-09-13T22:28:34.707450+0000 mgr.a (mgr.14355) 332 : audit [DBG] from='client.20991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:36.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:36 smithi007 bash[22722]: cluster 2024-09-13T22:28:35.987612+0000 mgr.a (mgr.14355) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:36.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:36 smithi131 bash[24745]: audit 2024-09-13T22:28:34.707450+0000 mgr.a (mgr.14355) 332 : audit [DBG] from='client.20991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:36.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:36 smithi131 bash[24745]: cluster 2024-09-13T22:28:35.987612+0000 mgr.a (mgr.14355) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:36.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:36 smithi171 bash[25040]: audit 2024-09-13T22:28:34.707450+0000 mgr.a (mgr.14355) 332 : audit [DBG] from='client.20991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:36.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:36 smithi171 bash[25040]: cluster 2024-09-13T22:28:35.987612+0000 mgr.a (mgr.14355) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:39 smithi007 bash[22722]: cluster 2024-09-13T22:28:37.988380+0000 mgr.a (mgr.14355) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:39 smithi131 bash[24745]: cluster 2024-09-13T22:28:37.988380+0000 mgr.a (mgr.14355) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:39.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:39 smithi171 bash[25040]: cluster 2024-09-13T22:28:37.988380+0000 mgr.a (mgr.14355) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:40.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:41 smithi007 bash[22722]: cluster 2024-09-13T22:28:39.989159+0000 mgr.a (mgr.14355) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:41 smithi131 bash[24745]: cluster 2024-09-13T22:28:39.989159+0000 mgr.a (mgr.14355) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:41.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:41 smithi171 bash[25040]: cluster 2024-09-13T22:28:39.989159+0000 mgr.a (mgr.14355) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:42.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:42 smithi007 bash[22722]: audit 2024-09-13T22:28:40.488385+0000 mgr.a (mgr.14355) 336 : audit [DBG] from='client.21066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:42.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:42 smithi131 bash[24745]: audit 2024-09-13T22:28:40.488385+0000 mgr.a (mgr.14355) 336 : audit [DBG] from='client.21066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:42.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:42 smithi171 bash[25040]: audit 2024-09-13T22:28:40.488385+0000 mgr.a (mgr.14355) 336 : audit [DBG] from='client.21066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:43 smithi007 bash[22722]: cluster 2024-09-13T22:28:41.992052+0000 mgr.a (mgr.14355) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:43 smithi131 bash[24745]: cluster 2024-09-13T22:28:41.992052+0000 mgr.a (mgr.14355) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:43.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:43 smithi171 bash[25040]: cluster 2024-09-13T22:28:41.992052+0000 mgr.a (mgr.14355) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:45 smithi007 bash[22722]: cluster 2024-09-13T22:28:43.992823+0000 mgr.a (mgr.14355) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:45 smithi131 bash[24745]: cluster 2024-09-13T22:28:43.992823+0000 mgr.a (mgr.14355) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:45.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:45 smithi171 bash[25040]: cluster 2024-09-13T22:28:43.992823+0000 mgr.a (mgr.14355) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:45.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:46.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:47 smithi007 bash[22722]: cluster 2024-09-13T22:28:45.994821+0000 mgr.a (mgr.14355) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:47 smithi131 bash[24745]: cluster 2024-09-13T22:28:45.994821+0000 mgr.a (mgr.14355) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:47.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:47 smithi171 bash[25040]: cluster 2024-09-13T22:28:45.994821+0000 mgr.a (mgr.14355) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:48.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:48 smithi007 bash[22722]: audit 2024-09-13T22:28:46.248972+0000 mgr.a (mgr.14355) 340 : audit [DBG] from='client.21144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:48.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:48 smithi131 bash[24745]: audit 2024-09-13T22:28:46.248972+0000 mgr.a (mgr.14355) 340 : audit [DBG] from='client.21144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:48.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:48 smithi171 bash[25040]: audit 2024-09-13T22:28:46.248972+0000 mgr.a (mgr.14355) 340 : audit [DBG] from='client.21144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:49 smithi007 bash[22722]: cluster 2024-09-13T22:28:47.995778+0000 mgr.a (mgr.14355) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:49 smithi131 bash[24745]: cluster 2024-09-13T22:28:47.995778+0000 mgr.a (mgr.14355) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:49.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:49 smithi171 bash[25040]: cluster 2024-09-13T22:28:47.995778+0000 mgr.a (mgr.14355) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:28:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:51 smithi007 bash[22722]: cluster 2024-09-13T22:28:49.996596+0000 mgr.a (mgr.14355) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:51 smithi131 bash[24745]: cluster 2024-09-13T22:28:49.996596+0000 mgr.a (mgr.14355) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:51.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:51 smithi171 bash[25040]: cluster 2024-09-13T22:28:49.996596+0000 mgr.a (mgr.14355) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:28:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:52.428 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:52.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:53 smithi007 bash[22722]: cluster 2024-09-13T22:28:51.998779+0000 mgr.a (mgr.14355) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:53 smithi007 bash[22722]: audit 2024-09-13T22:28:52.002421+0000 mgr.a (mgr.14355) 344 : audit [DBG] from='client.21219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:53 smithi131 bash[24745]: cluster 2024-09-13T22:28:51.998779+0000 mgr.a (mgr.14355) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:53 smithi131 bash[24745]: audit 2024-09-13T22:28:52.002421+0000 mgr.a (mgr.14355) 344 : audit [DBG] from='client.21219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:53.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:53 smithi171 bash[25040]: cluster 2024-09-13T22:28:51.998779+0000 mgr.a (mgr.14355) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:53.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:53 smithi171 bash[25040]: audit 2024-09-13T22:28:52.002421+0000 mgr.a (mgr.14355) 344 : audit [DBG] from='client.21219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:55 smithi007 bash[22722]: cluster 2024-09-13T22:28:53.999660+0000 mgr.a (mgr.14355) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:55 smithi131 bash[24745]: cluster 2024-09-13T22:28:53.999660+0000 mgr.a (mgr.14355) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:55.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:55 smithi171 bash[25040]: cluster 2024-09-13T22:28:53.999660+0000 mgr.a (mgr.14355) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:28:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:28:57.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:28:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:57 smithi007 bash[22722]: cluster 2024-09-13T22:28:56.001906+0000 mgr.a (mgr.14355) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:57 smithi131 bash[24745]: cluster 2024-09-13T22:28:56.001906+0000 mgr.a (mgr.14355) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:57.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:57 smithi171 bash[25040]: cluster 2024-09-13T22:28:56.001906+0000 mgr.a (mgr.14355) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:28:58.179 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:28:58.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:28:58.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:28:58.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:28:58.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:28:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:59 smithi007 bash[22722]: audit 2024-09-13T22:28:57.764748+0000 mgr.a (mgr.14355) 347 : audit [DBG] from='client.21294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:28:59 smithi007 bash[22722]: cluster 2024-09-13T22:28:58.002574+0000 mgr.a (mgr.14355) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:59 smithi131 bash[24745]: audit 2024-09-13T22:28:57.764748+0000 mgr.a (mgr.14355) 347 : audit [DBG] from='client.21294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:28:59 smithi131 bash[24745]: cluster 2024-09-13T22:28:58.002574+0000 mgr.a (mgr.14355) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:28:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:59 smithi171 bash[25040]: audit 2024-09-13T22:28:57.764748+0000 mgr.a (mgr.14355) 347 : audit [DBG] from='client.21294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:28:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:28:59 smithi171 bash[25040]: cluster 2024-09-13T22:28:58.002574+0000 mgr.a (mgr.14355) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:01 smithi007 bash[22722]: cluster 2024-09-13T22:29:00.003427+0000 mgr.a (mgr.14355) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:01 smithi131 bash[24745]: cluster 2024-09-13T22:29:00.003427+0000 mgr.a (mgr.14355) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:01.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:01 smithi171 bash[25040]: cluster 2024-09-13T22:29:00.003427+0000 mgr.a (mgr.14355) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:03.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:03.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:03.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:03 smithi007 bash[22722]: cluster 2024-09-13T22:29:02.005778+0000 mgr.a (mgr.14355) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:03 smithi131 bash[24745]: cluster 2024-09-13T22:29:02.005778+0000 mgr.a (mgr.14355) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:03.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:03 smithi171 bash[25040]: cluster 2024-09-13T22:29:02.005778+0000 mgr.a (mgr.14355) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:03.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:03.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:05 smithi007 bash[22722]: audit 2024-09-13T22:29:03.516968+0000 mgr.a (mgr.14355) 351 : audit [DBG] from='client.21366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:05 smithi007 bash[22722]: cluster 2024-09-13T22:29:04.006722+0000 mgr.a (mgr.14355) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:05.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:05 smithi131 bash[24745]: audit 2024-09-13T22:29:03.516968+0000 mgr.a (mgr.14355) 351 : audit [DBG] from='client.21366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:05.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:05 smithi131 bash[24745]: cluster 2024-09-13T22:29:04.006722+0000 mgr.a (mgr.14355) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:05.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:05 smithi171 bash[25040]: audit 2024-09-13T22:29:03.516968+0000 mgr.a (mgr.14355) 351 : audit [DBG] from='client.21366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:05.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:05 smithi171 bash[25040]: cluster 2024-09-13T22:29:04.006722+0000 mgr.a (mgr.14355) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:07 smithi007 bash[22722]: cluster 2024-09-13T22:29:06.009044+0000 mgr.a (mgr.14355) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:07 smithi131 bash[24745]: cluster 2024-09-13T22:29:06.009044+0000 mgr.a (mgr.14355) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:07.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:07 smithi171 bash[25040]: cluster 2024-09-13T22:29:06.009044+0000 mgr.a (mgr.14355) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:08.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:09 smithi007 bash[22722]: cluster 2024-09-13T22:29:08.009959+0000 mgr.a (mgr.14355) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:09.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:09 smithi131 bash[24745]: cluster 2024-09-13T22:29:08.009959+0000 mgr.a (mgr.14355) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:09.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:09 smithi171 bash[25040]: cluster 2024-09-13T22:29:08.009959+0000 mgr.a (mgr.14355) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:09.695 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:11 smithi007 bash[22722]: audit 2024-09-13T22:29:09.289468+0000 mgr.a (mgr.14355) 355 : audit [DBG] from='client.21441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:11 smithi007 bash[22722]: cluster 2024-09-13T22:29:10.011019+0000 mgr.a (mgr.14355) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:11 smithi131 bash[24745]: audit 2024-09-13T22:29:09.289468+0000 mgr.a (mgr.14355) 355 : audit [DBG] from='client.21441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:11 smithi131 bash[24745]: cluster 2024-09-13T22:29:10.011019+0000 mgr.a (mgr.14355) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:11.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:11 smithi171 bash[25040]: audit 2024-09-13T22:29:09.289468+0000 mgr.a (mgr.14355) 355 : audit [DBG] from='client.21441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:11.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:11 smithi171 bash[25040]: cluster 2024-09-13T22:29:10.011019+0000 mgr.a (mgr.14355) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:13 smithi007 bash[22722]: cluster 2024-09-13T22:29:12.013292+0000 mgr.a (mgr.14355) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:13 smithi131 bash[24745]: cluster 2024-09-13T22:29:12.013292+0000 mgr.a (mgr.14355) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:13 smithi171 bash[25040]: cluster 2024-09-13T22:29:12.013292+0000 mgr.a (mgr.14355) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:15 smithi007 bash[22722]: cluster 2024-09-13T22:29:14.014057+0000 mgr.a (mgr.14355) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:15.474 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:15 smithi131 bash[24745]: cluster 2024-09-13T22:29:14.014057+0000 mgr.a (mgr.14355) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:15.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:15 smithi171 bash[25040]: cluster 2024-09-13T22:29:14.014057+0000 mgr.a (mgr.14355) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:16.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:16 smithi007 bash[22722]: audit 2024-09-13T22:29:15.034853+0000 mgr.a (mgr.14355) 359 : audit [DBG] from='client.21519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:16.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:16 smithi007 bash[22722]: audit 2024-09-13T22:29:15.536192+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:29:16.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:16 smithi131 bash[24745]: audit 2024-09-13T22:29:15.034853+0000 mgr.a (mgr.14355) 359 : audit [DBG] from='client.21519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:16.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:16 smithi131 bash[24745]: audit 2024-09-13T22:29:15.536192+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:29:16.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:16 smithi171 bash[25040]: audit 2024-09-13T22:29:15.034853+0000 mgr.a (mgr.14355) 359 : audit [DBG] from='client.21519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:16.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:16 smithi171 bash[25040]: audit 2024-09-13T22:29:15.536192+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:29:17.451 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22972]: debug 2024-09-13T22:29:17.100+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22972]: debug 2024-09-13T22:29:17.100+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22722]: cluster 2024-09-13T22:29:16.015708+0000 mgr.a (mgr.14355) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22722]: audit 2024-09-13T22:29:16.379285+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22722]: audit 2024-09-13T22:29:16.381185+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22722]: audit 2024-09-13T22:29:16.392281+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:29:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:17 smithi007 bash[22722]: audit 2024-09-13T22:29:16.397744+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:17 smithi131 bash[24745]: cluster 2024-09-13T22:29:16.015708+0000 mgr.a (mgr.14355) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:17 smithi131 bash[24745]: audit 2024-09-13T22:29:16.379285+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:29:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:17 smithi131 bash[24745]: audit 2024-09-13T22:29:16.381185+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:29:17.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:17 smithi131 bash[24745]: audit 2024-09-13T22:29:16.392281+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:29:17.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:17 smithi131 bash[24745]: audit 2024-09-13T22:29:16.397744+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:17 smithi171 bash[25040]: cluster 2024-09-13T22:29:16.015708+0000 mgr.a (mgr.14355) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:17 smithi171 bash[25040]: audit 2024-09-13T22:29:16.379285+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:29:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:17 smithi171 bash[25040]: audit 2024-09-13T22:29:16.381185+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:29:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:17 smithi171 bash[25040]: audit 2024-09-13T22:29:16.392281+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:29:17.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:17 smithi171 bash[25040]: audit 2024-09-13T22:29:16.397744+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:18 smithi007 bash[22722]: audit 2024-09-13T22:29:16.398977+0000 mgr.a (mgr.14355) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:18 smithi007 bash[22722]: audit 2024-09-13T22:29:17.103585+0000 mgr.a (mgr.14355) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:29:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:18 smithi007 bash[22722]: cephadm 2024-09-13T22:29:17.105109+0000 mgr.a (mgr.14355) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:29:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:18 smithi131 bash[24745]: audit 2024-09-13T22:29:16.398977+0000 mgr.a (mgr.14355) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:18 smithi131 bash[24745]: audit 2024-09-13T22:29:17.103585+0000 mgr.a (mgr.14355) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:29:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:18 smithi131 bash[24745]: cephadm 2024-09-13T22:29:17.105109+0000 mgr.a (mgr.14355) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:29:18.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:18 smithi171 bash[25040]: audit 2024-09-13T22:29:16.398977+0000 mgr.a (mgr.14355) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:29:18.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:18 smithi171 bash[25040]: audit 2024-09-13T22:29:17.103585+0000 mgr.a (mgr.14355) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:29:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:18 smithi171 bash[25040]: cephadm 2024-09-13T22:29:17.105109+0000 mgr.a (mgr.14355) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:29:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:19 smithi007 bash[22722]: cluster 2024-09-13T22:29:18.016623+0000 mgr.a (mgr.14355) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:29:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:19 smithi131 bash[24745]: cluster 2024-09-13T22:29:18.016623+0000 mgr.a (mgr.14355) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:29:19.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:19 smithi171 bash[25040]: cluster 2024-09-13T22:29:18.016623+0000 mgr.a (mgr.14355) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:29:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:20.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:21.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:21.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:21 smithi007 bash[22722]: cluster 2024-09-13T22:29:20.017407+0000 mgr.a (mgr.14355) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:29:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:21 smithi131 bash[24745]: cluster 2024-09-13T22:29:20.017407+0000 mgr.a (mgr.14355) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:29:21.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:21 smithi171 bash[25040]: cluster 2024-09-13T22:29:20.017407+0000 mgr.a (mgr.14355) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:29:22.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:22 smithi007 bash[22722]: audit 2024-09-13T22:29:20.803809+0000 mgr.a (mgr.14355) 366 : audit [DBG] from='client.21690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:22.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:22 smithi131 bash[24745]: audit 2024-09-13T22:29:20.803809+0000 mgr.a (mgr.14355) 366 : audit [DBG] from='client.21690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:22.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:22 smithi171 bash[25040]: audit 2024-09-13T22:29:20.803809+0000 mgr.a (mgr.14355) 366 : audit [DBG] from='client.21690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:23 smithi007 bash[22722]: cluster 2024-09-13T22:29:22.020161+0000 mgr.a (mgr.14355) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:23 smithi131 bash[24745]: cluster 2024-09-13T22:29:22.020161+0000 mgr.a (mgr.14355) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:23.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:23 smithi171 bash[25040]: cluster 2024-09-13T22:29:22.020161+0000 mgr.a (mgr.14355) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:24.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:24 smithi131 bash[24745]: cluster 2024-09-13T22:29:24.020986+0000 mgr.a (mgr.14355) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:29:24.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:24 smithi171 bash[25040]: cluster 2024-09-13T22:29:24.020986+0000 mgr.a (mgr.14355) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:29:24.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:24 smithi007 bash[22722]: cluster 2024-09-13T22:29:24.020986+0000 mgr.a (mgr.14355) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:29:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:26.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:26.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:26.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:27 smithi007 bash[22722]: cluster 2024-09-13T22:29:26.023106+0000 mgr.a (mgr.14355) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:27 smithi131 bash[24745]: cluster 2024-09-13T22:29:26.023106+0000 mgr.a (mgr.14355) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:27.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:27 smithi171 bash[25040]: cluster 2024-09-13T22:29:26.023106+0000 mgr.a (mgr.14355) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:28.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:28 smithi007 bash[22722]: audit 2024-09-13T22:29:26.566413+0000 mgr.a (mgr.14355) 370 : audit [DBG] from='client.21768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:28.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:28 smithi131 bash[24745]: audit 2024-09-13T22:29:26.566413+0000 mgr.a (mgr.14355) 370 : audit [DBG] from='client.21768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:28.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:28 smithi171 bash[25040]: audit 2024-09-13T22:29:26.566413+0000 mgr.a (mgr.14355) 370 : audit [DBG] from='client.21768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:29 smithi007 bash[22722]: cluster 2024-09-13T22:29:28.024057+0000 mgr.a (mgr.14355) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:29 smithi131 bash[24745]: cluster 2024-09-13T22:29:28.024057+0000 mgr.a (mgr.14355) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:29.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:29 smithi171 bash[25040]: cluster 2024-09-13T22:29:28.024057+0000 mgr.a (mgr.14355) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:31 smithi007 bash[22722]: cluster 2024-09-13T22:29:30.024996+0000 mgr.a (mgr.14355) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:31.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:31 smithi131 bash[24745]: cluster 2024-09-13T22:29:30.024996+0000 mgr.a (mgr.14355) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:31.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:31 smithi171 bash[25040]: cluster 2024-09-13T22:29:30.024996+0000 mgr.a (mgr.14355) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:31.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:32.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:32.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:32.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:32.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:32.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:33.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:33 smithi007 bash[22722]: cluster 2024-09-13T22:29:32.027031+0000 mgr.a (mgr.14355) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:33 smithi131 bash[24745]: cluster 2024-09-13T22:29:32.027031+0000 mgr.a (mgr.14355) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:33.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:33 smithi171 bash[25040]: cluster 2024-09-13T22:29:32.027031+0000 mgr.a (mgr.14355) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:29:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:34 smithi007 bash[22722]: audit 2024-09-13T22:29:32.306394+0000 mgr.a (mgr.14355) 374 : audit [DBG] from='client.21840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:34.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:34 smithi131 bash[24745]: audit 2024-09-13T22:29:32.306394+0000 mgr.a (mgr.14355) 374 : audit [DBG] from='client.21840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:34.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:34 smithi171 bash[25040]: audit 2024-09-13T22:29:32.306394+0000 mgr.a (mgr.14355) 374 : audit [DBG] from='client.21840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:35 smithi007 bash[22722]: cluster 2024-09-13T22:29:34.027897+0000 mgr.a (mgr.14355) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:35 smithi131 bash[24745]: cluster 2024-09-13T22:29:34.027897+0000 mgr.a (mgr.14355) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:35.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:35 smithi171 bash[25040]: cluster 2024-09-13T22:29:34.027897+0000 mgr.a (mgr.14355) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:37 smithi007 bash[22722]: cluster 2024-09-13T22:29:36.030164+0000 mgr.a (mgr.14355) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:37 smithi131 bash[24745]: cluster 2024-09-13T22:29:36.030164+0000 mgr.a (mgr.14355) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:37.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:37 smithi171 bash[25040]: cluster 2024-09-13T22:29:36.030164+0000 mgr.a (mgr.14355) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:38.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:38.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:39 smithi007 bash[22722]: cluster 2024-09-13T22:29:38.030669+0000 mgr.a (mgr.14355) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:39 smithi007 bash[22722]: audit 2024-09-13T22:29:38.045654+0000 mgr.a (mgr.14355) 378 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:39 smithi131 bash[24745]: cluster 2024-09-13T22:29:38.030669+0000 mgr.a (mgr.14355) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:39 smithi131 bash[24745]: audit 2024-09-13T22:29:38.045654+0000 mgr.a (mgr.14355) 378 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:39.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:39 smithi171 bash[25040]: cluster 2024-09-13T22:29:38.030669+0000 mgr.a (mgr.14355) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:39.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:39 smithi171 bash[25040]: audit 2024-09-13T22:29:38.045654+0000 mgr.a (mgr.14355) 378 : audit [DBG] from='client.21912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:41 smithi007 bash[22722]: cluster 2024-09-13T22:29:40.031506+0000 mgr.a (mgr.14355) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:41 smithi131 bash[24745]: cluster 2024-09-13T22:29:40.031506+0000 mgr.a (mgr.14355) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:41.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:41 smithi171 bash[25040]: cluster 2024-09-13T22:29:40.031506+0000 mgr.a (mgr.14355) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:43 smithi007 bash[22722]: cluster 2024-09-13T22:29:42.033790+0000 mgr.a (mgr.14355) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:43.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:43.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:43 smithi131 bash[24745]: cluster 2024-09-13T22:29:42.033790+0000 mgr.a (mgr.14355) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:43.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:43 smithi171 bash[25040]: cluster 2024-09-13T22:29:42.033790+0000 mgr.a (mgr.14355) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:44.212 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:44.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:45 smithi007 bash[22722]: audit 2024-09-13T22:29:43.805927+0000 mgr.a (mgr.14355) 381 : audit [DBG] from='client.21987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:45 smithi007 bash[22722]: cluster 2024-09-13T22:29:44.034372+0000 mgr.a (mgr.14355) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:45 smithi131 bash[24745]: audit 2024-09-13T22:29:43.805927+0000 mgr.a (mgr.14355) 381 : audit [DBG] from='client.21987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:45 smithi131 bash[24745]: cluster 2024-09-13T22:29:44.034372+0000 mgr.a (mgr.14355) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:45.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:45 smithi171 bash[25040]: audit 2024-09-13T22:29:43.805927+0000 mgr.a (mgr.14355) 381 : audit [DBG] from='client.21987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:45.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:45 smithi171 bash[25040]: cluster 2024-09-13T22:29:44.034372+0000 mgr.a (mgr.14355) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:47 smithi007 bash[22722]: cluster 2024-09-13T22:29:46.036676+0000 mgr.a (mgr.14355) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:47 smithi131 bash[24745]: cluster 2024-09-13T22:29:46.036676+0000 mgr.a (mgr.14355) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:47.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:47 smithi171 bash[25040]: cluster 2024-09-13T22:29:46.036676+0000 mgr.a (mgr.14355) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:49.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:49.214 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:49.214 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:49 smithi007 bash[22722]: cluster 2024-09-13T22:29:48.037453+0000 mgr.a (mgr.14355) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:49 smithi131 bash[24745]: cluster 2024-09-13T22:29:48.037453+0000 mgr.a (mgr.14355) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:49.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:49 smithi171 bash[25040]: cluster 2024-09-13T22:29:48.037453+0000 mgr.a (mgr.14355) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:49.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:49.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:49.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:49.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:49.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:51 smithi007 bash[22722]: audit 2024-09-13T22:29:49.552508+0000 mgr.a (mgr.14355) 385 : audit [DBG] from='client.22065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:51 smithi007 bash[22722]: cluster 2024-09-13T22:29:50.037966+0000 mgr.a (mgr.14355) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:51 smithi131 bash[24745]: audit 2024-09-13T22:29:49.552508+0000 mgr.a (mgr.14355) 385 : audit [DBG] from='client.22065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:51 smithi131 bash[24745]: cluster 2024-09-13T22:29:50.037966+0000 mgr.a (mgr.14355) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:51.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:51 smithi171 bash[25040]: audit 2024-09-13T22:29:49.552508+0000 mgr.a (mgr.14355) 385 : audit [DBG] from='client.22065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:51.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:51 smithi171 bash[25040]: cluster 2024-09-13T22:29:50.037966+0000 mgr.a (mgr.14355) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:53 smithi007 bash[22722]: cluster 2024-09-13T22:29:52.040180+0000 mgr.a (mgr.14355) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:53 smithi131 bash[24745]: cluster 2024-09-13T22:29:52.040180+0000 mgr.a (mgr.14355) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:53.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:53 smithi171 bash[25040]: cluster 2024-09-13T22:29:52.040180+0000 mgr.a (mgr.14355) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:29:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:29:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:29:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:29:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:55 smithi007 bash[22722]: cluster 2024-09-13T22:29:54.040959+0000 mgr.a (mgr.14355) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:55 smithi131 bash[24745]: cluster 2024-09-13T22:29:54.040959+0000 mgr.a (mgr.14355) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:55.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:55 smithi171 bash[25040]: cluster 2024-09-13T22:29:54.040959+0000 mgr.a (mgr.14355) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:55.719 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:29:55.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:29:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:29:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:29:55.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:29:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:57 smithi007 bash[22722]: audit 2024-09-13T22:29:55.306834+0000 mgr.a (mgr.14355) 389 : audit [DBG] from='client.22143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:57 smithi007 bash[22722]: cluster 2024-09-13T22:29:56.043704+0000 mgr.a (mgr.14355) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:57 smithi131 bash[24745]: audit 2024-09-13T22:29:55.306834+0000 mgr.a (mgr.14355) 389 : audit [DBG] from='client.22143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:57 smithi131 bash[24745]: cluster 2024-09-13T22:29:56.043704+0000 mgr.a (mgr.14355) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:57.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:57 smithi171 bash[25040]: audit 2024-09-13T22:29:55.306834+0000 mgr.a (mgr.14355) 389 : audit [DBG] from='client.22143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:29:57.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:57 smithi171 bash[25040]: cluster 2024-09-13T22:29:56.043704+0000 mgr.a (mgr.14355) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:29:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:29:59 smithi007 bash[22722]: cluster 2024-09-13T22:29:58.044502+0000 mgr.a (mgr.14355) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:29:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:29:59 smithi131 bash[24745]: cluster 2024-09-13T22:29:58.044502+0000 mgr.a (mgr.14355) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:29:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:29:59 smithi171 bash[25040]: cluster 2024-09-13T22:29:58.044502+0000 mgr.a (mgr.14355) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:00 smithi007 bash[22722]: cluster 2024-09-13T22:30:00.000111+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:00 smithi007 bash[22722]: cluster 2024-09-13T22:30:00.000148+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:00 smithi007 bash[22722]: cluster 2024-09-13T22:30:00.000165+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:00 smithi131 bash[24745]: cluster 2024-09-13T22:30:00.000111+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:00 smithi131 bash[24745]: cluster 2024-09-13T22:30:00.000148+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:00 smithi131 bash[24745]: cluster 2024-09-13T22:30:00.000165+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:00 smithi171 bash[25040]: cluster 2024-09-13T22:30:00.000111+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:00 smithi171 bash[25040]: cluster 2024-09-13T22:30:00.000148+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-13T22:30:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:00 smithi171 bash[25040]: cluster 2024-09-13T22:30:00.000165+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:00.721 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:00.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:01 smithi007 bash[22722]: cluster 2024-09-13T22:30:00.045252+0000 mgr.a (mgr.14355) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:01.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:01.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:01.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:01.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:01.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:01 smithi131 bash[24745]: cluster 2024-09-13T22:30:00.045252+0000 mgr.a (mgr.14355) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:01.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:01 smithi171 bash[25040]: cluster 2024-09-13T22:30:00.045252+0000 mgr.a (mgr.14355) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:02.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:02 smithi007 bash[22722]: audit 2024-09-13T22:30:01.055131+0000 mgr.a (mgr.14355) 393 : audit [DBG] from='client.22218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:02.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:02 smithi131 bash[24745]: audit 2024-09-13T22:30:01.055131+0000 mgr.a (mgr.14355) 393 : audit [DBG] from='client.22218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:02.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:02 smithi171 bash[25040]: audit 2024-09-13T22:30:01.055131+0000 mgr.a (mgr.14355) 393 : audit [DBG] from='client.22218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:03.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:03 smithi007 bash[22722]: cluster 2024-09-13T22:30:02.048051+0000 mgr.a (mgr.14355) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:03 smithi131 bash[24745]: cluster 2024-09-13T22:30:02.048051+0000 mgr.a (mgr.14355) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:03.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:03 smithi171 bash[25040]: cluster 2024-09-13T22:30:02.048051+0000 mgr.a (mgr.14355) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:05 smithi007 bash[22722]: cluster 2024-09-13T22:30:04.048838+0000 mgr.a (mgr.14355) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:05.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:05 smithi131 bash[24745]: cluster 2024-09-13T22:30:04.048838+0000 mgr.a (mgr.14355) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:05.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:05 smithi171 bash[25040]: cluster 2024-09-13T22:30:04.048838+0000 mgr.a (mgr.14355) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:06.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:06.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:06.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:06.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:06 smithi131 bash[24745]: cluster 2024-09-13T22:30:06.050882+0000 mgr.a (mgr.14355) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:06.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:06 smithi171 bash[25040]: cluster 2024-09-13T22:30:06.050882+0000 mgr.a (mgr.14355) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:06.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:06 smithi007 bash[22722]: cluster 2024-09-13T22:30:06.050882+0000 mgr.a (mgr.14355) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:07.205 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:07.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:07 smithi131 bash[24745]: audit 2024-09-13T22:30:06.794129+0000 mgr.a (mgr.14355) 397 : audit [DBG] from='client.22293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:07.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:07 smithi171 bash[25040]: audit 2024-09-13T22:30:06.794129+0000 mgr.a (mgr.14355) 397 : audit [DBG] from='client.22293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:07.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:07 smithi007 bash[22722]: audit 2024-09-13T22:30:06.794129+0000 mgr.a (mgr.14355) 397 : audit [DBG] from='client.22293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:08.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:08 smithi131 bash[24745]: cluster 2024-09-13T22:30:08.051775+0000 mgr.a (mgr.14355) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:08.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:08 smithi171 bash[25040]: cluster 2024-09-13T22:30:08.051775+0000 mgr.a (mgr.14355) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:08.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:08 smithi007 bash[22722]: cluster 2024-09-13T22:30:08.051775+0000 mgr.a (mgr.14355) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:11 smithi007 bash[22722]: cluster 2024-09-13T22:30:10.052679+0000 mgr.a (mgr.14355) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:11 smithi131 bash[24745]: cluster 2024-09-13T22:30:10.052679+0000 mgr.a (mgr.14355) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:11.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:11 smithi171 bash[25040]: cluster 2024-09-13T22:30:10.052679+0000 mgr.a (mgr.14355) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:12.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:12.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:12.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:12.971 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:13 smithi007 bash[22722]: cluster 2024-09-13T22:30:12.054900+0000 mgr.a (mgr.14355) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:13 smithi131 bash[24745]: cluster 2024-09-13T22:30:12.054900+0000 mgr.a (mgr.14355) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:13 smithi171 bash[25040]: cluster 2024-09-13T22:30:12.054900+0000 mgr.a (mgr.14355) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:14 smithi007 bash[22722]: audit 2024-09-13T22:30:12.542943+0000 mgr.a (mgr.14355) 401 : audit [DBG] from='client.22368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:14 smithi131 bash[24745]: audit 2024-09-13T22:30:12.542943+0000 mgr.a (mgr.14355) 401 : audit [DBG] from='client.22368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:14.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:14 smithi171 bash[25040]: audit 2024-09-13T22:30:12.542943+0000 mgr.a (mgr.14355) 401 : audit [DBG] from='client.22368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:15 smithi007 bash[22722]: cluster 2024-09-13T22:30:14.055782+0000 mgr.a (mgr.14355) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:15 smithi131 bash[24745]: cluster 2024-09-13T22:30:14.055782+0000 mgr.a (mgr.14355) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:15.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:15 smithi171 bash[25040]: cluster 2024-09-13T22:30:14.055782+0000 mgr.a (mgr.14355) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:17.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:17 smithi007 bash[22722]: cluster 2024-09-13T22:30:16.058056+0000 mgr.a (mgr.14355) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:17 smithi131 bash[24745]: cluster 2024-09-13T22:30:16.058056+0000 mgr.a (mgr.14355) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:17 smithi171 bash[25040]: cluster 2024-09-13T22:30:16.058056+0000 mgr.a (mgr.14355) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:17.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22722]: audit 2024-09-13T22:30:17.156949+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:30:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22722]: audit 2024-09-13T22:30:18.005676+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:30:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22722]: audit 2024-09-13T22:30:18.006913+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:30:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22722]: audit 2024-09-13T22:30:18.014552+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:30:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22722]: audit 2024-09-13T22:30:18.017476+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:18 smithi131 bash[24745]: audit 2024-09-13T22:30:17.156949+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:30:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:18 smithi131 bash[24745]: audit 2024-09-13T22:30:18.005676+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:30:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:18 smithi131 bash[24745]: audit 2024-09-13T22:30:18.006913+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:30:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:18 smithi131 bash[24745]: audit 2024-09-13T22:30:18.014552+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:30:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:18 smithi131 bash[24745]: audit 2024-09-13T22:30:18.017476+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:18 smithi171 bash[25040]: audit 2024-09-13T22:30:17.156949+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:30:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:18 smithi171 bash[25040]: audit 2024-09-13T22:30:18.005676+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:30:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:18 smithi171 bash[25040]: audit 2024-09-13T22:30:18.006913+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:30:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:18 smithi171 bash[25040]: audit 2024-09-13T22:30:18.014552+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:30:18.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:18 smithi171 bash[25040]: audit 2024-09-13T22:30:18.017476+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:19.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:19.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:19.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:19.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:19.135 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22972]: debug 2024-09-13T22:30:18.723+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:19.135 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:30:18 smithi007 bash[22972]: debug 2024-09-13T22:30:18.731+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:19 smithi007 bash[22722]: audit 2024-09-13T22:30:18.019624+0000 mgr.a (mgr.14355) 404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:19.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:19 smithi007 bash[22722]: cluster 2024-09-13T22:30:18.058810+0000 mgr.a (mgr.14355) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:19 smithi131 bash[24745]: audit 2024-09-13T22:30:18.019624+0000 mgr.a (mgr.14355) 404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:19 smithi131 bash[24745]: cluster 2024-09-13T22:30:18.058810+0000 mgr.a (mgr.14355) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:19 smithi171 bash[25040]: audit 2024-09-13T22:30:18.019624+0000 mgr.a (mgr.14355) 404 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:30:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:19 smithi171 bash[25040]: cluster 2024-09-13T22:30:18.058810+0000 mgr.a (mgr.14355) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:20.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:20 smithi007 bash[22722]: audit 2024-09-13T22:30:18.335110+0000 mgr.a (mgr.14355) 406 : audit [DBG] from='client.22446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:20 smithi007 bash[22722]: audit 2024-09-13T22:30:18.726806+0000 mgr.a (mgr.14355) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:30:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:20 smithi007 bash[22722]: cephadm 2024-09-13T22:30:18.737980+0000 mgr.a (mgr.14355) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:20 smithi131 bash[24745]: audit 2024-09-13T22:30:18.335110+0000 mgr.a (mgr.14355) 406 : audit [DBG] from='client.22446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:20 smithi131 bash[24745]: audit 2024-09-13T22:30:18.726806+0000 mgr.a (mgr.14355) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:30:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:20 smithi131 bash[24745]: cephadm 2024-09-13T22:30:18.737980+0000 mgr.a (mgr.14355) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:20 smithi171 bash[25040]: audit 2024-09-13T22:30:18.335110+0000 mgr.a (mgr.14355) 406 : audit [DBG] from='client.22446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:20 smithi171 bash[25040]: audit 2024-09-13T22:30:18.726806+0000 mgr.a (mgr.14355) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:30:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:20 smithi171 bash[25040]: cephadm 2024-09-13T22:30:18.737980+0000 mgr.a (mgr.14355) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:30:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:21 smithi007 bash[22722]: cluster 2024-09-13T22:30:20.059731+0000 mgr.a (mgr.14355) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:21 smithi131 bash[24745]: cluster 2024-09-13T22:30:20.059731+0000 mgr.a (mgr.14355) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:21 smithi171 bash[25040]: cluster 2024-09-13T22:30:20.059731+0000 mgr.a (mgr.14355) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:23 smithi007 bash[22722]: cluster 2024-09-13T22:30:22.061992+0000 mgr.a (mgr.14355) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:23 smithi131 bash[24745]: cluster 2024-09-13T22:30:22.061992+0000 mgr.a (mgr.14355) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:23.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:23 smithi171 bash[25040]: cluster 2024-09-13T22:30:22.061992+0000 mgr.a (mgr.14355) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:24.906 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:24.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:25 smithi007 bash[22722]: cluster 2024-09-13T22:30:24.062790+0000 mgr.a (mgr.14355) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:25 smithi131 bash[24745]: cluster 2024-09-13T22:30:24.062790+0000 mgr.a (mgr.14355) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:25.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:25 smithi171 bash[25040]: cluster 2024-09-13T22:30:24.062790+0000 mgr.a (mgr.14355) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:26.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:26 smithi007 bash[22722]: audit 2024-09-13T22:30:24.466525+0000 mgr.a (mgr.14355) 412 : audit [DBG] from='client.22626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:26.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:26 smithi131 bash[24745]: audit 2024-09-13T22:30:24.466525+0000 mgr.a (mgr.14355) 412 : audit [DBG] from='client.22626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:26.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:26 smithi171 bash[25040]: audit 2024-09-13T22:30:24.466525+0000 mgr.a (mgr.14355) 412 : audit [DBG] from='client.22626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:27 smithi007 bash[22722]: cluster 2024-09-13T22:30:26.065130+0000 mgr.a (mgr.14355) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:27 smithi131 bash[24745]: cluster 2024-09-13T22:30:26.065130+0000 mgr.a (mgr.14355) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:27.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:27 smithi171 bash[25040]: cluster 2024-09-13T22:30:26.065130+0000 mgr.a (mgr.14355) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:29 smithi007 bash[22722]: cluster 2024-09-13T22:30:28.065912+0000 mgr.a (mgr.14355) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:29 smithi131 bash[24745]: cluster 2024-09-13T22:30:28.065912+0000 mgr.a (mgr.14355) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:29.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:29 smithi171 bash[25040]: cluster 2024-09-13T22:30:28.065912+0000 mgr.a (mgr.14355) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:29.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:29.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:30.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:31 smithi007 bash[22722]: cluster 2024-09-13T22:30:30.066415+0000 mgr.a (mgr.14355) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:31.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:31 smithi131 bash[24745]: cluster 2024-09-13T22:30:30.066415+0000 mgr.a (mgr.14355) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:31.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:31 smithi171 bash[25040]: cluster 2024-09-13T22:30:30.066415+0000 mgr.a (mgr.14355) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:32.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:32 smithi007 bash[22722]: audit 2024-09-13T22:30:30.240363+0000 mgr.a (mgr.14355) 416 : audit [DBG] from='client.22698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:32.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:32 smithi131 bash[24745]: audit 2024-09-13T22:30:30.240363+0000 mgr.a (mgr.14355) 416 : audit [DBG] from='client.22698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:32.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:32 smithi171 bash[25040]: audit 2024-09-13T22:30:30.240363+0000 mgr.a (mgr.14355) 416 : audit [DBG] from='client.22698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:33 smithi007 bash[22722]: cluster 2024-09-13T22:30:32.069089+0000 mgr.a (mgr.14355) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:33 smithi131 bash[24745]: cluster 2024-09-13T22:30:32.069089+0000 mgr.a (mgr.14355) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:33.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:33 smithi171 bash[25040]: cluster 2024-09-13T22:30:32.069089+0000 mgr.a (mgr.14355) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:30:34.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:34 smithi131 bash[24745]: cluster 2024-09-13T22:30:34.069840+0000 mgr.a (mgr.14355) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:34.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:34 smithi171 bash[25040]: cluster 2024-09-13T22:30:34.069840+0000 mgr.a (mgr.14355) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:34.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:34 smithi007 bash[22722]: cluster 2024-09-13T22:30:34.069840+0000 mgr.a (mgr.14355) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:30:35.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:35.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:35.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:36.403 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:37 smithi007 bash[22722]: audit 2024-09-13T22:30:35.981648+0000 mgr.a (mgr.14355) 419 : audit [DBG] from='client.22776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:37 smithi007 bash[22722]: cluster 2024-09-13T22:30:36.071167+0000 mgr.a (mgr.14355) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:37 smithi131 bash[24745]: audit 2024-09-13T22:30:35.981648+0000 mgr.a (mgr.14355) 419 : audit [DBG] from='client.22776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:37 smithi131 bash[24745]: cluster 2024-09-13T22:30:36.071167+0000 mgr.a (mgr.14355) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:37.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:37 smithi171 bash[25040]: audit 2024-09-13T22:30:35.981648+0000 mgr.a (mgr.14355) 419 : audit [DBG] from='client.22776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:37.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:37 smithi171 bash[25040]: cluster 2024-09-13T22:30:36.071167+0000 mgr.a (mgr.14355) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:39 smithi007 bash[22722]: cluster 2024-09-13T22:30:38.072023+0000 mgr.a (mgr.14355) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:39 smithi131 bash[24745]: cluster 2024-09-13T22:30:38.072023+0000 mgr.a (mgr.14355) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:39.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:39 smithi171 bash[25040]: cluster 2024-09-13T22:30:38.072023+0000 mgr.a (mgr.14355) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:41.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:41.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:41 smithi007 bash[22722]: cluster 2024-09-13T22:30:40.072790+0000 mgr.a (mgr.14355) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:41 smithi131 bash[24745]: cluster 2024-09-13T22:30:40.072790+0000 mgr.a (mgr.14355) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:41.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:41 smithi171 bash[25040]: cluster 2024-09-13T22:30:40.072790+0000 mgr.a (mgr.14355) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:30:42.171 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:42.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:43 smithi007 bash[22722]: audit 2024-09-13T22:30:41.745607+0000 mgr.a (mgr.14355) 423 : audit [DBG] from='client.22854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:43 smithi007 bash[22722]: cluster 2024-09-13T22:30:42.075825+0000 mgr.a (mgr.14355) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:43 smithi131 bash[24745]: audit 2024-09-13T22:30:41.745607+0000 mgr.a (mgr.14355) 423 : audit [DBG] from='client.22854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:43 smithi131 bash[24745]: cluster 2024-09-13T22:30:42.075825+0000 mgr.a (mgr.14355) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:43.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:43 smithi171 bash[25040]: audit 2024-09-13T22:30:41.745607+0000 mgr.a (mgr.14355) 423 : audit [DBG] from='client.22854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:43.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:43 smithi171 bash[25040]: cluster 2024-09-13T22:30:42.075825+0000 mgr.a (mgr.14355) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:45 smithi007 bash[22722]: cluster 2024-09-13T22:30:44.076590+0000 mgr.a (mgr.14355) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:45 smithi131 bash[24745]: cluster 2024-09-13T22:30:44.076590+0000 mgr.a (mgr.14355) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:45.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:45 smithi171 bash[25040]: cluster 2024-09-13T22:30:44.076590+0000 mgr.a (mgr.14355) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:47.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:47 smithi007 bash[22722]: cluster 2024-09-13T22:30:46.078604+0000 mgr.a (mgr.14355) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:47 smithi131 bash[24745]: cluster 2024-09-13T22:30:46.078604+0000 mgr.a (mgr.14355) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:47.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:47 smithi171 bash[25040]: cluster 2024-09-13T22:30:46.078604+0000 mgr.a (mgr.14355) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:47.914 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:47.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:47.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:47.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:47.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:49 smithi007 bash[22722]: audit 2024-09-13T22:30:47.508557+0000 mgr.a (mgr.14355) 427 : audit [DBG] from='client.22929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:49.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:49 smithi007 bash[22722]: cluster 2024-09-13T22:30:48.079493+0000 mgr.a (mgr.14355) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:49 smithi131 bash[24745]: audit 2024-09-13T22:30:47.508557+0000 mgr.a (mgr.14355) 427 : audit [DBG] from='client.22929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:49 smithi131 bash[24745]: cluster 2024-09-13T22:30:48.079493+0000 mgr.a (mgr.14355) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:49.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:49 smithi171 bash[25040]: audit 2024-09-13T22:30:47.508557+0000 mgr.a (mgr.14355) 427 : audit [DBG] from='client.22929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:49.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:49 smithi171 bash[25040]: cluster 2024-09-13T22:30:48.079493+0000 mgr.a (mgr.14355) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:51 smithi007 bash[22722]: cluster 2024-09-13T22:30:50.080286+0000 mgr.a (mgr.14355) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:51 smithi131 bash[24745]: cluster 2024-09-13T22:30:50.080286+0000 mgr.a (mgr.14355) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:51.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:51 smithi171 bash[25040]: cluster 2024-09-13T22:30:50.080286+0000 mgr.a (mgr.14355) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:52.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:53.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:53 smithi007 bash[22722]: cluster 2024-09-13T22:30:52.082573+0000 mgr.a (mgr.14355) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:53.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:53 smithi131 bash[24745]: cluster 2024-09-13T22:30:52.082573+0000 mgr.a (mgr.14355) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:53.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:53 smithi171 bash[25040]: cluster 2024-09-13T22:30:52.082573+0000 mgr.a (mgr.14355) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:53.641 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:53.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:53.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:53.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:53.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:55.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:55 smithi007 bash[22722]: audit 2024-09-13T22:30:53.246729+0000 mgr.a (mgr.14355) 431 : audit [DBG] from='client.23004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:55.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:55 smithi007 bash[22722]: cluster 2024-09-13T22:30:54.083442+0000 mgr.a (mgr.14355) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:55 smithi131 bash[24745]: audit 2024-09-13T22:30:53.246729+0000 mgr.a (mgr.14355) 431 : audit [DBG] from='client.23004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:55 smithi131 bash[24745]: cluster 2024-09-13T22:30:54.083442+0000 mgr.a (mgr.14355) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:55.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:55 smithi171 bash[25040]: audit 2024-09-13T22:30:53.246729+0000 mgr.a (mgr.14355) 431 : audit [DBG] from='client.23004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:30:55.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:55 smithi171 bash[25040]: cluster 2024-09-13T22:30:54.083442+0000 mgr.a (mgr.14355) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:57 smithi007 bash[22722]: cluster 2024-09-13T22:30:56.085676+0000 mgr.a (mgr.14355) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:57 smithi131 bash[24745]: cluster 2024-09-13T22:30:56.085676+0000 mgr.a (mgr.14355) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:57.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:57 smithi171 bash[25040]: cluster 2024-09-13T22:30:56.085676+0000 mgr.a (mgr.14355) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:30:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:30:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:30:58.644 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:30:59.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:30:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:30:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:30:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:30:59.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:30:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:30:59 smithi007 bash[22722]: cluster 2024-09-13T22:30:58.086426+0000 mgr.a (mgr.14355) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:30:59 smithi131 bash[24745]: cluster 2024-09-13T22:30:58.086426+0000 mgr.a (mgr.14355) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:30:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:30:59 smithi171 bash[25040]: cluster 2024-09-13T22:30:58.086426+0000 mgr.a (mgr.14355) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:00 smithi007 bash[22722]: audit 2024-09-13T22:30:58.977521+0000 mgr.a (mgr.14355) 435 : audit [DBG] from='client.23082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:00 smithi131 bash[24745]: audit 2024-09-13T22:30:58.977521+0000 mgr.a (mgr.14355) 435 : audit [DBG] from='client.23082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:00.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:00 smithi171 bash[25040]: audit 2024-09-13T22:30:58.977521+0000 mgr.a (mgr.14355) 435 : audit [DBG] from='client.23082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:01.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:01 smithi007 bash[22722]: cluster 2024-09-13T22:31:00.087391+0000 mgr.a (mgr.14355) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:01 smithi131 bash[24745]: cluster 2024-09-13T22:31:00.087391+0000 mgr.a (mgr.14355) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:01.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:01 smithi171 bash[25040]: cluster 2024-09-13T22:31:00.087391+0000 mgr.a (mgr.14355) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:03.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:03 smithi007 bash[22722]: cluster 2024-09-13T22:31:02.089774+0000 mgr.a (mgr.14355) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:03 smithi131 bash[24745]: cluster 2024-09-13T22:31:02.089774+0000 mgr.a (mgr.14355) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:03.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:03 smithi171 bash[25040]: cluster 2024-09-13T22:31:02.089774+0000 mgr.a (mgr.14355) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:05.158 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:05.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:05.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:05 smithi007 bash[22722]: cluster 2024-09-13T22:31:04.090724+0000 mgr.a (mgr.14355) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:05.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:05 smithi131 bash[24745]: cluster 2024-09-13T22:31:04.090724+0000 mgr.a (mgr.14355) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:05.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:05 smithi171 bash[25040]: cluster 2024-09-13T22:31:04.090724+0000 mgr.a (mgr.14355) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:06.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:06 smithi007 bash[22722]: audit 2024-09-13T22:31:04.739039+0000 mgr.a (mgr.14355) 439 : audit [DBG] from='client.23154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:06.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:06 smithi131 bash[24745]: audit 2024-09-13T22:31:04.739039+0000 mgr.a (mgr.14355) 439 : audit [DBG] from='client.23154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:06.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:06 smithi171 bash[25040]: audit 2024-09-13T22:31:04.739039+0000 mgr.a (mgr.14355) 439 : audit [DBG] from='client.23154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:07.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:07 smithi007 bash[22722]: cluster 2024-09-13T22:31:06.093169+0000 mgr.a (mgr.14355) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:07 smithi131 bash[24745]: cluster 2024-09-13T22:31:06.093169+0000 mgr.a (mgr.14355) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:07.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:07 smithi171 bash[25040]: cluster 2024-09-13T22:31:06.093169+0000 mgr.a (mgr.14355) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:08.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:08 smithi131 bash[24745]: cluster 2024-09-13T22:31:08.093936+0000 mgr.a (mgr.14355) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:08.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:08 smithi171 bash[25040]: cluster 2024-09-13T22:31:08.093936+0000 mgr.a (mgr.14355) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:08.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:08 smithi007 bash[22722]: cluster 2024-09-13T22:31:08.093936+0000 mgr.a (mgr.14355) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:10.936 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:11.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:11 smithi007 bash[22722]: cluster 2024-09-13T22:31:10.094692+0000 mgr.a (mgr.14355) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:11.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:11 smithi131 bash[24745]: cluster 2024-09-13T22:31:10.094692+0000 mgr.a (mgr.14355) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:11.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:11 smithi171 bash[25040]: cluster 2024-09-13T22:31:10.094692+0000 mgr.a (mgr.14355) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:12.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:12 smithi007 bash[22722]: audit 2024-09-13T22:31:10.498057+0000 mgr.a (mgr.14355) 443 : audit [DBG] from='client.23229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:12.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:12 smithi131 bash[24745]: audit 2024-09-13T22:31:10.498057+0000 mgr.a (mgr.14355) 443 : audit [DBG] from='client.23229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:12.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:12 smithi171 bash[25040]: audit 2024-09-13T22:31:10.498057+0000 mgr.a (mgr.14355) 443 : audit [DBG] from='client.23229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:13.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:13 smithi007 bash[22722]: cluster 2024-09-13T22:31:12.097296+0000 mgr.a (mgr.14355) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:13.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:13 smithi131 bash[24745]: cluster 2024-09-13T22:31:12.097296+0000 mgr.a (mgr.14355) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:13 smithi171 bash[25040]: cluster 2024-09-13T22:31:12.097296+0000 mgr.a (mgr.14355) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:15 smithi007 bash[22722]: cluster 2024-09-13T22:31:14.098060+0000 mgr.a (mgr.14355) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:15 smithi131 bash[24745]: cluster 2024-09-13T22:31:14.098060+0000 mgr.a (mgr.14355) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:15 smithi171 bash[25040]: cluster 2024-09-13T22:31:14.098060+0000 mgr.a (mgr.14355) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:15.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:16.715 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:16.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:16.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:16.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:16.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:17 smithi007 bash[22722]: cluster 2024-09-13T22:31:16.099338+0000 mgr.a (mgr.14355) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:17 smithi131 bash[24745]: cluster 2024-09-13T22:31:16.099338+0000 mgr.a (mgr.14355) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:17 smithi171 bash[25040]: cluster 2024-09-13T22:31:16.099338+0000 mgr.a (mgr.14355) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:18 smithi007 bash[22722]: audit 2024-09-13T22:31:16.278740+0000 mgr.a (mgr.14355) 447 : audit [DBG] from='client.23304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:18 smithi131 bash[24745]: audit 2024-09-13T22:31:16.278740+0000 mgr.a (mgr.14355) 447 : audit [DBG] from='client.23304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:18.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:18 smithi171 bash[25040]: audit 2024-09-13T22:31:16.278740+0000 mgr.a (mgr.14355) 447 : audit [DBG] from='client.23304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:19.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:19 smithi007 bash[22722]: cluster 2024-09-13T22:31:18.100175+0000 mgr.a (mgr.14355) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:19.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:19 smithi007 bash[22722]: audit 2024-09-13T22:31:18.790391+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:31:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:19 smithi131 bash[24745]: cluster 2024-09-13T22:31:18.100175+0000 mgr.a (mgr.14355) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:19.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:19 smithi131 bash[24745]: audit 2024-09-13T22:31:18.790391+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:31:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:19 smithi171 bash[25040]: cluster 2024-09-13T22:31:18.100175+0000 mgr.a (mgr.14355) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:19.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:19 smithi171 bash[25040]: audit 2024-09-13T22:31:18.790391+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22972]: debug 2024-09-13T22:31:20.370+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22972]: debug 2024-09-13T22:31:20.374+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22722]: audit 2024-09-13T22:31:19.638822+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22722]: audit 2024-09-13T22:31:19.640495+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22722]: audit 2024-09-13T22:31:19.649836+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:31:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:20 smithi007 bash[22722]: audit 2024-09-13T22:31:19.652458+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:20 smithi131 bash[24745]: audit 2024-09-13T22:31:19.638822+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:31:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:20 smithi131 bash[24745]: audit 2024-09-13T22:31:19.640495+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:31:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:20 smithi131 bash[24745]: audit 2024-09-13T22:31:19.649836+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:31:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:20 smithi131 bash[24745]: audit 2024-09-13T22:31:19.652458+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:20 smithi171 bash[25040]: audit 2024-09-13T22:31:19.638822+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:31:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:20 smithi171 bash[25040]: audit 2024-09-13T22:31:19.640495+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:31:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:20 smithi171 bash[25040]: audit 2024-09-13T22:31:19.649836+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:31:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:20 smithi171 bash[25040]: audit 2024-09-13T22:31:19.652458+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:21 smithi007 bash[22722]: audit 2024-09-13T22:31:19.653578+0000 mgr.a (mgr.14355) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:21 smithi007 bash[22722]: cluster 2024-09-13T22:31:20.100777+0000 mgr.a (mgr.14355) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:31:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:21 smithi131 bash[24745]: audit 2024-09-13T22:31:19.653578+0000 mgr.a (mgr.14355) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:21 smithi131 bash[24745]: cluster 2024-09-13T22:31:20.100777+0000 mgr.a (mgr.14355) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:31:21.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:21 smithi171 bash[25040]: audit 2024-09-13T22:31:19.653578+0000 mgr.a (mgr.14355) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:31:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:21 smithi171 bash[25040]: cluster 2024-09-13T22:31:20.100777+0000 mgr.a (mgr.14355) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:31:21.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:21.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:22.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:22 smithi007 bash[22722]: audit 2024-09-13T22:31:20.377374+0000 mgr.a (mgr.14355) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:31:22.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:22 smithi007 bash[22722]: cephadm 2024-09-13T22:31:20.378529+0000 mgr.a (mgr.14355) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:31:22.480 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:22.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:22 smithi131 bash[24745]: audit 2024-09-13T22:31:20.377374+0000 mgr.a (mgr.14355) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:31:22.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:22 smithi131 bash[24745]: cephadm 2024-09-13T22:31:20.378529+0000 mgr.a (mgr.14355) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:31:22.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:22 smithi171 bash[25040]: audit 2024-09-13T22:31:20.377374+0000 mgr.a (mgr.14355) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:31:22.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:22 smithi171 bash[25040]: cephadm 2024-09-13T22:31:20.378529+0000 mgr.a (mgr.14355) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:31:23.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:23 smithi007 bash[22722]: audit 2024-09-13T22:31:22.057883+0000 mgr.a (mgr.14355) 453 : audit [DBG] from='client.23490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:23.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:23 smithi007 bash[22722]: cluster 2024-09-13T22:31:22.103002+0000 mgr.a (mgr.14355) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:23 smithi131 bash[24745]: audit 2024-09-13T22:31:22.057883+0000 mgr.a (mgr.14355) 453 : audit [DBG] from='client.23490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:23.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:23 smithi131 bash[24745]: cluster 2024-09-13T22:31:22.103002+0000 mgr.a (mgr.14355) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:23.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:23 smithi171 bash[25040]: audit 2024-09-13T22:31:22.057883+0000 mgr.a (mgr.14355) 453 : audit [DBG] from='client.23490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:23.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:23 smithi171 bash[25040]: cluster 2024-09-13T22:31:22.103002+0000 mgr.a (mgr.14355) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:25.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:25 smithi007 bash[22722]: cluster 2024-09-13T22:31:24.103873+0000 mgr.a (mgr.14355) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:25.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:25 smithi131 bash[24745]: cluster 2024-09-13T22:31:24.103873+0000 mgr.a (mgr.14355) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:25.551 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:25 smithi171 bash[25040]: cluster 2024-09-13T22:31:24.103873+0000 mgr.a (mgr.14355) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:31:26.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:26 smithi131 bash[24745]: cluster 2024-09-13T22:31:26.106109+0000 mgr.a (mgr.14355) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:26.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:26 smithi171 bash[25040]: cluster 2024-09-13T22:31:26.106109+0000 mgr.a (mgr.14355) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:26.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:26 smithi007 bash[22722]: cluster 2024-09-13T22:31:26.106109+0000 mgr.a (mgr.14355) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:27.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:27.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:27.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:28.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:28.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:28.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:28.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:28.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:29 smithi007 bash[22722]: audit 2024-09-13T22:31:27.816116+0000 mgr.a (mgr.14355) 457 : audit [DBG] from='client.23568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:29.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:29 smithi007 bash[22722]: cluster 2024-09-13T22:31:28.106772+0000 mgr.a (mgr.14355) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:29 smithi131 bash[24745]: audit 2024-09-13T22:31:27.816116+0000 mgr.a (mgr.14355) 457 : audit [DBG] from='client.23568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:29.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:29 smithi131 bash[24745]: cluster 2024-09-13T22:31:28.106772+0000 mgr.a (mgr.14355) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:29.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:29 smithi171 bash[25040]: audit 2024-09-13T22:31:27.816116+0000 mgr.a (mgr.14355) 457 : audit [DBG] from='client.23568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:29.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:29 smithi171 bash[25040]: cluster 2024-09-13T22:31:28.106772+0000 mgr.a (mgr.14355) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:31 smithi007 bash[22722]: cluster 2024-09-13T22:31:30.107611+0000 mgr.a (mgr.14355) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:31.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:31 smithi131 bash[24745]: cluster 2024-09-13T22:31:30.107611+0000 mgr.a (mgr.14355) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:31.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:31 smithi171 bash[25040]: cluster 2024-09-13T22:31:30.107611+0000 mgr.a (mgr.14355) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:33.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:33.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:33.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:33 smithi007 bash[22722]: cluster 2024-09-13T22:31:32.109837+0000 mgr.a (mgr.14355) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:33 smithi131 bash[24745]: cluster 2024-09-13T22:31:32.109837+0000 mgr.a (mgr.14355) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:33.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:33 smithi171 bash[25040]: cluster 2024-09-13T22:31:32.109837+0000 mgr.a (mgr.14355) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:31:34.011 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:35 smithi007 bash[22722]: audit 2024-09-13T22:31:33.581160+0000 mgr.a (mgr.14355) 461 : audit [DBG] from='client.23646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:35.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:35 smithi007 bash[22722]: cluster 2024-09-13T22:31:34.110363+0000 mgr.a (mgr.14355) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:35 smithi131 bash[24745]: audit 2024-09-13T22:31:33.581160+0000 mgr.a (mgr.14355) 461 : audit [DBG] from='client.23646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:35.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:35 smithi131 bash[24745]: cluster 2024-09-13T22:31:34.110363+0000 mgr.a (mgr.14355) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:35.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:35 smithi171 bash[25040]: audit 2024-09-13T22:31:33.581160+0000 mgr.a (mgr.14355) 461 : audit [DBG] from='client.23646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:35.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:35 smithi171 bash[25040]: cluster 2024-09-13T22:31:34.110363+0000 mgr.a (mgr.14355) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:37 smithi007 bash[22722]: cluster 2024-09-13T22:31:36.112500+0000 mgr.a (mgr.14355) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:37.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:37 smithi131 bash[24745]: cluster 2024-09-13T22:31:36.112500+0000 mgr.a (mgr.14355) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:37.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:37 smithi171 bash[25040]: cluster 2024-09-13T22:31:36.112500+0000 mgr.a (mgr.14355) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:31:39.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:39.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:39.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:39 smithi007 bash[22722]: cluster 2024-09-13T22:31:38.113230+0000 mgr.a (mgr.14355) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:39 smithi131 bash[24745]: cluster 2024-09-13T22:31:38.113230+0000 mgr.a (mgr.14355) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:39.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:39 smithi171 bash[25040]: cluster 2024-09-13T22:31:38.113230+0000 mgr.a (mgr.14355) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:39.778 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:39.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:39.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:39.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:39.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:41 smithi007 bash[22722]: audit 2024-09-13T22:31:39.353174+0000 mgr.a (mgr.14355) 465 : audit [DBG] from='client.23724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:41.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:41 smithi007 bash[22722]: cluster 2024-09-13T22:31:40.114032+0000 mgr.a (mgr.14355) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:41 smithi131 bash[24745]: audit 2024-09-13T22:31:39.353174+0000 mgr.a (mgr.14355) 465 : audit [DBG] from='client.23724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:41 smithi131 bash[24745]: cluster 2024-09-13T22:31:40.114032+0000 mgr.a (mgr.14355) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:41.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:41 smithi171 bash[25040]: audit 2024-09-13T22:31:39.353174+0000 mgr.a (mgr.14355) 465 : audit [DBG] from='client.23724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:41.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:41 smithi171 bash[25040]: cluster 2024-09-13T22:31:40.114032+0000 mgr.a (mgr.14355) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:43 smithi007 bash[22722]: cluster 2024-09-13T22:31:42.116284+0000 mgr.a (mgr.14355) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:43.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:43 smithi131 bash[24745]: cluster 2024-09-13T22:31:42.116284+0000 mgr.a (mgr.14355) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:43.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:43 smithi171 bash[25040]: cluster 2024-09-13T22:31:42.116284+0000 mgr.a (mgr.14355) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:31:44.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:44.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:45.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:45 smithi007 bash[22722]: cluster 2024-09-13T22:31:44.117084+0000 mgr.a (mgr.14355) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:45.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:45.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:45.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:45.493 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:45.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:45 smithi131 bash[24745]: cluster 2024-09-13T22:31:44.117084+0000 mgr.a (mgr.14355) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:45.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:45 smithi171 bash[25040]: cluster 2024-09-13T22:31:44.117084+0000 mgr.a (mgr.14355) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:46.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:46 smithi007 bash[22722]: audit 2024-09-13T22:31:45.104785+0000 mgr.a (mgr.14355) 469 : audit [DBG] from='client.23802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:46.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:46 smithi131 bash[24745]: audit 2024-09-13T22:31:45.104785+0000 mgr.a (mgr.14355) 469 : audit [DBG] from='client.23802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:46.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:46 smithi171 bash[25040]: audit 2024-09-13T22:31:45.104785+0000 mgr.a (mgr.14355) 469 : audit [DBG] from='client.23802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:47.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:47 smithi007 bash[22722]: cluster 2024-09-13T22:31:46.120042+0000 mgr.a (mgr.14355) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:47 smithi131 bash[24745]: cluster 2024-09-13T22:31:46.120042+0000 mgr.a (mgr.14355) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:47.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:47 smithi171 bash[25040]: cluster 2024-09-13T22:31:46.120042+0000 mgr.a (mgr.14355) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:49.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:49 smithi007 bash[22722]: cluster 2024-09-13T22:31:48.121026+0000 mgr.a (mgr.14355) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:49.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:49 smithi131 bash[24745]: cluster 2024-09-13T22:31:48.121026+0000 mgr.a (mgr.14355) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:49.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:49 smithi171 bash[25040]: cluster 2024-09-13T22:31:48.121026+0000 mgr.a (mgr.14355) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:50.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:50.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:50 smithi131 bash[24745]: cluster 2024-09-13T22:31:50.121936+0000 mgr.a (mgr.14355) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:50.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:50 smithi171 bash[25040]: cluster 2024-09-13T22:31:50.121936+0000 mgr.a (mgr.14355) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:50.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:50 smithi007 bash[22722]: cluster 2024-09-13T22:31:50.121936+0000 mgr.a (mgr.14355) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:51.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:51.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:51.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:51.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:51.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:51.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:51 smithi131 bash[24745]: audit 2024-09-13T22:31:50.837062+0000 mgr.a (mgr.14355) 473 : audit [DBG] from='client.23877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:51.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:51 smithi171 bash[25040]: audit 2024-09-13T22:31:50.837062+0000 mgr.a (mgr.14355) 473 : audit [DBG] from='client.23877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:51.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:51 smithi007 bash[22722]: audit 2024-09-13T22:31:50.837062+0000 mgr.a (mgr.14355) 473 : audit [DBG] from='client.23877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:52.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:52 smithi131 bash[24745]: cluster 2024-09-13T22:31:52.124754+0000 mgr.a (mgr.14355) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:52.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:52 smithi171 bash[25040]: cluster 2024-09-13T22:31:52.124754+0000 mgr.a (mgr.14355) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:52.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:52 smithi007 bash[22722]: cluster 2024-09-13T22:31:52.124754+0000 mgr.a (mgr.14355) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:55.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:55 smithi007 bash[22722]: cluster 2024-09-13T22:31:54.125490+0000 mgr.a (mgr.14355) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:55 smithi131 bash[24745]: cluster 2024-09-13T22:31:54.125490+0000 mgr.a (mgr.14355) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:55.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:55 smithi171 bash[25040]: cluster 2024-09-13T22:31:54.125490+0000 mgr.a (mgr.14355) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:31:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:31:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:31:56.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:31:57.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:31:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:31:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:31:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:31:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:31:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:57 smithi007 bash[22722]: cluster 2024-09-13T22:31:56.127502+0000 mgr.a (mgr.14355) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:57.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:57 smithi131 bash[24745]: cluster 2024-09-13T22:31:56.127502+0000 mgr.a (mgr.14355) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:57.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:57 smithi171 bash[25040]: cluster 2024-09-13T22:31:56.127502+0000 mgr.a (mgr.14355) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:58.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:58 smithi007 bash[22722]: audit 2024-09-13T22:31:56.604097+0000 mgr.a (mgr.14355) 477 : audit [DBG] from='client.23955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:58.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:58 smithi131 bash[24745]: audit 2024-09-13T22:31:56.604097+0000 mgr.a (mgr.14355) 477 : audit [DBG] from='client.23955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:58.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:58 smithi171 bash[25040]: audit 2024-09-13T22:31:56.604097+0000 mgr.a (mgr.14355) 477 : audit [DBG] from='client.23955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:31:59.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:31:59 smithi007 bash[22722]: cluster 2024-09-13T22:31:58.128557+0000 mgr.a (mgr.14355) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:59.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:31:59 smithi131 bash[24745]: cluster 2024-09-13T22:31:58.128557+0000 mgr.a (mgr.14355) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:31:59.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:31:59 smithi171 bash[25040]: cluster 2024-09-13T22:31:58.128557+0000 mgr.a (mgr.14355) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:01.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:01 smithi007 bash[22722]: cluster 2024-09-13T22:32:00.129471+0000 mgr.a (mgr.14355) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:01.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:01 smithi131 bash[24745]: cluster 2024-09-13T22:32:00.129471+0000 mgr.a (mgr.14355) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:01.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:01 smithi171 bash[25040]: cluster 2024-09-13T22:32:00.129471+0000 mgr.a (mgr.14355) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:02.755 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:03.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:03 smithi131 bash[24745]: cluster 2024-09-13T22:32:02.130805+0000 mgr.a (mgr.14355) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:03.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:03 smithi171 bash[25040]: cluster 2024-09-13T22:32:02.130805+0000 mgr.a (mgr.14355) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:03.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:03 smithi007 bash[22722]: cluster 2024-09-13T22:32:02.130805+0000 mgr.a (mgr.14355) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:04.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:04 smithi131 bash[24745]: audit 2024-09-13T22:32:02.357077+0000 mgr.a (mgr.14355) 481 : audit [DBG] from='client.24033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:04.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:04 smithi171 bash[25040]: audit 2024-09-13T22:32:02.357077+0000 mgr.a (mgr.14355) 481 : audit [DBG] from='client.24033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:04 smithi007 bash[22722]: audit 2024-09-13T22:32:02.357077+0000 mgr.a (mgr.14355) 481 : audit [DBG] from='client.24033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:05.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:05 smithi131 bash[24745]: cluster 2024-09-13T22:32:04.131726+0000 mgr.a (mgr.14355) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:05.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:05 smithi171 bash[25040]: cluster 2024-09-13T22:32:04.131726+0000 mgr.a (mgr.14355) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:05.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:05 smithi007 bash[22722]: cluster 2024-09-13T22:32:04.131726+0000 mgr.a (mgr.14355) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:06.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:06 smithi131 bash[24745]: cluster 2024-09-13T22:32:06.133948+0000 mgr.a (mgr.14355) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:06.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:06 smithi171 bash[25040]: cluster 2024-09-13T22:32:06.133948+0000 mgr.a (mgr.14355) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:06.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:06 smithi007 bash[22722]: cluster 2024-09-13T22:32:06.133948+0000 mgr.a (mgr.14355) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:08.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:09.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:09 smithi007 bash[22722]: audit 2024-09-13T22:32:08.094445+0000 mgr.a (mgr.14355) 484 : audit [DBG] from='client.24108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:09.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:09 smithi007 bash[22722]: cluster 2024-09-13T22:32:08.135029+0000 mgr.a (mgr.14355) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:09.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:09 smithi131 bash[24745]: audit 2024-09-13T22:32:08.094445+0000 mgr.a (mgr.14355) 484 : audit [DBG] from='client.24108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:09.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:09 smithi131 bash[24745]: cluster 2024-09-13T22:32:08.135029+0000 mgr.a (mgr.14355) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:09.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:09 smithi171 bash[25040]: audit 2024-09-13T22:32:08.094445+0000 mgr.a (mgr.14355) 484 : audit [DBG] from='client.24108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:09.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:09 smithi171 bash[25040]: cluster 2024-09-13T22:32:08.135029+0000 mgr.a (mgr.14355) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:11 smithi007 bash[22722]: cluster 2024-09-13T22:32:10.136115+0000 mgr.a (mgr.14355) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:11.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:11 smithi131 bash[24745]: cluster 2024-09-13T22:32:10.136115+0000 mgr.a (mgr.14355) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:11.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:11 smithi171 bash[25040]: cluster 2024-09-13T22:32:10.136115+0000 mgr.a (mgr.14355) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-09-13T22:32:13.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:13 smithi007 bash[22722]: cluster 2024-09-13T22:32:12.138416+0000 mgr.a (mgr.14355) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:13.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:13.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:13 smithi131 bash[24745]: cluster 2024-09-13T22:32:12.138416+0000 mgr.a (mgr.14355) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:13.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:13 smithi171 bash[25040]: cluster 2024-09-13T22:32:12.138416+0000 mgr.a (mgr.14355) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-13T22:32:14.291 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:14.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:14.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:14.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:14.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:15.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:15 smithi007 bash[22722]: audit 2024-09-13T22:32:13.861246+0000 mgr.a (mgr.14355) 488 : audit [DBG] from='client.24183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:15.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:15 smithi007 bash[22722]: cluster 2024-09-13T22:32:14.138954+0000 mgr.a (mgr.14355) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:15 smithi131 bash[24745]: audit 2024-09-13T22:32:13.861246+0000 mgr.a (mgr.14355) 488 : audit [DBG] from='client.24183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:15 smithi131 bash[24745]: cluster 2024-09-13T22:32:14.138954+0000 mgr.a (mgr.14355) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:15 smithi171 bash[25040]: audit 2024-09-13T22:32:13.861246+0000 mgr.a (mgr.14355) 488 : audit [DBG] from='client.24183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:15 smithi171 bash[25040]: cluster 2024-09-13T22:32:14.138954+0000 mgr.a (mgr.14355) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:17.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:17 smithi131 bash[24745]: cluster 2024-09-13T22:32:16.141203+0000 mgr.a (mgr.14355) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:17 smithi171 bash[25040]: cluster 2024-09-13T22:32:16.141203+0000 mgr.a (mgr.14355) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:17.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:17 smithi007 bash[22722]: cluster 2024-09-13T22:32:16.141203+0000 mgr.a (mgr.14355) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:18 smithi131 bash[24745]: cluster 2024-09-13T22:32:18.141998+0000 mgr.a (mgr.14355) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:18.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:18 smithi171 bash[25040]: cluster 2024-09-13T22:32:18.141998+0000 mgr.a (mgr.14355) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:18 smithi007 bash[22722]: cluster 2024-09-13T22:32:18.141998+0000 mgr.a (mgr.14355) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:19.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:19.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:20.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:20.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:20.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:20.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:20.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:21 smithi007 bash[22722]: audit 2024-09-13T22:32:19.628669+0000 mgr.a (mgr.14355) 492 : audit [DBG] from='client.24258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:21 smithi007 bash[22722]: cluster 2024-09-13T22:32:20.142974+0000 mgr.a (mgr.14355) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:21.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:21 smithi007 bash[22722]: audit 2024-09-13T22:32:20.430332+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:32:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:21 smithi131 bash[24745]: audit 2024-09-13T22:32:19.628669+0000 mgr.a (mgr.14355) 492 : audit [DBG] from='client.24258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:21 smithi131 bash[24745]: cluster 2024-09-13T22:32:20.142974+0000 mgr.a (mgr.14355) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:21 smithi131 bash[24745]: audit 2024-09-13T22:32:20.430332+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:32:21.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:21 smithi171 bash[25040]: audit 2024-09-13T22:32:19.628669+0000 mgr.a (mgr.14355) 492 : audit [DBG] from='client.24258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:21 smithi171 bash[25040]: cluster 2024-09-13T22:32:20.142974+0000 mgr.a (mgr.14355) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:21 smithi171 bash[25040]: audit 2024-09-13T22:32:20.430332+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:32:23.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:23 smithi007 bash[22722]: cluster 2024-09-13T22:32:22.145278+0000 mgr.a (mgr.14355) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:23.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:23 smithi131 bash[24745]: cluster 2024-09-13T22:32:22.145278+0000 mgr.a (mgr.14355) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:23.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:23 smithi171 bash[25040]: cluster 2024-09-13T22:32:22.145278+0000 mgr.a (mgr.14355) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:25.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:25.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:25.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:25 smithi131 bash[24745]: cluster 2024-09-13T22:32:24.146067+0000 mgr.a (mgr.14355) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:25.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:25 smithi171 bash[25040]: cluster 2024-09-13T22:32:24.146067+0000 mgr.a (mgr.14355) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:25.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:25 smithi007 bash[22722]: cluster 2024-09-13T22:32:24.146067+0000 mgr.a (mgr.14355) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:25.821 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:27.028 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.375081+0000 mgr.a (mgr.14355) 496 : audit [DBG] from='client.24333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.766257+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.774090+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.789346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.793872+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.803103+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:25.807727+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: cluster 2024-09-13T22:32:26.147567+0000 mgr.a (mgr.14355) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.524017+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.524514+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.532023+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.538996+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.543119+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.544491+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.553620+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:26 smithi131 bash[24745]: audit 2024-09-13T22:32:26.558620+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:27.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.375081+0000 mgr.a (mgr.14355) 496 : audit [DBG] from='client.24333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:27.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.766257+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.774090+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.789346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.793872+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.803103+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:25.807727+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: cluster 2024-09-13T22:32:26.147567+0000 mgr.a (mgr.14355) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:27.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.524017+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.524514+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.532023+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.538996+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.543119+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.544491+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.553620+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:26 smithi171 bash[25040]: audit 2024-09-13T22:32:26.558620+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.375081+0000 mgr.a (mgr.14355) 496 : audit [DBG] from='client.24333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.766257+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.774090+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.789346+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.793872+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.803103+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:25.807727+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: cluster 2024-09-13T22:32:26.147567+0000 mgr.a (mgr.14355) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.524017+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.524514+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.532023+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.538996+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.543119+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:32:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.544491+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:32:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.553620+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:32:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:26 smithi007 bash[22722]: audit 2024-09-13T22:32:26.558620+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:27.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:32:27 smithi007 bash[22972]: debug 2024-09-13T22:32:27.257+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:32:27.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:32:27 smithi007 bash[22972]: debug 2024-09-13T22:32:27.257+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:32:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:27 smithi007 bash[22722]: cephadm 2024-09-13T22:32:26.525638+0000 mgr.a (mgr.14355) 498 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 20337M 2024-09-13T22:32:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:27 smithi007 bash[22722]: cephadm 2024-09-13T22:32:26.526090+0000 mgr.a (mgr.14355) 499 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 16241M 2024-09-13T22:32:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:27 smithi007 bash[22722]: audit 2024-09-13T22:32:26.559877+0000 mgr.a (mgr.14355) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:28.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:27 smithi131 bash[24745]: cephadm 2024-09-13T22:32:26.525638+0000 mgr.a (mgr.14355) 498 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 20337M 2024-09-13T22:32:28.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:27 smithi131 bash[24745]: cephadm 2024-09-13T22:32:26.526090+0000 mgr.a (mgr.14355) 499 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 16241M 2024-09-13T22:32:28.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:27 smithi131 bash[24745]: audit 2024-09-13T22:32:26.559877+0000 mgr.a (mgr.14355) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:28.289 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:27 smithi171 bash[25040]: cephadm 2024-09-13T22:32:26.525638+0000 mgr.a (mgr.14355) 498 : cephadm [INF] Adjusting osd_memory_target on smithi171 to 20337M 2024-09-13T22:32:28.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:27 smithi171 bash[25040]: cephadm 2024-09-13T22:32:26.526090+0000 mgr.a (mgr.14355) 499 : cephadm [INF] Adjusting osd_memory_target on smithi131 to 16241M 2024-09-13T22:32:28.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:27 smithi171 bash[25040]: audit 2024-09-13T22:32:26.559877+0000 mgr.a (mgr.14355) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:32:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:28 smithi007 bash[22722]: audit 2024-09-13T22:32:27.258616+0000 mgr.a (mgr.14355) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:32:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:28 smithi007 bash[22722]: cephadm 2024-09-13T22:32:27.259858+0000 mgr.a (mgr.14355) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:32:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:28 smithi007 bash[22722]: cluster 2024-09-13T22:32:28.148468+0000 mgr.a (mgr.14355) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:32:29.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:28 smithi131 bash[24745]: audit 2024-09-13T22:32:27.258616+0000 mgr.a (mgr.14355) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:32:29.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:28 smithi131 bash[24745]: cephadm 2024-09-13T22:32:27.259858+0000 mgr.a (mgr.14355) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:32:29.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:28 smithi131 bash[24745]: cluster 2024-09-13T22:32:28.148468+0000 mgr.a (mgr.14355) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:32:29.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:28 smithi171 bash[25040]: audit 2024-09-13T22:32:27.258616+0000 mgr.a (mgr.14355) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:32:29.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:28 smithi171 bash[25040]: cephadm 2024-09-13T22:32:27.259858+0000 mgr.a (mgr.14355) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:32:29.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:28 smithi171 bash[25040]: cluster 2024-09-13T22:32:28.148468+0000 mgr.a (mgr.14355) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:32:30.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:30.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:30.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:31.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:31 smithi131 bash[24745]: cluster 2024-09-13T22:32:30.149279+0000 mgr.a (mgr.14355) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:32:31.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:31 smithi171 bash[25040]: cluster 2024-09-13T22:32:30.149279+0000 mgr.a (mgr.14355) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:32:31.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:31.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:31 smithi007 bash[22722]: cluster 2024-09-13T22:32:30.149279+0000 mgr.a (mgr.14355) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:32:32.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:32 smithi131 bash[24745]: audit 2024-09-13T22:32:31.162666+0000 mgr.a (mgr.14355) 505 : audit [DBG] from='client.24516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:32.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:32 smithi171 bash[25040]: audit 2024-09-13T22:32:31.162666+0000 mgr.a (mgr.14355) 505 : audit [DBG] from='client.24516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:32.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:32 smithi007 bash[22722]: audit 2024-09-13T22:32:31.162666+0000 mgr.a (mgr.14355) 505 : audit [DBG] from='client.24516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:33.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:33 smithi131 bash[24745]: cluster 2024-09-13T22:32:32.152075+0000 mgr.a (mgr.14355) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:33.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:33 smithi171 bash[25040]: cluster 2024-09-13T22:32:32.152075+0000 mgr.a (mgr.14355) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:33.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:33 smithi007 bash[22722]: cluster 2024-09-13T22:32:32.152075+0000 mgr.a (mgr.14355) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:34 smithi131 bash[24745]: cluster 2024-09-13T22:32:34.152856+0000 mgr.a (mgr.14355) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:32:34.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:34 smithi171 bash[25040]: cluster 2024-09-13T22:32:34.152856+0000 mgr.a (mgr.14355) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:32:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:34 smithi007 bash[22722]: cluster 2024-09-13T22:32:34.152856+0000 mgr.a (mgr.14355) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:32:36.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:36.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:36.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:37.342 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:37.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:37.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:37 smithi131 bash[24745]: cluster 2024-09-13T22:32:36.154798+0000 mgr.a (mgr.14355) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:37.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:37 smithi171 bash[25040]: cluster 2024-09-13T22:32:36.154798+0000 mgr.a (mgr.14355) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:37.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:37 smithi007 bash[22722]: cluster 2024-09-13T22:32:36.154798+0000 mgr.a (mgr.14355) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:38.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:38 smithi131 bash[24745]: audit 2024-09-13T22:32:36.928813+0000 mgr.a (mgr.14355) 509 : audit [DBG] from='client.24591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:38.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:38 smithi171 bash[25040]: audit 2024-09-13T22:32:36.928813+0000 mgr.a (mgr.14355) 509 : audit [DBG] from='client.24591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:38.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:38 smithi007 bash[22722]: audit 2024-09-13T22:32:36.928813+0000 mgr.a (mgr.14355) 509 : audit [DBG] from='client.24591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:39.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:39 smithi131 bash[24745]: cluster 2024-09-13T22:32:38.155807+0000 mgr.a (mgr.14355) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:39.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:39 smithi171 bash[25040]: cluster 2024-09-13T22:32:38.155807+0000 mgr.a (mgr.14355) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:39 smithi007 bash[22722]: cluster 2024-09-13T22:32:38.155807+0000 mgr.a (mgr.14355) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:40.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:40 smithi131 bash[24745]: cluster 2024-09-13T22:32:40.156838+0000 mgr.a (mgr.14355) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:40.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:40 smithi171 bash[25040]: cluster 2024-09-13T22:32:40.156838+0000 mgr.a (mgr.14355) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:40.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:40 smithi007 bash[22722]: cluster 2024-09-13T22:32:40.156838+0000 mgr.a (mgr.14355) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:42.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:42.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:42.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:43.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:43.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:43 smithi131 bash[24745]: cluster 2024-09-13T22:32:42.159095+0000 mgr.a (mgr.14355) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:43.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:43 smithi171 bash[25040]: cluster 2024-09-13T22:32:42.159095+0000 mgr.a (mgr.14355) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:43.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:43 smithi007 bash[22722]: cluster 2024-09-13T22:32:42.159095+0000 mgr.a (mgr.14355) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:32:44.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:44 smithi131 bash[24745]: audit 2024-09-13T22:32:42.680909+0000 mgr.a (mgr.14355) 513 : audit [DBG] from='client.24669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:44.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:44 smithi131 bash[24745]: cluster 2024-09-13T22:32:44.160068+0000 mgr.a (mgr.14355) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:44.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:44 smithi171 bash[25040]: audit 2024-09-13T22:32:42.680909+0000 mgr.a (mgr.14355) 513 : audit [DBG] from='client.24669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:44.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:44 smithi171 bash[25040]: cluster 2024-09-13T22:32:44.160068+0000 mgr.a (mgr.14355) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:44 smithi007 bash[22722]: audit 2024-09-13T22:32:42.680909+0000 mgr.a (mgr.14355) 513 : audit [DBG] from='client.24669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:44 smithi007 bash[22722]: cluster 2024-09-13T22:32:44.160068+0000 mgr.a (mgr.14355) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:46.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:46 smithi131 bash[24745]: cluster 2024-09-13T22:32:46.162237+0000 mgr.a (mgr.14355) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:46.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:46 smithi171 bash[25040]: cluster 2024-09-13T22:32:46.162237+0000 mgr.a (mgr.14355) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:46 smithi007 bash[22722]: cluster 2024-09-13T22:32:46.162237+0000 mgr.a (mgr.14355) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:48.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:48.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:48 smithi131 bash[24745]: cluster 2024-09-13T22:32:48.162810+0000 mgr.a (mgr.14355) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:48.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:48 smithi171 bash[25040]: cluster 2024-09-13T22:32:48.162810+0000 mgr.a (mgr.14355) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:48.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:48 smithi007 bash[22722]: cluster 2024-09-13T22:32:48.162810+0000 mgr.a (mgr.14355) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:48.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:48.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:49.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:49 smithi131 bash[24745]: audit 2024-09-13T22:32:48.447379+0000 mgr.a (mgr.14355) 517 : audit [DBG] from='client.24744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:49.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:49 smithi171 bash[25040]: audit 2024-09-13T22:32:48.447379+0000 mgr.a (mgr.14355) 517 : audit [DBG] from='client.24744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:49.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:49 smithi007 bash[22722]: audit 2024-09-13T22:32:48.447379+0000 mgr.a (mgr.14355) 517 : audit [DBG] from='client.24744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:50.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:50 smithi131 bash[24745]: cluster 2024-09-13T22:32:50.163742+0000 mgr.a (mgr.14355) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:50.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:50 smithi171 bash[25040]: cluster 2024-09-13T22:32:50.163742+0000 mgr.a (mgr.14355) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:50.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:50 smithi007 bash[22722]: cluster 2024-09-13T22:32:50.163742+0000 mgr.a (mgr.14355) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:52.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:52 smithi131 bash[24745]: cluster 2024-09-13T22:32:52.166042+0000 mgr.a (mgr.14355) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:52.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:52 smithi171 bash[25040]: cluster 2024-09-13T22:32:52.166042+0000 mgr.a (mgr.14355) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:52 smithi007 bash[22722]: cluster 2024-09-13T22:32:52.166042+0000 mgr.a (mgr.14355) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:53.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:53.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:53.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:32:54.612 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:32:54.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:32:54.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:32:54.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:32:54.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:32:55.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:55 smithi131 bash[24745]: cluster 2024-09-13T22:32:54.166777+0000 mgr.a (mgr.14355) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:55.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:55 smithi131 bash[24745]: audit 2024-09-13T22:32:54.204422+0000 mgr.a (mgr.14355) 521 : audit [DBG] from='client.24822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:55.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:55 smithi171 bash[25040]: cluster 2024-09-13T22:32:54.166777+0000 mgr.a (mgr.14355) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:55.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:55 smithi171 bash[25040]: audit 2024-09-13T22:32:54.204422+0000 mgr.a (mgr.14355) 521 : audit [DBG] from='client.24822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:55.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:55 smithi007 bash[22722]: cluster 2024-09-13T22:32:54.166777+0000 mgr.a (mgr.14355) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:55.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:55 smithi007 bash[22722]: audit 2024-09-13T22:32:54.204422+0000 mgr.a (mgr.14355) 521 : audit [DBG] from='client.24822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:32:56.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:56 smithi131 bash[24745]: cluster 2024-09-13T22:32:56.169141+0000 mgr.a (mgr.14355) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:56.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:56 smithi171 bash[25040]: cluster 2024-09-13T22:32:56.169141+0000 mgr.a (mgr.14355) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:56 smithi007 bash[22722]: cluster 2024-09-13T22:32:56.169141+0000 mgr.a (mgr.14355) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:32:58.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:32:58 smithi131 bash[24745]: cluster 2024-09-13T22:32:58.169975+0000 mgr.a (mgr.14355) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:58.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:32:58 smithi171 bash[25040]: cluster 2024-09-13T22:32:58.169975+0000 mgr.a (mgr.14355) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:32:58 smithi007 bash[22722]: cluster 2024-09-13T22:32:58.169975+0000 mgr.a (mgr.14355) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:32:59.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:32:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:32:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:00.379 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:00 smithi131 bash[24745]: audit 2024-09-13T22:32:59.956425+0000 mgr.a (mgr.14355) 524 : audit [DBG] from='client.24894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:00 smithi131 bash[24745]: cluster 2024-09-13T22:33:00.170501+0000 mgr.a (mgr.14355) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:00.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:00 smithi171 bash[25040]: audit 2024-09-13T22:32:59.956425+0000 mgr.a (mgr.14355) 524 : audit [DBG] from='client.24894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:00 smithi171 bash[25040]: cluster 2024-09-13T22:33:00.170501+0000 mgr.a (mgr.14355) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:00.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:00 smithi007 bash[22722]: audit 2024-09-13T22:32:59.956425+0000 mgr.a (mgr.14355) 524 : audit [DBG] from='client.24894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:00.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:00 smithi007 bash[22722]: cluster 2024-09-13T22:33:00.170501+0000 mgr.a (mgr.14355) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:02.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:02 smithi131 bash[24745]: cluster 2024-09-13T22:33:02.173095+0000 mgr.a (mgr.14355) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:33:02.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:02 smithi171 bash[25040]: cluster 2024-09-13T22:33:02.173095+0000 mgr.a (mgr.14355) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:33:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:02 smithi007 bash[22722]: cluster 2024-09-13T22:33:02.173095+0000 mgr.a (mgr.14355) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:33:04.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:04 smithi131 bash[24745]: cluster 2024-09-13T22:33:04.173919+0000 mgr.a (mgr.14355) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:33:04.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:04 smithi171 bash[25040]: cluster 2024-09-13T22:33:04.173919+0000 mgr.a (mgr.14355) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:33:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:04 smithi007 bash[22722]: cluster 2024-09-13T22:33:04.173919+0000 mgr.a (mgr.14355) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:33:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:06.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:06.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:06 smithi131 bash[24745]: audit 2024-09-13T22:33:05.719229+0000 mgr.a (mgr.14355) 528 : audit [DBG] from='client.24972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:06.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:06 smithi131 bash[24745]: cluster 2024-09-13T22:33:06.176624+0000 mgr.a (mgr.14355) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:06.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:06 smithi171 bash[25040]: audit 2024-09-13T22:33:05.719229+0000 mgr.a (mgr.14355) 528 : audit [DBG] from='client.24972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:06.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:06 smithi171 bash[25040]: cluster 2024-09-13T22:33:06.176624+0000 mgr.a (mgr.14355) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:06 smithi007 bash[22722]: audit 2024-09-13T22:33:05.719229+0000 mgr.a (mgr.14355) 528 : audit [DBG] from='client.24972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:06 smithi007 bash[22722]: cluster 2024-09-13T22:33:06.176624+0000 mgr.a (mgr.14355) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:08.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:08 smithi131 bash[24745]: cluster 2024-09-13T22:33:08.177408+0000 mgr.a (mgr.14355) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:08.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:08 smithi171 bash[25040]: cluster 2024-09-13T22:33:08.177408+0000 mgr.a (mgr.14355) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:08.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:08 smithi007 bash[22722]: cluster 2024-09-13T22:33:08.177408+0000 mgr.a (mgr.14355) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:10.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:10 smithi131 bash[24745]: cluster 2024-09-13T22:33:10.178163+0000 mgr.a (mgr.14355) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:10.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:10 smithi171 bash[25040]: cluster 2024-09-13T22:33:10.178163+0000 mgr.a (mgr.14355) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:10 smithi007 bash[22722]: cluster 2024-09-13T22:33:10.178163+0000 mgr.a (mgr.14355) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:11.862 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:12.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:12 smithi131 bash[24745]: audit 2024-09-13T22:33:11.463314+0000 mgr.a (mgr.14355) 532 : audit [DBG] from='client.25047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:12.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:12 smithi131 bash[24745]: cluster 2024-09-13T22:33:12.180946+0000 mgr.a (mgr.14355) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:12.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:12 smithi171 bash[25040]: audit 2024-09-13T22:33:11.463314+0000 mgr.a (mgr.14355) 532 : audit [DBG] from='client.25047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:12.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:12 smithi171 bash[25040]: cluster 2024-09-13T22:33:12.180946+0000 mgr.a (mgr.14355) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:12 smithi007 bash[22722]: audit 2024-09-13T22:33:11.463314+0000 mgr.a (mgr.14355) 532 : audit [DBG] from='client.25047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:12 smithi007 bash[22722]: cluster 2024-09-13T22:33:12.180946+0000 mgr.a (mgr.14355) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:14.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:14 smithi131 bash[24745]: cluster 2024-09-13T22:33:14.181730+0000 mgr.a (mgr.14355) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:33:14.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:14 smithi171 bash[25040]: cluster 2024-09-13T22:33:14.181730+0000 mgr.a (mgr.14355) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:33:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:14 smithi007 bash[22722]: cluster 2024-09-13T22:33:14.181730+0000 mgr.a (mgr.14355) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:33:16.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:16 smithi131 bash[24745]: cluster 2024-09-13T22:33:16.183803+0000 mgr.a (mgr.14355) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:33:16.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:16 smithi171 bash[25040]: cluster 2024-09-13T22:33:16.183803+0000 mgr.a (mgr.14355) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:33:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:16 smithi007 bash[22722]: cluster 2024-09-13T22:33:16.183803+0000 mgr.a (mgr.14355) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:33:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:17.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:17 smithi131 bash[24745]: audit 2024-09-13T22:33:17.199842+0000 mgr.a (mgr.14355) 536 : audit [DBG] from='client.25125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:17.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:17 smithi171 bash[25040]: audit 2024-09-13T22:33:17.199842+0000 mgr.a (mgr.14355) 536 : audit [DBG] from='client.25125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:17.606 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:17.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:17.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:17.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:17.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:17 smithi007 bash[22722]: audit 2024-09-13T22:33:17.199842+0000 mgr.a (mgr.14355) 536 : audit [DBG] from='client.25125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:18 smithi171 bash[25040]: cluster 2024-09-13T22:33:18.184828+0000 mgr.a (mgr.14355) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:18 smithi007 bash[22722]: cluster 2024-09-13T22:33:18.184828+0000 mgr.a (mgr.14355) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:18.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:18 smithi131 bash[24745]: cluster 2024-09-13T22:33:18.184828+0000 mgr.a (mgr.14355) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:20.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:20 smithi131 bash[24745]: cluster 2024-09-13T22:33:20.185596+0000 mgr.a (mgr.14355) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:20 smithi171 bash[25040]: cluster 2024-09-13T22:33:20.185596+0000 mgr.a (mgr.14355) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:20 smithi007 bash[22722]: cluster 2024-09-13T22:33:20.185596+0000 mgr.a (mgr.14355) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:22.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:22 smithi131 bash[24745]: cluster 2024-09-13T22:33:22.187877+0000 mgr.a (mgr.14355) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:22.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:22 smithi171 bash[25040]: cluster 2024-09-13T22:33:22.187877+0000 mgr.a (mgr.14355) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:22.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:22 smithi007 bash[22722]: cluster 2024-09-13T22:33:22.187877+0000 mgr.a (mgr.14355) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:23.377 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:23.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:23.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:23 smithi171 bash[25040]: audit 2024-09-13T22:33:22.944367+0000 mgr.a (mgr.14355) 540 : audit [DBG] from='client.25203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:23.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:23 smithi007 bash[22722]: audit 2024-09-13T22:33:22.944367+0000 mgr.a (mgr.14355) 540 : audit [DBG] from='client.25203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:23.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:23 smithi131 bash[24745]: audit 2024-09-13T22:33:22.944367+0000 mgr.a (mgr.14355) 540 : audit [DBG] from='client.25203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:24.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:24 smithi171 bash[25040]: cluster 2024-09-13T22:33:24.188795+0000 mgr.a (mgr.14355) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:24.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:24 smithi007 bash[22722]: cluster 2024-09-13T22:33:24.188795+0000 mgr.a (mgr.14355) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:24.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:24 smithi131 bash[24745]: cluster 2024-09-13T22:33:24.188795+0000 mgr.a (mgr.14355) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:26.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:26 smithi171 bash[25040]: cluster 2024-09-13T22:33:26.191023+0000 mgr.a (mgr.14355) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:26 smithi007 bash[22722]: cluster 2024-09-13T22:33:26.191023+0000 mgr.a (mgr.14355) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:26.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:26 smithi131 bash[24745]: cluster 2024-09-13T22:33:26.191023+0000 mgr.a (mgr.14355) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:27.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:27 smithi007 bash[22722]: audit 2024-09-13T22:33:27.310145+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:33:27.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:27 smithi131 bash[24745]: audit 2024-09-13T22:33:27.310145+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:33:27.789 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:27 smithi171 bash[25040]: audit 2024-09-13T22:33:27.310145+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:33:28.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:28.378 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:28.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: audit 2024-09-13T22:33:28.150035+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: audit 2024-09-13T22:33:28.151640+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: audit 2024-09-13T22:33:28.161335+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: audit 2024-09-13T22:33:28.163897+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: audit 2024-09-13T22:33:28.166119+0000 mgr.a (mgr.14355) 543 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22722]: cluster 2024-09-13T22:33:28.192199+0000 mgr.a (mgr.14355) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:28.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: audit 2024-09-13T22:33:28.150035+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:33:28.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: audit 2024-09-13T22:33:28.151640+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:33:28.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: audit 2024-09-13T22:33:28.161335+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:33:28.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: audit 2024-09-13T22:33:28.163897+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: audit 2024-09-13T22:33:28.166119+0000 mgr.a (mgr.14355) 543 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:28 smithi131 bash[24745]: cluster 2024-09-13T22:33:28.192199+0000 mgr.a (mgr.14355) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: audit 2024-09-13T22:33:28.150035+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: audit 2024-09-13T22:33:28.151640+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: audit 2024-09-13T22:33:28.161335+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: audit 2024-09-13T22:33:28.163897+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: audit 2024-09-13T22:33:28.166119+0000 mgr.a (mgr.14355) 543 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:33:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:28 smithi171 bash[25040]: cluster 2024-09-13T22:33:28.192199+0000 mgr.a (mgr.14355) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:29.201 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22972]: debug 2024-09-13T22:33:28.892+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:33:29.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:33:28 smithi007 bash[22972]: debug 2024-09-13T22:33:28.900+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:33:29.277 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:29.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:29.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:29.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:29.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:30 smithi007 bash[22722]: audit 2024-09-13T22:33:28.710373+0000 mgr.a (mgr.14355) 545 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:30 smithi007 bash[22722]: audit 2024-09-13T22:33:28.894610+0000 mgr.a (mgr.14355) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:33:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:30 smithi007 bash[22722]: cephadm 2024-09-13T22:33:28.905855+0000 mgr.a (mgr.14355) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:33:30.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:30 smithi131 bash[24745]: audit 2024-09-13T22:33:28.710373+0000 mgr.a (mgr.14355) 545 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:30.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:30 smithi131 bash[24745]: audit 2024-09-13T22:33:28.894610+0000 mgr.a (mgr.14355) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:33:30.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:30 smithi131 bash[24745]: cephadm 2024-09-13T22:33:28.905855+0000 mgr.a (mgr.14355) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:33:30.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:30 smithi171 bash[25040]: audit 2024-09-13T22:33:28.710373+0000 mgr.a (mgr.14355) 545 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:30.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:30 smithi171 bash[25040]: audit 2024-09-13T22:33:28.894610+0000 mgr.a (mgr.14355) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:33:30.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:30 smithi171 bash[25040]: cephadm 2024-09-13T22:33:28.905855+0000 mgr.a (mgr.14355) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:33:31.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:31 smithi007 bash[22722]: cluster 2024-09-13T22:33:30.193257+0000 mgr.a (mgr.14355) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:31.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:31 smithi131 bash[24745]: cluster 2024-09-13T22:33:30.193257+0000 mgr.a (mgr.14355) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:31.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:31 smithi171 bash[25040]: cluster 2024-09-13T22:33:30.193257+0000 mgr.a (mgr.14355) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:32.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:32 smithi171 bash[25040]: cluster 2024-09-13T22:33:32.195560+0000 mgr.a (mgr.14355) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:32.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:32 smithi007 bash[22722]: cluster 2024-09-13T22:33:32.195560+0000 mgr.a (mgr.14355) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:32.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:32 smithi131 bash[24745]: cluster 2024-09-13T22:33:32.195560+0000 mgr.a (mgr.14355) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:34.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:34 smithi171 bash[25040]: cluster 2024-09-13T22:33:34.196314+0000 mgr.a (mgr.14355) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:34 smithi007 bash[22722]: cluster 2024-09-13T22:33:34.196314+0000 mgr.a (mgr.14355) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:34.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:34 smithi131 bash[24745]: cluster 2024-09-13T22:33:34.196314+0000 mgr.a (mgr.14355) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:35.031 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:35.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:35.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:35 smithi171 bash[25040]: audit 2024-09-13T22:33:34.614971+0000 mgr.a (mgr.14355) 551 : audit [DBG] from='client.25458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:35.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:35 smithi007 bash[22722]: audit 2024-09-13T22:33:34.614971+0000 mgr.a (mgr.14355) 551 : audit [DBG] from='client.25458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:35.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:35 smithi131 bash[24745]: audit 2024-09-13T22:33:34.614971+0000 mgr.a (mgr.14355) 551 : audit [DBG] from='client.25458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:36.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:36 smithi171 bash[25040]: cluster 2024-09-13T22:33:36.198744+0000 mgr.a (mgr.14355) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:36.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:36 smithi007 bash[22722]: cluster 2024-09-13T22:33:36.198744+0000 mgr.a (mgr.14355) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:36.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:36 smithi131 bash[24745]: cluster 2024-09-13T22:33:36.198744+0000 mgr.a (mgr.14355) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:38.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:38 smithi171 bash[25040]: cluster 2024-09-13T22:33:38.199516+0000 mgr.a (mgr.14355) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:38.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:38 smithi007 bash[22722]: cluster 2024-09-13T22:33:38.199516+0000 mgr.a (mgr.14355) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:38.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:38 smithi131 bash[24745]: cluster 2024-09-13T22:33:38.199516+0000 mgr.a (mgr.14355) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:40.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:40.033 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:40.033 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:40.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:40 smithi171 bash[25040]: cluster 2024-09-13T22:33:40.200128+0000 mgr.a (mgr.14355) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:40.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:40 smithi007 bash[22722]: cluster 2024-09-13T22:33:40.200128+0000 mgr.a (mgr.14355) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:40.775 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:40.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:40.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:40 smithi131 bash[24745]: cluster 2024-09-13T22:33:40.200128+0000 mgr.a (mgr.14355) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:41.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:41 smithi171 bash[25040]: audit 2024-09-13T22:33:40.368229+0000 mgr.a (mgr.14355) 555 : audit [DBG] from='client.25533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:41.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:41 smithi007 bash[22722]: audit 2024-09-13T22:33:40.368229+0000 mgr.a (mgr.14355) 555 : audit [DBG] from='client.25533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:41.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:41 smithi131 bash[24745]: audit 2024-09-13T22:33:40.368229+0000 mgr.a (mgr.14355) 555 : audit [DBG] from='client.25533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:42.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:42 smithi007 bash[22722]: cluster 2024-09-13T22:33:42.202805+0000 mgr.a (mgr.14355) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:42.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:42 smithi131 bash[24745]: cluster 2024-09-13T22:33:42.202805+0000 mgr.a (mgr.14355) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:42.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:42 smithi171 bash[25040]: cluster 2024-09-13T22:33:42.202805+0000 mgr.a (mgr.14355) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:33:44.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:44 smithi171 bash[25040]: cluster 2024-09-13T22:33:44.203586+0000 mgr.a (mgr.14355) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:44 smithi007 bash[22722]: cluster 2024-09-13T22:33:44.203586+0000 mgr.a (mgr.14355) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:44.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:44 smithi131 bash[24745]: cluster 2024-09-13T22:33:44.203586+0000 mgr.a (mgr.14355) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:33:45.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:45.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:45.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:46.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:46.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:46 smithi171 bash[25040]: audit 2024-09-13T22:33:46.107429+0000 mgr.a (mgr.14355) 558 : audit [DBG] from='client.25611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:46.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:46 smithi171 bash[25040]: cluster 2024-09-13T22:33:46.204803+0000 mgr.a (mgr.14355) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:46 smithi007 bash[22722]: audit 2024-09-13T22:33:46.107429+0000 mgr.a (mgr.14355) 558 : audit [DBG] from='client.25611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:46 smithi007 bash[22722]: cluster 2024-09-13T22:33:46.204803+0000 mgr.a (mgr.14355) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:46.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:46 smithi131 bash[24745]: audit 2024-09-13T22:33:46.107429+0000 mgr.a (mgr.14355) 558 : audit [DBG] from='client.25611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:46.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:46 smithi131 bash[24745]: cluster 2024-09-13T22:33:46.204803+0000 mgr.a (mgr.14355) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:48.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:48 smithi171 bash[25040]: cluster 2024-09-13T22:33:48.205760+0000 mgr.a (mgr.14355) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:48.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:48 smithi007 bash[22722]: cluster 2024-09-13T22:33:48.205760+0000 mgr.a (mgr.14355) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:48.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:48 smithi131 bash[24745]: cluster 2024-09-13T22:33:48.205760+0000 mgr.a (mgr.14355) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:50.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:50 smithi171 bash[25040]: cluster 2024-09-13T22:33:50.206725+0000 mgr.a (mgr.14355) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:50.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:50 smithi007 bash[22722]: cluster 2024-09-13T22:33:50.206725+0000 mgr.a (mgr.14355) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:50.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:50 smithi131 bash[24745]: cluster 2024-09-13T22:33:50.206725+0000 mgr.a (mgr.14355) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:33:51.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:52.249 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:52.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:52.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:52.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:52.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:52.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:52 smithi171 bash[25040]: audit 2024-09-13T22:33:51.855340+0000 mgr.a (mgr.14355) 562 : audit [DBG] from='client.25689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:52.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:52 smithi171 bash[25040]: cluster 2024-09-13T22:33:52.208033+0000 mgr.a (mgr.14355) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:52 smithi007 bash[22722]: audit 2024-09-13T22:33:51.855340+0000 mgr.a (mgr.14355) 562 : audit [DBG] from='client.25689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:52 smithi007 bash[22722]: cluster 2024-09-13T22:33:52.208033+0000 mgr.a (mgr.14355) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:52.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:52 smithi131 bash[24745]: audit 2024-09-13T22:33:51.855340+0000 mgr.a (mgr.14355) 562 : audit [DBG] from='client.25689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:52.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:52 smithi131 bash[24745]: cluster 2024-09-13T22:33:52.208033+0000 mgr.a (mgr.14355) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:54.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:54 smithi171 bash[25040]: cluster 2024-09-13T22:33:54.208905+0000 mgr.a (mgr.14355) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:54.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:54 smithi007 bash[22722]: cluster 2024-09-13T22:33:54.208905+0000 mgr.a (mgr.14355) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:54.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:54 smithi131 bash[24745]: cluster 2024-09-13T22:33:54.208905+0000 mgr.a (mgr.14355) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:56.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:56 smithi171 bash[25040]: cluster 2024-09-13T22:33:56.210976+0000 mgr.a (mgr.14355) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:56 smithi007 bash[22722]: cluster 2024-09-13T22:33:56.210976+0000 mgr.a (mgr.14355) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:56.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:56 smithi131 bash[24745]: cluster 2024-09-13T22:33:56.210976+0000 mgr.a (mgr.14355) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:33:57.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:33:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:33:57.252 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:33:58.013 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:33:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:33:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:33:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:33:58.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:33:58.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:58 smithi171 bash[25040]: audit 2024-09-13T22:33:57.592090+0000 mgr.a (mgr.14355) 566 : audit [DBG] from='client.25767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:58.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:33:58 smithi171 bash[25040]: cluster 2024-09-13T22:33:58.212025+0000 mgr.a (mgr.14355) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:58 smithi007 bash[22722]: audit 2024-09-13T22:33:57.592090+0000 mgr.a (mgr.14355) 566 : audit [DBG] from='client.25767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:33:58 smithi007 bash[22722]: cluster 2024-09-13T22:33:58.212025+0000 mgr.a (mgr.14355) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:33:58.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:58 smithi131 bash[24745]: audit 2024-09-13T22:33:57.592090+0000 mgr.a (mgr.14355) 566 : audit [DBG] from='client.25767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:33:58.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:33:58 smithi131 bash[24745]: cluster 2024-09-13T22:33:58.212025+0000 mgr.a (mgr.14355) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:00.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:00 smithi171 bash[25040]: cluster 2024-09-13T22:34:00.212991+0000 mgr.a (mgr.14355) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:00.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:00 smithi007 bash[22722]: cluster 2024-09-13T22:34:00.212991+0000 mgr.a (mgr.14355) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:00.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:00 smithi131 bash[24745]: cluster 2024-09-13T22:34:00.212991+0000 mgr.a (mgr.14355) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:02.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:02 smithi171 bash[25040]: cluster 2024-09-13T22:34:02.215383+0000 mgr.a (mgr.14355) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:02 smithi007 bash[22722]: cluster 2024-09-13T22:34:02.215383+0000 mgr.a (mgr.14355) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:02.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:02 smithi131 bash[24745]: cluster 2024-09-13T22:34:02.215383+0000 mgr.a (mgr.14355) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:03.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:03.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:03.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:03.782 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:03.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:04.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:04 smithi171 bash[25040]: audit 2024-09-13T22:34:03.352888+0000 mgr.a (mgr.14355) 570 : audit [DBG] from='client.25842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:04.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:04 smithi171 bash[25040]: cluster 2024-09-13T22:34:04.216529+0000 mgr.a (mgr.14355) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:04 smithi007 bash[22722]: audit 2024-09-13T22:34:03.352888+0000 mgr.a (mgr.14355) 570 : audit [DBG] from='client.25842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:04 smithi007 bash[22722]: cluster 2024-09-13T22:34:04.216529+0000 mgr.a (mgr.14355) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:04.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:04 smithi131 bash[24745]: audit 2024-09-13T22:34:03.352888+0000 mgr.a (mgr.14355) 570 : audit [DBG] from='client.25842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:04.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:04 smithi131 bash[24745]: cluster 2024-09-13T22:34:04.216529+0000 mgr.a (mgr.14355) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:06.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:06 smithi171 bash[25040]: cluster 2024-09-13T22:34:06.218790+0000 mgr.a (mgr.14355) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:06 smithi007 bash[22722]: cluster 2024-09-13T22:34:06.218790+0000 mgr.a (mgr.14355) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:06.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:06 smithi131 bash[24745]: cluster 2024-09-13T22:34:06.218790+0000 mgr.a (mgr.14355) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:08.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:08 smithi171 bash[25040]: cluster 2024-09-13T22:34:08.219550+0000 mgr.a (mgr.14355) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:08.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:08 smithi007 bash[22722]: cluster 2024-09-13T22:34:08.219550+0000 mgr.a (mgr.14355) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:08.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:08 smithi131 bash[24745]: cluster 2024-09-13T22:34:08.219550+0000 mgr.a (mgr.14355) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:08.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:08.785 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:09.538 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:09.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:09 smithi171 bash[25040]: audit 2024-09-13T22:34:09.116208+0000 mgr.a (mgr.14355) 574 : audit [DBG] from='client.25920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:09.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:09 smithi007 bash[22722]: audit 2024-09-13T22:34:09.116208+0000 mgr.a (mgr.14355) 574 : audit [DBG] from='client.25920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:09.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:09 smithi131 bash[24745]: audit 2024-09-13T22:34:09.116208+0000 mgr.a (mgr.14355) 574 : audit [DBG] from='client.25920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:10 smithi007 bash[22722]: cluster 2024-09-13T22:34:10.220489+0000 mgr.a (mgr.14355) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:10.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:10 smithi131 bash[24745]: cluster 2024-09-13T22:34:10.220489+0000 mgr.a (mgr.14355) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:10.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:10 smithi171 bash[25040]: cluster 2024-09-13T22:34:10.220489+0000 mgr.a (mgr.14355) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:12.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:12 smithi171 bash[25040]: cluster 2024-09-13T22:34:12.222761+0000 mgr.a (mgr.14355) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:12 smithi007 bash[22722]: cluster 2024-09-13T22:34:12.222761+0000 mgr.a (mgr.14355) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:12.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:12 smithi131 bash[24745]: cluster 2024-09-13T22:34:12.222761+0000 mgr.a (mgr.14355) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:14.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:14 smithi171 bash[25040]: cluster 2024-09-13T22:34:14.223510+0000 mgr.a (mgr.14355) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:14.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:14.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:14 smithi007 bash[22722]: cluster 2024-09-13T22:34:14.223510+0000 mgr.a (mgr.14355) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:14.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:14 smithi131 bash[24745]: cluster 2024-09-13T22:34:14.223510+0000 mgr.a (mgr.14355) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:15.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:15.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:15 smithi171 bash[25040]: audit 2024-09-13T22:34:14.873309+0000 mgr.a (mgr.14355) 578 : audit [DBG] from='client.25998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:15.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:15 smithi007 bash[22722]: audit 2024-09-13T22:34:14.873309+0000 mgr.a (mgr.14355) 578 : audit [DBG] from='client.25998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:15.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:15 smithi131 bash[24745]: audit 2024-09-13T22:34:14.873309+0000 mgr.a (mgr.14355) 578 : audit [DBG] from='client.25998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:16 smithi007 bash[22722]: cluster 2024-09-13T22:34:16.225935+0000 mgr.a (mgr.14355) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:16.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:16 smithi131 bash[24745]: cluster 2024-09-13T22:34:16.225935+0000 mgr.a (mgr.14355) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:16.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:16 smithi171 bash[25040]: cluster 2024-09-13T22:34:16.225935+0000 mgr.a (mgr.14355) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:18 smithi171 bash[25040]: cluster 2024-09-13T22:34:18.226919+0000 mgr.a (mgr.14355) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:18 smithi007 bash[22722]: cluster 2024-09-13T22:34:18.226919+0000 mgr.a (mgr.14355) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:18.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:18 smithi131 bash[24745]: cluster 2024-09-13T22:34:18.226919+0000 mgr.a (mgr.14355) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:20.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:20.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:20.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:20 smithi171 bash[25040]: cluster 2024-09-13T22:34:20.227712+0000 mgr.a (mgr.14355) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:20.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:20 smithi007 bash[22722]: cluster 2024-09-13T22:34:20.227712+0000 mgr.a (mgr.14355) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:20.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:20 smithi131 bash[24745]: cluster 2024-09-13T22:34:20.227712+0000 mgr.a (mgr.14355) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:21.047 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:21.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:21.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:21.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:21.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:21.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:21 smithi171 bash[25040]: audit 2024-09-13T22:34:20.618320+0000 mgr.a (mgr.14355) 582 : audit [DBG] from='client.26076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:21.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:21 smithi007 bash[22722]: audit 2024-09-13T22:34:20.618320+0000 mgr.a (mgr.14355) 582 : audit [DBG] from='client.26076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:21.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:21 smithi131 bash[24745]: audit 2024-09-13T22:34:20.618320+0000 mgr.a (mgr.14355) 582 : audit [DBG] from='client.26076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:22.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:22 smithi007 bash[22722]: cluster 2024-09-13T22:34:22.230395+0000 mgr.a (mgr.14355) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:22.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:22 smithi131 bash[24745]: cluster 2024-09-13T22:34:22.230395+0000 mgr.a (mgr.14355) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:22.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:22 smithi171 bash[25040]: cluster 2024-09-13T22:34:22.230395+0000 mgr.a (mgr.14355) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:24.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:24 smithi171 bash[25040]: cluster 2024-09-13T22:34:24.231156+0000 mgr.a (mgr.14355) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:24.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:24 smithi007 bash[22722]: cluster 2024-09-13T22:34:24.231156+0000 mgr.a (mgr.14355) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:24.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:24 smithi131 bash[24745]: cluster 2024-09-13T22:34:24.231156+0000 mgr.a (mgr.14355) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:26.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:26.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:26 smithi007 bash[22722]: cluster 2024-09-13T22:34:26.233067+0000 mgr.a (mgr.14355) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:26.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:26 smithi131 bash[24745]: cluster 2024-09-13T22:34:26.233067+0000 mgr.a (mgr.14355) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:26.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:26 smithi171 bash[25040]: cluster 2024-09-13T22:34:26.233067+0000 mgr.a (mgr.14355) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:26.795 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:26.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:26.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:27.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:27 smithi007 bash[22722]: audit 2024-09-13T22:34:26.385359+0000 mgr.a (mgr.14355) 586 : audit [DBG] from='client.26151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:27.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:27 smithi131 bash[24745]: audit 2024-09-13T22:34:26.385359+0000 mgr.a (mgr.14355) 586 : audit [DBG] from='client.26151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:27.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:27 smithi171 bash[25040]: audit 2024-09-13T22:34:26.385359+0000 mgr.a (mgr.14355) 586 : audit [DBG] from='client.26151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:28 smithi007 bash[22722]: cluster 2024-09-13T22:34:28.233942+0000 mgr.a (mgr.14355) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:28.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:28 smithi131 bash[24745]: cluster 2024-09-13T22:34:28.233942+0000 mgr.a (mgr.14355) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:28.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:28 smithi171 bash[25040]: cluster 2024-09-13T22:34:28.233942+0000 mgr.a (mgr.14355) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:34:29.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:29 smithi007 bash[22722]: audit 2024-09-13T22:34:28.958559+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:34:29.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:29 smithi131 bash[24745]: audit 2024-09-13T22:34:28.958559+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:34:29.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:29 smithi171 bash[25040]: audit 2024-09-13T22:34:28.958559+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:34:30.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22972]: debug 2024-09-13T22:34:30.519+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:34:30.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22972]: debug 2024-09-13T22:34:30.519+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: audit 2024-09-13T22:34:29.787555+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: audit 2024-09-13T22:34:29.788860+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: audit 2024-09-13T22:34:29.795320+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: audit 2024-09-13T22:34:29.797544+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: audit 2024-09-13T22:34:29.798589+0000 mgr.a (mgr.14355) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:30 smithi007 bash[22722]: cluster 2024-09-13T22:34:30.234596+0000 mgr.a (mgr.14355) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:34:30.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: audit 2024-09-13T22:34:29.787555+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:34:30.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: audit 2024-09-13T22:34:29.788860+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:34:30.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: audit 2024-09-13T22:34:29.795320+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:34:30.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: audit 2024-09-13T22:34:29.797544+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: audit 2024-09-13T22:34:29.798589+0000 mgr.a (mgr.14355) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.778 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:30 smithi131 bash[24745]: cluster 2024-09-13T22:34:30.234596+0000 mgr.a (mgr.14355) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:34:30.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: audit 2024-09-13T22:34:29.787555+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:34:30.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: audit 2024-09-13T22:34:29.788860+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:34:30.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: audit 2024-09-13T22:34:29.795320+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:34:30.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: audit 2024-09-13T22:34:29.797544+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: audit 2024-09-13T22:34:29.798589+0000 mgr.a (mgr.14355) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:34:30.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:30 smithi171 bash[25040]: cluster 2024-09-13T22:34:30.234596+0000 mgr.a (mgr.14355) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:34:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:31.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:31 smithi007 bash[22722]: audit 2024-09-13T22:34:30.522846+0000 mgr.a (mgr.14355) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:34:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:31 smithi007 bash[22722]: cephadm 2024-09-13T22:34:30.523947+0000 mgr.a (mgr.14355) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:34:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:31 smithi131 bash[24745]: audit 2024-09-13T22:34:30.522846+0000 mgr.a (mgr.14355) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:34:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:31 smithi131 bash[24745]: cephadm 2024-09-13T22:34:30.523947+0000 mgr.a (mgr.14355) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:34:32.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:31 smithi171 bash[25040]: audit 2024-09-13T22:34:30.522846+0000 mgr.a (mgr.14355) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:34:32.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:31 smithi171 bash[25040]: cephadm 2024-09-13T22:34:30.523947+0000 mgr.a (mgr.14355) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:34:32.566 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:32.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:32 smithi007 bash[22722]: audit 2024-09-13T22:34:32.132637+0000 mgr.a (mgr.14355) 592 : audit [DBG] from='client.26334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:32 smithi007 bash[22722]: cluster 2024-09-13T22:34:32.235827+0000 mgr.a (mgr.14355) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:33.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:32 smithi131 bash[24745]: audit 2024-09-13T22:34:32.132637+0000 mgr.a (mgr.14355) 592 : audit [DBG] from='client.26334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:33.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:32 smithi131 bash[24745]: cluster 2024-09-13T22:34:32.235827+0000 mgr.a (mgr.14355) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:33.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:32 smithi171 bash[25040]: audit 2024-09-13T22:34:32.132637+0000 mgr.a (mgr.14355) 592 : audit [DBG] from='client.26334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:33.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:32 smithi171 bash[25040]: cluster 2024-09-13T22:34:32.235827+0000 mgr.a (mgr.14355) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:34 smithi007 bash[22722]: cluster 2024-09-13T22:34:34.236666+0000 mgr.a (mgr.14355) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:34.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:34 smithi131 bash[24745]: cluster 2024-09-13T22:34:34.236666+0000 mgr.a (mgr.14355) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:34.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:34 smithi171 bash[25040]: cluster 2024-09-13T22:34:34.236666+0000 mgr.a (mgr.14355) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:34:36.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:36 smithi007 bash[22722]: cluster 2024-09-13T22:34:36.238931+0000 mgr.a (mgr.14355) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:36.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:36 smithi131 bash[24745]: cluster 2024-09-13T22:34:36.238931+0000 mgr.a (mgr.14355) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:36.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:36 smithi171 bash[25040]: cluster 2024-09-13T22:34:36.238931+0000 mgr.a (mgr.14355) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:38.312 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:38.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:38.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:38.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:38.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:38.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:38 smithi007 bash[22722]: audit 2024-09-13T22:34:37.899571+0000 mgr.a (mgr.14355) 596 : audit [DBG] from='client.26412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:38.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:38 smithi007 bash[22722]: cluster 2024-09-13T22:34:38.239445+0000 mgr.a (mgr.14355) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:38.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:38 smithi131 bash[24745]: audit 2024-09-13T22:34:37.899571+0000 mgr.a (mgr.14355) 596 : audit [DBG] from='client.26412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:38.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:38 smithi131 bash[24745]: cluster 2024-09-13T22:34:38.239445+0000 mgr.a (mgr.14355) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:38.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:38 smithi171 bash[25040]: audit 2024-09-13T22:34:37.899571+0000 mgr.a (mgr.14355) 596 : audit [DBG] from='client.26412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:38.791 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:38 smithi171 bash[25040]: cluster 2024-09-13T22:34:38.239445+0000 mgr.a (mgr.14355) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:40.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:40 smithi007 bash[22722]: cluster 2024-09-13T22:34:40.240196+0000 mgr.a (mgr.14355) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:40.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:40 smithi131 bash[24745]: cluster 2024-09-13T22:34:40.240196+0000 mgr.a (mgr.14355) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:40.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:40 smithi171 bash[25040]: cluster 2024-09-13T22:34:40.240196+0000 mgr.a (mgr.14355) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:43.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:43.317 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:43.317 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:43.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:43 smithi007 bash[22722]: cluster 2024-09-13T22:34:42.242465+0000 mgr.a (mgr.14355) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:43.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:43 smithi131 bash[24745]: cluster 2024-09-13T22:34:42.242465+0000 mgr.a (mgr.14355) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:43.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:43 smithi171 bash[25040]: cluster 2024-09-13T22:34:42.242465+0000 mgr.a (mgr.14355) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:34:44.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:44 smithi007 bash[22722]: audit 2024-09-13T22:34:43.650707+0000 mgr.a (mgr.14355) 600 : audit [DBG] from='client.26490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:44.777 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:44 smithi131 bash[24745]: audit 2024-09-13T22:34:43.650707+0000 mgr.a (mgr.14355) 600 : audit [DBG] from='client.26490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:44.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:44 smithi171 bash[25040]: audit 2024-09-13T22:34:43.650707+0000 mgr.a (mgr.14355) 600 : audit [DBG] from='client.26490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:46.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:45 smithi007 bash[22722]: cluster 2024-09-13T22:34:44.243415+0000 mgr.a (mgr.14355) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:34:46.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:45 smithi131 bash[24745]: cluster 2024-09-13T22:34:44.243415+0000 mgr.a (mgr.14355) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:34:46.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:45 smithi171 bash[25040]: cluster 2024-09-13T22:34:44.243415+0000 mgr.a (mgr.14355) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:34:48.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:47 smithi007 bash[22722]: cluster 2024-09-13T22:34:46.245730+0000 mgr.a (mgr.14355) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:34:48.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:47 smithi131 bash[24745]: cluster 2024-09-13T22:34:46.245730+0000 mgr.a (mgr.14355) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:34:48.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:47 smithi171 bash[25040]: cluster 2024-09-13T22:34:46.245730+0000 mgr.a (mgr.14355) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:34:49.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:49.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:49.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:49.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:50.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:49 smithi007 bash[22722]: cluster 2024-09-13T22:34:48.246478+0000 mgr.a (mgr.14355) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:50.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:49 smithi131 bash[24745]: cluster 2024-09-13T22:34:48.246478+0000 mgr.a (mgr.14355) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:50.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:49 smithi171 bash[25040]: cluster 2024-09-13T22:34:48.246478+0000 mgr.a (mgr.14355) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:51.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:50 smithi007 bash[22722]: audit 2024-09-13T22:34:49.419653+0000 mgr.a (mgr.14355) 604 : audit [DBG] from='client.26565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:51.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:50 smithi131 bash[24745]: audit 2024-09-13T22:34:49.419653+0000 mgr.a (mgr.14355) 604 : audit [DBG] from='client.26565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:51.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:50 smithi171 bash[25040]: audit 2024-09-13T22:34:49.419653+0000 mgr.a (mgr.14355) 604 : audit [DBG] from='client.26565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:52.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:51 smithi007 bash[22722]: cluster 2024-09-13T22:34:50.247342+0000 mgr.a (mgr.14355) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:52.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:51 smithi131 bash[24745]: cluster 2024-09-13T22:34:50.247342+0000 mgr.a (mgr.14355) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:52.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:51 smithi171 bash[25040]: cluster 2024-09-13T22:34:50.247342+0000 mgr.a (mgr.14355) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:54.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:53 smithi007 bash[22722]: cluster 2024-09-13T22:34:52.249576+0000 mgr.a (mgr.14355) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:54.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:53 smithi131 bash[24745]: cluster 2024-09-13T22:34:52.249576+0000 mgr.a (mgr.14355) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:54.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:53 smithi171 bash[25040]: cluster 2024-09-13T22:34:52.249576+0000 mgr.a (mgr.14355) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:34:54.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:34:54.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:34:54.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:34:55.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:34:55.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:34:55.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:34:55.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:34:55.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:34:56.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:55 smithi007 bash[22722]: cluster 2024-09-13T22:34:54.250367+0000 mgr.a (mgr.14355) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:56.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:55 smithi007 bash[22722]: audit 2024-09-13T22:34:55.170478+0000 mgr.a (mgr.14355) 608 : audit [DBG] from='client.26643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:56.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:55 smithi131 bash[24745]: cluster 2024-09-13T22:34:54.250367+0000 mgr.a (mgr.14355) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:56.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:55 smithi131 bash[24745]: audit 2024-09-13T22:34:55.170478+0000 mgr.a (mgr.14355) 608 : audit [DBG] from='client.26643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:56.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:55 smithi171 bash[25040]: cluster 2024-09-13T22:34:54.250367+0000 mgr.a (mgr.14355) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:56.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:55 smithi171 bash[25040]: audit 2024-09-13T22:34:55.170478+0000 mgr.a (mgr.14355) 608 : audit [DBG] from='client.26643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:34:58.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:57 smithi007 bash[22722]: cluster 2024-09-13T22:34:56.253065+0000 mgr.a (mgr.14355) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:58.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:57 smithi131 bash[24745]: cluster 2024-09-13T22:34:56.253065+0000 mgr.a (mgr.14355) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:34:58.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:57 smithi171 bash[25040]: cluster 2024-09-13T22:34:56.253065+0000 mgr.a (mgr.14355) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:00.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:34:59 smithi007 bash[22722]: cluster 2024-09-13T22:34:58.253847+0000 mgr.a (mgr.14355) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:00.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:34:59 smithi131 bash[24745]: cluster 2024-09-13T22:34:58.253847+0000 mgr.a (mgr.14355) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:00.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:34:59 smithi171 bash[25040]: cluster 2024-09-13T22:34:58.253847+0000 mgr.a (mgr.14355) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:00.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:00.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:01.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:01.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:01.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:01 smithi007 bash[22722]: cluster 2024-09-13T22:35:00.254609+0000 mgr.a (mgr.14355) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:35:01.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:01 smithi007 bash[22722]: audit 2024-09-13T22:35:00.929168+0000 mgr.a (mgr.14355) 612 : audit [DBG] from='client.26721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:02.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:01 smithi131 bash[24745]: cluster 2024-09-13T22:35:00.254609+0000 mgr.a (mgr.14355) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:35:02.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:01 smithi131 bash[24745]: audit 2024-09-13T22:35:00.929168+0000 mgr.a (mgr.14355) 612 : audit [DBG] from='client.26721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:01 smithi171 bash[25040]: cluster 2024-09-13T22:35:00.254609+0000 mgr.a (mgr.14355) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:35:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:01 smithi171 bash[25040]: audit 2024-09-13T22:35:00.929168+0000 mgr.a (mgr.14355) 612 : audit [DBG] from='client.26721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:04.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:03 smithi007 bash[22722]: cluster 2024-09-13T22:35:02.257382+0000 mgr.a (mgr.14355) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:04.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:03 smithi131 bash[24745]: cluster 2024-09-13T22:35:02.257382+0000 mgr.a (mgr.14355) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:04.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:03 smithi171 bash[25040]: cluster 2024-09-13T22:35:02.257382+0000 mgr.a (mgr.14355) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:05 smithi007 bash[22722]: cluster 2024-09-13T22:35:04.258229+0000 mgr.a (mgr.14355) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:06.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:05 smithi131 bash[24745]: cluster 2024-09-13T22:35:04.258229+0000 mgr.a (mgr.14355) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:06.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:05 smithi171 bash[25040]: cluster 2024-09-13T22:35:04.258229+0000 mgr.a (mgr.14355) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:35:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:07.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:07.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:07.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:07 smithi007 bash[22722]: cluster 2024-09-13T22:35:06.260237+0000 mgr.a (mgr.14355) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:07 smithi007 bash[22722]: audit 2024-09-13T22:35:06.667385+0000 mgr.a (mgr.14355) 616 : audit [DBG] from='client.26799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:08.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:07 smithi131 bash[24745]: cluster 2024-09-13T22:35:06.260237+0000 mgr.a (mgr.14355) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:08.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:07 smithi131 bash[24745]: audit 2024-09-13T22:35:06.667385+0000 mgr.a (mgr.14355) 616 : audit [DBG] from='client.26799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:08.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:07 smithi171 bash[25040]: cluster 2024-09-13T22:35:06.260237+0000 mgr.a (mgr.14355) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:08.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:07 smithi171 bash[25040]: audit 2024-09-13T22:35:06.667385+0000 mgr.a (mgr.14355) 616 : audit [DBG] from='client.26799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:09 smithi007 bash[22722]: cluster 2024-09-13T22:35:08.261116+0000 mgr.a (mgr.14355) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:10.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:09 smithi131 bash[24745]: cluster 2024-09-13T22:35:08.261116+0000 mgr.a (mgr.14355) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:10.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:09 smithi171 bash[25040]: cluster 2024-09-13T22:35:08.261116+0000 mgr.a (mgr.14355) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:12.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:12.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:12.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:11 smithi007 bash[22722]: cluster 2024-09-13T22:35:10.261865+0000 mgr.a (mgr.14355) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:12.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:11 smithi131 bash[24745]: cluster 2024-09-13T22:35:10.261865+0000 mgr.a (mgr.14355) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:12.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:11 smithi171 bash[25040]: cluster 2024-09-13T22:35:10.261865+0000 mgr.a (mgr.14355) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:12.839 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:12.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:12.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:12.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:12.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:13 smithi007 bash[22722]: cluster 2024-09-13T22:35:12.264021+0000 mgr.a (mgr.14355) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:13 smithi007 bash[22722]: audit 2024-09-13T22:35:12.412104+0000 mgr.a (mgr.14355) 620 : audit [DBG] from='client.26871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:14.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:13 smithi131 bash[24745]: cluster 2024-09-13T22:35:12.264021+0000 mgr.a (mgr.14355) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:14.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:13 smithi131 bash[24745]: audit 2024-09-13T22:35:12.412104+0000 mgr.a (mgr.14355) 620 : audit [DBG] from='client.26871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:14.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:13 smithi171 bash[25040]: cluster 2024-09-13T22:35:12.264021+0000 mgr.a (mgr.14355) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:14.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:13 smithi171 bash[25040]: audit 2024-09-13T22:35:12.412104+0000 mgr.a (mgr.14355) 620 : audit [DBG] from='client.26871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:16.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:15 smithi007 bash[22722]: cluster 2024-09-13T22:35:14.265000+0000 mgr.a (mgr.14355) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:16.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:15 smithi131 bash[24745]: cluster 2024-09-13T22:35:14.265000+0000 mgr.a (mgr.14355) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:16.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:15 smithi171 bash[25040]: cluster 2024-09-13T22:35:14.265000+0000 mgr.a (mgr.14355) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:18.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:17 smithi007 bash[22722]: cluster 2024-09-13T22:35:16.267326+0000 mgr.a (mgr.14355) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:18.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:17 smithi131 bash[24745]: cluster 2024-09-13T22:35:16.267326+0000 mgr.a (mgr.14355) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:18.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:17 smithi171 bash[25040]: cluster 2024-09-13T22:35:16.267326+0000 mgr.a (mgr.14355) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:18.580 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:18.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:19.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:18 smithi007 bash[22722]: audit 2024-09-13T22:35:18.170857+0000 mgr.a (mgr.14355) 623 : audit [DBG] from='client.26946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:19.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:18 smithi131 bash[24745]: audit 2024-09-13T22:35:18.170857+0000 mgr.a (mgr.14355) 623 : audit [DBG] from='client.26946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:19.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:18 smithi171 bash[25040]: audit 2024-09-13T22:35:18.170857+0000 mgr.a (mgr.14355) 623 : audit [DBG] from='client.26946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:20.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:19 smithi007 bash[22722]: cluster 2024-09-13T22:35:18.267783+0000 mgr.a (mgr.14355) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:20.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:19 smithi131 bash[24745]: cluster 2024-09-13T22:35:18.267783+0000 mgr.a (mgr.14355) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:20.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:19 smithi171 bash[25040]: cluster 2024-09-13T22:35:18.267783+0000 mgr.a (mgr.14355) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:22.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:21 smithi007 bash[22722]: cluster 2024-09-13T22:35:20.268687+0000 mgr.a (mgr.14355) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:22.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:21 smithi131 bash[24745]: cluster 2024-09-13T22:35:20.268687+0000 mgr.a (mgr.14355) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:22.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:21 smithi171 bash[25040]: cluster 2024-09-13T22:35:20.268687+0000 mgr.a (mgr.14355) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:23.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:24.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:23 smithi007 bash[22722]: cluster 2024-09-13T22:35:22.270992+0000 mgr.a (mgr.14355) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:24.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:23 smithi131 bash[24745]: cluster 2024-09-13T22:35:22.270992+0000 mgr.a (mgr.14355) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:24.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:23 smithi171 bash[25040]: cluster 2024-09-13T22:35:22.270992+0000 mgr.a (mgr.14355) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:24.335 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:24.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:24.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:24.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:25.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:24 smithi007 bash[22722]: audit 2024-09-13T22:35:23.915550+0000 mgr.a (mgr.14355) 627 : audit [DBG] from='client.27018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:25.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:24 smithi131 bash[24745]: audit 2024-09-13T22:35:23.915550+0000 mgr.a (mgr.14355) 627 : audit [DBG] from='client.27018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:25.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:24 smithi171 bash[25040]: audit 2024-09-13T22:35:23.915550+0000 mgr.a (mgr.14355) 627 : audit [DBG] from='client.27018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:26.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:25 smithi007 bash[22722]: cluster 2024-09-13T22:35:24.271914+0000 mgr.a (mgr.14355) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:26.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:25 smithi131 bash[24745]: cluster 2024-09-13T22:35:24.271914+0000 mgr.a (mgr.14355) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:26.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:25 smithi171 bash[25040]: cluster 2024-09-13T22:35:24.271914+0000 mgr.a (mgr.14355) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:27 smithi007 bash[22722]: cluster 2024-09-13T22:35:26.274193+0000 mgr.a (mgr.14355) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:28.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:27 smithi131 bash[24745]: cluster 2024-09-13T22:35:26.274193+0000 mgr.a (mgr.14355) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:28.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:27 smithi171 bash[25040]: cluster 2024-09-13T22:35:26.274193+0000 mgr.a (mgr.14355) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:29.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:30.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:30.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:30.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:29 smithi007 bash[22722]: cluster 2024-09-13T22:35:28.275026+0000 mgr.a (mgr.14355) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:30.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:29 smithi131 bash[24745]: cluster 2024-09-13T22:35:28.275026+0000 mgr.a (mgr.14355) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:30.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:29 smithi171 bash[25040]: cluster 2024-09-13T22:35:28.275026+0000 mgr.a (mgr.14355) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:31.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:30 smithi007 bash[22722]: audit 2024-09-13T22:35:29.677236+0000 mgr.a (mgr.14355) 631 : audit [DBG] from='client.27096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:31.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:30 smithi007 bash[22722]: audit 2024-09-13T22:35:30.575690+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:35:31.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:30 smithi131 bash[24745]: audit 2024-09-13T22:35:29.677236+0000 mgr.a (mgr.14355) 631 : audit [DBG] from='client.27096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:31.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:30 smithi131 bash[24745]: audit 2024-09-13T22:35:30.575690+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:35:31.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:30 smithi171 bash[25040]: audit 2024-09-13T22:35:29.677236+0000 mgr.a (mgr.14355) 631 : audit [DBG] from='client.27096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:31.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:30 smithi171 bash[25040]: audit 2024-09-13T22:35:30.575690+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:35:32 smithi007 bash[22972]: debug 2024-09-13T22:35:32.158+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:35:32 smithi007 bash[22972]: debug 2024-09-13T22:35:32.158+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:31 smithi007 bash[22722]: cluster 2024-09-13T22:35:30.275968+0000 mgr.a (mgr.14355) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:31 smithi007 bash[22722]: audit 2024-09-13T22:35:31.427488+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:31 smithi007 bash[22722]: audit 2024-09-13T22:35:31.429183+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:31 smithi007 bash[22722]: audit 2024-09-13T22:35:31.437786+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:35:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:31 smithi007 bash[22722]: audit 2024-09-13T22:35:31.442737+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:32.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:31 smithi131 bash[24745]: cluster 2024-09-13T22:35:30.275968+0000 mgr.a (mgr.14355) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:31 smithi131 bash[24745]: audit 2024-09-13T22:35:31.427488+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:35:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:31 smithi131 bash[24745]: audit 2024-09-13T22:35:31.429183+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:35:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:31 smithi131 bash[24745]: audit 2024-09-13T22:35:31.437786+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:35:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:31 smithi131 bash[24745]: audit 2024-09-13T22:35:31.442737+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:31 smithi171 bash[25040]: cluster 2024-09-13T22:35:30.275968+0000 mgr.a (mgr.14355) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:31 smithi171 bash[25040]: audit 2024-09-13T22:35:31.427488+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:35:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:31 smithi171 bash[25040]: audit 2024-09-13T22:35:31.429183+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:35:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:31 smithi171 bash[25040]: audit 2024-09-13T22:35:31.437786+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:35:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:31 smithi171 bash[25040]: audit 2024-09-13T22:35:31.442737+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:32 smithi007 bash[22722]: audit 2024-09-13T22:35:31.445106+0000 mgr.a (mgr.14355) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:32 smithi007 bash[22722]: audit 2024-09-13T22:35:32.163261+0000 mgr.a (mgr.14355) 634 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:35:33.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:32 smithi007 bash[22722]: cephadm 2024-09-13T22:35:32.164613+0000 mgr.a (mgr.14355) 635 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:35:33.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:32 smithi131 bash[24745]: audit 2024-09-13T22:35:31.445106+0000 mgr.a (mgr.14355) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:33.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:32 smithi131 bash[24745]: audit 2024-09-13T22:35:32.163261+0000 mgr.a (mgr.14355) 634 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:35:33.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:32 smithi131 bash[24745]: cephadm 2024-09-13T22:35:32.164613+0000 mgr.a (mgr.14355) 635 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:35:33.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:32 smithi171 bash[25040]: audit 2024-09-13T22:35:31.445106+0000 mgr.a (mgr.14355) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:35:33.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:32 smithi171 bash[25040]: audit 2024-09-13T22:35:32.163261+0000 mgr.a (mgr.14355) 634 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:35:33.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:32 smithi171 bash[25040]: cephadm 2024-09-13T22:35:32.164613+0000 mgr.a (mgr.14355) 635 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:35:34.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:33 smithi007 bash[22722]: cluster 2024-09-13T22:35:32.278675+0000 mgr.a (mgr.14355) 636 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:34.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:33 smithi131 bash[24745]: cluster 2024-09-13T22:35:32.278675+0000 mgr.a (mgr.14355) 636 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:34.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:33 smithi171 bash[25040]: cluster 2024-09-13T22:35:32.278675+0000 mgr.a (mgr.14355) 636 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:35.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:35.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:35.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:35.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:35.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:35 smithi007 bash[22722]: cluster 2024-09-13T22:35:34.279459+0000 mgr.a (mgr.14355) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:36.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:35 smithi131 bash[24745]: cluster 2024-09-13T22:35:34.279459+0000 mgr.a (mgr.14355) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:36.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:35 smithi171 bash[25040]: cluster 2024-09-13T22:35:34.279459+0000 mgr.a (mgr.14355) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:37.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:36 smithi007 bash[22722]: audit 2024-09-13T22:35:35.442325+0000 mgr.a (mgr.14355) 638 : audit [DBG] from='client.27279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:37.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:36 smithi131 bash[24745]: audit 2024-09-13T22:35:35.442325+0000 mgr.a (mgr.14355) 638 : audit [DBG] from='client.27279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:37.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:36 smithi171 bash[25040]: audit 2024-09-13T22:35:35.442325+0000 mgr.a (mgr.14355) 638 : audit [DBG] from='client.27279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:37 smithi007 bash[22722]: cluster 2024-09-13T22:35:36.282319+0000 mgr.a (mgr.14355) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:38.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:37 smithi131 bash[24745]: cluster 2024-09-13T22:35:36.282319+0000 mgr.a (mgr.14355) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:37 smithi171 bash[25040]: cluster 2024-09-13T22:35:36.282319+0000 mgr.a (mgr.14355) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:40.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:39 smithi131 bash[24745]: cluster 2024-09-13T22:35:38.283128+0000 mgr.a (mgr.14355) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:40.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:39 smithi171 bash[25040]: cluster 2024-09-13T22:35:38.283128+0000 mgr.a (mgr.14355) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:40.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:39 smithi007 bash[22722]: cluster 2024-09-13T22:35:38.283128+0000 mgr.a (mgr.14355) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:41.628 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:41.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:42.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:41 smithi131 bash[24745]: cluster 2024-09-13T22:35:40.283894+0000 mgr.a (mgr.14355) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:42.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:41 smithi131 bash[24745]: audit 2024-09-13T22:35:41.189709+0000 mgr.a (mgr.14355) 642 : audit [DBG] from='client.27354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:42.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:41 smithi171 bash[25040]: cluster 2024-09-13T22:35:40.283894+0000 mgr.a (mgr.14355) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:42.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:41 smithi171 bash[25040]: audit 2024-09-13T22:35:41.189709+0000 mgr.a (mgr.14355) 642 : audit [DBG] from='client.27354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:41 smithi007 bash[22722]: cluster 2024-09-13T22:35:40.283894+0000 mgr.a (mgr.14355) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:41 smithi007 bash[22722]: audit 2024-09-13T22:35:41.189709+0000 mgr.a (mgr.14355) 642 : audit [DBG] from='client.27354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:44.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:43 smithi131 bash[24745]: cluster 2024-09-13T22:35:42.286702+0000 mgr.a (mgr.14355) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:44.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:43 smithi171 bash[25040]: cluster 2024-09-13T22:35:42.286702+0000 mgr.a (mgr.14355) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:43 smithi007 bash[22722]: cluster 2024-09-13T22:35:42.286702+0000 mgr.a (mgr.14355) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:46.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:45 smithi131 bash[24745]: cluster 2024-09-13T22:35:44.287480+0000 mgr.a (mgr.14355) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:46.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:45 smithi171 bash[25040]: cluster 2024-09-13T22:35:44.287480+0000 mgr.a (mgr.14355) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:46.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:45 smithi007 bash[22722]: cluster 2024-09-13T22:35:44.287480+0000 mgr.a (mgr.14355) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:35:46.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:47.371 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:47.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:47.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:47.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:48.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:47 smithi131 bash[24745]: cluster 2024-09-13T22:35:46.289596+0000 mgr.a (mgr.14355) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:48.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:47 smithi131 bash[24745]: audit 2024-09-13T22:35:46.964904+0000 mgr.a (mgr.14355) 646 : audit [DBG] from='client.27429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:48.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:47 smithi171 bash[25040]: cluster 2024-09-13T22:35:46.289596+0000 mgr.a (mgr.14355) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:48.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:47 smithi171 bash[25040]: audit 2024-09-13T22:35:46.964904+0000 mgr.a (mgr.14355) 646 : audit [DBG] from='client.27429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:48.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:47 smithi007 bash[22722]: cluster 2024-09-13T22:35:46.289596+0000 mgr.a (mgr.14355) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:35:48.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:47 smithi007 bash[22722]: audit 2024-09-13T22:35:46.964904+0000 mgr.a (mgr.14355) 646 : audit [DBG] from='client.27429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:50.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:49 smithi131 bash[24745]: cluster 2024-09-13T22:35:48.290700+0000 mgr.a (mgr.14355) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:50.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:49 smithi171 bash[25040]: cluster 2024-09-13T22:35:48.290700+0000 mgr.a (mgr.14355) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:50.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:49 smithi007 bash[22722]: cluster 2024-09-13T22:35:48.290700+0000 mgr.a (mgr.14355) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:52.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:51 smithi131 bash[24745]: cluster 2024-09-13T22:35:50.291656+0000 mgr.a (mgr.14355) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:52.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:51 smithi171 bash[25040]: cluster 2024-09-13T22:35:50.291656+0000 mgr.a (mgr.14355) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:52.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:52.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:51 smithi007 bash[22722]: cluster 2024-09-13T22:35:50.291656+0000 mgr.a (mgr.14355) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:53.130 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:53.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:35:54.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:53 smithi131 bash[24745]: cluster 2024-09-13T22:35:52.293915+0000 mgr.a (mgr.14355) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:54.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:53 smithi131 bash[24745]: audit 2024-09-13T22:35:52.710123+0000 mgr.a (mgr.14355) 650 : audit [DBG] from='client.27507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:54.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:53 smithi171 bash[25040]: cluster 2024-09-13T22:35:52.293915+0000 mgr.a (mgr.14355) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:54.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:53 smithi171 bash[25040]: audit 2024-09-13T22:35:52.710123+0000 mgr.a (mgr.14355) 650 : audit [DBG] from='client.27507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:53 smithi007 bash[22722]: cluster 2024-09-13T22:35:52.293915+0000 mgr.a (mgr.14355) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:53 smithi007 bash[22722]: audit 2024-09-13T22:35:52.710123+0000 mgr.a (mgr.14355) 650 : audit [DBG] from='client.27507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:35:56.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:55 smithi131 bash[24745]: cluster 2024-09-13T22:35:54.295019+0000 mgr.a (mgr.14355) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:56.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:55 smithi171 bash[25040]: cluster 2024-09-13T22:35:54.295019+0000 mgr.a (mgr.14355) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:56.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:55 smithi007 bash[22722]: cluster 2024-09-13T22:35:54.295019+0000 mgr.a (mgr.14355) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:35:58.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:35:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:35:58.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:35:58.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:35:58 smithi131 bash[24745]: cluster 2024-09-13T22:35:56.297330+0000 mgr.a (mgr.14355) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:58.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:35:57 smithi171 bash[25040]: cluster 2024-09-13T22:35:56.297330+0000 mgr.a (mgr.14355) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:35:57 smithi007 bash[22722]: cluster 2024-09-13T22:35:56.297330+0000 mgr.a (mgr.14355) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:35:58.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:35:58.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:35:58.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:35:58.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:35:58.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:00.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:00 smithi131 bash[24745]: cluster 2024-09-13T22:35:58.298082+0000 mgr.a (mgr.14355) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:00.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:00 smithi131 bash[24745]: audit 2024-09-13T22:35:58.468797+0000 mgr.a (mgr.14355) 654 : audit [DBG] from='client.27585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:00.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:00 smithi171 bash[25040]: cluster 2024-09-13T22:35:58.298082+0000 mgr.a (mgr.14355) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:00.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:00 smithi171 bash[25040]: audit 2024-09-13T22:35:58.468797+0000 mgr.a (mgr.14355) 654 : audit [DBG] from='client.27585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:00 smithi007 bash[22722]: cluster 2024-09-13T22:35:58.298082+0000 mgr.a (mgr.14355) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:00 smithi007 bash[22722]: audit 2024-09-13T22:35:58.468797+0000 mgr.a (mgr.14355) 654 : audit [DBG] from='client.27585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:02.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:02 smithi131 bash[24745]: cluster 2024-09-13T22:36:00.299147+0000 mgr.a (mgr.14355) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:02 smithi171 bash[25040]: cluster 2024-09-13T22:36:00.299147+0000 mgr.a (mgr.14355) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:02.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:02 smithi007 bash[22722]: cluster 2024-09-13T22:36:00.299147+0000 mgr.a (mgr.14355) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:03.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:03.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:03.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:04.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:04 smithi131 bash[24745]: cluster 2024-09-13T22:36:02.301619+0000 mgr.a (mgr.14355) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:04.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:04 smithi171 bash[25040]: cluster 2024-09-13T22:36:02.301619+0000 mgr.a (mgr.14355) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:04.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:04 smithi007 bash[22722]: cluster 2024-09-13T22:36:02.301619+0000 mgr.a (mgr.14355) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:04.642 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:04.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:04.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:04.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:04.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:05.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:05 smithi131 bash[24745]: audit 2024-09-13T22:36:04.236877+0000 mgr.a (mgr.14355) 657 : audit [DBG] from='client.27660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:05.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:05 smithi171 bash[25040]: audit 2024-09-13T22:36:04.236877+0000 mgr.a (mgr.14355) 657 : audit [DBG] from='client.27660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:05.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:05 smithi007 bash[22722]: audit 2024-09-13T22:36:04.236877+0000 mgr.a (mgr.14355) 657 : audit [DBG] from='client.27660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:06.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:06 smithi131 bash[24745]: cluster 2024-09-13T22:36:04.302370+0000 mgr.a (mgr.14355) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:06.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:06 smithi171 bash[25040]: cluster 2024-09-13T22:36:04.302370+0000 mgr.a (mgr.14355) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:06.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:06 smithi007 bash[22722]: cluster 2024-09-13T22:36:04.302370+0000 mgr.a (mgr.14355) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:08.276 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:08 smithi131 bash[24745]: cluster 2024-09-13T22:36:06.304706+0000 mgr.a (mgr.14355) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:08.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:08 smithi171 bash[25040]: cluster 2024-09-13T22:36:06.304706+0000 mgr.a (mgr.14355) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:08 smithi007 bash[22722]: cluster 2024-09-13T22:36:06.304706+0000 mgr.a (mgr.14355) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:09.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:09.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:09.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:10.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:10 smithi171 bash[25040]: cluster 2024-09-13T22:36:08.305511+0000 mgr.a (mgr.14355) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:10.398 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:10.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:10.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:10 smithi007 bash[22722]: cluster 2024-09-13T22:36:08.305511+0000 mgr.a (mgr.14355) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:10.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:10 smithi131 bash[24745]: cluster 2024-09-13T22:36:08.305511+0000 mgr.a (mgr.14355) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:11.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:11 smithi171 bash[25040]: audit 2024-09-13T22:36:09.981976+0000 mgr.a (mgr.14355) 661 : audit [DBG] from='client.27738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:11.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:11 smithi007 bash[22722]: audit 2024-09-13T22:36:09.981976+0000 mgr.a (mgr.14355) 661 : audit [DBG] from='client.27738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:11.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:11 smithi131 bash[24745]: audit 2024-09-13T22:36:09.981976+0000 mgr.a (mgr.14355) 661 : audit [DBG] from='client.27738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:12.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:12 smithi171 bash[25040]: cluster 2024-09-13T22:36:10.306222+0000 mgr.a (mgr.14355) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:12.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:12 smithi007 bash[22722]: cluster 2024-09-13T22:36:10.306222+0000 mgr.a (mgr.14355) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:12.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:12 smithi131 bash[24745]: cluster 2024-09-13T22:36:10.306222+0000 mgr.a (mgr.14355) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:14.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:14 smithi007 bash[22722]: cluster 2024-09-13T22:36:12.308462+0000 mgr.a (mgr.14355) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:36:14.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:14 smithi131 bash[24745]: cluster 2024-09-13T22:36:12.308462+0000 mgr.a (mgr.14355) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:36:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:14 smithi171 bash[25040]: cluster 2024-09-13T22:36:12.308462+0000 mgr.a (mgr.14355) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:36:15.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:15.401 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:16.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:16.173 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:16.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:16 smithi007 bash[22722]: cluster 2024-09-13T22:36:14.309183+0000 mgr.a (mgr.14355) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:36:16.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:16 smithi131 bash[24745]: cluster 2024-09-13T22:36:14.309183+0000 mgr.a (mgr.14355) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:36:16.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:16 smithi171 bash[25040]: cluster 2024-09-13T22:36:14.309183+0000 mgr.a (mgr.14355) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:36:17.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:17 smithi007 bash[22722]: audit 2024-09-13T22:36:15.742006+0000 mgr.a (mgr.14355) 665 : audit [DBG] from='client.27816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:17.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:17 smithi131 bash[24745]: audit 2024-09-13T22:36:15.742006+0000 mgr.a (mgr.14355) 665 : audit [DBG] from='client.27816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:17.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:17 smithi171 bash[25040]: audit 2024-09-13T22:36:15.742006+0000 mgr.a (mgr.14355) 665 : audit [DBG] from='client.27816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:18 smithi007 bash[22722]: cluster 2024-09-13T22:36:16.311905+0000 mgr.a (mgr.14355) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:18.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:18 smithi131 bash[24745]: cluster 2024-09-13T22:36:16.311905+0000 mgr.a (mgr.14355) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:18.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:18 smithi171 bash[25040]: cluster 2024-09-13T22:36:16.311905+0000 mgr.a (mgr.14355) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:20 smithi007 bash[22722]: cluster 2024-09-13T22:36:18.312706+0000 mgr.a (mgr.14355) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:36:20.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:20 smithi131 bash[24745]: cluster 2024-09-13T22:36:18.312706+0000 mgr.a (mgr.14355) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:36:20.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:20 smithi171 bash[25040]: cluster 2024-09-13T22:36:18.312706+0000 mgr.a (mgr.14355) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:36:21.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:21.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:21.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:21.913 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:21.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:21.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:21.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:21.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:22.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:22 smithi007 bash[22722]: cluster 2024-09-13T22:36:20.314366+0000 mgr.a (mgr.14355) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:36:22.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:22 smithi131 bash[24745]: cluster 2024-09-13T22:36:20.314366+0000 mgr.a (mgr.14355) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:36:22.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:22 smithi171 bash[25040]: cluster 2024-09-13T22:36:20.314366+0000 mgr.a (mgr.14355) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:36:23.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:23 smithi007 bash[22722]: audit 2024-09-13T22:36:21.506894+0000 mgr.a (mgr.14355) 669 : audit [DBG] from='client.27894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:23.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:23 smithi131 bash[24745]: audit 2024-09-13T22:36:21.506894+0000 mgr.a (mgr.14355) 669 : audit [DBG] from='client.27894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:23.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:23 smithi171 bash[25040]: audit 2024-09-13T22:36:21.506894+0000 mgr.a (mgr.14355) 669 : audit [DBG] from='client.27894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:24 smithi007 bash[22722]: cluster 2024-09-13T22:36:22.316262+0000 mgr.a (mgr.14355) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:24.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:24 smithi131 bash[24745]: cluster 2024-09-13T22:36:22.316262+0000 mgr.a (mgr.14355) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:24.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:24 smithi171 bash[25040]: cluster 2024-09-13T22:36:22.316262+0000 mgr.a (mgr.14355) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:26.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:26 smithi007 bash[22722]: cluster 2024-09-13T22:36:24.317059+0000 mgr.a (mgr.14355) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:36:26.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:26 smithi131 bash[24745]: cluster 2024-09-13T22:36:24.317059+0000 mgr.a (mgr.14355) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:36:26.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:26 smithi171 bash[25040]: cluster 2024-09-13T22:36:24.317059+0000 mgr.a (mgr.14355) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:36:26.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:26.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:27.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:27.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:27.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:27.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:27.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:28.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:28 smithi007 bash[22722]: cluster 2024-09-13T22:36:26.319184+0000 mgr.a (mgr.14355) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:36:28.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:28 smithi007 bash[22722]: audit 2024-09-13T22:36:27.250470+0000 mgr.a (mgr.14355) 673 : audit [DBG] from='client.27972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:28.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:28 smithi131 bash[24745]: cluster 2024-09-13T22:36:26.319184+0000 mgr.a (mgr.14355) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:36:28.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:28 smithi131 bash[24745]: audit 2024-09-13T22:36:27.250470+0000 mgr.a (mgr.14355) 673 : audit [DBG] from='client.27972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:28.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:28 smithi171 bash[25040]: cluster 2024-09-13T22:36:26.319184+0000 mgr.a (mgr.14355) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:36:28.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:28 smithi171 bash[25040]: audit 2024-09-13T22:36:27.250470+0000 mgr.a (mgr.14355) 673 : audit [DBG] from='client.27972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:30 smithi007 bash[22722]: cluster 2024-09-13T22:36:28.320139+0000 mgr.a (mgr.14355) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:30.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:30 smithi131 bash[24745]: cluster 2024-09-13T22:36:28.320139+0000 mgr.a (mgr.14355) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:30.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:30 smithi171 bash[25040]: cluster 2024-09-13T22:36:28.320139+0000 mgr.a (mgr.14355) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:32.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:32 smithi007 bash[22722]: cluster 2024-09-13T22:36:30.322374+0000 mgr.a (mgr.14355) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:32.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:32 smithi131 bash[24745]: cluster 2024-09-13T22:36:30.322374+0000 mgr.a (mgr.14355) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:32.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:32 smithi171 bash[25040]: cluster 2024-09-13T22:36:30.322374+0000 mgr.a (mgr.14355) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:36:32.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:32.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:32.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:33.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:33.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:33 smithi007 bash[22722]: audit 2024-09-13T22:36:32.214993+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:36:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:33 smithi007 bash[22722]: audit 2024-09-13T22:36:32.833810+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:33.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:33 smithi007 bash[22722]: audit 2024-09-13T22:36:32.838282+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:33.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:33 smithi131 bash[24745]: audit 2024-09-13T22:36:32.214993+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:36:33.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:33 smithi131 bash[24745]: audit 2024-09-13T22:36:32.833810+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:33.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:33 smithi131 bash[24745]: audit 2024-09-13T22:36:32.838282+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:33.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:33 smithi171 bash[25040]: audit 2024-09-13T22:36:32.214993+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:36:33.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:33 smithi171 bash[25040]: audit 2024-09-13T22:36:32.833810+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:33.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:33 smithi171 bash[25040]: audit 2024-09-13T22:36:32.838282+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:34.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22972]: debug 2024-09-13T22:36:34.145+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:36:34.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22972]: debug 2024-09-13T22:36:34.145+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:36:34.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: cluster 2024-09-13T22:36:32.323136+0000 mgr.a (mgr.14355) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:36:34.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: audit 2024-09-13T22:36:32.991246+0000 mgr.a (mgr.14355) 677 : audit [DBG] from='client.28050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:34.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: audit 2024-09-13T22:36:33.471744+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:36:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: audit 2024-09-13T22:36:33.472549+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:36:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: audit 2024-09-13T22:36:33.477633+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:34 smithi007 bash[22722]: audit 2024-09-13T22:36:33.479690+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:34.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: cluster 2024-09-13T22:36:32.323136+0000 mgr.a (mgr.14355) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:36:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: audit 2024-09-13T22:36:32.991246+0000 mgr.a (mgr.14355) 677 : audit [DBG] from='client.28050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: audit 2024-09-13T22:36:33.471744+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:36:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: audit 2024-09-13T22:36:33.472549+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:36:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: audit 2024-09-13T22:36:33.477633+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:34 smithi131 bash[24745]: audit 2024-09-13T22:36:33.479690+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: cluster 2024-09-13T22:36:32.323136+0000 mgr.a (mgr.14355) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:36:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: audit 2024-09-13T22:36:32.991246+0000 mgr.a (mgr.14355) 677 : audit [DBG] from='client.28050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: audit 2024-09-13T22:36:33.471744+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:36:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: audit 2024-09-13T22:36:33.472549+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:36:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: audit 2024-09-13T22:36:33.477633+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:36:34.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:34 smithi171 bash[25040]: audit 2024-09-13T22:36:33.479690+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:35.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:35 smithi007 bash[22722]: audit 2024-09-13T22:36:33.480676+0000 mgr.a (mgr.14355) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:35.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:35 smithi007 bash[22722]: audit 2024-09-13T22:36:34.146965+0000 mgr.a (mgr.14355) 679 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:36:35.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:35 smithi007 bash[22722]: cephadm 2024-09-13T22:36:34.148233+0000 mgr.a (mgr.14355) 680 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:36:35.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:35 smithi131 bash[24745]: audit 2024-09-13T22:36:33.480676+0000 mgr.a (mgr.14355) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:35.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:35 smithi131 bash[24745]: audit 2024-09-13T22:36:34.146965+0000 mgr.a (mgr.14355) 679 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:36:35.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:35 smithi131 bash[24745]: cephadm 2024-09-13T22:36:34.148233+0000 mgr.a (mgr.14355) 680 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:36:35.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:35 smithi171 bash[25040]: audit 2024-09-13T22:36:33.480676+0000 mgr.a (mgr.14355) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:36:35.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:35 smithi171 bash[25040]: audit 2024-09-13T22:36:34.146965+0000 mgr.a (mgr.14355) 679 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:36:35.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:35 smithi171 bash[25040]: cephadm 2024-09-13T22:36:34.148233+0000 mgr.a (mgr.14355) 680 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:36:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:36 smithi007 bash[22722]: cluster 2024-09-13T22:36:34.324024+0000 mgr.a (mgr.14355) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:36.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:36 smithi131 bash[24745]: cluster 2024-09-13T22:36:34.324024+0000 mgr.a (mgr.14355) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:36.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:36 smithi171 bash[25040]: cluster 2024-09-13T22:36:34.324024+0000 mgr.a (mgr.14355) 681 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:38 smithi007 bash[22722]: cluster 2024-09-13T22:36:36.326221+0000 mgr.a (mgr.14355) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:38.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:38 smithi131 bash[24745]: cluster 2024-09-13T22:36:36.326221+0000 mgr.a (mgr.14355) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:38.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:38 smithi171 bash[25040]: cluster 2024-09-13T22:36:36.326221+0000 mgr.a (mgr.14355) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:39.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:40.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:40 smithi007 bash[22722]: cluster 2024-09-13T22:36:38.327002+0000 mgr.a (mgr.14355) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:40.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:40 smithi007 bash[22722]: audit 2024-09-13T22:36:38.733457+0000 mgr.a (mgr.14355) 684 : audit [DBG] from='client.28233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:40.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:40 smithi131 bash[24745]: cluster 2024-09-13T22:36:38.327002+0000 mgr.a (mgr.14355) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:40.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:40 smithi131 bash[24745]: audit 2024-09-13T22:36:38.733457+0000 mgr.a (mgr.14355) 684 : audit [DBG] from='client.28233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:40.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:40 smithi171 bash[25040]: cluster 2024-09-13T22:36:38.327002+0000 mgr.a (mgr.14355) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:40.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:40 smithi171 bash[25040]: audit 2024-09-13T22:36:38.733457+0000 mgr.a (mgr.14355) 684 : audit [DBG] from='client.28233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:42 smithi007 bash[22722]: cluster 2024-09-13T22:36:40.329313+0000 mgr.a (mgr.14355) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:42.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:42 smithi131 bash[24745]: cluster 2024-09-13T22:36:40.329313+0000 mgr.a (mgr.14355) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:42.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:42 smithi171 bash[25040]: cluster 2024-09-13T22:36:40.329313+0000 mgr.a (mgr.14355) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:44.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:44 smithi007 bash[22722]: cluster 2024-09-13T22:36:42.330108+0000 mgr.a (mgr.14355) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:44.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:44 smithi131 bash[24745]: cluster 2024-09-13T22:36:42.330108+0000 mgr.a (mgr.14355) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:44.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:44 smithi171 bash[25040]: cluster 2024-09-13T22:36:42.330108+0000 mgr.a (mgr.14355) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:44.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:44.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:46.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:46 smithi007 bash[22722]: cluster 2024-09-13T22:36:44.330841+0000 mgr.a (mgr.14355) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:46.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:46 smithi007 bash[22722]: audit 2024-09-13T22:36:44.478433+0000 mgr.a (mgr.14355) 688 : audit [DBG] from='client.28311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:46.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:46 smithi131 bash[24745]: cluster 2024-09-13T22:36:44.330841+0000 mgr.a (mgr.14355) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:46.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:46 smithi131 bash[24745]: audit 2024-09-13T22:36:44.478433+0000 mgr.a (mgr.14355) 688 : audit [DBG] from='client.28311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:46.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:46 smithi171 bash[25040]: cluster 2024-09-13T22:36:44.330841+0000 mgr.a (mgr.14355) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:46.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:46 smithi171 bash[25040]: audit 2024-09-13T22:36:44.478433+0000 mgr.a (mgr.14355) 688 : audit [DBG] from='client.28311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:48.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:48 smithi007 bash[22722]: cluster 2024-09-13T22:36:46.333217+0000 mgr.a (mgr.14355) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:48.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:48 smithi131 bash[24745]: cluster 2024-09-13T22:36:46.333217+0000 mgr.a (mgr.14355) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:48.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:48 smithi171 bash[25040]: cluster 2024-09-13T22:36:46.333217+0000 mgr.a (mgr.14355) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:36:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:50.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:50 smithi007 bash[22722]: cluster 2024-09-13T22:36:48.334016+0000 mgr.a (mgr.14355) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:50.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:50 smithi131 bash[24745]: cluster 2024-09-13T22:36:48.334016+0000 mgr.a (mgr.14355) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:50.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:50 smithi171 bash[25040]: cluster 2024-09-13T22:36:48.334016+0000 mgr.a (mgr.14355) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:51.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:51 smithi007 bash[22722]: audit 2024-09-13T22:36:50.222651+0000 mgr.a (mgr.14355) 691 : audit [DBG] from='client.28389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:51.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:51 smithi131 bash[24745]: audit 2024-09-13T22:36:50.222651+0000 mgr.a (mgr.14355) 691 : audit [DBG] from='client.28389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:51.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:51 smithi171 bash[25040]: audit 2024-09-13T22:36:50.222651+0000 mgr.a (mgr.14355) 691 : audit [DBG] from='client.28389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:52 smithi007 bash[22722]: cluster 2024-09-13T22:36:50.335107+0000 mgr.a (mgr.14355) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:52.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:52 smithi131 bash[24745]: cluster 2024-09-13T22:36:50.335107+0000 mgr.a (mgr.14355) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:52.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:52 smithi171 bash[25040]: cluster 2024-09-13T22:36:50.335107+0000 mgr.a (mgr.14355) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:54 smithi007 bash[22722]: cluster 2024-09-13T22:36:52.335958+0000 mgr.a (mgr.14355) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:54.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:54 smithi131 bash[24745]: cluster 2024-09-13T22:36:52.335958+0000 mgr.a (mgr.14355) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:54.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:54 smithi171 bash[25040]: cluster 2024-09-13T22:36:52.335958+0000 mgr.a (mgr.14355) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:36:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:36:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:36:56.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:36:56.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:36:56.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:36:56.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:36:56.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:36:56.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:56 smithi007 bash[22722]: cluster 2024-09-13T22:36:54.336736+0000 mgr.a (mgr.14355) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:56.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:56 smithi131 bash[24745]: cluster 2024-09-13T22:36:54.336736+0000 mgr.a (mgr.14355) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:56.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:56 smithi171 bash[25040]: cluster 2024-09-13T22:36:54.336736+0000 mgr.a (mgr.14355) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:36:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:57 smithi007 bash[22722]: audit 2024-09-13T22:36:55.994682+0000 mgr.a (mgr.14355) 695 : audit [DBG] from='client.28467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:57.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:57 smithi131 bash[24745]: audit 2024-09-13T22:36:55.994682+0000 mgr.a (mgr.14355) 695 : audit [DBG] from='client.28467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:57.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:57 smithi171 bash[25040]: audit 2024-09-13T22:36:55.994682+0000 mgr.a (mgr.14355) 695 : audit [DBG] from='client.28467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:36:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:36:58 smithi007 bash[22722]: cluster 2024-09-13T22:36:56.338098+0000 mgr.a (mgr.14355) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:58.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:36:58 smithi131 bash[24745]: cluster 2024-09-13T22:36:56.338098+0000 mgr.a (mgr.14355) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:36:58.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:36:58 smithi171 bash[25040]: cluster 2024-09-13T22:36:56.338098+0000 mgr.a (mgr.14355) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:00 smithi007 bash[22722]: cluster 2024-09-13T22:36:58.338863+0000 mgr.a (mgr.14355) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:00.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:00 smithi131 bash[24745]: cluster 2024-09-13T22:36:58.338863+0000 mgr.a (mgr.14355) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:00.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:00 smithi171 bash[25040]: cluster 2024-09-13T22:36:58.338863+0000 mgr.a (mgr.14355) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:01.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:01.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:01.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:02.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:02.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:02.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:02.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:02.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:02.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:02 smithi007 bash[22722]: cluster 2024-09-13T22:37:00.340768+0000 mgr.a (mgr.14355) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:02.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:02 smithi131 bash[24745]: cluster 2024-09-13T22:37:00.340768+0000 mgr.a (mgr.14355) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:02.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:02 smithi171 bash[25040]: cluster 2024-09-13T22:37:00.340768+0000 mgr.a (mgr.14355) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:03.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:03 smithi007 bash[22722]: audit 2024-09-13T22:37:01.765699+0000 mgr.a (mgr.14355) 699 : audit [DBG] from='client.28539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:03.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:03 smithi131 bash[24745]: audit 2024-09-13T22:37:01.765699+0000 mgr.a (mgr.14355) 699 : audit [DBG] from='client.28539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:03.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:03 smithi171 bash[25040]: audit 2024-09-13T22:37:01.765699+0000 mgr.a (mgr.14355) 699 : audit [DBG] from='client.28539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:04.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:04 smithi007 bash[22722]: cluster 2024-09-13T22:37:02.341700+0000 mgr.a (mgr.14355) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:04.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:04 smithi131 bash[24745]: cluster 2024-09-13T22:37:02.341700+0000 mgr.a (mgr.14355) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:04.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:04 smithi171 bash[25040]: cluster 2024-09-13T22:37:02.341700+0000 mgr.a (mgr.14355) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:06.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:06 smithi007 bash[22722]: cluster 2024-09-13T22:37:04.342516+0000 mgr.a (mgr.14355) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:06.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:06 smithi131 bash[24745]: cluster 2024-09-13T22:37:04.342516+0000 mgr.a (mgr.14355) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:06.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:06 smithi171 bash[25040]: cluster 2024-09-13T22:37:04.342516+0000 mgr.a (mgr.14355) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:07.922 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:08 smithi007 bash[22722]: cluster 2024-09-13T22:37:06.344758+0000 mgr.a (mgr.14355) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:08.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:08 smithi131 bash[24745]: cluster 2024-09-13T22:37:06.344758+0000 mgr.a (mgr.14355) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:08.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:08 smithi171 bash[25040]: cluster 2024-09-13T22:37:06.344758+0000 mgr.a (mgr.14355) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:09.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:09 smithi131 bash[24745]: audit 2024-09-13T22:37:07.518392+0000 mgr.a (mgr.14355) 703 : audit [DBG] from='client.28617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:09.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:09 smithi171 bash[25040]: audit 2024-09-13T22:37:07.518392+0000 mgr.a (mgr.14355) 703 : audit [DBG] from='client.28617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:09.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:09 smithi007 bash[22722]: audit 2024-09-13T22:37:07.518392+0000 mgr.a (mgr.14355) 703 : audit [DBG] from='client.28617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:10.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:10 smithi131 bash[24745]: cluster 2024-09-13T22:37:08.345640+0000 mgr.a (mgr.14355) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:10.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:10 smithi171 bash[25040]: cluster 2024-09-13T22:37:08.345640+0000 mgr.a (mgr.14355) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:10 smithi007 bash[22722]: cluster 2024-09-13T22:37:08.345640+0000 mgr.a (mgr.14355) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:12.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:12 smithi131 bash[24745]: cluster 2024-09-13T22:37:10.347884+0000 mgr.a (mgr.14355) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:12.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:12 smithi171 bash[25040]: cluster 2024-09-13T22:37:10.347884+0000 mgr.a (mgr.14355) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:12 smithi007 bash[22722]: cluster 2024-09-13T22:37:10.347884+0000 mgr.a (mgr.14355) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:13.662 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:14.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:14 smithi131 bash[24745]: cluster 2024-09-13T22:37:12.348664+0000 mgr.a (mgr.14355) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:14.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:14 smithi131 bash[24745]: audit 2024-09-13T22:37:13.257782+0000 mgr.a (mgr.14355) 707 : audit [DBG] from='client.28695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:14 smithi171 bash[25040]: cluster 2024-09-13T22:37:12.348664+0000 mgr.a (mgr.14355) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:14 smithi171 bash[25040]: audit 2024-09-13T22:37:13.257782+0000 mgr.a (mgr.14355) 707 : audit [DBG] from='client.28695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:14 smithi007 bash[22722]: cluster 2024-09-13T22:37:12.348664+0000 mgr.a (mgr.14355) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:14 smithi007 bash[22722]: audit 2024-09-13T22:37:13.257782+0000 mgr.a (mgr.14355) 707 : audit [DBG] from='client.28695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:16.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:16 smithi131 bash[24745]: cluster 2024-09-13T22:37:14.349612+0000 mgr.a (mgr.14355) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:16.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:16 smithi171 bash[25040]: cluster 2024-09-13T22:37:14.349612+0000 mgr.a (mgr.14355) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:16 smithi007 bash[22722]: cluster 2024-09-13T22:37:14.349612+0000 mgr.a (mgr.14355) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:18.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:18 smithi131 bash[24745]: cluster 2024-09-13T22:37:16.351908+0000 mgr.a (mgr.14355) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:18.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:18 smithi171 bash[25040]: cluster 2024-09-13T22:37:16.351908+0000 mgr.a (mgr.14355) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:18 smithi007 bash[22722]: cluster 2024-09-13T22:37:16.351908+0000 mgr.a (mgr.14355) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:19.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:19.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:19.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:20.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:20 smithi131 bash[24745]: cluster 2024-09-13T22:37:18.352822+0000 mgr.a (mgr.14355) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:20.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:20 smithi131 bash[24745]: audit 2024-09-13T22:37:19.000633+0000 mgr.a (mgr.14355) 711 : audit [DBG] from='client.28773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:20.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:20 smithi171 bash[25040]: cluster 2024-09-13T22:37:18.352822+0000 mgr.a (mgr.14355) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:20.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:20 smithi171 bash[25040]: audit 2024-09-13T22:37:19.000633+0000 mgr.a (mgr.14355) 711 : audit [DBG] from='client.28773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:20 smithi007 bash[22722]: cluster 2024-09-13T22:37:18.352822+0000 mgr.a (mgr.14355) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:20 smithi007 bash[22722]: audit 2024-09-13T22:37:19.000633+0000 mgr.a (mgr.14355) 711 : audit [DBG] from='client.28773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:22.526 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:22 smithi131 bash[24745]: cluster 2024-09-13T22:37:20.355148+0000 mgr.a (mgr.14355) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:22.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:22 smithi171 bash[25040]: cluster 2024-09-13T22:37:20.355148+0000 mgr.a (mgr.14355) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:22.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:22 smithi007 bash[22722]: cluster 2024-09-13T22:37:20.355148+0000 mgr.a (mgr.14355) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:24.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:24.435 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:24.435 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:24.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:24 smithi131 bash[24745]: cluster 2024-09-13T22:37:22.355939+0000 mgr.a (mgr.14355) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:24.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:24 smithi171 bash[25040]: cluster 2024-09-13T22:37:22.355939+0000 mgr.a (mgr.14355) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:24.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:24 smithi007 bash[22722]: cluster 2024-09-13T22:37:22.355939+0000 mgr.a (mgr.14355) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:25.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:25.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:26.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:26 smithi131 bash[24745]: cluster 2024-09-13T22:37:24.356746+0000 mgr.a (mgr.14355) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:26.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:26 smithi131 bash[24745]: audit 2024-09-13T22:37:24.767811+0000 mgr.a (mgr.14355) 715 : audit [DBG] from='client.28851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:26.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:26 smithi171 bash[25040]: cluster 2024-09-13T22:37:24.356746+0000 mgr.a (mgr.14355) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:26.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:26 smithi171 bash[25040]: audit 2024-09-13T22:37:24.767811+0000 mgr.a (mgr.14355) 715 : audit [DBG] from='client.28851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:26 smithi007 bash[22722]: cluster 2024-09-13T22:37:24.356746+0000 mgr.a (mgr.14355) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:26 smithi007 bash[22722]: audit 2024-09-13T22:37:24.767811+0000 mgr.a (mgr.14355) 715 : audit [DBG] from='client.28851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:28.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:28 smithi131 bash[24745]: cluster 2024-09-13T22:37:26.359159+0000 mgr.a (mgr.14355) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:37:28.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:28 smithi171 bash[25040]: cluster 2024-09-13T22:37:26.359159+0000 mgr.a (mgr.14355) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:37:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:28 smithi007 bash[22722]: cluster 2024-09-13T22:37:26.359159+0000 mgr.a (mgr.14355) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:37:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:30.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:30 smithi131 bash[24745]: cluster 2024-09-13T22:37:28.359951+0000 mgr.a (mgr.14355) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:37:30.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:30 smithi171 bash[25040]: cluster 2024-09-13T22:37:28.359951+0000 mgr.a (mgr.14355) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:37:30.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:30 smithi007 bash[22722]: cluster 2024-09-13T22:37:28.359951+0000 mgr.a (mgr.14355) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:37:30.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:30.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:32.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:32 smithi131 bash[24745]: cluster 2024-09-13T22:37:30.361424+0000 mgr.a (mgr.14355) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:32.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:32 smithi131 bash[24745]: audit 2024-09-13T22:37:30.535678+0000 mgr.a (mgr.14355) 719 : audit [DBG] from='client.28929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:32.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:32 smithi171 bash[25040]: cluster 2024-09-13T22:37:30.361424+0000 mgr.a (mgr.14355) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:32.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:32 smithi171 bash[25040]: audit 2024-09-13T22:37:30.535678+0000 mgr.a (mgr.14355) 719 : audit [DBG] from='client.28929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:32.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:32 smithi007 bash[22722]: cluster 2024-09-13T22:37:30.361424+0000 mgr.a (mgr.14355) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:32.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:32 smithi007 bash[22722]: audit 2024-09-13T22:37:30.535678+0000 mgr.a (mgr.14355) 719 : audit [DBG] from='client.28929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:34 smithi131 bash[24745]: cluster 2024-09-13T22:37:32.362354+0000 mgr.a (mgr.14355) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:37:34.527 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:34 smithi131 bash[24745]: audit 2024-09-13T22:37:34.198230+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:37:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:34 smithi171 bash[25040]: cluster 2024-09-13T22:37:32.362354+0000 mgr.a (mgr.14355) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:37:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:34 smithi171 bash[25040]: audit 2024-09-13T22:37:34.198230+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:37:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:34 smithi007 bash[22722]: cluster 2024-09-13T22:37:32.362354+0000 mgr.a (mgr.14355) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:37:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:34 smithi007 bash[22722]: audit 2024-09-13T22:37:34.198230+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:37:35.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:35.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:35.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: cluster 2024-09-13T22:37:34.363112+0000 mgr.a (mgr.14355) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:34.823079+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:34.829642+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:34.850903+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:34.861283+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:35.591111+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:35.593077+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:37:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:35.601995+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:35 smithi007 bash[22722]: audit 2024-09-13T22:37:35.607201+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: cluster 2024-09-13T22:37:34.363112+0000 mgr.a (mgr.14355) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:34.823079+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:34.829642+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:34.850903+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:34.861283+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:35.591111+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:37:36.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:35.593077+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:37:36.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:35.601995+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:35 smithi131 bash[24745]: audit 2024-09-13T22:37:35.607201+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:36.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: cluster 2024-09-13T22:37:34.363112+0000 mgr.a (mgr.14355) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:37:36.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:34.823079+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:34.829642+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:34.850903+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:34.861283+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:35.591111+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:35.593077+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:35.601995+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:37:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:35 smithi171 bash[25040]: audit 2024-09-13T22:37:35.607201+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:36.701 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:37:36 smithi007 bash[22972]: debug 2024-09-13T22:37:36.348+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:37:36.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:37:36 smithi007 bash[22972]: debug 2024-09-13T22:37:36.356+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:37:36.729 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:36.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:37.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:36 smithi007 bash[22722]: audit 2024-09-13T22:37:35.609475+0000 mgr.a (mgr.14355) 722 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:37.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:36 smithi131 bash[24745]: audit 2024-09-13T22:37:35.609475+0000 mgr.a (mgr.14355) 722 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:37.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:36 smithi171 bash[25040]: audit 2024-09-13T22:37:35.609475+0000 mgr.a (mgr.14355) 722 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:37:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:37 smithi007 bash[22722]: audit 2024-09-13T22:37:36.312732+0000 mgr.a (mgr.14355) 723 : audit [DBG] from='client.29079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:37 smithi007 bash[22722]: audit 2024-09-13T22:37:36.352263+0000 mgr.a (mgr.14355) 724 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:37:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:37 smithi007 bash[22722]: cephadm 2024-09-13T22:37:36.361644+0000 mgr.a (mgr.14355) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:37:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:37 smithi007 bash[22722]: cluster 2024-09-13T22:37:36.364969+0000 mgr.a (mgr.14355) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:38.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:37 smithi131 bash[24745]: audit 2024-09-13T22:37:36.312732+0000 mgr.a (mgr.14355) 723 : audit [DBG] from='client.29079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:38.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:37 smithi131 bash[24745]: audit 2024-09-13T22:37:36.352263+0000 mgr.a (mgr.14355) 724 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:37:38.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:37 smithi131 bash[24745]: cephadm 2024-09-13T22:37:36.361644+0000 mgr.a (mgr.14355) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:37:38.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:37 smithi131 bash[24745]: cluster 2024-09-13T22:37:36.364969+0000 mgr.a (mgr.14355) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:37 smithi171 bash[25040]: audit 2024-09-13T22:37:36.312732+0000 mgr.a (mgr.14355) 723 : audit [DBG] from='client.29079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:37 smithi171 bash[25040]: audit 2024-09-13T22:37:36.352263+0000 mgr.a (mgr.14355) 724 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:37:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:37 smithi171 bash[25040]: cephadm 2024-09-13T22:37:36.361644+0000 mgr.a (mgr.14355) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:37:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:37 smithi171 bash[25040]: cluster 2024-09-13T22:37:36.364969+0000 mgr.a (mgr.14355) 726 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:39 smithi007 bash[22722]: cluster 2024-09-13T22:37:38.365805+0000 mgr.a (mgr.14355) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:37:40.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:39 smithi131 bash[24745]: cluster 2024-09-13T22:37:38.365805+0000 mgr.a (mgr.14355) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:37:40.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:39 smithi171 bash[25040]: cluster 2024-09-13T22:37:38.365805+0000 mgr.a (mgr.14355) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:37:41.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:42.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:41 smithi007 bash[22722]: cluster 2024-09-13T22:37:40.367989+0000 mgr.a (mgr.14355) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:42.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:41 smithi131 bash[24745]: cluster 2024-09-13T22:37:40.367989+0000 mgr.a (mgr.14355) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:42.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:41 smithi171 bash[25040]: cluster 2024-09-13T22:37:40.367989+0000 mgr.a (mgr.14355) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:42.467 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:42.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:42.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:42.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:42.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:43.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:42 smithi007 bash[22722]: audit 2024-09-13T22:37:42.064003+0000 mgr.a (mgr.14355) 729 : audit [DBG] from='client.29190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:43.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:42 smithi131 bash[24745]: audit 2024-09-13T22:37:42.064003+0000 mgr.a (mgr.14355) 729 : audit [DBG] from='client.29190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:43.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:42 smithi171 bash[25040]: audit 2024-09-13T22:37:42.064003+0000 mgr.a (mgr.14355) 729 : audit [DBG] from='client.29190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:44.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:43 smithi007 bash[22722]: cluster 2024-09-13T22:37:42.373153+0000 mgr.a (mgr.14355) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:44.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:43 smithi131 bash[24745]: cluster 2024-09-13T22:37:42.373153+0000 mgr.a (mgr.14355) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:44.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:43 smithi171 bash[25040]: cluster 2024-09-13T22:37:42.373153+0000 mgr.a (mgr.14355) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:46.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:45 smithi007 bash[22722]: cluster 2024-09-13T22:37:44.373912+0000 mgr.a (mgr.14355) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:46.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:45 smithi131 bash[24745]: cluster 2024-09-13T22:37:44.373912+0000 mgr.a (mgr.14355) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:46.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:45 smithi171 bash[25040]: cluster 2024-09-13T22:37:44.373912+0000 mgr.a (mgr.14355) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:47.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:48.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:47 smithi007 bash[22722]: cluster 2024-09-13T22:37:46.376179+0000 mgr.a (mgr.14355) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:48.228 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:48.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:48.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:48.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:48.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:48.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:47 smithi131 bash[24745]: cluster 2024-09-13T22:37:46.376179+0000 mgr.a (mgr.14355) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:48.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:47 smithi171 bash[25040]: cluster 2024-09-13T22:37:46.376179+0000 mgr.a (mgr.14355) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:49.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:48 smithi007 bash[22722]: audit 2024-09-13T22:37:47.808141+0000 mgr.a (mgr.14355) 733 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:49.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:48 smithi131 bash[24745]: audit 2024-09-13T22:37:47.808141+0000 mgr.a (mgr.14355) 733 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:49.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:48 smithi171 bash[25040]: audit 2024-09-13T22:37:47.808141+0000 mgr.a (mgr.14355) 733 : audit [DBG] from='client.29265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:50.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:49 smithi007 bash[22722]: cluster 2024-09-13T22:37:48.377076+0000 mgr.a (mgr.14355) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:50.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:49 smithi131 bash[24745]: cluster 2024-09-13T22:37:48.377076+0000 mgr.a (mgr.14355) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:50.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:49 smithi171 bash[25040]: cluster 2024-09-13T22:37:48.377076+0000 mgr.a (mgr.14355) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:52.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:51 smithi007 bash[22722]: cluster 2024-09-13T22:37:50.379284+0000 mgr.a (mgr.14355) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:52.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:51 smithi131 bash[24745]: cluster 2024-09-13T22:37:50.379284+0000 mgr.a (mgr.14355) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:52.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:51 smithi171 bash[25040]: cluster 2024-09-13T22:37:50.379284+0000 mgr.a (mgr.14355) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:37:53.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:53.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:53.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:53.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:53.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:37:54.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:53 smithi007 bash[22722]: cluster 2024-09-13T22:37:52.380082+0000 mgr.a (mgr.14355) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:54.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:53 smithi131 bash[24745]: cluster 2024-09-13T22:37:52.380082+0000 mgr.a (mgr.14355) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:54.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:53 smithi171 bash[25040]: cluster 2024-09-13T22:37:52.380082+0000 mgr.a (mgr.14355) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:55.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:54 smithi007 bash[22722]: audit 2024-09-13T22:37:53.564759+0000 mgr.a (mgr.14355) 737 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:55.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:54 smithi131 bash[24745]: audit 2024-09-13T22:37:53.564759+0000 mgr.a (mgr.14355) 737 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:55.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:54 smithi171 bash[25040]: audit 2024-09-13T22:37:53.564759+0000 mgr.a (mgr.14355) 737 : audit [DBG] from='client.29343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:37:56.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:55 smithi007 bash[22722]: cluster 2024-09-13T22:37:54.380955+0000 mgr.a (mgr.14355) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:56.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:55 smithi131 bash[24745]: cluster 2024-09-13T22:37:54.380955+0000 mgr.a (mgr.14355) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:56.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:55 smithi171 bash[25040]: cluster 2024-09-13T22:37:54.380955+0000 mgr.a (mgr.14355) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:37:58.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:57 smithi007 bash[22722]: cluster 2024-09-13T22:37:56.383220+0000 mgr.a (mgr.14355) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:58.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:57 smithi131 bash[24745]: cluster 2024-09-13T22:37:56.383220+0000 mgr.a (mgr.14355) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:58.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:57 smithi171 bash[25040]: cluster 2024-09-13T22:37:56.383220+0000 mgr.a (mgr.14355) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:37:58.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:37:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:37:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:37:59.761 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:37:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:37:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:37:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:37:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:00.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:37:59 smithi007 bash[22722]: cluster 2024-09-13T22:37:58.384010+0000 mgr.a (mgr.14355) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:00.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:37:59 smithi131 bash[24745]: cluster 2024-09-13T22:37:58.384010+0000 mgr.a (mgr.14355) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:00.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:37:59 smithi171 bash[25040]: cluster 2024-09-13T22:37:58.384010+0000 mgr.a (mgr.14355) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:01.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:00 smithi007 bash[22722]: audit 2024-09-13T22:37:59.329174+0000 mgr.a (mgr.14355) 741 : audit [DBG] from='client.29421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:01.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:00 smithi131 bash[24745]: audit 2024-09-13T22:37:59.329174+0000 mgr.a (mgr.14355) 741 : audit [DBG] from='client.29421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:01.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:00 smithi171 bash[25040]: audit 2024-09-13T22:37:59.329174+0000 mgr.a (mgr.14355) 741 : audit [DBG] from='client.29421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:02.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:01 smithi007 bash[22722]: cluster 2024-09-13T22:38:00.386260+0000 mgr.a (mgr.14355) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:02.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:01 smithi131 bash[24745]: cluster 2024-09-13T22:38:00.386260+0000 mgr.a (mgr.14355) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:01 smithi171 bash[25040]: cluster 2024-09-13T22:38:00.386260+0000 mgr.a (mgr.14355) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:04.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:03 smithi007 bash[22722]: cluster 2024-09-13T22:38:02.387014+0000 mgr.a (mgr.14355) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:04.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:03 smithi131 bash[24745]: cluster 2024-09-13T22:38:02.387014+0000 mgr.a (mgr.14355) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:04.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:03 smithi171 bash[25040]: cluster 2024-09-13T22:38:02.387014+0000 mgr.a (mgr.14355) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:04.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:04.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:04.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:05.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:05.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:05.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:05.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:05.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:06.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:05 smithi007 bash[22722]: cluster 2024-09-13T22:38:04.387739+0000 mgr.a (mgr.14355) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:05 smithi007 bash[22722]: audit 2024-09-13T22:38:05.098010+0000 mgr.a (mgr.14355) 745 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:06.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:05 smithi131 bash[24745]: cluster 2024-09-13T22:38:04.387739+0000 mgr.a (mgr.14355) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:06.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:05 smithi131 bash[24745]: audit 2024-09-13T22:38:05.098010+0000 mgr.a (mgr.14355) 745 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:06.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:05 smithi171 bash[25040]: cluster 2024-09-13T22:38:04.387739+0000 mgr.a (mgr.14355) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:06.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:05 smithi171 bash[25040]: audit 2024-09-13T22:38:05.098010+0000 mgr.a (mgr.14355) 745 : audit [DBG] from='client.29496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:08.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:07 smithi007 bash[22722]: cluster 2024-09-13T22:38:06.390546+0000 mgr.a (mgr.14355) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:38:08.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:07 smithi131 bash[24745]: cluster 2024-09-13T22:38:06.390546+0000 mgr.a (mgr.14355) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:38:08.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:07 smithi171 bash[25040]: cluster 2024-09-13T22:38:06.390546+0000 mgr.a (mgr.14355) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:38:10.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:09 smithi007 bash[22722]: cluster 2024-09-13T22:38:08.391451+0000 mgr.a (mgr.14355) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:38:10.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:09 smithi131 bash[24745]: cluster 2024-09-13T22:38:08.391451+0000 mgr.a (mgr.14355) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:38:10.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:09 smithi171 bash[25040]: cluster 2024-09-13T22:38:08.391451+0000 mgr.a (mgr.14355) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:38:10.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:11.262 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:11.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:11.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:11.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:11.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:11 smithi007 bash[22722]: cluster 2024-09-13T22:38:10.393529+0000 mgr.a (mgr.14355) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:11 smithi007 bash[22722]: audit 2024-09-13T22:38:10.847584+0000 mgr.a (mgr.14355) 749 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:12.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:11 smithi131 bash[24745]: cluster 2024-09-13T22:38:10.393529+0000 mgr.a (mgr.14355) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:12.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:11 smithi131 bash[24745]: audit 2024-09-13T22:38:10.847584+0000 mgr.a (mgr.14355) 749 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:12.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:11 smithi171 bash[25040]: cluster 2024-09-13T22:38:10.393529+0000 mgr.a (mgr.14355) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:12.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:11 smithi171 bash[25040]: audit 2024-09-13T22:38:10.847584+0000 mgr.a (mgr.14355) 749 : audit [DBG] from='client.29574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:14.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:13 smithi007 bash[22722]: cluster 2024-09-13T22:38:12.394444+0000 mgr.a (mgr.14355) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:14.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:13 smithi131 bash[24745]: cluster 2024-09-13T22:38:12.394444+0000 mgr.a (mgr.14355) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:14.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:13 smithi171 bash[25040]: cluster 2024-09-13T22:38:12.394444+0000 mgr.a (mgr.14355) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:16.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:15 smithi007 bash[22722]: cluster 2024-09-13T22:38:14.395195+0000 mgr.a (mgr.14355) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:16.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:16.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:16.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:16.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:15 smithi131 bash[24745]: cluster 2024-09-13T22:38:14.395195+0000 mgr.a (mgr.14355) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:16.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:15 smithi171 bash[25040]: cluster 2024-09-13T22:38:14.395195+0000 mgr.a (mgr.14355) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:17.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:17.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:17.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:18.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:17 smithi131 bash[24745]: cluster 2024-09-13T22:38:16.396381+0000 mgr.a (mgr.14355) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:18.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:17 smithi131 bash[24745]: audit 2024-09-13T22:38:16.596337+0000 mgr.a (mgr.14355) 753 : audit [DBG] from='client.29652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:18.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:17 smithi171 bash[25040]: cluster 2024-09-13T22:38:16.396381+0000 mgr.a (mgr.14355) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:18.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:17 smithi171 bash[25040]: audit 2024-09-13T22:38:16.596337+0000 mgr.a (mgr.14355) 753 : audit [DBG] from='client.29652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:17 smithi007 bash[22722]: cluster 2024-09-13T22:38:16.396381+0000 mgr.a (mgr.14355) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:17 smithi007 bash[22722]: audit 2024-09-13T22:38:16.596337+0000 mgr.a (mgr.14355) 753 : audit [DBG] from='client.29652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:20.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:19 smithi131 bash[24745]: cluster 2024-09-13T22:38:18.397351+0000 mgr.a (mgr.14355) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:38:20.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:19 smithi171 bash[25040]: cluster 2024-09-13T22:38:18.397351+0000 mgr.a (mgr.14355) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:38:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:19 smithi007 bash[22722]: cluster 2024-09-13T22:38:18.397351+0000 mgr.a (mgr.14355) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:38:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:22.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:21 smithi131 bash[24745]: cluster 2024-09-13T22:38:20.399668+0000 mgr.a (mgr.14355) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:22.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:21 smithi171 bash[25040]: cluster 2024-09-13T22:38:20.399668+0000 mgr.a (mgr.14355) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:21 smithi007 bash[22722]: cluster 2024-09-13T22:38:20.399668+0000 mgr.a (mgr.14355) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:22.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:22.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:24.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:23 smithi131 bash[24745]: audit 2024-09-13T22:38:22.338984+0000 mgr.a (mgr.14355) 756 : audit [DBG] from='client.29727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:24.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:23 smithi131 bash[24745]: cluster 2024-09-13T22:38:22.400357+0000 mgr.a (mgr.14355) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:23 smithi171 bash[25040]: audit 2024-09-13T22:38:22.338984+0000 mgr.a (mgr.14355) 756 : audit [DBG] from='client.29727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:23 smithi171 bash[25040]: cluster 2024-09-13T22:38:22.400357+0000 mgr.a (mgr.14355) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:23 smithi007 bash[22722]: audit 2024-09-13T22:38:22.338984+0000 mgr.a (mgr.14355) 756 : audit [DBG] from='client.29727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:23 smithi007 bash[22722]: cluster 2024-09-13T22:38:22.400357+0000 mgr.a (mgr.14355) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:26.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:25 smithi131 bash[24745]: cluster 2024-09-13T22:38:24.401222+0000 mgr.a (mgr.14355) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:26.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:25 smithi171 bash[25040]: cluster 2024-09-13T22:38:24.401222+0000 mgr.a (mgr.14355) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:26.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:25 smithi007 bash[22722]: cluster 2024-09-13T22:38:24.401222+0000 mgr.a (mgr.14355) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:27.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:27.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:27.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:28.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:27 smithi131 bash[24745]: cluster 2024-09-13T22:38:26.403460+0000 mgr.a (mgr.14355) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:28.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:27 smithi171 bash[25040]: cluster 2024-09-13T22:38:26.403460+0000 mgr.a (mgr.14355) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:28.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:27 smithi007 bash[22722]: cluster 2024-09-13T22:38:26.403460+0000 mgr.a (mgr.14355) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:28.510 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:29.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:28 smithi131 bash[24745]: audit 2024-09-13T22:38:28.102424+0000 mgr.a (mgr.14355) 760 : audit [DBG] from='client.29805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:29.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:28 smithi171 bash[25040]: audit 2024-09-13T22:38:28.102424+0000 mgr.a (mgr.14355) 760 : audit [DBG] from='client.29805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:29.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:28 smithi007 bash[22722]: audit 2024-09-13T22:38:28.102424+0000 mgr.a (mgr.14355) 760 : audit [DBG] from='client.29805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:30.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:29 smithi131 bash[24745]: cluster 2024-09-13T22:38:28.403938+0000 mgr.a (mgr.14355) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:30.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:29 smithi171 bash[25040]: cluster 2024-09-13T22:38:28.403938+0000 mgr.a (mgr.14355) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:30.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:29 smithi007 bash[22722]: cluster 2024-09-13T22:38:28.403938+0000 mgr.a (mgr.14355) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:32.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:31 smithi131 bash[24745]: cluster 2024-09-13T22:38:30.406116+0000 mgr.a (mgr.14355) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:32.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:31 smithi171 bash[25040]: cluster 2024-09-13T22:38:30.406116+0000 mgr.a (mgr.14355) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:32.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:31 smithi007 bash[22722]: cluster 2024-09-13T22:38:30.406116+0000 mgr.a (mgr.14355) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:33.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:33.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:34.262 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:34.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:34.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:33 smithi131 bash[24745]: cluster 2024-09-13T22:38:32.406896+0000 mgr.a (mgr.14355) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:34.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:33 smithi171 bash[25040]: cluster 2024-09-13T22:38:32.406896+0000 mgr.a (mgr.14355) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:33 smithi007 bash[22722]: cluster 2024-09-13T22:38:32.406896+0000 mgr.a (mgr.14355) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:35.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:35 smithi131 bash[24745]: audit 2024-09-13T22:38:33.850106+0000 mgr.a (mgr.14355) 764 : audit [DBG] from='client.29880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:35.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:35 smithi171 bash[25040]: audit 2024-09-13T22:38:33.850106+0000 mgr.a (mgr.14355) 764 : audit [DBG] from='client.29880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:35.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:35 smithi007 bash[22722]: audit 2024-09-13T22:38:33.850106+0000 mgr.a (mgr.14355) 764 : audit [DBG] from='client.29880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:36.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:36 smithi131 bash[24745]: cluster 2024-09-13T22:38:34.407715+0000 mgr.a (mgr.14355) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:36.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:36 smithi171 bash[25040]: cluster 2024-09-13T22:38:34.407715+0000 mgr.a (mgr.14355) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:36 smithi007 bash[22722]: cluster 2024-09-13T22:38:34.407715+0000 mgr.a (mgr.14355) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:37.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:37 smithi131 bash[24745]: audit 2024-09-13T22:38:36.416430+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:38:37.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:37 smithi171 bash[25040]: audit 2024-09-13T22:38:36.416430+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:38:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:37 smithi007 bash[22722]: audit 2024-09-13T22:38:36.416430+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:38:38.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: cluster 2024-09-13T22:38:36.409918+0000 mgr.a (mgr.14355) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:38.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: audit 2024-09-13T22:38:37.263065+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:38:38.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: audit 2024-09-13T22:38:37.264518+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:38:38.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: audit 2024-09-13T22:38:37.272142+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:38:38.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: audit 2024-09-13T22:38:37.276811+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:38.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:38 smithi131 bash[24745]: audit 2024-09-13T22:38:37.278972+0000 mgr.a (mgr.14355) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: cluster 2024-09-13T22:38:36.409918+0000 mgr.a (mgr.14355) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: audit 2024-09-13T22:38:37.263065+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: audit 2024-09-13T22:38:37.264518+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: audit 2024-09-13T22:38:37.272142+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: audit 2024-09-13T22:38:37.276811+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:38.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:38 smithi171 bash[25040]: audit 2024-09-13T22:38:37.278972+0000 mgr.a (mgr.14355) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:38.451 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:38:37 smithi007 bash[22972]: debug 2024-09-13T22:38:37.991+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:38:37 smithi007 bash[22972]: debug 2024-09-13T22:38:37.995+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: cluster 2024-09-13T22:38:36.409918+0000 mgr.a (mgr.14355) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: audit 2024-09-13T22:38:37.263065+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: audit 2024-09-13T22:38:37.264518+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: audit 2024-09-13T22:38:37.272142+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: audit 2024-09-13T22:38:37.276811+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:38 smithi007 bash[22722]: audit 2024-09-13T22:38:37.278972+0000 mgr.a (mgr.14355) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:38:39.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:39.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:39.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:39.277 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:39 smithi131 bash[24745]: audit 2024-09-13T22:38:37.997208+0000 mgr.a (mgr.14355) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:38:39.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:39 smithi131 bash[24745]: cephadm 2024-09-13T22:38:37.998606+0000 mgr.a (mgr.14355) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:38:39.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:39 smithi171 bash[25040]: audit 2024-09-13T22:38:37.997208+0000 mgr.a (mgr.14355) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:38:39.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:39 smithi171 bash[25040]: cephadm 2024-09-13T22:38:37.998606+0000 mgr.a (mgr.14355) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:38:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:39 smithi007 bash[22722]: audit 2024-09-13T22:38:37.997208+0000 mgr.a (mgr.14355) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:38:39.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:39 smithi007 bash[22722]: cephadm 2024-09-13T22:38:37.998606+0000 mgr.a (mgr.14355) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:38:40.005 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:40.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:40.278 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:40 smithi131 bash[24745]: cluster 2024-09-13T22:38:38.410755+0000 mgr.a (mgr.14355) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:40.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:40 smithi171 bash[25040]: cluster 2024-09-13T22:38:38.410755+0000 mgr.a (mgr.14355) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:40.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:40 smithi007 bash[22722]: cluster 2024-09-13T22:38:38.410755+0000 mgr.a (mgr.14355) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:41.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:41 smithi171 bash[25040]: audit 2024-09-13T22:38:39.598640+0000 mgr.a (mgr.14355) 771 : audit [DBG] from='client.30066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:41 smithi007 bash[22722]: audit 2024-09-13T22:38:39.598640+0000 mgr.a (mgr.14355) 771 : audit [DBG] from='client.30066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:41 smithi131 bash[24745]: audit 2024-09-13T22:38:39.598640+0000 mgr.a (mgr.14355) 771 : audit [DBG] from='client.30066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:42.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:42 smithi171 bash[25040]: cluster 2024-09-13T22:38:40.412963+0000 mgr.a (mgr.14355) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:42.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:42 smithi007 bash[22722]: cluster 2024-09-13T22:38:40.412963+0000 mgr.a (mgr.14355) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:42.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:42 smithi131 bash[24745]: cluster 2024-09-13T22:38:40.412963+0000 mgr.a (mgr.14355) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:44.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:44 smithi171 bash[25040]: cluster 2024-09-13T22:38:42.413741+0000 mgr.a (mgr.14355) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:44.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:44 smithi007 bash[22722]: cluster 2024-09-13T22:38:42.413741+0000 mgr.a (mgr.14355) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:44.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:44 smithi131 bash[24745]: cluster 2024-09-13T22:38:42.413741+0000 mgr.a (mgr.14355) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:45.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:45.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:45.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:45.771 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:45.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:46.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:46 smithi171 bash[25040]: cluster 2024-09-13T22:38:44.414548+0000 mgr.a (mgr.14355) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:46.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:46 smithi007 bash[22722]: cluster 2024-09-13T22:38:44.414548+0000 mgr.a (mgr.14355) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:46.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:46 smithi131 bash[24745]: cluster 2024-09-13T22:38:44.414548+0000 mgr.a (mgr.14355) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:47.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:47 smithi007 bash[22722]: audit 2024-09-13T22:38:45.346505+0000 mgr.a (mgr.14355) 775 : audit [DBG] from='client.30141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:47.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:47 smithi131 bash[24745]: audit 2024-09-13T22:38:45.346505+0000 mgr.a (mgr.14355) 775 : audit [DBG] from='client.30141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:47.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:47 smithi171 bash[25040]: audit 2024-09-13T22:38:45.346505+0000 mgr.a (mgr.14355) 775 : audit [DBG] from='client.30141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:48.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:48 smithi007 bash[22722]: cluster 2024-09-13T22:38:46.417204+0000 mgr.a (mgr.14355) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:48.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:48 smithi131 bash[24745]: cluster 2024-09-13T22:38:46.417204+0000 mgr.a (mgr.14355) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:48.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:48 smithi171 bash[25040]: cluster 2024-09-13T22:38:46.417204+0000 mgr.a (mgr.14355) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:50.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:50 smithi007 bash[22722]: cluster 2024-09-13T22:38:48.417974+0000 mgr.a (mgr.14355) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:38:50.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:50 smithi131 bash[24745]: cluster 2024-09-13T22:38:48.417974+0000 mgr.a (mgr.14355) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:38:50.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:50 smithi171 bash[25040]: cluster 2024-09-13T22:38:48.417974+0000 mgr.a (mgr.14355) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:38:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:50.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:51.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:51.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:51.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:52.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:52 smithi007 bash[22722]: cluster 2024-09-13T22:38:50.419945+0000 mgr.a (mgr.14355) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:52.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:52 smithi007 bash[22722]: audit 2024-09-13T22:38:51.108178+0000 mgr.a (mgr.14355) 779 : audit [DBG] from='client.30213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:52.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:52 smithi131 bash[24745]: cluster 2024-09-13T22:38:50.419945+0000 mgr.a (mgr.14355) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:52.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:52 smithi131 bash[24745]: audit 2024-09-13T22:38:51.108178+0000 mgr.a (mgr.14355) 779 : audit [DBG] from='client.30213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:52.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:52 smithi171 bash[25040]: cluster 2024-09-13T22:38:50.419945+0000 mgr.a (mgr.14355) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:38:52.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:52 smithi171 bash[25040]: audit 2024-09-13T22:38:51.108178+0000 mgr.a (mgr.14355) 779 : audit [DBG] from='client.30213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:54.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:54 smithi007 bash[22722]: cluster 2024-09-13T22:38:52.420918+0000 mgr.a (mgr.14355) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:54.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:54 smithi131 bash[24745]: cluster 2024-09-13T22:38:52.420918+0000 mgr.a (mgr.14355) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:54.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:54 smithi171 bash[25040]: cluster 2024-09-13T22:38:52.420918+0000 mgr.a (mgr.14355) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:38:56.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:56 smithi007 bash[22722]: cluster 2024-09-13T22:38:54.421723+0000 mgr.a (mgr.14355) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:56.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:56 smithi131 bash[24745]: cluster 2024-09-13T22:38:54.421723+0000 mgr.a (mgr.14355) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:56.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:38:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:38:56.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:38:56.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:56 smithi171 bash[25040]: cluster 2024-09-13T22:38:54.421723+0000 mgr.a (mgr.14355) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:38:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:38:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:38:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:38:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:38:57.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:38:58.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:58 smithi007 bash[22722]: cluster 2024-09-13T22:38:56.423984+0000 mgr.a (mgr.14355) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:38:58 smithi007 bash[22722]: audit 2024-09-13T22:38:56.867048+0000 mgr.a (mgr.14355) 783 : audit [DBG] from='client.30291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:58.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:58 smithi131 bash[24745]: cluster 2024-09-13T22:38:56.423984+0000 mgr.a (mgr.14355) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:58.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:38:58 smithi131 bash[24745]: audit 2024-09-13T22:38:56.867048+0000 mgr.a (mgr.14355) 783 : audit [DBG] from='client.30291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:38:58.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:58 smithi171 bash[25040]: cluster 2024-09-13T22:38:56.423984+0000 mgr.a (mgr.14355) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:38:58.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:38:58 smithi171 bash[25040]: audit 2024-09-13T22:38:56.867048+0000 mgr.a (mgr.14355) 783 : audit [DBG] from='client.30291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:00 smithi007 bash[22722]: cluster 2024-09-13T22:38:58.424970+0000 mgr.a (mgr.14355) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:00 smithi131 bash[24745]: cluster 2024-09-13T22:38:58.424970+0000 mgr.a (mgr.14355) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:00.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:00 smithi171 bash[25040]: cluster 2024-09-13T22:38:58.424970+0000 mgr.a (mgr.14355) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:02.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:02 smithi007 bash[22722]: cluster 2024-09-13T22:39:00.427161+0000 mgr.a (mgr.14355) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:02.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:02 smithi131 bash[24745]: cluster 2024-09-13T22:39:00.427161+0000 mgr.a (mgr.14355) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:02.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:02 smithi171 bash[25040]: cluster 2024-09-13T22:39:00.427161+0000 mgr.a (mgr.14355) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:03.054 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:03.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:03.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:03.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:03.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:04.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:04 smithi007 bash[22722]: cluster 2024-09-13T22:39:02.427687+0000 mgr.a (mgr.14355) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:04.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:04 smithi007 bash[22722]: audit 2024-09-13T22:39:02.622764+0000 mgr.a (mgr.14355) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:04.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:04 smithi131 bash[24745]: cluster 2024-09-13T22:39:02.427687+0000 mgr.a (mgr.14355) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:04.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:04 smithi131 bash[24745]: audit 2024-09-13T22:39:02.622764+0000 mgr.a (mgr.14355) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:04.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:04 smithi171 bash[25040]: cluster 2024-09-13T22:39:02.427687+0000 mgr.a (mgr.14355) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:04.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:04 smithi171 bash[25040]: audit 2024-09-13T22:39:02.622764+0000 mgr.a (mgr.14355) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:06.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:06 smithi007 bash[22722]: cluster 2024-09-13T22:39:04.428614+0000 mgr.a (mgr.14355) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:06.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:06 smithi131 bash[24745]: cluster 2024-09-13T22:39:04.428614+0000 mgr.a (mgr.14355) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:06.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:06 smithi171 bash[25040]: cluster 2024-09-13T22:39:04.428614+0000 mgr.a (mgr.14355) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:08.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:08.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:08 smithi007 bash[22722]: cluster 2024-09-13T22:39:06.430910+0000 mgr.a (mgr.14355) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:08.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:08 smithi131 bash[24745]: cluster 2024-09-13T22:39:06.430910+0000 mgr.a (mgr.14355) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:08.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:08 smithi171 bash[25040]: cluster 2024-09-13T22:39:06.430910+0000 mgr.a (mgr.14355) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:08.795 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:08.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:10 smithi007 bash[22722]: audit 2024-09-13T22:39:08.392594+0000 mgr.a (mgr.14355) 790 : audit [DBG] from='client.30444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:10 smithi007 bash[22722]: cluster 2024-09-13T22:39:08.431451+0000 mgr.a (mgr.14355) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:10.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:10 smithi131 bash[24745]: audit 2024-09-13T22:39:08.392594+0000 mgr.a (mgr.14355) 790 : audit [DBG] from='client.30444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:10.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:10 smithi131 bash[24745]: cluster 2024-09-13T22:39:08.431451+0000 mgr.a (mgr.14355) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:10.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:10 smithi171 bash[25040]: audit 2024-09-13T22:39:08.392594+0000 mgr.a (mgr.14355) 790 : audit [DBG] from='client.30444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:10.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:10 smithi171 bash[25040]: cluster 2024-09-13T22:39:08.431451+0000 mgr.a (mgr.14355) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:12.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:12 smithi007 bash[22722]: cluster 2024-09-13T22:39:10.433766+0000 mgr.a (mgr.14355) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:12.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:12 smithi131 bash[24745]: cluster 2024-09-13T22:39:10.433766+0000 mgr.a (mgr.14355) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:12.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:12 smithi171 bash[25040]: cluster 2024-09-13T22:39:10.433766+0000 mgr.a (mgr.14355) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:13.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:14 smithi007 bash[22722]: cluster 2024-09-13T22:39:12.434648+0000 mgr.a (mgr.14355) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:14.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:14 smithi131 bash[24745]: cluster 2024-09-13T22:39:12.434648+0000 mgr.a (mgr.14355) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:14.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:14.535 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:14 smithi171 bash[25040]: cluster 2024-09-13T22:39:12.434648+0000 mgr.a (mgr.14355) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:15.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:15 smithi007 bash[22722]: audit 2024-09-13T22:39:14.133412+0000 mgr.a (mgr.14355) 794 : audit [DBG] from='client.30522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:15.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:15 smithi131 bash[24745]: audit 2024-09-13T22:39:14.133412+0000 mgr.a (mgr.14355) 794 : audit [DBG] from='client.30522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:15.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:15 smithi171 bash[25040]: audit 2024-09-13T22:39:14.133412+0000 mgr.a (mgr.14355) 794 : audit [DBG] from='client.30522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:16.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:16 smithi007 bash[22722]: cluster 2024-09-13T22:39:14.440571+0000 mgr.a (mgr.14355) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:16.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:16 smithi131 bash[24745]: cluster 2024-09-13T22:39:14.440571+0000 mgr.a (mgr.14355) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:16.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:16 smithi171 bash[25040]: cluster 2024-09-13T22:39:14.440571+0000 mgr.a (mgr.14355) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:18 smithi007 bash[22722]: cluster 2024-09-13T22:39:16.442904+0000 mgr.a (mgr.14355) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:18.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:18 smithi131 bash[24745]: cluster 2024-09-13T22:39:16.442904+0000 mgr.a (mgr.14355) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:18.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:18 smithi171 bash[25040]: cluster 2024-09-13T22:39:16.442904+0000 mgr.a (mgr.14355) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:19.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:19.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:19.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:20.310 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:20.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:20.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:20.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:20 smithi007 bash[22722]: cluster 2024-09-13T22:39:18.443836+0000 mgr.a (mgr.14355) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:20.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:20 smithi131 bash[24745]: cluster 2024-09-13T22:39:18.443836+0000 mgr.a (mgr.14355) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:20.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:20 smithi171 bash[25040]: cluster 2024-09-13T22:39:18.443836+0000 mgr.a (mgr.14355) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:21.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:21 smithi007 bash[22722]: audit 2024-09-13T22:39:19.875370+0000 mgr.a (mgr.14355) 798 : audit [DBG] from='client.30600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:21.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:21 smithi131 bash[24745]: audit 2024-09-13T22:39:19.875370+0000 mgr.a (mgr.14355) 798 : audit [DBG] from='client.30600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:21.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:21 smithi171 bash[25040]: audit 2024-09-13T22:39:19.875370+0000 mgr.a (mgr.14355) 798 : audit [DBG] from='client.30600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:22.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:22 smithi007 bash[22722]: cluster 2024-09-13T22:39:20.446256+0000 mgr.a (mgr.14355) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:39:22.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:22 smithi131 bash[24745]: cluster 2024-09-13T22:39:20.446256+0000 mgr.a (mgr.14355) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:39:22.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:22 smithi171 bash[25040]: cluster 2024-09-13T22:39:20.446256+0000 mgr.a (mgr.14355) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:39:24.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:24 smithi007 bash[22722]: cluster 2024-09-13T22:39:22.447072+0000 mgr.a (mgr.14355) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:24.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:24 smithi131 bash[24745]: cluster 2024-09-13T22:39:22.447072+0000 mgr.a (mgr.14355) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:24.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:24 smithi171 bash[25040]: cluster 2024-09-13T22:39:22.447072+0000 mgr.a (mgr.14355) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:25.312 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:25.313 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:26.045 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:26.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:26.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:26.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:26 smithi007 bash[22722]: cluster 2024-09-13T22:39:24.447827+0000 mgr.a (mgr.14355) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:26.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:26 smithi131 bash[24745]: cluster 2024-09-13T22:39:24.447827+0000 mgr.a (mgr.14355) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:26.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:26 smithi171 bash[25040]: cluster 2024-09-13T22:39:24.447827+0000 mgr.a (mgr.14355) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:39:27.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:27 smithi007 bash[22722]: audit 2024-09-13T22:39:25.645684+0000 mgr.a (mgr.14355) 802 : audit [DBG] from='client.30678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:27.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:27 smithi131 bash[24745]: audit 2024-09-13T22:39:25.645684+0000 mgr.a (mgr.14355) 802 : audit [DBG] from='client.30678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:27.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:27 smithi171 bash[25040]: audit 2024-09-13T22:39:25.645684+0000 mgr.a (mgr.14355) 802 : audit [DBG] from='client.30678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:28.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:28 smithi007 bash[22722]: cluster 2024-09-13T22:39:26.450556+0000 mgr.a (mgr.14355) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:28.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:28 smithi131 bash[24745]: cluster 2024-09-13T22:39:26.450556+0000 mgr.a (mgr.14355) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:28.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:28 smithi171 bash[25040]: cluster 2024-09-13T22:39:26.450556+0000 mgr.a (mgr.14355) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:30.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:30 smithi007 bash[22722]: cluster 2024-09-13T22:39:28.451335+0000 mgr.a (mgr.14355) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:39:30.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:30 smithi131 bash[24745]: cluster 2024-09-13T22:39:28.451335+0000 mgr.a (mgr.14355) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:39:30.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:30 smithi171 bash[25040]: cluster 2024-09-13T22:39:28.451335+0000 mgr.a (mgr.14355) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:39:31.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:31.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:31.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:31.818 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:31.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:32.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:32 smithi007 bash[22722]: cluster 2024-09-13T22:39:30.453270+0000 mgr.a (mgr.14355) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:32.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:32 smithi131 bash[24745]: cluster 2024-09-13T22:39:30.453270+0000 mgr.a (mgr.14355) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:32.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:32 smithi171 bash[25040]: cluster 2024-09-13T22:39:30.453270+0000 mgr.a (mgr.14355) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:33.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:33 smithi007 bash[22722]: audit 2024-09-13T22:39:31.387547+0000 mgr.a (mgr.14355) 806 : audit [DBG] from='client.30756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:33.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:33 smithi131 bash[24745]: audit 2024-09-13T22:39:31.387547+0000 mgr.a (mgr.14355) 806 : audit [DBG] from='client.30756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:33.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:33 smithi171 bash[25040]: audit 2024-09-13T22:39:31.387547+0000 mgr.a (mgr.14355) 806 : audit [DBG] from='client.30756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:34 smithi007 bash[22722]: cluster 2024-09-13T22:39:32.454364+0000 mgr.a (mgr.14355) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:34.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:34 smithi131 bash[24745]: cluster 2024-09-13T22:39:32.454364+0000 mgr.a (mgr.14355) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:34.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:34 smithi171 bash[25040]: cluster 2024-09-13T22:39:32.454364+0000 mgr.a (mgr.14355) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:36 smithi007 bash[22722]: cluster 2024-09-13T22:39:34.455160+0000 mgr.a (mgr.14355) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:36.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:36 smithi131 bash[24745]: cluster 2024-09-13T22:39:34.455160+0000 mgr.a (mgr.14355) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:36.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:36 smithi171 bash[25040]: cluster 2024-09-13T22:39:34.455160+0000 mgr.a (mgr.14355) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:39:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:36.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:36.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:37.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:38.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:38 smithi007 bash[22722]: cluster 2024-09-13T22:39:36.457494+0000 mgr.a (mgr.14355) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:39:38.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:38 smithi007 bash[22722]: audit 2024-09-13T22:39:37.156389+0000 mgr.a (mgr.14355) 810 : audit [DBG] from='client.30825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:38 smithi007 bash[22722]: audit 2024-09-13T22:39:38.050771+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:39:38.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:38 smithi131 bash[24745]: cluster 2024-09-13T22:39:36.457494+0000 mgr.a (mgr.14355) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:39:38.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:38 smithi131 bash[24745]: audit 2024-09-13T22:39:37.156389+0000 mgr.a (mgr.14355) 810 : audit [DBG] from='client.30825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:38.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:38 smithi131 bash[24745]: audit 2024-09-13T22:39:38.050771+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:39:38.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:38 smithi171 bash[25040]: cluster 2024-09-13T22:39:36.457494+0000 mgr.a (mgr.14355) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:39:38.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:38 smithi171 bash[25040]: audit 2024-09-13T22:39:37.156389+0000 mgr.a (mgr.14355) 810 : audit [DBG] from='client.30825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:38.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:38 smithi171 bash[25040]: audit 2024-09-13T22:39:38.050771+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:39:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22722]: audit 2024-09-13T22:39:38.893356+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:39:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22722]: audit 2024-09-13T22:39:38.894820+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:39:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22722]: audit 2024-09-13T22:39:38.902637+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:39:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22722]: audit 2024-09-13T22:39:38.905131+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:39.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:39 smithi131 bash[24745]: audit 2024-09-13T22:39:38.893356+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:39:39.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:39 smithi131 bash[24745]: audit 2024-09-13T22:39:38.894820+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:39:39.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:39 smithi131 bash[24745]: audit 2024-09-13T22:39:38.902637+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:39:39.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:39 smithi131 bash[24745]: audit 2024-09-13T22:39:38.905131+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:39.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:39 smithi171 bash[25040]: audit 2024-09-13T22:39:38.893356+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:39:39.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:39 smithi171 bash[25040]: audit 2024-09-13T22:39:38.894820+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:39:39.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:39 smithi171 bash[25040]: audit 2024-09-13T22:39:38.902637+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:39:39.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:39 smithi171 bash[25040]: audit 2024-09-13T22:39:38.905131+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:39.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22972]: debug 2024-09-13T22:39:39.631+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:39:39.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:39:39 smithi007 bash[22972]: debug 2024-09-13T22:39:39.631+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:39:40.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:40 smithi007 bash[22722]: cluster 2024-09-13T22:39:38.458471+0000 mgr.a (mgr.14355) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:40.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:40 smithi007 bash[22722]: audit 2024-09-13T22:39:38.907837+0000 mgr.a (mgr.14355) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:40.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:40 smithi131 bash[24745]: cluster 2024-09-13T22:39:38.458471+0000 mgr.a (mgr.14355) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:40.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:40 smithi131 bash[24745]: audit 2024-09-13T22:39:38.907837+0000 mgr.a (mgr.14355) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:40.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:40 smithi171 bash[25040]: cluster 2024-09-13T22:39:38.458471+0000 mgr.a (mgr.14355) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:40.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:40 smithi171 bash[25040]: audit 2024-09-13T22:39:38.907837+0000 mgr.a (mgr.14355) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:39:41.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:41 smithi007 bash[22722]: audit 2024-09-13T22:39:39.635017+0000 mgr.a (mgr.14355) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:39:41.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:41 smithi007 bash[22722]: cephadm 2024-09-13T22:39:39.636411+0000 mgr.a (mgr.14355) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:39:41.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:41 smithi131 bash[24745]: audit 2024-09-13T22:39:39.635017+0000 mgr.a (mgr.14355) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:39:41.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:41 smithi131 bash[24745]: cephadm 2024-09-13T22:39:39.636411+0000 mgr.a (mgr.14355) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:39:41.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:41 smithi171 bash[25040]: audit 2024-09-13T22:39:39.635017+0000 mgr.a (mgr.14355) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:39:41.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:41 smithi171 bash[25040]: cephadm 2024-09-13T22:39:39.636411+0000 mgr.a (mgr.14355) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:39:42.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:42 smithi007 bash[22722]: cluster 2024-09-13T22:39:40.460804+0000 mgr.a (mgr.14355) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:42.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:42 smithi131 bash[24745]: cluster 2024-09-13T22:39:40.460804+0000 mgr.a (mgr.14355) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:42.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:42 smithi171 bash[25040]: cluster 2024-09-13T22:39:40.460804+0000 mgr.a (mgr.14355) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:42.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:42.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:43.355 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:44.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:44 smithi131 bash[24745]: cluster 2024-09-13T22:39:42.461586+0000 mgr.a (mgr.14355) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:44.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:44 smithi131 bash[24745]: audit 2024-09-13T22:39:42.911986+0000 mgr.a (mgr.14355) 817 : audit [DBG] from='client.31011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:44.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:44 smithi171 bash[25040]: cluster 2024-09-13T22:39:42.461586+0000 mgr.a (mgr.14355) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:44.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:44 smithi171 bash[25040]: audit 2024-09-13T22:39:42.911986+0000 mgr.a (mgr.14355) 817 : audit [DBG] from='client.31011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:44.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:44 smithi007 bash[22722]: cluster 2024-09-13T22:39:42.461586+0000 mgr.a (mgr.14355) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:44.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:44 smithi007 bash[22722]: audit 2024-09-13T22:39:42.911986+0000 mgr.a (mgr.14355) 817 : audit [DBG] from='client.31011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:46.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:46 smithi131 bash[24745]: cluster 2024-09-13T22:39:44.462557+0000 mgr.a (mgr.14355) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:46.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:46 smithi171 bash[25040]: cluster 2024-09-13T22:39:44.462557+0000 mgr.a (mgr.14355) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:46.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:46 smithi007 bash[22722]: cluster 2024-09-13T22:39:44.462557+0000 mgr.a (mgr.14355) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:48.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:48.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:48.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:48.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:48 smithi131 bash[24745]: cluster 2024-09-13T22:39:46.464788+0000 mgr.a (mgr.14355) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:48.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:48 smithi171 bash[25040]: cluster 2024-09-13T22:39:46.464788+0000 mgr.a (mgr.14355) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:48.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:48 smithi007 bash[22722]: cluster 2024-09-13T22:39:46.464788+0000 mgr.a (mgr.14355) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:49.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:50.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:50 smithi131 bash[24745]: cluster 2024-09-13T22:39:48.465198+0000 mgr.a (mgr.14355) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:50.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:50 smithi131 bash[24745]: audit 2024-09-13T22:39:48.691703+0000 mgr.a (mgr.14355) 821 : audit [DBG] from='client.31083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:50.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:50 smithi171 bash[25040]: cluster 2024-09-13T22:39:48.465198+0000 mgr.a (mgr.14355) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:50.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:50 smithi171 bash[25040]: audit 2024-09-13T22:39:48.691703+0000 mgr.a (mgr.14355) 821 : audit [DBG] from='client.31083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:50.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:50 smithi007 bash[22722]: cluster 2024-09-13T22:39:48.465198+0000 mgr.a (mgr.14355) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:50.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:50 smithi007 bash[22722]: audit 2024-09-13T22:39:48.691703+0000 mgr.a (mgr.14355) 821 : audit [DBG] from='client.31083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:52.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:52 smithi131 bash[24745]: cluster 2024-09-13T22:39:50.467473+0000 mgr.a (mgr.14355) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:52.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:52 smithi171 bash[25040]: cluster 2024-09-13T22:39:50.467473+0000 mgr.a (mgr.14355) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:52.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:52 smithi007 bash[22722]: cluster 2024-09-13T22:39:50.467473+0000 mgr.a (mgr.14355) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:39:54.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:54.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:39:54.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:54 smithi131 bash[24745]: cluster 2024-09-13T22:39:52.468250+0000 mgr.a (mgr.14355) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:54.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:54 smithi171 bash[25040]: cluster 2024-09-13T22:39:52.468250+0000 mgr.a (mgr.14355) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:54.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:54 smithi007 bash[22722]: cluster 2024-09-13T22:39:52.468250+0000 mgr.a (mgr.14355) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:54.866 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:39:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:39:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:39:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:39:54.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:39:56.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:56 smithi131 bash[24745]: audit 2024-09-13T22:39:54.441677+0000 mgr.a (mgr.14355) 824 : audit [DBG] from='client.31158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:56.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:56 smithi131 bash[24745]: cluster 2024-09-13T22:39:54.468911+0000 mgr.a (mgr.14355) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:56.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:56 smithi171 bash[25040]: audit 2024-09-13T22:39:54.441677+0000 mgr.a (mgr.14355) 824 : audit [DBG] from='client.31158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:56.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:56 smithi171 bash[25040]: cluster 2024-09-13T22:39:54.468911+0000 mgr.a (mgr.14355) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:56.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:56 smithi007 bash[22722]: audit 2024-09-13T22:39:54.441677+0000 mgr.a (mgr.14355) 824 : audit [DBG] from='client.31158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:39:56.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:56 smithi007 bash[22722]: cluster 2024-09-13T22:39:54.468911+0000 mgr.a (mgr.14355) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:39:58.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:39:58 smithi131 bash[24745]: cluster 2024-09-13T22:39:56.471323+0000 mgr.a (mgr.14355) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:58.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:39:58 smithi171 bash[25040]: cluster 2024-09-13T22:39:56.471323+0000 mgr.a (mgr.14355) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:58.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:39:58 smithi007 bash[22722]: cluster 2024-09-13T22:39:56.471323+0000 mgr.a (mgr.14355) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:39:59.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:39:59.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:39:59.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:00.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:00 smithi131 bash[24745]: cluster 2024-09-13T22:39:58.472123+0000 mgr.a (mgr.14355) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:00.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:00 smithi131 bash[24745]: cluster 2024-09-13T22:40:00.000111+0000 mon.a (mon.0) 719 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:40:00.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:00 smithi171 bash[25040]: cluster 2024-09-13T22:39:58.472123+0000 mgr.a (mgr.14355) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:00.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:00 smithi171 bash[25040]: cluster 2024-09-13T22:40:00.000111+0000 mon.a (mon.0) 719 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:40:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:00.633 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:00.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:00 smithi007 bash[22722]: cluster 2024-09-13T22:39:58.472123+0000 mgr.a (mgr.14355) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:00.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:00 smithi007 bash[22722]: cluster 2024-09-13T22:40:00.000111+0000 mon.a (mon.0) 719 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:40:01.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:01 smithi131 bash[24745]: audit 2024-09-13T22:40:00.203542+0000 mgr.a (mgr.14355) 828 : audit [DBG] from='client.31236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:01.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:01 smithi171 bash[25040]: audit 2024-09-13T22:40:00.203542+0000 mgr.a (mgr.14355) 828 : audit [DBG] from='client.31236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:01.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:01 smithi007 bash[22722]: audit 2024-09-13T22:40:00.203542+0000 mgr.a (mgr.14355) 828 : audit [DBG] from='client.31236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:02.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:02 smithi131 bash[24745]: cluster 2024-09-13T22:40:00.473451+0000 mgr.a (mgr.14355) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:02.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:02 smithi171 bash[25040]: cluster 2024-09-13T22:40:00.473451+0000 mgr.a (mgr.14355) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:02 smithi007 bash[22722]: cluster 2024-09-13T22:40:00.473451+0000 mgr.a (mgr.14355) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:04.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:04 smithi131 bash[24745]: cluster 2024-09-13T22:40:02.474349+0000 mgr.a (mgr.14355) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:04.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:04 smithi171 bash[25040]: cluster 2024-09-13T22:40:02.474349+0000 mgr.a (mgr.14355) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:04 smithi007 bash[22722]: cluster 2024-09-13T22:40:02.474349+0000 mgr.a (mgr.14355) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:05.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:05.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:06.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:06.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:06.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:06.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:06.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:06.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:06 smithi131 bash[24745]: cluster 2024-09-13T22:40:04.475266+0000 mgr.a (mgr.14355) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:06.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:06 smithi171 bash[25040]: cluster 2024-09-13T22:40:04.475266+0000 mgr.a (mgr.14355) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:06.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:06 smithi007 bash[22722]: cluster 2024-09-13T22:40:04.475266+0000 mgr.a (mgr.14355) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:40:07.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:07 smithi131 bash[24745]: audit 2024-09-13T22:40:05.975077+0000 mgr.a (mgr.14355) 832 : audit [DBG] from='client.31311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:07.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:07 smithi171 bash[25040]: audit 2024-09-13T22:40:05.975077+0000 mgr.a (mgr.14355) 832 : audit [DBG] from='client.31311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:07.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:07 smithi007 bash[22722]: audit 2024-09-13T22:40:05.975077+0000 mgr.a (mgr.14355) 832 : audit [DBG] from='client.31311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:08.528 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:08 smithi131 bash[24745]: cluster 2024-09-13T22:40:06.477980+0000 mgr.a (mgr.14355) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:08.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:08 smithi171 bash[25040]: cluster 2024-09-13T22:40:06.477980+0000 mgr.a (mgr.14355) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:08.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:08 smithi007 bash[22722]: cluster 2024-09-13T22:40:06.477980+0000 mgr.a (mgr.14355) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:10.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:10 smithi131 bash[24745]: cluster 2024-09-13T22:40:08.478787+0000 mgr.a (mgr.14355) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:10.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:10 smithi171 bash[25040]: cluster 2024-09-13T22:40:08.478787+0000 mgr.a (mgr.14355) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:10.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:10 smithi007 bash[22722]: cluster 2024-09-13T22:40:08.478787+0000 mgr.a (mgr.14355) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:11.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:11.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:12.169 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:12.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:12 smithi131 bash[24745]: cluster 2024-09-13T22:40:10.480741+0000 mgr.a (mgr.14355) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:12.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:12 smithi171 bash[25040]: cluster 2024-09-13T22:40:10.480741+0000 mgr.a (mgr.14355) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:12.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:12 smithi007 bash[22722]: cluster 2024-09-13T22:40:10.480741+0000 mgr.a (mgr.14355) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:13.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:13 smithi171 bash[25040]: audit 2024-09-13T22:40:11.741017+0000 mgr.a (mgr.14355) 836 : audit [DBG] from='client.31386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:13.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:13 smithi007 bash[22722]: audit 2024-09-13T22:40:11.741017+0000 mgr.a (mgr.14355) 836 : audit [DBG] from='client.31386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:13.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:13 smithi131 bash[24745]: audit 2024-09-13T22:40:11.741017+0000 mgr.a (mgr.14355) 836 : audit [DBG] from='client.31386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:14 smithi171 bash[25040]: cluster 2024-09-13T22:40:12.481709+0000 mgr.a (mgr.14355) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:14 smithi007 bash[22722]: cluster 2024-09-13T22:40:12.481709+0000 mgr.a (mgr.14355) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:14.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:14 smithi131 bash[24745]: cluster 2024-09-13T22:40:12.481709+0000 mgr.a (mgr.14355) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:16.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:16 smithi007 bash[22722]: cluster 2024-09-13T22:40:14.482533+0000 mgr.a (mgr.14355) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:16.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:16 smithi131 bash[24745]: cluster 2024-09-13T22:40:14.482533+0000 mgr.a (mgr.14355) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:16.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:16 smithi171 bash[25040]: cluster 2024-09-13T22:40:14.482533+0000 mgr.a (mgr.14355) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:17.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:17.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:17.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:17.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:18.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:18 smithi007 bash[22722]: cluster 2024-09-13T22:40:16.484777+0000 mgr.a (mgr.14355) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:18.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:18 smithi131 bash[24745]: cluster 2024-09-13T22:40:16.484777+0000 mgr.a (mgr.14355) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:18.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:18 smithi171 bash[25040]: cluster 2024-09-13T22:40:16.484777+0000 mgr.a (mgr.14355) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:19.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:19 smithi007 bash[22722]: audit 2024-09-13T22:40:17.503074+0000 mgr.a (mgr.14355) 840 : audit [DBG] from='client.31464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:19.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:19 smithi131 bash[24745]: audit 2024-09-13T22:40:17.503074+0000 mgr.a (mgr.14355) 840 : audit [DBG] from='client.31464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:19.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:19 smithi171 bash[25040]: audit 2024-09-13T22:40:17.503074+0000 mgr.a (mgr.14355) 840 : audit [DBG] from='client.31464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:20.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:20 smithi007 bash[22722]: cluster 2024-09-13T22:40:18.485890+0000 mgr.a (mgr.14355) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:20.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:20 smithi131 bash[24745]: cluster 2024-09-13T22:40:18.485890+0000 mgr.a (mgr.14355) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:20.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:20 smithi171 bash[25040]: cluster 2024-09-13T22:40:18.485890+0000 mgr.a (mgr.14355) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:22.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:22 smithi007 bash[22722]: cluster 2024-09-13T22:40:20.488241+0000 mgr.a (mgr.14355) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:22.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:22 smithi131 bash[24745]: cluster 2024-09-13T22:40:20.488241+0000 mgr.a (mgr.14355) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:22.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:22 smithi171 bash[25040]: cluster 2024-09-13T22:40:20.488241+0000 mgr.a (mgr.14355) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:22.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:22.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:22.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:23.659 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:23.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:23.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:23.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:23.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:24.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:24 smithi007 bash[22722]: cluster 2024-09-13T22:40:22.489180+0000 mgr.a (mgr.14355) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:24.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:24 smithi007 bash[22722]: audit 2024-09-13T22:40:23.244748+0000 mgr.a (mgr.14355) 844 : audit [DBG] from='client.31539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:24.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:24 smithi131 bash[24745]: cluster 2024-09-13T22:40:22.489180+0000 mgr.a (mgr.14355) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:24.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:24 smithi131 bash[24745]: audit 2024-09-13T22:40:23.244748+0000 mgr.a (mgr.14355) 844 : audit [DBG] from='client.31539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:24.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:24 smithi171 bash[25040]: cluster 2024-09-13T22:40:22.489180+0000 mgr.a (mgr.14355) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:24.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:24 smithi171 bash[25040]: audit 2024-09-13T22:40:23.244748+0000 mgr.a (mgr.14355) 844 : audit [DBG] from='client.31539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:25.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:25 smithi007 bash[22722]: cluster 2024-09-13T22:40:24.490165+0000 mgr.a (mgr.14355) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:25.779 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:25 smithi131 bash[24745]: cluster 2024-09-13T22:40:24.490165+0000 mgr.a (mgr.14355) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:25.790 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:25 smithi171 bash[25040]: cluster 2024-09-13T22:40:24.490165+0000 mgr.a (mgr.14355) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:27.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:27 smithi007 bash[22722]: cluster 2024-09-13T22:40:26.492503+0000 mgr.a (mgr.14355) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:28.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:27 smithi131 bash[24745]: cluster 2024-09-13T22:40:26.492503+0000 mgr.a (mgr.14355) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:28.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:27 smithi171 bash[25040]: cluster 2024-09-13T22:40:26.492503+0000 mgr.a (mgr.14355) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:28.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:28.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:28.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:29.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:29.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:29 smithi007 bash[22722]: cluster 2024-09-13T22:40:28.493317+0000 mgr.a (mgr.14355) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:29.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:29 smithi007 bash[22722]: audit 2024-09-13T22:40:28.991881+0000 mgr.a (mgr.14355) 848 : audit [DBG] from='client.31617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:30.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:29 smithi131 bash[24745]: cluster 2024-09-13T22:40:28.493317+0000 mgr.a (mgr.14355) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:30.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:29 smithi131 bash[24745]: audit 2024-09-13T22:40:28.991881+0000 mgr.a (mgr.14355) 848 : audit [DBG] from='client.31617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:30.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:29 smithi171 bash[25040]: cluster 2024-09-13T22:40:28.493317+0000 mgr.a (mgr.14355) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:30.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:29 smithi171 bash[25040]: audit 2024-09-13T22:40:28.991881+0000 mgr.a (mgr.14355) 848 : audit [DBG] from='client.31617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:31.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:31 smithi007 bash[22722]: cluster 2024-09-13T22:40:30.495597+0000 mgr.a (mgr.14355) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:32.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:31 smithi131 bash[24745]: cluster 2024-09-13T22:40:30.495597+0000 mgr.a (mgr.14355) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:32.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:31 smithi171 bash[25040]: cluster 2024-09-13T22:40:30.495597+0000 mgr.a (mgr.14355) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:33.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:33 smithi007 bash[22722]: cluster 2024-09-13T22:40:32.496391+0000 mgr.a (mgr.14355) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:34.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:33 smithi131 bash[24745]: cluster 2024-09-13T22:40:32.496391+0000 mgr.a (mgr.14355) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:34.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:33 smithi171 bash[25040]: cluster 2024-09-13T22:40:32.496391+0000 mgr.a (mgr.14355) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:34.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:34.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:34.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:35.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:35.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:35.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:35 smithi007 bash[22722]: cluster 2024-09-13T22:40:34.497100+0000 mgr.a (mgr.14355) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:35.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:35 smithi007 bash[22722]: audit 2024-09-13T22:40:34.737314+0000 mgr.a (mgr.14355) 852 : audit [DBG] from='client.31695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:36.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:35 smithi131 bash[24745]: cluster 2024-09-13T22:40:34.497100+0000 mgr.a (mgr.14355) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:36.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:35 smithi131 bash[24745]: audit 2024-09-13T22:40:34.737314+0000 mgr.a (mgr.14355) 852 : audit [DBG] from='client.31695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:36.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:35 smithi171 bash[25040]: cluster 2024-09-13T22:40:34.497100+0000 mgr.a (mgr.14355) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:36.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:35 smithi171 bash[25040]: audit 2024-09-13T22:40:34.737314+0000 mgr.a (mgr.14355) 852 : audit [DBG] from='client.31695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:37.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:37 smithi007 bash[22722]: cluster 2024-09-13T22:40:36.499497+0000 mgr.a (mgr.14355) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:38.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:37 smithi131 bash[24745]: cluster 2024-09-13T22:40:36.499497+0000 mgr.a (mgr.14355) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:38.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:37 smithi171 bash[25040]: cluster 2024-09-13T22:40:36.499497+0000 mgr.a (mgr.14355) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:40:39.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:39 smithi007 bash[22722]: cluster 2024-09-13T22:40:38.500298+0000 mgr.a (mgr.14355) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:40.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:39 smithi131 bash[24745]: cluster 2024-09-13T22:40:38.500298+0000 mgr.a (mgr.14355) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:40.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:39 smithi171 bash[25040]: cluster 2024-09-13T22:40:38.500298+0000 mgr.a (mgr.14355) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:40.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:40.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:40.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:40.921 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:40.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:40.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:40 smithi007 bash[22722]: audit 2024-09-13T22:40:39.690450+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:40:40.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:40 smithi007 bash[22722]: audit 2024-09-13T22:40:40.548246+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:40:40.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:40 smithi007 bash[22722]: audit 2024-09-13T22:40:40.549292+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:40:40.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:40 smithi007 bash[22722]: audit 2024-09-13T22:40:40.555367+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:40:40.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:40 smithi007 bash[22722]: audit 2024-09-13T22:40:40.557795+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:41.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:40 smithi131 bash[24745]: audit 2024-09-13T22:40:39.690450+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:40:41.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:40 smithi131 bash[24745]: audit 2024-09-13T22:40:40.548246+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:40:41.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:40 smithi131 bash[24745]: audit 2024-09-13T22:40:40.549292+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:40:41.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:40 smithi131 bash[24745]: audit 2024-09-13T22:40:40.555367+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:40:41.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:40 smithi131 bash[24745]: audit 2024-09-13T22:40:40.557795+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:41.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:40 smithi171 bash[25040]: audit 2024-09-13T22:40:39.690450+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:40:41.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:40 smithi171 bash[25040]: audit 2024-09-13T22:40:40.548246+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:40:41.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:40 smithi171 bash[25040]: audit 2024-09-13T22:40:40.549292+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:40:41.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:40 smithi171 bash[25040]: audit 2024-09-13T22:40:40.555367+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:40:41.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:40 smithi171 bash[25040]: audit 2024-09-13T22:40:40.557795+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:41.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:40:41 smithi007 bash[22972]: debug 2024-09-13T22:40:41.594+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:40:41.951 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:40:41 smithi007 bash[22972]: debug 2024-09-13T22:40:41.594+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:40:41.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:41 smithi007 bash[22722]: audit 2024-09-13T22:40:40.486500+0000 mgr.a (mgr.14355) 855 : audit [DBG] from='client.31770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:41.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:41 smithi007 bash[22722]: cluster 2024-09-13T22:40:40.509978+0000 mgr.a (mgr.14355) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:41.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:41 smithi007 bash[22722]: audit 2024-09-13T22:40:40.558923+0000 mgr.a (mgr.14355) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:42.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:41 smithi131 bash[24745]: audit 2024-09-13T22:40:40.486500+0000 mgr.a (mgr.14355) 855 : audit [DBG] from='client.31770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:42.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:41 smithi131 bash[24745]: cluster 2024-09-13T22:40:40.509978+0000 mgr.a (mgr.14355) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:42.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:41 smithi131 bash[24745]: audit 2024-09-13T22:40:40.558923+0000 mgr.a (mgr.14355) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:42.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:41 smithi171 bash[25040]: audit 2024-09-13T22:40:40.486500+0000 mgr.a (mgr.14355) 855 : audit [DBG] from='client.31770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:42.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:41 smithi171 bash[25040]: cluster 2024-09-13T22:40:40.509978+0000 mgr.a (mgr.14355) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:40:42.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:41 smithi171 bash[25040]: audit 2024-09-13T22:40:40.558923+0000 mgr.a (mgr.14355) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:40:42.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:42 smithi007 bash[22722]: audit 2024-09-13T22:40:41.598517+0000 mgr.a (mgr.14355) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:40:42.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:42 smithi007 bash[22722]: cephadm 2024-09-13T22:40:41.599568+0000 mgr.a (mgr.14355) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:40:43.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:42 smithi131 bash[24745]: audit 2024-09-13T22:40:41.598517+0000 mgr.a (mgr.14355) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:40:43.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:42 smithi131 bash[24745]: cephadm 2024-09-13T22:40:41.599568+0000 mgr.a (mgr.14355) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:40:43.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:42 smithi171 bash[25040]: audit 2024-09-13T22:40:41.598517+0000 mgr.a (mgr.14355) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:40:43.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:42 smithi171 bash[25040]: cephadm 2024-09-13T22:40:41.599568+0000 mgr.a (mgr.14355) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:40:43.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:43 smithi007 bash[22722]: cluster 2024-09-13T22:40:42.511017+0000 mgr.a (mgr.14355) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:44.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:43 smithi131 bash[24745]: cluster 2024-09-13T22:40:42.511017+0000 mgr.a (mgr.14355) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:44.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:43 smithi171 bash[25040]: cluster 2024-09-13T22:40:42.511017+0000 mgr.a (mgr.14355) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:45.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:45.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:45 smithi007 bash[22722]: cluster 2024-09-13T22:40:44.511933+0000 mgr.a (mgr.14355) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:46.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:45 smithi131 bash[24745]: cluster 2024-09-13T22:40:44.511933+0000 mgr.a (mgr.14355) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:46.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:45 smithi171 bash[25040]: cluster 2024-09-13T22:40:44.511933+0000 mgr.a (mgr.14355) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:40:46.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:46.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:46 smithi007 bash[22722]: audit 2024-09-13T22:40:46.256123+0000 mgr.a (mgr.14355) 862 : audit [DBG] from='client.31953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:47.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:46 smithi131 bash[24745]: audit 2024-09-13T22:40:46.256123+0000 mgr.a (mgr.14355) 862 : audit [DBG] from='client.31953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:47.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:46 smithi171 bash[25040]: audit 2024-09-13T22:40:46.256123+0000 mgr.a (mgr.14355) 862 : audit [DBG] from='client.31953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:47.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:47 smithi007 bash[22722]: cluster 2024-09-13T22:40:46.513599+0000 mgr.a (mgr.14355) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:48.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:47 smithi131 bash[24745]: cluster 2024-09-13T22:40:46.513599+0000 mgr.a (mgr.14355) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:48.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:47 smithi171 bash[25040]: cluster 2024-09-13T22:40:46.513599+0000 mgr.a (mgr.14355) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:49.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:49 smithi007 bash[22722]: cluster 2024-09-13T22:40:48.514617+0000 mgr.a (mgr.14355) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:40:50.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:49 smithi131 bash[24745]: cluster 2024-09-13T22:40:48.514617+0000 mgr.a (mgr.14355) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:40:50.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:49 smithi171 bash[25040]: cluster 2024-09-13T22:40:48.514617+0000 mgr.a (mgr.14355) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:40:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:51.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:51 smithi007 bash[22722]: cluster 2024-09-13T22:40:50.516776+0000 mgr.a (mgr.14355) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:52.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:51 smithi131 bash[24745]: cluster 2024-09-13T22:40:50.516776+0000 mgr.a (mgr.14355) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:52.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:51 smithi171 bash[25040]: cluster 2024-09-13T22:40:50.516776+0000 mgr.a (mgr.14355) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:52.433 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:52.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:52.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:52 smithi007 bash[22722]: audit 2024-09-13T22:40:52.001288+0000 mgr.a (mgr.14355) 866 : audit [DBG] from='client.32031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:53.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:52 smithi131 bash[24745]: audit 2024-09-13T22:40:52.001288+0000 mgr.a (mgr.14355) 866 : audit [DBG] from='client.32031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:53.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:52 smithi171 bash[25040]: audit 2024-09-13T22:40:52.001288+0000 mgr.a (mgr.14355) 866 : audit [DBG] from='client.32031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:53.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:53 smithi007 bash[22722]: cluster 2024-09-13T22:40:52.517734+0000 mgr.a (mgr.14355) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:54.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:53 smithi131 bash[24745]: cluster 2024-09-13T22:40:52.517734+0000 mgr.a (mgr.14355) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:54.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:53 smithi171 bash[25040]: cluster 2024-09-13T22:40:52.517734+0000 mgr.a (mgr.14355) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:55.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:55 smithi007 bash[22722]: cluster 2024-09-13T22:40:54.518571+0000 mgr.a (mgr.14355) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:56.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:55 smithi131 bash[24745]: cluster 2024-09-13T22:40:54.518571+0000 mgr.a (mgr.14355) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:56.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:55 smithi171 bash[25040]: cluster 2024-09-13T22:40:54.518571+0000 mgr.a (mgr.14355) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:57.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:40:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:40:57.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:40:57.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:57 smithi007 bash[22722]: cluster 2024-09-13T22:40:56.520808+0000 mgr.a (mgr.14355) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:58.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:57 smithi131 bash[24745]: cluster 2024-09-13T22:40:56.520808+0000 mgr.a (mgr.14355) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:58.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:57 smithi171 bash[25040]: cluster 2024-09-13T22:40:56.520808+0000 mgr.a (mgr.14355) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:40:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:40:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:40:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:40:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:40:58.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:40:58.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:58 smithi007 bash[22722]: audit 2024-09-13T22:40:57.780607+0000 mgr.a (mgr.14355) 870 : audit [DBG] from='client.32106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:59.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:58 smithi131 bash[24745]: audit 2024-09-13T22:40:57.780607+0000 mgr.a (mgr.14355) 870 : audit [DBG] from='client.32106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:59.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:58 smithi171 bash[25040]: audit 2024-09-13T22:40:57.780607+0000 mgr.a (mgr.14355) 870 : audit [DBG] from='client.32106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:40:59.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:40:59 smithi007 bash[22722]: cluster 2024-09-13T22:40:58.521671+0000 mgr.a (mgr.14355) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:00.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:40:59 smithi131 bash[24745]: cluster 2024-09-13T22:40:58.521671+0000 mgr.a (mgr.14355) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:00.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:40:59 smithi171 bash[25040]: cluster 2024-09-13T22:40:58.521671+0000 mgr.a (mgr.14355) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:01.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:01 smithi007 bash[22722]: cluster 2024-09-13T22:41:00.523837+0000 mgr.a (mgr.14355) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:02.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:01 smithi131 bash[24745]: cluster 2024-09-13T22:41:00.523837+0000 mgr.a (mgr.14355) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:02.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:01 smithi171 bash[25040]: cluster 2024-09-13T22:41:00.523837+0000 mgr.a (mgr.14355) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:03.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:03.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:03.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:03.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:03.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:03.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:03.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:03 smithi007 bash[22722]: cluster 2024-09-13T22:41:02.524682+0000 mgr.a (mgr.14355) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:04.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:03 smithi131 bash[24745]: cluster 2024-09-13T22:41:02.524682+0000 mgr.a (mgr.14355) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:04.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:03 smithi171 bash[25040]: cluster 2024-09-13T22:41:02.524682+0000 mgr.a (mgr.14355) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:04.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:04 smithi007 bash[22722]: audit 2024-09-13T22:41:03.543500+0000 mgr.a (mgr.14355) 874 : audit [DBG] from='client.32184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:05.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:04 smithi131 bash[24745]: audit 2024-09-13T22:41:03.543500+0000 mgr.a (mgr.14355) 874 : audit [DBG] from='client.32184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:05.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:04 smithi171 bash[25040]: audit 2024-09-13T22:41:03.543500+0000 mgr.a (mgr.14355) 874 : audit [DBG] from='client.32184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:05.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:05 smithi007 bash[22722]: cluster 2024-09-13T22:41:04.525614+0000 mgr.a (mgr.14355) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:06.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:05 smithi131 bash[24745]: cluster 2024-09-13T22:41:04.525614+0000 mgr.a (mgr.14355) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:06.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:05 smithi171 bash[25040]: cluster 2024-09-13T22:41:04.525614+0000 mgr.a (mgr.14355) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:07.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:07 smithi007 bash[22722]: cluster 2024-09-13T22:41:06.527888+0000 mgr.a (mgr.14355) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:08.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:07 smithi131 bash[24745]: cluster 2024-09-13T22:41:06.527888+0000 mgr.a (mgr.14355) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:08.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:07 smithi171 bash[25040]: cluster 2024-09-13T22:41:06.527888+0000 mgr.a (mgr.14355) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:08.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:08.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:09.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:09.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:09 smithi007 bash[22722]: cluster 2024-09-13T22:41:08.528669+0000 mgr.a (mgr.14355) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:09.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:09 smithi007 bash[22722]: audit 2024-09-13T22:41:09.279343+0000 mgr.a (mgr.14355) 878 : audit [DBG] from='client.32259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:10.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:09 smithi131 bash[24745]: cluster 2024-09-13T22:41:08.528669+0000 mgr.a (mgr.14355) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:10.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:09 smithi131 bash[24745]: audit 2024-09-13T22:41:09.279343+0000 mgr.a (mgr.14355) 878 : audit [DBG] from='client.32259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:10.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:09 smithi171 bash[25040]: cluster 2024-09-13T22:41:08.528669+0000 mgr.a (mgr.14355) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:10.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:09 smithi171 bash[25040]: audit 2024-09-13T22:41:09.279343+0000 mgr.a (mgr.14355) 878 : audit [DBG] from='client.32259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:11.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:11 smithi007 bash[22722]: cluster 2024-09-13T22:41:10.531081+0000 mgr.a (mgr.14355) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:12.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:11 smithi131 bash[24745]: cluster 2024-09-13T22:41:10.531081+0000 mgr.a (mgr.14355) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:12.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:11 smithi171 bash[25040]: cluster 2024-09-13T22:41:10.531081+0000 mgr.a (mgr.14355) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:13.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:13 smithi007 bash[22722]: cluster 2024-09-13T22:41:12.532044+0000 mgr.a (mgr.14355) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:14.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:13 smithi131 bash[24745]: cluster 2024-09-13T22:41:12.532044+0000 mgr.a (mgr.14355) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:14.040 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:13 smithi171 bash[25040]: cluster 2024-09-13T22:41:12.532044+0000 mgr.a (mgr.14355) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:14.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:14.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:14.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:15.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:15.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:15.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:15.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:15.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:16.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:15 smithi007 bash[22722]: cluster 2024-09-13T22:41:14.532952+0000 mgr.a (mgr.14355) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:16.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:15 smithi007 bash[22722]: audit 2024-09-13T22:41:15.016547+0000 mgr.a (mgr.14355) 882 : audit [DBG] from='client.32328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:16.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:15 smithi131 bash[24745]: cluster 2024-09-13T22:41:14.532952+0000 mgr.a (mgr.14355) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:16.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:15 smithi131 bash[24745]: audit 2024-09-13T22:41:15.016547+0000 mgr.a (mgr.14355) 882 : audit [DBG] from='client.32328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:16.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:15 smithi171 bash[25040]: cluster 2024-09-13T22:41:14.532952+0000 mgr.a (mgr.14355) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:16.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:15 smithi171 bash[25040]: audit 2024-09-13T22:41:15.016547+0000 mgr.a (mgr.14355) 882 : audit [DBG] from='client.32328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:18.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:17 smithi007 bash[22722]: cluster 2024-09-13T22:41:16.535372+0000 mgr.a (mgr.14355) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:41:18.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:17 smithi131 bash[24745]: cluster 2024-09-13T22:41:16.535372+0000 mgr.a (mgr.14355) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:41:18.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:17 smithi171 bash[25040]: cluster 2024-09-13T22:41:16.535372+0000 mgr.a (mgr.14355) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:41:20.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:19 smithi007 bash[22722]: cluster 2024-09-13T22:41:18.536114+0000 mgr.a (mgr.14355) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:41:20.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:19 smithi131 bash[24745]: cluster 2024-09-13T22:41:18.536114+0000 mgr.a (mgr.14355) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:41:20.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:19 smithi171 bash[25040]: cluster 2024-09-13T22:41:18.536114+0000 mgr.a (mgr.14355) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:41:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:21.186 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:21.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:21.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:21.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:21.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:22.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:21 smithi007 bash[22722]: cluster 2024-09-13T22:41:20.537089+0000 mgr.a (mgr.14355) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:22.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:21 smithi007 bash[22722]: audit 2024-09-13T22:41:20.758232+0000 mgr.a (mgr.14355) 886 : audit [DBG] from='client.32406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:22.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:21 smithi131 bash[24745]: cluster 2024-09-13T22:41:20.537089+0000 mgr.a (mgr.14355) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:22.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:21 smithi131 bash[24745]: audit 2024-09-13T22:41:20.758232+0000 mgr.a (mgr.14355) 886 : audit [DBG] from='client.32406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:22.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:21 smithi171 bash[25040]: cluster 2024-09-13T22:41:20.537089+0000 mgr.a (mgr.14355) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:22.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:21 smithi171 bash[25040]: audit 2024-09-13T22:41:20.758232+0000 mgr.a (mgr.14355) 886 : audit [DBG] from='client.32406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:24.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:23 smithi007 bash[22722]: cluster 2024-09-13T22:41:22.537911+0000 mgr.a (mgr.14355) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:24.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:23 smithi131 bash[24745]: cluster 2024-09-13T22:41:22.537911+0000 mgr.a (mgr.14355) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:24.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:23 smithi171 bash[25040]: cluster 2024-09-13T22:41:22.537911+0000 mgr.a (mgr.14355) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:26.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:25 smithi007 bash[22722]: cluster 2024-09-13T22:41:24.538701+0000 mgr.a (mgr.14355) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:26.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:25 smithi131 bash[24745]: cluster 2024-09-13T22:41:24.538701+0000 mgr.a (mgr.14355) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:26.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:25 smithi171 bash[25040]: cluster 2024-09-13T22:41:24.538701+0000 mgr.a (mgr.14355) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:41:26.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:26.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:28.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:27 smithi007 bash[22722]: audit 2024-09-13T22:41:26.521964+0000 mgr.a (mgr.14355) 889 : audit [DBG] from='client.32478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:28.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:27 smithi007 bash[22722]: cluster 2024-09-13T22:41:26.540693+0000 mgr.a (mgr.14355) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:28.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:27 smithi131 bash[24745]: audit 2024-09-13T22:41:26.521964+0000 mgr.a (mgr.14355) 889 : audit [DBG] from='client.32478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:28.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:27 smithi131 bash[24745]: cluster 2024-09-13T22:41:26.540693+0000 mgr.a (mgr.14355) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:28.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:27 smithi171 bash[25040]: audit 2024-09-13T22:41:26.521964+0000 mgr.a (mgr.14355) 889 : audit [DBG] from='client.32478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:28.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:27 smithi171 bash[25040]: cluster 2024-09-13T22:41:26.540693+0000 mgr.a (mgr.14355) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:30.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:29 smithi007 bash[22722]: cluster 2024-09-13T22:41:28.541565+0000 mgr.a (mgr.14355) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:41:30.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:29 smithi131 bash[24745]: cluster 2024-09-13T22:41:28.541565+0000 mgr.a (mgr.14355) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:41:30.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:29 smithi171 bash[25040]: cluster 2024-09-13T22:41:28.541565+0000 mgr.a (mgr.14355) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:41:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:31.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:31.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:32.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:31 smithi007 bash[22722]: cluster 2024-09-13T22:41:30.543841+0000 mgr.a (mgr.14355) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:41:32.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:31 smithi131 bash[24745]: cluster 2024-09-13T22:41:30.543841+0000 mgr.a (mgr.14355) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:41:32.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:31 smithi171 bash[25040]: cluster 2024-09-13T22:41:30.543841+0000 mgr.a (mgr.14355) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:41:32.669 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:32.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:32.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:32.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:32.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:33.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:32 smithi007 bash[22722]: audit 2024-09-13T22:41:32.263720+0000 mgr.a (mgr.14355) 893 : audit [DBG] from='client.32550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:33.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:32 smithi131 bash[24745]: audit 2024-09-13T22:41:32.263720+0000 mgr.a (mgr.14355) 893 : audit [DBG] from='client.32550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:33.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:32 smithi171 bash[25040]: audit 2024-09-13T22:41:32.263720+0000 mgr.a (mgr.14355) 893 : audit [DBG] from='client.32550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:34.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:33 smithi007 bash[22722]: cluster 2024-09-13T22:41:32.544452+0000 mgr.a (mgr.14355) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:34.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:33 smithi131 bash[24745]: cluster 2024-09-13T22:41:32.544452+0000 mgr.a (mgr.14355) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:34.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:33 smithi171 bash[25040]: cluster 2024-09-13T22:41:32.544452+0000 mgr.a (mgr.14355) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:36.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:35 smithi131 bash[24745]: cluster 2024-09-13T22:41:34.545286+0000 mgr.a (mgr.14355) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:36.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:35 smithi171 bash[25040]: cluster 2024-09-13T22:41:34.545286+0000 mgr.a (mgr.14355) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:35 smithi007 bash[22722]: cluster 2024-09-13T22:41:34.545286+0000 mgr.a (mgr.14355) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:37.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:37.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:38.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:37 smithi131 bash[24745]: cluster 2024-09-13T22:41:36.547524+0000 mgr.a (mgr.14355) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:38.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:37 smithi171 bash[25040]: cluster 2024-09-13T22:41:36.547524+0000 mgr.a (mgr.14355) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:38.440 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:38.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:38.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:37 smithi007 bash[22722]: cluster 2024-09-13T22:41:36.547524+0000 mgr.a (mgr.14355) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:39.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:38 smithi131 bash[24745]: audit 2024-09-13T22:41:38.008416+0000 mgr.a (mgr.14355) 897 : audit [DBG] from='client.32625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:39.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:38 smithi171 bash[25040]: audit 2024-09-13T22:41:38.008416+0000 mgr.a (mgr.14355) 897 : audit [DBG] from='client.32625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:39.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:38 smithi007 bash[22722]: audit 2024-09-13T22:41:38.008416+0000 mgr.a (mgr.14355) 897 : audit [DBG] from='client.32625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:40.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:39 smithi131 bash[24745]: cluster 2024-09-13T22:41:38.548473+0000 mgr.a (mgr.14355) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:40.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:39 smithi171 bash[25040]: cluster 2024-09-13T22:41:38.548473+0000 mgr.a (mgr.14355) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:40.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:39 smithi007 bash[22722]: cluster 2024-09-13T22:41:38.548473+0000 mgr.a (mgr.14355) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:42.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:41 smithi131 bash[24745]: cluster 2024-09-13T22:41:40.550689+0000 mgr.a (mgr.14355) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:42.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:41 smithi131 bash[24745]: audit 2024-09-13T22:41:41.647507+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:41:42.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:41 smithi171 bash[25040]: cluster 2024-09-13T22:41:40.550689+0000 mgr.a (mgr.14355) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:42.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:41 smithi171 bash[25040]: audit 2024-09-13T22:41:41.647507+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:41:42.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:41 smithi007 bash[22722]: cluster 2024-09-13T22:41:40.550689+0000 mgr.a (mgr.14355) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:41:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:41 smithi007 bash[22722]: audit 2024-09-13T22:41:41.647507+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:41:43.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:42 smithi131 bash[24745]: audit 2024-09-13T22:41:42.480251+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:41:43.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:42 smithi131 bash[24745]: audit 2024-09-13T22:41:42.481928+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:41:43.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:42 smithi131 bash[24745]: audit 2024-09-13T22:41:42.490410+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:41:43.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:42 smithi131 bash[24745]: audit 2024-09-13T22:41:42.495107+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:42 smithi171 bash[25040]: audit 2024-09-13T22:41:42.480251+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:41:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:42 smithi171 bash[25040]: audit 2024-09-13T22:41:42.481928+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:41:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:42 smithi171 bash[25040]: audit 2024-09-13T22:41:42.490410+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:41:43.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:42 smithi171 bash[25040]: audit 2024-09-13T22:41:42.495107+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:43.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:43.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:43.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:43.451 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22972]: debug 2024-09-13T22:41:43.221+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:41:43.451 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22972]: debug 2024-09-13T22:41:43.221+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:41:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:42 smithi007 bash[22722]: audit 2024-09-13T22:41:42.480251+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:41:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:42 smithi007 bash[22722]: audit 2024-09-13T22:41:42.481928+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:41:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:42 smithi007 bash[22722]: audit 2024-09-13T22:41:42.490410+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:41:43.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:42 smithi007 bash[22722]: audit 2024-09-13T22:41:42.495107+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:44.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:44.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:44.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:43 smithi131 bash[24745]: audit 2024-09-13T22:41:42.496250+0000 mgr.a (mgr.14355) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:44.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:43 smithi131 bash[24745]: cluster 2024-09-13T22:41:42.551771+0000 mgr.a (mgr.14355) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:44.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:43 smithi131 bash[24745]: audit 2024-09-13T22:41:43.224169+0000 mgr.a (mgr.14355) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:41:44.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:43 smithi131 bash[24745]: cephadm 2024-09-13T22:41:43.225534+0000 mgr.a (mgr.14355) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:41:44.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:43 smithi171 bash[25040]: audit 2024-09-13T22:41:42.496250+0000 mgr.a (mgr.14355) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:44.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:43 smithi171 bash[25040]: cluster 2024-09-13T22:41:42.551771+0000 mgr.a (mgr.14355) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:44.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:43 smithi171 bash[25040]: audit 2024-09-13T22:41:43.224169+0000 mgr.a (mgr.14355) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:41:44.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:43 smithi171 bash[25040]: cephadm 2024-09-13T22:41:43.225534+0000 mgr.a (mgr.14355) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:41:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22722]: audit 2024-09-13T22:41:42.496250+0000 mgr.a (mgr.14355) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:41:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22722]: cluster 2024-09-13T22:41:42.551771+0000 mgr.a (mgr.14355) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22722]: audit 2024-09-13T22:41:43.224169+0000 mgr.a (mgr.14355) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:41:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:43 smithi007 bash[22722]: cephadm 2024-09-13T22:41:43.225534+0000 mgr.a (mgr.14355) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:41:45.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:44 smithi131 bash[24745]: audit 2024-09-13T22:41:43.779227+0000 mgr.a (mgr.14355) 904 : audit [DBG] from='client.32808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:45.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:44 smithi171 bash[25040]: audit 2024-09-13T22:41:43.779227+0000 mgr.a (mgr.14355) 904 : audit [DBG] from='client.32808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:44 smithi007 bash[22722]: audit 2024-09-13T22:41:43.779227+0000 mgr.a (mgr.14355) 904 : audit [DBG] from='client.32808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:46.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:45 smithi131 bash[24745]: cluster 2024-09-13T22:41:44.552622+0000 mgr.a (mgr.14355) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:46.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:45 smithi171 bash[25040]: cluster 2024-09-13T22:41:44.552622+0000 mgr.a (mgr.14355) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:46.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:45 smithi007 bash[22722]: cluster 2024-09-13T22:41:44.552622+0000 mgr.a (mgr.14355) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:41:48.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:47 smithi131 bash[24745]: cluster 2024-09-13T22:41:46.554920+0000 mgr.a (mgr.14355) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:48.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:47 smithi171 bash[25040]: cluster 2024-09-13T22:41:46.554920+0000 mgr.a (mgr.14355) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:48.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:47 smithi007 bash[22722]: cluster 2024-09-13T22:41:46.554920+0000 mgr.a (mgr.14355) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:49.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:49.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:49.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:49.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:50.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:49 smithi131 bash[24745]: cluster 2024-09-13T22:41:48.555677+0000 mgr.a (mgr.14355) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:50.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:49 smithi171 bash[25040]: cluster 2024-09-13T22:41:48.555677+0000 mgr.a (mgr.14355) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:50.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:49 smithi007 bash[22722]: cluster 2024-09-13T22:41:48.555677+0000 mgr.a (mgr.14355) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:51.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:51 smithi131 bash[24745]: audit 2024-09-13T22:41:49.565103+0000 mgr.a (mgr.14355) 908 : audit [DBG] from='client.32886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:51.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:51 smithi171 bash[25040]: audit 2024-09-13T22:41:49.565103+0000 mgr.a (mgr.14355) 908 : audit [DBG] from='client.32886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:51.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:51 smithi007 bash[22722]: audit 2024-09-13T22:41:49.565103+0000 mgr.a (mgr.14355) 908 : audit [DBG] from='client.32886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:52.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:52 smithi131 bash[24745]: cluster 2024-09-13T22:41:50.557945+0000 mgr.a (mgr.14355) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:52.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:52 smithi171 bash[25040]: cluster 2024-09-13T22:41:50.557945+0000 mgr.a (mgr.14355) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:52 smithi007 bash[22722]: cluster 2024-09-13T22:41:50.557945+0000 mgr.a (mgr.14355) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:54.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:54 smithi131 bash[24745]: cluster 2024-09-13T22:41:52.558717+0000 mgr.a (mgr.14355) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:54.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:54 smithi171 bash[25040]: cluster 2024-09-13T22:41:52.558717+0000 mgr.a (mgr.14355) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:54.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:54 smithi007 bash[22722]: cluster 2024-09-13T22:41:52.558717+0000 mgr.a (mgr.14355) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:54.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:41:54.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:41:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:41:55.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:41:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:41:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:41:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:41:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:41:56.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:56 smithi131 bash[24745]: cluster 2024-09-13T22:41:54.559525+0000 mgr.a (mgr.14355) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:56.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:56 smithi131 bash[24745]: audit 2024-09-13T22:41:55.325077+0000 mgr.a (mgr.14355) 912 : audit [DBG] from='client.32964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:56.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:56 smithi171 bash[25040]: cluster 2024-09-13T22:41:54.559525+0000 mgr.a (mgr.14355) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:56.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:56 smithi171 bash[25040]: audit 2024-09-13T22:41:55.325077+0000 mgr.a (mgr.14355) 912 : audit [DBG] from='client.32964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:56.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:56 smithi007 bash[22722]: cluster 2024-09-13T22:41:54.559525+0000 mgr.a (mgr.14355) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:56.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:56 smithi007 bash[22722]: audit 2024-09-13T22:41:55.325077+0000 mgr.a (mgr.14355) 912 : audit [DBG] from='client.32964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:41:58.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:41:58 smithi131 bash[24745]: cluster 2024-09-13T22:41:56.562195+0000 mgr.a (mgr.14355) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:58.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:41:58 smithi171 bash[25040]: cluster 2024-09-13T22:41:56.562195+0000 mgr.a (mgr.14355) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:41:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:41:58 smithi007 bash[22722]: cluster 2024-09-13T22:41:56.562195+0000 mgr.a (mgr.14355) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:00.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:00 smithi131 bash[24745]: cluster 2024-09-13T22:41:58.563112+0000 mgr.a (mgr.14355) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:00.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:00 smithi171 bash[25040]: cluster 2024-09-13T22:41:58.563112+0000 mgr.a (mgr.14355) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:00.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:00 smithi007 bash[22722]: cluster 2024-09-13T22:41:58.563112+0000 mgr.a (mgr.14355) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:00.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:00.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:00.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:01.496 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:02.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:02 smithi131 bash[24745]: cluster 2024-09-13T22:42:00.565092+0000 mgr.a (mgr.14355) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:02.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:02 smithi131 bash[24745]: audit 2024-09-13T22:42:01.083949+0000 mgr.a (mgr.14355) 916 : audit [DBG] from='client.33042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:02.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:02 smithi171 bash[25040]: cluster 2024-09-13T22:42:00.565092+0000 mgr.a (mgr.14355) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:02.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:02 smithi171 bash[25040]: audit 2024-09-13T22:42:01.083949+0000 mgr.a (mgr.14355) 916 : audit [DBG] from='client.33042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:02.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:02 smithi007 bash[22722]: cluster 2024-09-13T22:42:00.565092+0000 mgr.a (mgr.14355) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:02.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:02 smithi007 bash[22722]: audit 2024-09-13T22:42:01.083949+0000 mgr.a (mgr.14355) 916 : audit [DBG] from='client.33042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:04.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:04 smithi171 bash[25040]: cluster 2024-09-13T22:42:02.565966+0000 mgr.a (mgr.14355) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:04.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:04 smithi007 bash[22722]: cluster 2024-09-13T22:42:02.565966+0000 mgr.a (mgr.14355) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:04.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:04 smithi131 bash[24745]: cluster 2024-09-13T22:42:02.565966+0000 mgr.a (mgr.14355) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:06.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:06 smithi171 bash[25040]: cluster 2024-09-13T22:42:04.566784+0000 mgr.a (mgr.14355) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:06.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:06 smithi007 bash[22722]: cluster 2024-09-13T22:42:04.566784+0000 mgr.a (mgr.14355) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:06.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:06.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:06.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:06 smithi131 bash[24745]: cluster 2024-09-13T22:42:04.566784+0000 mgr.a (mgr.14355) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-09-13T22:42:07.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:07.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:07.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:07.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:07.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:08.290 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:08 smithi171 bash[25040]: cluster 2024-09-13T22:42:06.568180+0000 mgr.a (mgr.14355) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:08.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:08 smithi171 bash[25040]: audit 2024-09-13T22:42:06.836430+0000 mgr.a (mgr.14355) 920 : audit [DBG] from='client.33117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:08.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:08 smithi007 bash[22722]: cluster 2024-09-13T22:42:06.568180+0000 mgr.a (mgr.14355) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:08 smithi007 bash[22722]: audit 2024-09-13T22:42:06.836430+0000 mgr.a (mgr.14355) 920 : audit [DBG] from='client.33117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:08 smithi131 bash[24745]: cluster 2024-09-13T22:42:06.568180+0000 mgr.a (mgr.14355) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:08.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:08 smithi131 bash[24745]: audit 2024-09-13T22:42:06.836430+0000 mgr.a (mgr.14355) 920 : audit [DBG] from='client.33117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:10.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:10 smithi007 bash[22722]: cluster 2024-09-13T22:42:08.569032+0000 mgr.a (mgr.14355) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:10.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:10 smithi131 bash[24745]: cluster 2024-09-13T22:42:08.569032+0000 mgr.a (mgr.14355) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:10.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:10 smithi171 bash[25040]: cluster 2024-09-13T22:42:08.569032+0000 mgr.a (mgr.14355) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:12.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:12.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:12.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:12 smithi007 bash[22722]: cluster 2024-09-13T22:42:10.571265+0000 mgr.a (mgr.14355) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:12.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:12 smithi131 bash[24745]: cluster 2024-09-13T22:42:10.571265+0000 mgr.a (mgr.14355) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:12.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:12 smithi171 bash[25040]: cluster 2024-09-13T22:42:10.571265+0000 mgr.a (mgr.14355) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-13T22:42:13.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:13.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:13.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:13.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:13.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:14.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:14 smithi007 bash[22722]: cluster 2024-09-13T22:42:12.571786+0000 mgr.a (mgr.14355) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:14.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:14 smithi007 bash[22722]: audit 2024-09-13T22:42:12.605784+0000 mgr.a (mgr.14355) 924 : audit [DBG] from='client.33192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:14.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:14 smithi131 bash[24745]: cluster 2024-09-13T22:42:12.571786+0000 mgr.a (mgr.14355) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:14.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:14 smithi131 bash[24745]: audit 2024-09-13T22:42:12.605784+0000 mgr.a (mgr.14355) 924 : audit [DBG] from='client.33192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:14.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:14 smithi171 bash[25040]: cluster 2024-09-13T22:42:12.571786+0000 mgr.a (mgr.14355) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:14.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:14 smithi171 bash[25040]: audit 2024-09-13T22:42:12.605784+0000 mgr.a (mgr.14355) 924 : audit [DBG] from='client.33192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:16.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:16 smithi007 bash[22722]: cluster 2024-09-13T22:42:14.572782+0000 mgr.a (mgr.14355) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:16.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:16 smithi131 bash[24745]: cluster 2024-09-13T22:42:14.572782+0000 mgr.a (mgr.14355) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:16.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:16 smithi171 bash[25040]: cluster 2024-09-13T22:42:14.572782+0000 mgr.a (mgr.14355) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:18.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:18.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:18.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:18 smithi007 bash[22722]: cluster 2024-09-13T22:42:16.575199+0000 mgr.a (mgr.14355) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:18 smithi131 bash[24745]: cluster 2024-09-13T22:42:16.575199+0000 mgr.a (mgr.14355) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:18.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:18 smithi171 bash[25040]: cluster 2024-09-13T22:42:16.575199+0000 mgr.a (mgr.14355) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:18.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:18.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:20 smithi007 bash[22722]: audit 2024-09-13T22:42:18.366786+0000 mgr.a (mgr.14355) 927 : audit [DBG] from='client.33270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:20 smithi007 bash[22722]: cluster 2024-09-13T22:42:18.575700+0000 mgr.a (mgr.14355) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:20.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:20 smithi131 bash[24745]: audit 2024-09-13T22:42:18.366786+0000 mgr.a (mgr.14355) 927 : audit [DBG] from='client.33270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:20.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:20 smithi131 bash[24745]: cluster 2024-09-13T22:42:18.575700+0000 mgr.a (mgr.14355) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:20.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:20 smithi171 bash[25040]: audit 2024-09-13T22:42:18.366786+0000 mgr.a (mgr.14355) 927 : audit [DBG] from='client.33270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:20.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:20 smithi171 bash[25040]: cluster 2024-09-13T22:42:18.575700+0000 mgr.a (mgr.14355) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:22.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:22 smithi007 bash[22722]: cluster 2024-09-13T22:42:20.577886+0000 mgr.a (mgr.14355) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:22.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:22 smithi131 bash[24745]: cluster 2024-09-13T22:42:20.577886+0000 mgr.a (mgr.14355) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:22.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:22 smithi171 bash[25040]: cluster 2024-09-13T22:42:20.577886+0000 mgr.a (mgr.14355) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:23.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:23.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:23.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:24.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:24 smithi007 bash[22722]: cluster 2024-09-13T22:42:22.578670+0000 mgr.a (mgr.14355) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:24.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:24 smithi131 bash[24745]: cluster 2024-09-13T22:42:22.578670+0000 mgr.a (mgr.14355) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:24.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:24 smithi171 bash[25040]: cluster 2024-09-13T22:42:22.578670+0000 mgr.a (mgr.14355) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:24.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:24.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:24.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:24.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:24.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:25.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:25 smithi007 bash[22722]: audit 2024-09-13T22:42:24.116789+0000 mgr.a (mgr.14355) 931 : audit [DBG] from='client.33348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:25.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:25 smithi131 bash[24745]: audit 2024-09-13T22:42:24.116789+0000 mgr.a (mgr.14355) 931 : audit [DBG] from='client.33348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:25.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:25 smithi171 bash[25040]: audit 2024-09-13T22:42:24.116789+0000 mgr.a (mgr.14355) 931 : audit [DBG] from='client.33348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:26.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:26 smithi007 bash[22722]: cluster 2024-09-13T22:42:24.579094+0000 mgr.a (mgr.14355) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:26.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:26 smithi131 bash[24745]: cluster 2024-09-13T22:42:24.579094+0000 mgr.a (mgr.14355) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:26.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:26 smithi171 bash[25040]: cluster 2024-09-13T22:42:24.579094+0000 mgr.a (mgr.14355) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:28.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:28 smithi007 bash[22722]: cluster 2024-09-13T22:42:26.581305+0000 mgr.a (mgr.14355) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:28.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:28 smithi131 bash[24745]: cluster 2024-09-13T22:42:26.581305+0000 mgr.a (mgr.14355) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:28.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:28 smithi171 bash[25040]: cluster 2024-09-13T22:42:26.581305+0000 mgr.a (mgr.14355) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:42:29.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:29.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:30.312 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:30.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:30 smithi007 bash[22722]: cluster 2024-09-13T22:42:28.582022+0000 mgr.a (mgr.14355) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:30.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:30 smithi131 bash[24745]: cluster 2024-09-13T22:42:28.582022+0000 mgr.a (mgr.14355) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:30.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:30 smithi171 bash[25040]: cluster 2024-09-13T22:42:28.582022+0000 mgr.a (mgr.14355) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:31.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:31 smithi007 bash[22722]: audit 2024-09-13T22:42:29.884200+0000 mgr.a (mgr.14355) 935 : audit [DBG] from='client.33423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:31.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:31 smithi131 bash[24745]: audit 2024-09-13T22:42:29.884200+0000 mgr.a (mgr.14355) 935 : audit [DBG] from='client.33423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:31.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:31 smithi171 bash[25040]: audit 2024-09-13T22:42:29.884200+0000 mgr.a (mgr.14355) 935 : audit [DBG] from='client.33423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:32.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:32 smithi007 bash[22722]: cluster 2024-09-13T22:42:30.584476+0000 mgr.a (mgr.14355) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:42:32.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:32 smithi131 bash[24745]: cluster 2024-09-13T22:42:30.584476+0000 mgr.a (mgr.14355) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:42:32.540 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:32 smithi171 bash[25040]: cluster 2024-09-13T22:42:30.584476+0000 mgr.a (mgr.14355) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:42:34.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:34 smithi007 bash[22722]: cluster 2024-09-13T22:42:32.585433+0000 mgr.a (mgr.14355) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:34.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:34 smithi131 bash[24745]: cluster 2024-09-13T22:42:32.585433+0000 mgr.a (mgr.14355) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:34.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:34 smithi171 bash[25040]: cluster 2024-09-13T22:42:32.585433+0000 mgr.a (mgr.14355) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:36.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:36.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:36.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:36 smithi007 bash[22722]: cluster 2024-09-13T22:42:34.586347+0000 mgr.a (mgr.14355) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:36.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:36 smithi131 bash[24745]: cluster 2024-09-13T22:42:34.586347+0000 mgr.a (mgr.14355) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:36.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:36 smithi171 bash[25040]: cluster 2024-09-13T22:42:34.586347+0000 mgr.a (mgr.14355) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:42:37.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:37 smithi007 bash[22722]: audit 2024-09-13T22:42:35.656228+0000 mgr.a (mgr.14355) 939 : audit [DBG] from='client.33498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:37.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:37 smithi131 bash[24745]: audit 2024-09-13T22:42:35.656228+0000 mgr.a (mgr.14355) 939 : audit [DBG] from='client.33498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:37.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:37 smithi171 bash[25040]: audit 2024-09-13T22:42:35.656228+0000 mgr.a (mgr.14355) 939 : audit [DBG] from='client.33498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:38 smithi007 bash[22722]: cluster 2024-09-13T22:42:36.589140+0000 mgr.a (mgr.14355) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:38.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:38 smithi131 bash[24745]: cluster 2024-09-13T22:42:36.589140+0000 mgr.a (mgr.14355) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:38.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:38 smithi171 bash[25040]: cluster 2024-09-13T22:42:36.589140+0000 mgr.a (mgr.14355) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:40.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:40 smithi007 bash[22722]: cluster 2024-09-13T22:42:38.589931+0000 mgr.a (mgr.14355) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:40.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:40 smithi131 bash[24745]: cluster 2024-09-13T22:42:38.589931+0000 mgr.a (mgr.14355) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:40.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:40 smithi171 bash[25040]: cluster 2024-09-13T22:42:38.589931+0000 mgr.a (mgr.14355) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:42:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:41.843 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:42.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:42 smithi007 bash[22722]: cluster 2024-09-13T22:42:40.591865+0000 mgr.a (mgr.14355) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:42.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:42 smithi131 bash[24745]: cluster 2024-09-13T22:42:40.591865+0000 mgr.a (mgr.14355) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:42.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:42 smithi171 bash[25040]: cluster 2024-09-13T22:42:40.591865+0000 mgr.a (mgr.14355) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:43.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:43 smithi007 bash[22722]: audit 2024-09-13T22:42:41.429998+0000 mgr.a (mgr.14355) 943 : audit [DBG] from='client.33576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:43.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:43 smithi131 bash[24745]: audit 2024-09-13T22:42:41.429998+0000 mgr.a (mgr.14355) 943 : audit [DBG] from='client.33576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:43.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:43 smithi171 bash[25040]: audit 2024-09-13T22:42:41.429998+0000 mgr.a (mgr.14355) 943 : audit [DBG] from='client.33576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:44.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:44 smithi007 bash[22722]: cluster 2024-09-13T22:42:42.592825+0000 mgr.a (mgr.14355) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:44 smithi007 bash[22722]: audit 2024-09-13T22:42:43.279659+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:42:44.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:44 smithi131 bash[24745]: cluster 2024-09-13T22:42:42.592825+0000 mgr.a (mgr.14355) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:44.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:44 smithi131 bash[24745]: audit 2024-09-13T22:42:43.279659+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:42:44.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:44 smithi171 bash[25040]: cluster 2024-09-13T22:42:42.592825+0000 mgr.a (mgr.14355) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:44.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:44 smithi171 bash[25040]: audit 2024-09-13T22:42:43.279659+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:42:46.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:46 smithi007 bash[22722]: cluster 2024-09-13T22:42:44.593612+0000 mgr.a (mgr.14355) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:46.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:46 smithi131 bash[24745]: cluster 2024-09-13T22:42:44.593612+0000 mgr.a (mgr.14355) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:46.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:46 smithi171 bash[25040]: cluster 2024-09-13T22:42:44.593612+0000 mgr.a (mgr.14355) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:42:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:47.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:47.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:48.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:48 smithi007 bash[22722]: cluster 2024-09-13T22:42:46.595880+0000 mgr.a (mgr.14355) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:42:48.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:48 smithi007 bash[22722]: audit 2024-09-13T22:42:47.183021+0000 mgr.a (mgr.14355) 947 : audit [DBG] from='client.33645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:48.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:48 smithi131 bash[24745]: cluster 2024-09-13T22:42:46.595880+0000 mgr.a (mgr.14355) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:42:48.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:48 smithi131 bash[24745]: audit 2024-09-13T22:42:47.183021+0000 mgr.a (mgr.14355) 947 : audit [DBG] from='client.33645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:48.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:48 smithi171 bash[25040]: cluster 2024-09-13T22:42:46.595880+0000 mgr.a (mgr.14355) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:42:48.541 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:48 smithi171 bash[25040]: audit 2024-09-13T22:42:47.183021+0000 mgr.a (mgr.14355) 947 : audit [DBG] from='client.33645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:49.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: cluster 2024-09-13T22:42:48.596388+0000 mgr.a (mgr.14355) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.626665+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.631845+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.637043+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.642369+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.652804+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:48.655985+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:49.388026+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:49.389675+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:49.399965+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:49.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:49 smithi007 bash[22722]: audit 2024-09-13T22:42:49.402826+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: cluster 2024-09-13T22:42:48.596388+0000 mgr.a (mgr.14355) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.626665+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.631845+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.637043+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.642369+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.652804+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:48.655985+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:49.388026+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:42:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:49.389675+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:42:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:49.399965+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:49 smithi131 bash[24745]: audit 2024-09-13T22:42:49.402826+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:50.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: cluster 2024-09-13T22:42:48.596388+0000 mgr.a (mgr.14355) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:42:50.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.626665+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.631845+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.637043+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.642369+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.652804+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:48.655985+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:49.388026+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:49.389675+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:49.399965+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:42:50.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:49 smithi171 bash[25040]: audit 2024-09-13T22:42:49.402826+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:50.451 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:42:50 smithi007 bash[22972]: debug 2024-09-13T22:42:50.107+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:42:50.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:42:50 smithi007 bash[22972]: debug 2024-09-13T22:42:50.111+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:42:50.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:50 smithi007 bash[22722]: audit 2024-09-13T22:42:49.405295+0000 mgr.a (mgr.14355) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:50.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:50 smithi007 bash[22722]: audit 2024-09-13T22:42:50.113856+0000 mgr.a (mgr.14355) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:42:50.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:50 smithi007 bash[22722]: cephadm 2024-09-13T22:42:50.115114+0000 mgr.a (mgr.14355) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:42:51.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:50 smithi131 bash[24745]: audit 2024-09-13T22:42:49.405295+0000 mgr.a (mgr.14355) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:51.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:50 smithi131 bash[24745]: audit 2024-09-13T22:42:50.113856+0000 mgr.a (mgr.14355) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:42:51.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:50 smithi131 bash[24745]: cephadm 2024-09-13T22:42:50.115114+0000 mgr.a (mgr.14355) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:42:51.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:50 smithi171 bash[25040]: audit 2024-09-13T22:42:49.405295+0000 mgr.a (mgr.14355) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:42:51.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:50 smithi171 bash[25040]: audit 2024-09-13T22:42:50.113856+0000 mgr.a (mgr.14355) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:42:51.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:50 smithi171 bash[25040]: cephadm 2024-09-13T22:42:50.115114+0000 mgr.a (mgr.14355) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:42:51.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:51 smithi007 bash[22722]: cluster 2024-09-13T22:42:50.598744+0000 mgr.a (mgr.14355) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:52.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:51 smithi131 bash[24745]: cluster 2024-09-13T22:42:50.598744+0000 mgr.a (mgr.14355) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:52.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:51 smithi171 bash[25040]: cluster 2024-09-13T22:42:50.598744+0000 mgr.a (mgr.14355) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:53.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:53.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:53.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:53.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:53.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:53.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:53 smithi007 bash[22722]: cluster 2024-09-13T22:42:52.599549+0000 mgr.a (mgr.14355) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:53.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:53 smithi007 bash[22722]: audit 2024-09-13T22:42:52.948103+0000 mgr.a (mgr.14355) 954 : audit [DBG] from='client.33819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:54.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:53 smithi131 bash[24745]: cluster 2024-09-13T22:42:52.599549+0000 mgr.a (mgr.14355) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:54.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:53 smithi131 bash[24745]: audit 2024-09-13T22:42:52.948103+0000 mgr.a (mgr.14355) 954 : audit [DBG] from='client.33819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:54.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:53 smithi171 bash[25040]: cluster 2024-09-13T22:42:52.599549+0000 mgr.a (mgr.14355) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:54.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:53 smithi171 bash[25040]: audit 2024-09-13T22:42:52.948103+0000 mgr.a (mgr.14355) 954 : audit [DBG] from='client.33819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:42:55.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:55 smithi007 bash[22722]: cluster 2024-09-13T22:42:54.600641+0000 mgr.a (mgr.14355) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:56.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:55 smithi131 bash[24745]: cluster 2024-09-13T22:42:54.600641+0000 mgr.a (mgr.14355) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:56.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:55 smithi171 bash[25040]: cluster 2024-09-13T22:42:54.600641+0000 mgr.a (mgr.14355) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:57.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:57 smithi007 bash[22722]: cluster 2024-09-13T22:42:56.602977+0000 mgr.a (mgr.14355) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:58.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:57 smithi131 bash[24745]: cluster 2024-09-13T22:42:56.602977+0000 mgr.a (mgr.14355) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:58.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:57 smithi171 bash[25040]: cluster 2024-09-13T22:42:56.602977+0000 mgr.a (mgr.14355) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:58.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:42:58.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:42:58.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:42:59.108 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:42:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:42:59.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:42:59.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:42:59.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:42:59.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:59 smithi007 bash[22722]: cluster 2024-09-13T22:42:58.603824+0000 mgr.a (mgr.14355) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:42:59.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:42:59 smithi007 bash[22722]: audit 2024-09-13T22:42:58.689471+0000 mgr.a (mgr.14355) 958 : audit [DBG] from='client.33894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:00.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:59 smithi131 bash[24745]: cluster 2024-09-13T22:42:58.603824+0000 mgr.a (mgr.14355) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:42:59 smithi131 bash[24745]: audit 2024-09-13T22:42:58.689471+0000 mgr.a (mgr.14355) 958 : audit [DBG] from='client.33894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:00.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:59 smithi171 bash[25040]: cluster 2024-09-13T22:42:58.603824+0000 mgr.a (mgr.14355) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:00.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:42:59 smithi171 bash[25040]: audit 2024-09-13T22:42:58.689471+0000 mgr.a (mgr.14355) 958 : audit [DBG] from='client.33894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:01.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:01 smithi007 bash[22722]: cluster 2024-09-13T22:43:00.606198+0000 mgr.a (mgr.14355) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:02.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:01 smithi131 bash[24745]: cluster 2024-09-13T22:43:00.606198+0000 mgr.a (mgr.14355) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:02.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:01 smithi171 bash[25040]: cluster 2024-09-13T22:43:00.606198+0000 mgr.a (mgr.14355) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:03.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:03 smithi007 bash[22722]: cluster 2024-09-13T22:43:02.607027+0000 mgr.a (mgr.14355) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:04.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:03 smithi131 bash[24745]: cluster 2024-09-13T22:43:02.607027+0000 mgr.a (mgr.14355) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:04.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:03 smithi171 bash[25040]: cluster 2024-09-13T22:43:02.607027+0000 mgr.a (mgr.14355) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:04.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:04.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:04.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:04.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:04.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:04.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:05.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:05 smithi007 bash[22722]: audit 2024-09-13T22:43:04.440561+0000 mgr.a (mgr.14355) 961 : audit [DBG] from='client.33972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:05.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:05 smithi007 bash[22722]: cluster 2024-09-13T22:43:04.607736+0000 mgr.a (mgr.14355) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:06.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:05 smithi131 bash[24745]: audit 2024-09-13T22:43:04.440561+0000 mgr.a (mgr.14355) 961 : audit [DBG] from='client.33972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:06.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:05 smithi131 bash[24745]: cluster 2024-09-13T22:43:04.607736+0000 mgr.a (mgr.14355) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:06.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:05 smithi171 bash[25040]: audit 2024-09-13T22:43:04.440561+0000 mgr.a (mgr.14355) 961 : audit [DBG] from='client.33972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:06.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:05 smithi171 bash[25040]: cluster 2024-09-13T22:43:04.607736+0000 mgr.a (mgr.14355) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:07.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:07 smithi007 bash[22722]: cluster 2024-09-13T22:43:06.610161+0000 mgr.a (mgr.14355) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:08.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:07 smithi131 bash[24745]: cluster 2024-09-13T22:43:06.610161+0000 mgr.a (mgr.14355) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:08.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:07 smithi171 bash[25040]: cluster 2024-09-13T22:43:06.610161+0000 mgr.a (mgr.14355) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:09.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:09.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:09 smithi007 bash[22722]: cluster 2024-09-13T22:43:08.611135+0000 mgr.a (mgr.14355) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:10.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:09 smithi131 bash[24745]: cluster 2024-09-13T22:43:08.611135+0000 mgr.a (mgr.14355) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:10.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:09 smithi171 bash[25040]: cluster 2024-09-13T22:43:08.611135+0000 mgr.a (mgr.14355) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:10.612 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:10.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:10.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:10 smithi007 bash[22722]: audit 2024-09-13T22:43:10.175410+0000 mgr.a (mgr.14355) 965 : audit [DBG] from='client.34050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:11.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:10 smithi131 bash[24745]: audit 2024-09-13T22:43:10.175410+0000 mgr.a (mgr.14355) 965 : audit [DBG] from='client.34050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:11.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:10 smithi171 bash[25040]: audit 2024-09-13T22:43:10.175410+0000 mgr.a (mgr.14355) 965 : audit [DBG] from='client.34050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:11.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:11 smithi007 bash[22722]: cluster 2024-09-13T22:43:10.612429+0000 mgr.a (mgr.14355) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:43:12.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:11 smithi131 bash[24745]: cluster 2024-09-13T22:43:10.612429+0000 mgr.a (mgr.14355) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:43:12.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:11 smithi171 bash[25040]: cluster 2024-09-13T22:43:10.612429+0000 mgr.a (mgr.14355) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:43:13.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:13 smithi007 bash[22722]: cluster 2024-09-13T22:43:12.613173+0000 mgr.a (mgr.14355) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:14.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:13 smithi131 bash[24745]: cluster 2024-09-13T22:43:12.613173+0000 mgr.a (mgr.14355) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:14.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:13 smithi171 bash[25040]: cluster 2024-09-13T22:43:12.613173+0000 mgr.a (mgr.14355) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:15.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:15.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:15.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:15 smithi007 bash[22722]: cluster 2024-09-13T22:43:14.613946+0000 mgr.a (mgr.14355) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:16.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:15 smithi131 bash[24745]: cluster 2024-09-13T22:43:14.613946+0000 mgr.a (mgr.14355) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:16.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:15 smithi171 bash[25040]: cluster 2024-09-13T22:43:14.613946+0000 mgr.a (mgr.14355) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:43:16.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:16.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:16.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:16.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:16.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:16.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:16 smithi007 bash[22722]: audit 2024-09-13T22:43:15.958956+0000 mgr.a (mgr.14355) 969 : audit [DBG] from='client.34119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:17.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:16 smithi131 bash[24745]: audit 2024-09-13T22:43:15.958956+0000 mgr.a (mgr.14355) 969 : audit [DBG] from='client.34119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:17.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:16 smithi171 bash[25040]: audit 2024-09-13T22:43:15.958956+0000 mgr.a (mgr.14355) 969 : audit [DBG] from='client.34119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:18.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:17 smithi131 bash[24745]: cluster 2024-09-13T22:43:16.616859+0000 mgr.a (mgr.14355) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:18.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:17 smithi171 bash[25040]: cluster 2024-09-13T22:43:16.616859+0000 mgr.a (mgr.14355) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:18.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:17 smithi007 bash[22722]: cluster 2024-09-13T22:43:16.616859+0000 mgr.a (mgr.14355) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:20.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:19 smithi131 bash[24745]: cluster 2024-09-13T22:43:18.617857+0000 mgr.a (mgr.14355) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:20.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:19 smithi171 bash[25040]: cluster 2024-09-13T22:43:18.617857+0000 mgr.a (mgr.14355) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:20.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:19 smithi007 bash[22722]: cluster 2024-09-13T22:43:18.617857+0000 mgr.a (mgr.14355) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:21.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:21.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:22.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:21 smithi131 bash[24745]: cluster 2024-09-13T22:43:20.619856+0000 mgr.a (mgr.14355) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:22.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:21 smithi171 bash[25040]: cluster 2024-09-13T22:43:20.619856+0000 mgr.a (mgr.14355) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:22.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:22.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:21 smithi007 bash[22722]: cluster 2024-09-13T22:43:20.619856+0000 mgr.a (mgr.14355) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:23.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:22 smithi131 bash[24745]: audit 2024-09-13T22:43:21.737611+0000 mgr.a (mgr.14355) 973 : audit [DBG] from='client.34197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:23.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:22 smithi171 bash[25040]: audit 2024-09-13T22:43:21.737611+0000 mgr.a (mgr.14355) 973 : audit [DBG] from='client.34197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:23.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:22 smithi007 bash[22722]: audit 2024-09-13T22:43:21.737611+0000 mgr.a (mgr.14355) 973 : audit [DBG] from='client.34197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:24.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:23 smithi131 bash[24745]: cluster 2024-09-13T22:43:22.620796+0000 mgr.a (mgr.14355) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:24.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:23 smithi171 bash[25040]: cluster 2024-09-13T22:43:22.620796+0000 mgr.a (mgr.14355) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:24.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:23 smithi007 bash[22722]: cluster 2024-09-13T22:43:22.620796+0000 mgr.a (mgr.14355) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:26.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:25 smithi131 bash[24745]: cluster 2024-09-13T22:43:24.621603+0000 mgr.a (mgr.14355) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:26.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:25 smithi171 bash[25040]: cluster 2024-09-13T22:43:24.621603+0000 mgr.a (mgr.14355) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:26.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:25 smithi007 bash[22722]: cluster 2024-09-13T22:43:24.621603+0000 mgr.a (mgr.14355) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:43:27.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:27.938 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:28.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:27 smithi131 bash[24745]: cluster 2024-09-13T22:43:26.623898+0000 mgr.a (mgr.14355) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:28.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:27 smithi171 bash[25040]: cluster 2024-09-13T22:43:26.623898+0000 mgr.a (mgr.14355) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:28.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:27 smithi007 bash[22722]: cluster 2024-09-13T22:43:26.623898+0000 mgr.a (mgr.14355) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:29.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:28 smithi131 bash[24745]: audit 2024-09-13T22:43:27.499751+0000 mgr.a (mgr.14355) 977 : audit [DBG] from='client.34272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:29.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:28 smithi171 bash[25040]: audit 2024-09-13T22:43:27.499751+0000 mgr.a (mgr.14355) 977 : audit [DBG] from='client.34272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:29.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:28 smithi007 bash[22722]: audit 2024-09-13T22:43:27.499751+0000 mgr.a (mgr.14355) 977 : audit [DBG] from='client.34272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:30.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:29 smithi131 bash[24745]: cluster 2024-09-13T22:43:28.624883+0000 mgr.a (mgr.14355) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:30.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:29 smithi171 bash[25040]: cluster 2024-09-13T22:43:28.624883+0000 mgr.a (mgr.14355) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:29 smithi007 bash[22722]: cluster 2024-09-13T22:43:28.624883+0000 mgr.a (mgr.14355) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:32.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:31 smithi131 bash[24745]: cluster 2024-09-13T22:43:30.627067+0000 mgr.a (mgr.14355) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:32.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:31 smithi171 bash[25040]: cluster 2024-09-13T22:43:30.627067+0000 mgr.a (mgr.14355) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:31 smithi007 bash[22722]: cluster 2024-09-13T22:43:30.627067+0000 mgr.a (mgr.14355) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:32.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:32.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:32.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:33.675 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:34.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:33 smithi131 bash[24745]: cluster 2024-09-13T22:43:32.627838+0000 mgr.a (mgr.14355) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:34.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:33 smithi131 bash[24745]: audit 2024-09-13T22:43:33.269886+0000 mgr.a (mgr.14355) 981 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:34.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:33 smithi171 bash[25040]: cluster 2024-09-13T22:43:32.627838+0000 mgr.a (mgr.14355) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:34.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:33 smithi171 bash[25040]: audit 2024-09-13T22:43:33.269886+0000 mgr.a (mgr.14355) 981 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:34.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:33 smithi007 bash[22722]: cluster 2024-09-13T22:43:32.627838+0000 mgr.a (mgr.14355) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:34.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:33 smithi007 bash[22722]: audit 2024-09-13T22:43:33.269886+0000 mgr.a (mgr.14355) 981 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:36.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:35 smithi131 bash[24745]: cluster 2024-09-13T22:43:34.628810+0000 mgr.a (mgr.14355) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:36.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:35 smithi171 bash[25040]: cluster 2024-09-13T22:43:34.628810+0000 mgr.a (mgr.14355) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:35 smithi007 bash[22722]: cluster 2024-09-13T22:43:34.628810+0000 mgr.a (mgr.14355) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:38.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:37 smithi131 bash[24745]: cluster 2024-09-13T22:43:36.631231+0000 mgr.a (mgr.14355) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:38.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:37 smithi171 bash[25040]: cluster 2024-09-13T22:43:36.631231+0000 mgr.a (mgr.14355) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:37 smithi007 bash[22722]: cluster 2024-09-13T22:43:36.631231+0000 mgr.a (mgr.14355) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:38.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:38.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:38.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:39.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:39.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:39.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:40.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:39 smithi131 bash[24745]: cluster 2024-09-13T22:43:38.632208+0000 mgr.a (mgr.14355) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:40.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:39 smithi131 bash[24745]: audit 2024-09-13T22:43:39.015348+0000 mgr.a (mgr.14355) 985 : audit [DBG] from='client.34428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:40.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:39 smithi171 bash[25040]: cluster 2024-09-13T22:43:38.632208+0000 mgr.a (mgr.14355) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:40.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:39 smithi171 bash[25040]: audit 2024-09-13T22:43:39.015348+0000 mgr.a (mgr.14355) 985 : audit [DBG] from='client.34428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:39 smithi007 bash[22722]: cluster 2024-09-13T22:43:38.632208+0000 mgr.a (mgr.14355) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:39 smithi007 bash[22722]: audit 2024-09-13T22:43:39.015348+0000 mgr.a (mgr.14355) 985 : audit [DBG] from='client.34428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:42.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:41 smithi131 bash[24745]: cluster 2024-09-13T22:43:40.634710+0000 mgr.a (mgr.14355) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:42.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:41 smithi171 bash[25040]: cluster 2024-09-13T22:43:40.634710+0000 mgr.a (mgr.14355) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:42.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:41 smithi007 bash[22722]: cluster 2024-09-13T22:43:40.634710+0000 mgr.a (mgr.14355) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:44.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:43 smithi131 bash[24745]: cluster 2024-09-13T22:43:42.635643+0000 mgr.a (mgr.14355) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:44.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:43 smithi171 bash[25040]: cluster 2024-09-13T22:43:42.635643+0000 mgr.a (mgr.14355) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:44.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:43 smithi007 bash[22722]: cluster 2024-09-13T22:43:42.635643+0000 mgr.a (mgr.14355) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:44.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:44.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:45.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:45.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:46.029 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:45 smithi131 bash[24745]: cluster 2024-09-13T22:43:44.636148+0000 mgr.a (mgr.14355) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:46.030 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:45 smithi131 bash[24745]: audit 2024-09-13T22:43:44.792376+0000 mgr.a (mgr.14355) 989 : audit [DBG] from='client.34506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:46.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:45 smithi171 bash[25040]: cluster 2024-09-13T22:43:44.636148+0000 mgr.a (mgr.14355) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:46.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:45 smithi171 bash[25040]: audit 2024-09-13T22:43:44.792376+0000 mgr.a (mgr.14355) 989 : audit [DBG] from='client.34506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:46.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:45 smithi007 bash[22722]: cluster 2024-09-13T22:43:44.636148+0000 mgr.a (mgr.14355) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:46.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:45 smithi007 bash[22722]: audit 2024-09-13T22:43:44.792376+0000 mgr.a (mgr.14355) 989 : audit [DBG] from='client.34506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:48.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:47 smithi171 bash[25040]: cluster 2024-09-13T22:43:46.638527+0000 mgr.a (mgr.14355) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:48.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:47 smithi007 bash[22722]: cluster 2024-09-13T22:43:46.638527+0000 mgr.a (mgr.14355) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:48.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:47 smithi131 bash[24745]: cluster 2024-09-13T22:43:46.638527+0000 mgr.a (mgr.14355) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:43:50.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:49 smithi171 bash[25040]: cluster 2024-09-13T22:43:48.639317+0000 mgr.a (mgr.14355) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:50.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:49 smithi007 bash[22722]: cluster 2024-09-13T22:43:48.639317+0000 mgr.a (mgr.14355) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:50.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:50.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:50.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:50.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:49 smithi131 bash[24745]: cluster 2024-09-13T22:43:48.639317+0000 mgr.a (mgr.14355) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:51.015 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:51.041 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:50 smithi171 bash[25040]: audit 2024-09-13T22:43:50.165533+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:43:51.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:50 smithi007 bash[22722]: audit 2024-09-13T22:43:50.165533+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:43:51.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:50 smithi131 bash[24745]: audit 2024-09-13T22:43:50.165533+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:43:51.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22972]: debug 2024-09-13T22:43:51.690+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:43:51.952 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22972]: debug 2024-09-13T22:43:51.694+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:43:51.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:50.577040+0000 mgr.a (mgr.14355) 992 : audit [DBG] from='client.34584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: cluster 2024-09-13T22:43:50.641087+0000 mgr.a (mgr.14355) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:51.016638+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:51.017620+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:51.023065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:51.025241+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:51 smithi007 bash[22722]: audit 2024-09-13T22:43:51.026232+0000 mgr.a (mgr.14355) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:50.577040+0000 mgr.a (mgr.14355) 992 : audit [DBG] from='client.34584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: cluster 2024-09-13T22:43:50.641087+0000 mgr.a (mgr.14355) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:51.016638+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:51.017620+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:51.023065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:43:52.042 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:51.025241+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:51 smithi171 bash[25040]: audit 2024-09-13T22:43:51.026232+0000 mgr.a (mgr.14355) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:50.577040+0000 mgr.a (mgr.14355) 992 : audit [DBG] from='client.34584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: cluster 2024-09-13T22:43:50.641087+0000 mgr.a (mgr.14355) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:51.016638+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:51.017620+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:51.023065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:51.025241+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:52.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:51 smithi131 bash[24745]: audit 2024-09-13T22:43:51.026232+0000 mgr.a (mgr.14355) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:43:53.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:52 smithi007 bash[22722]: audit 2024-09-13T22:43:51.697198+0000 mgr.a (mgr.14355) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:43:53.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:52 smithi007 bash[22722]: cephadm 2024-09-13T22:43:51.698415+0000 mgr.a (mgr.14355) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:43:53.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:52 smithi131 bash[24745]: audit 2024-09-13T22:43:51.697198+0000 mgr.a (mgr.14355) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:43:53.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:52 smithi131 bash[24745]: cephadm 2024-09-13T22:43:51.698415+0000 mgr.a (mgr.14355) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:43:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:52 smithi171 bash[25040]: audit 2024-09-13T22:43:51.697198+0000 mgr.a (mgr.14355) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:43:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:52 smithi171 bash[25040]: cephadm 2024-09-13T22:43:51.698415+0000 mgr.a (mgr.14355) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:43:54.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:53 smithi007 bash[22722]: cluster 2024-09-13T22:43:52.642005+0000 mgr.a (mgr.14355) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:54.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:53 smithi131 bash[24745]: cluster 2024-09-13T22:43:52.642005+0000 mgr.a (mgr.14355) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:54.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:53 smithi171 bash[25040]: cluster 2024-09-13T22:43:52.642005+0000 mgr.a (mgr.14355) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:43:56.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:43:56.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:43:56.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:43:56.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:55 smithi007 bash[22722]: cluster 2024-09-13T22:43:54.642810+0000 mgr.a (mgr.14355) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:43:56.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:55 smithi131 bash[24745]: cluster 2024-09-13T22:43:54.642810+0000 mgr.a (mgr.14355) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:43:56.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:55 smithi171 bash[25040]: cluster 2024-09-13T22:43:54.642810+0000 mgr.a (mgr.14355) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:43:56.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:43:56.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:43:56.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:43:56.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:43:56.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:43:57.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:56 smithi007 bash[22722]: audit 2024-09-13T22:43:56.353843+0000 mgr.a (mgr.14355) 999 : audit [DBG] from='client.34767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:57.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:56 smithi131 bash[24745]: audit 2024-09-13T22:43:56.353843+0000 mgr.a (mgr.14355) 999 : audit [DBG] from='client.34767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:57.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:56 smithi171 bash[25040]: audit 2024-09-13T22:43:56.353843+0000 mgr.a (mgr.14355) 999 : audit [DBG] from='client.34767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:43:58.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:57 smithi007 bash[22722]: cluster 2024-09-13T22:43:56.644111+0000 mgr.a (mgr.14355) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:58.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:57 smithi131 bash[24745]: cluster 2024-09-13T22:43:56.644111+0000 mgr.a (mgr.14355) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:43:58.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:57 smithi171 bash[25040]: cluster 2024-09-13T22:43:56.644111+0000 mgr.a (mgr.14355) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:00.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:43:59 smithi007 bash[22722]: cluster 2024-09-13T22:43:58.644986+0000 mgr.a (mgr.14355) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:44:00.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:43:59 smithi131 bash[24745]: cluster 2024-09-13T22:43:58.644986+0000 mgr.a (mgr.14355) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:44:00.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:43:59 smithi171 bash[25040]: cluster 2024-09-13T22:43:58.644986+0000 mgr.a (mgr.14355) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:44:01.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:01.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:01.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:02.201 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:01 smithi007 bash[22722]: cluster 2024-09-13T22:44:00.647163+0000 mgr.a (mgr.14355) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:02.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:01 smithi131 bash[24745]: cluster 2024-09-13T22:44:00.647163+0000 mgr.a (mgr.14355) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:02.291 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:01 smithi171 bash[25040]: cluster 2024-09-13T22:44:00.647163+0000 mgr.a (mgr.14355) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:02.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:02.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:03.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:02 smithi007 bash[22722]: audit 2024-09-13T22:44:02.128834+0000 mgr.a (mgr.14355) 1003 : audit [DBG] from='client.34839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:03.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:02 smithi131 bash[24745]: audit 2024-09-13T22:44:02.128834+0000 mgr.a (mgr.14355) 1003 : audit [DBG] from='client.34839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:03.322 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:02 smithi171 bash[25040]: audit 2024-09-13T22:44:02.128834+0000 mgr.a (mgr.14355) 1003 : audit [DBG] from='client.34839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:04.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:03 smithi007 bash[22722]: cluster 2024-09-13T22:44:02.648114+0000 mgr.a (mgr.14355) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:04.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:03 smithi131 bash[24745]: cluster 2024-09-13T22:44:02.648114+0000 mgr.a (mgr.14355) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:04.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:03 smithi171 bash[25040]: cluster 2024-09-13T22:44:02.648114+0000 mgr.a (mgr.14355) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:05 smithi007 bash[22722]: cluster 2024-09-13T22:44:04.648904+0000 mgr.a (mgr.14355) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:06.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:05 smithi131 bash[24745]: cluster 2024-09-13T22:44:04.648904+0000 mgr.a (mgr.14355) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:05 smithi171 bash[25040]: cluster 2024-09-13T22:44:04.648904+0000 mgr.a (mgr.14355) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:07.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:07.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:07 smithi007 bash[22722]: cluster 2024-09-13T22:44:06.651183+0000 mgr.a (mgr.14355) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:08.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:08.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:08.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:07 smithi131 bash[24745]: cluster 2024-09-13T22:44:06.651183+0000 mgr.a (mgr.14355) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:08.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:07 smithi171 bash[25040]: cluster 2024-09-13T22:44:06.651183+0000 mgr.a (mgr.14355) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:09.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:08 smithi007 bash[22722]: audit 2024-09-13T22:44:07.873775+0000 mgr.a (mgr.14355) 1007 : audit [DBG] from='client.34914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:09.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:08 smithi131 bash[24745]: audit 2024-09-13T22:44:07.873775+0000 mgr.a (mgr.14355) 1007 : audit [DBG] from='client.34914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:09.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:08 smithi171 bash[25040]: audit 2024-09-13T22:44:07.873775+0000 mgr.a (mgr.14355) 1007 : audit [DBG] from='client.34914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:09 smithi007 bash[22722]: cluster 2024-09-13T22:44:08.652111+0000 mgr.a (mgr.14355) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:10.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:09 smithi131 bash[24745]: cluster 2024-09-13T22:44:08.652111+0000 mgr.a (mgr.14355) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:10.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:09 smithi171 bash[25040]: cluster 2024-09-13T22:44:08.652111+0000 mgr.a (mgr.14355) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:11 smithi007 bash[22722]: cluster 2024-09-13T22:44:10.654390+0000 mgr.a (mgr.14355) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:12.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:11 smithi131 bash[24745]: cluster 2024-09-13T22:44:10.654390+0000 mgr.a (mgr.14355) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:11 smithi171 bash[25040]: cluster 2024-09-13T22:44:10.654390+0000 mgr.a (mgr.14355) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:13.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:13.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:13.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:14.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:14.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:13 smithi007 bash[22722]: cluster 2024-09-13T22:44:12.655274+0000 mgr.a (mgr.14355) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:14.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:13 smithi131 bash[24745]: cluster 2024-09-13T22:44:12.655274+0000 mgr.a (mgr.14355) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:14.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:13 smithi171 bash[25040]: cluster 2024-09-13T22:44:12.655274+0000 mgr.a (mgr.14355) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:15.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:14 smithi007 bash[22722]: audit 2024-09-13T22:44:13.621045+0000 mgr.a (mgr.14355) 1011 : audit [DBG] from='client.34992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:15.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:14 smithi131 bash[24745]: audit 2024-09-13T22:44:13.621045+0000 mgr.a (mgr.14355) 1011 : audit [DBG] from='client.34992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:15.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:14 smithi171 bash[25040]: audit 2024-09-13T22:44:13.621045+0000 mgr.a (mgr.14355) 1011 : audit [DBG] from='client.34992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:16.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:15 smithi007 bash[22722]: cluster 2024-09-13T22:44:14.656239+0000 mgr.a (mgr.14355) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:16.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:15 smithi131 bash[24745]: cluster 2024-09-13T22:44:14.656239+0000 mgr.a (mgr.14355) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:16.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:15 smithi171 bash[25040]: cluster 2024-09-13T22:44:14.656239+0000 mgr.a (mgr.14355) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:18.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:17 smithi007 bash[22722]: cluster 2024-09-13T22:44:16.658558+0000 mgr.a (mgr.14355) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:18.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:17 smithi131 bash[24745]: cluster 2024-09-13T22:44:16.658558+0000 mgr.a (mgr.14355) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:18.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:17 smithi171 bash[25040]: cluster 2024-09-13T22:44:16.658558+0000 mgr.a (mgr.14355) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:19.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:19.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:19.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:19.806 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:19.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:20.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:19 smithi007 bash[22722]: cluster 2024-09-13T22:44:18.659381+0000 mgr.a (mgr.14355) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:20.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:19 smithi131 bash[24745]: cluster 2024-09-13T22:44:18.659381+0000 mgr.a (mgr.14355) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:20.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:19 smithi171 bash[25040]: cluster 2024-09-13T22:44:18.659381+0000 mgr.a (mgr.14355) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:21.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:20 smithi007 bash[22722]: audit 2024-09-13T22:44:19.381801+0000 mgr.a (mgr.14355) 1015 : audit [DBG] from='client.35067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:21.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:20 smithi131 bash[24745]: audit 2024-09-13T22:44:19.381801+0000 mgr.a (mgr.14355) 1015 : audit [DBG] from='client.35067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:21.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:20 smithi171 bash[25040]: audit 2024-09-13T22:44:19.381801+0000 mgr.a (mgr.14355) 1015 : audit [DBG] from='client.35067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:22.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:21 smithi007 bash[22722]: cluster 2024-09-13T22:44:20.661669+0000 mgr.a (mgr.14355) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:22.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:21 smithi131 bash[24745]: cluster 2024-09-13T22:44:20.661669+0000 mgr.a (mgr.14355) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:22.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:21 smithi171 bash[25040]: cluster 2024-09-13T22:44:20.661669+0000 mgr.a (mgr.14355) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:24.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:23 smithi007 bash[22722]: cluster 2024-09-13T22:44:22.662455+0000 mgr.a (mgr.14355) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:24.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:23 smithi131 bash[24745]: cluster 2024-09-13T22:44:22.662455+0000 mgr.a (mgr.14355) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:24.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:23 smithi171 bash[25040]: cluster 2024-09-13T22:44:22.662455+0000 mgr.a (mgr.14355) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:25.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:25.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:26.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:25 smithi007 bash[22722]: cluster 2024-09-13T22:44:24.663235+0000 mgr.a (mgr.14355) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:26.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:25 smithi007 bash[22722]: audit 2024-09-13T22:44:25.143123+0000 mgr.a (mgr.14355) 1019 : audit [DBG] from='client.35145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:26.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:25 smithi131 bash[24745]: cluster 2024-09-13T22:44:24.663235+0000 mgr.a (mgr.14355) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:26.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:25 smithi131 bash[24745]: audit 2024-09-13T22:44:25.143123+0000 mgr.a (mgr.14355) 1019 : audit [DBG] from='client.35145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:26.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:25 smithi171 bash[25040]: cluster 2024-09-13T22:44:24.663235+0000 mgr.a (mgr.14355) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:26.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:25 smithi171 bash[25040]: audit 2024-09-13T22:44:25.143123+0000 mgr.a (mgr.14355) 1019 : audit [DBG] from='client.35145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:27 smithi007 bash[22722]: cluster 2024-09-13T22:44:26.665986+0000 mgr.a (mgr.14355) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:44:28.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:27 smithi131 bash[24745]: cluster 2024-09-13T22:44:26.665986+0000 mgr.a (mgr.14355) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:44:28.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:27 smithi171 bash[25040]: cluster 2024-09-13T22:44:26.665986+0000 mgr.a (mgr.14355) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:44:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:29 smithi007 bash[22722]: cluster 2024-09-13T22:44:28.666797+0000 mgr.a (mgr.14355) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:44:30.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:29 smithi131 bash[24745]: cluster 2024-09-13T22:44:28.666797+0000 mgr.a (mgr.14355) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:44:30.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:29 smithi171 bash[25040]: cluster 2024-09-13T22:44:28.666797+0000 mgr.a (mgr.14355) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T22:44:30.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:30.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:30.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:31.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:31.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:31.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:31.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:31.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:31 smithi007 bash[22722]: cluster 2024-09-13T22:44:30.668696+0000 mgr.a (mgr.14355) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:31 smithi007 bash[22722]: audit 2024-09-13T22:44:30.886857+0000 mgr.a (mgr.14355) 1023 : audit [DBG] from='client.35223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:32.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:31 smithi131 bash[24745]: cluster 2024-09-13T22:44:30.668696+0000 mgr.a (mgr.14355) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:32.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:31 smithi131 bash[24745]: audit 2024-09-13T22:44:30.886857+0000 mgr.a (mgr.14355) 1023 : audit [DBG] from='client.35223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:32.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:31 smithi171 bash[25040]: cluster 2024-09-13T22:44:30.668696+0000 mgr.a (mgr.14355) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:32.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:31 smithi171 bash[25040]: audit 2024-09-13T22:44:30.886857+0000 mgr.a (mgr.14355) 1023 : audit [DBG] from='client.35223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:34.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:33 smithi007 bash[22722]: cluster 2024-09-13T22:44:32.669585+0000 mgr.a (mgr.14355) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:44:34.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:33 smithi131 bash[24745]: cluster 2024-09-13T22:44:32.669585+0000 mgr.a (mgr.14355) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:44:34.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:33 smithi171 bash[25040]: cluster 2024-09-13T22:44:32.669585+0000 mgr.a (mgr.14355) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:44:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:35 smithi007 bash[22722]: cluster 2024-09-13T22:44:34.670373+0000 mgr.a (mgr.14355) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:44:36.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:35 smithi131 bash[24745]: cluster 2024-09-13T22:44:34.670373+0000 mgr.a (mgr.14355) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:44:36.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:36.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:36.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:35 smithi171 bash[25040]: cluster 2024-09-13T22:44:34.670373+0000 mgr.a (mgr.14355) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:44:37.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:37 smithi007 bash[22722]: audit 2024-09-13T22:44:36.621602+0000 mgr.a (mgr.14355) 1026 : audit [DBG] from='client.35301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:37 smithi007 bash[22722]: cluster 2024-09-13T22:44:36.672285+0000 mgr.a (mgr.14355) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:38.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:37 smithi131 bash[24745]: audit 2024-09-13T22:44:36.621602+0000 mgr.a (mgr.14355) 1026 : audit [DBG] from='client.35301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:38.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:37 smithi131 bash[24745]: cluster 2024-09-13T22:44:36.672285+0000 mgr.a (mgr.14355) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:38.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:37 smithi171 bash[25040]: audit 2024-09-13T22:44:36.621602+0000 mgr.a (mgr.14355) 1026 : audit [DBG] from='client.35301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:38.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:37 smithi171 bash[25040]: cluster 2024-09-13T22:44:36.672285+0000 mgr.a (mgr.14355) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:39 smithi007 bash[22722]: cluster 2024-09-13T22:44:38.673200+0000 mgr.a (mgr.14355) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:44:40.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:39 smithi131 bash[24745]: cluster 2024-09-13T22:44:38.673200+0000 mgr.a (mgr.14355) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:44:40.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:39 smithi171 bash[25040]: cluster 2024-09-13T22:44:38.673200+0000 mgr.a (mgr.14355) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:44:42.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:42.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:42.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:41 smithi007 bash[22722]: cluster 2024-09-13T22:44:40.675381+0000 mgr.a (mgr.14355) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:42.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:41 smithi131 bash[24745]: cluster 2024-09-13T22:44:40.675381+0000 mgr.a (mgr.14355) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:42.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:41 smithi171 bash[25040]: cluster 2024-09-13T22:44:40.675381+0000 mgr.a (mgr.14355) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:42.814 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:44.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:43 smithi007 bash[22722]: audit 2024-09-13T22:44:42.397310+0000 mgr.a (mgr.14355) 1030 : audit [DBG] from='client.35379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:44.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:43 smithi007 bash[22722]: cluster 2024-09-13T22:44:42.675903+0000 mgr.a (mgr.14355) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:44.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:43 smithi131 bash[24745]: audit 2024-09-13T22:44:42.397310+0000 mgr.a (mgr.14355) 1030 : audit [DBG] from='client.35379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:44.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:43 smithi131 bash[24745]: cluster 2024-09-13T22:44:42.675903+0000 mgr.a (mgr.14355) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:44.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:43 smithi171 bash[25040]: audit 2024-09-13T22:44:42.397310+0000 mgr.a (mgr.14355) 1030 : audit [DBG] from='client.35379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:44.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:43 smithi171 bash[25040]: cluster 2024-09-13T22:44:42.675903+0000 mgr.a (mgr.14355) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:46.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:45 smithi007 bash[22722]: cluster 2024-09-13T22:44:44.676754+0000 mgr.a (mgr.14355) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:46.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:45 smithi131 bash[24745]: cluster 2024-09-13T22:44:44.676754+0000 mgr.a (mgr.14355) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:46.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:45 smithi171 bash[25040]: cluster 2024-09-13T22:44:44.676754+0000 mgr.a (mgr.14355) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:47.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:47.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:47.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:48.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:47 smithi007 bash[22722]: cluster 2024-09-13T22:44:46.679023+0000 mgr.a (mgr.14355) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:48.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:47 smithi131 bash[24745]: cluster 2024-09-13T22:44:46.679023+0000 mgr.a (mgr.14355) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:48.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:47 smithi171 bash[25040]: cluster 2024-09-13T22:44:46.679023+0000 mgr.a (mgr.14355) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:48.575 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:48.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:48.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:48.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:48.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:49.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:48 smithi131 bash[24745]: audit 2024-09-13T22:44:48.155758+0000 mgr.a (mgr.14355) 1034 : audit [DBG] from='client.35454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:49.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:48 smithi171 bash[25040]: audit 2024-09-13T22:44:48.155758+0000 mgr.a (mgr.14355) 1034 : audit [DBG] from='client.35454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:49.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:48 smithi007 bash[22722]: audit 2024-09-13T22:44:48.155758+0000 mgr.a (mgr.14355) 1034 : audit [DBG] from='client.35454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:50.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:49 smithi131 bash[24745]: cluster 2024-09-13T22:44:48.679958+0000 mgr.a (mgr.14355) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:50.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:49 smithi171 bash[25040]: cluster 2024-09-13T22:44:48.679958+0000 mgr.a (mgr.14355) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:50.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:49 smithi007 bash[22722]: cluster 2024-09-13T22:44:48.679958+0000 mgr.a (mgr.14355) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:52.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:51 smithi131 bash[24745]: cluster 2024-09-13T22:44:50.682149+0000 mgr.a (mgr.14355) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:52.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:51 smithi131 bash[24745]: audit 2024-09-13T22:44:51.747979+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:44:52.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:51 smithi171 bash[25040]: cluster 2024-09-13T22:44:50.682149+0000 mgr.a (mgr.14355) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:52.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:51 smithi171 bash[25040]: audit 2024-09-13T22:44:51.747979+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:44:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:51 smithi007 bash[22722]: cluster 2024-09-13T22:44:50.682149+0000 mgr.a (mgr.14355) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:44:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:51 smithi007 bash[22722]: audit 2024-09-13T22:44:51.747979+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:44:53.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:52 smithi131 bash[24745]: audit 2024-09-13T22:44:52.594123+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:44:53.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:52 smithi131 bash[24745]: audit 2024-09-13T22:44:52.595672+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:44:53.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:52 smithi131 bash[24745]: audit 2024-09-13T22:44:52.606106+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:44:53.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:52 smithi131 bash[24745]: audit 2024-09-13T22:44:52.610992+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:52 smithi171 bash[25040]: audit 2024-09-13T22:44:52.594123+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:44:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:52 smithi171 bash[25040]: audit 2024-09-13T22:44:52.595672+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:44:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:52 smithi171 bash[25040]: audit 2024-09-13T22:44:52.606106+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:44:53.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:52 smithi171 bash[25040]: audit 2024-09-13T22:44:52.610992+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:53.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:52 smithi007 bash[22722]: audit 2024-09-13T22:44:52.594123+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:44:53.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:52 smithi007 bash[22722]: audit 2024-09-13T22:44:52.595672+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:44:53.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:52 smithi007 bash[22722]: audit 2024-09-13T22:44:52.606106+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:44:53.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:52 smithi007 bash[22722]: audit 2024-09-13T22:44:52.610992+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:53.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:53.577 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:53.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:44:53.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22972]: debug 2024-09-13T22:44:53.341+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:44:53.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22972]: debug 2024-09-13T22:44:53.341+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:44:54.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:53 smithi131 bash[24745]: audit 2024-09-13T22:44:52.613218+0000 mgr.a (mgr.14355) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:54.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:53 smithi131 bash[24745]: cluster 2024-09-13T22:44:52.682888+0000 mgr.a (mgr.14355) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:54.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:53 smithi131 bash[24745]: audit 2024-09-13T22:44:53.343094+0000 mgr.a (mgr.14355) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:44:54.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:53 smithi131 bash[24745]: cephadm 2024-09-13T22:44:53.344667+0000 mgr.a (mgr.14355) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:44:54.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:53 smithi171 bash[25040]: audit 2024-09-13T22:44:52.613218+0000 mgr.a (mgr.14355) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:54.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:53 smithi171 bash[25040]: cluster 2024-09-13T22:44:52.682888+0000 mgr.a (mgr.14355) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:54.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:53 smithi171 bash[25040]: audit 2024-09-13T22:44:53.343094+0000 mgr.a (mgr.14355) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:44:54.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:53 smithi171 bash[25040]: cephadm 2024-09-13T22:44:53.344667+0000 mgr.a (mgr.14355) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:44:54.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:44:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:44:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:44:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:44:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:44:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22722]: audit 2024-09-13T22:44:52.613218+0000 mgr.a (mgr.14355) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:44:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22722]: cluster 2024-09-13T22:44:52.682888+0000 mgr.a (mgr.14355) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22722]: audit 2024-09-13T22:44:53.343094+0000 mgr.a (mgr.14355) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:44:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:53 smithi007 bash[22722]: cephadm 2024-09-13T22:44:53.344667+0000 mgr.a (mgr.14355) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:44:55.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:54 smithi131 bash[24745]: audit 2024-09-13T22:44:53.903006+0000 mgr.a (mgr.14355) 1041 : audit [DBG] from='client.35640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:55.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:54 smithi171 bash[25040]: audit 2024-09-13T22:44:53.903006+0000 mgr.a (mgr.14355) 1041 : audit [DBG] from='client.35640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:55.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:54 smithi007 bash[22722]: audit 2024-09-13T22:44:53.903006+0000 mgr.a (mgr.14355) 1041 : audit [DBG] from='client.35640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:44:56.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:55 smithi131 bash[24745]: cluster 2024-09-13T22:44:54.683829+0000 mgr.a (mgr.14355) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:56.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:55 smithi171 bash[25040]: cluster 2024-09-13T22:44:54.683829+0000 mgr.a (mgr.14355) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:56.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:55 smithi007 bash[22722]: cluster 2024-09-13T22:44:54.683829+0000 mgr.a (mgr.14355) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:44:58.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:57 smithi131 bash[24745]: cluster 2024-09-13T22:44:56.686108+0000 mgr.a (mgr.14355) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:58.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:57 smithi171 bash[25040]: cluster 2024-09-13T22:44:56.686108+0000 mgr.a (mgr.14355) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:57 smithi007 bash[22722]: cluster 2024-09-13T22:44:56.686108+0000 mgr.a (mgr.14355) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:44:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:44:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:44:59.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:00.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:00.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:00.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:00.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:00.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:00.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:44:59 smithi131 bash[24745]: cluster 2024-09-13T22:44:58.686935+0000 mgr.a (mgr.14355) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:00.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:44:59 smithi171 bash[25040]: cluster 2024-09-13T22:44:58.686935+0000 mgr.a (mgr.14355) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:00.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:44:59 smithi007 bash[22722]: cluster 2024-09-13T22:44:58.686935+0000 mgr.a (mgr.14355) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:01.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:01 smithi131 bash[24745]: audit 2024-09-13T22:44:59.655167+0000 mgr.a (mgr.14355) 1045 : audit [DBG] from='client.35718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:01.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:01 smithi171 bash[25040]: audit 2024-09-13T22:44:59.655167+0000 mgr.a (mgr.14355) 1045 : audit [DBG] from='client.35718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:01.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:00 smithi007 bash[22722]: audit 2024-09-13T22:44:59.655167+0000 mgr.a (mgr.14355) 1045 : audit [DBG] from='client.35718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:02.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:02 smithi131 bash[24745]: cluster 2024-09-13T22:45:00.689259+0000 mgr.a (mgr.14355) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:02.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:02 smithi171 bash[25040]: cluster 2024-09-13T22:45:00.689259+0000 mgr.a (mgr.14355) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:02.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:02 smithi007 bash[22722]: cluster 2024-09-13T22:45:00.689259+0000 mgr.a (mgr.14355) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:04.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:04 smithi131 bash[24745]: cluster 2024-09-13T22:45:02.690055+0000 mgr.a (mgr.14355) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:04.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:04 smithi171 bash[25040]: cluster 2024-09-13T22:45:02.690055+0000 mgr.a (mgr.14355) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:04.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:04 smithi007 bash[22722]: cluster 2024-09-13T22:45:02.690055+0000 mgr.a (mgr.14355) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:05.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:05.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:05.825 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:05.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:06.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:06 smithi131 bash[24745]: cluster 2024-09-13T22:45:04.690808+0000 mgr.a (mgr.14355) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:06.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:06 smithi171 bash[25040]: cluster 2024-09-13T22:45:04.690808+0000 mgr.a (mgr.14355) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:06.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:06 smithi007 bash[22722]: cluster 2024-09-13T22:45:04.690808+0000 mgr.a (mgr.14355) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:07.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:07 smithi131 bash[24745]: audit 2024-09-13T22:45:05.408016+0000 mgr.a (mgr.14355) 1049 : audit [DBG] from='client.35793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:07.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:07 smithi171 bash[25040]: audit 2024-09-13T22:45:05.408016+0000 mgr.a (mgr.14355) 1049 : audit [DBG] from='client.35793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:07.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:07 smithi007 bash[22722]: audit 2024-09-13T22:45:05.408016+0000 mgr.a (mgr.14355) 1049 : audit [DBG] from='client.35793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:08.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:08 smithi131 bash[24745]: cluster 2024-09-13T22:45:06.693483+0000 mgr.a (mgr.14355) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:08.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:08 smithi171 bash[25040]: cluster 2024-09-13T22:45:06.693483+0000 mgr.a (mgr.14355) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:08.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:08 smithi007 bash[22722]: cluster 2024-09-13T22:45:06.693483+0000 mgr.a (mgr.14355) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:10.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:10 smithi131 bash[24745]: cluster 2024-09-13T22:45:08.694249+0000 mgr.a (mgr.14355) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:10.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:10 smithi171 bash[25040]: cluster 2024-09-13T22:45:08.694249+0000 mgr.a (mgr.14355) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:10.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:10 smithi007 bash[22722]: cluster 2024-09-13T22:45:08.694249+0000 mgr.a (mgr.14355) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:10.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:10.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:10.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:11.574 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:11.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:12.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:12 smithi131 bash[24745]: cluster 2024-09-13T22:45:10.696174+0000 mgr.a (mgr.14355) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:12.279 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:12 smithi131 bash[24745]: audit 2024-09-13T22:45:11.151793+0000 mgr.a (mgr.14355) 1053 : audit [DBG] from='client.35868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:12.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:12 smithi171 bash[25040]: cluster 2024-09-13T22:45:10.696174+0000 mgr.a (mgr.14355) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:12 smithi171 bash[25040]: audit 2024-09-13T22:45:11.151793+0000 mgr.a (mgr.14355) 1053 : audit [DBG] from='client.35868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:12.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:12 smithi007 bash[22722]: cluster 2024-09-13T22:45:10.696174+0000 mgr.a (mgr.14355) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:12.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:12 smithi007 bash[22722]: audit 2024-09-13T22:45:11.151793+0000 mgr.a (mgr.14355) 1053 : audit [DBG] from='client.35868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:14.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:14 smithi171 bash[25040]: cluster 2024-09-13T22:45:12.697034+0000 mgr.a (mgr.14355) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:14.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:14 smithi007 bash[22722]: cluster 2024-09-13T22:45:12.697034+0000 mgr.a (mgr.14355) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:14.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:14 smithi131 bash[24745]: cluster 2024-09-13T22:45:12.697034+0000 mgr.a (mgr.14355) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:16.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:16 smithi171 bash[25040]: cluster 2024-09-13T22:45:14.697815+0000 mgr.a (mgr.14355) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:45:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:16 smithi007 bash[22722]: cluster 2024-09-13T22:45:14.697815+0000 mgr.a (mgr.14355) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:45:16.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:16 smithi131 bash[24745]: cluster 2024-09-13T22:45:14.697815+0000 mgr.a (mgr.14355) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:45:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:16.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:16.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:17.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:17.343 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:18.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:18 smithi171 bash[25040]: cluster 2024-09-13T22:45:16.699007+0000 mgr.a (mgr.14355) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:18.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:18 smithi171 bash[25040]: audit 2024-09-13T22:45:16.910749+0000 mgr.a (mgr.14355) 1057 : audit [DBG] from='client.35946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:18 smithi007 bash[22722]: cluster 2024-09-13T22:45:16.699007+0000 mgr.a (mgr.14355) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:18.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:18 smithi007 bash[22722]: audit 2024-09-13T22:45:16.910749+0000 mgr.a (mgr.14355) 1057 : audit [DBG] from='client.35946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:18 smithi131 bash[24745]: cluster 2024-09-13T22:45:16.699007+0000 mgr.a (mgr.14355) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:18.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:18 smithi131 bash[24745]: audit 2024-09-13T22:45:16.910749+0000 mgr.a (mgr.14355) 1057 : audit [DBG] from='client.35946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:20.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:20 smithi007 bash[22722]: cluster 2024-09-13T22:45:18.699865+0000 mgr.a (mgr.14355) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:20.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:20 smithi131 bash[24745]: cluster 2024-09-13T22:45:18.699865+0000 mgr.a (mgr.14355) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:20.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:20 smithi171 bash[25040]: cluster 2024-09-13T22:45:18.699865+0000 mgr.a (mgr.14355) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:22.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:22.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:22.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:22.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:22 smithi007 bash[22722]: cluster 2024-09-13T22:45:20.702065+0000 mgr.a (mgr.14355) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:22.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:22 smithi131 bash[24745]: cluster 2024-09-13T22:45:20.702065+0000 mgr.a (mgr.14355) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:22.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:22 smithi171 bash[25040]: cluster 2024-09-13T22:45:20.702065+0000 mgr.a (mgr.14355) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:23.120 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:23.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:23.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:23.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:23.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:24 smithi007 bash[22722]: audit 2024-09-13T22:45:22.682233+0000 mgr.a (mgr.14355) 1060 : audit [DBG] from='client.36024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:24.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:24 smithi007 bash[22722]: cluster 2024-09-13T22:45:22.703325+0000 mgr.a (mgr.14355) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:24.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:24 smithi131 bash[24745]: audit 2024-09-13T22:45:22.682233+0000 mgr.a (mgr.14355) 1060 : audit [DBG] from='client.36024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:24.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:24 smithi131 bash[24745]: cluster 2024-09-13T22:45:22.703325+0000 mgr.a (mgr.14355) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:24.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:24 smithi171 bash[25040]: audit 2024-09-13T22:45:22.682233+0000 mgr.a (mgr.14355) 1060 : audit [DBG] from='client.36024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:24 smithi171 bash[25040]: cluster 2024-09-13T22:45:22.703325+0000 mgr.a (mgr.14355) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:26.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:26 smithi007 bash[22722]: cluster 2024-09-13T22:45:24.704280+0000 mgr.a (mgr.14355) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:26.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:26 smithi131 bash[24745]: cluster 2024-09-13T22:45:24.704280+0000 mgr.a (mgr.14355) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:26.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:26 smithi171 bash[25040]: cluster 2024-09-13T22:45:24.704280+0000 mgr.a (mgr.14355) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:28.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:28.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:28.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:28.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:28 smithi007 bash[22722]: cluster 2024-09-13T22:45:26.706562+0000 mgr.a (mgr.14355) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:28.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:28 smithi131 bash[24745]: cluster 2024-09-13T22:45:26.706562+0000 mgr.a (mgr.14355) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:28.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:28 smithi171 bash[25040]: cluster 2024-09-13T22:45:26.706562+0000 mgr.a (mgr.14355) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:28.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:28.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:30 smithi007 bash[22722]: audit 2024-09-13T22:45:28.457098+0000 mgr.a (mgr.14355) 1064 : audit [DBG] from='client.36099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:30.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:30 smithi007 bash[22722]: cluster 2024-09-13T22:45:28.707115+0000 mgr.a (mgr.14355) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:30.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:30 smithi131 bash[24745]: audit 2024-09-13T22:45:28.457098+0000 mgr.a (mgr.14355) 1064 : audit [DBG] from='client.36099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:30.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:30 smithi131 bash[24745]: cluster 2024-09-13T22:45:28.707115+0000 mgr.a (mgr.14355) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:30.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:30 smithi171 bash[25040]: audit 2024-09-13T22:45:28.457098+0000 mgr.a (mgr.14355) 1064 : audit [DBG] from='client.36099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:30.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:30 smithi171 bash[25040]: cluster 2024-09-13T22:45:28.707115+0000 mgr.a (mgr.14355) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:32.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:32 smithi007 bash[22722]: cluster 2024-09-13T22:45:30.709348+0000 mgr.a (mgr.14355) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:32.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:32 smithi131 bash[24745]: cluster 2024-09-13T22:45:30.709348+0000 mgr.a (mgr.14355) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:32.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:32 smithi171 bash[25040]: cluster 2024-09-13T22:45:30.709348+0000 mgr.a (mgr.14355) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:33.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:33.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:34.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:34 smithi007 bash[22722]: cluster 2024-09-13T22:45:32.710133+0000 mgr.a (mgr.14355) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:34.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:34 smithi131 bash[24745]: cluster 2024-09-13T22:45:32.710133+0000 mgr.a (mgr.14355) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:34.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:34 smithi171 bash[25040]: cluster 2024-09-13T22:45:32.710133+0000 mgr.a (mgr.14355) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:34.633 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:34.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:35.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:35 smithi007 bash[22722]: audit 2024-09-13T22:45:34.225538+0000 mgr.a (mgr.14355) 1068 : audit [DBG] from='client.36177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:35.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:35 smithi131 bash[24745]: audit 2024-09-13T22:45:34.225538+0000 mgr.a (mgr.14355) 1068 : audit [DBG] from='client.36177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:35.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:35 smithi171 bash[25040]: audit 2024-09-13T22:45:34.225538+0000 mgr.a (mgr.14355) 1068 : audit [DBG] from='client.36177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:36.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:36 smithi007 bash[22722]: cluster 2024-09-13T22:45:34.711022+0000 mgr.a (mgr.14355) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:36.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:36 smithi131 bash[24745]: cluster 2024-09-13T22:45:34.711022+0000 mgr.a (mgr.14355) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:36 smithi171 bash[25040]: cluster 2024-09-13T22:45:34.711022+0000 mgr.a (mgr.14355) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:38.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:38 smithi007 bash[22722]: cluster 2024-09-13T22:45:36.713209+0000 mgr.a (mgr.14355) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:38.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:38 smithi131 bash[24745]: cluster 2024-09-13T22:45:36.713209+0000 mgr.a (mgr.14355) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:38.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:38 smithi171 bash[25040]: cluster 2024-09-13T22:45:36.713209+0000 mgr.a (mgr.14355) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:45:39.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:39.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:39.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:40.416 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:40.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:40.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:40.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:40.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:40.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:40 smithi007 bash[22722]: cluster 2024-09-13T22:45:38.714100+0000 mgr.a (mgr.14355) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:40.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:40 smithi131 bash[24745]: cluster 2024-09-13T22:45:38.714100+0000 mgr.a (mgr.14355) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:40.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:40 smithi171 bash[25040]: cluster 2024-09-13T22:45:38.714100+0000 mgr.a (mgr.14355) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:41.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:41 smithi007 bash[22722]: audit 2024-09-13T22:45:39.971798+0000 mgr.a (mgr.14355) 1072 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:41.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:41 smithi131 bash[24745]: audit 2024-09-13T22:45:39.971798+0000 mgr.a (mgr.14355) 1072 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:41.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:41 smithi171 bash[25040]: audit 2024-09-13T22:45:39.971798+0000 mgr.a (mgr.14355) 1072 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:42.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:42 smithi007 bash[22722]: cluster 2024-09-13T22:45:40.716435+0000 mgr.a (mgr.14355) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:45:42.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:42 smithi131 bash[24745]: cluster 2024-09-13T22:45:40.716435+0000 mgr.a (mgr.14355) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:45:42.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:42 smithi171 bash[25040]: cluster 2024-09-13T22:45:40.716435+0000 mgr.a (mgr.14355) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:45:44.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:44 smithi007 bash[22722]: cluster 2024-09-13T22:45:42.717351+0000 mgr.a (mgr.14355) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:44.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:44 smithi131 bash[24745]: cluster 2024-09-13T22:45:42.717351+0000 mgr.a (mgr.14355) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:44.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:44 smithi171 bash[25040]: cluster 2024-09-13T22:45:42.717351+0000 mgr.a (mgr.14355) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:45.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:45.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:45.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:46.151 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:46.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:46.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:46 smithi007 bash[22722]: cluster 2024-09-13T22:45:44.718145+0000 mgr.a (mgr.14355) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:46.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:46 smithi131 bash[24745]: cluster 2024-09-13T22:45:44.718145+0000 mgr.a (mgr.14355) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:46 smithi171 bash[25040]: cluster 2024-09-13T22:45:44.718145+0000 mgr.a (mgr.14355) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:45:47.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:47 smithi007 bash[22722]: audit 2024-09-13T22:45:45.750787+0000 mgr.a (mgr.14355) 1076 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:47.529 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:47 smithi131 bash[24745]: audit 2024-09-13T22:45:45.750787+0000 mgr.a (mgr.14355) 1076 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:47.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:47 smithi171 bash[25040]: audit 2024-09-13T22:45:45.750787+0000 mgr.a (mgr.14355) 1076 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:48.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:48 smithi007 bash[22722]: cluster 2024-09-13T22:45:46.720802+0000 mgr.a (mgr.14355) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:48.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:48 smithi131 bash[24745]: cluster 2024-09-13T22:45:46.720802+0000 mgr.a (mgr.14355) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:48.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:48 smithi171 bash[25040]: cluster 2024-09-13T22:45:46.720802+0000 mgr.a (mgr.14355) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:50.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:50 smithi007 bash[22722]: cluster 2024-09-13T22:45:48.721598+0000 mgr.a (mgr.14355) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:50.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:50 smithi131 bash[24745]: cluster 2024-09-13T22:45:48.721598+0000 mgr.a (mgr.14355) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:50.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:50 smithi171 bash[25040]: cluster 2024-09-13T22:45:48.721598+0000 mgr.a (mgr.14355) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:45:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:51.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:52 smithi007 bash[22722]: cluster 2024-09-13T22:45:50.723562+0000 mgr.a (mgr.14355) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:52.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:52 smithi131 bash[24745]: cluster 2024-09-13T22:45:50.723562+0000 mgr.a (mgr.14355) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:52.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:52 smithi171 bash[25040]: cluster 2024-09-13T22:45:50.723562+0000 mgr.a (mgr.14355) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:45:53.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:53 smithi007 bash[22722]: audit 2024-09-13T22:45:51.486560+0000 mgr.a (mgr.14355) 1080 : audit [DBG] from='client.36405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:53.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:53 smithi131 bash[24745]: audit 2024-09-13T22:45:51.486560+0000 mgr.a (mgr.14355) 1080 : audit [DBG] from='client.36405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:53.542 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:53 smithi171 bash[25040]: audit 2024-09-13T22:45:51.486560+0000 mgr.a (mgr.14355) 1080 : audit [DBG] from='client.36405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:54 smithi007 bash[22722]: cluster 2024-09-13T22:45:52.724435+0000 mgr.a (mgr.14355) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:54.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:54 smithi007 bash[22722]: audit 2024-09-13T22:45:53.399356+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:45:54.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:54 smithi131 bash[24745]: cluster 2024-09-13T22:45:52.724435+0000 mgr.a (mgr.14355) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:54.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:54 smithi131 bash[24745]: audit 2024-09-13T22:45:53.399356+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:45:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:54 smithi171 bash[25040]: cluster 2024-09-13T22:45:52.724435+0000 mgr.a (mgr.14355) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:54 smithi171 bash[25040]: audit 2024-09-13T22:45:53.399356+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:45:55.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:45:54 smithi007 bash[22972]: debug 2024-09-13T22:45:54.976+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:45:55.452 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:45:54 smithi007 bash[22972]: debug 2024-09-13T22:45:54.980+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:45:55.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:55 smithi007 bash[22722]: audit 2024-09-13T22:45:54.240245+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:45:55.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:55 smithi007 bash[22722]: audit 2024-09-13T22:45:54.241885+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:45:55.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:55 smithi007 bash[22722]: audit 2024-09-13T22:45:54.251517+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:45:55.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:55 smithi007 bash[22722]: audit 2024-09-13T22:45:54.254156+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:55.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:55 smithi007 bash[22722]: audit 2024-09-13T22:45:54.256487+0000 mgr.a (mgr.14355) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:55.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:55 smithi131 bash[24745]: audit 2024-09-13T22:45:54.240245+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:45:55.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:55 smithi131 bash[24745]: audit 2024-09-13T22:45:54.241885+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:45:55.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:55 smithi131 bash[24745]: audit 2024-09-13T22:45:54.251517+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:45:55.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:55 smithi131 bash[24745]: audit 2024-09-13T22:45:54.254156+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:55.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:55 smithi131 bash[24745]: audit 2024-09-13T22:45:54.256487+0000 mgr.a (mgr.14355) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:55.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:55 smithi171 bash[25040]: audit 2024-09-13T22:45:54.240245+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:45:55.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:55 smithi171 bash[25040]: audit 2024-09-13T22:45:54.241885+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:45:55.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:55 smithi171 bash[25040]: audit 2024-09-13T22:45:54.251517+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:45:55.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:55 smithi171 bash[25040]: audit 2024-09-13T22:45:54.254156+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:55.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:55 smithi171 bash[25040]: audit 2024-09-13T22:45:54.256487+0000 mgr.a (mgr.14355) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:45:56.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:56 smithi131 bash[24745]: cluster 2024-09-13T22:45:54.725032+0000 mgr.a (mgr.14355) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:56.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:56 smithi131 bash[24745]: audit 2024-09-13T22:45:54.982241+0000 mgr.a (mgr.14355) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:45:56.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:56 smithi131 bash[24745]: cephadm 2024-09-13T22:45:54.983700+0000 mgr.a (mgr.14355) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:45:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:56 smithi171 bash[25040]: cluster 2024-09-13T22:45:54.725032+0000 mgr.a (mgr.14355) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:56 smithi171 bash[25040]: audit 2024-09-13T22:45:54.982241+0000 mgr.a (mgr.14355) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:45:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:56 smithi171 bash[25040]: cephadm 2024-09-13T22:45:54.983700+0000 mgr.a (mgr.14355) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:45:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:56 smithi007 bash[22722]: cluster 2024-09-13T22:45:54.725032+0000 mgr.a (mgr.14355) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:45:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:56 smithi007 bash[22722]: audit 2024-09-13T22:45:54.982241+0000 mgr.a (mgr.14355) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:45:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:56 smithi007 bash[22722]: cephadm 2024-09-13T22:45:54.983700+0000 mgr.a (mgr.14355) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:45:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:45:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:45:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:45:57.656 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:45:57.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:45:57.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:45:57.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:45:57.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:45:58.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:58 smithi131 bash[24745]: cluster 2024-09-13T22:45:56.727398+0000 mgr.a (mgr.14355) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:58.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:45:58 smithi131 bash[24745]: audit 2024-09-13T22:45:57.225384+0000 mgr.a (mgr.14355) 1087 : audit [DBG] from='client.36588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:58.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:58 smithi171 bash[25040]: cluster 2024-09-13T22:45:56.727398+0000 mgr.a (mgr.14355) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:58.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:45:58 smithi171 bash[25040]: audit 2024-09-13T22:45:57.225384+0000 mgr.a (mgr.14355) 1087 : audit [DBG] from='client.36588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:45:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:58 smithi007 bash[22722]: cluster 2024-09-13T22:45:56.727398+0000 mgr.a (mgr.14355) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:45:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:45:58 smithi007 bash[22722]: audit 2024-09-13T22:45:57.225384+0000 mgr.a (mgr.14355) 1087 : audit [DBG] from='client.36588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:00.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:00 smithi131 bash[24745]: cluster 2024-09-13T22:45:58.728431+0000 mgr.a (mgr.14355) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:00 smithi171 bash[25040]: cluster 2024-09-13T22:45:58.728431+0000 mgr.a (mgr.14355) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:00.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:00 smithi007 bash[22722]: cluster 2024-09-13T22:45:58.728431+0000 mgr.a (mgr.14355) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:02.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:02 smithi131 bash[24745]: cluster 2024-09-13T22:46:00.730767+0000 mgr.a (mgr.14355) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:02 smithi171 bash[25040]: cluster 2024-09-13T22:46:00.730767+0000 mgr.a (mgr.14355) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:02.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:02 smithi007 bash[22722]: cluster 2024-09-13T22:46:00.730767+0000 mgr.a (mgr.14355) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:03.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:03.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:03.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:03.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:03.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:04.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:04 smithi131 bash[24745]: cluster 2024-09-13T22:46:02.731550+0000 mgr.a (mgr.14355) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:04.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:04 smithi131 bash[24745]: audit 2024-09-13T22:46:02.987366+0000 mgr.a (mgr.14355) 1091 : audit [DBG] from='client.36660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:04 smithi171 bash[25040]: cluster 2024-09-13T22:46:02.731550+0000 mgr.a (mgr.14355) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:04 smithi171 bash[25040]: audit 2024-09-13T22:46:02.987366+0000 mgr.a (mgr.14355) 1091 : audit [DBG] from='client.36660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:04 smithi007 bash[22722]: cluster 2024-09-13T22:46:02.731550+0000 mgr.a (mgr.14355) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:04 smithi007 bash[22722]: audit 2024-09-13T22:46:02.987366+0000 mgr.a (mgr.14355) 1091 : audit [DBG] from='client.36660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:06.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:06 smithi131 bash[24745]: cluster 2024-09-13T22:46:04.732491+0000 mgr.a (mgr.14355) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:06 smithi171 bash[25040]: cluster 2024-09-13T22:46:04.732491+0000 mgr.a (mgr.14355) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:06 smithi007 bash[22722]: cluster 2024-09-13T22:46:04.732491+0000 mgr.a (mgr.14355) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:08.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:08.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:08 smithi131 bash[24745]: cluster 2024-09-13T22:46:06.734795+0000 mgr.a (mgr.14355) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:08.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:08 smithi171 bash[25040]: cluster 2024-09-13T22:46:06.734795+0000 mgr.a (mgr.14355) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:08.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:08 smithi007 bash[22722]: cluster 2024-09-13T22:46:06.734795+0000 mgr.a (mgr.14355) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:46:09.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:10.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:10 smithi131 bash[24745]: cluster 2024-09-13T22:46:08.735607+0000 mgr.a (mgr.14355) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:10.530 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:10 smithi131 bash[24745]: audit 2024-09-13T22:46:08.740543+0000 mgr.a (mgr.14355) 1095 : audit [DBG] from='client.36738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:10.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:10 smithi171 bash[25040]: cluster 2024-09-13T22:46:08.735607+0000 mgr.a (mgr.14355) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:10.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:10 smithi171 bash[25040]: audit 2024-09-13T22:46:08.740543+0000 mgr.a (mgr.14355) 1095 : audit [DBG] from='client.36738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:10 smithi007 bash[22722]: cluster 2024-09-13T22:46:08.735607+0000 mgr.a (mgr.14355) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:10 smithi007 bash[22722]: audit 2024-09-13T22:46:08.740543+0000 mgr.a (mgr.14355) 1095 : audit [DBG] from='client.36738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:12.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:12 smithi171 bash[25040]: cluster 2024-09-13T22:46:10.737961+0000 mgr.a (mgr.14355) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:12 smithi007 bash[22722]: cluster 2024-09-13T22:46:10.737961+0000 mgr.a (mgr.14355) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:12.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:12 smithi131 bash[24745]: cluster 2024-09-13T22:46:10.737961+0000 mgr.a (mgr.14355) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:14.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:14.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:14.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:14.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:14 smithi171 bash[25040]: cluster 2024-09-13T22:46:12.738804+0000 mgr.a (mgr.14355) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:14 smithi007 bash[22722]: cluster 2024-09-13T22:46:12.738804+0000 mgr.a (mgr.14355) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:14.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:14 smithi131 bash[24745]: cluster 2024-09-13T22:46:12.738804+0000 mgr.a (mgr.14355) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:14.930 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:14.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:16.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:16 smithi171 bash[25040]: audit 2024-09-13T22:46:14.506943+0000 mgr.a (mgr.14355) 1098 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:16.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:16 smithi171 bash[25040]: cluster 2024-09-13T22:46:14.739492+0000 mgr.a (mgr.14355) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:16 smithi007 bash[22722]: audit 2024-09-13T22:46:14.506943+0000 mgr.a (mgr.14355) 1098 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:16 smithi007 bash[22722]: cluster 2024-09-13T22:46:14.739492+0000 mgr.a (mgr.14355) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:16.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:16 smithi131 bash[24745]: audit 2024-09-13T22:46:14.506943+0000 mgr.a (mgr.14355) 1098 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:16.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:16 smithi131 bash[24745]: cluster 2024-09-13T22:46:14.739492+0000 mgr.a (mgr.14355) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:18 smithi007 bash[22722]: cluster 2024-09-13T22:46:16.741861+0000 mgr.a (mgr.14355) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:18.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:18 smithi131 bash[24745]: cluster 2024-09-13T22:46:16.741861+0000 mgr.a (mgr.14355) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:18 smithi171 bash[25040]: cluster 2024-09-13T22:46:16.741861+0000 mgr.a (mgr.14355) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:19.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:19.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:20.698 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:20.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:20.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:20.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:20.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:20 smithi007 bash[22722]: cluster 2024-09-13T22:46:18.742643+0000 mgr.a (mgr.14355) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:20.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:20 smithi131 bash[24745]: cluster 2024-09-13T22:46:18.742643+0000 mgr.a (mgr.14355) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:20 smithi171 bash[25040]: cluster 2024-09-13T22:46:18.742643+0000 mgr.a (mgr.14355) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:21.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:21 smithi007 bash[22722]: audit 2024-09-13T22:46:20.265620+0000 mgr.a (mgr.14355) 1102 : audit [DBG] from='client.36888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:21.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:21 smithi131 bash[24745]: audit 2024-09-13T22:46:20.265620+0000 mgr.a (mgr.14355) 1102 : audit [DBG] from='client.36888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:21.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:21 smithi171 bash[25040]: audit 2024-09-13T22:46:20.265620+0000 mgr.a (mgr.14355) 1102 : audit [DBG] from='client.36888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:22.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:22 smithi007 bash[22722]: cluster 2024-09-13T22:46:20.744041+0000 mgr.a (mgr.14355) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:22.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:22 smithi131 bash[24745]: cluster 2024-09-13T22:46:20.744041+0000 mgr.a (mgr.14355) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:22 smithi171 bash[25040]: cluster 2024-09-13T22:46:20.744041+0000 mgr.a (mgr.14355) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:24.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:24 smithi007 bash[22722]: cluster 2024-09-13T22:46:22.744811+0000 mgr.a (mgr.14355) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:24.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:24 smithi131 bash[24745]: cluster 2024-09-13T22:46:22.744811+0000 mgr.a (mgr.14355) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:24 smithi171 bash[25040]: cluster 2024-09-13T22:46:22.744811+0000 mgr.a (mgr.14355) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:26.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:26.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:26.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:26.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:26.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:26 smithi007 bash[22722]: cluster 2024-09-13T22:46:24.745589+0000 mgr.a (mgr.14355) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:26.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:26 smithi131 bash[24745]: cluster 2024-09-13T22:46:24.745589+0000 mgr.a (mgr.14355) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:26 smithi171 bash[25040]: cluster 2024-09-13T22:46:24.745589+0000 mgr.a (mgr.14355) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:46:27.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:27 smithi007 bash[22722]: audit 2024-09-13T22:46:26.028149+0000 mgr.a (mgr.14355) 1106 : audit [DBG] from='client.36963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:27.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:27 smithi131 bash[24745]: audit 2024-09-13T22:46:26.028149+0000 mgr.a (mgr.14355) 1106 : audit [DBG] from='client.36963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:27.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:27 smithi171 bash[25040]: audit 2024-09-13T22:46:26.028149+0000 mgr.a (mgr.14355) 1106 : audit [DBG] from='client.36963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:28 smithi007 bash[22722]: cluster 2024-09-13T22:46:26.748343+0000 mgr.a (mgr.14355) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:28.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:28 smithi131 bash[24745]: cluster 2024-09-13T22:46:26.748343+0000 mgr.a (mgr.14355) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:28 smithi171 bash[25040]: cluster 2024-09-13T22:46:26.748343+0000 mgr.a (mgr.14355) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:30.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:30 smithi007 bash[22722]: cluster 2024-09-13T22:46:28.749112+0000 mgr.a (mgr.14355) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:46:30.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:30 smithi131 bash[24745]: cluster 2024-09-13T22:46:28.749112+0000 mgr.a (mgr.14355) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:46:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:30 smithi171 bash[25040]: cluster 2024-09-13T22:46:28.749112+0000 mgr.a (mgr.14355) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:46:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:31.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:31.445 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:32.204 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:32.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:32.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:32.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:32 smithi007 bash[22722]: cluster 2024-09-13T22:46:30.751070+0000 mgr.a (mgr.14355) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:32.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:32 smithi131 bash[24745]: cluster 2024-09-13T22:46:30.751070+0000 mgr.a (mgr.14355) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:32 smithi171 bash[25040]: cluster 2024-09-13T22:46:30.751070+0000 mgr.a (mgr.14355) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:33.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:33 smithi007 bash[22722]: audit 2024-09-13T22:46:31.781667+0000 mgr.a (mgr.14355) 1110 : audit [DBG] from='client.37041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:33.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:33 smithi131 bash[24745]: audit 2024-09-13T22:46:31.781667+0000 mgr.a (mgr.14355) 1110 : audit [DBG] from='client.37041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:33.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:33 smithi171 bash[25040]: audit 2024-09-13T22:46:31.781667+0000 mgr.a (mgr.14355) 1110 : audit [DBG] from='client.37041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:34.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:34 smithi007 bash[22722]: cluster 2024-09-13T22:46:32.752080+0000 mgr.a (mgr.14355) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:34.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:34 smithi131 bash[24745]: cluster 2024-09-13T22:46:32.752080+0000 mgr.a (mgr.14355) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:34 smithi171 bash[25040]: cluster 2024-09-13T22:46:32.752080+0000 mgr.a (mgr.14355) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:36.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:36 smithi007 bash[22722]: cluster 2024-09-13T22:46:34.752839+0000 mgr.a (mgr.14355) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:36.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:36 smithi131 bash[24745]: cluster 2024-09-13T22:46:34.752839+0000 mgr.a (mgr.14355) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:36 smithi171 bash[25040]: cluster 2024-09-13T22:46:34.752839+0000 mgr.a (mgr.14355) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:37.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:37.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:37.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:37.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:37.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:37.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:37.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:37.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:38.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:38 smithi007 bash[22722]: cluster 2024-09-13T22:46:36.755098+0000 mgr.a (mgr.14355) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:38.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:38 smithi131 bash[24745]: cluster 2024-09-13T22:46:36.755098+0000 mgr.a (mgr.14355) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:38 smithi171 bash[25040]: cluster 2024-09-13T22:46:36.755098+0000 mgr.a (mgr.14355) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:39.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:39 smithi007 bash[22722]: audit 2024-09-13T22:46:37.542174+0000 mgr.a (mgr.14355) 1114 : audit [DBG] from='client.37116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:39.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:39 smithi131 bash[24745]: audit 2024-09-13T22:46:37.542174+0000 mgr.a (mgr.14355) 1114 : audit [DBG] from='client.37116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:39 smithi171 bash[25040]: audit 2024-09-13T22:46:37.542174+0000 mgr.a (mgr.14355) 1114 : audit [DBG] from='client.37116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:40.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:40 smithi007 bash[22722]: cluster 2024-09-13T22:46:38.756028+0000 mgr.a (mgr.14355) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:40.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:40 smithi131 bash[24745]: cluster 2024-09-13T22:46:38.756028+0000 mgr.a (mgr.14355) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:40 smithi171 bash[25040]: cluster 2024-09-13T22:46:38.756028+0000 mgr.a (mgr.14355) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:42.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:42 smithi007 bash[22722]: cluster 2024-09-13T22:46:40.758214+0000 mgr.a (mgr.14355) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:42.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:42 smithi131 bash[24745]: cluster 2024-09-13T22:46:40.758214+0000 mgr.a (mgr.14355) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:42 smithi171 bash[25040]: cluster 2024-09-13T22:46:40.758214+0000 mgr.a (mgr.14355) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:43.723 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:44 smithi007 bash[22722]: cluster 2024-09-13T22:46:42.759029+0000 mgr.a (mgr.14355) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:44.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:44 smithi007 bash[22722]: audit 2024-09-13T22:46:43.291485+0000 mgr.a (mgr.14355) 1118 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:44.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:44 smithi131 bash[24745]: cluster 2024-09-13T22:46:42.759029+0000 mgr.a (mgr.14355) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:44.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:44 smithi131 bash[24745]: audit 2024-09-13T22:46:43.291485+0000 mgr.a (mgr.14355) 1118 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:44 smithi171 bash[25040]: cluster 2024-09-13T22:46:42.759029+0000 mgr.a (mgr.14355) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:44 smithi171 bash[25040]: audit 2024-09-13T22:46:43.291485+0000 mgr.a (mgr.14355) 1118 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:46.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:46 smithi007 bash[22722]: cluster 2024-09-13T22:46:44.760011+0000 mgr.a (mgr.14355) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:46.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:46 smithi131 bash[24745]: cluster 2024-09-13T22:46:44.760011+0000 mgr.a (mgr.14355) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:46 smithi171 bash[25040]: cluster 2024-09-13T22:46:44.760011+0000 mgr.a (mgr.14355) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:48.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:48 smithi007 bash[22722]: cluster 2024-09-13T22:46:46.762262+0000 mgr.a (mgr.14355) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:48 smithi131 bash[24745]: cluster 2024-09-13T22:46:46.762262+0000 mgr.a (mgr.14355) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:48.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:48 smithi171 bash[25040]: cluster 2024-09-13T22:46:46.762262+0000 mgr.a (mgr.14355) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:49.474 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:50.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:50 smithi007 bash[22722]: cluster 2024-09-13T22:46:48.763143+0000 mgr.a (mgr.14355) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:50.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:50 smithi007 bash[22722]: audit 2024-09-13T22:46:49.062199+0000 mgr.a (mgr.14355) 1122 : audit [DBG] from='client.37266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:50.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:50 smithi131 bash[24745]: cluster 2024-09-13T22:46:48.763143+0000 mgr.a (mgr.14355) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:50.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:50 smithi131 bash[24745]: audit 2024-09-13T22:46:49.062199+0000 mgr.a (mgr.14355) 1122 : audit [DBG] from='client.37266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:50 smithi171 bash[25040]: cluster 2024-09-13T22:46:48.763143+0000 mgr.a (mgr.14355) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:50 smithi171 bash[25040]: audit 2024-09-13T22:46:49.062199+0000 mgr.a (mgr.14355) 1122 : audit [DBG] from='client.37266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:52 smithi007 bash[22722]: cluster 2024-09-13T22:46:50.765550+0000 mgr.a (mgr.14355) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:52.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:52 smithi131 bash[24745]: cluster 2024-09-13T22:46:50.765550+0000 mgr.a (mgr.14355) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:52 smithi171 bash[25040]: cluster 2024-09-13T22:46:50.765550+0000 mgr.a (mgr.14355) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:54.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:46:54.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:46:54.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:46:54.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:54 smithi007 bash[22722]: cluster 2024-09-13T22:46:52.766336+0000 mgr.a (mgr.14355) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:54.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:54 smithi131 bash[24745]: cluster 2024-09-13T22:46:52.766336+0000 mgr.a (mgr.14355) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:54 smithi171 bash[25040]: cluster 2024-09-13T22:46:52.766336+0000 mgr.a (mgr.14355) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:46:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:46:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:46:55.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:46:55.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:46:55.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:55 smithi007 bash[22722]: audit 2024-09-13T22:46:55.036808+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:55.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:55 smithi131 bash[24745]: audit 2024-09-13T22:46:55.036808+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:55.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:55 smithi171 bash[25040]: audit 2024-09-13T22:46:55.036808+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: cluster 2024-09-13T22:46:54.767042+0000 mgr.a (mgr.14355) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:54.814394+0000 mgr.a (mgr.14355) 1126 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:55.609769+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:55.616161+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:56.233699+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:46:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:56.234864+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:46:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:56.243907+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22722]: audit 2024-09-13T22:46:56.246687+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:56.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: cluster 2024-09-13T22:46:54.767042+0000 mgr.a (mgr.14355) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:54.814394+0000 mgr.a (mgr.14355) 1126 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:55.609769+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:55.616161+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:56.233699+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:56.234864+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:56.243907+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:56 smithi131 bash[24745]: audit 2024-09-13T22:46:56.246687+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: cluster 2024-09-13T22:46:54.767042+0000 mgr.a (mgr.14355) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:54.814394+0000 mgr.a (mgr.14355) 1126 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:55.609769+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:55.616161+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:56.233699+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:56.234864+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:56.243907+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:46:56.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:56 smithi171 bash[25040]: audit 2024-09-13T22:46:56.246687+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:57.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22972]: debug 2024-09-13T22:46:56.943+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:46:57.202 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:46:56 smithi007 bash[22972]: debug 2024-09-13T22:46:56.943+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:46:57.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:57 smithi007 bash[22722]: audit 2024-09-13T22:46:56.247935+0000 mgr.a (mgr.14355) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:57.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:57 smithi131 bash[24745]: audit 2024-09-13T22:46:56.247935+0000 mgr.a (mgr.14355) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:57.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:57 smithi171 bash[25040]: audit 2024-09-13T22:46:56.247935+0000 mgr.a (mgr.14355) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:46:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:58 smithi007 bash[22722]: cluster 2024-09-13T22:46:56.768283+0000 mgr.a (mgr.14355) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:58 smithi007 bash[22722]: audit 2024-09-13T22:46:56.946649+0000 mgr.a (mgr.14355) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:46:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:58 smithi007 bash[22722]: cephadm 2024-09-13T22:46:56.948169+0000 mgr.a (mgr.14355) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:46:58.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:58 smithi131 bash[24745]: cluster 2024-09-13T22:46:56.768283+0000 mgr.a (mgr.14355) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:58 smithi131 bash[24745]: audit 2024-09-13T22:46:56.946649+0000 mgr.a (mgr.14355) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:46:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:58 smithi131 bash[24745]: cephadm 2024-09-13T22:46:56.948169+0000 mgr.a (mgr.14355) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:46:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:58 smithi171 bash[25040]: cluster 2024-09-13T22:46:56.768283+0000 mgr.a (mgr.14355) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:46:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:58 smithi171 bash[25040]: audit 2024-09-13T22:46:56.946649+0000 mgr.a (mgr.14355) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:46:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:58 smithi171 bash[25040]: cephadm 2024-09-13T22:46:56.948169+0000 mgr.a (mgr.14355) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:46:59.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:46:59 smithi007 bash[22722]: cluster 2024-09-13T22:46:58.769036+0000 mgr.a (mgr.14355) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:59.780 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:46:59 smithi131 bash[24745]: cluster 2024-09-13T22:46:58.769036+0000 mgr.a (mgr.14355) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:46:59.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:46:59 smithi171 bash[25040]: cluster 2024-09-13T22:46:58.769036+0000 mgr.a (mgr.14355) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:00.979 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:02.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:01 smithi007 bash[22722]: audit 2024-09-13T22:47:00.578544+0000 mgr.a (mgr.14355) 1132 : audit [DBG] from='client.37524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:02.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:01 smithi007 bash[22722]: cluster 2024-09-13T22:47:00.770312+0000 mgr.a (mgr.14355) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:02.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:01 smithi131 bash[24745]: audit 2024-09-13T22:47:00.578544+0000 mgr.a (mgr.14355) 1132 : audit [DBG] from='client.37524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:01 smithi131 bash[24745]: cluster 2024-09-13T22:47:00.770312+0000 mgr.a (mgr.14355) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:02.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:01 smithi171 bash[25040]: audit 2024-09-13T22:47:00.578544+0000 mgr.a (mgr.14355) 1132 : audit [DBG] from='client.37524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:02.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:01 smithi171 bash[25040]: cluster 2024-09-13T22:47:00.770312+0000 mgr.a (mgr.14355) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:03 smithi007 bash[22722]: cluster 2024-09-13T22:47:02.771168+0000 mgr.a (mgr.14355) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:03 smithi131 bash[24745]: cluster 2024-09-13T22:47:02.771168+0000 mgr.a (mgr.14355) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:04.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:03 smithi171 bash[25040]: cluster 2024-09-13T22:47:02.771168+0000 mgr.a (mgr.14355) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:05.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:06.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:05 smithi007 bash[22722]: cluster 2024-09-13T22:47:04.771966+0000 mgr.a (mgr.14355) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:06.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:05 smithi131 bash[24745]: cluster 2024-09-13T22:47:04.771966+0000 mgr.a (mgr.14355) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:06.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:05 smithi171 bash[25040]: cluster 2024-09-13T22:47:04.771966+0000 mgr.a (mgr.14355) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:06.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:07.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:06 smithi007 bash[22722]: audit 2024-09-13T22:47:06.318209+0000 mgr.a (mgr.14355) 1136 : audit [DBG] from='client.37599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:07.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:06 smithi131 bash[24745]: audit 2024-09-13T22:47:06.318209+0000 mgr.a (mgr.14355) 1136 : audit [DBG] from='client.37599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:07.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:06 smithi171 bash[25040]: audit 2024-09-13T22:47:06.318209+0000 mgr.a (mgr.14355) 1136 : audit [DBG] from='client.37599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:08.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:07 smithi007 bash[22722]: cluster 2024-09-13T22:47:06.773350+0000 mgr.a (mgr.14355) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:08.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:07 smithi131 bash[24745]: cluster 2024-09-13T22:47:06.773350+0000 mgr.a (mgr.14355) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:08.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:07 smithi171 bash[25040]: cluster 2024-09-13T22:47:06.773350+0000 mgr.a (mgr.14355) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:10.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:09 smithi007 bash[22722]: cluster 2024-09-13T22:47:08.774095+0000 mgr.a (mgr.14355) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:10.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:09 smithi131 bash[24745]: cluster 2024-09-13T22:47:08.774095+0000 mgr.a (mgr.14355) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:10.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:09 smithi171 bash[25040]: cluster 2024-09-13T22:47:08.774095+0000 mgr.a (mgr.14355) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:47:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:12.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:11 smithi007 bash[22722]: cluster 2024-09-13T22:47:10.776042+0000 mgr.a (mgr.14355) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:12.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:11 smithi131 bash[24745]: cluster 2024-09-13T22:47:10.776042+0000 mgr.a (mgr.14355) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:12.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:11 smithi171 bash[25040]: cluster 2024-09-13T22:47:10.776042+0000 mgr.a (mgr.14355) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:47:12.519 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:12.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:13.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:12 smithi007 bash[22722]: audit 2024-09-13T22:47:12.092274+0000 mgr.a (mgr.14355) 1140 : audit [DBG] from='client.37677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:13.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:12 smithi131 bash[24745]: audit 2024-09-13T22:47:12.092274+0000 mgr.a (mgr.14355) 1140 : audit [DBG] from='client.37677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:13.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:12 smithi171 bash[25040]: audit 2024-09-13T22:47:12.092274+0000 mgr.a (mgr.14355) 1140 : audit [DBG] from='client.37677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:14.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:13 smithi007 bash[22722]: cluster 2024-09-13T22:47:12.776978+0000 mgr.a (mgr.14355) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:14.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:13 smithi131 bash[24745]: cluster 2024-09-13T22:47:12.776978+0000 mgr.a (mgr.14355) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:14.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:13 smithi171 bash[25040]: cluster 2024-09-13T22:47:12.776978+0000 mgr.a (mgr.14355) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:16.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:15 smithi007 bash[22722]: cluster 2024-09-13T22:47:14.777795+0000 mgr.a (mgr.14355) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:16.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:15 smithi131 bash[24745]: cluster 2024-09-13T22:47:14.777795+0000 mgr.a (mgr.14355) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:16.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:15 smithi171 bash[25040]: cluster 2024-09-13T22:47:14.777795+0000 mgr.a (mgr.14355) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:17.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:18.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:17 smithi007 bash[22722]: cluster 2024-09-13T22:47:16.780033+0000 mgr.a (mgr.14355) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:18.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:18.251 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:18.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:17 smithi131 bash[24745]: cluster 2024-09-13T22:47:16.780033+0000 mgr.a (mgr.14355) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:18.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:17 smithi171 bash[25040]: cluster 2024-09-13T22:47:16.780033+0000 mgr.a (mgr.14355) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:19.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:18 smithi007 bash[22722]: audit 2024-09-13T22:47:17.852718+0000 mgr.a (mgr.14355) 1144 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:19.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:18 smithi131 bash[24745]: audit 2024-09-13T22:47:17.852718+0000 mgr.a (mgr.14355) 1144 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:19.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:18 smithi171 bash[25040]: audit 2024-09-13T22:47:17.852718+0000 mgr.a (mgr.14355) 1144 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:20.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:19 smithi007 bash[22722]: cluster 2024-09-13T22:47:18.780970+0000 mgr.a (mgr.14355) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:20.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:19 smithi131 bash[24745]: cluster 2024-09-13T22:47:18.780970+0000 mgr.a (mgr.14355) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:20.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:19 smithi171 bash[25040]: cluster 2024-09-13T22:47:18.780970+0000 mgr.a (mgr.14355) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:22.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:21 smithi007 bash[22722]: cluster 2024-09-13T22:47:20.783160+0000 mgr.a (mgr.14355) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:22.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:21 smithi131 bash[24745]: cluster 2024-09-13T22:47:20.783160+0000 mgr.a (mgr.14355) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:22.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:21 smithi171 bash[25040]: cluster 2024-09-13T22:47:20.783160+0000 mgr.a (mgr.14355) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:23.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:23.253 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:23.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:24.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:24.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:24.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:24.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:24.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:24.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:23 smithi007 bash[22722]: cluster 2024-09-13T22:47:22.783922+0000 mgr.a (mgr.14355) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:24.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:23 smithi131 bash[24745]: cluster 2024-09-13T22:47:22.783922+0000 mgr.a (mgr.14355) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:24.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:23 smithi171 bash[25040]: cluster 2024-09-13T22:47:22.783922+0000 mgr.a (mgr.14355) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:25.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:24 smithi007 bash[22722]: audit 2024-09-13T22:47:23.596233+0000 mgr.a (mgr.14355) 1148 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:25.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:24 smithi131 bash[24745]: audit 2024-09-13T22:47:23.596233+0000 mgr.a (mgr.14355) 1148 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:25.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:24 smithi171 bash[25040]: audit 2024-09-13T22:47:23.596233+0000 mgr.a (mgr.14355) 1148 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:26.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:25 smithi007 bash[22722]: cluster 2024-09-13T22:47:24.784902+0000 mgr.a (mgr.14355) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:26.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:25 smithi131 bash[24745]: cluster 2024-09-13T22:47:24.784902+0000 mgr.a (mgr.14355) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:26.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:25 smithi171 bash[25040]: cluster 2024-09-13T22:47:24.784902+0000 mgr.a (mgr.14355) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:28.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:27 smithi007 bash[22722]: cluster 2024-09-13T22:47:26.787210+0000 mgr.a (mgr.14355) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:28.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:27 smithi131 bash[24745]: cluster 2024-09-13T22:47:26.787210+0000 mgr.a (mgr.14355) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:28.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:27 smithi171 bash[25040]: cluster 2024-09-13T22:47:26.787210+0000 mgr.a (mgr.14355) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:29.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:29.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:29.799 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:29.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:29.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:29.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:29.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:29 smithi007 bash[22722]: cluster 2024-09-13T22:47:28.787989+0000 mgr.a (mgr.14355) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:30.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:29 smithi007 bash[22722]: audit 2024-09-13T22:47:29.369785+0000 mgr.a (mgr.14355) 1152 : audit [DBG] from='client.37908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:30.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:29 smithi131 bash[24745]: cluster 2024-09-13T22:47:28.787989+0000 mgr.a (mgr.14355) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:30.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:29 smithi131 bash[24745]: audit 2024-09-13T22:47:29.369785+0000 mgr.a (mgr.14355) 1152 : audit [DBG] from='client.37908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:30.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:29 smithi171 bash[25040]: cluster 2024-09-13T22:47:28.787989+0000 mgr.a (mgr.14355) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:29 smithi171 bash[25040]: audit 2024-09-13T22:47:29.369785+0000 mgr.a (mgr.14355) 1152 : audit [DBG] from='client.37908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:32.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:31 smithi007 bash[22722]: cluster 2024-09-13T22:47:30.790359+0000 mgr.a (mgr.14355) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:32.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:31 smithi131 bash[24745]: cluster 2024-09-13T22:47:30.790359+0000 mgr.a (mgr.14355) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:32.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:31 smithi171 bash[25040]: cluster 2024-09-13T22:47:30.790359+0000 mgr.a (mgr.14355) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:34.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:33 smithi007 bash[22722]: cluster 2024-09-13T22:47:32.791076+0000 mgr.a (mgr.14355) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:34.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:33 smithi131 bash[24745]: cluster 2024-09-13T22:47:32.791076+0000 mgr.a (mgr.14355) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:33 smithi171 bash[25040]: cluster 2024-09-13T22:47:32.791076+0000 mgr.a (mgr.14355) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:34.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:34.802 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:34.802 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:35.566 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:35.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:35 smithi007 bash[22722]: cluster 2024-09-13T22:47:34.791829+0000 mgr.a (mgr.14355) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:36.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:35 smithi007 bash[22722]: audit 2024-09-13T22:47:35.137406+0000 mgr.a (mgr.14355) 1156 : audit [DBG] from='client.37983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:36.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:35 smithi131 bash[24745]: cluster 2024-09-13T22:47:34.791829+0000 mgr.a (mgr.14355) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:36.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:35 smithi131 bash[24745]: audit 2024-09-13T22:47:35.137406+0000 mgr.a (mgr.14355) 1156 : audit [DBG] from='client.37983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:36.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:35 smithi171 bash[25040]: cluster 2024-09-13T22:47:34.791829+0000 mgr.a (mgr.14355) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:36.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:35 smithi171 bash[25040]: audit 2024-09-13T22:47:35.137406+0000 mgr.a (mgr.14355) 1156 : audit [DBG] from='client.37983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:38.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:37 smithi007 bash[22722]: cluster 2024-09-13T22:47:36.794229+0000 mgr.a (mgr.14355) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:47:38.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:37 smithi131 bash[24745]: cluster 2024-09-13T22:47:36.794229+0000 mgr.a (mgr.14355) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:47:38.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:37 smithi171 bash[25040]: cluster 2024-09-13T22:47:36.794229+0000 mgr.a (mgr.14355) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:47:40.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:39 smithi007 bash[22722]: cluster 2024-09-13T22:47:38.795033+0000 mgr.a (mgr.14355) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:47:40.280 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:39 smithi131 bash[24745]: cluster 2024-09-13T22:47:38.795033+0000 mgr.a (mgr.14355) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:47:40.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:39 smithi171 bash[25040]: cluster 2024-09-13T22:47:38.795033+0000 mgr.a (mgr.14355) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:47:40.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:40.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:40.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:41.315 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:41.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:41.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:41.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:41.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:42.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:41 smithi007 bash[22722]: cluster 2024-09-13T22:47:40.796990+0000 mgr.a (mgr.14355) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:41 smithi007 bash[22722]: audit 2024-09-13T22:47:40.900894+0000 mgr.a (mgr.14355) 1160 : audit [DBG] from='client.38058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:42.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:41 smithi131 bash[24745]: cluster 2024-09-13T22:47:40.796990+0000 mgr.a (mgr.14355) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:42.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:41 smithi131 bash[24745]: audit 2024-09-13T22:47:40.900894+0000 mgr.a (mgr.14355) 1160 : audit [DBG] from='client.38058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:42.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:41 smithi171 bash[25040]: cluster 2024-09-13T22:47:40.796990+0000 mgr.a (mgr.14355) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:42.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:41 smithi171 bash[25040]: audit 2024-09-13T22:47:40.900894+0000 mgr.a (mgr.14355) 1160 : audit [DBG] from='client.38058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:43 smithi007 bash[22722]: cluster 2024-09-13T22:47:42.797896+0000 mgr.a (mgr.14355) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:47:44.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:43 smithi131 bash[24745]: cluster 2024-09-13T22:47:42.797896+0000 mgr.a (mgr.14355) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:47:44.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:43 smithi171 bash[25040]: cluster 2024-09-13T22:47:42.797896+0000 mgr.a (mgr.14355) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:47:46.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:46 smithi131 bash[24745]: cluster 2024-09-13T22:47:44.798736+0000 mgr.a (mgr.14355) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:47:46.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:46 smithi171 bash[25040]: cluster 2024-09-13T22:47:44.798736+0000 mgr.a (mgr.14355) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:47:46.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:46.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:46.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:46.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:46 smithi007 bash[22722]: cluster 2024-09-13T22:47:44.798736+0000 mgr.a (mgr.14355) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:47:47.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:47.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:48.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:48 smithi131 bash[24745]: audit 2024-09-13T22:47:46.656823+0000 mgr.a (mgr.14355) 1163 : audit [DBG] from='client.38136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:48.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:48 smithi131 bash[24745]: cluster 2024-09-13T22:47:46.800078+0000 mgr.a (mgr.14355) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:48.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:48 smithi171 bash[25040]: audit 2024-09-13T22:47:46.656823+0000 mgr.a (mgr.14355) 1163 : audit [DBG] from='client.38136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:48.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:48 smithi171 bash[25040]: cluster 2024-09-13T22:47:46.800078+0000 mgr.a (mgr.14355) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:48 smithi007 bash[22722]: audit 2024-09-13T22:47:46.656823+0000 mgr.a (mgr.14355) 1163 : audit [DBG] from='client.38136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:48 smithi007 bash[22722]: cluster 2024-09-13T22:47:46.800078+0000 mgr.a (mgr.14355) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:50.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:50 smithi131 bash[24745]: cluster 2024-09-13T22:47:48.800945+0000 mgr.a (mgr.14355) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:47:50.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:50 smithi171 bash[25040]: cluster 2024-09-13T22:47:48.800945+0000 mgr.a (mgr.14355) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:47:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:50 smithi007 bash[22722]: cluster 2024-09-13T22:47:48.800945+0000 mgr.a (mgr.14355) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:47:52.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:52.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:52.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:52.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:52 smithi131 bash[24745]: cluster 2024-09-13T22:47:50.803169+0000 mgr.a (mgr.14355) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:47:52.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:52 smithi171 bash[25040]: cluster 2024-09-13T22:47:50.803169+0000 mgr.a (mgr.14355) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:47:52.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:52 smithi007 bash[22722]: cluster 2024-09-13T22:47:50.803169+0000 mgr.a (mgr.14355) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:47:52.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:53.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:53 smithi131 bash[24745]: audit 2024-09-13T22:47:52.410187+0000 mgr.a (mgr.14355) 1167 : audit [DBG] from='client.38214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:53.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:53 smithi171 bash[25040]: audit 2024-09-13T22:47:52.410187+0000 mgr.a (mgr.14355) 1167 : audit [DBG] from='client.38214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:53.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:53 smithi007 bash[22722]: audit 2024-09-13T22:47:52.410187+0000 mgr.a (mgr.14355) 1167 : audit [DBG] from='client.38214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:54.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:54 smithi131 bash[24745]: cluster 2024-09-13T22:47:52.803638+0000 mgr.a (mgr.14355) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:54.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:54 smithi171 bash[25040]: cluster 2024-09-13T22:47:52.803638+0000 mgr.a (mgr.14355) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:54 smithi007 bash[22722]: cluster 2024-09-13T22:47:52.803638+0000 mgr.a (mgr.14355) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:56.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:56 smithi131 bash[24745]: cluster 2024-09-13T22:47:54.804357+0000 mgr.a (mgr.14355) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:56.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:56 smithi171 bash[25040]: cluster 2024-09-13T22:47:54.804357+0000 mgr.a (mgr.14355) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:56 smithi007 bash[22722]: cluster 2024-09-13T22:47:54.804357+0000 mgr.a (mgr.14355) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:47:57.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:57 smithi171 bash[25040]: audit 2024-09-13T22:47:56.998522+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:47:57.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:57 smithi007 bash[22722]: audit 2024-09-13T22:47:56.998522+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:47:57.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:57 smithi131 bash[24745]: audit 2024-09-13T22:47:56.998522+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:47:57.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:47:57.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:47:57.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:47:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:58 smithi171 bash[25040]: cluster 2024-09-13T22:47:56.806609+0000 mgr.a (mgr.14355) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:58 smithi171 bash[25040]: audit 2024-09-13T22:47:57.616405+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:58 smithi171 bash[25040]: audit 2024-09-13T22:47:57.622372+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:58 smithi171 bash[25040]: audit 2024-09-13T22:47:57.628474+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:58 smithi171 bash[25040]: audit 2024-09-13T22:47:57.634839+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:58 smithi007 bash[22722]: cluster 2024-09-13T22:47:56.806609+0000 mgr.a (mgr.14355) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:58 smithi007 bash[22722]: audit 2024-09-13T22:47:57.616405+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:58 smithi007 bash[22722]: audit 2024-09-13T22:47:57.622372+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:58 smithi007 bash[22722]: audit 2024-09-13T22:47:57.628474+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:58 smithi007 bash[22722]: audit 2024-09-13T22:47:57.634839+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:58 smithi131 bash[24745]: cluster 2024-09-13T22:47:56.806609+0000 mgr.a (mgr.14355) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:47:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:58 smithi131 bash[24745]: audit 2024-09-13T22:47:57.616405+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:58 smithi131 bash[24745]: audit 2024-09-13T22:47:57.622372+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:58 smithi131 bash[24745]: audit 2024-09-13T22:47:57.628474+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:58 smithi131 bash[24745]: audit 2024-09-13T22:47:57.634839+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:58.586 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:47:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:47:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:47:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:47:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.140108+0000 mgr.a (mgr.14355) 1171 : audit [DBG] from='client.38292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.313500+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.314551+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.320463+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.323761+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:47:59.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:47:59 smithi171 bash[25040]: audit 2024-09-13T22:47:58.325405+0000 mgr.a (mgr.14355) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:47:59.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22972]: debug 2024-09-13T22:47:59.245+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:47:59.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22972]: debug 2024-09-13T22:47:59.249+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:47:59.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.140108+0000 mgr.a (mgr.14355) 1171 : audit [DBG] from='client.38292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:59.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.313500+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:47:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.314551+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:47:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.320463+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.323761+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:47:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:47:59 smithi007 bash[22722]: audit 2024-09-13T22:47:58.325405+0000 mgr.a (mgr.14355) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:47:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.140108+0000 mgr.a (mgr.14355) 1171 : audit [DBG] from='client.38292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.313500+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:47:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.314551+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:47:59.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.320463+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:47:59.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.323761+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:47:59.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:47:59 smithi131 bash[24745]: audit 2024-09-13T22:47:58.325405+0000 mgr.a (mgr.14355) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:48:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:00 smithi007 bash[22722]: cluster 2024-09-13T22:47:58.807124+0000 mgr.a (mgr.14355) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:00 smithi007 bash[22722]: audit 2024-09-13T22:47:59.249240+0000 mgr.a (mgr.14355) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:48:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:00 smithi007 bash[22722]: cephadm 2024-09-13T22:47:59.250503+0000 mgr.a (mgr.14355) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:48:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:00 smithi131 bash[24745]: cluster 2024-09-13T22:47:58.807124+0000 mgr.a (mgr.14355) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:00 smithi131 bash[24745]: audit 2024-09-13T22:47:59.249240+0000 mgr.a (mgr.14355) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:48:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:00 smithi131 bash[24745]: cephadm 2024-09-13T22:47:59.250503+0000 mgr.a (mgr.14355) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:48:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:00 smithi171 bash[25040]: cluster 2024-09-13T22:47:58.807124+0000 mgr.a (mgr.14355) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:00 smithi171 bash[25040]: audit 2024-09-13T22:47:59.249240+0000 mgr.a (mgr.14355) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:48:00.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:00 smithi171 bash[25040]: cephadm 2024-09-13T22:47:59.250503+0000 mgr.a (mgr.14355) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:48:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:02 smithi007 bash[22722]: cluster 2024-09-13T22:48:00.809386+0000 mgr.a (mgr.14355) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:02 smithi131 bash[24745]: cluster 2024-09-13T22:48:00.809386+0000 mgr.a (mgr.14355) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:02 smithi171 bash[25040]: cluster 2024-09-13T22:48:00.809386+0000 mgr.a (mgr.14355) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:04.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:04 smithi007 bash[22722]: cluster 2024-09-13T22:48:02.810148+0000 mgr.a (mgr.14355) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:04.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:04 smithi131 bash[24745]: cluster 2024-09-13T22:48:02.810148+0000 mgr.a (mgr.14355) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:04 smithi171 bash[25040]: cluster 2024-09-13T22:48:02.810148+0000 mgr.a (mgr.14355) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:05 smithi007 bash[22722]: audit 2024-09-13T22:48:03.920327+0000 mgr.a (mgr.14355) 1178 : audit [DBG] from='client.38475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:05.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:05 smithi131 bash[24745]: audit 2024-09-13T22:48:03.920327+0000 mgr.a (mgr.14355) 1178 : audit [DBG] from='client.38475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:05.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:05 smithi171 bash[25040]: audit 2024-09-13T22:48:03.920327+0000 mgr.a (mgr.14355) 1178 : audit [DBG] from='client.38475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:06 smithi007 bash[22722]: cluster 2024-09-13T22:48:04.811077+0000 mgr.a (mgr.14355) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:06 smithi131 bash[24745]: cluster 2024-09-13T22:48:04.811077+0000 mgr.a (mgr.14355) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:06 smithi171 bash[25040]: cluster 2024-09-13T22:48:04.811077+0000 mgr.a (mgr.14355) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:08 smithi007 bash[22722]: cluster 2024-09-13T22:48:06.813311+0000 mgr.a (mgr.14355) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:08.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:08 smithi131 bash[24745]: cluster 2024-09-13T22:48:06.813311+0000 mgr.a (mgr.14355) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:08 smithi171 bash[25040]: cluster 2024-09-13T22:48:06.813311+0000 mgr.a (mgr.14355) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:09.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:09.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:09.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:10.056 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:10.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:10 smithi007 bash[22722]: cluster 2024-09-13T22:48:08.814089+0000 mgr.a (mgr.14355) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:10.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:10 smithi131 bash[24745]: cluster 2024-09-13T22:48:08.814089+0000 mgr.a (mgr.14355) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:10 smithi171 bash[25040]: cluster 2024-09-13T22:48:08.814089+0000 mgr.a (mgr.14355) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:11 smithi007 bash[22722]: audit 2024-09-13T22:48:09.655621+0000 mgr.a (mgr.14355) 1182 : audit [DBG] from='client.38553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:11.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:11 smithi131 bash[24745]: audit 2024-09-13T22:48:09.655621+0000 mgr.a (mgr.14355) 1182 : audit [DBG] from='client.38553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:11 smithi171 bash[25040]: audit 2024-09-13T22:48:09.655621+0000 mgr.a (mgr.14355) 1182 : audit [DBG] from='client.38553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:12 smithi007 bash[22722]: cluster 2024-09-13T22:48:10.816481+0000 mgr.a (mgr.14355) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:12 smithi131 bash[24745]: cluster 2024-09-13T22:48:10.816481+0000 mgr.a (mgr.14355) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:12.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:12 smithi171 bash[25040]: cluster 2024-09-13T22:48:10.816481+0000 mgr.a (mgr.14355) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:48:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:14 smithi007 bash[22722]: cluster 2024-09-13T22:48:12.817421+0000 mgr.a (mgr.14355) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:14 smithi131 bash[24745]: cluster 2024-09-13T22:48:12.817421+0000 mgr.a (mgr.14355) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:14 smithi171 bash[25040]: cluster 2024-09-13T22:48:12.817421+0000 mgr.a (mgr.14355) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:15.826 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:15.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:16 smithi007 bash[22722]: cluster 2024-09-13T22:48:14.818380+0000 mgr.a (mgr.14355) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:16 smithi007 bash[22722]: audit 2024-09-13T22:48:15.393343+0000 mgr.a (mgr.14355) 1186 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:16 smithi131 bash[24745]: cluster 2024-09-13T22:48:14.818380+0000 mgr.a (mgr.14355) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:16 smithi131 bash[24745]: audit 2024-09-13T22:48:15.393343+0000 mgr.a (mgr.14355) 1186 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:16 smithi171 bash[25040]: cluster 2024-09-13T22:48:14.818380+0000 mgr.a (mgr.14355) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:16.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:16 smithi171 bash[25040]: audit 2024-09-13T22:48:15.393343+0000 mgr.a (mgr.14355) 1186 : audit [DBG] from='client.38631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:18 smithi007 bash[22722]: cluster 2024-09-13T22:48:16.821115+0000 mgr.a (mgr.14355) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:18 smithi131 bash[24745]: cluster 2024-09-13T22:48:16.821115+0000 mgr.a (mgr.14355) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:18.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:18 smithi171 bash[25040]: cluster 2024-09-13T22:48:16.821115+0000 mgr.a (mgr.14355) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:20 smithi007 bash[22722]: cluster 2024-09-13T22:48:18.821906+0000 mgr.a (mgr.14355) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:20.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:20 smithi131 bash[24745]: cluster 2024-09-13T22:48:18.821906+0000 mgr.a (mgr.14355) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:20.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:20 smithi171 bash[25040]: cluster 2024-09-13T22:48:18.821906+0000 mgr.a (mgr.14355) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:21.593 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:22 smithi007 bash[22722]: cluster 2024-09-13T22:48:20.823858+0000 mgr.a (mgr.14355) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:22 smithi007 bash[22722]: audit 2024-09-13T22:48:21.163492+0000 mgr.a (mgr.14355) 1190 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:22 smithi131 bash[24745]: cluster 2024-09-13T22:48:20.823858+0000 mgr.a (mgr.14355) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:22 smithi131 bash[24745]: audit 2024-09-13T22:48:21.163492+0000 mgr.a (mgr.14355) 1190 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:22 smithi171 bash[25040]: cluster 2024-09-13T22:48:20.823858+0000 mgr.a (mgr.14355) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:22.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:22 smithi171 bash[25040]: audit 2024-09-13T22:48:21.163492+0000 mgr.a (mgr.14355) 1190 : audit [DBG] from='client.38709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:24 smithi007 bash[22722]: cluster 2024-09-13T22:48:22.824674+0000 mgr.a (mgr.14355) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:24 smithi131 bash[24745]: cluster 2024-09-13T22:48:22.824674+0000 mgr.a (mgr.14355) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:24 smithi171 bash[25040]: cluster 2024-09-13T22:48:22.824674+0000 mgr.a (mgr.14355) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:48:26.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:26.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:26.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:26 smithi007 bash[22722]: cluster 2024-09-13T22:48:24.825484+0000 mgr.a (mgr.14355) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:48:26.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:26 smithi131 bash[24745]: cluster 2024-09-13T22:48:24.825484+0000 mgr.a (mgr.14355) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:48:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:26 smithi171 bash[25040]: cluster 2024-09-13T22:48:24.825484+0000 mgr.a (mgr.14355) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:48:27.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:28 smithi007 bash[22722]: cluster 2024-09-13T22:48:26.827674+0000 mgr.a (mgr.14355) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:28 smithi007 bash[22722]: audit 2024-09-13T22:48:26.924054+0000 mgr.a (mgr.14355) 1194 : audit [DBG] from='client.38784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:28.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:28 smithi131 bash[24745]: cluster 2024-09-13T22:48:26.827674+0000 mgr.a (mgr.14355) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:28.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:28 smithi131 bash[24745]: audit 2024-09-13T22:48:26.924054+0000 mgr.a (mgr.14355) 1194 : audit [DBG] from='client.38784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:28 smithi171 bash[25040]: cluster 2024-09-13T22:48:26.827674+0000 mgr.a (mgr.14355) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:28.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:28 smithi171 bash[25040]: audit 2024-09-13T22:48:26.924054+0000 mgr.a (mgr.14355) 1194 : audit [DBG] from='client.38784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:30 smithi007 bash[22722]: cluster 2024-09-13T22:48:28.828578+0000 mgr.a (mgr.14355) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:30 smithi131 bash[24745]: cluster 2024-09-13T22:48:28.828578+0000 mgr.a (mgr.14355) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:30 smithi171 bash[25040]: cluster 2024-09-13T22:48:28.828578+0000 mgr.a (mgr.14355) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:32.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:32 smithi007 bash[22722]: cluster 2024-09-13T22:48:30.830834+0000 mgr.a (mgr.14355) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:32 smithi131 bash[24745]: cluster 2024-09-13T22:48:30.830834+0000 mgr.a (mgr.14355) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:32 smithi171 bash[25040]: cluster 2024-09-13T22:48:30.830834+0000 mgr.a (mgr.14355) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:33.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:34 smithi007 bash[22722]: audit 2024-09-13T22:48:32.666809+0000 mgr.a (mgr.14355) 1197 : audit [DBG] from='client.38862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:34 smithi007 bash[22722]: cluster 2024-09-13T22:48:32.831795+0000 mgr.a (mgr.14355) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:34 smithi131 bash[24745]: audit 2024-09-13T22:48:32.666809+0000 mgr.a (mgr.14355) 1197 : audit [DBG] from='client.38862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:34 smithi131 bash[24745]: cluster 2024-09-13T22:48:32.831795+0000 mgr.a (mgr.14355) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:34 smithi171 bash[25040]: audit 2024-09-13T22:48:32.666809+0000 mgr.a (mgr.14355) 1197 : audit [DBG] from='client.38862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:34.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:34 smithi171 bash[25040]: cluster 2024-09-13T22:48:32.831795+0000 mgr.a (mgr.14355) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:36 smithi007 bash[22722]: cluster 2024-09-13T22:48:34.832836+0000 mgr.a (mgr.14355) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:36 smithi131 bash[24745]: cluster 2024-09-13T22:48:34.832836+0000 mgr.a (mgr.14355) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:36 smithi171 bash[25040]: cluster 2024-09-13T22:48:34.832836+0000 mgr.a (mgr.14355) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:38 smithi007 bash[22722]: cluster 2024-09-13T22:48:36.835096+0000 mgr.a (mgr.14355) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:38 smithi131 bash[24745]: cluster 2024-09-13T22:48:36.835096+0000 mgr.a (mgr.14355) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:38 smithi171 bash[25040]: cluster 2024-09-13T22:48:36.835096+0000 mgr.a (mgr.14355) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:38.817 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:38.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:39.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:39 smithi007 bash[22722]: audit 2024-09-13T22:48:38.411378+0000 mgr.a (mgr.14355) 1201 : audit [DBG] from='client.38937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:39 smithi131 bash[24745]: audit 2024-09-13T22:48:38.411378+0000 mgr.a (mgr.14355) 1201 : audit [DBG] from='client.38937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:39 smithi171 bash[25040]: audit 2024-09-13T22:48:38.411378+0000 mgr.a (mgr.14355) 1201 : audit [DBG] from='client.38937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:40 smithi007 bash[22722]: cluster 2024-09-13T22:48:38.835718+0000 mgr.a (mgr.14355) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:40 smithi131 bash[24745]: cluster 2024-09-13T22:48:38.835718+0000 mgr.a (mgr.14355) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:40 smithi171 bash[25040]: cluster 2024-09-13T22:48:38.835718+0000 mgr.a (mgr.14355) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:41 smithi007 bash[22722]: cluster 2024-09-13T22:48:40.837800+0000 mgr.a (mgr.14355) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:41 smithi131 bash[24745]: cluster 2024-09-13T22:48:40.837800+0000 mgr.a (mgr.14355) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:41 smithi171 bash[25040]: cluster 2024-09-13T22:48:40.837800+0000 mgr.a (mgr.14355) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:43 smithi007 bash[22722]: cluster 2024-09-13T22:48:42.838561+0000 mgr.a (mgr.14355) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:44.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:43 smithi131 bash[24745]: cluster 2024-09-13T22:48:42.838561+0000 mgr.a (mgr.14355) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:44.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:43 smithi171 bash[25040]: cluster 2024-09-13T22:48:42.838561+0000 mgr.a (mgr.14355) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:44.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:45.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:44 smithi007 bash[22722]: audit 2024-09-13T22:48:44.154390+0000 mgr.a (mgr.14355) 1205 : audit [DBG] from='client.39015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:45.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:44 smithi131 bash[24745]: audit 2024-09-13T22:48:44.154390+0000 mgr.a (mgr.14355) 1205 : audit [DBG] from='client.39015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:45.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:44 smithi171 bash[25040]: audit 2024-09-13T22:48:44.154390+0000 mgr.a (mgr.14355) 1205 : audit [DBG] from='client.39015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:45 smithi007 bash[22722]: cluster 2024-09-13T22:48:44.839545+0000 mgr.a (mgr.14355) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:46.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:45 smithi131 bash[24745]: cluster 2024-09-13T22:48:44.839545+0000 mgr.a (mgr.14355) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:46.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:45 smithi171 bash[25040]: cluster 2024-09-13T22:48:44.839545+0000 mgr.a (mgr.14355) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:47 smithi007 bash[22722]: cluster 2024-09-13T22:48:46.841790+0000 mgr.a (mgr.14355) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:48.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:47 smithi131 bash[24745]: cluster 2024-09-13T22:48:46.841790+0000 mgr.a (mgr.14355) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:48.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:47 smithi171 bash[25040]: cluster 2024-09-13T22:48:46.841790+0000 mgr.a (mgr.14355) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:48:49.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:49.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:49.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:50.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:49 smithi007 bash[22722]: cluster 2024-09-13T22:48:48.842582+0000 mgr.a (mgr.14355) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:50.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:49 smithi131 bash[24745]: cluster 2024-09-13T22:48:48.842582+0000 mgr.a (mgr.14355) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:50.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:49 smithi171 bash[25040]: cluster 2024-09-13T22:48:48.842582+0000 mgr.a (mgr.14355) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:50.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:50.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:51.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:51 smithi131 bash[24745]: audit 2024-09-13T22:48:49.915964+0000 mgr.a (mgr.14355) 1209 : audit [DBG] from='client.39090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:51.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:51 smithi171 bash[25040]: audit 2024-09-13T22:48:49.915964+0000 mgr.a (mgr.14355) 1209 : audit [DBG] from='client.39090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:51.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:51 smithi007 bash[22722]: audit 2024-09-13T22:48:49.915964+0000 mgr.a (mgr.14355) 1209 : audit [DBG] from='client.39090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:52.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:52 smithi171 bash[25040]: cluster 2024-09-13T22:48:50.844845+0000 mgr.a (mgr.14355) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:48:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:52 smithi007 bash[22722]: cluster 2024-09-13T22:48:50.844845+0000 mgr.a (mgr.14355) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:48:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:52 smithi131 bash[24745]: cluster 2024-09-13T22:48:50.844845+0000 mgr.a (mgr.14355) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:48:54.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:54 smithi171 bash[25040]: cluster 2024-09-13T22:48:52.845594+0000 mgr.a (mgr.14355) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:54 smithi007 bash[22722]: cluster 2024-09-13T22:48:52.845594+0000 mgr.a (mgr.14355) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:54 smithi131 bash[24745]: cluster 2024-09-13T22:48:52.845594+0000 mgr.a (mgr.14355) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:48:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:48:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:48:56.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:48:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:48:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:48:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:48:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:48:56.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:56 smithi171 bash[25040]: cluster 2024-09-13T22:48:54.846505+0000 mgr.a (mgr.14355) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:56 smithi007 bash[22722]: cluster 2024-09-13T22:48:54.846505+0000 mgr.a (mgr.14355) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:56 smithi131 bash[24745]: cluster 2024-09-13T22:48:54.846505+0000 mgr.a (mgr.14355) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:48:57.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:57 smithi007 bash[22722]: audit 2024-09-13T22:48:55.665102+0000 mgr.a (mgr.14355) 1213 : audit [DBG] from='client.39168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:57.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:57 smithi131 bash[24745]: audit 2024-09-13T22:48:55.665102+0000 mgr.a (mgr.14355) 1213 : audit [DBG] from='client.39168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:57.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:57 smithi171 bash[25040]: audit 2024-09-13T22:48:55.665102+0000 mgr.a (mgr.14355) 1213 : audit [DBG] from='client.39168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:48:58 smithi007 bash[22722]: cluster 2024-09-13T22:48:56.849182+0000 mgr.a (mgr.14355) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:48:58 smithi131 bash[24745]: cluster 2024-09-13T22:48:56.849182+0000 mgr.a (mgr.14355) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:48:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:48:58 smithi171 bash[25040]: cluster 2024-09-13T22:48:56.849182+0000 mgr.a (mgr.14355) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:00 smithi007 bash[22722]: cluster 2024-09-13T22:48:58.849958+0000 mgr.a (mgr.14355) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:00 smithi007 bash[22722]: audit 2024-09-13T22:48:59.304107+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:00 smithi131 bash[24745]: cluster 2024-09-13T22:48:58.849958+0000 mgr.a (mgr.14355) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:00 smithi131 bash[24745]: audit 2024-09-13T22:48:59.304107+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:00 smithi171 bash[25040]: cluster 2024-09-13T22:48:58.849958+0000 mgr.a (mgr.14355) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:00 smithi171 bash[25040]: audit 2024-09-13T22:48:59.304107+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:01.829 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:01.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:01.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:01.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:01.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:02 smithi007 bash[22722]: cluster 2024-09-13T22:49:00.851928+0000 mgr.a (mgr.14355) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:02 smithi007 bash[22722]: audit 2024-09-13T22:49:01.418179+0000 mgr.a (mgr.14355) 1217 : audit [DBG] from='client.39246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:02 smithi131 bash[24745]: cluster 2024-09-13T22:49:00.851928+0000 mgr.a (mgr.14355) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:02 smithi131 bash[24745]: audit 2024-09-13T22:49:01.418179+0000 mgr.a (mgr.14355) 1217 : audit [DBG] from='client.39246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:02 smithi171 bash[25040]: cluster 2024-09-13T22:49:00.851928+0000 mgr.a (mgr.14355) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:02.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:02 smithi171 bash[25040]: audit 2024-09-13T22:49:01.418179+0000 mgr.a (mgr.14355) 1217 : audit [DBG] from='client.39246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:04 smithi007 bash[22722]: cluster 2024-09-13T22:49:02.852816+0000 mgr.a (mgr.14355) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:04 smithi131 bash[24745]: cluster 2024-09-13T22:49:02.852816+0000 mgr.a (mgr.14355) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:04 smithi171 bash[25040]: cluster 2024-09-13T22:49:02.852816+0000 mgr.a (mgr.14355) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:06.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:06 smithi007 bash[22722]: cluster 2024-09-13T22:49:04.853587+0000 mgr.a (mgr.14355) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:06 smithi131 bash[24745]: cluster 2024-09-13T22:49:04.853587+0000 mgr.a (mgr.14355) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:06 smithi171 bash[25040]: cluster 2024-09-13T22:49:04.853587+0000 mgr.a (mgr.14355) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:06.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:06.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:06.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:07.565 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:07.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:07.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:08 smithi007 bash[22722]: cluster 2024-09-13T22:49:06.854954+0000 mgr.a (mgr.14355) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:08 smithi007 bash[22722]: audit 2024-09-13T22:49:07.161272+0000 mgr.a (mgr.14355) 1221 : audit [DBG] from='client.39324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:08 smithi131 bash[24745]: cluster 2024-09-13T22:49:06.854954+0000 mgr.a (mgr.14355) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:08 smithi131 bash[24745]: audit 2024-09-13T22:49:07.161272+0000 mgr.a (mgr.14355) 1221 : audit [DBG] from='client.39324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:08 smithi171 bash[25040]: cluster 2024-09-13T22:49:06.854954+0000 mgr.a (mgr.14355) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:08 smithi171 bash[25040]: audit 2024-09-13T22:49:07.161272+0000 mgr.a (mgr.14355) 1221 : audit [DBG] from='client.39324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:10.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: cluster 2024-09-13T22:49:08.856083+0000 mgr.a (mgr.14355) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:10.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.960588+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.969093+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.971655+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.973667+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.984108+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22722]: audit 2024-09-13T22:49:09.989271+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: cluster 2024-09-13T22:49:08.856083+0000 mgr.a (mgr.14355) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.960588+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.969093+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.971655+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.973667+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.984108+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:10 smithi131 bash[24745]: audit 2024-09-13T22:49:09.989271+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: cluster 2024-09-13T22:49:08.856083+0000 mgr.a (mgr.14355) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.960588+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.969093+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.971655+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.973667+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.984108+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:49:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:10 smithi171 bash[25040]: audit 2024-09-13T22:49:09.989271+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:11.083 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22972]: debug 2024-09-13T22:49:10.740+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:49:11.083 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:49:10 smithi007 bash[22972]: debug 2024-09-13T22:49:10.744+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:49:11.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:11 smithi007 bash[22722]: audit 2024-09-13T22:49:09.991719+0000 mgr.a (mgr.14355) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:11 smithi131 bash[24745]: audit 2024-09-13T22:49:09.991719+0000 mgr.a (mgr.14355) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:11 smithi171 bash[25040]: audit 2024-09-13T22:49:09.991719+0000 mgr.a (mgr.14355) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:49:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:12 smithi007 bash[22722]: audit 2024-09-13T22:49:10.744928+0000 mgr.a (mgr.14355) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:49:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:12 smithi007 bash[22722]: cephadm 2024-09-13T22:49:10.746414+0000 mgr.a (mgr.14355) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:49:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:12 smithi007 bash[22722]: cluster 2024-09-13T22:49:10.858756+0000 mgr.a (mgr.14355) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:49:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:12 smithi131 bash[24745]: audit 2024-09-13T22:49:10.744928+0000 mgr.a (mgr.14355) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:49:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:12 smithi131 bash[24745]: cephadm 2024-09-13T22:49:10.746414+0000 mgr.a (mgr.14355) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:49:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:12 smithi131 bash[24745]: cluster 2024-09-13T22:49:10.858756+0000 mgr.a (mgr.14355) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:49:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:12 smithi171 bash[25040]: audit 2024-09-13T22:49:10.744928+0000 mgr.a (mgr.14355) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:49:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:12 smithi171 bash[25040]: cephadm 2024-09-13T22:49:10.746414+0000 mgr.a (mgr.14355) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:49:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:12 smithi171 bash[25040]: cluster 2024-09-13T22:49:10.858756+0000 mgr.a (mgr.14355) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:49:12.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:12.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:12.568 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:13.324 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:14 smithi007 bash[22722]: cluster 2024-09-13T22:49:12.859474+0000 mgr.a (mgr.14355) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:14 smithi007 bash[22722]: audit 2024-09-13T22:49:12.902554+0000 mgr.a (mgr.14355) 1228 : audit [DBG] from='client.39504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:14 smithi131 bash[24745]: cluster 2024-09-13T22:49:12.859474+0000 mgr.a (mgr.14355) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:14 smithi131 bash[24745]: audit 2024-09-13T22:49:12.902554+0000 mgr.a (mgr.14355) 1228 : audit [DBG] from='client.39504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:14 smithi171 bash[25040]: cluster 2024-09-13T22:49:12.859474+0000 mgr.a (mgr.14355) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:14 smithi171 bash[25040]: audit 2024-09-13T22:49:12.902554+0000 mgr.a (mgr.14355) 1228 : audit [DBG] from='client.39504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:16.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:16 smithi007 bash[22722]: cluster 2024-09-13T22:49:14.860342+0000 mgr.a (mgr.14355) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:16 smithi131 bash[24745]: cluster 2024-09-13T22:49:14.860342+0000 mgr.a (mgr.14355) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:16.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:16 smithi171 bash[25040]: cluster 2024-09-13T22:49:14.860342+0000 mgr.a (mgr.14355) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:49:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:18.326 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:18.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:18 smithi007 bash[22722]: cluster 2024-09-13T22:49:16.862606+0000 mgr.a (mgr.14355) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:18 smithi131 bash[24745]: cluster 2024-09-13T22:49:16.862606+0000 mgr.a (mgr.14355) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:18.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:18 smithi171 bash[25040]: cluster 2024-09-13T22:49:16.862606+0000 mgr.a (mgr.14355) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:19.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:19.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:19.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:19.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:19.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:20 smithi007 bash[22722]: audit 2024-09-13T22:49:18.657408+0000 mgr.a (mgr.14355) 1231 : audit [DBG] from='client.39579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:20 smithi007 bash[22722]: cluster 2024-09-13T22:49:18.863059+0000 mgr.a (mgr.14355) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:20 smithi131 bash[24745]: audit 2024-09-13T22:49:18.657408+0000 mgr.a (mgr.14355) 1231 : audit [DBG] from='client.39579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:20 smithi131 bash[24745]: cluster 2024-09-13T22:49:18.863059+0000 mgr.a (mgr.14355) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:20 smithi171 bash[25040]: audit 2024-09-13T22:49:18.657408+0000 mgr.a (mgr.14355) 1231 : audit [DBG] from='client.39579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:20 smithi171 bash[25040]: cluster 2024-09-13T22:49:18.863059+0000 mgr.a (mgr.14355) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:22.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:22 smithi007 bash[22722]: cluster 2024-09-13T22:49:20.865266+0000 mgr.a (mgr.14355) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:22 smithi131 bash[24745]: cluster 2024-09-13T22:49:20.865266+0000 mgr.a (mgr.14355) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:22.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:22 smithi171 bash[25040]: cluster 2024-09-13T22:49:20.865266+0000 mgr.a (mgr.14355) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:49:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:24.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:24.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:24.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:24 smithi007 bash[22722]: cluster 2024-09-13T22:49:22.866039+0000 mgr.a (mgr.14355) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:24.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:24 smithi131 bash[24745]: cluster 2024-09-13T22:49:22.866039+0000 mgr.a (mgr.14355) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:24.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:24 smithi171 bash[25040]: cluster 2024-09-13T22:49:22.866039+0000 mgr.a (mgr.14355) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:24.819 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:24.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:25.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:25 smithi007 bash[22722]: audit 2024-09-13T22:49:24.407729+0000 mgr.a (mgr.14355) 1235 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:25.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:25 smithi131 bash[24745]: audit 2024-09-13T22:49:24.407729+0000 mgr.a (mgr.14355) 1235 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:25.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:25 smithi171 bash[25040]: audit 2024-09-13T22:49:24.407729+0000 mgr.a (mgr.14355) 1235 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:26 smithi007 bash[22722]: cluster 2024-09-13T22:49:24.866577+0000 mgr.a (mgr.14355) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:26 smithi131 bash[24745]: cluster 2024-09-13T22:49:24.866577+0000 mgr.a (mgr.14355) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:26 smithi171 bash[25040]: cluster 2024-09-13T22:49:24.866577+0000 mgr.a (mgr.14355) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:49:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:28 smithi007 bash[22722]: cluster 2024-09-13T22:49:26.868748+0000 mgr.a (mgr.14355) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:49:28.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:28 smithi131 bash[24745]: cluster 2024-09-13T22:49:26.868748+0000 mgr.a (mgr.14355) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:49:28.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:28 smithi171 bash[25040]: cluster 2024-09-13T22:49:26.868748+0000 mgr.a (mgr.14355) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:49:29.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:29.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:29.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:30 smithi007 bash[22722]: cluster 2024-09-13T22:49:28.869514+0000 mgr.a (mgr.14355) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:30 smithi131 bash[24745]: cluster 2024-09-13T22:49:28.869514+0000 mgr.a (mgr.14355) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:30.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:30 smithi171 bash[25040]: cluster 2024-09-13T22:49:28.869514+0000 mgr.a (mgr.14355) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:30.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:31.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:31 smithi007 bash[22722]: audit 2024-09-13T22:49:30.159902+0000 mgr.a (mgr.14355) 1239 : audit [DBG] from='client.39726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:31.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:31 smithi131 bash[24745]: audit 2024-09-13T22:49:30.159902+0000 mgr.a (mgr.14355) 1239 : audit [DBG] from='client.39726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:31.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:31 smithi171 bash[25040]: audit 2024-09-13T22:49:30.159902+0000 mgr.a (mgr.14355) 1239 : audit [DBG] from='client.39726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:32 smithi007 bash[22722]: cluster 2024-09-13T22:49:30.871898+0000 mgr.a (mgr.14355) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:32.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:32 smithi131 bash[24745]: cluster 2024-09-13T22:49:30.871898+0000 mgr.a (mgr.14355) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:32.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:32 smithi171 bash[25040]: cluster 2024-09-13T22:49:30.871898+0000 mgr.a (mgr.14355) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:49:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:34 smithi007 bash[22722]: cluster 2024-09-13T22:49:32.872830+0000 mgr.a (mgr.14355) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:34.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:34 smithi131 bash[24745]: cluster 2024-09-13T22:49:32.872830+0000 mgr.a (mgr.14355) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:34.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:34 smithi171 bash[25040]: cluster 2024-09-13T22:49:32.872830+0000 mgr.a (mgr.14355) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:35.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:35.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:35.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:36.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:36.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:36.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:36.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:36.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:36 smithi007 bash[22722]: cluster 2024-09-13T22:49:34.873741+0000 mgr.a (mgr.14355) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:36.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:36 smithi131 bash[24745]: cluster 2024-09-13T22:49:34.873741+0000 mgr.a (mgr.14355) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:36.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:36 smithi171 bash[25040]: cluster 2024-09-13T22:49:34.873741+0000 mgr.a (mgr.14355) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:49:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:37 smithi007 bash[22722]: audit 2024-09-13T22:49:35.908066+0000 mgr.a (mgr.14355) 1243 : audit [DBG] from='client.39804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:37.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:37 smithi131 bash[24745]: audit 2024-09-13T22:49:35.908066+0000 mgr.a (mgr.14355) 1243 : audit [DBG] from='client.39804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:37.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:37 smithi171 bash[25040]: audit 2024-09-13T22:49:35.908066+0000 mgr.a (mgr.14355) 1243 : audit [DBG] from='client.39804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:38 smithi007 bash[22722]: cluster 2024-09-13T22:49:36.876595+0000 mgr.a (mgr.14355) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:38.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:38 smithi131 bash[24745]: cluster 2024-09-13T22:49:36.876595+0000 mgr.a (mgr.14355) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:38.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:38 smithi171 bash[25040]: cluster 2024-09-13T22:49:36.876595+0000 mgr.a (mgr.14355) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:40 smithi007 bash[22722]: cluster 2024-09-13T22:49:38.877404+0000 mgr.a (mgr.14355) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:40.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:40 smithi131 bash[24745]: cluster 2024-09-13T22:49:38.877404+0000 mgr.a (mgr.14355) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:40.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:40 smithi171 bash[25040]: cluster 2024-09-13T22:49:38.877404+0000 mgr.a (mgr.14355) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:49:41.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:41.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:42.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:42.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:42 smithi007 bash[22722]: cluster 2024-09-13T22:49:40.879455+0000 mgr.a (mgr.14355) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:42.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:42 smithi131 bash[24745]: cluster 2024-09-13T22:49:40.879455+0000 mgr.a (mgr.14355) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:42.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:42 smithi171 bash[25040]: cluster 2024-09-13T22:49:40.879455+0000 mgr.a (mgr.14355) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:43.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:43 smithi007 bash[22722]: audit 2024-09-13T22:49:41.668261+0000 mgr.a (mgr.14355) 1247 : audit [DBG] from='client.39879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:43.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:43 smithi131 bash[24745]: audit 2024-09-13T22:49:41.668261+0000 mgr.a (mgr.14355) 1247 : audit [DBG] from='client.39879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:43.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:43 smithi171 bash[25040]: audit 2024-09-13T22:49:41.668261+0000 mgr.a (mgr.14355) 1247 : audit [DBG] from='client.39879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:44 smithi007 bash[22722]: cluster 2024-09-13T22:49:42.880547+0000 mgr.a (mgr.14355) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:44.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:44 smithi131 bash[24745]: cluster 2024-09-13T22:49:42.880547+0000 mgr.a (mgr.14355) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:44.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:44 smithi171 bash[25040]: cluster 2024-09-13T22:49:42.880547+0000 mgr.a (mgr.14355) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:46 smithi007 bash[22722]: cluster 2024-09-13T22:49:44.881482+0000 mgr.a (mgr.14355) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:46 smithi131 bash[24745]: cluster 2024-09-13T22:49:44.881482+0000 mgr.a (mgr.14355) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:46 smithi171 bash[25040]: cluster 2024-09-13T22:49:44.881482+0000 mgr.a (mgr.14355) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:49:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:47.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:47.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:47.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:47.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:47.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:47.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:48 smithi007 bash[22722]: cluster 2024-09-13T22:49:46.883799+0000 mgr.a (mgr.14355) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:49:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:48 smithi007 bash[22722]: audit 2024-09-13T22:49:47.444554+0000 mgr.a (mgr.14355) 1251 : audit [DBG] from='client.39957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:48 smithi131 bash[24745]: cluster 2024-09-13T22:49:46.883799+0000 mgr.a (mgr.14355) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:49:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:48 smithi131 bash[24745]: audit 2024-09-13T22:49:47.444554+0000 mgr.a (mgr.14355) 1251 : audit [DBG] from='client.39957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:48 smithi171 bash[25040]: cluster 2024-09-13T22:49:46.883799+0000 mgr.a (mgr.14355) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:49:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:48 smithi171 bash[25040]: audit 2024-09-13T22:49:47.444554+0000 mgr.a (mgr.14355) 1251 : audit [DBG] from='client.39957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:50 smithi007 bash[22722]: cluster 2024-09-13T22:49:48.884753+0000 mgr.a (mgr.14355) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:50 smithi131 bash[24745]: cluster 2024-09-13T22:49:48.884753+0000 mgr.a (mgr.14355) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:50.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:50 smithi171 bash[25040]: cluster 2024-09-13T22:49:48.884753+0000 mgr.a (mgr.14355) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:52 smithi007 bash[22722]: cluster 2024-09-13T22:49:50.886983+0000 mgr.a (mgr.14355) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:52 smithi131 bash[24745]: cluster 2024-09-13T22:49:50.886983+0000 mgr.a (mgr.14355) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:52.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:52 smithi171 bash[25040]: cluster 2024-09-13T22:49:50.886983+0000 mgr.a (mgr.14355) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:53.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:53.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:53.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:53.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:53.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:49:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:54 smithi007 bash[22722]: cluster 2024-09-13T22:49:52.887810+0000 mgr.a (mgr.14355) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:54 smithi007 bash[22722]: audit 2024-09-13T22:49:53.212976+0000 mgr.a (mgr.14355) 1255 : audit [DBG] from='client.40035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:54 smithi131 bash[24745]: cluster 2024-09-13T22:49:52.887810+0000 mgr.a (mgr.14355) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:54 smithi131 bash[24745]: audit 2024-09-13T22:49:53.212976+0000 mgr.a (mgr.14355) 1255 : audit [DBG] from='client.40035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:54.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:54 smithi171 bash[25040]: cluster 2024-09-13T22:49:52.887810+0000 mgr.a (mgr.14355) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:54.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:54 smithi171 bash[25040]: audit 2024-09-13T22:49:53.212976+0000 mgr.a (mgr.14355) 1255 : audit [DBG] from='client.40035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:56 smithi131 bash[24745]: cluster 2024-09-13T22:49:54.888772+0000 mgr.a (mgr.14355) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:56.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:56 smithi171 bash[25040]: cluster 2024-09-13T22:49:54.888772+0000 mgr.a (mgr.14355) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:56 smithi007 bash[22722]: cluster 2024-09-13T22:49:54.888772+0000 mgr.a (mgr.14355) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:49:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:49:58 smithi131 bash[24745]: cluster 2024-09-13T22:49:56.891226+0000 mgr.a (mgr.14355) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:49:58 smithi171 bash[25040]: cluster 2024-09-13T22:49:56.891226+0000 mgr.a (mgr.14355) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:49:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:49:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:49:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:49:58 smithi007 bash[22722]: cluster 2024-09-13T22:49:56.891226+0000 mgr.a (mgr.14355) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:49:59.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:49:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:49:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:49:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:49:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:00 smithi131 bash[24745]: cluster 2024-09-13T22:49:58.892073+0000 mgr.a (mgr.14355) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:00 smithi131 bash[24745]: audit 2024-09-13T22:49:58.980147+0000 mgr.a (mgr.14355) 1259 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:00 smithi131 bash[24745]: cluster 2024-09-13T22:50:00.000159+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:50:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:00 smithi171 bash[25040]: cluster 2024-09-13T22:49:58.892073+0000 mgr.a (mgr.14355) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:00 smithi171 bash[25040]: audit 2024-09-13T22:49:58.980147+0000 mgr.a (mgr.14355) 1259 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:00 smithi171 bash[25040]: cluster 2024-09-13T22:50:00.000159+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:50:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:00 smithi007 bash[22722]: cluster 2024-09-13T22:49:58.892073+0000 mgr.a (mgr.14355) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:00 smithi007 bash[22722]: audit 2024-09-13T22:49:58.980147+0000 mgr.a (mgr.14355) 1259 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:00 smithi007 bash[22722]: cluster 2024-09-13T22:50:00.000159+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T22:50:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:02 smithi131 bash[24745]: cluster 2024-09-13T22:50:00.894432+0000 mgr.a (mgr.14355) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:02.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:02 smithi171 bash[25040]: cluster 2024-09-13T22:50:00.894432+0000 mgr.a (mgr.14355) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:02 smithi007 bash[22722]: cluster 2024-09-13T22:50:00.894432+0000 mgr.a (mgr.14355) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:04 smithi131 bash[24745]: cluster 2024-09-13T22:50:02.895204+0000 mgr.a (mgr.14355) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:04 smithi171 bash[25040]: cluster 2024-09-13T22:50:02.895204+0000 mgr.a (mgr.14355) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:04 smithi007 bash[22722]: cluster 2024-09-13T22:50:02.895204+0000 mgr.a (mgr.14355) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:05.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:05.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:06 smithi131 bash[24745]: audit 2024-09-13T22:50:04.730802+0000 mgr.a (mgr.14355) 1262 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:06.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:06 smithi131 bash[24745]: cluster 2024-09-13T22:50:04.895794+0000 mgr.a (mgr.14355) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:06 smithi171 bash[25040]: audit 2024-09-13T22:50:04.730802+0000 mgr.a (mgr.14355) 1262 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:06 smithi171 bash[25040]: cluster 2024-09-13T22:50:04.895794+0000 mgr.a (mgr.14355) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:06 smithi007 bash[22722]: audit 2024-09-13T22:50:04.730802+0000 mgr.a (mgr.14355) 1262 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:06 smithi007 bash[22722]: cluster 2024-09-13T22:50:04.895794+0000 mgr.a (mgr.14355) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:08 smithi131 bash[24745]: cluster 2024-09-13T22:50:06.898277+0000 mgr.a (mgr.14355) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:08 smithi171 bash[25040]: cluster 2024-09-13T22:50:06.898277+0000 mgr.a (mgr.14355) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:08 smithi007 bash[22722]: cluster 2024-09-13T22:50:06.898277+0000 mgr.a (mgr.14355) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:10.152 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:10.152 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:10 smithi131 bash[24745]: cluster 2024-09-13T22:50:08.899277+0000 mgr.a (mgr.14355) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:10 smithi171 bash[25040]: cluster 2024-09-13T22:50:08.899277+0000 mgr.a (mgr.14355) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:10 smithi007 bash[22722]: cluster 2024-09-13T22:50:08.899277+0000 mgr.a (mgr.14355) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:10.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:10.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:11 smithi131 bash[24745]: audit 2024-09-13T22:50:10.803153+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:11.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:11 smithi171 bash[25040]: audit 2024-09-13T22:50:10.803153+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:11 smithi007 bash[22722]: audit 2024-09-13T22:50:10.803153+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:12 smithi131 bash[24745]: audit 2024-09-13T22:50:10.479230+0000 mgr.a (mgr.14355) 1266 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:12 smithi131 bash[24745]: cluster 2024-09-13T22:50:10.900489+0000 mgr.a (mgr.14355) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:12 smithi171 bash[25040]: audit 2024-09-13T22:50:10.479230+0000 mgr.a (mgr.14355) 1266 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:12 smithi171 bash[25040]: cluster 2024-09-13T22:50:10.900489+0000 mgr.a (mgr.14355) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:12 smithi007 bash[22722]: audit 2024-09-13T22:50:10.479230+0000 mgr.a (mgr.14355) 1266 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:12 smithi007 bash[22722]: cluster 2024-09-13T22:50:10.900489+0000 mgr.a (mgr.14355) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:14 smithi131 bash[24745]: cluster 2024-09-13T22:50:12.901201+0000 mgr.a (mgr.14355) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:14.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:14 smithi171 bash[25040]: cluster 2024-09-13T22:50:12.901201+0000 mgr.a (mgr.14355) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:14 smithi007 bash[22722]: cluster 2024-09-13T22:50:12.901201+0000 mgr.a (mgr.14355) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:15.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:15.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:15.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:16 smithi131 bash[24745]: cluster 2024-09-13T22:50:14.901980+0000 mgr.a (mgr.14355) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:16.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:16 smithi171 bash[25040]: cluster 2024-09-13T22:50:14.901980+0000 mgr.a (mgr.14355) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:16.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:16.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:16.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:16.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:16.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:16 smithi007 bash[22722]: cluster 2024-09-13T22:50:14.901980+0000 mgr.a (mgr.14355) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:17.517 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:17 smithi171 bash[25040]: audit 2024-09-13T22:50:16.228979+0000 mgr.a (mgr.14355) 1270 : audit [DBG] from='client.40338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:17.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:17 smithi131 bash[24745]: audit 2024-09-13T22:50:16.228979+0000 mgr.a (mgr.14355) 1270 : audit [DBG] from='client.40338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:17.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:17 smithi007 bash[22722]: audit 2024-09-13T22:50:16.228979+0000 mgr.a (mgr.14355) 1270 : audit [DBG] from='client.40338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:18 smithi131 bash[24745]: cluster 2024-09-13T22:50:16.904783+0000 mgr.a (mgr.14355) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:18.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:18 smithi171 bash[25040]: cluster 2024-09-13T22:50:16.904783+0000 mgr.a (mgr.14355) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:18 smithi007 bash[22722]: cluster 2024-09-13T22:50:16.904783+0000 mgr.a (mgr.14355) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:20 smithi131 bash[24745]: cluster 2024-09-13T22:50:18.905546+0000 mgr.a (mgr.14355) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:20 smithi171 bash[25040]: cluster 2024-09-13T22:50:18.905546+0000 mgr.a (mgr.14355) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:20 smithi007 bash[22722]: cluster 2024-09-13T22:50:18.905546+0000 mgr.a (mgr.14355) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:21.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:21.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:21.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22972]: debug 2024-09-13T22:50:21.659+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:50:21.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22972]: debug 2024-09-13T22:50:21.659+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:50:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.788544+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.797307+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.866094+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.874645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.877609+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.879461+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.890154+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.895374+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: audit 2024-09-13T22:50:20.897648+0000 mgr.a (mgr.14355) 1273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:21 smithi007 bash[22722]: cluster 2024-09-13T22:50:20.921244+0000 mgr.a (mgr.14355) 1274 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.788544+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.797307+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.866094+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.874645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.877609+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.879461+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.890154+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.895374+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: audit 2024-09-13T22:50:20.897648+0000 mgr.a (mgr.14355) 1273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:21 smithi171 bash[25040]: cluster 2024-09-13T22:50:20.921244+0000 mgr.a (mgr.14355) 1274 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.788544+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.797307+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.866094+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.874645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.877609+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.879461+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.890154+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.895374+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:22.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: audit 2024-09-13T22:50:20.897648+0000 mgr.a (mgr.14355) 1273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:50:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:21 smithi131 bash[24745]: cluster 2024-09-13T22:50:20.921244+0000 mgr.a (mgr.14355) 1274 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:22.366 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:22.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:23.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:22 smithi007 bash[22722]: audit 2024-09-13T22:50:21.663239+0000 mgr.a (mgr.14355) 1275 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:50:23.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:22 smithi007 bash[22722]: cephadm 2024-09-13T22:50:21.664518+0000 mgr.a (mgr.14355) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:50:23.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:22 smithi007 bash[22722]: audit 2024-09-13T22:50:21.964814+0000 mgr.a (mgr.14355) 1277 : audit [DBG] from='client.40524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:23.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:22 smithi131 bash[24745]: audit 2024-09-13T22:50:21.663239+0000 mgr.a (mgr.14355) 1275 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:50:23.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:22 smithi131 bash[24745]: cephadm 2024-09-13T22:50:21.664518+0000 mgr.a (mgr.14355) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:50:23.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:22 smithi131 bash[24745]: audit 2024-09-13T22:50:21.964814+0000 mgr.a (mgr.14355) 1277 : audit [DBG] from='client.40524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:23.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:22 smithi171 bash[25040]: audit 2024-09-13T22:50:21.663239+0000 mgr.a (mgr.14355) 1275 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:50:23.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:22 smithi171 bash[25040]: cephadm 2024-09-13T22:50:21.664518+0000 mgr.a (mgr.14355) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:50:23.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:22 smithi171 bash[25040]: audit 2024-09-13T22:50:21.964814+0000 mgr.a (mgr.14355) 1277 : audit [DBG] from='client.40524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:23 smithi007 bash[22722]: cluster 2024-09-13T22:50:22.922257+0000 mgr.a (mgr.14355) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:24.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:23 smithi131 bash[24745]: cluster 2024-09-13T22:50:22.922257+0000 mgr.a (mgr.14355) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:24.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:23 smithi171 bash[25040]: cluster 2024-09-13T22:50:22.922257+0000 mgr.a (mgr.14355) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:26.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:25 smithi131 bash[24745]: cluster 2024-09-13T22:50:24.923073+0000 mgr.a (mgr.14355) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:26.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:25 smithi171 bash[25040]: cluster 2024-09-13T22:50:24.923073+0000 mgr.a (mgr.14355) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:25 smithi007 bash[22722]: cluster 2024-09-13T22:50:24.923073+0000 mgr.a (mgr.14355) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:27.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:28.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:28.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:28.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:28.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:28.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:28.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:27 smithi131 bash[24745]: cluster 2024-09-13T22:50:26.925289+0000 mgr.a (mgr.14355) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:28.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:27 smithi171 bash[25040]: cluster 2024-09-13T22:50:26.925289+0000 mgr.a (mgr.14355) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:27 smithi007 bash[22722]: cluster 2024-09-13T22:50:26.925289+0000 mgr.a (mgr.14355) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:29.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:28 smithi131 bash[24745]: audit 2024-09-13T22:50:27.707631+0000 mgr.a (mgr.14355) 1281 : audit [DBG] from='client.40602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:29.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:28 smithi171 bash[25040]: audit 2024-09-13T22:50:27.707631+0000 mgr.a (mgr.14355) 1281 : audit [DBG] from='client.40602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:29.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:28 smithi007 bash[22722]: audit 2024-09-13T22:50:27.707631+0000 mgr.a (mgr.14355) 1281 : audit [DBG] from='client.40602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:30.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:29 smithi131 bash[24745]: cluster 2024-09-13T22:50:28.926227+0000 mgr.a (mgr.14355) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:30.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:29 smithi171 bash[25040]: cluster 2024-09-13T22:50:28.926227+0000 mgr.a (mgr.14355) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:29 smithi007 bash[22722]: cluster 2024-09-13T22:50:28.926227+0000 mgr.a (mgr.14355) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:32.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:31 smithi131 bash[24745]: cluster 2024-09-13T22:50:30.928453+0000 mgr.a (mgr.14355) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:31 smithi171 bash[25040]: cluster 2024-09-13T22:50:30.928453+0000 mgr.a (mgr.14355) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:31 smithi007 bash[22722]: cluster 2024-09-13T22:50:30.928453+0000 mgr.a (mgr.14355) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T22:50:33.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:33.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:33.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:33.887 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:34.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:34 smithi131 bash[24745]: cluster 2024-09-13T22:50:32.929259+0000 mgr.a (mgr.14355) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:34.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:34 smithi171 bash[25040]: cluster 2024-09-13T22:50:32.929259+0000 mgr.a (mgr.14355) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:34 smithi007 bash[22722]: cluster 2024-09-13T22:50:32.929259+0000 mgr.a (mgr.14355) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:35.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:35 smithi131 bash[24745]: audit 2024-09-13T22:50:33.468404+0000 mgr.a (mgr.14355) 1285 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:35 smithi171 bash[25040]: audit 2024-09-13T22:50:33.468404+0000 mgr.a (mgr.14355) 1285 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:35.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:35 smithi007 bash[22722]: audit 2024-09-13T22:50:33.468404+0000 mgr.a (mgr.14355) 1285 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:36.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:36 smithi131 bash[24745]: cluster 2024-09-13T22:50:34.930182+0000 mgr.a (mgr.14355) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:36.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:36 smithi171 bash[25040]: cluster 2024-09-13T22:50:34.930182+0000 mgr.a (mgr.14355) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:36 smithi007 bash[22722]: cluster 2024-09-13T22:50:34.930182+0000 mgr.a (mgr.14355) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:38.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:38 smithi131 bash[24745]: cluster 2024-09-13T22:50:36.932416+0000 mgr.a (mgr.14355) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:38.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:38 smithi171 bash[25040]: cluster 2024-09-13T22:50:36.932416+0000 mgr.a (mgr.14355) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:38 smithi007 bash[22722]: cluster 2024-09-13T22:50:36.932416+0000 mgr.a (mgr.14355) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:50:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:38.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:39.659 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:40 smithi131 bash[24745]: cluster 2024-09-13T22:50:38.933021+0000 mgr.a (mgr.14355) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:40 smithi131 bash[24745]: audit 2024-09-13T22:50:39.235423+0000 mgr.a (mgr.14355) 1289 : audit [DBG] from='client.40752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:40.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:40 smithi171 bash[25040]: cluster 2024-09-13T22:50:38.933021+0000 mgr.a (mgr.14355) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:40.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:40 smithi171 bash[25040]: audit 2024-09-13T22:50:39.235423+0000 mgr.a (mgr.14355) 1289 : audit [DBG] from='client.40752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:40 smithi007 bash[22722]: cluster 2024-09-13T22:50:38.933021+0000 mgr.a (mgr.14355) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:40 smithi007 bash[22722]: audit 2024-09-13T22:50:39.235423+0000 mgr.a (mgr.14355) 1289 : audit [DBG] from='client.40752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:42.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:42 smithi131 bash[24745]: cluster 2024-09-13T22:50:40.935333+0000 mgr.a (mgr.14355) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:42.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:42 smithi171 bash[25040]: cluster 2024-09-13T22:50:40.935333+0000 mgr.a (mgr.14355) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:42 smithi007 bash[22722]: cluster 2024-09-13T22:50:40.935333+0000 mgr.a (mgr.14355) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:50:44.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:44 smithi131 bash[24745]: cluster 2024-09-13T22:50:42.936111+0000 mgr.a (mgr.14355) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:44.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:44 smithi171 bash[25040]: cluster 2024-09-13T22:50:42.936111+0000 mgr.a (mgr.14355) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:44 smithi007 bash[22722]: cluster 2024-09-13T22:50:42.936111+0000 mgr.a (mgr.14355) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:45.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:45.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:46 smithi007 bash[22722]: cluster 2024-09-13T22:50:44.936844+0000 mgr.a (mgr.14355) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:46 smithi007 bash[22722]: audit 2024-09-13T22:50:44.994206+0000 mgr.a (mgr.14355) 1293 : audit [DBG] from='client.40830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:46 smithi131 bash[24745]: cluster 2024-09-13T22:50:44.936844+0000 mgr.a (mgr.14355) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:46 smithi131 bash[24745]: audit 2024-09-13T22:50:44.994206+0000 mgr.a (mgr.14355) 1293 : audit [DBG] from='client.40830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:46 smithi171 bash[25040]: cluster 2024-09-13T22:50:44.936844+0000 mgr.a (mgr.14355) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:46 smithi171 bash[25040]: audit 2024-09-13T22:50:44.994206+0000 mgr.a (mgr.14355) 1293 : audit [DBG] from='client.40830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:48 smithi007 bash[22722]: cluster 2024-09-13T22:50:46.939251+0000 mgr.a (mgr.14355) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:50:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:48 smithi131 bash[24745]: cluster 2024-09-13T22:50:46.939251+0000 mgr.a (mgr.14355) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:50:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:48 smithi171 bash[25040]: cluster 2024-09-13T22:50:46.939251+0000 mgr.a (mgr.14355) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-13T22:50:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:50 smithi007 bash[22722]: cluster 2024-09-13T22:50:48.940187+0000 mgr.a (mgr.14355) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:50:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:50 smithi131 bash[24745]: cluster 2024-09-13T22:50:48.940187+0000 mgr.a (mgr.14355) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:50:50.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:50 smithi171 bash[25040]: cluster 2024-09-13T22:50:48.940187+0000 mgr.a (mgr.14355) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T22:50:51.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:51.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:52 smithi007 bash[22722]: audit 2024-09-13T22:50:50.746862+0000 mgr.a (mgr.14355) 1296 : audit [DBG] from='client.40908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:52 smithi007 bash[22722]: cluster 2024-09-13T22:50:50.941624+0000 mgr.a (mgr.14355) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:52 smithi131 bash[24745]: audit 2024-09-13T22:50:50.746862+0000 mgr.a (mgr.14355) 1296 : audit [DBG] from='client.40908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:52.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:52 smithi131 bash[24745]: cluster 2024-09-13T22:50:50.941624+0000 mgr.a (mgr.14355) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:52.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:52 smithi171 bash[25040]: audit 2024-09-13T22:50:50.746862+0000 mgr.a (mgr.14355) 1296 : audit [DBG] from='client.40908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:52.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:52 smithi171 bash[25040]: cluster 2024-09-13T22:50:50.941624+0000 mgr.a (mgr.14355) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:54 smithi007 bash[22722]: cluster 2024-09-13T22:50:52.942530+0000 mgr.a (mgr.14355) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:54 smithi131 bash[24745]: cluster 2024-09-13T22:50:52.942530+0000 mgr.a (mgr.14355) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:54.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:54 smithi171 bash[25040]: cluster 2024-09-13T22:50:52.942530+0000 mgr.a (mgr.14355) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:50:56.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:50:56.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:50:56.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:50:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:56 smithi007 bash[22722]: cluster 2024-09-13T22:50:54.943312+0000 mgr.a (mgr.14355) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:56 smithi131 bash[24745]: cluster 2024-09-13T22:50:54.943312+0000 mgr.a (mgr.14355) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:56.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:56 smithi171 bash[25040]: cluster 2024-09-13T22:50:54.943312+0000 mgr.a (mgr.14355) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:50:56.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:50:56.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:50:56.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:50:56.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:50:56.957 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:50:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:58 smithi007 bash[22722]: audit 2024-09-13T22:50:56.513983+0000 mgr.a (mgr.14355) 1300 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:50:58 smithi007 bash[22722]: cluster 2024-09-13T22:50:56.944587+0000 mgr.a (mgr.14355) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:58 smithi131 bash[24745]: audit 2024-09-13T22:50:56.513983+0000 mgr.a (mgr.14355) 1300 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:58.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:50:58 smithi131 bash[24745]: cluster 2024-09-13T22:50:56.944587+0000 mgr.a (mgr.14355) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:50:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:58 smithi171 bash[25040]: audit 2024-09-13T22:50:56.513983+0000 mgr.a (mgr.14355) 1300 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:50:58 smithi171 bash[25040]: cluster 2024-09-13T22:50:56.944587+0000 mgr.a (mgr.14355) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:00 smithi007 bash[22722]: cluster 2024-09-13T22:50:58.945326+0000 mgr.a (mgr.14355) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:51:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:00 smithi131 bash[24745]: cluster 2024-09-13T22:50:58.945326+0000 mgr.a (mgr.14355) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:51:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:00 smithi171 bash[25040]: cluster 2024-09-13T22:50:58.945326+0000 mgr.a (mgr.14355) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:51:01.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:01.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:01.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:02 smithi007 bash[22722]: cluster 2024-09-13T22:51:00.947296+0000 mgr.a (mgr.14355) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:51:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:02 smithi131 bash[24745]: cluster 2024-09-13T22:51:00.947296+0000 mgr.a (mgr.14355) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:51:02.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:02 smithi171 bash[25040]: cluster 2024-09-13T22:51:00.947296+0000 mgr.a (mgr.14355) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T22:51:02.743 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:03 smithi007 bash[22722]: audit 2024-09-13T22:51:02.296304+0000 mgr.a (mgr.14355) 1304 : audit [DBG] from='client.41061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:03 smithi131 bash[24745]: audit 2024-09-13T22:51:02.296304+0000 mgr.a (mgr.14355) 1304 : audit [DBG] from='client.41061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:03 smithi171 bash[25040]: audit 2024-09-13T22:51:02.296304+0000 mgr.a (mgr.14355) 1304 : audit [DBG] from='client.41061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:04 smithi007 bash[22722]: cluster 2024-09-13T22:51:02.948303+0000 mgr.a (mgr.14355) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:04 smithi131 bash[24745]: cluster 2024-09-13T22:51:02.948303+0000 mgr.a (mgr.14355) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:04 smithi171 bash[25040]: cluster 2024-09-13T22:51:02.948303+0000 mgr.a (mgr.14355) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:06 smithi007 bash[22722]: cluster 2024-09-13T22:51:04.949259+0000 mgr.a (mgr.14355) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:06 smithi131 bash[24745]: cluster 2024-09-13T22:51:04.949259+0000 mgr.a (mgr.14355) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:06 smithi171 bash[25040]: cluster 2024-09-13T22:51:04.949259+0000 mgr.a (mgr.14355) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:07.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:07.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:08 smithi007 bash[22722]: cluster 2024-09-13T22:51:06.951593+0000 mgr.a (mgr.14355) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:08.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:08 smithi131 bash[24745]: cluster 2024-09-13T22:51:06.951593+0000 mgr.a (mgr.14355) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:08 smithi171 bash[25040]: cluster 2024-09-13T22:51:06.951593+0000 mgr.a (mgr.14355) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:09.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:09 smithi007 bash[22722]: audit 2024-09-13T22:51:08.077995+0000 mgr.a (mgr.14355) 1308 : audit [DBG] from='client.41133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:09.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:09 smithi131 bash[24745]: audit 2024-09-13T22:51:08.077995+0000 mgr.a (mgr.14355) 1308 : audit [DBG] from='client.41133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:09.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:09 smithi171 bash[25040]: audit 2024-09-13T22:51:08.077995+0000 mgr.a (mgr.14355) 1308 : audit [DBG] from='client.41133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:10 smithi007 bash[22722]: cluster 2024-09-13T22:51:08.952549+0000 mgr.a (mgr.14355) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:10 smithi131 bash[24745]: cluster 2024-09-13T22:51:08.952549+0000 mgr.a (mgr.14355) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:10 smithi171 bash[25040]: cluster 2024-09-13T22:51:08.952549+0000 mgr.a (mgr.14355) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:12 smithi007 bash[22722]: cluster 2024-09-13T22:51:10.954746+0000 mgr.a (mgr.14355) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:12 smithi131 bash[24745]: cluster 2024-09-13T22:51:10.954746+0000 mgr.a (mgr.14355) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:12.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:12 smithi171 bash[25040]: cluster 2024-09-13T22:51:10.954746+0000 mgr.a (mgr.14355) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:13.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:14.268 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:14.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:14 smithi007 bash[22722]: cluster 2024-09-13T22:51:12.955506+0000 mgr.a (mgr.14355) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:14 smithi131 bash[24745]: cluster 2024-09-13T22:51:12.955506+0000 mgr.a (mgr.14355) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:14 smithi171 bash[25040]: cluster 2024-09-13T22:51:12.955506+0000 mgr.a (mgr.14355) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:15.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:15 smithi007 bash[22722]: audit 2024-09-13T22:51:13.828304+0000 mgr.a (mgr.14355) 1312 : audit [DBG] from='client.41211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:15.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:15 smithi131 bash[24745]: audit 2024-09-13T22:51:13.828304+0000 mgr.a (mgr.14355) 1312 : audit [DBG] from='client.41211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:15.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:15 smithi171 bash[25040]: audit 2024-09-13T22:51:13.828304+0000 mgr.a (mgr.14355) 1312 : audit [DBG] from='client.41211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:16.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:16 smithi007 bash[22722]: cluster 2024-09-13T22:51:14.956602+0000 mgr.a (mgr.14355) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:16 smithi131 bash[24745]: cluster 2024-09-13T22:51:14.956602+0000 mgr.a (mgr.14355) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:16.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:16 smithi171 bash[25040]: cluster 2024-09-13T22:51:14.956602+0000 mgr.a (mgr.14355) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:18.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:18 smithi007 bash[22722]: cluster 2024-09-13T22:51:16.959008+0000 mgr.a (mgr.14355) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:18 smithi131 bash[24745]: cluster 2024-09-13T22:51:16.959008+0000 mgr.a (mgr.14355) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:18.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:18 smithi171 bash[25040]: cluster 2024-09-13T22:51:16.959008+0000 mgr.a (mgr.14355) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:19.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:19.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:19.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:20.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:20 smithi007 bash[22722]: cluster 2024-09-13T22:51:18.959958+0000 mgr.a (mgr.14355) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:20 smithi131 bash[24745]: cluster 2024-09-13T22:51:18.959958+0000 mgr.a (mgr.14355) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:20 smithi171 bash[25040]: cluster 2024-09-13T22:51:18.959958+0000 mgr.a (mgr.14355) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:21.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:21 smithi007 bash[22722]: audit 2024-09-13T22:51:19.595239+0000 mgr.a (mgr.14355) 1316 : audit [DBG] from='client.41289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:21.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:21 smithi131 bash[24745]: audit 2024-09-13T22:51:19.595239+0000 mgr.a (mgr.14355) 1316 : audit [DBG] from='client.41289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:21.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:21 smithi171 bash[25040]: audit 2024-09-13T22:51:19.595239+0000 mgr.a (mgr.14355) 1316 : audit [DBG] from='client.41289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:22 smithi007 bash[22722]: cluster 2024-09-13T22:51:20.962234+0000 mgr.a (mgr.14355) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:22 smithi007 bash[22722]: audit 2024-09-13T22:51:21.718610+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:22 smithi131 bash[24745]: cluster 2024-09-13T22:51:20.962234+0000 mgr.a (mgr.14355) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:22 smithi131 bash[24745]: audit 2024-09-13T22:51:21.718610+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:22.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:22 smithi171 bash[25040]: cluster 2024-09-13T22:51:20.962234+0000 mgr.a (mgr.14355) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:22.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:22 smithi171 bash[25040]: audit 2024-09-13T22:51:21.718610+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:23.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22972]: debug 2024-09-13T22:51:23.294+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:51:23.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22972]: debug 2024-09-13T22:51:23.294+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22722]: audit 2024-09-13T22:51:22.558045+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22722]: audit 2024-09-13T22:51:22.559895+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22722]: audit 2024-09-13T22:51:22.570340+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:23 smithi007 bash[22722]: audit 2024-09-13T22:51:22.575135+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:23.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:23 smithi131 bash[24745]: audit 2024-09-13T22:51:22.558045+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:23 smithi131 bash[24745]: audit 2024-09-13T22:51:22.559895+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:23 smithi131 bash[24745]: audit 2024-09-13T22:51:22.570340+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:51:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:23 smithi131 bash[24745]: audit 2024-09-13T22:51:22.575135+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:23.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:23 smithi171 bash[25040]: audit 2024-09-13T22:51:22.558045+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:23.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:23 smithi171 bash[25040]: audit 2024-09-13T22:51:22.559895+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:23.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:23 smithi171 bash[25040]: audit 2024-09-13T22:51:22.570340+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:51:23.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:23 smithi171 bash[25040]: audit 2024-09-13T22:51:22.575135+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:24.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:24 smithi007 bash[22722]: audit 2024-09-13T22:51:22.577434+0000 mgr.a (mgr.14355) 1318 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:24.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:24 smithi007 bash[22722]: cluster 2024-09-13T22:51:22.962802+0000 mgr.a (mgr.14355) 1319 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:24 smithi007 bash[22722]: audit 2024-09-13T22:51:23.300680+0000 mgr.a (mgr.14355) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:51:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:24 smithi007 bash[22722]: cephadm 2024-09-13T22:51:23.302130+0000 mgr.a (mgr.14355) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:51:24.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:24 smithi131 bash[24745]: audit 2024-09-13T22:51:22.577434+0000 mgr.a (mgr.14355) 1318 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:24.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:24 smithi131 bash[24745]: cluster 2024-09-13T22:51:22.962802+0000 mgr.a (mgr.14355) 1319 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:24.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:24 smithi131 bash[24745]: audit 2024-09-13T22:51:23.300680+0000 mgr.a (mgr.14355) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:51:24.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:24 smithi131 bash[24745]: cephadm 2024-09-13T22:51:23.302130+0000 mgr.a (mgr.14355) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:51:24.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:24 smithi171 bash[25040]: audit 2024-09-13T22:51:22.577434+0000 mgr.a (mgr.14355) 1318 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:51:24.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:24 smithi171 bash[25040]: cluster 2024-09-13T22:51:22.962802+0000 mgr.a (mgr.14355) 1319 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:24.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:24 smithi171 bash[25040]: audit 2024-09-13T22:51:23.300680+0000 mgr.a (mgr.14355) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:51:24.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:24 smithi171 bash[25040]: cephadm 2024-09-13T22:51:23.302130+0000 mgr.a (mgr.14355) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:51:25.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:25.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:25.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:25.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:25.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:25.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:25.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:25.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:26 smithi007 bash[22722]: cluster 2024-09-13T22:51:24.963612+0000 mgr.a (mgr.14355) 1322 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:26 smithi007 bash[22722]: audit 2024-09-13T22:51:25.350116+0000 mgr.a (mgr.14355) 1323 : audit [DBG] from='client.41475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:26 smithi131 bash[24745]: cluster 2024-09-13T22:51:24.963612+0000 mgr.a (mgr.14355) 1322 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:26.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:26 smithi131 bash[24745]: audit 2024-09-13T22:51:25.350116+0000 mgr.a (mgr.14355) 1323 : audit [DBG] from='client.41475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:26 smithi171 bash[25040]: cluster 2024-09-13T22:51:24.963612+0000 mgr.a (mgr.14355) 1322 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:26 smithi171 bash[25040]: audit 2024-09-13T22:51:25.350116+0000 mgr.a (mgr.14355) 1323 : audit [DBG] from='client.41475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:28 smithi007 bash[22722]: cluster 2024-09-13T22:51:26.966438+0000 mgr.a (mgr.14355) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:28.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:28 smithi131 bash[24745]: cluster 2024-09-13T22:51:26.966438+0000 mgr.a (mgr.14355) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:28.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:28 smithi171 bash[25040]: cluster 2024-09-13T22:51:26.966438+0000 mgr.a (mgr.14355) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:30 smithi007 bash[22722]: cluster 2024-09-13T22:51:28.967389+0000 mgr.a (mgr.14355) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:30 smithi131 bash[24745]: cluster 2024-09-13T22:51:28.967389+0000 mgr.a (mgr.14355) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:30.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:30 smithi171 bash[25040]: cluster 2024-09-13T22:51:28.967389+0000 mgr.a (mgr.14355) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:30.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:30.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:31.558 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:32 smithi007 bash[22722]: cluster 2024-09-13T22:51:30.969513+0000 mgr.a (mgr.14355) 1326 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:32 smithi007 bash[22722]: audit 2024-09-13T22:51:31.120152+0000 mgr.a (mgr.14355) 1327 : audit [DBG] from='client.41553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:32.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:32 smithi131 bash[24745]: cluster 2024-09-13T22:51:30.969513+0000 mgr.a (mgr.14355) 1326 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:32.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:32 smithi131 bash[24745]: audit 2024-09-13T22:51:31.120152+0000 mgr.a (mgr.14355) 1327 : audit [DBG] from='client.41553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:32.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:32 smithi171 bash[25040]: cluster 2024-09-13T22:51:30.969513+0000 mgr.a (mgr.14355) 1326 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:32.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:32 smithi171 bash[25040]: audit 2024-09-13T22:51:31.120152+0000 mgr.a (mgr.14355) 1327 : audit [DBG] from='client.41553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:34 smithi007 bash[22722]: cluster 2024-09-13T22:51:32.970496+0000 mgr.a (mgr.14355) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:34.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:34 smithi131 bash[24745]: cluster 2024-09-13T22:51:32.970496+0000 mgr.a (mgr.14355) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:34.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:34 smithi171 bash[25040]: cluster 2024-09-13T22:51:32.970496+0000 mgr.a (mgr.14355) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:36 smithi007 bash[22722]: cluster 2024-09-13T22:51:34.971282+0000 mgr.a (mgr.14355) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:36.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:36 smithi131 bash[24745]: cluster 2024-09-13T22:51:34.971282+0000 mgr.a (mgr.14355) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:36.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:36 smithi171 bash[25040]: cluster 2024-09-13T22:51:34.971282+0000 mgr.a (mgr.14355) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:51:36.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:36.560 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:36.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:37.320 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:37.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:37.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:37.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:37.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:38 smithi007 bash[22722]: audit 2024-09-13T22:51:36.898268+0000 mgr.a (mgr.14355) 1330 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:38 smithi007 bash[22722]: cluster 2024-09-13T22:51:36.972738+0000 mgr.a (mgr.14355) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:38.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:38 smithi131 bash[24745]: audit 2024-09-13T22:51:36.898268+0000 mgr.a (mgr.14355) 1330 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:38.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:38 smithi131 bash[24745]: cluster 2024-09-13T22:51:36.972738+0000 mgr.a (mgr.14355) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:38.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:38 smithi171 bash[25040]: audit 2024-09-13T22:51:36.898268+0000 mgr.a (mgr.14355) 1330 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:38.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:38 smithi171 bash[25040]: cluster 2024-09-13T22:51:36.972738+0000 mgr.a (mgr.14355) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:51:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:40 smithi007 bash[22722]: cluster 2024-09-13T22:51:38.973621+0000 mgr.a (mgr.14355) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:40.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:40 smithi131 bash[24745]: cluster 2024-09-13T22:51:38.973621+0000 mgr.a (mgr.14355) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:40.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:40 smithi171 bash[25040]: cluster 2024-09-13T22:51:38.973621+0000 mgr.a (mgr.14355) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:42.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:42.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:42 smithi007 bash[22722]: cluster 2024-09-13T22:51:40.975923+0000 mgr.a (mgr.14355) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:42.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:42 smithi131 bash[24745]: cluster 2024-09-13T22:51:40.975923+0000 mgr.a (mgr.14355) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:42.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:42 smithi171 bash[25040]: cluster 2024-09-13T22:51:40.975923+0000 mgr.a (mgr.14355) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:43.088 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:43.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:44 smithi007 bash[22722]: audit 2024-09-13T22:51:42.657776+0000 mgr.a (mgr.14355) 1334 : audit [DBG] from='client.41709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:44 smithi007 bash[22722]: cluster 2024-09-13T22:51:42.976432+0000 mgr.a (mgr.14355) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:44.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:44 smithi131 bash[24745]: audit 2024-09-13T22:51:42.657776+0000 mgr.a (mgr.14355) 1334 : audit [DBG] from='client.41709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:44.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:44 smithi131 bash[24745]: cluster 2024-09-13T22:51:42.976432+0000 mgr.a (mgr.14355) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:44.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:44 smithi171 bash[25040]: audit 2024-09-13T22:51:42.657776+0000 mgr.a (mgr.14355) 1334 : audit [DBG] from='client.41709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:44.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:44 smithi171 bash[25040]: cluster 2024-09-13T22:51:42.976432+0000 mgr.a (mgr.14355) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:46 smithi131 bash[24745]: cluster 2024-09-13T22:51:44.977321+0000 mgr.a (mgr.14355) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:46 smithi171 bash[25040]: cluster 2024-09-13T22:51:44.977321+0000 mgr.a (mgr.14355) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:46 smithi007 bash[22722]: cluster 2024-09-13T22:51:44.977321+0000 mgr.a (mgr.14355) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:48 smithi131 bash[24745]: cluster 2024-09-13T22:51:46.979635+0000 mgr.a (mgr.14355) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:48 smithi171 bash[25040]: cluster 2024-09-13T22:51:46.979635+0000 mgr.a (mgr.14355) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:48 smithi007 bash[22722]: cluster 2024-09-13T22:51:46.979635+0000 mgr.a (mgr.14355) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:48.839 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:48.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:48.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:48.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:48.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:49 smithi131 bash[24745]: audit 2024-09-13T22:51:48.420749+0000 mgr.a (mgr.14355) 1338 : audit [DBG] from='client.41787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:49.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:49 smithi171 bash[25040]: audit 2024-09-13T22:51:48.420749+0000 mgr.a (mgr.14355) 1338 : audit [DBG] from='client.41787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:49 smithi007 bash[22722]: audit 2024-09-13T22:51:48.420749+0000 mgr.a (mgr.14355) 1338 : audit [DBG] from='client.41787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:50 smithi131 bash[24745]: cluster 2024-09-13T22:51:48.980542+0000 mgr.a (mgr.14355) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:50.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:50 smithi171 bash[25040]: cluster 2024-09-13T22:51:48.980542+0000 mgr.a (mgr.14355) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:50 smithi007 bash[22722]: cluster 2024-09-13T22:51:48.980542+0000 mgr.a (mgr.14355) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:52 smithi131 bash[24745]: cluster 2024-09-13T22:51:50.982821+0000 mgr.a (mgr.14355) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:52.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:52 smithi171 bash[25040]: cluster 2024-09-13T22:51:50.982821+0000 mgr.a (mgr.14355) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:52 smithi007 bash[22722]: cluster 2024-09-13T22:51:50.982821+0000 mgr.a (mgr.14355) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:51:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:54 smithi131 bash[24745]: cluster 2024-09-13T22:51:52.983617+0000 mgr.a (mgr.14355) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:54 smithi171 bash[25040]: cluster 2024-09-13T22:51:52.983617+0000 mgr.a (mgr.14355) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:54.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:51:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:51:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:51:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:51:54.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:51:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:54 smithi007 bash[22722]: cluster 2024-09-13T22:51:52.983617+0000 mgr.a (mgr.14355) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:55.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:55 smithi131 bash[24745]: audit 2024-09-13T22:51:54.180541+0000 mgr.a (mgr.14355) 1342 : audit [DBG] from='client.41859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:55.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:55 smithi171 bash[25040]: audit 2024-09-13T22:51:54.180541+0000 mgr.a (mgr.14355) 1342 : audit [DBG] from='client.41859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:55.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:55 smithi007 bash[22722]: audit 2024-09-13T22:51:54.180541+0000 mgr.a (mgr.14355) 1342 : audit [DBG] from='client.41859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:56 smithi131 bash[24745]: cluster 2024-09-13T22:51:54.984544+0000 mgr.a (mgr.14355) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:56.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:56 smithi171 bash[25040]: cluster 2024-09-13T22:51:54.984544+0000 mgr.a (mgr.14355) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:56 smithi007 bash[22722]: cluster 2024-09-13T22:51:54.984544+0000 mgr.a (mgr.14355) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:51:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:51:58 smithi131 bash[24745]: cluster 2024-09-13T22:51:56.986877+0000 mgr.a (mgr.14355) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:51:58 smithi171 bash[25040]: cluster 2024-09-13T22:51:56.986877+0000 mgr.a (mgr.14355) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:51:58 smithi007 bash[22722]: cluster 2024-09-13T22:51:56.986877+0000 mgr.a (mgr.14355) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:51:59.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:51:59.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:51:59.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:00.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:00.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:00 smithi131 bash[24745]: cluster 2024-09-13T22:51:58.987759+0000 mgr.a (mgr.14355) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:00 smithi171 bash[25040]: cluster 2024-09-13T22:51:58.987759+0000 mgr.a (mgr.14355) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:00 smithi007 bash[22722]: cluster 2024-09-13T22:51:58.987759+0000 mgr.a (mgr.14355) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:01.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:01 smithi131 bash[24745]: audit 2024-09-13T22:51:59.951306+0000 mgr.a (mgr.14355) 1346 : audit [DBG] from='client.41937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:01.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:01 smithi171 bash[25040]: audit 2024-09-13T22:51:59.951306+0000 mgr.a (mgr.14355) 1346 : audit [DBG] from='client.41937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:01 smithi007 bash[22722]: audit 2024-09-13T22:51:59.951306+0000 mgr.a (mgr.14355) 1346 : audit [DBG] from='client.41937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:02 smithi131 bash[24745]: cluster 2024-09-13T22:52:00.990510+0000 mgr.a (mgr.14355) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:02 smithi171 bash[25040]: cluster 2024-09-13T22:52:00.990510+0000 mgr.a (mgr.14355) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:02 smithi007 bash[22722]: cluster 2024-09-13T22:52:00.990510+0000 mgr.a (mgr.14355) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:04 smithi131 bash[24745]: cluster 2024-09-13T22:52:02.991310+0000 mgr.a (mgr.14355) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:04 smithi171 bash[25040]: cluster 2024-09-13T22:52:02.991310+0000 mgr.a (mgr.14355) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:04 smithi007 bash[22722]: cluster 2024-09-13T22:52:02.991310+0000 mgr.a (mgr.14355) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:05.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:05.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:06.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:06.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:06 smithi131 bash[24745]: cluster 2024-09-13T22:52:04.992109+0000 mgr.a (mgr.14355) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:06 smithi171 bash[25040]: cluster 2024-09-13T22:52:04.992109+0000 mgr.a (mgr.14355) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:06 smithi007 bash[22722]: cluster 2024-09-13T22:52:04.992109+0000 mgr.a (mgr.14355) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:07 smithi131 bash[24745]: audit 2024-09-13T22:52:05.734069+0000 mgr.a (mgr.14355) 1350 : audit [DBG] from='client.42012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:07.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:07 smithi171 bash[25040]: audit 2024-09-13T22:52:05.734069+0000 mgr.a (mgr.14355) 1350 : audit [DBG] from='client.42012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:07.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:07 smithi007 bash[22722]: audit 2024-09-13T22:52:05.734069+0000 mgr.a (mgr.14355) 1350 : audit [DBG] from='client.42012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:08 smithi131 bash[24745]: cluster 2024-09-13T22:52:06.994907+0000 mgr.a (mgr.14355) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:08.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:08 smithi171 bash[25040]: cluster 2024-09-13T22:52:06.994907+0000 mgr.a (mgr.14355) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:08 smithi007 bash[22722]: cluster 2024-09-13T22:52:06.994907+0000 mgr.a (mgr.14355) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:10 smithi131 bash[24745]: cluster 2024-09-13T22:52:08.995703+0000 mgr.a (mgr.14355) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:10.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:10 smithi171 bash[25040]: cluster 2024-09-13T22:52:08.995703+0000 mgr.a (mgr.14355) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:10 smithi007 bash[22722]: cluster 2024-09-13T22:52:08.995703+0000 mgr.a (mgr.14355) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 0 B/s wr, 70 op/s 2024-09-13T22:52:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:11.917 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:11.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:11.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:11.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:11.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:12 smithi171 bash[25040]: cluster 2024-09-13T22:52:10.997702+0000 mgr.a (mgr.14355) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:12 smithi007 bash[22722]: cluster 2024-09-13T22:52:10.997702+0000 mgr.a (mgr.14355) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:12 smithi131 bash[24745]: cluster 2024-09-13T22:52:10.997702+0000 mgr.a (mgr.14355) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-09-13T22:52:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:13 smithi007 bash[22722]: audit 2024-09-13T22:52:11.509446+0000 mgr.a (mgr.14355) 1354 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:13 smithi131 bash[24745]: audit 2024-09-13T22:52:11.509446+0000 mgr.a (mgr.14355) 1354 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:13.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:13 smithi171 bash[25040]: audit 2024-09-13T22:52:11.509446+0000 mgr.a (mgr.14355) 1354 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:14 smithi007 bash[22722]: cluster 2024-09-13T22:52:12.998626+0000 mgr.a (mgr.14355) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:14 smithi131 bash[24745]: cluster 2024-09-13T22:52:12.998626+0000 mgr.a (mgr.14355) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:14 smithi171 bash[25040]: cluster 2024-09-13T22:52:12.998626+0000 mgr.a (mgr.14355) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:16 smithi007 bash[22722]: cluster 2024-09-13T22:52:14.999408+0000 mgr.a (mgr.14355) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:16 smithi131 bash[24745]: cluster 2024-09-13T22:52:14.999408+0000 mgr.a (mgr.14355) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:16 smithi171 bash[25040]: cluster 2024-09-13T22:52:14.999408+0000 mgr.a (mgr.14355) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:16.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:17.660 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:17.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:17.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:17.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:17.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:18 smithi007 bash[22722]: cluster 2024-09-13T22:52:17.001611+0000 mgr.a (mgr.14355) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:18 smithi007 bash[22722]: audit 2024-09-13T22:52:17.253753+0000 mgr.a (mgr.14355) 1358 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:18 smithi131 bash[24745]: cluster 2024-09-13T22:52:17.001611+0000 mgr.a (mgr.14355) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:18 smithi131 bash[24745]: audit 2024-09-13T22:52:17.253753+0000 mgr.a (mgr.14355) 1358 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:18 smithi171 bash[25040]: cluster 2024-09-13T22:52:17.001611+0000 mgr.a (mgr.14355) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:18.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:18 smithi171 bash[25040]: audit 2024-09-13T22:52:17.253753+0000 mgr.a (mgr.14355) 1358 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:20 smithi007 bash[22722]: cluster 2024-09-13T22:52:19.002527+0000 mgr.a (mgr.14355) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:20.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:20 smithi131 bash[24745]: cluster 2024-09-13T22:52:19.002527+0000 mgr.a (mgr.14355) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:20 smithi171 bash[25040]: cluster 2024-09-13T22:52:19.002527+0000 mgr.a (mgr.14355) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:22.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:22 smithi007 bash[22722]: cluster 2024-09-13T22:52:21.004711+0000 mgr.a (mgr.14355) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:22 smithi131 bash[24745]: cluster 2024-09-13T22:52:21.004711+0000 mgr.a (mgr.14355) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:22 smithi171 bash[25040]: cluster 2024-09-13T22:52:21.004711+0000 mgr.a (mgr.14355) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:23.396 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:23.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:23.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:24 smithi007 bash[22722]: audit 2024-09-13T22:52:22.987075+0000 mgr.a (mgr.14355) 1361 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:24 smithi007 bash[22722]: cluster 2024-09-13T22:52:23.005764+0000 mgr.a (mgr.14355) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:24 smithi007 bash[22722]: audit 2024-09-13T22:52:23.354726+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:52:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:24 smithi131 bash[24745]: audit 2024-09-13T22:52:22.987075+0000 mgr.a (mgr.14355) 1361 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:24 smithi131 bash[24745]: cluster 2024-09-13T22:52:23.005764+0000 mgr.a (mgr.14355) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:24 smithi131 bash[24745]: audit 2024-09-13T22:52:23.354726+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:52:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:24 smithi171 bash[25040]: audit 2024-09-13T22:52:22.987075+0000 mgr.a (mgr.14355) 1361 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:24 smithi171 bash[25040]: cluster 2024-09-13T22:52:23.005764+0000 mgr.a (mgr.14355) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:24 smithi171 bash[25040]: audit 2024-09-13T22:52:23.354726+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:52:25.624 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22972]: debug 2024-09-13T22:52:25.373+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:52:25.624 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22972]: debug 2024-09-13T22:52:25.373+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.626279+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.633325+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.654455+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.660061+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.669891+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.676285+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.677378+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.678246+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.683439+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.685964+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:24.687187+0000 mgr.a (mgr.14355) 1363 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: cluster 2024-09-13T22:52:25.006438+0000 mgr.a (mgr.14355) 1364 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: audit 2024-09-13T22:52:25.374582+0000 mgr.a (mgr.14355) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:52:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:25 smithi007 bash[22722]: cephadm 2024-09-13T22:52:25.375833+0000 mgr.a (mgr.14355) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.626279+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.633325+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.654455+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.660061+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.669891+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.676285+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.677378+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.678246+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.683439+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.685964+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:24.687187+0000 mgr.a (mgr.14355) 1363 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: cluster 2024-09-13T22:52:25.006438+0000 mgr.a (mgr.14355) 1364 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: audit 2024-09-13T22:52:25.374582+0000 mgr.a (mgr.14355) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:25 smithi131 bash[24745]: cephadm 2024-09-13T22:52:25.375833+0000 mgr.a (mgr.14355) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:52:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.626279+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.633325+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.654455+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.660061+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.669891+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.676285+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.677378+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.678246+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.683439+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.685964+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:24.687187+0000 mgr.a (mgr.14355) 1363 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: cluster 2024-09-13T22:52:25.006438+0000 mgr.a (mgr.14355) 1364 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: audit 2024-09-13T22:52:25.374582+0000 mgr.a (mgr.14355) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:52:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:25 smithi171 bash[25040]: cephadm 2024-09-13T22:52:25.375833+0000 mgr.a (mgr.14355) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:52:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:28 smithi007 bash[22722]: cluster 2024-09-13T22:52:27.009210+0000 mgr.a (mgr.14355) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:52:28.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:28 smithi131 bash[24745]: cluster 2024-09-13T22:52:27.009210+0000 mgr.a (mgr.14355) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:52:28.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:28 smithi171 bash[25040]: cluster 2024-09-13T22:52:27.009210+0000 mgr.a (mgr.14355) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:52:29.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:29.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:29.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:29.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:29.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:30 smithi007 bash[22722]: audit 2024-09-13T22:52:28.730332+0000 mgr.a (mgr.14355) 1368 : audit [DBG] from='client.42423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:30 smithi007 bash[22722]: cluster 2024-09-13T22:52:29.009792+0000 mgr.a (mgr.14355) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:52:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:30 smithi131 bash[24745]: audit 2024-09-13T22:52:28.730332+0000 mgr.a (mgr.14355) 1368 : audit [DBG] from='client.42423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:30 smithi131 bash[24745]: cluster 2024-09-13T22:52:29.009792+0000 mgr.a (mgr.14355) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:52:30.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:30 smithi171 bash[25040]: audit 2024-09-13T22:52:28.730332+0000 mgr.a (mgr.14355) 1368 : audit [DBG] from='client.42423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:30.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:30 smithi171 bash[25040]: cluster 2024-09-13T22:52:29.009792+0000 mgr.a (mgr.14355) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:52:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:32 smithi007 bash[22722]: cluster 2024-09-13T22:52:31.012048+0000 mgr.a (mgr.14355) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:32.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:32 smithi131 bash[24745]: cluster 2024-09-13T22:52:31.012048+0000 mgr.a (mgr.14355) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:32.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:32 smithi171 bash[25040]: cluster 2024-09-13T22:52:31.012048+0000 mgr.a (mgr.14355) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:34.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:34 smithi007 bash[22722]: cluster 2024-09-13T22:52:33.012835+0000 mgr.a (mgr.14355) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:34.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:34 smithi131 bash[24745]: cluster 2024-09-13T22:52:33.012835+0000 mgr.a (mgr.14355) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:34.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:34 smithi171 bash[25040]: cluster 2024-09-13T22:52:33.012835+0000 mgr.a (mgr.14355) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:34.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:34.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:34.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:36 smithi007 bash[22722]: audit 2024-09-13T22:52:34.507204+0000 mgr.a (mgr.14355) 1372 : audit [DBG] from='client.42495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:36 smithi007 bash[22722]: cluster 2024-09-13T22:52:35.013622+0000 mgr.a (mgr.14355) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:36.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:36 smithi131 bash[24745]: audit 2024-09-13T22:52:34.507204+0000 mgr.a (mgr.14355) 1372 : audit [DBG] from='client.42495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:36.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:36 smithi131 bash[24745]: cluster 2024-09-13T22:52:35.013622+0000 mgr.a (mgr.14355) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:36.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:36 smithi171 bash[25040]: audit 2024-09-13T22:52:34.507204+0000 mgr.a (mgr.14355) 1372 : audit [DBG] from='client.42495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:36.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:36 smithi171 bash[25040]: cluster 2024-09-13T22:52:35.013622+0000 mgr.a (mgr.14355) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:38 smithi007 bash[22722]: cluster 2024-09-13T22:52:37.015909+0000 mgr.a (mgr.14355) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:38.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:38 smithi131 bash[24745]: cluster 2024-09-13T22:52:37.015909+0000 mgr.a (mgr.14355) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:38.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:38 smithi171 bash[25040]: cluster 2024-09-13T22:52:37.015909+0000 mgr.a (mgr.14355) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:52:39.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:39.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:39.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:40 smithi007 bash[22722]: cluster 2024-09-13T22:52:39.016763+0000 mgr.a (mgr.14355) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:40.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:40 smithi131 bash[24745]: cluster 2024-09-13T22:52:39.016763+0000 mgr.a (mgr.14355) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:40.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:40 smithi171 bash[25040]: cluster 2024-09-13T22:52:39.016763+0000 mgr.a (mgr.14355) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:40.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:41.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:41 smithi007 bash[22722]: audit 2024-09-13T22:52:40.273823+0000 mgr.a (mgr.14355) 1376 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:41.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:41 smithi131 bash[24745]: audit 2024-09-13T22:52:40.273823+0000 mgr.a (mgr.14355) 1376 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:41.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:41 smithi171 bash[25040]: audit 2024-09-13T22:52:40.273823+0000 mgr.a (mgr.14355) 1376 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:42 smithi007 bash[22722]: cluster 2024-09-13T22:52:41.019465+0000 mgr.a (mgr.14355) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:42.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:42 smithi131 bash[24745]: cluster 2024-09-13T22:52:41.019465+0000 mgr.a (mgr.14355) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:42.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:42 smithi171 bash[25040]: cluster 2024-09-13T22:52:41.019465+0000 mgr.a (mgr.14355) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T22:52:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:44 smithi007 bash[22722]: cluster 2024-09-13T22:52:43.020351+0000 mgr.a (mgr.14355) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:44.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:44 smithi131 bash[24745]: cluster 2024-09-13T22:52:43.020351+0000 mgr.a (mgr.14355) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:44.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:44 smithi171 bash[25040]: cluster 2024-09-13T22:52:43.020351+0000 mgr.a (mgr.14355) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:45.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:45.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:46.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:46 smithi007 bash[22722]: cluster 2024-09-13T22:52:45.021269+0000 mgr.a (mgr.14355) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:52:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:46 smithi131 bash[24745]: cluster 2024-09-13T22:52:45.021269+0000 mgr.a (mgr.14355) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:52:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:46 smithi171 bash[25040]: cluster 2024-09-13T22:52:45.021269+0000 mgr.a (mgr.14355) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:52:47.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:47 smithi007 bash[22722]: audit 2024-09-13T22:52:46.018014+0000 mgr.a (mgr.14355) 1380 : audit [DBG] from='client.42651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:47.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:47 smithi131 bash[24745]: audit 2024-09-13T22:52:46.018014+0000 mgr.a (mgr.14355) 1380 : audit [DBG] from='client.42651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:47.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:47 smithi171 bash[25040]: audit 2024-09-13T22:52:46.018014+0000 mgr.a (mgr.14355) 1380 : audit [DBG] from='client.42651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:48 smithi007 bash[22722]: cluster 2024-09-13T22:52:47.024022+0000 mgr.a (mgr.14355) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:48 smithi131 bash[24745]: cluster 2024-09-13T22:52:47.024022+0000 mgr.a (mgr.14355) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:48.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:48 smithi171 bash[25040]: cluster 2024-09-13T22:52:47.024022+0000 mgr.a (mgr.14355) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:50 smithi007 bash[22722]: cluster 2024-09-13T22:52:49.024797+0000 mgr.a (mgr.14355) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:50 smithi131 bash[24745]: cluster 2024-09-13T22:52:49.024797+0000 mgr.a (mgr.14355) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:50.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:50 smithi171 bash[25040]: cluster 2024-09-13T22:52:49.024797+0000 mgr.a (mgr.14355) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:52:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:51.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:51.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:52.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:52.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:52.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:52 smithi007 bash[22722]: cluster 2024-09-13T22:52:51.026823+0000 mgr.a (mgr.14355) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:52 smithi131 bash[24745]: cluster 2024-09-13T22:52:51.026823+0000 mgr.a (mgr.14355) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:52.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:52 smithi171 bash[25040]: cluster 2024-09-13T22:52:51.026823+0000 mgr.a (mgr.14355) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:53.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:53 smithi007 bash[22722]: audit 2024-09-13T22:52:51.759011+0000 mgr.a (mgr.14355) 1384 : audit [DBG] from='client.42729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:53.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:53 smithi131 bash[24745]: audit 2024-09-13T22:52:51.759011+0000 mgr.a (mgr.14355) 1384 : audit [DBG] from='client.42729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:53.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:53 smithi171 bash[25040]: audit 2024-09-13T22:52:51.759011+0000 mgr.a (mgr.14355) 1384 : audit [DBG] from='client.42729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:54 smithi007 bash[22722]: cluster 2024-09-13T22:52:53.027677+0000 mgr.a (mgr.14355) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:54 smithi131 bash[24745]: cluster 2024-09-13T22:52:53.027677+0000 mgr.a (mgr.14355) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:54 smithi171 bash[25040]: cluster 2024-09-13T22:52:53.027677+0000 mgr.a (mgr.14355) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:56 smithi007 bash[22722]: cluster 2024-09-13T22:52:55.028582+0000 mgr.a (mgr.14355) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:56 smithi131 bash[24745]: cluster 2024-09-13T22:52:55.028582+0000 mgr.a (mgr.14355) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:56 smithi171 bash[25040]: cluster 2024-09-13T22:52:55.028582+0000 mgr.a (mgr.14355) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:52:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:52:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:52:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:52:57.917 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:52:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:52:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:52:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:52:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:52:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:58 smithi007 bash[22722]: cluster 2024-09-13T22:52:57.030933+0000 mgr.a (mgr.14355) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:58 smithi131 bash[24745]: cluster 2024-09-13T22:52:57.030933+0000 mgr.a (mgr.14355) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:58.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:58 smithi171 bash[25040]: cluster 2024-09-13T22:52:57.030933+0000 mgr.a (mgr.14355) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:52:59.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:52:59 smithi007 bash[22722]: audit 2024-09-13T22:52:57.502637+0000 mgr.a (mgr.14355) 1388 : audit [DBG] from='client.42801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:52:59 smithi131 bash[24745]: audit 2024-09-13T22:52:57.502637+0000 mgr.a (mgr.14355) 1388 : audit [DBG] from='client.42801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:59.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:52:59 smithi171 bash[25040]: audit 2024-09-13T22:52:57.502637+0000 mgr.a (mgr.14355) 1388 : audit [DBG] from='client.42801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:00 smithi007 bash[22722]: cluster 2024-09-13T22:52:59.031833+0000 mgr.a (mgr.14355) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:00 smithi131 bash[24745]: cluster 2024-09-13T22:52:59.031833+0000 mgr.a (mgr.14355) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:00 smithi171 bash[25040]: cluster 2024-09-13T22:52:59.031833+0000 mgr.a (mgr.14355) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:02 smithi007 bash[22722]: cluster 2024-09-13T22:53:01.034064+0000 mgr.a (mgr.14355) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:02 smithi131 bash[24745]: cluster 2024-09-13T22:53:01.034064+0000 mgr.a (mgr.14355) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:02 smithi171 bash[25040]: cluster 2024-09-13T22:53:01.034064+0000 mgr.a (mgr.14355) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:03.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:03.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:03.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:04 smithi007 bash[22722]: cluster 2024-09-13T22:53:03.034521+0000 mgr.a (mgr.14355) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:04 smithi007 bash[22722]: audit 2024-09-13T22:53:03.246858+0000 mgr.a (mgr.14355) 1392 : audit [DBG] from='client.42876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:04 smithi131 bash[24745]: cluster 2024-09-13T22:53:03.034521+0000 mgr.a (mgr.14355) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:04 smithi131 bash[24745]: audit 2024-09-13T22:53:03.246858+0000 mgr.a (mgr.14355) 1392 : audit [DBG] from='client.42876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:04 smithi171 bash[25040]: cluster 2024-09-13T22:53:03.034521+0000 mgr.a (mgr.14355) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:04 smithi171 bash[25040]: audit 2024-09-13T22:53:03.246858+0000 mgr.a (mgr.14355) 1392 : audit [DBG] from='client.42876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:06 smithi007 bash[22722]: cluster 2024-09-13T22:53:05.035363+0000 mgr.a (mgr.14355) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:06 smithi131 bash[24745]: cluster 2024-09-13T22:53:05.035363+0000 mgr.a (mgr.14355) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:06 smithi171 bash[25040]: cluster 2024-09-13T22:53:05.035363+0000 mgr.a (mgr.14355) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:08 smithi007 bash[22722]: cluster 2024-09-13T22:53:07.037596+0000 mgr.a (mgr.14355) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:08 smithi131 bash[24745]: cluster 2024-09-13T22:53:07.037596+0000 mgr.a (mgr.14355) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:08.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:08 smithi171 bash[25040]: cluster 2024-09-13T22:53:07.037596+0000 mgr.a (mgr.14355) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:09.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:09.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:09.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:10 smithi007 bash[22722]: audit 2024-09-13T22:53:09.001855+0000 mgr.a (mgr.14355) 1395 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:10 smithi007 bash[22722]: cluster 2024-09-13T22:53:09.038651+0000 mgr.a (mgr.14355) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:10 smithi131 bash[24745]: audit 2024-09-13T22:53:09.001855+0000 mgr.a (mgr.14355) 1395 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:10 smithi131 bash[24745]: cluster 2024-09-13T22:53:09.038651+0000 mgr.a (mgr.14355) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:10 smithi171 bash[25040]: audit 2024-09-13T22:53:09.001855+0000 mgr.a (mgr.14355) 1395 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:10 smithi171 bash[25040]: cluster 2024-09-13T22:53:09.038651+0000 mgr.a (mgr.14355) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:12 smithi007 bash[22722]: cluster 2024-09-13T22:53:11.041182+0000 mgr.a (mgr.14355) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:12 smithi131 bash[24745]: cluster 2024-09-13T22:53:11.041182+0000 mgr.a (mgr.14355) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:12 smithi171 bash[25040]: cluster 2024-09-13T22:53:11.041182+0000 mgr.a (mgr.14355) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:14.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:14 smithi007 bash[22722]: cluster 2024-09-13T22:53:13.042123+0000 mgr.a (mgr.14355) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:14 smithi131 bash[24745]: cluster 2024-09-13T22:53:13.042123+0000 mgr.a (mgr.14355) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:14 smithi171 bash[25040]: cluster 2024-09-13T22:53:13.042123+0000 mgr.a (mgr.14355) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:15.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:16.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:16 smithi007 bash[22722]: audit 2024-09-13T22:53:14.749336+0000 mgr.a (mgr.14355) 1399 : audit [DBG] from='client.43029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:16.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:16 smithi007 bash[22722]: cluster 2024-09-13T22:53:15.042612+0000 mgr.a (mgr.14355) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:16 smithi131 bash[24745]: audit 2024-09-13T22:53:14.749336+0000 mgr.a (mgr.14355) 1399 : audit [DBG] from='client.43029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:16 smithi131 bash[24745]: cluster 2024-09-13T22:53:15.042612+0000 mgr.a (mgr.14355) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:16.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:16 smithi171 bash[25040]: audit 2024-09-13T22:53:14.749336+0000 mgr.a (mgr.14355) 1399 : audit [DBG] from='client.43029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:16.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:16 smithi171 bash[25040]: cluster 2024-09-13T22:53:15.042612+0000 mgr.a (mgr.14355) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:18.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:18 smithi007 bash[22722]: cluster 2024-09-13T22:53:17.044875+0000 mgr.a (mgr.14355) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:53:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:18 smithi131 bash[24745]: cluster 2024-09-13T22:53:17.044875+0000 mgr.a (mgr.14355) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:53:18.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:18 smithi171 bash[25040]: cluster 2024-09-13T22:53:17.044875+0000 mgr.a (mgr.14355) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:53:20.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:20.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:20 smithi007 bash[22722]: cluster 2024-09-13T22:53:19.045682+0000 mgr.a (mgr.14355) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:53:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:20 smithi131 bash[24745]: cluster 2024-09-13T22:53:19.045682+0000 mgr.a (mgr.14355) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:53:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:20 smithi171 bash[25040]: cluster 2024-09-13T22:53:19.045682+0000 mgr.a (mgr.14355) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:53:20.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:20.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:20.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:20.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:20.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:22 smithi007 bash[22722]: audit 2024-09-13T22:53:20.500930+0000 mgr.a (mgr.14355) 1403 : audit [DBG] from='client.43107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:22 smithi007 bash[22722]: cluster 2024-09-13T22:53:21.048506+0000 mgr.a (mgr.14355) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:22 smithi131 bash[24745]: audit 2024-09-13T22:53:20.500930+0000 mgr.a (mgr.14355) 1403 : audit [DBG] from='client.43107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:22 smithi131 bash[24745]: cluster 2024-09-13T22:53:21.048506+0000 mgr.a (mgr.14355) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:22.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:22 smithi171 bash[25040]: audit 2024-09-13T22:53:20.500930+0000 mgr.a (mgr.14355) 1403 : audit [DBG] from='client.43107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:22.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:22 smithi171 bash[25040]: cluster 2024-09-13T22:53:21.048506+0000 mgr.a (mgr.14355) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:24.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:24 smithi131 bash[24745]: cluster 2024-09-13T22:53:23.049346+0000 mgr.a (mgr.14355) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:53:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:24 smithi171 bash[25040]: cluster 2024-09-13T22:53:23.049346+0000 mgr.a (mgr.14355) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:53:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:24 smithi007 bash[22722]: cluster 2024-09-13T22:53:23.049346+0000 mgr.a (mgr.14355) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:53:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:26 smithi131 bash[24745]: cluster 2024-09-13T22:53:25.050151+0000 mgr.a (mgr.14355) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:53:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:26 smithi131 bash[24745]: audit 2024-09-13T22:53:25.430955+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:26 smithi171 bash[25040]: cluster 2024-09-13T22:53:25.050151+0000 mgr.a (mgr.14355) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:53:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:26 smithi171 bash[25040]: audit 2024-09-13T22:53:25.430955+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:26.639 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:26.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:26 smithi007 bash[22722]: cluster 2024-09-13T22:53:25.050151+0000 mgr.a (mgr.14355) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:53:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:26 smithi007 bash[22722]: audit 2024-09-13T22:53:25.430955+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:27.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:27 smithi131 bash[24745]: audit 2024-09-13T22:53:26.234133+0000 mgr.a (mgr.14355) 1407 : audit [DBG] from='client.43185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:27.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:27 smithi171 bash[25040]: audit 2024-09-13T22:53:26.234133+0000 mgr.a (mgr.14355) 1407 : audit [DBG] from='client.43185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:27 smithi007 bash[22722]: audit 2024-09-13T22:53:26.234133+0000 mgr.a (mgr.14355) 1407 : audit [DBG] from='client.43185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:28.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:28 smithi131 bash[24745]: cluster 2024-09-13T22:53:27.052990+0000 mgr.a (mgr.14355) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:28.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:28 smithi171 bash[25040]: cluster 2024-09-13T22:53:27.052990+0000 mgr.a (mgr.14355) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:28 smithi007 bash[22722]: cluster 2024-09-13T22:53:27.052990+0000 mgr.a (mgr.14355) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:30 smithi131 bash[24745]: cluster 2024-09-13T22:53:29.053932+0000 mgr.a (mgr.14355) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-13T22:53:30.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:30 smithi171 bash[25040]: cluster 2024-09-13T22:53:29.053932+0000 mgr.a (mgr.14355) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-13T22:53:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:30 smithi007 bash[22722]: cluster 2024-09-13T22:53:29.053932+0000 mgr.a (mgr.14355) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-13T22:53:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:31.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.775141+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.779593+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.796628+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.802706+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.812351+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:30.815682+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: cluster 2024-09-13T22:53:31.055902+0000 mgr.a (mgr.14355) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:53:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:31.504076+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:31.505150+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:31.513197+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:31 smithi131 bash[24745]: audit 2024-09-13T22:53:31.515718+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.775141+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.779593+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.796628+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.802706+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.812351+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:30.815682+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: cluster 2024-09-13T22:53:31.055902+0000 mgr.a (mgr.14355) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:53:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:31.504076+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:31.505150+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:31.513197+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:31 smithi171 bash[25040]: audit 2024-09-13T22:53:31.515718+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.775141+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.779593+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.796628+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.802706+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.812351+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:30.815682+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: cluster 2024-09-13T22:53:31.055902+0000 mgr.a (mgr.14355) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:31.504076+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:31.505150+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:31.513197+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:31 smithi007 bash[22722]: audit 2024-09-13T22:53:31.515718+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:32.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:32.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:32.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22972]: debug 2024-09-13T22:53:32.228+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:53:32.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22972]: debug 2024-09-13T22:53:32.240+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:53:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22722]: audit 2024-09-13T22:53:31.517985+0000 mgr.a (mgr.14355) 1411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22722]: audit 2024-09-13T22:53:31.970623+0000 mgr.a (mgr.14355) 1412 : audit [DBG] from='client.43299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22722]: audit 2024-09-13T22:53:32.233526+0000 mgr.a (mgr.14355) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:53:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:32 smithi007 bash[22722]: cephadm 2024-09-13T22:53:32.243605+0000 mgr.a (mgr.14355) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:53:33.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:32 smithi131 bash[24745]: audit 2024-09-13T22:53:31.517985+0000 mgr.a (mgr.14355) 1411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:33.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:32 smithi131 bash[24745]: audit 2024-09-13T22:53:31.970623+0000 mgr.a (mgr.14355) 1412 : audit [DBG] from='client.43299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:33.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:32 smithi131 bash[24745]: audit 2024-09-13T22:53:32.233526+0000 mgr.a (mgr.14355) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:53:33.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:32 smithi131 bash[24745]: cephadm 2024-09-13T22:53:32.243605+0000 mgr.a (mgr.14355) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:53:33.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:32 smithi171 bash[25040]: audit 2024-09-13T22:53:31.517985+0000 mgr.a (mgr.14355) 1411 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:53:33.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:32 smithi171 bash[25040]: audit 2024-09-13T22:53:31.970623+0000 mgr.a (mgr.14355) 1412 : audit [DBG] from='client.43299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:33.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:32 smithi171 bash[25040]: audit 2024-09-13T22:53:32.233526+0000 mgr.a (mgr.14355) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:53:33.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:32 smithi171 bash[25040]: cephadm 2024-09-13T22:53:32.243605+0000 mgr.a (mgr.14355) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:53:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:33 smithi007 bash[22722]: cluster 2024-09-13T22:53:33.056903+0000 mgr.a (mgr.14355) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:34.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:33 smithi131 bash[24745]: cluster 2024-09-13T22:53:33.056903+0000 mgr.a (mgr.14355) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:34.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:33 smithi171 bash[25040]: cluster 2024-09-13T22:53:33.056903+0000 mgr.a (mgr.14355) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:36 smithi007 bash[22722]: cluster 2024-09-13T22:53:35.057712+0000 mgr.a (mgr.14355) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:36.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:36 smithi131 bash[24745]: cluster 2024-09-13T22:53:35.057712+0000 mgr.a (mgr.14355) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:36 smithi171 bash[25040]: cluster 2024-09-13T22:53:35.057712+0000 mgr.a (mgr.14355) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:37.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:37.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:38.355 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:38.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:38 smithi007 bash[22722]: cluster 2024-09-13T22:53:37.059947+0000 mgr.a (mgr.14355) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:38.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:38 smithi131 bash[24745]: cluster 2024-09-13T22:53:37.059947+0000 mgr.a (mgr.14355) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:38.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:38 smithi171 bash[25040]: cluster 2024-09-13T22:53:37.059947+0000 mgr.a (mgr.14355) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:39.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:39 smithi007 bash[22722]: audit 2024-09-13T22:53:37.955793+0000 mgr.a (mgr.14355) 1418 : audit [DBG] from='client.43446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:39.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:39 smithi131 bash[24745]: audit 2024-09-13T22:53:37.955793+0000 mgr.a (mgr.14355) 1418 : audit [DBG] from='client.43446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:39.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:39 smithi171 bash[25040]: audit 2024-09-13T22:53:37.955793+0000 mgr.a (mgr.14355) 1418 : audit [DBG] from='client.43446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:40 smithi007 bash[22722]: cluster 2024-09-13T22:53:39.061006+0000 mgr.a (mgr.14355) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:40.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:40 smithi131 bash[24745]: cluster 2024-09-13T22:53:39.061006+0000 mgr.a (mgr.14355) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:40.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:40 smithi171 bash[25040]: cluster 2024-09-13T22:53:39.061006+0000 mgr.a (mgr.14355) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:42 smithi007 bash[22722]: cluster 2024-09-13T22:53:41.063377+0000 mgr.a (mgr.14355) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:42.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:42 smithi131 bash[24745]: cluster 2024-09-13T22:53:41.063377+0000 mgr.a (mgr.14355) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:42.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:42 smithi171 bash[25040]: cluster 2024-09-13T22:53:41.063377+0000 mgr.a (mgr.14355) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:43.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:43.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:43.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:44.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:44.135 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:44 smithi007 bash[22722]: cluster 2024-09-13T22:53:43.064293+0000 mgr.a (mgr.14355) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:44.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:44 smithi131 bash[24745]: cluster 2024-09-13T22:53:43.064293+0000 mgr.a (mgr.14355) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:44.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:44 smithi171 bash[25040]: cluster 2024-09-13T22:53:43.064293+0000 mgr.a (mgr.14355) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:45.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:45 smithi007 bash[22722]: audit 2024-09-13T22:53:43.698060+0000 mgr.a (mgr.14355) 1422 : audit [DBG] from='client.43524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:45.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:45 smithi131 bash[24745]: audit 2024-09-13T22:53:43.698060+0000 mgr.a (mgr.14355) 1422 : audit [DBG] from='client.43524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:45.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:45 smithi171 bash[25040]: audit 2024-09-13T22:53:43.698060+0000 mgr.a (mgr.14355) 1422 : audit [DBG] from='client.43524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:46 smithi007 bash[22722]: cluster 2024-09-13T22:53:45.065268+0000 mgr.a (mgr.14355) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:46 smithi131 bash[24745]: cluster 2024-09-13T22:53:45.065268+0000 mgr.a (mgr.14355) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:46 smithi171 bash[25040]: cluster 2024-09-13T22:53:45.065268+0000 mgr.a (mgr.14355) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:48 smithi007 bash[22722]: cluster 2024-09-13T22:53:47.067646+0000 mgr.a (mgr.14355) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:48 smithi131 bash[24745]: cluster 2024-09-13T22:53:47.067646+0000 mgr.a (mgr.14355) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:48.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:48 smithi171 bash[25040]: cluster 2024-09-13T22:53:47.067646+0000 mgr.a (mgr.14355) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:53:49.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:49.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:49.901 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:49.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:49.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:49.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:49.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:50 smithi007 bash[22722]: cluster 2024-09-13T22:53:49.068601+0000 mgr.a (mgr.14355) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:50 smithi007 bash[22722]: audit 2024-09-13T22:53:49.470751+0000 mgr.a (mgr.14355) 1426 : audit [DBG] from='client.43602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:50 smithi131 bash[24745]: cluster 2024-09-13T22:53:49.068601+0000 mgr.a (mgr.14355) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:50.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:50 smithi131 bash[24745]: audit 2024-09-13T22:53:49.470751+0000 mgr.a (mgr.14355) 1426 : audit [DBG] from='client.43602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:50.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:50 smithi171 bash[25040]: cluster 2024-09-13T22:53:49.068601+0000 mgr.a (mgr.14355) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:50.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:50 smithi171 bash[25040]: audit 2024-09-13T22:53:49.470751+0000 mgr.a (mgr.14355) 1426 : audit [DBG] from='client.43602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:52 smithi007 bash[22722]: cluster 2024-09-13T22:53:51.071056+0000 mgr.a (mgr.14355) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:52 smithi131 bash[24745]: cluster 2024-09-13T22:53:51.071056+0000 mgr.a (mgr.14355) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:52.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:52 smithi171 bash[25040]: cluster 2024-09-13T22:53:51.071056+0000 mgr.a (mgr.14355) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:53:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:54 smithi007 bash[22722]: cluster 2024-09-13T22:53:53.071816+0000 mgr.a (mgr.14355) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:54 smithi131 bash[24745]: cluster 2024-09-13T22:53:53.071816+0000 mgr.a (mgr.14355) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:54 smithi171 bash[25040]: cluster 2024-09-13T22:53:53.071816+0000 mgr.a (mgr.14355) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:53:54.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:53:54.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:53:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:53:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:53:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:53:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:53:55.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:53:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:56 smithi007 bash[22722]: cluster 2024-09-13T22:53:55.072562+0000 mgr.a (mgr.14355) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:56 smithi007 bash[22722]: audit 2024-09-13T22:53:55.236351+0000 mgr.a (mgr.14355) 1430 : audit [DBG] from='client.43677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:56 smithi131 bash[24745]: cluster 2024-09-13T22:53:55.072562+0000 mgr.a (mgr.14355) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:56 smithi131 bash[24745]: audit 2024-09-13T22:53:55.236351+0000 mgr.a (mgr.14355) 1430 : audit [DBG] from='client.43677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:56 smithi171 bash[25040]: cluster 2024-09-13T22:53:55.072562+0000 mgr.a (mgr.14355) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:56.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:56 smithi171 bash[25040]: audit 2024-09-13T22:53:55.236351+0000 mgr.a (mgr.14355) 1430 : audit [DBG] from='client.43677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:53:58 smithi007 bash[22722]: cluster 2024-09-13T22:53:57.075457+0000 mgr.a (mgr.14355) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:53:58 smithi131 bash[24745]: cluster 2024-09-13T22:53:57.075457+0000 mgr.a (mgr.14355) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:53:58.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:53:58 smithi171 bash[25040]: cluster 2024-09-13T22:53:57.075457+0000 mgr.a (mgr.14355) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:00 smithi007 bash[22722]: cluster 2024-09-13T22:53:59.076423+0000 mgr.a (mgr.14355) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:00 smithi131 bash[24745]: cluster 2024-09-13T22:53:59.076423+0000 mgr.a (mgr.14355) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:00 smithi171 bash[25040]: cluster 2024-09-13T22:53:59.076423+0000 mgr.a (mgr.14355) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:00.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:00.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:00.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:01.440 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:01.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:01.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:01.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:01.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:02 smithi007 bash[22722]: audit 2024-09-13T22:54:01.009055+0000 mgr.a (mgr.14355) 1433 : audit [DBG] from='client.43755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:02 smithi007 bash[22722]: cluster 2024-09-13T22:54:01.077843+0000 mgr.a (mgr.14355) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:02 smithi131 bash[24745]: audit 2024-09-13T22:54:01.009055+0000 mgr.a (mgr.14355) 1433 : audit [DBG] from='client.43755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:02.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:02 smithi131 bash[24745]: cluster 2024-09-13T22:54:01.077843+0000 mgr.a (mgr.14355) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:02 smithi171 bash[25040]: audit 2024-09-13T22:54:01.009055+0000 mgr.a (mgr.14355) 1433 : audit [DBG] from='client.43755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:02 smithi171 bash[25040]: cluster 2024-09-13T22:54:01.077843+0000 mgr.a (mgr.14355) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:04 smithi007 bash[22722]: cluster 2024-09-13T22:54:03.078765+0000 mgr.a (mgr.14355) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:04 smithi131 bash[24745]: cluster 2024-09-13T22:54:03.078765+0000 mgr.a (mgr.14355) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:04 smithi171 bash[25040]: cluster 2024-09-13T22:54:03.078765+0000 mgr.a (mgr.14355) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:54:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:06.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:06.443 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:06 smithi007 bash[22722]: cluster 2024-09-13T22:54:05.079528+0000 mgr.a (mgr.14355) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:54:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:06 smithi131 bash[24745]: cluster 2024-09-13T22:54:05.079528+0000 mgr.a (mgr.14355) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:54:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:06 smithi171 bash[25040]: cluster 2024-09-13T22:54:05.079528+0000 mgr.a (mgr.14355) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:54:07.175 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:07.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:08 smithi007 bash[22722]: audit 2024-09-13T22:54:06.775697+0000 mgr.a (mgr.14355) 1437 : audit [DBG] from='client.43833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:08 smithi007 bash[22722]: cluster 2024-09-13T22:54:07.081804+0000 mgr.a (mgr.14355) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:08 smithi131 bash[24745]: audit 2024-09-13T22:54:06.775697+0000 mgr.a (mgr.14355) 1437 : audit [DBG] from='client.43833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:08.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:08 smithi131 bash[24745]: cluster 2024-09-13T22:54:07.081804+0000 mgr.a (mgr.14355) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:08 smithi171 bash[25040]: audit 2024-09-13T22:54:06.775697+0000 mgr.a (mgr.14355) 1437 : audit [DBG] from='client.43833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:08 smithi171 bash[25040]: cluster 2024-09-13T22:54:07.081804+0000 mgr.a (mgr.14355) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:10 smithi007 bash[22722]: cluster 2024-09-13T22:54:09.082575+0000 mgr.a (mgr.14355) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:10 smithi131 bash[24745]: cluster 2024-09-13T22:54:09.082575+0000 mgr.a (mgr.14355) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:10 smithi171 bash[25040]: cluster 2024-09-13T22:54:09.082575+0000 mgr.a (mgr.14355) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:12 smithi007 bash[22722]: cluster 2024-09-13T22:54:11.084598+0000 mgr.a (mgr.14355) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:12 smithi131 bash[24745]: cluster 2024-09-13T22:54:11.084598+0000 mgr.a (mgr.14355) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:12.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:12 smithi171 bash[25040]: cluster 2024-09-13T22:54:11.084598+0000 mgr.a (mgr.14355) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:12.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:12.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:13.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:13 smithi131 bash[24745]: audit 2024-09-13T22:54:12.508198+0000 mgr.a (mgr.14355) 1441 : audit [DBG] from='client.43911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:13.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:13 smithi171 bash[25040]: audit 2024-09-13T22:54:12.508198+0000 mgr.a (mgr.14355) 1441 : audit [DBG] from='client.43911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:13 smithi007 bash[22722]: audit 2024-09-13T22:54:12.508198+0000 mgr.a (mgr.14355) 1441 : audit [DBG] from='client.43911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:14 smithi131 bash[24745]: cluster 2024-09-13T22:54:13.085537+0000 mgr.a (mgr.14355) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:14.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:14 smithi171 bash[25040]: cluster 2024-09-13T22:54:13.085537+0000 mgr.a (mgr.14355) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:14 smithi007 bash[22722]: cluster 2024-09-13T22:54:13.085537+0000 mgr.a (mgr.14355) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:16 smithi131 bash[24745]: cluster 2024-09-13T22:54:15.086346+0000 mgr.a (mgr.14355) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:16.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:16 smithi171 bash[25040]: cluster 2024-09-13T22:54:15.086346+0000 mgr.a (mgr.14355) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:16 smithi007 bash[22722]: cluster 2024-09-13T22:54:15.086346+0000 mgr.a (mgr.14355) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:17.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:17.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:17.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:18 smithi131 bash[24745]: cluster 2024-09-13T22:54:17.088568+0000 mgr.a (mgr.14355) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:18.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:18 smithi171 bash[25040]: cluster 2024-09-13T22:54:17.088568+0000 mgr.a (mgr.14355) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:18.679 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:18 smithi007 bash[22722]: cluster 2024-09-13T22:54:17.088568+0000 mgr.a (mgr.14355) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:19.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:19 smithi131 bash[24745]: audit 2024-09-13T22:54:18.253031+0000 mgr.a (mgr.14355) 1445 : audit [DBG] from='client.43989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:19.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:19 smithi171 bash[25040]: audit 2024-09-13T22:54:18.253031+0000 mgr.a (mgr.14355) 1445 : audit [DBG] from='client.43989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:19.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:19 smithi007 bash[22722]: audit 2024-09-13T22:54:18.253031+0000 mgr.a (mgr.14355) 1445 : audit [DBG] from='client.43989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:20 smithi131 bash[24745]: cluster 2024-09-13T22:54:19.089501+0000 mgr.a (mgr.14355) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:20.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:20 smithi171 bash[25040]: cluster 2024-09-13T22:54:19.089501+0000 mgr.a (mgr.14355) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:20 smithi007 bash[22722]: cluster 2024-09-13T22:54:19.089501+0000 mgr.a (mgr.14355) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:22 smithi131 bash[24745]: cluster 2024-09-13T22:54:21.091750+0000 mgr.a (mgr.14355) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:22.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:22 smithi171 bash[25040]: cluster 2024-09-13T22:54:21.091750+0000 mgr.a (mgr.14355) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:22 smithi007 bash[22722]: cluster 2024-09-13T22:54:21.091750+0000 mgr.a (mgr.14355) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:23.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:23.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:23.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:24.456 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:24.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:24.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:24 smithi131 bash[24745]: cluster 2024-09-13T22:54:23.092507+0000 mgr.a (mgr.14355) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:24 smithi171 bash[25040]: cluster 2024-09-13T22:54:23.092507+0000 mgr.a (mgr.14355) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:24 smithi007 bash[22722]: cluster 2024-09-13T22:54:23.092507+0000 mgr.a (mgr.14355) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:25.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:25 smithi131 bash[24745]: audit 2024-09-13T22:54:24.022068+0000 mgr.a (mgr.14355) 1449 : audit [DBG] from='client.44067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:25.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:25 smithi171 bash[25040]: audit 2024-09-13T22:54:24.022068+0000 mgr.a (mgr.14355) 1449 : audit [DBG] from='client.44067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:25 smithi007 bash[22722]: audit 2024-09-13T22:54:24.022068+0000 mgr.a (mgr.14355) 1449 : audit [DBG] from='client.44067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:26 smithi131 bash[24745]: cluster 2024-09-13T22:54:25.093436+0000 mgr.a (mgr.14355) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:26.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:26 smithi171 bash[25040]: cluster 2024-09-13T22:54:25.093436+0000 mgr.a (mgr.14355) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:26 smithi007 bash[22722]: cluster 2024-09-13T22:54:25.093436+0000 mgr.a (mgr.14355) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:28.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:28 smithi131 bash[24745]: cluster 2024-09-13T22:54:27.095743+0000 mgr.a (mgr.14355) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:28.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:28 smithi171 bash[25040]: cluster 2024-09-13T22:54:27.095743+0000 mgr.a (mgr.14355) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:28 smithi007 bash[22722]: cluster 2024-09-13T22:54:27.095743+0000 mgr.a (mgr.14355) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:30 smithi131 bash[24745]: cluster 2024-09-13T22:54:29.096498+0000 mgr.a (mgr.14355) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:30.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:30 smithi171 bash[25040]: cluster 2024-09-13T22:54:29.096498+0000 mgr.a (mgr.14355) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:30 smithi007 bash[22722]: cluster 2024-09-13T22:54:29.096498+0000 mgr.a (mgr.14355) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:31.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:31 smithi131 bash[24745]: audit 2024-09-13T22:54:29.795760+0000 mgr.a (mgr.14355) 1453 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:31.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:31 smithi171 bash[25040]: audit 2024-09-13T22:54:29.795760+0000 mgr.a (mgr.14355) 1453 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:31.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:31 smithi007 bash[22722]: audit 2024-09-13T22:54:29.795760+0000 mgr.a (mgr.14355) 1453 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:32.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:32 smithi131 bash[24745]: cluster 2024-09-13T22:54:31.098945+0000 mgr.a (mgr.14355) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:54:32.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:32 smithi171 bash[25040]: cluster 2024-09-13T22:54:31.098945+0000 mgr.a (mgr.14355) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:54:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:32 smithi007 bash[22722]: cluster 2024-09-13T22:54:31.098945+0000 mgr.a (mgr.14355) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:54:33.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:33 smithi131 bash[24745]: audit 2024-09-13T22:54:32.296639+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:33.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:33 smithi131 bash[24745]: audit 2024-09-13T22:54:33.140056+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:54:33.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:33 smithi131 bash[24745]: audit 2024-09-13T22:54:33.141555+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:54:33.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:33 smithi131 bash[24745]: audit 2024-09-13T22:54:33.152063+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:54:33.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:33 smithi131 bash[24745]: audit 2024-09-13T22:54:33.155261+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:33 smithi171 bash[25040]: audit 2024-09-13T22:54:32.296639+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:33 smithi171 bash[25040]: audit 2024-09-13T22:54:33.140056+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:54:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:33 smithi171 bash[25040]: audit 2024-09-13T22:54:33.141555+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:54:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:33 smithi171 bash[25040]: audit 2024-09-13T22:54:33.152063+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:54:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:33 smithi171 bash[25040]: audit 2024-09-13T22:54:33.155261+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22722]: audit 2024-09-13T22:54:32.296639+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22722]: audit 2024-09-13T22:54:33.140056+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:54:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22722]: audit 2024-09-13T22:54:33.141555+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:54:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22722]: audit 2024-09-13T22:54:33.152063+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:54:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22722]: audit 2024-09-13T22:54:33.155261+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:34.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22972]: debug 2024-09-13T22:54:33.871+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:54:34.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:54:33 smithi007 bash[22972]: debug 2024-09-13T22:54:33.871+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:54:34.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:34 smithi131 bash[24745]: cluster 2024-09-13T22:54:33.099686+0000 mgr.a (mgr.14355) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:34.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:34 smithi131 bash[24745]: audit 2024-09-13T22:54:33.157561+0000 mgr.a (mgr.14355) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:34.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:34 smithi171 bash[25040]: cluster 2024-09-13T22:54:33.099686+0000 mgr.a (mgr.14355) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:34.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:34 smithi171 bash[25040]: audit 2024-09-13T22:54:33.157561+0000 mgr.a (mgr.14355) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:34 smithi007 bash[22722]: cluster 2024-09-13T22:54:33.099686+0000 mgr.a (mgr.14355) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:34 smithi007 bash[22722]: audit 2024-09-13T22:54:33.157561+0000 mgr.a (mgr.14355) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:54:35.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:35.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:35.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:35.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:35 smithi171 bash[25040]: audit 2024-09-13T22:54:33.876432+0000 mgr.a (mgr.14355) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:54:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:35 smithi171 bash[25040]: cephadm 2024-09-13T22:54:33.878136+0000 mgr.a (mgr.14355) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:54:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:35 smithi007 bash[22722]: audit 2024-09-13T22:54:33.876432+0000 mgr.a (mgr.14355) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:54:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:35 smithi007 bash[22722]: cephadm 2024-09-13T22:54:33.878136+0000 mgr.a (mgr.14355) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:54:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:35 smithi131 bash[24745]: audit 2024-09-13T22:54:33.876432+0000 mgr.a (mgr.14355) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:54:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:35 smithi131 bash[24745]: cephadm 2024-09-13T22:54:33.878136+0000 mgr.a (mgr.14355) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:54:35.971 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:35.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:36.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:36 smithi171 bash[25040]: cluster 2024-09-13T22:54:35.100518+0000 mgr.a (mgr.14355) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:36 smithi007 bash[22722]: cluster 2024-09-13T22:54:35.100518+0000 mgr.a (mgr.14355) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:36 smithi131 bash[24745]: cluster 2024-09-13T22:54:35.100518+0000 mgr.a (mgr.14355) 1459 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:54:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:37 smithi007 bash[22722]: audit 2024-09-13T22:54:35.548904+0000 mgr.a (mgr.14355) 1460 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:37.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:37 smithi131 bash[24745]: audit 2024-09-13T22:54:35.548904+0000 mgr.a (mgr.14355) 1460 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:37 smithi171 bash[25040]: audit 2024-09-13T22:54:35.548904+0000 mgr.a (mgr.14355) 1460 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:38 smithi007 bash[22722]: cluster 2024-09-13T22:54:37.103300+0000 mgr.a (mgr.14355) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:38 smithi131 bash[24745]: cluster 2024-09-13T22:54:37.103300+0000 mgr.a (mgr.14355) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:38 smithi171 bash[25040]: cluster 2024-09-13T22:54:37.103300+0000 mgr.a (mgr.14355) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:40 smithi007 bash[22722]: cluster 2024-09-13T22:54:39.104091+0000 mgr.a (mgr.14355) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:40 smithi131 bash[24745]: cluster 2024-09-13T22:54:39.104091+0000 mgr.a (mgr.14355) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:40 smithi171 bash[25040]: cluster 2024-09-13T22:54:39.104091+0000 mgr.a (mgr.14355) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:40.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:41.721 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:41.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:42 smithi007 bash[22722]: cluster 2024-09-13T22:54:41.105109+0000 mgr.a (mgr.14355) 1463 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:42 smithi007 bash[22722]: audit 2024-09-13T22:54:41.307128+0000 mgr.a (mgr.14355) 1464 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:42 smithi131 bash[24745]: cluster 2024-09-13T22:54:41.105109+0000 mgr.a (mgr.14355) 1463 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:42 smithi131 bash[24745]: audit 2024-09-13T22:54:41.307128+0000 mgr.a (mgr.14355) 1464 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:42 smithi171 bash[25040]: cluster 2024-09-13T22:54:41.105109+0000 mgr.a (mgr.14355) 1463 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:42 smithi171 bash[25040]: audit 2024-09-13T22:54:41.307128+0000 mgr.a (mgr.14355) 1464 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:44.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:44 smithi007 bash[22722]: cluster 2024-09-13T22:54:43.105959+0000 mgr.a (mgr.14355) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:44 smithi131 bash[24745]: cluster 2024-09-13T22:54:43.105959+0000 mgr.a (mgr.14355) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:44 smithi171 bash[25040]: cluster 2024-09-13T22:54:43.105959+0000 mgr.a (mgr.14355) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:46 smithi007 bash[22722]: cluster 2024-09-13T22:54:45.106771+0000 mgr.a (mgr.14355) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:46 smithi131 bash[24745]: cluster 2024-09-13T22:54:45.106771+0000 mgr.a (mgr.14355) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:46 smithi171 bash[25040]: cluster 2024-09-13T22:54:45.106771+0000 mgr.a (mgr.14355) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:54:46.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:46.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:46.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:47.460 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:47.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:47.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:47.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:47.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:48 smithi007 bash[22722]: audit 2024-09-13T22:54:47.044793+0000 mgr.a (mgr.14355) 1467 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:48 smithi007 bash[22722]: cluster 2024-09-13T22:54:47.108202+0000 mgr.a (mgr.14355) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:48.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:48 smithi131 bash[24745]: audit 2024-09-13T22:54:47.044793+0000 mgr.a (mgr.14355) 1467 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:48 smithi131 bash[24745]: cluster 2024-09-13T22:54:47.108202+0000 mgr.a (mgr.14355) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:48.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:48 smithi171 bash[25040]: audit 2024-09-13T22:54:47.044793+0000 mgr.a (mgr.14355) 1467 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:48 smithi171 bash[25040]: cluster 2024-09-13T22:54:47.108202+0000 mgr.a (mgr.14355) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:54:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:50 smithi007 bash[22722]: cluster 2024-09-13T22:54:49.109168+0000 mgr.a (mgr.14355) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:50.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:50 smithi131 bash[24745]: cluster 2024-09-13T22:54:49.109168+0000 mgr.a (mgr.14355) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:50.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:50 smithi171 bash[25040]: cluster 2024-09-13T22:54:49.109168+0000 mgr.a (mgr.14355) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:52 smithi007 bash[22722]: cluster 2024-09-13T22:54:51.111505+0000 mgr.a (mgr.14355) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:52.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:52.462 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:52.462 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:52.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:52 smithi131 bash[24745]: cluster 2024-09-13T22:54:51.111505+0000 mgr.a (mgr.14355) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:52.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:52 smithi171 bash[25040]: cluster 2024-09-13T22:54:51.111505+0000 mgr.a (mgr.14355) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:53.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:53.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:53.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:53.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:53.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:54:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:54 smithi007 bash[22722]: audit 2024-09-13T22:54:52.791671+0000 mgr.a (mgr.14355) 1471 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:54 smithi007 bash[22722]: cluster 2024-09-13T22:54:53.112076+0000 mgr.a (mgr.14355) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:54 smithi131 bash[24745]: audit 2024-09-13T22:54:52.791671+0000 mgr.a (mgr.14355) 1471 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:54.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:54 smithi131 bash[24745]: cluster 2024-09-13T22:54:53.112076+0000 mgr.a (mgr.14355) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:54 smithi171 bash[25040]: audit 2024-09-13T22:54:52.791671+0000 mgr.a (mgr.14355) 1471 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:54.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:54 smithi171 bash[25040]: cluster 2024-09-13T22:54:53.112076+0000 mgr.a (mgr.14355) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:56 smithi007 bash[22722]: cluster 2024-09-13T22:54:55.112852+0000 mgr.a (mgr.14355) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:56 smithi131 bash[24745]: cluster 2024-09-13T22:54:55.112852+0000 mgr.a (mgr.14355) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:56 smithi171 bash[25040]: cluster 2024-09-13T22:54:55.112852+0000 mgr.a (mgr.14355) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:54:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:54:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:54:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:54:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:54:58 smithi007 bash[22722]: cluster 2024-09-13T22:54:57.115149+0000 mgr.a (mgr.14355) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:58.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:54:58 smithi131 bash[24745]: cluster 2024-09-13T22:54:57.115149+0000 mgr.a (mgr.14355) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:58.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:54:58 smithi171 bash[25040]: cluster 2024-09-13T22:54:57.115149+0000 mgr.a (mgr.14355) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:54:58.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:54:58.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:54:58.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:54:58.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:54:58.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:00 smithi007 bash[22722]: audit 2024-09-13T22:54:58.551147+0000 mgr.a (mgr.14355) 1475 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:00.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:00 smithi007 bash[22722]: cluster 2024-09-13T22:54:59.116099+0000 mgr.a (mgr.14355) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:00 smithi131 bash[24745]: audit 2024-09-13T22:54:58.551147+0000 mgr.a (mgr.14355) 1475 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:00 smithi131 bash[24745]: cluster 2024-09-13T22:54:59.116099+0000 mgr.a (mgr.14355) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:00 smithi171 bash[25040]: audit 2024-09-13T22:54:58.551147+0000 mgr.a (mgr.14355) 1475 : audit [DBG] from='client.44631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:00.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:00 smithi171 bash[25040]: cluster 2024-09-13T22:54:59.116099+0000 mgr.a (mgr.14355) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:02.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:02 smithi007 bash[22722]: cluster 2024-09-13T22:55:01.118436+0000 mgr.a (mgr.14355) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:02.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:02 smithi131 bash[24745]: cluster 2024-09-13T22:55:01.118436+0000 mgr.a (mgr.14355) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:02.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:02 smithi171 bash[25040]: cluster 2024-09-13T22:55:01.118436+0000 mgr.a (mgr.14355) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:04 smithi007 bash[22722]: cluster 2024-09-13T22:55:03.119174+0000 mgr.a (mgr.14355) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:04 smithi131 bash[24745]: cluster 2024-09-13T22:55:03.119174+0000 mgr.a (mgr.14355) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:04 smithi171 bash[25040]: cluster 2024-09-13T22:55:03.119174+0000 mgr.a (mgr.14355) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:04.755 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:04.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:04.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:05 smithi131 bash[24745]: audit 2024-09-13T22:55:04.322849+0000 mgr.a (mgr.14355) 1479 : audit [DBG] from='client.44709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:05.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:05 smithi171 bash[25040]: audit 2024-09-13T22:55:04.322849+0000 mgr.a (mgr.14355) 1479 : audit [DBG] from='client.44709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:05 smithi007 bash[22722]: audit 2024-09-13T22:55:04.322849+0000 mgr.a (mgr.14355) 1479 : audit [DBG] from='client.44709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:06 smithi131 bash[24745]: cluster 2024-09-13T22:55:05.120187+0000 mgr.a (mgr.14355) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:06 smithi171 bash[25040]: cluster 2024-09-13T22:55:05.120187+0000 mgr.a (mgr.14355) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:06 smithi007 bash[22722]: cluster 2024-09-13T22:55:05.120187+0000 mgr.a (mgr.14355) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:08.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:08 smithi131 bash[24745]: cluster 2024-09-13T22:55:07.122541+0000 mgr.a (mgr.14355) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:08.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:08 smithi171 bash[25040]: cluster 2024-09-13T22:55:07.122541+0000 mgr.a (mgr.14355) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:08 smithi007 bash[22722]: cluster 2024-09-13T22:55:07.122541+0000 mgr.a (mgr.14355) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:09.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:10 smithi131 bash[24745]: cluster 2024-09-13T22:55:09.123423+0000 mgr.a (mgr.14355) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:10.532 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:10.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:10.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:10.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:10.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:10.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:10 smithi171 bash[25040]: cluster 2024-09-13T22:55:09.123423+0000 mgr.a (mgr.14355) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:10 smithi007 bash[22722]: cluster 2024-09-13T22:55:09.123423+0000 mgr.a (mgr.14355) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:11 smithi131 bash[24745]: audit 2024-09-13T22:55:10.094510+0000 mgr.a (mgr.14355) 1483 : audit [DBG] from='client.44787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:11.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:11 smithi171 bash[25040]: audit 2024-09-13T22:55:10.094510+0000 mgr.a (mgr.14355) 1483 : audit [DBG] from='client.44787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:11 smithi007 bash[22722]: audit 2024-09-13T22:55:10.094510+0000 mgr.a (mgr.14355) 1483 : audit [DBG] from='client.44787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:12 smithi131 bash[24745]: cluster 2024-09-13T22:55:11.126220+0000 mgr.a (mgr.14355) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:12.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:12 smithi171 bash[25040]: cluster 2024-09-13T22:55:11.126220+0000 mgr.a (mgr.14355) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:12 smithi007 bash[22722]: cluster 2024-09-13T22:55:11.126220+0000 mgr.a (mgr.14355) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:14.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:14 smithi131 bash[24745]: cluster 2024-09-13T22:55:13.126999+0000 mgr.a (mgr.14355) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:14.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:14 smithi171 bash[25040]: cluster 2024-09-13T22:55:13.126999+0000 mgr.a (mgr.14355) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:14 smithi007 bash[22722]: cluster 2024-09-13T22:55:13.126999+0000 mgr.a (mgr.14355) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:15.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:16.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:16.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:16.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:16.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:16.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:16.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:16 smithi131 bash[24745]: cluster 2024-09-13T22:55:15.127741+0000 mgr.a (mgr.14355) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:16.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:16 smithi171 bash[25040]: cluster 2024-09-13T22:55:15.127741+0000 mgr.a (mgr.14355) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:16 smithi007 bash[22722]: cluster 2024-09-13T22:55:15.127741+0000 mgr.a (mgr.14355) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:17.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:17 smithi131 bash[24745]: audit 2024-09-13T22:55:15.864930+0000 mgr.a (mgr.14355) 1487 : audit [DBG] from='client.44859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:17.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:17 smithi171 bash[25040]: audit 2024-09-13T22:55:15.864930+0000 mgr.a (mgr.14355) 1487 : audit [DBG] from='client.44859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:17.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:17 smithi007 bash[22722]: audit 2024-09-13T22:55:15.864930+0000 mgr.a (mgr.14355) 1487 : audit [DBG] from='client.44859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:18 smithi131 bash[24745]: cluster 2024-09-13T22:55:17.130461+0000 mgr.a (mgr.14355) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:18.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:18 smithi171 bash[25040]: cluster 2024-09-13T22:55:17.130461+0000 mgr.a (mgr.14355) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:18 smithi007 bash[22722]: cluster 2024-09-13T22:55:17.130461+0000 mgr.a (mgr.14355) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:20.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:20 smithi131 bash[24745]: cluster 2024-09-13T22:55:19.131252+0000 mgr.a (mgr.14355) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:20 smithi171 bash[25040]: cluster 2024-09-13T22:55:19.131252+0000 mgr.a (mgr.14355) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:20 smithi007 bash[22722]: cluster 2024-09-13T22:55:19.131252+0000 mgr.a (mgr.14355) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:21.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:21.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:22.030 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:22.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:22.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:22.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:22.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:22.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:22 smithi131 bash[24745]: cluster 2024-09-13T22:55:21.133256+0000 mgr.a (mgr.14355) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:22.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:22 smithi171 bash[25040]: cluster 2024-09-13T22:55:21.133256+0000 mgr.a (mgr.14355) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:22 smithi007 bash[22722]: cluster 2024-09-13T22:55:21.133256+0000 mgr.a (mgr.14355) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:23 smithi131 bash[24745]: audit 2024-09-13T22:55:21.612690+0000 mgr.a (mgr.14355) 1491 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:23.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:23 smithi171 bash[25040]: audit 2024-09-13T22:55:21.612690+0000 mgr.a (mgr.14355) 1491 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:23.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:23 smithi007 bash[22722]: audit 2024-09-13T22:55:21.612690+0000 mgr.a (mgr.14355) 1491 : audit [DBG] from='client.44937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:24.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:24 smithi131 bash[24745]: cluster 2024-09-13T22:55:23.134131+0000 mgr.a (mgr.14355) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:24 smithi171 bash[25040]: cluster 2024-09-13T22:55:23.134131+0000 mgr.a (mgr.14355) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:24 smithi007 bash[22722]: cluster 2024-09-13T22:55:23.134131+0000 mgr.a (mgr.14355) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:26 smithi131 bash[24745]: cluster 2024-09-13T22:55:25.134915+0000 mgr.a (mgr.14355) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:26 smithi171 bash[25040]: cluster 2024-09-13T22:55:25.134915+0000 mgr.a (mgr.14355) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:26 smithi007 bash[22722]: cluster 2024-09-13T22:55:25.134915+0000 mgr.a (mgr.14355) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:27.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:27.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:28.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:28 smithi131 bash[24745]: cluster 2024-09-13T22:55:27.136127+0000 mgr.a (mgr.14355) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:28.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:28 smithi131 bash[24745]: audit 2024-09-13T22:55:27.373809+0000 mgr.a (mgr.14355) 1495 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:28.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:28 smithi171 bash[25040]: cluster 2024-09-13T22:55:27.136127+0000 mgr.a (mgr.14355) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:28.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:28 smithi171 bash[25040]: audit 2024-09-13T22:55:27.373809+0000 mgr.a (mgr.14355) 1495 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:28 smithi007 bash[22722]: cluster 2024-09-13T22:55:27.136127+0000 mgr.a (mgr.14355) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:28 smithi007 bash[22722]: audit 2024-09-13T22:55:27.373809+0000 mgr.a (mgr.14355) 1495 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:30.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:30 smithi171 bash[25040]: cluster 2024-09-13T22:55:29.136969+0000 mgr.a (mgr.14355) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:30 smithi007 bash[22722]: cluster 2024-09-13T22:55:29.136969+0000 mgr.a (mgr.14355) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:30 smithi131 bash[24745]: cluster 2024-09-13T22:55:29.136969+0000 mgr.a (mgr.14355) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:32.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:32 smithi171 bash[25040]: cluster 2024-09-13T22:55:31.139256+0000 mgr.a (mgr.14355) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:32 smithi007 bash[22722]: cluster 2024-09-13T22:55:31.139256+0000 mgr.a (mgr.14355) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:32 smithi131 bash[24745]: cluster 2024-09-13T22:55:31.139256+0000 mgr.a (mgr.14355) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:55:32.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:32.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:32.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:33.584 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:34.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:34 smithi171 bash[25040]: cluster 2024-09-13T22:55:33.140012+0000 mgr.a (mgr.14355) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:34.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:34 smithi171 bash[25040]: audit 2024-09-13T22:55:33.148586+0000 mgr.a (mgr.14355) 1499 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:34.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:34 smithi171 bash[25040]: audit 2024-09-13T22:55:33.929936+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:34 smithi007 bash[22722]: cluster 2024-09-13T22:55:33.140012+0000 mgr.a (mgr.14355) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:34 smithi007 bash[22722]: audit 2024-09-13T22:55:33.148586+0000 mgr.a (mgr.14355) 1499 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:34 smithi007 bash[22722]: audit 2024-09-13T22:55:33.929936+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:34 smithi131 bash[24745]: cluster 2024-09-13T22:55:33.140012+0000 mgr.a (mgr.14355) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:34 smithi131 bash[24745]: audit 2024-09-13T22:55:33.148586+0000 mgr.a (mgr.14355) 1499 : audit [DBG] from='client.45090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:34 smithi131 bash[24745]: audit 2024-09-13T22:55:33.929936+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:35 smithi171 bash[25040]: audit 2024-09-13T22:55:34.795198+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:35 smithi171 bash[25040]: audit 2024-09-13T22:55:34.796905+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:55:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:35 smithi171 bash[25040]: audit 2024-09-13T22:55:34.806986+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:55:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:35 smithi171 bash[25040]: audit 2024-09-13T22:55:34.809587+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:35.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22972]: debug 2024-09-13T22:55:35.530+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:55:35.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22972]: debug 2024-09-13T22:55:35.530+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:55:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22722]: audit 2024-09-13T22:55:34.795198+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22722]: audit 2024-09-13T22:55:34.796905+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:55:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22722]: audit 2024-09-13T22:55:34.806986+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:55:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:35 smithi007 bash[22722]: audit 2024-09-13T22:55:34.809587+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:35 smithi131 bash[24745]: audit 2024-09-13T22:55:34.795198+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:35 smithi131 bash[24745]: audit 2024-09-13T22:55:34.796905+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:55:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:35 smithi131 bash[24745]: audit 2024-09-13T22:55:34.806986+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:55:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:35 smithi131 bash[24745]: audit 2024-09-13T22:55:34.809587+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:36 smithi007 bash[22722]: audit 2024-09-13T22:55:34.812014+0000 mgr.a (mgr.14355) 1500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:36 smithi007 bash[22722]: cluster 2024-09-13T22:55:35.141116+0000 mgr.a (mgr.14355) 1501 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:36 smithi007 bash[22722]: audit 2024-09-13T22:55:35.534691+0000 mgr.a (mgr.14355) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:55:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:36 smithi007 bash[22722]: cephadm 2024-09-13T22:55:35.535913+0000 mgr.a (mgr.14355) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:55:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:36 smithi131 bash[24745]: audit 2024-09-13T22:55:34.812014+0000 mgr.a (mgr.14355) 1500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:36 smithi131 bash[24745]: cluster 2024-09-13T22:55:35.141116+0000 mgr.a (mgr.14355) 1501 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:36 smithi131 bash[24745]: audit 2024-09-13T22:55:35.534691+0000 mgr.a (mgr.14355) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:55:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:36 smithi131 bash[24745]: cephadm 2024-09-13T22:55:35.535913+0000 mgr.a (mgr.14355) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:55:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:36 smithi171 bash[25040]: audit 2024-09-13T22:55:34.812014+0000 mgr.a (mgr.14355) 1500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:55:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:36 smithi171 bash[25040]: cluster 2024-09-13T22:55:35.141116+0000 mgr.a (mgr.14355) 1501 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:36 smithi171 bash[25040]: audit 2024-09-13T22:55:35.534691+0000 mgr.a (mgr.14355) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:55:36.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:36 smithi171 bash[25040]: cephadm 2024-09-13T22:55:35.535913+0000 mgr.a (mgr.14355) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:55:38.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:38 smithi007 bash[22722]: cluster 2024-09-13T22:55:37.143817+0000 mgr.a (mgr.14355) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:55:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:38 smithi131 bash[24745]: cluster 2024-09-13T22:55:37.143817+0000 mgr.a (mgr.14355) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:55:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:38 smithi171 bash[25040]: cluster 2024-09-13T22:55:37.143817+0000 mgr.a (mgr.14355) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T22:55:39.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:39.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:39.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:39.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:39.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:40 smithi007 bash[22722]: audit 2024-09-13T22:55:38.915966+0000 mgr.a (mgr.14355) 1505 : audit [DBG] from='client.45273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:40 smithi007 bash[22722]: cluster 2024-09-13T22:55:39.144559+0000 mgr.a (mgr.14355) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:55:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:40 smithi131 bash[24745]: audit 2024-09-13T22:55:38.915966+0000 mgr.a (mgr.14355) 1505 : audit [DBG] from='client.45273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:40 smithi131 bash[24745]: cluster 2024-09-13T22:55:39.144559+0000 mgr.a (mgr.14355) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:55:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:40 smithi171 bash[25040]: audit 2024-09-13T22:55:38.915966+0000 mgr.a (mgr.14355) 1505 : audit [DBG] from='client.45273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:40 smithi171 bash[25040]: cluster 2024-09-13T22:55:39.144559+0000 mgr.a (mgr.14355) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T22:55:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:42 smithi007 bash[22722]: cluster 2024-09-13T22:55:41.146907+0000 mgr.a (mgr.14355) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:42 smithi131 bash[24745]: cluster 2024-09-13T22:55:41.146907+0000 mgr.a (mgr.14355) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:42 smithi171 bash[25040]: cluster 2024-09-13T22:55:41.146907+0000 mgr.a (mgr.14355) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:44.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:44 smithi007 bash[22722]: cluster 2024-09-13T22:55:43.147658+0000 mgr.a (mgr.14355) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:44 smithi131 bash[24745]: cluster 2024-09-13T22:55:43.147658+0000 mgr.a (mgr.14355) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:44 smithi171 bash[25040]: cluster 2024-09-13T22:55:43.147658+0000 mgr.a (mgr.14355) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:45.077 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:45.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:46 smithi007 bash[22722]: audit 2024-09-13T22:55:44.663374+0000 mgr.a (mgr.14355) 1509 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:46 smithi007 bash[22722]: cluster 2024-09-13T22:55:45.148321+0000 mgr.a (mgr.14355) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:46 smithi131 bash[24745]: audit 2024-09-13T22:55:44.663374+0000 mgr.a (mgr.14355) 1509 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:46 smithi131 bash[24745]: cluster 2024-09-13T22:55:45.148321+0000 mgr.a (mgr.14355) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:46 smithi171 bash[25040]: audit 2024-09-13T22:55:44.663374+0000 mgr.a (mgr.14355) 1509 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:46 smithi171 bash[25040]: cluster 2024-09-13T22:55:45.148321+0000 mgr.a (mgr.14355) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:48 smithi007 bash[22722]: cluster 2024-09-13T22:55:47.150513+0000 mgr.a (mgr.14355) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:48 smithi131 bash[24745]: cluster 2024-09-13T22:55:47.150513+0000 mgr.a (mgr.14355) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:48 smithi171 bash[25040]: cluster 2024-09-13T22:55:47.150513+0000 mgr.a (mgr.14355) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:55:50.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:50.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:50.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:50 smithi007 bash[22722]: cluster 2024-09-13T22:55:49.151265+0000 mgr.a (mgr.14355) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:50 smithi131 bash[24745]: cluster 2024-09-13T22:55:49.151265+0000 mgr.a (mgr.14355) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:50 smithi171 bash[25040]: cluster 2024-09-13T22:55:49.151265+0000 mgr.a (mgr.14355) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:50.835 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:50.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:50.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:50.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:50.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:51 smithi007 bash[22722]: audit 2024-09-13T22:55:50.412673+0000 mgr.a (mgr.14355) 1513 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:51.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:51 smithi131 bash[24745]: audit 2024-09-13T22:55:50.412673+0000 mgr.a (mgr.14355) 1513 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:51 smithi171 bash[25040]: audit 2024-09-13T22:55:50.412673+0000 mgr.a (mgr.14355) 1513 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:52 smithi007 bash[22722]: cluster 2024-09-13T22:55:51.154096+0000 mgr.a (mgr.14355) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:52 smithi131 bash[24745]: cluster 2024-09-13T22:55:51.154096+0000 mgr.a (mgr.14355) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:52 smithi171 bash[25040]: cluster 2024-09-13T22:55:51.154096+0000 mgr.a (mgr.14355) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T22:55:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:54 smithi007 bash[22722]: cluster 2024-09-13T22:55:53.155043+0000 mgr.a (mgr.14355) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:54.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:54 smithi131 bash[24745]: cluster 2024-09-13T22:55:53.155043+0000 mgr.a (mgr.14355) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:54 smithi171 bash[25040]: cluster 2024-09-13T22:55:53.155043+0000 mgr.a (mgr.14355) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:55:55.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:55:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:55:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:55:56.569 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:55:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:55:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:55:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:55:56.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:55:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:56 smithi007 bash[22722]: cluster 2024-09-13T22:55:55.155971+0000 mgr.a (mgr.14355) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:55:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:56 smithi131 bash[24745]: cluster 2024-09-13T22:55:55.155971+0000 mgr.a (mgr.14355) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:55:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:56 smithi171 bash[25040]: cluster 2024-09-13T22:55:55.155971+0000 mgr.a (mgr.14355) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:55:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:57 smithi007 bash[22722]: audit 2024-09-13T22:55:56.165520+0000 mgr.a (mgr.14355) 1517 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:57 smithi131 bash[24745]: audit 2024-09-13T22:55:56.165520+0000 mgr.a (mgr.14355) 1517 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:57.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:57 smithi171 bash[25040]: audit 2024-09-13T22:55:56.165520+0000 mgr.a (mgr.14355) 1517 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:55:58 smithi007 bash[22722]: cluster 2024-09-13T22:55:57.158686+0000 mgr.a (mgr.14355) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:55:58 smithi131 bash[24745]: cluster 2024-09-13T22:55:57.158686+0000 mgr.a (mgr.14355) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:55:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:55:58 smithi171 bash[25040]: cluster 2024-09-13T22:55:57.158686+0000 mgr.a (mgr.14355) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:00 smithi007 bash[22722]: cluster 2024-09-13T22:55:59.159498+0000 mgr.a (mgr.14355) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:00 smithi131 bash[24745]: cluster 2024-09-13T22:55:59.159498+0000 mgr.a (mgr.14355) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:00 smithi171 bash[25040]: cluster 2024-09-13T22:55:59.159498+0000 mgr.a (mgr.14355) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:01.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:01.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:01.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:02.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:02.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:02 smithi007 bash[22722]: cluster 2024-09-13T22:56:01.161522+0000 mgr.a (mgr.14355) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:02 smithi131 bash[24745]: cluster 2024-09-13T22:56:01.161522+0000 mgr.a (mgr.14355) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:02 smithi171 bash[25040]: cluster 2024-09-13T22:56:01.161522+0000 mgr.a (mgr.14355) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:03.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:03 smithi007 bash[22722]: audit 2024-09-13T22:56:01.905439+0000 mgr.a (mgr.14355) 1521 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:03.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:03 smithi131 bash[24745]: audit 2024-09-13T22:56:01.905439+0000 mgr.a (mgr.14355) 1521 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:03.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:03 smithi171 bash[25040]: audit 2024-09-13T22:56:01.905439+0000 mgr.a (mgr.14355) 1521 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:04 smithi007 bash[22722]: cluster 2024-09-13T22:56:03.162409+0000 mgr.a (mgr.14355) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:04 smithi131 bash[24745]: cluster 2024-09-13T22:56:03.162409+0000 mgr.a (mgr.14355) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:04 smithi171 bash[25040]: cluster 2024-09-13T22:56:03.162409+0000 mgr.a (mgr.14355) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:06 smithi007 bash[22722]: cluster 2024-09-13T22:56:05.163144+0000 mgr.a (mgr.14355) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:06 smithi131 bash[24745]: cluster 2024-09-13T22:56:05.163144+0000 mgr.a (mgr.14355) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:06 smithi171 bash[25040]: cluster 2024-09-13T22:56:05.163144+0000 mgr.a (mgr.14355) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:07.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:07.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:07.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:08.082 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:08.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:08 smithi007 bash[22722]: cluster 2024-09-13T22:56:07.165365+0000 mgr.a (mgr.14355) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:08.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:08 smithi131 bash[24745]: cluster 2024-09-13T22:56:07.165365+0000 mgr.a (mgr.14355) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:08 smithi171 bash[25040]: cluster 2024-09-13T22:56:07.165365+0000 mgr.a (mgr.14355) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:09 smithi007 bash[22722]: audit 2024-09-13T22:56:07.671525+0000 mgr.a (mgr.14355) 1525 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:09.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:09 smithi131 bash[24745]: audit 2024-09-13T22:56:07.671525+0000 mgr.a (mgr.14355) 1525 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:09.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:09 smithi171 bash[25040]: audit 2024-09-13T22:56:07.671525+0000 mgr.a (mgr.14355) 1525 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:10 smithi007 bash[22722]: cluster 2024-09-13T22:56:09.166252+0000 mgr.a (mgr.14355) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:10.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:10 smithi131 bash[24745]: cluster 2024-09-13T22:56:09.166252+0000 mgr.a (mgr.14355) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:10 smithi171 bash[25040]: cluster 2024-09-13T22:56:09.166252+0000 mgr.a (mgr.14355) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:12 smithi007 bash[22722]: cluster 2024-09-13T22:56:11.168495+0000 mgr.a (mgr.14355) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:12 smithi131 bash[24745]: cluster 2024-09-13T22:56:11.168495+0000 mgr.a (mgr.14355) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:12.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:12 smithi171 bash[25040]: cluster 2024-09-13T22:56:11.168495+0000 mgr.a (mgr.14355) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:13.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:13.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:13.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:13.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:13.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:14 smithi007 bash[22722]: cluster 2024-09-13T22:56:13.168952+0000 mgr.a (mgr.14355) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:14 smithi007 bash[22722]: audit 2024-09-13T22:56:13.423431+0000 mgr.a (mgr.14355) 1529 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:14 smithi131 bash[24745]: cluster 2024-09-13T22:56:13.168952+0000 mgr.a (mgr.14355) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:14 smithi131 bash[24745]: audit 2024-09-13T22:56:13.423431+0000 mgr.a (mgr.14355) 1529 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:14 smithi171 bash[25040]: cluster 2024-09-13T22:56:13.168952+0000 mgr.a (mgr.14355) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:14 smithi171 bash[25040]: audit 2024-09-13T22:56:13.423431+0000 mgr.a (mgr.14355) 1529 : audit [DBG] from='client.45735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:16 smithi007 bash[22722]: cluster 2024-09-13T22:56:15.170451+0000 mgr.a (mgr.14355) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:16 smithi131 bash[24745]: cluster 2024-09-13T22:56:15.170451+0000 mgr.a (mgr.14355) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:16 smithi171 bash[25040]: cluster 2024-09-13T22:56:15.170451+0000 mgr.a (mgr.14355) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:18 smithi007 bash[22722]: cluster 2024-09-13T22:56:17.172105+0000 mgr.a (mgr.14355) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:18 smithi131 bash[24745]: cluster 2024-09-13T22:56:17.172105+0000 mgr.a (mgr.14355) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:18 smithi171 bash[25040]: cluster 2024-09-13T22:56:17.172105+0000 mgr.a (mgr.14355) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:18.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:19.593 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:19.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:20 smithi007 bash[22722]: cluster 2024-09-13T22:56:19.172829+0000 mgr.a (mgr.14355) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:20 smithi007 bash[22722]: audit 2024-09-13T22:56:19.184224+0000 mgr.a (mgr.14355) 1533 : audit [DBG] from='client.45807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:20 smithi131 bash[24745]: cluster 2024-09-13T22:56:19.172829+0000 mgr.a (mgr.14355) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:20 smithi131 bash[24745]: audit 2024-09-13T22:56:19.184224+0000 mgr.a (mgr.14355) 1533 : audit [DBG] from='client.45807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:20 smithi171 bash[25040]: cluster 2024-09-13T22:56:19.172829+0000 mgr.a (mgr.14355) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:20 smithi171 bash[25040]: audit 2024-09-13T22:56:19.184224+0000 mgr.a (mgr.14355) 1533 : audit [DBG] from='client.45807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:22 smithi007 bash[22722]: cluster 2024-09-13T22:56:21.175177+0000 mgr.a (mgr.14355) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:22 smithi131 bash[24745]: cluster 2024-09-13T22:56:21.175177+0000 mgr.a (mgr.14355) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:22 smithi171 bash[25040]: cluster 2024-09-13T22:56:21.175177+0000 mgr.a (mgr.14355) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:24 smithi007 bash[22722]: cluster 2024-09-13T22:56:23.175932+0000 mgr.a (mgr.14355) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:24 smithi131 bash[24745]: cluster 2024-09-13T22:56:23.175932+0000 mgr.a (mgr.14355) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:24 smithi171 bash[25040]: cluster 2024-09-13T22:56:23.175932+0000 mgr.a (mgr.14355) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:25.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:26 smithi007 bash[22722]: audit 2024-09-13T22:56:24.926424+0000 mgr.a (mgr.14355) 1536 : audit [DBG] from='client.45885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:26 smithi007 bash[22722]: cluster 2024-09-13T22:56:25.177477+0000 mgr.a (mgr.14355) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:26 smithi131 bash[24745]: audit 2024-09-13T22:56:24.926424+0000 mgr.a (mgr.14355) 1536 : audit [DBG] from='client.45885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:26 smithi131 bash[24745]: cluster 2024-09-13T22:56:25.177477+0000 mgr.a (mgr.14355) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:26.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:26 smithi171 bash[25040]: audit 2024-09-13T22:56:24.926424+0000 mgr.a (mgr.14355) 1536 : audit [DBG] from='client.45885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:26.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:26 smithi171 bash[25040]: cluster 2024-09-13T22:56:25.177477+0000 mgr.a (mgr.14355) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T22:56:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:28 smithi007 bash[22722]: cluster 2024-09-13T22:56:27.179692+0000 mgr.a (mgr.14355) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T22:56:28.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:28 smithi131 bash[24745]: cluster 2024-09-13T22:56:27.179692+0000 mgr.a (mgr.14355) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T22:56:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:28 smithi171 bash[25040]: cluster 2024-09-13T22:56:27.179692+0000 mgr.a (mgr.14355) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T22:56:30.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:30 smithi007 bash[22722]: cluster 2024-09-13T22:56:29.180459+0000 mgr.a (mgr.14355) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:56:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:30 smithi131 bash[24745]: cluster 2024-09-13T22:56:29.180459+0000 mgr.a (mgr.14355) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:56:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:30 smithi171 bash[25040]: cluster 2024-09-13T22:56:29.180459+0000 mgr.a (mgr.14355) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:56:31.086 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:31.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:31.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:31.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:31.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:32 smithi007 bash[22722]: audit 2024-09-13T22:56:30.675099+0000 mgr.a (mgr.14355) 1540 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:32 smithi007 bash[22722]: cluster 2024-09-13T22:56:31.181872+0000 mgr.a (mgr.14355) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:32 smithi131 bash[24745]: audit 2024-09-13T22:56:30.675099+0000 mgr.a (mgr.14355) 1540 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:32 smithi131 bash[24745]: cluster 2024-09-13T22:56:31.181872+0000 mgr.a (mgr.14355) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:32 smithi171 bash[25040]: audit 2024-09-13T22:56:30.675099+0000 mgr.a (mgr.14355) 1540 : audit [DBG] from='client.45963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:32 smithi171 bash[25040]: cluster 2024-09-13T22:56:31.181872+0000 mgr.a (mgr.14355) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:34 smithi007 bash[22722]: cluster 2024-09-13T22:56:33.182769+0000 mgr.a (mgr.14355) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:34 smithi131 bash[24745]: cluster 2024-09-13T22:56:33.182769+0000 mgr.a (mgr.14355) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:34 smithi171 bash[25040]: cluster 2024-09-13T22:56:33.182769+0000 mgr.a (mgr.14355) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:56:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:36.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: cluster 2024-09-13T22:56:35.184473+0000 mgr.a (mgr.14355) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: audit 2024-09-13T22:56:35.585510+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: audit 2024-09-13T22:56:36.411294+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: audit 2024-09-13T22:56:36.423600+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: audit 2024-09-13T22:56:36.433431+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:56:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:36 smithi007 bash[22722]: audit 2024-09-13T22:56:36.436214+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: cluster 2024-09-13T22:56:35.184473+0000 mgr.a (mgr.14355) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: audit 2024-09-13T22:56:35.585510+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: audit 2024-09-13T22:56:36.411294+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: audit 2024-09-13T22:56:36.423600+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: audit 2024-09-13T22:56:36.433431+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:56:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:36 smithi131 bash[24745]: audit 2024-09-13T22:56:36.436214+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: cluster 2024-09-13T22:56:35.184473+0000 mgr.a (mgr.14355) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: audit 2024-09-13T22:56:35.585510+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: audit 2024-09-13T22:56:36.411294+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: audit 2024-09-13T22:56:36.423600+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: audit 2024-09-13T22:56:36.433431+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:56:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:36 smithi171 bash[25040]: audit 2024-09-13T22:56:36.436214+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:36.806 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:37 smithi007 bash[22722]: audit 2024-09-13T22:56:36.409787+0000 mgr.a (mgr.14355) 1544 : audit [DBG] from='client.46041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:37 smithi007 bash[22722]: audit 2024-09-13T22:56:36.437441+0000 mgr.a (mgr.14355) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:56:37 smithi007 bash[22972]: debug 2024-09-13T22:56:37.477+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:56:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:56:37 smithi007 bash[22972]: debug 2024-09-13T22:56:37.477+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:56:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:37 smithi131 bash[24745]: audit 2024-09-13T22:56:36.409787+0000 mgr.a (mgr.14355) 1544 : audit [DBG] from='client.46041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:37 smithi131 bash[24745]: audit 2024-09-13T22:56:36.437441+0000 mgr.a (mgr.14355) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:37 smithi171 bash[25040]: audit 2024-09-13T22:56:36.409787+0000 mgr.a (mgr.14355) 1544 : audit [DBG] from='client.46041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:37 smithi171 bash[25040]: audit 2024-09-13T22:56:36.437441+0000 mgr.a (mgr.14355) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:56:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:38 smithi131 bash[24745]: cluster 2024-09-13T22:56:37.185743+0000 mgr.a (mgr.14355) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:56:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:38 smithi131 bash[24745]: audit 2024-09-13T22:56:37.480197+0000 mgr.a (mgr.14355) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:56:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:38 smithi131 bash[24745]: cephadm 2024-09-13T22:56:37.481617+0000 mgr.a (mgr.14355) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:56:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:38 smithi171 bash[25040]: cluster 2024-09-13T22:56:37.185743+0000 mgr.a (mgr.14355) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:56:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:38 smithi171 bash[25040]: audit 2024-09-13T22:56:37.480197+0000 mgr.a (mgr.14355) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:56:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:38 smithi171 bash[25040]: cephadm 2024-09-13T22:56:37.481617+0000 mgr.a (mgr.14355) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:56:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:38 smithi007 bash[22722]: cluster 2024-09-13T22:56:37.185743+0000 mgr.a (mgr.14355) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T22:56:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:38 smithi007 bash[22722]: audit 2024-09-13T22:56:37.480197+0000 mgr.a (mgr.14355) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:56:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:38 smithi007 bash[22722]: cephadm 2024-09-13T22:56:37.481617+0000 mgr.a (mgr.14355) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:56:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:40 smithi131 bash[24745]: cluster 2024-09-13T22:56:39.186600+0000 mgr.a (mgr.14355) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:56:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:40 smithi171 bash[25040]: cluster 2024-09-13T22:56:39.186600+0000 mgr.a (mgr.14355) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:56:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:40 smithi007 bash[22722]: cluster 2024-09-13T22:56:39.186600+0000 mgr.a (mgr.14355) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:56:41.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:41.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:42.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:42.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:42 smithi131 bash[24745]: cluster 2024-09-13T22:56:41.188832+0000 mgr.a (mgr.14355) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:42 smithi171 bash[25040]: cluster 2024-09-13T22:56:41.188832+0000 mgr.a (mgr.14355) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:42 smithi007 bash[22722]: cluster 2024-09-13T22:56:41.188832+0000 mgr.a (mgr.14355) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:43 smithi131 bash[24745]: audit 2024-09-13T22:56:42.141599+0000 mgr.a (mgr.14355) 1551 : audit [DBG] from='client.46221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:43 smithi171 bash[25040]: audit 2024-09-13T22:56:42.141599+0000 mgr.a (mgr.14355) 1551 : audit [DBG] from='client.46221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:43 smithi007 bash[22722]: audit 2024-09-13T22:56:42.141599+0000 mgr.a (mgr.14355) 1551 : audit [DBG] from='client.46221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:44 smithi131 bash[24745]: cluster 2024-09-13T22:56:43.189711+0000 mgr.a (mgr.14355) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:44 smithi171 bash[25040]: cluster 2024-09-13T22:56:43.189711+0000 mgr.a (mgr.14355) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:44 smithi007 bash[22722]: cluster 2024-09-13T22:56:43.189711+0000 mgr.a (mgr.14355) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:46 smithi131 bash[24745]: cluster 2024-09-13T22:56:45.191485+0000 mgr.a (mgr.14355) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:46 smithi171 bash[25040]: cluster 2024-09-13T22:56:45.191485+0000 mgr.a (mgr.14355) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:46 smithi007 bash[22722]: cluster 2024-09-13T22:56:45.191485+0000 mgr.a (mgr.14355) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:48.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:48.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:48.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:48 smithi131 bash[24745]: cluster 2024-09-13T22:56:47.192962+0000 mgr.a (mgr.14355) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:48 smithi171 bash[25040]: cluster 2024-09-13T22:56:47.192962+0000 mgr.a (mgr.14355) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:48 smithi007 bash[22722]: cluster 2024-09-13T22:56:47.192962+0000 mgr.a (mgr.14355) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:49 smithi131 bash[24745]: audit 2024-09-13T22:56:47.896873+0000 mgr.a (mgr.14355) 1555 : audit [DBG] from='client.46299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:49.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:49 smithi171 bash[25040]: audit 2024-09-13T22:56:47.896873+0000 mgr.a (mgr.14355) 1555 : audit [DBG] from='client.46299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:49 smithi007 bash[22722]: audit 2024-09-13T22:56:47.896873+0000 mgr.a (mgr.14355) 1555 : audit [DBG] from='client.46299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:50 smithi131 bash[24745]: cluster 2024-09-13T22:56:49.193853+0000 mgr.a (mgr.14355) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:50 smithi171 bash[25040]: cluster 2024-09-13T22:56:49.193853+0000 mgr.a (mgr.14355) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:50 smithi007 bash[22722]: cluster 2024-09-13T22:56:49.193853+0000 mgr.a (mgr.14355) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:52 smithi131 bash[24745]: cluster 2024-09-13T22:56:51.196170+0000 mgr.a (mgr.14355) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:52 smithi171 bash[25040]: cluster 2024-09-13T22:56:51.196170+0000 mgr.a (mgr.14355) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:52 smithi007 bash[22722]: cluster 2024-09-13T22:56:51.196170+0000 mgr.a (mgr.14355) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:56:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:53.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:54.100 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:54.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:54.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:56:54.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:54 smithi131 bash[24745]: cluster 2024-09-13T22:56:53.196932+0000 mgr.a (mgr.14355) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:54 smithi171 bash[25040]: cluster 2024-09-13T22:56:53.196932+0000 mgr.a (mgr.14355) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:54 smithi007 bash[22722]: cluster 2024-09-13T22:56:53.196932+0000 mgr.a (mgr.14355) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:56:55.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:55 smithi131 bash[24745]: audit 2024-09-13T22:56:53.668612+0000 mgr.a (mgr.14355) 1559 : audit [DBG] from='client.46377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:55.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:55 smithi171 bash[25040]: audit 2024-09-13T22:56:53.668612+0000 mgr.a (mgr.14355) 1559 : audit [DBG] from='client.46377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:55 smithi007 bash[22722]: audit 2024-09-13T22:56:53.668612+0000 mgr.a (mgr.14355) 1559 : audit [DBG] from='client.46377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:56 smithi131 bash[24745]: cluster 2024-09-13T22:56:55.199274+0000 mgr.a (mgr.14355) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:56 smithi171 bash[25040]: cluster 2024-09-13T22:56:55.199274+0000 mgr.a (mgr.14355) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:56 smithi007 bash[22722]: cluster 2024-09-13T22:56:55.199274+0000 mgr.a (mgr.14355) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:56:58.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:56:58 smithi131 bash[24745]: cluster 2024-09-13T22:56:57.200185+0000 mgr.a (mgr.14355) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:56:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:56:58 smithi171 bash[25040]: cluster 2024-09-13T22:56:57.200185+0000 mgr.a (mgr.14355) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:56:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:56:58 smithi007 bash[22722]: cluster 2024-09-13T22:56:57.200185+0000 mgr.a (mgr.14355) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:56:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:56:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:56:59.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:56:59.857 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:56:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:56:59.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:56:59.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:56:59.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:00 smithi131 bash[24745]: cluster 2024-09-13T22:56:59.200708+0000 mgr.a (mgr.14355) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:00 smithi131 bash[24745]: audit 2024-09-13T22:56:59.435537+0000 mgr.a (mgr.14355) 1563 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:00 smithi171 bash[25040]: cluster 2024-09-13T22:56:59.200708+0000 mgr.a (mgr.14355) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:00 smithi171 bash[25040]: audit 2024-09-13T22:56:59.435537+0000 mgr.a (mgr.14355) 1563 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:00 smithi007 bash[22722]: cluster 2024-09-13T22:56:59.200708+0000 mgr.a (mgr.14355) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:00 smithi007 bash[22722]: audit 2024-09-13T22:56:59.435537+0000 mgr.a (mgr.14355) 1563 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:02 smithi131 bash[24745]: cluster 2024-09-13T22:57:01.203236+0000 mgr.a (mgr.14355) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:02 smithi171 bash[25040]: cluster 2024-09-13T22:57:01.203236+0000 mgr.a (mgr.14355) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:02 smithi007 bash[22722]: cluster 2024-09-13T22:57:01.203236+0000 mgr.a (mgr.14355) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:04 smithi131 bash[24745]: cluster 2024-09-13T22:57:03.204083+0000 mgr.a (mgr.14355) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:04 smithi171 bash[25040]: cluster 2024-09-13T22:57:03.204083+0000 mgr.a (mgr.14355) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:04.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:04 smithi007 bash[22722]: cluster 2024-09-13T22:57:03.204083+0000 mgr.a (mgr.14355) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:05.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:05.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:06 smithi171 bash[25040]: audit 2024-09-13T22:57:05.192232+0000 mgr.a (mgr.14355) 1566 : audit [DBG] from='client.46527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:06 smithi171 bash[25040]: cluster 2024-09-13T22:57:05.210338+0000 mgr.a (mgr.14355) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:06 smithi007 bash[22722]: audit 2024-09-13T22:57:05.192232+0000 mgr.a (mgr.14355) 1566 : audit [DBG] from='client.46527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:06 smithi007 bash[22722]: cluster 2024-09-13T22:57:05.210338+0000 mgr.a (mgr.14355) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:06 smithi131 bash[24745]: audit 2024-09-13T22:57:05.192232+0000 mgr.a (mgr.14355) 1566 : audit [DBG] from='client.46527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:06 smithi131 bash[24745]: cluster 2024-09-13T22:57:05.210338+0000 mgr.a (mgr.14355) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:08 smithi171 bash[25040]: cluster 2024-09-13T22:57:07.212375+0000 mgr.a (mgr.14355) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:08 smithi007 bash[22722]: cluster 2024-09-13T22:57:07.212375+0000 mgr.a (mgr.14355) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:08 smithi131 bash[24745]: cluster 2024-09-13T22:57:07.212375+0000 mgr.a (mgr.14355) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:10.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:10 smithi171 bash[25040]: cluster 2024-09-13T22:57:09.213155+0000 mgr.a (mgr.14355) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:10 smithi007 bash[22722]: cluster 2024-09-13T22:57:09.213155+0000 mgr.a (mgr.14355) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:10 smithi131 bash[24745]: cluster 2024-09-13T22:57:09.213155+0000 mgr.a (mgr.14355) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:11.375 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:12 smithi007 bash[22722]: audit 2024-09-13T22:57:10.962096+0000 mgr.a (mgr.14355) 1570 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:12 smithi007 bash[22722]: cluster 2024-09-13T22:57:11.214505+0000 mgr.a (mgr.14355) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:12 smithi131 bash[24745]: audit 2024-09-13T22:57:10.962096+0000 mgr.a (mgr.14355) 1570 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:12 smithi131 bash[24745]: cluster 2024-09-13T22:57:11.214505+0000 mgr.a (mgr.14355) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:12 smithi171 bash[25040]: audit 2024-09-13T22:57:10.962096+0000 mgr.a (mgr.14355) 1570 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:12 smithi171 bash[25040]: cluster 2024-09-13T22:57:11.214505+0000 mgr.a (mgr.14355) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:14 smithi007 bash[22722]: cluster 2024-09-13T22:57:13.215497+0000 mgr.a (mgr.14355) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:14 smithi131 bash[24745]: cluster 2024-09-13T22:57:13.215497+0000 mgr.a (mgr.14355) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:15.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:14 smithi171 bash[25040]: cluster 2024-09-13T22:57:13.215497+0000 mgr.a (mgr.14355) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:16 smithi007 bash[22722]: cluster 2024-09-13T22:57:15.217676+0000 mgr.a (mgr.14355) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:16 smithi131 bash[24745]: cluster 2024-09-13T22:57:15.217676+0000 mgr.a (mgr.14355) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:16 smithi171 bash[25040]: cluster 2024-09-13T22:57:15.217676+0000 mgr.a (mgr.14355) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:17.139 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:17.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:17.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:18 smithi007 bash[22722]: audit 2024-09-13T22:57:16.712843+0000 mgr.a (mgr.14355) 1574 : audit [DBG] from='client.46677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:18 smithi007 bash[22722]: cluster 2024-09-13T22:57:17.218603+0000 mgr.a (mgr.14355) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:18 smithi131 bash[24745]: audit 2024-09-13T22:57:16.712843+0000 mgr.a (mgr.14355) 1574 : audit [DBG] from='client.46677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:18 smithi131 bash[24745]: cluster 2024-09-13T22:57:17.218603+0000 mgr.a (mgr.14355) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:19.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:18 smithi171 bash[25040]: audit 2024-09-13T22:57:16.712843+0000 mgr.a (mgr.14355) 1574 : audit [DBG] from='client.46677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:19.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:18 smithi171 bash[25040]: cluster 2024-09-13T22:57:17.218603+0000 mgr.a (mgr.14355) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:19 smithi007 bash[22722]: cluster 2024-09-13T22:57:19.219384+0000 mgr.a (mgr.14355) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:19 smithi131 bash[24745]: cluster 2024-09-13T22:57:19.219384+0000 mgr.a (mgr.14355) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:20.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:19 smithi171 bash[25040]: cluster 2024-09-13T22:57:19.219384+0000 mgr.a (mgr.14355) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:22.141 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:22.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:22.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:22.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:22 smithi131 bash[24745]: cluster 2024-09-13T22:57:21.221595+0000 mgr.a (mgr.14355) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:22.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:22 smithi171 bash[25040]: cluster 2024-09-13T22:57:21.221595+0000 mgr.a (mgr.14355) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:22 smithi007 bash[22722]: cluster 2024-09-13T22:57:21.221595+0000 mgr.a (mgr.14355) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:22.919 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:22.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:22.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:22.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:22.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:23.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:23 smithi131 bash[24745]: audit 2024-09-13T22:57:22.483120+0000 mgr.a (mgr.14355) 1578 : audit [DBG] from='client.46755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:23.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:23 smithi171 bash[25040]: audit 2024-09-13T22:57:22.483120+0000 mgr.a (mgr.14355) 1578 : audit [DBG] from='client.46755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:23.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:23 smithi007 bash[22722]: audit 2024-09-13T22:57:22.483120+0000 mgr.a (mgr.14355) 1578 : audit [DBG] from='client.46755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:24 smithi171 bash[25040]: cluster 2024-09-13T22:57:23.222741+0000 mgr.a (mgr.14355) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:24 smithi007 bash[22722]: cluster 2024-09-13T22:57:23.222741+0000 mgr.a (mgr.14355) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:24 smithi131 bash[24745]: cluster 2024-09-13T22:57:23.222741+0000 mgr.a (mgr.14355) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:26 smithi007 bash[22722]: cluster 2024-09-13T22:57:25.224973+0000 mgr.a (mgr.14355) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:26 smithi131 bash[24745]: cluster 2024-09-13T22:57:25.224973+0000 mgr.a (mgr.14355) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:26 smithi171 bash[25040]: cluster 2024-09-13T22:57:25.224973+0000 mgr.a (mgr.14355) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:27.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:27.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:27.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:28.660 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:28.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:28.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:28.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:28.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:28 smithi007 bash[22722]: cluster 2024-09-13T22:57:27.225745+0000 mgr.a (mgr.14355) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:28 smithi131 bash[24745]: cluster 2024-09-13T22:57:27.225745+0000 mgr.a (mgr.14355) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:28 smithi171 bash[25040]: cluster 2024-09-13T22:57:27.225745+0000 mgr.a (mgr.14355) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:29.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:29 smithi007 bash[22722]: audit 2024-09-13T22:57:28.253724+0000 mgr.a (mgr.14355) 1582 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:29.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:29 smithi131 bash[24745]: audit 2024-09-13T22:57:28.253724+0000 mgr.a (mgr.14355) 1582 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:29.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:29 smithi171 bash[25040]: audit 2024-09-13T22:57:28.253724+0000 mgr.a (mgr.14355) 1582 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:30 smithi007 bash[22722]: cluster 2024-09-13T22:57:29.226704+0000 mgr.a (mgr.14355) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:30 smithi131 bash[24745]: cluster 2024-09-13T22:57:29.226704+0000 mgr.a (mgr.14355) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:30 smithi171 bash[25040]: cluster 2024-09-13T22:57:29.226704+0000 mgr.a (mgr.14355) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:32 smithi007 bash[22722]: cluster 2024-09-13T22:57:31.228956+0000 mgr.a (mgr.14355) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:32 smithi131 bash[24745]: cluster 2024-09-13T22:57:31.228956+0000 mgr.a (mgr.14355) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:32 smithi171 bash[25040]: cluster 2024-09-13T22:57:31.228956+0000 mgr.a (mgr.14355) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:33.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:33.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:34.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:34 smithi007 bash[22722]: cluster 2024-09-13T22:57:33.229722+0000 mgr.a (mgr.14355) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:34 smithi131 bash[24745]: cluster 2024-09-13T22:57:33.229722+0000 mgr.a (mgr.14355) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:34 smithi171 bash[25040]: cluster 2024-09-13T22:57:33.229722+0000 mgr.a (mgr.14355) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:35 smithi007 bash[22722]: audit 2024-09-13T22:57:33.990957+0000 mgr.a (mgr.14355) 1586 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:35 smithi131 bash[24745]: audit 2024-09-13T22:57:33.990957+0000 mgr.a (mgr.14355) 1586 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:35.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:35 smithi171 bash[25040]: audit 2024-09-13T22:57:33.990957+0000 mgr.a (mgr.14355) 1586 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:36 smithi007 bash[22722]: cluster 2024-09-13T22:57:35.232007+0000 mgr.a (mgr.14355) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:36 smithi131 bash[24745]: cluster 2024-09-13T22:57:35.232007+0000 mgr.a (mgr.14355) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:36 smithi171 bash[25040]: cluster 2024-09-13T22:57:35.232007+0000 mgr.a (mgr.14355) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:57:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:38 smithi007 bash[22722]: cluster 2024-09-13T22:57:37.232799+0000 mgr.a (mgr.14355) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:38 smithi007 bash[22722]: audit 2024-09-13T22:57:37.535455+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:38 smithi007 bash[22722]: audit 2024-09-13T22:57:38.160447+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:38 smithi007 bash[22722]: audit 2024-09-13T22:57:38.164639+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:38 smithi131 bash[24745]: cluster 2024-09-13T22:57:37.232799+0000 mgr.a (mgr.14355) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:38 smithi131 bash[24745]: audit 2024-09-13T22:57:37.535455+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:38 smithi131 bash[24745]: audit 2024-09-13T22:57:38.160447+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:38 smithi131 bash[24745]: audit 2024-09-13T22:57:38.164639+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:38 smithi171 bash[25040]: cluster 2024-09-13T22:57:37.232799+0000 mgr.a (mgr.14355) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:38 smithi171 bash[25040]: audit 2024-09-13T22:57:37.535455+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:38 smithi171 bash[25040]: audit 2024-09-13T22:57:38.160447+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:38 smithi171 bash[25040]: audit 2024-09-13T22:57:38.164639+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:39.634 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22722]: audit 2024-09-13T22:57:38.935009+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:39.634 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22722]: audit 2024-09-13T22:57:38.935984+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:39.634 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22722]: audit 2024-09-13T22:57:38.943466+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:39.634 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22722]: audit 2024-09-13T22:57:38.946267+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:39 smithi131 bash[24745]: audit 2024-09-13T22:57:38.935009+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:39 smithi131 bash[24745]: audit 2024-09-13T22:57:38.935984+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:39 smithi131 bash[24745]: audit 2024-09-13T22:57:38.943466+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:39 smithi131 bash[24745]: audit 2024-09-13T22:57:38.946267+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:39 smithi171 bash[25040]: audit 2024-09-13T22:57:38.935009+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:39 smithi171 bash[25040]: audit 2024-09-13T22:57:38.935984+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:39 smithi171 bash[25040]: audit 2024-09-13T22:57:38.943466+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:57:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:39 smithi171 bash[25040]: audit 2024-09-13T22:57:38.946267+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:39.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22972]: debug 2024-09-13T22:57:39.632+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:57:39.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:57:39 smithi007 bash[22972]: debug 2024-09-13T22:57:39.632+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:57:40.139 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:40 smithi007 bash[22722]: audit 2024-09-13T22:57:38.947415+0000 mgr.a (mgr.14355) 1589 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:40 smithi007 bash[22722]: cluster 2024-09-13T22:57:39.233282+0000 mgr.a (mgr.14355) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:40 smithi131 bash[24745]: audit 2024-09-13T22:57:38.947415+0000 mgr.a (mgr.14355) 1589 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:40 smithi131 bash[24745]: cluster 2024-09-13T22:57:39.233282+0000 mgr.a (mgr.14355) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:40 smithi171 bash[25040]: audit 2024-09-13T22:57:38.947415+0000 mgr.a (mgr.14355) 1589 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:57:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:40 smithi171 bash[25040]: cluster 2024-09-13T22:57:39.233282+0000 mgr.a (mgr.14355) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:41 smithi007 bash[22722]: audit 2024-09-13T22:57:39.635049+0000 mgr.a (mgr.14355) 1591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:57:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:41 smithi007 bash[22722]: cephadm 2024-09-13T22:57:39.636790+0000 mgr.a (mgr.14355) 1592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:57:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:41 smithi007 bash[22722]: audit 2024-09-13T22:57:39.728708+0000 mgr.a (mgr.14355) 1593 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:41 smithi131 bash[24745]: audit 2024-09-13T22:57:39.635049+0000 mgr.a (mgr.14355) 1591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:57:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:41 smithi131 bash[24745]: cephadm 2024-09-13T22:57:39.636790+0000 mgr.a (mgr.14355) 1592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:57:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:41 smithi131 bash[24745]: audit 2024-09-13T22:57:39.728708+0000 mgr.a (mgr.14355) 1593 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:41 smithi171 bash[25040]: audit 2024-09-13T22:57:39.635049+0000 mgr.a (mgr.14355) 1591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:57:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:41 smithi171 bash[25040]: cephadm 2024-09-13T22:57:39.636790+0000 mgr.a (mgr.14355) 1592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:57:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:41 smithi171 bash[25040]: audit 2024-09-13T22:57:39.728708+0000 mgr.a (mgr.14355) 1593 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:42 smithi007 bash[22722]: cluster 2024-09-13T22:57:41.235686+0000 mgr.a (mgr.14355) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:42 smithi131 bash[24745]: cluster 2024-09-13T22:57:41.235686+0000 mgr.a (mgr.14355) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:42 smithi171 bash[25040]: cluster 2024-09-13T22:57:41.235686+0000 mgr.a (mgr.14355) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:44.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:44 smithi007 bash[22722]: cluster 2024-09-13T22:57:43.236485+0000 mgr.a (mgr.14355) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:44 smithi131 bash[24745]: cluster 2024-09-13T22:57:43.236485+0000 mgr.a (mgr.14355) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:44 smithi171 bash[25040]: cluster 2024-09-13T22:57:43.236485+0000 mgr.a (mgr.14355) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:45.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:45.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:45.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:45.890 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:45.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:45.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:45.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:45.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:46 smithi007 bash[22722]: cluster 2024-09-13T22:57:45.237658+0000 mgr.a (mgr.14355) 1596 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:46 smithi007 bash[22722]: audit 2024-09-13T22:57:45.475797+0000 mgr.a (mgr.14355) 1597 : audit [DBG] from='client.47160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:46 smithi131 bash[24745]: cluster 2024-09-13T22:57:45.237658+0000 mgr.a (mgr.14355) 1596 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:46 smithi131 bash[24745]: audit 2024-09-13T22:57:45.475797+0000 mgr.a (mgr.14355) 1597 : audit [DBG] from='client.47160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:46 smithi171 bash[25040]: cluster 2024-09-13T22:57:45.237658+0000 mgr.a (mgr.14355) 1596 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:46 smithi171 bash[25040]: audit 2024-09-13T22:57:45.475797+0000 mgr.a (mgr.14355) 1597 : audit [DBG] from='client.47160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:48 smithi007 bash[22722]: cluster 2024-09-13T22:57:47.238625+0000 mgr.a (mgr.14355) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:48 smithi131 bash[24745]: cluster 2024-09-13T22:57:47.238625+0000 mgr.a (mgr.14355) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:48 smithi171 bash[25040]: cluster 2024-09-13T22:57:47.238625+0000 mgr.a (mgr.14355) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:50 smithi007 bash[22722]: cluster 2024-09-13T22:57:49.239426+0000 mgr.a (mgr.14355) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:50 smithi131 bash[24745]: cluster 2024-09-13T22:57:49.239426+0000 mgr.a (mgr.14355) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:50 smithi171 bash[25040]: cluster 2024-09-13T22:57:49.239426+0000 mgr.a (mgr.14355) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:57:50.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:50.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:51.657 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:52 smithi007 bash[22722]: audit 2024-09-13T22:57:51.227333+0000 mgr.a (mgr.14355) 1600 : audit [DBG] from='client.47235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:52 smithi007 bash[22722]: cluster 2024-09-13T22:57:51.248116+0000 mgr.a (mgr.14355) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:52.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:52 smithi131 bash[24745]: audit 2024-09-13T22:57:51.227333+0000 mgr.a (mgr.14355) 1600 : audit [DBG] from='client.47235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:52 smithi131 bash[24745]: cluster 2024-09-13T22:57:51.248116+0000 mgr.a (mgr.14355) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:52 smithi171 bash[25040]: audit 2024-09-13T22:57:51.227333+0000 mgr.a (mgr.14355) 1600 : audit [DBG] from='client.47235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:52 smithi171 bash[25040]: cluster 2024-09-13T22:57:51.248116+0000 mgr.a (mgr.14355) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:57:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:54 smithi007 bash[22722]: cluster 2024-09-13T22:57:53.249100+0000 mgr.a (mgr.14355) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:54.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:54 smithi131 bash[24745]: cluster 2024-09-13T22:57:53.249100+0000 mgr.a (mgr.14355) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:54 smithi171 bash[25040]: cluster 2024-09-13T22:57:53.249100+0000 mgr.a (mgr.14355) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:57:56.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:57:56.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:57:56.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:57:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:56 smithi007 bash[22722]: cluster 2024-09-13T22:57:55.251289+0000 mgr.a (mgr.14355) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:56 smithi131 bash[24745]: cluster 2024-09-13T22:57:55.251289+0000 mgr.a (mgr.14355) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:56 smithi171 bash[25040]: cluster 2024-09-13T22:57:55.251289+0000 mgr.a (mgr.14355) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:57.416 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:57:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:57:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:58 smithi007 bash[22722]: audit 2024-09-13T22:57:56.995043+0000 mgr.a (mgr.14355) 1604 : audit [DBG] from='client.47313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:57:58 smithi007 bash[22722]: cluster 2024-09-13T22:57:57.251929+0000 mgr.a (mgr.14355) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:58.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:58 smithi131 bash[24745]: audit 2024-09-13T22:57:56.995043+0000 mgr.a (mgr.14355) 1604 : audit [DBG] from='client.47313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:58.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:57:58 smithi131 bash[24745]: cluster 2024-09-13T22:57:57.251929+0000 mgr.a (mgr.14355) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:57:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:58 smithi171 bash[25040]: audit 2024-09-13T22:57:56.995043+0000 mgr.a (mgr.14355) 1604 : audit [DBG] from='client.47313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:57:58 smithi171 bash[25040]: cluster 2024-09-13T22:57:57.251929+0000 mgr.a (mgr.14355) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:00 smithi007 bash[22722]: cluster 2024-09-13T22:57:59.252862+0000 mgr.a (mgr.14355) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:00 smithi131 bash[24745]: cluster 2024-09-13T22:57:59.252862+0000 mgr.a (mgr.14355) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:00 smithi171 bash[25040]: cluster 2024-09-13T22:57:59.252862+0000 mgr.a (mgr.14355) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:02.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:02.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:02 smithi007 bash[22722]: cluster 2024-09-13T22:58:01.255454+0000 mgr.a (mgr.14355) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:02 smithi131 bash[24745]: cluster 2024-09-13T22:58:01.255454+0000 mgr.a (mgr.14355) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:02 smithi171 bash[25040]: cluster 2024-09-13T22:58:01.255454+0000 mgr.a (mgr.14355) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:03.162 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:03.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:03.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:04 smithi007 bash[22722]: audit 2024-09-13T22:58:02.749369+0000 mgr.a (mgr.14355) 1608 : audit [DBG] from='client.47391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:04 smithi007 bash[22722]: cluster 2024-09-13T22:58:03.256377+0000 mgr.a (mgr.14355) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:04 smithi131 bash[24745]: audit 2024-09-13T22:58:02.749369+0000 mgr.a (mgr.14355) 1608 : audit [DBG] from='client.47391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:04 smithi131 bash[24745]: cluster 2024-09-13T22:58:03.256377+0000 mgr.a (mgr.14355) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:04 smithi171 bash[25040]: audit 2024-09-13T22:58:02.749369+0000 mgr.a (mgr.14355) 1608 : audit [DBG] from='client.47391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:04 smithi171 bash[25040]: cluster 2024-09-13T22:58:03.256377+0000 mgr.a (mgr.14355) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:06 smithi007 bash[22722]: cluster 2024-09-13T22:58:05.258555+0000 mgr.a (mgr.14355) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:06 smithi131 bash[24745]: cluster 2024-09-13T22:58:05.258555+0000 mgr.a (mgr.14355) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:06 smithi171 bash[25040]: cluster 2024-09-13T22:58:05.258555+0000 mgr.a (mgr.14355) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:08.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:08 smithi007 bash[22722]: cluster 2024-09-13T22:58:07.259338+0000 mgr.a (mgr.14355) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:08.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:08 smithi131 bash[24745]: cluster 2024-09-13T22:58:07.259338+0000 mgr.a (mgr.14355) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:08 smithi171 bash[25040]: cluster 2024-09-13T22:58:07.259338+0000 mgr.a (mgr.14355) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:08.895 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:08.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:09 smithi007 bash[22722]: audit 2024-09-13T22:58:08.492621+0000 mgr.a (mgr.14355) 1612 : audit [DBG] from='client.47466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:09.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:09 smithi131 bash[24745]: audit 2024-09-13T22:58:08.492621+0000 mgr.a (mgr.14355) 1612 : audit [DBG] from='client.47466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:09.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:09 smithi171 bash[25040]: audit 2024-09-13T22:58:08.492621+0000 mgr.a (mgr.14355) 1612 : audit [DBG] from='client.47466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:10 smithi007 bash[22722]: cluster 2024-09-13T22:58:09.260203+0000 mgr.a (mgr.14355) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:10.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:10 smithi131 bash[24745]: cluster 2024-09-13T22:58:09.260203+0000 mgr.a (mgr.14355) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:10 smithi171 bash[25040]: cluster 2024-09-13T22:58:09.260203+0000 mgr.a (mgr.14355) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:12 smithi007 bash[22722]: cluster 2024-09-13T22:58:11.262506+0000 mgr.a (mgr.14355) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:12 smithi131 bash[24745]: cluster 2024-09-13T22:58:11.262506+0000 mgr.a (mgr.14355) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:12.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:12 smithi171 bash[25040]: cluster 2024-09-13T22:58:11.262506+0000 mgr.a (mgr.14355) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:13.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:13.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:13.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:14.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:14.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:14.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:14 smithi007 bash[22722]: cluster 2024-09-13T22:58:13.263409+0000 mgr.a (mgr.14355) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:14 smithi131 bash[24745]: cluster 2024-09-13T22:58:13.263409+0000 mgr.a (mgr.14355) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:14 smithi171 bash[25040]: cluster 2024-09-13T22:58:13.263409+0000 mgr.a (mgr.14355) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:15.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:15 smithi007 bash[22722]: audit 2024-09-13T22:58:14.232003+0000 mgr.a (mgr.14355) 1616 : audit [DBG] from='client.47541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:15.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:15 smithi131 bash[24745]: audit 2024-09-13T22:58:14.232003+0000 mgr.a (mgr.14355) 1616 : audit [DBG] from='client.47541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:15.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:15 smithi171 bash[25040]: audit 2024-09-13T22:58:14.232003+0000 mgr.a (mgr.14355) 1616 : audit [DBG] from='client.47541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:16 smithi007 bash[22722]: cluster 2024-09-13T22:58:15.265723+0000 mgr.a (mgr.14355) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:16 smithi131 bash[24745]: cluster 2024-09-13T22:58:15.265723+0000 mgr.a (mgr.14355) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:16 smithi171 bash[25040]: cluster 2024-09-13T22:58:15.265723+0000 mgr.a (mgr.14355) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:18 smithi007 bash[22722]: cluster 2024-09-13T22:58:17.266597+0000 mgr.a (mgr.14355) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:18 smithi131 bash[24745]: cluster 2024-09-13T22:58:17.266597+0000 mgr.a (mgr.14355) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:18 smithi171 bash[25040]: cluster 2024-09-13T22:58:17.266597+0000 mgr.a (mgr.14355) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:20.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:20.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:20.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:20.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:20.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:20 smithi007 bash[22722]: cluster 2024-09-13T22:58:19.267364+0000 mgr.a (mgr.14355) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:20.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:20 smithi131 bash[24745]: cluster 2024-09-13T22:58:19.267364+0000 mgr.a (mgr.14355) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:20 smithi171 bash[25040]: cluster 2024-09-13T22:58:19.267364+0000 mgr.a (mgr.14355) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:21.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:21 smithi007 bash[22722]: audit 2024-09-13T22:58:19.986202+0000 mgr.a (mgr.14355) 1620 : audit [DBG] from='client.47619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:21 smithi131 bash[24745]: audit 2024-09-13T22:58:19.986202+0000 mgr.a (mgr.14355) 1620 : audit [DBG] from='client.47619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:21.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:21 smithi171 bash[25040]: audit 2024-09-13T22:58:19.986202+0000 mgr.a (mgr.14355) 1620 : audit [DBG] from='client.47619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:22 smithi007 bash[22722]: cluster 2024-09-13T22:58:21.270183+0000 mgr.a (mgr.14355) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:58:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:22 smithi131 bash[24745]: cluster 2024-09-13T22:58:21.270183+0000 mgr.a (mgr.14355) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:58:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:22 smithi171 bash[25040]: cluster 2024-09-13T22:58:21.270183+0000 mgr.a (mgr.14355) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T22:58:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:24 smithi007 bash[22722]: cluster 2024-09-13T22:58:23.270953+0000 mgr.a (mgr.14355) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:58:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:24 smithi131 bash[24745]: cluster 2024-09-13T22:58:23.270953+0000 mgr.a (mgr.14355) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:58:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:24 smithi171 bash[25040]: cluster 2024-09-13T22:58:23.270953+0000 mgr.a (mgr.14355) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T22:58:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:25.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:26.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:26.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:26.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:26.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:26.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:26.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:26 smithi131 bash[24745]: cluster 2024-09-13T22:58:25.272886+0000 mgr.a (mgr.14355) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:26 smithi171 bash[25040]: cluster 2024-09-13T22:58:25.272886+0000 mgr.a (mgr.14355) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:26 smithi007 bash[22722]: cluster 2024-09-13T22:58:25.272886+0000 mgr.a (mgr.14355) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:27.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:27 smithi131 bash[24745]: audit 2024-09-13T22:58:25.746716+0000 mgr.a (mgr.14355) 1624 : audit [DBG] from='client.47697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:27.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:27 smithi171 bash[25040]: audit 2024-09-13T22:58:25.746716+0000 mgr.a (mgr.14355) 1624 : audit [DBG] from='client.47697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:27 smithi007 bash[22722]: audit 2024-09-13T22:58:25.746716+0000 mgr.a (mgr.14355) 1624 : audit [DBG] from='client.47697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:28 smithi131 bash[24745]: cluster 2024-09-13T22:58:27.273769+0000 mgr.a (mgr.14355) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:58:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:28 smithi171 bash[25040]: cluster 2024-09-13T22:58:27.273769+0000 mgr.a (mgr.14355) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:58:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:28 smithi007 bash[22722]: cluster 2024-09-13T22:58:27.273769+0000 mgr.a (mgr.14355) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:58:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:30 smithi131 bash[24745]: cluster 2024-09-13T22:58:29.274597+0000 mgr.a (mgr.14355) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:58:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:30 smithi171 bash[25040]: cluster 2024-09-13T22:58:29.274597+0000 mgr.a (mgr.14355) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:58:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:30 smithi007 bash[22722]: cluster 2024-09-13T22:58:29.274597+0000 mgr.a (mgr.14355) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:58:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:31.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:31.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:31.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:31.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:31.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:31.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:31.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:32 smithi131 bash[24745]: cluster 2024-09-13T22:58:31.276000+0000 mgr.a (mgr.14355) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:32 smithi131 bash[24745]: audit 2024-09-13T22:58:31.498941+0000 mgr.a (mgr.14355) 1628 : audit [DBG] from='client.47775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:32 smithi171 bash[25040]: cluster 2024-09-13T22:58:31.276000+0000 mgr.a (mgr.14355) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:32 smithi171 bash[25040]: audit 2024-09-13T22:58:31.498941+0000 mgr.a (mgr.14355) 1628 : audit [DBG] from='client.47775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:32 smithi007 bash[22722]: cluster 2024-09-13T22:58:31.276000+0000 mgr.a (mgr.14355) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:32 smithi007 bash[22722]: audit 2024-09-13T22:58:31.498941+0000 mgr.a (mgr.14355) 1628 : audit [DBG] from='client.47775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:34 smithi131 bash[24745]: cluster 2024-09-13T22:58:33.276811+0000 mgr.a (mgr.14355) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:58:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:34 smithi171 bash[25040]: cluster 2024-09-13T22:58:33.276811+0000 mgr.a (mgr.14355) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:58:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:34 smithi007 bash[22722]: cluster 2024-09-13T22:58:33.276811+0000 mgr.a (mgr.14355) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T22:58:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:36 smithi131 bash[24745]: cluster 2024-09-13T22:58:35.278957+0000 mgr.a (mgr.14355) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:58:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:36 smithi171 bash[25040]: cluster 2024-09-13T22:58:35.278957+0000 mgr.a (mgr.14355) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:58:36.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:36.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:36.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:36 smithi007 bash[22722]: cluster 2024-09-13T22:58:35.278957+0000 mgr.a (mgr.14355) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T22:58:37.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:37.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:38 smithi131 bash[24745]: audit 2024-09-13T22:58:37.261390+0000 mgr.a (mgr.14355) 1631 : audit [DBG] from='client.47847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:38 smithi131 bash[24745]: cluster 2024-09-13T22:58:37.280432+0000 mgr.a (mgr.14355) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:38 smithi171 bash[25040]: audit 2024-09-13T22:58:37.261390+0000 mgr.a (mgr.14355) 1631 : audit [DBG] from='client.47847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:38 smithi171 bash[25040]: cluster 2024-09-13T22:58:37.280432+0000 mgr.a (mgr.14355) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:38 smithi007 bash[22722]: audit 2024-09-13T22:58:37.261390+0000 mgr.a (mgr.14355) 1631 : audit [DBG] from='client.47847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:38 smithi007 bash[22722]: cluster 2024-09-13T22:58:37.280432+0000 mgr.a (mgr.14355) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: cluster 2024-09-13T22:58:39.281379+0000 mgr.a (mgr.14355) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: audit 2024-09-13T22:58:39.695965+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: audit 2024-09-13T22:58:40.330497+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: audit 2024-09-13T22:58:40.335768+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: audit 2024-09-13T22:58:40.347974+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:40 smithi131 bash[24745]: audit 2024-09-13T22:58:40.352763+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: cluster 2024-09-13T22:58:39.281379+0000 mgr.a (mgr.14355) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: audit 2024-09-13T22:58:39.695965+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: audit 2024-09-13T22:58:40.330497+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: audit 2024-09-13T22:58:40.335768+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: audit 2024-09-13T22:58:40.347974+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:40 smithi171 bash[25040]: audit 2024-09-13T22:58:40.352763+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: cluster 2024-09-13T22:58:39.281379+0000 mgr.a (mgr.14355) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: audit 2024-09-13T22:58:39.695965+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: audit 2024-09-13T22:58:40.330497+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: audit 2024-09-13T22:58:40.335768+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: audit 2024-09-13T22:58:40.347974+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:40 smithi007 bash[22722]: audit 2024-09-13T22:58:40.352763+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:41 smithi131 bash[24745]: audit 2024-09-13T22:58:40.988237+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:41 smithi131 bash[24745]: audit 2024-09-13T22:58:40.989986+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:41 smithi131 bash[24745]: audit 2024-09-13T22:58:40.999217+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:41 smithi131 bash[24745]: audit 2024-09-13T22:58:41.004126+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:41 smithi171 bash[25040]: audit 2024-09-13T22:58:40.988237+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:41 smithi171 bash[25040]: audit 2024-09-13T22:58:40.989986+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:41 smithi171 bash[25040]: audit 2024-09-13T22:58:40.999217+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:41 smithi171 bash[25040]: audit 2024-09-13T22:58:41.004126+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22972]: debug 2024-09-13T22:58:41.719+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22972]: debug 2024-09-13T22:58:41.723+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22722]: audit 2024-09-13T22:58:40.988237+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22722]: audit 2024-09-13T22:58:40.989986+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22722]: audit 2024-09-13T22:58:40.999217+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:58:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:41 smithi007 bash[22722]: audit 2024-09-13T22:58:41.004126+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:42.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:42.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:42 smithi131 bash[24745]: audit 2024-09-13T22:58:41.006330+0000 mgr.a (mgr.14355) 1634 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:42 smithi131 bash[24745]: cluster 2024-09-13T22:58:41.282691+0000 mgr.a (mgr.14355) 1635 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:42 smithi171 bash[25040]: audit 2024-09-13T22:58:41.006330+0000 mgr.a (mgr.14355) 1634 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:42 smithi171 bash[25040]: cluster 2024-09-13T22:58:41.282691+0000 mgr.a (mgr.14355) 1635 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:42 smithi007 bash[22722]: audit 2024-09-13T22:58:41.006330+0000 mgr.a (mgr.14355) 1634 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:58:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:42 smithi007 bash[22722]: cluster 2024-09-13T22:58:41.282691+0000 mgr.a (mgr.14355) 1635 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:58:43.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:43.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:43 smithi131 bash[24745]: audit 2024-09-13T22:58:41.725747+0000 mgr.a (mgr.14355) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:58:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:43 smithi131 bash[24745]: cephadm 2024-09-13T22:58:41.727502+0000 mgr.a (mgr.14355) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:58:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:43 smithi171 bash[25040]: audit 2024-09-13T22:58:41.725747+0000 mgr.a (mgr.14355) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:58:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:43 smithi171 bash[25040]: cephadm 2024-09-13T22:58:41.727502+0000 mgr.a (mgr.14355) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:58:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:43 smithi007 bash[22722]: audit 2024-09-13T22:58:41.725747+0000 mgr.a (mgr.14355) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:58:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:43 smithi007 bash[22722]: cephadm 2024-09-13T22:58:41.727502+0000 mgr.a (mgr.14355) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:58:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:44 smithi131 bash[24745]: audit 2024-09-13T22:58:43.008471+0000 mgr.a (mgr.14355) 1638 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:44 smithi131 bash[24745]: cluster 2024-09-13T22:58:43.283283+0000 mgr.a (mgr.14355) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:44 smithi171 bash[25040]: audit 2024-09-13T22:58:43.008471+0000 mgr.a (mgr.14355) 1638 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:44 smithi171 bash[25040]: cluster 2024-09-13T22:58:43.283283+0000 mgr.a (mgr.14355) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:44 smithi007 bash[22722]: audit 2024-09-13T22:58:43.008471+0000 mgr.a (mgr.14355) 1638 : audit [DBG] from='client.48027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:44 smithi007 bash[22722]: cluster 2024-09-13T22:58:43.283283+0000 mgr.a (mgr.14355) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:46 smithi007 bash[22722]: cluster 2024-09-13T22:58:45.285491+0000 mgr.a (mgr.14355) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:46 smithi131 bash[24745]: cluster 2024-09-13T22:58:45.285491+0000 mgr.a (mgr.14355) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:46 smithi171 bash[25040]: cluster 2024-09-13T22:58:45.285491+0000 mgr.a (mgr.14355) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:48.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:48.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:48.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:48 smithi007 bash[22722]: cluster 2024-09-13T22:58:47.286238+0000 mgr.a (mgr.14355) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:48 smithi131 bash[24745]: cluster 2024-09-13T22:58:47.286238+0000 mgr.a (mgr.14355) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:48 smithi171 bash[25040]: cluster 2024-09-13T22:58:47.286238+0000 mgr.a (mgr.14355) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:49.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:50 smithi007 bash[22722]: audit 2024-09-13T22:58:48.769536+0000 mgr.a (mgr.14355) 1642 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:50 smithi007 bash[22722]: cluster 2024-09-13T22:58:49.287269+0000 mgr.a (mgr.14355) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:50 smithi131 bash[24745]: audit 2024-09-13T22:58:48.769536+0000 mgr.a (mgr.14355) 1642 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:50 smithi131 bash[24745]: cluster 2024-09-13T22:58:49.287269+0000 mgr.a (mgr.14355) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:50 smithi171 bash[25040]: audit 2024-09-13T22:58:48.769536+0000 mgr.a (mgr.14355) 1642 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:50 smithi171 bash[25040]: cluster 2024-09-13T22:58:49.287269+0000 mgr.a (mgr.14355) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:52.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:52 smithi007 bash[22722]: cluster 2024-09-13T22:58:51.289695+0000 mgr.a (mgr.14355) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:52.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:52 smithi131 bash[24745]: cluster 2024-09-13T22:58:51.289695+0000 mgr.a (mgr.14355) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:52 smithi171 bash[25040]: cluster 2024-09-13T22:58:51.289695+0000 mgr.a (mgr.14355) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:54.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:54.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:54.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:58:54.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:54 smithi007 bash[22722]: cluster 2024-09-13T22:58:53.290642+0000 mgr.a (mgr.14355) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:54.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:54 smithi131 bash[24745]: cluster 2024-09-13T22:58:53.290642+0000 mgr.a (mgr.14355) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:54 smithi171 bash[25040]: cluster 2024-09-13T22:58:53.290642+0000 mgr.a (mgr.14355) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:54.972 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:58:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:58:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:58:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:58:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:58:55.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:55 smithi007 bash[22722]: audit 2024-09-13T22:58:54.532401+0000 mgr.a (mgr.14355) 1646 : audit [DBG] from='client.48177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:55.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:55 smithi131 bash[24745]: audit 2024-09-13T22:58:54.532401+0000 mgr.a (mgr.14355) 1646 : audit [DBG] from='client.48177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:55.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:55 smithi171 bash[25040]: audit 2024-09-13T22:58:54.532401+0000 mgr.a (mgr.14355) 1646 : audit [DBG] from='client.48177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:56.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:56 smithi007 bash[22722]: cluster 2024-09-13T22:58:55.293035+0000 mgr.a (mgr.14355) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:56.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:56 smithi131 bash[24745]: cluster 2024-09-13T22:58:55.293035+0000 mgr.a (mgr.14355) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:56 smithi171 bash[25040]: cluster 2024-09-13T22:58:55.293035+0000 mgr.a (mgr.14355) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:58:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:58:58 smithi007 bash[22722]: cluster 2024-09-13T22:58:57.293812+0000 mgr.a (mgr.14355) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:58:58 smithi131 bash[24745]: cluster 2024-09-13T22:58:57.293812+0000 mgr.a (mgr.14355) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:58:58 smithi171 bash[25040]: cluster 2024-09-13T22:58:57.293812+0000 mgr.a (mgr.14355) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:58:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:58:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:58:59.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:00 smithi007 bash[22722]: cluster 2024-09-13T22:58:59.294565+0000 mgr.a (mgr.14355) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:00.741 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:00.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:00.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:00.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:00.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:00 smithi131 bash[24745]: cluster 2024-09-13T22:58:59.294565+0000 mgr.a (mgr.14355) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:00 smithi171 bash[25040]: cluster 2024-09-13T22:58:59.294565+0000 mgr.a (mgr.14355) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:01.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:01 smithi007 bash[22722]: audit 2024-09-13T22:59:00.310250+0000 mgr.a (mgr.14355) 1650 : audit [DBG] from='client.48252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:01.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:01 smithi131 bash[24745]: audit 2024-09-13T22:59:00.310250+0000 mgr.a (mgr.14355) 1650 : audit [DBG] from='client.48252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:01.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:01 smithi171 bash[25040]: audit 2024-09-13T22:59:00.310250+0000 mgr.a (mgr.14355) 1650 : audit [DBG] from='client.48252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:02 smithi007 bash[22722]: cluster 2024-09-13T22:59:01.297366+0000 mgr.a (mgr.14355) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:02 smithi131 bash[24745]: cluster 2024-09-13T22:59:01.297366+0000 mgr.a (mgr.14355) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:02 smithi171 bash[25040]: cluster 2024-09-13T22:59:01.297366+0000 mgr.a (mgr.14355) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:04 smithi007 bash[22722]: cluster 2024-09-13T22:59:03.298283+0000 mgr.a (mgr.14355) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:04.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:04 smithi131 bash[24745]: cluster 2024-09-13T22:59:03.298283+0000 mgr.a (mgr.14355) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:04 smithi171 bash[25040]: cluster 2024-09-13T22:59:03.298283+0000 mgr.a (mgr.14355) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:05.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:05.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:06.511 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:06 smithi007 bash[22722]: cluster 2024-09-13T22:59:05.300228+0000 mgr.a (mgr.14355) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:06 smithi131 bash[24745]: cluster 2024-09-13T22:59:05.300228+0000 mgr.a (mgr.14355) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:06 smithi171 bash[25040]: cluster 2024-09-13T22:59:05.300228+0000 mgr.a (mgr.14355) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:07.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:07 smithi007 bash[22722]: audit 2024-09-13T22:59:06.077091+0000 mgr.a (mgr.14355) 1654 : audit [DBG] from='client.48327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:07.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:07 smithi131 bash[24745]: audit 2024-09-13T22:59:06.077091+0000 mgr.a (mgr.14355) 1654 : audit [DBG] from='client.48327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:07.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:07 smithi171 bash[25040]: audit 2024-09-13T22:59:06.077091+0000 mgr.a (mgr.14355) 1654 : audit [DBG] from='client.48327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:08 smithi007 bash[22722]: cluster 2024-09-13T22:59:07.301264+0000 mgr.a (mgr.14355) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:08.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:08 smithi131 bash[24745]: cluster 2024-09-13T22:59:07.301264+0000 mgr.a (mgr.14355) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:08 smithi171 bash[25040]: cluster 2024-09-13T22:59:07.301264+0000 mgr.a (mgr.14355) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:10 smithi007 bash[22722]: cluster 2024-09-13T22:59:09.302187+0000 mgr.a (mgr.14355) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:59:10.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:10 smithi131 bash[24745]: cluster 2024-09-13T22:59:09.302187+0000 mgr.a (mgr.14355) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:59:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:10 smithi171 bash[25040]: cluster 2024-09-13T22:59:09.302187+0000 mgr.a (mgr.14355) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T22:59:11.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:12.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:12 smithi007 bash[22722]: cluster 2024-09-13T22:59:11.304477+0000 mgr.a (mgr.14355) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:12 smithi131 bash[24745]: cluster 2024-09-13T22:59:11.304477+0000 mgr.a (mgr.14355) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:12.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:12 smithi171 bash[25040]: cluster 2024-09-13T22:59:11.304477+0000 mgr.a (mgr.14355) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:13.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:13 smithi007 bash[22722]: audit 2024-09-13T22:59:11.848660+0000 mgr.a (mgr.14355) 1658 : audit [DBG] from='client.48405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:13 smithi131 bash[24745]: audit 2024-09-13T22:59:11.848660+0000 mgr.a (mgr.14355) 1658 : audit [DBG] from='client.48405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:13.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:13 smithi171 bash[25040]: audit 2024-09-13T22:59:11.848660+0000 mgr.a (mgr.14355) 1658 : audit [DBG] from='client.48405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:14 smithi007 bash[22722]: cluster 2024-09-13T22:59:13.305382+0000 mgr.a (mgr.14355) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:14.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:14 smithi131 bash[24745]: cluster 2024-09-13T22:59:13.305382+0000 mgr.a (mgr.14355) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:14 smithi171 bash[25040]: cluster 2024-09-13T22:59:13.305382+0000 mgr.a (mgr.14355) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:16 smithi007 bash[22722]: cluster 2024-09-13T22:59:15.307731+0000 mgr.a (mgr.14355) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:16 smithi131 bash[24745]: cluster 2024-09-13T22:59:15.307731+0000 mgr.a (mgr.14355) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:16 smithi171 bash[25040]: cluster 2024-09-13T22:59:15.307731+0000 mgr.a (mgr.14355) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:17.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:18.030 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:18 smithi007 bash[22722]: cluster 2024-09-13T22:59:17.308510+0000 mgr.a (mgr.14355) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:18 smithi131 bash[24745]: cluster 2024-09-13T22:59:17.308510+0000 mgr.a (mgr.14355) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:18 smithi171 bash[25040]: cluster 2024-09-13T22:59:17.308510+0000 mgr.a (mgr.14355) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:19.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:19 smithi007 bash[22722]: audit 2024-09-13T22:59:17.591113+0000 mgr.a (mgr.14355) 1662 : audit [DBG] from='client.48483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:19.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:19 smithi131 bash[24745]: audit 2024-09-13T22:59:17.591113+0000 mgr.a (mgr.14355) 1662 : audit [DBG] from='client.48483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:19.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:19 smithi171 bash[25040]: audit 2024-09-13T22:59:17.591113+0000 mgr.a (mgr.14355) 1662 : audit [DBG] from='client.48483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:20 smithi007 bash[22722]: cluster 2024-09-13T22:59:19.309552+0000 mgr.a (mgr.14355) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:20.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:20 smithi131 bash[24745]: cluster 2024-09-13T22:59:19.309552+0000 mgr.a (mgr.14355) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:20 smithi171 bash[25040]: cluster 2024-09-13T22:59:19.309552+0000 mgr.a (mgr.14355) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:22 smithi007 bash[22722]: cluster 2024-09-13T22:59:21.311967+0000 mgr.a (mgr.14355) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:22 smithi131 bash[24745]: cluster 2024-09-13T22:59:21.311967+0000 mgr.a (mgr.14355) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:22 smithi171 bash[25040]: cluster 2024-09-13T22:59:21.311967+0000 mgr.a (mgr.14355) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:23.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:23.033 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:23.033 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:23.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:23.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:23.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:23.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:23.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:24 smithi131 bash[24745]: cluster 2024-09-13T22:59:23.312761+0000 mgr.a (mgr.14355) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:24 smithi131 bash[24745]: audit 2024-09-13T22:59:23.373498+0000 mgr.a (mgr.14355) 1666 : audit [DBG] from='client.48561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:24 smithi171 bash[25040]: cluster 2024-09-13T22:59:23.312761+0000 mgr.a (mgr.14355) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:24 smithi171 bash[25040]: audit 2024-09-13T22:59:23.373498+0000 mgr.a (mgr.14355) 1666 : audit [DBG] from='client.48561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:24 smithi007 bash[22722]: cluster 2024-09-13T22:59:23.312761+0000 mgr.a (mgr.14355) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:24 smithi007 bash[22722]: audit 2024-09-13T22:59:23.373498+0000 mgr.a (mgr.14355) 1666 : audit [DBG] from='client.48561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:26.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:26 smithi131 bash[24745]: cluster 2024-09-13T22:59:25.315018+0000 mgr.a (mgr.14355) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:26 smithi171 bash[25040]: cluster 2024-09-13T22:59:25.315018+0000 mgr.a (mgr.14355) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:26 smithi007 bash[22722]: cluster 2024-09-13T22:59:25.315018+0000 mgr.a (mgr.14355) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:28.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:28 smithi131 bash[24745]: cluster 2024-09-13T22:59:27.315766+0000 mgr.a (mgr.14355) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:28 smithi171 bash[25040]: cluster 2024-09-13T22:59:27.315766+0000 mgr.a (mgr.14355) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:28.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:28.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:28.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:28 smithi007 bash[22722]: cluster 2024-09-13T22:59:27.315766+0000 mgr.a (mgr.14355) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:29.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:29.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:29.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:29.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:29.540 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:30 smithi131 bash[24745]: audit 2024-09-13T22:59:29.126860+0000 mgr.a (mgr.14355) 1669 : audit [DBG] from='client.48633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:30 smithi131 bash[24745]: cluster 2024-09-13T22:59:29.316321+0000 mgr.a (mgr.14355) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:30 smithi171 bash[25040]: audit 2024-09-13T22:59:29.126860+0000 mgr.a (mgr.14355) 1669 : audit [DBG] from='client.48633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:30 smithi171 bash[25040]: cluster 2024-09-13T22:59:29.316321+0000 mgr.a (mgr.14355) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:30.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:30 smithi007 bash[22722]: audit 2024-09-13T22:59:29.126860+0000 mgr.a (mgr.14355) 1669 : audit [DBG] from='client.48633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:30 smithi007 bash[22722]: cluster 2024-09-13T22:59:29.316321+0000 mgr.a (mgr.14355) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:32 smithi131 bash[24745]: cluster 2024-09-13T22:59:31.318657+0000 mgr.a (mgr.14355) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:32 smithi171 bash[25040]: cluster 2024-09-13T22:59:31.318657+0000 mgr.a (mgr.14355) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:32 smithi007 bash[22722]: cluster 2024-09-13T22:59:31.318657+0000 mgr.a (mgr.14355) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T22:59:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:34.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:34.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:34 smithi131 bash[24745]: cluster 2024-09-13T22:59:33.319380+0000 mgr.a (mgr.14355) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:34 smithi171 bash[25040]: cluster 2024-09-13T22:59:33.319380+0000 mgr.a (mgr.14355) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:34 smithi007 bash[22722]: cluster 2024-09-13T22:59:33.319380+0000 mgr.a (mgr.14355) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:35.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:36 smithi131 bash[24745]: audit 2024-09-13T22:59:34.878688+0000 mgr.a (mgr.14355) 1673 : audit [DBG] from='client.48711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:36 smithi131 bash[24745]: cluster 2024-09-13T22:59:35.320631+0000 mgr.a (mgr.14355) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:59:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:36 smithi171 bash[25040]: audit 2024-09-13T22:59:34.878688+0000 mgr.a (mgr.14355) 1673 : audit [DBG] from='client.48711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:36 smithi171 bash[25040]: cluster 2024-09-13T22:59:35.320631+0000 mgr.a (mgr.14355) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:59:36.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:36 smithi007 bash[22722]: audit 2024-09-13T22:59:34.878688+0000 mgr.a (mgr.14355) 1673 : audit [DBG] from='client.48711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:36 smithi007 bash[22722]: cluster 2024-09-13T22:59:35.320631+0000 mgr.a (mgr.14355) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T22:59:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:38 smithi131 bash[24745]: cluster 2024-09-13T22:59:37.321376+0000 mgr.a (mgr.14355) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:38 smithi171 bash[25040]: cluster 2024-09-13T22:59:37.321376+0000 mgr.a (mgr.14355) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:38 smithi007 bash[22722]: cluster 2024-09-13T22:59:37.321376+0000 mgr.a (mgr.14355) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:40.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:40 smithi131 bash[24745]: cluster 2024-09-13T22:59:39.322144+0000 mgr.a (mgr.14355) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:40 smithi171 bash[25040]: cluster 2024-09-13T22:59:39.322144+0000 mgr.a (mgr.14355) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:40.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:40 smithi007 bash[22722]: cluster 2024-09-13T22:59:39.322144+0000 mgr.a (mgr.14355) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T22:59:41.099 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:41.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:42 smithi131 bash[24745]: audit 2024-09-13T22:59:40.664318+0000 mgr.a (mgr.14355) 1677 : audit [DBG] from='client.48789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:42 smithi131 bash[24745]: cluster 2024-09-13T22:59:41.324894+0000 mgr.a (mgr.14355) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:42 smithi131 bash[24745]: audit 2024-09-13T22:59:41.781446+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:42 smithi171 bash[25040]: audit 2024-09-13T22:59:40.664318+0000 mgr.a (mgr.14355) 1677 : audit [DBG] from='client.48789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:42 smithi171 bash[25040]: cluster 2024-09-13T22:59:41.324894+0000 mgr.a (mgr.14355) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:42 smithi171 bash[25040]: audit 2024-09-13T22:59:41.781446+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:42.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:42 smithi007 bash[22722]: audit 2024-09-13T22:59:40.664318+0000 mgr.a (mgr.14355) 1677 : audit [DBG] from='client.48789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:42.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:42 smithi007 bash[22722]: cluster 2024-09-13T22:59:41.324894+0000 mgr.a (mgr.14355) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:42 smithi007 bash[22722]: audit 2024-09-13T22:59:41.781446+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:43.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22972]: debug 2024-09-13T22:59:43.366+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:59:43.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22972]: debug 2024-09-13T22:59:43.366+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:59:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22722]: audit 2024-09-13T22:59:42.624209+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22722]: audit 2024-09-13T22:59:42.625881+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22722]: audit 2024-09-13T22:59:42.636139+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:59:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:43 smithi007 bash[22722]: audit 2024-09-13T22:59:42.639131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:43 smithi131 bash[24745]: audit 2024-09-13T22:59:42.624209+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:43 smithi131 bash[24745]: audit 2024-09-13T22:59:42.625881+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:43 smithi131 bash[24745]: audit 2024-09-13T22:59:42.636139+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:59:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:43 smithi131 bash[24745]: audit 2024-09-13T22:59:42.639131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:43 smithi171 bash[25040]: audit 2024-09-13T22:59:42.624209+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:43 smithi171 bash[25040]: audit 2024-09-13T22:59:42.625881+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:43 smithi171 bash[25040]: audit 2024-09-13T22:59:42.636139+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T22:59:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:43 smithi171 bash[25040]: audit 2024-09-13T22:59:42.639131+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:44 smithi131 bash[24745]: audit 2024-09-13T22:59:42.640431+0000 mgr.a (mgr.14355) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:44 smithi131 bash[24745]: cluster 2024-09-13T22:59:43.325594+0000 mgr.a (mgr.14355) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:44 smithi131 bash[24745]: audit 2024-09-13T22:59:43.370581+0000 mgr.a (mgr.14355) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:59:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:44 smithi131 bash[24745]: cephadm 2024-09-13T22:59:43.372553+0000 mgr.a (mgr.14355) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:59:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:44 smithi171 bash[25040]: audit 2024-09-13T22:59:42.640431+0000 mgr.a (mgr.14355) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:44 smithi171 bash[25040]: cluster 2024-09-13T22:59:43.325594+0000 mgr.a (mgr.14355) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:44 smithi171 bash[25040]: audit 2024-09-13T22:59:43.370581+0000 mgr.a (mgr.14355) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:59:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:44 smithi171 bash[25040]: cephadm 2024-09-13T22:59:43.372553+0000 mgr.a (mgr.14355) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:59:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:44 smithi007 bash[22722]: audit 2024-09-13T22:59:42.640431+0000 mgr.a (mgr.14355) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T22:59:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:44 smithi007 bash[22722]: cluster 2024-09-13T22:59:43.325594+0000 mgr.a (mgr.14355) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T22:59:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:44 smithi007 bash[22722]: audit 2024-09-13T22:59:43.370581+0000 mgr.a (mgr.14355) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T22:59:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:44 smithi007 bash[22722]: cephadm 2024-09-13T22:59:43.372553+0000 mgr.a (mgr.14355) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T22:59:46.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:46.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:46 smithi131 bash[24745]: cluster 2024-09-13T22:59:45.327746+0000 mgr.a (mgr.14355) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:46 smithi171 bash[25040]: cluster 2024-09-13T22:59:45.327746+0000 mgr.a (mgr.14355) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:46.880 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:46.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:46.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:46 smithi007 bash[22722]: cluster 2024-09-13T22:59:45.327746+0000 mgr.a (mgr.14355) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:47.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:47 smithi131 bash[24745]: audit 2024-09-13T22:59:46.443215+0000 mgr.a (mgr.14355) 1684 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:47.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:47 smithi171 bash[25040]: audit 2024-09-13T22:59:46.443215+0000 mgr.a (mgr.14355) 1684 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:47.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:47 smithi007 bash[22722]: audit 2024-09-13T22:59:46.443215+0000 mgr.a (mgr.14355) 1684 : audit [DBG] from='client.48969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:48 smithi131 bash[24745]: cluster 2024-09-13T22:59:47.328755+0000 mgr.a (mgr.14355) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:48 smithi171 bash[25040]: cluster 2024-09-13T22:59:47.328755+0000 mgr.a (mgr.14355) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:48.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:48 smithi007 bash[22722]: cluster 2024-09-13T22:59:47.328755+0000 mgr.a (mgr.14355) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:50 smithi131 bash[24745]: cluster 2024-09-13T22:59:49.329588+0000 mgr.a (mgr.14355) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:50 smithi171 bash[25040]: cluster 2024-09-13T22:59:49.329588+0000 mgr.a (mgr.14355) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:50.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:50 smithi007 bash[22722]: cluster 2024-09-13T22:59:49.329588+0000 mgr.a (mgr.14355) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T22:59:51.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:51.882 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:52.631 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:52.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:52.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:52 smithi131 bash[24745]: cluster 2024-09-13T22:59:51.331857+0000 mgr.a (mgr.14355) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:52 smithi171 bash[25040]: cluster 2024-09-13T22:59:51.331857+0000 mgr.a (mgr.14355) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:52.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:52 smithi007 bash[22722]: cluster 2024-09-13T22:59:51.331857+0000 mgr.a (mgr.14355) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:53.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:53 smithi131 bash[24745]: audit 2024-09-13T22:59:52.212924+0000 mgr.a (mgr.14355) 1688 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:53.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:53 smithi171 bash[25040]: audit 2024-09-13T22:59:52.212924+0000 mgr.a (mgr.14355) 1688 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:53 smithi007 bash[22722]: audit 2024-09-13T22:59:52.212924+0000 mgr.a (mgr.14355) 1688 : audit [DBG] from='client.49044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:54.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:54 smithi171 bash[25040]: cluster 2024-09-13T22:59:53.332734+0000 mgr.a (mgr.14355) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:54.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:54 smithi007 bash[22722]: cluster 2024-09-13T22:59:53.332734+0000 mgr.a (mgr.14355) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:54 smithi131 bash[24745]: cluster 2024-09-13T22:59:53.332734+0000 mgr.a (mgr.14355) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:56.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:56 smithi007 bash[22722]: cluster 2024-09-13T22:59:55.335020+0000 mgr.a (mgr.14355) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:56.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:56 smithi131 bash[24745]: cluster 2024-09-13T22:59:55.335020+0000 mgr.a (mgr.14355) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:56.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:56 smithi171 bash[25040]: cluster 2024-09-13T22:59:55.335020+0000 mgr.a (mgr.14355) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T22:59:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T22:59:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T22:59:57.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T22:59:58.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T22:59:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T22:59:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T22:59:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T22:59:58.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T22:59:58.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:58 smithi007 bash[22722]: cluster 2024-09-13T22:59:57.335922+0000 mgr.a (mgr.14355) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:58 smithi131 bash[24745]: cluster 2024-09-13T22:59:57.335922+0000 mgr.a (mgr.14355) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:58 smithi171 bash[25040]: cluster 2024-09-13T22:59:57.335922+0000 mgr.a (mgr.14355) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T22:59:59.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 22:59:59 smithi007 bash[22722]: audit 2024-09-13T22:59:57.966848+0000 mgr.a (mgr.14355) 1692 : audit [DBG] from='client.49119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:59.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 22:59:59 smithi131 bash[24745]: audit 2024-09-13T22:59:57.966848+0000 mgr.a (mgr.14355) 1692 : audit [DBG] from='client.49119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:59.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 22:59:59 smithi171 bash[25040]: audit 2024-09-13T22:59:57.966848+0000 mgr.a (mgr.14355) 1692 : audit [DBG] from='client.49119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:00 smithi007 bash[22722]: cluster 2024-09-13T22:59:59.336836+0000 mgr.a (mgr.14355) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:00 smithi007 bash[22722]: cluster 2024-09-13T23:00:00.000153+0000 mon.a (mon.0) 852 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:00:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:00 smithi131 bash[24745]: cluster 2024-09-13T22:59:59.336836+0000 mgr.a (mgr.14355) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:00 smithi131 bash[24745]: cluster 2024-09-13T23:00:00.000153+0000 mon.a (mon.0) 852 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:00:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:00 smithi171 bash[25040]: cluster 2024-09-13T22:59:59.336836+0000 mgr.a (mgr.14355) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:00 smithi171 bash[25040]: cluster 2024-09-13T23:00:00.000153+0000 mon.a (mon.0) 852 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:00:02.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:02 smithi007 bash[22722]: cluster 2024-09-13T23:00:01.339122+0000 mgr.a (mgr.14355) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:02.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:02 smithi131 bash[24745]: cluster 2024-09-13T23:00:01.339122+0000 mgr.a (mgr.14355) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:02.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:02 smithi171 bash[25040]: cluster 2024-09-13T23:00:01.339122+0000 mgr.a (mgr.14355) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:03.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:03.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:04.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:04.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:04.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:04.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:04.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:04.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:04 smithi007 bash[22722]: cluster 2024-09-13T23:00:03.339897+0000 mgr.a (mgr.14355) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:04.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:04 smithi131 bash[24745]: cluster 2024-09-13T23:00:03.339897+0000 mgr.a (mgr.14355) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:04 smithi171 bash[25040]: cluster 2024-09-13T23:00:03.339897+0000 mgr.a (mgr.14355) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:05.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:05 smithi007 bash[22722]: audit 2024-09-13T23:00:03.755013+0000 mgr.a (mgr.14355) 1696 : audit [DBG] from='client.49194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:05.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:05 smithi131 bash[24745]: audit 2024-09-13T23:00:03.755013+0000 mgr.a (mgr.14355) 1696 : audit [DBG] from='client.49194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:05.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:05 smithi171 bash[25040]: audit 2024-09-13T23:00:03.755013+0000 mgr.a (mgr.14355) 1696 : audit [DBG] from='client.49194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:06.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:06 smithi007 bash[22722]: cluster 2024-09-13T23:00:05.342142+0000 mgr.a (mgr.14355) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:06 smithi131 bash[24745]: cluster 2024-09-13T23:00:05.342142+0000 mgr.a (mgr.14355) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:06.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:06 smithi171 bash[25040]: cluster 2024-09-13T23:00:05.342142+0000 mgr.a (mgr.14355) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:08.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:08 smithi007 bash[22722]: cluster 2024-09-13T23:00:07.343041+0000 mgr.a (mgr.14355) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:08.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:08 smithi131 bash[24745]: cluster 2024-09-13T23:00:07.343041+0000 mgr.a (mgr.14355) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:08.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:08 smithi171 bash[25040]: cluster 2024-09-13T23:00:07.343041+0000 mgr.a (mgr.14355) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:09.931 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:10.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:10 smithi007 bash[22722]: cluster 2024-09-13T23:00:09.343526+0000 mgr.a (mgr.14355) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:10 smithi007 bash[22722]: audit 2024-09-13T23:00:09.522640+0000 mgr.a (mgr.14355) 1700 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:10.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:10 smithi131 bash[24745]: cluster 2024-09-13T23:00:09.343526+0000 mgr.a (mgr.14355) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:10.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:10 smithi131 bash[24745]: audit 2024-09-13T23:00:09.522640+0000 mgr.a (mgr.14355) 1700 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:10 smithi171 bash[25040]: cluster 2024-09-13T23:00:09.343526+0000 mgr.a (mgr.14355) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:10.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:10 smithi171 bash[25040]: audit 2024-09-13T23:00:09.522640+0000 mgr.a (mgr.14355) 1700 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:12.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:12 smithi007 bash[22722]: cluster 2024-09-13T23:00:11.345814+0000 mgr.a (mgr.14355) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:12.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:12 smithi131 bash[24745]: cluster 2024-09-13T23:00:11.345814+0000 mgr.a (mgr.14355) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:12.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:12 smithi171 bash[25040]: cluster 2024-09-13T23:00:11.345814+0000 mgr.a (mgr.14355) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:14.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:14 smithi007 bash[22722]: cluster 2024-09-13T23:00:13.346588+0000 mgr.a (mgr.14355) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:14 smithi131 bash[24745]: cluster 2024-09-13T23:00:13.346588+0000 mgr.a (mgr.14355) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:14.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:14 smithi171 bash[25040]: cluster 2024-09-13T23:00:13.346588+0000 mgr.a (mgr.14355) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:14.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:14.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:14.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:15.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:15.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:15.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:15.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:15.696 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:16.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:16 smithi007 bash[22722]: audit 2024-09-13T23:00:15.273023+0000 mgr.a (mgr.14355) 1703 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:16 smithi007 bash[22722]: cluster 2024-09-13T23:00:15.348099+0000 mgr.a (mgr.14355) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:16.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:16 smithi131 bash[24745]: audit 2024-09-13T23:00:15.273023+0000 mgr.a (mgr.14355) 1703 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:16.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:16 smithi131 bash[24745]: cluster 2024-09-13T23:00:15.348099+0000 mgr.a (mgr.14355) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:16.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:16 smithi171 bash[25040]: audit 2024-09-13T23:00:15.273023+0000 mgr.a (mgr.14355) 1703 : audit [DBG] from='client.49350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:16.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:16 smithi171 bash[25040]: cluster 2024-09-13T23:00:15.348099+0000 mgr.a (mgr.14355) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:18.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:18 smithi007 bash[22722]: cluster 2024-09-13T23:00:17.349099+0000 mgr.a (mgr.14355) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:18 smithi131 bash[24745]: cluster 2024-09-13T23:00:17.349099+0000 mgr.a (mgr.14355) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:18.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:18 smithi171 bash[25040]: cluster 2024-09-13T23:00:17.349099+0000 mgr.a (mgr.14355) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:20.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:20.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:20.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:20.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:20 smithi007 bash[22722]: cluster 2024-09-13T23:00:19.350073+0000 mgr.a (mgr.14355) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:20 smithi131 bash[24745]: cluster 2024-09-13T23:00:19.350073+0000 mgr.a (mgr.14355) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:20.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:20 smithi171 bash[25040]: cluster 2024-09-13T23:00:19.350073+0000 mgr.a (mgr.14355) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:21.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:22 smithi131 bash[24745]: audit 2024-09-13T23:00:21.039314+0000 mgr.a (mgr.14355) 1707 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:22 smithi131 bash[24745]: cluster 2024-09-13T23:00:21.351374+0000 mgr.a (mgr.14355) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:22 smithi171 bash[25040]: audit 2024-09-13T23:00:21.039314+0000 mgr.a (mgr.14355) 1707 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:22.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:22 smithi171 bash[25040]: cluster 2024-09-13T23:00:21.351374+0000 mgr.a (mgr.14355) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:22.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:22 smithi007 bash[22722]: audit 2024-09-13T23:00:21.039314+0000 mgr.a (mgr.14355) 1707 : audit [DBG] from='client.49428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:22 smithi007 bash[22722]: cluster 2024-09-13T23:00:21.351374+0000 mgr.a (mgr.14355) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:24 smithi131 bash[24745]: cluster 2024-09-13T23:00:23.352330+0000 mgr.a (mgr.14355) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:24.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:24 smithi171 bash[25040]: cluster 2024-09-13T23:00:23.352330+0000 mgr.a (mgr.14355) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:24.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:24 smithi007 bash[22722]: cluster 2024-09-13T23:00:23.352330+0000 mgr.a (mgr.14355) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:00:26.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:26.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:26 smithi131 bash[24745]: cluster 2024-09-13T23:00:25.354542+0000 mgr.a (mgr.14355) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:26.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:26 smithi171 bash[25040]: cluster 2024-09-13T23:00:25.354542+0000 mgr.a (mgr.14355) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:26.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:26 smithi007 bash[22722]: cluster 2024-09-13T23:00:25.354542+0000 mgr.a (mgr.14355) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:27.276 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:27.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:27.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:27.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:27.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:28 smithi131 bash[24745]: audit 2024-09-13T23:00:26.833147+0000 mgr.a (mgr.14355) 1711 : audit [DBG] from='client.49503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:28 smithi131 bash[24745]: cluster 2024-09-13T23:00:27.355484+0000 mgr.a (mgr.14355) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:28 smithi171 bash[25040]: audit 2024-09-13T23:00:26.833147+0000 mgr.a (mgr.14355) 1711 : audit [DBG] from='client.49503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:28.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:28 smithi171 bash[25040]: cluster 2024-09-13T23:00:27.355484+0000 mgr.a (mgr.14355) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:28.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:28 smithi007 bash[22722]: audit 2024-09-13T23:00:26.833147+0000 mgr.a (mgr.14355) 1711 : audit [DBG] from='client.49503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:28 smithi007 bash[22722]: cluster 2024-09-13T23:00:27.355484+0000 mgr.a (mgr.14355) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:30 smithi131 bash[24745]: cluster 2024-09-13T23:00:29.356417+0000 mgr.a (mgr.14355) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:30 smithi171 bash[25040]: cluster 2024-09-13T23:00:29.356417+0000 mgr.a (mgr.14355) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:30.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:30 smithi007 bash[22722]: cluster 2024-09-13T23:00:29.356417+0000 mgr.a (mgr.14355) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:32.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:32.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:32.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:32 smithi131 bash[24745]: cluster 2024-09-13T23:00:31.358693+0000 mgr.a (mgr.14355) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:32.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:32 smithi171 bash[25040]: cluster 2024-09-13T23:00:31.358693+0000 mgr.a (mgr.14355) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:32 smithi007 bash[22722]: cluster 2024-09-13T23:00:31.358693+0000 mgr.a (mgr.14355) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:33.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:33.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:33.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:34 smithi131 bash[24745]: audit 2024-09-13T23:00:32.616069+0000 mgr.a (mgr.14355) 1715 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:34 smithi131 bash[24745]: cluster 2024-09-13T23:00:33.359639+0000 mgr.a (mgr.14355) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:34 smithi171 bash[25040]: audit 2024-09-13T23:00:32.616069+0000 mgr.a (mgr.14355) 1715 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:34 smithi171 bash[25040]: cluster 2024-09-13T23:00:33.359639+0000 mgr.a (mgr.14355) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:34 smithi007 bash[22722]: audit 2024-09-13T23:00:32.616069+0000 mgr.a (mgr.14355) 1715 : audit [DBG] from='client.49581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:34 smithi007 bash[22722]: cluster 2024-09-13T23:00:33.359639+0000 mgr.a (mgr.14355) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:36 smithi131 bash[24745]: cluster 2024-09-13T23:00:35.361776+0000 mgr.a (mgr.14355) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:36 smithi171 bash[25040]: cluster 2024-09-13T23:00:35.361776+0000 mgr.a (mgr.14355) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:36.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:36 smithi007 bash[22722]: cluster 2024-09-13T23:00:35.361776+0000 mgr.a (mgr.14355) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:38.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:38.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:38 smithi131 bash[24745]: cluster 2024-09-13T23:00:37.362550+0000 mgr.a (mgr.14355) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:38 smithi171 bash[25040]: cluster 2024-09-13T23:00:37.362550+0000 mgr.a (mgr.14355) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:38.831 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:38.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:38.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:38.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:38.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:38.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:38 smithi007 bash[22722]: cluster 2024-09-13T23:00:37.362550+0000 mgr.a (mgr.14355) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:39 smithi131 bash[24745]: audit 2024-09-13T23:00:38.391042+0000 mgr.a (mgr.14355) 1719 : audit [DBG] from='client.49653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:39 smithi171 bash[25040]: audit 2024-09-13T23:00:38.391042+0000 mgr.a (mgr.14355) 1719 : audit [DBG] from='client.49653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:39.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:39 smithi007 bash[22722]: audit 2024-09-13T23:00:38.391042+0000 mgr.a (mgr.14355) 1719 : audit [DBG] from='client.49653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:40 smithi131 bash[24745]: cluster 2024-09-13T23:00:39.363547+0000 mgr.a (mgr.14355) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:40 smithi171 bash[25040]: cluster 2024-09-13T23:00:39.363547+0000 mgr.a (mgr.14355) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:40.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:40 smithi007 bash[22722]: cluster 2024-09-13T23:00:39.363547+0000 mgr.a (mgr.14355) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:42 smithi131 bash[24745]: cluster 2024-09-13T23:00:41.365842+0000 mgr.a (mgr.14355) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:42 smithi171 bash[25040]: cluster 2024-09-13T23:00:41.365842+0000 mgr.a (mgr.14355) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:42.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:42 smithi007 bash[22722]: cluster 2024-09-13T23:00:41.365842+0000 mgr.a (mgr.14355) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:00:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:43 smithi131 bash[24745]: audit 2024-09-13T23:00:43.423489+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:43 smithi171 bash[25040]: audit 2024-09-13T23:00:43.423489+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:43.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:43.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:43 smithi007 bash[22722]: audit 2024-09-13T23:00:43.423489+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:44.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:44.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:44 smithi131 bash[24745]: cluster 2024-09-13T23:00:43.366624+0000 mgr.a (mgr.14355) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:44 smithi131 bash[24745]: audit 2024-09-13T23:00:44.253090+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:44 smithi131 bash[24745]: audit 2024-09-13T23:00:44.254853+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:44 smithi131 bash[24745]: audit 2024-09-13T23:00:44.261035+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:00:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:44 smithi131 bash[24745]: audit 2024-09-13T23:00:44.263215+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:44.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:44 smithi171 bash[25040]: cluster 2024-09-13T23:00:43.366624+0000 mgr.a (mgr.14355) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:44 smithi171 bash[25040]: audit 2024-09-13T23:00:44.253090+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:44 smithi171 bash[25040]: audit 2024-09-13T23:00:44.254853+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:44 smithi171 bash[25040]: audit 2024-09-13T23:00:44.261035+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:00:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:44 smithi171 bash[25040]: audit 2024-09-13T23:00:44.263215+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:44.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:44 smithi007 bash[22722]: cluster 2024-09-13T23:00:43.366624+0000 mgr.a (mgr.14355) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:00:44.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:44 smithi007 bash[22722]: audit 2024-09-13T23:00:44.253090+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:44 smithi007 bash[22722]: audit 2024-09-13T23:00:44.254853+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:44 smithi007 bash[22722]: audit 2024-09-13T23:00:44.261035+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:00:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:44 smithi007 bash[22722]: audit 2024-09-13T23:00:44.263215+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:45.702 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:00:45 smithi007 bash[22972]: debug 2024-09-13T23:00:45.298+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:00:45.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:00:45 smithi007 bash[22972]: debug 2024-09-13T23:00:45.302+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:00:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:45 smithi007 bash[22722]: audit 2024-09-13T23:00:44.193338+0000 mgr.a (mgr.14355) 1723 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:45 smithi007 bash[22722]: audit 2024-09-13T23:00:44.264356+0000 mgr.a (mgr.14355) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:45 smithi131 bash[24745]: audit 2024-09-13T23:00:44.193338+0000 mgr.a (mgr.14355) 1723 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:45 smithi131 bash[24745]: audit 2024-09-13T23:00:44.264356+0000 mgr.a (mgr.14355) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:45 smithi171 bash[25040]: audit 2024-09-13T23:00:44.193338+0000 mgr.a (mgr.14355) 1723 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:45 smithi171 bash[25040]: audit 2024-09-13T23:00:44.264356+0000 mgr.a (mgr.14355) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:00:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:46 smithi131 bash[24745]: audit 2024-09-13T23:00:45.301322+0000 mgr.a (mgr.14355) 1725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:00:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:46 smithi131 bash[24745]: cephadm 2024-09-13T23:00:45.302694+0000 mgr.a (mgr.14355) 1726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:00:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:46 smithi131 bash[24745]: cluster 2024-09-13T23:00:45.368160+0000 mgr.a (mgr.14355) 1727 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:46 smithi171 bash[25040]: audit 2024-09-13T23:00:45.301322+0000 mgr.a (mgr.14355) 1725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:00:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:46 smithi171 bash[25040]: cephadm 2024-09-13T23:00:45.302694+0000 mgr.a (mgr.14355) 1726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:00:46.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:46 smithi171 bash[25040]: cluster 2024-09-13T23:00:45.368160+0000 mgr.a (mgr.14355) 1727 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:46 smithi007 bash[22722]: audit 2024-09-13T23:00:45.301322+0000 mgr.a (mgr.14355) 1725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:00:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:46 smithi007 bash[22722]: cephadm 2024-09-13T23:00:45.302694+0000 mgr.a (mgr.14355) 1726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:00:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:46 smithi007 bash[22722]: cluster 2024-09-13T23:00:45.368160+0000 mgr.a (mgr.14355) 1727 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:48.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:48 smithi131 bash[24745]: cluster 2024-09-13T23:00:47.368910+0000 mgr.a (mgr.14355) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:48 smithi171 bash[25040]: cluster 2024-09-13T23:00:47.368910+0000 mgr.a (mgr.14355) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:48 smithi007 bash[22722]: cluster 2024-09-13T23:00:47.368910+0000 mgr.a (mgr.14355) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:49.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:49.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:50.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:50.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:50.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:50 smithi171 bash[25040]: cluster 2024-09-13T23:00:49.369693+0000 mgr.a (mgr.14355) 1729 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:50 smithi007 bash[22722]: cluster 2024-09-13T23:00:49.369693+0000 mgr.a (mgr.14355) 1729 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:50 smithi131 bash[24745]: cluster 2024-09-13T23:00:49.369693+0000 mgr.a (mgr.14355) 1729 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:00:51.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:51 smithi171 bash[25040]: audit 2024-09-13T23:00:49.956520+0000 mgr.a (mgr.14355) 1730 : audit [DBG] from='client.49908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:51.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:51 smithi007 bash[22722]: audit 2024-09-13T23:00:49.956520+0000 mgr.a (mgr.14355) 1730 : audit [DBG] from='client.49908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:51 smithi131 bash[24745]: audit 2024-09-13T23:00:49.956520+0000 mgr.a (mgr.14355) 1730 : audit [DBG] from='client.49908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:52 smithi007 bash[22722]: cluster 2024-09-13T23:00:51.372461+0000 mgr.a (mgr.14355) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:53.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:52 smithi131 bash[24745]: cluster 2024-09-13T23:00:51.372461+0000 mgr.a (mgr.14355) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:53.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:52 smithi171 bash[25040]: cluster 2024-09-13T23:00:51.372461+0000 mgr.a (mgr.14355) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:54 smithi007 bash[22722]: cluster 2024-09-13T23:00:53.373233+0000 mgr.a (mgr.14355) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:00:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:54 smithi131 bash[24745]: cluster 2024-09-13T23:00:53.373233+0000 mgr.a (mgr.14355) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:00:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:54 smithi171 bash[25040]: cluster 2024-09-13T23:00:53.373233+0000 mgr.a (mgr.14355) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:00:55.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:00:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:00:55.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:00:56.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:00:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:00:56.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:00:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:00:56.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:00:56.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:56 smithi007 bash[22722]: cluster 2024-09-13T23:00:55.374519+0000 mgr.a (mgr.14355) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:56 smithi131 bash[24745]: cluster 2024-09-13T23:00:55.374519+0000 mgr.a (mgr.14355) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:56 smithi171 bash[25040]: cluster 2024-09-13T23:00:55.374519+0000 mgr.a (mgr.14355) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:00:57.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:57 smithi007 bash[22722]: audit 2024-09-13T23:00:55.699139+0000 mgr.a (mgr.14355) 1734 : audit [DBG] from='client.49986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:57 smithi131 bash[24745]: audit 2024-09-13T23:00:55.699139+0000 mgr.a (mgr.14355) 1734 : audit [DBG] from='client.49986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:57 smithi171 bash[25040]: audit 2024-09-13T23:00:55.699139+0000 mgr.a (mgr.14355) 1734 : audit [DBG] from='client.49986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:00:58 smithi007 bash[22722]: cluster 2024-09-13T23:00:57.375464+0000 mgr.a (mgr.14355) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:00:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:00:58 smithi131 bash[24745]: cluster 2024-09-13T23:00:57.375464+0000 mgr.a (mgr.14355) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:00:59.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:00:58 smithi171 bash[25040]: cluster 2024-09-13T23:00:57.375464+0000 mgr.a (mgr.14355) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:00 smithi007 bash[22722]: cluster 2024-09-13T23:00:59.376232+0000 mgr.a (mgr.14355) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:00 smithi131 bash[24745]: cluster 2024-09-13T23:00:59.376232+0000 mgr.a (mgr.14355) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:00 smithi171 bash[25040]: cluster 2024-09-13T23:00:59.376232+0000 mgr.a (mgr.14355) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:01.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:01.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:01.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:01.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:01.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:01.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:01.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:01.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:02 smithi007 bash[22722]: cluster 2024-09-13T23:01:01.378350+0000 mgr.a (mgr.14355) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:01:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:02 smithi007 bash[22722]: audit 2024-09-13T23:01:01.443516+0000 mgr.a (mgr.14355) 1738 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:02 smithi131 bash[24745]: cluster 2024-09-13T23:01:01.378350+0000 mgr.a (mgr.14355) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:01:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:02 smithi131 bash[24745]: audit 2024-09-13T23:01:01.443516+0000 mgr.a (mgr.14355) 1738 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:02 smithi171 bash[25040]: cluster 2024-09-13T23:01:01.378350+0000 mgr.a (mgr.14355) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:01:03.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:02 smithi171 bash[25040]: audit 2024-09-13T23:01:01.443516+0000 mgr.a (mgr.14355) 1738 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:04 smithi007 bash[22722]: cluster 2024-09-13T23:01:03.379432+0000 mgr.a (mgr.14355) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:01:05.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:04 smithi131 bash[24745]: cluster 2024-09-13T23:01:03.379432+0000 mgr.a (mgr.14355) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:01:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:04 smithi171 bash[25040]: cluster 2024-09-13T23:01:03.379432+0000 mgr.a (mgr.14355) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:01:06.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:06.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:06.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:06 smithi007 bash[22722]: cluster 2024-09-13T23:01:05.381640+0000 mgr.a (mgr.14355) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:01:07.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:06 smithi131 bash[24745]: cluster 2024-09-13T23:01:05.381640+0000 mgr.a (mgr.14355) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:01:07.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:06 smithi171 bash[25040]: cluster 2024-09-13T23:01:05.381640+0000 mgr.a (mgr.14355) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:01:07.612 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:08 smithi007 bash[22722]: audit 2024-09-13T23:01:07.197555+0000 mgr.a (mgr.14355) 1741 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:08 smithi007 bash[22722]: cluster 2024-09-13T23:01:07.382188+0000 mgr.a (mgr.14355) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:08 smithi131 bash[24745]: audit 2024-09-13T23:01:07.197555+0000 mgr.a (mgr.14355) 1741 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:08 smithi131 bash[24745]: cluster 2024-09-13T23:01:07.382188+0000 mgr.a (mgr.14355) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:09.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:08 smithi171 bash[25040]: audit 2024-09-13T23:01:07.197555+0000 mgr.a (mgr.14355) 1741 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:08 smithi171 bash[25040]: cluster 2024-09-13T23:01:07.382188+0000 mgr.a (mgr.14355) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:10.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:10 smithi007 bash[22722]: cluster 2024-09-13T23:01:09.383040+0000 mgr.a (mgr.14355) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:10 smithi131 bash[24745]: cluster 2024-09-13T23:01:09.383040+0000 mgr.a (mgr.14355) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:11.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:10 smithi171 bash[25040]: cluster 2024-09-13T23:01:09.383040+0000 mgr.a (mgr.14355) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:12.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:12.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:12 smithi007 bash[22722]: cluster 2024-09-13T23:01:11.385299+0000 mgr.a (mgr.14355) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:12 smithi131 bash[24745]: cluster 2024-09-13T23:01:11.385299+0000 mgr.a (mgr.14355) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:12 smithi171 bash[25040]: cluster 2024-09-13T23:01:11.385299+0000 mgr.a (mgr.14355) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:13.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:13.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:14 smithi007 bash[22722]: audit 2024-09-13T23:01:12.954444+0000 mgr.a (mgr.14355) 1745 : audit [DBG] from='client.50211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:14 smithi007 bash[22722]: cluster 2024-09-13T23:01:13.385831+0000 mgr.a (mgr.14355) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:14 smithi131 bash[24745]: audit 2024-09-13T23:01:12.954444+0000 mgr.a (mgr.14355) 1745 : audit [DBG] from='client.50211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:14 smithi131 bash[24745]: cluster 2024-09-13T23:01:13.385831+0000 mgr.a (mgr.14355) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:15.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:14 smithi171 bash[25040]: audit 2024-09-13T23:01:12.954444+0000 mgr.a (mgr.14355) 1745 : audit [DBG] from='client.50211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:15.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:14 smithi171 bash[25040]: cluster 2024-09-13T23:01:13.385831+0000 mgr.a (mgr.14355) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:16.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:16 smithi007 bash[22722]: cluster 2024-09-13T23:01:15.387976+0000 mgr.a (mgr.14355) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:16 smithi131 bash[24745]: cluster 2024-09-13T23:01:15.387976+0000 mgr.a (mgr.14355) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:16 smithi171 bash[25040]: cluster 2024-09-13T23:01:15.387976+0000 mgr.a (mgr.14355) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:18.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:18.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:18.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:18.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:18 smithi007 bash[22722]: cluster 2024-09-13T23:01:17.388737+0000 mgr.a (mgr.14355) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:18 smithi131 bash[24745]: cluster 2024-09-13T23:01:17.388737+0000 mgr.a (mgr.14355) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:19.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:18 smithi171 bash[25040]: cluster 2024-09-13T23:01:17.388737+0000 mgr.a (mgr.14355) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:19.126 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:19.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:20 smithi007 bash[22722]: audit 2024-09-13T23:01:18.720037+0000 mgr.a (mgr.14355) 1749 : audit [DBG] from='client.50289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:20 smithi007 bash[22722]: cluster 2024-09-13T23:01:19.389702+0000 mgr.a (mgr.14355) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:20 smithi131 bash[24745]: audit 2024-09-13T23:01:18.720037+0000 mgr.a (mgr.14355) 1749 : audit [DBG] from='client.50289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:20 smithi131 bash[24745]: cluster 2024-09-13T23:01:19.389702+0000 mgr.a (mgr.14355) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:20 smithi171 bash[25040]: audit 2024-09-13T23:01:18.720037+0000 mgr.a (mgr.14355) 1749 : audit [DBG] from='client.50289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:20 smithi171 bash[25040]: cluster 2024-09-13T23:01:19.389702+0000 mgr.a (mgr.14355) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:22 smithi007 bash[22722]: cluster 2024-09-13T23:01:21.391989+0000 mgr.a (mgr.14355) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:22 smithi131 bash[24745]: cluster 2024-09-13T23:01:21.391989+0000 mgr.a (mgr.14355) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:22 smithi171 bash[25040]: cluster 2024-09-13T23:01:21.391989+0000 mgr.a (mgr.14355) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:24.892 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:24.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:24 smithi007 bash[22722]: cluster 2024-09-13T23:01:23.392773+0000 mgr.a (mgr.14355) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:24 smithi131 bash[24745]: cluster 2024-09-13T23:01:23.392773+0000 mgr.a (mgr.14355) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:25.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:24 smithi171 bash[25040]: cluster 2024-09-13T23:01:23.392773+0000 mgr.a (mgr.14355) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:25 smithi007 bash[22722]: audit 2024-09-13T23:01:24.459414+0000 mgr.a (mgr.14355) 1753 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:25 smithi131 bash[24745]: audit 2024-09-13T23:01:24.459414+0000 mgr.a (mgr.14355) 1753 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:26.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:25 smithi171 bash[25040]: audit 2024-09-13T23:01:24.459414+0000 mgr.a (mgr.14355) 1753 : audit [DBG] from='client.50367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:26 smithi007 bash[22722]: cluster 2024-09-13T23:01:25.395159+0000 mgr.a (mgr.14355) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:26 smithi131 bash[24745]: cluster 2024-09-13T23:01:25.395159+0000 mgr.a (mgr.14355) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:27.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:26 smithi171 bash[25040]: cluster 2024-09-13T23:01:25.395159+0000 mgr.a (mgr.14355) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:27.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:27 smithi007 bash[22722]: cluster 2024-09-13T23:01:27.395966+0000 mgr.a (mgr.14355) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:27 smithi131 bash[24745]: cluster 2024-09-13T23:01:27.395966+0000 mgr.a (mgr.14355) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:28.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:27 smithi171 bash[25040]: cluster 2024-09-13T23:01:27.395966+0000 mgr.a (mgr.14355) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:30.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:30.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:30.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:30.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:30.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:30.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:30 smithi007 bash[22722]: cluster 2024-09-13T23:01:29.396730+0000 mgr.a (mgr.14355) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:30 smithi131 bash[24745]: cluster 2024-09-13T23:01:29.396730+0000 mgr.a (mgr.14355) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:30.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:30 smithi171 bash[25040]: cluster 2024-09-13T23:01:29.396730+0000 mgr.a (mgr.14355) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:31 smithi131 bash[24745]: audit 2024-09-13T23:01:30.224154+0000 mgr.a (mgr.14355) 1757 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:31.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:31 smithi171 bash[25040]: audit 2024-09-13T23:01:30.224154+0000 mgr.a (mgr.14355) 1757 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:31 smithi007 bash[22722]: audit 2024-09-13T23:01:30.224154+0000 mgr.a (mgr.14355) 1757 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:32.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:32 smithi131 bash[24745]: cluster 2024-09-13T23:01:31.399510+0000 mgr.a (mgr.14355) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:32.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:32 smithi171 bash[25040]: cluster 2024-09-13T23:01:31.399510+0000 mgr.a (mgr.14355) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:32.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:32 smithi007 bash[22722]: cluster 2024-09-13T23:01:31.399510+0000 mgr.a (mgr.14355) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:34 smithi131 bash[24745]: cluster 2024-09-13T23:01:33.400292+0000 mgr.a (mgr.14355) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:34 smithi171 bash[25040]: cluster 2024-09-13T23:01:33.400292+0000 mgr.a (mgr.14355) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:34.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:34 smithi007 bash[22722]: cluster 2024-09-13T23:01:33.400292+0000 mgr.a (mgr.14355) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:35.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:35.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:35.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:36.381 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:36 smithi131 bash[24745]: cluster 2024-09-13T23:01:35.402350+0000 mgr.a (mgr.14355) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:36 smithi171 bash[25040]: cluster 2024-09-13T23:01:35.402350+0000 mgr.a (mgr.14355) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:36 smithi007 bash[22722]: cluster 2024-09-13T23:01:35.402350+0000 mgr.a (mgr.14355) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:37.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:37 smithi131 bash[24745]: audit 2024-09-13T23:01:35.971587+0000 mgr.a (mgr.14355) 1761 : audit [DBG] from='client.50517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:37 smithi171 bash[25040]: audit 2024-09-13T23:01:35.971587+0000 mgr.a (mgr.14355) 1761 : audit [DBG] from='client.50517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:37.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:37 smithi007 bash[22722]: audit 2024-09-13T23:01:35.971587+0000 mgr.a (mgr.14355) 1761 : audit [DBG] from='client.50517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:38 smithi131 bash[24745]: cluster 2024-09-13T23:01:37.403258+0000 mgr.a (mgr.14355) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:38.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:38 smithi171 bash[25040]: cluster 2024-09-13T23:01:37.403258+0000 mgr.a (mgr.14355) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:38 smithi007 bash[22722]: cluster 2024-09-13T23:01:37.403258+0000 mgr.a (mgr.14355) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:01:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:40 smithi131 bash[24745]: cluster 2024-09-13T23:01:39.404044+0000 mgr.a (mgr.14355) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:01:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:40 smithi171 bash[25040]: cluster 2024-09-13T23:01:39.404044+0000 mgr.a (mgr.14355) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:01:40.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:40 smithi007 bash[22722]: cluster 2024-09-13T23:01:39.404044+0000 mgr.a (mgr.14355) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:01:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:41.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:42.131 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:42.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:42 smithi131 bash[24745]: cluster 2024-09-13T23:01:41.405710+0000 mgr.a (mgr.14355) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:42.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:42 smithi171 bash[25040]: cluster 2024-09-13T23:01:41.405710+0000 mgr.a (mgr.14355) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:42 smithi007 bash[22722]: cluster 2024-09-13T23:01:41.405710+0000 mgr.a (mgr.14355) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:43 smithi131 bash[24745]: audit 2024-09-13T23:01:41.718752+0000 mgr.a (mgr.14355) 1765 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:43.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:43 smithi171 bash[25040]: audit 2024-09-13T23:01:41.718752+0000 mgr.a (mgr.14355) 1765 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:43.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:43 smithi007 bash[22722]: audit 2024-09-13T23:01:41.718752+0000 mgr.a (mgr.14355) 1765 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:44 smithi131 bash[24745]: cluster 2024-09-13T23:01:43.406584+0000 mgr.a (mgr.14355) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:44 smithi171 bash[25040]: cluster 2024-09-13T23:01:43.406584+0000 mgr.a (mgr.14355) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:44 smithi007 bash[22722]: cluster 2024-09-13T23:01:43.406584+0000 mgr.a (mgr.14355) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:45 smithi131 bash[24745]: audit 2024-09-13T23:01:45.353908+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:45 smithi171 bash[25040]: audit 2024-09-13T23:01:45.353908+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:45 smithi007 bash[22722]: audit 2024-09-13T23:01:45.353908+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:46 smithi131 bash[24745]: cluster 2024-09-13T23:01:45.408905+0000 mgr.a (mgr.14355) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:46 smithi131 bash[24745]: audit 2024-09-13T23:01:46.186947+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:46 smithi131 bash[24745]: audit 2024-09-13T23:01:46.188515+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:46 smithi131 bash[24745]: audit 2024-09-13T23:01:46.198559+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:01:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:46 smithi131 bash[24745]: audit 2024-09-13T23:01:46.203044+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:46 smithi171 bash[25040]: cluster 2024-09-13T23:01:45.408905+0000 mgr.a (mgr.14355) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:46 smithi171 bash[25040]: audit 2024-09-13T23:01:46.186947+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:46 smithi171 bash[25040]: audit 2024-09-13T23:01:46.188515+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:46 smithi171 bash[25040]: audit 2024-09-13T23:01:46.198559+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:01:46.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:46 smithi171 bash[25040]: audit 2024-09-13T23:01:46.203044+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:46.946 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22722]: cluster 2024-09-13T23:01:45.408905+0000 mgr.a (mgr.14355) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:01:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22722]: audit 2024-09-13T23:01:46.186947+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22722]: audit 2024-09-13T23:01:46.188515+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22722]: audit 2024-09-13T23:01:46.198559+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:01:46.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22722]: audit 2024-09-13T23:01:46.203044+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:47.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:47.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22972]: debug 2024-09-13T23:01:46.945+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:01:47.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:01:46 smithi007 bash[22972]: debug 2024-09-13T23:01:46.945+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:01:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:47 smithi131 bash[24745]: audit 2024-09-13T23:01:46.205401+0000 mgr.a (mgr.14355) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:47.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:47 smithi171 bash[25040]: audit 2024-09-13T23:01:46.205401+0000 mgr.a (mgr.14355) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:47.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:47.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:47.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:47.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:47.874 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:47.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:47 smithi007 bash[22722]: audit 2024-09-13T23:01:46.205401+0000 mgr.a (mgr.14355) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:01:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:48 smithi131 bash[24745]: audit 2024-09-13T23:01:46.947769+0000 mgr.a (mgr.14355) 1769 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:01:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:48 smithi131 bash[24745]: cephadm 2024-09-13T23:01:46.949538+0000 mgr.a (mgr.14355) 1770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:01:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:48 smithi131 bash[24745]: cluster 2024-09-13T23:01:47.409782+0000 mgr.a (mgr.14355) 1771 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:48 smithi131 bash[24745]: audit 2024-09-13T23:01:47.459652+0000 mgr.a (mgr.14355) 1772 : audit [DBG] from='client.50775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:48.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:48 smithi171 bash[25040]: audit 2024-09-13T23:01:46.947769+0000 mgr.a (mgr.14355) 1769 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:01:48.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:48 smithi171 bash[25040]: cephadm 2024-09-13T23:01:46.949538+0000 mgr.a (mgr.14355) 1770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:01:48.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:48 smithi171 bash[25040]: cluster 2024-09-13T23:01:47.409782+0000 mgr.a (mgr.14355) 1771 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:48.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:48 smithi171 bash[25040]: audit 2024-09-13T23:01:47.459652+0000 mgr.a (mgr.14355) 1772 : audit [DBG] from='client.50775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:48 smithi007 bash[22722]: audit 2024-09-13T23:01:46.947769+0000 mgr.a (mgr.14355) 1769 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:01:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:48 smithi007 bash[22722]: cephadm 2024-09-13T23:01:46.949538+0000 mgr.a (mgr.14355) 1770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:01:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:48 smithi007 bash[22722]: cluster 2024-09-13T23:01:47.409782+0000 mgr.a (mgr.14355) 1771 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:48 smithi007 bash[22722]: audit 2024-09-13T23:01:47.459652+0000 mgr.a (mgr.14355) 1772 : audit [DBG] from='client.50775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:50.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:50 smithi131 bash[24745]: cluster 2024-09-13T23:01:49.410685+0000 mgr.a (mgr.14355) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:50.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:50 smithi171 bash[25040]: cluster 2024-09-13T23:01:49.410685+0000 mgr.a (mgr.14355) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:50 smithi007 bash[22722]: cluster 2024-09-13T23:01:49.410685+0000 mgr.a (mgr.14355) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:01:52.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:52 smithi171 bash[25040]: cluster 2024-09-13T23:01:51.412920+0000 mgr.a (mgr.14355) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:52.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:52 smithi007 bash[22722]: cluster 2024-09-13T23:01:51.412920+0000 mgr.a (mgr.14355) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:53.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:52 smithi131 bash[24745]: cluster 2024-09-13T23:01:51.412920+0000 mgr.a (mgr.14355) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:53.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:53.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:01:54.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:54 smithi171 bash[25040]: audit 2024-09-13T23:01:53.207817+0000 mgr.a (mgr.14355) 1775 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:54.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:54 smithi171 bash[25040]: cluster 2024-09-13T23:01:53.413388+0000 mgr.a (mgr.14355) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:54.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:54 smithi007 bash[22722]: audit 2024-09-13T23:01:53.207817+0000 mgr.a (mgr.14355) 1775 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:54 smithi007 bash[22722]: cluster 2024-09-13T23:01:53.413388+0000 mgr.a (mgr.14355) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:54 smithi131 bash[24745]: audit 2024-09-13T23:01:53.207817+0000 mgr.a (mgr.14355) 1775 : audit [DBG] from='client.50853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:54 smithi131 bash[24745]: cluster 2024-09-13T23:01:53.413388+0000 mgr.a (mgr.14355) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:56 smithi171 bash[25040]: cluster 2024-09-13T23:01:55.415566+0000 mgr.a (mgr.14355) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:56 smithi007 bash[22722]: cluster 2024-09-13T23:01:55.415566+0000 mgr.a (mgr.14355) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:56 smithi131 bash[24745]: cluster 2024-09-13T23:01:55.415566+0000 mgr.a (mgr.14355) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:58.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:01:58.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:01:58.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:01:58.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:01:58 smithi007 bash[22722]: cluster 2024-09-13T23:01:57.416364+0000 mgr.a (mgr.14355) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:01:58 smithi131 bash[24745]: cluster 2024-09-13T23:01:57.416364+0000 mgr.a (mgr.14355) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:59.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:01:58 smithi171 bash[25040]: cluster 2024-09-13T23:01:57.416364+0000 mgr.a (mgr.14355) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:01:59.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:01:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:01:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:01:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:01:59.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:00 smithi007 bash[22722]: audit 2024-09-13T23:01:58.948125+0000 mgr.a (mgr.14355) 1779 : audit [DBG] from='client.50931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:00 smithi007 bash[22722]: cluster 2024-09-13T23:01:59.416836+0000 mgr.a (mgr.14355) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:01.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:00 smithi131 bash[24745]: audit 2024-09-13T23:01:58.948125+0000 mgr.a (mgr.14355) 1779 : audit [DBG] from='client.50931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:01.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:00 smithi131 bash[24745]: cluster 2024-09-13T23:01:59.416836+0000 mgr.a (mgr.14355) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:00 smithi171 bash[25040]: audit 2024-09-13T23:01:58.948125+0000 mgr.a (mgr.14355) 1779 : audit [DBG] from='client.50931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:01.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:00 smithi171 bash[25040]: cluster 2024-09-13T23:01:59.416836+0000 mgr.a (mgr.14355) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:02 smithi007 bash[22722]: cluster 2024-09-13T23:02:01.419194+0000 mgr.a (mgr.14355) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:02:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:02 smithi131 bash[24745]: cluster 2024-09-13T23:02:01.419194+0000 mgr.a (mgr.14355) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:02:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:02 smithi171 bash[25040]: cluster 2024-09-13T23:02:01.419194+0000 mgr.a (mgr.14355) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:02:04.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:04.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:04 smithi007 bash[22722]: cluster 2024-09-13T23:02:03.419986+0000 mgr.a (mgr.14355) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:04 smithi131 bash[24745]: cluster 2024-09-13T23:02:03.419986+0000 mgr.a (mgr.14355) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:04 smithi171 bash[25040]: cluster 2024-09-13T23:02:03.419986+0000 mgr.a (mgr.14355) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:05.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:05.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:05.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:05.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:05.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:06 smithi007 bash[22722]: audit 2024-09-13T23:02:04.730742+0000 mgr.a (mgr.14355) 1783 : audit [DBG] from='client.51009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:06 smithi007 bash[22722]: cluster 2024-09-13T23:02:05.422260+0000 mgr.a (mgr.14355) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:06 smithi131 bash[24745]: audit 2024-09-13T23:02:04.730742+0000 mgr.a (mgr.14355) 1783 : audit [DBG] from='client.51009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:06 smithi131 bash[24745]: cluster 2024-09-13T23:02:05.422260+0000 mgr.a (mgr.14355) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:07.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:06 smithi171 bash[25040]: audit 2024-09-13T23:02:04.730742+0000 mgr.a (mgr.14355) 1783 : audit [DBG] from='client.51009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:07.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:06 smithi171 bash[25040]: cluster 2024-09-13T23:02:05.422260+0000 mgr.a (mgr.14355) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:08 smithi007 bash[22722]: cluster 2024-09-13T23:02:07.423072+0000 mgr.a (mgr.14355) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:08 smithi131 bash[24745]: cluster 2024-09-13T23:02:07.423072+0000 mgr.a (mgr.14355) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:09.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:08 smithi171 bash[25040]: cluster 2024-09-13T23:02:07.423072+0000 mgr.a (mgr.14355) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:10.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:10 smithi007 bash[22722]: cluster 2024-09-13T23:02:09.423847+0000 mgr.a (mgr.14355) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:10 smithi131 bash[24745]: cluster 2024-09-13T23:02:09.423847+0000 mgr.a (mgr.14355) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:11.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:10 smithi171 bash[25040]: cluster 2024-09-13T23:02:09.423847+0000 mgr.a (mgr.14355) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:11.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:11 smithi007 bash[22722]: audit 2024-09-13T23:02:10.477470+0000 mgr.a (mgr.14355) 1787 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:12.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:11 smithi131 bash[24745]: audit 2024-09-13T23:02:10.477470+0000 mgr.a (mgr.14355) 1787 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:12.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:11 smithi171 bash[25040]: audit 2024-09-13T23:02:10.477470+0000 mgr.a (mgr.14355) 1787 : audit [DBG] from='client.51087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:12 smithi007 bash[22722]: cluster 2024-09-13T23:02:11.426729+0000 mgr.a (mgr.14355) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:13.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:12 smithi131 bash[24745]: cluster 2024-09-13T23:02:11.426729+0000 mgr.a (mgr.14355) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:12 smithi171 bash[25040]: cluster 2024-09-13T23:02:11.426729+0000 mgr.a (mgr.14355) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:02:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:14 smithi007 bash[22722]: cluster 2024-09-13T23:02:13.427537+0000 mgr.a (mgr.14355) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:14 smithi131 bash[24745]: cluster 2024-09-13T23:02:13.427537+0000 mgr.a (mgr.14355) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:15.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:14 smithi171 bash[25040]: cluster 2024-09-13T23:02:13.427537+0000 mgr.a (mgr.14355) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:15.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:15.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:16.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:16.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:16 smithi007 bash[22722]: cluster 2024-09-13T23:02:15.429454+0000 mgr.a (mgr.14355) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:16 smithi131 bash[24745]: cluster 2024-09-13T23:02:15.429454+0000 mgr.a (mgr.14355) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:17.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:16 smithi171 bash[25040]: cluster 2024-09-13T23:02:15.429454+0000 mgr.a (mgr.14355) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:17.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:17 smithi007 bash[22722]: audit 2024-09-13T23:02:16.216630+0000 mgr.a (mgr.14355) 1791 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:18.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:17 smithi131 bash[24745]: audit 2024-09-13T23:02:16.216630+0000 mgr.a (mgr.14355) 1791 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:18.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:17 smithi171 bash[25040]: audit 2024-09-13T23:02:16.216630+0000 mgr.a (mgr.14355) 1791 : audit [DBG] from='client.51165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:18 smithi007 bash[22722]: cluster 2024-09-13T23:02:17.430423+0000 mgr.a (mgr.14355) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:18 smithi131 bash[24745]: cluster 2024-09-13T23:02:17.430423+0000 mgr.a (mgr.14355) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:19.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:18 smithi171 bash[25040]: cluster 2024-09-13T23:02:17.430423+0000 mgr.a (mgr.14355) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:02:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:20 smithi007 bash[22722]: cluster 2024-09-13T23:02:19.431267+0000 mgr.a (mgr.14355) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:02:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:20 smithi131 bash[24745]: cluster 2024-09-13T23:02:19.431267+0000 mgr.a (mgr.14355) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:02:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:20 smithi171 bash[25040]: cluster 2024-09-13T23:02:19.431267+0000 mgr.a (mgr.14355) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:02:21.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:22.379 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:22.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:22.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:22.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:22.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:22 smithi007 bash[22722]: cluster 2024-09-13T23:02:21.433499+0000 mgr.a (mgr.14355) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:22 smithi131 bash[24745]: cluster 2024-09-13T23:02:21.433499+0000 mgr.a (mgr.14355) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:23.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:22 smithi171 bash[25040]: cluster 2024-09-13T23:02:21.433499+0000 mgr.a (mgr.14355) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:23.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:23 smithi007 bash[22722]: audit 2024-09-13T23:02:21.968648+0000 mgr.a (mgr.14355) 1795 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:24.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:23 smithi131 bash[24745]: audit 2024-09-13T23:02:21.968648+0000 mgr.a (mgr.14355) 1795 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:24.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:23 smithi171 bash[25040]: audit 2024-09-13T23:02:21.968648+0000 mgr.a (mgr.14355) 1795 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:24 smithi007 bash[22722]: cluster 2024-09-13T23:02:23.434569+0000 mgr.a (mgr.14355) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:24 smithi131 bash[24745]: cluster 2024-09-13T23:02:23.434569+0000 mgr.a (mgr.14355) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:24 smithi171 bash[25040]: cluster 2024-09-13T23:02:23.434569+0000 mgr.a (mgr.14355) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:26 smithi007 bash[22722]: cluster 2024-09-13T23:02:25.436747+0000 mgr.a (mgr.14355) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:26 smithi131 bash[24745]: cluster 2024-09-13T23:02:25.436747+0000 mgr.a (mgr.14355) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:26 smithi171 bash[25040]: cluster 2024-09-13T23:02:25.436747+0000 mgr.a (mgr.14355) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:27.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:27.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:27.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:28.126 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:28.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:28.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:28.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:28.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:28.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:28 smithi007 bash[22722]: cluster 2024-09-13T23:02:27.437573+0000 mgr.a (mgr.14355) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:28 smithi131 bash[24745]: cluster 2024-09-13T23:02:27.437573+0000 mgr.a (mgr.14355) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:29.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:28 smithi171 bash[25040]: cluster 2024-09-13T23:02:27.437573+0000 mgr.a (mgr.14355) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:29.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:29 smithi007 bash[22722]: audit 2024-09-13T23:02:27.710764+0000 mgr.a (mgr.14355) 1799 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:30.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:29 smithi131 bash[24745]: audit 2024-09-13T23:02:27.710764+0000 mgr.a (mgr.14355) 1799 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:30.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:29 smithi171 bash[25040]: audit 2024-09-13T23:02:27.710764+0000 mgr.a (mgr.14355) 1799 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:30 smithi007 bash[22722]: cluster 2024-09-13T23:02:29.438490+0000 mgr.a (mgr.14355) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:31.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:30 smithi131 bash[24745]: cluster 2024-09-13T23:02:29.438490+0000 mgr.a (mgr.14355) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:31.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:30 smithi171 bash[25040]: cluster 2024-09-13T23:02:29.438490+0000 mgr.a (mgr.14355) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:31 smithi007 bash[22722]: cluster 2024-09-13T23:02:31.440726+0000 mgr.a (mgr.14355) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:32.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:31 smithi131 bash[24745]: cluster 2024-09-13T23:02:31.440726+0000 mgr.a (mgr.14355) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:31 smithi171 bash[25040]: cluster 2024-09-13T23:02:31.440726+0000 mgr.a (mgr.14355) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:33.129 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:33.879 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:33.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:33.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:34.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:34 smithi131 bash[24745]: cluster 2024-09-13T23:02:33.441447+0000 mgr.a (mgr.14355) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:34 smithi131 bash[24745]: audit 2024-09-13T23:02:33.464336+0000 mgr.a (mgr.14355) 1803 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:34.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:34 smithi171 bash[25040]: cluster 2024-09-13T23:02:33.441447+0000 mgr.a (mgr.14355) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:34.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:34 smithi171 bash[25040]: audit 2024-09-13T23:02:33.464336+0000 mgr.a (mgr.14355) 1803 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:34 smithi007 bash[22722]: cluster 2024-09-13T23:02:33.441447+0000 mgr.a (mgr.14355) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:34 smithi007 bash[22722]: audit 2024-09-13T23:02:33.464336+0000 mgr.a (mgr.14355) 1803 : audit [DBG] from='client.51390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:36 smithi131 bash[24745]: cluster 2024-09-13T23:02:35.443785+0000 mgr.a (mgr.14355) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:36.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:36 smithi171 bash[25040]: cluster 2024-09-13T23:02:35.443785+0000 mgr.a (mgr.14355) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:36 smithi007 bash[22722]: cluster 2024-09-13T23:02:35.443785+0000 mgr.a (mgr.14355) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:38.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:38 smithi131 bash[24745]: cluster 2024-09-13T23:02:37.444631+0000 mgr.a (mgr.14355) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:38.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:38 smithi171 bash[25040]: cluster 2024-09-13T23:02:37.444631+0000 mgr.a (mgr.14355) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:38.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:38.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:38 smithi007 bash[22722]: cluster 2024-09-13T23:02:37.444631+0000 mgr.a (mgr.14355) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:39.627 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:39.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:39.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:40.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:40 smithi131 bash[24745]: audit 2024-09-13T23:02:39.211470+0000 mgr.a (mgr.14355) 1806 : audit [DBG] from='client.51462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:40 smithi131 bash[24745]: cluster 2024-09-13T23:02:39.445185+0000 mgr.a (mgr.14355) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:40.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:40 smithi171 bash[25040]: audit 2024-09-13T23:02:39.211470+0000 mgr.a (mgr.14355) 1806 : audit [DBG] from='client.51462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:40 smithi171 bash[25040]: cluster 2024-09-13T23:02:39.445185+0000 mgr.a (mgr.14355) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:40 smithi007 bash[22722]: audit 2024-09-13T23:02:39.211470+0000 mgr.a (mgr.14355) 1806 : audit [DBG] from='client.51462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:40 smithi007 bash[22722]: cluster 2024-09-13T23:02:39.445185+0000 mgr.a (mgr.14355) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:42.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:42 smithi131 bash[24745]: cluster 2024-09-13T23:02:41.447497+0000 mgr.a (mgr.14355) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:42.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:42 smithi171 bash[25040]: cluster 2024-09-13T23:02:41.447497+0000 mgr.a (mgr.14355) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:42 smithi007 bash[22722]: cluster 2024-09-13T23:02:41.447497+0000 mgr.a (mgr.14355) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:02:44.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:44.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:44.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:44.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:44 smithi131 bash[24745]: cluster 2024-09-13T23:02:43.448251+0000 mgr.a (mgr.14355) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:44.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:44 smithi171 bash[25040]: cluster 2024-09-13T23:02:43.448251+0000 mgr.a (mgr.14355) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:44 smithi007 bash[22722]: cluster 2024-09-13T23:02:43.448251+0000 mgr.a (mgr.14355) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:02:45.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:45.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:46.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:46 smithi131 bash[24745]: audit 2024-09-13T23:02:44.967676+0000 mgr.a (mgr.14355) 1810 : audit [DBG] from='client.51537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:46.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:46 smithi131 bash[24745]: cluster 2024-09-13T23:02:45.449504+0000 mgr.a (mgr.14355) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:02:46.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:46 smithi171 bash[25040]: audit 2024-09-13T23:02:44.967676+0000 mgr.a (mgr.14355) 1810 : audit [DBG] from='client.51537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:46 smithi171 bash[25040]: cluster 2024-09-13T23:02:45.449504+0000 mgr.a (mgr.14355) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:02:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:46 smithi007 bash[22722]: audit 2024-09-13T23:02:44.967676+0000 mgr.a (mgr.14355) 1810 : audit [DBG] from='client.51537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:46 smithi007 bash[22722]: cluster 2024-09-13T23:02:45.449504+0000 mgr.a (mgr.14355) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:02:47.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:47 smithi131 bash[24745]: audit 2024-09-13T23:02:47.003162+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:47.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:47 smithi171 bash[25040]: audit 2024-09-13T23:02:47.003162+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:47.702 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:47 smithi007 bash[22722]: audit 2024-09-13T23:02:47.003162+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:48 smithi131 bash[24745]: cluster 2024-09-13T23:02:47.450209+0000 mgr.a (mgr.14355) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:48 smithi131 bash[24745]: audit 2024-09-13T23:02:47.849161+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:48 smithi131 bash[24745]: audit 2024-09-13T23:02:47.850888+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:48 smithi131 bash[24745]: audit 2024-09-13T23:02:47.860479+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:02:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:48 smithi131 bash[24745]: audit 2024-09-13T23:02:47.863308+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:48 smithi171 bash[25040]: cluster 2024-09-13T23:02:47.450209+0000 mgr.a (mgr.14355) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:48 smithi171 bash[25040]: audit 2024-09-13T23:02:47.849161+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:48 smithi171 bash[25040]: audit 2024-09-13T23:02:47.850888+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:48 smithi171 bash[25040]: audit 2024-09-13T23:02:47.860479+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:02:48.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:48 smithi171 bash[25040]: audit 2024-09-13T23:02:47.863308+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:48.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22722]: cluster 2024-09-13T23:02:47.450209+0000 mgr.a (mgr.14355) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:48.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22722]: audit 2024-09-13T23:02:47.849161+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:48.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22722]: audit 2024-09-13T23:02:47.850888+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:48.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22722]: audit 2024-09-13T23:02:47.860479+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:02:48.595 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22722]: audit 2024-09-13T23:02:47.863308+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:48.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22972]: debug 2024-09-13T23:02:48.591+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:02:48.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:02:48 smithi007 bash[22972]: debug 2024-09-13T23:02:48.591+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:02:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:49 smithi131 bash[24745]: audit 2024-09-13T23:02:47.865622+0000 mgr.a (mgr.14355) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:49 smithi131 bash[24745]: audit 2024-09-13T23:02:48.595194+0000 mgr.a (mgr.14355) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:02:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:49 smithi131 bash[24745]: cephadm 2024-09-13T23:02:48.596564+0000 mgr.a (mgr.14355) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:02:49.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:49 smithi171 bash[25040]: audit 2024-09-13T23:02:47.865622+0000 mgr.a (mgr.14355) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:49.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:49 smithi171 bash[25040]: audit 2024-09-13T23:02:48.595194+0000 mgr.a (mgr.14355) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:02:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:49 smithi171 bash[25040]: cephadm 2024-09-13T23:02:48.596564+0000 mgr.a (mgr.14355) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:02:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:49 smithi007 bash[22722]: audit 2024-09-13T23:02:47.865622+0000 mgr.a (mgr.14355) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:02:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:49 smithi007 bash[22722]: audit 2024-09-13T23:02:48.595194+0000 mgr.a (mgr.14355) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:02:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:49 smithi007 bash[22722]: cephadm 2024-09-13T23:02:48.596564+0000 mgr.a (mgr.14355) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:02:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:50.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:50.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:50 smithi131 bash[24745]: cluster 2024-09-13T23:02:49.451102+0000 mgr.a (mgr.14355) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:50.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:50 smithi171 bash[25040]: cluster 2024-09-13T23:02:49.451102+0000 mgr.a (mgr.14355) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:50 smithi007 bash[22722]: cluster 2024-09-13T23:02:49.451102+0000 mgr.a (mgr.14355) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:51.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:51.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:51.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:51.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:51.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:52.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:52 smithi131 bash[24745]: audit 2024-09-13T23:02:50.738066+0000 mgr.a (mgr.14355) 1817 : audit [DBG] from='client.51720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:52 smithi131 bash[24745]: cluster 2024-09-13T23:02:51.453918+0000 mgr.a (mgr.14355) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:52.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:52 smithi171 bash[25040]: audit 2024-09-13T23:02:50.738066+0000 mgr.a (mgr.14355) 1817 : audit [DBG] from='client.51720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:52.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:52 smithi171 bash[25040]: cluster 2024-09-13T23:02:51.453918+0000 mgr.a (mgr.14355) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:52 smithi007 bash[22722]: audit 2024-09-13T23:02:50.738066+0000 mgr.a (mgr.14355) 1817 : audit [DBG] from='client.51720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:52 smithi007 bash[22722]: cluster 2024-09-13T23:02:51.453918+0000 mgr.a (mgr.14355) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:54.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:54 smithi131 bash[24745]: cluster 2024-09-13T23:02:53.454912+0000 mgr.a (mgr.14355) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:02:54.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:54 smithi171 bash[25040]: cluster 2024-09-13T23:02:53.454912+0000 mgr.a (mgr.14355) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:02:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:54 smithi007 bash[22722]: cluster 2024-09-13T23:02:53.454912+0000 mgr.a (mgr.14355) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:02:56.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:02:56.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:02:56.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:02:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:56 smithi131 bash[24745]: cluster 2024-09-13T23:02:55.456844+0000 mgr.a (mgr.14355) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:56.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:56 smithi171 bash[25040]: cluster 2024-09-13T23:02:55.456844+0000 mgr.a (mgr.14355) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:02:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:02:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:02:56.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:02:56.940 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:02:56.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:56 smithi007 bash[22722]: cluster 2024-09-13T23:02:55.456844+0000 mgr.a (mgr.14355) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:02:57.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:57 smithi131 bash[24745]: audit 2024-09-13T23:02:56.510163+0000 mgr.a (mgr.14355) 1821 : audit [DBG] from='client.51792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:57.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:57 smithi171 bash[25040]: audit 2024-09-13T23:02:56.510163+0000 mgr.a (mgr.14355) 1821 : audit [DBG] from='client.51792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:57 smithi007 bash[22722]: audit 2024-09-13T23:02:56.510163+0000 mgr.a (mgr.14355) 1821 : audit [DBG] from='client.51792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:02:58 smithi131 bash[24745]: cluster 2024-09-13T23:02:57.457899+0000 mgr.a (mgr.14355) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:02:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:02:58 smithi171 bash[25040]: cluster 2024-09-13T23:02:57.457899+0000 mgr.a (mgr.14355) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:02:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:02:58 smithi007 bash[22722]: cluster 2024-09-13T23:02:57.457899+0000 mgr.a (mgr.14355) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:03:00.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:00 smithi171 bash[25040]: cluster 2024-09-13T23:02:59.458882+0000 mgr.a (mgr.14355) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:03:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:00 smithi007 bash[22722]: cluster 2024-09-13T23:02:59.458882+0000 mgr.a (mgr.14355) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:03:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:00 smithi131 bash[24745]: cluster 2024-09-13T23:02:59.458882+0000 mgr.a (mgr.14355) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:03:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:01.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:02.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:02.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:02.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:02.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:02.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:02.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:02 smithi171 bash[25040]: cluster 2024-09-13T23:03:01.461210+0000 mgr.a (mgr.14355) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:03:02.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:02 smithi007 bash[22722]: cluster 2024-09-13T23:03:01.461210+0000 mgr.a (mgr.14355) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:03:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:02 smithi131 bash[24745]: cluster 2024-09-13T23:03:01.461210+0000 mgr.a (mgr.14355) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:03:03.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:03 smithi171 bash[25040]: audit 2024-09-13T23:03:02.270526+0000 mgr.a (mgr.14355) 1825 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:03 smithi007 bash[22722]: audit 2024-09-13T23:03:02.270526+0000 mgr.a (mgr.14355) 1825 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:03 smithi131 bash[24745]: audit 2024-09-13T23:03:02.270526+0000 mgr.a (mgr.14355) 1825 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:04 smithi007 bash[22722]: cluster 2024-09-13T23:03:03.462055+0000 mgr.a (mgr.14355) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:05.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:04 smithi131 bash[24745]: cluster 2024-09-13T23:03:03.462055+0000 mgr.a (mgr.14355) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:04 smithi171 bash[25040]: cluster 2024-09-13T23:03:03.462055+0000 mgr.a (mgr.14355) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:06.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:06 smithi007 bash[22722]: cluster 2024-09-13T23:03:05.464202+0000 mgr.a (mgr.14355) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:06 smithi131 bash[24745]: cluster 2024-09-13T23:03:05.464202+0000 mgr.a (mgr.14355) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:07.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:06 smithi171 bash[25040]: cluster 2024-09-13T23:03:05.464202+0000 mgr.a (mgr.14355) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:07.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:07.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:07.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:08.483 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:08 smithi007 bash[22722]: cluster 2024-09-13T23:03:07.464934+0000 mgr.a (mgr.14355) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:08 smithi131 bash[24745]: cluster 2024-09-13T23:03:07.464934+0000 mgr.a (mgr.14355) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:08 smithi171 bash[25040]: cluster 2024-09-13T23:03:07.464934+0000 mgr.a (mgr.14355) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:09 smithi007 bash[22722]: audit 2024-09-13T23:03:08.051029+0000 mgr.a (mgr.14355) 1829 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:09 smithi131 bash[24745]: audit 2024-09-13T23:03:08.051029+0000 mgr.a (mgr.14355) 1829 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:09 smithi171 bash[25040]: audit 2024-09-13T23:03:08.051029+0000 mgr.a (mgr.14355) 1829 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:10 smithi007 bash[22722]: cluster 2024-09-13T23:03:09.465808+0000 mgr.a (mgr.14355) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:10 smithi131 bash[24745]: cluster 2024-09-13T23:03:09.465808+0000 mgr.a (mgr.14355) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:11.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:10 smithi171 bash[25040]: cluster 2024-09-13T23:03:09.465808+0000 mgr.a (mgr.14355) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:12 smithi007 bash[22722]: cluster 2024-09-13T23:03:11.468098+0000 mgr.a (mgr.14355) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:12 smithi131 bash[24745]: cluster 2024-09-13T23:03:11.468098+0000 mgr.a (mgr.14355) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:13.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:12 smithi171 bash[25040]: cluster 2024-09-13T23:03:11.468098+0000 mgr.a (mgr.14355) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:13.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:14.249 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:14.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:14 smithi007 bash[22722]: cluster 2024-09-13T23:03:13.468834+0000 mgr.a (mgr.14355) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:14 smithi131 bash[24745]: cluster 2024-09-13T23:03:13.468834+0000 mgr.a (mgr.14355) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:15.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:14 smithi171 bash[25040]: cluster 2024-09-13T23:03:13.468834+0000 mgr.a (mgr.14355) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:15.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:15 smithi007 bash[22722]: audit 2024-09-13T23:03:13.823785+0000 mgr.a (mgr.14355) 1833 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:15 smithi131 bash[24745]: audit 2024-09-13T23:03:13.823785+0000 mgr.a (mgr.14355) 1833 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:15 smithi171 bash[25040]: audit 2024-09-13T23:03:13.823785+0000 mgr.a (mgr.14355) 1833 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:16 smithi007 bash[22722]: cluster 2024-09-13T23:03:15.471040+0000 mgr.a (mgr.14355) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:16 smithi131 bash[24745]: cluster 2024-09-13T23:03:15.471040+0000 mgr.a (mgr.14355) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:16 smithi171 bash[25040]: cluster 2024-09-13T23:03:15.471040+0000 mgr.a (mgr.14355) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:18 smithi007 bash[22722]: cluster 2024-09-13T23:03:17.471790+0000 mgr.a (mgr.14355) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:18 smithi131 bash[24745]: cluster 2024-09-13T23:03:17.471790+0000 mgr.a (mgr.14355) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:18 smithi171 bash[25040]: cluster 2024-09-13T23:03:17.471790+0000 mgr.a (mgr.14355) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:19.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:19.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:20 smithi007 bash[22722]: cluster 2024-09-13T23:03:19.472299+0000 mgr.a (mgr.14355) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:20 smithi007 bash[22722]: audit 2024-09-13T23:03:19.584449+0000 mgr.a (mgr.14355) 1837 : audit [DBG] from='client.52095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:20 smithi131 bash[24745]: cluster 2024-09-13T23:03:19.472299+0000 mgr.a (mgr.14355) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:20 smithi131 bash[24745]: audit 2024-09-13T23:03:19.584449+0000 mgr.a (mgr.14355) 1837 : audit [DBG] from='client.52095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:20 smithi171 bash[25040]: cluster 2024-09-13T23:03:19.472299+0000 mgr.a (mgr.14355) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:20 smithi171 bash[25040]: audit 2024-09-13T23:03:19.584449+0000 mgr.a (mgr.14355) 1837 : audit [DBG] from='client.52095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:22 smithi007 bash[22722]: cluster 2024-09-13T23:03:21.474589+0000 mgr.a (mgr.14355) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:22 smithi131 bash[24745]: cluster 2024-09-13T23:03:21.474589+0000 mgr.a (mgr.14355) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:23.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:22 smithi171 bash[25040]: cluster 2024-09-13T23:03:21.474589+0000 mgr.a (mgr.14355) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:24 smithi007 bash[22722]: cluster 2024-09-13T23:03:23.475345+0000 mgr.a (mgr.14355) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:24.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:24.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:25.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:24 smithi131 bash[24745]: cluster 2024-09-13T23:03:23.475345+0000 mgr.a (mgr.14355) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:25.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:24 smithi171 bash[25040]: cluster 2024-09-13T23:03:23.475345+0000 mgr.a (mgr.14355) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:25.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:25.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:25.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:26 smithi007 bash[22722]: audit 2024-09-13T23:03:25.327667+0000 mgr.a (mgr.14355) 1840 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:26 smithi007 bash[22722]: cluster 2024-09-13T23:03:25.476732+0000 mgr.a (mgr.14355) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:26 smithi131 bash[24745]: audit 2024-09-13T23:03:25.327667+0000 mgr.a (mgr.14355) 1840 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:26 smithi131 bash[24745]: cluster 2024-09-13T23:03:25.476732+0000 mgr.a (mgr.14355) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:26 smithi171 bash[25040]: audit 2024-09-13T23:03:25.327667+0000 mgr.a (mgr.14355) 1840 : audit [DBG] from='client.52173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:26 smithi171 bash[25040]: cluster 2024-09-13T23:03:25.476732+0000 mgr.a (mgr.14355) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:28 smithi007 bash[22722]: cluster 2024-09-13T23:03:27.477594+0000 mgr.a (mgr.14355) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:28 smithi131 bash[24745]: cluster 2024-09-13T23:03:27.477594+0000 mgr.a (mgr.14355) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:29.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:28 smithi171 bash[25040]: cluster 2024-09-13T23:03:27.477594+0000 mgr.a (mgr.14355) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:30.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:30 smithi007 bash[22722]: cluster 2024-09-13T23:03:29.478367+0000 mgr.a (mgr.14355) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:30 smithi131 bash[24745]: cluster 2024-09-13T23:03:29.478367+0000 mgr.a (mgr.14355) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:31.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:30 smithi171 bash[25040]: cluster 2024-09-13T23:03:29.478367+0000 mgr.a (mgr.14355) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:31.494 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:31.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:31.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:32 smithi007 bash[22722]: audit 2024-09-13T23:03:31.089470+0000 mgr.a (mgr.14355) 1844 : audit [DBG] from='client.52251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:32 smithi007 bash[22722]: cluster 2024-09-13T23:03:31.479522+0000 mgr.a (mgr.14355) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:32 smithi131 bash[24745]: audit 2024-09-13T23:03:31.089470+0000 mgr.a (mgr.14355) 1844 : audit [DBG] from='client.52251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:33.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:32 smithi131 bash[24745]: cluster 2024-09-13T23:03:31.479522+0000 mgr.a (mgr.14355) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:33.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:32 smithi171 bash[25040]: audit 2024-09-13T23:03:31.089470+0000 mgr.a (mgr.14355) 1844 : audit [DBG] from='client.52251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:33.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:32 smithi171 bash[25040]: cluster 2024-09-13T23:03:31.479522+0000 mgr.a (mgr.14355) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:34 smithi007 bash[22722]: cluster 2024-09-13T23:03:33.480243+0000 mgr.a (mgr.14355) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:34 smithi131 bash[24745]: cluster 2024-09-13T23:03:33.480243+0000 mgr.a (mgr.14355) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:35.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:34 smithi171 bash[25040]: cluster 2024-09-13T23:03:33.480243+0000 mgr.a (mgr.14355) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:03:36.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:36.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:36.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:36.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:36 smithi007 bash[22722]: cluster 2024-09-13T23:03:35.482108+0000 mgr.a (mgr.14355) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:36 smithi131 bash[24745]: cluster 2024-09-13T23:03:35.482108+0000 mgr.a (mgr.14355) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:37.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:36 smithi171 bash[25040]: cluster 2024-09-13T23:03:35.482108+0000 mgr.a (mgr.14355) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:37.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:37.244 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:38 smithi007 bash[22722]: audit 2024-09-13T23:03:36.828943+0000 mgr.a (mgr.14355) 1848 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:38 smithi007 bash[22722]: cluster 2024-09-13T23:03:37.482963+0000 mgr.a (mgr.14355) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:39.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:38 smithi131 bash[24745]: audit 2024-09-13T23:03:36.828943+0000 mgr.a (mgr.14355) 1848 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:39.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:38 smithi131 bash[24745]: cluster 2024-09-13T23:03:37.482963+0000 mgr.a (mgr.14355) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:39.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:38 smithi171 bash[25040]: audit 2024-09-13T23:03:36.828943+0000 mgr.a (mgr.14355) 1848 : audit [DBG] from='client.52329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:39.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:38 smithi171 bash[25040]: cluster 2024-09-13T23:03:37.482963+0000 mgr.a (mgr.14355) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:40 smithi007 bash[22722]: cluster 2024-09-13T23:03:39.483734+0000 mgr.a (mgr.14355) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:41.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:40 smithi131 bash[24745]: cluster 2024-09-13T23:03:39.483734+0000 mgr.a (mgr.14355) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:41.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:40 smithi171 bash[25040]: cluster 2024-09-13T23:03:39.483734+0000 mgr.a (mgr.14355) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:42.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:42.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:42.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:42 smithi007 bash[22722]: cluster 2024-09-13T23:03:41.485910+0000 mgr.a (mgr.14355) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:42.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:42.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:42 smithi131 bash[24745]: cluster 2024-09-13T23:03:41.485910+0000 mgr.a (mgr.14355) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:43.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:42 smithi171 bash[25040]: cluster 2024-09-13T23:03:41.485910+0000 mgr.a (mgr.14355) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:43 smithi007 bash[22722]: audit 2024-09-13T23:03:42.576261+0000 mgr.a (mgr.14355) 1852 : audit [DBG] from='client.52404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:43 smithi131 bash[24745]: audit 2024-09-13T23:03:42.576261+0000 mgr.a (mgr.14355) 1852 : audit [DBG] from='client.52404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:43 smithi171 bash[25040]: audit 2024-09-13T23:03:42.576261+0000 mgr.a (mgr.14355) 1852 : audit [DBG] from='client.52404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:44 smithi007 bash[22722]: cluster 2024-09-13T23:03:43.486819+0000 mgr.a (mgr.14355) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:44 smithi131 bash[24745]: cluster 2024-09-13T23:03:43.486819+0000 mgr.a (mgr.14355) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:45.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:44 smithi171 bash[25040]: cluster 2024-09-13T23:03:43.486819+0000 mgr.a (mgr.14355) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:46 smithi007 bash[22722]: cluster 2024-09-13T23:03:45.488925+0000 mgr.a (mgr.14355) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:47.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:46 smithi131 bash[24745]: cluster 2024-09-13T23:03:45.488925+0000 mgr.a (mgr.14355) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:47.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:46 smithi171 bash[25040]: cluster 2024-09-13T23:03:45.488925+0000 mgr.a (mgr.14355) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:48.735 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:48.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:48.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:48.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:48.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:48 smithi007 bash[22722]: cluster 2024-09-13T23:03:47.489696+0000 mgr.a (mgr.14355) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:48 smithi007 bash[22722]: audit 2024-09-13T23:03:48.647083+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:48 smithi131 bash[24745]: cluster 2024-09-13T23:03:47.489696+0000 mgr.a (mgr.14355) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:49.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:48 smithi131 bash[24745]: audit 2024-09-13T23:03:48.647083+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:49.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:48 smithi171 bash[25040]: cluster 2024-09-13T23:03:47.489696+0000 mgr.a (mgr.14355) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:49.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:48 smithi171 bash[25040]: audit 2024-09-13T23:03:48.647083+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:49 smithi007 bash[22722]: audit 2024-09-13T23:03:48.318864+0000 mgr.a (mgr.14355) 1856 : audit [DBG] from='client.52482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:49 smithi007 bash[22722]: cluster 2024-09-13T23:03:49.490715+0000 mgr.a (mgr.14355) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:49 smithi131 bash[24745]: audit 2024-09-13T23:03:48.318864+0000 mgr.a (mgr.14355) 1856 : audit [DBG] from='client.52482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:50.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:49 smithi131 bash[24745]: cluster 2024-09-13T23:03:49.490715+0000 mgr.a (mgr.14355) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:49 smithi171 bash[25040]: audit 2024-09-13T23:03:48.318864+0000 mgr.a (mgr.14355) 1856 : audit [DBG] from='client.52482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:49 smithi171 bash[25040]: cluster 2024-09-13T23:03:49.490715+0000 mgr.a (mgr.14355) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:52 smithi007 bash[22722]: cluster 2024-09-13T23:03:51.492947+0000 mgr.a (mgr.14355) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:53.316 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:52 smithi171 bash[25040]: cluster 2024-09-13T23:03:51.492947+0000 mgr.a (mgr.14355) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:53.317 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:52 smithi131 bash[24745]: cluster 2024-09-13T23:03:51.492947+0000 mgr.a (mgr.14355) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:03:53.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:53.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:53.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:03:54.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:03:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:03:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:03:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:03:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: cluster 2024-09-13T23:03:53.493694+0000 mgr.a (mgr.14355) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.908852+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.914264+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.964454+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.970704+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.977093+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:54 smithi007 bash[22722]: audit 2024-09-13T23:03:53.983707+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: cluster 2024-09-13T23:03:53.493694+0000 mgr.a (mgr.14355) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.908852+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.914264+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.964454+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.970704+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.977093+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:54 smithi131 bash[24745]: audit 2024-09-13T23:03:53.983707+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: cluster 2024-09-13T23:03:53.493694+0000 mgr.a (mgr.14355) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.908852+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.914264+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.964454+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.970704+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.977093+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:54 smithi171 bash[25040]: audit 2024-09-13T23:03:53.983707+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22972]: debug 2024-09-13T23:03:55.378+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:03:55.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22972]: debug 2024-09-13T23:03:55.378+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:03:55.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22722]: audit 2024-09-13T23:03:54.121310+0000 mgr.a (mgr.14355) 1860 : audit [DBG] from='client.52560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:55.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22722]: audit 2024-09-13T23:03:54.678466+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:55.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22722]: audit 2024-09-13T23:03:54.679478+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22722]: audit 2024-09-13T23:03:54.687343+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:55 smithi007 bash[22722]: audit 2024-09-13T23:03:54.689450+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:55 smithi131 bash[24745]: audit 2024-09-13T23:03:54.121310+0000 mgr.a (mgr.14355) 1860 : audit [DBG] from='client.52560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:55 smithi131 bash[24745]: audit 2024-09-13T23:03:54.678466+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:55 smithi131 bash[24745]: audit 2024-09-13T23:03:54.679478+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:55 smithi131 bash[24745]: audit 2024-09-13T23:03:54.687343+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:55 smithi131 bash[24745]: audit 2024-09-13T23:03:54.689450+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:55 smithi171 bash[25040]: audit 2024-09-13T23:03:54.121310+0000 mgr.a (mgr.14355) 1860 : audit [DBG] from='client.52560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:55 smithi171 bash[25040]: audit 2024-09-13T23:03:54.678466+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:55 smithi171 bash[25040]: audit 2024-09-13T23:03:54.679478+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:55 smithi171 bash[25040]: audit 2024-09-13T23:03:54.687343+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:03:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:55 smithi171 bash[25040]: audit 2024-09-13T23:03:54.689450+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:56 smithi007 bash[22722]: audit 2024-09-13T23:03:54.691943+0000 mgr.a (mgr.14355) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:56 smithi007 bash[22722]: audit 2024-09-13T23:03:55.384374+0000 mgr.a (mgr.14355) 1862 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:03:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:56 smithi007 bash[22722]: cephadm 2024-09-13T23:03:55.385722+0000 mgr.a (mgr.14355) 1863 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:03:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:56 smithi007 bash[22722]: cluster 2024-09-13T23:03:55.496011+0000 mgr.a (mgr.14355) 1864 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:03:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:56 smithi131 bash[24745]: audit 2024-09-13T23:03:54.691943+0000 mgr.a (mgr.14355) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:56 smithi131 bash[24745]: audit 2024-09-13T23:03:55.384374+0000 mgr.a (mgr.14355) 1862 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:03:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:56 smithi131 bash[24745]: cephadm 2024-09-13T23:03:55.385722+0000 mgr.a (mgr.14355) 1863 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:03:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:56 smithi131 bash[24745]: cluster 2024-09-13T23:03:55.496011+0000 mgr.a (mgr.14355) 1864 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:03:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:56 smithi171 bash[25040]: audit 2024-09-13T23:03:54.691943+0000 mgr.a (mgr.14355) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:03:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:56 smithi171 bash[25040]: audit 2024-09-13T23:03:55.384374+0000 mgr.a (mgr.14355) 1862 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:03:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:56 smithi171 bash[25040]: cephadm 2024-09-13T23:03:55.385722+0000 mgr.a (mgr.14355) 1863 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:03:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:56 smithi171 bash[25040]: cluster 2024-09-13T23:03:55.496011+0000 mgr.a (mgr.14355) 1864 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:03:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:03:58 smithi007 bash[22722]: cluster 2024-09-13T23:03:57.496770+0000 mgr.a (mgr.14355) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:03:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:03:58 smithi131 bash[24745]: cluster 2024-09-13T23:03:57.496770+0000 mgr.a (mgr.14355) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:03:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:03:58 smithi171 bash[25040]: cluster 2024-09-13T23:03:57.496770+0000 mgr.a (mgr.14355) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:03:59.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:03:59.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:03:59.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:00.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:00.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:00 smithi007 bash[22722]: cluster 2024-09-13T23:03:59.497504+0000 mgr.a (mgr.14355) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:04:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:00 smithi131 bash[24745]: cluster 2024-09-13T23:03:59.497504+0000 mgr.a (mgr.14355) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:04:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:00 smithi171 bash[25040]: cluster 2024-09-13T23:03:59.497504+0000 mgr.a (mgr.14355) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:04:01.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:01 smithi007 bash[22722]: audit 2024-09-13T23:03:59.872718+0000 mgr.a (mgr.14355) 1867 : audit [DBG] from='client.52734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:01 smithi131 bash[24745]: audit 2024-09-13T23:03:59.872718+0000 mgr.a (mgr.14355) 1867 : audit [DBG] from='client.52734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:01 smithi171 bash[25040]: audit 2024-09-13T23:03:59.872718+0000 mgr.a (mgr.14355) 1867 : audit [DBG] from='client.52734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:02 smithi007 bash[22722]: cluster 2024-09-13T23:04:01.499957+0000 mgr.a (mgr.14355) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:02 smithi131 bash[24745]: cluster 2024-09-13T23:04:01.499957+0000 mgr.a (mgr.14355) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:03.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:02 smithi171 bash[25040]: cluster 2024-09-13T23:04:01.499957+0000 mgr.a (mgr.14355) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:04 smithi007 bash[22722]: cluster 2024-09-13T23:04:03.500721+0000 mgr.a (mgr.14355) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:04 smithi131 bash[24745]: cluster 2024-09-13T23:04:03.500721+0000 mgr.a (mgr.14355) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:04 smithi171 bash[25040]: cluster 2024-09-13T23:04:03.500721+0000 mgr.a (mgr.14355) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:06.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:06 smithi007 bash[22722]: cluster 2024-09-13T23:04:05.502686+0000 mgr.a (mgr.14355) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:06 smithi007 bash[22722]: audit 2024-09-13T23:04:05.646703+0000 mgr.a (mgr.14355) 1871 : audit [DBG] from='client.52809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:07.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:06 smithi131 bash[24745]: cluster 2024-09-13T23:04:05.502686+0000 mgr.a (mgr.14355) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:06 smithi131 bash[24745]: audit 2024-09-13T23:04:05.646703+0000 mgr.a (mgr.14355) 1871 : audit [DBG] from='client.52809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:07.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:06 smithi171 bash[25040]: cluster 2024-09-13T23:04:05.502686+0000 mgr.a (mgr.14355) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:04:07.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:06 smithi171 bash[25040]: audit 2024-09-13T23:04:05.646703+0000 mgr.a (mgr.14355) 1871 : audit [DBG] from='client.52809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:08 smithi007 bash[22722]: cluster 2024-09-13T23:04:07.503631+0000 mgr.a (mgr.14355) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:08 smithi131 bash[24745]: cluster 2024-09-13T23:04:07.503631+0000 mgr.a (mgr.14355) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:08 smithi171 bash[25040]: cluster 2024-09-13T23:04:07.503631+0000 mgr.a (mgr.14355) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:10 smithi007 bash[22722]: cluster 2024-09-13T23:04:09.504442+0000 mgr.a (mgr.14355) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:10 smithi131 bash[24745]: cluster 2024-09-13T23:04:09.504442+0000 mgr.a (mgr.14355) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:11.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:10 smithi171 bash[25040]: cluster 2024-09-13T23:04:09.504442+0000 mgr.a (mgr.14355) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:04:11.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:11.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:11.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:11.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:11.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:12 smithi007 bash[22722]: audit 2024-09-13T23:04:11.415922+0000 mgr.a (mgr.14355) 1874 : audit [DBG] from='client.52887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:12 smithi007 bash[22722]: cluster 2024-09-13T23:04:11.505954+0000 mgr.a (mgr.14355) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:04:13.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:12 smithi131 bash[24745]: audit 2024-09-13T23:04:11.415922+0000 mgr.a (mgr.14355) 1874 : audit [DBG] from='client.52887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:12 smithi131 bash[24745]: cluster 2024-09-13T23:04:11.505954+0000 mgr.a (mgr.14355) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:04:13.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:12 smithi171 bash[25040]: audit 2024-09-13T23:04:11.415922+0000 mgr.a (mgr.14355) 1874 : audit [DBG] from='client.52887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:12 smithi171 bash[25040]: cluster 2024-09-13T23:04:11.505954+0000 mgr.a (mgr.14355) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:04:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:14 smithi007 bash[22722]: cluster 2024-09-13T23:04:13.506899+0000 mgr.a (mgr.14355) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:14 smithi131 bash[24745]: cluster 2024-09-13T23:04:13.506899+0000 mgr.a (mgr.14355) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:15.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:14 smithi171 bash[25040]: cluster 2024-09-13T23:04:13.506899+0000 mgr.a (mgr.14355) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:16.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:16.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:16 smithi007 bash[22722]: cluster 2024-09-13T23:04:15.509050+0000 mgr.a (mgr.14355) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:16 smithi131 bash[24745]: cluster 2024-09-13T23:04:15.509050+0000 mgr.a (mgr.14355) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:17.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:16 smithi171 bash[25040]: cluster 2024-09-13T23:04:15.509050+0000 mgr.a (mgr.14355) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:17.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:18 smithi007 bash[22722]: audit 2024-09-13T23:04:17.179036+0000 mgr.a (mgr.14355) 1878 : audit [DBG] from='client.52965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:18 smithi007 bash[22722]: cluster 2024-09-13T23:04:17.509584+0000 mgr.a (mgr.14355) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:18 smithi131 bash[24745]: audit 2024-09-13T23:04:17.179036+0000 mgr.a (mgr.14355) 1878 : audit [DBG] from='client.52965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:18 smithi131 bash[24745]: cluster 2024-09-13T23:04:17.509584+0000 mgr.a (mgr.14355) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:18 smithi171 bash[25040]: audit 2024-09-13T23:04:17.179036+0000 mgr.a (mgr.14355) 1878 : audit [DBG] from='client.52965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:18 smithi171 bash[25040]: cluster 2024-09-13T23:04:17.509584+0000 mgr.a (mgr.14355) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:20 smithi007 bash[22722]: cluster 2024-09-13T23:04:19.510490+0000 mgr.a (mgr.14355) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:20 smithi131 bash[24745]: cluster 2024-09-13T23:04:19.510490+0000 mgr.a (mgr.14355) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:20 smithi171 bash[25040]: cluster 2024-09-13T23:04:19.510490+0000 mgr.a (mgr.14355) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:22.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:22.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:22.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:22 smithi007 bash[22722]: cluster 2024-09-13T23:04:21.512745+0000 mgr.a (mgr.14355) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:22 smithi131 bash[24745]: cluster 2024-09-13T23:04:21.512745+0000 mgr.a (mgr.14355) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:22 smithi171 bash[25040]: cluster 2024-09-13T23:04:21.512745+0000 mgr.a (mgr.14355) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:23.363 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:23.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:23.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:23.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:23.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:24 smithi007 bash[22722]: audit 2024-09-13T23:04:22.933764+0000 mgr.a (mgr.14355) 1882 : audit [DBG] from='client.53043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:24 smithi007 bash[22722]: cluster 2024-09-13T23:04:23.513666+0000 mgr.a (mgr.14355) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:25.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:24 smithi131 bash[24745]: audit 2024-09-13T23:04:22.933764+0000 mgr.a (mgr.14355) 1882 : audit [DBG] from='client.53043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:24 smithi131 bash[24745]: cluster 2024-09-13T23:04:23.513666+0000 mgr.a (mgr.14355) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:24 smithi171 bash[25040]: audit 2024-09-13T23:04:22.933764+0000 mgr.a (mgr.14355) 1882 : audit [DBG] from='client.53043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:24 smithi171 bash[25040]: cluster 2024-09-13T23:04:23.513666+0000 mgr.a (mgr.14355) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:26 smithi007 bash[22722]: cluster 2024-09-13T23:04:25.515837+0000 mgr.a (mgr.14355) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:27.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:26 smithi131 bash[24745]: cluster 2024-09-13T23:04:25.515837+0000 mgr.a (mgr.14355) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:26 smithi171 bash[25040]: cluster 2024-09-13T23:04:25.515837+0000 mgr.a (mgr.14355) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:28.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:28.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:28.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:28 smithi007 bash[22722]: cluster 2024-09-13T23:04:27.516626+0000 mgr.a (mgr.14355) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:28 smithi131 bash[24745]: cluster 2024-09-13T23:04:27.516626+0000 mgr.a (mgr.14355) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:29.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:28 smithi171 bash[25040]: cluster 2024-09-13T23:04:27.516626+0000 mgr.a (mgr.14355) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:29.115 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:29.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:30 smithi007 bash[22722]: audit 2024-09-13T23:04:28.697244+0000 mgr.a (mgr.14355) 1886 : audit [DBG] from='client.53121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:30 smithi007 bash[22722]: cluster 2024-09-13T23:04:29.517611+0000 mgr.a (mgr.14355) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:30 smithi131 bash[24745]: audit 2024-09-13T23:04:28.697244+0000 mgr.a (mgr.14355) 1886 : audit [DBG] from='client.53121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:31.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:30 smithi131 bash[24745]: cluster 2024-09-13T23:04:29.517611+0000 mgr.a (mgr.14355) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:30 smithi171 bash[25040]: audit 2024-09-13T23:04:28.697244+0000 mgr.a (mgr.14355) 1886 : audit [DBG] from='client.53121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:30 smithi171 bash[25040]: cluster 2024-09-13T23:04:29.517611+0000 mgr.a (mgr.14355) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:32 smithi007 bash[22722]: cluster 2024-09-13T23:04:31.519931+0000 mgr.a (mgr.14355) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:32 smithi131 bash[24745]: cluster 2024-09-13T23:04:31.519931+0000 mgr.a (mgr.14355) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:33.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:32 smithi171 bash[25040]: cluster 2024-09-13T23:04:31.519931+0000 mgr.a (mgr.14355) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:34.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:34.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:34 smithi007 bash[22722]: cluster 2024-09-13T23:04:33.520881+0000 mgr.a (mgr.14355) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:34 smithi131 bash[24745]: cluster 2024-09-13T23:04:33.520881+0000 mgr.a (mgr.14355) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:35.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:34 smithi171 bash[25040]: cluster 2024-09-13T23:04:33.520881+0000 mgr.a (mgr.14355) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:35 smithi007 bash[22722]: audit 2024-09-13T23:04:34.446255+0000 mgr.a (mgr.14355) 1890 : audit [DBG] from='client.53199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:36.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:35 smithi131 bash[24745]: audit 2024-09-13T23:04:34.446255+0000 mgr.a (mgr.14355) 1890 : audit [DBG] from='client.53199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:36.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:35 smithi171 bash[25040]: audit 2024-09-13T23:04:34.446255+0000 mgr.a (mgr.14355) 1890 : audit [DBG] from='client.53199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:36 smithi007 bash[22722]: cluster 2024-09-13T23:04:35.523255+0000 mgr.a (mgr.14355) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:36 smithi131 bash[24745]: cluster 2024-09-13T23:04:35.523255+0000 mgr.a (mgr.14355) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:37.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:36 smithi171 bash[25040]: cluster 2024-09-13T23:04:35.523255+0000 mgr.a (mgr.14355) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:38 smithi007 bash[22722]: cluster 2024-09-13T23:04:37.524047+0000 mgr.a (mgr.14355) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:39.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:38 smithi131 bash[24745]: cluster 2024-09-13T23:04:37.524047+0000 mgr.a (mgr.14355) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:39.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:38 smithi171 bash[25040]: cluster 2024-09-13T23:04:37.524047+0000 mgr.a (mgr.14355) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:39.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:39.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:39.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:40.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:40.642 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:40 smithi007 bash[22722]: cluster 2024-09-13T23:04:39.524817+0000 mgr.a (mgr.14355) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:41.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:40 smithi131 bash[24745]: cluster 2024-09-13T23:04:39.524817+0000 mgr.a (mgr.14355) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:41.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:40 smithi171 bash[25040]: cluster 2024-09-13T23:04:39.524817+0000 mgr.a (mgr.14355) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:41 smithi007 bash[22722]: audit 2024-09-13T23:04:40.200617+0000 mgr.a (mgr.14355) 1894 : audit [DBG] from='client.53277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:41 smithi131 bash[24745]: audit 2024-09-13T23:04:40.200617+0000 mgr.a (mgr.14355) 1894 : audit [DBG] from='client.53277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:42.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:41 smithi171 bash[25040]: audit 2024-09-13T23:04:40.200617+0000 mgr.a (mgr.14355) 1894 : audit [DBG] from='client.53277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:42 smithi007 bash[22722]: cluster 2024-09-13T23:04:41.527763+0000 mgr.a (mgr.14355) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:42 smithi131 bash[24745]: cluster 2024-09-13T23:04:41.527763+0000 mgr.a (mgr.14355) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:43.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:42 smithi171 bash[25040]: cluster 2024-09-13T23:04:41.527763+0000 mgr.a (mgr.14355) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:43 smithi131 bash[24745]: cluster 2024-09-13T23:04:43.528717+0000 mgr.a (mgr.14355) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:43 smithi171 bash[25040]: cluster 2024-09-13T23:04:43.528717+0000 mgr.a (mgr.14355) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:43 smithi007 bash[22722]: cluster 2024-09-13T23:04:43.528717+0000 mgr.a (mgr.14355) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:45.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:46.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:46.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:46.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:46.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:46.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:46 smithi007 bash[22722]: cluster 2024-09-13T23:04:45.530682+0000 mgr.a (mgr.14355) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:47.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:46 smithi131 bash[24745]: cluster 2024-09-13T23:04:45.530682+0000 mgr.a (mgr.14355) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:47.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:46 smithi171 bash[25040]: cluster 2024-09-13T23:04:45.530682+0000 mgr.a (mgr.14355) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:47.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:47 smithi007 bash[22722]: audit 2024-09-13T23:04:45.969611+0000 mgr.a (mgr.14355) 1898 : audit [DBG] from='client.53352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:47 smithi131 bash[24745]: audit 2024-09-13T23:04:45.969611+0000 mgr.a (mgr.14355) 1898 : audit [DBG] from='client.53352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:47 smithi171 bash[25040]: audit 2024-09-13T23:04:45.969611+0000 mgr.a (mgr.14355) 1898 : audit [DBG] from='client.53352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:48 smithi007 bash[22722]: cluster 2024-09-13T23:04:47.531642+0000 mgr.a (mgr.14355) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:48 smithi131 bash[24745]: cluster 2024-09-13T23:04:47.531642+0000 mgr.a (mgr.14355) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:49.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:48 smithi171 bash[25040]: cluster 2024-09-13T23:04:47.531642+0000 mgr.a (mgr.14355) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:04:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:50 smithi007 bash[22722]: cluster 2024-09-13T23:04:49.532455+0000 mgr.a (mgr.14355) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:50 smithi131 bash[24745]: cluster 2024-09-13T23:04:49.532455+0000 mgr.a (mgr.14355) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:51.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:50 smithi171 bash[25040]: cluster 2024-09-13T23:04:49.532455+0000 mgr.a (mgr.14355) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:04:51.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:51.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:51.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:52.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:52.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:52.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:52.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:52.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:52 smithi007 bash[22722]: cluster 2024-09-13T23:04:51.533622+0000 mgr.a (mgr.14355) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:53.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:52 smithi131 bash[24745]: cluster 2024-09-13T23:04:51.533622+0000 mgr.a (mgr.14355) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:53.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:52 smithi171 bash[25040]: cluster 2024-09-13T23:04:51.533622+0000 mgr.a (mgr.14355) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:53 smithi007 bash[22722]: audit 2024-09-13T23:04:51.740105+0000 mgr.a (mgr.14355) 1902 : audit [DBG] from='client.53424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:53 smithi131 bash[24745]: audit 2024-09-13T23:04:51.740105+0000 mgr.a (mgr.14355) 1902 : audit [DBG] from='client.53424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:53 smithi171 bash[25040]: audit 2024-09-13T23:04:51.740105+0000 mgr.a (mgr.14355) 1902 : audit [DBG] from='client.53424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:54 smithi007 bash[22722]: cluster 2024-09-13T23:04:53.534591+0000 mgr.a (mgr.14355) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:54 smithi131 bash[24745]: cluster 2024-09-13T23:04:53.534591+0000 mgr.a (mgr.14355) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:55.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:54 smithi171 bash[25040]: cluster 2024-09-13T23:04:53.534591+0000 mgr.a (mgr.14355) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:55 smithi007 bash[22722]: audit 2024-09-13T23:04:55.448578+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:55 smithi131 bash[24745]: audit 2024-09-13T23:04:55.448578+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:55 smithi171 bash[25040]: audit 2024-09-13T23:04:55.448578+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:56.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:56 smithi007 bash[22722]: cluster 2024-09-13T23:04:55.536020+0000 mgr.a (mgr.14355) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:56 smithi007 bash[22722]: audit 2024-09-13T23:04:56.301097+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:56 smithi007 bash[22722]: audit 2024-09-13T23:04:56.302500+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:56 smithi007 bash[22722]: audit 2024-09-13T23:04:56.312486+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:04:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:56 smithi007 bash[22722]: audit 2024-09-13T23:04:56.315422+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:56 smithi131 bash[24745]: cluster 2024-09-13T23:04:55.536020+0000 mgr.a (mgr.14355) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:56 smithi131 bash[24745]: audit 2024-09-13T23:04:56.301097+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:56 smithi131 bash[24745]: audit 2024-09-13T23:04:56.302500+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:56 smithi131 bash[24745]: audit 2024-09-13T23:04:56.312486+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:04:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:56 smithi131 bash[24745]: audit 2024-09-13T23:04:56.315422+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:56 smithi171 bash[25040]: cluster 2024-09-13T23:04:55.536020+0000 mgr.a (mgr.14355) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:04:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:56 smithi171 bash[25040]: audit 2024-09-13T23:04:56.301097+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:56 smithi171 bash[25040]: audit 2024-09-13T23:04:56.302500+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:56 smithi171 bash[25040]: audit 2024-09-13T23:04:56.312486+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:04:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:56 smithi171 bash[25040]: audit 2024-09-13T23:04:56.315422+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:57.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:04:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:04:57.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:04:57.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:04:57 smithi007 bash[22972]: debug 2024-09-13T23:04:57.033+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:04:57.453 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:04:57 smithi007 bash[22972]: debug 2024-09-13T23:04:57.033+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:04:57.902 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:04:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:04:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:57 smithi007 bash[22722]: audit 2024-09-13T23:04:56.317754+0000 mgr.a (mgr.14355) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:57 smithi131 bash[24745]: audit 2024-09-13T23:04:56.317754+0000 mgr.a (mgr.14355) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:57 smithi171 bash[25040]: audit 2024-09-13T23:04:56.317754+0000 mgr.a (mgr.14355) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:04:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:58 smithi007 bash[22722]: audit 2024-09-13T23:04:57.035318+0000 mgr.a (mgr.14355) 1906 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:04:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:58 smithi007 bash[22722]: cephadm 2024-09-13T23:04:57.036707+0000 mgr.a (mgr.14355) 1907 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:04:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:58 smithi007 bash[22722]: audit 2024-09-13T23:04:57.493882+0000 mgr.a (mgr.14355) 1908 : audit [DBG] from='client.53610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:04:58 smithi007 bash[22722]: cluster 2024-09-13T23:04:57.536791+0000 mgr.a (mgr.14355) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:58 smithi131 bash[24745]: audit 2024-09-13T23:04:57.035318+0000 mgr.a (mgr.14355) 1906 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:04:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:58 smithi131 bash[24745]: cephadm 2024-09-13T23:04:57.036707+0000 mgr.a (mgr.14355) 1907 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:04:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:58 smithi131 bash[24745]: audit 2024-09-13T23:04:57.493882+0000 mgr.a (mgr.14355) 1908 : audit [DBG] from='client.53610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:04:58 smithi131 bash[24745]: cluster 2024-09-13T23:04:57.536791+0000 mgr.a (mgr.14355) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:04:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:58 smithi171 bash[25040]: audit 2024-09-13T23:04:57.035318+0000 mgr.a (mgr.14355) 1906 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:04:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:58 smithi171 bash[25040]: cephadm 2024-09-13T23:04:57.036707+0000 mgr.a (mgr.14355) 1907 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:04:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:58 smithi171 bash[25040]: audit 2024-09-13T23:04:57.493882+0000 mgr.a (mgr.14355) 1908 : audit [DBG] from='client.53610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:04:58 smithi171 bash[25040]: cluster 2024-09-13T23:04:57.536791+0000 mgr.a (mgr.14355) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:00 smithi007 bash[22722]: cluster 2024-09-13T23:04:59.537796+0000 mgr.a (mgr.14355) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:00 smithi131 bash[24745]: cluster 2024-09-13T23:04:59.537796+0000 mgr.a (mgr.14355) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:01.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:00 smithi171 bash[25040]: cluster 2024-09-13T23:04:59.537796+0000 mgr.a (mgr.14355) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:02.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:02.905 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:02.905 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:02 smithi007 bash[22722]: cluster 2024-09-13T23:05:01.540116+0000 mgr.a (mgr.14355) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:02 smithi131 bash[24745]: cluster 2024-09-13T23:05:01.540116+0000 mgr.a (mgr.14355) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:02 smithi171 bash[25040]: cluster 2024-09-13T23:05:01.540116+0000 mgr.a (mgr.14355) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:03.681 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:04 smithi007 bash[22722]: audit 2024-09-13T23:05:03.236807+0000 mgr.a (mgr.14355) 1912 : audit [DBG] from='client.53688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:04 smithi007 bash[22722]: cluster 2024-09-13T23:05:03.540694+0000 mgr.a (mgr.14355) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:04 smithi131 bash[24745]: audit 2024-09-13T23:05:03.236807+0000 mgr.a (mgr.14355) 1912 : audit [DBG] from='client.53688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:04 smithi131 bash[24745]: cluster 2024-09-13T23:05:03.540694+0000 mgr.a (mgr.14355) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:04 smithi171 bash[25040]: audit 2024-09-13T23:05:03.236807+0000 mgr.a (mgr.14355) 1912 : audit [DBG] from='client.53688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:04 smithi171 bash[25040]: cluster 2024-09-13T23:05:03.540694+0000 mgr.a (mgr.14355) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:06 smithi007 bash[22722]: cluster 2024-09-13T23:05:05.542961+0000 mgr.a (mgr.14355) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:07.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:06 smithi131 bash[24745]: cluster 2024-09-13T23:05:05.542961+0000 mgr.a (mgr.14355) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:07.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:06 smithi171 bash[25040]: cluster 2024-09-13T23:05:05.542961+0000 mgr.a (mgr.14355) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:08.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:08 smithi007 bash[22722]: cluster 2024-09-13T23:05:07.543750+0000 mgr.a (mgr.14355) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:08 smithi131 bash[24745]: cluster 2024-09-13T23:05:07.543750+0000 mgr.a (mgr.14355) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:08 smithi171 bash[25040]: cluster 2024-09-13T23:05:07.543750+0000 mgr.a (mgr.14355) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:09.445 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:09.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:09.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:09.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:09.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:10 smithi007 bash[22722]: audit 2024-09-13T23:05:09.018814+0000 mgr.a (mgr.14355) 1916 : audit [DBG] from='client.53763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:10 smithi007 bash[22722]: cluster 2024-09-13T23:05:09.544689+0000 mgr.a (mgr.14355) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:10 smithi131 bash[24745]: audit 2024-09-13T23:05:09.018814+0000 mgr.a (mgr.14355) 1916 : audit [DBG] from='client.53763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:10 smithi131 bash[24745]: cluster 2024-09-13T23:05:09.544689+0000 mgr.a (mgr.14355) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:11.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:10 smithi171 bash[25040]: audit 2024-09-13T23:05:09.018814+0000 mgr.a (mgr.14355) 1916 : audit [DBG] from='client.53763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:10 smithi171 bash[25040]: cluster 2024-09-13T23:05:09.544689+0000 mgr.a (mgr.14355) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:12 smithi007 bash[22722]: cluster 2024-09-13T23:05:11.546995+0000 mgr.a (mgr.14355) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:13.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:12 smithi131 bash[24745]: cluster 2024-09-13T23:05:11.546995+0000 mgr.a (mgr.14355) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:13.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:12 smithi171 bash[25040]: cluster 2024-09-13T23:05:11.546995+0000 mgr.a (mgr.14355) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:05:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:14 smithi007 bash[22722]: cluster 2024-09-13T23:05:13.547787+0000 mgr.a (mgr.14355) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:14 smithi131 bash[24745]: cluster 2024-09-13T23:05:13.547787+0000 mgr.a (mgr.14355) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:15.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:14 smithi171 bash[25040]: cluster 2024-09-13T23:05:13.547787+0000 mgr.a (mgr.14355) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:15.203 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:15.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:15.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:15.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:15.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:16 smithi007 bash[22722]: audit 2024-09-13T23:05:14.784235+0000 mgr.a (mgr.14355) 1920 : audit [DBG] from='client.53841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:16 smithi007 bash[22722]: cluster 2024-09-13T23:05:15.550083+0000 mgr.a (mgr.14355) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:16 smithi131 bash[24745]: audit 2024-09-13T23:05:14.784235+0000 mgr.a (mgr.14355) 1920 : audit [DBG] from='client.53841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:16 smithi131 bash[24745]: cluster 2024-09-13T23:05:15.550083+0000 mgr.a (mgr.14355) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:16 smithi171 bash[25040]: audit 2024-09-13T23:05:14.784235+0000 mgr.a (mgr.14355) 1920 : audit [DBG] from='client.53841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:17.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:16 smithi171 bash[25040]: cluster 2024-09-13T23:05:15.550083+0000 mgr.a (mgr.14355) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:18 smithi007 bash[22722]: cluster 2024-09-13T23:05:17.551006+0000 mgr.a (mgr.14355) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:18 smithi131 bash[24745]: cluster 2024-09-13T23:05:17.551006+0000 mgr.a (mgr.14355) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:19.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:18 smithi171 bash[25040]: cluster 2024-09-13T23:05:17.551006+0000 mgr.a (mgr.14355) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:19 smithi007 bash[22722]: cluster 2024-09-13T23:05:19.551939+0000 mgr.a (mgr.14355) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:19 smithi131 bash[24745]: cluster 2024-09-13T23:05:19.551939+0000 mgr.a (mgr.14355) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:20.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:19 smithi171 bash[25040]: cluster 2024-09-13T23:05:19.551939+0000 mgr.a (mgr.14355) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:20.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:20.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:20.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:20 smithi007 bash[22722]: audit 2024-09-13T23:05:20.539817+0000 mgr.a (mgr.14355) 1924 : audit [DBG] from='client.53919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:20 smithi131 bash[24745]: audit 2024-09-13T23:05:20.539817+0000 mgr.a (mgr.14355) 1924 : audit [DBG] from='client.53919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:20 smithi171 bash[25040]: audit 2024-09-13T23:05:20.539817+0000 mgr.a (mgr.14355) 1924 : audit [DBG] from='client.53919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:21 smithi007 bash[22722]: cluster 2024-09-13T23:05:21.554914+0000 mgr.a (mgr.14355) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:22.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:21 smithi131 bash[24745]: cluster 2024-09-13T23:05:21.554914+0000 mgr.a (mgr.14355) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:21 smithi171 bash[25040]: cluster 2024-09-13T23:05:21.554914+0000 mgr.a (mgr.14355) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:24 smithi007 bash[22722]: cluster 2024-09-13T23:05:23.555638+0000 mgr.a (mgr.14355) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:25.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:24 smithi131 bash[24745]: cluster 2024-09-13T23:05:23.555638+0000 mgr.a (mgr.14355) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:24 smithi171 bash[25040]: cluster 2024-09-13T23:05:23.555638+0000 mgr.a (mgr.14355) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:25.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:25.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:25.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:26.722 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:26.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:26.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:26 smithi007 bash[22722]: cluster 2024-09-13T23:05:25.557465+0000 mgr.a (mgr.14355) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:27.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:26 smithi131 bash[24745]: cluster 2024-09-13T23:05:25.557465+0000 mgr.a (mgr.14355) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:27.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:26 smithi171 bash[25040]: cluster 2024-09-13T23:05:25.557465+0000 mgr.a (mgr.14355) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:27 smithi007 bash[22722]: audit 2024-09-13T23:05:26.282249+0000 mgr.a (mgr.14355) 1928 : audit [DBG] from='client.53994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:27 smithi131 bash[24745]: audit 2024-09-13T23:05:26.282249+0000 mgr.a (mgr.14355) 1928 : audit [DBG] from='client.53994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:27 smithi171 bash[25040]: audit 2024-09-13T23:05:26.282249+0000 mgr.a (mgr.14355) 1928 : audit [DBG] from='client.53994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:28 smithi007 bash[22722]: cluster 2024-09-13T23:05:27.558462+0000 mgr.a (mgr.14355) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:28 smithi131 bash[24745]: cluster 2024-09-13T23:05:27.558462+0000 mgr.a (mgr.14355) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:29.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:28 smithi171 bash[25040]: cluster 2024-09-13T23:05:27.558462+0000 mgr.a (mgr.14355) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:05:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:30 smithi007 bash[22722]: cluster 2024-09-13T23:05:29.559260+0000 mgr.a (mgr.14355) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:05:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:30 smithi131 bash[24745]: cluster 2024-09-13T23:05:29.559260+0000 mgr.a (mgr.14355) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:05:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:30 smithi171 bash[25040]: cluster 2024-09-13T23:05:29.559260+0000 mgr.a (mgr.14355) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:05:31.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:31.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:31.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:32.500 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:32 smithi007 bash[22722]: cluster 2024-09-13T23:05:31.561474+0000 mgr.a (mgr.14355) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:32 smithi131 bash[24745]: cluster 2024-09-13T23:05:31.561474+0000 mgr.a (mgr.14355) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:33.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:32 smithi171 bash[25040]: cluster 2024-09-13T23:05:31.561474+0000 mgr.a (mgr.14355) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:33 smithi007 bash[22722]: audit 2024-09-13T23:05:32.061577+0000 mgr.a (mgr.14355) 1932 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:33 smithi131 bash[24745]: audit 2024-09-13T23:05:32.061577+0000 mgr.a (mgr.14355) 1932 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:34.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:33 smithi171 bash[25040]: audit 2024-09-13T23:05:32.061577+0000 mgr.a (mgr.14355) 1932 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:34 smithi007 bash[22722]: cluster 2024-09-13T23:05:33.562538+0000 mgr.a (mgr.14355) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:34 smithi131 bash[24745]: cluster 2024-09-13T23:05:33.562538+0000 mgr.a (mgr.14355) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:35.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:34 smithi171 bash[25040]: cluster 2024-09-13T23:05:33.562538+0000 mgr.a (mgr.14355) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:36 smithi007 bash[22722]: cluster 2024-09-13T23:05:35.564853+0000 mgr.a (mgr.14355) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:36 smithi131 bash[24745]: cluster 2024-09-13T23:05:35.564853+0000 mgr.a (mgr.14355) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:37.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:36 smithi171 bash[25040]: cluster 2024-09-13T23:05:35.564853+0000 mgr.a (mgr.14355) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:37.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:37.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:37.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:38.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:38 smithi007 bash[22722]: cluster 2024-09-13T23:05:37.565630+0000 mgr.a (mgr.14355) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:39.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:38 smithi131 bash[24745]: cluster 2024-09-13T23:05:37.565630+0000 mgr.a (mgr.14355) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:39.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:38 smithi171 bash[25040]: cluster 2024-09-13T23:05:37.565630+0000 mgr.a (mgr.14355) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:39 smithi007 bash[22722]: audit 2024-09-13T23:05:37.841013+0000 mgr.a (mgr.14355) 1936 : audit [DBG] from='client.54144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:39 smithi131 bash[24745]: audit 2024-09-13T23:05:37.841013+0000 mgr.a (mgr.14355) 1936 : audit [DBG] from='client.54144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:40.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:39 smithi171 bash[25040]: audit 2024-09-13T23:05:37.841013+0000 mgr.a (mgr.14355) 1936 : audit [DBG] from='client.54144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:40 smithi007 bash[22722]: cluster 2024-09-13T23:05:39.566521+0000 mgr.a (mgr.14355) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:41.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:40 smithi131 bash[24745]: cluster 2024-09-13T23:05:39.566521+0000 mgr.a (mgr.14355) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:41.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:40 smithi171 bash[25040]: cluster 2024-09-13T23:05:39.566521+0000 mgr.a (mgr.14355) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:42 smithi007 bash[22722]: cluster 2024-09-13T23:05:41.568762+0000 mgr.a (mgr.14355) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:42 smithi131 bash[24745]: cluster 2024-09-13T23:05:41.568762+0000 mgr.a (mgr.14355) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:43.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:42 smithi171 bash[25040]: cluster 2024-09-13T23:05:41.568762+0000 mgr.a (mgr.14355) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:43.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:44.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:44 smithi007 bash[22722]: cluster 2024-09-13T23:05:43.569490+0000 mgr.a (mgr.14355) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:44 smithi007 bash[22722]: audit 2024-09-13T23:05:43.604021+0000 mgr.a (mgr.14355) 1940 : audit [DBG] from='client.54222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:44 smithi131 bash[24745]: cluster 2024-09-13T23:05:43.569490+0000 mgr.a (mgr.14355) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:44 smithi131 bash[24745]: audit 2024-09-13T23:05:43.604021+0000 mgr.a (mgr.14355) 1940 : audit [DBG] from='client.54222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:45.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:44 smithi171 bash[25040]: cluster 2024-09-13T23:05:43.569490+0000 mgr.a (mgr.14355) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:45.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:44 smithi171 bash[25040]: audit 2024-09-13T23:05:43.604021+0000 mgr.a (mgr.14355) 1940 : audit [DBG] from='client.54222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:46 smithi007 bash[22722]: cluster 2024-09-13T23:05:45.571774+0000 mgr.a (mgr.14355) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:47.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:46 smithi131 bash[24745]: cluster 2024-09-13T23:05:45.571774+0000 mgr.a (mgr.14355) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:47.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:46 smithi171 bash[25040]: cluster 2024-09-13T23:05:45.571774+0000 mgr.a (mgr.14355) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:48 smithi007 bash[22722]: cluster 2024-09-13T23:05:47.572508+0000 mgr.a (mgr.14355) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:48 smithi131 bash[24745]: cluster 2024-09-13T23:05:47.572508+0000 mgr.a (mgr.14355) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:49.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:48 smithi171 bash[25040]: cluster 2024-09-13T23:05:47.572508+0000 mgr.a (mgr.14355) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:49.763 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:50 smithi007 bash[22722]: audit 2024-09-13T23:05:49.357269+0000 mgr.a (mgr.14355) 1943 : audit [DBG] from='client.54300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:50 smithi007 bash[22722]: cluster 2024-09-13T23:05:49.573399+0000 mgr.a (mgr.14355) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:50 smithi131 bash[24745]: audit 2024-09-13T23:05:49.357269+0000 mgr.a (mgr.14355) 1943 : audit [DBG] from='client.54300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:50 smithi131 bash[24745]: cluster 2024-09-13T23:05:49.573399+0000 mgr.a (mgr.14355) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:51.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:50 smithi171 bash[25040]: audit 2024-09-13T23:05:49.357269+0000 mgr.a (mgr.14355) 1943 : audit [DBG] from='client.54300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:51.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:50 smithi171 bash[25040]: cluster 2024-09-13T23:05:49.573399+0000 mgr.a (mgr.14355) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:51 smithi131 bash[24745]: cluster 2024-09-13T23:05:51.575745+0000 mgr.a (mgr.14355) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:52.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:51 smithi171 bash[25040]: cluster 2024-09-13T23:05:51.575745+0000 mgr.a (mgr.14355) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:51 smithi007 bash[22722]: cluster 2024-09-13T23:05:51.575745+0000 mgr.a (mgr.14355) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:05:54.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:05:54.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:05:54.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:05:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:54 smithi007 bash[22722]: cluster 2024-09-13T23:05:53.576525+0000 mgr.a (mgr.14355) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:54 smithi131 bash[24745]: cluster 2024-09-13T23:05:53.576525+0000 mgr.a (mgr.14355) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:55.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:54 smithi171 bash[25040]: cluster 2024-09-13T23:05:53.576525+0000 mgr.a (mgr.14355) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:05:55.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:05:55.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:05:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:05:55.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:05:55.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:05:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:56 smithi007 bash[22722]: audit 2024-09-13T23:05:55.088689+0000 mgr.a (mgr.14355) 1947 : audit [DBG] from='client.54378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:56 smithi007 bash[22722]: cluster 2024-09-13T23:05:55.579295+0000 mgr.a (mgr.14355) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:05:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:56 smithi131 bash[24745]: audit 2024-09-13T23:05:55.088689+0000 mgr.a (mgr.14355) 1947 : audit [DBG] from='client.54378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:56 smithi131 bash[24745]: cluster 2024-09-13T23:05:55.579295+0000 mgr.a (mgr.14355) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:05:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:56 smithi171 bash[25040]: audit 2024-09-13T23:05:55.088689+0000 mgr.a (mgr.14355) 1947 : audit [DBG] from='client.54378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:56 smithi171 bash[25040]: cluster 2024-09-13T23:05:55.579295+0000 mgr.a (mgr.14355) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:05:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:57 smithi007 bash[22722]: audit 2024-09-13T23:05:57.087820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:57 smithi131 bash[24745]: audit 2024-09-13T23:05:57.087820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:57 smithi171 bash[25040]: audit 2024-09-13T23:05:57.087820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:58.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22972]: debug 2024-09-13T23:05:58.672+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:05:58.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22972]: debug 2024-09-13T23:05:58.672+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22722]: cluster 2024-09-13T23:05:57.580070+0000 mgr.a (mgr.14355) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22722]: audit 2024-09-13T23:05:57.937916+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22722]: audit 2024-09-13T23:05:57.939732+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22722]: audit 2024-09-13T23:05:57.950421+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:58 smithi007 bash[22722]: audit 2024-09-13T23:05:57.953317+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:05:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:58 smithi131 bash[24745]: cluster 2024-09-13T23:05:57.580070+0000 mgr.a (mgr.14355) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:05:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:58 smithi131 bash[24745]: audit 2024-09-13T23:05:57.937916+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:58 smithi131 bash[24745]: audit 2024-09-13T23:05:57.939732+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:58 smithi131 bash[24745]: audit 2024-09-13T23:05:57.950421+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:05:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:58 smithi131 bash[24745]: audit 2024-09-13T23:05:57.953317+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:05:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:58 smithi171 bash[25040]: cluster 2024-09-13T23:05:57.580070+0000 mgr.a (mgr.14355) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:05:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:58 smithi171 bash[25040]: audit 2024-09-13T23:05:57.937916+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:58 smithi171 bash[25040]: audit 2024-09-13T23:05:57.939732+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:58 smithi171 bash[25040]: audit 2024-09-13T23:05:57.950421+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:05:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:58 smithi171 bash[25040]: audit 2024-09-13T23:05:57.953317+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:05:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:59 smithi007 bash[22722]: audit 2024-09-13T23:05:57.955806+0000 mgr.a (mgr.14355) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:05:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:59 smithi007 bash[22722]: audit 2024-09-13T23:05:58.676944+0000 mgr.a (mgr.14355) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:05:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:05:59 smithi007 bash[22722]: cephadm 2024-09-13T23:05:58.678188+0000 mgr.a (mgr.14355) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:06:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:59 smithi131 bash[24745]: audit 2024-09-13T23:05:57.955806+0000 mgr.a (mgr.14355) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:06:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:59 smithi131 bash[24745]: audit 2024-09-13T23:05:58.676944+0000 mgr.a (mgr.14355) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:06:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:05:59 smithi131 bash[24745]: cephadm 2024-09-13T23:05:58.678188+0000 mgr.a (mgr.14355) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:06:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:59 smithi171 bash[25040]: audit 2024-09-13T23:05:57.955806+0000 mgr.a (mgr.14355) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:06:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:59 smithi171 bash[25040]: audit 2024-09-13T23:05:58.676944+0000 mgr.a (mgr.14355) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:06:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:05:59 smithi171 bash[25040]: cephadm 2024-09-13T23:05:58.678188+0000 mgr.a (mgr.14355) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:06:00.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:00.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:00 smithi007 bash[22722]: cluster 2024-09-13T23:05:59.580957+0000 mgr.a (mgr.14355) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:06:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:00 smithi131 bash[24745]: cluster 2024-09-13T23:05:59.580957+0000 mgr.a (mgr.14355) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:06:01.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:00 smithi171 bash[25040]: cluster 2024-09-13T23:05:59.580957+0000 mgr.a (mgr.14355) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:06:01.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:02 smithi007 bash[22722]: audit 2024-09-13T23:06:00.823609+0000 mgr.a (mgr.14355) 1954 : audit [DBG] from='client.54564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:02 smithi007 bash[22722]: cluster 2024-09-13T23:06:01.583794+0000 mgr.a (mgr.14355) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:02 smithi131 bash[24745]: audit 2024-09-13T23:06:00.823609+0000 mgr.a (mgr.14355) 1954 : audit [DBG] from='client.54564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:02 smithi131 bash[24745]: cluster 2024-09-13T23:06:01.583794+0000 mgr.a (mgr.14355) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:02 smithi171 bash[25040]: audit 2024-09-13T23:06:00.823609+0000 mgr.a (mgr.14355) 1954 : audit [DBG] from='client.54564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:02 smithi171 bash[25040]: cluster 2024-09-13T23:06:01.583794+0000 mgr.a (mgr.14355) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:04 smithi007 bash[22722]: cluster 2024-09-13T23:06:03.584610+0000 mgr.a (mgr.14355) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:04 smithi131 bash[24745]: cluster 2024-09-13T23:06:03.584610+0000 mgr.a (mgr.14355) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:04 smithi171 bash[25040]: cluster 2024-09-13T23:06:03.584610+0000 mgr.a (mgr.14355) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:06.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:06.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:06.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:06 smithi007 bash[22722]: cluster 2024-09-13T23:06:05.586569+0000 mgr.a (mgr.14355) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:07.000 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:07.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:07.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:06 smithi131 bash[24745]: cluster 2024-09-13T23:06:05.586569+0000 mgr.a (mgr.14355) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:07.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:06 smithi171 bash[25040]: cluster 2024-09-13T23:06:05.586569+0000 mgr.a (mgr.14355) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:07.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:07 smithi007 bash[22722]: audit 2024-09-13T23:06:06.568946+0000 mgr.a (mgr.14355) 1958 : audit [DBG] from='client.54642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:08.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:07 smithi131 bash[24745]: audit 2024-09-13T23:06:06.568946+0000 mgr.a (mgr.14355) 1958 : audit [DBG] from='client.54642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:08.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:07 smithi171 bash[25040]: audit 2024-09-13T23:06:06.568946+0000 mgr.a (mgr.14355) 1958 : audit [DBG] from='client.54642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:08 smithi007 bash[22722]: cluster 2024-09-13T23:06:07.587582+0000 mgr.a (mgr.14355) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:08 smithi131 bash[24745]: cluster 2024-09-13T23:06:07.587582+0000 mgr.a (mgr.14355) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:09.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:08 smithi171 bash[25040]: cluster 2024-09-13T23:06:07.587582+0000 mgr.a (mgr.14355) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:09 smithi131 bash[24745]: cluster 2024-09-13T23:06:09.588369+0000 mgr.a (mgr.14355) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:10.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:09 smithi171 bash[25040]: cluster 2024-09-13T23:06:09.588369+0000 mgr.a (mgr.14355) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:09 smithi007 bash[22722]: cluster 2024-09-13T23:06:09.588369+0000 mgr.a (mgr.14355) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:06:12.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:12.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:12.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:12.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:12 smithi007 bash[22722]: cluster 2024-09-13T23:06:11.590588+0000 mgr.a (mgr.14355) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:13.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:12 smithi131 bash[24745]: cluster 2024-09-13T23:06:11.590588+0000 mgr.a (mgr.14355) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:13.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:12 smithi171 bash[25040]: cluster 2024-09-13T23:06:11.590588+0000 mgr.a (mgr.14355) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:06:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:13 smithi007 bash[22722]: audit 2024-09-13T23:06:12.337676+0000 mgr.a (mgr.14355) 1962 : audit [DBG] from='client.54720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:14.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:13 smithi131 bash[24745]: audit 2024-09-13T23:06:12.337676+0000 mgr.a (mgr.14355) 1962 : audit [DBG] from='client.54720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:14.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:13 smithi171 bash[25040]: audit 2024-09-13T23:06:12.337676+0000 mgr.a (mgr.14355) 1962 : audit [DBG] from='client.54720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:14 smithi007 bash[22722]: cluster 2024-09-13T23:06:13.591470+0000 mgr.a (mgr.14355) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:14 smithi131 bash[24745]: cluster 2024-09-13T23:06:13.591470+0000 mgr.a (mgr.14355) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:15.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:14 smithi171 bash[25040]: cluster 2024-09-13T23:06:13.591470+0000 mgr.a (mgr.14355) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:16 smithi007 bash[22722]: cluster 2024-09-13T23:06:15.593610+0000 mgr.a (mgr.14355) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:16 smithi131 bash[24745]: cluster 2024-09-13T23:06:15.593610+0000 mgr.a (mgr.14355) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:16 smithi171 bash[25040]: cluster 2024-09-13T23:06:15.593610+0000 mgr.a (mgr.14355) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:18.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:18 smithi007 bash[22722]: cluster 2024-09-13T23:06:17.594408+0000 mgr.a (mgr.14355) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:18 smithi131 bash[24745]: cluster 2024-09-13T23:06:17.594408+0000 mgr.a (mgr.14355) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:18 smithi171 bash[25040]: cluster 2024-09-13T23:06:17.594408+0000 mgr.a (mgr.14355) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:19 smithi007 bash[22722]: audit 2024-09-13T23:06:18.105088+0000 mgr.a (mgr.14355) 1966 : audit [DBG] from='client.54798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:19 smithi131 bash[24745]: audit 2024-09-13T23:06:18.105088+0000 mgr.a (mgr.14355) 1966 : audit [DBG] from='client.54798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:19 smithi171 bash[25040]: audit 2024-09-13T23:06:18.105088+0000 mgr.a (mgr.14355) 1966 : audit [DBG] from='client.54798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:20 smithi007 bash[22722]: cluster 2024-09-13T23:06:19.595252+0000 mgr.a (mgr.14355) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:20 smithi131 bash[24745]: cluster 2024-09-13T23:06:19.595252+0000 mgr.a (mgr.14355) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:20 smithi171 bash[25040]: cluster 2024-09-13T23:06:19.595252+0000 mgr.a (mgr.14355) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:22 smithi007 bash[22722]: cluster 2024-09-13T23:06:21.597498+0000 mgr.a (mgr.14355) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:22 smithi131 bash[24745]: cluster 2024-09-13T23:06:21.597498+0000 mgr.a (mgr.14355) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:22 smithi171 bash[25040]: cluster 2024-09-13T23:06:21.597498+0000 mgr.a (mgr.14355) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:24.326 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:24 smithi007 bash[22722]: cluster 2024-09-13T23:06:23.598259+0000 mgr.a (mgr.14355) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:25.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:24 smithi131 bash[24745]: cluster 2024-09-13T23:06:23.598259+0000 mgr.a (mgr.14355) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:24 smithi171 bash[25040]: cluster 2024-09-13T23:06:23.598259+0000 mgr.a (mgr.14355) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:25 smithi007 bash[22722]: audit 2024-09-13T23:06:23.887115+0000 mgr.a (mgr.14355) 1970 : audit [DBG] from='client.37210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:25 smithi131 bash[24745]: audit 2024-09-13T23:06:23.887115+0000 mgr.a (mgr.14355) 1970 : audit [DBG] from='client.37210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:25 smithi171 bash[25040]: audit 2024-09-13T23:06:23.887115+0000 mgr.a (mgr.14355) 1970 : audit [DBG] from='client.37210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:26 smithi007 bash[22722]: cluster 2024-09-13T23:06:25.600560+0000 mgr.a (mgr.14355) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:27.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:26 smithi131 bash[24745]: cluster 2024-09-13T23:06:25.600560+0000 mgr.a (mgr.14355) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:26 smithi171 bash[25040]: cluster 2024-09-13T23:06:25.600560+0000 mgr.a (mgr.14355) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:27 smithi007 bash[22722]: cluster 2024-09-13T23:06:27.601366+0000 mgr.a (mgr.14355) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:27 smithi131 bash[24745]: cluster 2024-09-13T23:06:27.601366+0000 mgr.a (mgr.14355) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:27 smithi171 bash[25040]: cluster 2024-09-13T23:06:27.601366+0000 mgr.a (mgr.14355) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:29.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:29.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:29.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:30.093 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:30.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:30.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:30 smithi007 bash[22722]: cluster 2024-09-13T23:06:29.602094+0000 mgr.a (mgr.14355) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:30 smithi007 bash[22722]: audit 2024-09-13T23:06:29.665840+0000 mgr.a (mgr.14355) 1974 : audit [DBG] from='client.54954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:30 smithi131 bash[24745]: cluster 2024-09-13T23:06:29.602094+0000 mgr.a (mgr.14355) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:30 smithi131 bash[24745]: audit 2024-09-13T23:06:29.665840+0000 mgr.a (mgr.14355) 1974 : audit [DBG] from='client.54954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:30 smithi171 bash[25040]: cluster 2024-09-13T23:06:29.602094+0000 mgr.a (mgr.14355) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:30 smithi171 bash[25040]: audit 2024-09-13T23:06:29.665840+0000 mgr.a (mgr.14355) 1974 : audit [DBG] from='client.54954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:32 smithi007 bash[22722]: cluster 2024-09-13T23:06:31.604417+0000 mgr.a (mgr.14355) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:32 smithi131 bash[24745]: cluster 2024-09-13T23:06:31.604417+0000 mgr.a (mgr.14355) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:33.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:32 smithi171 bash[25040]: cluster 2024-09-13T23:06:31.604417+0000 mgr.a (mgr.14355) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:34 smithi007 bash[22722]: cluster 2024-09-13T23:06:33.605218+0000 mgr.a (mgr.14355) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:35.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:34 smithi131 bash[24745]: cluster 2024-09-13T23:06:33.605218+0000 mgr.a (mgr.14355) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:35.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:34 smithi171 bash[25040]: cluster 2024-09-13T23:06:33.605218+0000 mgr.a (mgr.14355) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:35.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:35.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:35.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:36 smithi007 bash[22722]: audit 2024-09-13T23:06:35.430990+0000 mgr.a (mgr.14355) 1977 : audit [DBG] from='client.55032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:36 smithi007 bash[22722]: cluster 2024-09-13T23:06:35.608127+0000 mgr.a (mgr.14355) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:36 smithi131 bash[24745]: audit 2024-09-13T23:06:35.430990+0000 mgr.a (mgr.14355) 1977 : audit [DBG] from='client.55032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:36 smithi131 bash[24745]: cluster 2024-09-13T23:06:35.608127+0000 mgr.a (mgr.14355) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:37.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:36 smithi171 bash[25040]: audit 2024-09-13T23:06:35.430990+0000 mgr.a (mgr.14355) 1977 : audit [DBG] from='client.55032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:37.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:36 smithi171 bash[25040]: cluster 2024-09-13T23:06:35.608127+0000 mgr.a (mgr.14355) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:38.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:38 smithi007 bash[22722]: cluster 2024-09-13T23:06:37.609054+0000 mgr.a (mgr.14355) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:39.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:38 smithi131 bash[24745]: cluster 2024-09-13T23:06:37.609054+0000 mgr.a (mgr.14355) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:39.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:38 smithi171 bash[25040]: cluster 2024-09-13T23:06:37.609054+0000 mgr.a (mgr.14355) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:40 smithi007 bash[22722]: cluster 2024-09-13T23:06:39.609986+0000 mgr.a (mgr.14355) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:06:41.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:40 smithi131 bash[24745]: cluster 2024-09-13T23:06:39.609986+0000 mgr.a (mgr.14355) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:06:41.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:40 smithi171 bash[25040]: cluster 2024-09-13T23:06:39.609986+0000 mgr.a (mgr.14355) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:06:41.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:42 smithi007 bash[22722]: audit 2024-09-13T23:06:41.195993+0000 mgr.a (mgr.14355) 1981 : audit [DBG] from='client.55107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:42 smithi007 bash[22722]: cluster 2024-09-13T23:06:41.611389+0000 mgr.a (mgr.14355) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:42 smithi131 bash[24745]: audit 2024-09-13T23:06:41.195993+0000 mgr.a (mgr.14355) 1981 : audit [DBG] from='client.55107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:42 smithi131 bash[24745]: cluster 2024-09-13T23:06:41.611389+0000 mgr.a (mgr.14355) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:43.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:42 smithi171 bash[25040]: audit 2024-09-13T23:06:41.195993+0000 mgr.a (mgr.14355) 1981 : audit [DBG] from='client.55107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:43.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:42 smithi171 bash[25040]: cluster 2024-09-13T23:06:41.611389+0000 mgr.a (mgr.14355) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:44 smithi007 bash[22722]: cluster 2024-09-13T23:06:43.612123+0000 mgr.a (mgr.14355) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:44 smithi131 bash[24745]: cluster 2024-09-13T23:06:43.612123+0000 mgr.a (mgr.14355) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:45.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:44 smithi171 bash[25040]: cluster 2024-09-13T23:06:43.612123+0000 mgr.a (mgr.14355) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:06:46.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:46 smithi171 bash[25040]: cluster 2024-09-13T23:06:45.614087+0000 mgr.a (mgr.14355) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:46.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:46.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:46.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:46 smithi007 bash[22722]: cluster 2024-09-13T23:06:45.614087+0000 mgr.a (mgr.14355) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:46.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:46 smithi131 bash[24745]: cluster 2024-09-13T23:06:45.614087+0000 mgr.a (mgr.14355) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:47.344 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:48 smithi007 bash[22722]: audit 2024-09-13T23:06:46.941811+0000 mgr.a (mgr.14355) 1985 : audit [DBG] from='client.55179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:48 smithi007 bash[22722]: cluster 2024-09-13T23:06:47.615059+0000 mgr.a (mgr.14355) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:48 smithi131 bash[24745]: audit 2024-09-13T23:06:46.941811+0000 mgr.a (mgr.14355) 1985 : audit [DBG] from='client.55179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:48 smithi131 bash[24745]: cluster 2024-09-13T23:06:47.615059+0000 mgr.a (mgr.14355) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:49.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:48 smithi171 bash[25040]: audit 2024-09-13T23:06:46.941811+0000 mgr.a (mgr.14355) 1985 : audit [DBG] from='client.55179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:49.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:48 smithi171 bash[25040]: cluster 2024-09-13T23:06:47.615059+0000 mgr.a (mgr.14355) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:50 smithi007 bash[22722]: cluster 2024-09-13T23:06:49.615862+0000 mgr.a (mgr.14355) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:50 smithi131 bash[24745]: cluster 2024-09-13T23:06:49.615862+0000 mgr.a (mgr.14355) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:51.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:50 smithi171 bash[25040]: cluster 2024-09-13T23:06:49.615862+0000 mgr.a (mgr.14355) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:52.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:52.346 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:52.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:52 smithi007 bash[22722]: cluster 2024-09-13T23:06:51.618077+0000 mgr.a (mgr.14355) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:53.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:52 smithi131 bash[24745]: cluster 2024-09-13T23:06:51.618077+0000 mgr.a (mgr.14355) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:53.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:52 smithi171 bash[25040]: cluster 2024-09-13T23:06:51.618077+0000 mgr.a (mgr.14355) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:53.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:53.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:53.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:53.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:53.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:53 smithi007 bash[22722]: audit 2024-09-13T23:06:52.687855+0000 mgr.a (mgr.14355) 1989 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:53 smithi131 bash[24745]: audit 2024-09-13T23:06:52.687855+0000 mgr.a (mgr.14355) 1989 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:53 smithi171 bash[25040]: audit 2024-09-13T23:06:52.687855+0000 mgr.a (mgr.14355) 1989 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:54.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:54 smithi007 bash[22722]: cluster 2024-09-13T23:06:53.618961+0000 mgr.a (mgr.14355) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:55.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:54 smithi131 bash[24745]: cluster 2024-09-13T23:06:53.618961+0000 mgr.a (mgr.14355) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:55.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:54 smithi171 bash[25040]: cluster 2024-09-13T23:06:53.618961+0000 mgr.a (mgr.14355) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:56 smithi007 bash[22722]: cluster 2024-09-13T23:06:55.621152+0000 mgr.a (mgr.14355) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:56 smithi131 bash[24745]: cluster 2024-09-13T23:06:55.621152+0000 mgr.a (mgr.14355) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:56 smithi171 bash[25040]: cluster 2024-09-13T23:06:55.621152+0000 mgr.a (mgr.14355) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:06:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:06:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:06:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:06:58.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:06:58.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:06:58.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:06:58.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:06:58.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:06:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:58 smithi007 bash[22722]: cluster 2024-09-13T23:06:57.621992+0000 mgr.a (mgr.14355) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:58 smithi131 bash[24745]: cluster 2024-09-13T23:06:57.621992+0000 mgr.a (mgr.14355) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:59.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:58 smithi171 bash[25040]: cluster 2024-09-13T23:06:57.621992+0000 mgr.a (mgr.14355) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:58.451716+0000 mgr.a (mgr.14355) 1993 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:58.727664+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:59.535630+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:59.537590+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:59.548031+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:06:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:06:59 smithi007 bash[22722]: audit 2024-09-13T23:06:59.550497+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:58.451716+0000 mgr.a (mgr.14355) 1993 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:58.727664+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:59.535630+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:59.537590+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:59.548031+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:07:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:06:59 smithi131 bash[24745]: audit 2024-09-13T23:06:59.550497+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:58.451716+0000 mgr.a (mgr.14355) 1993 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:58.727664+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:59.535630+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:59.537590+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:59.548031+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:07:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:06:59 smithi171 bash[25040]: audit 2024-09-13T23:06:59.550497+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:00.700 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:07:00 smithi007 bash[22972]: debug 2024-09-13T23:07:00.259+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:07:00.700 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:07:00 smithi007 bash[22972]: debug 2024-09-13T23:07:00.259+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:07:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:00 smithi007 bash[22722]: audit 2024-09-13T23:06:59.552934+0000 mgr.a (mgr.14355) 1994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:00 smithi007 bash[22722]: cluster 2024-09-13T23:06:59.622601+0000 mgr.a (mgr.14355) 1995 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:00 smithi131 bash[24745]: audit 2024-09-13T23:06:59.552934+0000 mgr.a (mgr.14355) 1994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:00 smithi131 bash[24745]: cluster 2024-09-13T23:06:59.622601+0000 mgr.a (mgr.14355) 1995 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:00 smithi171 bash[25040]: audit 2024-09-13T23:06:59.552934+0000 mgr.a (mgr.14355) 1994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:07:01.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:00 smithi171 bash[25040]: cluster 2024-09-13T23:06:59.622601+0000 mgr.a (mgr.14355) 1995 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:01 smithi131 bash[24745]: audit 2024-09-13T23:07:00.263240+0000 mgr.a (mgr.14355) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:07:02.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:01 smithi131 bash[24745]: cephadm 2024-09-13T23:07:00.264529+0000 mgr.a (mgr.14355) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:07:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:01 smithi171 bash[25040]: audit 2024-09-13T23:07:00.263240+0000 mgr.a (mgr.14355) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:07:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:01 smithi171 bash[25040]: cephadm 2024-09-13T23:07:00.264529+0000 mgr.a (mgr.14355) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:07:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:01 smithi007 bash[22722]: audit 2024-09-13T23:07:00.263240+0000 mgr.a (mgr.14355) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:07:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:01 smithi007 bash[22722]: cephadm 2024-09-13T23:07:00.264529+0000 mgr.a (mgr.14355) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:07:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:02 smithi131 bash[24745]: cluster 2024-09-13T23:07:01.624846+0000 mgr.a (mgr.14355) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:03.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:02 smithi171 bash[25040]: cluster 2024-09-13T23:07:01.624846+0000 mgr.a (mgr.14355) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:02 smithi007 bash[22722]: cluster 2024-09-13T23:07:01.624846+0000 mgr.a (mgr.14355) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:03.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:03.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:03.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:03 smithi131 bash[24745]: cluster 2024-09-13T23:07:03.625761+0000 mgr.a (mgr.14355) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:03 smithi171 bash[25040]: cluster 2024-09-13T23:07:03.625761+0000 mgr.a (mgr.14355) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:03 smithi007 bash[22722]: cluster 2024-09-13T23:07:03.625761+0000 mgr.a (mgr.14355) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:07:04.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:04.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:04.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:04.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:04.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:04 smithi131 bash[24745]: audit 2024-09-13T23:07:04.217064+0000 mgr.a (mgr.14355) 2000 : audit [DBG] from='client.55506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:05.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:04 smithi171 bash[25040]: audit 2024-09-13T23:07:04.217064+0000 mgr.a (mgr.14355) 2000 : audit [DBG] from='client.55506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:04 smithi007 bash[22722]: audit 2024-09-13T23:07:04.217064+0000 mgr.a (mgr.14355) 2000 : audit [DBG] from='client.55506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:05 smithi131 bash[24745]: cluster 2024-09-13T23:07:05.628104+0000 mgr.a (mgr.14355) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:06.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:05 smithi171 bash[25040]: cluster 2024-09-13T23:07:05.628104+0000 mgr.a (mgr.14355) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:05 smithi007 bash[22722]: cluster 2024-09-13T23:07:05.628104+0000 mgr.a (mgr.14355) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:08 smithi007 bash[22722]: cluster 2024-09-13T23:07:07.628923+0000 mgr.a (mgr.14355) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:08 smithi131 bash[24745]: cluster 2024-09-13T23:07:07.628923+0000 mgr.a (mgr.14355) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:09.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:08 smithi171 bash[25040]: cluster 2024-09-13T23:07:07.628923+0000 mgr.a (mgr.14355) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:09.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:10.385 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:10.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:10 smithi007 bash[22722]: cluster 2024-09-13T23:07:09.629830+0000 mgr.a (mgr.14355) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:10 smithi131 bash[24745]: cluster 2024-09-13T23:07:09.629830+0000 mgr.a (mgr.14355) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:11.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:10 smithi171 bash[25040]: cluster 2024-09-13T23:07:09.629830+0000 mgr.a (mgr.14355) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:11 smithi007 bash[22722]: audit 2024-09-13T23:07:09.972591+0000 mgr.a (mgr.14355) 2004 : audit [DBG] from='client.55584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:12.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:11 smithi131 bash[24745]: audit 2024-09-13T23:07:09.972591+0000 mgr.a (mgr.14355) 2004 : audit [DBG] from='client.55584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:11 smithi171 bash[25040]: audit 2024-09-13T23:07:09.972591+0000 mgr.a (mgr.14355) 2004 : audit [DBG] from='client.55584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:12 smithi007 bash[22722]: cluster 2024-09-13T23:07:11.632539+0000 mgr.a (mgr.14355) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:13.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:12 smithi131 bash[24745]: cluster 2024-09-13T23:07:11.632539+0000 mgr.a (mgr.14355) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:13.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:12 smithi171 bash[25040]: cluster 2024-09-13T23:07:11.632539+0000 mgr.a (mgr.14355) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:07:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:14 smithi131 bash[24745]: cluster 2024-09-13T23:07:13.633294+0000 mgr.a (mgr.14355) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:07:15.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:14 smithi171 bash[25040]: cluster 2024-09-13T23:07:13.633294+0000 mgr.a (mgr.14355) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:07:15.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:14 smithi007 bash[22722]: cluster 2024-09-13T23:07:13.633294+0000 mgr.a (mgr.14355) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:07:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:16.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:16.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:16 smithi131 bash[24745]: cluster 2024-09-13T23:07:15.635265+0000 mgr.a (mgr.14355) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:07:17.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:16 smithi171 bash[25040]: cluster 2024-09-13T23:07:15.635265+0000 mgr.a (mgr.14355) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:07:17.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:16 smithi007 bash[22722]: cluster 2024-09-13T23:07:15.635265+0000 mgr.a (mgr.14355) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:07:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:17 smithi131 bash[24745]: audit 2024-09-13T23:07:15.730469+0000 mgr.a (mgr.14355) 2008 : audit [DBG] from='client.55659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:17 smithi131 bash[24745]: cluster 2024-09-13T23:07:17.636199+0000 mgr.a (mgr.14355) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:18.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:17 smithi171 bash[25040]: audit 2024-09-13T23:07:15.730469+0000 mgr.a (mgr.14355) 2008 : audit [DBG] from='client.55659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:18.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:17 smithi171 bash[25040]: cluster 2024-09-13T23:07:17.636199+0000 mgr.a (mgr.14355) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:17 smithi007 bash[22722]: audit 2024-09-13T23:07:15.730469+0000 mgr.a (mgr.14355) 2008 : audit [DBG] from='client.55659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:17 smithi007 bash[22722]: cluster 2024-09-13T23:07:17.636199+0000 mgr.a (mgr.14355) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:20.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:20 smithi007 bash[22722]: cluster 2024-09-13T23:07:19.637019+0000 mgr.a (mgr.14355) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:07:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:20 smithi131 bash[24745]: cluster 2024-09-13T23:07:19.637019+0000 mgr.a (mgr.14355) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:07:21.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:20 smithi171 bash[25040]: cluster 2024-09-13T23:07:19.637019+0000 mgr.a (mgr.14355) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:07:21.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:21.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:21.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:21.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:21.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:21.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:22 smithi007 bash[22722]: audit 2024-09-13T23:07:21.506159+0000 mgr.a (mgr.14355) 2011 : audit [DBG] from='client.55731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:22.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:22 smithi007 bash[22722]: cluster 2024-09-13T23:07:21.648017+0000 mgr.a (mgr.14355) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:22 smithi131 bash[24745]: audit 2024-09-13T23:07:21.506159+0000 mgr.a (mgr.14355) 2011 : audit [DBG] from='client.55731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:23.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:22 smithi131 bash[24745]: cluster 2024-09-13T23:07:21.648017+0000 mgr.a (mgr.14355) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:23.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:22 smithi171 bash[25040]: audit 2024-09-13T23:07:21.506159+0000 mgr.a (mgr.14355) 2011 : audit [DBG] from='client.55731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:23.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:22 smithi171 bash[25040]: cluster 2024-09-13T23:07:21.648017+0000 mgr.a (mgr.14355) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:24 smithi007 bash[22722]: cluster 2024-09-13T23:07:23.648891+0000 mgr.a (mgr.14355) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:25.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:24 smithi131 bash[24745]: cluster 2024-09-13T23:07:23.648891+0000 mgr.a (mgr.14355) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:25.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:24 smithi171 bash[25040]: cluster 2024-09-13T23:07:23.648891+0000 mgr.a (mgr.14355) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:26.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:27.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:26 smithi131 bash[24745]: cluster 2024-09-13T23:07:25.651023+0000 mgr.a (mgr.14355) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:27.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:26 smithi171 bash[25040]: cluster 2024-09-13T23:07:25.651023+0000 mgr.a (mgr.14355) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:26 smithi007 bash[22722]: cluster 2024-09-13T23:07:25.651023+0000 mgr.a (mgr.14355) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:27.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:27.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:27.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:28 smithi131 bash[24745]: audit 2024-09-13T23:07:27.286540+0000 mgr.a (mgr.14355) 2015 : audit [DBG] from='client.55809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:28 smithi131 bash[24745]: cluster 2024-09-13T23:07:27.651505+0000 mgr.a (mgr.14355) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:29.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:28 smithi171 bash[25040]: audit 2024-09-13T23:07:27.286540+0000 mgr.a (mgr.14355) 2015 : audit [DBG] from='client.55809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:28 smithi171 bash[25040]: cluster 2024-09-13T23:07:27.651505+0000 mgr.a (mgr.14355) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:29.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:28 smithi007 bash[22722]: audit 2024-09-13T23:07:27.286540+0000 mgr.a (mgr.14355) 2015 : audit [DBG] from='client.55809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:28 smithi007 bash[22722]: cluster 2024-09-13T23:07:27.651505+0000 mgr.a (mgr.14355) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:30.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:29 smithi131 bash[24745]: cluster 2024-09-13T23:07:29.652220+0000 mgr.a (mgr.14355) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:30.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:29 smithi171 bash[25040]: cluster 2024-09-13T23:07:29.652220+0000 mgr.a (mgr.14355) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:29 smithi007 bash[22722]: cluster 2024-09-13T23:07:29.652220+0000 mgr.a (mgr.14355) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:32.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:32.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:32.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:32 smithi131 bash[24745]: cluster 2024-09-13T23:07:31.654433+0000 mgr.a (mgr.14355) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:33.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:32 smithi171 bash[25040]: cluster 2024-09-13T23:07:31.654433+0000 mgr.a (mgr.14355) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:32 smithi007 bash[22722]: cluster 2024-09-13T23:07:31.654433+0000 mgr.a (mgr.14355) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:33.458 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:33.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:33.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:33.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:33.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:33 smithi131 bash[24745]: audit 2024-09-13T23:07:33.048181+0000 mgr.a (mgr.14355) 2019 : audit [DBG] from='client.55884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:33 smithi131 bash[24745]: cluster 2024-09-13T23:07:33.655267+0000 mgr.a (mgr.14355) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:34.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:33 smithi171 bash[25040]: audit 2024-09-13T23:07:33.048181+0000 mgr.a (mgr.14355) 2019 : audit [DBG] from='client.55884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:34.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:33 smithi171 bash[25040]: cluster 2024-09-13T23:07:33.655267+0000 mgr.a (mgr.14355) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:33 smithi007 bash[22722]: audit 2024-09-13T23:07:33.048181+0000 mgr.a (mgr.14355) 2019 : audit [DBG] from='client.55884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:33 smithi007 bash[22722]: cluster 2024-09-13T23:07:33.655267+0000 mgr.a (mgr.14355) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:36.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:35 smithi131 bash[24745]: cluster 2024-09-13T23:07:35.657520+0000 mgr.a (mgr.14355) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:36.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:35 smithi171 bash[25040]: cluster 2024-09-13T23:07:35.657520+0000 mgr.a (mgr.14355) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:35 smithi007 bash[22722]: cluster 2024-09-13T23:07:35.657520+0000 mgr.a (mgr.14355) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:37 smithi131 bash[24745]: cluster 2024-09-13T23:07:37.658247+0000 mgr.a (mgr.14355) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:38.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:37 smithi171 bash[25040]: cluster 2024-09-13T23:07:37.658247+0000 mgr.a (mgr.14355) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:37 smithi007 bash[22722]: cluster 2024-09-13T23:07:37.658247+0000 mgr.a (mgr.14355) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:38.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:38.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:39.241 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:39.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:39 smithi131 bash[24745]: audit 2024-09-13T23:07:38.798757+0000 mgr.a (mgr.14355) 2023 : audit [DBG] from='client.55962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:39 smithi131 bash[24745]: cluster 2024-09-13T23:07:39.659237+0000 mgr.a (mgr.14355) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:40.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:39 smithi171 bash[25040]: audit 2024-09-13T23:07:38.798757+0000 mgr.a (mgr.14355) 2023 : audit [DBG] from='client.55962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:40.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:39 smithi171 bash[25040]: cluster 2024-09-13T23:07:39.659237+0000 mgr.a (mgr.14355) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:39 smithi007 bash[22722]: audit 2024-09-13T23:07:38.798757+0000 mgr.a (mgr.14355) 2023 : audit [DBG] from='client.55962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:39 smithi007 bash[22722]: cluster 2024-09-13T23:07:39.659237+0000 mgr.a (mgr.14355) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:41 smithi131 bash[24745]: cluster 2024-09-13T23:07:41.661502+0000 mgr.a (mgr.14355) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:42.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:41 smithi171 bash[25040]: cluster 2024-09-13T23:07:41.661502+0000 mgr.a (mgr.14355) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:41 smithi007 bash[22722]: cluster 2024-09-13T23:07:41.661502+0000 mgr.a (mgr.14355) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:43 smithi131 bash[24745]: cluster 2024-09-13T23:07:43.662273+0000 mgr.a (mgr.14355) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:44.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:43 smithi171 bash[25040]: cluster 2024-09-13T23:07:43.662273+0000 mgr.a (mgr.14355) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:43 smithi007 bash[22722]: cluster 2024-09-13T23:07:43.662273+0000 mgr.a (mgr.14355) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:44.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:44.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:44.987 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:44 smithi131 bash[24745]: audit 2024-09-13T23:07:44.573707+0000 mgr.a (mgr.14355) 2027 : audit [DBG] from='client.56037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:45.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:44 smithi171 bash[25040]: audit 2024-09-13T23:07:44.573707+0000 mgr.a (mgr.14355) 2027 : audit [DBG] from='client.56037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:45.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:44 smithi007 bash[22722]: audit 2024-09-13T23:07:44.573707+0000 mgr.a (mgr.14355) 2027 : audit [DBG] from='client.56037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:45 smithi131 bash[24745]: cluster 2024-09-13T23:07:45.664631+0000 mgr.a (mgr.14355) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:46.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:45 smithi171 bash[25040]: cluster 2024-09-13T23:07:45.664631+0000 mgr.a (mgr.14355) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:45 smithi007 bash[22722]: cluster 2024-09-13T23:07:45.664631+0000 mgr.a (mgr.14355) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:07:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:47 smithi131 bash[24745]: cluster 2024-09-13T23:07:47.665396+0000 mgr.a (mgr.14355) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:48.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:47 smithi171 bash[25040]: cluster 2024-09-13T23:07:47.665396+0000 mgr.a (mgr.14355) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:47 smithi007 bash[22722]: cluster 2024-09-13T23:07:47.665396+0000 mgr.a (mgr.14355) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:49.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:49 smithi131 bash[24745]: cluster 2024-09-13T23:07:49.666143+0000 mgr.a (mgr.14355) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:49 smithi171 bash[25040]: cluster 2024-09-13T23:07:49.666143+0000 mgr.a (mgr.14355) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:49 smithi007 bash[22722]: cluster 2024-09-13T23:07:49.666143+0000 mgr.a (mgr.14355) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:50.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:50.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:50 smithi131 bash[24745]: audit 2024-09-13T23:07:50.338912+0000 mgr.a (mgr.14355) 2031 : audit [DBG] from='client.56115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:51.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:50 smithi171 bash[25040]: audit 2024-09-13T23:07:50.338912+0000 mgr.a (mgr.14355) 2031 : audit [DBG] from='client.56115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:51.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:50 smithi007 bash[22722]: audit 2024-09-13T23:07:50.338912+0000 mgr.a (mgr.14355) 2031 : audit [DBG] from='client.56115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:51 smithi131 bash[24745]: cluster 2024-09-13T23:07:51.668942+0000 mgr.a (mgr.14355) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:51 smithi171 bash[25040]: cluster 2024-09-13T23:07:51.668942+0000 mgr.a (mgr.14355) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:51 smithi007 bash[22722]: cluster 2024-09-13T23:07:51.668942+0000 mgr.a (mgr.14355) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:53 smithi131 bash[24745]: cluster 2024-09-13T23:07:53.669737+0000 mgr.a (mgr.14355) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:53 smithi171 bash[25040]: cluster 2024-09-13T23:07:53.669737+0000 mgr.a (mgr.14355) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:53 smithi007 bash[22722]: cluster 2024-09-13T23:07:53.669737+0000 mgr.a (mgr.14355) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:07:55.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:07:55.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:07:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:55 smithi131 bash[24745]: cluster 2024-09-13T23:07:55.671689+0000 mgr.a (mgr.14355) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:55 smithi171 bash[25040]: cluster 2024-09-13T23:07:55.671689+0000 mgr.a (mgr.14355) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:55 smithi007 bash[22722]: cluster 2024-09-13T23:07:55.671689+0000 mgr.a (mgr.14355) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:07:56.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:07:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:07:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:07:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:07:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:07:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:56 smithi131 bash[24745]: audit 2024-09-13T23:07:56.107063+0000 mgr.a (mgr.14355) 2035 : audit [DBG] from='client.56193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:56 smithi171 bash[25040]: audit 2024-09-13T23:07:56.107063+0000 mgr.a (mgr.14355) 2035 : audit [DBG] from='client.56193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:56 smithi007 bash[22722]: audit 2024-09-13T23:07:56.107063+0000 mgr.a (mgr.14355) 2035 : audit [DBG] from='client.56193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:57 smithi131 bash[24745]: cluster 2024-09-13T23:07:57.672639+0000 mgr.a (mgr.14355) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:57 smithi171 bash[25040]: cluster 2024-09-13T23:07:57.672639+0000 mgr.a (mgr.14355) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:07:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:57 smithi007 bash[22722]: cluster 2024-09-13T23:07:57.672639+0000 mgr.a (mgr.14355) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:07:59 smithi131 bash[24745]: cluster 2024-09-13T23:07:59.673406+0000 mgr.a (mgr.14355) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:00.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:07:59 smithi171 bash[25040]: cluster 2024-09-13T23:07:59.673406+0000 mgr.a (mgr.14355) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:07:59 smithi007 bash[22722]: cluster 2024-09-13T23:07:59.673406+0000 mgr.a (mgr.14355) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:01.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:00 smithi131 bash[24745]: audit 2024-09-13T23:08:00.316729+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:00 smithi171 bash[25040]: audit 2024-09-13T23:08:00.316729+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:00 smithi007 bash[22722]: audit 2024-09-13T23:08:00.316729+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:01.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:00.941092+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:00.947418+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: cluster 2024-09-13T23:08:01.674694+0000 mgr.a (mgr.14355) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:01.690448+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:01.691328+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:01.696701+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:01.699254+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:01 smithi007 bash[22722]: audit 2024-09-13T23:08:01.700504+0000 mgr.a (mgr.14355) 2039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:00.941092+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:00.947418+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: cluster 2024-09-13T23:08:01.674694+0000 mgr.a (mgr.14355) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:01.690448+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:01.691328+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:02.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:01.696701+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:01.699254+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:01 smithi131 bash[24745]: audit 2024-09-13T23:08:01.700504+0000 mgr.a (mgr.14355) 2039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:00.941092+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:00.947418+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: cluster 2024-09-13T23:08:01.674694+0000 mgr.a (mgr.14355) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:01.690448+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:01.691328+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:01.696701+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:01.699254+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:01 smithi171 bash[25040]: audit 2024-09-13T23:08:01.700504+0000 mgr.a (mgr.14355) 2039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:08:02.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:08:02 smithi007 bash[22972]: debug 2024-09-13T23:08:02.394+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:08:02.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:08:02 smithi007 bash[22972]: debug 2024-09-13T23:08:02.402+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:08:02.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:02.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:02.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:02.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:02.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:02 smithi007 bash[22722]: audit 2024-09-13T23:08:01.874810+0000 mgr.a (mgr.14355) 2040 : audit [DBG] from='client.56271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:02 smithi007 bash[22722]: audit 2024-09-13T23:08:02.400116+0000 mgr.a (mgr.14355) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:08:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:02 smithi007 bash[22722]: cephadm 2024-09-13T23:08:02.409814+0000 mgr.a (mgr.14355) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:08:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:02 smithi131 bash[24745]: audit 2024-09-13T23:08:01.874810+0000 mgr.a (mgr.14355) 2040 : audit [DBG] from='client.56271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:02 smithi131 bash[24745]: audit 2024-09-13T23:08:02.400116+0000 mgr.a (mgr.14355) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:08:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:02 smithi131 bash[24745]: cephadm 2024-09-13T23:08:02.409814+0000 mgr.a (mgr.14355) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:08:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:02 smithi171 bash[25040]: audit 2024-09-13T23:08:01.874810+0000 mgr.a (mgr.14355) 2040 : audit [DBG] from='client.56271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:03.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:02 smithi171 bash[25040]: audit 2024-09-13T23:08:02.400116+0000 mgr.a (mgr.14355) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:08:03.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:02 smithi171 bash[25040]: cephadm 2024-09-13T23:08:02.409814+0000 mgr.a (mgr.14355) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:08:04.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:03 smithi131 bash[24745]: cluster 2024-09-13T23:08:03.675627+0000 mgr.a (mgr.14355) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:04.293 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:03 smithi171 bash[25040]: cluster 2024-09-13T23:08:03.675627+0000 mgr.a (mgr.14355) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:03 smithi007 bash[22722]: cluster 2024-09-13T23:08:03.675627+0000 mgr.a (mgr.14355) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:05 smithi131 bash[24745]: cluster 2024-09-13T23:08:05.677782+0000 mgr.a (mgr.14355) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:05 smithi171 bash[25040]: cluster 2024-09-13T23:08:05.677782+0000 mgr.a (mgr.14355) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:05 smithi007 bash[22722]: cluster 2024-09-13T23:08:05.677782+0000 mgr.a (mgr.14355) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:07.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:07.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:07.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:08.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:07 smithi131 bash[24745]: cluster 2024-09-13T23:08:07.678572+0000 mgr.a (mgr.14355) 2045 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:08.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:07 smithi171 bash[25040]: cluster 2024-09-13T23:08:07.678572+0000 mgr.a (mgr.14355) 2045 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:07 smithi007 bash[22722]: cluster 2024-09-13T23:08:07.678572+0000 mgr.a (mgr.14355) 2045 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:08.569 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:08.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:08 smithi131 bash[24745]: audit 2024-09-13T23:08:08.131771+0000 mgr.a (mgr.14355) 2046 : audit [DBG] from='client.56454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:09.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:08 smithi171 bash[25040]: audit 2024-09-13T23:08:08.131771+0000 mgr.a (mgr.14355) 2046 : audit [DBG] from='client.56454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:09.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:08 smithi007 bash[22722]: audit 2024-09-13T23:08:08.131771+0000 mgr.a (mgr.14355) 2046 : audit [DBG] from='client.56454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:10.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:09 smithi171 bash[25040]: cluster 2024-09-13T23:08:09.679507+0000 mgr.a (mgr.14355) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:09 smithi007 bash[22722]: cluster 2024-09-13T23:08:09.679507+0000 mgr.a (mgr.14355) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:09 smithi131 bash[24745]: cluster 2024-09-13T23:08:09.679507+0000 mgr.a (mgr.14355) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:12.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:11 smithi131 bash[24745]: cluster 2024-09-13T23:08:11.681708+0000 mgr.a (mgr.14355) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:12.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:11 smithi171 bash[25040]: cluster 2024-09-13T23:08:11.681708+0000 mgr.a (mgr.14355) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:11 smithi007 bash[22722]: cluster 2024-09-13T23:08:11.681708+0000 mgr.a (mgr.14355) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:13.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:13.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:14.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:13 smithi131 bash[24745]: cluster 2024-09-13T23:08:13.682128+0000 mgr.a (mgr.14355) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:14.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:13 smithi171 bash[25040]: cluster 2024-09-13T23:08:13.682128+0000 mgr.a (mgr.14355) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:13 smithi007 bash[22722]: cluster 2024-09-13T23:08:13.682128+0000 mgr.a (mgr.14355) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:14.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:15.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:14 smithi131 bash[24745]: audit 2024-09-13T23:08:13.904360+0000 mgr.a (mgr.14355) 2050 : audit [DBG] from='client.56532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:15.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:14 smithi171 bash[25040]: audit 2024-09-13T23:08:13.904360+0000 mgr.a (mgr.14355) 2050 : audit [DBG] from='client.56532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:15.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:14 smithi007 bash[22722]: audit 2024-09-13T23:08:13.904360+0000 mgr.a (mgr.14355) 2050 : audit [DBG] from='client.56532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:15 smithi131 bash[24745]: cluster 2024-09-13T23:08:15.684423+0000 mgr.a (mgr.14355) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:16.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:15 smithi171 bash[25040]: cluster 2024-09-13T23:08:15.684423+0000 mgr.a (mgr.14355) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:15 smithi007 bash[22722]: cluster 2024-09-13T23:08:15.684423+0000 mgr.a (mgr.14355) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:08:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:17 smithi131 bash[24745]: cluster 2024-09-13T23:08:17.685186+0000 mgr.a (mgr.14355) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:18.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:17 smithi171 bash[25040]: cluster 2024-09-13T23:08:17.685186+0000 mgr.a (mgr.14355) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:17 smithi007 bash[22722]: cluster 2024-09-13T23:08:17.685186+0000 mgr.a (mgr.14355) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:19.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:19.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:19 smithi131 bash[24745]: audit 2024-09-13T23:08:19.654789+0000 mgr.a (mgr.14355) 2053 : audit [DBG] from='client.56610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:19 smithi131 bash[24745]: cluster 2024-09-13T23:08:19.686178+0000 mgr.a (mgr.14355) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:20.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:19 smithi171 bash[25040]: audit 2024-09-13T23:08:19.654789+0000 mgr.a (mgr.14355) 2053 : audit [DBG] from='client.56610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:19 smithi171 bash[25040]: cluster 2024-09-13T23:08:19.686178+0000 mgr.a (mgr.14355) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:20.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:19 smithi007 bash[22722]: audit 2024-09-13T23:08:19.654789+0000 mgr.a (mgr.14355) 2053 : audit [DBG] from='client.56610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:19 smithi007 bash[22722]: cluster 2024-09-13T23:08:19.686178+0000 mgr.a (mgr.14355) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:22.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:21 smithi131 bash[24745]: cluster 2024-09-13T23:08:21.688500+0000 mgr.a (mgr.14355) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:22.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:21 smithi171 bash[25040]: cluster 2024-09-13T23:08:21.688500+0000 mgr.a (mgr.14355) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:21 smithi007 bash[22722]: cluster 2024-09-13T23:08:21.688500+0000 mgr.a (mgr.14355) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:24.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:23 smithi131 bash[24745]: cluster 2024-09-13T23:08:23.689251+0000 mgr.a (mgr.14355) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:24.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:23 smithi171 bash[25040]: cluster 2024-09-13T23:08:23.689251+0000 mgr.a (mgr.14355) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:23 smithi007 bash[22722]: cluster 2024-09-13T23:08:23.689251+0000 mgr.a (mgr.14355) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:25.827 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:25.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:25.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:25.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:25.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:25 smithi131 bash[24745]: audit 2024-09-13T23:08:25.408045+0000 mgr.a (mgr.14355) 2057 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:25 smithi131 bash[24745]: cluster 2024-09-13T23:08:25.690706+0000 mgr.a (mgr.14355) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:26.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:25 smithi171 bash[25040]: audit 2024-09-13T23:08:25.408045+0000 mgr.a (mgr.14355) 2057 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:26.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:25 smithi171 bash[25040]: cluster 2024-09-13T23:08:25.690706+0000 mgr.a (mgr.14355) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:25 smithi007 bash[22722]: audit 2024-09-13T23:08:25.408045+0000 mgr.a (mgr.14355) 2057 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:25 smithi007 bash[22722]: cluster 2024-09-13T23:08:25.690706+0000 mgr.a (mgr.14355) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:27 smithi131 bash[24745]: cluster 2024-09-13T23:08:27.691688+0000 mgr.a (mgr.14355) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:28.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:27 smithi171 bash[25040]: cluster 2024-09-13T23:08:27.691688+0000 mgr.a (mgr.14355) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:27 smithi007 bash[22722]: cluster 2024-09-13T23:08:27.691688+0000 mgr.a (mgr.14355) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:30.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:29 smithi131 bash[24745]: cluster 2024-09-13T23:08:29.692520+0000 mgr.a (mgr.14355) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:30.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:29 smithi171 bash[25040]: cluster 2024-09-13T23:08:29.692520+0000 mgr.a (mgr.14355) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:29 smithi007 bash[22722]: cluster 2024-09-13T23:08:29.692520+0000 mgr.a (mgr.14355) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:08:30.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:30.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:30.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:31.569 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:31.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:32.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:31 smithi131 bash[24745]: audit 2024-09-13T23:08:31.160499+0000 mgr.a (mgr.14355) 2061 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:32.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:31 smithi131 bash[24745]: cluster 2024-09-13T23:08:31.696092+0000 mgr.a (mgr.14355) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:32.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:31 smithi171 bash[25040]: audit 2024-09-13T23:08:31.160499+0000 mgr.a (mgr.14355) 2061 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:32.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:31 smithi171 bash[25040]: cluster 2024-09-13T23:08:31.696092+0000 mgr.a (mgr.14355) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:31 smithi007 bash[22722]: audit 2024-09-13T23:08:31.160499+0000 mgr.a (mgr.14355) 2061 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:31 smithi007 bash[22722]: cluster 2024-09-13T23:08:31.696092+0000 mgr.a (mgr.14355) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:33 smithi131 bash[24745]: cluster 2024-09-13T23:08:33.697073+0000 mgr.a (mgr.14355) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:34.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:33 smithi171 bash[25040]: cluster 2024-09-13T23:08:33.697073+0000 mgr.a (mgr.14355) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:33 smithi007 bash[22722]: cluster 2024-09-13T23:08:33.697073+0000 mgr.a (mgr.14355) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:08:36.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:35 smithi131 bash[24745]: cluster 2024-09-13T23:08:35.699133+0000 mgr.a (mgr.14355) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:36.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:35 smithi171 bash[25040]: cluster 2024-09-13T23:08:35.699133+0000 mgr.a (mgr.14355) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:35 smithi007 bash[22722]: cluster 2024-09-13T23:08:35.699133+0000 mgr.a (mgr.14355) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:36.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:36.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:37.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:37 smithi131 bash[24745]: audit 2024-09-13T23:08:36.906793+0000 mgr.a (mgr.14355) 2065 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:37 smithi131 bash[24745]: cluster 2024-09-13T23:08:37.700171+0000 mgr.a (mgr.14355) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:38.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:37 smithi171 bash[25040]: audit 2024-09-13T23:08:36.906793+0000 mgr.a (mgr.14355) 2065 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:38.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:37 smithi171 bash[25040]: cluster 2024-09-13T23:08:37.700171+0000 mgr.a (mgr.14355) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:37 smithi007 bash[22722]: audit 2024-09-13T23:08:36.906793+0000 mgr.a (mgr.14355) 2065 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:37 smithi007 bash[22722]: cluster 2024-09-13T23:08:37.700171+0000 mgr.a (mgr.14355) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:39 smithi131 bash[24745]: cluster 2024-09-13T23:08:39.700936+0000 mgr.a (mgr.14355) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:40.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:39 smithi171 bash[25040]: cluster 2024-09-13T23:08:39.700936+0000 mgr.a (mgr.14355) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:39 smithi007 bash[22722]: cluster 2024-09-13T23:08:39.700936+0000 mgr.a (mgr.14355) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:41 smithi131 bash[24745]: cluster 2024-09-13T23:08:41.703246+0000 mgr.a (mgr.14355) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:42.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:41 smithi171 bash[25040]: cluster 2024-09-13T23:08:41.703246+0000 mgr.a (mgr.14355) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:41 smithi007 bash[22722]: cluster 2024-09-13T23:08:41.703246+0000 mgr.a (mgr.14355) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:42.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:42.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:42 smithi131 bash[24745]: audit 2024-09-13T23:08:42.680259+0000 mgr.a (mgr.14355) 2069 : audit [DBG] from='client.56919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:43.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:42 smithi171 bash[25040]: audit 2024-09-13T23:08:42.680259+0000 mgr.a (mgr.14355) 2069 : audit [DBG] from='client.56919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:43.104 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:42 smithi007 bash[22722]: audit 2024-09-13T23:08:42.680259+0000 mgr.a (mgr.14355) 2069 : audit [DBG] from='client.56919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:44.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:43 smithi171 bash[25040]: cluster 2024-09-13T23:08:43.704363+0000 mgr.a (mgr.14355) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:43 smithi007 bash[22722]: cluster 2024-09-13T23:08:43.704363+0000 mgr.a (mgr.14355) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:44.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:43 smithi131 bash[24745]: cluster 2024-09-13T23:08:43.704363+0000 mgr.a (mgr.14355) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:45 smithi131 bash[24745]: cluster 2024-09-13T23:08:45.706739+0000 mgr.a (mgr.14355) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:46.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:45 smithi171 bash[25040]: cluster 2024-09-13T23:08:45.706739+0000 mgr.a (mgr.14355) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:45 smithi007 bash[22722]: cluster 2024-09-13T23:08:45.706739+0000 mgr.a (mgr.14355) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:47 smithi131 bash[24745]: cluster 2024-09-13T23:08:47.707662+0000 mgr.a (mgr.14355) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:48.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:47 smithi171 bash[25040]: cluster 2024-09-13T23:08:47.707662+0000 mgr.a (mgr.14355) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:48.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:48.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:48.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:47 smithi007 bash[22722]: cluster 2024-09-13T23:08:47.707662+0000 mgr.a (mgr.14355) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:48.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:48.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:48.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:48.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:48.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:49.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:48 smithi131 bash[24745]: audit 2024-09-13T23:08:48.437526+0000 mgr.a (mgr.14355) 2073 : audit [DBG] from='client.56997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:49.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:48 smithi171 bash[25040]: audit 2024-09-13T23:08:48.437526+0000 mgr.a (mgr.14355) 2073 : audit [DBG] from='client.56997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:49.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:48 smithi007 bash[22722]: audit 2024-09-13T23:08:48.437526+0000 mgr.a (mgr.14355) 2073 : audit [DBG] from='client.56997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:50.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:49 smithi171 bash[25040]: cluster 2024-09-13T23:08:49.708786+0000 mgr.a (mgr.14355) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:49 smithi007 bash[22722]: cluster 2024-09-13T23:08:49.708786+0000 mgr.a (mgr.14355) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:50.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:49 smithi131 bash[24745]: cluster 2024-09-13T23:08:49.708786+0000 mgr.a (mgr.14355) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:51 smithi131 bash[24745]: cluster 2024-09-13T23:08:51.711081+0000 mgr.a (mgr.14355) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:51 smithi171 bash[25040]: cluster 2024-09-13T23:08:51.711081+0000 mgr.a (mgr.14355) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:51 smithi007 bash[22722]: cluster 2024-09-13T23:08:51.711081+0000 mgr.a (mgr.14355) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:53.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:53.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:53.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:08:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:53 smithi131 bash[24745]: cluster 2024-09-13T23:08:53.711844+0000 mgr.a (mgr.14355) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:53 smithi171 bash[25040]: cluster 2024-09-13T23:08:53.711844+0000 mgr.a (mgr.14355) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:53 smithi007 bash[22722]: cluster 2024-09-13T23:08:53.711844+0000 mgr.a (mgr.14355) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:54.606 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:08:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:08:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:08:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:08:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:08:55.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:54 smithi171 bash[25040]: audit 2024-09-13T23:08:54.182730+0000 mgr.a (mgr.14355) 2077 : audit [DBG] from='client.57075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:55.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:54 smithi007 bash[22722]: audit 2024-09-13T23:08:54.182730+0000 mgr.a (mgr.14355) 2077 : audit [DBG] from='client.57075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:55.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:54 smithi131 bash[24745]: audit 2024-09-13T23:08:54.182730+0000 mgr.a (mgr.14355) 2077 : audit [DBG] from='client.57075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:56.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:55 smithi171 bash[25040]: cluster 2024-09-13T23:08:55.714180+0000 mgr.a (mgr.14355) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:55 smithi007 bash[22722]: cluster 2024-09-13T23:08:55.714180+0000 mgr.a (mgr.14355) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:56.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:55 smithi131 bash[24745]: cluster 2024-09-13T23:08:55.714180+0000 mgr.a (mgr.14355) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:08:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:57 smithi131 bash[24745]: cluster 2024-09-13T23:08:57.715000+0000 mgr.a (mgr.14355) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:57 smithi171 bash[25040]: cluster 2024-09-13T23:08:57.715000+0000 mgr.a (mgr.14355) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:57 smithi007 bash[22722]: cluster 2024-09-13T23:08:57.715000+0000 mgr.a (mgr.14355) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:08:59.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:08:59.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:08:59.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:08:59 smithi131 bash[24745]: cluster 2024-09-13T23:08:59.715440+0000 mgr.a (mgr.14355) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:00.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:08:59 smithi171 bash[25040]: cluster 2024-09-13T23:08:59.715440+0000 mgr.a (mgr.14355) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:08:59 smithi007 bash[22722]: cluster 2024-09-13T23:08:59.715440+0000 mgr.a (mgr.14355) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:00.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:00.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:00.383 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:01.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:00 smithi171 bash[25040]: audit 2024-09-13T23:08:59.947036+0000 mgr.a (mgr.14355) 2081 : audit [DBG] from='client.57153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:00 smithi007 bash[22722]: audit 2024-09-13T23:08:59.947036+0000 mgr.a (mgr.14355) 2081 : audit [DBG] from='client.57153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:01.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:00 smithi131 bash[24745]: audit 2024-09-13T23:08:59.947036+0000 mgr.a (mgr.14355) 2081 : audit [DBG] from='client.57153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:02.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:01 smithi171 bash[25040]: cluster 2024-09-13T23:09:01.718119+0000 mgr.a (mgr.14355) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:01 smithi007 bash[22722]: cluster 2024-09-13T23:09:01.718119+0000 mgr.a (mgr.14355) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:02.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:01 smithi131 bash[24745]: cluster 2024-09-13T23:09:01.718119+0000 mgr.a (mgr.14355) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:03.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:02 smithi171 bash[25040]: audit 2024-09-13T23:09:02.464665+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:02 smithi007 bash[22722]: audit 2024-09-13T23:09:02.464665+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:03.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:02 smithi131 bash[24745]: audit 2024-09-13T23:09:02.464665+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.075807+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.078966+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.082110+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.085172+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: cluster 2024-09-13T23:09:03.718873+0000 mgr.a (mgr.14355) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.807827+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.809524+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.819416+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22722]: audit 2024-09-13T23:09:03.824083+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:04.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.075807+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.078966+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.082110+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.085172+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: cluster 2024-09-13T23:09:03.718873+0000 mgr.a (mgr.14355) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.807827+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.809524+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.819416+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:04 smithi131 bash[24745]: audit 2024-09-13T23:09:03.824083+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:04.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.075807+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.078966+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.082110+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.085172+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: cluster 2024-09-13T23:09:03.718873+0000 mgr.a (mgr.14355) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.807827+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.809524+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.819416+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:09:04.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:04 smithi171 bash[25040]: audit 2024-09-13T23:09:03.824083+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:04.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22972]: debug 2024-09-13T23:09:04.553+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:09:04.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:09:04 smithi007 bash[22972]: debug 2024-09-13T23:09:04.553+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:09:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:05.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:05 smithi007 bash[22722]: audit 2024-09-13T23:09:03.825123+0000 mgr.a (mgr.14355) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:05.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:05 smithi007 bash[22722]: audit 2024-09-13T23:09:04.554868+0000 mgr.a (mgr.14355) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:09:05.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:05 smithi007 bash[22722]: cephadm 2024-09-13T23:09:04.556304+0000 mgr.a (mgr.14355) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:09:05.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:05 smithi131 bash[24745]: audit 2024-09-13T23:09:03.825123+0000 mgr.a (mgr.14355) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:05.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:05 smithi131 bash[24745]: audit 2024-09-13T23:09:04.554868+0000 mgr.a (mgr.14355) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:09:05.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:05 smithi131 bash[24745]: cephadm 2024-09-13T23:09:04.556304+0000 mgr.a (mgr.14355) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:09:05.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:05 smithi171 bash[25040]: audit 2024-09-13T23:09:03.825123+0000 mgr.a (mgr.14355) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:09:05.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:05 smithi171 bash[25040]: audit 2024-09-13T23:09:04.554868+0000 mgr.a (mgr.14355) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:09:05.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:05 smithi171 bash[25040]: cephadm 2024-09-13T23:09:04.556304+0000 mgr.a (mgr.14355) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:09:06.154 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:06.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:06 smithi007 bash[22722]: audit 2024-09-13T23:09:05.715980+0000 mgr.a (mgr.14355) 2087 : audit [DBG] from='client.57336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:06 smithi131 bash[24745]: audit 2024-09-13T23:09:05.715980+0000 mgr.a (mgr.14355) 2087 : audit [DBG] from='client.57336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:06.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:06 smithi171 bash[25040]: audit 2024-09-13T23:09:05.715980+0000 mgr.a (mgr.14355) 2087 : audit [DBG] from='client.57336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:07 smithi007 bash[22722]: cluster 2024-09-13T23:09:05.730132+0000 mgr.a (mgr.14355) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:07 smithi131 bash[24745]: cluster 2024-09-13T23:09:05.730132+0000 mgr.a (mgr.14355) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:07.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:07 smithi171 bash[25040]: cluster 2024-09-13T23:09:05.730132+0000 mgr.a (mgr.14355) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:09.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:09 smithi007 bash[22722]: cluster 2024-09-13T23:09:07.731119+0000 mgr.a (mgr.14355) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:09.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:09 smithi131 bash[24745]: cluster 2024-09-13T23:09:07.731119+0000 mgr.a (mgr.14355) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:09.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:09 smithi171 bash[25040]: cluster 2024-09-13T23:09:07.731119+0000 mgr.a (mgr.14355) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:11.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:11.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:11.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:11.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:11 smithi007 bash[22722]: cluster 2024-09-13T23:09:09.731885+0000 mgr.a (mgr.14355) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:11 smithi131 bash[24745]: cluster 2024-09-13T23:09:09.731885+0000 mgr.a (mgr.14355) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:11.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:11 smithi171 bash[25040]: cluster 2024-09-13T23:09:09.731885+0000 mgr.a (mgr.14355) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:09:11.899 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:11.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:12 smithi007 bash[22722]: audit 2024-09-13T23:09:11.487221+0000 mgr.a (mgr.14355) 2091 : audit [DBG] from='client.57408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:12.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:12 smithi131 bash[24745]: audit 2024-09-13T23:09:11.487221+0000 mgr.a (mgr.14355) 2091 : audit [DBG] from='client.57408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:12.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:12 smithi171 bash[25040]: audit 2024-09-13T23:09:11.487221+0000 mgr.a (mgr.14355) 2091 : audit [DBG] from='client.57408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:13.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:13 smithi007 bash[22722]: cluster 2024-09-13T23:09:11.733442+0000 mgr.a (mgr.14355) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:13.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:13 smithi131 bash[24745]: cluster 2024-09-13T23:09:11.733442+0000 mgr.a (mgr.14355) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:13.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:13 smithi171 bash[25040]: cluster 2024-09-13T23:09:11.733442+0000 mgr.a (mgr.14355) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:15.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:15 smithi007 bash[22722]: cluster 2024-09-13T23:09:13.734319+0000 mgr.a (mgr.14355) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:15.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:15 smithi131 bash[24745]: cluster 2024-09-13T23:09:13.734319+0000 mgr.a (mgr.14355) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:15.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:15 smithi171 bash[25040]: cluster 2024-09-13T23:09:13.734319+0000 mgr.a (mgr.14355) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:16.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:17.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:17 smithi007 bash[22722]: cluster 2024-09-13T23:09:15.736523+0000 mgr.a (mgr.14355) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:17.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:17 smithi131 bash[24745]: cluster 2024-09-13T23:09:15.736523+0000 mgr.a (mgr.14355) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:17.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:17 smithi171 bash[25040]: cluster 2024-09-13T23:09:15.736523+0000 mgr.a (mgr.14355) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:09:17.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:17.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:18.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:18 smithi007 bash[22722]: audit 2024-09-13T23:09:17.243831+0000 mgr.a (mgr.14355) 2095 : audit [DBG] from='client.57486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:18.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:18 smithi131 bash[24745]: audit 2024-09-13T23:09:17.243831+0000 mgr.a (mgr.14355) 2095 : audit [DBG] from='client.57486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:18.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:18 smithi171 bash[25040]: audit 2024-09-13T23:09:17.243831+0000 mgr.a (mgr.14355) 2095 : audit [DBG] from='client.57486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:19.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:19 smithi007 bash[22722]: cluster 2024-09-13T23:09:17.737534+0000 mgr.a (mgr.14355) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:19.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:19 smithi131 bash[24745]: cluster 2024-09-13T23:09:17.737534+0000 mgr.a (mgr.14355) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:19.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:19 smithi171 bash[25040]: cluster 2024-09-13T23:09:17.737534+0000 mgr.a (mgr.14355) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:21.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:21 smithi007 bash[22722]: cluster 2024-09-13T23:09:19.738428+0000 mgr.a (mgr.14355) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:21.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:21 smithi131 bash[24745]: cluster 2024-09-13T23:09:19.738428+0000 mgr.a (mgr.14355) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:21.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:21 smithi171 bash[25040]: cluster 2024-09-13T23:09:19.738428+0000 mgr.a (mgr.14355) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:23.418 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:23.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:23 smithi007 bash[22722]: cluster 2024-09-13T23:09:21.740653+0000 mgr.a (mgr.14355) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:23.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:23 smithi131 bash[24745]: cluster 2024-09-13T23:09:21.740653+0000 mgr.a (mgr.14355) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:23.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:23 smithi171 bash[25040]: cluster 2024-09-13T23:09:21.740653+0000 mgr.a (mgr.14355) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:24.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:24 smithi007 bash[22722]: audit 2024-09-13T23:09:23.003604+0000 mgr.a (mgr.14355) 2099 : audit [DBG] from='client.57561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:24.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:24 smithi131 bash[24745]: audit 2024-09-13T23:09:23.003604+0000 mgr.a (mgr.14355) 2099 : audit [DBG] from='client.57561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:24.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:24 smithi171 bash[25040]: audit 2024-09-13T23:09:23.003604+0000 mgr.a (mgr.14355) 2099 : audit [DBG] from='client.57561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:25.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:25 smithi007 bash[22722]: cluster 2024-09-13T23:09:23.741723+0000 mgr.a (mgr.14355) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:25.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:25 smithi131 bash[24745]: cluster 2024-09-13T23:09:23.741723+0000 mgr.a (mgr.14355) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:25.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:25 smithi171 bash[25040]: cluster 2024-09-13T23:09:23.741723+0000 mgr.a (mgr.14355) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:27.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:27 smithi007 bash[22722]: cluster 2024-09-13T23:09:25.744134+0000 mgr.a (mgr.14355) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:27.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:27 smithi131 bash[24745]: cluster 2024-09-13T23:09:25.744134+0000 mgr.a (mgr.14355) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:27.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:27 smithi171 bash[25040]: cluster 2024-09-13T23:09:25.744134+0000 mgr.a (mgr.14355) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:28.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:28.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:28.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:29.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:29.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:29.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:29.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:29.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:29.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:29 smithi007 bash[22722]: cluster 2024-09-13T23:09:27.745067+0000 mgr.a (mgr.14355) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:29.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:29 smithi131 bash[24745]: cluster 2024-09-13T23:09:27.745067+0000 mgr.a (mgr.14355) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:29.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:29 smithi171 bash[25040]: cluster 2024-09-13T23:09:27.745067+0000 mgr.a (mgr.14355) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:30 smithi007 bash[22722]: audit 2024-09-13T23:09:28.756076+0000 mgr.a (mgr.14355) 2103 : audit [DBG] from='client.57636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:30.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:30 smithi131 bash[24745]: audit 2024-09-13T23:09:28.756076+0000 mgr.a (mgr.14355) 2103 : audit [DBG] from='client.57636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:30 smithi171 bash[25040]: audit 2024-09-13T23:09:28.756076+0000 mgr.a (mgr.14355) 2103 : audit [DBG] from='client.57636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:31.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:31 smithi007 bash[22722]: cluster 2024-09-13T23:09:29.746021+0000 mgr.a (mgr.14355) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:31.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:31 smithi131 bash[24745]: cluster 2024-09-13T23:09:29.746021+0000 mgr.a (mgr.14355) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:31.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:31 smithi171 bash[25040]: cluster 2024-09-13T23:09:29.746021+0000 mgr.a (mgr.14355) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:33 smithi007 bash[22722]: cluster 2024-09-13T23:09:31.748319+0000 mgr.a (mgr.14355) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:33.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:33 smithi131 bash[24745]: cluster 2024-09-13T23:09:31.748319+0000 mgr.a (mgr.14355) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:33.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:33 smithi171 bash[25040]: cluster 2024-09-13T23:09:31.748319+0000 mgr.a (mgr.14355) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:34.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:34.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:34.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:34.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:34.935 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:35 smithi007 bash[22722]: cluster 2024-09-13T23:09:33.749102+0000 mgr.a (mgr.14355) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:35 smithi007 bash[22722]: audit 2024-09-13T23:09:34.525413+0000 mgr.a (mgr.14355) 2107 : audit [DBG] from='client.57714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:35 smithi131 bash[24745]: cluster 2024-09-13T23:09:33.749102+0000 mgr.a (mgr.14355) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:35 smithi131 bash[24745]: audit 2024-09-13T23:09:34.525413+0000 mgr.a (mgr.14355) 2107 : audit [DBG] from='client.57714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:35.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:35 smithi171 bash[25040]: cluster 2024-09-13T23:09:33.749102+0000 mgr.a (mgr.14355) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:35.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:35 smithi171 bash[25040]: audit 2024-09-13T23:09:34.525413+0000 mgr.a (mgr.14355) 2107 : audit [DBG] from='client.57714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:37 smithi007 bash[22722]: cluster 2024-09-13T23:09:35.751401+0000 mgr.a (mgr.14355) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:37.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:37 smithi131 bash[24745]: cluster 2024-09-13T23:09:35.751401+0000 mgr.a (mgr.14355) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:37 smithi171 bash[25040]: cluster 2024-09-13T23:09:35.751401+0000 mgr.a (mgr.14355) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:39.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:39 smithi007 bash[22722]: cluster 2024-09-13T23:09:37.752176+0000 mgr.a (mgr.14355) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:39 smithi131 bash[24745]: cluster 2024-09-13T23:09:37.752176+0000 mgr.a (mgr.14355) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:39.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:39 smithi171 bash[25040]: cluster 2024-09-13T23:09:37.752176+0000 mgr.a (mgr.14355) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:39.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:40.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:40.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:40.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:41 smithi007 bash[22722]: cluster 2024-09-13T23:09:39.752922+0000 mgr.a (mgr.14355) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:41 smithi007 bash[22722]: audit 2024-09-13T23:09:40.268056+0000 mgr.a (mgr.14355) 2111 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:41 smithi131 bash[24745]: cluster 2024-09-13T23:09:39.752922+0000 mgr.a (mgr.14355) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:41.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:41 smithi131 bash[24745]: audit 2024-09-13T23:09:40.268056+0000 mgr.a (mgr.14355) 2111 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:41 smithi171 bash[25040]: cluster 2024-09-13T23:09:39.752922+0000 mgr.a (mgr.14355) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:41.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:41 smithi171 bash[25040]: audit 2024-09-13T23:09:40.268056+0000 mgr.a (mgr.14355) 2111 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:43 smithi007 bash[22722]: cluster 2024-09-13T23:09:41.755648+0000 mgr.a (mgr.14355) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:43 smithi131 bash[24745]: cluster 2024-09-13T23:09:41.755648+0000 mgr.a (mgr.14355) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:43.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:43 smithi171 bash[25040]: cluster 2024-09-13T23:09:41.755648+0000 mgr.a (mgr.14355) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:45 smithi007 bash[22722]: cluster 2024-09-13T23:09:43.756451+0000 mgr.a (mgr.14355) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:45.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:45 smithi131 bash[24745]: cluster 2024-09-13T23:09:43.756451+0000 mgr.a (mgr.14355) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:45.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:45 smithi171 bash[25040]: cluster 2024-09-13T23:09:43.756451+0000 mgr.a (mgr.14355) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:46.427 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:46.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:47.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:47 smithi007 bash[22722]: cluster 2024-09-13T23:09:45.757767+0000 mgr.a (mgr.14355) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:47.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:47 smithi007 bash[22722]: audit 2024-09-13T23:09:46.022110+0000 mgr.a (mgr.14355) 2115 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:47.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:47 smithi131 bash[24745]: cluster 2024-09-13T23:09:45.757767+0000 mgr.a (mgr.14355) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:47.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:47 smithi131 bash[24745]: audit 2024-09-13T23:09:46.022110+0000 mgr.a (mgr.14355) 2115 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:47.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:47 smithi171 bash[25040]: cluster 2024-09-13T23:09:45.757767+0000 mgr.a (mgr.14355) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:47.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:47 smithi171 bash[25040]: audit 2024-09-13T23:09:46.022110+0000 mgr.a (mgr.14355) 2115 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:49 smithi007 bash[22722]: cluster 2024-09-13T23:09:47.758630+0000 mgr.a (mgr.14355) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:49 smithi131 bash[24745]: cluster 2024-09-13T23:09:47.758630+0000 mgr.a (mgr.14355) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:49.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:49 smithi171 bash[25040]: cluster 2024-09-13T23:09:47.758630+0000 mgr.a (mgr.14355) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:09:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:51.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:51 smithi007 bash[22722]: cluster 2024-09-13T23:09:49.759412+0000 mgr.a (mgr.14355) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:09:51.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:51 smithi131 bash[24745]: cluster 2024-09-13T23:09:49.759412+0000 mgr.a (mgr.14355) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:09:51.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:51 smithi171 bash[25040]: cluster 2024-09-13T23:09:49.759412+0000 mgr.a (mgr.14355) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:09:52.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:52.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:52.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:52.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:52.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:53.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:53 smithi007 bash[22722]: cluster 2024-09-13T23:09:51.761513+0000 mgr.a (mgr.14355) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:53.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:53 smithi007 bash[22722]: audit 2024-09-13T23:09:51.762397+0000 mgr.a (mgr.14355) 2119 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:53.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:53 smithi131 bash[24745]: cluster 2024-09-13T23:09:51.761513+0000 mgr.a (mgr.14355) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:53.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:53 smithi131 bash[24745]: audit 2024-09-13T23:09:51.762397+0000 mgr.a (mgr.14355) 2119 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:53.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:53 smithi171 bash[25040]: cluster 2024-09-13T23:09:51.761513+0000 mgr.a (mgr.14355) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:53.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:53 smithi171 bash[25040]: audit 2024-09-13T23:09:51.762397+0000 mgr.a (mgr.14355) 2119 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:55.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:55 smithi007 bash[22722]: cluster 2024-09-13T23:09:53.762428+0000 mgr.a (mgr.14355) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:55.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:55 smithi131 bash[24745]: cluster 2024-09-13T23:09:53.762428+0000 mgr.a (mgr.14355) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:55.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:55 smithi171 bash[25040]: cluster 2024-09-13T23:09:53.762428+0000 mgr.a (mgr.14355) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:57.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:09:57.174 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:09:57.174 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:09:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:57 smithi007 bash[22722]: cluster 2024-09-13T23:09:55.764645+0000 mgr.a (mgr.14355) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:57.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:57 smithi131 bash[24745]: cluster 2024-09-13T23:09:55.764645+0000 mgr.a (mgr.14355) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:57.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:57 smithi171 bash[25040]: cluster 2024-09-13T23:09:55.764645+0000 mgr.a (mgr.14355) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:09:57.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:09:57.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:09:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:09:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:09:57.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:09:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:58 smithi007 bash[22722]: audit 2024-09-13T23:09:57.505654+0000 mgr.a (mgr.14355) 2122 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:58.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:58 smithi131 bash[24745]: audit 2024-09-13T23:09:57.505654+0000 mgr.a (mgr.14355) 2122 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:58.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:58 smithi171 bash[25040]: audit 2024-09-13T23:09:57.505654+0000 mgr.a (mgr.14355) 2122 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:59.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:09:59 smithi007 bash[22722]: cluster 2024-09-13T23:09:57.765140+0000 mgr.a (mgr.14355) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:59.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:09:59 smithi131 bash[24745]: cluster 2024-09-13T23:09:57.765140+0000 mgr.a (mgr.14355) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:09:59.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:09:59 smithi171 bash[25040]: cluster 2024-09-13T23:09:57.765140+0000 mgr.a (mgr.14355) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:00 smithi007 bash[22722]: cluster 2024-09-13T23:10:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:10:00.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:00 smithi131 bash[24745]: cluster 2024-09-13T23:10:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:10:00.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:00 smithi171 bash[25040]: cluster 2024-09-13T23:10:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:10:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:01 smithi007 bash[22722]: cluster 2024-09-13T23:09:59.765975+0000 mgr.a (mgr.14355) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:01.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:01 smithi131 bash[24745]: cluster 2024-09-13T23:09:59.765975+0000 mgr.a (mgr.14355) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:01.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:01 smithi171 bash[25040]: cluster 2024-09-13T23:09:59.765975+0000 mgr.a (mgr.14355) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:02.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:03.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:03.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:03.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:03.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:03.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:03.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:03 smithi007 bash[22722]: cluster 2024-09-13T23:10:01.768983+0000 mgr.a (mgr.14355) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:03.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:03 smithi131 bash[24745]: cluster 2024-09-13T23:10:01.768983+0000 mgr.a (mgr.14355) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:03.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:03 smithi171 bash[25040]: cluster 2024-09-13T23:10:01.768983+0000 mgr.a (mgr.14355) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:04 smithi007 bash[22722]: audit 2024-09-13T23:10:03.249270+0000 mgr.a (mgr.14355) 2126 : audit [DBG] from='client.58101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:04.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:04 smithi131 bash[24745]: audit 2024-09-13T23:10:03.249270+0000 mgr.a (mgr.14355) 2126 : audit [DBG] from='client.58101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:04.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:04 smithi171 bash[25040]: audit 2024-09-13T23:10:03.249270+0000 mgr.a (mgr.14355) 2126 : audit [DBG] from='client.58101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:05 smithi007 bash[22722]: cluster 2024-09-13T23:10:03.769897+0000 mgr.a (mgr.14355) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:05 smithi007 bash[22722]: audit 2024-09-13T23:10:04.613184+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:05.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:05 smithi131 bash[24745]: cluster 2024-09-13T23:10:03.769897+0000 mgr.a (mgr.14355) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:05.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:05 smithi131 bash[24745]: audit 2024-09-13T23:10:04.613184+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:05.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:05 smithi171 bash[25040]: cluster 2024-09-13T23:10:03.769897+0000 mgr.a (mgr.14355) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:05.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:05 smithi171 bash[25040]: audit 2024-09-13T23:10:04.613184+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:06.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22972]: debug 2024-09-13T23:10:06.208+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22972]: debug 2024-09-13T23:10:06.208+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22722]: audit 2024-09-13T23:10:05.436931+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22722]: audit 2024-09-13T23:10:05.438540+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22722]: audit 2024-09-13T23:10:05.448775+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22722]: audit 2024-09-13T23:10:05.453551+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:06 smithi007 bash[22722]: audit 2024-09-13T23:10:05.454699+0000 mgr.a (mgr.14355) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:06.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:06 smithi131 bash[24745]: audit 2024-09-13T23:10:05.436931+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:06 smithi131 bash[24745]: audit 2024-09-13T23:10:05.438540+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:06 smithi131 bash[24745]: audit 2024-09-13T23:10:05.448775+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:10:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:06 smithi131 bash[24745]: audit 2024-09-13T23:10:05.453551+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:06 smithi131 bash[24745]: audit 2024-09-13T23:10:05.454699+0000 mgr.a (mgr.14355) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:06.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:06 smithi171 bash[25040]: audit 2024-09-13T23:10:05.436931+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:06.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:06 smithi171 bash[25040]: audit 2024-09-13T23:10:05.438540+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:06.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:06 smithi171 bash[25040]: audit 2024-09-13T23:10:05.448775+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:10:06.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:06 smithi171 bash[25040]: audit 2024-09-13T23:10:05.453551+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:06.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:06 smithi171 bash[25040]: audit 2024-09-13T23:10:05.454699+0000 mgr.a (mgr.14355) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:10:07.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:07 smithi007 bash[22722]: cluster 2024-09-13T23:10:05.771165+0000 mgr.a (mgr.14355) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:07 smithi007 bash[22722]: audit 2024-09-13T23:10:06.210843+0000 mgr.a (mgr.14355) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:10:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:07 smithi007 bash[22722]: cephadm 2024-09-13T23:10:06.212813+0000 mgr.a (mgr.14355) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:10:07.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:07 smithi131 bash[24745]: cluster 2024-09-13T23:10:05.771165+0000 mgr.a (mgr.14355) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:07.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:07 smithi131 bash[24745]: audit 2024-09-13T23:10:06.210843+0000 mgr.a (mgr.14355) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:10:07.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:07 smithi131 bash[24745]: cephadm 2024-09-13T23:10:06.212813+0000 mgr.a (mgr.14355) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:10:07.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:07 smithi171 bash[25040]: cluster 2024-09-13T23:10:05.771165+0000 mgr.a (mgr.14355) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:07.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:07 smithi171 bash[25040]: audit 2024-09-13T23:10:06.210843+0000 mgr.a (mgr.14355) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:10:07.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:07 smithi171 bash[25040]: cephadm 2024-09-13T23:10:06.212813+0000 mgr.a (mgr.14355) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:10:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:09.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:09 smithi007 bash[22722]: cluster 2024-09-13T23:10:07.772017+0000 mgr.a (mgr.14355) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:09.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:09 smithi131 bash[24745]: cluster 2024-09-13T23:10:07.772017+0000 mgr.a (mgr.14355) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:09.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:09 smithi171 bash[25040]: cluster 2024-09-13T23:10:07.772017+0000 mgr.a (mgr.14355) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:10.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:10 smithi131 bash[24745]: audit 2024-09-13T23:10:09.024972+0000 mgr.a (mgr.14355) 2133 : audit [DBG] from='client.58278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:10 smithi171 bash[25040]: audit 2024-09-13T23:10:09.024972+0000 mgr.a (mgr.14355) 2133 : audit [DBG] from='client.58278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:10 smithi007 bash[22722]: audit 2024-09-13T23:10:09.024972+0000 mgr.a (mgr.14355) 2133 : audit [DBG] from='client.58278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:11.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:11 smithi131 bash[24745]: cluster 2024-09-13T23:10:09.772882+0000 mgr.a (mgr.14355) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:11.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:11 smithi171 bash[25040]: cluster 2024-09-13T23:10:09.772882+0000 mgr.a (mgr.14355) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:11 smithi007 bash[22722]: cluster 2024-09-13T23:10:09.772882+0000 mgr.a (mgr.14355) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:13 smithi131 bash[24745]: cluster 2024-09-13T23:10:11.775175+0000 mgr.a (mgr.14355) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:13.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:13 smithi171 bash[25040]: cluster 2024-09-13T23:10:11.775175+0000 mgr.a (mgr.14355) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:13 smithi007 bash[22722]: cluster 2024-09-13T23:10:11.775175+0000 mgr.a (mgr.14355) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:15.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:15.228 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:15.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:15 smithi131 bash[24745]: cluster 2024-09-13T23:10:13.775956+0000 mgr.a (mgr.14355) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:15.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:15 smithi171 bash[25040]: cluster 2024-09-13T23:10:13.775956+0000 mgr.a (mgr.14355) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:15 smithi007 bash[22722]: cluster 2024-09-13T23:10:13.775956+0000 mgr.a (mgr.14355) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:16.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:16 smithi131 bash[24745]: audit 2024-09-13T23:10:14.790688+0000 mgr.a (mgr.14355) 2137 : audit [DBG] from='client.58353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:16.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:16 smithi171 bash[25040]: audit 2024-09-13T23:10:14.790688+0000 mgr.a (mgr.14355) 2137 : audit [DBG] from='client.58353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:16 smithi007 bash[22722]: audit 2024-09-13T23:10:14.790688+0000 mgr.a (mgr.14355) 2137 : audit [DBG] from='client.58353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:17.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:17 smithi131 bash[24745]: cluster 2024-09-13T23:10:15.778363+0000 mgr.a (mgr.14355) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:17.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:17 smithi171 bash[25040]: cluster 2024-09-13T23:10:15.778363+0000 mgr.a (mgr.14355) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:17 smithi007 bash[22722]: cluster 2024-09-13T23:10:15.778363+0000 mgr.a (mgr.14355) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:19.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:19 smithi131 bash[24745]: cluster 2024-09-13T23:10:17.779215+0000 mgr.a (mgr.14355) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:19.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:19 smithi171 bash[25040]: cluster 2024-09-13T23:10:17.779215+0000 mgr.a (mgr.14355) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:19 smithi007 bash[22722]: cluster 2024-09-13T23:10:17.779215+0000 mgr.a (mgr.14355) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:20.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:21.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:21 smithi131 bash[24745]: cluster 2024-09-13T23:10:19.780117+0000 mgr.a (mgr.14355) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:21 smithi131 bash[24745]: audit 2024-09-13T23:10:20.566145+0000 mgr.a (mgr.14355) 2141 : audit [DBG] from='client.58425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:21.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:21 smithi171 bash[25040]: cluster 2024-09-13T23:10:19.780117+0000 mgr.a (mgr.14355) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:21 smithi171 bash[25040]: audit 2024-09-13T23:10:20.566145+0000 mgr.a (mgr.14355) 2141 : audit [DBG] from='client.58425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:21 smithi007 bash[22722]: cluster 2024-09-13T23:10:19.780117+0000 mgr.a (mgr.14355) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:10:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:21 smithi007 bash[22722]: audit 2024-09-13T23:10:20.566145+0000 mgr.a (mgr.14355) 2141 : audit [DBG] from='client.58425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:23.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:23 smithi131 bash[24745]: cluster 2024-09-13T23:10:21.783014+0000 mgr.a (mgr.14355) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:23.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:23 smithi171 bash[25040]: cluster 2024-09-13T23:10:21.783014+0000 mgr.a (mgr.14355) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:23 smithi007 bash[22722]: cluster 2024-09-13T23:10:21.783014+0000 mgr.a (mgr.14355) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:10:25.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:25 smithi131 bash[24745]: cluster 2024-09-13T23:10:23.783818+0000 mgr.a (mgr.14355) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:10:25.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:25 smithi171 bash[25040]: cluster 2024-09-13T23:10:23.783818+0000 mgr.a (mgr.14355) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:10:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:25 smithi007 bash[22722]: cluster 2024-09-13T23:10:23.783818+0000 mgr.a (mgr.14355) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:10:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:26.782 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:26.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:27.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:27 smithi131 bash[24745]: cluster 2024-09-13T23:10:25.785811+0000 mgr.a (mgr.14355) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:27.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:27 smithi131 bash[24745]: audit 2024-09-13T23:10:26.338958+0000 mgr.a (mgr.14355) 2145 : audit [DBG] from='client.58503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:27.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:27 smithi171 bash[25040]: cluster 2024-09-13T23:10:25.785811+0000 mgr.a (mgr.14355) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:27.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:27 smithi171 bash[25040]: audit 2024-09-13T23:10:26.338958+0000 mgr.a (mgr.14355) 2145 : audit [DBG] from='client.58503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:27 smithi007 bash[22722]: cluster 2024-09-13T23:10:25.785811+0000 mgr.a (mgr.14355) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:27 smithi007 bash[22722]: audit 2024-09-13T23:10:26.338958+0000 mgr.a (mgr.14355) 2145 : audit [DBG] from='client.58503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:29.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:29 smithi131 bash[24745]: cluster 2024-09-13T23:10:27.786705+0000 mgr.a (mgr.14355) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:29.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:29 smithi171 bash[25040]: cluster 2024-09-13T23:10:27.786705+0000 mgr.a (mgr.14355) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:29.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:29 smithi007 bash[22722]: cluster 2024-09-13T23:10:27.786705+0000 mgr.a (mgr.14355) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:31.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:31 smithi131 bash[24745]: cluster 2024-09-13T23:10:29.787519+0000 mgr.a (mgr.14355) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:31.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:31.785 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:31.785 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:31.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:31 smithi171 bash[25040]: cluster 2024-09-13T23:10:29.787519+0000 mgr.a (mgr.14355) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:31 smithi007 bash[22722]: cluster 2024-09-13T23:10:29.787519+0000 mgr.a (mgr.14355) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:10:32.567 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:32.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:33.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:33 smithi131 bash[24745]: cluster 2024-09-13T23:10:31.788969+0000 mgr.a (mgr.14355) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:10:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:33 smithi131 bash[24745]: audit 2024-09-13T23:10:32.122580+0000 mgr.a (mgr.14355) 2149 : audit [DBG] from='client.58578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:33.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:33 smithi171 bash[25040]: cluster 2024-09-13T23:10:31.788969+0000 mgr.a (mgr.14355) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:10:33.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:33 smithi171 bash[25040]: audit 2024-09-13T23:10:32.122580+0000 mgr.a (mgr.14355) 2149 : audit [DBG] from='client.58578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:33 smithi007 bash[22722]: cluster 2024-09-13T23:10:31.788969+0000 mgr.a (mgr.14355) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:10:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:33 smithi007 bash[22722]: audit 2024-09-13T23:10:32.122580+0000 mgr.a (mgr.14355) 2149 : audit [DBG] from='client.58578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:35 smithi131 bash[24745]: cluster 2024-09-13T23:10:33.789808+0000 mgr.a (mgr.14355) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:35.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:35 smithi171 bash[25040]: cluster 2024-09-13T23:10:33.789808+0000 mgr.a (mgr.14355) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:35 smithi007 bash[22722]: cluster 2024-09-13T23:10:33.789808+0000 mgr.a (mgr.14355) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:37.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:37 smithi131 bash[24745]: cluster 2024-09-13T23:10:35.792045+0000 mgr.a (mgr.14355) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:37.793 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:37 smithi171 bash[25040]: cluster 2024-09-13T23:10:35.792045+0000 mgr.a (mgr.14355) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:37 smithi007 bash[22722]: cluster 2024-09-13T23:10:35.792045+0000 mgr.a (mgr.14355) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:38.332 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:39 smithi131 bash[24745]: cluster 2024-09-13T23:10:37.792782+0000 mgr.a (mgr.14355) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:39 smithi131 bash[24745]: audit 2024-09-13T23:10:37.908418+0000 mgr.a (mgr.14355) 2153 : audit [DBG] from='client.58650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:39 smithi171 bash[25040]: cluster 2024-09-13T23:10:37.792782+0000 mgr.a (mgr.14355) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:39 smithi171 bash[25040]: audit 2024-09-13T23:10:37.908418+0000 mgr.a (mgr.14355) 2153 : audit [DBG] from='client.58650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:39 smithi007 bash[22722]: cluster 2024-09-13T23:10:37.792782+0000 mgr.a (mgr.14355) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:39 smithi007 bash[22722]: audit 2024-09-13T23:10:37.908418+0000 mgr.a (mgr.14355) 2153 : audit [DBG] from='client.58650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:41 smithi171 bash[25040]: cluster 2024-09-13T23:10:39.793722+0000 mgr.a (mgr.14355) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:41 smithi007 bash[22722]: cluster 2024-09-13T23:10:39.793722+0000 mgr.a (mgr.14355) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:41 smithi131 bash[24745]: cluster 2024-09-13T23:10:39.793722+0000 mgr.a (mgr.14355) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:43.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:43.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:43.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:43.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:43 smithi171 bash[25040]: cluster 2024-09-13T23:10:41.796042+0000 mgr.a (mgr.14355) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:43 smithi007 bash[22722]: cluster 2024-09-13T23:10:41.796042+0000 mgr.a (mgr.14355) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:43 smithi131 bash[24745]: cluster 2024-09-13T23:10:41.796042+0000 mgr.a (mgr.14355) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:44.071 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:44 smithi007 bash[22722]: audit 2024-09-13T23:10:43.665817+0000 mgr.a (mgr.14355) 2156 : audit [DBG] from='client.58728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:45.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:44 smithi131 bash[24745]: audit 2024-09-13T23:10:43.665817+0000 mgr.a (mgr.14355) 2156 : audit [DBG] from='client.58728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:45.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:44 smithi171 bash[25040]: audit 2024-09-13T23:10:43.665817+0000 mgr.a (mgr.14355) 2156 : audit [DBG] from='client.58728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:45 smithi007 bash[22722]: cluster 2024-09-13T23:10:43.796754+0000 mgr.a (mgr.14355) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:45 smithi131 bash[24745]: cluster 2024-09-13T23:10:43.796754+0000 mgr.a (mgr.14355) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:46.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:45 smithi171 bash[25040]: cluster 2024-09-13T23:10:43.796754+0000 mgr.a (mgr.14355) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:47.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:47 smithi007 bash[22722]: cluster 2024-09-13T23:10:45.799051+0000 mgr.a (mgr.14355) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:47 smithi131 bash[24745]: cluster 2024-09-13T23:10:45.799051+0000 mgr.a (mgr.14355) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:47 smithi171 bash[25040]: cluster 2024-09-13T23:10:45.799051+0000 mgr.a (mgr.14355) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:49.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:49.824 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:49 smithi007 bash[22722]: cluster 2024-09-13T23:10:47.799821+0000 mgr.a (mgr.14355) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:49 smithi131 bash[24745]: cluster 2024-09-13T23:10:47.799821+0000 mgr.a (mgr.14355) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:49 smithi171 bash[25040]: cluster 2024-09-13T23:10:47.799821+0000 mgr.a (mgr.14355) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:50 smithi007 bash[22722]: audit 2024-09-13T23:10:49.405400+0000 mgr.a (mgr.14355) 2160 : audit [DBG] from='client.58803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:51.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:50 smithi131 bash[24745]: audit 2024-09-13T23:10:49.405400+0000 mgr.a (mgr.14355) 2160 : audit [DBG] from='client.58803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:51.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:50 smithi171 bash[25040]: audit 2024-09-13T23:10:49.405400+0000 mgr.a (mgr.14355) 2160 : audit [DBG] from='client.58803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:51 smithi007 bash[22722]: cluster 2024-09-13T23:10:49.800284+0000 mgr.a (mgr.14355) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:51 smithi131 bash[24745]: cluster 2024-09-13T23:10:49.800284+0000 mgr.a (mgr.14355) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:52.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:51 smithi171 bash[25040]: cluster 2024-09-13T23:10:49.800284+0000 mgr.a (mgr.14355) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:53 smithi007 bash[22722]: cluster 2024-09-13T23:10:51.802490+0000 mgr.a (mgr.14355) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:53 smithi131 bash[24745]: cluster 2024-09-13T23:10:51.802490+0000 mgr.a (mgr.14355) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:54.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:53 smithi171 bash[25040]: cluster 2024-09-13T23:10:51.802490+0000 mgr.a (mgr.14355) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:10:54.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:10:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:10:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:10:55.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:10:55.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:10:55.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:10:55.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:10:55.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:10:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:55 smithi007 bash[22722]: cluster 2024-09-13T23:10:53.803248+0000 mgr.a (mgr.14355) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:55 smithi131 bash[24745]: cluster 2024-09-13T23:10:53.803248+0000 mgr.a (mgr.14355) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:55 smithi171 bash[25040]: cluster 2024-09-13T23:10:53.803248+0000 mgr.a (mgr.14355) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:56 smithi007 bash[22722]: audit 2024-09-13T23:10:55.157187+0000 mgr.a (mgr.14355) 2164 : audit [DBG] from='client.58875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:57.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:56 smithi131 bash[24745]: audit 2024-09-13T23:10:55.157187+0000 mgr.a (mgr.14355) 2164 : audit [DBG] from='client.58875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:57.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:56 smithi171 bash[25040]: audit 2024-09-13T23:10:55.157187+0000 mgr.a (mgr.14355) 2164 : audit [DBG] from='client.58875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:57 smithi007 bash[22722]: cluster 2024-09-13T23:10:55.805748+0000 mgr.a (mgr.14355) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:57 smithi131 bash[24745]: cluster 2024-09-13T23:10:55.805748+0000 mgr.a (mgr.14355) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:58.043 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:57 smithi171 bash[25040]: cluster 2024-09-13T23:10:55.805748+0000 mgr.a (mgr.14355) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:10:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:10:59 smithi007 bash[22722]: cluster 2024-09-13T23:10:57.806562+0000 mgr.a (mgr.14355) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:10:59 smithi131 bash[24745]: cluster 2024-09-13T23:10:57.806562+0000 mgr.a (mgr.14355) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:10:59 smithi171 bash[25040]: cluster 2024-09-13T23:10:57.806562+0000 mgr.a (mgr.14355) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:00.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:00.573 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:00.573 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:01.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:01.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:01.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:01.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:01.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:01.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:01 smithi007 bash[22722]: cluster 2024-09-13T23:10:59.807322+0000 mgr.a (mgr.14355) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:01 smithi131 bash[24745]: cluster 2024-09-13T23:10:59.807322+0000 mgr.a (mgr.14355) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:01 smithi171 bash[25040]: cluster 2024-09-13T23:10:59.807322+0000 mgr.a (mgr.14355) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:02 smithi007 bash[22722]: audit 2024-09-13T23:11:00.912434+0000 mgr.a (mgr.14355) 2168 : audit [DBG] from='client.58953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:02 smithi131 bash[24745]: audit 2024-09-13T23:11:00.912434+0000 mgr.a (mgr.14355) 2168 : audit [DBG] from='client.58953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:02 smithi171 bash[25040]: audit 2024-09-13T23:11:00.912434+0000 mgr.a (mgr.14355) 2168 : audit [DBG] from='client.58953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:03 smithi007 bash[22722]: cluster 2024-09-13T23:11:01.809996+0000 mgr.a (mgr.14355) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:03 smithi131 bash[24745]: cluster 2024-09-13T23:11:01.809996+0000 mgr.a (mgr.14355) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:03 smithi171 bash[25040]: cluster 2024-09-13T23:11:01.809996+0000 mgr.a (mgr.14355) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:05 smithi007 bash[22722]: cluster 2024-09-13T23:11:03.810803+0000 mgr.a (mgr.14355) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:05 smithi131 bash[24745]: cluster 2024-09-13T23:11:03.810803+0000 mgr.a (mgr.14355) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:05 smithi171 bash[25040]: cluster 2024-09-13T23:11:03.810803+0000 mgr.a (mgr.14355) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:06.356 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:06 smithi007 bash[22722]: audit 2024-09-13T23:11:06.264137+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:07.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:06 smithi131 bash[24745]: audit 2024-09-13T23:11:06.264137+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:07.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:06 smithi171 bash[25040]: audit 2024-09-13T23:11:06.264137+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:07.123 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:07.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22972]: debug 2024-09-13T23:11:07.819+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22972]: debug 2024-09-13T23:11:07.819+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: cluster 2024-09-13T23:11:05.812811+0000 mgr.a (mgr.14355) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: audit 2024-09-13T23:11:06.691888+0000 mgr.a (mgr.14355) 2172 : audit [DBG] from='client.59028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: audit 2024-09-13T23:11:07.125259+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: audit 2024-09-13T23:11:07.126134+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: audit 2024-09-13T23:11:07.131407+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:07 smithi007 bash[22722]: audit 2024-09-13T23:11:07.133310+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:08.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: cluster 2024-09-13T23:11:05.812811+0000 mgr.a (mgr.14355) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: audit 2024-09-13T23:11:06.691888+0000 mgr.a (mgr.14355) 2172 : audit [DBG] from='client.59028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: audit 2024-09-13T23:11:07.125259+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: audit 2024-09-13T23:11:07.126134+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: audit 2024-09-13T23:11:07.131407+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:11:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:07 smithi131 bash[24745]: audit 2024-09-13T23:11:07.133310+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: cluster 2024-09-13T23:11:05.812811+0000 mgr.a (mgr.14355) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: audit 2024-09-13T23:11:06.691888+0000 mgr.a (mgr.14355) 2172 : audit [DBG] from='client.59028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: audit 2024-09-13T23:11:07.125259+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: audit 2024-09-13T23:11:07.126134+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: audit 2024-09-13T23:11:07.131407+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:11:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:07 smithi171 bash[25040]: audit 2024-09-13T23:11:07.133310+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:08.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:08 smithi007 bash[22722]: audit 2024-09-13T23:11:07.134314+0000 mgr.a (mgr.14355) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:09.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:08 smithi131 bash[24745]: audit 2024-09-13T23:11:07.134314+0000 mgr.a (mgr.14355) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:08 smithi171 bash[25040]: audit 2024-09-13T23:11:07.134314+0000 mgr.a (mgr.14355) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:11:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:09 smithi007 bash[22722]: cluster 2024-09-13T23:11:07.813419+0000 mgr.a (mgr.14355) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:09 smithi007 bash[22722]: audit 2024-09-13T23:11:07.822662+0000 mgr.a (mgr.14355) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:11:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:09 smithi007 bash[22722]: cephadm 2024-09-13T23:11:07.823832+0000 mgr.a (mgr.14355) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:11:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:09 smithi131 bash[24745]: cluster 2024-09-13T23:11:07.813419+0000 mgr.a (mgr.14355) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:09 smithi131 bash[24745]: audit 2024-09-13T23:11:07.822662+0000 mgr.a (mgr.14355) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:11:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:09 smithi131 bash[24745]: cephadm 2024-09-13T23:11:07.823832+0000 mgr.a (mgr.14355) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:11:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:09 smithi171 bash[25040]: cluster 2024-09-13T23:11:07.813419+0000 mgr.a (mgr.14355) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:09 smithi171 bash[25040]: audit 2024-09-13T23:11:07.822662+0000 mgr.a (mgr.14355) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:11:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:09 smithi171 bash[25040]: cephadm 2024-09-13T23:11:07.823832+0000 mgr.a (mgr.14355) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:11:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:11 smithi007 bash[22722]: cluster 2024-09-13T23:11:09.814160+0000 mgr.a (mgr.14355) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:12.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:11 smithi131 bash[24745]: cluster 2024-09-13T23:11:09.814160+0000 mgr.a (mgr.14355) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:11 smithi171 bash[25040]: cluster 2024-09-13T23:11:09.814160+0000 mgr.a (mgr.14355) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:12.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:12.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:13 smithi007 bash[22722]: cluster 2024-09-13T23:11:11.816488+0000 mgr.a (mgr.14355) 2178 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:13 smithi007 bash[22722]: audit 2024-09-13T23:11:12.457085+0000 mgr.a (mgr.14355) 2179 : audit [DBG] from='client.59211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:13 smithi131 bash[24745]: cluster 2024-09-13T23:11:11.816488+0000 mgr.a (mgr.14355) 2178 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:13 smithi131 bash[24745]: audit 2024-09-13T23:11:12.457085+0000 mgr.a (mgr.14355) 2179 : audit [DBG] from='client.59211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:13 smithi171 bash[25040]: cluster 2024-09-13T23:11:11.816488+0000 mgr.a (mgr.14355) 2178 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:14.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:13 smithi171 bash[25040]: audit 2024-09-13T23:11:12.457085+0000 mgr.a (mgr.14355) 2179 : audit [DBG] from='client.59211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:15 smithi007 bash[22722]: cluster 2024-09-13T23:11:13.817369+0000 mgr.a (mgr.14355) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:15 smithi131 bash[24745]: cluster 2024-09-13T23:11:13.817369+0000 mgr.a (mgr.14355) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:15 smithi171 bash[25040]: cluster 2024-09-13T23:11:13.817369+0000 mgr.a (mgr.14355) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:17.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:17.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:17 smithi007 bash[22722]: cluster 2024-09-13T23:11:15.820311+0000 mgr.a (mgr.14355) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:17 smithi131 bash[24745]: cluster 2024-09-13T23:11:15.820311+0000 mgr.a (mgr.14355) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:18.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:17 smithi171 bash[25040]: cluster 2024-09-13T23:11:15.820311+0000 mgr.a (mgr.14355) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:18.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:18.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:19 smithi007 bash[22722]: cluster 2024-09-13T23:11:17.821089+0000 mgr.a (mgr.14355) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:19 smithi007 bash[22722]: audit 2024-09-13T23:11:18.188539+0000 mgr.a (mgr.14355) 2183 : audit [DBG] from='client.59289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:19 smithi131 bash[24745]: cluster 2024-09-13T23:11:17.821089+0000 mgr.a (mgr.14355) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:19 smithi131 bash[24745]: audit 2024-09-13T23:11:18.188539+0000 mgr.a (mgr.14355) 2183 : audit [DBG] from='client.59289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:19 smithi171 bash[25040]: cluster 2024-09-13T23:11:17.821089+0000 mgr.a (mgr.14355) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:19 smithi171 bash[25040]: audit 2024-09-13T23:11:18.188539+0000 mgr.a (mgr.14355) 2183 : audit [DBG] from='client.59289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:21 smithi007 bash[22722]: cluster 2024-09-13T23:11:19.822021+0000 mgr.a (mgr.14355) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:22.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:21 smithi131 bash[24745]: cluster 2024-09-13T23:11:19.822021+0000 mgr.a (mgr.14355) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:21 smithi171 bash[25040]: cluster 2024-09-13T23:11:19.822021+0000 mgr.a (mgr.14355) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:23.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:23.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:23.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:23 smithi007 bash[22722]: cluster 2024-09-13T23:11:21.824319+0000 mgr.a (mgr.14355) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:24.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:23 smithi131 bash[24745]: cluster 2024-09-13T23:11:21.824319+0000 mgr.a (mgr.14355) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:24.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:23 smithi171 bash[25040]: cluster 2024-09-13T23:11:21.824319+0000 mgr.a (mgr.14355) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:11:24.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:24.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:25 smithi007 bash[22722]: cluster 2024-09-13T23:11:23.825014+0000 mgr.a (mgr.14355) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:25 smithi007 bash[22722]: audit 2024-09-13T23:11:23.952126+0000 mgr.a (mgr.14355) 2187 : audit [DBG] from='client.59364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:25 smithi131 bash[24745]: cluster 2024-09-13T23:11:23.825014+0000 mgr.a (mgr.14355) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:25 smithi131 bash[24745]: audit 2024-09-13T23:11:23.952126+0000 mgr.a (mgr.14355) 2187 : audit [DBG] from='client.59364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:25 smithi171 bash[25040]: cluster 2024-09-13T23:11:23.825014+0000 mgr.a (mgr.14355) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:25 smithi171 bash[25040]: audit 2024-09-13T23:11:23.952126+0000 mgr.a (mgr.14355) 2187 : audit [DBG] from='client.59364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:27 smithi007 bash[22722]: cluster 2024-09-13T23:11:25.827451+0000 mgr.a (mgr.14355) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:27 smithi131 bash[24745]: cluster 2024-09-13T23:11:25.827451+0000 mgr.a (mgr.14355) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:27 smithi171 bash[25040]: cluster 2024-09-13T23:11:25.827451+0000 mgr.a (mgr.14355) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:29.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:29 smithi007 bash[22722]: cluster 2024-09-13T23:11:27.828247+0000 mgr.a (mgr.14355) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:30.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:29 smithi131 bash[24745]: cluster 2024-09-13T23:11:27.828247+0000 mgr.a (mgr.14355) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:30.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:29 smithi171 bash[25040]: cluster 2024-09-13T23:11:27.828247+0000 mgr.a (mgr.14355) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:30.091 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:30.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:30 smithi007 bash[22722]: audit 2024-09-13T23:11:29.686573+0000 mgr.a (mgr.14355) 2190 : audit [DBG] from='client.59442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:31.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:30 smithi131 bash[24745]: audit 2024-09-13T23:11:29.686573+0000 mgr.a (mgr.14355) 2190 : audit [DBG] from='client.59442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:31.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:30 smithi171 bash[25040]: audit 2024-09-13T23:11:29.686573+0000 mgr.a (mgr.14355) 2190 : audit [DBG] from='client.59442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:31 smithi007 bash[22722]: cluster 2024-09-13T23:11:29.828798+0000 mgr.a (mgr.14355) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:32.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:31 smithi131 bash[24745]: cluster 2024-09-13T23:11:29.828798+0000 mgr.a (mgr.14355) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:31 smithi171 bash[25040]: cluster 2024-09-13T23:11:29.828798+0000 mgr.a (mgr.14355) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:33 smithi007 bash[22722]: cluster 2024-09-13T23:11:31.831129+0000 mgr.a (mgr.14355) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:33 smithi131 bash[24745]: cluster 2024-09-13T23:11:31.831129+0000 mgr.a (mgr.14355) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:34.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:33 smithi171 bash[25040]: cluster 2024-09-13T23:11:31.831129+0000 mgr.a (mgr.14355) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:35.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:35.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:35.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:35.840 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:35 smithi007 bash[22722]: cluster 2024-09-13T23:11:33.831910+0000 mgr.a (mgr.14355) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:36.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:35 smithi131 bash[24745]: cluster 2024-09-13T23:11:33.831910+0000 mgr.a (mgr.14355) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:36.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:35 smithi171 bash[25040]: cluster 2024-09-13T23:11:33.831910+0000 mgr.a (mgr.14355) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:36 smithi007 bash[22722]: audit 2024-09-13T23:11:35.428152+0000 mgr.a (mgr.14355) 2194 : audit [DBG] from='client.59520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:37.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:36 smithi131 bash[24745]: audit 2024-09-13T23:11:35.428152+0000 mgr.a (mgr.14355) 2194 : audit [DBG] from='client.59520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:37.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:36 smithi171 bash[25040]: audit 2024-09-13T23:11:35.428152+0000 mgr.a (mgr.14355) 2194 : audit [DBG] from='client.59520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:37 smithi007 bash[22722]: cluster 2024-09-13T23:11:35.833054+0000 mgr.a (mgr.14355) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:37 smithi131 bash[24745]: cluster 2024-09-13T23:11:35.833054+0000 mgr.a (mgr.14355) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:38.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:37 smithi171 bash[25040]: cluster 2024-09-13T23:11:35.833054+0000 mgr.a (mgr.14355) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:39 smithi007 bash[22722]: cluster 2024-09-13T23:11:37.833759+0000 mgr.a (mgr.14355) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:39 smithi131 bash[24745]: cluster 2024-09-13T23:11:37.833759+0000 mgr.a (mgr.14355) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:40.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:39 smithi171 bash[25040]: cluster 2024-09-13T23:11:37.833759+0000 mgr.a (mgr.14355) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:41.619 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:41.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:41.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:41.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:41.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:41 smithi131 bash[24745]: cluster 2024-09-13T23:11:39.834530+0000 mgr.a (mgr.14355) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:42.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:41 smithi171 bash[25040]: cluster 2024-09-13T23:11:39.834530+0000 mgr.a (mgr.14355) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:41 smithi007 bash[22722]: cluster 2024-09-13T23:11:39.834530+0000 mgr.a (mgr.14355) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:11:43.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:42 smithi131 bash[24745]: audit 2024-09-13T23:11:41.178967+0000 mgr.a (mgr.14355) 2198 : audit [DBG] from='client.59595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:43.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:42 smithi171 bash[25040]: audit 2024-09-13T23:11:41.178967+0000 mgr.a (mgr.14355) 2198 : audit [DBG] from='client.59595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:42 smithi007 bash[22722]: audit 2024-09-13T23:11:41.178967+0000 mgr.a (mgr.14355) 2198 : audit [DBG] from='client.59595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:43 smithi131 bash[24745]: cluster 2024-09-13T23:11:41.837330+0000 mgr.a (mgr.14355) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:43 smithi171 bash[25040]: cluster 2024-09-13T23:11:41.837330+0000 mgr.a (mgr.14355) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:43 smithi007 bash[22722]: cluster 2024-09-13T23:11:41.837330+0000 mgr.a (mgr.14355) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:45 smithi131 bash[24745]: cluster 2024-09-13T23:11:43.838159+0000 mgr.a (mgr.14355) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:46.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:45 smithi171 bash[25040]: cluster 2024-09-13T23:11:43.838159+0000 mgr.a (mgr.14355) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:45 smithi007 bash[22722]: cluster 2024-09-13T23:11:43.838159+0000 mgr.a (mgr.14355) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:11:46.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:46.622 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:46.622 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:47.360 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:47.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:47.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:47.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:47.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:47 smithi131 bash[24745]: cluster 2024-09-13T23:11:45.840191+0000 mgr.a (mgr.14355) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:47 smithi171 bash[25040]: cluster 2024-09-13T23:11:45.840191+0000 mgr.a (mgr.14355) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:47 smithi007 bash[22722]: cluster 2024-09-13T23:11:45.840191+0000 mgr.a (mgr.14355) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:49.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:48 smithi131 bash[24745]: audit 2024-09-13T23:11:46.956999+0000 mgr.a (mgr.14355) 2202 : audit [DBG] from='client.59670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:49.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:48 smithi171 bash[25040]: audit 2024-09-13T23:11:46.956999+0000 mgr.a (mgr.14355) 2202 : audit [DBG] from='client.59670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:49.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:48 smithi007 bash[22722]: audit 2024-09-13T23:11:46.956999+0000 mgr.a (mgr.14355) 2202 : audit [DBG] from='client.59670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:49 smithi131 bash[24745]: cluster 2024-09-13T23:11:47.841124+0000 mgr.a (mgr.14355) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:49 smithi171 bash[25040]: cluster 2024-09-13T23:11:47.841124+0000 mgr.a (mgr.14355) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:49 smithi007 bash[22722]: cluster 2024-09-13T23:11:47.841124+0000 mgr.a (mgr.14355) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:51 smithi131 bash[24745]: cluster 2024-09-13T23:11:49.841963+0000 mgr.a (mgr.14355) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:52.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:51 smithi171 bash[25040]: cluster 2024-09-13T23:11:49.841963+0000 mgr.a (mgr.14355) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:51 smithi007 bash[22722]: cluster 2024-09-13T23:11:49.841963+0000 mgr.a (mgr.14355) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:52.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:52.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:52.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:53.116 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:53.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:11:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:53 smithi131 bash[24745]: cluster 2024-09-13T23:11:51.844228+0000 mgr.a (mgr.14355) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:54.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:53 smithi131 bash[24745]: audit 2024-09-13T23:11:52.695968+0000 mgr.a (mgr.14355) 2206 : audit [DBG] from='client.59748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:53 smithi171 bash[25040]: cluster 2024-09-13T23:11:51.844228+0000 mgr.a (mgr.14355) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:53 smithi171 bash[25040]: audit 2024-09-13T23:11:52.695968+0000 mgr.a (mgr.14355) 2206 : audit [DBG] from='client.59748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:53 smithi007 bash[22722]: cluster 2024-09-13T23:11:51.844228+0000 mgr.a (mgr.14355) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:54.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:53 smithi007 bash[22722]: audit 2024-09-13T23:11:52.695968+0000 mgr.a (mgr.14355) 2206 : audit [DBG] from='client.59748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:55 smithi131 bash[24745]: cluster 2024-09-13T23:11:53.845215+0000 mgr.a (mgr.14355) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:55 smithi171 bash[25040]: cluster 2024-09-13T23:11:53.845215+0000 mgr.a (mgr.14355) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:55 smithi007 bash[22722]: cluster 2024-09-13T23:11:53.845215+0000 mgr.a (mgr.14355) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:11:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:57 smithi131 bash[24745]: cluster 2024-09-13T23:11:55.847499+0000 mgr.a (mgr.14355) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:57 smithi171 bash[25040]: cluster 2024-09-13T23:11:55.847499+0000 mgr.a (mgr.14355) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:58.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:11:58.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:11:58.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:11:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:57 smithi007 bash[22722]: cluster 2024-09-13T23:11:55.847499+0000 mgr.a (mgr.14355) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:11:58.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:11:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:11:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:11:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:11:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:59 smithi131 bash[24745]: cluster 2024-09-13T23:11:57.848400+0000 mgr.a (mgr.14355) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:11:59 smithi131 bash[24745]: audit 2024-09-13T23:11:58.454541+0000 mgr.a (mgr.14355) 2210 : audit [DBG] from='client.59823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:59 smithi171 bash[25040]: cluster 2024-09-13T23:11:57.848400+0000 mgr.a (mgr.14355) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:11:59 smithi171 bash[25040]: audit 2024-09-13T23:11:58.454541+0000 mgr.a (mgr.14355) 2210 : audit [DBG] from='client.59823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:59 smithi007 bash[22722]: cluster 2024-09-13T23:11:57.848400+0000 mgr.a (mgr.14355) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:11:59 smithi007 bash[22722]: audit 2024-09-13T23:11:58.454541+0000 mgr.a (mgr.14355) 2210 : audit [DBG] from='client.59823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:01 smithi131 bash[24745]: cluster 2024-09-13T23:11:59.849541+0000 mgr.a (mgr.14355) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:01 smithi171 bash[25040]: cluster 2024-09-13T23:11:59.849541+0000 mgr.a (mgr.14355) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:01 smithi007 bash[22722]: cluster 2024-09-13T23:11:59.849541+0000 mgr.a (mgr.14355) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:03.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:03.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:03.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:03 smithi131 bash[24745]: cluster 2024-09-13T23:12:01.851921+0000 mgr.a (mgr.14355) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-09-13T23:12:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:03 smithi171 bash[25040]: cluster 2024-09-13T23:12:01.851921+0000 mgr.a (mgr.14355) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-09-13T23:12:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:03 smithi007 bash[22722]: cluster 2024-09-13T23:12:01.851921+0000 mgr.a (mgr.14355) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-09-13T23:12:04.615 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:04.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:04.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:04.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:04.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:05.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:04 smithi007 bash[22722]: cluster 2024-09-13T23:12:03.852704+0000 mgr.a (mgr.14355) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:12:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:04 smithi007 bash[22722]: audit 2024-09-13T23:12:04.203195+0000 mgr.a (mgr.14355) 2214 : audit [DBG] from='client.59898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:05.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:04 smithi131 bash[24745]: cluster 2024-09-13T23:12:03.852704+0000 mgr.a (mgr.14355) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:12:05.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:04 smithi131 bash[24745]: audit 2024-09-13T23:12:04.203195+0000 mgr.a (mgr.14355) 2214 : audit [DBG] from='client.59898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:05.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:04 smithi171 bash[25040]: cluster 2024-09-13T23:12:03.852704+0000 mgr.a (mgr.14355) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:12:05.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:04 smithi171 bash[25040]: audit 2024-09-13T23:12:04.203195+0000 mgr.a (mgr.14355) 2214 : audit [DBG] from='client.59898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:07.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:06 smithi007 bash[22722]: cluster 2024-09-13T23:12:05.855119+0000 mgr.a (mgr.14355) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-13T23:12:07.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:06 smithi131 bash[24745]: cluster 2024-09-13T23:12:05.855119+0000 mgr.a (mgr.14355) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-13T23:12:07.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:06 smithi171 bash[25040]: cluster 2024-09-13T23:12:05.855119+0000 mgr.a (mgr.14355) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-13T23:12:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:07 smithi007 bash[22722]: audit 2024-09-13T23:12:07.874686+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:07 smithi131 bash[24745]: audit 2024-09-13T23:12:07.874686+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:08.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:07 smithi171 bash[25040]: audit 2024-09-13T23:12:07.874686+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: cluster 2024-09-13T23:12:07.855909+0000 mgr.a (mgr.14355) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: audit 2024-09-13T23:12:08.737461+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: audit 2024-09-13T23:12:08.739185+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: audit 2024-09-13T23:12:08.749369+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:12:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: audit 2024-09-13T23:12:08.754123+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:08 smithi007 bash[22722]: audit 2024-09-13T23:12:08.756374+0000 mgr.a (mgr.14355) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: cluster 2024-09-13T23:12:07.855909+0000 mgr.a (mgr.14355) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: audit 2024-09-13T23:12:08.737461+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: audit 2024-09-13T23:12:08.739185+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: audit 2024-09-13T23:12:08.749369+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: audit 2024-09-13T23:12:08.754123+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:08 smithi131 bash[24745]: audit 2024-09-13T23:12:08.756374+0000 mgr.a (mgr.14355) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: cluster 2024-09-13T23:12:07.855909+0000 mgr.a (mgr.14355) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: audit 2024-09-13T23:12:08.737461+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: audit 2024-09-13T23:12:08.739185+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: audit 2024-09-13T23:12:08.749369+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: audit 2024-09-13T23:12:08.754123+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:08 smithi171 bash[25040]: audit 2024-09-13T23:12:08.756374+0000 mgr.a (mgr.14355) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:12:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:09.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:09.930 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:12:09 smithi007 bash[22972]: debug 2024-09-13T23:12:09.466+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:12:09.930 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:12:09 smithi007 bash[22972]: debug 2024-09-13T23:12:09.466+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:12:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:09 smithi007 bash[22722]: audit 2024-09-13T23:12:09.472546+0000 mgr.a (mgr.14355) 2218 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:12:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:09 smithi007 bash[22722]: cephadm 2024-09-13T23:12:09.473870+0000 mgr.a (mgr.14355) 2219 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:12:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:09 smithi131 bash[24745]: audit 2024-09-13T23:12:09.472546+0000 mgr.a (mgr.14355) 2218 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:12:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:09 smithi131 bash[24745]: cephadm 2024-09-13T23:12:09.473870+0000 mgr.a (mgr.14355) 2219 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:12:10.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:09 smithi171 bash[25040]: audit 2024-09-13T23:12:09.472546+0000 mgr.a (mgr.14355) 2218 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:12:10.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:09 smithi171 bash[25040]: cephadm 2024-09-13T23:12:09.473870+0000 mgr.a (mgr.14355) 2219 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:12:10.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:11.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:10 smithi007 bash[22722]: cluster 2024-09-13T23:12:09.856810+0000 mgr.a (mgr.14355) 2220 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:11.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:10 smithi007 bash[22722]: audit 2024-09-13T23:12:09.956073+0000 mgr.a (mgr.14355) 2221 : audit [DBG] from='client.60078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:11.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:10 smithi131 bash[24745]: cluster 2024-09-13T23:12:09.856810+0000 mgr.a (mgr.14355) 2220 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:10 smithi131 bash[24745]: audit 2024-09-13T23:12:09.956073+0000 mgr.a (mgr.14355) 2221 : audit [DBG] from='client.60078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:10 smithi171 bash[25040]: cluster 2024-09-13T23:12:09.856810+0000 mgr.a (mgr.14355) 2220 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-09-13T23:12:11.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:10 smithi171 bash[25040]: audit 2024-09-13T23:12:09.956073+0000 mgr.a (mgr.14355) 2221 : audit [DBG] from='client.60078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:13.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:12 smithi007 bash[22722]: cluster 2024-09-13T23:12:11.859607+0000 mgr.a (mgr.14355) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:12:13.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:12 smithi131 bash[24745]: cluster 2024-09-13T23:12:11.859607+0000 mgr.a (mgr.14355) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:12:13.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:12 smithi171 bash[25040]: cluster 2024-09-13T23:12:11.859607+0000 mgr.a (mgr.14355) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-09-13T23:12:15.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:14 smithi007 bash[22722]: cluster 2024-09-13T23:12:13.860399+0000 mgr.a (mgr.14355) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-13T23:12:15.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:14 smithi131 bash[24745]: cluster 2024-09-13T23:12:13.860399+0000 mgr.a (mgr.14355) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-13T23:12:15.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:14 smithi171 bash[25040]: cluster 2024-09-13T23:12:13.860399+0000 mgr.a (mgr.14355) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 16 op/s 2024-09-13T23:12:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:16.171 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:15 smithi007 bash[22722]: audit 2024-09-13T23:12:15.737180+0000 mgr.a (mgr.14355) 2224 : audit [DBG] from='client.60153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:16.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:15 smithi131 bash[24745]: audit 2024-09-13T23:12:15.737180+0000 mgr.a (mgr.14355) 2224 : audit [DBG] from='client.60153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:16.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:15 smithi171 bash[25040]: audit 2024-09-13T23:12:15.737180+0000 mgr.a (mgr.14355) 2224 : audit [DBG] from='client.60153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:17.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:16 smithi007 bash[22722]: cluster 2024-09-13T23:12:15.861668+0000 mgr.a (mgr.14355) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-13T23:12:17.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:16 smithi131 bash[24745]: cluster 2024-09-13T23:12:15.861668+0000 mgr.a (mgr.14355) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-13T23:12:17.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:16 smithi171 bash[25040]: cluster 2024-09-13T23:12:15.861668+0000 mgr.a (mgr.14355) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-13T23:12:19.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:18 smithi131 bash[24745]: cluster 2024-09-13T23:12:17.862578+0000 mgr.a (mgr.14355) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:19.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:18 smithi171 bash[25040]: cluster 2024-09-13T23:12:17.862578+0000 mgr.a (mgr.14355) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:19.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:18 smithi007 bash[22722]: cluster 2024-09-13T23:12:17.862578+0000 mgr.a (mgr.14355) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:21.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:20 smithi131 bash[24745]: cluster 2024-09-13T23:12:19.863377+0000 mgr.a (mgr.14355) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:21.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:20 smithi171 bash[25040]: cluster 2024-09-13T23:12:19.863377+0000 mgr.a (mgr.14355) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:21.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:20 smithi007 bash[22722]: cluster 2024-09-13T23:12:19.863377+0000 mgr.a (mgr.14355) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:12:21.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:21.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:21.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:21.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:21.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:22.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:21 smithi131 bash[24745]: audit 2024-09-13T23:12:21.497767+0000 mgr.a (mgr.14355) 2228 : audit [DBG] from='client.60231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:22.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:21 smithi171 bash[25040]: audit 2024-09-13T23:12:21.497767+0000 mgr.a (mgr.14355) 2228 : audit [DBG] from='client.60231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:21 smithi007 bash[22722]: audit 2024-09-13T23:12:21.497767+0000 mgr.a (mgr.14355) 2228 : audit [DBG] from='client.60231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:23.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:22 smithi131 bash[24745]: cluster 2024-09-13T23:12:21.864672+0000 mgr.a (mgr.14355) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:12:23.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:22 smithi171 bash[25040]: cluster 2024-09-13T23:12:21.864672+0000 mgr.a (mgr.14355) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:12:23.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:22 smithi007 bash[22722]: cluster 2024-09-13T23:12:21.864672+0000 mgr.a (mgr.14355) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:12:25.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:24 smithi131 bash[24745]: cluster 2024-09-13T23:12:23.865554+0000 mgr.a (mgr.14355) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:12:25.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:24 smithi171 bash[25040]: cluster 2024-09-13T23:12:23.865554+0000 mgr.a (mgr.14355) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:12:25.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:24 smithi007 bash[22722]: cluster 2024-09-13T23:12:23.865554+0000 mgr.a (mgr.14355) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:12:26.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:26.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:26.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:27.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:26 smithi131 bash[24745]: cluster 2024-09-13T23:12:25.867585+0000 mgr.a (mgr.14355) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:12:27.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:26 smithi171 bash[25040]: cluster 2024-09-13T23:12:25.867585+0000 mgr.a (mgr.14355) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:12:27.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:26 smithi007 bash[22722]: cluster 2024-09-13T23:12:25.867585+0000 mgr.a (mgr.14355) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:12:27.646 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:27.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:28.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:27 smithi131 bash[24745]: audit 2024-09-13T23:12:27.241054+0000 mgr.a (mgr.14355) 2232 : audit [DBG] from='client.60309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:28.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:27 smithi171 bash[25040]: audit 2024-09-13T23:12:27.241054+0000 mgr.a (mgr.14355) 2232 : audit [DBG] from='client.60309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:27 smithi007 bash[22722]: audit 2024-09-13T23:12:27.241054+0000 mgr.a (mgr.14355) 2232 : audit [DBG] from='client.60309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:29.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:28 smithi131 bash[24745]: cluster 2024-09-13T23:12:27.868486+0000 mgr.a (mgr.14355) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:29.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:28 smithi171 bash[25040]: cluster 2024-09-13T23:12:27.868486+0000 mgr.a (mgr.14355) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:29.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:28 smithi007 bash[22722]: cluster 2024-09-13T23:12:27.868486+0000 mgr.a (mgr.14355) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:31.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:30 smithi131 bash[24745]: cluster 2024-09-13T23:12:29.869401+0000 mgr.a (mgr.14355) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:31.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:30 smithi171 bash[25040]: cluster 2024-09-13T23:12:29.869401+0000 mgr.a (mgr.14355) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:31.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:30 smithi007 bash[22722]: cluster 2024-09-13T23:12:29.869401+0000 mgr.a (mgr.14355) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:32.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:32.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:32.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:33.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:32 smithi131 bash[24745]: cluster 2024-09-13T23:12:31.871704+0000 mgr.a (mgr.14355) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:33.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:32 smithi171 bash[25040]: cluster 2024-09-13T23:12:31.871704+0000 mgr.a (mgr.14355) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:33.396 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:33.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:32 smithi007 bash[22722]: cluster 2024-09-13T23:12:31.871704+0000 mgr.a (mgr.14355) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:34.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:34 smithi131 bash[24745]: audit 2024-09-13T23:12:32.971554+0000 mgr.a (mgr.14355) 2236 : audit [DBG] from='client.60384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:34.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:34 smithi171 bash[25040]: audit 2024-09-13T23:12:32.971554+0000 mgr.a (mgr.14355) 2236 : audit [DBG] from='client.60384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:33 smithi007 bash[22722]: audit 2024-09-13T23:12:32.971554+0000 mgr.a (mgr.14355) 2236 : audit [DBG] from='client.60384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:35.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:35 smithi131 bash[24745]: cluster 2024-09-13T23:12:33.872671+0000 mgr.a (mgr.14355) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:35.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:35 smithi171 bash[25040]: cluster 2024-09-13T23:12:33.872671+0000 mgr.a (mgr.14355) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:35.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:35 smithi007 bash[22722]: cluster 2024-09-13T23:12:33.872671+0000 mgr.a (mgr.14355) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:37.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:37 smithi131 bash[24745]: cluster 2024-09-13T23:12:35.874877+0000 mgr.a (mgr.14355) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:37.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:37 smithi171 bash[25040]: cluster 2024-09-13T23:12:35.874877+0000 mgr.a (mgr.14355) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:37 smithi007 bash[22722]: cluster 2024-09-13T23:12:35.874877+0000 mgr.a (mgr.14355) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:39.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:39.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:39.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:39.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:39.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:39 smithi131 bash[24745]: cluster 2024-09-13T23:12:37.875629+0000 mgr.a (mgr.14355) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:39.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:39 smithi131 bash[24745]: audit 2024-09-13T23:12:38.733387+0000 mgr.a (mgr.14355) 2240 : audit [DBG] from='client.60462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:39.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:39 smithi171 bash[25040]: cluster 2024-09-13T23:12:37.875629+0000 mgr.a (mgr.14355) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:39.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:39 smithi171 bash[25040]: audit 2024-09-13T23:12:38.733387+0000 mgr.a (mgr.14355) 2240 : audit [DBG] from='client.60462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:39.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:39 smithi007 bash[22722]: cluster 2024-09-13T23:12:37.875629+0000 mgr.a (mgr.14355) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:39.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:39 smithi007 bash[22722]: audit 2024-09-13T23:12:38.733387+0000 mgr.a (mgr.14355) 2240 : audit [DBG] from='client.60462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:41.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:41 smithi131 bash[24745]: cluster 2024-09-13T23:12:39.876562+0000 mgr.a (mgr.14355) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:41.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:41 smithi171 bash[25040]: cluster 2024-09-13T23:12:39.876562+0000 mgr.a (mgr.14355) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:41.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:41 smithi007 bash[22722]: cluster 2024-09-13T23:12:39.876562+0000 mgr.a (mgr.14355) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:43.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:43 smithi131 bash[24745]: cluster 2024-09-13T23:12:41.878831+0000 mgr.a (mgr.14355) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:43 smithi171 bash[25040]: cluster 2024-09-13T23:12:41.878831+0000 mgr.a (mgr.14355) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:43.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:43 smithi007 bash[22722]: cluster 2024-09-13T23:12:41.878831+0000 mgr.a (mgr.14355) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:44.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:44.912 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:44.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:45.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:45 smithi131 bash[24745]: cluster 2024-09-13T23:12:43.879737+0000 mgr.a (mgr.14355) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:45.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:45 smithi131 bash[24745]: audit 2024-09-13T23:12:44.481558+0000 mgr.a (mgr.14355) 2244 : audit [DBG] from='client.60540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:45.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:45 smithi171 bash[25040]: cluster 2024-09-13T23:12:43.879737+0000 mgr.a (mgr.14355) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:45.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:45 smithi171 bash[25040]: audit 2024-09-13T23:12:44.481558+0000 mgr.a (mgr.14355) 2244 : audit [DBG] from='client.60540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:45.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:45 smithi007 bash[22722]: cluster 2024-09-13T23:12:43.879737+0000 mgr.a (mgr.14355) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:45 smithi007 bash[22722]: audit 2024-09-13T23:12:44.481558+0000 mgr.a (mgr.14355) 2244 : audit [DBG] from='client.60540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:47.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:47 smithi171 bash[25040]: cluster 2024-09-13T23:12:45.882232+0000 mgr.a (mgr.14355) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:47.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:47 smithi007 bash[22722]: cluster 2024-09-13T23:12:45.882232+0000 mgr.a (mgr.14355) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:47.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:47 smithi131 bash[24745]: cluster 2024-09-13T23:12:45.882232+0000 mgr.a (mgr.14355) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:12:49.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:49 smithi171 bash[25040]: cluster 2024-09-13T23:12:47.883238+0000 mgr.a (mgr.14355) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:49.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:49 smithi007 bash[22722]: cluster 2024-09-13T23:12:47.883238+0000 mgr.a (mgr.14355) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:49.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:49 smithi131 bash[24745]: cluster 2024-09-13T23:12:47.883238+0000 mgr.a (mgr.14355) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:49.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:50.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:51.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:51 smithi171 bash[25040]: cluster 2024-09-13T23:12:49.884127+0000 mgr.a (mgr.14355) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:51.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:51 smithi171 bash[25040]: audit 2024-09-13T23:12:50.253880+0000 mgr.a (mgr.14355) 2248 : audit [DBG] from='client.60615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:51 smithi007 bash[22722]: cluster 2024-09-13T23:12:49.884127+0000 mgr.a (mgr.14355) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:51 smithi007 bash[22722]: audit 2024-09-13T23:12:50.253880+0000 mgr.a (mgr.14355) 2248 : audit [DBG] from='client.60615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:51.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:51 smithi131 bash[24745]: cluster 2024-09-13T23:12:49.884127+0000 mgr.a (mgr.14355) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:51.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:51 smithi131 bash[24745]: audit 2024-09-13T23:12:50.253880+0000 mgr.a (mgr.14355) 2248 : audit [DBG] from='client.60615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:53.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:53 smithi007 bash[22722]: cluster 2024-09-13T23:12:51.886967+0000 mgr.a (mgr.14355) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:53.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:53 smithi131 bash[24745]: cluster 2024-09-13T23:12:51.886967+0000 mgr.a (mgr.14355) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:53.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:53 smithi171 bash[25040]: cluster 2024-09-13T23:12:51.886967+0000 mgr.a (mgr.14355) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:55 smithi007 bash[22722]: cluster 2024-09-13T23:12:53.887915+0000 mgr.a (mgr.14355) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:12:55.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:55 smithi131 bash[24745]: cluster 2024-09-13T23:12:53.887915+0000 mgr.a (mgr.14355) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:12:55.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:55 smithi171 bash[25040]: cluster 2024-09-13T23:12:53.887915+0000 mgr.a (mgr.14355) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:12:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:12:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:12:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:12:56.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:12:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:12:56.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:12:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:12:56.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:12:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:57 smithi007 bash[22722]: cluster 2024-09-13T23:12:55.890093+0000 mgr.a (mgr.14355) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:57 smithi007 bash[22722]: audit 2024-09-13T23:12:56.020772+0000 mgr.a (mgr.14355) 2252 : audit [DBG] from='client.60693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:57.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:57 smithi131 bash[24745]: cluster 2024-09-13T23:12:55.890093+0000 mgr.a (mgr.14355) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:57.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:57 smithi131 bash[24745]: audit 2024-09-13T23:12:56.020772+0000 mgr.a (mgr.14355) 2252 : audit [DBG] from='client.60693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:57.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:57 smithi171 bash[25040]: cluster 2024-09-13T23:12:55.890093+0000 mgr.a (mgr.14355) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:12:57.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:57 smithi171 bash[25040]: audit 2024-09-13T23:12:56.020772+0000 mgr.a (mgr.14355) 2252 : audit [DBG] from='client.60693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:59.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:12:59 smithi007 bash[22722]: cluster 2024-09-13T23:12:57.890986+0000 mgr.a (mgr.14355) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:12:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:12:59 smithi131 bash[24745]: cluster 2024-09-13T23:12:57.890986+0000 mgr.a (mgr.14355) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:12:59.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:12:59 smithi171 bash[25040]: cluster 2024-09-13T23:12:57.890986+0000 mgr.a (mgr.14355) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:01.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:01 smithi007 bash[22722]: cluster 2024-09-13T23:12:59.891760+0000 mgr.a (mgr.14355) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:01.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:01.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:01.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:01.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:01 smithi131 bash[24745]: cluster 2024-09-13T23:12:59.891760+0000 mgr.a (mgr.14355) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:01.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:01 smithi171 bash[25040]: cluster 2024-09-13T23:12:59.891760+0000 mgr.a (mgr.14355) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:02.202 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:02.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:02.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:02.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:02.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:03.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:03 smithi007 bash[22722]: audit 2024-09-13T23:13:01.788305+0000 mgr.a (mgr.14355) 2255 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:03 smithi007 bash[22722]: cluster 2024-09-13T23:13:01.893024+0000 mgr.a (mgr.14355) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:03 smithi131 bash[24745]: audit 2024-09-13T23:13:01.788305+0000 mgr.a (mgr.14355) 2255 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:03 smithi131 bash[24745]: cluster 2024-09-13T23:13:01.893024+0000 mgr.a (mgr.14355) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:03 smithi171 bash[25040]: audit 2024-09-13T23:13:01.788305+0000 mgr.a (mgr.14355) 2255 : audit [DBG] from='client.60771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:03 smithi171 bash[25040]: cluster 2024-09-13T23:13:01.893024+0000 mgr.a (mgr.14355) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:05.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:05 smithi007 bash[22722]: cluster 2024-09-13T23:13:03.893909+0000 mgr.a (mgr.14355) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:05.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:05 smithi131 bash[24745]: cluster 2024-09-13T23:13:03.893909+0000 mgr.a (mgr.14355) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:05.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:05 smithi171 bash[25040]: cluster 2024-09-13T23:13:03.893909+0000 mgr.a (mgr.14355) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:07.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:07.204 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:07.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:07 smithi007 bash[22722]: cluster 2024-09-13T23:13:05.896133+0000 mgr.a (mgr.14355) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:07 smithi131 bash[24745]: cluster 2024-09-13T23:13:05.896133+0000 mgr.a (mgr.14355) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:07.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:07 smithi171 bash[25040]: cluster 2024-09-13T23:13:05.896133+0000 mgr.a (mgr.14355) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:07.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:08 smithi007 bash[22722]: audit 2024-09-13T23:13:07.533842+0000 mgr.a (mgr.14355) 2259 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:08.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:08 smithi131 bash[24745]: audit 2024-09-13T23:13:07.533842+0000 mgr.a (mgr.14355) 2259 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:08 smithi171 bash[25040]: audit 2024-09-13T23:13:07.533842+0000 mgr.a (mgr.14355) 2259 : audit [DBG] from='client.60849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:09.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:09 smithi007 bash[22722]: cluster 2024-09-13T23:13:07.896660+0000 mgr.a (mgr.14355) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:09.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:09 smithi131 bash[24745]: cluster 2024-09-13T23:13:07.896660+0000 mgr.a (mgr.14355) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:09.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:09 smithi171 bash[25040]: cluster 2024-09-13T23:13:07.896660+0000 mgr.a (mgr.14355) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:10 smithi007 bash[22722]: audit 2024-09-13T23:13:09.527675+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:10.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:10 smithi131 bash[24745]: audit 2024-09-13T23:13:09.527675+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:10.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:10 smithi171 bash[25040]: audit 2024-09-13T23:13:09.527675+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:11.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22972]: debug 2024-09-13T23:13:11.141+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:13:11.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22972]: debug 2024-09-13T23:13:11.145+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:13:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: cluster 2024-09-13T23:13:09.897346+0000 mgr.a (mgr.14355) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: audit 2024-09-13T23:13:10.410764+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: audit 2024-09-13T23:13:10.412216+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: audit 2024-09-13T23:13:10.421876+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:13:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: audit 2024-09-13T23:13:10.426848+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:11.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:11 smithi007 bash[22722]: audit 2024-09-13T23:13:10.429193+0000 mgr.a (mgr.14355) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: cluster 2024-09-13T23:13:09.897346+0000 mgr.a (mgr.14355) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: audit 2024-09-13T23:13:10.410764+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: audit 2024-09-13T23:13:10.412216+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: audit 2024-09-13T23:13:10.421876+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:13:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: audit 2024-09-13T23:13:10.426848+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:11 smithi131 bash[24745]: audit 2024-09-13T23:13:10.429193+0000 mgr.a (mgr.14355) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: cluster 2024-09-13T23:13:09.897346+0000 mgr.a (mgr.14355) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: audit 2024-09-13T23:13:10.410764+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: audit 2024-09-13T23:13:10.412216+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: audit 2024-09-13T23:13:10.421876+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:13:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: audit 2024-09-13T23:13:10.426848+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:11 smithi171 bash[25040]: audit 2024-09-13T23:13:10.429193+0000 mgr.a (mgr.14355) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:13:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:12 smithi007 bash[22722]: audit 2024-09-13T23:13:11.146135+0000 mgr.a (mgr.14355) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:13:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:12 smithi007 bash[22722]: cephadm 2024-09-13T23:13:11.147268+0000 mgr.a (mgr.14355) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:13:12.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:12 smithi131 bash[24745]: audit 2024-09-13T23:13:11.146135+0000 mgr.a (mgr.14355) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:13:12.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:12 smithi131 bash[24745]: cephadm 2024-09-13T23:13:11.147268+0000 mgr.a (mgr.14355) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:13:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:12 smithi171 bash[25040]: audit 2024-09-13T23:13:11.146135+0000 mgr.a (mgr.14355) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:13:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:12 smithi171 bash[25040]: cephadm 2024-09-13T23:13:11.147268+0000 mgr.a (mgr.14355) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:13:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:13.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:13 smithi007 bash[22722]: cluster 2024-09-13T23:13:11.900092+0000 mgr.a (mgr.14355) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:13.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:13 smithi131 bash[24745]: cluster 2024-09-13T23:13:11.900092+0000 mgr.a (mgr.14355) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:13.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:13 smithi171 bash[25040]: cluster 2024-09-13T23:13:11.900092+0000 mgr.a (mgr.14355) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:13.721 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:13.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:13.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:13.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:13.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:14.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:14 smithi007 bash[22722]: audit 2024-09-13T23:13:13.287299+0000 mgr.a (mgr.14355) 2266 : audit [DBG] from='client.61035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:14.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:14 smithi131 bash[24745]: audit 2024-09-13T23:13:13.287299+0000 mgr.a (mgr.14355) 2266 : audit [DBG] from='client.61035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:14.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:14 smithi171 bash[25040]: audit 2024-09-13T23:13:13.287299+0000 mgr.a (mgr.14355) 2266 : audit [DBG] from='client.61035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:15.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:15 smithi007 bash[22722]: cluster 2024-09-13T23:13:13.901018+0000 mgr.a (mgr.14355) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:15.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:15 smithi131 bash[24745]: cluster 2024-09-13T23:13:13.901018+0000 mgr.a (mgr.14355) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:15.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:15 smithi171 bash[25040]: cluster 2024-09-13T23:13:13.901018+0000 mgr.a (mgr.14355) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:17.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:17 smithi007 bash[22722]: cluster 2024-09-13T23:13:15.903266+0000 mgr.a (mgr.14355) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:17.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:17 smithi131 bash[24745]: cluster 2024-09-13T23:13:15.903266+0000 mgr.a (mgr.14355) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:17.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:17 smithi171 bash[25040]: cluster 2024-09-13T23:13:15.903266+0000 mgr.a (mgr.14355) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:18.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:18.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:18.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:19.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:19 smithi007 bash[22722]: cluster 2024-09-13T23:13:17.904031+0000 mgr.a (mgr.14355) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:19.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:19.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:19.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:19.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:19.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:19.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:19 smithi131 bash[24745]: cluster 2024-09-13T23:13:17.904031+0000 mgr.a (mgr.14355) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:19.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:19 smithi171 bash[25040]: cluster 2024-09-13T23:13:17.904031+0000 mgr.a (mgr.14355) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:20 smithi007 bash[22722]: audit 2024-09-13T23:13:19.061444+0000 mgr.a (mgr.14355) 2270 : audit [DBG] from='client.61110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:20.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:20 smithi131 bash[24745]: audit 2024-09-13T23:13:19.061444+0000 mgr.a (mgr.14355) 2270 : audit [DBG] from='client.61110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:20.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:20 smithi171 bash[25040]: audit 2024-09-13T23:13:19.061444+0000 mgr.a (mgr.14355) 2270 : audit [DBG] from='client.61110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:21.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:21 smithi007 bash[22722]: cluster 2024-09-13T23:13:19.904978+0000 mgr.a (mgr.14355) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:21.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:21 smithi131 bash[24745]: cluster 2024-09-13T23:13:19.904978+0000 mgr.a (mgr.14355) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:21.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:21 smithi171 bash[25040]: cluster 2024-09-13T23:13:19.904978+0000 mgr.a (mgr.14355) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:23.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:23 smithi007 bash[22722]: cluster 2024-09-13T23:13:21.907260+0000 mgr.a (mgr.14355) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:23.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:23 smithi131 bash[24745]: cluster 2024-09-13T23:13:21.907260+0000 mgr.a (mgr.14355) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:23.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:23 smithi171 bash[25040]: cluster 2024-09-13T23:13:21.907260+0000 mgr.a (mgr.14355) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:24.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:24.492 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:25.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:25.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:25 smithi007 bash[22722]: cluster 2024-09-13T23:13:23.908094+0000 mgr.a (mgr.14355) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:25.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:25 smithi131 bash[24745]: cluster 2024-09-13T23:13:23.908094+0000 mgr.a (mgr.14355) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:25.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:25 smithi171 bash[25040]: cluster 2024-09-13T23:13:23.908094+0000 mgr.a (mgr.14355) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:26 smithi007 bash[22722]: audit 2024-09-13T23:13:24.827885+0000 mgr.a (mgr.14355) 2274 : audit [DBG] from='client.61185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:26.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:26 smithi131 bash[24745]: audit 2024-09-13T23:13:24.827885+0000 mgr.a (mgr.14355) 2274 : audit [DBG] from='client.61185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:26.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:26 smithi171 bash[25040]: audit 2024-09-13T23:13:24.827885+0000 mgr.a (mgr.14355) 2274 : audit [DBG] from='client.61185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:27.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:27 smithi007 bash[22722]: cluster 2024-09-13T23:13:25.910687+0000 mgr.a (mgr.14355) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:27.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:27 smithi131 bash[24745]: cluster 2024-09-13T23:13:25.910687+0000 mgr.a (mgr.14355) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:27.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:27 smithi171 bash[25040]: cluster 2024-09-13T23:13:25.910687+0000 mgr.a (mgr.14355) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:13:29.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:29 smithi007 bash[22722]: cluster 2024-09-13T23:13:27.911645+0000 mgr.a (mgr.14355) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:29.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:29 smithi131 bash[24745]: cluster 2024-09-13T23:13:27.911645+0000 mgr.a (mgr.14355) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:29.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:29 smithi171 bash[25040]: cluster 2024-09-13T23:13:27.911645+0000 mgr.a (mgr.14355) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:31.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:31.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:31.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:31 smithi007 bash[22722]: cluster 2024-09-13T23:13:29.912591+0000 mgr.a (mgr.14355) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:31.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:31 smithi007 bash[22722]: audit 2024-09-13T23:13:30.590698+0000 mgr.a (mgr.14355) 2278 : audit [DBG] from='client.61260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:31.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:31 smithi131 bash[24745]: cluster 2024-09-13T23:13:29.912591+0000 mgr.a (mgr.14355) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:31.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:31 smithi131 bash[24745]: audit 2024-09-13T23:13:30.590698+0000 mgr.a (mgr.14355) 2278 : audit [DBG] from='client.61260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:31.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:31 smithi171 bash[25040]: cluster 2024-09-13T23:13:29.912591+0000 mgr.a (mgr.14355) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:13:31.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:31 smithi171 bash[25040]: audit 2024-09-13T23:13:30.590698+0000 mgr.a (mgr.14355) 2278 : audit [DBG] from='client.61260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:33.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:33 smithi007 bash[22722]: cluster 2024-09-13T23:13:31.915332+0000 mgr.a (mgr.14355) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:33.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:33 smithi131 bash[24745]: cluster 2024-09-13T23:13:31.915332+0000 mgr.a (mgr.14355) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:33.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:33 smithi171 bash[25040]: cluster 2024-09-13T23:13:31.915332+0000 mgr.a (mgr.14355) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:35.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:35 smithi007 bash[22722]: cluster 2024-09-13T23:13:33.916121+0000 mgr.a (mgr.14355) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:35.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:35 smithi131 bash[24745]: cluster 2024-09-13T23:13:33.916121+0000 mgr.a (mgr.14355) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:35.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:35 smithi171 bash[25040]: cluster 2024-09-13T23:13:33.916121+0000 mgr.a (mgr.14355) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:13:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:36.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:36.749 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:37 smithi007 bash[22722]: cluster 2024-09-13T23:13:35.918108+0000 mgr.a (mgr.14355) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:37 smithi007 bash[22722]: audit 2024-09-13T23:13:36.342599+0000 mgr.a (mgr.14355) 2282 : audit [DBG] from='client.61338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:37.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:37 smithi131 bash[24745]: cluster 2024-09-13T23:13:35.918108+0000 mgr.a (mgr.14355) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:37.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:37 smithi131 bash[24745]: audit 2024-09-13T23:13:36.342599+0000 mgr.a (mgr.14355) 2282 : audit [DBG] from='client.61338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:37.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:37 smithi171 bash[25040]: cluster 2024-09-13T23:13:35.918108+0000 mgr.a (mgr.14355) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:37.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:37 smithi171 bash[25040]: audit 2024-09-13T23:13:36.342599+0000 mgr.a (mgr.14355) 2282 : audit [DBG] from='client.61338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:39.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:39 smithi007 bash[22722]: cluster 2024-09-13T23:13:37.918999+0000 mgr.a (mgr.14355) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:39.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:39 smithi131 bash[24745]: cluster 2024-09-13T23:13:37.918999+0000 mgr.a (mgr.14355) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:39.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:39 smithi171 bash[25040]: cluster 2024-09-13T23:13:37.918999+0000 mgr.a (mgr.14355) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:41.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:41 smithi007 bash[22722]: cluster 2024-09-13T23:13:39.919771+0000 mgr.a (mgr.14355) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:41.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:41 smithi131 bash[24745]: cluster 2024-09-13T23:13:39.919771+0000 mgr.a (mgr.14355) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:41.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:41 smithi171 bash[25040]: cluster 2024-09-13T23:13:39.919771+0000 mgr.a (mgr.14355) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:13:41.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:41.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:41.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:42.519 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:42.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:42.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:42.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:42.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:43.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:43 smithi007 bash[22722]: cluster 2024-09-13T23:13:41.921955+0000 mgr.a (mgr.14355) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:13:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:43 smithi007 bash[22722]: audit 2024-09-13T23:13:42.084137+0000 mgr.a (mgr.14355) 2286 : audit [DBG] from='client.61416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:43.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:43 smithi131 bash[24745]: cluster 2024-09-13T23:13:41.921955+0000 mgr.a (mgr.14355) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:13:43.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:43 smithi131 bash[24745]: audit 2024-09-13T23:13:42.084137+0000 mgr.a (mgr.14355) 2286 : audit [DBG] from='client.61416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:43.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:43 smithi171 bash[25040]: cluster 2024-09-13T23:13:41.921955+0000 mgr.a (mgr.14355) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:13:43.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:43 smithi171 bash[25040]: audit 2024-09-13T23:13:42.084137+0000 mgr.a (mgr.14355) 2286 : audit [DBG] from='client.61416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:45.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:45 smithi007 bash[22722]: cluster 2024-09-13T23:13:43.922878+0000 mgr.a (mgr.14355) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:45.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:45 smithi131 bash[24745]: cluster 2024-09-13T23:13:43.922878+0000 mgr.a (mgr.14355) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:45.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:45 smithi171 bash[25040]: cluster 2024-09-13T23:13:43.922878+0000 mgr.a (mgr.14355) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:47.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:47.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:47.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:47.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:47 smithi131 bash[24745]: cluster 2024-09-13T23:13:45.925110+0000 mgr.a (mgr.14355) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:47.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:47 smithi171 bash[25040]: cluster 2024-09-13T23:13:45.925110+0000 mgr.a (mgr.14355) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:47.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:47 smithi007 bash[22722]: cluster 2024-09-13T23:13:45.925110+0000 mgr.a (mgr.14355) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:48.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:48.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:49.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:49 smithi131 bash[24745]: audit 2024-09-13T23:13:47.842660+0000 mgr.a (mgr.14355) 2289 : audit [DBG] from='client.61494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:49.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:49 smithi131 bash[24745]: cluster 2024-09-13T23:13:47.925628+0000 mgr.a (mgr.14355) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:49.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:49 smithi171 bash[25040]: audit 2024-09-13T23:13:47.842660+0000 mgr.a (mgr.14355) 2289 : audit [DBG] from='client.61494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:49.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:49 smithi171 bash[25040]: cluster 2024-09-13T23:13:47.925628+0000 mgr.a (mgr.14355) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:49 smithi007 bash[22722]: audit 2024-09-13T23:13:47.842660+0000 mgr.a (mgr.14355) 2289 : audit [DBG] from='client.61494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:49 smithi007 bash[22722]: cluster 2024-09-13T23:13:47.925628+0000 mgr.a (mgr.14355) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:51.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:51 smithi131 bash[24745]: cluster 2024-09-13T23:13:49.926525+0000 mgr.a (mgr.14355) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:51.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:51 smithi171 bash[25040]: cluster 2024-09-13T23:13:49.926525+0000 mgr.a (mgr.14355) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:51 smithi007 bash[22722]: cluster 2024-09-13T23:13:49.926525+0000 mgr.a (mgr.14355) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:53.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:53.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:53.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:53.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:53 smithi131 bash[24745]: cluster 2024-09-13T23:13:51.928897+0000 mgr.a (mgr.14355) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:53.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:53 smithi171 bash[25040]: cluster 2024-09-13T23:13:51.928897+0000 mgr.a (mgr.14355) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:53.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:53 smithi007 bash[22722]: cluster 2024-09-13T23:13:51.928897+0000 mgr.a (mgr.14355) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:54.010 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:54.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:13:54.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:54 smithi131 bash[24745]: audit 2024-09-13T23:13:53.602414+0000 mgr.a (mgr.14355) 2293 : audit [DBG] from='client.61569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:54 smithi171 bash[25040]: audit 2024-09-13T23:13:53.602414+0000 mgr.a (mgr.14355) 2293 : audit [DBG] from='client.61569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:54 smithi007 bash[22722]: audit 2024-09-13T23:13:53.602414+0000 mgr.a (mgr.14355) 2293 : audit [DBG] from='client.61569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:55.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:55 smithi131 bash[24745]: cluster 2024-09-13T23:13:53.929515+0000 mgr.a (mgr.14355) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:55.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:55 smithi171 bash[25040]: cluster 2024-09-13T23:13:53.929515+0000 mgr.a (mgr.14355) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:55 smithi007 bash[22722]: cluster 2024-09-13T23:13:53.929515+0000 mgr.a (mgr.14355) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:57.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:57 smithi131 bash[24745]: cluster 2024-09-13T23:13:55.931900+0000 mgr.a (mgr.14355) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:57.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:57 smithi171 bash[25040]: cluster 2024-09-13T23:13:55.931900+0000 mgr.a (mgr.14355) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:57 smithi007 bash[22722]: cluster 2024-09-13T23:13:55.931900+0000 mgr.a (mgr.14355) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:13:59.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:13:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:13:59.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:13:59.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:13:59 smithi131 bash[24745]: cluster 2024-09-13T23:13:57.932795+0000 mgr.a (mgr.14355) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:59.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:13:59 smithi171 bash[25040]: cluster 2024-09-13T23:13:57.932795+0000 mgr.a (mgr.14355) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:59.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:13:59 smithi007 bash[22722]: cluster 2024-09-13T23:13:57.932795+0000 mgr.a (mgr.14355) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:13:59.743 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:13:59.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:13:59.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:13:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:13:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:00.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:00 smithi131 bash[24745]: audit 2024-09-13T23:13:59.338674+0000 mgr.a (mgr.14355) 2297 : audit [DBG] from='client.61644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:00.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:00 smithi171 bash[25040]: audit 2024-09-13T23:13:59.338674+0000 mgr.a (mgr.14355) 2297 : audit [DBG] from='client.61644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:00 smithi007 bash[22722]: audit 2024-09-13T23:13:59.338674+0000 mgr.a (mgr.14355) 2297 : audit [DBG] from='client.61644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:01.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:01 smithi131 bash[24745]: cluster 2024-09-13T23:13:59.933733+0000 mgr.a (mgr.14355) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:01.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:01 smithi171 bash[25040]: cluster 2024-09-13T23:13:59.933733+0000 mgr.a (mgr.14355) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:01 smithi007 bash[22722]: cluster 2024-09-13T23:13:59.933733+0000 mgr.a (mgr.14355) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:03.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:03 smithi131 bash[24745]: cluster 2024-09-13T23:14:01.936006+0000 mgr.a (mgr.14355) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:03.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:03 smithi171 bash[25040]: cluster 2024-09-13T23:14:01.936006+0000 mgr.a (mgr.14355) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:03.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:03 smithi007 bash[22722]: cluster 2024-09-13T23:14:01.936006+0000 mgr.a (mgr.14355) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:04.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:05.517 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:05.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:05 smithi131 bash[24745]: cluster 2024-09-13T23:14:03.936918+0000 mgr.a (mgr.14355) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:05.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:05 smithi171 bash[25040]: cluster 2024-09-13T23:14:03.936918+0000 mgr.a (mgr.14355) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:05 smithi007 bash[22722]: cluster 2024-09-13T23:14:03.936918+0000 mgr.a (mgr.14355) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:06.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:06 smithi131 bash[24745]: audit 2024-09-13T23:14:05.076860+0000 mgr.a (mgr.14355) 2301 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:06.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:06 smithi171 bash[25040]: audit 2024-09-13T23:14:05.076860+0000 mgr.a (mgr.14355) 2301 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:06 smithi007 bash[22722]: audit 2024-09-13T23:14:05.076860+0000 mgr.a (mgr.14355) 2301 : audit [DBG] from='client.61722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:07.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:07 smithi131 bash[24745]: cluster 2024-09-13T23:14:05.939720+0000 mgr.a (mgr.14355) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:07.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:07 smithi171 bash[25040]: cluster 2024-09-13T23:14:05.939720+0000 mgr.a (mgr.14355) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:07.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:07 smithi007 bash[22722]: cluster 2024-09-13T23:14:05.939720+0000 mgr.a (mgr.14355) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:09.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:09 smithi131 bash[24745]: cluster 2024-09-13T23:14:07.940491+0000 mgr.a (mgr.14355) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:09.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:09 smithi171 bash[25040]: cluster 2024-09-13T23:14:07.940491+0000 mgr.a (mgr.14355) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:09 smithi007 bash[22722]: cluster 2024-09-13T23:14:07.940491+0000 mgr.a (mgr.14355) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:10.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:10.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:11.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:11.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:11 smithi131 bash[24745]: cluster 2024-09-13T23:14:09.941263+0000 mgr.a (mgr.14355) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:11.531 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:11 smithi131 bash[24745]: audit 2024-09-13T23:14:11.196407+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:11 smithi171 bash[25040]: cluster 2024-09-13T23:14:09.941263+0000 mgr.a (mgr.14355) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:11 smithi171 bash[25040]: audit 2024-09-13T23:14:11.196407+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:11 smithi007 bash[22722]: cluster 2024-09-13T23:14:09.941263+0000 mgr.a (mgr.14355) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:11 smithi007 bash[22722]: audit 2024-09-13T23:14:11.196407+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:12.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:12 smithi171 bash[25040]: audit 2024-09-13T23:14:10.852003+0000 mgr.a (mgr.14355) 2305 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:12 smithi007 bash[22722]: audit 2024-09-13T23:14:10.852003+0000 mgr.a (mgr.14355) 2305 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:12 smithi131 bash[24745]: audit 2024-09-13T23:14:10.852003+0000 mgr.a (mgr.14355) 2305 : audit [DBG] from='client.61797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:13.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:13 smithi171 bash[25040]: cluster 2024-09-13T23:14:11.944084+0000 mgr.a (mgr.14355) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:13 smithi007 bash[22722]: cluster 2024-09-13T23:14:11.944084+0000 mgr.a (mgr.14355) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:13.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:13 smithi131 bash[24745]: cluster 2024-09-13T23:14:11.944084+0000 mgr.a (mgr.14355) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:15.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:15 smithi171 bash[25040]: cluster 2024-09-13T23:14:13.945054+0000 mgr.a (mgr.14355) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:15.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:15 smithi007 bash[22722]: cluster 2024-09-13T23:14:13.945054+0000 mgr.a (mgr.14355) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:15.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:15 smithi131 bash[24745]: cluster 2024-09-13T23:14:13.945054+0000 mgr.a (mgr.14355) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:17.052 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: cluster 2024-09-13T23:14:15.947302+0000 mgr.a (mgr.14355) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.486656+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.492438+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.503446+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.507685+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.510466+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.513807+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:16.635318+0000 mgr.a (mgr.14355) 2309 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:17.256802+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:17.258662+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:17.268871+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:17 smithi131 bash[24745]: audit 2024-09-13T23:14:17.273644+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:17.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: cluster 2024-09-13T23:14:15.947302+0000 mgr.a (mgr.14355) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:17.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.486656+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.492438+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.503446+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.507685+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.510466+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.513807+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:16.635318+0000 mgr.a (mgr.14355) 2309 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:17.256802+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:17.258662+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:17.268871+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:17 smithi171 bash[25040]: audit 2024-09-13T23:14:17.273644+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: cluster 2024-09-13T23:14:15.947302+0000 mgr.a (mgr.14355) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.486656+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.492438+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.503446+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.507685+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.510466+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.513807+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:16.635318+0000 mgr.a (mgr.14355) 2309 : audit [DBG] from='client.61872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:17.256802+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:17.258662+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:17.268871+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:14:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22722]: audit 2024-09-13T23:14:17.273644+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:18.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22972]: debug 2024-09-13T23:14:17.980+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:14:18.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:14:17 smithi007 bash[22972]: debug 2024-09-13T23:14:17.984+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:14:18.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:18 smithi131 bash[24745]: audit 2024-09-13T23:14:17.276322+0000 mgr.a (mgr.14355) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:18.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:18 smithi171 bash[25040]: audit 2024-09-13T23:14:17.276322+0000 mgr.a (mgr.14355) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:18 smithi007 bash[22722]: audit 2024-09-13T23:14:17.276322+0000 mgr.a (mgr.14355) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:14:19.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:19 smithi131 bash[24745]: cluster 2024-09-13T23:14:17.948042+0000 mgr.a (mgr.14355) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:19 smithi131 bash[24745]: audit 2024-09-13T23:14:17.986003+0000 mgr.a (mgr.14355) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:14:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:19 smithi131 bash[24745]: cephadm 2024-09-13T23:14:17.987542+0000 mgr.a (mgr.14355) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:14:19.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:19 smithi171 bash[25040]: cluster 2024-09-13T23:14:17.948042+0000 mgr.a (mgr.14355) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:19.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:19 smithi171 bash[25040]: audit 2024-09-13T23:14:17.986003+0000 mgr.a (mgr.14355) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:14:19.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:19 smithi171 bash[25040]: cephadm 2024-09-13T23:14:17.987542+0000 mgr.a (mgr.14355) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:14:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:19 smithi007 bash[22722]: cluster 2024-09-13T23:14:17.948042+0000 mgr.a (mgr.14355) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:19 smithi007 bash[22722]: audit 2024-09-13T23:14:17.986003+0000 mgr.a (mgr.14355) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:14:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:19 smithi007 bash[22722]: cephadm 2024-09-13T23:14:17.987542+0000 mgr.a (mgr.14355) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:14:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:21 smithi131 bash[24745]: cluster 2024-09-13T23:14:19.948804+0000 mgr.a (mgr.14355) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:21 smithi171 bash[25040]: cluster 2024-09-13T23:14:19.948804+0000 mgr.a (mgr.14355) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:21 smithi007 bash[22722]: cluster 2024-09-13T23:14:19.948804+0000 mgr.a (mgr.14355) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:22.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:22.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:22.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:23.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:23 smithi131 bash[24745]: cluster 2024-09-13T23:14:21.951117+0000 mgr.a (mgr.14355) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:23.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:23 smithi131 bash[24745]: audit 2024-09-13T23:14:22.390161+0000 mgr.a (mgr.14355) 2316 : audit [DBG] from='client.62058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:23.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:23 smithi171 bash[25040]: cluster 2024-09-13T23:14:21.951117+0000 mgr.a (mgr.14355) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:23.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:23 smithi171 bash[25040]: audit 2024-09-13T23:14:22.390161+0000 mgr.a (mgr.14355) 2316 : audit [DBG] from='client.62058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:23 smithi007 bash[22722]: cluster 2024-09-13T23:14:21.951117+0000 mgr.a (mgr.14355) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:23 smithi007 bash[22722]: audit 2024-09-13T23:14:22.390161+0000 mgr.a (mgr.14355) 2316 : audit [DBG] from='client.62058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:25.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:25 smithi131 bash[24745]: cluster 2024-09-13T23:14:23.952007+0000 mgr.a (mgr.14355) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:25.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:25 smithi171 bash[25040]: cluster 2024-09-13T23:14:23.952007+0000 mgr.a (mgr.14355) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:25 smithi007 bash[22722]: cluster 2024-09-13T23:14:23.952007+0000 mgr.a (mgr.14355) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:27.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:27 smithi131 bash[24745]: cluster 2024-09-13T23:14:25.954369+0000 mgr.a (mgr.14355) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:27.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:27 smithi171 bash[25040]: cluster 2024-09-13T23:14:25.954369+0000 mgr.a (mgr.14355) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:27.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:27.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:27 smithi007 bash[22722]: cluster 2024-09-13T23:14:25.954369+0000 mgr.a (mgr.14355) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:28.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:28.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:28.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:28.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:29.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:29 smithi131 bash[24745]: cluster 2024-09-13T23:14:27.955102+0000 mgr.a (mgr.14355) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:29.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:29 smithi131 bash[24745]: audit 2024-09-13T23:14:28.140941+0000 mgr.a (mgr.14355) 2320 : audit [DBG] from='client.62127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:29 smithi171 bash[25040]: cluster 2024-09-13T23:14:27.955102+0000 mgr.a (mgr.14355) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:29 smithi171 bash[25040]: audit 2024-09-13T23:14:28.140941+0000 mgr.a (mgr.14355) 2320 : audit [DBG] from='client.62127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:29 smithi007 bash[22722]: cluster 2024-09-13T23:14:27.955102+0000 mgr.a (mgr.14355) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:29 smithi007 bash[22722]: audit 2024-09-13T23:14:28.140941+0000 mgr.a (mgr.14355) 2320 : audit [DBG] from='client.62127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:31.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:31 smithi131 bash[24745]: cluster 2024-09-13T23:14:29.955944+0000 mgr.a (mgr.14355) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:31.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:31 smithi171 bash[25040]: cluster 2024-09-13T23:14:29.955944+0000 mgr.a (mgr.14355) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:31 smithi007 bash[22722]: cluster 2024-09-13T23:14:29.955944+0000 mgr.a (mgr.14355) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:33.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:33 smithi131 bash[24745]: cluster 2024-09-13T23:14:31.958179+0000 mgr.a (mgr.14355) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:33.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:33 smithi171 bash[25040]: cluster 2024-09-13T23:14:31.958179+0000 mgr.a (mgr.14355) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:33.971 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:33 smithi007 bash[22722]: cluster 2024-09-13T23:14:31.958179+0000 mgr.a (mgr.14355) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:14:34.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:34.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:34.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:34.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:34.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:35 smithi131 bash[24745]: audit 2024-09-13T23:14:33.885614+0000 mgr.a (mgr.14355) 2323 : audit [DBG] from='client.62199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:35 smithi131 bash[24745]: cluster 2024-09-13T23:14:33.958719+0000 mgr.a (mgr.14355) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:35.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:35 smithi171 bash[25040]: audit 2024-09-13T23:14:33.885614+0000 mgr.a (mgr.14355) 2323 : audit [DBG] from='client.62199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:35.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:35 smithi171 bash[25040]: cluster 2024-09-13T23:14:33.958719+0000 mgr.a (mgr.14355) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:35 smithi007 bash[22722]: audit 2024-09-13T23:14:33.885614+0000 mgr.a (mgr.14355) 2323 : audit [DBG] from='client.62199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:35 smithi007 bash[22722]: cluster 2024-09-13T23:14:33.958719+0000 mgr.a (mgr.14355) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:37.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:37 smithi171 bash[25040]: cluster 2024-09-13T23:14:35.961086+0000 mgr.a (mgr.14355) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:37 smithi007 bash[22722]: cluster 2024-09-13T23:14:35.961086+0000 mgr.a (mgr.14355) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:37 smithi131 bash[24745]: cluster 2024-09-13T23:14:35.961086+0000 mgr.a (mgr.14355) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:39.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:39.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:39.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:39 smithi171 bash[25040]: cluster 2024-09-13T23:14:37.962025+0000 mgr.a (mgr.14355) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:39 smithi007 bash[22722]: cluster 2024-09-13T23:14:37.962025+0000 mgr.a (mgr.14355) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:40.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:40.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:39 smithi131 bash[24745]: cluster 2024-09-13T23:14:37.962025+0000 mgr.a (mgr.14355) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:40 smithi007 bash[22722]: audit 2024-09-13T23:14:39.629952+0000 mgr.a (mgr.14355) 2327 : audit [DBG] from='client.62277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:41.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:40 smithi131 bash[24745]: audit 2024-09-13T23:14:39.629952+0000 mgr.a (mgr.14355) 2327 : audit [DBG] from='client.62277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:41.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:40 smithi171 bash[25040]: audit 2024-09-13T23:14:39.629952+0000 mgr.a (mgr.14355) 2327 : audit [DBG] from='client.62277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:41.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:41 smithi007 bash[22722]: cluster 2024-09-13T23:14:39.962581+0000 mgr.a (mgr.14355) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:41 smithi131 bash[24745]: cluster 2024-09-13T23:14:39.962581+0000 mgr.a (mgr.14355) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:42.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:41 smithi171 bash[25040]: cluster 2024-09-13T23:14:39.962581+0000 mgr.a (mgr.14355) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:43 smithi007 bash[22722]: cluster 2024-09-13T23:14:41.964702+0000 mgr.a (mgr.14355) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:43 smithi131 bash[24745]: cluster 2024-09-13T23:14:41.964702+0000 mgr.a (mgr.14355) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:43 smithi171 bash[25040]: cluster 2024-09-13T23:14:41.964702+0000 mgr.a (mgr.14355) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:14:45.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:45.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:45.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:45.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:45.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:45 smithi007 bash[22722]: cluster 2024-09-13T23:14:43.965466+0000 mgr.a (mgr.14355) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:45 smithi131 bash[24745]: cluster 2024-09-13T23:14:43.965466+0000 mgr.a (mgr.14355) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:46.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:45 smithi171 bash[25040]: cluster 2024-09-13T23:14:43.965466+0000 mgr.a (mgr.14355) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:46 smithi007 bash[22722]: audit 2024-09-13T23:14:45.355326+0000 mgr.a (mgr.14355) 2331 : audit [DBG] from='client.62355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:47.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:46 smithi131 bash[24745]: audit 2024-09-13T23:14:45.355326+0000 mgr.a (mgr.14355) 2331 : audit [DBG] from='client.62355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:47.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:46 smithi171 bash[25040]: audit 2024-09-13T23:14:45.355326+0000 mgr.a (mgr.14355) 2331 : audit [DBG] from='client.62355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:47 smithi007 bash[22722]: cluster 2024-09-13T23:14:45.968189+0000 mgr.a (mgr.14355) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:47 smithi131 bash[24745]: cluster 2024-09-13T23:14:45.968189+0000 mgr.a (mgr.14355) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:47 smithi171 bash[25040]: cluster 2024-09-13T23:14:45.968189+0000 mgr.a (mgr.14355) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:49 smithi007 bash[22722]: cluster 2024-09-13T23:14:47.969100+0000 mgr.a (mgr.14355) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:49 smithi131 bash[24745]: cluster 2024-09-13T23:14:47.969100+0000 mgr.a (mgr.14355) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:49 smithi171 bash[25040]: cluster 2024-09-13T23:14:47.969100+0000 mgr.a (mgr.14355) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:50.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:50.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:50.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:51.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:51.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:51 smithi007 bash[22722]: cluster 2024-09-13T23:14:49.970043+0000 mgr.a (mgr.14355) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:14:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:51 smithi131 bash[24745]: cluster 2024-09-13T23:14:49.970043+0000 mgr.a (mgr.14355) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:14:52.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:51 smithi171 bash[25040]: cluster 2024-09-13T23:14:49.970043+0000 mgr.a (mgr.14355) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:14:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:52 smithi007 bash[22722]: audit 2024-09-13T23:14:51.104319+0000 mgr.a (mgr.14355) 2335 : audit [DBG] from='client.62433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:53.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:52 smithi131 bash[24745]: audit 2024-09-13T23:14:51.104319+0000 mgr.a (mgr.14355) 2335 : audit [DBG] from='client.62433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:53.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:52 smithi171 bash[25040]: audit 2024-09-13T23:14:51.104319+0000 mgr.a (mgr.14355) 2335 : audit [DBG] from='client.62433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:53 smithi007 bash[22722]: cluster 2024-09-13T23:14:51.972912+0000 mgr.a (mgr.14355) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:53 smithi131 bash[24745]: cluster 2024-09-13T23:14:51.972912+0000 mgr.a (mgr.14355) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:53 smithi171 bash[25040]: cluster 2024-09-13T23:14:51.972912+0000 mgr.a (mgr.14355) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:55.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:55 smithi007 bash[22722]: cluster 2024-09-13T23:14:53.973728+0000 mgr.a (mgr.14355) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:55 smithi131 bash[24745]: cluster 2024-09-13T23:14:53.973728+0000 mgr.a (mgr.14355) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:55 smithi171 bash[25040]: cluster 2024-09-13T23:14:53.973728+0000 mgr.a (mgr.14355) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:14:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:14:56.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:14:56.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:14:57.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:14:57.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:14:57.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:14:57.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:14:57.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:14:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:57 smithi007 bash[22722]: cluster 2024-09-13T23:14:55.975828+0000 mgr.a (mgr.14355) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:57 smithi131 bash[24745]: cluster 2024-09-13T23:14:55.975828+0000 mgr.a (mgr.14355) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:57 smithi171 bash[25040]: cluster 2024-09-13T23:14:55.975828+0000 mgr.a (mgr.14355) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:14:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:58 smithi007 bash[22722]: audit 2024-09-13T23:14:56.887307+0000 mgr.a (mgr.14355) 2339 : audit [DBG] from='client.62511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:59.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:58 smithi131 bash[24745]: audit 2024-09-13T23:14:56.887307+0000 mgr.a (mgr.14355) 2339 : audit [DBG] from='client.62511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:59.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:58 smithi171 bash[25040]: audit 2024-09-13T23:14:56.887307+0000 mgr.a (mgr.14355) 2339 : audit [DBG] from='client.62511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:14:59 smithi007 bash[22722]: cluster 2024-09-13T23:14:57.976795+0000 mgr.a (mgr.14355) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:14:59 smithi131 bash[24745]: cluster 2024-09-13T23:14:57.976795+0000 mgr.a (mgr.14355) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:14:59 smithi171 bash[25040]: cluster 2024-09-13T23:14:57.976795+0000 mgr.a (mgr.14355) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:01.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:01 smithi007 bash[22722]: cluster 2024-09-13T23:14:59.977588+0000 mgr.a (mgr.14355) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:01 smithi131 bash[24745]: cluster 2024-09-13T23:14:59.977588+0000 mgr.a (mgr.14355) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:01 smithi171 bash[25040]: cluster 2024-09-13T23:14:59.977588+0000 mgr.a (mgr.14355) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:02.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:02.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:03.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:03.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:03 smithi007 bash[22722]: cluster 2024-09-13T23:15:01.979843+0000 mgr.a (mgr.14355) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:03 smithi007 bash[22722]: audit 2024-09-13T23:15:02.676622+0000 mgr.a (mgr.14355) 2343 : audit [DBG] from='client.62586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:03 smithi131 bash[24745]: cluster 2024-09-13T23:15:01.979843+0000 mgr.a (mgr.14355) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:03 smithi131 bash[24745]: audit 2024-09-13T23:15:02.676622+0000 mgr.a (mgr.14355) 2343 : audit [DBG] from='client.62586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:03 smithi171 bash[25040]: cluster 2024-09-13T23:15:01.979843+0000 mgr.a (mgr.14355) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:03 smithi171 bash[25040]: audit 2024-09-13T23:15:02.676622+0000 mgr.a (mgr.14355) 2343 : audit [DBG] from='client.62586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:05 smithi007 bash[22722]: cluster 2024-09-13T23:15:03.980790+0000 mgr.a (mgr.14355) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:05 smithi131 bash[24745]: cluster 2024-09-13T23:15:03.980790+0000 mgr.a (mgr.14355) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:05 smithi171 bash[25040]: cluster 2024-09-13T23:15:03.980790+0000 mgr.a (mgr.14355) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:07.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:07 smithi007 bash[22722]: cluster 2024-09-13T23:15:05.983109+0000 mgr.a (mgr.14355) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:08.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:07 smithi131 bash[24745]: cluster 2024-09-13T23:15:05.983109+0000 mgr.a (mgr.14355) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:07 smithi171 bash[25040]: cluster 2024-09-13T23:15:05.983109+0000 mgr.a (mgr.14355) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:08.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:08.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:08.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:08.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:09 smithi007 bash[22722]: cluster 2024-09-13T23:15:07.983886+0000 mgr.a (mgr.14355) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:09 smithi007 bash[22722]: audit 2024-09-13T23:15:08.446647+0000 mgr.a (mgr.14355) 2347 : audit [DBG] from='client.62664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:09 smithi131 bash[24745]: cluster 2024-09-13T23:15:07.983886+0000 mgr.a (mgr.14355) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:09 smithi131 bash[24745]: audit 2024-09-13T23:15:08.446647+0000 mgr.a (mgr.14355) 2347 : audit [DBG] from='client.62664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:09 smithi171 bash[25040]: cluster 2024-09-13T23:15:07.983886+0000 mgr.a (mgr.14355) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:09 smithi171 bash[25040]: audit 2024-09-13T23:15:08.446647+0000 mgr.a (mgr.14355) 2347 : audit [DBG] from='client.62664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:11 smithi007 bash[22722]: cluster 2024-09-13T23:15:09.984834+0000 mgr.a (mgr.14355) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:12.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:11 smithi131 bash[24745]: cluster 2024-09-13T23:15:09.984834+0000 mgr.a (mgr.14355) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:11 smithi171 bash[25040]: cluster 2024-09-13T23:15:09.984834+0000 mgr.a (mgr.14355) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:13.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:13.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:13 smithi007 bash[22722]: cluster 2024-09-13T23:15:11.987167+0000 mgr.a (mgr.14355) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:14.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:13 smithi131 bash[24745]: cluster 2024-09-13T23:15:11.987167+0000 mgr.a (mgr.14355) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:14.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:13 smithi171 bash[25040]: cluster 2024-09-13T23:15:11.987167+0000 mgr.a (mgr.14355) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:14.613 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:14.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:14.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:15 smithi007 bash[22722]: cluster 2024-09-13T23:15:13.987707+0000 mgr.a (mgr.14355) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:15 smithi007 bash[22722]: audit 2024-09-13T23:15:14.193581+0000 mgr.a (mgr.14355) 2351 : audit [DBG] from='client.62739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:15 smithi131 bash[24745]: cluster 2024-09-13T23:15:13.987707+0000 mgr.a (mgr.14355) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:15 smithi131 bash[24745]: audit 2024-09-13T23:15:14.193581+0000 mgr.a (mgr.14355) 2351 : audit [DBG] from='client.62739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:15 smithi171 bash[25040]: cluster 2024-09-13T23:15:13.987707+0000 mgr.a (mgr.14355) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:15 smithi171 bash[25040]: audit 2024-09-13T23:15:14.193581+0000 mgr.a (mgr.14355) 2351 : audit [DBG] from='client.62739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:17 smithi007 bash[22722]: cluster 2024-09-13T23:15:15.990085+0000 mgr.a (mgr.14355) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:17 smithi131 bash[24745]: cluster 2024-09-13T23:15:15.990085+0000 mgr.a (mgr.14355) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:18.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:17 smithi171 bash[25040]: cluster 2024-09-13T23:15:15.990085+0000 mgr.a (mgr.14355) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:18 smithi007 bash[22722]: audit 2024-09-13T23:15:18.047046+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:15:19.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:18 smithi131 bash[24745]: audit 2024-09-13T23:15:18.047046+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:15:19.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:18 smithi171 bash[25040]: audit 2024-09-13T23:15:18.047046+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:15:19.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:19.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:19.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22972]: debug 2024-09-13T23:15:19.623+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:15:19.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22972]: debug 2024-09-13T23:15:19.623+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22722]: cluster 2024-09-13T23:15:17.990863+0000 mgr.a (mgr.14355) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22722]: audit 2024-09-13T23:15:18.897333+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22722]: audit 2024-09-13T23:15:18.898767+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22722]: audit 2024-09-13T23:15:18.907361+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:19 smithi007 bash[22722]: audit 2024-09-13T23:15:18.912281+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:19 smithi131 bash[24745]: cluster 2024-09-13T23:15:17.990863+0000 mgr.a (mgr.14355) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:19 smithi131 bash[24745]: audit 2024-09-13T23:15:18.897333+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:15:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:19 smithi131 bash[24745]: audit 2024-09-13T23:15:18.898767+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:15:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:19 smithi131 bash[24745]: audit 2024-09-13T23:15:18.907361+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:15:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:19 smithi131 bash[24745]: audit 2024-09-13T23:15:18.912281+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:19 smithi171 bash[25040]: cluster 2024-09-13T23:15:17.990863+0000 mgr.a (mgr.14355) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:19 smithi171 bash[25040]: audit 2024-09-13T23:15:18.897333+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:15:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:19 smithi171 bash[25040]: audit 2024-09-13T23:15:18.898767+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:15:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:19 smithi171 bash[25040]: audit 2024-09-13T23:15:18.907361+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:15:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:19 smithi171 bash[25040]: audit 2024-09-13T23:15:18.912281+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:20.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:20 smithi007 bash[22722]: audit 2024-09-13T23:15:18.914603+0000 mgr.a (mgr.14355) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:20 smithi007 bash[22722]: audit 2024-09-13T23:15:19.627470+0000 mgr.a (mgr.14355) 2355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:20 smithi007 bash[22722]: cephadm 2024-09-13T23:15:19.629134+0000 mgr.a (mgr.14355) 2356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:15:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:20 smithi131 bash[24745]: audit 2024-09-13T23:15:18.914603+0000 mgr.a (mgr.14355) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:21.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:20 smithi131 bash[24745]: audit 2024-09-13T23:15:19.627470+0000 mgr.a (mgr.14355) 2355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:15:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:20 smithi131 bash[24745]: cephadm 2024-09-13T23:15:19.629134+0000 mgr.a (mgr.14355) 2356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:15:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:20 smithi171 bash[25040]: audit 2024-09-13T23:15:18.914603+0000 mgr.a (mgr.14355) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:15:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:20 smithi171 bash[25040]: audit 2024-09-13T23:15:19.627470+0000 mgr.a (mgr.14355) 2355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:15:21.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:20 smithi171 bash[25040]: cephadm 2024-09-13T23:15:19.629134+0000 mgr.a (mgr.14355) 2356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:15:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:21 smithi007 bash[22722]: audit 2024-09-13T23:15:19.931860+0000 mgr.a (mgr.14355) 2357 : audit [DBG] from='client.62922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:21 smithi007 bash[22722]: cluster 2024-09-13T23:15:19.991568+0000 mgr.a (mgr.14355) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:22.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:21 smithi131 bash[24745]: audit 2024-09-13T23:15:19.931860+0000 mgr.a (mgr.14355) 2357 : audit [DBG] from='client.62922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:22.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:21 smithi131 bash[24745]: cluster 2024-09-13T23:15:19.991568+0000 mgr.a (mgr.14355) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:21 smithi171 bash[25040]: audit 2024-09-13T23:15:19.931860+0000 mgr.a (mgr.14355) 2357 : audit [DBG] from='client.62922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:21 smithi171 bash[25040]: cluster 2024-09-13T23:15:19.991568+0000 mgr.a (mgr.14355) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:23 smithi007 bash[22722]: cluster 2024-09-13T23:15:21.993930+0000 mgr.a (mgr.14355) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:24.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:23 smithi131 bash[24745]: cluster 2024-09-13T23:15:21.993930+0000 mgr.a (mgr.14355) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:24.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:23 smithi171 bash[25040]: cluster 2024-09-13T23:15:21.993930+0000 mgr.a (mgr.14355) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:25.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:25 smithi007 bash[22722]: cluster 2024-09-13T23:15:23.994911+0000 mgr.a (mgr.14355) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:26.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:25 smithi131 bash[24745]: cluster 2024-09-13T23:15:23.994911+0000 mgr.a (mgr.14355) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:25 smithi171 bash[25040]: cluster 2024-09-13T23:15:23.994911+0000 mgr.a (mgr.14355) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:26.108 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:26.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:26 smithi007 bash[22722]: audit 2024-09-13T23:15:25.678756+0000 mgr.a (mgr.14355) 2361 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:27.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:26 smithi131 bash[24745]: audit 2024-09-13T23:15:25.678756+0000 mgr.a (mgr.14355) 2361 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:26 smithi171 bash[25040]: audit 2024-09-13T23:15:25.678756+0000 mgr.a (mgr.14355) 2361 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:27 smithi007 bash[22722]: cluster 2024-09-13T23:15:25.996218+0000 mgr.a (mgr.14355) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:28.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:27 smithi131 bash[24745]: cluster 2024-09-13T23:15:25.996218+0000 mgr.a (mgr.14355) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:27 smithi171 bash[25040]: cluster 2024-09-13T23:15:25.996218+0000 mgr.a (mgr.14355) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:29 smithi007 bash[22722]: cluster 2024-09-13T23:15:27.997089+0000 mgr.a (mgr.14355) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:30.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:29 smithi131 bash[24745]: cluster 2024-09-13T23:15:27.997089+0000 mgr.a (mgr.14355) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:30.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:29 smithi171 bash[25040]: cluster 2024-09-13T23:15:27.997089+0000 mgr.a (mgr.14355) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:31.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:31.895 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:31 smithi007 bash[22722]: cluster 2024-09-13T23:15:29.997928+0000 mgr.a (mgr.14355) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:32.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:31 smithi131 bash[24745]: cluster 2024-09-13T23:15:29.997928+0000 mgr.a (mgr.14355) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:31 smithi171 bash[25040]: cluster 2024-09-13T23:15:29.997928+0000 mgr.a (mgr.14355) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:15:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:32 smithi007 bash[22722]: audit 2024-09-13T23:15:31.443534+0000 mgr.a (mgr.14355) 2365 : audit [DBG] from='client.63078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:33.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:32 smithi131 bash[24745]: audit 2024-09-13T23:15:31.443534+0000 mgr.a (mgr.14355) 2365 : audit [DBG] from='client.63078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:33.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:32 smithi171 bash[25040]: audit 2024-09-13T23:15:31.443534+0000 mgr.a (mgr.14355) 2365 : audit [DBG] from='client.63078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:33 smithi007 bash[22722]: cluster 2024-09-13T23:15:32.000754+0000 mgr.a (mgr.14355) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:34.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:33 smithi131 bash[24745]: cluster 2024-09-13T23:15:32.000754+0000 mgr.a (mgr.14355) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:34.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:33 smithi171 bash[25040]: cluster 2024-09-13T23:15:32.000754+0000 mgr.a (mgr.14355) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:15:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:35 smithi007 bash[22722]: cluster 2024-09-13T23:15:34.001535+0000 mgr.a (mgr.14355) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:15:36.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:35 smithi131 bash[24745]: cluster 2024-09-13T23:15:34.001535+0000 mgr.a (mgr.14355) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:15:36.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:35 smithi171 bash[25040]: cluster 2024-09-13T23:15:34.001535+0000 mgr.a (mgr.14355) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:15:36.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:36.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:37.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:37.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:37.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:37.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:37.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:38.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:37 smithi131 bash[24745]: cluster 2024-09-13T23:15:36.003567+0000 mgr.a (mgr.14355) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:15:38.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:37 smithi171 bash[25040]: cluster 2024-09-13T23:15:36.003567+0000 mgr.a (mgr.14355) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:15:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:37 smithi007 bash[22722]: cluster 2024-09-13T23:15:36.003567+0000 mgr.a (mgr.14355) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:15:39.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:38 smithi131 bash[24745]: audit 2024-09-13T23:15:37.225890+0000 mgr.a (mgr.14355) 2369 : audit [DBG] from='client.63153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:39.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:38 smithi171 bash[25040]: audit 2024-09-13T23:15:37.225890+0000 mgr.a (mgr.14355) 2369 : audit [DBG] from='client.63153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:39.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:38 smithi007 bash[22722]: audit 2024-09-13T23:15:37.225890+0000 mgr.a (mgr.14355) 2369 : audit [DBG] from='client.63153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:40.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:39 smithi131 bash[24745]: cluster 2024-09-13T23:15:38.004490+0000 mgr.a (mgr.14355) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:40.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:39 smithi171 bash[25040]: cluster 2024-09-13T23:15:38.004490+0000 mgr.a (mgr.14355) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:39 smithi007 bash[22722]: cluster 2024-09-13T23:15:38.004490+0000 mgr.a (mgr.14355) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:42.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:41 smithi131 bash[24745]: cluster 2024-09-13T23:15:40.005272+0000 mgr.a (mgr.14355) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:42.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:41 smithi171 bash[25040]: cluster 2024-09-13T23:15:40.005272+0000 mgr.a (mgr.14355) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:41 smithi007 bash[22722]: cluster 2024-09-13T23:15:40.005272+0000 mgr.a (mgr.14355) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:42.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:42.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:43.418 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:44.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:43 smithi131 bash[24745]: cluster 2024-09-13T23:15:42.007561+0000 mgr.a (mgr.14355) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:43 smithi171 bash[25040]: cluster 2024-09-13T23:15:42.007561+0000 mgr.a (mgr.14355) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:43 smithi007 bash[22722]: cluster 2024-09-13T23:15:42.007561+0000 mgr.a (mgr.14355) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:45.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:44 smithi131 bash[24745]: audit 2024-09-13T23:15:42.978259+0000 mgr.a (mgr.14355) 2373 : audit [DBG] from='client.63231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:45.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:44 smithi171 bash[25040]: audit 2024-09-13T23:15:42.978259+0000 mgr.a (mgr.14355) 2373 : audit [DBG] from='client.63231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:44 smithi007 bash[22722]: audit 2024-09-13T23:15:42.978259+0000 mgr.a (mgr.14355) 2373 : audit [DBG] from='client.63231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:46.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:45 smithi131 bash[24745]: cluster 2024-09-13T23:15:44.008481+0000 mgr.a (mgr.14355) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:46.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:45 smithi171 bash[25040]: cluster 2024-09-13T23:15:44.008481+0000 mgr.a (mgr.14355) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:45 smithi007 bash[22722]: cluster 2024-09-13T23:15:44.008481+0000 mgr.a (mgr.14355) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:48.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:47 smithi131 bash[24745]: cluster 2024-09-13T23:15:46.010739+0000 mgr.a (mgr.14355) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:47 smithi171 bash[25040]: cluster 2024-09-13T23:15:46.010739+0000 mgr.a (mgr.14355) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:47 smithi007 bash[22722]: cluster 2024-09-13T23:15:46.010739+0000 mgr.a (mgr.14355) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:48.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:48.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:49.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:49 smithi131 bash[24745]: cluster 2024-09-13T23:15:48.011486+0000 mgr.a (mgr.14355) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:50.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:49 smithi131 bash[24745]: audit 2024-09-13T23:15:48.754005+0000 mgr.a (mgr.14355) 2377 : audit [DBG] from='client.63306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:49 smithi171 bash[25040]: cluster 2024-09-13T23:15:48.011486+0000 mgr.a (mgr.14355) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:49 smithi171 bash[25040]: audit 2024-09-13T23:15:48.754005+0000 mgr.a (mgr.14355) 2377 : audit [DBG] from='client.63306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:49 smithi007 bash[22722]: cluster 2024-09-13T23:15:48.011486+0000 mgr.a (mgr.14355) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:49 smithi007 bash[22722]: audit 2024-09-13T23:15:48.754005+0000 mgr.a (mgr.14355) 2377 : audit [DBG] from='client.63306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:52.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:51 smithi131 bash[24745]: cluster 2024-09-13T23:15:50.012436+0000 mgr.a (mgr.14355) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:52.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:51 smithi171 bash[25040]: cluster 2024-09-13T23:15:50.012436+0000 mgr.a (mgr.14355) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:51 smithi007 bash[22722]: cluster 2024-09-13T23:15:50.012436+0000 mgr.a (mgr.14355) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:54.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:53 smithi131 bash[24745]: cluster 2024-09-13T23:15:52.014719+0000 mgr.a (mgr.14355) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:53 smithi171 bash[25040]: cluster 2024-09-13T23:15:52.014719+0000 mgr.a (mgr.14355) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:54.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:54.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:54.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:15:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:53 smithi007 bash[22722]: cluster 2024-09-13T23:15:52.014719+0000 mgr.a (mgr.14355) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:54.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:15:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:15:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:15:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:15:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:15:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:55 smithi131 bash[24745]: cluster 2024-09-13T23:15:54.015484+0000 mgr.a (mgr.14355) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:56.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:55 smithi131 bash[24745]: audit 2024-09-13T23:15:54.504422+0000 mgr.a (mgr.14355) 2381 : audit [DBG] from='client.63384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:55 smithi171 bash[25040]: cluster 2024-09-13T23:15:54.015484+0000 mgr.a (mgr.14355) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:55 smithi171 bash[25040]: audit 2024-09-13T23:15:54.504422+0000 mgr.a (mgr.14355) 2381 : audit [DBG] from='client.63384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:55 smithi007 bash[22722]: cluster 2024-09-13T23:15:54.015484+0000 mgr.a (mgr.14355) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:15:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:55 smithi007 bash[22722]: audit 2024-09-13T23:15:54.504422+0000 mgr.a (mgr.14355) 2381 : audit [DBG] from='client.63384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:58.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:57 smithi131 bash[24745]: cluster 2024-09-13T23:15:56.017919+0000 mgr.a (mgr.14355) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:57 smithi171 bash[25040]: cluster 2024-09-13T23:15:56.017919+0000 mgr.a (mgr.14355) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:57 smithi007 bash[22722]: cluster 2024-09-13T23:15:56.017919+0000 mgr.a (mgr.14355) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:15:59.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:15:59.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:15:59.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:00.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:15:59 smithi131 bash[24745]: cluster 2024-09-13T23:15:58.018722+0000 mgr.a (mgr.14355) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:15:59 smithi171 bash[25040]: cluster 2024-09-13T23:15:58.018722+0000 mgr.a (mgr.14355) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:15:59 smithi007 bash[22722]: cluster 2024-09-13T23:15:58.018722+0000 mgr.a (mgr.14355) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:00.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:00.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:00.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:01 smithi131 bash[24745]: cluster 2024-09-13T23:16:00.019448+0000 mgr.a (mgr.14355) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:01 smithi131 bash[24745]: audit 2024-09-13T23:16:00.270268+0000 mgr.a (mgr.14355) 2385 : audit [DBG] from='client.63462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:01 smithi171 bash[25040]: cluster 2024-09-13T23:16:00.019448+0000 mgr.a (mgr.14355) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:01 smithi171 bash[25040]: audit 2024-09-13T23:16:00.270268+0000 mgr.a (mgr.14355) 2385 : audit [DBG] from='client.63462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:01 smithi007 bash[22722]: cluster 2024-09-13T23:16:00.019448+0000 mgr.a (mgr.14355) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:01 smithi007 bash[22722]: audit 2024-09-13T23:16:00.270268+0000 mgr.a (mgr.14355) 2385 : audit [DBG] from='client.63462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:03 smithi131 bash[24745]: cluster 2024-09-13T23:16:02.022143+0000 mgr.a (mgr.14355) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:03 smithi171 bash[25040]: cluster 2024-09-13T23:16:02.022143+0000 mgr.a (mgr.14355) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:03 smithi007 bash[22722]: cluster 2024-09-13T23:16:02.022143+0000 mgr.a (mgr.14355) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:05.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:05.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:05.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:05 smithi131 bash[24745]: cluster 2024-09-13T23:16:04.022957+0000 mgr.a (mgr.14355) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:05 smithi171 bash[25040]: cluster 2024-09-13T23:16:04.022957+0000 mgr.a (mgr.14355) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:05 smithi007 bash[22722]: cluster 2024-09-13T23:16:04.022957+0000 mgr.a (mgr.14355) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:06.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:06.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:07 smithi171 bash[25040]: cluster 2024-09-13T23:16:06.024859+0000 mgr.a (mgr.14355) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:07 smithi171 bash[25040]: audit 2024-09-13T23:16:06.027026+0000 mgr.a (mgr.14355) 2389 : audit [DBG] from='client.63540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:07 smithi007 bash[22722]: cluster 2024-09-13T23:16:06.024859+0000 mgr.a (mgr.14355) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:07 smithi007 bash[22722]: audit 2024-09-13T23:16:06.027026+0000 mgr.a (mgr.14355) 2389 : audit [DBG] from='client.63540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:07 smithi131 bash[24745]: cluster 2024-09-13T23:16:06.024859+0000 mgr.a (mgr.14355) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:08.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:07 smithi131 bash[24745]: audit 2024-09-13T23:16:06.027026+0000 mgr.a (mgr.14355) 2389 : audit [DBG] from='client.63540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:09 smithi171 bash[25040]: cluster 2024-09-13T23:16:08.025870+0000 mgr.a (mgr.14355) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:09 smithi007 bash[22722]: cluster 2024-09-13T23:16:08.025870+0000 mgr.a (mgr.14355) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:10.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:09 smithi131 bash[24745]: cluster 2024-09-13T23:16:08.025870+0000 mgr.a (mgr.14355) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:11.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:11.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:11.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:11 smithi171 bash[25040]: cluster 2024-09-13T23:16:10.026737+0000 mgr.a (mgr.14355) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:11 smithi007 bash[22722]: cluster 2024-09-13T23:16:10.026737+0000 mgr.a (mgr.14355) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:12.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:12.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:11 smithi131 bash[24745]: cluster 2024-09-13T23:16:10.026737+0000 mgr.a (mgr.14355) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:13.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:12 smithi007 bash[22722]: audit 2024-09-13T23:16:11.790867+0000 mgr.a (mgr.14355) 2392 : audit [DBG] from='client.63612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:13.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:12 smithi131 bash[24745]: audit 2024-09-13T23:16:11.790867+0000 mgr.a (mgr.14355) 2392 : audit [DBG] from='client.63612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:13.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:12 smithi171 bash[25040]: audit 2024-09-13T23:16:11.790867+0000 mgr.a (mgr.14355) 2392 : audit [DBG] from='client.63612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:13 smithi007 bash[22722]: cluster 2024-09-13T23:16:12.030658+0000 mgr.a (mgr.14355) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:14.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:13 smithi131 bash[24745]: cluster 2024-09-13T23:16:12.030658+0000 mgr.a (mgr.14355) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:14.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:13 smithi171 bash[25040]: cluster 2024-09-13T23:16:12.030658+0000 mgr.a (mgr.14355) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:15 smithi007 bash[22722]: cluster 2024-09-13T23:16:14.031685+0000 mgr.a (mgr.14355) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:16.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:15 smithi131 bash[24745]: cluster 2024-09-13T23:16:14.031685+0000 mgr.a (mgr.14355) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:16.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:15 smithi171 bash[25040]: cluster 2024-09-13T23:16:14.031685+0000 mgr.a (mgr.14355) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:17.979 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:17 smithi007 bash[22722]: cluster 2024-09-13T23:16:16.033987+0000 mgr.a (mgr.14355) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:18.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:17 smithi131 bash[24745]: cluster 2024-09-13T23:16:16.033987+0000 mgr.a (mgr.14355) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:18.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:17 smithi171 bash[25040]: cluster 2024-09-13T23:16:16.033987+0000 mgr.a (mgr.14355) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:19.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:18 smithi007 bash[22722]: audit 2024-09-13T23:16:17.562660+0000 mgr.a (mgr.14355) 2396 : audit [DBG] from='client.63690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:19.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:18 smithi131 bash[24745]: audit 2024-09-13T23:16:17.562660+0000 mgr.a (mgr.14355) 2396 : audit [DBG] from='client.63690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:19.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:18 smithi171 bash[25040]: audit 2024-09-13T23:16:17.562660+0000 mgr.a (mgr.14355) 2396 : audit [DBG] from='client.63690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:19 smithi007 bash[22722]: cluster 2024-09-13T23:16:18.034940+0000 mgr.a (mgr.14355) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:19 smithi007 bash[22722]: audit 2024-09-13T23:16:19.684404+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:16:20.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:19 smithi131 bash[24745]: cluster 2024-09-13T23:16:18.034940+0000 mgr.a (mgr.14355) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:20.281 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:19 smithi131 bash[24745]: audit 2024-09-13T23:16:19.684404+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:16:20.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:19 smithi171 bash[25040]: cluster 2024-09-13T23:16:18.034940+0000 mgr.a (mgr.14355) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:20.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:19 smithi171 bash[25040]: audit 2024-09-13T23:16:19.684404+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:16:21.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22972]: debug 2024-09-13T23:16:21.266+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:16:21.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22972]: debug 2024-09-13T23:16:21.266+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:16:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: cluster 2024-09-13T23:16:20.035698+0000 mgr.a (mgr.14355) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: audit 2024-09-13T23:16:20.514412+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:16:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: audit 2024-09-13T23:16:20.515835+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:16:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: audit 2024-09-13T23:16:20.526547+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:16:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: audit 2024-09-13T23:16:20.531565+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:21 smithi007 bash[22722]: audit 2024-09-13T23:16:20.533891+0000 mgr.a (mgr.14355) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:21.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: cluster 2024-09-13T23:16:20.035698+0000 mgr.a (mgr.14355) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: audit 2024-09-13T23:16:20.514412+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:16:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: audit 2024-09-13T23:16:20.515835+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:16:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: audit 2024-09-13T23:16:20.526547+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:16:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: audit 2024-09-13T23:16:20.531565+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:21 smithi131 bash[24745]: audit 2024-09-13T23:16:20.533891+0000 mgr.a (mgr.14355) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: cluster 2024-09-13T23:16:20.035698+0000 mgr.a (mgr.14355) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: audit 2024-09-13T23:16:20.514412+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:16:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: audit 2024-09-13T23:16:20.515835+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:16:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: audit 2024-09-13T23:16:20.526547+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:16:21.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: audit 2024-09-13T23:16:20.531565+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:21 smithi171 bash[25040]: audit 2024-09-13T23:16:20.533891+0000 mgr.a (mgr.14355) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:16:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:22 smithi007 bash[22722]: audit 2024-09-13T23:16:21.272697+0000 mgr.a (mgr.14355) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:16:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:22 smithi007 bash[22722]: cephadm 2024-09-13T23:16:21.274076+0000 mgr.a (mgr.14355) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:16:22.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:22 smithi131 bash[24745]: audit 2024-09-13T23:16:21.272697+0000 mgr.a (mgr.14355) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:16:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:22 smithi131 bash[24745]: cephadm 2024-09-13T23:16:21.274076+0000 mgr.a (mgr.14355) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:16:22.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:22 smithi171 bash[25040]: audit 2024-09-13T23:16:21.272697+0000 mgr.a (mgr.14355) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:16:22.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:22 smithi171 bash[25040]: cephadm 2024-09-13T23:16:21.274076+0000 mgr.a (mgr.14355) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:23.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:23 smithi007 bash[22722]: cluster 2024-09-13T23:16:22.038499+0000 mgr.a (mgr.14355) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:23.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:23.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:23.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:23 smithi131 bash[24745]: cluster 2024-09-13T23:16:22.038499+0000 mgr.a (mgr.14355) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:23.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:23 smithi171 bash[25040]: cluster 2024-09-13T23:16:22.038499+0000 mgr.a (mgr.14355) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:16:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:24 smithi007 bash[22722]: audit 2024-09-13T23:16:23.310123+0000 mgr.a (mgr.14355) 2403 : audit [DBG] from='client.63876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:24.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:24 smithi131 bash[24745]: audit 2024-09-13T23:16:23.310123+0000 mgr.a (mgr.14355) 2403 : audit [DBG] from='client.63876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:24.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:24 smithi171 bash[25040]: audit 2024-09-13T23:16:23.310123+0000 mgr.a (mgr.14355) 2403 : audit [DBG] from='client.63876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:25 smithi007 bash[22722]: cluster 2024-09-13T23:16:24.039423+0000 mgr.a (mgr.14355) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:25.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:25 smithi131 bash[24745]: cluster 2024-09-13T23:16:24.039423+0000 mgr.a (mgr.14355) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:25.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:25 smithi171 bash[25040]: cluster 2024-09-13T23:16:24.039423+0000 mgr.a (mgr.14355) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:27.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:27 smithi007 bash[22722]: cluster 2024-09-13T23:16:26.041710+0000 mgr.a (mgr.14355) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:27.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:27 smithi131 bash[24745]: cluster 2024-09-13T23:16:26.041710+0000 mgr.a (mgr.14355) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:27.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:27 smithi171 bash[25040]: cluster 2024-09-13T23:16:26.041710+0000 mgr.a (mgr.14355) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:28.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:28.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:29.495 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:29.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:29.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:29.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:29.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:29.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:29 smithi007 bash[22722]: cluster 2024-09-13T23:16:28.042489+0000 mgr.a (mgr.14355) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:29.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:29 smithi131 bash[24745]: cluster 2024-09-13T23:16:28.042489+0000 mgr.a (mgr.14355) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:29 smithi171 bash[25040]: cluster 2024-09-13T23:16:28.042489+0000 mgr.a (mgr.14355) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:30.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:30 smithi131 bash[24745]: audit 2024-09-13T23:16:29.051446+0000 mgr.a (mgr.14355) 2407 : audit [DBG] from='client.63951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:30.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:30 smithi171 bash[25040]: audit 2024-09-13T23:16:29.051446+0000 mgr.a (mgr.14355) 2407 : audit [DBG] from='client.63951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:30 smithi007 bash[22722]: audit 2024-09-13T23:16:29.051446+0000 mgr.a (mgr.14355) 2407 : audit [DBG] from='client.63951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:31.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:31 smithi131 bash[24745]: cluster 2024-09-13T23:16:30.043432+0000 mgr.a (mgr.14355) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:31.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:31 smithi171 bash[25040]: cluster 2024-09-13T23:16:30.043432+0000 mgr.a (mgr.14355) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:31 smithi007 bash[22722]: cluster 2024-09-13T23:16:30.043432+0000 mgr.a (mgr.14355) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:33.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:33 smithi131 bash[24745]: cluster 2024-09-13T23:16:32.045712+0000 mgr.a (mgr.14355) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:33.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:33 smithi171 bash[25040]: cluster 2024-09-13T23:16:32.045712+0000 mgr.a (mgr.14355) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:33 smithi007 bash[22722]: cluster 2024-09-13T23:16:32.045712+0000 mgr.a (mgr.14355) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:34.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:35.244 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:35.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:35.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:35 smithi131 bash[24745]: cluster 2024-09-13T23:16:34.046496+0000 mgr.a (mgr.14355) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:35.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:35 smithi171 bash[25040]: cluster 2024-09-13T23:16:34.046496+0000 mgr.a (mgr.14355) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:35 smithi007 bash[22722]: cluster 2024-09-13T23:16:34.046496+0000 mgr.a (mgr.14355) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:36.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:36 smithi131 bash[24745]: audit 2024-09-13T23:16:34.830504+0000 mgr.a (mgr.14355) 2411 : audit [DBG] from='client.64023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:36.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:36 smithi171 bash[25040]: audit 2024-09-13T23:16:34.830504+0000 mgr.a (mgr.14355) 2411 : audit [DBG] from='client.64023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:36 smithi007 bash[22722]: audit 2024-09-13T23:16:34.830504+0000 mgr.a (mgr.14355) 2411 : audit [DBG] from='client.64023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:37.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:37 smithi131 bash[24745]: cluster 2024-09-13T23:16:36.048825+0000 mgr.a (mgr.14355) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:37.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:37 smithi171 bash[25040]: cluster 2024-09-13T23:16:36.048825+0000 mgr.a (mgr.14355) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:37 smithi007 bash[22722]: cluster 2024-09-13T23:16:36.048825+0000 mgr.a (mgr.14355) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:16:39.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:39 smithi131 bash[24745]: cluster 2024-09-13T23:16:38.049628+0000 mgr.a (mgr.14355) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:39.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:39 smithi171 bash[25040]: cluster 2024-09-13T23:16:38.049628+0000 mgr.a (mgr.14355) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:39 smithi007 bash[22722]: cluster 2024-09-13T23:16:38.049628+0000 mgr.a (mgr.14355) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:40.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:40.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:40.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:41 smithi131 bash[24745]: cluster 2024-09-13T23:16:40.050419+0000 mgr.a (mgr.14355) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:41 smithi131 bash[24745]: audit 2024-09-13T23:16:40.576237+0000 mgr.a (mgr.14355) 2415 : audit [DBG] from='client.64101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:41 smithi171 bash[25040]: cluster 2024-09-13T23:16:40.050419+0000 mgr.a (mgr.14355) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:41.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:41 smithi171 bash[25040]: audit 2024-09-13T23:16:40.576237+0000 mgr.a (mgr.14355) 2415 : audit [DBG] from='client.64101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:41 smithi007 bash[22722]: cluster 2024-09-13T23:16:40.050419+0000 mgr.a (mgr.14355) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:41 smithi007 bash[22722]: audit 2024-09-13T23:16:40.576237+0000 mgr.a (mgr.14355) 2415 : audit [DBG] from='client.64101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:43.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:43 smithi131 bash[24745]: cluster 2024-09-13T23:16:42.053064+0000 mgr.a (mgr.14355) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:43.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:43 smithi171 bash[25040]: cluster 2024-09-13T23:16:42.053064+0000 mgr.a (mgr.14355) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:43 smithi007 bash[22722]: cluster 2024-09-13T23:16:42.053064+0000 mgr.a (mgr.14355) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:45 smithi131 bash[24745]: cluster 2024-09-13T23:16:44.053831+0000 mgr.a (mgr.14355) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:45.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:45 smithi171 bash[25040]: cluster 2024-09-13T23:16:44.053831+0000 mgr.a (mgr.14355) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:45 smithi007 bash[22722]: cluster 2024-09-13T23:16:44.053831+0000 mgr.a (mgr.14355) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:45.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:45.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:45.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:46.724 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:46.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:46.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:46.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:46.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:47.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:47 smithi131 bash[24745]: cluster 2024-09-13T23:16:46.055846+0000 mgr.a (mgr.14355) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:47 smithi131 bash[24745]: audit 2024-09-13T23:16:46.318696+0000 mgr.a (mgr.14355) 2419 : audit [DBG] from='client.64176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:47.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:47 smithi171 bash[25040]: cluster 2024-09-13T23:16:46.055846+0000 mgr.a (mgr.14355) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:47.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:47 smithi171 bash[25040]: audit 2024-09-13T23:16:46.318696+0000 mgr.a (mgr.14355) 2419 : audit [DBG] from='client.64176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:47 smithi007 bash[22722]: cluster 2024-09-13T23:16:46.055846+0000 mgr.a (mgr.14355) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:47 smithi007 bash[22722]: audit 2024-09-13T23:16:46.318696+0000 mgr.a (mgr.14355) 2419 : audit [DBG] from='client.64176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:49.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:49 smithi131 bash[24745]: cluster 2024-09-13T23:16:48.056727+0000 mgr.a (mgr.14355) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:49.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:49 smithi171 bash[25040]: cluster 2024-09-13T23:16:48.056727+0000 mgr.a (mgr.14355) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:49 smithi007 bash[22722]: cluster 2024-09-13T23:16:48.056727+0000 mgr.a (mgr.14355) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:16:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:51.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:51 smithi131 bash[24745]: cluster 2024-09-13T23:16:50.057509+0000 mgr.a (mgr.14355) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:51.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:51 smithi171 bash[25040]: cluster 2024-09-13T23:16:50.057509+0000 mgr.a (mgr.14355) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:51 smithi007 bash[22722]: cluster 2024-09-13T23:16:50.057509+0000 mgr.a (mgr.14355) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:16:52.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:53.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:53 smithi131 bash[24745]: cluster 2024-09-13T23:16:52.059708+0000 mgr.a (mgr.14355) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:53 smithi131 bash[24745]: audit 2024-09-13T23:16:52.061662+0000 mgr.a (mgr.14355) 2423 : audit [DBG] from='client.64254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:53.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:53 smithi171 bash[25040]: cluster 2024-09-13T23:16:52.059708+0000 mgr.a (mgr.14355) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:53.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:53 smithi171 bash[25040]: audit 2024-09-13T23:16:52.061662+0000 mgr.a (mgr.14355) 2423 : audit [DBG] from='client.64254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:53 smithi007 bash[22722]: cluster 2024-09-13T23:16:52.059708+0000 mgr.a (mgr.14355) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:53 smithi007 bash[22722]: audit 2024-09-13T23:16:52.061662+0000 mgr.a (mgr.14355) 2423 : audit [DBG] from='client.64254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:55.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:55 smithi131 bash[24745]: cluster 2024-09-13T23:16:54.060732+0000 mgr.a (mgr.14355) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:55.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:55 smithi171 bash[25040]: cluster 2024-09-13T23:16:54.060732+0000 mgr.a (mgr.14355) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:55 smithi007 bash[22722]: cluster 2024-09-13T23:16:54.060732+0000 mgr.a (mgr.14355) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:16:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:16:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:16:57.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:16:57.781 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:57 smithi131 bash[24745]: cluster 2024-09-13T23:16:56.063125+0000 mgr.a (mgr.14355) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:16:57.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:57 smithi171 bash[25040]: cluster 2024-09-13T23:16:56.063125+0000 mgr.a (mgr.14355) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:16:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:57 smithi007 bash[22722]: cluster 2024-09-13T23:16:56.063125+0000 mgr.a (mgr.14355) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:16:58.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:16:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:16:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:16:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:16:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:16:59.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:59 smithi171 bash[25040]: audit 2024-09-13T23:16:57.837189+0000 mgr.a (mgr.14355) 2426 : audit [DBG] from='client.64332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:59.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:16:59 smithi171 bash[25040]: cluster 2024-09-13T23:16:58.063710+0000 mgr.a (mgr.14355) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:16:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:59 smithi007 bash[22722]: audit 2024-09-13T23:16:57.837189+0000 mgr.a (mgr.14355) 2426 : audit [DBG] from='client.64332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:16:59 smithi007 bash[22722]: cluster 2024-09-13T23:16:58.063710+0000 mgr.a (mgr.14355) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:59 smithi131 bash[24745]: audit 2024-09-13T23:16:57.837189+0000 mgr.a (mgr.14355) 2426 : audit [DBG] from='client.64332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:16:59 smithi131 bash[24745]: cluster 2024-09-13T23:16:58.063710+0000 mgr.a (mgr.14355) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:01.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:01 smithi171 bash[25040]: cluster 2024-09-13T23:17:00.064575+0000 mgr.a (mgr.14355) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:01.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:01 smithi007 bash[22722]: cluster 2024-09-13T23:17:00.064575+0000 mgr.a (mgr.14355) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:02.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:01 smithi131 bash[24745]: cluster 2024-09-13T23:17:00.064575+0000 mgr.a (mgr.14355) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:03.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:03.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:03.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:03.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:03 smithi171 bash[25040]: cluster 2024-09-13T23:17:02.066881+0000 mgr.a (mgr.14355) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:03 smithi007 bash[22722]: cluster 2024-09-13T23:17:02.066881+0000 mgr.a (mgr.14355) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:04.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:04.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:04.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:03 smithi131 bash[24745]: cluster 2024-09-13T23:17:02.066881+0000 mgr.a (mgr.14355) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:04 smithi007 bash[22722]: audit 2024-09-13T23:17:03.580072+0000 mgr.a (mgr.14355) 2430 : audit [DBG] from='client.64407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:05.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:04 smithi131 bash[24745]: audit 2024-09-13T23:17:03.580072+0000 mgr.a (mgr.14355) 2430 : audit [DBG] from='client.64407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:05.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:04 smithi171 bash[25040]: audit 2024-09-13T23:17:03.580072+0000 mgr.a (mgr.14355) 2430 : audit [DBG] from='client.64407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:05 smithi007 bash[22722]: cluster 2024-09-13T23:17:04.067787+0000 mgr.a (mgr.14355) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:06.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:05 smithi131 bash[24745]: cluster 2024-09-13T23:17:04.067787+0000 mgr.a (mgr.14355) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:05 smithi171 bash[25040]: cluster 2024-09-13T23:17:04.067787+0000 mgr.a (mgr.14355) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:17:07.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:07 smithi007 bash[22722]: cluster 2024-09-13T23:17:06.070032+0000 mgr.a (mgr.14355) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:08.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:07 smithi131 bash[24745]: cluster 2024-09-13T23:17:06.070032+0000 mgr.a (mgr.14355) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:07 smithi171 bash[25040]: cluster 2024-09-13T23:17:06.070032+0000 mgr.a (mgr.14355) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-13T23:17:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:09.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:09.778 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:09.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:09.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:09.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:09.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:09 smithi007 bash[22722]: cluster 2024-09-13T23:17:08.070830+0000 mgr.a (mgr.14355) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:09 smithi131 bash[24745]: cluster 2024-09-13T23:17:08.070830+0000 mgr.a (mgr.14355) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:09 smithi171 bash[25040]: cluster 2024-09-13T23:17:08.070830+0000 mgr.a (mgr.14355) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:10 smithi007 bash[22722]: audit 2024-09-13T23:17:09.337869+0000 mgr.a (mgr.14355) 2434 : audit [DBG] from='client.64485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:11.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:10 smithi131 bash[24745]: audit 2024-09-13T23:17:09.337869+0000 mgr.a (mgr.14355) 2434 : audit [DBG] from='client.64485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:11.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:10 smithi171 bash[25040]: audit 2024-09-13T23:17:09.337869+0000 mgr.a (mgr.14355) 2434 : audit [DBG] from='client.64485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:11 smithi007 bash[22722]: cluster 2024-09-13T23:17:10.071793+0000 mgr.a (mgr.14355) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:11 smithi131 bash[24745]: cluster 2024-09-13T23:17:10.071793+0000 mgr.a (mgr.14355) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:11 smithi171 bash[25040]: cluster 2024-09-13T23:17:10.071793+0000 mgr.a (mgr.14355) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:13 smithi007 bash[22722]: cluster 2024-09-13T23:17:12.074068+0000 mgr.a (mgr.14355) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:13 smithi131 bash[24745]: cluster 2024-09-13T23:17:12.074068+0000 mgr.a (mgr.14355) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:14.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:13 smithi171 bash[25040]: cluster 2024-09-13T23:17:12.074068+0000 mgr.a (mgr.14355) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:14.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:15.559 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:15.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:15 smithi007 bash[22722]: cluster 2024-09-13T23:17:14.074878+0000 mgr.a (mgr.14355) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:16.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:15 smithi131 bash[24745]: cluster 2024-09-13T23:17:14.074878+0000 mgr.a (mgr.14355) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:15 smithi171 bash[25040]: cluster 2024-09-13T23:17:14.074878+0000 mgr.a (mgr.14355) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:16 smithi007 bash[22722]: audit 2024-09-13T23:17:15.115542+0000 mgr.a (mgr.14355) 2438 : audit [DBG] from='client.64563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:17.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:16 smithi131 bash[24745]: audit 2024-09-13T23:17:15.115542+0000 mgr.a (mgr.14355) 2438 : audit [DBG] from='client.64563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:17.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:16 smithi171 bash[25040]: audit 2024-09-13T23:17:15.115542+0000 mgr.a (mgr.14355) 2438 : audit [DBG] from='client.64563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:17 smithi007 bash[22722]: cluster 2024-09-13T23:17:16.077740+0000 mgr.a (mgr.14355) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:18.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:17 smithi131 bash[24745]: cluster 2024-09-13T23:17:16.077740+0000 mgr.a (mgr.14355) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:18.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:17 smithi171 bash[25040]: cluster 2024-09-13T23:17:16.077740+0000 mgr.a (mgr.14355) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:19 smithi007 bash[22722]: cluster 2024-09-13T23:17:18.078559+0000 mgr.a (mgr.14355) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:20.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:19 smithi131 bash[24745]: cluster 2024-09-13T23:17:18.078559+0000 mgr.a (mgr.14355) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:19 smithi171 bash[25040]: cluster 2024-09-13T23:17:18.078559+0000 mgr.a (mgr.14355) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:20.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:20.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:21.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:21.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:21 smithi007 bash[22722]: cluster 2024-09-13T23:17:20.079348+0000 mgr.a (mgr.14355) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:17:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:21 smithi007 bash[22722]: audit 2024-09-13T23:17:21.324754+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:17:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:21 smithi131 bash[24745]: cluster 2024-09-13T23:17:20.079348+0000 mgr.a (mgr.14355) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:17:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:21 smithi131 bash[24745]: audit 2024-09-13T23:17:21.324754+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:17:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:21 smithi171 bash[25040]: cluster 2024-09-13T23:17:20.079348+0000 mgr.a (mgr.14355) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:17:22.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:21 smithi171 bash[25040]: audit 2024-09-13T23:17:21.324754+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:17:22.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22722]: audit 2024-09-13T23:17:20.898779+0000 mgr.a (mgr.14355) 2442 : audit [DBG] from='client.64641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:22.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22722]: audit 2024-09-13T23:17:22.098469+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:17:22.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22722]: audit 2024-09-13T23:17:22.100014+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:17:22.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22722]: audit 2024-09-13T23:17:22.108117+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:17:22.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22722]: audit 2024-09-13T23:17:22.112886+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:22 smithi131 bash[24745]: audit 2024-09-13T23:17:20.898779+0000 mgr.a (mgr.14355) 2442 : audit [DBG] from='client.64641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:22 smithi131 bash[24745]: audit 2024-09-13T23:17:22.098469+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:22 smithi131 bash[24745]: audit 2024-09-13T23:17:22.100014+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:22 smithi131 bash[24745]: audit 2024-09-13T23:17:22.108117+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:17:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:22 smithi131 bash[24745]: audit 2024-09-13T23:17:22.112886+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:22 smithi171 bash[25040]: audit 2024-09-13T23:17:20.898779+0000 mgr.a (mgr.14355) 2442 : audit [DBG] from='client.64641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:23.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:22 smithi171 bash[25040]: audit 2024-09-13T23:17:22.098469+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:17:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:22 smithi171 bash[25040]: audit 2024-09-13T23:17:22.100014+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:17:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:22 smithi171 bash[25040]: audit 2024-09-13T23:17:22.108117+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:17:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:22 smithi171 bash[25040]: audit 2024-09-13T23:17:22.112886+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:23.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22972]: debug 2024-09-13T23:17:22.857+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:17:23.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:17:22 smithi007 bash[22972]: debug 2024-09-13T23:17:22.857+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:17:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:23 smithi007 bash[22722]: cluster 2024-09-13T23:17:22.081979+0000 mgr.a (mgr.14355) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:23 smithi007 bash[22722]: audit 2024-09-13T23:17:22.115394+0000 mgr.a (mgr.14355) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:23 smithi131 bash[24745]: cluster 2024-09-13T23:17:22.081979+0000 mgr.a (mgr.14355) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:23 smithi131 bash[24745]: audit 2024-09-13T23:17:22.115394+0000 mgr.a (mgr.14355) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:24.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:23 smithi171 bash[25040]: cluster 2024-09-13T23:17:22.081979+0000 mgr.a (mgr.14355) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:24.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:23 smithi171 bash[25040]: audit 2024-09-13T23:17:22.115394+0000 mgr.a (mgr.14355) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:17:24.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:24 smithi007 bash[22722]: audit 2024-09-13T23:17:22.858758+0000 mgr.a (mgr.14355) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:17:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:24 smithi007 bash[22722]: cephadm 2024-09-13T23:17:22.860074+0000 mgr.a (mgr.14355) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:17:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:24 smithi131 bash[24745]: audit 2024-09-13T23:17:22.858758+0000 mgr.a (mgr.14355) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:17:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:24 smithi131 bash[24745]: cephadm 2024-09-13T23:17:22.860074+0000 mgr.a (mgr.14355) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:17:25.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:24 smithi171 bash[25040]: audit 2024-09-13T23:17:22.858758+0000 mgr.a (mgr.14355) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:17:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:24 smithi171 bash[25040]: cephadm 2024-09-13T23:17:22.860074+0000 mgr.a (mgr.14355) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:17:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:25 smithi007 bash[22722]: cluster 2024-09-13T23:17:24.082928+0000 mgr.a (mgr.14355) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:25 smithi131 bash[24745]: cluster 2024-09-13T23:17:24.082928+0000 mgr.a (mgr.14355) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:26.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:25 smithi171 bash[25040]: cluster 2024-09-13T23:17:24.082928+0000 mgr.a (mgr.14355) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:17:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:27.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:27.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:27.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:27.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:27 smithi007 bash[22722]: cluster 2024-09-13T23:17:26.085187+0000 mgr.a (mgr.14355) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:27 smithi007 bash[22722]: audit 2024-09-13T23:17:26.668815+0000 mgr.a (mgr.14355) 2449 : audit [DBG] from='client.64824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:28.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:27 smithi131 bash[24745]: cluster 2024-09-13T23:17:26.085187+0000 mgr.a (mgr.14355) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:28.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:27 smithi131 bash[24745]: audit 2024-09-13T23:17:26.668815+0000 mgr.a (mgr.14355) 2449 : audit [DBG] from='client.64824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:27 smithi171 bash[25040]: cluster 2024-09-13T23:17:26.085187+0000 mgr.a (mgr.14355) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:28.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:27 smithi171 bash[25040]: audit 2024-09-13T23:17:26.668815+0000 mgr.a (mgr.14355) 2449 : audit [DBG] from='client.64824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:29 smithi007 bash[22722]: cluster 2024-09-13T23:17:28.086058+0000 mgr.a (mgr.14355) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:30.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:29 smithi131 bash[24745]: cluster 2024-09-13T23:17:28.086058+0000 mgr.a (mgr.14355) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:30.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:29 smithi171 bash[25040]: cluster 2024-09-13T23:17:28.086058+0000 mgr.a (mgr.14355) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:31 smithi007 bash[22722]: cluster 2024-09-13T23:17:30.086871+0000 mgr.a (mgr.14355) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:31 smithi131 bash[24745]: cluster 2024-09-13T23:17:30.086871+0000 mgr.a (mgr.14355) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:32.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:31 smithi171 bash[25040]: cluster 2024-09-13T23:17:30.086871+0000 mgr.a (mgr.14355) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:32.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:32.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:32.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:32.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:32.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:33 smithi007 bash[22722]: cluster 2024-09-13T23:17:32.088350+0000 mgr.a (mgr.14355) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:33 smithi007 bash[22722]: audit 2024-09-13T23:17:32.410028+0000 mgr.a (mgr.14355) 2453 : audit [DBG] from='client.64899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:34.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:33 smithi131 bash[24745]: cluster 2024-09-13T23:17:32.088350+0000 mgr.a (mgr.14355) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:34.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:33 smithi131 bash[24745]: audit 2024-09-13T23:17:32.410028+0000 mgr.a (mgr.14355) 2453 : audit [DBG] from='client.64899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:34.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:33 smithi171 bash[25040]: cluster 2024-09-13T23:17:32.088350+0000 mgr.a (mgr.14355) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:34.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:33 smithi171 bash[25040]: audit 2024-09-13T23:17:32.410028+0000 mgr.a (mgr.14355) 2453 : audit [DBG] from='client.64899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:35 smithi007 bash[22722]: cluster 2024-09-13T23:17:34.089355+0000 mgr.a (mgr.14355) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:36.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:35 smithi131 bash[24745]: cluster 2024-09-13T23:17:34.089355+0000 mgr.a (mgr.14355) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:36.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:35 smithi171 bash[25040]: cluster 2024-09-13T23:17:34.089355+0000 mgr.a (mgr.14355) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:37.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:37.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:37.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:37 smithi007 bash[22722]: cluster 2024-09-13T23:17:36.091770+0000 mgr.a (mgr.14355) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:38.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:37 smithi131 bash[24745]: cluster 2024-09-13T23:17:36.091770+0000 mgr.a (mgr.14355) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:38.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:37 smithi171 bash[25040]: cluster 2024-09-13T23:17:36.091770+0000 mgr.a (mgr.14355) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:17:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:38.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:38.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:39 smithi007 bash[22722]: cluster 2024-09-13T23:17:38.092550+0000 mgr.a (mgr.14355) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:39 smithi007 bash[22722]: audit 2024-09-13T23:17:38.189320+0000 mgr.a (mgr.14355) 2457 : audit [DBG] from='client.64977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:40.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:39 smithi131 bash[24745]: cluster 2024-09-13T23:17:38.092550+0000 mgr.a (mgr.14355) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:40.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:39 smithi131 bash[24745]: audit 2024-09-13T23:17:38.189320+0000 mgr.a (mgr.14355) 2457 : audit [DBG] from='client.64977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:40.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:39 smithi171 bash[25040]: cluster 2024-09-13T23:17:38.092550+0000 mgr.a (mgr.14355) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:40.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:39 smithi171 bash[25040]: audit 2024-09-13T23:17:38.189320+0000 mgr.a (mgr.14355) 2457 : audit [DBG] from='client.64977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:41 smithi007 bash[22722]: cluster 2024-09-13T23:17:40.093449+0000 mgr.a (mgr.14355) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:42.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:41 smithi131 bash[24745]: cluster 2024-09-13T23:17:40.093449+0000 mgr.a (mgr.14355) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:42.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:41 smithi171 bash[25040]: cluster 2024-09-13T23:17:40.093449+0000 mgr.a (mgr.14355) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:43 smithi007 bash[22722]: cluster 2024-09-13T23:17:42.095750+0000 mgr.a (mgr.14355) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:44.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:43 smithi131 bash[24745]: cluster 2024-09-13T23:17:42.095750+0000 mgr.a (mgr.14355) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:44.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:43 smithi171 bash[25040]: cluster 2024-09-13T23:17:42.095750+0000 mgr.a (mgr.14355) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:44.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:44.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:44.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:44.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:44.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:45 smithi007 bash[22722]: audit 2024-09-13T23:17:43.962685+0000 mgr.a (mgr.14355) 2460 : audit [DBG] from='client.65052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:45 smithi007 bash[22722]: cluster 2024-09-13T23:17:44.103293+0000 mgr.a (mgr.14355) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:45 smithi131 bash[24745]: audit 2024-09-13T23:17:43.962685+0000 mgr.a (mgr.14355) 2460 : audit [DBG] from='client.65052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:45 smithi131 bash[24745]: cluster 2024-09-13T23:17:44.103293+0000 mgr.a (mgr.14355) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:46.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:45 smithi171 bash[25040]: audit 2024-09-13T23:17:43.962685+0000 mgr.a (mgr.14355) 2460 : audit [DBG] from='client.65052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:46.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:45 smithi171 bash[25040]: cluster 2024-09-13T23:17:44.103293+0000 mgr.a (mgr.14355) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:47 smithi007 bash[22722]: cluster 2024-09-13T23:17:46.105655+0000 mgr.a (mgr.14355) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:48.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:47 smithi131 bash[24745]: cluster 2024-09-13T23:17:46.105655+0000 mgr.a (mgr.14355) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:48.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:47 smithi171 bash[25040]: cluster 2024-09-13T23:17:46.105655+0000 mgr.a (mgr.14355) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:49.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:49.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:49 smithi007 bash[22722]: cluster 2024-09-13T23:17:48.106471+0000 mgr.a (mgr.14355) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:50.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:49 smithi131 bash[24745]: cluster 2024-09-13T23:17:48.106471+0000 mgr.a (mgr.14355) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:50.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:49 smithi171 bash[25040]: cluster 2024-09-13T23:17:48.106471+0000 mgr.a (mgr.14355) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:50.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:50.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:50.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:50.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:50 smithi007 bash[22722]: audit 2024-09-13T23:17:49.739983+0000 mgr.a (mgr.14355) 2464 : audit [DBG] from='client.65127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:51.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:50 smithi131 bash[24745]: audit 2024-09-13T23:17:49.739983+0000 mgr.a (mgr.14355) 2464 : audit [DBG] from='client.65127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:51.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:50 smithi171 bash[25040]: audit 2024-09-13T23:17:49.739983+0000 mgr.a (mgr.14355) 2464 : audit [DBG] from='client.65127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:51 smithi007 bash[22722]: cluster 2024-09-13T23:17:50.106968+0000 mgr.a (mgr.14355) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:51 smithi131 bash[24745]: cluster 2024-09-13T23:17:50.106968+0000 mgr.a (mgr.14355) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:52.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:51 smithi171 bash[25040]: cluster 2024-09-13T23:17:50.106968+0000 mgr.a (mgr.14355) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:53 smithi007 bash[22722]: cluster 2024-09-13T23:17:52.109124+0000 mgr.a (mgr.14355) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:54.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:53 smithi131 bash[24745]: cluster 2024-09-13T23:17:52.109124+0000 mgr.a (mgr.14355) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:54.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:53 smithi171 bash[25040]: cluster 2024-09-13T23:17:52.109124+0000 mgr.a (mgr.14355) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:17:55.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:17:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:17:55.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:17:55.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:17:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:17:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:17:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:17:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:17:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:55 smithi007 bash[22722]: cluster 2024-09-13T23:17:54.109876+0000 mgr.a (mgr.14355) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:56.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:55 smithi131 bash[24745]: cluster 2024-09-13T23:17:54.109876+0000 mgr.a (mgr.14355) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:56.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:55 smithi171 bash[25040]: cluster 2024-09-13T23:17:54.109876+0000 mgr.a (mgr.14355) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:56 smithi007 bash[22722]: audit 2024-09-13T23:17:55.500525+0000 mgr.a (mgr.14355) 2468 : audit [DBG] from='client.65202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:56 smithi131 bash[24745]: audit 2024-09-13T23:17:55.500525+0000 mgr.a (mgr.14355) 2468 : audit [DBG] from='client.65202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:57.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:56 smithi171 bash[25040]: audit 2024-09-13T23:17:55.500525+0000 mgr.a (mgr.14355) 2468 : audit [DBG] from='client.65202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:17:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:57 smithi007 bash[22722]: cluster 2024-09-13T23:17:56.112509+0000 mgr.a (mgr.14355) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:57 smithi131 bash[24745]: cluster 2024-09-13T23:17:56.112509+0000 mgr.a (mgr.14355) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:58.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:57 smithi171 bash[25040]: cluster 2024-09-13T23:17:56.112509+0000 mgr.a (mgr.14355) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:17:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:17:59 smithi007 bash[22722]: cluster 2024-09-13T23:17:58.113271+0000 mgr.a (mgr.14355) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:17:59 smithi131 bash[24745]: cluster 2024-09-13T23:17:58.113271+0000 mgr.a (mgr.14355) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:00.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:17:59 smithi171 bash[25040]: cluster 2024-09-13T23:17:58.113271+0000 mgr.a (mgr.14355) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:00.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:00.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:01.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:01.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:02.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:01 smithi131 bash[24745]: cluster 2024-09-13T23:18:00.114159+0000 mgr.a (mgr.14355) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:18:02.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:01 smithi171 bash[25040]: cluster 2024-09-13T23:18:00.114159+0000 mgr.a (mgr.14355) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:18:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:01 smithi007 bash[22722]: cluster 2024-09-13T23:18:00.114159+0000 mgr.a (mgr.14355) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:18:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:02 smithi131 bash[24745]: audit 2024-09-13T23:18:01.265329+0000 mgr.a (mgr.14355) 2472 : audit [DBG] from='client.65280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:03.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:02 smithi171 bash[25040]: audit 2024-09-13T23:18:01.265329+0000 mgr.a (mgr.14355) 2472 : audit [DBG] from='client.65280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:02 smithi007 bash[22722]: audit 2024-09-13T23:18:01.265329+0000 mgr.a (mgr.14355) 2472 : audit [DBG] from='client.65280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:04.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:03 smithi131 bash[24745]: cluster 2024-09-13T23:18:02.116747+0000 mgr.a (mgr.14355) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:04.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:03 smithi171 bash[25040]: cluster 2024-09-13T23:18:02.116747+0000 mgr.a (mgr.14355) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:03 smithi007 bash[22722]: cluster 2024-09-13T23:18:02.116747+0000 mgr.a (mgr.14355) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:05 smithi131 bash[24745]: cluster 2024-09-13T23:18:04.117515+0000 mgr.a (mgr.14355) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:06.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:05 smithi171 bash[25040]: cluster 2024-09-13T23:18:04.117515+0000 mgr.a (mgr.14355) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:05 smithi007 bash[22722]: cluster 2024-09-13T23:18:04.117515+0000 mgr.a (mgr.14355) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:18:06.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:07.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:07.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:07 smithi131 bash[24745]: cluster 2024-09-13T23:18:06.119543+0000 mgr.a (mgr.14355) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:08.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:07 smithi171 bash[25040]: cluster 2024-09-13T23:18:06.119543+0000 mgr.a (mgr.14355) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:07 smithi007 bash[22722]: cluster 2024-09-13T23:18:06.119543+0000 mgr.a (mgr.14355) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:08 smithi131 bash[24745]: audit 2024-09-13T23:18:07.011232+0000 mgr.a (mgr.14355) 2476 : audit [DBG] from='client.65358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:09.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:08 smithi171 bash[25040]: audit 2024-09-13T23:18:07.011232+0000 mgr.a (mgr.14355) 2476 : audit [DBG] from='client.65358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:09.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:08 smithi007 bash[22722]: audit 2024-09-13T23:18:07.011232+0000 mgr.a (mgr.14355) 2476 : audit [DBG] from='client.65358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:10.031 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:09 smithi131 bash[24745]: cluster 2024-09-13T23:18:08.120419+0000 mgr.a (mgr.14355) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:10.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:09 smithi171 bash[25040]: cluster 2024-09-13T23:18:08.120419+0000 mgr.a (mgr.14355) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:09 smithi007 bash[22722]: cluster 2024-09-13T23:18:08.120419+0000 mgr.a (mgr.14355) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:11 smithi131 bash[24745]: cluster 2024-09-13T23:18:10.121204+0000 mgr.a (mgr.14355) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:12.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:11 smithi171 bash[25040]: cluster 2024-09-13T23:18:10.121204+0000 mgr.a (mgr.14355) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:11 smithi007 bash[22722]: cluster 2024-09-13T23:18:10.121204+0000 mgr.a (mgr.14355) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:13.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:13 smithi131 bash[24745]: cluster 2024-09-13T23:18:12.123431+0000 mgr.a (mgr.14355) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:13 smithi131 bash[24745]: audit 2024-09-13T23:18:12.754899+0000 mgr.a (mgr.14355) 2480 : audit [DBG] from='client.65436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:14.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:13 smithi171 bash[25040]: cluster 2024-09-13T23:18:12.123431+0000 mgr.a (mgr.14355) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:13 smithi171 bash[25040]: audit 2024-09-13T23:18:12.754899+0000 mgr.a (mgr.14355) 2480 : audit [DBG] from='client.65436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:13 smithi007 bash[22722]: cluster 2024-09-13T23:18:12.123431+0000 mgr.a (mgr.14355) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:13 smithi007 bash[22722]: audit 2024-09-13T23:18:12.754899+0000 mgr.a (mgr.14355) 2480 : audit [DBG] from='client.65436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:15 smithi131 bash[24745]: cluster 2024-09-13T23:18:14.124455+0000 mgr.a (mgr.14355) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:16.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:15 smithi171 bash[25040]: cluster 2024-09-13T23:18:14.124455+0000 mgr.a (mgr.14355) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:15 smithi007 bash[22722]: cluster 2024-09-13T23:18:14.124455+0000 mgr.a (mgr.14355) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:18.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:17 smithi131 bash[24745]: cluster 2024-09-13T23:18:16.126860+0000 mgr.a (mgr.14355) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:18.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:17 smithi171 bash[25040]: cluster 2024-09-13T23:18:16.126860+0000 mgr.a (mgr.14355) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:17 smithi007 bash[22722]: cluster 2024-09-13T23:18:16.126860+0000 mgr.a (mgr.14355) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:18.918 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:18.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:19 smithi131 bash[24745]: cluster 2024-09-13T23:18:18.127785+0000 mgr.a (mgr.14355) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:19 smithi131 bash[24745]: audit 2024-09-13T23:18:18.514310+0000 mgr.a (mgr.14355) 2484 : audit [DBG] from='client.65514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:19 smithi171 bash[25040]: cluster 2024-09-13T23:18:18.127785+0000 mgr.a (mgr.14355) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:20.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:19 smithi171 bash[25040]: audit 2024-09-13T23:18:18.514310+0000 mgr.a (mgr.14355) 2484 : audit [DBG] from='client.65514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:19 smithi007 bash[22722]: cluster 2024-09-13T23:18:18.127785+0000 mgr.a (mgr.14355) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:19 smithi007 bash[22722]: audit 2024-09-13T23:18:18.514310+0000 mgr.a (mgr.14355) 2484 : audit [DBG] from='client.65514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:21 smithi131 bash[24745]: cluster 2024-09-13T23:18:20.128694+0000 mgr.a (mgr.14355) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:21 smithi171 bash[25040]: cluster 2024-09-13T23:18:20.128694+0000 mgr.a (mgr.14355) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:21 smithi007 bash[22722]: cluster 2024-09-13T23:18:20.128694+0000 mgr.a (mgr.14355) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:23.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:23.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:23 smithi131 bash[24745]: cluster 2024-09-13T23:18:22.130910+0000 mgr.a (mgr.14355) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:23 smithi131 bash[24745]: audit 2024-09-13T23:18:22.911568+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:18:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:23 smithi131 bash[24745]: audit 2024-09-13T23:18:23.540586+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:23 smithi131 bash[24745]: audit 2024-09-13T23:18:23.544408+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:23 smithi171 bash[25040]: cluster 2024-09-13T23:18:22.130910+0000 mgr.a (mgr.14355) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:23 smithi171 bash[25040]: audit 2024-09-13T23:18:22.911568+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:18:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:23 smithi171 bash[25040]: audit 2024-09-13T23:18:23.540586+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:23 smithi171 bash[25040]: audit 2024-09-13T23:18:23.544408+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:23 smithi007 bash[22722]: cluster 2024-09-13T23:18:22.130910+0000 mgr.a (mgr.14355) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:23 smithi007 bash[22722]: audit 2024-09-13T23:18:22.911568+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:18:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:23 smithi007 bash[22722]: audit 2024-09-13T23:18:23.540586+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:23 smithi007 bash[22722]: audit 2024-09-13T23:18:23.544408+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:24.652 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:24.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:24.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:24 smithi131 bash[24745]: audit 2024-09-13T23:18:24.318498+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:18:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:24 smithi131 bash[24745]: audit 2024-09-13T23:18:24.319389+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:18:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:24 smithi131 bash[24745]: audit 2024-09-13T23:18:24.324601+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:24 smithi131 bash[24745]: audit 2024-09-13T23:18:24.326974+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:24 smithi171 bash[25040]: audit 2024-09-13T23:18:24.318498+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:18:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:24 smithi171 bash[25040]: audit 2024-09-13T23:18:24.319389+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:18:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:24 smithi171 bash[25040]: audit 2024-09-13T23:18:24.324601+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:24 smithi171 bash[25040]: audit 2024-09-13T23:18:24.326974+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:25.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:24 smithi007 bash[22722]: audit 2024-09-13T23:18:24.318498+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:18:25.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:24 smithi007 bash[22722]: audit 2024-09-13T23:18:24.319389+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:18:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:24 smithi007 bash[22722]: audit 2024-09-13T23:18:24.324601+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:18:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:24 smithi007 bash[22722]: audit 2024-09-13T23:18:24.326974+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:18:25 smithi007 bash[22972]: debug 2024-09-13T23:18:25.324+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:18:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:18:25 smithi007 bash[22972]: debug 2024-09-13T23:18:25.324+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:18:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:25 smithi131 bash[24745]: cluster 2024-09-13T23:18:24.131587+0000 mgr.a (mgr.14355) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:25 smithi131 bash[24745]: audit 2024-09-13T23:18:24.248566+0000 mgr.a (mgr.14355) 2488 : audit [DBG] from='client.65586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:25 smithi131 bash[24745]: audit 2024-09-13T23:18:24.328344+0000 mgr.a (mgr.14355) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:25 smithi171 bash[25040]: cluster 2024-09-13T23:18:24.131587+0000 mgr.a (mgr.14355) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:25 smithi171 bash[25040]: audit 2024-09-13T23:18:24.248566+0000 mgr.a (mgr.14355) 2488 : audit [DBG] from='client.65586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:25 smithi171 bash[25040]: audit 2024-09-13T23:18:24.328344+0000 mgr.a (mgr.14355) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:25 smithi007 bash[22722]: cluster 2024-09-13T23:18:24.131587+0000 mgr.a (mgr.14355) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:25 smithi007 bash[22722]: audit 2024-09-13T23:18:24.248566+0000 mgr.a (mgr.14355) 2488 : audit [DBG] from='client.65586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:25 smithi007 bash[22722]: audit 2024-09-13T23:18:24.328344+0000 mgr.a (mgr.14355) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:18:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:26 smithi131 bash[24745]: audit 2024-09-13T23:18:25.326475+0000 mgr.a (mgr.14355) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:18:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:26 smithi131 bash[24745]: cephadm 2024-09-13T23:18:25.327754+0000 mgr.a (mgr.14355) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:18:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:26 smithi171 bash[25040]: audit 2024-09-13T23:18:25.326475+0000 mgr.a (mgr.14355) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:18:27.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:26 smithi171 bash[25040]: cephadm 2024-09-13T23:18:25.327754+0000 mgr.a (mgr.14355) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:18:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:26 smithi007 bash[22722]: audit 2024-09-13T23:18:25.326475+0000 mgr.a (mgr.14355) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:18:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:26 smithi007 bash[22722]: cephadm 2024-09-13T23:18:25.327754+0000 mgr.a (mgr.14355) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:18:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:27 smithi171 bash[25040]: cluster 2024-09-13T23:18:26.133893+0000 mgr.a (mgr.14355) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T23:18:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:27 smithi007 bash[22722]: cluster 2024-09-13T23:18:26.133893+0000 mgr.a (mgr.14355) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T23:18:28.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:27 smithi131 bash[24745]: cluster 2024-09-13T23:18:26.133893+0000 mgr.a (mgr.14355) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T23:18:29.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:29.654 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:29.654 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:30.044 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:29 smithi171 bash[25040]: cluster 2024-09-13T23:18:28.134862+0000 mgr.a (mgr.14355) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:29 smithi007 bash[22722]: cluster 2024-09-13T23:18:28.134862+0000 mgr.a (mgr.14355) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:29 smithi131 bash[24745]: cluster 2024-09-13T23:18:28.134862+0000 mgr.a (mgr.14355) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:30.396 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:30.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:30.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:30.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:30.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:31 smithi171 bash[25040]: audit 2024-09-13T23:18:29.980753+0000 mgr.a (mgr.14355) 2494 : audit [DBG] from='client.65769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:31 smithi171 bash[25040]: cluster 2024-09-13T23:18:30.135717+0000 mgr.a (mgr.14355) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:31 smithi007 bash[22722]: audit 2024-09-13T23:18:29.980753+0000 mgr.a (mgr.14355) 2494 : audit [DBG] from='client.65769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:31 smithi007 bash[22722]: cluster 2024-09-13T23:18:30.135717+0000 mgr.a (mgr.14355) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:32.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:31 smithi131 bash[24745]: audit 2024-09-13T23:18:29.980753+0000 mgr.a (mgr.14355) 2494 : audit [DBG] from='client.65769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:32.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:31 smithi131 bash[24745]: cluster 2024-09-13T23:18:30.135717+0000 mgr.a (mgr.14355) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T23:18:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:33 smithi007 bash[22722]: cluster 2024-09-13T23:18:32.138563+0000 mgr.a (mgr.14355) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:34.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:33 smithi131 bash[24745]: cluster 2024-09-13T23:18:32.138563+0000 mgr.a (mgr.14355) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:34.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:33 smithi171 bash[25040]: cluster 2024-09-13T23:18:32.138563+0000 mgr.a (mgr.14355) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:36.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:35 smithi007 bash[22722]: cluster 2024-09-13T23:18:34.139510+0000 mgr.a (mgr.14355) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:18:36.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:35 smithi131 bash[24745]: cluster 2024-09-13T23:18:34.139510+0000 mgr.a (mgr.14355) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:18:36.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:35 smithi171 bash[25040]: cluster 2024-09-13T23:18:34.139510+0000 mgr.a (mgr.14355) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:18:37.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:36 smithi007 bash[22722]: audit 2024-09-13T23:18:35.736787+0000 mgr.a (mgr.14355) 2498 : audit [DBG] from='client.65847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:37.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:36 smithi131 bash[24745]: audit 2024-09-13T23:18:35.736787+0000 mgr.a (mgr.14355) 2498 : audit [DBG] from='client.65847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:37.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:36 smithi171 bash[25040]: audit 2024-09-13T23:18:35.736787+0000 mgr.a (mgr.14355) 2498 : audit [DBG] from='client.65847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:37 smithi007 bash[22722]: cluster 2024-09-13T23:18:36.141122+0000 mgr.a (mgr.14355) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:38.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:37 smithi131 bash[24745]: cluster 2024-09-13T23:18:36.141122+0000 mgr.a (mgr.14355) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:37 smithi171 bash[25040]: cluster 2024-09-13T23:18:36.141122+0000 mgr.a (mgr.14355) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:18:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:39 smithi007 bash[22722]: cluster 2024-09-13T23:18:38.142020+0000 mgr.a (mgr.14355) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:40.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:39 smithi131 bash[24745]: cluster 2024-09-13T23:18:38.142020+0000 mgr.a (mgr.14355) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:39 smithi171 bash[25040]: cluster 2024-09-13T23:18:38.142020+0000 mgr.a (mgr.14355) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:41.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:41 smithi007 bash[22722]: cluster 2024-09-13T23:18:40.142983+0000 mgr.a (mgr.14355) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:42.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:41 smithi131 bash[24745]: cluster 2024-09-13T23:18:40.142983+0000 mgr.a (mgr.14355) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:42.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:41 smithi171 bash[25040]: cluster 2024-09-13T23:18:40.142983+0000 mgr.a (mgr.14355) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:18:43.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:42 smithi007 bash[22722]: audit 2024-09-13T23:18:41.512951+0000 mgr.a (mgr.14355) 2502 : audit [DBG] from='client.65922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:42 smithi131 bash[24745]: audit 2024-09-13T23:18:41.512951+0000 mgr.a (mgr.14355) 2502 : audit [DBG] from='client.65922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:43.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:42 smithi171 bash[25040]: audit 2024-09-13T23:18:41.512951+0000 mgr.a (mgr.14355) 2502 : audit [DBG] from='client.65922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:43 smithi007 bash[22722]: cluster 2024-09-13T23:18:42.145921+0000 mgr.a (mgr.14355) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:18:44.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:43 smithi131 bash[24745]: cluster 2024-09-13T23:18:42.145921+0000 mgr.a (mgr.14355) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:18:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:43 smithi171 bash[25040]: cluster 2024-09-13T23:18:42.145921+0000 mgr.a (mgr.14355) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T23:18:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:45 smithi007 bash[22722]: cluster 2024-09-13T23:18:44.146793+0000 mgr.a (mgr.14355) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:18:46.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:45 smithi131 bash[24745]: cluster 2024-09-13T23:18:44.146793+0000 mgr.a (mgr.14355) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:18:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:45 smithi171 bash[25040]: cluster 2024-09-13T23:18:44.146793+0000 mgr.a (mgr.14355) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:18:46.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:46.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:47.727 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:47.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:47.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:47.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:47.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:47 smithi007 bash[22722]: cluster 2024-09-13T23:18:46.148816+0000 mgr.a (mgr.14355) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:18:48.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:47 smithi131 bash[24745]: cluster 2024-09-13T23:18:46.148816+0000 mgr.a (mgr.14355) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:18:48.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:47 smithi171 bash[25040]: cluster 2024-09-13T23:18:46.148816+0000 mgr.a (mgr.14355) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:18:49.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:48 smithi007 bash[22722]: audit 2024-09-13T23:18:47.286580+0000 mgr.a (mgr.14355) 2506 : audit [DBG] from='client.66000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:49.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:48 smithi131 bash[24745]: audit 2024-09-13T23:18:47.286580+0000 mgr.a (mgr.14355) 2506 : audit [DBG] from='client.66000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:49.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:48 smithi171 bash[25040]: audit 2024-09-13T23:18:47.286580+0000 mgr.a (mgr.14355) 2506 : audit [DBG] from='client.66000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:49 smithi007 bash[22722]: cluster 2024-09-13T23:18:48.149784+0000 mgr.a (mgr.14355) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:50.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:49 smithi131 bash[24745]: cluster 2024-09-13T23:18:48.149784+0000 mgr.a (mgr.14355) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:49 smithi171 bash[25040]: cluster 2024-09-13T23:18:48.149784+0000 mgr.a (mgr.14355) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:51 smithi007 bash[22722]: cluster 2024-09-13T23:18:50.150622+0000 mgr.a (mgr.14355) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:52.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:51 smithi131 bash[24745]: cluster 2024-09-13T23:18:50.150622+0000 mgr.a (mgr.14355) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:52.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:51 smithi171 bash[25040]: cluster 2024-09-13T23:18:50.150622+0000 mgr.a (mgr.14355) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:52.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:53.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:52 smithi007 bash[22722]: cluster 2024-09-13T23:18:52.152874+0000 mgr.a (mgr.14355) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:53.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:52 smithi131 bash[24745]: cluster 2024-09-13T23:18:52.152874+0000 mgr.a (mgr.14355) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:52 smithi171 bash[25040]: cluster 2024-09-13T23:18:52.152874+0000 mgr.a (mgr.14355) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:53 smithi007 bash[22722]: audit 2024-09-13T23:18:53.075480+0000 mgr.a (mgr.14355) 2510 : audit [DBG] from='client.66078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:54.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:53 smithi131 bash[24745]: audit 2024-09-13T23:18:53.075480+0000 mgr.a (mgr.14355) 2510 : audit [DBG] from='client.66078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:54.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:53 smithi171 bash[25040]: audit 2024-09-13T23:18:53.075480+0000 mgr.a (mgr.14355) 2510 : audit [DBG] from='client.66078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:18:55.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:54 smithi007 bash[22722]: cluster 2024-09-13T23:18:54.153810+0000 mgr.a (mgr.14355) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:55.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:54 smithi131 bash[24745]: cluster 2024-09-13T23:18:54.153810+0000 mgr.a (mgr.14355) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:54 smithi171 bash[25040]: cluster 2024-09-13T23:18:54.153810+0000 mgr.a (mgr.14355) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:57.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:57 smithi131 bash[24745]: cluster 2024-09-13T23:18:56.156080+0000 mgr.a (mgr.14355) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:57 smithi171 bash[25040]: cluster 2024-09-13T23:18:56.156080+0000 mgr.a (mgr.14355) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:57 smithi007 bash[22722]: cluster 2024-09-13T23:18:56.156080+0000 mgr.a (mgr.14355) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:18:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:18:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:18:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:18:59.295 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:18:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:18:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:18:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:18:59.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:18:59.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:18:59 smithi131 bash[24745]: cluster 2024-09-13T23:18:58.156852+0000 mgr.a (mgr.14355) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:59.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:18:59 smithi171 bash[25040]: cluster 2024-09-13T23:18:58.156852+0000 mgr.a (mgr.14355) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:18:59.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:18:59 smithi007 bash[22722]: cluster 2024-09-13T23:18:58.156852+0000 mgr.a (mgr.14355) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:00 smithi131 bash[24745]: audit 2024-09-13T23:18:58.857112+0000 mgr.a (mgr.14355) 2514 : audit [DBG] from='client.66156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:00 smithi171 bash[25040]: audit 2024-09-13T23:18:58.857112+0000 mgr.a (mgr.14355) 2514 : audit [DBG] from='client.66156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:00 smithi007 bash[22722]: audit 2024-09-13T23:18:58.857112+0000 mgr.a (mgr.14355) 2514 : audit [DBG] from='client.66156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:01.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:01 smithi131 bash[24745]: cluster 2024-09-13T23:19:00.157812+0000 mgr.a (mgr.14355) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:01.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:01 smithi171 bash[25040]: cluster 2024-09-13T23:19:00.157812+0000 mgr.a (mgr.14355) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:01 smithi007 bash[22722]: cluster 2024-09-13T23:19:00.157812+0000 mgr.a (mgr.14355) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:03.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:03 smithi131 bash[24745]: cluster 2024-09-13T23:19:02.160087+0000 mgr.a (mgr.14355) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:03 smithi171 bash[25040]: cluster 2024-09-13T23:19:02.160087+0000 mgr.a (mgr.14355) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:03 smithi007 bash[22722]: cluster 2024-09-13T23:19:02.160087+0000 mgr.a (mgr.14355) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:04.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:05.044 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:05.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:05.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:05.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:05.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:05 smithi131 bash[24745]: cluster 2024-09-13T23:19:04.160867+0000 mgr.a (mgr.14355) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:05 smithi131 bash[24745]: audit 2024-09-13T23:19:04.629101+0000 mgr.a (mgr.14355) 2518 : audit [DBG] from='client.66234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:05 smithi171 bash[25040]: cluster 2024-09-13T23:19:04.160867+0000 mgr.a (mgr.14355) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:05 smithi171 bash[25040]: audit 2024-09-13T23:19:04.629101+0000 mgr.a (mgr.14355) 2518 : audit [DBG] from='client.66234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:05 smithi007 bash[22722]: cluster 2024-09-13T23:19:04.160867+0000 mgr.a (mgr.14355) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:05 smithi007 bash[22722]: audit 2024-09-13T23:19:04.629101+0000 mgr.a (mgr.14355) 2518 : audit [DBG] from='client.66234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:07 smithi131 bash[24745]: cluster 2024-09-13T23:19:06.163331+0000 mgr.a (mgr.14355) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:07.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:07 smithi171 bash[25040]: cluster 2024-09-13T23:19:06.163331+0000 mgr.a (mgr.14355) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:07.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:07 smithi007 bash[22722]: cluster 2024-09-13T23:19:06.163331+0000 mgr.a (mgr.14355) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:09.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:09 smithi131 bash[24745]: cluster 2024-09-13T23:19:08.164142+0000 mgr.a (mgr.14355) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:09 smithi171 bash[25040]: cluster 2024-09-13T23:19:08.164142+0000 mgr.a (mgr.14355) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:09 smithi007 bash[22722]: cluster 2024-09-13T23:19:08.164142+0000 mgr.a (mgr.14355) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:10.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:10.822 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:11 smithi131 bash[24745]: cluster 2024-09-13T23:19:10.164668+0000 mgr.a (mgr.14355) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:11 smithi131 bash[24745]: audit 2024-09-13T23:19:10.383786+0000 mgr.a (mgr.14355) 2522 : audit [DBG] from='client.66312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:11.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:11 smithi171 bash[25040]: cluster 2024-09-13T23:19:10.164668+0000 mgr.a (mgr.14355) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:11 smithi171 bash[25040]: audit 2024-09-13T23:19:10.383786+0000 mgr.a (mgr.14355) 2522 : audit [DBG] from='client.66312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:11 smithi007 bash[22722]: cluster 2024-09-13T23:19:10.164668+0000 mgr.a (mgr.14355) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:11 smithi007 bash[22722]: audit 2024-09-13T23:19:10.383786+0000 mgr.a (mgr.14355) 2522 : audit [DBG] from='client.66312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:13.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:13 smithi131 bash[24745]: cluster 2024-09-13T23:19:12.167415+0000 mgr.a (mgr.14355) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:13 smithi171 bash[25040]: cluster 2024-09-13T23:19:12.167415+0000 mgr.a (mgr.14355) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:13 smithi007 bash[22722]: cluster 2024-09-13T23:19:12.167415+0000 mgr.a (mgr.14355) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:15.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:15 smithi131 bash[24745]: cluster 2024-09-13T23:19:14.168203+0000 mgr.a (mgr.14355) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:15 smithi171 bash[25040]: cluster 2024-09-13T23:19:14.168203+0000 mgr.a (mgr.14355) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:15.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:15 smithi007 bash[22722]: cluster 2024-09-13T23:19:14.168203+0000 mgr.a (mgr.14355) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:16.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:16.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:17.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:17 smithi131 bash[24745]: audit 2024-09-13T23:19:16.159069+0000 mgr.a (mgr.14355) 2525 : audit [DBG] from='client.66390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:17.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:17 smithi131 bash[24745]: cluster 2024-09-13T23:19:16.179298+0000 mgr.a (mgr.14355) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:17 smithi171 bash[25040]: audit 2024-09-13T23:19:16.159069+0000 mgr.a (mgr.14355) 2525 : audit [DBG] from='client.66390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:17 smithi171 bash[25040]: cluster 2024-09-13T23:19:16.179298+0000 mgr.a (mgr.14355) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:17 smithi007 bash[22722]: audit 2024-09-13T23:19:16.159069+0000 mgr.a (mgr.14355) 2525 : audit [DBG] from='client.66390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:17 smithi007 bash[22722]: cluster 2024-09-13T23:19:16.179298+0000 mgr.a (mgr.14355) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:19.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:19 smithi131 bash[24745]: cluster 2024-09-13T23:19:18.180403+0000 mgr.a (mgr.14355) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:19 smithi171 bash[25040]: cluster 2024-09-13T23:19:18.180403+0000 mgr.a (mgr.14355) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:19 smithi007 bash[22722]: cluster 2024-09-13T23:19:18.180403+0000 mgr.a (mgr.14355) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:21.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:21 smithi131 bash[24745]: cluster 2024-09-13T23:19:20.181148+0000 mgr.a (mgr.14355) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:21 smithi171 bash[25040]: cluster 2024-09-13T23:19:20.181148+0000 mgr.a (mgr.14355) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:21.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:21.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:21.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:21 smithi007 bash[22722]: cluster 2024-09-13T23:19:20.181148+0000 mgr.a (mgr.14355) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:22.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:23 smithi131 bash[24745]: audit 2024-09-13T23:19:21.925836+0000 mgr.a (mgr.14355) 2529 : audit [DBG] from='client.66468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:23 smithi131 bash[24745]: cluster 2024-09-13T23:19:22.182510+0000 mgr.a (mgr.14355) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:23 smithi171 bash[25040]: audit 2024-09-13T23:19:21.925836+0000 mgr.a (mgr.14355) 2529 : audit [DBG] from='client.66468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:23 smithi171 bash[25040]: cluster 2024-09-13T23:19:22.182510+0000 mgr.a (mgr.14355) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:23 smithi007 bash[22722]: audit 2024-09-13T23:19:21.925836+0000 mgr.a (mgr.14355) 2529 : audit [DBG] from='client.66468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:23 smithi007 bash[22722]: cluster 2024-09-13T23:19:22.182510+0000 mgr.a (mgr.14355) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:25.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:25 smithi131 bash[24745]: cluster 2024-09-13T23:19:24.183424+0000 mgr.a (mgr.14355) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:25 smithi171 bash[25040]: cluster 2024-09-13T23:19:24.183424+0000 mgr.a (mgr.14355) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:25 smithi007 bash[22722]: cluster 2024-09-13T23:19:24.183424+0000 mgr.a (mgr.14355) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:26.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:26 smithi131 bash[24745]: audit 2024-09-13T23:19:25.381181+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:19:26.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:26 smithi131 bash[24745]: audit 2024-09-13T23:19:25.996103+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:26 smithi131 bash[24745]: audit 2024-09-13T23:19:25.999261+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:26 smithi131 bash[24745]: audit 2024-09-13T23:19:26.002227+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:26 smithi131 bash[24745]: audit 2024-09-13T23:19:26.004965+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:26 smithi171 bash[25040]: audit 2024-09-13T23:19:25.381181+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:26 smithi171 bash[25040]: audit 2024-09-13T23:19:25.996103+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:26 smithi171 bash[25040]: audit 2024-09-13T23:19:25.999261+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:26 smithi171 bash[25040]: audit 2024-09-13T23:19:26.002227+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:26 smithi171 bash[25040]: audit 2024-09-13T23:19:26.004965+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:26 smithi007 bash[22722]: audit 2024-09-13T23:19:25.381181+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:19:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:26 smithi007 bash[22722]: audit 2024-09-13T23:19:25.996103+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:26 smithi007 bash[22722]: audit 2024-09-13T23:19:25.999261+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:26 smithi007 bash[22722]: audit 2024-09-13T23:19:26.002227+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:26 smithi007 bash[22722]: audit 2024-09-13T23:19:26.004965+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:27.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:27 smithi171 bash[25040]: cluster 2024-09-13T23:19:26.184922+0000 mgr.a (mgr.14355) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:27 smithi007 bash[22722]: cluster 2024-09-13T23:19:26.184922+0000 mgr.a (mgr.14355) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:27 smithi131 bash[24745]: cluster 2024-09-13T23:19:26.184922+0000 mgr.a (mgr.14355) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:28.089 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:28.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:28.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:28.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:28.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:28 smithi171 bash[25040]: audit 2024-09-13T23:19:27.676112+0000 mgr.a (mgr.14355) 2533 : audit [DBG] from='client.66546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:28 smithi007 bash[22722]: audit 2024-09-13T23:19:27.676112+0000 mgr.a (mgr.14355) 2533 : audit [DBG] from='client.66546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:28 smithi131 bash[24745]: audit 2024-09-13T23:19:27.676112+0000 mgr.a (mgr.14355) 2533 : audit [DBG] from='client.66546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:29 smithi007 bash[22722]: cluster 2024-09-13T23:19:28.185864+0000 mgr.a (mgr.14355) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:29 smithi131 bash[24745]: cluster 2024-09-13T23:19:28.185864+0000 mgr.a (mgr.14355) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:29 smithi171 bash[25040]: cluster 2024-09-13T23:19:28.185864+0000 mgr.a (mgr.14355) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:31.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:31 smithi007 bash[22722]: cluster 2024-09-13T23:19:30.186682+0000 mgr.a (mgr.14355) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:31 smithi131 bash[24745]: cluster 2024-09-13T23:19:30.186682+0000 mgr.a (mgr.14355) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:31.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:31 smithi171 bash[25040]: cluster 2024-09-13T23:19:30.186682+0000 mgr.a (mgr.14355) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:33.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:33 smithi007 bash[22722]: cluster 2024-09-13T23:19:32.188945+0000 mgr.a (mgr.14355) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:33 smithi131 bash[24745]: cluster 2024-09-13T23:19:32.188945+0000 mgr.a (mgr.14355) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:33.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:33 smithi171 bash[25040]: cluster 2024-09-13T23:19:32.188945+0000 mgr.a (mgr.14355) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:33.832 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:34 smithi007 bash[22722]: audit 2024-09-13T23:19:33.420817+0000 mgr.a (mgr.14355) 2537 : audit [DBG] from='client.66624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:34 smithi131 bash[24745]: audit 2024-09-13T23:19:33.420817+0000 mgr.a (mgr.14355) 2537 : audit [DBG] from='client.66624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:34.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:34 smithi171 bash[25040]: audit 2024-09-13T23:19:33.420817+0000 mgr.a (mgr.14355) 2537 : audit [DBG] from='client.66624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:35 smithi007 bash[22722]: cluster 2024-09-13T23:19:34.189898+0000 mgr.a (mgr.14355) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:35 smithi131 bash[24745]: cluster 2024-09-13T23:19:34.189898+0000 mgr.a (mgr.14355) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:35 smithi171 bash[25040]: cluster 2024-09-13T23:19:34.189898+0000 mgr.a (mgr.14355) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:37.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22972]: debug 2024-09-13T23:19:36.775+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:19:37.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22972]: debug 2024-09-13T23:19:36.775+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:19:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:35.996233+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.001584+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.003480+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.005028+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.012619+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.016016+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.018368+0000 mgr.a (mgr.14355) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: cluster 2024-09-13T23:19:36.191324+0000 mgr.a (mgr.14355) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: audit 2024-09-13T23:19:36.778955+0000 mgr.a (mgr.14355) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:19:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:36 smithi007 bash[22722]: cephadm 2024-09-13T23:19:36.780579+0000 mgr.a (mgr.14355) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:19:37.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:35.996233+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.001584+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.003480+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.005028+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.012619+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.016016+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.018368+0000 mgr.a (mgr.14355) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: cluster 2024-09-13T23:19:36.191324+0000 mgr.a (mgr.14355) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: audit 2024-09-13T23:19:36.778955+0000 mgr.a (mgr.14355) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:36 smithi131 bash[24745]: cephadm 2024-09-13T23:19:36.780579+0000 mgr.a (mgr.14355) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:35.996233+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.001584+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.003480+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.005028+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.012619+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.016016+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.018368+0000 mgr.a (mgr.14355) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:19:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: cluster 2024-09-13T23:19:36.191324+0000 mgr.a (mgr.14355) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:19:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: audit 2024-09-13T23:19:36.778955+0000 mgr.a (mgr.14355) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:19:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:36 smithi171 bash[25040]: cephadm 2024-09-13T23:19:36.780579+0000 mgr.a (mgr.14355) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:19:38.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:38.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:39.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:39 smithi131 bash[24745]: cluster 2024-09-13T23:19:38.192166+0000 mgr.a (mgr.14355) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:39 smithi171 bash[25040]: cluster 2024-09-13T23:19:38.192166+0000 mgr.a (mgr.14355) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:39.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:39.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:39.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:39 smithi007 bash[22722]: cluster 2024-09-13T23:19:38.192166+0000 mgr.a (mgr.14355) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:40.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:40 smithi131 bash[24745]: audit 2024-09-13T23:19:39.168619+0000 mgr.a (mgr.14355) 2544 : audit [DBG] from='client.66810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:40 smithi171 bash[25040]: audit 2024-09-13T23:19:39.168619+0000 mgr.a (mgr.14355) 2544 : audit [DBG] from='client.66810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:40.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:40 smithi007 bash[22722]: audit 2024-09-13T23:19:39.168619+0000 mgr.a (mgr.14355) 2544 : audit [DBG] from='client.66810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:41.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:41 smithi131 bash[24745]: cluster 2024-09-13T23:19:40.193139+0000 mgr.a (mgr.14355) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:41 smithi171 bash[25040]: cluster 2024-09-13T23:19:40.193139+0000 mgr.a (mgr.14355) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:41 smithi007 bash[22722]: cluster 2024-09-13T23:19:40.193139+0000 mgr.a (mgr.14355) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:43.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:43 smithi131 bash[24745]: cluster 2024-09-13T23:19:42.195425+0000 mgr.a (mgr.14355) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:43 smithi171 bash[25040]: cluster 2024-09-13T23:19:42.195425+0000 mgr.a (mgr.14355) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:43 smithi007 bash[22722]: cluster 2024-09-13T23:19:42.195425+0000 mgr.a (mgr.14355) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:44.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:45.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:45.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:45.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:45.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:45.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:45 smithi131 bash[24745]: cluster 2024-09-13T23:19:44.196198+0000 mgr.a (mgr.14355) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:45 smithi171 bash[25040]: cluster 2024-09-13T23:19:44.196198+0000 mgr.a (mgr.14355) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:45 smithi007 bash[22722]: cluster 2024-09-13T23:19:44.196198+0000 mgr.a (mgr.14355) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:46.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:46 smithi131 bash[24745]: audit 2024-09-13T23:19:44.923208+0000 mgr.a (mgr.14355) 2548 : audit [DBG] from='client.66888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:46 smithi171 bash[25040]: audit 2024-09-13T23:19:44.923208+0000 mgr.a (mgr.14355) 2548 : audit [DBG] from='client.66888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:46 smithi007 bash[22722]: audit 2024-09-13T23:19:44.923208+0000 mgr.a (mgr.14355) 2548 : audit [DBG] from='client.66888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:47.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:47 smithi131 bash[24745]: cluster 2024-09-13T23:19:46.198622+0000 mgr.a (mgr.14355) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:47 smithi171 bash[25040]: cluster 2024-09-13T23:19:46.198622+0000 mgr.a (mgr.14355) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:47.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:47 smithi007 bash[22722]: cluster 2024-09-13T23:19:46.198622+0000 mgr.a (mgr.14355) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:49 smithi171 bash[25040]: cluster 2024-09-13T23:19:48.199446+0000 mgr.a (mgr.14355) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:49 smithi007 bash[22722]: cluster 2024-09-13T23:19:48.199446+0000 mgr.a (mgr.14355) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:49 smithi131 bash[24745]: cluster 2024-09-13T23:19:48.199446+0000 mgr.a (mgr.14355) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:50.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:50.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:50.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:51.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:51.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:51 smithi171 bash[25040]: cluster 2024-09-13T23:19:50.200206+0000 mgr.a (mgr.14355) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:51 smithi171 bash[25040]: audit 2024-09-13T23:19:50.668044+0000 mgr.a (mgr.14355) 2552 : audit [DBG] from='client.66966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:51 smithi007 bash[22722]: cluster 2024-09-13T23:19:50.200206+0000 mgr.a (mgr.14355) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:51 smithi007 bash[22722]: audit 2024-09-13T23:19:50.668044+0000 mgr.a (mgr.14355) 2552 : audit [DBG] from='client.66966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:51 smithi131 bash[24745]: cluster 2024-09-13T23:19:50.200206+0000 mgr.a (mgr.14355) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:19:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:51 smithi131 bash[24745]: audit 2024-09-13T23:19:50.668044+0000 mgr.a (mgr.14355) 2552 : audit [DBG] from='client.66966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:53 smithi171 bash[25040]: cluster 2024-09-13T23:19:52.203168+0000 mgr.a (mgr.14355) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:53.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:53 smithi007 bash[22722]: cluster 2024-09-13T23:19:52.203168+0000 mgr.a (mgr.14355) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:53 smithi131 bash[24745]: cluster 2024-09-13T23:19:52.203168+0000 mgr.a (mgr.14355) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:19:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:55 smithi007 bash[22722]: cluster 2024-09-13T23:19:54.203989+0000 mgr.a (mgr.14355) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:55 smithi131 bash[24745]: cluster 2024-09-13T23:19:54.203989+0000 mgr.a (mgr.14355) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:55 smithi171 bash[25040]: cluster 2024-09-13T23:19:54.203989+0000 mgr.a (mgr.14355) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:19:56.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:19:56.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:19:56.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:19:56.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:19:56.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:19:56.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:19:56.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:19:56.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:19:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:57 smithi007 bash[22722]: cluster 2024-09-13T23:19:56.205134+0000 mgr.a (mgr.14355) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:57 smithi007 bash[22722]: audit 2024-09-13T23:19:56.437636+0000 mgr.a (mgr.14355) 2556 : audit [DBG] from='client.67041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:57 smithi131 bash[24745]: cluster 2024-09-13T23:19:56.205134+0000 mgr.a (mgr.14355) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:57 smithi131 bash[24745]: audit 2024-09-13T23:19:56.437636+0000 mgr.a (mgr.14355) 2556 : audit [DBG] from='client.67041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:57 smithi171 bash[25040]: cluster 2024-09-13T23:19:56.205134+0000 mgr.a (mgr.14355) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:57 smithi171 bash[25040]: audit 2024-09-13T23:19:56.437636+0000 mgr.a (mgr.14355) 2556 : audit [DBG] from='client.67041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:19:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:19:59 smithi007 bash[22722]: cluster 2024-09-13T23:19:58.205982+0000 mgr.a (mgr.14355) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:19:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:19:59 smithi131 bash[24745]: cluster 2024-09-13T23:19:58.205982+0000 mgr.a (mgr.14355) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:19:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:19:59 smithi171 bash[25040]: cluster 2024-09-13T23:19:58.205982+0000 mgr.a (mgr.14355) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:20:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:00 smithi007 bash[22722]: cluster 2024-09-13T23:20:00.000152+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:20:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:00 smithi131 bash[24745]: cluster 2024-09-13T23:20:00.000152+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:20:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:00 smithi171 bash[25040]: cluster 2024-09-13T23:20:00.000152+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:20:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:01 smithi007 bash[22722]: cluster 2024-09-13T23:20:00.206784+0000 mgr.a (mgr.14355) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:20:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:01 smithi131 bash[24745]: cluster 2024-09-13T23:20:00.206784+0000 mgr.a (mgr.14355) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:20:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:01 smithi171 bash[25040]: cluster 2024-09-13T23:20:00.206784+0000 mgr.a (mgr.14355) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:20:01.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:01.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:01.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:02.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:02.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:02.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:03.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:03 smithi007 bash[22722]: audit 2024-09-13T23:20:02.190242+0000 mgr.a (mgr.14355) 2559 : audit [DBG] from='client.67119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:03 smithi007 bash[22722]: cluster 2024-09-13T23:20:02.208059+0000 mgr.a (mgr.14355) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:20:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:03 smithi131 bash[24745]: audit 2024-09-13T23:20:02.190242+0000 mgr.a (mgr.14355) 2559 : audit [DBG] from='client.67119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:03 smithi131 bash[24745]: cluster 2024-09-13T23:20:02.208059+0000 mgr.a (mgr.14355) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:20:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:03 smithi171 bash[25040]: audit 2024-09-13T23:20:02.190242+0000 mgr.a (mgr.14355) 2559 : audit [DBG] from='client.67119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:03 smithi171 bash[25040]: cluster 2024-09-13T23:20:02.208059+0000 mgr.a (mgr.14355) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:20:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:05 smithi007 bash[22722]: cluster 2024-09-13T23:20:04.208939+0000 mgr.a (mgr.14355) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:05 smithi131 bash[24745]: cluster 2024-09-13T23:20:04.208939+0000 mgr.a (mgr.14355) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:05 smithi171 bash[25040]: cluster 2024-09-13T23:20:04.208939+0000 mgr.a (mgr.14355) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:07.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:07.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:07.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:07 smithi007 bash[22722]: cluster 2024-09-13T23:20:06.211232+0000 mgr.a (mgr.14355) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:07 smithi131 bash[24745]: cluster 2024-09-13T23:20:06.211232+0000 mgr.a (mgr.14355) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:07 smithi171 bash[25040]: cluster 2024-09-13T23:20:06.211232+0000 mgr.a (mgr.14355) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:08.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:08.371 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:09 smithi007 bash[22722]: audit 2024-09-13T23:20:07.934531+0000 mgr.a (mgr.14355) 2563 : audit [DBG] from='client.67194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:09 smithi007 bash[22722]: cluster 2024-09-13T23:20:08.211780+0000 mgr.a (mgr.14355) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:09 smithi131 bash[24745]: audit 2024-09-13T23:20:07.934531+0000 mgr.a (mgr.14355) 2563 : audit [DBG] from='client.67194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:09 smithi131 bash[24745]: cluster 2024-09-13T23:20:08.211780+0000 mgr.a (mgr.14355) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:09 smithi171 bash[25040]: audit 2024-09-13T23:20:07.934531+0000 mgr.a (mgr.14355) 2563 : audit [DBG] from='client.67194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:09 smithi171 bash[25040]: cluster 2024-09-13T23:20:08.211780+0000 mgr.a (mgr.14355) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:11 smithi007 bash[22722]: cluster 2024-09-13T23:20:10.212642+0000 mgr.a (mgr.14355) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:11 smithi131 bash[24745]: cluster 2024-09-13T23:20:10.212642+0000 mgr.a (mgr.14355) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:11 smithi171 bash[25040]: cluster 2024-09-13T23:20:10.212642+0000 mgr.a (mgr.14355) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:13.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:13 smithi007 bash[22722]: cluster 2024-09-13T23:20:12.214949+0000 mgr.a (mgr.14355) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:13 smithi131 bash[24745]: cluster 2024-09-13T23:20:12.214949+0000 mgr.a (mgr.14355) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:13 smithi171 bash[25040]: cluster 2024-09-13T23:20:12.214949+0000 mgr.a (mgr.14355) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:14.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:14.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:14.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:14.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:14 smithi007 bash[22722]: audit 2024-09-13T23:20:13.708587+0000 mgr.a (mgr.14355) 2567 : audit [DBG] from='client.67272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:14 smithi131 bash[24745]: audit 2024-09-13T23:20:13.708587+0000 mgr.a (mgr.14355) 2567 : audit [DBG] from='client.67272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:14 smithi171 bash[25040]: audit 2024-09-13T23:20:13.708587+0000 mgr.a (mgr.14355) 2567 : audit [DBG] from='client.67272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:15 smithi007 bash[22722]: cluster 2024-09-13T23:20:14.215928+0000 mgr.a (mgr.14355) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:15 smithi131 bash[24745]: cluster 2024-09-13T23:20:14.215928+0000 mgr.a (mgr.14355) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:15 smithi171 bash[25040]: cluster 2024-09-13T23:20:14.215928+0000 mgr.a (mgr.14355) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:17 smithi007 bash[22722]: cluster 2024-09-13T23:20:16.218270+0000 mgr.a (mgr.14355) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:17 smithi131 bash[24745]: cluster 2024-09-13T23:20:16.218270+0000 mgr.a (mgr.14355) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:17 smithi171 bash[25040]: cluster 2024-09-13T23:20:16.218270+0000 mgr.a (mgr.14355) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:19.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:19.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:19.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:19 smithi007 bash[22722]: cluster 2024-09-13T23:20:18.219070+0000 mgr.a (mgr.14355) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:19 smithi131 bash[24745]: cluster 2024-09-13T23:20:18.219070+0000 mgr.a (mgr.14355) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:19 smithi171 bash[25040]: cluster 2024-09-13T23:20:18.219070+0000 mgr.a (mgr.14355) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:19.904 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:19.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:20 smithi007 bash[22722]: audit 2024-09-13T23:20:19.477029+0000 mgr.a (mgr.14355) 2571 : audit [DBG] from='client.67347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:20 smithi131 bash[24745]: audit 2024-09-13T23:20:19.477029+0000 mgr.a (mgr.14355) 2571 : audit [DBG] from='client.67347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:20 smithi171 bash[25040]: audit 2024-09-13T23:20:19.477029+0000 mgr.a (mgr.14355) 2571 : audit [DBG] from='client.67347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:21 smithi007 bash[22722]: cluster 2024-09-13T23:20:20.220009+0000 mgr.a (mgr.14355) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:21 smithi131 bash[24745]: cluster 2024-09-13T23:20:20.220009+0000 mgr.a (mgr.14355) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:21 smithi171 bash[25040]: cluster 2024-09-13T23:20:20.220009+0000 mgr.a (mgr.14355) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:23 smithi007 bash[22722]: cluster 2024-09-13T23:20:22.222255+0000 mgr.a (mgr.14355) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:23.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:23 smithi131 bash[24745]: cluster 2024-09-13T23:20:22.222255+0000 mgr.a (mgr.14355) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:23 smithi171 bash[25040]: cluster 2024-09-13T23:20:22.222255+0000 mgr.a (mgr.14355) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:24.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:25.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:25 smithi007 bash[22722]: cluster 2024-09-13T23:20:24.223044+0000 mgr.a (mgr.14355) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:25 smithi131 bash[24745]: cluster 2024-09-13T23:20:24.223044+0000 mgr.a (mgr.14355) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:25 smithi171 bash[25040]: cluster 2024-09-13T23:20:24.223044+0000 mgr.a (mgr.14355) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:26 smithi007 bash[22722]: audit 2024-09-13T23:20:25.241169+0000 mgr.a (mgr.14355) 2575 : audit [DBG] from='client.67425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:26 smithi131 bash[24745]: audit 2024-09-13T23:20:25.241169+0000 mgr.a (mgr.14355) 2575 : audit [DBG] from='client.67425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:26 smithi171 bash[25040]: audit 2024-09-13T23:20:25.241169+0000 mgr.a (mgr.14355) 2575 : audit [DBG] from='client.67425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:27.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:27 smithi007 bash[22722]: cluster 2024-09-13T23:20:26.225834+0000 mgr.a (mgr.14355) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:27 smithi131 bash[24745]: cluster 2024-09-13T23:20:26.225834+0000 mgr.a (mgr.14355) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:27 smithi171 bash[25040]: cluster 2024-09-13T23:20:26.225834+0000 mgr.a (mgr.14355) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:29.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:29 smithi007 bash[22722]: cluster 2024-09-13T23:20:28.226665+0000 mgr.a (mgr.14355) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:29 smithi131 bash[24745]: cluster 2024-09-13T23:20:28.226665+0000 mgr.a (mgr.14355) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:29 smithi171 bash[25040]: cluster 2024-09-13T23:20:28.226665+0000 mgr.a (mgr.14355) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:30.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:30.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:30.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:31.421 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:31.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:31.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:31.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:31 smithi007 bash[22722]: cluster 2024-09-13T23:20:30.227434+0000 mgr.a (mgr.14355) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:20:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:31 smithi131 bash[24745]: cluster 2024-09-13T23:20:30.227434+0000 mgr.a (mgr.14355) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:20:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:31 smithi171 bash[25040]: cluster 2024-09-13T23:20:30.227434+0000 mgr.a (mgr.14355) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:20:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:32 smithi007 bash[22722]: audit 2024-09-13T23:20:31.003287+0000 mgr.a (mgr.14355) 2579 : audit [DBG] from='client.67503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:32 smithi131 bash[24745]: audit 2024-09-13T23:20:31.003287+0000 mgr.a (mgr.14355) 2579 : audit [DBG] from='client.67503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:32 smithi171 bash[25040]: audit 2024-09-13T23:20:31.003287+0000 mgr.a (mgr.14355) 2579 : audit [DBG] from='client.67503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:33 smithi007 bash[22722]: cluster 2024-09-13T23:20:32.230313+0000 mgr.a (mgr.14355) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:33 smithi131 bash[24745]: cluster 2024-09-13T23:20:32.230313+0000 mgr.a (mgr.14355) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:33 smithi171 bash[25040]: cluster 2024-09-13T23:20:32.230313+0000 mgr.a (mgr.14355) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:35 smithi007 bash[22722]: cluster 2024-09-13T23:20:34.231121+0000 mgr.a (mgr.14355) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:35 smithi131 bash[24745]: cluster 2024-09-13T23:20:34.231121+0000 mgr.a (mgr.14355) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:35 smithi171 bash[25040]: cluster 2024-09-13T23:20:34.231121+0000 mgr.a (mgr.14355) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:20:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:36.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:36.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:37.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:37 smithi007 bash[22722]: cluster 2024-09-13T23:20:36.233155+0000 mgr.a (mgr.14355) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:37 smithi007 bash[22722]: audit 2024-09-13T23:20:36.754535+0000 mgr.a (mgr.14355) 2583 : audit [DBG] from='client.67581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:37 smithi007 bash[22722]: audit 2024-09-13T23:20:36.842978+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:20:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:37 smithi131 bash[24745]: cluster 2024-09-13T23:20:36.233155+0000 mgr.a (mgr.14355) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:37 smithi131 bash[24745]: audit 2024-09-13T23:20:36.754535+0000 mgr.a (mgr.14355) 2583 : audit [DBG] from='client.67581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:37 smithi131 bash[24745]: audit 2024-09-13T23:20:36.842978+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:20:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:37 smithi171 bash[25040]: cluster 2024-09-13T23:20:36.233155+0000 mgr.a (mgr.14355) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:37 smithi171 bash[25040]: audit 2024-09-13T23:20:36.754535+0000 mgr.a (mgr.14355) 2583 : audit [DBG] from='client.67581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:37 smithi171 bash[25040]: audit 2024-09-13T23:20:36.842978+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:20:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:39 smithi007 bash[22722]: cluster 2024-09-13T23:20:38.234037+0000 mgr.a (mgr.14355) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:39 smithi131 bash[24745]: cluster 2024-09-13T23:20:38.234037+0000 mgr.a (mgr.14355) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:39 smithi171 bash[25040]: cluster 2024-09-13T23:20:38.234037+0000 mgr.a (mgr.14355) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:41 smithi007 bash[22722]: cluster 2024-09-13T23:20:40.234976+0000 mgr.a (mgr.14355) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:41 smithi131 bash[24745]: cluster 2024-09-13T23:20:40.234976+0000 mgr.a (mgr.14355) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:41 smithi171 bash[25040]: cluster 2024-09-13T23:20:40.234976+0000 mgr.a (mgr.14355) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:42.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:42.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:42.959 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:43 smithi007 bash[22722]: cluster 2024-09-13T23:20:42.237226+0000 mgr.a (mgr.14355) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:43 smithi007 bash[22722]: audit 2024-09-13T23:20:42.518570+0000 mgr.a (mgr.14355) 2587 : audit [DBG] from='client.67659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:43.721 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:43 smithi171 bash[25040]: cluster 2024-09-13T23:20:42.237226+0000 mgr.a (mgr.14355) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:43.721 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:43 smithi171 bash[25040]: audit 2024-09-13T23:20:42.518570+0000 mgr.a (mgr.14355) 2587 : audit [DBG] from='client.67659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:43.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:43 smithi131 bash[24745]: cluster 2024-09-13T23:20:42.237226+0000 mgr.a (mgr.14355) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:43.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:43 smithi131 bash[24745]: audit 2024-09-13T23:20:42.518570+0000 mgr.a (mgr.14355) 2587 : audit [DBG] from='client.67659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:45.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:45 smithi131 bash[24745]: cluster 2024-09-13T23:20:44.238173+0000 mgr.a (mgr.14355) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:45 smithi007 bash[22722]: cluster 2024-09-13T23:20:44.238173+0000 mgr.a (mgr.14355) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:45 smithi171 bash[25040]: cluster 2024-09-13T23:20:44.238173+0000 mgr.a (mgr.14355) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: cluster 2024-09-13T23:20:46.240425+0000 mgr.a (mgr.14355) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:46.916368+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:46.925435+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.137489+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.145693+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.148200+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:20:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.150360+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:20:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.160959+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:47 smithi131 bash[24745]: audit 2024-09-13T23:20:47.166829+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: cluster 2024-09-13T23:20:46.240425+0000 mgr.a (mgr.14355) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:46.916368+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:46.925435+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.137489+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.145693+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.148200+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:20:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.150360+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:20:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.160959+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:47 smithi171 bash[25040]: audit 2024-09-13T23:20:47.166829+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: cluster 2024-09-13T23:20:46.240425+0000 mgr.a (mgr.14355) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:46.916368+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:46.925435+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.137489+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.145693+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.148200+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:20:47.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.150360+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:20:47.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.160959+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:20:47.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22722]: audit 2024-09-13T23:20:47.166829+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:47.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:47.961 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:47.961 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:48.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22972]: debug 2024-09-13T23:20:47.914+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:20:48.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:20:47 smithi007 bash[22972]: debug 2024-09-13T23:20:47.914+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:20:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:48.707 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:48 smithi131 bash[24745]: audit 2024-09-13T23:20:47.169217+0000 mgr.a (mgr.14355) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:48 smithi171 bash[25040]: audit 2024-09-13T23:20:47.169217+0000 mgr.a (mgr.14355) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:48 smithi007 bash[22722]: audit 2024-09-13T23:20:47.169217+0000 mgr.a (mgr.14355) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:20:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:49 smithi131 bash[24745]: audit 2024-09-13T23:20:47.919326+0000 mgr.a (mgr.14355) 2591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:20:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:49 smithi131 bash[24745]: cephadm 2024-09-13T23:20:47.920675+0000 mgr.a (mgr.14355) 2592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:20:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:49 smithi131 bash[24745]: cluster 2024-09-13T23:20:48.241449+0000 mgr.a (mgr.14355) 2593 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:49 smithi131 bash[24745]: audit 2024-09-13T23:20:48.285863+0000 mgr.a (mgr.14355) 2594 : audit [DBG] from='client.67839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:49 smithi171 bash[25040]: audit 2024-09-13T23:20:47.919326+0000 mgr.a (mgr.14355) 2591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:20:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:49 smithi171 bash[25040]: cephadm 2024-09-13T23:20:47.920675+0000 mgr.a (mgr.14355) 2592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:20:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:49 smithi171 bash[25040]: cluster 2024-09-13T23:20:48.241449+0000 mgr.a (mgr.14355) 2593 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:49 smithi171 bash[25040]: audit 2024-09-13T23:20:48.285863+0000 mgr.a (mgr.14355) 2594 : audit [DBG] from='client.67839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:49 smithi007 bash[22722]: audit 2024-09-13T23:20:47.919326+0000 mgr.a (mgr.14355) 2591 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:49 smithi007 bash[22722]: cephadm 2024-09-13T23:20:47.920675+0000 mgr.a (mgr.14355) 2592 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:49 smithi007 bash[22722]: cluster 2024-09-13T23:20:48.241449+0000 mgr.a (mgr.14355) 2593 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:49 smithi007 bash[22722]: audit 2024-09-13T23:20:48.285863+0000 mgr.a (mgr.14355) 2594 : audit [DBG] from='client.67839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:51 smithi131 bash[24745]: cluster 2024-09-13T23:20:50.242540+0000 mgr.a (mgr.14355) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:51 smithi171 bash[25040]: cluster 2024-09-13T23:20:50.242540+0000 mgr.a (mgr.14355) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:51 smithi007 bash[22722]: cluster 2024-09-13T23:20:50.242540+0000 mgr.a (mgr.14355) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:20:53.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:53.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:53.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:53 smithi131 bash[24745]: cluster 2024-09-13T23:20:52.244955+0000 mgr.a (mgr.14355) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:53 smithi171 bash[25040]: cluster 2024-09-13T23:20:52.244955+0000 mgr.a (mgr.14355) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:53 smithi007 bash[22722]: cluster 2024-09-13T23:20:52.244955+0000 mgr.a (mgr.14355) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:54.460 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:20:54.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:20:54.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:20:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:20:54.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:20:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:55 smithi131 bash[24745]: audit 2024-09-13T23:20:54.044674+0000 mgr.a (mgr.14355) 2597 : audit [DBG] from='client.67914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:55 smithi131 bash[24745]: cluster 2024-09-13T23:20:54.245485+0000 mgr.a (mgr.14355) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:55 smithi171 bash[25040]: audit 2024-09-13T23:20:54.044674+0000 mgr.a (mgr.14355) 2597 : audit [DBG] from='client.67914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:55 smithi171 bash[25040]: cluster 2024-09-13T23:20:54.245485+0000 mgr.a (mgr.14355) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:55 smithi007 bash[22722]: audit 2024-09-13T23:20:54.044674+0000 mgr.a (mgr.14355) 2597 : audit [DBG] from='client.67914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:20:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:55 smithi007 bash[22722]: cluster 2024-09-13T23:20:54.245485+0000 mgr.a (mgr.14355) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:57 smithi131 bash[24745]: cluster 2024-09-13T23:20:56.247873+0000 mgr.a (mgr.14355) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:57 smithi171 bash[25040]: cluster 2024-09-13T23:20:56.247873+0000 mgr.a (mgr.14355) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:57 smithi007 bash[22722]: cluster 2024-09-13T23:20:56.247873+0000 mgr.a (mgr.14355) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:20:59.462 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:20:59.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:20:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:20:59 smithi131 bash[24745]: cluster 2024-09-13T23:20:58.248636+0000 mgr.a (mgr.14355) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:20:59 smithi171 bash[25040]: cluster 2024-09-13T23:20:58.248636+0000 mgr.a (mgr.14355) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:20:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:20:59 smithi007 bash[22722]: cluster 2024-09-13T23:20:58.248636+0000 mgr.a (mgr.14355) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:00.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:00.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:00.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:00 smithi131 bash[24745]: audit 2024-09-13T23:20:59.795979+0000 mgr.a (mgr.14355) 2601 : audit [DBG] from='client.67992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:00 smithi171 bash[25040]: audit 2024-09-13T23:20:59.795979+0000 mgr.a (mgr.14355) 2601 : audit [DBG] from='client.67992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:00 smithi007 bash[22722]: audit 2024-09-13T23:20:59.795979+0000 mgr.a (mgr.14355) 2601 : audit [DBG] from='client.67992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:01 smithi131 bash[24745]: cluster 2024-09-13T23:21:00.249303+0000 mgr.a (mgr.14355) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:01 smithi171 bash[25040]: cluster 2024-09-13T23:21:00.249303+0000 mgr.a (mgr.14355) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:01 smithi007 bash[22722]: cluster 2024-09-13T23:21:00.249303+0000 mgr.a (mgr.14355) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:03 smithi131 bash[24745]: cluster 2024-09-13T23:21:02.251546+0000 mgr.a (mgr.14355) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:03 smithi171 bash[25040]: cluster 2024-09-13T23:21:02.251546+0000 mgr.a (mgr.14355) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:03 smithi007 bash[22722]: cluster 2024-09-13T23:21:02.251546+0000 mgr.a (mgr.14355) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:05.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:05.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:05 smithi171 bash[25040]: cluster 2024-09-13T23:21:04.252316+0000 mgr.a (mgr.14355) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:05 smithi007 bash[22722]: cluster 2024-09-13T23:21:04.252316+0000 mgr.a (mgr.14355) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:05.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:05.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:05 smithi131 bash[24745]: cluster 2024-09-13T23:21:04.252316+0000 mgr.a (mgr.14355) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:06 smithi171 bash[25040]: audit 2024-09-13T23:21:05.547112+0000 mgr.a (mgr.14355) 2605 : audit [DBG] from='client.68070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:06.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:06 smithi007 bash[22722]: audit 2024-09-13T23:21:05.547112+0000 mgr.a (mgr.14355) 2605 : audit [DBG] from='client.68070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:06 smithi131 bash[24745]: audit 2024-09-13T23:21:05.547112+0000 mgr.a (mgr.14355) 2605 : audit [DBG] from='client.68070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:07 smithi171 bash[25040]: cluster 2024-09-13T23:21:06.254873+0000 mgr.a (mgr.14355) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:07 smithi007 bash[22722]: cluster 2024-09-13T23:21:06.254873+0000 mgr.a (mgr.14355) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:07 smithi131 bash[24745]: cluster 2024-09-13T23:21:06.254873+0000 mgr.a (mgr.14355) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:09 smithi007 bash[22722]: cluster 2024-09-13T23:21:08.255663+0000 mgr.a (mgr.14355) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:09 smithi131 bash[24745]: cluster 2024-09-13T23:21:08.255663+0000 mgr.a (mgr.14355) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:09 smithi171 bash[25040]: cluster 2024-09-13T23:21:08.255663+0000 mgr.a (mgr.14355) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:10.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:10.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:10.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:11.741 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:11.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:11 smithi007 bash[22722]: cluster 2024-09-13T23:21:10.256452+0000 mgr.a (mgr.14355) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:11 smithi131 bash[24745]: cluster 2024-09-13T23:21:10.256452+0000 mgr.a (mgr.14355) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:11 smithi171 bash[25040]: cluster 2024-09-13T23:21:10.256452+0000 mgr.a (mgr.14355) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:12 smithi007 bash[22722]: audit 2024-09-13T23:21:11.301191+0000 mgr.a (mgr.14355) 2609 : audit [DBG] from='client.68145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:12 smithi131 bash[24745]: audit 2024-09-13T23:21:11.301191+0000 mgr.a (mgr.14355) 2609 : audit [DBG] from='client.68145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:12 smithi171 bash[25040]: audit 2024-09-13T23:21:11.301191+0000 mgr.a (mgr.14355) 2609 : audit [DBG] from='client.68145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:13 smithi007 bash[22722]: cluster 2024-09-13T23:21:12.259216+0000 mgr.a (mgr.14355) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:13 smithi131 bash[24745]: cluster 2024-09-13T23:21:12.259216+0000 mgr.a (mgr.14355) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:13 smithi171 bash[25040]: cluster 2024-09-13T23:21:12.259216+0000 mgr.a (mgr.14355) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:15 smithi007 bash[22722]: cluster 2024-09-13T23:21:14.260033+0000 mgr.a (mgr.14355) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:15 smithi131 bash[24745]: cluster 2024-09-13T23:21:14.260033+0000 mgr.a (mgr.14355) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:15 smithi171 bash[25040]: cluster 2024-09-13T23:21:14.260033+0000 mgr.a (mgr.14355) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:21:16.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:17.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:17.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:17 smithi007 bash[22722]: cluster 2024-09-13T23:21:16.262066+0000 mgr.a (mgr.14355) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:18.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:17 smithi131 bash[24745]: cluster 2024-09-13T23:21:16.262066+0000 mgr.a (mgr.14355) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:17 smithi171 bash[25040]: cluster 2024-09-13T23:21:16.262066+0000 mgr.a (mgr.14355) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:18 smithi007 bash[22722]: audit 2024-09-13T23:21:17.074505+0000 mgr.a (mgr.14355) 2613 : audit [DBG] from='client.68217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:18 smithi131 bash[24745]: audit 2024-09-13T23:21:17.074505+0000 mgr.a (mgr.14355) 2613 : audit [DBG] from='client.68217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:18 smithi171 bash[25040]: audit 2024-09-13T23:21:17.074505+0000 mgr.a (mgr.14355) 2613 : audit [DBG] from='client.68217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:19 smithi007 bash[22722]: cluster 2024-09-13T23:21:18.262979+0000 mgr.a (mgr.14355) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:19 smithi131 bash[24745]: cluster 2024-09-13T23:21:18.262979+0000 mgr.a (mgr.14355) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:19 smithi171 bash[25040]: cluster 2024-09-13T23:21:18.262979+0000 mgr.a (mgr.14355) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:21 smithi007 bash[22722]: cluster 2024-09-13T23:21:20.263738+0000 mgr.a (mgr.14355) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:21 smithi131 bash[24745]: cluster 2024-09-13T23:21:20.263738+0000 mgr.a (mgr.14355) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:21 smithi171 bash[25040]: cluster 2024-09-13T23:21:20.263738+0000 mgr.a (mgr.14355) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:22.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:22.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:22.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:23.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:23.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:23 smithi007 bash[22722]: cluster 2024-09-13T23:21:22.265977+0000 mgr.a (mgr.14355) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:23 smithi007 bash[22722]: audit 2024-09-13T23:21:22.837282+0000 mgr.a (mgr.14355) 2617 : audit [DBG] from='client.68292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:23 smithi131 bash[24745]: cluster 2024-09-13T23:21:22.265977+0000 mgr.a (mgr.14355) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:23 smithi131 bash[24745]: audit 2024-09-13T23:21:22.837282+0000 mgr.a (mgr.14355) 2617 : audit [DBG] from='client.68292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:23 smithi171 bash[25040]: cluster 2024-09-13T23:21:22.265977+0000 mgr.a (mgr.14355) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:23 smithi171 bash[25040]: audit 2024-09-13T23:21:22.837282+0000 mgr.a (mgr.14355) 2617 : audit [DBG] from='client.68292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:25 smithi007 bash[22722]: cluster 2024-09-13T23:21:24.266879+0000 mgr.a (mgr.14355) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:25 smithi131 bash[24745]: cluster 2024-09-13T23:21:24.266879+0000 mgr.a (mgr.14355) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:25 smithi171 bash[25040]: cluster 2024-09-13T23:21:24.266879+0000 mgr.a (mgr.14355) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:27 smithi007 bash[22722]: cluster 2024-09-13T23:21:26.269133+0000 mgr.a (mgr.14355) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:28.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:27 smithi131 bash[24745]: cluster 2024-09-13T23:21:26.269133+0000 mgr.a (mgr.14355) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:27 smithi171 bash[25040]: cluster 2024-09-13T23:21:26.269133+0000 mgr.a (mgr.14355) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:29.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:29.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:29 smithi007 bash[22722]: cluster 2024-09-13T23:21:28.269866+0000 mgr.a (mgr.14355) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:29 smithi007 bash[22722]: audit 2024-09-13T23:21:28.610743+0000 mgr.a (mgr.14355) 2621 : audit [DBG] from='client.68370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:30.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:29 smithi131 bash[24745]: cluster 2024-09-13T23:21:28.269866+0000 mgr.a (mgr.14355) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:29 smithi131 bash[24745]: audit 2024-09-13T23:21:28.610743+0000 mgr.a (mgr.14355) 2621 : audit [DBG] from='client.68370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:29 smithi171 bash[25040]: cluster 2024-09-13T23:21:28.269866+0000 mgr.a (mgr.14355) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:29 smithi171 bash[25040]: audit 2024-09-13T23:21:28.610743+0000 mgr.a (mgr.14355) 2621 : audit [DBG] from='client.68370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:31.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:31 smithi007 bash[22722]: cluster 2024-09-13T23:21:30.270788+0000 mgr.a (mgr.14355) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:31 smithi131 bash[24745]: cluster 2024-09-13T23:21:30.270788+0000 mgr.a (mgr.14355) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:31 smithi171 bash[25040]: cluster 2024-09-13T23:21:30.270788+0000 mgr.a (mgr.14355) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:33 smithi007 bash[22722]: cluster 2024-09-13T23:21:32.273027+0000 mgr.a (mgr.14355) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:34.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:33 smithi131 bash[24745]: cluster 2024-09-13T23:21:32.273027+0000 mgr.a (mgr.14355) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:33 smithi171 bash[25040]: cluster 2024-09-13T23:21:32.273027+0000 mgr.a (mgr.14355) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:34.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:34.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:34.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:34.834 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:34.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:34.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:35 smithi007 bash[22722]: cluster 2024-09-13T23:21:34.273760+0000 mgr.a (mgr.14355) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:35 smithi007 bash[22722]: audit 2024-09-13T23:21:34.392675+0000 mgr.a (mgr.14355) 2625 : audit [DBG] from='client.68439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:36.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:35 smithi131 bash[24745]: cluster 2024-09-13T23:21:34.273760+0000 mgr.a (mgr.14355) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:35 smithi131 bash[24745]: audit 2024-09-13T23:21:34.392675+0000 mgr.a (mgr.14355) 2625 : audit [DBG] from='client.68439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:35 smithi171 bash[25040]: cluster 2024-09-13T23:21:34.273760+0000 mgr.a (mgr.14355) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:35 smithi171 bash[25040]: audit 2024-09-13T23:21:34.392675+0000 mgr.a (mgr.14355) 2625 : audit [DBG] from='client.68439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:37 smithi007 bash[22722]: cluster 2024-09-13T23:21:36.276049+0000 mgr.a (mgr.14355) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:38.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:37 smithi131 bash[24745]: cluster 2024-09-13T23:21:36.276049+0000 mgr.a (mgr.14355) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:37 smithi171 bash[25040]: cluster 2024-09-13T23:21:36.276049+0000 mgr.a (mgr.14355) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:21:39.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:39.836 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:39.836 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:39 smithi007 bash[22722]: cluster 2024-09-13T23:21:38.276805+0000 mgr.a (mgr.14355) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:40.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:39 smithi131 bash[24745]: cluster 2024-09-13T23:21:38.276805+0000 mgr.a (mgr.14355) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:39 smithi171 bash[25040]: cluster 2024-09-13T23:21:38.276805+0000 mgr.a (mgr.14355) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:40.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:40.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:41 smithi007 bash[22722]: audit 2024-09-13T23:21:40.170756+0000 mgr.a (mgr.14355) 2628 : audit [DBG] from='client.68514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:41 smithi007 bash[22722]: cluster 2024-09-13T23:21:40.278181+0000 mgr.a (mgr.14355) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:42.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:41 smithi131 bash[24745]: audit 2024-09-13T23:21:40.170756+0000 mgr.a (mgr.14355) 2628 : audit [DBG] from='client.68514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:41 smithi131 bash[24745]: cluster 2024-09-13T23:21:40.278181+0000 mgr.a (mgr.14355) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:41 smithi171 bash[25040]: audit 2024-09-13T23:21:40.170756+0000 mgr.a (mgr.14355) 2628 : audit [DBG] from='client.68514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:41 smithi171 bash[25040]: cluster 2024-09-13T23:21:40.278181+0000 mgr.a (mgr.14355) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:43 smithi007 bash[22722]: cluster 2024-09-13T23:21:42.279036+0000 mgr.a (mgr.14355) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:44.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:43 smithi131 bash[24745]: cluster 2024-09-13T23:21:42.279036+0000 mgr.a (mgr.14355) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:43 smithi171 bash[25040]: cluster 2024-09-13T23:21:42.279036+0000 mgr.a (mgr.14355) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:45.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:45.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:45.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:45 smithi007 bash[22722]: cluster 2024-09-13T23:21:44.279820+0000 mgr.a (mgr.14355) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:45 smithi131 bash[24745]: cluster 2024-09-13T23:21:44.279820+0000 mgr.a (mgr.14355) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:45 smithi171 bash[25040]: cluster 2024-09-13T23:21:44.279820+0000 mgr.a (mgr.14355) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:46.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:47 smithi007 bash[22722]: audit 2024-09-13T23:21:45.928876+0000 mgr.a (mgr.14355) 2632 : audit [DBG] from='client.68589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:47 smithi007 bash[22722]: cluster 2024-09-13T23:21:46.281200+0000 mgr.a (mgr.14355) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:48.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:47 smithi131 bash[24745]: audit 2024-09-13T23:21:45.928876+0000 mgr.a (mgr.14355) 2632 : audit [DBG] from='client.68589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:47 smithi131 bash[24745]: cluster 2024-09-13T23:21:46.281200+0000 mgr.a (mgr.14355) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:47 smithi171 bash[25040]: audit 2024-09-13T23:21:45.928876+0000 mgr.a (mgr.14355) 2632 : audit [DBG] from='client.68589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:47 smithi171 bash[25040]: cluster 2024-09-13T23:21:46.281200+0000 mgr.a (mgr.14355) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:21:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:48 smithi007 bash[22722]: audit 2024-09-13T23:21:47.983757+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:21:49.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:48 smithi131 bash[24745]: audit 2024-09-13T23:21:47.983757+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:21:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:48 smithi171 bash[25040]: audit 2024-09-13T23:21:47.983757+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:21:49.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22972]: debug 2024-09-13T23:21:49.549+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:21:49.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22972]: debug 2024-09-13T23:21:49.549+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:21:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: cluster 2024-09-13T23:21:48.281921+0000 mgr.a (mgr.14355) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: audit 2024-09-13T23:21:48.814500+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:21:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: audit 2024-09-13T23:21:48.816320+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:21:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: audit 2024-09-13T23:21:48.826909+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:21:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: audit 2024-09-13T23:21:48.832179+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:49 smithi007 bash[22722]: audit 2024-09-13T23:21:48.834594+0000 mgr.a (mgr.14355) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: cluster 2024-09-13T23:21:48.281921+0000 mgr.a (mgr.14355) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: audit 2024-09-13T23:21:48.814500+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: audit 2024-09-13T23:21:48.816320+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: audit 2024-09-13T23:21:48.826909+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: audit 2024-09-13T23:21:48.832179+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:49 smithi131 bash[24745]: audit 2024-09-13T23:21:48.834594+0000 mgr.a (mgr.14355) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: cluster 2024-09-13T23:21:48.281921+0000 mgr.a (mgr.14355) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: audit 2024-09-13T23:21:48.814500+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: audit 2024-09-13T23:21:48.816320+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: audit 2024-09-13T23:21:48.826909+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: audit 2024-09-13T23:21:48.832179+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:49 smithi171 bash[25040]: audit 2024-09-13T23:21:48.834594+0000 mgr.a (mgr.14355) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:21:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:50 smithi007 bash[22722]: audit 2024-09-13T23:21:49.551796+0000 mgr.a (mgr.14355) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:21:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:50 smithi007 bash[22722]: cephadm 2024-09-13T23:21:49.553376+0000 mgr.a (mgr.14355) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:21:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:50 smithi131 bash[24745]: audit 2024-09-13T23:21:49.551796+0000 mgr.a (mgr.14355) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:21:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:50 smithi131 bash[24745]: cephadm 2024-09-13T23:21:49.553376+0000 mgr.a (mgr.14355) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:21:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:50 smithi171 bash[25040]: audit 2024-09-13T23:21:49.551796+0000 mgr.a (mgr.14355) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:21:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:50 smithi171 bash[25040]: cephadm 2024-09-13T23:21:49.553376+0000 mgr.a (mgr.14355) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:21:51.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:51.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:51 smithi007 bash[22722]: cluster 2024-09-13T23:21:50.284235+0000 mgr.a (mgr.14355) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:51 smithi131 bash[24745]: cluster 2024-09-13T23:21:50.284235+0000 mgr.a (mgr.14355) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:51 smithi171 bash[25040]: cluster 2024-09-13T23:21:50.284235+0000 mgr.a (mgr.14355) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:52.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:52 smithi007 bash[22722]: audit 2024-09-13T23:21:51.710106+0000 mgr.a (mgr.14355) 2639 : audit [DBG] from='client.68775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:53.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:52 smithi131 bash[24745]: audit 2024-09-13T23:21:51.710106+0000 mgr.a (mgr.14355) 2639 : audit [DBG] from='client.68775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:52 smithi171 bash[25040]: audit 2024-09-13T23:21:51.710106+0000 mgr.a (mgr.14355) 2639 : audit [DBG] from='client.68775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:53 smithi007 bash[22722]: cluster 2024-09-13T23:21:52.285115+0000 mgr.a (mgr.14355) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:53 smithi131 bash[24745]: cluster 2024-09-13T23:21:52.285115+0000 mgr.a (mgr.14355) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:53 smithi171 bash[25040]: cluster 2024-09-13T23:21:52.285115+0000 mgr.a (mgr.14355) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:55 smithi007 bash[22722]: cluster 2024-09-13T23:21:54.285877+0000 mgr.a (mgr.14355) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:55 smithi131 bash[24745]: cluster 2024-09-13T23:21:54.285877+0000 mgr.a (mgr.14355) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:55 smithi171 bash[25040]: cluster 2024-09-13T23:21:54.285877+0000 mgr.a (mgr.14355) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:57.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:21:57.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:21:57.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:21:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:21:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:21:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:21:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:21:57.942 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:21:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:57 smithi007 bash[22722]: cluster 2024-09-13T23:21:56.288106+0000 mgr.a (mgr.14355) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:57 smithi131 bash[24745]: cluster 2024-09-13T23:21:56.288106+0000 mgr.a (mgr.14355) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:57 smithi171 bash[25040]: cluster 2024-09-13T23:21:56.288106+0000 mgr.a (mgr.14355) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:21:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:58 smithi007 bash[22722]: audit 2024-09-13T23:21:57.498959+0000 mgr.a (mgr.14355) 2643 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:58 smithi131 bash[24745]: audit 2024-09-13T23:21:57.498959+0000 mgr.a (mgr.14355) 2643 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:58 smithi171 bash[25040]: audit 2024-09-13T23:21:57.498959+0000 mgr.a (mgr.14355) 2643 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:21:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:21:59 smithi007 bash[22722]: cluster 2024-09-13T23:21:58.289010+0000 mgr.a (mgr.14355) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:22:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:21:59 smithi131 bash[24745]: cluster 2024-09-13T23:21:58.289010+0000 mgr.a (mgr.14355) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:22:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:21:59 smithi171 bash[25040]: cluster 2024-09-13T23:21:58.289010+0000 mgr.a (mgr.14355) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:22:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:01 smithi007 bash[22722]: cluster 2024-09-13T23:22:00.291331+0000 mgr.a (mgr.14355) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 426 B/s wr, 45 op/s 2024-09-13T23:22:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:01 smithi131 bash[24745]: cluster 2024-09-13T23:22:00.291331+0000 mgr.a (mgr.14355) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 426 B/s wr, 45 op/s 2024-09-13T23:22:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:01 smithi171 bash[25040]: cluster 2024-09-13T23:22:00.291331+0000 mgr.a (mgr.14355) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 426 B/s wr, 45 op/s 2024-09-13T23:22:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:03.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:03.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:03.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:03.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:03.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:03 smithi007 bash[22722]: cluster 2024-09-13T23:22:02.292128+0000 mgr.a (mgr.14355) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:03 smithi171 bash[25040]: cluster 2024-09-13T23:22:02.292128+0000 mgr.a (mgr.14355) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:04.052 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:03 smithi131 bash[24745]: cluster 2024-09-13T23:22:02.292128+0000 mgr.a (mgr.14355) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:04 smithi007 bash[22722]: audit 2024-09-13T23:22:03.277497+0000 mgr.a (mgr.14355) 2647 : audit [DBG] from='client.68931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:05.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:04 smithi131 bash[24745]: audit 2024-09-13T23:22:03.277497+0000 mgr.a (mgr.14355) 2647 : audit [DBG] from='client.68931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:04 smithi171 bash[25040]: audit 2024-09-13T23:22:03.277497+0000 mgr.a (mgr.14355) 2647 : audit [DBG] from='client.68931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:05 smithi131 bash[24745]: cluster 2024-09-13T23:22:04.293010+0000 mgr.a (mgr.14355) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:05 smithi171 bash[25040]: cluster 2024-09-13T23:22:04.293010+0000 mgr.a (mgr.14355) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:05 smithi007 bash[22722]: cluster 2024-09-13T23:22:04.293010+0000 mgr.a (mgr.14355) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-13T23:22:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:07 smithi131 bash[24745]: cluster 2024-09-13T23:22:06.295322+0000 mgr.a (mgr.14355) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:07 smithi171 bash[25040]: cluster 2024-09-13T23:22:06.295322+0000 mgr.a (mgr.14355) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:07 smithi007 bash[22722]: cluster 2024-09-13T23:22:06.295322+0000 mgr.a (mgr.14355) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:08.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:08.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:08.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:09.467 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:09.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:09 smithi131 bash[24745]: cluster 2024-09-13T23:22:08.296104+0000 mgr.a (mgr.14355) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-13T23:22:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:09 smithi171 bash[25040]: cluster 2024-09-13T23:22:08.296104+0000 mgr.a (mgr.14355) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-13T23:22:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:09 smithi007 bash[22722]: cluster 2024-09-13T23:22:08.296104+0000 mgr.a (mgr.14355) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-13T23:22:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:10 smithi131 bash[24745]: audit 2024-09-13T23:22:09.050683+0000 mgr.a (mgr.14355) 2651 : audit [DBG] from='client.69006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:10 smithi171 bash[25040]: audit 2024-09-13T23:22:09.050683+0000 mgr.a (mgr.14355) 2651 : audit [DBG] from='client.69006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:11.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:10 smithi007 bash[22722]: audit 2024-09-13T23:22:09.050683+0000 mgr.a (mgr.14355) 2651 : audit [DBG] from='client.69006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:11 smithi131 bash[24745]: cluster 2024-09-13T23:22:10.298513+0000 mgr.a (mgr.14355) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:11 smithi171 bash[25040]: cluster 2024-09-13T23:22:10.298513+0000 mgr.a (mgr.14355) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:11 smithi007 bash[22722]: cluster 2024-09-13T23:22:10.298513+0000 mgr.a (mgr.14355) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-09-13T23:22:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:13 smithi131 bash[24745]: cluster 2024-09-13T23:22:12.299301+0000 mgr.a (mgr.14355) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:13 smithi171 bash[25040]: cluster 2024-09-13T23:22:12.299301+0000 mgr.a (mgr.14355) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:13 smithi007 bash[22722]: cluster 2024-09-13T23:22:12.299301+0000 mgr.a (mgr.14355) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:15.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:15 smithi131 bash[24745]: cluster 2024-09-13T23:22:14.300125+0000 mgr.a (mgr.14355) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:15 smithi131 bash[24745]: audit 2024-09-13T23:22:14.803466+0000 mgr.a (mgr.14355) 2655 : audit [DBG] from='client.69084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:15 smithi171 bash[25040]: cluster 2024-09-13T23:22:14.300125+0000 mgr.a (mgr.14355) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:15 smithi171 bash[25040]: audit 2024-09-13T23:22:14.803466+0000 mgr.a (mgr.14355) 2655 : audit [DBG] from='client.69084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:15 smithi007 bash[22722]: cluster 2024-09-13T23:22:14.300125+0000 mgr.a (mgr.14355) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:22:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:15 smithi007 bash[22722]: audit 2024-09-13T23:22:14.803466+0000 mgr.a (mgr.14355) 2655 : audit [DBG] from='client.69084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:18.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:17 smithi131 bash[24745]: cluster 2024-09-13T23:22:16.302663+0000 mgr.a (mgr.14355) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:22:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:17 smithi171 bash[25040]: cluster 2024-09-13T23:22:16.302663+0000 mgr.a (mgr.14355) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:22:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:17 smithi007 bash[22722]: cluster 2024-09-13T23:22:16.302663+0000 mgr.a (mgr.14355) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:22:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:19 smithi131 bash[24745]: cluster 2024-09-13T23:22:18.303466+0000 mgr.a (mgr.14355) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:22:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:19 smithi171 bash[25040]: cluster 2024-09-13T23:22:18.303466+0000 mgr.a (mgr.14355) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:22:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:19 smithi007 bash[22722]: cluster 2024-09-13T23:22:18.303466+0000 mgr.a (mgr.14355) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:22:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:21.017 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:21.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:21.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:21.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:21.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:21 smithi131 bash[24745]: cluster 2024-09-13T23:22:20.305446+0000 mgr.a (mgr.14355) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:21 smithi131 bash[24745]: audit 2024-09-13T23:22:20.572926+0000 mgr.a (mgr.14355) 2659 : audit [DBG] from='client.69162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:21 smithi171 bash[25040]: cluster 2024-09-13T23:22:20.305446+0000 mgr.a (mgr.14355) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:21 smithi171 bash[25040]: audit 2024-09-13T23:22:20.572926+0000 mgr.a (mgr.14355) 2659 : audit [DBG] from='client.69162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:21 smithi007 bash[22722]: cluster 2024-09-13T23:22:20.305446+0000 mgr.a (mgr.14355) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:21 smithi007 bash[22722]: audit 2024-09-13T23:22:20.572926+0000 mgr.a (mgr.14355) 2659 : audit [DBG] from='client.69162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:23 smithi131 bash[24745]: cluster 2024-09-13T23:22:22.306453+0000 mgr.a (mgr.14355) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:22:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:23 smithi171 bash[25040]: cluster 2024-09-13T23:22:22.306453+0000 mgr.a (mgr.14355) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:22:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:23 smithi007 bash[22722]: cluster 2024-09-13T23:22:22.306453+0000 mgr.a (mgr.14355) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:22:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:26.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:25 smithi131 bash[24745]: cluster 2024-09-13T23:22:24.307262+0000 mgr.a (mgr.14355) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:22:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:25 smithi171 bash[25040]: cluster 2024-09-13T23:22:24.307262+0000 mgr.a (mgr.14355) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:22:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:25 smithi007 bash[22722]: cluster 2024-09-13T23:22:24.307262+0000 mgr.a (mgr.14355) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:22:26.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:27 smithi131 bash[24745]: cluster 2024-09-13T23:22:26.309454+0000 mgr.a (mgr.14355) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:27 smithi131 bash[24745]: audit 2024-09-13T23:22:26.357003+0000 mgr.a (mgr.14355) 2663 : audit [DBG] from='client.69240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:27 smithi171 bash[25040]: cluster 2024-09-13T23:22:26.309454+0000 mgr.a (mgr.14355) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:27 smithi171 bash[25040]: audit 2024-09-13T23:22:26.357003+0000 mgr.a (mgr.14355) 2663 : audit [DBG] from='client.69240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:27 smithi007 bash[22722]: cluster 2024-09-13T23:22:26.309454+0000 mgr.a (mgr.14355) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:27 smithi007 bash[22722]: audit 2024-09-13T23:22:26.357003+0000 mgr.a (mgr.14355) 2663 : audit [DBG] from='client.69240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:30.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:29 smithi131 bash[24745]: cluster 2024-09-13T23:22:28.310452+0000 mgr.a (mgr.14355) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:22:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:29 smithi171 bash[25040]: cluster 2024-09-13T23:22:28.310452+0000 mgr.a (mgr.14355) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:22:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:29 smithi007 bash[22722]: cluster 2024-09-13T23:22:28.310452+0000 mgr.a (mgr.14355) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:22:31.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:31.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:31 smithi131 bash[24745]: cluster 2024-09-13T23:22:30.312668+0000 mgr.a (mgr.14355) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:22:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:31 smithi171 bash[25040]: cluster 2024-09-13T23:22:30.312668+0000 mgr.a (mgr.14355) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:22:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:31 smithi007 bash[22722]: cluster 2024-09-13T23:22:30.312668+0000 mgr.a (mgr.14355) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:22:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:32.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:33 smithi131 bash[24745]: audit 2024-09-13T23:22:32.123641+0000 mgr.a (mgr.14355) 2666 : audit [DBG] from='client.69318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:33 smithi131 bash[24745]: cluster 2024-09-13T23:22:32.313362+0000 mgr.a (mgr.14355) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:33 smithi171 bash[25040]: audit 2024-09-13T23:22:32.123641+0000 mgr.a (mgr.14355) 2666 : audit [DBG] from='client.69318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:33 smithi171 bash[25040]: cluster 2024-09-13T23:22:32.313362+0000 mgr.a (mgr.14355) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:33 smithi007 bash[22722]: audit 2024-09-13T23:22:32.123641+0000 mgr.a (mgr.14355) 2666 : audit [DBG] from='client.69318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:33 smithi007 bash[22722]: cluster 2024-09-13T23:22:32.313362+0000 mgr.a (mgr.14355) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:35 smithi131 bash[24745]: cluster 2024-09-13T23:22:34.314256+0000 mgr.a (mgr.14355) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:35 smithi171 bash[25040]: cluster 2024-09-13T23:22:34.314256+0000 mgr.a (mgr.14355) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:35 smithi007 bash[22722]: cluster 2024-09-13T23:22:34.314256+0000 mgr.a (mgr.14355) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:37 smithi131 bash[24745]: cluster 2024-09-13T23:22:36.316609+0000 mgr.a (mgr.14355) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:37 smithi171 bash[25040]: cluster 2024-09-13T23:22:36.316609+0000 mgr.a (mgr.14355) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:37 smithi007 bash[22722]: cluster 2024-09-13T23:22:36.316609+0000 mgr.a (mgr.14355) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:38.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:38.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:38.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:38.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:38.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:38 smithi171 bash[25040]: audit 2024-09-13T23:22:37.877399+0000 mgr.a (mgr.14355) 2670 : audit [DBG] from='client.69396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:38 smithi007 bash[22722]: audit 2024-09-13T23:22:37.877399+0000 mgr.a (mgr.14355) 2670 : audit [DBG] from='client.69396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:38 smithi131 bash[24745]: audit 2024-09-13T23:22:37.877399+0000 mgr.a (mgr.14355) 2670 : audit [DBG] from='client.69396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:39 smithi171 bash[25040]: cluster 2024-09-13T23:22:38.317242+0000 mgr.a (mgr.14355) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:39 smithi007 bash[22722]: cluster 2024-09-13T23:22:38.317242+0000 mgr.a (mgr.14355) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:40.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:39 smithi131 bash[24745]: cluster 2024-09-13T23:22:38.317242+0000 mgr.a (mgr.14355) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:41 smithi171 bash[25040]: cluster 2024-09-13T23:22:40.319440+0000 mgr.a (mgr.14355) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:41 smithi007 bash[22722]: cluster 2024-09-13T23:22:40.319440+0000 mgr.a (mgr.14355) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:41 smithi131 bash[24745]: cluster 2024-09-13T23:22:40.319440+0000 mgr.a (mgr.14355) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:43.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:43 smithi007 bash[22722]: cluster 2024-09-13T23:22:42.320203+0000 mgr.a (mgr.14355) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:44.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:43 smithi131 bash[24745]: cluster 2024-09-13T23:22:42.320203+0000 mgr.a (mgr.14355) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:43 smithi171 bash[25040]: cluster 2024-09-13T23:22:42.320203+0000 mgr.a (mgr.14355) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:45.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:44 smithi007 bash[22722]: audit 2024-09-13T23:22:43.636078+0000 mgr.a (mgr.14355) 2674 : audit [DBG] from='client.69471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:44 smithi131 bash[24745]: audit 2024-09-13T23:22:43.636078+0000 mgr.a (mgr.14355) 2674 : audit [DBG] from='client.69471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:44 smithi171 bash[25040]: audit 2024-09-13T23:22:43.636078+0000 mgr.a (mgr.14355) 2674 : audit [DBG] from='client.69471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:45 smithi007 bash[22722]: cluster 2024-09-13T23:22:44.321142+0000 mgr.a (mgr.14355) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:46.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:45 smithi131 bash[24745]: cluster 2024-09-13T23:22:44.321142+0000 mgr.a (mgr.14355) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:45 smithi171 bash[25040]: cluster 2024-09-13T23:22:44.321142+0000 mgr.a (mgr.14355) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:47 smithi007 bash[22722]: cluster 2024-09-13T23:22:46.323437+0000 mgr.a (mgr.14355) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:47 smithi131 bash[24745]: cluster 2024-09-13T23:22:46.323437+0000 mgr.a (mgr.14355) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:47 smithi171 bash[25040]: cluster 2024-09-13T23:22:46.323437+0000 mgr.a (mgr.14355) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:49.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:49.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:49 smithi007 bash[22722]: cluster 2024-09-13T23:22:48.324353+0000 mgr.a (mgr.14355) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:49 smithi007 bash[22722]: audit 2024-09-13T23:22:49.606282+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:22:50.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:49 smithi131 bash[24745]: cluster 2024-09-13T23:22:48.324353+0000 mgr.a (mgr.14355) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:49 smithi131 bash[24745]: audit 2024-09-13T23:22:49.606282+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:22:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:49 smithi171 bash[25040]: cluster 2024-09-13T23:22:48.324353+0000 mgr.a (mgr.14355) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:49 smithi171 bash[25040]: audit 2024-09-13T23:22:49.606282+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:22:51.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:50 smithi007 bash[22722]: audit 2024-09-13T23:22:49.409228+0000 mgr.a (mgr.14355) 2678 : audit [DBG] from='client.69549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:50 smithi131 bash[24745]: audit 2024-09-13T23:22:49.409228+0000 mgr.a (mgr.14355) 2678 : audit [DBG] from='client.69549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:50 smithi171 bash[25040]: audit 2024-09-13T23:22:49.409228+0000 mgr.a (mgr.14355) 2678 : audit [DBG] from='client.69549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22972]: debug 2024-09-13T23:22:51.668+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22972]: debug 2024-09-13T23:22:51.668+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: cluster 2024-09-13T23:22:50.326786+0000 mgr.a (mgr.14355) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.907233+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.914244+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.932963+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.937786+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.952388+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.958445+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.959288+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.960058+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.964659+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:51 smithi007 bash[22722]: audit 2024-09-13T23:22:50.967229+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: cluster 2024-09-13T23:22:50.326786+0000 mgr.a (mgr.14355) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.907233+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.914244+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.932963+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.937786+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.952388+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.958445+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.959288+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:22:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.960058+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:22:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.964659+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:51 smithi131 bash[24745]: audit 2024-09-13T23:22:50.967229+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: cluster 2024-09-13T23:22:50.326786+0000 mgr.a (mgr.14355) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:22:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.907233+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.914244+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.932963+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.937786+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.952388+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.958445+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.959288+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.960058+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.964659+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:22:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:51 smithi171 bash[25040]: audit 2024-09-13T23:22:50.967229+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:52 smithi007 bash[22722]: audit 2024-09-13T23:22:50.968414+0000 mgr.a (mgr.14355) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:52 smithi007 bash[22722]: audit 2024-09-13T23:22:51.671792+0000 mgr.a (mgr.14355) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:22:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:52 smithi007 bash[22722]: cephadm 2024-09-13T23:22:51.673116+0000 mgr.a (mgr.14355) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:22:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:52 smithi131 bash[24745]: audit 2024-09-13T23:22:50.968414+0000 mgr.a (mgr.14355) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:52 smithi131 bash[24745]: audit 2024-09-13T23:22:51.671792+0000 mgr.a (mgr.14355) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:22:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:52 smithi131 bash[24745]: cephadm 2024-09-13T23:22:51.673116+0000 mgr.a (mgr.14355) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:22:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:52 smithi171 bash[25040]: audit 2024-09-13T23:22:50.968414+0000 mgr.a (mgr.14355) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:22:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:52 smithi171 bash[25040]: audit 2024-09-13T23:22:51.671792+0000 mgr.a (mgr.14355) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:22:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:52 smithi171 bash[25040]: cephadm 2024-09-13T23:22:51.673116+0000 mgr.a (mgr.14355) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:22:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:53 smithi007 bash[22722]: cluster 2024-09-13T23:22:52.327895+0000 mgr.a (mgr.14355) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:54.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:53 smithi131 bash[24745]: cluster 2024-09-13T23:22:52.327895+0000 mgr.a (mgr.14355) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:53 smithi171 bash[25040]: cluster 2024-09-13T23:22:52.327895+0000 mgr.a (mgr.14355) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:22:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:22:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:22:55.642 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:22:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:22:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:22:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:22:55.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:22:56.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:55 smithi007 bash[22722]: cluster 2024-09-13T23:22:54.328699+0000 mgr.a (mgr.14355) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:56.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:55 smithi131 bash[24745]: cluster 2024-09-13T23:22:54.328699+0000 mgr.a (mgr.14355) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:55 smithi171 bash[25040]: cluster 2024-09-13T23:22:54.328699+0000 mgr.a (mgr.14355) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:22:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:56 smithi007 bash[22722]: audit 2024-09-13T23:22:55.203046+0000 mgr.a (mgr.14355) 2685 : audit [DBG] from='client.69729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:56 smithi131 bash[24745]: audit 2024-09-13T23:22:55.203046+0000 mgr.a (mgr.14355) 2685 : audit [DBG] from='client.69729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:56 smithi171 bash[25040]: audit 2024-09-13T23:22:55.203046+0000 mgr.a (mgr.14355) 2685 : audit [DBG] from='client.69729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:22:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:57 smithi007 bash[22722]: cluster 2024-09-13T23:22:56.331565+0000 mgr.a (mgr.14355) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:22:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:57 smithi131 bash[24745]: cluster 2024-09-13T23:22:56.331565+0000 mgr.a (mgr.14355) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:22:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:57 smithi171 bash[25040]: cluster 2024-09-13T23:22:56.331565+0000 mgr.a (mgr.14355) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:22:59 smithi007 bash[22722]: cluster 2024-09-13T23:22:58.332345+0000 mgr.a (mgr.14355) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:22:59 smithi131 bash[24745]: cluster 2024-09-13T23:22:58.332345+0000 mgr.a (mgr.14355) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:22:59 smithi171 bash[25040]: cluster 2024-09-13T23:22:58.332345+0000 mgr.a (mgr.14355) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:00.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:00.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:00.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:01.423 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:01.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:01 smithi007 bash[22722]: cluster 2024-09-13T23:23:00.334279+0000 mgr.a (mgr.14355) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:01 smithi131 bash[24745]: cluster 2024-09-13T23:23:00.334279+0000 mgr.a (mgr.14355) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:01 smithi171 bash[25040]: cluster 2024-09-13T23:23:00.334279+0000 mgr.a (mgr.14355) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:03.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:02 smithi007 bash[22722]: audit 2024-09-13T23:23:00.978145+0000 mgr.a (mgr.14355) 2689 : audit [DBG] from='client.69804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:02 smithi131 bash[24745]: audit 2024-09-13T23:23:00.978145+0000 mgr.a (mgr.14355) 2689 : audit [DBG] from='client.69804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:02 smithi171 bash[25040]: audit 2024-09-13T23:23:00.978145+0000 mgr.a (mgr.14355) 2689 : audit [DBG] from='client.69804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:03 smithi007 bash[22722]: cluster 2024-09-13T23:23:02.335252+0000 mgr.a (mgr.14355) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:03 smithi131 bash[24745]: cluster 2024-09-13T23:23:02.335252+0000 mgr.a (mgr.14355) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:03 smithi171 bash[25040]: cluster 2024-09-13T23:23:02.335252+0000 mgr.a (mgr.14355) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:05 smithi007 bash[22722]: cluster 2024-09-13T23:23:04.336048+0000 mgr.a (mgr.14355) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:05 smithi131 bash[24745]: cluster 2024-09-13T23:23:04.336048+0000 mgr.a (mgr.14355) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:05 smithi171 bash[25040]: cluster 2024-09-13T23:23:04.336048+0000 mgr.a (mgr.14355) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:23:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:07.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:07 smithi007 bash[22722]: cluster 2024-09-13T23:23:06.338357+0000 mgr.a (mgr.14355) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:07 smithi007 bash[22722]: audit 2024-09-13T23:23:06.755823+0000 mgr.a (mgr.14355) 2693 : audit [DBG] from='client.69882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:07 smithi131 bash[24745]: cluster 2024-09-13T23:23:06.338357+0000 mgr.a (mgr.14355) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:07 smithi131 bash[24745]: audit 2024-09-13T23:23:06.755823+0000 mgr.a (mgr.14355) 2693 : audit [DBG] from='client.69882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:07 smithi171 bash[25040]: cluster 2024-09-13T23:23:06.338357+0000 mgr.a (mgr.14355) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:07 smithi171 bash[25040]: audit 2024-09-13T23:23:06.755823+0000 mgr.a (mgr.14355) 2693 : audit [DBG] from='client.69882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:09 smithi007 bash[22722]: cluster 2024-09-13T23:23:08.339262+0000 mgr.a (mgr.14355) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:09 smithi131 bash[24745]: cluster 2024-09-13T23:23:08.339262+0000 mgr.a (mgr.14355) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:09 smithi171 bash[25040]: cluster 2024-09-13T23:23:08.339262+0000 mgr.a (mgr.14355) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:12.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:12.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:12.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:11 smithi007 bash[22722]: cluster 2024-09-13T23:23:10.341482+0000 mgr.a (mgr.14355) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:12.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:11 smithi131 bash[24745]: cluster 2024-09-13T23:23:10.341482+0000 mgr.a (mgr.14355) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:11 smithi171 bash[25040]: cluster 2024-09-13T23:23:10.341482+0000 mgr.a (mgr.14355) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:12.904 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:13 smithi007 bash[22722]: cluster 2024-09-13T23:23:12.342254+0000 mgr.a (mgr.14355) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:13 smithi007 bash[22722]: audit 2024-09-13T23:23:12.495827+0000 mgr.a (mgr.14355) 2697 : audit [DBG] from='client.69957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:14.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:13 smithi131 bash[24745]: cluster 2024-09-13T23:23:12.342254+0000 mgr.a (mgr.14355) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:13 smithi131 bash[24745]: audit 2024-09-13T23:23:12.495827+0000 mgr.a (mgr.14355) 2697 : audit [DBG] from='client.69957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:13 smithi171 bash[25040]: cluster 2024-09-13T23:23:12.342254+0000 mgr.a (mgr.14355) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:13 smithi171 bash[25040]: audit 2024-09-13T23:23:12.495827+0000 mgr.a (mgr.14355) 2697 : audit [DBG] from='client.69957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:15 smithi007 bash[22722]: cluster 2024-09-13T23:23:14.343277+0000 mgr.a (mgr.14355) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:15 smithi131 bash[24745]: cluster 2024-09-13T23:23:14.343277+0000 mgr.a (mgr.14355) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:15 smithi171 bash[25040]: cluster 2024-09-13T23:23:14.343277+0000 mgr.a (mgr.14355) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:17.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:17 smithi007 bash[22722]: cluster 2024-09-13T23:23:16.345592+0000 mgr.a (mgr.14355) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:18.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:17 smithi131 bash[24745]: cluster 2024-09-13T23:23:16.345592+0000 mgr.a (mgr.14355) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:17 smithi171 bash[25040]: cluster 2024-09-13T23:23:16.345592+0000 mgr.a (mgr.14355) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:18.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:18.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:19 smithi007 bash[22722]: audit 2024-09-13T23:23:18.239466+0000 mgr.a (mgr.14355) 2700 : audit [DBG] from='client.70032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:19 smithi007 bash[22722]: cluster 2024-09-13T23:23:18.346244+0000 mgr.a (mgr.14355) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:19 smithi131 bash[24745]: audit 2024-09-13T23:23:18.239466+0000 mgr.a (mgr.14355) 2700 : audit [DBG] from='client.70032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:19 smithi131 bash[24745]: cluster 2024-09-13T23:23:18.346244+0000 mgr.a (mgr.14355) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:19 smithi171 bash[25040]: audit 2024-09-13T23:23:18.239466+0000 mgr.a (mgr.14355) 2700 : audit [DBG] from='client.70032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:19 smithi171 bash[25040]: cluster 2024-09-13T23:23:18.346244+0000 mgr.a (mgr.14355) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:21 smithi007 bash[22722]: cluster 2024-09-13T23:23:20.348498+0000 mgr.a (mgr.14355) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:21 smithi131 bash[24745]: cluster 2024-09-13T23:23:20.348498+0000 mgr.a (mgr.14355) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:21 smithi171 bash[25040]: cluster 2024-09-13T23:23:20.348498+0000 mgr.a (mgr.14355) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:23.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:22 smithi007 bash[22722]: cluster 2024-09-13T23:23:22.349319+0000 mgr.a (mgr.14355) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:23.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:22 smithi131 bash[24745]: cluster 2024-09-13T23:23:22.349319+0000 mgr.a (mgr.14355) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:22 smithi171 bash[25040]: cluster 2024-09-13T23:23:22.349319+0000 mgr.a (mgr.14355) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:23.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:23.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:23.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:24.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:25 smithi007 bash[22722]: audit 2024-09-13T23:23:24.016868+0000 mgr.a (mgr.14355) 2704 : audit [DBG] from='client.70104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:25 smithi007 bash[22722]: cluster 2024-09-13T23:23:24.350282+0000 mgr.a (mgr.14355) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:25 smithi131 bash[24745]: audit 2024-09-13T23:23:24.016868+0000 mgr.a (mgr.14355) 2704 : audit [DBG] from='client.70104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:25 smithi131 bash[24745]: cluster 2024-09-13T23:23:24.350282+0000 mgr.a (mgr.14355) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:25 smithi171 bash[25040]: audit 2024-09-13T23:23:24.016868+0000 mgr.a (mgr.14355) 2704 : audit [DBG] from='client.70104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:25 smithi171 bash[25040]: cluster 2024-09-13T23:23:24.350282+0000 mgr.a (mgr.14355) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:27 smithi007 bash[22722]: cluster 2024-09-13T23:23:26.352575+0000 mgr.a (mgr.14355) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:27 smithi131 bash[24745]: cluster 2024-09-13T23:23:26.352575+0000 mgr.a (mgr.14355) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:27 smithi171 bash[25040]: cluster 2024-09-13T23:23:26.352575+0000 mgr.a (mgr.14355) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:29.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:29 smithi007 bash[22722]: cluster 2024-09-13T23:23:28.353348+0000 mgr.a (mgr.14355) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:29 smithi131 bash[24745]: cluster 2024-09-13T23:23:28.353348+0000 mgr.a (mgr.14355) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:29 smithi171 bash[25040]: cluster 2024-09-13T23:23:28.353348+0000 mgr.a (mgr.14355) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:30.226 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:30 smithi007 bash[22722]: audit 2024-09-13T23:23:29.793632+0000 mgr.a (mgr.14355) 2708 : audit [DBG] from='client.70182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:30 smithi131 bash[24745]: audit 2024-09-13T23:23:29.793632+0000 mgr.a (mgr.14355) 2708 : audit [DBG] from='client.70182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:30 smithi171 bash[25040]: audit 2024-09-13T23:23:29.793632+0000 mgr.a (mgr.14355) 2708 : audit [DBG] from='client.70182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:31.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:31 smithi007 bash[22722]: cluster 2024-09-13T23:23:30.355294+0000 mgr.a (mgr.14355) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:23:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:31 smithi131 bash[24745]: cluster 2024-09-13T23:23:30.355294+0000 mgr.a (mgr.14355) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:23:31.865 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:31 smithi171 bash[25040]: cluster 2024-09-13T23:23:30.355294+0000 mgr.a (mgr.14355) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:23:33.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:33 smithi007 bash[22722]: cluster 2024-09-13T23:23:32.356068+0000 mgr.a (mgr.14355) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:33 smithi131 bash[24745]: cluster 2024-09-13T23:23:32.356068+0000 mgr.a (mgr.14355) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:33 smithi171 bash[25040]: cluster 2024-09-13T23:23:32.356068+0000 mgr.a (mgr.14355) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:35.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:35.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:35.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:35 smithi007 bash[22722]: cluster 2024-09-13T23:23:34.356846+0000 mgr.a (mgr.14355) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:35 smithi131 bash[24745]: cluster 2024-09-13T23:23:34.356846+0000 mgr.a (mgr.14355) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:35 smithi171 bash[25040]: cluster 2024-09-13T23:23:34.356846+0000 mgr.a (mgr.14355) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:23:35.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:35.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:36 smithi007 bash[22722]: audit 2024-09-13T23:23:35.558507+0000 mgr.a (mgr.14355) 2712 : audit [DBG] from='client.70254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:36 smithi131 bash[24745]: audit 2024-09-13T23:23:35.558507+0000 mgr.a (mgr.14355) 2712 : audit [DBG] from='client.70254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:36 smithi171 bash[25040]: audit 2024-09-13T23:23:35.558507+0000 mgr.a (mgr.14355) 2712 : audit [DBG] from='client.70254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:37 smithi007 bash[22722]: cluster 2024-09-13T23:23:36.359546+0000 mgr.a (mgr.14355) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:37 smithi131 bash[24745]: cluster 2024-09-13T23:23:36.359546+0000 mgr.a (mgr.14355) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:37 smithi171 bash[25040]: cluster 2024-09-13T23:23:36.359546+0000 mgr.a (mgr.14355) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:39.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:39 smithi007 bash[22722]: cluster 2024-09-13T23:23:38.360371+0000 mgr.a (mgr.14355) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:23:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:39 smithi131 bash[24745]: cluster 2024-09-13T23:23:38.360371+0000 mgr.a (mgr.14355) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:23:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:39 smithi171 bash[25040]: cluster 2024-09-13T23:23:38.360371+0000 mgr.a (mgr.14355) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:23:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:41 smithi007 bash[22722]: cluster 2024-09-13T23:23:40.362327+0000 mgr.a (mgr.14355) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:41.704 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:41 smithi131 bash[24745]: cluster 2024-09-13T23:23:40.362327+0000 mgr.a (mgr.14355) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:41 smithi171 bash[25040]: cluster 2024-09-13T23:23:40.362327+0000 mgr.a (mgr.14355) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:42 smithi131 bash[24745]: audit 2024-09-13T23:23:41.302405+0000 mgr.a (mgr.14355) 2716 : audit [DBG] from='client.70332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:42 smithi171 bash[25040]: audit 2024-09-13T23:23:41.302405+0000 mgr.a (mgr.14355) 2716 : audit [DBG] from='client.70332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:42.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:42 smithi007 bash[22722]: audit 2024-09-13T23:23:41.302405+0000 mgr.a (mgr.14355) 2716 : audit [DBG] from='client.70332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:43 smithi131 bash[24745]: cluster 2024-09-13T23:23:42.363301+0000 mgr.a (mgr.14355) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:43 smithi171 bash[25040]: cluster 2024-09-13T23:23:42.363301+0000 mgr.a (mgr.14355) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:43 smithi007 bash[22722]: cluster 2024-09-13T23:23:42.363301+0000 mgr.a (mgr.14355) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:45 smithi131 bash[24745]: cluster 2024-09-13T23:23:44.364107+0000 mgr.a (mgr.14355) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:45 smithi171 bash[25040]: cluster 2024-09-13T23:23:44.364107+0000 mgr.a (mgr.14355) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:45 smithi007 bash[22722]: cluster 2024-09-13T23:23:44.364107+0000 mgr.a (mgr.14355) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:23:46.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:46.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:47.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:47 smithi131 bash[24745]: cluster 2024-09-13T23:23:46.366401+0000 mgr.a (mgr.14355) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:23:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:47 smithi171 bash[25040]: cluster 2024-09-13T23:23:46.366401+0000 mgr.a (mgr.14355) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:23:47.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:47 smithi007 bash[22722]: cluster 2024-09-13T23:23:46.366401+0000 mgr.a (mgr.14355) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:23:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:48 smithi131 bash[24745]: audit 2024-09-13T23:23:47.038000+0000 mgr.a (mgr.14355) 2720 : audit [DBG] from='client.70410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:48 smithi171 bash[25040]: audit 2024-09-13T23:23:47.038000+0000 mgr.a (mgr.14355) 2720 : audit [DBG] from='client.70410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:48.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:48 smithi007 bash[22722]: audit 2024-09-13T23:23:47.038000+0000 mgr.a (mgr.14355) 2720 : audit [DBG] from='client.70410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:49 smithi131 bash[24745]: cluster 2024-09-13T23:23:48.367341+0000 mgr.a (mgr.14355) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:49 smithi171 bash[25040]: cluster 2024-09-13T23:23:48.367341+0000 mgr.a (mgr.14355) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:49 smithi007 bash[22722]: cluster 2024-09-13T23:23:48.367341+0000 mgr.a (mgr.14355) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:51 smithi131 bash[24745]: cluster 2024-09-13T23:23:50.369513+0000 mgr.a (mgr.14355) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:51 smithi171 bash[25040]: cluster 2024-09-13T23:23:50.369513+0000 mgr.a (mgr.14355) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:51 smithi007 bash[22722]: cluster 2024-09-13T23:23:50.369513+0000 mgr.a (mgr.14355) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:23:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:52 smithi131 bash[24745]: audit 2024-09-13T23:23:51.729147+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:23:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:52 smithi171 bash[25040]: audit 2024-09-13T23:23:51.729147+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:23:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:52 smithi007 bash[22722]: audit 2024-09-13T23:23:51.729147+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22972]: debug 2024-09-13T23:23:53.307+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22972]: debug 2024-09-13T23:23:53.319+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: cluster 2024-09-13T23:23:52.369951+0000 mgr.a (mgr.14355) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.571100+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.572257+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.579373+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:23:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.583679+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.585712+0000 mgr.a (mgr.14355) 2724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:53 smithi007 bash[22722]: audit 2024-09-13T23:23:52.800983+0000 mgr.a (mgr.14355) 2725 : audit [DBG] from='client.70488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:53.728 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: cluster 2024-09-13T23:23:52.369951+0000 mgr.a (mgr.14355) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.571100+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.572257+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.579373+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.583679+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.585712+0000 mgr.a (mgr.14355) 2724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:53 smithi131 bash[24745]: audit 2024-09-13T23:23:52.800983+0000 mgr.a (mgr.14355) 2725 : audit [DBG] from='client.70488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: cluster 2024-09-13T23:23:52.369951+0000 mgr.a (mgr.14355) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.571100+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:23:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.572257+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:23:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.579373+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:23:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.583679+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.585712+0000 mgr.a (mgr.14355) 2724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:23:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:53 smithi171 bash[25040]: audit 2024-09-13T23:23:52.800983+0000 mgr.a (mgr.14355) 2725 : audit [DBG] from='client.70488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:23:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:54 smithi131 bash[24745]: audit 2024-09-13T23:23:53.313836+0000 mgr.a (mgr.14355) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:23:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:54 smithi131 bash[24745]: cephadm 2024-09-13T23:23:53.326140+0000 mgr.a (mgr.14355) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:23:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:54 smithi171 bash[25040]: audit 2024-09-13T23:23:53.313836+0000 mgr.a (mgr.14355) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:23:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:54 smithi171 bash[25040]: cephadm 2024-09-13T23:23:53.326140+0000 mgr.a (mgr.14355) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:23:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:54 smithi007 bash[22722]: audit 2024-09-13T23:23:53.313836+0000 mgr.a (mgr.14355) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:23:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:54 smithi007 bash[22722]: cephadm 2024-09-13T23:23:53.326140+0000 mgr.a (mgr.14355) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:23:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:55 smithi131 bash[24745]: cluster 2024-09-13T23:23:54.370992+0000 mgr.a (mgr.14355) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:55 smithi171 bash[25040]: cluster 2024-09-13T23:23:54.370992+0000 mgr.a (mgr.14355) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:55 smithi007 bash[22722]: cluster 2024-09-13T23:23:54.370992+0000 mgr.a (mgr.14355) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:23:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:57 smithi131 bash[24745]: cluster 2024-09-13T23:23:56.373333+0000 mgr.a (mgr.14355) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:57 smithi171 bash[25040]: cluster 2024-09-13T23:23:56.373333+0000 mgr.a (mgr.14355) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:57 smithi007 bash[22722]: cluster 2024-09-13T23:23:56.373333+0000 mgr.a (mgr.14355) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:58.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:23:58.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:23:58.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:23:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:23:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:23:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:23:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:23:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:23:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:23:59 smithi131 bash[24745]: cluster 2024-09-13T23:23:58.374102+0000 mgr.a (mgr.14355) 2730 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:23:59 smithi171 bash[25040]: cluster 2024-09-13T23:23:58.374102+0000 mgr.a (mgr.14355) 2730 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:23:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:23:59 smithi007 bash[22722]: cluster 2024-09-13T23:23:58.374102+0000 mgr.a (mgr.14355) 2730 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:00 smithi131 bash[24745]: audit 2024-09-13T23:23:59.058445+0000 mgr.a (mgr.14355) 2731 : audit [DBG] from='client.70671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:00 smithi171 bash[25040]: audit 2024-09-13T23:23:59.058445+0000 mgr.a (mgr.14355) 2731 : audit [DBG] from='client.70671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:00 smithi007 bash[22722]: audit 2024-09-13T23:23:59.058445+0000 mgr.a (mgr.14355) 2731 : audit [DBG] from='client.70671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:01 smithi131 bash[24745]: cluster 2024-09-13T23:24:00.376513+0000 mgr.a (mgr.14355) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:01 smithi171 bash[25040]: cluster 2024-09-13T23:24:00.376513+0000 mgr.a (mgr.14355) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:01.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:01 smithi007 bash[22722]: cluster 2024-09-13T23:24:00.376513+0000 mgr.a (mgr.14355) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:03 smithi131 bash[24745]: cluster 2024-09-13T23:24:02.377462+0000 mgr.a (mgr.14355) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:03 smithi171 bash[25040]: cluster 2024-09-13T23:24:02.377462+0000 mgr.a (mgr.14355) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:03 smithi007 bash[22722]: cluster 2024-09-13T23:24:02.377462+0000 mgr.a (mgr.14355) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:05.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:05.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:05.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:05.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:05 smithi171 bash[25040]: cluster 2024-09-13T23:24:04.378241+0000 mgr.a (mgr.14355) 2734 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:05 smithi171 bash[25040]: audit 2024-09-13T23:24:04.815489+0000 mgr.a (mgr.14355) 2735 : audit [DBG] from='client.70749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:05 smithi007 bash[22722]: cluster 2024-09-13T23:24:04.378241+0000 mgr.a (mgr.14355) 2734 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:05 smithi007 bash[22722]: audit 2024-09-13T23:24:04.815489+0000 mgr.a (mgr.14355) 2735 : audit [DBG] from='client.70749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:05 smithi131 bash[24745]: cluster 2024-09-13T23:24:04.378241+0000 mgr.a (mgr.14355) 2734 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:05 smithi131 bash[24745]: audit 2024-09-13T23:24:04.815489+0000 mgr.a (mgr.14355) 2735 : audit [DBG] from='client.70749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:07 smithi171 bash[25040]: cluster 2024-09-13T23:24:06.380623+0000 mgr.a (mgr.14355) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:07.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:07 smithi007 bash[22722]: cluster 2024-09-13T23:24:06.380623+0000 mgr.a (mgr.14355) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:07 smithi131 bash[24745]: cluster 2024-09-13T23:24:06.380623+0000 mgr.a (mgr.14355) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:24:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:09 smithi171 bash[25040]: cluster 2024-09-13T23:24:08.381412+0000 mgr.a (mgr.14355) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:24:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:09 smithi007 bash[22722]: cluster 2024-09-13T23:24:08.381412+0000 mgr.a (mgr.14355) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:24:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:09 smithi131 bash[24745]: cluster 2024-09-13T23:24:08.381412+0000 mgr.a (mgr.14355) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:24:10.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:10.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:10.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:10.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:10.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:10.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:10.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:10.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:11 smithi007 bash[22722]: cluster 2024-09-13T23:24:10.382397+0000 mgr.a (mgr.14355) 2738 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:11 smithi007 bash[22722]: audit 2024-09-13T23:24:10.583787+0000 mgr.a (mgr.14355) 2739 : audit [DBG] from='client.70824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:11 smithi131 bash[24745]: cluster 2024-09-13T23:24:10.382397+0000 mgr.a (mgr.14355) 2738 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:11 smithi131 bash[24745]: audit 2024-09-13T23:24:10.583787+0000 mgr.a (mgr.14355) 2739 : audit [DBG] from='client.70824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:11 smithi171 bash[25040]: cluster 2024-09-13T23:24:10.382397+0000 mgr.a (mgr.14355) 2738 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:11 smithi171 bash[25040]: audit 2024-09-13T23:24:10.583787+0000 mgr.a (mgr.14355) 2739 : audit [DBG] from='client.70824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:13 smithi007 bash[22722]: cluster 2024-09-13T23:24:12.383201+0000 mgr.a (mgr.14355) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:13 smithi131 bash[24745]: cluster 2024-09-13T23:24:12.383201+0000 mgr.a (mgr.14355) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:13 smithi171 bash[25040]: cluster 2024-09-13T23:24:12.383201+0000 mgr.a (mgr.14355) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:15 smithi007 bash[22722]: cluster 2024-09-13T23:24:14.383984+0000 mgr.a (mgr.14355) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:15.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:15 smithi131 bash[24745]: cluster 2024-09-13T23:24:14.383984+0000 mgr.a (mgr.14355) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:15 smithi171 bash[25040]: cluster 2024-09-13T23:24:14.383984+0000 mgr.a (mgr.14355) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:16.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:16.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:17 smithi007 bash[22722]: audit 2024-09-13T23:24:16.322841+0000 mgr.a (mgr.14355) 2742 : audit [DBG] from='client.70896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:17 smithi007 bash[22722]: cluster 2024-09-13T23:24:16.385643+0000 mgr.a (mgr.14355) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:17 smithi131 bash[24745]: audit 2024-09-13T23:24:16.322841+0000 mgr.a (mgr.14355) 2742 : audit [DBG] from='client.70896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:17 smithi131 bash[24745]: cluster 2024-09-13T23:24:16.385643+0000 mgr.a (mgr.14355) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:17 smithi171 bash[25040]: audit 2024-09-13T23:24:16.322841+0000 mgr.a (mgr.14355) 2742 : audit [DBG] from='client.70896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:17 smithi171 bash[25040]: cluster 2024-09-13T23:24:16.385643+0000 mgr.a (mgr.14355) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:19 smithi007 bash[22722]: cluster 2024-09-13T23:24:18.386538+0000 mgr.a (mgr.14355) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:24:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:19 smithi131 bash[24745]: cluster 2024-09-13T23:24:18.386538+0000 mgr.a (mgr.14355) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:24:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:19 smithi171 bash[25040]: cluster 2024-09-13T23:24:18.386538+0000 mgr.a (mgr.14355) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:24:21.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:21.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:21.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:21 smithi007 bash[22722]: cluster 2024-09-13T23:24:20.388660+0000 mgr.a (mgr.14355) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:24:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:21 smithi131 bash[24745]: cluster 2024-09-13T23:24:20.388660+0000 mgr.a (mgr.14355) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:24:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:21 smithi171 bash[25040]: cluster 2024-09-13T23:24:20.388660+0000 mgr.a (mgr.14355) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:24:22.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:22.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:22.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:22.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:22.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:23 smithi007 bash[22722]: audit 2024-09-13T23:24:22.073778+0000 mgr.a (mgr.14355) 2746 : audit [DBG] from='client.70974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:23 smithi007 bash[22722]: cluster 2024-09-13T23:24:22.389266+0000 mgr.a (mgr.14355) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:23 smithi131 bash[24745]: audit 2024-09-13T23:24:22.073778+0000 mgr.a (mgr.14355) 2746 : audit [DBG] from='client.70974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:23 smithi131 bash[24745]: cluster 2024-09-13T23:24:22.389266+0000 mgr.a (mgr.14355) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:23 smithi171 bash[25040]: audit 2024-09-13T23:24:22.073778+0000 mgr.a (mgr.14355) 2746 : audit [DBG] from='client.70974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:23 smithi171 bash[25040]: cluster 2024-09-13T23:24:22.389266+0000 mgr.a (mgr.14355) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:25 smithi007 bash[22722]: cluster 2024-09-13T23:24:24.390143+0000 mgr.a (mgr.14355) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:25 smithi131 bash[24745]: cluster 2024-09-13T23:24:24.390143+0000 mgr.a (mgr.14355) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:25 smithi171 bash[25040]: cluster 2024-09-13T23:24:24.390143+0000 mgr.a (mgr.14355) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:27.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:27.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:27.512 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:27 smithi007 bash[22722]: cluster 2024-09-13T23:24:26.392400+0000 mgr.a (mgr.14355) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:27 smithi131 bash[24745]: cluster 2024-09-13T23:24:26.392400+0000 mgr.a (mgr.14355) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:27 smithi171 bash[25040]: cluster 2024-09-13T23:24:26.392400+0000 mgr.a (mgr.14355) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:28.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:28.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:28.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:28.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:28.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:28 smithi007 bash[22722]: audit 2024-09-13T23:24:27.846260+0000 mgr.a (mgr.14355) 2750 : audit [DBG] from='client.71049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:28 smithi131 bash[24745]: audit 2024-09-13T23:24:27.846260+0000 mgr.a (mgr.14355) 2750 : audit [DBG] from='client.71049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:28 smithi171 bash[25040]: audit 2024-09-13T23:24:27.846260+0000 mgr.a (mgr.14355) 2750 : audit [DBG] from='client.71049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:29.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:29 smithi007 bash[22722]: cluster 2024-09-13T23:24:28.393455+0000 mgr.a (mgr.14355) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:29 smithi131 bash[24745]: cluster 2024-09-13T23:24:28.393455+0000 mgr.a (mgr.14355) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:29 smithi171 bash[25040]: cluster 2024-09-13T23:24:28.393455+0000 mgr.a (mgr.14355) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:31 smithi007 bash[22722]: cluster 2024-09-13T23:24:30.395673+0000 mgr.a (mgr.14355) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:31 smithi131 bash[24745]: cluster 2024-09-13T23:24:30.395673+0000 mgr.a (mgr.14355) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:31 smithi171 bash[25040]: cluster 2024-09-13T23:24:30.395673+0000 mgr.a (mgr.14355) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:33 smithi007 bash[22722]: cluster 2024-09-13T23:24:32.396434+0000 mgr.a (mgr.14355) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:34.005 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:33 smithi131 bash[24745]: cluster 2024-09-13T23:24:32.396434+0000 mgr.a (mgr.14355) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:33 smithi171 bash[25040]: cluster 2024-09-13T23:24:32.396434+0000 mgr.a (mgr.14355) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:34 smithi007 bash[22722]: audit 2024-09-13T23:24:33.601083+0000 mgr.a (mgr.14355) 2754 : audit [DBG] from='client.71127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:34 smithi131 bash[24745]: audit 2024-09-13T23:24:33.601083+0000 mgr.a (mgr.14355) 2754 : audit [DBG] from='client.71127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:34 smithi171 bash[25040]: audit 2024-09-13T23:24:33.601083+0000 mgr.a (mgr.14355) 2754 : audit [DBG] from='client.71127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:35.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:35 smithi007 bash[22722]: cluster 2024-09-13T23:24:34.397381+0000 mgr.a (mgr.14355) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:35 smithi131 bash[24745]: cluster 2024-09-13T23:24:34.397381+0000 mgr.a (mgr.14355) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:35 smithi171 bash[25040]: cluster 2024-09-13T23:24:34.397381+0000 mgr.a (mgr.14355) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:37.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:37 smithi007 bash[22722]: cluster 2024-09-13T23:24:36.399615+0000 mgr.a (mgr.14355) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:37 smithi131 bash[24745]: cluster 2024-09-13T23:24:36.399615+0000 mgr.a (mgr.14355) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:37 smithi171 bash[25040]: cluster 2024-09-13T23:24:36.399615+0000 mgr.a (mgr.14355) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:39.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:39.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:39.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:39.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:39.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:39.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:39.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:39.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:39 smithi007 bash[22722]: cluster 2024-09-13T23:24:38.400376+0000 mgr.a (mgr.14355) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:39 smithi131 bash[24745]: cluster 2024-09-13T23:24:38.400376+0000 mgr.a (mgr.14355) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:39 smithi171 bash[25040]: cluster 2024-09-13T23:24:38.400376+0000 mgr.a (mgr.14355) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:40 smithi007 bash[22722]: audit 2024-09-13T23:24:39.341312+0000 mgr.a (mgr.14355) 2758 : audit [DBG] from='client.71205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:40 smithi131 bash[24745]: audit 2024-09-13T23:24:39.341312+0000 mgr.a (mgr.14355) 2758 : audit [DBG] from='client.71205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:40 smithi171 bash[25040]: audit 2024-09-13T23:24:39.341312+0000 mgr.a (mgr.14355) 2758 : audit [DBG] from='client.71205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:41 smithi007 bash[22722]: cluster 2024-09-13T23:24:40.402772+0000 mgr.a (mgr.14355) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:41 smithi131 bash[24745]: cluster 2024-09-13T23:24:40.402772+0000 mgr.a (mgr.14355) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:41 smithi171 bash[25040]: cluster 2024-09-13T23:24:40.402772+0000 mgr.a (mgr.14355) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:24:43.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:43 smithi007 bash[22722]: cluster 2024-09-13T23:24:42.403577+0000 mgr.a (mgr.14355) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:43 smithi131 bash[24745]: cluster 2024-09-13T23:24:42.403577+0000 mgr.a (mgr.14355) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:43 smithi171 bash[25040]: cluster 2024-09-13T23:24:42.403577+0000 mgr.a (mgr.14355) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:45.529 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:45.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:45.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:45.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:45.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:45 smithi007 bash[22722]: cluster 2024-09-13T23:24:44.404337+0000 mgr.a (mgr.14355) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:45 smithi131 bash[24745]: cluster 2024-09-13T23:24:44.404337+0000 mgr.a (mgr.14355) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:45 smithi171 bash[25040]: cluster 2024-09-13T23:24:44.404337+0000 mgr.a (mgr.14355) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:46 smithi007 bash[22722]: audit 2024-09-13T23:24:45.086188+0000 mgr.a (mgr.14355) 2762 : audit [DBG] from='client.71283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:46 smithi131 bash[24745]: audit 2024-09-13T23:24:45.086188+0000 mgr.a (mgr.14355) 2762 : audit [DBG] from='client.71283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:46 smithi171 bash[25040]: audit 2024-09-13T23:24:45.086188+0000 mgr.a (mgr.14355) 2762 : audit [DBG] from='client.71283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:47 smithi007 bash[22722]: cluster 2024-09-13T23:24:46.407055+0000 mgr.a (mgr.14355) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:47 smithi131 bash[24745]: cluster 2024-09-13T23:24:46.407055+0000 mgr.a (mgr.14355) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:47 smithi171 bash[25040]: cluster 2024-09-13T23:24:46.407055+0000 mgr.a (mgr.14355) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:49 smithi007 bash[22722]: cluster 2024-09-13T23:24:48.407817+0000 mgr.a (mgr.14355) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:49 smithi131 bash[24745]: cluster 2024-09-13T23:24:48.407817+0000 mgr.a (mgr.14355) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:49 smithi171 bash[25040]: cluster 2024-09-13T23:24:48.407817+0000 mgr.a (mgr.14355) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:50.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:50.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:50.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:51.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:51.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:51.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:51.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:51.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:51 smithi007 bash[22722]: cluster 2024-09-13T23:24:50.409718+0000 mgr.a (mgr.14355) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:51 smithi007 bash[22722]: audit 2024-09-13T23:24:50.867692+0000 mgr.a (mgr.14355) 2766 : audit [DBG] from='client.71361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:51 smithi131 bash[24745]: cluster 2024-09-13T23:24:50.409718+0000 mgr.a (mgr.14355) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:51 smithi131 bash[24745]: audit 2024-09-13T23:24:50.867692+0000 mgr.a (mgr.14355) 2766 : audit [DBG] from='client.71361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:51 smithi171 bash[25040]: cluster 2024-09-13T23:24:50.409718+0000 mgr.a (mgr.14355) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:51 smithi171 bash[25040]: audit 2024-09-13T23:24:50.867692+0000 mgr.a (mgr.14355) 2766 : audit [DBG] from='client.71361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:53 smithi007 bash[22722]: cluster 2024-09-13T23:24:52.410634+0000 mgr.a (mgr.14355) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:53 smithi007 bash[22722]: audit 2024-09-13T23:24:53.387734+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:24:54.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:53 smithi131 bash[24745]: cluster 2024-09-13T23:24:52.410634+0000 mgr.a (mgr.14355) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:53 smithi131 bash[24745]: audit 2024-09-13T23:24:53.387734+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:24:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:53 smithi171 bash[25040]: cluster 2024-09-13T23:24:52.410634+0000 mgr.a (mgr.14355) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:24:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:53 smithi171 bash[25040]: audit 2024-09-13T23:24:53.387734+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:24:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:55 smithi007 bash[22722]: cluster 2024-09-13T23:24:54.411529+0000 mgr.a (mgr.14355) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:55 smithi131 bash[24745]: cluster 2024-09-13T23:24:54.411529+0000 mgr.a (mgr.14355) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:55 smithi171 bash[25040]: cluster 2024-09-13T23:24:54.411529+0000 mgr.a (mgr.14355) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:24:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:24:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:24:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:24:57.052 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:24:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:24:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:24:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:24:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:24:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:57 smithi007 bash[22722]: cluster 2024-09-13T23:24:56.412683+0000 mgr.a (mgr.14355) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:57 smithi007 bash[22722]: audit 2024-09-13T23:24:56.640043+0000 mgr.a (mgr.14355) 2770 : audit [DBG] from='client.71433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:57 smithi131 bash[24745]: cluster 2024-09-13T23:24:56.412683+0000 mgr.a (mgr.14355) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:57 smithi131 bash[24745]: audit 2024-09-13T23:24:56.640043+0000 mgr.a (mgr.14355) 2770 : audit [DBG] from='client.71433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:24:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:57 smithi171 bash[25040]: cluster 2024-09-13T23:24:56.412683+0000 mgr.a (mgr.14355) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:24:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:57 smithi171 bash[25040]: audit 2024-09-13T23:24:56.640043+0000 mgr.a (mgr.14355) 2770 : audit [DBG] from='client.71433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: cluster 2024-09-13T23:24:58.413543+0000 mgr.a (mgr.14355) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.739418+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.743804+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.746913+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.751087+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.774118+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:58.777941+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:59.532527+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:59.534454+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:59.544616+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:24:59 smithi131 bash[24745]: audit 2024-09-13T23:24:59.549318+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:00.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: cluster 2024-09-13T23:24:58.413543+0000 mgr.a (mgr.14355) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:00.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.739418+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.743804+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.746913+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.751087+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.774118+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:58.777941+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:59.532527+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:59.534454+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:59.544616+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:24:59 smithi171 bash[25040]: audit 2024-09-13T23:24:59.549318+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: cluster 2024-09-13T23:24:58.413543+0000 mgr.a (mgr.14355) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.739418+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.743804+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.746913+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.751087+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.774118+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:58.777941+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:59.532527+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:59.534454+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:59.544616+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:25:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:24:59 smithi007 bash[22722]: audit 2024-09-13T23:24:59.549318+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:25:00 smithi007 bash[22972]: debug 2024-09-13T23:25:00.270+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:25:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:25:00 smithi007 bash[22972]: debug 2024-09-13T23:25:00.274+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:25:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:00 smithi131 bash[24745]: audit 2024-09-13T23:24:59.551698+0000 mgr.a (mgr.14355) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:00 smithi171 bash[25040]: audit 2024-09-13T23:24:59.551698+0000 mgr.a (mgr.14355) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:00 smithi007 bash[22722]: audit 2024-09-13T23:24:59.551698+0000 mgr.a (mgr.14355) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:25:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:01 smithi131 bash[24745]: audit 2024-09-13T23:25:00.277746+0000 mgr.a (mgr.14355) 2773 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:25:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:01 smithi131 bash[24745]: cephadm 2024-09-13T23:25:00.278850+0000 mgr.a (mgr.14355) 2774 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:25:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:01 smithi131 bash[24745]: cluster 2024-09-13T23:25:00.416012+0000 mgr.a (mgr.14355) 2775 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:01 smithi171 bash[25040]: audit 2024-09-13T23:25:00.277746+0000 mgr.a (mgr.14355) 2773 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:25:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:01 smithi171 bash[25040]: cephadm 2024-09-13T23:25:00.278850+0000 mgr.a (mgr.14355) 2774 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:25:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:01 smithi171 bash[25040]: cluster 2024-09-13T23:25:00.416012+0000 mgr.a (mgr.14355) 2775 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:02.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:02.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:02.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:01 smithi007 bash[22722]: audit 2024-09-13T23:25:00.277746+0000 mgr.a (mgr.14355) 2773 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:25:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:01 smithi007 bash[22722]: cephadm 2024-09-13T23:25:00.278850+0000 mgr.a (mgr.14355) 2774 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:25:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:01 smithi007 bash[22722]: cluster 2024-09-13T23:25:00.416012+0000 mgr.a (mgr.14355) 2775 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:03 smithi131 bash[24745]: audit 2024-09-13T23:25:02.384183+0000 mgr.a (mgr.14355) 2776 : audit [DBG] from='client.71619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:03 smithi131 bash[24745]: cluster 2024-09-13T23:25:02.417172+0000 mgr.a (mgr.14355) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:03 smithi171 bash[25040]: audit 2024-09-13T23:25:02.384183+0000 mgr.a (mgr.14355) 2776 : audit [DBG] from='client.71619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:03 smithi171 bash[25040]: cluster 2024-09-13T23:25:02.417172+0000 mgr.a (mgr.14355) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:03 smithi007 bash[22722]: audit 2024-09-13T23:25:02.384183+0000 mgr.a (mgr.14355) 2776 : audit [DBG] from='client.71619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:03 smithi007 bash[22722]: cluster 2024-09-13T23:25:02.417172+0000 mgr.a (mgr.14355) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:05 smithi131 bash[24745]: cluster 2024-09-13T23:25:04.418147+0000 mgr.a (mgr.14355) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:05 smithi171 bash[25040]: cluster 2024-09-13T23:25:04.418147+0000 mgr.a (mgr.14355) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:05 smithi007 bash[22722]: cluster 2024-09-13T23:25:04.418147+0000 mgr.a (mgr.14355) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T23:25:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:07 smithi131 bash[24745]: cluster 2024-09-13T23:25:06.420489+0000 mgr.a (mgr.14355) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:08.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:07 smithi171 bash[25040]: cluster 2024-09-13T23:25:06.420489+0000 mgr.a (mgr.14355) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:07 smithi007 bash[22722]: cluster 2024-09-13T23:25:06.420489+0000 mgr.a (mgr.14355) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:08.555 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:08.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:08.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:09 smithi131 bash[24745]: audit 2024-09-13T23:25:08.144891+0000 mgr.a (mgr.14355) 2780 : audit [DBG] from='client.71694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:09 smithi131 bash[24745]: cluster 2024-09-13T23:25:08.421049+0000 mgr.a (mgr.14355) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:09 smithi171 bash[25040]: audit 2024-09-13T23:25:08.144891+0000 mgr.a (mgr.14355) 2780 : audit [DBG] from='client.71694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:09 smithi171 bash[25040]: cluster 2024-09-13T23:25:08.421049+0000 mgr.a (mgr.14355) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:09 smithi007 bash[22722]: audit 2024-09-13T23:25:08.144891+0000 mgr.a (mgr.14355) 2780 : audit [DBG] from='client.71694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:09 smithi007 bash[22722]: cluster 2024-09-13T23:25:08.421049+0000 mgr.a (mgr.14355) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:11 smithi131 bash[24745]: cluster 2024-09-13T23:25:10.423296+0000 mgr.a (mgr.14355) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:11 smithi171 bash[25040]: cluster 2024-09-13T23:25:10.423296+0000 mgr.a (mgr.14355) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:11 smithi007 bash[22722]: cluster 2024-09-13T23:25:10.423296+0000 mgr.a (mgr.14355) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:25:13.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:13.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:13.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:13 smithi131 bash[24745]: cluster 2024-09-13T23:25:12.424052+0000 mgr.a (mgr.14355) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:13 smithi171 bash[25040]: cluster 2024-09-13T23:25:12.424052+0000 mgr.a (mgr.14355) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:14.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:13 smithi007 bash[22722]: cluster 2024-09-13T23:25:12.424052+0000 mgr.a (mgr.14355) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:14.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:14.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:14 smithi131 bash[24745]: audit 2024-09-13T23:25:13.890888+0000 mgr.a (mgr.14355) 2784 : audit [DBG] from='client.71772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:14 smithi171 bash[25040]: audit 2024-09-13T23:25:13.890888+0000 mgr.a (mgr.14355) 2784 : audit [DBG] from='client.71772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:15.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:14 smithi007 bash[22722]: audit 2024-09-13T23:25:13.890888+0000 mgr.a (mgr.14355) 2784 : audit [DBG] from='client.71772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:15 smithi171 bash[25040]: cluster 2024-09-13T23:25:14.424923+0000 mgr.a (mgr.14355) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:15 smithi007 bash[22722]: cluster 2024-09-13T23:25:14.424923+0000 mgr.a (mgr.14355) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:16.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:15 smithi131 bash[24745]: cluster 2024-09-13T23:25:14.424923+0000 mgr.a (mgr.14355) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:25:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:17 smithi171 bash[25040]: cluster 2024-09-13T23:25:16.427335+0000 mgr.a (mgr.14355) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:25:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:17 smithi007 bash[22722]: cluster 2024-09-13T23:25:16.427335+0000 mgr.a (mgr.14355) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:25:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:17 smithi131 bash[24745]: cluster 2024-09-13T23:25:16.427335+0000 mgr.a (mgr.14355) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:25:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:20.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:20.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:20.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:19 smithi007 bash[22722]: cluster 2024-09-13T23:25:18.428240+0000 mgr.a (mgr.14355) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:19 smithi131 bash[24745]: cluster 2024-09-13T23:25:18.428240+0000 mgr.a (mgr.14355) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:19 smithi171 bash[25040]: cluster 2024-09-13T23:25:18.428240+0000 mgr.a (mgr.14355) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:20 smithi007 bash[22722]: audit 2024-09-13T23:25:19.631747+0000 mgr.a (mgr.14355) 2788 : audit [DBG] from='client.71850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:20 smithi131 bash[24745]: audit 2024-09-13T23:25:19.631747+0000 mgr.a (mgr.14355) 2788 : audit [DBG] from='client.71850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:20 smithi171 bash[25040]: audit 2024-09-13T23:25:19.631747+0000 mgr.a (mgr.14355) 2788 : audit [DBG] from='client.71850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:21 smithi007 bash[22722]: cluster 2024-09-13T23:25:20.430497+0000 mgr.a (mgr.14355) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:21 smithi131 bash[24745]: cluster 2024-09-13T23:25:20.430497+0000 mgr.a (mgr.14355) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:21 smithi171 bash[25040]: cluster 2024-09-13T23:25:20.430497+0000 mgr.a (mgr.14355) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:23 smithi007 bash[22722]: cluster 2024-09-13T23:25:22.431256+0000 mgr.a (mgr.14355) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:23 smithi131 bash[24745]: cluster 2024-09-13T23:25:22.431256+0000 mgr.a (mgr.14355) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:23 smithi171 bash[25040]: cluster 2024-09-13T23:25:22.431256+0000 mgr.a (mgr.14355) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:25.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:25.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:25.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:25.792 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:25 smithi007 bash[22722]: cluster 2024-09-13T23:25:24.432008+0000 mgr.a (mgr.14355) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:25 smithi131 bash[24745]: cluster 2024-09-13T23:25:24.432008+0000 mgr.a (mgr.14355) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:25 smithi171 bash[25040]: cluster 2024-09-13T23:25:24.432008+0000 mgr.a (mgr.14355) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:27.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:26 smithi007 bash[22722]: audit 2024-09-13T23:25:25.382035+0000 mgr.a (mgr.14355) 2792 : audit [DBG] from='client.71928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:26 smithi131 bash[24745]: audit 2024-09-13T23:25:25.382035+0000 mgr.a (mgr.14355) 2792 : audit [DBG] from='client.71928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:26 smithi171 bash[25040]: audit 2024-09-13T23:25:25.382035+0000 mgr.a (mgr.14355) 2792 : audit [DBG] from='client.71928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:27 smithi007 bash[22722]: cluster 2024-09-13T23:25:26.434722+0000 mgr.a (mgr.14355) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:27 smithi131 bash[24745]: cluster 2024-09-13T23:25:26.434722+0000 mgr.a (mgr.14355) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:27 smithi171 bash[25040]: cluster 2024-09-13T23:25:26.434722+0000 mgr.a (mgr.14355) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:29 smithi007 bash[22722]: cluster 2024-09-13T23:25:28.435494+0000 mgr.a (mgr.14355) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:29 smithi131 bash[24745]: cluster 2024-09-13T23:25:28.435494+0000 mgr.a (mgr.14355) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:29 smithi171 bash[25040]: cluster 2024-09-13T23:25:28.435494+0000 mgr.a (mgr.14355) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:31 smithi007 bash[22722]: cluster 2024-09-13T23:25:30.437404+0000 mgr.a (mgr.14355) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:31 smithi131 bash[24745]: cluster 2024-09-13T23:25:30.437404+0000 mgr.a (mgr.14355) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:31 smithi171 bash[25040]: cluster 2024-09-13T23:25:30.437404+0000 mgr.a (mgr.14355) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:32 smithi007 bash[22722]: audit 2024-09-13T23:25:31.127532+0000 mgr.a (mgr.14355) 2796 : audit [DBG] from='client.72003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:33.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:32 smithi131 bash[24745]: audit 2024-09-13T23:25:31.127532+0000 mgr.a (mgr.14355) 2796 : audit [DBG] from='client.72003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:32 smithi171 bash[25040]: audit 2024-09-13T23:25:31.127532+0000 mgr.a (mgr.14355) 2796 : audit [DBG] from='client.72003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:33 smithi007 bash[22722]: cluster 2024-09-13T23:25:32.438447+0000 mgr.a (mgr.14355) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:33 smithi131 bash[24745]: cluster 2024-09-13T23:25:32.438447+0000 mgr.a (mgr.14355) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:33 smithi171 bash[25040]: cluster 2024-09-13T23:25:32.438447+0000 mgr.a (mgr.14355) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:25:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:35 smithi007 bash[22722]: cluster 2024-09-13T23:25:34.439266+0000 mgr.a (mgr.14355) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:25:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:35 smithi131 bash[24745]: cluster 2024-09-13T23:25:34.439266+0000 mgr.a (mgr.14355) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:25:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:35 smithi171 bash[25040]: cluster 2024-09-13T23:25:34.439266+0000 mgr.a (mgr.14355) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:25:36.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:36.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:37.314 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:37 smithi007 bash[22722]: cluster 2024-09-13T23:25:36.441485+0000 mgr.a (mgr.14355) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:37 smithi007 bash[22722]: audit 2024-09-13T23:25:36.873869+0000 mgr.a (mgr.14355) 2800 : audit [DBG] from='client.72081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:37 smithi131 bash[24745]: cluster 2024-09-13T23:25:36.441485+0000 mgr.a (mgr.14355) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:37 smithi131 bash[24745]: audit 2024-09-13T23:25:36.873869+0000 mgr.a (mgr.14355) 2800 : audit [DBG] from='client.72081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:37 smithi171 bash[25040]: cluster 2024-09-13T23:25:36.441485+0000 mgr.a (mgr.14355) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:37 smithi171 bash[25040]: audit 2024-09-13T23:25:36.873869+0000 mgr.a (mgr.14355) 2800 : audit [DBG] from='client.72081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:39 smithi007 bash[22722]: cluster 2024-09-13T23:25:38.442472+0000 mgr.a (mgr.14355) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:39 smithi131 bash[24745]: cluster 2024-09-13T23:25:38.442472+0000 mgr.a (mgr.14355) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:39 smithi171 bash[25040]: cluster 2024-09-13T23:25:38.442472+0000 mgr.a (mgr.14355) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:41 smithi007 bash[22722]: cluster 2024-09-13T23:25:40.444640+0000 mgr.a (mgr.14355) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:41 smithi131 bash[24745]: cluster 2024-09-13T23:25:40.444640+0000 mgr.a (mgr.14355) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:41 smithi171 bash[25040]: cluster 2024-09-13T23:25:40.444640+0000 mgr.a (mgr.14355) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:43.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:43.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:43.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:43.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:43.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:43 smithi007 bash[22722]: cluster 2024-09-13T23:25:42.445224+0000 mgr.a (mgr.14355) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:43 smithi007 bash[22722]: audit 2024-09-13T23:25:42.643489+0000 mgr.a (mgr.14355) 2804 : audit [DBG] from='client.72159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:43 smithi131 bash[24745]: cluster 2024-09-13T23:25:42.445224+0000 mgr.a (mgr.14355) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:43 smithi131 bash[24745]: audit 2024-09-13T23:25:42.643489+0000 mgr.a (mgr.14355) 2804 : audit [DBG] from='client.72159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:43 smithi171 bash[25040]: cluster 2024-09-13T23:25:42.445224+0000 mgr.a (mgr.14355) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:43 smithi171 bash[25040]: audit 2024-09-13T23:25:42.643489+0000 mgr.a (mgr.14355) 2804 : audit [DBG] from='client.72159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:46.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:45 smithi007 bash[22722]: cluster 2024-09-13T23:25:44.446279+0000 mgr.a (mgr.14355) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:45 smithi131 bash[24745]: cluster 2024-09-13T23:25:44.446279+0000 mgr.a (mgr.14355) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:45 smithi171 bash[25040]: cluster 2024-09-13T23:25:44.446279+0000 mgr.a (mgr.14355) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:48.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:47 smithi007 bash[22722]: cluster 2024-09-13T23:25:46.448724+0000 mgr.a (mgr.14355) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:48.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:47 smithi131 bash[24745]: cluster 2024-09-13T23:25:46.448724+0000 mgr.a (mgr.14355) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:47 smithi171 bash[25040]: cluster 2024-09-13T23:25:46.448724+0000 mgr.a (mgr.14355) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:48.817 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:49 smithi007 bash[22722]: audit 2024-09-13T23:25:48.391779+0000 mgr.a (mgr.14355) 2807 : audit [DBG] from='client.72237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:49 smithi007 bash[22722]: cluster 2024-09-13T23:25:48.449583+0000 mgr.a (mgr.14355) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:49 smithi131 bash[24745]: audit 2024-09-13T23:25:48.391779+0000 mgr.a (mgr.14355) 2807 : audit [DBG] from='client.72237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:49 smithi131 bash[24745]: cluster 2024-09-13T23:25:48.449583+0000 mgr.a (mgr.14355) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:49 smithi171 bash[25040]: audit 2024-09-13T23:25:48.391779+0000 mgr.a (mgr.14355) 2807 : audit [DBG] from='client.72237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:49 smithi171 bash[25040]: cluster 2024-09-13T23:25:48.449583+0000 mgr.a (mgr.14355) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:51 smithi007 bash[22722]: cluster 2024-09-13T23:25:50.451981+0000 mgr.a (mgr.14355) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:52.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:51 smithi131 bash[24745]: cluster 2024-09-13T23:25:50.451981+0000 mgr.a (mgr.14355) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:51 smithi171 bash[25040]: cluster 2024-09-13T23:25:50.451981+0000 mgr.a (mgr.14355) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:53.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:25:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:53 smithi007 bash[22722]: cluster 2024-09-13T23:25:52.452796+0000 mgr.a (mgr.14355) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:54.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:53 smithi131 bash[24745]: cluster 2024-09-13T23:25:52.452796+0000 mgr.a (mgr.14355) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:53 smithi171 bash[25040]: cluster 2024-09-13T23:25:52.452796+0000 mgr.a (mgr.14355) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:54.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:25:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:25:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:25:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:25:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:25:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:55 smithi007 bash[22722]: audit 2024-09-13T23:25:54.175969+0000 mgr.a (mgr.14355) 2811 : audit [DBG] from='client.72315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:55 smithi007 bash[22722]: cluster 2024-09-13T23:25:54.453382+0000 mgr.a (mgr.14355) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:55 smithi131 bash[24745]: audit 2024-09-13T23:25:54.175969+0000 mgr.a (mgr.14355) 2811 : audit [DBG] from='client.72315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:55 smithi131 bash[24745]: cluster 2024-09-13T23:25:54.453382+0000 mgr.a (mgr.14355) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:55 smithi171 bash[25040]: audit 2024-09-13T23:25:54.175969+0000 mgr.a (mgr.14355) 2811 : audit [DBG] from='client.72315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:25:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:55 smithi171 bash[25040]: cluster 2024-09-13T23:25:54.453382+0000 mgr.a (mgr.14355) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:25:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:57 smithi007 bash[22722]: cluster 2024-09-13T23:25:56.455853+0000 mgr.a (mgr.14355) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:57 smithi131 bash[24745]: cluster 2024-09-13T23:25:56.455853+0000 mgr.a (mgr.14355) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:57 smithi171 bash[25040]: cluster 2024-09-13T23:25:56.455853+0000 mgr.a (mgr.14355) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:25:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:25:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:25:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:00.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:25:59 smithi007 bash[22722]: cluster 2024-09-13T23:25:58.456790+0000 mgr.a (mgr.14355) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:25:59 smithi131 bash[24745]: cluster 2024-09-13T23:25:58.456790+0000 mgr.a (mgr.14355) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:25:59 smithi171 bash[25040]: cluster 2024-09-13T23:25:58.456790+0000 mgr.a (mgr.14355) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:00.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:00.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:00.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:00 smithi007 bash[22722]: audit 2024-09-13T23:26:00.330993+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:26:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:00 smithi131 bash[24745]: audit 2024-09-13T23:26:00.330993+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:26:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:00 smithi171 bash[25040]: audit 2024-09-13T23:26:00.330993+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22972]: debug 2024-09-13T23:26:01.825+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22972]: debug 2024-09-13T23:26:01.825+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: audit 2024-09-13T23:25:59.959131+0000 mgr.a (mgr.14355) 2815 : audit [DBG] from='client.72393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: cluster 2024-09-13T23:26:00.458453+0000 mgr.a (mgr.14355) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: audit 2024-09-13T23:26:01.090720+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:26:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: audit 2024-09-13T23:26:01.092390+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:26:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: audit 2024-09-13T23:26:01.102981+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:26:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:01 smithi007 bash[22722]: audit 2024-09-13T23:26:01.106073+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: audit 2024-09-13T23:25:59.959131+0000 mgr.a (mgr.14355) 2815 : audit [DBG] from='client.72393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: cluster 2024-09-13T23:26:00.458453+0000 mgr.a (mgr.14355) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: audit 2024-09-13T23:26:01.090720+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: audit 2024-09-13T23:26:01.092390+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: audit 2024-09-13T23:26:01.102981+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:26:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:01 smithi131 bash[24745]: audit 2024-09-13T23:26:01.106073+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: audit 2024-09-13T23:25:59.959131+0000 mgr.a (mgr.14355) 2815 : audit [DBG] from='client.72393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: cluster 2024-09-13T23:26:00.458453+0000 mgr.a (mgr.14355) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:26:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: audit 2024-09-13T23:26:01.090720+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:26:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: audit 2024-09-13T23:26:01.092390+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:26:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: audit 2024-09-13T23:26:01.102981+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:26:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:01 smithi171 bash[25040]: audit 2024-09-13T23:26:01.106073+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:02 smithi007 bash[22722]: audit 2024-09-13T23:26:01.107287+0000 mgr.a (mgr.14355) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:02 smithi007 bash[22722]: audit 2024-09-13T23:26:01.827032+0000 mgr.a (mgr.14355) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:26:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:02 smithi007 bash[22722]: cephadm 2024-09-13T23:26:01.828376+0000 mgr.a (mgr.14355) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:26:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:02 smithi131 bash[24745]: audit 2024-09-13T23:26:01.107287+0000 mgr.a (mgr.14355) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:02 smithi131 bash[24745]: audit 2024-09-13T23:26:01.827032+0000 mgr.a (mgr.14355) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:26:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:02 smithi131 bash[24745]: cephadm 2024-09-13T23:26:01.828376+0000 mgr.a (mgr.14355) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:26:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:02 smithi171 bash[25040]: audit 2024-09-13T23:26:01.107287+0000 mgr.a (mgr.14355) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:26:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:02 smithi171 bash[25040]: audit 2024-09-13T23:26:01.827032+0000 mgr.a (mgr.14355) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:26:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:02 smithi171 bash[25040]: cephadm 2024-09-13T23:26:01.828376+0000 mgr.a (mgr.14355) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:26:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:03 smithi007 bash[22722]: cluster 2024-09-13T23:26:02.459373+0000 mgr.a (mgr.14355) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:03 smithi131 bash[24745]: cluster 2024-09-13T23:26:02.459373+0000 mgr.a (mgr.14355) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:03 smithi171 bash[25040]: cluster 2024-09-13T23:26:02.459373+0000 mgr.a (mgr.14355) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:05.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:05.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:06.170 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:06.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:06.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:05 smithi007 bash[22722]: cluster 2024-09-13T23:26:04.460143+0000 mgr.a (mgr.14355) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:05 smithi131 bash[24745]: cluster 2024-09-13T23:26:04.460143+0000 mgr.a (mgr.14355) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:05 smithi171 bash[25040]: cluster 2024-09-13T23:26:04.460143+0000 mgr.a (mgr.14355) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:26:07.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:06 smithi007 bash[22722]: audit 2024-09-13T23:26:05.741039+0000 mgr.a (mgr.14355) 2822 : audit [DBG] from='client.72579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:06 smithi131 bash[24745]: audit 2024-09-13T23:26:05.741039+0000 mgr.a (mgr.14355) 2822 : audit [DBG] from='client.72579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:06 smithi171 bash[25040]: audit 2024-09-13T23:26:05.741039+0000 mgr.a (mgr.14355) 2822 : audit [DBG] from='client.72579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:07 smithi007 bash[22722]: cluster 2024-09-13T23:26:06.462970+0000 mgr.a (mgr.14355) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:07 smithi131 bash[24745]: cluster 2024-09-13T23:26:06.462970+0000 mgr.a (mgr.14355) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:07 smithi171 bash[25040]: cluster 2024-09-13T23:26:06.462970+0000 mgr.a (mgr.14355) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:08 smithi131 bash[24745]: cluster 2024-09-13T23:26:08.463758+0000 mgr.a (mgr.14355) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:08 smithi171 bash[25040]: cluster 2024-09-13T23:26:08.463758+0000 mgr.a (mgr.14355) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:09.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:08 smithi007 bash[22722]: cluster 2024-09-13T23:26:08.463758+0000 mgr.a (mgr.14355) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:11.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:11.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:11 smithi131 bash[24745]: cluster 2024-09-13T23:26:10.465687+0000 mgr.a (mgr.14355) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:11 smithi171 bash[25040]: cluster 2024-09-13T23:26:10.465687+0000 mgr.a (mgr.14355) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:11.941 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:11.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:11 smithi007 bash[22722]: cluster 2024-09-13T23:26:10.465687+0000 mgr.a (mgr.14355) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:12 smithi131 bash[24745]: audit 2024-09-13T23:26:11.504509+0000 mgr.a (mgr.14355) 2826 : audit [DBG] from='client.72657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:12 smithi171 bash[25040]: audit 2024-09-13T23:26:11.504509+0000 mgr.a (mgr.14355) 2826 : audit [DBG] from='client.72657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:12 smithi007 bash[22722]: audit 2024-09-13T23:26:11.504509+0000 mgr.a (mgr.14355) 2826 : audit [DBG] from='client.72657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:13 smithi171 bash[25040]: cluster 2024-09-13T23:26:12.466670+0000 mgr.a (mgr.14355) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:13 smithi007 bash[22722]: cluster 2024-09-13T23:26:12.466670+0000 mgr.a (mgr.14355) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:13 smithi131 bash[24745]: cluster 2024-09-13T23:26:12.466670+0000 mgr.a (mgr.14355) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:15 smithi171 bash[25040]: cluster 2024-09-13T23:26:14.467449+0000 mgr.a (mgr.14355) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:15 smithi007 bash[22722]: cluster 2024-09-13T23:26:14.467449+0000 mgr.a (mgr.14355) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:15 smithi131 bash[24745]: cluster 2024-09-13T23:26:14.467449+0000 mgr.a (mgr.14355) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:26:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:17.727 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:17 smithi171 bash[25040]: cluster 2024-09-13T23:26:16.469717+0000 mgr.a (mgr.14355) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:17.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:17 smithi007 bash[22722]: cluster 2024-09-13T23:26:16.469717+0000 mgr.a (mgr.14355) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:17 smithi131 bash[24745]: cluster 2024-09-13T23:26:16.469717+0000 mgr.a (mgr.14355) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:26:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:18 smithi007 bash[22722]: audit 2024-09-13T23:26:17.284985+0000 mgr.a (mgr.14355) 2830 : audit [DBG] from='client.72732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:18 smithi131 bash[24745]: audit 2024-09-13T23:26:17.284985+0000 mgr.a (mgr.14355) 2830 : audit [DBG] from='client.72732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:18 smithi171 bash[25040]: audit 2024-09-13T23:26:17.284985+0000 mgr.a (mgr.14355) 2830 : audit [DBG] from='client.72732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:19.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:19 smithi007 bash[22722]: cluster 2024-09-13T23:26:18.470690+0000 mgr.a (mgr.14355) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:19 smithi131 bash[24745]: cluster 2024-09-13T23:26:18.470690+0000 mgr.a (mgr.14355) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:19 smithi171 bash[25040]: cluster 2024-09-13T23:26:18.470690+0000 mgr.a (mgr.14355) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:21.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:21 smithi007 bash[22722]: cluster 2024-09-13T23:26:20.472859+0000 mgr.a (mgr.14355) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:21 smithi131 bash[24745]: cluster 2024-09-13T23:26:20.472859+0000 mgr.a (mgr.14355) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:21 smithi171 bash[25040]: cluster 2024-09-13T23:26:20.472859+0000 mgr.a (mgr.14355) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:22.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:23.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:23.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:23.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:23.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:23.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:23 smithi007 bash[22722]: cluster 2024-09-13T23:26:22.473621+0000 mgr.a (mgr.14355) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:23 smithi131 bash[24745]: cluster 2024-09-13T23:26:22.473621+0000 mgr.a (mgr.14355) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:23 smithi171 bash[25040]: cluster 2024-09-13T23:26:22.473621+0000 mgr.a (mgr.14355) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:24 smithi007 bash[22722]: audit 2024-09-13T23:26:23.067391+0000 mgr.a (mgr.14355) 2834 : audit [DBG] from='client.72804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:24 smithi131 bash[24745]: audit 2024-09-13T23:26:23.067391+0000 mgr.a (mgr.14355) 2834 : audit [DBG] from='client.72804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:24 smithi171 bash[25040]: audit 2024-09-13T23:26:23.067391+0000 mgr.a (mgr.14355) 2834 : audit [DBG] from='client.72804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:25.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:25 smithi007 bash[22722]: cluster 2024-09-13T23:26:24.474758+0000 mgr.a (mgr.14355) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:25 smithi131 bash[24745]: cluster 2024-09-13T23:26:24.474758+0000 mgr.a (mgr.14355) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:25 smithi171 bash[25040]: cluster 2024-09-13T23:26:24.474758+0000 mgr.a (mgr.14355) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:27 smithi007 bash[22722]: cluster 2024-09-13T23:26:26.477146+0000 mgr.a (mgr.14355) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:27 smithi131 bash[24745]: cluster 2024-09-13T23:26:26.477146+0000 mgr.a (mgr.14355) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:27 smithi171 bash[25040]: cluster 2024-09-13T23:26:26.477146+0000 mgr.a (mgr.14355) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:28.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:28.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:29.294 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:29.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:29.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:29.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:29.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:29 smithi007 bash[22722]: cluster 2024-09-13T23:26:28.477963+0000 mgr.a (mgr.14355) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:29 smithi007 bash[22722]: audit 2024-09-13T23:26:28.853421+0000 mgr.a (mgr.14355) 2838 : audit [DBG] from='client.72882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:29 smithi131 bash[24745]: cluster 2024-09-13T23:26:28.477963+0000 mgr.a (mgr.14355) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:29 smithi131 bash[24745]: audit 2024-09-13T23:26:28.853421+0000 mgr.a (mgr.14355) 2838 : audit [DBG] from='client.72882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:29 smithi171 bash[25040]: cluster 2024-09-13T23:26:28.477963+0000 mgr.a (mgr.14355) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:29 smithi171 bash[25040]: audit 2024-09-13T23:26:28.853421+0000 mgr.a (mgr.14355) 2838 : audit [DBG] from='client.72882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:31 smithi007 bash[22722]: cluster 2024-09-13T23:26:30.480336+0000 mgr.a (mgr.14355) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:31 smithi131 bash[24745]: cluster 2024-09-13T23:26:30.480336+0000 mgr.a (mgr.14355) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:31 smithi171 bash[25040]: cluster 2024-09-13T23:26:30.480336+0000 mgr.a (mgr.14355) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:33 smithi007 bash[22722]: cluster 2024-09-13T23:26:32.481125+0000 mgr.a (mgr.14355) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:33 smithi131 bash[24745]: cluster 2024-09-13T23:26:32.481125+0000 mgr.a (mgr.14355) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:33 smithi171 bash[25040]: cluster 2024-09-13T23:26:32.481125+0000 mgr.a (mgr.14355) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:34.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:35.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:35 smithi007 bash[22722]: cluster 2024-09-13T23:26:34.481822+0000 mgr.a (mgr.14355) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:35 smithi007 bash[22722]: audit 2024-09-13T23:26:34.633950+0000 mgr.a (mgr.14355) 2842 : audit [DBG] from='client.72960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:35 smithi131 bash[24745]: cluster 2024-09-13T23:26:34.481822+0000 mgr.a (mgr.14355) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:35 smithi131 bash[24745]: audit 2024-09-13T23:26:34.633950+0000 mgr.a (mgr.14355) 2842 : audit [DBG] from='client.72960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:35 smithi171 bash[25040]: cluster 2024-09-13T23:26:34.481822+0000 mgr.a (mgr.14355) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:35 smithi171 bash[25040]: audit 2024-09-13T23:26:34.633950+0000 mgr.a (mgr.14355) 2842 : audit [DBG] from='client.72960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:37 smithi007 bash[22722]: cluster 2024-09-13T23:26:36.484159+0000 mgr.a (mgr.14355) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:37 smithi131 bash[24745]: cluster 2024-09-13T23:26:36.484159+0000 mgr.a (mgr.14355) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:37 smithi171 bash[25040]: cluster 2024-09-13T23:26:36.484159+0000 mgr.a (mgr.14355) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:39 smithi007 bash[22722]: cluster 2024-09-13T23:26:38.484907+0000 mgr.a (mgr.14355) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:39 smithi131 bash[24745]: cluster 2024-09-13T23:26:38.484907+0000 mgr.a (mgr.14355) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:39 smithi171 bash[25040]: cluster 2024-09-13T23:26:38.484907+0000 mgr.a (mgr.14355) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:40.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:40.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:40.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:41 smithi007 bash[22722]: audit 2024-09-13T23:26:40.413386+0000 mgr.a (mgr.14355) 2845 : audit [DBG] from='client.73038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:41 smithi007 bash[22722]: cluster 2024-09-13T23:26:40.486468+0000 mgr.a (mgr.14355) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:41 smithi131 bash[24745]: audit 2024-09-13T23:26:40.413386+0000 mgr.a (mgr.14355) 2845 : audit [DBG] from='client.73038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:41 smithi131 bash[24745]: cluster 2024-09-13T23:26:40.486468+0000 mgr.a (mgr.14355) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:41 smithi171 bash[25040]: audit 2024-09-13T23:26:40.413386+0000 mgr.a (mgr.14355) 2845 : audit [DBG] from='client.73038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:41 smithi171 bash[25040]: cluster 2024-09-13T23:26:40.486468+0000 mgr.a (mgr.14355) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:43 smithi007 bash[22722]: cluster 2024-09-13T23:26:42.487500+0000 mgr.a (mgr.14355) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:43 smithi131 bash[24745]: cluster 2024-09-13T23:26:42.487500+0000 mgr.a (mgr.14355) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:43 smithi171 bash[25040]: cluster 2024-09-13T23:26:42.487500+0000 mgr.a (mgr.14355) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:45.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:45.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:45 smithi007 bash[22722]: cluster 2024-09-13T23:26:44.488449+0000 mgr.a (mgr.14355) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:45 smithi131 bash[24745]: cluster 2024-09-13T23:26:44.488449+0000 mgr.a (mgr.14355) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:45 smithi171 bash[25040]: cluster 2024-09-13T23:26:44.488449+0000 mgr.a (mgr.14355) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:46.569 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:47 smithi007 bash[22722]: audit 2024-09-13T23:26:46.169303+0000 mgr.a (mgr.14355) 2849 : audit [DBG] from='client.73116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:47 smithi007 bash[22722]: cluster 2024-09-13T23:26:46.489788+0000 mgr.a (mgr.14355) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:47 smithi131 bash[24745]: audit 2024-09-13T23:26:46.169303+0000 mgr.a (mgr.14355) 2849 : audit [DBG] from='client.73116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:47 smithi131 bash[24745]: cluster 2024-09-13T23:26:46.489788+0000 mgr.a (mgr.14355) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:47 smithi171 bash[25040]: audit 2024-09-13T23:26:46.169303+0000 mgr.a (mgr.14355) 2849 : audit [DBG] from='client.73116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:47 smithi171 bash[25040]: cluster 2024-09-13T23:26:46.489788+0000 mgr.a (mgr.14355) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:49.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:49 smithi007 bash[22722]: cluster 2024-09-13T23:26:48.490554+0000 mgr.a (mgr.14355) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:49 smithi131 bash[24745]: cluster 2024-09-13T23:26:48.490554+0000 mgr.a (mgr.14355) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:49 smithi171 bash[25040]: cluster 2024-09-13T23:26:48.490554+0000 mgr.a (mgr.14355) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:26:51.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:51.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:51.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:51.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:51 smithi007 bash[22722]: cluster 2024-09-13T23:26:50.492613+0000 mgr.a (mgr.14355) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:51 smithi131 bash[24745]: cluster 2024-09-13T23:26:50.492613+0000 mgr.a (mgr.14355) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:51 smithi171 bash[25040]: cluster 2024-09-13T23:26:50.492613+0000 mgr.a (mgr.14355) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:52.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:52.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:52.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:52.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:52.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:52.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:52 smithi007 bash[22722]: audit 2024-09-13T23:26:51.907243+0000 mgr.a (mgr.14355) 2853 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:52 smithi131 bash[24745]: audit 2024-09-13T23:26:51.907243+0000 mgr.a (mgr.14355) 2853 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:52 smithi171 bash[25040]: audit 2024-09-13T23:26:51.907243+0000 mgr.a (mgr.14355) 2853 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:53 smithi007 bash[22722]: cluster 2024-09-13T23:26:52.493744+0000 mgr.a (mgr.14355) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:54.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:53 smithi131 bash[24745]: cluster 2024-09-13T23:26:52.493744+0000 mgr.a (mgr.14355) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:53 smithi171 bash[25040]: cluster 2024-09-13T23:26:52.493744+0000 mgr.a (mgr.14355) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:55 smithi007 bash[22722]: cluster 2024-09-13T23:26:54.494592+0000 mgr.a (mgr.14355) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:55 smithi131 bash[24745]: cluster 2024-09-13T23:26:54.494592+0000 mgr.a (mgr.14355) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:55 smithi171 bash[25040]: cluster 2024-09-13T23:26:54.494592+0000 mgr.a (mgr.14355) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:26:57.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:26:57.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:26:57.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:26:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:57 smithi007 bash[22722]: cluster 2024-09-13T23:26:56.496841+0000 mgr.a (mgr.14355) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:57 smithi131 bash[24745]: cluster 2024-09-13T23:26:56.496841+0000 mgr.a (mgr.14355) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:57 smithi171 bash[25040]: cluster 2024-09-13T23:26:56.496841+0000 mgr.a (mgr.14355) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:26:58.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:26:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:26:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:26:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:26:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:26:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:58 smithi007 bash[22722]: audit 2024-09-13T23:26:57.669893+0000 mgr.a (mgr.14355) 2857 : audit [DBG] from='client.73269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:58 smithi131 bash[24745]: audit 2024-09-13T23:26:57.669893+0000 mgr.a (mgr.14355) 2857 : audit [DBG] from='client.73269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:58 smithi171 bash[25040]: audit 2024-09-13T23:26:57.669893+0000 mgr.a (mgr.14355) 2857 : audit [DBG] from='client.73269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:26:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:26:59 smithi007 bash[22722]: cluster 2024-09-13T23:26:58.497796+0000 mgr.a (mgr.14355) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:26:59 smithi131 bash[24745]: cluster 2024-09-13T23:26:58.497796+0000 mgr.a (mgr.14355) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:26:59 smithi171 bash[25040]: cluster 2024-09-13T23:26:58.497796+0000 mgr.a (mgr.14355) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:01 smithi007 bash[22722]: cluster 2024-09-13T23:27:00.500013+0000 mgr.a (mgr.14355) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:02.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:01 smithi131 bash[24745]: cluster 2024-09-13T23:27:00.500013+0000 mgr.a (mgr.14355) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:01 smithi171 bash[25040]: cluster 2024-09-13T23:27:00.500013+0000 mgr.a (mgr.14355) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:02 smithi007 bash[22722]: audit 2024-09-13T23:27:01.879080+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:27:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:02 smithi131 bash[24745]: audit 2024-09-13T23:27:01.879080+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:27:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:02 smithi171 bash[25040]: audit 2024-09-13T23:27:01.879080+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:27:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:03.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22972]: debug 2024-09-13T23:27:03.444+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22972]: debug 2024-09-13T23:27:03.452+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: cluster 2024-09-13T23:27:02.500596+0000 mgr.a (mgr.14355) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: audit 2024-09-13T23:27:02.723492+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: audit 2024-09-13T23:27:02.725366+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: audit 2024-09-13T23:27:02.735897+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: audit 2024-09-13T23:27:02.740772+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:03 smithi007 bash[22722]: audit 2024-09-13T23:27:02.743080+0000 mgr.a (mgr.14355) 2861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:03.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:03.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: cluster 2024-09-13T23:27:02.500596+0000 mgr.a (mgr.14355) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: audit 2024-09-13T23:27:02.723492+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: audit 2024-09-13T23:27:02.725366+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: audit 2024-09-13T23:27:02.735897+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: audit 2024-09-13T23:27:02.740772+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:03 smithi131 bash[24745]: audit 2024-09-13T23:27:02.743080+0000 mgr.a (mgr.14355) 2861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: cluster 2024-09-13T23:27:02.500596+0000 mgr.a (mgr.14355) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: audit 2024-09-13T23:27:02.723492+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:27:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: audit 2024-09-13T23:27:02.725366+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:27:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: audit 2024-09-13T23:27:02.735897+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:27:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: audit 2024-09-13T23:27:02.740772+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:03 smithi171 bash[25040]: audit 2024-09-13T23:27:02.743080+0000 mgr.a (mgr.14355) 2861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:27:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:04 smithi007 bash[22722]: audit 2024-09-13T23:27:03.447346+0000 mgr.a (mgr.14355) 2862 : audit [DBG] from='client.73413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:04 smithi007 bash[22722]: audit 2024-09-13T23:27:03.448111+0000 mgr.a (mgr.14355) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:27:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:04 smithi007 bash[22722]: cephadm 2024-09-13T23:27:03.457640+0000 mgr.a (mgr.14355) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:27:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:04 smithi131 bash[24745]: audit 2024-09-13T23:27:03.447346+0000 mgr.a (mgr.14355) 2862 : audit [DBG] from='client.73413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:04 smithi131 bash[24745]: audit 2024-09-13T23:27:03.448111+0000 mgr.a (mgr.14355) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:27:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:04 smithi131 bash[24745]: cephadm 2024-09-13T23:27:03.457640+0000 mgr.a (mgr.14355) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:27:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:04 smithi171 bash[25040]: audit 2024-09-13T23:27:03.447346+0000 mgr.a (mgr.14355) 2862 : audit [DBG] from='client.73413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:04 smithi171 bash[25040]: audit 2024-09-13T23:27:03.448111+0000 mgr.a (mgr.14355) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:27:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:04 smithi171 bash[25040]: cephadm 2024-09-13T23:27:03.457640+0000 mgr.a (mgr.14355) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:27:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:05 smithi007 bash[22722]: cluster 2024-09-13T23:27:04.501505+0000 mgr.a (mgr.14355) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:05 smithi131 bash[24745]: cluster 2024-09-13T23:27:04.501505+0000 mgr.a (mgr.14355) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:05 smithi171 bash[25040]: cluster 2024-09-13T23:27:04.501505+0000 mgr.a (mgr.14355) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:07 smithi007 bash[22722]: cluster 2024-09-13T23:27:06.503885+0000 mgr.a (mgr.14355) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:07 smithi131 bash[24745]: cluster 2024-09-13T23:27:06.503885+0000 mgr.a (mgr.14355) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:07 smithi171 bash[25040]: cluster 2024-09-13T23:27:06.503885+0000 mgr.a (mgr.14355) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:08.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:09.586 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:09.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:09.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:09 smithi007 bash[22722]: cluster 2024-09-13T23:27:08.504689+0000 mgr.a (mgr.14355) 2867 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:09 smithi131 bash[24745]: cluster 2024-09-13T23:27:08.504689+0000 mgr.a (mgr.14355) 2867 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:09 smithi171 bash[25040]: cluster 2024-09-13T23:27:08.504689+0000 mgr.a (mgr.14355) 2867 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:10 smithi007 bash[22722]: audit 2024-09-13T23:27:09.168123+0000 mgr.a (mgr.14355) 2868 : audit [DBG] from='client.73521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:10 smithi131 bash[24745]: audit 2024-09-13T23:27:09.168123+0000 mgr.a (mgr.14355) 2868 : audit [DBG] from='client.73521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:10 smithi171 bash[25040]: audit 2024-09-13T23:27:09.168123+0000 mgr.a (mgr.14355) 2868 : audit [DBG] from='client.73521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:11.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:11 smithi007 bash[22722]: cluster 2024-09-13T23:27:10.507202+0000 mgr.a (mgr.14355) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:11 smithi131 bash[24745]: cluster 2024-09-13T23:27:10.507202+0000 mgr.a (mgr.14355) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:11 smithi171 bash[25040]: cluster 2024-09-13T23:27:10.507202+0000 mgr.a (mgr.14355) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:13 smithi007 bash[22722]: cluster 2024-09-13T23:27:12.508157+0000 mgr.a (mgr.14355) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:13 smithi131 bash[24745]: cluster 2024-09-13T23:27:12.508157+0000 mgr.a (mgr.14355) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:13 smithi171 bash[25040]: cluster 2024-09-13T23:27:12.508157+0000 mgr.a (mgr.14355) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:14.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:15.328 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:15.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:15.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:15 smithi131 bash[24745]: cluster 2024-09-13T23:27:14.509088+0000 mgr.a (mgr.14355) 2871 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:15 smithi131 bash[24745]: audit 2024-09-13T23:27:14.908681+0000 mgr.a (mgr.14355) 2872 : audit [DBG] from='client.73599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:15 smithi171 bash[25040]: cluster 2024-09-13T23:27:14.509088+0000 mgr.a (mgr.14355) 2871 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:15 smithi171 bash[25040]: audit 2024-09-13T23:27:14.908681+0000 mgr.a (mgr.14355) 2872 : audit [DBG] from='client.73599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:15 smithi007 bash[22722]: cluster 2024-09-13T23:27:14.509088+0000 mgr.a (mgr.14355) 2871 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:15 smithi007 bash[22722]: audit 2024-09-13T23:27:14.908681+0000 mgr.a (mgr.14355) 2872 : audit [DBG] from='client.73599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:17 smithi131 bash[24745]: cluster 2024-09-13T23:27:16.511925+0000 mgr.a (mgr.14355) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:17 smithi171 bash[25040]: cluster 2024-09-13T23:27:16.511925+0000 mgr.a (mgr.14355) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:17 smithi007 bash[22722]: cluster 2024-09-13T23:27:16.511925+0000 mgr.a (mgr.14355) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:27:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:19 smithi131 bash[24745]: cluster 2024-09-13T23:27:18.512898+0000 mgr.a (mgr.14355) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:27:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:19 smithi171 bash[25040]: cluster 2024-09-13T23:27:18.512898+0000 mgr.a (mgr.14355) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:27:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:19 smithi007 bash[22722]: cluster 2024-09-13T23:27:18.512898+0000 mgr.a (mgr.14355) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:21.069 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:21.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:21.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:21.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:21 smithi131 bash[24745]: cluster 2024-09-13T23:27:20.514793+0000 mgr.a (mgr.14355) 2875 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:21 smithi131 bash[24745]: audit 2024-09-13T23:27:20.660125+0000 mgr.a (mgr.14355) 2876 : audit [DBG] from='client.73677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:21 smithi171 bash[25040]: cluster 2024-09-13T23:27:20.514793+0000 mgr.a (mgr.14355) 2875 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:21 smithi171 bash[25040]: audit 2024-09-13T23:27:20.660125+0000 mgr.a (mgr.14355) 2876 : audit [DBG] from='client.73677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:21 smithi007 bash[22722]: cluster 2024-09-13T23:27:20.514793+0000 mgr.a (mgr.14355) 2875 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:21 smithi007 bash[22722]: audit 2024-09-13T23:27:20.660125+0000 mgr.a (mgr.14355) 2876 : audit [DBG] from='client.73677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:23 smithi131 bash[24745]: cluster 2024-09-13T23:27:22.515713+0000 mgr.a (mgr.14355) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:27:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:23 smithi171 bash[25040]: cluster 2024-09-13T23:27:22.515713+0000 mgr.a (mgr.14355) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:27:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:23 smithi007 bash[22722]: cluster 2024-09-13T23:27:22.515713+0000 mgr.a (mgr.14355) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:27:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:25 smithi131 bash[24745]: cluster 2024-09-13T23:27:24.516510+0000 mgr.a (mgr.14355) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:27:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:25 smithi171 bash[25040]: cluster 2024-09-13T23:27:24.516510+0000 mgr.a (mgr.14355) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:27:26.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:26.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:25 smithi007 bash[22722]: cluster 2024-09-13T23:27:24.516510+0000 mgr.a (mgr.14355) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:27:26.849 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:26.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:26.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:26.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:26.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:27 smithi131 bash[24745]: audit 2024-09-13T23:27:26.403812+0000 mgr.a (mgr.14355) 2879 : audit [DBG] from='client.73752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:27 smithi131 bash[24745]: cluster 2024-09-13T23:27:26.517872+0000 mgr.a (mgr.14355) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:27 smithi171 bash[25040]: audit 2024-09-13T23:27:26.403812+0000 mgr.a (mgr.14355) 2879 : audit [DBG] from='client.73752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:27 smithi171 bash[25040]: cluster 2024-09-13T23:27:26.517872+0000 mgr.a (mgr.14355) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:27 smithi007 bash[22722]: audit 2024-09-13T23:27:26.403812+0000 mgr.a (mgr.14355) 2879 : audit [DBG] from='client.73752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:27 smithi007 bash[22722]: cluster 2024-09-13T23:27:26.517872+0000 mgr.a (mgr.14355) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:29 smithi131 bash[24745]: cluster 2024-09-13T23:27:28.518765+0000 mgr.a (mgr.14355) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:27:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:29 smithi171 bash[25040]: cluster 2024-09-13T23:27:28.518765+0000 mgr.a (mgr.14355) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:27:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:29 smithi007 bash[22722]: cluster 2024-09-13T23:27:28.518765+0000 mgr.a (mgr.14355) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:27:31.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:31.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:31 smithi131 bash[24745]: cluster 2024-09-13T23:27:30.520898+0000 mgr.a (mgr.14355) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:27:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:31 smithi171 bash[25040]: cluster 2024-09-13T23:27:30.520898+0000 mgr.a (mgr.14355) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:27:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:31 smithi007 bash[22722]: cluster 2024-09-13T23:27:30.520898+0000 mgr.a (mgr.14355) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:27:32.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:32.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:33 smithi131 bash[24745]: audit 2024-09-13T23:27:32.181031+0000 mgr.a (mgr.14355) 2883 : audit [DBG] from='client.73827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:33 smithi131 bash[24745]: cluster 2024-09-13T23:27:32.521434+0000 mgr.a (mgr.14355) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:33 smithi171 bash[25040]: audit 2024-09-13T23:27:32.181031+0000 mgr.a (mgr.14355) 2883 : audit [DBG] from='client.73827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:33 smithi171 bash[25040]: cluster 2024-09-13T23:27:32.521434+0000 mgr.a (mgr.14355) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:33 smithi007 bash[22722]: audit 2024-09-13T23:27:32.181031+0000 mgr.a (mgr.14355) 2883 : audit [DBG] from='client.73827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:33 smithi007 bash[22722]: cluster 2024-09-13T23:27:32.521434+0000 mgr.a (mgr.14355) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:35 smithi131 bash[24745]: cluster 2024-09-13T23:27:34.522356+0000 mgr.a (mgr.14355) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:35 smithi171 bash[25040]: cluster 2024-09-13T23:27:34.522356+0000 mgr.a (mgr.14355) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:35 smithi007 bash[22722]: cluster 2024-09-13T23:27:34.522356+0000 mgr.a (mgr.14355) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:37.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:37.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:37.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:38.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:37 smithi131 bash[24745]: cluster 2024-09-13T23:27:36.524581+0000 mgr.a (mgr.14355) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:37 smithi171 bash[25040]: cluster 2024-09-13T23:27:36.524581+0000 mgr.a (mgr.14355) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:38.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:37 smithi007 bash[22722]: cluster 2024-09-13T23:27:36.524581+0000 mgr.a (mgr.14355) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:38.371 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:38 smithi131 bash[24745]: audit 2024-09-13T23:27:37.943043+0000 mgr.a (mgr.14355) 2887 : audit [DBG] from='client.73905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:38 smithi171 bash[25040]: audit 2024-09-13T23:27:37.943043+0000 mgr.a (mgr.14355) 2887 : audit [DBG] from='client.73905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:38 smithi007 bash[22722]: audit 2024-09-13T23:27:37.943043+0000 mgr.a (mgr.14355) 2887 : audit [DBG] from='client.73905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:39 smithi131 bash[24745]: cluster 2024-09-13T23:27:38.525528+0000 mgr.a (mgr.14355) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:39 smithi171 bash[25040]: cluster 2024-09-13T23:27:38.525528+0000 mgr.a (mgr.14355) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:39 smithi007 bash[22722]: cluster 2024-09-13T23:27:38.525528+0000 mgr.a (mgr.14355) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:41 smithi131 bash[24745]: cluster 2024-09-13T23:27:40.527712+0000 mgr.a (mgr.14355) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:41 smithi171 bash[25040]: cluster 2024-09-13T23:27:40.527712+0000 mgr.a (mgr.14355) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:41 smithi007 bash[22722]: cluster 2024-09-13T23:27:40.527712+0000 mgr.a (mgr.14355) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:43 smithi131 bash[24745]: cluster 2024-09-13T23:27:42.528487+0000 mgr.a (mgr.14355) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:43 smithi171 bash[25040]: cluster 2024-09-13T23:27:42.528487+0000 mgr.a (mgr.14355) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:44.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:44.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:43 smithi007 bash[22722]: cluster 2024-09-13T23:27:42.528487+0000 mgr.a (mgr.14355) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:45.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:44 smithi131 bash[24745]: audit 2024-09-13T23:27:43.706108+0000 mgr.a (mgr.14355) 2891 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:44 smithi171 bash[25040]: audit 2024-09-13T23:27:43.706108+0000 mgr.a (mgr.14355) 2891 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:44 smithi007 bash[22722]: audit 2024-09-13T23:27:43.706108+0000 mgr.a (mgr.14355) 2891 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:45 smithi171 bash[25040]: cluster 2024-09-13T23:27:44.529449+0000 mgr.a (mgr.14355) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:45 smithi007 bash[22722]: cluster 2024-09-13T23:27:44.529449+0000 mgr.a (mgr.14355) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:45 smithi131 bash[24745]: cluster 2024-09-13T23:27:44.529449+0000 mgr.a (mgr.14355) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:47 smithi171 bash[25040]: cluster 2024-09-13T23:27:46.531754+0000 mgr.a (mgr.14355) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:47 smithi007 bash[22722]: cluster 2024-09-13T23:27:46.531754+0000 mgr.a (mgr.14355) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:48.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:47 smithi131 bash[24745]: cluster 2024-09-13T23:27:46.531754+0000 mgr.a (mgr.14355) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:49.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:49.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:49.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:49.919 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:49 smithi007 bash[22722]: cluster 2024-09-13T23:27:48.532513+0000 mgr.a (mgr.14355) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:49 smithi131 bash[24745]: cluster 2024-09-13T23:27:48.532513+0000 mgr.a (mgr.14355) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:49 smithi171 bash[25040]: cluster 2024-09-13T23:27:48.532513+0000 mgr.a (mgr.14355) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:51.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:50 smithi007 bash[22722]: audit 2024-09-13T23:27:49.483628+0000 mgr.a (mgr.14355) 2895 : audit [DBG] from='client.74052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:51.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:50 smithi131 bash[24745]: audit 2024-09-13T23:27:49.483628+0000 mgr.a (mgr.14355) 2895 : audit [DBG] from='client.74052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:50 smithi171 bash[25040]: audit 2024-09-13T23:27:49.483628+0000 mgr.a (mgr.14355) 2895 : audit [DBG] from='client.74052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:51 smithi007 bash[22722]: cluster 2024-09-13T23:27:50.534854+0000 mgr.a (mgr.14355) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:51 smithi131 bash[24745]: cluster 2024-09-13T23:27:50.534854+0000 mgr.a (mgr.14355) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:51 smithi171 bash[25040]: cluster 2024-09-13T23:27:50.534854+0000 mgr.a (mgr.14355) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:27:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:53 smithi007 bash[22722]: cluster 2024-09-13T23:27:52.535658+0000 mgr.a (mgr.14355) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:53 smithi131 bash[24745]: cluster 2024-09-13T23:27:52.535658+0000 mgr.a (mgr.14355) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:53 smithi171 bash[25040]: cluster 2024-09-13T23:27:52.535658+0000 mgr.a (mgr.14355) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:27:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:27:54.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:27:55.654 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:27:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:27:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:27:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:27:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:27:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:55 smithi007 bash[22722]: cluster 2024-09-13T23:27:54.536457+0000 mgr.a (mgr.14355) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:55 smithi131 bash[24745]: cluster 2024-09-13T23:27:54.536457+0000 mgr.a (mgr.14355) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:55 smithi171 bash[25040]: cluster 2024-09-13T23:27:54.536457+0000 mgr.a (mgr.14355) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:56 smithi007 bash[22722]: audit 2024-09-13T23:27:55.251941+0000 mgr.a (mgr.14355) 2899 : audit [DBG] from='client.74130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:56 smithi131 bash[24745]: audit 2024-09-13T23:27:55.251941+0000 mgr.a (mgr.14355) 2899 : audit [DBG] from='client.74130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:56 smithi171 bash[25040]: audit 2024-09-13T23:27:55.251941+0000 mgr.a (mgr.14355) 2899 : audit [DBG] from='client.74130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:27:58.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:57 smithi007 bash[22722]: cluster 2024-09-13T23:27:56.539301+0000 mgr.a (mgr.14355) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:57 smithi131 bash[24745]: cluster 2024-09-13T23:27:56.539301+0000 mgr.a (mgr.14355) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:27:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:57 smithi171 bash[25040]: cluster 2024-09-13T23:27:56.539301+0000 mgr.a (mgr.14355) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:27:59 smithi007 bash[22722]: cluster 2024-09-13T23:27:58.540240+0000 mgr.a (mgr.14355) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:00.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:27:59 smithi131 bash[24745]: cluster 2024-09-13T23:27:58.540240+0000 mgr.a (mgr.14355) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:27:59 smithi171 bash[25040]: cluster 2024-09-13T23:27:58.540240+0000 mgr.a (mgr.14355) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:00.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:01.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:01 smithi007 bash[22722]: cluster 2024-09-13T23:28:00.542355+0000 mgr.a (mgr.14355) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:01 smithi131 bash[24745]: cluster 2024-09-13T23:28:00.542355+0000 mgr.a (mgr.14355) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:01 smithi171 bash[25040]: cluster 2024-09-13T23:28:00.542355+0000 mgr.a (mgr.14355) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:02 smithi007 bash[22722]: audit 2024-09-13T23:28:00.985523+0000 mgr.a (mgr.14355) 2903 : audit [DBG] from='client.74208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:03.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:02 smithi131 bash[24745]: audit 2024-09-13T23:28:00.985523+0000 mgr.a (mgr.14355) 2903 : audit [DBG] from='client.74208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:02 smithi171 bash[25040]: audit 2024-09-13T23:28:00.985523+0000 mgr.a (mgr.14355) 2903 : audit [DBG] from='client.74208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:03 smithi007 bash[22722]: cluster 2024-09-13T23:28:02.543267+0000 mgr.a (mgr.14355) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:03 smithi007 bash[22722]: audit 2024-09-13T23:28:03.508873+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:28:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:03 smithi131 bash[24745]: cluster 2024-09-13T23:28:02.543267+0000 mgr.a (mgr.14355) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:03 smithi131 bash[24745]: audit 2024-09-13T23:28:03.508873+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:28:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:03 smithi171 bash[25040]: cluster 2024-09-13T23:28:02.543267+0000 mgr.a (mgr.14355) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:03 smithi171 bash[25040]: audit 2024-09-13T23:28:03.508873+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:28:05 smithi007 bash[22972]: debug 2024-09-13T23:28:05.075+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:28:05 smithi007 bash[22972]: debug 2024-09-13T23:28:05.075+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:04 smithi007 bash[22722]: audit 2024-09-13T23:28:04.337474+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:04 smithi007 bash[22722]: audit 2024-09-13T23:28:04.339126+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:04 smithi007 bash[22722]: audit 2024-09-13T23:28:04.347758+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:28:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:04 smithi007 bash[22722]: audit 2024-09-13T23:28:04.352722+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:04 smithi131 bash[24745]: audit 2024-09-13T23:28:04.337474+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:28:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:04 smithi131 bash[24745]: audit 2024-09-13T23:28:04.339126+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:28:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:04 smithi131 bash[24745]: audit 2024-09-13T23:28:04.347758+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:28:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:04 smithi131 bash[24745]: audit 2024-09-13T23:28:04.352722+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:04 smithi171 bash[25040]: audit 2024-09-13T23:28:04.337474+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:28:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:04 smithi171 bash[25040]: audit 2024-09-13T23:28:04.339126+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:28:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:04 smithi171 bash[25040]: audit 2024-09-13T23:28:04.347758+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:28:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:04 smithi171 bash[25040]: audit 2024-09-13T23:28:04.352722+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:05 smithi007 bash[22722]: audit 2024-09-13T23:28:04.355142+0000 mgr.a (mgr.14355) 2905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:05 smithi007 bash[22722]: cluster 2024-09-13T23:28:04.543889+0000 mgr.a (mgr.14355) 2906 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:05 smithi131 bash[24745]: audit 2024-09-13T23:28:04.355142+0000 mgr.a (mgr.14355) 2905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:05 smithi131 bash[24745]: cluster 2024-09-13T23:28:04.543889+0000 mgr.a (mgr.14355) 2906 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:05 smithi171 bash[25040]: audit 2024-09-13T23:28:04.355142+0000 mgr.a (mgr.14355) 2905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:28:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:05 smithi171 bash[25040]: cluster 2024-09-13T23:28:04.543889+0000 mgr.a (mgr.14355) 2906 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:06.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:07.171 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:07.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:06 smithi007 bash[22722]: audit 2024-09-13T23:28:05.080647+0000 mgr.a (mgr.14355) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:28:07.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:06 smithi007 bash[22722]: cephadm 2024-09-13T23:28:05.082060+0000 mgr.a (mgr.14355) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:28:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:06 smithi131 bash[24745]: audit 2024-09-13T23:28:05.080647+0000 mgr.a (mgr.14355) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:28:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:06 smithi131 bash[24745]: cephadm 2024-09-13T23:28:05.082060+0000 mgr.a (mgr.14355) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:28:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:06 smithi171 bash[25040]: audit 2024-09-13T23:28:05.080647+0000 mgr.a (mgr.14355) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:28:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:06 smithi171 bash[25040]: cephadm 2024-09-13T23:28:05.082060+0000 mgr.a (mgr.14355) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:28:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:07 smithi007 bash[22722]: cluster 2024-09-13T23:28:06.545377+0000 mgr.a (mgr.14355) 2909 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:07 smithi007 bash[22722]: audit 2024-09-13T23:28:06.746358+0000 mgr.a (mgr.14355) 2910 : audit [DBG] from='client.74391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:08.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:07 smithi131 bash[24745]: cluster 2024-09-13T23:28:06.545377+0000 mgr.a (mgr.14355) 2909 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:07 smithi131 bash[24745]: audit 2024-09-13T23:28:06.746358+0000 mgr.a (mgr.14355) 2910 : audit [DBG] from='client.74391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:07 smithi171 bash[25040]: cluster 2024-09-13T23:28:06.545377+0000 mgr.a (mgr.14355) 2909 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:07 smithi171 bash[25040]: audit 2024-09-13T23:28:06.746358+0000 mgr.a (mgr.14355) 2910 : audit [DBG] from='client.74391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:09 smithi007 bash[22722]: cluster 2024-09-13T23:28:08.546225+0000 mgr.a (mgr.14355) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:10.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:09 smithi131 bash[24745]: cluster 2024-09-13T23:28:08.546225+0000 mgr.a (mgr.14355) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:09 smithi171 bash[25040]: cluster 2024-09-13T23:28:08.546225+0000 mgr.a (mgr.14355) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:12.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:12.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:12.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:12.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:11 smithi007 bash[22722]: cluster 2024-09-13T23:28:10.548411+0000 mgr.a (mgr.14355) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:11 smithi131 bash[24745]: cluster 2024-09-13T23:28:10.548411+0000 mgr.a (mgr.14355) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:11 smithi171 bash[25040]: cluster 2024-09-13T23:28:10.548411+0000 mgr.a (mgr.14355) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:12.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:13 smithi007 bash[22722]: audit 2024-09-13T23:28:12.507511+0000 mgr.a (mgr.14355) 2913 : audit [DBG] from='client.74469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:13 smithi007 bash[22722]: cluster 2024-09-13T23:28:12.549438+0000 mgr.a (mgr.14355) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:13 smithi131 bash[24745]: audit 2024-09-13T23:28:12.507511+0000 mgr.a (mgr.14355) 2913 : audit [DBG] from='client.74469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:13 smithi131 bash[24745]: cluster 2024-09-13T23:28:12.549438+0000 mgr.a (mgr.14355) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:13 smithi171 bash[25040]: audit 2024-09-13T23:28:12.507511+0000 mgr.a (mgr.14355) 2913 : audit [DBG] from='client.74469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:13 smithi171 bash[25040]: cluster 2024-09-13T23:28:12.549438+0000 mgr.a (mgr.14355) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:15 smithi007 bash[22722]: cluster 2024-09-13T23:28:14.550387+0000 mgr.a (mgr.14355) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:16.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:15 smithi131 bash[24745]: cluster 2024-09-13T23:28:14.550387+0000 mgr.a (mgr.14355) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:15 smithi171 bash[25040]: cluster 2024-09-13T23:28:14.550387+0000 mgr.a (mgr.14355) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:17.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:17 smithi007 bash[22722]: cluster 2024-09-13T23:28:16.552658+0000 mgr.a (mgr.14355) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:17 smithi131 bash[24745]: cluster 2024-09-13T23:28:16.552658+0000 mgr.a (mgr.14355) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:17 smithi171 bash[25040]: cluster 2024-09-13T23:28:16.552658+0000 mgr.a (mgr.14355) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:28:18.703 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:18.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:19 smithi007 bash[22722]: audit 2024-09-13T23:28:18.283627+0000 mgr.a (mgr.14355) 2917 : audit [DBG] from='client.74547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:19 smithi007 bash[22722]: cluster 2024-09-13T23:28:18.553186+0000 mgr.a (mgr.14355) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:19 smithi131 bash[24745]: audit 2024-09-13T23:28:18.283627+0000 mgr.a (mgr.14355) 2917 : audit [DBG] from='client.74547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:19 smithi131 bash[24745]: cluster 2024-09-13T23:28:18.553186+0000 mgr.a (mgr.14355) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:19 smithi171 bash[25040]: audit 2024-09-13T23:28:18.283627+0000 mgr.a (mgr.14355) 2917 : audit [DBG] from='client.74547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:19 smithi171 bash[25040]: cluster 2024-09-13T23:28:18.553186+0000 mgr.a (mgr.14355) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:21 smithi007 bash[22722]: cluster 2024-09-13T23:28:20.555564+0000 mgr.a (mgr.14355) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:21 smithi131 bash[24745]: cluster 2024-09-13T23:28:20.555564+0000 mgr.a (mgr.14355) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:21 smithi171 bash[25040]: cluster 2024-09-13T23:28:20.555564+0000 mgr.a (mgr.14355) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:23.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:23.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:23.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:23 smithi007 bash[22722]: cluster 2024-09-13T23:28:22.556490+0000 mgr.a (mgr.14355) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:24.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:23 smithi131 bash[24745]: cluster 2024-09-13T23:28:22.556490+0000 mgr.a (mgr.14355) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:23 smithi171 bash[25040]: cluster 2024-09-13T23:28:22.556490+0000 mgr.a (mgr.14355) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:24.468 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:24.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:25 smithi007 bash[22722]: audit 2024-09-13T23:28:24.044653+0000 mgr.a (mgr.14355) 2921 : audit [DBG] from='client.74625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:25 smithi007 bash[22722]: cluster 2024-09-13T23:28:24.557469+0000 mgr.a (mgr.14355) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:25 smithi131 bash[24745]: audit 2024-09-13T23:28:24.044653+0000 mgr.a (mgr.14355) 2921 : audit [DBG] from='client.74625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:25 smithi131 bash[24745]: cluster 2024-09-13T23:28:24.557469+0000 mgr.a (mgr.14355) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:25 smithi171 bash[25040]: audit 2024-09-13T23:28:24.044653+0000 mgr.a (mgr.14355) 2921 : audit [DBG] from='client.74625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:25 smithi171 bash[25040]: cluster 2024-09-13T23:28:24.557469+0000 mgr.a (mgr.14355) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:27 smithi007 bash[22722]: cluster 2024-09-13T23:28:26.559745+0000 mgr.a (mgr.14355) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:27 smithi131 bash[24745]: cluster 2024-09-13T23:28:26.559745+0000 mgr.a (mgr.14355) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:27 smithi171 bash[25040]: cluster 2024-09-13T23:28:26.559745+0000 mgr.a (mgr.14355) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:29 smithi007 bash[22722]: cluster 2024-09-13T23:28:28.560492+0000 mgr.a (mgr.14355) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:30.208 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:30.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:29 smithi131 bash[24745]: cluster 2024-09-13T23:28:28.560492+0000 mgr.a (mgr.14355) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:29 smithi171 bash[25040]: cluster 2024-09-13T23:28:28.560492+0000 mgr.a (mgr.14355) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:31.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:30 smithi007 bash[22722]: audit 2024-09-13T23:28:29.802994+0000 mgr.a (mgr.14355) 2925 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:30 smithi131 bash[24745]: audit 2024-09-13T23:28:29.802994+0000 mgr.a (mgr.14355) 2925 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:30 smithi171 bash[25040]: audit 2024-09-13T23:28:29.802994+0000 mgr.a (mgr.14355) 2925 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:32.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:31 smithi007 bash[22722]: cluster 2024-09-13T23:28:30.562743+0000 mgr.a (mgr.14355) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:31 smithi131 bash[24745]: cluster 2024-09-13T23:28:30.562743+0000 mgr.a (mgr.14355) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:31 smithi171 bash[25040]: cluster 2024-09-13T23:28:30.562743+0000 mgr.a (mgr.14355) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:33 smithi007 bash[22722]: cluster 2024-09-13T23:28:32.563537+0000 mgr.a (mgr.14355) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:33 smithi131 bash[24745]: cluster 2024-09-13T23:28:32.563537+0000 mgr.a (mgr.14355) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:33 smithi171 bash[25040]: cluster 2024-09-13T23:28:32.563537+0000 mgr.a (mgr.14355) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:35.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:35.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:35.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:35.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:36.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:35 smithi007 bash[22722]: cluster 2024-09-13T23:28:34.564435+0000 mgr.a (mgr.14355) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:35 smithi131 bash[24745]: cluster 2024-09-13T23:28:34.564435+0000 mgr.a (mgr.14355) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:35 smithi171 bash[25040]: cluster 2024-09-13T23:28:34.564435+0000 mgr.a (mgr.14355) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:36 smithi007 bash[22722]: audit 2024-09-13T23:28:35.544966+0000 mgr.a (mgr.14355) 2929 : audit [DBG] from='client.74778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:36 smithi131 bash[24745]: audit 2024-09-13T23:28:35.544966+0000 mgr.a (mgr.14355) 2929 : audit [DBG] from='client.74778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:36 smithi171 bash[25040]: audit 2024-09-13T23:28:35.544966+0000 mgr.a (mgr.14355) 2929 : audit [DBG] from='client.74778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:37 smithi007 bash[22722]: cluster 2024-09-13T23:28:36.567147+0000 mgr.a (mgr.14355) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:37 smithi131 bash[24745]: cluster 2024-09-13T23:28:36.567147+0000 mgr.a (mgr.14355) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:37 smithi171 bash[25040]: cluster 2024-09-13T23:28:36.567147+0000 mgr.a (mgr.14355) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:40.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:39 smithi007 bash[22722]: cluster 2024-09-13T23:28:38.567933+0000 mgr.a (mgr.14355) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:39 smithi131 bash[24745]: cluster 2024-09-13T23:28:38.567933+0000 mgr.a (mgr.14355) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:39 smithi171 bash[25040]: cluster 2024-09-13T23:28:38.567933+0000 mgr.a (mgr.14355) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:40.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:41.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:41.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:41 smithi007 bash[22722]: cluster 2024-09-13T23:28:40.569840+0000 mgr.a (mgr.14355) 2932 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:41 smithi131 bash[24745]: cluster 2024-09-13T23:28:40.569840+0000 mgr.a (mgr.14355) 2932 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:41 smithi171 bash[25040]: cluster 2024-09-13T23:28:40.569840+0000 mgr.a (mgr.14355) 2932 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:42 smithi007 bash[22722]: audit 2024-09-13T23:28:41.318098+0000 mgr.a (mgr.14355) 2933 : audit [DBG] from='client.74853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:42 smithi131 bash[24745]: audit 2024-09-13T23:28:41.318098+0000 mgr.a (mgr.14355) 2933 : audit [DBG] from='client.74853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:42 smithi171 bash[25040]: audit 2024-09-13T23:28:41.318098+0000 mgr.a (mgr.14355) 2933 : audit [DBG] from='client.74853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:43 smithi007 bash[22722]: cluster 2024-09-13T23:28:42.570739+0000 mgr.a (mgr.14355) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:43 smithi131 bash[24745]: cluster 2024-09-13T23:28:42.570739+0000 mgr.a (mgr.14355) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:43 smithi171 bash[25040]: cluster 2024-09-13T23:28:42.570739+0000 mgr.a (mgr.14355) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:28:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:45 smithi131 bash[24745]: cluster 2024-09-13T23:28:44.571508+0000 mgr.a (mgr.14355) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:45 smithi171 bash[25040]: cluster 2024-09-13T23:28:44.571508+0000 mgr.a (mgr.14355) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:45 smithi007 bash[22722]: cluster 2024-09-13T23:28:44.571508+0000 mgr.a (mgr.14355) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:28:46.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:46.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:46.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:47.465 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:47.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:47 smithi131 bash[24745]: cluster 2024-09-13T23:28:46.573753+0000 mgr.a (mgr.14355) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:47 smithi171 bash[25040]: cluster 2024-09-13T23:28:46.573753+0000 mgr.a (mgr.14355) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:47 smithi007 bash[22722]: cluster 2024-09-13T23:28:46.573753+0000 mgr.a (mgr.14355) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:48 smithi131 bash[24745]: audit 2024-09-13T23:28:47.062130+0000 mgr.a (mgr.14355) 2937 : audit [DBG] from='client.74931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:48 smithi171 bash[25040]: audit 2024-09-13T23:28:47.062130+0000 mgr.a (mgr.14355) 2937 : audit [DBG] from='client.74931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:48 smithi007 bash[22722]: audit 2024-09-13T23:28:47.062130+0000 mgr.a (mgr.14355) 2937 : audit [DBG] from='client.74931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:49 smithi131 bash[24745]: cluster 2024-09-13T23:28:48.574630+0000 mgr.a (mgr.14355) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:49 smithi171 bash[25040]: cluster 2024-09-13T23:28:48.574630+0000 mgr.a (mgr.14355) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:49 smithi007 bash[22722]: cluster 2024-09-13T23:28:48.574630+0000 mgr.a (mgr.14355) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:51 smithi131 bash[24745]: cluster 2024-09-13T23:28:50.576788+0000 mgr.a (mgr.14355) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:51 smithi171 bash[25040]: cluster 2024-09-13T23:28:50.576788+0000 mgr.a (mgr.14355) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:51 smithi007 bash[22722]: cluster 2024-09-13T23:28:50.576788+0000 mgr.a (mgr.14355) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:52.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:52.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:52.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:53.238 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:53.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:53.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:53 smithi007 bash[22722]: cluster 2024-09-13T23:28:52.577279+0000 mgr.a (mgr.14355) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:53 smithi007 bash[22722]: audit 2024-09-13T23:28:52.805055+0000 mgr.a (mgr.14355) 2941 : audit [DBG] from='client.75009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:53 smithi131 bash[24745]: cluster 2024-09-13T23:28:52.577279+0000 mgr.a (mgr.14355) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:53 smithi131 bash[24745]: audit 2024-09-13T23:28:52.805055+0000 mgr.a (mgr.14355) 2941 : audit [DBG] from='client.75009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:53 smithi171 bash[25040]: cluster 2024-09-13T23:28:52.577279+0000 mgr.a (mgr.14355) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:53 smithi171 bash[25040]: audit 2024-09-13T23:28:52.805055+0000 mgr.a (mgr.14355) 2941 : audit [DBG] from='client.75009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:55 smithi007 bash[22722]: cluster 2024-09-13T23:28:54.578129+0000 mgr.a (mgr.14355) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:55 smithi131 bash[24745]: cluster 2024-09-13T23:28:54.578129+0000 mgr.a (mgr.14355) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:55 smithi171 bash[25040]: cluster 2024-09-13T23:28:54.578129+0000 mgr.a (mgr.14355) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:28:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:57 smithi007 bash[22722]: cluster 2024-09-13T23:28:56.580412+0000 mgr.a (mgr.14355) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:57 smithi131 bash[24745]: cluster 2024-09-13T23:28:56.580412+0000 mgr.a (mgr.14355) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:57 smithi171 bash[25040]: cluster 2024-09-13T23:28:56.580412+0000 mgr.a (mgr.14355) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:28:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:28:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:28:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:28:58.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:28:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:28:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:28:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:28:58.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:28:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:59 smithi007 bash[22722]: audit 2024-09-13T23:28:58.574098+0000 mgr.a (mgr.14355) 2944 : audit [DBG] from='client.75084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:28:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:28:59 smithi007 bash[22722]: cluster 2024-09-13T23:28:58.591689+0000 mgr.a (mgr.14355) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:59 smithi131 bash[24745]: audit 2024-09-13T23:28:58.574098+0000 mgr.a (mgr.14355) 2944 : audit [DBG] from='client.75084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:28:59 smithi131 bash[24745]: cluster 2024-09-13T23:28:58.591689+0000 mgr.a (mgr.14355) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:59 smithi171 bash[25040]: audit 2024-09-13T23:28:58.574098+0000 mgr.a (mgr.14355) 2944 : audit [DBG] from='client.75084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:28:59 smithi171 bash[25040]: cluster 2024-09-13T23:28:58.591689+0000 mgr.a (mgr.14355) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:01 smithi007 bash[22722]: cluster 2024-09-13T23:29:00.594073+0000 mgr.a (mgr.14355) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:01 smithi131 bash[24745]: cluster 2024-09-13T23:29:00.594073+0000 mgr.a (mgr.14355) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:01 smithi171 bash[25040]: cluster 2024-09-13T23:29:00.594073+0000 mgr.a (mgr.14355) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:03 smithi007 bash[22722]: cluster 2024-09-13T23:29:02.594859+0000 mgr.a (mgr.14355) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:03.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:03.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:03 smithi131 bash[24745]: cluster 2024-09-13T23:29:02.594859+0000 mgr.a (mgr.14355) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:03 smithi171 bash[25040]: cluster 2024-09-13T23:29:02.594859+0000 mgr.a (mgr.14355) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:04.724 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:04.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:05 smithi007 bash[22722]: audit 2024-09-13T23:29:04.321517+0000 mgr.a (mgr.14355) 2948 : audit [DBG] from='client.75156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:05 smithi007 bash[22722]: cluster 2024-09-13T23:29:04.595333+0000 mgr.a (mgr.14355) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:05 smithi007 bash[22722]: audit 2024-09-13T23:29:05.134678+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:29:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:05 smithi131 bash[24745]: audit 2024-09-13T23:29:04.321517+0000 mgr.a (mgr.14355) 2948 : audit [DBG] from='client.75156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:05 smithi131 bash[24745]: cluster 2024-09-13T23:29:04.595333+0000 mgr.a (mgr.14355) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:05 smithi131 bash[24745]: audit 2024-09-13T23:29:05.134678+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:29:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:05 smithi171 bash[25040]: audit 2024-09-13T23:29:04.321517+0000 mgr.a (mgr.14355) 2948 : audit [DBG] from='client.75156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:05 smithi171 bash[25040]: cluster 2024-09-13T23:29:04.595333+0000 mgr.a (mgr.14355) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:05 smithi171 bash[25040]: audit 2024-09-13T23:29:05.134678+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:05.732588+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:05.737358+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:06.359214+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:06.360644+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:06.371320+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:06 smithi131 bash[24745]: audit 2024-09-13T23:29:06.374276+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:05.732588+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:05.737358+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:06.359214+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:29:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:06.360644+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:29:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:06.371320+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:06 smithi171 bash[25040]: audit 2024-09-13T23:29:06.374276+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:05.732588+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:05.737358+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:06.359214+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:06.360644+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:06.371320+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:29:07.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:06 smithi007 bash[22722]: audit 2024-09-13T23:29:06.374276+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:29:07 smithi007 bash[22972]: debug 2024-09-13T23:29:07.102+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:29:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:29:07 smithi007 bash[22972]: debug 2024-09-13T23:29:07.102+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:29:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:07 smithi131 bash[24745]: audit 2024-09-13T23:29:06.376805+0000 mgr.a (mgr.14355) 2950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:07 smithi131 bash[24745]: cluster 2024-09-13T23:29:06.602192+0000 mgr.a (mgr.14355) 2951 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:07 smithi171 bash[25040]: audit 2024-09-13T23:29:06.376805+0000 mgr.a (mgr.14355) 2950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:07 smithi171 bash[25040]: cluster 2024-09-13T23:29:06.602192+0000 mgr.a (mgr.14355) 2951 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:07 smithi007 bash[22722]: audit 2024-09-13T23:29:06.376805+0000 mgr.a (mgr.14355) 2950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:29:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:07 smithi007 bash[22722]: cluster 2024-09-13T23:29:06.602192+0000 mgr.a (mgr.14355) 2951 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:08 smithi131 bash[24745]: audit 2024-09-13T23:29:07.108955+0000 mgr.a (mgr.14355) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:29:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:08 smithi131 bash[24745]: cephadm 2024-09-13T23:29:07.110262+0000 mgr.a (mgr.14355) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:29:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:08 smithi171 bash[25040]: audit 2024-09-13T23:29:07.108955+0000 mgr.a (mgr.14355) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:29:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:08 smithi171 bash[25040]: cephadm 2024-09-13T23:29:07.110262+0000 mgr.a (mgr.14355) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:29:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:08 smithi007 bash[22722]: audit 2024-09-13T23:29:07.108955+0000 mgr.a (mgr.14355) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:29:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:08 smithi007 bash[22722]: cephadm 2024-09-13T23:29:07.110262+0000 mgr.a (mgr.14355) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:29:09.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:09.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:09.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:09 smithi131 bash[24745]: cluster 2024-09-13T23:29:08.603031+0000 mgr.a (mgr.14355) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:09 smithi171 bash[25040]: cluster 2024-09-13T23:29:08.603031+0000 mgr.a (mgr.14355) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:09 smithi007 bash[22722]: cluster 2024-09-13T23:29:08.603031+0000 mgr.a (mgr.14355) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:10.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:10.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:10.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:10.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:10.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:11 smithi131 bash[24745]: audit 2024-09-13T23:29:10.063572+0000 mgr.a (mgr.14355) 2955 : audit [DBG] from='client.75336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:11 smithi131 bash[24745]: cluster 2024-09-13T23:29:10.605067+0000 mgr.a (mgr.14355) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:11 smithi171 bash[25040]: audit 2024-09-13T23:29:10.063572+0000 mgr.a (mgr.14355) 2955 : audit [DBG] from='client.75336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:11 smithi171 bash[25040]: cluster 2024-09-13T23:29:10.605067+0000 mgr.a (mgr.14355) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:11 smithi007 bash[22722]: audit 2024-09-13T23:29:10.063572+0000 mgr.a (mgr.14355) 2955 : audit [DBG] from='client.75336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:11 smithi007 bash[22722]: cluster 2024-09-13T23:29:10.605067+0000 mgr.a (mgr.14355) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:13 smithi131 bash[24745]: cluster 2024-09-13T23:29:12.605833+0000 mgr.a (mgr.14355) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:13 smithi171 bash[25040]: cluster 2024-09-13T23:29:12.605833+0000 mgr.a (mgr.14355) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:13 smithi007 bash[22722]: cluster 2024-09-13T23:29:12.605833+0000 mgr.a (mgr.14355) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:15 smithi131 bash[24745]: cluster 2024-09-13T23:29:14.606624+0000 mgr.a (mgr.14355) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:15 smithi171 bash[25040]: cluster 2024-09-13T23:29:14.606624+0000 mgr.a (mgr.14355) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:16.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:15 smithi007 bash[22722]: cluster 2024-09-13T23:29:14.606624+0000 mgr.a (mgr.14355) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:16.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:16.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:16.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:16.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:16.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:16 smithi131 bash[24745]: audit 2024-09-13T23:29:15.843796+0000 mgr.a (mgr.14355) 2959 : audit [DBG] from='client.75414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:16 smithi171 bash[25040]: audit 2024-09-13T23:29:15.843796+0000 mgr.a (mgr.14355) 2959 : audit [DBG] from='client.75414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:16 smithi007 bash[22722]: audit 2024-09-13T23:29:15.843796+0000 mgr.a (mgr.14355) 2959 : audit [DBG] from='client.75414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:17 smithi131 bash[24745]: cluster 2024-09-13T23:29:16.609433+0000 mgr.a (mgr.14355) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:17 smithi171 bash[25040]: cluster 2024-09-13T23:29:16.609433+0000 mgr.a (mgr.14355) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:17 smithi007 bash[22722]: cluster 2024-09-13T23:29:16.609433+0000 mgr.a (mgr.14355) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:19 smithi131 bash[24745]: cluster 2024-09-13T23:29:18.610231+0000 mgr.a (mgr.14355) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:19 smithi171 bash[25040]: cluster 2024-09-13T23:29:18.610231+0000 mgr.a (mgr.14355) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:19 smithi007 bash[22722]: cluster 2024-09-13T23:29:18.610231+0000 mgr.a (mgr.14355) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:29:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:21 smithi131 bash[24745]: cluster 2024-09-13T23:29:20.612117+0000 mgr.a (mgr.14355) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:21 smithi171 bash[25040]: cluster 2024-09-13T23:29:20.612117+0000 mgr.a (mgr.14355) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:22.057 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:22.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:21 smithi007 bash[22722]: cluster 2024-09-13T23:29:20.612117+0000 mgr.a (mgr.14355) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:29:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:22 smithi171 bash[25040]: audit 2024-09-13T23:29:21.617149+0000 mgr.a (mgr.14355) 2963 : audit [DBG] from='client.75492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:22 smithi007 bash[22722]: audit 2024-09-13T23:29:21.617149+0000 mgr.a (mgr.14355) 2963 : audit [DBG] from='client.75492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:22 smithi131 bash[24745]: audit 2024-09-13T23:29:21.617149+0000 mgr.a (mgr.14355) 2963 : audit [DBG] from='client.75492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:23 smithi171 bash[25040]: cluster 2024-09-13T23:29:22.613094+0000 mgr.a (mgr.14355) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:23 smithi007 bash[22722]: cluster 2024-09-13T23:29:22.613094+0000 mgr.a (mgr.14355) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:23 smithi131 bash[24745]: cluster 2024-09-13T23:29:22.613094+0000 mgr.a (mgr.14355) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:25 smithi171 bash[25040]: cluster 2024-09-13T23:29:24.613876+0000 mgr.a (mgr.14355) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:25 smithi007 bash[22722]: cluster 2024-09-13T23:29:24.613876+0000 mgr.a (mgr.14355) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:25 smithi131 bash[24745]: cluster 2024-09-13T23:29:24.613876+0000 mgr.a (mgr.14355) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:27.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:27.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:27.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:27.829 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:27.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:27.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:27.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:27.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:27 smithi007 bash[22722]: cluster 2024-09-13T23:29:26.616143+0000 mgr.a (mgr.14355) 2966 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:27 smithi131 bash[24745]: cluster 2024-09-13T23:29:26.616143+0000 mgr.a (mgr.14355) 2966 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:27 smithi171 bash[25040]: cluster 2024-09-13T23:29:26.616143+0000 mgr.a (mgr.14355) 2966 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:28 smithi007 bash[22722]: audit 2024-09-13T23:29:27.396882+0000 mgr.a (mgr.14355) 2967 : audit [DBG] from='client.75567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:28 smithi131 bash[24745]: audit 2024-09-13T23:29:27.396882+0000 mgr.a (mgr.14355) 2967 : audit [DBG] from='client.75567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:28 smithi171 bash[25040]: audit 2024-09-13T23:29:27.396882+0000 mgr.a (mgr.14355) 2967 : audit [DBG] from='client.75567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:29 smithi007 bash[22722]: cluster 2024-09-13T23:29:28.617115+0000 mgr.a (mgr.14355) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:29 smithi131 bash[24745]: cluster 2024-09-13T23:29:28.617115+0000 mgr.a (mgr.14355) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:29 smithi171 bash[25040]: cluster 2024-09-13T23:29:28.617115+0000 mgr.a (mgr.14355) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:31 smithi007 bash[22722]: cluster 2024-09-13T23:29:30.619318+0000 mgr.a (mgr.14355) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:31 smithi131 bash[24745]: cluster 2024-09-13T23:29:30.619318+0000 mgr.a (mgr.14355) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:31 smithi171 bash[25040]: cluster 2024-09-13T23:29:30.619318+0000 mgr.a (mgr.14355) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:32.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:32.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:32.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:33.599 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:33.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:33.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:33.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:33.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:33 smithi007 bash[22722]: cluster 2024-09-13T23:29:32.620116+0000 mgr.a (mgr.14355) 2970 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:33 smithi131 bash[24745]: cluster 2024-09-13T23:29:32.620116+0000 mgr.a (mgr.14355) 2970 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:33 smithi171 bash[25040]: cluster 2024-09-13T23:29:32.620116+0000 mgr.a (mgr.14355) 2970 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:34 smithi007 bash[22722]: audit 2024-09-13T23:29:33.170625+0000 mgr.a (mgr.14355) 2971 : audit [DBG] from='client.75642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:34 smithi131 bash[24745]: audit 2024-09-13T23:29:33.170625+0000 mgr.a (mgr.14355) 2971 : audit [DBG] from='client.75642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:34 smithi171 bash[25040]: audit 2024-09-13T23:29:33.170625+0000 mgr.a (mgr.14355) 2971 : audit [DBG] from='client.75642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:35 smithi007 bash[22722]: cluster 2024-09-13T23:29:34.621071+0000 mgr.a (mgr.14355) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:35 smithi131 bash[24745]: cluster 2024-09-13T23:29:34.621071+0000 mgr.a (mgr.14355) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:35 smithi171 bash[25040]: cluster 2024-09-13T23:29:34.621071+0000 mgr.a (mgr.14355) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:37 smithi007 bash[22722]: cluster 2024-09-13T23:29:36.623293+0000 mgr.a (mgr.14355) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:37 smithi131 bash[24745]: cluster 2024-09-13T23:29:36.623293+0000 mgr.a (mgr.14355) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:37 smithi171 bash[25040]: cluster 2024-09-13T23:29:36.623293+0000 mgr.a (mgr.14355) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:38.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:38.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:38.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:39.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:39 smithi007 bash[22722]: cluster 2024-09-13T23:29:38.624073+0000 mgr.a (mgr.14355) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:39 smithi007 bash[22722]: audit 2024-09-13T23:29:38.937105+0000 mgr.a (mgr.14355) 2975 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:39 smithi131 bash[24745]: cluster 2024-09-13T23:29:38.624073+0000 mgr.a (mgr.14355) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:39 smithi131 bash[24745]: audit 2024-09-13T23:29:38.937105+0000 mgr.a (mgr.14355) 2975 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:39 smithi171 bash[25040]: cluster 2024-09-13T23:29:38.624073+0000 mgr.a (mgr.14355) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:39 smithi171 bash[25040]: audit 2024-09-13T23:29:38.937105+0000 mgr.a (mgr.14355) 2975 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:41 smithi007 bash[22722]: cluster 2024-09-13T23:29:40.626443+0000 mgr.a (mgr.14355) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:41 smithi131 bash[24745]: cluster 2024-09-13T23:29:40.626443+0000 mgr.a (mgr.14355) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:41 smithi171 bash[25040]: cluster 2024-09-13T23:29:40.626443+0000 mgr.a (mgr.14355) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:43 smithi007 bash[22722]: cluster 2024-09-13T23:29:42.627199+0000 mgr.a (mgr.14355) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:43 smithi131 bash[24745]: cluster 2024-09-13T23:29:42.627199+0000 mgr.a (mgr.14355) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:43 smithi171 bash[25040]: cluster 2024-09-13T23:29:42.627199+0000 mgr.a (mgr.14355) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:44.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:44.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:45.124 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:45 smithi007 bash[22722]: cluster 2024-09-13T23:29:44.627926+0000 mgr.a (mgr.14355) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:45 smithi007 bash[22722]: audit 2024-09-13T23:29:44.694367+0000 mgr.a (mgr.14355) 2979 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:45 smithi131 bash[24745]: cluster 2024-09-13T23:29:44.627926+0000 mgr.a (mgr.14355) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:45 smithi131 bash[24745]: audit 2024-09-13T23:29:44.694367+0000 mgr.a (mgr.14355) 2979 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:45 smithi171 bash[25040]: cluster 2024-09-13T23:29:44.627926+0000 mgr.a (mgr.14355) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:45 smithi171 bash[25040]: audit 2024-09-13T23:29:44.694367+0000 mgr.a (mgr.14355) 2979 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:47 smithi007 bash[22722]: cluster 2024-09-13T23:29:46.630405+0000 mgr.a (mgr.14355) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:47 smithi131 bash[24745]: cluster 2024-09-13T23:29:46.630405+0000 mgr.a (mgr.14355) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:47 smithi171 bash[25040]: cluster 2024-09-13T23:29:46.630405+0000 mgr.a (mgr.14355) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:29:50.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:49 smithi007 bash[22722]: cluster 2024-09-13T23:29:48.631322+0000 mgr.a (mgr.14355) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:49 smithi131 bash[24745]: cluster 2024-09-13T23:29:48.631322+0000 mgr.a (mgr.14355) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:49 smithi171 bash[25040]: cluster 2024-09-13T23:29:48.631322+0000 mgr.a (mgr.14355) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:50.889 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:51 smithi007 bash[22722]: audit 2024-09-13T23:29:50.454732+0000 mgr.a (mgr.14355) 2982 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:51 smithi007 bash[22722]: cluster 2024-09-13T23:29:50.632670+0000 mgr.a (mgr.14355) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:51 smithi131 bash[24745]: audit 2024-09-13T23:29:50.454732+0000 mgr.a (mgr.14355) 2982 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:51 smithi131 bash[24745]: cluster 2024-09-13T23:29:50.632670+0000 mgr.a (mgr.14355) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:51 smithi171 bash[25040]: audit 2024-09-13T23:29:50.454732+0000 mgr.a (mgr.14355) 2982 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:51 smithi171 bash[25040]: cluster 2024-09-13T23:29:50.632670+0000 mgr.a (mgr.14355) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:53 smithi007 bash[22722]: cluster 2024-09-13T23:29:52.633703+0000 mgr.a (mgr.14355) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:29:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:53 smithi131 bash[24745]: cluster 2024-09-13T23:29:52.633703+0000 mgr.a (mgr.14355) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:29:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:53 smithi171 bash[25040]: cluster 2024-09-13T23:29:52.633703+0000 mgr.a (mgr.14355) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:29:55.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:29:55.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:29:55.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:29:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:55 smithi007 bash[22722]: cluster 2024-09-13T23:29:54.634682+0000 mgr.a (mgr.14355) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:29:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:55 smithi131 bash[24745]: cluster 2024-09-13T23:29:54.634682+0000 mgr.a (mgr.14355) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:29:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:55 smithi171 bash[25040]: cluster 2024-09-13T23:29:54.634682+0000 mgr.a (mgr.14355) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:29:56.641 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:29:56.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:29:56.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:29:56.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:29:56.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:29:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:57 smithi007 bash[22722]: audit 2024-09-13T23:29:56.219684+0000 mgr.a (mgr.14355) 2986 : audit [DBG] from='client.75948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:57 smithi007 bash[22722]: cluster 2024-09-13T23:29:56.635894+0000 mgr.a (mgr.14355) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:57 smithi131 bash[24745]: audit 2024-09-13T23:29:56.219684+0000 mgr.a (mgr.14355) 2986 : audit [DBG] from='client.75948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:57 smithi131 bash[24745]: cluster 2024-09-13T23:29:56.635894+0000 mgr.a (mgr.14355) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:29:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:57 smithi171 bash[25040]: audit 2024-09-13T23:29:56.219684+0000 mgr.a (mgr.14355) 2986 : audit [DBG] from='client.75948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:29:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:57 smithi171 bash[25040]: cluster 2024-09-13T23:29:56.635894+0000 mgr.a (mgr.14355) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:29:59 smithi007 bash[22722]: cluster 2024-09-13T23:29:58.636763+0000 mgr.a (mgr.14355) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:29:59 smithi131 bash[24745]: cluster 2024-09-13T23:29:58.636763+0000 mgr.a (mgr.14355) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:29:59 smithi171 bash[25040]: cluster 2024-09-13T23:29:58.636763+0000 mgr.a (mgr.14355) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:00 smithi007 bash[22722]: cluster 2024-09-13T23:30:00.000153+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:30:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:00 smithi131 bash[24745]: cluster 2024-09-13T23:30:00.000153+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:30:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:00 smithi171 bash[25040]: cluster 2024-09-13T23:30:00.000153+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:30:01.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:01.644 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:02.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:01 smithi007 bash[22722]: cluster 2024-09-13T23:30:00.638858+0000 mgr.a (mgr.14355) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:01 smithi131 bash[24745]: cluster 2024-09-13T23:30:00.638858+0000 mgr.a (mgr.14355) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:01 smithi171 bash[25040]: cluster 2024-09-13T23:30:00.638858+0000 mgr.a (mgr.14355) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:02.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:02 smithi007 bash[22722]: audit 2024-09-13T23:30:01.975224+0000 mgr.a (mgr.14355) 2990 : audit [DBG] from='client.76020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:02 smithi131 bash[24745]: audit 2024-09-13T23:30:01.975224+0000 mgr.a (mgr.14355) 2990 : audit [DBG] from='client.76020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:02 smithi171 bash[25040]: audit 2024-09-13T23:30:01.975224+0000 mgr.a (mgr.14355) 2990 : audit [DBG] from='client.76020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:03 smithi007 bash[22722]: cluster 2024-09-13T23:30:02.639834+0000 mgr.a (mgr.14355) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:03 smithi131 bash[24745]: cluster 2024-09-13T23:30:02.639834+0000 mgr.a (mgr.14355) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:03 smithi171 bash[25040]: cluster 2024-09-13T23:30:02.639834+0000 mgr.a (mgr.14355) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:05 smithi007 bash[22722]: cluster 2024-09-13T23:30:04.640637+0000 mgr.a (mgr.14355) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:05 smithi131 bash[24745]: cluster 2024-09-13T23:30:04.640637+0000 mgr.a (mgr.14355) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:05 smithi171 bash[25040]: cluster 2024-09-13T23:30:04.640637+0000 mgr.a (mgr.14355) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:07.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:08.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:08.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:08.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:08.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:08.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: cluster 2024-09-13T23:30:06.642942+0000 mgr.a (mgr.14355) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: audit 2024-09-13T23:30:07.159197+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: audit 2024-09-13T23:30:07.764424+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: audit 2024-09-13T23:30:07.768330+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: audit 2024-09-13T23:30:07.783370+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:07 smithi007 bash[22722]: audit 2024-09-13T23:30:07.787503+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: cluster 2024-09-13T23:30:06.642942+0000 mgr.a (mgr.14355) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: audit 2024-09-13T23:30:07.159197+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: audit 2024-09-13T23:30:07.764424+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: audit 2024-09-13T23:30:07.768330+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: audit 2024-09-13T23:30:07.783370+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:07 smithi131 bash[24745]: audit 2024-09-13T23:30:07.787503+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: cluster 2024-09-13T23:30:06.642942+0000 mgr.a (mgr.14355) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: audit 2024-09-13T23:30:07.159197+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:30:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: audit 2024-09-13T23:30:07.764424+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: audit 2024-09-13T23:30:07.768330+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: audit 2024-09-13T23:30:07.783370+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:07 smithi171 bash[25040]: audit 2024-09-13T23:30:07.787503+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:09.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:08 smithi007 bash[22722]: audit 2024-09-13T23:30:07.714199+0000 mgr.a (mgr.14355) 2994 : audit [DBG] from='client.76095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:09.156 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:08 smithi007 bash[22722]: audit 2024-09-13T23:30:08.428956+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:30:09.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:08 smithi007 bash[22722]: audit 2024-09-13T23:30:08.430858+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:30:09.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:08 smithi007 bash[22722]: audit 2024-09-13T23:30:08.439173+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:09.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:08 smithi007 bash[22722]: audit 2024-09-13T23:30:08.443881+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:08 smithi131 bash[24745]: audit 2024-09-13T23:30:07.714199+0000 mgr.a (mgr.14355) 2994 : audit [DBG] from='client.76095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:08 smithi131 bash[24745]: audit 2024-09-13T23:30:08.428956+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:08 smithi131 bash[24745]: audit 2024-09-13T23:30:08.430858+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:08 smithi131 bash[24745]: audit 2024-09-13T23:30:08.439173+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:08 smithi131 bash[24745]: audit 2024-09-13T23:30:08.443881+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:08 smithi171 bash[25040]: audit 2024-09-13T23:30:07.714199+0000 mgr.a (mgr.14355) 2994 : audit [DBG] from='client.76095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:08 smithi171 bash[25040]: audit 2024-09-13T23:30:08.428956+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:08 smithi171 bash[25040]: audit 2024-09-13T23:30:08.430858+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:08 smithi171 bash[25040]: audit 2024-09-13T23:30:08.439173+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:30:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:08 smithi171 bash[25040]: audit 2024-09-13T23:30:08.443881+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:09.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:30:09 smithi007 bash[22972]: debug 2024-09-13T23:30:09.153+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:30:09.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:30:09 smithi007 bash[22972]: debug 2024-09-13T23:30:09.153+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:30:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:09 smithi007 bash[22722]: audit 2024-09-13T23:30:08.446578+0000 mgr.a (mgr.14355) 2995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:09 smithi007 bash[22722]: cluster 2024-09-13T23:30:08.643426+0000 mgr.a (mgr.14355) 2996 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:09 smithi131 bash[24745]: audit 2024-09-13T23:30:08.446578+0000 mgr.a (mgr.14355) 2995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:09 smithi131 bash[24745]: cluster 2024-09-13T23:30:08.643426+0000 mgr.a (mgr.14355) 2996 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:09 smithi171 bash[25040]: audit 2024-09-13T23:30:08.446578+0000 mgr.a (mgr.14355) 2995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:30:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:09 smithi171 bash[25040]: cluster 2024-09-13T23:30:08.643426+0000 mgr.a (mgr.14355) 2996 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:10 smithi007 bash[22722]: audit 2024-09-13T23:30:09.156562+0000 mgr.a (mgr.14355) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:30:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:10 smithi007 bash[22722]: cephadm 2024-09-13T23:30:09.157820+0000 mgr.a (mgr.14355) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:30:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:10 smithi131 bash[24745]: audit 2024-09-13T23:30:09.156562+0000 mgr.a (mgr.14355) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:30:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:10 smithi131 bash[24745]: cephadm 2024-09-13T23:30:09.157820+0000 mgr.a (mgr.14355) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:30:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:10 smithi171 bash[25040]: audit 2024-09-13T23:30:09.156562+0000 mgr.a (mgr.14355) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:30:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:10 smithi171 bash[25040]: cephadm 2024-09-13T23:30:09.157820+0000 mgr.a (mgr.14355) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:30:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:11 smithi007 bash[22722]: cluster 2024-09-13T23:30:10.645665+0000 mgr.a (mgr.14355) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:11 smithi131 bash[24745]: cluster 2024-09-13T23:30:10.645665+0000 mgr.a (mgr.14355) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:11 smithi171 bash[25040]: cluster 2024-09-13T23:30:10.645665+0000 mgr.a (mgr.14355) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:13.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:13.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:13.929 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:13.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:13 smithi007 bash[22722]: cluster 2024-09-13T23:30:12.646469+0000 mgr.a (mgr.14355) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:13 smithi131 bash[24745]: cluster 2024-09-13T23:30:12.646469+0000 mgr.a (mgr.14355) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:13 smithi171 bash[25040]: cluster 2024-09-13T23:30:12.646469+0000 mgr.a (mgr.14355) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:14 smithi007 bash[22722]: audit 2024-09-13T23:30:13.485714+0000 mgr.a (mgr.14355) 3001 : audit [DBG] from='client.76275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:14 smithi131 bash[24745]: audit 2024-09-13T23:30:13.485714+0000 mgr.a (mgr.14355) 3001 : audit [DBG] from='client.76275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:14 smithi171 bash[25040]: audit 2024-09-13T23:30:13.485714+0000 mgr.a (mgr.14355) 3001 : audit [DBG] from='client.76275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:15 smithi007 bash[22722]: cluster 2024-09-13T23:30:14.647365+0000 mgr.a (mgr.14355) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:15 smithi131 bash[24745]: cluster 2024-09-13T23:30:14.647365+0000 mgr.a (mgr.14355) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:15 smithi171 bash[25040]: cluster 2024-09-13T23:30:14.647365+0000 mgr.a (mgr.14355) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:17 smithi007 bash[22722]: cluster 2024-09-13T23:30:16.649690+0000 mgr.a (mgr.14355) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:17 smithi131 bash[24745]: cluster 2024-09-13T23:30:16.649690+0000 mgr.a (mgr.14355) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:17 smithi171 bash[25040]: cluster 2024-09-13T23:30:16.649690+0000 mgr.a (mgr.14355) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:18.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:18.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:19.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:19 smithi007 bash[22722]: cluster 2024-09-13T23:30:18.650506+0000 mgr.a (mgr.14355) 3004 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:19 smithi131 bash[24745]: cluster 2024-09-13T23:30:18.650506+0000 mgr.a (mgr.14355) 3004 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:19 smithi171 bash[25040]: cluster 2024-09-13T23:30:18.650506+0000 mgr.a (mgr.14355) 3004 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:20 smithi007 bash[22722]: audit 2024-09-13T23:30:19.272410+0000 mgr.a (mgr.14355) 3005 : audit [DBG] from='client.76350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:20 smithi131 bash[24745]: audit 2024-09-13T23:30:19.272410+0000 mgr.a (mgr.14355) 3005 : audit [DBG] from='client.76350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:20 smithi171 bash[25040]: audit 2024-09-13T23:30:19.272410+0000 mgr.a (mgr.14355) 3005 : audit [DBG] from='client.76350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:21 smithi007 bash[22722]: cluster 2024-09-13T23:30:20.652772+0000 mgr.a (mgr.14355) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:21 smithi131 bash[24745]: cluster 2024-09-13T23:30:20.652772+0000 mgr.a (mgr.14355) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:21 smithi171 bash[25040]: cluster 2024-09-13T23:30:20.652772+0000 mgr.a (mgr.14355) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:30:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:23 smithi131 bash[24745]: cluster 2024-09-13T23:30:22.653555+0000 mgr.a (mgr.14355) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:23 smithi171 bash[25040]: cluster 2024-09-13T23:30:22.653555+0000 mgr.a (mgr.14355) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:23 smithi007 bash[22722]: cluster 2024-09-13T23:30:22.653555+0000 mgr.a (mgr.14355) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:25.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:25.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:25.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:25.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:25 smithi131 bash[24745]: cluster 2024-09-13T23:30:24.654325+0000 mgr.a (mgr.14355) 3008 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:25 smithi171 bash[25040]: cluster 2024-09-13T23:30:24.654325+0000 mgr.a (mgr.14355) 3008 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:25 smithi007 bash[22722]: cluster 2024-09-13T23:30:24.654325+0000 mgr.a (mgr.14355) 3008 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:26 smithi131 bash[24745]: audit 2024-09-13T23:30:25.047258+0000 mgr.a (mgr.14355) 3009 : audit [DBG] from='client.76422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:26 smithi171 bash[25040]: audit 2024-09-13T23:30:25.047258+0000 mgr.a (mgr.14355) 3009 : audit [DBG] from='client.76422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:26 smithi007 bash[22722]: audit 2024-09-13T23:30:25.047258+0000 mgr.a (mgr.14355) 3009 : audit [DBG] from='client.76422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:27 smithi131 bash[24745]: cluster 2024-09-13T23:30:26.657187+0000 mgr.a (mgr.14355) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:27 smithi171 bash[25040]: cluster 2024-09-13T23:30:26.657187+0000 mgr.a (mgr.14355) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:27 smithi007 bash[22722]: cluster 2024-09-13T23:30:26.657187+0000 mgr.a (mgr.14355) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:29 smithi131 bash[24745]: cluster 2024-09-13T23:30:28.658152+0000 mgr.a (mgr.14355) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:29 smithi171 bash[25040]: cluster 2024-09-13T23:30:28.658152+0000 mgr.a (mgr.14355) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:29 smithi007 bash[22722]: cluster 2024-09-13T23:30:28.658152+0000 mgr.a (mgr.14355) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:30.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:30.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:31.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:31 smithi131 bash[24745]: cluster 2024-09-13T23:30:30.659490+0000 mgr.a (mgr.14355) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:31 smithi131 bash[24745]: audit 2024-09-13T23:30:30.816655+0000 mgr.a (mgr.14355) 3013 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:31 smithi171 bash[25040]: cluster 2024-09-13T23:30:30.659490+0000 mgr.a (mgr.14355) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:31 smithi171 bash[25040]: audit 2024-09-13T23:30:30.816655+0000 mgr.a (mgr.14355) 3013 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:31 smithi007 bash[22722]: cluster 2024-09-13T23:30:30.659490+0000 mgr.a (mgr.14355) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:31 smithi007 bash[22722]: audit 2024-09-13T23:30:30.816655+0000 mgr.a (mgr.14355) 3013 : audit [DBG] from='client.76497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:33 smithi131 bash[24745]: cluster 2024-09-13T23:30:32.660372+0000 mgr.a (mgr.14355) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:33 smithi171 bash[25040]: cluster 2024-09-13T23:30:32.660372+0000 mgr.a (mgr.14355) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:33 smithi007 bash[22722]: cluster 2024-09-13T23:30:32.660372+0000 mgr.a (mgr.14355) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:30:36.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:36.259 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:36.259 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:35 smithi131 bash[24745]: cluster 2024-09-13T23:30:34.661143+0000 mgr.a (mgr.14355) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:35 smithi171 bash[25040]: cluster 2024-09-13T23:30:34.661143+0000 mgr.a (mgr.14355) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:35 smithi007 bash[22722]: cluster 2024-09-13T23:30:34.661143+0000 mgr.a (mgr.14355) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:30:37.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:37.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:37 smithi131 bash[24745]: audit 2024-09-13T23:30:36.595797+0000 mgr.a (mgr.14355) 3016 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:37 smithi131 bash[24745]: cluster 2024-09-13T23:30:36.662533+0000 mgr.a (mgr.14355) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:37 smithi171 bash[25040]: audit 2024-09-13T23:30:36.595797+0000 mgr.a (mgr.14355) 3016 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:37 smithi171 bash[25040]: cluster 2024-09-13T23:30:36.662533+0000 mgr.a (mgr.14355) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:37 smithi007 bash[22722]: audit 2024-09-13T23:30:36.595797+0000 mgr.a (mgr.14355) 3016 : audit [DBG] from='client.76575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:37 smithi007 bash[22722]: cluster 2024-09-13T23:30:36.662533+0000 mgr.a (mgr.14355) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:39 smithi131 bash[24745]: cluster 2024-09-13T23:30:38.663373+0000 mgr.a (mgr.14355) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:39 smithi171 bash[25040]: cluster 2024-09-13T23:30:38.663373+0000 mgr.a (mgr.14355) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:39 smithi007 bash[22722]: cluster 2024-09-13T23:30:38.663373+0000 mgr.a (mgr.14355) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:42.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:42.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:42 smithi131 bash[24745]: cluster 2024-09-13T23:30:40.665557+0000 mgr.a (mgr.14355) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:42 smithi171 bash[25040]: cluster 2024-09-13T23:30:40.665557+0000 mgr.a (mgr.14355) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:41 smithi007 bash[22722]: cluster 2024-09-13T23:30:40.665557+0000 mgr.a (mgr.14355) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:42.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:43 smithi007 bash[22722]: audit 2024-09-13T23:30:42.370189+0000 mgr.a (mgr.14355) 3020 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:43 smithi007 bash[22722]: cluster 2024-09-13T23:30:42.666084+0000 mgr.a (mgr.14355) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:43 smithi131 bash[24745]: audit 2024-09-13T23:30:42.370189+0000 mgr.a (mgr.14355) 3020 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:43 smithi131 bash[24745]: cluster 2024-09-13T23:30:42.666084+0000 mgr.a (mgr.14355) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:43 smithi171 bash[25040]: audit 2024-09-13T23:30:42.370189+0000 mgr.a (mgr.14355) 3020 : audit [DBG] from='client.76653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:43 smithi171 bash[25040]: cluster 2024-09-13T23:30:42.666084+0000 mgr.a (mgr.14355) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:45 smithi131 bash[24745]: cluster 2024-09-13T23:30:44.666981+0000 mgr.a (mgr.14355) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:45 smithi171 bash[25040]: cluster 2024-09-13T23:30:44.666981+0000 mgr.a (mgr.14355) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:45 smithi007 bash[22722]: cluster 2024-09-13T23:30:44.666981+0000 mgr.a (mgr.14355) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:47.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:47.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:47.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:47 smithi131 bash[24745]: cluster 2024-09-13T23:30:46.669291+0000 mgr.a (mgr.14355) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:47 smithi171 bash[25040]: cluster 2024-09-13T23:30:46.669291+0000 mgr.a (mgr.14355) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:48.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:47 smithi007 bash[22722]: cluster 2024-09-13T23:30:46.669291+0000 mgr.a (mgr.14355) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:48.526 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:48.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:48.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:48.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:48.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:49 smithi131 bash[24745]: audit 2024-09-13T23:30:48.109723+0000 mgr.a (mgr.14355) 3024 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:49 smithi131 bash[24745]: cluster 2024-09-13T23:30:48.670190+0000 mgr.a (mgr.14355) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:49 smithi171 bash[25040]: audit 2024-09-13T23:30:48.109723+0000 mgr.a (mgr.14355) 3024 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:49 smithi171 bash[25040]: cluster 2024-09-13T23:30:48.670190+0000 mgr.a (mgr.14355) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:49 smithi007 bash[22722]: audit 2024-09-13T23:30:48.109723+0000 mgr.a (mgr.14355) 3024 : audit [DBG] from='client.76731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:49 smithi007 bash[22722]: cluster 2024-09-13T23:30:48.670190+0000 mgr.a (mgr.14355) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:51 smithi131 bash[24745]: cluster 2024-09-13T23:30:50.672530+0000 mgr.a (mgr.14355) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:51 smithi171 bash[25040]: cluster 2024-09-13T23:30:50.672530+0000 mgr.a (mgr.14355) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:51 smithi007 bash[22722]: cluster 2024-09-13T23:30:50.672530+0000 mgr.a (mgr.14355) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:53.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:30:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:53 smithi131 bash[24745]: cluster 2024-09-13T23:30:52.673356+0000 mgr.a (mgr.14355) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:53 smithi171 bash[25040]: cluster 2024-09-13T23:30:52.673356+0000 mgr.a (mgr.14355) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:53 smithi007 bash[22722]: cluster 2024-09-13T23:30:52.673356+0000 mgr.a (mgr.14355) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:30:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:30:54.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:30:54.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:30:54.276 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:30:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:54 smithi131 bash[24745]: audit 2024-09-13T23:30:53.856808+0000 mgr.a (mgr.14355) 3028 : audit [DBG] from='client.76806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:54 smithi171 bash[25040]: audit 2024-09-13T23:30:53.856808+0000 mgr.a (mgr.14355) 3028 : audit [DBG] from='client.76806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:54 smithi007 bash[22722]: audit 2024-09-13T23:30:53.856808+0000 mgr.a (mgr.14355) 3028 : audit [DBG] from='client.76806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:30:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:55 smithi131 bash[24745]: cluster 2024-09-13T23:30:54.674390+0000 mgr.a (mgr.14355) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:55 smithi171 bash[25040]: cluster 2024-09-13T23:30:54.674390+0000 mgr.a (mgr.14355) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:55 smithi007 bash[22722]: cluster 2024-09-13T23:30:54.674390+0000 mgr.a (mgr.14355) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:30:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:57 smithi131 bash[24745]: cluster 2024-09-13T23:30:56.676697+0000 mgr.a (mgr.14355) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:57 smithi171 bash[25040]: cluster 2024-09-13T23:30:56.676697+0000 mgr.a (mgr.14355) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:57 smithi007 bash[22722]: cluster 2024-09-13T23:30:56.676697+0000 mgr.a (mgr.14355) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:30:59.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:30:59.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:30:59.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:30:59 smithi131 bash[24745]: cluster 2024-09-13T23:30:58.677474+0000 mgr.a (mgr.14355) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:30:59 smithi171 bash[25040]: cluster 2024-09-13T23:30:58.677474+0000 mgr.a (mgr.14355) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:00.061 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:00.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:30:59 smithi007 bash[22722]: cluster 2024-09-13T23:30:58.677474+0000 mgr.a (mgr.14355) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:00 smithi131 bash[24745]: audit 2024-09-13T23:30:59.613029+0000 mgr.a (mgr.14355) 3032 : audit [DBG] from='client.76881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:00 smithi171 bash[25040]: audit 2024-09-13T23:30:59.613029+0000 mgr.a (mgr.14355) 3032 : audit [DBG] from='client.76881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:00 smithi007 bash[22722]: audit 2024-09-13T23:30:59.613029+0000 mgr.a (mgr.14355) 3032 : audit [DBG] from='client.76881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:01 smithi131 bash[24745]: cluster 2024-09-13T23:31:00.679882+0000 mgr.a (mgr.14355) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:01 smithi171 bash[25040]: cluster 2024-09-13T23:31:00.679882+0000 mgr.a (mgr.14355) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:01 smithi007 bash[22722]: cluster 2024-09-13T23:31:00.679882+0000 mgr.a (mgr.14355) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:03 smithi131 bash[24745]: cluster 2024-09-13T23:31:02.680670+0000 mgr.a (mgr.14355) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:03 smithi171 bash[25040]: cluster 2024-09-13T23:31:02.680670+0000 mgr.a (mgr.14355) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:03 smithi007 bash[22722]: cluster 2024-09-13T23:31:02.680670+0000 mgr.a (mgr.14355) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:05.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:05.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:05.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:05.794 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:05 smithi131 bash[24745]: cluster 2024-09-13T23:31:04.681447+0000 mgr.a (mgr.14355) 3035 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:05 smithi171 bash[25040]: cluster 2024-09-13T23:31:04.681447+0000 mgr.a (mgr.14355) 3035 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:05 smithi007 bash[22722]: cluster 2024-09-13T23:31:04.681447+0000 mgr.a (mgr.14355) 3035 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:06 smithi171 bash[25040]: audit 2024-09-13T23:31:05.392717+0000 mgr.a (mgr.14355) 3036 : audit [DBG] from='client.76959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:06 smithi007 bash[22722]: audit 2024-09-13T23:31:05.392717+0000 mgr.a (mgr.14355) 3036 : audit [DBG] from='client.76959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:06 smithi131 bash[24745]: audit 2024-09-13T23:31:05.392717+0000 mgr.a (mgr.14355) 3036 : audit [DBG] from='client.76959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:07 smithi171 bash[25040]: cluster 2024-09-13T23:31:06.684221+0000 mgr.a (mgr.14355) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:07 smithi007 bash[22722]: cluster 2024-09-13T23:31:06.684221+0000 mgr.a (mgr.14355) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:07 smithi131 bash[24745]: cluster 2024-09-13T23:31:06.684221+0000 mgr.a (mgr.14355) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:09 smithi171 bash[25040]: cluster 2024-09-13T23:31:08.685006+0000 mgr.a (mgr.14355) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:09 smithi171 bash[25040]: audit 2024-09-13T23:31:09.208458+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:31:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:09 smithi007 bash[22722]: cluster 2024-09-13T23:31:08.685006+0000 mgr.a (mgr.14355) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:09 smithi007 bash[22722]: audit 2024-09-13T23:31:09.208458+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:31:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:09 smithi131 bash[24745]: cluster 2024-09-13T23:31:08.685006+0000 mgr.a (mgr.14355) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:09 smithi131 bash[24745]: audit 2024-09-13T23:31:09.208458+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:31:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22972]: debug 2024-09-13T23:31:10.780+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22972]: debug 2024-09-13T23:31:10.780+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22722]: audit 2024-09-13T23:31:10.042610+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22722]: audit 2024-09-13T23:31:10.044290+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22722]: audit 2024-09-13T23:31:10.054480+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:31:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:10 smithi007 bash[22722]: audit 2024-09-13T23:31:10.059129+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:10 smithi131 bash[24745]: audit 2024-09-13T23:31:10.042610+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:31:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:10 smithi131 bash[24745]: audit 2024-09-13T23:31:10.044290+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:31:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:10 smithi131 bash[24745]: audit 2024-09-13T23:31:10.054480+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:31:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:10 smithi131 bash[24745]: audit 2024-09-13T23:31:10.059129+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:10 smithi171 bash[25040]: audit 2024-09-13T23:31:10.042610+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:31:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:10 smithi171 bash[25040]: audit 2024-09-13T23:31:10.044290+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:31:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:10 smithi171 bash[25040]: audit 2024-09-13T23:31:10.054480+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:31:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:10 smithi171 bash[25040]: audit 2024-09-13T23:31:10.059129+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:11.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:11.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:11 smithi007 bash[22722]: audit 2024-09-13T23:31:10.061523+0000 mgr.a (mgr.14355) 3039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:11 smithi007 bash[22722]: cluster 2024-09-13T23:31:10.686250+0000 mgr.a (mgr.14355) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:11 smithi007 bash[22722]: audit 2024-09-13T23:31:10.783599+0000 mgr.a (mgr.14355) 3041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:31:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:11 smithi007 bash[22722]: cephadm 2024-09-13T23:31:10.784947+0000 mgr.a (mgr.14355) 3042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:11 smithi131 bash[24745]: audit 2024-09-13T23:31:10.061523+0000 mgr.a (mgr.14355) 3039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:11 smithi131 bash[24745]: cluster 2024-09-13T23:31:10.686250+0000 mgr.a (mgr.14355) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:11 smithi131 bash[24745]: audit 2024-09-13T23:31:10.783599+0000 mgr.a (mgr.14355) 3041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:11 smithi131 bash[24745]: cephadm 2024-09-13T23:31:10.784947+0000 mgr.a (mgr.14355) 3042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:11 smithi171 bash[25040]: audit 2024-09-13T23:31:10.061523+0000 mgr.a (mgr.14355) 3039 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:11 smithi171 bash[25040]: cluster 2024-09-13T23:31:10.686250+0000 mgr.a (mgr.14355) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:11 smithi171 bash[25040]: audit 2024-09-13T23:31:10.783599+0000 mgr.a (mgr.14355) 3041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:11 smithi171 bash[25040]: cephadm 2024-09-13T23:31:10.784947+0000 mgr.a (mgr.14355) 3042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:31:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:12 smithi007 bash[22722]: audit 2024-09-13T23:31:11.110146+0000 mgr.a (mgr.14355) 3043 : audit [DBG] from='client.77142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:12 smithi131 bash[24745]: audit 2024-09-13T23:31:11.110146+0000 mgr.a (mgr.14355) 3043 : audit [DBG] from='client.77142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:12 smithi171 bash[25040]: audit 2024-09-13T23:31:11.110146+0000 mgr.a (mgr.14355) 3043 : audit [DBG] from='client.77142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:13 smithi007 bash[22722]: cluster 2024-09-13T23:31:12.687146+0000 mgr.a (mgr.14355) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:13 smithi131 bash[24745]: cluster 2024-09-13T23:31:12.687146+0000 mgr.a (mgr.14355) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:13 smithi171 bash[25040]: cluster 2024-09-13T23:31:12.687146+0000 mgr.a (mgr.14355) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:15 smithi007 bash[22722]: cluster 2024-09-13T23:31:14.687933+0000 mgr.a (mgr.14355) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:15 smithi131 bash[24745]: cluster 2024-09-13T23:31:14.687933+0000 mgr.a (mgr.14355) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:15 smithi171 bash[25040]: cluster 2024-09-13T23:31:14.687933+0000 mgr.a (mgr.14355) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:16.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:16.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:17.292 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:17 smithi007 bash[22722]: cluster 2024-09-13T23:31:16.689319+0000 mgr.a (mgr.14355) 3046 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:17 smithi007 bash[22722]: audit 2024-09-13T23:31:16.854607+0000 mgr.a (mgr.14355) 3047 : audit [DBG] from='client.77217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:17 smithi131 bash[24745]: cluster 2024-09-13T23:31:16.689319+0000 mgr.a (mgr.14355) 3046 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:17 smithi131 bash[24745]: audit 2024-09-13T23:31:16.854607+0000 mgr.a (mgr.14355) 3047 : audit [DBG] from='client.77217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:17 smithi171 bash[25040]: cluster 2024-09-13T23:31:16.689319+0000 mgr.a (mgr.14355) 3046 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:17 smithi171 bash[25040]: audit 2024-09-13T23:31:16.854607+0000 mgr.a (mgr.14355) 3047 : audit [DBG] from='client.77217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:19 smithi007 bash[22722]: cluster 2024-09-13T23:31:18.690204+0000 mgr.a (mgr.14355) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:19 smithi131 bash[24745]: cluster 2024-09-13T23:31:18.690204+0000 mgr.a (mgr.14355) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:19 smithi171 bash[25040]: cluster 2024-09-13T23:31:18.690204+0000 mgr.a (mgr.14355) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:21 smithi007 bash[22722]: cluster 2024-09-13T23:31:20.692332+0000 mgr.a (mgr.14355) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:21 smithi131 bash[24745]: cluster 2024-09-13T23:31:20.692332+0000 mgr.a (mgr.14355) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:22.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:22.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:21 smithi171 bash[25040]: cluster 2024-09-13T23:31:20.692332+0000 mgr.a (mgr.14355) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:23.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:23.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:23.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:23.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:23.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:23 smithi007 bash[22722]: audit 2024-09-13T23:31:22.627480+0000 mgr.a (mgr.14355) 3050 : audit [DBG] from='client.77295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:23 smithi007 bash[22722]: cluster 2024-09-13T23:31:22.692828+0000 mgr.a (mgr.14355) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:23 smithi131 bash[24745]: audit 2024-09-13T23:31:22.627480+0000 mgr.a (mgr.14355) 3050 : audit [DBG] from='client.77295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:23 smithi131 bash[24745]: cluster 2024-09-13T23:31:22.692828+0000 mgr.a (mgr.14355) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:23 smithi171 bash[25040]: audit 2024-09-13T23:31:22.627480+0000 mgr.a (mgr.14355) 3050 : audit [DBG] from='client.77295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:23 smithi171 bash[25040]: cluster 2024-09-13T23:31:22.692828+0000 mgr.a (mgr.14355) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:25 smithi007 bash[22722]: cluster 2024-09-13T23:31:24.693652+0000 mgr.a (mgr.14355) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:25 smithi131 bash[24745]: cluster 2024-09-13T23:31:24.693652+0000 mgr.a (mgr.14355) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:25 smithi171 bash[25040]: cluster 2024-09-13T23:31:24.693652+0000 mgr.a (mgr.14355) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:31:28.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:28.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:28.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:27 smithi007 bash[22722]: cluster 2024-09-13T23:31:26.695931+0000 mgr.a (mgr.14355) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:27 smithi131 bash[24745]: cluster 2024-09-13T23:31:26.695931+0000 mgr.a (mgr.14355) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:27 smithi171 bash[25040]: cluster 2024-09-13T23:31:26.695931+0000 mgr.a (mgr.14355) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:31:28.834 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:28.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:29 smithi007 bash[22722]: audit 2024-09-13T23:31:28.393323+0000 mgr.a (mgr.14355) 3054 : audit [DBG] from='client.77370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:29 smithi007 bash[22722]: cluster 2024-09-13T23:31:28.696461+0000 mgr.a (mgr.14355) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:29 smithi131 bash[24745]: audit 2024-09-13T23:31:28.393323+0000 mgr.a (mgr.14355) 3054 : audit [DBG] from='client.77370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:29 smithi131 bash[24745]: cluster 2024-09-13T23:31:28.696461+0000 mgr.a (mgr.14355) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:29 smithi171 bash[25040]: audit 2024-09-13T23:31:28.393323+0000 mgr.a (mgr.14355) 3054 : audit [DBG] from='client.77370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:29 smithi171 bash[25040]: cluster 2024-09-13T23:31:28.696461+0000 mgr.a (mgr.14355) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:31 smithi007 bash[22722]: cluster 2024-09-13T23:31:30.698711+0000 mgr.a (mgr.14355) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:31 smithi131 bash[24745]: cluster 2024-09-13T23:31:30.698711+0000 mgr.a (mgr.14355) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:31 smithi171 bash[25040]: cluster 2024-09-13T23:31:30.698711+0000 mgr.a (mgr.14355) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:33 smithi007 bash[22722]: cluster 2024-09-13T23:31:32.699465+0000 mgr.a (mgr.14355) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:33 smithi131 bash[24745]: cluster 2024-09-13T23:31:32.699465+0000 mgr.a (mgr.14355) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:33 smithi171 bash[25040]: cluster 2024-09-13T23:31:32.699465+0000 mgr.a (mgr.14355) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:34.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:34.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:34.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:34.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:35 smithi007 bash[22722]: audit 2024-09-13T23:31:34.175438+0000 mgr.a (mgr.14355) 3058 : audit [DBG] from='client.77445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:35 smithi007 bash[22722]: cluster 2024-09-13T23:31:34.700373+0000 mgr.a (mgr.14355) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:35 smithi131 bash[24745]: audit 2024-09-13T23:31:34.175438+0000 mgr.a (mgr.14355) 3058 : audit [DBG] from='client.77445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:35 smithi131 bash[24745]: cluster 2024-09-13T23:31:34.700373+0000 mgr.a (mgr.14355) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:35 smithi171 bash[25040]: audit 2024-09-13T23:31:34.175438+0000 mgr.a (mgr.14355) 3058 : audit [DBG] from='client.77445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:35 smithi171 bash[25040]: cluster 2024-09-13T23:31:34.700373+0000 mgr.a (mgr.14355) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:37 smithi007 bash[22722]: cluster 2024-09-13T23:31:36.702605+0000 mgr.a (mgr.14355) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:37 smithi131 bash[24745]: cluster 2024-09-13T23:31:36.702605+0000 mgr.a (mgr.14355) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:37 smithi171 bash[25040]: cluster 2024-09-13T23:31:36.702605+0000 mgr.a (mgr.14355) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:31:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:39 smithi007 bash[22722]: cluster 2024-09-13T23:31:38.703367+0000 mgr.a (mgr.14355) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:39 smithi131 bash[24745]: cluster 2024-09-13T23:31:38.703367+0000 mgr.a (mgr.14355) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:39 smithi171 bash[25040]: cluster 2024-09-13T23:31:38.703367+0000 mgr.a (mgr.14355) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:40.377 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:40 smithi007 bash[22722]: audit 2024-09-13T23:31:39.941983+0000 mgr.a (mgr.14355) 3062 : audit [DBG] from='client.77520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:40 smithi131 bash[24745]: audit 2024-09-13T23:31:39.941983+0000 mgr.a (mgr.14355) 3062 : audit [DBG] from='client.77520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:40 smithi171 bash[25040]: audit 2024-09-13T23:31:39.941983+0000 mgr.a (mgr.14355) 3062 : audit [DBG] from='client.77520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:41 smithi007 bash[22722]: cluster 2024-09-13T23:31:40.706332+0000 mgr.a (mgr.14355) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:31:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:41 smithi131 bash[24745]: cluster 2024-09-13T23:31:40.706332+0000 mgr.a (mgr.14355) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:31:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:41 smithi171 bash[25040]: cluster 2024-09-13T23:31:40.706332+0000 mgr.a (mgr.14355) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:31:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:43 smithi007 bash[22722]: cluster 2024-09-13T23:31:42.707263+0000 mgr.a (mgr.14355) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:43 smithi131 bash[24745]: cluster 2024-09-13T23:31:42.707263+0000 mgr.a (mgr.14355) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:43 smithi171 bash[25040]: cluster 2024-09-13T23:31:42.707263+0000 mgr.a (mgr.14355) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:45.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:45.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:45.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:46.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:45 smithi007 bash[22722]: cluster 2024-09-13T23:31:44.708028+0000 mgr.a (mgr.14355) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:45 smithi131 bash[24745]: cluster 2024-09-13T23:31:44.708028+0000 mgr.a (mgr.14355) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:45 smithi171 bash[25040]: cluster 2024-09-13T23:31:44.708028+0000 mgr.a (mgr.14355) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:31:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:46 smithi007 bash[22722]: audit 2024-09-13T23:31:45.716646+0000 mgr.a (mgr.14355) 3066 : audit [DBG] from='client.77598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:46 smithi131 bash[24745]: audit 2024-09-13T23:31:45.716646+0000 mgr.a (mgr.14355) 3066 : audit [DBG] from='client.77598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:46 smithi171 bash[25040]: audit 2024-09-13T23:31:45.716646+0000 mgr.a (mgr.14355) 3066 : audit [DBG] from='client.77598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:47 smithi007 bash[22722]: cluster 2024-09-13T23:31:46.710790+0000 mgr.a (mgr.14355) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:47 smithi131 bash[24745]: cluster 2024-09-13T23:31:46.710790+0000 mgr.a (mgr.14355) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:47 smithi171 bash[25040]: cluster 2024-09-13T23:31:46.710790+0000 mgr.a (mgr.14355) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:49 smithi007 bash[22722]: cluster 2024-09-13T23:31:48.711558+0000 mgr.a (mgr.14355) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:49 smithi131 bash[24745]: cluster 2024-09-13T23:31:48.711558+0000 mgr.a (mgr.14355) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:49 smithi171 bash[25040]: cluster 2024-09-13T23:31:48.711558+0000 mgr.a (mgr.14355) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:31:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:51.924 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:51.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:51.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:51.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:51.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:51 smithi007 bash[22722]: cluster 2024-09-13T23:31:50.713488+0000 mgr.a (mgr.14355) 3069 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:51 smithi131 bash[24745]: cluster 2024-09-13T23:31:50.713488+0000 mgr.a (mgr.14355) 3069 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:51 smithi171 bash[25040]: cluster 2024-09-13T23:31:50.713488+0000 mgr.a (mgr.14355) 3069 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:31:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:52 smithi007 bash[22722]: audit 2024-09-13T23:31:51.487217+0000 mgr.a (mgr.14355) 3070 : audit [DBG] from='client.77673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:52 smithi131 bash[24745]: audit 2024-09-13T23:31:51.487217+0000 mgr.a (mgr.14355) 3070 : audit [DBG] from='client.77673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:52 smithi171 bash[25040]: audit 2024-09-13T23:31:51.487217+0000 mgr.a (mgr.14355) 3070 : audit [DBG] from='client.77673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:53 smithi007 bash[22722]: cluster 2024-09-13T23:31:52.714371+0000 mgr.a (mgr.14355) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:53 smithi131 bash[24745]: cluster 2024-09-13T23:31:52.714371+0000 mgr.a (mgr.14355) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:53 smithi171 bash[25040]: cluster 2024-09-13T23:31:52.714371+0000 mgr.a (mgr.14355) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:55 smithi007 bash[22722]: cluster 2024-09-13T23:31:54.715144+0000 mgr.a (mgr.14355) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:55 smithi131 bash[24745]: cluster 2024-09-13T23:31:54.715144+0000 mgr.a (mgr.14355) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:55 smithi171 bash[25040]: cluster 2024-09-13T23:31:54.715144+0000 mgr.a (mgr.14355) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:31:56.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:31:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:31:56.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:31:57.695 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:31:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:31:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:31:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:57 smithi007 bash[22722]: cluster 2024-09-13T23:31:56.717497+0000 mgr.a (mgr.14355) 3073 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:57 smithi131 bash[24745]: cluster 2024-09-13T23:31:56.717497+0000 mgr.a (mgr.14355) 3073 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:57 smithi171 bash[25040]: cluster 2024-09-13T23:31:56.717497+0000 mgr.a (mgr.14355) 3073 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:31:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:58 smithi007 bash[22722]: audit 2024-09-13T23:31:57.264786+0000 mgr.a (mgr.14355) 3074 : audit [DBG] from='client.77751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:58 smithi131 bash[24745]: audit 2024-09-13T23:31:57.264786+0000 mgr.a (mgr.14355) 3074 : audit [DBG] from='client.77751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:31:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:58 smithi171 bash[25040]: audit 2024-09-13T23:31:57.264786+0000 mgr.a (mgr.14355) 3074 : audit [DBG] from='client.77751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:31:59 smithi007 bash[22722]: cluster 2024-09-13T23:31:58.718432+0000 mgr.a (mgr.14355) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:31:59 smithi131 bash[24745]: cluster 2024-09-13T23:31:58.718432+0000 mgr.a (mgr.14355) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:31:59 smithi171 bash[25040]: cluster 2024-09-13T23:31:58.718432+0000 mgr.a (mgr.14355) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:01 smithi007 bash[22722]: cluster 2024-09-13T23:32:00.720594+0000 mgr.a (mgr.14355) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:01 smithi131 bash[24745]: cluster 2024-09-13T23:32:00.720594+0000 mgr.a (mgr.14355) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:01 smithi171 bash[25040]: cluster 2024-09-13T23:32:00.720594+0000 mgr.a (mgr.14355) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:03.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:03 smithi007 bash[22722]: cluster 2024-09-13T23:32:02.721489+0000 mgr.a (mgr.14355) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:03 smithi131 bash[24745]: cluster 2024-09-13T23:32:02.721489+0000 mgr.a (mgr.14355) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:03 smithi171 bash[25040]: cluster 2024-09-13T23:32:02.721489+0000 mgr.a (mgr.14355) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:04 smithi007 bash[22722]: audit 2024-09-13T23:32:03.035560+0000 mgr.a (mgr.14355) 3078 : audit [DBG] from='client.77823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:04 smithi131 bash[24745]: audit 2024-09-13T23:32:03.035560+0000 mgr.a (mgr.14355) 3078 : audit [DBG] from='client.77823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:04 smithi171 bash[25040]: audit 2024-09-13T23:32:03.035560+0000 mgr.a (mgr.14355) 3078 : audit [DBG] from='client.77823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:05 smithi007 bash[22722]: cluster 2024-09-13T23:32:04.722561+0000 mgr.a (mgr.14355) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:05 smithi131 bash[24745]: cluster 2024-09-13T23:32:04.722561+0000 mgr.a (mgr.14355) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:05 smithi171 bash[25040]: cluster 2024-09-13T23:32:04.722561+0000 mgr.a (mgr.14355) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:32:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:07 smithi131 bash[24745]: cluster 2024-09-13T23:32:06.724827+0000 mgr.a (mgr.14355) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:07 smithi171 bash[25040]: cluster 2024-09-13T23:32:06.724827+0000 mgr.a (mgr.14355) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:07 smithi007 bash[22722]: cluster 2024-09-13T23:32:06.724827+0000 mgr.a (mgr.14355) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:08.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:09.242 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:09 smithi131 bash[24745]: cluster 2024-09-13T23:32:08.725570+0000 mgr.a (mgr.14355) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:32:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:09 smithi131 bash[24745]: audit 2024-09-13T23:32:08.818221+0000 mgr.a (mgr.14355) 3082 : audit [DBG] from='client.77898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:09 smithi171 bash[25040]: cluster 2024-09-13T23:32:08.725570+0000 mgr.a (mgr.14355) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:32:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:09 smithi171 bash[25040]: audit 2024-09-13T23:32:08.818221+0000 mgr.a (mgr.14355) 3082 : audit [DBG] from='client.77898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:09 smithi007 bash[22722]: cluster 2024-09-13T23:32:08.725570+0000 mgr.a (mgr.14355) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:32:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:09 smithi007 bash[22722]: audit 2024-09-13T23:32:08.818221+0000 mgr.a (mgr.14355) 3082 : audit [DBG] from='client.77898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:10 smithi131 bash[24745]: audit 2024-09-13T23:32:10.836241+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:32:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:10 smithi171 bash[25040]: audit 2024-09-13T23:32:10.836241+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:32:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:10 smithi007 bash[22722]: audit 2024-09-13T23:32:10.836241+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:32:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:11 smithi131 bash[24745]: cluster 2024-09-13T23:32:10.727870+0000 mgr.a (mgr.14355) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:11 smithi131 bash[24745]: audit 2024-09-13T23:32:11.684569+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:32:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:11 smithi131 bash[24745]: audit 2024-09-13T23:32:11.686412+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:32:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:11 smithi131 bash[24745]: audit 2024-09-13T23:32:11.697050+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:32:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:11 smithi131 bash[24745]: audit 2024-09-13T23:32:11.700222+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:11 smithi171 bash[25040]: cluster 2024-09-13T23:32:10.727870+0000 mgr.a (mgr.14355) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:11 smithi171 bash[25040]: audit 2024-09-13T23:32:11.684569+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:32:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:11 smithi171 bash[25040]: audit 2024-09-13T23:32:11.686412+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:32:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:11 smithi171 bash[25040]: audit 2024-09-13T23:32:11.697050+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:32:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:11 smithi171 bash[25040]: audit 2024-09-13T23:32:11.700222+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:12.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:11 smithi007 bash[22722]: cluster 2024-09-13T23:32:10.727870+0000 mgr.a (mgr.14355) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-13T23:32:12.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:11 smithi007 bash[22722]: audit 2024-09-13T23:32:11.684569+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:32:12.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:11 smithi007 bash[22722]: audit 2024-09-13T23:32:11.686412+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:32:12.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:11 smithi007 bash[22722]: audit 2024-09-13T23:32:11.697050+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:32:12.424 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:11 smithi007 bash[22722]: audit 2024-09-13T23:32:11.700222+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:12.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:32:12 smithi007 bash[22972]: debug 2024-09-13T23:32:12.419+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:32:12.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:32:12 smithi007 bash[22972]: debug 2024-09-13T23:32:12.419+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:32:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:12 smithi131 bash[24745]: audit 2024-09-13T23:32:11.702528+0000 mgr.a (mgr.14355) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:12 smithi171 bash[25040]: audit 2024-09-13T23:32:11.702528+0000 mgr.a (mgr.14355) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:12 smithi007 bash[22722]: audit 2024-09-13T23:32:11.702528+0000 mgr.a (mgr.14355) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:32:14.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:14.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:14.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:13 smithi131 bash[24745]: audit 2024-09-13T23:32:12.423677+0000 mgr.a (mgr.14355) 3085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:32:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:13 smithi131 bash[24745]: cephadm 2024-09-13T23:32:12.425118+0000 mgr.a (mgr.14355) 3086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:32:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:13 smithi131 bash[24745]: cluster 2024-09-13T23:32:12.728660+0000 mgr.a (mgr.14355) 3087 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:13 smithi171 bash[25040]: audit 2024-09-13T23:32:12.423677+0000 mgr.a (mgr.14355) 3085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:32:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:13 smithi171 bash[25040]: cephadm 2024-09-13T23:32:12.425118+0000 mgr.a (mgr.14355) 3086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:32:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:13 smithi171 bash[25040]: cluster 2024-09-13T23:32:12.728660+0000 mgr.a (mgr.14355) 3087 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:13 smithi007 bash[22722]: audit 2024-09-13T23:32:12.423677+0000 mgr.a (mgr.14355) 3085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:32:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:13 smithi007 bash[22722]: cephadm 2024-09-13T23:32:12.425118+0000 mgr.a (mgr.14355) 3086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:32:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:13 smithi007 bash[22722]: cluster 2024-09-13T23:32:12.728660+0000 mgr.a (mgr.14355) 3087 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:14.979 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:15 smithi131 bash[24745]: audit 2024-09-13T23:32:14.573411+0000 mgr.a (mgr.14355) 3088 : audit [DBG] from='client.78078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:15 smithi131 bash[24745]: cluster 2024-09-13T23:32:14.729277+0000 mgr.a (mgr.14355) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:15 smithi171 bash[25040]: audit 2024-09-13T23:32:14.573411+0000 mgr.a (mgr.14355) 3088 : audit [DBG] from='client.78078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:15 smithi171 bash[25040]: cluster 2024-09-13T23:32:14.729277+0000 mgr.a (mgr.14355) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:15 smithi007 bash[22722]: audit 2024-09-13T23:32:14.573411+0000 mgr.a (mgr.14355) 3088 : audit [DBG] from='client.78078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:15 smithi007 bash[22722]: cluster 2024-09-13T23:32:14.729277+0000 mgr.a (mgr.14355) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:32:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:17 smithi131 bash[24745]: cluster 2024-09-13T23:32:16.731635+0000 mgr.a (mgr.14355) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:32:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:17 smithi171 bash[25040]: cluster 2024-09-13T23:32:16.731635+0000 mgr.a (mgr.14355) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:32:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:17 smithi007 bash[22722]: cluster 2024-09-13T23:32:16.731635+0000 mgr.a (mgr.14355) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:32:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:19.981 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:19 smithi131 bash[24745]: cluster 2024-09-13T23:32:18.732381+0000 mgr.a (mgr.14355) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:19 smithi171 bash[25040]: cluster 2024-09-13T23:32:18.732381+0000 mgr.a (mgr.14355) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:19 smithi007 bash[22722]: cluster 2024-09-13T23:32:18.732381+0000 mgr.a (mgr.14355) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:20.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:20.728 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:21 smithi131 bash[24745]: audit 2024-09-13T23:32:20.314051+0000 mgr.a (mgr.14355) 3092 : audit [DBG] from='client.78156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:21 smithi131 bash[24745]: cluster 2024-09-13T23:32:20.733704+0000 mgr.a (mgr.14355) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:21 smithi171 bash[25040]: audit 2024-09-13T23:32:20.314051+0000 mgr.a (mgr.14355) 3092 : audit [DBG] from='client.78156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:21 smithi171 bash[25040]: cluster 2024-09-13T23:32:20.733704+0000 mgr.a (mgr.14355) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:21 smithi007 bash[22722]: audit 2024-09-13T23:32:20.314051+0000 mgr.a (mgr.14355) 3092 : audit [DBG] from='client.78156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:21 smithi007 bash[22722]: cluster 2024-09-13T23:32:20.733704+0000 mgr.a (mgr.14355) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:23 smithi131 bash[24745]: cluster 2024-09-13T23:32:22.734459+0000 mgr.a (mgr.14355) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:23 smithi171 bash[25040]: cluster 2024-09-13T23:32:22.734459+0000 mgr.a (mgr.14355) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:23 smithi007 bash[22722]: cluster 2024-09-13T23:32:22.734459+0000 mgr.a (mgr.14355) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:25.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:26 smithi131 bash[24745]: cluster 2024-09-13T23:32:24.735235+0000 mgr.a (mgr.14355) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:26 smithi171 bash[25040]: cluster 2024-09-13T23:32:24.735235+0000 mgr.a (mgr.14355) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:26 smithi007 bash[22722]: cluster 2024-09-13T23:32:24.735235+0000 mgr.a (mgr.14355) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:32:26.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:28 smithi131 bash[24745]: audit 2024-09-13T23:32:26.067982+0000 mgr.a (mgr.14355) 3096 : audit [DBG] from='client.78228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:28 smithi131 bash[24745]: cluster 2024-09-13T23:32:26.737949+0000 mgr.a (mgr.14355) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:28 smithi171 bash[25040]: audit 2024-09-13T23:32:26.067982+0000 mgr.a (mgr.14355) 3096 : audit [DBG] from='client.78228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:28 smithi171 bash[25040]: cluster 2024-09-13T23:32:26.737949+0000 mgr.a (mgr.14355) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:28 smithi007 bash[22722]: audit 2024-09-13T23:32:26.067982+0000 mgr.a (mgr.14355) 3096 : audit [DBG] from='client.78228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:28 smithi007 bash[22722]: cluster 2024-09-13T23:32:26.737949+0000 mgr.a (mgr.14355) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:32:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:30 smithi131 bash[24745]: cluster 2024-09-13T23:32:28.738741+0000 mgr.a (mgr.14355) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:32:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:30 smithi171 bash[25040]: cluster 2024-09-13T23:32:28.738741+0000 mgr.a (mgr.14355) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:32:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:30 smithi007 bash[22722]: cluster 2024-09-13T23:32:28.738741+0000 mgr.a (mgr.14355) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:32:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:32.270 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:32.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:32 smithi131 bash[24745]: cluster 2024-09-13T23:32:30.740653+0000 mgr.a (mgr.14355) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:32 smithi171 bash[25040]: cluster 2024-09-13T23:32:30.740653+0000 mgr.a (mgr.14355) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:32 smithi007 bash[22722]: cluster 2024-09-13T23:32:30.740653+0000 mgr.a (mgr.14355) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:33 smithi131 bash[24745]: audit 2024-09-13T23:32:31.847603+0000 mgr.a (mgr.14355) 3100 : audit [DBG] from='client.78306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:33 smithi171 bash[25040]: audit 2024-09-13T23:32:31.847603+0000 mgr.a (mgr.14355) 3100 : audit [DBG] from='client.78306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:33 smithi007 bash[22722]: audit 2024-09-13T23:32:31.847603+0000 mgr.a (mgr.14355) 3100 : audit [DBG] from='client.78306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:34 smithi131 bash[24745]: cluster 2024-09-13T23:32:32.741535+0000 mgr.a (mgr.14355) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:34 smithi171 bash[25040]: cluster 2024-09-13T23:32:32.741535+0000 mgr.a (mgr.14355) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:34 smithi007 bash[22722]: cluster 2024-09-13T23:32:32.741535+0000 mgr.a (mgr.14355) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:36 smithi131 bash[24745]: cluster 2024-09-13T23:32:34.742329+0000 mgr.a (mgr.14355) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:36 smithi171 bash[25040]: cluster 2024-09-13T23:32:34.742329+0000 mgr.a (mgr.14355) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:36 smithi007 bash[22722]: cluster 2024-09-13T23:32:34.742329+0000 mgr.a (mgr.14355) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:37.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:37.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:37.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:37 smithi171 bash[25040]: cluster 2024-09-13T23:32:36.744516+0000 mgr.a (mgr.14355) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:37 smithi007 bash[22722]: cluster 2024-09-13T23:32:36.744516+0000 mgr.a (mgr.14355) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:37 smithi131 bash[24745]: cluster 2024-09-13T23:32:36.744516+0000 mgr.a (mgr.14355) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:38.050 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:38.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:38 smithi171 bash[25040]: audit 2024-09-13T23:32:37.615092+0000 mgr.a (mgr.14355) 3104 : audit [DBG] from='client.78381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:38 smithi007 bash[22722]: audit 2024-09-13T23:32:37.615092+0000 mgr.a (mgr.14355) 3104 : audit [DBG] from='client.78381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:38 smithi131 bash[24745]: audit 2024-09-13T23:32:37.615092+0000 mgr.a (mgr.14355) 3104 : audit [DBG] from='client.78381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:39 smithi171 bash[25040]: cluster 2024-09-13T23:32:38.745402+0000 mgr.a (mgr.14355) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:39 smithi007 bash[22722]: cluster 2024-09-13T23:32:38.745402+0000 mgr.a (mgr.14355) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:39 smithi131 bash[24745]: cluster 2024-09-13T23:32:38.745402+0000 mgr.a (mgr.14355) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:41 smithi007 bash[22722]: cluster 2024-09-13T23:32:40.747623+0000 mgr.a (mgr.14355) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:41 smithi131 bash[24745]: cluster 2024-09-13T23:32:40.747623+0000 mgr.a (mgr.14355) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:41 smithi171 bash[25040]: cluster 2024-09-13T23:32:40.747623+0000 mgr.a (mgr.14355) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:43.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:43.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:43.819 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:43.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:43 smithi007 bash[22722]: cluster 2024-09-13T23:32:42.748367+0000 mgr.a (mgr.14355) 3107 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:43 smithi131 bash[24745]: cluster 2024-09-13T23:32:42.748367+0000 mgr.a (mgr.14355) 3107 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:43 smithi171 bash[25040]: cluster 2024-09-13T23:32:42.748367+0000 mgr.a (mgr.14355) 3107 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:44 smithi007 bash[22722]: audit 2024-09-13T23:32:43.387310+0000 mgr.a (mgr.14355) 3108 : audit [DBG] from='client.78456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:44 smithi131 bash[24745]: audit 2024-09-13T23:32:43.387310+0000 mgr.a (mgr.14355) 3108 : audit [DBG] from='client.78456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:44 smithi171 bash[25040]: audit 2024-09-13T23:32:43.387310+0000 mgr.a (mgr.14355) 3108 : audit [DBG] from='client.78456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:45 smithi007 bash[22722]: cluster 2024-09-13T23:32:44.749176+0000 mgr.a (mgr.14355) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:45 smithi131 bash[24745]: cluster 2024-09-13T23:32:44.749176+0000 mgr.a (mgr.14355) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:45 smithi171 bash[25040]: cluster 2024-09-13T23:32:44.749176+0000 mgr.a (mgr.14355) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:47 smithi007 bash[22722]: cluster 2024-09-13T23:32:46.751477+0000 mgr.a (mgr.14355) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:47 smithi131 bash[24745]: cluster 2024-09-13T23:32:46.751477+0000 mgr.a (mgr.14355) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:47 smithi171 bash[25040]: cluster 2024-09-13T23:32:46.751477+0000 mgr.a (mgr.14355) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:48.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:48.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:49.602 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:49 smithi007 bash[22722]: cluster 2024-09-13T23:32:48.752227+0000 mgr.a (mgr.14355) 3111 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:49 smithi131 bash[24745]: cluster 2024-09-13T23:32:48.752227+0000 mgr.a (mgr.14355) 3111 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:49 smithi171 bash[25040]: cluster 2024-09-13T23:32:48.752227+0000 mgr.a (mgr.14355) 3111 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:50 smithi007 bash[22722]: audit 2024-09-13T23:32:49.157162+0000 mgr.a (mgr.14355) 3112 : audit [DBG] from='client.78534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:50 smithi131 bash[24745]: audit 2024-09-13T23:32:49.157162+0000 mgr.a (mgr.14355) 3112 : audit [DBG] from='client.78534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:50 smithi171 bash[25040]: audit 2024-09-13T23:32:49.157162+0000 mgr.a (mgr.14355) 3112 : audit [DBG] from='client.78534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:51 smithi007 bash[22722]: cluster 2024-09-13T23:32:50.754695+0000 mgr.a (mgr.14355) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:51 smithi131 bash[24745]: cluster 2024-09-13T23:32:50.754695+0000 mgr.a (mgr.14355) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:51 smithi171 bash[25040]: cluster 2024-09-13T23:32:50.754695+0000 mgr.a (mgr.14355) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:32:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:53 smithi007 bash[22722]: cluster 2024-09-13T23:32:52.755645+0000 mgr.a (mgr.14355) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:53 smithi131 bash[24745]: cluster 2024-09-13T23:32:52.755645+0000 mgr.a (mgr.14355) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:53 smithi171 bash[25040]: cluster 2024-09-13T23:32:52.755645+0000 mgr.a (mgr.14355) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:54.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:32:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:32:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:32:55.341 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:32:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:32:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:32:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:32:55.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:32:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:55 smithi007 bash[22722]: cluster 2024-09-13T23:32:54.756542+0000 mgr.a (mgr.14355) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:55 smithi007 bash[22722]: audit 2024-09-13T23:32:54.939733+0000 mgr.a (mgr.14355) 3116 : audit [DBG] from='client.78612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:55 smithi131 bash[24745]: cluster 2024-09-13T23:32:54.756542+0000 mgr.a (mgr.14355) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:55 smithi131 bash[24745]: audit 2024-09-13T23:32:54.939733+0000 mgr.a (mgr.14355) 3116 : audit [DBG] from='client.78612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:55 smithi171 bash[25040]: cluster 2024-09-13T23:32:54.756542+0000 mgr.a (mgr.14355) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:32:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:55 smithi171 bash[25040]: audit 2024-09-13T23:32:54.939733+0000 mgr.a (mgr.14355) 3116 : audit [DBG] from='client.78612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:32:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:57 smithi007 bash[22722]: cluster 2024-09-13T23:32:56.759049+0000 mgr.a (mgr.14355) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:32:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:57 smithi131 bash[24745]: cluster 2024-09-13T23:32:56.759049+0000 mgr.a (mgr.14355) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:32:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:57 smithi171 bash[25040]: cluster 2024-09-13T23:32:56.759049+0000 mgr.a (mgr.14355) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:33:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:32:59 smithi007 bash[22722]: cluster 2024-09-13T23:32:58.759834+0000 mgr.a (mgr.14355) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:33:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:32:59 smithi131 bash[24745]: cluster 2024-09-13T23:32:58.759834+0000 mgr.a (mgr.14355) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:33:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:32:59 smithi171 bash[25040]: cluster 2024-09-13T23:32:58.759834+0000 mgr.a (mgr.14355) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:33:00.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:00.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:01.104 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:01 smithi007 bash[22722]: audit 2024-09-13T23:33:00.681215+0000 mgr.a (mgr.14355) 3119 : audit [DBG] from='client.78690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:01 smithi007 bash[22722]: cluster 2024-09-13T23:33:00.761430+0000 mgr.a (mgr.14355) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:01 smithi131 bash[24745]: audit 2024-09-13T23:33:00.681215+0000 mgr.a (mgr.14355) 3119 : audit [DBG] from='client.78690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:01 smithi131 bash[24745]: cluster 2024-09-13T23:33:00.761430+0000 mgr.a (mgr.14355) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:01 smithi171 bash[25040]: audit 2024-09-13T23:33:00.681215+0000 mgr.a (mgr.14355) 3119 : audit [DBG] from='client.78690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:01 smithi171 bash[25040]: cluster 2024-09-13T23:33:00.761430+0000 mgr.a (mgr.14355) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:03 smithi007 bash[22722]: cluster 2024-09-13T23:33:02.762391+0000 mgr.a (mgr.14355) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:03 smithi131 bash[24745]: cluster 2024-09-13T23:33:02.762391+0000 mgr.a (mgr.14355) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:03 smithi171 bash[25040]: cluster 2024-09-13T23:33:02.762391+0000 mgr.a (mgr.14355) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:06.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:05 smithi007 bash[22722]: cluster 2024-09-13T23:33:04.763177+0000 mgr.a (mgr.14355) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:33:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:05 smithi131 bash[24745]: cluster 2024-09-13T23:33:04.763177+0000 mgr.a (mgr.14355) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:33:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:05 smithi171 bash[25040]: cluster 2024-09-13T23:33:04.763177+0000 mgr.a (mgr.14355) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:33:06.879 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:06.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:06.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:07 smithi007 bash[22722]: audit 2024-09-13T23:33:06.438868+0000 mgr.a (mgr.14355) 3123 : audit [DBG] from='client.78768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:07 smithi007 bash[22722]: cluster 2024-09-13T23:33:06.764455+0000 mgr.a (mgr.14355) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:07 smithi131 bash[24745]: audit 2024-09-13T23:33:06.438868+0000 mgr.a (mgr.14355) 3123 : audit [DBG] from='client.78768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:07 smithi131 bash[24745]: cluster 2024-09-13T23:33:06.764455+0000 mgr.a (mgr.14355) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:07 smithi171 bash[25040]: audit 2024-09-13T23:33:06.438868+0000 mgr.a (mgr.14355) 3123 : audit [DBG] from='client.78768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:07 smithi171 bash[25040]: cluster 2024-09-13T23:33:06.764455+0000 mgr.a (mgr.14355) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:09 smithi007 bash[22722]: cluster 2024-09-13T23:33:08.765285+0000 mgr.a (mgr.14355) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:33:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:09 smithi131 bash[24745]: cluster 2024-09-13T23:33:08.765285+0000 mgr.a (mgr.14355) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:33:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:09 smithi171 bash[25040]: cluster 2024-09-13T23:33:08.765285+0000 mgr.a (mgr.14355) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:33:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:11 smithi007 bash[22722]: cluster 2024-09-13T23:33:10.767615+0000 mgr.a (mgr.14355) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:33:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:11 smithi131 bash[24745]: cluster 2024-09-13T23:33:10.767615+0000 mgr.a (mgr.14355) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:33:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:11 smithi171 bash[25040]: cluster 2024-09-13T23:33:10.767615+0000 mgr.a (mgr.14355) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:33:12.627 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:12 smithi007 bash[22722]: audit 2024-09-13T23:33:12.477123+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:33:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:12 smithi131 bash[24745]: audit 2024-09-13T23:33:12.477123+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:33:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:12 smithi171 bash[25040]: audit 2024-09-13T23:33:12.477123+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:33:14.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:33:14 smithi007 bash[22972]: debug 2024-09-13T23:33:13.994+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:33:14.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:33:14 smithi007 bash[22972]: debug 2024-09-13T23:33:13.998+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:33:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: audit 2024-09-13T23:33:12.208378+0000 mgr.a (mgr.14355) 3127 : audit [DBG] from='client.78843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: cluster 2024-09-13T23:33:12.768247+0000 mgr.a (mgr.14355) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: audit 2024-09-13T23:33:13.252811+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:33:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: audit 2024-09-13T23:33:13.254415+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:33:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: audit 2024-09-13T23:33:13.264567+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:33:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:13 smithi007 bash[22722]: audit 2024-09-13T23:33:13.269285+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: audit 2024-09-13T23:33:12.208378+0000 mgr.a (mgr.14355) 3127 : audit [DBG] from='client.78843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: cluster 2024-09-13T23:33:12.768247+0000 mgr.a (mgr.14355) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: audit 2024-09-13T23:33:13.252811+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: audit 2024-09-13T23:33:13.254415+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: audit 2024-09-13T23:33:13.264567+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:33:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:13 smithi131 bash[24745]: audit 2024-09-13T23:33:13.269285+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: audit 2024-09-13T23:33:12.208378+0000 mgr.a (mgr.14355) 3127 : audit [DBG] from='client.78843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: cluster 2024-09-13T23:33:12.768247+0000 mgr.a (mgr.14355) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: audit 2024-09-13T23:33:13.252811+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:33:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: audit 2024-09-13T23:33:13.254415+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:33:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: audit 2024-09-13T23:33:13.264567+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:33:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:13 smithi171 bash[25040]: audit 2024-09-13T23:33:13.269285+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:14 smithi007 bash[22722]: audit 2024-09-13T23:33:13.270841+0000 mgr.a (mgr.14355) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:14 smithi007 bash[22722]: audit 2024-09-13T23:33:14.000750+0000 mgr.a (mgr.14355) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:33:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:14 smithi007 bash[22722]: cephadm 2024-09-13T23:33:14.002693+0000 mgr.a (mgr.14355) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:33:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:14 smithi131 bash[24745]: audit 2024-09-13T23:33:13.270841+0000 mgr.a (mgr.14355) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:14 smithi131 bash[24745]: audit 2024-09-13T23:33:14.000750+0000 mgr.a (mgr.14355) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:33:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:14 smithi131 bash[24745]: cephadm 2024-09-13T23:33:14.002693+0000 mgr.a (mgr.14355) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:33:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:14 smithi171 bash[25040]: audit 2024-09-13T23:33:13.270841+0000 mgr.a (mgr.14355) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:33:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:14 smithi171 bash[25040]: audit 2024-09-13T23:33:14.000750+0000 mgr.a (mgr.14355) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:33:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:14 smithi171 bash[25040]: cephadm 2024-09-13T23:33:14.002693+0000 mgr.a (mgr.14355) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:33:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:15 smithi007 bash[22722]: cluster 2024-09-13T23:33:14.769283+0000 mgr.a (mgr.14355) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:15 smithi131 bash[24745]: cluster 2024-09-13T23:33:14.769283+0000 mgr.a (mgr.14355) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:15 smithi171 bash[25040]: cluster 2024-09-13T23:33:14.769283+0000 mgr.a (mgr.14355) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:17.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:17.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:17.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:17 smithi007 bash[22722]: cluster 2024-09-13T23:33:16.771750+0000 mgr.a (mgr.14355) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:17 smithi131 bash[24745]: cluster 2024-09-13T23:33:16.771750+0000 mgr.a (mgr.14355) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:17 smithi171 bash[25040]: cluster 2024-09-13T23:33:16.771750+0000 mgr.a (mgr.14355) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:18.403 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:18.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:18 smithi007 bash[22722]: audit 2024-09-13T23:33:17.964493+0000 mgr.a (mgr.14355) 3134 : audit [DBG] from='client.79026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:18 smithi131 bash[24745]: audit 2024-09-13T23:33:17.964493+0000 mgr.a (mgr.14355) 3134 : audit [DBG] from='client.79026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:18 smithi171 bash[25040]: audit 2024-09-13T23:33:17.964493+0000 mgr.a (mgr.14355) 3134 : audit [DBG] from='client.79026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:19 smithi007 bash[22722]: cluster 2024-09-13T23:33:18.772813+0000 mgr.a (mgr.14355) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:19 smithi131 bash[24745]: cluster 2024-09-13T23:33:18.772813+0000 mgr.a (mgr.14355) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:19 smithi171 bash[25040]: cluster 2024-09-13T23:33:18.772813+0000 mgr.a (mgr.14355) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:21 smithi007 bash[22722]: cluster 2024-09-13T23:33:20.775200+0000 mgr.a (mgr.14355) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:21 smithi131 bash[24745]: cluster 2024-09-13T23:33:20.775200+0000 mgr.a (mgr.14355) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:21 smithi171 bash[25040]: cluster 2024-09-13T23:33:20.775200+0000 mgr.a (mgr.14355) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:23.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:24.185 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:24.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:24.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:23 smithi007 bash[22722]: cluster 2024-09-13T23:33:22.776125+0000 mgr.a (mgr.14355) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:23 smithi131 bash[24745]: cluster 2024-09-13T23:33:22.776125+0000 mgr.a (mgr.14355) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:23 smithi171 bash[25040]: cluster 2024-09-13T23:33:22.776125+0000 mgr.a (mgr.14355) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:24 smithi007 bash[22722]: audit 2024-09-13T23:33:23.743877+0000 mgr.a (mgr.14355) 3138 : audit [DBG] from='client.79104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:24 smithi131 bash[24745]: audit 2024-09-13T23:33:23.743877+0000 mgr.a (mgr.14355) 3138 : audit [DBG] from='client.79104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:24 smithi171 bash[25040]: audit 2024-09-13T23:33:23.743877+0000 mgr.a (mgr.14355) 3138 : audit [DBG] from='client.79104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:25 smithi007 bash[22722]: cluster 2024-09-13T23:33:24.777159+0000 mgr.a (mgr.14355) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:25 smithi131 bash[24745]: cluster 2024-09-13T23:33:24.777159+0000 mgr.a (mgr.14355) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:25 smithi171 bash[25040]: cluster 2024-09-13T23:33:24.777159+0000 mgr.a (mgr.14355) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:27 smithi007 bash[22722]: cluster 2024-09-13T23:33:26.779413+0000 mgr.a (mgr.14355) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:27 smithi131 bash[24745]: cluster 2024-09-13T23:33:26.779413+0000 mgr.a (mgr.14355) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:27 smithi171 bash[25040]: cluster 2024-09-13T23:33:26.779413+0000 mgr.a (mgr.14355) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:33:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:29.188 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:29.188 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:29.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:29.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:29 smithi007 bash[22722]: cluster 2024-09-13T23:33:28.780211+0000 mgr.a (mgr.14355) 3141 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:29 smithi131 bash[24745]: cluster 2024-09-13T23:33:28.780211+0000 mgr.a (mgr.14355) 3141 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:29 smithi171 bash[25040]: cluster 2024-09-13T23:33:28.780211+0000 mgr.a (mgr.14355) 3141 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:30 smithi007 bash[22722]: audit 2024-09-13T23:33:29.522255+0000 mgr.a (mgr.14355) 3142 : audit [DBG] from='client.79182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:30 smithi131 bash[24745]: audit 2024-09-13T23:33:29.522255+0000 mgr.a (mgr.14355) 3142 : audit [DBG] from='client.79182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:30 smithi171 bash[25040]: audit 2024-09-13T23:33:29.522255+0000 mgr.a (mgr.14355) 3142 : audit [DBG] from='client.79182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:31 smithi007 bash[22722]: cluster 2024-09-13T23:33:30.782574+0000 mgr.a (mgr.14355) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:31 smithi131 bash[24745]: cluster 2024-09-13T23:33:30.782574+0000 mgr.a (mgr.14355) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:31 smithi171 bash[25040]: cluster 2024-09-13T23:33:30.782574+0000 mgr.a (mgr.14355) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:33 smithi007 bash[22722]: cluster 2024-09-13T23:33:32.783340+0000 mgr.a (mgr.14355) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:33 smithi131 bash[24745]: cluster 2024-09-13T23:33:32.783340+0000 mgr.a (mgr.14355) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:33 smithi171 bash[25040]: cluster 2024-09-13T23:33:32.783340+0000 mgr.a (mgr.14355) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:34.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:35.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:35.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:35 smithi007 bash[22722]: cluster 2024-09-13T23:33:34.784096+0000 mgr.a (mgr.14355) 3145 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:35 smithi131 bash[24745]: cluster 2024-09-13T23:33:34.784096+0000 mgr.a (mgr.14355) 3145 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:35 smithi171 bash[25040]: cluster 2024-09-13T23:33:34.784096+0000 mgr.a (mgr.14355) 3145 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:36 smithi007 bash[22722]: audit 2024-09-13T23:33:35.299527+0000 mgr.a (mgr.14355) 3146 : audit [DBG] from='client.79260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:36 smithi131 bash[24745]: audit 2024-09-13T23:33:35.299527+0000 mgr.a (mgr.14355) 3146 : audit [DBG] from='client.79260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:36 smithi171 bash[25040]: audit 2024-09-13T23:33:35.299527+0000 mgr.a (mgr.14355) 3146 : audit [DBG] from='client.79260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:37 smithi007 bash[22722]: cluster 2024-09-13T23:33:36.786953+0000 mgr.a (mgr.14355) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:37 smithi131 bash[24745]: cluster 2024-09-13T23:33:36.786953+0000 mgr.a (mgr.14355) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:37 smithi171 bash[25040]: cluster 2024-09-13T23:33:36.786953+0000 mgr.a (mgr.14355) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:39 smithi007 bash[22722]: cluster 2024-09-13T23:33:38.787888+0000 mgr.a (mgr.14355) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:39 smithi131 bash[24745]: cluster 2024-09-13T23:33:38.787888+0000 mgr.a (mgr.14355) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:39 smithi171 bash[25040]: cluster 2024-09-13T23:33:38.787888+0000 mgr.a (mgr.14355) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:41.517 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:41.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:41.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:41.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:41.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:41 smithi007 bash[22722]: cluster 2024-09-13T23:33:40.789912+0000 mgr.a (mgr.14355) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:41 smithi131 bash[24745]: cluster 2024-09-13T23:33:40.789912+0000 mgr.a (mgr.14355) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:41 smithi171 bash[25040]: cluster 2024-09-13T23:33:40.789912+0000 mgr.a (mgr.14355) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:42 smithi007 bash[22722]: audit 2024-09-13T23:33:41.081519+0000 mgr.a (mgr.14355) 3150 : audit [DBG] from='client.79338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:42 smithi131 bash[24745]: audit 2024-09-13T23:33:41.081519+0000 mgr.a (mgr.14355) 3150 : audit [DBG] from='client.79338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:42 smithi171 bash[25040]: audit 2024-09-13T23:33:41.081519+0000 mgr.a (mgr.14355) 3150 : audit [DBG] from='client.79338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:43 smithi007 bash[22722]: cluster 2024-09-13T23:33:42.791044+0000 mgr.a (mgr.14355) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:43 smithi131 bash[24745]: cluster 2024-09-13T23:33:42.791044+0000 mgr.a (mgr.14355) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:43 smithi171 bash[25040]: cluster 2024-09-13T23:33:42.791044+0000 mgr.a (mgr.14355) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:45 smithi007 bash[22722]: cluster 2024-09-13T23:33:44.791974+0000 mgr.a (mgr.14355) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:45 smithi131 bash[24745]: cluster 2024-09-13T23:33:44.791974+0000 mgr.a (mgr.14355) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:45 smithi171 bash[25040]: cluster 2024-09-13T23:33:44.791974+0000 mgr.a (mgr.14355) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:33:46.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:46.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:46.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:47.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:47 smithi007 bash[22722]: cluster 2024-09-13T23:33:46.793352+0000 mgr.a (mgr.14355) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:47 smithi007 bash[22722]: audit 2024-09-13T23:33:46.854856+0000 mgr.a (mgr.14355) 3154 : audit [DBG] from='client.79416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:47 smithi131 bash[24745]: cluster 2024-09-13T23:33:46.793352+0000 mgr.a (mgr.14355) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:47 smithi131 bash[24745]: audit 2024-09-13T23:33:46.854856+0000 mgr.a (mgr.14355) 3154 : audit [DBG] from='client.79416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:47 smithi171 bash[25040]: cluster 2024-09-13T23:33:46.793352+0000 mgr.a (mgr.14355) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:47 smithi171 bash[25040]: audit 2024-09-13T23:33:46.854856+0000 mgr.a (mgr.14355) 3154 : audit [DBG] from='client.79416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:49 smithi007 bash[22722]: cluster 2024-09-13T23:33:48.794213+0000 mgr.a (mgr.14355) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:49 smithi131 bash[24745]: cluster 2024-09-13T23:33:48.794213+0000 mgr.a (mgr.14355) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:49 smithi171 bash[25040]: cluster 2024-09-13T23:33:48.794213+0000 mgr.a (mgr.14355) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:51 smithi007 bash[22722]: cluster 2024-09-13T23:33:50.796409+0000 mgr.a (mgr.14355) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:51 smithi131 bash[24745]: cluster 2024-09-13T23:33:50.796409+0000 mgr.a (mgr.14355) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:52.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:52.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:52.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:51 smithi171 bash[25040]: cluster 2024-09-13T23:33:50.796409+0000 mgr.a (mgr.14355) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:53.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:33:53.038 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:53 smithi007 bash[22722]: audit 2024-09-13T23:33:52.621298+0000 mgr.a (mgr.14355) 3157 : audit [DBG] from='client.79494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:53 smithi007 bash[22722]: cluster 2024-09-13T23:33:52.796920+0000 mgr.a (mgr.14355) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:53 smithi131 bash[24745]: audit 2024-09-13T23:33:52.621298+0000 mgr.a (mgr.14355) 3157 : audit [DBG] from='client.79494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:53 smithi131 bash[24745]: cluster 2024-09-13T23:33:52.796920+0000 mgr.a (mgr.14355) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:53 smithi171 bash[25040]: audit 2024-09-13T23:33:52.621298+0000 mgr.a (mgr.14355) 3157 : audit [DBG] from='client.79494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:33:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:53 smithi171 bash[25040]: cluster 2024-09-13T23:33:52.796920+0000 mgr.a (mgr.14355) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:55 smithi007 bash[22722]: cluster 2024-09-13T23:33:54.797743+0000 mgr.a (mgr.14355) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:55 smithi131 bash[24745]: cluster 2024-09-13T23:33:54.797743+0000 mgr.a (mgr.14355) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:55 smithi171 bash[25040]: cluster 2024-09-13T23:33:54.797743+0000 mgr.a (mgr.14355) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:33:58.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:33:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:33:58.040 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:33:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:57 smithi007 bash[22722]: cluster 2024-09-13T23:33:56.800030+0000 mgr.a (mgr.14355) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:57 smithi131 bash[24745]: cluster 2024-09-13T23:33:56.800030+0000 mgr.a (mgr.14355) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:57 smithi171 bash[25040]: cluster 2024-09-13T23:33:56.800030+0000 mgr.a (mgr.14355) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:33:58.804 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:33:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:33:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:33:58.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:33:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:59 smithi007 bash[22722]: audit 2024-09-13T23:33:58.376575+0000 mgr.a (mgr.14355) 3161 : audit [DBG] from='client.79572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:33:59 smithi007 bash[22722]: cluster 2024-09-13T23:33:58.800635+0000 mgr.a (mgr.14355) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:59 smithi131 bash[24745]: audit 2024-09-13T23:33:58.376575+0000 mgr.a (mgr.14355) 3161 : audit [DBG] from='client.79572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:33:59 smithi131 bash[24745]: cluster 2024-09-13T23:33:58.800635+0000 mgr.a (mgr.14355) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:59 smithi171 bash[25040]: audit 2024-09-13T23:33:58.376575+0000 mgr.a (mgr.14355) 3161 : audit [DBG] from='client.79572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:33:59 smithi171 bash[25040]: cluster 2024-09-13T23:33:58.800635+0000 mgr.a (mgr.14355) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:01 smithi007 bash[22722]: cluster 2024-09-13T23:34:00.802812+0000 mgr.a (mgr.14355) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:01 smithi131 bash[24745]: cluster 2024-09-13T23:34:00.802812+0000 mgr.a (mgr.14355) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:01 smithi171 bash[25040]: cluster 2024-09-13T23:34:00.802812+0000 mgr.a (mgr.14355) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:03.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:03.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:03.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:03 smithi007 bash[22722]: cluster 2024-09-13T23:34:02.803582+0000 mgr.a (mgr.14355) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:03 smithi131 bash[24745]: cluster 2024-09-13T23:34:02.803582+0000 mgr.a (mgr.14355) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:03 smithi171 bash[25040]: cluster 2024-09-13T23:34:02.803582+0000 mgr.a (mgr.14355) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:04.555 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:04.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:04.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:04.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:04.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:05 smithi007 bash[22722]: audit 2024-09-13T23:34:04.137930+0000 mgr.a (mgr.14355) 3165 : audit [DBG] from='client.79650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:05 smithi007 bash[22722]: cluster 2024-09-13T23:34:04.804540+0000 mgr.a (mgr.14355) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:05 smithi131 bash[24745]: audit 2024-09-13T23:34:04.137930+0000 mgr.a (mgr.14355) 3165 : audit [DBG] from='client.79650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:06.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:05 smithi131 bash[24745]: cluster 2024-09-13T23:34:04.804540+0000 mgr.a (mgr.14355) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:05 smithi171 bash[25040]: audit 2024-09-13T23:34:04.137930+0000 mgr.a (mgr.14355) 3165 : audit [DBG] from='client.79650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:05 smithi171 bash[25040]: cluster 2024-09-13T23:34:04.804540+0000 mgr.a (mgr.14355) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:07 smithi007 bash[22722]: cluster 2024-09-13T23:34:06.806828+0000 mgr.a (mgr.14355) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:07 smithi131 bash[24745]: cluster 2024-09-13T23:34:06.806828+0000 mgr.a (mgr.14355) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:07 smithi171 bash[25040]: cluster 2024-09-13T23:34:06.806828+0000 mgr.a (mgr.14355) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:09.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:09.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:09 smithi007 bash[22722]: cluster 2024-09-13T23:34:08.807653+0000 mgr.a (mgr.14355) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:09 smithi131 bash[24745]: cluster 2024-09-13T23:34:08.807653+0000 mgr.a (mgr.14355) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:09 smithi171 bash[25040]: cluster 2024-09-13T23:34:08.807653+0000 mgr.a (mgr.14355) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:10.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:10.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:10 smithi131 bash[24745]: audit 2024-09-13T23:34:09.892633+0000 mgr.a (mgr.14355) 3169 : audit [DBG] from='client.79728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:10 smithi171 bash[25040]: audit 2024-09-13T23:34:09.892633+0000 mgr.a (mgr.14355) 3169 : audit [DBG] from='client.79728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:10 smithi007 bash[22722]: audit 2024-09-13T23:34:09.892633+0000 mgr.a (mgr.14355) 3169 : audit [DBG] from='client.79728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:11 smithi131 bash[24745]: cluster 2024-09-13T23:34:10.810133+0000 mgr.a (mgr.14355) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:34:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:11 smithi171 bash[25040]: cluster 2024-09-13T23:34:10.810133+0000 mgr.a (mgr.14355) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:34:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:11 smithi007 bash[22722]: cluster 2024-09-13T23:34:10.810133+0000 mgr.a (mgr.14355) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:34:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:13 smithi131 bash[24745]: cluster 2024-09-13T23:34:12.810952+0000 mgr.a (mgr.14355) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:13 smithi171 bash[25040]: cluster 2024-09-13T23:34:12.810952+0000 mgr.a (mgr.14355) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:13 smithi007 bash[22722]: cluster 2024-09-13T23:34:12.810952+0000 mgr.a (mgr.14355) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:14 smithi131 bash[24745]: audit 2024-09-13T23:34:14.058974+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:14 smithi131 bash[24745]: audit 2024-09-13T23:34:14.904344+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:14 smithi131 bash[24745]: audit 2024-09-13T23:34:14.905944+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:14 smithi131 bash[24745]: audit 2024-09-13T23:34:14.915463+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:14 smithi131 bash[24745]: audit 2024-09-13T23:34:14.920442+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:14 smithi171 bash[25040]: audit 2024-09-13T23:34:14.058974+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:14 smithi171 bash[25040]: audit 2024-09-13T23:34:14.904344+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:14 smithi171 bash[25040]: audit 2024-09-13T23:34:14.905944+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:14 smithi171 bash[25040]: audit 2024-09-13T23:34:14.915463+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:14 smithi171 bash[25040]: audit 2024-09-13T23:34:14.920442+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:15.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:14 smithi007 bash[22722]: audit 2024-09-13T23:34:14.058974+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:34:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:14 smithi007 bash[22722]: audit 2024-09-13T23:34:14.904344+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:34:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:14 smithi007 bash[22722]: audit 2024-09-13T23:34:14.905944+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:34:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:14 smithi007 bash[22722]: audit 2024-09-13T23:34:14.915463+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:34:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:14 smithi007 bash[22722]: audit 2024-09-13T23:34:14.920442+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:15.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:34:15 smithi007 bash[22972]: debug 2024-09-13T23:34:15.617+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:34:15.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:34:15 smithi007 bash[22972]: debug 2024-09-13T23:34:15.621+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:34:16.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:15 smithi131 bash[24745]: cluster 2024-09-13T23:34:14.811404+0000 mgr.a (mgr.14355) 3172 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:15 smithi131 bash[24745]: audit 2024-09-13T23:34:14.922734+0000 mgr.a (mgr.14355) 3173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:15 smithi171 bash[25040]: cluster 2024-09-13T23:34:14.811404+0000 mgr.a (mgr.14355) 3172 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:15 smithi171 bash[25040]: audit 2024-09-13T23:34:14.922734+0000 mgr.a (mgr.14355) 3173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:15 smithi007 bash[22722]: cluster 2024-09-13T23:34:14.811404+0000 mgr.a (mgr.14355) 3172 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:34:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:15 smithi007 bash[22722]: audit 2024-09-13T23:34:14.922734+0000 mgr.a (mgr.14355) 3173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:34:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:16 smithi131 bash[24745]: audit 2024-09-13T23:34:15.622029+0000 mgr.a (mgr.14355) 3174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:34:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:16 smithi131 bash[24745]: cephadm 2024-09-13T23:34:15.623310+0000 mgr.a (mgr.14355) 3175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:34:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:16 smithi131 bash[24745]: audit 2024-09-13T23:34:15.659363+0000 mgr.a (mgr.14355) 3176 : audit [DBG] from='client.79893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:16 smithi171 bash[25040]: audit 2024-09-13T23:34:15.622029+0000 mgr.a (mgr.14355) 3174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:34:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:16 smithi171 bash[25040]: cephadm 2024-09-13T23:34:15.623310+0000 mgr.a (mgr.14355) 3175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:34:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:16 smithi171 bash[25040]: audit 2024-09-13T23:34:15.659363+0000 mgr.a (mgr.14355) 3176 : audit [DBG] from='client.79893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:16 smithi007 bash[22722]: audit 2024-09-13T23:34:15.622029+0000 mgr.a (mgr.14355) 3174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:34:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:16 smithi007 bash[22722]: cephadm 2024-09-13T23:34:15.623310+0000 mgr.a (mgr.14355) 3175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:34:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:16 smithi007 bash[22722]: audit 2024-09-13T23:34:15.659363+0000 mgr.a (mgr.14355) 3176 : audit [DBG] from='client.79893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:17 smithi131 bash[24745]: cluster 2024-09-13T23:34:16.814202+0000 mgr.a (mgr.14355) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T23:34:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:17 smithi171 bash[25040]: cluster 2024-09-13T23:34:16.814202+0000 mgr.a (mgr.14355) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T23:34:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:17 smithi007 bash[22722]: cluster 2024-09-13T23:34:16.814202+0000 mgr.a (mgr.14355) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T23:34:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:19 smithi131 bash[24745]: cluster 2024-09-13T23:34:18.815047+0000 mgr.a (mgr.14355) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T23:34:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:19 smithi171 bash[25040]: cluster 2024-09-13T23:34:18.815047+0000 mgr.a (mgr.14355) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T23:34:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:19 smithi007 bash[22722]: cluster 2024-09-13T23:34:18.815047+0000 mgr.a (mgr.14355) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T23:34:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:21.795 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:21.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:21.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:21.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:21.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:22 smithi131 bash[24745]: cluster 2024-09-13T23:34:20.817016+0000 mgr.a (mgr.14355) 3179 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:22 smithi171 bash[25040]: cluster 2024-09-13T23:34:20.817016+0000 mgr.a (mgr.14355) 3179 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:21 smithi007 bash[22722]: cluster 2024-09-13T23:34:20.817016+0000 mgr.a (mgr.14355) 3179 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:23 smithi131 bash[24745]: audit 2024-09-13T23:34:21.379372+0000 mgr.a (mgr.14355) 3180 : audit [DBG] from='client.79989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:23 smithi171 bash[25040]: audit 2024-09-13T23:34:21.379372+0000 mgr.a (mgr.14355) 3180 : audit [DBG] from='client.79989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:23 smithi007 bash[22722]: audit 2024-09-13T23:34:21.379372+0000 mgr.a (mgr.14355) 3180 : audit [DBG] from='client.79989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:24 smithi131 bash[24745]: cluster 2024-09-13T23:34:22.817958+0000 mgr.a (mgr.14355) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:24 smithi171 bash[25040]: cluster 2024-09-13T23:34:22.817958+0000 mgr.a (mgr.14355) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:24 smithi007 bash[22722]: cluster 2024-09-13T23:34:22.817958+0000 mgr.a (mgr.14355) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:26 smithi131 bash[24745]: cluster 2024-09-13T23:34:24.818789+0000 mgr.a (mgr.14355) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:26 smithi171 bash[25040]: cluster 2024-09-13T23:34:24.818789+0000 mgr.a (mgr.14355) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:26 smithi007 bash[22722]: cluster 2024-09-13T23:34:24.818789+0000 mgr.a (mgr.14355) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:34:26.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:26.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:26.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:27.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:27.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:28 smithi131 bash[24745]: cluster 2024-09-13T23:34:26.820282+0000 mgr.a (mgr.14355) 3183 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:28 smithi171 bash[25040]: cluster 2024-09-13T23:34:26.820282+0000 mgr.a (mgr.14355) 3183 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:28 smithi007 bash[22722]: cluster 2024-09-13T23:34:26.820282+0000 mgr.a (mgr.14355) 3183 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:34:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:29 smithi131 bash[24745]: audit 2024-09-13T23:34:27.128880+0000 mgr.a (mgr.14355) 3184 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:29 smithi171 bash[25040]: audit 2024-09-13T23:34:27.128880+0000 mgr.a (mgr.14355) 3184 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:29 smithi007 bash[22722]: audit 2024-09-13T23:34:27.128880+0000 mgr.a (mgr.14355) 3184 : audit [DBG] from='client.80061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:30 smithi131 bash[24745]: cluster 2024-09-13T23:34:28.821154+0000 mgr.a (mgr.14355) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:30 smithi171 bash[25040]: cluster 2024-09-13T23:34:28.821154+0000 mgr.a (mgr.14355) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:30 smithi007 bash[22722]: cluster 2024-09-13T23:34:28.821154+0000 mgr.a (mgr.14355) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:32 smithi171 bash[25040]: cluster 2024-09-13T23:34:30.823353+0000 mgr.a (mgr.14355) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:32 smithi007 bash[22722]: cluster 2024-09-13T23:34:30.823353+0000 mgr.a (mgr.14355) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:32 smithi131 bash[24745]: cluster 2024-09-13T23:34:30.823353+0000 mgr.a (mgr.14355) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:34:32.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:33.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:33.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:33.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:33.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:33.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:34 smithi171 bash[25040]: cluster 2024-09-13T23:34:32.823907+0000 mgr.a (mgr.14355) 3187 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:34 smithi171 bash[25040]: audit 2024-09-13T23:34:32.883179+0000 mgr.a (mgr.14355) 3188 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:34 smithi007 bash[22722]: cluster 2024-09-13T23:34:32.823907+0000 mgr.a (mgr.14355) 3187 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:34 smithi007 bash[22722]: audit 2024-09-13T23:34:32.883179+0000 mgr.a (mgr.14355) 3188 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:34.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:34 smithi131 bash[24745]: cluster 2024-09-13T23:34:32.823907+0000 mgr.a (mgr.14355) 3187 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:34.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:34 smithi131 bash[24745]: audit 2024-09-13T23:34:32.883179+0000 mgr.a (mgr.14355) 3188 : audit [DBG] from='client.80139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:36 smithi171 bash[25040]: cluster 2024-09-13T23:34:34.824748+0000 mgr.a (mgr.14355) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:36 smithi007 bash[22722]: cluster 2024-09-13T23:34:34.824748+0000 mgr.a (mgr.14355) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:36 smithi131 bash[24745]: cluster 2024-09-13T23:34:34.824748+0000 mgr.a (mgr.14355) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:38.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:38 smithi007 bash[22722]: cluster 2024-09-13T23:34:36.827024+0000 mgr.a (mgr.14355) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:38 smithi131 bash[24745]: cluster 2024-09-13T23:34:36.827024+0000 mgr.a (mgr.14355) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:38 smithi171 bash[25040]: cluster 2024-09-13T23:34:36.827024+0000 mgr.a (mgr.14355) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:39.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:39 smithi007 bash[22722]: audit 2024-09-13T23:34:38.658410+0000 mgr.a (mgr.14355) 3191 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:39 smithi007 bash[22722]: cluster 2024-09-13T23:34:38.827534+0000 mgr.a (mgr.14355) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:39 smithi131 bash[24745]: audit 2024-09-13T23:34:38.658410+0000 mgr.a (mgr.14355) 3191 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:39 smithi131 bash[24745]: cluster 2024-09-13T23:34:38.827534+0000 mgr.a (mgr.14355) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:39 smithi171 bash[25040]: audit 2024-09-13T23:34:38.658410+0000 mgr.a (mgr.14355) 3191 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:39 smithi171 bash[25040]: cluster 2024-09-13T23:34:38.827534+0000 mgr.a (mgr.14355) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:41 smithi007 bash[22722]: cluster 2024-09-13T23:34:40.829785+0000 mgr.a (mgr.14355) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:41 smithi131 bash[24745]: cluster 2024-09-13T23:34:40.829785+0000 mgr.a (mgr.14355) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:41 smithi171 bash[25040]: cluster 2024-09-13T23:34:40.829785+0000 mgr.a (mgr.14355) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:43 smithi007 bash[22722]: cluster 2024-09-13T23:34:42.830568+0000 mgr.a (mgr.14355) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:43 smithi131 bash[24745]: cluster 2024-09-13T23:34:42.830568+0000 mgr.a (mgr.14355) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:43 smithi171 bash[25040]: cluster 2024-09-13T23:34:42.830568+0000 mgr.a (mgr.14355) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:44.840 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:44.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:44.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:44.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:44.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:45 smithi007 bash[22722]: audit 2024-09-13T23:34:44.404627+0000 mgr.a (mgr.14355) 3195 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:45 smithi007 bash[22722]: cluster 2024-09-13T23:34:44.831122+0000 mgr.a (mgr.14355) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:45 smithi131 bash[24745]: audit 2024-09-13T23:34:44.404627+0000 mgr.a (mgr.14355) 3195 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:45 smithi131 bash[24745]: cluster 2024-09-13T23:34:44.831122+0000 mgr.a (mgr.14355) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:45 smithi171 bash[25040]: audit 2024-09-13T23:34:44.404627+0000 mgr.a (mgr.14355) 3195 : audit [DBG] from='client.80292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:45 smithi171 bash[25040]: cluster 2024-09-13T23:34:44.831122+0000 mgr.a (mgr.14355) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:47 smithi007 bash[22722]: cluster 2024-09-13T23:34:46.833433+0000 mgr.a (mgr.14355) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:47 smithi131 bash[24745]: cluster 2024-09-13T23:34:46.833433+0000 mgr.a (mgr.14355) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:47 smithi171 bash[25040]: cluster 2024-09-13T23:34:46.833433+0000 mgr.a (mgr.14355) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:34:49.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:49.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:49.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:49 smithi007 bash[22722]: cluster 2024-09-13T23:34:48.834211+0000 mgr.a (mgr.14355) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:49 smithi131 bash[24745]: cluster 2024-09-13T23:34:48.834211+0000 mgr.a (mgr.14355) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:49 smithi171 bash[25040]: cluster 2024-09-13T23:34:48.834211+0000 mgr.a (mgr.14355) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:50.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:51 smithi007 bash[22722]: audit 2024-09-13T23:34:50.184291+0000 mgr.a (mgr.14355) 3199 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:51 smithi007 bash[22722]: cluster 2024-09-13T23:34:50.836966+0000 mgr.a (mgr.14355) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:51 smithi131 bash[24745]: audit 2024-09-13T23:34:50.184291+0000 mgr.a (mgr.14355) 3199 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:51 smithi131 bash[24745]: cluster 2024-09-13T23:34:50.836966+0000 mgr.a (mgr.14355) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:51 smithi171 bash[25040]: audit 2024-09-13T23:34:50.184291+0000 mgr.a (mgr.14355) 3199 : audit [DBG] from='client.80370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:51 smithi171 bash[25040]: cluster 2024-09-13T23:34:50.836966+0000 mgr.a (mgr.14355) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:53 smithi007 bash[22722]: cluster 2024-09-13T23:34:52.837763+0000 mgr.a (mgr.14355) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:34:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:53 smithi131 bash[24745]: cluster 2024-09-13T23:34:52.837763+0000 mgr.a (mgr.14355) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:34:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:53 smithi171 bash[25040]: cluster 2024-09-13T23:34:52.837763+0000 mgr.a (mgr.14355) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:34:55.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:34:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:34:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:34:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:55 smithi007 bash[22722]: cluster 2024-09-13T23:34:54.838530+0000 mgr.a (mgr.14355) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:34:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:55 smithi131 bash[24745]: cluster 2024-09-13T23:34:54.838530+0000 mgr.a (mgr.14355) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:34:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:55 smithi171 bash[25040]: cluster 2024-09-13T23:34:54.838530+0000 mgr.a (mgr.14355) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:34:56.371 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:34:56.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:34:56.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:34:56.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:34:56.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:34:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:56 smithi007 bash[22722]: audit 2024-09-13T23:34:55.960634+0000 mgr.a (mgr.14355) 3203 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:56 smithi131 bash[24745]: audit 2024-09-13T23:34:55.960634+0000 mgr.a (mgr.14355) 3203 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:56 smithi171 bash[25040]: audit 2024-09-13T23:34:55.960634+0000 mgr.a (mgr.14355) 3203 : audit [DBG] from='client.80448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:34:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:57 smithi007 bash[22722]: cluster 2024-09-13T23:34:56.841328+0000 mgr.a (mgr.14355) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:57 smithi131 bash[24745]: cluster 2024-09-13T23:34:56.841328+0000 mgr.a (mgr.14355) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:34:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:57 smithi171 bash[25040]: cluster 2024-09-13T23:34:56.841328+0000 mgr.a (mgr.14355) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:34:59 smithi007 bash[22722]: cluster 2024-09-13T23:34:58.842125+0000 mgr.a (mgr.14355) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:34:59 smithi131 bash[24745]: cluster 2024-09-13T23:34:58.842125+0000 mgr.a (mgr.14355) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:34:59 smithi171 bash[25040]: cluster 2024-09-13T23:34:58.842125+0000 mgr.a (mgr.14355) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:01.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:01.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:01.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:02.106 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:02.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:02.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:02.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:02.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:01 smithi007 bash[22722]: cluster 2024-09-13T23:35:00.844134+0000 mgr.a (mgr.14355) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:01 smithi131 bash[24745]: cluster 2024-09-13T23:35:00.844134+0000 mgr.a (mgr.14355) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:01 smithi171 bash[25040]: cluster 2024-09-13T23:35:00.844134+0000 mgr.a (mgr.14355) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:02 smithi007 bash[22722]: audit 2024-09-13T23:35:01.691569+0000 mgr.a (mgr.14355) 3207 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:02 smithi131 bash[24745]: audit 2024-09-13T23:35:01.691569+0000 mgr.a (mgr.14355) 3207 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:02 smithi171 bash[25040]: audit 2024-09-13T23:35:01.691569+0000 mgr.a (mgr.14355) 3207 : audit [DBG] from='client.80523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:03 smithi007 bash[22722]: cluster 2024-09-13T23:35:02.845089+0000 mgr.a (mgr.14355) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:03 smithi131 bash[24745]: cluster 2024-09-13T23:35:02.845089+0000 mgr.a (mgr.14355) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:03 smithi171 bash[25040]: cluster 2024-09-13T23:35:02.845089+0000 mgr.a (mgr.14355) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:05 smithi131 bash[24745]: cluster 2024-09-13T23:35:04.845876+0000 mgr.a (mgr.14355) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:05 smithi171 bash[25040]: cluster 2024-09-13T23:35:04.845876+0000 mgr.a (mgr.14355) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:05 smithi007 bash[22722]: cluster 2024-09-13T23:35:04.845876+0000 mgr.a (mgr.14355) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:07.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:07.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:07.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:07.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:07 smithi131 bash[24745]: cluster 2024-09-13T23:35:06.848111+0000 mgr.a (mgr.14355) 3210 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:07 smithi171 bash[25040]: cluster 2024-09-13T23:35:06.848111+0000 mgr.a (mgr.14355) 3210 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:07 smithi007 bash[22722]: cluster 2024-09-13T23:35:06.848111+0000 mgr.a (mgr.14355) 3210 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:08 smithi131 bash[24745]: audit 2024-09-13T23:35:07.436407+0000 mgr.a (mgr.14355) 3211 : audit [DBG] from='client.80601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:08 smithi171 bash[25040]: audit 2024-09-13T23:35:07.436407+0000 mgr.a (mgr.14355) 3211 : audit [DBG] from='client.80601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:08 smithi007 bash[22722]: audit 2024-09-13T23:35:07.436407+0000 mgr.a (mgr.14355) 3211 : audit [DBG] from='client.80601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:09 smithi131 bash[24745]: cluster 2024-09-13T23:35:08.848975+0000 mgr.a (mgr.14355) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:09 smithi171 bash[25040]: cluster 2024-09-13T23:35:08.848975+0000 mgr.a (mgr.14355) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:09 smithi007 bash[22722]: cluster 2024-09-13T23:35:08.848975+0000 mgr.a (mgr.14355) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:11 smithi131 bash[24745]: cluster 2024-09-13T23:35:10.851152+0000 mgr.a (mgr.14355) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:11 smithi171 bash[25040]: cluster 2024-09-13T23:35:10.851152+0000 mgr.a (mgr.14355) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:11 smithi007 bash[22722]: cluster 2024-09-13T23:35:10.851152+0000 mgr.a (mgr.14355) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:13.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:13.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:13 smithi131 bash[24745]: cluster 2024-09-13T23:35:12.851897+0000 mgr.a (mgr.14355) 3214 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:13 smithi171 bash[25040]: cluster 2024-09-13T23:35:12.851897+0000 mgr.a (mgr.14355) 3214 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:13 smithi007 bash[22722]: cluster 2024-09-13T23:35:12.851897+0000 mgr.a (mgr.14355) 3214 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:14 smithi131 bash[24745]: audit 2024-09-13T23:35:13.186887+0000 mgr.a (mgr.14355) 3215 : audit [DBG] from='client.80679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:14 smithi171 bash[25040]: audit 2024-09-13T23:35:13.186887+0000 mgr.a (mgr.14355) 3215 : audit [DBG] from='client.80679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:14 smithi007 bash[22722]: audit 2024-09-13T23:35:13.186887+0000 mgr.a (mgr.14355) 3215 : audit [DBG] from='client.80679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:15 smithi131 bash[24745]: cluster 2024-09-13T23:35:14.852747+0000 mgr.a (mgr.14355) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:15 smithi131 bash[24745]: audit 2024-09-13T23:35:15.684346+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:35:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:15 smithi171 bash[25040]: cluster 2024-09-13T23:35:14.852747+0000 mgr.a (mgr.14355) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:15 smithi171 bash[25040]: audit 2024-09-13T23:35:15.684346+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:35:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:15 smithi007 bash[22722]: cluster 2024-09-13T23:35:14.852747+0000 mgr.a (mgr.14355) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:15 smithi007 bash[22722]: audit 2024-09-13T23:35:15.684346+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:35:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:17 smithi131 bash[24745]: cluster 2024-09-13T23:35:16.855027+0000 mgr.a (mgr.14355) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:17 smithi171 bash[25040]: cluster 2024-09-13T23:35:16.855027+0000 mgr.a (mgr.14355) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:17 smithi007 bash[22722]: cluster 2024-09-13T23:35:16.855027+0000 mgr.a (mgr.14355) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:18.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:18.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:19.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:19.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:19 smithi131 bash[24745]: cluster 2024-09-13T23:35:18.855750+0000 mgr.a (mgr.14355) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:19 smithi131 bash[24745]: audit 2024-09-13T23:35:18.945086+0000 mgr.a (mgr.14355) 3219 : audit [DBG] from='client.80757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:19 smithi171 bash[25040]: cluster 2024-09-13T23:35:18.855750+0000 mgr.a (mgr.14355) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:19 smithi171 bash[25040]: audit 2024-09-13T23:35:18.945086+0000 mgr.a (mgr.14355) 3219 : audit [DBG] from='client.80757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:19 smithi007 bash[22722]: cluster 2024-09-13T23:35:18.855750+0000 mgr.a (mgr.14355) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:19 smithi007 bash[22722]: audit 2024-09-13T23:35:18.945086+0000 mgr.a (mgr.14355) 3219 : audit [DBG] from='client.80757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: cluster 2024-09-13T23:35:20.857216+0000 mgr.a (mgr.14355) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.030349+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.034435+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.066284+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.071051+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.076054+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.081527+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.777400+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.778959+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.788926+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:22 smithi131 bash[24745]: audit 2024-09-13T23:35:21.793584+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: cluster 2024-09-13T23:35:20.857216+0000 mgr.a (mgr.14355) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.030349+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.034435+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.066284+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.071051+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.076054+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.081527+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.777400+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.778959+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.788926+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:22 smithi171 bash[25040]: audit 2024-09-13T23:35:21.793584+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: cluster 2024-09-13T23:35:20.857216+0000 mgr.a (mgr.14355) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.030349+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.034435+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.066284+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.071051+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.076054+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.081527+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.777400+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:35:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.778959+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:35:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.788926+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:35:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22722]: audit 2024-09-13T23:35:21.793584+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:22.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22972]: debug 2024-09-13T23:35:22.524+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:35:22.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:35:22 smithi007 bash[22972]: debug 2024-09-13T23:35:22.524+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:35:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:23 smithi171 bash[25040]: audit 2024-09-13T23:35:21.795067+0000 mgr.a (mgr.14355) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:23 smithi007 bash[22722]: audit 2024-09-13T23:35:21.795067+0000 mgr.a (mgr.14355) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:23 smithi131 bash[24745]: audit 2024-09-13T23:35:21.795067+0000 mgr.a (mgr.14355) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:35:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:24 smithi171 bash[25040]: audit 2024-09-13T23:35:22.527989+0000 mgr.a (mgr.14355) 3222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:35:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:24 smithi171 bash[25040]: cephadm 2024-09-13T23:35:22.529416+0000 mgr.a (mgr.14355) 3223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:35:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:24 smithi171 bash[25040]: cluster 2024-09-13T23:35:22.858106+0000 mgr.a (mgr.14355) 3224 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:24.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:24.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:24 smithi007 bash[22722]: audit 2024-09-13T23:35:22.527989+0000 mgr.a (mgr.14355) 3222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:35:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:24 smithi007 bash[22722]: cephadm 2024-09-13T23:35:22.529416+0000 mgr.a (mgr.14355) 3223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:35:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:24 smithi007 bash[22722]: cluster 2024-09-13T23:35:22.858106+0000 mgr.a (mgr.14355) 3224 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:24 smithi131 bash[24745]: audit 2024-09-13T23:35:22.527989+0000 mgr.a (mgr.14355) 3222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:35:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:24 smithi131 bash[24745]: cephadm 2024-09-13T23:35:22.529416+0000 mgr.a (mgr.14355) 3223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:35:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:24 smithi131 bash[24745]: cluster 2024-09-13T23:35:22.858106+0000 mgr.a (mgr.14355) 3224 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:25.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:26 smithi007 bash[22722]: audit 2024-09-13T23:35:24.693331+0000 mgr.a (mgr.14355) 3225 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:26 smithi007 bash[22722]: cluster 2024-09-13T23:35:24.858669+0000 mgr.a (mgr.14355) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:26 smithi131 bash[24745]: audit 2024-09-13T23:35:24.693331+0000 mgr.a (mgr.14355) 3225 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:26 smithi131 bash[24745]: cluster 2024-09-13T23:35:24.858669+0000 mgr.a (mgr.14355) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:26 smithi171 bash[25040]: audit 2024-09-13T23:35:24.693331+0000 mgr.a (mgr.14355) 3225 : audit [DBG] from='client.80937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:26 smithi171 bash[25040]: cluster 2024-09-13T23:35:24.858669+0000 mgr.a (mgr.14355) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:28 smithi007 bash[22722]: cluster 2024-09-13T23:35:26.860974+0000 mgr.a (mgr.14355) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:28 smithi131 bash[24745]: cluster 2024-09-13T23:35:26.860974+0000 mgr.a (mgr.14355) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:28 smithi171 bash[25040]: cluster 2024-09-13T23:35:26.860974+0000 mgr.a (mgr.14355) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:30.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:30.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:30 smithi007 bash[22722]: cluster 2024-09-13T23:35:28.861750+0000 mgr.a (mgr.14355) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:30 smithi131 bash[24745]: cluster 2024-09-13T23:35:28.861750+0000 mgr.a (mgr.14355) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:30 smithi171 bash[25040]: cluster 2024-09-13T23:35:28.861750+0000 mgr.a (mgr.14355) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:30.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:32 smithi007 bash[22722]: audit 2024-09-13T23:35:30.444588+0000 mgr.a (mgr.14355) 3229 : audit [DBG] from='client.81012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:32 smithi007 bash[22722]: cluster 2024-09-13T23:35:30.863161+0000 mgr.a (mgr.14355) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:32 smithi131 bash[24745]: audit 2024-09-13T23:35:30.444588+0000 mgr.a (mgr.14355) 3229 : audit [DBG] from='client.81012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:32 smithi131 bash[24745]: cluster 2024-09-13T23:35:30.863161+0000 mgr.a (mgr.14355) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:32 smithi171 bash[25040]: audit 2024-09-13T23:35:30.444588+0000 mgr.a (mgr.14355) 3229 : audit [DBG] from='client.81012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:32 smithi171 bash[25040]: cluster 2024-09-13T23:35:30.863161+0000 mgr.a (mgr.14355) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:33 smithi007 bash[22722]: cluster 2024-09-13T23:35:32.863902+0000 mgr.a (mgr.14355) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:33 smithi131 bash[24745]: cluster 2024-09-13T23:35:32.863902+0000 mgr.a (mgr.14355) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:33 smithi171 bash[25040]: cluster 2024-09-13T23:35:32.863902+0000 mgr.a (mgr.14355) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:35.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:35.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:35.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:35 smithi007 bash[22722]: cluster 2024-09-13T23:35:34.864647+0000 mgr.a (mgr.14355) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:35 smithi131 bash[24745]: cluster 2024-09-13T23:35:34.864647+0000 mgr.a (mgr.14355) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:35 smithi171 bash[25040]: cluster 2024-09-13T23:35:34.864647+0000 mgr.a (mgr.14355) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:35:36.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:36.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:36.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:36.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:36.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:37 smithi007 bash[22722]: audit 2024-09-13T23:35:36.222635+0000 mgr.a (mgr.14355) 3233 : audit [DBG] from='client.81090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:37 smithi007 bash[22722]: cluster 2024-09-13T23:35:36.867380+0000 mgr.a (mgr.14355) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:37 smithi131 bash[24745]: audit 2024-09-13T23:35:36.222635+0000 mgr.a (mgr.14355) 3233 : audit [DBG] from='client.81090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:37 smithi131 bash[24745]: cluster 2024-09-13T23:35:36.867380+0000 mgr.a (mgr.14355) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:37 smithi171 bash[25040]: audit 2024-09-13T23:35:36.222635+0000 mgr.a (mgr.14355) 3233 : audit [DBG] from='client.81090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:37 smithi171 bash[25040]: cluster 2024-09-13T23:35:36.867380+0000 mgr.a (mgr.14355) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:35:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:39 smithi007 bash[22722]: cluster 2024-09-13T23:35:38.868176+0000 mgr.a (mgr.14355) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:39 smithi131 bash[24745]: cluster 2024-09-13T23:35:38.868176+0000 mgr.a (mgr.14355) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:39 smithi171 bash[25040]: cluster 2024-09-13T23:35:38.868176+0000 mgr.a (mgr.14355) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:35:41.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:41.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:41.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:41 smithi007 bash[22722]: cluster 2024-09-13T23:35:40.870242+0000 mgr.a (mgr.14355) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:41 smithi131 bash[24745]: cluster 2024-09-13T23:35:40.870242+0000 mgr.a (mgr.14355) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:41 smithi171 bash[25040]: cluster 2024-09-13T23:35:40.870242+0000 mgr.a (mgr.14355) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:42.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:42.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:42.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:42.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:42.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:42 smithi007 bash[22722]: audit 2024-09-13T23:35:42.000702+0000 mgr.a (mgr.14355) 3237 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:42 smithi131 bash[24745]: audit 2024-09-13T23:35:42.000702+0000 mgr.a (mgr.14355) 3237 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:42 smithi171 bash[25040]: audit 2024-09-13T23:35:42.000702+0000 mgr.a (mgr.14355) 3237 : audit [DBG] from='client.81162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:43 smithi007 bash[22722]: cluster 2024-09-13T23:35:42.871182+0000 mgr.a (mgr.14355) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:43 smithi131 bash[24745]: cluster 2024-09-13T23:35:42.871182+0000 mgr.a (mgr.14355) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:43 smithi171 bash[25040]: cluster 2024-09-13T23:35:42.871182+0000 mgr.a (mgr.14355) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:45 smithi007 bash[22722]: cluster 2024-09-13T23:35:44.871958+0000 mgr.a (mgr.14355) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:45 smithi131 bash[24745]: cluster 2024-09-13T23:35:44.871958+0000 mgr.a (mgr.14355) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:45 smithi171 bash[25040]: cluster 2024-09-13T23:35:44.871958+0000 mgr.a (mgr.14355) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:47.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:47.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:48.200 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:48.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:47 smithi131 bash[24745]: cluster 2024-09-13T23:35:46.874196+0000 mgr.a (mgr.14355) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:47 smithi171 bash[25040]: cluster 2024-09-13T23:35:46.874196+0000 mgr.a (mgr.14355) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:47 smithi007 bash[22722]: cluster 2024-09-13T23:35:46.874196+0000 mgr.a (mgr.14355) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:48 smithi131 bash[24745]: audit 2024-09-13T23:35:47.767415+0000 mgr.a (mgr.14355) 3241 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:48 smithi171 bash[25040]: audit 2024-09-13T23:35:47.767415+0000 mgr.a (mgr.14355) 3241 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:48 smithi007 bash[22722]: audit 2024-09-13T23:35:47.767415+0000 mgr.a (mgr.14355) 3241 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:49 smithi131 bash[24745]: cluster 2024-09-13T23:35:48.875166+0000 mgr.a (mgr.14355) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:49 smithi171 bash[25040]: cluster 2024-09-13T23:35:48.875166+0000 mgr.a (mgr.14355) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:49 smithi007 bash[22722]: cluster 2024-09-13T23:35:48.875166+0000 mgr.a (mgr.14355) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:51 smithi131 bash[24745]: cluster 2024-09-13T23:35:50.877393+0000 mgr.a (mgr.14355) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:51 smithi171 bash[25040]: cluster 2024-09-13T23:35:50.877393+0000 mgr.a (mgr.14355) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:51 smithi007 bash[22722]: cluster 2024-09-13T23:35:50.877393+0000 mgr.a (mgr.14355) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:53.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:53.203 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:53.967 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:35:53.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:53.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:53.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:53.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:53 smithi131 bash[24745]: cluster 2024-09-13T23:35:52.878217+0000 mgr.a (mgr.14355) 3244 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:53 smithi171 bash[25040]: cluster 2024-09-13T23:35:52.878217+0000 mgr.a (mgr.14355) 3244 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:53 smithi007 bash[22722]: cluster 2024-09-13T23:35:52.878217+0000 mgr.a (mgr.14355) 3244 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:54 smithi131 bash[24745]: audit 2024-09-13T23:35:53.535169+0000 mgr.a (mgr.14355) 3245 : audit [DBG] from='client.81309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:54 smithi171 bash[25040]: audit 2024-09-13T23:35:53.535169+0000 mgr.a (mgr.14355) 3245 : audit [DBG] from='client.81309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:54 smithi007 bash[22722]: audit 2024-09-13T23:35:53.535169+0000 mgr.a (mgr.14355) 3245 : audit [DBG] from='client.81309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:35:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:55 smithi131 bash[24745]: cluster 2024-09-13T23:35:54.879098+0000 mgr.a (mgr.14355) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:55 smithi171 bash[25040]: cluster 2024-09-13T23:35:54.879098+0000 mgr.a (mgr.14355) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:55 smithi007 bash[22722]: cluster 2024-09-13T23:35:54.879098+0000 mgr.a (mgr.14355) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:35:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:57 smithi131 bash[24745]: cluster 2024-09-13T23:35:56.881466+0000 mgr.a (mgr.14355) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:57 smithi171 bash[25040]: cluster 2024-09-13T23:35:56.881466+0000 mgr.a (mgr.14355) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:57 smithi007 bash[22722]: cluster 2024-09-13T23:35:56.881466+0000 mgr.a (mgr.14355) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:35:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:35:58.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:35:58.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:35:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:35:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:35:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:35:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:35:59.729 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:35:59 smithi131 bash[24745]: cluster 2024-09-13T23:35:58.882269+0000 mgr.a (mgr.14355) 3248 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:35:59 smithi171 bash[25040]: cluster 2024-09-13T23:35:58.882269+0000 mgr.a (mgr.14355) 3248 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:35:59 smithi007 bash[22722]: cluster 2024-09-13T23:35:58.882269+0000 mgr.a (mgr.14355) 3248 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:01 smithi131 bash[24745]: audit 2024-09-13T23:35:59.302694+0000 mgr.a (mgr.14355) 3249 : audit [DBG] from='client.81387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:01 smithi171 bash[25040]: audit 2024-09-13T23:35:59.302694+0000 mgr.a (mgr.14355) 3249 : audit [DBG] from='client.81387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:01 smithi007 bash[22722]: audit 2024-09-13T23:35:59.302694+0000 mgr.a (mgr.14355) 3249 : audit [DBG] from='client.81387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:02 smithi131 bash[24745]: cluster 2024-09-13T23:36:00.884594+0000 mgr.a (mgr.14355) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:02 smithi171 bash[25040]: cluster 2024-09-13T23:36:00.884594+0000 mgr.a (mgr.14355) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:02 smithi007 bash[22722]: cluster 2024-09-13T23:36:00.884594+0000 mgr.a (mgr.14355) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:04 smithi131 bash[24745]: cluster 2024-09-13T23:36:02.885368+0000 mgr.a (mgr.14355) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:04 smithi171 bash[25040]: cluster 2024-09-13T23:36:02.885368+0000 mgr.a (mgr.14355) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:04 smithi007 bash[22722]: cluster 2024-09-13T23:36:02.885368+0000 mgr.a (mgr.14355) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:04.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:05.487 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:05.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:05.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:05.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:05.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:06 smithi131 bash[24745]: cluster 2024-09-13T23:36:04.886189+0000 mgr.a (mgr.14355) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:06 smithi131 bash[24745]: audit 2024-09-13T23:36:05.060513+0000 mgr.a (mgr.14355) 3253 : audit [DBG] from='client.81465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:06 smithi171 bash[25040]: cluster 2024-09-13T23:36:04.886189+0000 mgr.a (mgr.14355) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:06 smithi171 bash[25040]: audit 2024-09-13T23:36:05.060513+0000 mgr.a (mgr.14355) 3253 : audit [DBG] from='client.81465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:06 smithi007 bash[22722]: cluster 2024-09-13T23:36:04.886189+0000 mgr.a (mgr.14355) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:06 smithi007 bash[22722]: audit 2024-09-13T23:36:05.060513+0000 mgr.a (mgr.14355) 3253 : audit [DBG] from='client.81465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:08 smithi131 bash[24745]: cluster 2024-09-13T23:36:06.888877+0000 mgr.a (mgr.14355) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:36:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:08 smithi171 bash[25040]: cluster 2024-09-13T23:36:06.888877+0000 mgr.a (mgr.14355) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:36:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:08 smithi007 bash[22722]: cluster 2024-09-13T23:36:06.888877+0000 mgr.a (mgr.14355) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:36:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:10 smithi131 bash[24745]: cluster 2024-09-13T23:36:08.889656+0000 mgr.a (mgr.14355) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:36:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:10 smithi171 bash[25040]: cluster 2024-09-13T23:36:08.889656+0000 mgr.a (mgr.14355) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:36:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:10 smithi007 bash[22722]: cluster 2024-09-13T23:36:08.889656+0000 mgr.a (mgr.14355) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:36:10.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:10.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:10.490 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:11.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:11.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:11.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:11.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:11.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:12 smithi131 bash[24745]: audit 2024-09-13T23:36:10.822541+0000 mgr.a (mgr.14355) 3256 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:12 smithi131 bash[24745]: cluster 2024-09-13T23:36:10.891002+0000 mgr.a (mgr.14355) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:12 smithi171 bash[25040]: audit 2024-09-13T23:36:10.822541+0000 mgr.a (mgr.14355) 3256 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:12 smithi171 bash[25040]: cluster 2024-09-13T23:36:10.891002+0000 mgr.a (mgr.14355) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:12 smithi007 bash[22722]: audit 2024-09-13T23:36:10.822541+0000 mgr.a (mgr.14355) 3256 : audit [DBG] from='client.81543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:12 smithi007 bash[22722]: cluster 2024-09-13T23:36:10.891002+0000 mgr.a (mgr.14355) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:14 smithi131 bash[24745]: cluster 2024-09-13T23:36:12.892023+0000 mgr.a (mgr.14355) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:14 smithi171 bash[25040]: cluster 2024-09-13T23:36:12.892023+0000 mgr.a (mgr.14355) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:14 smithi007 bash[22722]: cluster 2024-09-13T23:36:12.892023+0000 mgr.a (mgr.14355) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:16.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:16.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:16 smithi171 bash[25040]: cluster 2024-09-13T23:36:14.892985+0000 mgr.a (mgr.14355) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:16 smithi007 bash[22722]: cluster 2024-09-13T23:36:14.892985+0000 mgr.a (mgr.14355) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:16 smithi131 bash[24745]: cluster 2024-09-13T23:36:14.892985+0000 mgr.a (mgr.14355) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:17.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:18 smithi171 bash[25040]: audit 2024-09-13T23:36:16.569136+0000 mgr.a (mgr.14355) 3260 : audit [DBG] from='client.81621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:18 smithi171 bash[25040]: cluster 2024-09-13T23:36:16.894255+0000 mgr.a (mgr.14355) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:18 smithi007 bash[22722]: audit 2024-09-13T23:36:16.569136+0000 mgr.a (mgr.14355) 3260 : audit [DBG] from='client.81621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:18 smithi007 bash[22722]: cluster 2024-09-13T23:36:16.894255+0000 mgr.a (mgr.14355) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:18 smithi131 bash[24745]: audit 2024-09-13T23:36:16.569136+0000 mgr.a (mgr.14355) 3260 : audit [DBG] from='client.81621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:18 smithi131 bash[24745]: cluster 2024-09-13T23:36:16.894255+0000 mgr.a (mgr.14355) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:20 smithi171 bash[25040]: cluster 2024-09-13T23:36:18.895060+0000 mgr.a (mgr.14355) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:36:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:20 smithi007 bash[22722]: cluster 2024-09-13T23:36:18.895060+0000 mgr.a (mgr.14355) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:36:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:20 smithi131 bash[24745]: cluster 2024-09-13T23:36:18.895060+0000 mgr.a (mgr.14355) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-13T23:36:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:22 smithi007 bash[22722]: cluster 2024-09-13T23:36:20.897214+0000 mgr.a (mgr.14355) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:36:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:22 smithi131 bash[24745]: cluster 2024-09-13T23:36:20.897214+0000 mgr.a (mgr.14355) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:36:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:22 smithi171 bash[25040]: cluster 2024-09-13T23:36:20.897214+0000 mgr.a (mgr.14355) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:36:22.770 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:22.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:22.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:22.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:23 smithi007 bash[22722]: audit 2024-09-13T23:36:22.583988+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:36:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:23 smithi131 bash[24745]: audit 2024-09-13T23:36:22.583988+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:36:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:23 smithi171 bash[25040]: audit 2024-09-13T23:36:22.583988+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:36:24.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22972]: debug 2024-09-13T23:36:24.091+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:36:24.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22972]: debug 2024-09-13T23:36:24.091+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: audit 2024-09-13T23:36:22.334094+0000 mgr.a (mgr.14355) 3264 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: cluster 2024-09-13T23:36:22.898128+0000 mgr.a (mgr.14355) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: audit 2024-09-13T23:36:23.361531+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: audit 2024-09-13T23:36:23.363471+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: audit 2024-09-13T23:36:23.374171+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:36:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:24 smithi007 bash[22722]: audit 2024-09-13T23:36:23.379600+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: audit 2024-09-13T23:36:22.334094+0000 mgr.a (mgr.14355) 3264 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: cluster 2024-09-13T23:36:22.898128+0000 mgr.a (mgr.14355) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: audit 2024-09-13T23:36:23.361531+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:36:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: audit 2024-09-13T23:36:23.363471+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:36:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: audit 2024-09-13T23:36:23.374171+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:36:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:24 smithi131 bash[24745]: audit 2024-09-13T23:36:23.379600+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: audit 2024-09-13T23:36:22.334094+0000 mgr.a (mgr.14355) 3264 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: cluster 2024-09-13T23:36:22.898128+0000 mgr.a (mgr.14355) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: audit 2024-09-13T23:36:23.361531+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:36:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: audit 2024-09-13T23:36:23.363471+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:36:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: audit 2024-09-13T23:36:23.374171+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:36:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:24 smithi171 bash[25040]: audit 2024-09-13T23:36:23.379600+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:25 smithi007 bash[22722]: audit 2024-09-13T23:36:23.381997+0000 mgr.a (mgr.14355) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:25 smithi131 bash[24745]: audit 2024-09-13T23:36:23.381997+0000 mgr.a (mgr.14355) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:25 smithi171 bash[25040]: audit 2024-09-13T23:36:23.381997+0000 mgr.a (mgr.14355) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:36:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:26 smithi007 bash[22722]: audit 2024-09-13T23:36:24.096779+0000 mgr.a (mgr.14355) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:36:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:26 smithi007 bash[22722]: cephadm 2024-09-13T23:36:24.098051+0000 mgr.a (mgr.14355) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:36:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:26 smithi007 bash[22722]: cluster 2024-09-13T23:36:24.899102+0000 mgr.a (mgr.14355) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:26 smithi131 bash[24745]: audit 2024-09-13T23:36:24.096779+0000 mgr.a (mgr.14355) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:36:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:26 smithi131 bash[24745]: cephadm 2024-09-13T23:36:24.098051+0000 mgr.a (mgr.14355) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:36:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:26 smithi131 bash[24745]: cluster 2024-09-13T23:36:24.899102+0000 mgr.a (mgr.14355) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:26 smithi171 bash[25040]: audit 2024-09-13T23:36:24.096779+0000 mgr.a (mgr.14355) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:36:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:26 smithi171 bash[25040]: cephadm 2024-09-13T23:36:24.098051+0000 mgr.a (mgr.14355) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:36:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:26 smithi171 bash[25040]: cluster 2024-09-13T23:36:24.899102+0000 mgr.a (mgr.14355) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:27.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:27.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:27.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:28 smithi007 bash[22722]: cluster 2024-09-13T23:36:26.901473+0000 mgr.a (mgr.14355) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:28 smithi131 bash[24745]: cluster 2024-09-13T23:36:26.901473+0000 mgr.a (mgr.14355) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:28.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:28 smithi171 bash[25040]: cluster 2024-09-13T23:36:26.901473+0000 mgr.a (mgr.14355) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:30 smithi007 bash[22722]: audit 2024-09-13T23:36:28.111108+0000 mgr.a (mgr.14355) 3271 : audit [DBG] from='client.81879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:30 smithi007 bash[22722]: cluster 2024-09-13T23:36:28.902479+0000 mgr.a (mgr.14355) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:30 smithi131 bash[24745]: audit 2024-09-13T23:36:28.111108+0000 mgr.a (mgr.14355) 3271 : audit [DBG] from='client.81879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:30 smithi131 bash[24745]: cluster 2024-09-13T23:36:28.902479+0000 mgr.a (mgr.14355) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:30 smithi171 bash[25040]: audit 2024-09-13T23:36:28.111108+0000 mgr.a (mgr.14355) 3271 : audit [DBG] from='client.81879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:30 smithi171 bash[25040]: cluster 2024-09-13T23:36:28.902479+0000 mgr.a (mgr.14355) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:31 smithi007 bash[22722]: cluster 2024-09-13T23:36:30.904661+0000 mgr.a (mgr.14355) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:31 smithi131 bash[24745]: cluster 2024-09-13T23:36:30.904661+0000 mgr.a (mgr.14355) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:31 smithi171 bash[25040]: cluster 2024-09-13T23:36:30.904661+0000 mgr.a (mgr.14355) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:33 smithi131 bash[24745]: cluster 2024-09-13T23:36:32.905447+0000 mgr.a (mgr.14355) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:34.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:34.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:33 smithi171 bash[25040]: cluster 2024-09-13T23:36:32.905447+0000 mgr.a (mgr.14355) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:33 smithi007 bash[22722]: cluster 2024-09-13T23:36:32.905447+0000 mgr.a (mgr.14355) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:34 smithi131 bash[24745]: audit 2024-09-13T23:36:33.877002+0000 mgr.a (mgr.14355) 3275 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:34 smithi171 bash[25040]: audit 2024-09-13T23:36:33.877002+0000 mgr.a (mgr.14355) 3275 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:34 smithi007 bash[22722]: audit 2024-09-13T23:36:33.877002+0000 mgr.a (mgr.14355) 3275 : audit [DBG] from='client.81954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:35 smithi131 bash[24745]: cluster 2024-09-13T23:36:34.906422+0000 mgr.a (mgr.14355) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:35 smithi171 bash[25040]: cluster 2024-09-13T23:36:34.906422+0000 mgr.a (mgr.14355) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:35 smithi007 bash[22722]: cluster 2024-09-13T23:36:34.906422+0000 mgr.a (mgr.14355) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:37 smithi131 bash[24745]: cluster 2024-09-13T23:36:36.908619+0000 mgr.a (mgr.14355) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:37 smithi171 bash[25040]: cluster 2024-09-13T23:36:36.908619+0000 mgr.a (mgr.14355) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:37 smithi007 bash[22722]: cluster 2024-09-13T23:36:36.908619+0000 mgr.a (mgr.14355) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:36:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:39.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:40.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:39 smithi131 bash[24745]: cluster 2024-09-13T23:36:38.909400+0000 mgr.a (mgr.14355) 3278 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:39 smithi171 bash[25040]: cluster 2024-09-13T23:36:38.909400+0000 mgr.a (mgr.14355) 3278 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:39 smithi007 bash[22722]: cluster 2024-09-13T23:36:38.909400+0000 mgr.a (mgr.14355) 3278 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:40 smithi131 bash[24745]: audit 2024-09-13T23:36:39.630080+0000 mgr.a (mgr.14355) 3279 : audit [DBG] from='client.82026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:40 smithi171 bash[25040]: audit 2024-09-13T23:36:39.630080+0000 mgr.a (mgr.14355) 3279 : audit [DBG] from='client.82026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:40 smithi007 bash[22722]: audit 2024-09-13T23:36:39.630080+0000 mgr.a (mgr.14355) 3279 : audit [DBG] from='client.82026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:41 smithi131 bash[24745]: cluster 2024-09-13T23:36:40.911894+0000 mgr.a (mgr.14355) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:41 smithi171 bash[25040]: cluster 2024-09-13T23:36:40.911894+0000 mgr.a (mgr.14355) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:41 smithi007 bash[22722]: cluster 2024-09-13T23:36:40.911894+0000 mgr.a (mgr.14355) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:36:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:43 smithi131 bash[24745]: cluster 2024-09-13T23:36:42.912877+0000 mgr.a (mgr.14355) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:43 smithi171 bash[25040]: cluster 2024-09-13T23:36:42.912877+0000 mgr.a (mgr.14355) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:43 smithi007 bash[22722]: cluster 2024-09-13T23:36:42.912877+0000 mgr.a (mgr.14355) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:45.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:45.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:45.840 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:45.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:46 smithi131 bash[24745]: cluster 2024-09-13T23:36:44.913811+0000 mgr.a (mgr.14355) 3282 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:46 smithi171 bash[25040]: cluster 2024-09-13T23:36:44.913811+0000 mgr.a (mgr.14355) 3282 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:46 smithi007 bash[22722]: cluster 2024-09-13T23:36:44.913811+0000 mgr.a (mgr.14355) 3282 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:47 smithi131 bash[24745]: audit 2024-09-13T23:36:45.405144+0000 mgr.a (mgr.14355) 3283 : audit [DBG] from='client.46255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:47 smithi171 bash[25040]: audit 2024-09-13T23:36:45.405144+0000 mgr.a (mgr.14355) 3283 : audit [DBG] from='client.46255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:47 smithi007 bash[22722]: audit 2024-09-13T23:36:45.405144+0000 mgr.a (mgr.14355) 3283 : audit [DBG] from='client.46255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:48 smithi131 bash[24745]: cluster 2024-09-13T23:36:46.916686+0000 mgr.a (mgr.14355) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:48 smithi171 bash[25040]: cluster 2024-09-13T23:36:46.916686+0000 mgr.a (mgr.14355) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:48 smithi007 bash[22722]: cluster 2024-09-13T23:36:46.916686+0000 mgr.a (mgr.14355) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:50 smithi131 bash[24745]: cluster 2024-09-13T23:36:48.917479+0000 mgr.a (mgr.14355) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:50 smithi171 bash[25040]: cluster 2024-09-13T23:36:48.917479+0000 mgr.a (mgr.14355) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:50 smithi007 bash[22722]: cluster 2024-09-13T23:36:48.917479+0000 mgr.a (mgr.14355) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:51.606 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:51.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:51 smithi131 bash[24745]: cluster 2024-09-13T23:36:50.919484+0000 mgr.a (mgr.14355) 3286 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:51 smithi171 bash[25040]: cluster 2024-09-13T23:36:50.919484+0000 mgr.a (mgr.14355) 3286 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:51 smithi007 bash[22722]: cluster 2024-09-13T23:36:50.919484+0000 mgr.a (mgr.14355) 3286 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:52 smithi131 bash[24745]: audit 2024-09-13T23:36:51.179752+0000 mgr.a (mgr.14355) 3287 : audit [DBG] from='client.82179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:52 smithi171 bash[25040]: audit 2024-09-13T23:36:51.179752+0000 mgr.a (mgr.14355) 3287 : audit [DBG] from='client.82179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:52 smithi007 bash[22722]: audit 2024-09-13T23:36:51.179752+0000 mgr.a (mgr.14355) 3287 : audit [DBG] from='client.82179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:53 smithi131 bash[24745]: cluster 2024-09-13T23:36:52.920465+0000 mgr.a (mgr.14355) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:53 smithi171 bash[25040]: cluster 2024-09-13T23:36:52.920465+0000 mgr.a (mgr.14355) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:53 smithi007 bash[22722]: cluster 2024-09-13T23:36:52.920465+0000 mgr.a (mgr.14355) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:36:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:55 smithi131 bash[24745]: cluster 2024-09-13T23:36:54.921240+0000 mgr.a (mgr.14355) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:55 smithi171 bash[25040]: cluster 2024-09-13T23:36:54.921240+0000 mgr.a (mgr.14355) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:55 smithi007 bash[22722]: cluster 2024-09-13T23:36:54.921240+0000 mgr.a (mgr.14355) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:36:56.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:36:56.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:36:56.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:36:57.349 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:36:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:36:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:36:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:36:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:36:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:57 smithi131 bash[24745]: cluster 2024-09-13T23:36:56.923406+0000 mgr.a (mgr.14355) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:57 smithi131 bash[24745]: audit 2024-09-13T23:36:56.943995+0000 mgr.a (mgr.14355) 3291 : audit [DBG] from='client.82257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:57 smithi171 bash[25040]: cluster 2024-09-13T23:36:56.923406+0000 mgr.a (mgr.14355) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:57 smithi171 bash[25040]: audit 2024-09-13T23:36:56.943995+0000 mgr.a (mgr.14355) 3291 : audit [DBG] from='client.82257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:36:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:57 smithi007 bash[22722]: cluster 2024-09-13T23:36:56.923406+0000 mgr.a (mgr.14355) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:36:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:57 smithi007 bash[22722]: audit 2024-09-13T23:36:56.943995+0000 mgr.a (mgr.14355) 3291 : audit [DBG] from='client.82257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:36:59 smithi131 bash[24745]: cluster 2024-09-13T23:36:58.924332+0000 mgr.a (mgr.14355) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:36:59 smithi171 bash[25040]: cluster 2024-09-13T23:36:58.924332+0000 mgr.a (mgr.14355) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:36:59 smithi007 bash[22722]: cluster 2024-09-13T23:36:58.924332+0000 mgr.a (mgr.14355) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:01 smithi131 bash[24745]: cluster 2024-09-13T23:37:00.926574+0000 mgr.a (mgr.14355) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:01 smithi171 bash[25040]: cluster 2024-09-13T23:37:00.926574+0000 mgr.a (mgr.14355) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:02.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:02.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:02.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:01 smithi007 bash[22722]: cluster 2024-09-13T23:37:00.926574+0000 mgr.a (mgr.14355) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:03.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:03.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:03.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:03.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:03.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:03 smithi131 bash[24745]: audit 2024-09-13T23:37:02.683633+0000 mgr.a (mgr.14355) 3294 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:03 smithi131 bash[24745]: cluster 2024-09-13T23:37:02.927274+0000 mgr.a (mgr.14355) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:03 smithi171 bash[25040]: audit 2024-09-13T23:37:02.683633+0000 mgr.a (mgr.14355) 3294 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:03 smithi171 bash[25040]: cluster 2024-09-13T23:37:02.927274+0000 mgr.a (mgr.14355) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:03 smithi007 bash[22722]: audit 2024-09-13T23:37:02.683633+0000 mgr.a (mgr.14355) 3294 : audit [DBG] from='client.82335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:03 smithi007 bash[22722]: cluster 2024-09-13T23:37:02.927274+0000 mgr.a (mgr.14355) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:05 smithi131 bash[24745]: cluster 2024-09-13T23:37:04.928294+0000 mgr.a (mgr.14355) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:05 smithi171 bash[25040]: cluster 2024-09-13T23:37:04.928294+0000 mgr.a (mgr.14355) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:05 smithi007 bash[22722]: cluster 2024-09-13T23:37:04.928294+0000 mgr.a (mgr.14355) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:08.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:08.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:08 smithi131 bash[24745]: cluster 2024-09-13T23:37:06.930745+0000 mgr.a (mgr.14355) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:08 smithi171 bash[25040]: cluster 2024-09-13T23:37:06.930745+0000 mgr.a (mgr.14355) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:08 smithi007 bash[22722]: cluster 2024-09-13T23:37:06.930745+0000 mgr.a (mgr.14355) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:08.862 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:08.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:08.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:10 smithi131 bash[24745]: audit 2024-09-13T23:37:08.430117+0000 mgr.a (mgr.14355) 3298 : audit [DBG] from='client.82413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:10 smithi131 bash[24745]: cluster 2024-09-13T23:37:08.931351+0000 mgr.a (mgr.14355) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:10 smithi171 bash[25040]: audit 2024-09-13T23:37:08.430117+0000 mgr.a (mgr.14355) 3298 : audit [DBG] from='client.82413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:10 smithi171 bash[25040]: cluster 2024-09-13T23:37:08.931351+0000 mgr.a (mgr.14355) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:10 smithi007 bash[22722]: audit 2024-09-13T23:37:08.430117+0000 mgr.a (mgr.14355) 3298 : audit [DBG] from='client.82413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:10 smithi007 bash[22722]: cluster 2024-09-13T23:37:08.931351+0000 mgr.a (mgr.14355) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:12 smithi131 bash[24745]: cluster 2024-09-13T23:37:10.933497+0000 mgr.a (mgr.14355) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:12 smithi171 bash[25040]: cluster 2024-09-13T23:37:10.933497+0000 mgr.a (mgr.14355) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:12 smithi007 bash[22722]: cluster 2024-09-13T23:37:10.933497+0000 mgr.a (mgr.14355) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:13.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:14 smithi131 bash[24745]: cluster 2024-09-13T23:37:12.934337+0000 mgr.a (mgr.14355) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:14 smithi171 bash[25040]: cluster 2024-09-13T23:37:12.934337+0000 mgr.a (mgr.14355) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:14 smithi007 bash[22722]: cluster 2024-09-13T23:37:12.934337+0000 mgr.a (mgr.14355) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:14.618 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:14.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:16 smithi131 bash[24745]: audit 2024-09-13T23:37:14.197696+0000 mgr.a (mgr.14355) 3302 : audit [DBG] from='client.82488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:16 smithi131 bash[24745]: cluster 2024-09-13T23:37:14.935420+0000 mgr.a (mgr.14355) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:16 smithi171 bash[25040]: audit 2024-09-13T23:37:14.197696+0000 mgr.a (mgr.14355) 3302 : audit [DBG] from='client.82488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:16 smithi171 bash[25040]: cluster 2024-09-13T23:37:14.935420+0000 mgr.a (mgr.14355) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:16 smithi007 bash[22722]: audit 2024-09-13T23:37:14.197696+0000 mgr.a (mgr.14355) 3302 : audit [DBG] from='client.82488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:16 smithi007 bash[22722]: cluster 2024-09-13T23:37:14.935420+0000 mgr.a (mgr.14355) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:18 smithi131 bash[24745]: cluster 2024-09-13T23:37:16.937868+0000 mgr.a (mgr.14355) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:18 smithi171 bash[25040]: cluster 2024-09-13T23:37:16.937868+0000 mgr.a (mgr.14355) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:18 smithi007 bash[22722]: cluster 2024-09-13T23:37:16.937868+0000 mgr.a (mgr.14355) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:19.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:20 smithi131 bash[24745]: cluster 2024-09-13T23:37:18.938779+0000 mgr.a (mgr.14355) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:20 smithi171 bash[25040]: cluster 2024-09-13T23:37:18.938779+0000 mgr.a (mgr.14355) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:20.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:20.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:20 smithi007 bash[22722]: cluster 2024-09-13T23:37:18.938779+0000 mgr.a (mgr.14355) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:21 smithi171 bash[25040]: audit 2024-09-13T23:37:19.962256+0000 mgr.a (mgr.14355) 3306 : audit [DBG] from='client.82566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:21 smithi007 bash[22722]: audit 2024-09-13T23:37:19.962256+0000 mgr.a (mgr.14355) 3306 : audit [DBG] from='client.82566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:21.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:21 smithi131 bash[24745]: audit 2024-09-13T23:37:19.962256+0000 mgr.a (mgr.14355) 3306 : audit [DBG] from='client.82566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:22 smithi171 bash[25040]: cluster 2024-09-13T23:37:20.941434+0000 mgr.a (mgr.14355) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:37:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:22 smithi007 bash[22722]: cluster 2024-09-13T23:37:20.941434+0000 mgr.a (mgr.14355) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:37:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:22 smithi131 bash[24745]: cluster 2024-09-13T23:37:20.941434+0000 mgr.a (mgr.14355) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:37:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:24 smithi171 bash[25040]: cluster 2024-09-13T23:37:22.942281+0000 mgr.a (mgr.14355) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:24 smithi007 bash[22722]: cluster 2024-09-13T23:37:22.942281+0000 mgr.a (mgr.14355) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:24 smithi131 bash[24745]: cluster 2024-09-13T23:37:22.942281+0000 mgr.a (mgr.14355) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22722]: audit 2024-09-13T23:37:24.159193+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22722]: audit 2024-09-13T23:37:25.019715+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22722]: audit 2024-09-13T23:37:25.021474+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22722]: audit 2024-09-13T23:37:25.032134+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22722]: audit 2024-09-13T23:37:25.036904+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:25 smithi131 bash[24745]: audit 2024-09-13T23:37:24.159193+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:25 smithi131 bash[24745]: audit 2024-09-13T23:37:25.019715+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:25 smithi131 bash[24745]: audit 2024-09-13T23:37:25.021474+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:25 smithi131 bash[24745]: audit 2024-09-13T23:37:25.032134+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:25 smithi131 bash[24745]: audit 2024-09-13T23:37:25.036904+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:25 smithi171 bash[25040]: audit 2024-09-13T23:37:24.159193+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:37:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:25 smithi171 bash[25040]: audit 2024-09-13T23:37:25.019715+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:37:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:25 smithi171 bash[25040]: audit 2024-09-13T23:37:25.021474+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:37:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:25 smithi171 bash[25040]: audit 2024-09-13T23:37:25.032134+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:37:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:25 smithi171 bash[25040]: audit 2024-09-13T23:37:25.036904+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:26.053 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22972]: debug 2024-09-13T23:37:25.762+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:37:26.053 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:37:25 smithi007 bash[22972]: debug 2024-09-13T23:37:25.774+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:37:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:26.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:26.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:26.160 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:26.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:26 smithi007 bash[22722]: cluster 2024-09-13T23:37:24.943171+0000 mgr.a (mgr.14355) 3309 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:26.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:26 smithi007 bash[22722]: audit 2024-09-13T23:37:25.039151+0000 mgr.a (mgr.14355) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:26 smithi131 bash[24745]: cluster 2024-09-13T23:37:24.943171+0000 mgr.a (mgr.14355) 3309 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:26 smithi131 bash[24745]: audit 2024-09-13T23:37:25.039151+0000 mgr.a (mgr.14355) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:26 smithi171 bash[25040]: cluster 2024-09-13T23:37:24.943171+0000 mgr.a (mgr.14355) 3309 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:37:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:26 smithi171 bash[25040]: audit 2024-09-13T23:37:25.039151+0000 mgr.a (mgr.14355) 3310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:37:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:27 smithi007 bash[22722]: audit 2024-09-13T23:37:25.739280+0000 mgr.a (mgr.14355) 3311 : audit [DBG] from='client.82716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:27 smithi007 bash[22722]: audit 2024-09-13T23:37:25.769516+0000 mgr.a (mgr.14355) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:37:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:27 smithi007 bash[22722]: cephadm 2024-09-13T23:37:25.779540+0000 mgr.a (mgr.14355) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:37:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:27 smithi131 bash[24745]: audit 2024-09-13T23:37:25.739280+0000 mgr.a (mgr.14355) 3311 : audit [DBG] from='client.82716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:27 smithi131 bash[24745]: audit 2024-09-13T23:37:25.769516+0000 mgr.a (mgr.14355) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:37:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:27 smithi131 bash[24745]: cephadm 2024-09-13T23:37:25.779540+0000 mgr.a (mgr.14355) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:37:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:27 smithi171 bash[25040]: audit 2024-09-13T23:37:25.739280+0000 mgr.a (mgr.14355) 3311 : audit [DBG] from='client.82716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:27 smithi171 bash[25040]: audit 2024-09-13T23:37:25.769516+0000 mgr.a (mgr.14355) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:37:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:27 smithi171 bash[25040]: cephadm 2024-09-13T23:37:25.779540+0000 mgr.a (mgr.14355) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:37:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:28 smithi007 bash[22722]: cluster 2024-09-13T23:37:26.946024+0000 mgr.a (mgr.14355) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:28 smithi131 bash[24745]: cluster 2024-09-13T23:37:26.946024+0000 mgr.a (mgr.14355) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:28 smithi171 bash[25040]: cluster 2024-09-13T23:37:26.946024+0000 mgr.a (mgr.14355) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:30 smithi007 bash[22722]: cluster 2024-09-13T23:37:28.946883+0000 mgr.a (mgr.14355) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:37:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:30 smithi131 bash[24745]: cluster 2024-09-13T23:37:28.946883+0000 mgr.a (mgr.14355) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:37:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:30 smithi171 bash[25040]: cluster 2024-09-13T23:37:28.946883+0000 mgr.a (mgr.14355) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:37:31.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:31.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:31.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:32 smithi007 bash[22722]: cluster 2024-09-13T23:37:30.948816+0000 mgr.a (mgr.14355) 3316 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:32 smithi131 bash[24745]: cluster 2024-09-13T23:37:30.948816+0000 mgr.a (mgr.14355) 3316 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:32 smithi171 bash[25040]: cluster 2024-09-13T23:37:30.948816+0000 mgr.a (mgr.14355) 3316 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:33 smithi007 bash[22722]: audit 2024-09-13T23:37:31.493354+0000 mgr.a (mgr.14355) 3317 : audit [DBG] from='client.82827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:33 smithi131 bash[24745]: audit 2024-09-13T23:37:31.493354+0000 mgr.a (mgr.14355) 3317 : audit [DBG] from='client.82827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:33 smithi171 bash[25040]: audit 2024-09-13T23:37:31.493354+0000 mgr.a (mgr.14355) 3317 : audit [DBG] from='client.82827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:34 smithi007 bash[22722]: cluster 2024-09-13T23:37:32.949752+0000 mgr.a (mgr.14355) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:34 smithi131 bash[24745]: cluster 2024-09-13T23:37:32.949752+0000 mgr.a (mgr.14355) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:34 smithi171 bash[25040]: cluster 2024-09-13T23:37:32.949752+0000 mgr.a (mgr.14355) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:36 smithi007 bash[22722]: cluster 2024-09-13T23:37:34.950546+0000 mgr.a (mgr.14355) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:36 smithi131 bash[24745]: cluster 2024-09-13T23:37:34.950546+0000 mgr.a (mgr.14355) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:36 smithi171 bash[25040]: cluster 2024-09-13T23:37:34.950546+0000 mgr.a (mgr.14355) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:37:36.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:36.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:37 smithi007 bash[22722]: cluster 2024-09-13T23:37:36.952810+0000 mgr.a (mgr.14355) 3320 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:37 smithi131 bash[24745]: cluster 2024-09-13T23:37:36.952810+0000 mgr.a (mgr.14355) 3320 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:37 smithi171 bash[25040]: cluster 2024-09-13T23:37:36.952810+0000 mgr.a (mgr.14355) 3320 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:37.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:37.682 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:38 smithi007 bash[22722]: audit 2024-09-13T23:37:37.237492+0000 mgr.a (mgr.14355) 3321 : audit [DBG] from='client.82905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:38 smithi131 bash[24745]: audit 2024-09-13T23:37:37.237492+0000 mgr.a (mgr.14355) 3321 : audit [DBG] from='client.82905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:38 smithi171 bash[25040]: audit 2024-09-13T23:37:37.237492+0000 mgr.a (mgr.14355) 3321 : audit [DBG] from='client.82905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:39 smithi007 bash[22722]: cluster 2024-09-13T23:37:38.953707+0000 mgr.a (mgr.14355) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:39 smithi131 bash[24745]: cluster 2024-09-13T23:37:38.953707+0000 mgr.a (mgr.14355) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:39 smithi171 bash[25040]: cluster 2024-09-13T23:37:38.953707+0000 mgr.a (mgr.14355) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:42 smithi131 bash[24745]: cluster 2024-09-13T23:37:40.955921+0000 mgr.a (mgr.14355) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:42 smithi171 bash[25040]: cluster 2024-09-13T23:37:40.955921+0000 mgr.a (mgr.14355) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:42 smithi007 bash[22722]: cluster 2024-09-13T23:37:40.955921+0000 mgr.a (mgr.14355) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:37:42.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:43.420 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:43.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:43.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:43.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:43.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:44 smithi131 bash[24745]: cluster 2024-09-13T23:37:42.956800+0000 mgr.a (mgr.14355) 3324 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:44 smithi131 bash[24745]: audit 2024-09-13T23:37:43.015205+0000 mgr.a (mgr.14355) 3325 : audit [DBG] from='client.82983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:44 smithi171 bash[25040]: cluster 2024-09-13T23:37:42.956800+0000 mgr.a (mgr.14355) 3324 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:44 smithi171 bash[25040]: audit 2024-09-13T23:37:43.015205+0000 mgr.a (mgr.14355) 3325 : audit [DBG] from='client.82983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:44 smithi007 bash[22722]: cluster 2024-09-13T23:37:42.956800+0000 mgr.a (mgr.14355) 3324 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:44 smithi007 bash[22722]: audit 2024-09-13T23:37:43.015205+0000 mgr.a (mgr.14355) 3325 : audit [DBG] from='client.82983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:46 smithi131 bash[24745]: cluster 2024-09-13T23:37:44.957690+0000 mgr.a (mgr.14355) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:46 smithi171 bash[25040]: cluster 2024-09-13T23:37:44.957690+0000 mgr.a (mgr.14355) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:46 smithi007 bash[22722]: cluster 2024-09-13T23:37:44.957690+0000 mgr.a (mgr.14355) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:48 smithi131 bash[24745]: cluster 2024-09-13T23:37:46.959976+0000 mgr.a (mgr.14355) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:48 smithi171 bash[25040]: cluster 2024-09-13T23:37:46.959976+0000 mgr.a (mgr.14355) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:48 smithi007 bash[22722]: cluster 2024-09-13T23:37:46.959976+0000 mgr.a (mgr.14355) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:49.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:49.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:49.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:50 smithi131 bash[24745]: audit 2024-09-13T23:37:48.746222+0000 mgr.a (mgr.14355) 3328 : audit [DBG] from='client.83061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:50 smithi131 bash[24745]: cluster 2024-09-13T23:37:48.967195+0000 mgr.a (mgr.14355) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:50 smithi171 bash[25040]: audit 2024-09-13T23:37:48.746222+0000 mgr.a (mgr.14355) 3328 : audit [DBG] from='client.83061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:50 smithi171 bash[25040]: cluster 2024-09-13T23:37:48.967195+0000 mgr.a (mgr.14355) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:50 smithi007 bash[22722]: audit 2024-09-13T23:37:48.746222+0000 mgr.a (mgr.14355) 3328 : audit [DBG] from='client.83061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:50 smithi007 bash[22722]: cluster 2024-09-13T23:37:48.967195+0000 mgr.a (mgr.14355) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:52 smithi171 bash[25040]: cluster 2024-09-13T23:37:50.969459+0000 mgr.a (mgr.14355) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:52 smithi007 bash[22722]: cluster 2024-09-13T23:37:50.969459+0000 mgr.a (mgr.14355) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:52 smithi131 bash[24745]: cluster 2024-09-13T23:37:50.969459+0000 mgr.a (mgr.14355) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:54.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:54.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:54.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:37:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:54 smithi171 bash[25040]: cluster 2024-09-13T23:37:52.970243+0000 mgr.a (mgr.14355) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:54 smithi007 bash[22722]: cluster 2024-09-13T23:37:52.970243+0000 mgr.a (mgr.14355) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:54 smithi131 bash[24745]: cluster 2024-09-13T23:37:52.970243+0000 mgr.a (mgr.14355) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:54.899 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:37:54.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:37:54.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:37:54.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:37:54.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:56 smithi171 bash[25040]: audit 2024-09-13T23:37:54.483224+0000 mgr.a (mgr.14355) 3332 : audit [DBG] from='client.83139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:56 smithi171 bash[25040]: cluster 2024-09-13T23:37:54.971171+0000 mgr.a (mgr.14355) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:56 smithi007 bash[22722]: audit 2024-09-13T23:37:54.483224+0000 mgr.a (mgr.14355) 3332 : audit [DBG] from='client.83139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:56 smithi007 bash[22722]: cluster 2024-09-13T23:37:54.971171+0000 mgr.a (mgr.14355) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:56 smithi131 bash[24745]: audit 2024-09-13T23:37:54.483224+0000 mgr.a (mgr.14355) 3332 : audit [DBG] from='client.83139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:37:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:56 smithi131 bash[24745]: cluster 2024-09-13T23:37:54.971171+0000 mgr.a (mgr.14355) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:37:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:37:58 smithi007 bash[22722]: cluster 2024-09-13T23:37:56.973419+0000 mgr.a (mgr.14355) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:37:58 smithi131 bash[24745]: cluster 2024-09-13T23:37:56.973419+0000 mgr.a (mgr.14355) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:37:58 smithi171 bash[25040]: cluster 2024-09-13T23:37:56.973419+0000 mgr.a (mgr.14355) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:37:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:37:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:37:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:00 smithi007 bash[22722]: cluster 2024-09-13T23:37:58.974180+0000 mgr.a (mgr.14355) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:00 smithi131 bash[24745]: cluster 2024-09-13T23:37:58.974180+0000 mgr.a (mgr.14355) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:00 smithi171 bash[25040]: cluster 2024-09-13T23:37:58.974180+0000 mgr.a (mgr.14355) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:00.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:00.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:00.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:00.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:00.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:02 smithi007 bash[22722]: audit 2024-09-13T23:38:00.233634+0000 mgr.a (mgr.14355) 3336 : audit [DBG] from='client.83217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:02 smithi007 bash[22722]: cluster 2024-09-13T23:38:00.976952+0000 mgr.a (mgr.14355) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:02 smithi131 bash[24745]: audit 2024-09-13T23:38:00.233634+0000 mgr.a (mgr.14355) 3336 : audit [DBG] from='client.83217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:02 smithi131 bash[24745]: cluster 2024-09-13T23:38:00.976952+0000 mgr.a (mgr.14355) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:02 smithi171 bash[25040]: audit 2024-09-13T23:38:00.233634+0000 mgr.a (mgr.14355) 3336 : audit [DBG] from='client.83217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:02 smithi171 bash[25040]: cluster 2024-09-13T23:38:00.976952+0000 mgr.a (mgr.14355) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:04 smithi007 bash[22722]: cluster 2024-09-13T23:38:02.977744+0000 mgr.a (mgr.14355) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:04 smithi131 bash[24745]: cluster 2024-09-13T23:38:02.977744+0000 mgr.a (mgr.14355) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:04 smithi171 bash[25040]: cluster 2024-09-13T23:38:02.977744+0000 mgr.a (mgr.14355) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:05.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:05.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:06.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:06.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:06.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:06.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:06.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:06 smithi007 bash[22722]: cluster 2024-09-13T23:38:04.978559+0000 mgr.a (mgr.14355) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:06 smithi131 bash[24745]: cluster 2024-09-13T23:38:04.978559+0000 mgr.a (mgr.14355) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:06 smithi171 bash[25040]: cluster 2024-09-13T23:38:04.978559+0000 mgr.a (mgr.14355) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:07 smithi007 bash[22722]: audit 2024-09-13T23:38:05.984409+0000 mgr.a (mgr.14355) 3340 : audit [DBG] from='client.83295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:07 smithi131 bash[24745]: audit 2024-09-13T23:38:05.984409+0000 mgr.a (mgr.14355) 3340 : audit [DBG] from='client.83295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:07 smithi171 bash[25040]: audit 2024-09-13T23:38:05.984409+0000 mgr.a (mgr.14355) 3340 : audit [DBG] from='client.83295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:08 smithi007 bash[22722]: cluster 2024-09-13T23:38:06.981342+0000 mgr.a (mgr.14355) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:08 smithi131 bash[24745]: cluster 2024-09-13T23:38:06.981342+0000 mgr.a (mgr.14355) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:08 smithi171 bash[25040]: cluster 2024-09-13T23:38:06.981342+0000 mgr.a (mgr.14355) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:10 smithi007 bash[22722]: cluster 2024-09-13T23:38:08.982115+0000 mgr.a (mgr.14355) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:10 smithi131 bash[24745]: cluster 2024-09-13T23:38:08.982115+0000 mgr.a (mgr.14355) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:10 smithi171 bash[25040]: cluster 2024-09-13T23:38:08.982115+0000 mgr.a (mgr.14355) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:38:11.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:11.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:12.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:12.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:12.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:12 smithi007 bash[22722]: cluster 2024-09-13T23:38:10.984041+0000 mgr.a (mgr.14355) 3343 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:12 smithi131 bash[24745]: cluster 2024-09-13T23:38:10.984041+0000 mgr.a (mgr.14355) 3343 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:12.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:12 smithi171 bash[25040]: cluster 2024-09-13T23:38:10.984041+0000 mgr.a (mgr.14355) 3343 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:13 smithi007 bash[22722]: audit 2024-09-13T23:38:11.733932+0000 mgr.a (mgr.14355) 3344 : audit [DBG] from='client.83373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:13 smithi131 bash[24745]: audit 2024-09-13T23:38:11.733932+0000 mgr.a (mgr.14355) 3344 : audit [DBG] from='client.83373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:13 smithi171 bash[25040]: audit 2024-09-13T23:38:11.733932+0000 mgr.a (mgr.14355) 3344 : audit [DBG] from='client.83373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:14 smithi007 bash[22722]: cluster 2024-09-13T23:38:12.985006+0000 mgr.a (mgr.14355) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:14 smithi131 bash[24745]: cluster 2024-09-13T23:38:12.985006+0000 mgr.a (mgr.14355) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:14 smithi171 bash[25040]: cluster 2024-09-13T23:38:12.985006+0000 mgr.a (mgr.14355) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:16 smithi007 bash[22722]: cluster 2024-09-13T23:38:14.985786+0000 mgr.a (mgr.14355) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:16 smithi131 bash[24745]: cluster 2024-09-13T23:38:14.985786+0000 mgr.a (mgr.14355) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:16 smithi171 bash[25040]: cluster 2024-09-13T23:38:14.985786+0000 mgr.a (mgr.14355) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:17.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:17.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:17.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:17 smithi007 bash[22722]: cluster 2024-09-13T23:38:16.988043+0000 mgr.a (mgr.14355) 3347 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:17.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:17 smithi131 bash[24745]: cluster 2024-09-13T23:38:16.988043+0000 mgr.a (mgr.14355) 3347 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:17 smithi171 bash[25040]: cluster 2024-09-13T23:38:16.988043+0000 mgr.a (mgr.14355) 3347 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:17.925 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:17.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:17.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:18 smithi007 bash[22722]: audit 2024-09-13T23:38:17.485977+0000 mgr.a (mgr.14355) 3348 : audit [DBG] from='client.83448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:18 smithi131 bash[24745]: audit 2024-09-13T23:38:17.485977+0000 mgr.a (mgr.14355) 3348 : audit [DBG] from='client.83448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:18 smithi171 bash[25040]: audit 2024-09-13T23:38:17.485977+0000 mgr.a (mgr.14355) 3348 : audit [DBG] from='client.83448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:19 smithi007 bash[22722]: cluster 2024-09-13T23:38:18.988962+0000 mgr.a (mgr.14355) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:19 smithi131 bash[24745]: cluster 2024-09-13T23:38:18.988962+0000 mgr.a (mgr.14355) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:19 smithi171 bash[25040]: cluster 2024-09-13T23:38:18.988962+0000 mgr.a (mgr.14355) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:22 smithi007 bash[22722]: cluster 2024-09-13T23:38:20.991152+0000 mgr.a (mgr.14355) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:22 smithi131 bash[24745]: cluster 2024-09-13T23:38:20.991152+0000 mgr.a (mgr.14355) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:22 smithi171 bash[25040]: cluster 2024-09-13T23:38:20.991152+0000 mgr.a (mgr.14355) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:22.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:22.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:23.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:23.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:24 smithi007 bash[22722]: cluster 2024-09-13T23:38:22.991730+0000 mgr.a (mgr.14355) 3351 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:24 smithi131 bash[24745]: cluster 2024-09-13T23:38:22.991730+0000 mgr.a (mgr.14355) 3351 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:24 smithi171 bash[25040]: cluster 2024-09-13T23:38:22.991730+0000 mgr.a (mgr.14355) 3351 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:25 smithi007 bash[22722]: audit 2024-09-13T23:38:23.257812+0000 mgr.a (mgr.14355) 3352 : audit [DBG] from='client.83523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:25 smithi131 bash[24745]: audit 2024-09-13T23:38:23.257812+0000 mgr.a (mgr.14355) 3352 : audit [DBG] from='client.83523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:25 smithi171 bash[25040]: audit 2024-09-13T23:38:23.257812+0000 mgr.a (mgr.14355) 3352 : audit [DBG] from='client.83523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:26 smithi007 bash[22722]: cluster 2024-09-13T23:38:24.992596+0000 mgr.a (mgr.14355) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:26 smithi007 bash[22722]: audit 2024-09-13T23:38:25.832135+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:38:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:26 smithi131 bash[24745]: cluster 2024-09-13T23:38:24.992596+0000 mgr.a (mgr.14355) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:26 smithi131 bash[24745]: audit 2024-09-13T23:38:25.832135+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:38:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:26 smithi171 bash[25040]: cluster 2024-09-13T23:38:24.992596+0000 mgr.a (mgr.14355) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:26 smithi171 bash[25040]: audit 2024-09-13T23:38:25.832135+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:38:27.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22722]: audit 2024-09-13T23:38:26.688696+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:38:27.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22722]: audit 2024-09-13T23:38:26.690137+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:38:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22722]: audit 2024-09-13T23:38:26.698840+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:38:27.435 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22722]: audit 2024-09-13T23:38:26.703717+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:27 smithi131 bash[24745]: audit 2024-09-13T23:38:26.688696+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:38:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:27 smithi131 bash[24745]: audit 2024-09-13T23:38:26.690137+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:38:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:27 smithi131 bash[24745]: audit 2024-09-13T23:38:26.698840+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:38:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:27 smithi131 bash[24745]: audit 2024-09-13T23:38:26.703717+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:27 smithi171 bash[25040]: audit 2024-09-13T23:38:26.688696+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:38:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:27 smithi171 bash[25040]: audit 2024-09-13T23:38:26.690137+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:38:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:27 smithi171 bash[25040]: audit 2024-09-13T23:38:26.698840+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:38:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:27 smithi171 bash[25040]: audit 2024-09-13T23:38:26.703717+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:27.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22972]: debug 2024-09-13T23:38:27.429+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:38:27.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:38:27 smithi007 bash[22972]: debug 2024-09-13T23:38:27.433+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:38:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:28 smithi007 bash[22722]: audit 2024-09-13T23:38:26.706014+0000 mgr.a (mgr.14355) 3354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:28 smithi007 bash[22722]: cluster 2024-09-13T23:38:26.993951+0000 mgr.a (mgr.14355) 3355 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:28 smithi131 bash[24745]: audit 2024-09-13T23:38:26.706014+0000 mgr.a (mgr.14355) 3354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:28 smithi131 bash[24745]: cluster 2024-09-13T23:38:26.993951+0000 mgr.a (mgr.14355) 3355 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:28 smithi171 bash[25040]: audit 2024-09-13T23:38:26.706014+0000 mgr.a (mgr.14355) 3354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:38:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:28 smithi171 bash[25040]: cluster 2024-09-13T23:38:26.993951+0000 mgr.a (mgr.14355) 3355 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:28.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:28.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:28.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:29.449 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:29 smithi007 bash[22722]: audit 2024-09-13T23:38:27.434142+0000 mgr.a (mgr.14355) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:38:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:29 smithi007 bash[22722]: cephadm 2024-09-13T23:38:27.435765+0000 mgr.a (mgr.14355) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:38:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:29 smithi131 bash[24745]: audit 2024-09-13T23:38:27.434142+0000 mgr.a (mgr.14355) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:38:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:29 smithi131 bash[24745]: cephadm 2024-09-13T23:38:27.435765+0000 mgr.a (mgr.14355) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:38:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:29 smithi171 bash[25040]: audit 2024-09-13T23:38:27.434142+0000 mgr.a (mgr.14355) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:38:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:29 smithi171 bash[25040]: cephadm 2024-09-13T23:38:27.435765+0000 mgr.a (mgr.14355) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:30 smithi007 bash[22722]: cluster 2024-09-13T23:38:28.994808+0000 mgr.a (mgr.14355) 3358 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:30 smithi007 bash[22722]: audit 2024-09-13T23:38:29.010578+0000 mgr.a (mgr.14355) 3359 : audit [DBG] from='client.83709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:30 smithi131 bash[24745]: cluster 2024-09-13T23:38:28.994808+0000 mgr.a (mgr.14355) 3358 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:30 smithi131 bash[24745]: audit 2024-09-13T23:38:29.010578+0000 mgr.a (mgr.14355) 3359 : audit [DBG] from='client.83709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:30 smithi171 bash[25040]: cluster 2024-09-13T23:38:28.994808+0000 mgr.a (mgr.14355) 3358 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:30 smithi171 bash[25040]: audit 2024-09-13T23:38:29.010578+0000 mgr.a (mgr.14355) 3359 : audit [DBG] from='client.83709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:32 smithi007 bash[22722]: cluster 2024-09-13T23:38:30.997108+0000 mgr.a (mgr.14355) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:32 smithi131 bash[24745]: cluster 2024-09-13T23:38:30.997108+0000 mgr.a (mgr.14355) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:32 smithi171 bash[25040]: cluster 2024-09-13T23:38:30.997108+0000 mgr.a (mgr.14355) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:34.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:34 smithi007 bash[22722]: cluster 2024-09-13T23:38:32.997868+0000 mgr.a (mgr.14355) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:34 smithi131 bash[24745]: cluster 2024-09-13T23:38:32.997868+0000 mgr.a (mgr.14355) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:34 smithi171 bash[25040]: cluster 2024-09-13T23:38:32.997868+0000 mgr.a (mgr.14355) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:35.200 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:36 smithi007 bash[22722]: audit 2024-09-13T23:38:34.781236+0000 mgr.a (mgr.14355) 3362 : audit [DBG] from='client.83784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:36 smithi007 bash[22722]: cluster 2024-09-13T23:38:34.998364+0000 mgr.a (mgr.14355) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:36 smithi131 bash[24745]: audit 2024-09-13T23:38:34.781236+0000 mgr.a (mgr.14355) 3362 : audit [DBG] from='client.83784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:36 smithi131 bash[24745]: cluster 2024-09-13T23:38:34.998364+0000 mgr.a (mgr.14355) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:36 smithi171 bash[25040]: audit 2024-09-13T23:38:34.781236+0000 mgr.a (mgr.14355) 3362 : audit [DBG] from='client.83784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:36 smithi171 bash[25040]: cluster 2024-09-13T23:38:34.998364+0000 mgr.a (mgr.14355) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:38 smithi007 bash[22722]: cluster 2024-09-13T23:38:37.000550+0000 mgr.a (mgr.14355) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:38 smithi131 bash[24745]: cluster 2024-09-13T23:38:37.000550+0000 mgr.a (mgr.14355) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:38 smithi171 bash[25040]: cluster 2024-09-13T23:38:37.000550+0000 mgr.a (mgr.14355) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:40.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:40 smithi007 bash[22722]: cluster 2024-09-13T23:38:39.001315+0000 mgr.a (mgr.14355) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:38:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:40 smithi131 bash[24745]: cluster 2024-09-13T23:38:39.001315+0000 mgr.a (mgr.14355) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:38:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:40 smithi171 bash[25040]: cluster 2024-09-13T23:38:39.001315+0000 mgr.a (mgr.14355) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:38:40.952 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:42 smithi007 bash[22722]: audit 2024-09-13T23:38:40.530336+0000 mgr.a (mgr.14355) 3366 : audit [DBG] from='client.83862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:42 smithi007 bash[22722]: cluster 2024-09-13T23:38:41.003035+0000 mgr.a (mgr.14355) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:42 smithi131 bash[24745]: audit 2024-09-13T23:38:40.530336+0000 mgr.a (mgr.14355) 3366 : audit [DBG] from='client.83862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:42 smithi131 bash[24745]: cluster 2024-09-13T23:38:41.003035+0000 mgr.a (mgr.14355) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:42 smithi171 bash[25040]: audit 2024-09-13T23:38:40.530336+0000 mgr.a (mgr.14355) 3366 : audit [DBG] from='client.83862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:42 smithi171 bash[25040]: cluster 2024-09-13T23:38:41.003035+0000 mgr.a (mgr.14355) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:38:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:43 smithi007 bash[22722]: cluster 2024-09-13T23:38:43.003788+0000 mgr.a (mgr.14355) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:43 smithi131 bash[24745]: cluster 2024-09-13T23:38:43.003788+0000 mgr.a (mgr.14355) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:43 smithi171 bash[25040]: cluster 2024-09-13T23:38:43.003788+0000 mgr.a (mgr.14355) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:45.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:45.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:45.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:46 smithi007 bash[22722]: cluster 2024-09-13T23:38:45.004532+0000 mgr.a (mgr.14355) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:46 smithi131 bash[24745]: cluster 2024-09-13T23:38:45.004532+0000 mgr.a (mgr.14355) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:46 smithi171 bash[25040]: cluster 2024-09-13T23:38:45.004532+0000 mgr.a (mgr.14355) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:38:46.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:48 smithi007 bash[22722]: audit 2024-09-13T23:38:46.286136+0000 mgr.a (mgr.14355) 3370 : audit [DBG] from='client.83937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:48 smithi007 bash[22722]: cluster 2024-09-13T23:38:47.007320+0000 mgr.a (mgr.14355) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:48 smithi131 bash[24745]: audit 2024-09-13T23:38:46.286136+0000 mgr.a (mgr.14355) 3370 : audit [DBG] from='client.83937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:48 smithi131 bash[24745]: cluster 2024-09-13T23:38:47.007320+0000 mgr.a (mgr.14355) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:48 smithi171 bash[25040]: audit 2024-09-13T23:38:46.286136+0000 mgr.a (mgr.14355) 3370 : audit [DBG] from='client.83937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:48 smithi171 bash[25040]: cluster 2024-09-13T23:38:47.007320+0000 mgr.a (mgr.14355) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:50 smithi007 bash[22722]: cluster 2024-09-13T23:38:49.008108+0000 mgr.a (mgr.14355) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:38:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:50 smithi131 bash[24745]: cluster 2024-09-13T23:38:49.008108+0000 mgr.a (mgr.14355) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:38:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:50 smithi171 bash[25040]: cluster 2024-09-13T23:38:49.008108+0000 mgr.a (mgr.14355) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:38:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:51.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:51.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:52 smithi007 bash[22722]: cluster 2024-09-13T23:38:51.010062+0000 mgr.a (mgr.14355) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:38:52.475 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:52.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:52.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:52.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:52.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:52 smithi131 bash[24745]: cluster 2024-09-13T23:38:51.010062+0000 mgr.a (mgr.14355) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:38:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:52 smithi171 bash[25040]: cluster 2024-09-13T23:38:51.010062+0000 mgr.a (mgr.14355) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:38:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:53 smithi007 bash[22722]: audit 2024-09-13T23:38:52.030138+0000 mgr.a (mgr.14355) 3374 : audit [DBG] from='client.84012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:53 smithi131 bash[24745]: audit 2024-09-13T23:38:52.030138+0000 mgr.a (mgr.14355) 3374 : audit [DBG] from='client.84012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:53 smithi171 bash[25040]: audit 2024-09-13T23:38:52.030138+0000 mgr.a (mgr.14355) 3374 : audit [DBG] from='client.84012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:54 smithi007 bash[22722]: cluster 2024-09-13T23:38:53.011002+0000 mgr.a (mgr.14355) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:54 smithi131 bash[24745]: cluster 2024-09-13T23:38:53.011002+0000 mgr.a (mgr.14355) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:54 smithi171 bash[25040]: cluster 2024-09-13T23:38:53.011002+0000 mgr.a (mgr.14355) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:56 smithi007 bash[22722]: cluster 2024-09-13T23:38:55.011833+0000 mgr.a (mgr.14355) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:56 smithi131 bash[24745]: cluster 2024-09-13T23:38:55.011833+0000 mgr.a (mgr.14355) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:56 smithi171 bash[25040]: cluster 2024-09-13T23:38:55.011833+0000 mgr.a (mgr.14355) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:38:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:38:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:38:57.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:38:58.239 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:38:58.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:38:58.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:38:58.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:38:58.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:38:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:58 smithi007 bash[22722]: cluster 2024-09-13T23:38:57.014075+0000 mgr.a (mgr.14355) 3377 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:58 smithi131 bash[24745]: cluster 2024-09-13T23:38:57.014075+0000 mgr.a (mgr.14355) 3377 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:58 smithi171 bash[25040]: cluster 2024-09-13T23:38:57.014075+0000 mgr.a (mgr.14355) 3377 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:38:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:38:59 smithi007 bash[22722]: audit 2024-09-13T23:38:57.811817+0000 mgr.a (mgr.14355) 3378 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:38:59 smithi131 bash[24745]: audit 2024-09-13T23:38:57.811817+0000 mgr.a (mgr.14355) 3378 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:38:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:38:59 smithi171 bash[25040]: audit 2024-09-13T23:38:57.811817+0000 mgr.a (mgr.14355) 3378 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:00 smithi007 bash[22722]: cluster 2024-09-13T23:38:59.014978+0000 mgr.a (mgr.14355) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:00 smithi131 bash[24745]: cluster 2024-09-13T23:38:59.014978+0000 mgr.a (mgr.14355) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:00 smithi171 bash[25040]: cluster 2024-09-13T23:38:59.014978+0000 mgr.a (mgr.14355) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:02 smithi007 bash[22722]: cluster 2024-09-13T23:39:01.017162+0000 mgr.a (mgr.14355) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:02 smithi131 bash[24745]: cluster 2024-09-13T23:39:01.017162+0000 mgr.a (mgr.14355) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:02 smithi171 bash[25040]: cluster 2024-09-13T23:39:01.017162+0000 mgr.a (mgr.14355) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:03 smithi007 bash[22722]: cluster 2024-09-13T23:39:03.017943+0000 mgr.a (mgr.14355) 3381 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:03 smithi131 bash[24745]: cluster 2024-09-13T23:39:03.017943+0000 mgr.a (mgr.14355) 3381 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:03 smithi171 bash[25040]: cluster 2024-09-13T23:39:03.017943+0000 mgr.a (mgr.14355) 3381 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:04.011 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:04.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:04.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:04.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:04.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:04 smithi007 bash[22722]: audit 2024-09-13T23:39:03.573487+0000 mgr.a (mgr.14355) 3382 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:04 smithi131 bash[24745]: audit 2024-09-13T23:39:03.573487+0000 mgr.a (mgr.14355) 3382 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:04 smithi171 bash[25040]: audit 2024-09-13T23:39:03.573487+0000 mgr.a (mgr.14355) 3382 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:05 smithi007 bash[22722]: cluster 2024-09-13T23:39:05.018896+0000 mgr.a (mgr.14355) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:05 smithi131 bash[24745]: cluster 2024-09-13T23:39:05.018896+0000 mgr.a (mgr.14355) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:05 smithi171 bash[25040]: cluster 2024-09-13T23:39:05.018896+0000 mgr.a (mgr.14355) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:08 smithi007 bash[22722]: cluster 2024-09-13T23:39:07.021171+0000 mgr.a (mgr.14355) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:08 smithi131 bash[24745]: cluster 2024-09-13T23:39:07.021171+0000 mgr.a (mgr.14355) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:08 smithi171 bash[25040]: cluster 2024-09-13T23:39:07.021171+0000 mgr.a (mgr.14355) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:09.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:09.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:09.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:09.774 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:09.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:09.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:09.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:09.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:10 smithi007 bash[22722]: cluster 2024-09-13T23:39:09.021827+0000 mgr.a (mgr.14355) 3385 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:10 smithi131 bash[24745]: cluster 2024-09-13T23:39:09.021827+0000 mgr.a (mgr.14355) 3385 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:10 smithi171 bash[25040]: cluster 2024-09-13T23:39:09.021827+0000 mgr.a (mgr.14355) 3385 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:11 smithi007 bash[22722]: audit 2024-09-13T23:39:09.342029+0000 mgr.a (mgr.14355) 3386 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:11 smithi131 bash[24745]: audit 2024-09-13T23:39:09.342029+0000 mgr.a (mgr.14355) 3386 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:11 smithi171 bash[25040]: audit 2024-09-13T23:39:09.342029+0000 mgr.a (mgr.14355) 3386 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:12 smithi007 bash[22722]: cluster 2024-09-13T23:39:11.024044+0000 mgr.a (mgr.14355) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:12 smithi131 bash[24745]: cluster 2024-09-13T23:39:11.024044+0000 mgr.a (mgr.14355) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:12 smithi171 bash[25040]: cluster 2024-09-13T23:39:11.024044+0000 mgr.a (mgr.14355) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:14 smithi007 bash[22722]: cluster 2024-09-13T23:39:13.024797+0000 mgr.a (mgr.14355) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:14 smithi131 bash[24745]: cluster 2024-09-13T23:39:13.024797+0000 mgr.a (mgr.14355) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:14 smithi171 bash[25040]: cluster 2024-09-13T23:39:13.024797+0000 mgr.a (mgr.14355) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:14.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:15.529 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:15.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:16 smithi007 bash[22722]: cluster 2024-09-13T23:39:15.025234+0000 mgr.a (mgr.14355) 3389 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:16 smithi007 bash[22722]: audit 2024-09-13T23:39:15.108962+0000 mgr.a (mgr.14355) 3390 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:16 smithi131 bash[24745]: cluster 2024-09-13T23:39:15.025234+0000 mgr.a (mgr.14355) 3389 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:16 smithi131 bash[24745]: audit 2024-09-13T23:39:15.108962+0000 mgr.a (mgr.14355) 3390 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:16 smithi171 bash[25040]: cluster 2024-09-13T23:39:15.025234+0000 mgr.a (mgr.14355) 3389 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:16 smithi171 bash[25040]: audit 2024-09-13T23:39:15.108962+0000 mgr.a (mgr.14355) 3390 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:18 smithi007 bash[22722]: cluster 2024-09-13T23:39:17.027998+0000 mgr.a (mgr.14355) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:39:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:18 smithi131 bash[24745]: cluster 2024-09-13T23:39:17.027998+0000 mgr.a (mgr.14355) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:39:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:18 smithi171 bash[25040]: cluster 2024-09-13T23:39:17.027998+0000 mgr.a (mgr.14355) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:39:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:20 smithi007 bash[22722]: cluster 2024-09-13T23:39:19.028916+0000 mgr.a (mgr.14355) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:39:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:20.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:20 smithi131 bash[24745]: cluster 2024-09-13T23:39:19.028916+0000 mgr.a (mgr.14355) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:39:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:20 smithi171 bash[25040]: cluster 2024-09-13T23:39:19.028916+0000 mgr.a (mgr.14355) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:39:21.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:21.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:22 smithi007 bash[22722]: audit 2024-09-13T23:39:20.865514+0000 mgr.a (mgr.14355) 3393 : audit [DBG] from='client.84399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:22 smithi007 bash[22722]: cluster 2024-09-13T23:39:21.030323+0000 mgr.a (mgr.14355) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:22 smithi131 bash[24745]: audit 2024-09-13T23:39:20.865514+0000 mgr.a (mgr.14355) 3393 : audit [DBG] from='client.84399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:22 smithi131 bash[24745]: cluster 2024-09-13T23:39:21.030323+0000 mgr.a (mgr.14355) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:22 smithi171 bash[25040]: audit 2024-09-13T23:39:20.865514+0000 mgr.a (mgr.14355) 3393 : audit [DBG] from='client.84399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:22 smithi171 bash[25040]: cluster 2024-09-13T23:39:21.030323+0000 mgr.a (mgr.14355) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:24 smithi007 bash[22722]: cluster 2024-09-13T23:39:23.031183+0000 mgr.a (mgr.14355) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:39:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:24 smithi131 bash[24745]: cluster 2024-09-13T23:39:23.031183+0000 mgr.a (mgr.14355) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:39:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:24 smithi171 bash[25040]: cluster 2024-09-13T23:39:23.031183+0000 mgr.a (mgr.14355) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:39:26.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:26.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:26.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:26 smithi007 bash[22722]: cluster 2024-09-13T23:39:25.031955+0000 mgr.a (mgr.14355) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:39:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:26 smithi131 bash[24745]: cluster 2024-09-13T23:39:25.031955+0000 mgr.a (mgr.14355) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:39:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:26 smithi171 bash[25040]: cluster 2024-09-13T23:39:25.031955+0000 mgr.a (mgr.14355) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:39:27.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:27.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:27.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:27 smithi007 bash[22722]: audit 2024-09-13T23:39:26.632559+0000 mgr.a (mgr.14355) 3397 : audit [DBG] from='client.84477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:27 smithi007 bash[22722]: cluster 2024-09-13T23:39:27.033316+0000 mgr.a (mgr.14355) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:27 smithi131 bash[24745]: audit 2024-09-13T23:39:26.632559+0000 mgr.a (mgr.14355) 3397 : audit [DBG] from='client.84477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:27 smithi131 bash[24745]: cluster 2024-09-13T23:39:27.033316+0000 mgr.a (mgr.14355) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:27 smithi171 bash[25040]: audit 2024-09-13T23:39:26.632559+0000 mgr.a (mgr.14355) 3397 : audit [DBG] from='client.84477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:27 smithi171 bash[25040]: cluster 2024-09-13T23:39:27.033316+0000 mgr.a (mgr.14355) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:28 smithi007 bash[22722]: audit 2024-09-13T23:39:27.489483+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:39:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:28 smithi007 bash[22722]: audit 2024-09-13T23:39:28.114761+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:28 smithi007 bash[22722]: audit 2024-09-13T23:39:28.118763+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:28 smithi131 bash[24745]: audit 2024-09-13T23:39:27.489483+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:39:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:28 smithi131 bash[24745]: audit 2024-09-13T23:39:28.114761+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:28 smithi131 bash[24745]: audit 2024-09-13T23:39:28.118763+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:28 smithi171 bash[25040]: audit 2024-09-13T23:39:27.489483+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:39:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:28 smithi171 bash[25040]: audit 2024-09-13T23:39:28.114761+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:28 smithi171 bash[25040]: audit 2024-09-13T23:39:28.118763+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: audit 2024-09-13T23:39:28.914219+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:39:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: audit 2024-09-13T23:39:28.915943+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:39:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: audit 2024-09-13T23:39:28.926168+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: audit 2024-09-13T23:39:28.931127+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: audit 2024-09-13T23:39:28.932743+0000 mgr.a (mgr.14355) 3399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22722]: cluster 2024-09-13T23:39:29.033862+0000 mgr.a (mgr.14355) 3400 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:39:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: audit 2024-09-13T23:39:28.914219+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:39:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: audit 2024-09-13T23:39:28.915943+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:39:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: audit 2024-09-13T23:39:28.926168+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: audit 2024-09-13T23:39:28.931127+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: audit 2024-09-13T23:39:28.932743+0000 mgr.a (mgr.14355) 3399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:29 smithi131 bash[24745]: cluster 2024-09-13T23:39:29.033862+0000 mgr.a (mgr.14355) 3400 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:39:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: audit 2024-09-13T23:39:28.914219+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:39:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: audit 2024-09-13T23:39:28.915943+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:39:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: audit 2024-09-13T23:39:28.926168+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:39:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: audit 2024-09-13T23:39:28.931127+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: audit 2024-09-13T23:39:28.932743+0000 mgr.a (mgr.14355) 3399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:39:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:29 smithi171 bash[25040]: cluster 2024-09-13T23:39:29.033862+0000 mgr.a (mgr.14355) 3400 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:39:29.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22972]: debug 2024-09-13T23:39:29.636+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:39:29.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:39:29 smithi007 bash[22972]: debug 2024-09-13T23:39:29.636+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:39:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:30 smithi007 bash[22722]: audit 2024-09-13T23:39:29.640532+0000 mgr.a (mgr.14355) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:39:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:30 smithi007 bash[22722]: cephadm 2024-09-13T23:39:29.641992+0000 mgr.a (mgr.14355) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:39:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:30 smithi131 bash[24745]: audit 2024-09-13T23:39:29.640532+0000 mgr.a (mgr.14355) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:39:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:30 smithi131 bash[24745]: cephadm 2024-09-13T23:39:29.641992+0000 mgr.a (mgr.14355) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:39:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:30 smithi171 bash[25040]: audit 2024-09-13T23:39:29.640532+0000 mgr.a (mgr.14355) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:39:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:30 smithi171 bash[25040]: cephadm 2024-09-13T23:39:29.641992+0000 mgr.a (mgr.14355) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:39:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:31 smithi007 bash[22722]: cluster 2024-09-13T23:39:31.036299+0000 mgr.a (mgr.14355) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:31 smithi131 bash[24745]: cluster 2024-09-13T23:39:31.036299+0000 mgr.a (mgr.14355) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:31 smithi171 bash[25040]: cluster 2024-09-13T23:39:31.036299+0000 mgr.a (mgr.14355) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:32.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:32.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:32.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:32.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:32.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:34 smithi007 bash[22722]: audit 2024-09-13T23:39:32.411190+0000 mgr.a (mgr.14355) 3404 : audit [DBG] from='client.84657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:34 smithi007 bash[22722]: cluster 2024-09-13T23:39:33.037339+0000 mgr.a (mgr.14355) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:34 smithi131 bash[24745]: audit 2024-09-13T23:39:32.411190+0000 mgr.a (mgr.14355) 3404 : audit [DBG] from='client.84657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:34 smithi131 bash[24745]: cluster 2024-09-13T23:39:33.037339+0000 mgr.a (mgr.14355) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:34 smithi171 bash[25040]: audit 2024-09-13T23:39:32.411190+0000 mgr.a (mgr.14355) 3404 : audit [DBG] from='client.84657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:34 smithi171 bash[25040]: cluster 2024-09-13T23:39:33.037339+0000 mgr.a (mgr.14355) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:36 smithi007 bash[22722]: cluster 2024-09-13T23:39:35.038147+0000 mgr.a (mgr.14355) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:36 smithi131 bash[24745]: cluster 2024-09-13T23:39:35.038147+0000 mgr.a (mgr.14355) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:36 smithi171 bash[25040]: cluster 2024-09-13T23:39:35.038147+0000 mgr.a (mgr.14355) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:37.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:37.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:37.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:38 smithi007 bash[22722]: cluster 2024-09-13T23:39:37.040326+0000 mgr.a (mgr.14355) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:38 smithi131 bash[24745]: cluster 2024-09-13T23:39:37.040326+0000 mgr.a (mgr.14355) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:38 smithi171 bash[25040]: cluster 2024-09-13T23:39:37.040326+0000 mgr.a (mgr.14355) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:38.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:38.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:40 smithi007 bash[22722]: audit 2024-09-13T23:39:38.171114+0000 mgr.a (mgr.14355) 3408 : audit [DBG] from='client.84732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:40 smithi007 bash[22722]: cluster 2024-09-13T23:39:39.041189+0000 mgr.a (mgr.14355) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:40 smithi131 bash[24745]: audit 2024-09-13T23:39:38.171114+0000 mgr.a (mgr.14355) 3408 : audit [DBG] from='client.84732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:40 smithi131 bash[24745]: cluster 2024-09-13T23:39:39.041189+0000 mgr.a (mgr.14355) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:40 smithi171 bash[25040]: audit 2024-09-13T23:39:38.171114+0000 mgr.a (mgr.14355) 3408 : audit [DBG] from='client.84732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:40 smithi171 bash[25040]: cluster 2024-09-13T23:39:39.041189+0000 mgr.a (mgr.14355) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:42 smithi007 bash[22722]: cluster 2024-09-13T23:39:41.043402+0000 mgr.a (mgr.14355) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:42 smithi131 bash[24745]: cluster 2024-09-13T23:39:41.043402+0000 mgr.a (mgr.14355) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:42 smithi171 bash[25040]: cluster 2024-09-13T23:39:41.043402+0000 mgr.a (mgr.14355) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:39:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:43.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:43.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:44.344 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:44.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:44.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:44.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:44.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:44 smithi007 bash[22722]: cluster 2024-09-13T23:39:43.044137+0000 mgr.a (mgr.14355) 3411 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:44 smithi131 bash[24745]: cluster 2024-09-13T23:39:43.044137+0000 mgr.a (mgr.14355) 3411 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:44 smithi171 bash[25040]: cluster 2024-09-13T23:39:43.044137+0000 mgr.a (mgr.14355) 3411 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:45 smithi007 bash[22722]: audit 2024-09-13T23:39:43.929712+0000 mgr.a (mgr.14355) 3412 : audit [DBG] from='client.84810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:45 smithi131 bash[24745]: audit 2024-09-13T23:39:43.929712+0000 mgr.a (mgr.14355) 3412 : audit [DBG] from='client.84810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:45 smithi171 bash[25040]: audit 2024-09-13T23:39:43.929712+0000 mgr.a (mgr.14355) 3412 : audit [DBG] from='client.84810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:46 smithi007 bash[22722]: cluster 2024-09-13T23:39:45.045003+0000 mgr.a (mgr.14355) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:46 smithi131 bash[24745]: cluster 2024-09-13T23:39:45.045003+0000 mgr.a (mgr.14355) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:46 smithi171 bash[25040]: cluster 2024-09-13T23:39:45.045003+0000 mgr.a (mgr.14355) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:47 smithi007 bash[22722]: cluster 2024-09-13T23:39:47.047280+0000 mgr.a (mgr.14355) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:47 smithi131 bash[24745]: cluster 2024-09-13T23:39:47.047280+0000 mgr.a (mgr.14355) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:47 smithi171 bash[25040]: cluster 2024-09-13T23:39:47.047280+0000 mgr.a (mgr.14355) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:49.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:49.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:50.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:50.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:50.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:50 smithi007 bash[22722]: cluster 2024-09-13T23:39:49.048028+0000 mgr.a (mgr.14355) 3415 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:50 smithi131 bash[24745]: cluster 2024-09-13T23:39:49.048028+0000 mgr.a (mgr.14355) 3415 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:50 smithi171 bash[25040]: cluster 2024-09-13T23:39:49.048028+0000 mgr.a (mgr.14355) 3415 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:51 smithi007 bash[22722]: audit 2024-09-13T23:39:49.675926+0000 mgr.a (mgr.14355) 3416 : audit [DBG] from='client.84888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:51 smithi131 bash[24745]: audit 2024-09-13T23:39:49.675926+0000 mgr.a (mgr.14355) 3416 : audit [DBG] from='client.84888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:51 smithi171 bash[25040]: audit 2024-09-13T23:39:49.675926+0000 mgr.a (mgr.14355) 3416 : audit [DBG] from='client.84888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:52 smithi007 bash[22722]: cluster 2024-09-13T23:39:51.050284+0000 mgr.a (mgr.14355) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:52 smithi131 bash[24745]: cluster 2024-09-13T23:39:51.050284+0000 mgr.a (mgr.14355) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:52 smithi171 bash[25040]: cluster 2024-09-13T23:39:51.050284+0000 mgr.a (mgr.14355) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:39:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:54 smithi007 bash[22722]: cluster 2024-09-13T23:39:53.051028+0000 mgr.a (mgr.14355) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:54 smithi131 bash[24745]: cluster 2024-09-13T23:39:53.051028+0000 mgr.a (mgr.14355) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:54 smithi171 bash[25040]: cluster 2024-09-13T23:39:53.051028+0000 mgr.a (mgr.14355) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:55.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:39:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:39:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:39:55.871 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:39:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:39:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:39:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:39:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:39:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:56 smithi007 bash[22722]: cluster 2024-09-13T23:39:55.051758+0000 mgr.a (mgr.14355) 3419 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:56 smithi131 bash[24745]: cluster 2024-09-13T23:39:55.051758+0000 mgr.a (mgr.14355) 3419 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:56 smithi171 bash[25040]: cluster 2024-09-13T23:39:55.051758+0000 mgr.a (mgr.14355) 3419 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:57 smithi007 bash[22722]: audit 2024-09-13T23:39:55.431533+0000 mgr.a (mgr.14355) 3420 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:57 smithi131 bash[24745]: audit 2024-09-13T23:39:55.431533+0000 mgr.a (mgr.14355) 3420 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:57 smithi171 bash[25040]: audit 2024-09-13T23:39:55.431533+0000 mgr.a (mgr.14355) 3420 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:39:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:58 smithi007 bash[22722]: cluster 2024-09-13T23:39:57.054469+0000 mgr.a (mgr.14355) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:58 smithi131 bash[24745]: cluster 2024-09-13T23:39:57.054469+0000 mgr.a (mgr.14355) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:58 smithi171 bash[25040]: cluster 2024-09-13T23:39:57.054469+0000 mgr.a (mgr.14355) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:39:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:39:59 smithi007 bash[22722]: cluster 2024-09-13T23:39:59.055184+0000 mgr.a (mgr.14355) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:39:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:39:59 smithi131 bash[24745]: cluster 2024-09-13T23:39:59.055184+0000 mgr.a (mgr.14355) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:39:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:39:59 smithi171 bash[25040]: cluster 2024-09-13T23:39:59.055184+0000 mgr.a (mgr.14355) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:40:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:00 smithi007 bash[22722]: cluster 2024-09-13T23:40:00.000153+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:40:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:00 smithi131 bash[24745]: cluster 2024-09-13T23:40:00.000153+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:40:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:00 smithi171 bash[25040]: cluster 2024-09-13T23:40:00.000153+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:40:00.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:00.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:00.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:01 smithi007 bash[22722]: cluster 2024-09-13T23:40:01.057122+0000 mgr.a (mgr.14355) 3423 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:01 smithi131 bash[24745]: cluster 2024-09-13T23:40:01.057122+0000 mgr.a (mgr.14355) 3423 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:01 smithi171 bash[25040]: cluster 2024-09-13T23:40:01.057122+0000 mgr.a (mgr.14355) 3423 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:01.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:01.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:02 smithi007 bash[22722]: audit 2024-09-13T23:40:01.201687+0000 mgr.a (mgr.14355) 3424 : audit [DBG] from='client.85041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:02 smithi131 bash[24745]: audit 2024-09-13T23:40:01.201687+0000 mgr.a (mgr.14355) 3424 : audit [DBG] from='client.85041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:02 smithi171 bash[25040]: audit 2024-09-13T23:40:01.201687+0000 mgr.a (mgr.14355) 3424 : audit [DBG] from='client.85041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:03 smithi007 bash[22722]: cluster 2024-09-13T23:40:03.058059+0000 mgr.a (mgr.14355) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:40:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:03 smithi131 bash[24745]: cluster 2024-09-13T23:40:03.058059+0000 mgr.a (mgr.14355) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:40:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:03 smithi171 bash[25040]: cluster 2024-09-13T23:40:03.058059+0000 mgr.a (mgr.14355) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:40:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:06 smithi007 bash[22722]: cluster 2024-09-13T23:40:05.058893+0000 mgr.a (mgr.14355) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:40:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:06 smithi131 bash[24745]: cluster 2024-09-13T23:40:05.058893+0000 mgr.a (mgr.14355) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:40:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:06 smithi171 bash[25040]: cluster 2024-09-13T23:40:05.058893+0000 mgr.a (mgr.14355) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:40:06.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:07.349 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:08 smithi007 bash[22722]: audit 2024-09-13T23:40:06.929933+0000 mgr.a (mgr.14355) 3427 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:08 smithi007 bash[22722]: cluster 2024-09-13T23:40:07.068066+0000 mgr.a (mgr.14355) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:08 smithi131 bash[24745]: audit 2024-09-13T23:40:06.929933+0000 mgr.a (mgr.14355) 3427 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:08 smithi131 bash[24745]: cluster 2024-09-13T23:40:07.068066+0000 mgr.a (mgr.14355) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:08 smithi171 bash[25040]: audit 2024-09-13T23:40:06.929933+0000 mgr.a (mgr.14355) 3427 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:08 smithi171 bash[25040]: cluster 2024-09-13T23:40:07.068066+0000 mgr.a (mgr.14355) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:10 smithi007 bash[22722]: cluster 2024-09-13T23:40:09.069001+0000 mgr.a (mgr.14355) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:10 smithi131 bash[24745]: cluster 2024-09-13T23:40:09.069001+0000 mgr.a (mgr.14355) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:10 smithi171 bash[25040]: cluster 2024-09-13T23:40:09.069001+0000 mgr.a (mgr.14355) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:12.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:12.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:12.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:12 smithi007 bash[22722]: cluster 2024-09-13T23:40:11.071215+0000 mgr.a (mgr.14355) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:12 smithi131 bash[24745]: cluster 2024-09-13T23:40:11.071215+0000 mgr.a (mgr.14355) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:12 smithi171 bash[25040]: cluster 2024-09-13T23:40:11.071215+0000 mgr.a (mgr.14355) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:13.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:13.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:14 smithi007 bash[22722]: audit 2024-09-13T23:40:12.685072+0000 mgr.a (mgr.14355) 3431 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:14 smithi007 bash[22722]: cluster 2024-09-13T23:40:13.071696+0000 mgr.a (mgr.14355) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:14 smithi131 bash[24745]: audit 2024-09-13T23:40:12.685072+0000 mgr.a (mgr.14355) 3431 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:14 smithi131 bash[24745]: cluster 2024-09-13T23:40:13.071696+0000 mgr.a (mgr.14355) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:14 smithi171 bash[25040]: audit 2024-09-13T23:40:12.685072+0000 mgr.a (mgr.14355) 3431 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:14 smithi171 bash[25040]: cluster 2024-09-13T23:40:13.071696+0000 mgr.a (mgr.14355) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:15 smithi007 bash[22722]: cluster 2024-09-13T23:40:15.072442+0000 mgr.a (mgr.14355) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:15 smithi131 bash[24745]: cluster 2024-09-13T23:40:15.072442+0000 mgr.a (mgr.14355) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:15 smithi171 bash[25040]: cluster 2024-09-13T23:40:15.072442+0000 mgr.a (mgr.14355) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:18 smithi007 bash[22722]: cluster 2024-09-13T23:40:17.074671+0000 mgr.a (mgr.14355) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:18 smithi131 bash[24745]: cluster 2024-09-13T23:40:17.074671+0000 mgr.a (mgr.14355) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:18 smithi171 bash[25040]: cluster 2024-09-13T23:40:17.074671+0000 mgr.a (mgr.14355) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:18.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:19 smithi007 bash[22722]: audit 2024-09-13T23:40:18.436553+0000 mgr.a (mgr.14355) 3435 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:19 smithi007 bash[22722]: cluster 2024-09-13T23:40:19.075598+0000 mgr.a (mgr.14355) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:19 smithi131 bash[24745]: audit 2024-09-13T23:40:18.436553+0000 mgr.a (mgr.14355) 3435 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:19 smithi131 bash[24745]: cluster 2024-09-13T23:40:19.075598+0000 mgr.a (mgr.14355) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:19 smithi171 bash[25040]: audit 2024-09-13T23:40:18.436553+0000 mgr.a (mgr.14355) 3435 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:19 smithi171 bash[25040]: cluster 2024-09-13T23:40:19.075598+0000 mgr.a (mgr.14355) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:22 smithi007 bash[22722]: cluster 2024-09-13T23:40:21.077773+0000 mgr.a (mgr.14355) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:22 smithi131 bash[24745]: cluster 2024-09-13T23:40:21.077773+0000 mgr.a (mgr.14355) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:22 smithi171 bash[25040]: cluster 2024-09-13T23:40:21.077773+0000 mgr.a (mgr.14355) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:23 smithi007 bash[22722]: cluster 2024-09-13T23:40:23.078692+0000 mgr.a (mgr.14355) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:23 smithi131 bash[24745]: cluster 2024-09-13T23:40:23.078692+0000 mgr.a (mgr.14355) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:23 smithi171 bash[25040]: cluster 2024-09-13T23:40:23.078692+0000 mgr.a (mgr.14355) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:23.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:23.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:23.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:24.611 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:24.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:24.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:25 smithi007 bash[22722]: audit 2024-09-13T23:40:24.201419+0000 mgr.a (mgr.14355) 3439 : audit [DBG] from='client.85350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:25 smithi007 bash[22722]: cluster 2024-09-13T23:40:25.079818+0000 mgr.a (mgr.14355) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:25 smithi131 bash[24745]: audit 2024-09-13T23:40:24.201419+0000 mgr.a (mgr.14355) 3439 : audit [DBG] from='client.85350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:25 smithi131 bash[24745]: cluster 2024-09-13T23:40:25.079818+0000 mgr.a (mgr.14355) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:25 smithi171 bash[25040]: audit 2024-09-13T23:40:24.201419+0000 mgr.a (mgr.14355) 3439 : audit [DBG] from='client.85350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:25 smithi171 bash[25040]: cluster 2024-09-13T23:40:25.079818+0000 mgr.a (mgr.14355) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:27 smithi007 bash[22722]: cluster 2024-09-13T23:40:27.082272+0000 mgr.a (mgr.14355) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:27 smithi131 bash[24745]: cluster 2024-09-13T23:40:27.082272+0000 mgr.a (mgr.14355) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:27 smithi171 bash[25040]: cluster 2024-09-13T23:40:27.082272+0000 mgr.a (mgr.14355) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:29 smithi007 bash[22722]: cluster 2024-09-13T23:40:29.083235+0000 mgr.a (mgr.14355) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:29 smithi131 bash[24745]: cluster 2024-09-13T23:40:29.083235+0000 mgr.a (mgr.14355) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:29 smithi171 bash[25040]: cluster 2024-09-13T23:40:29.083235+0000 mgr.a (mgr.14355) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:30.380 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:30 smithi007 bash[22722]: audit 2024-09-13T23:40:29.698597+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:40:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:30 smithi007 bash[22722]: audit 2024-09-13T23:40:29.949990+0000 mgr.a (mgr.14355) 3443 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:30 smithi131 bash[24745]: audit 2024-09-13T23:40:29.698597+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:40:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:30 smithi131 bash[24745]: audit 2024-09-13T23:40:29.949990+0000 mgr.a (mgr.14355) 3443 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:30 smithi171 bash[25040]: audit 2024-09-13T23:40:29.698597+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:40:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:30 smithi171 bash[25040]: audit 2024-09-13T23:40:29.949990+0000 mgr.a (mgr.14355) 3443 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:31.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:30.269108+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:30.273166+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:30.276359+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:30.279781+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:31.026167+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:31.028193+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:31.038440+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:31.043807+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: audit 2024-09-13T23:40:31.046371+0000 mgr.a (mgr.14355) 3444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:31 smithi131 bash[24745]: cluster 2024-09-13T23:40:31.086069+0000 mgr.a (mgr.14355) 3445 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:30.269108+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:30.273166+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:30.276359+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:30.279781+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:31.026167+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:31.028193+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:31.038440+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:31.043807+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: audit 2024-09-13T23:40:31.046371+0000 mgr.a (mgr.14355) 3444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:31 smithi171 bash[25040]: cluster 2024-09-13T23:40:31.086069+0000 mgr.a (mgr.14355) 3445 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:30.269108+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:30.273166+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:30.276359+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:30.279781+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:31.026167+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:31.028193+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:40:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:31.038440+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:40:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:31.043807+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: audit 2024-09-13T23:40:31.046371+0000 mgr.a (mgr.14355) 3444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:40:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22722]: cluster 2024-09-13T23:40:31.086069+0000 mgr.a (mgr.14355) 3445 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:40:32.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22972]: debug 2024-09-13T23:40:31.743+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:40:32.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:40:31 smithi007 bash[22972]: debug 2024-09-13T23:40:31.743+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:40:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:33 smithi171 bash[25040]: audit 2024-09-13T23:40:31.747350+0000 mgr.a (mgr.14355) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:40:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:33 smithi171 bash[25040]: cephadm 2024-09-13T23:40:31.748718+0000 mgr.a (mgr.14355) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:40:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:33 smithi007 bash[22722]: audit 2024-09-13T23:40:31.747350+0000 mgr.a (mgr.14355) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:40:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:33 smithi007 bash[22722]: cephadm 2024-09-13T23:40:31.748718+0000 mgr.a (mgr.14355) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:40:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:33 smithi131 bash[24745]: audit 2024-09-13T23:40:31.747350+0000 mgr.a (mgr.14355) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:40:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:33 smithi131 bash[24745]: cephadm 2024-09-13T23:40:31.748718+0000 mgr.a (mgr.14355) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:40:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:34 smithi007 bash[22722]: cluster 2024-09-13T23:40:33.087074+0000 mgr.a (mgr.14355) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:34 smithi131 bash[24745]: cluster 2024-09-13T23:40:33.087074+0000 mgr.a (mgr.14355) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:34 smithi171 bash[25040]: cluster 2024-09-13T23:40:33.087074+0000 mgr.a (mgr.14355) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:35 smithi007 bash[22722]: cluster 2024-09-13T23:40:35.087849+0000 mgr.a (mgr.14355) 3449 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:35 smithi131 bash[24745]: cluster 2024-09-13T23:40:35.087849+0000 mgr.a (mgr.14355) 3449 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:35 smithi171 bash[25040]: cluster 2024-09-13T23:40:35.087849+0000 mgr.a (mgr.14355) 3449 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:40:36.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:36 smithi007 bash[22722]: audit 2024-09-13T23:40:35.718034+0000 mgr.a (mgr.14355) 3450 : audit [DBG] from='client.85611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:36 smithi131 bash[24745]: audit 2024-09-13T23:40:35.718034+0000 mgr.a (mgr.14355) 3450 : audit [DBG] from='client.85611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:36 smithi171 bash[25040]: audit 2024-09-13T23:40:35.718034+0000 mgr.a (mgr.14355) 3450 : audit [DBG] from='client.85611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:37 smithi007 bash[22722]: cluster 2024-09-13T23:40:37.090710+0000 mgr.a (mgr.14355) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:37 smithi131 bash[24745]: cluster 2024-09-13T23:40:37.090710+0000 mgr.a (mgr.14355) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:37 smithi171 bash[25040]: cluster 2024-09-13T23:40:37.090710+0000 mgr.a (mgr.14355) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:39 smithi007 bash[22722]: cluster 2024-09-13T23:40:39.091517+0000 mgr.a (mgr.14355) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:39 smithi131 bash[24745]: cluster 2024-09-13T23:40:39.091517+0000 mgr.a (mgr.14355) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:39 smithi171 bash[25040]: cluster 2024-09-13T23:40:39.091517+0000 mgr.a (mgr.14355) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:41.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:41.160 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:41 smithi007 bash[22722]: cluster 2024-09-13T23:40:41.093463+0000 mgr.a (mgr.14355) 3453 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:41 smithi131 bash[24745]: cluster 2024-09-13T23:40:41.093463+0000 mgr.a (mgr.14355) 3453 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:41 smithi171 bash[25040]: cluster 2024-09-13T23:40:41.093463+0000 mgr.a (mgr.14355) 3453 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:41.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:41.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:41.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:42 smithi007 bash[22722]: audit 2024-09-13T23:40:41.492240+0000 mgr.a (mgr.14355) 3454 : audit [DBG] from='client.85686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:42 smithi131 bash[24745]: audit 2024-09-13T23:40:41.492240+0000 mgr.a (mgr.14355) 3454 : audit [DBG] from='client.85686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:42 smithi171 bash[25040]: audit 2024-09-13T23:40:41.492240+0000 mgr.a (mgr.14355) 3454 : audit [DBG] from='client.85686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:43 smithi007 bash[22722]: cluster 2024-09-13T23:40:43.094371+0000 mgr.a (mgr.14355) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:43 smithi131 bash[24745]: cluster 2024-09-13T23:40:43.094371+0000 mgr.a (mgr.14355) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:43 smithi171 bash[25040]: cluster 2024-09-13T23:40:43.094371+0000 mgr.a (mgr.14355) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:45 smithi007 bash[22722]: cluster 2024-09-13T23:40:45.095150+0000 mgr.a (mgr.14355) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:45 smithi131 bash[24745]: cluster 2024-09-13T23:40:45.095150+0000 mgr.a (mgr.14355) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:45 smithi171 bash[25040]: cluster 2024-09-13T23:40:45.095150+0000 mgr.a (mgr.14355) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:40:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:46.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:47 smithi007 bash[22722]: cluster 2024-09-13T23:40:47.097305+0000 mgr.a (mgr.14355) 3457 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:47 smithi131 bash[24745]: cluster 2024-09-13T23:40:47.097305+0000 mgr.a (mgr.14355) 3457 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:47 smithi171 bash[25040]: cluster 2024-09-13T23:40:47.097305+0000 mgr.a (mgr.14355) 3457 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:40:47.680 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:47.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:48 smithi007 bash[22722]: audit 2024-09-13T23:40:47.247289+0000 mgr.a (mgr.14355) 3458 : audit [DBG] from='client.85764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:48 smithi131 bash[24745]: audit 2024-09-13T23:40:47.247289+0000 mgr.a (mgr.14355) 3458 : audit [DBG] from='client.85764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:48 smithi171 bash[25040]: audit 2024-09-13T23:40:47.247289+0000 mgr.a (mgr.14355) 3458 : audit [DBG] from='client.85764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:49 smithi007 bash[22722]: cluster 2024-09-13T23:40:49.098274+0000 mgr.a (mgr.14355) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:49 smithi131 bash[24745]: cluster 2024-09-13T23:40:49.098274+0000 mgr.a (mgr.14355) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:49 smithi171 bash[25040]: cluster 2024-09-13T23:40:49.098274+0000 mgr.a (mgr.14355) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:51 smithi007 bash[22722]: cluster 2024-09-13T23:40:51.100482+0000 mgr.a (mgr.14355) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:51 smithi131 bash[24745]: cluster 2024-09-13T23:40:51.100482+0000 mgr.a (mgr.14355) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:51 smithi171 bash[25040]: cluster 2024-09-13T23:40:51.100482+0000 mgr.a (mgr.14355) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:52.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:52.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:52.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:53.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:53.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:53.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:53.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:53.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:53 smithi007 bash[22722]: audit 2024-09-13T23:40:53.006394+0000 mgr.a (mgr.14355) 3461 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:53 smithi007 bash[22722]: cluster 2024-09-13T23:40:53.100992+0000 mgr.a (mgr.14355) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:53 smithi131 bash[24745]: audit 2024-09-13T23:40:53.006394+0000 mgr.a (mgr.14355) 3461 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:53 smithi131 bash[24745]: cluster 2024-09-13T23:40:53.100992+0000 mgr.a (mgr.14355) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:53 smithi171 bash[25040]: audit 2024-09-13T23:40:53.006394+0000 mgr.a (mgr.14355) 3461 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:53 smithi171 bash[25040]: cluster 2024-09-13T23:40:53.100992+0000 mgr.a (mgr.14355) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:55 smithi007 bash[22722]: cluster 2024-09-13T23:40:55.101839+0000 mgr.a (mgr.14355) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:55 smithi131 bash[24745]: cluster 2024-09-13T23:40:55.101839+0000 mgr.a (mgr.14355) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:55 smithi171 bash[25040]: cluster 2024-09-13T23:40:55.101839+0000 mgr.a (mgr.14355) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:57 smithi007 bash[22722]: cluster 2024-09-13T23:40:57.104105+0000 mgr.a (mgr.14355) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:57 smithi131 bash[24745]: cluster 2024-09-13T23:40:57.104105+0000 mgr.a (mgr.14355) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:57 smithi171 bash[25040]: cluster 2024-09-13T23:40:57.104105+0000 mgr.a (mgr.14355) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:40:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:40:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:40:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:40:59.191 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:40:59.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:40:59.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:40:59.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:40:59.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:40:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:59 smithi007 bash[22722]: audit 2024-09-13T23:40:58.762304+0000 mgr.a (mgr.14355) 3465 : audit [DBG] from='client.85911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:40:59 smithi007 bash[22722]: cluster 2024-09-13T23:40:59.104634+0000 mgr.a (mgr.14355) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:59 smithi131 bash[24745]: audit 2024-09-13T23:40:58.762304+0000 mgr.a (mgr.14355) 3465 : audit [DBG] from='client.85911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:40:59 smithi131 bash[24745]: cluster 2024-09-13T23:40:59.104634+0000 mgr.a (mgr.14355) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:40:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:59 smithi171 bash[25040]: audit 2024-09-13T23:40:58.762304+0000 mgr.a (mgr.14355) 3465 : audit [DBG] from='client.85911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:40:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:40:59 smithi171 bash[25040]: cluster 2024-09-13T23:40:59.104634+0000 mgr.a (mgr.14355) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:01 smithi007 bash[22722]: cluster 2024-09-13T23:41:01.106796+0000 mgr.a (mgr.14355) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:01 smithi131 bash[24745]: cluster 2024-09-13T23:41:01.106796+0000 mgr.a (mgr.14355) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:01 smithi171 bash[25040]: cluster 2024-09-13T23:41:01.106796+0000 mgr.a (mgr.14355) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:03 smithi007 bash[22722]: cluster 2024-09-13T23:41:03.107540+0000 mgr.a (mgr.14355) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:03 smithi131 bash[24745]: cluster 2024-09-13T23:41:03.107540+0000 mgr.a (mgr.14355) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:03 smithi171 bash[25040]: cluster 2024-09-13T23:41:03.107540+0000 mgr.a (mgr.14355) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:04.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:04.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:04.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:04.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:04.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:04.957 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:05 smithi007 bash[22722]: audit 2024-09-13T23:41:04.531601+0000 mgr.a (mgr.14355) 3469 : audit [DBG] from='client.85989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:05 smithi007 bash[22722]: cluster 2024-09-13T23:41:05.108466+0000 mgr.a (mgr.14355) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:05 smithi131 bash[24745]: audit 2024-09-13T23:41:04.531601+0000 mgr.a (mgr.14355) 3469 : audit [DBG] from='client.85989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:05 smithi131 bash[24745]: cluster 2024-09-13T23:41:05.108466+0000 mgr.a (mgr.14355) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:05 smithi171 bash[25040]: audit 2024-09-13T23:41:04.531601+0000 mgr.a (mgr.14355) 3469 : audit [DBG] from='client.85989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:05 smithi171 bash[25040]: cluster 2024-09-13T23:41:05.108466+0000 mgr.a (mgr.14355) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:07 smithi007 bash[22722]: cluster 2024-09-13T23:41:07.110736+0000 mgr.a (mgr.14355) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:07 smithi131 bash[24745]: cluster 2024-09-13T23:41:07.110736+0000 mgr.a (mgr.14355) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:07 smithi171 bash[25040]: cluster 2024-09-13T23:41:07.110736+0000 mgr.a (mgr.14355) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:09 smithi007 bash[22722]: cluster 2024-09-13T23:41:09.111501+0000 mgr.a (mgr.14355) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:09 smithi131 bash[24745]: cluster 2024-09-13T23:41:09.111501+0000 mgr.a (mgr.14355) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:09 smithi171 bash[25040]: cluster 2024-09-13T23:41:09.111501+0000 mgr.a (mgr.14355) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:09.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:09.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:10.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:10.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:10.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:10.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:10.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:11 smithi007 bash[22722]: audit 2024-09-13T23:41:10.290060+0000 mgr.a (mgr.14355) 3473 : audit [DBG] from='client.86067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:11 smithi007 bash[22722]: cluster 2024-09-13T23:41:11.114210+0000 mgr.a (mgr.14355) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:11 smithi131 bash[24745]: audit 2024-09-13T23:41:10.290060+0000 mgr.a (mgr.14355) 3473 : audit [DBG] from='client.86067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:11 smithi131 bash[24745]: cluster 2024-09-13T23:41:11.114210+0000 mgr.a (mgr.14355) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:11 smithi171 bash[25040]: audit 2024-09-13T23:41:10.290060+0000 mgr.a (mgr.14355) 3473 : audit [DBG] from='client.86067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:11 smithi171 bash[25040]: cluster 2024-09-13T23:41:11.114210+0000 mgr.a (mgr.14355) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:13 smithi007 bash[22722]: cluster 2024-09-13T23:41:13.115002+0000 mgr.a (mgr.14355) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:13 smithi131 bash[24745]: cluster 2024-09-13T23:41:13.115002+0000 mgr.a (mgr.14355) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:13 smithi171 bash[25040]: cluster 2024-09-13T23:41:13.115002+0000 mgr.a (mgr.14355) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:15 smithi007 bash[22722]: cluster 2024-09-13T23:41:15.115739+0000 mgr.a (mgr.14355) 3476 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:15 smithi131 bash[24745]: cluster 2024-09-13T23:41:15.115739+0000 mgr.a (mgr.14355) 3476 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:15 smithi171 bash[25040]: cluster 2024-09-13T23:41:15.115739+0000 mgr.a (mgr.14355) 3476 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:15.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:15.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:15.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:16.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:16.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:16 smithi007 bash[22722]: audit 2024-09-13T23:41:16.037356+0000 mgr.a (mgr.14355) 3477 : audit [DBG] from='client.86145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:16 smithi131 bash[24745]: audit 2024-09-13T23:41:16.037356+0000 mgr.a (mgr.14355) 3477 : audit [DBG] from='client.86145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:16 smithi171 bash[25040]: audit 2024-09-13T23:41:16.037356+0000 mgr.a (mgr.14355) 3477 : audit [DBG] from='client.86145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:17 smithi131 bash[24745]: cluster 2024-09-13T23:41:17.118729+0000 mgr.a (mgr.14355) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:17 smithi171 bash[25040]: cluster 2024-09-13T23:41:17.118729+0000 mgr.a (mgr.14355) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:17 smithi007 bash[22722]: cluster 2024-09-13T23:41:17.118729+0000 mgr.a (mgr.14355) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:19 smithi007 bash[22722]: cluster 2024-09-13T23:41:19.119670+0000 mgr.a (mgr.14355) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:19 smithi131 bash[24745]: cluster 2024-09-13T23:41:19.119670+0000 mgr.a (mgr.14355) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:19 smithi171 bash[25040]: cluster 2024-09-13T23:41:19.119670+0000 mgr.a (mgr.14355) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:21.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:21.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:21 smithi007 bash[22722]: cluster 2024-09-13T23:41:21.121786+0000 mgr.a (mgr.14355) 3480 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:21 smithi131 bash[24745]: cluster 2024-09-13T23:41:21.121786+0000 mgr.a (mgr.14355) 3480 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:21.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:21 smithi171 bash[25040]: cluster 2024-09-13T23:41:21.121786+0000 mgr.a (mgr.14355) 3480 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:22.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:22.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:22.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:22 smithi131 bash[24745]: audit 2024-09-13T23:41:21.785060+0000 mgr.a (mgr.14355) 3481 : audit [DBG] from='client.86223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:22 smithi171 bash[25040]: audit 2024-09-13T23:41:21.785060+0000 mgr.a (mgr.14355) 3481 : audit [DBG] from='client.86223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:22 smithi007 bash[22722]: audit 2024-09-13T23:41:21.785060+0000 mgr.a (mgr.14355) 3481 : audit [DBG] from='client.86223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:23 smithi131 bash[24745]: cluster 2024-09-13T23:41:23.122946+0000 mgr.a (mgr.14355) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:23 smithi171 bash[25040]: cluster 2024-09-13T23:41:23.122946+0000 mgr.a (mgr.14355) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:23 smithi007 bash[22722]: cluster 2024-09-13T23:41:23.122946+0000 mgr.a (mgr.14355) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:25 smithi131 bash[24745]: cluster 2024-09-13T23:41:25.123776+0000 mgr.a (mgr.14355) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:25 smithi171 bash[25040]: cluster 2024-09-13T23:41:25.123776+0000 mgr.a (mgr.14355) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:25 smithi007 bash[22722]: cluster 2024-09-13T23:41:25.123776+0000 mgr.a (mgr.14355) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:27 smithi131 bash[24745]: cluster 2024-09-13T23:41:27.125964+0000 mgr.a (mgr.14355) 3484 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:27 smithi171 bash[25040]: cluster 2024-09-13T23:41:27.125964+0000 mgr.a (mgr.14355) 3484 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:27 smithi007 bash[22722]: cluster 2024-09-13T23:41:27.125964+0000 mgr.a (mgr.14355) 3484 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:27.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:28 smithi131 bash[24745]: audit 2024-09-13T23:41:27.559192+0000 mgr.a (mgr.14355) 3485 : audit [DBG] from='client.86298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:28 smithi171 bash[25040]: audit 2024-09-13T23:41:27.559192+0000 mgr.a (mgr.14355) 3485 : audit [DBG] from='client.86298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:28 smithi007 bash[22722]: audit 2024-09-13T23:41:27.559192+0000 mgr.a (mgr.14355) 3485 : audit [DBG] from='client.86298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:29 smithi131 bash[24745]: cluster 2024-09-13T23:41:29.126858+0000 mgr.a (mgr.14355) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:29 smithi171 bash[25040]: cluster 2024-09-13T23:41:29.126858+0000 mgr.a (mgr.14355) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:29 smithi007 bash[22722]: cluster 2024-09-13T23:41:29.126858+0000 mgr.a (mgr.14355) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:31 smithi131 bash[24745]: cluster 2024-09-13T23:41:31.129044+0000 mgr.a (mgr.14355) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:31 smithi171 bash[25040]: cluster 2024-09-13T23:41:31.129044+0000 mgr.a (mgr.14355) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:31 smithi007 bash[22722]: cluster 2024-09-13T23:41:31.129044+0000 mgr.a (mgr.14355) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:41:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:32 smithi131 bash[24745]: audit 2024-09-13T23:41:31.800063+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:41:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:32 smithi171 bash[25040]: audit 2024-09-13T23:41:31.800063+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:41:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:32 smithi007 bash[22722]: audit 2024-09-13T23:41:31.800063+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:41:32.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:32.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:32.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: audit 2024-09-13T23:41:32.626093+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: audit 2024-09-13T23:41:32.627339+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: audit 2024-09-13T23:41:32.636142+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: audit 2024-09-13T23:41:32.638756+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: audit 2024-09-13T23:41:32.640990+0000 mgr.a (mgr.14355) 3488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:33 smithi131 bash[24745]: cluster 2024-09-13T23:41:33.129485+0000 mgr.a (mgr.14355) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: audit 2024-09-13T23:41:32.626093+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:41:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: audit 2024-09-13T23:41:32.627339+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:41:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: audit 2024-09-13T23:41:32.636142+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:41:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: audit 2024-09-13T23:41:32.638756+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: audit 2024-09-13T23:41:32.640990+0000 mgr.a (mgr.14355) 3488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:33 smithi171 bash[25040]: cluster 2024-09-13T23:41:33.129485+0000 mgr.a (mgr.14355) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:33.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22972]: debug 2024-09-13T23:41:33.346+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:41:33.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22972]: debug 2024-09-13T23:41:33.354+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:41:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: audit 2024-09-13T23:41:32.626093+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:41:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: audit 2024-09-13T23:41:32.627339+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:41:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: audit 2024-09-13T23:41:32.636142+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:41:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: audit 2024-09-13T23:41:32.638756+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: audit 2024-09-13T23:41:32.640990+0000 mgr.a (mgr.14355) 3488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:41:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:33 smithi007 bash[22722]: cluster 2024-09-13T23:41:33.129485+0000 mgr.a (mgr.14355) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:33.740 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:34 smithi007 bash[22722]: audit 2024-09-13T23:41:33.297574+0000 mgr.a (mgr.14355) 3490 : audit [DBG] from='client.86445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:34 smithi007 bash[22722]: audit 2024-09-13T23:41:33.351639+0000 mgr.a (mgr.14355) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:41:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:34 smithi007 bash[22722]: cephadm 2024-09-13T23:41:33.361341+0000 mgr.a (mgr.14355) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:41:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:34 smithi131 bash[24745]: audit 2024-09-13T23:41:33.297574+0000 mgr.a (mgr.14355) 3490 : audit [DBG] from='client.86445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:34 smithi131 bash[24745]: audit 2024-09-13T23:41:33.351639+0000 mgr.a (mgr.14355) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:41:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:34 smithi131 bash[24745]: cephadm 2024-09-13T23:41:33.361341+0000 mgr.a (mgr.14355) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:41:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:34 smithi171 bash[25040]: audit 2024-09-13T23:41:33.297574+0000 mgr.a (mgr.14355) 3490 : audit [DBG] from='client.86445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:34 smithi171 bash[25040]: audit 2024-09-13T23:41:33.351639+0000 mgr.a (mgr.14355) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:41:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:34 smithi171 bash[25040]: cephadm 2024-09-13T23:41:33.361341+0000 mgr.a (mgr.14355) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:41:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:35 smithi007 bash[22722]: cluster 2024-09-13T23:41:35.130340+0000 mgr.a (mgr.14355) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:35 smithi131 bash[24745]: cluster 2024-09-13T23:41:35.130340+0000 mgr.a (mgr.14355) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:35 smithi171 bash[25040]: cluster 2024-09-13T23:41:35.130340+0000 mgr.a (mgr.14355) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:37 smithi131 bash[24745]: cluster 2024-09-13T23:41:37.132525+0000 mgr.a (mgr.14355) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:37 smithi171 bash[25040]: cluster 2024-09-13T23:41:37.132525+0000 mgr.a (mgr.14355) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:37 smithi007 bash[22722]: cluster 2024-09-13T23:41:37.132525+0000 mgr.a (mgr.14355) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:38.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:38.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:38.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:39.485 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:39.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:39.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:39.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:39.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:39 smithi131 bash[24745]: audit 2024-09-13T23:41:39.072532+0000 mgr.a (mgr.14355) 3495 : audit [DBG] from='client.86556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:39 smithi131 bash[24745]: cluster 2024-09-13T23:41:39.133032+0000 mgr.a (mgr.14355) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:39 smithi171 bash[25040]: audit 2024-09-13T23:41:39.072532+0000 mgr.a (mgr.14355) 3495 : audit [DBG] from='client.86556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:39 smithi171 bash[25040]: cluster 2024-09-13T23:41:39.133032+0000 mgr.a (mgr.14355) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:39 smithi007 bash[22722]: audit 2024-09-13T23:41:39.072532+0000 mgr.a (mgr.14355) 3495 : audit [DBG] from='client.86556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:39 smithi007 bash[22722]: cluster 2024-09-13T23:41:39.133032+0000 mgr.a (mgr.14355) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:41 smithi131 bash[24745]: cluster 2024-09-13T23:41:41.135307+0000 mgr.a (mgr.14355) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:41 smithi171 bash[25040]: cluster 2024-09-13T23:41:41.135307+0000 mgr.a (mgr.14355) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:41 smithi007 bash[22722]: cluster 2024-09-13T23:41:41.135307+0000 mgr.a (mgr.14355) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:43 smithi131 bash[24745]: cluster 2024-09-13T23:41:43.136073+0000 mgr.a (mgr.14355) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:43 smithi171 bash[25040]: cluster 2024-09-13T23:41:43.136073+0000 mgr.a (mgr.14355) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:43 smithi007 bash[22722]: cluster 2024-09-13T23:41:43.136073+0000 mgr.a (mgr.14355) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:44.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:44.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:45.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:45.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:45 smithi131 bash[24745]: audit 2024-09-13T23:41:44.821583+0000 mgr.a (mgr.14355) 3499 : audit [DBG] from='client.86634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:45 smithi131 bash[24745]: cluster 2024-09-13T23:41:45.136548+0000 mgr.a (mgr.14355) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:45 smithi171 bash[25040]: audit 2024-09-13T23:41:44.821583+0000 mgr.a (mgr.14355) 3499 : audit [DBG] from='client.86634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:45 smithi171 bash[25040]: cluster 2024-09-13T23:41:45.136548+0000 mgr.a (mgr.14355) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:45 smithi007 bash[22722]: audit 2024-09-13T23:41:44.821583+0000 mgr.a (mgr.14355) 3499 : audit [DBG] from='client.86634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:45 smithi007 bash[22722]: cluster 2024-09-13T23:41:45.136548+0000 mgr.a (mgr.14355) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:47 smithi131 bash[24745]: cluster 2024-09-13T23:41:47.138886+0000 mgr.a (mgr.14355) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:47.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:47 smithi171 bash[25040]: cluster 2024-09-13T23:41:47.138886+0000 mgr.a (mgr.14355) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:47 smithi007 bash[22722]: cluster 2024-09-13T23:41:47.138886+0000 mgr.a (mgr.14355) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:41:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:49 smithi131 bash[24745]: cluster 2024-09-13T23:41:49.139628+0000 mgr.a (mgr.14355) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:41:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:49 smithi171 bash[25040]: cluster 2024-09-13T23:41:49.139628+0000 mgr.a (mgr.14355) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:41:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:49 smithi007 bash[22722]: cluster 2024-09-13T23:41:49.139628+0000 mgr.a (mgr.14355) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:41:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:51.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:51 smithi131 bash[24745]: audit 2024-09-13T23:41:50.582556+0000 mgr.a (mgr.14355) 3503 : audit [DBG] from='client.86709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:51 smithi131 bash[24745]: cluster 2024-09-13T23:41:51.142368+0000 mgr.a (mgr.14355) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:51 smithi171 bash[25040]: audit 2024-09-13T23:41:50.582556+0000 mgr.a (mgr.14355) 3503 : audit [DBG] from='client.86709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:51 smithi171 bash[25040]: cluster 2024-09-13T23:41:51.142368+0000 mgr.a (mgr.14355) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:51 smithi007 bash[22722]: audit 2024-09-13T23:41:50.582556+0000 mgr.a (mgr.14355) 3503 : audit [DBG] from='client.86709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:51 smithi007 bash[22722]: cluster 2024-09-13T23:41:51.142368+0000 mgr.a (mgr.14355) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:53 smithi131 bash[24745]: cluster 2024-09-13T23:41:53.143159+0000 mgr.a (mgr.14355) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:53 smithi171 bash[25040]: cluster 2024-09-13T23:41:53.143159+0000 mgr.a (mgr.14355) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:53 smithi007 bash[22722]: cluster 2024-09-13T23:41:53.143159+0000 mgr.a (mgr.14355) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:41:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:55 smithi131 bash[24745]: cluster 2024-09-13T23:41:55.143976+0000 mgr.a (mgr.14355) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:55 smithi171 bash[25040]: cluster 2024-09-13T23:41:55.143976+0000 mgr.a (mgr.14355) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:55 smithi007 bash[22722]: cluster 2024-09-13T23:41:55.143976+0000 mgr.a (mgr.14355) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:41:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:41:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:41:56.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:41:56.756 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:41:56.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:41:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:41:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:41:56.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:57 smithi131 bash[24745]: audit 2024-09-13T23:41:56.344329+0000 mgr.a (mgr.14355) 3507 : audit [DBG] from='client.86781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:57 smithi131 bash[24745]: cluster 2024-09-13T23:41:57.146739+0000 mgr.a (mgr.14355) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:57 smithi171 bash[25040]: audit 2024-09-13T23:41:56.344329+0000 mgr.a (mgr.14355) 3507 : audit [DBG] from='client.86781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:57 smithi171 bash[25040]: cluster 2024-09-13T23:41:57.146739+0000 mgr.a (mgr.14355) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:57 smithi007 bash[22722]: audit 2024-09-13T23:41:56.344329+0000 mgr.a (mgr.14355) 3507 : audit [DBG] from='client.86781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:41:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:57 smithi007 bash[22722]: cluster 2024-09-13T23:41:57.146739+0000 mgr.a (mgr.14355) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:41:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:41:59 smithi131 bash[24745]: cluster 2024-09-13T23:41:59.147543+0000 mgr.a (mgr.14355) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:41:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:41:59 smithi171 bash[25040]: cluster 2024-09-13T23:41:59.147543+0000 mgr.a (mgr.14355) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:41:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:41:59 smithi007 bash[22722]: cluster 2024-09-13T23:41:59.147543+0000 mgr.a (mgr.14355) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:42:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:01 smithi131 bash[24745]: cluster 2024-09-13T23:42:01.149459+0000 mgr.a (mgr.14355) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:01 smithi171 bash[25040]: cluster 2024-09-13T23:42:01.149459+0000 mgr.a (mgr.14355) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:01 smithi007 bash[22722]: cluster 2024-09-13T23:42:01.149459+0000 mgr.a (mgr.14355) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:01.758 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:01.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:01.759 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:02 smithi131 bash[24745]: audit 2024-09-13T23:42:02.124426+0000 mgr.a (mgr.14355) 3511 : audit [DBG] from='client.86859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:02 smithi171 bash[25040]: audit 2024-09-13T23:42:02.124426+0000 mgr.a (mgr.14355) 3511 : audit [DBG] from='client.86859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:02.578 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:02.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:02 smithi007 bash[22722]: audit 2024-09-13T23:42:02.124426+0000 mgr.a (mgr.14355) 3511 : audit [DBG] from='client.86859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:03 smithi131 bash[24745]: cluster 2024-09-13T23:42:03.150459+0000 mgr.a (mgr.14355) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:03 smithi171 bash[25040]: cluster 2024-09-13T23:42:03.150459+0000 mgr.a (mgr.14355) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:03 smithi007 bash[22722]: cluster 2024-09-13T23:42:03.150459+0000 mgr.a (mgr.14355) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:05 smithi131 bash[24745]: cluster 2024-09-13T23:42:05.151387+0000 mgr.a (mgr.14355) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:05 smithi171 bash[25040]: cluster 2024-09-13T23:42:05.151387+0000 mgr.a (mgr.14355) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:05 smithi007 bash[22722]: cluster 2024-09-13T23:42:05.151387+0000 mgr.a (mgr.14355) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:42:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:07 smithi131 bash[24745]: cluster 2024-09-13T23:42:07.153709+0000 mgr.a (mgr.14355) 3514 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:07 smithi171 bash[25040]: cluster 2024-09-13T23:42:07.153709+0000 mgr.a (mgr.14355) 3514 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:07.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:07.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:07.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:07 smithi007 bash[22722]: cluster 2024-09-13T23:42:07.153709+0000 mgr.a (mgr.14355) 3514 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:08.365 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:08 smithi131 bash[24745]: audit 2024-09-13T23:42:07.921807+0000 mgr.a (mgr.14355) 3515 : audit [DBG] from='client.86937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:08 smithi171 bash[25040]: audit 2024-09-13T23:42:07.921807+0000 mgr.a (mgr.14355) 3515 : audit [DBG] from='client.86937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:08 smithi007 bash[22722]: audit 2024-09-13T23:42:07.921807+0000 mgr.a (mgr.14355) 3515 : audit [DBG] from='client.86937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:09 smithi131 bash[24745]: cluster 2024-09-13T23:42:09.154654+0000 mgr.a (mgr.14355) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:42:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:09 smithi171 bash[25040]: cluster 2024-09-13T23:42:09.154654+0000 mgr.a (mgr.14355) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:42:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:09 smithi007 bash[22722]: cluster 2024-09-13T23:42:09.154654+0000 mgr.a (mgr.14355) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:42:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:11 smithi131 bash[24745]: cluster 2024-09-13T23:42:11.156826+0000 mgr.a (mgr.14355) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:11 smithi171 bash[25040]: cluster 2024-09-13T23:42:11.156826+0000 mgr.a (mgr.14355) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:11 smithi007 bash[22722]: cluster 2024-09-13T23:42:11.156826+0000 mgr.a (mgr.14355) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:42:13.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:13 smithi131 bash[24745]: cluster 2024-09-13T23:42:13.157590+0000 mgr.a (mgr.14355) 3518 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:13 smithi171 bash[25040]: cluster 2024-09-13T23:42:13.157590+0000 mgr.a (mgr.14355) 3518 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:13 smithi007 bash[22722]: cluster 2024-09-13T23:42:13.157590+0000 mgr.a (mgr.14355) 3518 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:14.128 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:14.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:14.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:14.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:14.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:14 smithi131 bash[24745]: audit 2024-09-13T23:42:13.702688+0000 mgr.a (mgr.14355) 3519 : audit [DBG] from='client.87015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:14 smithi171 bash[25040]: audit 2024-09-13T23:42:13.702688+0000 mgr.a (mgr.14355) 3519 : audit [DBG] from='client.87015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:14 smithi007 bash[22722]: audit 2024-09-13T23:42:13.702688+0000 mgr.a (mgr.14355) 3519 : audit [DBG] from='client.87015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:15 smithi131 bash[24745]: cluster 2024-09-13T23:42:15.158500+0000 mgr.a (mgr.14355) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:15 smithi171 bash[25040]: cluster 2024-09-13T23:42:15.158500+0000 mgr.a (mgr.14355) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:15 smithi007 bash[22722]: cluster 2024-09-13T23:42:15.158500+0000 mgr.a (mgr.14355) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-13T23:42:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:17 smithi131 bash[24745]: cluster 2024-09-13T23:42:17.160753+0000 mgr.a (mgr.14355) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:42:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:17 smithi171 bash[25040]: cluster 2024-09-13T23:42:17.160753+0000 mgr.a (mgr.14355) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:42:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:17 smithi007 bash[22722]: cluster 2024-09-13T23:42:17.160753+0000 mgr.a (mgr.14355) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:42:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:19.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:19.871 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:20 smithi131 bash[24745]: cluster 2024-09-13T23:42:19.161417+0000 mgr.a (mgr.14355) 3522 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:20 smithi131 bash[24745]: audit 2024-09-13T23:42:19.460543+0000 mgr.a (mgr.14355) 3523 : audit [DBG] from='client.87093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:20 smithi171 bash[25040]: cluster 2024-09-13T23:42:19.161417+0000 mgr.a (mgr.14355) 3522 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:20 smithi171 bash[25040]: audit 2024-09-13T23:42:19.460543+0000 mgr.a (mgr.14355) 3523 : audit [DBG] from='client.87093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:20 smithi007 bash[22722]: cluster 2024-09-13T23:42:19.161417+0000 mgr.a (mgr.14355) 3522 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:20 smithi007 bash[22722]: audit 2024-09-13T23:42:19.460543+0000 mgr.a (mgr.14355) 3523 : audit [DBG] from='client.87093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:22 smithi131 bash[24745]: cluster 2024-09-13T23:42:21.163848+0000 mgr.a (mgr.14355) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:22 smithi171 bash[25040]: cluster 2024-09-13T23:42:21.163848+0000 mgr.a (mgr.14355) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:22 smithi007 bash[22722]: cluster 2024-09-13T23:42:21.163848+0000 mgr.a (mgr.14355) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:24 smithi131 bash[24745]: cluster 2024-09-13T23:42:23.164788+0000 mgr.a (mgr.14355) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:24 smithi171 bash[25040]: cluster 2024-09-13T23:42:23.164788+0000 mgr.a (mgr.14355) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:24 smithi007 bash[22722]: cluster 2024-09-13T23:42:23.164788+0000 mgr.a (mgr.14355) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:24.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:24.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:25.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:25.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:25.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:26 smithi131 bash[24745]: cluster 2024-09-13T23:42:25.165649+0000 mgr.a (mgr.14355) 3526 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:26 smithi131 bash[24745]: audit 2024-09-13T23:42:25.207515+0000 mgr.a (mgr.14355) 3527 : audit [DBG] from='client.87171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:26 smithi171 bash[25040]: cluster 2024-09-13T23:42:25.165649+0000 mgr.a (mgr.14355) 3526 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:26 smithi171 bash[25040]: audit 2024-09-13T23:42:25.207515+0000 mgr.a (mgr.14355) 3527 : audit [DBG] from='client.87171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:26 smithi007 bash[22722]: cluster 2024-09-13T23:42:25.165649+0000 mgr.a (mgr.14355) 3526 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:26 smithi007 bash[22722]: audit 2024-09-13T23:42:25.207515+0000 mgr.a (mgr.14355) 3527 : audit [DBG] from='client.87171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:28 smithi131 bash[24745]: cluster 2024-09-13T23:42:27.168408+0000 mgr.a (mgr.14355) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:28 smithi171 bash[25040]: cluster 2024-09-13T23:42:27.168408+0000 mgr.a (mgr.14355) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:28 smithi007 bash[22722]: cluster 2024-09-13T23:42:27.168408+0000 mgr.a (mgr.14355) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:30 smithi131 bash[24745]: cluster 2024-09-13T23:42:29.169214+0000 mgr.a (mgr.14355) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:30 smithi171 bash[25040]: cluster 2024-09-13T23:42:29.169214+0000 mgr.a (mgr.14355) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:30.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:30.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:30.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:30 smithi007 bash[22722]: cluster 2024-09-13T23:42:29.169214+0000 mgr.a (mgr.14355) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:31.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:31.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:31 smithi131 bash[24745]: audit 2024-09-13T23:42:30.984475+0000 mgr.a (mgr.14355) 3530 : audit [DBG] from='client.87246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:31 smithi171 bash[25040]: audit 2024-09-13T23:42:30.984475+0000 mgr.a (mgr.14355) 3530 : audit [DBG] from='client.87246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:31 smithi007 bash[22722]: audit 2024-09-13T23:42:30.984475+0000 mgr.a (mgr.14355) 3530 : audit [DBG] from='client.87246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:32 smithi131 bash[24745]: cluster 2024-09-13T23:42:31.171088+0000 mgr.a (mgr.14355) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:32 smithi171 bash[25040]: cluster 2024-09-13T23:42:31.171088+0000 mgr.a (mgr.14355) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:32 smithi007 bash[22722]: cluster 2024-09-13T23:42:31.171088+0000 mgr.a (mgr.14355) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:34 smithi131 bash[24745]: cluster 2024-09-13T23:42:33.172098+0000 mgr.a (mgr.14355) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:34 smithi131 bash[24745]: audit 2024-09-13T23:42:33.416676+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:34 smithi131 bash[24745]: audit 2024-09-13T23:42:34.236786+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:34 smithi131 bash[24745]: audit 2024-09-13T23:42:34.238613+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:34 smithi131 bash[24745]: audit 2024-09-13T23:42:34.249083+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:34 smithi171 bash[25040]: cluster 2024-09-13T23:42:33.172098+0000 mgr.a (mgr.14355) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:34 smithi171 bash[25040]: audit 2024-09-13T23:42:33.416676+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:34 smithi171 bash[25040]: audit 2024-09-13T23:42:34.236786+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:34 smithi171 bash[25040]: audit 2024-09-13T23:42:34.238613+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:42:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:34 smithi171 bash[25040]: audit 2024-09-13T23:42:34.249083+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22722]: cluster 2024-09-13T23:42:33.172098+0000 mgr.a (mgr.14355) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22722]: audit 2024-09-13T23:42:33.416676+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22722]: audit 2024-09-13T23:42:34.236786+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22722]: audit 2024-09-13T23:42:34.238613+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:42:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22722]: audit 2024-09-13T23:42:34.249083+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:42:35.261 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22972]: debug 2024-09-13T23:42:34.961+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:42:35.262 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:42:34 smithi007 bash[22972]: debug 2024-09-13T23:42:34.961+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:42:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:35 smithi131 bash[24745]: audit 2024-09-13T23:42:34.255091+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:35 smithi131 bash[24745]: audit 2024-09-13T23:42:34.257538+0000 mgr.a (mgr.14355) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:35 smithi131 bash[24745]: audit 2024-09-13T23:42:34.964522+0000 mgr.a (mgr.14355) 3534 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:42:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:35 smithi131 bash[24745]: cephadm 2024-09-13T23:42:34.966081+0000 mgr.a (mgr.14355) 3535 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:42:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:35 smithi171 bash[25040]: audit 2024-09-13T23:42:34.255091+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:35 smithi171 bash[25040]: audit 2024-09-13T23:42:34.257538+0000 mgr.a (mgr.14355) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:35 smithi171 bash[25040]: audit 2024-09-13T23:42:34.964522+0000 mgr.a (mgr.14355) 3534 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:42:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:35 smithi171 bash[25040]: cephadm 2024-09-13T23:42:34.966081+0000 mgr.a (mgr.14355) 3535 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:42:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:35 smithi007 bash[22722]: audit 2024-09-13T23:42:34.255091+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:35 smithi007 bash[22722]: audit 2024-09-13T23:42:34.257538+0000 mgr.a (mgr.14355) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:42:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:35 smithi007 bash[22722]: audit 2024-09-13T23:42:34.964522+0000 mgr.a (mgr.14355) 3534 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:42:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:35 smithi007 bash[22722]: cephadm 2024-09-13T23:42:34.966081+0000 mgr.a (mgr.14355) 3535 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:42:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:36 smithi131 bash[24745]: cluster 2024-09-13T23:42:35.173044+0000 mgr.a (mgr.14355) 3536 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:42:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:36 smithi171 bash[25040]: cluster 2024-09-13T23:42:35.173044+0000 mgr.a (mgr.14355) 3536 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:42:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:36 smithi007 bash[22722]: cluster 2024-09-13T23:42:35.173044+0000 mgr.a (mgr.14355) 3536 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:42:37.184 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:37.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:37 smithi131 bash[24745]: audit 2024-09-13T23:42:36.755027+0000 mgr.a (mgr.14355) 3537 : audit [DBG] from='client.87426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:37 smithi171 bash[25040]: audit 2024-09-13T23:42:36.755027+0000 mgr.a (mgr.14355) 3537 : audit [DBG] from='client.87426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:37 smithi007 bash[22722]: audit 2024-09-13T23:42:36.755027+0000 mgr.a (mgr.14355) 3537 : audit [DBG] from='client.87426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:38 smithi131 bash[24745]: cluster 2024-09-13T23:42:37.174215+0000 mgr.a (mgr.14355) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:38 smithi171 bash[25040]: cluster 2024-09-13T23:42:37.174215+0000 mgr.a (mgr.14355) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:38 smithi007 bash[22722]: cluster 2024-09-13T23:42:37.174215+0000 mgr.a (mgr.14355) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:40 smithi131 bash[24745]: cluster 2024-09-13T23:42:39.174944+0000 mgr.a (mgr.14355) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:40 smithi171 bash[25040]: cluster 2024-09-13T23:42:39.174944+0000 mgr.a (mgr.14355) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:40 smithi007 bash[22722]: cluster 2024-09-13T23:42:39.174944+0000 mgr.a (mgr.14355) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:42.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:42.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:42 smithi131 bash[24745]: cluster 2024-09-13T23:42:41.176910+0000 mgr.a (mgr.14355) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:42 smithi171 bash[25040]: cluster 2024-09-13T23:42:41.176910+0000 mgr.a (mgr.14355) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:42 smithi007 bash[22722]: cluster 2024-09-13T23:42:41.176910+0000 mgr.a (mgr.14355) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:42.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:43 smithi171 bash[25040]: audit 2024-09-13T23:42:42.515853+0000 mgr.a (mgr.14355) 3541 : audit [DBG] from='client.87501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:43 smithi007 bash[22722]: audit 2024-09-13T23:42:42.515853+0000 mgr.a (mgr.14355) 3541 : audit [DBG] from='client.87501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:43 smithi131 bash[24745]: audit 2024-09-13T23:42:42.515853+0000 mgr.a (mgr.14355) 3541 : audit [DBG] from='client.87501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:44 smithi171 bash[25040]: cluster 2024-09-13T23:42:43.177837+0000 mgr.a (mgr.14355) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:44 smithi007 bash[22722]: cluster 2024-09-13T23:42:43.177837+0000 mgr.a (mgr.14355) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:44 smithi131 bash[24745]: cluster 2024-09-13T23:42:43.177837+0000 mgr.a (mgr.14355) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:46 smithi007 bash[22722]: cluster 2024-09-13T23:42:45.178631+0000 mgr.a (mgr.14355) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:46 smithi131 bash[24745]: cluster 2024-09-13T23:42:45.178631+0000 mgr.a (mgr.14355) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:46 smithi171 bash[25040]: cluster 2024-09-13T23:42:45.178631+0000 mgr.a (mgr.14355) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:48.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:48 smithi007 bash[22722]: cluster 2024-09-13T23:42:47.180955+0000 mgr.a (mgr.14355) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:48 smithi131 bash[24745]: cluster 2024-09-13T23:42:47.180955+0000 mgr.a (mgr.14355) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:48 smithi171 bash[25040]: cluster 2024-09-13T23:42:47.180955+0000 mgr.a (mgr.14355) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:42:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:49 smithi007 bash[22722]: audit 2024-09-13T23:42:48.270503+0000 mgr.a (mgr.14355) 3545 : audit [DBG] from='client.87579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:49 smithi131 bash[24745]: audit 2024-09-13T23:42:48.270503+0000 mgr.a (mgr.14355) 3545 : audit [DBG] from='client.87579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:49 smithi171 bash[25040]: audit 2024-09-13T23:42:48.270503+0000 mgr.a (mgr.14355) 3545 : audit [DBG] from='client.87579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:50 smithi007 bash[22722]: cluster 2024-09-13T23:42:49.182017+0000 mgr.a (mgr.14355) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:50 smithi131 bash[24745]: cluster 2024-09-13T23:42:49.182017+0000 mgr.a (mgr.14355) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:50 smithi171 bash[25040]: cluster 2024-09-13T23:42:49.182017+0000 mgr.a (mgr.14355) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:52 smithi007 bash[22722]: cluster 2024-09-13T23:42:51.184406+0000 mgr.a (mgr.14355) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:52 smithi131 bash[24745]: cluster 2024-09-13T23:42:51.184406+0000 mgr.a (mgr.14355) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:52 smithi171 bash[25040]: cluster 2024-09-13T23:42:51.184406+0000 mgr.a (mgr.14355) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:42:54.465 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:42:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:42:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:42:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:42:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:42:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:54 smithi007 bash[22722]: cluster 2024-09-13T23:42:53.185212+0000 mgr.a (mgr.14355) 3548 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:54 smithi007 bash[22722]: audit 2024-09-13T23:42:54.050605+0000 mgr.a (mgr.14355) 3549 : audit [DBG] from='client.87657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:54 smithi131 bash[24745]: cluster 2024-09-13T23:42:53.185212+0000 mgr.a (mgr.14355) 3548 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:54 smithi131 bash[24745]: audit 2024-09-13T23:42:54.050605+0000 mgr.a (mgr.14355) 3549 : audit [DBG] from='client.87657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:54 smithi171 bash[25040]: cluster 2024-09-13T23:42:53.185212+0000 mgr.a (mgr.14355) 3548 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:54 smithi171 bash[25040]: audit 2024-09-13T23:42:54.050605+0000 mgr.a (mgr.14355) 3549 : audit [DBG] from='client.87657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:42:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:56 smithi007 bash[22722]: cluster 2024-09-13T23:42:55.186218+0000 mgr.a (mgr.14355) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:56 smithi131 bash[24745]: cluster 2024-09-13T23:42:55.186218+0000 mgr.a (mgr.14355) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:56 smithi171 bash[25040]: cluster 2024-09-13T23:42:55.186218+0000 mgr.a (mgr.14355) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:42:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:42:58 smithi007 bash[22722]: cluster 2024-09-13T23:42:57.188597+0000 mgr.a (mgr.14355) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:42:58 smithi131 bash[24745]: cluster 2024-09-13T23:42:57.188597+0000 mgr.a (mgr.14355) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:42:58 smithi171 bash[25040]: cluster 2024-09-13T23:42:57.188597+0000 mgr.a (mgr.14355) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:42:59.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:42:59.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:42:59.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:00.244 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:00.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:00 smithi007 bash[22722]: cluster 2024-09-13T23:42:59.189395+0000 mgr.a (mgr.14355) 3552 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:00 smithi007 bash[22722]: audit 2024-09-13T23:42:59.808031+0000 mgr.a (mgr.14355) 3553 : audit [DBG] from='client.87732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:00 smithi131 bash[24745]: cluster 2024-09-13T23:42:59.189395+0000 mgr.a (mgr.14355) 3552 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:00 smithi131 bash[24745]: audit 2024-09-13T23:42:59.808031+0000 mgr.a (mgr.14355) 3553 : audit [DBG] from='client.87732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:00 smithi171 bash[25040]: cluster 2024-09-13T23:42:59.189395+0000 mgr.a (mgr.14355) 3552 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:00 smithi171 bash[25040]: audit 2024-09-13T23:42:59.808031+0000 mgr.a (mgr.14355) 3553 : audit [DBG] from='client.87732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:02 smithi007 bash[22722]: cluster 2024-09-13T23:43:01.191861+0000 mgr.a (mgr.14355) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:02 smithi131 bash[24745]: cluster 2024-09-13T23:43:01.191861+0000 mgr.a (mgr.14355) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:02 smithi171 bash[25040]: cluster 2024-09-13T23:43:01.191861+0000 mgr.a (mgr.14355) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:04 smithi007 bash[22722]: cluster 2024-09-13T23:43:03.192673+0000 mgr.a (mgr.14355) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:04 smithi131 bash[24745]: cluster 2024-09-13T23:43:03.192673+0000 mgr.a (mgr.14355) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:04 smithi171 bash[25040]: cluster 2024-09-13T23:43:03.192673+0000 mgr.a (mgr.14355) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:05.988 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:06 smithi007 bash[22722]: cluster 2024-09-13T23:43:05.193435+0000 mgr.a (mgr.14355) 3556 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:06 smithi007 bash[22722]: audit 2024-09-13T23:43:05.569811+0000 mgr.a (mgr.14355) 3557 : audit [DBG] from='client.87810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:06 smithi131 bash[24745]: cluster 2024-09-13T23:43:05.193435+0000 mgr.a (mgr.14355) 3556 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:06 smithi131 bash[24745]: audit 2024-09-13T23:43:05.569811+0000 mgr.a (mgr.14355) 3557 : audit [DBG] from='client.87810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:06 smithi171 bash[25040]: cluster 2024-09-13T23:43:05.193435+0000 mgr.a (mgr.14355) 3556 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:06 smithi171 bash[25040]: audit 2024-09-13T23:43:05.569811+0000 mgr.a (mgr.14355) 3557 : audit [DBG] from='client.87810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:08 smithi007 bash[22722]: cluster 2024-09-13T23:43:07.196115+0000 mgr.a (mgr.14355) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:08 smithi131 bash[24745]: cluster 2024-09-13T23:43:07.196115+0000 mgr.a (mgr.14355) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:08 smithi171 bash[25040]: cluster 2024-09-13T23:43:07.196115+0000 mgr.a (mgr.14355) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:10.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:10 smithi007 bash[22722]: cluster 2024-09-13T23:43:09.196894+0000 mgr.a (mgr.14355) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:43:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:10 smithi131 bash[24745]: cluster 2024-09-13T23:43:09.196894+0000 mgr.a (mgr.14355) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:43:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:10 smithi171 bash[25040]: cluster 2024-09-13T23:43:09.196894+0000 mgr.a (mgr.14355) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:43:11.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:11.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:12 smithi007 bash[22722]: cluster 2024-09-13T23:43:11.198950+0000 mgr.a (mgr.14355) 3560 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:12 smithi007 bash[22722]: audit 2024-09-13T23:43:11.318807+0000 mgr.a (mgr.14355) 3561 : audit [DBG] from='client.87888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:12 smithi131 bash[24745]: cluster 2024-09-13T23:43:11.198950+0000 mgr.a (mgr.14355) 3560 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:12 smithi131 bash[24745]: audit 2024-09-13T23:43:11.318807+0000 mgr.a (mgr.14355) 3561 : audit [DBG] from='client.87888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:12 smithi171 bash[25040]: cluster 2024-09-13T23:43:11.198950+0000 mgr.a (mgr.14355) 3560 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:12 smithi171 bash[25040]: audit 2024-09-13T23:43:11.318807+0000 mgr.a (mgr.14355) 3561 : audit [DBG] from='client.87888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:14 smithi007 bash[22722]: cluster 2024-09-13T23:43:13.199861+0000 mgr.a (mgr.14355) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:14 smithi131 bash[24745]: cluster 2024-09-13T23:43:13.199861+0000 mgr.a (mgr.14355) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:14 smithi171 bash[25040]: cluster 2024-09-13T23:43:13.199861+0000 mgr.a (mgr.14355) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:16 smithi007 bash[22722]: cluster 2024-09-13T23:43:15.200634+0000 mgr.a (mgr.14355) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:16 smithi131 bash[24745]: cluster 2024-09-13T23:43:15.200634+0000 mgr.a (mgr.14355) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:16 smithi171 bash[25040]: cluster 2024-09-13T23:43:15.200634+0000 mgr.a (mgr.14355) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:43:17.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:17.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:17 smithi007 bash[22722]: audit 2024-09-13T23:43:17.070222+0000 mgr.a (mgr.14355) 3564 : audit [DBG] from='client.87966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:17 smithi131 bash[24745]: audit 2024-09-13T23:43:17.070222+0000 mgr.a (mgr.14355) 3564 : audit [DBG] from='client.87966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:17 smithi171 bash[25040]: audit 2024-09-13T23:43:17.070222+0000 mgr.a (mgr.14355) 3564 : audit [DBG] from='client.87966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:18 smithi007 bash[22722]: cluster 2024-09-13T23:43:17.209650+0000 mgr.a (mgr.14355) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:43:19.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:18 smithi131 bash[24745]: cluster 2024-09-13T23:43:17.209650+0000 mgr.a (mgr.14355) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:43:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:18 smithi171 bash[25040]: cluster 2024-09-13T23:43:17.209650+0000 mgr.a (mgr.14355) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:43:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:20 smithi007 bash[22722]: cluster 2024-09-13T23:43:19.210582+0000 mgr.a (mgr.14355) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:20 smithi131 bash[24745]: cluster 2024-09-13T23:43:19.210582+0000 mgr.a (mgr.14355) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:20 smithi171 bash[25040]: cluster 2024-09-13T23:43:19.210582+0000 mgr.a (mgr.14355) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:22 smithi007 bash[22722]: cluster 2024-09-13T23:43:21.212769+0000 mgr.a (mgr.14355) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:23.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:23.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:22 smithi131 bash[24745]: cluster 2024-09-13T23:43:21.212769+0000 mgr.a (mgr.14355) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:22 smithi171 bash[25040]: cluster 2024-09-13T23:43:21.212769+0000 mgr.a (mgr.14355) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:23 smithi007 bash[22722]: audit 2024-09-13T23:43:22.830768+0000 mgr.a (mgr.14355) 3568 : audit [DBG] from='client.88044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:23 smithi131 bash[24745]: audit 2024-09-13T23:43:22.830768+0000 mgr.a (mgr.14355) 3568 : audit [DBG] from='client.88044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:23 smithi171 bash[25040]: audit 2024-09-13T23:43:22.830768+0000 mgr.a (mgr.14355) 3568 : audit [DBG] from='client.88044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:24 smithi007 bash[22722]: cluster 2024-09-13T23:43:23.213308+0000 mgr.a (mgr.14355) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:24 smithi131 bash[24745]: cluster 2024-09-13T23:43:23.213308+0000 mgr.a (mgr.14355) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:24 smithi171 bash[25040]: cluster 2024-09-13T23:43:23.213308+0000 mgr.a (mgr.14355) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:26 smithi007 bash[22722]: cluster 2024-09-13T23:43:25.214020+0000 mgr.a (mgr.14355) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:26 smithi131 bash[24745]: cluster 2024-09-13T23:43:25.214020+0000 mgr.a (mgr.14355) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:26 smithi171 bash[25040]: cluster 2024-09-13T23:43:25.214020+0000 mgr.a (mgr.14355) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:28.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:29.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:29.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:28 smithi007 bash[22722]: cluster 2024-09-13T23:43:27.216327+0000 mgr.a (mgr.14355) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:28 smithi131 bash[24745]: cluster 2024-09-13T23:43:27.216327+0000 mgr.a (mgr.14355) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:28 smithi171 bash[25040]: cluster 2024-09-13T23:43:27.216327+0000 mgr.a (mgr.14355) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:29 smithi007 bash[22722]: audit 2024-09-13T23:43:28.614816+0000 mgr.a (mgr.14355) 3572 : audit [DBG] from='client.88119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:29 smithi131 bash[24745]: audit 2024-09-13T23:43:28.614816+0000 mgr.a (mgr.14355) 3572 : audit [DBG] from='client.88119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:29 smithi171 bash[25040]: audit 2024-09-13T23:43:28.614816+0000 mgr.a (mgr.14355) 3572 : audit [DBG] from='client.88119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:30 smithi007 bash[22722]: cluster 2024-09-13T23:43:29.217174+0000 mgr.a (mgr.14355) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:30 smithi131 bash[24745]: cluster 2024-09-13T23:43:29.217174+0000 mgr.a (mgr.14355) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:30 smithi171 bash[25040]: cluster 2024-09-13T23:43:29.217174+0000 mgr.a (mgr.14355) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:32 smithi007 bash[22722]: cluster 2024-09-13T23:43:31.219429+0000 mgr.a (mgr.14355) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:32 smithi131 bash[24745]: cluster 2024-09-13T23:43:31.219429+0000 mgr.a (mgr.14355) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:32 smithi171 bash[25040]: cluster 2024-09-13T23:43:31.219429+0000 mgr.a (mgr.14355) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:34.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:34.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:34.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:34.770 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:34 smithi007 bash[22722]: cluster 2024-09-13T23:43:33.220161+0000 mgr.a (mgr.14355) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:34 smithi131 bash[24745]: cluster 2024-09-13T23:43:33.220161+0000 mgr.a (mgr.14355) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:34 smithi171 bash[25040]: cluster 2024-09-13T23:43:33.220161+0000 mgr.a (mgr.14355) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:34.357192+0000 mgr.a (mgr.14355) 3576 : audit [DBG] from='client.88197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:35.018130+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:43:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:35.861784+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:43:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:35.863488+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:43:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:35.873574+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:43:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:35 smithi007 bash[22722]: audit 2024-09-13T23:43:35.878563+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:34.357192+0000 mgr.a (mgr.14355) 3576 : audit [DBG] from='client.88197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:35.018130+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:35.861784+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:35.863488+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:43:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:35.873574+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:43:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:35 smithi131 bash[24745]: audit 2024-09-13T23:43:35.878563+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:34.357192+0000 mgr.a (mgr.14355) 3576 : audit [DBG] from='client.88197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:35.018130+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:35.861784+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:43:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:35.863488+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:43:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:35.873574+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:43:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:35 smithi171 bash[25040]: audit 2024-09-13T23:43:35.878563+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:36.944 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:43:36 smithi007 bash[22972]: debug 2024-09-13T23:43:36.596+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:43:36.944 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:43:36 smithi007 bash[22972]: debug 2024-09-13T23:43:36.596+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:43:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:36 smithi007 bash[22722]: cluster 2024-09-13T23:43:35.220993+0000 mgr.a (mgr.14355) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:36 smithi007 bash[22722]: audit 2024-09-13T23:43:35.880781+0000 mgr.a (mgr.14355) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:36 smithi131 bash[24745]: cluster 2024-09-13T23:43:35.220993+0000 mgr.a (mgr.14355) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:36 smithi131 bash[24745]: audit 2024-09-13T23:43:35.880781+0000 mgr.a (mgr.14355) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:36 smithi171 bash[25040]: cluster 2024-09-13T23:43:35.220993+0000 mgr.a (mgr.14355) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:36 smithi171 bash[25040]: audit 2024-09-13T23:43:35.880781+0000 mgr.a (mgr.14355) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:43:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:37 smithi007 bash[22722]: audit 2024-09-13T23:43:36.599927+0000 mgr.a (mgr.14355) 3579 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:43:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:37 smithi007 bash[22722]: cephadm 2024-09-13T23:43:36.601091+0000 mgr.a (mgr.14355) 3580 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:43:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:37 smithi131 bash[24745]: audit 2024-09-13T23:43:36.599927+0000 mgr.a (mgr.14355) 3579 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:43:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:37 smithi131 bash[24745]: cephadm 2024-09-13T23:43:36.601091+0000 mgr.a (mgr.14355) 3580 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:43:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:37 smithi171 bash[25040]: audit 2024-09-13T23:43:36.599927+0000 mgr.a (mgr.14355) 3579 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:43:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:37 smithi171 bash[25040]: cephadm 2024-09-13T23:43:36.601091+0000 mgr.a (mgr.14355) 3580 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:43:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:38 smithi007 bash[22722]: cluster 2024-09-13T23:43:37.223818+0000 mgr.a (mgr.14355) 3581 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:38 smithi131 bash[24745]: cluster 2024-09-13T23:43:37.223818+0000 mgr.a (mgr.14355) 3581 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:38 smithi171 bash[25040]: cluster 2024-09-13T23:43:37.223818+0000 mgr.a (mgr.14355) 3581 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:43:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:39.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:40.515 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:40 smithi131 bash[24745]: cluster 2024-09-13T23:43:39.224605+0000 mgr.a (mgr.14355) 3582 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:40 smithi131 bash[24745]: audit 2024-09-13T23:43:40.103046+0000 mgr.a (mgr.14355) 3583 : audit [DBG] from='client.88374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:40 smithi171 bash[25040]: cluster 2024-09-13T23:43:39.224605+0000 mgr.a (mgr.14355) 3582 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:40 smithi171 bash[25040]: audit 2024-09-13T23:43:40.103046+0000 mgr.a (mgr.14355) 3583 : audit [DBG] from='client.88374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:40 smithi007 bash[22722]: cluster 2024-09-13T23:43:39.224605+0000 mgr.a (mgr.14355) 3582 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:40 smithi007 bash[22722]: audit 2024-09-13T23:43:40.103046+0000 mgr.a (mgr.14355) 3583 : audit [DBG] from='client.88374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:42 smithi131 bash[24745]: cluster 2024-09-13T23:43:41.227105+0000 mgr.a (mgr.14355) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:42 smithi171 bash[25040]: cluster 2024-09-13T23:43:41.227105+0000 mgr.a (mgr.14355) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:42 smithi007 bash[22722]: cluster 2024-09-13T23:43:41.227105+0000 mgr.a (mgr.14355) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:44 smithi131 bash[24745]: cluster 2024-09-13T23:43:43.227878+0000 mgr.a (mgr.14355) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:44 smithi171 bash[25040]: cluster 2024-09-13T23:43:43.227878+0000 mgr.a (mgr.14355) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:44 smithi007 bash[22722]: cluster 2024-09-13T23:43:43.227878+0000 mgr.a (mgr.14355) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:45.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:45.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:46.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:46.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:46.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:46.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:46.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:46 smithi131 bash[24745]: cluster 2024-09-13T23:43:45.229469+0000 mgr.a (mgr.14355) 3586 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:46 smithi131 bash[24745]: audit 2024-09-13T23:43:45.847339+0000 mgr.a (mgr.14355) 3587 : audit [DBG] from='client.88446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:46 smithi171 bash[25040]: cluster 2024-09-13T23:43:45.229469+0000 mgr.a (mgr.14355) 3586 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:46 smithi171 bash[25040]: audit 2024-09-13T23:43:45.847339+0000 mgr.a (mgr.14355) 3587 : audit [DBG] from='client.88446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:46 smithi007 bash[22722]: cluster 2024-09-13T23:43:45.229469+0000 mgr.a (mgr.14355) 3586 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:46 smithi007 bash[22722]: audit 2024-09-13T23:43:45.847339+0000 mgr.a (mgr.14355) 3587 : audit [DBG] from='client.88446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:48 smithi131 bash[24745]: cluster 2024-09-13T23:43:47.231346+0000 mgr.a (mgr.14355) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:48 smithi171 bash[25040]: cluster 2024-09-13T23:43:47.231346+0000 mgr.a (mgr.14355) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:48 smithi007 bash[22722]: cluster 2024-09-13T23:43:47.231346+0000 mgr.a (mgr.14355) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:51.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:51.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:51.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:50 smithi131 bash[24745]: cluster 2024-09-13T23:43:49.232148+0000 mgr.a (mgr.14355) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:50 smithi171 bash[25040]: cluster 2024-09-13T23:43:49.232148+0000 mgr.a (mgr.14355) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:50 smithi007 bash[22722]: cluster 2024-09-13T23:43:49.232148+0000 mgr.a (mgr.14355) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:43:52.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:52.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:52.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:52 smithi131 bash[24745]: cluster 2024-09-13T23:43:51.234195+0000 mgr.a (mgr.14355) 3590 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:52 smithi131 bash[24745]: audit 2024-09-13T23:43:51.600612+0000 mgr.a (mgr.14355) 3591 : audit [DBG] from='client.88521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:52 smithi171 bash[25040]: cluster 2024-09-13T23:43:51.234195+0000 mgr.a (mgr.14355) 3590 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:52 smithi171 bash[25040]: audit 2024-09-13T23:43:51.600612+0000 mgr.a (mgr.14355) 3591 : audit [DBG] from='client.88521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:52 smithi007 bash[22722]: cluster 2024-09-13T23:43:51.234195+0000 mgr.a (mgr.14355) 3590 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:43:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:52 smithi007 bash[22722]: audit 2024-09-13T23:43:51.600612+0000 mgr.a (mgr.14355) 3591 : audit [DBG] from='client.88521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:54 smithi131 bash[24745]: cluster 2024-09-13T23:43:53.235147+0000 mgr.a (mgr.14355) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:54 smithi171 bash[25040]: cluster 2024-09-13T23:43:53.235147+0000 mgr.a (mgr.14355) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:54 smithi007 bash[22722]: cluster 2024-09-13T23:43:53.235147+0000 mgr.a (mgr.14355) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:43:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:43:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:43:57.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:43:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:56 smithi131 bash[24745]: cluster 2024-09-13T23:43:55.236937+0000 mgr.a (mgr.14355) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:56 smithi171 bash[25040]: cluster 2024-09-13T23:43:55.236937+0000 mgr.a (mgr.14355) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:56 smithi007 bash[22722]: cluster 2024-09-13T23:43:55.236937+0000 mgr.a (mgr.14355) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:43:57.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:43:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:43:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:43:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:43:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:43:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:58 smithi131 bash[24745]: cluster 2024-09-13T23:43:57.237742+0000 mgr.a (mgr.14355) 3594 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:43:58 smithi131 bash[24745]: audit 2024-09-13T23:43:57.371021+0000 mgr.a (mgr.14355) 3595 : audit [DBG] from='client.88599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:58 smithi171 bash[25040]: cluster 2024-09-13T23:43:57.237742+0000 mgr.a (mgr.14355) 3594 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:43:58 smithi171 bash[25040]: audit 2024-09-13T23:43:57.371021+0000 mgr.a (mgr.14355) 3595 : audit [DBG] from='client.88599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:43:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:58 smithi007 bash[22722]: cluster 2024-09-13T23:43:57.237742+0000 mgr.a (mgr.14355) 3594 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:43:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:43:58 smithi007 bash[22722]: audit 2024-09-13T23:43:57.371021+0000 mgr.a (mgr.14355) 3595 : audit [DBG] from='client.88599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:00 smithi131 bash[24745]: cluster 2024-09-13T23:43:59.238725+0000 mgr.a (mgr.14355) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:00 smithi171 bash[25040]: cluster 2024-09-13T23:43:59.238725+0000 mgr.a (mgr.14355) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:00 smithi007 bash[22722]: cluster 2024-09-13T23:43:59.238725+0000 mgr.a (mgr.14355) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:02.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:02.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:02.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:03 smithi131 bash[24745]: cluster 2024-09-13T23:44:01.241012+0000 mgr.a (mgr.14355) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:03 smithi171 bash[25040]: cluster 2024-09-13T23:44:01.241012+0000 mgr.a (mgr.14355) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:03 smithi007 bash[22722]: cluster 2024-09-13T23:44:01.241012+0000 mgr.a (mgr.14355) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:03.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:03.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:03.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:03.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:03.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:04 smithi131 bash[24745]: audit 2024-09-13T23:44:03.116159+0000 mgr.a (mgr.14355) 3598 : audit [DBG] from='client.88674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:04 smithi171 bash[25040]: audit 2024-09-13T23:44:03.116159+0000 mgr.a (mgr.14355) 3598 : audit [DBG] from='client.88674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:04 smithi007 bash[22722]: audit 2024-09-13T23:44:03.116159+0000 mgr.a (mgr.14355) 3598 : audit [DBG] from='client.88674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:05 smithi131 bash[24745]: cluster 2024-09-13T23:44:03.242605+0000 mgr.a (mgr.14355) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:05 smithi171 bash[25040]: cluster 2024-09-13T23:44:03.242605+0000 mgr.a (mgr.14355) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:05 smithi007 bash[22722]: cluster 2024-09-13T23:44:03.242605+0000 mgr.a (mgr.14355) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:07 smithi131 bash[24745]: cluster 2024-09-13T23:44:05.244451+0000 mgr.a (mgr.14355) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:07 smithi171 bash[25040]: cluster 2024-09-13T23:44:05.244451+0000 mgr.a (mgr.14355) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:07 smithi007 bash[22722]: cluster 2024-09-13T23:44:05.244451+0000 mgr.a (mgr.14355) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:08.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:08.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:09 smithi131 bash[24745]: cluster 2024-09-13T23:44:07.245715+0000 mgr.a (mgr.14355) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:09 smithi171 bash[25040]: cluster 2024-09-13T23:44:07.245715+0000 mgr.a (mgr.14355) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:09.300 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:09 smithi007 bash[22722]: cluster 2024-09-13T23:44:07.245715+0000 mgr.a (mgr.14355) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:10 smithi131 bash[24745]: audit 2024-09-13T23:44:08.857510+0000 mgr.a (mgr.14355) 3602 : audit [DBG] from='client.88752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:10 smithi171 bash[25040]: audit 2024-09-13T23:44:08.857510+0000 mgr.a (mgr.14355) 3602 : audit [DBG] from='client.88752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:10 smithi007 bash[22722]: audit 2024-09-13T23:44:08.857510+0000 mgr.a (mgr.14355) 3602 : audit [DBG] from='client.88752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:11 smithi131 bash[24745]: cluster 2024-09-13T23:44:09.246371+0000 mgr.a (mgr.14355) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:11 smithi171 bash[25040]: cluster 2024-09-13T23:44:09.246371+0000 mgr.a (mgr.14355) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:11 smithi007 bash[22722]: cluster 2024-09-13T23:44:09.246371+0000 mgr.a (mgr.14355) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:13 smithi171 bash[25040]: cluster 2024-09-13T23:44:11.248565+0000 mgr.a (mgr.14355) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:13 smithi007 bash[22722]: cluster 2024-09-13T23:44:11.248565+0000 mgr.a (mgr.14355) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:13 smithi131 bash[24745]: cluster 2024-09-13T23:44:11.248565+0000 mgr.a (mgr.14355) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:14.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:15.063 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:15.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:15 smithi171 bash[25040]: cluster 2024-09-13T23:44:13.249337+0000 mgr.a (mgr.14355) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:15 smithi007 bash[22722]: cluster 2024-09-13T23:44:13.249337+0000 mgr.a (mgr.14355) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:15 smithi131 bash[24745]: cluster 2024-09-13T23:44:13.249337+0000 mgr.a (mgr.14355) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:16 smithi007 bash[22722]: audit 2024-09-13T23:44:14.635288+0000 mgr.a (mgr.14355) 3606 : audit [DBG] from='client.88827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:16 smithi131 bash[24745]: audit 2024-09-13T23:44:14.635288+0000 mgr.a (mgr.14355) 3606 : audit [DBG] from='client.88827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:16 smithi171 bash[25040]: audit 2024-09-13T23:44:14.635288+0000 mgr.a (mgr.14355) 3606 : audit [DBG] from='client.88827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:17 smithi007 bash[22722]: cluster 2024-09-13T23:44:15.251239+0000 mgr.a (mgr.14355) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:17 smithi131 bash[24745]: cluster 2024-09-13T23:44:15.251239+0000 mgr.a (mgr.14355) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:17 smithi171 bash[25040]: cluster 2024-09-13T23:44:15.251239+0000 mgr.a (mgr.14355) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:19.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:19 smithi007 bash[22722]: cluster 2024-09-13T23:44:17.252526+0000 mgr.a (mgr.14355) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:19 smithi131 bash[24745]: cluster 2024-09-13T23:44:17.252526+0000 mgr.a (mgr.14355) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:19 smithi171 bash[25040]: cluster 2024-09-13T23:44:17.252526+0000 mgr.a (mgr.14355) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:20.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:20.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:20.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:20.817 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:20.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:21 smithi007 bash[22722]: cluster 2024-09-13T23:44:19.253284+0000 mgr.a (mgr.14355) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:21 smithi131 bash[24745]: cluster 2024-09-13T23:44:19.253284+0000 mgr.a (mgr.14355) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:21 smithi171 bash[25040]: cluster 2024-09-13T23:44:19.253284+0000 mgr.a (mgr.14355) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:22 smithi007 bash[22722]: audit 2024-09-13T23:44:20.397664+0000 mgr.a (mgr.14355) 3610 : audit [DBG] from='client.88896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:22 smithi131 bash[24745]: audit 2024-09-13T23:44:20.397664+0000 mgr.a (mgr.14355) 3610 : audit [DBG] from='client.88896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:22 smithi171 bash[25040]: audit 2024-09-13T23:44:20.397664+0000 mgr.a (mgr.14355) 3610 : audit [DBG] from='client.88896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:23 smithi007 bash[22722]: cluster 2024-09-13T23:44:21.256056+0000 mgr.a (mgr.14355) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:23 smithi131 bash[24745]: cluster 2024-09-13T23:44:21.256056+0000 mgr.a (mgr.14355) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:23 smithi171 bash[25040]: cluster 2024-09-13T23:44:21.256056+0000 mgr.a (mgr.14355) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:25 smithi007 bash[22722]: cluster 2024-09-13T23:44:23.256837+0000 mgr.a (mgr.14355) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:25 smithi131 bash[24745]: cluster 2024-09-13T23:44:23.256837+0000 mgr.a (mgr.14355) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:25 smithi171 bash[25040]: cluster 2024-09-13T23:44:23.256837+0000 mgr.a (mgr.14355) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:26.558 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:27 smithi007 bash[22722]: cluster 2024-09-13T23:44:25.258400+0000 mgr.a (mgr.14355) 3613 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:44:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:27 smithi007 bash[22722]: audit 2024-09-13T23:44:26.153039+0000 mgr.a (mgr.14355) 3614 : audit [DBG] from='client.88974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:27 smithi131 bash[24745]: cluster 2024-09-13T23:44:25.258400+0000 mgr.a (mgr.14355) 3613 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:44:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:27 smithi131 bash[24745]: audit 2024-09-13T23:44:26.153039+0000 mgr.a (mgr.14355) 3614 : audit [DBG] from='client.88974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:27 smithi171 bash[25040]: cluster 2024-09-13T23:44:25.258400+0000 mgr.a (mgr.14355) 3613 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:44:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:27 smithi171 bash[25040]: audit 2024-09-13T23:44:26.153039+0000 mgr.a (mgr.14355) 3614 : audit [DBG] from='client.88974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:29 smithi007 bash[22722]: cluster 2024-09-13T23:44:27.260226+0000 mgr.a (mgr.14355) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:44:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:29 smithi131 bash[24745]: cluster 2024-09-13T23:44:27.260226+0000 mgr.a (mgr.14355) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:44:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:29 smithi171 bash[25040]: cluster 2024-09-13T23:44:27.260226+0000 mgr.a (mgr.14355) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:44:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:31 smithi007 bash[22722]: cluster 2024-09-13T23:44:29.261021+0000 mgr.a (mgr.14355) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:31 smithi131 bash[24745]: cluster 2024-09-13T23:44:29.261021+0000 mgr.a (mgr.14355) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:31 smithi171 bash[25040]: cluster 2024-09-13T23:44:29.261021+0000 mgr.a (mgr.14355) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:44:31.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:32.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:33 smithi007 bash[22722]: cluster 2024-09-13T23:44:31.263079+0000 mgr.a (mgr.14355) 3617 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:33 smithi007 bash[22722]: audit 2024-09-13T23:44:31.891301+0000 mgr.a (mgr.14355) 3618 : audit [DBG] from='client.89052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:33 smithi131 bash[24745]: cluster 2024-09-13T23:44:31.263079+0000 mgr.a (mgr.14355) 3617 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:33 smithi131 bash[24745]: audit 2024-09-13T23:44:31.891301+0000 mgr.a (mgr.14355) 3618 : audit [DBG] from='client.89052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:33 smithi171 bash[25040]: cluster 2024-09-13T23:44:31.263079+0000 mgr.a (mgr.14355) 3617 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:33 smithi171 bash[25040]: audit 2024-09-13T23:44:31.891301+0000 mgr.a (mgr.14355) 3618 : audit [DBG] from='client.89052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:35 smithi007 bash[22722]: cluster 2024-09-13T23:44:33.264181+0000 mgr.a (mgr.14355) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:35 smithi131 bash[24745]: cluster 2024-09-13T23:44:33.264181+0000 mgr.a (mgr.14355) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:35 smithi171 bash[25040]: cluster 2024-09-13T23:44:33.264181+0000 mgr.a (mgr.14355) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:37.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:37.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:37 smithi007 bash[22722]: cluster 2024-09-13T23:44:35.266101+0000 mgr.a (mgr.14355) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:37 smithi007 bash[22722]: audit 2024-09-13T23:44:36.650565+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:44:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:37 smithi131 bash[24745]: cluster 2024-09-13T23:44:35.266101+0000 mgr.a (mgr.14355) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:37 smithi131 bash[24745]: audit 2024-09-13T23:44:36.650565+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:44:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:37 smithi171 bash[25040]: cluster 2024-09-13T23:44:35.266101+0000 mgr.a (mgr.14355) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:44:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:37 smithi171 bash[25040]: audit 2024-09-13T23:44:36.650565+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22722]: audit 2024-09-13T23:44:37.480361+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22722]: audit 2024-09-13T23:44:37.481727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22722]: audit 2024-09-13T23:44:37.490531+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22722]: audit 2024-09-13T23:44:37.493509+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22972]: debug 2024-09-13T23:44:38.207+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:44:38.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:44:38 smithi007 bash[22972]: debug 2024-09-13T23:44:38.219+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:44:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:38 smithi131 bash[24745]: audit 2024-09-13T23:44:37.480361+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:44:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:38 smithi131 bash[24745]: audit 2024-09-13T23:44:37.481727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:44:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:38 smithi131 bash[24745]: audit 2024-09-13T23:44:37.490531+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:44:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:38 smithi131 bash[24745]: audit 2024-09-13T23:44:37.493509+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:38 smithi171 bash[25040]: audit 2024-09-13T23:44:37.480361+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:38 smithi171 bash[25040]: audit 2024-09-13T23:44:37.481727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:38 smithi171 bash[25040]: audit 2024-09-13T23:44:37.490531+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:38 smithi171 bash[25040]: audit 2024-09-13T23:44:37.493509+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:38.600 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:38.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:38.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:38.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:38.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:39 smithi007 bash[22722]: cluster 2024-09-13T23:44:37.266919+0000 mgr.a (mgr.14355) 3621 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:39 smithi007 bash[22722]: audit 2024-09-13T23:44:37.495803+0000 mgr.a (mgr.14355) 3622 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:39 smithi007 bash[22722]: audit 2024-09-13T23:44:37.681385+0000 mgr.a (mgr.14355) 3623 : audit [DBG] from='client.89130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:39 smithi131 bash[24745]: cluster 2024-09-13T23:44:37.266919+0000 mgr.a (mgr.14355) 3621 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:39 smithi131 bash[24745]: audit 2024-09-13T23:44:37.495803+0000 mgr.a (mgr.14355) 3622 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:39 smithi131 bash[24745]: audit 2024-09-13T23:44:37.681385+0000 mgr.a (mgr.14355) 3623 : audit [DBG] from='client.89130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:39 smithi171 bash[25040]: cluster 2024-09-13T23:44:37.266919+0000 mgr.a (mgr.14355) 3621 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:44:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:39 smithi171 bash[25040]: audit 2024-09-13T23:44:37.495803+0000 mgr.a (mgr.14355) 3622 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:44:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:39 smithi171 bash[25040]: audit 2024-09-13T23:44:37.681385+0000 mgr.a (mgr.14355) 3623 : audit [DBG] from='client.89130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:40 smithi007 bash[22722]: audit 2024-09-13T23:44:38.212774+0000 mgr.a (mgr.14355) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:40 smithi007 bash[22722]: cephadm 2024-09-13T23:44:38.223920+0000 mgr.a (mgr.14355) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:44:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:40 smithi131 bash[24745]: audit 2024-09-13T23:44:38.212774+0000 mgr.a (mgr.14355) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:44:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:40 smithi131 bash[24745]: cephadm 2024-09-13T23:44:38.223920+0000 mgr.a (mgr.14355) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:44:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:40 smithi171 bash[25040]: audit 2024-09-13T23:44:38.212774+0000 mgr.a (mgr.14355) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:44:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:40 smithi171 bash[25040]: cephadm 2024-09-13T23:44:38.223920+0000 mgr.a (mgr.14355) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:44:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:41 smithi007 bash[22722]: cluster 2024-09-13T23:44:39.267824+0000 mgr.a (mgr.14355) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:41 smithi131 bash[24745]: cluster 2024-09-13T23:44:39.267824+0000 mgr.a (mgr.14355) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:41 smithi171 bash[25040]: cluster 2024-09-13T23:44:39.267824+0000 mgr.a (mgr.14355) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:43 smithi007 bash[22722]: cluster 2024-09-13T23:44:41.270180+0000 mgr.a (mgr.14355) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:43 smithi131 bash[24745]: cluster 2024-09-13T23:44:41.270180+0000 mgr.a (mgr.14355) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:43 smithi171 bash[25040]: cluster 2024-09-13T23:44:41.270180+0000 mgr.a (mgr.14355) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:43.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:44.355 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:44.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:44.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:44.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:45 smithi007 bash[22722]: cluster 2024-09-13T23:44:43.270928+0000 mgr.a (mgr.14355) 3628 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:45 smithi007 bash[22722]: audit 2024-09-13T23:44:43.931071+0000 mgr.a (mgr.14355) 3629 : audit [DBG] from='client.89316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:45 smithi131 bash[24745]: cluster 2024-09-13T23:44:43.270928+0000 mgr.a (mgr.14355) 3628 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:45 smithi131 bash[24745]: audit 2024-09-13T23:44:43.931071+0000 mgr.a (mgr.14355) 3629 : audit [DBG] from='client.89316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:45 smithi171 bash[25040]: cluster 2024-09-13T23:44:43.270928+0000 mgr.a (mgr.14355) 3628 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:45 smithi171 bash[25040]: audit 2024-09-13T23:44:43.931071+0000 mgr.a (mgr.14355) 3629 : audit [DBG] from='client.89316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:47 smithi007 bash[22722]: cluster 2024-09-13T23:44:45.272915+0000 mgr.a (mgr.14355) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:47 smithi131 bash[24745]: cluster 2024-09-13T23:44:45.272915+0000 mgr.a (mgr.14355) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:47 smithi171 bash[25040]: cluster 2024-09-13T23:44:45.272915+0000 mgr.a (mgr.14355) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:49 smithi007 bash[22722]: cluster 2024-09-13T23:44:47.274134+0000 mgr.a (mgr.14355) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:49 smithi131 bash[24745]: cluster 2024-09-13T23:44:47.274134+0000 mgr.a (mgr.14355) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:49 smithi171 bash[25040]: cluster 2024-09-13T23:44:47.274134+0000 mgr.a (mgr.14355) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:50.108 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:50.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:50.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:51 smithi007 bash[22722]: cluster 2024-09-13T23:44:49.274949+0000 mgr.a (mgr.14355) 3632 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:51 smithi007 bash[22722]: audit 2024-09-13T23:44:49.689580+0000 mgr.a (mgr.14355) 3633 : audit [DBG] from='client.89394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:51 smithi131 bash[24745]: cluster 2024-09-13T23:44:49.274949+0000 mgr.a (mgr.14355) 3632 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:51 smithi131 bash[24745]: audit 2024-09-13T23:44:49.689580+0000 mgr.a (mgr.14355) 3633 : audit [DBG] from='client.89394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:51 smithi171 bash[25040]: cluster 2024-09-13T23:44:49.274949+0000 mgr.a (mgr.14355) 3632 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:51 smithi171 bash[25040]: audit 2024-09-13T23:44:49.689580+0000 mgr.a (mgr.14355) 3633 : audit [DBG] from='client.89394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:53 smithi007 bash[22722]: cluster 2024-09-13T23:44:51.277332+0000 mgr.a (mgr.14355) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:53 smithi131 bash[24745]: cluster 2024-09-13T23:44:51.277332+0000 mgr.a (mgr.14355) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:53 smithi171 bash[25040]: cluster 2024-09-13T23:44:51.277332+0000 mgr.a (mgr.14355) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:44:55.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:44:55.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:44:55.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:44:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:55 smithi007 bash[22722]: cluster 2024-09-13T23:44:53.278147+0000 mgr.a (mgr.14355) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:55 smithi131 bash[24745]: cluster 2024-09-13T23:44:53.278147+0000 mgr.a (mgr.14355) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:55 smithi171 bash[25040]: cluster 2024-09-13T23:44:53.278147+0000 mgr.a (mgr.14355) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:55.844 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:44:55.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:44:55.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:44:55.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:44:55.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:44:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:57 smithi007 bash[22722]: cluster 2024-09-13T23:44:55.279638+0000 mgr.a (mgr.14355) 3636 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:57 smithi007 bash[22722]: audit 2024-09-13T23:44:55.438218+0000 mgr.a (mgr.14355) 3637 : audit [DBG] from='client.89469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:57 smithi131 bash[24745]: cluster 2024-09-13T23:44:55.279638+0000 mgr.a (mgr.14355) 3636 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:57 smithi131 bash[24745]: audit 2024-09-13T23:44:55.438218+0000 mgr.a (mgr.14355) 3637 : audit [DBG] from='client.89469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:57 smithi171 bash[25040]: cluster 2024-09-13T23:44:55.279638+0000 mgr.a (mgr.14355) 3636 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:44:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:57 smithi171 bash[25040]: audit 2024-09-13T23:44:55.438218+0000 mgr.a (mgr.14355) 3637 : audit [DBG] from='client.89469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:44:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:44:59 smithi007 bash[22722]: cluster 2024-09-13T23:44:57.281366+0000 mgr.a (mgr.14355) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:44:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:44:59 smithi131 bash[24745]: cluster 2024-09-13T23:44:57.281366+0000 mgr.a (mgr.14355) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:44:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:44:59 smithi171 bash[25040]: cluster 2024-09-13T23:44:57.281366+0000 mgr.a (mgr.14355) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:45:00.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:00.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:00.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:01 smithi007 bash[22722]: cluster 2024-09-13T23:44:59.282149+0000 mgr.a (mgr.14355) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:01 smithi131 bash[24745]: cluster 2024-09-13T23:44:59.282149+0000 mgr.a (mgr.14355) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:01 smithi171 bash[25040]: cluster 2024-09-13T23:44:59.282149+0000 mgr.a (mgr.14355) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:01.583 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:02 smithi007 bash[22722]: audit 2024-09-13T23:45:01.167231+0000 mgr.a (mgr.14355) 3640 : audit [DBG] from='client.89547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:02 smithi131 bash[24745]: audit 2024-09-13T23:45:01.167231+0000 mgr.a (mgr.14355) 3640 : audit [DBG] from='client.89547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:02 smithi171 bash[25040]: audit 2024-09-13T23:45:01.167231+0000 mgr.a (mgr.14355) 3640 : audit [DBG] from='client.89547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:03 smithi007 bash[22722]: cluster 2024-09-13T23:45:01.283759+0000 mgr.a (mgr.14355) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:03 smithi131 bash[24745]: cluster 2024-09-13T23:45:01.283759+0000 mgr.a (mgr.14355) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:03 smithi171 bash[25040]: cluster 2024-09-13T23:45:01.283759+0000 mgr.a (mgr.14355) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:05 smithi007 bash[22722]: cluster 2024-09-13T23:45:03.284769+0000 mgr.a (mgr.14355) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:45:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:05 smithi131 bash[24745]: cluster 2024-09-13T23:45:03.284769+0000 mgr.a (mgr.14355) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:45:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:05 smithi171 bash[25040]: cluster 2024-09-13T23:45:03.284769+0000 mgr.a (mgr.14355) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:45:06.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:06.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:06.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:07.332 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:07 smithi007 bash[22722]: cluster 2024-09-13T23:45:05.286735+0000 mgr.a (mgr.14355) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:45:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:07 smithi131 bash[24745]: cluster 2024-09-13T23:45:05.286735+0000 mgr.a (mgr.14355) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:45:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:07 smithi171 bash[25040]: cluster 2024-09-13T23:45:05.286735+0000 mgr.a (mgr.14355) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:45:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:08 smithi007 bash[22722]: audit 2024-09-13T23:45:06.917806+0000 mgr.a (mgr.14355) 3644 : audit [DBG] from='client.89625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:08 smithi131 bash[24745]: audit 2024-09-13T23:45:06.917806+0000 mgr.a (mgr.14355) 3644 : audit [DBG] from='client.89625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:08 smithi171 bash[25040]: audit 2024-09-13T23:45:06.917806+0000 mgr.a (mgr.14355) 3644 : audit [DBG] from='client.89625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:09 smithi007 bash[22722]: cluster 2024-09-13T23:45:07.287687+0000 mgr.a (mgr.14355) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:09 smithi131 bash[24745]: cluster 2024-09-13T23:45:07.287687+0000 mgr.a (mgr.14355) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:09 smithi171 bash[25040]: cluster 2024-09-13T23:45:07.287687+0000 mgr.a (mgr.14355) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:11 smithi007 bash[22722]: cluster 2024-09-13T23:45:09.288599+0000 mgr.a (mgr.14355) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:11 smithi131 bash[24745]: cluster 2024-09-13T23:45:09.288599+0000 mgr.a (mgr.14355) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:11 smithi171 bash[25040]: cluster 2024-09-13T23:45:09.288599+0000 mgr.a (mgr.14355) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:12.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:12.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:12.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:13.107 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:13.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:13 smithi007 bash[22722]: cluster 2024-09-13T23:45:11.290791+0000 mgr.a (mgr.14355) 3647 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:13 smithi131 bash[24745]: cluster 2024-09-13T23:45:11.290791+0000 mgr.a (mgr.14355) 3647 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:13 smithi171 bash[25040]: cluster 2024-09-13T23:45:11.290791+0000 mgr.a (mgr.14355) 3647 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:14 smithi131 bash[24745]: audit 2024-09-13T23:45:12.665542+0000 mgr.a (mgr.14355) 3648 : audit [DBG] from='client.89703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:14 smithi131 bash[24745]: cluster 2024-09-13T23:45:13.291738+0000 mgr.a (mgr.14355) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:14 smithi171 bash[25040]: audit 2024-09-13T23:45:12.665542+0000 mgr.a (mgr.14355) 3648 : audit [DBG] from='client.89703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:14 smithi171 bash[25040]: cluster 2024-09-13T23:45:13.291738+0000 mgr.a (mgr.14355) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:14 smithi007 bash[22722]: audit 2024-09-13T23:45:12.665542+0000 mgr.a (mgr.14355) 3648 : audit [DBG] from='client.89703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:14 smithi007 bash[22722]: cluster 2024-09-13T23:45:13.291738+0000 mgr.a (mgr.14355) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:16 smithi007 bash[22722]: cluster 2024-09-13T23:45:15.293473+0000 mgr.a (mgr.14355) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:16 smithi131 bash[24745]: cluster 2024-09-13T23:45:15.293473+0000 mgr.a (mgr.14355) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:16 smithi171 bash[25040]: cluster 2024-09-13T23:45:15.293473+0000 mgr.a (mgr.14355) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:18 smithi007 bash[22722]: cluster 2024-09-13T23:45:17.294760+0000 mgr.a (mgr.14355) 3651 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:18 smithi131 bash[24745]: cluster 2024-09-13T23:45:17.294760+0000 mgr.a (mgr.14355) 3651 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:18 smithi171 bash[25040]: cluster 2024-09-13T23:45:17.294760+0000 mgr.a (mgr.14355) 3651 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:18.857 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:18.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:19 smithi007 bash[22722]: audit 2024-09-13T23:45:18.436799+0000 mgr.a (mgr.14355) 3652 : audit [DBG] from='client.89775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:19 smithi131 bash[24745]: audit 2024-09-13T23:45:18.436799+0000 mgr.a (mgr.14355) 3652 : audit [DBG] from='client.89775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:19 smithi171 bash[25040]: audit 2024-09-13T23:45:18.436799+0000 mgr.a (mgr.14355) 3652 : audit [DBG] from='client.89775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:20 smithi007 bash[22722]: cluster 2024-09-13T23:45:19.295666+0000 mgr.a (mgr.14355) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:20 smithi131 bash[24745]: cluster 2024-09-13T23:45:19.295666+0000 mgr.a (mgr.14355) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:20 smithi171 bash[25040]: cluster 2024-09-13T23:45:19.295666+0000 mgr.a (mgr.14355) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:22 smithi007 bash[22722]: cluster 2024-09-13T23:45:21.297872+0000 mgr.a (mgr.14355) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:22 smithi131 bash[24745]: cluster 2024-09-13T23:45:21.297872+0000 mgr.a (mgr.14355) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:22 smithi171 bash[25040]: cluster 2024-09-13T23:45:21.297872+0000 mgr.a (mgr.14355) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:23.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:23.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:23.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:24.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:24.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:24 smithi007 bash[22722]: cluster 2024-09-13T23:45:23.298669+0000 mgr.a (mgr.14355) 3655 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:24 smithi007 bash[22722]: audit 2024-09-13T23:45:24.194435+0000 mgr.a (mgr.14355) 3656 : audit [DBG] from='client.89853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:24 smithi131 bash[24745]: cluster 2024-09-13T23:45:23.298669+0000 mgr.a (mgr.14355) 3655 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:24 smithi131 bash[24745]: audit 2024-09-13T23:45:24.194435+0000 mgr.a (mgr.14355) 3656 : audit [DBG] from='client.89853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:24 smithi171 bash[25040]: cluster 2024-09-13T23:45:23.298669+0000 mgr.a (mgr.14355) 3655 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:24 smithi171 bash[25040]: audit 2024-09-13T23:45:24.194435+0000 mgr.a (mgr.14355) 3656 : audit [DBG] from='client.89853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:26 smithi007 bash[22722]: cluster 2024-09-13T23:45:25.300605+0000 mgr.a (mgr.14355) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:26 smithi131 bash[24745]: cluster 2024-09-13T23:45:25.300605+0000 mgr.a (mgr.14355) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:26 smithi171 bash[25040]: cluster 2024-09-13T23:45:25.300605+0000 mgr.a (mgr.14355) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:45:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:28 smithi007 bash[22722]: cluster 2024-09-13T23:45:27.301872+0000 mgr.a (mgr.14355) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:28 smithi131 bash[24745]: cluster 2024-09-13T23:45:27.301872+0000 mgr.a (mgr.14355) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:28 smithi171 bash[25040]: cluster 2024-09-13T23:45:27.301872+0000 mgr.a (mgr.14355) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:45:29.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:29.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:29.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:30.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:30 smithi007 bash[22722]: cluster 2024-09-13T23:45:29.302662+0000 mgr.a (mgr.14355) 3659 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:30 smithi007 bash[22722]: audit 2024-09-13T23:45:29.941495+0000 mgr.a (mgr.14355) 3660 : audit [DBG] from='client.89931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:30 smithi131 bash[24745]: cluster 2024-09-13T23:45:29.302662+0000 mgr.a (mgr.14355) 3659 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:30 smithi131 bash[24745]: audit 2024-09-13T23:45:29.941495+0000 mgr.a (mgr.14355) 3660 : audit [DBG] from='client.89931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:30 smithi171 bash[25040]: cluster 2024-09-13T23:45:29.302662+0000 mgr.a (mgr.14355) 3659 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:30 smithi171 bash[25040]: audit 2024-09-13T23:45:29.941495+0000 mgr.a (mgr.14355) 3660 : audit [DBG] from='client.89931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:32 smithi007 bash[22722]: cluster 2024-09-13T23:45:31.304984+0000 mgr.a (mgr.14355) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:45:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:32 smithi131 bash[24745]: cluster 2024-09-13T23:45:31.304984+0000 mgr.a (mgr.14355) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:45:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:32 smithi171 bash[25040]: cluster 2024-09-13T23:45:31.304984+0000 mgr.a (mgr.14355) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:45:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:34 smithi007 bash[22722]: cluster 2024-09-13T23:45:33.305751+0000 mgr.a (mgr.14355) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:45:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:34 smithi131 bash[24745]: cluster 2024-09-13T23:45:33.305751+0000 mgr.a (mgr.14355) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:45:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:34 smithi171 bash[25040]: cluster 2024-09-13T23:45:33.305751+0000 mgr.a (mgr.14355) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:45:35.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:36.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:36.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:36.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:36.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:36.130 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:36 smithi007 bash[22722]: cluster 2024-09-13T23:45:35.307274+0000 mgr.a (mgr.14355) 3663 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:36 smithi007 bash[22722]: audit 2024-09-13T23:45:35.687961+0000 mgr.a (mgr.14355) 3664 : audit [DBG] from='client.90009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:36 smithi131 bash[24745]: cluster 2024-09-13T23:45:35.307274+0000 mgr.a (mgr.14355) 3663 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:36 smithi131 bash[24745]: audit 2024-09-13T23:45:35.687961+0000 mgr.a (mgr.14355) 3664 : audit [DBG] from='client.90009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:36 smithi171 bash[25040]: cluster 2024-09-13T23:45:35.307274+0000 mgr.a (mgr.14355) 3663 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:36 smithi171 bash[25040]: audit 2024-09-13T23:45:35.687961+0000 mgr.a (mgr.14355) 3664 : audit [DBG] from='client.90009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:38 smithi007 bash[22722]: cluster 2024-09-13T23:45:37.308933+0000 mgr.a (mgr.14355) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:45:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:38 smithi007 bash[22722]: audit 2024-09-13T23:45:38.276923+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:45:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:38 smithi131 bash[24745]: cluster 2024-09-13T23:45:37.308933+0000 mgr.a (mgr.14355) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:45:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:38 smithi131 bash[24745]: audit 2024-09-13T23:45:38.276923+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:45:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:38 smithi171 bash[25040]: cluster 2024-09-13T23:45:37.308933+0000 mgr.a (mgr.14355) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:45:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:38 smithi171 bash[25040]: audit 2024-09-13T23:45:38.276923+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:45:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:40 smithi007 bash[22722]: cluster 2024-09-13T23:45:39.309693+0000 mgr.a (mgr.14355) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:40 smithi131 bash[24745]: cluster 2024-09-13T23:45:39.309693+0000 mgr.a (mgr.14355) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:40 smithi171 bash[25040]: cluster 2024-09-13T23:45:39.309693+0000 mgr.a (mgr.14355) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:45:41.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:41.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:41.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:41.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:42 smithi007 bash[22722]: cluster 2024-09-13T23:45:41.311436+0000 mgr.a (mgr.14355) 3667 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:42 smithi007 bash[22722]: audit 2024-09-13T23:45:41.466901+0000 mgr.a (mgr.14355) 3668 : audit [DBG] from='client.90084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:42 smithi131 bash[24745]: cluster 2024-09-13T23:45:41.311436+0000 mgr.a (mgr.14355) 3667 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:42 smithi131 bash[24745]: audit 2024-09-13T23:45:41.466901+0000 mgr.a (mgr.14355) 3668 : audit [DBG] from='client.90084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:42 smithi171 bash[25040]: cluster 2024-09-13T23:45:41.311436+0000 mgr.a (mgr.14355) 3667 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:45:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:42 smithi171 bash[25040]: audit 2024-09-13T23:45:41.466901+0000 mgr.a (mgr.14355) 3668 : audit [DBG] from='client.90084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: cluster 2024-09-13T23:45:43.312441+0000 mgr.a (mgr.14355) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:45:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.634031+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.638477+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.647824+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.652663+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.659502+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:43.664771+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:44.384793+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:44.386406+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:44.394874+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:44 smithi007 bash[22722]: audit 2024-09-13T23:45:44.399544+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: cluster 2024-09-13T23:45:43.312441+0000 mgr.a (mgr.14355) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.634031+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.638477+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.647824+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.652663+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.659502+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:43.664771+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:44.384793+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:44.386406+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:44.394874+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:44 smithi131 bash[24745]: audit 2024-09-13T23:45:44.399544+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: cluster 2024-09-13T23:45:43.312441+0000 mgr.a (mgr.14355) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:45:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.634031+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.638477+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.647824+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.652663+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.659502+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:43.664771+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:44.384793+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:44.386406+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:44.394874+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:44 smithi171 bash[25040]: audit 2024-09-13T23:45:44.399544+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:45:45 smithi007 bash[22972]: debug 2024-09-13T23:45:45.126+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:45:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:45:45 smithi007 bash[22972]: debug 2024-09-13T23:45:45.130+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:45:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:45 smithi007 bash[22722]: audit 2024-09-13T23:45:44.401863+0000 mgr.a (mgr.14355) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:45 smithi007 bash[22722]: audit 2024-09-13T23:45:45.132660+0000 mgr.a (mgr.14355) 3671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:45:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:45 smithi007 bash[22722]: cephadm 2024-09-13T23:45:45.134367+0000 mgr.a (mgr.14355) 3672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:45:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:45 smithi131 bash[24745]: audit 2024-09-13T23:45:44.401863+0000 mgr.a (mgr.14355) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:45 smithi131 bash[24745]: audit 2024-09-13T23:45:45.132660+0000 mgr.a (mgr.14355) 3671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:45:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:45 smithi131 bash[24745]: cephadm 2024-09-13T23:45:45.134367+0000 mgr.a (mgr.14355) 3672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:45:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:45 smithi171 bash[25040]: audit 2024-09-13T23:45:44.401863+0000 mgr.a (mgr.14355) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:45:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:45 smithi171 bash[25040]: audit 2024-09-13T23:45:45.132660+0000 mgr.a (mgr.14355) 3671 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:45:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:45 smithi171 bash[25040]: cephadm 2024-09-13T23:45:45.134367+0000 mgr.a (mgr.14355) 3672 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:45:46.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:46.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:46 smithi007 bash[22722]: cluster 2024-09-13T23:45:45.314513+0000 mgr.a (mgr.14355) 3673 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:45:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:46 smithi131 bash[24745]: cluster 2024-09-13T23:45:45.314513+0000 mgr.a (mgr.14355) 3673 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:45:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:46 smithi171 bash[25040]: cluster 2024-09-13T23:45:45.314513+0000 mgr.a (mgr.14355) 3673 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:45:47.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:47.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:47.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:47.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:48 smithi007 bash[22722]: audit 2024-09-13T23:45:47.233606+0000 mgr.a (mgr.14355) 3674 : audit [DBG] from='client.90264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:48 smithi007 bash[22722]: cluster 2024-09-13T23:45:47.315409+0000 mgr.a (mgr.14355) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:48 smithi131 bash[24745]: audit 2024-09-13T23:45:47.233606+0000 mgr.a (mgr.14355) 3674 : audit [DBG] from='client.90264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:48 smithi131 bash[24745]: cluster 2024-09-13T23:45:47.315409+0000 mgr.a (mgr.14355) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:48 smithi171 bash[25040]: audit 2024-09-13T23:45:47.233606+0000 mgr.a (mgr.14355) 3674 : audit [DBG] from='client.90264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:48 smithi171 bash[25040]: cluster 2024-09-13T23:45:47.315409+0000 mgr.a (mgr.14355) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:50 smithi007 bash[22722]: cluster 2024-09-13T23:45:49.316272+0000 mgr.a (mgr.14355) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:50 smithi131 bash[24745]: cluster 2024-09-13T23:45:49.316272+0000 mgr.a (mgr.14355) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:50 smithi171 bash[25040]: cluster 2024-09-13T23:45:49.316272+0000 mgr.a (mgr.14355) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:52.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:52.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:52.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:52 smithi007 bash[22722]: cluster 2024-09-13T23:45:51.318659+0000 mgr.a (mgr.14355) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:52 smithi131 bash[24745]: cluster 2024-09-13T23:45:51.318659+0000 mgr.a (mgr.14355) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:52 smithi171 bash[25040]: cluster 2024-09-13T23:45:51.318659+0000 mgr.a (mgr.14355) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:53.375 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:53 smithi007 bash[22722]: audit 2024-09-13T23:45:52.967271+0000 mgr.a (mgr.14355) 3678 : audit [DBG] from='client.90339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:53 smithi131 bash[24745]: audit 2024-09-13T23:45:52.967271+0000 mgr.a (mgr.14355) 3678 : audit [DBG] from='client.90339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:53 smithi171 bash[25040]: audit 2024-09-13T23:45:52.967271+0000 mgr.a (mgr.14355) 3678 : audit [DBG] from='client.90339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:45:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:54 smithi007 bash[22722]: cluster 2024-09-13T23:45:53.319210+0000 mgr.a (mgr.14355) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:54 smithi131 bash[24745]: cluster 2024-09-13T23:45:53.319210+0000 mgr.a (mgr.14355) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:54 smithi171 bash[25040]: cluster 2024-09-13T23:45:53.319210+0000 mgr.a (mgr.14355) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:56 smithi007 bash[22722]: cluster 2024-09-13T23:45:55.320921+0000 mgr.a (mgr.14355) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:56 smithi131 bash[24745]: cluster 2024-09-13T23:45:55.320921+0000 mgr.a (mgr.14355) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:56 smithi171 bash[25040]: cluster 2024-09-13T23:45:55.320921+0000 mgr.a (mgr.14355) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:45:58.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:45:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:45:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:45:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:58 smithi007 bash[22722]: cluster 2024-09-13T23:45:57.322192+0000 mgr.a (mgr.14355) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:45:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:58 smithi131 bash[24745]: cluster 2024-09-13T23:45:57.322192+0000 mgr.a (mgr.14355) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:45:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:58 smithi171 bash[25040]: cluster 2024-09-13T23:45:57.322192+0000 mgr.a (mgr.14355) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:45:59.140 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:45:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:45:59.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:45:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:45:59.141 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:45:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:45:59 smithi007 bash[22722]: audit 2024-09-13T23:45:58.713753+0000 mgr.a (mgr.14355) 3682 : audit [DBG] from='client.90414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:45:59 smithi131 bash[24745]: audit 2024-09-13T23:45:58.713753+0000 mgr.a (mgr.14355) 3682 : audit [DBG] from='client.90414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:45:59 smithi171 bash[25040]: audit 2024-09-13T23:45:58.713753+0000 mgr.a (mgr.14355) 3682 : audit [DBG] from='client.90414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:00 smithi007 bash[22722]: cluster 2024-09-13T23:45:59.323067+0000 mgr.a (mgr.14355) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:00 smithi131 bash[24745]: cluster 2024-09-13T23:45:59.323067+0000 mgr.a (mgr.14355) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:00 smithi171 bash[25040]: cluster 2024-09-13T23:45:59.323067+0000 mgr.a (mgr.14355) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:02 smithi007 bash[22722]: cluster 2024-09-13T23:46:01.325308+0000 mgr.a (mgr.14355) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:02 smithi131 bash[24745]: cluster 2024-09-13T23:46:01.325308+0000 mgr.a (mgr.14355) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:02 smithi171 bash[25040]: cluster 2024-09-13T23:46:01.325308+0000 mgr.a (mgr.14355) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:04.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:04.142 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:04.143 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:04.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:04.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:04 smithi007 bash[22722]: cluster 2024-09-13T23:46:03.326093+0000 mgr.a (mgr.14355) 3685 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:04 smithi131 bash[24745]: cluster 2024-09-13T23:46:03.326093+0000 mgr.a (mgr.14355) 3685 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:04 smithi171 bash[25040]: cluster 2024-09-13T23:46:03.326093+0000 mgr.a (mgr.14355) 3685 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:05 smithi131 bash[24745]: audit 2024-09-13T23:46:04.470875+0000 mgr.a (mgr.14355) 3686 : audit [DBG] from='client.90489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:05 smithi171 bash[25040]: audit 2024-09-13T23:46:04.470875+0000 mgr.a (mgr.14355) 3686 : audit [DBG] from='client.90489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:05 smithi007 bash[22722]: audit 2024-09-13T23:46:04.470875+0000 mgr.a (mgr.14355) 3686 : audit [DBG] from='client.90489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:06 smithi131 bash[24745]: cluster 2024-09-13T23:46:05.328019+0000 mgr.a (mgr.14355) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:06 smithi171 bash[25040]: cluster 2024-09-13T23:46:05.328019+0000 mgr.a (mgr.14355) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:06 smithi007 bash[22722]: cluster 2024-09-13T23:46:05.328019+0000 mgr.a (mgr.14355) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:08 smithi131 bash[24745]: cluster 2024-09-13T23:46:07.329288+0000 mgr.a (mgr.14355) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:08 smithi171 bash[25040]: cluster 2024-09-13T23:46:07.329288+0000 mgr.a (mgr.14355) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:08 smithi007 bash[22722]: cluster 2024-09-13T23:46:07.329288+0000 mgr.a (mgr.14355) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:09.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:10.651 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:10 smithi131 bash[24745]: cluster 2024-09-13T23:46:09.330037+0000 mgr.a (mgr.14355) 3689 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:10 smithi171 bash[25040]: cluster 2024-09-13T23:46:09.330037+0000 mgr.a (mgr.14355) 3689 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:10 smithi007 bash[22722]: cluster 2024-09-13T23:46:09.330037+0000 mgr.a (mgr.14355) 3689 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:12.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:11 smithi131 bash[24745]: audit 2024-09-13T23:46:10.226079+0000 mgr.a (mgr.14355) 3690 : audit [DBG] from='client.90567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:11 smithi171 bash[25040]: audit 2024-09-13T23:46:10.226079+0000 mgr.a (mgr.14355) 3690 : audit [DBG] from='client.90567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:11 smithi007 bash[22722]: audit 2024-09-13T23:46:10.226079+0000 mgr.a (mgr.14355) 3690 : audit [DBG] from='client.90567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:12 smithi131 bash[24745]: cluster 2024-09-13T23:46:11.332766+0000 mgr.a (mgr.14355) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:12 smithi171 bash[25040]: cluster 2024-09-13T23:46:11.332766+0000 mgr.a (mgr.14355) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:12 smithi007 bash[22722]: cluster 2024-09-13T23:46:11.332766+0000 mgr.a (mgr.14355) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:14 smithi131 bash[24745]: cluster 2024-09-13T23:46:13.333586+0000 mgr.a (mgr.14355) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:14 smithi171 bash[25040]: cluster 2024-09-13T23:46:13.333586+0000 mgr.a (mgr.14355) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:14 smithi007 bash[22722]: cluster 2024-09-13T23:46:13.333586+0000 mgr.a (mgr.14355) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:16.428 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:16.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:16 smithi131 bash[24745]: cluster 2024-09-13T23:46:15.335129+0000 mgr.a (mgr.14355) 3693 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:16 smithi131 bash[24745]: audit 2024-09-13T23:46:15.989871+0000 mgr.a (mgr.14355) 3694 : audit [DBG] from='client.90639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:16 smithi171 bash[25040]: cluster 2024-09-13T23:46:15.335129+0000 mgr.a (mgr.14355) 3693 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:16 smithi171 bash[25040]: audit 2024-09-13T23:46:15.989871+0000 mgr.a (mgr.14355) 3694 : audit [DBG] from='client.90639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:16 smithi007 bash[22722]: cluster 2024-09-13T23:46:15.335129+0000 mgr.a (mgr.14355) 3693 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:16 smithi007 bash[22722]: audit 2024-09-13T23:46:15.989871+0000 mgr.a (mgr.14355) 3694 : audit [DBG] from='client.90639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:18 smithi131 bash[24745]: cluster 2024-09-13T23:46:17.336859+0000 mgr.a (mgr.14355) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:18 smithi171 bash[25040]: cluster 2024-09-13T23:46:17.336859+0000 mgr.a (mgr.14355) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:18 smithi007 bash[22722]: cluster 2024-09-13T23:46:17.336859+0000 mgr.a (mgr.14355) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:46:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:20 smithi131 bash[24745]: cluster 2024-09-13T23:46:19.337644+0000 mgr.a (mgr.14355) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:46:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:20 smithi171 bash[25040]: cluster 2024-09-13T23:46:19.337644+0000 mgr.a (mgr.14355) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:46:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:20 smithi007 bash[22722]: cluster 2024-09-13T23:46:19.337644+0000 mgr.a (mgr.14355) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:46:21.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:22.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:22.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:22.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:22 smithi131 bash[24745]: cluster 2024-09-13T23:46:21.339742+0000 mgr.a (mgr.14355) 3697 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:22 smithi131 bash[24745]: audit 2024-09-13T23:46:21.758507+0000 mgr.a (mgr.14355) 3698 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:22 smithi171 bash[25040]: cluster 2024-09-13T23:46:21.339742+0000 mgr.a (mgr.14355) 3697 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:22 smithi171 bash[25040]: audit 2024-09-13T23:46:21.758507+0000 mgr.a (mgr.14355) 3698 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:22 smithi007 bash[22722]: cluster 2024-09-13T23:46:21.339742+0000 mgr.a (mgr.14355) 3697 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:22 smithi007 bash[22722]: audit 2024-09-13T23:46:21.758507+0000 mgr.a (mgr.14355) 3698 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:24 smithi131 bash[24745]: cluster 2024-09-13T23:46:23.340618+0000 mgr.a (mgr.14355) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:46:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:24 smithi171 bash[25040]: cluster 2024-09-13T23:46:23.340618+0000 mgr.a (mgr.14355) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:46:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:24 smithi007 bash[22722]: cluster 2024-09-13T23:46:23.340618+0000 mgr.a (mgr.14355) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:46:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:26 smithi131 bash[24745]: cluster 2024-09-13T23:46:25.342407+0000 mgr.a (mgr.14355) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:46:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:26 smithi171 bash[25040]: cluster 2024-09-13T23:46:25.342407+0000 mgr.a (mgr.14355) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:46:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:26 smithi007 bash[22722]: cluster 2024-09-13T23:46:25.342407+0000 mgr.a (mgr.14355) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:46:27.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:27.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:27.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:27.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:27.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:28 smithi131 bash[24745]: cluster 2024-09-13T23:46:27.343193+0000 mgr.a (mgr.14355) 3701 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:28 smithi131 bash[24745]: audit 2024-09-13T23:46:27.501013+0000 mgr.a (mgr.14355) 3702 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:28 smithi171 bash[25040]: cluster 2024-09-13T23:46:27.343193+0000 mgr.a (mgr.14355) 3701 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:28 smithi171 bash[25040]: audit 2024-09-13T23:46:27.501013+0000 mgr.a (mgr.14355) 3702 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:28 smithi007 bash[22722]: cluster 2024-09-13T23:46:27.343193+0000 mgr.a (mgr.14355) 3701 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:28 smithi007 bash[22722]: audit 2024-09-13T23:46:27.501013+0000 mgr.a (mgr.14355) 3702 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:30 smithi131 bash[24745]: cluster 2024-09-13T23:46:29.344075+0000 mgr.a (mgr.14355) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:30 smithi171 bash[25040]: cluster 2024-09-13T23:46:29.344075+0000 mgr.a (mgr.14355) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:30 smithi007 bash[22722]: cluster 2024-09-13T23:46:29.344075+0000 mgr.a (mgr.14355) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:32 smithi131 bash[24745]: cluster 2024-09-13T23:46:31.346325+0000 mgr.a (mgr.14355) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:32 smithi171 bash[25040]: cluster 2024-09-13T23:46:31.346325+0000 mgr.a (mgr.14355) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:32 smithi007 bash[22722]: cluster 2024-09-13T23:46:31.346325+0000 mgr.a (mgr.14355) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:33.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:34 smithi131 bash[24745]: audit 2024-09-13T23:46:33.266409+0000 mgr.a (mgr.14355) 3705 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:34 smithi131 bash[24745]: cluster 2024-09-13T23:46:33.346902+0000 mgr.a (mgr.14355) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:34 smithi171 bash[25040]: audit 2024-09-13T23:46:33.266409+0000 mgr.a (mgr.14355) 3705 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:34 smithi171 bash[25040]: cluster 2024-09-13T23:46:33.346902+0000 mgr.a (mgr.14355) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:34 smithi007 bash[22722]: audit 2024-09-13T23:46:33.266409+0000 mgr.a (mgr.14355) 3705 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:34 smithi007 bash[22722]: cluster 2024-09-13T23:46:33.346902+0000 mgr.a (mgr.14355) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:36 smithi131 bash[24745]: cluster 2024-09-13T23:46:35.348735+0000 mgr.a (mgr.14355) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:36 smithi171 bash[25040]: cluster 2024-09-13T23:46:35.348735+0000 mgr.a (mgr.14355) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:36 smithi007 bash[22722]: cluster 2024-09-13T23:46:35.348735+0000 mgr.a (mgr.14355) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:38.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:38.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:38.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:38 smithi171 bash[25040]: cluster 2024-09-13T23:46:37.349984+0000 mgr.a (mgr.14355) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:38 smithi007 bash[22722]: cluster 2024-09-13T23:46:37.349984+0000 mgr.a (mgr.14355) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:38 smithi131 bash[24745]: cluster 2024-09-13T23:46:37.349984+0000 mgr.a (mgr.14355) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:39.483 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:39 smithi171 bash[25040]: audit 2024-09-13T23:46:39.047015+0000 mgr.a (mgr.14355) 3709 : audit [DBG] from='client.90945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:39 smithi007 bash[22722]: audit 2024-09-13T23:46:39.047015+0000 mgr.a (mgr.14355) 3709 : audit [DBG] from='client.90945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:39 smithi131 bash[24745]: audit 2024-09-13T23:46:39.047015+0000 mgr.a (mgr.14355) 3709 : audit [DBG] from='client.90945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:40 smithi007 bash[22722]: cluster 2024-09-13T23:46:39.350586+0000 mgr.a (mgr.14355) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:40 smithi131 bash[24745]: cluster 2024-09-13T23:46:39.350586+0000 mgr.a (mgr.14355) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:40 smithi171 bash[25040]: cluster 2024-09-13T23:46:39.350586+0000 mgr.a (mgr.14355) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:42 smithi007 bash[22722]: cluster 2024-09-13T23:46:41.353050+0000 mgr.a (mgr.14355) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:42 smithi131 bash[24745]: cluster 2024-09-13T23:46:41.353050+0000 mgr.a (mgr.14355) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:42 smithi171 bash[25040]: cluster 2024-09-13T23:46:41.353050+0000 mgr.a (mgr.14355) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:44.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:44.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:44.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:44 smithi007 bash[22722]: cluster 2024-09-13T23:46:43.353974+0000 mgr.a (mgr.14355) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:45.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:44 smithi131 bash[24745]: cluster 2024-09-13T23:46:43.353974+0000 mgr.a (mgr.14355) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:44 smithi171 bash[25040]: cluster 2024-09-13T23:46:43.353974+0000 mgr.a (mgr.14355) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:45 smithi007 bash[22722]: audit 2024-09-13T23:46:44.818888+0000 mgr.a (mgr.14355) 3713 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:45 smithi007 bash[22722]: audit 2024-09-13T23:46:45.189438+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:46:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:45 smithi131 bash[24745]: audit 2024-09-13T23:46:44.818888+0000 mgr.a (mgr.14355) 3713 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:45 smithi131 bash[24745]: audit 2024-09-13T23:46:45.189438+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:46:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:45 smithi171 bash[25040]: audit 2024-09-13T23:46:44.818888+0000 mgr.a (mgr.14355) 3713 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:45 smithi171 bash[25040]: audit 2024-09-13T23:46:45.189438+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:46:46.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22972]: debug 2024-09-13T23:46:46.673+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22972]: debug 2024-09-13T23:46:46.677+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: cluster 2024-09-13T23:46:45.355497+0000 mgr.a (mgr.14355) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: audit 2024-09-13T23:46:45.947109+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: audit 2024-09-13T23:46:45.948714+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: audit 2024-09-13T23:46:45.958933+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: audit 2024-09-13T23:46:45.963903+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:46 smithi007 bash[22722]: audit 2024-09-13T23:46:45.966362+0000 mgr.a (mgr.14355) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: cluster 2024-09-13T23:46:45.355497+0000 mgr.a (mgr.14355) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: audit 2024-09-13T23:46:45.947109+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:46:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: audit 2024-09-13T23:46:45.948714+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:46:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: audit 2024-09-13T23:46:45.958933+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:46:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: audit 2024-09-13T23:46:45.963903+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:46 smithi131 bash[24745]: audit 2024-09-13T23:46:45.966362+0000 mgr.a (mgr.14355) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: cluster 2024-09-13T23:46:45.355497+0000 mgr.a (mgr.14355) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: audit 2024-09-13T23:46:45.947109+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: audit 2024-09-13T23:46:45.948714+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: audit 2024-09-13T23:46:45.958933+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: audit 2024-09-13T23:46:45.963903+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:46 smithi171 bash[25040]: audit 2024-09-13T23:46:45.966362+0000 mgr.a (mgr.14355) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:46:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:47 smithi007 bash[22722]: audit 2024-09-13T23:46:46.677820+0000 mgr.a (mgr.14355) 3716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:46:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:47 smithi007 bash[22722]: cephadm 2024-09-13T23:46:46.679203+0000 mgr.a (mgr.14355) 3717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:46:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:47 smithi131 bash[24745]: audit 2024-09-13T23:46:46.677820+0000 mgr.a (mgr.14355) 3716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:46:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:47 smithi131 bash[24745]: cephadm 2024-09-13T23:46:46.679203+0000 mgr.a (mgr.14355) 3717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:46:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:47 smithi171 bash[25040]: audit 2024-09-13T23:46:46.677820+0000 mgr.a (mgr.14355) 3716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:46:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:47 smithi171 bash[25040]: cephadm 2024-09-13T23:46:46.679203+0000 mgr.a (mgr.14355) 3717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:46:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:48 smithi007 bash[22722]: cluster 2024-09-13T23:46:47.357254+0000 mgr.a (mgr.14355) 3718 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:48 smithi131 bash[24745]: cluster 2024-09-13T23:46:47.357254+0000 mgr.a (mgr.14355) 3718 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:48 smithi171 bash[25040]: cluster 2024-09-13T23:46:47.357254+0000 mgr.a (mgr.14355) 3718 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:46:50.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:50.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:51.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:51.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:51.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:51.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:51.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:50 smithi007 bash[22722]: cluster 2024-09-13T23:46:49.358030+0000 mgr.a (mgr.14355) 3719 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:50 smithi131 bash[24745]: cluster 2024-09-13T23:46:49.358030+0000 mgr.a (mgr.14355) 3719 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:50 smithi171 bash[25040]: cluster 2024-09-13T23:46:49.358030+0000 mgr.a (mgr.14355) 3719 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:46:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:51 smithi007 bash[22722]: audit 2024-09-13T23:46:50.598103+0000 mgr.a (mgr.14355) 3720 : audit [DBG] from='client.91206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:51 smithi131 bash[24745]: audit 2024-09-13T23:46:50.598103+0000 mgr.a (mgr.14355) 3720 : audit [DBG] from='client.91206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:51 smithi171 bash[25040]: audit 2024-09-13T23:46:50.598103+0000 mgr.a (mgr.14355) 3720 : audit [DBG] from='client.91206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:52 smithi007 bash[22722]: cluster 2024-09-13T23:46:51.360672+0000 mgr.a (mgr.14355) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:46:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:52 smithi131 bash[24745]: cluster 2024-09-13T23:46:51.360672+0000 mgr.a (mgr.14355) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:46:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:52 smithi171 bash[25040]: cluster 2024-09-13T23:46:51.360672+0000 mgr.a (mgr.14355) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:46:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:54 smithi007 bash[22722]: cluster 2024-09-13T23:46:53.361386+0000 mgr.a (mgr.14355) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:54 smithi131 bash[24745]: cluster 2024-09-13T23:46:53.361386+0000 mgr.a (mgr.14355) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:54 smithi171 bash[25040]: cluster 2024-09-13T23:46:53.361386+0000 mgr.a (mgr.14355) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:56.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:46:56.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:46:56.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:46:56.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:46:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:46:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:46:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:46:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:46:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:56 smithi007 bash[22722]: cluster 2024-09-13T23:46:55.362919+0000 mgr.a (mgr.14355) 3723 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:56 smithi131 bash[24745]: cluster 2024-09-13T23:46:55.362919+0000 mgr.a (mgr.14355) 3723 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:56 smithi171 bash[25040]: cluster 2024-09-13T23:46:55.362919+0000 mgr.a (mgr.14355) 3723 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:57 smithi007 bash[22722]: audit 2024-09-13T23:46:56.369796+0000 mgr.a (mgr.14355) 3724 : audit [DBG] from='client.91284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:57 smithi131 bash[24745]: audit 2024-09-13T23:46:56.369796+0000 mgr.a (mgr.14355) 3724 : audit [DBG] from='client.91284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:57 smithi171 bash[25040]: audit 2024-09-13T23:46:56.369796+0000 mgr.a (mgr.14355) 3724 : audit [DBG] from='client.91284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:46:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:46:58 smithi007 bash[22722]: cluster 2024-09-13T23:46:57.364773+0000 mgr.a (mgr.14355) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:46:58 smithi131 bash[24745]: cluster 2024-09-13T23:46:57.364773+0000 mgr.a (mgr.14355) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:46:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:46:58 smithi171 bash[25040]: cluster 2024-09-13T23:46:57.364773+0000 mgr.a (mgr.14355) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:47:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:00 smithi007 bash[22722]: cluster 2024-09-13T23:46:59.365747+0000 mgr.a (mgr.14355) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:47:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:00 smithi131 bash[24745]: cluster 2024-09-13T23:46:59.365747+0000 mgr.a (mgr.14355) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:47:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:00 smithi171 bash[25040]: cluster 2024-09-13T23:46:59.365747+0000 mgr.a (mgr.14355) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:47:01.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:01.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:01.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:02.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:02.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:02.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:02.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:02 smithi007 bash[22722]: cluster 2024-09-13T23:47:01.367951+0000 mgr.a (mgr.14355) 3727 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:02 smithi007 bash[22722]: audit 2024-09-13T23:47:02.119652+0000 mgr.a (mgr.14355) 3728 : audit [DBG] from='client.91362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:02 smithi131 bash[24745]: cluster 2024-09-13T23:47:01.367951+0000 mgr.a (mgr.14355) 3727 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:02 smithi131 bash[24745]: audit 2024-09-13T23:47:02.119652+0000 mgr.a (mgr.14355) 3728 : audit [DBG] from='client.91362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:02 smithi171 bash[25040]: cluster 2024-09-13T23:47:01.367951+0000 mgr.a (mgr.14355) 3727 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:02 smithi171 bash[25040]: audit 2024-09-13T23:47:02.119652+0000 mgr.a (mgr.14355) 3728 : audit [DBG] from='client.91362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:04 smithi007 bash[22722]: cluster 2024-09-13T23:47:03.368866+0000 mgr.a (mgr.14355) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:04 smithi131 bash[24745]: cluster 2024-09-13T23:47:03.368866+0000 mgr.a (mgr.14355) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:04 smithi171 bash[25040]: cluster 2024-09-13T23:47:03.368866+0000 mgr.a (mgr.14355) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:06 smithi007 bash[22722]: cluster 2024-09-13T23:47:05.370648+0000 mgr.a (mgr.14355) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:06 smithi131 bash[24745]: cluster 2024-09-13T23:47:05.370648+0000 mgr.a (mgr.14355) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:06 smithi171 bash[25040]: cluster 2024-09-13T23:47:05.370648+0000 mgr.a (mgr.14355) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:07.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:08.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:08.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:08 smithi007 bash[22722]: cluster 2024-09-13T23:47:07.371882+0000 mgr.a (mgr.14355) 3731 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:08 smithi007 bash[22722]: audit 2024-09-13T23:47:07.898061+0000 mgr.a (mgr.14355) 3732 : audit [DBG] from='client.91437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:08 smithi131 bash[24745]: cluster 2024-09-13T23:47:07.371882+0000 mgr.a (mgr.14355) 3731 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:08 smithi131 bash[24745]: audit 2024-09-13T23:47:07.898061+0000 mgr.a (mgr.14355) 3732 : audit [DBG] from='client.91437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:08 smithi171 bash[25040]: cluster 2024-09-13T23:47:07.371882+0000 mgr.a (mgr.14355) 3731 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:08 smithi171 bash[25040]: audit 2024-09-13T23:47:07.898061+0000 mgr.a (mgr.14355) 3732 : audit [DBG] from='client.91437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:10 smithi007 bash[22722]: cluster 2024-09-13T23:47:09.372768+0000 mgr.a (mgr.14355) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:10 smithi131 bash[24745]: cluster 2024-09-13T23:47:09.372768+0000 mgr.a (mgr.14355) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:10 smithi171 bash[25040]: cluster 2024-09-13T23:47:09.372768+0000 mgr.a (mgr.14355) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:12 smithi007 bash[22722]: cluster 2024-09-13T23:47:11.375066+0000 mgr.a (mgr.14355) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:12 smithi131 bash[24745]: cluster 2024-09-13T23:47:11.375066+0000 mgr.a (mgr.14355) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:12 smithi171 bash[25040]: cluster 2024-09-13T23:47:11.375066+0000 mgr.a (mgr.14355) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:13.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:14.102 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:14.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:14 smithi007 bash[22722]: cluster 2024-09-13T23:47:13.375701+0000 mgr.a (mgr.14355) 3735 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:14 smithi007 bash[22722]: audit 2024-09-13T23:47:13.664224+0000 mgr.a (mgr.14355) 3736 : audit [DBG] from='client.91515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:14 smithi131 bash[24745]: cluster 2024-09-13T23:47:13.375701+0000 mgr.a (mgr.14355) 3735 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:14 smithi131 bash[24745]: audit 2024-09-13T23:47:13.664224+0000 mgr.a (mgr.14355) 3736 : audit [DBG] from='client.91515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:14 smithi171 bash[25040]: cluster 2024-09-13T23:47:13.375701+0000 mgr.a (mgr.14355) 3735 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:14 smithi171 bash[25040]: audit 2024-09-13T23:47:13.664224+0000 mgr.a (mgr.14355) 3736 : audit [DBG] from='client.91515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:16 smithi007 bash[22722]: cluster 2024-09-13T23:47:15.377589+0000 mgr.a (mgr.14355) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:16 smithi131 bash[24745]: cluster 2024-09-13T23:47:15.377589+0000 mgr.a (mgr.14355) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:16 smithi171 bash[25040]: cluster 2024-09-13T23:47:15.377589+0000 mgr.a (mgr.14355) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:19.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:19.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:19.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:18 smithi007 bash[22722]: cluster 2024-09-13T23:47:17.378871+0000 mgr.a (mgr.14355) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:18 smithi131 bash[24745]: cluster 2024-09-13T23:47:17.378871+0000 mgr.a (mgr.14355) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:18 smithi171 bash[25040]: cluster 2024-09-13T23:47:17.378871+0000 mgr.a (mgr.14355) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:19.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:20 smithi007 bash[22722]: cluster 2024-09-13T23:47:19.379373+0000 mgr.a (mgr.14355) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:20 smithi007 bash[22722]: audit 2024-09-13T23:47:19.433815+0000 mgr.a (mgr.14355) 3740 : audit [DBG] from='client.91593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:20 smithi131 bash[24745]: cluster 2024-09-13T23:47:19.379373+0000 mgr.a (mgr.14355) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:20 smithi131 bash[24745]: audit 2024-09-13T23:47:19.433815+0000 mgr.a (mgr.14355) 3740 : audit [DBG] from='client.91593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:20 smithi171 bash[25040]: cluster 2024-09-13T23:47:19.379373+0000 mgr.a (mgr.14355) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:20 smithi171 bash[25040]: audit 2024-09-13T23:47:19.433815+0000 mgr.a (mgr.14355) 3740 : audit [DBG] from='client.91593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:22 smithi131 bash[24745]: cluster 2024-09-13T23:47:21.381893+0000 mgr.a (mgr.14355) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:22 smithi171 bash[25040]: cluster 2024-09-13T23:47:21.381893+0000 mgr.a (mgr.14355) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:22 smithi007 bash[22722]: cluster 2024-09-13T23:47:21.381893+0000 mgr.a (mgr.14355) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:24.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:24.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:24.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:24 smithi131 bash[24745]: cluster 2024-09-13T23:47:23.382858+0000 mgr.a (mgr.14355) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:24 smithi171 bash[25040]: cluster 2024-09-13T23:47:23.382858+0000 mgr.a (mgr.14355) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:24 smithi007 bash[22722]: cluster 2024-09-13T23:47:23.382858+0000 mgr.a (mgr.14355) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:25.613 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:25.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:25.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:25.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:25.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:25 smithi131 bash[24745]: audit 2024-09-13T23:47:25.181000+0000 mgr.a (mgr.14355) 3743 : audit [DBG] from='client.91671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:25 smithi171 bash[25040]: audit 2024-09-13T23:47:25.181000+0000 mgr.a (mgr.14355) 3743 : audit [DBG] from='client.91671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:25 smithi007 bash[22722]: audit 2024-09-13T23:47:25.181000+0000 mgr.a (mgr.14355) 3743 : audit [DBG] from='client.91671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:26 smithi131 bash[24745]: cluster 2024-09-13T23:47:25.384120+0000 mgr.a (mgr.14355) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:26 smithi171 bash[25040]: cluster 2024-09-13T23:47:25.384120+0000 mgr.a (mgr.14355) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:26 smithi007 bash[22722]: cluster 2024-09-13T23:47:25.384120+0000 mgr.a (mgr.14355) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:28 smithi131 bash[24745]: cluster 2024-09-13T23:47:27.385805+0000 mgr.a (mgr.14355) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:47:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:28 smithi171 bash[25040]: cluster 2024-09-13T23:47:27.385805+0000 mgr.a (mgr.14355) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:47:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:28 smithi007 bash[22722]: cluster 2024-09-13T23:47:27.385805+0000 mgr.a (mgr.14355) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:47:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:30.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:30 smithi131 bash[24745]: cluster 2024-09-13T23:47:29.386594+0000 mgr.a (mgr.14355) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:47:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:30 smithi171 bash[25040]: cluster 2024-09-13T23:47:29.386594+0000 mgr.a (mgr.14355) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:47:31.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:30 smithi007 bash[22722]: cluster 2024-09-13T23:47:29.386594+0000 mgr.a (mgr.14355) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:47:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:31 smithi131 bash[24745]: audit 2024-09-13T23:47:30.951616+0000 mgr.a (mgr.14355) 3747 : audit [DBG] from='client.91749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:31 smithi171 bash[25040]: audit 2024-09-13T23:47:30.951616+0000 mgr.a (mgr.14355) 3747 : audit [DBG] from='client.91749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:31 smithi007 bash[22722]: audit 2024-09-13T23:47:30.951616+0000 mgr.a (mgr.14355) 3747 : audit [DBG] from='client.91749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:32 smithi131 bash[24745]: cluster 2024-09-13T23:47:31.387962+0000 mgr.a (mgr.14355) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:32 smithi171 bash[25040]: cluster 2024-09-13T23:47:31.387962+0000 mgr.a (mgr.14355) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:32 smithi007 bash[22722]: cluster 2024-09-13T23:47:31.387962+0000 mgr.a (mgr.14355) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:34 smithi131 bash[24745]: cluster 2024-09-13T23:47:33.388713+0000 mgr.a (mgr.14355) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:47:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:34 smithi171 bash[25040]: cluster 2024-09-13T23:47:33.388713+0000 mgr.a (mgr.14355) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:47:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:34 smithi007 bash[22722]: cluster 2024-09-13T23:47:33.388713+0000 mgr.a (mgr.14355) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:47:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:36.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:37.160 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:37.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:36 smithi131 bash[24745]: cluster 2024-09-13T23:47:35.390185+0000 mgr.a (mgr.14355) 3750 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:36 smithi171 bash[25040]: cluster 2024-09-13T23:47:35.390185+0000 mgr.a (mgr.14355) 3750 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:36 smithi007 bash[22722]: cluster 2024-09-13T23:47:35.390185+0000 mgr.a (mgr.14355) 3750 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:38 smithi131 bash[24745]: audit 2024-09-13T23:47:36.720870+0000 mgr.a (mgr.14355) 3751 : audit [DBG] from='client.91824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:38 smithi171 bash[25040]: audit 2024-09-13T23:47:36.720870+0000 mgr.a (mgr.14355) 3751 : audit [DBG] from='client.91824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:38 smithi007 bash[22722]: audit 2024-09-13T23:47:36.720870+0000 mgr.a (mgr.14355) 3751 : audit [DBG] from='client.91824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:39 smithi131 bash[24745]: cluster 2024-09-13T23:47:37.391808+0000 mgr.a (mgr.14355) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:39 smithi171 bash[25040]: cluster 2024-09-13T23:47:37.391808+0000 mgr.a (mgr.14355) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:39 smithi007 bash[22722]: cluster 2024-09-13T23:47:37.391808+0000 mgr.a (mgr.14355) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:41 smithi131 bash[24745]: cluster 2024-09-13T23:47:39.392601+0000 mgr.a (mgr.14355) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:41 smithi171 bash[25040]: cluster 2024-09-13T23:47:39.392601+0000 mgr.a (mgr.14355) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:41 smithi007 bash[22722]: cluster 2024-09-13T23:47:39.392601+0000 mgr.a (mgr.14355) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:47:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:42.890 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:42.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:42.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:43 smithi131 bash[24745]: cluster 2024-09-13T23:47:41.394706+0000 mgr.a (mgr.14355) 3754 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:43 smithi171 bash[25040]: cluster 2024-09-13T23:47:41.394706+0000 mgr.a (mgr.14355) 3754 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:43 smithi007 bash[22722]: cluster 2024-09-13T23:47:41.394706+0000 mgr.a (mgr.14355) 3754 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:44 smithi131 bash[24745]: audit 2024-09-13T23:47:42.485379+0000 mgr.a (mgr.14355) 3755 : audit [DBG] from='client.91899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:44 smithi171 bash[25040]: audit 2024-09-13T23:47:42.485379+0000 mgr.a (mgr.14355) 3755 : audit [DBG] from='client.91899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:44 smithi007 bash[22722]: audit 2024-09-13T23:47:42.485379+0000 mgr.a (mgr.14355) 3755 : audit [DBG] from='client.91899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:45 smithi131 bash[24745]: cluster 2024-09-13T23:47:43.395697+0000 mgr.a (mgr.14355) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:45 smithi171 bash[25040]: cluster 2024-09-13T23:47:43.395697+0000 mgr.a (mgr.14355) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:45 smithi007 bash[22722]: cluster 2024-09-13T23:47:43.395697+0000 mgr.a (mgr.14355) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:47 smithi131 bash[24745]: cluster 2024-09-13T23:47:45.397603+0000 mgr.a (mgr.14355) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:47 smithi131 bash[24745]: audit 2024-09-13T23:47:46.729254+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:47:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:47 smithi171 bash[25040]: cluster 2024-09-13T23:47:45.397603+0000 mgr.a (mgr.14355) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:47 smithi171 bash[25040]: audit 2024-09-13T23:47:46.729254+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:47:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:47 smithi007 bash[22722]: cluster 2024-09-13T23:47:45.397603+0000 mgr.a (mgr.14355) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:47:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:47 smithi007 bash[22722]: audit 2024-09-13T23:47:46.729254+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:47:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:48 smithi171 bash[25040]: audit 2024-09-13T23:47:47.557733+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:47:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:48 smithi171 bash[25040]: audit 2024-09-13T23:47:47.559455+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:47:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:48 smithi171 bash[25040]: audit 2024-09-13T23:47:47.569932+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:47:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:48 smithi171 bash[25040]: audit 2024-09-13T23:47:47.574702+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:48.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22722]: audit 2024-09-13T23:47:47.557733+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:47:48.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22722]: audit 2024-09-13T23:47:47.559455+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:47:48.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22722]: audit 2024-09-13T23:47:47.569932+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:47:48.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22722]: audit 2024-09-13T23:47:47.574702+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:48 smithi131 bash[24745]: audit 2024-09-13T23:47:47.557733+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:47:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:48 smithi131 bash[24745]: audit 2024-09-13T23:47:47.559455+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:47:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:48 smithi131 bash[24745]: audit 2024-09-13T23:47:47.569932+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:47:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:48 smithi131 bash[24745]: audit 2024-09-13T23:47:47.574702+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:48.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22972]: debug 2024-09-13T23:47:48.329+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:47:48.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:47:48 smithi007 bash[22972]: debug 2024-09-13T23:47:48.341+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:47:48.737 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:48.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:48.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:49 smithi171 bash[25040]: cluster 2024-09-13T23:47:47.398808+0000 mgr.a (mgr.14355) 3758 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:49 smithi171 bash[25040]: audit 2024-09-13T23:47:47.576137+0000 mgr.a (mgr.14355) 3759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:49 smithi171 bash[25040]: audit 2024-09-13T23:47:48.236846+0000 mgr.a (mgr.14355) 3760 : audit [DBG] from='client.92040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:49 smithi007 bash[22722]: cluster 2024-09-13T23:47:47.398808+0000 mgr.a (mgr.14355) 3758 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:49 smithi007 bash[22722]: audit 2024-09-13T23:47:47.576137+0000 mgr.a (mgr.14355) 3759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:49 smithi007 bash[22722]: audit 2024-09-13T23:47:48.236846+0000 mgr.a (mgr.14355) 3760 : audit [DBG] from='client.92040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:49 smithi131 bash[24745]: cluster 2024-09-13T23:47:47.398808+0000 mgr.a (mgr.14355) 3758 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:47:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:49 smithi131 bash[24745]: audit 2024-09-13T23:47:47.576137+0000 mgr.a (mgr.14355) 3759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:47:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:49 smithi131 bash[24745]: audit 2024-09-13T23:47:48.236846+0000 mgr.a (mgr.14355) 3760 : audit [DBG] from='client.92040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:50 smithi007 bash[22722]: audit 2024-09-13T23:47:48.331531+0000 mgr.a (mgr.14355) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:47:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:50 smithi007 bash[22722]: cephadm 2024-09-13T23:47:48.343131+0000 mgr.a (mgr.14355) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:47:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:50 smithi131 bash[24745]: audit 2024-09-13T23:47:48.331531+0000 mgr.a (mgr.14355) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:47:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:50 smithi131 bash[24745]: cephadm 2024-09-13T23:47:48.343131+0000 mgr.a (mgr.14355) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:47:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:50 smithi171 bash[25040]: audit 2024-09-13T23:47:48.331531+0000 mgr.a (mgr.14355) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:47:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:50 smithi171 bash[25040]: cephadm 2024-09-13T23:47:48.343131+0000 mgr.a (mgr.14355) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:47:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:51 smithi007 bash[22722]: cluster 2024-09-13T23:47:49.399780+0000 mgr.a (mgr.14355) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:51 smithi131 bash[24745]: cluster 2024-09-13T23:47:49.399780+0000 mgr.a (mgr.14355) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:51 smithi171 bash[25040]: cluster 2024-09-13T23:47:49.399780+0000 mgr.a (mgr.14355) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:47:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:53 smithi007 bash[22722]: cluster 2024-09-13T23:47:51.402063+0000 mgr.a (mgr.14355) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:53 smithi131 bash[24745]: cluster 2024-09-13T23:47:51.402063+0000 mgr.a (mgr.14355) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:53 smithi171 bash[25040]: cluster 2024-09-13T23:47:51.402063+0000 mgr.a (mgr.14355) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:53.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:54.496 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:47:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:47:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:47:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:47:54.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:47:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:55 smithi007 bash[22722]: cluster 2024-09-13T23:47:53.402860+0000 mgr.a (mgr.14355) 3765 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:55 smithi007 bash[22722]: audit 2024-09-13T23:47:54.079059+0000 mgr.a (mgr.14355) 3766 : audit [DBG] from='client.92157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:55 smithi131 bash[24745]: cluster 2024-09-13T23:47:53.402860+0000 mgr.a (mgr.14355) 3765 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:55 smithi131 bash[24745]: audit 2024-09-13T23:47:54.079059+0000 mgr.a (mgr.14355) 3766 : audit [DBG] from='client.92157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:55 smithi171 bash[25040]: cluster 2024-09-13T23:47:53.402860+0000 mgr.a (mgr.14355) 3765 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:55 smithi171 bash[25040]: audit 2024-09-13T23:47:54.079059+0000 mgr.a (mgr.14355) 3766 : audit [DBG] from='client.92157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:47:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:57 smithi007 bash[22722]: cluster 2024-09-13T23:47:55.404812+0000 mgr.a (mgr.14355) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:57 smithi131 bash[24745]: cluster 2024-09-13T23:47:55.404812+0000 mgr.a (mgr.14355) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:57 smithi171 bash[25040]: cluster 2024-09-13T23:47:55.404812+0000 mgr.a (mgr.14355) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:47:59 smithi007 bash[22722]: cluster 2024-09-13T23:47:57.406111+0000 mgr.a (mgr.14355) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:59.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:47:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:47:59.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:47:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:47:59 smithi131 bash[24745]: cluster 2024-09-13T23:47:57.406111+0000 mgr.a (mgr.14355) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:47:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:47:59 smithi171 bash[25040]: cluster 2024-09-13T23:47:57.406111+0000 mgr.a (mgr.14355) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:00.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:00.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:01 smithi007 bash[22722]: cluster 2024-09-13T23:47:59.406890+0000 mgr.a (mgr.14355) 3769 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:01 smithi007 bash[22722]: audit 2024-09-13T23:47:59.823597+0000 mgr.a (mgr.14355) 3770 : audit [DBG] from='client.92229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:01 smithi131 bash[24745]: cluster 2024-09-13T23:47:59.406890+0000 mgr.a (mgr.14355) 3769 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:01 smithi131 bash[24745]: audit 2024-09-13T23:47:59.823597+0000 mgr.a (mgr.14355) 3770 : audit [DBG] from='client.92229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:01 smithi171 bash[25040]: cluster 2024-09-13T23:47:59.406890+0000 mgr.a (mgr.14355) 3769 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:01 smithi171 bash[25040]: audit 2024-09-13T23:47:59.823597+0000 mgr.a (mgr.14355) 3770 : audit [DBG] from='client.92229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:03 smithi007 bash[22722]: cluster 2024-09-13T23:48:01.409318+0000 mgr.a (mgr.14355) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:03 smithi131 bash[24745]: cluster 2024-09-13T23:48:01.409318+0000 mgr.a (mgr.14355) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:03 smithi171 bash[25040]: cluster 2024-09-13T23:48:01.409318+0000 mgr.a (mgr.14355) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:05 smithi007 bash[22722]: cluster 2024-09-13T23:48:03.410118+0000 mgr.a (mgr.14355) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:05 smithi131 bash[24745]: cluster 2024-09-13T23:48:03.410118+0000 mgr.a (mgr.14355) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:05 smithi171 bash[25040]: cluster 2024-09-13T23:48:03.410118+0000 mgr.a (mgr.14355) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:05.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:05.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:05.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:05.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:05.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:07 smithi007 bash[22722]: cluster 2024-09-13T23:48:05.411455+0000 mgr.a (mgr.14355) 3773 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:07 smithi007 bash[22722]: audit 2024-09-13T23:48:05.580737+0000 mgr.a (mgr.14355) 3774 : audit [DBG] from='client.92304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:07 smithi131 bash[24745]: cluster 2024-09-13T23:48:05.411455+0000 mgr.a (mgr.14355) 3773 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:07 smithi131 bash[24745]: audit 2024-09-13T23:48:05.580737+0000 mgr.a (mgr.14355) 3774 : audit [DBG] from='client.92304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:07 smithi171 bash[25040]: cluster 2024-09-13T23:48:05.411455+0000 mgr.a (mgr.14355) 3773 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:07 smithi171 bash[25040]: audit 2024-09-13T23:48:05.580737+0000 mgr.a (mgr.14355) 3774 : audit [DBG] from='client.92304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:09 smithi007 bash[22722]: cluster 2024-09-13T23:48:07.413215+0000 mgr.a (mgr.14355) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:09 smithi131 bash[24745]: cluster 2024-09-13T23:48:07.413215+0000 mgr.a (mgr.14355) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:09 smithi171 bash[25040]: cluster 2024-09-13T23:48:07.413215+0000 mgr.a (mgr.14355) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:10.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:10.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:10.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:11 smithi007 bash[22722]: cluster 2024-09-13T23:48:09.413996+0000 mgr.a (mgr.14355) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:11 smithi131 bash[24745]: cluster 2024-09-13T23:48:09.413996+0000 mgr.a (mgr.14355) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:11 smithi171 bash[25040]: cluster 2024-09-13T23:48:09.413996+0000 mgr.a (mgr.14355) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:11.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:13 smithi007 bash[22722]: audit 2024-09-13T23:48:11.319523+0000 mgr.a (mgr.14355) 3777 : audit [DBG] from='client.92382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:13 smithi007 bash[22722]: cluster 2024-09-13T23:48:11.415381+0000 mgr.a (mgr.14355) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:13 smithi131 bash[24745]: audit 2024-09-13T23:48:11.319523+0000 mgr.a (mgr.14355) 3777 : audit [DBG] from='client.92382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:13 smithi131 bash[24745]: cluster 2024-09-13T23:48:11.415381+0000 mgr.a (mgr.14355) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:13 smithi171 bash[25040]: audit 2024-09-13T23:48:11.319523+0000 mgr.a (mgr.14355) 3777 : audit [DBG] from='client.92382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:13 smithi171 bash[25040]: cluster 2024-09-13T23:48:11.415381+0000 mgr.a (mgr.14355) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:15 smithi007 bash[22722]: cluster 2024-09-13T23:48:13.416226+0000 mgr.a (mgr.14355) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:15 smithi131 bash[24745]: cluster 2024-09-13T23:48:13.416226+0000 mgr.a (mgr.14355) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:15 smithi171 bash[25040]: cluster 2024-09-13T23:48:13.416226+0000 mgr.a (mgr.14355) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:48:16.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:16.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:17 smithi007 bash[22722]: cluster 2024-09-13T23:48:15.418009+0000 mgr.a (mgr.14355) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:48:17.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:17 smithi131 bash[24745]: cluster 2024-09-13T23:48:15.418009+0000 mgr.a (mgr.14355) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:48:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:17 smithi171 bash[25040]: cluster 2024-09-13T23:48:15.418009+0000 mgr.a (mgr.14355) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:48:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:18 smithi007 bash[22722]: audit 2024-09-13T23:48:17.087285+0000 mgr.a (mgr.14355) 3781 : audit [DBG] from='client.92460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:18 smithi131 bash[24745]: audit 2024-09-13T23:48:17.087285+0000 mgr.a (mgr.14355) 3781 : audit [DBG] from='client.92460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:18 smithi171 bash[25040]: audit 2024-09-13T23:48:17.087285+0000 mgr.a (mgr.14355) 3781 : audit [DBG] from='client.92460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:19 smithi007 bash[22722]: cluster 2024-09-13T23:48:17.427179+0000 mgr.a (mgr.14355) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:19 smithi131 bash[24745]: cluster 2024-09-13T23:48:17.427179+0000 mgr.a (mgr.14355) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:19 smithi171 bash[25040]: cluster 2024-09-13T23:48:17.427179+0000 mgr.a (mgr.14355) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:21 smithi007 bash[22722]: cluster 2024-09-13T23:48:19.428122+0000 mgr.a (mgr.14355) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:21 smithi131 bash[24745]: cluster 2024-09-13T23:48:19.428122+0000 mgr.a (mgr.14355) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:21 smithi171 bash[25040]: cluster 2024-09-13T23:48:19.428122+0000 mgr.a (mgr.14355) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:23.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:23.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:23 smithi007 bash[22722]: cluster 2024-09-13T23:48:21.430376+0000 mgr.a (mgr.14355) 3784 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:23 smithi131 bash[24745]: cluster 2024-09-13T23:48:21.430376+0000 mgr.a (mgr.14355) 3784 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:23 smithi171 bash[25040]: cluster 2024-09-13T23:48:21.430376+0000 mgr.a (mgr.14355) 3784 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:24 smithi007 bash[22722]: audit 2024-09-13T23:48:22.854141+0000 mgr.a (mgr.14355) 3785 : audit [DBG] from='client.92538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:24 smithi131 bash[24745]: audit 2024-09-13T23:48:22.854141+0000 mgr.a (mgr.14355) 3785 : audit [DBG] from='client.92538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:24 smithi171 bash[25040]: audit 2024-09-13T23:48:22.854141+0000 mgr.a (mgr.14355) 3785 : audit [DBG] from='client.92538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:25 smithi007 bash[22722]: cluster 2024-09-13T23:48:23.431332+0000 mgr.a (mgr.14355) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:25 smithi131 bash[24745]: cluster 2024-09-13T23:48:23.431332+0000 mgr.a (mgr.14355) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:25 smithi171 bash[25040]: cluster 2024-09-13T23:48:23.431332+0000 mgr.a (mgr.14355) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:27 smithi007 bash[22722]: cluster 2024-09-13T23:48:25.433093+0000 mgr.a (mgr.14355) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:27 smithi131 bash[24745]: cluster 2024-09-13T23:48:25.433093+0000 mgr.a (mgr.14355) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:27 smithi171 bash[25040]: cluster 2024-09-13T23:48:25.433093+0000 mgr.a (mgr.14355) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:28.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:28.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:29.047 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:29.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:29 smithi007 bash[22722]: cluster 2024-09-13T23:48:27.434443+0000 mgr.a (mgr.14355) 3788 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:29 smithi131 bash[24745]: cluster 2024-09-13T23:48:27.434443+0000 mgr.a (mgr.14355) 3788 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:29 smithi171 bash[25040]: cluster 2024-09-13T23:48:27.434443+0000 mgr.a (mgr.14355) 3788 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:30 smithi007 bash[22722]: audit 2024-09-13T23:48:28.613063+0000 mgr.a (mgr.14355) 3789 : audit [DBG] from='client.92616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:30 smithi131 bash[24745]: audit 2024-09-13T23:48:28.613063+0000 mgr.a (mgr.14355) 3789 : audit [DBG] from='client.92616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:30 smithi171 bash[25040]: audit 2024-09-13T23:48:28.613063+0000 mgr.a (mgr.14355) 3789 : audit [DBG] from='client.92616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:31.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:31 smithi007 bash[22722]: cluster 2024-09-13T23:48:29.435368+0000 mgr.a (mgr.14355) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:31 smithi131 bash[24745]: cluster 2024-09-13T23:48:29.435368+0000 mgr.a (mgr.14355) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:31 smithi171 bash[25040]: cluster 2024-09-13T23:48:29.435368+0000 mgr.a (mgr.14355) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:33 smithi007 bash[22722]: cluster 2024-09-13T23:48:31.437612+0000 mgr.a (mgr.14355) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:33 smithi131 bash[24745]: cluster 2024-09-13T23:48:31.437612+0000 mgr.a (mgr.14355) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:33 smithi171 bash[25040]: cluster 2024-09-13T23:48:31.437612+0000 mgr.a (mgr.14355) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:34.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:34.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:34.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:35 smithi007 bash[22722]: cluster 2024-09-13T23:48:33.438390+0000 mgr.a (mgr.14355) 3792 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:35 smithi131 bash[24745]: cluster 2024-09-13T23:48:33.438390+0000 mgr.a (mgr.14355) 3792 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:35 smithi171 bash[25040]: cluster 2024-09-13T23:48:33.438390+0000 mgr.a (mgr.14355) 3792 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:36 smithi007 bash[22722]: audit 2024-09-13T23:48:34.377930+0000 mgr.a (mgr.14355) 3793 : audit [DBG] from='client.92694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:36 smithi131 bash[24745]: audit 2024-09-13T23:48:34.377930+0000 mgr.a (mgr.14355) 3793 : audit [DBG] from='client.92694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:36 smithi171 bash[25040]: audit 2024-09-13T23:48:34.377930+0000 mgr.a (mgr.14355) 3793 : audit [DBG] from='client.92694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:37 smithi007 bash[22722]: cluster 2024-09-13T23:48:35.440292+0000 mgr.a (mgr.14355) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:37 smithi131 bash[24745]: cluster 2024-09-13T23:48:35.440292+0000 mgr.a (mgr.14355) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:37 smithi171 bash[25040]: cluster 2024-09-13T23:48:35.440292+0000 mgr.a (mgr.14355) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:48:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:39 smithi007 bash[22722]: cluster 2024-09-13T23:48:37.441556+0000 mgr.a (mgr.14355) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:39 smithi131 bash[24745]: cluster 2024-09-13T23:48:37.441556+0000 mgr.a (mgr.14355) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:39 smithi171 bash[25040]: cluster 2024-09-13T23:48:37.441556+0000 mgr.a (mgr.14355) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:39.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:40.543 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:40.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:41 smithi007 bash[22722]: cluster 2024-09-13T23:48:39.442352+0000 mgr.a (mgr.14355) 3796 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:41 smithi007 bash[22722]: audit 2024-09-13T23:48:40.133710+0000 mgr.a (mgr.14355) 3797 : audit [DBG] from='client.92772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:41 smithi131 bash[24745]: cluster 2024-09-13T23:48:39.442352+0000 mgr.a (mgr.14355) 3796 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:41 smithi131 bash[24745]: audit 2024-09-13T23:48:40.133710+0000 mgr.a (mgr.14355) 3797 : audit [DBG] from='client.92772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:41 smithi171 bash[25040]: cluster 2024-09-13T23:48:39.442352+0000 mgr.a (mgr.14355) 3796 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:41 smithi171 bash[25040]: audit 2024-09-13T23:48:40.133710+0000 mgr.a (mgr.14355) 3797 : audit [DBG] from='client.92772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:43 smithi007 bash[22722]: cluster 2024-09-13T23:48:41.444900+0000 mgr.a (mgr.14355) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:43 smithi131 bash[24745]: cluster 2024-09-13T23:48:41.444900+0000 mgr.a (mgr.14355) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:43 smithi171 bash[25040]: cluster 2024-09-13T23:48:41.444900+0000 mgr.a (mgr.14355) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:48:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:45 smithi007 bash[22722]: cluster 2024-09-13T23:48:43.445738+0000 mgr.a (mgr.14355) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:45 smithi131 bash[24745]: cluster 2024-09-13T23:48:43.445738+0000 mgr.a (mgr.14355) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:45.544 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:45 smithi171 bash[25040]: cluster 2024-09-13T23:48:43.445738+0000 mgr.a (mgr.14355) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:45.545 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:45.545 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:46.322 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:46.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:46.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:46.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:46.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:47 smithi007 bash[22722]: cluster 2024-09-13T23:48:45.447315+0000 mgr.a (mgr.14355) 3800 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:47 smithi007 bash[22722]: audit 2024-09-13T23:48:45.881368+0000 mgr.a (mgr.14355) 3801 : audit [DBG] from='client.92847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:47 smithi131 bash[24745]: cluster 2024-09-13T23:48:45.447315+0000 mgr.a (mgr.14355) 3800 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:47 smithi131 bash[24745]: audit 2024-09-13T23:48:45.881368+0000 mgr.a (mgr.14355) 3801 : audit [DBG] from='client.92847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:47 smithi171 bash[25040]: cluster 2024-09-13T23:48:45.447315+0000 mgr.a (mgr.14355) 3800 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:48:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:47 smithi171 bash[25040]: audit 2024-09-13T23:48:45.881368+0000 mgr.a (mgr.14355) 3801 : audit [DBG] from='client.92847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:49 smithi007 bash[22722]: cluster 2024-09-13T23:48:47.449087+0000 mgr.a (mgr.14355) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:49 smithi007 bash[22722]: audit 2024-09-13T23:48:48.408450+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:48:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:49 smithi131 bash[24745]: cluster 2024-09-13T23:48:47.449087+0000 mgr.a (mgr.14355) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:49 smithi131 bash[24745]: audit 2024-09-13T23:48:48.408450+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:48:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:49 smithi171 bash[25040]: cluster 2024-09-13T23:48:47.449087+0000 mgr.a (mgr.14355) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:48:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:49 smithi171 bash[25040]: audit 2024-09-13T23:48:48.408450+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:48:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:48:49 smithi007 bash[22972]: debug 2024-09-13T23:48:49.988+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:48:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:48:49 smithi007 bash[22972]: debug 2024-09-13T23:48:49.992+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:48:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:50 smithi007 bash[22722]: audit 2024-09-13T23:48:49.253316+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:48:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:50 smithi007 bash[22722]: audit 2024-09-13T23:48:49.255169+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:48:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:50 smithi007 bash[22722]: audit 2024-09-13T23:48:49.265715+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:48:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:50 smithi007 bash[22722]: audit 2024-09-13T23:48:49.270640+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:50 smithi131 bash[24745]: audit 2024-09-13T23:48:49.253316+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:48:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:50 smithi131 bash[24745]: audit 2024-09-13T23:48:49.255169+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:48:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:50 smithi131 bash[24745]: audit 2024-09-13T23:48:49.265715+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:48:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:50 smithi131 bash[24745]: audit 2024-09-13T23:48:49.270640+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:50 smithi171 bash[25040]: audit 2024-09-13T23:48:49.253316+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:50 smithi171 bash[25040]: audit 2024-09-13T23:48:49.255169+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:50 smithi171 bash[25040]: audit 2024-09-13T23:48:49.265715+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:50 smithi171 bash[25040]: audit 2024-09-13T23:48:49.270640+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:51.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:51.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:51 smithi007 bash[22722]: audit 2024-09-13T23:48:49.273017+0000 mgr.a (mgr.14355) 3803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:51 smithi007 bash[22722]: cluster 2024-09-13T23:48:49.449696+0000 mgr.a (mgr.14355) 3804 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:48:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:51 smithi007 bash[22722]: audit 2024-09-13T23:48:49.993764+0000 mgr.a (mgr.14355) 3805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:48:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:51 smithi007 bash[22722]: cephadm 2024-09-13T23:48:49.995030+0000 mgr.a (mgr.14355) 3806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:48:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:51 smithi131 bash[24745]: audit 2024-09-13T23:48:49.273017+0000 mgr.a (mgr.14355) 3803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:51 smithi131 bash[24745]: cluster 2024-09-13T23:48:49.449696+0000 mgr.a (mgr.14355) 3804 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:48:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:51 smithi131 bash[24745]: audit 2024-09-13T23:48:49.993764+0000 mgr.a (mgr.14355) 3805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:48:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:51 smithi131 bash[24745]: cephadm 2024-09-13T23:48:49.995030+0000 mgr.a (mgr.14355) 3806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:48:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:51 smithi171 bash[25040]: audit 2024-09-13T23:48:49.273017+0000 mgr.a (mgr.14355) 3803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:48:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:51 smithi171 bash[25040]: cluster 2024-09-13T23:48:49.449696+0000 mgr.a (mgr.14355) 3804 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:48:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:51 smithi171 bash[25040]: audit 2024-09-13T23:48:49.993764+0000 mgr.a (mgr.14355) 3805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:48:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:51 smithi171 bash[25040]: cephadm 2024-09-13T23:48:49.995030+0000 mgr.a (mgr.14355) 3806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:48:52.089 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:53 smithi131 bash[24745]: cluster 2024-09-13T23:48:51.450853+0000 mgr.a (mgr.14355) 3807 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:53 smithi131 bash[24745]: audit 2024-09-13T23:48:51.661738+0000 mgr.a (mgr.14355) 3808 : audit [DBG] from='client.93024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:53 smithi171 bash[25040]: cluster 2024-09-13T23:48:51.450853+0000 mgr.a (mgr.14355) 3807 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:53 smithi171 bash[25040]: audit 2024-09-13T23:48:51.661738+0000 mgr.a (mgr.14355) 3808 : audit [DBG] from='client.93024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:53 smithi007 bash[22722]: cluster 2024-09-13T23:48:51.450853+0000 mgr.a (mgr.14355) 3807 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:53 smithi007 bash[22722]: audit 2024-09-13T23:48:51.661738+0000 mgr.a (mgr.14355) 3808 : audit [DBG] from='client.93024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:55 smithi131 bash[24745]: cluster 2024-09-13T23:48:53.451716+0000 mgr.a (mgr.14355) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:48:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:55 smithi171 bash[25040]: cluster 2024-09-13T23:48:53.451716+0000 mgr.a (mgr.14355) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:48:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:55 smithi007 bash[22722]: cluster 2024-09-13T23:48:53.451716+0000 mgr.a (mgr.14355) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:48:57.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:48:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:48:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:48:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:57 smithi131 bash[24745]: cluster 2024-09-13T23:48:55.453484+0000 mgr.a (mgr.14355) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:57 smithi171 bash[25040]: cluster 2024-09-13T23:48:55.453484+0000 mgr.a (mgr.14355) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:57 smithi007 bash[22722]: cluster 2024-09-13T23:48:55.453484+0000 mgr.a (mgr.14355) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:57.869 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:48:57.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:48:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:48:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:48:57.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:48:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:59 smithi131 bash[24745]: audit 2024-09-13T23:48:57.428946+0000 mgr.a (mgr.14355) 3811 : audit [DBG] from='client.93099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:48:59 smithi131 bash[24745]: cluster 2024-09-13T23:48:57.454902+0000 mgr.a (mgr.14355) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:59 smithi171 bash[25040]: audit 2024-09-13T23:48:57.428946+0000 mgr.a (mgr.14355) 3811 : audit [DBG] from='client.93099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:48:59 smithi171 bash[25040]: cluster 2024-09-13T23:48:57.454902+0000 mgr.a (mgr.14355) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:48:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:59 smithi007 bash[22722]: audit 2024-09-13T23:48:57.428946+0000 mgr.a (mgr.14355) 3811 : audit [DBG] from='client.93099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:48:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:48:59 smithi007 bash[22722]: cluster 2024-09-13T23:48:57.454902+0000 mgr.a (mgr.14355) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:01 smithi131 bash[24745]: cluster 2024-09-13T23:48:59.455793+0000 mgr.a (mgr.14355) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:01 smithi171 bash[25040]: cluster 2024-09-13T23:48:59.455793+0000 mgr.a (mgr.14355) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:01 smithi007 bash[22722]: cluster 2024-09-13T23:48:59.455793+0000 mgr.a (mgr.14355) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:02.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:02.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:02.872 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:03 smithi131 bash[24745]: cluster 2024-09-13T23:49:01.458081+0000 mgr.a (mgr.14355) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:03 smithi171 bash[25040]: cluster 2024-09-13T23:49:01.458081+0000 mgr.a (mgr.14355) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:03.618 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:03.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:03.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:03.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:03.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:03 smithi007 bash[22722]: cluster 2024-09-13T23:49:01.458081+0000 mgr.a (mgr.14355) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:49:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:04 smithi131 bash[24745]: audit 2024-09-13T23:49:03.198275+0000 mgr.a (mgr.14355) 3815 : audit [DBG] from='client.93174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:04 smithi171 bash[25040]: audit 2024-09-13T23:49:03.198275+0000 mgr.a (mgr.14355) 3815 : audit [DBG] from='client.93174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:04 smithi007 bash[22722]: audit 2024-09-13T23:49:03.198275+0000 mgr.a (mgr.14355) 3815 : audit [DBG] from='client.93174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:05 smithi131 bash[24745]: cluster 2024-09-13T23:49:03.458618+0000 mgr.a (mgr.14355) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:05 smithi171 bash[25040]: cluster 2024-09-13T23:49:03.458618+0000 mgr.a (mgr.14355) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:05 smithi007 bash[22722]: cluster 2024-09-13T23:49:03.458618+0000 mgr.a (mgr.14355) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:07 smithi131 bash[24745]: cluster 2024-09-13T23:49:05.460463+0000 mgr.a (mgr.14355) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:07 smithi171 bash[25040]: cluster 2024-09-13T23:49:05.460463+0000 mgr.a (mgr.14355) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:07 smithi007 bash[22722]: cluster 2024-09-13T23:49:05.460463+0000 mgr.a (mgr.14355) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:09.394 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:09.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:09 smithi131 bash[24745]: cluster 2024-09-13T23:49:07.461731+0000 mgr.a (mgr.14355) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:09 smithi171 bash[25040]: cluster 2024-09-13T23:49:07.461731+0000 mgr.a (mgr.14355) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:09 smithi007 bash[22722]: cluster 2024-09-13T23:49:07.461731+0000 mgr.a (mgr.14355) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:10 smithi131 bash[24745]: audit 2024-09-13T23:49:08.954752+0000 mgr.a (mgr.14355) 3819 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:10 smithi171 bash[25040]: audit 2024-09-13T23:49:08.954752+0000 mgr.a (mgr.14355) 3819 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:10 smithi007 bash[22722]: audit 2024-09-13T23:49:08.954752+0000 mgr.a (mgr.14355) 3819 : audit [DBG] from='client.93249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:11 smithi131 bash[24745]: cluster 2024-09-13T23:49:09.462752+0000 mgr.a (mgr.14355) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:11 smithi171 bash[25040]: cluster 2024-09-13T23:49:09.462752+0000 mgr.a (mgr.14355) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:11 smithi007 bash[22722]: cluster 2024-09-13T23:49:09.462752+0000 mgr.a (mgr.14355) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:13 smithi131 bash[24745]: cluster 2024-09-13T23:49:11.465071+0000 mgr.a (mgr.14355) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:13 smithi171 bash[25040]: cluster 2024-09-13T23:49:11.465071+0000 mgr.a (mgr.14355) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:13 smithi007 bash[22722]: cluster 2024-09-13T23:49:11.465071+0000 mgr.a (mgr.14355) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:14 smithi131 bash[24745]: cluster 2024-09-13T23:49:13.465893+0000 mgr.a (mgr.14355) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:14 smithi171 bash[25040]: cluster 2024-09-13T23:49:13.465893+0000 mgr.a (mgr.14355) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:14 smithi007 bash[22722]: cluster 2024-09-13T23:49:13.465893+0000 mgr.a (mgr.14355) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:15.173 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:15 smithi171 bash[25040]: audit 2024-09-13T23:49:14.729900+0000 mgr.a (mgr.14355) 3823 : audit [DBG] from='client.93324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:15 smithi007 bash[22722]: audit 2024-09-13T23:49:14.729900+0000 mgr.a (mgr.14355) 3823 : audit [DBG] from='client.93324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:15 smithi131 bash[24745]: audit 2024-09-13T23:49:14.729900+0000 mgr.a (mgr.14355) 3823 : audit [DBG] from='client.93324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:16 smithi171 bash[25040]: cluster 2024-09-13T23:49:15.467883+0000 mgr.a (mgr.14355) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:16 smithi007 bash[22722]: cluster 2024-09-13T23:49:15.467883+0000 mgr.a (mgr.14355) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:16 smithi131 bash[24745]: cluster 2024-09-13T23:49:15.467883+0000 mgr.a (mgr.14355) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:18 smithi131 bash[24745]: cluster 2024-09-13T23:49:17.469137+0000 mgr.a (mgr.14355) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:18 smithi171 bash[25040]: cluster 2024-09-13T23:49:17.469137+0000 mgr.a (mgr.14355) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:18 smithi007 bash[22722]: cluster 2024-09-13T23:49:17.469137+0000 mgr.a (mgr.14355) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:20.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:20.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:20 smithi131 bash[24745]: cluster 2024-09-13T23:49:19.469937+0000 mgr.a (mgr.14355) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:20 smithi171 bash[25040]: cluster 2024-09-13T23:49:19.469937+0000 mgr.a (mgr.14355) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:20 smithi007 bash[22722]: cluster 2024-09-13T23:49:19.469937+0000 mgr.a (mgr.14355) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:20.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:21 smithi171 bash[25040]: audit 2024-09-13T23:49:20.516281+0000 mgr.a (mgr.14355) 3827 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:21 smithi007 bash[22722]: audit 2024-09-13T23:49:20.516281+0000 mgr.a (mgr.14355) 3827 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:21 smithi131 bash[24745]: audit 2024-09-13T23:49:20.516281+0000 mgr.a (mgr.14355) 3827 : audit [DBG] from='client.93402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:22 smithi171 bash[25040]: cluster 2024-09-13T23:49:21.472848+0000 mgr.a (mgr.14355) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:22 smithi007 bash[22722]: cluster 2024-09-13T23:49:21.472848+0000 mgr.a (mgr.14355) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:22 smithi131 bash[24745]: cluster 2024-09-13T23:49:21.472848+0000 mgr.a (mgr.14355) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:24 smithi007 bash[22722]: cluster 2024-09-13T23:49:23.473791+0000 mgr.a (mgr.14355) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:24 smithi131 bash[24745]: cluster 2024-09-13T23:49:23.473791+0000 mgr.a (mgr.14355) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:24 smithi171 bash[25040]: cluster 2024-09-13T23:49:23.473791+0000 mgr.a (mgr.14355) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:25.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:25.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:25.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:26.734 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:26.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:26 smithi007 bash[22722]: cluster 2024-09-13T23:49:25.475380+0000 mgr.a (mgr.14355) 3830 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:49:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:26 smithi131 bash[24745]: cluster 2024-09-13T23:49:25.475380+0000 mgr.a (mgr.14355) 3830 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:49:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:26 smithi171 bash[25040]: cluster 2024-09-13T23:49:25.475380+0000 mgr.a (mgr.14355) 3830 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:49:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:27 smithi007 bash[22722]: audit 2024-09-13T23:49:26.293520+0000 mgr.a (mgr.14355) 3831 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:27 smithi131 bash[24745]: audit 2024-09-13T23:49:26.293520+0000 mgr.a (mgr.14355) 3831 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:27 smithi171 bash[25040]: audit 2024-09-13T23:49:26.293520+0000 mgr.a (mgr.14355) 3831 : audit [DBG] from='client.93480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:28 smithi007 bash[22722]: cluster 2024-09-13T23:49:27.477084+0000 mgr.a (mgr.14355) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:49:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:28 smithi131 bash[24745]: cluster 2024-09-13T23:49:27.477084+0000 mgr.a (mgr.14355) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:49:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:28 smithi171 bash[25040]: cluster 2024-09-13T23:49:27.477084+0000 mgr.a (mgr.14355) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:49:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:30 smithi007 bash[22722]: cluster 2024-09-13T23:49:29.477859+0000 mgr.a (mgr.14355) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:30 smithi131 bash[24745]: cluster 2024-09-13T23:49:29.477859+0000 mgr.a (mgr.14355) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:30 smithi171 bash[25040]: cluster 2024-09-13T23:49:29.477859+0000 mgr.a (mgr.14355) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:49:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:31.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:31.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:32.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:32.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:32.487 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:32.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:32 smithi007 bash[22722]: cluster 2024-09-13T23:49:31.480081+0000 mgr.a (mgr.14355) 3834 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:32.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:32 smithi007 bash[22722]: audit 2024-09-13T23:49:32.067185+0000 mgr.a (mgr.14355) 3835 : audit [DBG] from='client.93555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:32 smithi131 bash[24745]: cluster 2024-09-13T23:49:31.480081+0000 mgr.a (mgr.14355) 3834 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:32 smithi131 bash[24745]: audit 2024-09-13T23:49:32.067185+0000 mgr.a (mgr.14355) 3835 : audit [DBG] from='client.93555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:32 smithi171 bash[25040]: cluster 2024-09-13T23:49:31.480081+0000 mgr.a (mgr.14355) 3834 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:32 smithi171 bash[25040]: audit 2024-09-13T23:49:32.067185+0000 mgr.a (mgr.14355) 3835 : audit [DBG] from='client.93555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:34 smithi007 bash[22722]: cluster 2024-09-13T23:49:33.480984+0000 mgr.a (mgr.14355) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:34 smithi131 bash[24745]: cluster 2024-09-13T23:49:33.480984+0000 mgr.a (mgr.14355) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:34 smithi171 bash[25040]: cluster 2024-09-13T23:49:33.480984+0000 mgr.a (mgr.14355) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:36 smithi007 bash[22722]: cluster 2024-09-13T23:49:35.482780+0000 mgr.a (mgr.14355) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:36 smithi131 bash[24745]: cluster 2024-09-13T23:49:35.482780+0000 mgr.a (mgr.14355) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:36 smithi171 bash[25040]: cluster 2024-09-13T23:49:35.482780+0000 mgr.a (mgr.14355) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:38.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:38 smithi007 bash[22722]: cluster 2024-09-13T23:49:37.484013+0000 mgr.a (mgr.14355) 3838 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:38 smithi007 bash[22722]: audit 2024-09-13T23:49:37.822640+0000 mgr.a (mgr.14355) 3839 : audit [DBG] from='client.93630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:38 smithi131 bash[24745]: cluster 2024-09-13T23:49:37.484013+0000 mgr.a (mgr.14355) 3838 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:38 smithi131 bash[24745]: audit 2024-09-13T23:49:37.822640+0000 mgr.a (mgr.14355) 3839 : audit [DBG] from='client.93630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:38 smithi171 bash[25040]: cluster 2024-09-13T23:49:37.484013+0000 mgr.a (mgr.14355) 3838 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:38 smithi171 bash[25040]: audit 2024-09-13T23:49:37.822640+0000 mgr.a (mgr.14355) 3839 : audit [DBG] from='client.93630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:40 smithi007 bash[22722]: cluster 2024-09-13T23:49:39.484895+0000 mgr.a (mgr.14355) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:40 smithi131 bash[24745]: cluster 2024-09-13T23:49:39.484895+0000 mgr.a (mgr.14355) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:40 smithi171 bash[25040]: cluster 2024-09-13T23:49:39.484895+0000 mgr.a (mgr.14355) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:42 smithi007 bash[22722]: cluster 2024-09-13T23:49:41.487186+0000 mgr.a (mgr.14355) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:42 smithi131 bash[24745]: cluster 2024-09-13T23:49:41.487186+0000 mgr.a (mgr.14355) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:42 smithi171 bash[25040]: cluster 2024-09-13T23:49:41.487186+0000 mgr.a (mgr.14355) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:43.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:44.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:44.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:44.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:44.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:44.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:44 smithi007 bash[22722]: cluster 2024-09-13T23:49:43.487696+0000 mgr.a (mgr.14355) 3842 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:44 smithi007 bash[22722]: audit 2024-09-13T23:49:43.594591+0000 mgr.a (mgr.14355) 3843 : audit [DBG] from='client.93708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:44 smithi131 bash[24745]: cluster 2024-09-13T23:49:43.487696+0000 mgr.a (mgr.14355) 3842 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:44 smithi131 bash[24745]: audit 2024-09-13T23:49:43.594591+0000 mgr.a (mgr.14355) 3843 : audit [DBG] from='client.93708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:44 smithi171 bash[25040]: cluster 2024-09-13T23:49:43.487696+0000 mgr.a (mgr.14355) 3842 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:44 smithi171 bash[25040]: audit 2024-09-13T23:49:43.594591+0000 mgr.a (mgr.14355) 3843 : audit [DBG] from='client.93708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:46 smithi007 bash[22722]: cluster 2024-09-13T23:49:45.489540+0000 mgr.a (mgr.14355) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:46 smithi131 bash[24745]: cluster 2024-09-13T23:49:45.489540+0000 mgr.a (mgr.14355) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:46 smithi171 bash[25040]: cluster 2024-09-13T23:49:45.489540+0000 mgr.a (mgr.14355) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:48 smithi007 bash[22722]: cluster 2024-09-13T23:49:47.490824+0000 mgr.a (mgr.14355) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:49.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:48 smithi131 bash[24745]: cluster 2024-09-13T23:49:47.490824+0000 mgr.a (mgr.14355) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:48 smithi171 bash[25040]: cluster 2024-09-13T23:49:47.490824+0000 mgr.a (mgr.14355) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:49:49.801 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:49.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:50 smithi007 bash[22722]: audit 2024-09-13T23:49:49.355705+0000 mgr.a (mgr.14355) 3846 : audit [DBG] from='client.93783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:50 smithi007 bash[22722]: cluster 2024-09-13T23:49:49.499581+0000 mgr.a (mgr.14355) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:50 smithi007 bash[22722]: audit 2024-09-13T23:49:50.052542+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:49:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:50 smithi131 bash[24745]: audit 2024-09-13T23:49:49.355705+0000 mgr.a (mgr.14355) 3846 : audit [DBG] from='client.93783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:50 smithi131 bash[24745]: cluster 2024-09-13T23:49:49.499581+0000 mgr.a (mgr.14355) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:50 smithi131 bash[24745]: audit 2024-09-13T23:49:50.052542+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:49:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:50 smithi171 bash[25040]: audit 2024-09-13T23:49:49.355705+0000 mgr.a (mgr.14355) 3846 : audit [DBG] from='client.93783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:50 smithi171 bash[25040]: cluster 2024-09-13T23:49:49.499581+0000 mgr.a (mgr.14355) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:50 smithi171 bash[25040]: audit 2024-09-13T23:49:50.052542+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:49:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:51 smithi007 bash[22722]: audit 2024-09-13T23:49:50.668582+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:51 smithi007 bash[22722]: audit 2024-09-13T23:49:50.674808+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:51 smithi131 bash[24745]: audit 2024-09-13T23:49:50.668582+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:51 smithi131 bash[24745]: audit 2024-09-13T23:49:50.674808+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:51 smithi171 bash[25040]: audit 2024-09-13T23:49:50.668582+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:51 smithi171 bash[25040]: audit 2024-09-13T23:49:50.674808+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:49:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:52 smithi007 bash[22722]: cluster 2024-09-13T23:49:51.501848+0000 mgr.a (mgr.14355) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:52 smithi131 bash[24745]: cluster 2024-09-13T23:49:51.501848+0000 mgr.a (mgr.14355) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:52 smithi171 bash[25040]: cluster 2024-09-13T23:49:51.501848+0000 mgr.a (mgr.14355) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:49:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:49:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:49:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:49:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:54 smithi007 bash[22722]: cluster 2024-09-13T23:49:53.502652+0000 mgr.a (mgr.14355) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:54 smithi131 bash[24745]: cluster 2024-09-13T23:49:53.502652+0000 mgr.a (mgr.14355) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:54 smithi171 bash[25040]: cluster 2024-09-13T23:49:53.502652+0000 mgr.a (mgr.14355) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:55.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:49:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:49:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:49:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:49:55.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:49:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:55 smithi007 bash[22722]: audit 2024-09-13T23:49:55.132683+0000 mgr.a (mgr.14355) 3850 : audit [DBG] from='client.93861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:55 smithi131 bash[24745]: audit 2024-09-13T23:49:55.132683+0000 mgr.a (mgr.14355) 3850 : audit [DBG] from='client.93861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:55 smithi171 bash[25040]: audit 2024-09-13T23:49:55.132683+0000 mgr.a (mgr.14355) 3850 : audit [DBG] from='client.93861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:49:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:56 smithi007 bash[22722]: cluster 2024-09-13T23:49:55.503639+0000 mgr.a (mgr.14355) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:56 smithi131 bash[24745]: cluster 2024-09-13T23:49:55.503639+0000 mgr.a (mgr.14355) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:56 smithi171 bash[25040]: cluster 2024-09-13T23:49:55.503639+0000 mgr.a (mgr.14355) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:49:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:49:58 smithi007 bash[22722]: cluster 2024-09-13T23:49:57.504450+0000 mgr.a (mgr.14355) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:49:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:49:58 smithi131 bash[24745]: cluster 2024-09-13T23:49:57.504450+0000 mgr.a (mgr.14355) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:49:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:49:58 smithi171 bash[25040]: cluster 2024-09-13T23:49:57.504450+0000 mgr.a (mgr.14355) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:50:00.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:00.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:00 smithi131 bash[24745]: cluster 2024-09-13T23:49:59.505171+0000 mgr.a (mgr.14355) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-13T23:50:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:00 smithi131 bash[24745]: cluster 2024-09-13T23:50:00.000097+0000 mon.a (mon.0) 1161 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:50:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:00 smithi171 bash[25040]: cluster 2024-09-13T23:49:59.505171+0000 mgr.a (mgr.14355) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-13T23:50:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:00 smithi171 bash[25040]: cluster 2024-09-13T23:50:00.000097+0000 mon.a (mon.0) 1161 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:50:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:00 smithi007 bash[22722]: cluster 2024-09-13T23:49:59.505171+0000 mgr.a (mgr.14355) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-13T23:50:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:00 smithi007 bash[22722]: cluster 2024-09-13T23:50:00.000097+0000 mon.a (mon.0) 1161 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-13T23:50:01.306 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:01.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:01.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.874140+0000 mgr.a (mgr.14355) 3854 : audit [DBG] from='client.93939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.963256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.970179+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.971513+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.972416+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.977543+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.979844+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:01 smithi131 bash[24745]: audit 2024-09-13T23:50:00.980952+0000 mgr.a (mgr.14355) 3855 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.874140+0000 mgr.a (mgr.14355) 3854 : audit [DBG] from='client.93939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.963256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.970179+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.971513+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.972416+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.977543+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.979844+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:01 smithi171 bash[25040]: audit 2024-09-13T23:50:00.980952+0000 mgr.a (mgr.14355) 3855 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:02.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22972]: debug 2024-09-13T23:50:01.978+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:50:02.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22972]: debug 2024-09-13T23:50:01.978+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.874140+0000 mgr.a (mgr.14355) 3854 : audit [DBG] from='client.93939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.963256+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.970179+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.971513+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.972416+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.977543+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.979844+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:01 smithi007 bash[22722]: audit 2024-09-13T23:50:00.980952+0000 mgr.a (mgr.14355) 3855 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:50:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:02 smithi131 bash[24745]: cluster 2024-09-13T23:50:01.506743+0000 mgr.a (mgr.14355) 3856 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:02 smithi131 bash[24745]: audit 2024-09-13T23:50:01.984481+0000 mgr.a (mgr.14355) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:50:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:02 smithi131 bash[24745]: cephadm 2024-09-13T23:50:01.985482+0000 mgr.a (mgr.14355) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:50:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:02 smithi171 bash[25040]: cluster 2024-09-13T23:50:01.506743+0000 mgr.a (mgr.14355) 3856 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:02 smithi171 bash[25040]: audit 2024-09-13T23:50:01.984481+0000 mgr.a (mgr.14355) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:50:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:02 smithi171 bash[25040]: cephadm 2024-09-13T23:50:01.985482+0000 mgr.a (mgr.14355) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:50:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:02 smithi007 bash[22722]: cluster 2024-09-13T23:50:01.506743+0000 mgr.a (mgr.14355) 3856 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:02 smithi007 bash[22722]: audit 2024-09-13T23:50:01.984481+0000 mgr.a (mgr.14355) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:50:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:02 smithi007 bash[22722]: cephadm 2024-09-13T23:50:01.985482+0000 mgr.a (mgr.14355) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:50:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:04 smithi131 bash[24745]: cluster 2024-09-13T23:50:03.507727+0000 mgr.a (mgr.14355) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:04 smithi171 bash[25040]: cluster 2024-09-13T23:50:03.507727+0000 mgr.a (mgr.14355) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:04 smithi007 bash[22722]: cluster 2024-09-13T23:50:03.507727+0000 mgr.a (mgr.14355) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:06.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:07.086 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:07.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:07.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:07.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:07.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:06 smithi131 bash[24745]: cluster 2024-09-13T23:50:05.509534+0000 mgr.a (mgr.14355) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:06 smithi171 bash[25040]: cluster 2024-09-13T23:50:05.509534+0000 mgr.a (mgr.14355) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:06 smithi007 bash[22722]: cluster 2024-09-13T23:50:05.509534+0000 mgr.a (mgr.14355) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:07 smithi131 bash[24745]: audit 2024-09-13T23:50:06.643660+0000 mgr.a (mgr.14355) 3861 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:07 smithi171 bash[25040]: audit 2024-09-13T23:50:06.643660+0000 mgr.a (mgr.14355) 3861 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:07 smithi007 bash[22722]: audit 2024-09-13T23:50:06.643660+0000 mgr.a (mgr.14355) 3861 : audit [DBG] from='client.94122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:08 smithi131 bash[24745]: cluster 2024-09-13T23:50:07.511305+0000 mgr.a (mgr.14355) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:08 smithi171 bash[25040]: cluster 2024-09-13T23:50:07.511305+0000 mgr.a (mgr.14355) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:08 smithi007 bash[22722]: cluster 2024-09-13T23:50:07.511305+0000 mgr.a (mgr.14355) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:11 smithi131 bash[24745]: cluster 2024-09-13T23:50:09.512086+0000 mgr.a (mgr.14355) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:11 smithi171 bash[25040]: cluster 2024-09-13T23:50:09.512086+0000 mgr.a (mgr.14355) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:11 smithi007 bash[22722]: cluster 2024-09-13T23:50:09.512086+0000 mgr.a (mgr.14355) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:50:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:12.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:13 smithi131 bash[24745]: cluster 2024-09-13T23:50:11.514237+0000 mgr.a (mgr.14355) 3864 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:13 smithi171 bash[25040]: cluster 2024-09-13T23:50:11.514237+0000 mgr.a (mgr.14355) 3864 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:13 smithi007 bash[22722]: cluster 2024-09-13T23:50:11.514237+0000 mgr.a (mgr.14355) 3864 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:14 smithi131 bash[24745]: audit 2024-09-13T23:50:12.423559+0000 mgr.a (mgr.14355) 3865 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:14 smithi171 bash[25040]: audit 2024-09-13T23:50:12.423559+0000 mgr.a (mgr.14355) 3865 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:14 smithi007 bash[22722]: audit 2024-09-13T23:50:12.423559+0000 mgr.a (mgr.14355) 3865 : audit [DBG] from='client.94197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:15 smithi131 bash[24745]: cluster 2024-09-13T23:50:13.515186+0000 mgr.a (mgr.14355) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:15 smithi171 bash[25040]: cluster 2024-09-13T23:50:13.515186+0000 mgr.a (mgr.14355) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:15 smithi007 bash[22722]: cluster 2024-09-13T23:50:13.515186+0000 mgr.a (mgr.14355) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:17 smithi131 bash[24745]: cluster 2024-09-13T23:50:15.516945+0000 mgr.a (mgr.14355) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:17 smithi171 bash[25040]: cluster 2024-09-13T23:50:15.516945+0000 mgr.a (mgr.14355) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:17 smithi007 bash[22722]: cluster 2024-09-13T23:50:15.516945+0000 mgr.a (mgr.14355) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:50:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:18.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:19 smithi131 bash[24745]: cluster 2024-09-13T23:50:17.518217+0000 mgr.a (mgr.14355) 3868 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:50:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:19 smithi131 bash[24745]: audit 2024-09-13T23:50:18.189858+0000 mgr.a (mgr.14355) 3869 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:19 smithi171 bash[25040]: cluster 2024-09-13T23:50:17.518217+0000 mgr.a (mgr.14355) 3868 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:50:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:19 smithi171 bash[25040]: audit 2024-09-13T23:50:18.189858+0000 mgr.a (mgr.14355) 3869 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:19 smithi007 bash[22722]: cluster 2024-09-13T23:50:17.518217+0000 mgr.a (mgr.14355) 3868 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:50:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:19 smithi007 bash[22722]: audit 2024-09-13T23:50:18.189858+0000 mgr.a (mgr.14355) 3869 : audit [DBG] from='client.94275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:21 smithi131 bash[24745]: cluster 2024-09-13T23:50:19.519318+0000 mgr.a (mgr.14355) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:21.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:21 smithi171 bash[25040]: cluster 2024-09-13T23:50:19.519318+0000 mgr.a (mgr.14355) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:21 smithi007 bash[22722]: cluster 2024-09-13T23:50:19.519318+0000 mgr.a (mgr.14355) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:23 smithi171 bash[25040]: cluster 2024-09-13T23:50:21.521549+0000 mgr.a (mgr.14355) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:23 smithi007 bash[22722]: cluster 2024-09-13T23:50:21.521549+0000 mgr.a (mgr.14355) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:23 smithi131 bash[24745]: cluster 2024-09-13T23:50:21.521549+0000 mgr.a (mgr.14355) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:23.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:23.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:23.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:24.367 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:24.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:25 smithi171 bash[25040]: cluster 2024-09-13T23:50:23.522447+0000 mgr.a (mgr.14355) 3872 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:25 smithi171 bash[25040]: audit 2024-09-13T23:50:23.936883+0000 mgr.a (mgr.14355) 3873 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:25 smithi007 bash[22722]: cluster 2024-09-13T23:50:23.522447+0000 mgr.a (mgr.14355) 3872 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:25 smithi007 bash[22722]: audit 2024-09-13T23:50:23.936883+0000 mgr.a (mgr.14355) 3873 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:25 smithi131 bash[24745]: cluster 2024-09-13T23:50:23.522447+0000 mgr.a (mgr.14355) 3872 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:25 smithi131 bash[24745]: audit 2024-09-13T23:50:23.936883+0000 mgr.a (mgr.14355) 3873 : audit [DBG] from='client.94353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:27 smithi171 bash[25040]: cluster 2024-09-13T23:50:25.524421+0000 mgr.a (mgr.14355) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:27 smithi007 bash[22722]: cluster 2024-09-13T23:50:25.524421+0000 mgr.a (mgr.14355) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:27 smithi131 bash[24745]: cluster 2024-09-13T23:50:25.524421+0000 mgr.a (mgr.14355) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:29.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:29.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:29 smithi007 bash[22722]: cluster 2024-09-13T23:50:27.525851+0000 mgr.a (mgr.14355) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:50:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:29 smithi131 bash[24745]: cluster 2024-09-13T23:50:27.525851+0000 mgr.a (mgr.14355) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:50:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:29 smithi171 bash[25040]: cluster 2024-09-13T23:50:27.525851+0000 mgr.a (mgr.14355) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-13T23:50:30.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:30.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:30.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:30.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:30.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:31 smithi007 bash[22722]: cluster 2024-09-13T23:50:29.526497+0000 mgr.a (mgr.14355) 3876 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:31 smithi007 bash[22722]: audit 2024-09-13T23:50:29.704808+0000 mgr.a (mgr.14355) 3877 : audit [DBG] from='client.94428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:31 smithi131 bash[24745]: cluster 2024-09-13T23:50:29.526497+0000 mgr.a (mgr.14355) 3876 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:31 smithi131 bash[24745]: audit 2024-09-13T23:50:29.704808+0000 mgr.a (mgr.14355) 3877 : audit [DBG] from='client.94428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:31 smithi171 bash[25040]: cluster 2024-09-13T23:50:29.526497+0000 mgr.a (mgr.14355) 3876 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:31 smithi171 bash[25040]: audit 2024-09-13T23:50:29.704808+0000 mgr.a (mgr.14355) 3877 : audit [DBG] from='client.94428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:33 smithi007 bash[22722]: cluster 2024-09-13T23:50:31.528881+0000 mgr.a (mgr.14355) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:33 smithi131 bash[24745]: cluster 2024-09-13T23:50:31.528881+0000 mgr.a (mgr.14355) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:33 smithi171 bash[25040]: cluster 2024-09-13T23:50:31.528881+0000 mgr.a (mgr.14355) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:35.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:35.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:35.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:35 smithi007 bash[22722]: cluster 2024-09-13T23:50:33.529653+0000 mgr.a (mgr.14355) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:35 smithi131 bash[24745]: cluster 2024-09-13T23:50:33.529653+0000 mgr.a (mgr.14355) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:35 smithi171 bash[25040]: cluster 2024-09-13T23:50:33.529653+0000 mgr.a (mgr.14355) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:35.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:37 smithi007 bash[22722]: audit 2024-09-13T23:50:35.487887+0000 mgr.a (mgr.14355) 3880 : audit [DBG] from='client.94503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:37 smithi007 bash[22722]: cluster 2024-09-13T23:50:35.531334+0000 mgr.a (mgr.14355) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:37 smithi131 bash[24745]: audit 2024-09-13T23:50:35.487887+0000 mgr.a (mgr.14355) 3880 : audit [DBG] from='client.94503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:37 smithi131 bash[24745]: cluster 2024-09-13T23:50:35.531334+0000 mgr.a (mgr.14355) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:37 smithi171 bash[25040]: audit 2024-09-13T23:50:35.487887+0000 mgr.a (mgr.14355) 3880 : audit [DBG] from='client.94503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:37 smithi171 bash[25040]: cluster 2024-09-13T23:50:35.531334+0000 mgr.a (mgr.14355) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:39 smithi007 bash[22722]: cluster 2024-09-13T23:50:37.533086+0000 mgr.a (mgr.14355) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:50:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:39 smithi131 bash[24745]: cluster 2024-09-13T23:50:37.533086+0000 mgr.a (mgr.14355) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:50:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:39 smithi171 bash[25040]: cluster 2024-09-13T23:50:37.533086+0000 mgr.a (mgr.14355) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-13T23:50:40.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:40.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:41 smithi007 bash[22722]: cluster 2024-09-13T23:50:39.533914+0000 mgr.a (mgr.14355) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:50:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:41 smithi131 bash[24745]: cluster 2024-09-13T23:50:39.533914+0000 mgr.a (mgr.14355) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:50:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:41 smithi171 bash[25040]: cluster 2024-09-13T23:50:39.533914+0000 mgr.a (mgr.14355) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:50:41.657 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:41.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:41.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:41.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:41.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:42 smithi007 bash[22722]: audit 2024-09-13T23:50:41.241870+0000 mgr.a (mgr.14355) 3884 : audit [DBG] from='client.94578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:42 smithi131 bash[24745]: audit 2024-09-13T23:50:41.241870+0000 mgr.a (mgr.14355) 3884 : audit [DBG] from='client.94578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:42 smithi171 bash[25040]: audit 2024-09-13T23:50:41.241870+0000 mgr.a (mgr.14355) 3884 : audit [DBG] from='client.94578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:43 smithi007 bash[22722]: cluster 2024-09-13T23:50:41.535066+0000 mgr.a (mgr.14355) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:43 smithi131 bash[24745]: cluster 2024-09-13T23:50:41.535066+0000 mgr.a (mgr.14355) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:43 smithi171 bash[25040]: cluster 2024-09-13T23:50:41.535066+0000 mgr.a (mgr.14355) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:45 smithi007 bash[22722]: cluster 2024-09-13T23:50:43.535872+0000 mgr.a (mgr.14355) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:45 smithi131 bash[24745]: cluster 2024-09-13T23:50:43.535872+0000 mgr.a (mgr.14355) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:45 smithi171 bash[25040]: cluster 2024-09-13T23:50:43.535872+0000 mgr.a (mgr.14355) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:50:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:47.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:47.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:47.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:47.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:47.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:47 smithi007 bash[22722]: cluster 2024-09-13T23:50:45.537978+0000 mgr.a (mgr.14355) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:47 smithi131 bash[24745]: cluster 2024-09-13T23:50:45.537978+0000 mgr.a (mgr.14355) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:47 smithi171 bash[25040]: cluster 2024-09-13T23:50:45.537978+0000 mgr.a (mgr.14355) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:48 smithi007 bash[22722]: audit 2024-09-13T23:50:46.993952+0000 mgr.a (mgr.14355) 3888 : audit [DBG] from='client.94653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:48 smithi131 bash[24745]: audit 2024-09-13T23:50:46.993952+0000 mgr.a (mgr.14355) 3888 : audit [DBG] from='client.94653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:48 smithi171 bash[25040]: audit 2024-09-13T23:50:46.993952+0000 mgr.a (mgr.14355) 3888 : audit [DBG] from='client.94653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:49 smithi007 bash[22722]: cluster 2024-09-13T23:50:47.539241+0000 mgr.a (mgr.14355) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:49 smithi131 bash[24745]: cluster 2024-09-13T23:50:47.539241+0000 mgr.a (mgr.14355) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:49 smithi171 bash[25040]: cluster 2024-09-13T23:50:47.539241+0000 mgr.a (mgr.14355) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:51 smithi007 bash[22722]: cluster 2024-09-13T23:50:49.540097+0000 mgr.a (mgr.14355) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:51 smithi131 bash[24745]: cluster 2024-09-13T23:50:49.540097+0000 mgr.a (mgr.14355) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:51 smithi171 bash[25040]: cluster 2024-09-13T23:50:49.540097+0000 mgr.a (mgr.14355) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:52.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:52.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:52.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:53.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:53 smithi007 bash[22722]: cluster 2024-09-13T23:50:51.542377+0000 mgr.a (mgr.14355) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:53 smithi131 bash[24745]: cluster 2024-09-13T23:50:51.542377+0000 mgr.a (mgr.14355) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:53 smithi171 bash[25040]: cluster 2024-09-13T23:50:51.542377+0000 mgr.a (mgr.14355) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:54 smithi007 bash[22722]: audit 2024-09-13T23:50:52.753687+0000 mgr.a (mgr.14355) 3892 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:54 smithi131 bash[24745]: audit 2024-09-13T23:50:52.753687+0000 mgr.a (mgr.14355) 3892 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:54 smithi171 bash[25040]: audit 2024-09-13T23:50:52.753687+0000 mgr.a (mgr.14355) 3892 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:50:55.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:55 smithi007 bash[22722]: cluster 2024-09-13T23:50:53.543326+0000 mgr.a (mgr.14355) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:55 smithi131 bash[24745]: cluster 2024-09-13T23:50:53.543326+0000 mgr.a (mgr.14355) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:55 smithi171 bash[25040]: cluster 2024-09-13T23:50:53.543326+0000 mgr.a (mgr.14355) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:57 smithi007 bash[22722]: cluster 2024-09-13T23:50:55.545490+0000 mgr.a (mgr.14355) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:57 smithi131 bash[24745]: cluster 2024-09-13T23:50:55.545490+0000 mgr.a (mgr.14355) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:57 smithi171 bash[25040]: cluster 2024-09-13T23:50:55.545490+0000 mgr.a (mgr.14355) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:50:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:50:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:50:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:50:58.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:50:58.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:50:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:50:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:50:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:50:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:50:59 smithi007 bash[22722]: cluster 2024-09-13T23:50:57.546274+0000 mgr.a (mgr.14355) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:50:59 smithi131 bash[24745]: cluster 2024-09-13T23:50:57.546274+0000 mgr.a (mgr.14355) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:50:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:50:59 smithi171 bash[25040]: cluster 2024-09-13T23:50:57.546274+0000 mgr.a (mgr.14355) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:00 smithi007 bash[22722]: audit 2024-09-13T23:50:58.506958+0000 mgr.a (mgr.14355) 3896 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:00 smithi131 bash[24745]: audit 2024-09-13T23:50:58.506958+0000 mgr.a (mgr.14355) 3896 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:00 smithi171 bash[25040]: audit 2024-09-13T23:50:58.506958+0000 mgr.a (mgr.14355) 3896 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:01 smithi007 bash[22722]: cluster 2024-09-13T23:50:59.547257+0000 mgr.a (mgr.14355) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:01 smithi131 bash[24745]: cluster 2024-09-13T23:50:59.547257+0000 mgr.a (mgr.14355) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:01 smithi171 bash[25040]: cluster 2024-09-13T23:50:59.547257+0000 mgr.a (mgr.14355) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:02 smithi007 bash[22722]: audit 2024-09-13T23:51:02.051943+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:51:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:02 smithi131 bash[24745]: audit 2024-09-13T23:51:02.051943+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:51:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:02 smithi171 bash[25040]: audit 2024-09-13T23:51:02.051943+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:51:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:03 smithi007 bash[22722]: cluster 2024-09-13T23:51:01.549535+0000 mgr.a (mgr.14355) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:03 smithi007 bash[22722]: audit 2024-09-13T23:51:02.661974+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:03 smithi007 bash[22722]: audit 2024-09-13T23:51:02.665348+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:03 smithi007 bash[22722]: audit 2024-09-13T23:51:02.668262+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:03 smithi007 bash[22722]: audit 2024-09-13T23:51:02.671482+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:03 smithi131 bash[24745]: cluster 2024-09-13T23:51:01.549535+0000 mgr.a (mgr.14355) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:03 smithi131 bash[24745]: audit 2024-09-13T23:51:02.661974+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:03 smithi131 bash[24745]: audit 2024-09-13T23:51:02.665348+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:03 smithi131 bash[24745]: audit 2024-09-13T23:51:02.668262+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:03 smithi131 bash[24745]: audit 2024-09-13T23:51:02.671482+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:03 smithi171 bash[25040]: cluster 2024-09-13T23:51:01.549535+0000 mgr.a (mgr.14355) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:03 smithi171 bash[25040]: audit 2024-09-13T23:51:02.661974+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:03 smithi171 bash[25040]: audit 2024-09-13T23:51:02.665348+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:03 smithi171 bash[25040]: audit 2024-09-13T23:51:02.668262+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:03 smithi171 bash[25040]: audit 2024-09-13T23:51:02.671482+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:03.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:03.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:04.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:04.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:04.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:04.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:04.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:05 smithi007 bash[22722]: cluster 2024-09-13T23:51:03.550430+0000 mgr.a (mgr.14355) 3899 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:05 smithi007 bash[22722]: audit 2024-09-13T23:51:04.270668+0000 mgr.a (mgr.14355) 3900 : audit [DBG] from='client.94878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:05 smithi131 bash[24745]: cluster 2024-09-13T23:51:03.550430+0000 mgr.a (mgr.14355) 3899 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:05 smithi131 bash[24745]: audit 2024-09-13T23:51:04.270668+0000 mgr.a (mgr.14355) 3900 : audit [DBG] from='client.94878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:05 smithi171 bash[25040]: cluster 2024-09-13T23:51:03.550430+0000 mgr.a (mgr.14355) 3899 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:05 smithi171 bash[25040]: audit 2024-09-13T23:51:04.270668+0000 mgr.a (mgr.14355) 3900 : audit [DBG] from='client.94878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:07 smithi007 bash[22722]: cluster 2024-09-13T23:51:05.552868+0000 mgr.a (mgr.14355) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:07 smithi131 bash[24745]: cluster 2024-09-13T23:51:05.552868+0000 mgr.a (mgr.14355) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:07 smithi171 bash[25040]: cluster 2024-09-13T23:51:05.552868+0000 mgr.a (mgr.14355) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:09.419 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:09 smithi131 bash[24745]: cluster 2024-09-13T23:51:07.553677+0000 mgr.a (mgr.14355) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:09 smithi007 bash[22722]: cluster 2024-09-13T23:51:07.553677+0000 mgr.a (mgr.14355) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:09.529 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:09 smithi171 bash[25040]: cluster 2024-09-13T23:51:07.553677+0000 mgr.a (mgr.14355) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:09.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:09.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:10.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:10.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:10.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:10.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:10.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:11 smithi131 bash[24745]: cluster 2024-09-13T23:51:09.554472+0000 mgr.a (mgr.14355) 3903 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:11 smithi131 bash[24745]: audit 2024-09-13T23:51:10.042717+0000 mgr.a (mgr.14355) 3904 : audit [DBG] from='client.94950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:11 smithi171 bash[25040]: cluster 2024-09-13T23:51:09.554472+0000 mgr.a (mgr.14355) 3903 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:11 smithi171 bash[25040]: audit 2024-09-13T23:51:10.042717+0000 mgr.a (mgr.14355) 3904 : audit [DBG] from='client.94950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:11 smithi007 bash[22722]: cluster 2024-09-13T23:51:09.554472+0000 mgr.a (mgr.14355) 3903 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:11 smithi007 bash[22722]: audit 2024-09-13T23:51:10.042717+0000 mgr.a (mgr.14355) 3904 : audit [DBG] from='client.94950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: cluster 2024-09-13T23:51:11.556972+0000 mgr.a (mgr.14355) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:51:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.676457+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.683798+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.690777+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.697481+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.699740+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:51:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.701793+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:51:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.712677+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22722]: audit 2024-09-13T23:51:12.717946+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: cluster 2024-09-13T23:51:11.556972+0000 mgr.a (mgr.14355) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.676457+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.683798+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.690777+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.697481+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.699740+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:51:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.701793+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:51:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.712677+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:13 smithi131 bash[24745]: audit 2024-09-13T23:51:12.717946+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: cluster 2024-09-13T23:51:11.556972+0000 mgr.a (mgr.14355) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-13T23:51:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.676457+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.683798+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.690777+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.697481+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.699740+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:51:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.701793+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:51:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.712677+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:51:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:13 smithi171 bash[25040]: audit 2024-09-13T23:51:12.717946+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:13.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22972]: debug 2024-09-13T23:51:13.485+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:51:13.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:51:13 smithi007 bash[22972]: debug 2024-09-13T23:51:13.485+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:51:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:14 smithi007 bash[22722]: audit 2024-09-13T23:51:12.720300+0000 mgr.a (mgr.14355) 3906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:14 smithi131 bash[24745]: audit 2024-09-13T23:51:12.720300+0000 mgr.a (mgr.14355) 3906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:14 smithi171 bash[25040]: audit 2024-09-13T23:51:12.720300+0000 mgr.a (mgr.14355) 3906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:51:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:15 smithi007 bash[22722]: audit 2024-09-13T23:51:13.486893+0000 mgr.a (mgr.14355) 3907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:51:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:15 smithi007 bash[22722]: cephadm 2024-09-13T23:51:13.488173+0000 mgr.a (mgr.14355) 3908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:51:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:15 smithi007 bash[22722]: cluster 2024-09-13T23:51:13.557637+0000 mgr.a (mgr.14355) 3909 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:51:15.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:15.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:15.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:15 smithi131 bash[24745]: audit 2024-09-13T23:51:13.486893+0000 mgr.a (mgr.14355) 3907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:51:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:15 smithi131 bash[24745]: cephadm 2024-09-13T23:51:13.488173+0000 mgr.a (mgr.14355) 3908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:51:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:15 smithi131 bash[24745]: cluster 2024-09-13T23:51:13.557637+0000 mgr.a (mgr.14355) 3909 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:51:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:15 smithi171 bash[25040]: audit 2024-09-13T23:51:13.486893+0000 mgr.a (mgr.14355) 3907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:51:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:15 smithi171 bash[25040]: cephadm 2024-09-13T23:51:13.488173+0000 mgr.a (mgr.14355) 3908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:51:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:15 smithi171 bash[25040]: cluster 2024-09-13T23:51:13.557637+0000 mgr.a (mgr.14355) 3909 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:51:16.224 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:17 smithi007 bash[22722]: cluster 2024-09-13T23:51:15.558620+0000 mgr.a (mgr.14355) 3910 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:17 smithi007 bash[22722]: audit 2024-09-13T23:51:15.781776+0000 mgr.a (mgr.14355) 3911 : audit [DBG] from='client.95127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:17 smithi131 bash[24745]: cluster 2024-09-13T23:51:15.558620+0000 mgr.a (mgr.14355) 3910 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:17 smithi131 bash[24745]: audit 2024-09-13T23:51:15.781776+0000 mgr.a (mgr.14355) 3911 : audit [DBG] from='client.95127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:17 smithi171 bash[25040]: cluster 2024-09-13T23:51:15.558620+0000 mgr.a (mgr.14355) 3910 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:17 smithi171 bash[25040]: audit 2024-09-13T23:51:15.781776+0000 mgr.a (mgr.14355) 3911 : audit [DBG] from='client.95127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:19 smithi007 bash[22722]: cluster 2024-09-13T23:51:17.559533+0000 mgr.a (mgr.14355) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:19 smithi131 bash[24745]: cluster 2024-09-13T23:51:17.559533+0000 mgr.a (mgr.14355) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:19 smithi171 bash[25040]: cluster 2024-09-13T23:51:17.559533+0000 mgr.a (mgr.14355) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:21.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:21 smithi007 bash[22722]: cluster 2024-09-13T23:51:19.560330+0000 mgr.a (mgr.14355) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:21 smithi131 bash[24745]: cluster 2024-09-13T23:51:19.560330+0000 mgr.a (mgr.14355) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:21 smithi171 bash[25040]: cluster 2024-09-13T23:51:19.560330+0000 mgr.a (mgr.14355) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:51:21.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:21.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:21.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:21.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:21.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:23 smithi007 bash[22722]: audit 2024-09-13T23:51:21.560196+0000 mgr.a (mgr.14355) 3914 : audit [DBG] from='client.95202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:23 smithi007 bash[22722]: cluster 2024-09-13T23:51:21.579150+0000 mgr.a (mgr.14355) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:23 smithi131 bash[24745]: audit 2024-09-13T23:51:21.560196+0000 mgr.a (mgr.14355) 3914 : audit [DBG] from='client.95202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:23 smithi131 bash[24745]: cluster 2024-09-13T23:51:21.579150+0000 mgr.a (mgr.14355) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:23 smithi171 bash[25040]: audit 2024-09-13T23:51:21.560196+0000 mgr.a (mgr.14355) 3914 : audit [DBG] from='client.95202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:23 smithi171 bash[25040]: cluster 2024-09-13T23:51:21.579150+0000 mgr.a (mgr.14355) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:51:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:25 smithi007 bash[22722]: cluster 2024-09-13T23:51:23.580159+0000 mgr.a (mgr.14355) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-13T23:51:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:25 smithi131 bash[24745]: cluster 2024-09-13T23:51:23.580159+0000 mgr.a (mgr.14355) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-13T23:51:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:25 smithi171 bash[25040]: cluster 2024-09-13T23:51:23.580159+0000 mgr.a (mgr.14355) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-13T23:51:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:27 smithi131 bash[24745]: cluster 2024-09-13T23:51:25.582402+0000 mgr.a (mgr.14355) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T23:51:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:27 smithi171 bash[25040]: cluster 2024-09-13T23:51:25.582402+0000 mgr.a (mgr.14355) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T23:51:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:27 smithi007 bash[22722]: cluster 2024-09-13T23:51:25.582402+0000 mgr.a (mgr.14355) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-13T23:51:27.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:27.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:27.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:27.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:27.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:29 smithi131 bash[24745]: audit 2024-09-13T23:51:27.318622+0000 mgr.a (mgr.14355) 3918 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:29 smithi131 bash[24745]: cluster 2024-09-13T23:51:27.583059+0000 mgr.a (mgr.14355) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:29 smithi171 bash[25040]: audit 2024-09-13T23:51:27.318622+0000 mgr.a (mgr.14355) 3918 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:29 smithi171 bash[25040]: cluster 2024-09-13T23:51:27.583059+0000 mgr.a (mgr.14355) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:29 smithi007 bash[22722]: audit 2024-09-13T23:51:27.318622+0000 mgr.a (mgr.14355) 3918 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:29 smithi007 bash[22722]: cluster 2024-09-13T23:51:27.583059+0000 mgr.a (mgr.14355) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:31 smithi131 bash[24745]: cluster 2024-09-13T23:51:29.583965+0000 mgr.a (mgr.14355) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:31 smithi171 bash[25040]: cluster 2024-09-13T23:51:29.583965+0000 mgr.a (mgr.14355) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:31 smithi007 bash[22722]: cluster 2024-09-13T23:51:29.583965+0000 mgr.a (mgr.14355) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:32.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:32.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:33.488 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:33.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:33 smithi131 bash[24745]: cluster 2024-09-13T23:51:31.586416+0000 mgr.a (mgr.14355) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:33 smithi171 bash[25040]: cluster 2024-09-13T23:51:31.586416+0000 mgr.a (mgr.14355) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:33 smithi007 bash[22722]: cluster 2024-09-13T23:51:31.586416+0000 mgr.a (mgr.14355) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:34 smithi131 bash[24745]: audit 2024-09-13T23:51:33.085887+0000 mgr.a (mgr.14355) 3922 : audit [DBG] from='client.95355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:34 smithi171 bash[25040]: audit 2024-09-13T23:51:33.085887+0000 mgr.a (mgr.14355) 3922 : audit [DBG] from='client.95355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:34 smithi007 bash[22722]: audit 2024-09-13T23:51:33.085887+0000 mgr.a (mgr.14355) 3922 : audit [DBG] from='client.95355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:35 smithi131 bash[24745]: cluster 2024-09-13T23:51:33.587520+0000 mgr.a (mgr.14355) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:35 smithi171 bash[25040]: cluster 2024-09-13T23:51:33.587520+0000 mgr.a (mgr.14355) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:35 smithi007 bash[22722]: cluster 2024-09-13T23:51:33.587520+0000 mgr.a (mgr.14355) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:37 smithi131 bash[24745]: cluster 2024-09-13T23:51:35.589756+0000 mgr.a (mgr.14355) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:37 smithi171 bash[25040]: cluster 2024-09-13T23:51:35.589756+0000 mgr.a (mgr.14355) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:37 smithi007 bash[22722]: cluster 2024-09-13T23:51:35.589756+0000 mgr.a (mgr.14355) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:38.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:38.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:38.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:39.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:39.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:39 smithi131 bash[24745]: cluster 2024-09-13T23:51:37.590539+0000 mgr.a (mgr.14355) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:39 smithi171 bash[25040]: cluster 2024-09-13T23:51:37.590539+0000 mgr.a (mgr.14355) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:39 smithi007 bash[22722]: cluster 2024-09-13T23:51:37.590539+0000 mgr.a (mgr.14355) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:40 smithi131 bash[24745]: audit 2024-09-13T23:51:38.820994+0000 mgr.a (mgr.14355) 3926 : audit [DBG] from='client.95433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:40 smithi171 bash[25040]: audit 2024-09-13T23:51:38.820994+0000 mgr.a (mgr.14355) 3926 : audit [DBG] from='client.95433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:40 smithi007 bash[22722]: audit 2024-09-13T23:51:38.820994+0000 mgr.a (mgr.14355) 3926 : audit [DBG] from='client.95433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:41 smithi131 bash[24745]: cluster 2024-09-13T23:51:39.591673+0000 mgr.a (mgr.14355) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:41 smithi171 bash[25040]: cluster 2024-09-13T23:51:39.591673+0000 mgr.a (mgr.14355) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:41 smithi007 bash[22722]: cluster 2024-09-13T23:51:39.591673+0000 mgr.a (mgr.14355) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:43 smithi131 bash[24745]: cluster 2024-09-13T23:51:41.594096+0000 mgr.a (mgr.14355) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:43 smithi171 bash[25040]: cluster 2024-09-13T23:51:41.594096+0000 mgr.a (mgr.14355) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:43 smithi007 bash[22722]: cluster 2024-09-13T23:51:41.594096+0000 mgr.a (mgr.14355) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:44.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:44.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:44.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:44.997 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:44.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:44.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:44.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:44.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:45 smithi131 bash[24745]: cluster 2024-09-13T23:51:43.595036+0000 mgr.a (mgr.14355) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:45 smithi171 bash[25040]: cluster 2024-09-13T23:51:43.595036+0000 mgr.a (mgr.14355) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:45 smithi007 bash[22722]: cluster 2024-09-13T23:51:43.595036+0000 mgr.a (mgr.14355) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:46 smithi131 bash[24745]: audit 2024-09-13T23:51:44.568585+0000 mgr.a (mgr.14355) 3930 : audit [DBG] from='client.95505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:46 smithi171 bash[25040]: audit 2024-09-13T23:51:44.568585+0000 mgr.a (mgr.14355) 3930 : audit [DBG] from='client.95505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:46 smithi007 bash[22722]: audit 2024-09-13T23:51:44.568585+0000 mgr.a (mgr.14355) 3930 : audit [DBG] from='client.95505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:47 smithi131 bash[24745]: cluster 2024-09-13T23:51:45.597461+0000 mgr.a (mgr.14355) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:47 smithi171 bash[25040]: cluster 2024-09-13T23:51:45.597461+0000 mgr.a (mgr.14355) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:47 smithi007 bash[22722]: cluster 2024-09-13T23:51:45.597461+0000 mgr.a (mgr.14355) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:51:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:49 smithi131 bash[24745]: cluster 2024-09-13T23:51:47.598273+0000 mgr.a (mgr.14355) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:49 smithi171 bash[25040]: cluster 2024-09-13T23:51:47.598273+0000 mgr.a (mgr.14355) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:49 smithi007 bash[22722]: cluster 2024-09-13T23:51:47.598273+0000 mgr.a (mgr.14355) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:49.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:49.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:50.758 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:50.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:51 smithi131 bash[24745]: cluster 2024-09-13T23:51:49.599027+0000 mgr.a (mgr.14355) 3933 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:51 smithi171 bash[25040]: cluster 2024-09-13T23:51:49.599027+0000 mgr.a (mgr.14355) 3933 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:51 smithi007 bash[22722]: cluster 2024-09-13T23:51:49.599027+0000 mgr.a (mgr.14355) 3933 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:52 smithi171 bash[25040]: audit 2024-09-13T23:51:50.339746+0000 mgr.a (mgr.14355) 3934 : audit [DBG] from='client.95583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:52 smithi007 bash[22722]: audit 2024-09-13T23:51:50.339746+0000 mgr.a (mgr.14355) 3934 : audit [DBG] from='client.95583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:52 smithi131 bash[24745]: audit 2024-09-13T23:51:50.339746+0000 mgr.a (mgr.14355) 3934 : audit [DBG] from='client.95583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:53 smithi171 bash[25040]: cluster 2024-09-13T23:51:51.601883+0000 mgr.a (mgr.14355) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:53 smithi007 bash[22722]: cluster 2024-09-13T23:51:51.601883+0000 mgr.a (mgr.14355) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:53 smithi131 bash[24745]: cluster 2024-09-13T23:51:51.601883+0000 mgr.a (mgr.14355) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:55 smithi171 bash[25040]: cluster 2024-09-13T23:51:53.602696+0000 mgr.a (mgr.14355) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:51:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:55 smithi007 bash[22722]: cluster 2024-09-13T23:51:53.602696+0000 mgr.a (mgr.14355) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:51:55.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:51:55.761 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:51:55.761 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:51:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:55 smithi131 bash[24745]: cluster 2024-09-13T23:51:53.602696+0000 mgr.a (mgr.14355) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:51:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:51:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:51:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:51:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:51:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:51:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:57 smithi007 bash[22722]: cluster 2024-09-13T23:51:55.604735+0000 mgr.a (mgr.14355) 3937 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:57 smithi007 bash[22722]: audit 2024-09-13T23:51:56.091874+0000 mgr.a (mgr.14355) 3938 : audit [DBG] from='client.95658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:57 smithi131 bash[24745]: cluster 2024-09-13T23:51:55.604735+0000 mgr.a (mgr.14355) 3937 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:57 smithi131 bash[24745]: audit 2024-09-13T23:51:56.091874+0000 mgr.a (mgr.14355) 3938 : audit [DBG] from='client.95658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:57 smithi171 bash[25040]: cluster 2024-09-13T23:51:55.604735+0000 mgr.a (mgr.14355) 3937 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:51:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:57 smithi171 bash[25040]: audit 2024-09-13T23:51:56.091874+0000 mgr.a (mgr.14355) 3938 : audit [DBG] from='client.95658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:51:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:51:59 smithi007 bash[22722]: cluster 2024-09-13T23:51:57.605727+0000 mgr.a (mgr.14355) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:51:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:51:59 smithi131 bash[24745]: cluster 2024-09-13T23:51:57.605727+0000 mgr.a (mgr.14355) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:51:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:51:59 smithi171 bash[25040]: cluster 2024-09-13T23:51:57.605727+0000 mgr.a (mgr.14355) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:52:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:00 smithi007 bash[22722]: cluster 2024-09-13T23:51:59.606677+0000 mgr.a (mgr.14355) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:52:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:00 smithi131 bash[24745]: cluster 2024-09-13T23:51:59.606677+0000 mgr.a (mgr.14355) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:52:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:00 smithi171 bash[25040]: cluster 2024-09-13T23:51:59.606677+0000 mgr.a (mgr.14355) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:52:01.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:01.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:01.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:02.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:02 smithi007 bash[22722]: cluster 2024-09-13T23:52:01.608430+0000 mgr.a (mgr.14355) 3941 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:02 smithi007 bash[22722]: audit 2024-09-13T23:52:01.850286+0000 mgr.a (mgr.14355) 3942 : audit [DBG] from='client.95733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:02 smithi131 bash[24745]: cluster 2024-09-13T23:52:01.608430+0000 mgr.a (mgr.14355) 3941 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:02 smithi131 bash[24745]: audit 2024-09-13T23:52:01.850286+0000 mgr.a (mgr.14355) 3942 : audit [DBG] from='client.95733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:02 smithi171 bash[25040]: cluster 2024-09-13T23:52:01.608430+0000 mgr.a (mgr.14355) 3941 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:02 smithi171 bash[25040]: audit 2024-09-13T23:52:01.850286+0000 mgr.a (mgr.14355) 3942 : audit [DBG] from='client.95733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:04 smithi007 bash[22722]: cluster 2024-09-13T23:52:03.609320+0000 mgr.a (mgr.14355) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:04 smithi131 bash[24745]: cluster 2024-09-13T23:52:03.609320+0000 mgr.a (mgr.14355) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:04 smithi171 bash[25040]: cluster 2024-09-13T23:52:03.609320+0000 mgr.a (mgr.14355) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:52:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:06 smithi007 bash[22722]: cluster 2024-09-13T23:52:05.611576+0000 mgr.a (mgr.14355) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:06 smithi131 bash[24745]: cluster 2024-09-13T23:52:05.611576+0000 mgr.a (mgr.14355) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:06 smithi171 bash[25040]: cluster 2024-09-13T23:52:05.611576+0000 mgr.a (mgr.14355) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:07.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:07.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:08.068 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:08 smithi007 bash[22722]: cluster 2024-09-13T23:52:07.612331+0000 mgr.a (mgr.14355) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:08 smithi007 bash[22722]: audit 2024-09-13T23:52:07.630139+0000 mgr.a (mgr.14355) 3946 : audit [DBG] from='client.95811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:08 smithi131 bash[24745]: cluster 2024-09-13T23:52:07.612331+0000 mgr.a (mgr.14355) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:08 smithi131 bash[24745]: audit 2024-09-13T23:52:07.630139+0000 mgr.a (mgr.14355) 3946 : audit [DBG] from='client.95811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:08 smithi171 bash[25040]: cluster 2024-09-13T23:52:07.612331+0000 mgr.a (mgr.14355) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:08 smithi171 bash[25040]: audit 2024-09-13T23:52:07.630139+0000 mgr.a (mgr.14355) 3946 : audit [DBG] from='client.95811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:10 smithi007 bash[22722]: cluster 2024-09-13T23:52:09.613388+0000 mgr.a (mgr.14355) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:10 smithi131 bash[24745]: cluster 2024-09-13T23:52:09.613388+0000 mgr.a (mgr.14355) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:10 smithi171 bash[25040]: cluster 2024-09-13T23:52:09.613388+0000 mgr.a (mgr.14355) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-13T23:52:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:12 smithi007 bash[22722]: cluster 2024-09-13T23:52:11.615864+0000 mgr.a (mgr.14355) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:12 smithi131 bash[24745]: cluster 2024-09-13T23:52:11.615864+0000 mgr.a (mgr.14355) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:12 smithi171 bash[25040]: cluster 2024-09-13T23:52:11.615864+0000 mgr.a (mgr.14355) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-09-13T23:52:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:13.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:13.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:13.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:13.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:13 smithi007 bash[22722]: audit 2024-09-13T23:52:13.540355+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:52:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:13 smithi131 bash[24745]: audit 2024-09-13T23:52:13.540355+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:52:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:13 smithi171 bash[25040]: audit 2024-09-13T23:52:13.540355+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: audit 2024-09-13T23:52:13.398689+0000 mgr.a (mgr.14355) 3949 : audit [DBG] from='client.95889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: cluster 2024-09-13T23:52:13.616458+0000 mgr.a (mgr.14355) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: audit 2024-09-13T23:52:14.313188+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: audit 2024-09-13T23:52:14.314458+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:52:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: audit 2024-09-13T23:52:14.322997+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:52:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:14 smithi007 bash[22722]: audit 2024-09-13T23:52:14.325404+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: audit 2024-09-13T23:52:13.398689+0000 mgr.a (mgr.14355) 3949 : audit [DBG] from='client.95889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: cluster 2024-09-13T23:52:13.616458+0000 mgr.a (mgr.14355) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: audit 2024-09-13T23:52:14.313188+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: audit 2024-09-13T23:52:14.314458+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: audit 2024-09-13T23:52:14.322997+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:14 smithi131 bash[24745]: audit 2024-09-13T23:52:14.325404+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: audit 2024-09-13T23:52:13.398689+0000 mgr.a (mgr.14355) 3949 : audit [DBG] from='client.95889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: cluster 2024-09-13T23:52:13.616458+0000 mgr.a (mgr.14355) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: audit 2024-09-13T23:52:14.313188+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: audit 2024-09-13T23:52:14.314458+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: audit 2024-09-13T23:52:14.322997+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:14 smithi171 bash[25040]: audit 2024-09-13T23:52:14.325404+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:15.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:52:15 smithi007 bash[22972]: debug 2024-09-13T23:52:15.040+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:52:15.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:52:15 smithi007 bash[22972]: debug 2024-09-13T23:52:15.040+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:52:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:15 smithi131 bash[24745]: audit 2024-09-13T23:52:14.328052+0000 mgr.a (mgr.14355) 3951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:15 smithi131 bash[24745]: audit 2024-09-13T23:52:15.042464+0000 mgr.a (mgr.14355) 3952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:52:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:15 smithi131 bash[24745]: cephadm 2024-09-13T23:52:15.043857+0000 mgr.a (mgr.14355) 3953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:52:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:15 smithi171 bash[25040]: audit 2024-09-13T23:52:14.328052+0000 mgr.a (mgr.14355) 3951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:15 smithi171 bash[25040]: audit 2024-09-13T23:52:15.042464+0000 mgr.a (mgr.14355) 3952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:52:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:15 smithi171 bash[25040]: cephadm 2024-09-13T23:52:15.043857+0000 mgr.a (mgr.14355) 3953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:52:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:15 smithi007 bash[22722]: audit 2024-09-13T23:52:14.328052+0000 mgr.a (mgr.14355) 3951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:52:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:15 smithi007 bash[22722]: audit 2024-09-13T23:52:15.042464+0000 mgr.a (mgr.14355) 3952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:52:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:15 smithi007 bash[22722]: cephadm 2024-09-13T23:52:15.043857+0000 mgr.a (mgr.14355) 3953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:52:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:16 smithi131 bash[24745]: cluster 2024-09-13T23:52:15.618844+0000 mgr.a (mgr.14355) 3954 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:52:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:16 smithi171 bash[25040]: cluster 2024-09-13T23:52:15.618844+0000 mgr.a (mgr.14355) 3954 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:52:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:16 smithi007 bash[22722]: cluster 2024-09-13T23:52:15.618844+0000 mgr.a (mgr.14355) 3954 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 63 op/s 2024-09-13T23:52:18.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:18.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:18 smithi131 bash[24745]: cluster 2024-09-13T23:52:17.619646+0000 mgr.a (mgr.14355) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:18 smithi171 bash[25040]: cluster 2024-09-13T23:52:17.619646+0000 mgr.a (mgr.14355) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:18 smithi007 bash[22722]: cluster 2024-09-13T23:52:17.619646+0000 mgr.a (mgr.14355) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:19.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:19.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:19 smithi131 bash[24745]: audit 2024-09-13T23:52:19.169726+0000 mgr.a (mgr.14355) 3956 : audit [DBG] from='client.96075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:19 smithi171 bash[25040]: audit 2024-09-13T23:52:19.169726+0000 mgr.a (mgr.14355) 3956 : audit [DBG] from='client.96075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:19 smithi007 bash[22722]: audit 2024-09-13T23:52:19.169726+0000 mgr.a (mgr.14355) 3956 : audit [DBG] from='client.96075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:20 smithi131 bash[24745]: cluster 2024-09-13T23:52:19.620247+0000 mgr.a (mgr.14355) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:20 smithi171 bash[25040]: cluster 2024-09-13T23:52:19.620247+0000 mgr.a (mgr.14355) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:20 smithi007 bash[22722]: cluster 2024-09-13T23:52:19.620247+0000 mgr.a (mgr.14355) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:22 smithi131 bash[24745]: cluster 2024-09-13T23:52:21.622498+0000 mgr.a (mgr.14355) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:22 smithi171 bash[25040]: cluster 2024-09-13T23:52:21.622498+0000 mgr.a (mgr.14355) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:22 smithi007 bash[22722]: cluster 2024-09-13T23:52:21.622498+0000 mgr.a (mgr.14355) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:24.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:24.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:24 smithi131 bash[24745]: cluster 2024-09-13T23:52:23.623266+0000 mgr.a (mgr.14355) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:24 smithi171 bash[25040]: cluster 2024-09-13T23:52:23.623266+0000 mgr.a (mgr.14355) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:24 smithi007 bash[22722]: cluster 2024-09-13T23:52:23.623266+0000 mgr.a (mgr.14355) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:25.341 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:25 smithi131 bash[24745]: audit 2024-09-13T23:52:24.912988+0000 mgr.a (mgr.14355) 3960 : audit [DBG] from='client.96150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:25 smithi171 bash[25040]: audit 2024-09-13T23:52:24.912988+0000 mgr.a (mgr.14355) 3960 : audit [DBG] from='client.96150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:25 smithi007 bash[22722]: audit 2024-09-13T23:52:24.912988+0000 mgr.a (mgr.14355) 3960 : audit [DBG] from='client.96150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:26 smithi131 bash[24745]: cluster 2024-09-13T23:52:25.625665+0000 mgr.a (mgr.14355) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:26 smithi171 bash[25040]: cluster 2024-09-13T23:52:25.625665+0000 mgr.a (mgr.14355) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:26 smithi007 bash[22722]: cluster 2024-09-13T23:52:25.625665+0000 mgr.a (mgr.14355) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:52:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:28 smithi131 bash[24745]: cluster 2024-09-13T23:52:27.626478+0000 mgr.a (mgr.14355) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:28 smithi171 bash[25040]: cluster 2024-09-13T23:52:27.626478+0000 mgr.a (mgr.14355) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:28 smithi007 bash[22722]: cluster 2024-09-13T23:52:27.626478+0000 mgr.a (mgr.14355) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:30.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:30.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:30 smithi131 bash[24745]: cluster 2024-09-13T23:52:29.627253+0000 mgr.a (mgr.14355) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:30 smithi171 bash[25040]: cluster 2024-09-13T23:52:29.627253+0000 mgr.a (mgr.14355) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:31.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:31.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:31.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:31.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:31.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:30 smithi007 bash[22722]: cluster 2024-09-13T23:52:29.627253+0000 mgr.a (mgr.14355) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:52:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:31 smithi131 bash[24745]: audit 2024-09-13T23:52:30.675008+0000 mgr.a (mgr.14355) 3964 : audit [DBG] from='client.96225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:31 smithi171 bash[25040]: audit 2024-09-13T23:52:30.675008+0000 mgr.a (mgr.14355) 3964 : audit [DBG] from='client.96225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:31 smithi007 bash[22722]: audit 2024-09-13T23:52:30.675008+0000 mgr.a (mgr.14355) 3964 : audit [DBG] from='client.96225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:32 smithi131 bash[24745]: cluster 2024-09-13T23:52:31.630056+0000 mgr.a (mgr.14355) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:32 smithi171 bash[25040]: cluster 2024-09-13T23:52:31.630056+0000 mgr.a (mgr.14355) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:32 smithi007 bash[22722]: cluster 2024-09-13T23:52:31.630056+0000 mgr.a (mgr.14355) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:34 smithi131 bash[24745]: cluster 2024-09-13T23:52:33.630873+0000 mgr.a (mgr.14355) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:52:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:34 smithi171 bash[25040]: cluster 2024-09-13T23:52:33.630873+0000 mgr.a (mgr.14355) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:52:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:34 smithi007 bash[22722]: cluster 2024-09-13T23:52:33.630873+0000 mgr.a (mgr.14355) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:52:36.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:36.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:36.832 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:36 smithi131 bash[24745]: cluster 2024-09-13T23:52:35.632851+0000 mgr.a (mgr.14355) 3967 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:36 smithi171 bash[25040]: cluster 2024-09-13T23:52:35.632851+0000 mgr.a (mgr.14355) 3967 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:36 smithi007 bash[22722]: cluster 2024-09-13T23:52:35.632851+0000 mgr.a (mgr.14355) 3967 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:37 smithi131 bash[24745]: audit 2024-09-13T23:52:36.421376+0000 mgr.a (mgr.14355) 3968 : audit [DBG] from='client.96300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:37 smithi171 bash[25040]: audit 2024-09-13T23:52:36.421376+0000 mgr.a (mgr.14355) 3968 : audit [DBG] from='client.96300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:37 smithi007 bash[22722]: audit 2024-09-13T23:52:36.421376+0000 mgr.a (mgr.14355) 3968 : audit [DBG] from='client.96300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:38 smithi131 bash[24745]: cluster 2024-09-13T23:52:37.633767+0000 mgr.a (mgr.14355) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:38 smithi171 bash[25040]: cluster 2024-09-13T23:52:37.633767+0000 mgr.a (mgr.14355) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:38 smithi007 bash[22722]: cluster 2024-09-13T23:52:37.633767+0000 mgr.a (mgr.14355) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:40 smithi171 bash[25040]: cluster 2024-09-13T23:52:39.634584+0000 mgr.a (mgr.14355) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:40 smithi007 bash[22722]: cluster 2024-09-13T23:52:39.634584+0000 mgr.a (mgr.14355) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:40 smithi131 bash[24745]: cluster 2024-09-13T23:52:39.634584+0000 mgr.a (mgr.14355) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:52:41.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:41.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:42.600 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:42 smithi007 bash[22722]: cluster 2024-09-13T23:52:41.636825+0000 mgr.a (mgr.14355) 3971 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:52:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:42 smithi007 bash[22722]: audit 2024-09-13T23:52:42.166643+0000 mgr.a (mgr.14355) 3972 : audit [DBG] from='client.96378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:42 smithi131 bash[24745]: cluster 2024-09-13T23:52:41.636825+0000 mgr.a (mgr.14355) 3971 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:52:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:42 smithi131 bash[24745]: audit 2024-09-13T23:52:42.166643+0000 mgr.a (mgr.14355) 3972 : audit [DBG] from='client.96378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:42 smithi171 bash[25040]: cluster 2024-09-13T23:52:41.636825+0000 mgr.a (mgr.14355) 3971 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:52:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:42 smithi171 bash[25040]: audit 2024-09-13T23:52:42.166643+0000 mgr.a (mgr.14355) 3972 : audit [DBG] from='client.96378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:44 smithi007 bash[22722]: cluster 2024-09-13T23:52:43.637728+0000 mgr.a (mgr.14355) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:44 smithi131 bash[24745]: cluster 2024-09-13T23:52:43.637728+0000 mgr.a (mgr.14355) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:44 smithi171 bash[25040]: cluster 2024-09-13T23:52:43.637728+0000 mgr.a (mgr.14355) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:46 smithi007 bash[22722]: cluster 2024-09-13T23:52:45.639934+0000 mgr.a (mgr.14355) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:46 smithi131 bash[24745]: cluster 2024-09-13T23:52:45.639934+0000 mgr.a (mgr.14355) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:46 smithi171 bash[25040]: cluster 2024-09-13T23:52:45.639934+0000 mgr.a (mgr.14355) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:48.381 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:48.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:48.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:48.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:48.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:48 smithi007 bash[22722]: cluster 2024-09-13T23:52:47.640484+0000 mgr.a (mgr.14355) 3975 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:48 smithi007 bash[22722]: audit 2024-09-13T23:52:47.940865+0000 mgr.a (mgr.14355) 3976 : audit [DBG] from='client.96456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:48 smithi131 bash[24745]: cluster 2024-09-13T23:52:47.640484+0000 mgr.a (mgr.14355) 3975 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:48 smithi131 bash[24745]: audit 2024-09-13T23:52:47.940865+0000 mgr.a (mgr.14355) 3976 : audit [DBG] from='client.96456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:48 smithi171 bash[25040]: cluster 2024-09-13T23:52:47.640484+0000 mgr.a (mgr.14355) 3975 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:48 smithi171 bash[25040]: audit 2024-09-13T23:52:47.940865+0000 mgr.a (mgr.14355) 3976 : audit [DBG] from='client.96456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:50 smithi007 bash[22722]: cluster 2024-09-13T23:52:49.641347+0000 mgr.a (mgr.14355) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:50 smithi131 bash[24745]: cluster 2024-09-13T23:52:49.641347+0000 mgr.a (mgr.14355) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:50 smithi171 bash[25040]: cluster 2024-09-13T23:52:49.641347+0000 mgr.a (mgr.14355) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:52 smithi007 bash[22722]: cluster 2024-09-13T23:52:51.643637+0000 mgr.a (mgr.14355) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:52 smithi131 bash[24745]: cluster 2024-09-13T23:52:51.643637+0000 mgr.a (mgr.14355) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:52 smithi171 bash[25040]: cluster 2024-09-13T23:52:51.643637+0000 mgr.a (mgr.14355) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:53.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:54.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:52:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:54.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:54 smithi007 bash[22722]: cluster 2024-09-13T23:52:53.644364+0000 mgr.a (mgr.14355) 3979 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:54 smithi007 bash[22722]: audit 2024-09-13T23:52:53.716425+0000 mgr.a (mgr.14355) 3980 : audit [DBG] from='client.96534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:54 smithi131 bash[24745]: cluster 2024-09-13T23:52:53.644364+0000 mgr.a (mgr.14355) 3979 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:54 smithi131 bash[24745]: audit 2024-09-13T23:52:53.716425+0000 mgr.a (mgr.14355) 3980 : audit [DBG] from='client.96534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:54 smithi171 bash[25040]: cluster 2024-09-13T23:52:53.644364+0000 mgr.a (mgr.14355) 3979 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:54 smithi171 bash[25040]: audit 2024-09-13T23:52:53.716425+0000 mgr.a (mgr.14355) 3980 : audit [DBG] from='client.96534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:52:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:56 smithi007 bash[22722]: cluster 2024-09-13T23:52:55.646650+0000 mgr.a (mgr.14355) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:56 smithi131 bash[24745]: cluster 2024-09-13T23:52:55.646650+0000 mgr.a (mgr.14355) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:56 smithi171 bash[25040]: cluster 2024-09-13T23:52:55.646650+0000 mgr.a (mgr.14355) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:52:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:52:59.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:52:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:52:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:52:58 smithi007 bash[22722]: cluster 2024-09-13T23:52:57.647436+0000 mgr.a (mgr.14355) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:52:58 smithi131 bash[24745]: cluster 2024-09-13T23:52:57.647436+0000 mgr.a (mgr.14355) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:52:58 smithi171 bash[25040]: cluster 2024-09-13T23:52:57.647436+0000 mgr.a (mgr.14355) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:52:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:52:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:52:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:52:59.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:52:59.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:00 smithi007 bash[22722]: audit 2024-09-13T23:52:59.465791+0000 mgr.a (mgr.14355) 3983 : audit [DBG] from='client.96609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:00 smithi007 bash[22722]: cluster 2024-09-13T23:52:59.647968+0000 mgr.a (mgr.14355) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:00 smithi131 bash[24745]: audit 2024-09-13T23:52:59.465791+0000 mgr.a (mgr.14355) 3983 : audit [DBG] from='client.96609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:00 smithi131 bash[24745]: cluster 2024-09-13T23:52:59.647968+0000 mgr.a (mgr.14355) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:00 smithi171 bash[25040]: audit 2024-09-13T23:52:59.465791+0000 mgr.a (mgr.14355) 3983 : audit [DBG] from='client.96609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:00 smithi171 bash[25040]: cluster 2024-09-13T23:52:59.647968+0000 mgr.a (mgr.14355) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:02 smithi007 bash[22722]: cluster 2024-09-13T23:53:01.650342+0000 mgr.a (mgr.14355) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:02 smithi131 bash[24745]: cluster 2024-09-13T23:53:01.650342+0000 mgr.a (mgr.14355) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:02 smithi171 bash[25040]: cluster 2024-09-13T23:53:01.650342+0000 mgr.a (mgr.14355) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:04.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:04.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:04.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:04 smithi007 bash[22722]: cluster 2024-09-13T23:53:03.651125+0000 mgr.a (mgr.14355) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:04 smithi131 bash[24745]: cluster 2024-09-13T23:53:03.651125+0000 mgr.a (mgr.14355) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:04 smithi171 bash[25040]: cluster 2024-09-13T23:53:03.651125+0000 mgr.a (mgr.14355) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:05.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:05.664 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:05 smithi007 bash[22722]: audit 2024-09-13T23:53:05.224838+0000 mgr.a (mgr.14355) 3987 : audit [DBG] from='client.96681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:05 smithi131 bash[24745]: audit 2024-09-13T23:53:05.224838+0000 mgr.a (mgr.14355) 3987 : audit [DBG] from='client.96681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:05 smithi171 bash[25040]: audit 2024-09-13T23:53:05.224838+0000 mgr.a (mgr.14355) 3987 : audit [DBG] from='client.96681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:06 smithi007 bash[22722]: cluster 2024-09-13T23:53:05.652757+0000 mgr.a (mgr.14355) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:06 smithi131 bash[24745]: cluster 2024-09-13T23:53:05.652757+0000 mgr.a (mgr.14355) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:06 smithi171 bash[25040]: cluster 2024-09-13T23:53:05.652757+0000 mgr.a (mgr.14355) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:08 smithi007 bash[22722]: cluster 2024-09-13T23:53:07.653498+0000 mgr.a (mgr.14355) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:08 smithi131 bash[24745]: cluster 2024-09-13T23:53:07.653498+0000 mgr.a (mgr.14355) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:08 smithi171 bash[25040]: cluster 2024-09-13T23:53:07.653498+0000 mgr.a (mgr.14355) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:10 smithi007 bash[22722]: cluster 2024-09-13T23:53:09.654261+0000 mgr.a (mgr.14355) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:10 smithi131 bash[24745]: cluster 2024-09-13T23:53:09.654261+0000 mgr.a (mgr.14355) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:10 smithi171 bash[25040]: cluster 2024-09-13T23:53:09.654261+0000 mgr.a (mgr.14355) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:11.445 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:11.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:11 smithi007 bash[22722]: audit 2024-09-13T23:53:11.003463+0000 mgr.a (mgr.14355) 3991 : audit [DBG] from='client.96759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:11 smithi131 bash[24745]: audit 2024-09-13T23:53:11.003463+0000 mgr.a (mgr.14355) 3991 : audit [DBG] from='client.96759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:11 smithi171 bash[25040]: audit 2024-09-13T23:53:11.003463+0000 mgr.a (mgr.14355) 3991 : audit [DBG] from='client.96759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:12 smithi007 bash[22722]: cluster 2024-09-13T23:53:11.657163+0000 mgr.a (mgr.14355) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:12 smithi131 bash[24745]: cluster 2024-09-13T23:53:11.657163+0000 mgr.a (mgr.14355) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:12 smithi171 bash[25040]: cluster 2024-09-13T23:53:11.657163+0000 mgr.a (mgr.14355) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:14 smithi007 bash[22722]: cluster 2024-09-13T23:53:13.658145+0000 mgr.a (mgr.14355) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:14 smithi131 bash[24745]: cluster 2024-09-13T23:53:13.658145+0000 mgr.a (mgr.14355) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:14 smithi171 bash[25040]: cluster 2024-09-13T23:53:13.658145+0000 mgr.a (mgr.14355) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:15 smithi007 bash[22722]: audit 2024-09-13T23:53:15.095359+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:53:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:15 smithi131 bash[24745]: audit 2024-09-13T23:53:15.095359+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:53:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:15 smithi171 bash[25040]: audit 2024-09-13T23:53:15.095359+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:53:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:16.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: cluster 2024-09-13T23:53:15.659097+0000 mgr.a (mgr.14355) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.447792+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.452158+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.455035+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.458923+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.467281+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.471753+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.472697+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.473536+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.479153+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:16 smithi007 bash[22722]: audit 2024-09-13T23:53:16.481267+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: cluster 2024-09-13T23:53:15.659097+0000 mgr.a (mgr.14355) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.447792+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.452158+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.455035+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.458923+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.467281+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.471753+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.472697+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.473536+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.479153+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:16 smithi131 bash[24745]: audit 2024-09-13T23:53:16.481267+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: cluster 2024-09-13T23:53:15.659097+0000 mgr.a (mgr.14355) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.447792+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.452158+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.455035+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.458923+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.467281+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.471753+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.472697+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.473536+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.479153+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:53:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:16 smithi171 bash[25040]: audit 2024-09-13T23:53:16.481267+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:17.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:17.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:17.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22972]: debug 2024-09-13T23:53:17.203+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:53:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22972]: debug 2024-09-13T23:53:17.211+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:53:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22722]: audit 2024-09-13T23:53:16.482161+0000 mgr.a (mgr.14355) 3995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22722]: audit 2024-09-13T23:53:16.815577+0000 mgr.a (mgr.14355) 3996 : audit [DBG] from='client.96837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22722]: audit 2024-09-13T23:53:17.206559+0000 mgr.a (mgr.14355) 3997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:53:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:17 smithi007 bash[22722]: cephadm 2024-09-13T23:53:17.218311+0000 mgr.a (mgr.14355) 3998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:53:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:17 smithi131 bash[24745]: audit 2024-09-13T23:53:16.482161+0000 mgr.a (mgr.14355) 3995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:17 smithi131 bash[24745]: audit 2024-09-13T23:53:16.815577+0000 mgr.a (mgr.14355) 3996 : audit [DBG] from='client.96837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:17 smithi131 bash[24745]: audit 2024-09-13T23:53:17.206559+0000 mgr.a (mgr.14355) 3997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:53:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:17 smithi131 bash[24745]: cephadm 2024-09-13T23:53:17.218311+0000 mgr.a (mgr.14355) 3998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:53:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:17 smithi171 bash[25040]: audit 2024-09-13T23:53:16.482161+0000 mgr.a (mgr.14355) 3995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:53:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:17 smithi171 bash[25040]: audit 2024-09-13T23:53:16.815577+0000 mgr.a (mgr.14355) 3996 : audit [DBG] from='client.96837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:17 smithi171 bash[25040]: audit 2024-09-13T23:53:17.206559+0000 mgr.a (mgr.14355) 3997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:53:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:17 smithi171 bash[25040]: cephadm 2024-09-13T23:53:17.218311+0000 mgr.a (mgr.14355) 3998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:53:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:18 smithi007 bash[22722]: cluster 2024-09-13T23:53:17.660021+0000 mgr.a (mgr.14355) 3999 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:18 smithi131 bash[24745]: cluster 2024-09-13T23:53:17.660021+0000 mgr.a (mgr.14355) 3999 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:18 smithi171 bash[25040]: cluster 2024-09-13T23:53:17.660021+0000 mgr.a (mgr.14355) 3999 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:20 smithi007 bash[22722]: cluster 2024-09-13T23:53:19.660788+0000 mgr.a (mgr.14355) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:20 smithi131 bash[24745]: cluster 2024-09-13T23:53:19.660788+0000 mgr.a (mgr.14355) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:20 smithi171 bash[25040]: cluster 2024-09-13T23:53:19.660788+0000 mgr.a (mgr.14355) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:22.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:22 smithi007 bash[22722]: cluster 2024-09-13T23:53:21.663054+0000 mgr.a (mgr.14355) 4001 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:22 smithi131 bash[24745]: cluster 2024-09-13T23:53:21.663054+0000 mgr.a (mgr.14355) 4001 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:22 smithi171 bash[25040]: cluster 2024-09-13T23:53:21.663054+0000 mgr.a (mgr.14355) 4001 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:23.361 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:23.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:23.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:23 smithi007 bash[22722]: audit 2024-09-13T23:53:22.943210+0000 mgr.a (mgr.14355) 4002 : audit [DBG] from='client.97020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:23 smithi131 bash[24745]: audit 2024-09-13T23:53:22.943210+0000 mgr.a (mgr.14355) 4002 : audit [DBG] from='client.97020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:23 smithi171 bash[25040]: audit 2024-09-13T23:53:22.943210+0000 mgr.a (mgr.14355) 4002 : audit [DBG] from='client.97020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:24 smithi007 bash[22722]: cluster 2024-09-13T23:53:23.663997+0000 mgr.a (mgr.14355) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:24 smithi131 bash[24745]: cluster 2024-09-13T23:53:23.663997+0000 mgr.a (mgr.14355) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:24 smithi171 bash[25040]: cluster 2024-09-13T23:53:23.663997+0000 mgr.a (mgr.14355) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:26 smithi007 bash[22722]: cluster 2024-09-13T23:53:25.666159+0000 mgr.a (mgr.14355) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:26 smithi131 bash[24745]: cluster 2024-09-13T23:53:25.666159+0000 mgr.a (mgr.14355) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:26 smithi171 bash[25040]: cluster 2024-09-13T23:53:25.666159+0000 mgr.a (mgr.14355) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:28.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:29.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:29.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:29.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:28 smithi007 bash[22722]: cluster 2024-09-13T23:53:27.666921+0000 mgr.a (mgr.14355) 4005 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:28 smithi131 bash[24745]: cluster 2024-09-13T23:53:27.666921+0000 mgr.a (mgr.14355) 4005 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:28 smithi171 bash[25040]: cluster 2024-09-13T23:53:27.666921+0000 mgr.a (mgr.14355) 4005 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:29 smithi007 bash[22722]: audit 2024-09-13T23:53:28.697895+0000 mgr.a (mgr.14355) 4006 : audit [DBG] from='client.97092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:29 smithi131 bash[24745]: audit 2024-09-13T23:53:28.697895+0000 mgr.a (mgr.14355) 4006 : audit [DBG] from='client.97092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:29 smithi171 bash[25040]: audit 2024-09-13T23:53:28.697895+0000 mgr.a (mgr.14355) 4006 : audit [DBG] from='client.97092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:30 smithi007 bash[22722]: cluster 2024-09-13T23:53:29.667819+0000 mgr.a (mgr.14355) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:30 smithi131 bash[24745]: cluster 2024-09-13T23:53:29.667819+0000 mgr.a (mgr.14355) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:30 smithi171 bash[25040]: cluster 2024-09-13T23:53:29.667819+0000 mgr.a (mgr.14355) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:32 smithi007 bash[22722]: cluster 2024-09-13T23:53:31.670086+0000 mgr.a (mgr.14355) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:32 smithi131 bash[24745]: cluster 2024-09-13T23:53:31.670086+0000 mgr.a (mgr.14355) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:32 smithi171 bash[25040]: cluster 2024-09-13T23:53:31.670086+0000 mgr.a (mgr.14355) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:53:34.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:34.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:34.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:34.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:34.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:34.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:34.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:34.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:34 smithi007 bash[22722]: cluster 2024-09-13T23:53:33.670864+0000 mgr.a (mgr.14355) 4009 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:34 smithi131 bash[24745]: cluster 2024-09-13T23:53:33.670864+0000 mgr.a (mgr.14355) 4009 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:34 smithi171 bash[25040]: cluster 2024-09-13T23:53:33.670864+0000 mgr.a (mgr.14355) 4009 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:35 smithi007 bash[22722]: audit 2024-09-13T23:53:34.473487+0000 mgr.a (mgr.14355) 4010 : audit [DBG] from='client.97170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:35 smithi131 bash[24745]: audit 2024-09-13T23:53:34.473487+0000 mgr.a (mgr.14355) 4010 : audit [DBG] from='client.97170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:35 smithi171 bash[25040]: audit 2024-09-13T23:53:34.473487+0000 mgr.a (mgr.14355) 4010 : audit [DBG] from='client.97170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:36 smithi131 bash[24745]: cluster 2024-09-13T23:53:35.673130+0000 mgr.a (mgr.14355) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:36 smithi171 bash[25040]: cluster 2024-09-13T23:53:35.673130+0000 mgr.a (mgr.14355) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:36 smithi007 bash[22722]: cluster 2024-09-13T23:53:35.673130+0000 mgr.a (mgr.14355) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:38 smithi131 bash[24745]: cluster 2024-09-13T23:53:37.673890+0000 mgr.a (mgr.14355) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:38 smithi171 bash[25040]: cluster 2024-09-13T23:53:37.673890+0000 mgr.a (mgr.14355) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:38 smithi007 bash[22722]: cluster 2024-09-13T23:53:37.673890+0000 mgr.a (mgr.14355) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:39.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:39.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:40.656 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:40.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:40 smithi131 bash[24745]: cluster 2024-09-13T23:53:39.674667+0000 mgr.a (mgr.14355) 4013 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:40 smithi131 bash[24745]: audit 2024-09-13T23:53:40.239731+0000 mgr.a (mgr.14355) 4014 : audit [DBG] from='client.97245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:40 smithi171 bash[25040]: cluster 2024-09-13T23:53:39.674667+0000 mgr.a (mgr.14355) 4013 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:40 smithi171 bash[25040]: audit 2024-09-13T23:53:40.239731+0000 mgr.a (mgr.14355) 4014 : audit [DBG] from='client.97245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:40 smithi007 bash[22722]: cluster 2024-09-13T23:53:39.674667+0000 mgr.a (mgr.14355) 4013 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:40 smithi007 bash[22722]: audit 2024-09-13T23:53:40.239731+0000 mgr.a (mgr.14355) 4014 : audit [DBG] from='client.97245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:42 smithi131 bash[24745]: cluster 2024-09-13T23:53:41.677369+0000 mgr.a (mgr.14355) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:42 smithi171 bash[25040]: cluster 2024-09-13T23:53:41.677369+0000 mgr.a (mgr.14355) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:42 smithi007 bash[22722]: cluster 2024-09-13T23:53:41.677369+0000 mgr.a (mgr.14355) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:44 smithi131 bash[24745]: cluster 2024-09-13T23:53:43.678164+0000 mgr.a (mgr.14355) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:45.315 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:44 smithi171 bash[25040]: cluster 2024-09-13T23:53:43.678164+0000 mgr.a (mgr.14355) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:44 smithi007 bash[22722]: cluster 2024-09-13T23:53:43.678164+0000 mgr.a (mgr.14355) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:45.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:45.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:45.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:46.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:46.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:46.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:46 smithi131 bash[24745]: cluster 2024-09-13T23:53:45.679546+0000 mgr.a (mgr.14355) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:46 smithi131 bash[24745]: audit 2024-09-13T23:53:45.996574+0000 mgr.a (mgr.14355) 4018 : audit [DBG] from='client.97323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:46 smithi171 bash[25040]: cluster 2024-09-13T23:53:45.679546+0000 mgr.a (mgr.14355) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:46 smithi171 bash[25040]: audit 2024-09-13T23:53:45.996574+0000 mgr.a (mgr.14355) 4018 : audit [DBG] from='client.97323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:46 smithi007 bash[22722]: cluster 2024-09-13T23:53:45.679546+0000 mgr.a (mgr.14355) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:46 smithi007 bash[22722]: audit 2024-09-13T23:53:45.996574+0000 mgr.a (mgr.14355) 4018 : audit [DBG] from='client.97323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:48 smithi131 bash[24745]: cluster 2024-09-13T23:53:47.680423+0000 mgr.a (mgr.14355) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:48 smithi171 bash[25040]: cluster 2024-09-13T23:53:47.680423+0000 mgr.a (mgr.14355) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:48 smithi007 bash[22722]: cluster 2024-09-13T23:53:47.680423+0000 mgr.a (mgr.14355) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:53:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:50 smithi131 bash[24745]: cluster 2024-09-13T23:53:49.681203+0000 mgr.a (mgr.14355) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:50 smithi171 bash[25040]: cluster 2024-09-13T23:53:49.681203+0000 mgr.a (mgr.14355) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:51.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:50 smithi007 bash[22722]: cluster 2024-09-13T23:53:49.681203+0000 mgr.a (mgr.14355) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:53:52.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:52.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:52 smithi131 bash[24745]: cluster 2024-09-13T23:53:51.683388+0000 mgr.a (mgr.14355) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:52 smithi131 bash[24745]: audit 2024-09-13T23:53:51.755560+0000 mgr.a (mgr.14355) 4022 : audit [DBG] from='client.97392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:52 smithi171 bash[25040]: cluster 2024-09-13T23:53:51.683388+0000 mgr.a (mgr.14355) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:52 smithi171 bash[25040]: audit 2024-09-13T23:53:51.755560+0000 mgr.a (mgr.14355) 4022 : audit [DBG] from='client.97392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:52 smithi007 bash[22722]: cluster 2024-09-13T23:53:51.683388+0000 mgr.a (mgr.14355) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:52 smithi007 bash[22722]: audit 2024-09-13T23:53:51.755560+0000 mgr.a (mgr.14355) 4022 : audit [DBG] from='client.97392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:54 smithi131 bash[24745]: cluster 2024-09-13T23:53:53.684282+0000 mgr.a (mgr.14355) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:54 smithi171 bash[25040]: cluster 2024-09-13T23:53:53.684282+0000 mgr.a (mgr.14355) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:54 smithi007 bash[22722]: cluster 2024-09-13T23:53:53.684282+0000 mgr.a (mgr.14355) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:53:57.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:53:57.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:53:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:56 smithi131 bash[24745]: cluster 2024-09-13T23:53:55.686487+0000 mgr.a (mgr.14355) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:56 smithi171 bash[25040]: cluster 2024-09-13T23:53:55.686487+0000 mgr.a (mgr.14355) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:56 smithi007 bash[22722]: cluster 2024-09-13T23:53:55.686487+0000 mgr.a (mgr.14355) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:53:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:53:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:53:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:53:57.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:53:57.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:53:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:58 smithi131 bash[24745]: audit 2024-09-13T23:53:57.499370+0000 mgr.a (mgr.14355) 4025 : audit [DBG] from='client.97467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:53:58 smithi131 bash[24745]: cluster 2024-09-13T23:53:57.687198+0000 mgr.a (mgr.14355) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:58 smithi171 bash[25040]: audit 2024-09-13T23:53:57.499370+0000 mgr.a (mgr.14355) 4025 : audit [DBG] from='client.97467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:53:58 smithi171 bash[25040]: cluster 2024-09-13T23:53:57.687198+0000 mgr.a (mgr.14355) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:53:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:58 smithi007 bash[22722]: audit 2024-09-13T23:53:57.499370+0000 mgr.a (mgr.14355) 4025 : audit [DBG] from='client.97467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:53:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:53:58 smithi007 bash[22722]: cluster 2024-09-13T23:53:57.687198+0000 mgr.a (mgr.14355) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:01 smithi131 bash[24745]: cluster 2024-09-13T23:53:59.688085+0000 mgr.a (mgr.14355) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:01 smithi171 bash[25040]: cluster 2024-09-13T23:53:59.688085+0000 mgr.a (mgr.14355) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:01 smithi007 bash[22722]: cluster 2024-09-13T23:53:59.688085+0000 mgr.a (mgr.14355) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:02.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:02.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:02.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:03 smithi131 bash[24745]: cluster 2024-09-13T23:54:01.690368+0000 mgr.a (mgr.14355) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:03 smithi171 bash[25040]: cluster 2024-09-13T23:54:01.690368+0000 mgr.a (mgr.14355) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:03 smithi007 bash[22722]: cluster 2024-09-13T23:54:01.690368+0000 mgr.a (mgr.14355) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:03.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:04 smithi131 bash[24745]: audit 2024-09-13T23:54:03.273272+0000 mgr.a (mgr.14355) 4029 : audit [DBG] from='client.97545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:04 smithi171 bash[25040]: audit 2024-09-13T23:54:03.273272+0000 mgr.a (mgr.14355) 4029 : audit [DBG] from='client.97545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:04 smithi007 bash[22722]: audit 2024-09-13T23:54:03.273272+0000 mgr.a (mgr.14355) 4029 : audit [DBG] from='client.97545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:05 smithi131 bash[24745]: cluster 2024-09-13T23:54:03.690943+0000 mgr.a (mgr.14355) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:05 smithi171 bash[25040]: cluster 2024-09-13T23:54:03.690943+0000 mgr.a (mgr.14355) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:05 smithi007 bash[22722]: cluster 2024-09-13T23:54:03.690943+0000 mgr.a (mgr.14355) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:07 smithi131 bash[24745]: cluster 2024-09-13T23:54:05.693098+0000 mgr.a (mgr.14355) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:07 smithi171 bash[25040]: cluster 2024-09-13T23:54:05.693098+0000 mgr.a (mgr.14355) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:07 smithi007 bash[22722]: cluster 2024-09-13T23:54:05.693098+0000 mgr.a (mgr.14355) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:08.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:08.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:09 smithi131 bash[24745]: cluster 2024-09-13T23:54:07.693841+0000 mgr.a (mgr.14355) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:09 smithi171 bash[25040]: cluster 2024-09-13T23:54:07.693841+0000 mgr.a (mgr.14355) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:09.447 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:09.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:09 smithi007 bash[22722]: cluster 2024-09-13T23:54:07.693841+0000 mgr.a (mgr.14355) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:10 smithi171 bash[25040]: audit 2024-09-13T23:54:09.044774+0000 mgr.a (mgr.14355) 4033 : audit [DBG] from='client.97620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:10 smithi007 bash[22722]: audit 2024-09-13T23:54:09.044774+0000 mgr.a (mgr.14355) 4033 : audit [DBG] from='client.97620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:10 smithi131 bash[24745]: audit 2024-09-13T23:54:09.044774+0000 mgr.a (mgr.14355) 4033 : audit [DBG] from='client.97620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:11 smithi171 bash[25040]: cluster 2024-09-13T23:54:09.694702+0000 mgr.a (mgr.14355) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:11 smithi007 bash[22722]: cluster 2024-09-13T23:54:09.694702+0000 mgr.a (mgr.14355) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:11 smithi131 bash[24745]: cluster 2024-09-13T23:54:09.694702+0000 mgr.a (mgr.14355) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:13 smithi171 bash[25040]: cluster 2024-09-13T23:54:11.696978+0000 mgr.a (mgr.14355) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:13 smithi007 bash[22722]: cluster 2024-09-13T23:54:11.696978+0000 mgr.a (mgr.14355) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:13 smithi131 bash[24745]: cluster 2024-09-13T23:54:11.696978+0000 mgr.a (mgr.14355) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:15.231 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:15 smithi007 bash[22722]: cluster 2024-09-13T23:54:13.697769+0000 mgr.a (mgr.14355) 4036 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:15 smithi131 bash[24745]: cluster 2024-09-13T23:54:13.697769+0000 mgr.a (mgr.14355) 4036 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:15 smithi171 bash[25040]: cluster 2024-09-13T23:54:13.697769+0000 mgr.a (mgr.14355) 4036 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:16 smithi007 bash[22722]: audit 2024-09-13T23:54:14.785080+0000 mgr.a (mgr.14355) 4037 : audit [DBG] from='client.97695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:16 smithi131 bash[24745]: audit 2024-09-13T23:54:14.785080+0000 mgr.a (mgr.14355) 4037 : audit [DBG] from='client.97695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:16 smithi171 bash[25040]: audit 2024-09-13T23:54:14.785080+0000 mgr.a (mgr.14355) 4037 : audit [DBG] from='client.97695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:17 smithi007 bash[22722]: cluster 2024-09-13T23:54:15.700119+0000 mgr.a (mgr.14355) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:17 smithi131 bash[24745]: cluster 2024-09-13T23:54:15.700119+0000 mgr.a (mgr.14355) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:17 smithi171 bash[25040]: cluster 2024-09-13T23:54:15.700119+0000 mgr.a (mgr.14355) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:18 smithi007 bash[22722]: audit 2024-09-13T23:54:17.281915+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:54:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:18 smithi131 bash[24745]: audit 2024-09-13T23:54:17.281915+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:54:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:18 smithi171 bash[25040]: audit 2024-09-13T23:54:17.281915+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:54:19.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:54:18 smithi007 bash[22972]: debug 2024-09-13T23:54:18.862+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:54:19.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:54:18 smithi007 bash[22972]: debug 2024-09-13T23:54:18.862+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: cluster 2024-09-13T23:54:17.700865+0000 mgr.a (mgr.14355) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: audit 2024-09-13T23:54:18.126406+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: audit 2024-09-13T23:54:18.128121+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: audit 2024-09-13T23:54:18.138493+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: audit 2024-09-13T23:54:18.143431+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:19 smithi007 bash[22722]: audit 2024-09-13T23:54:18.145750+0000 mgr.a (mgr.14355) 4040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: cluster 2024-09-13T23:54:17.700865+0000 mgr.a (mgr.14355) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: audit 2024-09-13T23:54:18.126406+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: audit 2024-09-13T23:54:18.128121+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: audit 2024-09-13T23:54:18.138493+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: audit 2024-09-13T23:54:18.143431+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:19.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:19 smithi131 bash[24745]: audit 2024-09-13T23:54:18.145750+0000 mgr.a (mgr.14355) 4040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: cluster 2024-09-13T23:54:17.700865+0000 mgr.a (mgr.14355) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: audit 2024-09-13T23:54:18.126406+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: audit 2024-09-13T23:54:18.128121+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: audit 2024-09-13T23:54:18.138493+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: audit 2024-09-13T23:54:18.143431+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:19 smithi171 bash[25040]: audit 2024-09-13T23:54:18.145750+0000 mgr.a (mgr.14355) 4040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:54:20.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:20 smithi007 bash[22722]: audit 2024-09-13T23:54:18.867968+0000 mgr.a (mgr.14355) 4041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:54:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:20 smithi007 bash[22722]: cephadm 2024-09-13T23:54:18.869340+0000 mgr.a (mgr.14355) 4042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:54:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:20 smithi131 bash[24745]: audit 2024-09-13T23:54:18.867968+0000 mgr.a (mgr.14355) 4041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:54:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:20 smithi131 bash[24745]: cephadm 2024-09-13T23:54:18.869340+0000 mgr.a (mgr.14355) 4042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:54:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:20 smithi171 bash[25040]: audit 2024-09-13T23:54:18.867968+0000 mgr.a (mgr.14355) 4041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:54:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:20 smithi171 bash[25040]: cephadm 2024-09-13T23:54:18.869340+0000 mgr.a (mgr.14355) 4042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:54:20.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:21 smithi007 bash[22722]: cluster 2024-09-13T23:54:19.701757+0000 mgr.a (mgr.14355) 4043 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:21 smithi131 bash[24745]: cluster 2024-09-13T23:54:19.701757+0000 mgr.a (mgr.14355) 4043 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:21 smithi171 bash[25040]: cluster 2024-09-13T23:54:19.701757+0000 mgr.a (mgr.14355) 4043 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:54:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:22 smithi007 bash[22722]: audit 2024-09-13T23:54:20.567401+0000 mgr.a (mgr.14355) 4044 : audit [DBG] from='client.97875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:22 smithi131 bash[24745]: audit 2024-09-13T23:54:20.567401+0000 mgr.a (mgr.14355) 4044 : audit [DBG] from='client.97875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:22 smithi171 bash[25040]: audit 2024-09-13T23:54:20.567401+0000 mgr.a (mgr.14355) 4044 : audit [DBG] from='client.97875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:23 smithi007 bash[22722]: cluster 2024-09-13T23:54:21.704529+0000 mgr.a (mgr.14355) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:23 smithi131 bash[24745]: cluster 2024-09-13T23:54:21.704529+0000 mgr.a (mgr.14355) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:23 smithi171 bash[25040]: cluster 2024-09-13T23:54:21.704529+0000 mgr.a (mgr.14355) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:25 smithi007 bash[22722]: cluster 2024-09-13T23:54:23.705457+0000 mgr.a (mgr.14355) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:25 smithi131 bash[24745]: cluster 2024-09-13T23:54:23.705457+0000 mgr.a (mgr.14355) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:25 smithi171 bash[25040]: cluster 2024-09-13T23:54:23.705457+0000 mgr.a (mgr.14355) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:26.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:26.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:26.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:27 smithi007 bash[22722]: cluster 2024-09-13T23:54:25.707461+0000 mgr.a (mgr.14355) 4047 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:27 smithi131 bash[24745]: cluster 2024-09-13T23:54:25.707461+0000 mgr.a (mgr.14355) 4047 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:27 smithi171 bash[25040]: cluster 2024-09-13T23:54:25.707461+0000 mgr.a (mgr.14355) 4047 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:28 smithi007 bash[22722]: audit 2024-09-13T23:54:26.335060+0000 mgr.a (mgr.14355) 4048 : audit [DBG] from='client.97953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:28 smithi131 bash[24745]: audit 2024-09-13T23:54:26.335060+0000 mgr.a (mgr.14355) 4048 : audit [DBG] from='client.97953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:28 smithi171 bash[25040]: audit 2024-09-13T23:54:26.335060+0000 mgr.a (mgr.14355) 4048 : audit [DBG] from='client.97953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:29 smithi007 bash[22722]: cluster 2024-09-13T23:54:27.708398+0000 mgr.a (mgr.14355) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:29 smithi131 bash[24745]: cluster 2024-09-13T23:54:27.708398+0000 mgr.a (mgr.14355) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:29 smithi171 bash[25040]: cluster 2024-09-13T23:54:27.708398+0000 mgr.a (mgr.14355) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:31 smithi007 bash[22722]: cluster 2024-09-13T23:54:29.709166+0000 mgr.a (mgr.14355) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:31 smithi131 bash[24745]: cluster 2024-09-13T23:54:29.709166+0000 mgr.a (mgr.14355) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:31 smithi171 bash[25040]: cluster 2024-09-13T23:54:29.709166+0000 mgr.a (mgr.14355) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:54:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:31.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:32.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:33 smithi007 bash[22722]: cluster 2024-09-13T23:54:31.711460+0000 mgr.a (mgr.14355) 4051 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:33 smithi007 bash[22722]: audit 2024-09-13T23:54:32.109385+0000 mgr.a (mgr.14355) 4052 : audit [DBG] from='client.98028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:33 smithi131 bash[24745]: cluster 2024-09-13T23:54:31.711460+0000 mgr.a (mgr.14355) 4051 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:33 smithi131 bash[24745]: audit 2024-09-13T23:54:32.109385+0000 mgr.a (mgr.14355) 4052 : audit [DBG] from='client.98028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:33 smithi171 bash[25040]: cluster 2024-09-13T23:54:31.711460+0000 mgr.a (mgr.14355) 4051 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:54:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:33 smithi171 bash[25040]: audit 2024-09-13T23:54:32.109385+0000 mgr.a (mgr.14355) 4052 : audit [DBG] from='client.98028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:35 smithi007 bash[22722]: cluster 2024-09-13T23:54:33.712453+0000 mgr.a (mgr.14355) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:35 smithi131 bash[24745]: cluster 2024-09-13T23:54:33.712453+0000 mgr.a (mgr.14355) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:35 smithi171 bash[25040]: cluster 2024-09-13T23:54:33.712453+0000 mgr.a (mgr.14355) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:37 smithi007 bash[22722]: cluster 2024-09-13T23:54:35.714677+0000 mgr.a (mgr.14355) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:37.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:37 smithi131 bash[24745]: cluster 2024-09-13T23:54:35.714677+0000 mgr.a (mgr.14355) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:37.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:37 smithi171 bash[25040]: cluster 2024-09-13T23:54:35.714677+0000 mgr.a (mgr.14355) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:38.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:39 smithi007 bash[22722]: cluster 2024-09-13T23:54:37.715414+0000 mgr.a (mgr.14355) 4055 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:39 smithi007 bash[22722]: audit 2024-09-13T23:54:37.868218+0000 mgr.a (mgr.14355) 4056 : audit [DBG] from='client.98106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:39 smithi131 bash[24745]: cluster 2024-09-13T23:54:37.715414+0000 mgr.a (mgr.14355) 4055 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:39 smithi131 bash[24745]: audit 2024-09-13T23:54:37.868218+0000 mgr.a (mgr.14355) 4056 : audit [DBG] from='client.98106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:39 smithi171 bash[25040]: cluster 2024-09-13T23:54:37.715414+0000 mgr.a (mgr.14355) 4055 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:39 smithi171 bash[25040]: audit 2024-09-13T23:54:37.868218+0000 mgr.a (mgr.14355) 4056 : audit [DBG] from='client.98106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:41 smithi007 bash[22722]: cluster 2024-09-13T23:54:39.716372+0000 mgr.a (mgr.14355) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:41 smithi131 bash[24745]: cluster 2024-09-13T23:54:39.716372+0000 mgr.a (mgr.14355) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:41 smithi171 bash[25040]: cluster 2024-09-13T23:54:39.716372+0000 mgr.a (mgr.14355) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:43 smithi007 bash[22722]: cluster 2024-09-13T23:54:41.718699+0000 mgr.a (mgr.14355) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:43 smithi131 bash[24745]: cluster 2024-09-13T23:54:41.718699+0000 mgr.a (mgr.14355) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:43 smithi171 bash[25040]: cluster 2024-09-13T23:54:41.718699+0000 mgr.a (mgr.14355) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:44.049 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:44.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:45 smithi007 bash[22722]: audit 2024-09-13T23:54:43.617048+0000 mgr.a (mgr.14355) 4059 : audit [DBG] from='client.98184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:45 smithi007 bash[22722]: cluster 2024-09-13T23:54:43.719253+0000 mgr.a (mgr.14355) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:45 smithi131 bash[24745]: audit 2024-09-13T23:54:43.617048+0000 mgr.a (mgr.14355) 4059 : audit [DBG] from='client.98184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:45 smithi131 bash[24745]: cluster 2024-09-13T23:54:43.719253+0000 mgr.a (mgr.14355) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:45 smithi171 bash[25040]: audit 2024-09-13T23:54:43.617048+0000 mgr.a (mgr.14355) 4059 : audit [DBG] from='client.98184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:45 smithi171 bash[25040]: cluster 2024-09-13T23:54:43.719253+0000 mgr.a (mgr.14355) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:47 smithi007 bash[22722]: cluster 2024-09-13T23:54:45.721541+0000 mgr.a (mgr.14355) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:47 smithi131 bash[24745]: cluster 2024-09-13T23:54:45.721541+0000 mgr.a (mgr.14355) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:47 smithi171 bash[25040]: cluster 2024-09-13T23:54:45.721541+0000 mgr.a (mgr.14355) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:49.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:49.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:49 smithi007 bash[22722]: cluster 2024-09-13T23:54:47.722350+0000 mgr.a (mgr.14355) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:49 smithi131 bash[24745]: cluster 2024-09-13T23:54:47.722350+0000 mgr.a (mgr.14355) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:49 smithi171 bash[25040]: cluster 2024-09-13T23:54:47.722350+0000 mgr.a (mgr.14355) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:49.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:51 smithi007 bash[22722]: audit 2024-09-13T23:54:49.381039+0000 mgr.a (mgr.14355) 4063 : audit [DBG] from='client.98256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:51 smithi007 bash[22722]: cluster 2024-09-13T23:54:49.722861+0000 mgr.a (mgr.14355) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:51 smithi131 bash[24745]: audit 2024-09-13T23:54:49.381039+0000 mgr.a (mgr.14355) 4063 : audit [DBG] from='client.98256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:51 smithi131 bash[24745]: cluster 2024-09-13T23:54:49.722861+0000 mgr.a (mgr.14355) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:51 smithi171 bash[25040]: audit 2024-09-13T23:54:49.381039+0000 mgr.a (mgr.14355) 4063 : audit [DBG] from='client.98256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:51 smithi171 bash[25040]: cluster 2024-09-13T23:54:49.722861+0000 mgr.a (mgr.14355) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:53 smithi007 bash[22722]: cluster 2024-09-13T23:54:51.725123+0000 mgr.a (mgr.14355) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:53 smithi131 bash[24745]: cluster 2024-09-13T23:54:51.725123+0000 mgr.a (mgr.14355) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:53 smithi171 bash[25040]: cluster 2024-09-13T23:54:51.725123+0000 mgr.a (mgr.14355) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:54:54.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:54:54.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:54:54.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:54:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:55 smithi007 bash[22722]: cluster 2024-09-13T23:54:53.725893+0000 mgr.a (mgr.14355) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:55 smithi131 bash[24745]: cluster 2024-09-13T23:54:53.725893+0000 mgr.a (mgr.14355) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:55.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:54:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:54:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:54:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:54:55.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:54:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:55 smithi171 bash[25040]: cluster 2024-09-13T23:54:53.725893+0000 mgr.a (mgr.14355) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:54:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:56 smithi007 bash[22722]: audit 2024-09-13T23:54:55.125516+0000 mgr.a (mgr.14355) 4067 : audit [DBG] from='client.98325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:56 smithi131 bash[24745]: audit 2024-09-13T23:54:55.125516+0000 mgr.a (mgr.14355) 4067 : audit [DBG] from='client.98325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:56 smithi171 bash[25040]: audit 2024-09-13T23:54:55.125516+0000 mgr.a (mgr.14355) 4067 : audit [DBG] from='client.98325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:54:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:57 smithi007 bash[22722]: cluster 2024-09-13T23:54:55.728664+0000 mgr.a (mgr.14355) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:54:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:57 smithi131 bash[24745]: cluster 2024-09-13T23:54:55.728664+0000 mgr.a (mgr.14355) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:54:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:57 smithi171 bash[25040]: cluster 2024-09-13T23:54:55.728664+0000 mgr.a (mgr.14355) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:54:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:54:59 smithi007 bash[22722]: cluster 2024-09-13T23:54:57.729485+0000 mgr.a (mgr.14355) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:54:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:54:59 smithi131 bash[24745]: cluster 2024-09-13T23:54:57.729485+0000 mgr.a (mgr.14355) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:54:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:54:59 smithi171 bash[25040]: cluster 2024-09-13T23:54:57.729485+0000 mgr.a (mgr.14355) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:55:00.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:00.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:01.316 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:01.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:01.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:01 smithi007 bash[22722]: cluster 2024-09-13T23:54:59.730259+0000 mgr.a (mgr.14355) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:55:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:01 smithi131 bash[24745]: cluster 2024-09-13T23:54:59.730259+0000 mgr.a (mgr.14355) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:55:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:01 smithi171 bash[25040]: cluster 2024-09-13T23:54:59.730259+0000 mgr.a (mgr.14355) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:55:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:02 smithi007 bash[22722]: audit 2024-09-13T23:55:00.873677+0000 mgr.a (mgr.14355) 4071 : audit [DBG] from='client.98403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:02 smithi131 bash[24745]: audit 2024-09-13T23:55:00.873677+0000 mgr.a (mgr.14355) 4071 : audit [DBG] from='client.98403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:02 smithi171 bash[25040]: audit 2024-09-13T23:55:00.873677+0000 mgr.a (mgr.14355) 4071 : audit [DBG] from='client.98403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:03 smithi007 bash[22722]: cluster 2024-09-13T23:55:01.733035+0000 mgr.a (mgr.14355) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:03 smithi131 bash[24745]: cluster 2024-09-13T23:55:01.733035+0000 mgr.a (mgr.14355) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:03 smithi171 bash[25040]: cluster 2024-09-13T23:55:01.733035+0000 mgr.a (mgr.14355) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:05 smithi007 bash[22722]: cluster 2024-09-13T23:55:03.733838+0000 mgr.a (mgr.14355) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:05 smithi131 bash[24745]: cluster 2024-09-13T23:55:03.733838+0000 mgr.a (mgr.14355) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:05 smithi171 bash[25040]: cluster 2024-09-13T23:55:03.733838+0000 mgr.a (mgr.14355) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:07.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:07 smithi007 bash[22722]: cluster 2024-09-13T23:55:05.735786+0000 mgr.a (mgr.14355) 4074 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:07 smithi131 bash[24745]: cluster 2024-09-13T23:55:05.735786+0000 mgr.a (mgr.14355) 4074 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:07 smithi171 bash[25040]: cluster 2024-09-13T23:55:05.735786+0000 mgr.a (mgr.14355) 4074 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:08 smithi131 bash[24745]: audit 2024-09-13T23:55:06.653643+0000 mgr.a (mgr.14355) 4075 : audit [DBG] from='client.98478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:08 smithi171 bash[25040]: audit 2024-09-13T23:55:06.653643+0000 mgr.a (mgr.14355) 4075 : audit [DBG] from='client.98478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:08 smithi007 bash[22722]: audit 2024-09-13T23:55:06.653643+0000 mgr.a (mgr.14355) 4075 : audit [DBG] from='client.98478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:09 smithi131 bash[24745]: cluster 2024-09-13T23:55:07.736738+0000 mgr.a (mgr.14355) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:09 smithi171 bash[25040]: cluster 2024-09-13T23:55:07.736738+0000 mgr.a (mgr.14355) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:09 smithi007 bash[22722]: cluster 2024-09-13T23:55:07.736738+0000 mgr.a (mgr.14355) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:11 smithi131 bash[24745]: cluster 2024-09-13T23:55:09.737536+0000 mgr.a (mgr.14355) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:11 smithi171 bash[25040]: cluster 2024-09-13T23:55:09.737536+0000 mgr.a (mgr.14355) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:11 smithi007 bash[22722]: cluster 2024-09-13T23:55:09.737536+0000 mgr.a (mgr.14355) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-13T23:55:12.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:12.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:12.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:13 smithi131 bash[24745]: cluster 2024-09-13T23:55:11.739797+0000 mgr.a (mgr.14355) 4078 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:55:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:13 smithi171 bash[25040]: cluster 2024-09-13T23:55:11.739797+0000 mgr.a (mgr.14355) 4078 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:55:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:13 smithi007 bash[22722]: cluster 2024-09-13T23:55:11.739797+0000 mgr.a (mgr.14355) 4078 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-13T23:55:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:14 smithi131 bash[24745]: audit 2024-09-13T23:55:12.404444+0000 mgr.a (mgr.14355) 4079 : audit [DBG] from='client.98550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:14 smithi171 bash[25040]: audit 2024-09-13T23:55:12.404444+0000 mgr.a (mgr.14355) 4079 : audit [DBG] from='client.98550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:14 smithi007 bash[22722]: audit 2024-09-13T23:55:12.404444+0000 mgr.a (mgr.14355) 4079 : audit [DBG] from='client.98550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:15 smithi131 bash[24745]: cluster 2024-09-13T23:55:13.740813+0000 mgr.a (mgr.14355) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:15 smithi171 bash[25040]: cluster 2024-09-13T23:55:13.740813+0000 mgr.a (mgr.14355) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:15 smithi007 bash[22722]: cluster 2024-09-13T23:55:13.740813+0000 mgr.a (mgr.14355) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:17 smithi131 bash[24745]: cluster 2024-09-13T23:55:15.743044+0000 mgr.a (mgr.14355) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:17 smithi171 bash[25040]: cluster 2024-09-13T23:55:15.743044+0000 mgr.a (mgr.14355) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:17 smithi007 bash[22722]: cluster 2024-09-13T23:55:15.743044+0000 mgr.a (mgr.14355) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:18.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:19.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:19 smithi131 bash[24745]: cluster 2024-09-13T23:55:17.743806+0000 mgr.a (mgr.14355) 4082 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:19 smithi131 bash[24745]: audit 2024-09-13T23:55:18.178069+0000 mgr.a (mgr.14355) 4083 : audit [DBG] from='client.98625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:19 smithi131 bash[24745]: audit 2024-09-13T23:55:18.922375+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:55:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:19 smithi171 bash[25040]: cluster 2024-09-13T23:55:17.743806+0000 mgr.a (mgr.14355) 4082 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:19 smithi171 bash[25040]: audit 2024-09-13T23:55:18.178069+0000 mgr.a (mgr.14355) 4083 : audit [DBG] from='client.98625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:19 smithi171 bash[25040]: audit 2024-09-13T23:55:18.922375+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:55:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:19 smithi007 bash[22722]: cluster 2024-09-13T23:55:17.743806+0000 mgr.a (mgr.14355) 4082 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:19 smithi007 bash[22722]: audit 2024-09-13T23:55:18.178069+0000 mgr.a (mgr.14355) 4083 : audit [DBG] from='client.98625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:19 smithi007 bash[22722]: audit 2024-09-13T23:55:18.922375+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:55:20.512 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22722]: audit 2024-09-13T23:55:19.760117+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:55:20.512 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22722]: audit 2024-09-13T23:55:19.761351+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:55:20.512 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22722]: audit 2024-09-13T23:55:19.769580+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:55:20.512 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22722]: audit 2024-09-13T23:55:19.771834+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:20 smithi131 bash[24745]: audit 2024-09-13T23:55:19.760117+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:55:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:20 smithi131 bash[24745]: audit 2024-09-13T23:55:19.761351+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:55:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:20 smithi131 bash[24745]: audit 2024-09-13T23:55:19.769580+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:55:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:20 smithi131 bash[24745]: audit 2024-09-13T23:55:19.771834+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:20 smithi171 bash[25040]: audit 2024-09-13T23:55:19.760117+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:55:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:20 smithi171 bash[25040]: audit 2024-09-13T23:55:19.761351+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:55:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:20 smithi171 bash[25040]: audit 2024-09-13T23:55:19.769580+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:55:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:20 smithi171 bash[25040]: audit 2024-09-13T23:55:19.771834+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22972]: debug 2024-09-13T23:55:20.510+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:55:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:55:20 smithi007 bash[22972]: debug 2024-09-13T23:55:20.510+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:55:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:21 smithi131 bash[24745]: cluster 2024-09-13T23:55:19.744689+0000 mgr.a (mgr.14355) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:21 smithi131 bash[24745]: audit 2024-09-13T23:55:19.774371+0000 mgr.a (mgr.14355) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:21 smithi171 bash[25040]: cluster 2024-09-13T23:55:19.744689+0000 mgr.a (mgr.14355) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:21 smithi171 bash[25040]: audit 2024-09-13T23:55:19.774371+0000 mgr.a (mgr.14355) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:21 smithi007 bash[22722]: cluster 2024-09-13T23:55:19.744689+0000 mgr.a (mgr.14355) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:21 smithi007 bash[22722]: audit 2024-09-13T23:55:19.774371+0000 mgr.a (mgr.14355) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:55:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:22 smithi131 bash[24745]: audit 2024-09-13T23:55:20.511990+0000 mgr.a (mgr.14355) 4086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:55:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:22 smithi131 bash[24745]: cephadm 2024-09-13T23:55:20.513603+0000 mgr.a (mgr.14355) 4087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:55:22.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:22 smithi171 bash[25040]: audit 2024-09-13T23:55:20.511990+0000 mgr.a (mgr.14355) 4086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:55:22.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:22 smithi171 bash[25040]: cephadm 2024-09-13T23:55:20.513603+0000 mgr.a (mgr.14355) 4087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:55:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:22 smithi007 bash[22722]: audit 2024-09-13T23:55:20.511990+0000 mgr.a (mgr.14355) 4086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:55:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:22 smithi007 bash[22722]: cephadm 2024-09-13T23:55:20.513603+0000 mgr.a (mgr.14355) 4087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:55:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:23 smithi131 bash[24745]: cluster 2024-09-13T23:55:21.747223+0000 mgr.a (mgr.14355) 4088 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:23 smithi171 bash[25040]: cluster 2024-09-13T23:55:21.747223+0000 mgr.a (mgr.14355) 4088 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:23 smithi007 bash[22722]: cluster 2024-09-13T23:55:21.747223+0000 mgr.a (mgr.14355) 4088 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:24.351 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:25 smithi131 bash[24745]: cluster 2024-09-13T23:55:23.747666+0000 mgr.a (mgr.14355) 4089 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:25 smithi131 bash[24745]: audit 2024-09-13T23:55:23.939499+0000 mgr.a (mgr.14355) 4090 : audit [DBG] from='client.98808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:25 smithi171 bash[25040]: cluster 2024-09-13T23:55:23.747666+0000 mgr.a (mgr.14355) 4089 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:25 smithi171 bash[25040]: audit 2024-09-13T23:55:23.939499+0000 mgr.a (mgr.14355) 4090 : audit [DBG] from='client.98808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:25 smithi007 bash[22722]: cluster 2024-09-13T23:55:23.747666+0000 mgr.a (mgr.14355) 4089 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:55:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:25 smithi007 bash[22722]: audit 2024-09-13T23:55:23.939499+0000 mgr.a (mgr.14355) 4090 : audit [DBG] from='client.98808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:27 smithi131 bash[24745]: cluster 2024-09-13T23:55:25.749917+0000 mgr.a (mgr.14355) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:27 smithi171 bash[25040]: cluster 2024-09-13T23:55:25.749917+0000 mgr.a (mgr.14355) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:27 smithi007 bash[22722]: cluster 2024-09-13T23:55:25.749917+0000 mgr.a (mgr.14355) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:29.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:29.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:29 smithi131 bash[24745]: cluster 2024-09-13T23:55:27.750730+0000 mgr.a (mgr.14355) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:29 smithi171 bash[25040]: cluster 2024-09-13T23:55:27.750730+0000 mgr.a (mgr.14355) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:29 smithi007 bash[22722]: cluster 2024-09-13T23:55:27.750730+0000 mgr.a (mgr.14355) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:30.087 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:30.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:30.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:31 smithi131 bash[24745]: audit 2024-09-13T23:55:29.681278+0000 mgr.a (mgr.14355) 4093 : audit [DBG] from='client.98886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:31 smithi131 bash[24745]: cluster 2024-09-13T23:55:29.751275+0000 mgr.a (mgr.14355) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:31 smithi171 bash[25040]: audit 2024-09-13T23:55:29.681278+0000 mgr.a (mgr.14355) 4093 : audit [DBG] from='client.98886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:31 smithi171 bash[25040]: cluster 2024-09-13T23:55:29.751275+0000 mgr.a (mgr.14355) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:31 smithi007 bash[22722]: audit 2024-09-13T23:55:29.681278+0000 mgr.a (mgr.14355) 4093 : audit [DBG] from='client.98886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:31 smithi007 bash[22722]: cluster 2024-09-13T23:55:29.751275+0000 mgr.a (mgr.14355) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:33 smithi131 bash[24745]: cluster 2024-09-13T23:55:31.753573+0000 mgr.a (mgr.14355) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:33 smithi171 bash[25040]: cluster 2024-09-13T23:55:31.753573+0000 mgr.a (mgr.14355) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:33 smithi007 bash[22722]: cluster 2024-09-13T23:55:31.753573+0000 mgr.a (mgr.14355) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:55:35.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:35.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:35 smithi131 bash[24745]: cluster 2024-09-13T23:55:33.754339+0000 mgr.a (mgr.14355) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:35 smithi171 bash[25040]: cluster 2024-09-13T23:55:33.754339+0000 mgr.a (mgr.14355) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:35 smithi007 bash[22722]: cluster 2024-09-13T23:55:33.754339+0000 mgr.a (mgr.14355) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:35.864 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:37 smithi171 bash[25040]: audit 2024-09-13T23:55:35.423531+0000 mgr.a (mgr.14355) 4097 : audit [DBG] from='client.98964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:37 smithi171 bash[25040]: cluster 2024-09-13T23:55:35.758707+0000 mgr.a (mgr.14355) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:37 smithi007 bash[22722]: audit 2024-09-13T23:55:35.423531+0000 mgr.a (mgr.14355) 4097 : audit [DBG] from='client.98964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:37 smithi007 bash[22722]: cluster 2024-09-13T23:55:35.758707+0000 mgr.a (mgr.14355) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:37 smithi131 bash[24745]: audit 2024-09-13T23:55:35.423531+0000 mgr.a (mgr.14355) 4097 : audit [DBG] from='client.98964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:37 smithi131 bash[24745]: cluster 2024-09-13T23:55:35.758707+0000 mgr.a (mgr.14355) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:55:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:39 smithi171 bash[25040]: cluster 2024-09-13T23:55:37.759433+0000 mgr.a (mgr.14355) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:39 smithi007 bash[22722]: cluster 2024-09-13T23:55:37.759433+0000 mgr.a (mgr.14355) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:39 smithi131 bash[24745]: cluster 2024-09-13T23:55:37.759433+0000 mgr.a (mgr.14355) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:41 smithi171 bash[25040]: cluster 2024-09-13T23:55:39.760196+0000 mgr.a (mgr.14355) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:41.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:41.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:41 smithi007 bash[22722]: cluster 2024-09-13T23:55:39.760196+0000 mgr.a (mgr.14355) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:41 smithi131 bash[24745]: cluster 2024-09-13T23:55:39.760196+0000 mgr.a (mgr.14355) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:42 smithi007 bash[22722]: audit 2024-09-13T23:55:41.199079+0000 mgr.a (mgr.14355) 4101 : audit [DBG] from='client.99036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:42 smithi131 bash[24745]: audit 2024-09-13T23:55:41.199079+0000 mgr.a (mgr.14355) 4101 : audit [DBG] from='client.99036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:42 smithi171 bash[25040]: audit 2024-09-13T23:55:41.199079+0000 mgr.a (mgr.14355) 4101 : audit [DBG] from='client.99036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:43 smithi007 bash[22722]: cluster 2024-09-13T23:55:41.762970+0000 mgr.a (mgr.14355) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:43 smithi131 bash[24745]: cluster 2024-09-13T23:55:41.762970+0000 mgr.a (mgr.14355) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:43 smithi171 bash[25040]: cluster 2024-09-13T23:55:41.762970+0000 mgr.a (mgr.14355) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:45 smithi007 bash[22722]: cluster 2024-09-13T23:55:43.763751+0000 mgr.a (mgr.14355) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:45 smithi131 bash[24745]: cluster 2024-09-13T23:55:43.763751+0000 mgr.a (mgr.14355) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:45 smithi171 bash[25040]: cluster 2024-09-13T23:55:43.763751+0000 mgr.a (mgr.14355) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:55:46.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:46.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:46.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:47.376 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:47.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:47.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:47.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:47 smithi007 bash[22722]: cluster 2024-09-13T23:55:45.765743+0000 mgr.a (mgr.14355) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:47 smithi131 bash[24745]: cluster 2024-09-13T23:55:45.765743+0000 mgr.a (mgr.14355) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:47 smithi171 bash[25040]: cluster 2024-09-13T23:55:45.765743+0000 mgr.a (mgr.14355) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:48 smithi007 bash[22722]: audit 2024-09-13T23:55:46.940505+0000 mgr.a (mgr.14355) 4105 : audit [DBG] from='client.99114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:48 smithi131 bash[24745]: audit 2024-09-13T23:55:46.940505+0000 mgr.a (mgr.14355) 4105 : audit [DBG] from='client.99114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:48 smithi171 bash[25040]: audit 2024-09-13T23:55:46.940505+0000 mgr.a (mgr.14355) 4105 : audit [DBG] from='client.99114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:49 smithi007 bash[22722]: cluster 2024-09-13T23:55:47.766713+0000 mgr.a (mgr.14355) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:49 smithi131 bash[24745]: cluster 2024-09-13T23:55:47.766713+0000 mgr.a (mgr.14355) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:49 smithi171 bash[25040]: cluster 2024-09-13T23:55:47.766713+0000 mgr.a (mgr.14355) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:51 smithi007 bash[22722]: cluster 2024-09-13T23:55:49.767509+0000 mgr.a (mgr.14355) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:51 smithi131 bash[24745]: cluster 2024-09-13T23:55:49.767509+0000 mgr.a (mgr.14355) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:51 smithi171 bash[25040]: cluster 2024-09-13T23:55:49.767509+0000 mgr.a (mgr.14355) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:52.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:53.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:53.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:53 smithi007 bash[22722]: cluster 2024-09-13T23:55:51.769768+0000 mgr.a (mgr.14355) 4108 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:53 smithi131 bash[24745]: cluster 2024-09-13T23:55:51.769768+0000 mgr.a (mgr.14355) 4108 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:53 smithi171 bash[25040]: cluster 2024-09-13T23:55:51.769768+0000 mgr.a (mgr.14355) 4108 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:54 smithi007 bash[22722]: audit 2024-09-13T23:55:52.708796+0000 mgr.a (mgr.14355) 4109 : audit [DBG] from='client.99192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:54 smithi131 bash[24745]: audit 2024-09-13T23:55:52.708796+0000 mgr.a (mgr.14355) 4109 : audit [DBG] from='client.99192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:54 smithi171 bash[25040]: audit 2024-09-13T23:55:52.708796+0000 mgr.a (mgr.14355) 4109 : audit [DBG] from='client.99192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:55:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:55 smithi007 bash[22722]: cluster 2024-09-13T23:55:53.770746+0000 mgr.a (mgr.14355) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:55 smithi131 bash[24745]: cluster 2024-09-13T23:55:53.770746+0000 mgr.a (mgr.14355) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:55 smithi171 bash[25040]: cluster 2024-09-13T23:55:53.770746+0000 mgr.a (mgr.14355) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:57 smithi007 bash[22722]: cluster 2024-09-13T23:55:55.772971+0000 mgr.a (mgr.14355) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:57 smithi131 bash[24745]: cluster 2024-09-13T23:55:55.772971+0000 mgr.a (mgr.14355) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:57 smithi171 bash[25040]: cluster 2024-09-13T23:55:55.772971+0000 mgr.a (mgr.14355) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:55:58.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:55:58.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:55:58.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:55:58.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:55:58.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:55:58.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:55:58.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:55:58.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:55:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:55:59 smithi007 bash[22722]: cluster 2024-09-13T23:55:57.773772+0000 mgr.a (mgr.14355) 4112 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:55:59 smithi131 bash[24745]: cluster 2024-09-13T23:55:57.773772+0000 mgr.a (mgr.14355) 4112 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:55:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:55:59 smithi171 bash[25040]: cluster 2024-09-13T23:55:57.773772+0000 mgr.a (mgr.14355) 4112 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:00 smithi007 bash[22722]: audit 2024-09-13T23:55:58.453849+0000 mgr.a (mgr.14355) 4113 : audit [DBG] from='client.99270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:00 smithi131 bash[24745]: audit 2024-09-13T23:55:58.453849+0000 mgr.a (mgr.14355) 4113 : audit [DBG] from='client.99270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:00 smithi171 bash[25040]: audit 2024-09-13T23:55:58.453849+0000 mgr.a (mgr.14355) 4113 : audit [DBG] from='client.99270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:01 smithi007 bash[22722]: cluster 2024-09-13T23:55:59.774757+0000 mgr.a (mgr.14355) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:01 smithi131 bash[24745]: cluster 2024-09-13T23:55:59.774757+0000 mgr.a (mgr.14355) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:01 smithi171 bash[25040]: cluster 2024-09-13T23:55:59.774757+0000 mgr.a (mgr.14355) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:02 smithi007 bash[22722]: cluster 2024-09-13T23:56:01.777022+0000 mgr.a (mgr.14355) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:02 smithi131 bash[24745]: cluster 2024-09-13T23:56:01.777022+0000 mgr.a (mgr.14355) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:02 smithi171 bash[25040]: cluster 2024-09-13T23:56:01.777022+0000 mgr.a (mgr.14355) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:03.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:03.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:04.626 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:04.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:04.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:04 smithi007 bash[22722]: cluster 2024-09-13T23:56:03.777783+0000 mgr.a (mgr.14355) 4116 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:04 smithi007 bash[22722]: audit 2024-09-13T23:56:04.217895+0000 mgr.a (mgr.14355) 4117 : audit [DBG] from='client.99345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:04 smithi131 bash[24745]: cluster 2024-09-13T23:56:03.777783+0000 mgr.a (mgr.14355) 4116 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:04 smithi131 bash[24745]: audit 2024-09-13T23:56:04.217895+0000 mgr.a (mgr.14355) 4117 : audit [DBG] from='client.99345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:04 smithi171 bash[25040]: cluster 2024-09-13T23:56:03.777783+0000 mgr.a (mgr.14355) 4116 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:04 smithi171 bash[25040]: audit 2024-09-13T23:56:04.217895+0000 mgr.a (mgr.14355) 4117 : audit [DBG] from='client.99345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:06 smithi007 bash[22722]: cluster 2024-09-13T23:56:05.780064+0000 mgr.a (mgr.14355) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:06 smithi131 bash[24745]: cluster 2024-09-13T23:56:05.780064+0000 mgr.a (mgr.14355) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:06 smithi171 bash[25040]: cluster 2024-09-13T23:56:05.780064+0000 mgr.a (mgr.14355) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:08 smithi007 bash[22722]: cluster 2024-09-13T23:56:07.780835+0000 mgr.a (mgr.14355) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:08 smithi131 bash[24745]: cluster 2024-09-13T23:56:07.780835+0000 mgr.a (mgr.14355) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:08 smithi171 bash[25040]: cluster 2024-09-13T23:56:07.780835+0000 mgr.a (mgr.14355) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:09.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:10.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:10.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:10 smithi007 bash[22722]: cluster 2024-09-13T23:56:09.781428+0000 mgr.a (mgr.14355) 4120 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:10 smithi007 bash[22722]: audit 2024-09-13T23:56:09.965964+0000 mgr.a (mgr.14355) 4121 : audit [DBG] from='client.99423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:10 smithi131 bash[24745]: cluster 2024-09-13T23:56:09.781428+0000 mgr.a (mgr.14355) 4120 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:10 smithi131 bash[24745]: audit 2024-09-13T23:56:09.965964+0000 mgr.a (mgr.14355) 4121 : audit [DBG] from='client.99423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:10 smithi171 bash[25040]: cluster 2024-09-13T23:56:09.781428+0000 mgr.a (mgr.14355) 4120 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:10 smithi171 bash[25040]: audit 2024-09-13T23:56:09.965964+0000 mgr.a (mgr.14355) 4121 : audit [DBG] from='client.99423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:12 smithi007 bash[22722]: cluster 2024-09-13T23:56:11.783908+0000 mgr.a (mgr.14355) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:56:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:12 smithi131 bash[24745]: cluster 2024-09-13T23:56:11.783908+0000 mgr.a (mgr.14355) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:56:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:12 smithi171 bash[25040]: cluster 2024-09-13T23:56:11.783908+0000 mgr.a (mgr.14355) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-13T23:56:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:14 smithi007 bash[22722]: cluster 2024-09-13T23:56:13.784702+0000 mgr.a (mgr.14355) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:56:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:14 smithi131 bash[24745]: cluster 2024-09-13T23:56:13.784702+0000 mgr.a (mgr.14355) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:56:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:14 smithi171 bash[25040]: cluster 2024-09-13T23:56:13.784702+0000 mgr.a (mgr.14355) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-13T23:56:15.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:15.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:15.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:16.197 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:16.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:16.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:16 smithi007 bash[22722]: audit 2024-09-13T23:56:15.747304+0000 mgr.a (mgr.14355) 4124 : audit [DBG] from='client.99495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:16 smithi007 bash[22722]: cluster 2024-09-13T23:56:15.786592+0000 mgr.a (mgr.14355) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:16 smithi131 bash[24745]: audit 2024-09-13T23:56:15.747304+0000 mgr.a (mgr.14355) 4124 : audit [DBG] from='client.99495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:16 smithi131 bash[24745]: cluster 2024-09-13T23:56:15.786592+0000 mgr.a (mgr.14355) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:16 smithi171 bash[25040]: audit 2024-09-13T23:56:15.747304+0000 mgr.a (mgr.14355) 4124 : audit [DBG] from='client.99495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:16 smithi171 bash[25040]: cluster 2024-09-13T23:56:15.786592+0000 mgr.a (mgr.14355) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:18 smithi007 bash[22722]: cluster 2024-09-13T23:56:17.787479+0000 mgr.a (mgr.14355) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:18 smithi131 bash[24745]: cluster 2024-09-13T23:56:17.787479+0000 mgr.a (mgr.14355) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:18 smithi171 bash[25040]: cluster 2024-09-13T23:56:17.787479+0000 mgr.a (mgr.14355) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:21.199 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:21.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:20 smithi007 bash[22722]: cluster 2024-09-13T23:56:19.788252+0000 mgr.a (mgr.14355) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:56:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:20 smithi007 bash[22722]: audit 2024-09-13T23:56:20.567438+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:56:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:20 smithi131 bash[24745]: cluster 2024-09-13T23:56:19.788252+0000 mgr.a (mgr.14355) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:56:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:20 smithi131 bash[24745]: audit 2024-09-13T23:56:20.567438+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:56:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:20 smithi171 bash[25040]: cluster 2024-09-13T23:56:19.788252+0000 mgr.a (mgr.14355) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:56:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:20 smithi171 bash[25040]: audit 2024-09-13T23:56:20.567438+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:56:21.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:21.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:21.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:22 smithi007 bash[22722]: audit 2024-09-13T23:56:21.520731+0000 mgr.a (mgr.14355) 4128 : audit [DBG] from='client.99573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:22 smithi007 bash[22722]: cluster 2024-09-13T23:56:21.789615+0000 mgr.a (mgr.14355) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:22 smithi131 bash[24745]: audit 2024-09-13T23:56:21.520731+0000 mgr.a (mgr.14355) 4128 : audit [DBG] from='client.99573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:22 smithi131 bash[24745]: cluster 2024-09-13T23:56:21.789615+0000 mgr.a (mgr.14355) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:22 smithi171 bash[25040]: audit 2024-09-13T23:56:21.520731+0000 mgr.a (mgr.14355) 4128 : audit [DBG] from='client.99573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:22 smithi171 bash[25040]: cluster 2024-09-13T23:56:21.789615+0000 mgr.a (mgr.14355) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:24 smithi007 bash[22722]: cluster 2024-09-13T23:56:23.790545+0000 mgr.a (mgr.14355) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:56:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:24 smithi131 bash[24745]: cluster 2024-09-13T23:56:23.790545+0000 mgr.a (mgr.14355) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:56:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:24 smithi171 bash[25040]: cluster 2024-09-13T23:56:23.790545+0000 mgr.a (mgr.14355) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-13T23:56:26.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:26.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:26.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: cluster 2024-09-13T23:56:25.792061+0000 mgr.a (mgr.14355) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.921646+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.927912+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.942668+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.947733+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.960465+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:25.965195+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:26.666080+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:56:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:26.667754+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:56:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:26.678112+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:26 smithi007 bash[22722]: audit 2024-09-13T23:56:26.682887+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: cluster 2024-09-13T23:56:25.792061+0000 mgr.a (mgr.14355) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:56:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.921646+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.927912+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.942668+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.947733+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.960465+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:25.965195+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:26.666080+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:26.667754+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:26.678112+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:26 smithi131 bash[24745]: audit 2024-09-13T23:56:26.682887+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: cluster 2024-09-13T23:56:25.792061+0000 mgr.a (mgr.14355) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T23:56:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.921646+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.927912+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.942668+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.947733+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.960465+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:25.965195+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:26.666080+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:26.667754+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:26.678112+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:56:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:26 smithi171 bash[25040]: audit 2024-09-13T23:56:26.682887+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:27.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:56:27 smithi007 bash[22972]: debug 2024-09-13T23:56:27.421+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:56:27.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:56:27 smithi007 bash[22972]: debug 2024-09-13T23:56:27.433+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:56:27.827 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:27.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:27.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:27.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:27.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:27 smithi007 bash[22722]: audit 2024-09-13T23:56:26.685129+0000 mgr.a (mgr.14355) 4132 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:27 smithi007 bash[22722]: audit 2024-09-13T23:56:27.251902+0000 mgr.a (mgr.14355) 4133 : audit [DBG] from='client.99702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:27 smithi131 bash[24745]: audit 2024-09-13T23:56:26.685129+0000 mgr.a (mgr.14355) 4132 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:27 smithi131 bash[24745]: audit 2024-09-13T23:56:27.251902+0000 mgr.a (mgr.14355) 4133 : audit [DBG] from='client.99702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:27 smithi171 bash[25040]: audit 2024-09-13T23:56:26.685129+0000 mgr.a (mgr.14355) 4132 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:56:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:27 smithi171 bash[25040]: audit 2024-09-13T23:56:27.251902+0000 mgr.a (mgr.14355) 4133 : audit [DBG] from='client.99702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:28 smithi007 bash[22722]: audit 2024-09-13T23:56:27.426196+0000 mgr.a (mgr.14355) 4134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:56:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:28 smithi007 bash[22722]: cephadm 2024-09-13T23:56:27.438042+0000 mgr.a (mgr.14355) 4135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:56:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:28 smithi007 bash[22722]: cluster 2024-09-13T23:56:27.792618+0000 mgr.a (mgr.14355) 4136 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:28 smithi131 bash[24745]: audit 2024-09-13T23:56:27.426196+0000 mgr.a (mgr.14355) 4134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:56:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:28 smithi131 bash[24745]: cephadm 2024-09-13T23:56:27.438042+0000 mgr.a (mgr.14355) 4135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:56:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:28 smithi131 bash[24745]: cluster 2024-09-13T23:56:27.792618+0000 mgr.a (mgr.14355) 4136 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:28 smithi171 bash[25040]: audit 2024-09-13T23:56:27.426196+0000 mgr.a (mgr.14355) 4134 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:56:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:28 smithi171 bash[25040]: cephadm 2024-09-13T23:56:27.438042+0000 mgr.a (mgr.14355) 4135 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:56:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:28 smithi171 bash[25040]: cluster 2024-09-13T23:56:27.792618+0000 mgr.a (mgr.14355) 4136 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:30 smithi007 bash[22722]: cluster 2024-09-13T23:56:29.793348+0000 mgr.a (mgr.14355) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:30 smithi131 bash[24745]: cluster 2024-09-13T23:56:29.793348+0000 mgr.a (mgr.14355) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:30 smithi171 bash[25040]: cluster 2024-09-13T23:56:29.793348+0000 mgr.a (mgr.14355) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:32.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:32.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:32.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:33.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:33 smithi131 bash[24745]: cluster 2024-09-13T23:56:31.795629+0000 mgr.a (mgr.14355) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:33 smithi171 bash[25040]: cluster 2024-09-13T23:56:31.795629+0000 mgr.a (mgr.14355) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:33 smithi007 bash[22722]: cluster 2024-09-13T23:56:31.795629+0000 mgr.a (mgr.14355) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:33.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:33.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:33.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:33.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:33.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:34 smithi131 bash[24745]: audit 2024-09-13T23:56:33.167676+0000 mgr.a (mgr.14355) 4139 : audit [DBG] from='client.99834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:34 smithi171 bash[25040]: audit 2024-09-13T23:56:33.167676+0000 mgr.a (mgr.14355) 4139 : audit [DBG] from='client.99834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:34 smithi007 bash[22722]: audit 2024-09-13T23:56:33.167676+0000 mgr.a (mgr.14355) 4139 : audit [DBG] from='client.99834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:35 smithi131 bash[24745]: cluster 2024-09-13T23:56:33.796577+0000 mgr.a (mgr.14355) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:35 smithi171 bash[25040]: cluster 2024-09-13T23:56:33.796577+0000 mgr.a (mgr.14355) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:35 smithi007 bash[22722]: cluster 2024-09-13T23:56:33.796577+0000 mgr.a (mgr.14355) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:37 smithi131 bash[24745]: cluster 2024-09-13T23:56:35.798755+0000 mgr.a (mgr.14355) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:37 smithi171 bash[25040]: cluster 2024-09-13T23:56:35.798755+0000 mgr.a (mgr.14355) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:37 smithi007 bash[22722]: cluster 2024-09-13T23:56:35.798755+0000 mgr.a (mgr.14355) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:38.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:38.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:38.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:39 smithi131 bash[24745]: cluster 2024-09-13T23:56:37.799482+0000 mgr.a (mgr.14355) 4142 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:39 smithi171 bash[25040]: cluster 2024-09-13T23:56:37.799482+0000 mgr.a (mgr.14355) 4142 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:39.345 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:39.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:39 smithi007 bash[22722]: cluster 2024-09-13T23:56:37.799482+0000 mgr.a (mgr.14355) 4142 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:40 smithi171 bash[25040]: audit 2024-09-13T23:56:38.923573+0000 mgr.a (mgr.14355) 4143 : audit [DBG] from='client.99909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:40 smithi007 bash[22722]: audit 2024-09-13T23:56:38.923573+0000 mgr.a (mgr.14355) 4143 : audit [DBG] from='client.99909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:40 smithi131 bash[24745]: audit 2024-09-13T23:56:38.923573+0000 mgr.a (mgr.14355) 4143 : audit [DBG] from='client.99909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:41 smithi171 bash[25040]: cluster 2024-09-13T23:56:39.800392+0000 mgr.a (mgr.14355) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:41 smithi007 bash[22722]: cluster 2024-09-13T23:56:39.800392+0000 mgr.a (mgr.14355) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:41 smithi131 bash[24745]: cluster 2024-09-13T23:56:39.800392+0000 mgr.a (mgr.14355) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:43 smithi171 bash[25040]: cluster 2024-09-13T23:56:41.802682+0000 mgr.a (mgr.14355) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:43 smithi007 bash[22722]: cluster 2024-09-13T23:56:41.802682+0000 mgr.a (mgr.14355) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:43 smithi131 bash[24745]: cluster 2024-09-13T23:56:41.802682+0000 mgr.a (mgr.14355) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:56:44.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:44.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:44.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:45.121 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:45 smithi007 bash[22722]: cluster 2024-09-13T23:56:43.803460+0000 mgr.a (mgr.14355) 4146 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:45 smithi131 bash[24745]: cluster 2024-09-13T23:56:43.803460+0000 mgr.a (mgr.14355) 4146 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:45 smithi171 bash[25040]: cluster 2024-09-13T23:56:43.803460+0000 mgr.a (mgr.14355) 4146 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:46 smithi007 bash[22722]: audit 2024-09-13T23:56:44.682624+0000 mgr.a (mgr.14355) 4147 : audit [DBG] from='client.99987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:46 smithi131 bash[24745]: audit 2024-09-13T23:56:44.682624+0000 mgr.a (mgr.14355) 4147 : audit [DBG] from='client.99987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:46 smithi171 bash[25040]: audit 2024-09-13T23:56:44.682624+0000 mgr.a (mgr.14355) 4147 : audit [DBG] from='client.99987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:47 smithi007 bash[22722]: cluster 2024-09-13T23:56:45.805746+0000 mgr.a (mgr.14355) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:47 smithi131 bash[24745]: cluster 2024-09-13T23:56:45.805746+0000 mgr.a (mgr.14355) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:47 smithi171 bash[25040]: cluster 2024-09-13T23:56:45.805746+0000 mgr.a (mgr.14355) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:56:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:49 smithi007 bash[22722]: cluster 2024-09-13T23:56:47.806529+0000 mgr.a (mgr.14355) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:49 smithi131 bash[24745]: cluster 2024-09-13T23:56:47.806529+0000 mgr.a (mgr.14355) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:49 smithi171 bash[25040]: cluster 2024-09-13T23:56:47.806529+0000 mgr.a (mgr.14355) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:50.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:51 smithi007 bash[22722]: cluster 2024-09-13T23:56:49.807279+0000 mgr.a (mgr.14355) 4150 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:51 smithi131 bash[24745]: cluster 2024-09-13T23:56:49.807279+0000 mgr.a (mgr.14355) 4150 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:51 smithi171 bash[25040]: cluster 2024-09-13T23:56:49.807279+0000 mgr.a (mgr.14355) 4150 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:52 smithi007 bash[22722]: audit 2024-09-13T23:56:50.445221+0000 mgr.a (mgr.14355) 4151 : audit [DBG] from='client.100062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:52 smithi131 bash[24745]: audit 2024-09-13T23:56:50.445221+0000 mgr.a (mgr.14355) 4151 : audit [DBG] from='client.100062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:52 smithi171 bash[25040]: audit 2024-09-13T23:56:50.445221+0000 mgr.a (mgr.14355) 4151 : audit [DBG] from='client.100062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:53 smithi007 bash[22722]: cluster 2024-09-13T23:56:51.810000+0000 mgr.a (mgr.14355) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:53 smithi131 bash[24745]: cluster 2024-09-13T23:56:51.810000+0000 mgr.a (mgr.14355) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:53 smithi171 bash[25040]: cluster 2024-09-13T23:56:51.810000+0000 mgr.a (mgr.14355) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:55 smithi007 bash[22722]: cluster 2024-09-13T23:56:53.810796+0000 mgr.a (mgr.14355) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:55 smithi131 bash[24745]: cluster 2024-09-13T23:56:53.810796+0000 mgr.a (mgr.14355) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:55 smithi171 bash[25040]: cluster 2024-09-13T23:56:53.810796+0000 mgr.a (mgr.14355) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:55.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:56:55.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:56:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:56:56.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:56:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:56:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:56:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:56:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:56:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:57 smithi007 bash[22722]: cluster 2024-09-13T23:56:55.812769+0000 mgr.a (mgr.14355) 4154 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:57 smithi007 bash[22722]: audit 2024-09-13T23:56:56.197221+0000 mgr.a (mgr.14355) 4155 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:57 smithi131 bash[24745]: cluster 2024-09-13T23:56:55.812769+0000 mgr.a (mgr.14355) 4154 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:57 smithi131 bash[24745]: audit 2024-09-13T23:56:56.197221+0000 mgr.a (mgr.14355) 4155 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:57 smithi171 bash[25040]: cluster 2024-09-13T23:56:55.812769+0000 mgr.a (mgr.14355) 4154 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:56:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:57 smithi171 bash[25040]: audit 2024-09-13T23:56:56.197221+0000 mgr.a (mgr.14355) 4155 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:56:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:56:59 smithi007 bash[22722]: cluster 2024-09-13T23:56:57.813644+0000 mgr.a (mgr.14355) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:56:59 smithi131 bash[24745]: cluster 2024-09-13T23:56:57.813644+0000 mgr.a (mgr.14355) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:56:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:56:59 smithi171 bash[25040]: cluster 2024-09-13T23:56:57.813644+0000 mgr.a (mgr.14355) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:57:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:01 smithi007 bash[22722]: cluster 2024-09-13T23:56:59.814469+0000 mgr.a (mgr.14355) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:57:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:01 smithi131 bash[24745]: cluster 2024-09-13T23:56:59.814469+0000 mgr.a (mgr.14355) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:57:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:01 smithi171 bash[25040]: cluster 2024-09-13T23:56:59.814469+0000 mgr.a (mgr.14355) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:02.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:02.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:02.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:02.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:02.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:03 smithi007 bash[22722]: cluster 2024-09-13T23:57:01.817289+0000 mgr.a (mgr.14355) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:03 smithi007 bash[22722]: audit 2024-09-13T23:57:01.970578+0000 mgr.a (mgr.14355) 4159 : audit [DBG] from='client.100218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:03 smithi131 bash[24745]: cluster 2024-09-13T23:57:01.817289+0000 mgr.a (mgr.14355) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:03 smithi131 bash[24745]: audit 2024-09-13T23:57:01.970578+0000 mgr.a (mgr.14355) 4159 : audit [DBG] from='client.100218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:03 smithi171 bash[25040]: cluster 2024-09-13T23:57:01.817289+0000 mgr.a (mgr.14355) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:03 smithi171 bash[25040]: audit 2024-09-13T23:57:01.970578+0000 mgr.a (mgr.14355) 4159 : audit [DBG] from='client.100218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:05 smithi007 bash[22722]: cluster 2024-09-13T23:57:03.818196+0000 mgr.a (mgr.14355) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:05 smithi131 bash[24745]: cluster 2024-09-13T23:57:03.818196+0000 mgr.a (mgr.14355) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:05 smithi171 bash[25040]: cluster 2024-09-13T23:57:03.818196+0000 mgr.a (mgr.14355) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:07.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:07.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:07.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:07 smithi007 bash[22722]: cluster 2024-09-13T23:57:05.820454+0000 mgr.a (mgr.14355) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:07 smithi131 bash[24745]: cluster 2024-09-13T23:57:05.820454+0000 mgr.a (mgr.14355) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:07 smithi171 bash[25040]: cluster 2024-09-13T23:57:05.820454+0000 mgr.a (mgr.14355) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:08.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:09 smithi007 bash[22722]: audit 2024-09-13T23:57:07.739092+0000 mgr.a (mgr.14355) 4162 : audit [DBG] from='client.100296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:09 smithi007 bash[22722]: cluster 2024-09-13T23:57:07.821141+0000 mgr.a (mgr.14355) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:09 smithi131 bash[24745]: audit 2024-09-13T23:57:07.739092+0000 mgr.a (mgr.14355) 4162 : audit [DBG] from='client.100296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:09 smithi131 bash[24745]: cluster 2024-09-13T23:57:07.821141+0000 mgr.a (mgr.14355) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:09 smithi171 bash[25040]: audit 2024-09-13T23:57:07.739092+0000 mgr.a (mgr.14355) 4162 : audit [DBG] from='client.100296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:09 smithi171 bash[25040]: cluster 2024-09-13T23:57:07.821141+0000 mgr.a (mgr.14355) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:11 smithi007 bash[22722]: cluster 2024-09-13T23:57:09.821937+0000 mgr.a (mgr.14355) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:11 smithi131 bash[24745]: cluster 2024-09-13T23:57:09.821937+0000 mgr.a (mgr.14355) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:11 smithi171 bash[25040]: cluster 2024-09-13T23:57:09.821937+0000 mgr.a (mgr.14355) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:13 smithi007 bash[22722]: cluster 2024-09-13T23:57:11.824231+0000 mgr.a (mgr.14355) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:13 smithi131 bash[24745]: cluster 2024-09-13T23:57:11.824231+0000 mgr.a (mgr.14355) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:13 smithi171 bash[25040]: cluster 2024-09-13T23:57:11.824231+0000 mgr.a (mgr.14355) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:13.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:13.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:15 smithi007 bash[22722]: audit 2024-09-13T23:57:13.509632+0000 mgr.a (mgr.14355) 4166 : audit [DBG] from='client.100371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:15 smithi007 bash[22722]: cluster 2024-09-13T23:57:13.825079+0000 mgr.a (mgr.14355) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:15 smithi131 bash[24745]: audit 2024-09-13T23:57:13.509632+0000 mgr.a (mgr.14355) 4166 : audit [DBG] from='client.100371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:15 smithi131 bash[24745]: cluster 2024-09-13T23:57:13.825079+0000 mgr.a (mgr.14355) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:15 smithi171 bash[25040]: audit 2024-09-13T23:57:13.509632+0000 mgr.a (mgr.14355) 4166 : audit [DBG] from='client.100371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:15 smithi171 bash[25040]: cluster 2024-09-13T23:57:13.825079+0000 mgr.a (mgr.14355) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:17 smithi007 bash[22722]: cluster 2024-09-13T23:57:15.827261+0000 mgr.a (mgr.14355) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:17 smithi131 bash[24745]: cluster 2024-09-13T23:57:15.827261+0000 mgr.a (mgr.14355) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:17 smithi171 bash[25040]: cluster 2024-09-13T23:57:15.827261+0000 mgr.a (mgr.14355) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:18.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:19 smithi007 bash[22722]: cluster 2024-09-13T23:57:17.828026+0000 mgr.a (mgr.14355) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:19 smithi131 bash[24745]: cluster 2024-09-13T23:57:17.828026+0000 mgr.a (mgr.14355) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:19 smithi171 bash[25040]: cluster 2024-09-13T23:57:17.828026+0000 mgr.a (mgr.14355) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:19.700 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:20 smithi007 bash[22722]: audit 2024-09-13T23:57:19.258861+0000 mgr.a (mgr.14355) 4170 : audit [DBG] from='client.100443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:20 smithi131 bash[24745]: audit 2024-09-13T23:57:19.258861+0000 mgr.a (mgr.14355) 4170 : audit [DBG] from='client.100443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:20 smithi171 bash[25040]: audit 2024-09-13T23:57:19.258861+0000 mgr.a (mgr.14355) 4170 : audit [DBG] from='client.100443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:21 smithi007 bash[22722]: cluster 2024-09-13T23:57:19.828992+0000 mgr.a (mgr.14355) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:21 smithi131 bash[24745]: cluster 2024-09-13T23:57:19.828992+0000 mgr.a (mgr.14355) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:21 smithi171 bash[25040]: cluster 2024-09-13T23:57:19.828992+0000 mgr.a (mgr.14355) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:23 smithi007 bash[22722]: cluster 2024-09-13T23:57:21.831282+0000 mgr.a (mgr.14355) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:23 smithi131 bash[24745]: cluster 2024-09-13T23:57:21.831282+0000 mgr.a (mgr.14355) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:23 smithi171 bash[25040]: cluster 2024-09-13T23:57:21.831282+0000 mgr.a (mgr.14355) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:24.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:24.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:25 smithi007 bash[22722]: cluster 2024-09-13T23:57:23.832026+0000 mgr.a (mgr.14355) 4173 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:25 smithi131 bash[24745]: cluster 2024-09-13T23:57:23.832026+0000 mgr.a (mgr.14355) 4173 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:25 smithi171 bash[25040]: cluster 2024-09-13T23:57:23.832026+0000 mgr.a (mgr.14355) 4173 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:26 smithi007 bash[22722]: audit 2024-09-13T23:57:25.044783+0000 mgr.a (mgr.14355) 4174 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:26 smithi131 bash[24745]: audit 2024-09-13T23:57:25.044783+0000 mgr.a (mgr.14355) 4174 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:26 smithi171 bash[25040]: audit 2024-09-13T23:57:25.044783+0000 mgr.a (mgr.14355) 4174 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:27 smithi007 bash[22722]: cluster 2024-09-13T23:57:25.834428+0000 mgr.a (mgr.14355) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:57:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:27 smithi131 bash[24745]: cluster 2024-09-13T23:57:25.834428+0000 mgr.a (mgr.14355) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:57:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:27 smithi171 bash[25040]: cluster 2024-09-13T23:57:25.834428+0000 mgr.a (mgr.14355) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-13T23:57:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:28 smithi007 bash[22722]: audit 2024-09-13T23:57:27.490643+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:57:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:28 smithi131 bash[24745]: audit 2024-09-13T23:57:27.490643+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:57:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:28 smithi171 bash[25040]: audit 2024-09-13T23:57:27.490643+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:57:29.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22972]: debug 2024-09-13T23:57:29.072+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:57:29.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22972]: debug 2024-09-13T23:57:29.072+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: cluster 2024-09-13T23:57:27.834975+0000 mgr.a (mgr.14355) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: audit 2024-09-13T23:57:28.342736+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: audit 2024-09-13T23:57:28.344476+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: audit 2024-09-13T23:57:28.355245+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: audit 2024-09-13T23:57:28.360106+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:29 smithi007 bash[22722]: audit 2024-09-13T23:57:28.361519+0000 mgr.a (mgr.14355) 4177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: cluster 2024-09-13T23:57:27.834975+0000 mgr.a (mgr.14355) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: audit 2024-09-13T23:57:28.342736+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: audit 2024-09-13T23:57:28.344476+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: audit 2024-09-13T23:57:28.355245+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: audit 2024-09-13T23:57:28.360106+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:29 smithi131 bash[24745]: audit 2024-09-13T23:57:28.361519+0000 mgr.a (mgr.14355) 4177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: cluster 2024-09-13T23:57:27.834975+0000 mgr.a (mgr.14355) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: audit 2024-09-13T23:57:28.342736+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:57:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: audit 2024-09-13T23:57:28.344476+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:57:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: audit 2024-09-13T23:57:28.355245+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:57:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: audit 2024-09-13T23:57:28.360106+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:29 smithi171 bash[25040]: audit 2024-09-13T23:57:28.361519+0000 mgr.a (mgr.14355) 4177 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:57:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:30 smithi007 bash[22722]: audit 2024-09-13T23:57:29.076871+0000 mgr.a (mgr.14355) 4178 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:57:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:30 smithi007 bash[22722]: cephadm 2024-09-13T23:57:29.078212+0000 mgr.a (mgr.14355) 4179 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:57:30.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:30.474 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:30 smithi131 bash[24745]: audit 2024-09-13T23:57:29.076871+0000 mgr.a (mgr.14355) 4178 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:57:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:30 smithi131 bash[24745]: cephadm 2024-09-13T23:57:29.078212+0000 mgr.a (mgr.14355) 4179 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:57:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:30 smithi171 bash[25040]: audit 2024-09-13T23:57:29.076871+0000 mgr.a (mgr.14355) 4178 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:57:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:30 smithi171 bash[25040]: cephadm 2024-09-13T23:57:29.078212+0000 mgr.a (mgr.14355) 4179 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:57:31.235 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:31.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:31 smithi007 bash[22722]: cluster 2024-09-13T23:57:29.835800+0000 mgr.a (mgr.14355) 4180 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:31 smithi131 bash[24745]: cluster 2024-09-13T23:57:29.835800+0000 mgr.a (mgr.14355) 4180 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:31 smithi171 bash[25040]: cluster 2024-09-13T23:57:29.835800+0000 mgr.a (mgr.14355) 4180 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-13T23:57:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:32 smithi007 bash[22722]: audit 2024-09-13T23:57:30.804613+0000 mgr.a (mgr.14355) 4181 : audit [DBG] from='client.100701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:32 smithi131 bash[24745]: audit 2024-09-13T23:57:30.804613+0000 mgr.a (mgr.14355) 4181 : audit [DBG] from='client.100701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:32 smithi171 bash[25040]: audit 2024-09-13T23:57:30.804613+0000 mgr.a (mgr.14355) 4181 : audit [DBG] from='client.100701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:33 smithi007 bash[22722]: cluster 2024-09-13T23:57:31.838593+0000 mgr.a (mgr.14355) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:33 smithi131 bash[24745]: cluster 2024-09-13T23:57:31.838593+0000 mgr.a (mgr.14355) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:33 smithi171 bash[25040]: cluster 2024-09-13T23:57:31.838593+0000 mgr.a (mgr.14355) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:35 smithi007 bash[22722]: cluster 2024-09-13T23:57:33.839357+0000 mgr.a (mgr.14355) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:35 smithi131 bash[24745]: cluster 2024-09-13T23:57:33.839357+0000 mgr.a (mgr.14355) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:35 smithi171 bash[25040]: cluster 2024-09-13T23:57:33.839357+0000 mgr.a (mgr.14355) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:36.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:36.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:37 smithi007 bash[22722]: cluster 2024-09-13T23:57:35.841289+0000 mgr.a (mgr.14355) 4184 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:37 smithi131 bash[24745]: cluster 2024-09-13T23:57:35.841289+0000 mgr.a (mgr.14355) 4184 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:37 smithi171 bash[25040]: cluster 2024-09-13T23:57:35.841289+0000 mgr.a (mgr.14355) 4184 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:38 smithi131 bash[24745]: audit 2024-09-13T23:57:36.569630+0000 mgr.a (mgr.14355) 4185 : audit [DBG] from='client.100779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:38 smithi171 bash[25040]: audit 2024-09-13T23:57:36.569630+0000 mgr.a (mgr.14355) 4185 : audit [DBG] from='client.100779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:38 smithi007 bash[22722]: audit 2024-09-13T23:57:36.569630+0000 mgr.a (mgr.14355) 4185 : audit [DBG] from='client.100779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:39 smithi131 bash[24745]: cluster 2024-09-13T23:57:37.842130+0000 mgr.a (mgr.14355) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:39 smithi171 bash[25040]: cluster 2024-09-13T23:57:37.842130+0000 mgr.a (mgr.14355) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:39 smithi007 bash[22722]: cluster 2024-09-13T23:57:37.842130+0000 mgr.a (mgr.14355) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:41 smithi131 bash[24745]: cluster 2024-09-13T23:57:39.842904+0000 mgr.a (mgr.14355) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:41 smithi171 bash[25040]: cluster 2024-09-13T23:57:39.842904+0000 mgr.a (mgr.14355) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:41 smithi007 bash[22722]: cluster 2024-09-13T23:57:39.842904+0000 mgr.a (mgr.14355) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:57:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:41.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:41.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:42.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:43 smithi131 bash[24745]: cluster 2024-09-13T23:57:41.845117+0000 mgr.a (mgr.14355) 4188 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:43 smithi131 bash[24745]: audit 2024-09-13T23:57:42.325158+0000 mgr.a (mgr.14355) 4189 : audit [DBG] from='client.100857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:43 smithi171 bash[25040]: cluster 2024-09-13T23:57:41.845117+0000 mgr.a (mgr.14355) 4188 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:43 smithi171 bash[25040]: audit 2024-09-13T23:57:42.325158+0000 mgr.a (mgr.14355) 4189 : audit [DBG] from='client.100857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:43 smithi007 bash[22722]: cluster 2024-09-13T23:57:41.845117+0000 mgr.a (mgr.14355) 4188 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:57:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:43 smithi007 bash[22722]: audit 2024-09-13T23:57:42.325158+0000 mgr.a (mgr.14355) 4189 : audit [DBG] from='client.100857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:45 smithi131 bash[24745]: cluster 2024-09-13T23:57:43.845996+0000 mgr.a (mgr.14355) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:45 smithi171 bash[25040]: cluster 2024-09-13T23:57:43.845996+0000 mgr.a (mgr.14355) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:45 smithi007 bash[22722]: cluster 2024-09-13T23:57:43.845996+0000 mgr.a (mgr.14355) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:47 smithi131 bash[24745]: cluster 2024-09-13T23:57:45.848185+0000 mgr.a (mgr.14355) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:47 smithi171 bash[25040]: cluster 2024-09-13T23:57:45.848185+0000 mgr.a (mgr.14355) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:47 smithi007 bash[22722]: cluster 2024-09-13T23:57:45.848185+0000 mgr.a (mgr.14355) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:47.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:47.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:48.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:48.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:48.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:48.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:48.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:49 smithi131 bash[24745]: cluster 2024-09-13T23:57:47.848928+0000 mgr.a (mgr.14355) 4192 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:49 smithi131 bash[24745]: audit 2024-09-13T23:57:48.103291+0000 mgr.a (mgr.14355) 4193 : audit [DBG] from='client.100932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:49 smithi171 bash[25040]: cluster 2024-09-13T23:57:47.848928+0000 mgr.a (mgr.14355) 4192 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:49 smithi171 bash[25040]: audit 2024-09-13T23:57:48.103291+0000 mgr.a (mgr.14355) 4193 : audit [DBG] from='client.100932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:49 smithi007 bash[22722]: cluster 2024-09-13T23:57:47.848928+0000 mgr.a (mgr.14355) 4192 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:49 smithi007 bash[22722]: audit 2024-09-13T23:57:48.103291+0000 mgr.a (mgr.14355) 4193 : audit [DBG] from='client.100932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:51 smithi131 bash[24745]: cluster 2024-09-13T23:57:49.849803+0000 mgr.a (mgr.14355) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:51 smithi171 bash[25040]: cluster 2024-09-13T23:57:49.849803+0000 mgr.a (mgr.14355) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:51 smithi007 bash[22722]: cluster 2024-09-13T23:57:49.849803+0000 mgr.a (mgr.14355) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:53 smithi131 bash[24745]: cluster 2024-09-13T23:57:51.852066+0000 mgr.a (mgr.14355) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:53.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:53.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:53 smithi171 bash[25040]: cluster 2024-09-13T23:57:51.852066+0000 mgr.a (mgr.14355) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:53 smithi007 bash[22722]: cluster 2024-09-13T23:57:51.852066+0000 mgr.a (mgr.14355) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:54.281 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:57:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:57:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:57:54.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:57:54.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:57:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:55 smithi131 bash[24745]: cluster 2024-09-13T23:57:53.852756+0000 mgr.a (mgr.14355) 4196 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:55 smithi131 bash[24745]: audit 2024-09-13T23:57:53.863645+0000 mgr.a (mgr.14355) 4197 : audit [DBG] from='client.101010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:55 smithi171 bash[25040]: cluster 2024-09-13T23:57:53.852756+0000 mgr.a (mgr.14355) 4196 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:55 smithi171 bash[25040]: audit 2024-09-13T23:57:53.863645+0000 mgr.a (mgr.14355) 4197 : audit [DBG] from='client.101010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:55 smithi007 bash[22722]: cluster 2024-09-13T23:57:53.852756+0000 mgr.a (mgr.14355) 4196 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:55 smithi007 bash[22722]: audit 2024-09-13T23:57:53.863645+0000 mgr.a (mgr.14355) 4197 : audit [DBG] from='client.101010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:57:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:57 smithi131 bash[24745]: cluster 2024-09-13T23:57:55.855091+0000 mgr.a (mgr.14355) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:57 smithi171 bash[25040]: cluster 2024-09-13T23:57:55.855091+0000 mgr.a (mgr.14355) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:57 smithi007 bash[22722]: cluster 2024-09-13T23:57:55.855091+0000 mgr.a (mgr.14355) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:57:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:57:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:57:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:57:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:57:59 smithi131 bash[24745]: cluster 2024-09-13T23:57:57.855875+0000 mgr.a (mgr.14355) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:57:59 smithi171 bash[25040]: cluster 2024-09-13T23:57:57.855875+0000 mgr.a (mgr.14355) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:57:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:57:59 smithi007 bash[22722]: cluster 2024-09-13T23:57:57.855875+0000 mgr.a (mgr.14355) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:00.025 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:00.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:00.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:00.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:00.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:01.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:01 smithi131 bash[24745]: audit 2024-09-13T23:57:59.617563+0000 mgr.a (mgr.14355) 4200 : audit [DBG] from='client.101088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:01.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:01 smithi131 bash[24745]: cluster 2024-09-13T23:57:59.856414+0000 mgr.a (mgr.14355) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:01 smithi171 bash[25040]: audit 2024-09-13T23:57:59.617563+0000 mgr.a (mgr.14355) 4200 : audit [DBG] from='client.101088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:01 smithi171 bash[25040]: cluster 2024-09-13T23:57:59.856414+0000 mgr.a (mgr.14355) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:01 smithi007 bash[22722]: audit 2024-09-13T23:57:59.617563+0000 mgr.a (mgr.14355) 4200 : audit [DBG] from='client.101088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:01 smithi007 bash[22722]: cluster 2024-09-13T23:57:59.856414+0000 mgr.a (mgr.14355) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:03 smithi131 bash[24745]: cluster 2024-09-13T23:58:01.858965+0000 mgr.a (mgr.14355) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:03 smithi171 bash[25040]: cluster 2024-09-13T23:58:01.858965+0000 mgr.a (mgr.14355) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:03 smithi007 bash[22722]: cluster 2024-09-13T23:58:01.858965+0000 mgr.a (mgr.14355) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:05.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:05.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:05 smithi131 bash[24745]: cluster 2024-09-13T23:58:03.859928+0000 mgr.a (mgr.14355) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:05 smithi171 bash[25040]: cluster 2024-09-13T23:58:03.859928+0000 mgr.a (mgr.14355) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:05 smithi007 bash[22722]: cluster 2024-09-13T23:58:03.859928+0000 mgr.a (mgr.14355) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:05.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:05.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:05.815 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:06 smithi131 bash[24745]: audit 2024-09-13T23:58:05.368638+0000 mgr.a (mgr.14355) 4204 : audit [DBG] from='client.101163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:06 smithi171 bash[25040]: audit 2024-09-13T23:58:05.368638+0000 mgr.a (mgr.14355) 4204 : audit [DBG] from='client.101163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:06 smithi007 bash[22722]: audit 2024-09-13T23:58:05.368638+0000 mgr.a (mgr.14355) 4204 : audit [DBG] from='client.101163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:07 smithi131 bash[24745]: cluster 2024-09-13T23:58:05.861519+0000 mgr.a (mgr.14355) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:07 smithi171 bash[25040]: cluster 2024-09-13T23:58:05.861519+0000 mgr.a (mgr.14355) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:07 smithi007 bash[22722]: cluster 2024-09-13T23:58:05.861519+0000 mgr.a (mgr.14355) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:09 smithi131 bash[24745]: cluster 2024-09-13T23:58:07.862268+0000 mgr.a (mgr.14355) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:09 smithi171 bash[25040]: cluster 2024-09-13T23:58:07.862268+0000 mgr.a (mgr.14355) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:09 smithi007 bash[22722]: cluster 2024-09-13T23:58:07.862268+0000 mgr.a (mgr.14355) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:10.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:10.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:10.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:11 smithi171 bash[25040]: cluster 2024-09-13T23:58:09.863034+0000 mgr.a (mgr.14355) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:11.560 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:11.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:11 smithi007 bash[22722]: cluster 2024-09-13T23:58:09.863034+0000 mgr.a (mgr.14355) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:11 smithi131 bash[24745]: cluster 2024-09-13T23:58:09.863034+0000 mgr.a (mgr.14355) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:12 smithi171 bash[25040]: audit 2024-09-13T23:58:11.150255+0000 mgr.a (mgr.14355) 4208 : audit [DBG] from='client.101241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:12 smithi007 bash[22722]: audit 2024-09-13T23:58:11.150255+0000 mgr.a (mgr.14355) 4208 : audit [DBG] from='client.101241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:12 smithi131 bash[24745]: audit 2024-09-13T23:58:11.150255+0000 mgr.a (mgr.14355) 4208 : audit [DBG] from='client.101241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:13 smithi007 bash[22722]: cluster 2024-09-13T23:58:11.865868+0000 mgr.a (mgr.14355) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:13 smithi131 bash[24745]: cluster 2024-09-13T23:58:11.865868+0000 mgr.a (mgr.14355) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:13 smithi171 bash[25040]: cluster 2024-09-13T23:58:11.865868+0000 mgr.a (mgr.14355) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:15 smithi007 bash[22722]: cluster 2024-09-13T23:58:13.866676+0000 mgr.a (mgr.14355) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:15 smithi131 bash[24745]: cluster 2024-09-13T23:58:13.866676+0000 mgr.a (mgr.14355) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:15 smithi171 bash[25040]: cluster 2024-09-13T23:58:13.866676+0000 mgr.a (mgr.14355) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:58:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:17.316 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:17 smithi007 bash[22722]: cluster 2024-09-13T23:58:15.868928+0000 mgr.a (mgr.14355) 4211 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:17 smithi131 bash[24745]: cluster 2024-09-13T23:58:15.868928+0000 mgr.a (mgr.14355) 4211 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:17 smithi171 bash[25040]: cluster 2024-09-13T23:58:15.868928+0000 mgr.a (mgr.14355) 4211 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:18 smithi007 bash[22722]: audit 2024-09-13T23:58:16.897172+0000 mgr.a (mgr.14355) 4212 : audit [DBG] from='client.101313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:18 smithi131 bash[24745]: audit 2024-09-13T23:58:16.897172+0000 mgr.a (mgr.14355) 4212 : audit [DBG] from='client.101313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:18 smithi171 bash[25040]: audit 2024-09-13T23:58:16.897172+0000 mgr.a (mgr.14355) 4212 : audit [DBG] from='client.101313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:19 smithi007 bash[22722]: cluster 2024-09-13T23:58:17.869943+0000 mgr.a (mgr.14355) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:19 smithi131 bash[24745]: cluster 2024-09-13T23:58:17.869943+0000 mgr.a (mgr.14355) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:19 smithi171 bash[25040]: cluster 2024-09-13T23:58:17.869943+0000 mgr.a (mgr.14355) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:21 smithi007 bash[22722]: cluster 2024-09-13T23:58:19.870770+0000 mgr.a (mgr.14355) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:21 smithi131 bash[24745]: cluster 2024-09-13T23:58:19.870770+0000 mgr.a (mgr.14355) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:21.818 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:21 smithi171 bash[25040]: cluster 2024-09-13T23:58:19.870770+0000 mgr.a (mgr.14355) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:22.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:22.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:22.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:23.098 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:23 smithi007 bash[22722]: cluster 2024-09-13T23:58:21.873020+0000 mgr.a (mgr.14355) 4215 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:23 smithi131 bash[24745]: cluster 2024-09-13T23:58:21.873020+0000 mgr.a (mgr.14355) 4215 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:23 smithi171 bash[25040]: cluster 2024-09-13T23:58:21.873020+0000 mgr.a (mgr.14355) 4215 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:24 smithi007 bash[22722]: audit 2024-09-13T23:58:22.655065+0000 mgr.a (mgr.14355) 4216 : audit [DBG] from='client.101388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:24 smithi131 bash[24745]: audit 2024-09-13T23:58:22.655065+0000 mgr.a (mgr.14355) 4216 : audit [DBG] from='client.101388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:24 smithi171 bash[25040]: audit 2024-09-13T23:58:22.655065+0000 mgr.a (mgr.14355) 4216 : audit [DBG] from='client.101388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:25 smithi007 bash[22722]: cluster 2024-09-13T23:58:23.874053+0000 mgr.a (mgr.14355) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:25 smithi131 bash[24745]: cluster 2024-09-13T23:58:23.874053+0000 mgr.a (mgr.14355) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:25 smithi171 bash[25040]: cluster 2024-09-13T23:58:23.874053+0000 mgr.a (mgr.14355) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:27 smithi007 bash[22722]: cluster 2024-09-13T23:58:25.876451+0000 mgr.a (mgr.14355) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:27 smithi131 bash[24745]: cluster 2024-09-13T23:58:25.876451+0000 mgr.a (mgr.14355) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:27 smithi171 bash[25040]: cluster 2024-09-13T23:58:25.876451+0000 mgr.a (mgr.14355) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:58:28.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:28.101 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:28.101 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:28.850 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:29 smithi007 bash[22722]: cluster 2024-09-13T23:58:27.877395+0000 mgr.a (mgr.14355) 4219 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:29 smithi007 bash[22722]: audit 2024-09-13T23:58:29.135204+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:58:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:29 smithi131 bash[24745]: cluster 2024-09-13T23:58:27.877395+0000 mgr.a (mgr.14355) 4219 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:29 smithi131 bash[24745]: audit 2024-09-13T23:58:29.135204+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:58:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:29 smithi171 bash[25040]: cluster 2024-09-13T23:58:27.877395+0000 mgr.a (mgr.14355) 4219 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:29 smithi171 bash[25040]: audit 2024-09-13T23:58:29.135204+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:58:30.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22722]: audit 2024-09-13T23:58:28.434676+0000 mgr.a (mgr.14355) 4220 : audit [DBG] from='client.101460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:30.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22722]: audit 2024-09-13T23:58:29.963127+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:58:30.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22722]: audit 2024-09-13T23:58:29.964423+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:58:30.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22722]: audit 2024-09-13T23:58:29.972521+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:58:30.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22722]: audit 2024-09-13T23:58:29.977335+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:30 smithi131 bash[24745]: audit 2024-09-13T23:58:28.434676+0000 mgr.a (mgr.14355) 4220 : audit [DBG] from='client.101460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:30 smithi131 bash[24745]: audit 2024-09-13T23:58:29.963127+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:58:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:30 smithi131 bash[24745]: audit 2024-09-13T23:58:29.964423+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:58:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:30 smithi131 bash[24745]: audit 2024-09-13T23:58:29.972521+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:58:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:30 smithi131 bash[24745]: audit 2024-09-13T23:58:29.977335+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:30 smithi171 bash[25040]: audit 2024-09-13T23:58:28.434676+0000 mgr.a (mgr.14355) 4220 : audit [DBG] from='client.101460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:30 smithi171 bash[25040]: audit 2024-09-13T23:58:29.963127+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:58:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:30 smithi171 bash[25040]: audit 2024-09-13T23:58:29.964423+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:58:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:30 smithi171 bash[25040]: audit 2024-09-13T23:58:29.972521+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:58:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:30 smithi171 bash[25040]: audit 2024-09-13T23:58:29.977335+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22972]: debug 2024-09-13T23:58:30.691+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:58:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:58:30 smithi007 bash[22972]: debug 2024-09-13T23:58:30.691+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:58:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:31 smithi007 bash[22722]: cluster 2024-09-13T23:58:29.878368+0000 mgr.a (mgr.14355) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:31 smithi007 bash[22722]: audit 2024-09-13T23:58:29.980024+0000 mgr.a (mgr.14355) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:31 smithi131 bash[24745]: cluster 2024-09-13T23:58:29.878368+0000 mgr.a (mgr.14355) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:31 smithi131 bash[24745]: audit 2024-09-13T23:58:29.980024+0000 mgr.a (mgr.14355) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:31 smithi171 bash[25040]: cluster 2024-09-13T23:58:29.878368+0000 mgr.a (mgr.14355) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:31 smithi171 bash[25040]: audit 2024-09-13T23:58:29.980024+0000 mgr.a (mgr.14355) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:58:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:32 smithi007 bash[22722]: audit 2024-09-13T23:58:30.695286+0000 mgr.a (mgr.14355) 4223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:58:32.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:32 smithi007 bash[22722]: cephadm 2024-09-13T23:58:30.696569+0000 mgr.a (mgr.14355) 4224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:58:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:32 smithi131 bash[24745]: audit 2024-09-13T23:58:30.695286+0000 mgr.a (mgr.14355) 4223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:58:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:32 smithi131 bash[24745]: cephadm 2024-09-13T23:58:30.696569+0000 mgr.a (mgr.14355) 4224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:58:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:32 smithi171 bash[25040]: audit 2024-09-13T23:58:30.695286+0000 mgr.a (mgr.14355) 4223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:58:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:32 smithi171 bash[25040]: cephadm 2024-09-13T23:58:30.696569+0000 mgr.a (mgr.14355) 4224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:58:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:33 smithi007 bash[22722]: cluster 2024-09-13T23:58:31.881854+0000 mgr.a (mgr.14355) 4225 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-13T23:58:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:33 smithi131 bash[24745]: cluster 2024-09-13T23:58:31.881854+0000 mgr.a (mgr.14355) 4225 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-13T23:58:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:33 smithi171 bash[25040]: cluster 2024-09-13T23:58:31.881854+0000 mgr.a (mgr.14355) 4225 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-13T23:58:33.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:33.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:33.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:34.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:35 smithi007 bash[22722]: cluster 2024-09-13T23:58:33.882629+0000 mgr.a (mgr.14355) 4226 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:58:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:35 smithi007 bash[22722]: audit 2024-09-13T23:58:34.188090+0000 mgr.a (mgr.14355) 4227 : audit [DBG] from='client.101640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:35 smithi131 bash[24745]: cluster 2024-09-13T23:58:33.882629+0000 mgr.a (mgr.14355) 4226 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:58:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:35 smithi131 bash[24745]: audit 2024-09-13T23:58:34.188090+0000 mgr.a (mgr.14355) 4227 : audit [DBG] from='client.101640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:35 smithi171 bash[25040]: cluster 2024-09-13T23:58:33.882629+0000 mgr.a (mgr.14355) 4226 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-13T23:58:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:35 smithi171 bash[25040]: audit 2024-09-13T23:58:34.188090+0000 mgr.a (mgr.14355) 4227 : audit [DBG] from='client.101640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:37 smithi007 bash[22722]: cluster 2024-09-13T23:58:35.884976+0000 mgr.a (mgr.14355) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:37 smithi131 bash[24745]: cluster 2024-09-13T23:58:35.884976+0000 mgr.a (mgr.14355) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:37 smithi171 bash[25040]: cluster 2024-09-13T23:58:35.884976+0000 mgr.a (mgr.14355) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:39.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:39.625 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:39.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:39 smithi007 bash[22722]: cluster 2024-09-13T23:58:37.885743+0000 mgr.a (mgr.14355) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:39 smithi131 bash[24745]: cluster 2024-09-13T23:58:37.885743+0000 mgr.a (mgr.14355) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:39 smithi171 bash[25040]: cluster 2024-09-13T23:58:37.885743+0000 mgr.a (mgr.14355) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:40.376 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:40.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:41 smithi007 bash[22722]: cluster 2024-09-13T23:58:39.886456+0000 mgr.a (mgr.14355) 4230 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:41 smithi007 bash[22722]: audit 2024-09-13T23:58:39.955070+0000 mgr.a (mgr.14355) 4231 : audit [DBG] from='client.101718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:41 smithi131 bash[24745]: cluster 2024-09-13T23:58:39.886456+0000 mgr.a (mgr.14355) 4230 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:41 smithi131 bash[24745]: audit 2024-09-13T23:58:39.955070+0000 mgr.a (mgr.14355) 4231 : audit [DBG] from='client.101718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:41 smithi171 bash[25040]: cluster 2024-09-13T23:58:39.886456+0000 mgr.a (mgr.14355) 4230 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:41 smithi171 bash[25040]: audit 2024-09-13T23:58:39.955070+0000 mgr.a (mgr.14355) 4231 : audit [DBG] from='client.101718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:43 smithi007 bash[22722]: cluster 2024-09-13T23:58:41.888971+0000 mgr.a (mgr.14355) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:43 smithi131 bash[24745]: cluster 2024-09-13T23:58:41.888971+0000 mgr.a (mgr.14355) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:43 smithi171 bash[25040]: cluster 2024-09-13T23:58:41.888971+0000 mgr.a (mgr.14355) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:58:45.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:45.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:45.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:45 smithi007 bash[22722]: cluster 2024-09-13T23:58:43.889771+0000 mgr.a (mgr.14355) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:45 smithi131 bash[24745]: cluster 2024-09-13T23:58:43.889771+0000 mgr.a (mgr.14355) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:45 smithi171 bash[25040]: cluster 2024-09-13T23:58:43.889771+0000 mgr.a (mgr.14355) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:46.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:47 smithi007 bash[22722]: audit 2024-09-13T23:58:45.717830+0000 mgr.a (mgr.14355) 4234 : audit [DBG] from='client.101796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:47 smithi007 bash[22722]: cluster 2024-09-13T23:58:45.891188+0000 mgr.a (mgr.14355) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:47 smithi131 bash[24745]: audit 2024-09-13T23:58:45.717830+0000 mgr.a (mgr.14355) 4234 : audit [DBG] from='client.101796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:47 smithi131 bash[24745]: cluster 2024-09-13T23:58:45.891188+0000 mgr.a (mgr.14355) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:47 smithi171 bash[25040]: audit 2024-09-13T23:58:45.717830+0000 mgr.a (mgr.14355) 4234 : audit [DBG] from='client.101796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:47 smithi171 bash[25040]: cluster 2024-09-13T23:58:45.891188+0000 mgr.a (mgr.14355) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T23:58:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:49 smithi007 bash[22722]: cluster 2024-09-13T23:58:47.892048+0000 mgr.a (mgr.14355) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:49 smithi131 bash[24745]: cluster 2024-09-13T23:58:47.892048+0000 mgr.a (mgr.14355) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:49 smithi171 bash[25040]: cluster 2024-09-13T23:58:47.892048+0000 mgr.a (mgr.14355) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:50 smithi007 bash[22722]: cluster 2024-09-13T23:58:49.892832+0000 mgr.a (mgr.14355) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:50 smithi131 bash[24745]: cluster 2024-09-13T23:58:49.892832+0000 mgr.a (mgr.14355) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:50 smithi171 bash[25040]: cluster 2024-09-13T23:58:49.892832+0000 mgr.a (mgr.14355) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:58:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:51.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:51.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:51.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:51.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:51.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:51.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:51.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:52 smithi007 bash[22722]: audit 2024-09-13T23:58:51.507216+0000 mgr.a (mgr.14355) 4238 : audit [DBG] from='client.101874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:52 smithi007 bash[22722]: cluster 2024-09-13T23:58:51.894114+0000 mgr.a (mgr.14355) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:52 smithi131 bash[24745]: audit 2024-09-13T23:58:51.507216+0000 mgr.a (mgr.14355) 4238 : audit [DBG] from='client.101874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:52 smithi131 bash[24745]: cluster 2024-09-13T23:58:51.894114+0000 mgr.a (mgr.14355) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:52 smithi171 bash[25040]: audit 2024-09-13T23:58:51.507216+0000 mgr.a (mgr.14355) 4238 : audit [DBG] from='client.101874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:52 smithi171 bash[25040]: cluster 2024-09-13T23:58:51.894114+0000 mgr.a (mgr.14355) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:54 smithi007 bash[22722]: cluster 2024-09-13T23:58:53.894885+0000 mgr.a (mgr.14355) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:58:55.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:54 smithi131 bash[24745]: cluster 2024-09-13T23:58:53.894885+0000 mgr.a (mgr.14355) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:58:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:54 smithi171 bash[25040]: cluster 2024-09-13T23:58:53.894885+0000 mgr.a (mgr.14355) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:58:56.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:58:56.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:58:56.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:58:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:56 smithi131 bash[24745]: cluster 2024-09-13T23:58:55.896841+0000 mgr.a (mgr.14355) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:58:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:56 smithi171 bash[25040]: cluster 2024-09-13T23:58:55.896841+0000 mgr.a (mgr.14355) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:58:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:56 smithi007 bash[22722]: cluster 2024-09-13T23:58:55.896841+0000 mgr.a (mgr.14355) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-13T23:58:57.678 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:58:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:58:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:58:57.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:58:57.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:58:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:57 smithi131 bash[24745]: audit 2024-09-13T23:58:57.269060+0000 mgr.a (mgr.14355) 4242 : audit [DBG] from='client.101949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:57 smithi171 bash[25040]: audit 2024-09-13T23:58:57.269060+0000 mgr.a (mgr.14355) 4242 : audit [DBG] from='client.101949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:57 smithi007 bash[22722]: audit 2024-09-13T23:58:57.269060+0000 mgr.a (mgr.14355) 4242 : audit [DBG] from='client.101949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:58:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:58:58 smithi131 bash[24745]: cluster 2024-09-13T23:58:57.897759+0000 mgr.a (mgr.14355) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:58:58 smithi171 bash[25040]: cluster 2024-09-13T23:58:57.897759+0000 mgr.a (mgr.14355) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:58:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:58:58 smithi007 bash[22722]: cluster 2024-09-13T23:58:57.897759+0000 mgr.a (mgr.14355) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:01.269 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:00 smithi171 bash[25040]: cluster 2024-09-13T23:58:59.898572+0000 mgr.a (mgr.14355) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:01.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:00 smithi131 bash[24745]: cluster 2024-09-13T23:58:59.898572+0000 mgr.a (mgr.14355) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:00 smithi007 bash[22722]: cluster 2024-09-13T23:58:59.898572+0000 mgr.a (mgr.14355) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:02.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:02.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:02.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:02 smithi131 bash[24745]: cluster 2024-09-13T23:59:01.900834+0000 mgr.a (mgr.14355) 4245 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:02 smithi171 bash[25040]: cluster 2024-09-13T23:59:01.900834+0000 mgr.a (mgr.14355) 4245 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:03.446 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:03.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:03.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:03.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:03.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:02 smithi007 bash[22722]: cluster 2024-09-13T23:59:01.900834+0000 mgr.a (mgr.14355) 4245 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:03 smithi131 bash[24745]: audit 2024-09-13T23:59:03.013733+0000 mgr.a (mgr.14355) 4246 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:03 smithi171 bash[25040]: audit 2024-09-13T23:59:03.013733+0000 mgr.a (mgr.14355) 4246 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:03 smithi007 bash[22722]: audit 2024-09-13T23:59:03.013733+0000 mgr.a (mgr.14355) 4246 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:04 smithi131 bash[24745]: cluster 2024-09-13T23:59:03.901833+0000 mgr.a (mgr.14355) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:04 smithi171 bash[25040]: cluster 2024-09-13T23:59:03.901833+0000 mgr.a (mgr.14355) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:04 smithi007 bash[22722]: cluster 2024-09-13T23:59:03.901833+0000 mgr.a (mgr.14355) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:06 smithi131 bash[24745]: cluster 2024-09-13T23:59:05.904041+0000 mgr.a (mgr.14355) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:06 smithi171 bash[25040]: cluster 2024-09-13T23:59:05.904041+0000 mgr.a (mgr.14355) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:06 smithi007 bash[22722]: cluster 2024-09-13T23:59:05.904041+0000 mgr.a (mgr.14355) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:09.231 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:09.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:08 smithi131 bash[24745]: cluster 2024-09-13T23:59:07.904828+0000 mgr.a (mgr.14355) 4249 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:08 smithi171 bash[25040]: cluster 2024-09-13T23:59:07.904828+0000 mgr.a (mgr.14355) 4249 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:08 smithi007 bash[22722]: cluster 2024-09-13T23:59:07.904828+0000 mgr.a (mgr.14355) 4249 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:10 smithi131 bash[24745]: audit 2024-09-13T23:59:08.783706+0000 mgr.a (mgr.14355) 4250 : audit [DBG] from='client.102102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:10 smithi171 bash[25040]: audit 2024-09-13T23:59:08.783706+0000 mgr.a (mgr.14355) 4250 : audit [DBG] from='client.102102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:10 smithi007 bash[22722]: audit 2024-09-13T23:59:08.783706+0000 mgr.a (mgr.14355) 4250 : audit [DBG] from='client.102102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:11 smithi131 bash[24745]: cluster 2024-09-13T23:59:09.905783+0000 mgr.a (mgr.14355) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:11 smithi171 bash[25040]: cluster 2024-09-13T23:59:09.905783+0000 mgr.a (mgr.14355) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:11 smithi007 bash[22722]: cluster 2024-09-13T23:59:09.905783+0000 mgr.a (mgr.14355) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:13 smithi131 bash[24745]: cluster 2024-09-13T23:59:11.908004+0000 mgr.a (mgr.14355) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:13 smithi171 bash[25040]: cluster 2024-09-13T23:59:11.908004+0000 mgr.a (mgr.14355) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:13 smithi007 bash[22722]: cluster 2024-09-13T23:59:11.908004+0000 mgr.a (mgr.14355) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:14.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:14.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:14.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:15 smithi131 bash[24745]: cluster 2024-09-13T23:59:13.908807+0000 mgr.a (mgr.14355) 4253 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:15 smithi171 bash[25040]: cluster 2024-09-13T23:59:13.908807+0000 mgr.a (mgr.14355) 4253 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:15 smithi007 bash[22722]: cluster 2024-09-13T23:59:13.908807+0000 mgr.a (mgr.14355) 4253 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:16.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:16 smithi131 bash[24745]: audit 2024-09-13T23:59:14.565007+0000 mgr.a (mgr.14355) 4254 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:16 smithi171 bash[25040]: audit 2024-09-13T23:59:14.565007+0000 mgr.a (mgr.14355) 4254 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:16 smithi007 bash[22722]: audit 2024-09-13T23:59:14.565007+0000 mgr.a (mgr.14355) 4254 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:17 smithi131 bash[24745]: cluster 2024-09-13T23:59:15.911189+0000 mgr.a (mgr.14355) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:17 smithi171 bash[25040]: cluster 2024-09-13T23:59:15.911189+0000 mgr.a (mgr.14355) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:17 smithi007 bash[22722]: cluster 2024-09-13T23:59:15.911189+0000 mgr.a (mgr.14355) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:19.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:19 smithi131 bash[24745]: cluster 2024-09-13T23:59:17.911982+0000 mgr.a (mgr.14355) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:19 smithi171 bash[25040]: cluster 2024-09-13T23:59:17.911982+0000 mgr.a (mgr.14355) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:19 smithi007 bash[22722]: cluster 2024-09-13T23:59:17.911982+0000 mgr.a (mgr.14355) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:19.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:19.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:20.743 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:20.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:20.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:21 smithi171 bash[25040]: cluster 2024-09-13T23:59:19.912734+0000 mgr.a (mgr.14355) 4257 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:21 smithi171 bash[25040]: audit 2024-09-13T23:59:20.319666+0000 mgr.a (mgr.14355) 4258 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:21 smithi007 bash[22722]: cluster 2024-09-13T23:59:19.912734+0000 mgr.a (mgr.14355) 4257 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:21 smithi007 bash[22722]: audit 2024-09-13T23:59:20.319666+0000 mgr.a (mgr.14355) 4258 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:21 smithi131 bash[24745]: cluster 2024-09-13T23:59:19.912734+0000 mgr.a (mgr.14355) 4257 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:21 smithi131 bash[24745]: audit 2024-09-13T23:59:20.319666+0000 mgr.a (mgr.14355) 4258 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:23 smithi171 bash[25040]: cluster 2024-09-13T23:59:21.915469+0000 mgr.a (mgr.14355) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:23 smithi007 bash[22722]: cluster 2024-09-13T23:59:21.915469+0000 mgr.a (mgr.14355) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:23 smithi131 bash[24745]: cluster 2024-09-13T23:59:21.915469+0000 mgr.a (mgr.14355) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:25 smithi171 bash[25040]: cluster 2024-09-13T23:59:23.916247+0000 mgr.a (mgr.14355) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:25 smithi007 bash[22722]: cluster 2024-09-13T23:59:23.916247+0000 mgr.a (mgr.14355) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:25 smithi131 bash[24745]: cluster 2024-09-13T23:59:23.916247+0000 mgr.a (mgr.14355) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:26.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:26.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:27 smithi007 bash[22722]: cluster 2024-09-13T23:59:25.918087+0000 mgr.a (mgr.14355) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:27 smithi007 bash[22722]: audit 2024-09-13T23:59:26.080109+0000 mgr.a (mgr.14355) 4262 : audit [DBG] from='client.102327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:27 smithi131 bash[24745]: cluster 2024-09-13T23:59:25.918087+0000 mgr.a (mgr.14355) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:27 smithi131 bash[24745]: audit 2024-09-13T23:59:26.080109+0000 mgr.a (mgr.14355) 4262 : audit [DBG] from='client.102327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:27 smithi171 bash[25040]: cluster 2024-09-13T23:59:25.918087+0000 mgr.a (mgr.14355) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:27 smithi171 bash[25040]: audit 2024-09-13T23:59:26.080109+0000 mgr.a (mgr.14355) 4262 : audit [DBG] from='client.102327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:29 smithi007 bash[22722]: cluster 2024-09-13T23:59:27.919012+0000 mgr.a (mgr.14355) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:29 smithi131 bash[24745]: cluster 2024-09-13T23:59:27.919012+0000 mgr.a (mgr.14355) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:29 smithi171 bash[25040]: cluster 2024-09-13T23:59:27.919012+0000 mgr.a (mgr.14355) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:31 smithi007 bash[22722]: cluster 2024-09-13T23:59:29.919790+0000 mgr.a (mgr.14355) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:59:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:31 smithi007 bash[22722]: audit 2024-09-13T23:59:30.748269+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:59:31.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:31.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:31.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:31.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:31 smithi131 bash[24745]: cluster 2024-09-13T23:59:29.919790+0000 mgr.a (mgr.14355) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:59:31.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:31 smithi131 bash[24745]: audit 2024-09-13T23:59:30.748269+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:59:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:31 smithi171 bash[25040]: cluster 2024-09-13T23:59:29.919790+0000 mgr.a (mgr.14355) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-13T23:59:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:31 smithi171 bash[25040]: audit 2024-09-13T23:59:30.748269+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:59:32.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22722]: audit 2024-09-13T23:59:31.585522+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:59:32.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22722]: audit 2024-09-13T23:59:31.586823+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:59:32.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22722]: audit 2024-09-13T23:59:31.594698+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:59:32.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22722]: audit 2024-09-13T23:59:31.597282+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:32 smithi131 bash[24745]: audit 2024-09-13T23:59:31.585522+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:59:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:32 smithi131 bash[24745]: audit 2024-09-13T23:59:31.586823+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:59:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:32 smithi131 bash[24745]: audit 2024-09-13T23:59:31.594698+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:59:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:32 smithi131 bash[24745]: audit 2024-09-13T23:59:31.597282+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:32 smithi171 bash[25040]: audit 2024-09-13T23:59:31.585522+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:59:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:32 smithi171 bash[25040]: audit 2024-09-13T23:59:31.586823+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:59:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:32 smithi171 bash[25040]: audit 2024-09-13T23:59:31.594698+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-13T23:59:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:32 smithi171 bash[25040]: audit 2024-09-13T23:59:31.597282+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:32.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22972]: debug 2024-09-13T23:59:32.310+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:59:32.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 13 23:59:32 smithi007 bash[22972]: debug 2024-09-13T23:59:32.322+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:59:32.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:32.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:32.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:32.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:32.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:33 smithi007 bash[22722]: audit 2024-09-13T23:59:31.598306+0000 mgr.a (mgr.14355) 4265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:33 smithi007 bash[22722]: audit 2024-09-13T23:59:31.858008+0000 mgr.a (mgr.14355) 4266 : audit [DBG] from='client.102399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:33 smithi007 bash[22722]: cluster 2024-09-13T23:59:31.921541+0000 mgr.a (mgr.14355) 4267 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:33 smithi007 bash[22722]: audit 2024-09-13T23:59:32.310817+0000 mgr.a (mgr.14355) 4268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:59:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:33 smithi007 bash[22722]: cephadm 2024-09-13T23:59:32.323514+0000 mgr.a (mgr.14355) 4269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:33 smithi131 bash[24745]: audit 2024-09-13T23:59:31.598306+0000 mgr.a (mgr.14355) 4265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:33 smithi131 bash[24745]: audit 2024-09-13T23:59:31.858008+0000 mgr.a (mgr.14355) 4266 : audit [DBG] from='client.102399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:33 smithi131 bash[24745]: cluster 2024-09-13T23:59:31.921541+0000 mgr.a (mgr.14355) 4267 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:33 smithi131 bash[24745]: audit 2024-09-13T23:59:32.310817+0000 mgr.a (mgr.14355) 4268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:33 smithi131 bash[24745]: cephadm 2024-09-13T23:59:32.323514+0000 mgr.a (mgr.14355) 4269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:59:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:33 smithi171 bash[25040]: audit 2024-09-13T23:59:31.598306+0000 mgr.a (mgr.14355) 4265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-13T23:59:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:33 smithi171 bash[25040]: audit 2024-09-13T23:59:31.858008+0000 mgr.a (mgr.14355) 4266 : audit [DBG] from='client.102399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:33 smithi171 bash[25040]: cluster 2024-09-13T23:59:31.921541+0000 mgr.a (mgr.14355) 4267 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:33 smithi171 bash[25040]: audit 2024-09-13T23:59:32.310817+0000 mgr.a (mgr.14355) 4268 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-13T23:59:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:33 smithi171 bash[25040]: cephadm 2024-09-13T23:59:32.323514+0000 mgr.a (mgr.14355) 4269 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-13T23:59:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:35 smithi007 bash[22722]: cluster 2024-09-13T23:59:33.922465+0000 mgr.a (mgr.14355) 4270 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:35 smithi131 bash[24745]: cluster 2024-09-13T23:59:33.922465+0000 mgr.a (mgr.14355) 4270 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:35 smithi171 bash[25040]: cluster 2024-09-13T23:59:33.922465+0000 mgr.a (mgr.14355) 4270 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:37 smithi007 bash[22722]: cluster 2024-09-13T23:59:35.924617+0000 mgr.a (mgr.14355) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:37 smithi131 bash[24745]: cluster 2024-09-13T23:59:35.924617+0000 mgr.a (mgr.14355) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:37 smithi171 bash[25040]: cluster 2024-09-13T23:59:35.924617+0000 mgr.a (mgr.14355) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:37.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:38.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:38.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:39 smithi007 bash[22722]: cluster 2024-09-13T23:59:37.925461+0000 mgr.a (mgr.14355) 4272 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:39 smithi007 bash[22722]: audit 2024-09-13T23:59:38.044896+0000 mgr.a (mgr.14355) 4273 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:39 smithi131 bash[24745]: cluster 2024-09-13T23:59:37.925461+0000 mgr.a (mgr.14355) 4272 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:39 smithi131 bash[24745]: audit 2024-09-13T23:59:38.044896+0000 mgr.a (mgr.14355) 4273 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:39 smithi171 bash[25040]: cluster 2024-09-13T23:59:37.925461+0000 mgr.a (mgr.14355) 4272 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:39 smithi171 bash[25040]: audit 2024-09-13T23:59:38.044896+0000 mgr.a (mgr.14355) 4273 : audit [DBG] from='client.102579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:41 smithi007 bash[22722]: cluster 2024-09-13T23:59:39.926408+0000 mgr.a (mgr.14355) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:41 smithi131 bash[24745]: cluster 2024-09-13T23:59:39.926408+0000 mgr.a (mgr.14355) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:41 smithi171 bash[25040]: cluster 2024-09-13T23:59:39.926408+0000 mgr.a (mgr.14355) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:43 smithi007 bash[22722]: cluster 2024-09-13T23:59:41.928665+0000 mgr.a (mgr.14355) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:43.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:43.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:43.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:43.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:43 smithi131 bash[24745]: cluster 2024-09-13T23:59:41.928665+0000 mgr.a (mgr.14355) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:43 smithi171 bash[25040]: cluster 2024-09-13T23:59:41.928665+0000 mgr.a (mgr.14355) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:44.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:44.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:44.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:44.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:44.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:45 smithi007 bash[22722]: audit 2024-09-13T23:59:43.791634+0000 mgr.a (mgr.14355) 4276 : audit [DBG] from='client.102657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:45 smithi007 bash[22722]: cluster 2024-09-13T23:59:43.929251+0000 mgr.a (mgr.14355) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:45 smithi131 bash[24745]: audit 2024-09-13T23:59:43.791634+0000 mgr.a (mgr.14355) 4276 : audit [DBG] from='client.102657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:45 smithi131 bash[24745]: cluster 2024-09-13T23:59:43.929251+0000 mgr.a (mgr.14355) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:45 smithi171 bash[25040]: audit 2024-09-13T23:59:43.791634+0000 mgr.a (mgr.14355) 4276 : audit [DBG] from='client.102657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:45 smithi171 bash[25040]: cluster 2024-09-13T23:59:43.929251+0000 mgr.a (mgr.14355) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:47 smithi007 bash[22722]: cluster 2024-09-13T23:59:45.932774+0000 mgr.a (mgr.14355) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:47 smithi131 bash[24745]: cluster 2024-09-13T23:59:45.932774+0000 mgr.a (mgr.14355) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:47 smithi171 bash[25040]: cluster 2024-09-13T23:59:45.932774+0000 mgr.a (mgr.14355) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T23:59:49.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:49.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:49.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:49 smithi007 bash[22722]: cluster 2024-09-13T23:59:47.933576+0000 mgr.a (mgr.14355) 4279 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:49 smithi131 bash[24745]: cluster 2024-09-13T23:59:47.933576+0000 mgr.a (mgr.14355) 4279 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:49 smithi171 bash[25040]: cluster 2024-09-13T23:59:47.933576+0000 mgr.a (mgr.14355) 4279 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:50.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:51 smithi007 bash[22722]: audit 2024-09-13T23:59:49.561093+0000 mgr.a (mgr.14355) 4280 : audit [DBG] from='client.102732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:51 smithi007 bash[22722]: cluster 2024-09-13T23:59:49.934138+0000 mgr.a (mgr.14355) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:51 smithi131 bash[24745]: audit 2024-09-13T23:59:49.561093+0000 mgr.a (mgr.14355) 4280 : audit [DBG] from='client.102732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:51 smithi131 bash[24745]: cluster 2024-09-13T23:59:49.934138+0000 mgr.a (mgr.14355) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:51 smithi171 bash[25040]: audit 2024-09-13T23:59:49.561093+0000 mgr.a (mgr.14355) 4280 : audit [DBG] from='client.102732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:51 smithi171 bash[25040]: cluster 2024-09-13T23:59:49.934138+0000 mgr.a (mgr.14355) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:53 smithi007 bash[22722]: cluster 2024-09-13T23:59:51.936358+0000 mgr.a (mgr.14355) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:53 smithi131 bash[24745]: cluster 2024-09-13T23:59:51.936358+0000 mgr.a (mgr.14355) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:53 smithi171 bash[25040]: cluster 2024-09-13T23:59:51.936358+0000 mgr.a (mgr.14355) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-13T23:59:55.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-13T23:59:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-13T23:59:55.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-13T23:59:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:55 smithi007 bash[22722]: cluster 2024-09-13T23:59:53.937085+0000 mgr.a (mgr.14355) 4283 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:55 smithi131 bash[24745]: cluster 2024-09-13T23:59:53.937085+0000 mgr.a (mgr.14355) 4283 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:55 smithi171 bash[25040]: cluster 2024-09-13T23:59:53.937085+0000 mgr.a (mgr.14355) 4283 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:55.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-13T23:59:55.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-13T23:59:55.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-13T23:59:55.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-13T23:59:55.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-13T23:59:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:56 smithi007 bash[22722]: audit 2024-09-13T23:59:55.343517+0000 mgr.a (mgr.14355) 4284 : audit [DBG] from='client.102810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:56 smithi131 bash[24745]: audit 2024-09-13T23:59:55.343517+0000 mgr.a (mgr.14355) 4284 : audit [DBG] from='client.102810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:56 smithi171 bash[25040]: audit 2024-09-13T23:59:55.343517+0000 mgr.a (mgr.14355) 4284 : audit [DBG] from='client.102810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:59:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:57 smithi007 bash[22722]: cluster 2024-09-13T23:59:55.939941+0000 mgr.a (mgr.14355) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:57 smithi131 bash[24745]: cluster 2024-09-13T23:59:55.939941+0000 mgr.a (mgr.14355) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:57 smithi171 bash[25040]: cluster 2024-09-13T23:59:55.939941+0000 mgr.a (mgr.14355) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-13T23:59:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 23:59:59 smithi007 bash[22722]: cluster 2024-09-13T23:59:57.940743+0000 mgr.a (mgr.14355) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 13 23:59:59 smithi131 bash[24745]: cluster 2024-09-13T23:59:57.940743+0000 mgr.a (mgr.14355) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-13T23:59:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 13 23:59:59 smithi171 bash[25040]: cluster 2024-09-13T23:59:57.940743+0000 mgr.a (mgr.14355) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:00:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:00 smithi007 bash[22722]: cluster 2024-09-14T00:00:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:00:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:00 smithi131 bash[24745]: cluster 2024-09-14T00:00:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:00:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:00 smithi171 bash[25040]: cluster 2024-09-14T00:00:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:00:00.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:00.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:00.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:01.413 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:01 smithi171 bash[25040]: cluster 2024-09-13T23:59:59.941509+0000 mgr.a (mgr.14355) 4287 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:00:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:01 smithi007 bash[22722]: cluster 2024-09-13T23:59:59.941509+0000 mgr.a (mgr.14355) 4287 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:00:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:01 smithi131 bash[24745]: cluster 2024-09-13T23:59:59.941509+0000 mgr.a (mgr.14355) 4287 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:00:01.594 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:01.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:02.469 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:02 smithi007 bash[22722]: audit 2024-09-14T00:00:01.165380+0000 mgr.a (mgr.14355) 4288 : audit [DBG] from='client.102885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:02 smithi131 bash[24745]: audit 2024-09-14T00:00:01.165380+0000 mgr.a (mgr.14355) 4288 : audit [DBG] from='client.102885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:02 smithi171 bash[25040]: audit 2024-09-14T00:00:01.165380+0000 mgr.a (mgr.14355) 4288 : audit [DBG] from='client.102885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:03 smithi007 bash[22722]: cluster 2024-09-14T00:00:01.944446+0000 mgr.a (mgr.14355) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:03 smithi131 bash[24745]: cluster 2024-09-14T00:00:01.944446+0000 mgr.a (mgr.14355) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:03 smithi171 bash[25040]: cluster 2024-09-14T00:00:01.944446+0000 mgr.a (mgr.14355) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:05 smithi007 bash[22722]: cluster 2024-09-14T00:00:03.945236+0000 mgr.a (mgr.14355) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:00:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:05 smithi131 bash[24745]: cluster 2024-09-14T00:00:03.945236+0000 mgr.a (mgr.14355) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:00:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:05 smithi171 bash[25040]: cluster 2024-09-14T00:00:03.945236+0000 mgr.a (mgr.14355) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:00:06.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:06.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:06.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:07.343 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:07.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:07.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:07 smithi007 bash[22722]: cluster 2024-09-14T00:00:05.947241+0000 mgr.a (mgr.14355) 4291 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:07 smithi131 bash[24745]: cluster 2024-09-14T00:00:05.947241+0000 mgr.a (mgr.14355) 4291 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:07 smithi171 bash[25040]: cluster 2024-09-14T00:00:05.947241+0000 mgr.a (mgr.14355) 4291 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:08 smithi007 bash[22722]: audit 2024-09-14T00:00:06.924017+0000 mgr.a (mgr.14355) 4292 : audit [DBG] from='client.102963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:08 smithi131 bash[24745]: audit 2024-09-14T00:00:06.924017+0000 mgr.a (mgr.14355) 4292 : audit [DBG] from='client.102963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:08 smithi171 bash[25040]: audit 2024-09-14T00:00:06.924017+0000 mgr.a (mgr.14355) 4292 : audit [DBG] from='client.102963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:09 smithi007 bash[22722]: cluster 2024-09-14T00:00:07.948058+0000 mgr.a (mgr.14355) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:09 smithi131 bash[24745]: cluster 2024-09-14T00:00:07.948058+0000 mgr.a (mgr.14355) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:09 smithi171 bash[25040]: cluster 2024-09-14T00:00:07.948058+0000 mgr.a (mgr.14355) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:11 smithi007 bash[22722]: cluster 2024-09-14T00:00:09.948835+0000 mgr.a (mgr.14355) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:11 smithi131 bash[24745]: cluster 2024-09-14T00:00:09.948835+0000 mgr.a (mgr.14355) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:11 smithi171 bash[25040]: cluster 2024-09-14T00:00:09.948835+0000 mgr.a (mgr.14355) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:12.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:12.346 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:12.346 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:13.128 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:13.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:13 smithi007 bash[22722]: cluster 2024-09-14T00:00:11.951139+0000 mgr.a (mgr.14355) 4295 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:13 smithi131 bash[24745]: cluster 2024-09-14T00:00:11.951139+0000 mgr.a (mgr.14355) 4295 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:13 smithi171 bash[25040]: cluster 2024-09-14T00:00:11.951139+0000 mgr.a (mgr.14355) 4295 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:14 smithi007 bash[22722]: audit 2024-09-14T00:00:12.687581+0000 mgr.a (mgr.14355) 4296 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:14 smithi131 bash[24745]: audit 2024-09-14T00:00:12.687581+0000 mgr.a (mgr.14355) 4296 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:14 smithi171 bash[25040]: audit 2024-09-14T00:00:12.687581+0000 mgr.a (mgr.14355) 4296 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:15 smithi007 bash[22722]: cluster 2024-09-14T00:00:13.952071+0000 mgr.a (mgr.14355) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:15 smithi131 bash[24745]: cluster 2024-09-14T00:00:13.952071+0000 mgr.a (mgr.14355) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:15 smithi171 bash[25040]: cluster 2024-09-14T00:00:13.952071+0000 mgr.a (mgr.14355) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 0 B/s wr, 81 op/s 2024-09-14T00:00:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:17 smithi007 bash[22722]: cluster 2024-09-14T00:00:15.954396+0000 mgr.a (mgr.14355) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:17 smithi131 bash[24745]: cluster 2024-09-14T00:00:15.954396+0000 mgr.a (mgr.14355) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:17 smithi171 bash[25040]: cluster 2024-09-14T00:00:15.954396+0000 mgr.a (mgr.14355) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 82 op/s 2024-09-14T00:00:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:18.895 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:18.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:19 smithi007 bash[22722]: cluster 2024-09-14T00:00:17.955202+0000 mgr.a (mgr.14355) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:19.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:19 smithi131 bash[24745]: cluster 2024-09-14T00:00:17.955202+0000 mgr.a (mgr.14355) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:19 smithi171 bash[25040]: cluster 2024-09-14T00:00:17.955202+0000 mgr.a (mgr.14355) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:20 smithi131 bash[24745]: audit 2024-09-14T00:00:18.463159+0000 mgr.a (mgr.14355) 4300 : audit [DBG] from='client.103119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:20 smithi171 bash[25040]: audit 2024-09-14T00:00:18.463159+0000 mgr.a (mgr.14355) 4300 : audit [DBG] from='client.103119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:20 smithi007 bash[22722]: audit 2024-09-14T00:00:18.463159+0000 mgr.a (mgr.14355) 4300 : audit [DBG] from='client.103119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:21 smithi131 bash[24745]: cluster 2024-09-14T00:00:19.956091+0000 mgr.a (mgr.14355) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:21 smithi171 bash[25040]: cluster 2024-09-14T00:00:19.956091+0000 mgr.a (mgr.14355) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:21 smithi007 bash[22722]: cluster 2024-09-14T00:00:19.956091+0000 mgr.a (mgr.14355) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:23 smithi131 bash[24745]: cluster 2024-09-14T00:00:21.958406+0000 mgr.a (mgr.14355) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:23 smithi171 bash[25040]: cluster 2024-09-14T00:00:21.958406+0000 mgr.a (mgr.14355) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:23 smithi007 bash[22722]: cluster 2024-09-14T00:00:21.958406+0000 mgr.a (mgr.14355) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:23.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:23.898 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:24.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:24.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:24.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:25 smithi131 bash[24745]: cluster 2024-09-14T00:00:23.959144+0000 mgr.a (mgr.14355) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:25 smithi131 bash[24745]: audit 2024-09-14T00:00:24.229842+0000 mgr.a (mgr.14355) 4304 : audit [DBG] from='client.103194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:25 smithi171 bash[25040]: cluster 2024-09-14T00:00:23.959144+0000 mgr.a (mgr.14355) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:25 smithi171 bash[25040]: audit 2024-09-14T00:00:24.229842+0000 mgr.a (mgr.14355) 4304 : audit [DBG] from='client.103194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:25 smithi007 bash[22722]: cluster 2024-09-14T00:00:23.959144+0000 mgr.a (mgr.14355) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:25 smithi007 bash[22722]: audit 2024-09-14T00:00:24.229842+0000 mgr.a (mgr.14355) 4304 : audit [DBG] from='client.103194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:27 smithi131 bash[24745]: cluster 2024-09-14T00:00:25.961423+0000 mgr.a (mgr.14355) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:27 smithi171 bash[25040]: cluster 2024-09-14T00:00:25.961423+0000 mgr.a (mgr.14355) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:27 smithi007 bash[22722]: cluster 2024-09-14T00:00:25.961423+0000 mgr.a (mgr.14355) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:29 smithi131 bash[24745]: cluster 2024-09-14T00:00:27.962174+0000 mgr.a (mgr.14355) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:29 smithi171 bash[25040]: cluster 2024-09-14T00:00:27.962174+0000 mgr.a (mgr.14355) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:29 smithi007 bash[22722]: cluster 2024-09-14T00:00:27.962174+0000 mgr.a (mgr.14355) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:30.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:30.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:30.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:30.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:30.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:31 smithi131 bash[24745]: cluster 2024-09-14T00:00:29.962941+0000 mgr.a (mgr.14355) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:31 smithi131 bash[24745]: audit 2024-09-14T00:00:29.981255+0000 mgr.a (mgr.14355) 4308 : audit [DBG] from='client.103272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:31 smithi171 bash[25040]: cluster 2024-09-14T00:00:29.962941+0000 mgr.a (mgr.14355) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:31 smithi171 bash[25040]: audit 2024-09-14T00:00:29.981255+0000 mgr.a (mgr.14355) 4308 : audit [DBG] from='client.103272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:31 smithi007 bash[22722]: cluster 2024-09-14T00:00:29.962941+0000 mgr.a (mgr.14355) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:31 smithi007 bash[22722]: audit 2024-09-14T00:00:29.981255+0000 mgr.a (mgr.14355) 4308 : audit [DBG] from='client.103272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:33 smithi131 bash[24745]: cluster 2024-09-14T00:00:31.965372+0000 mgr.a (mgr.14355) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:00:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:33 smithi131 bash[24745]: audit 2024-09-14T00:00:32.384314+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:00:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:33 smithi131 bash[24745]: audit 2024-09-14T00:00:33.006251+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:33 smithi131 bash[24745]: audit 2024-09-14T00:00:33.010818+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:33 smithi171 bash[25040]: cluster 2024-09-14T00:00:31.965372+0000 mgr.a (mgr.14355) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:00:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:33 smithi171 bash[25040]: audit 2024-09-14T00:00:32.384314+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:00:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:33 smithi171 bash[25040]: audit 2024-09-14T00:00:33.006251+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:33 smithi171 bash[25040]: audit 2024-09-14T00:00:33.010818+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:33 smithi007 bash[22722]: cluster 2024-09-14T00:00:31.965372+0000 mgr.a (mgr.14355) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:00:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:33 smithi007 bash[22722]: audit 2024-09-14T00:00:32.384314+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:00:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:33 smithi007 bash[22722]: audit 2024-09-14T00:00:33.006251+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:33 smithi007 bash[22722]: audit 2024-09-14T00:00:33.010818+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:34.518 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22722]: audit 2024-09-14T00:00:33.796992+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:00:34.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22722]: audit 2024-09-14T00:00:33.798240+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:00:34.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22722]: audit 2024-09-14T00:00:33.806480+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:34.519 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22722]: audit 2024-09-14T00:00:33.811147+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:34 smithi131 bash[24745]: audit 2024-09-14T00:00:33.796992+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:34 smithi131 bash[24745]: audit 2024-09-14T00:00:33.798240+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:34 smithi131 bash[24745]: audit 2024-09-14T00:00:33.806480+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:34 smithi131 bash[24745]: audit 2024-09-14T00:00:33.811147+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:34 smithi171 bash[25040]: audit 2024-09-14T00:00:33.796992+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:34 smithi171 bash[25040]: audit 2024-09-14T00:00:33.798240+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:34 smithi171 bash[25040]: audit 2024-09-14T00:00:33.806480+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:34 smithi171 bash[25040]: audit 2024-09-14T00:00:33.811147+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:34.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22972]: debug 2024-09-14T00:00:34.517+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:00:34.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:00:34 smithi007 bash[22972]: debug 2024-09-14T00:00:34.517+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:00:35.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:35.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:35.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:35 smithi131 bash[24745]: audit 2024-09-14T00:00:33.813366+0000 mgr.a (mgr.14355) 4310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:35 smithi131 bash[24745]: cluster 2024-09-14T00:00:33.965922+0000 mgr.a (mgr.14355) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T00:00:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:35 smithi171 bash[25040]: audit 2024-09-14T00:00:33.813366+0000 mgr.a (mgr.14355) 4310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:35 smithi171 bash[25040]: cluster 2024-09-14T00:00:33.965922+0000 mgr.a (mgr.14355) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T00:00:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:35 smithi007 bash[22722]: audit 2024-09-14T00:00:33.813366+0000 mgr.a (mgr.14355) 4310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:00:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:35 smithi007 bash[22722]: cluster 2024-09-14T00:00:33.965922+0000 mgr.a (mgr.14355) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T00:00:36.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:36.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:36.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:36 smithi131 bash[24745]: audit 2024-09-14T00:00:34.518576+0000 mgr.a (mgr.14355) 4312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:00:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:36 smithi131 bash[24745]: cephadm 2024-09-14T00:00:34.519965+0000 mgr.a (mgr.14355) 4313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:00:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:36 smithi171 bash[25040]: audit 2024-09-14T00:00:34.518576+0000 mgr.a (mgr.14355) 4312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:00:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:36 smithi171 bash[25040]: cephadm 2024-09-14T00:00:34.519965+0000 mgr.a (mgr.14355) 4313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:00:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:36 smithi007 bash[22722]: audit 2024-09-14T00:00:34.518576+0000 mgr.a (mgr.14355) 4312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:00:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:36 smithi007 bash[22722]: cephadm 2024-09-14T00:00:34.519965+0000 mgr.a (mgr.14355) 4313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:00:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:37 smithi131 bash[24745]: audit 2024-09-14T00:00:35.756076+0000 mgr.a (mgr.14355) 4314 : audit [DBG] from='client.103458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:37 smithi131 bash[24745]: cluster 2024-09-14T00:00:35.967170+0000 mgr.a (mgr.14355) 4315 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:37 smithi171 bash[25040]: audit 2024-09-14T00:00:35.756076+0000 mgr.a (mgr.14355) 4314 : audit [DBG] from='client.103458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:37 smithi171 bash[25040]: cluster 2024-09-14T00:00:35.967170+0000 mgr.a (mgr.14355) 4315 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:37 smithi007 bash[22722]: audit 2024-09-14T00:00:35.756076+0000 mgr.a (mgr.14355) 4314 : audit [DBG] from='client.103458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:37 smithi007 bash[22722]: cluster 2024-09-14T00:00:35.967170+0000 mgr.a (mgr.14355) 4315 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:39 smithi131 bash[24745]: cluster 2024-09-14T00:00:37.967994+0000 mgr.a (mgr.14355) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:39 smithi171 bash[25040]: cluster 2024-09-14T00:00:37.967994+0000 mgr.a (mgr.14355) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:39 smithi007 bash[22722]: cluster 2024-09-14T00:00:37.967994+0000 mgr.a (mgr.14355) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:41.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:41 smithi131 bash[24745]: cluster 2024-09-14T00:00:39.968782+0000 mgr.a (mgr.14355) 4317 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:41 smithi171 bash[25040]: cluster 2024-09-14T00:00:39.968782+0000 mgr.a (mgr.14355) 4317 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:41 smithi007 bash[22722]: cluster 2024-09-14T00:00:39.968782+0000 mgr.a (mgr.14355) 4317 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:41.962 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:41.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:41.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:41.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:41.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:43 smithi131 bash[24745]: audit 2024-09-14T00:00:41.516381+0000 mgr.a (mgr.14355) 4318 : audit [DBG] from='client.103536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:43 smithi131 bash[24745]: cluster 2024-09-14T00:00:41.970126+0000 mgr.a (mgr.14355) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:43 smithi171 bash[25040]: audit 2024-09-14T00:00:41.516381+0000 mgr.a (mgr.14355) 4318 : audit [DBG] from='client.103536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:43 smithi171 bash[25040]: cluster 2024-09-14T00:00:41.970126+0000 mgr.a (mgr.14355) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:43 smithi007 bash[22722]: audit 2024-09-14T00:00:41.516381+0000 mgr.a (mgr.14355) 4318 : audit [DBG] from='client.103536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:43 smithi007 bash[22722]: cluster 2024-09-14T00:00:41.970126+0000 mgr.a (mgr.14355) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:45 smithi131 bash[24745]: cluster 2024-09-14T00:00:43.970885+0000 mgr.a (mgr.14355) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:45 smithi171 bash[25040]: cluster 2024-09-14T00:00:43.970885+0000 mgr.a (mgr.14355) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:45 smithi007 bash[22722]: cluster 2024-09-14T00:00:43.970885+0000 mgr.a (mgr.14355) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:00:46.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:46.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:46.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:47 smithi131 bash[24745]: cluster 2024-09-14T00:00:45.972832+0000 mgr.a (mgr.14355) 4321 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:47 smithi171 bash[25040]: cluster 2024-09-14T00:00:45.972832+0000 mgr.a (mgr.14355) 4321 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:47 smithi007 bash[22722]: cluster 2024-09-14T00:00:45.972832+0000 mgr.a (mgr.14355) 4321 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:00:47.740 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:47.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:48 smithi131 bash[24745]: audit 2024-09-14T00:00:47.299502+0000 mgr.a (mgr.14355) 4322 : audit [DBG] from='client.103614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:48 smithi171 bash[25040]: audit 2024-09-14T00:00:47.299502+0000 mgr.a (mgr.14355) 4322 : audit [DBG] from='client.103614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:48 smithi007 bash[22722]: audit 2024-09-14T00:00:47.299502+0000 mgr.a (mgr.14355) 4322 : audit [DBG] from='client.103614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:49 smithi171 bash[25040]: cluster 2024-09-14T00:00:47.973776+0000 mgr.a (mgr.14355) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:49 smithi007 bash[22722]: cluster 2024-09-14T00:00:47.973776+0000 mgr.a (mgr.14355) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:49 smithi131 bash[24745]: cluster 2024-09-14T00:00:47.973776+0000 mgr.a (mgr.14355) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:51 smithi007 bash[22722]: cluster 2024-09-14T00:00:49.974595+0000 mgr.a (mgr.14355) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:51 smithi131 bash[24745]: cluster 2024-09-14T00:00:49.974595+0000 mgr.a (mgr.14355) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:51 smithi171 bash[25040]: cluster 2024-09-14T00:00:49.974595+0000 mgr.a (mgr.14355) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:52.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:52.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:53.519 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:53.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:53 smithi007 bash[22722]: cluster 2024-09-14T00:00:51.977225+0000 mgr.a (mgr.14355) 4325 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:53 smithi131 bash[24745]: cluster 2024-09-14T00:00:51.977225+0000 mgr.a (mgr.14355) 4325 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:53 smithi171 bash[25040]: cluster 2024-09-14T00:00:51.977225+0000 mgr.a (mgr.14355) 4325 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:54 smithi007 bash[22722]: audit 2024-09-14T00:00:53.075073+0000 mgr.a (mgr.14355) 4326 : audit [DBG] from='client.103686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:54 smithi131 bash[24745]: audit 2024-09-14T00:00:53.075073+0000 mgr.a (mgr.14355) 4326 : audit [DBG] from='client.103686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:54 smithi171 bash[25040]: audit 2024-09-14T00:00:53.075073+0000 mgr.a (mgr.14355) 4326 : audit [DBG] from='client.103686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:00:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:55 smithi007 bash[22722]: cluster 2024-09-14T00:00:53.978130+0000 mgr.a (mgr.14355) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:55 smithi131 bash[24745]: cluster 2024-09-14T00:00:53.978130+0000 mgr.a (mgr.14355) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:55 smithi171 bash[25040]: cluster 2024-09-14T00:00:53.978130+0000 mgr.a (mgr.14355) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:57 smithi007 bash[22722]: cluster 2024-09-14T00:00:55.980403+0000 mgr.a (mgr.14355) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:57 smithi131 bash[24745]: cluster 2024-09-14T00:00:55.980403+0000 mgr.a (mgr.14355) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:57 smithi171 bash[25040]: cluster 2024-09-14T00:00:55.980403+0000 mgr.a (mgr.14355) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:00:58.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:00:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:00:58.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:00:59.268 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:00:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:00:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:00:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:00:59.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:00:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:00:59 smithi007 bash[22722]: cluster 2024-09-14T00:00:57.981133+0000 mgr.a (mgr.14355) 4329 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:00:59 smithi131 bash[24745]: cluster 2024-09-14T00:00:57.981133+0000 mgr.a (mgr.14355) 4329 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:00:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:00:59 smithi171 bash[25040]: cluster 2024-09-14T00:00:57.981133+0000 mgr.a (mgr.14355) 4329 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:00 smithi007 bash[22722]: audit 2024-09-14T00:00:58.852306+0000 mgr.a (mgr.14355) 4330 : audit [DBG] from='client.103764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:00 smithi131 bash[24745]: audit 2024-09-14T00:00:58.852306+0000 mgr.a (mgr.14355) 4330 : audit [DBG] from='client.103764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:00 smithi171 bash[25040]: audit 2024-09-14T00:00:58.852306+0000 mgr.a (mgr.14355) 4330 : audit [DBG] from='client.103764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:01 smithi007 bash[22722]: cluster 2024-09-14T00:00:59.981966+0000 mgr.a (mgr.14355) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:01 smithi131 bash[24745]: cluster 2024-09-14T00:00:59.981966+0000 mgr.a (mgr.14355) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:01 smithi171 bash[25040]: cluster 2024-09-14T00:00:59.981966+0000 mgr.a (mgr.14355) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:03 smithi007 bash[22722]: cluster 2024-09-14T00:01:01.984213+0000 mgr.a (mgr.14355) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:03 smithi131 bash[24745]: cluster 2024-09-14T00:01:01.984213+0000 mgr.a (mgr.14355) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:03 smithi171 bash[25040]: cluster 2024-09-14T00:01:01.984213+0000 mgr.a (mgr.14355) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:05.039 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:05.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:05 smithi007 bash[22722]: cluster 2024-09-14T00:01:03.984963+0000 mgr.a (mgr.14355) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:05 smithi131 bash[24745]: cluster 2024-09-14T00:01:03.984963+0000 mgr.a (mgr.14355) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:05 smithi171 bash[25040]: cluster 2024-09-14T00:01:03.984963+0000 mgr.a (mgr.14355) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:06 smithi007 bash[22722]: audit 2024-09-14T00:01:04.605793+0000 mgr.a (mgr.14355) 4334 : audit [DBG] from='client.103836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:06 smithi131 bash[24745]: audit 2024-09-14T00:01:04.605793+0000 mgr.a (mgr.14355) 4334 : audit [DBG] from='client.103836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:06 smithi171 bash[25040]: audit 2024-09-14T00:01:04.605793+0000 mgr.a (mgr.14355) 4334 : audit [DBG] from='client.103836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:07 smithi007 bash[22722]: cluster 2024-09-14T00:01:05.987290+0000 mgr.a (mgr.14355) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:07 smithi131 bash[24745]: cluster 2024-09-14T00:01:05.987290+0000 mgr.a (mgr.14355) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:07 smithi171 bash[25040]: cluster 2024-09-14T00:01:05.987290+0000 mgr.a (mgr.14355) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:09 smithi007 bash[22722]: cluster 2024-09-14T00:01:07.988072+0000 mgr.a (mgr.14355) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:09 smithi131 bash[24745]: cluster 2024-09-14T00:01:07.988072+0000 mgr.a (mgr.14355) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:09 smithi171 bash[25040]: cluster 2024-09-14T00:01:07.988072+0000 mgr.a (mgr.14355) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:10.820 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:10.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:11 smithi007 bash[22722]: cluster 2024-09-14T00:01:09.988811+0000 mgr.a (mgr.14355) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:11 smithi007 bash[22722]: audit 2024-09-14T00:01:10.375124+0000 mgr.a (mgr.14355) 4338 : audit [DBG] from='client.103914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:11 smithi131 bash[24745]: cluster 2024-09-14T00:01:09.988811+0000 mgr.a (mgr.14355) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:11 smithi131 bash[24745]: audit 2024-09-14T00:01:10.375124+0000 mgr.a (mgr.14355) 4338 : audit [DBG] from='client.103914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:11 smithi171 bash[25040]: cluster 2024-09-14T00:01:09.988811+0000 mgr.a (mgr.14355) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:11 smithi171 bash[25040]: audit 2024-09-14T00:01:10.375124+0000 mgr.a (mgr.14355) 4338 : audit [DBG] from='client.103914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:13 smithi007 bash[22722]: cluster 2024-09-14T00:01:11.991479+0000 mgr.a (mgr.14355) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:13 smithi131 bash[24745]: cluster 2024-09-14T00:01:11.991479+0000 mgr.a (mgr.14355) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:13 smithi171 bash[25040]: cluster 2024-09-14T00:01:11.991479+0000 mgr.a (mgr.14355) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:15 smithi007 bash[22722]: cluster 2024-09-14T00:01:13.992269+0000 mgr.a (mgr.14355) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:15 smithi131 bash[24745]: cluster 2024-09-14T00:01:13.992269+0000 mgr.a (mgr.14355) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:15 smithi171 bash[25040]: cluster 2024-09-14T00:01:13.992269+0000 mgr.a (mgr.14355) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:16.578 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:17 smithi007 bash[22722]: cluster 2024-09-14T00:01:15.994216+0000 mgr.a (mgr.14355) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:17 smithi007 bash[22722]: audit 2024-09-14T00:01:16.159195+0000 mgr.a (mgr.14355) 4342 : audit [DBG] from='client.103992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:17 smithi131 bash[24745]: cluster 2024-09-14T00:01:15.994216+0000 mgr.a (mgr.14355) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:17 smithi131 bash[24745]: audit 2024-09-14T00:01:16.159195+0000 mgr.a (mgr.14355) 4342 : audit [DBG] from='client.103992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:17 smithi171 bash[25040]: cluster 2024-09-14T00:01:15.994216+0000 mgr.a (mgr.14355) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:17 smithi171 bash[25040]: audit 2024-09-14T00:01:16.159195+0000 mgr.a (mgr.14355) 4342 : audit [DBG] from='client.103992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:19 smithi007 bash[22722]: cluster 2024-09-14T00:01:17.995146+0000 mgr.a (mgr.14355) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:19 smithi131 bash[24745]: cluster 2024-09-14T00:01:17.995146+0000 mgr.a (mgr.14355) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:19 smithi171 bash[25040]: cluster 2024-09-14T00:01:17.995146+0000 mgr.a (mgr.14355) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:01:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:21 smithi007 bash[22722]: cluster 2024-09-14T00:01:19.995914+0000 mgr.a (mgr.14355) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:01:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:21 smithi131 bash[24745]: cluster 2024-09-14T00:01:19.995914+0000 mgr.a (mgr.14355) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:01:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:21 smithi171 bash[25040]: cluster 2024-09-14T00:01:19.995914+0000 mgr.a (mgr.14355) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:01:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:22.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:22.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:22.324 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:23 smithi007 bash[22722]: audit 2024-09-14T00:01:21.908661+0000 mgr.a (mgr.14355) 4345 : audit [DBG] from='client.104064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:23 smithi007 bash[22722]: cluster 2024-09-14T00:01:21.997279+0000 mgr.a (mgr.14355) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:23 smithi131 bash[24745]: audit 2024-09-14T00:01:21.908661+0000 mgr.a (mgr.14355) 4345 : audit [DBG] from='client.104064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:23 smithi131 bash[24745]: cluster 2024-09-14T00:01:21.997279+0000 mgr.a (mgr.14355) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:23 smithi171 bash[25040]: audit 2024-09-14T00:01:21.908661+0000 mgr.a (mgr.14355) 4345 : audit [DBG] from='client.104064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:23 smithi171 bash[25040]: cluster 2024-09-14T00:01:21.997279+0000 mgr.a (mgr.14355) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:25 smithi007 bash[22722]: cluster 2024-09-14T00:01:23.998150+0000 mgr.a (mgr.14355) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:25 smithi131 bash[24745]: cluster 2024-09-14T00:01:23.998150+0000 mgr.a (mgr.14355) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:25 smithi171 bash[25040]: cluster 2024-09-14T00:01:23.998150+0000 mgr.a (mgr.14355) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:27.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:27 smithi007 bash[22722]: cluster 2024-09-14T00:01:26.000437+0000 mgr.a (mgr.14355) 4348 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:27 smithi131 bash[24745]: cluster 2024-09-14T00:01:26.000437+0000 mgr.a (mgr.14355) 4348 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:27 smithi171 bash[25040]: cluster 2024-09-14T00:01:26.000437+0000 mgr.a (mgr.14355) 4348 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:28.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:29 smithi007 bash[22722]: audit 2024-09-14T00:01:27.659311+0000 mgr.a (mgr.14355) 4349 : audit [DBG] from='client.104142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:29 smithi007 bash[22722]: cluster 2024-09-14T00:01:28.002265+0000 mgr.a (mgr.14355) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:29 smithi131 bash[24745]: audit 2024-09-14T00:01:27.659311+0000 mgr.a (mgr.14355) 4349 : audit [DBG] from='client.104142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:29 smithi131 bash[24745]: cluster 2024-09-14T00:01:28.002265+0000 mgr.a (mgr.14355) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:29 smithi171 bash[25040]: audit 2024-09-14T00:01:27.659311+0000 mgr.a (mgr.14355) 4349 : audit [DBG] from='client.104142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:29 smithi171 bash[25040]: cluster 2024-09-14T00:01:28.002265+0000 mgr.a (mgr.14355) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:31 smithi007 bash[22722]: cluster 2024-09-14T00:01:30.003038+0000 mgr.a (mgr.14355) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:31 smithi131 bash[24745]: cluster 2024-09-14T00:01:30.003038+0000 mgr.a (mgr.14355) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:31 smithi171 bash[25040]: cluster 2024-09-14T00:01:30.003038+0000 mgr.a (mgr.14355) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:33.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:33.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:33 smithi007 bash[22722]: cluster 2024-09-14T00:01:32.005240+0000 mgr.a (mgr.14355) 4352 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:33 smithi131 bash[24745]: cluster 2024-09-14T00:01:32.005240+0000 mgr.a (mgr.14355) 4352 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:33 smithi171 bash[25040]: cluster 2024-09-14T00:01:32.005240+0000 mgr.a (mgr.14355) 4352 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:33.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:33.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:33.438708+0000 mgr.a (mgr.14355) 4353 : audit [DBG] from='client.104220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: cluster 2024-09-14T00:01:34.006066+0000 mgr.a (mgr.14355) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:34.569686+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:35.177510+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:35.182494+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:35.187649+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:35 smithi007 bash[22722]: audit 2024-09-14T00:01:35.192887+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:33.438708+0000 mgr.a (mgr.14355) 4353 : audit [DBG] from='client.104220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: cluster 2024-09-14T00:01:34.006066+0000 mgr.a (mgr.14355) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:34.569686+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:35.177510+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:35.182494+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:35.187649+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:35 smithi131 bash[24745]: audit 2024-09-14T00:01:35.192887+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:33.438708+0000 mgr.a (mgr.14355) 4353 : audit [DBG] from='client.104220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: cluster 2024-09-14T00:01:34.006066+0000 mgr.a (mgr.14355) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:34.569686+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:35.177510+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:35.182494+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:35.187649+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:35 smithi171 bash[25040]: audit 2024-09-14T00:01:35.192887+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:36.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22722]: audit 2024-09-14T00:01:35.927831+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:01:36.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22722]: audit 2024-09-14T00:01:35.929698+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:01:36.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22722]: audit 2024-09-14T00:01:35.938757+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:36.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22722]: audit 2024-09-14T00:01:35.944164+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:36 smithi131 bash[24745]: audit 2024-09-14T00:01:35.927831+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:01:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:36 smithi131 bash[24745]: audit 2024-09-14T00:01:35.929698+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:01:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:36 smithi131 bash[24745]: audit 2024-09-14T00:01:35.938757+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:36 smithi131 bash[24745]: audit 2024-09-14T00:01:35.944164+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:36 smithi171 bash[25040]: audit 2024-09-14T00:01:35.927831+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:01:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:36 smithi171 bash[25040]: audit 2024-09-14T00:01:35.929698+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:01:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:36 smithi171 bash[25040]: audit 2024-09-14T00:01:35.938757+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:36 smithi171 bash[25040]: audit 2024-09-14T00:01:35.944164+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22972]: debug 2024-09-14T00:01:36.668+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:01:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:01:36 smithi007 bash[22972]: debug 2024-09-14T00:01:36.668+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:01:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:37 smithi007 bash[22722]: audit 2024-09-14T00:01:35.945544+0000 mgr.a (mgr.14355) 4355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:37 smithi007 bash[22722]: cluster 2024-09-14T00:01:36.008843+0000 mgr.a (mgr.14355) 4356 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:37 smithi007 bash[22722]: audit 2024-09-14T00:01:37.344546+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:37 smithi131 bash[24745]: audit 2024-09-14T00:01:35.945544+0000 mgr.a (mgr.14355) 4355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:37 smithi131 bash[24745]: cluster 2024-09-14T00:01:36.008843+0000 mgr.a (mgr.14355) 4356 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:37 smithi131 bash[24745]: audit 2024-09-14T00:01:37.344546+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:37 smithi171 bash[25040]: audit 2024-09-14T00:01:35.945544+0000 mgr.a (mgr.14355) 4355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:01:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:37 smithi171 bash[25040]: cluster 2024-09-14T00:01:36.008843+0000 mgr.a (mgr.14355) 4356 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:01:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:37 smithi171 bash[25040]: audit 2024-09-14T00:01:37.344546+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:38 smithi007 bash[22722]: audit 2024-09-14T00:01:36.672236+0000 mgr.a (mgr.14355) 4357 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:01:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:38 smithi007 bash[22722]: cephadm 2024-09-14T00:01:36.673362+0000 mgr.a (mgr.14355) 4358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:01:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:38 smithi007 bash[22722]: audit 2024-09-14T00:01:38.304915+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:38 smithi131 bash[24745]: audit 2024-09-14T00:01:36.672236+0000 mgr.a (mgr.14355) 4357 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:01:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:38 smithi131 bash[24745]: cephadm 2024-09-14T00:01:36.673362+0000 mgr.a (mgr.14355) 4358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:01:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:38 smithi131 bash[24745]: audit 2024-09-14T00:01:38.304915+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:38 smithi171 bash[25040]: audit 2024-09-14T00:01:36.672236+0000 mgr.a (mgr.14355) 4357 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:01:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:38 smithi171 bash[25040]: cephadm 2024-09-14T00:01:36.673362+0000 mgr.a (mgr.14355) 4358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:01:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:38 smithi171 bash[25040]: audit 2024-09-14T00:01:38.304915+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:40.478 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:40.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:40 smithi131 bash[24745]: cluster 2024-09-14T00:01:38.009724+0000 mgr.a (mgr.14355) 4359 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:40 smithi131 bash[24745]: audit 2024-09-14T00:01:39.306088+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:40 smithi131 bash[24745]: audit 2024-09-14T00:01:39.307784+0000 mon.a (mon.0) 1253 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:40 smithi171 bash[25040]: cluster 2024-09-14T00:01:38.009724+0000 mgr.a (mgr.14355) 4359 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:40 smithi171 bash[25040]: audit 2024-09-14T00:01:39.306088+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:40 smithi171 bash[25040]: audit 2024-09-14T00:01:39.307784+0000 mon.a (mon.0) 1253 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:40 smithi007 bash[22722]: cluster 2024-09-14T00:01:38.009724+0000 mgr.a (mgr.14355) 4359 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:40 smithi007 bash[22722]: audit 2024-09-14T00:01:39.306088+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:01:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:40 smithi007 bash[22722]: audit 2024-09-14T00:01:39.307784+0000 mon.a (mon.0) 1253 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:39.215982+0000 mgr.a (mgr.14355) 4360 : audit [DBG] from='client.104397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: cluster 2024-09-14T00:01:40.010633+0000 mgr.a (mgr.14355) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.233173+0000 mon.a (mon.0) 1254 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.234369+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.234684+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.238727+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.242846+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.242898+0000 mon.c (mon.1) 12 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.242972+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:40.243110+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:41.098341+0000 mon.c (mon.1) 13 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:41.104104+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:41.104437+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:42 smithi131 bash[24745]: audit 2024-09-14T00:01:41.104931+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:39.215982+0000 mgr.a (mgr.14355) 4360 : audit [DBG] from='client.104397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: cluster 2024-09-14T00:01:40.010633+0000 mgr.a (mgr.14355) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.233173+0000 mon.a (mon.0) 1254 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.234369+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.234684+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.238727+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.242846+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.242898+0000 mon.c (mon.1) 12 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.242972+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:40.243110+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:41.098341+0000 mon.c (mon.1) 13 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:41.104104+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:41.104437+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:42 smithi171 bash[25040]: audit 2024-09-14T00:01:41.104931+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:39.215982+0000 mgr.a (mgr.14355) 4360 : audit [DBG] from='client.104397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: cluster 2024-09-14T00:01:40.010633+0000 mgr.a (mgr.14355) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.233173+0000 mon.a (mon.0) 1254 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.234369+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.234684+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.238727+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.242846+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.242898+0000 mon.c (mon.1) 12 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.242972+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:40.243110+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:41.098341+0000 mon.c (mon.1) 13 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:42.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:41.104104+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-14T00:01:42.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:41.104437+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-14T00:01:42.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:42 smithi007 bash[22722]: audit 2024-09-14T00:01:41.104931+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-14T00:01:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:43 smithi131 bash[24745]: audit 2024-09-14T00:01:41.103791+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:43 smithi131 bash[24745]: cluster 2024-09-14T00:01:42.013040+0000 mgr.a (mgr.14355) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-14T00:01:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:43 smithi131 bash[24745]: audit 2024-09-14T00:01:42.014957+0000 mon.b (mon.2) 22 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:43 smithi171 bash[25040]: audit 2024-09-14T00:01:41.103791+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:43 smithi171 bash[25040]: cluster 2024-09-14T00:01:42.013040+0000 mgr.a (mgr.14355) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-14T00:01:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:43 smithi171 bash[25040]: audit 2024-09-14T00:01:42.014957+0000 mon.b (mon.2) 22 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:43 smithi007 bash[22722]: audit 2024-09-14T00:01:41.103791+0000 mon.b (mon.2) 21 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-14T00:01:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:43 smithi007 bash[22722]: cluster 2024-09-14T00:01:42.013040+0000 mgr.a (mgr.14355) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 15 op/s 2024-09-14T00:01:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:43 smithi007 bash[22722]: audit 2024-09-14T00:01:42.014957+0000 mon.b (mon.2) 22 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-14T00:01:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:45 smithi171 bash[25040]: cluster 2024-09-14T00:01:44.013858+0000 mgr.a (mgr.14355) 4363 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-09-14T00:01:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:45 smithi007 bash[22722]: cluster 2024-09-14T00:01:44.013858+0000 mgr.a (mgr.14355) 4363 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-09-14T00:01:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:45 smithi131 bash[24745]: cluster 2024-09-14T00:01:44.013858+0000 mgr.a (mgr.14355) 4363 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 98 KiB/s wr, 14 op/s 2024-09-14T00:01:46.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:46.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:46.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:46.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:46.222 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:47 smithi171 bash[25040]: audit 2024-09-14T00:01:45.810166+0000 mgr.a (mgr.14355) 4364 : audit [DBG] from='client.104475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:47 smithi171 bash[25040]: cluster 2024-09-14T00:01:46.015222+0000 mgr.a (mgr.14355) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:47 smithi007 bash[22722]: audit 2024-09-14T00:01:45.810166+0000 mgr.a (mgr.14355) 4364 : audit [DBG] from='client.104475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:47 smithi007 bash[22722]: cluster 2024-09-14T00:01:46.015222+0000 mgr.a (mgr.14355) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:47 smithi131 bash[24745]: audit 2024-09-14T00:01:45.810166+0000 mgr.a (mgr.14355) 4364 : audit [DBG] from='client.104475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:47 smithi131 bash[24745]: cluster 2024-09-14T00:01:46.015222+0000 mgr.a (mgr.14355) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:49 smithi171 bash[25040]: cluster 2024-09-14T00:01:48.016216+0000 mgr.a (mgr.14355) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:49 smithi007 bash[22722]: cluster 2024-09-14T00:01:48.016216+0000 mgr.a (mgr.14355) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:49 smithi131 bash[24745]: cluster 2024-09-14T00:01:48.016216+0000 mgr.a (mgr.14355) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:51.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:51.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:51.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:51 smithi007 bash[22722]: cluster 2024-09-14T00:01:50.017010+0000 mgr.a (mgr.14355) 4367 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:51 smithi131 bash[24745]: cluster 2024-09-14T00:01:50.017010+0000 mgr.a (mgr.14355) 4367 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:51 smithi171 bash[25040]: cluster 2024-09-14T00:01:50.017010+0000 mgr.a (mgr.14355) 4367 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 120 KiB/s wr, 16 op/s 2024-09-14T00:01:51.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:51.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:51.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:51.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:51.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:53 smithi007 bash[22722]: audit 2024-09-14T00:01:51.553309+0000 mgr.a (mgr.14355) 4368 : audit [DBG] from='client.104547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:53 smithi007 bash[22722]: cluster 2024-09-14T00:01:52.018877+0000 mgr.a (mgr.14355) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:53 smithi131 bash[24745]: audit 2024-09-14T00:01:51.553309+0000 mgr.a (mgr.14355) 4368 : audit [DBG] from='client.104547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:53 smithi131 bash[24745]: cluster 2024-09-14T00:01:52.018877+0000 mgr.a (mgr.14355) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:53 smithi171 bash[25040]: audit 2024-09-14T00:01:51.553309+0000 mgr.a (mgr.14355) 4368 : audit [DBG] from='client.104547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:53 smithi171 bash[25040]: cluster 2024-09-14T00:01:52.018877+0000 mgr.a (mgr.14355) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 120 KiB/s wr, 17 op/s 2024-09-14T00:01:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:55 smithi007 bash[22722]: cluster 2024-09-14T00:01:54.019629+0000 mgr.a (mgr.14355) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-14T00:01:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:55 smithi131 bash[24745]: cluster 2024-09-14T00:01:54.019629+0000 mgr.a (mgr.14355) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-14T00:01:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:55 smithi171 bash[25040]: cluster 2024-09-14T00:01:54.019629+0000 mgr.a (mgr.14355) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-14T00:01:56.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:01:56.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:01:56.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:01:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:57 smithi007 bash[22722]: cluster 2024-09-14T00:01:56.021627+0000 mgr.a (mgr.14355) 4371 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 22 KiB/s wr, 4 op/s 2024-09-14T00:01:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:57 smithi131 bash[24745]: cluster 2024-09-14T00:01:56.021627+0000 mgr.a (mgr.14355) 4371 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 22 KiB/s wr, 4 op/s 2024-09-14T00:01:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:57 smithi171 bash[25040]: cluster 2024-09-14T00:01:56.021627+0000 mgr.a (mgr.14355) 4371 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 22 KiB/s wr, 4 op/s 2024-09-14T00:01:57.761 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:01:57.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:01:57.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:01:57.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:01:57.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:01:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:58 smithi007 bash[22722]: audit 2024-09-14T00:01:57.309856+0000 mgr.a (mgr.14355) 4372 : audit [DBG] from='client.104625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:58 smithi131 bash[24745]: audit 2024-09-14T00:01:57.309856+0000 mgr.a (mgr.14355) 4372 : audit [DBG] from='client.104625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:58 smithi171 bash[25040]: audit 2024-09-14T00:01:57.309856+0000 mgr.a (mgr.14355) 4372 : audit [DBG] from='client.104625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:01:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:01:59 smithi007 bash[22722]: cluster 2024-09-14T00:01:58.022604+0000 mgr.a (mgr.14355) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:01:59 smithi131 bash[24745]: cluster 2024-09-14T00:01:58.022604+0000 mgr.a (mgr.14355) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:01:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:01:59 smithi171 bash[25040]: cluster 2024-09-14T00:01:58.022604+0000 mgr.a (mgr.14355) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:01 smithi007 bash[22722]: cluster 2024-09-14T00:02:00.023371+0000 mgr.a (mgr.14355) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:01 smithi131 bash[24745]: cluster 2024-09-14T00:02:00.023371+0000 mgr.a (mgr.14355) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:01 smithi171 bash[25040]: cluster 2024-09-14T00:02:00.023371+0000 mgr.a (mgr.14355) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:02.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:02.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:03 smithi007 bash[22722]: cluster 2024-09-14T00:02:02.025606+0000 mgr.a (mgr.14355) 4375 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:02:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:03 smithi131 bash[24745]: cluster 2024-09-14T00:02:02.025606+0000 mgr.a (mgr.14355) 4375 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:02:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:03 smithi171 bash[25040]: cluster 2024-09-14T00:02:02.025606+0000 mgr.a (mgr.14355) 4375 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:02:03.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:04 smithi007 bash[22722]: audit 2024-09-14T00:02:03.131113+0000 mgr.a (mgr.14355) 4376 : audit [DBG] from='client.104703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:04 smithi131 bash[24745]: audit 2024-09-14T00:02:03.131113+0000 mgr.a (mgr.14355) 4376 : audit [DBG] from='client.104703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:04 smithi171 bash[25040]: audit 2024-09-14T00:02:03.131113+0000 mgr.a (mgr.14355) 4376 : audit [DBG] from='client.104703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:05 smithi007 bash[22722]: cluster 2024-09-14T00:02:04.026637+0000 mgr.a (mgr.14355) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:02:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:05 smithi131 bash[24745]: cluster 2024-09-14T00:02:04.026637+0000 mgr.a (mgr.14355) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:02:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:05 smithi171 bash[25040]: cluster 2024-09-14T00:02:04.026637+0000 mgr.a (mgr.14355) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:02:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:07 smithi007 bash[22722]: cluster 2024-09-14T00:02:06.028836+0000 mgr.a (mgr.14355) 4378 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:07 smithi131 bash[24745]: cluster 2024-09-14T00:02:06.028836+0000 mgr.a (mgr.14355) 4378 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:07 smithi171 bash[25040]: cluster 2024-09-14T00:02:06.028836+0000 mgr.a (mgr.14355) 4378 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:08.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:09.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:09.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:09 smithi007 bash[22722]: cluster 2024-09-14T00:02:08.029615+0000 mgr.a (mgr.14355) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:09 smithi131 bash[24745]: cluster 2024-09-14T00:02:08.029615+0000 mgr.a (mgr.14355) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:09 smithi171 bash[25040]: cluster 2024-09-14T00:02:08.029615+0000 mgr.a (mgr.14355) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:10 smithi007 bash[22722]: audit 2024-09-14T00:02:08.928469+0000 mgr.a (mgr.14355) 4380 : audit [DBG] from='client.104781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:10 smithi131 bash[24745]: audit 2024-09-14T00:02:08.928469+0000 mgr.a (mgr.14355) 4380 : audit [DBG] from='client.104781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:10 smithi171 bash[25040]: audit 2024-09-14T00:02:08.928469+0000 mgr.a (mgr.14355) 4380 : audit [DBG] from='client.104781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:11 smithi007 bash[22722]: cluster 2024-09-14T00:02:10.030623+0000 mgr.a (mgr.14355) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:11 smithi131 bash[24745]: cluster 2024-09-14T00:02:10.030623+0000 mgr.a (mgr.14355) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:11 smithi171 bash[25040]: cluster 2024-09-14T00:02:10.030623+0000 mgr.a (mgr.14355) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-09-14T00:02:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:13 smithi007 bash[22722]: cluster 2024-09-14T00:02:12.032897+0000 mgr.a (mgr.14355) 4382 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:13 smithi131 bash[24745]: cluster 2024-09-14T00:02:12.032897+0000 mgr.a (mgr.14355) 4382 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:13 smithi171 bash[25040]: cluster 2024-09-14T00:02:12.032897+0000 mgr.a (mgr.14355) 4382 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-09-14T00:02:14.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:14.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:14.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:15.089 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:15.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:15 smithi007 bash[22722]: cluster 2024-09-14T00:02:14.033683+0000 mgr.a (mgr.14355) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:15 smithi131 bash[24745]: cluster 2024-09-14T00:02:14.033683+0000 mgr.a (mgr.14355) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:15 smithi171 bash[25040]: cluster 2024-09-14T00:02:14.033683+0000 mgr.a (mgr.14355) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:16 smithi007 bash[22722]: audit 2024-09-14T00:02:14.686473+0000 mgr.a (mgr.14355) 4384 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:16 smithi131 bash[24745]: audit 2024-09-14T00:02:14.686473+0000 mgr.a (mgr.14355) 4384 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:16 smithi171 bash[25040]: audit 2024-09-14T00:02:14.686473+0000 mgr.a (mgr.14355) 4384 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:17 smithi007 bash[22722]: cluster 2024-09-14T00:02:16.036213+0000 mgr.a (mgr.14355) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:17 smithi131 bash[24745]: cluster 2024-09-14T00:02:16.036213+0000 mgr.a (mgr.14355) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:17 smithi171 bash[25040]: cluster 2024-09-14T00:02:16.036213+0000 mgr.a (mgr.14355) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:02:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:19 smithi007 bash[22722]: cluster 2024-09-14T00:02:18.037156+0000 mgr.a (mgr.14355) 4386 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:19 smithi131 bash[24745]: cluster 2024-09-14T00:02:18.037156+0000 mgr.a (mgr.14355) 4386 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:19 smithi171 bash[25040]: cluster 2024-09-14T00:02:18.037156+0000 mgr.a (mgr.14355) 4386 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:20.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:21 smithi007 bash[22722]: cluster 2024-09-14T00:02:20.038112+0000 mgr.a (mgr.14355) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:21 smithi007 bash[22722]: audit 2024-09-14T00:02:20.430172+0000 mgr.a (mgr.14355) 4388 : audit [DBG] from='client.104931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:21 smithi131 bash[24745]: cluster 2024-09-14T00:02:20.038112+0000 mgr.a (mgr.14355) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:21 smithi131 bash[24745]: audit 2024-09-14T00:02:20.430172+0000 mgr.a (mgr.14355) 4388 : audit [DBG] from='client.104931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:21.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:21 smithi171 bash[25040]: cluster 2024-09-14T00:02:20.038112+0000 mgr.a (mgr.14355) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:21.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:21 smithi171 bash[25040]: audit 2024-09-14T00:02:20.430172+0000 mgr.a (mgr.14355) 4388 : audit [DBG] from='client.104931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:23 smithi007 bash[22722]: cluster 2024-09-14T00:02:22.041022+0000 mgr.a (mgr.14355) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:23 smithi131 bash[24745]: cluster 2024-09-14T00:02:22.041022+0000 mgr.a (mgr.14355) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:23 smithi171 bash[25040]: cluster 2024-09-14T00:02:22.041022+0000 mgr.a (mgr.14355) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:25 smithi007 bash[22722]: cluster 2024-09-14T00:02:24.041822+0000 mgr.a (mgr.14355) 4390 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:25 smithi131 bash[24745]: cluster 2024-09-14T00:02:24.041822+0000 mgr.a (mgr.14355) 4390 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:25 smithi171 bash[25040]: cluster 2024-09-14T00:02:24.041822+0000 mgr.a (mgr.14355) 4390 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:25.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:25.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:25.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:26.645 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:26.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:26.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:26.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:26.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:27 smithi007 bash[22722]: cluster 2024-09-14T00:02:26.043800+0000 mgr.a (mgr.14355) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:27 smithi007 bash[22722]: audit 2024-09-14T00:02:26.202910+0000 mgr.a (mgr.14355) 4392 : audit [DBG] from='client.105009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:27 smithi131 bash[24745]: cluster 2024-09-14T00:02:26.043800+0000 mgr.a (mgr.14355) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:27 smithi131 bash[24745]: audit 2024-09-14T00:02:26.202910+0000 mgr.a (mgr.14355) 4392 : audit [DBG] from='client.105009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:27 smithi171 bash[25040]: cluster 2024-09-14T00:02:26.043800+0000 mgr.a (mgr.14355) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:27 smithi171 bash[25040]: audit 2024-09-14T00:02:26.202910+0000 mgr.a (mgr.14355) 4392 : audit [DBG] from='client.105009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:29 smithi007 bash[22722]: cluster 2024-09-14T00:02:28.044739+0000 mgr.a (mgr.14355) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:29 smithi131 bash[24745]: cluster 2024-09-14T00:02:28.044739+0000 mgr.a (mgr.14355) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:29 smithi171 bash[25040]: cluster 2024-09-14T00:02:28.044739+0000 mgr.a (mgr.14355) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:31 smithi007 bash[22722]: cluster 2024-09-14T00:02:30.045554+0000 mgr.a (mgr.14355) 4394 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:02:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:31 smithi131 bash[24745]: cluster 2024-09-14T00:02:30.045554+0000 mgr.a (mgr.14355) 4394 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:02:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:31 smithi171 bash[25040]: cluster 2024-09-14T00:02:30.045554+0000 mgr.a (mgr.14355) 4394 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:02:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:32.407 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:32.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:33 smithi007 bash[22722]: audit 2024-09-14T00:02:31.977795+0000 mgr.a (mgr.14355) 4395 : audit [DBG] from='client.105084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:33 smithi007 bash[22722]: cluster 2024-09-14T00:02:32.046985+0000 mgr.a (mgr.14355) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:33 smithi131 bash[24745]: audit 2024-09-14T00:02:31.977795+0000 mgr.a (mgr.14355) 4395 : audit [DBG] from='client.105084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:33 smithi131 bash[24745]: cluster 2024-09-14T00:02:32.046985+0000 mgr.a (mgr.14355) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:33 smithi171 bash[25040]: audit 2024-09-14T00:02:31.977795+0000 mgr.a (mgr.14355) 4395 : audit [DBG] from='client.105084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:33 smithi171 bash[25040]: cluster 2024-09-14T00:02:32.046985+0000 mgr.a (mgr.14355) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:35 smithi007 bash[22722]: cluster 2024-09-14T00:02:34.047931+0000 mgr.a (mgr.14355) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:35 smithi131 bash[24745]: cluster 2024-09-14T00:02:34.047931+0000 mgr.a (mgr.14355) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:35 smithi171 bash[25040]: cluster 2024-09-14T00:02:34.047931+0000 mgr.a (mgr.14355) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:37.409 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:37.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:37 smithi007 bash[22722]: cluster 2024-09-14T00:02:36.050272+0000 mgr.a (mgr.14355) 4398 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:02:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:37 smithi007 bash[22722]: audit 2024-09-14T00:02:36.724883+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:02:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:37 smithi131 bash[24745]: cluster 2024-09-14T00:02:36.050272+0000 mgr.a (mgr.14355) 4398 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:02:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:37 smithi131 bash[24745]: audit 2024-09-14T00:02:36.724883+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:02:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:37 smithi171 bash[25040]: cluster 2024-09-14T00:02:36.050272+0000 mgr.a (mgr.14355) 4398 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:02:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:37 smithi171 bash[25040]: audit 2024-09-14T00:02:36.724883+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22722]: audit 2024-09-14T00:02:37.580162+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22722]: audit 2024-09-14T00:02:37.581263+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22722]: audit 2024-09-14T00:02:37.589738+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22722]: audit 2024-09-14T00:02:37.591900+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22972]: debug 2024-09-14T00:02:38.279+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:02:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:02:38 smithi007 bash[22972]: debug 2024-09-14T00:02:38.291+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:38 smithi131 bash[24745]: audit 2024-09-14T00:02:37.580162+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:38 smithi131 bash[24745]: audit 2024-09-14T00:02:37.581263+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:38 smithi131 bash[24745]: audit 2024-09-14T00:02:37.589738+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:38 smithi131 bash[24745]: audit 2024-09-14T00:02:37.591900+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:38 smithi171 bash[25040]: audit 2024-09-14T00:02:37.580162+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:02:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:38 smithi171 bash[25040]: audit 2024-09-14T00:02:37.581263+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:02:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:38 smithi171 bash[25040]: audit 2024-09-14T00:02:37.589738+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:02:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:38 smithi171 bash[25040]: audit 2024-09-14T00:02:37.591900+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:38.679 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:38.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:38.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:39 smithi007 bash[22722]: audit 2024-09-14T00:02:37.593740+0000 mgr.a (mgr.14355) 4399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:39 smithi007 bash[22722]: audit 2024-09-14T00:02:37.724411+0000 mgr.a (mgr.14355) 4400 : audit [DBG] from='client.105159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:39 smithi007 bash[22722]: cluster 2024-09-14T00:02:38.050892+0000 mgr.a (mgr.14355) 4401 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:39 smithi007 bash[22722]: audit 2024-09-14T00:02:38.285952+0000 mgr.a (mgr.14355) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:02:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:39 smithi007 bash[22722]: cephadm 2024-09-14T00:02:38.297555+0000 mgr.a (mgr.14355) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:39 smithi131 bash[24745]: audit 2024-09-14T00:02:37.593740+0000 mgr.a (mgr.14355) 4399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:39 smithi131 bash[24745]: audit 2024-09-14T00:02:37.724411+0000 mgr.a (mgr.14355) 4400 : audit [DBG] from='client.105159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:39 smithi131 bash[24745]: cluster 2024-09-14T00:02:38.050892+0000 mgr.a (mgr.14355) 4401 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:39 smithi131 bash[24745]: audit 2024-09-14T00:02:38.285952+0000 mgr.a (mgr.14355) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:39 smithi131 bash[24745]: cephadm 2024-09-14T00:02:38.297555+0000 mgr.a (mgr.14355) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:02:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:39 smithi171 bash[25040]: audit 2024-09-14T00:02:37.593740+0000 mgr.a (mgr.14355) 4399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:02:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:39 smithi171 bash[25040]: audit 2024-09-14T00:02:37.724411+0000 mgr.a (mgr.14355) 4400 : audit [DBG] from='client.105159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:39 smithi171 bash[25040]: cluster 2024-09-14T00:02:38.050892+0000 mgr.a (mgr.14355) 4401 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:39 smithi171 bash[25040]: audit 2024-09-14T00:02:38.285952+0000 mgr.a (mgr.14355) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:02:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:39 smithi171 bash[25040]: cephadm 2024-09-14T00:02:38.297555+0000 mgr.a (mgr.14355) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:02:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:41 smithi007 bash[22722]: cluster 2024-09-14T00:02:40.051766+0000 mgr.a (mgr.14355) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:41 smithi131 bash[24745]: cluster 2024-09-14T00:02:40.051766+0000 mgr.a (mgr.14355) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:41 smithi171 bash[25040]: cluster 2024-09-14T00:02:40.051766+0000 mgr.a (mgr.14355) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:43 smithi007 bash[22722]: cluster 2024-09-14T00:02:42.054029+0000 mgr.a (mgr.14355) 4405 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:43 smithi131 bash[24745]: cluster 2024-09-14T00:02:42.054029+0000 mgr.a (mgr.14355) 4405 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:43 smithi171 bash[25040]: cluster 2024-09-14T00:02:42.054029+0000 mgr.a (mgr.14355) 4405 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:44.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:45 smithi007 bash[22722]: audit 2024-09-14T00:02:44.013440+0000 mgr.a (mgr.14355) 4406 : audit [DBG] from='client.105342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:45 smithi007 bash[22722]: cluster 2024-09-14T00:02:44.054870+0000 mgr.a (mgr.14355) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:45 smithi131 bash[24745]: audit 2024-09-14T00:02:44.013440+0000 mgr.a (mgr.14355) 4406 : audit [DBG] from='client.105342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:45 smithi131 bash[24745]: cluster 2024-09-14T00:02:44.054870+0000 mgr.a (mgr.14355) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:45 smithi171 bash[25040]: audit 2024-09-14T00:02:44.013440+0000 mgr.a (mgr.14355) 4406 : audit [DBG] from='client.105342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:45 smithi171 bash[25040]: cluster 2024-09-14T00:02:44.054870+0000 mgr.a (mgr.14355) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:47 smithi007 bash[22722]: cluster 2024-09-14T00:02:46.057202+0000 mgr.a (mgr.14355) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:47 smithi131 bash[24745]: cluster 2024-09-14T00:02:46.057202+0000 mgr.a (mgr.14355) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:47 smithi171 bash[25040]: cluster 2024-09-14T00:02:46.057202+0000 mgr.a (mgr.14355) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:49 smithi007 bash[22722]: cluster 2024-09-14T00:02:48.057979+0000 mgr.a (mgr.14355) 4409 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:49 smithi131 bash[24745]: cluster 2024-09-14T00:02:48.057979+0000 mgr.a (mgr.14355) 4409 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:49 smithi171 bash[25040]: cluster 2024-09-14T00:02:48.057979+0000 mgr.a (mgr.14355) 4409 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:50.205 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:50.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:51 smithi007 bash[22722]: audit 2024-09-14T00:02:49.775341+0000 mgr.a (mgr.14355) 4410 : audit [DBG] from='client.105420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:51 smithi007 bash[22722]: cluster 2024-09-14T00:02:50.058518+0000 mgr.a (mgr.14355) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:51 smithi131 bash[24745]: audit 2024-09-14T00:02:49.775341+0000 mgr.a (mgr.14355) 4410 : audit [DBG] from='client.105420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:51 smithi131 bash[24745]: cluster 2024-09-14T00:02:50.058518+0000 mgr.a (mgr.14355) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:51 smithi171 bash[25040]: audit 2024-09-14T00:02:49.775341+0000 mgr.a (mgr.14355) 4410 : audit [DBG] from='client.105420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:51 smithi171 bash[25040]: cluster 2024-09-14T00:02:50.058518+0000 mgr.a (mgr.14355) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:53 smithi007 bash[22722]: cluster 2024-09-14T00:02:52.060854+0000 mgr.a (mgr.14355) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:53 smithi131 bash[24745]: cluster 2024-09-14T00:02:52.060854+0000 mgr.a (mgr.14355) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:53 smithi171 bash[25040]: cluster 2024-09-14T00:02:52.060854+0000 mgr.a (mgr.14355) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:02:55.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:02:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:02:55.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:02:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:55 smithi131 bash[24745]: cluster 2024-09-14T00:02:54.061635+0000 mgr.a (mgr.14355) 4413 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:55 smithi171 bash[25040]: cluster 2024-09-14T00:02:54.061635+0000 mgr.a (mgr.14355) 4413 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:55 smithi007 bash[22722]: cluster 2024-09-14T00:02:54.061635+0000 mgr.a (mgr.14355) 4413 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:55.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:02:55.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:02:55.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:02:55.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:02:55.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:02:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:57 smithi131 bash[24745]: audit 2024-09-14T00:02:55.542874+0000 mgr.a (mgr.14355) 4414 : audit [DBG] from='client.105495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:57 smithi131 bash[24745]: cluster 2024-09-14T00:02:56.063809+0000 mgr.a (mgr.14355) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:57 smithi171 bash[25040]: audit 2024-09-14T00:02:55.542874+0000 mgr.a (mgr.14355) 4414 : audit [DBG] from='client.105495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:57 smithi171 bash[25040]: cluster 2024-09-14T00:02:56.063809+0000 mgr.a (mgr.14355) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:57 smithi007 bash[22722]: audit 2024-09-14T00:02:55.542874+0000 mgr.a (mgr.14355) 4414 : audit [DBG] from='client.105495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:02:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:57 smithi007 bash[22722]: cluster 2024-09-14T00:02:56.063809+0000 mgr.a (mgr.14355) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:02:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:02:59 smithi131 bash[24745]: cluster 2024-09-14T00:02:58.064613+0000 mgr.a (mgr.14355) 4416 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:02:59 smithi171 bash[25040]: cluster 2024-09-14T00:02:58.064613+0000 mgr.a (mgr.14355) 4416 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:02:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:02:59 smithi007 bash[22722]: cluster 2024-09-14T00:02:58.064613+0000 mgr.a (mgr.14355) 4416 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:03:00.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:00.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:01 smithi131 bash[24745]: cluster 2024-09-14T00:03:00.065382+0000 mgr.a (mgr.14355) 4417 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:01 smithi171 bash[25040]: cluster 2024-09-14T00:03:00.065382+0000 mgr.a (mgr.14355) 4417 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:01 smithi007 bash[22722]: cluster 2024-09-14T00:03:00.065382+0000 mgr.a (mgr.14355) 4417 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:01.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:02 smithi131 bash[24745]: audit 2024-09-14T00:03:01.288518+0000 mgr.a (mgr.14355) 4418 : audit [DBG] from='client.105573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:02 smithi171 bash[25040]: audit 2024-09-14T00:03:01.288518+0000 mgr.a (mgr.14355) 4418 : audit [DBG] from='client.105573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:02 smithi007 bash[22722]: audit 2024-09-14T00:03:01.288518+0000 mgr.a (mgr.14355) 4418 : audit [DBG] from='client.105573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:03 smithi131 bash[24745]: cluster 2024-09-14T00:03:02.068355+0000 mgr.a (mgr.14355) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:03 smithi171 bash[25040]: cluster 2024-09-14T00:03:02.068355+0000 mgr.a (mgr.14355) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:03 smithi007 bash[22722]: cluster 2024-09-14T00:03:02.068355+0000 mgr.a (mgr.14355) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:05 smithi131 bash[24745]: cluster 2024-09-14T00:03:04.069179+0000 mgr.a (mgr.14355) 4420 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:03:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:05 smithi171 bash[25040]: cluster 2024-09-14T00:03:04.069179+0000 mgr.a (mgr.14355) 4420 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:03:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:05 smithi007 bash[22722]: cluster 2024-09-14T00:03:04.069179+0000 mgr.a (mgr.14355) 4420 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:03:06.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:06.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:06.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:07.519 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:07 smithi131 bash[24745]: cluster 2024-09-14T00:03:06.071166+0000 mgr.a (mgr.14355) 4421 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:07 smithi171 bash[25040]: cluster 2024-09-14T00:03:06.071166+0000 mgr.a (mgr.14355) 4421 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:07 smithi007 bash[22722]: cluster 2024-09-14T00:03:06.071166+0000 mgr.a (mgr.14355) 4421 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:08 smithi131 bash[24745]: audit 2024-09-14T00:03:07.080138+0000 mgr.a (mgr.14355) 4422 : audit [DBG] from='client.105648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:08 smithi171 bash[25040]: audit 2024-09-14T00:03:07.080138+0000 mgr.a (mgr.14355) 4422 : audit [DBG] from='client.105648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:08 smithi007 bash[22722]: audit 2024-09-14T00:03:07.080138+0000 mgr.a (mgr.14355) 4422 : audit [DBG] from='client.105648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:09 smithi131 bash[24745]: cluster 2024-09-14T00:03:08.072135+0000 mgr.a (mgr.14355) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:09 smithi171 bash[25040]: cluster 2024-09-14T00:03:08.072135+0000 mgr.a (mgr.14355) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:09 smithi007 bash[22722]: cluster 2024-09-14T00:03:08.072135+0000 mgr.a (mgr.14355) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:11 smithi131 bash[24745]: cluster 2024-09-14T00:03:10.072961+0000 mgr.a (mgr.14355) 4424 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:11 smithi171 bash[25040]: cluster 2024-09-14T00:03:10.072961+0000 mgr.a (mgr.14355) 4424 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:11 smithi007 bash[22722]: cluster 2024-09-14T00:03:10.072961+0000 mgr.a (mgr.14355) 4424 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:12.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:13.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:13 smithi131 bash[24745]: cluster 2024-09-14T00:03:12.075242+0000 mgr.a (mgr.14355) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:13 smithi171 bash[25040]: cluster 2024-09-14T00:03:12.075242+0000 mgr.a (mgr.14355) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:13 smithi007 bash[22722]: cluster 2024-09-14T00:03:12.075242+0000 mgr.a (mgr.14355) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:14 smithi131 bash[24745]: audit 2024-09-14T00:03:12.852832+0000 mgr.a (mgr.14355) 4426 : audit [DBG] from='client.105726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:14 smithi171 bash[25040]: audit 2024-09-14T00:03:12.852832+0000 mgr.a (mgr.14355) 4426 : audit [DBG] from='client.105726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:14 smithi007 bash[22722]: audit 2024-09-14T00:03:12.852832+0000 mgr.a (mgr.14355) 4426 : audit [DBG] from='client.105726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:15 smithi131 bash[24745]: cluster 2024-09-14T00:03:14.076233+0000 mgr.a (mgr.14355) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:15 smithi171 bash[25040]: cluster 2024-09-14T00:03:14.076233+0000 mgr.a (mgr.14355) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:15 smithi007 bash[22722]: cluster 2024-09-14T00:03:14.076233+0000 mgr.a (mgr.14355) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:17 smithi131 bash[24745]: cluster 2024-09-14T00:03:16.078475+0000 mgr.a (mgr.14355) 4428 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:17 smithi171 bash[25040]: cluster 2024-09-14T00:03:16.078475+0000 mgr.a (mgr.14355) 4428 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:17 smithi007 bash[22722]: cluster 2024-09-14T00:03:16.078475+0000 mgr.a (mgr.14355) 4428 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:18.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:18.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:19.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:19.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:19.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:19.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:19.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:19 smithi131 bash[24745]: cluster 2024-09-14T00:03:18.079264+0000 mgr.a (mgr.14355) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:19 smithi171 bash[25040]: cluster 2024-09-14T00:03:18.079264+0000 mgr.a (mgr.14355) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:19 smithi007 bash[22722]: cluster 2024-09-14T00:03:18.079264+0000 mgr.a (mgr.14355) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:20 smithi171 bash[25040]: audit 2024-09-14T00:03:18.625611+0000 mgr.a (mgr.14355) 4430 : audit [DBG] from='client.105804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:20 smithi007 bash[22722]: audit 2024-09-14T00:03:18.625611+0000 mgr.a (mgr.14355) 4430 : audit [DBG] from='client.105804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:20 smithi131 bash[24745]: audit 2024-09-14T00:03:18.625611+0000 mgr.a (mgr.14355) 4430 : audit [DBG] from='client.105804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:21 smithi171 bash[25040]: cluster 2024-09-14T00:03:20.080170+0000 mgr.a (mgr.14355) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:21 smithi007 bash[22722]: cluster 2024-09-14T00:03:20.080170+0000 mgr.a (mgr.14355) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:21 smithi131 bash[24745]: cluster 2024-09-14T00:03:20.080170+0000 mgr.a (mgr.14355) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:23 smithi171 bash[25040]: cluster 2024-09-14T00:03:22.082453+0000 mgr.a (mgr.14355) 4432 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:23 smithi007 bash[22722]: cluster 2024-09-14T00:03:22.082453+0000 mgr.a (mgr.14355) 4432 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:23.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:23 smithi131 bash[24745]: cluster 2024-09-14T00:03:22.082453+0000 mgr.a (mgr.14355) 4432 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:24.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:24.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:24.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:24.820 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:25 smithi007 bash[22722]: cluster 2024-09-14T00:03:24.083072+0000 mgr.a (mgr.14355) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:25 smithi007 bash[22722]: audit 2024-09-14T00:03:24.406437+0000 mgr.a (mgr.14355) 4434 : audit [DBG] from='client.105879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:25 smithi131 bash[24745]: cluster 2024-09-14T00:03:24.083072+0000 mgr.a (mgr.14355) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:25 smithi131 bash[24745]: audit 2024-09-14T00:03:24.406437+0000 mgr.a (mgr.14355) 4434 : audit [DBG] from='client.105879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:25 smithi171 bash[25040]: cluster 2024-09-14T00:03:24.083072+0000 mgr.a (mgr.14355) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:25 smithi171 bash[25040]: audit 2024-09-14T00:03:24.406437+0000 mgr.a (mgr.14355) 4434 : audit [DBG] from='client.105879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:27 smithi007 bash[22722]: cluster 2024-09-14T00:03:26.085384+0000 mgr.a (mgr.14355) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:27 smithi131 bash[24745]: cluster 2024-09-14T00:03:26.085384+0000 mgr.a (mgr.14355) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:27 smithi171 bash[25040]: cluster 2024-09-14T00:03:26.085384+0000 mgr.a (mgr.14355) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:29 smithi007 bash[22722]: cluster 2024-09-14T00:03:28.086171+0000 mgr.a (mgr.14355) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:29 smithi131 bash[24745]: cluster 2024-09-14T00:03:28.086171+0000 mgr.a (mgr.14355) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:29 smithi171 bash[25040]: cluster 2024-09-14T00:03:28.086171+0000 mgr.a (mgr.14355) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:29.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:29.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:29.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:30.566 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:30.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:30.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:30.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:31 smithi007 bash[22722]: cluster 2024-09-14T00:03:30.086872+0000 mgr.a (mgr.14355) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:31 smithi007 bash[22722]: audit 2024-09-14T00:03:30.152956+0000 mgr.a (mgr.14355) 4438 : audit [DBG] from='client.105957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:31 smithi131 bash[24745]: cluster 2024-09-14T00:03:30.086872+0000 mgr.a (mgr.14355) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:31 smithi131 bash[24745]: audit 2024-09-14T00:03:30.152956+0000 mgr.a (mgr.14355) 4438 : audit [DBG] from='client.105957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:31 smithi171 bash[25040]: cluster 2024-09-14T00:03:30.086872+0000 mgr.a (mgr.14355) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:31 smithi171 bash[25040]: audit 2024-09-14T00:03:30.152956+0000 mgr.a (mgr.14355) 4438 : audit [DBG] from='client.105957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:33 smithi007 bash[22722]: cluster 2024-09-14T00:03:32.089330+0000 mgr.a (mgr.14355) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T00:03:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:33 smithi131 bash[24745]: cluster 2024-09-14T00:03:32.089330+0000 mgr.a (mgr.14355) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T00:03:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:33 smithi171 bash[25040]: cluster 2024-09-14T00:03:32.089330+0000 mgr.a (mgr.14355) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T00:03:35.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:35.568 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:35 smithi007 bash[22722]: cluster 2024-09-14T00:03:34.090137+0000 mgr.a (mgr.14355) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T00:03:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:35 smithi131 bash[24745]: cluster 2024-09-14T00:03:34.090137+0000 mgr.a (mgr.14355) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T00:03:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:35 smithi171 bash[25040]: cluster 2024-09-14T00:03:34.090137+0000 mgr.a (mgr.14355) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T00:03:36.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:36.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:36.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:36.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:36.316 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:37 smithi007 bash[22722]: audit 2024-09-14T00:03:35.899655+0000 mgr.a (mgr.14355) 4441 : audit [DBG] from='client.106035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:37 smithi007 bash[22722]: cluster 2024-09-14T00:03:36.091515+0000 mgr.a (mgr.14355) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:37 smithi131 bash[24745]: audit 2024-09-14T00:03:35.899655+0000 mgr.a (mgr.14355) 4441 : audit [DBG] from='client.106035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:37 smithi131 bash[24745]: cluster 2024-09-14T00:03:36.091515+0000 mgr.a (mgr.14355) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:37 smithi171 bash[25040]: audit 2024-09-14T00:03:35.899655+0000 mgr.a (mgr.14355) 4441 : audit [DBG] from='client.106035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:37 smithi171 bash[25040]: cluster 2024-09-14T00:03:36.091515+0000 mgr.a (mgr.14355) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: cluster 2024-09-14T00:03:38.092326+0000 mgr.a (mgr.14355) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: audit 2024-09-14T00:03:38.349712+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: audit 2024-09-14T00:03:39.199523+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: audit 2024-09-14T00:03:39.201189+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: audit 2024-09-14T00:03:39.211739+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:03:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22722]: audit 2024-09-14T00:03:39.216530+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: cluster 2024-09-14T00:03:38.092326+0000 mgr.a (mgr.14355) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: audit 2024-09-14T00:03:38.349712+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:03:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: audit 2024-09-14T00:03:39.199523+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:03:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: audit 2024-09-14T00:03:39.201189+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:03:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: audit 2024-09-14T00:03:39.211739+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:03:39.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:39 smithi131 bash[24745]: audit 2024-09-14T00:03:39.216530+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: cluster 2024-09-14T00:03:38.092326+0000 mgr.a (mgr.14355) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: audit 2024-09-14T00:03:38.349712+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:03:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: audit 2024-09-14T00:03:39.199523+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:03:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: audit 2024-09-14T00:03:39.201189+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:03:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: audit 2024-09-14T00:03:39.211739+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:03:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:39 smithi171 bash[25040]: audit 2024-09-14T00:03:39.216530+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:40.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22972]: debug 2024-09-14T00:03:39.942+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:03:40.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:03:39 smithi007 bash[22972]: debug 2024-09-14T00:03:39.946+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:03:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:40 smithi007 bash[22722]: audit 2024-09-14T00:03:39.217821+0000 mgr.a (mgr.14355) 4444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:40 smithi131 bash[24745]: audit 2024-09-14T00:03:39.217821+0000 mgr.a (mgr.14355) 4444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:40 smithi171 bash[25040]: audit 2024-09-14T00:03:39.217821+0000 mgr.a (mgr.14355) 4444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:03:41.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:41.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:41.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:41 smithi007 bash[22722]: audit 2024-09-14T00:03:39.949646+0000 mgr.a (mgr.14355) 4445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:03:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:41 smithi007 bash[22722]: cephadm 2024-09-14T00:03:39.950945+0000 mgr.a (mgr.14355) 4446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:03:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:41 smithi007 bash[22722]: cluster 2024-09-14T00:03:40.093270+0000 mgr.a (mgr.14355) 4447 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:41 smithi131 bash[24745]: audit 2024-09-14T00:03:39.949646+0000 mgr.a (mgr.14355) 4445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:03:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:41 smithi131 bash[24745]: cephadm 2024-09-14T00:03:39.950945+0000 mgr.a (mgr.14355) 4446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:03:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:41 smithi131 bash[24745]: cluster 2024-09-14T00:03:40.093270+0000 mgr.a (mgr.14355) 4447 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:41 smithi171 bash[25040]: audit 2024-09-14T00:03:39.949646+0000 mgr.a (mgr.14355) 4445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:03:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:41 smithi171 bash[25040]: cephadm 2024-09-14T00:03:39.950945+0000 mgr.a (mgr.14355) 4446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:03:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:41 smithi171 bash[25040]: cluster 2024-09-14T00:03:40.093270+0000 mgr.a (mgr.14355) 4447 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:03:42.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:42.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:43 smithi007 bash[22722]: audit 2024-09-14T00:03:41.656360+0000 mgr.a (mgr.14355) 4448 : audit [DBG] from='client.106218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:43 smithi007 bash[22722]: cluster 2024-09-14T00:03:42.094586+0000 mgr.a (mgr.14355) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:43 smithi131 bash[24745]: audit 2024-09-14T00:03:41.656360+0000 mgr.a (mgr.14355) 4448 : audit [DBG] from='client.106218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:43 smithi131 bash[24745]: cluster 2024-09-14T00:03:42.094586+0000 mgr.a (mgr.14355) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:43 smithi171 bash[25040]: audit 2024-09-14T00:03:41.656360+0000 mgr.a (mgr.14355) 4448 : audit [DBG] from='client.106218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:43 smithi171 bash[25040]: cluster 2024-09-14T00:03:42.094586+0000 mgr.a (mgr.14355) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:45 smithi007 bash[22722]: cluster 2024-09-14T00:03:44.095326+0000 mgr.a (mgr.14355) 4450 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:03:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:45 smithi131 bash[24745]: cluster 2024-09-14T00:03:44.095326+0000 mgr.a (mgr.14355) 4450 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:03:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:45 smithi171 bash[25040]: cluster 2024-09-14T00:03:44.095326+0000 mgr.a (mgr.14355) 4450 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:03:47.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:47.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:47 smithi007 bash[22722]: cluster 2024-09-14T00:03:46.097361+0000 mgr.a (mgr.14355) 4451 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:47 smithi131 bash[24745]: cluster 2024-09-14T00:03:46.097361+0000 mgr.a (mgr.14355) 4451 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:47 smithi171 bash[25040]: cluster 2024-09-14T00:03:46.097361+0000 mgr.a (mgr.14355) 4451 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:47.878 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:48 smithi007 bash[22722]: audit 2024-09-14T00:03:47.431092+0000 mgr.a (mgr.14355) 4452 : audit [DBG] from='client.106296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:48 smithi131 bash[24745]: audit 2024-09-14T00:03:47.431092+0000 mgr.a (mgr.14355) 4452 : audit [DBG] from='client.106296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:48 smithi171 bash[25040]: audit 2024-09-14T00:03:47.431092+0000 mgr.a (mgr.14355) 4452 : audit [DBG] from='client.106296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:49 smithi007 bash[22722]: cluster 2024-09-14T00:03:48.098378+0000 mgr.a (mgr.14355) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:49 smithi131 bash[24745]: cluster 2024-09-14T00:03:48.098378+0000 mgr.a (mgr.14355) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:49 smithi171 bash[25040]: cluster 2024-09-14T00:03:48.098378+0000 mgr.a (mgr.14355) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:51 smithi007 bash[22722]: cluster 2024-09-14T00:03:50.099116+0000 mgr.a (mgr.14355) 4454 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:51 smithi131 bash[24745]: cluster 2024-09-14T00:03:50.099116+0000 mgr.a (mgr.14355) 4454 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:51 smithi171 bash[25040]: cluster 2024-09-14T00:03:50.099116+0000 mgr.a (mgr.14355) 4454 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:53.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:53.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:53 smithi007 bash[22722]: cluster 2024-09-14T00:03:52.101361+0000 mgr.a (mgr.14355) 4455 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:53 smithi131 bash[24745]: cluster 2024-09-14T00:03:52.101361+0000 mgr.a (mgr.14355) 4455 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:53 smithi171 bash[25040]: cluster 2024-09-14T00:03:52.101361+0000 mgr.a (mgr.14355) 4455 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:03:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:54 smithi007 bash[22722]: audit 2024-09-14T00:03:53.208513+0000 mgr.a (mgr.14355) 4456 : audit [DBG] from='client.106374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:54 smithi131 bash[24745]: audit 2024-09-14T00:03:53.208513+0000 mgr.a (mgr.14355) 4456 : audit [DBG] from='client.106374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:54 smithi171 bash[25040]: audit 2024-09-14T00:03:53.208513+0000 mgr.a (mgr.14355) 4456 : audit [DBG] from='client.106374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:03:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:55 smithi007 bash[22722]: cluster 2024-09-14T00:03:54.102385+0000 mgr.a (mgr.14355) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:55 smithi131 bash[24745]: cluster 2024-09-14T00:03:54.102385+0000 mgr.a (mgr.14355) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:55 smithi171 bash[25040]: cluster 2024-09-14T00:03:54.102385+0000 mgr.a (mgr.14355) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:57 smithi007 bash[22722]: cluster 2024-09-14T00:03:56.104588+0000 mgr.a (mgr.14355) 4458 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:57 smithi131 bash[24745]: cluster 2024-09-14T00:03:56.104588+0000 mgr.a (mgr.14355) 4458 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:57 smithi171 bash[25040]: cluster 2024-09-14T00:03:56.104588+0000 mgr.a (mgr.14355) 4458 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:03:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:03:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:03:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:03:59.402 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:03:59.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:03:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:03:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:03:59.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:03:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:03:59 smithi007 bash[22722]: cluster 2024-09-14T00:03:58.105355+0000 mgr.a (mgr.14355) 4459 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:03:59 smithi131 bash[24745]: cluster 2024-09-14T00:03:58.105355+0000 mgr.a (mgr.14355) 4459 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:03:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:03:59 smithi171 bash[25040]: cluster 2024-09-14T00:03:58.105355+0000 mgr.a (mgr.14355) 4459 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:00 smithi007 bash[22722]: audit 2024-09-14T00:03:58.967499+0000 mgr.a (mgr.14355) 4460 : audit [DBG] from='client.106452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:00 smithi131 bash[24745]: audit 2024-09-14T00:03:58.967499+0000 mgr.a (mgr.14355) 4460 : audit [DBG] from='client.106452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:00 smithi171 bash[25040]: audit 2024-09-14T00:03:58.967499+0000 mgr.a (mgr.14355) 4460 : audit [DBG] from='client.106452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:01 smithi007 bash[22722]: cluster 2024-09-14T00:04:00.106247+0000 mgr.a (mgr.14355) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:01 smithi131 bash[24745]: cluster 2024-09-14T00:04:00.106247+0000 mgr.a (mgr.14355) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:01 smithi171 bash[25040]: cluster 2024-09-14T00:04:00.106247+0000 mgr.a (mgr.14355) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:03 smithi007 bash[22722]: cluster 2024-09-14T00:04:02.108652+0000 mgr.a (mgr.14355) 4462 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:03 smithi131 bash[24745]: cluster 2024-09-14T00:04:02.108652+0000 mgr.a (mgr.14355) 4462 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:03 smithi171 bash[25040]: cluster 2024-09-14T00:04:02.108652+0000 mgr.a (mgr.14355) 4462 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:05.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:05.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:05.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:05.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:05.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:05 smithi007 bash[22722]: cluster 2024-09-14T00:04:04.109455+0000 mgr.a (mgr.14355) 4463 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:05 smithi131 bash[24745]: cluster 2024-09-14T00:04:04.109455+0000 mgr.a (mgr.14355) 4463 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:05 smithi171 bash[25040]: cluster 2024-09-14T00:04:04.109455+0000 mgr.a (mgr.14355) 4463 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:06 smithi007 bash[22722]: audit 2024-09-14T00:04:04.743122+0000 mgr.a (mgr.14355) 4464 : audit [DBG] from='client.106530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:06 smithi131 bash[24745]: audit 2024-09-14T00:04:04.743122+0000 mgr.a (mgr.14355) 4464 : audit [DBG] from='client.106530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:06 smithi171 bash[25040]: audit 2024-09-14T00:04:04.743122+0000 mgr.a (mgr.14355) 4464 : audit [DBG] from='client.106530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:07 smithi007 bash[22722]: cluster 2024-09-14T00:04:06.111763+0000 mgr.a (mgr.14355) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:07 smithi131 bash[24745]: cluster 2024-09-14T00:04:06.111763+0000 mgr.a (mgr.14355) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:07 smithi171 bash[25040]: cluster 2024-09-14T00:04:06.111763+0000 mgr.a (mgr.14355) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:09 smithi007 bash[22722]: cluster 2024-09-14T00:04:08.112541+0000 mgr.a (mgr.14355) 4466 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:09 smithi131 bash[24745]: cluster 2024-09-14T00:04:08.112541+0000 mgr.a (mgr.14355) 4466 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:09 smithi171 bash[25040]: cluster 2024-09-14T00:04:08.112541+0000 mgr.a (mgr.14355) 4466 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:10.963 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:10.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:10.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:10.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:10.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:11 smithi007 bash[22722]: cluster 2024-09-14T00:04:10.113305+0000 mgr.a (mgr.14355) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:11 smithi131 bash[24745]: cluster 2024-09-14T00:04:10.113305+0000 mgr.a (mgr.14355) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:11 smithi171 bash[25040]: cluster 2024-09-14T00:04:10.113305+0000 mgr.a (mgr.14355) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:12 smithi007 bash[22722]: audit 2024-09-14T00:04:10.521325+0000 mgr.a (mgr.14355) 4468 : audit [DBG] from='client.106608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:12 smithi131 bash[24745]: audit 2024-09-14T00:04:10.521325+0000 mgr.a (mgr.14355) 4468 : audit [DBG] from='client.106608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:12 smithi171 bash[25040]: audit 2024-09-14T00:04:10.521325+0000 mgr.a (mgr.14355) 4468 : audit [DBG] from='client.106608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:13 smithi007 bash[22722]: cluster 2024-09-14T00:04:12.116061+0000 mgr.a (mgr.14355) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:13 smithi131 bash[24745]: cluster 2024-09-14T00:04:12.116061+0000 mgr.a (mgr.14355) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:13 smithi171 bash[25040]: cluster 2024-09-14T00:04:12.116061+0000 mgr.a (mgr.14355) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:15 smithi007 bash[22722]: cluster 2024-09-14T00:04:14.116845+0000 mgr.a (mgr.14355) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:15 smithi131 bash[24745]: cluster 2024-09-14T00:04:14.116845+0000 mgr.a (mgr.14355) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:15 smithi171 bash[25040]: cluster 2024-09-14T00:04:14.116845+0000 mgr.a (mgr.14355) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:16.740 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:16.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:16.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:16.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:16.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:17 smithi007 bash[22722]: cluster 2024-09-14T00:04:16.118348+0000 mgr.a (mgr.14355) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:17 smithi007 bash[22722]: audit 2024-09-14T00:04:16.300399+0000 mgr.a (mgr.14355) 4472 : audit [DBG] from='client.106683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:17 smithi131 bash[24745]: cluster 2024-09-14T00:04:16.118348+0000 mgr.a (mgr.14355) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:17 smithi131 bash[24745]: audit 2024-09-14T00:04:16.300399+0000 mgr.a (mgr.14355) 4472 : audit [DBG] from='client.106683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:17 smithi171 bash[25040]: cluster 2024-09-14T00:04:16.118348+0000 mgr.a (mgr.14355) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:17 smithi171 bash[25040]: audit 2024-09-14T00:04:16.300399+0000 mgr.a (mgr.14355) 4472 : audit [DBG] from='client.106683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:19 smithi007 bash[22722]: cluster 2024-09-14T00:04:18.119269+0000 mgr.a (mgr.14355) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:19 smithi131 bash[24745]: cluster 2024-09-14T00:04:18.119269+0000 mgr.a (mgr.14355) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:19 smithi171 bash[25040]: cluster 2024-09-14T00:04:18.119269+0000 mgr.a (mgr.14355) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:04:21.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:21.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:21 smithi131 bash[24745]: cluster 2024-09-14T00:04:20.120055+0000 mgr.a (mgr.14355) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:04:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:21 smithi171 bash[25040]: cluster 2024-09-14T00:04:20.120055+0000 mgr.a (mgr.14355) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:04:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:21 smithi007 bash[22722]: cluster 2024-09-14T00:04:20.120055+0000 mgr.a (mgr.14355) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:04:22.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:23 smithi131 bash[24745]: audit 2024-09-14T00:04:22.080137+0000 mgr.a (mgr.14355) 4475 : audit [DBG] from='client.106758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:23 smithi131 bash[24745]: cluster 2024-09-14T00:04:22.123103+0000 mgr.a (mgr.14355) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:23 smithi171 bash[25040]: audit 2024-09-14T00:04:22.080137+0000 mgr.a (mgr.14355) 4475 : audit [DBG] from='client.106758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:23 smithi171 bash[25040]: cluster 2024-09-14T00:04:22.123103+0000 mgr.a (mgr.14355) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:23 smithi007 bash[22722]: audit 2024-09-14T00:04:22.080137+0000 mgr.a (mgr.14355) 4475 : audit [DBG] from='client.106758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:23 smithi007 bash[22722]: cluster 2024-09-14T00:04:22.123103+0000 mgr.a (mgr.14355) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:25 smithi131 bash[24745]: cluster 2024-09-14T00:04:24.124038+0000 mgr.a (mgr.14355) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:25 smithi171 bash[25040]: cluster 2024-09-14T00:04:24.124038+0000 mgr.a (mgr.14355) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:25 smithi007 bash[22722]: cluster 2024-09-14T00:04:24.124038+0000 mgr.a (mgr.14355) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:27 smithi007 bash[22722]: cluster 2024-09-14T00:04:26.126489+0000 mgr.a (mgr.14355) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:27.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:27.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:27.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:27 smithi131 bash[24745]: cluster 2024-09-14T00:04:26.126489+0000 mgr.a (mgr.14355) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:27 smithi171 bash[25040]: cluster 2024-09-14T00:04:26.126489+0000 mgr.a (mgr.14355) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:28.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:28.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:28.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:29 smithi007 bash[22722]: audit 2024-09-14T00:04:27.837261+0000 mgr.a (mgr.14355) 4479 : audit [DBG] from='client.106836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:29 smithi007 bash[22722]: cluster 2024-09-14T00:04:28.127083+0000 mgr.a (mgr.14355) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:29 smithi131 bash[24745]: audit 2024-09-14T00:04:27.837261+0000 mgr.a (mgr.14355) 4479 : audit [DBG] from='client.106836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:29 smithi131 bash[24745]: cluster 2024-09-14T00:04:28.127083+0000 mgr.a (mgr.14355) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:29 smithi171 bash[25040]: audit 2024-09-14T00:04:27.837261+0000 mgr.a (mgr.14355) 4479 : audit [DBG] from='client.106836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:29 smithi171 bash[25040]: cluster 2024-09-14T00:04:28.127083+0000 mgr.a (mgr.14355) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:31 smithi007 bash[22722]: cluster 2024-09-14T00:04:30.127928+0000 mgr.a (mgr.14355) 4481 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:31 smithi131 bash[24745]: cluster 2024-09-14T00:04:30.127928+0000 mgr.a (mgr.14355) 4481 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:31 smithi171 bash[25040]: cluster 2024-09-14T00:04:30.127928+0000 mgr.a (mgr.14355) 4481 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:33.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:33.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:33.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:33 smithi007 bash[22722]: cluster 2024-09-14T00:04:32.130193+0000 mgr.a (mgr.14355) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:33 smithi131 bash[24745]: cluster 2024-09-14T00:04:32.130193+0000 mgr.a (mgr.14355) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:33 smithi171 bash[25040]: cluster 2024-09-14T00:04:32.130193+0000 mgr.a (mgr.14355) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:34.022 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:35 smithi007 bash[22722]: audit 2024-09-14T00:04:33.602994+0000 mgr.a (mgr.14355) 4483 : audit [DBG] from='client.106911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:35 smithi007 bash[22722]: cluster 2024-09-14T00:04:34.131128+0000 mgr.a (mgr.14355) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:35 smithi131 bash[24745]: audit 2024-09-14T00:04:33.602994+0000 mgr.a (mgr.14355) 4483 : audit [DBG] from='client.106911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:35 smithi131 bash[24745]: cluster 2024-09-14T00:04:34.131128+0000 mgr.a (mgr.14355) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:35 smithi171 bash[25040]: audit 2024-09-14T00:04:33.602994+0000 mgr.a (mgr.14355) 4483 : audit [DBG] from='client.106911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:35 smithi171 bash[25040]: cluster 2024-09-14T00:04:34.131128+0000 mgr.a (mgr.14355) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:37 smithi007 bash[22722]: cluster 2024-09-14T00:04:36.133451+0000 mgr.a (mgr.14355) 4485 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:37 smithi131 bash[24745]: cluster 2024-09-14T00:04:36.133451+0000 mgr.a (mgr.14355) 4485 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:37 smithi171 bash[25040]: cluster 2024-09-14T00:04:36.133451+0000 mgr.a (mgr.14355) 4485 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:39 smithi007 bash[22722]: cluster 2024-09-14T00:04:38.134220+0000 mgr.a (mgr.14355) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:39 smithi131 bash[24745]: cluster 2024-09-14T00:04:38.134220+0000 mgr.a (mgr.14355) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:39 smithi171 bash[25040]: cluster 2024-09-14T00:04:38.134220+0000 mgr.a (mgr.14355) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:39.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:39.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:40 smithi007 bash[22722]: audit 2024-09-14T00:04:39.358417+0000 mgr.a (mgr.14355) 4487 : audit [DBG] from='client.106986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:40 smithi007 bash[22722]: audit 2024-09-14T00:04:40.001821+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:04:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:40 smithi131 bash[24745]: audit 2024-09-14T00:04:39.358417+0000 mgr.a (mgr.14355) 4487 : audit [DBG] from='client.106986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:40 smithi131 bash[24745]: audit 2024-09-14T00:04:40.001821+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:04:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:40 smithi171 bash[25040]: audit 2024-09-14T00:04:39.358417+0000 mgr.a (mgr.14355) 4487 : audit [DBG] from='client.106986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:40 smithi171 bash[25040]: audit 2024-09-14T00:04:40.001821+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:04:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22722]: cluster 2024-09-14T00:04:40.134890+0000 mgr.a (mgr.14355) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22722]: audit 2024-09-14T00:04:40.878817+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:04:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22722]: audit 2024-09-14T00:04:40.879927+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:04:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22722]: audit 2024-09-14T00:04:40.888653+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:04:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22722]: audit 2024-09-14T00:04:40.892209+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:41 smithi131 bash[24745]: cluster 2024-09-14T00:04:40.134890+0000 mgr.a (mgr.14355) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:41 smithi131 bash[24745]: audit 2024-09-14T00:04:40.878817+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:04:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:41 smithi131 bash[24745]: audit 2024-09-14T00:04:40.879927+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:04:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:41 smithi131 bash[24745]: audit 2024-09-14T00:04:40.888653+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:04:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:41 smithi131 bash[24745]: audit 2024-09-14T00:04:40.892209+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:41 smithi171 bash[25040]: cluster 2024-09-14T00:04:40.134890+0000 mgr.a (mgr.14355) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:41 smithi171 bash[25040]: audit 2024-09-14T00:04:40.878817+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:04:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:41 smithi171 bash[25040]: audit 2024-09-14T00:04:40.879927+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:04:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:41 smithi171 bash[25040]: audit 2024-09-14T00:04:40.888653+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:04:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:41 smithi171 bash[25040]: audit 2024-09-14T00:04:40.892209+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22972]: debug 2024-09-14T00:04:41.605+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:04:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:04:41 smithi007 bash[22972]: debug 2024-09-14T00:04:41.609+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:04:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:42 smithi007 bash[22722]: audit 2024-09-14T00:04:40.894527+0000 mgr.a (mgr.14355) 4489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:42 smithi131 bash[24745]: audit 2024-09-14T00:04:40.894527+0000 mgr.a (mgr.14355) 4489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:42 smithi171 bash[25040]: audit 2024-09-14T00:04:40.894527+0000 mgr.a (mgr.14355) 4489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:04:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:43 smithi007 bash[22722]: audit 2024-09-14T00:04:41.609882+0000 mgr.a (mgr.14355) 4490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:04:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:43 smithi007 bash[22722]: cephadm 2024-09-14T00:04:41.611038+0000 mgr.a (mgr.14355) 4491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:04:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:43 smithi007 bash[22722]: cluster 2024-09-14T00:04:42.137591+0000 mgr.a (mgr.14355) 4492 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:43 smithi131 bash[24745]: audit 2024-09-14T00:04:41.609882+0000 mgr.a (mgr.14355) 4490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:04:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:43 smithi131 bash[24745]: cephadm 2024-09-14T00:04:41.611038+0000 mgr.a (mgr.14355) 4491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:04:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:43 smithi131 bash[24745]: cluster 2024-09-14T00:04:42.137591+0000 mgr.a (mgr.14355) 4492 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:43 smithi171 bash[25040]: audit 2024-09-14T00:04:41.609882+0000 mgr.a (mgr.14355) 4490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:04:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:43 smithi171 bash[25040]: cephadm 2024-09-14T00:04:41.611038+0000 mgr.a (mgr.14355) 4491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:04:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:43 smithi171 bash[25040]: cluster 2024-09-14T00:04:42.137591+0000 mgr.a (mgr.14355) 4492 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:04:44.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:44.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:45 smithi007 bash[22722]: cluster 2024-09-14T00:04:44.138367+0000 mgr.a (mgr.14355) 4493 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:45.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:45.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:45.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:45.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:45.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:45 smithi131 bash[24745]: cluster 2024-09-14T00:04:44.138367+0000 mgr.a (mgr.14355) 4493 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:45 smithi171 bash[25040]: cluster 2024-09-14T00:04:44.138367+0000 mgr.a (mgr.14355) 4493 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:04:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:46 smithi007 bash[22722]: audit 2024-09-14T00:04:45.114219+0000 mgr.a (mgr.14355) 4494 : audit [DBG] from='client.107163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:46 smithi131 bash[24745]: audit 2024-09-14T00:04:45.114219+0000 mgr.a (mgr.14355) 4494 : audit [DBG] from='client.107163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:46 smithi171 bash[25040]: audit 2024-09-14T00:04:45.114219+0000 mgr.a (mgr.14355) 4494 : audit [DBG] from='client.107163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:47 smithi007 bash[22722]: cluster 2024-09-14T00:04:46.140728+0000 mgr.a (mgr.14355) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:47 smithi131 bash[24745]: cluster 2024-09-14T00:04:46.140728+0000 mgr.a (mgr.14355) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:47 smithi171 bash[25040]: cluster 2024-09-14T00:04:46.140728+0000 mgr.a (mgr.14355) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:49 smithi007 bash[22722]: cluster 2024-09-14T00:04:48.141511+0000 mgr.a (mgr.14355) 4496 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:49 smithi131 bash[24745]: cluster 2024-09-14T00:04:48.141511+0000 mgr.a (mgr.14355) 4496 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:49 smithi171 bash[25040]: cluster 2024-09-14T00:04:48.141511+0000 mgr.a (mgr.14355) 4496 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:50.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:50.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:50.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:51.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:51.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:51.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:51.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:51.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:51 smithi007 bash[22722]: cluster 2024-09-14T00:04:50.142256+0000 mgr.a (mgr.14355) 4497 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:51 smithi131 bash[24745]: cluster 2024-09-14T00:04:50.142256+0000 mgr.a (mgr.14355) 4497 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:51 smithi171 bash[25040]: cluster 2024-09-14T00:04:50.142256+0000 mgr.a (mgr.14355) 4497 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:52 smithi007 bash[22722]: audit 2024-09-14T00:04:50.864243+0000 mgr.a (mgr.14355) 4498 : audit [DBG] from='client.107238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:52 smithi131 bash[24745]: audit 2024-09-14T00:04:50.864243+0000 mgr.a (mgr.14355) 4498 : audit [DBG] from='client.107238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:52 smithi171 bash[25040]: audit 2024-09-14T00:04:50.864243+0000 mgr.a (mgr.14355) 4498 : audit [DBG] from='client.107238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:53 smithi131 bash[24745]: cluster 2024-09-14T00:04:52.145101+0000 mgr.a (mgr.14355) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:53 smithi171 bash[25040]: cluster 2024-09-14T00:04:52.145101+0000 mgr.a (mgr.14355) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:53 smithi007 bash[22722]: cluster 2024-09-14T00:04:52.145101+0000 mgr.a (mgr.14355) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:55 smithi131 bash[24745]: cluster 2024-09-14T00:04:54.146066+0000 mgr.a (mgr.14355) 4500 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:55 smithi171 bash[25040]: cluster 2024-09-14T00:04:54.146066+0000 mgr.a (mgr.14355) 4500 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:55 smithi007 bash[22722]: cluster 2024-09-14T00:04:54.146066+0000 mgr.a (mgr.14355) 4500 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:04:56.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:04:56.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:04:56.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:04:57.037 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:04:57.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:04:57.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:04:57.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:04:57.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:04:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:57 smithi131 bash[24745]: cluster 2024-09-14T00:04:56.148229+0000 mgr.a (mgr.14355) 4501 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:57 smithi171 bash[25040]: cluster 2024-09-14T00:04:56.148229+0000 mgr.a (mgr.14355) 4501 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:57 smithi007 bash[22722]: cluster 2024-09-14T00:04:56.148229+0000 mgr.a (mgr.14355) 4501 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:04:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:58 smithi131 bash[24745]: audit 2024-09-14T00:04:56.609173+0000 mgr.a (mgr.14355) 4502 : audit [DBG] from='client.107316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:58 smithi171 bash[25040]: audit 2024-09-14T00:04:56.609173+0000 mgr.a (mgr.14355) 4502 : audit [DBG] from='client.107316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:58 smithi007 bash[22722]: audit 2024-09-14T00:04:56.609173+0000 mgr.a (mgr.14355) 4502 : audit [DBG] from='client.107316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:04:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:04:59 smithi131 bash[24745]: cluster 2024-09-14T00:04:58.149112+0000 mgr.a (mgr.14355) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:04:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:04:59 smithi171 bash[25040]: cluster 2024-09-14T00:04:58.149112+0000 mgr.a (mgr.14355) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:04:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:04:59 smithi007 bash[22722]: cluster 2024-09-14T00:04:58.149112+0000 mgr.a (mgr.14355) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:05:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:01 smithi131 bash[24745]: cluster 2024-09-14T00:05:00.149889+0000 mgr.a (mgr.14355) 4504 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:05:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:01 smithi171 bash[25040]: cluster 2024-09-14T00:05:00.149889+0000 mgr.a (mgr.14355) 4504 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:05:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:01 smithi007 bash[22722]: cluster 2024-09-14T00:05:00.149889+0000 mgr.a (mgr.14355) 4504 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:05:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:02.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:02.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:02.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:02.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:02.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:03 smithi131 bash[24745]: cluster 2024-09-14T00:05:02.151021+0000 mgr.a (mgr.14355) 4505 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T00:05:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:03 smithi131 bash[24745]: audit 2024-09-14T00:05:02.367415+0000 mgr.a (mgr.14355) 4506 : audit [DBG] from='client.107391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:03 smithi171 bash[25040]: cluster 2024-09-14T00:05:02.151021+0000 mgr.a (mgr.14355) 4505 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T00:05:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:03 smithi171 bash[25040]: audit 2024-09-14T00:05:02.367415+0000 mgr.a (mgr.14355) 4506 : audit [DBG] from='client.107391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:03 smithi007 bash[22722]: cluster 2024-09-14T00:05:02.151021+0000 mgr.a (mgr.14355) 4505 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T00:05:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:03 smithi007 bash[22722]: audit 2024-09-14T00:05:02.367415+0000 mgr.a (mgr.14355) 4506 : audit [DBG] from='client.107391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:05 smithi131 bash[24745]: cluster 2024-09-14T00:05:04.151893+0000 mgr.a (mgr.14355) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:05 smithi171 bash[25040]: cluster 2024-09-14T00:05:04.151893+0000 mgr.a (mgr.14355) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:05 smithi007 bash[22722]: cluster 2024-09-14T00:05:04.151893+0000 mgr.a (mgr.14355) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:07 smithi131 bash[24745]: cluster 2024-09-14T00:05:06.154099+0000 mgr.a (mgr.14355) 4508 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:07 smithi171 bash[25040]: cluster 2024-09-14T00:05:06.154099+0000 mgr.a (mgr.14355) 4508 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:07 smithi007 bash[22722]: cluster 2024-09-14T00:05:06.154099+0000 mgr.a (mgr.14355) 4508 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:08.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:08.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:08.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:09 smithi131 bash[24745]: audit 2024-09-14T00:05:08.108869+0000 mgr.a (mgr.14355) 4509 : audit [DBG] from='client.107469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:09 smithi131 bash[24745]: cluster 2024-09-14T00:05:08.154980+0000 mgr.a (mgr.14355) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:09 smithi171 bash[25040]: audit 2024-09-14T00:05:08.108869+0000 mgr.a (mgr.14355) 4509 : audit [DBG] from='client.107469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:09 smithi171 bash[25040]: cluster 2024-09-14T00:05:08.154980+0000 mgr.a (mgr.14355) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:09 smithi007 bash[22722]: audit 2024-09-14T00:05:08.108869+0000 mgr.a (mgr.14355) 4509 : audit [DBG] from='client.107469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:09 smithi007 bash[22722]: cluster 2024-09-14T00:05:08.154980+0000 mgr.a (mgr.14355) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:11 smithi131 bash[24745]: cluster 2024-09-14T00:05:10.155859+0000 mgr.a (mgr.14355) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:11 smithi171 bash[25040]: cluster 2024-09-14T00:05:10.155859+0000 mgr.a (mgr.14355) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:11 smithi007 bash[22722]: cluster 2024-09-14T00:05:10.155859+0000 mgr.a (mgr.14355) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:13 smithi131 bash[24745]: cluster 2024-09-14T00:05:12.158174+0000 mgr.a (mgr.14355) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:13 smithi171 bash[25040]: cluster 2024-09-14T00:05:12.158174+0000 mgr.a (mgr.14355) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:13 smithi007 bash[22722]: cluster 2024-09-14T00:05:12.158174+0000 mgr.a (mgr.14355) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:14.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:15 smithi131 bash[24745]: audit 2024-09-14T00:05:13.853445+0000 mgr.a (mgr.14355) 4513 : audit [DBG] from='client.107544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:15 smithi131 bash[24745]: cluster 2024-09-14T00:05:14.158726+0000 mgr.a (mgr.14355) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:15 smithi171 bash[25040]: audit 2024-09-14T00:05:13.853445+0000 mgr.a (mgr.14355) 4513 : audit [DBG] from='client.107544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:15 smithi171 bash[25040]: cluster 2024-09-14T00:05:14.158726+0000 mgr.a (mgr.14355) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:15 smithi007 bash[22722]: audit 2024-09-14T00:05:13.853445+0000 mgr.a (mgr.14355) 4513 : audit [DBG] from='client.107544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:15 smithi007 bash[22722]: cluster 2024-09-14T00:05:14.158726+0000 mgr.a (mgr.14355) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:17 smithi131 bash[24745]: cluster 2024-09-14T00:05:16.161016+0000 mgr.a (mgr.14355) 4515 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:17 smithi171 bash[25040]: cluster 2024-09-14T00:05:16.161016+0000 mgr.a (mgr.14355) 4515 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:17 smithi007 bash[22722]: cluster 2024-09-14T00:05:16.161016+0000 mgr.a (mgr.14355) 4515 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:19 smithi131 bash[24745]: cluster 2024-09-14T00:05:18.161837+0000 mgr.a (mgr.14355) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:19 smithi171 bash[25040]: cluster 2024-09-14T00:05:18.161837+0000 mgr.a (mgr.14355) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:19 smithi007 bash[22722]: cluster 2024-09-14T00:05:18.161837+0000 mgr.a (mgr.14355) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:20.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:20.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:20.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:20.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:20.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:21 smithi131 bash[24745]: audit 2024-09-14T00:05:19.634722+0000 mgr.a (mgr.14355) 4517 : audit [DBG] from='client.107619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:21 smithi131 bash[24745]: cluster 2024-09-14T00:05:20.162416+0000 mgr.a (mgr.14355) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:21 smithi171 bash[25040]: audit 2024-09-14T00:05:19.634722+0000 mgr.a (mgr.14355) 4517 : audit [DBG] from='client.107619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:21 smithi171 bash[25040]: cluster 2024-09-14T00:05:20.162416+0000 mgr.a (mgr.14355) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:21 smithi007 bash[22722]: audit 2024-09-14T00:05:19.634722+0000 mgr.a (mgr.14355) 4517 : audit [DBG] from='client.107619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:21 smithi007 bash[22722]: cluster 2024-09-14T00:05:20.162416+0000 mgr.a (mgr.14355) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:23 smithi131 bash[24745]: cluster 2024-09-14T00:05:22.164643+0000 mgr.a (mgr.14355) 4519 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:23 smithi171 bash[25040]: cluster 2024-09-14T00:05:22.164643+0000 mgr.a (mgr.14355) 4519 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:23 smithi007 bash[22722]: cluster 2024-09-14T00:05:22.164643+0000 mgr.a (mgr.14355) 4519 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:25 smithi131 bash[24745]: cluster 2024-09-14T00:05:24.165465+0000 mgr.a (mgr.14355) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:25 smithi171 bash[25040]: cluster 2024-09-14T00:05:24.165465+0000 mgr.a (mgr.14355) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:25 smithi007 bash[22722]: cluster 2024-09-14T00:05:24.165465+0000 mgr.a (mgr.14355) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:25.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:25.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:25.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:25.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:25.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:26 smithi171 bash[25040]: audit 2024-09-14T00:05:25.407382+0000 mgr.a (mgr.14355) 4521 : audit [DBG] from='client.107694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:26 smithi007 bash[22722]: audit 2024-09-14T00:05:25.407382+0000 mgr.a (mgr.14355) 4521 : audit [DBG] from='client.107694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:26 smithi131 bash[24745]: audit 2024-09-14T00:05:25.407382+0000 mgr.a (mgr.14355) 4521 : audit [DBG] from='client.107694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:27 smithi007 bash[22722]: cluster 2024-09-14T00:05:26.168307+0000 mgr.a (mgr.14355) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:27 smithi131 bash[24745]: cluster 2024-09-14T00:05:26.168307+0000 mgr.a (mgr.14355) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:27 smithi171 bash[25040]: cluster 2024-09-14T00:05:26.168307+0000 mgr.a (mgr.14355) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:29 smithi007 bash[22722]: cluster 2024-09-14T00:05:28.169098+0000 mgr.a (mgr.14355) 4523 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:29 smithi131 bash[24745]: cluster 2024-09-14T00:05:28.169098+0000 mgr.a (mgr.14355) 4523 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:29 smithi171 bash[25040]: cluster 2024-09-14T00:05:28.169098+0000 mgr.a (mgr.14355) 4523 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:30.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:30.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:30.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:31.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:31 smithi007 bash[22722]: cluster 2024-09-14T00:05:30.169887+0000 mgr.a (mgr.14355) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:05:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:31 smithi131 bash[24745]: cluster 2024-09-14T00:05:30.169887+0000 mgr.a (mgr.14355) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:05:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:31 smithi171 bash[25040]: cluster 2024-09-14T00:05:30.169887+0000 mgr.a (mgr.14355) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:05:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:32 smithi007 bash[22722]: audit 2024-09-14T00:05:31.164332+0000 mgr.a (mgr.14355) 4525 : audit [DBG] from='client.107772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:32 smithi131 bash[24745]: audit 2024-09-14T00:05:31.164332+0000 mgr.a (mgr.14355) 4525 : audit [DBG] from='client.107772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:32 smithi171 bash[25040]: audit 2024-09-14T00:05:31.164332+0000 mgr.a (mgr.14355) 4525 : audit [DBG] from='client.107772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:33 smithi007 bash[22722]: cluster 2024-09-14T00:05:32.172762+0000 mgr.a (mgr.14355) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:33 smithi131 bash[24745]: cluster 2024-09-14T00:05:32.172762+0000 mgr.a (mgr.14355) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:33 smithi171 bash[25040]: cluster 2024-09-14T00:05:32.172762+0000 mgr.a (mgr.14355) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:35 smithi007 bash[22722]: cluster 2024-09-14T00:05:34.173705+0000 mgr.a (mgr.14355) 4527 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:35 smithi131 bash[24745]: cluster 2024-09-14T00:05:34.173705+0000 mgr.a (mgr.14355) 4527 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:35 smithi171 bash[25040]: cluster 2024-09-14T00:05:34.173705+0000 mgr.a (mgr.14355) 4527 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:05:36.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:36.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:37.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:37 smithi007 bash[22722]: cluster 2024-09-14T00:05:36.175919+0000 mgr.a (mgr.14355) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:37 smithi131 bash[24745]: cluster 2024-09-14T00:05:36.175919+0000 mgr.a (mgr.14355) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:37 smithi171 bash[25040]: cluster 2024-09-14T00:05:36.175919+0000 mgr.a (mgr.14355) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:38 smithi007 bash[22722]: audit 2024-09-14T00:05:36.926900+0000 mgr.a (mgr.14355) 4529 : audit [DBG] from='client.107850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:38 smithi131 bash[24745]: audit 2024-09-14T00:05:36.926900+0000 mgr.a (mgr.14355) 4529 : audit [DBG] from='client.107850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:38 smithi171 bash[25040]: audit 2024-09-14T00:05:36.926900+0000 mgr.a (mgr.14355) 4529 : audit [DBG] from='client.107850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:39 smithi007 bash[22722]: cluster 2024-09-14T00:05:38.176885+0000 mgr.a (mgr.14355) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:39 smithi131 bash[24745]: cluster 2024-09-14T00:05:38.176885+0000 mgr.a (mgr.14355) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:39 smithi171 bash[25040]: cluster 2024-09-14T00:05:38.176885+0000 mgr.a (mgr.14355) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:41 smithi007 bash[22722]: cluster 2024-09-14T00:05:40.177678+0000 mgr.a (mgr.14355) 4531 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:41 smithi131 bash[24745]: cluster 2024-09-14T00:05:40.177678+0000 mgr.a (mgr.14355) 4531 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:41 smithi171 bash[25040]: cluster 2024-09-14T00:05:40.177678+0000 mgr.a (mgr.14355) 4531 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:42.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:42 smithi007 bash[22722]: audit 2024-09-14T00:05:41.660125+0000 mon.a (mon.0) 1279 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:05:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:42 smithi131 bash[24745]: audit 2024-09-14T00:05:41.660125+0000 mon.a (mon.0) 1279 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:05:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:42 smithi171 bash[25040]: audit 2024-09-14T00:05:41.660125+0000 mon.a (mon.0) 1279 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:05:43.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:43.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:43.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:43.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22972]: debug 2024-09-14T00:05:43.228+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:05:43.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22972]: debug 2024-09-14T00:05:43.236+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:05:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22722]: cluster 2024-09-14T00:05:42.179915+0000 mgr.a (mgr.14355) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22722]: audit 2024-09-14T00:05:42.521636+0000 mon.a (mon.0) 1280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:05:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22722]: audit 2024-09-14T00:05:42.523054+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:05:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22722]: audit 2024-09-14T00:05:42.530930+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:05:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:43 smithi007 bash[22722]: audit 2024-09-14T00:05:42.533980+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:43 smithi131 bash[24745]: cluster 2024-09-14T00:05:42.179915+0000 mgr.a (mgr.14355) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:43 smithi131 bash[24745]: audit 2024-09-14T00:05:42.521636+0000 mon.a (mon.0) 1280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:05:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:43 smithi131 bash[24745]: audit 2024-09-14T00:05:42.523054+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:05:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:43 smithi131 bash[24745]: audit 2024-09-14T00:05:42.530930+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:05:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:43 smithi131 bash[24745]: audit 2024-09-14T00:05:42.533980+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:43 smithi171 bash[25040]: cluster 2024-09-14T00:05:42.179915+0000 mgr.a (mgr.14355) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:05:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:43 smithi171 bash[25040]: audit 2024-09-14T00:05:42.521636+0000 mon.a (mon.0) 1280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:05:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:43 smithi171 bash[25040]: audit 2024-09-14T00:05:42.523054+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:05:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:43 smithi171 bash[25040]: audit 2024-09-14T00:05:42.530930+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:05:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:43 smithi171 bash[25040]: audit 2024-09-14T00:05:42.533980+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:44 smithi007 bash[22722]: audit 2024-09-14T00:05:42.536197+0000 mgr.a (mgr.14355) 4533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:44 smithi007 bash[22722]: audit 2024-09-14T00:05:42.687850+0000 mgr.a (mgr.14355) 4534 : audit [DBG] from='client.107928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:44 smithi007 bash[22722]: audit 2024-09-14T00:05:43.231276+0000 mgr.a (mgr.14355) 4535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:05:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:44 smithi007 bash[22722]: cephadm 2024-09-14T00:05:43.241334+0000 mgr.a (mgr.14355) 4536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:05:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:44 smithi131 bash[24745]: audit 2024-09-14T00:05:42.536197+0000 mgr.a (mgr.14355) 4533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:44 smithi131 bash[24745]: audit 2024-09-14T00:05:42.687850+0000 mgr.a (mgr.14355) 4534 : audit [DBG] from='client.107928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:44 smithi131 bash[24745]: audit 2024-09-14T00:05:43.231276+0000 mgr.a (mgr.14355) 4535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:05:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:44 smithi131 bash[24745]: cephadm 2024-09-14T00:05:43.241334+0000 mgr.a (mgr.14355) 4536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:05:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:44 smithi171 bash[25040]: audit 2024-09-14T00:05:42.536197+0000 mgr.a (mgr.14355) 4533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:05:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:44 smithi171 bash[25040]: audit 2024-09-14T00:05:42.687850+0000 mgr.a (mgr.14355) 4534 : audit [DBG] from='client.107928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:44 smithi171 bash[25040]: audit 2024-09-14T00:05:43.231276+0000 mgr.a (mgr.14355) 4535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:05:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:44 smithi171 bash[25040]: cephadm 2024-09-14T00:05:43.241334+0000 mgr.a (mgr.14355) 4536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:05:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:45 smithi007 bash[22722]: cluster 2024-09-14T00:05:44.180907+0000 mgr.a (mgr.14355) 4537 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:45 smithi131 bash[24745]: cluster 2024-09-14T00:05:44.180907+0000 mgr.a (mgr.14355) 4537 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:45 smithi171 bash[25040]: cluster 2024-09-14T00:05:44.180907+0000 mgr.a (mgr.14355) 4537 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:47 smithi007 bash[22722]: cluster 2024-09-14T00:05:46.183217+0000 mgr.a (mgr.14355) 4538 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:47 smithi131 bash[24745]: cluster 2024-09-14T00:05:46.183217+0000 mgr.a (mgr.14355) 4538 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:47 smithi171 bash[25040]: cluster 2024-09-14T00:05:46.183217+0000 mgr.a (mgr.14355) 4538 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:48.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:48.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:49.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:49.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:49 smithi007 bash[22722]: cluster 2024-09-14T00:05:48.184023+0000 mgr.a (mgr.14355) 4539 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:49 smithi131 bash[24745]: cluster 2024-09-14T00:05:48.184023+0000 mgr.a (mgr.14355) 4539 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:49 smithi171 bash[25040]: cluster 2024-09-14T00:05:48.184023+0000 mgr.a (mgr.14355) 4539 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:50 smithi007 bash[22722]: audit 2024-09-14T00:05:48.968832+0000 mgr.a (mgr.14355) 4540 : audit [DBG] from='client.108114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:50 smithi131 bash[24745]: audit 2024-09-14T00:05:48.968832+0000 mgr.a (mgr.14355) 4540 : audit [DBG] from='client.108114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:50 smithi171 bash[25040]: audit 2024-09-14T00:05:48.968832+0000 mgr.a (mgr.14355) 4540 : audit [DBG] from='client.108114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:51 smithi007 bash[22722]: cluster 2024-09-14T00:05:50.185034+0000 mgr.a (mgr.14355) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:51 smithi131 bash[24745]: cluster 2024-09-14T00:05:50.185034+0000 mgr.a (mgr.14355) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:51 smithi171 bash[25040]: cluster 2024-09-14T00:05:50.185034+0000 mgr.a (mgr.14355) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:53 smithi007 bash[22722]: cluster 2024-09-14T00:05:52.187473+0000 mgr.a (mgr.14355) 4542 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:53 smithi131 bash[24745]: cluster 2024-09-14T00:05:52.187473+0000 mgr.a (mgr.14355) 4542 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:53 smithi171 bash[25040]: cluster 2024-09-14T00:05:52.187473+0000 mgr.a (mgr.14355) 4542 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:05:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:05:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:05:55.149 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:05:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:05:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:05:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:05:55.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:05:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:55 smithi007 bash[22722]: cluster 2024-09-14T00:05:54.188442+0000 mgr.a (mgr.14355) 4543 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:55 smithi131 bash[24745]: cluster 2024-09-14T00:05:54.188442+0000 mgr.a (mgr.14355) 4543 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:55 smithi171 bash[25040]: cluster 2024-09-14T00:05:54.188442+0000 mgr.a (mgr.14355) 4543 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:56 smithi007 bash[22722]: audit 2024-09-14T00:05:54.719921+0000 mgr.a (mgr.14355) 4544 : audit [DBG] from='client.108189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:56 smithi131 bash[24745]: audit 2024-09-14T00:05:54.719921+0000 mgr.a (mgr.14355) 4544 : audit [DBG] from='client.108189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:56 smithi171 bash[25040]: audit 2024-09-14T00:05:54.719921+0000 mgr.a (mgr.14355) 4544 : audit [DBG] from='client.108189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:05:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:57 smithi007 bash[22722]: cluster 2024-09-14T00:05:56.191040+0000 mgr.a (mgr.14355) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:57 smithi131 bash[24745]: cluster 2024-09-14T00:05:56.191040+0000 mgr.a (mgr.14355) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:57 smithi171 bash[25040]: cluster 2024-09-14T00:05:56.191040+0000 mgr.a (mgr.14355) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:05:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:05:59 smithi007 bash[22722]: cluster 2024-09-14T00:05:58.191855+0000 mgr.a (mgr.14355) 4546 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:05:59 smithi131 bash[24745]: cluster 2024-09-14T00:05:58.191855+0000 mgr.a (mgr.14355) 4546 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:05:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:05:59 smithi171 bash[25040]: cluster 2024-09-14T00:05:58.191855+0000 mgr.a (mgr.14355) 4546 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:00.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:00.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:00.892 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:00.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:00.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:00.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:00.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:01 smithi007 bash[22722]: cluster 2024-09-14T00:06:00.192471+0000 mgr.a (mgr.14355) 4547 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:01 smithi007 bash[22722]: audit 2024-09-14T00:06:00.484012+0000 mgr.a (mgr.14355) 4548 : audit [DBG] from='client.108264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:01 smithi131 bash[24745]: cluster 2024-09-14T00:06:00.192471+0000 mgr.a (mgr.14355) 4547 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:01 smithi131 bash[24745]: audit 2024-09-14T00:06:00.484012+0000 mgr.a (mgr.14355) 4548 : audit [DBG] from='client.108264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:01 smithi171 bash[25040]: cluster 2024-09-14T00:06:00.192471+0000 mgr.a (mgr.14355) 4547 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:01 smithi171 bash[25040]: audit 2024-09-14T00:06:00.484012+0000 mgr.a (mgr.14355) 4548 : audit [DBG] from='client.108264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:03 smithi007 bash[22722]: cluster 2024-09-14T00:06:02.195395+0000 mgr.a (mgr.14355) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:03 smithi131 bash[24745]: cluster 2024-09-14T00:06:02.195395+0000 mgr.a (mgr.14355) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:03 smithi171 bash[25040]: cluster 2024-09-14T00:06:02.195395+0000 mgr.a (mgr.14355) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:05 smithi007 bash[22722]: cluster 2024-09-14T00:06:04.196183+0000 mgr.a (mgr.14355) 4550 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:05 smithi131 bash[24745]: cluster 2024-09-14T00:06:04.196183+0000 mgr.a (mgr.14355) 4550 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:05 smithi171 bash[25040]: cluster 2024-09-14T00:06:04.196183+0000 mgr.a (mgr.14355) 4550 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:05.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:05.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:05.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:06.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:07 smithi007 bash[22722]: cluster 2024-09-14T00:06:06.198126+0000 mgr.a (mgr.14355) 4551 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:07 smithi007 bash[22722]: audit 2024-09-14T00:06:06.226838+0000 mgr.a (mgr.14355) 4552 : audit [DBG] from='client.108342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:07 smithi131 bash[24745]: cluster 2024-09-14T00:06:06.198126+0000 mgr.a (mgr.14355) 4551 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:07 smithi131 bash[24745]: audit 2024-09-14T00:06:06.226838+0000 mgr.a (mgr.14355) 4552 : audit [DBG] from='client.108342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:07 smithi171 bash[25040]: cluster 2024-09-14T00:06:06.198126+0000 mgr.a (mgr.14355) 4551 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:07 smithi171 bash[25040]: audit 2024-09-14T00:06:06.226838+0000 mgr.a (mgr.14355) 4552 : audit [DBG] from='client.108342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:09 smithi007 bash[22722]: cluster 2024-09-14T00:06:08.199184+0000 mgr.a (mgr.14355) 4553 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:09 smithi131 bash[24745]: cluster 2024-09-14T00:06:08.199184+0000 mgr.a (mgr.14355) 4553 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:09 smithi171 bash[25040]: cluster 2024-09-14T00:06:08.199184+0000 mgr.a (mgr.14355) 4553 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:11.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:11 smithi007 bash[22722]: cluster 2024-09-14T00:06:10.200097+0000 mgr.a (mgr.14355) 4554 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:06:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:11 smithi131 bash[24745]: cluster 2024-09-14T00:06:10.200097+0000 mgr.a (mgr.14355) 4554 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:06:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:11 smithi171 bash[25040]: cluster 2024-09-14T00:06:10.200097+0000 mgr.a (mgr.14355) 4554 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:06:12.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:12.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:12.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:13 smithi007 bash[22722]: audit 2024-09-14T00:06:11.984038+0000 mgr.a (mgr.14355) 4555 : audit [DBG] from='client.108414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:13 smithi007 bash[22722]: cluster 2024-09-14T00:06:12.207481+0000 mgr.a (mgr.14355) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:13 smithi131 bash[24745]: audit 2024-09-14T00:06:11.984038+0000 mgr.a (mgr.14355) 4555 : audit [DBG] from='client.108414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:13 smithi131 bash[24745]: cluster 2024-09-14T00:06:12.207481+0000 mgr.a (mgr.14355) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:13 smithi171 bash[25040]: audit 2024-09-14T00:06:11.984038+0000 mgr.a (mgr.14355) 4555 : audit [DBG] from='client.108414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:13 smithi171 bash[25040]: cluster 2024-09-14T00:06:12.207481+0000 mgr.a (mgr.14355) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:15 smithi007 bash[22722]: cluster 2024-09-14T00:06:14.208368+0000 mgr.a (mgr.14355) 4557 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:15 smithi131 bash[24745]: cluster 2024-09-14T00:06:14.208368+0000 mgr.a (mgr.14355) 4557 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:15 smithi171 bash[25040]: cluster 2024-09-14T00:06:14.208368+0000 mgr.a (mgr.14355) 4557 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:17 smithi007 bash[22722]: cluster 2024-09-14T00:06:16.210670+0000 mgr.a (mgr.14355) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:17 smithi131 bash[24745]: cluster 2024-09-14T00:06:16.210670+0000 mgr.a (mgr.14355) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:17 smithi171 bash[25040]: cluster 2024-09-14T00:06:16.210670+0000 mgr.a (mgr.14355) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:18.136 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:18.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:18.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:18.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:18.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:19 smithi007 bash[22722]: audit 2024-09-14T00:06:17.725668+0000 mgr.a (mgr.14355) 4559 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:19 smithi007 bash[22722]: cluster 2024-09-14T00:06:18.211649+0000 mgr.a (mgr.14355) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:19 smithi131 bash[24745]: audit 2024-09-14T00:06:17.725668+0000 mgr.a (mgr.14355) 4559 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:19 smithi131 bash[24745]: cluster 2024-09-14T00:06:18.211649+0000 mgr.a (mgr.14355) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:19 smithi171 bash[25040]: audit 2024-09-14T00:06:17.725668+0000 mgr.a (mgr.14355) 4559 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:19 smithi171 bash[25040]: cluster 2024-09-14T00:06:18.211649+0000 mgr.a (mgr.14355) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:21 smithi007 bash[22722]: cluster 2024-09-14T00:06:20.212439+0000 mgr.a (mgr.14355) 4561 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:21 smithi131 bash[24745]: cluster 2024-09-14T00:06:20.212439+0000 mgr.a (mgr.14355) 4561 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:21 smithi171 bash[25040]: cluster 2024-09-14T00:06:20.212439+0000 mgr.a (mgr.14355) 4561 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:23.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:23.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:23 smithi007 bash[22722]: cluster 2024-09-14T00:06:22.214744+0000 mgr.a (mgr.14355) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:23 smithi131 bash[24745]: cluster 2024-09-14T00:06:22.214744+0000 mgr.a (mgr.14355) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:23 smithi171 bash[25040]: cluster 2024-09-14T00:06:22.214744+0000 mgr.a (mgr.14355) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:23.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:24 smithi131 bash[24745]: audit 2024-09-14T00:06:23.470036+0000 mgr.a (mgr.14355) 4563 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:24 smithi171 bash[25040]: audit 2024-09-14T00:06:23.470036+0000 mgr.a (mgr.14355) 4563 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:24 smithi007 bash[22722]: audit 2024-09-14T00:06:23.470036+0000 mgr.a (mgr.14355) 4563 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:25 smithi131 bash[24745]: cluster 2024-09-14T00:06:24.215737+0000 mgr.a (mgr.14355) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:25 smithi171 bash[25040]: cluster 2024-09-14T00:06:24.215737+0000 mgr.a (mgr.14355) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:25 smithi007 bash[22722]: cluster 2024-09-14T00:06:24.215737+0000 mgr.a (mgr.14355) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:27 smithi131 bash[24745]: cluster 2024-09-14T00:06:26.217997+0000 mgr.a (mgr.14355) 4565 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:27 smithi171 bash[25040]: cluster 2024-09-14T00:06:26.217997+0000 mgr.a (mgr.14355) 4565 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:27 smithi007 bash[22722]: cluster 2024-09-14T00:06:26.217997+0000 mgr.a (mgr.14355) 4565 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:28.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:28.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:29.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:29.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:29 smithi131 bash[24745]: cluster 2024-09-14T00:06:28.218802+0000 mgr.a (mgr.14355) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:29 smithi171 bash[25040]: cluster 2024-09-14T00:06:28.218802+0000 mgr.a (mgr.14355) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:29 smithi007 bash[22722]: cluster 2024-09-14T00:06:28.218802+0000 mgr.a (mgr.14355) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:30 smithi131 bash[24745]: audit 2024-09-14T00:06:29.219772+0000 mgr.a (mgr.14355) 4567 : audit [DBG] from='client.108639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:30 smithi171 bash[25040]: audit 2024-09-14T00:06:29.219772+0000 mgr.a (mgr.14355) 4567 : audit [DBG] from='client.108639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:30 smithi007 bash[22722]: audit 2024-09-14T00:06:29.219772+0000 mgr.a (mgr.14355) 4567 : audit [DBG] from='client.108639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:31 smithi131 bash[24745]: cluster 2024-09-14T00:06:30.219775+0000 mgr.a (mgr.14355) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:31 smithi171 bash[25040]: cluster 2024-09-14T00:06:30.219775+0000 mgr.a (mgr.14355) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:31 smithi007 bash[22722]: cluster 2024-09-14T00:06:30.219775+0000 mgr.a (mgr.14355) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:33 smithi131 bash[24745]: cluster 2024-09-14T00:06:32.222135+0000 mgr.a (mgr.14355) 4569 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:33 smithi171 bash[25040]: cluster 2024-09-14T00:06:32.222135+0000 mgr.a (mgr.14355) 4569 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:33 smithi007 bash[22722]: cluster 2024-09-14T00:06:32.222135+0000 mgr.a (mgr.14355) 4569 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:06:34.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:34.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:34.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:35.440 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:35.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:35 smithi131 bash[24745]: cluster 2024-09-14T00:06:34.223081+0000 mgr.a (mgr.14355) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:35 smithi171 bash[25040]: cluster 2024-09-14T00:06:34.223081+0000 mgr.a (mgr.14355) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:35 smithi007 bash[22722]: cluster 2024-09-14T00:06:34.223081+0000 mgr.a (mgr.14355) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:36 smithi131 bash[24745]: audit 2024-09-14T00:06:35.003393+0000 mgr.a (mgr.14355) 4571 : audit [DBG] from='client.108717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:36 smithi171 bash[25040]: audit 2024-09-14T00:06:35.003393+0000 mgr.a (mgr.14355) 4571 : audit [DBG] from='client.108717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:36 smithi007 bash[22722]: audit 2024-09-14T00:06:35.003393+0000 mgr.a (mgr.14355) 4571 : audit [DBG] from='client.108717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:37 smithi131 bash[24745]: cluster 2024-09-14T00:06:36.225922+0000 mgr.a (mgr.14355) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:37 smithi171 bash[25040]: cluster 2024-09-14T00:06:36.225922+0000 mgr.a (mgr.14355) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:37 smithi007 bash[22722]: cluster 2024-09-14T00:06:36.225922+0000 mgr.a (mgr.14355) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:39 smithi131 bash[24745]: cluster 2024-09-14T00:06:38.226929+0000 mgr.a (mgr.14355) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:39 smithi171 bash[25040]: cluster 2024-09-14T00:06:38.226929+0000 mgr.a (mgr.14355) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:39 smithi007 bash[22722]: cluster 2024-09-14T00:06:38.226929+0000 mgr.a (mgr.14355) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:40.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:40.443 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:40.443 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:41.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:41.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:41 smithi131 bash[24745]: cluster 2024-09-14T00:06:40.228917+0000 mgr.a (mgr.14355) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:41 smithi171 bash[25040]: cluster 2024-09-14T00:06:40.228917+0000 mgr.a (mgr.14355) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:41 smithi007 bash[22722]: cluster 2024-09-14T00:06:40.228917+0000 mgr.a (mgr.14355) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:42 smithi131 bash[24745]: audit 2024-09-14T00:06:40.773907+0000 mgr.a (mgr.14355) 4575 : audit [DBG] from='client.108795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:42 smithi171 bash[25040]: audit 2024-09-14T00:06:40.773907+0000 mgr.a (mgr.14355) 4575 : audit [DBG] from='client.108795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:42 smithi007 bash[22722]: audit 2024-09-14T00:06:40.773907+0000 mgr.a (mgr.14355) 4575 : audit [DBG] from='client.108795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:43 smithi131 bash[24745]: cluster 2024-09-14T00:06:42.229873+0000 mgr.a (mgr.14355) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:43 smithi131 bash[24745]: audit 2024-09-14T00:06:43.298669+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:06:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:43 smithi171 bash[25040]: cluster 2024-09-14T00:06:42.229873+0000 mgr.a (mgr.14355) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:43 smithi171 bash[25040]: audit 2024-09-14T00:06:43.298669+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:06:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:43 smithi007 bash[22722]: cluster 2024-09-14T00:06:42.229873+0000 mgr.a (mgr.14355) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:43 smithi007 bash[22722]: audit 2024-09-14T00:06:43.298669+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:06:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:44 smithi131 bash[24745]: cluster 2024-09-14T00:06:44.230687+0000 mgr.a (mgr.14355) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:44 smithi171 bash[25040]: cluster 2024-09-14T00:06:44.230687+0000 mgr.a (mgr.14355) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:44 smithi007 bash[22722]: cluster 2024-09-14T00:06:44.230687+0000 mgr.a (mgr.14355) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:06:46.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:46.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:46.953 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:46.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:46.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:46.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:46.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:47 smithi007 bash[22722]: cluster 2024-09-14T00:06:46.232730+0000 mgr.a (mgr.14355) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:47 smithi131 bash[24745]: cluster 2024-09-14T00:06:46.232730+0000 mgr.a (mgr.14355) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:47 smithi171 bash[25040]: cluster 2024-09-14T00:06:46.232730+0000 mgr.a (mgr.14355) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:48 smithi007 bash[22722]: audit 2024-09-14T00:06:46.525132+0000 mgr.a (mgr.14355) 4579 : audit [DBG] from='client.108870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:48 smithi131 bash[24745]: audit 2024-09-14T00:06:46.525132+0000 mgr.a (mgr.14355) 4579 : audit [DBG] from='client.108870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:48 smithi171 bash[25040]: audit 2024-09-14T00:06:46.525132+0000 mgr.a (mgr.14355) 4579 : audit [DBG] from='client.108870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: cluster 2024-09-14T00:06:48.233701+0000 mgr.a (mgr.14355) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.646899+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.651227+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.655163+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.658066+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.697413+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:49 smithi007 bash[22722]: audit 2024-09-14T00:06:48.704019+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: cluster 2024-09-14T00:06:48.233701+0000 mgr.a (mgr.14355) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.646899+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.651227+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.655163+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.658066+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.697413+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:49 smithi131 bash[24745]: audit 2024-09-14T00:06:48.704019+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: cluster 2024-09-14T00:06:48.233701+0000 mgr.a (mgr.14355) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:06:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.646899+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.651227+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.655163+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.658066+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.697413+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:49 smithi171 bash[25040]: audit 2024-09-14T00:06:48.704019+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22972]: debug 2024-09-14T00:06:50.147+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22972]: debug 2024-09-14T00:06:50.151+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22722]: audit 2024-09-14T00:06:49.411741+0000 mon.a (mon.0) 1291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22722]: audit 2024-09-14T00:06:49.413418+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22722]: audit 2024-09-14T00:06:49.423582+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22722]: audit 2024-09-14T00:06:49.428373+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:50 smithi007 bash[22722]: audit 2024-09-14T00:06:49.430716+0000 mgr.a (mgr.14355) 4581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:50 smithi131 bash[24745]: audit 2024-09-14T00:06:49.411741+0000 mon.a (mon.0) 1291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:50 smithi131 bash[24745]: audit 2024-09-14T00:06:49.413418+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:50 smithi131 bash[24745]: audit 2024-09-14T00:06:49.423582+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:50 smithi131 bash[24745]: audit 2024-09-14T00:06:49.428373+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:50 smithi131 bash[24745]: audit 2024-09-14T00:06:49.430716+0000 mgr.a (mgr.14355) 4581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:50 smithi171 bash[25040]: audit 2024-09-14T00:06:49.411741+0000 mon.a (mon.0) 1291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:06:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:50 smithi171 bash[25040]: audit 2024-09-14T00:06:49.413418+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:06:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:50 smithi171 bash[25040]: audit 2024-09-14T00:06:49.423582+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:06:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:50 smithi171 bash[25040]: audit 2024-09-14T00:06:49.428373+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:50 smithi171 bash[25040]: audit 2024-09-14T00:06:49.430716+0000 mgr.a (mgr.14355) 4581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:06:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:51 smithi007 bash[22722]: audit 2024-09-14T00:06:50.153729+0000 mgr.a (mgr.14355) 4582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:06:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:51 smithi007 bash[22722]: cephadm 2024-09-14T00:06:50.154935+0000 mgr.a (mgr.14355) 4583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:06:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:51 smithi007 bash[22722]: cluster 2024-09-14T00:06:50.234858+0000 mgr.a (mgr.14355) 4584 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:51 smithi131 bash[24745]: audit 2024-09-14T00:06:50.153729+0000 mgr.a (mgr.14355) 4582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:06:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:51 smithi131 bash[24745]: cephadm 2024-09-14T00:06:50.154935+0000 mgr.a (mgr.14355) 4583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:06:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:51 smithi131 bash[24745]: cluster 2024-09-14T00:06:50.234858+0000 mgr.a (mgr.14355) 4584 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:51 smithi171 bash[25040]: audit 2024-09-14T00:06:50.153729+0000 mgr.a (mgr.14355) 4582 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:06:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:51 smithi171 bash[25040]: cephadm 2024-09-14T00:06:50.154935+0000 mgr.a (mgr.14355) 4583 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:06:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:51 smithi171 bash[25040]: cluster 2024-09-14T00:06:50.234858+0000 mgr.a (mgr.14355) 4584 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:51.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:52.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:53 smithi171 bash[25040]: cluster 2024-09-14T00:06:52.235329+0000 mgr.a (mgr.14355) 4585 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:53 smithi171 bash[25040]: audit 2024-09-14T00:06:52.282939+0000 mgr.a (mgr.14355) 4586 : audit [DBG] from='client.109053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:53 smithi007 bash[22722]: cluster 2024-09-14T00:06:52.235329+0000 mgr.a (mgr.14355) 4585 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:53 smithi007 bash[22722]: audit 2024-09-14T00:06:52.282939+0000 mgr.a (mgr.14355) 4586 : audit [DBG] from='client.109053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:53 smithi131 bash[24745]: cluster 2024-09-14T00:06:52.235329+0000 mgr.a (mgr.14355) 4585 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:53 smithi131 bash[24745]: audit 2024-09-14T00:06:52.282939+0000 mgr.a (mgr.14355) 4586 : audit [DBG] from='client.109053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:55 smithi007 bash[22722]: cluster 2024-09-14T00:06:54.236212+0000 mgr.a (mgr.14355) 4587 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:55 smithi131 bash[24745]: cluster 2024-09-14T00:06:54.236212+0000 mgr.a (mgr.14355) 4587 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:55 smithi171 bash[25040]: cluster 2024-09-14T00:06:54.236212+0000 mgr.a (mgr.14355) 4587 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:57 smithi007 bash[22722]: cluster 2024-09-14T00:06:56.238493+0000 mgr.a (mgr.14355) 4588 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:57 smithi131 bash[24745]: cluster 2024-09-14T00:06:56.238493+0000 mgr.a (mgr.14355) 4588 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:57 smithi171 bash[25040]: cluster 2024-09-14T00:06:56.238493+0000 mgr.a (mgr.14355) 4588 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:57.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:06:57.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:06:57.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:06:58.451 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:06:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:59 smithi007 bash[22722]: audit 2024-09-14T00:06:58.042730+0000 mgr.a (mgr.14355) 4589 : audit [DBG] from='client.109131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:06:59 smithi007 bash[22722]: cluster 2024-09-14T00:06:58.239102+0000 mgr.a (mgr.14355) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:59 smithi131 bash[24745]: audit 2024-09-14T00:06:58.042730+0000 mgr.a (mgr.14355) 4589 : audit [DBG] from='client.109131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:06:59 smithi131 bash[24745]: cluster 2024-09-14T00:06:58.239102+0000 mgr.a (mgr.14355) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:06:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:59 smithi171 bash[25040]: audit 2024-09-14T00:06:58.042730+0000 mgr.a (mgr.14355) 4589 : audit [DBG] from='client.109131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:06:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:06:59 smithi171 bash[25040]: cluster 2024-09-14T00:06:58.239102+0000 mgr.a (mgr.14355) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:01 smithi007 bash[22722]: cluster 2024-09-14T00:07:00.241344+0000 mgr.a (mgr.14355) 4591 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:01 smithi131 bash[24745]: cluster 2024-09-14T00:07:00.241344+0000 mgr.a (mgr.14355) 4591 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:01 smithi171 bash[25040]: cluster 2024-09-14T00:07:00.241344+0000 mgr.a (mgr.14355) 4591 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:03 smithi007 bash[22722]: cluster 2024-09-14T00:07:02.242267+0000 mgr.a (mgr.14355) 4592 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:03 smithi131 bash[24745]: cluster 2024-09-14T00:07:02.242267+0000 mgr.a (mgr.14355) 4592 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:03 smithi171 bash[25040]: cluster 2024-09-14T00:07:02.242267+0000 mgr.a (mgr.14355) 4592 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:04.180 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:05 smithi007 bash[22722]: audit 2024-09-14T00:07:03.776098+0000 mgr.a (mgr.14355) 4593 : audit [DBG] from='client.109206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:05 smithi007 bash[22722]: cluster 2024-09-14T00:07:04.242801+0000 mgr.a (mgr.14355) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:05 smithi131 bash[24745]: audit 2024-09-14T00:07:03.776098+0000 mgr.a (mgr.14355) 4593 : audit [DBG] from='client.109206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:05 smithi131 bash[24745]: cluster 2024-09-14T00:07:04.242801+0000 mgr.a (mgr.14355) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:05 smithi171 bash[25040]: audit 2024-09-14T00:07:03.776098+0000 mgr.a (mgr.14355) 4593 : audit [DBG] from='client.109206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:05 smithi171 bash[25040]: cluster 2024-09-14T00:07:04.242801+0000 mgr.a (mgr.14355) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:07 smithi007 bash[22722]: cluster 2024-09-14T00:07:06.245012+0000 mgr.a (mgr.14355) 4595 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:07 smithi131 bash[24745]: cluster 2024-09-14T00:07:06.245012+0000 mgr.a (mgr.14355) 4595 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:07 smithi171 bash[25040]: cluster 2024-09-14T00:07:06.245012+0000 mgr.a (mgr.14355) 4595 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:09 smithi007 bash[22722]: cluster 2024-09-14T00:07:08.245823+0000 mgr.a (mgr.14355) 4596 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:09 smithi131 bash[24745]: cluster 2024-09-14T00:07:08.245823+0000 mgr.a (mgr.14355) 4596 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:09 smithi171 bash[25040]: cluster 2024-09-14T00:07:08.245823+0000 mgr.a (mgr.14355) 4596 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:09.936 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:11 smithi007 bash[22722]: audit 2024-09-14T00:07:09.521242+0000 mgr.a (mgr.14355) 4597 : audit [DBG] from='client.109281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:11 smithi007 bash[22722]: cluster 2024-09-14T00:07:10.248174+0000 mgr.a (mgr.14355) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:11 smithi131 bash[24745]: audit 2024-09-14T00:07:09.521242+0000 mgr.a (mgr.14355) 4597 : audit [DBG] from='client.109281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:11 smithi131 bash[24745]: cluster 2024-09-14T00:07:10.248174+0000 mgr.a (mgr.14355) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:11 smithi171 bash[25040]: audit 2024-09-14T00:07:09.521242+0000 mgr.a (mgr.14355) 4597 : audit [DBG] from='client.109281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:11 smithi171 bash[25040]: cluster 2024-09-14T00:07:10.248174+0000 mgr.a (mgr.14355) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:13 smithi007 bash[22722]: cluster 2024-09-14T00:07:12.248966+0000 mgr.a (mgr.14355) 4599 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:13 smithi131 bash[24745]: cluster 2024-09-14T00:07:12.248966+0000 mgr.a (mgr.14355) 4599 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:13 smithi171 bash[25040]: cluster 2024-09-14T00:07:12.248966+0000 mgr.a (mgr.14355) 4599 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:14.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:14.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:14.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:15.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:15 smithi007 bash[22722]: cluster 2024-09-14T00:07:14.249894+0000 mgr.a (mgr.14355) 4600 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:15 smithi131 bash[24745]: cluster 2024-09-14T00:07:14.249894+0000 mgr.a (mgr.14355) 4600 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:15 smithi171 bash[25040]: cluster 2024-09-14T00:07:14.249894+0000 mgr.a (mgr.14355) 4600 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:16 smithi007 bash[22722]: audit 2024-09-14T00:07:15.259491+0000 mgr.a (mgr.14355) 4601 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:16 smithi131 bash[24745]: audit 2024-09-14T00:07:15.259491+0000 mgr.a (mgr.14355) 4601 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:16 smithi171 bash[25040]: audit 2024-09-14T00:07:15.259491+0000 mgr.a (mgr.14355) 4601 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:17 smithi007 bash[22722]: cluster 2024-09-14T00:07:16.252855+0000 mgr.a (mgr.14355) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:17 smithi131 bash[24745]: cluster 2024-09-14T00:07:16.252855+0000 mgr.a (mgr.14355) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:17 smithi171 bash[25040]: cluster 2024-09-14T00:07:16.252855+0000 mgr.a (mgr.14355) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:19 smithi007 bash[22722]: cluster 2024-09-14T00:07:18.253667+0000 mgr.a (mgr.14355) 4603 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:19 smithi131 bash[24745]: cluster 2024-09-14T00:07:18.253667+0000 mgr.a (mgr.14355) 4603 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:19 smithi171 bash[25040]: cluster 2024-09-14T00:07:18.253667+0000 mgr.a (mgr.14355) 4603 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:20.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:21.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:21.456 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:21 smithi007 bash[22722]: cluster 2024-09-14T00:07:20.255619+0000 mgr.a (mgr.14355) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:21 smithi131 bash[24745]: cluster 2024-09-14T00:07:20.255619+0000 mgr.a (mgr.14355) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:21 smithi171 bash[25040]: cluster 2024-09-14T00:07:20.255619+0000 mgr.a (mgr.14355) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:22 smithi007 bash[22722]: audit 2024-09-14T00:07:21.013176+0000 mgr.a (mgr.14355) 4605 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:22 smithi131 bash[24745]: audit 2024-09-14T00:07:21.013176+0000 mgr.a (mgr.14355) 4605 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:22 smithi171 bash[25040]: audit 2024-09-14T00:07:21.013176+0000 mgr.a (mgr.14355) 4605 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:23 smithi007 bash[22722]: cluster 2024-09-14T00:07:22.256672+0000 mgr.a (mgr.14355) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:23 smithi131 bash[24745]: cluster 2024-09-14T00:07:22.256672+0000 mgr.a (mgr.14355) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:23 smithi171 bash[25040]: cluster 2024-09-14T00:07:22.256672+0000 mgr.a (mgr.14355) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:25 smithi007 bash[22722]: cluster 2024-09-14T00:07:24.257654+0000 mgr.a (mgr.14355) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:25 smithi131 bash[24745]: cluster 2024-09-14T00:07:24.257654+0000 mgr.a (mgr.14355) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:25 smithi171 bash[25040]: cluster 2024-09-14T00:07:24.257654+0000 mgr.a (mgr.14355) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:07:26.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:26.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:26.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:27.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:27.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:27.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:27.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:27.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:27 smithi007 bash[22722]: cluster 2024-09-14T00:07:26.260072+0000 mgr.a (mgr.14355) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:27 smithi131 bash[24745]: cluster 2024-09-14T00:07:26.260072+0000 mgr.a (mgr.14355) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:27 smithi171 bash[25040]: cluster 2024-09-14T00:07:26.260072+0000 mgr.a (mgr.14355) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:28 smithi007 bash[22722]: audit 2024-09-14T00:07:26.790777+0000 mgr.a (mgr.14355) 4609 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:28 smithi131 bash[24745]: audit 2024-09-14T00:07:26.790777+0000 mgr.a (mgr.14355) 4609 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:28 smithi171 bash[25040]: audit 2024-09-14T00:07:26.790777+0000 mgr.a (mgr.14355) 4609 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:29 smithi007 bash[22722]: cluster 2024-09-14T00:07:28.260997+0000 mgr.a (mgr.14355) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:29 smithi131 bash[24745]: cluster 2024-09-14T00:07:28.260997+0000 mgr.a (mgr.14355) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:29 smithi171 bash[25040]: cluster 2024-09-14T00:07:28.260997+0000 mgr.a (mgr.14355) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:31 smithi007 bash[22722]: cluster 2024-09-14T00:07:30.263170+0000 mgr.a (mgr.14355) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:31 smithi131 bash[24745]: cluster 2024-09-14T00:07:30.263170+0000 mgr.a (mgr.14355) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:31 smithi171 bash[25040]: cluster 2024-09-14T00:07:30.263170+0000 mgr.a (mgr.14355) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:32.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:32.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:32.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:32.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:32.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:32.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:33 smithi007 bash[22722]: cluster 2024-09-14T00:07:32.263941+0000 mgr.a (mgr.14355) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:33 smithi131 bash[24745]: cluster 2024-09-14T00:07:32.263941+0000 mgr.a (mgr.14355) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:33 smithi171 bash[25040]: cluster 2024-09-14T00:07:32.263941+0000 mgr.a (mgr.14355) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:34 smithi007 bash[22722]: audit 2024-09-14T00:07:32.539216+0000 mgr.a (mgr.14355) 4613 : audit [DBG] from='client.109590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:34 smithi131 bash[24745]: audit 2024-09-14T00:07:32.539216+0000 mgr.a (mgr.14355) 4613 : audit [DBG] from='client.109590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:34 smithi171 bash[25040]: audit 2024-09-14T00:07:32.539216+0000 mgr.a (mgr.14355) 4613 : audit [DBG] from='client.109590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:35 smithi007 bash[22722]: cluster 2024-09-14T00:07:34.264855+0000 mgr.a (mgr.14355) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:35 smithi131 bash[24745]: cluster 2024-09-14T00:07:34.264855+0000 mgr.a (mgr.14355) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:35 smithi171 bash[25040]: cluster 2024-09-14T00:07:34.264855+0000 mgr.a (mgr.14355) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:37 smithi007 bash[22722]: cluster 2024-09-14T00:07:36.267223+0000 mgr.a (mgr.14355) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:37 smithi131 bash[24745]: cluster 2024-09-14T00:07:36.267223+0000 mgr.a (mgr.14355) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:37 smithi171 bash[25040]: cluster 2024-09-14T00:07:36.267223+0000 mgr.a (mgr.14355) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:37.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:37.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:37.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:38.735 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:38.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:38.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:38.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:38.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:39 smithi007 bash[22722]: cluster 2024-09-14T00:07:38.268093+0000 mgr.a (mgr.14355) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:39 smithi007 bash[22722]: audit 2024-09-14T00:07:38.325744+0000 mgr.a (mgr.14355) 4617 : audit [DBG] from='client.109668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:39 smithi131 bash[24745]: cluster 2024-09-14T00:07:38.268093+0000 mgr.a (mgr.14355) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:39 smithi131 bash[24745]: audit 2024-09-14T00:07:38.325744+0000 mgr.a (mgr.14355) 4617 : audit [DBG] from='client.109668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:39 smithi171 bash[25040]: cluster 2024-09-14T00:07:38.268093+0000 mgr.a (mgr.14355) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:39 smithi171 bash[25040]: audit 2024-09-14T00:07:38.325744+0000 mgr.a (mgr.14355) 4617 : audit [DBG] from='client.109668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:41 smithi007 bash[22722]: cluster 2024-09-14T00:07:40.270523+0000 mgr.a (mgr.14355) 4618 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:41 smithi131 bash[24745]: cluster 2024-09-14T00:07:40.270523+0000 mgr.a (mgr.14355) 4618 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:41 smithi171 bash[25040]: cluster 2024-09-14T00:07:40.270523+0000 mgr.a (mgr.14355) 4618 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:43 smithi007 bash[22722]: cluster 2024-09-14T00:07:42.271300+0000 mgr.a (mgr.14355) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:43.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:43.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:43 smithi131 bash[24745]: cluster 2024-09-14T00:07:42.271300+0000 mgr.a (mgr.14355) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:43 smithi171 bash[25040]: cluster 2024-09-14T00:07:42.271300+0000 mgr.a (mgr.14355) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:44.474 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:44.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:44.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:44.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:44.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:45 smithi007 bash[22722]: audit 2024-09-14T00:07:44.068452+0000 mgr.a (mgr.14355) 4620 : audit [DBG] from='client.109746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:45 smithi007 bash[22722]: cluster 2024-09-14T00:07:44.271804+0000 mgr.a (mgr.14355) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:45 smithi131 bash[24745]: audit 2024-09-14T00:07:44.068452+0000 mgr.a (mgr.14355) 4620 : audit [DBG] from='client.109746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:45 smithi131 bash[24745]: cluster 2024-09-14T00:07:44.271804+0000 mgr.a (mgr.14355) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:45 smithi171 bash[25040]: audit 2024-09-14T00:07:44.068452+0000 mgr.a (mgr.14355) 4620 : audit [DBG] from='client.109746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:45 smithi171 bash[25040]: cluster 2024-09-14T00:07:44.271804+0000 mgr.a (mgr.14355) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:47 smithi007 bash[22722]: cluster 2024-09-14T00:07:46.274116+0000 mgr.a (mgr.14355) 4622 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:47 smithi131 bash[24745]: cluster 2024-09-14T00:07:46.274116+0000 mgr.a (mgr.14355) 4622 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:47 smithi171 bash[25040]: cluster 2024-09-14T00:07:46.274116+0000 mgr.a (mgr.14355) 4622 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:07:49.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:49.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:49 smithi007 bash[22722]: cluster 2024-09-14T00:07:48.274899+0000 mgr.a (mgr.14355) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:49 smithi131 bash[24745]: cluster 2024-09-14T00:07:48.274899+0000 mgr.a (mgr.14355) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:49 smithi171 bash[25040]: cluster 2024-09-14T00:07:48.274899+0000 mgr.a (mgr.14355) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:07:50.253 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:50 smithi007 bash[22722]: audit 2024-09-14T00:07:50.205631+0000 mon.a (mon.0) 1295 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:07:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:50 smithi131 bash[24745]: audit 2024-09-14T00:07:50.205631+0000 mon.a (mon.0) 1295 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:07:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:50 smithi171 bash[25040]: audit 2024-09-14T00:07:50.205631+0000 mon.a (mon.0) 1295 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: audit 2024-09-14T00:07:49.813164+0000 mgr.a (mgr.14355) 4624 : audit [DBG] from='client.109824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: cluster 2024-09-14T00:07:50.275996+0000 mgr.a (mgr.14355) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: audit 2024-09-14T00:07:50.979068+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: audit 2024-09-14T00:07:50.980807+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: audit 2024-09-14T00:07:50.989750+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:07:51.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22722]: audit 2024-09-14T00:07:50.992250+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: audit 2024-09-14T00:07:49.813164+0000 mgr.a (mgr.14355) 4624 : audit [DBG] from='client.109824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: cluster 2024-09-14T00:07:50.275996+0000 mgr.a (mgr.14355) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:07:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: audit 2024-09-14T00:07:50.979068+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:07:51.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: audit 2024-09-14T00:07:50.980807+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:07:51.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: audit 2024-09-14T00:07:50.989750+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:07:51.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:51 smithi131 bash[24745]: audit 2024-09-14T00:07:50.992250+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: audit 2024-09-14T00:07:49.813164+0000 mgr.a (mgr.14355) 4624 : audit [DBG] from='client.109824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: cluster 2024-09-14T00:07:50.275996+0000 mgr.a (mgr.14355) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:07:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: audit 2024-09-14T00:07:50.979068+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:07:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: audit 2024-09-14T00:07:50.980807+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:07:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: audit 2024-09-14T00:07:50.989750+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:07:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:51 smithi171 bash[25040]: audit 2024-09-14T00:07:50.992250+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22972]: debug 2024-09-14T00:07:51.694+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:07:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:07:51 smithi007 bash[22972]: debug 2024-09-14T00:07:51.694+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:07:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:52 smithi007 bash[22722]: audit 2024-09-14T00:07:50.994765+0000 mgr.a (mgr.14355) 4626 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:52 smithi131 bash[24745]: audit 2024-09-14T00:07:50.994765+0000 mgr.a (mgr.14355) 4626 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:52 smithi171 bash[25040]: audit 2024-09-14T00:07:50.994765+0000 mgr.a (mgr.14355) 4626 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:07:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:53 smithi007 bash[22722]: audit 2024-09-14T00:07:51.699476+0000 mgr.a (mgr.14355) 4627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:07:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:53 smithi007 bash[22722]: cephadm 2024-09-14T00:07:51.700740+0000 mgr.a (mgr.14355) 4628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:07:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:53 smithi007 bash[22722]: cluster 2024-09-14T00:07:52.276843+0000 mgr.a (mgr.14355) 4629 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:53 smithi131 bash[24745]: audit 2024-09-14T00:07:51.699476+0000 mgr.a (mgr.14355) 4627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:07:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:53 smithi131 bash[24745]: cephadm 2024-09-14T00:07:51.700740+0000 mgr.a (mgr.14355) 4628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:07:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:53 smithi131 bash[24745]: cluster 2024-09-14T00:07:52.276843+0000 mgr.a (mgr.14355) 4629 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:53 smithi171 bash[25040]: audit 2024-09-14T00:07:51.699476+0000 mgr.a (mgr.14355) 4627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:07:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:53 smithi171 bash[25040]: cephadm 2024-09-14T00:07:51.700740+0000 mgr.a (mgr.14355) 4628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:07:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:53 smithi171 bash[25040]: cluster 2024-09-14T00:07:52.276843+0000 mgr.a (mgr.14355) 4629 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:55.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:07:55.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:07:55.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:07:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:55 smithi007 bash[22722]: cluster 2024-09-14T00:07:54.277606+0000 mgr.a (mgr.14355) 4630 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:55 smithi131 bash[24745]: cluster 2024-09-14T00:07:54.277606+0000 mgr.a (mgr.14355) 4630 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:55 smithi171 bash[25040]: cluster 2024-09-14T00:07:54.277606+0000 mgr.a (mgr.14355) 4630 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:07:56.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:07:56.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:07:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:07:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:07:56.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:07:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:57 smithi007 bash[22722]: audit 2024-09-14T00:07:55.590783+0000 mgr.a (mgr.14355) 4631 : audit [DBG] from='client.110007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:57 smithi007 bash[22722]: cluster 2024-09-14T00:07:56.280446+0000 mgr.a (mgr.14355) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:57 smithi131 bash[24745]: audit 2024-09-14T00:07:55.590783+0000 mgr.a (mgr.14355) 4631 : audit [DBG] from='client.110007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:57 smithi131 bash[24745]: cluster 2024-09-14T00:07:56.280446+0000 mgr.a (mgr.14355) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:57 smithi171 bash[25040]: audit 2024-09-14T00:07:55.590783+0000 mgr.a (mgr.14355) 4631 : audit [DBG] from='client.110007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:07:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:57 smithi171 bash[25040]: cluster 2024-09-14T00:07:56.280446+0000 mgr.a (mgr.14355) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:07:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:07:59 smithi131 bash[24745]: cluster 2024-09-14T00:07:58.281233+0000 mgr.a (mgr.14355) 4633 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:07:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:07:59 smithi171 bash[25040]: cluster 2024-09-14T00:07:58.281233+0000 mgr.a (mgr.14355) 4633 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:07:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:07:59 smithi007 bash[22722]: cluster 2024-09-14T00:07:58.281233+0000 mgr.a (mgr.14355) 4633 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:01.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:01.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:01.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:01.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:01.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:01.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:01.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:01.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:01 smithi131 bash[24745]: cluster 2024-09-14T00:08:00.283243+0000 mgr.a (mgr.14355) 4634 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:01 smithi171 bash[25040]: cluster 2024-09-14T00:08:00.283243+0000 mgr.a (mgr.14355) 4634 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:01 smithi007 bash[22722]: cluster 2024-09-14T00:08:00.283243+0000 mgr.a (mgr.14355) 4634 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:02 smithi131 bash[24745]: audit 2024-09-14T00:08:01.350744+0000 mgr.a (mgr.14355) 4635 : audit [DBG] from='client.110082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:02 smithi171 bash[25040]: audit 2024-09-14T00:08:01.350744+0000 mgr.a (mgr.14355) 4635 : audit [DBG] from='client.110082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:02 smithi007 bash[22722]: audit 2024-09-14T00:08:01.350744+0000 mgr.a (mgr.14355) 4635 : audit [DBG] from='client.110082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:03 smithi131 bash[24745]: cluster 2024-09-14T00:08:02.284284+0000 mgr.a (mgr.14355) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:03 smithi171 bash[25040]: cluster 2024-09-14T00:08:02.284284+0000 mgr.a (mgr.14355) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:03 smithi007 bash[22722]: cluster 2024-09-14T00:08:02.284284+0000 mgr.a (mgr.14355) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:05 smithi131 bash[24745]: cluster 2024-09-14T00:08:04.285106+0000 mgr.a (mgr.14355) 4637 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:05 smithi171 bash[25040]: cluster 2024-09-14T00:08:04.285106+0000 mgr.a (mgr.14355) 4637 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:05 smithi007 bash[22722]: cluster 2024-09-14T00:08:04.285106+0000 mgr.a (mgr.14355) 4637 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:08:06.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:06.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:07.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:07.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:07.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:07.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:07 smithi131 bash[24745]: cluster 2024-09-14T00:08:06.287350+0000 mgr.a (mgr.14355) 4638 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:07 smithi171 bash[25040]: cluster 2024-09-14T00:08:06.287350+0000 mgr.a (mgr.14355) 4638 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:07 smithi007 bash[22722]: cluster 2024-09-14T00:08:06.287350+0000 mgr.a (mgr.14355) 4638 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:08 smithi131 bash[24745]: audit 2024-09-14T00:08:07.110744+0000 mgr.a (mgr.14355) 4639 : audit [DBG] from='client.110160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:08 smithi171 bash[25040]: audit 2024-09-14T00:08:07.110744+0000 mgr.a (mgr.14355) 4639 : audit [DBG] from='client.110160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:08 smithi007 bash[22722]: audit 2024-09-14T00:08:07.110744+0000 mgr.a (mgr.14355) 4639 : audit [DBG] from='client.110160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:09 smithi131 bash[24745]: cluster 2024-09-14T00:08:08.288235+0000 mgr.a (mgr.14355) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:09 smithi171 bash[25040]: cluster 2024-09-14T00:08:08.288235+0000 mgr.a (mgr.14355) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:09 smithi007 bash[22722]: cluster 2024-09-14T00:08:08.288235+0000 mgr.a (mgr.14355) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:11 smithi131 bash[24745]: cluster 2024-09-14T00:08:10.290425+0000 mgr.a (mgr.14355) 4641 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:11 smithi171 bash[25040]: cluster 2024-09-14T00:08:10.290425+0000 mgr.a (mgr.14355) 4641 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:11 smithi007 bash[22722]: cluster 2024-09-14T00:08:10.290425+0000 mgr.a (mgr.14355) 4641 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:12.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:13.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:13.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:13 smithi131 bash[24745]: cluster 2024-09-14T00:08:12.291158+0000 mgr.a (mgr.14355) 4642 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:13 smithi171 bash[25040]: cluster 2024-09-14T00:08:12.291158+0000 mgr.a (mgr.14355) 4642 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:13 smithi007 bash[22722]: cluster 2024-09-14T00:08:12.291158+0000 mgr.a (mgr.14355) 4642 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:14 smithi131 bash[24745]: audit 2024-09-14T00:08:12.893422+0000 mgr.a (mgr.14355) 4643 : audit [DBG] from='client.110238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:14 smithi171 bash[25040]: audit 2024-09-14T00:08:12.893422+0000 mgr.a (mgr.14355) 4643 : audit [DBG] from='client.110238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:14 smithi007 bash[22722]: audit 2024-09-14T00:08:12.893422+0000 mgr.a (mgr.14355) 4643 : audit [DBG] from='client.110238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:15 smithi131 bash[24745]: cluster 2024-09-14T00:08:14.292025+0000 mgr.a (mgr.14355) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:15 smithi171 bash[25040]: cluster 2024-09-14T00:08:14.292025+0000 mgr.a (mgr.14355) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:15 smithi007 bash[22722]: cluster 2024-09-14T00:08:14.292025+0000 mgr.a (mgr.14355) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:17 smithi131 bash[24745]: cluster 2024-09-14T00:08:16.294286+0000 mgr.a (mgr.14355) 4645 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:17 smithi171 bash[25040]: cluster 2024-09-14T00:08:16.294286+0000 mgr.a (mgr.14355) 4645 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:17 smithi007 bash[22722]: cluster 2024-09-14T00:08:16.294286+0000 mgr.a (mgr.14355) 4645 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:18.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:18.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:18.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:19.115 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:19.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:19 smithi131 bash[24745]: cluster 2024-09-14T00:08:18.295051+0000 mgr.a (mgr.14355) 4646 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:19 smithi171 bash[25040]: cluster 2024-09-14T00:08:18.295051+0000 mgr.a (mgr.14355) 4646 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:19 smithi007 bash[22722]: cluster 2024-09-14T00:08:18.295051+0000 mgr.a (mgr.14355) 4646 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:20 smithi131 bash[24745]: audit 2024-09-14T00:08:18.674412+0000 mgr.a (mgr.14355) 4647 : audit [DBG] from='client.110316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:20 smithi171 bash[25040]: audit 2024-09-14T00:08:18.674412+0000 mgr.a (mgr.14355) 4647 : audit [DBG] from='client.110316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:20 smithi007 bash[22722]: audit 2024-09-14T00:08:18.674412+0000 mgr.a (mgr.14355) 4647 : audit [DBG] from='client.110316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:21 smithi131 bash[24745]: cluster 2024-09-14T00:08:20.297285+0000 mgr.a (mgr.14355) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:21 smithi171 bash[25040]: cluster 2024-09-14T00:08:20.297285+0000 mgr.a (mgr.14355) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:21 smithi007 bash[22722]: cluster 2024-09-14T00:08:20.297285+0000 mgr.a (mgr.14355) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:22.964 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:22 smithi007 bash[22722]: cluster 2024-09-14T00:08:22.298049+0000 mgr.a (mgr.14355) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:22 smithi131 bash[24745]: cluster 2024-09-14T00:08:22.298049+0000 mgr.a (mgr.14355) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:22 smithi171 bash[25040]: cluster 2024-09-14T00:08:22.298049+0000 mgr.a (mgr.14355) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:24.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:24.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:24.866 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:25 smithi007 bash[22722]: cluster 2024-09-14T00:08:24.298819+0000 mgr.a (mgr.14355) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:25 smithi007 bash[22722]: audit 2024-09-14T00:08:24.448884+0000 mgr.a (mgr.14355) 4651 : audit [DBG] from='client.110388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:25 smithi131 bash[24745]: cluster 2024-09-14T00:08:24.298819+0000 mgr.a (mgr.14355) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:25 smithi131 bash[24745]: audit 2024-09-14T00:08:24.448884+0000 mgr.a (mgr.14355) 4651 : audit [DBG] from='client.110388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:25 smithi171 bash[25040]: cluster 2024-09-14T00:08:24.298819+0000 mgr.a (mgr.14355) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:25 smithi171 bash[25040]: audit 2024-09-14T00:08:24.448884+0000 mgr.a (mgr.14355) 4651 : audit [DBG] from='client.110388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:27 smithi007 bash[22722]: cluster 2024-09-14T00:08:26.301090+0000 mgr.a (mgr.14355) 4652 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:27 smithi131 bash[24745]: cluster 2024-09-14T00:08:26.301090+0000 mgr.a (mgr.14355) 4652 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:27 smithi171 bash[25040]: cluster 2024-09-14T00:08:26.301090+0000 mgr.a (mgr.14355) 4652 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:29 smithi007 bash[22722]: cluster 2024-09-14T00:08:28.301853+0000 mgr.a (mgr.14355) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:29 smithi131 bash[24745]: cluster 2024-09-14T00:08:28.301853+0000 mgr.a (mgr.14355) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:29 smithi171 bash[25040]: cluster 2024-09-14T00:08:28.301853+0000 mgr.a (mgr.14355) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:29.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:29.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:30.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:30.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:31 smithi007 bash[22722]: audit 2024-09-14T00:08:30.202087+0000 mgr.a (mgr.14355) 4654 : audit [DBG] from='client.110466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:31 smithi007 bash[22722]: cluster 2024-09-14T00:08:30.303103+0000 mgr.a (mgr.14355) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:31 smithi131 bash[24745]: audit 2024-09-14T00:08:30.202087+0000 mgr.a (mgr.14355) 4654 : audit [DBG] from='client.110466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:31 smithi131 bash[24745]: cluster 2024-09-14T00:08:30.303103+0000 mgr.a (mgr.14355) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:31 smithi171 bash[25040]: audit 2024-09-14T00:08:30.202087+0000 mgr.a (mgr.14355) 4654 : audit [DBG] from='client.110466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:31 smithi171 bash[25040]: cluster 2024-09-14T00:08:30.303103+0000 mgr.a (mgr.14355) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:33 smithi007 bash[22722]: cluster 2024-09-14T00:08:32.303924+0000 mgr.a (mgr.14355) 4656 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:33 smithi131 bash[24745]: cluster 2024-09-14T00:08:32.303924+0000 mgr.a (mgr.14355) 4656 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:33 smithi171 bash[25040]: cluster 2024-09-14T00:08:32.303924+0000 mgr.a (mgr.14355) 4656 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:35.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:35 smithi007 bash[22722]: cluster 2024-09-14T00:08:34.304683+0000 mgr.a (mgr.14355) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:35 smithi131 bash[24745]: cluster 2024-09-14T00:08:34.304683+0000 mgr.a (mgr.14355) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:35 smithi171 bash[25040]: cluster 2024-09-14T00:08:34.304683+0000 mgr.a (mgr.14355) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:36.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:37 smithi007 bash[22722]: audit 2024-09-14T00:08:35.964110+0000 mgr.a (mgr.14355) 4658 : audit [DBG] from='client.110541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:37 smithi007 bash[22722]: cluster 2024-09-14T00:08:36.306057+0000 mgr.a (mgr.14355) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:37 smithi131 bash[24745]: audit 2024-09-14T00:08:35.964110+0000 mgr.a (mgr.14355) 4658 : audit [DBG] from='client.110541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:37 smithi131 bash[24745]: cluster 2024-09-14T00:08:36.306057+0000 mgr.a (mgr.14355) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:37 smithi171 bash[25040]: audit 2024-09-14T00:08:35.964110+0000 mgr.a (mgr.14355) 4658 : audit [DBG] from='client.110541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:37 smithi171 bash[25040]: cluster 2024-09-14T00:08:36.306057+0000 mgr.a (mgr.14355) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:39 smithi007 bash[22722]: cluster 2024-09-14T00:08:38.306802+0000 mgr.a (mgr.14355) 4660 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:39 smithi131 bash[24745]: cluster 2024-09-14T00:08:38.306802+0000 mgr.a (mgr.14355) 4660 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:39 smithi171 bash[25040]: cluster 2024-09-14T00:08:38.306802+0000 mgr.a (mgr.14355) 4660 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:08:41.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:41.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:41 smithi007 bash[22722]: cluster 2024-09-14T00:08:40.308706+0000 mgr.a (mgr.14355) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:41 smithi131 bash[24745]: cluster 2024-09-14T00:08:40.308706+0000 mgr.a (mgr.14355) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:41 smithi171 bash[25040]: cluster 2024-09-14T00:08:40.308706+0000 mgr.a (mgr.14355) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:42.138 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:42.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:43 smithi007 bash[22722]: audit 2024-09-14T00:08:41.721047+0000 mgr.a (mgr.14355) 4662 : audit [DBG] from='client.110619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:43 smithi007 bash[22722]: cluster 2024-09-14T00:08:42.309520+0000 mgr.a (mgr.14355) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:43 smithi131 bash[24745]: audit 2024-09-14T00:08:41.721047+0000 mgr.a (mgr.14355) 4662 : audit [DBG] from='client.110619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:43 smithi131 bash[24745]: cluster 2024-09-14T00:08:42.309520+0000 mgr.a (mgr.14355) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:43 smithi171 bash[25040]: audit 2024-09-14T00:08:41.721047+0000 mgr.a (mgr.14355) 4662 : audit [DBG] from='client.110619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:43 smithi171 bash[25040]: cluster 2024-09-14T00:08:42.309520+0000 mgr.a (mgr.14355) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:45 smithi007 bash[22722]: cluster 2024-09-14T00:08:44.310345+0000 mgr.a (mgr.14355) 4664 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:45 smithi131 bash[24745]: cluster 2024-09-14T00:08:44.310345+0000 mgr.a (mgr.14355) 4664 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:45 smithi171 bash[25040]: cluster 2024-09-14T00:08:44.310345+0000 mgr.a (mgr.14355) 4664 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:47 smithi007 bash[22722]: cluster 2024-09-14T00:08:46.312557+0000 mgr.a (mgr.14355) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:47 smithi131 bash[24745]: cluster 2024-09-14T00:08:46.312557+0000 mgr.a (mgr.14355) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:47 smithi171 bash[25040]: cluster 2024-09-14T00:08:46.312557+0000 mgr.a (mgr.14355) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:47.922 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:47.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:47.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:48 smithi007 bash[22722]: audit 2024-09-14T00:08:47.476060+0000 mgr.a (mgr.14355) 4666 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:48 smithi131 bash[24745]: audit 2024-09-14T00:08:47.476060+0000 mgr.a (mgr.14355) 4666 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:48 smithi171 bash[25040]: audit 2024-09-14T00:08:47.476060+0000 mgr.a (mgr.14355) 4666 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:49 smithi007 bash[22722]: cluster 2024-09-14T00:08:48.313688+0000 mgr.a (mgr.14355) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:49 smithi131 bash[24745]: cluster 2024-09-14T00:08:48.313688+0000 mgr.a (mgr.14355) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:49 smithi171 bash[25040]: cluster 2024-09-14T00:08:48.313688+0000 mgr.a (mgr.14355) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:51 smithi007 bash[22722]: cluster 2024-09-14T00:08:50.315884+0000 mgr.a (mgr.14355) 4668 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:51 smithi131 bash[24745]: cluster 2024-09-14T00:08:50.315884+0000 mgr.a (mgr.14355) 4668 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:51 smithi171 bash[25040]: cluster 2024-09-14T00:08:50.315884+0000 mgr.a (mgr.14355) 4668 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:08:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:52 smithi007 bash[22722]: audit 2024-09-14T00:08:51.752519+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:08:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:52 smithi131 bash[24745]: audit 2024-09-14T00:08:51.752519+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:08:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:52 smithi171 bash[25040]: audit 2024-09-14T00:08:51.752519+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:08:52.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:52.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:52.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22972]: debug 2024-09-14T00:08:53.369+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:08:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22972]: debug 2024-09-14T00:08:53.381+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:08:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22722]: cluster 2024-09-14T00:08:52.316624+0000 mgr.a (mgr.14355) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22722]: audit 2024-09-14T00:08:52.603227+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:08:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22722]: audit 2024-09-14T00:08:52.605128+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:08:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22722]: audit 2024-09-14T00:08:52.616018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:08:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:53 smithi007 bash[22722]: audit 2024-09-14T00:08:52.620917+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:53.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:53.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:53 smithi131 bash[24745]: cluster 2024-09-14T00:08:52.316624+0000 mgr.a (mgr.14355) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:53 smithi131 bash[24745]: audit 2024-09-14T00:08:52.603227+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:08:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:53 smithi131 bash[24745]: audit 2024-09-14T00:08:52.605128+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:08:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:53 smithi131 bash[24745]: audit 2024-09-14T00:08:52.616018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:08:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:53 smithi131 bash[24745]: audit 2024-09-14T00:08:52.620917+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:53 smithi171 bash[25040]: cluster 2024-09-14T00:08:52.316624+0000 mgr.a (mgr.14355) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:53 smithi171 bash[25040]: audit 2024-09-14T00:08:52.603227+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:08:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:53 smithi171 bash[25040]: audit 2024-09-14T00:08:52.605128+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:08:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:53 smithi171 bash[25040]: audit 2024-09-14T00:08:52.616018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:08:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:53 smithi171 bash[25040]: audit 2024-09-14T00:08:52.620917+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:54 smithi007 bash[22722]: audit 2024-09-14T00:08:52.623170+0000 mgr.a (mgr.14355) 4670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:54 smithi007 bash[22722]: audit 2024-09-14T00:08:53.286677+0000 mgr.a (mgr.14355) 4671 : audit [DBG] from='client.110826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:54 smithi007 bash[22722]: audit 2024-09-14T00:08:53.373615+0000 mgr.a (mgr.14355) 4672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:08:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:54 smithi007 bash[22722]: cephadm 2024-09-14T00:08:53.385558+0000 mgr.a (mgr.14355) 4673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:08:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:54 smithi131 bash[24745]: audit 2024-09-14T00:08:52.623170+0000 mgr.a (mgr.14355) 4670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:54.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:54 smithi131 bash[24745]: audit 2024-09-14T00:08:53.286677+0000 mgr.a (mgr.14355) 4671 : audit [DBG] from='client.110826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:54.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:54 smithi131 bash[24745]: audit 2024-09-14T00:08:53.373615+0000 mgr.a (mgr.14355) 4672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:08:54.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:54 smithi131 bash[24745]: cephadm 2024-09-14T00:08:53.385558+0000 mgr.a (mgr.14355) 4673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:08:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:54 smithi171 bash[25040]: audit 2024-09-14T00:08:52.623170+0000 mgr.a (mgr.14355) 4670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:08:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:54 smithi171 bash[25040]: audit 2024-09-14T00:08:53.286677+0000 mgr.a (mgr.14355) 4671 : audit [DBG] from='client.110826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:08:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:54 smithi171 bash[25040]: audit 2024-09-14T00:08:53.373615+0000 mgr.a (mgr.14355) 4672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:08:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:54 smithi171 bash[25040]: cephadm 2024-09-14T00:08:53.385558+0000 mgr.a (mgr.14355) 4673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:08:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:55 smithi007 bash[22722]: cluster 2024-09-14T00:08:54.317583+0000 mgr.a (mgr.14355) 4674 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:55 smithi131 bash[24745]: cluster 2024-09-14T00:08:54.317583+0000 mgr.a (mgr.14355) 4674 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:55 smithi171 bash[25040]: cluster 2024-09-14T00:08:54.317583+0000 mgr.a (mgr.14355) 4674 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:08:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:57 smithi007 bash[22722]: cluster 2024-09-14T00:08:56.319928+0000 mgr.a (mgr.14355) 4675 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:57 smithi131 bash[24745]: cluster 2024-09-14T00:08:56.319928+0000 mgr.a (mgr.14355) 4675 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:57 smithi171 bash[25040]: cluster 2024-09-14T00:08:56.319928+0000 mgr.a (mgr.14355) 4675 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:08:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:08:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:08:59.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:08:59.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:08:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:08:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:08:59.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:08:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:08:59 smithi007 bash[22722]: cluster 2024-09-14T00:08:58.320716+0000 mgr.a (mgr.14355) 4676 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:08:59 smithi131 bash[24745]: cluster 2024-09-14T00:08:58.320716+0000 mgr.a (mgr.14355) 4676 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:08:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:08:59 smithi171 bash[25040]: cluster 2024-09-14T00:08:58.320716+0000 mgr.a (mgr.14355) 4676 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:00 smithi007 bash[22722]: audit 2024-09-14T00:08:59.102551+0000 mgr.a (mgr.14355) 4677 : audit [DBG] from='client.110952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:00 smithi131 bash[24745]: audit 2024-09-14T00:08:59.102551+0000 mgr.a (mgr.14355) 4677 : audit [DBG] from='client.110952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:00 smithi171 bash[25040]: audit 2024-09-14T00:08:59.102551+0000 mgr.a (mgr.14355) 4677 : audit [DBG] from='client.110952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:01 smithi131 bash[24745]: cluster 2024-09-14T00:09:00.323116+0000 mgr.a (mgr.14355) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:01 smithi171 bash[25040]: cluster 2024-09-14T00:09:00.323116+0000 mgr.a (mgr.14355) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:01 smithi007 bash[22722]: cluster 2024-09-14T00:09:00.323116+0000 mgr.a (mgr.14355) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:03 smithi131 bash[24745]: cluster 2024-09-14T00:09:02.323906+0000 mgr.a (mgr.14355) 4679 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:03 smithi171 bash[25040]: cluster 2024-09-14T00:09:02.323906+0000 mgr.a (mgr.14355) 4679 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:03 smithi007 bash[22722]: cluster 2024-09-14T00:09:02.323906+0000 mgr.a (mgr.14355) 4679 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:04.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:05.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:05.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:05.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:05.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:05.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:05 smithi131 bash[24745]: cluster 2024-09-14T00:09:04.324667+0000 mgr.a (mgr.14355) 4680 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:05 smithi171 bash[25040]: cluster 2024-09-14T00:09:04.324667+0000 mgr.a (mgr.14355) 4680 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:05 smithi007 bash[22722]: cluster 2024-09-14T00:09:04.324667+0000 mgr.a (mgr.14355) 4680 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:06 smithi131 bash[24745]: audit 2024-09-14T00:09:04.866727+0000 mgr.a (mgr.14355) 4681 : audit [DBG] from='client.111030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:06 smithi171 bash[25040]: audit 2024-09-14T00:09:04.866727+0000 mgr.a (mgr.14355) 4681 : audit [DBG] from='client.111030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:06 smithi007 bash[22722]: audit 2024-09-14T00:09:04.866727+0000 mgr.a (mgr.14355) 4681 : audit [DBG] from='client.111030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:07 smithi131 bash[24745]: cluster 2024-09-14T00:09:06.327549+0000 mgr.a (mgr.14355) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:07 smithi171 bash[25040]: cluster 2024-09-14T00:09:06.327549+0000 mgr.a (mgr.14355) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:07 smithi007 bash[22722]: cluster 2024-09-14T00:09:06.327549+0000 mgr.a (mgr.14355) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:09 smithi131 bash[24745]: cluster 2024-09-14T00:09:08.328361+0000 mgr.a (mgr.14355) 4683 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:09:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:09 smithi171 bash[25040]: cluster 2024-09-14T00:09:08.328361+0000 mgr.a (mgr.14355) 4683 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:09:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:09 smithi007 bash[22722]: cluster 2024-09-14T00:09:08.328361+0000 mgr.a (mgr.14355) 4683 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:09:10.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:10.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:11.055 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:11.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:11.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:11.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:11.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:11 smithi131 bash[24745]: cluster 2024-09-14T00:09:10.330122+0000 mgr.a (mgr.14355) 4684 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:11 smithi171 bash[25040]: cluster 2024-09-14T00:09:10.330122+0000 mgr.a (mgr.14355) 4684 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:11 smithi007 bash[22722]: cluster 2024-09-14T00:09:10.330122+0000 mgr.a (mgr.14355) 4684 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:12 smithi131 bash[24745]: audit 2024-09-14T00:09:10.618364+0000 mgr.a (mgr.14355) 4685 : audit [DBG] from='client.111108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:12 smithi171 bash[25040]: audit 2024-09-14T00:09:10.618364+0000 mgr.a (mgr.14355) 4685 : audit [DBG] from='client.111108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:12 smithi007 bash[22722]: audit 2024-09-14T00:09:10.618364+0000 mgr.a (mgr.14355) 4685 : audit [DBG] from='client.111108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:13 smithi131 bash[24745]: cluster 2024-09-14T00:09:12.331139+0000 mgr.a (mgr.14355) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:13 smithi171 bash[25040]: cluster 2024-09-14T00:09:12.331139+0000 mgr.a (mgr.14355) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:13 smithi007 bash[22722]: cluster 2024-09-14T00:09:12.331139+0000 mgr.a (mgr.14355) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:15 smithi131 bash[24745]: cluster 2024-09-14T00:09:14.331935+0000 mgr.a (mgr.14355) 4687 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:15 smithi171 bash[25040]: cluster 2024-09-14T00:09:14.331935+0000 mgr.a (mgr.14355) 4687 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:15 smithi007 bash[22722]: cluster 2024-09-14T00:09:14.331935+0000 mgr.a (mgr.14355) 4687 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:16.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:16.802 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:17 smithi131 bash[24745]: cluster 2024-09-14T00:09:16.334058+0000 mgr.a (mgr.14355) 4688 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:17 smithi131 bash[24745]: audit 2024-09-14T00:09:16.378621+0000 mgr.a (mgr.14355) 4689 : audit [DBG] from='client.111186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:17 smithi171 bash[25040]: cluster 2024-09-14T00:09:16.334058+0000 mgr.a (mgr.14355) 4688 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:17 smithi171 bash[25040]: audit 2024-09-14T00:09:16.378621+0000 mgr.a (mgr.14355) 4689 : audit [DBG] from='client.111186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:17 smithi007 bash[22722]: cluster 2024-09-14T00:09:16.334058+0000 mgr.a (mgr.14355) 4688 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:17 smithi007 bash[22722]: audit 2024-09-14T00:09:16.378621+0000 mgr.a (mgr.14355) 4689 : audit [DBG] from='client.111186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:19 smithi131 bash[24745]: cluster 2024-09-14T00:09:18.335188+0000 mgr.a (mgr.14355) 4690 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:09:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:19 smithi171 bash[25040]: cluster 2024-09-14T00:09:18.335188+0000 mgr.a (mgr.14355) 4690 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:09:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:19 smithi007 bash[22722]: cluster 2024-09-14T00:09:18.335188+0000 mgr.a (mgr.14355) 4690 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:09:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:21 smithi131 bash[24745]: cluster 2024-09-14T00:09:20.337420+0000 mgr.a (mgr.14355) 4691 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:09:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:21 smithi171 bash[25040]: cluster 2024-09-14T00:09:20.337420+0000 mgr.a (mgr.14355) 4691 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:09:21.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:21 smithi007 bash[22722]: cluster 2024-09-14T00:09:20.337420+0000 mgr.a (mgr.14355) 4691 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:09:22.567 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:22.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:22.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:22.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:22.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:23 smithi131 bash[24745]: audit 2024-09-14T00:09:22.136861+0000 mgr.a (mgr.14355) 4692 : audit [DBG] from='client.111261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:23 smithi131 bash[24745]: cluster 2024-09-14T00:09:22.337990+0000 mgr.a (mgr.14355) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:23 smithi171 bash[25040]: audit 2024-09-14T00:09:22.136861+0000 mgr.a (mgr.14355) 4692 : audit [DBG] from='client.111261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:23 smithi171 bash[25040]: cluster 2024-09-14T00:09:22.337990+0000 mgr.a (mgr.14355) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:23 smithi007 bash[22722]: audit 2024-09-14T00:09:22.136861+0000 mgr.a (mgr.14355) 4692 : audit [DBG] from='client.111261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:23 smithi007 bash[22722]: cluster 2024-09-14T00:09:22.337990+0000 mgr.a (mgr.14355) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:25 smithi131 bash[24745]: cluster 2024-09-14T00:09:24.338894+0000 mgr.a (mgr.14355) 4694 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:25 smithi171 bash[25040]: cluster 2024-09-14T00:09:24.338894+0000 mgr.a (mgr.14355) 4694 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:25 smithi007 bash[22722]: cluster 2024-09-14T00:09:24.338894+0000 mgr.a (mgr.14355) 4694 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:27.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:27.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:27.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:27 smithi131 bash[24745]: cluster 2024-09-14T00:09:26.341161+0000 mgr.a (mgr.14355) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:27 smithi171 bash[25040]: cluster 2024-09-14T00:09:26.341161+0000 mgr.a (mgr.14355) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:27 smithi007 bash[22722]: cluster 2024-09-14T00:09:26.341161+0000 mgr.a (mgr.14355) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:28.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:28.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:29 smithi131 bash[24745]: audit 2024-09-14T00:09:27.905943+0000 mgr.a (mgr.14355) 4696 : audit [DBG] from='client.111339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:29 smithi131 bash[24745]: cluster 2024-09-14T00:09:28.341845+0000 mgr.a (mgr.14355) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:29 smithi171 bash[25040]: audit 2024-09-14T00:09:27.905943+0000 mgr.a (mgr.14355) 4696 : audit [DBG] from='client.111339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:29 smithi171 bash[25040]: cluster 2024-09-14T00:09:28.341845+0000 mgr.a (mgr.14355) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:29 smithi007 bash[22722]: audit 2024-09-14T00:09:27.905943+0000 mgr.a (mgr.14355) 4696 : audit [DBG] from='client.111339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:29 smithi007 bash[22722]: cluster 2024-09-14T00:09:28.341845+0000 mgr.a (mgr.14355) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:31 smithi131 bash[24745]: cluster 2024-09-14T00:09:30.343980+0000 mgr.a (mgr.14355) 4698 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:31 smithi171 bash[25040]: cluster 2024-09-14T00:09:30.343980+0000 mgr.a (mgr.14355) 4698 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:31 smithi007 bash[22722]: cluster 2024-09-14T00:09:30.343980+0000 mgr.a (mgr.14355) 4698 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:33.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:33.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:33.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:33 smithi171 bash[25040]: cluster 2024-09-14T00:09:32.344766+0000 mgr.a (mgr.14355) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:33 smithi007 bash[22722]: cluster 2024-09-14T00:09:32.344766+0000 mgr.a (mgr.14355) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:33 smithi131 bash[24745]: cluster 2024-09-14T00:09:32.344766+0000 mgr.a (mgr.14355) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:34.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:34.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:35 smithi171 bash[25040]: audit 2024-09-14T00:09:33.673775+0000 mgr.a (mgr.14355) 4700 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:35 smithi171 bash[25040]: cluster 2024-09-14T00:09:34.345674+0000 mgr.a (mgr.14355) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:35 smithi007 bash[22722]: audit 2024-09-14T00:09:33.673775+0000 mgr.a (mgr.14355) 4700 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:35 smithi007 bash[22722]: cluster 2024-09-14T00:09:34.345674+0000 mgr.a (mgr.14355) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:35 smithi131 bash[24745]: audit 2024-09-14T00:09:33.673775+0000 mgr.a (mgr.14355) 4700 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:35 smithi131 bash[24745]: cluster 2024-09-14T00:09:34.345674+0000 mgr.a (mgr.14355) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:37 smithi171 bash[25040]: cluster 2024-09-14T00:09:36.348017+0000 mgr.a (mgr.14355) 4702 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:37 smithi007 bash[22722]: cluster 2024-09-14T00:09:36.348017+0000 mgr.a (mgr.14355) 4702 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:37 smithi131 bash[24745]: cluster 2024-09-14T00:09:36.348017+0000 mgr.a (mgr.14355) 4702 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:39.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:39.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:39.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:39.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:39 smithi007 bash[22722]: cluster 2024-09-14T00:09:38.348821+0000 mgr.a (mgr.14355) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:39 smithi131 bash[24745]: cluster 2024-09-14T00:09:38.348821+0000 mgr.a (mgr.14355) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:39 smithi171 bash[25040]: cluster 2024-09-14T00:09:38.348821+0000 mgr.a (mgr.14355) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:40 smithi007 bash[22722]: audit 2024-09-14T00:09:39.428913+0000 mgr.a (mgr.14355) 4704 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:40 smithi007 bash[22722]: cluster 2024-09-14T00:09:40.351216+0000 mgr.a (mgr.14355) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:40 smithi131 bash[24745]: audit 2024-09-14T00:09:39.428913+0000 mgr.a (mgr.14355) 4704 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:40 smithi131 bash[24745]: cluster 2024-09-14T00:09:40.351216+0000 mgr.a (mgr.14355) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:40 smithi171 bash[25040]: audit 2024-09-14T00:09:39.428913+0000 mgr.a (mgr.14355) 4704 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:40 smithi171 bash[25040]: cluster 2024-09-14T00:09:40.351216+0000 mgr.a (mgr.14355) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:09:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:43 smithi007 bash[22722]: cluster 2024-09-14T00:09:42.352017+0000 mgr.a (mgr.14355) 4706 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:43 smithi131 bash[24745]: cluster 2024-09-14T00:09:42.352017+0000 mgr.a (mgr.14355) 4706 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:43 smithi171 bash[25040]: cluster 2024-09-14T00:09:42.352017+0000 mgr.a (mgr.14355) 4706 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:44.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:44.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:44.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:45.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:45.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:45 smithi007 bash[22722]: cluster 2024-09-14T00:09:44.352794+0000 mgr.a (mgr.14355) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:45 smithi131 bash[24745]: cluster 2024-09-14T00:09:44.352794+0000 mgr.a (mgr.14355) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:45 smithi171 bash[25040]: cluster 2024-09-14T00:09:44.352794+0000 mgr.a (mgr.14355) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:46 smithi007 bash[22722]: audit 2024-09-14T00:09:45.190575+0000 mgr.a (mgr.14355) 4708 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:46 smithi131 bash[24745]: audit 2024-09-14T00:09:45.190575+0000 mgr.a (mgr.14355) 4708 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:46 smithi171 bash[25040]: audit 2024-09-14T00:09:45.190575+0000 mgr.a (mgr.14355) 4708 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:47 smithi007 bash[22722]: cluster 2024-09-14T00:09:46.355712+0000 mgr.a (mgr.14355) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:47 smithi131 bash[24745]: cluster 2024-09-14T00:09:46.355712+0000 mgr.a (mgr.14355) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:47 smithi171 bash[25040]: cluster 2024-09-14T00:09:46.355712+0000 mgr.a (mgr.14355) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:49 smithi007 bash[22722]: cluster 2024-09-14T00:09:48.356517+0000 mgr.a (mgr.14355) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:49 smithi131 bash[24745]: cluster 2024-09-14T00:09:48.356517+0000 mgr.a (mgr.14355) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:49 smithi171 bash[25040]: cluster 2024-09-14T00:09:48.356517+0000 mgr.a (mgr.14355) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:50.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:50.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:51.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:51 smithi007 bash[22722]: cluster 2024-09-14T00:09:50.358442+0000 mgr.a (mgr.14355) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:51 smithi131 bash[24745]: cluster 2024-09-14T00:09:50.358442+0000 mgr.a (mgr.14355) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:51 smithi171 bash[25040]: cluster 2024-09-14T00:09:50.358442+0000 mgr.a (mgr.14355) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:09:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:52 smithi007 bash[22722]: audit 2024-09-14T00:09:50.975796+0000 mgr.a (mgr.14355) 4712 : audit [DBG] from='client.111648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:52 smithi131 bash[24745]: audit 2024-09-14T00:09:50.975796+0000 mgr.a (mgr.14355) 4712 : audit [DBG] from='client.111648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:52 smithi171 bash[25040]: audit 2024-09-14T00:09:50.975796+0000 mgr.a (mgr.14355) 4712 : audit [DBG] from='client.111648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:53 smithi007 bash[22722]: cluster 2024-09-14T00:09:52.359473+0000 mgr.a (mgr.14355) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:53 smithi007 bash[22722]: audit 2024-09-14T00:09:53.439816+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:09:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:53 smithi131 bash[24745]: cluster 2024-09-14T00:09:52.359473+0000 mgr.a (mgr.14355) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:53 smithi131 bash[24745]: audit 2024-09-14T00:09:53.439816+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:09:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:53 smithi171 bash[25040]: cluster 2024-09-14T00:09:52.359473+0000 mgr.a (mgr.14355) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:09:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:53 smithi171 bash[25040]: audit 2024-09-14T00:09:53.439816+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:09:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:54 smithi007 bash[22722]: audit 2024-09-14T00:09:54.290088+0000 mon.a (mon.0) 1306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:09:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:54 smithi007 bash[22722]: audit 2024-09-14T00:09:54.291992+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:09:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:54 smithi007 bash[22722]: audit 2024-09-14T00:09:54.302518+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:09:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:54 smithi007 bash[22722]: audit 2024-09-14T00:09:54.307410+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:54 smithi131 bash[24745]: audit 2024-09-14T00:09:54.290088+0000 mon.a (mon.0) 1306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:09:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:54 smithi131 bash[24745]: audit 2024-09-14T00:09:54.291992+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:09:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:54 smithi131 bash[24745]: audit 2024-09-14T00:09:54.302518+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:09:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:54 smithi131 bash[24745]: audit 2024-09-14T00:09:54.307410+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:54 smithi171 bash[25040]: audit 2024-09-14T00:09:54.290088+0000 mon.a (mon.0) 1306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:09:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:54 smithi171 bash[25040]: audit 2024-09-14T00:09:54.291992+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:09:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:54 smithi171 bash[25040]: audit 2024-09-14T00:09:54.302518+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:09:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:54 smithi171 bash[25040]: audit 2024-09-14T00:09:54.307410+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:55.448 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:09:55 smithi007 bash[22972]: debug 2024-09-14T00:09:55.056+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:09:55.448 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:09:55 smithi007 bash[22972]: debug 2024-09-14T00:09:55.056+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:09:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:55 smithi007 bash[22722]: audit 2024-09-14T00:09:54.309794+0000 mgr.a (mgr.14355) 4714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:55 smithi007 bash[22722]: cluster 2024-09-14T00:09:54.360504+0000 mgr.a (mgr.14355) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:55 smithi131 bash[24745]: audit 2024-09-14T00:09:54.309794+0000 mgr.a (mgr.14355) 4714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:55 smithi131 bash[24745]: cluster 2024-09-14T00:09:54.360504+0000 mgr.a (mgr.14355) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:55 smithi171 bash[25040]: audit 2024-09-14T00:09:54.309794+0000 mgr.a (mgr.14355) 4714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:09:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:55 smithi171 bash[25040]: cluster 2024-09-14T00:09:54.360504+0000 mgr.a (mgr.14355) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:09:56.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:09:56.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:09:56.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:09:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:56 smithi131 bash[24745]: audit 2024-09-14T00:09:55.060649+0000 mgr.a (mgr.14355) 4716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:09:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:56 smithi131 bash[24745]: cephadm 2024-09-14T00:09:55.061909+0000 mgr.a (mgr.14355) 4717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:09:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:56 smithi171 bash[25040]: audit 2024-09-14T00:09:55.060649+0000 mgr.a (mgr.14355) 4716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:09:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:56 smithi171 bash[25040]: cephadm 2024-09-14T00:09:55.061909+0000 mgr.a (mgr.14355) 4717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:09:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:56 smithi007 bash[22722]: audit 2024-09-14T00:09:55.060649+0000 mgr.a (mgr.14355) 4716 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:09:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:56 smithi007 bash[22722]: cephadm 2024-09-14T00:09:55.061909+0000 mgr.a (mgr.14355) 4717 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:09:57.162 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:09:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:09:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:09:57.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:09:57.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:09:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:57 smithi131 bash[24745]: cluster 2024-09-14T00:09:56.362931+0000 mgr.a (mgr.14355) 4718 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:57 smithi171 bash[25040]: cluster 2024-09-14T00:09:56.362931+0000 mgr.a (mgr.14355) 4718 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:57 smithi007 bash[22722]: cluster 2024-09-14T00:09:56.362931+0000 mgr.a (mgr.14355) 4718 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:58 smithi131 bash[24745]: audit 2024-09-14T00:09:56.753499+0000 mgr.a (mgr.14355) 4719 : audit [DBG] from='client.111825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:58 smithi171 bash[25040]: audit 2024-09-14T00:09:56.753499+0000 mgr.a (mgr.14355) 4719 : audit [DBG] from='client.111825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:58 smithi007 bash[22722]: audit 2024-09-14T00:09:56.753499+0000 mgr.a (mgr.14355) 4719 : audit [DBG] from='client.111825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:09:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:09:59 smithi131 bash[24745]: cluster 2024-09-14T00:09:58.363905+0000 mgr.a (mgr.14355) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:09:59 smithi171 bash[25040]: cluster 2024-09-14T00:09:58.363905+0000 mgr.a (mgr.14355) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:09:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:09:59 smithi007 bash[22722]: cluster 2024-09-14T00:09:58.363905+0000 mgr.a (mgr.14355) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:00 smithi131 bash[24745]: cluster 2024-09-14T00:10:00.000155+0000 mon.a (mon.0) 1310 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:10:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:00 smithi171 bash[25040]: cluster 2024-09-14T00:10:00.000155+0000 mon.a (mon.0) 1310 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:10:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:00 smithi007 bash[22722]: cluster 2024-09-14T00:10:00.000155+0000 mon.a (mon.0) 1310 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:10:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:01 smithi131 bash[24745]: cluster 2024-09-14T00:10:00.366131+0000 mgr.a (mgr.14355) 4721 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:01 smithi171 bash[25040]: cluster 2024-09-14T00:10:00.366131+0000 mgr.a (mgr.14355) 4721 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:01 smithi007 bash[22722]: cluster 2024-09-14T00:10:00.366131+0000 mgr.a (mgr.14355) 4721 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:02.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:02.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:02.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:02.945 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:03 smithi131 bash[24745]: cluster 2024-09-14T00:10:02.367039+0000 mgr.a (mgr.14355) 4722 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:03 smithi131 bash[24745]: audit 2024-09-14T00:10:02.499942+0000 mgr.a (mgr.14355) 4723 : audit [DBG] from='client.111903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:03 smithi171 bash[25040]: cluster 2024-09-14T00:10:02.367039+0000 mgr.a (mgr.14355) 4722 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:03 smithi171 bash[25040]: audit 2024-09-14T00:10:02.499942+0000 mgr.a (mgr.14355) 4723 : audit [DBG] from='client.111903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:03 smithi007 bash[22722]: cluster 2024-09-14T00:10:02.367039+0000 mgr.a (mgr.14355) 4722 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:03 smithi007 bash[22722]: audit 2024-09-14T00:10:02.499942+0000 mgr.a (mgr.14355) 4723 : audit [DBG] from='client.111903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:05 smithi131 bash[24745]: cluster 2024-09-14T00:10:04.367950+0000 mgr.a (mgr.14355) 4724 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:05 smithi171 bash[25040]: cluster 2024-09-14T00:10:04.367950+0000 mgr.a (mgr.14355) 4724 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:05 smithi007 bash[22722]: cluster 2024-09-14T00:10:04.367950+0000 mgr.a (mgr.14355) 4724 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:07 smithi131 bash[24745]: cluster 2024-09-14T00:10:06.370222+0000 mgr.a (mgr.14355) 4725 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:07 smithi171 bash[25040]: cluster 2024-09-14T00:10:06.370222+0000 mgr.a (mgr.14355) 4725 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:07.947 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:07.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:07 smithi007 bash[22722]: cluster 2024-09-14T00:10:06.370222+0000 mgr.a (mgr.14355) 4725 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:10:08.731 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:08.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:09 smithi131 bash[24745]: audit 2024-09-14T00:10:08.282914+0000 mgr.a (mgr.14355) 4726 : audit [DBG] from='client.111981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:09 smithi131 bash[24745]: cluster 2024-09-14T00:10:08.370886+0000 mgr.a (mgr.14355) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:09 smithi171 bash[25040]: audit 2024-09-14T00:10:08.282914+0000 mgr.a (mgr.14355) 4726 : audit [DBG] from='client.111981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:09 smithi171 bash[25040]: cluster 2024-09-14T00:10:08.370886+0000 mgr.a (mgr.14355) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:09 smithi007 bash[22722]: audit 2024-09-14T00:10:08.282914+0000 mgr.a (mgr.14355) 4726 : audit [DBG] from='client.111981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:09 smithi007 bash[22722]: cluster 2024-09-14T00:10:08.370886+0000 mgr.a (mgr.14355) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:11 smithi131 bash[24745]: cluster 2024-09-14T00:10:10.373110+0000 mgr.a (mgr.14355) 4728 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:11 smithi171 bash[25040]: cluster 2024-09-14T00:10:10.373110+0000 mgr.a (mgr.14355) 4728 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:11 smithi007 bash[22722]: cluster 2024-09-14T00:10:10.373110+0000 mgr.a (mgr.14355) 4728 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:13 smithi131 bash[24745]: cluster 2024-09-14T00:10:12.373910+0000 mgr.a (mgr.14355) 4729 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:13 smithi171 bash[25040]: cluster 2024-09-14T00:10:12.373910+0000 mgr.a (mgr.14355) 4729 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:13.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:13 smithi007 bash[22722]: cluster 2024-09-14T00:10:12.373910+0000 mgr.a (mgr.14355) 4729 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:14.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:14.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:14.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:14.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:14.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:15 smithi131 bash[24745]: audit 2024-09-14T00:10:14.065575+0000 mgr.a (mgr.14355) 4730 : audit [DBG] from='client.112053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:15 smithi131 bash[24745]: cluster 2024-09-14T00:10:14.374465+0000 mgr.a (mgr.14355) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:15 smithi171 bash[25040]: audit 2024-09-14T00:10:14.065575+0000 mgr.a (mgr.14355) 4730 : audit [DBG] from='client.112053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:15 smithi171 bash[25040]: cluster 2024-09-14T00:10:14.374465+0000 mgr.a (mgr.14355) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:15 smithi007 bash[22722]: audit 2024-09-14T00:10:14.065575+0000 mgr.a (mgr.14355) 4730 : audit [DBG] from='client.112053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:15 smithi007 bash[22722]: cluster 2024-09-14T00:10:14.374465+0000 mgr.a (mgr.14355) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:17 smithi131 bash[24745]: cluster 2024-09-14T00:10:16.376809+0000 mgr.a (mgr.14355) 4732 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:17 smithi171 bash[25040]: cluster 2024-09-14T00:10:16.376809+0000 mgr.a (mgr.14355) 4732 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:17 smithi007 bash[22722]: cluster 2024-09-14T00:10:16.376809+0000 mgr.a (mgr.14355) 4732 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:19.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:19.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:19 smithi131 bash[24745]: cluster 2024-09-14T00:10:18.377577+0000 mgr.a (mgr.14355) 4733 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:19 smithi171 bash[25040]: cluster 2024-09-14T00:10:18.377577+0000 mgr.a (mgr.14355) 4733 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:19 smithi007 bash[22722]: cluster 2024-09-14T00:10:18.377577+0000 mgr.a (mgr.14355) 4733 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:20.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:21 smithi131 bash[24745]: audit 2024-09-14T00:10:19.824767+0000 mgr.a (mgr.14355) 4734 : audit [DBG] from='client.112131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:21 smithi131 bash[24745]: cluster 2024-09-14T00:10:20.379981+0000 mgr.a (mgr.14355) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:10:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:21 smithi171 bash[25040]: audit 2024-09-14T00:10:19.824767+0000 mgr.a (mgr.14355) 4734 : audit [DBG] from='client.112131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:21 smithi171 bash[25040]: cluster 2024-09-14T00:10:20.379981+0000 mgr.a (mgr.14355) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:10:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:21 smithi007 bash[22722]: audit 2024-09-14T00:10:19.824767+0000 mgr.a (mgr.14355) 4734 : audit [DBG] from='client.112131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:21 smithi007 bash[22722]: cluster 2024-09-14T00:10:20.379981+0000 mgr.a (mgr.14355) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:10:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:23 smithi131 bash[24745]: cluster 2024-09-14T00:10:22.380787+0000 mgr.a (mgr.14355) 4736 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:23 smithi171 bash[25040]: cluster 2024-09-14T00:10:22.380787+0000 mgr.a (mgr.14355) 4736 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:23 smithi007 bash[22722]: cluster 2024-09-14T00:10:22.380787+0000 mgr.a (mgr.14355) 4736 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:25 smithi131 bash[24745]: cluster 2024-09-14T00:10:24.381594+0000 mgr.a (mgr.14355) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:25 smithi171 bash[25040]: cluster 2024-09-14T00:10:24.381594+0000 mgr.a (mgr.14355) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:25 smithi007 bash[22722]: cluster 2024-09-14T00:10:24.381594+0000 mgr.a (mgr.14355) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:10:26.037 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:27 smithi171 bash[25040]: audit 2024-09-14T00:10:25.595639+0000 mgr.a (mgr.14355) 4738 : audit [DBG] from='client.112209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:27 smithi171 bash[25040]: cluster 2024-09-14T00:10:26.384557+0000 mgr.a (mgr.14355) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:27 smithi007 bash[22722]: audit 2024-09-14T00:10:25.595639+0000 mgr.a (mgr.14355) 4738 : audit [DBG] from='client.112209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:27 smithi007 bash[22722]: cluster 2024-09-14T00:10:26.384557+0000 mgr.a (mgr.14355) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:27 smithi131 bash[24745]: audit 2024-09-14T00:10:25.595639+0000 mgr.a (mgr.14355) 4738 : audit [DBG] from='client.112209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:27 smithi131 bash[24745]: cluster 2024-09-14T00:10:26.384557+0000 mgr.a (mgr.14355) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:29 smithi171 bash[25040]: cluster 2024-09-14T00:10:28.385342+0000 mgr.a (mgr.14355) 4740 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:10:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:29 smithi007 bash[22722]: cluster 2024-09-14T00:10:28.385342+0000 mgr.a (mgr.14355) 4740 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:10:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:29 smithi131 bash[24745]: cluster 2024-09-14T00:10:28.385342+0000 mgr.a (mgr.14355) 4740 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:10:31.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:31 smithi171 bash[25040]: cluster 2024-09-14T00:10:30.387301+0000 mgr.a (mgr.14355) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:31.804 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:31 smithi007 bash[22722]: cluster 2024-09-14T00:10:30.387301+0000 mgr.a (mgr.14355) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:31 smithi131 bash[24745]: cluster 2024-09-14T00:10:30.387301+0000 mgr.a (mgr.14355) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:32 smithi171 bash[25040]: audit 2024-09-14T00:10:31.369334+0000 mgr.a (mgr.14355) 4742 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:32 smithi007 bash[22722]: audit 2024-09-14T00:10:31.369334+0000 mgr.a (mgr.14355) 4742 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:32 smithi131 bash[24745]: audit 2024-09-14T00:10:31.369334+0000 mgr.a (mgr.14355) 4742 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:33 smithi007 bash[22722]: cluster 2024-09-14T00:10:32.388308+0000 mgr.a (mgr.14355) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:33 smithi131 bash[24745]: cluster 2024-09-14T00:10:32.388308+0000 mgr.a (mgr.14355) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:33 smithi171 bash[25040]: cluster 2024-09-14T00:10:32.388308+0000 mgr.a (mgr.14355) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:35 smithi007 bash[22722]: cluster 2024-09-14T00:10:34.389099+0000 mgr.a (mgr.14355) 4744 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:35 smithi131 bash[24745]: cluster 2024-09-14T00:10:34.389099+0000 mgr.a (mgr.14355) 4744 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:35 smithi171 bash[25040]: cluster 2024-09-14T00:10:34.389099+0000 mgr.a (mgr.14355) 4744 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:10:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:36 smithi007 bash[22722]: cluster 2024-09-14T00:10:36.391374+0000 mgr.a (mgr.14355) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:10:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:36 smithi131 bash[24745]: cluster 2024-09-14T00:10:36.391374+0000 mgr.a (mgr.14355) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:10:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:36 smithi171 bash[25040]: cluster 2024-09-14T00:10:36.391374+0000 mgr.a (mgr.14355) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:10:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:37.582 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:37 smithi007 bash[22722]: audit 2024-09-14T00:10:37.143724+0000 mgr.a (mgr.14355) 4746 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:37 smithi131 bash[24745]: audit 2024-09-14T00:10:37.143724+0000 mgr.a (mgr.14355) 4746 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:37 smithi171 bash[25040]: audit 2024-09-14T00:10:37.143724+0000 mgr.a (mgr.14355) 4746 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:38 smithi007 bash[22722]: cluster 2024-09-14T00:10:38.392306+0000 mgr.a (mgr.14355) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:38 smithi131 bash[24745]: cluster 2024-09-14T00:10:38.392306+0000 mgr.a (mgr.14355) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:38 smithi171 bash[25040]: cluster 2024-09-14T00:10:38.392306+0000 mgr.a (mgr.14355) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:41 smithi131 bash[24745]: cluster 2024-09-14T00:10:40.394501+0000 mgr.a (mgr.14355) 4748 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:41 smithi171 bash[25040]: cluster 2024-09-14T00:10:40.394501+0000 mgr.a (mgr.14355) 4748 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:41 smithi007 bash[22722]: cluster 2024-09-14T00:10:40.394501+0000 mgr.a (mgr.14355) 4748 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:42.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:43.341 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:43.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:43.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:43.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:43.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:43 smithi131 bash[24745]: cluster 2024-09-14T00:10:42.395275+0000 mgr.a (mgr.14355) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:43 smithi171 bash[25040]: cluster 2024-09-14T00:10:42.395275+0000 mgr.a (mgr.14355) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:43 smithi007 bash[22722]: cluster 2024-09-14T00:10:42.395275+0000 mgr.a (mgr.14355) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:44 smithi131 bash[24745]: audit 2024-09-14T00:10:42.921577+0000 mgr.a (mgr.14355) 4750 : audit [DBG] from='client.112431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:44 smithi171 bash[25040]: audit 2024-09-14T00:10:42.921577+0000 mgr.a (mgr.14355) 4750 : audit [DBG] from='client.112431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:44 smithi007 bash[22722]: audit 2024-09-14T00:10:42.921577+0000 mgr.a (mgr.14355) 4750 : audit [DBG] from='client.112431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:45 smithi131 bash[24745]: cluster 2024-09-14T00:10:44.396161+0000 mgr.a (mgr.14355) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:45 smithi171 bash[25040]: cluster 2024-09-14T00:10:44.396161+0000 mgr.a (mgr.14355) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:45 smithi007 bash[22722]: cluster 2024-09-14T00:10:44.396161+0000 mgr.a (mgr.14355) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:47 smithi131 bash[24745]: cluster 2024-09-14T00:10:46.398438+0000 mgr.a (mgr.14355) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:47 smithi171 bash[25040]: cluster 2024-09-14T00:10:46.398438+0000 mgr.a (mgr.14355) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:47 smithi007 bash[22722]: cluster 2024-09-14T00:10:46.398438+0000 mgr.a (mgr.14355) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:48.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:48.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:48.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:49.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:49 smithi131 bash[24745]: cluster 2024-09-14T00:10:48.399152+0000 mgr.a (mgr.14355) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:49 smithi171 bash[25040]: cluster 2024-09-14T00:10:48.399152+0000 mgr.a (mgr.14355) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:49 smithi007 bash[22722]: cluster 2024-09-14T00:10:48.399152+0000 mgr.a (mgr.14355) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:50 smithi131 bash[24745]: audit 2024-09-14T00:10:48.676951+0000 mgr.a (mgr.14355) 4754 : audit [DBG] from='client.112509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:50 smithi171 bash[25040]: audit 2024-09-14T00:10:48.676951+0000 mgr.a (mgr.14355) 4754 : audit [DBG] from='client.112509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:50 smithi007 bash[22722]: audit 2024-09-14T00:10:48.676951+0000 mgr.a (mgr.14355) 4754 : audit [DBG] from='client.112509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:51 smithi131 bash[24745]: cluster 2024-09-14T00:10:50.401430+0000 mgr.a (mgr.14355) 4755 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:51 smithi171 bash[25040]: cluster 2024-09-14T00:10:50.401430+0000 mgr.a (mgr.14355) 4755 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:51 smithi007 bash[22722]: cluster 2024-09-14T00:10:50.401430+0000 mgr.a (mgr.14355) 4755 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:53 smithi131 bash[24745]: cluster 2024-09-14T00:10:52.402236+0000 mgr.a (mgr.14355) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:53 smithi171 bash[25040]: cluster 2024-09-14T00:10:52.402236+0000 mgr.a (mgr.14355) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:53 smithi007 bash[22722]: cluster 2024-09-14T00:10:52.402236+0000 mgr.a (mgr.14355) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:54.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:54.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:54.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:10:54.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:10:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:10:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:10:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:10:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:10:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:55 smithi131 bash[24745]: cluster 2024-09-14T00:10:54.402962+0000 mgr.a (mgr.14355) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:55 smithi131 bash[24745]: audit 2024-09-14T00:10:54.443571+0000 mgr.a (mgr.14355) 4758 : audit [DBG] from='client.112578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:55 smithi131 bash[24745]: audit 2024-09-14T00:10:55.119264+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:10:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:55 smithi171 bash[25040]: cluster 2024-09-14T00:10:54.402962+0000 mgr.a (mgr.14355) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:55 smithi171 bash[25040]: audit 2024-09-14T00:10:54.443571+0000 mgr.a (mgr.14355) 4758 : audit [DBG] from='client.112578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:55 smithi171 bash[25040]: audit 2024-09-14T00:10:55.119264+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:10:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:55 smithi007 bash[22722]: cluster 2024-09-14T00:10:54.402962+0000 mgr.a (mgr.14355) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:55 smithi007 bash[22722]: audit 2024-09-14T00:10:54.443571+0000 mgr.a (mgr.14355) 4758 : audit [DBG] from='client.112578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:10:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:55 smithi007 bash[22722]: audit 2024-09-14T00:10:55.119264+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:10:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:55.742521+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:55.747057+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:56.363413+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:10:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:56.364528+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:10:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:56.370145+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:56.372413+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: audit 2024-09-14T00:10:56.374816+0000 mgr.a (mgr.14355) 4759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:56 smithi131 bash[24745]: cluster 2024-09-14T00:10:56.404780+0000 mgr.a (mgr.14355) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:55.742521+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:55.747057+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:56.363413+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:56.364528+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:56.370145+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:56.372413+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: audit 2024-09-14T00:10:56.374816+0000 mgr.a (mgr.14355) 4759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:56 smithi171 bash[25040]: cluster 2024-09-14T00:10:56.404780+0000 mgr.a (mgr.14355) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:55.742521+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:55.747057+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:56.363413+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:56.364528+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:56.370145+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:10:57.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:56.372413+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: audit 2024-09-14T00:10:56.374816+0000 mgr.a (mgr.14355) 4759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:10:57.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:56 smithi007 bash[22722]: cluster 2024-09-14T00:10:56.404780+0000 mgr.a (mgr.14355) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:10:57.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:10:57 smithi007 bash[22972]: debug 2024-09-14T00:10:57.083+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:10:57.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:10:57 smithi007 bash[22972]: debug 2024-09-14T00:10:57.083+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:10:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:58 smithi007 bash[22722]: audit 2024-09-14T00:10:57.087546+0000 mgr.a (mgr.14355) 4761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:10:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:58 smithi007 bash[22722]: cephadm 2024-09-14T00:10:57.089385+0000 mgr.a (mgr.14355) 4762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:10:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:58 smithi131 bash[24745]: audit 2024-09-14T00:10:57.087546+0000 mgr.a (mgr.14355) 4761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:10:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:58 smithi131 bash[24745]: cephadm 2024-09-14T00:10:57.089385+0000 mgr.a (mgr.14355) 4762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:10:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:58 smithi171 bash[25040]: audit 2024-09-14T00:10:57.087546+0000 mgr.a (mgr.14355) 4761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:10:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:58 smithi171 bash[25040]: cephadm 2024-09-14T00:10:57.089385+0000 mgr.a (mgr.14355) 4762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:10:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:10:59 smithi007 bash[22722]: cluster 2024-09-14T00:10:58.405653+0000 mgr.a (mgr.14355) 4763 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:10:59 smithi131 bash[24745]: cluster 2024-09-14T00:10:58.405653+0000 mgr.a (mgr.14355) 4763 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:10:59 smithi171 bash[25040]: cluster 2024-09-14T00:10:58.405653+0000 mgr.a (mgr.14355) 4763 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:10:59.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:10:59.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:10:59.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:00.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:00.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:00.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:01 smithi131 bash[24745]: audit 2024-09-14T00:11:00.194987+0000 mgr.a (mgr.14355) 4764 : audit [DBG] from='client.112761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:01 smithi131 bash[24745]: cluster 2024-09-14T00:11:00.406942+0000 mgr.a (mgr.14355) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:01 smithi171 bash[25040]: audit 2024-09-14T00:11:00.194987+0000 mgr.a (mgr.14355) 4764 : audit [DBG] from='client.112761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:01 smithi171 bash[25040]: cluster 2024-09-14T00:11:00.406942+0000 mgr.a (mgr.14355) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:01 smithi007 bash[22722]: audit 2024-09-14T00:11:00.194987+0000 mgr.a (mgr.14355) 4764 : audit [DBG] from='client.112761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:01.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:01 smithi007 bash[22722]: cluster 2024-09-14T00:11:00.406942+0000 mgr.a (mgr.14355) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:03 smithi131 bash[24745]: cluster 2024-09-14T00:11:02.407948+0000 mgr.a (mgr.14355) 4766 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:03 smithi171 bash[25040]: cluster 2024-09-14T00:11:02.407948+0000 mgr.a (mgr.14355) 4766 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:03 smithi007 bash[22722]: cluster 2024-09-14T00:11:02.407948+0000 mgr.a (mgr.14355) 4766 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:05.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:05.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:05 smithi131 bash[24745]: cluster 2024-09-14T00:11:04.408898+0000 mgr.a (mgr.14355) 4767 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:05 smithi171 bash[25040]: cluster 2024-09-14T00:11:04.408898+0000 mgr.a (mgr.14355) 4767 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:05 smithi007 bash[22722]: cluster 2024-09-14T00:11:04.408898+0000 mgr.a (mgr.14355) 4767 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:06.361 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:06.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:06.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:07 smithi131 bash[24745]: audit 2024-09-14T00:11:05.946674+0000 mgr.a (mgr.14355) 4768 : audit [DBG] from='client.112839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:07 smithi131 bash[24745]: cluster 2024-09-14T00:11:06.410302+0000 mgr.a (mgr.14355) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:07 smithi171 bash[25040]: audit 2024-09-14T00:11:05.946674+0000 mgr.a (mgr.14355) 4768 : audit [DBG] from='client.112839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:07 smithi171 bash[25040]: cluster 2024-09-14T00:11:06.410302+0000 mgr.a (mgr.14355) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:07 smithi007 bash[22722]: audit 2024-09-14T00:11:05.946674+0000 mgr.a (mgr.14355) 4768 : audit [DBG] from='client.112839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:07 smithi007 bash[22722]: cluster 2024-09-14T00:11:06.410302+0000 mgr.a (mgr.14355) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:09 smithi131 bash[24745]: cluster 2024-09-14T00:11:08.411065+0000 mgr.a (mgr.14355) 4770 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:09 smithi171 bash[25040]: cluster 2024-09-14T00:11:08.411065+0000 mgr.a (mgr.14355) 4770 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:09 smithi007 bash[22722]: cluster 2024-09-14T00:11:08.411065+0000 mgr.a (mgr.14355) 4770 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:11:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:11 smithi131 bash[24745]: cluster 2024-09-14T00:11:10.412999+0000 mgr.a (mgr.14355) 4771 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:11 smithi171 bash[25040]: cluster 2024-09-14T00:11:10.412999+0000 mgr.a (mgr.14355) 4771 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:11 smithi007 bash[22722]: cluster 2024-09-14T00:11:10.412999+0000 mgr.a (mgr.14355) 4771 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:11:12.137 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:12.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:13 smithi131 bash[24745]: audit 2024-09-14T00:11:11.704959+0000 mgr.a (mgr.14355) 4772 : audit [DBG] from='client.112914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:13 smithi131 bash[24745]: cluster 2024-09-14T00:11:12.413981+0000 mgr.a (mgr.14355) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:13 smithi171 bash[25040]: audit 2024-09-14T00:11:11.704959+0000 mgr.a (mgr.14355) 4772 : audit [DBG] from='client.112914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:13 smithi171 bash[25040]: cluster 2024-09-14T00:11:12.413981+0000 mgr.a (mgr.14355) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:13 smithi007 bash[22722]: audit 2024-09-14T00:11:11.704959+0000 mgr.a (mgr.14355) 4772 : audit [DBG] from='client.112914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:13 smithi007 bash[22722]: cluster 2024-09-14T00:11:12.413981+0000 mgr.a (mgr.14355) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:15 smithi131 bash[24745]: cluster 2024-09-14T00:11:14.414803+0000 mgr.a (mgr.14355) 4774 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:15 smithi171 bash[25040]: cluster 2024-09-14T00:11:14.414803+0000 mgr.a (mgr.14355) 4774 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:15 smithi007 bash[22722]: cluster 2024-09-14T00:11:14.414803+0000 mgr.a (mgr.14355) 4774 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:17.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:17.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:17 smithi131 bash[24745]: cluster 2024-09-14T00:11:16.417059+0000 mgr.a (mgr.14355) 4775 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:17 smithi171 bash[25040]: cluster 2024-09-14T00:11:16.417059+0000 mgr.a (mgr.14355) 4775 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:17 smithi007 bash[22722]: cluster 2024-09-14T00:11:16.417059+0000 mgr.a (mgr.14355) 4775 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:17.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:18 smithi131 bash[24745]: audit 2024-09-14T00:11:17.479189+0000 mgr.a (mgr.14355) 4776 : audit [DBG] from='client.112992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:18 smithi171 bash[25040]: audit 2024-09-14T00:11:17.479189+0000 mgr.a (mgr.14355) 4776 : audit [DBG] from='client.112992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:18 smithi007 bash[22722]: audit 2024-09-14T00:11:17.479189+0000 mgr.a (mgr.14355) 4776 : audit [DBG] from='client.112992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:19 smithi131 bash[24745]: cluster 2024-09-14T00:11:18.418003+0000 mgr.a (mgr.14355) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:19 smithi171 bash[25040]: cluster 2024-09-14T00:11:18.418003+0000 mgr.a (mgr.14355) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:19 smithi007 bash[22722]: cluster 2024-09-14T00:11:18.418003+0000 mgr.a (mgr.14355) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:21 smithi131 bash[24745]: cluster 2024-09-14T00:11:20.420165+0000 mgr.a (mgr.14355) 4778 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:21 smithi171 bash[25040]: cluster 2024-09-14T00:11:20.420165+0000 mgr.a (mgr.14355) 4778 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:21 smithi007 bash[22722]: cluster 2024-09-14T00:11:20.420165+0000 mgr.a (mgr.14355) 4778 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:22.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:22.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:22.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:23.656 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:23.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:23 smithi131 bash[24745]: cluster 2024-09-14T00:11:22.420937+0000 mgr.a (mgr.14355) 4779 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:23 smithi171 bash[25040]: cluster 2024-09-14T00:11:22.420937+0000 mgr.a (mgr.14355) 4779 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:23 smithi007 bash[22722]: cluster 2024-09-14T00:11:22.420937+0000 mgr.a (mgr.14355) 4779 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:24 smithi131 bash[24745]: audit 2024-09-14T00:11:23.244984+0000 mgr.a (mgr.14355) 4780 : audit [DBG] from='client.113070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:24 smithi171 bash[25040]: audit 2024-09-14T00:11:23.244984+0000 mgr.a (mgr.14355) 4780 : audit [DBG] from='client.113070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:24 smithi007 bash[22722]: audit 2024-09-14T00:11:23.244984+0000 mgr.a (mgr.14355) 4780 : audit [DBG] from='client.113070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:25 smithi131 bash[24745]: cluster 2024-09-14T00:11:24.421837+0000 mgr.a (mgr.14355) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:25 smithi171 bash[25040]: cluster 2024-09-14T00:11:24.421837+0000 mgr.a (mgr.14355) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:25 smithi007 bash[22722]: cluster 2024-09-14T00:11:24.421837+0000 mgr.a (mgr.14355) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:27 smithi131 bash[24745]: cluster 2024-09-14T00:11:26.424072+0000 mgr.a (mgr.14355) 4782 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:27 smithi171 bash[25040]: cluster 2024-09-14T00:11:26.424072+0000 mgr.a (mgr.14355) 4782 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:27 smithi007 bash[22722]: cluster 2024-09-14T00:11:26.424072+0000 mgr.a (mgr.14355) 4782 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:28.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:28.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:29.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:29.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:29 smithi131 bash[24745]: cluster 2024-09-14T00:11:28.424838+0000 mgr.a (mgr.14355) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:29 smithi171 bash[25040]: cluster 2024-09-14T00:11:28.424838+0000 mgr.a (mgr.14355) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:29 smithi007 bash[22722]: cluster 2024-09-14T00:11:28.424838+0000 mgr.a (mgr.14355) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:30 smithi131 bash[24745]: audit 2024-09-14T00:11:28.997364+0000 mgr.a (mgr.14355) 4784 : audit [DBG] from='client.113142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:30 smithi171 bash[25040]: audit 2024-09-14T00:11:28.997364+0000 mgr.a (mgr.14355) 4784 : audit [DBG] from='client.113142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:30 smithi007 bash[22722]: audit 2024-09-14T00:11:28.997364+0000 mgr.a (mgr.14355) 4784 : audit [DBG] from='client.113142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:31 smithi131 bash[24745]: cluster 2024-09-14T00:11:30.427108+0000 mgr.a (mgr.14355) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:31 smithi171 bash[25040]: cluster 2024-09-14T00:11:30.427108+0000 mgr.a (mgr.14355) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:31 smithi007 bash[22722]: cluster 2024-09-14T00:11:30.427108+0000 mgr.a (mgr.14355) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:33 smithi131 bash[24745]: cluster 2024-09-14T00:11:32.427886+0000 mgr.a (mgr.14355) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:33 smithi171 bash[25040]: cluster 2024-09-14T00:11:32.427886+0000 mgr.a (mgr.14355) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:33 smithi007 bash[22722]: cluster 2024-09-14T00:11:32.427886+0000 mgr.a (mgr.14355) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:34.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:34.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:34.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:35.204 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:35 smithi131 bash[24745]: cluster 2024-09-14T00:11:34.428881+0000 mgr.a (mgr.14355) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:35 smithi171 bash[25040]: cluster 2024-09-14T00:11:34.428881+0000 mgr.a (mgr.14355) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:35 smithi007 bash[22722]: cluster 2024-09-14T00:11:34.428881+0000 mgr.a (mgr.14355) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:36 smithi131 bash[24745]: audit 2024-09-14T00:11:34.767962+0000 mgr.a (mgr.14355) 4788 : audit [DBG] from='client.113214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:36 smithi171 bash[25040]: audit 2024-09-14T00:11:34.767962+0000 mgr.a (mgr.14355) 4788 : audit [DBG] from='client.113214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:36 smithi007 bash[22722]: audit 2024-09-14T00:11:34.767962+0000 mgr.a (mgr.14355) 4788 : audit [DBG] from='client.113214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:37 smithi131 bash[24745]: cluster 2024-09-14T00:11:36.431306+0000 mgr.a (mgr.14355) 4789 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:37 smithi171 bash[25040]: cluster 2024-09-14T00:11:36.431306+0000 mgr.a (mgr.14355) 4789 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:37 smithi007 bash[22722]: cluster 2024-09-14T00:11:36.431306+0000 mgr.a (mgr.14355) 4789 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:39 smithi171 bash[25040]: cluster 2024-09-14T00:11:38.432038+0000 mgr.a (mgr.14355) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:39 smithi007 bash[22722]: cluster 2024-09-14T00:11:38.432038+0000 mgr.a (mgr.14355) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:39 smithi131 bash[24745]: cluster 2024-09-14T00:11:38.432038+0000 mgr.a (mgr.14355) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:40.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:40.206 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:40.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:40.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:41 smithi171 bash[25040]: cluster 2024-09-14T00:11:40.433944+0000 mgr.a (mgr.14355) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:41 smithi171 bash[25040]: audit 2024-09-14T00:11:40.533013+0000 mgr.a (mgr.14355) 4792 : audit [DBG] from='client.113292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:41 smithi007 bash[22722]: cluster 2024-09-14T00:11:40.433944+0000 mgr.a (mgr.14355) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:41 smithi007 bash[22722]: audit 2024-09-14T00:11:40.533013+0000 mgr.a (mgr.14355) 4792 : audit [DBG] from='client.113292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:41 smithi131 bash[24745]: cluster 2024-09-14T00:11:40.433944+0000 mgr.a (mgr.14355) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:41 smithi131 bash[24745]: audit 2024-09-14T00:11:40.533013+0000 mgr.a (mgr.14355) 4792 : audit [DBG] from='client.113292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:43 smithi171 bash[25040]: cluster 2024-09-14T00:11:42.434957+0000 mgr.a (mgr.14355) 4793 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:43 smithi007 bash[22722]: cluster 2024-09-14T00:11:42.434957+0000 mgr.a (mgr.14355) 4793 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:43 smithi131 bash[24745]: cluster 2024-09-14T00:11:42.434957+0000 mgr.a (mgr.14355) 4793 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:45.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:45.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:45.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:45 smithi007 bash[22722]: cluster 2024-09-14T00:11:44.435924+0000 mgr.a (mgr.14355) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:11:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:45 smithi131 bash[24745]: cluster 2024-09-14T00:11:44.435924+0000 mgr.a (mgr.14355) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:11:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:45 smithi171 bash[25040]: cluster 2024-09-14T00:11:44.435924+0000 mgr.a (mgr.14355) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:11:46.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:46.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:46.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:46.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:46.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:47 smithi007 bash[22722]: audit 2024-09-14T00:11:46.283087+0000 mgr.a (mgr.14355) 4795 : audit [DBG] from='client.113367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:47 smithi007 bash[22722]: cluster 2024-09-14T00:11:46.437689+0000 mgr.a (mgr.14355) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:47 smithi131 bash[24745]: audit 2024-09-14T00:11:46.283087+0000 mgr.a (mgr.14355) 4795 : audit [DBG] from='client.113367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:47 smithi131 bash[24745]: cluster 2024-09-14T00:11:46.437689+0000 mgr.a (mgr.14355) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:47 smithi171 bash[25040]: audit 2024-09-14T00:11:46.283087+0000 mgr.a (mgr.14355) 4795 : audit [DBG] from='client.113367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:47 smithi171 bash[25040]: cluster 2024-09-14T00:11:46.437689+0000 mgr.a (mgr.14355) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:49 smithi007 bash[22722]: cluster 2024-09-14T00:11:48.438598+0000 mgr.a (mgr.14355) 4797 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:49 smithi131 bash[24745]: cluster 2024-09-14T00:11:48.438598+0000 mgr.a (mgr.14355) 4797 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:49 smithi171 bash[25040]: cluster 2024-09-14T00:11:48.438598+0000 mgr.a (mgr.14355) 4797 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:11:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:51.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:51.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:51 smithi007 bash[22722]: cluster 2024-09-14T00:11:50.440785+0000 mgr.a (mgr.14355) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:51 smithi131 bash[24745]: cluster 2024-09-14T00:11:50.440785+0000 mgr.a (mgr.14355) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:51 smithi171 bash[25040]: cluster 2024-09-14T00:11:50.440785+0000 mgr.a (mgr.14355) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:52.491 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:52.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:52.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:53 smithi007 bash[22722]: audit 2024-09-14T00:11:52.056297+0000 mgr.a (mgr.14355) 4799 : audit [DBG] from='client.113445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:53 smithi007 bash[22722]: cluster 2024-09-14T00:11:52.441330+0000 mgr.a (mgr.14355) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:53 smithi131 bash[24745]: audit 2024-09-14T00:11:52.056297+0000 mgr.a (mgr.14355) 4799 : audit [DBG] from='client.113445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:53 smithi131 bash[24745]: cluster 2024-09-14T00:11:52.441330+0000 mgr.a (mgr.14355) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:53 smithi171 bash[25040]: audit 2024-09-14T00:11:52.056297+0000 mgr.a (mgr.14355) 4799 : audit [DBG] from='client.113445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:53 smithi171 bash[25040]: cluster 2024-09-14T00:11:52.441330+0000 mgr.a (mgr.14355) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:55 smithi007 bash[22722]: cluster 2024-09-14T00:11:54.442073+0000 mgr.a (mgr.14355) 4801 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:55 smithi131 bash[24745]: cluster 2024-09-14T00:11:54.442073+0000 mgr.a (mgr.14355) 4801 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:55 smithi171 bash[25040]: cluster 2024-09-14T00:11:54.442073+0000 mgr.a (mgr.14355) 4801 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:57.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:11:57.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:11:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:57 smithi007 bash[22722]: cluster 2024-09-14T00:11:56.444266+0000 mgr.a (mgr.14355) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:57 smithi007 bash[22722]: audit 2024-09-14T00:11:57.139447+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:11:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:57 smithi131 bash[24745]: cluster 2024-09-14T00:11:56.444266+0000 mgr.a (mgr.14355) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:57 smithi131 bash[24745]: audit 2024-09-14T00:11:57.139447+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:11:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:57 smithi171 bash[25040]: cluster 2024-09-14T00:11:56.444266+0000 mgr.a (mgr.14355) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:11:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:57 smithi171 bash[25040]: audit 2024-09-14T00:11:57.139447+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:11:58.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:11:58.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:11:58.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:11:58.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:11:58.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:11:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:57.745327+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:57.748239+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:57.753555+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:57.759497+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:57.928988+0000 mgr.a (mgr.14355) 4803 : audit [DBG] from='client.113520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:58.437631+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:11:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:58.438608+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:11:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:58.444383+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: cluster 2024-09-14T00:11:58.444750+0000 mgr.a (mgr.14355) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:59.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:58.447258+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:11:58 smithi131 bash[24745]: audit 2024-09-14T00:11:58.449939+0000 mgr.a (mgr.14355) 4805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:57.745327+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:57.748239+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:57.753555+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:57.759497+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:57.928988+0000 mgr.a (mgr.14355) 4803 : audit [DBG] from='client.113520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:58.437631+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:58.438608+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:58.444383+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: cluster 2024-09-14T00:11:58.444750+0000 mgr.a (mgr.14355) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:58.447258+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:11:58 smithi171 bash[25040]: audit 2024-09-14T00:11:58.449939+0000 mgr.a (mgr.14355) 4805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:57.745327+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:57.748239+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:57.753555+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:57.759497+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:57.928988+0000 mgr.a (mgr.14355) 4803 : audit [DBG] from='client.113520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:58.437631+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:58.438608+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:58.444383+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: cluster 2024-09-14T00:11:58.444750+0000 mgr.a (mgr.14355) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:11:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:58.447258+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:11:58 smithi007 bash[22722]: audit 2024-09-14T00:11:58.449939+0000 mgr.a (mgr.14355) 4805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:11:59.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:11:59 smithi007 bash[22972]: debug 2024-09-14T00:11:59.142+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:11:59.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:11:59 smithi007 bash[22972]: debug 2024-09-14T00:11:59.142+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:12:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:00 smithi007 bash[22722]: audit 2024-09-14T00:11:59.148267+0000 mgr.a (mgr.14355) 4806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:12:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:00 smithi007 bash[22722]: cephadm 2024-09-14T00:11:59.149481+0000 mgr.a (mgr.14355) 4807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:12:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:00 smithi131 bash[24745]: audit 2024-09-14T00:11:59.148267+0000 mgr.a (mgr.14355) 4806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:12:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:00 smithi131 bash[24745]: cephadm 2024-09-14T00:11:59.149481+0000 mgr.a (mgr.14355) 4807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:12:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:00 smithi171 bash[25040]: audit 2024-09-14T00:11:59.148267+0000 mgr.a (mgr.14355) 4806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:12:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:00 smithi171 bash[25040]: cephadm 2024-09-14T00:11:59.149481+0000 mgr.a (mgr.14355) 4807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:12:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:01 smithi131 bash[24745]: cluster 2024-09-14T00:12:00.447106+0000 mgr.a (mgr.14355) 4808 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:12:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:01 smithi171 bash[25040]: cluster 2024-09-14T00:12:00.447106+0000 mgr.a (mgr.14355) 4808 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:12:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:01 smithi007 bash[22722]: cluster 2024-09-14T00:12:00.447106+0000 mgr.a (mgr.14355) 4808 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:12:03.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:03.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:03.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:03 smithi131 bash[24745]: cluster 2024-09-14T00:12:02.447899+0000 mgr.a (mgr.14355) 4809 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:03 smithi171 bash[25040]: cluster 2024-09-14T00:12:02.447899+0000 mgr.a (mgr.14355) 4809 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:03 smithi007 bash[22722]: cluster 2024-09-14T00:12:02.447899+0000 mgr.a (mgr.14355) 4809 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:04.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:04.203 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:05 smithi131 bash[24745]: audit 2024-09-14T00:12:03.749151+0000 mgr.a (mgr.14355) 4810 : audit [DBG] from='client.113700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:05 smithi131 bash[24745]: cluster 2024-09-14T00:12:04.448760+0000 mgr.a (mgr.14355) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:05 smithi171 bash[25040]: audit 2024-09-14T00:12:03.749151+0000 mgr.a (mgr.14355) 4810 : audit [DBG] from='client.113700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:05 smithi171 bash[25040]: cluster 2024-09-14T00:12:04.448760+0000 mgr.a (mgr.14355) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:05 smithi007 bash[22722]: audit 2024-09-14T00:12:03.749151+0000 mgr.a (mgr.14355) 4810 : audit [DBG] from='client.113700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:05 smithi007 bash[22722]: cluster 2024-09-14T00:12:04.448760+0000 mgr.a (mgr.14355) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:12:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:07 smithi131 bash[24745]: cluster 2024-09-14T00:12:06.451015+0000 mgr.a (mgr.14355) 4812 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:07 smithi171 bash[25040]: cluster 2024-09-14T00:12:06.451015+0000 mgr.a (mgr.14355) 4812 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:07 smithi007 bash[22722]: cluster 2024-09-14T00:12:06.451015+0000 mgr.a (mgr.14355) 4812 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:09 smithi131 bash[24745]: cluster 2024-09-14T00:12:08.451778+0000 mgr.a (mgr.14355) 4813 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:12:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:09 smithi171 bash[25040]: cluster 2024-09-14T00:12:08.451778+0000 mgr.a (mgr.14355) 4813 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:12:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:09 smithi007 bash[22722]: cluster 2024-09-14T00:12:08.451778+0000 mgr.a (mgr.14355) 4813 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:12:09.957 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:09.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:10 smithi131 bash[24745]: audit 2024-09-14T00:12:09.534754+0000 mgr.a (mgr.14355) 4814 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:10 smithi171 bash[25040]: audit 2024-09-14T00:12:09.534754+0000 mgr.a (mgr.14355) 4814 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:10 smithi007 bash[22722]: audit 2024-09-14T00:12:09.534754+0000 mgr.a (mgr.14355) 4814 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:11 smithi131 bash[24745]: cluster 2024-09-14T00:12:10.454073+0000 mgr.a (mgr.14355) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:11 smithi171 bash[25040]: cluster 2024-09-14T00:12:10.454073+0000 mgr.a (mgr.14355) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:11 smithi007 bash[22722]: cluster 2024-09-14T00:12:10.454073+0000 mgr.a (mgr.14355) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-09-14T00:12:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:13 smithi131 bash[24745]: cluster 2024-09-14T00:12:12.454861+0000 mgr.a (mgr.14355) 4816 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:13 smithi171 bash[25040]: cluster 2024-09-14T00:12:12.454861+0000 mgr.a (mgr.14355) 4816 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:13 smithi007 bash[22722]: cluster 2024-09-14T00:12:12.454861+0000 mgr.a (mgr.14355) 4816 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:14.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:14.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:14.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:15.734 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:15 smithi131 bash[24745]: cluster 2024-09-14T00:12:14.455618+0000 mgr.a (mgr.14355) 4817 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:15 smithi171 bash[25040]: cluster 2024-09-14T00:12:14.455618+0000 mgr.a (mgr.14355) 4817 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:15 smithi007 bash[22722]: cluster 2024-09-14T00:12:14.455618+0000 mgr.a (mgr.14355) 4817 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:16 smithi131 bash[24745]: audit 2024-09-14T00:12:15.293797+0000 mgr.a (mgr.14355) 4818 : audit [DBG] from='client.113841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:16 smithi171 bash[25040]: audit 2024-09-14T00:12:15.293797+0000 mgr.a (mgr.14355) 4818 : audit [DBG] from='client.113841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:16 smithi007 bash[22722]: audit 2024-09-14T00:12:15.293797+0000 mgr.a (mgr.14355) 4818 : audit [DBG] from='client.113841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:17 smithi131 bash[24745]: cluster 2024-09-14T00:12:16.458399+0000 mgr.a (mgr.14355) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:17 smithi171 bash[25040]: cluster 2024-09-14T00:12:16.458399+0000 mgr.a (mgr.14355) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:17 smithi007 bash[22722]: cluster 2024-09-14T00:12:16.458399+0000 mgr.a (mgr.14355) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:12:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:19 smithi131 bash[24745]: cluster 2024-09-14T00:12:18.459113+0000 mgr.a (mgr.14355) 4820 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:12:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:19 smithi171 bash[25040]: cluster 2024-09-14T00:12:18.459113+0000 mgr.a (mgr.14355) 4820 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:12:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:19 smithi007 bash[22722]: cluster 2024-09-14T00:12:18.459113+0000 mgr.a (mgr.14355) 4820 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:12:20.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:20.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:20.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:21.494 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:21.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:21.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:21.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:21.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:21 smithi131 bash[24745]: cluster 2024-09-14T00:12:20.461005+0000 mgr.a (mgr.14355) 4821 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:21 smithi171 bash[25040]: cluster 2024-09-14T00:12:20.461005+0000 mgr.a (mgr.14355) 4821 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:21 smithi007 bash[22722]: cluster 2024-09-14T00:12:20.461005+0000 mgr.a (mgr.14355) 4821 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:22 smithi131 bash[24745]: audit 2024-09-14T00:12:21.068678+0000 mgr.a (mgr.14355) 4822 : audit [DBG] from='client.113916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:22 smithi171 bash[25040]: audit 2024-09-14T00:12:21.068678+0000 mgr.a (mgr.14355) 4822 : audit [DBG] from='client.113916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:22 smithi007 bash[22722]: audit 2024-09-14T00:12:21.068678+0000 mgr.a (mgr.14355) 4822 : audit [DBG] from='client.113916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:23 smithi131 bash[24745]: cluster 2024-09-14T00:12:22.461909+0000 mgr.a (mgr.14355) 4823 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:23 smithi171 bash[25040]: cluster 2024-09-14T00:12:22.461909+0000 mgr.a (mgr.14355) 4823 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:23 smithi007 bash[22722]: cluster 2024-09-14T00:12:22.461909+0000 mgr.a (mgr.14355) 4823 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:25 smithi131 bash[24745]: cluster 2024-09-14T00:12:24.462716+0000 mgr.a (mgr.14355) 4824 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:25 smithi171 bash[25040]: cluster 2024-09-14T00:12:24.462716+0000 mgr.a (mgr.14355) 4824 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:25 smithi007 bash[22722]: cluster 2024-09-14T00:12:24.462716+0000 mgr.a (mgr.14355) 4824 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:27.233 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:27 smithi171 bash[25040]: cluster 2024-09-14T00:12:26.464968+0000 mgr.a (mgr.14355) 4825 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:27 smithi007 bash[22722]: cluster 2024-09-14T00:12:26.464968+0000 mgr.a (mgr.14355) 4825 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:27 smithi131 bash[24745]: cluster 2024-09-14T00:12:26.464968+0000 mgr.a (mgr.14355) 4825 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:28 smithi171 bash[25040]: audit 2024-09-14T00:12:26.818814+0000 mgr.a (mgr.14355) 4826 : audit [DBG] from='client.113991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:28 smithi007 bash[22722]: audit 2024-09-14T00:12:26.818814+0000 mgr.a (mgr.14355) 4826 : audit [DBG] from='client.113991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:28 smithi131 bash[24745]: audit 2024-09-14T00:12:26.818814+0000 mgr.a (mgr.14355) 4826 : audit [DBG] from='client.113991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:29 smithi007 bash[22722]: cluster 2024-09-14T00:12:28.465932+0000 mgr.a (mgr.14355) 4827 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:29 smithi131 bash[24745]: cluster 2024-09-14T00:12:28.465932+0000 mgr.a (mgr.14355) 4827 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:29 smithi171 bash[25040]: cluster 2024-09-14T00:12:28.465932+0000 mgr.a (mgr.14355) 4827 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:31 smithi007 bash[22722]: cluster 2024-09-14T00:12:30.468224+0000 mgr.a (mgr.14355) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T00:12:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:31 smithi131 bash[24745]: cluster 2024-09-14T00:12:30.468224+0000 mgr.a (mgr.14355) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T00:12:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:31 smithi171 bash[25040]: cluster 2024-09-14T00:12:30.468224+0000 mgr.a (mgr.14355) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T00:12:32.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:32.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:32.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:32.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:32.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:32.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:32.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:32.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:33 smithi007 bash[22722]: cluster 2024-09-14T00:12:32.469035+0000 mgr.a (mgr.14355) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:33 smithi007 bash[22722]: audit 2024-09-14T00:12:32.563023+0000 mgr.a (mgr.14355) 4830 : audit [DBG] from='client.114066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:33 smithi131 bash[24745]: cluster 2024-09-14T00:12:32.469035+0000 mgr.a (mgr.14355) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:33 smithi131 bash[24745]: audit 2024-09-14T00:12:32.563023+0000 mgr.a (mgr.14355) 4830 : audit [DBG] from='client.114066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:33 smithi171 bash[25040]: cluster 2024-09-14T00:12:32.469035+0000 mgr.a (mgr.14355) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:33 smithi171 bash[25040]: audit 2024-09-14T00:12:32.563023+0000 mgr.a (mgr.14355) 4830 : audit [DBG] from='client.114066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:35 smithi007 bash[22722]: cluster 2024-09-14T00:12:34.469958+0000 mgr.a (mgr.14355) 4831 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:35 smithi131 bash[24745]: cluster 2024-09-14T00:12:34.469958+0000 mgr.a (mgr.14355) 4831 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:35 smithi171 bash[25040]: cluster 2024-09-14T00:12:34.469958+0000 mgr.a (mgr.14355) 4831 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:37 smithi007 bash[22722]: cluster 2024-09-14T00:12:36.472218+0000 mgr.a (mgr.14355) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:37.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:37.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:37.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:37 smithi131 bash[24745]: cluster 2024-09-14T00:12:36.472218+0000 mgr.a (mgr.14355) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:37 smithi171 bash[25040]: cluster 2024-09-14T00:12:36.472218+0000 mgr.a (mgr.14355) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:38.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:38.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:39 smithi007 bash[22722]: audit 2024-09-14T00:12:38.316866+0000 mgr.a (mgr.14355) 4833 : audit [DBG] from='client.114144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:39 smithi007 bash[22722]: cluster 2024-09-14T00:12:38.472765+0000 mgr.a (mgr.14355) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:39 smithi131 bash[24745]: audit 2024-09-14T00:12:38.316866+0000 mgr.a (mgr.14355) 4833 : audit [DBG] from='client.114144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:39 smithi131 bash[24745]: cluster 2024-09-14T00:12:38.472765+0000 mgr.a (mgr.14355) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:39 smithi171 bash[25040]: audit 2024-09-14T00:12:38.316866+0000 mgr.a (mgr.14355) 4833 : audit [DBG] from='client.114144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:39 smithi171 bash[25040]: cluster 2024-09-14T00:12:38.472765+0000 mgr.a (mgr.14355) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:41 smithi007 bash[22722]: cluster 2024-09-14T00:12:40.475089+0000 mgr.a (mgr.14355) 4835 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:41 smithi131 bash[24745]: cluster 2024-09-14T00:12:40.475089+0000 mgr.a (mgr.14355) 4835 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:41 smithi171 bash[25040]: cluster 2024-09-14T00:12:40.475089+0000 mgr.a (mgr.14355) 4835 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:43.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:43.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:43 smithi007 bash[22722]: cluster 2024-09-14T00:12:42.475905+0000 mgr.a (mgr.14355) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:43 smithi131 bash[24745]: cluster 2024-09-14T00:12:42.475905+0000 mgr.a (mgr.14355) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:43 smithi171 bash[25040]: cluster 2024-09-14T00:12:42.475905+0000 mgr.a (mgr.14355) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:44.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:44.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:44.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:44.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:44.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:45 smithi007 bash[22722]: audit 2024-09-14T00:12:44.098733+0000 mgr.a (mgr.14355) 4837 : audit [DBG] from='client.114222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:45 smithi007 bash[22722]: cluster 2024-09-14T00:12:44.476433+0000 mgr.a (mgr.14355) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:45 smithi131 bash[24745]: audit 2024-09-14T00:12:44.098733+0000 mgr.a (mgr.14355) 4837 : audit [DBG] from='client.114222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:45 smithi131 bash[24745]: cluster 2024-09-14T00:12:44.476433+0000 mgr.a (mgr.14355) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:45 smithi171 bash[25040]: audit 2024-09-14T00:12:44.098733+0000 mgr.a (mgr.14355) 4837 : audit [DBG] from='client.114222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:45 smithi171 bash[25040]: cluster 2024-09-14T00:12:44.476433+0000 mgr.a (mgr.14355) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:47 smithi007 bash[22722]: cluster 2024-09-14T00:12:46.478675+0000 mgr.a (mgr.14355) 4839 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:47 smithi131 bash[24745]: cluster 2024-09-14T00:12:46.478675+0000 mgr.a (mgr.14355) 4839 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:47 smithi171 bash[25040]: cluster 2024-09-14T00:12:46.478675+0000 mgr.a (mgr.14355) 4839 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:12:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:48 smithi007 bash[22722]: cluster 2024-09-14T00:12:48.479448+0000 mgr.a (mgr.14355) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:48 smithi131 bash[24745]: cluster 2024-09-14T00:12:48.479448+0000 mgr.a (mgr.14355) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:48 smithi171 bash[25040]: cluster 2024-09-14T00:12:48.479448+0000 mgr.a (mgr.14355) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:49.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:50.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:50.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:51 smithi171 bash[25040]: audit 2024-09-14T00:12:49.853972+0000 mgr.a (mgr.14355) 4841 : audit [DBG] from='client.114300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:51 smithi171 bash[25040]: cluster 2024-09-14T00:12:50.481956+0000 mgr.a (mgr.14355) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:51 smithi007 bash[22722]: audit 2024-09-14T00:12:49.853972+0000 mgr.a (mgr.14355) 4841 : audit [DBG] from='client.114300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:51 smithi007 bash[22722]: cluster 2024-09-14T00:12:50.481956+0000 mgr.a (mgr.14355) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:51 smithi131 bash[24745]: audit 2024-09-14T00:12:49.853972+0000 mgr.a (mgr.14355) 4841 : audit [DBG] from='client.114300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:51 smithi131 bash[24745]: cluster 2024-09-14T00:12:50.481956+0000 mgr.a (mgr.14355) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:12:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:53 smithi171 bash[25040]: cluster 2024-09-14T00:12:52.482965+0000 mgr.a (mgr.14355) 4843 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:53 smithi007 bash[22722]: cluster 2024-09-14T00:12:52.482965+0000 mgr.a (mgr.14355) 4843 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:53 smithi131 bash[24745]: cluster 2024-09-14T00:12:52.482965+0000 mgr.a (mgr.14355) 4843 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:55.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:12:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:12:55.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:12:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:55 smithi007 bash[22722]: cluster 2024-09-14T00:12:54.483920+0000 mgr.a (mgr.14355) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:55 smithi131 bash[24745]: cluster 2024-09-14T00:12:54.483920+0000 mgr.a (mgr.14355) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:55 smithi171 bash[25040]: cluster 2024-09-14T00:12:54.483920+0000 mgr.a (mgr.14355) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:12:56.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:12:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:12:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:12:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:12:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:12:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:57 smithi007 bash[22722]: audit 2024-09-14T00:12:55.638574+0000 mgr.a (mgr.14355) 4845 : audit [DBG] from='client.114378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:57 smithi007 bash[22722]: cluster 2024-09-14T00:12:56.486824+0000 mgr.a (mgr.14355) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:57 smithi131 bash[24745]: audit 2024-09-14T00:12:55.638574+0000 mgr.a (mgr.14355) 4845 : audit [DBG] from='client.114378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:57 smithi131 bash[24745]: cluster 2024-09-14T00:12:56.486824+0000 mgr.a (mgr.14355) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:57 smithi171 bash[25040]: audit 2024-09-14T00:12:55.638574+0000 mgr.a (mgr.14355) 4845 : audit [DBG] from='client.114378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:12:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:57 smithi171 bash[25040]: cluster 2024-09-14T00:12:56.486824+0000 mgr.a (mgr.14355) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:12:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:59 smithi007 bash[22722]: cluster 2024-09-14T00:12:58.487597+0000 mgr.a (mgr.14355) 4847 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:12:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:12:59 smithi007 bash[22722]: audit 2024-09-14T00:12:59.198839+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:13:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:59 smithi131 bash[24745]: cluster 2024-09-14T00:12:58.487597+0000 mgr.a (mgr.14355) 4847 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:13:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:12:59 smithi131 bash[24745]: audit 2024-09-14T00:12:59.198839+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:13:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:59 smithi171 bash[25040]: cluster 2024-09-14T00:12:58.487597+0000 mgr.a (mgr.14355) 4847 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:13:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:12:59 smithi171 bash[25040]: audit 2024-09-14T00:12:59.198839+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:13:00.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22722]: audit 2024-09-14T00:13:00.067257+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:13:00.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22722]: audit 2024-09-14T00:13:00.068957+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:13:00.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22722]: audit 2024-09-14T00:13:00.079077+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:13:00.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22722]: audit 2024-09-14T00:13:00.083908+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:00 smithi131 bash[24745]: audit 2024-09-14T00:13:00.067257+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:13:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:00 smithi131 bash[24745]: audit 2024-09-14T00:13:00.068957+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:13:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:00 smithi131 bash[24745]: audit 2024-09-14T00:13:00.079077+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:13:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:00 smithi131 bash[24745]: audit 2024-09-14T00:13:00.083908+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:00 smithi171 bash[25040]: audit 2024-09-14T00:13:00.067257+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:13:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:00 smithi171 bash[25040]: audit 2024-09-14T00:13:00.068957+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:13:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:00 smithi171 bash[25040]: audit 2024-09-14T00:13:00.079077+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:13:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:00 smithi171 bash[25040]: audit 2024-09-14T00:13:00.083908+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:01.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:01.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22972]: debug 2024-09-14T00:13:00.821+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:13:01.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:13:00 smithi007 bash[22972]: debug 2024-09-14T00:13:00.825+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:13:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:01.814 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:01 smithi007 bash[22722]: audit 2024-09-14T00:13:00.086283+0000 mgr.a (mgr.14355) 4848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:01 smithi007 bash[22722]: cluster 2024-09-14T00:13:00.489008+0000 mgr.a (mgr.14355) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:13:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:01 smithi131 bash[24745]: audit 2024-09-14T00:13:00.086283+0000 mgr.a (mgr.14355) 4848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:01 smithi131 bash[24745]: cluster 2024-09-14T00:13:00.489008+0000 mgr.a (mgr.14355) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:13:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:01 smithi171 bash[25040]: audit 2024-09-14T00:13:00.086283+0000 mgr.a (mgr.14355) 4848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:13:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:01 smithi171 bash[25040]: cluster 2024-09-14T00:13:00.489008+0000 mgr.a (mgr.14355) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:13:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:02 smithi007 bash[22722]: audit 2024-09-14T00:13:00.825771+0000 mgr.a (mgr.14355) 4850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:13:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:02 smithi007 bash[22722]: cephadm 2024-09-14T00:13:00.827066+0000 mgr.a (mgr.14355) 4851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:13:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:02 smithi007 bash[22722]: audit 2024-09-14T00:13:01.406363+0000 mgr.a (mgr.14355) 4852 : audit [DBG] from='client.114564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:02 smithi131 bash[24745]: audit 2024-09-14T00:13:00.825771+0000 mgr.a (mgr.14355) 4850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:13:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:02 smithi131 bash[24745]: cephadm 2024-09-14T00:13:00.827066+0000 mgr.a (mgr.14355) 4851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:13:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:02 smithi131 bash[24745]: audit 2024-09-14T00:13:01.406363+0000 mgr.a (mgr.14355) 4852 : audit [DBG] from='client.114564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:02 smithi171 bash[25040]: audit 2024-09-14T00:13:00.825771+0000 mgr.a (mgr.14355) 4850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:13:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:02 smithi171 bash[25040]: cephadm 2024-09-14T00:13:00.827066+0000 mgr.a (mgr.14355) 4851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:13:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:02 smithi171 bash[25040]: audit 2024-09-14T00:13:01.406363+0000 mgr.a (mgr.14355) 4852 : audit [DBG] from='client.114564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:03 smithi007 bash[22722]: cluster 2024-09-14T00:13:02.489972+0000 mgr.a (mgr.14355) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:04.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:03 smithi131 bash[24745]: cluster 2024-09-14T00:13:02.489972+0000 mgr.a (mgr.14355) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:03 smithi171 bash[25040]: cluster 2024-09-14T00:13:02.489972+0000 mgr.a (mgr.14355) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:05 smithi007 bash[22722]: cluster 2024-09-14T00:13:04.490810+0000 mgr.a (mgr.14355) 4854 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:05 smithi131 bash[24745]: cluster 2024-09-14T00:13:04.490810+0000 mgr.a (mgr.14355) 4854 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:05 smithi171 bash[25040]: cluster 2024-09-14T00:13:04.490810+0000 mgr.a (mgr.14355) 4854 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T00:13:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:06.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:06.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:07.571 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:07.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:07.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:07.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:07.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:07 smithi007 bash[22722]: cluster 2024-09-14T00:13:06.492984+0000 mgr.a (mgr.14355) 4855 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:07 smithi131 bash[24745]: cluster 2024-09-14T00:13:06.492984+0000 mgr.a (mgr.14355) 4855 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:07 smithi171 bash[25040]: cluster 2024-09-14T00:13:06.492984+0000 mgr.a (mgr.14355) 4855 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:08 smithi007 bash[22722]: audit 2024-09-14T00:13:07.144789+0000 mgr.a (mgr.14355) 4856 : audit [DBG] from='client.114642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:08 smithi131 bash[24745]: audit 2024-09-14T00:13:07.144789+0000 mgr.a (mgr.14355) 4856 : audit [DBG] from='client.114642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:08 smithi171 bash[25040]: audit 2024-09-14T00:13:07.144789+0000 mgr.a (mgr.14355) 4856 : audit [DBG] from='client.114642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:09 smithi007 bash[22722]: cluster 2024-09-14T00:13:08.493949+0000 mgr.a (mgr.14355) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:09 smithi131 bash[24745]: cluster 2024-09-14T00:13:08.493949+0000 mgr.a (mgr.14355) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:09 smithi171 bash[25040]: cluster 2024-09-14T00:13:08.493949+0000 mgr.a (mgr.14355) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:11 smithi007 bash[22722]: cluster 2024-09-14T00:13:10.496148+0000 mgr.a (mgr.14355) 4858 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:11 smithi131 bash[24745]: cluster 2024-09-14T00:13:10.496148+0000 mgr.a (mgr.14355) 4858 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:11 smithi171 bash[25040]: cluster 2024-09-14T00:13:10.496148+0000 mgr.a (mgr.14355) 4858 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:12 smithi007 bash[22722]: cluster 2024-09-14T00:13:12.496947+0000 mgr.a (mgr.14355) 4859 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:12 smithi131 bash[24745]: cluster 2024-09-14T00:13:12.496947+0000 mgr.a (mgr.14355) 4859 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:12 smithi171 bash[25040]: cluster 2024-09-14T00:13:12.496947+0000 mgr.a (mgr.14355) 4859 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:13.348 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:13 smithi007 bash[22722]: audit 2024-09-14T00:13:12.907135+0000 mgr.a (mgr.14355) 4860 : audit [DBG] from='client.114720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:13 smithi131 bash[24745]: audit 2024-09-14T00:13:12.907135+0000 mgr.a (mgr.14355) 4860 : audit [DBG] from='client.114720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:13 smithi171 bash[25040]: audit 2024-09-14T00:13:12.907135+0000 mgr.a (mgr.14355) 4860 : audit [DBG] from='client.114720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:14 smithi007 bash[22722]: cluster 2024-09-14T00:13:14.497944+0000 mgr.a (mgr.14355) 4861 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:14 smithi131 bash[24745]: cluster 2024-09-14T00:13:14.497944+0000 mgr.a (mgr.14355) 4861 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:14 smithi171 bash[25040]: cluster 2024-09-14T00:13:14.497944+0000 mgr.a (mgr.14355) 4861 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:13:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:17 smithi007 bash[22722]: cluster 2024-09-14T00:13:16.500235+0000 mgr.a (mgr.14355) 4862 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:17 smithi131 bash[24745]: cluster 2024-09-14T00:13:16.500235+0000 mgr.a (mgr.14355) 4862 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:17 smithi171 bash[25040]: cluster 2024-09-14T00:13:16.500235+0000 mgr.a (mgr.14355) 4862 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:13:18.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:19.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:19.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:19 smithi007 bash[22722]: cluster 2024-09-14T00:13:18.500667+0000 mgr.a (mgr.14355) 4863 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:19 smithi131 bash[24745]: cluster 2024-09-14T00:13:18.500667+0000 mgr.a (mgr.14355) 4863 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:19 smithi171 bash[25040]: cluster 2024-09-14T00:13:18.500667+0000 mgr.a (mgr.14355) 4863 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:20 smithi007 bash[22722]: audit 2024-09-14T00:13:18.681603+0000 mgr.a (mgr.14355) 4864 : audit [DBG] from='client.114798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:20 smithi131 bash[24745]: audit 2024-09-14T00:13:18.681603+0000 mgr.a (mgr.14355) 4864 : audit [DBG] from='client.114798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:20 smithi171 bash[25040]: audit 2024-09-14T00:13:18.681603+0000 mgr.a (mgr.14355) 4864 : audit [DBG] from='client.114798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:21 smithi007 bash[22722]: cluster 2024-09-14T00:13:20.502901+0000 mgr.a (mgr.14355) 4865 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:21 smithi131 bash[24745]: cluster 2024-09-14T00:13:20.502901+0000 mgr.a (mgr.14355) 4865 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:21 smithi171 bash[25040]: cluster 2024-09-14T00:13:20.502901+0000 mgr.a (mgr.14355) 4865 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:23 smithi007 bash[22722]: cluster 2024-09-14T00:13:22.503717+0000 mgr.a (mgr.14355) 4866 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:23 smithi131 bash[24745]: cluster 2024-09-14T00:13:22.503717+0000 mgr.a (mgr.14355) 4866 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:23 smithi171 bash[25040]: cluster 2024-09-14T00:13:22.503717+0000 mgr.a (mgr.14355) 4866 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:24.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:24.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:24.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:24.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:24.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:24.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:25 smithi007 bash[22722]: audit 2024-09-14T00:13:24.425807+0000 mgr.a (mgr.14355) 4867 : audit [DBG] from='client.114876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:25 smithi007 bash[22722]: cluster 2024-09-14T00:13:24.504277+0000 mgr.a (mgr.14355) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:25 smithi131 bash[24745]: audit 2024-09-14T00:13:24.425807+0000 mgr.a (mgr.14355) 4867 : audit [DBG] from='client.114876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:25 smithi131 bash[24745]: cluster 2024-09-14T00:13:24.504277+0000 mgr.a (mgr.14355) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:25 smithi171 bash[25040]: audit 2024-09-14T00:13:24.425807+0000 mgr.a (mgr.14355) 4867 : audit [DBG] from='client.114876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:25 smithi171 bash[25040]: cluster 2024-09-14T00:13:24.504277+0000 mgr.a (mgr.14355) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:27 smithi007 bash[22722]: cluster 2024-09-14T00:13:26.506739+0000 mgr.a (mgr.14355) 4869 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:27 smithi131 bash[24745]: cluster 2024-09-14T00:13:26.506739+0000 mgr.a (mgr.14355) 4869 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:27 smithi171 bash[25040]: cluster 2024-09-14T00:13:26.506739+0000 mgr.a (mgr.14355) 4869 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:29.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:29.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:29.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:29 smithi007 bash[22722]: cluster 2024-09-14T00:13:28.507671+0000 mgr.a (mgr.14355) 4870 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:29 smithi131 bash[24745]: cluster 2024-09-14T00:13:28.507671+0000 mgr.a (mgr.14355) 4870 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:29 smithi171 bash[25040]: cluster 2024-09-14T00:13:28.507671+0000 mgr.a (mgr.14355) 4870 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:30.586 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:31 smithi007 bash[22722]: audit 2024-09-14T00:13:30.170320+0000 mgr.a (mgr.14355) 4871 : audit [DBG] from='client.114951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:31 smithi007 bash[22722]: cluster 2024-09-14T00:13:30.509034+0000 mgr.a (mgr.14355) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:31 smithi131 bash[24745]: audit 2024-09-14T00:13:30.170320+0000 mgr.a (mgr.14355) 4871 : audit [DBG] from='client.114951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:31 smithi131 bash[24745]: cluster 2024-09-14T00:13:30.509034+0000 mgr.a (mgr.14355) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:31 smithi171 bash[25040]: audit 2024-09-14T00:13:30.170320+0000 mgr.a (mgr.14355) 4871 : audit [DBG] from='client.114951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:31 smithi171 bash[25040]: cluster 2024-09-14T00:13:30.509034+0000 mgr.a (mgr.14355) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:32 smithi007 bash[22722]: cluster 2024-09-14T00:13:32.509806+0000 mgr.a (mgr.14355) 4873 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:32 smithi131 bash[24745]: cluster 2024-09-14T00:13:32.509806+0000 mgr.a (mgr.14355) 4873 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:32 smithi171 bash[25040]: cluster 2024-09-14T00:13:32.509806+0000 mgr.a (mgr.14355) 4873 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:35.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:35.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:35.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:35 smithi007 bash[22722]: cluster 2024-09-14T00:13:34.510601+0000 mgr.a (mgr.14355) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:35 smithi131 bash[24745]: cluster 2024-09-14T00:13:34.510601+0000 mgr.a (mgr.14355) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:35 smithi171 bash[25040]: cluster 2024-09-14T00:13:34.510601+0000 mgr.a (mgr.14355) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:13:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:36.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:36.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:36.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:36.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:37 smithi007 bash[22722]: audit 2024-09-14T00:13:35.919751+0000 mgr.a (mgr.14355) 4875 : audit [DBG] from='client.115026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:37 smithi007 bash[22722]: cluster 2024-09-14T00:13:36.513581+0000 mgr.a (mgr.14355) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:37 smithi131 bash[24745]: audit 2024-09-14T00:13:35.919751+0000 mgr.a (mgr.14355) 4875 : audit [DBG] from='client.115026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:37 smithi131 bash[24745]: cluster 2024-09-14T00:13:36.513581+0000 mgr.a (mgr.14355) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:37 smithi171 bash[25040]: audit 2024-09-14T00:13:35.919751+0000 mgr.a (mgr.14355) 4875 : audit [DBG] from='client.115026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:37 smithi171 bash[25040]: cluster 2024-09-14T00:13:36.513581+0000 mgr.a (mgr.14355) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:39 smithi007 bash[22722]: cluster 2024-09-14T00:13:38.514559+0000 mgr.a (mgr.14355) 4877 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:13:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:39 smithi131 bash[24745]: cluster 2024-09-14T00:13:38.514559+0000 mgr.a (mgr.14355) 4877 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:13:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:39 smithi171 bash[25040]: cluster 2024-09-14T00:13:38.514559+0000 mgr.a (mgr.14355) 4877 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:13:41.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:41.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:41.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:41 smithi007 bash[22722]: cluster 2024-09-14T00:13:40.516650+0000 mgr.a (mgr.14355) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:41 smithi131 bash[24745]: cluster 2024-09-14T00:13:40.516650+0000 mgr.a (mgr.14355) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:41 smithi171 bash[25040]: cluster 2024-09-14T00:13:40.516650+0000 mgr.a (mgr.14355) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:42.137 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:42.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:42.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:43 smithi007 bash[22722]: audit 2024-09-14T00:13:41.697323+0000 mgr.a (mgr.14355) 4879 : audit [DBG] from='client.115104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:43 smithi007 bash[22722]: cluster 2024-09-14T00:13:42.517615+0000 mgr.a (mgr.14355) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:43 smithi131 bash[24745]: audit 2024-09-14T00:13:41.697323+0000 mgr.a (mgr.14355) 4879 : audit [DBG] from='client.115104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:43 smithi131 bash[24745]: cluster 2024-09-14T00:13:42.517615+0000 mgr.a (mgr.14355) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:43 smithi171 bash[25040]: audit 2024-09-14T00:13:41.697323+0000 mgr.a (mgr.14355) 4879 : audit [DBG] from='client.115104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:43 smithi171 bash[25040]: cluster 2024-09-14T00:13:42.517615+0000 mgr.a (mgr.14355) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:45 smithi007 bash[22722]: cluster 2024-09-14T00:13:44.518589+0000 mgr.a (mgr.14355) 4881 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:45 smithi131 bash[24745]: cluster 2024-09-14T00:13:44.518589+0000 mgr.a (mgr.14355) 4881 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:45 smithi171 bash[25040]: cluster 2024-09-14T00:13:44.518589+0000 mgr.a (mgr.14355) 4881 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:47.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:47.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:47.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:47 smithi007 bash[22722]: cluster 2024-09-14T00:13:46.520876+0000 mgr.a (mgr.14355) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:47 smithi131 bash[24745]: cluster 2024-09-14T00:13:46.520876+0000 mgr.a (mgr.14355) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:47 smithi171 bash[25040]: cluster 2024-09-14T00:13:46.520876+0000 mgr.a (mgr.14355) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:48 smithi007 bash[22722]: audit 2024-09-14T00:13:47.474060+0000 mgr.a (mgr.14355) 4883 : audit [DBG] from='client.115182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:48 smithi131 bash[24745]: audit 2024-09-14T00:13:47.474060+0000 mgr.a (mgr.14355) 4883 : audit [DBG] from='client.115182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:48 smithi171 bash[25040]: audit 2024-09-14T00:13:47.474060+0000 mgr.a (mgr.14355) 4883 : audit [DBG] from='client.115182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:49 smithi007 bash[22722]: cluster 2024-09-14T00:13:48.521874+0000 mgr.a (mgr.14355) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:49 smithi131 bash[24745]: cluster 2024-09-14T00:13:48.521874+0000 mgr.a (mgr.14355) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:49 smithi171 bash[25040]: cluster 2024-09-14T00:13:48.521874+0000 mgr.a (mgr.14355) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:50 smithi007 bash[22722]: cluster 2024-09-14T00:13:50.524075+0000 mgr.a (mgr.14355) 4885 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:50 smithi131 bash[24745]: cluster 2024-09-14T00:13:50.524075+0000 mgr.a (mgr.14355) 4885 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:50 smithi171 bash[25040]: cluster 2024-09-14T00:13:50.524075+0000 mgr.a (mgr.14355) 4885 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:52.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:52.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:52.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:53.700 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:53.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:53.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:53.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:53 smithi007 bash[22722]: cluster 2024-09-14T00:13:52.524840+0000 mgr.a (mgr.14355) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:53 smithi131 bash[24745]: cluster 2024-09-14T00:13:52.524840+0000 mgr.a (mgr.14355) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:53 smithi171 bash[25040]: cluster 2024-09-14T00:13:52.524840+0000 mgr.a (mgr.14355) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:54 smithi007 bash[22722]: audit 2024-09-14T00:13:53.255025+0000 mgr.a (mgr.14355) 4887 : audit [DBG] from='client.115257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:54 smithi131 bash[24745]: audit 2024-09-14T00:13:53.255025+0000 mgr.a (mgr.14355) 4887 : audit [DBG] from='client.115257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:54 smithi171 bash[25040]: audit 2024-09-14T00:13:53.255025+0000 mgr.a (mgr.14355) 4887 : audit [DBG] from='client.115257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:13:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:55 smithi007 bash[22722]: cluster 2024-09-14T00:13:54.525955+0000 mgr.a (mgr.14355) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:55 smithi131 bash[24745]: cluster 2024-09-14T00:13:54.525955+0000 mgr.a (mgr.14355) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:55 smithi171 bash[25040]: cluster 2024-09-14T00:13:54.525955+0000 mgr.a (mgr.14355) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:57 smithi007 bash[22722]: cluster 2024-09-14T00:13:56.528400+0000 mgr.a (mgr.14355) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:57 smithi131 bash[24745]: cluster 2024-09-14T00:13:56.528400+0000 mgr.a (mgr.14355) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:57 smithi171 bash[25040]: cluster 2024-09-14T00:13:56.528400+0000 mgr.a (mgr.14355) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:13:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:13:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:13:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:13:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:58 smithi007 bash[22722]: cluster 2024-09-14T00:13:58.529208+0000 mgr.a (mgr.14355) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:58 smithi131 bash[24745]: cluster 2024-09-14T00:13:58.529208+0000 mgr.a (mgr.14355) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:58 smithi171 bash[25040]: cluster 2024-09-14T00:13:58.529208+0000 mgr.a (mgr.14355) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:13:59.490 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:13:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:13:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:13:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:13:59.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:13:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:13:59 smithi007 bash[22722]: audit 2024-09-14T00:13:59.038749+0000 mgr.a (mgr.14355) 4891 : audit [DBG] from='client.115335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:13:59 smithi131 bash[24745]: audit 2024-09-14T00:13:59.038749+0000 mgr.a (mgr.14355) 4891 : audit [DBG] from='client.115335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:13:59 smithi171 bash[25040]: audit 2024-09-14T00:13:59.038749+0000 mgr.a (mgr.14355) 4891 : audit [DBG] from='client.115335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:00 smithi007 bash[22722]: cluster 2024-09-14T00:14:00.531512+0000 mgr.a (mgr.14355) 4892 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:00 smithi131 bash[24745]: cluster 2024-09-14T00:14:00.531512+0000 mgr.a (mgr.14355) 4892 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:00 smithi171 bash[25040]: cluster 2024-09-14T00:14:00.531512+0000 mgr.a (mgr.14355) 4892 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:01 smithi007 bash[22722]: audit 2024-09-14T00:14:00.876421+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:14:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:01 smithi131 bash[24745]: audit 2024-09-14T00:14:00.876421+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:14:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:01 smithi171 bash[25040]: audit 2024-09-14T00:14:00.876421+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:14:02.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22972]: debug 2024-09-14T00:14:02.448+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:14:02.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22972]: debug 2024-09-14T00:14:02.452+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:01.709466+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:01.711118+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:01.720808+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:01.723730+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:01.726058+0000 mgr.a (mgr.14355) 4893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: audit 2024-09-14T00:14:02.453836+0000 mgr.a (mgr.14355) 4894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: cephadm 2024-09-14T00:14:02.455196+0000 mgr.a (mgr.14355) 4895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:14:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:02 smithi007 bash[22722]: cluster 2024-09-14T00:14:02.532158+0000 mgr.a (mgr.14355) 4896 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:01.709466+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:01.711118+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:01.720808+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:01.723730+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:01.726058+0000 mgr.a (mgr.14355) 4893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: audit 2024-09-14T00:14:02.453836+0000 mgr.a (mgr.14355) 4894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:14:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: cephadm 2024-09-14T00:14:02.455196+0000 mgr.a (mgr.14355) 4895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:14:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:02 smithi131 bash[24745]: cluster 2024-09-14T00:14:02.532158+0000 mgr.a (mgr.14355) 4896 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:01.709466+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:01.711118+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:01.720808+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:01.723730+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:01.726058+0000 mgr.a (mgr.14355) 4893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: audit 2024-09-14T00:14:02.453836+0000 mgr.a (mgr.14355) 4894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: cephadm 2024-09-14T00:14:02.455196+0000 mgr.a (mgr.14355) 4895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:14:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:02 smithi171 bash[25040]: cluster 2024-09-14T00:14:02.532158+0000 mgr.a (mgr.14355) 4896 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:04.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:04.492 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:04.492 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:05.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:05 smithi007 bash[22722]: cluster 2024-09-14T00:14:04.532810+0000 mgr.a (mgr.14355) 4897 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:05 smithi131 bash[24745]: cluster 2024-09-14T00:14:04.532810+0000 mgr.a (mgr.14355) 4897 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:05 smithi171 bash[25040]: cluster 2024-09-14T00:14:04.532810+0000 mgr.a (mgr.14355) 4897 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:06 smithi007 bash[22722]: audit 2024-09-14T00:14:04.824710+0000 mgr.a (mgr.14355) 4898 : audit [DBG] from='client.115518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:06 smithi131 bash[24745]: audit 2024-09-14T00:14:04.824710+0000 mgr.a (mgr.14355) 4898 : audit [DBG] from='client.115518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:06 smithi171 bash[25040]: audit 2024-09-14T00:14:04.824710+0000 mgr.a (mgr.14355) 4898 : audit [DBG] from='client.115518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:07 smithi007 bash[22722]: cluster 2024-09-14T00:14:06.535086+0000 mgr.a (mgr.14355) 4899 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:07 smithi131 bash[24745]: cluster 2024-09-14T00:14:06.535086+0000 mgr.a (mgr.14355) 4899 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:07 smithi171 bash[25040]: cluster 2024-09-14T00:14:06.535086+0000 mgr.a (mgr.14355) 4899 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:08 smithi007 bash[22722]: cluster 2024-09-14T00:14:08.535880+0000 mgr.a (mgr.14355) 4900 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:08 smithi131 bash[24745]: cluster 2024-09-14T00:14:08.535880+0000 mgr.a (mgr.14355) 4900 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:08 smithi171 bash[25040]: cluster 2024-09-14T00:14:08.535880+0000 mgr.a (mgr.14355) 4900 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:10.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:10.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:10.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:11 smithi007 bash[22722]: cluster 2024-09-14T00:14:10.537814+0000 mgr.a (mgr.14355) 4901 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:11 smithi007 bash[22722]: audit 2024-09-14T00:14:10.567051+0000 mgr.a (mgr.14355) 4902 : audit [DBG] from='client.115593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:11 smithi131 bash[24745]: cluster 2024-09-14T00:14:10.537814+0000 mgr.a (mgr.14355) 4901 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:11 smithi131 bash[24745]: audit 2024-09-14T00:14:10.567051+0000 mgr.a (mgr.14355) 4902 : audit [DBG] from='client.115593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:11 smithi171 bash[25040]: cluster 2024-09-14T00:14:10.537814+0000 mgr.a (mgr.14355) 4901 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:11 smithi171 bash[25040]: audit 2024-09-14T00:14:10.567051+0000 mgr.a (mgr.14355) 4902 : audit [DBG] from='client.115593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:13 smithi007 bash[22722]: cluster 2024-09-14T00:14:12.538768+0000 mgr.a (mgr.14355) 4903 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:13 smithi131 bash[24745]: cluster 2024-09-14T00:14:12.538768+0000 mgr.a (mgr.14355) 4903 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:13 smithi171 bash[25040]: cluster 2024-09-14T00:14:12.538768+0000 mgr.a (mgr.14355) 4903 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:14 smithi007 bash[22722]: cluster 2024-09-14T00:14:14.539542+0000 mgr.a (mgr.14355) 4904 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:14 smithi131 bash[24745]: cluster 2024-09-14T00:14:14.539542+0000 mgr.a (mgr.14355) 4904 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:14 smithi171 bash[25040]: cluster 2024-09-14T00:14:14.539542+0000 mgr.a (mgr.14355) 4904 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:14:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:16.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:17 smithi007 bash[22722]: audit 2024-09-14T00:14:16.326766+0000 mgr.a (mgr.14355) 4905 : audit [DBG] from='client.115668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:17 smithi007 bash[22722]: cluster 2024-09-14T00:14:16.540904+0000 mgr.a (mgr.14355) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:17 smithi131 bash[24745]: audit 2024-09-14T00:14:16.326766+0000 mgr.a (mgr.14355) 4905 : audit [DBG] from='client.115668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:17 smithi131 bash[24745]: cluster 2024-09-14T00:14:16.540904+0000 mgr.a (mgr.14355) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:17 smithi171 bash[25040]: audit 2024-09-14T00:14:16.326766+0000 mgr.a (mgr.14355) 4905 : audit [DBG] from='client.115668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:17 smithi171 bash[25040]: cluster 2024-09-14T00:14:16.540904+0000 mgr.a (mgr.14355) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:14:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:19 smithi007 bash[22722]: cluster 2024-09-14T00:14:18.541750+0000 mgr.a (mgr.14355) 4907 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:19 smithi131 bash[24745]: cluster 2024-09-14T00:14:18.541750+0000 mgr.a (mgr.14355) 4907 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:19 smithi171 bash[25040]: cluster 2024-09-14T00:14:18.541750+0000 mgr.a (mgr.14355) 4907 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:20 smithi007 bash[22722]: cluster 2024-09-14T00:14:20.543961+0000 mgr.a (mgr.14355) 4908 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:20 smithi131 bash[24745]: cluster 2024-09-14T00:14:20.543961+0000 mgr.a (mgr.14355) 4908 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:20 smithi171 bash[25040]: cluster 2024-09-14T00:14:20.543961+0000 mgr.a (mgr.14355) 4908 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:21.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:21.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:21.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:22.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:22.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:22.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:23 smithi007 bash[22722]: audit 2024-09-14T00:14:22.099563+0000 mgr.a (mgr.14355) 4909 : audit [DBG] from='client.115746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:23 smithi007 bash[22722]: cluster 2024-09-14T00:14:22.544636+0000 mgr.a (mgr.14355) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:23 smithi131 bash[24745]: audit 2024-09-14T00:14:22.099563+0000 mgr.a (mgr.14355) 4909 : audit [DBG] from='client.115746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:23 smithi131 bash[24745]: cluster 2024-09-14T00:14:22.544636+0000 mgr.a (mgr.14355) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:23 smithi171 bash[25040]: audit 2024-09-14T00:14:22.099563+0000 mgr.a (mgr.14355) 4909 : audit [DBG] from='client.115746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:23 smithi171 bash[25040]: cluster 2024-09-14T00:14:22.544636+0000 mgr.a (mgr.14355) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:24 smithi007 bash[22722]: cluster 2024-09-14T00:14:24.545369+0000 mgr.a (mgr.14355) 4911 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:24 smithi131 bash[24745]: cluster 2024-09-14T00:14:24.545369+0000 mgr.a (mgr.14355) 4911 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:24 smithi171 bash[25040]: cluster 2024-09-14T00:14:24.545369+0000 mgr.a (mgr.14355) 4911 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:27.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:27.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:27 smithi007 bash[22722]: cluster 2024-09-14T00:14:26.547617+0000 mgr.a (mgr.14355) 4912 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:27 smithi131 bash[24745]: cluster 2024-09-14T00:14:26.547617+0000 mgr.a (mgr.14355) 4912 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:27 smithi171 bash[25040]: cluster 2024-09-14T00:14:26.547617+0000 mgr.a (mgr.14355) 4912 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:28.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:28.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:28 smithi007 bash[22722]: audit 2024-09-14T00:14:27.872680+0000 mgr.a (mgr.14355) 4913 : audit [DBG] from='client.115824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:28 smithi007 bash[22722]: cluster 2024-09-14T00:14:28.548537+0000 mgr.a (mgr.14355) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:28 smithi131 bash[24745]: audit 2024-09-14T00:14:27.872680+0000 mgr.a (mgr.14355) 4913 : audit [DBG] from='client.115824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:28 smithi131 bash[24745]: cluster 2024-09-14T00:14:28.548537+0000 mgr.a (mgr.14355) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:28 smithi171 bash[25040]: audit 2024-09-14T00:14:27.872680+0000 mgr.a (mgr.14355) 4913 : audit [DBG] from='client.115824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:28 smithi171 bash[25040]: cluster 2024-09-14T00:14:28.548537+0000 mgr.a (mgr.14355) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:30 smithi007 bash[22722]: cluster 2024-09-14T00:14:30.550852+0000 mgr.a (mgr.14355) 4915 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:30 smithi131 bash[24745]: cluster 2024-09-14T00:14:30.550852+0000 mgr.a (mgr.14355) 4915 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:30 smithi171 bash[25040]: cluster 2024-09-14T00:14:30.550852+0000 mgr.a (mgr.14355) 4915 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:32 smithi007 bash[22722]: cluster 2024-09-14T00:14:32.551770+0000 mgr.a (mgr.14355) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:32 smithi131 bash[24745]: cluster 2024-09-14T00:14:32.551770+0000 mgr.a (mgr.14355) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:32 smithi171 bash[25040]: cluster 2024-09-14T00:14:32.551770+0000 mgr.a (mgr.14355) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:33.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:33.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:33.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:34.033 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:34.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:34 smithi007 bash[22722]: audit 2024-09-14T00:14:33.628860+0000 mgr.a (mgr.14355) 4917 : audit [DBG] from='client.115899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:34 smithi007 bash[22722]: cluster 2024-09-14T00:14:34.552738+0000 mgr.a (mgr.14355) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:34 smithi131 bash[24745]: audit 2024-09-14T00:14:33.628860+0000 mgr.a (mgr.14355) 4917 : audit [DBG] from='client.115899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:34 smithi131 bash[24745]: cluster 2024-09-14T00:14:34.552738+0000 mgr.a (mgr.14355) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:34 smithi171 bash[25040]: audit 2024-09-14T00:14:33.628860+0000 mgr.a (mgr.14355) 4917 : audit [DBG] from='client.115899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:34 smithi171 bash[25040]: cluster 2024-09-14T00:14:34.552738+0000 mgr.a (mgr.14355) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:36 smithi007 bash[22722]: cluster 2024-09-14T00:14:36.555022+0000 mgr.a (mgr.14355) 4919 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:36 smithi131 bash[24745]: cluster 2024-09-14T00:14:36.555022+0000 mgr.a (mgr.14355) 4919 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:36 smithi171 bash[25040]: cluster 2024-09-14T00:14:36.555022+0000 mgr.a (mgr.14355) 4919 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:38 smithi007 bash[22722]: cluster 2024-09-14T00:14:38.555781+0000 mgr.a (mgr.14355) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:38 smithi131 bash[24745]: cluster 2024-09-14T00:14:38.555781+0000 mgr.a (mgr.14355) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:39.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:39.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:39.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:38 smithi171 bash[25040]: cluster 2024-09-14T00:14:38.555781+0000 mgr.a (mgr.14355) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:39.806 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:39.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:39.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:39.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:39.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:39 smithi007 bash[22722]: audit 2024-09-14T00:14:39.367942+0000 mgr.a (mgr.14355) 4921 : audit [DBG] from='client.115974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:39 smithi131 bash[24745]: audit 2024-09-14T00:14:39.367942+0000 mgr.a (mgr.14355) 4921 : audit [DBG] from='client.115974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:39 smithi171 bash[25040]: audit 2024-09-14T00:14:39.367942+0000 mgr.a (mgr.14355) 4921 : audit [DBG] from='client.115974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:40 smithi007 bash[22722]: cluster 2024-09-14T00:14:40.558054+0000 mgr.a (mgr.14355) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:40 smithi131 bash[24745]: cluster 2024-09-14T00:14:40.558054+0000 mgr.a (mgr.14355) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:40 smithi171 bash[25040]: cluster 2024-09-14T00:14:40.558054+0000 mgr.a (mgr.14355) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:14:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:42 smithi007 bash[22722]: cluster 2024-09-14T00:14:42.558817+0000 mgr.a (mgr.14355) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:42 smithi131 bash[24745]: cluster 2024-09-14T00:14:42.558817+0000 mgr.a (mgr.14355) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:42 smithi171 bash[25040]: cluster 2024-09-14T00:14:42.558817+0000 mgr.a (mgr.14355) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:44.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:44.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:44.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:44 smithi007 bash[22722]: cluster 2024-09-14T00:14:44.559572+0000 mgr.a (mgr.14355) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:44 smithi131 bash[24745]: cluster 2024-09-14T00:14:44.559572+0000 mgr.a (mgr.14355) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:44 smithi171 bash[25040]: cluster 2024-09-14T00:14:44.559572+0000 mgr.a (mgr.14355) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:45.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:45.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:45.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:45.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:45.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:45 smithi007 bash[22722]: audit 2024-09-14T00:14:45.139036+0000 mgr.a (mgr.14355) 4925 : audit [DBG] from='client.116052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:45 smithi131 bash[24745]: audit 2024-09-14T00:14:45.139036+0000 mgr.a (mgr.14355) 4925 : audit [DBG] from='client.116052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:45 smithi171 bash[25040]: audit 2024-09-14T00:14:45.139036+0000 mgr.a (mgr.14355) 4925 : audit [DBG] from='client.116052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:47 smithi131 bash[24745]: cluster 2024-09-14T00:14:46.562386+0000 mgr.a (mgr.14355) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:47 smithi171 bash[25040]: cluster 2024-09-14T00:14:46.562386+0000 mgr.a (mgr.14355) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:47 smithi007 bash[22722]: cluster 2024-09-14T00:14:46.562386+0000 mgr.a (mgr.14355) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:48 smithi007 bash[22722]: cluster 2024-09-14T00:14:48.563090+0000 mgr.a (mgr.14355) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:48 smithi131 bash[24745]: cluster 2024-09-14T00:14:48.563090+0000 mgr.a (mgr.14355) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:48 smithi171 bash[25040]: cluster 2024-09-14T00:14:48.563090+0000 mgr.a (mgr.14355) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:50.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:50.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:50.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:50 smithi007 bash[22722]: cluster 2024-09-14T00:14:50.565007+0000 mgr.a (mgr.14355) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:50 smithi131 bash[24745]: cluster 2024-09-14T00:14:50.565007+0000 mgr.a (mgr.14355) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:50 smithi171 bash[25040]: cluster 2024-09-14T00:14:50.565007+0000 mgr.a (mgr.14355) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:51.330 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:51.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:51.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:51.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:51.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:51 smithi007 bash[22722]: audit 2024-09-14T00:14:50.917338+0000 mgr.a (mgr.14355) 4929 : audit [DBG] from='client.116130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:51 smithi131 bash[24745]: audit 2024-09-14T00:14:50.917338+0000 mgr.a (mgr.14355) 4929 : audit [DBG] from='client.116130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:51 smithi171 bash[25040]: audit 2024-09-14T00:14:50.917338+0000 mgr.a (mgr.14355) 4929 : audit [DBG] from='client.116130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:52 smithi007 bash[22722]: cluster 2024-09-14T00:14:52.565870+0000 mgr.a (mgr.14355) 4930 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:52 smithi131 bash[24745]: cluster 2024-09-14T00:14:52.565870+0000 mgr.a (mgr.14355) 4930 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:52 smithi171 bash[25040]: cluster 2024-09-14T00:14:52.565870+0000 mgr.a (mgr.14355) 4930 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:14:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:54 smithi007 bash[22722]: cluster 2024-09-14T00:14:54.566655+0000 mgr.a (mgr.14355) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:54 smithi131 bash[24745]: cluster 2024-09-14T00:14:54.566655+0000 mgr.a (mgr.14355) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:54 smithi171 bash[25040]: cluster 2024-09-14T00:14:54.566655+0000 mgr.a (mgr.14355) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:14:56.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:14:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:14:56.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:14:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:56 smithi007 bash[22722]: cluster 2024-09-14T00:14:56.568884+0000 mgr.a (mgr.14355) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:56 smithi131 bash[24745]: cluster 2024-09-14T00:14:56.568884+0000 mgr.a (mgr.14355) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:56 smithi171 bash[25040]: cluster 2024-09-14T00:14:56.568884+0000 mgr.a (mgr.14355) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:57.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:14:57.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:14:57.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:14:57.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:14:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:14:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:57 smithi007 bash[22722]: audit 2024-09-14T00:14:56.664952+0000 mgr.a (mgr.14355) 4933 : audit [DBG] from='client.116205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:57 smithi131 bash[24745]: audit 2024-09-14T00:14:56.664952+0000 mgr.a (mgr.14355) 4933 : audit [DBG] from='client.116205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:57 smithi171 bash[25040]: audit 2024-09-14T00:14:56.664952+0000 mgr.a (mgr.14355) 4933 : audit [DBG] from='client.116205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:14:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:14:58 smithi007 bash[22722]: cluster 2024-09-14T00:14:58.569899+0000 mgr.a (mgr.14355) 4934 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:14:58 smithi131 bash[24745]: cluster 2024-09-14T00:14:58.569899+0000 mgr.a (mgr.14355) 4934 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:14:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:14:58 smithi171 bash[25040]: cluster 2024-09-14T00:14:58.569899+0000 mgr.a (mgr.14355) 4934 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:00 smithi007 bash[22722]: cluster 2024-09-14T00:15:00.572156+0000 mgr.a (mgr.14355) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:00 smithi131 bash[24745]: cluster 2024-09-14T00:15:00.572156+0000 mgr.a (mgr.14355) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:00 smithi171 bash[25040]: cluster 2024-09-14T00:15:00.572156+0000 mgr.a (mgr.14355) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:02.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:02.067 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:02.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:02.825 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:02.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:02.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:02.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:02.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:02 smithi007 bash[22722]: audit 2024-09-14T00:15:02.509309+0000 mon.a (mon.0) 1337 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:15:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:02 smithi131 bash[24745]: audit 2024-09-14T00:15:02.509309+0000 mon.a (mon.0) 1337 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:15:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:02 smithi171 bash[25040]: audit 2024-09-14T00:15:02.509309+0000 mon.a (mon.0) 1337 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: audit 2024-09-14T00:15:02.398191+0000 mgr.a (mgr.14355) 4936 : audit [DBG] from='client.116283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: cluster 2024-09-14T00:15:02.572656+0000 mgr.a (mgr.14355) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: audit 2024-09-14T00:15:03.320948+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: audit 2024-09-14T00:15:03.323121+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:15:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: audit 2024-09-14T00:15:03.333763+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:15:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:03 smithi007 bash[22722]: audit 2024-09-14T00:15:03.338681+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: audit 2024-09-14T00:15:02.398191+0000 mgr.a (mgr.14355) 4936 : audit [DBG] from='client.116283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: cluster 2024-09-14T00:15:02.572656+0000 mgr.a (mgr.14355) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: audit 2024-09-14T00:15:03.320948+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: audit 2024-09-14T00:15:03.323121+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: audit 2024-09-14T00:15:03.333763+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:15:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:03 smithi131 bash[24745]: audit 2024-09-14T00:15:03.338681+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: audit 2024-09-14T00:15:02.398191+0000 mgr.a (mgr.14355) 4936 : audit [DBG] from='client.116283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: cluster 2024-09-14T00:15:02.572656+0000 mgr.a (mgr.14355) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: audit 2024-09-14T00:15:03.320948+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:15:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: audit 2024-09-14T00:15:03.323121+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:15:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: audit 2024-09-14T00:15:03.333763+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:15:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:03 smithi171 bash[25040]: audit 2024-09-14T00:15:03.338681+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:04.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:15:04 smithi007 bash[22972]: debug 2024-09-14T00:15:04.071+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:15:04.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:15:04 smithi007 bash[22972]: debug 2024-09-14T00:15:04.075+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:15:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:04 smithi007 bash[22722]: audit 2024-09-14T00:15:03.341348+0000 mgr.a (mgr.14355) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:04 smithi131 bash[24745]: audit 2024-09-14T00:15:03.341348+0000 mgr.a (mgr.14355) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:04 smithi171 bash[25040]: audit 2024-09-14T00:15:03.341348+0000 mgr.a (mgr.14355) 4938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:15:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:05 smithi007 bash[22722]: audit 2024-09-14T00:15:04.077377+0000 mgr.a (mgr.14355) 4939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:15:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:05 smithi007 bash[22722]: cephadm 2024-09-14T00:15:04.078627+0000 mgr.a (mgr.14355) 4940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:15:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:05 smithi007 bash[22722]: cluster 2024-09-14T00:15:04.573485+0000 mgr.a (mgr.14355) 4941 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:05 smithi131 bash[24745]: audit 2024-09-14T00:15:04.077377+0000 mgr.a (mgr.14355) 4939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:15:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:05 smithi131 bash[24745]: cephadm 2024-09-14T00:15:04.078627+0000 mgr.a (mgr.14355) 4940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:15:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:05 smithi131 bash[24745]: cluster 2024-09-14T00:15:04.573485+0000 mgr.a (mgr.14355) 4941 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:05 smithi171 bash[25040]: audit 2024-09-14T00:15:04.077377+0000 mgr.a (mgr.14355) 4939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:15:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:05 smithi171 bash[25040]: cephadm 2024-09-14T00:15:04.078627+0000 mgr.a (mgr.14355) 4940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:15:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:05 smithi171 bash[25040]: cluster 2024-09-14T00:15:04.573485+0000 mgr.a (mgr.14355) 4941 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:07.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:07.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:07.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:07 smithi007 bash[22722]: cluster 2024-09-14T00:15:06.575760+0000 mgr.a (mgr.14355) 4942 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:07 smithi131 bash[24745]: cluster 2024-09-14T00:15:06.575760+0000 mgr.a (mgr.14355) 4942 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:07 smithi171 bash[25040]: cluster 2024-09-14T00:15:06.575760+0000 mgr.a (mgr.14355) 4942 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:08.606 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:09 smithi007 bash[22722]: audit 2024-09-14T00:15:08.167782+0000 mgr.a (mgr.14355) 4943 : audit [DBG] from='client.116469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:09 smithi007 bash[22722]: cluster 2024-09-14T00:15:08.576248+0000 mgr.a (mgr.14355) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:09 smithi131 bash[24745]: audit 2024-09-14T00:15:08.167782+0000 mgr.a (mgr.14355) 4943 : audit [DBG] from='client.116469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:09 smithi131 bash[24745]: cluster 2024-09-14T00:15:08.576248+0000 mgr.a (mgr.14355) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:09 smithi171 bash[25040]: audit 2024-09-14T00:15:08.167782+0000 mgr.a (mgr.14355) 4943 : audit [DBG] from='client.116469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:09 smithi171 bash[25040]: cluster 2024-09-14T00:15:08.576248+0000 mgr.a (mgr.14355) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:11 smithi007 bash[22722]: cluster 2024-09-14T00:15:10.578414+0000 mgr.a (mgr.14355) 4945 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:11 smithi131 bash[24745]: cluster 2024-09-14T00:15:10.578414+0000 mgr.a (mgr.14355) 4945 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:11 smithi171 bash[25040]: cluster 2024-09-14T00:15:10.578414+0000 mgr.a (mgr.14355) 4945 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:13.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:13.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:13 smithi007 bash[22722]: cluster 2024-09-14T00:15:12.579183+0000 mgr.a (mgr.14355) 4946 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:13 smithi131 bash[24745]: cluster 2024-09-14T00:15:12.579183+0000 mgr.a (mgr.14355) 4946 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:13 smithi171 bash[25040]: cluster 2024-09-14T00:15:12.579183+0000 mgr.a (mgr.14355) 4946 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:14.349 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:14.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:14.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:15 smithi007 bash[22722]: audit 2024-09-14T00:15:13.937957+0000 mgr.a (mgr.14355) 4947 : audit [DBG] from='client.116544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:15 smithi007 bash[22722]: cluster 2024-09-14T00:15:14.580126+0000 mgr.a (mgr.14355) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:15 smithi131 bash[24745]: audit 2024-09-14T00:15:13.937957+0000 mgr.a (mgr.14355) 4947 : audit [DBG] from='client.116544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:15 smithi131 bash[24745]: cluster 2024-09-14T00:15:14.580126+0000 mgr.a (mgr.14355) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:15 smithi171 bash[25040]: audit 2024-09-14T00:15:13.937957+0000 mgr.a (mgr.14355) 4947 : audit [DBG] from='client.116544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:15 smithi171 bash[25040]: cluster 2024-09-14T00:15:14.580126+0000 mgr.a (mgr.14355) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:17 smithi007 bash[22722]: cluster 2024-09-14T00:15:16.582374+0000 mgr.a (mgr.14355) 4949 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:17 smithi131 bash[24745]: cluster 2024-09-14T00:15:16.582374+0000 mgr.a (mgr.14355) 4949 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:17 smithi171 bash[25040]: cluster 2024-09-14T00:15:16.582374+0000 mgr.a (mgr.14355) 4949 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:15:19.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:19.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:19.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:19 smithi007 bash[22722]: cluster 2024-09-14T00:15:18.583121+0000 mgr.a (mgr.14355) 4950 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:19 smithi131 bash[24745]: cluster 2024-09-14T00:15:18.583121+0000 mgr.a (mgr.14355) 4950 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:19 smithi171 bash[25040]: cluster 2024-09-14T00:15:18.583121+0000 mgr.a (mgr.14355) 4950 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:20.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:21 smithi007 bash[22722]: audit 2024-09-14T00:15:19.687702+0000 mgr.a (mgr.14355) 4951 : audit [DBG] from='client.116619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:21 smithi007 bash[22722]: cluster 2024-09-14T00:15:20.585452+0000 mgr.a (mgr.14355) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:21 smithi131 bash[24745]: audit 2024-09-14T00:15:19.687702+0000 mgr.a (mgr.14355) 4951 : audit [DBG] from='client.116619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:21 smithi131 bash[24745]: cluster 2024-09-14T00:15:20.585452+0000 mgr.a (mgr.14355) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:21 smithi171 bash[25040]: audit 2024-09-14T00:15:19.687702+0000 mgr.a (mgr.14355) 4951 : audit [DBG] from='client.116619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:21 smithi171 bash[25040]: cluster 2024-09-14T00:15:20.585452+0000 mgr.a (mgr.14355) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:23 smithi007 bash[22722]: cluster 2024-09-14T00:15:22.586382+0000 mgr.a (mgr.14355) 4953 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:23 smithi131 bash[24745]: cluster 2024-09-14T00:15:22.586382+0000 mgr.a (mgr.14355) 4953 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:23 smithi171 bash[25040]: cluster 2024-09-14T00:15:22.586382+0000 mgr.a (mgr.14355) 4953 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:24 smithi007 bash[22722]: cluster 2024-09-14T00:15:24.587114+0000 mgr.a (mgr.14355) 4954 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:24 smithi131 bash[24745]: cluster 2024-09-14T00:15:24.587114+0000 mgr.a (mgr.14355) 4954 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:24 smithi171 bash[25040]: cluster 2024-09-14T00:15:24.587114+0000 mgr.a (mgr.14355) 4954 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:25.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:25.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:25.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:25.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:25.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:25.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:25.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:25.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:25 smithi007 bash[22722]: audit 2024-09-14T00:15:25.451182+0000 mgr.a (mgr.14355) 4955 : audit [DBG] from='client.116694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:25 smithi131 bash[24745]: audit 2024-09-14T00:15:25.451182+0000 mgr.a (mgr.14355) 4955 : audit [DBG] from='client.116694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:25 smithi171 bash[25040]: audit 2024-09-14T00:15:25.451182+0000 mgr.a (mgr.14355) 4955 : audit [DBG] from='client.116694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:26 smithi007 bash[22722]: cluster 2024-09-14T00:15:26.589863+0000 mgr.a (mgr.14355) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:26 smithi131 bash[24745]: cluster 2024-09-14T00:15:26.589863+0000 mgr.a (mgr.14355) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:26 smithi171 bash[25040]: cluster 2024-09-14T00:15:26.589863+0000 mgr.a (mgr.14355) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:28 smithi007 bash[22722]: cluster 2024-09-14T00:15:28.590636+0000 mgr.a (mgr.14355) 4957 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:28 smithi131 bash[24745]: cluster 2024-09-14T00:15:28.590636+0000 mgr.a (mgr.14355) 4957 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:28 smithi171 bash[25040]: cluster 2024-09-14T00:15:28.590636+0000 mgr.a (mgr.14355) 4957 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:30.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:30.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:30.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:30 smithi007 bash[22722]: cluster 2024-09-14T00:15:30.592519+0000 mgr.a (mgr.14355) 4958 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:30 smithi131 bash[24745]: cluster 2024-09-14T00:15:30.592519+0000 mgr.a (mgr.14355) 4958 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:30 smithi171 bash[25040]: cluster 2024-09-14T00:15:30.592519+0000 mgr.a (mgr.14355) 4958 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:31.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:31.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:31.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:31.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:31.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:31 smithi007 bash[22722]: audit 2024-09-14T00:15:31.225591+0000 mgr.a (mgr.14355) 4959 : audit [DBG] from='client.116769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:31 smithi131 bash[24745]: audit 2024-09-14T00:15:31.225591+0000 mgr.a (mgr.14355) 4959 : audit [DBG] from='client.116769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:31 smithi171 bash[25040]: audit 2024-09-14T00:15:31.225591+0000 mgr.a (mgr.14355) 4959 : audit [DBG] from='client.116769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:32 smithi007 bash[22722]: cluster 2024-09-14T00:15:32.593575+0000 mgr.a (mgr.14355) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:32 smithi131 bash[24745]: cluster 2024-09-14T00:15:32.593575+0000 mgr.a (mgr.14355) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:32 smithi171 bash[25040]: cluster 2024-09-14T00:15:32.593575+0000 mgr.a (mgr.14355) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:15:34.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:34 smithi007 bash[22722]: cluster 2024-09-14T00:15:34.594523+0000 mgr.a (mgr.14355) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:15:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:34 smithi131 bash[24745]: cluster 2024-09-14T00:15:34.594523+0000 mgr.a (mgr.14355) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:15:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:34 smithi171 bash[25040]: cluster 2024-09-14T00:15:34.594523+0000 mgr.a (mgr.14355) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:15:36.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:36.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:36.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:36 smithi007 bash[22722]: cluster 2024-09-14T00:15:36.596889+0000 mgr.a (mgr.14355) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:36 smithi131 bash[24745]: cluster 2024-09-14T00:15:36.596889+0000 mgr.a (mgr.14355) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:36 smithi171 bash[25040]: cluster 2024-09-14T00:15:36.596889+0000 mgr.a (mgr.14355) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:37.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:37.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:37.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:37.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:37.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:37 smithi007 bash[22722]: audit 2024-09-14T00:15:37.011496+0000 mgr.a (mgr.14355) 4963 : audit [DBG] from='client.116847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:37 smithi131 bash[24745]: audit 2024-09-14T00:15:37.011496+0000 mgr.a (mgr.14355) 4963 : audit [DBG] from='client.116847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:37 smithi171 bash[25040]: audit 2024-09-14T00:15:37.011496+0000 mgr.a (mgr.14355) 4963 : audit [DBG] from='client.116847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:38 smithi007 bash[22722]: cluster 2024-09-14T00:15:38.597767+0000 mgr.a (mgr.14355) 4964 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:38 smithi131 bash[24745]: cluster 2024-09-14T00:15:38.597767+0000 mgr.a (mgr.14355) 4964 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:38 smithi171 bash[25040]: cluster 2024-09-14T00:15:38.597767+0000 mgr.a (mgr.14355) 4964 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:40 smithi007 bash[22722]: cluster 2024-09-14T00:15:40.599922+0000 mgr.a (mgr.14355) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:40 smithi131 bash[24745]: cluster 2024-09-14T00:15:40.599922+0000 mgr.a (mgr.14355) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:40 smithi171 bash[25040]: cluster 2024-09-14T00:15:40.599922+0000 mgr.a (mgr.14355) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:42.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:42.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:42.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:42 smithi007 bash[22722]: cluster 2024-09-14T00:15:42.600478+0000 mgr.a (mgr.14355) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:42 smithi131 bash[24745]: cluster 2024-09-14T00:15:42.600478+0000 mgr.a (mgr.14355) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:42 smithi171 bash[25040]: cluster 2024-09-14T00:15:42.600478+0000 mgr.a (mgr.14355) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:43.236 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:43 smithi007 bash[22722]: audit 2024-09-14T00:15:42.795216+0000 mgr.a (mgr.14355) 4967 : audit [DBG] from='client.116919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:43 smithi131 bash[24745]: audit 2024-09-14T00:15:42.795216+0000 mgr.a (mgr.14355) 4967 : audit [DBG] from='client.116919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:43 smithi171 bash[25040]: audit 2024-09-14T00:15:42.795216+0000 mgr.a (mgr.14355) 4967 : audit [DBG] from='client.116919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:44 smithi007 bash[22722]: cluster 2024-09-14T00:15:44.601381+0000 mgr.a (mgr.14355) 4968 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:44 smithi131 bash[24745]: cluster 2024-09-14T00:15:44.601381+0000 mgr.a (mgr.14355) 4968 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:44 smithi171 bash[25040]: cluster 2024-09-14T00:15:44.601381+0000 mgr.a (mgr.14355) 4968 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:47 smithi171 bash[25040]: cluster 2024-09-14T00:15:46.603602+0000 mgr.a (mgr.14355) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:47 smithi007 bash[22722]: cluster 2024-09-14T00:15:46.603602+0000 mgr.a (mgr.14355) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:47 smithi131 bash[24745]: cluster 2024-09-14T00:15:46.603602+0000 mgr.a (mgr.14355) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:48.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:48 smithi007 bash[22722]: audit 2024-09-14T00:15:48.572219+0000 mgr.a (mgr.14355) 4970 : audit [DBG] from='client.116997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:48 smithi007 bash[22722]: cluster 2024-09-14T00:15:48.604495+0000 mgr.a (mgr.14355) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:48 smithi131 bash[24745]: audit 2024-09-14T00:15:48.572219+0000 mgr.a (mgr.14355) 4970 : audit [DBG] from='client.116997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:48 smithi131 bash[24745]: cluster 2024-09-14T00:15:48.604495+0000 mgr.a (mgr.14355) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:48 smithi171 bash[25040]: audit 2024-09-14T00:15:48.572219+0000 mgr.a (mgr.14355) 4970 : audit [DBG] from='client.116997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:48 smithi171 bash[25040]: cluster 2024-09-14T00:15:48.604495+0000 mgr.a (mgr.14355) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:50 smithi007 bash[22722]: cluster 2024-09-14T00:15:50.606842+0000 mgr.a (mgr.14355) 4972 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:50 smithi131 bash[24745]: cluster 2024-09-14T00:15:50.606842+0000 mgr.a (mgr.14355) 4972 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:50 smithi171 bash[25040]: cluster 2024-09-14T00:15:50.606842+0000 mgr.a (mgr.14355) 4972 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:52 smithi007 bash[22722]: cluster 2024-09-14T00:15:52.607631+0000 mgr.a (mgr.14355) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:52 smithi131 bash[24745]: cluster 2024-09-14T00:15:52.607631+0000 mgr.a (mgr.14355) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:52 smithi171 bash[25040]: cluster 2024-09-14T00:15:52.607631+0000 mgr.a (mgr.14355) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:54.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:54.014 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:15:54.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:15:54.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:15:54.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:15:54.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:15:54.789 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:15:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:54 smithi007 bash[22722]: audit 2024-09-14T00:15:54.350635+0000 mgr.a (mgr.14355) 4974 : audit [DBG] from='client.117075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:54 smithi007 bash[22722]: cluster 2024-09-14T00:15:54.608160+0000 mgr.a (mgr.14355) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:54 smithi131 bash[24745]: audit 2024-09-14T00:15:54.350635+0000 mgr.a (mgr.14355) 4974 : audit [DBG] from='client.117075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:54 smithi131 bash[24745]: cluster 2024-09-14T00:15:54.608160+0000 mgr.a (mgr.14355) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:54 smithi171 bash[25040]: audit 2024-09-14T00:15:54.350635+0000 mgr.a (mgr.14355) 4974 : audit [DBG] from='client.117075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:15:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:54 smithi171 bash[25040]: cluster 2024-09-14T00:15:54.608160+0000 mgr.a (mgr.14355) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:56 smithi007 bash[22722]: cluster 2024-09-14T00:15:56.610558+0000 mgr.a (mgr.14355) 4976 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:56 smithi131 bash[24745]: cluster 2024-09-14T00:15:56.610558+0000 mgr.a (mgr.14355) 4976 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:56 smithi171 bash[25040]: cluster 2024-09-14T00:15:56.610558+0000 mgr.a (mgr.14355) 4976 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:15:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:15:58 smithi007 bash[22722]: cluster 2024-09-14T00:15:58.611346+0000 mgr.a (mgr.14355) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:15:58 smithi131 bash[24745]: cluster 2024-09-14T00:15:58.611346+0000 mgr.a (mgr.14355) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:15:58 smithi171 bash[25040]: cluster 2024-09-14T00:15:58.611346+0000 mgr.a (mgr.14355) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:15:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:15:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:15:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:00.565 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:00.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:00 smithi007 bash[22722]: audit 2024-09-14T00:16:00.124842+0000 mgr.a (mgr.14355) 4978 : audit [DBG] from='client.117153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:00 smithi007 bash[22722]: cluster 2024-09-14T00:16:00.612790+0000 mgr.a (mgr.14355) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:00 smithi131 bash[24745]: audit 2024-09-14T00:16:00.124842+0000 mgr.a (mgr.14355) 4978 : audit [DBG] from='client.117153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:00 smithi131 bash[24745]: cluster 2024-09-14T00:16:00.612790+0000 mgr.a (mgr.14355) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:00 smithi171 bash[25040]: audit 2024-09-14T00:16:00.124842+0000 mgr.a (mgr.14355) 4978 : audit [DBG] from='client.117153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:00 smithi171 bash[25040]: cluster 2024-09-14T00:16:00.612790+0000 mgr.a (mgr.14355) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:02 smithi007 bash[22722]: cluster 2024-09-14T00:16:02.613569+0000 mgr.a (mgr.14355) 4980 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:02 smithi131 bash[24745]: cluster 2024-09-14T00:16:02.613569+0000 mgr.a (mgr.14355) 4980 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:02 smithi171 bash[25040]: cluster 2024-09-14T00:16:02.613569+0000 mgr.a (mgr.14355) 4980 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:04 smithi007 bash[22722]: audit 2024-09-14T00:16:04.127450+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:16:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:04 smithi131 bash[24745]: audit 2024-09-14T00:16:04.127450+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:16:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:04 smithi171 bash[25040]: audit 2024-09-14T00:16:04.127450+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22722]: cluster 2024-09-14T00:16:04.614287+0000 mgr.a (mgr.14355) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22722]: audit 2024-09-14T00:16:04.975415+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22722]: audit 2024-09-14T00:16:04.977404+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22722]: audit 2024-09-14T00:16:04.988044+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22722]: audit 2024-09-14T00:16:04.992855+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:05 smithi131 bash[24745]: cluster 2024-09-14T00:16:04.614287+0000 mgr.a (mgr.14355) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:05 smithi131 bash[24745]: audit 2024-09-14T00:16:04.975415+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:05 smithi131 bash[24745]: audit 2024-09-14T00:16:04.977404+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:05 smithi131 bash[24745]: audit 2024-09-14T00:16:04.988044+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:05 smithi131 bash[24745]: audit 2024-09-14T00:16:04.992855+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:05 smithi171 bash[25040]: cluster 2024-09-14T00:16:04.614287+0000 mgr.a (mgr.14355) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:05 smithi171 bash[25040]: audit 2024-09-14T00:16:04.975415+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:16:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:05 smithi171 bash[25040]: audit 2024-09-14T00:16:04.977404+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:16:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:05 smithi171 bash[25040]: audit 2024-09-14T00:16:04.988044+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:16:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:05 smithi171 bash[25040]: audit 2024-09-14T00:16:04.992855+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:05.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:06.191 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22972]: debug 2024-09-14T00:16:05.738+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:16:06.191 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:16:05 smithi007 bash[22972]: debug 2024-09-14T00:16:05.738+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:16:06.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:06.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:06 smithi007 bash[22722]: audit 2024-09-14T00:16:04.994126+0000 mgr.a (mgr.14355) 4982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:06 smithi131 bash[24745]: audit 2024-09-14T00:16:04.994126+0000 mgr.a (mgr.14355) 4982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:06 smithi171 bash[25040]: audit 2024-09-14T00:16:04.994126+0000 mgr.a (mgr.14355) 4982 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:16:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:07 smithi007 bash[22722]: audit 2024-09-14T00:16:05.743001+0000 mgr.a (mgr.14355) 4983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:16:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:07 smithi007 bash[22722]: cephadm 2024-09-14T00:16:05.744686+0000 mgr.a (mgr.14355) 4984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:16:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:07 smithi007 bash[22722]: audit 2024-09-14T00:16:05.920642+0000 mgr.a (mgr.14355) 4985 : audit [DBG] from='client.117336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:07 smithi007 bash[22722]: cluster 2024-09-14T00:16:06.617117+0000 mgr.a (mgr.14355) 4986 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:16:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:07 smithi131 bash[24745]: audit 2024-09-14T00:16:05.743001+0000 mgr.a (mgr.14355) 4983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:16:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:07 smithi131 bash[24745]: cephadm 2024-09-14T00:16:05.744686+0000 mgr.a (mgr.14355) 4984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:16:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:07 smithi131 bash[24745]: audit 2024-09-14T00:16:05.920642+0000 mgr.a (mgr.14355) 4985 : audit [DBG] from='client.117336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:07 smithi131 bash[24745]: cluster 2024-09-14T00:16:06.617117+0000 mgr.a (mgr.14355) 4986 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:16:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:07 smithi171 bash[25040]: audit 2024-09-14T00:16:05.743001+0000 mgr.a (mgr.14355) 4983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:16:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:07 smithi171 bash[25040]: cephadm 2024-09-14T00:16:05.744686+0000 mgr.a (mgr.14355) 4984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:16:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:07 smithi171 bash[25040]: audit 2024-09-14T00:16:05.920642+0000 mgr.a (mgr.14355) 4985 : audit [DBG] from='client.117336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:07 smithi171 bash[25040]: cluster 2024-09-14T00:16:06.617117+0000 mgr.a (mgr.14355) 4986 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:16:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:08 smithi007 bash[22722]: cluster 2024-09-14T00:16:08.617940+0000 mgr.a (mgr.14355) 4987 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:16:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:08 smithi131 bash[24745]: cluster 2024-09-14T00:16:08.617940+0000 mgr.a (mgr.14355) 4987 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:16:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:08 smithi171 bash[25040]: cluster 2024-09-14T00:16:08.617940+0000 mgr.a (mgr.14355) 4987 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:16:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:10 smithi007 bash[22722]: cluster 2024-09-14T00:16:10.619905+0000 mgr.a (mgr.14355) 4988 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:10 smithi131 bash[24745]: cluster 2024-09-14T00:16:10.619905+0000 mgr.a (mgr.14355) 4988 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:10 smithi171 bash[25040]: cluster 2024-09-14T00:16:10.619905+0000 mgr.a (mgr.14355) 4988 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:12.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:12.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:12.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:12.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:12.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:12 smithi007 bash[22722]: audit 2024-09-14T00:16:11.672282+0000 mgr.a (mgr.14355) 4989 : audit [DBG] from='client.117414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:12 smithi007 bash[22722]: cluster 2024-09-14T00:16:12.620941+0000 mgr.a (mgr.14355) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:12 smithi131 bash[24745]: audit 2024-09-14T00:16:11.672282+0000 mgr.a (mgr.14355) 4989 : audit [DBG] from='client.117414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:12 smithi131 bash[24745]: cluster 2024-09-14T00:16:12.620941+0000 mgr.a (mgr.14355) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:12 smithi171 bash[25040]: audit 2024-09-14T00:16:11.672282+0000 mgr.a (mgr.14355) 4989 : audit [DBG] from='client.117414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:12 smithi171 bash[25040]: cluster 2024-09-14T00:16:12.620941+0000 mgr.a (mgr.14355) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:14 smithi007 bash[22722]: cluster 2024-09-14T00:16:14.621736+0000 mgr.a (mgr.14355) 4991 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:14 smithi131 bash[24745]: cluster 2024-09-14T00:16:14.621736+0000 mgr.a (mgr.14355) 4991 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:14 smithi171 bash[25040]: cluster 2024-09-14T00:16:14.621736+0000 mgr.a (mgr.14355) 4991 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:16 smithi007 bash[22722]: cluster 2024-09-14T00:16:16.623987+0000 mgr.a (mgr.14355) 4992 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:16 smithi131 bash[24745]: cluster 2024-09-14T00:16:16.623987+0000 mgr.a (mgr.14355) 4992 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:16 smithi171 bash[25040]: cluster 2024-09-14T00:16:16.623987+0000 mgr.a (mgr.14355) 4992 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:17.876 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:17.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:17 smithi007 bash[22722]: audit 2024-09-14T00:16:17.435960+0000 mgr.a (mgr.14355) 4993 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:17 smithi131 bash[24745]: audit 2024-09-14T00:16:17.435960+0000 mgr.a (mgr.14355) 4993 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:17 smithi171 bash[25040]: audit 2024-09-14T00:16:17.435960+0000 mgr.a (mgr.14355) 4993 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:18 smithi007 bash[22722]: cluster 2024-09-14T00:16:18.625023+0000 mgr.a (mgr.14355) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:16:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:18 smithi131 bash[24745]: cluster 2024-09-14T00:16:18.625023+0000 mgr.a (mgr.14355) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:16:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:18 smithi171 bash[25040]: cluster 2024-09-14T00:16:18.625023+0000 mgr.a (mgr.14355) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:16:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:20 smithi007 bash[22722]: cluster 2024-09-14T00:16:20.627196+0000 mgr.a (mgr.14355) 4995 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:20 smithi131 bash[24745]: cluster 2024-09-14T00:16:20.627196+0000 mgr.a (mgr.14355) 4995 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:20 smithi171 bash[25040]: cluster 2024-09-14T00:16:20.627196+0000 mgr.a (mgr.14355) 4995 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:16:22.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:22.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:22.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:22 smithi007 bash[22722]: cluster 2024-09-14T00:16:22.627990+0000 mgr.a (mgr.14355) 4996 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:22 smithi131 bash[24745]: cluster 2024-09-14T00:16:22.627990+0000 mgr.a (mgr.14355) 4996 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:22 smithi171 bash[25040]: cluster 2024-09-14T00:16:22.627990+0000 mgr.a (mgr.14355) 4996 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:23.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:23.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:23.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:23.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:23.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:23 smithi007 bash[22722]: audit 2024-09-14T00:16:23.214125+0000 mgr.a (mgr.14355) 4997 : audit [DBG] from='client.117564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:23 smithi131 bash[24745]: audit 2024-09-14T00:16:23.214125+0000 mgr.a (mgr.14355) 4997 : audit [DBG] from='client.117564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:23 smithi171 bash[25040]: audit 2024-09-14T00:16:23.214125+0000 mgr.a (mgr.14355) 4997 : audit [DBG] from='client.117564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:24 smithi007 bash[22722]: cluster 2024-09-14T00:16:24.628930+0000 mgr.a (mgr.14355) 4998 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:24 smithi131 bash[24745]: cluster 2024-09-14T00:16:24.628930+0000 mgr.a (mgr.14355) 4998 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:24 smithi171 bash[25040]: cluster 2024-09-14T00:16:24.628930+0000 mgr.a (mgr.14355) 4998 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:27 smithi007 bash[22722]: cluster 2024-09-14T00:16:26.631180+0000 mgr.a (mgr.14355) 4999 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:27 smithi131 bash[24745]: cluster 2024-09-14T00:16:26.631180+0000 mgr.a (mgr.14355) 4999 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:27 smithi171 bash[25040]: cluster 2024-09-14T00:16:26.631180+0000 mgr.a (mgr.14355) 4999 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:28.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:28.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:29.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:29.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:29 smithi007 bash[22722]: cluster 2024-09-14T00:16:28.631935+0000 mgr.a (mgr.14355) 5000 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:29 smithi007 bash[22722]: audit 2024-09-14T00:16:28.992822+0000 mgr.a (mgr.14355) 5001 : audit [DBG] from='client.117636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:29 smithi131 bash[24745]: cluster 2024-09-14T00:16:28.631935+0000 mgr.a (mgr.14355) 5000 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:29 smithi131 bash[24745]: audit 2024-09-14T00:16:28.992822+0000 mgr.a (mgr.14355) 5001 : audit [DBG] from='client.117636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:29 smithi171 bash[25040]: cluster 2024-09-14T00:16:28.631935+0000 mgr.a (mgr.14355) 5000 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:29 smithi171 bash[25040]: audit 2024-09-14T00:16:28.992822+0000 mgr.a (mgr.14355) 5001 : audit [DBG] from='client.117636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:31 smithi007 bash[22722]: cluster 2024-09-14T00:16:30.634234+0000 mgr.a (mgr.14355) 5002 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:31 smithi131 bash[24745]: cluster 2024-09-14T00:16:30.634234+0000 mgr.a (mgr.14355) 5002 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:31 smithi171 bash[25040]: cluster 2024-09-14T00:16:30.634234+0000 mgr.a (mgr.14355) 5002 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:33 smithi007 bash[22722]: cluster 2024-09-14T00:16:32.635011+0000 mgr.a (mgr.14355) 5003 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:33 smithi131 bash[24745]: cluster 2024-09-14T00:16:32.635011+0000 mgr.a (mgr.14355) 5003 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:34.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:33 smithi171 bash[25040]: cluster 2024-09-14T00:16:32.635011+0000 mgr.a (mgr.14355) 5003 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:35.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:35 smithi131 bash[24745]: cluster 2024-09-14T00:16:34.635763+0000 mgr.a (mgr.14355) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:35 smithi131 bash[24745]: audit 2024-09-14T00:16:34.760997+0000 mgr.a (mgr.14355) 5005 : audit [DBG] from='client.117708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:35 smithi171 bash[25040]: cluster 2024-09-14T00:16:34.635763+0000 mgr.a (mgr.14355) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:35 smithi171 bash[25040]: audit 2024-09-14T00:16:34.760997+0000 mgr.a (mgr.14355) 5005 : audit [DBG] from='client.117708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:35 smithi007 bash[22722]: cluster 2024-09-14T00:16:34.635763+0000 mgr.a (mgr.14355) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:35 smithi007 bash[22722]: audit 2024-09-14T00:16:34.760997+0000 mgr.a (mgr.14355) 5005 : audit [DBG] from='client.117708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:37 smithi131 bash[24745]: cluster 2024-09-14T00:16:36.638235+0000 mgr.a (mgr.14355) 5006 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:37 smithi171 bash[25040]: cluster 2024-09-14T00:16:36.638235+0000 mgr.a (mgr.14355) 5006 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:37 smithi007 bash[22722]: cluster 2024-09-14T00:16:36.638235+0000 mgr.a (mgr.14355) 5006 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:39 smithi131 bash[24745]: cluster 2024-09-14T00:16:38.638979+0000 mgr.a (mgr.14355) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:39 smithi171 bash[25040]: cluster 2024-09-14T00:16:38.638979+0000 mgr.a (mgr.14355) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:39 smithi007 bash[22722]: cluster 2024-09-14T00:16:38.638979+0000 mgr.a (mgr.14355) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:40.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:40.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:40.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:40.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:40 smithi131 bash[24745]: audit 2024-09-14T00:16:40.547166+0000 mgr.a (mgr.14355) 5008 : audit [DBG] from='client.117786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:40 smithi171 bash[25040]: audit 2024-09-14T00:16:40.547166+0000 mgr.a (mgr.14355) 5008 : audit [DBG] from='client.117786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:40 smithi007 bash[22722]: audit 2024-09-14T00:16:40.547166+0000 mgr.a (mgr.14355) 5008 : audit [DBG] from='client.117786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:41 smithi131 bash[24745]: cluster 2024-09-14T00:16:40.640259+0000 mgr.a (mgr.14355) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:41 smithi171 bash[25040]: cluster 2024-09-14T00:16:40.640259+0000 mgr.a (mgr.14355) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:41 smithi007 bash[22722]: cluster 2024-09-14T00:16:40.640259+0000 mgr.a (mgr.14355) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:43 smithi131 bash[24745]: cluster 2024-09-14T00:16:42.641111+0000 mgr.a (mgr.14355) 5010 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:43 smithi171 bash[25040]: cluster 2024-09-14T00:16:42.641111+0000 mgr.a (mgr.14355) 5010 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:43 smithi007 bash[22722]: cluster 2024-09-14T00:16:42.641111+0000 mgr.a (mgr.14355) 5010 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:45 smithi131 bash[24745]: cluster 2024-09-14T00:16:44.641875+0000 mgr.a (mgr.14355) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:45 smithi171 bash[25040]: cluster 2024-09-14T00:16:44.641875+0000 mgr.a (mgr.14355) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:45 smithi007 bash[22722]: cluster 2024-09-14T00:16:44.641875+0000 mgr.a (mgr.14355) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:46.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:46.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:46.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:46.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:46.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:46 smithi131 bash[24745]: audit 2024-09-14T00:16:46.313758+0000 mgr.a (mgr.14355) 5012 : audit [DBG] from='client.117861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:46 smithi171 bash[25040]: audit 2024-09-14T00:16:46.313758+0000 mgr.a (mgr.14355) 5012 : audit [DBG] from='client.117861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:46 smithi007 bash[22722]: audit 2024-09-14T00:16:46.313758+0000 mgr.a (mgr.14355) 5012 : audit [DBG] from='client.117861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:47 smithi131 bash[24745]: cluster 2024-09-14T00:16:46.643676+0000 mgr.a (mgr.14355) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:47 smithi171 bash[25040]: cluster 2024-09-14T00:16:46.643676+0000 mgr.a (mgr.14355) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:47 smithi007 bash[22722]: cluster 2024-09-14T00:16:46.643676+0000 mgr.a (mgr.14355) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:49 smithi131 bash[24745]: cluster 2024-09-14T00:16:48.644556+0000 mgr.a (mgr.14355) 5014 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:49 smithi171 bash[25040]: cluster 2024-09-14T00:16:48.644556+0000 mgr.a (mgr.14355) 5014 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:49 smithi007 bash[22722]: cluster 2024-09-14T00:16:48.644556+0000 mgr.a (mgr.14355) 5014 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:16:51.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:51.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:51.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:51 smithi131 bash[24745]: cluster 2024-09-14T00:16:50.646666+0000 mgr.a (mgr.14355) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:51 smithi171 bash[25040]: cluster 2024-09-14T00:16:50.646666+0000 mgr.a (mgr.14355) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:51 smithi007 bash[22722]: cluster 2024-09-14T00:16:50.646666+0000 mgr.a (mgr.14355) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:52.481 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:52.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:52.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:52.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:52.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:52 smithi131 bash[24745]: audit 2024-09-14T00:16:52.066483+0000 mgr.a (mgr.14355) 5016 : audit [DBG] from='client.117939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:52 smithi171 bash[25040]: audit 2024-09-14T00:16:52.066483+0000 mgr.a (mgr.14355) 5016 : audit [DBG] from='client.117939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:52 smithi007 bash[22722]: audit 2024-09-14T00:16:52.066483+0000 mgr.a (mgr.14355) 5016 : audit [DBG] from='client.117939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:53 smithi131 bash[24745]: cluster 2024-09-14T00:16:52.647613+0000 mgr.a (mgr.14355) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:53 smithi171 bash[25040]: cluster 2024-09-14T00:16:52.647613+0000 mgr.a (mgr.14355) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:53 smithi007 bash[22722]: cluster 2024-09-14T00:16:52.647613+0000 mgr.a (mgr.14355) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:55 smithi131 bash[24745]: cluster 2024-09-14T00:16:54.648393+0000 mgr.a (mgr.14355) 5018 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:55 smithi171 bash[25040]: cluster 2024-09-14T00:16:54.648393+0000 mgr.a (mgr.14355) 5018 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:55 smithi007 bash[22722]: cluster 2024-09-14T00:16:54.648393+0000 mgr.a (mgr.14355) 5018 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:16:57.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:16:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:16:57.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:16:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:57 smithi131 bash[24745]: cluster 2024-09-14T00:16:56.650682+0000 mgr.a (mgr.14355) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:57 smithi171 bash[25040]: cluster 2024-09-14T00:16:56.650682+0000 mgr.a (mgr.14355) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:57 smithi007 bash[22722]: cluster 2024-09-14T00:16:56.650682+0000 mgr.a (mgr.14355) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:16:58.221 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:16:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:16:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:16:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:16:58.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:16:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:58 smithi131 bash[24745]: audit 2024-09-14T00:16:57.809927+0000 mgr.a (mgr.14355) 5020 : audit [DBG] from='client.118017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:58 smithi171 bash[25040]: audit 2024-09-14T00:16:57.809927+0000 mgr.a (mgr.14355) 5020 : audit [DBG] from='client.118017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:16:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:58 smithi007 bash[22722]: audit 2024-09-14T00:16:57.809927+0000 mgr.a (mgr.14355) 5020 : audit [DBG] from='client.118017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:16:59 smithi131 bash[24745]: cluster 2024-09-14T00:16:58.651612+0000 mgr.a (mgr.14355) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:16:59 smithi171 bash[25040]: cluster 2024-09-14T00:16:58.651612+0000 mgr.a (mgr.14355) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:16:59 smithi007 bash[22722]: cluster 2024-09-14T00:16:58.651612+0000 mgr.a (mgr.14355) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:01 smithi171 bash[25040]: cluster 2024-09-14T00:17:00.653780+0000 mgr.a (mgr.14355) 5022 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:01 smithi007 bash[22722]: cluster 2024-09-14T00:17:00.653780+0000 mgr.a (mgr.14355) 5022 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:01 smithi131 bash[24745]: cluster 2024-09-14T00:17:00.653780+0000 mgr.a (mgr.14355) 5022 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:03.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:03.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:03.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:03.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:04.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:03 smithi171 bash[25040]: cluster 2024-09-14T00:17:02.654582+0000 mgr.a (mgr.14355) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:03 smithi171 bash[25040]: audit 2024-09-14T00:17:03.555111+0000 mgr.a (mgr.14355) 5024 : audit [DBG] from='client.118095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:03 smithi007 bash[22722]: cluster 2024-09-14T00:17:02.654582+0000 mgr.a (mgr.14355) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:03 smithi007 bash[22722]: audit 2024-09-14T00:17:03.555111+0000 mgr.a (mgr.14355) 5024 : audit [DBG] from='client.118095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:03 smithi131 bash[24745]: cluster 2024-09-14T00:17:02.654582+0000 mgr.a (mgr.14355) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:03 smithi131 bash[24745]: audit 2024-09-14T00:17:03.555111+0000 mgr.a (mgr.14355) 5024 : audit [DBG] from='client.118095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:05 smithi171 bash[25040]: cluster 2024-09-14T00:17:04.655457+0000 mgr.a (mgr.14355) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:05 smithi007 bash[22722]: cluster 2024-09-14T00:17:04.655457+0000 mgr.a (mgr.14355) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:05 smithi131 bash[24745]: cluster 2024-09-14T00:17:04.655457+0000 mgr.a (mgr.14355) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:06 smithi007 bash[22722]: audit 2024-09-14T00:17:05.804667+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:17:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:06 smithi131 bash[24745]: audit 2024-09-14T00:17:05.804667+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:17:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:06 smithi171 bash[25040]: audit 2024-09-14T00:17:05.804667+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:17:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:07 smithi007 bash[22722]: cluster 2024-09-14T00:17:06.657654+0000 mgr.a (mgr.14355) 5026 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:07 smithi131 bash[24745]: cluster 2024-09-14T00:17:06.657654+0000 mgr.a (mgr.14355) 5026 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:07 smithi171 bash[25040]: cluster 2024-09-14T00:17:06.657654+0000 mgr.a (mgr.14355) 5026 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:09.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:09.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:09.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:09.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:09.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:09.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:09.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:09.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:09 smithi007 bash[22722]: cluster 2024-09-14T00:17:08.658425+0000 mgr.a (mgr.14355) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:09 smithi007 bash[22722]: audit 2024-09-14T00:17:09.330395+0000 mgr.a (mgr.14355) 5028 : audit [DBG] from='client.118173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:09 smithi131 bash[24745]: cluster 2024-09-14T00:17:08.658425+0000 mgr.a (mgr.14355) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:09 smithi131 bash[24745]: audit 2024-09-14T00:17:09.330395+0000 mgr.a (mgr.14355) 5028 : audit [DBG] from='client.118173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:09 smithi171 bash[25040]: cluster 2024-09-14T00:17:08.658425+0000 mgr.a (mgr.14355) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:09 smithi171 bash[25040]: audit 2024-09-14T00:17:09.330395+0000 mgr.a (mgr.14355) 5028 : audit [DBG] from='client.118173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: cluster 2024-09-14T00:17:10.660793+0000 mgr.a (mgr.14355) 5029 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.162900+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.166310+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.169679+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.173139+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.185957+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.191048+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.946379+0000 mon.a (mon.0) 1354 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.948040+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.958526+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22722]: audit 2024-09-14T00:17:11.963723+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: cluster 2024-09-14T00:17:10.660793+0000 mgr.a (mgr.14355) 5029 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.162900+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.166310+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.169679+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.173139+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.185957+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.191048+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.946379+0000 mon.a (mon.0) 1354 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.948040+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.958526+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:12 smithi131 bash[24745]: audit 2024-09-14T00:17:11.963723+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: cluster 2024-09-14T00:17:10.660793+0000 mgr.a (mgr.14355) 5029 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.162900+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.166310+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.169679+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.173139+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.185957+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.191048+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.946379+0000 mon.a (mon.0) 1354 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.948040+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:17:12.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.958526+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:17:12.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:12 smithi171 bash[25040]: audit 2024-09-14T00:17:11.963723+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:12.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22972]: debug 2024-09-14T00:17:12.693+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:17:12.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:17:12 smithi007 bash[22972]: debug 2024-09-14T00:17:12.697+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:17:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:13 smithi007 bash[22722]: audit 2024-09-14T00:17:11.965851+0000 mgr.a (mgr.14355) 5030 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:13 smithi131 bash[24745]: audit 2024-09-14T00:17:11.965851+0000 mgr.a (mgr.14355) 5030 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:13 smithi171 bash[25040]: audit 2024-09-14T00:17:11.965851+0000 mgr.a (mgr.14355) 5030 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:14 smithi007 bash[22722]: cluster 2024-09-14T00:17:12.661519+0000 mgr.a (mgr.14355) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:14 smithi007 bash[22722]: audit 2024-09-14T00:17:12.697932+0000 mgr.a (mgr.14355) 5032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:14 smithi007 bash[22722]: cephadm 2024-09-14T00:17:12.699859+0000 mgr.a (mgr.14355) 5033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:17:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:14 smithi131 bash[24745]: cluster 2024-09-14T00:17:12.661519+0000 mgr.a (mgr.14355) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:14 smithi131 bash[24745]: audit 2024-09-14T00:17:12.697932+0000 mgr.a (mgr.14355) 5032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:17:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:14 smithi131 bash[24745]: cephadm 2024-09-14T00:17:12.699859+0000 mgr.a (mgr.14355) 5033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:14 smithi171 bash[25040]: cluster 2024-09-14T00:17:12.661519+0000 mgr.a (mgr.14355) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:14 smithi171 bash[25040]: audit 2024-09-14T00:17:12.697932+0000 mgr.a (mgr.14355) 5032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:14 smithi171 bash[25040]: cephadm 2024-09-14T00:17:12.699859+0000 mgr.a (mgr.14355) 5033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:17:14.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:14.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:14.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:15.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:15.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:16 smithi007 bash[22722]: cluster 2024-09-14T00:17:14.662221+0000 mgr.a (mgr.14355) 5034 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:16 smithi007 bash[22722]: audit 2024-09-14T00:17:15.084014+0000 mgr.a (mgr.14355) 5035 : audit [DBG] from='client.118359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:16 smithi131 bash[24745]: cluster 2024-09-14T00:17:14.662221+0000 mgr.a (mgr.14355) 5034 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:16 smithi131 bash[24745]: audit 2024-09-14T00:17:15.084014+0000 mgr.a (mgr.14355) 5035 : audit [DBG] from='client.118359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:16 smithi171 bash[25040]: cluster 2024-09-14T00:17:14.662221+0000 mgr.a (mgr.14355) 5034 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:16 smithi171 bash[25040]: audit 2024-09-14T00:17:15.084014+0000 mgr.a (mgr.14355) 5035 : audit [DBG] from='client.118359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:18 smithi007 bash[22722]: cluster 2024-09-14T00:17:16.665042+0000 mgr.a (mgr.14355) 5036 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:18 smithi131 bash[24745]: cluster 2024-09-14T00:17:16.665042+0000 mgr.a (mgr.14355) 5036 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:18 smithi171 bash[25040]: cluster 2024-09-14T00:17:16.665042+0000 mgr.a (mgr.14355) 5036 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:20 smithi007 bash[22722]: cluster 2024-09-14T00:17:18.666002+0000 mgr.a (mgr.14355) 5037 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:20.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:20.532 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:20.532 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:20.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:20 smithi131 bash[24745]: cluster 2024-09-14T00:17:18.666002+0000 mgr.a (mgr.14355) 5037 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:20 smithi171 bash[25040]: cluster 2024-09-14T00:17:18.666002+0000 mgr.a (mgr.14355) 5037 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:21.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:21.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:22 smithi007 bash[22722]: cluster 2024-09-14T00:17:20.667188+0000 mgr.a (mgr.14355) 5038 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:22 smithi007 bash[22722]: audit 2024-09-14T00:17:20.862480+0000 mgr.a (mgr.14355) 5039 : audit [DBG] from='client.118437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:22 smithi131 bash[24745]: cluster 2024-09-14T00:17:20.667188+0000 mgr.a (mgr.14355) 5038 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:22 smithi131 bash[24745]: audit 2024-09-14T00:17:20.862480+0000 mgr.a (mgr.14355) 5039 : audit [DBG] from='client.118437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:22 smithi171 bash[25040]: cluster 2024-09-14T00:17:20.667188+0000 mgr.a (mgr.14355) 5038 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:22 smithi171 bash[25040]: audit 2024-09-14T00:17:20.862480+0000 mgr.a (mgr.14355) 5039 : audit [DBG] from='client.118437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:24 smithi007 bash[22722]: cluster 2024-09-14T00:17:22.668079+0000 mgr.a (mgr.14355) 5040 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:24 smithi131 bash[24745]: cluster 2024-09-14T00:17:22.668079+0000 mgr.a (mgr.14355) 5040 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:24 smithi171 bash[25040]: cluster 2024-09-14T00:17:22.668079+0000 mgr.a (mgr.14355) 5040 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:26.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:26.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:26.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:26 smithi007 bash[22722]: cluster 2024-09-14T00:17:24.668884+0000 mgr.a (mgr.14355) 5041 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:26 smithi131 bash[24745]: cluster 2024-09-14T00:17:24.668884+0000 mgr.a (mgr.14355) 5041 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:26 smithi171 bash[25040]: cluster 2024-09-14T00:17:24.668884+0000 mgr.a (mgr.14355) 5041 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:27.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:27 smithi131 bash[24745]: audit 2024-09-14T00:17:26.614553+0000 mgr.a (mgr.14355) 5042 : audit [DBG] from='client.118515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:27 smithi171 bash[25040]: audit 2024-09-14T00:17:26.614553+0000 mgr.a (mgr.14355) 5042 : audit [DBG] from='client.118515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:27 smithi007 bash[22722]: audit 2024-09-14T00:17:26.614553+0000 mgr.a (mgr.14355) 5042 : audit [DBG] from='client.118515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:28 smithi131 bash[24745]: cluster 2024-09-14T00:17:26.671889+0000 mgr.a (mgr.14355) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:28 smithi171 bash[25040]: cluster 2024-09-14T00:17:26.671889+0000 mgr.a (mgr.14355) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:28 smithi007 bash[22722]: cluster 2024-09-14T00:17:26.671889+0000 mgr.a (mgr.14355) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:17:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:30 smithi131 bash[24745]: cluster 2024-09-14T00:17:28.672970+0000 mgr.a (mgr.14355) 5044 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:30 smithi171 bash[25040]: cluster 2024-09-14T00:17:28.672970+0000 mgr.a (mgr.14355) 5044 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:30 smithi007 bash[22722]: cluster 2024-09-14T00:17:28.672970+0000 mgr.a (mgr.14355) 5044 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:32.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:32.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:32 smithi131 bash[24745]: cluster 2024-09-14T00:17:30.675352+0000 mgr.a (mgr.14355) 5045 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:32 smithi171 bash[25040]: cluster 2024-09-14T00:17:30.675352+0000 mgr.a (mgr.14355) 5045 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:32 smithi007 bash[22722]: cluster 2024-09-14T00:17:30.675352+0000 mgr.a (mgr.14355) 5045 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:32.819 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:32.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:33 smithi131 bash[24745]: audit 2024-09-14T00:17:32.369599+0000 mgr.a (mgr.14355) 5046 : audit [DBG] from='client.118593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:33 smithi171 bash[25040]: audit 2024-09-14T00:17:32.369599+0000 mgr.a (mgr.14355) 5046 : audit [DBG] from='client.118593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:33 smithi007 bash[22722]: audit 2024-09-14T00:17:32.369599+0000 mgr.a (mgr.14355) 5046 : audit [DBG] from='client.118593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:34 smithi131 bash[24745]: cluster 2024-09-14T00:17:32.675934+0000 mgr.a (mgr.14355) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:34 smithi171 bash[25040]: cluster 2024-09-14T00:17:32.675934+0000 mgr.a (mgr.14355) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:34 smithi007 bash[22722]: cluster 2024-09-14T00:17:32.675934+0000 mgr.a (mgr.14355) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:36 smithi131 bash[24745]: cluster 2024-09-14T00:17:34.676758+0000 mgr.a (mgr.14355) 5048 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:36 smithi171 bash[25040]: cluster 2024-09-14T00:17:34.676758+0000 mgr.a (mgr.14355) 5048 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:36 smithi007 bash[22722]: cluster 2024-09-14T00:17:34.676758+0000 mgr.a (mgr.14355) 5048 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:37.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:37.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:37.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:38 smithi131 bash[24745]: cluster 2024-09-14T00:17:36.679063+0000 mgr.a (mgr.14355) 5049 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:38 smithi171 bash[25040]: cluster 2024-09-14T00:17:36.679063+0000 mgr.a (mgr.14355) 5049 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:38.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:38.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:38.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:38.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:38.595 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:38 smithi007 bash[22722]: cluster 2024-09-14T00:17:36.679063+0000 mgr.a (mgr.14355) 5049 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:39 smithi131 bash[24745]: audit 2024-09-14T00:17:38.153496+0000 mgr.a (mgr.14355) 5050 : audit [DBG] from='client.118665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:39 smithi171 bash[25040]: audit 2024-09-14T00:17:38.153496+0000 mgr.a (mgr.14355) 5050 : audit [DBG] from='client.118665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:39 smithi007 bash[22722]: audit 2024-09-14T00:17:38.153496+0000 mgr.a (mgr.14355) 5050 : audit [DBG] from='client.118665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:40 smithi131 bash[24745]: cluster 2024-09-14T00:17:38.680034+0000 mgr.a (mgr.14355) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:40 smithi171 bash[25040]: cluster 2024-09-14T00:17:38.680034+0000 mgr.a (mgr.14355) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:40 smithi007 bash[22722]: cluster 2024-09-14T00:17:38.680034+0000 mgr.a (mgr.14355) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:42 smithi131 bash[24745]: cluster 2024-09-14T00:17:40.682194+0000 mgr.a (mgr.14355) 5052 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:42 smithi171 bash[25040]: cluster 2024-09-14T00:17:40.682194+0000 mgr.a (mgr.14355) 5052 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:42 smithi007 bash[22722]: cluster 2024-09-14T00:17:40.682194+0000 mgr.a (mgr.14355) 5052 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:43.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:43.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:43.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:44.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:44.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:44 smithi131 bash[24745]: cluster 2024-09-14T00:17:42.682962+0000 mgr.a (mgr.14355) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:44 smithi171 bash[25040]: cluster 2024-09-14T00:17:42.682962+0000 mgr.a (mgr.14355) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:44 smithi007 bash[22722]: cluster 2024-09-14T00:17:42.682962+0000 mgr.a (mgr.14355) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:45 smithi131 bash[24745]: audit 2024-09-14T00:17:43.924571+0000 mgr.a (mgr.14355) 5054 : audit [DBG] from='client.118743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:45 smithi171 bash[25040]: audit 2024-09-14T00:17:43.924571+0000 mgr.a (mgr.14355) 5054 : audit [DBG] from='client.118743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:45 smithi007 bash[22722]: audit 2024-09-14T00:17:43.924571+0000 mgr.a (mgr.14355) 5054 : audit [DBG] from='client.118743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:46 smithi131 bash[24745]: cluster 2024-09-14T00:17:44.683829+0000 mgr.a (mgr.14355) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:46 smithi171 bash[25040]: cluster 2024-09-14T00:17:44.683829+0000 mgr.a (mgr.14355) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:46 smithi007 bash[22722]: cluster 2024-09-14T00:17:44.683829+0000 mgr.a (mgr.14355) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:48 smithi131 bash[24745]: cluster 2024-09-14T00:17:46.686070+0000 mgr.a (mgr.14355) 5056 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:48 smithi171 bash[25040]: cluster 2024-09-14T00:17:46.686070+0000 mgr.a (mgr.14355) 5056 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:48 smithi007 bash[22722]: cluster 2024-09-14T00:17:46.686070+0000 mgr.a (mgr.14355) 5056 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:49.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:49.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:49.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:50.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:50.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:50.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:50.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:50 smithi131 bash[24745]: cluster 2024-09-14T00:17:48.686843+0000 mgr.a (mgr.14355) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:50 smithi171 bash[25040]: cluster 2024-09-14T00:17:48.686843+0000 mgr.a (mgr.14355) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:50 smithi007 bash[22722]: cluster 2024-09-14T00:17:48.686843+0000 mgr.a (mgr.14355) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:51 smithi171 bash[25040]: audit 2024-09-14T00:17:49.664702+0000 mgr.a (mgr.14355) 5058 : audit [DBG] from='client.118821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:51 smithi007 bash[22722]: audit 2024-09-14T00:17:49.664702+0000 mgr.a (mgr.14355) 5058 : audit [DBG] from='client.118821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:51 smithi131 bash[24745]: audit 2024-09-14T00:17:49.664702+0000 mgr.a (mgr.14355) 5058 : audit [DBG] from='client.118821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:52 smithi171 bash[25040]: cluster 2024-09-14T00:17:50.689187+0000 mgr.a (mgr.14355) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:52 smithi007 bash[22722]: cluster 2024-09-14T00:17:50.689187+0000 mgr.a (mgr.14355) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:52 smithi131 bash[24745]: cluster 2024-09-14T00:17:50.689187+0000 mgr.a (mgr.14355) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:17:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:54 smithi171 bash[25040]: cluster 2024-09-14T00:17:52.689977+0000 mgr.a (mgr.14355) 5060 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:54 smithi007 bash[22722]: cluster 2024-09-14T00:17:52.689977+0000 mgr.a (mgr.14355) 5060 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:54 smithi131 bash[24745]: cluster 2024-09-14T00:17:52.689977+0000 mgr.a (mgr.14355) 5060 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:55.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:17:55.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:17:55.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:17:55.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:17:55.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:17:55.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:17:55.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:17:55.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:17:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:56 smithi171 bash[25040]: cluster 2024-09-14T00:17:54.690770+0000 mgr.a (mgr.14355) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:56 smithi171 bash[25040]: audit 2024-09-14T00:17:55.449028+0000 mgr.a (mgr.14355) 5062 : audit [DBG] from='client.118899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:56 smithi007 bash[22722]: cluster 2024-09-14T00:17:54.690770+0000 mgr.a (mgr.14355) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:56 smithi007 bash[22722]: audit 2024-09-14T00:17:55.449028+0000 mgr.a (mgr.14355) 5062 : audit [DBG] from='client.118899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:56 smithi131 bash[24745]: cluster 2024-09-14T00:17:54.690770+0000 mgr.a (mgr.14355) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:56 smithi131 bash[24745]: audit 2024-09-14T00:17:55.449028+0000 mgr.a (mgr.14355) 5062 : audit [DBG] from='client.118899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:17:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:17:58 smithi007 bash[22722]: cluster 2024-09-14T00:17:56.693543+0000 mgr.a (mgr.14355) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:17:58 smithi131 bash[24745]: cluster 2024-09-14T00:17:56.693543+0000 mgr.a (mgr.14355) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:17:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:17:58 smithi171 bash[25040]: cluster 2024-09-14T00:17:56.693543+0000 mgr.a (mgr.14355) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:00 smithi007 bash[22722]: cluster 2024-09-14T00:17:58.694346+0000 mgr.a (mgr.14355) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:00 smithi131 bash[24745]: cluster 2024-09-14T00:17:58.694346+0000 mgr.a (mgr.14355) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:00 smithi171 bash[25040]: cluster 2024-09-14T00:17:58.694346+0000 mgr.a (mgr.14355) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:00.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:00.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:00.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:01.657 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:01.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:02 smithi007 bash[22722]: cluster 2024-09-14T00:18:00.696340+0000 mgr.a (mgr.14355) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:02 smithi007 bash[22722]: audit 2024-09-14T00:18:01.220391+0000 mgr.a (mgr.14355) 5066 : audit [DBG] from='client.118974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:02 smithi131 bash[24745]: cluster 2024-09-14T00:18:00.696340+0000 mgr.a (mgr.14355) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:02 smithi131 bash[24745]: audit 2024-09-14T00:18:01.220391+0000 mgr.a (mgr.14355) 5066 : audit [DBG] from='client.118974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:02 smithi171 bash[25040]: cluster 2024-09-14T00:18:00.696340+0000 mgr.a (mgr.14355) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:02 smithi171 bash[25040]: audit 2024-09-14T00:18:01.220391+0000 mgr.a (mgr.14355) 5066 : audit [DBG] from='client.118974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:04 smithi007 bash[22722]: cluster 2024-09-14T00:18:02.697249+0000 mgr.a (mgr.14355) 5067 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:04 smithi131 bash[24745]: cluster 2024-09-14T00:18:02.697249+0000 mgr.a (mgr.14355) 5067 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:04 smithi171 bash[25040]: cluster 2024-09-14T00:18:02.697249+0000 mgr.a (mgr.14355) 5067 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:06.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:06.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:06.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:06 smithi007 bash[22722]: cluster 2024-09-14T00:18:04.698036+0000 mgr.a (mgr.14355) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:18:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:06 smithi131 bash[24745]: cluster 2024-09-14T00:18:04.698036+0000 mgr.a (mgr.14355) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:18:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:06 smithi171 bash[25040]: cluster 2024-09-14T00:18:04.698036+0000 mgr.a (mgr.14355) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:18:07.407 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:07.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:07.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:07.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:07.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:08 smithi007 bash[22722]: cluster 2024-09-14T00:18:06.700253+0000 mgr.a (mgr.14355) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:08 smithi007 bash[22722]: audit 2024-09-14T00:18:06.985862+0000 mgr.a (mgr.14355) 5070 : audit [DBG] from='client.119049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:08 smithi131 bash[24745]: cluster 2024-09-14T00:18:06.700253+0000 mgr.a (mgr.14355) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:08 smithi131 bash[24745]: audit 2024-09-14T00:18:06.985862+0000 mgr.a (mgr.14355) 5070 : audit [DBG] from='client.119049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:08 smithi171 bash[25040]: cluster 2024-09-14T00:18:06.700253+0000 mgr.a (mgr.14355) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:08 smithi171 bash[25040]: audit 2024-09-14T00:18:06.985862+0000 mgr.a (mgr.14355) 5070 : audit [DBG] from='client.119049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:10 smithi007 bash[22722]: cluster 2024-09-14T00:18:08.701150+0000 mgr.a (mgr.14355) 5071 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:10 smithi131 bash[24745]: cluster 2024-09-14T00:18:08.701150+0000 mgr.a (mgr.14355) 5071 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:10 smithi171 bash[25040]: cluster 2024-09-14T00:18:08.701150+0000 mgr.a (mgr.14355) 5071 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:12.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:12.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:12.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:12 smithi007 bash[22722]: cluster 2024-09-14T00:18:10.703398+0000 mgr.a (mgr.14355) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:12 smithi131 bash[24745]: cluster 2024-09-14T00:18:10.703398+0000 mgr.a (mgr.14355) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:12 smithi171 bash[25040]: cluster 2024-09-14T00:18:10.703398+0000 mgr.a (mgr.14355) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:13.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:13 smithi007 bash[22722]: audit 2024-09-14T00:18:12.755677+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:18:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:13 smithi131 bash[24745]: audit 2024-09-14T00:18:12.755677+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:18:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:13 smithi171 bash[25040]: audit 2024-09-14T00:18:12.755677+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:18:14.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22972]: debug 2024-09-14T00:18:14.304+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:18:14.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22972]: debug 2024-09-14T00:18:14.304+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: cluster 2024-09-14T00:18:12.704125+0000 mgr.a (mgr.14355) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:12.740766+0000 mgr.a (mgr.14355) 5074 : audit [DBG] from='client.119127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:13.555505+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:13.557742+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:13.566725+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:13.571682+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:14 smithi007 bash[22722]: audit 2024-09-14T00:18:13.574455+0000 mgr.a (mgr.14355) 5075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: cluster 2024-09-14T00:18:12.704125+0000 mgr.a (mgr.14355) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:12.740766+0000 mgr.a (mgr.14355) 5074 : audit [DBG] from='client.119127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:13.555505+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:13.557742+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:13.566725+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:18:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:13.571682+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:14 smithi131 bash[24745]: audit 2024-09-14T00:18:13.574455+0000 mgr.a (mgr.14355) 5075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: cluster 2024-09-14T00:18:12.704125+0000 mgr.a (mgr.14355) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:12.740766+0000 mgr.a (mgr.14355) 5074 : audit [DBG] from='client.119127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:13.555505+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:13.557742+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:13.566725+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:13.571682+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:14 smithi171 bash[25040]: audit 2024-09-14T00:18:13.574455+0000 mgr.a (mgr.14355) 5075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:18:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:15 smithi007 bash[22722]: audit 2024-09-14T00:18:14.306930+0000 mgr.a (mgr.14355) 5076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:18:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:15 smithi007 bash[22722]: cephadm 2024-09-14T00:18:14.308438+0000 mgr.a (mgr.14355) 5077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:18:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:15 smithi131 bash[24745]: audit 2024-09-14T00:18:14.306930+0000 mgr.a (mgr.14355) 5076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:18:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:15 smithi131 bash[24745]: cephadm 2024-09-14T00:18:14.308438+0000 mgr.a (mgr.14355) 5077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:18:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:15 smithi171 bash[25040]: audit 2024-09-14T00:18:14.306930+0000 mgr.a (mgr.14355) 5076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:18:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:15 smithi171 bash[25040]: cephadm 2024-09-14T00:18:14.308438+0000 mgr.a (mgr.14355) 5077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:18:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:16 smithi007 bash[22722]: cluster 2024-09-14T00:18:14.705090+0000 mgr.a (mgr.14355) 5078 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:16 smithi131 bash[24745]: cluster 2024-09-14T00:18:14.705090+0000 mgr.a (mgr.14355) 5078 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:16 smithi171 bash[25040]: cluster 2024-09-14T00:18:14.705090+0000 mgr.a (mgr.14355) 5078 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:18 smithi007 bash[22722]: cluster 2024-09-14T00:18:16.707367+0000 mgr.a (mgr.14355) 5079 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:18 smithi131 bash[24745]: cluster 2024-09-14T00:18:16.707367+0000 mgr.a (mgr.14355) 5079 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:18 smithi171 bash[25040]: cluster 2024-09-14T00:18:16.707367+0000 mgr.a (mgr.14355) 5079 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:18.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:19 smithi007 bash[22722]: audit 2024-09-14T00:18:18.528939+0000 mgr.a (mgr.14355) 5080 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:19 smithi131 bash[24745]: audit 2024-09-14T00:18:18.528939+0000 mgr.a (mgr.14355) 5080 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:19 smithi171 bash[25040]: audit 2024-09-14T00:18:18.528939+0000 mgr.a (mgr.14355) 5080 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:20 smithi007 bash[22722]: cluster 2024-09-14T00:18:18.707953+0000 mgr.a (mgr.14355) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:20 smithi131 bash[24745]: cluster 2024-09-14T00:18:18.707953+0000 mgr.a (mgr.14355) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:20 smithi171 bash[25040]: cluster 2024-09-14T00:18:18.707953+0000 mgr.a (mgr.14355) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:22 smithi007 bash[22722]: cluster 2024-09-14T00:18:20.710309+0000 mgr.a (mgr.14355) 5082 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:22 smithi131 bash[24745]: cluster 2024-09-14T00:18:20.710309+0000 mgr.a (mgr.14355) 5082 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:22 smithi171 bash[25040]: cluster 2024-09-14T00:18:20.710309+0000 mgr.a (mgr.14355) 5082 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:23.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:23.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:24 smithi007 bash[22722]: cluster 2024-09-14T00:18:22.711047+0000 mgr.a (mgr.14355) 5083 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:24.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:24.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:24 smithi131 bash[24745]: cluster 2024-09-14T00:18:22.711047+0000 mgr.a (mgr.14355) 5083 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:24 smithi171 bash[25040]: cluster 2024-09-14T00:18:22.711047+0000 mgr.a (mgr.14355) 5083 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:25 smithi007 bash[22722]: audit 2024-09-14T00:18:24.279698+0000 mgr.a (mgr.14355) 5084 : audit [DBG] from='client.119388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:25 smithi131 bash[24745]: audit 2024-09-14T00:18:24.279698+0000 mgr.a (mgr.14355) 5084 : audit [DBG] from='client.119388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:25 smithi171 bash[25040]: audit 2024-09-14T00:18:24.279698+0000 mgr.a (mgr.14355) 5084 : audit [DBG] from='client.119388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:26 smithi007 bash[22722]: cluster 2024-09-14T00:18:24.711527+0000 mgr.a (mgr.14355) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:26 smithi131 bash[24745]: cluster 2024-09-14T00:18:24.711527+0000 mgr.a (mgr.14355) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:26 smithi171 bash[25040]: cluster 2024-09-14T00:18:24.711527+0000 mgr.a (mgr.14355) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:28 smithi007 bash[22722]: cluster 2024-09-14T00:18:26.713827+0000 mgr.a (mgr.14355) 5086 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:28 smithi131 bash[24745]: cluster 2024-09-14T00:18:26.713827+0000 mgr.a (mgr.14355) 5086 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:28 smithi171 bash[25040]: cluster 2024-09-14T00:18:26.713827+0000 mgr.a (mgr.14355) 5086 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:18:29.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:29.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:29.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:30.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:30 smithi007 bash[22722]: cluster 2024-09-14T00:18:28.714801+0000 mgr.a (mgr.14355) 5087 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:30 smithi131 bash[24745]: cluster 2024-09-14T00:18:28.714801+0000 mgr.a (mgr.14355) 5087 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:30 smithi171 bash[25040]: cluster 2024-09-14T00:18:28.714801+0000 mgr.a (mgr.14355) 5087 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:31 smithi007 bash[22722]: audit 2024-09-14T00:18:30.055366+0000 mgr.a (mgr.14355) 5088 : audit [DBG] from='client.119463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:31 smithi131 bash[24745]: audit 2024-09-14T00:18:30.055366+0000 mgr.a (mgr.14355) 5088 : audit [DBG] from='client.119463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:31 smithi171 bash[25040]: audit 2024-09-14T00:18:30.055366+0000 mgr.a (mgr.14355) 5088 : audit [DBG] from='client.119463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:32 smithi007 bash[22722]: cluster 2024-09-14T00:18:30.717433+0000 mgr.a (mgr.14355) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:18:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:32 smithi131 bash[24745]: cluster 2024-09-14T00:18:30.717433+0000 mgr.a (mgr.14355) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:18:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:32 smithi171 bash[25040]: cluster 2024-09-14T00:18:30.717433+0000 mgr.a (mgr.14355) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:18:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:34 smithi007 bash[22722]: cluster 2024-09-14T00:18:32.718217+0000 mgr.a (mgr.14355) 5090 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:34 smithi131 bash[24745]: cluster 2024-09-14T00:18:32.718217+0000 mgr.a (mgr.14355) 5090 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:34 smithi171 bash[25040]: cluster 2024-09-14T00:18:32.718217+0000 mgr.a (mgr.14355) 5090 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:36.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:36.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:36.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:36.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:36.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:36 smithi007 bash[22722]: cluster 2024-09-14T00:18:34.718966+0000 mgr.a (mgr.14355) 5091 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:36 smithi131 bash[24745]: cluster 2024-09-14T00:18:34.718966+0000 mgr.a (mgr.14355) 5091 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:36 smithi171 bash[25040]: cluster 2024-09-14T00:18:34.718966+0000 mgr.a (mgr.14355) 5091 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:18:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:37 smithi007 bash[22722]: audit 2024-09-14T00:18:35.839908+0000 mgr.a (mgr.14355) 5092 : audit [DBG] from='client.119541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:37 smithi131 bash[24745]: audit 2024-09-14T00:18:35.839908+0000 mgr.a (mgr.14355) 5092 : audit [DBG] from='client.119541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:37 smithi171 bash[25040]: audit 2024-09-14T00:18:35.839908+0000 mgr.a (mgr.14355) 5092 : audit [DBG] from='client.119541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:38 smithi007 bash[22722]: cluster 2024-09-14T00:18:36.721593+0000 mgr.a (mgr.14355) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:38 smithi131 bash[24745]: cluster 2024-09-14T00:18:36.721593+0000 mgr.a (mgr.14355) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:38 smithi171 bash[25040]: cluster 2024-09-14T00:18:36.721593+0000 mgr.a (mgr.14355) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:40 smithi007 bash[22722]: cluster 2024-09-14T00:18:38.722378+0000 mgr.a (mgr.14355) 5094 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:40 smithi131 bash[24745]: cluster 2024-09-14T00:18:38.722378+0000 mgr.a (mgr.14355) 5094 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:40 smithi171 bash[25040]: cluster 2024-09-14T00:18:38.722378+0000 mgr.a (mgr.14355) 5094 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:18:41.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:41.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:41.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:42.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:42.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:42 smithi007 bash[22722]: cluster 2024-09-14T00:18:40.724357+0000 mgr.a (mgr.14355) 5095 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:42 smithi007 bash[22722]: audit 2024-09-14T00:18:41.606344+0000 mgr.a (mgr.14355) 5096 : audit [DBG] from='client.119616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:42 smithi131 bash[24745]: cluster 2024-09-14T00:18:40.724357+0000 mgr.a (mgr.14355) 5095 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:42 smithi131 bash[24745]: audit 2024-09-14T00:18:41.606344+0000 mgr.a (mgr.14355) 5096 : audit [DBG] from='client.119616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:42 smithi171 bash[25040]: cluster 2024-09-14T00:18:40.724357+0000 mgr.a (mgr.14355) 5095 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:42 smithi171 bash[25040]: audit 2024-09-14T00:18:41.606344+0000 mgr.a (mgr.14355) 5096 : audit [DBG] from='client.119616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:44 smithi007 bash[22722]: cluster 2024-09-14T00:18:42.725252+0000 mgr.a (mgr.14355) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:44 smithi131 bash[24745]: cluster 2024-09-14T00:18:42.725252+0000 mgr.a (mgr.14355) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:44 smithi171 bash[25040]: cluster 2024-09-14T00:18:42.725252+0000 mgr.a (mgr.14355) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:46 smithi007 bash[22722]: cluster 2024-09-14T00:18:44.726059+0000 mgr.a (mgr.14355) 5098 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:46 smithi131 bash[24745]: cluster 2024-09-14T00:18:44.726059+0000 mgr.a (mgr.14355) 5098 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:46 smithi171 bash[25040]: cluster 2024-09-14T00:18:44.726059+0000 mgr.a (mgr.14355) 5098 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:18:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:47.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:47.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:48 smithi007 bash[22722]: cluster 2024-09-14T00:18:46.728333+0000 mgr.a (mgr.14355) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:18:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:48 smithi007 bash[22722]: audit 2024-09-14T00:18:47.386174+0000 mgr.a (mgr.14355) 5100 : audit [DBG] from='client.119691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:48 smithi131 bash[24745]: cluster 2024-09-14T00:18:46.728333+0000 mgr.a (mgr.14355) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:18:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:48 smithi131 bash[24745]: audit 2024-09-14T00:18:47.386174+0000 mgr.a (mgr.14355) 5100 : audit [DBG] from='client.119691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:48 smithi171 bash[25040]: cluster 2024-09-14T00:18:46.728333+0000 mgr.a (mgr.14355) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:18:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:48 smithi171 bash[25040]: audit 2024-09-14T00:18:47.386174+0000 mgr.a (mgr.14355) 5100 : audit [DBG] from='client.119691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:50 smithi007 bash[22722]: cluster 2024-09-14T00:18:48.729251+0000 mgr.a (mgr.14355) 5101 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:50 smithi131 bash[24745]: cluster 2024-09-14T00:18:48.729251+0000 mgr.a (mgr.14355) 5101 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:50 smithi171 bash[25040]: cluster 2024-09-14T00:18:48.729251+0000 mgr.a (mgr.14355) 5101 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:52 smithi131 bash[24745]: cluster 2024-09-14T00:18:50.731528+0000 mgr.a (mgr.14355) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:52 smithi171 bash[25040]: cluster 2024-09-14T00:18:50.731528+0000 mgr.a (mgr.14355) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:52 smithi007 bash[22722]: cluster 2024-09-14T00:18:50.731528+0000 mgr.a (mgr.14355) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:53.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:53.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:53.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:53.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:18:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:54 smithi131 bash[24745]: cluster 2024-09-14T00:18:52.732288+0000 mgr.a (mgr.14355) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:54 smithi131 bash[24745]: audit 2024-09-14T00:18:53.143806+0000 mgr.a (mgr.14355) 5104 : audit [DBG] from='client.119769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:54 smithi171 bash[25040]: cluster 2024-09-14T00:18:52.732288+0000 mgr.a (mgr.14355) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:54 smithi171 bash[25040]: audit 2024-09-14T00:18:53.143806+0000 mgr.a (mgr.14355) 5104 : audit [DBG] from='client.119769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:54 smithi007 bash[22722]: cluster 2024-09-14T00:18:52.732288+0000 mgr.a (mgr.14355) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:54 smithi007 bash[22722]: audit 2024-09-14T00:18:53.143806+0000 mgr.a (mgr.14355) 5104 : audit [DBG] from='client.119769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:18:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:56 smithi131 bash[24745]: cluster 2024-09-14T00:18:54.733312+0000 mgr.a (mgr.14355) 5105 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:56 smithi171 bash[25040]: cluster 2024-09-14T00:18:54.733312+0000 mgr.a (mgr.14355) 5105 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:56 smithi007 bash[22722]: cluster 2024-09-14T00:18:54.733312+0000 mgr.a (mgr.14355) 5105 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:18:58.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:18:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:18:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:18:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:18:58 smithi131 bash[24745]: cluster 2024-09-14T00:18:56.735715+0000 mgr.a (mgr.14355) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:18:58 smithi171 bash[25040]: cluster 2024-09-14T00:18:56.735715+0000 mgr.a (mgr.14355) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:18:58 smithi007 bash[22722]: cluster 2024-09-14T00:18:56.735715+0000 mgr.a (mgr.14355) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:18:59.329 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:18:59.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:18:59.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:18:59.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:18:59.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:00 smithi131 bash[24745]: cluster 2024-09-14T00:18:58.736502+0000 mgr.a (mgr.14355) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:00 smithi131 bash[24745]: audit 2024-09-14T00:18:58.896393+0000 mgr.a (mgr.14355) 5108 : audit [DBG] from='client.119847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:00 smithi171 bash[25040]: cluster 2024-09-14T00:18:58.736502+0000 mgr.a (mgr.14355) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:00 smithi171 bash[25040]: audit 2024-09-14T00:18:58.896393+0000 mgr.a (mgr.14355) 5108 : audit [DBG] from='client.119847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:00 smithi007 bash[22722]: cluster 2024-09-14T00:18:58.736502+0000 mgr.a (mgr.14355) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:00 smithi007 bash[22722]: audit 2024-09-14T00:18:58.896393+0000 mgr.a (mgr.14355) 5108 : audit [DBG] from='client.119847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:02 smithi131 bash[24745]: cluster 2024-09-14T00:19:00.738919+0000 mgr.a (mgr.14355) 5109 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:02 smithi171 bash[25040]: cluster 2024-09-14T00:19:00.738919+0000 mgr.a (mgr.14355) 5109 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:02 smithi007 bash[22722]: cluster 2024-09-14T00:19:00.738919+0000 mgr.a (mgr.14355) 5109 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:04.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:04 smithi131 bash[24745]: cluster 2024-09-14T00:19:02.739675+0000 mgr.a (mgr.14355) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:04 smithi171 bash[25040]: cluster 2024-09-14T00:19:02.739675+0000 mgr.a (mgr.14355) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:04 smithi007 bash[22722]: cluster 2024-09-14T00:19:02.739675+0000 mgr.a (mgr.14355) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:05.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:05.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:06 smithi131 bash[24745]: audit 2024-09-14T00:19:04.670188+0000 mgr.a (mgr.14355) 5111 : audit [DBG] from='client.119922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:06 smithi131 bash[24745]: cluster 2024-09-14T00:19:04.740213+0000 mgr.a (mgr.14355) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:06 smithi171 bash[25040]: audit 2024-09-14T00:19:04.670188+0000 mgr.a (mgr.14355) 5111 : audit [DBG] from='client.119922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:06 smithi171 bash[25040]: cluster 2024-09-14T00:19:04.740213+0000 mgr.a (mgr.14355) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:06 smithi007 bash[22722]: audit 2024-09-14T00:19:04.670188+0000 mgr.a (mgr.14355) 5111 : audit [DBG] from='client.119922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:06 smithi007 bash[22722]: cluster 2024-09-14T00:19:04.740213+0000 mgr.a (mgr.14355) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:08 smithi131 bash[24745]: cluster 2024-09-14T00:19:06.742515+0000 mgr.a (mgr.14355) 5113 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:08 smithi171 bash[25040]: cluster 2024-09-14T00:19:06.742515+0000 mgr.a (mgr.14355) 5113 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:08 smithi007 bash[22722]: cluster 2024-09-14T00:19:06.742515+0000 mgr.a (mgr.14355) 5113 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:10 smithi131 bash[24745]: cluster 2024-09-14T00:19:08.743308+0000 mgr.a (mgr.14355) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:10 smithi171 bash[25040]: cluster 2024-09-14T00:19:08.743308+0000 mgr.a (mgr.14355) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:10.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:10 smithi007 bash[22722]: cluster 2024-09-14T00:19:08.743308+0000 mgr.a (mgr.14355) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:11 smithi131 bash[24745]: audit 2024-09-14T00:19:10.438087+0000 mgr.a (mgr.14355) 5115 : audit [DBG] from='client.119997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:11 smithi171 bash[25040]: audit 2024-09-14T00:19:10.438087+0000 mgr.a (mgr.14355) 5115 : audit [DBG] from='client.119997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:11 smithi007 bash[22722]: audit 2024-09-14T00:19:10.438087+0000 mgr.a (mgr.14355) 5115 : audit [DBG] from='client.119997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:12 smithi131 bash[24745]: cluster 2024-09-14T00:19:10.744531+0000 mgr.a (mgr.14355) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:12 smithi171 bash[25040]: cluster 2024-09-14T00:19:10.744531+0000 mgr.a (mgr.14355) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:12 smithi007 bash[22722]: cluster 2024-09-14T00:19:10.744531+0000 mgr.a (mgr.14355) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:14 smithi131 bash[24745]: cluster 2024-09-14T00:19:12.745381+0000 mgr.a (mgr.14355) 5117 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:14 smithi131 bash[24745]: audit 2024-09-14T00:19:14.361736+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:19:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:14 smithi171 bash[25040]: cluster 2024-09-14T00:19:12.745381+0000 mgr.a (mgr.14355) 5117 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:14 smithi171 bash[25040]: audit 2024-09-14T00:19:14.361736+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:19:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:14 smithi007 bash[22722]: cluster 2024-09-14T00:19:12.745381+0000 mgr.a (mgr.14355) 5117 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:14 smithi007 bash[22722]: audit 2024-09-14T00:19:14.361736+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:19:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:15 smithi131 bash[24745]: audit 2024-09-14T00:19:15.224276+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:19:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:15 smithi131 bash[24745]: audit 2024-09-14T00:19:15.226178+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:19:15.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:15 smithi131 bash[24745]: audit 2024-09-14T00:19:15.236110+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:19:15.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:15 smithi131 bash[24745]: audit 2024-09-14T00:19:15.238986+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:15 smithi171 bash[25040]: audit 2024-09-14T00:19:15.224276+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:19:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:15 smithi171 bash[25040]: audit 2024-09-14T00:19:15.226178+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:19:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:15 smithi171 bash[25040]: audit 2024-09-14T00:19:15.236110+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:19:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:15 smithi171 bash[25040]: audit 2024-09-14T00:19:15.238986+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:15.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:15.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22722]: audit 2024-09-14T00:19:15.224276+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:19:15.951 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22722]: audit 2024-09-14T00:19:15.226178+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:19:15.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22722]: audit 2024-09-14T00:19:15.236110+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:19:15.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22722]: audit 2024-09-14T00:19:15.238986+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:16.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22972]: debug 2024-09-14T00:19:15.947+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:19:16.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:19:15 smithi007 bash[22972]: debug 2024-09-14T00:19:15.947+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:19:16.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:16.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:16.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:16 smithi131 bash[24745]: cluster 2024-09-14T00:19:14.746165+0000 mgr.a (mgr.14355) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:16 smithi131 bash[24745]: audit 2024-09-14T00:19:15.241319+0000 mgr.a (mgr.14355) 5119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:16 smithi171 bash[25040]: cluster 2024-09-14T00:19:14.746165+0000 mgr.a (mgr.14355) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:16 smithi171 bash[25040]: audit 2024-09-14T00:19:15.241319+0000 mgr.a (mgr.14355) 5119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:16 smithi007 bash[22722]: cluster 2024-09-14T00:19:14.746165+0000 mgr.a (mgr.14355) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:19:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:16 smithi007 bash[22722]: audit 2024-09-14T00:19:15.241319+0000 mgr.a (mgr.14355) 5119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:19:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:17 smithi131 bash[24745]: audit 2024-09-14T00:19:15.951344+0000 mgr.a (mgr.14355) 5120 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:19:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:17 smithi131 bash[24745]: cephadm 2024-09-14T00:19:15.952503+0000 mgr.a (mgr.14355) 5121 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:19:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:17 smithi131 bash[24745]: audit 2024-09-14T00:19:16.192119+0000 mgr.a (mgr.14355) 5122 : audit [DBG] from='client.120177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:17 smithi171 bash[25040]: audit 2024-09-14T00:19:15.951344+0000 mgr.a (mgr.14355) 5120 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:19:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:17 smithi171 bash[25040]: cephadm 2024-09-14T00:19:15.952503+0000 mgr.a (mgr.14355) 5121 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:19:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:17 smithi171 bash[25040]: audit 2024-09-14T00:19:16.192119+0000 mgr.a (mgr.14355) 5122 : audit [DBG] from='client.120177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:17 smithi007 bash[22722]: audit 2024-09-14T00:19:15.951344+0000 mgr.a (mgr.14355) 5120 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:19:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:17 smithi007 bash[22722]: cephadm 2024-09-14T00:19:15.952503+0000 mgr.a (mgr.14355) 5121 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:19:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:17 smithi007 bash[22722]: audit 2024-09-14T00:19:16.192119+0000 mgr.a (mgr.14355) 5122 : audit [DBG] from='client.120177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:18 smithi131 bash[24745]: cluster 2024-09-14T00:19:16.748769+0000 mgr.a (mgr.14355) 5123 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:18 smithi171 bash[25040]: cluster 2024-09-14T00:19:16.748769+0000 mgr.a (mgr.14355) 5123 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:18 smithi007 bash[22722]: cluster 2024-09-14T00:19:16.748769+0000 mgr.a (mgr.14355) 5123 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:20 smithi171 bash[25040]: cluster 2024-09-14T00:19:18.749542+0000 mgr.a (mgr.14355) 5124 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:20 smithi007 bash[22722]: cluster 2024-09-14T00:19:18.749542+0000 mgr.a (mgr.14355) 5124 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:20 smithi131 bash[24745]: cluster 2024-09-14T00:19:18.749542+0000 mgr.a (mgr.14355) 5124 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:21.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:22.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:22.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:22 smithi171 bash[25040]: cluster 2024-09-14T00:19:20.751571+0000 mgr.a (mgr.14355) 5125 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:22 smithi007 bash[22722]: cluster 2024-09-14T00:19:20.751571+0000 mgr.a (mgr.14355) 5125 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:22 smithi131 bash[24745]: cluster 2024-09-14T00:19:20.751571+0000 mgr.a (mgr.14355) 5125 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:23 smithi007 bash[22722]: audit 2024-09-14T00:19:21.923438+0000 mgr.a (mgr.14355) 5126 : audit [DBG] from='client.120252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:23 smithi131 bash[24745]: audit 2024-09-14T00:19:21.923438+0000 mgr.a (mgr.14355) 5126 : audit [DBG] from='client.120252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:23 smithi171 bash[25040]: audit 2024-09-14T00:19:21.923438+0000 mgr.a (mgr.14355) 5126 : audit [DBG] from='client.120252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:24 smithi007 bash[22722]: cluster 2024-09-14T00:19:22.752448+0000 mgr.a (mgr.14355) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:24 smithi131 bash[24745]: cluster 2024-09-14T00:19:22.752448+0000 mgr.a (mgr.14355) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:24 smithi171 bash[25040]: cluster 2024-09-14T00:19:22.752448+0000 mgr.a (mgr.14355) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:26 smithi007 bash[22722]: cluster 2024-09-14T00:19:24.753225+0000 mgr.a (mgr.14355) 5128 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:26 smithi131 bash[24745]: cluster 2024-09-14T00:19:24.753225+0000 mgr.a (mgr.14355) 5128 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:26 smithi171 bash[25040]: cluster 2024-09-14T00:19:24.753225+0000 mgr.a (mgr.14355) 5128 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:28.106 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:28 smithi007 bash[22722]: cluster 2024-09-14T00:19:26.755493+0000 mgr.a (mgr.14355) 5129 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:28 smithi131 bash[24745]: cluster 2024-09-14T00:19:26.755493+0000 mgr.a (mgr.14355) 5129 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:28 smithi171 bash[25040]: cluster 2024-09-14T00:19:26.755493+0000 mgr.a (mgr.14355) 5129 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:29 smithi007 bash[22722]: audit 2024-09-14T00:19:27.677936+0000 mgr.a (mgr.14355) 5130 : audit [DBG] from='client.120330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:29 smithi131 bash[24745]: audit 2024-09-14T00:19:27.677936+0000 mgr.a (mgr.14355) 5130 : audit [DBG] from='client.120330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:29 smithi171 bash[25040]: audit 2024-09-14T00:19:27.677936+0000 mgr.a (mgr.14355) 5130 : audit [DBG] from='client.120330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:30 smithi007 bash[22722]: cluster 2024-09-14T00:19:28.756422+0000 mgr.a (mgr.14355) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:30 smithi131 bash[24745]: cluster 2024-09-14T00:19:28.756422+0000 mgr.a (mgr.14355) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:30 smithi171 bash[25040]: cluster 2024-09-14T00:19:28.756422+0000 mgr.a (mgr.14355) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:32 smithi007 bash[22722]: cluster 2024-09-14T00:19:30.758693+0000 mgr.a (mgr.14355) 5132 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:32 smithi131 bash[24745]: cluster 2024-09-14T00:19:30.758693+0000 mgr.a (mgr.14355) 5132 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:32 smithi171 bash[25040]: cluster 2024-09-14T00:19:30.758693+0000 mgr.a (mgr.14355) 5132 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:19:33.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:33.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:33.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:33.881 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:33.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:34 smithi007 bash[22722]: cluster 2024-09-14T00:19:32.759487+0000 mgr.a (mgr.14355) 5133 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:34 smithi007 bash[22722]: audit 2024-09-14T00:19:33.443342+0000 mgr.a (mgr.14355) 5134 : audit [DBG] from='client.120408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:34 smithi131 bash[24745]: cluster 2024-09-14T00:19:32.759487+0000 mgr.a (mgr.14355) 5133 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:34 smithi131 bash[24745]: audit 2024-09-14T00:19:33.443342+0000 mgr.a (mgr.14355) 5134 : audit [DBG] from='client.120408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:34 smithi171 bash[25040]: cluster 2024-09-14T00:19:32.759487+0000 mgr.a (mgr.14355) 5133 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:34 smithi171 bash[25040]: audit 2024-09-14T00:19:33.443342+0000 mgr.a (mgr.14355) 5134 : audit [DBG] from='client.120408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:36 smithi007 bash[22722]: cluster 2024-09-14T00:19:34.760463+0000 mgr.a (mgr.14355) 5135 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:36 smithi131 bash[24745]: cluster 2024-09-14T00:19:34.760463+0000 mgr.a (mgr.14355) 5135 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:36 smithi171 bash[25040]: cluster 2024-09-14T00:19:34.760463+0000 mgr.a (mgr.14355) 5135 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:38.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:38.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:38 smithi007 bash[22722]: cluster 2024-09-14T00:19:36.762774+0000 mgr.a (mgr.14355) 5136 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:38 smithi131 bash[24745]: cluster 2024-09-14T00:19:36.762774+0000 mgr.a (mgr.14355) 5136 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:38 smithi171 bash[25040]: cluster 2024-09-14T00:19:36.762774+0000 mgr.a (mgr.14355) 5136 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:39.646 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:39.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:39.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:40 smithi007 bash[22722]: cluster 2024-09-14T00:19:38.763516+0000 mgr.a (mgr.14355) 5137 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:40 smithi007 bash[22722]: audit 2024-09-14T00:19:39.211750+0000 mgr.a (mgr.14355) 5138 : audit [DBG] from='client.120486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:40 smithi131 bash[24745]: cluster 2024-09-14T00:19:38.763516+0000 mgr.a (mgr.14355) 5137 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:40 smithi131 bash[24745]: audit 2024-09-14T00:19:39.211750+0000 mgr.a (mgr.14355) 5138 : audit [DBG] from='client.120486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:40 smithi171 bash[25040]: cluster 2024-09-14T00:19:38.763516+0000 mgr.a (mgr.14355) 5137 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:40 smithi171 bash[25040]: audit 2024-09-14T00:19:39.211750+0000 mgr.a (mgr.14355) 5138 : audit [DBG] from='client.120486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:42 smithi007 bash[22722]: cluster 2024-09-14T00:19:40.765954+0000 mgr.a (mgr.14355) 5139 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:42 smithi131 bash[24745]: cluster 2024-09-14T00:19:40.765954+0000 mgr.a (mgr.14355) 5139 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:42 smithi171 bash[25040]: cluster 2024-09-14T00:19:40.765954+0000 mgr.a (mgr.14355) 5139 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:19:44.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:44.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:44.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:44 smithi007 bash[22722]: cluster 2024-09-14T00:19:42.766758+0000 mgr.a (mgr.14355) 5140 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:44 smithi131 bash[24745]: cluster 2024-09-14T00:19:42.766758+0000 mgr.a (mgr.14355) 5140 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:44 smithi171 bash[25040]: cluster 2024-09-14T00:19:42.766758+0000 mgr.a (mgr.14355) 5140 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:45.416 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:45.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:46 smithi007 bash[22722]: cluster 2024-09-14T00:19:44.767290+0000 mgr.a (mgr.14355) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:46 smithi007 bash[22722]: audit 2024-09-14T00:19:44.982994+0000 mgr.a (mgr.14355) 5142 : audit [DBG] from='client.120561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:46 smithi131 bash[24745]: cluster 2024-09-14T00:19:44.767290+0000 mgr.a (mgr.14355) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:46 smithi131 bash[24745]: audit 2024-09-14T00:19:44.982994+0000 mgr.a (mgr.14355) 5142 : audit [DBG] from='client.120561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:46 smithi171 bash[25040]: cluster 2024-09-14T00:19:44.767290+0000 mgr.a (mgr.14355) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:46 smithi171 bash[25040]: audit 2024-09-14T00:19:44.982994+0000 mgr.a (mgr.14355) 5142 : audit [DBG] from='client.120561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:48 smithi007 bash[22722]: cluster 2024-09-14T00:19:46.769717+0000 mgr.a (mgr.14355) 5143 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:19:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:48 smithi131 bash[24745]: cluster 2024-09-14T00:19:46.769717+0000 mgr.a (mgr.14355) 5143 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:19:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:48 smithi171 bash[25040]: cluster 2024-09-14T00:19:46.769717+0000 mgr.a (mgr.14355) 5143 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:19:50.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:50.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:50.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:50 smithi007 bash[22722]: cluster 2024-09-14T00:19:48.770531+0000 mgr.a (mgr.14355) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:19:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:50 smithi131 bash[24745]: cluster 2024-09-14T00:19:48.770531+0000 mgr.a (mgr.14355) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:19:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:50 smithi171 bash[25040]: cluster 2024-09-14T00:19:48.770531+0000 mgr.a (mgr.14355) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:19:51.187 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:52 smithi007 bash[22722]: audit 2024-09-14T00:19:50.753309+0000 mgr.a (mgr.14355) 5145 : audit [DBG] from='client.120639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:52 smithi007 bash[22722]: cluster 2024-09-14T00:19:50.773653+0000 mgr.a (mgr.14355) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:52 smithi131 bash[24745]: audit 2024-09-14T00:19:50.753309+0000 mgr.a (mgr.14355) 5145 : audit [DBG] from='client.120639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:52 smithi131 bash[24745]: cluster 2024-09-14T00:19:50.773653+0000 mgr.a (mgr.14355) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:52 smithi171 bash[25040]: audit 2024-09-14T00:19:50.753309+0000 mgr.a (mgr.14355) 5145 : audit [DBG] from='client.120639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:52 smithi171 bash[25040]: cluster 2024-09-14T00:19:50.773653+0000 mgr.a (mgr.14355) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:54 smithi007 bash[22722]: cluster 2024-09-14T00:19:52.774671+0000 mgr.a (mgr.14355) 5147 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:54 smithi131 bash[24745]: cluster 2024-09-14T00:19:52.774671+0000 mgr.a (mgr.14355) 5147 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:54 smithi171 bash[25040]: cluster 2024-09-14T00:19:52.774671+0000 mgr.a (mgr.14355) 5147 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:56.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:19:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:19:56.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:19:56.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:19:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:19:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:19:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:19:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:19:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:56 smithi007 bash[22722]: cluster 2024-09-14T00:19:54.775446+0000 mgr.a (mgr.14355) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:56 smithi131 bash[24745]: cluster 2024-09-14T00:19:54.775446+0000 mgr.a (mgr.14355) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:56 smithi171 bash[25040]: cluster 2024-09-14T00:19:54.775446+0000 mgr.a (mgr.14355) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:19:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:57 smithi007 bash[22722]: audit 2024-09-14T00:19:56.518427+0000 mgr.a (mgr.14355) 5149 : audit [DBG] from='client.120717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:57 smithi131 bash[24745]: audit 2024-09-14T00:19:56.518427+0000 mgr.a (mgr.14355) 5149 : audit [DBG] from='client.120717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:57 smithi171 bash[25040]: audit 2024-09-14T00:19:56.518427+0000 mgr.a (mgr.14355) 5149 : audit [DBG] from='client.120717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:19:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:19:58 smithi007 bash[22722]: cluster 2024-09-14T00:19:56.776815+0000 mgr.a (mgr.14355) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:19:58 smithi131 bash[24745]: cluster 2024-09-14T00:19:56.776815+0000 mgr.a (mgr.14355) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:19:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:19:58 smithi171 bash[25040]: cluster 2024-09-14T00:19:56.776815+0000 mgr.a (mgr.14355) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:00 smithi007 bash[22722]: cluster 2024-09-14T00:19:58.777693+0000 mgr.a (mgr.14355) 5151 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:20:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:00 smithi007 bash[22722]: cluster 2024-09-14T00:20:00.000131+0000 mon.a (mon.0) 1368 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:20:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:00 smithi131 bash[24745]: cluster 2024-09-14T00:19:58.777693+0000 mgr.a (mgr.14355) 5151 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:20:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:00 smithi131 bash[24745]: cluster 2024-09-14T00:20:00.000131+0000 mon.a (mon.0) 1368 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:20:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:00 smithi171 bash[25040]: cluster 2024-09-14T00:19:58.777693+0000 mgr.a (mgr.14355) 5151 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:20:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:00 smithi171 bash[25040]: cluster 2024-09-14T00:20:00.000131+0000 mon.a (mon.0) 1368 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:20:01.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:01.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:01.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:02.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:02.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:02.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:02.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:02.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:02 smithi007 bash[22722]: cluster 2024-09-14T00:20:00.779969+0000 mgr.a (mgr.14355) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:20:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:02 smithi131 bash[24745]: cluster 2024-09-14T00:20:00.779969+0000 mgr.a (mgr.14355) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:20:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:02 smithi171 bash[25040]: cluster 2024-09-14T00:20:00.779969+0000 mgr.a (mgr.14355) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:20:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:03 smithi007 bash[22722]: audit 2024-09-14T00:20:02.270654+0000 mgr.a (mgr.14355) 5153 : audit [DBG] from='client.120792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:03 smithi131 bash[24745]: audit 2024-09-14T00:20:02.270654+0000 mgr.a (mgr.14355) 5153 : audit [DBG] from='client.120792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:03 smithi171 bash[25040]: audit 2024-09-14T00:20:02.270654+0000 mgr.a (mgr.14355) 5153 : audit [DBG] from='client.120792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:04 smithi007 bash[22722]: cluster 2024-09-14T00:20:02.780683+0000 mgr.a (mgr.14355) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:04 smithi131 bash[24745]: cluster 2024-09-14T00:20:02.780683+0000 mgr.a (mgr.14355) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:04 smithi171 bash[25040]: cluster 2024-09-14T00:20:02.780683+0000 mgr.a (mgr.14355) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:06 smithi007 bash[22722]: cluster 2024-09-14T00:20:04.781423+0000 mgr.a (mgr.14355) 5155 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:06 smithi131 bash[24745]: cluster 2024-09-14T00:20:04.781423+0000 mgr.a (mgr.14355) 5155 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:06 smithi171 bash[25040]: cluster 2024-09-14T00:20:04.781423+0000 mgr.a (mgr.14355) 5155 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:07.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:07.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:07.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:08.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:08 smithi007 bash[22722]: cluster 2024-09-14T00:20:06.783695+0000 mgr.a (mgr.14355) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:08 smithi131 bash[24745]: cluster 2024-09-14T00:20:06.783695+0000 mgr.a (mgr.14355) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:08 smithi171 bash[25040]: cluster 2024-09-14T00:20:06.783695+0000 mgr.a (mgr.14355) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:09 smithi007 bash[22722]: audit 2024-09-14T00:20:08.046806+0000 mgr.a (mgr.14355) 5157 : audit [DBG] from='client.120867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:09 smithi131 bash[24745]: audit 2024-09-14T00:20:08.046806+0000 mgr.a (mgr.14355) 5157 : audit [DBG] from='client.120867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:09 smithi171 bash[25040]: audit 2024-09-14T00:20:08.046806+0000 mgr.a (mgr.14355) 5157 : audit [DBG] from='client.120867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:10 smithi007 bash[22722]: cluster 2024-09-14T00:20:08.784640+0000 mgr.a (mgr.14355) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:10 smithi131 bash[24745]: cluster 2024-09-14T00:20:08.784640+0000 mgr.a (mgr.14355) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:10 smithi171 bash[25040]: cluster 2024-09-14T00:20:08.784640+0000 mgr.a (mgr.14355) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:12 smithi007 bash[22722]: cluster 2024-09-14T00:20:10.786941+0000 mgr.a (mgr.14355) 5159 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:12 smithi131 bash[24745]: cluster 2024-09-14T00:20:10.786941+0000 mgr.a (mgr.14355) 5159 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:12 smithi171 bash[25040]: cluster 2024-09-14T00:20:10.786941+0000 mgr.a (mgr.14355) 5159 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:13.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:13.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:13.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:14.191 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:14.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:14.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:14.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:14.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:14 smithi007 bash[22722]: cluster 2024-09-14T00:20:12.787751+0000 mgr.a (mgr.14355) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:14 smithi131 bash[24745]: cluster 2024-09-14T00:20:12.787751+0000 mgr.a (mgr.14355) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:14 smithi171 bash[25040]: cluster 2024-09-14T00:20:12.787751+0000 mgr.a (mgr.14355) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:15 smithi007 bash[22722]: audit 2024-09-14T00:20:13.783103+0000 mgr.a (mgr.14355) 5161 : audit [DBG] from='client.120942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:15 smithi131 bash[24745]: audit 2024-09-14T00:20:13.783103+0000 mgr.a (mgr.14355) 5161 : audit [DBG] from='client.120942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:15 smithi171 bash[25040]: audit 2024-09-14T00:20:13.783103+0000 mgr.a (mgr.14355) 5161 : audit [DBG] from='client.120942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:16 smithi007 bash[22722]: cluster 2024-09-14T00:20:14.788756+0000 mgr.a (mgr.14355) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:16 smithi007 bash[22722]: audit 2024-09-14T00:20:16.010601+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:20:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:16 smithi131 bash[24745]: cluster 2024-09-14T00:20:14.788756+0000 mgr.a (mgr.14355) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:16 smithi131 bash[24745]: audit 2024-09-14T00:20:16.010601+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:20:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:16 smithi171 bash[25040]: cluster 2024-09-14T00:20:14.788756+0000 mgr.a (mgr.14355) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:16 smithi171 bash[25040]: audit 2024-09-14T00:20:16.010601+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:20:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:17 smithi007 bash[22722]: cluster 2024-09-14T00:20:16.790928+0000 mgr.a (mgr.14355) 5163 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:17 smithi131 bash[24745]: cluster 2024-09-14T00:20:16.790928+0000 mgr.a (mgr.14355) 5163 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:17 smithi171 bash[25040]: cluster 2024-09-14T00:20:16.790928+0000 mgr.a (mgr.14355) 5163 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:19.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:19.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:19.967 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:19 smithi007 bash[22722]: cluster 2024-09-14T00:20:18.791690+0000 mgr.a (mgr.14355) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:19 smithi007 bash[22722]: audit 2024-09-14T00:20:19.526620+0000 mgr.a (mgr.14355) 5165 : audit [DBG] from='client.121020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:19 smithi131 bash[24745]: cluster 2024-09-14T00:20:18.791690+0000 mgr.a (mgr.14355) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:19 smithi131 bash[24745]: audit 2024-09-14T00:20:19.526620+0000 mgr.a (mgr.14355) 5165 : audit [DBG] from='client.121020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:19 smithi171 bash[25040]: cluster 2024-09-14T00:20:18.791690+0000 mgr.a (mgr.14355) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:19 smithi171 bash[25040]: audit 2024-09-14T00:20:19.526620+0000 mgr.a (mgr.14355) 5165 : audit [DBG] from='client.121020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:21 smithi007 bash[22722]: cluster 2024-09-14T00:20:20.794120+0000 mgr.a (mgr.14355) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:21 smithi131 bash[24745]: cluster 2024-09-14T00:20:20.794120+0000 mgr.a (mgr.14355) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:21 smithi171 bash[25040]: cluster 2024-09-14T00:20:20.794120+0000 mgr.a (mgr.14355) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:23 smithi007 bash[22722]: cluster 2024-09-14T00:20:22.794919+0000 mgr.a (mgr.14355) 5167 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:23 smithi131 bash[24745]: cluster 2024-09-14T00:20:22.794919+0000 mgr.a (mgr.14355) 5167 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:23 smithi171 bash[25040]: cluster 2024-09-14T00:20:22.794919+0000 mgr.a (mgr.14355) 5167 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:25.737 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:25.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:25 smithi007 bash[22722]: cluster 2024-09-14T00:20:24.795801+0000 mgr.a (mgr.14355) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:25 smithi007 bash[22722]: audit 2024-09-14T00:20:25.298351+0000 mgr.a (mgr.14355) 5169 : audit [DBG] from='client.121092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:25 smithi131 bash[24745]: cluster 2024-09-14T00:20:24.795801+0000 mgr.a (mgr.14355) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:25 smithi131 bash[24745]: audit 2024-09-14T00:20:25.298351+0000 mgr.a (mgr.14355) 5169 : audit [DBG] from='client.121092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:25 smithi171 bash[25040]: cluster 2024-09-14T00:20:24.795801+0000 mgr.a (mgr.14355) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:25 smithi171 bash[25040]: audit 2024-09-14T00:20:25.298351+0000 mgr.a (mgr.14355) 5169 : audit [DBG] from='client.121092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:20:26 smithi007 bash[22972]: debug 2024-09-14T00:20:26.918+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:20:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:20:26 smithi007 bash[22972]: debug 2024-09-14T00:20:26.918+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.113457+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.121712+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.123965+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.125737+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.135546+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.140548+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:27 smithi007 bash[22722]: audit 2024-09-14T00:20:26.142697+0000 mgr.a (mgr.14355) 5170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.113457+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.121712+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.123965+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:20:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.125737+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:20:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.135546+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.140548+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:27 smithi131 bash[24745]: audit 2024-09-14T00:20:26.142697+0000 mgr.a (mgr.14355) 5170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.113457+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.121712+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.123965+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.125737+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.135546+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.140548+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:27 smithi171 bash[25040]: audit 2024-09-14T00:20:26.142697+0000 mgr.a (mgr.14355) 5170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:20:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:28 smithi007 bash[22722]: cluster 2024-09-14T00:20:26.797164+0000 mgr.a (mgr.14355) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:28 smithi007 bash[22722]: audit 2024-09-14T00:20:26.923456+0000 mgr.a (mgr.14355) 5172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:20:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:28 smithi007 bash[22722]: cephadm 2024-09-14T00:20:26.925073+0000 mgr.a (mgr.14355) 5173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:20:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:28 smithi131 bash[24745]: cluster 2024-09-14T00:20:26.797164+0000 mgr.a (mgr.14355) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:28 smithi131 bash[24745]: audit 2024-09-14T00:20:26.923456+0000 mgr.a (mgr.14355) 5172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:20:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:28 smithi131 bash[24745]: cephadm 2024-09-14T00:20:26.925073+0000 mgr.a (mgr.14355) 5173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:20:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:28 smithi171 bash[25040]: cluster 2024-09-14T00:20:26.797164+0000 mgr.a (mgr.14355) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:28 smithi171 bash[25040]: audit 2024-09-14T00:20:26.923456+0000 mgr.a (mgr.14355) 5172 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:20:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:28 smithi171 bash[25040]: cephadm 2024-09-14T00:20:26.925073+0000 mgr.a (mgr.14355) 5173 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:20:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:30 smithi007 bash[22722]: cluster 2024-09-14T00:20:28.797893+0000 mgr.a (mgr.14355) 5174 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:20:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:30 smithi131 bash[24745]: cluster 2024-09-14T00:20:28.797893+0000 mgr.a (mgr.14355) 5174 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:20:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:30 smithi171 bash[25040]: cluster 2024-09-14T00:20:28.797893+0000 mgr.a (mgr.14355) 5174 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:20:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:30.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:30.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:31.484 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:31.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:32 smithi007 bash[22722]: cluster 2024-09-14T00:20:30.799344+0000 mgr.a (mgr.14355) 5175 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:32 smithi007 bash[22722]: audit 2024-09-14T00:20:31.068718+0000 mgr.a (mgr.14355) 5176 : audit [DBG] from='client.121272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:32 smithi131 bash[24745]: cluster 2024-09-14T00:20:30.799344+0000 mgr.a (mgr.14355) 5175 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:32 smithi131 bash[24745]: audit 2024-09-14T00:20:31.068718+0000 mgr.a (mgr.14355) 5176 : audit [DBG] from='client.121272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:32 smithi171 bash[25040]: cluster 2024-09-14T00:20:30.799344+0000 mgr.a (mgr.14355) 5175 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:32 smithi171 bash[25040]: audit 2024-09-14T00:20:31.068718+0000 mgr.a (mgr.14355) 5176 : audit [DBG] from='client.121272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:34 smithi007 bash[22722]: cluster 2024-09-14T00:20:32.800221+0000 mgr.a (mgr.14355) 5177 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:34 smithi131 bash[24745]: cluster 2024-09-14T00:20:32.800221+0000 mgr.a (mgr.14355) 5177 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:34 smithi171 bash[25040]: cluster 2024-09-14T00:20:32.800221+0000 mgr.a (mgr.14355) 5177 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:36 smithi007 bash[22722]: cluster 2024-09-14T00:20:34.801010+0000 mgr.a (mgr.14355) 5178 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:36.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:36.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:36 smithi131 bash[24745]: cluster 2024-09-14T00:20:34.801010+0000 mgr.a (mgr.14355) 5178 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:36 smithi171 bash[25040]: cluster 2024-09-14T00:20:34.801010+0000 mgr.a (mgr.14355) 5178 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:20:37.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:38 smithi007 bash[22722]: cluster 2024-09-14T00:20:36.803155+0000 mgr.a (mgr.14355) 5179 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:38 smithi007 bash[22722]: audit 2024-09-14T00:20:36.832280+0000 mgr.a (mgr.14355) 5180 : audit [DBG] from='client.121347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:38 smithi131 bash[24745]: cluster 2024-09-14T00:20:36.803155+0000 mgr.a (mgr.14355) 5179 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:38 smithi131 bash[24745]: audit 2024-09-14T00:20:36.832280+0000 mgr.a (mgr.14355) 5180 : audit [DBG] from='client.121347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:38 smithi171 bash[25040]: cluster 2024-09-14T00:20:36.803155+0000 mgr.a (mgr.14355) 5179 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:38 smithi171 bash[25040]: audit 2024-09-14T00:20:36.832280+0000 mgr.a (mgr.14355) 5180 : audit [DBG] from='client.121347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:40 smithi007 bash[22722]: cluster 2024-09-14T00:20:38.804012+0000 mgr.a (mgr.14355) 5181 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:40 smithi131 bash[24745]: cluster 2024-09-14T00:20:38.804012+0000 mgr.a (mgr.14355) 5181 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:40 smithi171 bash[25040]: cluster 2024-09-14T00:20:38.804012+0000 mgr.a (mgr.14355) 5181 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:42.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:42.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:42 smithi007 bash[22722]: cluster 2024-09-14T00:20:40.806239+0000 mgr.a (mgr.14355) 5182 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:42 smithi131 bash[24745]: cluster 2024-09-14T00:20:40.806239+0000 mgr.a (mgr.14355) 5182 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:42 smithi171 bash[25040]: cluster 2024-09-14T00:20:40.806239+0000 mgr.a (mgr.14355) 5182 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:20:43.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:43 smithi007 bash[22722]: audit 2024-09-14T00:20:42.620121+0000 mgr.a (mgr.14355) 5183 : audit [DBG] from='client.121425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:43 smithi131 bash[24745]: audit 2024-09-14T00:20:42.620121+0000 mgr.a (mgr.14355) 5183 : audit [DBG] from='client.121425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:43 smithi171 bash[25040]: audit 2024-09-14T00:20:42.620121+0000 mgr.a (mgr.14355) 5183 : audit [DBG] from='client.121425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:44 smithi007 bash[22722]: cluster 2024-09-14T00:20:42.806904+0000 mgr.a (mgr.14355) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:44 smithi131 bash[24745]: cluster 2024-09-14T00:20:42.806904+0000 mgr.a (mgr.14355) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:44 smithi171 bash[25040]: cluster 2024-09-14T00:20:42.806904+0000 mgr.a (mgr.14355) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:46 smithi007 bash[22722]: cluster 2024-09-14T00:20:44.807769+0000 mgr.a (mgr.14355) 5185 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:46 smithi131 bash[24745]: cluster 2024-09-14T00:20:44.807769+0000 mgr.a (mgr.14355) 5185 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:46 smithi171 bash[25040]: cluster 2024-09-14T00:20:44.807769+0000 mgr.a (mgr.14355) 5185 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:48.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:48.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:48 smithi007 bash[22722]: cluster 2024-09-14T00:20:46.810037+0000 mgr.a (mgr.14355) 5186 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:48 smithi131 bash[24745]: cluster 2024-09-14T00:20:46.810037+0000 mgr.a (mgr.14355) 5186 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:48 smithi171 bash[25040]: cluster 2024-09-14T00:20:46.810037+0000 mgr.a (mgr.14355) 5186 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:48.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:48.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:48.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:49 smithi007 bash[22722]: audit 2024-09-14T00:20:48.388688+0000 mgr.a (mgr.14355) 5187 : audit [DBG] from='client.121497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:49 smithi131 bash[24745]: audit 2024-09-14T00:20:48.388688+0000 mgr.a (mgr.14355) 5187 : audit [DBG] from='client.121497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:49 smithi171 bash[25040]: audit 2024-09-14T00:20:48.388688+0000 mgr.a (mgr.14355) 5187 : audit [DBG] from='client.121497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:50 smithi007 bash[22722]: cluster 2024-09-14T00:20:48.810770+0000 mgr.a (mgr.14355) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:50 smithi131 bash[24745]: cluster 2024-09-14T00:20:48.810770+0000 mgr.a (mgr.14355) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:50 smithi171 bash[25040]: cluster 2024-09-14T00:20:48.810770+0000 mgr.a (mgr.14355) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:52 smithi007 bash[22722]: cluster 2024-09-14T00:20:50.812912+0000 mgr.a (mgr.14355) 5189 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:52 smithi131 bash[24745]: cluster 2024-09-14T00:20:50.812912+0000 mgr.a (mgr.14355) 5189 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:52 smithi171 bash[25040]: cluster 2024-09-14T00:20:50.812912+0000 mgr.a (mgr.14355) 5189 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:53.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:53.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:20:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:54 smithi007 bash[22722]: cluster 2024-09-14T00:20:52.813694+0000 mgr.a (mgr.14355) 5190 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:54 smithi131 bash[24745]: cluster 2024-09-14T00:20:52.813694+0000 mgr.a (mgr.14355) 5190 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:54 smithi171 bash[25040]: cluster 2024-09-14T00:20:52.813694+0000 mgr.a (mgr.14355) 5190 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:20:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:20:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:20:54.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:20:54.580 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:20:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:55 smithi131 bash[24745]: audit 2024-09-14T00:20:54.142825+0000 mgr.a (mgr.14355) 5191 : audit [DBG] from='client.121572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:55 smithi171 bash[25040]: audit 2024-09-14T00:20:54.142825+0000 mgr.a (mgr.14355) 5191 : audit [DBG] from='client.121572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:55 smithi007 bash[22722]: audit 2024-09-14T00:20:54.142825+0000 mgr.a (mgr.14355) 5191 : audit [DBG] from='client.121572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:20:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:56 smithi131 bash[24745]: cluster 2024-09-14T00:20:54.814700+0000 mgr.a (mgr.14355) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:56 smithi171 bash[25040]: cluster 2024-09-14T00:20:54.814700+0000 mgr.a (mgr.14355) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:56 smithi007 bash[22722]: cluster 2024-09-14T00:20:54.814700+0000 mgr.a (mgr.14355) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:20:58 smithi131 bash[24745]: cluster 2024-09-14T00:20:56.816989+0000 mgr.a (mgr.14355) 5193 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:20:58 smithi171 bash[25040]: cluster 2024-09-14T00:20:56.816989+0000 mgr.a (mgr.14355) 5193 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:20:58 smithi007 bash[22722]: cluster 2024-09-14T00:20:56.816989+0000 mgr.a (mgr.14355) 5193 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:20:59.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:20:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:20:59.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:00.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:00.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:00.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:00.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:00.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:00 smithi131 bash[24745]: cluster 2024-09-14T00:20:58.817790+0000 mgr.a (mgr.14355) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:00 smithi171 bash[25040]: cluster 2024-09-14T00:20:58.817790+0000 mgr.a (mgr.14355) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:00 smithi007 bash[22722]: cluster 2024-09-14T00:20:58.817790+0000 mgr.a (mgr.14355) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:01 smithi131 bash[24745]: audit 2024-09-14T00:20:59.915889+0000 mgr.a (mgr.14355) 5195 : audit [DBG] from='client.121650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:01 smithi171 bash[25040]: audit 2024-09-14T00:20:59.915889+0000 mgr.a (mgr.14355) 5195 : audit [DBG] from='client.121650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:01 smithi007 bash[22722]: audit 2024-09-14T00:20:59.915889+0000 mgr.a (mgr.14355) 5195 : audit [DBG] from='client.121650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:02 smithi131 bash[24745]: cluster 2024-09-14T00:21:00.820296+0000 mgr.a (mgr.14355) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:02 smithi171 bash[25040]: cluster 2024-09-14T00:21:00.820296+0000 mgr.a (mgr.14355) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:02 smithi007 bash[22722]: cluster 2024-09-14T00:21:00.820296+0000 mgr.a (mgr.14355) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:04 smithi131 bash[24745]: cluster 2024-09-14T00:21:02.821103+0000 mgr.a (mgr.14355) 5197 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:04 smithi171 bash[25040]: cluster 2024-09-14T00:21:02.821103+0000 mgr.a (mgr.14355) 5197 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:04 smithi007 bash[22722]: cluster 2024-09-14T00:21:02.821103+0000 mgr.a (mgr.14355) 5197 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:06.122 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:06.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:06 smithi131 bash[24745]: cluster 2024-09-14T00:21:04.821876+0000 mgr.a (mgr.14355) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:06 smithi131 bash[24745]: audit 2024-09-14T00:21:05.677598+0000 mgr.a (mgr.14355) 5199 : audit [DBG] from='client.121728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:06 smithi171 bash[25040]: cluster 2024-09-14T00:21:04.821876+0000 mgr.a (mgr.14355) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:06 smithi171 bash[25040]: audit 2024-09-14T00:21:05.677598+0000 mgr.a (mgr.14355) 5199 : audit [DBG] from='client.121728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:06 smithi007 bash[22722]: cluster 2024-09-14T00:21:04.821876+0000 mgr.a (mgr.14355) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:06 smithi007 bash[22722]: audit 2024-09-14T00:21:05.677598+0000 mgr.a (mgr.14355) 5199 : audit [DBG] from='client.121728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:08 smithi131 bash[24745]: cluster 2024-09-14T00:21:06.824748+0000 mgr.a (mgr.14355) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:08 smithi171 bash[25040]: cluster 2024-09-14T00:21:06.824748+0000 mgr.a (mgr.14355) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:08 smithi007 bash[22722]: cluster 2024-09-14T00:21:06.824748+0000 mgr.a (mgr.14355) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:10 smithi131 bash[24745]: cluster 2024-09-14T00:21:08.825531+0000 mgr.a (mgr.14355) 5201 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:10 smithi171 bash[25040]: cluster 2024-09-14T00:21:08.825531+0000 mgr.a (mgr.14355) 5201 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:10 smithi007 bash[22722]: cluster 2024-09-14T00:21:08.825531+0000 mgr.a (mgr.14355) 5201 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:11.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:11.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:11.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:12 smithi131 bash[24745]: cluster 2024-09-14T00:21:10.827461+0000 mgr.a (mgr.14355) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:12 smithi131 bash[24745]: audit 2024-09-14T00:21:11.456810+0000 mgr.a (mgr.14355) 5203 : audit [DBG] from='client.121803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:12 smithi171 bash[25040]: cluster 2024-09-14T00:21:10.827461+0000 mgr.a (mgr.14355) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:12 smithi171 bash[25040]: audit 2024-09-14T00:21:11.456810+0000 mgr.a (mgr.14355) 5203 : audit [DBG] from='client.121803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:12 smithi007 bash[22722]: cluster 2024-09-14T00:21:10.827461+0000 mgr.a (mgr.14355) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:12 smithi007 bash[22722]: audit 2024-09-14T00:21:11.456810+0000 mgr.a (mgr.14355) 5203 : audit [DBG] from='client.121803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:14.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:14 smithi131 bash[24745]: cluster 2024-09-14T00:21:12.828347+0000 mgr.a (mgr.14355) 5204 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:14 smithi171 bash[25040]: cluster 2024-09-14T00:21:12.828347+0000 mgr.a (mgr.14355) 5204 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:14 smithi007 bash[22722]: cluster 2024-09-14T00:21:12.828347+0000 mgr.a (mgr.14355) 5204 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:21:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:16 smithi131 bash[24745]: cluster 2024-09-14T00:21:14.829127+0000 mgr.a (mgr.14355) 5205 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:21:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:16 smithi171 bash[25040]: cluster 2024-09-14T00:21:14.829127+0000 mgr.a (mgr.14355) 5205 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:21:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:16 smithi007 bash[22722]: cluster 2024-09-14T00:21:14.829127+0000 mgr.a (mgr.14355) 5205 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:21:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:16.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:16.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:17.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:17.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:17.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:17.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:17.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:18 smithi131 bash[24745]: cluster 2024-09-14T00:21:16.831413+0000 mgr.a (mgr.14355) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:18 smithi131 bash[24745]: audit 2024-09-14T00:21:17.200157+0000 mgr.a (mgr.14355) 5207 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:18 smithi171 bash[25040]: cluster 2024-09-14T00:21:16.831413+0000 mgr.a (mgr.14355) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:18 smithi171 bash[25040]: audit 2024-09-14T00:21:17.200157+0000 mgr.a (mgr.14355) 5207 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:18 smithi007 bash[22722]: cluster 2024-09-14T00:21:16.831413+0000 mgr.a (mgr.14355) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:18 smithi007 bash[22722]: audit 2024-09-14T00:21:17.200157+0000 mgr.a (mgr.14355) 5207 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:20 smithi131 bash[24745]: cluster 2024-09-14T00:21:18.832343+0000 mgr.a (mgr.14355) 5208 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:20 smithi171 bash[25040]: cluster 2024-09-14T00:21:18.832343+0000 mgr.a (mgr.14355) 5208 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:20 smithi007 bash[22722]: cluster 2024-09-14T00:21:18.832343+0000 mgr.a (mgr.14355) 5208 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:22 smithi131 bash[24745]: cluster 2024-09-14T00:21:20.834510+0000 mgr.a (mgr.14355) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:22 smithi171 bash[25040]: cluster 2024-09-14T00:21:20.834510+0000 mgr.a (mgr.14355) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:22 smithi007 bash[22722]: cluster 2024-09-14T00:21:20.834510+0000 mgr.a (mgr.14355) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:23.380 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:23.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:24 smithi131 bash[24745]: cluster 2024-09-14T00:21:22.835243+0000 mgr.a (mgr.14355) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:24 smithi131 bash[24745]: audit 2024-09-14T00:21:22.947953+0000 mgr.a (mgr.14355) 5211 : audit [DBG] from='client.121953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:24 smithi171 bash[25040]: cluster 2024-09-14T00:21:22.835243+0000 mgr.a (mgr.14355) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:24 smithi171 bash[25040]: audit 2024-09-14T00:21:22.947953+0000 mgr.a (mgr.14355) 5211 : audit [DBG] from='client.121953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:24 smithi007 bash[22722]: cluster 2024-09-14T00:21:22.835243+0000 mgr.a (mgr.14355) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:24 smithi007 bash[22722]: audit 2024-09-14T00:21:22.947953+0000 mgr.a (mgr.14355) 5211 : audit [DBG] from='client.121953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:26 smithi131 bash[24745]: cluster 2024-09-14T00:21:24.836277+0000 mgr.a (mgr.14355) 5212 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:26 smithi171 bash[25040]: cluster 2024-09-14T00:21:24.836277+0000 mgr.a (mgr.14355) 5212 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:26 smithi007 bash[22722]: cluster 2024-09-14T00:21:24.836277+0000 mgr.a (mgr.14355) 5212 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:27 smithi171 bash[25040]: audit 2024-09-14T00:21:26.993879+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:21:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:27 smithi007 bash[22722]: audit 2024-09-14T00:21:26.993879+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:21:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:27 smithi131 bash[24745]: audit 2024-09-14T00:21:26.993879+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:21:28.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:28.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:28.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:28 smithi007 bash[22722]: cluster 2024-09-14T00:21:26.838608+0000 mgr.a (mgr.14355) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:28 smithi007 bash[22722]: audit 2024-09-14T00:21:27.622589+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:28 smithi007 bash[22722]: audit 2024-09-14T00:21:27.626451+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:28 smithi131 bash[24745]: cluster 2024-09-14T00:21:26.838608+0000 mgr.a (mgr.14355) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:28 smithi131 bash[24745]: audit 2024-09-14T00:21:27.622589+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:28 smithi131 bash[24745]: audit 2024-09-14T00:21:27.626451+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:28 smithi171 bash[25040]: cluster 2024-09-14T00:21:26.838608+0000 mgr.a (mgr.14355) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:28 smithi171 bash[25040]: audit 2024-09-14T00:21:27.622589+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:28 smithi171 bash[25040]: audit 2024-09-14T00:21:27.626451+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:29.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:29.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:29.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:29.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:29.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:30 smithi007 bash[22722]: audit 2024-09-14T00:21:28.697737+0000 mgr.a (mgr.14355) 5214 : audit [DBG] from='client.122031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:30 smithi007 bash[22722]: cluster 2024-09-14T00:21:28.839257+0000 mgr.a (mgr.14355) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:30 smithi131 bash[24745]: audit 2024-09-14T00:21:28.697737+0000 mgr.a (mgr.14355) 5214 : audit [DBG] from='client.122031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:30 smithi131 bash[24745]: cluster 2024-09-14T00:21:28.839257+0000 mgr.a (mgr.14355) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:30 smithi171 bash[25040]: audit 2024-09-14T00:21:28.697737+0000 mgr.a (mgr.14355) 5214 : audit [DBG] from='client.122031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:30 smithi171 bash[25040]: cluster 2024-09-14T00:21:28.839257+0000 mgr.a (mgr.14355) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:32.913 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:32 smithi131 bash[24745]: cluster 2024-09-14T00:21:30.841683+0000 mgr.a (mgr.14355) 5216 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:32.923 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:32 smithi171 bash[25040]: cluster 2024-09-14T00:21:30.841683+0000 mgr.a (mgr.14355) 5216 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:32 smithi007 bash[22722]: cluster 2024-09-14T00:21:30.841683+0000 mgr.a (mgr.14355) 5216 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:34.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:34.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:34.867 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:34 smithi007 bash[22722]: cluster 2024-09-14T00:21:32.842471+0000 mgr.a (mgr.14355) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:34 smithi131 bash[24745]: cluster 2024-09-14T00:21:32.842471+0000 mgr.a (mgr.14355) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:34 smithi171 bash[25040]: cluster 2024-09-14T00:21:32.842471+0000 mgr.a (mgr.14355) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:35 smithi007 bash[22722]: audit 2024-09-14T00:21:34.438692+0000 mgr.a (mgr.14355) 5218 : audit [DBG] from='client.122109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:35 smithi131 bash[24745]: audit 2024-09-14T00:21:34.438692+0000 mgr.a (mgr.14355) 5218 : audit [DBG] from='client.122109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:35 smithi171 bash[25040]: audit 2024-09-14T00:21:34.438692+0000 mgr.a (mgr.14355) 5218 : audit [DBG] from='client.122109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:36 smithi131 bash[24745]: cluster 2024-09-14T00:21:34.842964+0000 mgr.a (mgr.14355) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:36 smithi007 bash[22722]: cluster 2024-09-14T00:21:34.842964+0000 mgr.a (mgr.14355) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:36 smithi171 bash[25040]: cluster 2024-09-14T00:21:34.842964+0000 mgr.a (mgr.14355) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: cluster 2024-09-14T00:21:36.845240+0000 mgr.a (mgr.14355) 5220 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.213069+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.223029+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.579488+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.588896+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.591260+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.593527+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.605166+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.610892+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:38 smithi131 bash[24745]: audit 2024-09-14T00:21:37.613182+0000 mgr.a (mgr.14355) 5221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: cluster 2024-09-14T00:21:36.845240+0000 mgr.a (mgr.14355) 5220 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.213069+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.223029+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.579488+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.588896+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.591260+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.593527+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.605166+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.610892+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:38.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:38 smithi171 bash[25040]: audit 2024-09-14T00:21:37.613182+0000 mgr.a (mgr.14355) 5221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:38.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22972]: debug 2024-09-14T00:21:38.381+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:21:38.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22972]: debug 2024-09-14T00:21:38.385+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: cluster 2024-09-14T00:21:36.845240+0000 mgr.a (mgr.14355) 5220 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.213069+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.223029+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.579488+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.588896+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.591260+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.593527+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.605166+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.610892+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:38 smithi007 bash[22722]: audit 2024-09-14T00:21:37.613182+0000 mgr.a (mgr.14355) 5221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:21:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:39 smithi131 bash[24745]: audit 2024-09-14T00:21:38.386016+0000 mgr.a (mgr.14355) 5222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:21:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:39 smithi131 bash[24745]: cephadm 2024-09-14T00:21:38.387719+0000 mgr.a (mgr.14355) 5223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:21:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:39 smithi171 bash[25040]: audit 2024-09-14T00:21:38.386016+0000 mgr.a (mgr.14355) 5222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:21:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:39 smithi171 bash[25040]: cephadm 2024-09-14T00:21:38.387719+0000 mgr.a (mgr.14355) 5223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:21:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:39 smithi007 bash[22722]: audit 2024-09-14T00:21:38.386016+0000 mgr.a (mgr.14355) 5222 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:21:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:39 smithi007 bash[22722]: cephadm 2024-09-14T00:21:38.387719+0000 mgr.a (mgr.14355) 5223 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:21:39.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:40 smithi131 bash[24745]: cluster 2024-09-14T00:21:38.846241+0000 mgr.a (mgr.14355) 5224 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:40 smithi171 bash[25040]: cluster 2024-09-14T00:21:38.846241+0000 mgr.a (mgr.14355) 5224 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:40.644 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:40.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:40 smithi007 bash[22722]: cluster 2024-09-14T00:21:38.846241+0000 mgr.a (mgr.14355) 5224 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:41 smithi131 bash[24745]: audit 2024-09-14T00:21:40.204514+0000 mgr.a (mgr.14355) 5225 : audit [DBG] from='client.122295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:41 smithi171 bash[25040]: audit 2024-09-14T00:21:40.204514+0000 mgr.a (mgr.14355) 5225 : audit [DBG] from='client.122295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:41 smithi007 bash[22722]: audit 2024-09-14T00:21:40.204514+0000 mgr.a (mgr.14355) 5225 : audit [DBG] from='client.122295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:42 smithi131 bash[24745]: cluster 2024-09-14T00:21:40.849178+0000 mgr.a (mgr.14355) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:42 smithi171 bash[25040]: cluster 2024-09-14T00:21:40.849178+0000 mgr.a (mgr.14355) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:42 smithi007 bash[22722]: cluster 2024-09-14T00:21:40.849178+0000 mgr.a (mgr.14355) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:44 smithi131 bash[24745]: cluster 2024-09-14T00:21:42.849965+0000 mgr.a (mgr.14355) 5227 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:44 smithi171 bash[25040]: cluster 2024-09-14T00:21:42.849965+0000 mgr.a (mgr.14355) 5227 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:44 smithi007 bash[22722]: cluster 2024-09-14T00:21:42.849965+0000 mgr.a (mgr.14355) 5227 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:45.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:46.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:46.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:46.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:46 smithi131 bash[24745]: cluster 2024-09-14T00:21:44.850766+0000 mgr.a (mgr.14355) 5228 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:46 smithi171 bash[25040]: cluster 2024-09-14T00:21:44.850766+0000 mgr.a (mgr.14355) 5228 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:46 smithi007 bash[22722]: cluster 2024-09-14T00:21:44.850766+0000 mgr.a (mgr.14355) 5228 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:47 smithi131 bash[24745]: audit 2024-09-14T00:21:45.980878+0000 mgr.a (mgr.14355) 5229 : audit [DBG] from='client.122373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:47 smithi171 bash[25040]: audit 2024-09-14T00:21:45.980878+0000 mgr.a (mgr.14355) 5229 : audit [DBG] from='client.122373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:47 smithi007 bash[22722]: audit 2024-09-14T00:21:45.980878+0000 mgr.a (mgr.14355) 5229 : audit [DBG] from='client.122373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:48 smithi131 bash[24745]: cluster 2024-09-14T00:21:46.853581+0000 mgr.a (mgr.14355) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:48 smithi171 bash[25040]: cluster 2024-09-14T00:21:46.853581+0000 mgr.a (mgr.14355) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:48 smithi007 bash[22722]: cluster 2024-09-14T00:21:46.853581+0000 mgr.a (mgr.14355) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:50 smithi131 bash[24745]: cluster 2024-09-14T00:21:48.854395+0000 mgr.a (mgr.14355) 5231 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:50 smithi171 bash[25040]: cluster 2024-09-14T00:21:48.854395+0000 mgr.a (mgr.14355) 5231 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:50 smithi007 bash[22722]: cluster 2024-09-14T00:21:48.854395+0000 mgr.a (mgr.14355) 5231 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:21:51.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:51.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:51.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:52.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:52.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:52.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:52.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:52.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:52 smithi131 bash[24745]: cluster 2024-09-14T00:21:50.856401+0000 mgr.a (mgr.14355) 5232 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:52 smithi171 bash[25040]: cluster 2024-09-14T00:21:50.856401+0000 mgr.a (mgr.14355) 5232 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:52 smithi007 bash[22722]: cluster 2024-09-14T00:21:50.856401+0000 mgr.a (mgr.14355) 5232 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:21:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:53 smithi131 bash[24745]: audit 2024-09-14T00:21:51.742515+0000 mgr.a (mgr.14355) 5233 : audit [DBG] from='client.122451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:53 smithi171 bash[25040]: audit 2024-09-14T00:21:51.742515+0000 mgr.a (mgr.14355) 5233 : audit [DBG] from='client.122451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:53 smithi007 bash[22722]: audit 2024-09-14T00:21:51.742515+0000 mgr.a (mgr.14355) 5233 : audit [DBG] from='client.122451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:54 smithi131 bash[24745]: cluster 2024-09-14T00:21:52.857331+0000 mgr.a (mgr.14355) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:54 smithi171 bash[25040]: cluster 2024-09-14T00:21:52.857331+0000 mgr.a (mgr.14355) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:54 smithi007 bash[22722]: cluster 2024-09-14T00:21:52.857331+0000 mgr.a (mgr.14355) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:56 smithi131 bash[24745]: cluster 2024-09-14T00:21:54.858098+0000 mgr.a (mgr.14355) 5235 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:56 smithi171 bash[25040]: cluster 2024-09-14T00:21:54.858098+0000 mgr.a (mgr.14355) 5235 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:56 smithi007 bash[22722]: cluster 2024-09-14T00:21:54.858098+0000 mgr.a (mgr.14355) 5235 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:21:57.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:21:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:21:57.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:21:57.994 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:21:57.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:21:57.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:21:57.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:21:57.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:21:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:58 smithi131 bash[24745]: cluster 2024-09-14T00:21:56.860345+0000 mgr.a (mgr.14355) 5236 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:21:58 smithi131 bash[24745]: audit 2024-09-14T00:21:57.534962+0000 mgr.a (mgr.14355) 5237 : audit [DBG] from='client.122529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:58 smithi171 bash[25040]: cluster 2024-09-14T00:21:56.860345+0000 mgr.a (mgr.14355) 5236 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:21:58 smithi171 bash[25040]: audit 2024-09-14T00:21:57.534962+0000 mgr.a (mgr.14355) 5237 : audit [DBG] from='client.122529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:21:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:58 smithi007 bash[22722]: cluster 2024-09-14T00:21:56.860345+0000 mgr.a (mgr.14355) 5236 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:21:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:21:58 smithi007 bash[22722]: audit 2024-09-14T00:21:57.534962+0000 mgr.a (mgr.14355) 5237 : audit [DBG] from='client.122529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:00 smithi131 bash[24745]: cluster 2024-09-14T00:21:58.861271+0000 mgr.a (mgr.14355) 5238 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:00 smithi171 bash[25040]: cluster 2024-09-14T00:21:58.861271+0000 mgr.a (mgr.14355) 5238 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:00 smithi007 bash[22722]: cluster 2024-09-14T00:21:58.861271+0000 mgr.a (mgr.14355) 5238 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:02 smithi171 bash[25040]: cluster 2024-09-14T00:22:00.863546+0000 mgr.a (mgr.14355) 5239 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:02 smithi007 bash[22722]: cluster 2024-09-14T00:22:00.863546+0000 mgr.a (mgr.14355) 5239 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:02 smithi131 bash[24745]: cluster 2024-09-14T00:22:00.863546+0000 mgr.a (mgr.14355) 5239 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:02.996 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:02.997 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:03.761 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:04 smithi171 bash[25040]: cluster 2024-09-14T00:22:02.864300+0000 mgr.a (mgr.14355) 5240 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:04 smithi171 bash[25040]: audit 2024-09-14T00:22:03.329203+0000 mgr.a (mgr.14355) 5241 : audit [DBG] from='client.122604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:04 smithi007 bash[22722]: cluster 2024-09-14T00:22:02.864300+0000 mgr.a (mgr.14355) 5240 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:04 smithi007 bash[22722]: audit 2024-09-14T00:22:03.329203+0000 mgr.a (mgr.14355) 5241 : audit [DBG] from='client.122604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:04 smithi131 bash[24745]: cluster 2024-09-14T00:22:02.864300+0000 mgr.a (mgr.14355) 5240 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:04 smithi131 bash[24745]: audit 2024-09-14T00:22:03.329203+0000 mgr.a (mgr.14355) 5241 : audit [DBG] from='client.122604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:06 smithi171 bash[25040]: cluster 2024-09-14T00:22:04.865384+0000 mgr.a (mgr.14355) 5242 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:06 smithi007 bash[22722]: cluster 2024-09-14T00:22:04.865384+0000 mgr.a (mgr.14355) 5242 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:06 smithi131 bash[24745]: cluster 2024-09-14T00:22:04.865384+0000 mgr.a (mgr.14355) 5242 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-14T00:22:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:08 smithi007 bash[22722]: cluster 2024-09-14T00:22:06.867715+0000 mgr.a (mgr.14355) 5243 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:08.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:08.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:08.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:08 smithi131 bash[24745]: cluster 2024-09-14T00:22:06.867715+0000 mgr.a (mgr.14355) 5243 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:08 smithi171 bash[25040]: cluster 2024-09-14T00:22:06.867715+0000 mgr.a (mgr.14355) 5243 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:09.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:09.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:10 smithi007 bash[22722]: cluster 2024-09-14T00:22:08.868134+0000 mgr.a (mgr.14355) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:10 smithi007 bash[22722]: audit 2024-09-14T00:22:09.095360+0000 mgr.a (mgr.14355) 5245 : audit [DBG] from='client.122679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:10 smithi131 bash[24745]: cluster 2024-09-14T00:22:08.868134+0000 mgr.a (mgr.14355) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:10 smithi131 bash[24745]: audit 2024-09-14T00:22:09.095360+0000 mgr.a (mgr.14355) 5245 : audit [DBG] from='client.122679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:10 smithi171 bash[25040]: cluster 2024-09-14T00:22:08.868134+0000 mgr.a (mgr.14355) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:10 smithi171 bash[25040]: audit 2024-09-14T00:22:09.095360+0000 mgr.a (mgr.14355) 5245 : audit [DBG] from='client.122679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:12 smithi007 bash[22722]: cluster 2024-09-14T00:22:10.870466+0000 mgr.a (mgr.14355) 5246 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:12 smithi131 bash[24745]: cluster 2024-09-14T00:22:10.870466+0000 mgr.a (mgr.14355) 5246 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:12 smithi171 bash[25040]: cluster 2024-09-14T00:22:10.870466+0000 mgr.a (mgr.14355) 5246 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 94 op/s 2024-09-14T00:22:14.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:14.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:14.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:14 smithi007 bash[22722]: cluster 2024-09-14T00:22:12.871245+0000 mgr.a (mgr.14355) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:14 smithi131 bash[24745]: cluster 2024-09-14T00:22:12.871245+0000 mgr.a (mgr.14355) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:14 smithi171 bash[25040]: cluster 2024-09-14T00:22:12.871245+0000 mgr.a (mgr.14355) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:15.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:16 smithi007 bash[22722]: audit 2024-09-14T00:22:14.872657+0000 mgr.a (mgr.14355) 5248 : audit [DBG] from='client.122757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:16 smithi007 bash[22722]: cluster 2024-09-14T00:22:14.873442+0000 mgr.a (mgr.14355) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:16 smithi131 bash[24745]: audit 2024-09-14T00:22:14.872657+0000 mgr.a (mgr.14355) 5248 : audit [DBG] from='client.122757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:16 smithi131 bash[24745]: cluster 2024-09-14T00:22:14.873442+0000 mgr.a (mgr.14355) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:16 smithi171 bash[25040]: audit 2024-09-14T00:22:14.872657+0000 mgr.a (mgr.14355) 5248 : audit [DBG] from='client.122757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:16 smithi171 bash[25040]: cluster 2024-09-14T00:22:14.873442+0000 mgr.a (mgr.14355) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:18 smithi007 bash[22722]: cluster 2024-09-14T00:22:16.876246+0000 mgr.a (mgr.14355) 5250 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:18 smithi131 bash[24745]: cluster 2024-09-14T00:22:16.876246+0000 mgr.a (mgr.14355) 5250 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:18 smithi171 bash[25040]: cluster 2024-09-14T00:22:16.876246+0000 mgr.a (mgr.14355) 5250 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-09-14T00:22:20.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:20.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:20 smithi007 bash[22722]: cluster 2024-09-14T00:22:18.877017+0000 mgr.a (mgr.14355) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:22:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:20 smithi131 bash[24745]: cluster 2024-09-14T00:22:18.877017+0000 mgr.a (mgr.14355) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:22:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:20 smithi171 bash[25040]: cluster 2024-09-14T00:22:18.877017+0000 mgr.a (mgr.14355) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:22:21.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:21.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:21.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:21.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:21.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:21 smithi007 bash[22722]: audit 2024-09-14T00:22:20.627333+0000 mgr.a (mgr.14355) 5252 : audit [DBG] from='client.122832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:21 smithi131 bash[24745]: audit 2024-09-14T00:22:20.627333+0000 mgr.a (mgr.14355) 5252 : audit [DBG] from='client.122832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:21 smithi171 bash[25040]: audit 2024-09-14T00:22:20.627333+0000 mgr.a (mgr.14355) 5252 : audit [DBG] from='client.122832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:22 smithi007 bash[22722]: cluster 2024-09-14T00:22:20.879045+0000 mgr.a (mgr.14355) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:22 smithi131 bash[24745]: cluster 2024-09-14T00:22:20.879045+0000 mgr.a (mgr.14355) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:22 smithi171 bash[25040]: cluster 2024-09-14T00:22:20.879045+0000 mgr.a (mgr.14355) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:24 smithi007 bash[22722]: cluster 2024-09-14T00:22:22.879924+0000 mgr.a (mgr.14355) 5254 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:24 smithi131 bash[24745]: cluster 2024-09-14T00:22:22.879924+0000 mgr.a (mgr.14355) 5254 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:24 smithi171 bash[25040]: cluster 2024-09-14T00:22:22.879924+0000 mgr.a (mgr.14355) 5254 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:26.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:26.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:26 smithi007 bash[22722]: cluster 2024-09-14T00:22:24.880703+0000 mgr.a (mgr.14355) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:26 smithi131 bash[24745]: cluster 2024-09-14T00:22:24.880703+0000 mgr.a (mgr.14355) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:26 smithi171 bash[25040]: cluster 2024-09-14T00:22:24.880703+0000 mgr.a (mgr.14355) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:22:26.801 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:26.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:27 smithi007 bash[22722]: audit 2024-09-14T00:22:26.370696+0000 mgr.a (mgr.14355) 5256 : audit [DBG] from='client.122910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:27 smithi131 bash[24745]: audit 2024-09-14T00:22:26.370696+0000 mgr.a (mgr.14355) 5256 : audit [DBG] from='client.122910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:27 smithi171 bash[25040]: audit 2024-09-14T00:22:26.370696+0000 mgr.a (mgr.14355) 5256 : audit [DBG] from='client.122910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:28 smithi007 bash[22722]: cluster 2024-09-14T00:22:26.882044+0000 mgr.a (mgr.14355) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:28 smithi131 bash[24745]: cluster 2024-09-14T00:22:26.882044+0000 mgr.a (mgr.14355) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:28 smithi171 bash[25040]: cluster 2024-09-14T00:22:26.882044+0000 mgr.a (mgr.14355) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:30 smithi007 bash[22722]: cluster 2024-09-14T00:22:28.882799+0000 mgr.a (mgr.14355) 5258 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:22:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:30 smithi131 bash[24745]: cluster 2024-09-14T00:22:28.882799+0000 mgr.a (mgr.14355) 5258 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:22:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:30 smithi171 bash[25040]: cluster 2024-09-14T00:22:28.882799+0000 mgr.a (mgr.14355) 5258 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:22:31.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:31.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:32.585 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:32.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:32.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:32.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:32.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:32 smithi007 bash[22722]: cluster 2024-09-14T00:22:30.884840+0000 mgr.a (mgr.14355) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:32 smithi131 bash[24745]: cluster 2024-09-14T00:22:30.884840+0000 mgr.a (mgr.14355) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:32 smithi171 bash[25040]: cluster 2024-09-14T00:22:30.884840+0000 mgr.a (mgr.14355) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:33 smithi007 bash[22722]: audit 2024-09-14T00:22:32.139047+0000 mgr.a (mgr.14355) 5260 : audit [DBG] from='client.122988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:33 smithi131 bash[24745]: audit 2024-09-14T00:22:32.139047+0000 mgr.a (mgr.14355) 5260 : audit [DBG] from='client.122988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:33 smithi171 bash[25040]: audit 2024-09-14T00:22:32.139047+0000 mgr.a (mgr.14355) 5260 : audit [DBG] from='client.122988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:34 smithi007 bash[22722]: cluster 2024-09-14T00:22:32.885746+0000 mgr.a (mgr.14355) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:34 smithi131 bash[24745]: cluster 2024-09-14T00:22:32.885746+0000 mgr.a (mgr.14355) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:34 smithi171 bash[25040]: cluster 2024-09-14T00:22:32.885746+0000 mgr.a (mgr.14355) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:36 smithi007 bash[22722]: cluster 2024-09-14T00:22:34.886532+0000 mgr.a (mgr.14355) 5262 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:36 smithi131 bash[24745]: cluster 2024-09-14T00:22:34.886532+0000 mgr.a (mgr.14355) 5262 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:36 smithi171 bash[25040]: cluster 2024-09-14T00:22:34.886532+0000 mgr.a (mgr.14355) 5262 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:37.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:37.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:37.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:38.379 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:38 smithi007 bash[22722]: cluster 2024-09-14T00:22:36.888792+0000 mgr.a (mgr.14355) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:22:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:38 smithi131 bash[24745]: cluster 2024-09-14T00:22:36.888792+0000 mgr.a (mgr.14355) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:38 smithi171 bash[25040]: cluster 2024-09-14T00:22:36.888792+0000 mgr.a (mgr.14355) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:22:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:37.923799+0000 mgr.a (mgr.14355) 5264 : audit [DBG] from='client.123060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:38.480508+0000 mon.a (mon.0) 1387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:39.089532+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:39.095277+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:39.101162+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:39 smithi007 bash[22722]: audit 2024-09-14T00:22:39.110810+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:37.923799+0000 mgr.a (mgr.14355) 5264 : audit [DBG] from='client.123060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:38.480508+0000 mon.a (mon.0) 1387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:39.089532+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:39.095277+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:39.101162+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:39 smithi131 bash[24745]: audit 2024-09-14T00:22:39.110810+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:37.923799+0000 mgr.a (mgr.14355) 5264 : audit [DBG] from='client.123060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:38.480508+0000 mon.a (mon.0) 1387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:39.089532+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:39.095277+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:39.101162+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:39 smithi171 bash[25040]: audit 2024-09-14T00:22:39.110810+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22722]: cluster 2024-09-14T00:22:38.889660+0000 mgr.a (mgr.14355) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22722]: audit 2024-09-14T00:22:39.907271+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:22:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22722]: audit 2024-09-14T00:22:39.909061+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:22:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22722]: audit 2024-09-14T00:22:39.919480+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22722]: audit 2024-09-14T00:22:39.922354+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:40 smithi131 bash[24745]: cluster 2024-09-14T00:22:38.889660+0000 mgr.a (mgr.14355) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:40 smithi131 bash[24745]: audit 2024-09-14T00:22:39.907271+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:22:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:40 smithi131 bash[24745]: audit 2024-09-14T00:22:39.909061+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:22:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:40 smithi131 bash[24745]: audit 2024-09-14T00:22:39.919480+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:40 smithi131 bash[24745]: audit 2024-09-14T00:22:39.922354+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:40 smithi171 bash[25040]: cluster 2024-09-14T00:22:38.889660+0000 mgr.a (mgr.14355) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:40 smithi171 bash[25040]: audit 2024-09-14T00:22:39.907271+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:40 smithi171 bash[25040]: audit 2024-09-14T00:22:39.909061+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:40 smithi171 bash[25040]: audit 2024-09-14T00:22:39.919480+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:40 smithi171 bash[25040]: audit 2024-09-14T00:22:39.922354+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22972]: debug 2024-09-14T00:22:40.648+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:22:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:22:40 smithi007 bash[22972]: debug 2024-09-14T00:22:40.652+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:22:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:41 smithi007 bash[22722]: audit 2024-09-14T00:22:39.923506+0000 mgr.a (mgr.14355) 5266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:41 smithi007 bash[22722]: audit 2024-09-14T00:22:40.653747+0000 mgr.a (mgr.14355) 5267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:22:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:41 smithi007 bash[22722]: cephadm 2024-09-14T00:22:40.655129+0000 mgr.a (mgr.14355) 5268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:22:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:41 smithi131 bash[24745]: audit 2024-09-14T00:22:39.923506+0000 mgr.a (mgr.14355) 5266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:41 smithi131 bash[24745]: audit 2024-09-14T00:22:40.653747+0000 mgr.a (mgr.14355) 5267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:22:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:41 smithi131 bash[24745]: cephadm 2024-09-14T00:22:40.655129+0000 mgr.a (mgr.14355) 5268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:22:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:41 smithi171 bash[25040]: audit 2024-09-14T00:22:39.923506+0000 mgr.a (mgr.14355) 5266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:22:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:41 smithi171 bash[25040]: audit 2024-09-14T00:22:40.653747+0000 mgr.a (mgr.14355) 5267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:22:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:41 smithi171 bash[25040]: cephadm 2024-09-14T00:22:40.655129+0000 mgr.a (mgr.14355) 5268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:22:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:42 smithi007 bash[22722]: cluster 2024-09-14T00:22:40.892340+0000 mgr.a (mgr.14355) 5269 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T00:22:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:42 smithi131 bash[24745]: cluster 2024-09-14T00:22:40.892340+0000 mgr.a (mgr.14355) 5269 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T00:22:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:42 smithi171 bash[25040]: cluster 2024-09-14T00:22:40.892340+0000 mgr.a (mgr.14355) 5269 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T00:22:43.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:43.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:44.160 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:44.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:44.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:44.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:44.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:44 smithi007 bash[22722]: cluster 2024-09-14T00:22:42.893123+0000 mgr.a (mgr.14355) 5270 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:44 smithi131 bash[24745]: cluster 2024-09-14T00:22:42.893123+0000 mgr.a (mgr.14355) 5270 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:44 smithi171 bash[25040]: cluster 2024-09-14T00:22:42.893123+0000 mgr.a (mgr.14355) 5270 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:45 smithi007 bash[22722]: audit 2024-09-14T00:22:43.716636+0000 mgr.a (mgr.14355) 5271 : audit [DBG] from='client.123240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:45 smithi131 bash[24745]: audit 2024-09-14T00:22:43.716636+0000 mgr.a (mgr.14355) 5271 : audit [DBG] from='client.123240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:45 smithi171 bash[25040]: audit 2024-09-14T00:22:43.716636+0000 mgr.a (mgr.14355) 5271 : audit [DBG] from='client.123240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:46 smithi007 bash[22722]: cluster 2024-09-14T00:22:44.894029+0000 mgr.a (mgr.14355) 5272 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:46 smithi131 bash[24745]: cluster 2024-09-14T00:22:44.894029+0000 mgr.a (mgr.14355) 5272 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:46 smithi171 bash[25040]: cluster 2024-09-14T00:22:44.894029+0000 mgr.a (mgr.14355) 5272 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:22:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:48 smithi007 bash[22722]: cluster 2024-09-14T00:22:46.896345+0000 mgr.a (mgr.14355) 5273 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:48 smithi131 bash[24745]: cluster 2024-09-14T00:22:46.896345+0000 mgr.a (mgr.14355) 5273 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:48 smithi171 bash[25040]: cluster 2024-09-14T00:22:46.896345+0000 mgr.a (mgr.14355) 5273 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:49.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:49.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:49.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:49.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:50 smithi007 bash[22722]: cluster 2024-09-14T00:22:48.897122+0000 mgr.a (mgr.14355) 5274 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:50 smithi007 bash[22722]: audit 2024-09-14T00:22:49.495563+0000 mgr.a (mgr.14355) 5275 : audit [DBG] from='client.123318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:50 smithi131 bash[24745]: cluster 2024-09-14T00:22:48.897122+0000 mgr.a (mgr.14355) 5274 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:50 smithi131 bash[24745]: audit 2024-09-14T00:22:49.495563+0000 mgr.a (mgr.14355) 5275 : audit [DBG] from='client.123318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:50 smithi171 bash[25040]: cluster 2024-09-14T00:22:48.897122+0000 mgr.a (mgr.14355) 5274 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:50 smithi171 bash[25040]: audit 2024-09-14T00:22:49.495563+0000 mgr.a (mgr.14355) 5275 : audit [DBG] from='client.123318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:52 smithi007 bash[22722]: cluster 2024-09-14T00:22:50.899540+0000 mgr.a (mgr.14355) 5276 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:52 smithi131 bash[24745]: cluster 2024-09-14T00:22:50.899540+0000 mgr.a (mgr.14355) 5276 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:52 smithi171 bash[25040]: cluster 2024-09-14T00:22:50.899540+0000 mgr.a (mgr.14355) 5276 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:22:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:54 smithi007 bash[22722]: cluster 2024-09-14T00:22:52.900311+0000 mgr.a (mgr.14355) 5277 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:54 smithi131 bash[24745]: cluster 2024-09-14T00:22:52.900311+0000 mgr.a (mgr.14355) 5277 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:54 smithi171 bash[25040]: cluster 2024-09-14T00:22:52.900311+0000 mgr.a (mgr.14355) 5277 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:54.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:22:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:22:54.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:22:55.704 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:22:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:22:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:22:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:22:55.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:22:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:56 smithi007 bash[22722]: cluster 2024-09-14T00:22:54.901087+0000 mgr.a (mgr.14355) 5278 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:56 smithi007 bash[22722]: audit 2024-09-14T00:22:55.267526+0000 mgr.a (mgr.14355) 5279 : audit [DBG] from='client.123396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:56 smithi131 bash[24745]: cluster 2024-09-14T00:22:54.901087+0000 mgr.a (mgr.14355) 5278 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:56 smithi131 bash[24745]: audit 2024-09-14T00:22:55.267526+0000 mgr.a (mgr.14355) 5279 : audit [DBG] from='client.123396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:56 smithi171 bash[25040]: cluster 2024-09-14T00:22:54.901087+0000 mgr.a (mgr.14355) 5278 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:56 smithi171 bash[25040]: audit 2024-09-14T00:22:55.267526+0000 mgr.a (mgr.14355) 5279 : audit [DBG] from='client.123396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:22:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:22:58 smithi007 bash[22722]: cluster 2024-09-14T00:22:56.903808+0000 mgr.a (mgr.14355) 5280 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:22:58 smithi131 bash[24745]: cluster 2024-09-14T00:22:56.903808+0000 mgr.a (mgr.14355) 5280 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:22:58.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:22:58 smithi171 bash[25040]: cluster 2024-09-14T00:22:56.903808+0000 mgr.a (mgr.14355) 5280 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:23:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:00 smithi007 bash[22722]: cluster 2024-09-14T00:22:58.904731+0000 mgr.a (mgr.14355) 5281 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:00.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:00.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:00.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:00 smithi131 bash[24745]: cluster 2024-09-14T00:22:58.904731+0000 mgr.a (mgr.14355) 5281 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:00 smithi171 bash[25040]: cluster 2024-09-14T00:22:58.904731+0000 mgr.a (mgr.14355) 5281 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:01.484 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:01.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:01.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:01.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:01.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:02 smithi007 bash[22722]: cluster 2024-09-14T00:23:00.906712+0000 mgr.a (mgr.14355) 5282 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:02 smithi007 bash[22722]: audit 2024-09-14T00:23:01.041847+0000 mgr.a (mgr.14355) 5283 : audit [DBG] from='client.123474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:02 smithi131 bash[24745]: cluster 2024-09-14T00:23:00.906712+0000 mgr.a (mgr.14355) 5282 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:02 smithi131 bash[24745]: audit 2024-09-14T00:23:01.041847+0000 mgr.a (mgr.14355) 5283 : audit [DBG] from='client.123474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:02 smithi171 bash[25040]: cluster 2024-09-14T00:23:00.906712+0000 mgr.a (mgr.14355) 5282 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:02 smithi171 bash[25040]: audit 2024-09-14T00:23:01.041847+0000 mgr.a (mgr.14355) 5283 : audit [DBG] from='client.123474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:04 smithi007 bash[22722]: cluster 2024-09-14T00:23:02.907577+0000 mgr.a (mgr.14355) 5284 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:04 smithi131 bash[24745]: cluster 2024-09-14T00:23:02.907577+0000 mgr.a (mgr.14355) 5284 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:04 smithi171 bash[25040]: cluster 2024-09-14T00:23:02.907577+0000 mgr.a (mgr.14355) 5284 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:06.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:06.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:06.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:06 smithi131 bash[24745]: cluster 2024-09-14T00:23:04.908392+0000 mgr.a (mgr.14355) 5285 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:23:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:06 smithi171 bash[25040]: cluster 2024-09-14T00:23:04.908392+0000 mgr.a (mgr.14355) 5285 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:23:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:06 smithi007 bash[22722]: cluster 2024-09-14T00:23:04.908392+0000 mgr.a (mgr.14355) 5285 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:23:07.244 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:07.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:08 smithi131 bash[24745]: audit 2024-09-14T00:23:06.818975+0000 mgr.a (mgr.14355) 5286 : audit [DBG] from='client.123546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:08 smithi131 bash[24745]: cluster 2024-09-14T00:23:06.909982+0000 mgr.a (mgr.14355) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:08 smithi171 bash[25040]: audit 2024-09-14T00:23:06.818975+0000 mgr.a (mgr.14355) 5286 : audit [DBG] from='client.123546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:08 smithi171 bash[25040]: cluster 2024-09-14T00:23:06.909982+0000 mgr.a (mgr.14355) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:08 smithi007 bash[22722]: audit 2024-09-14T00:23:06.818975+0000 mgr.a (mgr.14355) 5286 : audit [DBG] from='client.123546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:08 smithi007 bash[22722]: cluster 2024-09-14T00:23:06.909982+0000 mgr.a (mgr.14355) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:10 smithi131 bash[24745]: cluster 2024-09-14T00:23:08.910941+0000 mgr.a (mgr.14355) 5288 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:10 smithi171 bash[25040]: cluster 2024-09-14T00:23:08.910941+0000 mgr.a (mgr.14355) 5288 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:10 smithi007 bash[22722]: cluster 2024-09-14T00:23:08.910941+0000 mgr.a (mgr.14355) 5288 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:12 smithi131 bash[24745]: cluster 2024-09-14T00:23:10.913348+0000 mgr.a (mgr.14355) 5289 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:12 smithi171 bash[25040]: cluster 2024-09-14T00:23:10.913348+0000 mgr.a (mgr.14355) 5289 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:12 smithi007 bash[22722]: cluster 2024-09-14T00:23:10.913348+0000 mgr.a (mgr.14355) 5289 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:13.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:13.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:13 smithi131 bash[24745]: audit 2024-09-14T00:23:12.582524+0000 mgr.a (mgr.14355) 5290 : audit [DBG] from='client.123624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:13 smithi171 bash[25040]: audit 2024-09-14T00:23:12.582524+0000 mgr.a (mgr.14355) 5290 : audit [DBG] from='client.123624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:13 smithi007 bash[22722]: audit 2024-09-14T00:23:12.582524+0000 mgr.a (mgr.14355) 5290 : audit [DBG] from='client.123624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:14 smithi131 bash[24745]: cluster 2024-09-14T00:23:12.914180+0000 mgr.a (mgr.14355) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:14 smithi171 bash[25040]: cluster 2024-09-14T00:23:12.914180+0000 mgr.a (mgr.14355) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:14 smithi007 bash[22722]: cluster 2024-09-14T00:23:12.914180+0000 mgr.a (mgr.14355) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:16 smithi131 bash[24745]: cluster 2024-09-14T00:23:14.914948+0000 mgr.a (mgr.14355) 5292 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:16 smithi171 bash[25040]: cluster 2024-09-14T00:23:14.914948+0000 mgr.a (mgr.14355) 5292 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:16 smithi007 bash[22722]: cluster 2024-09-14T00:23:14.914948+0000 mgr.a (mgr.14355) 5292 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:18.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:18.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:18 smithi131 bash[24745]: cluster 2024-09-14T00:23:16.917161+0000 mgr.a (mgr.14355) 5293 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:18 smithi171 bash[25040]: cluster 2024-09-14T00:23:16.917161+0000 mgr.a (mgr.14355) 5293 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:18 smithi007 bash[22722]: cluster 2024-09-14T00:23:16.917161+0000 mgr.a (mgr.14355) 5293 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:19 smithi131 bash[24745]: audit 2024-09-14T00:23:18.352445+0000 mgr.a (mgr.14355) 5294 : audit [DBG] from='client.123702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:19 smithi171 bash[25040]: audit 2024-09-14T00:23:18.352445+0000 mgr.a (mgr.14355) 5294 : audit [DBG] from='client.123702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:19 smithi007 bash[22722]: audit 2024-09-14T00:23:18.352445+0000 mgr.a (mgr.14355) 5294 : audit [DBG] from='client.123702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:20 smithi131 bash[24745]: cluster 2024-09-14T00:23:18.918117+0000 mgr.a (mgr.14355) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:20 smithi171 bash[25040]: cluster 2024-09-14T00:23:18.918117+0000 mgr.a (mgr.14355) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:20 smithi007 bash[22722]: cluster 2024-09-14T00:23:18.918117+0000 mgr.a (mgr.14355) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:22 smithi131 bash[24745]: cluster 2024-09-14T00:23:20.920353+0000 mgr.a (mgr.14355) 5296 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:22 smithi171 bash[25040]: cluster 2024-09-14T00:23:20.920353+0000 mgr.a (mgr.14355) 5296 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:22 smithi007 bash[22722]: cluster 2024-09-14T00:23:20.920353+0000 mgr.a (mgr.14355) 5296 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:23.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:24.505 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:24.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:24 smithi131 bash[24745]: cluster 2024-09-14T00:23:22.921115+0000 mgr.a (mgr.14355) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:24 smithi171 bash[25040]: cluster 2024-09-14T00:23:22.921115+0000 mgr.a (mgr.14355) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:24 smithi007 bash[22722]: cluster 2024-09-14T00:23:22.921115+0000 mgr.a (mgr.14355) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:25 smithi131 bash[24745]: audit 2024-09-14T00:23:24.082247+0000 mgr.a (mgr.14355) 5298 : audit [DBG] from='client.123777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:25 smithi171 bash[25040]: audit 2024-09-14T00:23:24.082247+0000 mgr.a (mgr.14355) 5298 : audit [DBG] from='client.123777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:25 smithi007 bash[22722]: audit 2024-09-14T00:23:24.082247+0000 mgr.a (mgr.14355) 5298 : audit [DBG] from='client.123777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:26 smithi131 bash[24745]: cluster 2024-09-14T00:23:24.922209+0000 mgr.a (mgr.14355) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:26 smithi171 bash[25040]: cluster 2024-09-14T00:23:24.922209+0000 mgr.a (mgr.14355) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:26 smithi007 bash[22722]: cluster 2024-09-14T00:23:24.922209+0000 mgr.a (mgr.14355) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:28 smithi131 bash[24745]: cluster 2024-09-14T00:23:26.924539+0000 mgr.a (mgr.14355) 5300 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:28 smithi171 bash[25040]: cluster 2024-09-14T00:23:26.924539+0000 mgr.a (mgr.14355) 5300 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:28 smithi007 bash[22722]: cluster 2024-09-14T00:23:26.924539+0000 mgr.a (mgr.14355) 5300 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:23:29.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:29.507 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:29.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:30.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:30 smithi131 bash[24745]: cluster 2024-09-14T00:23:28.925301+0000 mgr.a (mgr.14355) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:30 smithi171 bash[25040]: cluster 2024-09-14T00:23:28.925301+0000 mgr.a (mgr.14355) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:30 smithi007 bash[22722]: cluster 2024-09-14T00:23:28.925301+0000 mgr.a (mgr.14355) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:31 smithi171 bash[25040]: audit 2024-09-14T00:23:29.835261+0000 mgr.a (mgr.14355) 5302 : audit [DBG] from='client.123855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:31 smithi007 bash[22722]: audit 2024-09-14T00:23:29.835261+0000 mgr.a (mgr.14355) 5302 : audit [DBG] from='client.123855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:31 smithi131 bash[24745]: audit 2024-09-14T00:23:29.835261+0000 mgr.a (mgr.14355) 5302 : audit [DBG] from='client.123855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:32 smithi171 bash[25040]: cluster 2024-09-14T00:23:30.927818+0000 mgr.a (mgr.14355) 5303 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:32 smithi007 bash[22722]: cluster 2024-09-14T00:23:30.927818+0000 mgr.a (mgr.14355) 5303 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:32 smithi131 bash[24745]: cluster 2024-09-14T00:23:30.927818+0000 mgr.a (mgr.14355) 5303 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:23:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:34 smithi171 bash[25040]: cluster 2024-09-14T00:23:32.928580+0000 mgr.a (mgr.14355) 5304 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:34 smithi007 bash[22722]: cluster 2024-09-14T00:23:32.928580+0000 mgr.a (mgr.14355) 5304 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:34 smithi131 bash[24745]: cluster 2024-09-14T00:23:32.928580+0000 mgr.a (mgr.14355) 5304 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:35.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:35.996 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:35.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:36 smithi171 bash[25040]: cluster 2024-09-14T00:23:34.929338+0000 mgr.a (mgr.14355) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:36 smithi171 bash[25040]: audit 2024-09-14T00:23:35.579953+0000 mgr.a (mgr.14355) 5306 : audit [DBG] from='client.123933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:36 smithi007 bash[22722]: cluster 2024-09-14T00:23:34.929338+0000 mgr.a (mgr.14355) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:36 smithi007 bash[22722]: audit 2024-09-14T00:23:35.579953+0000 mgr.a (mgr.14355) 5306 : audit [DBG] from='client.123933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:36 smithi131 bash[24745]: cluster 2024-09-14T00:23:34.929338+0000 mgr.a (mgr.14355) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:23:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:36 smithi131 bash[24745]: audit 2024-09-14T00:23:35.579953+0000 mgr.a (mgr.14355) 5306 : audit [DBG] from='client.123933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:38 smithi007 bash[22722]: cluster 2024-09-14T00:23:36.932145+0000 mgr.a (mgr.14355) 5307 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:38 smithi131 bash[24745]: cluster 2024-09-14T00:23:36.932145+0000 mgr.a (mgr.14355) 5307 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:38 smithi171 bash[25040]: cluster 2024-09-14T00:23:36.932145+0000 mgr.a (mgr.14355) 5307 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:40 smithi007 bash[22722]: cluster 2024-09-14T00:23:38.932926+0000 mgr.a (mgr.14355) 5308 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:40.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:40.998 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:40.998 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:40 smithi131 bash[24745]: cluster 2024-09-14T00:23:38.932926+0000 mgr.a (mgr.14355) 5308 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:40 smithi171 bash[25040]: cluster 2024-09-14T00:23:38.932926+0000 mgr.a (mgr.14355) 5308 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:23:41.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:41.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:41.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:41.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:41.770 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:41 smithi007 bash[22722]: audit 2024-09-14T00:23:40.706336+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:23:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:41 smithi131 bash[24745]: audit 2024-09-14T00:23:40.706336+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:23:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:41 smithi171 bash[25040]: audit 2024-09-14T00:23:40.706336+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:23:42.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22972]: debug 2024-09-14T00:23:42.799+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:23:42.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22972]: debug 2024-09-14T00:23:42.799+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: cluster 2024-09-14T00:23:40.934919+0000 mgr.a (mgr.14355) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:41.326392+0000 mgr.a (mgr.14355) 5310 : audit [DBG] from='client.124011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.051686+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.056946+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.061591+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.065770+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.076487+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.080416+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.081452+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:23:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.082444+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:23:42.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.087032+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:42.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:42 smithi007 bash[22722]: audit 2024-09-14T00:23:42.089253+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: cluster 2024-09-14T00:23:40.934919+0000 mgr.a (mgr.14355) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:41.326392+0000 mgr.a (mgr.14355) 5310 : audit [DBG] from='client.124011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.051686+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.056946+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.061591+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.065770+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.076487+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.080416+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.081452+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.082444+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.087032+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:42 smithi131 bash[24745]: audit 2024-09-14T00:23:42.089253+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: cluster 2024-09-14T00:23:40.934919+0000 mgr.a (mgr.14355) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:41.326392+0000 mgr.a (mgr.14355) 5310 : audit [DBG] from='client.124011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.051686+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.056946+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.061591+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.065770+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.076487+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.080416+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.081452+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.082444+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:23:43.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.087032+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:23:43.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:42 smithi171 bash[25040]: audit 2024-09-14T00:23:42.089253+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:43 smithi007 bash[22722]: audit 2024-09-14T00:23:42.090688+0000 mgr.a (mgr.14355) 5311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:43 smithi131 bash[24745]: audit 2024-09-14T00:23:42.090688+0000 mgr.a (mgr.14355) 5311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:43 smithi171 bash[25040]: audit 2024-09-14T00:23:42.090688+0000 mgr.a (mgr.14355) 5311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:23:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:44 smithi007 bash[22722]: audit 2024-09-14T00:23:42.803608+0000 mgr.a (mgr.14355) 5312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:23:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:44 smithi007 bash[22722]: cephadm 2024-09-14T00:23:42.805337+0000 mgr.a (mgr.14355) 5313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:23:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:44 smithi007 bash[22722]: cluster 2024-09-14T00:23:42.935988+0000 mgr.a (mgr.14355) 5314 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:44 smithi131 bash[24745]: audit 2024-09-14T00:23:42.803608+0000 mgr.a (mgr.14355) 5312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:23:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:44 smithi131 bash[24745]: cephadm 2024-09-14T00:23:42.805337+0000 mgr.a (mgr.14355) 5313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:23:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:44 smithi131 bash[24745]: cluster 2024-09-14T00:23:42.935988+0000 mgr.a (mgr.14355) 5314 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:44 smithi171 bash[25040]: audit 2024-09-14T00:23:42.803608+0000 mgr.a (mgr.14355) 5312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:23:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:44 smithi171 bash[25040]: cephadm 2024-09-14T00:23:42.805337+0000 mgr.a (mgr.14355) 5313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:23:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:44 smithi171 bash[25040]: cluster 2024-09-14T00:23:42.935988+0000 mgr.a (mgr.14355) 5314 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:46.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:46.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:46 smithi007 bash[22722]: cluster 2024-09-14T00:23:44.936827+0000 mgr.a (mgr.14355) 5315 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:46 smithi131 bash[24745]: cluster 2024-09-14T00:23:44.936827+0000 mgr.a (mgr.14355) 5315 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:46 smithi171 bash[25040]: cluster 2024-09-14T00:23:44.936827+0000 mgr.a (mgr.14355) 5315 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:23:47.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:47.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:48 smithi007 bash[22722]: cluster 2024-09-14T00:23:46.939024+0000 mgr.a (mgr.14355) 5316 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:48 smithi007 bash[22722]: audit 2024-09-14T00:23:47.102242+0000 mgr.a (mgr.14355) 5317 : audit [DBG] from='client.124197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:48 smithi131 bash[24745]: cluster 2024-09-14T00:23:46.939024+0000 mgr.a (mgr.14355) 5316 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:48 smithi131 bash[24745]: audit 2024-09-14T00:23:47.102242+0000 mgr.a (mgr.14355) 5317 : audit [DBG] from='client.124197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:48 smithi171 bash[25040]: cluster 2024-09-14T00:23:46.939024+0000 mgr.a (mgr.14355) 5316 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:48 smithi171 bash[25040]: audit 2024-09-14T00:23:47.102242+0000 mgr.a (mgr.14355) 5317 : audit [DBG] from='client.124197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:50 smithi007 bash[22722]: cluster 2024-09-14T00:23:48.940004+0000 mgr.a (mgr.14355) 5318 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:50 smithi131 bash[24745]: cluster 2024-09-14T00:23:48.940004+0000 mgr.a (mgr.14355) 5318 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:50 smithi171 bash[25040]: cluster 2024-09-14T00:23:48.940004+0000 mgr.a (mgr.14355) 5318 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:52.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:52 smithi007 bash[22722]: cluster 2024-09-14T00:23:50.942237+0000 mgr.a (mgr.14355) 5319 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:52 smithi131 bash[24745]: cluster 2024-09-14T00:23:50.942237+0000 mgr.a (mgr.14355) 5319 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:52 smithi171 bash[25040]: cluster 2024-09-14T00:23:50.942237+0000 mgr.a (mgr.14355) 5319 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:53.300 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:53.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:53.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:53.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:53.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:54 smithi007 bash[22722]: audit 2024-09-14T00:23:52.863860+0000 mgr.a (mgr.14355) 5320 : audit [DBG] from='client.124272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:54 smithi007 bash[22722]: cluster 2024-09-14T00:23:52.942851+0000 mgr.a (mgr.14355) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:54 smithi131 bash[24745]: audit 2024-09-14T00:23:52.863860+0000 mgr.a (mgr.14355) 5320 : audit [DBG] from='client.124272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:54 smithi131 bash[24745]: cluster 2024-09-14T00:23:52.942851+0000 mgr.a (mgr.14355) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:54 smithi171 bash[25040]: audit 2024-09-14T00:23:52.863860+0000 mgr.a (mgr.14355) 5320 : audit [DBG] from='client.124272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:23:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:54 smithi171 bash[25040]: cluster 2024-09-14T00:23:52.942851+0000 mgr.a (mgr.14355) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:56 smithi007 bash[22722]: cluster 2024-09-14T00:23:54.943803+0000 mgr.a (mgr.14355) 5322 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:56 smithi131 bash[24745]: cluster 2024-09-14T00:23:54.943803+0000 mgr.a (mgr.14355) 5322 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:56 smithi171 bash[25040]: cluster 2024-09-14T00:23:54.943803+0000 mgr.a (mgr.14355) 5322 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:23:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:23:58.303 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:23:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:58 smithi007 bash[22722]: cluster 2024-09-14T00:23:56.946131+0000 mgr.a (mgr.14355) 5323 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:58 smithi131 bash[24745]: cluster 2024-09-14T00:23:56.946131+0000 mgr.a (mgr.14355) 5323 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:58 smithi171 bash[25040]: cluster 2024-09-14T00:23:56.946131+0000 mgr.a (mgr.14355) 5323 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:23:59.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:23:59.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:23:59.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:23:59.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:23:59.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:23:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:23:59 smithi007 bash[22722]: audit 2024-09-14T00:23:58.638282+0000 mgr.a (mgr.14355) 5324 : audit [DBG] from='client.124350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:23:59 smithi131 bash[24745]: audit 2024-09-14T00:23:58.638282+0000 mgr.a (mgr.14355) 5324 : audit [DBG] from='client.124350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:23:59 smithi171 bash[25040]: audit 2024-09-14T00:23:58.638282+0000 mgr.a (mgr.14355) 5324 : audit [DBG] from='client.124350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:00 smithi007 bash[22722]: cluster 2024-09-14T00:23:58.946692+0000 mgr.a (mgr.14355) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:00 smithi131 bash[24745]: cluster 2024-09-14T00:23:58.946692+0000 mgr.a (mgr.14355) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:00 smithi171 bash[25040]: cluster 2024-09-14T00:23:58.946692+0000 mgr.a (mgr.14355) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:02 smithi007 bash[22722]: cluster 2024-09-14T00:24:00.949127+0000 mgr.a (mgr.14355) 5326 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:02 smithi131 bash[24745]: cluster 2024-09-14T00:24:00.949127+0000 mgr.a (mgr.14355) 5326 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:02 smithi171 bash[25040]: cluster 2024-09-14T00:24:00.949127+0000 mgr.a (mgr.14355) 5326 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:04.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:04.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:04.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:04 smithi007 bash[22722]: cluster 2024-09-14T00:24:02.950053+0000 mgr.a (mgr.14355) 5327 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:04 smithi131 bash[24745]: cluster 2024-09-14T00:24:02.950053+0000 mgr.a (mgr.14355) 5327 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:04 smithi171 bash[25040]: cluster 2024-09-14T00:24:02.950053+0000 mgr.a (mgr.14355) 5327 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:05 smithi007 bash[22722]: audit 2024-09-14T00:24:04.415912+0000 mgr.a (mgr.14355) 5328 : audit [DBG] from='client.124428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:05 smithi131 bash[24745]: audit 2024-09-14T00:24:04.415912+0000 mgr.a (mgr.14355) 5328 : audit [DBG] from='client.124428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:05 smithi171 bash[25040]: audit 2024-09-14T00:24:04.415912+0000 mgr.a (mgr.14355) 5328 : audit [DBG] from='client.124428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:06 smithi007 bash[22722]: cluster 2024-09-14T00:24:04.951021+0000 mgr.a (mgr.14355) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:06 smithi131 bash[24745]: cluster 2024-09-14T00:24:04.951021+0000 mgr.a (mgr.14355) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:06 smithi171 bash[25040]: cluster 2024-09-14T00:24:04.951021+0000 mgr.a (mgr.14355) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:08 smithi007 bash[22722]: cluster 2024-09-14T00:24:06.953320+0000 mgr.a (mgr.14355) 5330 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:08 smithi131 bash[24745]: cluster 2024-09-14T00:24:06.953320+0000 mgr.a (mgr.14355) 5330 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:08 smithi171 bash[25040]: cluster 2024-09-14T00:24:06.953320+0000 mgr.a (mgr.14355) 5330 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:09.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:09.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:09.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:10.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:10.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:10 smithi007 bash[22722]: cluster 2024-09-14T00:24:08.954117+0000 mgr.a (mgr.14355) 5331 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:10 smithi131 bash[24745]: cluster 2024-09-14T00:24:08.954117+0000 mgr.a (mgr.14355) 5331 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:10 smithi171 bash[25040]: cluster 2024-09-14T00:24:08.954117+0000 mgr.a (mgr.14355) 5331 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:11 smithi007 bash[22722]: audit 2024-09-14T00:24:10.196197+0000 mgr.a (mgr.14355) 5332 : audit [DBG] from='client.124506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:11 smithi131 bash[24745]: audit 2024-09-14T00:24:10.196197+0000 mgr.a (mgr.14355) 5332 : audit [DBG] from='client.124506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:11 smithi171 bash[25040]: audit 2024-09-14T00:24:10.196197+0000 mgr.a (mgr.14355) 5332 : audit [DBG] from='client.124506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:12 smithi007 bash[22722]: cluster 2024-09-14T00:24:10.956872+0000 mgr.a (mgr.14355) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:12 smithi131 bash[24745]: cluster 2024-09-14T00:24:10.956872+0000 mgr.a (mgr.14355) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:12 smithi171 bash[25040]: cluster 2024-09-14T00:24:10.956872+0000 mgr.a (mgr.14355) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:14 smithi007 bash[22722]: cluster 2024-09-14T00:24:12.957666+0000 mgr.a (mgr.14355) 5334 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:14 smithi131 bash[24745]: cluster 2024-09-14T00:24:12.957666+0000 mgr.a (mgr.14355) 5334 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:14 smithi171 bash[25040]: cluster 2024-09-14T00:24:12.957666+0000 mgr.a (mgr.14355) 5334 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:15.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:15.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:16.411 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:16.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:16 smithi007 bash[22722]: cluster 2024-09-14T00:24:14.958450+0000 mgr.a (mgr.14355) 5335 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:24:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:16 smithi131 bash[24745]: cluster 2024-09-14T00:24:14.958450+0000 mgr.a (mgr.14355) 5335 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:24:17.115 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:16 smithi171 bash[25040]: cluster 2024-09-14T00:24:14.958450+0000 mgr.a (mgr.14355) 5335 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:24:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:17 smithi007 bash[22722]: audit 2024-09-14T00:24:15.969933+0000 mgr.a (mgr.14355) 5336 : audit [DBG] from='client.124584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:17 smithi131 bash[24745]: audit 2024-09-14T00:24:15.969933+0000 mgr.a (mgr.14355) 5336 : audit [DBG] from='client.124584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:17 smithi171 bash[25040]: audit 2024-09-14T00:24:15.969933+0000 mgr.a (mgr.14355) 5336 : audit [DBG] from='client.124584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:18 smithi007 bash[22722]: cluster 2024-09-14T00:24:16.961238+0000 mgr.a (mgr.14355) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:18 smithi131 bash[24745]: cluster 2024-09-14T00:24:16.961238+0000 mgr.a (mgr.14355) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:18 smithi171 bash[25040]: cluster 2024-09-14T00:24:16.961238+0000 mgr.a (mgr.14355) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:20 smithi007 bash[22722]: cluster 2024-09-14T00:24:18.962028+0000 mgr.a (mgr.14355) 5338 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:20 smithi131 bash[24745]: cluster 2024-09-14T00:24:18.962028+0000 mgr.a (mgr.14355) 5338 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:20 smithi171 bash[25040]: cluster 2024-09-14T00:24:18.962028+0000 mgr.a (mgr.14355) 5338 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:24:21.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:21.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:22.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:22.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:22.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:22 smithi007 bash[22722]: cluster 2024-09-14T00:24:20.964049+0000 mgr.a (mgr.14355) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:22 smithi131 bash[24745]: cluster 2024-09-14T00:24:20.964049+0000 mgr.a (mgr.14355) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:22 smithi171 bash[25040]: cluster 2024-09-14T00:24:20.964049+0000 mgr.a (mgr.14355) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:23 smithi007 bash[22722]: audit 2024-09-14T00:24:21.744383+0000 mgr.a (mgr.14355) 5340 : audit [DBG] from='client.124659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:23 smithi131 bash[24745]: audit 2024-09-14T00:24:21.744383+0000 mgr.a (mgr.14355) 5340 : audit [DBG] from='client.124659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:23 smithi171 bash[25040]: audit 2024-09-14T00:24:21.744383+0000 mgr.a (mgr.14355) 5340 : audit [DBG] from='client.124659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:24 smithi007 bash[22722]: cluster 2024-09-14T00:24:22.964992+0000 mgr.a (mgr.14355) 5341 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:24 smithi131 bash[24745]: cluster 2024-09-14T00:24:22.964992+0000 mgr.a (mgr.14355) 5341 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:24 smithi171 bash[25040]: cluster 2024-09-14T00:24:22.964992+0000 mgr.a (mgr.14355) 5341 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:26 smithi007 bash[22722]: cluster 2024-09-14T00:24:24.965796+0000 mgr.a (mgr.14355) 5342 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:26 smithi131 bash[24745]: cluster 2024-09-14T00:24:24.965796+0000 mgr.a (mgr.14355) 5342 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:26 smithi171 bash[25040]: cluster 2024-09-14T00:24:24.965796+0000 mgr.a (mgr.14355) 5342 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:27.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:27.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:27.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:27.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:27.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:28 smithi007 bash[22722]: cluster 2024-09-14T00:24:26.968078+0000 mgr.a (mgr.14355) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:28 smithi007 bash[22722]: audit 2024-09-14T00:24:27.494377+0000 mgr.a (mgr.14355) 5344 : audit [DBG] from='client.124737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:28 smithi131 bash[24745]: cluster 2024-09-14T00:24:26.968078+0000 mgr.a (mgr.14355) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:28 smithi131 bash[24745]: audit 2024-09-14T00:24:27.494377+0000 mgr.a (mgr.14355) 5344 : audit [DBG] from='client.124737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:28 smithi171 bash[25040]: cluster 2024-09-14T00:24:26.968078+0000 mgr.a (mgr.14355) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:28 smithi171 bash[25040]: audit 2024-09-14T00:24:27.494377+0000 mgr.a (mgr.14355) 5344 : audit [DBG] from='client.124737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:30 smithi007 bash[22722]: cluster 2024-09-14T00:24:28.969050+0000 mgr.a (mgr.14355) 5345 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:30 smithi131 bash[24745]: cluster 2024-09-14T00:24:28.969050+0000 mgr.a (mgr.14355) 5345 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:30 smithi171 bash[25040]: cluster 2024-09-14T00:24:28.969050+0000 mgr.a (mgr.14355) 5345 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:32.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:32.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:32.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:32 smithi131 bash[24745]: cluster 2024-09-14T00:24:30.971312+0000 mgr.a (mgr.14355) 5346 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:32 smithi171 bash[25040]: cluster 2024-09-14T00:24:30.971312+0000 mgr.a (mgr.14355) 5346 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:32 smithi007 bash[22722]: cluster 2024-09-14T00:24:30.971312+0000 mgr.a (mgr.14355) 5346 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:33.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:33.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:33.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:34 smithi131 bash[24745]: cluster 2024-09-14T00:24:32.972065+0000 mgr.a (mgr.14355) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:34 smithi131 bash[24745]: audit 2024-09-14T00:24:33.234658+0000 mgr.a (mgr.14355) 5348 : audit [DBG] from='client.124815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:34 smithi171 bash[25040]: cluster 2024-09-14T00:24:32.972065+0000 mgr.a (mgr.14355) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:34 smithi171 bash[25040]: audit 2024-09-14T00:24:33.234658+0000 mgr.a (mgr.14355) 5348 : audit [DBG] from='client.124815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:34 smithi007 bash[22722]: cluster 2024-09-14T00:24:32.972065+0000 mgr.a (mgr.14355) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:34 smithi007 bash[22722]: audit 2024-09-14T00:24:33.234658+0000 mgr.a (mgr.14355) 5348 : audit [DBG] from='client.124815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:36 smithi131 bash[24745]: cluster 2024-09-14T00:24:34.972932+0000 mgr.a (mgr.14355) 5349 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:36 smithi171 bash[25040]: cluster 2024-09-14T00:24:34.972932+0000 mgr.a (mgr.14355) 5349 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:36 smithi007 bash[22722]: cluster 2024-09-14T00:24:34.972932+0000 mgr.a (mgr.14355) 5349 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:38.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:38.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:38 smithi131 bash[24745]: cluster 2024-09-14T00:24:36.975196+0000 mgr.a (mgr.14355) 5350 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:38 smithi171 bash[25040]: cluster 2024-09-14T00:24:36.975196+0000 mgr.a (mgr.14355) 5350 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:38 smithi007 bash[22722]: cluster 2024-09-14T00:24:36.975196+0000 mgr.a (mgr.14355) 5350 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:39.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:40 smithi131 bash[24745]: cluster 2024-09-14T00:24:38.975928+0000 mgr.a (mgr.14355) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:40 smithi131 bash[24745]: audit 2024-09-14T00:24:38.989847+0000 mgr.a (mgr.14355) 5352 : audit [DBG] from='client.124893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:40 smithi171 bash[25040]: cluster 2024-09-14T00:24:38.975928+0000 mgr.a (mgr.14355) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:40 smithi171 bash[25040]: audit 2024-09-14T00:24:38.989847+0000 mgr.a (mgr.14355) 5352 : audit [DBG] from='client.124893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:40 smithi007 bash[22722]: cluster 2024-09-14T00:24:38.975928+0000 mgr.a (mgr.14355) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:40 smithi007 bash[22722]: audit 2024-09-14T00:24:38.989847+0000 mgr.a (mgr.14355) 5352 : audit [DBG] from='client.124893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:42 smithi131 bash[24745]: cluster 2024-09-14T00:24:40.978259+0000 mgr.a (mgr.14355) 5353 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:42 smithi171 bash[25040]: cluster 2024-09-14T00:24:40.978259+0000 mgr.a (mgr.14355) 5353 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:42 smithi007 bash[22722]: cluster 2024-09-14T00:24:40.978259+0000 mgr.a (mgr.14355) 5353 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:24:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:43 smithi131 bash[24745]: audit 2024-09-14T00:24:42.870701+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:24:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:43 smithi131 bash[24745]: audit 2024-09-14T00:24:43.693476+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:24:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:43 smithi131 bash[24745]: audit 2024-09-14T00:24:43.695140+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:24:44.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:43 smithi131 bash[24745]: audit 2024-09-14T00:24:43.705316+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:24:44.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:43 smithi131 bash[24745]: audit 2024-09-14T00:24:43.710191+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:43 smithi171 bash[25040]: audit 2024-09-14T00:24:42.870701+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:24:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:43 smithi171 bash[25040]: audit 2024-09-14T00:24:43.693476+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:24:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:43 smithi171 bash[25040]: audit 2024-09-14T00:24:43.695140+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:24:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:43 smithi171 bash[25040]: audit 2024-09-14T00:24:43.705316+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:24:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:43 smithi171 bash[25040]: audit 2024-09-14T00:24:43.710191+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:43 smithi007 bash[22722]: audit 2024-09-14T00:24:42.870701+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:24:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:43 smithi007 bash[22722]: audit 2024-09-14T00:24:43.693476+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:24:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:43 smithi007 bash[22722]: audit 2024-09-14T00:24:43.695140+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:24:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:43 smithi007 bash[22722]: audit 2024-09-14T00:24:43.705316+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:24:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:43 smithi007 bash[22722]: audit 2024-09-14T00:24:43.710191+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:44.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:44.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:44.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:44.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:24:44 smithi007 bash[22972]: debug 2024-09-14T00:24:44.446+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:24:44.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:24:44 smithi007 bash[22972]: debug 2024-09-14T00:24:44.446+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:24:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:44 smithi131 bash[24745]: cluster 2024-09-14T00:24:42.978804+0000 mgr.a (mgr.14355) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:44 smithi131 bash[24745]: audit 2024-09-14T00:24:43.712487+0000 mgr.a (mgr.14355) 5355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:44 smithi171 bash[25040]: cluster 2024-09-14T00:24:42.978804+0000 mgr.a (mgr.14355) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:44 smithi171 bash[25040]: audit 2024-09-14T00:24:43.712487+0000 mgr.a (mgr.14355) 5355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:45.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:44 smithi007 bash[22722]: cluster 2024-09-14T00:24:42.978804+0000 mgr.a (mgr.14355) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:44 smithi007 bash[22722]: audit 2024-09-14T00:24:43.712487+0000 mgr.a (mgr.14355) 5355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:24:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:45 smithi131 bash[24745]: audit 2024-09-14T00:24:44.451291+0000 mgr.a (mgr.14355) 5356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:24:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:45 smithi131 bash[24745]: cephadm 2024-09-14T00:24:44.452690+0000 mgr.a (mgr.14355) 5357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:24:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:45 smithi131 bash[24745]: audit 2024-09-14T00:24:44.729994+0000 mgr.a (mgr.14355) 5358 : audit [DBG] from='client.125076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:45 smithi171 bash[25040]: audit 2024-09-14T00:24:44.451291+0000 mgr.a (mgr.14355) 5356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:24:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:45 smithi171 bash[25040]: cephadm 2024-09-14T00:24:44.452690+0000 mgr.a (mgr.14355) 5357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:24:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:45 smithi171 bash[25040]: audit 2024-09-14T00:24:44.729994+0000 mgr.a (mgr.14355) 5358 : audit [DBG] from='client.125076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:45 smithi007 bash[22722]: audit 2024-09-14T00:24:44.451291+0000 mgr.a (mgr.14355) 5356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:24:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:45 smithi007 bash[22722]: cephadm 2024-09-14T00:24:44.452690+0000 mgr.a (mgr.14355) 5357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:24:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:45 smithi007 bash[22722]: audit 2024-09-14T00:24:44.729994+0000 mgr.a (mgr.14355) 5358 : audit [DBG] from='client.125076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:46 smithi131 bash[24745]: cluster 2024-09-14T00:24:44.979290+0000 mgr.a (mgr.14355) 5359 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:46 smithi171 bash[25040]: cluster 2024-09-14T00:24:44.979290+0000 mgr.a (mgr.14355) 5359 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:46 smithi007 bash[22722]: cluster 2024-09-14T00:24:44.979290+0000 mgr.a (mgr.14355) 5359 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:24:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:47 smithi131 bash[24745]: cluster 2024-09-14T00:24:46.981661+0000 mgr.a (mgr.14355) 5360 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:47 smithi171 bash[25040]: cluster 2024-09-14T00:24:46.981661+0000 mgr.a (mgr.14355) 5360 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:47 smithi007 bash[22722]: cluster 2024-09-14T00:24:46.981661+0000 mgr.a (mgr.14355) 5360 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:50.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:50 smithi171 bash[25040]: cluster 2024-09-14T00:24:48.982513+0000 mgr.a (mgr.14355) 5361 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:50 smithi007 bash[22722]: cluster 2024-09-14T00:24:48.982513+0000 mgr.a (mgr.14355) 5361 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:50 smithi131 bash[24745]: cluster 2024-09-14T00:24:48.982513+0000 mgr.a (mgr.14355) 5361 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:50.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:50.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:51 smithi007 bash[22722]: audit 2024-09-14T00:24:50.467192+0000 mgr.a (mgr.14355) 5362 : audit [DBG] from='client.125154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:51 smithi131 bash[24745]: audit 2024-09-14T00:24:50.467192+0000 mgr.a (mgr.14355) 5362 : audit [DBG] from='client.125154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:51 smithi171 bash[25040]: audit 2024-09-14T00:24:50.467192+0000 mgr.a (mgr.14355) 5362 : audit [DBG] from='client.125154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:52 smithi007 bash[22722]: cluster 2024-09-14T00:24:50.985332+0000 mgr.a (mgr.14355) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:52 smithi131 bash[24745]: cluster 2024-09-14T00:24:50.985332+0000 mgr.a (mgr.14355) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:52 smithi171 bash[25040]: cluster 2024-09-14T00:24:50.985332+0000 mgr.a (mgr.14355) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:54 smithi007 bash[22722]: cluster 2024-09-14T00:24:52.986123+0000 mgr.a (mgr.14355) 5364 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:54 smithi131 bash[24745]: cluster 2024-09-14T00:24:52.986123+0000 mgr.a (mgr.14355) 5364 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:54 smithi171 bash[25040]: cluster 2024-09-14T00:24:52.986123+0000 mgr.a (mgr.14355) 5364 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:55.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:24:55.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:24:55.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:24:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:56 smithi007 bash[22722]: cluster 2024-09-14T00:24:54.986872+0000 mgr.a (mgr.14355) 5365 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:56 smithi131 bash[24745]: cluster 2024-09-14T00:24:54.986872+0000 mgr.a (mgr.14355) 5365 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:56 smithi171 bash[25040]: cluster 2024-09-14T00:24:54.986872+0000 mgr.a (mgr.14355) 5365 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:24:56.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:24:56.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:24:56.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:24:56.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:24:56.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:24:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:57 smithi007 bash[22722]: audit 2024-09-14T00:24:56.221890+0000 mgr.a (mgr.14355) 5366 : audit [DBG] from='client.125226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:57 smithi131 bash[24745]: audit 2024-09-14T00:24:56.221890+0000 mgr.a (mgr.14355) 5366 : audit [DBG] from='client.125226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:57 smithi171 bash[25040]: audit 2024-09-14T00:24:56.221890+0000 mgr.a (mgr.14355) 5366 : audit [DBG] from='client.125226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:24:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:24:58 smithi007 bash[22722]: cluster 2024-09-14T00:24:56.989702+0000 mgr.a (mgr.14355) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:24:58 smithi131 bash[24745]: cluster 2024-09-14T00:24:56.989702+0000 mgr.a (mgr.14355) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:24:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:24:58 smithi171 bash[25040]: cluster 2024-09-14T00:24:56.989702+0000 mgr.a (mgr.14355) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:00 smithi007 bash[22722]: cluster 2024-09-14T00:24:58.990462+0000 mgr.a (mgr.14355) 5368 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:00 smithi131 bash[24745]: cluster 2024-09-14T00:24:58.990462+0000 mgr.a (mgr.14355) 5368 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:00 smithi171 bash[25040]: cluster 2024-09-14T00:24:58.990462+0000 mgr.a (mgr.14355) 5368 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:01.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:01.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:02.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:02.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:02.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:02.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:02.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:02 smithi007 bash[22722]: cluster 2024-09-14T00:25:00.992402+0000 mgr.a (mgr.14355) 5369 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:02 smithi131 bash[24745]: cluster 2024-09-14T00:25:00.992402+0000 mgr.a (mgr.14355) 5369 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:02 smithi171 bash[25040]: cluster 2024-09-14T00:25:00.992402+0000 mgr.a (mgr.14355) 5369 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:03 smithi007 bash[22722]: audit 2024-09-14T00:25:01.998525+0000 mgr.a (mgr.14355) 5370 : audit [DBG] from='client.125301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:03 smithi131 bash[24745]: audit 2024-09-14T00:25:01.998525+0000 mgr.a (mgr.14355) 5370 : audit [DBG] from='client.125301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:03 smithi171 bash[25040]: audit 2024-09-14T00:25:01.998525+0000 mgr.a (mgr.14355) 5370 : audit [DBG] from='client.125301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:04 smithi007 bash[22722]: cluster 2024-09-14T00:25:02.993495+0000 mgr.a (mgr.14355) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:04 smithi131 bash[24745]: cluster 2024-09-14T00:25:02.993495+0000 mgr.a (mgr.14355) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:04 smithi171 bash[25040]: cluster 2024-09-14T00:25:02.993495+0000 mgr.a (mgr.14355) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:06 smithi007 bash[22722]: cluster 2024-09-14T00:25:04.994491+0000 mgr.a (mgr.14355) 5372 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:06 smithi131 bash[24745]: cluster 2024-09-14T00:25:04.994491+0000 mgr.a (mgr.14355) 5372 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:06 smithi171 bash[25040]: cluster 2024-09-14T00:25:04.994491+0000 mgr.a (mgr.14355) 5372 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:07.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:08.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:08 smithi007 bash[22722]: cluster 2024-09-14T00:25:06.996872+0000 mgr.a (mgr.14355) 5373 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:08 smithi131 bash[24745]: cluster 2024-09-14T00:25:06.996872+0000 mgr.a (mgr.14355) 5373 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:08 smithi171 bash[25040]: cluster 2024-09-14T00:25:06.996872+0000 mgr.a (mgr.14355) 5373 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:09 smithi007 bash[22722]: audit 2024-09-14T00:25:07.768289+0000 mgr.a (mgr.14355) 5374 : audit [DBG] from='client.125376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:09 smithi131 bash[24745]: audit 2024-09-14T00:25:07.768289+0000 mgr.a (mgr.14355) 5374 : audit [DBG] from='client.125376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:09 smithi171 bash[25040]: audit 2024-09-14T00:25:07.768289+0000 mgr.a (mgr.14355) 5374 : audit [DBG] from='client.125376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:10 smithi007 bash[22722]: cluster 2024-09-14T00:25:08.997800+0000 mgr.a (mgr.14355) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:10 smithi131 bash[24745]: cluster 2024-09-14T00:25:08.997800+0000 mgr.a (mgr.14355) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:10 smithi171 bash[25040]: cluster 2024-09-14T00:25:08.997800+0000 mgr.a (mgr.14355) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:12 smithi131 bash[24745]: cluster 2024-09-14T00:25:11.000069+0000 mgr.a (mgr.14355) 5376 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:12 smithi171 bash[25040]: cluster 2024-09-14T00:25:11.000069+0000 mgr.a (mgr.14355) 5376 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:12 smithi007 bash[22722]: cluster 2024-09-14T00:25:11.000069+0000 mgr.a (mgr.14355) 5376 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:13.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:13.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:13.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:13.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:13.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:13.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:14 smithi131 bash[24745]: cluster 2024-09-14T00:25:13.000816+0000 mgr.a (mgr.14355) 5377 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:14 smithi131 bash[24745]: audit 2024-09-14T00:25:13.539040+0000 mgr.a (mgr.14355) 5378 : audit [DBG] from='client.125451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:14 smithi171 bash[25040]: cluster 2024-09-14T00:25:13.000816+0000 mgr.a (mgr.14355) 5377 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:14 smithi171 bash[25040]: audit 2024-09-14T00:25:13.539040+0000 mgr.a (mgr.14355) 5378 : audit [DBG] from='client.125451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:14 smithi007 bash[22722]: cluster 2024-09-14T00:25:13.000816+0000 mgr.a (mgr.14355) 5377 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:14 smithi007 bash[22722]: audit 2024-09-14T00:25:13.539040+0000 mgr.a (mgr.14355) 5378 : audit [DBG] from='client.125451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:16 smithi131 bash[24745]: cluster 2024-09-14T00:25:15.001643+0000 mgr.a (mgr.14355) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:16 smithi171 bash[25040]: cluster 2024-09-14T00:25:15.001643+0000 mgr.a (mgr.14355) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:16 smithi007 bash[22722]: cluster 2024-09-14T00:25:15.001643+0000 mgr.a (mgr.14355) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:18 smithi131 bash[24745]: cluster 2024-09-14T00:25:17.003935+0000 mgr.a (mgr.14355) 5380 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:18 smithi171 bash[25040]: cluster 2024-09-14T00:25:17.003935+0000 mgr.a (mgr.14355) 5380 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:18 smithi007 bash[22722]: cluster 2024-09-14T00:25:17.003935+0000 mgr.a (mgr.14355) 5380 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:18.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:18.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:18.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:19.724 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:19.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:19.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:20 smithi131 bash[24745]: cluster 2024-09-14T00:25:19.004694+0000 mgr.a (mgr.14355) 5381 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:20 smithi131 bash[24745]: audit 2024-09-14T00:25:19.287843+0000 mgr.a (mgr.14355) 5382 : audit [DBG] from='client.125526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:20 smithi171 bash[25040]: cluster 2024-09-14T00:25:19.004694+0000 mgr.a (mgr.14355) 5381 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:20 smithi171 bash[25040]: audit 2024-09-14T00:25:19.287843+0000 mgr.a (mgr.14355) 5382 : audit [DBG] from='client.125526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:20 smithi007 bash[22722]: cluster 2024-09-14T00:25:19.004694+0000 mgr.a (mgr.14355) 5381 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:20 smithi007 bash[22722]: audit 2024-09-14T00:25:19.287843+0000 mgr.a (mgr.14355) 5382 : audit [DBG] from='client.125526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:22 smithi131 bash[24745]: cluster 2024-09-14T00:25:21.007021+0000 mgr.a (mgr.14355) 5383 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:22 smithi171 bash[25040]: cluster 2024-09-14T00:25:21.007021+0000 mgr.a (mgr.14355) 5383 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:22 smithi007 bash[22722]: cluster 2024-09-14T00:25:21.007021+0000 mgr.a (mgr.14355) 5383 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:24.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:24.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:24.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:24 smithi131 bash[24745]: cluster 2024-09-14T00:25:23.007816+0000 mgr.a (mgr.14355) 5384 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:24 smithi171 bash[25040]: cluster 2024-09-14T00:25:23.007816+0000 mgr.a (mgr.14355) 5384 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:24 smithi007 bash[22722]: cluster 2024-09-14T00:25:23.007816+0000 mgr.a (mgr.14355) 5384 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:25.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:25.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:26 smithi131 bash[24745]: cluster 2024-09-14T00:25:25.008718+0000 mgr.a (mgr.14355) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:26 smithi131 bash[24745]: audit 2024-09-14T00:25:25.061231+0000 mgr.a (mgr.14355) 5386 : audit [DBG] from='client.125601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:26 smithi171 bash[25040]: cluster 2024-09-14T00:25:25.008718+0000 mgr.a (mgr.14355) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:26 smithi171 bash[25040]: audit 2024-09-14T00:25:25.061231+0000 mgr.a (mgr.14355) 5386 : audit [DBG] from='client.125601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:26 smithi007 bash[22722]: cluster 2024-09-14T00:25:25.008718+0000 mgr.a (mgr.14355) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:26 smithi007 bash[22722]: audit 2024-09-14T00:25:25.061231+0000 mgr.a (mgr.14355) 5386 : audit [DBG] from='client.125601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:28 smithi131 bash[24745]: cluster 2024-09-14T00:25:27.011552+0000 mgr.a (mgr.14355) 5387 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:28 smithi171 bash[25040]: cluster 2024-09-14T00:25:27.011552+0000 mgr.a (mgr.14355) 5387 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:28 smithi007 bash[22722]: cluster 2024-09-14T00:25:27.011552+0000 mgr.a (mgr.14355) 5387 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:30.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:30.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:30.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:30 smithi131 bash[24745]: cluster 2024-09-14T00:25:29.012346+0000 mgr.a (mgr.14355) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:30 smithi171 bash[25040]: cluster 2024-09-14T00:25:29.012346+0000 mgr.a (mgr.14355) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:30 smithi007 bash[22722]: cluster 2024-09-14T00:25:29.012346+0000 mgr.a (mgr.14355) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:31.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:31.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:31.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:31.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:31.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:32 smithi131 bash[24745]: audit 2024-09-14T00:25:30.842572+0000 mgr.a (mgr.14355) 5389 : audit [DBG] from='client.125679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:32 smithi131 bash[24745]: cluster 2024-09-14T00:25:31.013713+0000 mgr.a (mgr.14355) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:32 smithi171 bash[25040]: audit 2024-09-14T00:25:30.842572+0000 mgr.a (mgr.14355) 5389 : audit [DBG] from='client.125679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:32 smithi171 bash[25040]: cluster 2024-09-14T00:25:31.013713+0000 mgr.a (mgr.14355) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:32 smithi007 bash[22722]: audit 2024-09-14T00:25:30.842572+0000 mgr.a (mgr.14355) 5389 : audit [DBG] from='client.125679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:32 smithi007 bash[22722]: cluster 2024-09-14T00:25:31.013713+0000 mgr.a (mgr.14355) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:34 smithi131 bash[24745]: cluster 2024-09-14T00:25:33.014607+0000 mgr.a (mgr.14355) 5391 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:34 smithi171 bash[25040]: cluster 2024-09-14T00:25:33.014607+0000 mgr.a (mgr.14355) 5391 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:34 smithi007 bash[22722]: cluster 2024-09-14T00:25:33.014607+0000 mgr.a (mgr.14355) 5391 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:25:36.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:36.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:36 smithi131 bash[24745]: cluster 2024-09-14T00:25:35.015414+0000 mgr.a (mgr.14355) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:25:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:36 smithi171 bash[25040]: cluster 2024-09-14T00:25:35.015414+0000 mgr.a (mgr.14355) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:25:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:36 smithi007 bash[22722]: cluster 2024-09-14T00:25:35.015414+0000 mgr.a (mgr.14355) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:25:37.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:37.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:37 smithi131 bash[24745]: audit 2024-09-14T00:25:36.604551+0000 mgr.a (mgr.14355) 5393 : audit [DBG] from='client.125757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:37 smithi171 bash[25040]: audit 2024-09-14T00:25:36.604551+0000 mgr.a (mgr.14355) 5393 : audit [DBG] from='client.125757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:37 smithi007 bash[22722]: audit 2024-09-14T00:25:36.604551+0000 mgr.a (mgr.14355) 5393 : audit [DBG] from='client.125757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:38 smithi131 bash[24745]: cluster 2024-09-14T00:25:37.016750+0000 mgr.a (mgr.14355) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:38 smithi171 bash[25040]: cluster 2024-09-14T00:25:37.016750+0000 mgr.a (mgr.14355) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:38 smithi007 bash[22722]: cluster 2024-09-14T00:25:37.016750+0000 mgr.a (mgr.14355) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:40 smithi131 bash[24745]: cluster 2024-09-14T00:25:39.017424+0000 mgr.a (mgr.14355) 5395 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:40 smithi171 bash[25040]: cluster 2024-09-14T00:25:39.017424+0000 mgr.a (mgr.14355) 5395 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:40 smithi007 bash[22722]: cluster 2024-09-14T00:25:39.017424+0000 mgr.a (mgr.14355) 5395 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:42.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:42 smithi131 bash[24745]: cluster 2024-09-14T00:25:41.019446+0000 mgr.a (mgr.14355) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:42.784 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:42 smithi171 bash[25040]: cluster 2024-09-14T00:25:41.019446+0000 mgr.a (mgr.14355) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:42 smithi007 bash[22722]: cluster 2024-09-14T00:25:41.019446+0000 mgr.a (mgr.14355) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:43 smithi131 bash[24745]: audit 2024-09-14T00:25:42.374449+0000 mgr.a (mgr.14355) 5397 : audit [DBG] from='client.125835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:43 smithi171 bash[25040]: audit 2024-09-14T00:25:42.374449+0000 mgr.a (mgr.14355) 5397 : audit [DBG] from='client.125835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:43 smithi007 bash[22722]: audit 2024-09-14T00:25:42.374449+0000 mgr.a (mgr.14355) 5397 : audit [DBG] from='client.125835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:44 smithi171 bash[25040]: cluster 2024-09-14T00:25:43.020379+0000 mgr.a (mgr.14355) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:44 smithi171 bash[25040]: audit 2024-09-14T00:25:44.506252+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:25:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:44 smithi007 bash[22722]: cluster 2024-09-14T00:25:43.020379+0000 mgr.a (mgr.14355) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:44 smithi007 bash[22722]: audit 2024-09-14T00:25:44.506252+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:25:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:44 smithi131 bash[24745]: cluster 2024-09-14T00:25:43.020379+0000 mgr.a (mgr.14355) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:44 smithi131 bash[24745]: audit 2024-09-14T00:25:44.506252+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:25:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:45 smithi171 bash[25040]: audit 2024-09-14T00:25:45.349581+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:25:45.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:45 smithi171 bash[25040]: audit 2024-09-14T00:25:45.351266+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:25:45.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:45 smithi171 bash[25040]: audit 2024-09-14T00:25:45.361196+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:25:45.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:45 smithi171 bash[25040]: audit 2024-09-14T00:25:45.366185+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:45 smithi007 bash[22722]: audit 2024-09-14T00:25:45.349581+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:25:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:45 smithi007 bash[22722]: audit 2024-09-14T00:25:45.351266+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:25:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:45 smithi007 bash[22722]: audit 2024-09-14T00:25:45.361196+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:25:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:45 smithi007 bash[22722]: audit 2024-09-14T00:25:45.366185+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:45 smithi131 bash[24745]: audit 2024-09-14T00:25:45.349581+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:25:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:45 smithi131 bash[24745]: audit 2024-09-14T00:25:45.351266+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:25:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:45 smithi131 bash[24745]: audit 2024-09-14T00:25:45.361196+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:25:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:45 smithi131 bash[24745]: audit 2024-09-14T00:25:45.366185+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:46.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:25:46 smithi007 bash[22972]: debug 2024-09-14T00:25:46.105+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:25:46.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:25:46 smithi007 bash[22972]: debug 2024-09-14T00:25:46.105+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:25:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:46 smithi171 bash[25040]: cluster 2024-09-14T00:25:45.020947+0000 mgr.a (mgr.14355) 5399 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:46 smithi171 bash[25040]: audit 2024-09-14T00:25:45.367472+0000 mgr.a (mgr.14355) 5400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:46 smithi007 bash[22722]: cluster 2024-09-14T00:25:45.020947+0000 mgr.a (mgr.14355) 5399 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:46 smithi007 bash[22722]: audit 2024-09-14T00:25:45.367472+0000 mgr.a (mgr.14355) 5400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:46 smithi131 bash[24745]: cluster 2024-09-14T00:25:45.020947+0000 mgr.a (mgr.14355) 5399 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:46 smithi131 bash[24745]: audit 2024-09-14T00:25:45.367472+0000 mgr.a (mgr.14355) 5400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:25:47.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:47.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:47.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:47 smithi007 bash[22722]: audit 2024-09-14T00:25:46.108657+0000 mgr.a (mgr.14355) 5401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:25:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:47 smithi007 bash[22722]: cephadm 2024-09-14T00:25:46.110171+0000 mgr.a (mgr.14355) 5402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:25:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:47 smithi131 bash[24745]: audit 2024-09-14T00:25:46.108657+0000 mgr.a (mgr.14355) 5401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:25:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:47 smithi131 bash[24745]: cephadm 2024-09-14T00:25:46.110171+0000 mgr.a (mgr.14355) 5402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:25:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:47 smithi171 bash[25040]: audit 2024-09-14T00:25:46.108657+0000 mgr.a (mgr.14355) 5401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:25:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:47 smithi171 bash[25040]: cephadm 2024-09-14T00:25:46.110171+0000 mgr.a (mgr.14355) 5402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:25:48.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:48 smithi007 bash[22722]: cluster 2024-09-14T00:25:47.023675+0000 mgr.a (mgr.14355) 5403 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:48 smithi131 bash[24745]: cluster 2024-09-14T00:25:47.023675+0000 mgr.a (mgr.14355) 5403 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:48 smithi171 bash[25040]: cluster 2024-09-14T00:25:47.023675+0000 mgr.a (mgr.14355) 5403 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:25:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:49 smithi007 bash[22722]: audit 2024-09-14T00:25:48.123716+0000 mgr.a (mgr.14355) 5404 : audit [DBG] from='client.126021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:49 smithi131 bash[24745]: audit 2024-09-14T00:25:48.123716+0000 mgr.a (mgr.14355) 5404 : audit [DBG] from='client.126021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:49 smithi171 bash[25040]: audit 2024-09-14T00:25:48.123716+0000 mgr.a (mgr.14355) 5404 : audit [DBG] from='client.126021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:50 smithi007 bash[22722]: cluster 2024-09-14T00:25:49.024582+0000 mgr.a (mgr.14355) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:50 smithi131 bash[24745]: cluster 2024-09-14T00:25:49.024582+0000 mgr.a (mgr.14355) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:50 smithi171 bash[25040]: cluster 2024-09-14T00:25:49.024582+0000 mgr.a (mgr.14355) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:25:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:52 smithi007 bash[22722]: cluster 2024-09-14T00:25:51.026842+0000 mgr.a (mgr.14355) 5406 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:52 smithi131 bash[24745]: cluster 2024-09-14T00:25:51.026842+0000 mgr.a (mgr.14355) 5406 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:52 smithi171 bash[25040]: cluster 2024-09-14T00:25:51.026842+0000 mgr.a (mgr.14355) 5406 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:25:54.329 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:25:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:25:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:25:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:25:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:25:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:54 smithi007 bash[22722]: cluster 2024-09-14T00:25:53.027592+0000 mgr.a (mgr.14355) 5407 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:54 smithi131 bash[24745]: cluster 2024-09-14T00:25:53.027592+0000 mgr.a (mgr.14355) 5407 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:54 smithi171 bash[25040]: cluster 2024-09-14T00:25:53.027592+0000 mgr.a (mgr.14355) 5407 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:55 smithi007 bash[22722]: audit 2024-09-14T00:25:53.886598+0000 mgr.a (mgr.14355) 5408 : audit [DBG] from='client.126099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:55 smithi131 bash[24745]: audit 2024-09-14T00:25:53.886598+0000 mgr.a (mgr.14355) 5408 : audit [DBG] from='client.126099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:55 smithi171 bash[25040]: audit 2024-09-14T00:25:53.886598+0000 mgr.a (mgr.14355) 5408 : audit [DBG] from='client.126099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:25:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:56 smithi007 bash[22722]: cluster 2024-09-14T00:25:55.028475+0000 mgr.a (mgr.14355) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:56 smithi131 bash[24745]: cluster 2024-09-14T00:25:55.028475+0000 mgr.a (mgr.14355) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:56 smithi171 bash[25040]: cluster 2024-09-14T00:25:55.028475+0000 mgr.a (mgr.14355) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:25:58 smithi007 bash[22722]: cluster 2024-09-14T00:25:57.030753+0000 mgr.a (mgr.14355) 5410 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:25:58 smithi131 bash[24745]: cluster 2024-09-14T00:25:57.030753+0000 mgr.a (mgr.14355) 5410 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:25:58 smithi171 bash[25040]: cluster 2024-09-14T00:25:57.030753+0000 mgr.a (mgr.14355) 5410 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:25:59.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:25:59.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:25:59.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:00.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:00.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:00 smithi007 bash[22722]: cluster 2024-09-14T00:25:59.031520+0000 mgr.a (mgr.14355) 5411 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:00 smithi007 bash[22722]: audit 2024-09-14T00:25:59.665338+0000 mgr.a (mgr.14355) 5412 : audit [DBG] from='client.126177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:00 smithi131 bash[24745]: cluster 2024-09-14T00:25:59.031520+0000 mgr.a (mgr.14355) 5411 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:00 smithi131 bash[24745]: audit 2024-09-14T00:25:59.665338+0000 mgr.a (mgr.14355) 5412 : audit [DBG] from='client.126177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:00 smithi171 bash[25040]: cluster 2024-09-14T00:25:59.031520+0000 mgr.a (mgr.14355) 5411 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:00 smithi171 bash[25040]: audit 2024-09-14T00:25:59.665338+0000 mgr.a (mgr.14355) 5412 : audit [DBG] from='client.126177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:02 smithi007 bash[22722]: cluster 2024-09-14T00:26:01.033832+0000 mgr.a (mgr.14355) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:02 smithi131 bash[24745]: cluster 2024-09-14T00:26:01.033832+0000 mgr.a (mgr.14355) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:02 smithi171 bash[25040]: cluster 2024-09-14T00:26:01.033832+0000 mgr.a (mgr.14355) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:04 smithi007 bash[22722]: cluster 2024-09-14T00:26:03.034778+0000 mgr.a (mgr.14355) 5414 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:04 smithi131 bash[24745]: cluster 2024-09-14T00:26:03.034778+0000 mgr.a (mgr.14355) 5414 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:04 smithi171 bash[25040]: cluster 2024-09-14T00:26:03.034778+0000 mgr.a (mgr.14355) 5414 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:05.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:05.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:05.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:05.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:05.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:05.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:05.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:06 smithi007 bash[22722]: cluster 2024-09-14T00:26:05.035550+0000 mgr.a (mgr.14355) 5415 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:06 smithi007 bash[22722]: audit 2024-09-14T00:26:05.441109+0000 mgr.a (mgr.14355) 5416 : audit [DBG] from='client.126255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:06 smithi131 bash[24745]: cluster 2024-09-14T00:26:05.035550+0000 mgr.a (mgr.14355) 5415 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:06 smithi131 bash[24745]: audit 2024-09-14T00:26:05.441109+0000 mgr.a (mgr.14355) 5416 : audit [DBG] from='client.126255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:06 smithi171 bash[25040]: cluster 2024-09-14T00:26:05.035550+0000 mgr.a (mgr.14355) 5415 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:06 smithi171 bash[25040]: audit 2024-09-14T00:26:05.441109+0000 mgr.a (mgr.14355) 5416 : audit [DBG] from='client.126255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:08 smithi007 bash[22722]: cluster 2024-09-14T00:26:07.038274+0000 mgr.a (mgr.14355) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:08 smithi131 bash[24745]: cluster 2024-09-14T00:26:07.038274+0000 mgr.a (mgr.14355) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:08 smithi171 bash[25040]: cluster 2024-09-14T00:26:07.038274+0000 mgr.a (mgr.14355) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:10.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:10.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:10 smithi007 bash[22722]: cluster 2024-09-14T00:26:09.039061+0000 mgr.a (mgr.14355) 5418 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:10 smithi131 bash[24745]: cluster 2024-09-14T00:26:09.039061+0000 mgr.a (mgr.14355) 5418 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:10 smithi171 bash[25040]: cluster 2024-09-14T00:26:09.039061+0000 mgr.a (mgr.14355) 5418 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:11.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:11.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:11.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:11.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:11.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:12 smithi007 bash[22722]: cluster 2024-09-14T00:26:11.040528+0000 mgr.a (mgr.14355) 5419 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:12 smithi007 bash[22722]: audit 2024-09-14T00:26:11.214420+0000 mgr.a (mgr.14355) 5420 : audit [DBG] from='client.126330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:12 smithi131 bash[24745]: cluster 2024-09-14T00:26:11.040528+0000 mgr.a (mgr.14355) 5419 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:12 smithi131 bash[24745]: audit 2024-09-14T00:26:11.214420+0000 mgr.a (mgr.14355) 5420 : audit [DBG] from='client.126330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:12 smithi171 bash[25040]: cluster 2024-09-14T00:26:11.040528+0000 mgr.a (mgr.14355) 5419 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:12 smithi171 bash[25040]: audit 2024-09-14T00:26:11.214420+0000 mgr.a (mgr.14355) 5420 : audit [DBG] from='client.126330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:14 smithi007 bash[22722]: cluster 2024-09-14T00:26:13.041384+0000 mgr.a (mgr.14355) 5421 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:14 smithi131 bash[24745]: cluster 2024-09-14T00:26:13.041384+0000 mgr.a (mgr.14355) 5421 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:14 smithi171 bash[25040]: cluster 2024-09-14T00:26:13.041384+0000 mgr.a (mgr.14355) 5421 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:16.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:16 smithi007 bash[22722]: cluster 2024-09-14T00:26:15.042160+0000 mgr.a (mgr.14355) 5422 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:26:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:16 smithi131 bash[24745]: cluster 2024-09-14T00:26:15.042160+0000 mgr.a (mgr.14355) 5422 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:26:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:16 smithi171 bash[25040]: cluster 2024-09-14T00:26:15.042160+0000 mgr.a (mgr.14355) 5422 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:26:17.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:17.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:18 smithi007 bash[22722]: audit 2024-09-14T00:26:16.972123+0000 mgr.a (mgr.14355) 5423 : audit [DBG] from='client.126408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:18 smithi007 bash[22722]: cluster 2024-09-14T00:26:17.043529+0000 mgr.a (mgr.14355) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:18 smithi131 bash[24745]: audit 2024-09-14T00:26:16.972123+0000 mgr.a (mgr.14355) 5423 : audit [DBG] from='client.126408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:18 smithi131 bash[24745]: cluster 2024-09-14T00:26:17.043529+0000 mgr.a (mgr.14355) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:18 smithi171 bash[25040]: audit 2024-09-14T00:26:16.972123+0000 mgr.a (mgr.14355) 5423 : audit [DBG] from='client.126408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:18 smithi171 bash[25040]: cluster 2024-09-14T00:26:17.043529+0000 mgr.a (mgr.14355) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:20 smithi007 bash[22722]: cluster 2024-09-14T00:26:19.044396+0000 mgr.a (mgr.14355) 5425 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:20 smithi131 bash[24745]: cluster 2024-09-14T00:26:19.044396+0000 mgr.a (mgr.14355) 5425 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:20 smithi171 bash[25040]: cluster 2024-09-14T00:26:19.044396+0000 mgr.a (mgr.14355) 5425 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:22.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:22.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:22.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:22 smithi007 bash[22722]: cluster 2024-09-14T00:26:21.046645+0000 mgr.a (mgr.14355) 5426 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:22 smithi131 bash[24745]: cluster 2024-09-14T00:26:21.046645+0000 mgr.a (mgr.14355) 5426 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:22 smithi171 bash[25040]: cluster 2024-09-14T00:26:21.046645+0000 mgr.a (mgr.14355) 5426 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:23.170 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:23.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:23.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:23.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:23.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:23 smithi007 bash[22722]: audit 2024-09-14T00:26:22.745139+0000 mgr.a (mgr.14355) 5427 : audit [DBG] from='client.126486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:23 smithi131 bash[24745]: audit 2024-09-14T00:26:22.745139+0000 mgr.a (mgr.14355) 5427 : audit [DBG] from='client.126486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:23 smithi171 bash[25040]: audit 2024-09-14T00:26:22.745139+0000 mgr.a (mgr.14355) 5427 : audit [DBG] from='client.126486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:24 smithi007 bash[22722]: cluster 2024-09-14T00:26:23.047112+0000 mgr.a (mgr.14355) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:24 smithi131 bash[24745]: cluster 2024-09-14T00:26:23.047112+0000 mgr.a (mgr.14355) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:24 smithi171 bash[25040]: cluster 2024-09-14T00:26:23.047112+0000 mgr.a (mgr.14355) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:26 smithi007 bash[22722]: cluster 2024-09-14T00:26:25.047913+0000 mgr.a (mgr.14355) 5429 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:26 smithi131 bash[24745]: cluster 2024-09-14T00:26:25.047913+0000 mgr.a (mgr.14355) 5429 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:26 smithi171 bash[25040]: cluster 2024-09-14T00:26:25.047913+0000 mgr.a (mgr.14355) 5429 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:28.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:28.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:28.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:28.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:28.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:28.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:28.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:28 smithi007 bash[22722]: cluster 2024-09-14T00:26:27.050170+0000 mgr.a (mgr.14355) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:28 smithi131 bash[24745]: cluster 2024-09-14T00:26:27.050170+0000 mgr.a (mgr.14355) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:28 smithi171 bash[25040]: cluster 2024-09-14T00:26:27.050170+0000 mgr.a (mgr.14355) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:29 smithi007 bash[22722]: audit 2024-09-14T00:26:28.507582+0000 mgr.a (mgr.14355) 5431 : audit [DBG] from='client.126564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:29 smithi131 bash[24745]: audit 2024-09-14T00:26:28.507582+0000 mgr.a (mgr.14355) 5431 : audit [DBG] from='client.126564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:29 smithi171 bash[25040]: audit 2024-09-14T00:26:28.507582+0000 mgr.a (mgr.14355) 5431 : audit [DBG] from='client.126564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:30 smithi007 bash[22722]: cluster 2024-09-14T00:26:29.051018+0000 mgr.a (mgr.14355) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:30 smithi131 bash[24745]: cluster 2024-09-14T00:26:29.051018+0000 mgr.a (mgr.14355) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:30 smithi171 bash[25040]: cluster 2024-09-14T00:26:29.051018+0000 mgr.a (mgr.14355) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:32 smithi007 bash[22722]: cluster 2024-09-14T00:26:31.053249+0000 mgr.a (mgr.14355) 5433 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:32 smithi131 bash[24745]: cluster 2024-09-14T00:26:31.053249+0000 mgr.a (mgr.14355) 5433 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:32 smithi171 bash[25040]: cluster 2024-09-14T00:26:31.053249+0000 mgr.a (mgr.14355) 5433 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:33.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:34.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:34.690 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:34 smithi007 bash[22722]: cluster 2024-09-14T00:26:33.054000+0000 mgr.a (mgr.14355) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:34 smithi131 bash[24745]: cluster 2024-09-14T00:26:33.054000+0000 mgr.a (mgr.14355) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:34 smithi171 bash[25040]: cluster 2024-09-14T00:26:33.054000+0000 mgr.a (mgr.14355) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:35 smithi007 bash[22722]: audit 2024-09-14T00:26:34.262374+0000 mgr.a (mgr.14355) 5435 : audit [DBG] from='client.126639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:35 smithi131 bash[24745]: audit 2024-09-14T00:26:34.262374+0000 mgr.a (mgr.14355) 5435 : audit [DBG] from='client.126639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:35 smithi171 bash[25040]: audit 2024-09-14T00:26:34.262374+0000 mgr.a (mgr.14355) 5435 : audit [DBG] from='client.126639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:36 smithi007 bash[22722]: cluster 2024-09-14T00:26:35.054851+0000 mgr.a (mgr.14355) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:36 smithi131 bash[24745]: cluster 2024-09-14T00:26:35.054851+0000 mgr.a (mgr.14355) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:36 smithi171 bash[25040]: cluster 2024-09-14T00:26:35.054851+0000 mgr.a (mgr.14355) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:38 smithi007 bash[22722]: cluster 2024-09-14T00:26:37.057057+0000 mgr.a (mgr.14355) 5437 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:38 smithi131 bash[24745]: cluster 2024-09-14T00:26:37.057057+0000 mgr.a (mgr.14355) 5437 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:38 smithi171 bash[25040]: cluster 2024-09-14T00:26:37.057057+0000 mgr.a (mgr.14355) 5437 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:26:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:40.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:40.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:40 smithi007 bash[22722]: cluster 2024-09-14T00:26:39.057821+0000 mgr.a (mgr.14355) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:40 smithi131 bash[24745]: cluster 2024-09-14T00:26:39.057821+0000 mgr.a (mgr.14355) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:40 smithi171 bash[25040]: cluster 2024-09-14T00:26:39.057821+0000 mgr.a (mgr.14355) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:41 smithi007 bash[22722]: audit 2024-09-14T00:26:40.029401+0000 mgr.a (mgr.14355) 5439 : audit [DBG] from='client.126717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:41 smithi131 bash[24745]: audit 2024-09-14T00:26:40.029401+0000 mgr.a (mgr.14355) 5439 : audit [DBG] from='client.126717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:41 smithi171 bash[25040]: audit 2024-09-14T00:26:40.029401+0000 mgr.a (mgr.14355) 5439 : audit [DBG] from='client.126717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:42 smithi007 bash[22722]: cluster 2024-09-14T00:26:41.060737+0000 mgr.a (mgr.14355) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:42 smithi131 bash[24745]: cluster 2024-09-14T00:26:41.060737+0000 mgr.a (mgr.14355) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:42 smithi171 bash[25040]: cluster 2024-09-14T00:26:41.060737+0000 mgr.a (mgr.14355) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:44 smithi131 bash[24745]: cluster 2024-09-14T00:26:43.061709+0000 mgr.a (mgr.14355) 5441 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:44 smithi171 bash[25040]: cluster 2024-09-14T00:26:43.061709+0000 mgr.a (mgr.14355) 5441 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:44 smithi007 bash[22722]: cluster 2024-09-14T00:26:43.061709+0000 mgr.a (mgr.14355) 5441 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:46.266 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:46 smithi131 bash[24745]: cluster 2024-09-14T00:26:45.062677+0000 mgr.a (mgr.14355) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:46 smithi131 bash[24745]: audit 2024-09-14T00:26:46.162406+0000 mon.a (mon.0) 1417 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:26:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:46 smithi171 bash[25040]: cluster 2024-09-14T00:26:45.062677+0000 mgr.a (mgr.14355) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:46 smithi171 bash[25040]: audit 2024-09-14T00:26:46.162406+0000 mon.a (mon.0) 1417 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:26:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:46 smithi007 bash[22722]: cluster 2024-09-14T00:26:45.062677+0000 mgr.a (mgr.14355) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:46 smithi007 bash[22722]: audit 2024-09-14T00:26:46.162406+0000 mon.a (mon.0) 1417 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:26:47.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22972]: debug 2024-09-14T00:26:47.680+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:26:47.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22972]: debug 2024-09-14T00:26:47.680+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:26:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22722]: audit 2024-09-14T00:26:45.818203+0000 mgr.a (mgr.14355) 5443 : audit [DBG] from='client.126792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22722]: audit 2024-09-14T00:26:46.940626+0000 mon.a (mon.0) 1418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:26:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22722]: audit 2024-09-14T00:26:46.942241+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:26:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22722]: audit 2024-09-14T00:26:46.951896+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:26:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:47 smithi007 bash[22722]: audit 2024-09-14T00:26:46.956754+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:47 smithi131 bash[24745]: audit 2024-09-14T00:26:45.818203+0000 mgr.a (mgr.14355) 5443 : audit [DBG] from='client.126792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:47 smithi131 bash[24745]: audit 2024-09-14T00:26:46.940626+0000 mon.a (mon.0) 1418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:26:48.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:47 smithi131 bash[24745]: audit 2024-09-14T00:26:46.942241+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:26:48.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:47 smithi131 bash[24745]: audit 2024-09-14T00:26:46.951896+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:26:48.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:47 smithi131 bash[24745]: audit 2024-09-14T00:26:46.956754+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:47 smithi171 bash[25040]: audit 2024-09-14T00:26:45.818203+0000 mgr.a (mgr.14355) 5443 : audit [DBG] from='client.126792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:47 smithi171 bash[25040]: audit 2024-09-14T00:26:46.940626+0000 mon.a (mon.0) 1418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:26:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:47 smithi171 bash[25040]: audit 2024-09-14T00:26:46.942241+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:26:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:47 smithi171 bash[25040]: audit 2024-09-14T00:26:46.951896+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:26:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:47 smithi171 bash[25040]: audit 2024-09-14T00:26:46.956754+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:48 smithi131 bash[24745]: audit 2024-09-14T00:26:46.959434+0000 mgr.a (mgr.14355) 5444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:49.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:48 smithi131 bash[24745]: cluster 2024-09-14T00:26:47.064262+0000 mgr.a (mgr.14355) 5445 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:49.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:48 smithi131 bash[24745]: audit 2024-09-14T00:26:47.684794+0000 mgr.a (mgr.14355) 5446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:26:49.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:48 smithi131 bash[24745]: cephadm 2024-09-14T00:26:47.685993+0000 mgr.a (mgr.14355) 5447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:26:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:48 smithi171 bash[25040]: audit 2024-09-14T00:26:46.959434+0000 mgr.a (mgr.14355) 5444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:48 smithi171 bash[25040]: cluster 2024-09-14T00:26:47.064262+0000 mgr.a (mgr.14355) 5445 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:48 smithi171 bash[25040]: audit 2024-09-14T00:26:47.684794+0000 mgr.a (mgr.14355) 5446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:26:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:48 smithi171 bash[25040]: cephadm 2024-09-14T00:26:47.685993+0000 mgr.a (mgr.14355) 5447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:26:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:48 smithi007 bash[22722]: audit 2024-09-14T00:26:46.959434+0000 mgr.a (mgr.14355) 5444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:26:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:48 smithi007 bash[22722]: cluster 2024-09-14T00:26:47.064262+0000 mgr.a (mgr.14355) 5445 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:26:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:48 smithi007 bash[22722]: audit 2024-09-14T00:26:47.684794+0000 mgr.a (mgr.14355) 5446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:26:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:48 smithi007 bash[22722]: cephadm 2024-09-14T00:26:47.685993+0000 mgr.a (mgr.14355) 5447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:26:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:50 smithi131 bash[24745]: cluster 2024-09-14T00:26:49.065157+0000 mgr.a (mgr.14355) 5448 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:50 smithi171 bash[25040]: cluster 2024-09-14T00:26:49.065157+0000 mgr.a (mgr.14355) 5448 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:50 smithi007 bash[22722]: cluster 2024-09-14T00:26:49.065157+0000 mgr.a (mgr.14355) 5448 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:26:51.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:51.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:51.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:52.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:52.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:52 smithi131 bash[24745]: cluster 2024-09-14T00:26:51.067431+0000 mgr.a (mgr.14355) 5449 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:53.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:52 smithi131 bash[24745]: audit 2024-09-14T00:26:51.603222+0000 mgr.a (mgr.14355) 5450 : audit [DBG] from='client.126978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:52 smithi171 bash[25040]: cluster 2024-09-14T00:26:51.067431+0000 mgr.a (mgr.14355) 5449 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:52 smithi171 bash[25040]: audit 2024-09-14T00:26:51.603222+0000 mgr.a (mgr.14355) 5450 : audit [DBG] from='client.126978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:52 smithi007 bash[22722]: cluster 2024-09-14T00:26:51.067431+0000 mgr.a (mgr.14355) 5449 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:52 smithi007 bash[22722]: audit 2024-09-14T00:26:51.603222+0000 mgr.a (mgr.14355) 5450 : audit [DBG] from='client.126978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:54 smithi131 bash[24745]: cluster 2024-09-14T00:26:53.068377+0000 mgr.a (mgr.14355) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:54 smithi171 bash[25040]: cluster 2024-09-14T00:26:53.068377+0000 mgr.a (mgr.14355) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:54 smithi007 bash[22722]: cluster 2024-09-14T00:26:53.068377+0000 mgr.a (mgr.14355) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:57.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:26:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:56 smithi131 bash[24745]: cluster 2024-09-14T00:26:55.069214+0000 mgr.a (mgr.14355) 5452 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:26:57.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:26:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:56 smithi171 bash[25040]: cluster 2024-09-14T00:26:55.069214+0000 mgr.a (mgr.14355) 5452 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:56 smithi007 bash[22722]: cluster 2024-09-14T00:26:55.069214+0000 mgr.a (mgr.14355) 5452 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:57.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:26:57.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:26:57.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:26:57.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:26:57.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:26:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:58 smithi131 bash[24745]: cluster 2024-09-14T00:26:57.070862+0000 mgr.a (mgr.14355) 5453 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:26:58 smithi131 bash[24745]: audit 2024-09-14T00:26:57.361210+0000 mgr.a (mgr.14355) 5454 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:58 smithi171 bash[25040]: cluster 2024-09-14T00:26:57.070862+0000 mgr.a (mgr.14355) 5453 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:26:58 smithi171 bash[25040]: audit 2024-09-14T00:26:57.361210+0000 mgr.a (mgr.14355) 5454 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:26:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:58 smithi007 bash[22722]: cluster 2024-09-14T00:26:57.070862+0000 mgr.a (mgr.14355) 5453 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:26:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:26:58 smithi007 bash[22722]: audit 2024-09-14T00:26:57.361210+0000 mgr.a (mgr.14355) 5454 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:00 smithi131 bash[24745]: cluster 2024-09-14T00:26:59.071815+0000 mgr.a (mgr.14355) 5455 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:00 smithi171 bash[25040]: cluster 2024-09-14T00:26:59.071815+0000 mgr.a (mgr.14355) 5455 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:00 smithi007 bash[22722]: cluster 2024-09-14T00:26:59.071815+0000 mgr.a (mgr.14355) 5455 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:02.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:02.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:02 smithi131 bash[24745]: cluster 2024-09-14T00:27:01.074084+0000 mgr.a (mgr.14355) 5456 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:02 smithi171 bash[25040]: cluster 2024-09-14T00:27:01.074084+0000 mgr.a (mgr.14355) 5456 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:02 smithi007 bash[22722]: cluster 2024-09-14T00:27:01.074084+0000 mgr.a (mgr.14355) 5456 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:03.563 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:04 smithi131 bash[24745]: cluster 2024-09-14T00:27:03.074837+0000 mgr.a (mgr.14355) 5457 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:04 smithi131 bash[24745]: audit 2024-09-14T00:27:03.123838+0000 mgr.a (mgr.14355) 5458 : audit [DBG] from='client.127131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:04 smithi171 bash[25040]: cluster 2024-09-14T00:27:03.074837+0000 mgr.a (mgr.14355) 5457 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:04 smithi171 bash[25040]: audit 2024-09-14T00:27:03.123838+0000 mgr.a (mgr.14355) 5458 : audit [DBG] from='client.127131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:04 smithi007 bash[22722]: cluster 2024-09-14T00:27:03.074837+0000 mgr.a (mgr.14355) 5457 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:04 smithi007 bash[22722]: audit 2024-09-14T00:27:03.123838+0000 mgr.a (mgr.14355) 5458 : audit [DBG] from='client.127131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:06 smithi131 bash[24745]: cluster 2024-09-14T00:27:05.075909+0000 mgr.a (mgr.14355) 5459 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:06 smithi171 bash[25040]: cluster 2024-09-14T00:27:05.075909+0000 mgr.a (mgr.14355) 5459 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:06 smithi007 bash[22722]: cluster 2024-09-14T00:27:05.075909+0000 mgr.a (mgr.14355) 5459 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:08.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:08 smithi131 bash[24745]: cluster 2024-09-14T00:27:07.078226+0000 mgr.a (mgr.14355) 5460 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:08 smithi171 bash[25040]: cluster 2024-09-14T00:27:07.078226+0000 mgr.a (mgr.14355) 5460 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:08 smithi007 bash[22722]: cluster 2024-09-14T00:27:07.078226+0000 mgr.a (mgr.14355) 5460 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:09.345 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:09.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:09.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:10 smithi131 bash[24745]: audit 2024-09-14T00:27:08.905486+0000 mgr.a (mgr.14355) 5461 : audit [DBG] from='client.127209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:10 smithi131 bash[24745]: cluster 2024-09-14T00:27:09.078865+0000 mgr.a (mgr.14355) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:10 smithi171 bash[25040]: audit 2024-09-14T00:27:08.905486+0000 mgr.a (mgr.14355) 5461 : audit [DBG] from='client.127209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:11.076 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:10 smithi171 bash[25040]: cluster 2024-09-14T00:27:09.078865+0000 mgr.a (mgr.14355) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:10 smithi007 bash[22722]: audit 2024-09-14T00:27:08.905486+0000 mgr.a (mgr.14355) 5461 : audit [DBG] from='client.127209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:10 smithi007 bash[22722]: cluster 2024-09-14T00:27:09.078865+0000 mgr.a (mgr.14355) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:12 smithi131 bash[24745]: cluster 2024-09-14T00:27:11.081210+0000 mgr.a (mgr.14355) 5463 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:12 smithi171 bash[25040]: cluster 2024-09-14T00:27:11.081210+0000 mgr.a (mgr.14355) 5463 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:12 smithi007 bash[22722]: cluster 2024-09-14T00:27:11.081210+0000 mgr.a (mgr.14355) 5463 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:14.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:14.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:14.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:14 smithi131 bash[24745]: cluster 2024-09-14T00:27:13.082137+0000 mgr.a (mgr.14355) 5464 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:14 smithi171 bash[25040]: cluster 2024-09-14T00:27:13.082137+0000 mgr.a (mgr.14355) 5464 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:15.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:15.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:15.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:15.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:15.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:14 smithi007 bash[22722]: cluster 2024-09-14T00:27:13.082137+0000 mgr.a (mgr.14355) 5464 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:15 smithi131 bash[24745]: audit 2024-09-14T00:27:14.682727+0000 mgr.a (mgr.14355) 5465 : audit [DBG] from='client.127281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:15 smithi171 bash[25040]: audit 2024-09-14T00:27:14.682727+0000 mgr.a (mgr.14355) 5465 : audit [DBG] from='client.127281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:15 smithi007 bash[22722]: audit 2024-09-14T00:27:14.682727+0000 mgr.a (mgr.14355) 5465 : audit [DBG] from='client.127281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:16 smithi131 bash[24745]: cluster 2024-09-14T00:27:15.082737+0000 mgr.a (mgr.14355) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:16 smithi171 bash[25040]: cluster 2024-09-14T00:27:15.082737+0000 mgr.a (mgr.14355) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:16 smithi007 bash[22722]: cluster 2024-09-14T00:27:15.082737+0000 mgr.a (mgr.14355) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:17 smithi171 bash[25040]: cluster 2024-09-14T00:27:17.084956+0000 mgr.a (mgr.14355) 5467 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:17 smithi007 bash[22722]: cluster 2024-09-14T00:27:17.084956+0000 mgr.a (mgr.14355) 5467 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:17 smithi131 bash[24745]: cluster 2024-09-14T00:27:17.084956+0000 mgr.a (mgr.14355) 5467 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:20 smithi007 bash[22722]: cluster 2024-09-14T00:27:19.085740+0000 mgr.a (mgr.14355) 5468 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:20 smithi131 bash[24745]: cluster 2024-09-14T00:27:19.085740+0000 mgr.a (mgr.14355) 5468 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:20 smithi171 bash[25040]: cluster 2024-09-14T00:27:19.085740+0000 mgr.a (mgr.14355) 5468 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:20.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:21 smithi007 bash[22722]: audit 2024-09-14T00:27:20.451285+0000 mgr.a (mgr.14355) 5469 : audit [DBG] from='client.127353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:21 smithi131 bash[24745]: audit 2024-09-14T00:27:20.451285+0000 mgr.a (mgr.14355) 5469 : audit [DBG] from='client.127353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:21 smithi171 bash[25040]: audit 2024-09-14T00:27:20.451285+0000 mgr.a (mgr.14355) 5469 : audit [DBG] from='client.127353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:22 smithi007 bash[22722]: cluster 2024-09-14T00:27:21.088578+0000 mgr.a (mgr.14355) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:22 smithi131 bash[24745]: cluster 2024-09-14T00:27:21.088578+0000 mgr.a (mgr.14355) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:22 smithi171 bash[25040]: cluster 2024-09-14T00:27:21.088578+0000 mgr.a (mgr.14355) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:24 smithi007 bash[22722]: cluster 2024-09-14T00:27:23.089408+0000 mgr.a (mgr.14355) 5471 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:24 smithi131 bash[24745]: cluster 2024-09-14T00:27:23.089408+0000 mgr.a (mgr.14355) 5471 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:24 smithi171 bash[25040]: cluster 2024-09-14T00:27:23.089408+0000 mgr.a (mgr.14355) 5471 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:25.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:25.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:25.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:26 smithi007 bash[22722]: cluster 2024-09-14T00:27:25.090178+0000 mgr.a (mgr.14355) 5472 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:27:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:26 smithi131 bash[24745]: cluster 2024-09-14T00:27:25.090178+0000 mgr.a (mgr.14355) 5472 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:27:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:26 smithi171 bash[25040]: cluster 2024-09-14T00:27:25.090178+0000 mgr.a (mgr.14355) 5472 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:27:26.609 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:26.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:26.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:26.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:26.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:27 smithi007 bash[22722]: audit 2024-09-14T00:27:26.193664+0000 mgr.a (mgr.14355) 5473 : audit [DBG] from='client.127431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:27 smithi131 bash[24745]: audit 2024-09-14T00:27:26.193664+0000 mgr.a (mgr.14355) 5473 : audit [DBG] from='client.127431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:27 smithi171 bash[25040]: audit 2024-09-14T00:27:26.193664+0000 mgr.a (mgr.14355) 5473 : audit [DBG] from='client.127431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:28 smithi007 bash[22722]: cluster 2024-09-14T00:27:27.093148+0000 mgr.a (mgr.14355) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:28 smithi131 bash[24745]: cluster 2024-09-14T00:27:27.093148+0000 mgr.a (mgr.14355) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:28 smithi171 bash[25040]: cluster 2024-09-14T00:27:27.093148+0000 mgr.a (mgr.14355) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:30 smithi007 bash[22722]: cluster 2024-09-14T00:27:29.094135+0000 mgr.a (mgr.14355) 5475 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:30 smithi131 bash[24745]: cluster 2024-09-14T00:27:29.094135+0000 mgr.a (mgr.14355) 5475 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:30 smithi171 bash[25040]: cluster 2024-09-14T00:27:29.094135+0000 mgr.a (mgr.14355) 5475 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:27:31.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:31.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:32.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:32.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:32.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:32 smithi007 bash[22722]: cluster 2024-09-14T00:27:31.096260+0000 mgr.a (mgr.14355) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:32 smithi131 bash[24745]: cluster 2024-09-14T00:27:31.096260+0000 mgr.a (mgr.14355) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:32 smithi171 bash[25040]: cluster 2024-09-14T00:27:31.096260+0000 mgr.a (mgr.14355) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:33 smithi007 bash[22722]: audit 2024-09-14T00:27:31.944448+0000 mgr.a (mgr.14355) 5477 : audit [DBG] from='client.127509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:33 smithi131 bash[24745]: audit 2024-09-14T00:27:31.944448+0000 mgr.a (mgr.14355) 5477 : audit [DBG] from='client.127509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:33 smithi171 bash[25040]: audit 2024-09-14T00:27:31.944448+0000 mgr.a (mgr.14355) 5477 : audit [DBG] from='client.127509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:34 smithi007 bash[22722]: cluster 2024-09-14T00:27:33.097228+0000 mgr.a (mgr.14355) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:34 smithi131 bash[24745]: cluster 2024-09-14T00:27:33.097228+0000 mgr.a (mgr.14355) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:34 smithi171 bash[25040]: cluster 2024-09-14T00:27:33.097228+0000 mgr.a (mgr.14355) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:36 smithi007 bash[22722]: cluster 2024-09-14T00:27:35.098002+0000 mgr.a (mgr.14355) 5479 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:36 smithi131 bash[24745]: cluster 2024-09-14T00:27:35.098002+0000 mgr.a (mgr.14355) 5479 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:36 smithi171 bash[25040]: cluster 2024-09-14T00:27:35.098002+0000 mgr.a (mgr.14355) 5479 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:37.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:38.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:38.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:38 smithi007 bash[22722]: cluster 2024-09-14T00:27:37.100243+0000 mgr.a (mgr.14355) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:38 smithi007 bash[22722]: audit 2024-09-14T00:27:37.725812+0000 mgr.a (mgr.14355) 5481 : audit [DBG] from='client.127584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:38 smithi131 bash[24745]: cluster 2024-09-14T00:27:37.100243+0000 mgr.a (mgr.14355) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:38 smithi131 bash[24745]: audit 2024-09-14T00:27:37.725812+0000 mgr.a (mgr.14355) 5481 : audit [DBG] from='client.127584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:38 smithi171 bash[25040]: cluster 2024-09-14T00:27:37.100243+0000 mgr.a (mgr.14355) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:38 smithi171 bash[25040]: audit 2024-09-14T00:27:37.725812+0000 mgr.a (mgr.14355) 5481 : audit [DBG] from='client.127584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:40 smithi007 bash[22722]: cluster 2024-09-14T00:27:39.101176+0000 mgr.a (mgr.14355) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:40 smithi131 bash[24745]: cluster 2024-09-14T00:27:39.101176+0000 mgr.a (mgr.14355) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:40 smithi171 bash[25040]: cluster 2024-09-14T00:27:39.101176+0000 mgr.a (mgr.14355) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:42 smithi131 bash[24745]: cluster 2024-09-14T00:27:41.103461+0000 mgr.a (mgr.14355) 5483 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:42 smithi171 bash[25040]: cluster 2024-09-14T00:27:41.103461+0000 mgr.a (mgr.14355) 5483 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:42 smithi007 bash[22722]: cluster 2024-09-14T00:27:41.103461+0000 mgr.a (mgr.14355) 5483 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:43.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:43.163 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:43.163 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:43.937 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:43.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:44 smithi131 bash[24745]: cluster 2024-09-14T00:27:43.104267+0000 mgr.a (mgr.14355) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:44.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:44 smithi131 bash[24745]: audit 2024-09-14T00:27:43.497556+0000 mgr.a (mgr.14355) 5485 : audit [DBG] from='client.127662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:44 smithi171 bash[25040]: cluster 2024-09-14T00:27:43.104267+0000 mgr.a (mgr.14355) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:44 smithi171 bash[25040]: audit 2024-09-14T00:27:43.497556+0000 mgr.a (mgr.14355) 5485 : audit [DBG] from='client.127662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:44 smithi007 bash[22722]: cluster 2024-09-14T00:27:43.104267+0000 mgr.a (mgr.14355) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:44 smithi007 bash[22722]: audit 2024-09-14T00:27:43.497556+0000 mgr.a (mgr.14355) 5485 : audit [DBG] from='client.127662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:46 smithi131 bash[24745]: cluster 2024-09-14T00:27:45.105244+0000 mgr.a (mgr.14355) 5486 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:46 smithi171 bash[25040]: cluster 2024-09-14T00:27:45.105244+0000 mgr.a (mgr.14355) 5486 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:46 smithi007 bash[22722]: cluster 2024-09-14T00:27:45.105244+0000 mgr.a (mgr.14355) 5486 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:48 smithi131 bash[24745]: cluster 2024-09-14T00:27:47.107556+0000 mgr.a (mgr.14355) 5487 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:48 smithi131 bash[24745]: audit 2024-09-14T00:27:47.739814+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:27:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:48 smithi171 bash[25040]: cluster 2024-09-14T00:27:47.107556+0000 mgr.a (mgr.14355) 5487 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:48 smithi171 bash[25040]: audit 2024-09-14T00:27:47.739814+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:27:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:48 smithi007 bash[22722]: cluster 2024-09-14T00:27:47.107556+0000 mgr.a (mgr.14355) 5487 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:48 smithi007 bash[22722]: audit 2024-09-14T00:27:47.739814+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:27:48.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:48.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:49.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:49.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:49.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:50 smithi131 bash[24745]: cluster 2024-09-14T00:27:49.108283+0000 mgr.a (mgr.14355) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:50 smithi131 bash[24745]: audit 2024-09-14T00:27:49.274543+0000 mgr.a (mgr.14355) 5489 : audit [DBG] from='client.127740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:50 smithi171 bash[25040]: cluster 2024-09-14T00:27:49.108283+0000 mgr.a (mgr.14355) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:50 smithi171 bash[25040]: audit 2024-09-14T00:27:49.274543+0000 mgr.a (mgr.14355) 5489 : audit [DBG] from='client.127740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:50 smithi007 bash[22722]: cluster 2024-09-14T00:27:49.108283+0000 mgr.a (mgr.14355) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:50 smithi007 bash[22722]: audit 2024-09-14T00:27:49.274543+0000 mgr.a (mgr.14355) 5489 : audit [DBG] from='client.127740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:52 smithi131 bash[24745]: cluster 2024-09-14T00:27:51.110708+0000 mgr.a (mgr.14355) 5490 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:52 smithi171 bash[25040]: cluster 2024-09-14T00:27:51.110708+0000 mgr.a (mgr.14355) 5490 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:52 smithi007 bash[22722]: cluster 2024-09-14T00:27:51.110708+0000 mgr.a (mgr.14355) 5490 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:27:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.076049+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.083745+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: cluster 2024-09-14T00:27:53.111168+0000 mgr.a (mgr.14355) 5491 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.115609+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.122830+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.130245+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.136371+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.837192+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.838979+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.849196+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22722]: audit 2024-09-14T00:27:53.853840+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.076049+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.083745+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: cluster 2024-09-14T00:27:53.111168+0000 mgr.a (mgr.14355) 5491 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.115609+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.122830+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.130245+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.136371+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.837192+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:27:54.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.838979+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:27:54.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.849196+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:54 smithi131 bash[24745]: audit 2024-09-14T00:27:53.853840+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.076049+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.083745+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: cluster 2024-09-14T00:27:53.111168+0000 mgr.a (mgr.14355) 5491 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.115609+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.122830+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.130245+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.136371+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.837192+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.838979+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:27:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.849196+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:27:54.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:54 smithi171 bash[25040]: audit 2024-09-14T00:27:53.853840+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:54.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:27:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:27:54.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:27:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22972]: debug 2024-09-14T00:27:54.575+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:27:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:27:54 smithi007 bash[22972]: debug 2024-09-14T00:27:54.575+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:27:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:55 smithi007 bash[22722]: audit 2024-09-14T00:27:53.855048+0000 mgr.a (mgr.14355) 5492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:55 smithi007 bash[22722]: audit 2024-09-14T00:27:54.579659+0000 mgr.a (mgr.14355) 5493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:27:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:55 smithi007 bash[22722]: cephadm 2024-09-14T00:27:54.580762+0000 mgr.a (mgr.14355) 5494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:27:55.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:27:55.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:27:55.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:27:55.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:27:55.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:27:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:55 smithi131 bash[24745]: audit 2024-09-14T00:27:53.855048+0000 mgr.a (mgr.14355) 5492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:55 smithi131 bash[24745]: audit 2024-09-14T00:27:54.579659+0000 mgr.a (mgr.14355) 5493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:27:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:55 smithi131 bash[24745]: cephadm 2024-09-14T00:27:54.580762+0000 mgr.a (mgr.14355) 5494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:27:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:55 smithi171 bash[25040]: audit 2024-09-14T00:27:53.855048+0000 mgr.a (mgr.14355) 5492 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:27:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:55 smithi171 bash[25040]: audit 2024-09-14T00:27:54.579659+0000 mgr.a (mgr.14355) 5493 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:27:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:55 smithi171 bash[25040]: cephadm 2024-09-14T00:27:54.580762+0000 mgr.a (mgr.14355) 5494 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:27:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:56 smithi007 bash[22722]: audit 2024-09-14T00:27:55.025242+0000 mgr.a (mgr.14355) 5495 : audit [DBG] from='client.127926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:56 smithi007 bash[22722]: cluster 2024-09-14T00:27:55.111702+0000 mgr.a (mgr.14355) 5496 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:56 smithi131 bash[24745]: audit 2024-09-14T00:27:55.025242+0000 mgr.a (mgr.14355) 5495 : audit [DBG] from='client.127926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:56 smithi131 bash[24745]: cluster 2024-09-14T00:27:55.111702+0000 mgr.a (mgr.14355) 5496 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:56 smithi171 bash[25040]: audit 2024-09-14T00:27:55.025242+0000 mgr.a (mgr.14355) 5495 : audit [DBG] from='client.127926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:27:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:56 smithi171 bash[25040]: cluster 2024-09-14T00:27:55.111702+0000 mgr.a (mgr.14355) 5496 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:27:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:27:58 smithi007 bash[22722]: cluster 2024-09-14T00:27:57.114592+0000 mgr.a (mgr.14355) 5497 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:27:58 smithi131 bash[24745]: cluster 2024-09-14T00:27:57.114592+0000 mgr.a (mgr.14355) 5497 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:27:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:27:58 smithi171 bash[25040]: cluster 2024-09-14T00:27:57.114592+0000 mgr.a (mgr.14355) 5497 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:00 smithi007 bash[22722]: cluster 2024-09-14T00:27:59.115418+0000 mgr.a (mgr.14355) 5498 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:00 smithi131 bash[24745]: cluster 2024-09-14T00:27:59.115418+0000 mgr.a (mgr.14355) 5498 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:00 smithi171 bash[25040]: cluster 2024-09-14T00:27:59.115418+0000 mgr.a (mgr.14355) 5498 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:01.234 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:01.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:01.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:01.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:01.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:02 smithi007 bash[22722]: audit 2024-09-14T00:28:00.796486+0000 mgr.a (mgr.14355) 5499 : audit [DBG] from='client.127998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:02 smithi007 bash[22722]: cluster 2024-09-14T00:28:01.116790+0000 mgr.a (mgr.14355) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:02 smithi131 bash[24745]: audit 2024-09-14T00:28:00.796486+0000 mgr.a (mgr.14355) 5499 : audit [DBG] from='client.127998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:02 smithi131 bash[24745]: cluster 2024-09-14T00:28:01.116790+0000 mgr.a (mgr.14355) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:02 smithi171 bash[25040]: audit 2024-09-14T00:28:00.796486+0000 mgr.a (mgr.14355) 5499 : audit [DBG] from='client.127998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:02 smithi171 bash[25040]: cluster 2024-09-14T00:28:01.116790+0000 mgr.a (mgr.14355) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:04 smithi007 bash[22722]: cluster 2024-09-14T00:28:03.117642+0000 mgr.a (mgr.14355) 5501 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:04 smithi131 bash[24745]: cluster 2024-09-14T00:28:03.117642+0000 mgr.a (mgr.14355) 5501 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:04 smithi171 bash[25040]: cluster 2024-09-14T00:28:03.117642+0000 mgr.a (mgr.14355) 5501 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:06.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:06.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:06.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:06 smithi007 bash[22722]: cluster 2024-09-14T00:28:05.118467+0000 mgr.a (mgr.14355) 5502 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:06 smithi131 bash[24745]: cluster 2024-09-14T00:28:05.118467+0000 mgr.a (mgr.14355) 5502 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:06 smithi171 bash[25040]: cluster 2024-09-14T00:28:05.118467+0000 mgr.a (mgr.14355) 5502 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:28:07.015 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:07 smithi007 bash[22722]: audit 2024-09-14T00:28:06.573952+0000 mgr.a (mgr.14355) 5503 : audit [DBG] from='client.128076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:07 smithi131 bash[24745]: audit 2024-09-14T00:28:06.573952+0000 mgr.a (mgr.14355) 5503 : audit [DBG] from='client.128076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:07 smithi171 bash[25040]: audit 2024-09-14T00:28:06.573952+0000 mgr.a (mgr.14355) 5503 : audit [DBG] from='client.128076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:08 smithi131 bash[24745]: cluster 2024-09-14T00:28:07.121307+0000 mgr.a (mgr.14355) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:08 smithi171 bash[25040]: cluster 2024-09-14T00:28:07.121307+0000 mgr.a (mgr.14355) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:08 smithi007 bash[22722]: cluster 2024-09-14T00:28:07.121307+0000 mgr.a (mgr.14355) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:28:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:10 smithi131 bash[24745]: cluster 2024-09-14T00:28:09.122107+0000 mgr.a (mgr.14355) 5505 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:10 smithi171 bash[25040]: cluster 2024-09-14T00:28:09.122107+0000 mgr.a (mgr.14355) 5505 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:10 smithi007 bash[22722]: cluster 2024-09-14T00:28:09.122107+0000 mgr.a (mgr.14355) 5505 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:12.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:12.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:12.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:12 smithi131 bash[24745]: cluster 2024-09-14T00:28:11.124044+0000 mgr.a (mgr.14355) 5506 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:12 smithi171 bash[25040]: cluster 2024-09-14T00:28:11.124044+0000 mgr.a (mgr.14355) 5506 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:12 smithi007 bash[22722]: cluster 2024-09-14T00:28:11.124044+0000 mgr.a (mgr.14355) 5506 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:12.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:12.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:13 smithi131 bash[24745]: audit 2024-09-14T00:28:12.351008+0000 mgr.a (mgr.14355) 5507 : audit [DBG] from='client.128154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:13 smithi171 bash[25040]: audit 2024-09-14T00:28:12.351008+0000 mgr.a (mgr.14355) 5507 : audit [DBG] from='client.128154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:13 smithi007 bash[22722]: audit 2024-09-14T00:28:12.351008+0000 mgr.a (mgr.14355) 5507 : audit [DBG] from='client.128154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:14 smithi131 bash[24745]: cluster 2024-09-14T00:28:13.124996+0000 mgr.a (mgr.14355) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:14 smithi171 bash[25040]: cluster 2024-09-14T00:28:13.124996+0000 mgr.a (mgr.14355) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:14 smithi007 bash[22722]: cluster 2024-09-14T00:28:13.124996+0000 mgr.a (mgr.14355) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:16 smithi131 bash[24745]: cluster 2024-09-14T00:28:15.125911+0000 mgr.a (mgr.14355) 5509 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:16 smithi171 bash[25040]: cluster 2024-09-14T00:28:15.125911+0000 mgr.a (mgr.14355) 5509 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:16 smithi007 bash[22722]: cluster 2024-09-14T00:28:15.125911+0000 mgr.a (mgr.14355) 5509 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:18 smithi131 bash[24745]: cluster 2024-09-14T00:28:17.128271+0000 mgr.a (mgr.14355) 5510 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:18 smithi171 bash[25040]: cluster 2024-09-14T00:28:17.128271+0000 mgr.a (mgr.14355) 5510 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:18.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:18 smithi007 bash[22722]: cluster 2024-09-14T00:28:17.128271+0000 mgr.a (mgr.14355) 5510 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:19 smithi131 bash[24745]: audit 2024-09-14T00:28:18.129436+0000 mgr.a (mgr.14355) 5511 : audit [DBG] from='client.128232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:19 smithi171 bash[25040]: audit 2024-09-14T00:28:18.129436+0000 mgr.a (mgr.14355) 5511 : audit [DBG] from='client.128232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:19 smithi007 bash[22722]: audit 2024-09-14T00:28:18.129436+0000 mgr.a (mgr.14355) 5511 : audit [DBG] from='client.128232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:20 smithi131 bash[24745]: cluster 2024-09-14T00:28:19.129193+0000 mgr.a (mgr.14355) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:20 smithi171 bash[25040]: cluster 2024-09-14T00:28:19.129193+0000 mgr.a (mgr.14355) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:20 smithi007 bash[22722]: cluster 2024-09-14T00:28:19.129193+0000 mgr.a (mgr.14355) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:22 smithi131 bash[24745]: cluster 2024-09-14T00:28:21.131572+0000 mgr.a (mgr.14355) 5513 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:22 smithi171 bash[25040]: cluster 2024-09-14T00:28:21.131572+0000 mgr.a (mgr.14355) 5513 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:22 smithi007 bash[22722]: cluster 2024-09-14T00:28:21.131572+0000 mgr.a (mgr.14355) 5513 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:23.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:23.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:23.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:24.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:24.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:24.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:24 smithi131 bash[24745]: cluster 2024-09-14T00:28:23.132525+0000 mgr.a (mgr.14355) 5514 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:24 smithi171 bash[25040]: cluster 2024-09-14T00:28:23.132525+0000 mgr.a (mgr.14355) 5514 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:24 smithi007 bash[22722]: cluster 2024-09-14T00:28:23.132525+0000 mgr.a (mgr.14355) 5514 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:25 smithi131 bash[24745]: audit 2024-09-14T00:28:23.889051+0000 mgr.a (mgr.14355) 5515 : audit [DBG] from='client.128304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:25 smithi171 bash[25040]: audit 2024-09-14T00:28:23.889051+0000 mgr.a (mgr.14355) 5515 : audit [DBG] from='client.128304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:25 smithi007 bash[22722]: audit 2024-09-14T00:28:23.889051+0000 mgr.a (mgr.14355) 5515 : audit [DBG] from='client.128304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:26 smithi131 bash[24745]: cluster 2024-09-14T00:28:25.133503+0000 mgr.a (mgr.14355) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:26 smithi171 bash[25040]: cluster 2024-09-14T00:28:25.133503+0000 mgr.a (mgr.14355) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:26 smithi007 bash[22722]: cluster 2024-09-14T00:28:25.133503+0000 mgr.a (mgr.14355) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:28 smithi131 bash[24745]: cluster 2024-09-14T00:28:27.135854+0000 mgr.a (mgr.14355) 5517 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:28 smithi171 bash[25040]: cluster 2024-09-14T00:28:27.135854+0000 mgr.a (mgr.14355) 5517 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:28 smithi007 bash[22722]: cluster 2024-09-14T00:28:27.135854+0000 mgr.a (mgr.14355) 5517 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:29.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:29.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:29.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:30.085 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:30 smithi131 bash[24745]: cluster 2024-09-14T00:28:29.136631+0000 mgr.a (mgr.14355) 5518 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:30 smithi131 bash[24745]: audit 2024-09-14T00:28:29.666481+0000 mgr.a (mgr.14355) 5519 : audit [DBG] from='client.128379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:30 smithi171 bash[25040]: cluster 2024-09-14T00:28:29.136631+0000 mgr.a (mgr.14355) 5518 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:30 smithi171 bash[25040]: audit 2024-09-14T00:28:29.666481+0000 mgr.a (mgr.14355) 5519 : audit [DBG] from='client.128379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:30 smithi007 bash[22722]: cluster 2024-09-14T00:28:29.136631+0000 mgr.a (mgr.14355) 5518 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:30 smithi007 bash[22722]: audit 2024-09-14T00:28:29.666481+0000 mgr.a (mgr.14355) 5519 : audit [DBG] from='client.128379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:32 smithi131 bash[24745]: cluster 2024-09-14T00:28:31.138977+0000 mgr.a (mgr.14355) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:32 smithi171 bash[25040]: cluster 2024-09-14T00:28:31.138977+0000 mgr.a (mgr.14355) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:32 smithi007 bash[22722]: cluster 2024-09-14T00:28:31.138977+0000 mgr.a (mgr.14355) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:34 smithi171 bash[25040]: cluster 2024-09-14T00:28:33.139755+0000 mgr.a (mgr.14355) 5521 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:34 smithi007 bash[22722]: cluster 2024-09-14T00:28:33.139755+0000 mgr.a (mgr.14355) 5521 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:34 smithi131 bash[24745]: cluster 2024-09-14T00:28:33.139755+0000 mgr.a (mgr.14355) 5521 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:35.088 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:35.865 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:35.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:36 smithi171 bash[25040]: cluster 2024-09-14T00:28:35.140490+0000 mgr.a (mgr.14355) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:36 smithi171 bash[25040]: audit 2024-09-14T00:28:35.423358+0000 mgr.a (mgr.14355) 5523 : audit [DBG] from='client.128454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:36 smithi007 bash[22722]: cluster 2024-09-14T00:28:35.140490+0000 mgr.a (mgr.14355) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:36 smithi007 bash[22722]: audit 2024-09-14T00:28:35.423358+0000 mgr.a (mgr.14355) 5523 : audit [DBG] from='client.128454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:36 smithi131 bash[24745]: cluster 2024-09-14T00:28:35.140490+0000 mgr.a (mgr.14355) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:36 smithi131 bash[24745]: audit 2024-09-14T00:28:35.423358+0000 mgr.a (mgr.14355) 5523 : audit [DBG] from='client.128454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:38 smithi007 bash[22722]: cluster 2024-09-14T00:28:37.143244+0000 mgr.a (mgr.14355) 5524 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:38 smithi131 bash[24745]: cluster 2024-09-14T00:28:37.143244+0000 mgr.a (mgr.14355) 5524 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:38 smithi171 bash[25040]: cluster 2024-09-14T00:28:37.143244+0000 mgr.a (mgr.14355) 5524 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:40 smithi007 bash[22722]: cluster 2024-09-14T00:28:39.144032+0000 mgr.a (mgr.14355) 5525 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:40 smithi131 bash[24745]: cluster 2024-09-14T00:28:39.144032+0000 mgr.a (mgr.14355) 5525 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:40 smithi171 bash[25040]: cluster 2024-09-14T00:28:39.144032+0000 mgr.a (mgr.14355) 5525 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:41.615 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:41.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:41.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:41.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:41.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:42 smithi007 bash[22722]: cluster 2024-09-14T00:28:41.146008+0000 mgr.a (mgr.14355) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:42 smithi007 bash[22722]: audit 2024-09-14T00:28:41.195747+0000 mgr.a (mgr.14355) 5527 : audit [DBG] from='client.128532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:42 smithi131 bash[24745]: cluster 2024-09-14T00:28:41.146008+0000 mgr.a (mgr.14355) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:42 smithi131 bash[24745]: audit 2024-09-14T00:28:41.195747+0000 mgr.a (mgr.14355) 5527 : audit [DBG] from='client.128532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:42 smithi171 bash[25040]: cluster 2024-09-14T00:28:41.146008+0000 mgr.a (mgr.14355) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:42 smithi171 bash[25040]: audit 2024-09-14T00:28:41.195747+0000 mgr.a (mgr.14355) 5527 : audit [DBG] from='client.128532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:44 smithi007 bash[22722]: cluster 2024-09-14T00:28:43.146911+0000 mgr.a (mgr.14355) 5528 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:44 smithi131 bash[24745]: cluster 2024-09-14T00:28:43.146911+0000 mgr.a (mgr.14355) 5528 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:44 smithi171 bash[25040]: cluster 2024-09-14T00:28:43.146911+0000 mgr.a (mgr.14355) 5528 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:28:46.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:46.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:46.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:46 smithi007 bash[22722]: cluster 2024-09-14T00:28:45.147731+0000 mgr.a (mgr.14355) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:28:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:46 smithi131 bash[24745]: cluster 2024-09-14T00:28:45.147731+0000 mgr.a (mgr.14355) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:28:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:46 smithi171 bash[25040]: cluster 2024-09-14T00:28:45.147731+0000 mgr.a (mgr.14355) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:28:47.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:47.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:48 smithi007 bash[22722]: audit 2024-09-14T00:28:46.950081+0000 mgr.a (mgr.14355) 5530 : audit [DBG] from='client.128610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:48 smithi007 bash[22722]: cluster 2024-09-14T00:28:47.149321+0000 mgr.a (mgr.14355) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:48 smithi131 bash[24745]: audit 2024-09-14T00:28:46.950081+0000 mgr.a (mgr.14355) 5530 : audit [DBG] from='client.128610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:48 smithi131 bash[24745]: cluster 2024-09-14T00:28:47.149321+0000 mgr.a (mgr.14355) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:48 smithi171 bash[25040]: audit 2024-09-14T00:28:46.950081+0000 mgr.a (mgr.14355) 5530 : audit [DBG] from='client.128610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:48 smithi171 bash[25040]: cluster 2024-09-14T00:28:47.149321+0000 mgr.a (mgr.14355) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:50 smithi007 bash[22722]: cluster 2024-09-14T00:28:49.150181+0000 mgr.a (mgr.14355) 5532 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:50 smithi131 bash[24745]: cluster 2024-09-14T00:28:49.150181+0000 mgr.a (mgr.14355) 5532 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:50 smithi171 bash[25040]: cluster 2024-09-14T00:28:49.150181+0000 mgr.a (mgr.14355) 5532 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:52.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:52.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:52.400 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:52 smithi007 bash[22722]: cluster 2024-09-14T00:28:51.152394+0000 mgr.a (mgr.14355) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:52 smithi131 bash[24745]: cluster 2024-09-14T00:28:51.152394+0000 mgr.a (mgr.14355) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:52 smithi171 bash[25040]: cluster 2024-09-14T00:28:51.152394+0000 mgr.a (mgr.14355) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:53.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:53 smithi007 bash[22722]: audit 2024-09-14T00:28:52.734543+0000 mgr.a (mgr.14355) 5534 : audit [DBG] from='client.128688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:53 smithi131 bash[24745]: audit 2024-09-14T00:28:52.734543+0000 mgr.a (mgr.14355) 5534 : audit [DBG] from='client.128688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:53 smithi171 bash[25040]: audit 2024-09-14T00:28:52.734543+0000 mgr.a (mgr.14355) 5534 : audit [DBG] from='client.128688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:54 smithi007 bash[22722]: cluster 2024-09-14T00:28:53.153050+0000 mgr.a (mgr.14355) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:54 smithi131 bash[24745]: cluster 2024-09-14T00:28:53.153050+0000 mgr.a (mgr.14355) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:54 smithi171 bash[25040]: cluster 2024-09-14T00:28:53.153050+0000 mgr.a (mgr.14355) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:55 smithi007 bash[22722]: audit 2024-09-14T00:28:54.631629+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:28:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:55 smithi131 bash[24745]: audit 2024-09-14T00:28:54.631629+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:28:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:55 smithi171 bash[25040]: audit 2024-09-14T00:28:54.631629+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22972]: debug 2024-09-14T00:28:56.250+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22972]: debug 2024-09-14T00:28:56.254+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: cluster 2024-09-14T00:28:55.153587+0000 mgr.a (mgr.14355) 5536 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: audit 2024-09-14T00:28:55.507631+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: audit 2024-09-14T00:28:55.509322+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: audit 2024-09-14T00:28:55.519748+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: audit 2024-09-14T00:28:55.524502+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:56 smithi007 bash[22722]: audit 2024-09-14T00:28:55.525984+0000 mgr.a (mgr.14355) 5537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: cluster 2024-09-14T00:28:55.153587+0000 mgr.a (mgr.14355) 5536 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: audit 2024-09-14T00:28:55.507631+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:28:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: audit 2024-09-14T00:28:55.509322+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:28:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: audit 2024-09-14T00:28:55.519748+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:28:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: audit 2024-09-14T00:28:55.524502+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:56 smithi131 bash[24745]: audit 2024-09-14T00:28:55.525984+0000 mgr.a (mgr.14355) 5537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: cluster 2024-09-14T00:28:55.153587+0000 mgr.a (mgr.14355) 5536 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:28:56.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: audit 2024-09-14T00:28:55.507631+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:28:56.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: audit 2024-09-14T00:28:55.509322+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:28:56.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: audit 2024-09-14T00:28:55.519748+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:28:56.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: audit 2024-09-14T00:28:55.524502+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:56.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:56 smithi171 bash[25040]: audit 2024-09-14T00:28:55.525984+0000 mgr.a (mgr.14355) 5537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:28:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:57 smithi007 bash[22722]: audit 2024-09-14T00:28:56.258215+0000 mgr.a (mgr.14355) 5538 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:28:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:57 smithi007 bash[22722]: cephadm 2024-09-14T00:28:56.259641+0000 mgr.a (mgr.14355) 5539 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:28:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:57 smithi131 bash[24745]: audit 2024-09-14T00:28:56.258215+0000 mgr.a (mgr.14355) 5538 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:28:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:57 smithi131 bash[24745]: cephadm 2024-09-14T00:28:56.259641+0000 mgr.a (mgr.14355) 5539 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:28:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:57 smithi171 bash[25040]: audit 2024-09-14T00:28:56.258215+0000 mgr.a (mgr.14355) 5538 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:28:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:57 smithi171 bash[25040]: cephadm 2024-09-14T00:28:56.259641+0000 mgr.a (mgr.14355) 5539 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:28:58.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:28:58.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:28:58.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:28:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:58 smithi007 bash[22722]: cluster 2024-09-14T00:28:57.156452+0000 mgr.a (mgr.14355) 5540 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:58 smithi131 bash[24745]: cluster 2024-09-14T00:28:57.156452+0000 mgr.a (mgr.14355) 5540 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:58 smithi171 bash[25040]: cluster 2024-09-14T00:28:57.156452+0000 mgr.a (mgr.14355) 5540 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:28:58.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:28:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:28:58.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:28:58.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:28:58.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:28:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:28:59 smithi007 bash[22722]: audit 2024-09-14T00:28:58.510870+0000 mgr.a (mgr.14355) 5541 : audit [DBG] from='client.128874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:28:59 smithi131 bash[24745]: audit 2024-09-14T00:28:58.510870+0000 mgr.a (mgr.14355) 5541 : audit [DBG] from='client.128874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:28:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:28:59 smithi171 bash[25040]: audit 2024-09-14T00:28:58.510870+0000 mgr.a (mgr.14355) 5541 : audit [DBG] from='client.128874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:00 smithi007 bash[22722]: cluster 2024-09-14T00:28:59.157463+0000 mgr.a (mgr.14355) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:00 smithi131 bash[24745]: cluster 2024-09-14T00:28:59.157463+0000 mgr.a (mgr.14355) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:00 smithi171 bash[25040]: cluster 2024-09-14T00:28:59.157463+0000 mgr.a (mgr.14355) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:02 smithi007 bash[22722]: cluster 2024-09-14T00:29:01.159742+0000 mgr.a (mgr.14355) 5543 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:02 smithi131 bash[24745]: cluster 2024-09-14T00:29:01.159742+0000 mgr.a (mgr.14355) 5543 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:02 smithi171 bash[25040]: cluster 2024-09-14T00:29:01.159742+0000 mgr.a (mgr.14355) 5543 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:03.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:03.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:03.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:04.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:04.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:04.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:04.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:04.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:04 smithi007 bash[22722]: cluster 2024-09-14T00:29:03.160507+0000 mgr.a (mgr.14355) 5544 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:04 smithi131 bash[24745]: cluster 2024-09-14T00:29:03.160507+0000 mgr.a (mgr.14355) 5544 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:04 smithi171 bash[25040]: cluster 2024-09-14T00:29:03.160507+0000 mgr.a (mgr.14355) 5544 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:05 smithi007 bash[22722]: audit 2024-09-14T00:29:04.288063+0000 mgr.a (mgr.14355) 5545 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:05 smithi131 bash[24745]: audit 2024-09-14T00:29:04.288063+0000 mgr.a (mgr.14355) 5545 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:05 smithi171 bash[25040]: audit 2024-09-14T00:29:04.288063+0000 mgr.a (mgr.14355) 5545 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:06 smithi007 bash[22722]: cluster 2024-09-14T00:29:05.161440+0000 mgr.a (mgr.14355) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:06 smithi131 bash[24745]: cluster 2024-09-14T00:29:05.161440+0000 mgr.a (mgr.14355) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:06 smithi171 bash[25040]: cluster 2024-09-14T00:29:05.161440+0000 mgr.a (mgr.14355) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:08 smithi007 bash[22722]: cluster 2024-09-14T00:29:07.163688+0000 mgr.a (mgr.14355) 5547 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:08 smithi131 bash[24745]: cluster 2024-09-14T00:29:07.163688+0000 mgr.a (mgr.14355) 5547 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:08 smithi171 bash[25040]: cluster 2024-09-14T00:29:07.163688+0000 mgr.a (mgr.14355) 5547 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:09.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:09.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:10.475 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:10 smithi007 bash[22722]: cluster 2024-09-14T00:29:09.164591+0000 mgr.a (mgr.14355) 5548 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:10 smithi131 bash[24745]: cluster 2024-09-14T00:29:09.164591+0000 mgr.a (mgr.14355) 5548 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:10 smithi171 bash[25040]: cluster 2024-09-14T00:29:09.164591+0000 mgr.a (mgr.14355) 5548 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:11 smithi007 bash[22722]: audit 2024-09-14T00:29:10.035449+0000 mgr.a (mgr.14355) 5549 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:11 smithi131 bash[24745]: audit 2024-09-14T00:29:10.035449+0000 mgr.a (mgr.14355) 5549 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:11 smithi171 bash[25040]: audit 2024-09-14T00:29:10.035449+0000 mgr.a (mgr.14355) 5549 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:12 smithi131 bash[24745]: cluster 2024-09-14T00:29:11.167376+0000 mgr.a (mgr.14355) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:12 smithi171 bash[25040]: cluster 2024-09-14T00:29:11.167376+0000 mgr.a (mgr.14355) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:12 smithi007 bash[22722]: cluster 2024-09-14T00:29:11.167376+0000 mgr.a (mgr.14355) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:29:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:14 smithi131 bash[24745]: cluster 2024-09-14T00:29:13.168189+0000 mgr.a (mgr.14355) 5551 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:14 smithi171 bash[25040]: cluster 2024-09-14T00:29:13.168189+0000 mgr.a (mgr.14355) 5551 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:14 smithi007 bash[22722]: cluster 2024-09-14T00:29:13.168189+0000 mgr.a (mgr.14355) 5551 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:16.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:16.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:16.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:16.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:16.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:16 smithi131 bash[24745]: cluster 2024-09-14T00:29:15.169004+0000 mgr.a (mgr.14355) 5552 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:16 smithi171 bash[25040]: cluster 2024-09-14T00:29:15.169004+0000 mgr.a (mgr.14355) 5552 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:16 smithi007 bash[22722]: cluster 2024-09-14T00:29:15.169004+0000 mgr.a (mgr.14355) 5552 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:17 smithi131 bash[24745]: audit 2024-09-14T00:29:15.811075+0000 mgr.a (mgr.14355) 5553 : audit [DBG] from='client.129102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:17 smithi171 bash[25040]: audit 2024-09-14T00:29:15.811075+0000 mgr.a (mgr.14355) 5553 : audit [DBG] from='client.129102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:17 smithi007 bash[22722]: audit 2024-09-14T00:29:15.811075+0000 mgr.a (mgr.14355) 5553 : audit [DBG] from='client.129102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:18 smithi131 bash[24745]: cluster 2024-09-14T00:29:17.171776+0000 mgr.a (mgr.14355) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:18 smithi171 bash[25040]: cluster 2024-09-14T00:29:17.171776+0000 mgr.a (mgr.14355) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:18 smithi007 bash[22722]: cluster 2024-09-14T00:29:17.171776+0000 mgr.a (mgr.14355) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:20 smithi131 bash[24745]: cluster 2024-09-14T00:29:19.172583+0000 mgr.a (mgr.14355) 5555 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:20 smithi171 bash[25040]: cluster 2024-09-14T00:29:19.172583+0000 mgr.a (mgr.14355) 5555 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:20 smithi007 bash[22722]: cluster 2024-09-14T00:29:19.172583+0000 mgr.a (mgr.14355) 5555 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:21.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:21.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:21.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:21.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:21.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:21.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:21.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:22 smithi131 bash[24745]: cluster 2024-09-14T00:29:21.174624+0000 mgr.a (mgr.14355) 5556 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:22.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:22 smithi131 bash[24745]: audit 2024-09-14T00:29:21.575950+0000 mgr.a (mgr.14355) 5557 : audit [DBG] from='client.129180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:22 smithi171 bash[25040]: cluster 2024-09-14T00:29:21.174624+0000 mgr.a (mgr.14355) 5556 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:22 smithi171 bash[25040]: audit 2024-09-14T00:29:21.575950+0000 mgr.a (mgr.14355) 5557 : audit [DBG] from='client.129180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:22 smithi007 bash[22722]: cluster 2024-09-14T00:29:21.174624+0000 mgr.a (mgr.14355) 5556 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:22 smithi007 bash[22722]: audit 2024-09-14T00:29:21.575950+0000 mgr.a (mgr.14355) 5557 : audit [DBG] from='client.129180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:24 smithi131 bash[24745]: cluster 2024-09-14T00:29:23.175532+0000 mgr.a (mgr.14355) 5558 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:24 smithi171 bash[25040]: cluster 2024-09-14T00:29:23.175532+0000 mgr.a (mgr.14355) 5558 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:24 smithi007 bash[22722]: cluster 2024-09-14T00:29:23.175532+0000 mgr.a (mgr.14355) 5558 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:26 smithi131 bash[24745]: cluster 2024-09-14T00:29:25.176322+0000 mgr.a (mgr.14355) 5559 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:26 smithi171 bash[25040]: cluster 2024-09-14T00:29:25.176322+0000 mgr.a (mgr.14355) 5559 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:26 smithi007 bash[22722]: cluster 2024-09-14T00:29:25.176322+0000 mgr.a (mgr.14355) 5559 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:26.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:26.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:26.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:27.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:28 smithi131 bash[24745]: cluster 2024-09-14T00:29:27.178506+0000 mgr.a (mgr.14355) 5560 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:28.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:28 smithi131 bash[24745]: audit 2024-09-14T00:29:27.322745+0000 mgr.a (mgr.14355) 5561 : audit [DBG] from='client.129258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:28 smithi171 bash[25040]: cluster 2024-09-14T00:29:27.178506+0000 mgr.a (mgr.14355) 5560 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:28 smithi171 bash[25040]: audit 2024-09-14T00:29:27.322745+0000 mgr.a (mgr.14355) 5561 : audit [DBG] from='client.129258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:28 smithi007 bash[22722]: cluster 2024-09-14T00:29:27.178506+0000 mgr.a (mgr.14355) 5560 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:28 smithi007 bash[22722]: audit 2024-09-14T00:29:27.322745+0000 mgr.a (mgr.14355) 5561 : audit [DBG] from='client.129258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:30 smithi131 bash[24745]: cluster 2024-09-14T00:29:29.179381+0000 mgr.a (mgr.14355) 5562 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:30 smithi171 bash[25040]: cluster 2024-09-14T00:29:29.179381+0000 mgr.a (mgr.14355) 5562 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:30 smithi007 bash[22722]: cluster 2024-09-14T00:29:29.179381+0000 mgr.a (mgr.14355) 5562 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:32.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:32.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:32 smithi131 bash[24745]: cluster 2024-09-14T00:29:31.181622+0000 mgr.a (mgr.14355) 5563 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:32 smithi171 bash[25040]: cluster 2024-09-14T00:29:31.181622+0000 mgr.a (mgr.14355) 5563 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:32 smithi007 bash[22722]: cluster 2024-09-14T00:29:31.181622+0000 mgr.a (mgr.14355) 5563 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:33.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:33.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:33.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:33.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:33.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:34 smithi131 bash[24745]: audit 2024-09-14T00:29:33.081325+0000 mgr.a (mgr.14355) 5564 : audit [DBG] from='client.129336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:34.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:34 smithi131 bash[24745]: cluster 2024-09-14T00:29:33.182189+0000 mgr.a (mgr.14355) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:34 smithi171 bash[25040]: audit 2024-09-14T00:29:33.081325+0000 mgr.a (mgr.14355) 5564 : audit [DBG] from='client.129336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:34 smithi171 bash[25040]: cluster 2024-09-14T00:29:33.182189+0000 mgr.a (mgr.14355) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:34 smithi007 bash[22722]: audit 2024-09-14T00:29:33.081325+0000 mgr.a (mgr.14355) 5564 : audit [DBG] from='client.129336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:34 smithi007 bash[22722]: cluster 2024-09-14T00:29:33.182189+0000 mgr.a (mgr.14355) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:36 smithi171 bash[25040]: cluster 2024-09-14T00:29:35.183035+0000 mgr.a (mgr.14355) 5566 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:36 smithi007 bash[22722]: cluster 2024-09-14T00:29:35.183035+0000 mgr.a (mgr.14355) 5566 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:36 smithi131 bash[24745]: cluster 2024-09-14T00:29:35.183035+0000 mgr.a (mgr.14355) 5566 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:38 smithi171 bash[25040]: cluster 2024-09-14T00:29:37.185237+0000 mgr.a (mgr.14355) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:38 smithi007 bash[22722]: cluster 2024-09-14T00:29:37.185237+0000 mgr.a (mgr.14355) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:38 smithi131 bash[24745]: cluster 2024-09-14T00:29:37.185237+0000 mgr.a (mgr.14355) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:39.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:39.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:40 smithi171 bash[25040]: audit 2024-09-14T00:29:38.853763+0000 mgr.a (mgr.14355) 5568 : audit [DBG] from='client.129414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:40 smithi171 bash[25040]: cluster 2024-09-14T00:29:39.192796+0000 mgr.a (mgr.14355) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:40 smithi007 bash[22722]: audit 2024-09-14T00:29:38.853763+0000 mgr.a (mgr.14355) 5568 : audit [DBG] from='client.129414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:40 smithi007 bash[22722]: cluster 2024-09-14T00:29:39.192796+0000 mgr.a (mgr.14355) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:40 smithi131 bash[24745]: audit 2024-09-14T00:29:38.853763+0000 mgr.a (mgr.14355) 5568 : audit [DBG] from='client.129414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:40 smithi131 bash[24745]: cluster 2024-09-14T00:29:39.192796+0000 mgr.a (mgr.14355) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:42 smithi007 bash[22722]: cluster 2024-09-14T00:29:41.195056+0000 mgr.a (mgr.14355) 5570 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:42 smithi131 bash[24745]: cluster 2024-09-14T00:29:41.195056+0000 mgr.a (mgr.14355) 5570 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:42 smithi171 bash[25040]: cluster 2024-09-14T00:29:41.195056+0000 mgr.a (mgr.14355) 5570 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:44.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:44 smithi007 bash[22722]: cluster 2024-09-14T00:29:43.195798+0000 mgr.a (mgr.14355) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:44 smithi131 bash[24745]: cluster 2024-09-14T00:29:43.195798+0000 mgr.a (mgr.14355) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:44 smithi171 bash[25040]: cluster 2024-09-14T00:29:43.195798+0000 mgr.a (mgr.14355) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:45.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:45.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:45.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:45.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:45.081 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:45 smithi007 bash[22722]: audit 2024-09-14T00:29:44.635559+0000 mgr.a (mgr.14355) 5572 : audit [DBG] from='client.129489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:45 smithi131 bash[24745]: audit 2024-09-14T00:29:44.635559+0000 mgr.a (mgr.14355) 5572 : audit [DBG] from='client.129489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:45 smithi171 bash[25040]: audit 2024-09-14T00:29:44.635559+0000 mgr.a (mgr.14355) 5572 : audit [DBG] from='client.129489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:46 smithi007 bash[22722]: cluster 2024-09-14T00:29:45.196410+0000 mgr.a (mgr.14355) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:46 smithi131 bash[24745]: cluster 2024-09-14T00:29:45.196410+0000 mgr.a (mgr.14355) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:46 smithi171 bash[25040]: cluster 2024-09-14T00:29:45.196410+0000 mgr.a (mgr.14355) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:48 smithi007 bash[22722]: cluster 2024-09-14T00:29:47.198706+0000 mgr.a (mgr.14355) 5574 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:48 smithi131 bash[24745]: cluster 2024-09-14T00:29:47.198706+0000 mgr.a (mgr.14355) 5574 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:48 smithi171 bash[25040]: cluster 2024-09-14T00:29:47.198706+0000 mgr.a (mgr.14355) 5574 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:29:50.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:50.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:50.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:50.864 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:50 smithi007 bash[22722]: cluster 2024-09-14T00:29:49.199453+0000 mgr.a (mgr.14355) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:50 smithi131 bash[24745]: cluster 2024-09-14T00:29:49.199453+0000 mgr.a (mgr.14355) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:50 smithi171 bash[25040]: cluster 2024-09-14T00:29:49.199453+0000 mgr.a (mgr.14355) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:51 smithi007 bash[22722]: audit 2024-09-14T00:29:50.418066+0000 mgr.a (mgr.14355) 5576 : audit [DBG] from='client.129567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:51 smithi131 bash[24745]: audit 2024-09-14T00:29:50.418066+0000 mgr.a (mgr.14355) 5576 : audit [DBG] from='client.129567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:51 smithi171 bash[25040]: audit 2024-09-14T00:29:50.418066+0000 mgr.a (mgr.14355) 5576 : audit [DBG] from='client.129567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:52 smithi007 bash[22722]: cluster 2024-09-14T00:29:51.202087+0000 mgr.a (mgr.14355) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:52 smithi131 bash[24745]: cluster 2024-09-14T00:29:51.202087+0000 mgr.a (mgr.14355) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:52 smithi171 bash[25040]: cluster 2024-09-14T00:29:51.202087+0000 mgr.a (mgr.14355) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:54 smithi007 bash[22722]: cluster 2024-09-14T00:29:53.202884+0000 mgr.a (mgr.14355) 5578 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:54 smithi131 bash[24745]: cluster 2024-09-14T00:29:53.202884+0000 mgr.a (mgr.14355) 5578 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:54 smithi171 bash[25040]: cluster 2024-09-14T00:29:53.202884+0000 mgr.a (mgr.14355) 5578 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:29:55.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:29:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:29:55.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:29:56.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:29:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:29:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:29:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:29:56.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:29:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:56 smithi007 bash[22722]: cluster 2024-09-14T00:29:55.203629+0000 mgr.a (mgr.14355) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:56 smithi007 bash[22722]: audit 2024-09-14T00:29:56.310350+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:29:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:56 smithi131 bash[24745]: cluster 2024-09-14T00:29:55.203629+0000 mgr.a (mgr.14355) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:56 smithi131 bash[24745]: audit 2024-09-14T00:29:56.310350+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:29:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:56 smithi171 bash[25040]: cluster 2024-09-14T00:29:55.203629+0000 mgr.a (mgr.14355) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:29:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:56 smithi171 bash[25040]: audit 2024-09-14T00:29:56.310350+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:29:57.872 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22722]: audit 2024-09-14T00:29:56.202986+0000 mgr.a (mgr.14355) 5580 : audit [DBG] from='client.129642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:57.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22722]: audit 2024-09-14T00:29:57.124105+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:29:57.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22722]: audit 2024-09-14T00:29:57.126506+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:29:57.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22722]: audit 2024-09-14T00:29:57.137757+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:29:57.873 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22722]: audit 2024-09-14T00:29:57.142729+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:57 smithi131 bash[24745]: audit 2024-09-14T00:29:56.202986+0000 mgr.a (mgr.14355) 5580 : audit [DBG] from='client.129642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:57 smithi131 bash[24745]: audit 2024-09-14T00:29:57.124105+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:29:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:57 smithi131 bash[24745]: audit 2024-09-14T00:29:57.126506+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:29:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:57 smithi131 bash[24745]: audit 2024-09-14T00:29:57.137757+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:29:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:57 smithi131 bash[24745]: audit 2024-09-14T00:29:57.142729+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:57 smithi171 bash[25040]: audit 2024-09-14T00:29:56.202986+0000 mgr.a (mgr.14355) 5580 : audit [DBG] from='client.129642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:29:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:57 smithi171 bash[25040]: audit 2024-09-14T00:29:57.124105+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:29:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:57 smithi171 bash[25040]: audit 2024-09-14T00:29:57.126506+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:29:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:57 smithi171 bash[25040]: audit 2024-09-14T00:29:57.137757+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:29:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:57 smithi171 bash[25040]: audit 2024-09-14T00:29:57.142729+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:58.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22972]: debug 2024-09-14T00:29:57.869+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:29:58.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:29:57 smithi007 bash[22972]: debug 2024-09-14T00:29:57.869+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:29:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:58 smithi007 bash[22722]: audit 2024-09-14T00:29:57.145114+0000 mgr.a (mgr.14355) 5581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:58 smithi007 bash[22722]: cluster 2024-09-14T00:29:57.206647+0000 mgr.a (mgr.14355) 5582 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:58 smithi131 bash[24745]: audit 2024-09-14T00:29:57.145114+0000 mgr.a (mgr.14355) 5581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:58 smithi131 bash[24745]: cluster 2024-09-14T00:29:57.206647+0000 mgr.a (mgr.14355) 5582 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:58 smithi171 bash[25040]: audit 2024-09-14T00:29:57.145114+0000 mgr.a (mgr.14355) 5581 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:29:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:58 smithi171 bash[25040]: cluster 2024-09-14T00:29:57.206647+0000 mgr.a (mgr.14355) 5582 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:29:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:59 smithi007 bash[22722]: audit 2024-09-14T00:29:57.872044+0000 mgr.a (mgr.14355) 5583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:29:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:29:59 smithi007 bash[22722]: cephadm 2024-09-14T00:29:57.873642+0000 mgr.a (mgr.14355) 5584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:30:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:59 smithi131 bash[24745]: audit 2024-09-14T00:29:57.872044+0000 mgr.a (mgr.14355) 5583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:30:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:29:59 smithi131 bash[24745]: cephadm 2024-09-14T00:29:57.873642+0000 mgr.a (mgr.14355) 5584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:30:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:59 smithi171 bash[25040]: audit 2024-09-14T00:29:57.872044+0000 mgr.a (mgr.14355) 5583 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:30:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:29:59 smithi171 bash[25040]: cephadm 2024-09-14T00:29:57.873642+0000 mgr.a (mgr.14355) 5584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:30:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:00 smithi007 bash[22722]: cluster 2024-09-14T00:29:59.207582+0000 mgr.a (mgr.14355) 5585 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:00 smithi007 bash[22722]: cluster 2024-09-14T00:30:00.000150+0000 mon.a (mon.0) 1443 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:30:01.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:00 smithi131 bash[24745]: cluster 2024-09-14T00:29:59.207582+0000 mgr.a (mgr.14355) 5585 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:01.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:00 smithi131 bash[24745]: cluster 2024-09-14T00:30:00.000150+0000 mon.a (mon.0) 1443 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:30:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:00 smithi171 bash[25040]: cluster 2024-09-14T00:29:59.207582+0000 mgr.a (mgr.14355) 5585 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:00 smithi171 bash[25040]: cluster 2024-09-14T00:30:00.000150+0000 mon.a (mon.0) 1443 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:30:01.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:01.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:02.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:02.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:02 smithi007 bash[22722]: cluster 2024-09-14T00:30:01.209832+0000 mgr.a (mgr.14355) 5586 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:02 smithi131 bash[24745]: cluster 2024-09-14T00:30:01.209832+0000 mgr.a (mgr.14355) 5586 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:02 smithi171 bash[25040]: cluster 2024-09-14T00:30:01.209832+0000 mgr.a (mgr.14355) 5586 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:03 smithi007 bash[22722]: audit 2024-09-14T00:30:01.982118+0000 mgr.a (mgr.14355) 5587 : audit [DBG] from='client.129828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:03 smithi131 bash[24745]: audit 2024-09-14T00:30:01.982118+0000 mgr.a (mgr.14355) 5587 : audit [DBG] from='client.129828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:03 smithi171 bash[25040]: audit 2024-09-14T00:30:01.982118+0000 mgr.a (mgr.14355) 5587 : audit [DBG] from='client.129828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:04 smithi007 bash[22722]: cluster 2024-09-14T00:30:03.210887+0000 mgr.a (mgr.14355) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:04 smithi131 bash[24745]: cluster 2024-09-14T00:30:03.210887+0000 mgr.a (mgr.14355) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:04 smithi171 bash[25040]: cluster 2024-09-14T00:30:03.210887+0000 mgr.a (mgr.14355) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:06 smithi007 bash[22722]: cluster 2024-09-14T00:30:05.211838+0000 mgr.a (mgr.14355) 5589 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:06 smithi131 bash[24745]: cluster 2024-09-14T00:30:05.211838+0000 mgr.a (mgr.14355) 5589 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:06 smithi171 bash[25040]: cluster 2024-09-14T00:30:05.211838+0000 mgr.a (mgr.14355) 5589 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:07.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:07.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:07.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:08.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:08.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:08.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:08.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:08 smithi007 bash[22722]: cluster 2024-09-14T00:30:07.214218+0000 mgr.a (mgr.14355) 5590 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:08 smithi007 bash[22722]: audit 2024-09-14T00:30:07.755965+0000 mgr.a (mgr.14355) 5591 : audit [DBG] from='client.129903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:08 smithi131 bash[24745]: cluster 2024-09-14T00:30:07.214218+0000 mgr.a (mgr.14355) 5590 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:09.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:08 smithi131 bash[24745]: audit 2024-09-14T00:30:07.755965+0000 mgr.a (mgr.14355) 5591 : audit [DBG] from='client.129903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:08 smithi171 bash[25040]: cluster 2024-09-14T00:30:07.214218+0000 mgr.a (mgr.14355) 5590 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:08 smithi171 bash[25040]: audit 2024-09-14T00:30:07.755965+0000 mgr.a (mgr.14355) 5591 : audit [DBG] from='client.129903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:10 smithi007 bash[22722]: cluster 2024-09-14T00:30:09.215182+0000 mgr.a (mgr.14355) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:10 smithi131 bash[24745]: cluster 2024-09-14T00:30:09.215182+0000 mgr.a (mgr.14355) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:10 smithi171 bash[25040]: cluster 2024-09-14T00:30:09.215182+0000 mgr.a (mgr.14355) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:12 smithi007 bash[22722]: cluster 2024-09-14T00:30:11.217424+0000 mgr.a (mgr.14355) 5593 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:12 smithi131 bash[24745]: cluster 2024-09-14T00:30:11.217424+0000 mgr.a (mgr.14355) 5593 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:12 smithi171 bash[25040]: cluster 2024-09-14T00:30:11.217424+0000 mgr.a (mgr.14355) 5593 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:30:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:13.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:13.946 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:13.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:13.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:13.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:13.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:14 smithi007 bash[22722]: cluster 2024-09-14T00:30:13.217947+0000 mgr.a (mgr.14355) 5594 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:14 smithi007 bash[22722]: audit 2024-09-14T00:30:13.523575+0000 mgr.a (mgr.14355) 5595 : audit [DBG] from='client.129981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:14 smithi131 bash[24745]: cluster 2024-09-14T00:30:13.217947+0000 mgr.a (mgr.14355) 5594 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:14 smithi131 bash[24745]: audit 2024-09-14T00:30:13.523575+0000 mgr.a (mgr.14355) 5595 : audit [DBG] from='client.129981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:14 smithi171 bash[25040]: cluster 2024-09-14T00:30:13.217947+0000 mgr.a (mgr.14355) 5594 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:14 smithi171 bash[25040]: audit 2024-09-14T00:30:13.523575+0000 mgr.a (mgr.14355) 5595 : audit [DBG] from='client.129981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:16 smithi007 bash[22722]: cluster 2024-09-14T00:30:15.218857+0000 mgr.a (mgr.14355) 5596 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:16 smithi131 bash[24745]: cluster 2024-09-14T00:30:15.218857+0000 mgr.a (mgr.14355) 5596 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:16 smithi171 bash[25040]: cluster 2024-09-14T00:30:15.218857+0000 mgr.a (mgr.14355) 5596 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:18.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:18.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:18 smithi007 bash[22722]: cluster 2024-09-14T00:30:17.221161+0000 mgr.a (mgr.14355) 5597 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:18 smithi131 bash[24745]: cluster 2024-09-14T00:30:17.221161+0000 mgr.a (mgr.14355) 5597 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:18 smithi171 bash[25040]: cluster 2024-09-14T00:30:17.221161+0000 mgr.a (mgr.14355) 5597 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:19.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:20 smithi007 bash[22722]: cluster 2024-09-14T00:30:19.221879+0000 mgr.a (mgr.14355) 5598 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:20 smithi007 bash[22722]: audit 2024-09-14T00:30:19.278000+0000 mgr.a (mgr.14355) 5599 : audit [DBG] from='client.130059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:20 smithi131 bash[24745]: cluster 2024-09-14T00:30:19.221879+0000 mgr.a (mgr.14355) 5598 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:20 smithi131 bash[24745]: audit 2024-09-14T00:30:19.278000+0000 mgr.a (mgr.14355) 5599 : audit [DBG] from='client.130059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:20 smithi171 bash[25040]: cluster 2024-09-14T00:30:19.221879+0000 mgr.a (mgr.14355) 5598 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:20 smithi171 bash[25040]: audit 2024-09-14T00:30:19.278000+0000 mgr.a (mgr.14355) 5599 : audit [DBG] from='client.130059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:22 smithi007 bash[22722]: cluster 2024-09-14T00:30:21.224318+0000 mgr.a (mgr.14355) 5600 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:22 smithi131 bash[24745]: cluster 2024-09-14T00:30:21.224318+0000 mgr.a (mgr.14355) 5600 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:22 smithi171 bash[25040]: cluster 2024-09-14T00:30:21.224318+0000 mgr.a (mgr.14355) 5600 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:24.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:24.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:24 smithi007 bash[22722]: cluster 2024-09-14T00:30:23.225088+0000 mgr.a (mgr.14355) 5601 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:24 smithi131 bash[24745]: cluster 2024-09-14T00:30:23.225088+0000 mgr.a (mgr.14355) 5601 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:24 smithi171 bash[25040]: cluster 2024-09-14T00:30:23.225088+0000 mgr.a (mgr.14355) 5601 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:25.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:25.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:25.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:25.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:25.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:26 smithi007 bash[22722]: audit 2024-09-14T00:30:25.026184+0000 mgr.a (mgr.14355) 5602 : audit [DBG] from='client.130131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:26 smithi007 bash[22722]: cluster 2024-09-14T00:30:25.225658+0000 mgr.a (mgr.14355) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:26 smithi131 bash[24745]: audit 2024-09-14T00:30:25.026184+0000 mgr.a (mgr.14355) 5602 : audit [DBG] from='client.130131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:26 smithi131 bash[24745]: cluster 2024-09-14T00:30:25.225658+0000 mgr.a (mgr.14355) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:26 smithi171 bash[25040]: audit 2024-09-14T00:30:25.026184+0000 mgr.a (mgr.14355) 5602 : audit [DBG] from='client.130131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:26 smithi171 bash[25040]: cluster 2024-09-14T00:30:25.225658+0000 mgr.a (mgr.14355) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:28 smithi007 bash[22722]: cluster 2024-09-14T00:30:27.228499+0000 mgr.a (mgr.14355) 5604 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:30:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:28 smithi131 bash[24745]: cluster 2024-09-14T00:30:27.228499+0000 mgr.a (mgr.14355) 5604 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:30:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:28 smithi171 bash[25040]: cluster 2024-09-14T00:30:27.228499+0000 mgr.a (mgr.14355) 5604 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:30:30.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:30.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:30 smithi007 bash[22722]: cluster 2024-09-14T00:30:29.229286+0000 mgr.a (mgr.14355) 5605 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:30:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:30 smithi131 bash[24745]: cluster 2024-09-14T00:30:29.229286+0000 mgr.a (mgr.14355) 5605 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:30:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:30 smithi171 bash[25040]: cluster 2024-09-14T00:30:29.229286+0000 mgr.a (mgr.14355) 5605 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:30:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:31.203 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:31 smithi007 bash[22722]: audit 2024-09-14T00:30:30.782037+0000 mgr.a (mgr.14355) 5606 : audit [DBG] from='client.130209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:31 smithi131 bash[24745]: audit 2024-09-14T00:30:30.782037+0000 mgr.a (mgr.14355) 5606 : audit [DBG] from='client.130209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:31 smithi171 bash[25040]: audit 2024-09-14T00:30:30.782037+0000 mgr.a (mgr.14355) 5606 : audit [DBG] from='client.130209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:32.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:32 smithi007 bash[22722]: cluster 2024-09-14T00:30:31.230746+0000 mgr.a (mgr.14355) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:32 smithi131 bash[24745]: cluster 2024-09-14T00:30:31.230746+0000 mgr.a (mgr.14355) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:32 smithi171 bash[25040]: cluster 2024-09-14T00:30:31.230746+0000 mgr.a (mgr.14355) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:34 smithi007 bash[22722]: cluster 2024-09-14T00:30:33.231522+0000 mgr.a (mgr.14355) 5608 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:34 smithi131 bash[24745]: cluster 2024-09-14T00:30:33.231522+0000 mgr.a (mgr.14355) 5608 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:34 smithi171 bash[25040]: cluster 2024-09-14T00:30:33.231522+0000 mgr.a (mgr.14355) 5608 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:30:36.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:36 smithi007 bash[22722]: cluster 2024-09-14T00:30:35.232279+0000 mgr.a (mgr.14355) 5609 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:30:36.987 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:36 smithi131 bash[24745]: cluster 2024-09-14T00:30:35.232279+0000 mgr.a (mgr.14355) 5609 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:30:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:36 smithi171 bash[25040]: cluster 2024-09-14T00:30:35.232279+0000 mgr.a (mgr.14355) 5609 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:30:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:37 smithi007 bash[22722]: audit 2024-09-14T00:30:36.539241+0000 mgr.a (mgr.14355) 5610 : audit [DBG] from='client.130287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:37 smithi131 bash[24745]: audit 2024-09-14T00:30:36.539241+0000 mgr.a (mgr.14355) 5610 : audit [DBG] from='client.130287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:37 smithi171 bash[25040]: audit 2024-09-14T00:30:36.539241+0000 mgr.a (mgr.14355) 5610 : audit [DBG] from='client.130287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:38 smithi007 bash[22722]: cluster 2024-09-14T00:30:37.235087+0000 mgr.a (mgr.14355) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:38 smithi131 bash[24745]: cluster 2024-09-14T00:30:37.235087+0000 mgr.a (mgr.14355) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:38 smithi171 bash[25040]: cluster 2024-09-14T00:30:37.235087+0000 mgr.a (mgr.14355) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:40 smithi007 bash[22722]: cluster 2024-09-14T00:30:39.235877+0000 mgr.a (mgr.14355) 5612 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:30:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:40 smithi131 bash[24745]: cluster 2024-09-14T00:30:39.235877+0000 mgr.a (mgr.14355) 5612 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:30:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:40 smithi171 bash[25040]: cluster 2024-09-14T00:30:39.235877+0000 mgr.a (mgr.14355) 5612 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:30:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:41.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:41.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:42.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:42.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:42.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:42.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:42.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:42 smithi131 bash[24745]: cluster 2024-09-14T00:30:41.237904+0000 mgr.a (mgr.14355) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:30:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:42 smithi171 bash[25040]: cluster 2024-09-14T00:30:41.237904+0000 mgr.a (mgr.14355) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:30:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:42 smithi007 bash[22722]: cluster 2024-09-14T00:30:41.237904+0000 mgr.a (mgr.14355) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:30:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:43 smithi131 bash[24745]: audit 2024-09-14T00:30:42.318781+0000 mgr.a (mgr.14355) 5614 : audit [DBG] from='client.130365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:43 smithi171 bash[25040]: audit 2024-09-14T00:30:42.318781+0000 mgr.a (mgr.14355) 5614 : audit [DBG] from='client.130365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:43 smithi007 bash[22722]: audit 2024-09-14T00:30:42.318781+0000 mgr.a (mgr.14355) 5614 : audit [DBG] from='client.130365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:44 smithi131 bash[24745]: cluster 2024-09-14T00:30:43.238846+0000 mgr.a (mgr.14355) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:44 smithi171 bash[25040]: cluster 2024-09-14T00:30:43.238846+0000 mgr.a (mgr.14355) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:44 smithi007 bash[22722]: cluster 2024-09-14T00:30:43.238846+0000 mgr.a (mgr.14355) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:46 smithi131 bash[24745]: cluster 2024-09-14T00:30:45.239592+0000 mgr.a (mgr.14355) 5616 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:46 smithi171 bash[25040]: cluster 2024-09-14T00:30:45.239592+0000 mgr.a (mgr.14355) 5616 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:46 smithi007 bash[22722]: cluster 2024-09-14T00:30:45.239592+0000 mgr.a (mgr.14355) 5616 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:48.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:48.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:48.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:48.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:48.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:48 smithi131 bash[24745]: cluster 2024-09-14T00:30:47.241843+0000 mgr.a (mgr.14355) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:48 smithi171 bash[25040]: cluster 2024-09-14T00:30:47.241843+0000 mgr.a (mgr.14355) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:48 smithi007 bash[22722]: cluster 2024-09-14T00:30:47.241843+0000 mgr.a (mgr.14355) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:49 smithi131 bash[24745]: audit 2024-09-14T00:30:48.074317+0000 mgr.a (mgr.14355) 5618 : audit [DBG] from='client.130440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:49 smithi171 bash[25040]: audit 2024-09-14T00:30:48.074317+0000 mgr.a (mgr.14355) 5618 : audit [DBG] from='client.130440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:49 smithi007 bash[22722]: audit 2024-09-14T00:30:48.074317+0000 mgr.a (mgr.14355) 5618 : audit [DBG] from='client.130440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:50 smithi131 bash[24745]: cluster 2024-09-14T00:30:49.242812+0000 mgr.a (mgr.14355) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:50 smithi171 bash[25040]: cluster 2024-09-14T00:30:49.242812+0000 mgr.a (mgr.14355) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:50 smithi007 bash[22722]: cluster 2024-09-14T00:30:49.242812+0000 mgr.a (mgr.14355) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:52 smithi131 bash[24745]: cluster 2024-09-14T00:30:51.245082+0000 mgr.a (mgr.14355) 5620 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:52 smithi171 bash[25040]: cluster 2024-09-14T00:30:51.245082+0000 mgr.a (mgr.14355) 5620 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:52 smithi007 bash[22722]: cluster 2024-09-14T00:30:51.245082+0000 mgr.a (mgr.14355) 5620 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:53.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:53.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:53.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:54.255 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:30:54.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:30:54.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:30:54.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:30:54.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:30:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:54 smithi131 bash[24745]: cluster 2024-09-14T00:30:53.245873+0000 mgr.a (mgr.14355) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:54 smithi171 bash[25040]: cluster 2024-09-14T00:30:53.245873+0000 mgr.a (mgr.14355) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:54 smithi007 bash[22722]: cluster 2024-09-14T00:30:53.245873+0000 mgr.a (mgr.14355) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:55 smithi131 bash[24745]: audit 2024-09-14T00:30:53.844752+0000 mgr.a (mgr.14355) 5622 : audit [DBG] from='client.130515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:55 smithi171 bash[25040]: audit 2024-09-14T00:30:53.844752+0000 mgr.a (mgr.14355) 5622 : audit [DBG] from='client.130515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:55 smithi007 bash[22722]: audit 2024-09-14T00:30:53.844752+0000 mgr.a (mgr.14355) 5622 : audit [DBG] from='client.130515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:30:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:56 smithi131 bash[24745]: cluster 2024-09-14T00:30:55.246825+0000 mgr.a (mgr.14355) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:56 smithi171 bash[25040]: cluster 2024-09-14T00:30:55.246825+0000 mgr.a (mgr.14355) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:56 smithi007 bash[22722]: cluster 2024-09-14T00:30:55.246825+0000 mgr.a (mgr.14355) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:30:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:58 smithi131 bash[24745]: cluster 2024-09-14T00:30:57.249090+0000 mgr.a (mgr.14355) 5624 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:58 smithi131 bash[24745]: audit 2024-09-14T00:30:57.928426+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:30:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:58 smithi171 bash[25040]: cluster 2024-09-14T00:30:57.249090+0000 mgr.a (mgr.14355) 5624 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:58 smithi171 bash[25040]: audit 2024-09-14T00:30:57.928426+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:30:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:58 smithi007 bash[22722]: cluster 2024-09-14T00:30:57.249090+0000 mgr.a (mgr.14355) 5624 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:30:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:58 smithi007 bash[22722]: audit 2024-09-14T00:30:57.928426+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:30:59.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:30:59.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:30:59.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:30:59.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22972]: debug 2024-09-14T00:30:59.516+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:30:59.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22972]: debug 2024-09-14T00:30:59.516+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:30:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22722]: audit 2024-09-14T00:30:58.765102+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:30:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22722]: audit 2024-09-14T00:30:58.766957+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:30:59.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22722]: audit 2024-09-14T00:30:58.777089+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:30:59.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22722]: audit 2024-09-14T00:30:58.780033+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:30:59.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:30:59 smithi007 bash[22722]: audit 2024-09-14T00:30:58.781132+0000 mgr.a (mgr.14355) 5625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:31:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:00.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:00.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:59 smithi131 bash[24745]: audit 2024-09-14T00:30:58.765102+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:31:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:59 smithi131 bash[24745]: audit 2024-09-14T00:30:58.766957+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:31:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:59 smithi131 bash[24745]: audit 2024-09-14T00:30:58.777089+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:31:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:59 smithi131 bash[24745]: audit 2024-09-14T00:30:58.780033+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:31:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:30:59 smithi131 bash[24745]: audit 2024-09-14T00:30:58.781132+0000 mgr.a (mgr.14355) 5625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:31:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:59 smithi171 bash[25040]: audit 2024-09-14T00:30:58.765102+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:31:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:59 smithi171 bash[25040]: audit 2024-09-14T00:30:58.766957+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:31:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:59 smithi171 bash[25040]: audit 2024-09-14T00:30:58.777089+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:31:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:59 smithi171 bash[25040]: audit 2024-09-14T00:30:58.780033+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:31:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:30:59 smithi171 bash[25040]: audit 2024-09-14T00:30:58.781132+0000 mgr.a (mgr.14355) 5625 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:31:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:00 smithi131 bash[24745]: cluster 2024-09-14T00:30:59.250014+0000 mgr.a (mgr.14355) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:00 smithi131 bash[24745]: audit 2024-09-14T00:30:59.520357+0000 mgr.a (mgr.14355) 5627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:31:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:00 smithi131 bash[24745]: cephadm 2024-09-14T00:30:59.521500+0000 mgr.a (mgr.14355) 5628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:31:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:00 smithi131 bash[24745]: audit 2024-09-14T00:30:59.590438+0000 mgr.a (mgr.14355) 5629 : audit [DBG] from='client.130680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:00 smithi171 bash[25040]: cluster 2024-09-14T00:30:59.250014+0000 mgr.a (mgr.14355) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:00 smithi171 bash[25040]: audit 2024-09-14T00:30:59.520357+0000 mgr.a (mgr.14355) 5627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:31:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:00 smithi171 bash[25040]: cephadm 2024-09-14T00:30:59.521500+0000 mgr.a (mgr.14355) 5628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:31:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:00 smithi171 bash[25040]: audit 2024-09-14T00:30:59.590438+0000 mgr.a (mgr.14355) 5629 : audit [DBG] from='client.130680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:00 smithi007 bash[22722]: cluster 2024-09-14T00:30:59.250014+0000 mgr.a (mgr.14355) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:00 smithi007 bash[22722]: audit 2024-09-14T00:30:59.520357+0000 mgr.a (mgr.14355) 5627 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:31:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:00 smithi007 bash[22722]: cephadm 2024-09-14T00:30:59.521500+0000 mgr.a (mgr.14355) 5628 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:31:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:00 smithi007 bash[22722]: audit 2024-09-14T00:30:59.590438+0000 mgr.a (mgr.14355) 5629 : audit [DBG] from='client.130680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:02 smithi131 bash[24745]: cluster 2024-09-14T00:31:01.252400+0000 mgr.a (mgr.14355) 5630 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:02 smithi171 bash[25040]: cluster 2024-09-14T00:31:01.252400+0000 mgr.a (mgr.14355) 5630 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:02 smithi007 bash[22722]: cluster 2024-09-14T00:31:01.252400+0000 mgr.a (mgr.14355) 5630 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:04 smithi171 bash[25040]: cluster 2024-09-14T00:31:03.253210+0000 mgr.a (mgr.14355) 5631 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:04 smithi007 bash[22722]: cluster 2024-09-14T00:31:03.253210+0000 mgr.a (mgr.14355) 5631 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:04 smithi131 bash[24745]: cluster 2024-09-14T00:31:03.253210+0000 mgr.a (mgr.14355) 5631 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:05.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:05.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:06 smithi171 bash[25040]: cluster 2024-09-14T00:31:05.254406+0000 mgr.a (mgr.14355) 5632 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:06 smithi171 bash[25040]: audit 2024-09-14T00:31:05.330671+0000 mgr.a (mgr.14355) 5633 : audit [DBG] from='client.130773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:06 smithi007 bash[22722]: cluster 2024-09-14T00:31:05.254406+0000 mgr.a (mgr.14355) 5632 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:06 smithi007 bash[22722]: audit 2024-09-14T00:31:05.330671+0000 mgr.a (mgr.14355) 5633 : audit [DBG] from='client.130773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:06 smithi131 bash[24745]: cluster 2024-09-14T00:31:05.254406+0000 mgr.a (mgr.14355) 5632 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:06 smithi131 bash[24745]: audit 2024-09-14T00:31:05.330671+0000 mgr.a (mgr.14355) 5633 : audit [DBG] from='client.130773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:08 smithi171 bash[25040]: cluster 2024-09-14T00:31:07.256695+0000 mgr.a (mgr.14355) 5634 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:08 smithi007 bash[22722]: cluster 2024-09-14T00:31:07.256695+0000 mgr.a (mgr.14355) 5634 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:08 smithi131 bash[24745]: cluster 2024-09-14T00:31:07.256695+0000 mgr.a (mgr.14355) 5634 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:10.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:10.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:10.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:10 smithi007 bash[22722]: cluster 2024-09-14T00:31:09.257528+0000 mgr.a (mgr.14355) 5635 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:31:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:10 smithi131 bash[24745]: cluster 2024-09-14T00:31:09.257528+0000 mgr.a (mgr.14355) 5635 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:31:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:10 smithi171 bash[25040]: cluster 2024-09-14T00:31:09.257528+0000 mgr.a (mgr.14355) 5635 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:31:11.526 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:11.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:11.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:11.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:11.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:12 smithi007 bash[22722]: audit 2024-09-14T00:31:11.087967+0000 mgr.a (mgr.14355) 5636 : audit [DBG] from='client.130851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:12 smithi007 bash[22722]: cluster 2024-09-14T00:31:11.258940+0000 mgr.a (mgr.14355) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:12 smithi131 bash[24745]: audit 2024-09-14T00:31:11.087967+0000 mgr.a (mgr.14355) 5636 : audit [DBG] from='client.130851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:12 smithi131 bash[24745]: cluster 2024-09-14T00:31:11.258940+0000 mgr.a (mgr.14355) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:12 smithi171 bash[25040]: audit 2024-09-14T00:31:11.087967+0000 mgr.a (mgr.14355) 5636 : audit [DBG] from='client.130851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:12 smithi171 bash[25040]: cluster 2024-09-14T00:31:11.258940+0000 mgr.a (mgr.14355) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:31:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:14 smithi007 bash[22722]: cluster 2024-09-14T00:31:13.259842+0000 mgr.a (mgr.14355) 5638 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:14 smithi131 bash[24745]: cluster 2024-09-14T00:31:13.259842+0000 mgr.a (mgr.14355) 5638 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:14 smithi171 bash[25040]: cluster 2024-09-14T00:31:13.259842+0000 mgr.a (mgr.14355) 5638 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:16.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:16.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:16.529 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:16 smithi007 bash[22722]: cluster 2024-09-14T00:31:15.261598+0000 mgr.a (mgr.14355) 5639 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T00:31:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:16 smithi131 bash[24745]: cluster 2024-09-14T00:31:15.261598+0000 mgr.a (mgr.14355) 5639 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T00:31:17.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:16 smithi171 bash[25040]: cluster 2024-09-14T00:31:15.261598+0000 mgr.a (mgr.14355) 5639 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T00:31:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:18 smithi007 bash[22722]: audit 2024-09-14T00:31:16.863701+0000 mgr.a (mgr.14355) 5640 : audit [DBG] from='client.130929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:18 smithi007 bash[22722]: cluster 2024-09-14T00:31:17.262820+0000 mgr.a (mgr.14355) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:18 smithi131 bash[24745]: audit 2024-09-14T00:31:16.863701+0000 mgr.a (mgr.14355) 5640 : audit [DBG] from='client.130929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:18 smithi131 bash[24745]: cluster 2024-09-14T00:31:17.262820+0000 mgr.a (mgr.14355) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:18 smithi171 bash[25040]: audit 2024-09-14T00:31:16.863701+0000 mgr.a (mgr.14355) 5640 : audit [DBG] from='client.130929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:18 smithi171 bash[25040]: cluster 2024-09-14T00:31:17.262820+0000 mgr.a (mgr.14355) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:20 smithi007 bash[22722]: cluster 2024-09-14T00:31:19.263709+0000 mgr.a (mgr.14355) 5642 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:20 smithi131 bash[24745]: cluster 2024-09-14T00:31:19.263709+0000 mgr.a (mgr.14355) 5642 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:20 smithi171 bash[25040]: cluster 2024-09-14T00:31:19.263709+0000 mgr.a (mgr.14355) 5642 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:22.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:23.062 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:23.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:23.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:23.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:23.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:22 smithi007 bash[22722]: cluster 2024-09-14T00:31:21.265903+0000 mgr.a (mgr.14355) 5643 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:22 smithi131 bash[24745]: cluster 2024-09-14T00:31:21.265903+0000 mgr.a (mgr.14355) 5643 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:22 smithi171 bash[25040]: cluster 2024-09-14T00:31:21.265903+0000 mgr.a (mgr.14355) 5643 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:23 smithi007 bash[22722]: audit 2024-09-14T00:31:22.624351+0000 mgr.a (mgr.14355) 5644 : audit [DBG] from='client.131007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:23 smithi131 bash[24745]: audit 2024-09-14T00:31:22.624351+0000 mgr.a (mgr.14355) 5644 : audit [DBG] from='client.131007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:23 smithi171 bash[25040]: audit 2024-09-14T00:31:22.624351+0000 mgr.a (mgr.14355) 5644 : audit [DBG] from='client.131007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:24 smithi007 bash[22722]: cluster 2024-09-14T00:31:23.267067+0000 mgr.a (mgr.14355) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:24 smithi131 bash[24745]: cluster 2024-09-14T00:31:23.267067+0000 mgr.a (mgr.14355) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:24 smithi171 bash[25040]: cluster 2024-09-14T00:31:23.267067+0000 mgr.a (mgr.14355) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:25 smithi007 bash[22722]: cluster 2024-09-14T00:31:25.268953+0000 mgr.a (mgr.14355) 5646 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:31:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:25 smithi131 bash[24745]: cluster 2024-09-14T00:31:25.268953+0000 mgr.a (mgr.14355) 5646 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:31:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:25 smithi171 bash[25040]: cluster 2024-09-14T00:31:25.268953+0000 mgr.a (mgr.14355) 5646 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T00:31:28.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:28 smithi007 bash[22722]: cluster 2024-09-14T00:31:27.270183+0000 mgr.a (mgr.14355) 5647 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:28 smithi131 bash[24745]: cluster 2024-09-14T00:31:27.270183+0000 mgr.a (mgr.14355) 5647 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:28 smithi171 bash[25040]: cluster 2024-09-14T00:31:27.270183+0000 mgr.a (mgr.14355) 5647 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:28.838 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:28.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:29 smithi007 bash[22722]: audit 2024-09-14T00:31:28.397637+0000 mgr.a (mgr.14355) 5648 : audit [DBG] from='client.131082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:29 smithi131 bash[24745]: audit 2024-09-14T00:31:28.397637+0000 mgr.a (mgr.14355) 5648 : audit [DBG] from='client.131082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:29 smithi171 bash[25040]: audit 2024-09-14T00:31:28.397637+0000 mgr.a (mgr.14355) 5648 : audit [DBG] from='client.131082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:30 smithi007 bash[22722]: cluster 2024-09-14T00:31:29.271143+0000 mgr.a (mgr.14355) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:30 smithi131 bash[24745]: cluster 2024-09-14T00:31:29.271143+0000 mgr.a (mgr.14355) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:30 smithi171 bash[25040]: cluster 2024-09-14T00:31:29.271143+0000 mgr.a (mgr.14355) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:32 smithi007 bash[22722]: cluster 2024-09-14T00:31:31.273516+0000 mgr.a (mgr.14355) 5650 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:32 smithi131 bash[24745]: cluster 2024-09-14T00:31:31.273516+0000 mgr.a (mgr.14355) 5650 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:32 smithi171 bash[25040]: cluster 2024-09-14T00:31:31.273516+0000 mgr.a (mgr.14355) 5650 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:34.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:34 smithi007 bash[22722]: cluster 2024-09-14T00:31:33.274365+0000 mgr.a (mgr.14355) 5651 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:34 smithi131 bash[24745]: cluster 2024-09-14T00:31:33.274365+0000 mgr.a (mgr.14355) 5651 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:34 smithi171 bash[25040]: cluster 2024-09-14T00:31:33.274365+0000 mgr.a (mgr.14355) 5651 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:35 smithi007 bash[22722]: audit 2024-09-14T00:31:34.172842+0000 mgr.a (mgr.14355) 5652 : audit [DBG] from='client.131157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:35 smithi131 bash[24745]: audit 2024-09-14T00:31:34.172842+0000 mgr.a (mgr.14355) 5652 : audit [DBG] from='client.131157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:35 smithi171 bash[25040]: audit 2024-09-14T00:31:34.172842+0000 mgr.a (mgr.14355) 5652 : audit [DBG] from='client.131157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:36 smithi007 bash[22722]: cluster 2024-09-14T00:31:35.276639+0000 mgr.a (mgr.14355) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:36 smithi131 bash[24745]: cluster 2024-09-14T00:31:35.276639+0000 mgr.a (mgr.14355) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:36 smithi171 bash[25040]: cluster 2024-09-14T00:31:35.276639+0000 mgr.a (mgr.14355) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:31:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:38 smithi007 bash[22722]: cluster 2024-09-14T00:31:37.277402+0000 mgr.a (mgr.14355) 5654 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:38 smithi131 bash[24745]: cluster 2024-09-14T00:31:37.277402+0000 mgr.a (mgr.14355) 5654 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:38 smithi171 bash[25040]: cluster 2024-09-14T00:31:37.277402+0000 mgr.a (mgr.14355) 5654 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:39.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:40.360 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:40.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:40.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:40.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:40.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:40 smithi007 bash[22722]: cluster 2024-09-14T00:31:39.278155+0000 mgr.a (mgr.14355) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:40 smithi131 bash[24745]: cluster 2024-09-14T00:31:39.278155+0000 mgr.a (mgr.14355) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:40 smithi171 bash[25040]: cluster 2024-09-14T00:31:39.278155+0000 mgr.a (mgr.14355) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:41 smithi007 bash[22722]: audit 2024-09-14T00:31:39.924484+0000 mgr.a (mgr.14355) 5656 : audit [DBG] from='client.131235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:41 smithi131 bash[24745]: audit 2024-09-14T00:31:39.924484+0000 mgr.a (mgr.14355) 5656 : audit [DBG] from='client.131235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:41 smithi171 bash[25040]: audit 2024-09-14T00:31:39.924484+0000 mgr.a (mgr.14355) 5656 : audit [DBG] from='client.131235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:42 smithi007 bash[22722]: cluster 2024-09-14T00:31:41.280601+0000 mgr.a (mgr.14355) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:31:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:42 smithi131 bash[24745]: cluster 2024-09-14T00:31:41.280601+0000 mgr.a (mgr.14355) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:31:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:42 smithi171 bash[25040]: cluster 2024-09-14T00:31:41.280601+0000 mgr.a (mgr.14355) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:31:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:44 smithi007 bash[22722]: cluster 2024-09-14T00:31:43.281417+0000 mgr.a (mgr.14355) 5658 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:31:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:44 smithi131 bash[24745]: cluster 2024-09-14T00:31:43.281417+0000 mgr.a (mgr.14355) 5658 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:31:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:44 smithi171 bash[25040]: cluster 2024-09-14T00:31:43.281417+0000 mgr.a (mgr.14355) 5658 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:31:45.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:45.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:46.117 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:46.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:46.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:46 smithi007 bash[22722]: cluster 2024-09-14T00:31:45.283394+0000 mgr.a (mgr.14355) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:46 smithi007 bash[22722]: audit 2024-09-14T00:31:45.694152+0000 mgr.a (mgr.14355) 5660 : audit [DBG] from='client.131313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:46 smithi131 bash[24745]: cluster 2024-09-14T00:31:45.283394+0000 mgr.a (mgr.14355) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:46 smithi131 bash[24745]: audit 2024-09-14T00:31:45.694152+0000 mgr.a (mgr.14355) 5660 : audit [DBG] from='client.131313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:46 smithi171 bash[25040]: cluster 2024-09-14T00:31:45.283394+0000 mgr.a (mgr.14355) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:46 smithi171 bash[25040]: audit 2024-09-14T00:31:45.694152+0000 mgr.a (mgr.14355) 5660 : audit [DBG] from='client.131313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:48 smithi007 bash[22722]: cluster 2024-09-14T00:31:47.284319+0000 mgr.a (mgr.14355) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:48 smithi131 bash[24745]: cluster 2024-09-14T00:31:47.284319+0000 mgr.a (mgr.14355) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:48 smithi171 bash[25040]: cluster 2024-09-14T00:31:47.284319+0000 mgr.a (mgr.14355) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:31:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:50 smithi007 bash[22722]: cluster 2024-09-14T00:31:49.285143+0000 mgr.a (mgr.14355) 5662 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:31:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:50 smithi131 bash[24745]: cluster 2024-09-14T00:31:49.285143+0000 mgr.a (mgr.14355) 5662 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:31:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:50 smithi171 bash[25040]: cluster 2024-09-14T00:31:49.285143+0000 mgr.a (mgr.14355) 5662 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:31:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:51.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:51.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:51.914 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:51.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:52 smithi007 bash[22722]: cluster 2024-09-14T00:31:51.287349+0000 mgr.a (mgr.14355) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:52 smithi007 bash[22722]: audit 2024-09-14T00:31:51.463480+0000 mgr.a (mgr.14355) 5664 : audit [DBG] from='client.131388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:52 smithi131 bash[24745]: cluster 2024-09-14T00:31:51.287349+0000 mgr.a (mgr.14355) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:52 smithi131 bash[24745]: audit 2024-09-14T00:31:51.463480+0000 mgr.a (mgr.14355) 5664 : audit [DBG] from='client.131388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:52 smithi171 bash[25040]: cluster 2024-09-14T00:31:51.287349+0000 mgr.a (mgr.14355) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:52 smithi171 bash[25040]: audit 2024-09-14T00:31:51.463480+0000 mgr.a (mgr.14355) 5664 : audit [DBG] from='client.131388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:54 smithi007 bash[22722]: cluster 2024-09-14T00:31:53.288268+0000 mgr.a (mgr.14355) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:31:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:54 smithi131 bash[24745]: cluster 2024-09-14T00:31:53.288268+0000 mgr.a (mgr.14355) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:31:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:54 smithi171 bash[25040]: cluster 2024-09-14T00:31:53.288268+0000 mgr.a (mgr.14355) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:31:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:56 smithi007 bash[22722]: cluster 2024-09-14T00:31:55.290520+0000 mgr.a (mgr.14355) 5666 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:56 smithi131 bash[24745]: cluster 2024-09-14T00:31:55.290520+0000 mgr.a (mgr.14355) 5666 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:56 smithi171 bash[25040]: cluster 2024-09-14T00:31:55.290520+0000 mgr.a (mgr.14355) 5666 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:31:56.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:31:56.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:31:56.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:31:57.694 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:31:57.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:31:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:58 smithi131 bash[24745]: audit 2024-09-14T00:31:57.251225+0000 mgr.a (mgr.14355) 5667 : audit [DBG] from='client.131466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:31:58 smithi131 bash[24745]: cluster 2024-09-14T00:31:57.291319+0000 mgr.a (mgr.14355) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:58 smithi171 bash[25040]: audit 2024-09-14T00:31:57.251225+0000 mgr.a (mgr.14355) 5667 : audit [DBG] from='client.131466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:31:58 smithi171 bash[25040]: cluster 2024-09-14T00:31:57.291319+0000 mgr.a (mgr.14355) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:31:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:58 smithi007 bash[22722]: audit 2024-09-14T00:31:57.251225+0000 mgr.a (mgr.14355) 5667 : audit [DBG] from='client.131466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:31:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:31:58 smithi007 bash[22722]: cluster 2024-09-14T00:31:57.291319+0000 mgr.a (mgr.14355) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:00 smithi131 bash[24745]: cluster 2024-09-14T00:31:59.292205+0000 mgr.a (mgr.14355) 5669 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:00 smithi131 bash[24745]: audit 2024-09-14T00:31:59.570523+0000 mon.a (mon.0) 1449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:32:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:00 smithi131 bash[24745]: audit 2024-09-14T00:32:00.201027+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:00 smithi131 bash[24745]: audit 2024-09-14T00:32:00.205959+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:00 smithi171 bash[25040]: cluster 2024-09-14T00:31:59.292205+0000 mgr.a (mgr.14355) 5669 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:00 smithi171 bash[25040]: audit 2024-09-14T00:31:59.570523+0000 mon.a (mon.0) 1449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:32:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:00 smithi171 bash[25040]: audit 2024-09-14T00:32:00.201027+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:00 smithi171 bash[25040]: audit 2024-09-14T00:32:00.205959+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:00 smithi007 bash[22722]: cluster 2024-09-14T00:31:59.292205+0000 mgr.a (mgr.14355) 5669 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:00 smithi007 bash[22722]: audit 2024-09-14T00:31:59.570523+0000 mon.a (mon.0) 1449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:32:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:00 smithi007 bash[22722]: audit 2024-09-14T00:32:00.201027+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:00 smithi007 bash[22722]: audit 2024-09-14T00:32:00.205959+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:01 smithi131 bash[24745]: audit 2024-09-14T00:32:00.972873+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:32:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:01 smithi131 bash[24745]: audit 2024-09-14T00:32:00.974649+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:32:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:01 smithi131 bash[24745]: audit 2024-09-14T00:32:00.984835+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:01 smithi131 bash[24745]: audit 2024-09-14T00:32:00.988198+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:01 smithi171 bash[25040]: audit 2024-09-14T00:32:00.972873+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:32:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:01 smithi171 bash[25040]: audit 2024-09-14T00:32:00.974649+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:32:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:01 smithi171 bash[25040]: audit 2024-09-14T00:32:00.984835+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:01 smithi171 bash[25040]: audit 2024-09-14T00:32:00.988198+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:01.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22972]: debug 2024-09-14T00:32:01.715+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:32:01.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22972]: debug 2024-09-14T00:32:01.719+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:32:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22722]: audit 2024-09-14T00:32:00.972873+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:32:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22722]: audit 2024-09-14T00:32:00.974649+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:32:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22722]: audit 2024-09-14T00:32:00.984835+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:32:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:01 smithi007 bash[22722]: audit 2024-09-14T00:32:00.988198+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:02.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:02.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:02 smithi131 bash[24745]: audit 2024-09-14T00:32:00.990472+0000 mgr.a (mgr.14355) 5670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:02 smithi131 bash[24745]: cluster 2024-09-14T00:32:01.293467+0000 mgr.a (mgr.14355) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:02 smithi131 bash[24745]: audit 2024-09-14T00:32:01.721016+0000 mgr.a (mgr.14355) 5672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:32:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:02 smithi131 bash[24745]: cephadm 2024-09-14T00:32:01.722467+0000 mgr.a (mgr.14355) 5673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:32:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:02 smithi171 bash[25040]: audit 2024-09-14T00:32:00.990472+0000 mgr.a (mgr.14355) 5670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:02 smithi171 bash[25040]: cluster 2024-09-14T00:32:01.293467+0000 mgr.a (mgr.14355) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:02 smithi171 bash[25040]: audit 2024-09-14T00:32:01.721016+0000 mgr.a (mgr.14355) 5672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:32:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:02 smithi171 bash[25040]: cephadm 2024-09-14T00:32:01.722467+0000 mgr.a (mgr.14355) 5673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:32:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:02 smithi007 bash[22722]: audit 2024-09-14T00:32:00.990472+0000 mgr.a (mgr.14355) 5670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:32:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:02 smithi007 bash[22722]: cluster 2024-09-14T00:32:01.293467+0000 mgr.a (mgr.14355) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:02 smithi007 bash[22722]: audit 2024-09-14T00:32:01.721016+0000 mgr.a (mgr.14355) 5672 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:32:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:02 smithi007 bash[22722]: cephadm 2024-09-14T00:32:01.722467+0000 mgr.a (mgr.14355) 5673 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:32:03.451 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:04 smithi131 bash[24745]: audit 2024-09-14T00:32:03.023721+0000 mgr.a (mgr.14355) 5674 : audit [DBG] from='client.131652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:04 smithi131 bash[24745]: cluster 2024-09-14T00:32:03.293962+0000 mgr.a (mgr.14355) 5675 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:32:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:04 smithi171 bash[25040]: audit 2024-09-14T00:32:03.023721+0000 mgr.a (mgr.14355) 5674 : audit [DBG] from='client.131652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:04 smithi171 bash[25040]: cluster 2024-09-14T00:32:03.293962+0000 mgr.a (mgr.14355) 5675 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:32:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:04 smithi007 bash[22722]: audit 2024-09-14T00:32:03.023721+0000 mgr.a (mgr.14355) 5674 : audit [DBG] from='client.131652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:04 smithi007 bash[22722]: cluster 2024-09-14T00:32:03.293962+0000 mgr.a (mgr.14355) 5675 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:32:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:06 smithi171 bash[25040]: cluster 2024-09-14T00:32:05.296319+0000 mgr.a (mgr.14355) 5676 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:06 smithi007 bash[22722]: cluster 2024-09-14T00:32:05.296319+0000 mgr.a (mgr.14355) 5676 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:06 smithi131 bash[24745]: cluster 2024-09-14T00:32:05.296319+0000 mgr.a (mgr.14355) 5676 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:08 smithi171 bash[25040]: cluster 2024-09-14T00:32:07.297111+0000 mgr.a (mgr.14355) 5677 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:08 smithi007 bash[22722]: cluster 2024-09-14T00:32:07.297111+0000 mgr.a (mgr.14355) 5677 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:08 smithi131 bash[24745]: cluster 2024-09-14T00:32:07.297111+0000 mgr.a (mgr.14355) 5677 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:09.203 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:09.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:09.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:09.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:09.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:09 smithi007 bash[22722]: audit 2024-09-14T00:32:08.785740+0000 mgr.a (mgr.14355) 5678 : audit [DBG] from='client.131730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:10.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:09 smithi131 bash[24745]: audit 2024-09-14T00:32:08.785740+0000 mgr.a (mgr.14355) 5678 : audit [DBG] from='client.131730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:09 smithi171 bash[25040]: audit 2024-09-14T00:32:08.785740+0000 mgr.a (mgr.14355) 5678 : audit [DBG] from='client.131730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:10 smithi007 bash[22722]: cluster 2024-09-14T00:32:09.298048+0000 mgr.a (mgr.14355) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:10 smithi131 bash[24745]: cluster 2024-09-14T00:32:09.298048+0000 mgr.a (mgr.14355) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:10 smithi171 bash[25040]: cluster 2024-09-14T00:32:09.298048+0000 mgr.a (mgr.14355) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 58 op/s 2024-09-14T00:32:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:12 smithi007 bash[22722]: cluster 2024-09-14T00:32:11.300304+0000 mgr.a (mgr.14355) 5680 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:32:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:12 smithi131 bash[24745]: cluster 2024-09-14T00:32:11.300304+0000 mgr.a (mgr.14355) 5680 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:32:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:12 smithi171 bash[25040]: cluster 2024-09-14T00:32:11.300304+0000 mgr.a (mgr.14355) 5680 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 67 op/s 2024-09-14T00:32:14.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:14.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:14.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:14 smithi007 bash[22722]: cluster 2024-09-14T00:32:13.301079+0000 mgr.a (mgr.14355) 5681 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:14.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:14.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:14.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:14 smithi131 bash[24745]: cluster 2024-09-14T00:32:13.301079+0000 mgr.a (mgr.14355) 5681 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:14 smithi171 bash[25040]: cluster 2024-09-14T00:32:13.301079+0000 mgr.a (mgr.14355) 5681 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T00:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:15 smithi007 bash[22722]: audit 2024-09-14T00:32:14.538904+0000 mgr.a (mgr.14355) 5682 : audit [DBG] from='client.131802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:15 smithi131 bash[24745]: audit 2024-09-14T00:32:14.538904+0000 mgr.a (mgr.14355) 5682 : audit [DBG] from='client.131802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:15 smithi171 bash[25040]: audit 2024-09-14T00:32:14.538904+0000 mgr.a (mgr.14355) 5682 : audit [DBG] from='client.131802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:16 smithi007 bash[22722]: cluster 2024-09-14T00:32:15.303400+0000 mgr.a (mgr.14355) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T00:32:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:16 smithi131 bash[24745]: cluster 2024-09-14T00:32:15.303400+0000 mgr.a (mgr.14355) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T00:32:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:16 smithi171 bash[25040]: cluster 2024-09-14T00:32:15.303400+0000 mgr.a (mgr.14355) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T00:32:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:18 smithi007 bash[22722]: cluster 2024-09-14T00:32:17.304224+0000 mgr.a (mgr.14355) 5684 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:18 smithi131 bash[24745]: cluster 2024-09-14T00:32:17.304224+0000 mgr.a (mgr.14355) 5684 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:18 smithi171 bash[25040]: cluster 2024-09-14T00:32:17.304224+0000 mgr.a (mgr.14355) 5684 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:19.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:19.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:20.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:20.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:20.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:20.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:20.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:20 smithi007 bash[22722]: cluster 2024-09-14T00:32:19.304994+0000 mgr.a (mgr.14355) 5685 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:20 smithi131 bash[24745]: cluster 2024-09-14T00:32:19.304994+0000 mgr.a (mgr.14355) 5685 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:20 smithi171 bash[25040]: cluster 2024-09-14T00:32:19.304994+0000 mgr.a (mgr.14355) 5685 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:21 smithi007 bash[22722]: audit 2024-09-14T00:32:20.309069+0000 mgr.a (mgr.14355) 5686 : audit [DBG] from='client.131880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:21 smithi131 bash[24745]: audit 2024-09-14T00:32:20.309069+0000 mgr.a (mgr.14355) 5686 : audit [DBG] from='client.131880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:21 smithi171 bash[25040]: audit 2024-09-14T00:32:20.309069+0000 mgr.a (mgr.14355) 5686 : audit [DBG] from='client.131880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:22 smithi007 bash[22722]: cluster 2024-09-14T00:32:21.307790+0000 mgr.a (mgr.14355) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:22 smithi131 bash[24745]: cluster 2024-09-14T00:32:21.307790+0000 mgr.a (mgr.14355) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:22 smithi171 bash[25040]: cluster 2024-09-14T00:32:21.307790+0000 mgr.a (mgr.14355) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:32:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:24 smithi007 bash[22722]: cluster 2024-09-14T00:32:23.308580+0000 mgr.a (mgr.14355) 5688 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:24 smithi131 bash[24745]: cluster 2024-09-14T00:32:23.308580+0000 mgr.a (mgr.14355) 5688 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:24 smithi171 bash[25040]: cluster 2024-09-14T00:32:23.308580+0000 mgr.a (mgr.14355) 5688 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:25.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:26.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:26.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:26 smithi007 bash[22722]: cluster 2024-09-14T00:32:25.310540+0000 mgr.a (mgr.14355) 5689 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:26 smithi131 bash[24745]: cluster 2024-09-14T00:32:25.310540+0000 mgr.a (mgr.14355) 5689 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:26 smithi171 bash[25040]: cluster 2024-09-14T00:32:25.310540+0000 mgr.a (mgr.14355) 5689 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:27 smithi007 bash[22722]: audit 2024-09-14T00:32:26.064177+0000 mgr.a (mgr.14355) 5690 : audit [DBG] from='client.131949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:27 smithi131 bash[24745]: audit 2024-09-14T00:32:26.064177+0000 mgr.a (mgr.14355) 5690 : audit [DBG] from='client.131949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:27 smithi171 bash[25040]: audit 2024-09-14T00:32:26.064177+0000 mgr.a (mgr.14355) 5690 : audit [DBG] from='client.131949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:28 smithi007 bash[22722]: cluster 2024-09-14T00:32:27.311426+0000 mgr.a (mgr.14355) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:28 smithi131 bash[24745]: cluster 2024-09-14T00:32:27.311426+0000 mgr.a (mgr.14355) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:28 smithi171 bash[25040]: cluster 2024-09-14T00:32:27.311426+0000 mgr.a (mgr.14355) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:32:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:30 smithi007 bash[22722]: cluster 2024-09-14T00:32:29.312209+0000 mgr.a (mgr.14355) 5692 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:32:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:30 smithi131 bash[24745]: cluster 2024-09-14T00:32:29.312209+0000 mgr.a (mgr.14355) 5692 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:32:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:30 smithi171 bash[25040]: cluster 2024-09-14T00:32:29.312209+0000 mgr.a (mgr.14355) 5692 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:32:31.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:31.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:32.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:32.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:32.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:32 smithi007 bash[22722]: cluster 2024-09-14T00:32:31.314456+0000 mgr.a (mgr.14355) 5693 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:32 smithi131 bash[24745]: cluster 2024-09-14T00:32:31.314456+0000 mgr.a (mgr.14355) 5693 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:32 smithi171 bash[25040]: cluster 2024-09-14T00:32:31.314456+0000 mgr.a (mgr.14355) 5693 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:33 smithi007 bash[22722]: audit 2024-09-14T00:32:31.851394+0000 mgr.a (mgr.14355) 5694 : audit [DBG] from='client.132024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:33 smithi131 bash[24745]: audit 2024-09-14T00:32:31.851394+0000 mgr.a (mgr.14355) 5694 : audit [DBG] from='client.132024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:33 smithi171 bash[25040]: audit 2024-09-14T00:32:31.851394+0000 mgr.a (mgr.14355) 5694 : audit [DBG] from='client.132024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:34 smithi007 bash[22722]: cluster 2024-09-14T00:32:33.315351+0000 mgr.a (mgr.14355) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:34 smithi131 bash[24745]: cluster 2024-09-14T00:32:33.315351+0000 mgr.a (mgr.14355) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:34 smithi171 bash[25040]: cluster 2024-09-14T00:32:33.315351+0000 mgr.a (mgr.14355) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:36 smithi007 bash[22722]: cluster 2024-09-14T00:32:35.317451+0000 mgr.a (mgr.14355) 5696 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:36 smithi131 bash[24745]: cluster 2024-09-14T00:32:35.317451+0000 mgr.a (mgr.14355) 5696 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:36 smithi171 bash[25040]: cluster 2024-09-14T00:32:35.317451+0000 mgr.a (mgr.14355) 5696 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:38.033 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:38.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:38 smithi007 bash[22722]: cluster 2024-09-14T00:32:37.318085+0000 mgr.a (mgr.14355) 5697 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:38 smithi007 bash[22722]: audit 2024-09-14T00:32:37.617878+0000 mgr.a (mgr.14355) 5698 : audit [DBG] from='client.132099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:38 smithi131 bash[24745]: cluster 2024-09-14T00:32:37.318085+0000 mgr.a (mgr.14355) 5697 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:38 smithi131 bash[24745]: audit 2024-09-14T00:32:37.617878+0000 mgr.a (mgr.14355) 5698 : audit [DBG] from='client.132099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:38 smithi171 bash[25040]: cluster 2024-09-14T00:32:37.318085+0000 mgr.a (mgr.14355) 5697 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:38 smithi171 bash[25040]: audit 2024-09-14T00:32:37.617878+0000 mgr.a (mgr.14355) 5698 : audit [DBG] from='client.132099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:40 smithi007 bash[22722]: cluster 2024-09-14T00:32:39.318943+0000 mgr.a (mgr.14355) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:40 smithi131 bash[24745]: cluster 2024-09-14T00:32:39.318943+0000 mgr.a (mgr.14355) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:40 smithi171 bash[25040]: cluster 2024-09-14T00:32:39.318943+0000 mgr.a (mgr.14355) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:42 smithi007 bash[22722]: cluster 2024-09-14T00:32:41.321144+0000 mgr.a (mgr.14355) 5700 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:42 smithi131 bash[24745]: cluster 2024-09-14T00:32:41.321144+0000 mgr.a (mgr.14355) 5700 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:43.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:42 smithi171 bash[25040]: cluster 2024-09-14T00:32:41.321144+0000 mgr.a (mgr.14355) 5700 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:43.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:43.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:43.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:43.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:43.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:44 smithi007 bash[22722]: cluster 2024-09-14T00:32:43.321860+0000 mgr.a (mgr.14355) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:44 smithi007 bash[22722]: audit 2024-09-14T00:32:43.368525+0000 mgr.a (mgr.14355) 5702 : audit [DBG] from='client.132174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:44 smithi131 bash[24745]: cluster 2024-09-14T00:32:43.321860+0000 mgr.a (mgr.14355) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:44 smithi131 bash[24745]: audit 2024-09-14T00:32:43.368525+0000 mgr.a (mgr.14355) 5702 : audit [DBG] from='client.132174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:44 smithi171 bash[25040]: cluster 2024-09-14T00:32:43.321860+0000 mgr.a (mgr.14355) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:44 smithi171 bash[25040]: audit 2024-09-14T00:32:43.368525+0000 mgr.a (mgr.14355) 5702 : audit [DBG] from='client.132174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:46 smithi007 bash[22722]: cluster 2024-09-14T00:32:45.324281+0000 mgr.a (mgr.14355) 5703 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:46 smithi131 bash[24745]: cluster 2024-09-14T00:32:45.324281+0000 mgr.a (mgr.14355) 5703 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:46 smithi171 bash[25040]: cluster 2024-09-14T00:32:45.324281+0000 mgr.a (mgr.14355) 5703 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:48.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:48.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:48.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:48 smithi007 bash[22722]: cluster 2024-09-14T00:32:47.325078+0000 mgr.a (mgr.14355) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:48 smithi131 bash[24745]: cluster 2024-09-14T00:32:47.325078+0000 mgr.a (mgr.14355) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:48 smithi171 bash[25040]: cluster 2024-09-14T00:32:47.325078+0000 mgr.a (mgr.14355) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:49.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:49.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:49.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:49.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:49.542 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:50 smithi007 bash[22722]: audit 2024-09-14T00:32:49.119733+0000 mgr.a (mgr.14355) 5705 : audit [DBG] from='client.132249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:50 smithi007 bash[22722]: cluster 2024-09-14T00:32:49.325620+0000 mgr.a (mgr.14355) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:50 smithi131 bash[24745]: audit 2024-09-14T00:32:49.119733+0000 mgr.a (mgr.14355) 5705 : audit [DBG] from='client.132249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:50 smithi131 bash[24745]: cluster 2024-09-14T00:32:49.325620+0000 mgr.a (mgr.14355) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:50 smithi171 bash[25040]: audit 2024-09-14T00:32:49.119733+0000 mgr.a (mgr.14355) 5705 : audit [DBG] from='client.132249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:50 smithi171 bash[25040]: cluster 2024-09-14T00:32:49.325620+0000 mgr.a (mgr.14355) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:52 smithi007 bash[22722]: cluster 2024-09-14T00:32:51.327952+0000 mgr.a (mgr.14355) 5707 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:52 smithi131 bash[24745]: cluster 2024-09-14T00:32:51.327952+0000 mgr.a (mgr.14355) 5707 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:52 smithi171 bash[25040]: cluster 2024-09-14T00:32:51.327952+0000 mgr.a (mgr.14355) 5707 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:54.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:32:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:32:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:32:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:54 smithi007 bash[22722]: cluster 2024-09-14T00:32:53.328754+0000 mgr.a (mgr.14355) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:54 smithi131 bash[24745]: cluster 2024-09-14T00:32:53.328754+0000 mgr.a (mgr.14355) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:54 smithi171 bash[25040]: cluster 2024-09-14T00:32:53.328754+0000 mgr.a (mgr.14355) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:55.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:32:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:32:55.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:32:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:32:55.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:32:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:56 smithi007 bash[22722]: audit 2024-09-14T00:32:54.872764+0000 mgr.a (mgr.14355) 5709 : audit [DBG] from='client.132327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:56 smithi007 bash[22722]: cluster 2024-09-14T00:32:55.330818+0000 mgr.a (mgr.14355) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:56 smithi131 bash[24745]: audit 2024-09-14T00:32:54.872764+0000 mgr.a (mgr.14355) 5709 : audit [DBG] from='client.132327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:56 smithi131 bash[24745]: cluster 2024-09-14T00:32:55.330818+0000 mgr.a (mgr.14355) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:56 smithi171 bash[25040]: audit 2024-09-14T00:32:54.872764+0000 mgr.a (mgr.14355) 5709 : audit [DBG] from='client.132327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:32:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:56 smithi171 bash[25040]: cluster 2024-09-14T00:32:55.330818+0000 mgr.a (mgr.14355) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:32:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:32:58 smithi007 bash[22722]: cluster 2024-09-14T00:32:57.331522+0000 mgr.a (mgr.14355) 5711 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:32:58 smithi131 bash[24745]: cluster 2024-09-14T00:32:57.331522+0000 mgr.a (mgr.14355) 5711 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:32:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:32:58 smithi171 bash[25040]: cluster 2024-09-14T00:32:57.331522+0000 mgr.a (mgr.14355) 5711 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:00.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:00 smithi007 bash[22722]: cluster 2024-09-14T00:32:59.332254+0000 mgr.a (mgr.14355) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:00 smithi131 bash[24745]: cluster 2024-09-14T00:32:59.332254+0000 mgr.a (mgr.14355) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:01.038 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:01.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:00 smithi171 bash[25040]: cluster 2024-09-14T00:32:59.332254+0000 mgr.a (mgr.14355) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:01 smithi007 bash[22722]: audit 2024-09-14T00:33:00.626716+0000 mgr.a (mgr.14355) 5713 : audit [DBG] from='client.132402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:01 smithi131 bash[24745]: audit 2024-09-14T00:33:00.626716+0000 mgr.a (mgr.14355) 5713 : audit [DBG] from='client.132402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:01 smithi171 bash[25040]: audit 2024-09-14T00:33:00.626716+0000 mgr.a (mgr.14355) 5713 : audit [DBG] from='client.132402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: cluster 2024-09-14T00:33:01.335082+0000 mgr.a (mgr.14355) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: audit 2024-09-14T00:33:01.774869+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:33:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: audit 2024-09-14T00:33:02.395838+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: audit 2024-09-14T00:33:02.400454+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: audit 2024-09-14T00:33:02.405319+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:02 smithi007 bash[22722]: audit 2024-09-14T00:33:02.410753+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: cluster 2024-09-14T00:33:01.335082+0000 mgr.a (mgr.14355) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: audit 2024-09-14T00:33:01.774869+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:33:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: audit 2024-09-14T00:33:02.395838+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: audit 2024-09-14T00:33:02.400454+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: audit 2024-09-14T00:33:02.405319+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:02 smithi131 bash[24745]: audit 2024-09-14T00:33:02.410753+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: cluster 2024-09-14T00:33:01.335082+0000 mgr.a (mgr.14355) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: audit 2024-09-14T00:33:01.774869+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:33:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: audit 2024-09-14T00:33:02.395838+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: audit 2024-09-14T00:33:02.400454+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: audit 2024-09-14T00:33:02.405319+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:02 smithi171 bash[25040]: audit 2024-09-14T00:33:02.410753+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22722]: audit 2024-09-14T00:33:03.199105+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22722]: audit 2024-09-14T00:33:03.200678+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22722]: audit 2024-09-14T00:33:03.209131+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22722]: audit 2024-09-14T00:33:03.213929+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:03.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22972]: debug 2024-09-14T00:33:03.946+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:33:03.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:33:03 smithi007 bash[22972]: debug 2024-09-14T00:33:03.946+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:33:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:03 smithi131 bash[24745]: audit 2024-09-14T00:33:03.199105+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:33:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:03 smithi131 bash[24745]: audit 2024-09-14T00:33:03.200678+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:33:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:03 smithi131 bash[24745]: audit 2024-09-14T00:33:03.209131+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:03 smithi131 bash[24745]: audit 2024-09-14T00:33:03.213929+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:03 smithi171 bash[25040]: audit 2024-09-14T00:33:03.199105+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:33:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:03 smithi171 bash[25040]: audit 2024-09-14T00:33:03.200678+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:33:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:03 smithi171 bash[25040]: audit 2024-09-14T00:33:03.209131+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:33:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:03 smithi171 bash[25040]: audit 2024-09-14T00:33:03.213929+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:04 smithi131 bash[24745]: audit 2024-09-14T00:33:03.216302+0000 mgr.a (mgr.14355) 5715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:05.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:04 smithi131 bash[24745]: cluster 2024-09-14T00:33:03.342878+0000 mgr.a (mgr.14355) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:33:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:04 smithi171 bash[25040]: audit 2024-09-14T00:33:03.216302+0000 mgr.a (mgr.14355) 5715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:04 smithi171 bash[25040]: cluster 2024-09-14T00:33:03.342878+0000 mgr.a (mgr.14355) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:33:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:04 smithi007 bash[22722]: audit 2024-09-14T00:33:03.216302+0000 mgr.a (mgr.14355) 5715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:33:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:04 smithi007 bash[22722]: cluster 2024-09-14T00:33:03.342878+0000 mgr.a (mgr.14355) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:33:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:05 smithi131 bash[24745]: audit 2024-09-14T00:33:03.951532+0000 mgr.a (mgr.14355) 5717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:33:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:05 smithi131 bash[24745]: cephadm 2024-09-14T00:33:03.952986+0000 mgr.a (mgr.14355) 5718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:33:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:05 smithi171 bash[25040]: audit 2024-09-14T00:33:03.951532+0000 mgr.a (mgr.14355) 5717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:33:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:05 smithi171 bash[25040]: cephadm 2024-09-14T00:33:03.952986+0000 mgr.a (mgr.14355) 5718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:33:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:05 smithi007 bash[22722]: audit 2024-09-14T00:33:03.951532+0000 mgr.a (mgr.14355) 5717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:33:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:05 smithi007 bash[22722]: cephadm 2024-09-14T00:33:03.952986+0000 mgr.a (mgr.14355) 5718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:33:06.820 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:06.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:06.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:06.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:06.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:06 smithi131 bash[24745]: cluster 2024-09-14T00:33:05.345117+0000 mgr.a (mgr.14355) 5719 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:06 smithi171 bash[25040]: cluster 2024-09-14T00:33:05.345117+0000 mgr.a (mgr.14355) 5719 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:06 smithi007 bash[22722]: cluster 2024-09-14T00:33:05.345117+0000 mgr.a (mgr.14355) 5719 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:07 smithi131 bash[24745]: audit 2024-09-14T00:33:06.378698+0000 mgr.a (mgr.14355) 5720 : audit [DBG] from='client.132585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:07 smithi171 bash[25040]: audit 2024-09-14T00:33:06.378698+0000 mgr.a (mgr.14355) 5720 : audit [DBG] from='client.132585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:07 smithi007 bash[22722]: audit 2024-09-14T00:33:06.378698+0000 mgr.a (mgr.14355) 5720 : audit [DBG] from='client.132585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:08 smithi131 bash[24745]: cluster 2024-09-14T00:33:07.345984+0000 mgr.a (mgr.14355) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:08 smithi171 bash[25040]: cluster 2024-09-14T00:33:07.345984+0000 mgr.a (mgr.14355) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:08 smithi007 bash[22722]: cluster 2024-09-14T00:33:07.345984+0000 mgr.a (mgr.14355) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:10 smithi131 bash[24745]: cluster 2024-09-14T00:33:09.346928+0000 mgr.a (mgr.14355) 5722 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:10 smithi171 bash[25040]: cluster 2024-09-14T00:33:09.346928+0000 mgr.a (mgr.14355) 5722 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:10 smithi007 bash[22722]: cluster 2024-09-14T00:33:09.346928+0000 mgr.a (mgr.14355) 5722 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:33:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:12.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:12 smithi131 bash[24745]: cluster 2024-09-14T00:33:11.349309+0000 mgr.a (mgr.14355) 5723 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:12 smithi171 bash[25040]: cluster 2024-09-14T00:33:11.349309+0000 mgr.a (mgr.14355) 5723 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:12 smithi007 bash[22722]: cluster 2024-09-14T00:33:11.349309+0000 mgr.a (mgr.14355) 5723 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:13 smithi131 bash[24745]: audit 2024-09-14T00:33:12.157865+0000 mgr.a (mgr.14355) 5724 : audit [DBG] from='client.132660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:13 smithi171 bash[25040]: audit 2024-09-14T00:33:12.157865+0000 mgr.a (mgr.14355) 5724 : audit [DBG] from='client.132660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:13 smithi007 bash[22722]: audit 2024-09-14T00:33:12.157865+0000 mgr.a (mgr.14355) 5724 : audit [DBG] from='client.132660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:14 smithi131 bash[24745]: cluster 2024-09-14T00:33:13.350239+0000 mgr.a (mgr.14355) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:14 smithi171 bash[25040]: cluster 2024-09-14T00:33:13.350239+0000 mgr.a (mgr.14355) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:14 smithi007 bash[22722]: cluster 2024-09-14T00:33:13.350239+0000 mgr.a (mgr.14355) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:17.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:16 smithi131 bash[24745]: cluster 2024-09-14T00:33:15.352440+0000 mgr.a (mgr.14355) 5726 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:16 smithi171 bash[25040]: cluster 2024-09-14T00:33:15.352440+0000 mgr.a (mgr.14355) 5726 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:16 smithi007 bash[22722]: cluster 2024-09-14T00:33:15.352440+0000 mgr.a (mgr.14355) 5726 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:33:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:17.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:17.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:18.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:18 smithi131 bash[24745]: cluster 2024-09-14T00:33:17.353192+0000 mgr.a (mgr.14355) 5727 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:18 smithi171 bash[25040]: cluster 2024-09-14T00:33:17.353192+0000 mgr.a (mgr.14355) 5727 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:18 smithi007 bash[22722]: cluster 2024-09-14T00:33:17.353192+0000 mgr.a (mgr.14355) 5727 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:19 smithi131 bash[24745]: audit 2024-09-14T00:33:17.908666+0000 mgr.a (mgr.14355) 5728 : audit [DBG] from='client.132735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:19 smithi171 bash[25040]: audit 2024-09-14T00:33:17.908666+0000 mgr.a (mgr.14355) 5728 : audit [DBG] from='client.132735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:19 smithi007 bash[22722]: audit 2024-09-14T00:33:17.908666+0000 mgr.a (mgr.14355) 5728 : audit [DBG] from='client.132735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:20 smithi131 bash[24745]: cluster 2024-09-14T00:33:19.354076+0000 mgr.a (mgr.14355) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:20 smithi171 bash[25040]: cluster 2024-09-14T00:33:19.354076+0000 mgr.a (mgr.14355) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:20 smithi007 bash[22722]: cluster 2024-09-14T00:33:19.354076+0000 mgr.a (mgr.14355) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:22 smithi131 bash[24745]: cluster 2024-09-14T00:33:21.356323+0000 mgr.a (mgr.14355) 5730 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:22 smithi171 bash[25040]: cluster 2024-09-14T00:33:21.356323+0000 mgr.a (mgr.14355) 5730 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:22 smithi007 bash[22722]: cluster 2024-09-14T00:33:21.356323+0000 mgr.a (mgr.14355) 5730 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:23.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:23.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:23.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:24.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:24 smithi131 bash[24745]: cluster 2024-09-14T00:33:23.356961+0000 mgr.a (mgr.14355) 5731 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:25.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:24 smithi131 bash[24745]: audit 2024-09-14T00:33:23.662745+0000 mgr.a (mgr.14355) 5732 : audit [DBG] from='client.132813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:24 smithi171 bash[25040]: cluster 2024-09-14T00:33:23.356961+0000 mgr.a (mgr.14355) 5731 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:24 smithi171 bash[25040]: audit 2024-09-14T00:33:23.662745+0000 mgr.a (mgr.14355) 5732 : audit [DBG] from='client.132813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:24 smithi007 bash[22722]: cluster 2024-09-14T00:33:23.356961+0000 mgr.a (mgr.14355) 5731 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:24 smithi007 bash[22722]: audit 2024-09-14T00:33:23.662745+0000 mgr.a (mgr.14355) 5732 : audit [DBG] from='client.132813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:26 smithi131 bash[24745]: cluster 2024-09-14T00:33:25.359230+0000 mgr.a (mgr.14355) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:26 smithi171 bash[25040]: cluster 2024-09-14T00:33:25.359230+0000 mgr.a (mgr.14355) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:26 smithi007 bash[22722]: cluster 2024-09-14T00:33:25.359230+0000 mgr.a (mgr.14355) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:28 smithi171 bash[25040]: cluster 2024-09-14T00:33:27.359986+0000 mgr.a (mgr.14355) 5734 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:28 smithi007 bash[22722]: cluster 2024-09-14T00:33:27.359986+0000 mgr.a (mgr.14355) 5734 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:28 smithi131 bash[24745]: cluster 2024-09-14T00:33:27.359986+0000 mgr.a (mgr.14355) 5734 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:29.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:30 smithi171 bash[25040]: cluster 2024-09-14T00:33:29.360716+0000 mgr.a (mgr.14355) 5735 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:30 smithi171 bash[25040]: audit 2024-09-14T00:33:29.446842+0000 mgr.a (mgr.14355) 5736 : audit [DBG] from='client.132891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:30 smithi007 bash[22722]: cluster 2024-09-14T00:33:29.360716+0000 mgr.a (mgr.14355) 5735 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:30 smithi007 bash[22722]: audit 2024-09-14T00:33:29.446842+0000 mgr.a (mgr.14355) 5736 : audit [DBG] from='client.132891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:30 smithi131 bash[24745]: cluster 2024-09-14T00:33:29.360716+0000 mgr.a (mgr.14355) 5735 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:30 smithi131 bash[24745]: audit 2024-09-14T00:33:29.446842+0000 mgr.a (mgr.14355) 5736 : audit [DBG] from='client.132891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:32 smithi171 bash[25040]: cluster 2024-09-14T00:33:31.363071+0000 mgr.a (mgr.14355) 5737 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:32 smithi007 bash[22722]: cluster 2024-09-14T00:33:31.363071+0000 mgr.a (mgr.14355) 5737 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:32 smithi131 bash[24745]: cluster 2024-09-14T00:33:31.363071+0000 mgr.a (mgr.14355) 5737 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:34 smithi007 bash[22722]: cluster 2024-09-14T00:33:33.363848+0000 mgr.a (mgr.14355) 5738 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:34 smithi131 bash[24745]: cluster 2024-09-14T00:33:33.363848+0000 mgr.a (mgr.14355) 5738 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:34 smithi171 bash[25040]: cluster 2024-09-14T00:33:33.363848+0000 mgr.a (mgr.14355) 5738 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:35.644 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:35.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:36 smithi007 bash[22722]: audit 2024-09-14T00:33:35.225315+0000 mgr.a (mgr.14355) 5739 : audit [DBG] from='client.132963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:36 smithi007 bash[22722]: cluster 2024-09-14T00:33:35.365233+0000 mgr.a (mgr.14355) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:36 smithi131 bash[24745]: audit 2024-09-14T00:33:35.225315+0000 mgr.a (mgr.14355) 5739 : audit [DBG] from='client.132963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:36 smithi131 bash[24745]: cluster 2024-09-14T00:33:35.365233+0000 mgr.a (mgr.14355) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:36 smithi171 bash[25040]: audit 2024-09-14T00:33:35.225315+0000 mgr.a (mgr.14355) 5739 : audit [DBG] from='client.132963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:36 smithi171 bash[25040]: cluster 2024-09-14T00:33:35.365233+0000 mgr.a (mgr.14355) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:38 smithi007 bash[22722]: cluster 2024-09-14T00:33:37.366045+0000 mgr.a (mgr.14355) 5741 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:38 smithi131 bash[24745]: cluster 2024-09-14T00:33:37.366045+0000 mgr.a (mgr.14355) 5741 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:38 smithi171 bash[25040]: cluster 2024-09-14T00:33:37.366045+0000 mgr.a (mgr.14355) 5741 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:40 smithi007 bash[22722]: cluster 2024-09-14T00:33:39.366850+0000 mgr.a (mgr.14355) 5742 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:40 smithi131 bash[24745]: cluster 2024-09-14T00:33:39.366850+0000 mgr.a (mgr.14355) 5742 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:40 smithi171 bash[25040]: cluster 2024-09-14T00:33:39.366850+0000 mgr.a (mgr.14355) 5742 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:41.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:41.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:41.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:41.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:41.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:42 smithi007 bash[22722]: audit 2024-09-14T00:33:40.986705+0000 mgr.a (mgr.14355) 5743 : audit [DBG] from='client.133041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:42 smithi007 bash[22722]: cluster 2024-09-14T00:33:41.368756+0000 mgr.a (mgr.14355) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:42 smithi131 bash[24745]: audit 2024-09-14T00:33:40.986705+0000 mgr.a (mgr.14355) 5743 : audit [DBG] from='client.133041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:42 smithi131 bash[24745]: cluster 2024-09-14T00:33:41.368756+0000 mgr.a (mgr.14355) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:42 smithi171 bash[25040]: audit 2024-09-14T00:33:40.986705+0000 mgr.a (mgr.14355) 5743 : audit [DBG] from='client.133041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:42 smithi171 bash[25040]: cluster 2024-09-14T00:33:41.368756+0000 mgr.a (mgr.14355) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:44 smithi007 bash[22722]: cluster 2024-09-14T00:33:43.369511+0000 mgr.a (mgr.14355) 5745 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:44 smithi131 bash[24745]: cluster 2024-09-14T00:33:43.369511+0000 mgr.a (mgr.14355) 5745 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:44 smithi171 bash[25040]: cluster 2024-09-14T00:33:43.369511+0000 mgr.a (mgr.14355) 5745 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:33:46.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:46.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:46 smithi007 bash[22722]: cluster 2024-09-14T00:33:45.371461+0000 mgr.a (mgr.14355) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:47.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:47.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:46 smithi131 bash[24745]: cluster 2024-09-14T00:33:45.371461+0000 mgr.a (mgr.14355) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:46 smithi171 bash[25040]: cluster 2024-09-14T00:33:45.371461+0000 mgr.a (mgr.14355) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:47 smithi007 bash[22722]: audit 2024-09-14T00:33:46.765348+0000 mgr.a (mgr.14355) 5747 : audit [DBG] from='client.133119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:47 smithi131 bash[24745]: audit 2024-09-14T00:33:46.765348+0000 mgr.a (mgr.14355) 5747 : audit [DBG] from='client.133119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:47 smithi171 bash[25040]: audit 2024-09-14T00:33:46.765348+0000 mgr.a (mgr.14355) 5747 : audit [DBG] from='client.133119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:48 smithi007 bash[22722]: cluster 2024-09-14T00:33:47.372357+0000 mgr.a (mgr.14355) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:48 smithi131 bash[24745]: cluster 2024-09-14T00:33:47.372357+0000 mgr.a (mgr.14355) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:48 smithi171 bash[25040]: cluster 2024-09-14T00:33:47.372357+0000 mgr.a (mgr.14355) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:50 smithi007 bash[22722]: cluster 2024-09-14T00:33:49.373272+0000 mgr.a (mgr.14355) 5749 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:50 smithi131 bash[24745]: cluster 2024-09-14T00:33:49.373272+0000 mgr.a (mgr.14355) 5749 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:50 smithi171 bash[25040]: cluster 2024-09-14T00:33:49.373272+0000 mgr.a (mgr.14355) 5749 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:52.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:52.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:52.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:52.978 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:52.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:52 smithi007 bash[22722]: cluster 2024-09-14T00:33:51.375561+0000 mgr.a (mgr.14355) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:52 smithi131 bash[24745]: cluster 2024-09-14T00:33:51.375561+0000 mgr.a (mgr.14355) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:52 smithi171 bash[25040]: cluster 2024-09-14T00:33:51.375561+0000 mgr.a (mgr.14355) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:53 smithi007 bash[22722]: audit 2024-09-14T00:33:52.549433+0000 mgr.a (mgr.14355) 5751 : audit [DBG] from='client.133197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:53 smithi131 bash[24745]: audit 2024-09-14T00:33:52.549433+0000 mgr.a (mgr.14355) 5751 : audit [DBG] from='client.133197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:53 smithi171 bash[25040]: audit 2024-09-14T00:33:52.549433+0000 mgr.a (mgr.14355) 5751 : audit [DBG] from='client.133197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:33:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:54 smithi007 bash[22722]: cluster 2024-09-14T00:33:53.376523+0000 mgr.a (mgr.14355) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:54 smithi131 bash[24745]: cluster 2024-09-14T00:33:53.376523+0000 mgr.a (mgr.14355) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:54 smithi171 bash[25040]: cluster 2024-09-14T00:33:53.376523+0000 mgr.a (mgr.14355) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:56 smithi007 bash[22722]: cluster 2024-09-14T00:33:55.378795+0000 mgr.a (mgr.14355) 5753 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:56 smithi131 bash[24745]: cluster 2024-09-14T00:33:55.378795+0000 mgr.a (mgr.14355) 5753 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:56 smithi171 bash[25040]: cluster 2024-09-14T00:33:55.378795+0000 mgr.a (mgr.14355) 5753 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:33:57.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:33:57.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:33:57.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:33:58.756 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:33:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:33:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:33:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:33:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:33:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:58 smithi007 bash[22722]: cluster 2024-09-14T00:33:57.379589+0000 mgr.a (mgr.14355) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:58 smithi131 bash[24745]: cluster 2024-09-14T00:33:57.379589+0000 mgr.a (mgr.14355) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:33:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:58 smithi171 bash[25040]: cluster 2024-09-14T00:33:57.379589+0000 mgr.a (mgr.14355) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:59 smithi007 bash[22722]: audit 2024-09-14T00:33:58.315604+0000 mgr.a (mgr.14355) 5755 : audit [DBG] from='client.133269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:33:59 smithi007 bash[22722]: cluster 2024-09-14T00:33:59.380549+0000 mgr.a (mgr.14355) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:59 smithi131 bash[24745]: audit 2024-09-14T00:33:58.315604+0000 mgr.a (mgr.14355) 5755 : audit [DBG] from='client.133269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:33:59 smithi131 bash[24745]: cluster 2024-09-14T00:33:59.380549+0000 mgr.a (mgr.14355) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:59 smithi171 bash[25040]: audit 2024-09-14T00:33:58.315604+0000 mgr.a (mgr.14355) 5755 : audit [DBG] from='client.133269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:33:59 smithi171 bash[25040]: cluster 2024-09-14T00:33:59.380549+0000 mgr.a (mgr.14355) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:02 smithi007 bash[22722]: cluster 2024-09-14T00:34:01.382758+0000 mgr.a (mgr.14355) 5757 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:02 smithi131 bash[24745]: cluster 2024-09-14T00:34:01.382758+0000 mgr.a (mgr.14355) 5757 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:02 smithi171 bash[25040]: cluster 2024-09-14T00:34:01.382758+0000 mgr.a (mgr.14355) 5757 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:03.758 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:03.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:03.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:04.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:04 smithi007 bash[22722]: cluster 2024-09-14T00:34:03.383539+0000 mgr.a (mgr.14355) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:04 smithi007 bash[22722]: audit 2024-09-14T00:34:04.004340+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:34:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:04 smithi131 bash[24745]: cluster 2024-09-14T00:34:03.383539+0000 mgr.a (mgr.14355) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:04 smithi131 bash[24745]: audit 2024-09-14T00:34:04.004340+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:34:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:04 smithi171 bash[25040]: cluster 2024-09-14T00:34:03.383539+0000 mgr.a (mgr.14355) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:04 smithi171 bash[25040]: audit 2024-09-14T00:34:04.004340+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:34:05.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22972]: debug 2024-09-14T00:34:05.609+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:34:05.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22972]: debug 2024-09-14T00:34:05.609+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:34:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22722]: audit 2024-09-14T00:34:04.096094+0000 mgr.a (mgr.14355) 5759 : audit [DBG] from='client.133344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22722]: audit 2024-09-14T00:34:04.871804+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:34:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22722]: audit 2024-09-14T00:34:04.873435+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:34:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22722]: audit 2024-09-14T00:34:04.881448+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:34:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:05 smithi007 bash[22722]: audit 2024-09-14T00:34:04.884353+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:05 smithi131 bash[24745]: audit 2024-09-14T00:34:04.096094+0000 mgr.a (mgr.14355) 5759 : audit [DBG] from='client.133344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:05.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:05 smithi131 bash[24745]: audit 2024-09-14T00:34:04.871804+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:34:05.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:05 smithi131 bash[24745]: audit 2024-09-14T00:34:04.873435+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:34:05.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:05 smithi131 bash[24745]: audit 2024-09-14T00:34:04.881448+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:34:05.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:05 smithi131 bash[24745]: audit 2024-09-14T00:34:04.884353+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:05.970 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:05 smithi171 bash[25040]: audit 2024-09-14T00:34:04.096094+0000 mgr.a (mgr.14355) 5759 : audit [DBG] from='client.133344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:05.970 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:05 smithi171 bash[25040]: audit 2024-09-14T00:34:04.871804+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:34:05.970 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:05 smithi171 bash[25040]: audit 2024-09-14T00:34:04.873435+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:34:05.970 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:05 smithi171 bash[25040]: audit 2024-09-14T00:34:04.881448+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:34:05.971 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:05 smithi171 bash[25040]: audit 2024-09-14T00:34:04.884353+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:06 smithi007 bash[22722]: audit 2024-09-14T00:34:04.885719+0000 mgr.a (mgr.14355) 5760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:06 smithi007 bash[22722]: cluster 2024-09-14T00:34:05.387927+0000 mgr.a (mgr.14355) 5761 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:34:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:06 smithi007 bash[22722]: audit 2024-09-14T00:34:05.612475+0000 mgr.a (mgr.14355) 5762 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:34:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:06 smithi007 bash[22722]: cephadm 2024-09-14T00:34:05.613922+0000 mgr.a (mgr.14355) 5763 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:34:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:06 smithi131 bash[24745]: audit 2024-09-14T00:34:04.885719+0000 mgr.a (mgr.14355) 5760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:06 smithi131 bash[24745]: cluster 2024-09-14T00:34:05.387927+0000 mgr.a (mgr.14355) 5761 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:34:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:06 smithi131 bash[24745]: audit 2024-09-14T00:34:05.612475+0000 mgr.a (mgr.14355) 5762 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:34:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:06 smithi131 bash[24745]: cephadm 2024-09-14T00:34:05.613922+0000 mgr.a (mgr.14355) 5763 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:34:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:06 smithi171 bash[25040]: audit 2024-09-14T00:34:04.885719+0000 mgr.a (mgr.14355) 5760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:34:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:06 smithi171 bash[25040]: cluster 2024-09-14T00:34:05.387927+0000 mgr.a (mgr.14355) 5761 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:34:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:06 smithi171 bash[25040]: audit 2024-09-14T00:34:05.612475+0000 mgr.a (mgr.14355) 5762 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:34:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:06 smithi171 bash[25040]: cephadm 2024-09-14T00:34:05.613922+0000 mgr.a (mgr.14355) 5763 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:34:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:08 smithi007 bash[22722]: cluster 2024-09-14T00:34:07.388692+0000 mgr.a (mgr.14355) 5764 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:08 smithi131 bash[24745]: cluster 2024-09-14T00:34:07.388692+0000 mgr.a (mgr.14355) 5764 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:08 smithi171 bash[25040]: cluster 2024-09-14T00:34:07.388692+0000 mgr.a (mgr.14355) 5764 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:10.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:10.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:10 smithi131 bash[24745]: cluster 2024-09-14T00:34:09.389472+0000 mgr.a (mgr.14355) 5765 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:10 smithi131 bash[24745]: audit 2024-09-14T00:34:09.844344+0000 mgr.a (mgr.14355) 5766 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:10 smithi171 bash[25040]: cluster 2024-09-14T00:34:09.389472+0000 mgr.a (mgr.14355) 5765 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:10 smithi171 bash[25040]: audit 2024-09-14T00:34:09.844344+0000 mgr.a (mgr.14355) 5766 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:10 smithi007 bash[22722]: cluster 2024-09-14T00:34:09.389472+0000 mgr.a (mgr.14355) 5765 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:34:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:10 smithi007 bash[22722]: audit 2024-09-14T00:34:09.844344+0000 mgr.a (mgr.14355) 5766 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:12 smithi131 bash[24745]: cluster 2024-09-14T00:34:11.391926+0000 mgr.a (mgr.14355) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:12 smithi171 bash[25040]: cluster 2024-09-14T00:34:11.391926+0000 mgr.a (mgr.14355) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:12 smithi007 bash[22722]: cluster 2024-09-14T00:34:11.391926+0000 mgr.a (mgr.14355) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:14 smithi131 bash[24745]: cluster 2024-09-14T00:34:13.392706+0000 mgr.a (mgr.14355) 5768 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:14 smithi171 bash[25040]: cluster 2024-09-14T00:34:13.392706+0000 mgr.a (mgr.14355) 5768 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:14 smithi007 bash[22722]: cluster 2024-09-14T00:34:13.392706+0000 mgr.a (mgr.14355) 5768 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:15.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:15.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:16.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:16 smithi131 bash[24745]: cluster 2024-09-14T00:34:15.393912+0000 mgr.a (mgr.14355) 5769 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:16.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:16 smithi131 bash[24745]: audit 2024-09-14T00:34:15.634476+0000 mgr.a (mgr.14355) 5770 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:16 smithi171 bash[25040]: cluster 2024-09-14T00:34:15.393912+0000 mgr.a (mgr.14355) 5769 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:16 smithi171 bash[25040]: audit 2024-09-14T00:34:15.634476+0000 mgr.a (mgr.14355) 5770 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:16 smithi007 bash[22722]: cluster 2024-09-14T00:34:15.393912+0000 mgr.a (mgr.14355) 5769 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:34:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:16 smithi007 bash[22722]: audit 2024-09-14T00:34:15.634476+0000 mgr.a (mgr.14355) 5770 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:18 smithi131 bash[24745]: cluster 2024-09-14T00:34:17.394864+0000 mgr.a (mgr.14355) 5771 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:18 smithi171 bash[25040]: cluster 2024-09-14T00:34:17.394864+0000 mgr.a (mgr.14355) 5771 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:18 smithi007 bash[22722]: cluster 2024-09-14T00:34:17.394864+0000 mgr.a (mgr.14355) 5771 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:20 smithi131 bash[24745]: cluster 2024-09-14T00:34:19.395696+0000 mgr.a (mgr.14355) 5772 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:20 smithi171 bash[25040]: cluster 2024-09-14T00:34:19.395696+0000 mgr.a (mgr.14355) 5772 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:20 smithi007 bash[22722]: cluster 2024-09-14T00:34:19.395696+0000 mgr.a (mgr.14355) 5772 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:21.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:21.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:21.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:21.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:21.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:21.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:21.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:22 smithi131 bash[24745]: audit 2024-09-14T00:34:21.393719+0000 mgr.a (mgr.14355) 5773 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:22 smithi131 bash[24745]: cluster 2024-09-14T00:34:21.413282+0000 mgr.a (mgr.14355) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:22 smithi171 bash[25040]: audit 2024-09-14T00:34:21.393719+0000 mgr.a (mgr.14355) 5773 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:22 smithi171 bash[25040]: cluster 2024-09-14T00:34:21.413282+0000 mgr.a (mgr.14355) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:22 smithi007 bash[22722]: audit 2024-09-14T00:34:21.393719+0000 mgr.a (mgr.14355) 5773 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:22 smithi007 bash[22722]: cluster 2024-09-14T00:34:21.413282+0000 mgr.a (mgr.14355) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:34:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:24 smithi131 bash[24745]: cluster 2024-09-14T00:34:23.414391+0000 mgr.a (mgr.14355) 5775 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T00:34:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:24 smithi171 bash[25040]: cluster 2024-09-14T00:34:23.414391+0000 mgr.a (mgr.14355) 5775 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T00:34:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:24 smithi007 bash[22722]: cluster 2024-09-14T00:34:23.414391+0000 mgr.a (mgr.14355) 5775 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T00:34:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:26 smithi131 bash[24745]: cluster 2024-09-14T00:34:25.416522+0000 mgr.a (mgr.14355) 5776 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:26.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:26 smithi171 bash[25040]: cluster 2024-09-14T00:34:25.416522+0000 mgr.a (mgr.14355) 5776 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:26.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:26.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:26 smithi007 bash[22722]: cluster 2024-09-14T00:34:25.416522+0000 mgr.a (mgr.14355) 5776 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:27.621 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:27.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:27.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:27.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:27.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:28 smithi131 bash[24745]: audit 2024-09-14T00:34:27.177682+0000 mgr.a (mgr.14355) 5777 : audit [DBG] from='client.133761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:28.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:28 smithi131 bash[24745]: cluster 2024-09-14T00:34:27.418334+0000 mgr.a (mgr.14355) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:28 smithi171 bash[25040]: audit 2024-09-14T00:34:27.177682+0000 mgr.a (mgr.14355) 5777 : audit [DBG] from='client.133761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:28 smithi171 bash[25040]: cluster 2024-09-14T00:34:27.418334+0000 mgr.a (mgr.14355) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:28 smithi007 bash[22722]: audit 2024-09-14T00:34:27.177682+0000 mgr.a (mgr.14355) 5777 : audit [DBG] from='client.133761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:28 smithi007 bash[22722]: cluster 2024-09-14T00:34:27.418334+0000 mgr.a (mgr.14355) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:30 smithi131 bash[24745]: cluster 2024-09-14T00:34:29.419265+0000 mgr.a (mgr.14355) 5779 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:30 smithi171 bash[25040]: cluster 2024-09-14T00:34:29.419265+0000 mgr.a (mgr.14355) 5779 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:30 smithi007 bash[22722]: cluster 2024-09-14T00:34:29.419265+0000 mgr.a (mgr.14355) 5779 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:32.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:32.623 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:32 smithi131 bash[24745]: cluster 2024-09-14T00:34:31.421499+0000 mgr.a (mgr.14355) 5780 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:32 smithi171 bash[25040]: cluster 2024-09-14T00:34:31.421499+0000 mgr.a (mgr.14355) 5780 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:32 smithi007 bash[22722]: cluster 2024-09-14T00:34:31.421499+0000 mgr.a (mgr.14355) 5780 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:33.358 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:33.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:34 smithi131 bash[24745]: audit 2024-09-14T00:34:32.951406+0000 mgr.a (mgr.14355) 5781 : audit [DBG] from='client.133839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:34.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:34 smithi131 bash[24745]: cluster 2024-09-14T00:34:33.422483+0000 mgr.a (mgr.14355) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:34 smithi171 bash[25040]: audit 2024-09-14T00:34:32.951406+0000 mgr.a (mgr.14355) 5781 : audit [DBG] from='client.133839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:34 smithi171 bash[25040]: cluster 2024-09-14T00:34:33.422483+0000 mgr.a (mgr.14355) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:34 smithi007 bash[22722]: audit 2024-09-14T00:34:32.951406+0000 mgr.a (mgr.14355) 5781 : audit [DBG] from='client.133839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:34 smithi007 bash[22722]: cluster 2024-09-14T00:34:33.422483+0000 mgr.a (mgr.14355) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:36 smithi131 bash[24745]: cluster 2024-09-14T00:34:35.424681+0000 mgr.a (mgr.14355) 5783 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:36 smithi171 bash[25040]: cluster 2024-09-14T00:34:35.424681+0000 mgr.a (mgr.14355) 5783 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:36 smithi007 bash[22722]: cluster 2024-09-14T00:34:35.424681+0000 mgr.a (mgr.14355) 5783 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:38.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:38.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:38.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:38 smithi131 bash[24745]: cluster 2024-09-14T00:34:37.425453+0000 mgr.a (mgr.14355) 5784 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:38 smithi171 bash[25040]: cluster 2024-09-14T00:34:37.425453+0000 mgr.a (mgr.14355) 5784 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:38 smithi007 bash[22722]: cluster 2024-09-14T00:34:37.425453+0000 mgr.a (mgr.14355) 5784 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:39.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:39 smithi131 bash[24745]: audit 2024-09-14T00:34:38.685543+0000 mgr.a (mgr.14355) 5785 : audit [DBG] from='client.133917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:39 smithi171 bash[25040]: audit 2024-09-14T00:34:38.685543+0000 mgr.a (mgr.14355) 5785 : audit [DBG] from='client.133917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:39 smithi007 bash[22722]: audit 2024-09-14T00:34:38.685543+0000 mgr.a (mgr.14355) 5785 : audit [DBG] from='client.133917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:40 smithi131 bash[24745]: cluster 2024-09-14T00:34:39.426443+0000 mgr.a (mgr.14355) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:40 smithi171 bash[25040]: cluster 2024-09-14T00:34:39.426443+0000 mgr.a (mgr.14355) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:40 smithi007 bash[22722]: cluster 2024-09-14T00:34:39.426443+0000 mgr.a (mgr.14355) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:42 smithi131 bash[24745]: cluster 2024-09-14T00:34:41.428726+0000 mgr.a (mgr.14355) 5787 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:42 smithi171 bash[25040]: cluster 2024-09-14T00:34:41.428726+0000 mgr.a (mgr.14355) 5787 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:42 smithi007 bash[22722]: cluster 2024-09-14T00:34:41.428726+0000 mgr.a (mgr.14355) 5787 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:44.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:44.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:44.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:44 smithi131 bash[24745]: cluster 2024-09-14T00:34:43.429486+0000 mgr.a (mgr.14355) 5788 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:44 smithi171 bash[25040]: cluster 2024-09-14T00:34:43.429486+0000 mgr.a (mgr.14355) 5788 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:44.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:44.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:44.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:44.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:44.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:44 smithi007 bash[22722]: cluster 2024-09-14T00:34:43.429486+0000 mgr.a (mgr.14355) 5788 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:45 smithi171 bash[25040]: audit 2024-09-14T00:34:44.439754+0000 mgr.a (mgr.14355) 5789 : audit [DBG] from='client.133992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:45 smithi007 bash[22722]: audit 2024-09-14T00:34:44.439754+0000 mgr.a (mgr.14355) 5789 : audit [DBG] from='client.133992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:45 smithi131 bash[24745]: audit 2024-09-14T00:34:44.439754+0000 mgr.a (mgr.14355) 5789 : audit [DBG] from='client.133992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:46 smithi171 bash[25040]: cluster 2024-09-14T00:34:45.431887+0000 mgr.a (mgr.14355) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:46 smithi007 bash[22722]: cluster 2024-09-14T00:34:45.431887+0000 mgr.a (mgr.14355) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:46 smithi131 bash[24745]: cluster 2024-09-14T00:34:45.431887+0000 mgr.a (mgr.14355) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:34:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:48 smithi007 bash[22722]: cluster 2024-09-14T00:34:47.432676+0000 mgr.a (mgr.14355) 5791 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:48 smithi131 bash[24745]: cluster 2024-09-14T00:34:47.432676+0000 mgr.a (mgr.14355) 5791 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:48 smithi171 bash[25040]: cluster 2024-09-14T00:34:47.432676+0000 mgr.a (mgr.14355) 5791 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:50.671 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:50.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:50.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:50 smithi007 bash[22722]: cluster 2024-09-14T00:34:49.433452+0000 mgr.a (mgr.14355) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:50 smithi131 bash[24745]: cluster 2024-09-14T00:34:49.433452+0000 mgr.a (mgr.14355) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:50 smithi171 bash[25040]: cluster 2024-09-14T00:34:49.433452+0000 mgr.a (mgr.14355) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:51 smithi007 bash[22722]: audit 2024-09-14T00:34:50.223832+0000 mgr.a (mgr.14355) 5793 : audit [DBG] from='client.134070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:51 smithi131 bash[24745]: audit 2024-09-14T00:34:50.223832+0000 mgr.a (mgr.14355) 5793 : audit [DBG] from='client.134070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:51 smithi171 bash[25040]: audit 2024-09-14T00:34:50.223832+0000 mgr.a (mgr.14355) 5793 : audit [DBG] from='client.134070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:52 smithi007 bash[22722]: cluster 2024-09-14T00:34:51.436409+0000 mgr.a (mgr.14355) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:52 smithi131 bash[24745]: cluster 2024-09-14T00:34:51.436409+0000 mgr.a (mgr.14355) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:52 smithi171 bash[25040]: cluster 2024-09-14T00:34:51.436409+0000 mgr.a (mgr.14355) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:54 smithi007 bash[22722]: cluster 2024-09-14T00:34:53.437230+0000 mgr.a (mgr.14355) 5795 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:34:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:54 smithi131 bash[24745]: cluster 2024-09-14T00:34:53.437230+0000 mgr.a (mgr.14355) 5795 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:34:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:54 smithi171 bash[25040]: cluster 2024-09-14T00:34:53.437230+0000 mgr.a (mgr.14355) 5795 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:34:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:34:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:34:55.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:34:56.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:34:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:34:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:34:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:34:56.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:34:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:56 smithi007 bash[22722]: cluster 2024-09-14T00:34:55.439172+0000 mgr.a (mgr.14355) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:56 smithi131 bash[24745]: cluster 2024-09-14T00:34:55.439172+0000 mgr.a (mgr.14355) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:56 smithi171 bash[25040]: cluster 2024-09-14T00:34:55.439172+0000 mgr.a (mgr.14355) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:57 smithi007 bash[22722]: audit 2024-09-14T00:34:56.009157+0000 mgr.a (mgr.14355) 5797 : audit [DBG] from='client.134145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:57 smithi131 bash[24745]: audit 2024-09-14T00:34:56.009157+0000 mgr.a (mgr.14355) 5797 : audit [DBG] from='client.134145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:57 smithi171 bash[25040]: audit 2024-09-14T00:34:56.009157+0000 mgr.a (mgr.14355) 5797 : audit [DBG] from='client.134145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:34:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:34:58 smithi007 bash[22722]: cluster 2024-09-14T00:34:57.440144+0000 mgr.a (mgr.14355) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:34:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:34:58 smithi131 bash[24745]: cluster 2024-09-14T00:34:57.440144+0000 mgr.a (mgr.14355) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:34:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:34:58 smithi171 bash[25040]: cluster 2024-09-14T00:34:57.440144+0000 mgr.a (mgr.14355) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:00 smithi007 bash[22722]: cluster 2024-09-14T00:34:59.440979+0000 mgr.a (mgr.14355) 5799 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:00 smithi131 bash[24745]: cluster 2024-09-14T00:34:59.440979+0000 mgr.a (mgr.14355) 5799 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:00 smithi171 bash[25040]: cluster 2024-09-14T00:34:59.440979+0000 mgr.a (mgr.14355) 5799 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:01.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:01.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:01.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:02.225 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:02.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:02 smithi007 bash[22722]: cluster 2024-09-14T00:35:01.443283+0000 mgr.a (mgr.14355) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:02 smithi007 bash[22722]: audit 2024-09-14T00:35:01.785732+0000 mgr.a (mgr.14355) 5801 : audit [DBG] from='client.134223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:02 smithi131 bash[24745]: cluster 2024-09-14T00:35:01.443283+0000 mgr.a (mgr.14355) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:02 smithi131 bash[24745]: audit 2024-09-14T00:35:01.785732+0000 mgr.a (mgr.14355) 5801 : audit [DBG] from='client.134223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:02 smithi171 bash[25040]: cluster 2024-09-14T00:35:01.443283+0000 mgr.a (mgr.14355) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:02 smithi171 bash[25040]: audit 2024-09-14T00:35:01.785732+0000 mgr.a (mgr.14355) 5801 : audit [DBG] from='client.134223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:04 smithi007 bash[22722]: cluster 2024-09-14T00:35:03.444183+0000 mgr.a (mgr.14355) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:04 smithi131 bash[24745]: cluster 2024-09-14T00:35:03.444183+0000 mgr.a (mgr.14355) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:04 smithi171 bash[25040]: cluster 2024-09-14T00:35:03.444183+0000 mgr.a (mgr.14355) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: cluster 2024-09-14T00:35:05.446367+0000 mgr.a (mgr.14355) 5803 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: audit 2024-09-14T00:35:05.666037+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:35:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: audit 2024-09-14T00:35:06.495499+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:35:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: audit 2024-09-14T00:35:06.497376+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:35:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: audit 2024-09-14T00:35:06.508084+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:35:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:06 smithi007 bash[22722]: audit 2024-09-14T00:35:06.513024+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: cluster 2024-09-14T00:35:05.446367+0000 mgr.a (mgr.14355) 5803 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: audit 2024-09-14T00:35:05.666037+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: audit 2024-09-14T00:35:06.495499+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: audit 2024-09-14T00:35:06.497376+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: audit 2024-09-14T00:35:06.508084+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:35:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:06 smithi131 bash[24745]: audit 2024-09-14T00:35:06.513024+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: cluster 2024-09-14T00:35:05.446367+0000 mgr.a (mgr.14355) 5803 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: audit 2024-09-14T00:35:05.666037+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: audit 2024-09-14T00:35:06.495499+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: audit 2024-09-14T00:35:06.497376+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: audit 2024-09-14T00:35:06.508084+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:35:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:06 smithi171 bash[25040]: audit 2024-09-14T00:35:06.513024+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:07.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:07.615 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:35:07 smithi007 bash[22972]: debug 2024-09-14T00:35:07.237+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:35:07.616 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:35:07 smithi007 bash[22972]: debug 2024-09-14T00:35:07.241+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:35:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:07 smithi007 bash[22722]: audit 2024-09-14T00:35:06.515291+0000 mgr.a (mgr.14355) 5804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:07.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:07.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:07.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:07 smithi131 bash[24745]: audit 2024-09-14T00:35:06.515291+0000 mgr.a (mgr.14355) 5804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:07 smithi171 bash[25040]: audit 2024-09-14T00:35:06.515291+0000 mgr.a (mgr.14355) 5804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:35:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:08 smithi007 bash[22722]: audit 2024-09-14T00:35:07.242018+0000 mgr.a (mgr.14355) 5805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:35:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:08 smithi007 bash[22722]: cephadm 2024-09-14T00:35:07.243666+0000 mgr.a (mgr.14355) 5806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:35:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:08 smithi007 bash[22722]: cluster 2024-09-14T00:35:07.447262+0000 mgr.a (mgr.14355) 5807 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:08 smithi007 bash[22722]: audit 2024-09-14T00:35:07.546556+0000 mgr.a (mgr.14355) 5808 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:08 smithi131 bash[24745]: audit 2024-09-14T00:35:07.242018+0000 mgr.a (mgr.14355) 5805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:35:09.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:08 smithi131 bash[24745]: cephadm 2024-09-14T00:35:07.243666+0000 mgr.a (mgr.14355) 5806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:35:09.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:08 smithi131 bash[24745]: cluster 2024-09-14T00:35:07.447262+0000 mgr.a (mgr.14355) 5807 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:09.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:08 smithi131 bash[24745]: audit 2024-09-14T00:35:07.546556+0000 mgr.a (mgr.14355) 5808 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:08 smithi171 bash[25040]: audit 2024-09-14T00:35:07.242018+0000 mgr.a (mgr.14355) 5805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:35:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:08 smithi171 bash[25040]: cephadm 2024-09-14T00:35:07.243666+0000 mgr.a (mgr.14355) 5806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:35:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:08 smithi171 bash[25040]: cluster 2024-09-14T00:35:07.447262+0000 mgr.a (mgr.14355) 5807 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:08 smithi171 bash[25040]: audit 2024-09-14T00:35:07.546556+0000 mgr.a (mgr.14355) 5808 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:10 smithi007 bash[22722]: cluster 2024-09-14T00:35:09.448183+0000 mgr.a (mgr.14355) 5809 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:10 smithi131 bash[24745]: cluster 2024-09-14T00:35:09.448183+0000 mgr.a (mgr.14355) 5809 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:10 smithi171 bash[25040]: cluster 2024-09-14T00:35:09.448183+0000 mgr.a (mgr.14355) 5809 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:12 smithi007 bash[22722]: cluster 2024-09-14T00:35:11.450454+0000 mgr.a (mgr.14355) 5810 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:12 smithi131 bash[24745]: cluster 2024-09-14T00:35:11.450454+0000 mgr.a (mgr.14355) 5810 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:12 smithi171 bash[25040]: cluster 2024-09-14T00:35:11.450454+0000 mgr.a (mgr.14355) 5810 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:13.722 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:13.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:13.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:13.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:13.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:14 smithi007 bash[22722]: audit 2024-09-14T00:35:13.300552+0000 mgr.a (mgr.14355) 5811 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:14 smithi007 bash[22722]: cluster 2024-09-14T00:35:13.450977+0000 mgr.a (mgr.14355) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:14 smithi131 bash[24745]: audit 2024-09-14T00:35:13.300552+0000 mgr.a (mgr.14355) 5811 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:14 smithi131 bash[24745]: cluster 2024-09-14T00:35:13.450977+0000 mgr.a (mgr.14355) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:14 smithi171 bash[25040]: audit 2024-09-14T00:35:13.300552+0000 mgr.a (mgr.14355) 5811 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:14 smithi171 bash[25040]: cluster 2024-09-14T00:35:13.450977+0000 mgr.a (mgr.14355) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:16 smithi007 bash[22722]: cluster 2024-09-14T00:35:15.453223+0000 mgr.a (mgr.14355) 5813 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:16 smithi131 bash[24745]: cluster 2024-09-14T00:35:15.453223+0000 mgr.a (mgr.14355) 5813 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:16 smithi171 bash[25040]: cluster 2024-09-14T00:35:15.453223+0000 mgr.a (mgr.14355) 5813 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:18.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:18.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:18.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:18 smithi007 bash[22722]: cluster 2024-09-14T00:35:17.453986+0000 mgr.a (mgr.14355) 5814 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:18 smithi131 bash[24745]: cluster 2024-09-14T00:35:17.453986+0000 mgr.a (mgr.14355) 5814 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:18 smithi171 bash[25040]: cluster 2024-09-14T00:35:17.453986+0000 mgr.a (mgr.14355) 5814 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:19.502 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:20 smithi007 bash[22722]: audit 2024-09-14T00:35:19.057369+0000 mgr.a (mgr.14355) 5815 : audit [DBG] from='client.134562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:20 smithi007 bash[22722]: cluster 2024-09-14T00:35:19.454593+0000 mgr.a (mgr.14355) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:20 smithi131 bash[24745]: audit 2024-09-14T00:35:19.057369+0000 mgr.a (mgr.14355) 5815 : audit [DBG] from='client.134562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:20 smithi131 bash[24745]: cluster 2024-09-14T00:35:19.454593+0000 mgr.a (mgr.14355) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:20 smithi171 bash[25040]: audit 2024-09-14T00:35:19.057369+0000 mgr.a (mgr.14355) 5815 : audit [DBG] from='client.134562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:20 smithi171 bash[25040]: cluster 2024-09-14T00:35:19.454593+0000 mgr.a (mgr.14355) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:22 smithi007 bash[22722]: cluster 2024-09-14T00:35:21.456954+0000 mgr.a (mgr.14355) 5817 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:22 smithi131 bash[24745]: cluster 2024-09-14T00:35:21.456954+0000 mgr.a (mgr.14355) 5817 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:22 smithi171 bash[25040]: cluster 2024-09-14T00:35:21.456954+0000 mgr.a (mgr.14355) 5817 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:35:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:24.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:24.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:24 smithi007 bash[22722]: cluster 2024-09-14T00:35:23.457892+0000 mgr.a (mgr.14355) 5818 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:25.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:24 smithi131 bash[24745]: cluster 2024-09-14T00:35:23.457892+0000 mgr.a (mgr.14355) 5818 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:24 smithi171 bash[25040]: cluster 2024-09-14T00:35:23.457892+0000 mgr.a (mgr.14355) 5818 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:25.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:25.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:25 smithi007 bash[22722]: audit 2024-09-14T00:35:24.841757+0000 mgr.a (mgr.14355) 5819 : audit [DBG] from='client.134637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:25 smithi131 bash[24745]: audit 2024-09-14T00:35:24.841757+0000 mgr.a (mgr.14355) 5819 : audit [DBG] from='client.134637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:25 smithi171 bash[25040]: audit 2024-09-14T00:35:24.841757+0000 mgr.a (mgr.14355) 5819 : audit [DBG] from='client.134637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:26.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:26 smithi007 bash[22722]: cluster 2024-09-14T00:35:25.460207+0000 mgr.a (mgr.14355) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:26 smithi131 bash[24745]: cluster 2024-09-14T00:35:25.460207+0000 mgr.a (mgr.14355) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:26 smithi171 bash[25040]: cluster 2024-09-14T00:35:25.460207+0000 mgr.a (mgr.14355) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:28 smithi007 bash[22722]: cluster 2024-09-14T00:35:27.460974+0000 mgr.a (mgr.14355) 5821 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:28 smithi131 bash[24745]: cluster 2024-09-14T00:35:27.460974+0000 mgr.a (mgr.14355) 5821 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:28 smithi171 bash[25040]: cluster 2024-09-14T00:35:27.460974+0000 mgr.a (mgr.14355) 5821 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:30 smithi007 bash[22722]: cluster 2024-09-14T00:35:29.461734+0000 mgr.a (mgr.14355) 5822 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:30 smithi131 bash[24745]: cluster 2024-09-14T00:35:29.461734+0000 mgr.a (mgr.14355) 5822 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:31.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:31.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:31.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:31.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:31.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:30 smithi171 bash[25040]: cluster 2024-09-14T00:35:29.461734+0000 mgr.a (mgr.14355) 5822 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:31 smithi007 bash[22722]: audit 2024-09-14T00:35:30.611844+0000 mgr.a (mgr.14355) 5823 : audit [DBG] from='client.134715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:31 smithi131 bash[24745]: audit 2024-09-14T00:35:30.611844+0000 mgr.a (mgr.14355) 5823 : audit [DBG] from='client.134715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:31 smithi171 bash[25040]: audit 2024-09-14T00:35:30.611844+0000 mgr.a (mgr.14355) 5823 : audit [DBG] from='client.134715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:32 smithi007 bash[22722]: cluster 2024-09-14T00:35:31.464615+0000 mgr.a (mgr.14355) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:32 smithi131 bash[24745]: cluster 2024-09-14T00:35:31.464615+0000 mgr.a (mgr.14355) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:32 smithi171 bash[25040]: cluster 2024-09-14T00:35:31.464615+0000 mgr.a (mgr.14355) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:34 smithi007 bash[22722]: cluster 2024-09-14T00:35:33.465411+0000 mgr.a (mgr.14355) 5825 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:34 smithi131 bash[24745]: cluster 2024-09-14T00:35:33.465411+0000 mgr.a (mgr.14355) 5825 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:34 smithi171 bash[25040]: cluster 2024-09-14T00:35:33.465411+0000 mgr.a (mgr.14355) 5825 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:36.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:36.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:36.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:36.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:36.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:36.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:36 smithi007 bash[22722]: cluster 2024-09-14T00:35:35.467359+0000 mgr.a (mgr.14355) 5826 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:36 smithi131 bash[24745]: cluster 2024-09-14T00:35:35.467359+0000 mgr.a (mgr.14355) 5826 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:36 smithi171 bash[25040]: cluster 2024-09-14T00:35:35.467359+0000 mgr.a (mgr.14355) 5826 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:37 smithi007 bash[22722]: audit 2024-09-14T00:35:36.375516+0000 mgr.a (mgr.14355) 5827 : audit [DBG] from='client.134790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:37 smithi131 bash[24745]: audit 2024-09-14T00:35:36.375516+0000 mgr.a (mgr.14355) 5827 : audit [DBG] from='client.134790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:37 smithi171 bash[25040]: audit 2024-09-14T00:35:36.375516+0000 mgr.a (mgr.14355) 5827 : audit [DBG] from='client.134790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:38 smithi007 bash[22722]: cluster 2024-09-14T00:35:37.468294+0000 mgr.a (mgr.14355) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:38 smithi131 bash[24745]: cluster 2024-09-14T00:35:37.468294+0000 mgr.a (mgr.14355) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:38 smithi171 bash[25040]: cluster 2024-09-14T00:35:37.468294+0000 mgr.a (mgr.14355) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:35:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:40 smithi131 bash[24745]: cluster 2024-09-14T00:35:39.469071+0000 mgr.a (mgr.14355) 5829 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:40 smithi171 bash[25040]: cluster 2024-09-14T00:35:39.469071+0000 mgr.a (mgr.14355) 5829 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:40 smithi007 bash[22722]: cluster 2024-09-14T00:35:39.469071+0000 mgr.a (mgr.14355) 5829 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:35:41.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:41.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:41.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:42.559 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:42.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:42.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:42 smithi131 bash[24745]: cluster 2024-09-14T00:35:41.471334+0000 mgr.a (mgr.14355) 5830 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:42 smithi171 bash[25040]: cluster 2024-09-14T00:35:41.471334+0000 mgr.a (mgr.14355) 5830 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:42 smithi007 bash[22722]: cluster 2024-09-14T00:35:41.471334+0000 mgr.a (mgr.14355) 5830 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:43 smithi131 bash[24745]: audit 2024-09-14T00:35:42.143957+0000 mgr.a (mgr.14355) 5831 : audit [DBG] from='client.134868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:43 smithi171 bash[25040]: audit 2024-09-14T00:35:42.143957+0000 mgr.a (mgr.14355) 5831 : audit [DBG] from='client.134868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:43 smithi007 bash[22722]: audit 2024-09-14T00:35:42.143957+0000 mgr.a (mgr.14355) 5831 : audit [DBG] from='client.134868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:44 smithi131 bash[24745]: cluster 2024-09-14T00:35:43.472233+0000 mgr.a (mgr.14355) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:44 smithi171 bash[25040]: cluster 2024-09-14T00:35:43.472233+0000 mgr.a (mgr.14355) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:44 smithi007 bash[22722]: cluster 2024-09-14T00:35:43.472233+0000 mgr.a (mgr.14355) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:46 smithi131 bash[24745]: cluster 2024-09-14T00:35:45.474414+0000 mgr.a (mgr.14355) 5833 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:46 smithi171 bash[25040]: cluster 2024-09-14T00:35:45.474414+0000 mgr.a (mgr.14355) 5833 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:46 smithi007 bash[22722]: cluster 2024-09-14T00:35:45.474414+0000 mgr.a (mgr.14355) 5833 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:47.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:47.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:47.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:48.312 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:48.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:48.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:48.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:48.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:48 smithi131 bash[24745]: cluster 2024-09-14T00:35:47.475163+0000 mgr.a (mgr.14355) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:48 smithi171 bash[25040]: cluster 2024-09-14T00:35:47.475163+0000 mgr.a (mgr.14355) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:48 smithi007 bash[22722]: cluster 2024-09-14T00:35:47.475163+0000 mgr.a (mgr.14355) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:49 smithi131 bash[24745]: audit 2024-09-14T00:35:47.887489+0000 mgr.a (mgr.14355) 5835 : audit [DBG] from='client.134946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:49 smithi171 bash[25040]: audit 2024-09-14T00:35:47.887489+0000 mgr.a (mgr.14355) 5835 : audit [DBG] from='client.134946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:49 smithi007 bash[22722]: audit 2024-09-14T00:35:47.887489+0000 mgr.a (mgr.14355) 5835 : audit [DBG] from='client.134946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:50 smithi131 bash[24745]: cluster 2024-09-14T00:35:49.476049+0000 mgr.a (mgr.14355) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:50 smithi171 bash[25040]: cluster 2024-09-14T00:35:49.476049+0000 mgr.a (mgr.14355) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:50 smithi007 bash[22722]: cluster 2024-09-14T00:35:49.476049+0000 mgr.a (mgr.14355) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:52 smithi131 bash[24745]: cluster 2024-09-14T00:35:51.478317+0000 mgr.a (mgr.14355) 5837 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:52 smithi171 bash[25040]: cluster 2024-09-14T00:35:51.478317+0000 mgr.a (mgr.14355) 5837 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:52 smithi007 bash[22722]: cluster 2024-09-14T00:35:51.478317+0000 mgr.a (mgr.14355) 5837 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:53.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:53.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:54.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:54.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:35:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:54 smithi131 bash[24745]: cluster 2024-09-14T00:35:53.479044+0000 mgr.a (mgr.14355) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:54 smithi131 bash[24745]: audit 2024-09-14T00:35:53.651241+0000 mgr.a (mgr.14355) 5839 : audit [DBG] from='client.135024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:54 smithi171 bash[25040]: cluster 2024-09-14T00:35:53.479044+0000 mgr.a (mgr.14355) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:54 smithi171 bash[25040]: audit 2024-09-14T00:35:53.651241+0000 mgr.a (mgr.14355) 5839 : audit [DBG] from='client.135024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:54 smithi007 bash[22722]: cluster 2024-09-14T00:35:53.479044+0000 mgr.a (mgr.14355) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:54 smithi007 bash[22722]: audit 2024-09-14T00:35:53.651241+0000 mgr.a (mgr.14355) 5839 : audit [DBG] from='client.135024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:35:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:56 smithi131 bash[24745]: cluster 2024-09-14T00:35:55.481275+0000 mgr.a (mgr.14355) 5840 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:56 smithi171 bash[25040]: cluster 2024-09-14T00:35:55.481275+0000 mgr.a (mgr.14355) 5840 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:56 smithi007 bash[22722]: cluster 2024-09-14T00:35:55.481275+0000 mgr.a (mgr.14355) 5840 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:35:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:35:58 smithi131 bash[24745]: cluster 2024-09-14T00:35:57.482030+0000 mgr.a (mgr.14355) 5841 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:35:58 smithi171 bash[25040]: cluster 2024-09-14T00:35:57.482030+0000 mgr.a (mgr.14355) 5841 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:59.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:35:59.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:35:59.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:35:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:35:58 smithi007 bash[22722]: cluster 2024-09-14T00:35:57.482030+0000 mgr.a (mgr.14355) 5841 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:35:59.829 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:35:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:35:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:35:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:35:59.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:00 smithi131 bash[24745]: audit 2024-09-14T00:35:59.422778+0000 mgr.a (mgr.14355) 5842 : audit [DBG] from='client.135102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:00 smithi131 bash[24745]: cluster 2024-09-14T00:35:59.482721+0000 mgr.a (mgr.14355) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:00 smithi171 bash[25040]: audit 2024-09-14T00:35:59.422778+0000 mgr.a (mgr.14355) 5842 : audit [DBG] from='client.135102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:00 smithi171 bash[25040]: cluster 2024-09-14T00:35:59.482721+0000 mgr.a (mgr.14355) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:00 smithi007 bash[22722]: audit 2024-09-14T00:35:59.422778+0000 mgr.a (mgr.14355) 5842 : audit [DBG] from='client.135102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:00 smithi007 bash[22722]: cluster 2024-09-14T00:35:59.482721+0000 mgr.a (mgr.14355) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:02 smithi131 bash[24745]: cluster 2024-09-14T00:36:01.485066+0000 mgr.a (mgr.14355) 5844 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:02 smithi171 bash[25040]: cluster 2024-09-14T00:36:01.485066+0000 mgr.a (mgr.14355) 5844 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:02 smithi007 bash[22722]: cluster 2024-09-14T00:36:01.485066+0000 mgr.a (mgr.14355) 5844 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:04 smithi131 bash[24745]: cluster 2024-09-14T00:36:03.485850+0000 mgr.a (mgr.14355) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:04 smithi171 bash[25040]: cluster 2024-09-14T00:36:03.485850+0000 mgr.a (mgr.14355) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:04 smithi007 bash[22722]: cluster 2024-09-14T00:36:03.485850+0000 mgr.a (mgr.14355) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:05.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:05.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:05.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:05.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:05.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:06 smithi131 bash[24745]: audit 2024-09-14T00:36:05.165009+0000 mgr.a (mgr.14355) 5846 : audit [DBG] from='client.135180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:06 smithi131 bash[24745]: cluster 2024-09-14T00:36:05.487526+0000 mgr.a (mgr.14355) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:06 smithi171 bash[25040]: audit 2024-09-14T00:36:05.165009+0000 mgr.a (mgr.14355) 5846 : audit [DBG] from='client.135180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:06 smithi171 bash[25040]: cluster 2024-09-14T00:36:05.487526+0000 mgr.a (mgr.14355) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:06 smithi007 bash[22722]: audit 2024-09-14T00:36:05.165009+0000 mgr.a (mgr.14355) 5846 : audit [DBG] from='client.135180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:06 smithi007 bash[22722]: cluster 2024-09-14T00:36:05.487526+0000 mgr.a (mgr.14355) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:07 smithi171 bash[25040]: audit 2024-09-14T00:36:07.296284+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:36:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:07 smithi007 bash[22722]: audit 2024-09-14T00:36:07.296284+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:36:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:07 smithi131 bash[24745]: audit 2024-09-14T00:36:07.296284+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:36:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:08 smithi171 bash[25040]: cluster 2024-09-14T00:36:07.488379+0000 mgr.a (mgr.14355) 5848 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:08 smithi171 bash[25040]: audit 2024-09-14T00:36:08.127726+0000 mon.a (mon.0) 1476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:36:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:08 smithi171 bash[25040]: audit 2024-09-14T00:36:08.129440+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:36:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:08 smithi171 bash[25040]: audit 2024-09-14T00:36:08.140315+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:36:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:08 smithi171 bash[25040]: audit 2024-09-14T00:36:08.145116+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:09.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22972]: debug 2024-09-14T00:36:08.876+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:36:09.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22972]: debug 2024-09-14T00:36:08.880+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:36:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22722]: cluster 2024-09-14T00:36:07.488379+0000 mgr.a (mgr.14355) 5848 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22722]: audit 2024-09-14T00:36:08.127726+0000 mon.a (mon.0) 1476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:36:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22722]: audit 2024-09-14T00:36:08.129440+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:36:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22722]: audit 2024-09-14T00:36:08.140315+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:36:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:08 smithi007 bash[22722]: audit 2024-09-14T00:36:08.145116+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:08 smithi131 bash[24745]: cluster 2024-09-14T00:36:07.488379+0000 mgr.a (mgr.14355) 5848 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:08 smithi131 bash[24745]: audit 2024-09-14T00:36:08.127726+0000 mon.a (mon.0) 1476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:36:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:08 smithi131 bash[24745]: audit 2024-09-14T00:36:08.129440+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:36:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:08 smithi131 bash[24745]: audit 2024-09-14T00:36:08.140315+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:36:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:08 smithi131 bash[24745]: audit 2024-09-14T00:36:08.145116+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:09 smithi007 bash[22722]: audit 2024-09-14T00:36:08.147527+0000 mgr.a (mgr.14355) 5849 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:09 smithi007 bash[22722]: audit 2024-09-14T00:36:08.882188+0000 mgr.a (mgr.14355) 5850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:36:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:09 smithi007 bash[22722]: cephadm 2024-09-14T00:36:08.883857+0000 mgr.a (mgr.14355) 5851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:36:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:09 smithi131 bash[24745]: audit 2024-09-14T00:36:08.147527+0000 mgr.a (mgr.14355) 5849 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:09 smithi131 bash[24745]: audit 2024-09-14T00:36:08.882188+0000 mgr.a (mgr.14355) 5850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:36:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:09 smithi131 bash[24745]: cephadm 2024-09-14T00:36:08.883857+0000 mgr.a (mgr.14355) 5851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:36:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:09 smithi171 bash[25040]: audit 2024-09-14T00:36:08.147527+0000 mgr.a (mgr.14355) 5849 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:36:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:09 smithi171 bash[25040]: audit 2024-09-14T00:36:08.882188+0000 mgr.a (mgr.14355) 5850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:36:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:09 smithi171 bash[25040]: cephadm 2024-09-14T00:36:08.883857+0000 mgr.a (mgr.14355) 5851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:36:10.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:10.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:10 smithi007 bash[22722]: cluster 2024-09-14T00:36:09.489289+0000 mgr.a (mgr.14355) 5852 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:10 smithi131 bash[24745]: cluster 2024-09-14T00:36:09.489289+0000 mgr.a (mgr.14355) 5852 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:10 smithi171 bash[25040]: cluster 2024-09-14T00:36:09.489289+0000 mgr.a (mgr.14355) 5852 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:11.356 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:11.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:12 smithi007 bash[22722]: audit 2024-09-14T00:36:10.935624+0000 mgr.a (mgr.14355) 5853 : audit [DBG] from='client.135363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:12 smithi007 bash[22722]: cluster 2024-09-14T00:36:11.492075+0000 mgr.a (mgr.14355) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:12 smithi131 bash[24745]: audit 2024-09-14T00:36:10.935624+0000 mgr.a (mgr.14355) 5853 : audit [DBG] from='client.135363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:12 smithi131 bash[24745]: cluster 2024-09-14T00:36:11.492075+0000 mgr.a (mgr.14355) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:12 smithi171 bash[25040]: audit 2024-09-14T00:36:10.935624+0000 mgr.a (mgr.14355) 5853 : audit [DBG] from='client.135363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:12 smithi171 bash[25040]: cluster 2024-09-14T00:36:11.492075+0000 mgr.a (mgr.14355) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:14 smithi007 bash[22722]: cluster 2024-09-14T00:36:13.492872+0000 mgr.a (mgr.14355) 5855 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:36:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:14 smithi131 bash[24745]: cluster 2024-09-14T00:36:13.492872+0000 mgr.a (mgr.14355) 5855 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:36:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:14 smithi171 bash[25040]: cluster 2024-09-14T00:36:13.492872+0000 mgr.a (mgr.14355) 5855 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:36:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:17.134 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:17.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:17.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:17.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:17.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:16 smithi007 bash[22722]: cluster 2024-09-14T00:36:15.494831+0000 mgr.a (mgr.14355) 5856 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:16 smithi131 bash[24745]: cluster 2024-09-14T00:36:15.494831+0000 mgr.a (mgr.14355) 5856 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:16 smithi171 bash[25040]: cluster 2024-09-14T00:36:15.494831+0000 mgr.a (mgr.14355) 5856 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:17 smithi007 bash[22722]: audit 2024-09-14T00:36:16.693637+0000 mgr.a (mgr.14355) 5857 : audit [DBG] from='client.135435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:17 smithi131 bash[24745]: audit 2024-09-14T00:36:16.693637+0000 mgr.a (mgr.14355) 5857 : audit [DBG] from='client.135435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:17 smithi171 bash[25040]: audit 2024-09-14T00:36:16.693637+0000 mgr.a (mgr.14355) 5857 : audit [DBG] from='client.135435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:18 smithi007 bash[22722]: cluster 2024-09-14T00:36:17.495848+0000 mgr.a (mgr.14355) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:18 smithi131 bash[24745]: cluster 2024-09-14T00:36:17.495848+0000 mgr.a (mgr.14355) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:18 smithi171 bash[25040]: cluster 2024-09-14T00:36:17.495848+0000 mgr.a (mgr.14355) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:20 smithi007 bash[22722]: cluster 2024-09-14T00:36:19.496791+0000 mgr.a (mgr.14355) 5859 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:20 smithi131 bash[24745]: cluster 2024-09-14T00:36:19.496791+0000 mgr.a (mgr.14355) 5859 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:20 smithi171 bash[25040]: cluster 2024-09-14T00:36:19.496791+0000 mgr.a (mgr.14355) 5859 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:22.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:22.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:22.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:22.914 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:22.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:22.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:22.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:22.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:22 smithi007 bash[22722]: cluster 2024-09-14T00:36:21.499169+0000 mgr.a (mgr.14355) 5860 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:22 smithi131 bash[24745]: cluster 2024-09-14T00:36:21.499169+0000 mgr.a (mgr.14355) 5860 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:22 smithi171 bash[25040]: cluster 2024-09-14T00:36:21.499169+0000 mgr.a (mgr.14355) 5860 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:36:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:23 smithi007 bash[22722]: audit 2024-09-14T00:36:22.466152+0000 mgr.a (mgr.14355) 5861 : audit [DBG] from='client.135513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:23 smithi131 bash[24745]: audit 2024-09-14T00:36:22.466152+0000 mgr.a (mgr.14355) 5861 : audit [DBG] from='client.135513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:23 smithi171 bash[25040]: audit 2024-09-14T00:36:22.466152+0000 mgr.a (mgr.14355) 5861 : audit [DBG] from='client.135513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:24 smithi007 bash[22722]: cluster 2024-09-14T00:36:23.500105+0000 mgr.a (mgr.14355) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:24 smithi131 bash[24745]: cluster 2024-09-14T00:36:23.500105+0000 mgr.a (mgr.14355) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:24 smithi171 bash[25040]: cluster 2024-09-14T00:36:23.500105+0000 mgr.a (mgr.14355) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:26 smithi007 bash[22722]: cluster 2024-09-14T00:36:25.502250+0000 mgr.a (mgr.14355) 5863 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:26 smithi131 bash[24745]: cluster 2024-09-14T00:36:25.502250+0000 mgr.a (mgr.14355) 5863 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:26 smithi171 bash[25040]: cluster 2024-09-14T00:36:25.502250+0000 mgr.a (mgr.14355) 5863 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:27.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:27.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:27.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:28.696 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:28.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:28.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:28.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:28.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:28 smithi007 bash[22722]: cluster 2024-09-14T00:36:27.503026+0000 mgr.a (mgr.14355) 5864 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:28 smithi131 bash[24745]: cluster 2024-09-14T00:36:27.503026+0000 mgr.a (mgr.14355) 5864 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:28 smithi171 bash[25040]: cluster 2024-09-14T00:36:27.503026+0000 mgr.a (mgr.14355) 5864 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:29 smithi007 bash[22722]: audit 2024-09-14T00:36:28.254993+0000 mgr.a (mgr.14355) 5865 : audit [DBG] from='client.135591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:29 smithi131 bash[24745]: audit 2024-09-14T00:36:28.254993+0000 mgr.a (mgr.14355) 5865 : audit [DBG] from='client.135591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:29 smithi171 bash[25040]: audit 2024-09-14T00:36:28.254993+0000 mgr.a (mgr.14355) 5865 : audit [DBG] from='client.135591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:30 smithi007 bash[22722]: cluster 2024-09-14T00:36:29.503904+0000 mgr.a (mgr.14355) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:30 smithi131 bash[24745]: cluster 2024-09-14T00:36:29.503904+0000 mgr.a (mgr.14355) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:30 smithi171 bash[25040]: cluster 2024-09-14T00:36:29.503904+0000 mgr.a (mgr.14355) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:32 smithi007 bash[22722]: cluster 2024-09-14T00:36:31.506134+0000 mgr.a (mgr.14355) 5867 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:32 smithi131 bash[24745]: cluster 2024-09-14T00:36:31.506134+0000 mgr.a (mgr.14355) 5867 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:32 smithi171 bash[25040]: cluster 2024-09-14T00:36:31.506134+0000 mgr.a (mgr.14355) 5867 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:33.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:33.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:33.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:34.480 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:34.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:34 smithi007 bash[22722]: cluster 2024-09-14T00:36:33.506889+0000 mgr.a (mgr.14355) 5868 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:34 smithi131 bash[24745]: cluster 2024-09-14T00:36:33.506889+0000 mgr.a (mgr.14355) 5868 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:34 smithi171 bash[25040]: cluster 2024-09-14T00:36:33.506889+0000 mgr.a (mgr.14355) 5868 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:35 smithi007 bash[22722]: audit 2024-09-14T00:36:34.033709+0000 mgr.a (mgr.14355) 5869 : audit [DBG] from='client.135666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:35 smithi131 bash[24745]: audit 2024-09-14T00:36:34.033709+0000 mgr.a (mgr.14355) 5869 : audit [DBG] from='client.135666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:35 smithi171 bash[25040]: audit 2024-09-14T00:36:34.033709+0000 mgr.a (mgr.14355) 5869 : audit [DBG] from='client.135666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:36 smithi007 bash[22722]: cluster 2024-09-14T00:36:35.509117+0000 mgr.a (mgr.14355) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:36 smithi131 bash[24745]: cluster 2024-09-14T00:36:35.509117+0000 mgr.a (mgr.14355) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:36 smithi171 bash[25040]: cluster 2024-09-14T00:36:35.509117+0000 mgr.a (mgr.14355) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:36:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:38 smithi007 bash[22722]: cluster 2024-09-14T00:36:37.509877+0000 mgr.a (mgr.14355) 5871 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:38 smithi131 bash[24745]: cluster 2024-09-14T00:36:37.509877+0000 mgr.a (mgr.14355) 5871 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:38 smithi171 bash[25040]: cluster 2024-09-14T00:36:37.509877+0000 mgr.a (mgr.14355) 5871 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:39.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:39.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:40.253 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:40.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:40 smithi007 bash[22722]: cluster 2024-09-14T00:36:39.510659+0000 mgr.a (mgr.14355) 5872 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:40 smithi007 bash[22722]: audit 2024-09-14T00:36:39.815887+0000 mgr.a (mgr.14355) 5873 : audit [DBG] from='client.135738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:40 smithi131 bash[24745]: cluster 2024-09-14T00:36:39.510659+0000 mgr.a (mgr.14355) 5872 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:40 smithi131 bash[24745]: audit 2024-09-14T00:36:39.815887+0000 mgr.a (mgr.14355) 5873 : audit [DBG] from='client.135738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:40 smithi171 bash[25040]: cluster 2024-09-14T00:36:39.510659+0000 mgr.a (mgr.14355) 5872 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:40 smithi171 bash[25040]: audit 2024-09-14T00:36:39.815887+0000 mgr.a (mgr.14355) 5873 : audit [DBG] from='client.135738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:42 smithi007 bash[22722]: cluster 2024-09-14T00:36:41.513393+0000 mgr.a (mgr.14355) 5874 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:36:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:42 smithi131 bash[24745]: cluster 2024-09-14T00:36:41.513393+0000 mgr.a (mgr.14355) 5874 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:36:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:42 smithi171 bash[25040]: cluster 2024-09-14T00:36:41.513393+0000 mgr.a (mgr.14355) 5874 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:36:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:44 smithi007 bash[22722]: cluster 2024-09-14T00:36:43.514161+0000 mgr.a (mgr.14355) 5875 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:36:45.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:45.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:44 smithi131 bash[24745]: cluster 2024-09-14T00:36:43.514161+0000 mgr.a (mgr.14355) 5875 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:36:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:44 smithi171 bash[25040]: cluster 2024-09-14T00:36:43.514161+0000 mgr.a (mgr.14355) 5875 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:36:46.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:46.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:45 smithi007 bash[22722]: cluster 2024-09-14T00:36:45.516229+0000 mgr.a (mgr.14355) 5876 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:45 smithi007 bash[22722]: audit 2024-09-14T00:36:45.586701+0000 mgr.a (mgr.14355) 5877 : audit [DBG] from='client.135813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:45 smithi131 bash[24745]: cluster 2024-09-14T00:36:45.516229+0000 mgr.a (mgr.14355) 5876 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:45 smithi131 bash[24745]: audit 2024-09-14T00:36:45.586701+0000 mgr.a (mgr.14355) 5877 : audit [DBG] from='client.135813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:45 smithi171 bash[25040]: cluster 2024-09-14T00:36:45.516229+0000 mgr.a (mgr.14355) 5876 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:45 smithi171 bash[25040]: audit 2024-09-14T00:36:45.586701+0000 mgr.a (mgr.14355) 5877 : audit [DBG] from='client.135813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:48 smithi007 bash[22722]: cluster 2024-09-14T00:36:47.517166+0000 mgr.a (mgr.14355) 5878 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:36:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:48 smithi131 bash[24745]: cluster 2024-09-14T00:36:47.517166+0000 mgr.a (mgr.14355) 5878 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:36:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:48 smithi171 bash[25040]: cluster 2024-09-14T00:36:47.517166+0000 mgr.a (mgr.14355) 5878 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:36:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:50 smithi007 bash[22722]: cluster 2024-09-14T00:36:49.517937+0000 mgr.a (mgr.14355) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:51.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:51.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:51.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:50 smithi131 bash[24745]: cluster 2024-09-14T00:36:49.517937+0000 mgr.a (mgr.14355) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:50 smithi171 bash[25040]: cluster 2024-09-14T00:36:49.517937+0000 mgr.a (mgr.14355) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:36:51.808 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:51.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:52 smithi007 bash[22722]: audit 2024-09-14T00:36:51.365359+0000 mgr.a (mgr.14355) 5880 : audit [DBG] from='client.135888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:52 smithi007 bash[22722]: cluster 2024-09-14T00:36:51.519467+0000 mgr.a (mgr.14355) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:52 smithi131 bash[24745]: audit 2024-09-14T00:36:51.365359+0000 mgr.a (mgr.14355) 5880 : audit [DBG] from='client.135888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:53.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:52 smithi131 bash[24745]: cluster 2024-09-14T00:36:51.519467+0000 mgr.a (mgr.14355) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:52 smithi171 bash[25040]: audit 2024-09-14T00:36:51.365359+0000 mgr.a (mgr.14355) 5880 : audit [DBG] from='client.135888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:52 smithi171 bash[25040]: cluster 2024-09-14T00:36:51.519467+0000 mgr.a (mgr.14355) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:54 smithi007 bash[22722]: cluster 2024-09-14T00:36:53.520372+0000 mgr.a (mgr.14355) 5882 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:54 smithi131 bash[24745]: cluster 2024-09-14T00:36:53.520372+0000 mgr.a (mgr.14355) 5882 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:54 smithi171 bash[25040]: cluster 2024-09-14T00:36:53.520372+0000 mgr.a (mgr.14355) 5882 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:36:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:36:56.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:36:56.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:36:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:56 smithi007 bash[22722]: cluster 2024-09-14T00:36:55.522659+0000 mgr.a (mgr.14355) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:36:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:56 smithi131 bash[24745]: cluster 2024-09-14T00:36:55.522659+0000 mgr.a (mgr.14355) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:36:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:56 smithi171 bash[25040]: cluster 2024-09-14T00:36:55.522659+0000 mgr.a (mgr.14355) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:36:57.580 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:36:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:36:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:36:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:36:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:36:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:58 smithi007 bash[22722]: audit 2024-09-14T00:36:57.142042+0000 mgr.a (mgr.14355) 5884 : audit [DBG] from='client.135963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:36:58 smithi007 bash[22722]: cluster 2024-09-14T00:36:57.523237+0000 mgr.a (mgr.14355) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:58 smithi131 bash[24745]: audit 2024-09-14T00:36:57.142042+0000 mgr.a (mgr.14355) 5884 : audit [DBG] from='client.135963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:36:58 smithi131 bash[24745]: cluster 2024-09-14T00:36:57.523237+0000 mgr.a (mgr.14355) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:36:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:58 smithi171 bash[25040]: audit 2024-09-14T00:36:57.142042+0000 mgr.a (mgr.14355) 5884 : audit [DBG] from='client.135963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:36:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:36:58 smithi171 bash[25040]: cluster 2024-09-14T00:36:57.523237+0000 mgr.a (mgr.14355) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:00 smithi007 bash[22722]: cluster 2024-09-14T00:36:59.523980+0000 mgr.a (mgr.14355) 5886 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:00 smithi131 bash[24745]: cluster 2024-09-14T00:36:59.523980+0000 mgr.a (mgr.14355) 5886 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:00 smithi171 bash[25040]: cluster 2024-09-14T00:36:59.523980+0000 mgr.a (mgr.14355) 5886 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:02 smithi007 bash[22722]: cluster 2024-09-14T00:37:01.526193+0000 mgr.a (mgr.14355) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:02 smithi131 bash[24745]: cluster 2024-09-14T00:37:01.526193+0000 mgr.a (mgr.14355) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:02 smithi171 bash[25040]: cluster 2024-09-14T00:37:01.526193+0000 mgr.a (mgr.14355) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:03.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:04 smithi007 bash[22722]: audit 2024-09-14T00:37:02.916901+0000 mgr.a (mgr.14355) 5888 : audit [DBG] from='client.136038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:04 smithi007 bash[22722]: cluster 2024-09-14T00:37:03.527101+0000 mgr.a (mgr.14355) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:04 smithi131 bash[24745]: audit 2024-09-14T00:37:02.916901+0000 mgr.a (mgr.14355) 5888 : audit [DBG] from='client.136038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:04 smithi131 bash[24745]: cluster 2024-09-14T00:37:03.527101+0000 mgr.a (mgr.14355) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:04 smithi171 bash[25040]: audit 2024-09-14T00:37:02.916901+0000 mgr.a (mgr.14355) 5888 : audit [DBG] from='client.136038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:04 smithi171 bash[25040]: cluster 2024-09-14T00:37:03.527101+0000 mgr.a (mgr.14355) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:06 smithi007 bash[22722]: cluster 2024-09-14T00:37:05.529272+0000 mgr.a (mgr.14355) 5890 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:06 smithi131 bash[24745]: cluster 2024-09-14T00:37:05.529272+0000 mgr.a (mgr.14355) 5890 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:06 smithi171 bash[25040]: cluster 2024-09-14T00:37:05.529272+0000 mgr.a (mgr.14355) 5890 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:08.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:08 smithi007 bash[22722]: cluster 2024-09-14T00:37:07.530067+0000 mgr.a (mgr.14355) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:08 smithi131 bash[24745]: cluster 2024-09-14T00:37:07.530067+0000 mgr.a (mgr.14355) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:08 smithi171 bash[25040]: cluster 2024-09-14T00:37:07.530067+0000 mgr.a (mgr.14355) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:09.151 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:09.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:09.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:09 smithi007 bash[22722]: audit 2024-09-14T00:37:08.697491+0000 mgr.a (mgr.14355) 5892 : audit [DBG] from='client.136110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:09 smithi007 bash[22722]: audit 2024-09-14T00:37:08.937866+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:37:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:09 smithi131 bash[24745]: audit 2024-09-14T00:37:08.697491+0000 mgr.a (mgr.14355) 5892 : audit [DBG] from='client.136110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:09 smithi131 bash[24745]: audit 2024-09-14T00:37:08.937866+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:37:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:09 smithi171 bash[25040]: audit 2024-09-14T00:37:08.697491+0000 mgr.a (mgr.14355) 5892 : audit [DBG] from='client.136110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:09 smithi171 bash[25040]: audit 2024-09-14T00:37:08.937866+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:37:10.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22972]: debug 2024-09-14T00:37:10.479+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:37:10.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22972]: debug 2024-09-14T00:37:10.479+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: cluster 2024-09-14T00:37:09.530997+0000 mgr.a (mgr.14355) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: audit 2024-09-14T00:37:09.726361+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: audit 2024-09-14T00:37:09.727892+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: audit 2024-09-14T00:37:09.737908+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: audit 2024-09-14T00:37:09.742629+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:10 smithi007 bash[22722]: audit 2024-09-14T00:37:09.743892+0000 mgr.a (mgr.14355) 5894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: cluster 2024-09-14T00:37:09.530997+0000 mgr.a (mgr.14355) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: audit 2024-09-14T00:37:09.726361+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: audit 2024-09-14T00:37:09.727892+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: audit 2024-09-14T00:37:09.737908+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: audit 2024-09-14T00:37:09.742629+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:10 smithi131 bash[24745]: audit 2024-09-14T00:37:09.743892+0000 mgr.a (mgr.14355) 5894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: cluster 2024-09-14T00:37:09.530997+0000 mgr.a (mgr.14355) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: audit 2024-09-14T00:37:09.726361+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: audit 2024-09-14T00:37:09.727892+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: audit 2024-09-14T00:37:09.737908+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: audit 2024-09-14T00:37:09.742629+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:10 smithi171 bash[25040]: audit 2024-09-14T00:37:09.743892+0000 mgr.a (mgr.14355) 5894 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:37:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:11 smithi007 bash[22722]: audit 2024-09-14T00:37:10.484715+0000 mgr.a (mgr.14355) 5895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:37:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:11 smithi007 bash[22722]: cephadm 2024-09-14T00:37:10.486213+0000 mgr.a (mgr.14355) 5896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:37:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:11 smithi131 bash[24745]: audit 2024-09-14T00:37:10.484715+0000 mgr.a (mgr.14355) 5895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:37:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:11 smithi131 bash[24745]: cephadm 2024-09-14T00:37:10.486213+0000 mgr.a (mgr.14355) 5896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:37:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:11 smithi171 bash[25040]: audit 2024-09-14T00:37:10.484715+0000 mgr.a (mgr.14355) 5895 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:37:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:11 smithi171 bash[25040]: cephadm 2024-09-14T00:37:10.486213+0000 mgr.a (mgr.14355) 5896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:37:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:12 smithi007 bash[22722]: cluster 2024-09-14T00:37:11.533705+0000 mgr.a (mgr.14355) 5897 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:37:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:12 smithi131 bash[24745]: cluster 2024-09-14T00:37:11.533705+0000 mgr.a (mgr.14355) 5897 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:37:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:12 smithi171 bash[25040]: cluster 2024-09-14T00:37:11.533705+0000 mgr.a (mgr.14355) 5897 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:37:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:14.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:14.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:14.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:14.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:14.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:14 smithi007 bash[22722]: cluster 2024-09-14T00:37:13.534479+0000 mgr.a (mgr.14355) 5898 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:37:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:14 smithi131 bash[24745]: cluster 2024-09-14T00:37:13.534479+0000 mgr.a (mgr.14355) 5898 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:37:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:14 smithi171 bash[25040]: cluster 2024-09-14T00:37:13.534479+0000 mgr.a (mgr.14355) 5898 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:37:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:15 smithi007 bash[22722]: audit 2024-09-14T00:37:14.488422+0000 mgr.a (mgr.14355) 5899 : audit [DBG] from='client.136293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:15 smithi131 bash[24745]: audit 2024-09-14T00:37:14.488422+0000 mgr.a (mgr.14355) 5899 : audit [DBG] from='client.136293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:15 smithi171 bash[25040]: audit 2024-09-14T00:37:14.488422+0000 mgr.a (mgr.14355) 5899 : audit [DBG] from='client.136293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:16 smithi007 bash[22722]: cluster 2024-09-14T00:37:15.536768+0000 mgr.a (mgr.14355) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:16 smithi131 bash[24745]: cluster 2024-09-14T00:37:15.536768+0000 mgr.a (mgr.14355) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:16 smithi171 bash[25040]: cluster 2024-09-14T00:37:15.536768+0000 mgr.a (mgr.14355) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:18 smithi007 bash[22722]: cluster 2024-09-14T00:37:17.537577+0000 mgr.a (mgr.14355) 5901 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:18 smithi131 bash[24745]: cluster 2024-09-14T00:37:17.537577+0000 mgr.a (mgr.14355) 5901 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:18 smithi171 bash[25040]: cluster 2024-09-14T00:37:17.537577+0000 mgr.a (mgr.14355) 5901 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:19.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:19.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:19.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:20.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:20.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:20.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:20 smithi007 bash[22722]: cluster 2024-09-14T00:37:19.538376+0000 mgr.a (mgr.14355) 5902 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:20 smithi131 bash[24745]: cluster 2024-09-14T00:37:19.538376+0000 mgr.a (mgr.14355) 5902 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:20 smithi171 bash[25040]: cluster 2024-09-14T00:37:19.538376+0000 mgr.a (mgr.14355) 5902 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:21 smithi007 bash[22722]: audit 2024-09-14T00:37:20.258723+0000 mgr.a (mgr.14355) 5903 : audit [DBG] from='client.136371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:21 smithi131 bash[24745]: audit 2024-09-14T00:37:20.258723+0000 mgr.a (mgr.14355) 5903 : audit [DBG] from='client.136371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:21 smithi171 bash[25040]: audit 2024-09-14T00:37:20.258723+0000 mgr.a (mgr.14355) 5903 : audit [DBG] from='client.136371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:22 smithi007 bash[22722]: cluster 2024-09-14T00:37:21.541057+0000 mgr.a (mgr.14355) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:22 smithi131 bash[24745]: cluster 2024-09-14T00:37:21.541057+0000 mgr.a (mgr.14355) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:22 smithi171 bash[25040]: cluster 2024-09-14T00:37:21.541057+0000 mgr.a (mgr.14355) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:37:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:24 smithi007 bash[22722]: cluster 2024-09-14T00:37:23.541853+0000 mgr.a (mgr.14355) 5905 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:37:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:24 smithi131 bash[24745]: cluster 2024-09-14T00:37:23.541853+0000 mgr.a (mgr.14355) 5905 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:37:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:24 smithi171 bash[25040]: cluster 2024-09-14T00:37:23.541853+0000 mgr.a (mgr.14355) 5905 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:37:25.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:25.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:25.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:26.463 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:26.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:26.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:26.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:26.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:26 smithi007 bash[22722]: cluster 2024-09-14T00:37:25.543804+0000 mgr.a (mgr.14355) 5906 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:37:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:26 smithi131 bash[24745]: cluster 2024-09-14T00:37:25.543804+0000 mgr.a (mgr.14355) 5906 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:37:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:26 smithi171 bash[25040]: cluster 2024-09-14T00:37:25.543804+0000 mgr.a (mgr.14355) 5906 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:37:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:27 smithi007 bash[22722]: audit 2024-09-14T00:37:26.022863+0000 mgr.a (mgr.14355) 5907 : audit [DBG] from='client.136443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:27 smithi131 bash[24745]: audit 2024-09-14T00:37:26.022863+0000 mgr.a (mgr.14355) 5907 : audit [DBG] from='client.136443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:27 smithi171 bash[25040]: audit 2024-09-14T00:37:26.022863+0000 mgr.a (mgr.14355) 5907 : audit [DBG] from='client.136443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:28 smithi007 bash[22722]: cluster 2024-09-14T00:37:27.544785+0000 mgr.a (mgr.14355) 5908 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:37:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:28 smithi131 bash[24745]: cluster 2024-09-14T00:37:27.544785+0000 mgr.a (mgr.14355) 5908 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:37:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:28 smithi171 bash[25040]: cluster 2024-09-14T00:37:27.544785+0000 mgr.a (mgr.14355) 5908 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:37:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:30 smithi007 bash[22722]: cluster 2024-09-14T00:37:29.545601+0000 mgr.a (mgr.14355) 5909 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:37:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:30 smithi131 bash[24745]: cluster 2024-09-14T00:37:29.545601+0000 mgr.a (mgr.14355) 5909 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:37:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:30 smithi171 bash[25040]: cluster 2024-09-14T00:37:29.545601+0000 mgr.a (mgr.14355) 5909 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:37:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:31.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:31.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:32.237 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:32.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:32 smithi007 bash[22722]: cluster 2024-09-14T00:37:31.547914+0000 mgr.a (mgr.14355) 5910 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:32 smithi007 bash[22722]: audit 2024-09-14T00:37:31.802116+0000 mgr.a (mgr.14355) 5911 : audit [DBG] from='client.136521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:32 smithi131 bash[24745]: cluster 2024-09-14T00:37:31.547914+0000 mgr.a (mgr.14355) 5910 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:32 smithi131 bash[24745]: audit 2024-09-14T00:37:31.802116+0000 mgr.a (mgr.14355) 5911 : audit [DBG] from='client.136521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:32 smithi171 bash[25040]: cluster 2024-09-14T00:37:31.547914+0000 mgr.a (mgr.14355) 5910 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:32 smithi171 bash[25040]: audit 2024-09-14T00:37:31.802116+0000 mgr.a (mgr.14355) 5911 : audit [DBG] from='client.136521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:34 smithi007 bash[22722]: cluster 2024-09-14T00:37:33.548920+0000 mgr.a (mgr.14355) 5912 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:34 smithi131 bash[24745]: cluster 2024-09-14T00:37:33.548920+0000 mgr.a (mgr.14355) 5912 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:34 smithi171 bash[25040]: cluster 2024-09-14T00:37:33.548920+0000 mgr.a (mgr.14355) 5912 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:36 smithi131 bash[24745]: cluster 2024-09-14T00:37:35.551152+0000 mgr.a (mgr.14355) 5913 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:36 smithi171 bash[25040]: cluster 2024-09-14T00:37:35.551152+0000 mgr.a (mgr.14355) 5913 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:36 smithi007 bash[22722]: cluster 2024-09-14T00:37:35.551152+0000 mgr.a (mgr.14355) 5913 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:37.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:37.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:37.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:37.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:38 smithi131 bash[24745]: cluster 2024-09-14T00:37:37.551855+0000 mgr.a (mgr.14355) 5914 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:38 smithi131 bash[24745]: audit 2024-09-14T00:37:37.569985+0000 mgr.a (mgr.14355) 5915 : audit [DBG] from='client.136599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:38 smithi171 bash[25040]: cluster 2024-09-14T00:37:37.551855+0000 mgr.a (mgr.14355) 5914 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:38 smithi171 bash[25040]: audit 2024-09-14T00:37:37.569985+0000 mgr.a (mgr.14355) 5915 : audit [DBG] from='client.136599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:38 smithi007 bash[22722]: cluster 2024-09-14T00:37:37.551855+0000 mgr.a (mgr.14355) 5914 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:38 smithi007 bash[22722]: audit 2024-09-14T00:37:37.569985+0000 mgr.a (mgr.14355) 5915 : audit [DBG] from='client.136599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:40 smithi131 bash[24745]: cluster 2024-09-14T00:37:39.552754+0000 mgr.a (mgr.14355) 5916 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:40 smithi171 bash[25040]: cluster 2024-09-14T00:37:39.552754+0000 mgr.a (mgr.14355) 5916 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:40 smithi007 bash[22722]: cluster 2024-09-14T00:37:39.552754+0000 mgr.a (mgr.14355) 5916 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:42.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:42.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:42 smithi131 bash[24745]: cluster 2024-09-14T00:37:41.555012+0000 mgr.a (mgr.14355) 5917 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:42 smithi171 bash[25040]: cluster 2024-09-14T00:37:41.555012+0000 mgr.a (mgr.14355) 5917 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:42 smithi007 bash[22722]: cluster 2024-09-14T00:37:41.555012+0000 mgr.a (mgr.14355) 5917 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:43.762 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:43.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:43.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:43.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:43.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:44 smithi131 bash[24745]: audit 2024-09-14T00:37:43.319229+0000 mgr.a (mgr.14355) 5918 : audit [DBG] from='client.136674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:44 smithi131 bash[24745]: cluster 2024-09-14T00:37:43.558707+0000 mgr.a (mgr.14355) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:44 smithi171 bash[25040]: audit 2024-09-14T00:37:43.319229+0000 mgr.a (mgr.14355) 5918 : audit [DBG] from='client.136674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:44 smithi171 bash[25040]: cluster 2024-09-14T00:37:43.558707+0000 mgr.a (mgr.14355) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:44 smithi007 bash[22722]: audit 2024-09-14T00:37:43.319229+0000 mgr.a (mgr.14355) 5918 : audit [DBG] from='client.136674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:44 smithi007 bash[22722]: cluster 2024-09-14T00:37:43.558707+0000 mgr.a (mgr.14355) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:46 smithi131 bash[24745]: cluster 2024-09-14T00:37:45.561008+0000 mgr.a (mgr.14355) 5920 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:46 smithi171 bash[25040]: cluster 2024-09-14T00:37:45.561008+0000 mgr.a (mgr.14355) 5920 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:46 smithi007 bash[22722]: cluster 2024-09-14T00:37:45.561008+0000 mgr.a (mgr.14355) 5920 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:48 smithi131 bash[24745]: cluster 2024-09-14T00:37:47.561824+0000 mgr.a (mgr.14355) 5921 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:48 smithi171 bash[25040]: cluster 2024-09-14T00:37:47.561824+0000 mgr.a (mgr.14355) 5921 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:48 smithi007 bash[22722]: cluster 2024-09-14T00:37:47.561824+0000 mgr.a (mgr.14355) 5921 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:49.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:49.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:49.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:50 smithi131 bash[24745]: audit 2024-09-14T00:37:49.093169+0000 mgr.a (mgr.14355) 5922 : audit [DBG] from='client.136752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:50 smithi131 bash[24745]: cluster 2024-09-14T00:37:49.562412+0000 mgr.a (mgr.14355) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:50 smithi171 bash[25040]: audit 2024-09-14T00:37:49.093169+0000 mgr.a (mgr.14355) 5922 : audit [DBG] from='client.136752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:50 smithi171 bash[25040]: cluster 2024-09-14T00:37:49.562412+0000 mgr.a (mgr.14355) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:50 smithi007 bash[22722]: audit 2024-09-14T00:37:49.093169+0000 mgr.a (mgr.14355) 5922 : audit [DBG] from='client.136752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:50 smithi007 bash[22722]: cluster 2024-09-14T00:37:49.562412+0000 mgr.a (mgr.14355) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:52 smithi131 bash[24745]: cluster 2024-09-14T00:37:51.564610+0000 mgr.a (mgr.14355) 5924 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:52 smithi171 bash[25040]: cluster 2024-09-14T00:37:51.564610+0000 mgr.a (mgr.14355) 5924 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:52 smithi007 bash[22722]: cluster 2024-09-14T00:37:51.564610+0000 mgr.a (mgr.14355) 5924 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:37:54.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:37:54.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:37:54.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:37:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:54 smithi131 bash[24745]: cluster 2024-09-14T00:37:53.565381+0000 mgr.a (mgr.14355) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:54 smithi171 bash[25040]: cluster 2024-09-14T00:37:53.565381+0000 mgr.a (mgr.14355) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:54 smithi007 bash[22722]: cluster 2024-09-14T00:37:53.565381+0000 mgr.a (mgr.14355) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:37:55.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:37:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:37:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:37:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:37:55.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:37:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:55 smithi131 bash[24745]: audit 2024-09-14T00:37:54.850525+0000 mgr.a (mgr.14355) 5926 : audit [DBG] from='client.136830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:55 smithi171 bash[25040]: audit 2024-09-14T00:37:54.850525+0000 mgr.a (mgr.14355) 5926 : audit [DBG] from='client.136830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:55 smithi007 bash[22722]: audit 2024-09-14T00:37:54.850525+0000 mgr.a (mgr.14355) 5926 : audit [DBG] from='client.136830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:37:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:56 smithi131 bash[24745]: cluster 2024-09-14T00:37:55.568311+0000 mgr.a (mgr.14355) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:37:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:56 smithi171 bash[25040]: cluster 2024-09-14T00:37:55.568311+0000 mgr.a (mgr.14355) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:37:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:56 smithi007 bash[22722]: cluster 2024-09-14T00:37:55.568311+0000 mgr.a (mgr.14355) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T00:37:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:37:58 smithi131 bash[24745]: cluster 2024-09-14T00:37:57.569114+0000 mgr.a (mgr.14355) 5928 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:37:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:37:58 smithi171 bash[25040]: cluster 2024-09-14T00:37:57.569114+0000 mgr.a (mgr.14355) 5928 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:37:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:37:58 smithi007 bash[22722]: cluster 2024-09-14T00:37:57.569114+0000 mgr.a (mgr.14355) 5928 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:38:00.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:00.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:00.291 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:00 smithi131 bash[24745]: cluster 2024-09-14T00:37:59.569900+0000 mgr.a (mgr.14355) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:38:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:00 smithi171 bash[25040]: cluster 2024-09-14T00:37:59.569900+0000 mgr.a (mgr.14355) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:38:01.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:01.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:00 smithi007 bash[22722]: cluster 2024-09-14T00:37:59.569900+0000 mgr.a (mgr.14355) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:38:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:01 smithi131 bash[24745]: audit 2024-09-14T00:38:00.624576+0000 mgr.a (mgr.14355) 5930 : audit [DBG] from='client.136905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:01 smithi171 bash[25040]: audit 2024-09-14T00:38:00.624576+0000 mgr.a (mgr.14355) 5930 : audit [DBG] from='client.136905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:01 smithi007 bash[22722]: audit 2024-09-14T00:38:00.624576+0000 mgr.a (mgr.14355) 5930 : audit [DBG] from='client.136905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:02 smithi131 bash[24745]: cluster 2024-09-14T00:38:01.572895+0000 mgr.a (mgr.14355) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:02 smithi171 bash[25040]: cluster 2024-09-14T00:38:01.572895+0000 mgr.a (mgr.14355) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:02 smithi007 bash[22722]: cluster 2024-09-14T00:38:01.572895+0000 mgr.a (mgr.14355) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:04 smithi131 bash[24745]: cluster 2024-09-14T00:38:03.573706+0000 mgr.a (mgr.14355) 5932 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:04 smithi171 bash[25040]: cluster 2024-09-14T00:38:03.573706+0000 mgr.a (mgr.14355) 5932 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:04 smithi007 bash[22722]: cluster 2024-09-14T00:38:03.573706+0000 mgr.a (mgr.14355) 5932 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:06.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:06.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:06.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:06.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:06.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:06.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:06 smithi171 bash[25040]: cluster 2024-09-14T00:38:05.575695+0000 mgr.a (mgr.14355) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:06 smithi007 bash[22722]: cluster 2024-09-14T00:38:05.575695+0000 mgr.a (mgr.14355) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:06 smithi131 bash[24745]: cluster 2024-09-14T00:38:05.575695+0000 mgr.a (mgr.14355) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:07 smithi171 bash[25040]: audit 2024-09-14T00:38:06.408740+0000 mgr.a (mgr.14355) 5934 : audit [DBG] from='client.136983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:07 smithi007 bash[22722]: audit 2024-09-14T00:38:06.408740+0000 mgr.a (mgr.14355) 5934 : audit [DBG] from='client.136983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:07 smithi131 bash[24745]: audit 2024-09-14T00:38:06.408740+0000 mgr.a (mgr.14355) 5934 : audit [DBG] from='client.136983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:08 smithi007 bash[22722]: cluster 2024-09-14T00:38:07.576673+0000 mgr.a (mgr.14355) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:08 smithi131 bash[24745]: cluster 2024-09-14T00:38:07.576673+0000 mgr.a (mgr.14355) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:08 smithi171 bash[25040]: cluster 2024-09-14T00:38:07.576673+0000 mgr.a (mgr.14355) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:10 smithi007 bash[22722]: cluster 2024-09-14T00:38:09.577469+0000 mgr.a (mgr.14355) 5936 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:10 smithi007 bash[22722]: audit 2024-09-14T00:38:10.537027+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:38:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:10 smithi131 bash[24745]: cluster 2024-09-14T00:38:09.577469+0000 mgr.a (mgr.14355) 5936 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:10 smithi131 bash[24745]: audit 2024-09-14T00:38:10.537027+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:38:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:10 smithi171 bash[25040]: cluster 2024-09-14T00:38:09.577469+0000 mgr.a (mgr.14355) 5936 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:38:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:10 smithi171 bash[25040]: audit 2024-09-14T00:38:10.537027+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:38:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:11.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:12.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:12.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:12 smithi007 bash[22722]: cluster 2024-09-14T00:38:11.579794+0000 mgr.a (mgr.14355) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:38:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:12 smithi131 bash[24745]: cluster 2024-09-14T00:38:11.579794+0000 mgr.a (mgr.14355) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:38:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:12 smithi171 bash[25040]: cluster 2024-09-14T00:38:11.579794+0000 mgr.a (mgr.14355) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:38:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:13 smithi007 bash[22722]: audit 2024-09-14T00:38:12.181035+0000 mgr.a (mgr.14355) 5938 : audit [DBG] from='client.137055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:13 smithi131 bash[24745]: audit 2024-09-14T00:38:12.181035+0000 mgr.a (mgr.14355) 5938 : audit [DBG] from='client.137055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:13 smithi171 bash[25040]: audit 2024-09-14T00:38:12.181035+0000 mgr.a (mgr.14355) 5938 : audit [DBG] from='client.137055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:14 smithi007 bash[22722]: cluster 2024-09-14T00:38:13.580769+0000 mgr.a (mgr.14355) 5939 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:14 smithi131 bash[24745]: cluster 2024-09-14T00:38:13.580769+0000 mgr.a (mgr.14355) 5939 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:14 smithi171 bash[25040]: cluster 2024-09-14T00:38:13.580769+0000 mgr.a (mgr.14355) 5939 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: cluster 2024-09-14T00:38:15.583084+0000 mgr.a (mgr.14355) 5940 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.887529+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.892037+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.925987+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.929792+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.934248+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:15.940096+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:16.635736+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:16.636811+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:16.642359+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:16 smithi007 bash[22722]: audit 2024-09-14T00:38:16.645127+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: cluster 2024-09-14T00:38:15.583084+0000 mgr.a (mgr.14355) 5940 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.887529+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.892037+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.925987+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.929792+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.934248+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:15.940096+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:16.635736+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:38:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:16.636811+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:38:17.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:16.642359+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:16 smithi131 bash[24745]: audit 2024-09-14T00:38:16.645127+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: cluster 2024-09-14T00:38:15.583084+0000 mgr.a (mgr.14355) 5940 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.887529+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.892037+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.925987+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.929792+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.934248+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:15.940096+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:16.635736+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:16.636811+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:16.642359+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:38:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:16 smithi171 bash[25040]: audit 2024-09-14T00:38:16.645127+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:38:17 smithi007 bash[22972]: debug 2024-09-14T00:38:17.370+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:38:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:38:17 smithi007 bash[22972]: debug 2024-09-14T00:38:17.374+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:38:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:17 smithi007 bash[22722]: audit 2024-09-14T00:38:16.646269+0000 mgr.a (mgr.14355) 5941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:17 smithi131 bash[24745]: audit 2024-09-14T00:38:16.646269+0000 mgr.a (mgr.14355) 5941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:17 smithi171 bash[25040]: audit 2024-09-14T00:38:16.646269+0000 mgr.a (mgr.14355) 5941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:38:18.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:18.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:18.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:18.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:18.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:18 smithi007 bash[22722]: audit 2024-09-14T00:38:17.373694+0000 mgr.a (mgr.14355) 5942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:38:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:18 smithi007 bash[22722]: cephadm 2024-09-14T00:38:17.375029+0000 mgr.a (mgr.14355) 5943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:38:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:18 smithi007 bash[22722]: cluster 2024-09-14T00:38:17.584041+0000 mgr.a (mgr.14355) 5944 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:18 smithi131 bash[24745]: audit 2024-09-14T00:38:17.373694+0000 mgr.a (mgr.14355) 5942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:38:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:18 smithi131 bash[24745]: cephadm 2024-09-14T00:38:17.375029+0000 mgr.a (mgr.14355) 5943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:38:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:18 smithi131 bash[24745]: cluster 2024-09-14T00:38:17.584041+0000 mgr.a (mgr.14355) 5944 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:18 smithi171 bash[25040]: audit 2024-09-14T00:38:17.373694+0000 mgr.a (mgr.14355) 5942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:38:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:18 smithi171 bash[25040]: cephadm 2024-09-14T00:38:17.375029+0000 mgr.a (mgr.14355) 5943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:38:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:18 smithi171 bash[25040]: cluster 2024-09-14T00:38:17.584041+0000 mgr.a (mgr.14355) 5944 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:19 smithi007 bash[22722]: audit 2024-09-14T00:38:17.923867+0000 mgr.a (mgr.14355) 5945 : audit [DBG] from='client.137238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:19 smithi131 bash[24745]: audit 2024-09-14T00:38:17.923867+0000 mgr.a (mgr.14355) 5945 : audit [DBG] from='client.137238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:19 smithi171 bash[25040]: audit 2024-09-14T00:38:17.923867+0000 mgr.a (mgr.14355) 5945 : audit [DBG] from='client.137238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:20 smithi007 bash[22722]: cluster 2024-09-14T00:38:19.585013+0000 mgr.a (mgr.14355) 5946 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:20 smithi131 bash[24745]: cluster 2024-09-14T00:38:19.585013+0000 mgr.a (mgr.14355) 5946 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:20 smithi171 bash[25040]: cluster 2024-09-14T00:38:19.585013+0000 mgr.a (mgr.14355) 5946 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:22 smithi007 bash[22722]: cluster 2024-09-14T00:38:21.587281+0000 mgr.a (mgr.14355) 5947 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:22 smithi131 bash[24745]: cluster 2024-09-14T00:38:21.587281+0000 mgr.a (mgr.14355) 5947 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:22 smithi171 bash[25040]: cluster 2024-09-14T00:38:21.587281+0000 mgr.a (mgr.14355) 5947 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:23.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:23.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:24.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:24 smithi007 bash[22722]: cluster 2024-09-14T00:38:23.588021+0000 mgr.a (mgr.14355) 5948 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:24 smithi007 bash[22722]: audit 2024-09-14T00:38:23.691618+0000 mgr.a (mgr.14355) 5949 : audit [DBG] from='client.137316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:24 smithi131 bash[24745]: cluster 2024-09-14T00:38:23.588021+0000 mgr.a (mgr.14355) 5948 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:24 smithi131 bash[24745]: audit 2024-09-14T00:38:23.691618+0000 mgr.a (mgr.14355) 5949 : audit [DBG] from='client.137316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:24 smithi171 bash[25040]: cluster 2024-09-14T00:38:23.588021+0000 mgr.a (mgr.14355) 5948 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:24 smithi171 bash[25040]: audit 2024-09-14T00:38:23.691618+0000 mgr.a (mgr.14355) 5949 : audit [DBG] from='client.137316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:25 smithi131 bash[24745]: cluster 2024-09-14T00:38:25.590326+0000 mgr.a (mgr.14355) 5950 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:25 smithi171 bash[25040]: cluster 2024-09-14T00:38:25.590326+0000 mgr.a (mgr.14355) 5950 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:25 smithi007 bash[22722]: cluster 2024-09-14T00:38:25.590326+0000 mgr.a (mgr.14355) 5950 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:28 smithi007 bash[22722]: cluster 2024-09-14T00:38:27.591115+0000 mgr.a (mgr.14355) 5951 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:28 smithi131 bash[24745]: cluster 2024-09-14T00:38:27.591115+0000 mgr.a (mgr.14355) 5951 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:28 smithi171 bash[25040]: cluster 2024-09-14T00:38:27.591115+0000 mgr.a (mgr.14355) 5951 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:29.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:29.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:29.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:29.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:30 smithi007 bash[22722]: audit 2024-09-14T00:38:29.464264+0000 mgr.a (mgr.14355) 5952 : audit [DBG] from='client.137391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:30 smithi007 bash[22722]: cluster 2024-09-14T00:38:29.591732+0000 mgr.a (mgr.14355) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:30 smithi131 bash[24745]: audit 2024-09-14T00:38:29.464264+0000 mgr.a (mgr.14355) 5952 : audit [DBG] from='client.137391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:30 smithi131 bash[24745]: cluster 2024-09-14T00:38:29.591732+0000 mgr.a (mgr.14355) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:30 smithi171 bash[25040]: audit 2024-09-14T00:38:29.464264+0000 mgr.a (mgr.14355) 5952 : audit [DBG] from='client.137391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:30 smithi171 bash[25040]: cluster 2024-09-14T00:38:29.591732+0000 mgr.a (mgr.14355) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:32 smithi007 bash[22722]: cluster 2024-09-14T00:38:31.594087+0000 mgr.a (mgr.14355) 5954 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:32 smithi131 bash[24745]: cluster 2024-09-14T00:38:31.594087+0000 mgr.a (mgr.14355) 5954 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:32 smithi171 bash[25040]: cluster 2024-09-14T00:38:31.594087+0000 mgr.a (mgr.14355) 5954 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:38:34.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:34.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:34.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:34 smithi007 bash[22722]: cluster 2024-09-14T00:38:33.594876+0000 mgr.a (mgr.14355) 5955 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:34 smithi131 bash[24745]: cluster 2024-09-14T00:38:33.594876+0000 mgr.a (mgr.14355) 5955 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:34 smithi171 bash[25040]: cluster 2024-09-14T00:38:33.594876+0000 mgr.a (mgr.14355) 5955 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:35.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:36 smithi007 bash[22722]: audit 2024-09-14T00:38:35.250020+0000 mgr.a (mgr.14355) 5956 : audit [DBG] from='client.137463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:36 smithi007 bash[22722]: cluster 2024-09-14T00:38:35.596174+0000 mgr.a (mgr.14355) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:36 smithi131 bash[24745]: audit 2024-09-14T00:38:35.250020+0000 mgr.a (mgr.14355) 5956 : audit [DBG] from='client.137463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:37.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:36 smithi131 bash[24745]: cluster 2024-09-14T00:38:35.596174+0000 mgr.a (mgr.14355) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:36 smithi171 bash[25040]: audit 2024-09-14T00:38:35.250020+0000 mgr.a (mgr.14355) 5956 : audit [DBG] from='client.137463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:36 smithi171 bash[25040]: cluster 2024-09-14T00:38:35.596174+0000 mgr.a (mgr.14355) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:38 smithi007 bash[22722]: cluster 2024-09-14T00:38:37.596860+0000 mgr.a (mgr.14355) 5958 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:38 smithi131 bash[24745]: cluster 2024-09-14T00:38:37.596860+0000 mgr.a (mgr.14355) 5958 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:38 smithi171 bash[25040]: cluster 2024-09-14T00:38:37.596860+0000 mgr.a (mgr.14355) 5958 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:40.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:40.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:40 smithi007 bash[22722]: cluster 2024-09-14T00:38:39.597620+0000 mgr.a (mgr.14355) 5959 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:40 smithi131 bash[24745]: cluster 2024-09-14T00:38:39.597620+0000 mgr.a (mgr.14355) 5959 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:40 smithi171 bash[25040]: cluster 2024-09-14T00:38:39.597620+0000 mgr.a (mgr.14355) 5959 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:38:41.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:41.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:42 smithi007 bash[22722]: audit 2024-09-14T00:38:41.018190+0000 mgr.a (mgr.14355) 5960 : audit [DBG] from='client.137538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:42 smithi007 bash[22722]: cluster 2024-09-14T00:38:41.600510+0000 mgr.a (mgr.14355) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:42 smithi131 bash[24745]: audit 2024-09-14T00:38:41.018190+0000 mgr.a (mgr.14355) 5960 : audit [DBG] from='client.137538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:42 smithi131 bash[24745]: cluster 2024-09-14T00:38:41.600510+0000 mgr.a (mgr.14355) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:42 smithi171 bash[25040]: audit 2024-09-14T00:38:41.018190+0000 mgr.a (mgr.14355) 5960 : audit [DBG] from='client.137538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:42 smithi171 bash[25040]: cluster 2024-09-14T00:38:41.600510+0000 mgr.a (mgr.14355) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:44 smithi007 bash[22722]: cluster 2024-09-14T00:38:43.601443+0000 mgr.a (mgr.14355) 5962 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:44 smithi131 bash[24745]: cluster 2024-09-14T00:38:43.601443+0000 mgr.a (mgr.14355) 5962 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:44 smithi171 bash[25040]: cluster 2024-09-14T00:38:43.601443+0000 mgr.a (mgr.14355) 5962 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:38:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:46.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:46.445 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:46 smithi007 bash[22722]: cluster 2024-09-14T00:38:45.603411+0000 mgr.a (mgr.14355) 5963 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:46 smithi131 bash[24745]: cluster 2024-09-14T00:38:45.603411+0000 mgr.a (mgr.14355) 5963 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:46 smithi171 bash[25040]: cluster 2024-09-14T00:38:45.603411+0000 mgr.a (mgr.14355) 5963 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:47.207 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:47.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:47 smithi007 bash[22722]: audit 2024-09-14T00:38:46.780846+0000 mgr.a (mgr.14355) 5964 : audit [DBG] from='client.137616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:47 smithi131 bash[24745]: audit 2024-09-14T00:38:46.780846+0000 mgr.a (mgr.14355) 5964 : audit [DBG] from='client.137616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:47 smithi171 bash[25040]: audit 2024-09-14T00:38:46.780846+0000 mgr.a (mgr.14355) 5964 : audit [DBG] from='client.137616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:48 smithi007 bash[22722]: cluster 2024-09-14T00:38:47.604520+0000 mgr.a (mgr.14355) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:48 smithi131 bash[24745]: cluster 2024-09-14T00:38:47.604520+0000 mgr.a (mgr.14355) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:48 smithi171 bash[25040]: cluster 2024-09-14T00:38:47.604520+0000 mgr.a (mgr.14355) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:50 smithi007 bash[22722]: cluster 2024-09-14T00:38:49.605490+0000 mgr.a (mgr.14355) 5966 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:50 smithi131 bash[24745]: cluster 2024-09-14T00:38:49.605490+0000 mgr.a (mgr.14355) 5966 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:50 smithi171 bash[25040]: cluster 2024-09-14T00:38:49.605490+0000 mgr.a (mgr.14355) 5966 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:52.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:52.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:52.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:52 smithi007 bash[22722]: cluster 2024-09-14T00:38:51.607896+0000 mgr.a (mgr.14355) 5967 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:52.973 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:52.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:52 smithi131 bash[24745]: cluster 2024-09-14T00:38:51.607896+0000 mgr.a (mgr.14355) 5967 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:52 smithi171 bash[25040]: cluster 2024-09-14T00:38:51.607896+0000 mgr.a (mgr.14355) 5967 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:53 smithi131 bash[24745]: audit 2024-09-14T00:38:52.539051+0000 mgr.a (mgr.14355) 5968 : audit [DBG] from='client.137694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:53 smithi171 bash[25040]: audit 2024-09-14T00:38:52.539051+0000 mgr.a (mgr.14355) 5968 : audit [DBG] from='client.137694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:53 smithi007 bash[22722]: audit 2024-09-14T00:38:52.539051+0000 mgr.a (mgr.14355) 5968 : audit [DBG] from='client.137694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:38:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:54 smithi131 bash[24745]: cluster 2024-09-14T00:38:53.609062+0000 mgr.a (mgr.14355) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:54 smithi171 bash[25040]: cluster 2024-09-14T00:38:53.609062+0000 mgr.a (mgr.14355) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:54 smithi007 bash[22722]: cluster 2024-09-14T00:38:53.609062+0000 mgr.a (mgr.14355) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:56 smithi131 bash[24745]: cluster 2024-09-14T00:38:55.611439+0000 mgr.a (mgr.14355) 5970 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:56 smithi171 bash[25040]: cluster 2024-09-14T00:38:55.611439+0000 mgr.a (mgr.14355) 5970 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:56 smithi007 bash[22722]: cluster 2024-09-14T00:38:55.611439+0000 mgr.a (mgr.14355) 5970 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:38:57.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:38:57.975 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:38:57.975 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:38:58.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:38:58.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:38:58.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:38:58.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:38:58.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:38:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:58 smithi131 bash[24745]: cluster 2024-09-14T00:38:57.612455+0000 mgr.a (mgr.14355) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:58 smithi171 bash[25040]: cluster 2024-09-14T00:38:57.612455+0000 mgr.a (mgr.14355) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:38:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:58 smithi007 bash[22722]: cluster 2024-09-14T00:38:57.612455+0000 mgr.a (mgr.14355) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:38:59 smithi131 bash[24745]: audit 2024-09-14T00:38:58.314426+0000 mgr.a (mgr.14355) 5972 : audit [DBG] from='client.137769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:38:59 smithi171 bash[25040]: audit 2024-09-14T00:38:58.314426+0000 mgr.a (mgr.14355) 5972 : audit [DBG] from='client.137769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:38:59 smithi007 bash[22722]: audit 2024-09-14T00:38:58.314426+0000 mgr.a (mgr.14355) 5972 : audit [DBG] from='client.137769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:00 smithi131 bash[24745]: cluster 2024-09-14T00:38:59.613410+0000 mgr.a (mgr.14355) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:00 smithi171 bash[25040]: cluster 2024-09-14T00:38:59.613410+0000 mgr.a (mgr.14355) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:00 smithi007 bash[22722]: cluster 2024-09-14T00:38:59.613410+0000 mgr.a (mgr.14355) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:02 smithi131 bash[24745]: cluster 2024-09-14T00:39:01.615707+0000 mgr.a (mgr.14355) 5974 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:02 smithi171 bash[25040]: cluster 2024-09-14T00:39:01.615707+0000 mgr.a (mgr.14355) 5974 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:02 smithi007 bash[22722]: cluster 2024-09-14T00:39:01.615707+0000 mgr.a (mgr.14355) 5974 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:03.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:03.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:04.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:04.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:04 smithi131 bash[24745]: cluster 2024-09-14T00:39:03.616476+0000 mgr.a (mgr.14355) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:04 smithi171 bash[25040]: cluster 2024-09-14T00:39:03.616476+0000 mgr.a (mgr.14355) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:04 smithi007 bash[22722]: cluster 2024-09-14T00:39:03.616476+0000 mgr.a (mgr.14355) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:05 smithi131 bash[24745]: audit 2024-09-14T00:39:04.088096+0000 mgr.a (mgr.14355) 5976 : audit [DBG] from='client.137847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:05 smithi171 bash[25040]: audit 2024-09-14T00:39:04.088096+0000 mgr.a (mgr.14355) 5976 : audit [DBG] from='client.137847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:05 smithi007 bash[22722]: audit 2024-09-14T00:39:04.088096+0000 mgr.a (mgr.14355) 5976 : audit [DBG] from='client.137847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:06 smithi131 bash[24745]: cluster 2024-09-14T00:39:05.618713+0000 mgr.a (mgr.14355) 5977 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:06 smithi171 bash[25040]: cluster 2024-09-14T00:39:05.618713+0000 mgr.a (mgr.14355) 5977 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:06 smithi007 bash[22722]: cluster 2024-09-14T00:39:05.618713+0000 mgr.a (mgr.14355) 5977 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:08 smithi131 bash[24745]: cluster 2024-09-14T00:39:07.619479+0000 mgr.a (mgr.14355) 5978 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:08 smithi171 bash[25040]: cluster 2024-09-14T00:39:07.619479+0000 mgr.a (mgr.14355) 5978 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:08 smithi007 bash[22722]: cluster 2024-09-14T00:39:07.619479+0000 mgr.a (mgr.14355) 5978 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:09.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:09.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:09.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:10.282 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:10.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:10.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:10.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:10.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:10 smithi131 bash[24745]: cluster 2024-09-14T00:39:09.620010+0000 mgr.a (mgr.14355) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:10 smithi131 bash[24745]: audit 2024-09-14T00:39:09.861506+0000 mgr.a (mgr.14355) 5980 : audit [DBG] from='client.137922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:10 smithi171 bash[25040]: cluster 2024-09-14T00:39:09.620010+0000 mgr.a (mgr.14355) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:10 smithi171 bash[25040]: audit 2024-09-14T00:39:09.861506+0000 mgr.a (mgr.14355) 5980 : audit [DBG] from='client.137922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:10 smithi007 bash[22722]: cluster 2024-09-14T00:39:09.620010+0000 mgr.a (mgr.14355) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:10 smithi007 bash[22722]: audit 2024-09-14T00:39:09.861506+0000 mgr.a (mgr.14355) 5980 : audit [DBG] from='client.137922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:12 smithi131 bash[24745]: cluster 2024-09-14T00:39:11.622770+0000 mgr.a (mgr.14355) 5981 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:39:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:12 smithi171 bash[25040]: cluster 2024-09-14T00:39:11.622770+0000 mgr.a (mgr.14355) 5981 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:39:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:12 smithi007 bash[22722]: cluster 2024-09-14T00:39:11.622770+0000 mgr.a (mgr.14355) 5981 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:39:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:14 smithi131 bash[24745]: cluster 2024-09-14T00:39:13.623522+0000 mgr.a (mgr.14355) 5982 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:39:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:14 smithi171 bash[25040]: cluster 2024-09-14T00:39:13.623522+0000 mgr.a (mgr.14355) 5982 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:39:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:14 smithi007 bash[22722]: cluster 2024-09-14T00:39:13.623522+0000 mgr.a (mgr.14355) 5982 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:39:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:16.027 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:16.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:16.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:16.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:16.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:16 smithi131 bash[24745]: audit 2024-09-14T00:39:15.610879+0000 mgr.a (mgr.14355) 5983 : audit [DBG] from='client.137997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:17.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:16 smithi131 bash[24745]: cluster 2024-09-14T00:39:15.631470+0000 mgr.a (mgr.14355) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:16 smithi171 bash[25040]: audit 2024-09-14T00:39:15.610879+0000 mgr.a (mgr.14355) 5983 : audit [DBG] from='client.137997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:16 smithi171 bash[25040]: cluster 2024-09-14T00:39:15.631470+0000 mgr.a (mgr.14355) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:16 smithi007 bash[22722]: audit 2024-09-14T00:39:15.610879+0000 mgr.a (mgr.14355) 5983 : audit [DBG] from='client.137997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:16 smithi007 bash[22722]: cluster 2024-09-14T00:39:15.631470+0000 mgr.a (mgr.14355) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:17 smithi131 bash[24745]: audit 2024-09-14T00:39:17.428974+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:39:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:17 smithi171 bash[25040]: audit 2024-09-14T00:39:17.428974+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:39:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:17 smithi007 bash[22722]: audit 2024-09-14T00:39:17.428974+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:39:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:18 smithi171 bash[25040]: cluster 2024-09-14T00:39:17.632429+0000 mgr.a (mgr.14355) 5985 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:18 smithi171 bash[25040]: audit 2024-09-14T00:39:18.256401+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:39:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:18 smithi171 bash[25040]: audit 2024-09-14T00:39:18.257933+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:39:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:18 smithi171 bash[25040]: audit 2024-09-14T00:39:18.267330+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:39:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:18 smithi171 bash[25040]: audit 2024-09-14T00:39:18.269878+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:19.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22972]: debug 2024-09-14T00:39:18.981+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:39:19.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22972]: debug 2024-09-14T00:39:18.985+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:39:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22722]: cluster 2024-09-14T00:39:17.632429+0000 mgr.a (mgr.14355) 5985 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22722]: audit 2024-09-14T00:39:18.256401+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:39:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22722]: audit 2024-09-14T00:39:18.257933+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:39:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22722]: audit 2024-09-14T00:39:18.267330+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:39:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:18 smithi007 bash[22722]: audit 2024-09-14T00:39:18.269878+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:18 smithi131 bash[24745]: cluster 2024-09-14T00:39:17.632429+0000 mgr.a (mgr.14355) 5985 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:18 smithi131 bash[24745]: audit 2024-09-14T00:39:18.256401+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:39:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:18 smithi131 bash[24745]: audit 2024-09-14T00:39:18.257933+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:39:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:18 smithi131 bash[24745]: audit 2024-09-14T00:39:18.267330+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:39:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:18 smithi131 bash[24745]: audit 2024-09-14T00:39:18.269878+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:19 smithi171 bash[25040]: audit 2024-09-14T00:39:18.272338+0000 mgr.a (mgr.14355) 5986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:19 smithi007 bash[22722]: audit 2024-09-14T00:39:18.272338+0000 mgr.a (mgr.14355) 5986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:19 smithi131 bash[24745]: audit 2024-09-14T00:39:18.272338+0000 mgr.a (mgr.14355) 5986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:39:21.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:21.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:21.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:20 smithi007 bash[22722]: audit 2024-09-14T00:39:18.985460+0000 mgr.a (mgr.14355) 5987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:39:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:20 smithi007 bash[22722]: cephadm 2024-09-14T00:39:18.986779+0000 mgr.a (mgr.14355) 5988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:39:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:20 smithi007 bash[22722]: cluster 2024-09-14T00:39:19.633387+0000 mgr.a (mgr.14355) 5989 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:20 smithi131 bash[24745]: audit 2024-09-14T00:39:18.985460+0000 mgr.a (mgr.14355) 5987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:39:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:20 smithi131 bash[24745]: cephadm 2024-09-14T00:39:18.986779+0000 mgr.a (mgr.14355) 5988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:39:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:20 smithi131 bash[24745]: cluster 2024-09-14T00:39:19.633387+0000 mgr.a (mgr.14355) 5989 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:20 smithi171 bash[25040]: audit 2024-09-14T00:39:18.985460+0000 mgr.a (mgr.14355) 5987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:39:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:20 smithi171 bash[25040]: cephadm 2024-09-14T00:39:18.986779+0000 mgr.a (mgr.14355) 5988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:39:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:20 smithi171 bash[25040]: cluster 2024-09-14T00:39:19.633387+0000 mgr.a (mgr.14355) 5989 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:21.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:22 smithi007 bash[22722]: audit 2024-09-14T00:39:21.358978+0000 mgr.a (mgr.14355) 5990 : audit [DBG] from='client.138180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:22 smithi007 bash[22722]: cluster 2024-09-14T00:39:21.634987+0000 mgr.a (mgr.14355) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:22 smithi131 bash[24745]: audit 2024-09-14T00:39:21.358978+0000 mgr.a (mgr.14355) 5990 : audit [DBG] from='client.138180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:22 smithi131 bash[24745]: cluster 2024-09-14T00:39:21.634987+0000 mgr.a (mgr.14355) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:22 smithi171 bash[25040]: audit 2024-09-14T00:39:21.358978+0000 mgr.a (mgr.14355) 5990 : audit [DBG] from='client.138180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:22 smithi171 bash[25040]: cluster 2024-09-14T00:39:21.634987+0000 mgr.a (mgr.14355) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:24 smithi007 bash[22722]: cluster 2024-09-14T00:39:23.635859+0000 mgr.a (mgr.14355) 5992 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:39:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:24 smithi131 bash[24745]: cluster 2024-09-14T00:39:23.635859+0000 mgr.a (mgr.14355) 5992 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:39:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:24 smithi171 bash[25040]: cluster 2024-09-14T00:39:23.635859+0000 mgr.a (mgr.14355) 5992 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:39:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:26 smithi007 bash[22722]: cluster 2024-09-14T00:39:25.638024+0000 mgr.a (mgr.14355) 5993 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:26 smithi131 bash[24745]: cluster 2024-09-14T00:39:25.638024+0000 mgr.a (mgr.14355) 5993 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:26 smithi171 bash[25040]: cluster 2024-09-14T00:39:25.638024+0000 mgr.a (mgr.14355) 5993 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:27.520 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:28 smithi007 bash[22722]: audit 2024-09-14T00:39:27.112603+0000 mgr.a (mgr.14355) 5994 : audit [DBG] from='client.138255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:28 smithi007 bash[22722]: cluster 2024-09-14T00:39:27.638987+0000 mgr.a (mgr.14355) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:28 smithi131 bash[24745]: audit 2024-09-14T00:39:27.112603+0000 mgr.a (mgr.14355) 5994 : audit [DBG] from='client.138255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:28 smithi131 bash[24745]: cluster 2024-09-14T00:39:27.638987+0000 mgr.a (mgr.14355) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:28 smithi171 bash[25040]: audit 2024-09-14T00:39:27.112603+0000 mgr.a (mgr.14355) 5994 : audit [DBG] from='client.138255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:28 smithi171 bash[25040]: cluster 2024-09-14T00:39:27.638987+0000 mgr.a (mgr.14355) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:30 smithi007 bash[22722]: cluster 2024-09-14T00:39:29.639832+0000 mgr.a (mgr.14355) 5996 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:30 smithi131 bash[24745]: cluster 2024-09-14T00:39:29.639832+0000 mgr.a (mgr.14355) 5996 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:30 smithi171 bash[25040]: cluster 2024-09-14T00:39:29.639832+0000 mgr.a (mgr.14355) 5996 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:32 smithi007 bash[22722]: cluster 2024-09-14T00:39:31.642078+0000 mgr.a (mgr.14355) 5997 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:32 smithi131 bash[24745]: cluster 2024-09-14T00:39:31.642078+0000 mgr.a (mgr.14355) 5997 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:32 smithi171 bash[25040]: cluster 2024-09-14T00:39:31.642078+0000 mgr.a (mgr.14355) 5997 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:39:33.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:33.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:33.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:33.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:33.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:33 smithi007 bash[22722]: audit 2024-09-14T00:39:32.860843+0000 mgr.a (mgr.14355) 5998 : audit [DBG] from='client.138333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:33 smithi131 bash[24745]: audit 2024-09-14T00:39:32.860843+0000 mgr.a (mgr.14355) 5998 : audit [DBG] from='client.138333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:33 smithi171 bash[25040]: audit 2024-09-14T00:39:32.860843+0000 mgr.a (mgr.14355) 5998 : audit [DBG] from='client.138333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:34 smithi007 bash[22722]: cluster 2024-09-14T00:39:33.643187+0000 mgr.a (mgr.14355) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:34 smithi131 bash[24745]: cluster 2024-09-14T00:39:33.643187+0000 mgr.a (mgr.14355) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:34 smithi171 bash[25040]: cluster 2024-09-14T00:39:33.643187+0000 mgr.a (mgr.14355) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:36 smithi007 bash[22722]: cluster 2024-09-14T00:39:35.645389+0000 mgr.a (mgr.14355) 6000 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:36 smithi131 bash[24745]: cluster 2024-09-14T00:39:35.645389+0000 mgr.a (mgr.14355) 6000 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:36 smithi171 bash[25040]: cluster 2024-09-14T00:39:35.645389+0000 mgr.a (mgr.14355) 6000 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:38.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:38.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:38.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:39.089 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:39.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:38 smithi007 bash[22722]: cluster 2024-09-14T00:39:37.646324+0000 mgr.a (mgr.14355) 6001 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:38 smithi131 bash[24745]: cluster 2024-09-14T00:39:37.646324+0000 mgr.a (mgr.14355) 6001 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:38 smithi171 bash[25040]: cluster 2024-09-14T00:39:37.646324+0000 mgr.a (mgr.14355) 6001 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:39 smithi007 bash[22722]: audit 2024-09-14T00:39:38.642014+0000 mgr.a (mgr.14355) 6002 : audit [DBG] from='client.138405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:39 smithi131 bash[24745]: audit 2024-09-14T00:39:38.642014+0000 mgr.a (mgr.14355) 6002 : audit [DBG] from='client.138405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:39 smithi171 bash[25040]: audit 2024-09-14T00:39:38.642014+0000 mgr.a (mgr.14355) 6002 : audit [DBG] from='client.138405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:40 smithi007 bash[22722]: cluster 2024-09-14T00:39:39.647263+0000 mgr.a (mgr.14355) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:40 smithi131 bash[24745]: cluster 2024-09-14T00:39:39.647263+0000 mgr.a (mgr.14355) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:40 smithi171 bash[25040]: cluster 2024-09-14T00:39:39.647263+0000 mgr.a (mgr.14355) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:42 smithi007 bash[22722]: cluster 2024-09-14T00:39:41.649493+0000 mgr.a (mgr.14355) 6004 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:42 smithi131 bash[24745]: cluster 2024-09-14T00:39:41.649493+0000 mgr.a (mgr.14355) 6004 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:42 smithi171 bash[25040]: cluster 2024-09-14T00:39:41.649493+0000 mgr.a (mgr.14355) 6004 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:44.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:44.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:44.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:44 smithi007 bash[22722]: cluster 2024-09-14T00:39:43.650252+0000 mgr.a (mgr.14355) 6005 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:44 smithi131 bash[24745]: cluster 2024-09-14T00:39:43.650252+0000 mgr.a (mgr.14355) 6005 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:44 smithi171 bash[25040]: cluster 2024-09-14T00:39:43.650252+0000 mgr.a (mgr.14355) 6005 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:45 smithi007 bash[22722]: audit 2024-09-14T00:39:44.420800+0000 mgr.a (mgr.14355) 6006 : audit [DBG] from='client.138483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:45 smithi131 bash[24745]: audit 2024-09-14T00:39:44.420800+0000 mgr.a (mgr.14355) 6006 : audit [DBG] from='client.138483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:45 smithi171 bash[25040]: audit 2024-09-14T00:39:44.420800+0000 mgr.a (mgr.14355) 6006 : audit [DBG] from='client.138483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:46 smithi007 bash[22722]: cluster 2024-09-14T00:39:45.652526+0000 mgr.a (mgr.14355) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:46 smithi131 bash[24745]: cluster 2024-09-14T00:39:45.652526+0000 mgr.a (mgr.14355) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:46 smithi171 bash[25040]: cluster 2024-09-14T00:39:45.652526+0000 mgr.a (mgr.14355) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:39:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:48 smithi007 bash[22722]: cluster 2024-09-14T00:39:47.653341+0000 mgr.a (mgr.14355) 6008 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:49.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:48 smithi171 bash[25040]: cluster 2024-09-14T00:39:47.653341+0000 mgr.a (mgr.14355) 6008 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:49.298 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:48 smithi131 bash[24745]: cluster 2024-09-14T00:39:47.653341+0000 mgr.a (mgr.14355) 6008 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:50.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:50.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:50.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:50.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:50 smithi007 bash[22722]: cluster 2024-09-14T00:39:49.654116+0000 mgr.a (mgr.14355) 6009 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:50 smithi131 bash[24745]: cluster 2024-09-14T00:39:49.654116+0000 mgr.a (mgr.14355) 6009 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:50 smithi171 bash[25040]: cluster 2024-09-14T00:39:49.654116+0000 mgr.a (mgr.14355) 6009 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:51 smithi007 bash[22722]: audit 2024-09-14T00:39:50.214396+0000 mgr.a (mgr.14355) 6010 : audit [DBG] from='client.138561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:51 smithi131 bash[24745]: audit 2024-09-14T00:39:50.214396+0000 mgr.a (mgr.14355) 6010 : audit [DBG] from='client.138561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:51 smithi171 bash[25040]: audit 2024-09-14T00:39:50.214396+0000 mgr.a (mgr.14355) 6010 : audit [DBG] from='client.138561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:52 smithi007 bash[22722]: cluster 2024-09-14T00:39:51.656849+0000 mgr.a (mgr.14355) 6011 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:52 smithi131 bash[24745]: cluster 2024-09-14T00:39:51.656849+0000 mgr.a (mgr.14355) 6011 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:52 smithi171 bash[25040]: cluster 2024-09-14T00:39:51.656849+0000 mgr.a (mgr.14355) 6011 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:54 smithi007 bash[22722]: cluster 2024-09-14T00:39:53.657598+0000 mgr.a (mgr.14355) 6012 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:54 smithi131 bash[24745]: cluster 2024-09-14T00:39:53.657598+0000 mgr.a (mgr.14355) 6012 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:54 smithi171 bash[25040]: cluster 2024-09-14T00:39:53.657598+0000 mgr.a (mgr.14355) 6012 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:55.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:39:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:39:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:39:56.426 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:39:56.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:39:56.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:39:56.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:39:56.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:39:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:56 smithi007 bash[22722]: cluster 2024-09-14T00:39:55.659352+0000 mgr.a (mgr.14355) 6013 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:56 smithi131 bash[24745]: cluster 2024-09-14T00:39:55.659352+0000 mgr.a (mgr.14355) 6013 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:56 smithi171 bash[25040]: cluster 2024-09-14T00:39:55.659352+0000 mgr.a (mgr.14355) 6013 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:39:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:57 smithi007 bash[22722]: audit 2024-09-14T00:39:55.985312+0000 mgr.a (mgr.14355) 6014 : audit [DBG] from='client.138636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:57 smithi131 bash[24745]: audit 2024-09-14T00:39:55.985312+0000 mgr.a (mgr.14355) 6014 : audit [DBG] from='client.138636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:57 smithi171 bash[25040]: audit 2024-09-14T00:39:55.985312+0000 mgr.a (mgr.14355) 6014 : audit [DBG] from='client.138636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:39:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:39:58 smithi007 bash[22722]: cluster 2024-09-14T00:39:57.660243+0000 mgr.a (mgr.14355) 6015 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:39:58 smithi131 bash[24745]: cluster 2024-09-14T00:39:57.660243+0000 mgr.a (mgr.14355) 6015 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:39:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:39:58 smithi171 bash[25040]: cluster 2024-09-14T00:39:57.660243+0000 mgr.a (mgr.14355) 6015 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:40:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:00 smithi007 bash[22722]: cluster 2024-09-14T00:39:59.661000+0000 mgr.a (mgr.14355) 6016 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:00 smithi007 bash[22722]: cluster 2024-09-14T00:40:00.000154+0000 mon.a (mon.0) 1501 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:40:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:00 smithi131 bash[24745]: cluster 2024-09-14T00:39:59.661000+0000 mgr.a (mgr.14355) 6016 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:00 smithi131 bash[24745]: cluster 2024-09-14T00:40:00.000154+0000 mon.a (mon.0) 1501 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:40:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:00 smithi171 bash[25040]: cluster 2024-09-14T00:39:59.661000+0000 mgr.a (mgr.14355) 6016 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:00 smithi171 bash[25040]: cluster 2024-09-14T00:40:00.000154+0000 mon.a (mon.0) 1501 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:40:01.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:01.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:02.177 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:02.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:02.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:02.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:02.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:02 smithi007 bash[22722]: cluster 2024-09-14T00:40:01.663195+0000 mgr.a (mgr.14355) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:02 smithi007 bash[22722]: audit 2024-09-14T00:40:01.761959+0000 mgr.a (mgr.14355) 6018 : audit [DBG] from='client.138708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:02 smithi131 bash[24745]: cluster 2024-09-14T00:40:01.663195+0000 mgr.a (mgr.14355) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:03.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:02 smithi131 bash[24745]: audit 2024-09-14T00:40:01.761959+0000 mgr.a (mgr.14355) 6018 : audit [DBG] from='client.138708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:02 smithi171 bash[25040]: cluster 2024-09-14T00:40:01.663195+0000 mgr.a (mgr.14355) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:02 smithi171 bash[25040]: audit 2024-09-14T00:40:01.761959+0000 mgr.a (mgr.14355) 6018 : audit [DBG] from='client.138708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:04 smithi007 bash[22722]: cluster 2024-09-14T00:40:03.664220+0000 mgr.a (mgr.14355) 6019 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:04 smithi131 bash[24745]: cluster 2024-09-14T00:40:03.664220+0000 mgr.a (mgr.14355) 6019 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:04 smithi171 bash[25040]: cluster 2024-09-14T00:40:03.664220+0000 mgr.a (mgr.14355) 6019 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:07.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:07.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:06 smithi007 bash[22722]: cluster 2024-09-14T00:40:05.666435+0000 mgr.a (mgr.14355) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:06 smithi131 bash[24745]: cluster 2024-09-14T00:40:05.666435+0000 mgr.a (mgr.14355) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:06 smithi171 bash[25040]: cluster 2024-09-14T00:40:05.666435+0000 mgr.a (mgr.14355) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:07.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:07.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:08 smithi007 bash[22722]: audit 2024-09-14T00:40:07.505776+0000 mgr.a (mgr.14355) 6021 : audit [DBG] from='client.138783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:08 smithi007 bash[22722]: cluster 2024-09-14T00:40:07.667007+0000 mgr.a (mgr.14355) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:08 smithi131 bash[24745]: audit 2024-09-14T00:40:07.505776+0000 mgr.a (mgr.14355) 6021 : audit [DBG] from='client.138783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:08 smithi131 bash[24745]: cluster 2024-09-14T00:40:07.667007+0000 mgr.a (mgr.14355) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:08 smithi171 bash[25040]: audit 2024-09-14T00:40:07.505776+0000 mgr.a (mgr.14355) 6021 : audit [DBG] from='client.138783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:08 smithi171 bash[25040]: cluster 2024-09-14T00:40:07.667007+0000 mgr.a (mgr.14355) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:10 smithi007 bash[22722]: cluster 2024-09-14T00:40:09.667896+0000 mgr.a (mgr.14355) 6023 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:10 smithi131 bash[24745]: cluster 2024-09-14T00:40:09.667896+0000 mgr.a (mgr.14355) 6023 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:10 smithi171 bash[25040]: cluster 2024-09-14T00:40:09.667896+0000 mgr.a (mgr.14355) 6023 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:11 smithi131 bash[24745]: cluster 2024-09-14T00:40:11.670152+0000 mgr.a (mgr.14355) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:11 smithi171 bash[25040]: cluster 2024-09-14T00:40:11.670152+0000 mgr.a (mgr.14355) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:11 smithi007 bash[22722]: cluster 2024-09-14T00:40:11.670152+0000 mgr.a (mgr.14355) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:12.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:12.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:13.686 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:13.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:13.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:13.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:13.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:14 smithi131 bash[24745]: audit 2024-09-14T00:40:13.246854+0000 mgr.a (mgr.14355) 6025 : audit [DBG] from='client.138858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:14 smithi131 bash[24745]: cluster 2024-09-14T00:40:13.670666+0000 mgr.a (mgr.14355) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:14 smithi171 bash[25040]: audit 2024-09-14T00:40:13.246854+0000 mgr.a (mgr.14355) 6025 : audit [DBG] from='client.138858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:14 smithi171 bash[25040]: cluster 2024-09-14T00:40:13.670666+0000 mgr.a (mgr.14355) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:14 smithi007 bash[22722]: audit 2024-09-14T00:40:13.246854+0000 mgr.a (mgr.14355) 6025 : audit [DBG] from='client.138858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:14 smithi007 bash[22722]: cluster 2024-09-14T00:40:13.670666+0000 mgr.a (mgr.14355) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:16 smithi131 bash[24745]: cluster 2024-09-14T00:40:15.672902+0000 mgr.a (mgr.14355) 6027 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:17.050 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:16 smithi171 bash[25040]: cluster 2024-09-14T00:40:15.672902+0000 mgr.a (mgr.14355) 6027 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:16 smithi007 bash[22722]: cluster 2024-09-14T00:40:15.672902+0000 mgr.a (mgr.14355) 6027 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:18.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:18 smithi131 bash[24745]: cluster 2024-09-14T00:40:17.673831+0000 mgr.a (mgr.14355) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:18 smithi171 bash[25040]: cluster 2024-09-14T00:40:17.673831+0000 mgr.a (mgr.14355) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:18 smithi007 bash[22722]: cluster 2024-09-14T00:40:17.673831+0000 mgr.a (mgr.14355) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:19.445 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:19 smithi131 bash[24745]: audit 2024-09-14T00:40:19.040358+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:40:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:19 smithi171 bash[25040]: audit 2024-09-14T00:40:19.040358+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:40:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:19 smithi007 bash[22722]: audit 2024-09-14T00:40:19.040358+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:40:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22972]: debug 2024-09-14T00:40:20.608+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:40:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22972]: debug 2024-09-14T00:40:20.612+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.021265+0000 mgr.a (mgr.14355) 6029 : audit [DBG] from='client.138933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: cluster 2024-09-14T00:40:19.674474+0000 mgr.a (mgr.14355) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.869608+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.871565+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.882278+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.884900+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:20 smithi007 bash[22722]: audit 2024-09-14T00:40:19.887492+0000 mgr.a (mgr.14355) 6031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.021265+0000 mgr.a (mgr.14355) 6029 : audit [DBG] from='client.138933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: cluster 2024-09-14T00:40:19.674474+0000 mgr.a (mgr.14355) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.869608+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:40:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.871565+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:40:21.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.882278+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:40:21.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.884900+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:21.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:20 smithi131 bash[24745]: audit 2024-09-14T00:40:19.887492+0000 mgr.a (mgr.14355) 6031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.021265+0000 mgr.a (mgr.14355) 6029 : audit [DBG] from='client.138933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: cluster 2024-09-14T00:40:19.674474+0000 mgr.a (mgr.14355) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.869608+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:40:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.871565+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:40:21.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.882278+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:40:21.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.884900+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:21.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:20 smithi171 bash[25040]: audit 2024-09-14T00:40:19.887492+0000 mgr.a (mgr.14355) 6031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:40:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:21 smithi131 bash[24745]: audit 2024-09-14T00:40:20.613094+0000 mgr.a (mgr.14355) 6032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:40:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:21 smithi131 bash[24745]: cephadm 2024-09-14T00:40:20.614557+0000 mgr.a (mgr.14355) 6033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:40:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:21 smithi171 bash[25040]: audit 2024-09-14T00:40:20.613094+0000 mgr.a (mgr.14355) 6032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:40:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:21 smithi171 bash[25040]: cephadm 2024-09-14T00:40:20.614557+0000 mgr.a (mgr.14355) 6033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:40:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:21 smithi007 bash[22722]: audit 2024-09-14T00:40:20.613094+0000 mgr.a (mgr.14355) 6032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:40:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:21 smithi007 bash[22722]: cephadm 2024-09-14T00:40:20.614557+0000 mgr.a (mgr.14355) 6033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:40:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:22 smithi131 bash[24745]: cluster 2024-09-14T00:40:21.677248+0000 mgr.a (mgr.14355) 6034 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:40:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:22 smithi171 bash[25040]: cluster 2024-09-14T00:40:21.677248+0000 mgr.a (mgr.14355) 6034 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:40:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:22 smithi007 bash[22722]: cluster 2024-09-14T00:40:21.677248+0000 mgr.a (mgr.14355) 6034 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T00:40:24.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:24 smithi131 bash[24745]: cluster 2024-09-14T00:40:23.678201+0000 mgr.a (mgr.14355) 6035 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:40:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:24 smithi171 bash[25040]: cluster 2024-09-14T00:40:23.678201+0000 mgr.a (mgr.14355) 6035 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:40:25.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:25.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:25.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:24 smithi007 bash[22722]: cluster 2024-09-14T00:40:23.678201+0000 mgr.a (mgr.14355) 6035 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T00:40:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:25 smithi131 bash[24745]: audit 2024-09-14T00:40:24.781650+0000 mgr.a (mgr.14355) 6036 : audit [DBG] from='client.139110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:25 smithi171 bash[25040]: audit 2024-09-14T00:40:24.781650+0000 mgr.a (mgr.14355) 6036 : audit [DBG] from='client.139110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:25 smithi007 bash[22722]: audit 2024-09-14T00:40:24.781650+0000 mgr.a (mgr.14355) 6036 : audit [DBG] from='client.139110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:26 smithi131 bash[24745]: cluster 2024-09-14T00:40:25.680558+0000 mgr.a (mgr.14355) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:26 smithi171 bash[25040]: cluster 2024-09-14T00:40:25.680558+0000 mgr.a (mgr.14355) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:26 smithi007 bash[22722]: cluster 2024-09-14T00:40:25.680558+0000 mgr.a (mgr.14355) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:28 smithi131 bash[24745]: cluster 2024-09-14T00:40:27.681324+0000 mgr.a (mgr.14355) 6038 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:28 smithi171 bash[25040]: cluster 2024-09-14T00:40:27.681324+0000 mgr.a (mgr.14355) 6038 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:28 smithi007 bash[22722]: cluster 2024-09-14T00:40:27.681324+0000 mgr.a (mgr.14355) 6038 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:30.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:30.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:30 smithi131 bash[24745]: cluster 2024-09-14T00:40:29.682091+0000 mgr.a (mgr.14355) 6039 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:30 smithi171 bash[25040]: cluster 2024-09-14T00:40:29.682091+0000 mgr.a (mgr.14355) 6039 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:30 smithi007 bash[22722]: cluster 2024-09-14T00:40:29.682091+0000 mgr.a (mgr.14355) 6039 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:31 smithi131 bash[24745]: audit 2024-09-14T00:40:30.528388+0000 mgr.a (mgr.14355) 6040 : audit [DBG] from='client.139188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:31 smithi171 bash[25040]: audit 2024-09-14T00:40:30.528388+0000 mgr.a (mgr.14355) 6040 : audit [DBG] from='client.139188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:31 smithi007 bash[22722]: audit 2024-09-14T00:40:30.528388+0000 mgr.a (mgr.14355) 6040 : audit [DBG] from='client.139188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:32 smithi131 bash[24745]: cluster 2024-09-14T00:40:31.684887+0000 mgr.a (mgr.14355) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:32 smithi171 bash[25040]: cluster 2024-09-14T00:40:31.684887+0000 mgr.a (mgr.14355) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:32 smithi007 bash[22722]: cluster 2024-09-14T00:40:31.684887+0000 mgr.a (mgr.14355) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:40:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:34 smithi171 bash[25040]: cluster 2024-09-14T00:40:33.685684+0000 mgr.a (mgr.14355) 6042 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:40:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:34 smithi007 bash[22722]: cluster 2024-09-14T00:40:33.685684+0000 mgr.a (mgr.14355) 6042 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:40:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:34 smithi131 bash[24745]: cluster 2024-09-14T00:40:33.685684+0000 mgr.a (mgr.14355) 6042 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T00:40:35.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:35.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:35.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:36.737 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:36.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:36 smithi171 bash[25040]: cluster 2024-09-14T00:40:35.687655+0000 mgr.a (mgr.14355) 6043 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:40:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:36 smithi007 bash[22722]: cluster 2024-09-14T00:40:35.687655+0000 mgr.a (mgr.14355) 6043 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:40:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:36 smithi131 bash[24745]: cluster 2024-09-14T00:40:35.687655+0000 mgr.a (mgr.14355) 6043 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T00:40:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:37 smithi007 bash[22722]: audit 2024-09-14T00:40:36.303124+0000 mgr.a (mgr.14355) 6044 : audit [DBG] from='client.139266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:37 smithi131 bash[24745]: audit 2024-09-14T00:40:36.303124+0000 mgr.a (mgr.14355) 6044 : audit [DBG] from='client.139266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:37 smithi171 bash[25040]: audit 2024-09-14T00:40:36.303124+0000 mgr.a (mgr.14355) 6044 : audit [DBG] from='client.139266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:38 smithi007 bash[22722]: cluster 2024-09-14T00:40:37.688497+0000 mgr.a (mgr.14355) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:40:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:38 smithi131 bash[24745]: cluster 2024-09-14T00:40:37.688497+0000 mgr.a (mgr.14355) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:40:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:38 smithi171 bash[25040]: cluster 2024-09-14T00:40:37.688497+0000 mgr.a (mgr.14355) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:40:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:40 smithi007 bash[22722]: cluster 2024-09-14T00:40:39.689289+0000 mgr.a (mgr.14355) 6046 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:40 smithi131 bash[24745]: cluster 2024-09-14T00:40:39.689289+0000 mgr.a (mgr.14355) 6046 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:40 smithi171 bash[25040]: cluster 2024-09-14T00:40:39.689289+0000 mgr.a (mgr.14355) 6046 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:40:41.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:41.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:42.491 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:42.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:42.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:42.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:42.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:42 smithi007 bash[22722]: cluster 2024-09-14T00:40:41.691630+0000 mgr.a (mgr.14355) 6047 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:42 smithi131 bash[24745]: cluster 2024-09-14T00:40:41.691630+0000 mgr.a (mgr.14355) 6047 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:42 smithi171 bash[25040]: cluster 2024-09-14T00:40:41.691630+0000 mgr.a (mgr.14355) 6047 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:43 smithi007 bash[22722]: audit 2024-09-14T00:40:42.075540+0000 mgr.a (mgr.14355) 6048 : audit [DBG] from='client.139341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:43 smithi131 bash[24745]: audit 2024-09-14T00:40:42.075540+0000 mgr.a (mgr.14355) 6048 : audit [DBG] from='client.139341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:43 smithi171 bash[25040]: audit 2024-09-14T00:40:42.075540+0000 mgr.a (mgr.14355) 6048 : audit [DBG] from='client.139341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:44 smithi007 bash[22722]: cluster 2024-09-14T00:40:43.692573+0000 mgr.a (mgr.14355) 6049 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:44 smithi131 bash[24745]: cluster 2024-09-14T00:40:43.692573+0000 mgr.a (mgr.14355) 6049 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:44 smithi171 bash[25040]: cluster 2024-09-14T00:40:43.692573+0000 mgr.a (mgr.14355) 6049 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:46 smithi007 bash[22722]: cluster 2024-09-14T00:40:45.694766+0000 mgr.a (mgr.14355) 6050 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:46 smithi131 bash[24745]: cluster 2024-09-14T00:40:45.694766+0000 mgr.a (mgr.14355) 6050 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:46 smithi171 bash[25040]: cluster 2024-09-14T00:40:45.694766+0000 mgr.a (mgr.14355) 6050 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:47.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:48.237 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:48.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:48 smithi007 bash[22722]: cluster 2024-09-14T00:40:47.695529+0000 mgr.a (mgr.14355) 6051 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:48 smithi007 bash[22722]: audit 2024-09-14T00:40:47.822741+0000 mgr.a (mgr.14355) 6052 : audit [DBG] from='client.139416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:48 smithi131 bash[24745]: cluster 2024-09-14T00:40:47.695529+0000 mgr.a (mgr.14355) 6051 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:48 smithi131 bash[24745]: audit 2024-09-14T00:40:47.822741+0000 mgr.a (mgr.14355) 6052 : audit [DBG] from='client.139416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:48 smithi171 bash[25040]: cluster 2024-09-14T00:40:47.695529+0000 mgr.a (mgr.14355) 6051 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:48 smithi171 bash[25040]: audit 2024-09-14T00:40:47.822741+0000 mgr.a (mgr.14355) 6052 : audit [DBG] from='client.139416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:50 smithi007 bash[22722]: cluster 2024-09-14T00:40:49.696390+0000 mgr.a (mgr.14355) 6053 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:50 smithi131 bash[24745]: cluster 2024-09-14T00:40:49.696390+0000 mgr.a (mgr.14355) 6053 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:50 smithi171 bash[25040]: cluster 2024-09-14T00:40:49.696390+0000 mgr.a (mgr.14355) 6053 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:52 smithi007 bash[22722]: cluster 2024-09-14T00:40:51.698669+0000 mgr.a (mgr.14355) 6054 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:52 smithi131 bash[24745]: cluster 2024-09-14T00:40:51.698669+0000 mgr.a (mgr.14355) 6054 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:52 smithi171 bash[25040]: cluster 2024-09-14T00:40:51.698669+0000 mgr.a (mgr.14355) 6054 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:54.015 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:40:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:54 smithi007 bash[22722]: audit 2024-09-14T00:40:53.575373+0000 mgr.a (mgr.14355) 6055 : audit [DBG] from='client.139491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:54 smithi007 bash[22722]: cluster 2024-09-14T00:40:53.699210+0000 mgr.a (mgr.14355) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:54 smithi131 bash[24745]: audit 2024-09-14T00:40:53.575373+0000 mgr.a (mgr.14355) 6055 : audit [DBG] from='client.139491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:54 smithi131 bash[24745]: cluster 2024-09-14T00:40:53.699210+0000 mgr.a (mgr.14355) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:54 smithi171 bash[25040]: audit 2024-09-14T00:40:53.575373+0000 mgr.a (mgr.14355) 6055 : audit [DBG] from='client.139491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:40:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:54 smithi171 bash[25040]: cluster 2024-09-14T00:40:53.699210+0000 mgr.a (mgr.14355) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:56 smithi007 bash[22722]: cluster 2024-09-14T00:40:55.701467+0000 mgr.a (mgr.14355) 6057 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:56 smithi131 bash[24745]: cluster 2024-09-14T00:40:55.701467+0000 mgr.a (mgr.14355) 6057 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:56 smithi171 bash[25040]: cluster 2024-09-14T00:40:55.701467+0000 mgr.a (mgr.14355) 6057 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:40:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:40:59.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:40:59.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:40:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:40:58 smithi007 bash[22722]: cluster 2024-09-14T00:40:57.702189+0000 mgr.a (mgr.14355) 6058 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:40:58 smithi131 bash[24745]: cluster 2024-09-14T00:40:57.702189+0000 mgr.a (mgr.14355) 6058 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:40:58 smithi171 bash[25040]: cluster 2024-09-14T00:40:57.702189+0000 mgr.a (mgr.14355) 6058 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:40:59.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:40:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:40:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:40:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:40:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:00 smithi007 bash[22722]: audit 2024-09-14T00:40:59.342909+0000 mgr.a (mgr.14355) 6059 : audit [DBG] from='client.139569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:00 smithi007 bash[22722]: cluster 2024-09-14T00:40:59.702639+0000 mgr.a (mgr.14355) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:00 smithi131 bash[24745]: audit 2024-09-14T00:40:59.342909+0000 mgr.a (mgr.14355) 6059 : audit [DBG] from='client.139569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:01.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:00 smithi131 bash[24745]: cluster 2024-09-14T00:40:59.702639+0000 mgr.a (mgr.14355) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:00 smithi171 bash[25040]: audit 2024-09-14T00:40:59.342909+0000 mgr.a (mgr.14355) 6059 : audit [DBG] from='client.139569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:00 smithi171 bash[25040]: cluster 2024-09-14T00:40:59.702639+0000 mgr.a (mgr.14355) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:02 smithi007 bash[22722]: cluster 2024-09-14T00:41:01.704809+0000 mgr.a (mgr.14355) 6061 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:02 smithi131 bash[24745]: cluster 2024-09-14T00:41:01.704809+0000 mgr.a (mgr.14355) 6061 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:02 smithi171 bash[25040]: cluster 2024-09-14T00:41:01.704809+0000 mgr.a (mgr.14355) 6061 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:04.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:04.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:04 smithi007 bash[22722]: cluster 2024-09-14T00:41:03.705586+0000 mgr.a (mgr.14355) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:04 smithi131 bash[24745]: cluster 2024-09-14T00:41:03.705586+0000 mgr.a (mgr.14355) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:04 smithi171 bash[25040]: cluster 2024-09-14T00:41:03.705586+0000 mgr.a (mgr.14355) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:05.551 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:05.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:05.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:05.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:05.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:06 smithi007 bash[22722]: audit 2024-09-14T00:41:05.110569+0000 mgr.a (mgr.14355) 6063 : audit [DBG] from='client.139647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:06 smithi007 bash[22722]: cluster 2024-09-14T00:41:05.708422+0000 mgr.a (mgr.14355) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:06 smithi131 bash[24745]: audit 2024-09-14T00:41:05.110569+0000 mgr.a (mgr.14355) 6063 : audit [DBG] from='client.139647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:06 smithi131 bash[24745]: cluster 2024-09-14T00:41:05.708422+0000 mgr.a (mgr.14355) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:06 smithi171 bash[25040]: audit 2024-09-14T00:41:05.110569+0000 mgr.a (mgr.14355) 6063 : audit [DBG] from='client.139647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:06 smithi171 bash[25040]: cluster 2024-09-14T00:41:05.708422+0000 mgr.a (mgr.14355) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:08 smithi007 bash[22722]: cluster 2024-09-14T00:41:07.709215+0000 mgr.a (mgr.14355) 6065 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:08 smithi131 bash[24745]: cluster 2024-09-14T00:41:07.709215+0000 mgr.a (mgr.14355) 6065 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:08 smithi171 bash[25040]: cluster 2024-09-14T00:41:07.709215+0000 mgr.a (mgr.14355) 6065 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:10.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:10.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:10.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:10 smithi007 bash[22722]: cluster 2024-09-14T00:41:09.710029+0000 mgr.a (mgr.14355) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:10 smithi131 bash[24745]: cluster 2024-09-14T00:41:09.710029+0000 mgr.a (mgr.14355) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:10 smithi171 bash[25040]: cluster 2024-09-14T00:41:09.710029+0000 mgr.a (mgr.14355) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:11.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:11.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:11.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:11.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:11.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:11 smithi007 bash[22722]: audit 2024-09-14T00:41:10.889059+0000 mgr.a (mgr.14355) 6067 : audit [DBG] from='client.139725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:11 smithi131 bash[24745]: audit 2024-09-14T00:41:10.889059+0000 mgr.a (mgr.14355) 6067 : audit [DBG] from='client.139725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:11 smithi171 bash[25040]: audit 2024-09-14T00:41:10.889059+0000 mgr.a (mgr.14355) 6067 : audit [DBG] from='client.139725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:12 smithi007 bash[22722]: cluster 2024-09-14T00:41:11.712960+0000 mgr.a (mgr.14355) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:12 smithi131 bash[24745]: cluster 2024-09-14T00:41:11.712960+0000 mgr.a (mgr.14355) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:12 smithi171 bash[25040]: cluster 2024-09-14T00:41:11.712960+0000 mgr.a (mgr.14355) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:14 smithi007 bash[22722]: cluster 2024-09-14T00:41:13.713814+0000 mgr.a (mgr.14355) 6069 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:14 smithi131 bash[24745]: cluster 2024-09-14T00:41:13.713814+0000 mgr.a (mgr.14355) 6069 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:14 smithi171 bash[25040]: cluster 2024-09-14T00:41:13.713814+0000 mgr.a (mgr.14355) 6069 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:17.106 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:17.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:16 smithi007 bash[22722]: cluster 2024-09-14T00:41:15.715812+0000 mgr.a (mgr.14355) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:16 smithi131 bash[24745]: cluster 2024-09-14T00:41:15.715812+0000 mgr.a (mgr.14355) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:16 smithi171 bash[25040]: cluster 2024-09-14T00:41:15.715812+0000 mgr.a (mgr.14355) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:17 smithi007 bash[22722]: audit 2024-09-14T00:41:16.663756+0000 mgr.a (mgr.14355) 6071 : audit [DBG] from='client.139800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:17 smithi131 bash[24745]: audit 2024-09-14T00:41:16.663756+0000 mgr.a (mgr.14355) 6071 : audit [DBG] from='client.139800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:17 smithi171 bash[25040]: audit 2024-09-14T00:41:16.663756+0000 mgr.a (mgr.14355) 6071 : audit [DBG] from='client.139800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:18 smithi007 bash[22722]: cluster 2024-09-14T00:41:17.716945+0000 mgr.a (mgr.14355) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:18 smithi131 bash[24745]: cluster 2024-09-14T00:41:17.716945+0000 mgr.a (mgr.14355) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:18 smithi171 bash[25040]: cluster 2024-09-14T00:41:17.716945+0000 mgr.a (mgr.14355) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:20 smithi007 bash[22722]: cluster 2024-09-14T00:41:19.717782+0000 mgr.a (mgr.14355) 6073 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:20 smithi007 bash[22722]: audit 2024-09-14T00:41:20.665272+0000 mon.a (mon.0) 1507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:41:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:20 smithi131 bash[24745]: cluster 2024-09-14T00:41:19.717782+0000 mgr.a (mgr.14355) 6073 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:20 smithi131 bash[24745]: audit 2024-09-14T00:41:20.665272+0000 mon.a (mon.0) 1507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:41:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:20 smithi171 bash[25040]: cluster 2024-09-14T00:41:19.717782+0000 mgr.a (mgr.14355) 6073 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:20 smithi171 bash[25040]: audit 2024-09-14T00:41:20.665272+0000 mon.a (mon.0) 1507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:41:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:22.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:21 smithi007 bash[22722]: audit 2024-09-14T00:41:21.488037+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:41:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:21 smithi007 bash[22722]: audit 2024-09-14T00:41:21.489517+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:41:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:21 smithi007 bash[22722]: audit 2024-09-14T00:41:21.496381+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:41:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:21 smithi007 bash[22722]: audit 2024-09-14T00:41:21.501044+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:21 smithi131 bash[24745]: audit 2024-09-14T00:41:21.488037+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:41:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:21 smithi131 bash[24745]: audit 2024-09-14T00:41:21.489517+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:41:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:21 smithi131 bash[24745]: audit 2024-09-14T00:41:21.496381+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:41:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:21 smithi131 bash[24745]: audit 2024-09-14T00:41:21.501044+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:21 smithi171 bash[25040]: audit 2024-09-14T00:41:21.488037+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:41:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:21 smithi171 bash[25040]: audit 2024-09-14T00:41:21.489517+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:41:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:21 smithi171 bash[25040]: audit 2024-09-14T00:41:21.496381+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:41:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:21 smithi171 bash[25040]: audit 2024-09-14T00:41:21.501044+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:22.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:41:22 smithi007 bash[22972]: debug 2024-09-14T00:41:22.207+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:41:22.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:41:22 smithi007 bash[22972]: debug 2024-09-14T00:41:22.207+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:41:22.809 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:22.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:22 smithi007 bash[22722]: audit 2024-09-14T00:41:21.503269+0000 mgr.a (mgr.14355) 6074 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:22 smithi007 bash[22722]: cluster 2024-09-14T00:41:21.719591+0000 mgr.a (mgr.14355) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:22 smithi131 bash[24745]: audit 2024-09-14T00:41:21.503269+0000 mgr.a (mgr.14355) 6074 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:22 smithi131 bash[24745]: cluster 2024-09-14T00:41:21.719591+0000 mgr.a (mgr.14355) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:22 smithi171 bash[25040]: audit 2024-09-14T00:41:21.503269+0000 mgr.a (mgr.14355) 6074 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:41:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:22 smithi171 bash[25040]: cluster 2024-09-14T00:41:21.719591+0000 mgr.a (mgr.14355) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:23 smithi007 bash[22722]: audit 2024-09-14T00:41:22.212586+0000 mgr.a (mgr.14355) 6076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:41:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:23 smithi007 bash[22722]: cephadm 2024-09-14T00:41:22.213738+0000 mgr.a (mgr.14355) 6077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:41:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:23 smithi007 bash[22722]: audit 2024-09-14T00:41:22.412126+0000 mgr.a (mgr.14355) 6078 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:23 smithi131 bash[24745]: audit 2024-09-14T00:41:22.212586+0000 mgr.a (mgr.14355) 6076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:41:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:23 smithi131 bash[24745]: cephadm 2024-09-14T00:41:22.213738+0000 mgr.a (mgr.14355) 6077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:41:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:23 smithi131 bash[24745]: audit 2024-09-14T00:41:22.412126+0000 mgr.a (mgr.14355) 6078 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:23 smithi171 bash[25040]: audit 2024-09-14T00:41:22.212586+0000 mgr.a (mgr.14355) 6076 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:41:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:23 smithi171 bash[25040]: cephadm 2024-09-14T00:41:22.213738+0000 mgr.a (mgr.14355) 6077 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:41:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:23 smithi171 bash[25040]: audit 2024-09-14T00:41:22.412126+0000 mgr.a (mgr.14355) 6078 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:24 smithi007 bash[22722]: cluster 2024-09-14T00:41:23.720543+0000 mgr.a (mgr.14355) 6079 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:24 smithi131 bash[24745]: cluster 2024-09-14T00:41:23.720543+0000 mgr.a (mgr.14355) 6079 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:24 smithi171 bash[25040]: cluster 2024-09-14T00:41:23.720543+0000 mgr.a (mgr.14355) 6079 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:26 smithi007 bash[22722]: cluster 2024-09-14T00:41:25.722747+0000 mgr.a (mgr.14355) 6080 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:26 smithi131 bash[24745]: cluster 2024-09-14T00:41:25.722747+0000 mgr.a (mgr.14355) 6080 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:26 smithi171 bash[25040]: cluster 2024-09-14T00:41:25.722747+0000 mgr.a (mgr.14355) 6080 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:27.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:27.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:28.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:28 smithi007 bash[22722]: cluster 2024-09-14T00:41:27.723532+0000 mgr.a (mgr.14355) 6081 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:28 smithi131 bash[24745]: cluster 2024-09-14T00:41:27.723532+0000 mgr.a (mgr.14355) 6081 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:28 smithi171 bash[25040]: cluster 2024-09-14T00:41:27.723532+0000 mgr.a (mgr.14355) 6081 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:29 smithi007 bash[22722]: audit 2024-09-14T00:41:28.151804+0000 mgr.a (mgr.14355) 6082 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:29 smithi131 bash[24745]: audit 2024-09-14T00:41:28.151804+0000 mgr.a (mgr.14355) 6082 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:29 smithi171 bash[25040]: audit 2024-09-14T00:41:28.151804+0000 mgr.a (mgr.14355) 6082 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:30 smithi007 bash[22722]: cluster 2024-09-14T00:41:29.724494+0000 mgr.a (mgr.14355) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:30 smithi131 bash[24745]: cluster 2024-09-14T00:41:29.724494+0000 mgr.a (mgr.14355) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:30 smithi171 bash[25040]: cluster 2024-09-14T00:41:29.724494+0000 mgr.a (mgr.14355) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:32 smithi007 bash[22722]: cluster 2024-09-14T00:41:31.726783+0000 mgr.a (mgr.14355) 6084 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:32 smithi131 bash[24745]: cluster 2024-09-14T00:41:31.726783+0000 mgr.a (mgr.14355) 6084 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:32 smithi171 bash[25040]: cluster 2024-09-14T00:41:31.726783+0000 mgr.a (mgr.14355) 6084 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:33.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:33.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:33.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:34.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:34 smithi007 bash[22722]: cluster 2024-09-14T00:41:33.727514+0000 mgr.a (mgr.14355) 6085 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:34 smithi007 bash[22722]: audit 2024-09-14T00:41:33.924521+0000 mgr.a (mgr.14355) 6086 : audit [DBG] from='client.140133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:34 smithi131 bash[24745]: cluster 2024-09-14T00:41:33.727514+0000 mgr.a (mgr.14355) 6085 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:34 smithi131 bash[24745]: audit 2024-09-14T00:41:33.924521+0000 mgr.a (mgr.14355) 6086 : audit [DBG] from='client.140133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:34 smithi171 bash[25040]: cluster 2024-09-14T00:41:33.727514+0000 mgr.a (mgr.14355) 6085 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:34 smithi171 bash[25040]: audit 2024-09-14T00:41:33.924521+0000 mgr.a (mgr.14355) 6086 : audit [DBG] from='client.140133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:36 smithi131 bash[24745]: cluster 2024-09-14T00:41:35.729840+0000 mgr.a (mgr.14355) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:36 smithi171 bash[25040]: cluster 2024-09-14T00:41:35.729840+0000 mgr.a (mgr.14355) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:36 smithi007 bash[22722]: cluster 2024-09-14T00:41:35.729840+0000 mgr.a (mgr.14355) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:41:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:38 smithi131 bash[24745]: cluster 2024-09-14T00:41:37.730624+0000 mgr.a (mgr.14355) 6088 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:38 smithi171 bash[25040]: cluster 2024-09-14T00:41:37.730624+0000 mgr.a (mgr.14355) 6088 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:38 smithi007 bash[22722]: cluster 2024-09-14T00:41:37.730624+0000 mgr.a (mgr.14355) 6088 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:40.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:39 smithi131 bash[24745]: audit 2024-09-14T00:41:39.693134+0000 mgr.a (mgr.14355) 6089 : audit [DBG] from='client.140208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:39 smithi131 bash[24745]: cluster 2024-09-14T00:41:39.731646+0000 mgr.a (mgr.14355) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:39 smithi171 bash[25040]: audit 2024-09-14T00:41:39.693134+0000 mgr.a (mgr.14355) 6089 : audit [DBG] from='client.140208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:39 smithi171 bash[25040]: cluster 2024-09-14T00:41:39.731646+0000 mgr.a (mgr.14355) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:39 smithi007 bash[22722]: audit 2024-09-14T00:41:39.693134+0000 mgr.a (mgr.14355) 6089 : audit [DBG] from='client.140208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:39 smithi007 bash[22722]: cluster 2024-09-14T00:41:39.731646+0000 mgr.a (mgr.14355) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:42 smithi171 bash[25040]: cluster 2024-09-14T00:41:41.733998+0000 mgr.a (mgr.14355) 6091 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:42 smithi007 bash[22722]: cluster 2024-09-14T00:41:41.733998+0000 mgr.a (mgr.14355) 6091 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:42 smithi131 bash[24745]: cluster 2024-09-14T00:41:41.733998+0000 mgr.a (mgr.14355) 6091 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:41:45.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:45.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:45.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:44 smithi007 bash[22722]: cluster 2024-09-14T00:41:43.734797+0000 mgr.a (mgr.14355) 6092 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:44 smithi131 bash[24745]: cluster 2024-09-14T00:41:43.734797+0000 mgr.a (mgr.14355) 6092 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:44 smithi171 bash[25040]: cluster 2024-09-14T00:41:43.734797+0000 mgr.a (mgr.14355) 6092 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:45.877 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:45.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:45.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:45.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:45.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:46 smithi007 bash[22722]: audit 2024-09-14T00:41:45.464450+0000 mgr.a (mgr.14355) 6093 : audit [DBG] from='client.140286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:46 smithi007 bash[22722]: cluster 2024-09-14T00:41:45.736218+0000 mgr.a (mgr.14355) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:46 smithi131 bash[24745]: audit 2024-09-14T00:41:45.464450+0000 mgr.a (mgr.14355) 6093 : audit [DBG] from='client.140286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:46 smithi131 bash[24745]: cluster 2024-09-14T00:41:45.736218+0000 mgr.a (mgr.14355) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:46 smithi171 bash[25040]: audit 2024-09-14T00:41:45.464450+0000 mgr.a (mgr.14355) 6093 : audit [DBG] from='client.140286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:46 smithi171 bash[25040]: cluster 2024-09-14T00:41:45.736218+0000 mgr.a (mgr.14355) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:48 smithi007 bash[22722]: cluster 2024-09-14T00:41:47.737079+0000 mgr.a (mgr.14355) 6095 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:48 smithi131 bash[24745]: cluster 2024-09-14T00:41:47.737079+0000 mgr.a (mgr.14355) 6095 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:48 smithi171 bash[25040]: cluster 2024-09-14T00:41:47.737079+0000 mgr.a (mgr.14355) 6095 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:50.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:50 smithi007 bash[22722]: cluster 2024-09-14T00:41:49.737848+0000 mgr.a (mgr.14355) 6096 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:50 smithi131 bash[24745]: cluster 2024-09-14T00:41:49.737848+0000 mgr.a (mgr.14355) 6096 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:50 smithi171 bash[25040]: cluster 2024-09-14T00:41:49.737848+0000 mgr.a (mgr.14355) 6096 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:41:51.628 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:51.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:52 smithi007 bash[22722]: audit 2024-09-14T00:41:51.213467+0000 mgr.a (mgr.14355) 6097 : audit [DBG] from='client.140361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:52 smithi007 bash[22722]: cluster 2024-09-14T00:41:51.740615+0000 mgr.a (mgr.14355) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:52 smithi131 bash[24745]: audit 2024-09-14T00:41:51.213467+0000 mgr.a (mgr.14355) 6097 : audit [DBG] from='client.140361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:52 smithi131 bash[24745]: cluster 2024-09-14T00:41:51.740615+0000 mgr.a (mgr.14355) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:52 smithi171 bash[25040]: audit 2024-09-14T00:41:51.213467+0000 mgr.a (mgr.14355) 6097 : audit [DBG] from='client.140361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:52 smithi171 bash[25040]: cluster 2024-09-14T00:41:51.740615+0000 mgr.a (mgr.14355) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:54 smithi007 bash[22722]: cluster 2024-09-14T00:41:53.741415+0000 mgr.a (mgr.14355) 6099 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:54 smithi131 bash[24745]: cluster 2024-09-14T00:41:53.741415+0000 mgr.a (mgr.14355) 6099 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:54 smithi171 bash[25040]: cluster 2024-09-14T00:41:53.741415+0000 mgr.a (mgr.14355) 6099 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:41:56.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:41:56.630 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:41:56.630 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:41:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:56 smithi007 bash[22722]: cluster 2024-09-14T00:41:55.743370+0000 mgr.a (mgr.14355) 6100 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:56 smithi131 bash[24745]: cluster 2024-09-14T00:41:55.743370+0000 mgr.a (mgr.14355) 6100 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:56 smithi171 bash[25040]: cluster 2024-09-14T00:41:55.743370+0000 mgr.a (mgr.14355) 6100 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:57.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:41:57.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:41:57.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:41:57.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:41:57.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:41:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:58 smithi007 bash[22722]: audit 2024-09-14T00:41:56.969145+0000 mgr.a (mgr.14355) 6101 : audit [DBG] from='client.140439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:41:58 smithi007 bash[22722]: cluster 2024-09-14T00:41:57.744295+0000 mgr.a (mgr.14355) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:58 smithi131 bash[24745]: audit 2024-09-14T00:41:56.969145+0000 mgr.a (mgr.14355) 6101 : audit [DBG] from='client.140439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:59.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:41:58 smithi131 bash[24745]: cluster 2024-09-14T00:41:57.744295+0000 mgr.a (mgr.14355) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:41:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:58 smithi171 bash[25040]: audit 2024-09-14T00:41:56.969145+0000 mgr.a (mgr.14355) 6101 : audit [DBG] from='client.140439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:41:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:41:58 smithi171 bash[25040]: cluster 2024-09-14T00:41:57.744295+0000 mgr.a (mgr.14355) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:00 smithi007 bash[22722]: cluster 2024-09-14T00:41:59.745021+0000 mgr.a (mgr.14355) 6103 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:00 smithi131 bash[24745]: cluster 2024-09-14T00:41:59.745021+0000 mgr.a (mgr.14355) 6103 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:00 smithi171 bash[25040]: cluster 2024-09-14T00:41:59.745021+0000 mgr.a (mgr.14355) 6103 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:02.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:02.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:02.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:03.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:03.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:03.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:02 smithi007 bash[22722]: cluster 2024-09-14T00:42:01.747309+0000 mgr.a (mgr.14355) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:02 smithi131 bash[24745]: cluster 2024-09-14T00:42:01.747309+0000 mgr.a (mgr.14355) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:02 smithi171 bash[25040]: cluster 2024-09-14T00:42:01.747309+0000 mgr.a (mgr.14355) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:03 smithi007 bash[22722]: audit 2024-09-14T00:42:02.733483+0000 mgr.a (mgr.14355) 6105 : audit [DBG] from='client.140517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:03 smithi131 bash[24745]: audit 2024-09-14T00:42:02.733483+0000 mgr.a (mgr.14355) 6105 : audit [DBG] from='client.140517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:03 smithi171 bash[25040]: audit 2024-09-14T00:42:02.733483+0000 mgr.a (mgr.14355) 6105 : audit [DBG] from='client.140517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:04 smithi007 bash[22722]: cluster 2024-09-14T00:42:03.748247+0000 mgr.a (mgr.14355) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:04 smithi131 bash[24745]: cluster 2024-09-14T00:42:03.748247+0000 mgr.a (mgr.14355) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:04 smithi171 bash[25040]: cluster 2024-09-14T00:42:03.748247+0000 mgr.a (mgr.14355) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:06 smithi007 bash[22722]: cluster 2024-09-14T00:42:05.750533+0000 mgr.a (mgr.14355) 6107 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:06 smithi131 bash[24745]: cluster 2024-09-14T00:42:05.750533+0000 mgr.a (mgr.14355) 6107 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:06 smithi171 bash[25040]: cluster 2024-09-14T00:42:05.750533+0000 mgr.a (mgr.14355) 6107 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:42:08.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:08.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:08.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:08.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:08.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:08.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:08.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:08 smithi007 bash[22722]: cluster 2024-09-14T00:42:07.751443+0000 mgr.a (mgr.14355) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:08 smithi131 bash[24745]: cluster 2024-09-14T00:42:07.751443+0000 mgr.a (mgr.14355) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:08 smithi171 bash[25040]: cluster 2024-09-14T00:42:07.751443+0000 mgr.a (mgr.14355) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:09 smithi007 bash[22722]: audit 2024-09-14T00:42:08.482372+0000 mgr.a (mgr.14355) 6109 : audit [DBG] from='client.140595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:09 smithi131 bash[24745]: audit 2024-09-14T00:42:08.482372+0000 mgr.a (mgr.14355) 6109 : audit [DBG] from='client.140595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:09 smithi171 bash[25040]: audit 2024-09-14T00:42:08.482372+0000 mgr.a (mgr.14355) 6109 : audit [DBG] from='client.140595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:10 smithi007 bash[22722]: cluster 2024-09-14T00:42:09.752458+0000 mgr.a (mgr.14355) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:11.288 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:10 smithi131 bash[24745]: cluster 2024-09-14T00:42:09.752458+0000 mgr.a (mgr.14355) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:10 smithi171 bash[25040]: cluster 2024-09-14T00:42:09.752458+0000 mgr.a (mgr.14355) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:42:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:12 smithi007 bash[22722]: cluster 2024-09-14T00:42:11.754794+0000 mgr.a (mgr.14355) 6111 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T00:42:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:12 smithi131 bash[24745]: cluster 2024-09-14T00:42:11.754794+0000 mgr.a (mgr.14355) 6111 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T00:42:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:12 smithi171 bash[25040]: cluster 2024-09-14T00:42:11.754794+0000 mgr.a (mgr.14355) 6111 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T00:42:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:13.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:13.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:14.691 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:14.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:14.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:14.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:14.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:14 smithi007 bash[22722]: cluster 2024-09-14T00:42:13.755546+0000 mgr.a (mgr.14355) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:14 smithi131 bash[24745]: cluster 2024-09-14T00:42:13.755546+0000 mgr.a (mgr.14355) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:14 smithi171 bash[25040]: cluster 2024-09-14T00:42:13.755546+0000 mgr.a (mgr.14355) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:15 smithi007 bash[22722]: audit 2024-09-14T00:42:14.262575+0000 mgr.a (mgr.14355) 6113 : audit [DBG] from='client.140673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:15 smithi131 bash[24745]: audit 2024-09-14T00:42:14.262575+0000 mgr.a (mgr.14355) 6113 : audit [DBG] from='client.140673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:15 smithi171 bash[25040]: audit 2024-09-14T00:42:14.262575+0000 mgr.a (mgr.14355) 6113 : audit [DBG] from='client.140673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:16 smithi007 bash[22722]: cluster 2024-09-14T00:42:15.757827+0000 mgr.a (mgr.14355) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:42:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:16 smithi131 bash[24745]: cluster 2024-09-14T00:42:15.757827+0000 mgr.a (mgr.14355) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:42:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:16 smithi171 bash[25040]: cluster 2024-09-14T00:42:15.757827+0000 mgr.a (mgr.14355) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T00:42:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:18 smithi007 bash[22722]: cluster 2024-09-14T00:42:17.758652+0000 mgr.a (mgr.14355) 6115 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:18 smithi131 bash[24745]: cluster 2024-09-14T00:42:17.758652+0000 mgr.a (mgr.14355) 6115 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:18 smithi171 bash[25040]: cluster 2024-09-14T00:42:17.758652+0000 mgr.a (mgr.14355) 6115 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:20.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:20.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:20 smithi007 bash[22722]: cluster 2024-09-14T00:42:19.759244+0000 mgr.a (mgr.14355) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:20 smithi131 bash[24745]: cluster 2024-09-14T00:42:19.759244+0000 mgr.a (mgr.14355) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:20 smithi171 bash[25040]: cluster 2024-09-14T00:42:19.759244+0000 mgr.a (mgr.14355) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:21 smithi007 bash[22722]: audit 2024-09-14T00:42:20.023427+0000 mgr.a (mgr.14355) 6117 : audit [DBG] from='client.140748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:21 smithi131 bash[24745]: audit 2024-09-14T00:42:20.023427+0000 mgr.a (mgr.14355) 6117 : audit [DBG] from='client.140748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:21 smithi171 bash[25040]: audit 2024-09-14T00:42:20.023427+0000 mgr.a (mgr.14355) 6117 : audit [DBG] from='client.140748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:22 smithi007 bash[22722]: cluster 2024-09-14T00:42:21.761948+0000 mgr.a (mgr.14355) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:22 smithi007 bash[22722]: audit 2024-09-14T00:42:22.261177+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:42:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:22 smithi007 bash[22722]: audit 2024-09-14T00:42:22.886189+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:22 smithi007 bash[22722]: audit 2024-09-14T00:42:22.890034+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:22 smithi131 bash[24745]: cluster 2024-09-14T00:42:21.761948+0000 mgr.a (mgr.14355) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:22 smithi131 bash[24745]: audit 2024-09-14T00:42:22.261177+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:42:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:22 smithi131 bash[24745]: audit 2024-09-14T00:42:22.886189+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:22 smithi131 bash[24745]: audit 2024-09-14T00:42:22.890034+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:22 smithi171 bash[25040]: cluster 2024-09-14T00:42:21.761948+0000 mgr.a (mgr.14355) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T00:42:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:22 smithi171 bash[25040]: audit 2024-09-14T00:42:22.261177+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:42:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:22 smithi171 bash[25040]: audit 2024-09-14T00:42:22.886189+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:22 smithi171 bash[25040]: audit 2024-09-14T00:42:22.890034+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:23 smithi007 bash[22722]: audit 2024-09-14T00:42:23.688786+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:42:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:23 smithi007 bash[22722]: audit 2024-09-14T00:42:23.690421+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:42:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:23 smithi007 bash[22722]: audit 2024-09-14T00:42:23.697511+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:23 smithi007 bash[22722]: audit 2024-09-14T00:42:23.700090+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:23 smithi131 bash[24745]: audit 2024-09-14T00:42:23.688786+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:42:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:23 smithi131 bash[24745]: audit 2024-09-14T00:42:23.690421+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:42:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:23 smithi131 bash[24745]: audit 2024-09-14T00:42:23.697511+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:23 smithi131 bash[24745]: audit 2024-09-14T00:42:23.700090+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:23 smithi171 bash[25040]: audit 2024-09-14T00:42:23.688786+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:42:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:23 smithi171 bash[25040]: audit 2024-09-14T00:42:23.690421+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:42:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:23 smithi171 bash[25040]: audit 2024-09-14T00:42:23.697511+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:42:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:23 smithi171 bash[25040]: audit 2024-09-14T00:42:23.700090+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:24.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:42:24 smithi007 bash[22972]: debug 2024-09-14T00:42:24.414+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:42:24.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:42:24 smithi007 bash[22972]: debug 2024-09-14T00:42:24.414+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:42:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:24 smithi007 bash[22722]: audit 2024-09-14T00:42:23.701114+0000 mgr.a (mgr.14355) 6119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:24 smithi007 bash[22722]: cluster 2024-09-14T00:42:23.762944+0000 mgr.a (mgr.14355) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:42:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:24 smithi131 bash[24745]: audit 2024-09-14T00:42:23.701114+0000 mgr.a (mgr.14355) 6119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:24 smithi131 bash[24745]: cluster 2024-09-14T00:42:23.762944+0000 mgr.a (mgr.14355) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:42:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:24 smithi171 bash[25040]: audit 2024-09-14T00:42:23.701114+0000 mgr.a (mgr.14355) 6119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:42:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:24 smithi171 bash[25040]: cluster 2024-09-14T00:42:23.762944+0000 mgr.a (mgr.14355) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:42:25.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:25.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:25.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:25 smithi007 bash[22722]: audit 2024-09-14T00:42:24.420666+0000 mgr.a (mgr.14355) 6121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:42:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:25 smithi007 bash[22722]: cephadm 2024-09-14T00:42:24.422169+0000 mgr.a (mgr.14355) 6122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:42:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:26.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:26.220 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:25 smithi131 bash[24745]: audit 2024-09-14T00:42:24.420666+0000 mgr.a (mgr.14355) 6121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:42:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:25 smithi131 bash[24745]: cephadm 2024-09-14T00:42:24.422169+0000 mgr.a (mgr.14355) 6122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:42:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:25 smithi171 bash[25040]: audit 2024-09-14T00:42:24.420666+0000 mgr.a (mgr.14355) 6121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:42:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:25 smithi171 bash[25040]: cephadm 2024-09-14T00:42:24.422169+0000 mgr.a (mgr.14355) 6122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:42:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:26 smithi007 bash[22722]: cluster 2024-09-14T00:42:25.764383+0000 mgr.a (mgr.14355) 6123 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:26 smithi007 bash[22722]: audit 2024-09-14T00:42:25.778035+0000 mgr.a (mgr.14355) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:26 smithi131 bash[24745]: cluster 2024-09-14T00:42:25.764383+0000 mgr.a (mgr.14355) 6123 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:26 smithi131 bash[24745]: audit 2024-09-14T00:42:25.778035+0000 mgr.a (mgr.14355) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:26 smithi171 bash[25040]: cluster 2024-09-14T00:42:25.764383+0000 mgr.a (mgr.14355) 6123 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:26 smithi171 bash[25040]: audit 2024-09-14T00:42:25.778035+0000 mgr.a (mgr.14355) 6124 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:28 smithi007 bash[22722]: cluster 2024-09-14T00:42:27.765246+0000 mgr.a (mgr.14355) 6125 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:28 smithi131 bash[24745]: cluster 2024-09-14T00:42:27.765246+0000 mgr.a (mgr.14355) 6125 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:28 smithi171 bash[25040]: cluster 2024-09-14T00:42:27.765246+0000 mgr.a (mgr.14355) 6125 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:30 smithi007 bash[22722]: cluster 2024-09-14T00:42:29.766026+0000 mgr.a (mgr.14355) 6126 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:31.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:31.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:30 smithi131 bash[24745]: cluster 2024-09-14T00:42:29.766026+0000 mgr.a (mgr.14355) 6126 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:30 smithi171 bash[25040]: cluster 2024-09-14T00:42:29.766026+0000 mgr.a (mgr.14355) 6126 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:42:31.993 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:31.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:31.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:32 smithi007 bash[22722]: audit 2024-09-14T00:42:31.554647+0000 mgr.a (mgr.14355) 6127 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:33.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:32 smithi007 bash[22722]: cluster 2024-09-14T00:42:31.767486+0000 mgr.a (mgr.14355) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:32 smithi131 bash[24745]: audit 2024-09-14T00:42:31.554647+0000 mgr.a (mgr.14355) 6127 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:32 smithi131 bash[24745]: cluster 2024-09-14T00:42:31.767486+0000 mgr.a (mgr.14355) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:32 smithi171 bash[25040]: audit 2024-09-14T00:42:31.554647+0000 mgr.a (mgr.14355) 6127 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:32 smithi171 bash[25040]: cluster 2024-09-14T00:42:31.767486+0000 mgr.a (mgr.14355) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:34 smithi007 bash[22722]: cluster 2024-09-14T00:42:33.768520+0000 mgr.a (mgr.14355) 6129 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:34 smithi131 bash[24745]: cluster 2024-09-14T00:42:33.768520+0000 mgr.a (mgr.14355) 6129 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:34 smithi171 bash[25040]: cluster 2024-09-14T00:42:33.768520+0000 mgr.a (mgr.14355) 6129 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:36.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:36 smithi007 bash[22722]: cluster 2024-09-14T00:42:35.770873+0000 mgr.a (mgr.14355) 6130 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:36 smithi131 bash[24745]: cluster 2024-09-14T00:42:35.770873+0000 mgr.a (mgr.14355) 6130 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:36 smithi171 bash[25040]: cluster 2024-09-14T00:42:35.770873+0000 mgr.a (mgr.14355) 6130 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:37.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:38 smithi007 bash[22722]: audit 2024-09-14T00:42:37.334819+0000 mgr.a (mgr.14355) 6131 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:38 smithi007 bash[22722]: cluster 2024-09-14T00:42:37.771429+0000 mgr.a (mgr.14355) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:38 smithi131 bash[24745]: audit 2024-09-14T00:42:37.334819+0000 mgr.a (mgr.14355) 6131 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:38 smithi131 bash[24745]: cluster 2024-09-14T00:42:37.771429+0000 mgr.a (mgr.14355) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:38 smithi171 bash[25040]: audit 2024-09-14T00:42:37.334819+0000 mgr.a (mgr.14355) 6131 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:38 smithi171 bash[25040]: cluster 2024-09-14T00:42:37.771429+0000 mgr.a (mgr.14355) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:40 smithi007 bash[22722]: cluster 2024-09-14T00:42:39.772160+0000 mgr.a (mgr.14355) 6133 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:40 smithi131 bash[24745]: cluster 2024-09-14T00:42:39.772160+0000 mgr.a (mgr.14355) 6133 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:40 smithi171 bash[25040]: cluster 2024-09-14T00:42:39.772160+0000 mgr.a (mgr.14355) 6133 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:42.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:42 smithi007 bash[22722]: cluster 2024-09-14T00:42:41.774444+0000 mgr.a (mgr.14355) 6134 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:42 smithi131 bash[24745]: cluster 2024-09-14T00:42:41.774444+0000 mgr.a (mgr.14355) 6134 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:42 smithi171 bash[25040]: cluster 2024-09-14T00:42:41.774444+0000 mgr.a (mgr.14355) 6134 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:43.518 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:43.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:44 smithi007 bash[22722]: audit 2024-09-14T00:42:43.097427+0000 mgr.a (mgr.14355) 6135 : audit [DBG] from='client.141168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:44 smithi007 bash[22722]: cluster 2024-09-14T00:42:43.775396+0000 mgr.a (mgr.14355) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:45.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:44 smithi131 bash[24745]: audit 2024-09-14T00:42:43.097427+0000 mgr.a (mgr.14355) 6135 : audit [DBG] from='client.141168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:45.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:44 smithi131 bash[24745]: cluster 2024-09-14T00:42:43.775396+0000 mgr.a (mgr.14355) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:44 smithi171 bash[25040]: audit 2024-09-14T00:42:43.097427+0000 mgr.a (mgr.14355) 6135 : audit [DBG] from='client.141168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:44 smithi171 bash[25040]: cluster 2024-09-14T00:42:43.775396+0000 mgr.a (mgr.14355) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:46 smithi131 bash[24745]: cluster 2024-09-14T00:42:45.777591+0000 mgr.a (mgr.14355) 6137 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:46 smithi171 bash[25040]: cluster 2024-09-14T00:42:45.777591+0000 mgr.a (mgr.14355) 6137 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:46 smithi007 bash[22722]: cluster 2024-09-14T00:42:45.777591+0000 mgr.a (mgr.14355) 6137 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:48.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:48.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:48.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:48 smithi131 bash[24745]: cluster 2024-09-14T00:42:47.778384+0000 mgr.a (mgr.14355) 6138 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:49.301 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:48 smithi171 bash[25040]: cluster 2024-09-14T00:42:47.778384+0000 mgr.a (mgr.14355) 6138 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:49.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:49.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:49.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:49.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:49.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:48 smithi007 bash[22722]: cluster 2024-09-14T00:42:47.778384+0000 mgr.a (mgr.14355) 6138 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:49 smithi131 bash[24745]: audit 2024-09-14T00:42:48.854283+0000 mgr.a (mgr.14355) 6139 : audit [DBG] from='client.141246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:49 smithi171 bash[25040]: audit 2024-09-14T00:42:48.854283+0000 mgr.a (mgr.14355) 6139 : audit [DBG] from='client.141246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:49 smithi007 bash[22722]: audit 2024-09-14T00:42:48.854283+0000 mgr.a (mgr.14355) 6139 : audit [DBG] from='client.141246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:50 smithi131 bash[24745]: cluster 2024-09-14T00:42:49.779340+0000 mgr.a (mgr.14355) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:50 smithi171 bash[25040]: cluster 2024-09-14T00:42:49.779340+0000 mgr.a (mgr.14355) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:50 smithi007 bash[22722]: cluster 2024-09-14T00:42:49.779340+0000 mgr.a (mgr.14355) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:52 smithi131 bash[24745]: cluster 2024-09-14T00:42:51.781600+0000 mgr.a (mgr.14355) 6141 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:52 smithi171 bash[25040]: cluster 2024-09-14T00:42:51.781600+0000 mgr.a (mgr.14355) 6141 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:52 smithi007 bash[22722]: cluster 2024-09-14T00:42:51.781600+0000 mgr.a (mgr.14355) 6141 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:53 smithi131 bash[24745]: cluster 2024-09-14T00:42:53.782421+0000 mgr.a (mgr.14355) 6142 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:53 smithi171 bash[25040]: cluster 2024-09-14T00:42:53.782421+0000 mgr.a (mgr.14355) 6142 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:42:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:42:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:42:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:53 smithi007 bash[22722]: cluster 2024-09-14T00:42:53.782421+0000 mgr.a (mgr.14355) 6142 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:55.070 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:42:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:42:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:42:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:42:55.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:42:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:54 smithi131 bash[24745]: audit 2024-09-14T00:42:54.637212+0000 mgr.a (mgr.14355) 6143 : audit [DBG] from='client.141315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:54 smithi171 bash[25040]: audit 2024-09-14T00:42:54.637212+0000 mgr.a (mgr.14355) 6143 : audit [DBG] from='client.141315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:54 smithi007 bash[22722]: audit 2024-09-14T00:42:54.637212+0000 mgr.a (mgr.14355) 6143 : audit [DBG] from='client.141315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:42:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:55 smithi131 bash[24745]: cluster 2024-09-14T00:42:55.784739+0000 mgr.a (mgr.14355) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:55 smithi171 bash[25040]: cluster 2024-09-14T00:42:55.784739+0000 mgr.a (mgr.14355) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:55 smithi007 bash[22722]: cluster 2024-09-14T00:42:55.784739+0000 mgr.a (mgr.14355) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:42:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:42:58 smithi007 bash[22722]: cluster 2024-09-14T00:42:57.785524+0000 mgr.a (mgr.14355) 6145 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:42:58 smithi131 bash[24745]: cluster 2024-09-14T00:42:57.785524+0000 mgr.a (mgr.14355) 6145 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:42:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:42:58 smithi171 bash[25040]: cluster 2024-09-14T00:42:57.785524+0000 mgr.a (mgr.14355) 6145 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:00.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:00.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:00.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:00.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:00.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:00.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:00.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:00 smithi007 bash[22722]: cluster 2024-09-14T00:42:59.786344+0000 mgr.a (mgr.14355) 6146 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:00 smithi131 bash[24745]: cluster 2024-09-14T00:42:59.786344+0000 mgr.a (mgr.14355) 6146 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:00 smithi171 bash[25040]: cluster 2024-09-14T00:42:59.786344+0000 mgr.a (mgr.14355) 6146 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:01 smithi007 bash[22722]: audit 2024-09-14T00:43:00.407627+0000 mgr.a (mgr.14355) 6147 : audit [DBG] from='client.141390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:01 smithi131 bash[24745]: audit 2024-09-14T00:43:00.407627+0000 mgr.a (mgr.14355) 6147 : audit [DBG] from='client.141390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:01 smithi171 bash[25040]: audit 2024-09-14T00:43:00.407627+0000 mgr.a (mgr.14355) 6147 : audit [DBG] from='client.141390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:02 smithi007 bash[22722]: cluster 2024-09-14T00:43:01.789044+0000 mgr.a (mgr.14355) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:02 smithi131 bash[24745]: cluster 2024-09-14T00:43:01.789044+0000 mgr.a (mgr.14355) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:02 smithi171 bash[25040]: cluster 2024-09-14T00:43:01.789044+0000 mgr.a (mgr.14355) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:04 smithi007 bash[22722]: cluster 2024-09-14T00:43:03.789813+0000 mgr.a (mgr.14355) 6149 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:04 smithi131 bash[24745]: cluster 2024-09-14T00:43:03.789813+0000 mgr.a (mgr.14355) 6149 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:04 smithi171 bash[25040]: cluster 2024-09-14T00:43:03.789813+0000 mgr.a (mgr.14355) 6149 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:05.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:06.613 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:06.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:06 smithi007 bash[22722]: cluster 2024-09-14T00:43:05.791761+0000 mgr.a (mgr.14355) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:06 smithi131 bash[24745]: cluster 2024-09-14T00:43:05.791761+0000 mgr.a (mgr.14355) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:06 smithi171 bash[25040]: cluster 2024-09-14T00:43:05.791761+0000 mgr.a (mgr.14355) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:07 smithi007 bash[22722]: audit 2024-09-14T00:43:06.170695+0000 mgr.a (mgr.14355) 6151 : audit [DBG] from='client.141465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:07 smithi131 bash[24745]: audit 2024-09-14T00:43:06.170695+0000 mgr.a (mgr.14355) 6151 : audit [DBG] from='client.141465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:07 smithi171 bash[25040]: audit 2024-09-14T00:43:06.170695+0000 mgr.a (mgr.14355) 6151 : audit [DBG] from='client.141465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:08 smithi007 bash[22722]: cluster 2024-09-14T00:43:07.792665+0000 mgr.a (mgr.14355) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:08 smithi131 bash[24745]: cluster 2024-09-14T00:43:07.792665+0000 mgr.a (mgr.14355) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:08 smithi171 bash[25040]: cluster 2024-09-14T00:43:07.792665+0000 mgr.a (mgr.14355) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:10 smithi007 bash[22722]: cluster 2024-09-14T00:43:09.793429+0000 mgr.a (mgr.14355) 6153 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:43:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:10 smithi131 bash[24745]: cluster 2024-09-14T00:43:09.793429+0000 mgr.a (mgr.14355) 6153 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:43:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:10 smithi171 bash[25040]: cluster 2024-09-14T00:43:09.793429+0000 mgr.a (mgr.14355) 6153 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:43:11.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:12.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:12.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:12.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:12.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:12.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:12 smithi007 bash[22722]: cluster 2024-09-14T00:43:11.795571+0000 mgr.a (mgr.14355) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:12 smithi007 bash[22722]: audit 2024-09-14T00:43:11.940766+0000 mgr.a (mgr.14355) 6155 : audit [DBG] from='client.141540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:12 smithi131 bash[24745]: cluster 2024-09-14T00:43:11.795571+0000 mgr.a (mgr.14355) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:12 smithi131 bash[24745]: audit 2024-09-14T00:43:11.940766+0000 mgr.a (mgr.14355) 6155 : audit [DBG] from='client.141540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:12 smithi171 bash[25040]: cluster 2024-09-14T00:43:11.795571+0000 mgr.a (mgr.14355) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:12 smithi171 bash[25040]: audit 2024-09-14T00:43:11.940766+0000 mgr.a (mgr.14355) 6155 : audit [DBG] from='client.141540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:14 smithi007 bash[22722]: cluster 2024-09-14T00:43:13.796465+0000 mgr.a (mgr.14355) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:14 smithi131 bash[24745]: cluster 2024-09-14T00:43:13.796465+0000 mgr.a (mgr.14355) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:14 smithi171 bash[25040]: cluster 2024-09-14T00:43:13.796465+0000 mgr.a (mgr.14355) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:16 smithi007 bash[22722]: cluster 2024-09-14T00:43:15.798656+0000 mgr.a (mgr.14355) 6157 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:16 smithi131 bash[24745]: cluster 2024-09-14T00:43:15.798656+0000 mgr.a (mgr.14355) 6157 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:16 smithi171 bash[25040]: cluster 2024-09-14T00:43:15.798656+0000 mgr.a (mgr.14355) 6157 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:17.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:17.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:18.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:18.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:18.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:18.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:18.114 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:18 smithi007 bash[22722]: audit 2024-09-14T00:43:17.683303+0000 mgr.a (mgr.14355) 6158 : audit [DBG] from='client.141618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:18 smithi007 bash[22722]: cluster 2024-09-14T00:43:17.799209+0000 mgr.a (mgr.14355) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:18 smithi131 bash[24745]: audit 2024-09-14T00:43:17.683303+0000 mgr.a (mgr.14355) 6158 : audit [DBG] from='client.141618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:18 smithi131 bash[24745]: cluster 2024-09-14T00:43:17.799209+0000 mgr.a (mgr.14355) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:18 smithi171 bash[25040]: audit 2024-09-14T00:43:17.683303+0000 mgr.a (mgr.14355) 6158 : audit [DBG] from='client.141618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:18 smithi171 bash[25040]: cluster 2024-09-14T00:43:17.799209+0000 mgr.a (mgr.14355) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:20 smithi007 bash[22722]: cluster 2024-09-14T00:43:19.800062+0000 mgr.a (mgr.14355) 6160 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:20 smithi131 bash[24745]: cluster 2024-09-14T00:43:19.800062+0000 mgr.a (mgr.14355) 6160 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:20 smithi171 bash[25040]: cluster 2024-09-14T00:43:19.800062+0000 mgr.a (mgr.14355) 6160 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:23.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:23.116 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:23.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:22 smithi007 bash[22722]: cluster 2024-09-14T00:43:21.802382+0000 mgr.a (mgr.14355) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:22 smithi131 bash[24745]: cluster 2024-09-14T00:43:21.802382+0000 mgr.a (mgr.14355) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:22 smithi171 bash[25040]: cluster 2024-09-14T00:43:21.802382+0000 mgr.a (mgr.14355) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:23.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:24 smithi007 bash[22722]: audit 2024-09-14T00:43:23.451778+0000 mgr.a (mgr.14355) 6162 : audit [DBG] from='client.141696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:24 smithi007 bash[22722]: cluster 2024-09-14T00:43:23.802913+0000 mgr.a (mgr.14355) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:24 smithi007 bash[22722]: audit 2024-09-14T00:43:24.475612+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:43:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:24 smithi131 bash[24745]: audit 2024-09-14T00:43:23.451778+0000 mgr.a (mgr.14355) 6162 : audit [DBG] from='client.141696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:24 smithi131 bash[24745]: cluster 2024-09-14T00:43:23.802913+0000 mgr.a (mgr.14355) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:24 smithi131 bash[24745]: audit 2024-09-14T00:43:24.475612+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:43:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:24 smithi171 bash[25040]: audit 2024-09-14T00:43:23.451778+0000 mgr.a (mgr.14355) 6162 : audit [DBG] from='client.141696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:24 smithi171 bash[25040]: cluster 2024-09-14T00:43:23.802913+0000 mgr.a (mgr.14355) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:24 smithi171 bash[25040]: audit 2024-09-14T00:43:24.475612+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.090316+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.094853+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.099217+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.103545+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: cluster 2024-09-14T00:43:25.805128+0000 mgr.a (mgr.14355) 6164 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.901511+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.903113+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:43:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.913617+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.916369+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22722]: audit 2024-09-14T00:43:25.918656+0000 mgr.a (mgr.14355) 6165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.090316+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.094853+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.099217+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.103545+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: cluster 2024-09-14T00:43:25.805128+0000 mgr.a (mgr.14355) 6164 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.901511+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.903113+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.913617+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.916369+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:26 smithi131 bash[24745]: audit 2024-09-14T00:43:25.918656+0000 mgr.a (mgr.14355) 6165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.090316+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.094853+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.099217+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.103545+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: cluster 2024-09-14T00:43:25.805128+0000 mgr.a (mgr.14355) 6164 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.901511+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.903113+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:43:26.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.913617+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:43:26.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.916369+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:26 smithi171 bash[25040]: audit 2024-09-14T00:43:25.918656+0000 mgr.a (mgr.14355) 6165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:43:26.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22972]: debug 2024-09-14T00:43:26.645+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:43:26.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:43:26 smithi007 bash[22972]: debug 2024-09-14T00:43:26.645+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:43:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:27 smithi007 bash[22722]: audit 2024-09-14T00:43:26.648383+0000 mgr.a (mgr.14355) 6166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:43:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:27 smithi007 bash[22722]: cephadm 2024-09-14T00:43:26.650050+0000 mgr.a (mgr.14355) 6167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:43:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:27 smithi131 bash[24745]: audit 2024-09-14T00:43:26.648383+0000 mgr.a (mgr.14355) 6166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:43:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:27 smithi131 bash[24745]: cephadm 2024-09-14T00:43:26.650050+0000 mgr.a (mgr.14355) 6167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:43:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:27 smithi171 bash[25040]: audit 2024-09-14T00:43:26.648383+0000 mgr.a (mgr.14355) 6166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:43:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:27 smithi171 bash[25040]: cephadm 2024-09-14T00:43:26.650050+0000 mgr.a (mgr.14355) 6167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:43:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:28 smithi007 bash[22722]: cluster 2024-09-14T00:43:27.806024+0000 mgr.a (mgr.14355) 6168 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:28 smithi131 bash[24745]: cluster 2024-09-14T00:43:27.806024+0000 mgr.a (mgr.14355) 6168 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:28 smithi171 bash[25040]: cluster 2024-09-14T00:43:27.806024+0000 mgr.a (mgr.14355) 6168 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:28.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:28.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:29.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:30 smithi007 bash[22722]: audit 2024-09-14T00:43:29.218300+0000 mgr.a (mgr.14355) 6169 : audit [DBG] from='client.141879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:30 smithi007 bash[22722]: cluster 2024-09-14T00:43:29.807126+0000 mgr.a (mgr.14355) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:30 smithi131 bash[24745]: audit 2024-09-14T00:43:29.218300+0000 mgr.a (mgr.14355) 6169 : audit [DBG] from='client.141879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:30 smithi131 bash[24745]: cluster 2024-09-14T00:43:29.807126+0000 mgr.a (mgr.14355) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:30 smithi171 bash[25040]: audit 2024-09-14T00:43:29.218300+0000 mgr.a (mgr.14355) 6169 : audit [DBG] from='client.141879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:30 smithi171 bash[25040]: cluster 2024-09-14T00:43:29.807126+0000 mgr.a (mgr.14355) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:32 smithi007 bash[22722]: cluster 2024-09-14T00:43:31.809432+0000 mgr.a (mgr.14355) 6171 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:32 smithi131 bash[24745]: cluster 2024-09-14T00:43:31.809432+0000 mgr.a (mgr.14355) 6171 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:32 smithi171 bash[25040]: cluster 2024-09-14T00:43:31.809432+0000 mgr.a (mgr.14355) 6171 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:34.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:34 smithi007 bash[22722]: cluster 2024-09-14T00:43:33.810372+0000 mgr.a (mgr.14355) 6172 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:34 smithi131 bash[24745]: cluster 2024-09-14T00:43:33.810372+0000 mgr.a (mgr.14355) 6172 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:34 smithi171 bash[25040]: cluster 2024-09-14T00:43:33.810372+0000 mgr.a (mgr.14355) 6172 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:35.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:35.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:35 smithi007 bash[22722]: audit 2024-09-14T00:43:34.971278+0000 mgr.a (mgr.14355) 6173 : audit [DBG] from='client.141957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:35 smithi131 bash[24745]: audit 2024-09-14T00:43:34.971278+0000 mgr.a (mgr.14355) 6173 : audit [DBG] from='client.141957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:35 smithi171 bash[25040]: audit 2024-09-14T00:43:34.971278+0000 mgr.a (mgr.14355) 6173 : audit [DBG] from='client.141957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:36 smithi007 bash[22722]: cluster 2024-09-14T00:43:35.813193+0000 mgr.a (mgr.14355) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:36 smithi131 bash[24745]: cluster 2024-09-14T00:43:35.813193+0000 mgr.a (mgr.14355) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:36 smithi171 bash[25040]: cluster 2024-09-14T00:43:35.813193+0000 mgr.a (mgr.14355) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:38 smithi007 bash[22722]: cluster 2024-09-14T00:43:37.813977+0000 mgr.a (mgr.14355) 6175 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:38 smithi131 bash[24745]: cluster 2024-09-14T00:43:37.813977+0000 mgr.a (mgr.14355) 6175 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:38 smithi171 bash[25040]: cluster 2024-09-14T00:43:37.813977+0000 mgr.a (mgr.14355) 6175 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:40.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:40.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:41.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:41.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:41.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:41.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:41.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:40 smithi007 bash[22722]: cluster 2024-09-14T00:43:39.814810+0000 mgr.a (mgr.14355) 6176 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:40 smithi131 bash[24745]: cluster 2024-09-14T00:43:39.814810+0000 mgr.a (mgr.14355) 6176 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:40 smithi171 bash[25040]: cluster 2024-09-14T00:43:39.814810+0000 mgr.a (mgr.14355) 6176 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:43:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:41 smithi007 bash[22722]: audit 2024-09-14T00:43:40.717463+0000 mgr.a (mgr.14355) 6177 : audit [DBG] from='client.142035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:41 smithi131 bash[24745]: audit 2024-09-14T00:43:40.717463+0000 mgr.a (mgr.14355) 6177 : audit [DBG] from='client.142035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:41 smithi171 bash[25040]: audit 2024-09-14T00:43:40.717463+0000 mgr.a (mgr.14355) 6177 : audit [DBG] from='client.142035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:42 smithi007 bash[22722]: cluster 2024-09-14T00:43:41.817635+0000 mgr.a (mgr.14355) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:42 smithi131 bash[24745]: cluster 2024-09-14T00:43:41.817635+0000 mgr.a (mgr.14355) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:42 smithi171 bash[25040]: cluster 2024-09-14T00:43:41.817635+0000 mgr.a (mgr.14355) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:43:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:44 smithi007 bash[22722]: cluster 2024-09-14T00:43:43.818458+0000 mgr.a (mgr.14355) 6179 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:44 smithi131 bash[24745]: cluster 2024-09-14T00:43:43.818458+0000 mgr.a (mgr.14355) 6179 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:44 smithi171 bash[25040]: cluster 2024-09-14T00:43:43.818458+0000 mgr.a (mgr.14355) 6179 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:43:46.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:46.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:46.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:46.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:46 smithi007 bash[22722]: cluster 2024-09-14T00:43:45.820316+0000 mgr.a (mgr.14355) 6180 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:46 smithi131 bash[24745]: cluster 2024-09-14T00:43:45.820316+0000 mgr.a (mgr.14355) 6180 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:46 smithi171 bash[25040]: cluster 2024-09-14T00:43:45.820316+0000 mgr.a (mgr.14355) 6180 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:47 smithi007 bash[22722]: audit 2024-09-14T00:43:46.471549+0000 mgr.a (mgr.14355) 6181 : audit [DBG] from='client.142113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:47 smithi131 bash[24745]: audit 2024-09-14T00:43:46.471549+0000 mgr.a (mgr.14355) 6181 : audit [DBG] from='client.142113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:47 smithi171 bash[25040]: audit 2024-09-14T00:43:46.471549+0000 mgr.a (mgr.14355) 6181 : audit [DBG] from='client.142113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:48 smithi007 bash[22722]: cluster 2024-09-14T00:43:47.821220+0000 mgr.a (mgr.14355) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:48 smithi131 bash[24745]: cluster 2024-09-14T00:43:47.821220+0000 mgr.a (mgr.14355) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:48 smithi171 bash[25040]: cluster 2024-09-14T00:43:47.821220+0000 mgr.a (mgr.14355) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:50 smithi007 bash[22722]: cluster 2024-09-14T00:43:49.821978+0000 mgr.a (mgr.14355) 6183 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:51.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:50 smithi131 bash[24745]: cluster 2024-09-14T00:43:49.821978+0000 mgr.a (mgr.14355) 6183 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:50 smithi171 bash[25040]: cluster 2024-09-14T00:43:49.821978+0000 mgr.a (mgr.14355) 6183 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:43:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:52.673 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:52.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:52.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:52.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:52.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:52 smithi007 bash[22722]: cluster 2024-09-14T00:43:51.824239+0000 mgr.a (mgr.14355) 6184 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:43:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:52 smithi131 bash[24745]: cluster 2024-09-14T00:43:51.824239+0000 mgr.a (mgr.14355) 6184 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:43:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:52 smithi171 bash[25040]: cluster 2024-09-14T00:43:51.824239+0000 mgr.a (mgr.14355) 6184 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:43:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:53 smithi007 bash[22722]: audit 2024-09-14T00:43:52.232463+0000 mgr.a (mgr.14355) 6185 : audit [DBG] from='client.142188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:53 smithi131 bash[24745]: audit 2024-09-14T00:43:52.232463+0000 mgr.a (mgr.14355) 6185 : audit [DBG] from='client.142188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:53 smithi171 bash[25040]: audit 2024-09-14T00:43:52.232463+0000 mgr.a (mgr.14355) 6185 : audit [DBG] from='client.142188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:43:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:54 smithi007 bash[22722]: cluster 2024-09-14T00:43:53.825131+0000 mgr.a (mgr.14355) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:54 smithi131 bash[24745]: cluster 2024-09-14T00:43:53.825131+0000 mgr.a (mgr.14355) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:54 smithi171 bash[25040]: cluster 2024-09-14T00:43:53.825131+0000 mgr.a (mgr.14355) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:56 smithi007 bash[22722]: cluster 2024-09-14T00:43:55.827376+0000 mgr.a (mgr.14355) 6187 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:56 smithi131 bash[24745]: cluster 2024-09-14T00:43:55.827376+0000 mgr.a (mgr.14355) 6187 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:56 smithi171 bash[25040]: cluster 2024-09-14T00:43:55.827376+0000 mgr.a (mgr.14355) 6187 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:43:57.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:43:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:43:57.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:43:58.456 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:43:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:43:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:43:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:43:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:43:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:58 smithi007 bash[22722]: cluster 2024-09-14T00:43:57.828110+0000 mgr.a (mgr.14355) 6188 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:58 smithi131 bash[24745]: cluster 2024-09-14T00:43:57.828110+0000 mgr.a (mgr.14355) 6188 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:43:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:58 smithi171 bash[25040]: cluster 2024-09-14T00:43:57.828110+0000 mgr.a (mgr.14355) 6188 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:43:59 smithi131 bash[24745]: audit 2024-09-14T00:43:58.013573+0000 mgr.a (mgr.14355) 6189 : audit [DBG] from='client.142263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:43:59 smithi171 bash[25040]: audit 2024-09-14T00:43:58.013573+0000 mgr.a (mgr.14355) 6189 : audit [DBG] from='client.142263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:43:59 smithi007 bash[22722]: audit 2024-09-14T00:43:58.013573+0000 mgr.a (mgr.14355) 6189 : audit [DBG] from='client.142263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:00 smithi131 bash[24745]: cluster 2024-09-14T00:43:59.828982+0000 mgr.a (mgr.14355) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:00 smithi171 bash[25040]: cluster 2024-09-14T00:43:59.828982+0000 mgr.a (mgr.14355) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:00 smithi007 bash[22722]: cluster 2024-09-14T00:43:59.828982+0000 mgr.a (mgr.14355) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:02 smithi131 bash[24745]: cluster 2024-09-14T00:44:01.831244+0000 mgr.a (mgr.14355) 6191 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:02 smithi171 bash[25040]: cluster 2024-09-14T00:44:01.831244+0000 mgr.a (mgr.14355) 6191 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:02 smithi007 bash[22722]: cluster 2024-09-14T00:44:01.831244+0000 mgr.a (mgr.14355) 6191 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:04.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:04.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:04.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:04.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:04.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:04 smithi131 bash[24745]: audit 2024-09-14T00:44:03.783951+0000 mgr.a (mgr.14355) 6192 : audit [DBG] from='client.142338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:04 smithi131 bash[24745]: cluster 2024-09-14T00:44:03.832258+0000 mgr.a (mgr.14355) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:04 smithi171 bash[25040]: audit 2024-09-14T00:44:03.783951+0000 mgr.a (mgr.14355) 6192 : audit [DBG] from='client.142338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:04 smithi171 bash[25040]: cluster 2024-09-14T00:44:03.832258+0000 mgr.a (mgr.14355) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:04 smithi007 bash[22722]: audit 2024-09-14T00:44:03.783951+0000 mgr.a (mgr.14355) 6192 : audit [DBG] from='client.142338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:04 smithi007 bash[22722]: cluster 2024-09-14T00:44:03.832258+0000 mgr.a (mgr.14355) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:06 smithi131 bash[24745]: cluster 2024-09-14T00:44:05.834633+0000 mgr.a (mgr.14355) 6194 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:06 smithi171 bash[25040]: cluster 2024-09-14T00:44:05.834633+0000 mgr.a (mgr.14355) 6194 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:06 smithi007 bash[22722]: cluster 2024-09-14T00:44:05.834633+0000 mgr.a (mgr.14355) 6194 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:09.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:09.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:08 smithi131 bash[24745]: cluster 2024-09-14T00:44:07.835447+0000 mgr.a (mgr.14355) 6195 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:08 smithi171 bash[25040]: cluster 2024-09-14T00:44:07.835447+0000 mgr.a (mgr.14355) 6195 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:08 smithi007 bash[22722]: cluster 2024-09-14T00:44:07.835447+0000 mgr.a (mgr.14355) 6195 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:09.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:09.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:10 smithi131 bash[24745]: audit 2024-09-14T00:44:09.550778+0000 mgr.a (mgr.14355) 6196 : audit [DBG] from='client.142413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:10 smithi131 bash[24745]: cluster 2024-09-14T00:44:09.836020+0000 mgr.a (mgr.14355) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:10 smithi171 bash[25040]: audit 2024-09-14T00:44:09.550778+0000 mgr.a (mgr.14355) 6196 : audit [DBG] from='client.142413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:10 smithi171 bash[25040]: cluster 2024-09-14T00:44:09.836020+0000 mgr.a (mgr.14355) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:10 smithi007 bash[22722]: audit 2024-09-14T00:44:09.550778+0000 mgr.a (mgr.14355) 6196 : audit [DBG] from='client.142413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:10 smithi007 bash[22722]: cluster 2024-09-14T00:44:09.836020+0000 mgr.a (mgr.14355) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:12 smithi131 bash[24745]: cluster 2024-09-14T00:44:11.838372+0000 mgr.a (mgr.14355) 6198 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:12 smithi171 bash[25040]: cluster 2024-09-14T00:44:11.838372+0000 mgr.a (mgr.14355) 6198 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:12 smithi007 bash[22722]: cluster 2024-09-14T00:44:11.838372+0000 mgr.a (mgr.14355) 6198 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:14.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:14.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:14 smithi131 bash[24745]: cluster 2024-09-14T00:44:13.839115+0000 mgr.a (mgr.14355) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:14 smithi171 bash[25040]: cluster 2024-09-14T00:44:13.839115+0000 mgr.a (mgr.14355) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:14 smithi007 bash[22722]: cluster 2024-09-14T00:44:13.839115+0000 mgr.a (mgr.14355) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:15.753 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:15.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:16 smithi131 bash[24745]: audit 2024-09-14T00:44:15.323172+0000 mgr.a (mgr.14355) 6200 : audit [DBG] from='client.142491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:16 smithi131 bash[24745]: cluster 2024-09-14T00:44:15.841749+0000 mgr.a (mgr.14355) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:16 smithi171 bash[25040]: audit 2024-09-14T00:44:15.323172+0000 mgr.a (mgr.14355) 6200 : audit [DBG] from='client.142491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:16 smithi171 bash[25040]: cluster 2024-09-14T00:44:15.841749+0000 mgr.a (mgr.14355) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:16 smithi007 bash[22722]: audit 2024-09-14T00:44:15.323172+0000 mgr.a (mgr.14355) 6200 : audit [DBG] from='client.142491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:16 smithi007 bash[22722]: cluster 2024-09-14T00:44:15.841749+0000 mgr.a (mgr.14355) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:18 smithi131 bash[24745]: cluster 2024-09-14T00:44:17.842564+0000 mgr.a (mgr.14355) 6202 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:18 smithi171 bash[25040]: cluster 2024-09-14T00:44:17.842564+0000 mgr.a (mgr.14355) 6202 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:18 smithi007 bash[22722]: cluster 2024-09-14T00:44:17.842564+0000 mgr.a (mgr.14355) 6202 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:20.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:20.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:20 smithi007 bash[22722]: cluster 2024-09-14T00:44:19.843465+0000 mgr.a (mgr.14355) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:44:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:20 smithi131 bash[24745]: cluster 2024-09-14T00:44:19.843465+0000 mgr.a (mgr.14355) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:44:21.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:20 smithi171 bash[25040]: cluster 2024-09-14T00:44:19.843465+0000 mgr.a (mgr.14355) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:44:21.502 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:21.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:21.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:21.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:21.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:22 smithi007 bash[22722]: audit 2024-09-14T00:44:21.086344+0000 mgr.a (mgr.14355) 6204 : audit [DBG] from='client.142569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:22 smithi007 bash[22722]: cluster 2024-09-14T00:44:21.846190+0000 mgr.a (mgr.14355) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:22 smithi131 bash[24745]: audit 2024-09-14T00:44:21.086344+0000 mgr.a (mgr.14355) 6204 : audit [DBG] from='client.142569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:22 smithi131 bash[24745]: cluster 2024-09-14T00:44:21.846190+0000 mgr.a (mgr.14355) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:22 smithi171 bash[25040]: audit 2024-09-14T00:44:21.086344+0000 mgr.a (mgr.14355) 6204 : audit [DBG] from='client.142569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:22 smithi171 bash[25040]: cluster 2024-09-14T00:44:21.846190+0000 mgr.a (mgr.14355) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:24 smithi007 bash[22722]: cluster 2024-09-14T00:44:23.847204+0000 mgr.a (mgr.14355) 6206 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:24 smithi131 bash[24745]: cluster 2024-09-14T00:44:23.847204+0000 mgr.a (mgr.14355) 6206 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:24 smithi171 bash[25040]: cluster 2024-09-14T00:44:23.847204+0000 mgr.a (mgr.14355) 6206 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:26 smithi007 bash[22722]: cluster 2024-09-14T00:44:25.849175+0000 mgr.a (mgr.14355) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:26 smithi007 bash[22722]: audit 2024-09-14T00:44:26.706973+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:44:27.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:26 smithi131 bash[24745]: cluster 2024-09-14T00:44:25.849175+0000 mgr.a (mgr.14355) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:26 smithi131 bash[24745]: audit 2024-09-14T00:44:26.706973+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:44:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:26 smithi171 bash[25040]: cluster 2024-09-14T00:44:25.849175+0000 mgr.a (mgr.14355) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:26 smithi171 bash[25040]: audit 2024-09-14T00:44:26.706973+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:27 smithi007 bash[22722]: audit 2024-09-14T00:44:26.826621+0000 mgr.a (mgr.14355) 6208 : audit [DBG] from='client.142644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:27 smithi007 bash[22722]: audit 2024-09-14T00:44:27.524719+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:27 smithi007 bash[22722]: audit 2024-09-14T00:44:27.526383+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:27 smithi007 bash[22722]: audit 2024-09-14T00:44:27.535679+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:27 smithi007 bash[22722]: audit 2024-09-14T00:44:27.538498+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:27 smithi131 bash[24745]: audit 2024-09-14T00:44:26.826621+0000 mgr.a (mgr.14355) 6208 : audit [DBG] from='client.142644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:27 smithi131 bash[24745]: audit 2024-09-14T00:44:27.524719+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:44:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:27 smithi131 bash[24745]: audit 2024-09-14T00:44:27.526383+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:44:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:27 smithi131 bash[24745]: audit 2024-09-14T00:44:27.535679+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:44:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:27 smithi131 bash[24745]: audit 2024-09-14T00:44:27.538498+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:27 smithi171 bash[25040]: audit 2024-09-14T00:44:26.826621+0000 mgr.a (mgr.14355) 6208 : audit [DBG] from='client.142644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:27 smithi171 bash[25040]: audit 2024-09-14T00:44:27.524719+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:44:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:27 smithi171 bash[25040]: audit 2024-09-14T00:44:27.526383+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:44:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:27 smithi171 bash[25040]: audit 2024-09-14T00:44:27.535679+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:44:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:27 smithi171 bash[25040]: audit 2024-09-14T00:44:27.538498+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:28.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:44:28 smithi007 bash[22972]: debug 2024-09-14T00:44:28.244+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:44:28.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:44:28 smithi007 bash[22972]: debug 2024-09-14T00:44:28.244+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:44:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:28 smithi007 bash[22722]: audit 2024-09-14T00:44:27.541174+0000 mgr.a (mgr.14355) 6209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:28 smithi007 bash[22722]: cluster 2024-09-14T00:44:27.849620+0000 mgr.a (mgr.14355) 6210 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:28 smithi131 bash[24745]: audit 2024-09-14T00:44:27.541174+0000 mgr.a (mgr.14355) 6209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:28 smithi131 bash[24745]: cluster 2024-09-14T00:44:27.849620+0000 mgr.a (mgr.14355) 6210 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:28 smithi171 bash[25040]: audit 2024-09-14T00:44:27.541174+0000 mgr.a (mgr.14355) 6209 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:44:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:28 smithi171 bash[25040]: cluster 2024-09-14T00:44:27.849620+0000 mgr.a (mgr.14355) 6210 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:29 smithi007 bash[22722]: audit 2024-09-14T00:44:28.248691+0000 mgr.a (mgr.14355) 6211 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:44:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:29 smithi007 bash[22722]: cephadm 2024-09-14T00:44:28.250119+0000 mgr.a (mgr.14355) 6212 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:44:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:29 smithi131 bash[24745]: audit 2024-09-14T00:44:28.248691+0000 mgr.a (mgr.14355) 6211 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:44:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:29 smithi131 bash[24745]: cephadm 2024-09-14T00:44:28.250119+0000 mgr.a (mgr.14355) 6212 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:44:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:29 smithi171 bash[25040]: audit 2024-09-14T00:44:28.248691+0000 mgr.a (mgr.14355) 6211 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:44:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:29 smithi171 bash[25040]: cephadm 2024-09-14T00:44:28.250119+0000 mgr.a (mgr.14355) 6212 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:44:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:30 smithi007 bash[22722]: cluster 2024-09-14T00:44:29.850462+0000 mgr.a (mgr.14355) 6213 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:30 smithi131 bash[24745]: cluster 2024-09-14T00:44:29.850462+0000 mgr.a (mgr.14355) 6213 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:30 smithi171 bash[25040]: cluster 2024-09-14T00:44:29.850462+0000 mgr.a (mgr.14355) 6213 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:32.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:32.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:32.996 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:32.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:32 smithi007 bash[22722]: cluster 2024-09-14T00:44:31.852671+0000 mgr.a (mgr.14355) 6214 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:32 smithi131 bash[24745]: cluster 2024-09-14T00:44:31.852671+0000 mgr.a (mgr.14355) 6214 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:32 smithi171 bash[25040]: cluster 2024-09-14T00:44:31.852671+0000 mgr.a (mgr.14355) 6214 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:33 smithi007 bash[22722]: audit 2024-09-14T00:44:32.588256+0000 mgr.a (mgr.14355) 6215 : audit [DBG] from='client.142827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:33 smithi131 bash[24745]: audit 2024-09-14T00:44:32.588256+0000 mgr.a (mgr.14355) 6215 : audit [DBG] from='client.142827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:33 smithi171 bash[25040]: audit 2024-09-14T00:44:32.588256+0000 mgr.a (mgr.14355) 6215 : audit [DBG] from='client.142827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:34 smithi007 bash[22722]: cluster 2024-09-14T00:44:33.853535+0000 mgr.a (mgr.14355) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:34 smithi131 bash[24745]: cluster 2024-09-14T00:44:33.853535+0000 mgr.a (mgr.14355) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:34 smithi171 bash[25040]: cluster 2024-09-14T00:44:33.853535+0000 mgr.a (mgr.14355) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:36 smithi007 bash[22722]: cluster 2024-09-14T00:44:35.855722+0000 mgr.a (mgr.14355) 6217 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:36 smithi131 bash[24745]: cluster 2024-09-14T00:44:35.855722+0000 mgr.a (mgr.14355) 6217 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:36 smithi171 bash[25040]: cluster 2024-09-14T00:44:35.855722+0000 mgr.a (mgr.14355) 6217 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:37.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:37.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:37.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:38.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:38.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:38 smithi007 bash[22722]: cluster 2024-09-14T00:44:37.856446+0000 mgr.a (mgr.14355) 6218 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:38 smithi131 bash[24745]: cluster 2024-09-14T00:44:37.856446+0000 mgr.a (mgr.14355) 6218 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:38 smithi171 bash[25040]: cluster 2024-09-14T00:44:37.856446+0000 mgr.a (mgr.14355) 6218 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:39 smithi131 bash[24745]: audit 2024-09-14T00:44:38.333401+0000 mgr.a (mgr.14355) 6219 : audit [DBG] from='client.142905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:39 smithi171 bash[25040]: audit 2024-09-14T00:44:38.333401+0000 mgr.a (mgr.14355) 6219 : audit [DBG] from='client.142905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:39 smithi007 bash[22722]: audit 2024-09-14T00:44:38.333401+0000 mgr.a (mgr.14355) 6219 : audit [DBG] from='client.142905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:40 smithi131 bash[24745]: cluster 2024-09-14T00:44:39.857343+0000 mgr.a (mgr.14355) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:40 smithi171 bash[25040]: cluster 2024-09-14T00:44:39.857343+0000 mgr.a (mgr.14355) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:40 smithi007 bash[22722]: cluster 2024-09-14T00:44:39.857343+0000 mgr.a (mgr.14355) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:42 smithi131 bash[24745]: cluster 2024-09-14T00:44:41.859599+0000 mgr.a (mgr.14355) 6221 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:42 smithi171 bash[25040]: cluster 2024-09-14T00:44:41.859599+0000 mgr.a (mgr.14355) 6221 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:42 smithi007 bash[22722]: cluster 2024-09-14T00:44:41.859599+0000 mgr.a (mgr.14355) 6221 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:44:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:44.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:44.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:44 smithi131 bash[24745]: cluster 2024-09-14T00:44:43.860033+0000 mgr.a (mgr.14355) 6222 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:44 smithi171 bash[25040]: cluster 2024-09-14T00:44:43.860033+0000 mgr.a (mgr.14355) 6222 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:44 smithi007 bash[22722]: cluster 2024-09-14T00:44:43.860033+0000 mgr.a (mgr.14355) 6222 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:45 smithi131 bash[24745]: audit 2024-09-14T00:44:44.094319+0000 mgr.a (mgr.14355) 6223 : audit [DBG] from='client.142977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:45 smithi171 bash[25040]: audit 2024-09-14T00:44:44.094319+0000 mgr.a (mgr.14355) 6223 : audit [DBG] from='client.142977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:45 smithi007 bash[22722]: audit 2024-09-14T00:44:44.094319+0000 mgr.a (mgr.14355) 6223 : audit [DBG] from='client.142977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:46 smithi131 bash[24745]: cluster 2024-09-14T00:44:45.862275+0000 mgr.a (mgr.14355) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:46 smithi171 bash[25040]: cluster 2024-09-14T00:44:45.862275+0000 mgr.a (mgr.14355) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:46 smithi007 bash[22722]: cluster 2024-09-14T00:44:45.862275+0000 mgr.a (mgr.14355) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:44:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:48 smithi131 bash[24745]: cluster 2024-09-14T00:44:47.863082+0000 mgr.a (mgr.14355) 6225 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:48 smithi171 bash[25040]: cluster 2024-09-14T00:44:47.863082+0000 mgr.a (mgr.14355) 6225 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:48 smithi007 bash[22722]: cluster 2024-09-14T00:44:47.863082+0000 mgr.a (mgr.14355) 6225 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:49.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:49.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:49.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:50.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:50.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:50 smithi131 bash[24745]: audit 2024-09-14T00:44:49.846615+0000 mgr.a (mgr.14355) 6226 : audit [DBG] from='client.143055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:51.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:50 smithi131 bash[24745]: cluster 2024-09-14T00:44:49.864535+0000 mgr.a (mgr.14355) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:50 smithi171 bash[25040]: audit 2024-09-14T00:44:49.846615+0000 mgr.a (mgr.14355) 6226 : audit [DBG] from='client.143055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:50 smithi171 bash[25040]: cluster 2024-09-14T00:44:49.864535+0000 mgr.a (mgr.14355) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:50 smithi007 bash[22722]: audit 2024-09-14T00:44:49.846615+0000 mgr.a (mgr.14355) 6226 : audit [DBG] from='client.143055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:50 smithi007 bash[22722]: cluster 2024-09-14T00:44:49.864535+0000 mgr.a (mgr.14355) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:52 smithi131 bash[24745]: cluster 2024-09-14T00:44:51.867118+0000 mgr.a (mgr.14355) 6228 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:44:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:52 smithi171 bash[25040]: cluster 2024-09-14T00:44:51.867118+0000 mgr.a (mgr.14355) 6228 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:44:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:52 smithi007 bash[22722]: cluster 2024-09-14T00:44:51.867118+0000 mgr.a (mgr.14355) 6228 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:44:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:54 smithi131 bash[24745]: cluster 2024-09-14T00:44:53.867928+0000 mgr.a (mgr.14355) 6229 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:44:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:44:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:44:55.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:44:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:54 smithi171 bash[25040]: cluster 2024-09-14T00:44:53.867928+0000 mgr.a (mgr.14355) 6229 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:44:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:54 smithi007 bash[22722]: cluster 2024-09-14T00:44:53.867928+0000 mgr.a (mgr.14355) 6229 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:44:56.054 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:44:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:44:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:44:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:44:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:44:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:56 smithi131 bash[24745]: audit 2024-09-14T00:44:55.619370+0000 mgr.a (mgr.14355) 6230 : audit [DBG] from='client.143124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:57.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:56 smithi131 bash[24745]: cluster 2024-09-14T00:44:55.869208+0000 mgr.a (mgr.14355) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:56 smithi171 bash[25040]: audit 2024-09-14T00:44:55.619370+0000 mgr.a (mgr.14355) 6230 : audit [DBG] from='client.143124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:56 smithi171 bash[25040]: cluster 2024-09-14T00:44:55.869208+0000 mgr.a (mgr.14355) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:56 smithi007 bash[22722]: audit 2024-09-14T00:44:55.619370+0000 mgr.a (mgr.14355) 6230 : audit [DBG] from='client.143124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:44:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:56 smithi007 bash[22722]: cluster 2024-09-14T00:44:55.869208+0000 mgr.a (mgr.14355) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:44:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:44:59 smithi131 bash[24745]: cluster 2024-09-14T00:44:57.870058+0000 mgr.a (mgr.14355) 6232 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:44:59 smithi171 bash[25040]: cluster 2024-09-14T00:44:57.870058+0000 mgr.a (mgr.14355) 6232 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:44:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:44:59 smithi007 bash[22722]: cluster 2024-09-14T00:44:57.870058+0000 mgr.a (mgr.14355) 6232 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:45:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:00 smithi131 bash[24745]: cluster 2024-09-14T00:44:59.870821+0000 mgr.a (mgr.14355) 6233 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:45:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:00 smithi171 bash[25040]: cluster 2024-09-14T00:44:59.870821+0000 mgr.a (mgr.14355) 6233 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:45:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:00 smithi007 bash[22722]: cluster 2024-09-14T00:44:59.870821+0000 mgr.a (mgr.14355) 6233 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:45:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:01.057 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:01.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:01.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:01.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:02 smithi007 bash[22722]: audit 2024-09-14T00:45:01.396825+0000 mgr.a (mgr.14355) 6234 : audit [DBG] from='client.143202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:02 smithi007 bash[22722]: cluster 2024-09-14T00:45:01.872108+0000 mgr.a (mgr.14355) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:02 smithi131 bash[24745]: audit 2024-09-14T00:45:01.396825+0000 mgr.a (mgr.14355) 6234 : audit [DBG] from='client.143202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:03.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:02 smithi131 bash[24745]: cluster 2024-09-14T00:45:01.872108+0000 mgr.a (mgr.14355) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:02 smithi171 bash[25040]: audit 2024-09-14T00:45:01.396825+0000 mgr.a (mgr.14355) 6234 : audit [DBG] from='client.143202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:02 smithi171 bash[25040]: cluster 2024-09-14T00:45:01.872108+0000 mgr.a (mgr.14355) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:04 smithi007 bash[22722]: cluster 2024-09-14T00:45:03.872855+0000 mgr.a (mgr.14355) 6236 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:45:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:04 smithi131 bash[24745]: cluster 2024-09-14T00:45:03.872855+0000 mgr.a (mgr.14355) 6236 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:45:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:04 smithi171 bash[25040]: cluster 2024-09-14T00:45:03.872855+0000 mgr.a (mgr.14355) 6236 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:45:06.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:06.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:06 smithi007 bash[22722]: cluster 2024-09-14T00:45:05.874805+0000 mgr.a (mgr.14355) 6237 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:45:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:06 smithi131 bash[24745]: cluster 2024-09-14T00:45:05.874805+0000 mgr.a (mgr.14355) 6237 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:45:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:06 smithi171 bash[25040]: cluster 2024-09-14T00:45:05.874805+0000 mgr.a (mgr.14355) 6237 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:45:07.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:08 smithi007 bash[22722]: audit 2024-09-14T00:45:07.180429+0000 mgr.a (mgr.14355) 6238 : audit [DBG] from='client.143277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:08 smithi007 bash[22722]: cluster 2024-09-14T00:45:07.875713+0000 mgr.a (mgr.14355) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:08 smithi131 bash[24745]: audit 2024-09-14T00:45:07.180429+0000 mgr.a (mgr.14355) 6238 : audit [DBG] from='client.143277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:08 smithi131 bash[24745]: cluster 2024-09-14T00:45:07.875713+0000 mgr.a (mgr.14355) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:08 smithi171 bash[25040]: audit 2024-09-14T00:45:07.180429+0000 mgr.a (mgr.14355) 6238 : audit [DBG] from='client.143277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:08 smithi171 bash[25040]: cluster 2024-09-14T00:45:07.875713+0000 mgr.a (mgr.14355) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:10 smithi007 bash[22722]: cluster 2024-09-14T00:45:09.876480+0000 mgr.a (mgr.14355) 6240 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:10 smithi131 bash[24745]: cluster 2024-09-14T00:45:09.876480+0000 mgr.a (mgr.14355) 6240 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:10 smithi171 bash[25040]: cluster 2024-09-14T00:45:09.876480+0000 mgr.a (mgr.14355) 6240 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:12.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:12 smithi007 bash[22722]: cluster 2024-09-14T00:45:11.878709+0000 mgr.a (mgr.14355) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:12 smithi131 bash[24745]: cluster 2024-09-14T00:45:11.878709+0000 mgr.a (mgr.14355) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:12 smithi171 bash[25040]: cluster 2024-09-14T00:45:11.878709+0000 mgr.a (mgr.14355) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:13.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:13 smithi007 bash[22722]: audit 2024-09-14T00:45:12.928110+0000 mgr.a (mgr.14355) 6242 : audit [DBG] from='client.143352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:13 smithi131 bash[24745]: audit 2024-09-14T00:45:12.928110+0000 mgr.a (mgr.14355) 6242 : audit [DBG] from='client.143352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:13 smithi171 bash[25040]: audit 2024-09-14T00:45:12.928110+0000 mgr.a (mgr.14355) 6242 : audit [DBG] from='client.143352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:14 smithi131 bash[24745]: cluster 2024-09-14T00:45:13.879680+0000 mgr.a (mgr.14355) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:14 smithi171 bash[25040]: cluster 2024-09-14T00:45:13.879680+0000 mgr.a (mgr.14355) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:14 smithi007 bash[22722]: cluster 2024-09-14T00:45:13.879680+0000 mgr.a (mgr.14355) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:16 smithi131 bash[24745]: cluster 2024-09-14T00:45:15.881866+0000 mgr.a (mgr.14355) 6244 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:16 smithi171 bash[25040]: cluster 2024-09-14T00:45:15.881866+0000 mgr.a (mgr.14355) 6244 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:16 smithi007 bash[22722]: cluster 2024-09-14T00:45:15.881866+0000 mgr.a (mgr.14355) 6244 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:18.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:18.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:18.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:19.082 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:19.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:19.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:19.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:19.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:18 smithi131 bash[24745]: cluster 2024-09-14T00:45:17.882687+0000 mgr.a (mgr.14355) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:18 smithi171 bash[25040]: cluster 2024-09-14T00:45:17.882687+0000 mgr.a (mgr.14355) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:18 smithi007 bash[22722]: cluster 2024-09-14T00:45:17.882687+0000 mgr.a (mgr.14355) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:19 smithi131 bash[24745]: audit 2024-09-14T00:45:18.665547+0000 mgr.a (mgr.14355) 6246 : audit [DBG] from='client.143430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:19 smithi171 bash[25040]: audit 2024-09-14T00:45:18.665547+0000 mgr.a (mgr.14355) 6246 : audit [DBG] from='client.143430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:19 smithi007 bash[22722]: audit 2024-09-14T00:45:18.665547+0000 mgr.a (mgr.14355) 6246 : audit [DBG] from='client.143430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:20 smithi131 bash[24745]: cluster 2024-09-14T00:45:19.883628+0000 mgr.a (mgr.14355) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:20 smithi171 bash[25040]: cluster 2024-09-14T00:45:19.883628+0000 mgr.a (mgr.14355) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:20 smithi007 bash[22722]: cluster 2024-09-14T00:45:19.883628+0000 mgr.a (mgr.14355) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:22 smithi131 bash[24745]: cluster 2024-09-14T00:45:21.885907+0000 mgr.a (mgr.14355) 6248 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:22 smithi171 bash[25040]: cluster 2024-09-14T00:45:21.885907+0000 mgr.a (mgr.14355) 6248 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:22 smithi007 bash[22722]: cluster 2024-09-14T00:45:21.885907+0000 mgr.a (mgr.14355) 6248 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:24.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:24.085 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:24.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:24.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:24 smithi131 bash[24745]: cluster 2024-09-14T00:45:23.886706+0000 mgr.a (mgr.14355) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:24 smithi171 bash[25040]: cluster 2024-09-14T00:45:23.886706+0000 mgr.a (mgr.14355) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:24 smithi007 bash[22722]: cluster 2024-09-14T00:45:23.886706+0000 mgr.a (mgr.14355) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:25 smithi131 bash[24745]: audit 2024-09-14T00:45:24.420599+0000 mgr.a (mgr.14355) 6250 : audit [DBG] from='client.143508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:25 smithi171 bash[25040]: audit 2024-09-14T00:45:24.420599+0000 mgr.a (mgr.14355) 6250 : audit [DBG] from='client.143508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:25 smithi007 bash[22722]: audit 2024-09-14T00:45:24.420599+0000 mgr.a (mgr.14355) 6250 : audit [DBG] from='client.143508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:26 smithi131 bash[24745]: cluster 2024-09-14T00:45:25.889034+0000 mgr.a (mgr.14355) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:26 smithi171 bash[25040]: cluster 2024-09-14T00:45:25.889034+0000 mgr.a (mgr.14355) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:26 smithi007 bash[22722]: cluster 2024-09-14T00:45:25.889034+0000 mgr.a (mgr.14355) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:29 smithi131 bash[24745]: cluster 2024-09-14T00:45:27.889797+0000 mgr.a (mgr.14355) 6252 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:29 smithi131 bash[24745]: audit 2024-09-14T00:45:28.301551+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:45:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:29 smithi171 bash[25040]: cluster 2024-09-14T00:45:27.889797+0000 mgr.a (mgr.14355) 6252 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:29 smithi171 bash[25040]: audit 2024-09-14T00:45:28.301551+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:45:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:29 smithi007 bash[22722]: cluster 2024-09-14T00:45:27.889797+0000 mgr.a (mgr.14355) 6252 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:29 smithi007 bash[22722]: audit 2024-09-14T00:45:28.301551+0000 mon.a (mon.0) 1533 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:45:29.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:29.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:30.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:45:29 smithi007 bash[22972]: debug 2024-09-14T00:45:29.895+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:45:30.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:45:29 smithi007 bash[22972]: debug 2024-09-14T00:45:29.895+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:45:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:30 smithi007 bash[22722]: audit 2024-09-14T00:45:29.158729+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:45:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:30 smithi007 bash[22722]: audit 2024-09-14T00:45:29.160324+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:45:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:30 smithi007 bash[22722]: audit 2024-09-14T00:45:29.169945+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:45:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:30 smithi007 bash[22722]: audit 2024-09-14T00:45:29.174666+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:30 smithi131 bash[24745]: audit 2024-09-14T00:45:29.158729+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:45:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:30 smithi131 bash[24745]: audit 2024-09-14T00:45:29.160324+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:45:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:30 smithi131 bash[24745]: audit 2024-09-14T00:45:29.169945+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:45:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:30 smithi131 bash[24745]: audit 2024-09-14T00:45:29.174666+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:30 smithi171 bash[25040]: audit 2024-09-14T00:45:29.158729+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:45:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:30 smithi171 bash[25040]: audit 2024-09-14T00:45:29.160324+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:45:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:30 smithi171 bash[25040]: audit 2024-09-14T00:45:29.169945+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:45:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:30 smithi171 bash[25040]: audit 2024-09-14T00:45:29.174666+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:30.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:30.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:31 smithi131 bash[24745]: audit 2024-09-14T00:45:29.175967+0000 mgr.a (mgr.14355) 6253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:31 smithi131 bash[24745]: cluster 2024-09-14T00:45:29.890373+0000 mgr.a (mgr.14355) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:31 smithi131 bash[24745]: audit 2024-09-14T00:45:29.899441+0000 mgr.a (mgr.14355) 6255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:45:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:31 smithi131 bash[24745]: cephadm 2024-09-14T00:45:29.900653+0000 mgr.a (mgr.14355) 6256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:45:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:31 smithi171 bash[25040]: audit 2024-09-14T00:45:29.175967+0000 mgr.a (mgr.14355) 6253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:31 smithi171 bash[25040]: cluster 2024-09-14T00:45:29.890373+0000 mgr.a (mgr.14355) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:31 smithi171 bash[25040]: audit 2024-09-14T00:45:29.899441+0000 mgr.a (mgr.14355) 6255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:45:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:31 smithi171 bash[25040]: cephadm 2024-09-14T00:45:29.900653+0000 mgr.a (mgr.14355) 6256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:45:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:31 smithi007 bash[22722]: audit 2024-09-14T00:45:29.175967+0000 mgr.a (mgr.14355) 6253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:45:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:31 smithi007 bash[22722]: cluster 2024-09-14T00:45:29.890373+0000 mgr.a (mgr.14355) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:31 smithi007 bash[22722]: audit 2024-09-14T00:45:29.899441+0000 mgr.a (mgr.14355) 6255 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:45:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:31 smithi007 bash[22722]: cephadm 2024-09-14T00:45:29.900653+0000 mgr.a (mgr.14355) 6256 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:45:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:32 smithi131 bash[24745]: audit 2024-09-14T00:45:30.164392+0000 mgr.a (mgr.14355) 6257 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:32 smithi171 bash[25040]: audit 2024-09-14T00:45:30.164392+0000 mgr.a (mgr.14355) 6257 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:32 smithi007 bash[22722]: audit 2024-09-14T00:45:30.164392+0000 mgr.a (mgr.14355) 6257 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:33 smithi131 bash[24745]: cluster 2024-09-14T00:45:31.893101+0000 mgr.a (mgr.14355) 6258 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:33 smithi171 bash[25040]: cluster 2024-09-14T00:45:31.893101+0000 mgr.a (mgr.14355) 6258 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:33 smithi007 bash[22722]: cluster 2024-09-14T00:45:31.893101+0000 mgr.a (mgr.14355) 6258 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:34 smithi131 bash[24745]: cluster 2024-09-14T00:45:33.893908+0000 mgr.a (mgr.14355) 6259 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:34 smithi171 bash[25040]: cluster 2024-09-14T00:45:33.893908+0000 mgr.a (mgr.14355) 6259 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:34 smithi007 bash[22722]: cluster 2024-09-14T00:45:33.893908+0000 mgr.a (mgr.14355) 6259 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:35.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:35.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:36.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:36.350 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:36 smithi007 bash[22722]: cluster 2024-09-14T00:45:35.895986+0000 mgr.a (mgr.14355) 6260 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:36 smithi007 bash[22722]: audit 2024-09-14T00:45:35.912409+0000 mgr.a (mgr.14355) 6261 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:36 smithi131 bash[24745]: cluster 2024-09-14T00:45:35.895986+0000 mgr.a (mgr.14355) 6260 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:36 smithi131 bash[24745]: audit 2024-09-14T00:45:35.912409+0000 mgr.a (mgr.14355) 6261 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:36 smithi171 bash[25040]: cluster 2024-09-14T00:45:35.895986+0000 mgr.a (mgr.14355) 6260 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:36 smithi171 bash[25040]: audit 2024-09-14T00:45:35.912409+0000 mgr.a (mgr.14355) 6261 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:38 smithi131 bash[24745]: cluster 2024-09-14T00:45:37.896998+0000 mgr.a (mgr.14355) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:38 smithi171 bash[25040]: cluster 2024-09-14T00:45:37.896998+0000 mgr.a (mgr.14355) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:38 smithi007 bash[22722]: cluster 2024-09-14T00:45:37.896998+0000 mgr.a (mgr.14355) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:40 smithi131 bash[24745]: cluster 2024-09-14T00:45:39.897956+0000 mgr.a (mgr.14355) 6263 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:40 smithi171 bash[25040]: cluster 2024-09-14T00:45:39.897956+0000 mgr.a (mgr.14355) 6263 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:41.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:41.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:41.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:40 smithi007 bash[22722]: cluster 2024-09-14T00:45:39.897956+0000 mgr.a (mgr.14355) 6263 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:45:42.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:42.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:42 smithi131 bash[24745]: audit 2024-09-14T00:45:41.678937+0000 mgr.a (mgr.14355) 6264 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:42 smithi131 bash[24745]: cluster 2024-09-14T00:45:41.899338+0000 mgr.a (mgr.14355) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:42 smithi171 bash[25040]: audit 2024-09-14T00:45:41.678937+0000 mgr.a (mgr.14355) 6264 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:42 smithi171 bash[25040]: cluster 2024-09-14T00:45:41.899338+0000 mgr.a (mgr.14355) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:42 smithi007 bash[22722]: audit 2024-09-14T00:45:41.678937+0000 mgr.a (mgr.14355) 6264 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:42 smithi007 bash[22722]: cluster 2024-09-14T00:45:41.899338+0000 mgr.a (mgr.14355) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:45:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:44 smithi131 bash[24745]: cluster 2024-09-14T00:45:43.900336+0000 mgr.a (mgr.14355) 6266 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:44 smithi171 bash[25040]: cluster 2024-09-14T00:45:43.900336+0000 mgr.a (mgr.14355) 6266 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:44 smithi007 bash[22722]: cluster 2024-09-14T00:45:43.900336+0000 mgr.a (mgr.14355) 6266 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:47.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:47.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:46 smithi131 bash[24745]: cluster 2024-09-14T00:45:45.902610+0000 mgr.a (mgr.14355) 6267 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:46 smithi171 bash[25040]: cluster 2024-09-14T00:45:45.902610+0000 mgr.a (mgr.14355) 6267 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:46 smithi007 bash[22722]: cluster 2024-09-14T00:45:45.902610+0000 mgr.a (mgr.14355) 6267 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:47.859 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:47.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:47.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:48 smithi131 bash[24745]: audit 2024-09-14T00:45:47.445807+0000 mgr.a (mgr.14355) 6268 : audit [DBG] from='client.143925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:48 smithi131 bash[24745]: cluster 2024-09-14T00:45:47.903525+0000 mgr.a (mgr.14355) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:48 smithi171 bash[25040]: audit 2024-09-14T00:45:47.445807+0000 mgr.a (mgr.14355) 6268 : audit [DBG] from='client.143925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:48 smithi171 bash[25040]: cluster 2024-09-14T00:45:47.903525+0000 mgr.a (mgr.14355) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:48 smithi007 bash[22722]: audit 2024-09-14T00:45:47.445807+0000 mgr.a (mgr.14355) 6268 : audit [DBG] from='client.143925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:48 smithi007 bash[22722]: cluster 2024-09-14T00:45:47.903525+0000 mgr.a (mgr.14355) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:50 smithi131 bash[24745]: cluster 2024-09-14T00:45:49.904331+0000 mgr.a (mgr.14355) 6270 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:50 smithi171 bash[25040]: cluster 2024-09-14T00:45:49.904331+0000 mgr.a (mgr.14355) 6270 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:50 smithi007 bash[22722]: cluster 2024-09-14T00:45:49.904331+0000 mgr.a (mgr.14355) 6270 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:52.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:52 smithi131 bash[24745]: cluster 2024-09-14T00:45:51.906604+0000 mgr.a (mgr.14355) 6271 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:52 smithi171 bash[25040]: cluster 2024-09-14T00:45:51.906604+0000 mgr.a (mgr.14355) 6271 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:52 smithi007 bash[22722]: cluster 2024-09-14T00:45:51.906604+0000 mgr.a (mgr.14355) 6271 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:53.613 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:53.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:54 smithi131 bash[24745]: audit 2024-09-14T00:45:53.189198+0000 mgr.a (mgr.14355) 6272 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:54 smithi131 bash[24745]: cluster 2024-09-14T00:45:53.907554+0000 mgr.a (mgr.14355) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:54 smithi171 bash[25040]: audit 2024-09-14T00:45:53.189198+0000 mgr.a (mgr.14355) 6272 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:54 smithi171 bash[25040]: cluster 2024-09-14T00:45:53.907554+0000 mgr.a (mgr.14355) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:54 smithi007 bash[22722]: audit 2024-09-14T00:45:53.189198+0000 mgr.a (mgr.14355) 6272 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:45:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:54 smithi007 bash[22722]: cluster 2024-09-14T00:45:53.907554+0000 mgr.a (mgr.14355) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:56 smithi131 bash[24745]: cluster 2024-09-14T00:45:55.909758+0000 mgr.a (mgr.14355) 6274 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:56 smithi171 bash[25040]: cluster 2024-09-14T00:45:55.909758+0000 mgr.a (mgr.14355) 6274 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:56 smithi007 bash[22722]: cluster 2024-09-14T00:45:55.909758+0000 mgr.a (mgr.14355) 6274 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:45:58.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:45:58.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:45:58.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:45:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:58 smithi131 bash[24745]: cluster 2024-09-14T00:45:57.910530+0000 mgr.a (mgr.14355) 6275 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:58 smithi171 bash[25040]: cluster 2024-09-14T00:45:57.910530+0000 mgr.a (mgr.14355) 6275 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:45:59.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:45:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:45:59.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:45:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:45:59.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:45:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:58 smithi007 bash[22722]: cluster 2024-09-14T00:45:57.910530+0000 mgr.a (mgr.14355) 6275 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:45:59 smithi131 bash[24745]: audit 2024-09-14T00:45:58.950516+0000 mgr.a (mgr.14355) 6276 : audit [DBG] from='client.144078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:45:59 smithi171 bash[25040]: audit 2024-09-14T00:45:58.950516+0000 mgr.a (mgr.14355) 6276 : audit [DBG] from='client.144078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:45:59 smithi007 bash[22722]: audit 2024-09-14T00:45:58.950516+0000 mgr.a (mgr.14355) 6276 : audit [DBG] from='client.144078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:00 smithi131 bash[24745]: cluster 2024-09-14T00:45:59.911354+0000 mgr.a (mgr.14355) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:00 smithi171 bash[25040]: cluster 2024-09-14T00:45:59.911354+0000 mgr.a (mgr.14355) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:00 smithi007 bash[22722]: cluster 2024-09-14T00:45:59.911354+0000 mgr.a (mgr.14355) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:03 smithi131 bash[24745]: cluster 2024-09-14T00:46:01.913781+0000 mgr.a (mgr.14355) 6278 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:03 smithi171 bash[25040]: cluster 2024-09-14T00:46:01.913781+0000 mgr.a (mgr.14355) 6278 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:03 smithi007 bash[22722]: cluster 2024-09-14T00:46:01.913781+0000 mgr.a (mgr.14355) 6278 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:04.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:04.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:04.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:05.123 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:05.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:05 smithi131 bash[24745]: cluster 2024-09-14T00:46:03.914734+0000 mgr.a (mgr.14355) 6279 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:05 smithi171 bash[25040]: cluster 2024-09-14T00:46:03.914734+0000 mgr.a (mgr.14355) 6279 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:05 smithi007 bash[22722]: cluster 2024-09-14T00:46:03.914734+0000 mgr.a (mgr.14355) 6279 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:06 smithi131 bash[24745]: audit 2024-09-14T00:46:04.727590+0000 mgr.a (mgr.14355) 6280 : audit [DBG] from='client.144150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:06 smithi171 bash[25040]: audit 2024-09-14T00:46:04.727590+0000 mgr.a (mgr.14355) 6280 : audit [DBG] from='client.144150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:06 smithi007 bash[22722]: audit 2024-09-14T00:46:04.727590+0000 mgr.a (mgr.14355) 6280 : audit [DBG] from='client.144150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:07 smithi131 bash[24745]: cluster 2024-09-14T00:46:05.917249+0000 mgr.a (mgr.14355) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:07 smithi171 bash[25040]: cluster 2024-09-14T00:46:05.917249+0000 mgr.a (mgr.14355) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:07 smithi007 bash[22722]: cluster 2024-09-14T00:46:05.917249+0000 mgr.a (mgr.14355) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:09 smithi131 bash[24745]: cluster 2024-09-14T00:46:07.918206+0000 mgr.a (mgr.14355) 6282 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:09 smithi171 bash[25040]: cluster 2024-09-14T00:46:07.918206+0000 mgr.a (mgr.14355) 6282 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:09 smithi007 bash[22722]: cluster 2024-09-14T00:46:07.918206+0000 mgr.a (mgr.14355) 6282 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:10.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:10.125 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:10.125 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:10 smithi007 bash[22722]: cluster 2024-09-14T00:46:09.919165+0000 mgr.a (mgr.14355) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:10 smithi131 bash[24745]: cluster 2024-09-14T00:46:09.919165+0000 mgr.a (mgr.14355) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:10 smithi171 bash[25040]: cluster 2024-09-14T00:46:09.919165+0000 mgr.a (mgr.14355) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:10.908 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:10.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:10.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:10.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:10.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:11 smithi007 bash[22722]: audit 2024-09-14T00:46:10.464564+0000 mgr.a (mgr.14355) 6284 : audit [DBG] from='client.144228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:11 smithi131 bash[24745]: audit 2024-09-14T00:46:10.464564+0000 mgr.a (mgr.14355) 6284 : audit [DBG] from='client.144228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:11 smithi171 bash[25040]: audit 2024-09-14T00:46:10.464564+0000 mgr.a (mgr.14355) 6284 : audit [DBG] from='client.144228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:12 smithi007 bash[22722]: cluster 2024-09-14T00:46:11.921935+0000 mgr.a (mgr.14355) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:12 smithi131 bash[24745]: cluster 2024-09-14T00:46:11.921935+0000 mgr.a (mgr.14355) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:12 smithi171 bash[25040]: cluster 2024-09-14T00:46:11.921935+0000 mgr.a (mgr.14355) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:14 smithi131 bash[24745]: cluster 2024-09-14T00:46:13.922735+0000 mgr.a (mgr.14355) 6286 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:14 smithi171 bash[25040]: cluster 2024-09-14T00:46:13.922735+0000 mgr.a (mgr.14355) 6286 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:14 smithi007 bash[22722]: cluster 2024-09-14T00:46:13.922735+0000 mgr.a (mgr.14355) 6286 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:15.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:16.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:16 smithi131 bash[24745]: cluster 2024-09-14T00:46:15.924756+0000 mgr.a (mgr.14355) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:16 smithi171 bash[25040]: cluster 2024-09-14T00:46:15.924756+0000 mgr.a (mgr.14355) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:16 smithi007 bash[22722]: cluster 2024-09-14T00:46:15.924756+0000 mgr.a (mgr.14355) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:17 smithi131 bash[24745]: audit 2024-09-14T00:46:16.246067+0000 mgr.a (mgr.14355) 6288 : audit [DBG] from='client.144306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:17 smithi171 bash[25040]: audit 2024-09-14T00:46:16.246067+0000 mgr.a (mgr.14355) 6288 : audit [DBG] from='client.144306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:17 smithi007 bash[22722]: audit 2024-09-14T00:46:16.246067+0000 mgr.a (mgr.14355) 6288 : audit [DBG] from='client.144306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:18 smithi131 bash[24745]: cluster 2024-09-14T00:46:17.925821+0000 mgr.a (mgr.14355) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:18 smithi171 bash[25040]: cluster 2024-09-14T00:46:17.925821+0000 mgr.a (mgr.14355) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:18 smithi007 bash[22722]: cluster 2024-09-14T00:46:17.925821+0000 mgr.a (mgr.14355) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:20 smithi131 bash[24745]: cluster 2024-09-14T00:46:19.926804+0000 mgr.a (mgr.14355) 6290 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:20 smithi171 bash[25040]: cluster 2024-09-14T00:46:19.926804+0000 mgr.a (mgr.14355) 6290 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:20 smithi007 bash[22722]: cluster 2024-09-14T00:46:19.926804+0000 mgr.a (mgr.14355) 6290 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:21.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:22.456 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:23 smithi131 bash[24745]: cluster 2024-09-14T00:46:21.929106+0000 mgr.a (mgr.14355) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:23 smithi131 bash[24745]: audit 2024-09-14T00:46:22.021381+0000 mgr.a (mgr.14355) 6292 : audit [DBG] from='client.144381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:23 smithi171 bash[25040]: cluster 2024-09-14T00:46:21.929106+0000 mgr.a (mgr.14355) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:23 smithi171 bash[25040]: audit 2024-09-14T00:46:22.021381+0000 mgr.a (mgr.14355) 6292 : audit [DBG] from='client.144381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:23 smithi007 bash[22722]: cluster 2024-09-14T00:46:21.929106+0000 mgr.a (mgr.14355) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:23 smithi007 bash[22722]: audit 2024-09-14T00:46:22.021381+0000 mgr.a (mgr.14355) 6292 : audit [DBG] from='client.144381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:25 smithi131 bash[24745]: cluster 2024-09-14T00:46:23.930049+0000 mgr.a (mgr.14355) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:25 smithi171 bash[25040]: cluster 2024-09-14T00:46:23.930049+0000 mgr.a (mgr.14355) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:25 smithi007 bash[22722]: cluster 2024-09-14T00:46:23.930049+0000 mgr.a (mgr.14355) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:27 smithi131 bash[24745]: cluster 2024-09-14T00:46:25.932436+0000 mgr.a (mgr.14355) 6294 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:27 smithi171 bash[25040]: cluster 2024-09-14T00:46:25.932436+0000 mgr.a (mgr.14355) 6294 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:27 smithi007 bash[22722]: cluster 2024-09-14T00:46:25.932436+0000 mgr.a (mgr.14355) 6294 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:27.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:27.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:27.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:28.204 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:28.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:28.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:29 smithi131 bash[24745]: audit 2024-09-14T00:46:27.792090+0000 mgr.a (mgr.14355) 6295 : audit [DBG] from='client.144459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:29 smithi131 bash[24745]: cluster 2024-09-14T00:46:27.933091+0000 mgr.a (mgr.14355) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:29 smithi171 bash[25040]: audit 2024-09-14T00:46:27.792090+0000 mgr.a (mgr.14355) 6295 : audit [DBG] from='client.144459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:29 smithi171 bash[25040]: cluster 2024-09-14T00:46:27.933091+0000 mgr.a (mgr.14355) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:29 smithi007 bash[22722]: audit 2024-09-14T00:46:27.792090+0000 mgr.a (mgr.14355) 6295 : audit [DBG] from='client.144459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:29 smithi007 bash[22722]: cluster 2024-09-14T00:46:27.933091+0000 mgr.a (mgr.14355) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:30 smithi131 bash[24745]: audit 2024-09-14T00:46:29.950871+0000 mon.a (mon.0) 1538 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:46:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:30 smithi171 bash[25040]: audit 2024-09-14T00:46:29.950871+0000 mon.a (mon.0) 1538 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:46:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:30 smithi007 bash[22722]: audit 2024-09-14T00:46:29.950871+0000 mon.a (mon.0) 1538 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:46:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:31 smithi131 bash[24745]: cluster 2024-09-14T00:46:29.933958+0000 mgr.a (mgr.14355) 6297 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:31 smithi131 bash[24745]: audit 2024-09-14T00:46:30.798323+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:46:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:31 smithi131 bash[24745]: audit 2024-09-14T00:46:30.799856+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:46:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:31 smithi131 bash[24745]: audit 2024-09-14T00:46:30.810045+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:46:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:31 smithi131 bash[24745]: audit 2024-09-14T00:46:30.815129+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:31 smithi171 bash[25040]: cluster 2024-09-14T00:46:29.933958+0000 mgr.a (mgr.14355) 6297 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:31 smithi171 bash[25040]: audit 2024-09-14T00:46:30.798323+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:31 smithi171 bash[25040]: audit 2024-09-14T00:46:30.799856+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:31 smithi171 bash[25040]: audit 2024-09-14T00:46:30.810045+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:31 smithi171 bash[25040]: audit 2024-09-14T00:46:30.815129+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22722]: cluster 2024-09-14T00:46:29.933958+0000 mgr.a (mgr.14355) 6297 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22722]: audit 2024-09-14T00:46:30.798323+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:46:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22722]: audit 2024-09-14T00:46:30.799856+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:46:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22722]: audit 2024-09-14T00:46:30.810045+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:46:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22722]: audit 2024-09-14T00:46:30.815129+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22972]: debug 2024-09-14T00:46:31.534+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:46:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:46:31 smithi007 bash[22972]: debug 2024-09-14T00:46:31.538+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:46:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:32 smithi131 bash[24745]: audit 2024-09-14T00:46:30.817411+0000 mgr.a (mgr.14355) 6298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:32 smithi171 bash[25040]: audit 2024-09-14T00:46:30.817411+0000 mgr.a (mgr.14355) 6298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:32 smithi007 bash[22722]: audit 2024-09-14T00:46:30.817411+0000 mgr.a (mgr.14355) 6298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:46:33.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:33.206 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:33.206 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:33 smithi171 bash[25040]: audit 2024-09-14T00:46:31.542136+0000 mgr.a (mgr.14355) 6299 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:46:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:33 smithi171 bash[25040]: cephadm 2024-09-14T00:46:31.543717+0000 mgr.a (mgr.14355) 6300 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:46:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:33 smithi171 bash[25040]: cluster 2024-09-14T00:46:31.936746+0000 mgr.a (mgr.14355) 6301 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:33 smithi007 bash[22722]: audit 2024-09-14T00:46:31.542136+0000 mgr.a (mgr.14355) 6299 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:46:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:33 smithi007 bash[22722]: cephadm 2024-09-14T00:46:31.543717+0000 mgr.a (mgr.14355) 6300 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:46:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:33 smithi007 bash[22722]: cluster 2024-09-14T00:46:31.936746+0000 mgr.a (mgr.14355) 6301 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:33 smithi131 bash[24745]: audit 2024-09-14T00:46:31.542136+0000 mgr.a (mgr.14355) 6299 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:46:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:33 smithi131 bash[24745]: cephadm 2024-09-14T00:46:31.543717+0000 mgr.a (mgr.14355) 6300 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:46:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:33 smithi131 bash[24745]: cluster 2024-09-14T00:46:31.936746+0000 mgr.a (mgr.14355) 6301 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:33.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:35 smithi171 bash[25040]: audit 2024-09-14T00:46:33.532102+0000 mgr.a (mgr.14355) 6302 : audit [DBG] from='client.144645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:35 smithi171 bash[25040]: cluster 2024-09-14T00:46:33.937248+0000 mgr.a (mgr.14355) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:35 smithi007 bash[22722]: audit 2024-09-14T00:46:33.532102+0000 mgr.a (mgr.14355) 6302 : audit [DBG] from='client.144645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:35 smithi007 bash[22722]: cluster 2024-09-14T00:46:33.937248+0000 mgr.a (mgr.14355) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:35 smithi131 bash[24745]: audit 2024-09-14T00:46:33.532102+0000 mgr.a (mgr.14355) 6302 : audit [DBG] from='client.144645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:35 smithi131 bash[24745]: cluster 2024-09-14T00:46:33.937248+0000 mgr.a (mgr.14355) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:36 smithi007 bash[22722]: cluster 2024-09-14T00:46:35.939445+0000 mgr.a (mgr.14355) 6304 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:36 smithi131 bash[24745]: cluster 2024-09-14T00:46:35.939445+0000 mgr.a (mgr.14355) 6304 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:36 smithi171 bash[25040]: cluster 2024-09-14T00:46:35.939445+0000 mgr.a (mgr.14355) 6304 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:39.411 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:38 smithi171 bash[25040]: cluster 2024-09-14T00:46:37.940194+0000 mgr.a (mgr.14355) 6305 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:39.411 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:38 smithi131 bash[24745]: cluster 2024-09-14T00:46:37.940194+0000 mgr.a (mgr.14355) 6305 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:38 smithi007 bash[22722]: cluster 2024-09-14T00:46:37.940194+0000 mgr.a (mgr.14355) 6305 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:39.722 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:39.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:39.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:39.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:39.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:41 smithi131 bash[24745]: audit 2024-09-14T00:46:39.298992+0000 mgr.a (mgr.14355) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:41 smithi131 bash[24745]: cluster 2024-09-14T00:46:39.941122+0000 mgr.a (mgr.14355) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:41 smithi171 bash[25040]: audit 2024-09-14T00:46:39.298992+0000 mgr.a (mgr.14355) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:41 smithi171 bash[25040]: cluster 2024-09-14T00:46:39.941122+0000 mgr.a (mgr.14355) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:41 smithi007 bash[22722]: audit 2024-09-14T00:46:39.298992+0000 mgr.a (mgr.14355) 6306 : audit [DBG] from='client.144720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:41 smithi007 bash[22722]: cluster 2024-09-14T00:46:39.941122+0000 mgr.a (mgr.14355) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:43 smithi131 bash[24745]: cluster 2024-09-14T00:46:41.943456+0000 mgr.a (mgr.14355) 6308 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:43 smithi171 bash[25040]: cluster 2024-09-14T00:46:41.943456+0000 mgr.a (mgr.14355) 6308 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:43 smithi007 bash[22722]: cluster 2024-09-14T00:46:41.943456+0000 mgr.a (mgr.14355) 6308 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:44.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:44.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:44.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:45 smithi131 bash[24745]: cluster 2024-09-14T00:46:43.944393+0000 mgr.a (mgr.14355) 6309 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:45 smithi171 bash[25040]: cluster 2024-09-14T00:46:43.944393+0000 mgr.a (mgr.14355) 6309 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:45 smithi007 bash[22722]: cluster 2024-09-14T00:46:43.944393+0000 mgr.a (mgr.14355) 6309 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:45.465 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:45.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:47 smithi131 bash[24745]: audit 2024-09-14T00:46:45.055608+0000 mgr.a (mgr.14355) 6310 : audit [DBG] from='client.144795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:47 smithi131 bash[24745]: cluster 2024-09-14T00:46:45.947302+0000 mgr.a (mgr.14355) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:47 smithi171 bash[25040]: audit 2024-09-14T00:46:45.055608+0000 mgr.a (mgr.14355) 6310 : audit [DBG] from='client.144795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:47 smithi171 bash[25040]: cluster 2024-09-14T00:46:45.947302+0000 mgr.a (mgr.14355) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:47 smithi007 bash[22722]: audit 2024-09-14T00:46:45.055608+0000 mgr.a (mgr.14355) 6310 : audit [DBG] from='client.144795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:47 smithi007 bash[22722]: cluster 2024-09-14T00:46:45.947302+0000 mgr.a (mgr.14355) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:46:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:49 smithi131 bash[24745]: cluster 2024-09-14T00:46:47.948096+0000 mgr.a (mgr.14355) 6312 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:49 smithi171 bash[25040]: cluster 2024-09-14T00:46:47.948096+0000 mgr.a (mgr.14355) 6312 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:49 smithi007 bash[22722]: cluster 2024-09-14T00:46:47.948096+0000 mgr.a (mgr.14355) 6312 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:50.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:50.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:50.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:51.233 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:51 smithi131 bash[24745]: cluster 2024-09-14T00:46:49.948897+0000 mgr.a (mgr.14355) 6313 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:51 smithi171 bash[25040]: cluster 2024-09-14T00:46:49.948897+0000 mgr.a (mgr.14355) 6313 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:51 smithi007 bash[22722]: cluster 2024-09-14T00:46:49.948897+0000 mgr.a (mgr.14355) 6313 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:46:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:52 smithi131 bash[24745]: audit 2024-09-14T00:46:50.803443+0000 mgr.a (mgr.14355) 6314 : audit [DBG] from='client.144870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:52 smithi171 bash[25040]: audit 2024-09-14T00:46:50.803443+0000 mgr.a (mgr.14355) 6314 : audit [DBG] from='client.144870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:52 smithi007 bash[22722]: audit 2024-09-14T00:46:50.803443+0000 mgr.a (mgr.14355) 6314 : audit [DBG] from='client.144870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:53 smithi131 bash[24745]: cluster 2024-09-14T00:46:51.951879+0000 mgr.a (mgr.14355) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:53 smithi171 bash[25040]: cluster 2024-09-14T00:46:51.951879+0000 mgr.a (mgr.14355) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:53 smithi007 bash[22722]: cluster 2024-09-14T00:46:51.951879+0000 mgr.a (mgr.14355) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:55 smithi171 bash[25040]: cluster 2024-09-14T00:46:53.952653+0000 mgr.a (mgr.14355) 6316 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:55 smithi007 bash[22722]: cluster 2024-09-14T00:46:53.952653+0000 mgr.a (mgr.14355) 6316 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:55 smithi131 bash[24745]: cluster 2024-09-14T00:46:53.952653+0000 mgr.a (mgr.14355) 6316 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:46:56.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:46:56.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:46:56.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:46:57.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:46:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:46:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:46:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:46:57.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:46:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:57 smithi171 bash[25040]: cluster 2024-09-14T00:46:55.954671+0000 mgr.a (mgr.14355) 6317 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:57 smithi007 bash[22722]: cluster 2024-09-14T00:46:55.954671+0000 mgr.a (mgr.14355) 6317 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:57 smithi131 bash[24745]: cluster 2024-09-14T00:46:55.954671+0000 mgr.a (mgr.14355) 6317 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:46:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:58 smithi171 bash[25040]: audit 2024-09-14T00:46:56.570873+0000 mgr.a (mgr.14355) 6318 : audit [DBG] from='client.144948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:58 smithi007 bash[22722]: audit 2024-09-14T00:46:56.570873+0000 mgr.a (mgr.14355) 6318 : audit [DBG] from='client.144948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:58 smithi131 bash[24745]: audit 2024-09-14T00:46:56.570873+0000 mgr.a (mgr.14355) 6318 : audit [DBG] from='client.144948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:46:59.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:46:59 smithi171 bash[25040]: cluster 2024-09-14T00:46:57.955562+0000 mgr.a (mgr.14355) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:46:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:46:59 smithi007 bash[22722]: cluster 2024-09-14T00:46:57.955562+0000 mgr.a (mgr.14355) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:46:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:46:59 smithi131 bash[24745]: cluster 2024-09-14T00:46:57.955562+0000 mgr.a (mgr.14355) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:47:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:00 smithi007 bash[22722]: cluster 2024-09-14T00:46:59.956487+0000 mgr.a (mgr.14355) 6320 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:47:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:00 smithi131 bash[24745]: cluster 2024-09-14T00:46:59.956487+0000 mgr.a (mgr.14355) 6320 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:47:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:00 smithi171 bash[25040]: cluster 2024-09-14T00:46:59.956487+0000 mgr.a (mgr.14355) 6320 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T00:47:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:02.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:02.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:02.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:03.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:03 smithi131 bash[24745]: cluster 2024-09-14T00:47:01.958900+0000 mgr.a (mgr.14355) 6321 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:47:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:03 smithi171 bash[25040]: cluster 2024-09-14T00:47:01.958900+0000 mgr.a (mgr.14355) 6321 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:47:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:03 smithi007 bash[22722]: cluster 2024-09-14T00:47:01.958900+0000 mgr.a (mgr.14355) 6321 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T00:47:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:04 smithi131 bash[24745]: audit 2024-09-14T00:47:02.351088+0000 mgr.a (mgr.14355) 6322 : audit [DBG] from='client.145023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:04 smithi171 bash[25040]: audit 2024-09-14T00:47:02.351088+0000 mgr.a (mgr.14355) 6322 : audit [DBG] from='client.145023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:04 smithi007 bash[22722]: audit 2024-09-14T00:47:02.351088+0000 mgr.a (mgr.14355) 6322 : audit [DBG] from='client.145023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:05 smithi131 bash[24745]: cluster 2024-09-14T00:47:03.959851+0000 mgr.a (mgr.14355) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:05 smithi171 bash[25040]: cluster 2024-09-14T00:47:03.959851+0000 mgr.a (mgr.14355) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:05 smithi007 bash[22722]: cluster 2024-09-14T00:47:03.959851+0000 mgr.a (mgr.14355) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:07 smithi131 bash[24745]: cluster 2024-09-14T00:47:05.962105+0000 mgr.a (mgr.14355) 6324 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:07 smithi171 bash[25040]: cluster 2024-09-14T00:47:05.962105+0000 mgr.a (mgr.14355) 6324 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:07 smithi007 bash[22722]: cluster 2024-09-14T00:47:05.962105+0000 mgr.a (mgr.14355) 6324 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:07.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:08.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:08.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:09 smithi171 bash[25040]: cluster 2024-09-14T00:47:07.962879+0000 mgr.a (mgr.14355) 6325 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:09 smithi007 bash[22722]: cluster 2024-09-14T00:47:07.962879+0000 mgr.a (mgr.14355) 6325 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:09 smithi131 bash[24745]: cluster 2024-09-14T00:47:07.962879+0000 mgr.a (mgr.14355) 6325 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:10 smithi171 bash[25040]: audit 2024-09-14T00:47:08.087279+0000 mgr.a (mgr.14355) 6326 : audit [DBG] from='client.145101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:10 smithi007 bash[22722]: audit 2024-09-14T00:47:08.087279+0000 mgr.a (mgr.14355) 6326 : audit [DBG] from='client.145101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:10 smithi131 bash[24745]: audit 2024-09-14T00:47:08.087279+0000 mgr.a (mgr.14355) 6326 : audit [DBG] from='client.145101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:11 smithi171 bash[25040]: cluster 2024-09-14T00:47:09.963756+0000 mgr.a (mgr.14355) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:11 smithi007 bash[22722]: cluster 2024-09-14T00:47:09.963756+0000 mgr.a (mgr.14355) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:11 smithi131 bash[24745]: cluster 2024-09-14T00:47:09.963756+0000 mgr.a (mgr.14355) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:13 smithi007 bash[22722]: cluster 2024-09-14T00:47:11.966006+0000 mgr.a (mgr.14355) 6328 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:13 smithi131 bash[24745]: cluster 2024-09-14T00:47:11.966006+0000 mgr.a (mgr.14355) 6328 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:13 smithi171 bash[25040]: cluster 2024-09-14T00:47:11.966006+0000 mgr.a (mgr.14355) 6328 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:14.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:14.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:14 smithi007 bash[22722]: audit 2024-09-14T00:47:13.846148+0000 mgr.a (mgr.14355) 6329 : audit [DBG] from='client.145176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:14 smithi007 bash[22722]: cluster 2024-09-14T00:47:13.966511+0000 mgr.a (mgr.14355) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:14 smithi131 bash[24745]: audit 2024-09-14T00:47:13.846148+0000 mgr.a (mgr.14355) 6329 : audit [DBG] from='client.145176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:14 smithi131 bash[24745]: cluster 2024-09-14T00:47:13.966511+0000 mgr.a (mgr.14355) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:14 smithi171 bash[25040]: audit 2024-09-14T00:47:13.846148+0000 mgr.a (mgr.14355) 6329 : audit [DBG] from='client.145176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:14 smithi171 bash[25040]: cluster 2024-09-14T00:47:13.966511+0000 mgr.a (mgr.14355) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:17 smithi131 bash[24745]: cluster 2024-09-14T00:47:15.968793+0000 mgr.a (mgr.14355) 6331 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:17 smithi171 bash[25040]: cluster 2024-09-14T00:47:15.968793+0000 mgr.a (mgr.14355) 6331 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:17 smithi007 bash[22722]: cluster 2024-09-14T00:47:15.968793+0000 mgr.a (mgr.14355) 6331 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:19 smithi131 bash[24745]: cluster 2024-09-14T00:47:17.969567+0000 mgr.a (mgr.14355) 6332 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:19 smithi171 bash[25040]: cluster 2024-09-14T00:47:17.969567+0000 mgr.a (mgr.14355) 6332 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:19.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:19.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:19 smithi007 bash[22722]: cluster 2024-09-14T00:47:17.969567+0000 mgr.a (mgr.14355) 6332 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:20.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:20.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:20.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:20.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:20.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:21 smithi171 bash[25040]: audit 2024-09-14T00:47:19.630393+0000 mgr.a (mgr.14355) 6333 : audit [DBG] from='client.145251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:21 smithi171 bash[25040]: cluster 2024-09-14T00:47:19.970099+0000 mgr.a (mgr.14355) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:21 smithi007 bash[22722]: audit 2024-09-14T00:47:19.630393+0000 mgr.a (mgr.14355) 6333 : audit [DBG] from='client.145251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:21 smithi007 bash[22722]: cluster 2024-09-14T00:47:19.970099+0000 mgr.a (mgr.14355) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:21 smithi131 bash[24745]: audit 2024-09-14T00:47:19.630393+0000 mgr.a (mgr.14355) 6333 : audit [DBG] from='client.145251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:21 smithi131 bash[24745]: cluster 2024-09-14T00:47:19.970099+0000 mgr.a (mgr.14355) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:23 smithi171 bash[25040]: cluster 2024-09-14T00:47:21.972288+0000 mgr.a (mgr.14355) 6335 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:23 smithi007 bash[22722]: cluster 2024-09-14T00:47:21.972288+0000 mgr.a (mgr.14355) 6335 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:23 smithi131 bash[24745]: cluster 2024-09-14T00:47:21.972288+0000 mgr.a (mgr.14355) 6335 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:25.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:25.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:25.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:25 smithi171 bash[25040]: cluster 2024-09-14T00:47:23.973043+0000 mgr.a (mgr.14355) 6336 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:25 smithi007 bash[22722]: cluster 2024-09-14T00:47:23.973043+0000 mgr.a (mgr.14355) 6336 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:25 smithi131 bash[24745]: cluster 2024-09-14T00:47:23.973043+0000 mgr.a (mgr.14355) 6336 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:25.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:27 smithi007 bash[22722]: audit 2024-09-14T00:47:25.362450+0000 mgr.a (mgr.14355) 6337 : audit [DBG] from='client.145329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:27 smithi007 bash[22722]: cluster 2024-09-14T00:47:25.975762+0000 mgr.a (mgr.14355) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:27 smithi131 bash[24745]: audit 2024-09-14T00:47:25.362450+0000 mgr.a (mgr.14355) 6337 : audit [DBG] from='client.145329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:27 smithi131 bash[24745]: cluster 2024-09-14T00:47:25.975762+0000 mgr.a (mgr.14355) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:27 smithi171 bash[25040]: audit 2024-09-14T00:47:25.362450+0000 mgr.a (mgr.14355) 6337 : audit [DBG] from='client.145329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:27 smithi171 bash[25040]: cluster 2024-09-14T00:47:25.975762+0000 mgr.a (mgr.14355) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:29 smithi007 bash[22722]: cluster 2024-09-14T00:47:27.976515+0000 mgr.a (mgr.14355) 6339 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:29.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:29 smithi131 bash[24745]: cluster 2024-09-14T00:47:27.976515+0000 mgr.a (mgr.14355) 6339 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:29 smithi171 bash[25040]: cluster 2024-09-14T00:47:27.976515+0000 mgr.a (mgr.14355) 6339 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:30 smithi007 bash[22722]: cluster 2024-09-14T00:47:29.977245+0000 mgr.a (mgr.14355) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:47:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:30 smithi131 bash[24745]: cluster 2024-09-14T00:47:29.977245+0000 mgr.a (mgr.14355) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:47:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:30 smithi171 bash[25040]: cluster 2024-09-14T00:47:29.977245+0000 mgr.a (mgr.14355) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:47:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:30.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:31.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:31.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:31.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:31.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:31.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:31 smithi007 bash[22722]: audit 2024-09-14T00:47:31.594185+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:47:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:31 smithi131 bash[24745]: audit 2024-09-14T00:47:31.594185+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:47:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:31 smithi171 bash[25040]: audit 2024-09-14T00:47:31.594185+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: audit 2024-09-14T00:47:31.101454+0000 mgr.a (mgr.14355) 6341 : audit [DBG] from='client.145404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: cluster 2024-09-14T00:47:31.979887+0000 mgr.a (mgr.14355) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: audit 2024-09-14T00:47:32.448600+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: audit 2024-09-14T00:47:32.450267+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: audit 2024-09-14T00:47:32.461171+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:32 smithi007 bash[22722]: audit 2024-09-14T00:47:32.466009+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: audit 2024-09-14T00:47:31.101454+0000 mgr.a (mgr.14355) 6341 : audit [DBG] from='client.145404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: cluster 2024-09-14T00:47:31.979887+0000 mgr.a (mgr.14355) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: audit 2024-09-14T00:47:32.448600+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:47:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: audit 2024-09-14T00:47:32.450267+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:47:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: audit 2024-09-14T00:47:32.461171+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:47:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:32 smithi131 bash[24745]: audit 2024-09-14T00:47:32.466009+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: audit 2024-09-14T00:47:31.101454+0000 mgr.a (mgr.14355) 6341 : audit [DBG] from='client.145404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: cluster 2024-09-14T00:47:31.979887+0000 mgr.a (mgr.14355) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: audit 2024-09-14T00:47:32.448600+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: audit 2024-09-14T00:47:32.450267+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: audit 2024-09-14T00:47:32.461171+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:47:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:32 smithi171 bash[25040]: audit 2024-09-14T00:47:32.466009+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:33.656 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:47:33 smithi007 bash[22972]: debug 2024-09-14T00:47:33.209+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:47:33.657 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:47:33 smithi007 bash[22972]: debug 2024-09-14T00:47:33.209+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:47:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:33 smithi007 bash[22722]: audit 2024-09-14T00:47:32.468453+0000 mgr.a (mgr.14355) 6343 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:33 smithi131 bash[24745]: audit 2024-09-14T00:47:32.468453+0000 mgr.a (mgr.14355) 6343 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:33 smithi171 bash[25040]: audit 2024-09-14T00:47:32.468453+0000 mgr.a (mgr.14355) 6343 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:47:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:34 smithi007 bash[22722]: audit 2024-09-14T00:47:33.211406+0000 mgr.a (mgr.14355) 6344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:47:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:34 smithi007 bash[22722]: cephadm 2024-09-14T00:47:33.212807+0000 mgr.a (mgr.14355) 6345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:47:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:34 smithi007 bash[22722]: cluster 2024-09-14T00:47:33.980790+0000 mgr.a (mgr.14355) 6346 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:34 smithi131 bash[24745]: audit 2024-09-14T00:47:33.211406+0000 mgr.a (mgr.14355) 6344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:47:35.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:34 smithi131 bash[24745]: cephadm 2024-09-14T00:47:33.212807+0000 mgr.a (mgr.14355) 6345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:47:35.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:34 smithi131 bash[24745]: cluster 2024-09-14T00:47:33.980790+0000 mgr.a (mgr.14355) 6346 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:34 smithi171 bash[25040]: audit 2024-09-14T00:47:33.211406+0000 mgr.a (mgr.14355) 6344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:47:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:34 smithi171 bash[25040]: cephadm 2024-09-14T00:47:33.212807+0000 mgr.a (mgr.14355) 6345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:47:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:34 smithi171 bash[25040]: cluster 2024-09-14T00:47:33.980790+0000 mgr.a (mgr.14355) 6346 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:47:36.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:36.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:37 smithi171 bash[25040]: cluster 2024-09-14T00:47:35.983062+0000 mgr.a (mgr.14355) 6347 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:37.300 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:37.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:37.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:37.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:37.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:37 smithi007 bash[22722]: cluster 2024-09-14T00:47:35.983062+0000 mgr.a (mgr.14355) 6347 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:37 smithi131 bash[24745]: cluster 2024-09-14T00:47:35.983062+0000 mgr.a (mgr.14355) 6347 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:38 smithi007 bash[22722]: audit 2024-09-14T00:47:36.851527+0000 mgr.a (mgr.14355) 6348 : audit [DBG] from='client.145587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:38 smithi131 bash[24745]: audit 2024-09-14T00:47:36.851527+0000 mgr.a (mgr.14355) 6348 : audit [DBG] from='client.145587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:38 smithi171 bash[25040]: audit 2024-09-14T00:47:36.851527+0000 mgr.a (mgr.14355) 6348 : audit [DBG] from='client.145587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:39 smithi007 bash[22722]: cluster 2024-09-14T00:47:37.983920+0000 mgr.a (mgr.14355) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:39 smithi131 bash[24745]: cluster 2024-09-14T00:47:37.983920+0000 mgr.a (mgr.14355) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:39 smithi171 bash[25040]: cluster 2024-09-14T00:47:37.983920+0000 mgr.a (mgr.14355) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:41 smithi007 bash[22722]: cluster 2024-09-14T00:47:39.984870+0000 mgr.a (mgr.14355) 6350 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:41 smithi131 bash[24745]: cluster 2024-09-14T00:47:39.984870+0000 mgr.a (mgr.14355) 6350 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:41 smithi171 bash[25040]: cluster 2024-09-14T00:47:39.984870+0000 mgr.a (mgr.14355) 6350 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:42.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:42.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:42.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:42 smithi007 bash[22722]: cluster 2024-09-14T00:47:41.987156+0000 mgr.a (mgr.14355) 6351 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:42 smithi131 bash[24745]: cluster 2024-09-14T00:47:41.987156+0000 mgr.a (mgr.14355) 6351 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:42 smithi171 bash[25040]: cluster 2024-09-14T00:47:41.987156+0000 mgr.a (mgr.14355) 6351 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:43.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:43 smithi007 bash[22722]: audit 2024-09-14T00:47:42.639810+0000 mgr.a (mgr.14355) 6352 : audit [DBG] from='client.145665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:43 smithi131 bash[24745]: audit 2024-09-14T00:47:42.639810+0000 mgr.a (mgr.14355) 6352 : audit [DBG] from='client.145665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:43 smithi171 bash[25040]: audit 2024-09-14T00:47:42.639810+0000 mgr.a (mgr.14355) 6352 : audit [DBG] from='client.145665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:44 smithi007 bash[22722]: cluster 2024-09-14T00:47:43.988184+0000 mgr.a (mgr.14355) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:44 smithi131 bash[24745]: cluster 2024-09-14T00:47:43.988184+0000 mgr.a (mgr.14355) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:44 smithi171 bash[25040]: cluster 2024-09-14T00:47:43.988184+0000 mgr.a (mgr.14355) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:47 smithi007 bash[22722]: cluster 2024-09-14T00:47:45.990583+0000 mgr.a (mgr.14355) 6354 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:47 smithi131 bash[24745]: cluster 2024-09-14T00:47:45.990583+0000 mgr.a (mgr.14355) 6354 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:47 smithi171 bash[25040]: cluster 2024-09-14T00:47:45.990583+0000 mgr.a (mgr.14355) 6354 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:47:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:48.827 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:49 smithi007 bash[22722]: cluster 2024-09-14T00:47:47.991527+0000 mgr.a (mgr.14355) 6355 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:49 smithi131 bash[24745]: cluster 2024-09-14T00:47:47.991527+0000 mgr.a (mgr.14355) 6355 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:49 smithi171 bash[25040]: cluster 2024-09-14T00:47:47.991527+0000 mgr.a (mgr.14355) 6355 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:50 smithi007 bash[22722]: audit 2024-09-14T00:47:48.415708+0000 mgr.a (mgr.14355) 6356 : audit [DBG] from='client.145740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:50 smithi131 bash[24745]: audit 2024-09-14T00:47:48.415708+0000 mgr.a (mgr.14355) 6356 : audit [DBG] from='client.145740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:50 smithi171 bash[25040]: audit 2024-09-14T00:47:48.415708+0000 mgr.a (mgr.14355) 6356 : audit [DBG] from='client.145740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:51 smithi007 bash[22722]: cluster 2024-09-14T00:47:49.992542+0000 mgr.a (mgr.14355) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:51 smithi131 bash[24745]: cluster 2024-09-14T00:47:49.992542+0000 mgr.a (mgr.14355) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:51 smithi171 bash[25040]: cluster 2024-09-14T00:47:49.992542+0000 mgr.a (mgr.14355) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:52 smithi007 bash[22722]: cluster 2024-09-14T00:47:51.994961+0000 mgr.a (mgr.14355) 6358 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:52 smithi131 bash[24745]: cluster 2024-09-14T00:47:51.994961+0000 mgr.a (mgr.14355) 6358 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:52 smithi171 bash[25040]: cluster 2024-09-14T00:47:51.994961+0000 mgr.a (mgr.14355) 6358 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:47:54.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:47:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:47:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:47:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:47:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:47:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:55 smithi007 bash[22722]: cluster 2024-09-14T00:47:53.995856+0000 mgr.a (mgr.14355) 6359 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:55 smithi131 bash[24745]: cluster 2024-09-14T00:47:53.995856+0000 mgr.a (mgr.14355) 6359 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:55 smithi171 bash[25040]: cluster 2024-09-14T00:47:53.995856+0000 mgr.a (mgr.14355) 6359 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:56 smithi007 bash[22722]: audit 2024-09-14T00:47:54.162322+0000 mgr.a (mgr.14355) 6360 : audit [DBG] from='client.145818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:56 smithi131 bash[24745]: audit 2024-09-14T00:47:54.162322+0000 mgr.a (mgr.14355) 6360 : audit [DBG] from='client.145818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:56 smithi171 bash[25040]: audit 2024-09-14T00:47:54.162322+0000 mgr.a (mgr.14355) 6360 : audit [DBG] from='client.145818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:47:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:57 smithi007 bash[22722]: cluster 2024-09-14T00:47:55.998199+0000 mgr.a (mgr.14355) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:57 smithi131 bash[24745]: cluster 2024-09-14T00:47:55.998199+0000 mgr.a (mgr.14355) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:57 smithi171 bash[25040]: cluster 2024-09-14T00:47:55.998199+0000 mgr.a (mgr.14355) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:47:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:47:58 smithi007 bash[22722]: cluster 2024-09-14T00:47:57.999081+0000 mgr.a (mgr.14355) 6362 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:47:58 smithi131 bash[24745]: cluster 2024-09-14T00:47:57.999081+0000 mgr.a (mgr.14355) 6362 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:47:58 smithi171 bash[25040]: cluster 2024-09-14T00:47:57.999081+0000 mgr.a (mgr.14355) 6362 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:47:59.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:47:59.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:47:59.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:00.354 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:00.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:00.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:00.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:00.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:01 smithi007 bash[22722]: audit 2024-09-14T00:47:59.914120+0000 mgr.a (mgr.14355) 6363 : audit [DBG] from='client.145890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:01 smithi007 bash[22722]: cluster 2024-09-14T00:47:59.999725+0000 mgr.a (mgr.14355) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:01 smithi131 bash[24745]: audit 2024-09-14T00:47:59.914120+0000 mgr.a (mgr.14355) 6363 : audit [DBG] from='client.145890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:01.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:01 smithi131 bash[24745]: cluster 2024-09-14T00:47:59.999725+0000 mgr.a (mgr.14355) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:01 smithi171 bash[25040]: audit 2024-09-14T00:47:59.914120+0000 mgr.a (mgr.14355) 6363 : audit [DBG] from='client.145890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:01 smithi171 bash[25040]: cluster 2024-09-14T00:47:59.999725+0000 mgr.a (mgr.14355) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:02 smithi007 bash[22722]: cluster 2024-09-14T00:48:02.002066+0000 mgr.a (mgr.14355) 6365 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:48:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:02 smithi131 bash[24745]: cluster 2024-09-14T00:48:02.002066+0000 mgr.a (mgr.14355) 6365 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:48:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:02 smithi171 bash[25040]: cluster 2024-09-14T00:48:02.002066+0000 mgr.a (mgr.14355) 6365 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:48:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:05 smithi007 bash[22722]: cluster 2024-09-14T00:48:04.002845+0000 mgr.a (mgr.14355) 6366 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:48:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:05 smithi131 bash[24745]: cluster 2024-09-14T00:48:04.002845+0000 mgr.a (mgr.14355) 6366 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:48:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:05 smithi171 bash[25040]: cluster 2024-09-14T00:48:04.002845+0000 mgr.a (mgr.14355) 6366 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:48:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:06.146 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:06 smithi007 bash[22722]: audit 2024-09-14T00:48:05.691620+0000 mgr.a (mgr.14355) 6367 : audit [DBG] from='client.145968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:06 smithi007 bash[22722]: cluster 2024-09-14T00:48:06.004195+0000 mgr.a (mgr.14355) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:06 smithi131 bash[24745]: audit 2024-09-14T00:48:05.691620+0000 mgr.a (mgr.14355) 6367 : audit [DBG] from='client.145968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:06.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:06 smithi131 bash[24745]: cluster 2024-09-14T00:48:06.004195+0000 mgr.a (mgr.14355) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:06 smithi171 bash[25040]: audit 2024-09-14T00:48:05.691620+0000 mgr.a (mgr.14355) 6367 : audit [DBG] from='client.145968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:06 smithi171 bash[25040]: cluster 2024-09-14T00:48:06.004195+0000 mgr.a (mgr.14355) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:08 smithi007 bash[22722]: cluster 2024-09-14T00:48:08.005182+0000 mgr.a (mgr.14355) 6369 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:08 smithi131 bash[24745]: cluster 2024-09-14T00:48:08.005182+0000 mgr.a (mgr.14355) 6369 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:08 smithi171 bash[25040]: cluster 2024-09-14T00:48:08.005182+0000 mgr.a (mgr.14355) 6369 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:10 smithi007 bash[22722]: cluster 2024-09-14T00:48:10.006114+0000 mgr.a (mgr.14355) 6370 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:10 smithi131 bash[24745]: cluster 2024-09-14T00:48:10.006114+0000 mgr.a (mgr.14355) 6370 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:10 smithi171 bash[25040]: cluster 2024-09-14T00:48:10.006114+0000 mgr.a (mgr.14355) 6370 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:48:11.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:11.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:12 smithi007 bash[22722]: audit 2024-09-14T00:48:11.480664+0000 mgr.a (mgr.14355) 6371 : audit [DBG] from='client.146046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:12 smithi007 bash[22722]: cluster 2024-09-14T00:48:12.009526+0000 mgr.a (mgr.14355) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:12 smithi131 bash[24745]: audit 2024-09-14T00:48:11.480664+0000 mgr.a (mgr.14355) 6371 : audit [DBG] from='client.146046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:12 smithi131 bash[24745]: cluster 2024-09-14T00:48:12.009526+0000 mgr.a (mgr.14355) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:12 smithi171 bash[25040]: audit 2024-09-14T00:48:11.480664+0000 mgr.a (mgr.14355) 6371 : audit [DBG] from='client.146046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:12 smithi171 bash[25040]: cluster 2024-09-14T00:48:12.009526+0000 mgr.a (mgr.14355) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:14 smithi007 bash[22722]: cluster 2024-09-14T00:48:14.010317+0000 mgr.a (mgr.14355) 6373 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:48:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:14 smithi131 bash[24745]: cluster 2024-09-14T00:48:14.010317+0000 mgr.a (mgr.14355) 6373 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:48:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:14 smithi171 bash[25040]: cluster 2024-09-14T00:48:14.010317+0000 mgr.a (mgr.14355) 6373 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:48:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:16 smithi007 bash[22722]: cluster 2024-09-14T00:48:16.012317+0000 mgr.a (mgr.14355) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:48:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:16 smithi131 bash[24745]: cluster 2024-09-14T00:48:16.012317+0000 mgr.a (mgr.14355) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:48:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:16 smithi171 bash[25040]: cluster 2024-09-14T00:48:16.012317+0000 mgr.a (mgr.14355) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:48:16.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:16.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:16.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:17.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:17.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:17.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:17.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:17.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:18 smithi007 bash[22722]: audit 2024-09-14T00:48:17.265955+0000 mgr.a (mgr.14355) 6375 : audit [DBG] from='client.146124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:18 smithi007 bash[22722]: cluster 2024-09-14T00:48:18.013309+0000 mgr.a (mgr.14355) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:18 smithi131 bash[24745]: audit 2024-09-14T00:48:17.265955+0000 mgr.a (mgr.14355) 6375 : audit [DBG] from='client.146124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:18 smithi131 bash[24745]: cluster 2024-09-14T00:48:18.013309+0000 mgr.a (mgr.14355) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:18 smithi171 bash[25040]: audit 2024-09-14T00:48:17.265955+0000 mgr.a (mgr.14355) 6375 : audit [DBG] from='client.146124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:18 smithi171 bash[25040]: cluster 2024-09-14T00:48:18.013309+0000 mgr.a (mgr.14355) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:20 smithi007 bash[22722]: cluster 2024-09-14T00:48:20.014073+0000 mgr.a (mgr.14355) 6377 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:20 smithi131 bash[24745]: cluster 2024-09-14T00:48:20.014073+0000 mgr.a (mgr.14355) 6377 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:20 smithi171 bash[25040]: cluster 2024-09-14T00:48:20.014073+0000 mgr.a (mgr.14355) 6377 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:22 smithi007 bash[22722]: cluster 2024-09-14T00:48:22.016335+0000 mgr.a (mgr.14355) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:22 smithi131 bash[24745]: cluster 2024-09-14T00:48:22.016335+0000 mgr.a (mgr.14355) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:22 smithi171 bash[25040]: cluster 2024-09-14T00:48:22.016335+0000 mgr.a (mgr.14355) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:22.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:22.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:22.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:23 smithi007 bash[22722]: audit 2024-09-14T00:48:23.044487+0000 mgr.a (mgr.14355) 6379 : audit [DBG] from='client.146196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:23.475 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:23.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:23 smithi131 bash[24745]: audit 2024-09-14T00:48:23.044487+0000 mgr.a (mgr.14355) 6379 : audit [DBG] from='client.146196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:23 smithi171 bash[25040]: audit 2024-09-14T00:48:23.044487+0000 mgr.a (mgr.14355) 6379 : audit [DBG] from='client.146196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:24 smithi007 bash[22722]: cluster 2024-09-14T00:48:24.017453+0000 mgr.a (mgr.14355) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:24 smithi131 bash[24745]: cluster 2024-09-14T00:48:24.017453+0000 mgr.a (mgr.14355) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:24 smithi171 bash[25040]: cluster 2024-09-14T00:48:24.017453+0000 mgr.a (mgr.14355) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:26 smithi007 bash[22722]: cluster 2024-09-14T00:48:26.019879+0000 mgr.a (mgr.14355) 6381 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:26 smithi131 bash[24745]: cluster 2024-09-14T00:48:26.019879+0000 mgr.a (mgr.14355) 6381 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:26 smithi171 bash[25040]: cluster 2024-09-14T00:48:26.019879+0000 mgr.a (mgr.14355) 6381 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:28 smithi007 bash[22722]: cluster 2024-09-14T00:48:28.020769+0000 mgr.a (mgr.14355) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:28.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:28.478 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:28.478 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:28 smithi131 bash[24745]: cluster 2024-09-14T00:48:28.020769+0000 mgr.a (mgr.14355) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:28 smithi171 bash[25040]: cluster 2024-09-14T00:48:28.020769+0000 mgr.a (mgr.14355) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:29.235 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:29.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:29 smithi007 bash[22722]: audit 2024-09-14T00:48:28.807955+0000 mgr.a (mgr.14355) 6383 : audit [DBG] from='client.146274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:29 smithi131 bash[24745]: audit 2024-09-14T00:48:28.807955+0000 mgr.a (mgr.14355) 6383 : audit [DBG] from='client.146274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:29 smithi171 bash[25040]: audit 2024-09-14T00:48:28.807955+0000 mgr.a (mgr.14355) 6383 : audit [DBG] from='client.146274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:30 smithi007 bash[22722]: cluster 2024-09-14T00:48:30.021769+0000 mgr.a (mgr.14355) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:30 smithi131 bash[24745]: cluster 2024-09-14T00:48:30.021769+0000 mgr.a (mgr.14355) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:30 smithi171 bash[25040]: cluster 2024-09-14T00:48:30.021769+0000 mgr.a (mgr.14355) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:32 smithi007 bash[22722]: cluster 2024-09-14T00:48:32.024047+0000 mgr.a (mgr.14355) 6385 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:32 smithi131 bash[24745]: cluster 2024-09-14T00:48:32.024047+0000 mgr.a (mgr.14355) 6385 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:32 smithi171 bash[25040]: cluster 2024-09-14T00:48:32.024047+0000 mgr.a (mgr.14355) 6385 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:33 smithi007 bash[22722]: audit 2024-09-14T00:48:33.264075+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:48:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:33 smithi131 bash[24745]: audit 2024-09-14T00:48:33.264075+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:48:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:33 smithi171 bash[25040]: audit 2024-09-14T00:48:33.264075+0000 mon.a (mon.0) 1548 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:48:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:34.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:34 smithi007 bash[22722]: cluster 2024-09-14T00:48:34.024799+0000 mgr.a (mgr.14355) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:34 smithi131 bash[24745]: cluster 2024-09-14T00:48:34.024799+0000 mgr.a (mgr.14355) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:34 smithi171 bash[25040]: cluster 2024-09-14T00:48:34.024799+0000 mgr.a (mgr.14355) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:34.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:34.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:35 smithi007 bash[22722]: audit 2024-09-14T00:48:34.567223+0000 mgr.a (mgr.14355) 6387 : audit [DBG] from='client.146352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:35 smithi131 bash[24745]: audit 2024-09-14T00:48:34.567223+0000 mgr.a (mgr.14355) 6387 : audit [DBG] from='client.146352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:35 smithi171 bash[25040]: audit 2024-09-14T00:48:34.567223+0000 mgr.a (mgr.14355) 6387 : audit [DBG] from='client.146352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:36 smithi007 bash[22722]: cluster 2024-09-14T00:48:36.027224+0000 mgr.a (mgr.14355) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:36 smithi131 bash[24745]: cluster 2024-09-14T00:48:36.027224+0000 mgr.a (mgr.14355) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:36 smithi171 bash[25040]: cluster 2024-09-14T00:48:36.027224+0000 mgr.a (mgr.14355) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:38 smithi007 bash[22722]: cluster 2024-09-14T00:48:38.028002+0000 mgr.a (mgr.14355) 6389 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:38 smithi131 bash[24745]: cluster 2024-09-14T00:48:38.028002+0000 mgr.a (mgr.14355) 6389 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:38 smithi171 bash[25040]: cluster 2024-09-14T00:48:38.028002+0000 mgr.a (mgr.14355) 6389 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.608381+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.614612+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.632703+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.637809+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.640578+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:38.644250+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:39.383597+0000 mon.a (mon.0) 1555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:48:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:39.385397+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:48:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:39.395599+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:39 smithi007 bash[22722]: audit 2024-09-14T00:48:39.400800+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:39.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:39.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:39.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.608381+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.614612+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.632703+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.637809+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.640578+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:38.644250+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:39.383597+0000 mon.a (mon.0) 1555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:39.385397+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:39.395599+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:39 smithi131 bash[24745]: audit 2024-09-14T00:48:39.400800+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.608381+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.614612+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.632703+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.637809+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.640578+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:38.644250+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:39.383597+0000 mon.a (mon.0) 1555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:39.385397+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:39.395599+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:48:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:39 smithi171 bash[25040]: audit 2024-09-14T00:48:39.400800+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:40.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:48:40 smithi007 bash[22972]: debug 2024-09-14T00:48:40.128+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:48:40.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:48:40 smithi007 bash[22972]: debug 2024-09-14T00:48:40.132+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:48:40.740 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:40.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:40 smithi007 bash[22722]: audit 2024-09-14T00:48:39.403030+0000 mgr.a (mgr.14355) 6390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:40 smithi007 bash[22722]: cluster 2024-09-14T00:48:40.028514+0000 mgr.a (mgr.14355) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:40 smithi131 bash[24745]: audit 2024-09-14T00:48:39.403030+0000 mgr.a (mgr.14355) 6390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:40 smithi131 bash[24745]: cluster 2024-09-14T00:48:40.028514+0000 mgr.a (mgr.14355) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:40 smithi171 bash[25040]: audit 2024-09-14T00:48:39.403030+0000 mgr.a (mgr.14355) 6390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:48:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:40 smithi171 bash[25040]: cluster 2024-09-14T00:48:40.028514+0000 mgr.a (mgr.14355) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:41 smithi007 bash[22722]: audit 2024-09-14T00:48:40.133393+0000 mgr.a (mgr.14355) 6392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:48:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:41 smithi007 bash[22722]: cephadm 2024-09-14T00:48:40.134698+0000 mgr.a (mgr.14355) 6393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:48:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:41 smithi007 bash[22722]: audit 2024-09-14T00:48:40.312637+0000 mgr.a (mgr.14355) 6394 : audit [DBG] from='client.146532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:41 smithi131 bash[24745]: audit 2024-09-14T00:48:40.133393+0000 mgr.a (mgr.14355) 6392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:48:42.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:41 smithi131 bash[24745]: cephadm 2024-09-14T00:48:40.134698+0000 mgr.a (mgr.14355) 6393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:48:42.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:41 smithi131 bash[24745]: audit 2024-09-14T00:48:40.312637+0000 mgr.a (mgr.14355) 6394 : audit [DBG] from='client.146532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:41 smithi171 bash[25040]: audit 2024-09-14T00:48:40.133393+0000 mgr.a (mgr.14355) 6392 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:48:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:41 smithi171 bash[25040]: cephadm 2024-09-14T00:48:40.134698+0000 mgr.a (mgr.14355) 6393 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:48:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:41 smithi171 bash[25040]: audit 2024-09-14T00:48:40.312637+0000 mgr.a (mgr.14355) 6394 : audit [DBG] from='client.146532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:42 smithi007 bash[22722]: cluster 2024-09-14T00:48:42.031272+0000 mgr.a (mgr.14355) 6395 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:42 smithi131 bash[24745]: cluster 2024-09-14T00:48:42.031272+0000 mgr.a (mgr.14355) 6395 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:43.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:42 smithi171 bash[25040]: cluster 2024-09-14T00:48:42.031272+0000 mgr.a (mgr.14355) 6395 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:44 smithi007 bash[22722]: cluster 2024-09-14T00:48:44.032108+0000 mgr.a (mgr.14355) 6396 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:44 smithi131 bash[24745]: cluster 2024-09-14T00:48:44.032108+0000 mgr.a (mgr.14355) 6396 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:44 smithi171 bash[25040]: cluster 2024-09-14T00:48:44.032108+0000 mgr.a (mgr.14355) 6396 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:45.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:45.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:46 smithi007 bash[22722]: cluster 2024-09-14T00:48:46.034110+0000 mgr.a (mgr.14355) 6397 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:46.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:46.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:46.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:46.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:46.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:46 smithi131 bash[24745]: cluster 2024-09-14T00:48:46.034110+0000 mgr.a (mgr.14355) 6397 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:46 smithi171 bash[25040]: cluster 2024-09-14T00:48:46.034110+0000 mgr.a (mgr.14355) 6397 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:47 smithi131 bash[24745]: audit 2024-09-14T00:48:46.079073+0000 mgr.a (mgr.14355) 6398 : audit [DBG] from='client.146607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:47 smithi171 bash[25040]: audit 2024-09-14T00:48:46.079073+0000 mgr.a (mgr.14355) 6398 : audit [DBG] from='client.146607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:47 smithi007 bash[22722]: audit 2024-09-14T00:48:46.079073+0000 mgr.a (mgr.14355) 6398 : audit [DBG] from='client.146607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:49.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:48 smithi131 bash[24745]: cluster 2024-09-14T00:48:48.035087+0000 mgr.a (mgr.14355) 6399 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:48 smithi171 bash[25040]: cluster 2024-09-14T00:48:48.035087+0000 mgr.a (mgr.14355) 6399 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:48 smithi007 bash[22722]: cluster 2024-09-14T00:48:48.035087+0000 mgr.a (mgr.14355) 6399 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:50 smithi007 bash[22722]: cluster 2024-09-14T00:48:50.036109+0000 mgr.a (mgr.14355) 6400 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:50 smithi131 bash[24745]: cluster 2024-09-14T00:48:50.036109+0000 mgr.a (mgr.14355) 6400 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:50 smithi171 bash[25040]: cluster 2024-09-14T00:48:50.036109+0000 mgr.a (mgr.14355) 6400 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:48:51.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:51.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:51.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:52.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:52.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:52 smithi007 bash[22722]: audit 2024-09-14T00:48:51.853091+0000 mgr.a (mgr.14355) 6401 : audit [DBG] from='client.146685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:52 smithi007 bash[22722]: cluster 2024-09-14T00:48:52.037558+0000 mgr.a (mgr.14355) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:52 smithi131 bash[24745]: audit 2024-09-14T00:48:51.853091+0000 mgr.a (mgr.14355) 6401 : audit [DBG] from='client.146685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:52 smithi131 bash[24745]: cluster 2024-09-14T00:48:52.037558+0000 mgr.a (mgr.14355) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:52 smithi171 bash[25040]: audit 2024-09-14T00:48:51.853091+0000 mgr.a (mgr.14355) 6401 : audit [DBG] from='client.146685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:52 smithi171 bash[25040]: cluster 2024-09-14T00:48:52.037558+0000 mgr.a (mgr.14355) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:48:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:54 smithi007 bash[22722]: cluster 2024-09-14T00:48:54.038463+0000 mgr.a (mgr.14355) 6403 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:54 smithi131 bash[24745]: cluster 2024-09-14T00:48:54.038463+0000 mgr.a (mgr.14355) 6403 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:54 smithi171 bash[25040]: cluster 2024-09-14T00:48:54.038463+0000 mgr.a (mgr.14355) 6403 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:56 smithi007 bash[22722]: cluster 2024-09-14T00:48:56.040670+0000 mgr.a (mgr.14355) 6404 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:56 smithi131 bash[24745]: cluster 2024-09-14T00:48:56.040670+0000 mgr.a (mgr.14355) 6404 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:56 smithi171 bash[25040]: cluster 2024-09-14T00:48:56.040670+0000 mgr.a (mgr.14355) 6404 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:48:57.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:48:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:48:57.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:48:58.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:48:58.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:48:58.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:48:58.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:48:58.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:48:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:58 smithi007 bash[22722]: audit 2024-09-14T00:48:57.636169+0000 mgr.a (mgr.14355) 6405 : audit [DBG] from='client.146763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:48:58 smithi007 bash[22722]: cluster 2024-09-14T00:48:58.041221+0000 mgr.a (mgr.14355) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:58 smithi131 bash[24745]: audit 2024-09-14T00:48:57.636169+0000 mgr.a (mgr.14355) 6405 : audit [DBG] from='client.146763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:48:58 smithi131 bash[24745]: cluster 2024-09-14T00:48:58.041221+0000 mgr.a (mgr.14355) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:48:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:58 smithi171 bash[25040]: audit 2024-09-14T00:48:57.636169+0000 mgr.a (mgr.14355) 6405 : audit [DBG] from='client.146763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:48:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:48:58 smithi171 bash[25040]: cluster 2024-09-14T00:48:58.041221+0000 mgr.a (mgr.14355) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:00 smithi007 bash[22722]: cluster 2024-09-14T00:49:00.041964+0000 mgr.a (mgr.14355) 6407 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:00 smithi131 bash[24745]: cluster 2024-09-14T00:49:00.041964+0000 mgr.a (mgr.14355) 6407 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:00 smithi171 bash[25040]: cluster 2024-09-14T00:49:00.041964+0000 mgr.a (mgr.14355) 6407 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:02 smithi007 bash[22722]: cluster 2024-09-14T00:49:02.044221+0000 mgr.a (mgr.14355) 6408 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:02 smithi131 bash[24745]: cluster 2024-09-14T00:49:02.044221+0000 mgr.a (mgr.14355) 6408 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:02 smithi171 bash[25040]: cluster 2024-09-14T00:49:02.044221+0000 mgr.a (mgr.14355) 6408 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:03.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:03.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:03.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:03.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:03.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:04 smithi007 bash[22722]: audit 2024-09-14T00:49:03.420495+0000 mgr.a (mgr.14355) 6409 : audit [DBG] from='client.146841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:04 smithi007 bash[22722]: cluster 2024-09-14T00:49:04.045162+0000 mgr.a (mgr.14355) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:04 smithi131 bash[24745]: audit 2024-09-14T00:49:03.420495+0000 mgr.a (mgr.14355) 6409 : audit [DBG] from='client.146841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:04 smithi131 bash[24745]: cluster 2024-09-14T00:49:04.045162+0000 mgr.a (mgr.14355) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:04 smithi171 bash[25040]: audit 2024-09-14T00:49:03.420495+0000 mgr.a (mgr.14355) 6409 : audit [DBG] from='client.146841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:04 smithi171 bash[25040]: cluster 2024-09-14T00:49:04.045162+0000 mgr.a (mgr.14355) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:06 smithi007 bash[22722]: cluster 2024-09-14T00:49:06.047428+0000 mgr.a (mgr.14355) 6411 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:06 smithi131 bash[24745]: cluster 2024-09-14T00:49:06.047428+0000 mgr.a (mgr.14355) 6411 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:06 smithi171 bash[25040]: cluster 2024-09-14T00:49:06.047428+0000 mgr.a (mgr.14355) 6411 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:08 smithi007 bash[22722]: cluster 2024-09-14T00:49:08.048185+0000 mgr.a (mgr.14355) 6412 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:08 smithi131 bash[24745]: cluster 2024-09-14T00:49:08.048185+0000 mgr.a (mgr.14355) 6412 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:08 smithi171 bash[25040]: cluster 2024-09-14T00:49:08.048185+0000 mgr.a (mgr.14355) 6412 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:08.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:08.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:08.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:09.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:09.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:10 smithi007 bash[22722]: audit 2024-09-14T00:49:09.181089+0000 mgr.a (mgr.14355) 6413 : audit [DBG] from='client.146919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:10 smithi007 bash[22722]: cluster 2024-09-14T00:49:10.049136+0000 mgr.a (mgr.14355) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:10 smithi131 bash[24745]: audit 2024-09-14T00:49:09.181089+0000 mgr.a (mgr.14355) 6413 : audit [DBG] from='client.146919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:10.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:10 smithi131 bash[24745]: cluster 2024-09-14T00:49:10.049136+0000 mgr.a (mgr.14355) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:10 smithi171 bash[25040]: audit 2024-09-14T00:49:09.181089+0000 mgr.a (mgr.14355) 6413 : audit [DBG] from='client.146919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:10 smithi171 bash[25040]: cluster 2024-09-14T00:49:10.049136+0000 mgr.a (mgr.14355) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:12 smithi007 bash[22722]: cluster 2024-09-14T00:49:12.051754+0000 mgr.a (mgr.14355) 6415 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:12 smithi131 bash[24745]: cluster 2024-09-14T00:49:12.051754+0000 mgr.a (mgr.14355) 6415 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:12 smithi171 bash[25040]: cluster 2024-09-14T00:49:12.051754+0000 mgr.a (mgr.14355) 6415 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:14 smithi007 bash[22722]: cluster 2024-09-14T00:49:14.052533+0000 mgr.a (mgr.14355) 6416 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:14 smithi131 bash[24745]: cluster 2024-09-14T00:49:14.052533+0000 mgr.a (mgr.14355) 6416 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:14 smithi171 bash[25040]: cluster 2024-09-14T00:49:14.052533+0000 mgr.a (mgr.14355) 6416 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:14.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:14.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:14.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:15.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:15 smithi007 bash[22722]: audit 2024-09-14T00:49:14.959649+0000 mgr.a (mgr.14355) 6417 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:15 smithi131 bash[24745]: audit 2024-09-14T00:49:14.959649+0000 mgr.a (mgr.14355) 6417 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:15 smithi171 bash[25040]: audit 2024-09-14T00:49:14.959649+0000 mgr.a (mgr.14355) 6417 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:16 smithi007 bash[22722]: cluster 2024-09-14T00:49:16.054996+0000 mgr.a (mgr.14355) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:49:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:16 smithi131 bash[24745]: cluster 2024-09-14T00:49:16.054996+0000 mgr.a (mgr.14355) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:49:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:16 smithi171 bash[25040]: cluster 2024-09-14T00:49:16.054996+0000 mgr.a (mgr.14355) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T00:49:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:18 smithi007 bash[22722]: cluster 2024-09-14T00:49:18.055770+0000 mgr.a (mgr.14355) 6419 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:18 smithi131 bash[24745]: cluster 2024-09-14T00:49:18.055770+0000 mgr.a (mgr.14355) 6419 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:18 smithi171 bash[25040]: cluster 2024-09-14T00:49:18.055770+0000 mgr.a (mgr.14355) 6419 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:20.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:20 smithi007 bash[22722]: cluster 2024-09-14T00:49:20.056671+0000 mgr.a (mgr.14355) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:20 smithi131 bash[24745]: cluster 2024-09-14T00:49:20.056671+0000 mgr.a (mgr.14355) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:20 smithi171 bash[25040]: cluster 2024-09-14T00:49:20.056671+0000 mgr.a (mgr.14355) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:49:21.171 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:21 smithi007 bash[22722]: audit 2024-09-14T00:49:20.737240+0000 mgr.a (mgr.14355) 6421 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:21 smithi131 bash[24745]: audit 2024-09-14T00:49:20.737240+0000 mgr.a (mgr.14355) 6421 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:21 smithi171 bash[25040]: audit 2024-09-14T00:49:20.737240+0000 mgr.a (mgr.14355) 6421 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:22 smithi007 bash[22722]: cluster 2024-09-14T00:49:22.059525+0000 mgr.a (mgr.14355) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:22 smithi131 bash[24745]: cluster 2024-09-14T00:49:22.059525+0000 mgr.a (mgr.14355) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:22 smithi171 bash[25040]: cluster 2024-09-14T00:49:22.059525+0000 mgr.a (mgr.14355) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:24 smithi007 bash[22722]: cluster 2024-09-14T00:49:24.060316+0000 mgr.a (mgr.14355) 6423 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:49:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:24 smithi131 bash[24745]: cluster 2024-09-14T00:49:24.060316+0000 mgr.a (mgr.14355) 6423 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:49:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:24 smithi171 bash[25040]: cluster 2024-09-14T00:49:24.060316+0000 mgr.a (mgr.14355) 6423 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:49:26.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:26.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:26.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:26 smithi007 bash[22722]: cluster 2024-09-14T00:49:26.062308+0000 mgr.a (mgr.14355) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:26 smithi131 bash[24745]: cluster 2024-09-14T00:49:26.062308+0000 mgr.a (mgr.14355) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:26 smithi171 bash[25040]: cluster 2024-09-14T00:49:26.062308+0000 mgr.a (mgr.14355) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:26.919 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:26.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:26.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:26.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:26.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:27 smithi007 bash[22722]: audit 2024-09-14T00:49:26.501992+0000 mgr.a (mgr.14355) 6425 : audit [DBG] from='client.147147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:27 smithi131 bash[24745]: audit 2024-09-14T00:49:26.501992+0000 mgr.a (mgr.14355) 6425 : audit [DBG] from='client.147147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:27 smithi171 bash[25040]: audit 2024-09-14T00:49:26.501992+0000 mgr.a (mgr.14355) 6425 : audit [DBG] from='client.147147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:28 smithi007 bash[22722]: cluster 2024-09-14T00:49:28.063216+0000 mgr.a (mgr.14355) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:28 smithi131 bash[24745]: cluster 2024-09-14T00:49:28.063216+0000 mgr.a (mgr.14355) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:28 smithi171 bash[25040]: cluster 2024-09-14T00:49:28.063216+0000 mgr.a (mgr.14355) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:30 smithi007 bash[22722]: cluster 2024-09-14T00:49:30.064041+0000 mgr.a (mgr.14355) 6427 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:30 smithi131 bash[24745]: cluster 2024-09-14T00:49:30.064041+0000 mgr.a (mgr.14355) 6427 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:30 smithi171 bash[25040]: cluster 2024-09-14T00:49:30.064041+0000 mgr.a (mgr.14355) 6427 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:49:31.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:31.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:32 smithi007 bash[22722]: cluster 2024-09-14T00:49:32.065881+0000 mgr.a (mgr.14355) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:49:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:32 smithi131 bash[24745]: cluster 2024-09-14T00:49:32.065881+0000 mgr.a (mgr.14355) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:49:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:32 smithi171 bash[25040]: cluster 2024-09-14T00:49:32.065881+0000 mgr.a (mgr.14355) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:49:32.664 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:32.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:32.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:32.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:32.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:33 smithi007 bash[22722]: audit 2024-09-14T00:49:32.254328+0000 mgr.a (mgr.14355) 6429 : audit [DBG] from='client.147225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:33 smithi131 bash[24745]: audit 2024-09-14T00:49:32.254328+0000 mgr.a (mgr.14355) 6429 : audit [DBG] from='client.147225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:33 smithi171 bash[25040]: audit 2024-09-14T00:49:32.254328+0000 mgr.a (mgr.14355) 6429 : audit [DBG] from='client.147225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:34 smithi007 bash[22722]: cluster 2024-09-14T00:49:34.066795+0000 mgr.a (mgr.14355) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:34 smithi131 bash[24745]: cluster 2024-09-14T00:49:34.066795+0000 mgr.a (mgr.14355) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:34 smithi171 bash[25040]: cluster 2024-09-14T00:49:34.066795+0000 mgr.a (mgr.14355) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:36 smithi007 bash[22722]: cluster 2024-09-14T00:49:36.068986+0000 mgr.a (mgr.14355) 6431 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:36 smithi131 bash[24745]: cluster 2024-09-14T00:49:36.068986+0000 mgr.a (mgr.14355) 6431 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:36 smithi171 bash[25040]: cluster 2024-09-14T00:49:36.068986+0000 mgr.a (mgr.14355) 6431 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:37.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:37.667 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:38.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:38 smithi007 bash[22722]: audit 2024-09-14T00:49:37.996142+0000 mgr.a (mgr.14355) 6432 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:38 smithi007 bash[22722]: cluster 2024-09-14T00:49:38.069599+0000 mgr.a (mgr.14355) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:38 smithi131 bash[24745]: audit 2024-09-14T00:49:37.996142+0000 mgr.a (mgr.14355) 6432 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:38 smithi131 bash[24745]: cluster 2024-09-14T00:49:38.069599+0000 mgr.a (mgr.14355) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:38 smithi171 bash[25040]: audit 2024-09-14T00:49:37.996142+0000 mgr.a (mgr.14355) 6432 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:38 smithi171 bash[25040]: cluster 2024-09-14T00:49:38.069599+0000 mgr.a (mgr.14355) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:40 smithi007 bash[22722]: cluster 2024-09-14T00:49:40.070468+0000 mgr.a (mgr.14355) 6434 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:40 smithi131 bash[24745]: cluster 2024-09-14T00:49:40.070468+0000 mgr.a (mgr.14355) 6434 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:40 smithi171 bash[25040]: cluster 2024-09-14T00:49:40.070468+0000 mgr.a (mgr.14355) 6434 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:40.184454+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:41.030484+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:41.032216+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:41.042697+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:41.047539+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22722]: audit 2024-09-14T00:49:41.049821+0000 mgr.a (mgr.14355) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:40.184454+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:41.030484+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:41.032216+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:41.042697+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:41.047539+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:41 smithi131 bash[24745]: audit 2024-09-14T00:49:41.049821+0000 mgr.a (mgr.14355) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:40.184454+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:41.030484+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:41.032216+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:41.042697+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:41.047539+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:41 smithi171 bash[25040]: audit 2024-09-14T00:49:41.049821+0000 mgr.a (mgr.14355) 6435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:49:42.142 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22972]: debug 2024-09-14T00:49:41.791+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:49:42.142 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:49:41 smithi007 bash[22972]: debug 2024-09-14T00:49:41.791+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:49:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:42 smithi007 bash[22722]: audit 2024-09-14T00:49:41.795300+0000 mgr.a (mgr.14355) 6436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:49:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:42 smithi007 bash[22722]: cephadm 2024-09-14T00:49:41.796569+0000 mgr.a (mgr.14355) 6437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:49:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:42 smithi007 bash[22722]: cluster 2024-09-14T00:49:42.073190+0000 mgr.a (mgr.14355) 6438 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:42 smithi131 bash[24745]: audit 2024-09-14T00:49:41.795300+0000 mgr.a (mgr.14355) 6436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:49:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:42 smithi131 bash[24745]: cephadm 2024-09-14T00:49:41.796569+0000 mgr.a (mgr.14355) 6437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:49:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:42 smithi131 bash[24745]: cluster 2024-09-14T00:49:42.073190+0000 mgr.a (mgr.14355) 6438 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:42 smithi171 bash[25040]: audit 2024-09-14T00:49:41.795300+0000 mgr.a (mgr.14355) 6436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:49:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:42 smithi171 bash[25040]: cephadm 2024-09-14T00:49:41.796569+0000 mgr.a (mgr.14355) 6437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:49:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:42 smithi171 bash[25040]: cluster 2024-09-14T00:49:42.073190+0000 mgr.a (mgr.14355) 6438 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:49:43.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:43.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:43.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:44.196 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:44 smithi007 bash[22722]: audit 2024-09-14T00:49:43.752214+0000 mgr.a (mgr.14355) 6439 : audit [DBG] from='client.147480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:44 smithi007 bash[22722]: cluster 2024-09-14T00:49:44.073755+0000 mgr.a (mgr.14355) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:44 smithi131 bash[24745]: audit 2024-09-14T00:49:43.752214+0000 mgr.a (mgr.14355) 6439 : audit [DBG] from='client.147480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:44 smithi131 bash[24745]: cluster 2024-09-14T00:49:44.073755+0000 mgr.a (mgr.14355) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:44 smithi171 bash[25040]: audit 2024-09-14T00:49:43.752214+0000 mgr.a (mgr.14355) 6439 : audit [DBG] from='client.147480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:44 smithi171 bash[25040]: cluster 2024-09-14T00:49:44.073755+0000 mgr.a (mgr.14355) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:49:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:46 smithi007 bash[22722]: cluster 2024-09-14T00:49:46.076107+0000 mgr.a (mgr.14355) 6441 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:46 smithi131 bash[24745]: cluster 2024-09-14T00:49:46.076107+0000 mgr.a (mgr.14355) 6441 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:46 smithi171 bash[25040]: cluster 2024-09-14T00:49:46.076107+0000 mgr.a (mgr.14355) 6441 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:48 smithi007 bash[22722]: cluster 2024-09-14T00:49:48.076987+0000 mgr.a (mgr.14355) 6442 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:48 smithi131 bash[24745]: cluster 2024-09-14T00:49:48.076987+0000 mgr.a (mgr.14355) 6442 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:48 smithi171 bash[25040]: cluster 2024-09-14T00:49:48.076987+0000 mgr.a (mgr.14355) 6442 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:49.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:49.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:49.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:49.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:49.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:50 smithi007 bash[22722]: audit 2024-09-14T00:49:49.529739+0000 mgr.a (mgr.14355) 6443 : audit [DBG] from='client.147558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:50 smithi007 bash[22722]: cluster 2024-09-14T00:49:50.077945+0000 mgr.a (mgr.14355) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:50 smithi131 bash[24745]: audit 2024-09-14T00:49:49.529739+0000 mgr.a (mgr.14355) 6443 : audit [DBG] from='client.147558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:50 smithi131 bash[24745]: cluster 2024-09-14T00:49:50.077945+0000 mgr.a (mgr.14355) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:50 smithi171 bash[25040]: audit 2024-09-14T00:49:49.529739+0000 mgr.a (mgr.14355) 6443 : audit [DBG] from='client.147558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:50 smithi171 bash[25040]: cluster 2024-09-14T00:49:50.077945+0000 mgr.a (mgr.14355) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:53 smithi007 bash[22722]: cluster 2024-09-14T00:49:52.080236+0000 mgr.a (mgr.14355) 6445 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:53 smithi131 bash[24745]: cluster 2024-09-14T00:49:52.080236+0000 mgr.a (mgr.14355) 6445 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:53 smithi171 bash[25040]: cluster 2024-09-14T00:49:52.080236+0000 mgr.a (mgr.14355) 6445 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:54.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:49:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:49:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:49:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:55 smithi007 bash[22722]: cluster 2024-09-14T00:49:54.081190+0000 mgr.a (mgr.14355) 6446 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:55 smithi131 bash[24745]: cluster 2024-09-14T00:49:54.081190+0000 mgr.a (mgr.14355) 6446 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:55 smithi171 bash[25040]: cluster 2024-09-14T00:49:54.081190+0000 mgr.a (mgr.14355) 6446 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:55.701 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:49:55.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:49:55.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:49:55.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:49:55.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:49:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:56 smithi007 bash[22722]: audit 2024-09-14T00:49:55.288175+0000 mgr.a (mgr.14355) 6447 : audit [DBG] from='client.147636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:56 smithi131 bash[24745]: audit 2024-09-14T00:49:55.288175+0000 mgr.a (mgr.14355) 6447 : audit [DBG] from='client.147636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:56 smithi171 bash[25040]: audit 2024-09-14T00:49:55.288175+0000 mgr.a (mgr.14355) 6447 : audit [DBG] from='client.147636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:49:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:57 smithi007 bash[22722]: cluster 2024-09-14T00:49:56.083959+0000 mgr.a (mgr.14355) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:57 smithi131 bash[24745]: cluster 2024-09-14T00:49:56.083959+0000 mgr.a (mgr.14355) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:57 smithi171 bash[25040]: cluster 2024-09-14T00:49:56.083959+0000 mgr.a (mgr.14355) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:49:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:49:59 smithi007 bash[22722]: cluster 2024-09-14T00:49:58.084736+0000 mgr.a (mgr.14355) 6449 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:49:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:49:59 smithi131 bash[24745]: cluster 2024-09-14T00:49:58.084736+0000 mgr.a (mgr.14355) 6449 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:49:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:49:59 smithi171 bash[25040]: cluster 2024-09-14T00:49:58.084736+0000 mgr.a (mgr.14355) 6449 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:00 smithi007 bash[22722]: cluster 2024-09-14T00:50:00.000153+0000 mon.a (mon.0) 1564 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:50:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:00 smithi131 bash[24745]: cluster 2024-09-14T00:50:00.000153+0000 mon.a (mon.0) 1564 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:50:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:00 smithi171 bash[25040]: cluster 2024-09-14T00:50:00.000153+0000 mon.a (mon.0) 1564 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T00:50:00.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:00.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:00.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:01 smithi007 bash[22722]: cluster 2024-09-14T00:50:00.085515+0000 mgr.a (mgr.14355) 6450 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:01 smithi007 bash[22722]: audit 2024-09-14T00:50:01.031860+0000 mgr.a (mgr.14355) 6451 : audit [DBG] from='client.147714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:01.466 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:01.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:01.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:01.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:01.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:01 smithi131 bash[24745]: cluster 2024-09-14T00:50:00.085515+0000 mgr.a (mgr.14355) 6450 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:01 smithi131 bash[24745]: audit 2024-09-14T00:50:01.031860+0000 mgr.a (mgr.14355) 6451 : audit [DBG] from='client.147714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:01 smithi171 bash[25040]: cluster 2024-09-14T00:50:00.085515+0000 mgr.a (mgr.14355) 6450 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:01 smithi171 bash[25040]: audit 2024-09-14T00:50:01.031860+0000 mgr.a (mgr.14355) 6451 : audit [DBG] from='client.147714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:03 smithi007 bash[22722]: cluster 2024-09-14T00:50:02.088299+0000 mgr.a (mgr.14355) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:03 smithi131 bash[24745]: cluster 2024-09-14T00:50:02.088299+0000 mgr.a (mgr.14355) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:03 smithi171 bash[25040]: cluster 2024-09-14T00:50:02.088299+0000 mgr.a (mgr.14355) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:05 smithi007 bash[22722]: cluster 2024-09-14T00:50:04.089093+0000 mgr.a (mgr.14355) 6453 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:05 smithi131 bash[24745]: cluster 2024-09-14T00:50:04.089093+0000 mgr.a (mgr.14355) 6453 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:05 smithi171 bash[25040]: cluster 2024-09-14T00:50:04.089093+0000 mgr.a (mgr.14355) 6453 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:06.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:06.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:06.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:07.241 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:07 smithi007 bash[22722]: cluster 2024-09-14T00:50:06.091132+0000 mgr.a (mgr.14355) 6454 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:07 smithi007 bash[22722]: audit 2024-09-14T00:50:06.801962+0000 mgr.a (mgr.14355) 6455 : audit [DBG] from='client.147789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:07 smithi131 bash[24745]: cluster 2024-09-14T00:50:06.091132+0000 mgr.a (mgr.14355) 6454 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:07 smithi131 bash[24745]: audit 2024-09-14T00:50:06.801962+0000 mgr.a (mgr.14355) 6455 : audit [DBG] from='client.147789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:07 smithi171 bash[25040]: cluster 2024-09-14T00:50:06.091132+0000 mgr.a (mgr.14355) 6454 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:07 smithi171 bash[25040]: audit 2024-09-14T00:50:06.801962+0000 mgr.a (mgr.14355) 6455 : audit [DBG] from='client.147789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:09 smithi007 bash[22722]: cluster 2024-09-14T00:50:08.092030+0000 mgr.a (mgr.14355) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:09 smithi131 bash[24745]: cluster 2024-09-14T00:50:08.092030+0000 mgr.a (mgr.14355) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:09 smithi171 bash[25040]: cluster 2024-09-14T00:50:08.092030+0000 mgr.a (mgr.14355) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:11 smithi007 bash[22722]: cluster 2024-09-14T00:50:10.092837+0000 mgr.a (mgr.14355) 6457 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:11 smithi131 bash[24745]: cluster 2024-09-14T00:50:10.092837+0000 mgr.a (mgr.14355) 6457 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:11 smithi171 bash[25040]: cluster 2024-09-14T00:50:10.092837+0000 mgr.a (mgr.14355) 6457 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:13.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:13.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:13 smithi007 bash[22722]: cluster 2024-09-14T00:50:12.095072+0000 mgr.a (mgr.14355) 6458 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:13 smithi007 bash[22722]: audit 2024-09-14T00:50:12.576682+0000 mgr.a (mgr.14355) 6459 : audit [DBG] from='client.147867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:13 smithi131 bash[24745]: cluster 2024-09-14T00:50:12.095072+0000 mgr.a (mgr.14355) 6458 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:13 smithi131 bash[24745]: audit 2024-09-14T00:50:12.576682+0000 mgr.a (mgr.14355) 6459 : audit [DBG] from='client.147867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:13 smithi171 bash[25040]: cluster 2024-09-14T00:50:12.095072+0000 mgr.a (mgr.14355) 6458 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:13 smithi171 bash[25040]: audit 2024-09-14T00:50:12.576682+0000 mgr.a (mgr.14355) 6459 : audit [DBG] from='client.147867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:15 smithi131 bash[24745]: cluster 2024-09-14T00:50:14.095983+0000 mgr.a (mgr.14355) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:15 smithi171 bash[25040]: cluster 2024-09-14T00:50:14.095983+0000 mgr.a (mgr.14355) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:15 smithi007 bash[22722]: cluster 2024-09-14T00:50:14.095983+0000 mgr.a (mgr.14355) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:17 smithi131 bash[24745]: cluster 2024-09-14T00:50:16.098204+0000 mgr.a (mgr.14355) 6461 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:17 smithi171 bash[25040]: cluster 2024-09-14T00:50:16.098204+0000 mgr.a (mgr.14355) 6461 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:17 smithi007 bash[22722]: cluster 2024-09-14T00:50:16.098204+0000 mgr.a (mgr.14355) 6461 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:18.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:18.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:18.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:19 smithi131 bash[24745]: cluster 2024-09-14T00:50:18.098963+0000 mgr.a (mgr.14355) 6462 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:19 smithi131 bash[24745]: audit 2024-09-14T00:50:18.354702+0000 mgr.a (mgr.14355) 6463 : audit [DBG] from='client.147945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:19 smithi171 bash[25040]: cluster 2024-09-14T00:50:18.098963+0000 mgr.a (mgr.14355) 6462 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:19 smithi171 bash[25040]: audit 2024-09-14T00:50:18.354702+0000 mgr.a (mgr.14355) 6463 : audit [DBG] from='client.147945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:19 smithi007 bash[22722]: cluster 2024-09-14T00:50:18.098963+0000 mgr.a (mgr.14355) 6462 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:19 smithi007 bash[22722]: audit 2024-09-14T00:50:18.354702+0000 mgr.a (mgr.14355) 6463 : audit [DBG] from='client.147945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:21 smithi131 bash[24745]: cluster 2024-09-14T00:50:20.099990+0000 mgr.a (mgr.14355) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:21 smithi171 bash[25040]: cluster 2024-09-14T00:50:20.099990+0000 mgr.a (mgr.14355) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:21 smithi007 bash[22722]: cluster 2024-09-14T00:50:20.099990+0000 mgr.a (mgr.14355) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:23 smithi131 bash[24745]: cluster 2024-09-14T00:50:22.102405+0000 mgr.a (mgr.14355) 6465 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:23 smithi171 bash[25040]: cluster 2024-09-14T00:50:22.102405+0000 mgr.a (mgr.14355) 6465 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:23 smithi007 bash[22722]: cluster 2024-09-14T00:50:22.102405+0000 mgr.a (mgr.14355) 6465 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:23.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:23.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:24.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:24.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:25 smithi131 bash[24745]: cluster 2024-09-14T00:50:24.103282+0000 mgr.a (mgr.14355) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:25 smithi131 bash[24745]: audit 2024-09-14T00:50:24.136857+0000 mgr.a (mgr.14355) 6467 : audit [DBG] from='client.148023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:25 smithi171 bash[25040]: cluster 2024-09-14T00:50:24.103282+0000 mgr.a (mgr.14355) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:25 smithi171 bash[25040]: audit 2024-09-14T00:50:24.136857+0000 mgr.a (mgr.14355) 6467 : audit [DBG] from='client.148023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:25 smithi007 bash[22722]: cluster 2024-09-14T00:50:24.103282+0000 mgr.a (mgr.14355) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:25 smithi007 bash[22722]: audit 2024-09-14T00:50:24.136857+0000 mgr.a (mgr.14355) 6467 : audit [DBG] from='client.148023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:27 smithi131 bash[24745]: cluster 2024-09-14T00:50:26.105592+0000 mgr.a (mgr.14355) 6468 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:27 smithi171 bash[25040]: cluster 2024-09-14T00:50:26.105592+0000 mgr.a (mgr.14355) 6468 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:27 smithi007 bash[22722]: cluster 2024-09-14T00:50:26.105592+0000 mgr.a (mgr.14355) 6468 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:29 smithi131 bash[24745]: cluster 2024-09-14T00:50:28.106380+0000 mgr.a (mgr.14355) 6469 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:29 smithi171 bash[25040]: cluster 2024-09-14T00:50:28.106380+0000 mgr.a (mgr.14355) 6469 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:29.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:29.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:29.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:29 smithi007 bash[22722]: cluster 2024-09-14T00:50:28.106380+0000 mgr.a (mgr.14355) 6469 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:30.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:30 smithi131 bash[24745]: audit 2024-09-14T00:50:29.913879+0000 mgr.a (mgr.14355) 6470 : audit [DBG] from='client.148098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:30 smithi171 bash[25040]: audit 2024-09-14T00:50:29.913879+0000 mgr.a (mgr.14355) 6470 : audit [DBG] from='client.148098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:30 smithi007 bash[22722]: audit 2024-09-14T00:50:29.913879+0000 mgr.a (mgr.14355) 6470 : audit [DBG] from='client.148098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:31 smithi131 bash[24745]: cluster 2024-09-14T00:50:30.107079+0000 mgr.a (mgr.14355) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:31.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:31 smithi171 bash[25040]: cluster 2024-09-14T00:50:30.107079+0000 mgr.a (mgr.14355) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:31 smithi007 bash[22722]: cluster 2024-09-14T00:50:30.107079+0000 mgr.a (mgr.14355) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:33 smithi131 bash[24745]: cluster 2024-09-14T00:50:32.109410+0000 mgr.a (mgr.14355) 6472 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:33 smithi171 bash[25040]: cluster 2024-09-14T00:50:32.109410+0000 mgr.a (mgr.14355) 6472 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:33 smithi007 bash[22722]: cluster 2024-09-14T00:50:32.109410+0000 mgr.a (mgr.14355) 6472 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:35 smithi131 bash[24745]: cluster 2024-09-14T00:50:34.110211+0000 mgr.a (mgr.14355) 6473 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:35 smithi171 bash[25040]: cluster 2024-09-14T00:50:34.110211+0000 mgr.a (mgr.14355) 6473 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:35 smithi007 bash[22722]: cluster 2024-09-14T00:50:34.110211+0000 mgr.a (mgr.14355) 6473 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:36.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:36 smithi131 bash[24745]: audit 2024-09-14T00:50:35.687962+0000 mgr.a (mgr.14355) 6474 : audit [DBG] from='client.148176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:36 smithi171 bash[25040]: audit 2024-09-14T00:50:35.687962+0000 mgr.a (mgr.14355) 6474 : audit [DBG] from='client.148176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:36 smithi007 bash[22722]: audit 2024-09-14T00:50:35.687962+0000 mgr.a (mgr.14355) 6474 : audit [DBG] from='client.148176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:37 smithi131 bash[24745]: cluster 2024-09-14T00:50:36.111521+0000 mgr.a (mgr.14355) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:37 smithi171 bash[25040]: cluster 2024-09-14T00:50:36.111521+0000 mgr.a (mgr.14355) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:37 smithi007 bash[22722]: cluster 2024-09-14T00:50:36.111521+0000 mgr.a (mgr.14355) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:39 smithi131 bash[24745]: cluster 2024-09-14T00:50:38.112226+0000 mgr.a (mgr.14355) 6476 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:39 smithi171 bash[25040]: cluster 2024-09-14T00:50:38.112226+0000 mgr.a (mgr.14355) 6476 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:39 smithi007 bash[22722]: cluster 2024-09-14T00:50:38.112226+0000 mgr.a (mgr.14355) 6476 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:41.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:41.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:41 smithi131 bash[24745]: cluster 2024-09-14T00:50:40.113122+0000 mgr.a (mgr.14355) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:41 smithi171 bash[25040]: cluster 2024-09-14T00:50:40.113122+0000 mgr.a (mgr.14355) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:41 smithi007 bash[22722]: cluster 2024-09-14T00:50:40.113122+0000 mgr.a (mgr.14355) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:50:41.895 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:41.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:42 smithi131 bash[24745]: audit 2024-09-14T00:50:41.451899+0000 mgr.a (mgr.14355) 6478 : audit [DBG] from='client.148254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:42 smithi131 bash[24745]: audit 2024-09-14T00:50:41.846857+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:50:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:42 smithi171 bash[25040]: audit 2024-09-14T00:50:41.451899+0000 mgr.a (mgr.14355) 6478 : audit [DBG] from='client.148254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:42 smithi171 bash[25040]: audit 2024-09-14T00:50:41.846857+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:50:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:42 smithi007 bash[22722]: audit 2024-09-14T00:50:41.451899+0000 mgr.a (mgr.14355) 6478 : audit [DBG] from='client.148254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:42 smithi007 bash[22722]: audit 2024-09-14T00:50:41.846857+0000 mon.a (mon.0) 1565 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:50:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:43 smithi131 bash[24745]: cluster 2024-09-14T00:50:42.115834+0000 mgr.a (mgr.14355) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:43 smithi171 bash[25040]: cluster 2024-09-14T00:50:42.115834+0000 mgr.a (mgr.14355) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:43 smithi007 bash[22722]: cluster 2024-09-14T00:50:42.115834+0000 mgr.a (mgr.14355) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:45 smithi171 bash[25040]: cluster 2024-09-14T00:50:44.116813+0000 mgr.a (mgr.14355) 6480 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:45 smithi007 bash[22722]: cluster 2024-09-14T00:50:44.116813+0000 mgr.a (mgr.14355) 6480 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:45 smithi131 bash[24745]: cluster 2024-09-14T00:50:44.116813+0000 mgr.a (mgr.14355) 6480 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:50:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:47.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:47.654 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:47 smithi171 bash[25040]: cluster 2024-09-14T00:50:46.118897+0000 mgr.a (mgr.14355) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:47 smithi007 bash[22722]: cluster 2024-09-14T00:50:46.118897+0000 mgr.a (mgr.14355) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:47 smithi131 bash[24745]: cluster 2024-09-14T00:50:46.118897+0000 mgr.a (mgr.14355) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:49.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:48 smithi007 bash[22722]: audit 2024-09-14T00:50:47.229097+0000 mgr.a (mgr.14355) 6482 : audit [DBG] from='client.148332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:48 smithi131 bash[24745]: audit 2024-09-14T00:50:47.229097+0000 mgr.a (mgr.14355) 6482 : audit [DBG] from='client.148332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:48 smithi171 bash[25040]: audit 2024-09-14T00:50:47.229097+0000 mgr.a (mgr.14355) 6482 : audit [DBG] from='client.148332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:49 smithi007 bash[22722]: cluster 2024-09-14T00:50:48.119784+0000 mgr.a (mgr.14355) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:49 smithi131 bash[24745]: cluster 2024-09-14T00:50:48.119784+0000 mgr.a (mgr.14355) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:49 smithi171 bash[25040]: cluster 2024-09-14T00:50:48.119784+0000 mgr.a (mgr.14355) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:51 smithi007 bash[22722]: cluster 2024-09-14T00:50:50.120587+0000 mgr.a (mgr.14355) 6484 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:51 smithi131 bash[24745]: cluster 2024-09-14T00:50:50.120587+0000 mgr.a (mgr.14355) 6484 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:51 smithi171 bash[25040]: cluster 2024-09-14T00:50:50.120587+0000 mgr.a (mgr.14355) 6484 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:52.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:52.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:52.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22972]: debug 2024-09-14T00:50:53.310+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:50:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22972]: debug 2024-09-14T00:50:53.326+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:50:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: cluster 2024-09-14T00:50:52.122895+0000 mgr.a (mgr.14355) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.522235+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.530244+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.532742+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.534610+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.546836+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.552066+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.554447+0000 mgr.a (mgr.14355) 6486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:53 smithi007 bash[22722]: audit 2024-09-14T00:50:52.997766+0000 mgr.a (mgr.14355) 6487 : audit [DBG] from='client.148431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:53.727 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:53.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:53.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:53.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:53.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: cluster 2024-09-14T00:50:52.122895+0000 mgr.a (mgr.14355) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.522235+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.530244+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.532742+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.534610+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.546836+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.552066+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.554447+0000 mgr.a (mgr.14355) 6486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:53 smithi131 bash[24745]: audit 2024-09-14T00:50:52.997766+0000 mgr.a (mgr.14355) 6487 : audit [DBG] from='client.148431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: cluster 2024-09-14T00:50:52.122895+0000 mgr.a (mgr.14355) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.522235+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.530244+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.532742+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.534610+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.546836+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.552066+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.554447+0000 mgr.a (mgr.14355) 6486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:50:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:53 smithi171 bash[25040]: audit 2024-09-14T00:50:52.997766+0000 mgr.a (mgr.14355) 6487 : audit [DBG] from='client.148431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:50:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:54 smithi131 bash[24745]: audit 2024-09-14T00:50:53.318213+0000 mgr.a (mgr.14355) 6488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:50:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:54 smithi131 bash[24745]: cephadm 2024-09-14T00:50:53.330375+0000 mgr.a (mgr.14355) 6489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:50:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:54 smithi171 bash[25040]: audit 2024-09-14T00:50:53.318213+0000 mgr.a (mgr.14355) 6488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:50:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:54 smithi171 bash[25040]: cephadm 2024-09-14T00:50:53.330375+0000 mgr.a (mgr.14355) 6489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:50:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:54 smithi007 bash[22722]: audit 2024-09-14T00:50:53.318213+0000 mgr.a (mgr.14355) 6488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:50:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:54 smithi007 bash[22722]: cephadm 2024-09-14T00:50:53.330375+0000 mgr.a (mgr.14355) 6489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:50:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:55 smithi131 bash[24745]: cluster 2024-09-14T00:50:54.123855+0000 mgr.a (mgr.14355) 6490 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:55 smithi171 bash[25040]: cluster 2024-09-14T00:50:54.123855+0000 mgr.a (mgr.14355) 6490 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:55 smithi007 bash[22722]: cluster 2024-09-14T00:50:54.123855+0000 mgr.a (mgr.14355) 6490 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:50:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:57 smithi007 bash[22722]: cluster 2024-09-14T00:50:56.126085+0000 mgr.a (mgr.14355) 6491 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:50:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:57 smithi131 bash[24745]: cluster 2024-09-14T00:50:56.126085+0000 mgr.a (mgr.14355) 6491 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:50:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:57 smithi171 bash[25040]: cluster 2024-09-14T00:50:56.126085+0000 mgr.a (mgr.14355) 6491 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:50:58.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:50:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:50:58.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:50:59.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:50:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:50:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:50:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:50:59.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:59 smithi007 bash[22722]: cluster 2024-09-14T00:50:58.126908+0000 mgr.a (mgr.14355) 6492 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:50:59 smithi007 bash[22722]: audit 2024-09-14T00:50:59.063573+0000 mgr.a (mgr.14355) 6493 : audit [DBG] from='client.148596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:59 smithi131 bash[24745]: cluster 2024-09-14T00:50:58.126908+0000 mgr.a (mgr.14355) 6492 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:50:59 smithi131 bash[24745]: audit 2024-09-14T00:50:59.063573+0000 mgr.a (mgr.14355) 6493 : audit [DBG] from='client.148596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:59 smithi171 bash[25040]: cluster 2024-09-14T00:50:58.126908+0000 mgr.a (mgr.14355) 6492 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:50:59 smithi171 bash[25040]: audit 2024-09-14T00:50:59.063573+0000 mgr.a (mgr.14355) 6493 : audit [DBG] from='client.148596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:01 smithi007 bash[22722]: cluster 2024-09-14T00:51:00.127826+0000 mgr.a (mgr.14355) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:01 smithi131 bash[24745]: cluster 2024-09-14T00:51:00.127826+0000 mgr.a (mgr.14355) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:01 smithi171 bash[25040]: cluster 2024-09-14T00:51:00.127826+0000 mgr.a (mgr.14355) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:03 smithi007 bash[22722]: cluster 2024-09-14T00:51:02.130201+0000 mgr.a (mgr.14355) 6495 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:03 smithi131 bash[24745]: cluster 2024-09-14T00:51:02.130201+0000 mgr.a (mgr.14355) 6495 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:03 smithi171 bash[25040]: cluster 2024-09-14T00:51:02.130201+0000 mgr.a (mgr.14355) 6495 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:04.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:04.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:04.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:05.249 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:05 smithi007 bash[22722]: cluster 2024-09-14T00:51:04.131124+0000 mgr.a (mgr.14355) 6496 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:05 smithi007 bash[22722]: audit 2024-09-14T00:51:04.834826+0000 mgr.a (mgr.14355) 6497 : audit [DBG] from='client.148671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:05 smithi131 bash[24745]: cluster 2024-09-14T00:51:04.131124+0000 mgr.a (mgr.14355) 6496 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:05 smithi131 bash[24745]: audit 2024-09-14T00:51:04.834826+0000 mgr.a (mgr.14355) 6497 : audit [DBG] from='client.148671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:05 smithi171 bash[25040]: cluster 2024-09-14T00:51:04.131124+0000 mgr.a (mgr.14355) 6496 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:05 smithi171 bash[25040]: audit 2024-09-14T00:51:04.834826+0000 mgr.a (mgr.14355) 6497 : audit [DBG] from='client.148671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:07 smithi007 bash[22722]: cluster 2024-09-14T00:51:06.133494+0000 mgr.a (mgr.14355) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:07 smithi131 bash[24745]: cluster 2024-09-14T00:51:06.133494+0000 mgr.a (mgr.14355) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:07 smithi171 bash[25040]: cluster 2024-09-14T00:51:06.133494+0000 mgr.a (mgr.14355) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:51:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:09 smithi007 bash[22722]: cluster 2024-09-14T00:51:08.134273+0000 mgr.a (mgr.14355) 6499 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:10.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:10.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:09 smithi131 bash[24745]: cluster 2024-09-14T00:51:08.134273+0000 mgr.a (mgr.14355) 6499 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:09 smithi171 bash[25040]: cluster 2024-09-14T00:51:08.134273+0000 mgr.a (mgr.14355) 6499 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:10.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:10.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:11 smithi007 bash[22722]: cluster 2024-09-14T00:51:10.135042+0000 mgr.a (mgr.14355) 6500 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:11 smithi007 bash[22722]: audit 2024-09-14T00:51:10.578722+0000 mgr.a (mgr.14355) 6501 : audit [DBG] from='client.148743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:11 smithi131 bash[24745]: cluster 2024-09-14T00:51:10.135042+0000 mgr.a (mgr.14355) 6500 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:11 smithi131 bash[24745]: audit 2024-09-14T00:51:10.578722+0000 mgr.a (mgr.14355) 6501 : audit [DBG] from='client.148743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:11 smithi171 bash[25040]: cluster 2024-09-14T00:51:10.135042+0000 mgr.a (mgr.14355) 6500 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:11 smithi171 bash[25040]: audit 2024-09-14T00:51:10.578722+0000 mgr.a (mgr.14355) 6501 : audit [DBG] from='client.148743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:13 smithi007 bash[22722]: cluster 2024-09-14T00:51:12.137771+0000 mgr.a (mgr.14355) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:13 smithi131 bash[24745]: cluster 2024-09-14T00:51:12.137771+0000 mgr.a (mgr.14355) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:13 smithi171 bash[25040]: cluster 2024-09-14T00:51:12.137771+0000 mgr.a (mgr.14355) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:16.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:16.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:16.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:15 smithi007 bash[22722]: cluster 2024-09-14T00:51:14.138576+0000 mgr.a (mgr.14355) 6503 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:15 smithi131 bash[24745]: cluster 2024-09-14T00:51:14.138576+0000 mgr.a (mgr.14355) 6503 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:15 smithi171 bash[25040]: cluster 2024-09-14T00:51:14.138576+0000 mgr.a (mgr.14355) 6503 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:16.755 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:16.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:16.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:16.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:16.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:17 smithi007 bash[22722]: cluster 2024-09-14T00:51:16.139526+0000 mgr.a (mgr.14355) 6504 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:17 smithi007 bash[22722]: audit 2024-09-14T00:51:16.336047+0000 mgr.a (mgr.14355) 6505 : audit [DBG] from='client.148818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:17 smithi131 bash[24745]: cluster 2024-09-14T00:51:16.139526+0000 mgr.a (mgr.14355) 6504 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:17 smithi131 bash[24745]: audit 2024-09-14T00:51:16.336047+0000 mgr.a (mgr.14355) 6505 : audit [DBG] from='client.148818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:17 smithi171 bash[25040]: cluster 2024-09-14T00:51:16.139526+0000 mgr.a (mgr.14355) 6504 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:17 smithi171 bash[25040]: audit 2024-09-14T00:51:16.336047+0000 mgr.a (mgr.14355) 6505 : audit [DBG] from='client.148818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:19 smithi007 bash[22722]: cluster 2024-09-14T00:51:18.140375+0000 mgr.a (mgr.14355) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:19 smithi131 bash[24745]: cluster 2024-09-14T00:51:18.140375+0000 mgr.a (mgr.14355) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:19 smithi171 bash[25040]: cluster 2024-09-14T00:51:18.140375+0000 mgr.a (mgr.14355) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:21.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:21.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:21.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:21 smithi007 bash[22722]: cluster 2024-09-14T00:51:20.141158+0000 mgr.a (mgr.14355) 6507 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:21 smithi131 bash[24745]: cluster 2024-09-14T00:51:20.141158+0000 mgr.a (mgr.14355) 6507 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:21 smithi171 bash[25040]: cluster 2024-09-14T00:51:20.141158+0000 mgr.a (mgr.14355) 6507 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:22.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:22.541 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:23 smithi007 bash[22722]: audit 2024-09-14T00:51:22.098501+0000 mgr.a (mgr.14355) 6508 : audit [DBG] from='client.148890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:23 smithi007 bash[22722]: cluster 2024-09-14T00:51:22.144217+0000 mgr.a (mgr.14355) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:23 smithi131 bash[24745]: audit 2024-09-14T00:51:22.098501+0000 mgr.a (mgr.14355) 6508 : audit [DBG] from='client.148890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:23 smithi131 bash[24745]: cluster 2024-09-14T00:51:22.144217+0000 mgr.a (mgr.14355) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:23 smithi171 bash[25040]: audit 2024-09-14T00:51:22.098501+0000 mgr.a (mgr.14355) 6508 : audit [DBG] from='client.148890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:23 smithi171 bash[25040]: cluster 2024-09-14T00:51:22.144217+0000 mgr.a (mgr.14355) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:25 smithi007 bash[22722]: cluster 2024-09-14T00:51:24.145249+0000 mgr.a (mgr.14355) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:25 smithi131 bash[24745]: cluster 2024-09-14T00:51:24.145249+0000 mgr.a (mgr.14355) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:25 smithi171 bash[25040]: cluster 2024-09-14T00:51:24.145249+0000 mgr.a (mgr.14355) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:27.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:28.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:27 smithi007 bash[22722]: cluster 2024-09-14T00:51:26.147562+0000 mgr.a (mgr.14355) 6511 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:27 smithi131 bash[24745]: cluster 2024-09-14T00:51:26.147562+0000 mgr.a (mgr.14355) 6511 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:27 smithi171 bash[25040]: cluster 2024-09-14T00:51:26.147562+0000 mgr.a (mgr.14355) 6511 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:28.314 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:28.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:28.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:28.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:28.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:28 smithi007 bash[22722]: audit 2024-09-14T00:51:27.879196+0000 mgr.a (mgr.14355) 6512 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:28 smithi131 bash[24745]: audit 2024-09-14T00:51:27.879196+0000 mgr.a (mgr.14355) 6512 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:28 smithi171 bash[25040]: audit 2024-09-14T00:51:27.879196+0000 mgr.a (mgr.14355) 6512 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:29 smithi007 bash[22722]: cluster 2024-09-14T00:51:28.148374+0000 mgr.a (mgr.14355) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:29 smithi131 bash[24745]: cluster 2024-09-14T00:51:28.148374+0000 mgr.a (mgr.14355) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:29 smithi171 bash[25040]: cluster 2024-09-14T00:51:28.148374+0000 mgr.a (mgr.14355) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:31 smithi007 bash[22722]: cluster 2024-09-14T00:51:30.149276+0000 mgr.a (mgr.14355) 6514 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:31 smithi131 bash[24745]: cluster 2024-09-14T00:51:30.149276+0000 mgr.a (mgr.14355) 6514 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:31 smithi171 bash[25040]: cluster 2024-09-14T00:51:30.149276+0000 mgr.a (mgr.14355) 6514 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:33.315 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:33.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:34.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:34.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:33 smithi007 bash[22722]: cluster 2024-09-14T00:51:32.151882+0000 mgr.a (mgr.14355) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:33 smithi131 bash[24745]: cluster 2024-09-14T00:51:32.151882+0000 mgr.a (mgr.14355) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:33 smithi171 bash[25040]: cluster 2024-09-14T00:51:32.151882+0000 mgr.a (mgr.14355) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:34 smithi007 bash[22722]: audit 2024-09-14T00:51:33.649389+0000 mgr.a (mgr.14355) 6516 : audit [DBG] from='client.149043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:34 smithi131 bash[24745]: audit 2024-09-14T00:51:33.649389+0000 mgr.a (mgr.14355) 6516 : audit [DBG] from='client.149043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:34 smithi171 bash[25040]: audit 2024-09-14T00:51:33.649389+0000 mgr.a (mgr.14355) 6516 : audit [DBG] from='client.149043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:35 smithi007 bash[22722]: cluster 2024-09-14T00:51:34.152746+0000 mgr.a (mgr.14355) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:35 smithi131 bash[24745]: cluster 2024-09-14T00:51:34.152746+0000 mgr.a (mgr.14355) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:35 smithi171 bash[25040]: cluster 2024-09-14T00:51:34.152746+0000 mgr.a (mgr.14355) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:37 smithi007 bash[22722]: cluster 2024-09-14T00:51:36.154993+0000 mgr.a (mgr.14355) 6518 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:37 smithi131 bash[24745]: cluster 2024-09-14T00:51:36.154993+0000 mgr.a (mgr.14355) 6518 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:37 smithi171 bash[25040]: cluster 2024-09-14T00:51:36.154993+0000 mgr.a (mgr.14355) 6518 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:39.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:39.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:39.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:39.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:39.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:39 smithi007 bash[22722]: cluster 2024-09-14T00:51:38.155787+0000 mgr.a (mgr.14355) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:39 smithi131 bash[24745]: cluster 2024-09-14T00:51:38.155787+0000 mgr.a (mgr.14355) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:39 smithi171 bash[25040]: cluster 2024-09-14T00:51:38.155787+0000 mgr.a (mgr.14355) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:40 smithi007 bash[22722]: audit 2024-09-14T00:51:39.432828+0000 mgr.a (mgr.14355) 6520 : audit [DBG] from='client.149118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:40 smithi131 bash[24745]: audit 2024-09-14T00:51:39.432828+0000 mgr.a (mgr.14355) 6520 : audit [DBG] from='client.149118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:40 smithi171 bash[25040]: audit 2024-09-14T00:51:39.432828+0000 mgr.a (mgr.14355) 6520 : audit [DBG] from='client.149118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:41 smithi007 bash[22722]: cluster 2024-09-14T00:51:40.157985+0000 mgr.a (mgr.14355) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:41 smithi131 bash[24745]: cluster 2024-09-14T00:51:40.157985+0000 mgr.a (mgr.14355) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:41 smithi171 bash[25040]: cluster 2024-09-14T00:51:40.157985+0000 mgr.a (mgr.14355) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:43 smithi007 bash[22722]: cluster 2024-09-14T00:51:42.158804+0000 mgr.a (mgr.14355) 6522 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:43 smithi131 bash[24745]: cluster 2024-09-14T00:51:42.158804+0000 mgr.a (mgr.14355) 6522 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:43 smithi171 bash[25040]: cluster 2024-09-14T00:51:42.158804+0000 mgr.a (mgr.14355) 6522 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:51:44.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:44.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:45.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:45.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:45 smithi007 bash[22722]: cluster 2024-09-14T00:51:44.159573+0000 mgr.a (mgr.14355) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:45 smithi131 bash[24745]: cluster 2024-09-14T00:51:44.159573+0000 mgr.a (mgr.14355) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:45 smithi171 bash[25040]: cluster 2024-09-14T00:51:44.159573+0000 mgr.a (mgr.14355) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:46 smithi007 bash[22722]: audit 2024-09-14T00:51:45.208978+0000 mgr.a (mgr.14355) 6524 : audit [DBG] from='client.149193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:46 smithi131 bash[24745]: audit 2024-09-14T00:51:45.208978+0000 mgr.a (mgr.14355) 6524 : audit [DBG] from='client.149193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:46 smithi171 bash[25040]: audit 2024-09-14T00:51:45.208978+0000 mgr.a (mgr.14355) 6524 : audit [DBG] from='client.149193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:47 smithi007 bash[22722]: cluster 2024-09-14T00:51:46.162287+0000 mgr.a (mgr.14355) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:47 smithi131 bash[24745]: cluster 2024-09-14T00:51:46.162287+0000 mgr.a (mgr.14355) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:47 smithi171 bash[25040]: cluster 2024-09-14T00:51:46.162287+0000 mgr.a (mgr.14355) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:49 smithi007 bash[22722]: cluster 2024-09-14T00:51:48.163038+0000 mgr.a (mgr.14355) 6526 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:49 smithi131 bash[24745]: cluster 2024-09-14T00:51:48.163038+0000 mgr.a (mgr.14355) 6526 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:49 smithi171 bash[25040]: cluster 2024-09-14T00:51:48.163038+0000 mgr.a (mgr.14355) 6526 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:50.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:50.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:50.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:51.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:51.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:51.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:51.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:51.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:51 smithi007 bash[22722]: cluster 2024-09-14T00:51:50.164918+0000 mgr.a (mgr.14355) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:51 smithi007 bash[22722]: audit 2024-09-14T00:51:50.979080+0000 mgr.a (mgr.14355) 6528 : audit [DBG] from='client.149268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:51 smithi131 bash[24745]: cluster 2024-09-14T00:51:50.164918+0000 mgr.a (mgr.14355) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:51 smithi131 bash[24745]: audit 2024-09-14T00:51:50.979080+0000 mgr.a (mgr.14355) 6528 : audit [DBG] from='client.149268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:51 smithi171 bash[25040]: cluster 2024-09-14T00:51:50.164918+0000 mgr.a (mgr.14355) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:51 smithi171 bash[25040]: audit 2024-09-14T00:51:50.979080+0000 mgr.a (mgr.14355) 6528 : audit [DBG] from='client.149268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:53 smithi007 bash[22722]: cluster 2024-09-14T00:51:52.165904+0000 mgr.a (mgr.14355) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:53 smithi007 bash[22722]: audit 2024-09-14T00:51:53.390499+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:51:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:53 smithi131 bash[24745]: cluster 2024-09-14T00:51:52.165904+0000 mgr.a (mgr.14355) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:53 smithi131 bash[24745]: audit 2024-09-14T00:51:53.390499+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:51:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:53 smithi171 bash[25040]: cluster 2024-09-14T00:51:52.165904+0000 mgr.a (mgr.14355) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:51:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:53 smithi171 bash[25040]: audit 2024-09-14T00:51:53.390499+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:51:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:55 smithi007 bash[22722]: cluster 2024-09-14T00:51:54.166477+0000 mgr.a (mgr.14355) 6530 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:55 smithi131 bash[24745]: cluster 2024-09-14T00:51:54.166477+0000 mgr.a (mgr.14355) 6530 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:55 smithi171 bash[25040]: cluster 2024-09-14T00:51:54.166477+0000 mgr.a (mgr.14355) 6530 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:51:56.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:51:56.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:51:56.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:51:57.135 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:51:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:51:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:51:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:51:57.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:51:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:57 smithi007 bash[22722]: cluster 2024-09-14T00:51:56.168764+0000 mgr.a (mgr.14355) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:57 smithi007 bash[22722]: audit 2024-09-14T00:51:56.723917+0000 mgr.a (mgr.14355) 6532 : audit [DBG] from='client.149346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:57 smithi131 bash[24745]: cluster 2024-09-14T00:51:56.168764+0000 mgr.a (mgr.14355) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:57 smithi131 bash[24745]: audit 2024-09-14T00:51:56.723917+0000 mgr.a (mgr.14355) 6532 : audit [DBG] from='client.149346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:51:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:57 smithi171 bash[25040]: cluster 2024-09-14T00:51:56.168764+0000 mgr.a (mgr.14355) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:51:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:57 smithi171 bash[25040]: audit 2024-09-14T00:51:56.723917+0000 mgr.a (mgr.14355) 6532 : audit [DBG] from='client.149346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:00.226 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:51:59 smithi171 bash[25040]: cluster 2024-09-14T00:51:58.169788+0000 mgr.a (mgr.14355) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:51:59 smithi131 bash[24745]: cluster 2024-09-14T00:51:58.169788+0000 mgr.a (mgr.14355) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:51:59 smithi007 bash[22722]: cluster 2024-09-14T00:51:58.169788+0000 mgr.a (mgr.14355) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:02.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:01 smithi131 bash[24745]: cluster 2024-09-14T00:52:00.172263+0000 mgr.a (mgr.14355) 6534 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:52:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:01 smithi171 bash[25040]: cluster 2024-09-14T00:52:00.172263+0000 mgr.a (mgr.14355) 6534 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:52:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:01 smithi007 bash[22722]: cluster 2024-09-14T00:52:00.172263+0000 mgr.a (mgr.14355) 6534 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T00:52:02.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:02.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:02.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:02.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:02.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: cluster 2024-09-14T00:52:02.173164+0000 mgr.a (mgr.14355) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:02.469882+0000 mgr.a (mgr.14355) 6536 : audit [DBG] from='client.149424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.734488+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.743359+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.749954+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.757876+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.760181+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:52:04.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.762243+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:52:04.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.773045+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:03 smithi131 bash[24745]: audit 2024-09-14T00:52:03.778786+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: cluster 2024-09-14T00:52:02.173164+0000 mgr.a (mgr.14355) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:02.469882+0000 mgr.a (mgr.14355) 6536 : audit [DBG] from='client.149424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.734488+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.743359+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.749954+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.757876+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.760181+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.762243+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.773045+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:03 smithi171 bash[25040]: audit 2024-09-14T00:52:03.778786+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: cluster 2024-09-14T00:52:02.173164+0000 mgr.a (mgr.14355) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:02.469882+0000 mgr.a (mgr.14355) 6536 : audit [DBG] from='client.149424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.734488+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.743359+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.749954+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.757876+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.760181+0000 mon.a (mon.0) 1577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.762243+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.773045+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:52:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:03 smithi007 bash[22722]: audit 2024-09-14T00:52:03.778786+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:04.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:52:04 smithi007 bash[22972]: debug 2024-09-14T00:52:04.565+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:52:04.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:52:04 smithi007 bash[22972]: debug 2024-09-14T00:52:04.565+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:52:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:04 smithi131 bash[24745]: audit 2024-09-14T00:52:03.781581+0000 mgr.a (mgr.14355) 6537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:04 smithi171 bash[25040]: audit 2024-09-14T00:52:03.781581+0000 mgr.a (mgr.14355) 6537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:04 smithi007 bash[22722]: audit 2024-09-14T00:52:03.781581+0000 mgr.a (mgr.14355) 6537 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:52:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:05 smithi131 bash[24745]: cluster 2024-09-14T00:52:04.173710+0000 mgr.a (mgr.14355) 6538 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:05 smithi131 bash[24745]: audit 2024-09-14T00:52:04.567452+0000 mgr.a (mgr.14355) 6539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:52:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:05 smithi131 bash[24745]: cephadm 2024-09-14T00:52:04.569322+0000 mgr.a (mgr.14355) 6540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:52:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:05 smithi171 bash[25040]: cluster 2024-09-14T00:52:04.173710+0000 mgr.a (mgr.14355) 6538 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:05 smithi171 bash[25040]: audit 2024-09-14T00:52:04.567452+0000 mgr.a (mgr.14355) 6539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:52:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:05 smithi171 bash[25040]: cephadm 2024-09-14T00:52:04.569322+0000 mgr.a (mgr.14355) 6540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:52:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:05 smithi007 bash[22722]: cluster 2024-09-14T00:52:04.173710+0000 mgr.a (mgr.14355) 6538 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T00:52:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:05 smithi007 bash[22722]: audit 2024-09-14T00:52:04.567452+0000 mgr.a (mgr.14355) 6539 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:52:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:05 smithi007 bash[22722]: cephadm 2024-09-14T00:52:04.569322+0000 mgr.a (mgr.14355) 6540 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:52:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:07 smithi131 bash[24745]: cluster 2024-09-14T00:52:06.176392+0000 mgr.a (mgr.14355) 6541 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:52:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:07 smithi171 bash[25040]: cluster 2024-09-14T00:52:06.176392+0000 mgr.a (mgr.14355) 6541 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:52:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:07 smithi007 bash[22722]: cluster 2024-09-14T00:52:06.176392+0000 mgr.a (mgr.14355) 6541 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T00:52:08.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:09 smithi131 bash[24745]: cluster 2024-09-14T00:52:08.177169+0000 mgr.a (mgr.14355) 6542 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:52:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:09 smithi131 bash[24745]: audit 2024-09-14T00:52:08.254598+0000 mgr.a (mgr.14355) 6543 : audit [DBG] from='client.149604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:09 smithi171 bash[25040]: cluster 2024-09-14T00:52:08.177169+0000 mgr.a (mgr.14355) 6542 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:52:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:09 smithi171 bash[25040]: audit 2024-09-14T00:52:08.254598+0000 mgr.a (mgr.14355) 6543 : audit [DBG] from='client.149604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:09 smithi007 bash[22722]: cluster 2024-09-14T00:52:08.177169+0000 mgr.a (mgr.14355) 6542 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T00:52:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:09 smithi007 bash[22722]: audit 2024-09-14T00:52:08.254598+0000 mgr.a (mgr.14355) 6543 : audit [DBG] from='client.149604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:11 smithi131 bash[24745]: cluster 2024-09-14T00:52:10.179464+0000 mgr.a (mgr.14355) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 72 op/s 2024-09-14T00:52:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:11 smithi171 bash[25040]: cluster 2024-09-14T00:52:10.179464+0000 mgr.a (mgr.14355) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 72 op/s 2024-09-14T00:52:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:11 smithi007 bash[22722]: cluster 2024-09-14T00:52:10.179464+0000 mgr.a (mgr.14355) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 72 op/s 2024-09-14T00:52:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:13 smithi131 bash[24745]: cluster 2024-09-14T00:52:12.180283+0000 mgr.a (mgr.14355) 6545 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:13 smithi171 bash[25040]: cluster 2024-09-14T00:52:12.180283+0000 mgr.a (mgr.14355) 6545 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:14.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:14.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:14.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:13 smithi007 bash[22722]: cluster 2024-09-14T00:52:12.180283+0000 mgr.a (mgr.14355) 6545 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:15 smithi131 bash[24745]: audit 2024-09-14T00:52:14.029172+0000 mgr.a (mgr.14355) 6546 : audit [DBG] from='client.149676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:15 smithi171 bash[25040]: audit 2024-09-14T00:52:14.029172+0000 mgr.a (mgr.14355) 6546 : audit [DBG] from='client.149676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:15 smithi007 bash[22722]: audit 2024-09-14T00:52:14.029172+0000 mgr.a (mgr.14355) 6546 : audit [DBG] from='client.149676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:16 smithi131 bash[24745]: cluster 2024-09-14T00:52:14.180839+0000 mgr.a (mgr.14355) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:16 smithi171 bash[25040]: cluster 2024-09-14T00:52:14.180839+0000 mgr.a (mgr.14355) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:16 smithi007 bash[22722]: cluster 2024-09-14T00:52:14.180839+0000 mgr.a (mgr.14355) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 426 B/s wr, 65 op/s 2024-09-14T00:52:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:18 smithi131 bash[24745]: cluster 2024-09-14T00:52:16.183175+0000 mgr.a (mgr.14355) 6548 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-09-14T00:52:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:18 smithi171 bash[25040]: cluster 2024-09-14T00:52:16.183175+0000 mgr.a (mgr.14355) 6548 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-09-14T00:52:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:18 smithi007 bash[22722]: cluster 2024-09-14T00:52:16.183175+0000 mgr.a (mgr.14355) 6548 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-09-14T00:52:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:20.221 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:20.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:20 smithi131 bash[24745]: cluster 2024-09-14T00:52:18.183992+0000 mgr.a (mgr.14355) 6549 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:52:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:20 smithi171 bash[25040]: cluster 2024-09-14T00:52:18.183992+0000 mgr.a (mgr.14355) 6549 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:52:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:20 smithi007 bash[22722]: cluster 2024-09-14T00:52:18.183992+0000 mgr.a (mgr.14355) 6549 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T00:52:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:21 smithi131 bash[24745]: audit 2024-09-14T00:52:19.775034+0000 mgr.a (mgr.14355) 6550 : audit [DBG] from='client.149754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:21 smithi171 bash[25040]: audit 2024-09-14T00:52:19.775034+0000 mgr.a (mgr.14355) 6550 : audit [DBG] from='client.149754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:21 smithi007 bash[22722]: audit 2024-09-14T00:52:19.775034+0000 mgr.a (mgr.14355) 6550 : audit [DBG] from='client.149754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:22 smithi131 bash[24745]: cluster 2024-09-14T00:52:20.185599+0000 mgr.a (mgr.14355) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T00:52:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:22 smithi171 bash[25040]: cluster 2024-09-14T00:52:20.185599+0000 mgr.a (mgr.14355) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T00:52:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:22 smithi007 bash[22722]: cluster 2024-09-14T00:52:20.185599+0000 mgr.a (mgr.14355) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T00:52:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:24 smithi131 bash[24745]: cluster 2024-09-14T00:52:22.186403+0000 mgr.a (mgr.14355) 6552 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:24 smithi171 bash[25040]: cluster 2024-09-14T00:52:22.186403+0000 mgr.a (mgr.14355) 6552 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:24 smithi007 bash[22722]: cluster 2024-09-14T00:52:22.186403+0000 mgr.a (mgr.14355) 6552 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:25.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:25.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:25.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:25.998 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:25.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:25.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:26 smithi131 bash[24745]: cluster 2024-09-14T00:52:24.187199+0000 mgr.a (mgr.14355) 6553 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:26 smithi171 bash[25040]: cluster 2024-09-14T00:52:24.187199+0000 mgr.a (mgr.14355) 6553 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:26 smithi007 bash[22722]: cluster 2024-09-14T00:52:24.187199+0000 mgr.a (mgr.14355) 6553 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T00:52:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:27 smithi171 bash[25040]: audit 2024-09-14T00:52:25.561792+0000 mgr.a (mgr.14355) 6554 : audit [DBG] from='client.149829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:27 smithi007 bash[22722]: audit 2024-09-14T00:52:25.561792+0000 mgr.a (mgr.14355) 6554 : audit [DBG] from='client.149829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:27 smithi131 bash[24745]: audit 2024-09-14T00:52:25.561792+0000 mgr.a (mgr.14355) 6554 : audit [DBG] from='client.149829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:28 smithi171 bash[25040]: cluster 2024-09-14T00:52:26.190013+0000 mgr.a (mgr.14355) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:28 smithi007 bash[22722]: cluster 2024-09-14T00:52:26.190013+0000 mgr.a (mgr.14355) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:28 smithi131 bash[24745]: cluster 2024-09-14T00:52:26.190013+0000 mgr.a (mgr.14355) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:30 smithi171 bash[25040]: cluster 2024-09-14T00:52:28.190821+0000 mgr.a (mgr.14355) 6556 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:52:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:30 smithi007 bash[22722]: cluster 2024-09-14T00:52:28.190821+0000 mgr.a (mgr.14355) 6556 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:52:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:30 smithi131 bash[24745]: cluster 2024-09-14T00:52:28.190821+0000 mgr.a (mgr.14355) 6556 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:52:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:31.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:31.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:31.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:31.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:31.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:32 smithi007 bash[22722]: cluster 2024-09-14T00:52:30.192756+0000 mgr.a (mgr.14355) 6557 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:32 smithi131 bash[24745]: cluster 2024-09-14T00:52:30.192756+0000 mgr.a (mgr.14355) 6557 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:32 smithi171 bash[25040]: cluster 2024-09-14T00:52:30.192756+0000 mgr.a (mgr.14355) 6557 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:33 smithi007 bash[22722]: audit 2024-09-14T00:52:31.340312+0000 mgr.a (mgr.14355) 6558 : audit [DBG] from='client.149904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:33 smithi131 bash[24745]: audit 2024-09-14T00:52:31.340312+0000 mgr.a (mgr.14355) 6558 : audit [DBG] from='client.149904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:33 smithi171 bash[25040]: audit 2024-09-14T00:52:31.340312+0000 mgr.a (mgr.14355) 6558 : audit [DBG] from='client.149904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:34 smithi007 bash[22722]: cluster 2024-09-14T00:52:32.193753+0000 mgr.a (mgr.14355) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:34 smithi131 bash[24745]: cluster 2024-09-14T00:52:32.193753+0000 mgr.a (mgr.14355) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:34 smithi171 bash[25040]: cluster 2024-09-14T00:52:32.193753+0000 mgr.a (mgr.14355) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:36 smithi007 bash[22722]: cluster 2024-09-14T00:52:34.194597+0000 mgr.a (mgr.14355) 6560 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:36 smithi131 bash[24745]: cluster 2024-09-14T00:52:34.194597+0000 mgr.a (mgr.14355) 6560 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:36 smithi171 bash[25040]: cluster 2024-09-14T00:52:34.194597+0000 mgr.a (mgr.14355) 6560 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T00:52:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:37.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:37.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:38 smithi007 bash[22722]: cluster 2024-09-14T00:52:36.196855+0000 mgr.a (mgr.14355) 6561 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:52:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:38 smithi131 bash[24745]: cluster 2024-09-14T00:52:36.196855+0000 mgr.a (mgr.14355) 6561 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:52:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:38 smithi171 bash[25040]: cluster 2024-09-14T00:52:36.196855+0000 mgr.a (mgr.14355) 6561 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:52:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:39 smithi007 bash[22722]: audit 2024-09-14T00:52:37.121528+0000 mgr.a (mgr.14355) 6562 : audit [DBG] from='client.149976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:39 smithi131 bash[24745]: audit 2024-09-14T00:52:37.121528+0000 mgr.a (mgr.14355) 6562 : audit [DBG] from='client.149976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:39 smithi171 bash[25040]: audit 2024-09-14T00:52:37.121528+0000 mgr.a (mgr.14355) 6562 : audit [DBG] from='client.149976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:40 smithi007 bash[22722]: cluster 2024-09-14T00:52:38.197794+0000 mgr.a (mgr.14355) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:40 smithi131 bash[24745]: cluster 2024-09-14T00:52:38.197794+0000 mgr.a (mgr.14355) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:40 smithi171 bash[25040]: cluster 2024-09-14T00:52:38.197794+0000 mgr.a (mgr.14355) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:42 smithi007 bash[22722]: cluster 2024-09-14T00:52:40.199915+0000 mgr.a (mgr.14355) 6564 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:42 smithi131 bash[24745]: cluster 2024-09-14T00:52:40.199915+0000 mgr.a (mgr.14355) 6564 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:42.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:42.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:42 smithi171 bash[25040]: cluster 2024-09-14T00:52:40.199915+0000 mgr.a (mgr.14355) 6564 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:43.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:44 smithi007 bash[22722]: cluster 2024-09-14T00:52:42.200706+0000 mgr.a (mgr.14355) 6565 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:44 smithi007 bash[22722]: audit 2024-09-14T00:52:42.877852+0000 mgr.a (mgr.14355) 6566 : audit [DBG] from='client.150051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:44 smithi131 bash[24745]: cluster 2024-09-14T00:52:42.200706+0000 mgr.a (mgr.14355) 6565 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:44 smithi131 bash[24745]: audit 2024-09-14T00:52:42.877852+0000 mgr.a (mgr.14355) 6566 : audit [DBG] from='client.150051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:44 smithi171 bash[25040]: cluster 2024-09-14T00:52:42.200706+0000 mgr.a (mgr.14355) 6565 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:44 smithi171 bash[25040]: audit 2024-09-14T00:52:42.877852+0000 mgr.a (mgr.14355) 6566 : audit [DBG] from='client.150051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:46 smithi007 bash[22722]: cluster 2024-09-14T00:52:44.201686+0000 mgr.a (mgr.14355) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:46 smithi131 bash[24745]: cluster 2024-09-14T00:52:44.201686+0000 mgr.a (mgr.14355) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:46 smithi171 bash[25040]: cluster 2024-09-14T00:52:44.201686+0000 mgr.a (mgr.14355) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:48.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:48.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:48.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:48 smithi007 bash[22722]: cluster 2024-09-14T00:52:46.203963+0000 mgr.a (mgr.14355) 6568 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:48 smithi131 bash[24745]: cluster 2024-09-14T00:52:46.203963+0000 mgr.a (mgr.14355) 6568 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:48 smithi171 bash[25040]: cluster 2024-09-14T00:52:46.203963+0000 mgr.a (mgr.14355) 6568 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:49.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:49.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:49.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:49.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:49.082 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:50 smithi007 bash[22722]: cluster 2024-09-14T00:52:48.204730+0000 mgr.a (mgr.14355) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:50 smithi007 bash[22722]: audit 2024-09-14T00:52:48.660878+0000 mgr.a (mgr.14355) 6570 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:50 smithi131 bash[24745]: cluster 2024-09-14T00:52:48.204730+0000 mgr.a (mgr.14355) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:50.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:50 smithi131 bash[24745]: audit 2024-09-14T00:52:48.660878+0000 mgr.a (mgr.14355) 6570 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:50 smithi171 bash[25040]: cluster 2024-09-14T00:52:48.204730+0000 mgr.a (mgr.14355) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:50 smithi171 bash[25040]: audit 2024-09-14T00:52:48.660878+0000 mgr.a (mgr.14355) 6570 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:52 smithi007 bash[22722]: cluster 2024-09-14T00:52:50.207175+0000 mgr.a (mgr.14355) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:52 smithi131 bash[24745]: cluster 2024-09-14T00:52:50.207175+0000 mgr.a (mgr.14355) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:52 smithi171 bash[25040]: cluster 2024-09-14T00:52:50.207175+0000 mgr.a (mgr.14355) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:52:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:54 smithi007 bash[22722]: cluster 2024-09-14T00:52:52.208132+0000 mgr.a (mgr.14355) 6572 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:54 smithi131 bash[24745]: cluster 2024-09-14T00:52:52.208132+0000 mgr.a (mgr.14355) 6572 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:54 smithi171 bash[25040]: cluster 2024-09-14T00:52:52.208132+0000 mgr.a (mgr.14355) 6572 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:54.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:52:54.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:52:54.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:52:54.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:52:54.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:52:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:56 smithi007 bash[22722]: cluster 2024-09-14T00:52:54.208614+0000 mgr.a (mgr.14355) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:56 smithi007 bash[22722]: audit 2024-09-14T00:52:54.422138+0000 mgr.a (mgr.14355) 6574 : audit [DBG] from='client.150204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:56 smithi131 bash[24745]: cluster 2024-09-14T00:52:54.208614+0000 mgr.a (mgr.14355) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:56 smithi131 bash[24745]: audit 2024-09-14T00:52:54.422138+0000 mgr.a (mgr.14355) 6574 : audit [DBG] from='client.150204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:56 smithi171 bash[25040]: cluster 2024-09-14T00:52:54.208614+0000 mgr.a (mgr.14355) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:52:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:56 smithi171 bash[25040]: audit 2024-09-14T00:52:54.422138+0000 mgr.a (mgr.14355) 6574 : audit [DBG] from='client.150204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:52:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:52:58 smithi007 bash[22722]: cluster 2024-09-14T00:52:56.210924+0000 mgr.a (mgr.14355) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:52:58 smithi131 bash[24745]: cluster 2024-09-14T00:52:56.210924+0000 mgr.a (mgr.14355) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:52:58 smithi171 bash[25040]: cluster 2024-09-14T00:52:56.210924+0000 mgr.a (mgr.14355) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:52:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:52:59.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:52:59.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:00 smithi007 bash[22722]: cluster 2024-09-14T00:52:58.211696+0000 mgr.a (mgr.14355) 6576 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:00 smithi131 bash[24745]: cluster 2024-09-14T00:52:58.211696+0000 mgr.a (mgr.14355) 6576 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:00 smithi171 bash[25040]: cluster 2024-09-14T00:52:58.211696+0000 mgr.a (mgr.14355) 6576 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:00.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:02 smithi007 bash[22722]: audit 2024-09-14T00:53:00.188253+0000 mgr.a (mgr.14355) 6577 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:02 smithi007 bash[22722]: cluster 2024-09-14T00:53:00.214417+0000 mgr.a (mgr.14355) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:02 smithi131 bash[24745]: audit 2024-09-14T00:53:00.188253+0000 mgr.a (mgr.14355) 6577 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:02 smithi131 bash[24745]: cluster 2024-09-14T00:53:00.214417+0000 mgr.a (mgr.14355) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:02 smithi171 bash[25040]: audit 2024-09-14T00:53:00.188253+0000 mgr.a (mgr.14355) 6577 : audit [DBG] from='client.150282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:02 smithi171 bash[25040]: cluster 2024-09-14T00:53:00.214417+0000 mgr.a (mgr.14355) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:04 smithi007 bash[22722]: cluster 2024-09-14T00:53:02.215483+0000 mgr.a (mgr.14355) 6579 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:04 smithi131 bash[24745]: cluster 2024-09-14T00:53:02.215483+0000 mgr.a (mgr.14355) 6579 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:04 smithi171 bash[25040]: cluster 2024-09-14T00:53:02.215483+0000 mgr.a (mgr.14355) 6579 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:05 smithi007 bash[22722]: audit 2024-09-14T00:53:04.627806+0000 mon.a (mon.0) 1581 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:53:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:05 smithi131 bash[24745]: audit 2024-09-14T00:53:04.627806+0000 mon.a (mon.0) 1581 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:53:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:05 smithi171 bash[25040]: audit 2024-09-14T00:53:04.627806+0000 mon.a (mon.0) 1581 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:53:05.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:05.612 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:05.612 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:06.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: cluster 2024-09-14T00:53:04.216446+0000 mgr.a (mgr.14355) 6580 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:05.251640+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:05.255110+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:05.932954+0000 mgr.a (mgr.14355) 6581 : audit [DBG] from='client.150357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:06.026759+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:06.027735+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:53:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:06.032849+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:06.034864+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:06 smithi007 bash[22722]: audit 2024-09-14T00:53:06.035955+0000 mgr.a (mgr.14355) 6582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:06.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: cluster 2024-09-14T00:53:04.216446+0000 mgr.a (mgr.14355) 6580 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:06.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:05.251640+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:05.255110+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:05.932954+0000 mgr.a (mgr.14355) 6581 : audit [DBG] from='client.150357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:06.026759+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:06.027735+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:06.032849+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:06.034864+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:06.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:06 smithi131 bash[24745]: audit 2024-09-14T00:53:06.035955+0000 mgr.a (mgr.14355) 6582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: cluster 2024-09-14T00:53:04.216446+0000 mgr.a (mgr.14355) 6580 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:05.251640+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:05.255110+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:05.932954+0000 mgr.a (mgr.14355) 6581 : audit [DBG] from='client.150357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:06.026759+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:06.027735+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:06.032849+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:06.034864+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:06.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:06 smithi171 bash[25040]: audit 2024-09-14T00:53:06.035955+0000 mgr.a (mgr.14355) 6582 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:53:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:53:07 smithi007 bash[22972]: debug 2024-09-14T00:53:07.028+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:53:07.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:53:07 smithi007 bash[22972]: debug 2024-09-14T00:53:07.028+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:53:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:07 smithi007 bash[22722]: cluster 2024-09-14T00:53:06.217704+0000 mgr.a (mgr.14355) 6583 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:07 smithi007 bash[22722]: audit 2024-09-14T00:53:07.031640+0000 mgr.a (mgr.14355) 6584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:53:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:07 smithi007 bash[22722]: cephadm 2024-09-14T00:53:07.032973+0000 mgr.a (mgr.14355) 6585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:53:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:07 smithi131 bash[24745]: cluster 2024-09-14T00:53:06.217704+0000 mgr.a (mgr.14355) 6583 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:07 smithi131 bash[24745]: audit 2024-09-14T00:53:07.031640+0000 mgr.a (mgr.14355) 6584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:53:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:07 smithi131 bash[24745]: cephadm 2024-09-14T00:53:07.032973+0000 mgr.a (mgr.14355) 6585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:53:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:07 smithi171 bash[25040]: cluster 2024-09-14T00:53:06.217704+0000 mgr.a (mgr.14355) 6583 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:07 smithi171 bash[25040]: audit 2024-09-14T00:53:07.031640+0000 mgr.a (mgr.14355) 6584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:53:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:07 smithi171 bash[25040]: cephadm 2024-09-14T00:53:07.032973+0000 mgr.a (mgr.14355) 6585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:53:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:09 smithi131 bash[24745]: cluster 2024-09-14T00:53:08.218583+0000 mgr.a (mgr.14355) 6586 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:09 smithi171 bash[25040]: cluster 2024-09-14T00:53:08.218583+0000 mgr.a (mgr.14355) 6586 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:09 smithi007 bash[22722]: cluster 2024-09-14T00:53:08.218583+0000 mgr.a (mgr.14355) 6586 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:11 smithi131 bash[24745]: cluster 2024-09-14T00:53:10.220672+0000 mgr.a (mgr.14355) 6587 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:11.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:11 smithi171 bash[25040]: cluster 2024-09-14T00:53:10.220672+0000 mgr.a (mgr.14355) 6587 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:11 smithi007 bash[22722]: cluster 2024-09-14T00:53:10.220672+0000 mgr.a (mgr.14355) 6587 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:12 smithi171 bash[25040]: audit 2024-09-14T00:53:11.672715+0000 mgr.a (mgr.14355) 6588 : audit [DBG] from='client.150534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:12 smithi007 bash[22722]: audit 2024-09-14T00:53:11.672715+0000 mgr.a (mgr.14355) 6588 : audit [DBG] from='client.150534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:12 smithi131 bash[24745]: audit 2024-09-14T00:53:11.672715+0000 mgr.a (mgr.14355) 6588 : audit [DBG] from='client.150534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:13 smithi171 bash[25040]: cluster 2024-09-14T00:53:12.221579+0000 mgr.a (mgr.14355) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:13 smithi007 bash[22722]: cluster 2024-09-14T00:53:12.221579+0000 mgr.a (mgr.14355) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:13 smithi131 bash[24745]: cluster 2024-09-14T00:53:12.221579+0000 mgr.a (mgr.14355) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:15 smithi171 bash[25040]: cluster 2024-09-14T00:53:14.222378+0000 mgr.a (mgr.14355) 6590 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:15 smithi007 bash[22722]: cluster 2024-09-14T00:53:14.222378+0000 mgr.a (mgr.14355) 6590 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:15 smithi131 bash[24745]: cluster 2024-09-14T00:53:14.222378+0000 mgr.a (mgr.14355) 6590 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:17.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:17.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:17.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:17 smithi007 bash[22722]: cluster 2024-09-14T00:53:16.224543+0000 mgr.a (mgr.14355) 6591 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:17 smithi131 bash[24745]: cluster 2024-09-14T00:53:16.224543+0000 mgr.a (mgr.14355) 6591 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:17 smithi171 bash[25040]: cluster 2024-09-14T00:53:16.224543+0000 mgr.a (mgr.14355) 6591 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:17.881 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:17.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:17.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:17.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:17.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:18 smithi007 bash[22722]: audit 2024-09-14T00:53:17.425801+0000 mgr.a (mgr.14355) 6592 : audit [DBG] from='client.150609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:18 smithi131 bash[24745]: audit 2024-09-14T00:53:17.425801+0000 mgr.a (mgr.14355) 6592 : audit [DBG] from='client.150609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:18 smithi171 bash[25040]: audit 2024-09-14T00:53:17.425801+0000 mgr.a (mgr.14355) 6592 : audit [DBG] from='client.150609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:19 smithi007 bash[22722]: cluster 2024-09-14T00:53:18.225518+0000 mgr.a (mgr.14355) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:19 smithi131 bash[24745]: cluster 2024-09-14T00:53:18.225518+0000 mgr.a (mgr.14355) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:19 smithi171 bash[25040]: cluster 2024-09-14T00:53:18.225518+0000 mgr.a (mgr.14355) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:21 smithi007 bash[22722]: cluster 2024-09-14T00:53:20.227708+0000 mgr.a (mgr.14355) 6594 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:21 smithi131 bash[24745]: cluster 2024-09-14T00:53:20.227708+0000 mgr.a (mgr.14355) 6594 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:21 smithi171 bash[25040]: cluster 2024-09-14T00:53:20.227708+0000 mgr.a (mgr.14355) 6594 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:53:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:22.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:23.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:23.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:23.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:23.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:23.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:23 smithi007 bash[22722]: cluster 2024-09-14T00:53:22.228486+0000 mgr.a (mgr.14355) 6595 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:23 smithi131 bash[24745]: cluster 2024-09-14T00:53:22.228486+0000 mgr.a (mgr.14355) 6595 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:23 smithi171 bash[25040]: cluster 2024-09-14T00:53:22.228486+0000 mgr.a (mgr.14355) 6595 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:24 smithi007 bash[22722]: audit 2024-09-14T00:53:23.214609+0000 mgr.a (mgr.14355) 6596 : audit [DBG] from='client.150684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:24 smithi131 bash[24745]: audit 2024-09-14T00:53:23.214609+0000 mgr.a (mgr.14355) 6596 : audit [DBG] from='client.150684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:24 smithi171 bash[25040]: audit 2024-09-14T00:53:23.214609+0000 mgr.a (mgr.14355) 6596 : audit [DBG] from='client.150684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:25 smithi007 bash[22722]: cluster 2024-09-14T00:53:24.229475+0000 mgr.a (mgr.14355) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:25 smithi131 bash[24745]: cluster 2024-09-14T00:53:24.229475+0000 mgr.a (mgr.14355) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:25 smithi171 bash[25040]: cluster 2024-09-14T00:53:24.229475+0000 mgr.a (mgr.14355) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:27 smithi007 bash[22722]: cluster 2024-09-14T00:53:26.231703+0000 mgr.a (mgr.14355) 6598 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:27 smithi131 bash[24745]: cluster 2024-09-14T00:53:26.231703+0000 mgr.a (mgr.14355) 6598 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:27 smithi171 bash[25040]: cluster 2024-09-14T00:53:26.231703+0000 mgr.a (mgr.14355) 6598 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:28.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:28.625 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:28.625 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:29.399 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:29 smithi007 bash[22722]: cluster 2024-09-14T00:53:28.232483+0000 mgr.a (mgr.14355) 6599 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:29 smithi007 bash[22722]: audit 2024-09-14T00:53:28.959132+0000 mgr.a (mgr.14355) 6600 : audit [DBG] from='client.150762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:29 smithi131 bash[24745]: cluster 2024-09-14T00:53:28.232483+0000 mgr.a (mgr.14355) 6599 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:29.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:29 smithi131 bash[24745]: audit 2024-09-14T00:53:28.959132+0000 mgr.a (mgr.14355) 6600 : audit [DBG] from='client.150762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:29 smithi171 bash[25040]: cluster 2024-09-14T00:53:28.232483+0000 mgr.a (mgr.14355) 6599 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:29 smithi171 bash[25040]: audit 2024-09-14T00:53:28.959132+0000 mgr.a (mgr.14355) 6600 : audit [DBG] from='client.150762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:31 smithi007 bash[22722]: cluster 2024-09-14T00:53:30.234941+0000 mgr.a (mgr.14355) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:31 smithi131 bash[24745]: cluster 2024-09-14T00:53:30.234941+0000 mgr.a (mgr.14355) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:31 smithi171 bash[25040]: cluster 2024-09-14T00:53:30.234941+0000 mgr.a (mgr.14355) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:33 smithi007 bash[22722]: cluster 2024-09-14T00:53:32.235777+0000 mgr.a (mgr.14355) 6602 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:33 smithi131 bash[24745]: cluster 2024-09-14T00:53:32.235777+0000 mgr.a (mgr.14355) 6602 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:33 smithi171 bash[25040]: cluster 2024-09-14T00:53:32.235777+0000 mgr.a (mgr.14355) 6602 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:34.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:34.401 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:34.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:35.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:35 smithi007 bash[22722]: cluster 2024-09-14T00:53:34.236533+0000 mgr.a (mgr.14355) 6603 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:35 smithi007 bash[22722]: audit 2024-09-14T00:53:34.735831+0000 mgr.a (mgr.14355) 6604 : audit [DBG] from='client.150840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:35 smithi131 bash[24745]: cluster 2024-09-14T00:53:34.236533+0000 mgr.a (mgr.14355) 6603 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:35 smithi131 bash[24745]: audit 2024-09-14T00:53:34.735831+0000 mgr.a (mgr.14355) 6604 : audit [DBG] from='client.150840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:35 smithi171 bash[25040]: cluster 2024-09-14T00:53:34.236533+0000 mgr.a (mgr.14355) 6603 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:35 smithi171 bash[25040]: audit 2024-09-14T00:53:34.735831+0000 mgr.a (mgr.14355) 6604 : audit [DBG] from='client.150840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:37 smithi007 bash[22722]: cluster 2024-09-14T00:53:36.238921+0000 mgr.a (mgr.14355) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:37 smithi131 bash[24745]: cluster 2024-09-14T00:53:36.238921+0000 mgr.a (mgr.14355) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:37 smithi171 bash[25040]: cluster 2024-09-14T00:53:36.238921+0000 mgr.a (mgr.14355) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:39 smithi007 bash[22722]: cluster 2024-09-14T00:53:38.239689+0000 mgr.a (mgr.14355) 6606 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:39 smithi131 bash[24745]: cluster 2024-09-14T00:53:38.239689+0000 mgr.a (mgr.14355) 6606 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:39 smithi171 bash[25040]: cluster 2024-09-14T00:53:38.239689+0000 mgr.a (mgr.14355) 6606 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:40.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:41 smithi007 bash[22722]: cluster 2024-09-14T00:53:40.241635+0000 mgr.a (mgr.14355) 6607 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:41 smithi007 bash[22722]: audit 2024-09-14T00:53:40.516245+0000 mgr.a (mgr.14355) 6608 : audit [DBG] from='client.150918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:41 smithi131 bash[24745]: cluster 2024-09-14T00:53:40.241635+0000 mgr.a (mgr.14355) 6607 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:41 smithi131 bash[24745]: audit 2024-09-14T00:53:40.516245+0000 mgr.a (mgr.14355) 6608 : audit [DBG] from='client.150918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:41 smithi171 bash[25040]: cluster 2024-09-14T00:53:40.241635+0000 mgr.a (mgr.14355) 6607 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:41 smithi171 bash[25040]: audit 2024-09-14T00:53:40.516245+0000 mgr.a (mgr.14355) 6608 : audit [DBG] from='client.150918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:43 smithi007 bash[22722]: cluster 2024-09-14T00:53:42.242585+0000 mgr.a (mgr.14355) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:43 smithi131 bash[24745]: cluster 2024-09-14T00:53:42.242585+0000 mgr.a (mgr.14355) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:43 smithi171 bash[25040]: cluster 2024-09-14T00:53:42.242585+0000 mgr.a (mgr.14355) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:53:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:45 smithi007 bash[22722]: cluster 2024-09-14T00:53:44.243482+0000 mgr.a (mgr.14355) 6610 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:45.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:45 smithi131 bash[24745]: cluster 2024-09-14T00:53:44.243482+0000 mgr.a (mgr.14355) 6610 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:45 smithi171 bash[25040]: cluster 2024-09-14T00:53:44.243482+0000 mgr.a (mgr.14355) 6610 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:45.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:45.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:46.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:46.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:46.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:46.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:46.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:47 smithi007 bash[22722]: cluster 2024-09-14T00:53:46.244816+0000 mgr.a (mgr.14355) 6611 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:47 smithi007 bash[22722]: audit 2024-09-14T00:53:46.296933+0000 mgr.a (mgr.14355) 6612 : audit [DBG] from='client.150993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:47 smithi131 bash[24745]: cluster 2024-09-14T00:53:46.244816+0000 mgr.a (mgr.14355) 6611 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:47 smithi131 bash[24745]: audit 2024-09-14T00:53:46.296933+0000 mgr.a (mgr.14355) 6612 : audit [DBG] from='client.150993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:47 smithi171 bash[25040]: cluster 2024-09-14T00:53:46.244816+0000 mgr.a (mgr.14355) 6611 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:47 smithi171 bash[25040]: audit 2024-09-14T00:53:46.296933+0000 mgr.a (mgr.14355) 6612 : audit [DBG] from='client.150993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:49 smithi007 bash[22722]: cluster 2024-09-14T00:53:48.245678+0000 mgr.a (mgr.14355) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:49 smithi131 bash[24745]: cluster 2024-09-14T00:53:48.245678+0000 mgr.a (mgr.14355) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:49 smithi171 bash[25040]: cluster 2024-09-14T00:53:48.245678+0000 mgr.a (mgr.14355) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:53:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:51 smithi007 bash[22722]: cluster 2024-09-14T00:53:50.247861+0000 mgr.a (mgr.14355) 6614 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:51.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:51.716 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:51 smithi131 bash[24745]: cluster 2024-09-14T00:53:50.247861+0000 mgr.a (mgr.14355) 6614 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:51 smithi171 bash[25040]: cluster 2024-09-14T00:53:50.247861+0000 mgr.a (mgr.14355) 6614 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:52.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:52.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:52 smithi007 bash[22722]: audit 2024-09-14T00:53:52.055911+0000 mgr.a (mgr.14355) 6615 : audit [DBG] from='client.151071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:52 smithi131 bash[24745]: audit 2024-09-14T00:53:52.055911+0000 mgr.a (mgr.14355) 6615 : audit [DBG] from='client.151071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:52 smithi171 bash[25040]: audit 2024-09-14T00:53:52.055911+0000 mgr.a (mgr.14355) 6615 : audit [DBG] from='client.151071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:53 smithi007 bash[22722]: cluster 2024-09-14T00:53:52.248458+0000 mgr.a (mgr.14355) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:53 smithi131 bash[24745]: cluster 2024-09-14T00:53:52.248458+0000 mgr.a (mgr.14355) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:53 smithi171 bash[25040]: cluster 2024-09-14T00:53:52.248458+0000 mgr.a (mgr.14355) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:55 smithi007 bash[22722]: cluster 2024-09-14T00:53:54.249505+0000 mgr.a (mgr.14355) 6617 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:55 smithi131 bash[24745]: cluster 2024-09-14T00:53:54.249505+0000 mgr.a (mgr.14355) 6617 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:55 smithi171 bash[25040]: cluster 2024-09-14T00:53:54.249505+0000 mgr.a (mgr.14355) 6617 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:53:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:53:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:53:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:57 smithi007 bash[22722]: cluster 2024-09-14T00:53:56.251826+0000 mgr.a (mgr.14355) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:57 smithi131 bash[24745]: cluster 2024-09-14T00:53:56.251826+0000 mgr.a (mgr.14355) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:57 smithi171 bash[25040]: cluster 2024-09-14T00:53:56.251826+0000 mgr.a (mgr.14355) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:53:58.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:53:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:53:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:53:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:53:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:53:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:58 smithi007 bash[22722]: audit 2024-09-14T00:53:57.828799+0000 mgr.a (mgr.14355) 6619 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:58 smithi131 bash[24745]: audit 2024-09-14T00:53:57.828799+0000 mgr.a (mgr.14355) 6619 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:58 smithi171 bash[25040]: audit 2024-09-14T00:53:57.828799+0000 mgr.a (mgr.14355) 6619 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:53:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:53:59 smithi007 bash[22722]: cluster 2024-09-14T00:53:58.252360+0000 mgr.a (mgr.14355) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:53:59 smithi131 bash[24745]: cluster 2024-09-14T00:53:58.252360+0000 mgr.a (mgr.14355) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:53:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:53:59 smithi171 bash[25040]: cluster 2024-09-14T00:53:58.252360+0000 mgr.a (mgr.14355) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:01 smithi007 bash[22722]: cluster 2024-09-14T00:54:00.254610+0000 mgr.a (mgr.14355) 6621 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:01 smithi131 bash[24745]: cluster 2024-09-14T00:54:00.254610+0000 mgr.a (mgr.14355) 6621 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:01 smithi171 bash[25040]: cluster 2024-09-14T00:54:00.254610+0000 mgr.a (mgr.14355) 6621 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:03.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:03.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:03 smithi007 bash[22722]: cluster 2024-09-14T00:54:02.255572+0000 mgr.a (mgr.14355) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:03 smithi131 bash[24745]: cluster 2024-09-14T00:54:02.255572+0000 mgr.a (mgr.14355) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:03 smithi171 bash[25040]: cluster 2024-09-14T00:54:02.255572+0000 mgr.a (mgr.14355) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:04.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:04.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:04.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:04.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:04.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:04 smithi007 bash[22722]: audit 2024-09-14T00:54:03.595396+0000 mgr.a (mgr.14355) 6623 : audit [DBG] from='client.151221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:04 smithi131 bash[24745]: audit 2024-09-14T00:54:03.595396+0000 mgr.a (mgr.14355) 6623 : audit [DBG] from='client.151221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:04 smithi171 bash[25040]: audit 2024-09-14T00:54:03.595396+0000 mgr.a (mgr.14355) 6623 : audit [DBG] from='client.151221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:05 smithi007 bash[22722]: cluster 2024-09-14T00:54:04.256672+0000 mgr.a (mgr.14355) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:05 smithi131 bash[24745]: cluster 2024-09-14T00:54:04.256672+0000 mgr.a (mgr.14355) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:05 smithi171 bash[25040]: cluster 2024-09-14T00:54:04.256672+0000 mgr.a (mgr.14355) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:07 smithi007 bash[22722]: cluster 2024-09-14T00:54:06.259088+0000 mgr.a (mgr.14355) 6625 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:07 smithi007 bash[22722]: audit 2024-09-14T00:54:07.083383+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:54:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:07 smithi131 bash[24745]: cluster 2024-09-14T00:54:06.259088+0000 mgr.a (mgr.14355) 6625 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:07 smithi131 bash[24745]: audit 2024-09-14T00:54:07.083383+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:54:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:07 smithi171 bash[25040]: cluster 2024-09-14T00:54:06.259088+0000 mgr.a (mgr.14355) 6625 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:07 smithi171 bash[25040]: audit 2024-09-14T00:54:07.083383+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:07.690110+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:07.694798+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:07.702467+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:07.707933+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:08.352211+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:08 smithi007 bash[22722]: audit 2024-09-14T00:54:08.357440+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:09.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:09.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:07.690110+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:07.694798+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:07.702467+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:07.707933+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:08.352211+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:08 smithi131 bash[24745]: audit 2024-09-14T00:54:08.357440+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:07.690110+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:07.694798+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:07.702467+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:07.707933+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:08.352211+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:08 smithi171 bash[25040]: audit 2024-09-14T00:54:08.357440+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.023 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:54:09 smithi007 bash[22972]: debug 2024-09-14T00:54:09.767+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:54:10.023 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:54:09 smithi007 bash[22972]: debug 2024-09-14T00:54:09.779+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:54:10.198 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:10.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:10.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:10.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:10.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: cluster 2024-09-14T00:54:08.259861+0000 mgr.a (mgr.14355) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.024288+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.027529+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.031034+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.034277+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.035775+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.037216+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:54:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.044829+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.049668+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:10.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:10 smithi131 bash[24745]: audit 2024-09-14T00:54:09.050829+0000 mgr.a (mgr.14355) 6627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: cluster 2024-09-14T00:54:08.259861+0000 mgr.a (mgr.14355) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.024288+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.027529+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.031034+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.034277+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.035775+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.037216+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.044829+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.049668+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:10 smithi171 bash[25040]: audit 2024-09-14T00:54:09.050829+0000 mgr.a (mgr.14355) 6627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: cluster 2024-09-14T00:54:08.259861+0000 mgr.a (mgr.14355) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.024288+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.027529+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.031034+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.034277+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.035775+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.037216+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.044829+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.049668+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:10 smithi007 bash[22722]: audit 2024-09-14T00:54:09.050829+0000 mgr.a (mgr.14355) 6627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:54:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:11 smithi171 bash[25040]: audit 2024-09-14T00:54:09.376428+0000 mgr.a (mgr.14355) 6628 : audit [DBG] from='client.151302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:11 smithi171 bash[25040]: audit 2024-09-14T00:54:09.770704+0000 mgr.a (mgr.14355) 6629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:54:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:11 smithi171 bash[25040]: cephadm 2024-09-14T00:54:09.783061+0000 mgr.a (mgr.14355) 6630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:54:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:11 smithi007 bash[22722]: audit 2024-09-14T00:54:09.376428+0000 mgr.a (mgr.14355) 6628 : audit [DBG] from='client.151302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:11 smithi007 bash[22722]: audit 2024-09-14T00:54:09.770704+0000 mgr.a (mgr.14355) 6629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:54:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:11 smithi007 bash[22722]: cephadm 2024-09-14T00:54:09.783061+0000 mgr.a (mgr.14355) 6630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:54:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:11 smithi131 bash[24745]: audit 2024-09-14T00:54:09.376428+0000 mgr.a (mgr.14355) 6628 : audit [DBG] from='client.151302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:11 smithi131 bash[24745]: audit 2024-09-14T00:54:09.770704+0000 mgr.a (mgr.14355) 6629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:54:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:11 smithi131 bash[24745]: cephadm 2024-09-14T00:54:09.783061+0000 mgr.a (mgr.14355) 6630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:54:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:12 smithi171 bash[25040]: cluster 2024-09-14T00:54:10.261032+0000 mgr.a (mgr.14355) 6631 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:12 smithi007 bash[22722]: cluster 2024-09-14T00:54:10.261032+0000 mgr.a (mgr.14355) 6631 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:12 smithi131 bash[24745]: cluster 2024-09-14T00:54:10.261032+0000 mgr.a (mgr.14355) 6631 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:14 smithi171 bash[25040]: cluster 2024-09-14T00:54:12.261765+0000 mgr.a (mgr.14355) 6632 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:14 smithi007 bash[22722]: cluster 2024-09-14T00:54:12.261765+0000 mgr.a (mgr.14355) 6632 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:14 smithi131 bash[24745]: cluster 2024-09-14T00:54:12.261765+0000 mgr.a (mgr.14355) 6632 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:15.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:15.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:16 smithi171 bash[25040]: cluster 2024-09-14T00:54:14.262568+0000 mgr.a (mgr.14355) 6633 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:16 smithi007 bash[22722]: cluster 2024-09-14T00:54:14.262568+0000 mgr.a (mgr.14355) 6633 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:16 smithi131 bash[24745]: cluster 2024-09-14T00:54:14.262568+0000 mgr.a (mgr.14355) 6633 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 113 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:17 smithi007 bash[22722]: audit 2024-09-14T00:54:15.535897+0000 mgr.a (mgr.14355) 6634 : audit [DBG] from='client.151479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:17 smithi131 bash[24745]: audit 2024-09-14T00:54:15.535897+0000 mgr.a (mgr.14355) 6634 : audit [DBG] from='client.151479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:17 smithi171 bash[25040]: audit 2024-09-14T00:54:15.535897+0000 mgr.a (mgr.14355) 6634 : audit [DBG] from='client.151479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:18 smithi007 bash[22722]: cluster 2024-09-14T00:54:16.265371+0000 mgr.a (mgr.14355) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:18 smithi131 bash[24745]: cluster 2024-09-14T00:54:16.265371+0000 mgr.a (mgr.14355) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:18 smithi171 bash[25040]: cluster 2024-09-14T00:54:16.265371+0000 mgr.a (mgr.14355) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:20 smithi007 bash[22722]: cluster 2024-09-14T00:54:18.266174+0000 mgr.a (mgr.14355) 6636 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:20 smithi131 bash[24745]: cluster 2024-09-14T00:54:18.266174+0000 mgr.a (mgr.14355) 6636 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:20 smithi171 bash[25040]: cluster 2024-09-14T00:54:18.266174+0000 mgr.a (mgr.14355) 6636 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:54:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:21.696 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:21.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:21.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:21.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:22 smithi007 bash[22722]: cluster 2024-09-14T00:54:20.268056+0000 mgr.a (mgr.14355) 6637 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:22 smithi131 bash[24745]: cluster 2024-09-14T00:54:20.268056+0000 mgr.a (mgr.14355) 6637 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:22 smithi171 bash[25040]: cluster 2024-09-14T00:54:20.268056+0000 mgr.a (mgr.14355) 6637 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:54:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:23 smithi007 bash[22722]: audit 2024-09-14T00:54:21.290022+0000 mgr.a (mgr.14355) 6638 : audit [DBG] from='client.151557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:23 smithi131 bash[24745]: audit 2024-09-14T00:54:21.290022+0000 mgr.a (mgr.14355) 6638 : audit [DBG] from='client.151557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:23 smithi171 bash[25040]: audit 2024-09-14T00:54:21.290022+0000 mgr.a (mgr.14355) 6638 : audit [DBG] from='client.151557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:24 smithi007 bash[22722]: cluster 2024-09-14T00:54:22.268936+0000 mgr.a (mgr.14355) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:24 smithi131 bash[24745]: cluster 2024-09-14T00:54:22.268936+0000 mgr.a (mgr.14355) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:24 smithi171 bash[25040]: cluster 2024-09-14T00:54:22.268936+0000 mgr.a (mgr.14355) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:26 smithi007 bash[22722]: cluster 2024-09-14T00:54:24.269756+0000 mgr.a (mgr.14355) 6640 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:26 smithi131 bash[24745]: cluster 2024-09-14T00:54:24.269756+0000 mgr.a (mgr.14355) 6640 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:26 smithi171 bash[25040]: cluster 2024-09-14T00:54:24.269756+0000 mgr.a (mgr.14355) 6640 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T00:54:26.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:26.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:27.432 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:27.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:27.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:27.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:27.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:28 smithi007 bash[22722]: cluster 2024-09-14T00:54:26.271991+0000 mgr.a (mgr.14355) 6641 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:54:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:28 smithi007 bash[22722]: audit 2024-09-14T00:54:27.027785+0000 mgr.a (mgr.14355) 6642 : audit [DBG] from='client.151635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:28 smithi131 bash[24745]: cluster 2024-09-14T00:54:26.271991+0000 mgr.a (mgr.14355) 6641 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:54:28.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:28 smithi131 bash[24745]: audit 2024-09-14T00:54:27.027785+0000 mgr.a (mgr.14355) 6642 : audit [DBG] from='client.151635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:28 smithi171 bash[25040]: cluster 2024-09-14T00:54:26.271991+0000 mgr.a (mgr.14355) 6641 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T00:54:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:28 smithi171 bash[25040]: audit 2024-09-14T00:54:27.027785+0000 mgr.a (mgr.14355) 6642 : audit [DBG] from='client.151635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:30 smithi007 bash[22722]: cluster 2024-09-14T00:54:28.272902+0000 mgr.a (mgr.14355) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:30 smithi131 bash[24745]: cluster 2024-09-14T00:54:28.272902+0000 mgr.a (mgr.14355) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:30 smithi171 bash[25040]: cluster 2024-09-14T00:54:28.272902+0000 mgr.a (mgr.14355) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:32 smithi007 bash[22722]: cluster 2024-09-14T00:54:30.275091+0000 mgr.a (mgr.14355) 6644 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:32 smithi131 bash[24745]: cluster 2024-09-14T00:54:30.275091+0000 mgr.a (mgr.14355) 6644 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:32 smithi171 bash[25040]: cluster 2024-09-14T00:54:30.275091+0000 mgr.a (mgr.14355) 6644 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:33.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:34 smithi007 bash[22722]: cluster 2024-09-14T00:54:32.275852+0000 mgr.a (mgr.14355) 6645 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:34 smithi007 bash[22722]: audit 2024-09-14T00:54:32.771569+0000 mgr.a (mgr.14355) 6646 : audit [DBG] from='client.151713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:34 smithi131 bash[24745]: cluster 2024-09-14T00:54:32.275852+0000 mgr.a (mgr.14355) 6645 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:34 smithi131 bash[24745]: audit 2024-09-14T00:54:32.771569+0000 mgr.a (mgr.14355) 6646 : audit [DBG] from='client.151713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:34 smithi171 bash[25040]: cluster 2024-09-14T00:54:32.275852+0000 mgr.a (mgr.14355) 6645 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:34 smithi171 bash[25040]: audit 2024-09-14T00:54:32.771569+0000 mgr.a (mgr.14355) 6646 : audit [DBG] from='client.151713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:36 smithi007 bash[22722]: cluster 2024-09-14T00:54:34.276720+0000 mgr.a (mgr.14355) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:36 smithi131 bash[24745]: cluster 2024-09-14T00:54:34.276720+0000 mgr.a (mgr.14355) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:36 smithi171 bash[25040]: cluster 2024-09-14T00:54:34.276720+0000 mgr.a (mgr.14355) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:38.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:38.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:38 smithi007 bash[22722]: cluster 2024-09-14T00:54:36.279092+0000 mgr.a (mgr.14355) 6648 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:38 smithi131 bash[24745]: cluster 2024-09-14T00:54:36.279092+0000 mgr.a (mgr.14355) 6648 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:38 smithi171 bash[25040]: cluster 2024-09-14T00:54:36.279092+0000 mgr.a (mgr.14355) 6648 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:38.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:38.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:40 smithi007 bash[22722]: cluster 2024-09-14T00:54:38.279876+0000 mgr.a (mgr.14355) 6649 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:40 smithi007 bash[22722]: audit 2024-09-14T00:54:38.548209+0000 mgr.a (mgr.14355) 6650 : audit [DBG] from='client.151785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:40 smithi131 bash[24745]: cluster 2024-09-14T00:54:38.279876+0000 mgr.a (mgr.14355) 6649 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:40.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:40 smithi131 bash[24745]: audit 2024-09-14T00:54:38.548209+0000 mgr.a (mgr.14355) 6650 : audit [DBG] from='client.151785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:40 smithi171 bash[25040]: cluster 2024-09-14T00:54:38.279876+0000 mgr.a (mgr.14355) 6649 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:40 smithi171 bash[25040]: audit 2024-09-14T00:54:38.548209+0000 mgr.a (mgr.14355) 6650 : audit [DBG] from='client.151785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:42 smithi007 bash[22722]: cluster 2024-09-14T00:54:40.282131+0000 mgr.a (mgr.14355) 6651 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:42 smithi131 bash[24745]: cluster 2024-09-14T00:54:40.282131+0000 mgr.a (mgr.14355) 6651 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:42 smithi171 bash[25040]: cluster 2024-09-14T00:54:40.282131+0000 mgr.a (mgr.14355) 6651 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:43.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:43.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:43.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:44 smithi007 bash[22722]: cluster 2024-09-14T00:54:42.282895+0000 mgr.a (mgr.14355) 6652 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:44 smithi131 bash[24745]: cluster 2024-09-14T00:54:42.282895+0000 mgr.a (mgr.14355) 6652 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:44 smithi171 bash[25040]: cluster 2024-09-14T00:54:42.282895+0000 mgr.a (mgr.14355) 6652 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:44.760 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:46 smithi007 bash[22722]: cluster 2024-09-14T00:54:44.283609+0000 mgr.a (mgr.14355) 6653 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:46 smithi007 bash[22722]: audit 2024-09-14T00:54:44.312792+0000 mgr.a (mgr.14355) 6654 : audit [DBG] from='client.151863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:46 smithi131 bash[24745]: cluster 2024-09-14T00:54:44.283609+0000 mgr.a (mgr.14355) 6653 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:46 smithi131 bash[24745]: audit 2024-09-14T00:54:44.312792+0000 mgr.a (mgr.14355) 6654 : audit [DBG] from='client.151863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:46 smithi171 bash[25040]: cluster 2024-09-14T00:54:44.283609+0000 mgr.a (mgr.14355) 6653 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:46 smithi171 bash[25040]: audit 2024-09-14T00:54:44.312792+0000 mgr.a (mgr.14355) 6654 : audit [DBG] from='client.151863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:48 smithi007 bash[22722]: cluster 2024-09-14T00:54:46.286044+0000 mgr.a (mgr.14355) 6655 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:48 smithi131 bash[24745]: cluster 2024-09-14T00:54:46.286044+0000 mgr.a (mgr.14355) 6655 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:48 smithi171 bash[25040]: cluster 2024-09-14T00:54:46.286044+0000 mgr.a (mgr.14355) 6655 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:54:49.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:50 smithi007 bash[22722]: cluster 2024-09-14T00:54:48.286894+0000 mgr.a (mgr.14355) 6656 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:50.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:50 smithi131 bash[24745]: cluster 2024-09-14T00:54:48.286894+0000 mgr.a (mgr.14355) 6656 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:50 smithi171 bash[25040]: cluster 2024-09-14T00:54:48.286894+0000 mgr.a (mgr.14355) 6656 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:51 smithi007 bash[22722]: audit 2024-09-14T00:54:50.094513+0000 mgr.a (mgr.14355) 6657 : audit [DBG] from='client.151938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:51 smithi131 bash[24745]: audit 2024-09-14T00:54:50.094513+0000 mgr.a (mgr.14355) 6657 : audit [DBG] from='client.151938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:51 smithi171 bash[25040]: audit 2024-09-14T00:54:50.094513+0000 mgr.a (mgr.14355) 6657 : audit [DBG] from='client.151938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:52 smithi007 bash[22722]: cluster 2024-09-14T00:54:50.288114+0000 mgr.a (mgr.14355) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:52 smithi131 bash[24745]: cluster 2024-09-14T00:54:50.288114+0000 mgr.a (mgr.14355) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:52 smithi171 bash[25040]: cluster 2024-09-14T00:54:50.288114+0000 mgr.a (mgr.14355) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:54 smithi007 bash[22722]: cluster 2024-09-14T00:54:52.288974+0000 mgr.a (mgr.14355) 6659 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:54 smithi131 bash[24745]: cluster 2024-09-14T00:54:52.288974+0000 mgr.a (mgr.14355) 6659 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:54 smithi171 bash[25040]: cluster 2024-09-14T00:54:52.288974+0000 mgr.a (mgr.14355) 6659 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:55.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:54:55.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:54:55.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:54:56.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:54:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:54:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:54:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:54:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:54:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:56 smithi007 bash[22722]: cluster 2024-09-14T00:54:54.289762+0000 mgr.a (mgr.14355) 6660 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:56 smithi131 bash[24745]: cluster 2024-09-14T00:54:54.289762+0000 mgr.a (mgr.14355) 6660 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:56 smithi171 bash[25040]: cluster 2024-09-14T00:54:54.289762+0000 mgr.a (mgr.14355) 6660 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:57 smithi007 bash[22722]: audit 2024-09-14T00:54:55.835544+0000 mgr.a (mgr.14355) 6661 : audit [DBG] from='client.152016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:57 smithi131 bash[24745]: audit 2024-09-14T00:54:55.835544+0000 mgr.a (mgr.14355) 6661 : audit [DBG] from='client.152016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:57 smithi171 bash[25040]: audit 2024-09-14T00:54:55.835544+0000 mgr.a (mgr.14355) 6661 : audit [DBG] from='client.152016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:54:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:58 smithi007 bash[22722]: cluster 2024-09-14T00:54:56.291032+0000 mgr.a (mgr.14355) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:58 smithi131 bash[24745]: cluster 2024-09-14T00:54:56.291032+0000 mgr.a (mgr.14355) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:58 smithi171 bash[25040]: cluster 2024-09-14T00:54:56.291032+0000 mgr.a (mgr.14355) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:54:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:54:59 smithi007 bash[22722]: cluster 2024-09-14T00:54:58.291741+0000 mgr.a (mgr.14355) 6663 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:54:59 smithi131 bash[24745]: cluster 2024-09-14T00:54:58.291741+0000 mgr.a (mgr.14355) 6663 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:54:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:54:59 smithi171 bash[25040]: cluster 2024-09-14T00:54:58.291741+0000 mgr.a (mgr.14355) 6663 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:01.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:01.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:01.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:01 smithi007 bash[22722]: cluster 2024-09-14T00:55:00.293634+0000 mgr.a (mgr.14355) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:01 smithi131 bash[24745]: cluster 2024-09-14T00:55:00.293634+0000 mgr.a (mgr.14355) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:01 smithi171 bash[25040]: cluster 2024-09-14T00:55:00.293634+0000 mgr.a (mgr.14355) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:02.013 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:02 smithi007 bash[22722]: audit 2024-09-14T00:55:01.601472+0000 mgr.a (mgr.14355) 6665 : audit [DBG] from='client.152094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:02 smithi131 bash[24745]: audit 2024-09-14T00:55:01.601472+0000 mgr.a (mgr.14355) 6665 : audit [DBG] from='client.152094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:02 smithi171 bash[25040]: audit 2024-09-14T00:55:01.601472+0000 mgr.a (mgr.14355) 6665 : audit [DBG] from='client.152094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:03 smithi007 bash[22722]: cluster 2024-09-14T00:55:02.294498+0000 mgr.a (mgr.14355) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:03 smithi131 bash[24745]: cluster 2024-09-14T00:55:02.294498+0000 mgr.a (mgr.14355) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:03 smithi171 bash[25040]: cluster 2024-09-14T00:55:02.294498+0000 mgr.a (mgr.14355) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:05 smithi007 bash[22722]: cluster 2024-09-14T00:55:04.295201+0000 mgr.a (mgr.14355) 6667 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:05 smithi131 bash[24745]: cluster 2024-09-14T00:55:04.295201+0000 mgr.a (mgr.14355) 6667 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:05 smithi171 bash[25040]: cluster 2024-09-14T00:55:04.295201+0000 mgr.a (mgr.14355) 6667 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:07.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:07.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:07 smithi007 bash[22722]: cluster 2024-09-14T00:55:06.297440+0000 mgr.a (mgr.14355) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:07 smithi131 bash[24745]: cluster 2024-09-14T00:55:06.297440+0000 mgr.a (mgr.14355) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:07 smithi171 bash[25040]: cluster 2024-09-14T00:55:06.297440+0000 mgr.a (mgr.14355) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:08 smithi007 bash[22722]: audit 2024-09-14T00:55:07.345568+0000 mgr.a (mgr.14355) 6669 : audit [DBG] from='client.152172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:08 smithi131 bash[24745]: audit 2024-09-14T00:55:07.345568+0000 mgr.a (mgr.14355) 6669 : audit [DBG] from='client.152172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:08 smithi171 bash[25040]: audit 2024-09-14T00:55:07.345568+0000 mgr.a (mgr.14355) 6669 : audit [DBG] from='client.152172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:09 smithi007 bash[22722]: cluster 2024-09-14T00:55:08.298353+0000 mgr.a (mgr.14355) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:09 smithi007 bash[22722]: audit 2024-09-14T00:55:09.853773+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:55:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:09 smithi131 bash[24745]: cluster 2024-09-14T00:55:08.298353+0000 mgr.a (mgr.14355) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:09 smithi131 bash[24745]: audit 2024-09-14T00:55:09.853773+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:55:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:09 smithi171 bash[25040]: cluster 2024-09-14T00:55:08.298353+0000 mgr.a (mgr.14355) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:09 smithi171 bash[25040]: audit 2024-09-14T00:55:09.853773+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:55:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:10 smithi007 bash[22722]: audit 2024-09-14T00:55:10.719272+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:55:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:10 smithi007 bash[22722]: audit 2024-09-14T00:55:10.720845+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:55:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:10 smithi007 bash[22722]: audit 2024-09-14T00:55:10.731021+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:55:11.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:10 smithi007 bash[22722]: audit 2024-09-14T00:55:10.735786+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:10 smithi131 bash[24745]: audit 2024-09-14T00:55:10.719272+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:55:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:10 smithi131 bash[24745]: audit 2024-09-14T00:55:10.720845+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:55:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:10 smithi131 bash[24745]: audit 2024-09-14T00:55:10.731021+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:55:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:10 smithi131 bash[24745]: audit 2024-09-14T00:55:10.735786+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:10 smithi171 bash[25040]: audit 2024-09-14T00:55:10.719272+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:55:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:10 smithi171 bash[25040]: audit 2024-09-14T00:55:10.720845+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:55:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:10 smithi171 bash[25040]: audit 2024-09-14T00:55:10.731021+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:55:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:10 smithi171 bash[25040]: audit 2024-09-14T00:55:10.735786+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:11.892 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:55:11 smithi007 bash[22972]: debug 2024-09-14T00:55:11.470+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:55:11.892 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:55:11 smithi007 bash[22972]: debug 2024-09-14T00:55:11.474+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:55:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:11 smithi007 bash[22722]: cluster 2024-09-14T00:55:10.300669+0000 mgr.a (mgr.14355) 6671 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:11 smithi007 bash[22722]: audit 2024-09-14T00:55:10.737021+0000 mgr.a (mgr.14355) 6672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:11 smithi131 bash[24745]: cluster 2024-09-14T00:55:10.300669+0000 mgr.a (mgr.14355) 6671 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:11 smithi131 bash[24745]: audit 2024-09-14T00:55:10.737021+0000 mgr.a (mgr.14355) 6672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:11 smithi171 bash[25040]: cluster 2024-09-14T00:55:10.300669+0000 mgr.a (mgr.14355) 6671 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:11 smithi171 bash[25040]: audit 2024-09-14T00:55:10.737021+0000 mgr.a (mgr.14355) 6672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:55:12.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:12 smithi007 bash[22722]: audit 2024-09-14T00:55:11.477032+0000 mgr.a (mgr.14355) 6673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:55:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:12 smithi007 bash[22722]: cephadm 2024-09-14T00:55:11.478485+0000 mgr.a (mgr.14355) 6674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:55:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:12 smithi131 bash[24745]: audit 2024-09-14T00:55:11.477032+0000 mgr.a (mgr.14355) 6673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:55:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:12 smithi131 bash[24745]: cephadm 2024-09-14T00:55:11.478485+0000 mgr.a (mgr.14355) 6674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:55:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:12 smithi171 bash[25040]: audit 2024-09-14T00:55:11.477032+0000 mgr.a (mgr.14355) 6673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:55:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:12 smithi171 bash[25040]: cephadm 2024-09-14T00:55:11.478485+0000 mgr.a (mgr.14355) 6674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:55:13.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:13 smithi007 bash[22722]: cluster 2024-09-14T00:55:12.301576+0000 mgr.a (mgr.14355) 6675 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:13 smithi007 bash[22722]: audit 2024-09-14T00:55:13.111397+0000 mgr.a (mgr.14355) 6676 : audit [DBG] from='client.152352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:13 smithi131 bash[24745]: cluster 2024-09-14T00:55:12.301576+0000 mgr.a (mgr.14355) 6675 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:14.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:13 smithi131 bash[24745]: audit 2024-09-14T00:55:13.111397+0000 mgr.a (mgr.14355) 6676 : audit [DBG] from='client.152352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:13 smithi171 bash[25040]: cluster 2024-09-14T00:55:12.301576+0000 mgr.a (mgr.14355) 6675 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:13 smithi171 bash[25040]: audit 2024-09-14T00:55:13.111397+0000 mgr.a (mgr.14355) 6676 : audit [DBG] from='client.152352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:15 smithi007 bash[22722]: cluster 2024-09-14T00:55:14.302527+0000 mgr.a (mgr.14355) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:15 smithi131 bash[24745]: cluster 2024-09-14T00:55:14.302527+0000 mgr.a (mgr.14355) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:15 smithi171 bash[25040]: cluster 2024-09-14T00:55:14.302527+0000 mgr.a (mgr.14355) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:17 smithi007 bash[22722]: cluster 2024-09-14T00:55:16.304788+0000 mgr.a (mgr.14355) 6678 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:17 smithi131 bash[24745]: cluster 2024-09-14T00:55:16.304788+0000 mgr.a (mgr.14355) 6678 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:17 smithi171 bash[25040]: cluster 2024-09-14T00:55:16.304788+0000 mgr.a (mgr.14355) 6678 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:19.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:19 smithi007 bash[22722]: cluster 2024-09-14T00:55:18.305526+0000 mgr.a (mgr.14355) 6679 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:19 smithi007 bash[22722]: audit 2024-09-14T00:55:18.869288+0000 mgr.a (mgr.14355) 6680 : audit [DBG] from='client.152430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:19 smithi131 bash[24745]: cluster 2024-09-14T00:55:18.305526+0000 mgr.a (mgr.14355) 6679 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:19 smithi131 bash[24745]: audit 2024-09-14T00:55:18.869288+0000 mgr.a (mgr.14355) 6680 : audit [DBG] from='client.152430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:19 smithi171 bash[25040]: cluster 2024-09-14T00:55:18.305526+0000 mgr.a (mgr.14355) 6679 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:19 smithi171 bash[25040]: audit 2024-09-14T00:55:18.869288+0000 mgr.a (mgr.14355) 6680 : audit [DBG] from='client.152430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:21 smithi007 bash[22722]: cluster 2024-09-14T00:55:20.307817+0000 mgr.a (mgr.14355) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:21 smithi131 bash[24745]: cluster 2024-09-14T00:55:20.307817+0000 mgr.a (mgr.14355) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:21 smithi171 bash[25040]: cluster 2024-09-14T00:55:20.307817+0000 mgr.a (mgr.14355) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:23 smithi007 bash[22722]: cluster 2024-09-14T00:55:22.308571+0000 mgr.a (mgr.14355) 6682 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:23 smithi131 bash[24745]: cluster 2024-09-14T00:55:22.308571+0000 mgr.a (mgr.14355) 6682 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:23 smithi171 bash[25040]: cluster 2024-09-14T00:55:22.308571+0000 mgr.a (mgr.14355) 6682 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:24.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:25.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:25 smithi007 bash[22722]: cluster 2024-09-14T00:55:24.309125+0000 mgr.a (mgr.14355) 6683 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:25 smithi007 bash[22722]: audit 2024-09-14T00:55:24.627372+0000 mgr.a (mgr.14355) 6684 : audit [DBG] from='client.152505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:25 smithi131 bash[24745]: cluster 2024-09-14T00:55:24.309125+0000 mgr.a (mgr.14355) 6683 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:26.385 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:25 smithi131 bash[24745]: audit 2024-09-14T00:55:24.627372+0000 mgr.a (mgr.14355) 6684 : audit [DBG] from='client.152505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:26.386 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:25 smithi171 bash[25040]: cluster 2024-09-14T00:55:24.309125+0000 mgr.a (mgr.14355) 6683 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:26.386 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:25 smithi171 bash[25040]: audit 2024-09-14T00:55:24.627372+0000 mgr.a (mgr.14355) 6684 : audit [DBG] from='client.152505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:27 smithi007 bash[22722]: cluster 2024-09-14T00:55:26.311614+0000 mgr.a (mgr.14355) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:27 smithi131 bash[24745]: cluster 2024-09-14T00:55:26.311614+0000 mgr.a (mgr.14355) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:27 smithi171 bash[25040]: cluster 2024-09-14T00:55:26.311614+0000 mgr.a (mgr.14355) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:55:30.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:30.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:29 smithi007 bash[22722]: cluster 2024-09-14T00:55:28.312417+0000 mgr.a (mgr.14355) 6686 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:29 smithi131 bash[24745]: cluster 2024-09-14T00:55:28.312417+0000 mgr.a (mgr.14355) 6686 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:29 smithi171 bash[25040]: cluster 2024-09-14T00:55:28.312417+0000 mgr.a (mgr.14355) 6686 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:30.816 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:30.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:30.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:30.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:30.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:31 smithi007 bash[22722]: cluster 2024-09-14T00:55:30.314335+0000 mgr.a (mgr.14355) 6687 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:31 smithi007 bash[22722]: audit 2024-09-14T00:55:30.389247+0000 mgr.a (mgr.14355) 6688 : audit [DBG] from='client.152583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:31 smithi131 bash[24745]: cluster 2024-09-14T00:55:30.314335+0000 mgr.a (mgr.14355) 6687 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:32.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:31 smithi131 bash[24745]: audit 2024-09-14T00:55:30.389247+0000 mgr.a (mgr.14355) 6688 : audit [DBG] from='client.152583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:31 smithi171 bash[25040]: cluster 2024-09-14T00:55:30.314335+0000 mgr.a (mgr.14355) 6687 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:31 smithi171 bash[25040]: audit 2024-09-14T00:55:30.389247+0000 mgr.a (mgr.14355) 6688 : audit [DBG] from='client.152583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:33 smithi007 bash[22722]: cluster 2024-09-14T00:55:32.315299+0000 mgr.a (mgr.14355) 6689 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:55:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:33 smithi131 bash[24745]: cluster 2024-09-14T00:55:32.315299+0000 mgr.a (mgr.14355) 6689 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:55:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:33 smithi171 bash[25040]: cluster 2024-09-14T00:55:32.315299+0000 mgr.a (mgr.14355) 6689 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:55:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:35 smithi007 bash[22722]: cluster 2024-09-14T00:55:34.316088+0000 mgr.a (mgr.14355) 6690 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:35 smithi131 bash[24745]: cluster 2024-09-14T00:55:34.316088+0000 mgr.a (mgr.14355) 6690 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:35 smithi171 bash[25040]: cluster 2024-09-14T00:55:34.316088+0000 mgr.a (mgr.14355) 6690 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:36.599 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:36.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:36 smithi131 bash[24745]: audit 2024-09-14T00:55:36.160584+0000 mgr.a (mgr.14355) 6691 : audit [DBG] from='client.152658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:36 smithi171 bash[25040]: audit 2024-09-14T00:55:36.160584+0000 mgr.a (mgr.14355) 6691 : audit [DBG] from='client.152658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:36 smithi007 bash[22722]: audit 2024-09-14T00:55:36.160584+0000 mgr.a (mgr.14355) 6691 : audit [DBG] from='client.152658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:37 smithi131 bash[24745]: cluster 2024-09-14T00:55:36.317476+0000 mgr.a (mgr.14355) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:37 smithi171 bash[25040]: cluster 2024-09-14T00:55:36.317476+0000 mgr.a (mgr.14355) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:37 smithi007 bash[22722]: cluster 2024-09-14T00:55:36.317476+0000 mgr.a (mgr.14355) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:39 smithi131 bash[24745]: cluster 2024-09-14T00:55:38.318416+0000 mgr.a (mgr.14355) 6693 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:39 smithi171 bash[25040]: cluster 2024-09-14T00:55:38.318416+0000 mgr.a (mgr.14355) 6693 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:39 smithi007 bash[22722]: cluster 2024-09-14T00:55:38.318416+0000 mgr.a (mgr.14355) 6693 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:55:41.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:41.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:41.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:41 smithi131 bash[24745]: cluster 2024-09-14T00:55:40.320540+0000 mgr.a (mgr.14355) 6694 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:41 smithi171 bash[25040]: cluster 2024-09-14T00:55:40.320540+0000 mgr.a (mgr.14355) 6694 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:42.378 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:42.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:42.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:42.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:42.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:41 smithi007 bash[22722]: cluster 2024-09-14T00:55:40.320540+0000 mgr.a (mgr.14355) 6694 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:42 smithi131 bash[24745]: audit 2024-09-14T00:55:41.934953+0000 mgr.a (mgr.14355) 6695 : audit [DBG] from='client.152733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:42 smithi171 bash[25040]: audit 2024-09-14T00:55:41.934953+0000 mgr.a (mgr.14355) 6695 : audit [DBG] from='client.152733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:42 smithi007 bash[22722]: audit 2024-09-14T00:55:41.934953+0000 mgr.a (mgr.14355) 6695 : audit [DBG] from='client.152733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:43 smithi131 bash[24745]: cluster 2024-09-14T00:55:42.321075+0000 mgr.a (mgr.14355) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:43 smithi171 bash[25040]: cluster 2024-09-14T00:55:42.321075+0000 mgr.a (mgr.14355) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:43 smithi007 bash[22722]: cluster 2024-09-14T00:55:42.321075+0000 mgr.a (mgr.14355) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:45 smithi131 bash[24745]: cluster 2024-09-14T00:55:44.321846+0000 mgr.a (mgr.14355) 6697 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:45 smithi171 bash[25040]: cluster 2024-09-14T00:55:44.321846+0000 mgr.a (mgr.14355) 6697 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:45 smithi007 bash[22722]: cluster 2024-09-14T00:55:44.321846+0000 mgr.a (mgr.14355) 6697 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:47.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:47.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:48.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:47 smithi131 bash[24745]: cluster 2024-09-14T00:55:46.324096+0000 mgr.a (mgr.14355) 6698 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:47 smithi171 bash[25040]: cluster 2024-09-14T00:55:46.324096+0000 mgr.a (mgr.14355) 6698 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:47 smithi007 bash[22722]: cluster 2024-09-14T00:55:46.324096+0000 mgr.a (mgr.14355) 6698 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:48 smithi131 bash[24745]: audit 2024-09-14T00:55:47.711773+0000 mgr.a (mgr.14355) 6699 : audit [DBG] from='client.152811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:48 smithi171 bash[25040]: audit 2024-09-14T00:55:47.711773+0000 mgr.a (mgr.14355) 6699 : audit [DBG] from='client.152811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:48 smithi007 bash[22722]: audit 2024-09-14T00:55:47.711773+0000 mgr.a (mgr.14355) 6699 : audit [DBG] from='client.152811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:49 smithi131 bash[24745]: cluster 2024-09-14T00:55:48.325177+0000 mgr.a (mgr.14355) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:49 smithi171 bash[25040]: cluster 2024-09-14T00:55:48.325177+0000 mgr.a (mgr.14355) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:49 smithi007 bash[22722]: cluster 2024-09-14T00:55:48.325177+0000 mgr.a (mgr.14355) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:52 smithi131 bash[24745]: cluster 2024-09-14T00:55:50.327414+0000 mgr.a (mgr.14355) 6701 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:52 smithi171 bash[25040]: cluster 2024-09-14T00:55:50.327414+0000 mgr.a (mgr.14355) 6701 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:52 smithi007 bash[22722]: cluster 2024-09-14T00:55:50.327414+0000 mgr.a (mgr.14355) 6701 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:53.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:53.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:53.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:53.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:55:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:54 smithi131 bash[24745]: cluster 2024-09-14T00:55:52.328236+0000 mgr.a (mgr.14355) 6702 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:54 smithi171 bash[25040]: cluster 2024-09-14T00:55:52.328236+0000 mgr.a (mgr.14355) 6702 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:54 smithi007 bash[22722]: cluster 2024-09-14T00:55:52.328236+0000 mgr.a (mgr.14355) 6702 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:55 smithi131 bash[24745]: audit 2024-09-14T00:55:53.487147+0000 mgr.a (mgr.14355) 6703 : audit [DBG] from='client.152886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:55 smithi171 bash[25040]: audit 2024-09-14T00:55:53.487147+0000 mgr.a (mgr.14355) 6703 : audit [DBG] from='client.152886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:55 smithi007 bash[22722]: audit 2024-09-14T00:55:53.487147+0000 mgr.a (mgr.14355) 6703 : audit [DBG] from='client.152886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:55:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:56 smithi131 bash[24745]: cluster 2024-09-14T00:55:54.329182+0000 mgr.a (mgr.14355) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:56 smithi171 bash[25040]: cluster 2024-09-14T00:55:54.329182+0000 mgr.a (mgr.14355) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:56 smithi007 bash[22722]: cluster 2024-09-14T00:55:54.329182+0000 mgr.a (mgr.14355) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:55:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:55:58 smithi131 bash[24745]: cluster 2024-09-14T00:55:56.331506+0000 mgr.a (mgr.14355) 6705 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:55:58 smithi171 bash[25040]: cluster 2024-09-14T00:55:56.331506+0000 mgr.a (mgr.14355) 6705 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:55:58 smithi007 bash[22722]: cluster 2024-09-14T00:55:56.331506+0000 mgr.a (mgr.14355) 6705 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:55:58.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:55:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:55:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:55:59.700 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:55:59.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:55:59.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:55:59.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:55:59.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:00 smithi131 bash[24745]: cluster 2024-09-14T00:55:58.332291+0000 mgr.a (mgr.14355) 6706 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:00 smithi171 bash[25040]: cluster 2024-09-14T00:55:58.332291+0000 mgr.a (mgr.14355) 6706 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:00 smithi007 bash[22722]: cluster 2024-09-14T00:55:58.332291+0000 mgr.a (mgr.14355) 6706 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:01 smithi171 bash[25040]: audit 2024-09-14T00:55:59.263593+0000 mgr.a (mgr.14355) 6707 : audit [DBG] from='client.152964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:01 smithi007 bash[22722]: audit 2024-09-14T00:55:59.263593+0000 mgr.a (mgr.14355) 6707 : audit [DBG] from='client.152964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:01.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:01 smithi131 bash[24745]: audit 2024-09-14T00:55:59.263593+0000 mgr.a (mgr.14355) 6707 : audit [DBG] from='client.152964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:02 smithi171 bash[25040]: cluster 2024-09-14T00:56:00.334692+0000 mgr.a (mgr.14355) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:02 smithi007 bash[22722]: cluster 2024-09-14T00:56:00.334692+0000 mgr.a (mgr.14355) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:02 smithi131 bash[24745]: cluster 2024-09-14T00:56:00.334692+0000 mgr.a (mgr.14355) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:04 smithi171 bash[25040]: cluster 2024-09-14T00:56:02.335503+0000 mgr.a (mgr.14355) 6709 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:04 smithi007 bash[22722]: cluster 2024-09-14T00:56:02.335503+0000 mgr.a (mgr.14355) 6709 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:04 smithi131 bash[24745]: cluster 2024-09-14T00:56:02.335503+0000 mgr.a (mgr.14355) 6709 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:04.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:04.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:05.473 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:05.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:05.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:05.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:05.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:06 smithi171 bash[25040]: cluster 2024-09-14T00:56:04.336274+0000 mgr.a (mgr.14355) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:06 smithi171 bash[25040]: audit 2024-09-14T00:56:05.034852+0000 mgr.a (mgr.14355) 6711 : audit [DBG] from='client.153042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:06 smithi007 bash[22722]: cluster 2024-09-14T00:56:04.336274+0000 mgr.a (mgr.14355) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:06 smithi007 bash[22722]: audit 2024-09-14T00:56:05.034852+0000 mgr.a (mgr.14355) 6711 : audit [DBG] from='client.153042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:06 smithi131 bash[24745]: cluster 2024-09-14T00:56:04.336274+0000 mgr.a (mgr.14355) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:06 smithi131 bash[24745]: audit 2024-09-14T00:56:05.034852+0000 mgr.a (mgr.14355) 6711 : audit [DBG] from='client.153042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:08 smithi007 bash[22722]: cluster 2024-09-14T00:56:06.339274+0000 mgr.a (mgr.14355) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:08 smithi131 bash[24745]: cluster 2024-09-14T00:56:06.339274+0000 mgr.a (mgr.14355) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:08 smithi171 bash[25040]: cluster 2024-09-14T00:56:06.339274+0000 mgr.a (mgr.14355) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:10 smithi007 bash[22722]: cluster 2024-09-14T00:56:08.340246+0000 mgr.a (mgr.14355) 6713 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:10.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:10.475 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:10.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:10 smithi131 bash[24745]: cluster 2024-09-14T00:56:08.340246+0000 mgr.a (mgr.14355) 6713 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:10 smithi171 bash[25040]: cluster 2024-09-14T00:56:08.340246+0000 mgr.a (mgr.14355) 6713 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:11.222 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:12 smithi007 bash[22722]: cluster 2024-09-14T00:56:10.342383+0000 mgr.a (mgr.14355) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:12 smithi007 bash[22722]: audit 2024-09-14T00:56:10.806814+0000 mgr.a (mgr.14355) 6715 : audit [DBG] from='client.153120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:12 smithi007 bash[22722]: audit 2024-09-14T00:56:11.533299+0000 mon.a (mon.0) 1608 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:56:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:12 smithi131 bash[24745]: cluster 2024-09-14T00:56:10.342383+0000 mgr.a (mgr.14355) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:12 smithi131 bash[24745]: audit 2024-09-14T00:56:10.806814+0000 mgr.a (mgr.14355) 6715 : audit [DBG] from='client.153120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:12 smithi131 bash[24745]: audit 2024-09-14T00:56:11.533299+0000 mon.a (mon.0) 1608 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:56:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:12 smithi171 bash[25040]: cluster 2024-09-14T00:56:10.342383+0000 mgr.a (mgr.14355) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:12 smithi171 bash[25040]: audit 2024-09-14T00:56:10.806814+0000 mgr.a (mgr.14355) 6715 : audit [DBG] from='client.153120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:12 smithi171 bash[25040]: audit 2024-09-14T00:56:11.533299+0000 mon.a (mon.0) 1608 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:56:13.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22972]: debug 2024-09-14T00:56:13.093+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:56:13.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22972]: debug 2024-09-14T00:56:13.093+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:56:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22722]: audit 2024-09-14T00:56:12.343813+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:56:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22722]: audit 2024-09-14T00:56:12.345418+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:56:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22722]: audit 2024-09-14T00:56:12.355762+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:56:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:13 smithi007 bash[22722]: audit 2024-09-14T00:56:12.360498+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:13 smithi131 bash[24745]: audit 2024-09-14T00:56:12.343813+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:56:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:13 smithi131 bash[24745]: audit 2024-09-14T00:56:12.345418+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:56:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:13 smithi131 bash[24745]: audit 2024-09-14T00:56:12.355762+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:56:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:13 smithi131 bash[24745]: audit 2024-09-14T00:56:12.360498+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:13 smithi171 bash[25040]: audit 2024-09-14T00:56:12.343813+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:56:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:13 smithi171 bash[25040]: audit 2024-09-14T00:56:12.345418+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:56:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:13 smithi171 bash[25040]: audit 2024-09-14T00:56:12.355762+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:56:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:13 smithi171 bash[25040]: audit 2024-09-14T00:56:12.360498+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:14 smithi007 bash[22722]: cluster 2024-09-14T00:56:12.342904+0000 mgr.a (mgr.14355) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:14 smithi007 bash[22722]: audit 2024-09-14T00:56:12.362060+0000 mgr.a (mgr.14355) 6717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:14 smithi007 bash[22722]: audit 2024-09-14T00:56:13.095273+0000 mgr.a (mgr.14355) 6718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:56:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:14 smithi007 bash[22722]: cephadm 2024-09-14T00:56:13.096341+0000 mgr.a (mgr.14355) 6719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:56:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:14 smithi131 bash[24745]: cluster 2024-09-14T00:56:12.342904+0000 mgr.a (mgr.14355) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:14 smithi131 bash[24745]: audit 2024-09-14T00:56:12.362060+0000 mgr.a (mgr.14355) 6717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:14 smithi131 bash[24745]: audit 2024-09-14T00:56:13.095273+0000 mgr.a (mgr.14355) 6718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:56:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:14 smithi131 bash[24745]: cephadm 2024-09-14T00:56:13.096341+0000 mgr.a (mgr.14355) 6719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:56:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:14 smithi171 bash[25040]: cluster 2024-09-14T00:56:12.342904+0000 mgr.a (mgr.14355) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:14 smithi171 bash[25040]: audit 2024-09-14T00:56:12.362060+0000 mgr.a (mgr.14355) 6717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:56:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:14 smithi171 bash[25040]: audit 2024-09-14T00:56:13.095273+0000 mgr.a (mgr.14355) 6718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:56:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:14 smithi171 bash[25040]: cephadm 2024-09-14T00:56:13.096341+0000 mgr.a (mgr.14355) 6719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:56:16.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:16.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:16.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:16 smithi007 bash[22722]: cluster 2024-09-14T00:56:14.343955+0000 mgr.a (mgr.14355) 6720 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:56:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:16 smithi131 bash[24745]: cluster 2024-09-14T00:56:14.343955+0000 mgr.a (mgr.14355) 6720 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:56:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:16 smithi171 bash[25040]: cluster 2024-09-14T00:56:14.343955+0000 mgr.a (mgr.14355) 6720 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:56:17.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:17.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:17.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:17.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:17.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:18 smithi007 bash[22722]: cluster 2024-09-14T00:56:16.345404+0000 mgr.a (mgr.14355) 6721 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:18 smithi007 bash[22722]: audit 2024-09-14T00:56:16.563173+0000 mgr.a (mgr.14355) 6722 : audit [DBG] from='client.153306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:18 smithi131 bash[24745]: cluster 2024-09-14T00:56:16.345404+0000 mgr.a (mgr.14355) 6721 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:18.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:18 smithi131 bash[24745]: audit 2024-09-14T00:56:16.563173+0000 mgr.a (mgr.14355) 6722 : audit [DBG] from='client.153306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:18 smithi171 bash[25040]: cluster 2024-09-14T00:56:16.345404+0000 mgr.a (mgr.14355) 6721 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:18 smithi171 bash[25040]: audit 2024-09-14T00:56:16.563173+0000 mgr.a (mgr.14355) 6722 : audit [DBG] from='client.153306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:20 smithi007 bash[22722]: cluster 2024-09-14T00:56:18.346357+0000 mgr.a (mgr.14355) 6723 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:20.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:20 smithi131 bash[24745]: cluster 2024-09-14T00:56:18.346357+0000 mgr.a (mgr.14355) 6723 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:20 smithi171 bash[25040]: cluster 2024-09-14T00:56:18.346357+0000 mgr.a (mgr.14355) 6723 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:22.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:22.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:22 smithi007 bash[22722]: cluster 2024-09-14T00:56:20.348542+0000 mgr.a (mgr.14355) 6724 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:22 smithi131 bash[24745]: cluster 2024-09-14T00:56:20.348542+0000 mgr.a (mgr.14355) 6724 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:22 smithi171 bash[25040]: cluster 2024-09-14T00:56:20.348542+0000 mgr.a (mgr.14355) 6724 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:22.760 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:24 smithi007 bash[22722]: audit 2024-09-14T00:56:22.348128+0000 mgr.a (mgr.14355) 6725 : audit [DBG] from='client.153381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:24 smithi007 bash[22722]: cluster 2024-09-14T00:56:22.364775+0000 mgr.a (mgr.14355) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:24 smithi131 bash[24745]: audit 2024-09-14T00:56:22.348128+0000 mgr.a (mgr.14355) 6725 : audit [DBG] from='client.153381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:24 smithi131 bash[24745]: cluster 2024-09-14T00:56:22.364775+0000 mgr.a (mgr.14355) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:24 smithi171 bash[25040]: audit 2024-09-14T00:56:22.348128+0000 mgr.a (mgr.14355) 6725 : audit [DBG] from='client.153381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:24 smithi171 bash[25040]: cluster 2024-09-14T00:56:22.364775+0000 mgr.a (mgr.14355) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:56:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:26 smithi007 bash[22722]: cluster 2024-09-14T00:56:24.366041+0000 mgr.a (mgr.14355) 6727 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:26 smithi131 bash[24745]: cluster 2024-09-14T00:56:24.366041+0000 mgr.a (mgr.14355) 6727 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:26 smithi171 bash[25040]: cluster 2024-09-14T00:56:24.366041+0000 mgr.a (mgr.14355) 6727 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:28 smithi007 bash[22722]: cluster 2024-09-14T00:56:26.368443+0000 mgr.a (mgr.14355) 6728 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:28 smithi131 bash[24745]: cluster 2024-09-14T00:56:26.368443+0000 mgr.a (mgr.14355) 6728 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:28.541 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:28 smithi171 bash[25040]: cluster 2024-09-14T00:56:26.368443+0000 mgr.a (mgr.14355) 6728 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T00:56:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:29 smithi007 bash[22722]: audit 2024-09-14T00:56:28.097659+0000 mgr.a (mgr.14355) 6729 : audit [DBG] from='client.153456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:29.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:29 smithi131 bash[24745]: audit 2024-09-14T00:56:28.097659+0000 mgr.a (mgr.14355) 6729 : audit [DBG] from='client.153456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:29 smithi171 bash[25040]: audit 2024-09-14T00:56:28.097659+0000 mgr.a (mgr.14355) 6729 : audit [DBG] from='client.153456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:30 smithi007 bash[22722]: cluster 2024-09-14T00:56:28.369164+0000 mgr.a (mgr.14355) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:30 smithi131 bash[24745]: cluster 2024-09-14T00:56:28.369164+0000 mgr.a (mgr.14355) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:30 smithi171 bash[25040]: cluster 2024-09-14T00:56:28.369164+0000 mgr.a (mgr.14355) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:32 smithi007 bash[22722]: cluster 2024-09-14T00:56:30.371450+0000 mgr.a (mgr.14355) 6731 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:32 smithi131 bash[24745]: cluster 2024-09-14T00:56:30.371450+0000 mgr.a (mgr.14355) 6731 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:32 smithi171 bash[25040]: cluster 2024-09-14T00:56:30.371450+0000 mgr.a (mgr.14355) 6731 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:33.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:33.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:33.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:34.315 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:34.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:34 smithi007 bash[22722]: cluster 2024-09-14T00:56:32.372245+0000 mgr.a (mgr.14355) 6732 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:34 smithi131 bash[24745]: cluster 2024-09-14T00:56:32.372245+0000 mgr.a (mgr.14355) 6732 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:34 smithi171 bash[25040]: cluster 2024-09-14T00:56:32.372245+0000 mgr.a (mgr.14355) 6732 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:35 smithi007 bash[22722]: audit 2024-09-14T00:56:33.881045+0000 mgr.a (mgr.14355) 6733 : audit [DBG] from='client.153534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:35 smithi131 bash[24745]: audit 2024-09-14T00:56:33.881045+0000 mgr.a (mgr.14355) 6733 : audit [DBG] from='client.153534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:35 smithi171 bash[25040]: audit 2024-09-14T00:56:33.881045+0000 mgr.a (mgr.14355) 6733 : audit [DBG] from='client.153534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:36 smithi007 bash[22722]: cluster 2024-09-14T00:56:34.373086+0000 mgr.a (mgr.14355) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:36 smithi131 bash[24745]: cluster 2024-09-14T00:56:34.373086+0000 mgr.a (mgr.14355) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:36 smithi171 bash[25040]: cluster 2024-09-14T00:56:34.373086+0000 mgr.a (mgr.14355) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:38 smithi007 bash[22722]: cluster 2024-09-14T00:56:36.375346+0000 mgr.a (mgr.14355) 6735 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:38 smithi131 bash[24745]: cluster 2024-09-14T00:56:36.375346+0000 mgr.a (mgr.14355) 6735 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:38 smithi171 bash[25040]: cluster 2024-09-14T00:56:36.375346+0000 mgr.a (mgr.14355) 6735 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:39.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:40.083 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:40.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:40 smithi007 bash[22722]: cluster 2024-09-14T00:56:38.376136+0000 mgr.a (mgr.14355) 6736 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:40 smithi131 bash[24745]: cluster 2024-09-14T00:56:38.376136+0000 mgr.a (mgr.14355) 6736 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:40 smithi171 bash[25040]: cluster 2024-09-14T00:56:38.376136+0000 mgr.a (mgr.14355) 6736 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:41 smithi007 bash[22722]: audit 2024-09-14T00:56:39.656453+0000 mgr.a (mgr.14355) 6737 : audit [DBG] from='client.153612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:41 smithi131 bash[24745]: audit 2024-09-14T00:56:39.656453+0000 mgr.a (mgr.14355) 6737 : audit [DBG] from='client.153612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:41 smithi171 bash[25040]: audit 2024-09-14T00:56:39.656453+0000 mgr.a (mgr.14355) 6737 : audit [DBG] from='client.153612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:42 smithi007 bash[22722]: cluster 2024-09-14T00:56:40.378569+0000 mgr.a (mgr.14355) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:42 smithi131 bash[24745]: cluster 2024-09-14T00:56:40.378569+0000 mgr.a (mgr.14355) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:42 smithi171 bash[25040]: cluster 2024-09-14T00:56:40.378569+0000 mgr.a (mgr.14355) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:56:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:44 smithi007 bash[22722]: cluster 2024-09-14T00:56:42.379544+0000 mgr.a (mgr.14355) 6739 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:44 smithi131 bash[24745]: cluster 2024-09-14T00:56:42.379544+0000 mgr.a (mgr.14355) 6739 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:44 smithi171 bash[25040]: cluster 2024-09-14T00:56:42.379544+0000 mgr.a (mgr.14355) 6739 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:45.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:45.085 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:45.085 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:45.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:45.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:45.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:45.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:45.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:46 smithi007 bash[22722]: cluster 2024-09-14T00:56:44.380499+0000 mgr.a (mgr.14355) 6740 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:46 smithi131 bash[24745]: cluster 2024-09-14T00:56:44.380499+0000 mgr.a (mgr.14355) 6740 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:46 smithi171 bash[25040]: cluster 2024-09-14T00:56:44.380499+0000 mgr.a (mgr.14355) 6740 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:47 smithi007 bash[22722]: audit 2024-09-14T00:56:45.420946+0000 mgr.a (mgr.14355) 6741 : audit [DBG] from='client.153690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:47 smithi131 bash[24745]: audit 2024-09-14T00:56:45.420946+0000 mgr.a (mgr.14355) 6741 : audit [DBG] from='client.153690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:47 smithi171 bash[25040]: audit 2024-09-14T00:56:45.420946+0000 mgr.a (mgr.14355) 6741 : audit [DBG] from='client.153690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:48 smithi007 bash[22722]: cluster 2024-09-14T00:56:46.383485+0000 mgr.a (mgr.14355) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:48 smithi131 bash[24745]: cluster 2024-09-14T00:56:46.383485+0000 mgr.a (mgr.14355) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:48 smithi171 bash[25040]: cluster 2024-09-14T00:56:46.383485+0000 mgr.a (mgr.14355) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:50 smithi007 bash[22722]: cluster 2024-09-14T00:56:48.384462+0000 mgr.a (mgr.14355) 6743 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:50 smithi131 bash[24745]: cluster 2024-09-14T00:56:48.384462+0000 mgr.a (mgr.14355) 6743 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:50 smithi171 bash[25040]: cluster 2024-09-14T00:56:48.384462+0000 mgr.a (mgr.14355) 6743 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:50.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:51.626 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:51.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:52 smithi007 bash[22722]: cluster 2024-09-14T00:56:50.386591+0000 mgr.a (mgr.14355) 6744 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:52 smithi131 bash[24745]: cluster 2024-09-14T00:56:50.386591+0000 mgr.a (mgr.14355) 6744 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:52 smithi171 bash[25040]: cluster 2024-09-14T00:56:50.386591+0000 mgr.a (mgr.14355) 6744 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:53 smithi007 bash[22722]: audit 2024-09-14T00:56:51.194745+0000 mgr.a (mgr.14355) 6745 : audit [DBG] from='client.153765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:53 smithi131 bash[24745]: audit 2024-09-14T00:56:51.194745+0000 mgr.a (mgr.14355) 6745 : audit [DBG] from='client.153765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:53 smithi171 bash[25040]: audit 2024-09-14T00:56:51.194745+0000 mgr.a (mgr.14355) 6745 : audit [DBG] from='client.153765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:54 smithi007 bash[22722]: cluster 2024-09-14T00:56:52.387567+0000 mgr.a (mgr.14355) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:54 smithi131 bash[24745]: cluster 2024-09-14T00:56:52.387567+0000 mgr.a (mgr.14355) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:54 smithi171 bash[25040]: cluster 2024-09-14T00:56:52.387567+0000 mgr.a (mgr.14355) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:56 smithi007 bash[22722]: cluster 2024-09-14T00:56:54.388375+0000 mgr.a (mgr.14355) 6747 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:56 smithi131 bash[24745]: cluster 2024-09-14T00:56:54.388375+0000 mgr.a (mgr.14355) 6747 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:56 smithi171 bash[25040]: cluster 2024-09-14T00:56:54.388375+0000 mgr.a (mgr.14355) 6747 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:56:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:56:56.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:56:56.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:56:57.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:56:57.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:56:57.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:56:57.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:56:57.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:56:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:58 smithi007 bash[22722]: cluster 2024-09-14T00:56:56.390764+0000 mgr.a (mgr.14355) 6748 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:58 smithi007 bash[22722]: audit 2024-09-14T00:56:56.962374+0000 mgr.a (mgr.14355) 6749 : audit [DBG] from='client.153843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:58 smithi131 bash[24745]: cluster 2024-09-14T00:56:56.390764+0000 mgr.a (mgr.14355) 6748 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:58 smithi131 bash[24745]: audit 2024-09-14T00:56:56.962374+0000 mgr.a (mgr.14355) 6749 : audit [DBG] from='client.153843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:58 smithi171 bash[25040]: cluster 2024-09-14T00:56:56.390764+0000 mgr.a (mgr.14355) 6748 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:58 smithi171 bash[25040]: audit 2024-09-14T00:56:56.962374+0000 mgr.a (mgr.14355) 6749 : audit [DBG] from='client.153843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:56:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:56:59 smithi131 bash[24745]: cluster 2024-09-14T00:56:58.391883+0000 mgr.a (mgr.14355) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:56:59 smithi171 bash[25040]: cluster 2024-09-14T00:56:58.391883+0000 mgr.a (mgr.14355) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:56:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:56:59 smithi007 bash[22722]: cluster 2024-09-14T00:56:58.391883+0000 mgr.a (mgr.14355) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:01 smithi007 bash[22722]: cluster 2024-09-14T00:57:00.394103+0000 mgr.a (mgr.14355) 6751 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:01 smithi131 bash[24745]: cluster 2024-09-14T00:57:00.394103+0000 mgr.a (mgr.14355) 6751 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:01 smithi171 bash[25040]: cluster 2024-09-14T00:57:00.394103+0000 mgr.a (mgr.14355) 6751 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:02.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:02.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:02.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:03.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:03.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:03.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:03.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:03.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:03 smithi131 bash[24745]: cluster 2024-09-14T00:57:02.394904+0000 mgr.a (mgr.14355) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:03.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:03 smithi131 bash[24745]: audit 2024-09-14T00:57:02.731645+0000 mgr.a (mgr.14355) 6753 : audit [DBG] from='client.153918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:03 smithi171 bash[25040]: cluster 2024-09-14T00:57:02.394904+0000 mgr.a (mgr.14355) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:03 smithi171 bash[25040]: audit 2024-09-14T00:57:02.731645+0000 mgr.a (mgr.14355) 6753 : audit [DBG] from='client.153918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:03 smithi007 bash[22722]: cluster 2024-09-14T00:57:02.394904+0000 mgr.a (mgr.14355) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:03 smithi007 bash[22722]: audit 2024-09-14T00:57:02.731645+0000 mgr.a (mgr.14355) 6753 : audit [DBG] from='client.153918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:05 smithi131 bash[24745]: cluster 2024-09-14T00:57:04.395820+0000 mgr.a (mgr.14355) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:05 smithi171 bash[25040]: cluster 2024-09-14T00:57:04.395820+0000 mgr.a (mgr.14355) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:05 smithi007 bash[22722]: cluster 2024-09-14T00:57:04.395820+0000 mgr.a (mgr.14355) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:07 smithi131 bash[24745]: cluster 2024-09-14T00:57:06.398095+0000 mgr.a (mgr.14355) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:07 smithi171 bash[25040]: cluster 2024-09-14T00:57:06.398095+0000 mgr.a (mgr.14355) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:07 smithi007 bash[22722]: cluster 2024-09-14T00:57:06.398095+0000 mgr.a (mgr.14355) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:08.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:08.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:08.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:08.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:08.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:08.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:08.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:08.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:09 smithi131 bash[24745]: cluster 2024-09-14T00:57:08.398852+0000 mgr.a (mgr.14355) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:09 smithi131 bash[24745]: audit 2024-09-14T00:57:08.484867+0000 mgr.a (mgr.14355) 6757 : audit [DBG] from='client.153996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:09 smithi171 bash[25040]: cluster 2024-09-14T00:57:08.398852+0000 mgr.a (mgr.14355) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:09 smithi171 bash[25040]: audit 2024-09-14T00:57:08.484867+0000 mgr.a (mgr.14355) 6757 : audit [DBG] from='client.153996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:09 smithi007 bash[22722]: cluster 2024-09-14T00:57:08.398852+0000 mgr.a (mgr.14355) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:09 smithi007 bash[22722]: audit 2024-09-14T00:57:08.484867+0000 mgr.a (mgr.14355) 6757 : audit [DBG] from='client.153996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:11 smithi131 bash[24745]: cluster 2024-09-14T00:57:10.401129+0000 mgr.a (mgr.14355) 6758 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:11 smithi171 bash[25040]: cluster 2024-09-14T00:57:10.401129+0000 mgr.a (mgr.14355) 6758 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:11 smithi007 bash[22722]: cluster 2024-09-14T00:57:10.401129+0000 mgr.a (mgr.14355) 6758 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:13 smithi131 bash[24745]: cluster 2024-09-14T00:57:12.401934+0000 mgr.a (mgr.14355) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:13 smithi131 bash[24745]: audit 2024-09-14T00:57:13.145590+0000 mon.a (mon.0) 1613 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:57:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:13 smithi171 bash[25040]: cluster 2024-09-14T00:57:12.401934+0000 mgr.a (mgr.14355) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:13 smithi171 bash[25040]: audit 2024-09-14T00:57:13.145590+0000 mon.a (mon.0) 1613 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:57:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:13.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:13.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:13 smithi007 bash[22722]: cluster 2024-09-14T00:57:12.401934+0000 mgr.a (mgr.14355) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:13 smithi007 bash[22722]: audit 2024-09-14T00:57:13.145590+0000 mon.a (mon.0) 1613 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:57:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:14 smithi131 bash[24745]: audit 2024-09-14T00:57:13.977844+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:57:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:14 smithi131 bash[24745]: audit 2024-09-14T00:57:13.978905+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:57:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:14 smithi131 bash[24745]: audit 2024-09-14T00:57:13.985416+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:57:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:14 smithi131 bash[24745]: audit 2024-09-14T00:57:13.988323+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:14 smithi131 bash[24745]: audit 2024-09-14T00:57:13.989375+0000 mgr.a (mgr.14355) 6760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:14 smithi171 bash[25040]: audit 2024-09-14T00:57:13.977844+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:57:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:14 smithi171 bash[25040]: audit 2024-09-14T00:57:13.978905+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:57:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:14 smithi171 bash[25040]: audit 2024-09-14T00:57:13.985416+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:57:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:14 smithi171 bash[25040]: audit 2024-09-14T00:57:13.988323+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:14 smithi171 bash[25040]: audit 2024-09-14T00:57:13.989375+0000 mgr.a (mgr.14355) 6760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:14.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22972]: debug 2024-09-14T00:57:14.700+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:57:14.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22972]: debug 2024-09-14T00:57:14.712+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:57:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22722]: audit 2024-09-14T00:57:13.977844+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:57:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22722]: audit 2024-09-14T00:57:13.978905+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:57:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22722]: audit 2024-09-14T00:57:13.985416+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:57:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22722]: audit 2024-09-14T00:57:13.988323+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:14 smithi007 bash[22722]: audit 2024-09-14T00:57:13.989375+0000 mgr.a (mgr.14355) 6760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:57:15.108 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:15.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:15.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:15.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:15.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:15 smithi131 bash[24745]: audit 2024-09-14T00:57:14.253204+0000 mgr.a (mgr.14355) 6761 : audit [DBG] from='client.154074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:15 smithi131 bash[24745]: cluster 2024-09-14T00:57:14.402503+0000 mgr.a (mgr.14355) 6762 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:15 smithi131 bash[24745]: audit 2024-09-14T00:57:14.705792+0000 mgr.a (mgr.14355) 6763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:57:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:15 smithi131 bash[24745]: cephadm 2024-09-14T00:57:14.717265+0000 mgr.a (mgr.14355) 6764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:57:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:15 smithi171 bash[25040]: audit 2024-09-14T00:57:14.253204+0000 mgr.a (mgr.14355) 6761 : audit [DBG] from='client.154074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:15 smithi171 bash[25040]: cluster 2024-09-14T00:57:14.402503+0000 mgr.a (mgr.14355) 6762 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:15 smithi171 bash[25040]: audit 2024-09-14T00:57:14.705792+0000 mgr.a (mgr.14355) 6763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:57:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:15 smithi171 bash[25040]: cephadm 2024-09-14T00:57:14.717265+0000 mgr.a (mgr.14355) 6764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:57:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:15 smithi007 bash[22722]: audit 2024-09-14T00:57:14.253204+0000 mgr.a (mgr.14355) 6761 : audit [DBG] from='client.154074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:15 smithi007 bash[22722]: cluster 2024-09-14T00:57:14.402503+0000 mgr.a (mgr.14355) 6762 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:15 smithi007 bash[22722]: audit 2024-09-14T00:57:14.705792+0000 mgr.a (mgr.14355) 6763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:57:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:15 smithi007 bash[22722]: cephadm 2024-09-14T00:57:14.717265+0000 mgr.a (mgr.14355) 6764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:57:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:18 smithi131 bash[24745]: cluster 2024-09-14T00:57:16.404896+0000 mgr.a (mgr.14355) 6765 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:18 smithi171 bash[25040]: cluster 2024-09-14T00:57:16.404896+0000 mgr.a (mgr.14355) 6765 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:18 smithi007 bash[22722]: cluster 2024-09-14T00:57:16.404896+0000 mgr.a (mgr.14355) 6765 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:20.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:20.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:20 smithi131 bash[24745]: cluster 2024-09-14T00:57:18.405665+0000 mgr.a (mgr.14355) 6766 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:20 smithi171 bash[25040]: cluster 2024-09-14T00:57:18.405665+0000 mgr.a (mgr.14355) 6766 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:20 smithi007 bash[22722]: cluster 2024-09-14T00:57:18.405665+0000 mgr.a (mgr.14355) 6766 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:20.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:22 smithi131 bash[24745]: cluster 2024-09-14T00:57:20.407628+0000 mgr.a (mgr.14355) 6767 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:22 smithi131 bash[24745]: audit 2024-09-14T00:57:20.447466+0000 mgr.a (mgr.14355) 6768 : audit [DBG] from='client.154257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:22 smithi171 bash[25040]: cluster 2024-09-14T00:57:20.407628+0000 mgr.a (mgr.14355) 6767 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:22 smithi171 bash[25040]: audit 2024-09-14T00:57:20.447466+0000 mgr.a (mgr.14355) 6768 : audit [DBG] from='client.154257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:22 smithi007 bash[22722]: cluster 2024-09-14T00:57:20.407628+0000 mgr.a (mgr.14355) 6767 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:22 smithi007 bash[22722]: audit 2024-09-14T00:57:20.447466+0000 mgr.a (mgr.14355) 6768 : audit [DBG] from='client.154257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:24 smithi131 bash[24745]: cluster 2024-09-14T00:57:22.408547+0000 mgr.a (mgr.14355) 6769 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:24 smithi171 bash[25040]: cluster 2024-09-14T00:57:22.408547+0000 mgr.a (mgr.14355) 6769 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:24 smithi007 bash[22722]: cluster 2024-09-14T00:57:22.408547+0000 mgr.a (mgr.14355) 6769 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:25.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:25.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:26 smithi131 bash[24745]: cluster 2024-09-14T00:57:24.409348+0000 mgr.a (mgr.14355) 6770 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:26 smithi171 bash[25040]: cluster 2024-09-14T00:57:24.409348+0000 mgr.a (mgr.14355) 6770 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:26 smithi007 bash[22722]: cluster 2024-09-14T00:57:24.409348+0000 mgr.a (mgr.14355) 6770 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T00:57:26.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:28 smithi131 bash[24745]: audit 2024-09-14T00:57:26.238345+0000 mgr.a (mgr.14355) 6771 : audit [DBG] from='client.154332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:28 smithi131 bash[24745]: cluster 2024-09-14T00:57:26.410776+0000 mgr.a (mgr.14355) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:28 smithi171 bash[25040]: audit 2024-09-14T00:57:26.238345+0000 mgr.a (mgr.14355) 6771 : audit [DBG] from='client.154332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:28 smithi171 bash[25040]: cluster 2024-09-14T00:57:26.410776+0000 mgr.a (mgr.14355) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:28 smithi007 bash[22722]: audit 2024-09-14T00:57:26.238345+0000 mgr.a (mgr.14355) 6771 : audit [DBG] from='client.154332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:28 smithi007 bash[22722]: cluster 2024-09-14T00:57:26.410776+0000 mgr.a (mgr.14355) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:57:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:30 smithi131 bash[24745]: cluster 2024-09-14T00:57:28.411666+0000 mgr.a (mgr.14355) 6773 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:57:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:30 smithi171 bash[25040]: cluster 2024-09-14T00:57:28.411666+0000 mgr.a (mgr.14355) 6773 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:57:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:30 smithi007 bash[22722]: cluster 2024-09-14T00:57:28.411666+0000 mgr.a (mgr.14355) 6773 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:57:31.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:31.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:31.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:32 smithi171 bash[25040]: cluster 2024-09-14T00:57:30.413878+0000 mgr.a (mgr.14355) 6774 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:32.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:32 smithi007 bash[22722]: cluster 2024-09-14T00:57:30.413878+0000 mgr.a (mgr.14355) 6774 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:32 smithi131 bash[24745]: cluster 2024-09-14T00:57:30.413878+0000 mgr.a (mgr.14355) 6774 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:33 smithi171 bash[25040]: audit 2024-09-14T00:57:32.021126+0000 mgr.a (mgr.14355) 6775 : audit [DBG] from='client.154410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:33 smithi007 bash[22722]: audit 2024-09-14T00:57:32.021126+0000 mgr.a (mgr.14355) 6775 : audit [DBG] from='client.154410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:33 smithi131 bash[24745]: audit 2024-09-14T00:57:32.021126+0000 mgr.a (mgr.14355) 6775 : audit [DBG] from='client.154410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:34 smithi171 bash[25040]: cluster 2024-09-14T00:57:32.414354+0000 mgr.a (mgr.14355) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:34.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:34 smithi007 bash[22722]: cluster 2024-09-14T00:57:32.414354+0000 mgr.a (mgr.14355) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:34 smithi131 bash[24745]: cluster 2024-09-14T00:57:32.414354+0000 mgr.a (mgr.14355) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:36 smithi007 bash[22722]: cluster 2024-09-14T00:57:34.415031+0000 mgr.a (mgr.14355) 6777 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:36 smithi131 bash[24745]: cluster 2024-09-14T00:57:34.415031+0000 mgr.a (mgr.14355) 6777 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:36 smithi171 bash[25040]: cluster 2024-09-14T00:57:34.415031+0000 mgr.a (mgr.14355) 6777 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:37.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:37.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:37.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:38.226 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:38.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:38.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:38.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:38.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:38 smithi007 bash[22722]: cluster 2024-09-14T00:57:36.417262+0000 mgr.a (mgr.14355) 6778 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:38 smithi131 bash[24745]: cluster 2024-09-14T00:57:36.417262+0000 mgr.a (mgr.14355) 6778 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:38 smithi171 bash[25040]: cluster 2024-09-14T00:57:36.417262+0000 mgr.a (mgr.14355) 6778 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:39 smithi007 bash[22722]: audit 2024-09-14T00:57:37.779293+0000 mgr.a (mgr.14355) 6779 : audit [DBG] from='client.154488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:39 smithi131 bash[24745]: audit 2024-09-14T00:57:37.779293+0000 mgr.a (mgr.14355) 6779 : audit [DBG] from='client.154488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:39 smithi171 bash[25040]: audit 2024-09-14T00:57:37.779293+0000 mgr.a (mgr.14355) 6779 : audit [DBG] from='client.154488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:40 smithi007 bash[22722]: cluster 2024-09-14T00:57:38.418375+0000 mgr.a (mgr.14355) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:40 smithi131 bash[24745]: cluster 2024-09-14T00:57:38.418375+0000 mgr.a (mgr.14355) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:40 smithi171 bash[25040]: cluster 2024-09-14T00:57:38.418375+0000 mgr.a (mgr.14355) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:42 smithi007 bash[22722]: cluster 2024-09-14T00:57:40.420834+0000 mgr.a (mgr.14355) 6781 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:42 smithi131 bash[24745]: cluster 2024-09-14T00:57:40.420834+0000 mgr.a (mgr.14355) 6781 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:42 smithi171 bash[25040]: cluster 2024-09-14T00:57:40.420834+0000 mgr.a (mgr.14355) 6781 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:43.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:43.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:43.980 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:44 smithi007 bash[22722]: cluster 2024-09-14T00:57:42.421794+0000 mgr.a (mgr.14355) 6782 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:44 smithi131 bash[24745]: cluster 2024-09-14T00:57:42.421794+0000 mgr.a (mgr.14355) 6782 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:44 smithi171 bash[25040]: cluster 2024-09-14T00:57:42.421794+0000 mgr.a (mgr.14355) 6782 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:45 smithi007 bash[22722]: audit 2024-09-14T00:57:43.563579+0000 mgr.a (mgr.14355) 6783 : audit [DBG] from='client.154566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:45 smithi131 bash[24745]: audit 2024-09-14T00:57:43.563579+0000 mgr.a (mgr.14355) 6783 : audit [DBG] from='client.154566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:45 smithi171 bash[25040]: audit 2024-09-14T00:57:43.563579+0000 mgr.a (mgr.14355) 6783 : audit [DBG] from='client.154566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:46 smithi007 bash[22722]: cluster 2024-09-14T00:57:44.422827+0000 mgr.a (mgr.14355) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:46 smithi131 bash[24745]: cluster 2024-09-14T00:57:44.422827+0000 mgr.a (mgr.14355) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:46 smithi171 bash[25040]: cluster 2024-09-14T00:57:44.422827+0000 mgr.a (mgr.14355) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:48 smithi007 bash[22722]: cluster 2024-09-14T00:57:46.425120+0000 mgr.a (mgr.14355) 6785 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:48 smithi131 bash[24745]: cluster 2024-09-14T00:57:46.425120+0000 mgr.a (mgr.14355) 6785 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:48 smithi171 bash[25040]: cluster 2024-09-14T00:57:46.425120+0000 mgr.a (mgr.14355) 6785 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:49.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:50 smithi007 bash[22722]: cluster 2024-09-14T00:57:48.425882+0000 mgr.a (mgr.14355) 6786 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:50 smithi131 bash[24745]: cluster 2024-09-14T00:57:48.425882+0000 mgr.a (mgr.14355) 6786 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:50 smithi171 bash[25040]: cluster 2024-09-14T00:57:48.425882+0000 mgr.a (mgr.14355) 6786 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:51 smithi007 bash[22722]: audit 2024-09-14T00:57:49.310358+0000 mgr.a (mgr.14355) 6787 : audit [DBG] from='client.154644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:51 smithi131 bash[24745]: audit 2024-09-14T00:57:49.310358+0000 mgr.a (mgr.14355) 6787 : audit [DBG] from='client.154644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:51 smithi171 bash[25040]: audit 2024-09-14T00:57:49.310358+0000 mgr.a (mgr.14355) 6787 : audit [DBG] from='client.154644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:52 smithi007 bash[22722]: cluster 2024-09-14T00:57:50.428156+0000 mgr.a (mgr.14355) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:52 smithi131 bash[24745]: cluster 2024-09-14T00:57:50.428156+0000 mgr.a (mgr.14355) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:52 smithi171 bash[25040]: cluster 2024-09-14T00:57:50.428156+0000 mgr.a (mgr.14355) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:57:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:54 smithi007 bash[22722]: cluster 2024-09-14T00:57:52.428944+0000 mgr.a (mgr.14355) 6789 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:54 smithi131 bash[24745]: cluster 2024-09-14T00:57:52.428944+0000 mgr.a (mgr.14355) 6789 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:54 smithi171 bash[25040]: cluster 2024-09-14T00:57:52.428944+0000 mgr.a (mgr.14355) 6789 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:57:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:57:54.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:57:55.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:57:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:57:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:57:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:57:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:57:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:56 smithi007 bash[22722]: cluster 2024-09-14T00:57:54.429705+0000 mgr.a (mgr.14355) 6790 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:56.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:56 smithi007 bash[22722]: audit 2024-09-14T00:57:55.049979+0000 mgr.a (mgr.14355) 6791 : audit [DBG] from='client.154722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:56 smithi131 bash[24745]: cluster 2024-09-14T00:57:54.429705+0000 mgr.a (mgr.14355) 6790 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:56 smithi131 bash[24745]: audit 2024-09-14T00:57:55.049979+0000 mgr.a (mgr.14355) 6791 : audit [DBG] from='client.154722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:56 smithi171 bash[25040]: cluster 2024-09-14T00:57:54.429705+0000 mgr.a (mgr.14355) 6790 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:56 smithi171 bash[25040]: audit 2024-09-14T00:57:55.049979+0000 mgr.a (mgr.14355) 6791 : audit [DBG] from='client.154722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:57:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:57:58 smithi007 bash[22722]: cluster 2024-09-14T00:57:56.432459+0000 mgr.a (mgr.14355) 6792 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:57:58 smithi131 bash[24745]: cluster 2024-09-14T00:57:56.432459+0000 mgr.a (mgr.14355) 6792 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:57:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:57:58 smithi171 bash[25040]: cluster 2024-09-14T00:57:56.432459+0000 mgr.a (mgr.14355) 6792 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:00 smithi007 bash[22722]: cluster 2024-09-14T00:57:58.433232+0000 mgr.a (mgr.14355) 6793 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:00 smithi131 bash[24745]: cluster 2024-09-14T00:57:58.433232+0000 mgr.a (mgr.14355) 6793 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:00 smithi171 bash[25040]: cluster 2024-09-14T00:57:58.433232+0000 mgr.a (mgr.14355) 6793 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:01.227 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:01.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:01.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:01.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:01.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:02 smithi007 bash[22722]: cluster 2024-09-14T00:58:00.435306+0000 mgr.a (mgr.14355) 6794 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:02 smithi007 bash[22722]: audit 2024-09-14T00:58:00.802272+0000 mgr.a (mgr.14355) 6795 : audit [DBG] from='client.154800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:02 smithi131 bash[24745]: cluster 2024-09-14T00:58:00.435306+0000 mgr.a (mgr.14355) 6794 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:02 smithi131 bash[24745]: audit 2024-09-14T00:58:00.802272+0000 mgr.a (mgr.14355) 6795 : audit [DBG] from='client.154800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:02 smithi171 bash[25040]: cluster 2024-09-14T00:58:00.435306+0000 mgr.a (mgr.14355) 6794 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:02 smithi171 bash[25040]: audit 2024-09-14T00:58:00.802272+0000 mgr.a (mgr.14355) 6795 : audit [DBG] from='client.154800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:04 smithi007 bash[22722]: cluster 2024-09-14T00:58:02.436220+0000 mgr.a (mgr.14355) 6796 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:04 smithi131 bash[24745]: cluster 2024-09-14T00:58:02.436220+0000 mgr.a (mgr.14355) 6796 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:04 smithi171 bash[25040]: cluster 2024-09-14T00:58:02.436220+0000 mgr.a (mgr.14355) 6796 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:06.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:06.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:06.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:06 smithi007 bash[22722]: cluster 2024-09-14T00:58:04.437023+0000 mgr.a (mgr.14355) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:06 smithi131 bash[24745]: cluster 2024-09-14T00:58:04.437023+0000 mgr.a (mgr.14355) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:06 smithi171 bash[25040]: cluster 2024-09-14T00:58:04.437023+0000 mgr.a (mgr.14355) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:07.004 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:08 smithi007 bash[22722]: cluster 2024-09-14T00:58:06.439089+0000 mgr.a (mgr.14355) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:08 smithi007 bash[22722]: audit 2024-09-14T00:58:06.565464+0000 mgr.a (mgr.14355) 6799 : audit [DBG] from='client.154875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:08 smithi131 bash[24745]: cluster 2024-09-14T00:58:06.439089+0000 mgr.a (mgr.14355) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:08.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:08 smithi131 bash[24745]: audit 2024-09-14T00:58:06.565464+0000 mgr.a (mgr.14355) 6799 : audit [DBG] from='client.154875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:08 smithi171 bash[25040]: cluster 2024-09-14T00:58:06.439089+0000 mgr.a (mgr.14355) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:08 smithi171 bash[25040]: audit 2024-09-14T00:58:06.565464+0000 mgr.a (mgr.14355) 6799 : audit [DBG] from='client.154875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:10 smithi007 bash[22722]: cluster 2024-09-14T00:58:08.440005+0000 mgr.a (mgr.14355) 6800 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:10 smithi131 bash[24745]: cluster 2024-09-14T00:58:08.440005+0000 mgr.a (mgr.14355) 6800 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:10 smithi171 bash[25040]: cluster 2024-09-14T00:58:08.440005+0000 mgr.a (mgr.14355) 6800 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:12.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:12.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:12.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:12.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:12 smithi007 bash[22722]: cluster 2024-09-14T00:58:10.442166+0000 mgr.a (mgr.14355) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:12 smithi131 bash[24745]: cluster 2024-09-14T00:58:10.442166+0000 mgr.a (mgr.14355) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:12 smithi171 bash[25040]: cluster 2024-09-14T00:58:10.442166+0000 mgr.a (mgr.14355) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:12.783 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:14 smithi007 bash[22722]: audit 2024-09-14T00:58:12.345633+0000 mgr.a (mgr.14355) 6802 : audit [DBG] from='client.154953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:14 smithi007 bash[22722]: cluster 2024-09-14T00:58:12.442723+0000 mgr.a (mgr.14355) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:14 smithi131 bash[24745]: audit 2024-09-14T00:58:12.345633+0000 mgr.a (mgr.14355) 6802 : audit [DBG] from='client.154953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:14 smithi131 bash[24745]: cluster 2024-09-14T00:58:12.442723+0000 mgr.a (mgr.14355) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:14 smithi171 bash[25040]: audit 2024-09-14T00:58:12.345633+0000 mgr.a (mgr.14355) 6802 : audit [DBG] from='client.154953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:14 smithi171 bash[25040]: cluster 2024-09-14T00:58:12.442723+0000 mgr.a (mgr.14355) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:15 smithi007 bash[22722]: audit 2024-09-14T00:58:14.776588+0000 mon.a (mon.0) 1618 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:58:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:15 smithi131 bash[24745]: audit 2024-09-14T00:58:14.776588+0000 mon.a (mon.0) 1618 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:58:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:15 smithi171 bash[25040]: audit 2024-09-14T00:58:14.776588+0000 mon.a (mon.0) 1618 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:58:16.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22972]: debug 2024-09-14T00:58:16.391+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:58:16.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22972]: debug 2024-09-14T00:58:16.391+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:58:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22722]: cluster 2024-09-14T00:58:14.443606+0000 mgr.a (mgr.14355) 6804 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22722]: audit 2024-09-14T00:58:15.642741+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:58:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22722]: audit 2024-09-14T00:58:15.644106+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:58:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22722]: audit 2024-09-14T00:58:15.654332+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:58:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:16 smithi007 bash[22722]: audit 2024-09-14T00:58:15.659645+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:16.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:16 smithi131 bash[24745]: cluster 2024-09-14T00:58:14.443606+0000 mgr.a (mgr.14355) 6804 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:16.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:16 smithi131 bash[24745]: audit 2024-09-14T00:58:15.642741+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:58:16.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:16 smithi131 bash[24745]: audit 2024-09-14T00:58:15.644106+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:58:16.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:16 smithi131 bash[24745]: audit 2024-09-14T00:58:15.654332+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:58:16.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:16 smithi131 bash[24745]: audit 2024-09-14T00:58:15.659645+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:16 smithi171 bash[25040]: cluster 2024-09-14T00:58:14.443606+0000 mgr.a (mgr.14355) 6804 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:16 smithi171 bash[25040]: audit 2024-09-14T00:58:15.642741+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:58:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:16 smithi171 bash[25040]: audit 2024-09-14T00:58:15.644106+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:58:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:16 smithi171 bash[25040]: audit 2024-09-14T00:58:15.654332+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:58:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:16 smithi171 bash[25040]: audit 2024-09-14T00:58:15.659645+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:17 smithi007 bash[22722]: audit 2024-09-14T00:58:15.661266+0000 mgr.a (mgr.14355) 6805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:17 smithi131 bash[24745]: audit 2024-09-14T00:58:15.661266+0000 mgr.a (mgr.14355) 6805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:17 smithi171 bash[25040]: audit 2024-09-14T00:58:15.661266+0000 mgr.a (mgr.14355) 6805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:58:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:18 smithi007 bash[22722]: audit 2024-09-14T00:58:16.396028+0000 mgr.a (mgr.14355) 6806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:58:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:18 smithi007 bash[22722]: cephadm 2024-09-14T00:58:16.397224+0000 mgr.a (mgr.14355) 6807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:58:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:18 smithi007 bash[22722]: cluster 2024-09-14T00:58:16.445005+0000 mgr.a (mgr.14355) 6808 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:18 smithi131 bash[24745]: audit 2024-09-14T00:58:16.396028+0000 mgr.a (mgr.14355) 6806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:58:18.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:18 smithi131 bash[24745]: cephadm 2024-09-14T00:58:16.397224+0000 mgr.a (mgr.14355) 6807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:58:18.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:18 smithi131 bash[24745]: cluster 2024-09-14T00:58:16.445005+0000 mgr.a (mgr.14355) 6808 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:18.535 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:18.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:18.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:18 smithi171 bash[25040]: audit 2024-09-14T00:58:16.396028+0000 mgr.a (mgr.14355) 6806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:58:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:18 smithi171 bash[25040]: cephadm 2024-09-14T00:58:16.397224+0000 mgr.a (mgr.14355) 6807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:58:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:18 smithi171 bash[25040]: cluster 2024-09-14T00:58:16.445005+0000 mgr.a (mgr.14355) 6808 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:19 smithi007 bash[22722]: audit 2024-09-14T00:58:18.124020+0000 mgr.a (mgr.14355) 6809 : audit [DBG] from='client.155133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:19 smithi131 bash[24745]: audit 2024-09-14T00:58:18.124020+0000 mgr.a (mgr.14355) 6809 : audit [DBG] from='client.155133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:19 smithi171 bash[25040]: audit 2024-09-14T00:58:18.124020+0000 mgr.a (mgr.14355) 6809 : audit [DBG] from='client.155133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:20 smithi007 bash[22722]: cluster 2024-09-14T00:58:18.445579+0000 mgr.a (mgr.14355) 6810 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:20 smithi131 bash[24745]: cluster 2024-09-14T00:58:18.445579+0000 mgr.a (mgr.14355) 6810 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:20 smithi171 bash[25040]: cluster 2024-09-14T00:58:18.445579+0000 mgr.a (mgr.14355) 6810 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:22 smithi007 bash[22722]: cluster 2024-09-14T00:58:20.447753+0000 mgr.a (mgr.14355) 6811 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:22 smithi131 bash[24745]: cluster 2024-09-14T00:58:20.447753+0000 mgr.a (mgr.14355) 6811 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:22 smithi171 bash[25040]: cluster 2024-09-14T00:58:20.447753+0000 mgr.a (mgr.14355) 6811 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:24.281 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:24.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:24.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:24.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:24.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:24 smithi007 bash[22722]: cluster 2024-09-14T00:58:22.448535+0000 mgr.a (mgr.14355) 6812 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:24 smithi131 bash[24745]: cluster 2024-09-14T00:58:22.448535+0000 mgr.a (mgr.14355) 6812 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:24 smithi171 bash[25040]: cluster 2024-09-14T00:58:22.448535+0000 mgr.a (mgr.14355) 6812 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:25 smithi007 bash[22722]: audit 2024-09-14T00:58:23.864036+0000 mgr.a (mgr.14355) 6813 : audit [DBG] from='client.155208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:25 smithi131 bash[24745]: audit 2024-09-14T00:58:23.864036+0000 mgr.a (mgr.14355) 6813 : audit [DBG] from='client.155208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:25 smithi171 bash[25040]: audit 2024-09-14T00:58:23.864036+0000 mgr.a (mgr.14355) 6813 : audit [DBG] from='client.155208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:26 smithi007 bash[22722]: cluster 2024-09-14T00:58:24.449481+0000 mgr.a (mgr.14355) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:26 smithi131 bash[24745]: cluster 2024-09-14T00:58:24.449481+0000 mgr.a (mgr.14355) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:26 smithi171 bash[25040]: cluster 2024-09-14T00:58:24.449481+0000 mgr.a (mgr.14355) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:28 smithi131 bash[24745]: cluster 2024-09-14T00:58:26.451804+0000 mgr.a (mgr.14355) 6815 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:28 smithi171 bash[25040]: cluster 2024-09-14T00:58:26.451804+0000 mgr.a (mgr.14355) 6815 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:28 smithi007 bash[22722]: cluster 2024-09-14T00:58:26.451804+0000 mgr.a (mgr.14355) 6815 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:29.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:29.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:29.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:30.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:30.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:30 smithi131 bash[24745]: cluster 2024-09-14T00:58:28.452612+0000 mgr.a (mgr.14355) 6816 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:30 smithi171 bash[25040]: cluster 2024-09-14T00:58:28.452612+0000 mgr.a (mgr.14355) 6816 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:30 smithi007 bash[22722]: cluster 2024-09-14T00:58:28.452612+0000 mgr.a (mgr.14355) 6816 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:31 smithi131 bash[24745]: audit 2024-09-14T00:58:29.620140+0000 mgr.a (mgr.14355) 6817 : audit [DBG] from='client.155286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:31 smithi171 bash[25040]: audit 2024-09-14T00:58:29.620140+0000 mgr.a (mgr.14355) 6817 : audit [DBG] from='client.155286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:31 smithi007 bash[22722]: audit 2024-09-14T00:58:29.620140+0000 mgr.a (mgr.14355) 6817 : audit [DBG] from='client.155286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:32 smithi131 bash[24745]: cluster 2024-09-14T00:58:30.454912+0000 mgr.a (mgr.14355) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:32 smithi171 bash[25040]: cluster 2024-09-14T00:58:30.454912+0000 mgr.a (mgr.14355) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:32 smithi007 bash[22722]: cluster 2024-09-14T00:58:30.454912+0000 mgr.a (mgr.14355) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:58:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:33 smithi131 bash[24745]: cluster 2024-09-14T00:58:32.455700+0000 mgr.a (mgr.14355) 6819 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:33 smithi171 bash[25040]: cluster 2024-09-14T00:58:32.455700+0000 mgr.a (mgr.14355) 6819 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:33 smithi007 bash[22722]: cluster 2024-09-14T00:58:32.455700+0000 mgr.a (mgr.14355) 6819 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:35.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:35 smithi131 bash[24745]: cluster 2024-09-14T00:58:34.456478+0000 mgr.a (mgr.14355) 6820 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:35 smithi171 bash[25040]: cluster 2024-09-14T00:58:34.456478+0000 mgr.a (mgr.14355) 6820 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:35.835 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:35.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:35.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:35.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:35.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:35 smithi007 bash[22722]: cluster 2024-09-14T00:58:34.456478+0000 mgr.a (mgr.14355) 6820 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:36 smithi131 bash[24745]: audit 2024-09-14T00:58:35.391500+0000 mgr.a (mgr.14355) 6821 : audit [DBG] from='client.155361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:36 smithi171 bash[25040]: audit 2024-09-14T00:58:35.391500+0000 mgr.a (mgr.14355) 6821 : audit [DBG] from='client.155361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:36 smithi007 bash[22722]: audit 2024-09-14T00:58:35.391500+0000 mgr.a (mgr.14355) 6821 : audit [DBG] from='client.155361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:37 smithi131 bash[24745]: cluster 2024-09-14T00:58:36.459268+0000 mgr.a (mgr.14355) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:37 smithi171 bash[25040]: cluster 2024-09-14T00:58:36.459268+0000 mgr.a (mgr.14355) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:37 smithi007 bash[22722]: cluster 2024-09-14T00:58:36.459268+0000 mgr.a (mgr.14355) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:39 smithi131 bash[24745]: cluster 2024-09-14T00:58:38.460175+0000 mgr.a (mgr.14355) 6823 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:39 smithi171 bash[25040]: cluster 2024-09-14T00:58:38.460175+0000 mgr.a (mgr.14355) 6823 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:39 smithi007 bash[22722]: cluster 2024-09-14T00:58:38.460175+0000 mgr.a (mgr.14355) 6823 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:40.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:40.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:41.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:41.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:41 smithi131 bash[24745]: cluster 2024-09-14T00:58:40.462274+0000 mgr.a (mgr.14355) 6824 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:41 smithi131 bash[24745]: audit 2024-09-14T00:58:41.173587+0000 mgr.a (mgr.14355) 6825 : audit [DBG] from='client.155439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:41 smithi171 bash[25040]: cluster 2024-09-14T00:58:40.462274+0000 mgr.a (mgr.14355) 6824 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:41 smithi171 bash[25040]: audit 2024-09-14T00:58:41.173587+0000 mgr.a (mgr.14355) 6825 : audit [DBG] from='client.155439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:41 smithi007 bash[22722]: cluster 2024-09-14T00:58:40.462274+0000 mgr.a (mgr.14355) 6824 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:41 smithi007 bash[22722]: audit 2024-09-14T00:58:41.173587+0000 mgr.a (mgr.14355) 6825 : audit [DBG] from='client.155439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:43 smithi171 bash[25040]: cluster 2024-09-14T00:58:42.463135+0000 mgr.a (mgr.14355) 6826 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:43 smithi007 bash[22722]: cluster 2024-09-14T00:58:42.463135+0000 mgr.a (mgr.14355) 6826 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:43 smithi131 bash[24745]: cluster 2024-09-14T00:58:42.463135+0000 mgr.a (mgr.14355) 6826 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:58:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:45 smithi171 bash[25040]: cluster 2024-09-14T00:58:44.463914+0000 mgr.a (mgr.14355) 6827 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:45 smithi007 bash[22722]: cluster 2024-09-14T00:58:44.463914+0000 mgr.a (mgr.14355) 6827 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:45 smithi131 bash[24745]: cluster 2024-09-14T00:58:44.463914+0000 mgr.a (mgr.14355) 6827 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:58:46.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:46.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:47.376 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:47.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:47 smithi007 bash[22722]: cluster 2024-09-14T00:58:46.466149+0000 mgr.a (mgr.14355) 6828 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:47 smithi007 bash[22722]: audit 2024-09-14T00:58:46.944627+0000 mgr.a (mgr.14355) 6829 : audit [DBG] from='client.155514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:47 smithi131 bash[24745]: cluster 2024-09-14T00:58:46.466149+0000 mgr.a (mgr.14355) 6828 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:47 smithi131 bash[24745]: audit 2024-09-14T00:58:46.944627+0000 mgr.a (mgr.14355) 6829 : audit [DBG] from='client.155514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:47 smithi171 bash[25040]: cluster 2024-09-14T00:58:46.466149+0000 mgr.a (mgr.14355) 6828 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:47 smithi171 bash[25040]: audit 2024-09-14T00:58:46.944627+0000 mgr.a (mgr.14355) 6829 : audit [DBG] from='client.155514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:49 smithi007 bash[22722]: cluster 2024-09-14T00:58:48.467035+0000 mgr.a (mgr.14355) 6830 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:49 smithi131 bash[24745]: cluster 2024-09-14T00:58:48.467035+0000 mgr.a (mgr.14355) 6830 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:49 smithi171 bash[25040]: cluster 2024-09-14T00:58:48.467035+0000 mgr.a (mgr.14355) 6830 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:51 smithi007 bash[22722]: cluster 2024-09-14T00:58:50.469186+0000 mgr.a (mgr.14355) 6831 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:51 smithi131 bash[24745]: cluster 2024-09-14T00:58:50.469186+0000 mgr.a (mgr.14355) 6831 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:51 smithi171 bash[25040]: cluster 2024-09-14T00:58:50.469186+0000 mgr.a (mgr.14355) 6831 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:52.378 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:53.149 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:53.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:53.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:53.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:53.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:58:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:53 smithi007 bash[22722]: cluster 2024-09-14T00:58:52.469755+0000 mgr.a (mgr.14355) 6832 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:53 smithi007 bash[22722]: audit 2024-09-14T00:58:52.710531+0000 mgr.a (mgr.14355) 6833 : audit [DBG] from='client.155592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:53 smithi131 bash[24745]: cluster 2024-09-14T00:58:52.469755+0000 mgr.a (mgr.14355) 6832 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:53 smithi131 bash[24745]: audit 2024-09-14T00:58:52.710531+0000 mgr.a (mgr.14355) 6833 : audit [DBG] from='client.155592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:53 smithi171 bash[25040]: cluster 2024-09-14T00:58:52.469755+0000 mgr.a (mgr.14355) 6832 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:53 smithi171 bash[25040]: audit 2024-09-14T00:58:52.710531+0000 mgr.a (mgr.14355) 6833 : audit [DBG] from='client.155592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:58:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:55 smithi007 bash[22722]: cluster 2024-09-14T00:58:54.470662+0000 mgr.a (mgr.14355) 6834 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:55 smithi131 bash[24745]: cluster 2024-09-14T00:58:54.470662+0000 mgr.a (mgr.14355) 6834 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:55 smithi171 bash[25040]: cluster 2024-09-14T00:58:54.470662+0000 mgr.a (mgr.14355) 6834 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:58:58.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:58:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:58:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:58:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:57 smithi007 bash[22722]: cluster 2024-09-14T00:58:56.472902+0000 mgr.a (mgr.14355) 6835 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:57 smithi131 bash[24745]: cluster 2024-09-14T00:58:56.472902+0000 mgr.a (mgr.14355) 6835 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:57 smithi171 bash[25040]: cluster 2024-09-14T00:58:56.472902+0000 mgr.a (mgr.14355) 6835 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:58:58.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:58:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:58:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:58:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:58:58.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:59 smithi007 bash[22722]: cluster 2024-09-14T00:58:58.473600+0000 mgr.a (mgr.14355) 6836 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:58:59 smithi007 bash[22722]: audit 2024-09-14T00:58:58.487592+0000 mgr.a (mgr.14355) 6837 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:59 smithi131 bash[24745]: cluster 2024-09-14T00:58:58.473600+0000 mgr.a (mgr.14355) 6836 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:58:59 smithi131 bash[24745]: audit 2024-09-14T00:58:58.487592+0000 mgr.a (mgr.14355) 6837 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:59 smithi171 bash[25040]: cluster 2024-09-14T00:58:58.473600+0000 mgr.a (mgr.14355) 6836 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:58:59 smithi171 bash[25040]: audit 2024-09-14T00:58:58.487592+0000 mgr.a (mgr.14355) 6837 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:01 smithi007 bash[22722]: cluster 2024-09-14T00:59:00.475884+0000 mgr.a (mgr.14355) 6838 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:01 smithi131 bash[24745]: cluster 2024-09-14T00:59:00.475884+0000 mgr.a (mgr.14355) 6838 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:01 smithi171 bash[25040]: cluster 2024-09-14T00:59:00.475884+0000 mgr.a (mgr.14355) 6838 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:03.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:03.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:03.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:03 smithi007 bash[22722]: cluster 2024-09-14T00:59:02.476693+0000 mgr.a (mgr.14355) 6839 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:03 smithi131 bash[24745]: cluster 2024-09-14T00:59:02.476693+0000 mgr.a (mgr.14355) 6839 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:03 smithi171 bash[25040]: cluster 2024-09-14T00:59:02.476693+0000 mgr.a (mgr.14355) 6839 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:04.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:04.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:04.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:04.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:04.718 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:05 smithi007 bash[22722]: audit 2024-09-14T00:59:04.277838+0000 mgr.a (mgr.14355) 6840 : audit [DBG] from='client.155742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:05 smithi007 bash[22722]: cluster 2024-09-14T00:59:04.477155+0000 mgr.a (mgr.14355) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:05 smithi131 bash[24745]: audit 2024-09-14T00:59:04.277838+0000 mgr.a (mgr.14355) 6840 : audit [DBG] from='client.155742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:05 smithi131 bash[24745]: cluster 2024-09-14T00:59:04.477155+0000 mgr.a (mgr.14355) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:05 smithi171 bash[25040]: audit 2024-09-14T00:59:04.277838+0000 mgr.a (mgr.14355) 6840 : audit [DBG] from='client.155742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:06.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:05 smithi171 bash[25040]: cluster 2024-09-14T00:59:04.477155+0000 mgr.a (mgr.14355) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:07 smithi007 bash[22722]: cluster 2024-09-14T00:59:06.479575+0000 mgr.a (mgr.14355) 6842 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:07 smithi131 bash[24745]: cluster 2024-09-14T00:59:06.479575+0000 mgr.a (mgr.14355) 6842 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:07 smithi171 bash[25040]: cluster 2024-09-14T00:59:06.479575+0000 mgr.a (mgr.14355) 6842 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:09 smithi007 bash[22722]: cluster 2024-09-14T00:59:08.480375+0000 mgr.a (mgr.14355) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:09 smithi131 bash[24745]: cluster 2024-09-14T00:59:08.480375+0000 mgr.a (mgr.14355) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:09 smithi171 bash[25040]: cluster 2024-09-14T00:59:08.480375+0000 mgr.a (mgr.14355) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:10.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:10 smithi131 bash[24745]: audit 2024-09-14T00:59:10.054879+0000 mgr.a (mgr.14355) 6844 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:10 smithi171 bash[25040]: audit 2024-09-14T00:59:10.054879+0000 mgr.a (mgr.14355) 6844 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:10 smithi007 bash[22722]: audit 2024-09-14T00:59:10.054879+0000 mgr.a (mgr.14355) 6844 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:11 smithi131 bash[24745]: cluster 2024-09-14T00:59:10.481629+0000 mgr.a (mgr.14355) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:11 smithi171 bash[25040]: cluster 2024-09-14T00:59:10.481629+0000 mgr.a (mgr.14355) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:11 smithi007 bash[22722]: cluster 2024-09-14T00:59:10.481629+0000 mgr.a (mgr.14355) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:13 smithi131 bash[24745]: cluster 2024-09-14T00:59:12.482540+0000 mgr.a (mgr.14355) 6846 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:13 smithi171 bash[25040]: cluster 2024-09-14T00:59:12.482540+0000 mgr.a (mgr.14355) 6846 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:13 smithi007 bash[22722]: cluster 2024-09-14T00:59:12.482540+0000 mgr.a (mgr.14355) 6846 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:15.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:15.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:16.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:15 smithi131 bash[24745]: cluster 2024-09-14T00:59:14.483371+0000 mgr.a (mgr.14355) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:15 smithi171 bash[25040]: cluster 2024-09-14T00:59:14.483371+0000 mgr.a (mgr.14355) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:15 smithi007 bash[22722]: cluster 2024-09-14T00:59:14.483371+0000 mgr.a (mgr.14355) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T00:59:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:16 smithi131 bash[24745]: audit 2024-09-14T00:59:15.832500+0000 mgr.a (mgr.14355) 6848 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:16 smithi131 bash[24745]: audit 2024-09-14T00:59:16.446655+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:59:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:16 smithi171 bash[25040]: audit 2024-09-14T00:59:15.832500+0000 mgr.a (mgr.14355) 6848 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:16 smithi171 bash[25040]: audit 2024-09-14T00:59:16.446655+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:59:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:16 smithi007 bash[22722]: audit 2024-09-14T00:59:15.832500+0000 mgr.a (mgr.14355) 6848 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:16 smithi007 bash[22722]: audit 2024-09-14T00:59:16.446655+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T00:59:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:17 smithi131 bash[24745]: cluster 2024-09-14T00:59:16.486137+0000 mgr.a (mgr.14355) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:17 smithi171 bash[25040]: cluster 2024-09-14T00:59:16.486137+0000 mgr.a (mgr.14355) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:17 smithi007 bash[22722]: cluster 2024-09-14T00:59:16.486137+0000 mgr.a (mgr.14355) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:19 smithi131 bash[24745]: cluster 2024-09-14T00:59:18.486936+0000 mgr.a (mgr.14355) 6850 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:19 smithi171 bash[25040]: cluster 2024-09-14T00:59:18.486936+0000 mgr.a (mgr.14355) 6850 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:19 smithi007 bash[22722]: cluster 2024-09-14T00:59:18.486936+0000 mgr.a (mgr.14355) 6850 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:22.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: cluster 2024-09-14T00:59:20.488864+0000 mgr.a (mgr.14355) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.789977+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.794905+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.800535+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.806759+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.814534+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:21 smithi131 bash[24745]: audit 2024-09-14T00:59:21.819701+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: cluster 2024-09-14T00:59:20.488864+0000 mgr.a (mgr.14355) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.789977+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.794905+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.800535+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.806759+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.814534+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:21 smithi171 bash[25040]: audit 2024-09-14T00:59:21.819701+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: cluster 2024-09-14T00:59:20.488864+0000 mgr.a (mgr.14355) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.789977+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.794905+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.800535+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.806759+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.814534+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:21 smithi007 bash[22722]: audit 2024-09-14T00:59:21.819701+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:22 smithi131 bash[24745]: audit 2024-09-14T00:59:21.610172+0000 mgr.a (mgr.14355) 6852 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:22 smithi131 bash[24745]: audit 2024-09-14T00:59:22.563741+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:59:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:22 smithi131 bash[24745]: audit 2024-09-14T00:59:22.565034+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:59:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:22 smithi131 bash[24745]: audit 2024-09-14T00:59:22.574902+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:22 smithi131 bash[24745]: audit 2024-09-14T00:59:22.577818+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:22 smithi171 bash[25040]: audit 2024-09-14T00:59:21.610172+0000 mgr.a (mgr.14355) 6852 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:22 smithi171 bash[25040]: audit 2024-09-14T00:59:22.563741+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:59:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:22 smithi171 bash[25040]: audit 2024-09-14T00:59:22.565034+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:59:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:22 smithi171 bash[25040]: audit 2024-09-14T00:59:22.574902+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:22 smithi171 bash[25040]: audit 2024-09-14T00:59:22.577818+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:23.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:22 smithi007 bash[22722]: audit 2024-09-14T00:59:21.610172+0000 mgr.a (mgr.14355) 6852 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:23.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:22 smithi007 bash[22722]: audit 2024-09-14T00:59:22.563741+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T00:59:23.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:22 smithi007 bash[22722]: audit 2024-09-14T00:59:22.565034+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T00:59:23.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:22 smithi007 bash[22722]: audit 2024-09-14T00:59:22.574902+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T00:59:23.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:22 smithi007 bash[22722]: audit 2024-09-14T00:59:22.577818+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:59:23 smithi007 bash[22972]: debug 2024-09-14T00:59:23.294+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:59:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 00:59:23 smithi007 bash[22972]: debug 2024-09-14T00:59:23.298+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:59:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:23 smithi131 bash[24745]: cluster 2024-09-14T00:59:22.489748+0000 mgr.a (mgr.14355) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:23 smithi131 bash[24745]: audit 2024-09-14T00:59:22.579203+0000 mgr.a (mgr.14355) 6854 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:23 smithi171 bash[25040]: cluster 2024-09-14T00:59:22.489748+0000 mgr.a (mgr.14355) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:23 smithi171 bash[25040]: audit 2024-09-14T00:59:22.579203+0000 mgr.a (mgr.14355) 6854 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:23 smithi007 bash[22722]: cluster 2024-09-14T00:59:22.489748+0000 mgr.a (mgr.14355) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:23 smithi007 bash[22722]: audit 2024-09-14T00:59:22.579203+0000 mgr.a (mgr.14355) 6854 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T00:59:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:25 smithi131 bash[24745]: audit 2024-09-14T00:59:23.301756+0000 mgr.a (mgr.14355) 6855 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:59:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:25 smithi131 bash[24745]: cephadm 2024-09-14T00:59:23.303148+0000 mgr.a (mgr.14355) 6856 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:59:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:25 smithi171 bash[25040]: audit 2024-09-14T00:59:23.301756+0000 mgr.a (mgr.14355) 6855 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:59:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:25 smithi171 bash[25040]: cephadm 2024-09-14T00:59:23.303148+0000 mgr.a (mgr.14355) 6856 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:59:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:25 smithi007 bash[22722]: audit 2024-09-14T00:59:23.301756+0000 mgr.a (mgr.14355) 6855 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T00:59:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:25 smithi007 bash[22722]: cephadm 2024-09-14T00:59:23.303148+0000 mgr.a (mgr.14355) 6856 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T00:59:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:26 smithi131 bash[24745]: cluster 2024-09-14T00:59:24.490731+0000 mgr.a (mgr.14355) 6857 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:26 smithi171 bash[25040]: cluster 2024-09-14T00:59:24.490731+0000 mgr.a (mgr.14355) 6857 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:26 smithi007 bash[22722]: cluster 2024-09-14T00:59:24.490731+0000 mgr.a (mgr.14355) 6857 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:27.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:27.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:27.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:27.821 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:27.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:27.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:28 smithi131 bash[24745]: cluster 2024-09-14T00:59:26.492996+0000 mgr.a (mgr.14355) 6858 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:28 smithi171 bash[25040]: cluster 2024-09-14T00:59:26.492996+0000 mgr.a (mgr.14355) 6858 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:28 smithi007 bash[22722]: cluster 2024-09-14T00:59:26.492996+0000 mgr.a (mgr.14355) 6858 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:29 smithi131 bash[24745]: audit 2024-09-14T00:59:27.383276+0000 mgr.a (mgr.14355) 6859 : audit [DBG] from='client.156147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:29 smithi171 bash[25040]: audit 2024-09-14T00:59:27.383276+0000 mgr.a (mgr.14355) 6859 : audit [DBG] from='client.156147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:29 smithi007 bash[22722]: audit 2024-09-14T00:59:27.383276+0000 mgr.a (mgr.14355) 6859 : audit [DBG] from='client.156147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:30 smithi131 bash[24745]: cluster 2024-09-14T00:59:28.493958+0000 mgr.a (mgr.14355) 6860 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:30 smithi171 bash[25040]: cluster 2024-09-14T00:59:28.493958+0000 mgr.a (mgr.14355) 6860 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:30 smithi007 bash[22722]: cluster 2024-09-14T00:59:28.493958+0000 mgr.a (mgr.14355) 6860 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:32 smithi131 bash[24745]: cluster 2024-09-14T00:59:30.496100+0000 mgr.a (mgr.14355) 6861 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:32 smithi171 bash[25040]: cluster 2024-09-14T00:59:30.496100+0000 mgr.a (mgr.14355) 6861 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:32 smithi007 bash[22722]: cluster 2024-09-14T00:59:30.496100+0000 mgr.a (mgr.14355) 6861 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:32.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:32.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:32.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:33.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:33.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:33.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:33.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:33.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:34 smithi171 bash[25040]: cluster 2024-09-14T00:59:32.496883+0000 mgr.a (mgr.14355) 6862 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:34 smithi171 bash[25040]: audit 2024-09-14T00:59:33.159547+0000 mgr.a (mgr.14355) 6863 : audit [DBG] from='client.156225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:34 smithi007 bash[22722]: cluster 2024-09-14T00:59:32.496883+0000 mgr.a (mgr.14355) 6862 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:34 smithi007 bash[22722]: audit 2024-09-14T00:59:33.159547+0000 mgr.a (mgr.14355) 6863 : audit [DBG] from='client.156225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:34 smithi131 bash[24745]: cluster 2024-09-14T00:59:32.496883+0000 mgr.a (mgr.14355) 6862 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:34 smithi131 bash[24745]: audit 2024-09-14T00:59:33.159547+0000 mgr.a (mgr.14355) 6863 : audit [DBG] from='client.156225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:36 smithi171 bash[25040]: cluster 2024-09-14T00:59:34.497872+0000 mgr.a (mgr.14355) 6864 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:36 smithi007 bash[22722]: cluster 2024-09-14T00:59:34.497872+0000 mgr.a (mgr.14355) 6864 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:36 smithi131 bash[24745]: cluster 2024-09-14T00:59:34.497872+0000 mgr.a (mgr.14355) 6864 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:38 smithi171 bash[25040]: cluster 2024-09-14T00:59:36.500206+0000 mgr.a (mgr.14355) 6865 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:38 smithi007 bash[22722]: cluster 2024-09-14T00:59:36.500206+0000 mgr.a (mgr.14355) 6865 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:38 smithi131 bash[24745]: cluster 2024-09-14T00:59:36.500206+0000 mgr.a (mgr.14355) 6865 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T00:59:38.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:38.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:38.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:39.360 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:40 smithi007 bash[22722]: cluster 2024-09-14T00:59:38.500988+0000 mgr.a (mgr.14355) 6866 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:40 smithi007 bash[22722]: audit 2024-09-14T00:59:38.934317+0000 mgr.a (mgr.14355) 6867 : audit [DBG] from='client.156303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:40 smithi131 bash[24745]: cluster 2024-09-14T00:59:38.500988+0000 mgr.a (mgr.14355) 6866 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:40 smithi131 bash[24745]: audit 2024-09-14T00:59:38.934317+0000 mgr.a (mgr.14355) 6867 : audit [DBG] from='client.156303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:40 smithi171 bash[25040]: cluster 2024-09-14T00:59:38.500988+0000 mgr.a (mgr.14355) 6866 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:40 smithi171 bash[25040]: audit 2024-09-14T00:59:38.934317+0000 mgr.a (mgr.14355) 6867 : audit [DBG] from='client.156303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:42 smithi007 bash[22722]: cluster 2024-09-14T00:59:40.503347+0000 mgr.a (mgr.14355) 6868 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:42 smithi131 bash[24745]: cluster 2024-09-14T00:59:40.503347+0000 mgr.a (mgr.14355) 6868 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:42 smithi171 bash[25040]: cluster 2024-09-14T00:59:40.503347+0000 mgr.a (mgr.14355) 6868 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:44.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:44.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:44 smithi007 bash[22722]: cluster 2024-09-14T00:59:42.504150+0000 mgr.a (mgr.14355) 6869 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:44 smithi131 bash[24745]: cluster 2024-09-14T00:59:42.504150+0000 mgr.a (mgr.14355) 6869 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:44 smithi171 bash[25040]: cluster 2024-09-14T00:59:42.504150+0000 mgr.a (mgr.14355) 6869 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:45.119 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:45.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:46 smithi007 bash[22722]: cluster 2024-09-14T00:59:44.504723+0000 mgr.a (mgr.14355) 6870 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:46 smithi007 bash[22722]: audit 2024-09-14T00:59:44.692701+0000 mgr.a (mgr.14355) 6871 : audit [DBG] from='client.156378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:46 smithi131 bash[24745]: cluster 2024-09-14T00:59:44.504723+0000 mgr.a (mgr.14355) 6870 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:46 smithi131 bash[24745]: audit 2024-09-14T00:59:44.692701+0000 mgr.a (mgr.14355) 6871 : audit [DBG] from='client.156378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:46 smithi171 bash[25040]: cluster 2024-09-14T00:59:44.504723+0000 mgr.a (mgr.14355) 6870 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:46 smithi171 bash[25040]: audit 2024-09-14T00:59:44.692701+0000 mgr.a (mgr.14355) 6871 : audit [DBG] from='client.156378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:48 smithi007 bash[22722]: cluster 2024-09-14T00:59:46.507170+0000 mgr.a (mgr.14355) 6872 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:48 smithi131 bash[24745]: cluster 2024-09-14T00:59:46.507170+0000 mgr.a (mgr.14355) 6872 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:48 smithi171 bash[25040]: cluster 2024-09-14T00:59:46.507170+0000 mgr.a (mgr.14355) 6872 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T00:59:50.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:50.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:50 smithi007 bash[22722]: cluster 2024-09-14T00:59:48.507959+0000 mgr.a (mgr.14355) 6873 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:50 smithi131 bash[24745]: cluster 2024-09-14T00:59:48.507959+0000 mgr.a (mgr.14355) 6873 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:50 smithi171 bash[25040]: cluster 2024-09-14T00:59:48.507959+0000 mgr.a (mgr.14355) 6873 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:50.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:50.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:50.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:50.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:52 smithi007 bash[22722]: audit 2024-09-14T00:59:50.455323+0000 mgr.a (mgr.14355) 6874 : audit [DBG] from='client.156453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:52 smithi007 bash[22722]: cluster 2024-09-14T00:59:50.510996+0000 mgr.a (mgr.14355) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:52 smithi131 bash[24745]: audit 2024-09-14T00:59:50.455323+0000 mgr.a (mgr.14355) 6874 : audit [DBG] from='client.156453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:52 smithi131 bash[24745]: cluster 2024-09-14T00:59:50.510996+0000 mgr.a (mgr.14355) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:52 smithi171 bash[25040]: audit 2024-09-14T00:59:50.455323+0000 mgr.a (mgr.14355) 6874 : audit [DBG] from='client.156453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:52 smithi171 bash[25040]: cluster 2024-09-14T00:59:50.510996+0000 mgr.a (mgr.14355) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:54 smithi007 bash[22722]: cluster 2024-09-14T00:59:52.511940+0000 mgr.a (mgr.14355) 6876 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:54 smithi131 bash[24745]: cluster 2024-09-14T00:59:52.511940+0000 mgr.a (mgr.14355) 6876 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:54 smithi171 bash[25040]: cluster 2024-09-14T00:59:52.511940+0000 mgr.a (mgr.14355) 6876 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:55.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T00:59:55.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T00:59:55.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T00:59:56.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:56 smithi007 bash[22722]: cluster 2024-09-14T00:59:54.512764+0000 mgr.a (mgr.14355) 6877 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:56 smithi131 bash[24745]: cluster 2024-09-14T00:59:54.512764+0000 mgr.a (mgr.14355) 6877 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:56 smithi171 bash[25040]: cluster 2024-09-14T00:59:54.512764+0000 mgr.a (mgr.14355) 6877 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T00:59:56.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T00:59:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T00:59:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T00:59:56.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T00:59:56.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T00:59:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:57 smithi007 bash[22722]: audit 2024-09-14T00:59:56.223269+0000 mgr.a (mgr.14355) 6878 : audit [DBG] from='client.156531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:57 smithi131 bash[24745]: audit 2024-09-14T00:59:56.223269+0000 mgr.a (mgr.14355) 6878 : audit [DBG] from='client.156531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:57 smithi171 bash[25040]: audit 2024-09-14T00:59:56.223269+0000 mgr.a (mgr.14355) 6878 : audit [DBG] from='client.156531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T00:59:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 00:59:58 smithi007 bash[22722]: cluster 2024-09-14T00:59:56.514283+0000 mgr.a (mgr.14355) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 00:59:58 smithi131 bash[24745]: cluster 2024-09-14T00:59:56.514283+0000 mgr.a (mgr.14355) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T00:59:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 00:59:58 smithi171 bash[25040]: cluster 2024-09-14T00:59:56.514283+0000 mgr.a (mgr.14355) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:00 smithi007 bash[22722]: cluster 2024-09-14T00:59:58.515133+0000 mgr.a (mgr.14355) 6880 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:00:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:00 smithi007 bash[22722]: cluster 2024-09-14T01:00:00.000145+0000 mon.a (mon.0) 1634 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:00:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:00 smithi131 bash[24745]: cluster 2024-09-14T00:59:58.515133+0000 mgr.a (mgr.14355) 6880 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:00:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:00 smithi131 bash[24745]: cluster 2024-09-14T01:00:00.000145+0000 mon.a (mon.0) 1634 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:00:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:00 smithi171 bash[25040]: cluster 2024-09-14T00:59:58.515133+0000 mgr.a (mgr.14355) 6880 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:00:00.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:00 smithi171 bash[25040]: cluster 2024-09-14T01:00:00.000145+0000 mon.a (mon.0) 1634 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:00:01.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:01.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:01.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:02.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:02.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:02.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:02 smithi007 bash[22722]: cluster 2024-09-14T01:00:00.517282+0000 mgr.a (mgr.14355) 6881 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:02 smithi131 bash[24745]: cluster 2024-09-14T01:00:00.517282+0000 mgr.a (mgr.14355) 6881 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:02 smithi171 bash[25040]: cluster 2024-09-14T01:00:00.517282+0000 mgr.a (mgr.14355) 6881 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:03 smithi007 bash[22722]: audit 2024-09-14T01:00:01.978871+0000 mgr.a (mgr.14355) 6882 : audit [DBG] from='client.156606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:03 smithi131 bash[24745]: audit 2024-09-14T01:00:01.978871+0000 mgr.a (mgr.14355) 6882 : audit [DBG] from='client.156606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:03 smithi171 bash[25040]: audit 2024-09-14T01:00:01.978871+0000 mgr.a (mgr.14355) 6882 : audit [DBG] from='client.156606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:04 smithi007 bash[22722]: cluster 2024-09-14T01:00:02.518244+0000 mgr.a (mgr.14355) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:04 smithi131 bash[24745]: cluster 2024-09-14T01:00:02.518244+0000 mgr.a (mgr.14355) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:04 smithi171 bash[25040]: cluster 2024-09-14T01:00:02.518244+0000 mgr.a (mgr.14355) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:06 smithi007 bash[22722]: cluster 2024-09-14T01:00:04.519069+0000 mgr.a (mgr.14355) 6884 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:06.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:06 smithi131 bash[24745]: cluster 2024-09-14T01:00:04.519069+0000 mgr.a (mgr.14355) 6884 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:06 smithi171 bash[25040]: cluster 2024-09-14T01:00:04.519069+0000 mgr.a (mgr.14355) 6884 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:07.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:07.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:07.423 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:08.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:08.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:08.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:08.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:08.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:08 smithi007 bash[22722]: cluster 2024-09-14T01:00:06.521303+0000 mgr.a (mgr.14355) 6885 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:08 smithi131 bash[24745]: cluster 2024-09-14T01:00:06.521303+0000 mgr.a (mgr.14355) 6885 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:08 smithi171 bash[25040]: cluster 2024-09-14T01:00:06.521303+0000 mgr.a (mgr.14355) 6885 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:09 smithi007 bash[22722]: audit 2024-09-14T01:00:07.754610+0000 mgr.a (mgr.14355) 6886 : audit [DBG] from='client.156684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:09 smithi131 bash[24745]: audit 2024-09-14T01:00:07.754610+0000 mgr.a (mgr.14355) 6886 : audit [DBG] from='client.156684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:09 smithi171 bash[25040]: audit 2024-09-14T01:00:07.754610+0000 mgr.a (mgr.14355) 6886 : audit [DBG] from='client.156684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:10 smithi007 bash[22722]: cluster 2024-09-14T01:00:08.522265+0000 mgr.a (mgr.14355) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:10 smithi131 bash[24745]: cluster 2024-09-14T01:00:08.522265+0000 mgr.a (mgr.14355) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:10 smithi171 bash[25040]: cluster 2024-09-14T01:00:08.522265+0000 mgr.a (mgr.14355) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:12 smithi007 bash[22722]: cluster 2024-09-14T01:00:10.524433+0000 mgr.a (mgr.14355) 6888 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:12 smithi131 bash[24745]: cluster 2024-09-14T01:00:10.524433+0000 mgr.a (mgr.14355) 6888 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:12 smithi171 bash[25040]: cluster 2024-09-14T01:00:10.524433+0000 mgr.a (mgr.14355) 6888 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:13.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:13.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:13.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:13.941 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:13.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:13.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:13.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:13.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:14 smithi007 bash[22722]: cluster 2024-09-14T01:00:12.525229+0000 mgr.a (mgr.14355) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:14 smithi131 bash[24745]: cluster 2024-09-14T01:00:12.525229+0000 mgr.a (mgr.14355) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:14 smithi171 bash[25040]: cluster 2024-09-14T01:00:12.525229+0000 mgr.a (mgr.14355) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:15 smithi007 bash[22722]: audit 2024-09-14T01:00:13.517484+0000 mgr.a (mgr.14355) 6890 : audit [DBG] from='client.156759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:15 smithi131 bash[24745]: audit 2024-09-14T01:00:13.517484+0000 mgr.a (mgr.14355) 6890 : audit [DBG] from='client.156759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:15 smithi171 bash[25040]: audit 2024-09-14T01:00:13.517484+0000 mgr.a (mgr.14355) 6890 : audit [DBG] from='client.156759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:16 smithi007 bash[22722]: cluster 2024-09-14T01:00:14.526191+0000 mgr.a (mgr.14355) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:16 smithi131 bash[24745]: cluster 2024-09-14T01:00:14.526191+0000 mgr.a (mgr.14355) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:16 smithi171 bash[25040]: cluster 2024-09-14T01:00:14.526191+0000 mgr.a (mgr.14355) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:18 smithi007 bash[22722]: cluster 2024-09-14T01:00:16.528503+0000 mgr.a (mgr.14355) 6892 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:18 smithi131 bash[24745]: cluster 2024-09-14T01:00:16.528503+0000 mgr.a (mgr.14355) 6892 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:18 smithi171 bash[25040]: cluster 2024-09-14T01:00:16.528503+0000 mgr.a (mgr.14355) 6892 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:18.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:18.944 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:19.723 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:19.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:20 smithi007 bash[22722]: cluster 2024-09-14T01:00:18.529416+0000 mgr.a (mgr.14355) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:20 smithi131 bash[24745]: cluster 2024-09-14T01:00:18.529416+0000 mgr.a (mgr.14355) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:20 smithi171 bash[25040]: cluster 2024-09-14T01:00:18.529416+0000 mgr.a (mgr.14355) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:21 smithi007 bash[22722]: audit 2024-09-14T01:00:19.281174+0000 mgr.a (mgr.14355) 6894 : audit [DBG] from='client.156834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:21 smithi131 bash[24745]: audit 2024-09-14T01:00:19.281174+0000 mgr.a (mgr.14355) 6894 : audit [DBG] from='client.156834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:21 smithi171 bash[25040]: audit 2024-09-14T01:00:19.281174+0000 mgr.a (mgr.14355) 6894 : audit [DBG] from='client.156834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:22 smithi007 bash[22722]: cluster 2024-09-14T01:00:20.531867+0000 mgr.a (mgr.14355) 6895 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:22 smithi131 bash[24745]: cluster 2024-09-14T01:00:20.531867+0000 mgr.a (mgr.14355) 6895 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:22 smithi171 bash[25040]: cluster 2024-09-14T01:00:20.531867+0000 mgr.a (mgr.14355) 6895 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:24 smithi007 bash[22722]: cluster 2024-09-14T01:00:22.532668+0000 mgr.a (mgr.14355) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:24.622 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:24 smithi007 bash[22722]: audit 2024-09-14T01:00:23.355006+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:00:24.623 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:24 smithi171 bash[25040]: cluster 2024-09-14T01:00:22.532668+0000 mgr.a (mgr.14355) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:24.623 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:24 smithi171 bash[25040]: audit 2024-09-14T01:00:23.355006+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:00:24.623 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:24 smithi131 bash[24745]: cluster 2024-09-14T01:00:22.532668+0000 mgr.a (mgr.14355) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:24.623 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:24 smithi131 bash[24745]: audit 2024-09-14T01:00:23.355006+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:00:24.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:24.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:24.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:00:24 smithi007 bash[22972]: debug 2024-09-14T01:00:24.977+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:00:24 smithi007 bash[22972]: debug 2024-09-14T01:00:24.981+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:25 smithi007 bash[22722]: audit 2024-09-14T01:00:24.222318+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:25 smithi007 bash[22722]: audit 2024-09-14T01:00:24.223866+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:25 smithi007 bash[22722]: audit 2024-09-14T01:00:24.233869+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:25 smithi007 bash[22722]: audit 2024-09-14T01:00:24.238751+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:25 smithi007 bash[22722]: audit 2024-09-14T01:00:24.241058+0000 mgr.a (mgr.14355) 6897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:25.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:25.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:25.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:25.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:25 smithi131 bash[24745]: audit 2024-09-14T01:00:24.222318+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:00:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:25 smithi131 bash[24745]: audit 2024-09-14T01:00:24.223866+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:00:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:25 smithi131 bash[24745]: audit 2024-09-14T01:00:24.233869+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:00:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:25 smithi131 bash[24745]: audit 2024-09-14T01:00:24.238751+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:25 smithi131 bash[24745]: audit 2024-09-14T01:00:24.241058+0000 mgr.a (mgr.14355) 6897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:25 smithi171 bash[25040]: audit 2024-09-14T01:00:24.222318+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:00:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:25 smithi171 bash[25040]: audit 2024-09-14T01:00:24.223866+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:00:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:25 smithi171 bash[25040]: audit 2024-09-14T01:00:24.233869+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:00:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:25 smithi171 bash[25040]: audit 2024-09-14T01:00:24.238751+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:25 smithi171 bash[25040]: audit 2024-09-14T01:00:24.241058+0000 mgr.a (mgr.14355) 6897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:00:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:26 smithi131 bash[24745]: cluster 2024-09-14T01:00:24.533195+0000 mgr.a (mgr.14355) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:26 smithi131 bash[24745]: audit 2024-09-14T01:00:24.981603+0000 mgr.a (mgr.14355) 6899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:00:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:26 smithi131 bash[24745]: cephadm 2024-09-14T01:00:24.983001+0000 mgr.a (mgr.14355) 6900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:00:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:26 smithi131 bash[24745]: audit 2024-09-14T01:00:25.070034+0000 mgr.a (mgr.14355) 6901 : audit [DBG] from='client.157002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:26 smithi171 bash[25040]: cluster 2024-09-14T01:00:24.533195+0000 mgr.a (mgr.14355) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:26 smithi171 bash[25040]: audit 2024-09-14T01:00:24.981603+0000 mgr.a (mgr.14355) 6899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:00:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:26 smithi171 bash[25040]: cephadm 2024-09-14T01:00:24.983001+0000 mgr.a (mgr.14355) 6900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:00:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:26 smithi171 bash[25040]: audit 2024-09-14T01:00:25.070034+0000 mgr.a (mgr.14355) 6901 : audit [DBG] from='client.157002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:26 smithi007 bash[22722]: cluster 2024-09-14T01:00:24.533195+0000 mgr.a (mgr.14355) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:26 smithi007 bash[22722]: audit 2024-09-14T01:00:24.981603+0000 mgr.a (mgr.14355) 6899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:00:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:26 smithi007 bash[22722]: cephadm 2024-09-14T01:00:24.983001+0000 mgr.a (mgr.14355) 6900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:00:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:26 smithi007 bash[22722]: audit 2024-09-14T01:00:25.070034+0000 mgr.a (mgr.14355) 6901 : audit [DBG] from='client.157002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:28 smithi131 bash[24745]: cluster 2024-09-14T01:00:26.536005+0000 mgr.a (mgr.14355) 6902 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:28 smithi171 bash[25040]: cluster 2024-09-14T01:00:26.536005+0000 mgr.a (mgr.14355) 6902 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:28 smithi007 bash[22722]: cluster 2024-09-14T01:00:26.536005+0000 mgr.a (mgr.14355) 6902 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:30 smithi131 bash[24745]: cluster 2024-09-14T01:00:28.536811+0000 mgr.a (mgr.14355) 6903 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:30 smithi171 bash[25040]: cluster 2024-09-14T01:00:28.536811+0000 mgr.a (mgr.14355) 6903 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:30 smithi007 bash[22722]: cluster 2024-09-14T01:00:28.536811+0000 mgr.a (mgr.14355) 6903 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:31.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:31.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:32 smithi131 bash[24745]: cluster 2024-09-14T01:00:30.538714+0000 mgr.a (mgr.14355) 6904 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:32 smithi131 bash[24745]: audit 2024-09-14T01:00:30.815104+0000 mgr.a (mgr.14355) 6905 : audit [DBG] from='client.157095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:32 smithi171 bash[25040]: cluster 2024-09-14T01:00:30.538714+0000 mgr.a (mgr.14355) 6904 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:32 smithi171 bash[25040]: audit 2024-09-14T01:00:30.815104+0000 mgr.a (mgr.14355) 6905 : audit [DBG] from='client.157095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:32 smithi007 bash[22722]: cluster 2024-09-14T01:00:30.538714+0000 mgr.a (mgr.14355) 6904 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:32 smithi007 bash[22722]: audit 2024-09-14T01:00:30.815104+0000 mgr.a (mgr.14355) 6905 : audit [DBG] from='client.157095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:34 smithi131 bash[24745]: cluster 2024-09-14T01:00:32.539635+0000 mgr.a (mgr.14355) 6906 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:34 smithi171 bash[25040]: cluster 2024-09-14T01:00:32.539635+0000 mgr.a (mgr.14355) 6906 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:34 smithi007 bash[22722]: cluster 2024-09-14T01:00:32.539635+0000 mgr.a (mgr.14355) 6906 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:36 smithi131 bash[24745]: cluster 2024-09-14T01:00:34.540461+0000 mgr.a (mgr.14355) 6907 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:36 smithi171 bash[25040]: cluster 2024-09-14T01:00:34.540461+0000 mgr.a (mgr.14355) 6907 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:36 smithi007 bash[22722]: cluster 2024-09-14T01:00:34.540461+0000 mgr.a (mgr.14355) 6907 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:00:37.017 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:37.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:38 smithi131 bash[24745]: cluster 2024-09-14T01:00:36.541759+0000 mgr.a (mgr.14355) 6908 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:38 smithi131 bash[24745]: audit 2024-09-14T01:00:36.592747+0000 mgr.a (mgr.14355) 6909 : audit [DBG] from='client.157170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:38 smithi171 bash[25040]: cluster 2024-09-14T01:00:36.541759+0000 mgr.a (mgr.14355) 6908 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:38 smithi171 bash[25040]: audit 2024-09-14T01:00:36.592747+0000 mgr.a (mgr.14355) 6909 : audit [DBG] from='client.157170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:38 smithi007 bash[22722]: cluster 2024-09-14T01:00:36.541759+0000 mgr.a (mgr.14355) 6908 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:00:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:38 smithi007 bash[22722]: audit 2024-09-14T01:00:36.592747+0000 mgr.a (mgr.14355) 6909 : audit [DBG] from='client.157170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:39 smithi007 bash[22722]: cluster 2024-09-14T01:00:38.542617+0000 mgr.a (mgr.14355) 6910 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:39 smithi131 bash[24745]: cluster 2024-09-14T01:00:38.542617+0000 mgr.a (mgr.14355) 6910 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:39 smithi171 bash[25040]: cluster 2024-09-14T01:00:38.542617+0000 mgr.a (mgr.14355) 6910 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:41 smithi007 bash[22722]: cluster 2024-09-14T01:00:40.544739+0000 mgr.a (mgr.14355) 6911 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:42.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:42.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:41 smithi131 bash[24745]: cluster 2024-09-14T01:00:40.544739+0000 mgr.a (mgr.14355) 6911 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:41 smithi171 bash[25040]: cluster 2024-09-14T01:00:40.544739+0000 mgr.a (mgr.14355) 6911 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:42.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:43 smithi007 bash[22722]: audit 2024-09-14T01:00:42.353954+0000 mgr.a (mgr.14355) 6912 : audit [DBG] from='client.157248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:43 smithi007 bash[22722]: cluster 2024-09-14T01:00:42.545350+0000 mgr.a (mgr.14355) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:43 smithi131 bash[24745]: audit 2024-09-14T01:00:42.353954+0000 mgr.a (mgr.14355) 6912 : audit [DBG] from='client.157248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:43 smithi131 bash[24745]: cluster 2024-09-14T01:00:42.545350+0000 mgr.a (mgr.14355) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:43 smithi171 bash[25040]: audit 2024-09-14T01:00:42.353954+0000 mgr.a (mgr.14355) 6912 : audit [DBG] from='client.157248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:43 smithi171 bash[25040]: cluster 2024-09-14T01:00:42.545350+0000 mgr.a (mgr.14355) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:45 smithi007 bash[22722]: cluster 2024-09-14T01:00:44.546205+0000 mgr.a (mgr.14355) 6914 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:45 smithi131 bash[24745]: cluster 2024-09-14T01:00:44.546205+0000 mgr.a (mgr.14355) 6914 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:45 smithi171 bash[25040]: cluster 2024-09-14T01:00:44.546205+0000 mgr.a (mgr.14355) 6914 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:47 smithi007 bash[22722]: cluster 2024-09-14T01:00:46.548414+0000 mgr.a (mgr.14355) 6915 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:47 smithi131 bash[24745]: cluster 2024-09-14T01:00:46.548414+0000 mgr.a (mgr.14355) 6915 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:47 smithi171 bash[25040]: cluster 2024-09-14T01:00:46.548414+0000 mgr.a (mgr.14355) 6915 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:48.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:48.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:48.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:48.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:48.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:48 smithi007 bash[22722]: audit 2024-09-14T01:00:48.089713+0000 mgr.a (mgr.14355) 6916 : audit [DBG] from='client.157326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:48 smithi131 bash[24745]: audit 2024-09-14T01:00:48.089713+0000 mgr.a (mgr.14355) 6916 : audit [DBG] from='client.157326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:48 smithi171 bash[25040]: audit 2024-09-14T01:00:48.089713+0000 mgr.a (mgr.14355) 6916 : audit [DBG] from='client.157326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:49 smithi007 bash[22722]: cluster 2024-09-14T01:00:48.549070+0000 mgr.a (mgr.14355) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:49 smithi131 bash[24745]: cluster 2024-09-14T01:00:48.549070+0000 mgr.a (mgr.14355) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:49 smithi171 bash[25040]: cluster 2024-09-14T01:00:48.549070+0000 mgr.a (mgr.14355) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:51 smithi007 bash[22722]: cluster 2024-09-14T01:00:50.551189+0000 mgr.a (mgr.14355) 6918 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:51 smithi131 bash[24745]: cluster 2024-09-14T01:00:50.551189+0000 mgr.a (mgr.14355) 6918 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:51 smithi171 bash[25040]: cluster 2024-09-14T01:00:50.551189+0000 mgr.a (mgr.14355) 6918 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:53.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:53.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:53.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:53 smithi007 bash[22722]: cluster 2024-09-14T01:00:52.551969+0000 mgr.a (mgr.14355) 6919 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:53 smithi131 bash[24745]: cluster 2024-09-14T01:00:52.551969+0000 mgr.a (mgr.14355) 6919 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:53 smithi171 bash[25040]: cluster 2024-09-14T01:00:52.551969+0000 mgr.a (mgr.14355) 6919 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:54.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:00:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:00:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:00:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:00:54.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:00:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:54 smithi007 bash[22722]: audit 2024-09-14T01:00:53.844022+0000 mgr.a (mgr.14355) 6920 : audit [DBG] from='client.157404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:54 smithi131 bash[24745]: audit 2024-09-14T01:00:53.844022+0000 mgr.a (mgr.14355) 6920 : audit [DBG] from='client.157404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:54 smithi171 bash[25040]: audit 2024-09-14T01:00:53.844022+0000 mgr.a (mgr.14355) 6920 : audit [DBG] from='client.157404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:00:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:55 smithi007 bash[22722]: cluster 2024-09-14T01:00:54.552894+0000 mgr.a (mgr.14355) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:55 smithi131 bash[24745]: cluster 2024-09-14T01:00:54.552894+0000 mgr.a (mgr.14355) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:55 smithi171 bash[25040]: cluster 2024-09-14T01:00:54.552894+0000 mgr.a (mgr.14355) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:00:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:57 smithi007 bash[22722]: cluster 2024-09-14T01:00:56.555298+0000 mgr.a (mgr.14355) 6922 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:57 smithi131 bash[24745]: cluster 2024-09-14T01:00:56.555298+0000 mgr.a (mgr.14355) 6922 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:57 smithi171 bash[25040]: cluster 2024-09-14T01:00:56.555298+0000 mgr.a (mgr.14355) 6922 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:00:59.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:00:59.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:00:59.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:00:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:00:59 smithi007 bash[22722]: cluster 2024-09-14T01:00:58.556263+0000 mgr.a (mgr.14355) 6923 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:00.019 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:00.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:00.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:00.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:00.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:00:59 smithi131 bash[24745]: cluster 2024-09-14T01:00:58.556263+0000 mgr.a (mgr.14355) 6923 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:00:59 smithi171 bash[25040]: cluster 2024-09-14T01:00:58.556263+0000 mgr.a (mgr.14355) 6923 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:00 smithi007 bash[22722]: audit 2024-09-14T01:00:59.601627+0000 mgr.a (mgr.14355) 6924 : audit [DBG] from='client.157482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:00 smithi131 bash[24745]: audit 2024-09-14T01:00:59.601627+0000 mgr.a (mgr.14355) 6924 : audit [DBG] from='client.157482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:00 smithi171 bash[25040]: audit 2024-09-14T01:00:59.601627+0000 mgr.a (mgr.14355) 6924 : audit [DBG] from='client.157482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:01 smithi007 bash[22722]: cluster 2024-09-14T01:01:00.558712+0000 mgr.a (mgr.14355) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:01 smithi131 bash[24745]: cluster 2024-09-14T01:01:00.558712+0000 mgr.a (mgr.14355) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:01 smithi171 bash[25040]: cluster 2024-09-14T01:01:00.558712+0000 mgr.a (mgr.14355) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:03 smithi007 bash[22722]: cluster 2024-09-14T01:01:02.559653+0000 mgr.a (mgr.14355) 6926 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:03 smithi131 bash[24745]: cluster 2024-09-14T01:01:02.559653+0000 mgr.a (mgr.14355) 6926 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:03 smithi171 bash[25040]: cluster 2024-09-14T01:01:02.559653+0000 mgr.a (mgr.14355) 6926 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:05.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:05.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:05.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:05.799 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:05.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:05.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:05.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:05.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:05 smithi007 bash[22722]: cluster 2024-09-14T01:01:04.560600+0000 mgr.a (mgr.14355) 6927 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:05 smithi131 bash[24745]: cluster 2024-09-14T01:01:04.560600+0000 mgr.a (mgr.14355) 6927 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:05 smithi171 bash[25040]: cluster 2024-09-14T01:01:04.560600+0000 mgr.a (mgr.14355) 6927 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:06 smithi007 bash[22722]: audit 2024-09-14T01:01:05.357064+0000 mgr.a (mgr.14355) 6928 : audit [DBG] from='client.157557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:06 smithi131 bash[24745]: audit 2024-09-14T01:01:05.357064+0000 mgr.a (mgr.14355) 6928 : audit [DBG] from='client.157557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:06 smithi171 bash[25040]: audit 2024-09-14T01:01:05.357064+0000 mgr.a (mgr.14355) 6928 : audit [DBG] from='client.157557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:07 smithi007 bash[22722]: cluster 2024-09-14T01:01:06.563379+0000 mgr.a (mgr.14355) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:07 smithi131 bash[24745]: cluster 2024-09-14T01:01:06.563379+0000 mgr.a (mgr.14355) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:07 smithi171 bash[25040]: cluster 2024-09-14T01:01:06.563379+0000 mgr.a (mgr.14355) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:09 smithi007 bash[22722]: cluster 2024-09-14T01:01:08.564171+0000 mgr.a (mgr.14355) 6930 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:09 smithi131 bash[24745]: cluster 2024-09-14T01:01:08.564171+0000 mgr.a (mgr.14355) 6930 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:09 smithi171 bash[25040]: cluster 2024-09-14T01:01:08.564171+0000 mgr.a (mgr.14355) 6930 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:10.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:10.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:11.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:11.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:11.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:11.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:11.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:11.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:11 smithi007 bash[22722]: cluster 2024-09-14T01:01:10.566095+0000 mgr.a (mgr.14355) 6931 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:11.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:11 smithi007 bash[22722]: audit 2024-09-14T01:01:11.139464+0000 mgr.a (mgr.14355) 6932 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:11 smithi131 bash[24745]: cluster 2024-09-14T01:01:10.566095+0000 mgr.a (mgr.14355) 6931 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:11 smithi131 bash[24745]: audit 2024-09-14T01:01:11.139464+0000 mgr.a (mgr.14355) 6932 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:11 smithi171 bash[25040]: cluster 2024-09-14T01:01:10.566095+0000 mgr.a (mgr.14355) 6931 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:11 smithi171 bash[25040]: audit 2024-09-14T01:01:11.139464+0000 mgr.a (mgr.14355) 6932 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:13 smithi007 bash[22722]: cluster 2024-09-14T01:01:12.567017+0000 mgr.a (mgr.14355) 6933 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:13 smithi131 bash[24745]: cluster 2024-09-14T01:01:12.567017+0000 mgr.a (mgr.14355) 6933 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:13 smithi171 bash[25040]: cluster 2024-09-14T01:01:12.567017+0000 mgr.a (mgr.14355) 6933 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:15 smithi131 bash[24745]: cluster 2024-09-14T01:01:14.567797+0000 mgr.a (mgr.14355) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:01:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:15 smithi171 bash[25040]: cluster 2024-09-14T01:01:14.567797+0000 mgr.a (mgr.14355) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:01:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:15 smithi007 bash[22722]: cluster 2024-09-14T01:01:14.567797+0000 mgr.a (mgr.14355) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:01:16.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:16.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:16.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:17.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:17 smithi131 bash[24745]: cluster 2024-09-14T01:01:16.570007+0000 mgr.a (mgr.14355) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:17 smithi131 bash[24745]: audit 2024-09-14T01:01:16.908918+0000 mgr.a (mgr.14355) 6936 : audit [DBG] from='client.157707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:17 smithi171 bash[25040]: cluster 2024-09-14T01:01:16.570007+0000 mgr.a (mgr.14355) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:17 smithi171 bash[25040]: audit 2024-09-14T01:01:16.908918+0000 mgr.a (mgr.14355) 6936 : audit [DBG] from='client.157707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:17 smithi007 bash[22722]: cluster 2024-09-14T01:01:16.570007+0000 mgr.a (mgr.14355) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:17 smithi007 bash[22722]: audit 2024-09-14T01:01:16.908918+0000 mgr.a (mgr.14355) 6936 : audit [DBG] from='client.157707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:19 smithi131 bash[24745]: cluster 2024-09-14T01:01:18.570900+0000 mgr.a (mgr.14355) 6937 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:19 smithi171 bash[25040]: cluster 2024-09-14T01:01:18.570900+0000 mgr.a (mgr.14355) 6937 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:19 smithi007 bash[22722]: cluster 2024-09-14T01:01:18.570900+0000 mgr.a (mgr.14355) 6937 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:21 smithi131 bash[24745]: cluster 2024-09-14T01:01:20.573090+0000 mgr.a (mgr.14355) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:21 smithi171 bash[25040]: cluster 2024-09-14T01:01:20.573090+0000 mgr.a (mgr.14355) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:21 smithi007 bash[22722]: cluster 2024-09-14T01:01:20.573090+0000 mgr.a (mgr.14355) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:23.136 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:23.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:23 smithi131 bash[24745]: cluster 2024-09-14T01:01:22.573790+0000 mgr.a (mgr.14355) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:23 smithi131 bash[24745]: audit 2024-09-14T01:01:22.691298+0000 mgr.a (mgr.14355) 6940 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:23 smithi171 bash[25040]: cluster 2024-09-14T01:01:22.573790+0000 mgr.a (mgr.14355) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:23 smithi171 bash[25040]: audit 2024-09-14T01:01:22.691298+0000 mgr.a (mgr.14355) 6940 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:23 smithi007 bash[22722]: cluster 2024-09-14T01:01:22.573790+0000 mgr.a (mgr.14355) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:23 smithi007 bash[22722]: audit 2024-09-14T01:01:22.691298+0000 mgr.a (mgr.14355) 6940 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:25 smithi131 bash[24745]: cluster 2024-09-14T01:01:24.574707+0000 mgr.a (mgr.14355) 6941 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:25 smithi131 bash[24745]: audit 2024-09-14T01:01:25.037573+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:01:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:25 smithi171 bash[25040]: cluster 2024-09-14T01:01:24.574707+0000 mgr.a (mgr.14355) 6941 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:25 smithi171 bash[25040]: audit 2024-09-14T01:01:25.037573+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:01:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:25 smithi007 bash[22722]: cluster 2024-09-14T01:01:24.574707+0000 mgr.a (mgr.14355) 6941 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:25 smithi007 bash[22722]: audit 2024-09-14T01:01:25.037573+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:01:26.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22972]: debug 2024-09-14T01:01:26.652+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:01:26.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22972]: debug 2024-09-14T01:01:26.652+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:01:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22722]: audit 2024-09-14T01:01:25.890785+0000 mon.a (mon.0) 1641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:01:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22722]: audit 2024-09-14T01:01:25.892488+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:01:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22722]: audit 2024-09-14T01:01:25.903269+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:01:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22722]: audit 2024-09-14T01:01:25.908233+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:26 smithi007 bash[22722]: audit 2024-09-14T01:01:25.910641+0000 mgr.a (mgr.14355) 6942 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:26 smithi131 bash[24745]: audit 2024-09-14T01:01:25.890785+0000 mon.a (mon.0) 1641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:01:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:26 smithi131 bash[24745]: audit 2024-09-14T01:01:25.892488+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:01:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:26 smithi131 bash[24745]: audit 2024-09-14T01:01:25.903269+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:01:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:26 smithi131 bash[24745]: audit 2024-09-14T01:01:25.908233+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:26 smithi131 bash[24745]: audit 2024-09-14T01:01:25.910641+0000 mgr.a (mgr.14355) 6942 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:26 smithi171 bash[25040]: audit 2024-09-14T01:01:25.890785+0000 mon.a (mon.0) 1641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:01:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:26 smithi171 bash[25040]: audit 2024-09-14T01:01:25.892488+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:01:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:26 smithi171 bash[25040]: audit 2024-09-14T01:01:25.903269+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:01:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:26 smithi171 bash[25040]: audit 2024-09-14T01:01:25.908233+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:26 smithi171 bash[25040]: audit 2024-09-14T01:01:25.910641+0000 mgr.a (mgr.14355) 6942 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:01:28.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:28.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:28.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:27 smithi007 bash[22722]: cluster 2024-09-14T01:01:26.575971+0000 mgr.a (mgr.14355) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:27 smithi007 bash[22722]: audit 2024-09-14T01:01:26.656244+0000 mgr.a (mgr.14355) 6944 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:01:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:27 smithi007 bash[22722]: cephadm 2024-09-14T01:01:26.658114+0000 mgr.a (mgr.14355) 6945 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:01:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:27 smithi131 bash[24745]: cluster 2024-09-14T01:01:26.575971+0000 mgr.a (mgr.14355) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:27 smithi131 bash[24745]: audit 2024-09-14T01:01:26.656244+0000 mgr.a (mgr.14355) 6944 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:01:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:27 smithi131 bash[24745]: cephadm 2024-09-14T01:01:26.658114+0000 mgr.a (mgr.14355) 6945 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:01:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:27 smithi171 bash[25040]: cluster 2024-09-14T01:01:26.575971+0000 mgr.a (mgr.14355) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:01:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:27 smithi171 bash[25040]: audit 2024-09-14T01:01:26.656244+0000 mgr.a (mgr.14355) 6944 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:01:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:27 smithi171 bash[25040]: cephadm 2024-09-14T01:01:26.658114+0000 mgr.a (mgr.14355) 6945 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:01:28.909 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:29 smithi007 bash[22722]: audit 2024-09-14T01:01:28.473107+0000 mgr.a (mgr.14355) 6946 : audit [DBG] from='client.157962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:29 smithi007 bash[22722]: cluster 2024-09-14T01:01:28.576457+0000 mgr.a (mgr.14355) 6947 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:29 smithi131 bash[24745]: audit 2024-09-14T01:01:28.473107+0000 mgr.a (mgr.14355) 6946 : audit [DBG] from='client.157962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:29 smithi131 bash[24745]: cluster 2024-09-14T01:01:28.576457+0000 mgr.a (mgr.14355) 6947 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:29 smithi171 bash[25040]: audit 2024-09-14T01:01:28.473107+0000 mgr.a (mgr.14355) 6946 : audit [DBG] from='client.157962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:29 smithi171 bash[25040]: cluster 2024-09-14T01:01:28.576457+0000 mgr.a (mgr.14355) 6947 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:31 smithi007 bash[22722]: cluster 2024-09-14T01:01:30.578690+0000 mgr.a (mgr.14355) 6948 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:31 smithi131 bash[24745]: cluster 2024-09-14T01:01:30.578690+0000 mgr.a (mgr.14355) 6948 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:31 smithi171 bash[25040]: cluster 2024-09-14T01:01:30.578690+0000 mgr.a (mgr.14355) 6948 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:33.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:33.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:33.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:33 smithi007 bash[22722]: cluster 2024-09-14T01:01:32.579447+0000 mgr.a (mgr.14355) 6949 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:33 smithi131 bash[24745]: cluster 2024-09-14T01:01:32.579447+0000 mgr.a (mgr.14355) 6949 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:33 smithi171 bash[25040]: cluster 2024-09-14T01:01:32.579447+0000 mgr.a (mgr.14355) 6949 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:34.651 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:34.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:34.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:34.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:34.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:34 smithi007 bash[22722]: audit 2024-09-14T01:01:34.243282+0000 mgr.a (mgr.14355) 6950 : audit [DBG] from='client.158037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:34 smithi131 bash[24745]: audit 2024-09-14T01:01:34.243282+0000 mgr.a (mgr.14355) 6950 : audit [DBG] from='client.158037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:34 smithi171 bash[25040]: audit 2024-09-14T01:01:34.243282+0000 mgr.a (mgr.14355) 6950 : audit [DBG] from='client.158037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:35 smithi007 bash[22722]: cluster 2024-09-14T01:01:34.580031+0000 mgr.a (mgr.14355) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:35 smithi131 bash[24745]: cluster 2024-09-14T01:01:34.580031+0000 mgr.a (mgr.14355) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:35 smithi171 bash[25040]: cluster 2024-09-14T01:01:34.580031+0000 mgr.a (mgr.14355) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:37 smithi007 bash[22722]: cluster 2024-09-14T01:01:36.582424+0000 mgr.a (mgr.14355) 6952 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:37 smithi131 bash[24745]: cluster 2024-09-14T01:01:36.582424+0000 mgr.a (mgr.14355) 6952 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:37 smithi171 bash[25040]: cluster 2024-09-14T01:01:36.582424+0000 mgr.a (mgr.14355) 6952 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:39.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:39.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:39 smithi007 bash[22722]: cluster 2024-09-14T01:01:38.583343+0000 mgr.a (mgr.14355) 6953 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:39 smithi131 bash[24745]: cluster 2024-09-14T01:01:38.583343+0000 mgr.a (mgr.14355) 6953 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:39 smithi171 bash[25040]: cluster 2024-09-14T01:01:38.583343+0000 mgr.a (mgr.14355) 6953 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:40.388 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:40.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:40.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:40.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:40.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:40 smithi007 bash[22722]: audit 2024-09-14T01:01:39.981338+0000 mgr.a (mgr.14355) 6954 : audit [DBG] from='client.158115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:40 smithi131 bash[24745]: audit 2024-09-14T01:01:39.981338+0000 mgr.a (mgr.14355) 6954 : audit [DBG] from='client.158115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:40 smithi171 bash[25040]: audit 2024-09-14T01:01:39.981338+0000 mgr.a (mgr.14355) 6954 : audit [DBG] from='client.158115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:41 smithi007 bash[22722]: cluster 2024-09-14T01:01:40.585969+0000 mgr.a (mgr.14355) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:41 smithi131 bash[24745]: cluster 2024-09-14T01:01:40.585969+0000 mgr.a (mgr.14355) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:41 smithi171 bash[25040]: cluster 2024-09-14T01:01:40.585969+0000 mgr.a (mgr.14355) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:01:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:43 smithi007 bash[22722]: cluster 2024-09-14T01:01:42.586956+0000 mgr.a (mgr.14355) 6956 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:43 smithi131 bash[24745]: cluster 2024-09-14T01:01:42.586956+0000 mgr.a (mgr.14355) 6956 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:43 smithi171 bash[25040]: cluster 2024-09-14T01:01:42.586956+0000 mgr.a (mgr.14355) 6956 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:45.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:45.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:45.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:46.177 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:46.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:46.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:46.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:46.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:45 smithi131 bash[24745]: cluster 2024-09-14T01:01:44.587893+0000 mgr.a (mgr.14355) 6957 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:45 smithi171 bash[25040]: cluster 2024-09-14T01:01:44.587893+0000 mgr.a (mgr.14355) 6957 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:45 smithi007 bash[22722]: cluster 2024-09-14T01:01:44.587893+0000 mgr.a (mgr.14355) 6957 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:01:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:46 smithi131 bash[24745]: audit 2024-09-14T01:01:45.731109+0000 mgr.a (mgr.14355) 6958 : audit [DBG] from='client.158193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:46 smithi171 bash[25040]: audit 2024-09-14T01:01:45.731109+0000 mgr.a (mgr.14355) 6958 : audit [DBG] from='client.158193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:46 smithi007 bash[22722]: audit 2024-09-14T01:01:45.731109+0000 mgr.a (mgr.14355) 6958 : audit [DBG] from='client.158193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:47 smithi131 bash[24745]: cluster 2024-09-14T01:01:46.590727+0000 mgr.a (mgr.14355) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:47 smithi171 bash[25040]: cluster 2024-09-14T01:01:46.590727+0000 mgr.a (mgr.14355) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:47 smithi007 bash[22722]: cluster 2024-09-14T01:01:46.590727+0000 mgr.a (mgr.14355) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:49 smithi131 bash[24745]: cluster 2024-09-14T01:01:48.591516+0000 mgr.a (mgr.14355) 6960 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:49 smithi171 bash[25040]: cluster 2024-09-14T01:01:48.591516+0000 mgr.a (mgr.14355) 6960 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:49 smithi007 bash[22722]: cluster 2024-09-14T01:01:48.591516+0000 mgr.a (mgr.14355) 6960 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:01:51.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:51.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:51.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:51.946 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:51.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:51.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:51.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:51.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:51 smithi131 bash[24745]: cluster 2024-09-14T01:01:50.593436+0000 mgr.a (mgr.14355) 6961 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:51 smithi171 bash[25040]: cluster 2024-09-14T01:01:50.593436+0000 mgr.a (mgr.14355) 6961 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:51 smithi007 bash[22722]: cluster 2024-09-14T01:01:50.593436+0000 mgr.a (mgr.14355) 6961 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:01:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:52 smithi131 bash[24745]: audit 2024-09-14T01:01:51.514784+0000 mgr.a (mgr.14355) 6962 : audit [DBG] from='client.158271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:52 smithi171 bash[25040]: audit 2024-09-14T01:01:51.514784+0000 mgr.a (mgr.14355) 6962 : audit [DBG] from='client.158271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:52 smithi007 bash[22722]: audit 2024-09-14T01:01:51.514784+0000 mgr.a (mgr.14355) 6962 : audit [DBG] from='client.158271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:53 smithi131 bash[24745]: cluster 2024-09-14T01:01:52.594511+0000 mgr.a (mgr.14355) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:53 smithi171 bash[25040]: cluster 2024-09-14T01:01:52.594511+0000 mgr.a (mgr.14355) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:53 smithi007 bash[22722]: cluster 2024-09-14T01:01:52.594511+0000 mgr.a (mgr.14355) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:55 smithi131 bash[24745]: cluster 2024-09-14T01:01:54.595477+0000 mgr.a (mgr.14355) 6964 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:55 smithi171 bash[25040]: cluster 2024-09-14T01:01:54.595477+0000 mgr.a (mgr.14355) 6964 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:55 smithi007 bash[22722]: cluster 2024-09-14T01:01:54.595477+0000 mgr.a (mgr.14355) 6964 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:01:56.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:01:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:01:56.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:01:57.686 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:01:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:01:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:01:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:01:57.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:01:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:57 smithi131 bash[24745]: cluster 2024-09-14T01:01:56.597849+0000 mgr.a (mgr.14355) 6965 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:01:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:57 smithi171 bash[25040]: cluster 2024-09-14T01:01:56.597849+0000 mgr.a (mgr.14355) 6965 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:01:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:57 smithi007 bash[22722]: cluster 2024-09-14T01:01:56.597849+0000 mgr.a (mgr.14355) 6965 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:01:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:01:59 smithi131 bash[24745]: audit 2024-09-14T01:01:57.278955+0000 mgr.a (mgr.14355) 6966 : audit [DBG] from='client.158349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:01:59 smithi171 bash[25040]: audit 2024-09-14T01:01:57.278955+0000 mgr.a (mgr.14355) 6966 : audit [DBG] from='client.158349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:01:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:01:59 smithi007 bash[22722]: audit 2024-09-14T01:01:57.278955+0000 mgr.a (mgr.14355) 6966 : audit [DBG] from='client.158349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:00 smithi131 bash[24745]: cluster 2024-09-14T01:01:58.598794+0000 mgr.a (mgr.14355) 6967 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:00 smithi171 bash[25040]: cluster 2024-09-14T01:01:58.598794+0000 mgr.a (mgr.14355) 6967 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:00 smithi007 bash[22722]: cluster 2024-09-14T01:01:58.598794+0000 mgr.a (mgr.14355) 6967 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:02 smithi131 bash[24745]: cluster 2024-09-14T01:02:00.600980+0000 mgr.a (mgr.14355) 6968 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:02 smithi171 bash[25040]: cluster 2024-09-14T01:02:00.600980+0000 mgr.a (mgr.14355) 6968 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:02 smithi007 bash[22722]: cluster 2024-09-14T01:02:00.600980+0000 mgr.a (mgr.14355) 6968 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:03.443 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:03.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:03.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:04 smithi131 bash[24745]: cluster 2024-09-14T01:02:02.601752+0000 mgr.a (mgr.14355) 6969 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:04 smithi131 bash[24745]: audit 2024-09-14T01:02:03.022205+0000 mgr.a (mgr.14355) 6970 : audit [DBG] from='client.158427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:04 smithi171 bash[25040]: cluster 2024-09-14T01:02:02.601752+0000 mgr.a (mgr.14355) 6969 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:04 smithi171 bash[25040]: audit 2024-09-14T01:02:03.022205+0000 mgr.a (mgr.14355) 6970 : audit [DBG] from='client.158427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:04 smithi007 bash[22722]: cluster 2024-09-14T01:02:02.601752+0000 mgr.a (mgr.14355) 6969 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:04 smithi007 bash[22722]: audit 2024-09-14T01:02:03.022205+0000 mgr.a (mgr.14355) 6970 : audit [DBG] from='client.158427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:06 smithi131 bash[24745]: cluster 2024-09-14T01:02:04.602671+0000 mgr.a (mgr.14355) 6971 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:06 smithi171 bash[25040]: cluster 2024-09-14T01:02:04.602671+0000 mgr.a (mgr.14355) 6971 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:06 smithi007 bash[22722]: cluster 2024-09-14T01:02:04.602671+0000 mgr.a (mgr.14355) 6971 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:08 smithi131 bash[24745]: cluster 2024-09-14T01:02:06.604937+0000 mgr.a (mgr.14355) 6972 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:08 smithi171 bash[25040]: cluster 2024-09-14T01:02:06.604937+0000 mgr.a (mgr.14355) 6972 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:08.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:08.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:08 smithi007 bash[22722]: cluster 2024-09-14T01:02:06.604937+0000 mgr.a (mgr.14355) 6972 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:02:09.224 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:09.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:10 smithi131 bash[24745]: cluster 2024-09-14T01:02:08.605475+0000 mgr.a (mgr.14355) 6973 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:10 smithi131 bash[24745]: audit 2024-09-14T01:02:08.783452+0000 mgr.a (mgr.14355) 6974 : audit [DBG] from='client.158502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:10 smithi171 bash[25040]: cluster 2024-09-14T01:02:08.605475+0000 mgr.a (mgr.14355) 6973 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:10 smithi171 bash[25040]: audit 2024-09-14T01:02:08.783452+0000 mgr.a (mgr.14355) 6974 : audit [DBG] from='client.158502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:10 smithi007 bash[22722]: cluster 2024-09-14T01:02:08.605475+0000 mgr.a (mgr.14355) 6973 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:02:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:10 smithi007 bash[22722]: audit 2024-09-14T01:02:08.783452+0000 mgr.a (mgr.14355) 6974 : audit [DBG] from='client.158502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:12 smithi131 bash[24745]: cluster 2024-09-14T01:02:10.607742+0000 mgr.a (mgr.14355) 6975 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T01:02:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:12 smithi171 bash[25040]: cluster 2024-09-14T01:02:10.607742+0000 mgr.a (mgr.14355) 6975 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T01:02:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:12 smithi007 bash[22722]: cluster 2024-09-14T01:02:10.607742+0000 mgr.a (mgr.14355) 6975 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-14T01:02:14.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:14.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:14.227 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:14 smithi171 bash[25040]: cluster 2024-09-14T01:02:12.608513+0000 mgr.a (mgr.14355) 6976 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:14 smithi007 bash[22722]: cluster 2024-09-14T01:02:12.608513+0000 mgr.a (mgr.14355) 6976 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:14 smithi131 bash[24745]: cluster 2024-09-14T01:02:12.608513+0000 mgr.a (mgr.14355) 6976 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:14.963 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:16 smithi171 bash[25040]: audit 2024-09-14T01:02:14.559253+0000 mgr.a (mgr.14355) 6977 : audit [DBG] from='client.158580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:16 smithi171 bash[25040]: cluster 2024-09-14T01:02:14.609520+0000 mgr.a (mgr.14355) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:16 smithi007 bash[22722]: audit 2024-09-14T01:02:14.559253+0000 mgr.a (mgr.14355) 6977 : audit [DBG] from='client.158580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:16 smithi007 bash[22722]: cluster 2024-09-14T01:02:14.609520+0000 mgr.a (mgr.14355) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:16 smithi131 bash[24745]: audit 2024-09-14T01:02:14.559253+0000 mgr.a (mgr.14355) 6977 : audit [DBG] from='client.158580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:16 smithi131 bash[24745]: cluster 2024-09-14T01:02:14.609520+0000 mgr.a (mgr.14355) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:18 smithi171 bash[25040]: cluster 2024-09-14T01:02:16.612068+0000 mgr.a (mgr.14355) 6979 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:02:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:18 smithi007 bash[22722]: cluster 2024-09-14T01:02:16.612068+0000 mgr.a (mgr.14355) 6979 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:02:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:18 smithi131 bash[24745]: cluster 2024-09-14T01:02:16.612068+0000 mgr.a (mgr.14355) 6979 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:02:19.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:20 smithi007 bash[22722]: cluster 2024-09-14T01:02:18.612895+0000 mgr.a (mgr.14355) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:20 smithi131 bash[24745]: cluster 2024-09-14T01:02:18.612895+0000 mgr.a (mgr.14355) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:20 smithi171 bash[25040]: cluster 2024-09-14T01:02:18.612895+0000 mgr.a (mgr.14355) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:20.701 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:20.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:20.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:20.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:20.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:22 smithi007 bash[22722]: audit 2024-09-14T01:02:20.293163+0000 mgr.a (mgr.14355) 6981 : audit [DBG] from='client.158658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:22 smithi007 bash[22722]: cluster 2024-09-14T01:02:20.614212+0000 mgr.a (mgr.14355) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:22 smithi131 bash[24745]: audit 2024-09-14T01:02:20.293163+0000 mgr.a (mgr.14355) 6981 : audit [DBG] from='client.158658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:22 smithi131 bash[24745]: cluster 2024-09-14T01:02:20.614212+0000 mgr.a (mgr.14355) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:22 smithi171 bash[25040]: audit 2024-09-14T01:02:20.293163+0000 mgr.a (mgr.14355) 6981 : audit [DBG] from='client.158658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:22 smithi171 bash[25040]: cluster 2024-09-14T01:02:20.614212+0000 mgr.a (mgr.14355) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:02:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:24 smithi007 bash[22722]: cluster 2024-09-14T01:02:22.614943+0000 mgr.a (mgr.14355) 6983 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:24 smithi131 bash[24745]: cluster 2024-09-14T01:02:22.614943+0000 mgr.a (mgr.14355) 6983 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:24 smithi171 bash[25040]: cluster 2024-09-14T01:02:22.614943+0000 mgr.a (mgr.14355) 6983 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:25.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:25.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:25.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:26 smithi007 bash[22722]: cluster 2024-09-14T01:02:24.615690+0000 mgr.a (mgr.14355) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:02:26.473 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:26 smithi131 bash[24745]: cluster 2024-09-14T01:02:24.615690+0000 mgr.a (mgr.14355) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:02:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:26 smithi171 bash[25040]: cluster 2024-09-14T01:02:24.615690+0000 mgr.a (mgr.14355) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:27 smithi007 bash[22722]: audit 2024-09-14T01:02:26.037316+0000 mgr.a (mgr.14355) 6985 : audit [DBG] from='client.158736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:27 smithi007 bash[22722]: audit 2024-09-14T01:02:26.710197+0000 mon.a (mon.0) 1645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:02:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:27 smithi131 bash[24745]: audit 2024-09-14T01:02:26.037316+0000 mgr.a (mgr.14355) 6985 : audit [DBG] from='client.158736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:27 smithi131 bash[24745]: audit 2024-09-14T01:02:26.710197+0000 mon.a (mon.0) 1645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:02:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:27 smithi171 bash[25040]: audit 2024-09-14T01:02:26.037316+0000 mgr.a (mgr.14355) 6985 : audit [DBG] from='client.158736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:27 smithi171 bash[25040]: audit 2024-09-14T01:02:26.710197+0000 mon.a (mon.0) 1645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:02:28.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22972]: debug 2024-09-14T01:02:28.299+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:02:28.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22972]: debug 2024-09-14T01:02:28.299+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:02:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22722]: cluster 2024-09-14T01:02:26.618483+0000 mgr.a (mgr.14355) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22722]: audit 2024-09-14T01:02:27.550664+0000 mon.a (mon.0) 1646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:02:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22722]: audit 2024-09-14T01:02:27.552231+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:02:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22722]: audit 2024-09-14T01:02:27.562989+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:02:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:28 smithi007 bash[22722]: audit 2024-09-14T01:02:27.566077+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:28 smithi131 bash[24745]: cluster 2024-09-14T01:02:26.618483+0000 mgr.a (mgr.14355) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:28 smithi131 bash[24745]: audit 2024-09-14T01:02:27.550664+0000 mon.a (mon.0) 1646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:02:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:28 smithi131 bash[24745]: audit 2024-09-14T01:02:27.552231+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:02:28.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:28 smithi131 bash[24745]: audit 2024-09-14T01:02:27.562989+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:02:28.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:28 smithi131 bash[24745]: audit 2024-09-14T01:02:27.566077+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:28 smithi171 bash[25040]: cluster 2024-09-14T01:02:26.618483+0000 mgr.a (mgr.14355) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:28 smithi171 bash[25040]: audit 2024-09-14T01:02:27.550664+0000 mon.a (mon.0) 1646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:02:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:28 smithi171 bash[25040]: audit 2024-09-14T01:02:27.552231+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:02:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:28 smithi171 bash[25040]: audit 2024-09-14T01:02:27.562989+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:02:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:28 smithi171 bash[25040]: audit 2024-09-14T01:02:27.566077+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:29 smithi007 bash[22722]: audit 2024-09-14T01:02:27.567597+0000 mgr.a (mgr.14355) 6987 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:29 smithi131 bash[24745]: audit 2024-09-14T01:02:27.567597+0000 mgr.a (mgr.14355) 6987 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:29 smithi171 bash[25040]: audit 2024-09-14T01:02:27.567597+0000 mgr.a (mgr.14355) 6987 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:02:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:30 smithi007 bash[22722]: audit 2024-09-14T01:02:28.303675+0000 mgr.a (mgr.14355) 6988 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:02:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:30 smithi007 bash[22722]: cephadm 2024-09-14T01:02:28.305092+0000 mgr.a (mgr.14355) 6989 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:02:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:30 smithi007 bash[22722]: cluster 2024-09-14T01:02:28.619349+0000 mgr.a (mgr.14355) 6990 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:30 smithi131 bash[24745]: audit 2024-09-14T01:02:28.303675+0000 mgr.a (mgr.14355) 6988 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:02:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:30 smithi131 bash[24745]: cephadm 2024-09-14T01:02:28.305092+0000 mgr.a (mgr.14355) 6989 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:02:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:30 smithi131 bash[24745]: cluster 2024-09-14T01:02:28.619349+0000 mgr.a (mgr.14355) 6990 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:30 smithi171 bash[25040]: audit 2024-09-14T01:02:28.303675+0000 mgr.a (mgr.14355) 6988 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:02:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:30 smithi171 bash[25040]: cephadm 2024-09-14T01:02:28.305092+0000 mgr.a (mgr.14355) 6989 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:02:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:30 smithi171 bash[25040]: cluster 2024-09-14T01:02:28.619349+0000 mgr.a (mgr.14355) 6990 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:02:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:31.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:32.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:32.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:32.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:32.244 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:32 smithi007 bash[22722]: cluster 2024-09-14T01:02:30.621628+0000 mgr.a (mgr.14355) 6991 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:32 smithi131 bash[24745]: cluster 2024-09-14T01:02:30.621628+0000 mgr.a (mgr.14355) 6991 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:32 smithi171 bash[25040]: cluster 2024-09-14T01:02:30.621628+0000 mgr.a (mgr.14355) 6991 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:33 smithi007 bash[22722]: audit 2024-09-14T01:02:31.811766+0000 mgr.a (mgr.14355) 6992 : audit [DBG] from='client.158922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:33 smithi131 bash[24745]: audit 2024-09-14T01:02:31.811766+0000 mgr.a (mgr.14355) 6992 : audit [DBG] from='client.158922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:33 smithi171 bash[25040]: audit 2024-09-14T01:02:31.811766+0000 mgr.a (mgr.14355) 6992 : audit [DBG] from='client.158922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:34 smithi007 bash[22722]: cluster 2024-09-14T01:02:32.622533+0000 mgr.a (mgr.14355) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:34 smithi131 bash[24745]: cluster 2024-09-14T01:02:32.622533+0000 mgr.a (mgr.14355) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:34 smithi171 bash[25040]: cluster 2024-09-14T01:02:32.622533+0000 mgr.a (mgr.14355) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:36 smithi007 bash[22722]: cluster 2024-09-14T01:02:34.623310+0000 mgr.a (mgr.14355) 6994 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:36 smithi131 bash[24745]: cluster 2024-09-14T01:02:34.623310+0000 mgr.a (mgr.14355) 6994 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:36 smithi171 bash[25040]: cluster 2024-09-14T01:02:34.623310+0000 mgr.a (mgr.14355) 6994 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:37.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:37.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:38.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:38.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:38 smithi007 bash[22722]: cluster 2024-09-14T01:02:36.625520+0000 mgr.a (mgr.14355) 6995 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:38 smithi131 bash[24745]: cluster 2024-09-14T01:02:36.625520+0000 mgr.a (mgr.14355) 6995 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:38 smithi171 bash[25040]: cluster 2024-09-14T01:02:36.625520+0000 mgr.a (mgr.14355) 6995 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:39 smithi007 bash[22722]: audit 2024-09-14T01:02:37.583082+0000 mgr.a (mgr.14355) 6996 : audit [DBG] from='client.159000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:39 smithi131 bash[24745]: audit 2024-09-14T01:02:37.583082+0000 mgr.a (mgr.14355) 6996 : audit [DBG] from='client.159000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:39 smithi171 bash[25040]: audit 2024-09-14T01:02:37.583082+0000 mgr.a (mgr.14355) 6996 : audit [DBG] from='client.159000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:40 smithi007 bash[22722]: cluster 2024-09-14T01:02:38.626417+0000 mgr.a (mgr.14355) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:40 smithi131 bash[24745]: cluster 2024-09-14T01:02:38.626417+0000 mgr.a (mgr.14355) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:40 smithi171 bash[25040]: cluster 2024-09-14T01:02:38.626417+0000 mgr.a (mgr.14355) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:42 smithi007 bash[22722]: cluster 2024-09-14T01:02:40.628537+0000 mgr.a (mgr.14355) 6998 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:42.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:42 smithi131 bash[24745]: cluster 2024-09-14T01:02:40.628537+0000 mgr.a (mgr.14355) 6998 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:42 smithi171 bash[25040]: cluster 2024-09-14T01:02:40.628537+0000 mgr.a (mgr.14355) 6998 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:02:43.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:43.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:43.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:43.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:43.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:43.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:43.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:44 smithi007 bash[22722]: cluster 2024-09-14T01:02:42.629327+0000 mgr.a (mgr.14355) 6999 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:44 smithi131 bash[24745]: cluster 2024-09-14T01:02:42.629327+0000 mgr.a (mgr.14355) 6999 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:44 smithi171 bash[25040]: cluster 2024-09-14T01:02:42.629327+0000 mgr.a (mgr.14355) 6999 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:45 smithi007 bash[22722]: audit 2024-09-14T01:02:43.363717+0000 mgr.a (mgr.14355) 7000 : audit [DBG] from='client.159078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:45 smithi131 bash[24745]: audit 2024-09-14T01:02:43.363717+0000 mgr.a (mgr.14355) 7000 : audit [DBG] from='client.159078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:45 smithi171 bash[25040]: audit 2024-09-14T01:02:43.363717+0000 mgr.a (mgr.14355) 7000 : audit [DBG] from='client.159078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:46 smithi007 bash[22722]: cluster 2024-09-14T01:02:44.630277+0000 mgr.a (mgr.14355) 7001 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:46 smithi131 bash[24745]: cluster 2024-09-14T01:02:44.630277+0000 mgr.a (mgr.14355) 7001 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:46 smithi171 bash[25040]: cluster 2024-09-14T01:02:44.630277+0000 mgr.a (mgr.14355) 7001 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:48 smithi007 bash[22722]: cluster 2024-09-14T01:02:46.632526+0000 mgr.a (mgr.14355) 7002 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:48 smithi131 bash[24745]: cluster 2024-09-14T01:02:46.632526+0000 mgr.a (mgr.14355) 7002 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:48 smithi171 bash[25040]: cluster 2024-09-14T01:02:46.632526+0000 mgr.a (mgr.14355) 7002 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:48.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:49.550 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:50 smithi007 bash[22722]: cluster 2024-09-14T01:02:48.633353+0000 mgr.a (mgr.14355) 7003 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:50 smithi007 bash[22722]: audit 2024-09-14T01:02:49.121183+0000 mgr.a (mgr.14355) 7004 : audit [DBG] from='client.159153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:50 smithi131 bash[24745]: cluster 2024-09-14T01:02:48.633353+0000 mgr.a (mgr.14355) 7003 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:50 smithi131 bash[24745]: audit 2024-09-14T01:02:49.121183+0000 mgr.a (mgr.14355) 7004 : audit [DBG] from='client.159153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:50 smithi171 bash[25040]: cluster 2024-09-14T01:02:48.633353+0000 mgr.a (mgr.14355) 7003 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:50 smithi171 bash[25040]: audit 2024-09-14T01:02:49.121183+0000 mgr.a (mgr.14355) 7004 : audit [DBG] from='client.159153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:52 smithi007 bash[22722]: cluster 2024-09-14T01:02:50.635736+0000 mgr.a (mgr.14355) 7005 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:52.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:52 smithi131 bash[24745]: cluster 2024-09-14T01:02:50.635736+0000 mgr.a (mgr.14355) 7005 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:52 smithi171 bash[25040]: cluster 2024-09-14T01:02:50.635736+0000 mgr.a (mgr.14355) 7005 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:54 smithi007 bash[22722]: cluster 2024-09-14T01:02:52.636532+0000 mgr.a (mgr.14355) 7006 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:54 smithi131 bash[24745]: cluster 2024-09-14T01:02:52.636532+0000 mgr.a (mgr.14355) 7006 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:54 smithi171 bash[25040]: cluster 2024-09-14T01:02:52.636532+0000 mgr.a (mgr.14355) 7006 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:02:54.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:02:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:02:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:02:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:02:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:02:55.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:02:55.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:02:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:56 smithi007 bash[22722]: cluster 2024-09-14T01:02:54.637284+0000 mgr.a (mgr.14355) 7007 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:56 smithi007 bash[22722]: audit 2024-09-14T01:02:54.878742+0000 mgr.a (mgr.14355) 7008 : audit [DBG] from='client.159225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:56 smithi131 bash[24745]: cluster 2024-09-14T01:02:54.637284+0000 mgr.a (mgr.14355) 7007 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:56 smithi131 bash[24745]: audit 2024-09-14T01:02:54.878742+0000 mgr.a (mgr.14355) 7008 : audit [DBG] from='client.159225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:56 smithi171 bash[25040]: cluster 2024-09-14T01:02:54.637284+0000 mgr.a (mgr.14355) 7007 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:02:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:56 smithi171 bash[25040]: audit 2024-09-14T01:02:54.878742+0000 mgr.a (mgr.14355) 7008 : audit [DBG] from='client.159225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:02:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:02:58 smithi007 bash[22722]: cluster 2024-09-14T01:02:56.639719+0000 mgr.a (mgr.14355) 7009 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:02:58 smithi131 bash[24745]: cluster 2024-09-14T01:02:56.639719+0000 mgr.a (mgr.14355) 7009 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:02:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:02:58 smithi171 bash[25040]: cluster 2024-09-14T01:02:56.639719+0000 mgr.a (mgr.14355) 7009 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:00.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:00.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:00.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:00 smithi007 bash[22722]: cluster 2024-09-14T01:02:58.640513+0000 mgr.a (mgr.14355) 7010 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:00 smithi131 bash[24745]: cluster 2024-09-14T01:02:58.640513+0000 mgr.a (mgr.14355) 7010 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:00 smithi171 bash[25040]: cluster 2024-09-14T01:02:58.640513+0000 mgr.a (mgr.14355) 7010 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:01.055 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:01.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:01.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:02 smithi007 bash[22722]: audit 2024-09-14T01:03:00.634565+0000 mgr.a (mgr.14355) 7011 : audit [DBG] from='client.159300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:02 smithi007 bash[22722]: cluster 2024-09-14T01:03:00.651178+0000 mgr.a (mgr.14355) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:02 smithi131 bash[24745]: audit 2024-09-14T01:03:00.634565+0000 mgr.a (mgr.14355) 7011 : audit [DBG] from='client.159300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:02 smithi131 bash[24745]: cluster 2024-09-14T01:03:00.651178+0000 mgr.a (mgr.14355) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:02 smithi171 bash[25040]: audit 2024-09-14T01:03:00.634565+0000 mgr.a (mgr.14355) 7011 : audit [DBG] from='client.159300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:02 smithi171 bash[25040]: cluster 2024-09-14T01:03:00.651178+0000 mgr.a (mgr.14355) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:04 smithi007 bash[22722]: cluster 2024-09-14T01:03:02.652155+0000 mgr.a (mgr.14355) 7013 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:04 smithi131 bash[24745]: cluster 2024-09-14T01:03:02.652155+0000 mgr.a (mgr.14355) 7013 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:04 smithi171 bash[25040]: cluster 2024-09-14T01:03:02.652155+0000 mgr.a (mgr.14355) 7013 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:06.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:06.057 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:06.057 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:06 smithi007 bash[22722]: cluster 2024-09-14T01:03:04.652957+0000 mgr.a (mgr.14355) 7014 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:06 smithi131 bash[24745]: cluster 2024-09-14T01:03:04.652957+0000 mgr.a (mgr.14355) 7014 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:06 smithi171 bash[25040]: cluster 2024-09-14T01:03:04.652957+0000 mgr.a (mgr.14355) 7014 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:06.815 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:06.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:08 smithi007 bash[22722]: audit 2024-09-14T01:03:06.392417+0000 mgr.a (mgr.14355) 7015 : audit [DBG] from='client.159378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:08 smithi007 bash[22722]: cluster 2024-09-14T01:03:06.654599+0000 mgr.a (mgr.14355) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:08 smithi131 bash[24745]: audit 2024-09-14T01:03:06.392417+0000 mgr.a (mgr.14355) 7015 : audit [DBG] from='client.159378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:08 smithi131 bash[24745]: cluster 2024-09-14T01:03:06.654599+0000 mgr.a (mgr.14355) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:08 smithi171 bash[25040]: audit 2024-09-14T01:03:06.392417+0000 mgr.a (mgr.14355) 7015 : audit [DBG] from='client.159378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:08 smithi171 bash[25040]: cluster 2024-09-14T01:03:06.654599+0000 mgr.a (mgr.14355) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:10 smithi007 bash[22722]: cluster 2024-09-14T01:03:08.655448+0000 mgr.a (mgr.14355) 7017 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:10 smithi131 bash[24745]: cluster 2024-09-14T01:03:08.655448+0000 mgr.a (mgr.14355) 7017 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:10 smithi171 bash[25040]: cluster 2024-09-14T01:03:08.655448+0000 mgr.a (mgr.14355) 7017 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:03:11.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:11.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:12.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:12 smithi007 bash[22722]: cluster 2024-09-14T01:03:10.657638+0000 mgr.a (mgr.14355) 7018 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:12 smithi131 bash[24745]: cluster 2024-09-14T01:03:10.657638+0000 mgr.a (mgr.14355) 7018 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:12 smithi171 bash[25040]: cluster 2024-09-14T01:03:10.657638+0000 mgr.a (mgr.14355) 7018 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:12.594 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:12.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:13 smithi007 bash[22722]: audit 2024-09-14T01:03:12.153614+0000 mgr.a (mgr.14355) 7019 : audit [DBG] from='client.159456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:13 smithi131 bash[24745]: audit 2024-09-14T01:03:12.153614+0000 mgr.a (mgr.14355) 7019 : audit [DBG] from='client.159456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:13 smithi171 bash[25040]: audit 2024-09-14T01:03:12.153614+0000 mgr.a (mgr.14355) 7019 : audit [DBG] from='client.159456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:14 smithi007 bash[22722]: cluster 2024-09-14T01:03:12.658616+0000 mgr.a (mgr.14355) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:14 smithi131 bash[24745]: cluster 2024-09-14T01:03:12.658616+0000 mgr.a (mgr.14355) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:14 smithi171 bash[25040]: cluster 2024-09-14T01:03:12.658616+0000 mgr.a (mgr.14355) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:16 smithi131 bash[24745]: cluster 2024-09-14T01:03:14.659433+0000 mgr.a (mgr.14355) 7021 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:16 smithi171 bash[25040]: cluster 2024-09-14T01:03:14.659433+0000 mgr.a (mgr.14355) 7021 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:16 smithi007 bash[22722]: cluster 2024-09-14T01:03:14.659433+0000 mgr.a (mgr.14355) 7021 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:17.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:17.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:18.365 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:18 smithi131 bash[24745]: cluster 2024-09-14T01:03:16.661669+0000 mgr.a (mgr.14355) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:18 smithi171 bash[25040]: cluster 2024-09-14T01:03:16.661669+0000 mgr.a (mgr.14355) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:18 smithi007 bash[22722]: cluster 2024-09-14T01:03:16.661669+0000 mgr.a (mgr.14355) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:19 smithi131 bash[24745]: audit 2024-09-14T01:03:17.935724+0000 mgr.a (mgr.14355) 7023 : audit [DBG] from='client.159534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:19 smithi171 bash[25040]: audit 2024-09-14T01:03:17.935724+0000 mgr.a (mgr.14355) 7023 : audit [DBG] from='client.159534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:19 smithi007 bash[22722]: audit 2024-09-14T01:03:17.935724+0000 mgr.a (mgr.14355) 7023 : audit [DBG] from='client.159534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:20 smithi131 bash[24745]: cluster 2024-09-14T01:03:18.662641+0000 mgr.a (mgr.14355) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:20 smithi171 bash[25040]: cluster 2024-09-14T01:03:18.662641+0000 mgr.a (mgr.14355) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:20 smithi007 bash[22722]: cluster 2024-09-14T01:03:18.662641+0000 mgr.a (mgr.14355) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:22 smithi131 bash[24745]: cluster 2024-09-14T01:03:20.664809+0000 mgr.a (mgr.14355) 7025 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:22 smithi171 bash[25040]: cluster 2024-09-14T01:03:20.664809+0000 mgr.a (mgr.14355) 7025 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:22 smithi007 bash[22722]: cluster 2024-09-14T01:03:20.664809+0000 mgr.a (mgr.14355) 7025 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:23.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:23.368 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:24.155 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:24.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:24.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:24.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:24.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:24 smithi131 bash[24745]: cluster 2024-09-14T01:03:22.665569+0000 mgr.a (mgr.14355) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:24 smithi171 bash[25040]: cluster 2024-09-14T01:03:22.665569+0000 mgr.a (mgr.14355) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:24 smithi007 bash[22722]: cluster 2024-09-14T01:03:22.665569+0000 mgr.a (mgr.14355) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:25 smithi131 bash[24745]: audit 2024-09-14T01:03:23.703225+0000 mgr.a (mgr.14355) 7027 : audit [DBG] from='client.159609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:25 smithi171 bash[25040]: audit 2024-09-14T01:03:23.703225+0000 mgr.a (mgr.14355) 7027 : audit [DBG] from='client.159609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:25 smithi007 bash[22722]: audit 2024-09-14T01:03:23.703225+0000 mgr.a (mgr.14355) 7027 : audit [DBG] from='client.159609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:26 smithi131 bash[24745]: cluster 2024-09-14T01:03:24.666554+0000 mgr.a (mgr.14355) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:26 smithi171 bash[25040]: cluster 2024-09-14T01:03:24.666554+0000 mgr.a (mgr.14355) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:26 smithi007 bash[22722]: cluster 2024-09-14T01:03:24.666554+0000 mgr.a (mgr.14355) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:28 smithi131 bash[24745]: cluster 2024-09-14T01:03:26.668808+0000 mgr.a (mgr.14355) 7029 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:28 smithi171 bash[25040]: cluster 2024-09-14T01:03:26.668808+0000 mgr.a (mgr.14355) 7029 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:28 smithi007 bash[22722]: cluster 2024-09-14T01:03:26.668808+0000 mgr.a (mgr.14355) 7029 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:29.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:29 smithi131 bash[24745]: audit 2024-09-14T01:03:28.355836+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:03:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:29 smithi131 bash[24745]: audit 2024-09-14T01:03:28.994373+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:29 smithi131 bash[24745]: audit 2024-09-14T01:03:28.999441+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:29 smithi171 bash[25040]: audit 2024-09-14T01:03:28.355836+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:03:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:29 smithi171 bash[25040]: audit 2024-09-14T01:03:28.994373+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:29 smithi171 bash[25040]: audit 2024-09-14T01:03:28.999441+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:29 smithi007 bash[22722]: audit 2024-09-14T01:03:28.355836+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:03:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:29 smithi007 bash[22722]: audit 2024-09-14T01:03:28.994373+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:29 smithi007 bash[22722]: audit 2024-09-14T01:03:28.999441+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:29.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:29.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:30 smithi131 bash[24745]: cluster 2024-09-14T01:03:28.669544+0000 mgr.a (mgr.14355) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:30 smithi131 bash[24745]: audit 2024-09-14T01:03:29.787294+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:03:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:30 smithi131 bash[24745]: audit 2024-09-14T01:03:29.788354+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:03:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:30 smithi131 bash[24745]: audit 2024-09-14T01:03:29.794314+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:30 smithi131 bash[24745]: audit 2024-09-14T01:03:29.796912+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:30 smithi171 bash[25040]: cluster 2024-09-14T01:03:28.669544+0000 mgr.a (mgr.14355) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:30 smithi171 bash[25040]: audit 2024-09-14T01:03:29.787294+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:03:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:30 smithi171 bash[25040]: audit 2024-09-14T01:03:29.788354+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:03:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:30 smithi171 bash[25040]: audit 2024-09-14T01:03:29.794314+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:30 smithi171 bash[25040]: audit 2024-09-14T01:03:29.796912+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:30.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22722]: cluster 2024-09-14T01:03:28.669544+0000 mgr.a (mgr.14355) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:30.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22722]: audit 2024-09-14T01:03:29.787294+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:03:30.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22722]: audit 2024-09-14T01:03:29.788354+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:03:30.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22722]: audit 2024-09-14T01:03:29.794314+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:03:30.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22722]: audit 2024-09-14T01:03:29.796912+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22972]: debug 2024-09-14T01:03:30.590+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:03:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:03:30 smithi007 bash[22972]: debug 2024-09-14T01:03:30.590+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:03:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:31 smithi131 bash[24745]: audit 2024-09-14T01:03:29.488675+0000 mgr.a (mgr.14355) 7031 : audit [DBG] from='client.159681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:31 smithi131 bash[24745]: audit 2024-09-14T01:03:29.797971+0000 mgr.a (mgr.14355) 7032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:31 smithi171 bash[25040]: audit 2024-09-14T01:03:29.488675+0000 mgr.a (mgr.14355) 7031 : audit [DBG] from='client.159681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:31 smithi171 bash[25040]: audit 2024-09-14T01:03:29.797971+0000 mgr.a (mgr.14355) 7032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:31 smithi007 bash[22722]: audit 2024-09-14T01:03:29.488675+0000 mgr.a (mgr.14355) 7031 : audit [DBG] from='client.159681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:31 smithi007 bash[22722]: audit 2024-09-14T01:03:29.797971+0000 mgr.a (mgr.14355) 7032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:03:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:32 smithi131 bash[24745]: audit 2024-09-14T01:03:30.596070+0000 mgr.a (mgr.14355) 7033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:03:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:32 smithi131 bash[24745]: cephadm 2024-09-14T01:03:30.597541+0000 mgr.a (mgr.14355) 7034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:03:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:32 smithi131 bash[24745]: cluster 2024-09-14T01:03:30.672315+0000 mgr.a (mgr.14355) 7035 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:03:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:32 smithi171 bash[25040]: audit 2024-09-14T01:03:30.596070+0000 mgr.a (mgr.14355) 7033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:03:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:32 smithi171 bash[25040]: cephadm 2024-09-14T01:03:30.597541+0000 mgr.a (mgr.14355) 7034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:03:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:32 smithi171 bash[25040]: cluster 2024-09-14T01:03:30.672315+0000 mgr.a (mgr.14355) 7035 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:03:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:32 smithi007 bash[22722]: audit 2024-09-14T01:03:30.596070+0000 mgr.a (mgr.14355) 7033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:03:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:32 smithi007 bash[22722]: cephadm 2024-09-14T01:03:30.597541+0000 mgr.a (mgr.14355) 7034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:03:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:32 smithi007 bash[22722]: cluster 2024-09-14T01:03:30.672315+0000 mgr.a (mgr.14355) 7035 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:03:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:34 smithi131 bash[24745]: cluster 2024-09-14T01:03:32.673105+0000 mgr.a (mgr.14355) 7036 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:34 smithi171 bash[25040]: cluster 2024-09-14T01:03:32.673105+0000 mgr.a (mgr.14355) 7036 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:34 smithi007 bash[22722]: cluster 2024-09-14T01:03:32.673105+0000 mgr.a (mgr.14355) 7036 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:34.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:34.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:34.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:35.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:35.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:35.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:35.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:35.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:36 smithi131 bash[24745]: cluster 2024-09-14T01:03:34.673840+0000 mgr.a (mgr.14355) 7037 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:36 smithi131 bash[24745]: audit 2024-09-14T01:03:35.237471+0000 mgr.a (mgr.14355) 7038 : audit [DBG] from='client.159867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:36 smithi171 bash[25040]: cluster 2024-09-14T01:03:34.673840+0000 mgr.a (mgr.14355) 7037 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:36 smithi171 bash[25040]: audit 2024-09-14T01:03:35.237471+0000 mgr.a (mgr.14355) 7038 : audit [DBG] from='client.159867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:36 smithi007 bash[22722]: cluster 2024-09-14T01:03:34.673840+0000 mgr.a (mgr.14355) 7037 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:03:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:36 smithi007 bash[22722]: audit 2024-09-14T01:03:35.237471+0000 mgr.a (mgr.14355) 7038 : audit [DBG] from='client.159867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:38 smithi131 bash[24745]: cluster 2024-09-14T01:03:36.676632+0000 mgr.a (mgr.14355) 7039 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:38 smithi171 bash[25040]: cluster 2024-09-14T01:03:36.676632+0000 mgr.a (mgr.14355) 7039 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:38 smithi007 bash[22722]: cluster 2024-09-14T01:03:36.676632+0000 mgr.a (mgr.14355) 7039 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:40 smithi131 bash[24745]: cluster 2024-09-14T01:03:38.677421+0000 mgr.a (mgr.14355) 7040 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:03:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:40 smithi171 bash[25040]: cluster 2024-09-14T01:03:38.677421+0000 mgr.a (mgr.14355) 7040 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:03:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:40.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:40.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:40 smithi007 bash[22722]: cluster 2024-09-14T01:03:38.677421+0000 mgr.a (mgr.14355) 7040 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:03:41.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:41.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:41.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:42 smithi171 bash[25040]: cluster 2024-09-14T01:03:40.679435+0000 mgr.a (mgr.14355) 7041 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:42 smithi171 bash[25040]: audit 2024-09-14T01:03:40.983106+0000 mgr.a (mgr.14355) 7042 : audit [DBG] from='client.159945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:42 smithi007 bash[22722]: cluster 2024-09-14T01:03:40.679435+0000 mgr.a (mgr.14355) 7041 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:42 smithi007 bash[22722]: audit 2024-09-14T01:03:40.983106+0000 mgr.a (mgr.14355) 7042 : audit [DBG] from='client.159945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:42 smithi131 bash[24745]: cluster 2024-09-14T01:03:40.679435+0000 mgr.a (mgr.14355) 7041 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:03:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:42 smithi131 bash[24745]: audit 2024-09-14T01:03:40.983106+0000 mgr.a (mgr.14355) 7042 : audit [DBG] from='client.159945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:44.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:44 smithi171 bash[25040]: cluster 2024-09-14T01:03:42.680424+0000 mgr.a (mgr.14355) 7043 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:44 smithi007 bash[22722]: cluster 2024-09-14T01:03:42.680424+0000 mgr.a (mgr.14355) 7043 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:44 smithi131 bash[24745]: cluster 2024-09-14T01:03:42.680424+0000 mgr.a (mgr.14355) 7043 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:46.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:46.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:46.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:46 smithi171 bash[25040]: cluster 2024-09-14T01:03:44.681200+0000 mgr.a (mgr.14355) 7044 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:46 smithi007 bash[22722]: cluster 2024-09-14T01:03:44.681200+0000 mgr.a (mgr.14355) 7044 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:46 smithi131 bash[24745]: cluster 2024-09-14T01:03:44.681200+0000 mgr.a (mgr.14355) 7044 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:47.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:47.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:48 smithi007 bash[22722]: cluster 2024-09-14T01:03:46.682567+0000 mgr.a (mgr.14355) 7045 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:48 smithi007 bash[22722]: audit 2024-09-14T01:03:46.728594+0000 mgr.a (mgr.14355) 7046 : audit [DBG] from='client.160023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:48 smithi131 bash[24745]: cluster 2024-09-14T01:03:46.682567+0000 mgr.a (mgr.14355) 7045 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:48 smithi131 bash[24745]: audit 2024-09-14T01:03:46.728594+0000 mgr.a (mgr.14355) 7046 : audit [DBG] from='client.160023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:48 smithi171 bash[25040]: cluster 2024-09-14T01:03:46.682567+0000 mgr.a (mgr.14355) 7045 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:03:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:48 smithi171 bash[25040]: audit 2024-09-14T01:03:46.728594+0000 mgr.a (mgr.14355) 7046 : audit [DBG] from='client.160023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:50 smithi007 bash[22722]: cluster 2024-09-14T01:03:48.683467+0000 mgr.a (mgr.14355) 7047 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:50 smithi131 bash[24745]: cluster 2024-09-14T01:03:48.683467+0000 mgr.a (mgr.14355) 7047 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:50 smithi171 bash[25040]: cluster 2024-09-14T01:03:48.683467+0000 mgr.a (mgr.14355) 7047 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:51 smithi007 bash[22722]: cluster 2024-09-14T01:03:50.685635+0000 mgr.a (mgr.14355) 7048 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:51 smithi131 bash[24745]: cluster 2024-09-14T01:03:50.685635+0000 mgr.a (mgr.14355) 7048 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:51 smithi171 bash[25040]: cluster 2024-09-14T01:03:50.685635+0000 mgr.a (mgr.14355) 7048 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:52.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:52.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:52.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:52.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:52.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:53 smithi131 bash[24745]: audit 2024-09-14T01:03:52.503489+0000 mgr.a (mgr.14355) 7049 : audit [DBG] from='client.160098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:53 smithi131 bash[24745]: cluster 2024-09-14T01:03:52.686197+0000 mgr.a (mgr.14355) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:53 smithi171 bash[25040]: audit 2024-09-14T01:03:52.503489+0000 mgr.a (mgr.14355) 7049 : audit [DBG] from='client.160098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:53 smithi171 bash[25040]: cluster 2024-09-14T01:03:52.686197+0000 mgr.a (mgr.14355) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:53 smithi007 bash[22722]: audit 2024-09-14T01:03:52.503489+0000 mgr.a (mgr.14355) 7049 : audit [DBG] from='client.160098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:53 smithi007 bash[22722]: cluster 2024-09-14T01:03:52.686197+0000 mgr.a (mgr.14355) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:55 smithi131 bash[24745]: cluster 2024-09-14T01:03:54.687084+0000 mgr.a (mgr.14355) 7051 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:55 smithi171 bash[25040]: cluster 2024-09-14T01:03:54.687084+0000 mgr.a (mgr.14355) 7051 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:55 smithi007 bash[22722]: cluster 2024-09-14T01:03:54.687084+0000 mgr.a (mgr.14355) 7051 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:03:57.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:03:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:03:57.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:03:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:57 smithi131 bash[24745]: cluster 2024-09-14T01:03:56.689367+0000 mgr.a (mgr.14355) 7052 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:58.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:57 smithi171 bash[25040]: cluster 2024-09-14T01:03:56.689367+0000 mgr.a (mgr.14355) 7052 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:57 smithi007 bash[22722]: cluster 2024-09-14T01:03:56.689367+0000 mgr.a (mgr.14355) 7052 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:03:58.701 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:03:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:03:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:03:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:03:58.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:03:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:58 smithi131 bash[24745]: audit 2024-09-14T01:03:58.259250+0000 mgr.a (mgr.14355) 7053 : audit [DBG] from='client.160170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:58 smithi171 bash[25040]: audit 2024-09-14T01:03:58.259250+0000 mgr.a (mgr.14355) 7053 : audit [DBG] from='client.160170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:03:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:58 smithi007 bash[22722]: audit 2024-09-14T01:03:58.259250+0000 mgr.a (mgr.14355) 7053 : audit [DBG] from='client.160170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:03:59 smithi131 bash[24745]: cluster 2024-09-14T01:03:58.689845+0000 mgr.a (mgr.14355) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:03:59 smithi171 bash[25040]: cluster 2024-09-14T01:03:58.689845+0000 mgr.a (mgr.14355) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:03:59 smithi007 bash[22722]: cluster 2024-09-14T01:03:58.689845+0000 mgr.a (mgr.14355) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:01 smithi131 bash[24745]: cluster 2024-09-14T01:04:00.692016+0000 mgr.a (mgr.14355) 7055 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:01 smithi171 bash[25040]: cluster 2024-09-14T01:04:00.692016+0000 mgr.a (mgr.14355) 7055 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:01 smithi007 bash[22722]: cluster 2024-09-14T01:04:00.692016+0000 mgr.a (mgr.14355) 7055 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:03 smithi131 bash[24745]: cluster 2024-09-14T01:04:02.692778+0000 mgr.a (mgr.14355) 7056 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:03 smithi171 bash[25040]: cluster 2024-09-14T01:04:02.692778+0000 mgr.a (mgr.14355) 7056 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:03 smithi007 bash[22722]: cluster 2024-09-14T01:04:02.692778+0000 mgr.a (mgr.14355) 7056 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:04.469 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:04 smithi131 bash[24745]: audit 2024-09-14T01:04:04.038023+0000 mgr.a (mgr.14355) 7057 : audit [DBG] from='client.160248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:04 smithi171 bash[25040]: audit 2024-09-14T01:04:04.038023+0000 mgr.a (mgr.14355) 7057 : audit [DBG] from='client.160248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:04 smithi007 bash[22722]: audit 2024-09-14T01:04:04.038023+0000 mgr.a (mgr.14355) 7057 : audit [DBG] from='client.160248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:06.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:05 smithi131 bash[24745]: cluster 2024-09-14T01:04:04.693709+0000 mgr.a (mgr.14355) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:05 smithi171 bash[25040]: cluster 2024-09-14T01:04:04.693709+0000 mgr.a (mgr.14355) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:05 smithi007 bash[22722]: cluster 2024-09-14T01:04:04.693709+0000 mgr.a (mgr.14355) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:07 smithi131 bash[24745]: cluster 2024-09-14T01:04:06.695975+0000 mgr.a (mgr.14355) 7059 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:07 smithi171 bash[25040]: cluster 2024-09-14T01:04:06.695975+0000 mgr.a (mgr.14355) 7059 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:07 smithi007 bash[22722]: cluster 2024-09-14T01:04:06.695975+0000 mgr.a (mgr.14355) 7059 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:09.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:09.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:09.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:09 smithi171 bash[25040]: cluster 2024-09-14T01:04:08.696761+0000 mgr.a (mgr.14355) 7060 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:09 smithi007 bash[22722]: cluster 2024-09-14T01:04:08.696761+0000 mgr.a (mgr.14355) 7060 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:10.215 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:10.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:10.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:10.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:10.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:09 smithi131 bash[24745]: cluster 2024-09-14T01:04:08.696761+0000 mgr.a (mgr.14355) 7060 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:10 smithi171 bash[25040]: audit 2024-09-14T01:04:09.804379+0000 mgr.a (mgr.14355) 7061 : audit [DBG] from='client.160326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:10 smithi007 bash[22722]: audit 2024-09-14T01:04:09.804379+0000 mgr.a (mgr.14355) 7061 : audit [DBG] from='client.160326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:10 smithi131 bash[24745]: audit 2024-09-14T01:04:09.804379+0000 mgr.a (mgr.14355) 7061 : audit [DBG] from='client.160326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:11 smithi007 bash[22722]: cluster 2024-09-14T01:04:10.699120+0000 mgr.a (mgr.14355) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:11 smithi131 bash[24745]: cluster 2024-09-14T01:04:10.699120+0000 mgr.a (mgr.14355) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:11 smithi171 bash[25040]: cluster 2024-09-14T01:04:10.699120+0000 mgr.a (mgr.14355) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:13 smithi007 bash[22722]: cluster 2024-09-14T01:04:12.699924+0000 mgr.a (mgr.14355) 7063 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:13 smithi131 bash[24745]: cluster 2024-09-14T01:04:12.699924+0000 mgr.a (mgr.14355) 7063 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:13 smithi171 bash[25040]: cluster 2024-09-14T01:04:12.699924+0000 mgr.a (mgr.14355) 7063 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:15.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:15.217 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:15.217 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:16.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:16.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:16.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:16.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:16.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:15 smithi007 bash[22722]: cluster 2024-09-14T01:04:14.700678+0000 mgr.a (mgr.14355) 7064 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:15 smithi131 bash[24745]: cluster 2024-09-14T01:04:14.700678+0000 mgr.a (mgr.14355) 7064 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:15 smithi171 bash[25040]: cluster 2024-09-14T01:04:14.700678+0000 mgr.a (mgr.14355) 7064 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:16 smithi007 bash[22722]: audit 2024-09-14T01:04:15.550058+0000 mgr.a (mgr.14355) 7065 : audit [DBG] from='client.160404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:16 smithi131 bash[24745]: audit 2024-09-14T01:04:15.550058+0000 mgr.a (mgr.14355) 7065 : audit [DBG] from='client.160404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:16 smithi171 bash[25040]: audit 2024-09-14T01:04:15.550058+0000 mgr.a (mgr.14355) 7065 : audit [DBG] from='client.160404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:17 smithi007 bash[22722]: cluster 2024-09-14T01:04:16.703503+0000 mgr.a (mgr.14355) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:17 smithi131 bash[24745]: cluster 2024-09-14T01:04:16.703503+0000 mgr.a (mgr.14355) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:17 smithi171 bash[25040]: cluster 2024-09-14T01:04:16.703503+0000 mgr.a (mgr.14355) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:19 smithi007 bash[22722]: cluster 2024-09-14T01:04:18.704294+0000 mgr.a (mgr.14355) 7067 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:19 smithi131 bash[24745]: cluster 2024-09-14T01:04:18.704294+0000 mgr.a (mgr.14355) 7067 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:19 smithi171 bash[25040]: cluster 2024-09-14T01:04:18.704294+0000 mgr.a (mgr.14355) 7067 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:21.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:21.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:21.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:21.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:21.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:21 smithi007 bash[22722]: cluster 2024-09-14T01:04:20.706224+0000 mgr.a (mgr.14355) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:21 smithi131 bash[24745]: cluster 2024-09-14T01:04:20.706224+0000 mgr.a (mgr.14355) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:21 smithi171 bash[25040]: cluster 2024-09-14T01:04:20.706224+0000 mgr.a (mgr.14355) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:22 smithi007 bash[22722]: audit 2024-09-14T01:04:21.343334+0000 mgr.a (mgr.14355) 7069 : audit [DBG] from='client.160479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:22 smithi131 bash[24745]: audit 2024-09-14T01:04:21.343334+0000 mgr.a (mgr.14355) 7069 : audit [DBG] from='client.160479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:22 smithi171 bash[25040]: audit 2024-09-14T01:04:21.343334+0000 mgr.a (mgr.14355) 7069 : audit [DBG] from='client.160479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:23 smithi007 bash[22722]: cluster 2024-09-14T01:04:22.707223+0000 mgr.a (mgr.14355) 7070 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:23 smithi131 bash[24745]: cluster 2024-09-14T01:04:22.707223+0000 mgr.a (mgr.14355) 7070 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:23 smithi171 bash[25040]: cluster 2024-09-14T01:04:22.707223+0000 mgr.a (mgr.14355) 7070 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:04:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:25 smithi007 bash[22722]: cluster 2024-09-14T01:04:24.708074+0000 mgr.a (mgr.14355) 7071 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:04:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:25 smithi131 bash[24745]: cluster 2024-09-14T01:04:24.708074+0000 mgr.a (mgr.14355) 7071 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:04:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:25 smithi171 bash[25040]: cluster 2024-09-14T01:04:24.708074+0000 mgr.a (mgr.14355) 7071 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:04:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:27.547 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:27 smithi007 bash[22722]: cluster 2024-09-14T01:04:26.710431+0000 mgr.a (mgr.14355) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:27 smithi007 bash[22722]: audit 2024-09-14T01:04:27.109472+0000 mgr.a (mgr.14355) 7073 : audit [DBG] from='client.160557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:27 smithi131 bash[24745]: cluster 2024-09-14T01:04:26.710431+0000 mgr.a (mgr.14355) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:27 smithi131 bash[24745]: audit 2024-09-14T01:04:27.109472+0000 mgr.a (mgr.14355) 7073 : audit [DBG] from='client.160557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:27 smithi171 bash[25040]: cluster 2024-09-14T01:04:26.710431+0000 mgr.a (mgr.14355) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:27 smithi171 bash[25040]: audit 2024-09-14T01:04:27.109472+0000 mgr.a (mgr.14355) 7073 : audit [DBG] from='client.160557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:29 smithi007 bash[22722]: cluster 2024-09-14T01:04:28.711383+0000 mgr.a (mgr.14355) 7074 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:29 smithi131 bash[24745]: cluster 2024-09-14T01:04:28.711383+0000 mgr.a (mgr.14355) 7074 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:29 smithi171 bash[25040]: cluster 2024-09-14T01:04:28.711383+0000 mgr.a (mgr.14355) 7074 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:30 smithi007 bash[22722]: audit 2024-09-14T01:04:30.659544+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:04:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:30 smithi131 bash[24745]: audit 2024-09-14T01:04:30.659544+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:04:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:30 smithi171 bash[25040]: audit 2024-09-14T01:04:30.659544+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: cluster 2024-09-14T01:04:30.712999+0000 mgr.a (mgr.14355) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.291608+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.294983+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.300033+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.305749+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.996902+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:31.998689+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:04:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:32.008637+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:32 smithi171 bash[25040]: audit 2024-09-14T01:04:32.013523+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: cluster 2024-09-14T01:04:30.712999+0000 mgr.a (mgr.14355) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.291608+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.294983+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.300033+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.305749+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.996902+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:31.998689+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:32.008637+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22722]: audit 2024-09-14T01:04:32.013523+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: cluster 2024-09-14T01:04:30.712999+0000 mgr.a (mgr.14355) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:04:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.291608+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.294983+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.300033+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.305749+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.996902+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:31.998689+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:32.008637+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:32 smithi131 bash[24745]: audit 2024-09-14T01:04:32.013523+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:33.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22972]: debug 2024-09-14T01:04:32.749+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:04:33.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:04:32 smithi007 bash[22972]: debug 2024-09-14T01:04:32.749+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:04:33.269 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:33.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:33 smithi007 bash[22722]: audit 2024-09-14T01:04:32.014744+0000 mgr.a (mgr.14355) 7076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:33 smithi131 bash[24745]: audit 2024-09-14T01:04:32.014744+0000 mgr.a (mgr.14355) 7076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:33 smithi171 bash[25040]: audit 2024-09-14T01:04:32.014744+0000 mgr.a (mgr.14355) 7076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:04:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:34 smithi007 bash[22722]: cluster 2024-09-14T01:04:32.713607+0000 mgr.a (mgr.14355) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:34 smithi007 bash[22722]: audit 2024-09-14T01:04:32.750784+0000 mgr.a (mgr.14355) 7078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:04:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:34 smithi007 bash[22722]: cephadm 2024-09-14T01:04:32.751975+0000 mgr.a (mgr.14355) 7079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:04:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:34 smithi007 bash[22722]: audit 2024-09-14T01:04:32.867017+0000 mgr.a (mgr.14355) 7080 : audit [DBG] from='client.160740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:34 smithi131 bash[24745]: cluster 2024-09-14T01:04:32.713607+0000 mgr.a (mgr.14355) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:34 smithi131 bash[24745]: audit 2024-09-14T01:04:32.750784+0000 mgr.a (mgr.14355) 7078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:34 smithi131 bash[24745]: cephadm 2024-09-14T01:04:32.751975+0000 mgr.a (mgr.14355) 7079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:04:34.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:34 smithi131 bash[24745]: audit 2024-09-14T01:04:32.867017+0000 mgr.a (mgr.14355) 7080 : audit [DBG] from='client.160740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:34 smithi171 bash[25040]: cluster 2024-09-14T01:04:32.713607+0000 mgr.a (mgr.14355) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:34 smithi171 bash[25040]: audit 2024-09-14T01:04:32.750784+0000 mgr.a (mgr.14355) 7078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:04:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:34 smithi171 bash[25040]: cephadm 2024-09-14T01:04:32.751975+0000 mgr.a (mgr.14355) 7079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:04:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:34 smithi171 bash[25040]: audit 2024-09-14T01:04:32.867017+0000 mgr.a (mgr.14355) 7080 : audit [DBG] from='client.160740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:36 smithi007 bash[22722]: cluster 2024-09-14T01:04:34.714484+0000 mgr.a (mgr.14355) 7081 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:36 smithi131 bash[24745]: cluster 2024-09-14T01:04:34.714484+0000 mgr.a (mgr.14355) 7081 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:36 smithi171 bash[25040]: cluster 2024-09-14T01:04:34.714484+0000 mgr.a (mgr.14355) 7081 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:38.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:38 smithi007 bash[22722]: cluster 2024-09-14T01:04:36.716698+0000 mgr.a (mgr.14355) 7082 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:38 smithi131 bash[24745]: cluster 2024-09-14T01:04:36.716698+0000 mgr.a (mgr.14355) 7082 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:38 smithi171 bash[25040]: cluster 2024-09-14T01:04:36.716698+0000 mgr.a (mgr.14355) 7082 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:39.023 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:39 smithi007 bash[22722]: audit 2024-09-14T01:04:38.607897+0000 mgr.a (mgr.14355) 7083 : audit [DBG] from='client.160818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:39 smithi007 bash[22722]: cluster 2024-09-14T01:04:38.717177+0000 mgr.a (mgr.14355) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:39 smithi131 bash[24745]: audit 2024-09-14T01:04:38.607897+0000 mgr.a (mgr.14355) 7083 : audit [DBG] from='client.160818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:39 smithi131 bash[24745]: cluster 2024-09-14T01:04:38.717177+0000 mgr.a (mgr.14355) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:39 smithi171 bash[25040]: audit 2024-09-14T01:04:38.607897+0000 mgr.a (mgr.14355) 7083 : audit [DBG] from='client.160818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:39 smithi171 bash[25040]: cluster 2024-09-14T01:04:38.717177+0000 mgr.a (mgr.14355) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:41 smithi131 bash[24745]: cluster 2024-09-14T01:04:40.719425+0000 mgr.a (mgr.14355) 7085 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:42.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:41 smithi171 bash[25040]: cluster 2024-09-14T01:04:40.719425+0000 mgr.a (mgr.14355) 7085 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:41 smithi007 bash[22722]: cluster 2024-09-14T01:04:40.719425+0000 mgr.a (mgr.14355) 7085 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:44.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:44.026 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:43 smithi131 bash[24745]: cluster 2024-09-14T01:04:42.720244+0000 mgr.a (mgr.14355) 7086 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:43 smithi171 bash[25040]: cluster 2024-09-14T01:04:42.720244+0000 mgr.a (mgr.14355) 7086 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:43 smithi007 bash[22722]: cluster 2024-09-14T01:04:42.720244+0000 mgr.a (mgr.14355) 7086 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:44.769 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:45 smithi171 bash[25040]: audit 2024-09-14T01:04:44.355174+0000 mgr.a (mgr.14355) 7087 : audit [DBG] from='client.160896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:45 smithi171 bash[25040]: cluster 2024-09-14T01:04:44.720880+0000 mgr.a (mgr.14355) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:45 smithi007 bash[22722]: audit 2024-09-14T01:04:44.355174+0000 mgr.a (mgr.14355) 7087 : audit [DBG] from='client.160896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:45 smithi007 bash[22722]: cluster 2024-09-14T01:04:44.720880+0000 mgr.a (mgr.14355) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:45 smithi131 bash[24745]: audit 2024-09-14T01:04:44.355174+0000 mgr.a (mgr.14355) 7087 : audit [DBG] from='client.160896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:45 smithi131 bash[24745]: cluster 2024-09-14T01:04:44.720880+0000 mgr.a (mgr.14355) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:47 smithi171 bash[25040]: cluster 2024-09-14T01:04:46.723266+0000 mgr.a (mgr.14355) 7089 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:47 smithi007 bash[22722]: cluster 2024-09-14T01:04:46.723266+0000 mgr.a (mgr.14355) 7089 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:47 smithi131 bash[24745]: cluster 2024-09-14T01:04:46.723266+0000 mgr.a (mgr.14355) 7089 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:04:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:49 smithi171 bash[25040]: cluster 2024-09-14T01:04:48.724073+0000 mgr.a (mgr.14355) 7090 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:50.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:49 smithi007 bash[22722]: cluster 2024-09-14T01:04:48.724073+0000 mgr.a (mgr.14355) 7090 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:49 smithi131 bash[24745]: cluster 2024-09-14T01:04:48.724073+0000 mgr.a (mgr.14355) 7090 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:50 smithi007 bash[22722]: audit 2024-09-14T01:04:50.100238+0000 mgr.a (mgr.14355) 7091 : audit [DBG] from='client.160974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:50 smithi131 bash[24745]: audit 2024-09-14T01:04:50.100238+0000 mgr.a (mgr.14355) 7091 : audit [DBG] from='client.160974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:50 smithi171 bash[25040]: audit 2024-09-14T01:04:50.100238+0000 mgr.a (mgr.14355) 7091 : audit [DBG] from='client.160974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:52.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:51 smithi007 bash[22722]: cluster 2024-09-14T01:04:50.726909+0000 mgr.a (mgr.14355) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:04:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:51 smithi131 bash[24745]: cluster 2024-09-14T01:04:50.726909+0000 mgr.a (mgr.14355) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:04:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:51 smithi171 bash[25040]: cluster 2024-09-14T01:04:50.726909+0000 mgr.a (mgr.14355) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:04:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:53 smithi007 bash[22722]: cluster 2024-09-14T01:04:52.727698+0000 mgr.a (mgr.14355) 7093 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:53 smithi131 bash[24745]: cluster 2024-09-14T01:04:52.727698+0000 mgr.a (mgr.14355) 7093 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:53 smithi171 bash[25040]: cluster 2024-09-14T01:04:52.727698+0000 mgr.a (mgr.14355) 7093 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:04:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:04:55.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:04:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:55 smithi007 bash[22722]: cluster 2024-09-14T01:04:54.728468+0000 mgr.a (mgr.14355) 7094 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:55 smithi131 bash[24745]: cluster 2024-09-14T01:04:54.728468+0000 mgr.a (mgr.14355) 7094 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:55 smithi171 bash[25040]: cluster 2024-09-14T01:04:54.728468+0000 mgr.a (mgr.14355) 7094 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:04:56.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:04:56.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:04:56.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:04:56.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:04:56.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:04:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:56 smithi007 bash[22722]: audit 2024-09-14T01:04:55.858949+0000 mgr.a (mgr.14355) 7095 : audit [DBG] from='client.161052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:56 smithi131 bash[24745]: audit 2024-09-14T01:04:55.858949+0000 mgr.a (mgr.14355) 7095 : audit [DBG] from='client.161052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:56 smithi171 bash[25040]: audit 2024-09-14T01:04:55.858949+0000 mgr.a (mgr.14355) 7095 : audit [DBG] from='client.161052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:04:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:57 smithi007 bash[22722]: cluster 2024-09-14T01:04:56.731405+0000 mgr.a (mgr.14355) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:57 smithi131 bash[24745]: cluster 2024-09-14T01:04:56.731405+0000 mgr.a (mgr.14355) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:04:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:57 smithi171 bash[25040]: cluster 2024-09-14T01:04:56.731405+0000 mgr.a (mgr.14355) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:04:59 smithi007 bash[22722]: cluster 2024-09-14T01:04:58.732190+0000 mgr.a (mgr.14355) 7097 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:05:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:04:59 smithi131 bash[24745]: cluster 2024-09-14T01:04:58.732190+0000 mgr.a (mgr.14355) 7097 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:05:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:04:59 smithi171 bash[25040]: cluster 2024-09-14T01:04:58.732190+0000 mgr.a (mgr.14355) 7097 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:05:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:02.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:01 smithi007 bash[22722]: cluster 2024-09-14T01:05:00.734128+0000 mgr.a (mgr.14355) 7098 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:01 smithi131 bash[24745]: cluster 2024-09-14T01:05:00.734128+0000 mgr.a (mgr.14355) 7098 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:01 smithi171 bash[25040]: cluster 2024-09-14T01:05:00.734128+0000 mgr.a (mgr.14355) 7098 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:02 smithi007 bash[22722]: audit 2024-09-14T01:05:01.638826+0000 mgr.a (mgr.14355) 7099 : audit [DBG] from='client.161130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:02 smithi131 bash[24745]: audit 2024-09-14T01:05:01.638826+0000 mgr.a (mgr.14355) 7099 : audit [DBG] from='client.161130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:02 smithi171 bash[25040]: audit 2024-09-14T01:05:01.638826+0000 mgr.a (mgr.14355) 7099 : audit [DBG] from='client.161130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:04.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:03 smithi007 bash[22722]: cluster 2024-09-14T01:05:02.734998+0000 mgr.a (mgr.14355) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:03 smithi131 bash[24745]: cluster 2024-09-14T01:05:02.734998+0000 mgr.a (mgr.14355) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:03 smithi171 bash[25040]: cluster 2024-09-14T01:05:02.734998+0000 mgr.a (mgr.14355) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:05 smithi007 bash[22722]: cluster 2024-09-14T01:05:04.735786+0000 mgr.a (mgr.14355) 7101 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:05 smithi131 bash[24745]: cluster 2024-09-14T01:05:04.735786+0000 mgr.a (mgr.14355) 7101 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:05 smithi171 bash[25040]: cluster 2024-09-14T01:05:04.735786+0000 mgr.a (mgr.14355) 7101 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:05:07.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:07.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:07.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:07.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:07 smithi007 bash[22722]: cluster 2024-09-14T01:05:06.738010+0000 mgr.a (mgr.14355) 7102 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:05:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:07 smithi131 bash[24745]: cluster 2024-09-14T01:05:06.738010+0000 mgr.a (mgr.14355) 7102 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:05:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:07 smithi171 bash[25040]: cluster 2024-09-14T01:05:06.738010+0000 mgr.a (mgr.14355) 7102 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:05:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:08 smithi007 bash[22722]: audit 2024-09-14T01:05:07.414688+0000 mgr.a (mgr.14355) 7103 : audit [DBG] from='client.161205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:08 smithi131 bash[24745]: audit 2024-09-14T01:05:07.414688+0000 mgr.a (mgr.14355) 7103 : audit [DBG] from='client.161205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:08 smithi171 bash[25040]: audit 2024-09-14T01:05:07.414688+0000 mgr.a (mgr.14355) 7103 : audit [DBG] from='client.161205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:10.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:09 smithi007 bash[22722]: cluster 2024-09-14T01:05:08.738911+0000 mgr.a (mgr.14355) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:09 smithi131 bash[24745]: cluster 2024-09-14T01:05:08.738911+0000 mgr.a (mgr.14355) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:09 smithi171 bash[25040]: cluster 2024-09-14T01:05:08.738911+0000 mgr.a (mgr.14355) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:11 smithi007 bash[22722]: cluster 2024-09-14T01:05:10.741027+0000 mgr.a (mgr.14355) 7105 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:11 smithi131 bash[24745]: cluster 2024-09-14T01:05:10.741027+0000 mgr.a (mgr.14355) 7105 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:11 smithi171 bash[25040]: cluster 2024-09-14T01:05:10.741027+0000 mgr.a (mgr.14355) 7105 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:13.580 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:13.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:13.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:13.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:13 smithi007 bash[22722]: cluster 2024-09-14T01:05:12.741791+0000 mgr.a (mgr.14355) 7106 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:13 smithi007 bash[22722]: audit 2024-09-14T01:05:13.179722+0000 mgr.a (mgr.14355) 7107 : audit [DBG] from='client.161280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:13 smithi131 bash[24745]: cluster 2024-09-14T01:05:12.741791+0000 mgr.a (mgr.14355) 7106 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:13 smithi131 bash[24745]: audit 2024-09-14T01:05:13.179722+0000 mgr.a (mgr.14355) 7107 : audit [DBG] from='client.161280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:13 smithi171 bash[25040]: cluster 2024-09-14T01:05:12.741791+0000 mgr.a (mgr.14355) 7106 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:13 smithi171 bash[25040]: audit 2024-09-14T01:05:13.179722+0000 mgr.a (mgr.14355) 7107 : audit [DBG] from='client.161280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:15 smithi007 bash[22722]: cluster 2024-09-14T01:05:14.742660+0000 mgr.a (mgr.14355) 7108 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:15 smithi131 bash[24745]: cluster 2024-09-14T01:05:14.742660+0000 mgr.a (mgr.14355) 7108 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:15 smithi171 bash[25040]: cluster 2024-09-14T01:05:14.742660+0000 mgr.a (mgr.14355) 7108 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:17 smithi007 bash[22722]: cluster 2024-09-14T01:05:16.745326+0000 mgr.a (mgr.14355) 7109 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:17 smithi131 bash[24745]: cluster 2024-09-14T01:05:16.745326+0000 mgr.a (mgr.14355) 7109 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:17 smithi171 bash[25040]: cluster 2024-09-14T01:05:16.745326+0000 mgr.a (mgr.14355) 7109 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:18.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:18.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:19.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:19 smithi007 bash[22722]: cluster 2024-09-14T01:05:18.746118+0000 mgr.a (mgr.14355) 7110 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:19 smithi007 bash[22722]: audit 2024-09-14T01:05:18.916333+0000 mgr.a (mgr.14355) 7111 : audit [DBG] from='client.161358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:19 smithi131 bash[24745]: cluster 2024-09-14T01:05:18.746118+0000 mgr.a (mgr.14355) 7110 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:19 smithi131 bash[24745]: audit 2024-09-14T01:05:18.916333+0000 mgr.a (mgr.14355) 7111 : audit [DBG] from='client.161358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:19 smithi171 bash[25040]: cluster 2024-09-14T01:05:18.746118+0000 mgr.a (mgr.14355) 7110 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:19 smithi171 bash[25040]: audit 2024-09-14T01:05:18.916333+0000 mgr.a (mgr.14355) 7111 : audit [DBG] from='client.161358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:21 smithi007 bash[22722]: cluster 2024-09-14T01:05:20.748366+0000 mgr.a (mgr.14355) 7112 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:21 smithi131 bash[24745]: cluster 2024-09-14T01:05:20.748366+0000 mgr.a (mgr.14355) 7112 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:21 smithi171 bash[25040]: cluster 2024-09-14T01:05:20.748366+0000 mgr.a (mgr.14355) 7112 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:23 smithi007 bash[22722]: cluster 2024-09-14T01:05:22.749136+0000 mgr.a (mgr.14355) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:23 smithi131 bash[24745]: cluster 2024-09-14T01:05:22.749136+0000 mgr.a (mgr.14355) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:23 smithi171 bash[25040]: cluster 2024-09-14T01:05:22.749136+0000 mgr.a (mgr.14355) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:24.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:25.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:25 smithi007 bash[22722]: audit 2024-09-14T01:05:24.698241+0000 mgr.a (mgr.14355) 7114 : audit [DBG] from='client.161436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:25 smithi007 bash[22722]: cluster 2024-09-14T01:05:24.750167+0000 mgr.a (mgr.14355) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:26.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:25 smithi131 bash[24745]: audit 2024-09-14T01:05:24.698241+0000 mgr.a (mgr.14355) 7114 : audit [DBG] from='client.161436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:26.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:25 smithi131 bash[24745]: cluster 2024-09-14T01:05:24.750167+0000 mgr.a (mgr.14355) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:25 smithi171 bash[25040]: audit 2024-09-14T01:05:24.698241+0000 mgr.a (mgr.14355) 7114 : audit [DBG] from='client.161436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:25 smithi171 bash[25040]: cluster 2024-09-14T01:05:24.750167+0000 mgr.a (mgr.14355) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:27 smithi007 bash[22722]: cluster 2024-09-14T01:05:26.752478+0000 mgr.a (mgr.14355) 7116 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:27 smithi131 bash[24745]: cluster 2024-09-14T01:05:26.752478+0000 mgr.a (mgr.14355) 7116 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:27 smithi171 bash[25040]: cluster 2024-09-14T01:05:26.752478+0000 mgr.a (mgr.14355) 7116 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:30.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:30.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:29 smithi007 bash[22722]: cluster 2024-09-14T01:05:28.753247+0000 mgr.a (mgr.14355) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:29 smithi131 bash[24745]: cluster 2024-09-14T01:05:28.753247+0000 mgr.a (mgr.14355) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:29 smithi171 bash[25040]: cluster 2024-09-14T01:05:28.753247+0000 mgr.a (mgr.14355) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:30.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:30.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:30.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:30.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:30.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:31 smithi007 bash[22722]: audit 2024-09-14T01:05:30.480539+0000 mgr.a (mgr.14355) 7118 : audit [DBG] from='client.161511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:31 smithi007 bash[22722]: cluster 2024-09-14T01:05:30.754530+0000 mgr.a (mgr.14355) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:31 smithi131 bash[24745]: audit 2024-09-14T01:05:30.480539+0000 mgr.a (mgr.14355) 7118 : audit [DBG] from='client.161511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:31 smithi131 bash[24745]: cluster 2024-09-14T01:05:30.754530+0000 mgr.a (mgr.14355) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:31 smithi171 bash[25040]: audit 2024-09-14T01:05:30.480539+0000 mgr.a (mgr.14355) 7118 : audit [DBG] from='client.161511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:31 smithi171 bash[25040]: cluster 2024-09-14T01:05:30.754530+0000 mgr.a (mgr.14355) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:33.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:32 smithi007 bash[22722]: audit 2024-09-14T01:05:32.800881+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:05:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:32 smithi131 bash[24745]: audit 2024-09-14T01:05:32.800881+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:05:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:32 smithi171 bash[25040]: audit 2024-09-14T01:05:32.800881+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:05:34.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:33 smithi007 bash[22722]: cluster 2024-09-14T01:05:32.755330+0000 mgr.a (mgr.14355) 7120 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:33 smithi007 bash[22722]: audit 2024-09-14T01:05:33.631507+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:05:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:33 smithi007 bash[22722]: audit 2024-09-14T01:05:33.633356+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:05:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:33 smithi007 bash[22722]: audit 2024-09-14T01:05:33.643913+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:05:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:33 smithi007 bash[22722]: audit 2024-09-14T01:05:33.648839+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:33 smithi131 bash[24745]: cluster 2024-09-14T01:05:32.755330+0000 mgr.a (mgr.14355) 7120 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:33 smithi131 bash[24745]: audit 2024-09-14T01:05:33.631507+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:05:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:33 smithi131 bash[24745]: audit 2024-09-14T01:05:33.633356+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:05:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:33 smithi131 bash[24745]: audit 2024-09-14T01:05:33.643913+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:05:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:33 smithi131 bash[24745]: audit 2024-09-14T01:05:33.648839+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:33 smithi171 bash[25040]: cluster 2024-09-14T01:05:32.755330+0000 mgr.a (mgr.14355) 7120 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:33 smithi171 bash[25040]: audit 2024-09-14T01:05:33.631507+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:05:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:33 smithi171 bash[25040]: audit 2024-09-14T01:05:33.633356+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:05:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:33 smithi171 bash[25040]: audit 2024-09-14T01:05:33.643913+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:05:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:33 smithi171 bash[25040]: audit 2024-09-14T01:05:33.648839+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:34.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:05:34 smithi007 bash[22972]: debug 2024-09-14T01:05:34.380+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:05:34.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:05:34 smithi007 bash[22972]: debug 2024-09-14T01:05:34.380+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:05:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:34 smithi007 bash[22722]: audit 2024-09-14T01:05:33.651287+0000 mgr.a (mgr.14355) 7121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:34 smithi131 bash[24745]: audit 2024-09-14T01:05:33.651287+0000 mgr.a (mgr.14355) 7121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:34 smithi171 bash[25040]: audit 2024-09-14T01:05:33.651287+0000 mgr.a (mgr.14355) 7121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:05:35.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:35.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:35.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:35 smithi007 bash[22722]: audit 2024-09-14T01:05:34.382621+0000 mgr.a (mgr.14355) 7122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:05:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:35 smithi007 bash[22722]: cephadm 2024-09-14T01:05:34.383909+0000 mgr.a (mgr.14355) 7123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:05:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:35 smithi007 bash[22722]: cluster 2024-09-14T01:05:34.756235+0000 mgr.a (mgr.14355) 7124 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:35 smithi131 bash[24745]: audit 2024-09-14T01:05:34.382621+0000 mgr.a (mgr.14355) 7122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:05:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:35 smithi131 bash[24745]: cephadm 2024-09-14T01:05:34.383909+0000 mgr.a (mgr.14355) 7123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:05:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:35 smithi131 bash[24745]: cluster 2024-09-14T01:05:34.756235+0000 mgr.a (mgr.14355) 7124 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:35 smithi171 bash[25040]: audit 2024-09-14T01:05:34.382621+0000 mgr.a (mgr.14355) 7122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:05:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:35 smithi171 bash[25040]: cephadm 2024-09-14T01:05:34.383909+0000 mgr.a (mgr.14355) 7123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:05:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:35 smithi171 bash[25040]: cluster 2024-09-14T01:05:34.756235+0000 mgr.a (mgr.14355) 7124 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:05:36.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:36.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:36.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:36.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:36.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:36 smithi007 bash[22722]: audit 2024-09-14T01:05:36.247840+0000 mgr.a (mgr.14355) 7125 : audit [DBG] from='client.161694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:36 smithi131 bash[24745]: audit 2024-09-14T01:05:36.247840+0000 mgr.a (mgr.14355) 7125 : audit [DBG] from='client.161694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:36 smithi171 bash[25040]: audit 2024-09-14T01:05:36.247840+0000 mgr.a (mgr.14355) 7125 : audit [DBG] from='client.161694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:37 smithi007 bash[22722]: cluster 2024-09-14T01:05:36.757552+0000 mgr.a (mgr.14355) 7126 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:37 smithi131 bash[24745]: cluster 2024-09-14T01:05:36.757552+0000 mgr.a (mgr.14355) 7126 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:37 smithi171 bash[25040]: cluster 2024-09-14T01:05:36.757552+0000 mgr.a (mgr.14355) 7126 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:39 smithi007 bash[22722]: cluster 2024-09-14T01:05:38.758280+0000 mgr.a (mgr.14355) 7127 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:05:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:39 smithi131 bash[24745]: cluster 2024-09-14T01:05:38.758280+0000 mgr.a (mgr.14355) 7127 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:05:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:39 smithi171 bash[25040]: cluster 2024-09-14T01:05:38.758280+0000 mgr.a (mgr.14355) 7127 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:05:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:41.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:42.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:41 smithi007 bash[22722]: cluster 2024-09-14T01:05:40.760223+0000 mgr.a (mgr.14355) 7128 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:41 smithi131 bash[24745]: cluster 2024-09-14T01:05:40.760223+0000 mgr.a (mgr.14355) 7128 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:41 smithi171 bash[25040]: cluster 2024-09-14T01:05:40.760223+0000 mgr.a (mgr.14355) 7128 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:42.468 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:42.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:42.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:42.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:42.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:42 smithi131 bash[24745]: audit 2024-09-14T01:05:42.025737+0000 mgr.a (mgr.14355) 7129 : audit [DBG] from='client.161766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:42 smithi171 bash[25040]: audit 2024-09-14T01:05:42.025737+0000 mgr.a (mgr.14355) 7129 : audit [DBG] from='client.161766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:42 smithi007 bash[22722]: audit 2024-09-14T01:05:42.025737+0000 mgr.a (mgr.14355) 7129 : audit [DBG] from='client.161766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:43 smithi131 bash[24745]: cluster 2024-09-14T01:05:42.761098+0000 mgr.a (mgr.14355) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:43 smithi171 bash[25040]: cluster 2024-09-14T01:05:42.761098+0000 mgr.a (mgr.14355) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:43 smithi007 bash[22722]: cluster 2024-09-14T01:05:42.761098+0000 mgr.a (mgr.14355) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:45 smithi131 bash[24745]: cluster 2024-09-14T01:05:44.761867+0000 mgr.a (mgr.14355) 7131 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:45 smithi171 bash[25040]: cluster 2024-09-14T01:05:44.761867+0000 mgr.a (mgr.14355) 7131 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:45 smithi007 bash[22722]: cluster 2024-09-14T01:05:44.761867+0000 mgr.a (mgr.14355) 7131 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:48.250 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:48.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:47 smithi131 bash[24745]: cluster 2024-09-14T01:05:46.764121+0000 mgr.a (mgr.14355) 7132 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:47 smithi171 bash[25040]: cluster 2024-09-14T01:05:46.764121+0000 mgr.a (mgr.14355) 7132 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:47 smithi007 bash[22722]: cluster 2024-09-14T01:05:46.764121+0000 mgr.a (mgr.14355) 7132 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:05:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:48 smithi131 bash[24745]: audit 2024-09-14T01:05:47.803494+0000 mgr.a (mgr.14355) 7133 : audit [DBG] from='client.161844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:48 smithi171 bash[25040]: audit 2024-09-14T01:05:47.803494+0000 mgr.a (mgr.14355) 7133 : audit [DBG] from='client.161844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:48 smithi007 bash[22722]: audit 2024-09-14T01:05:47.803494+0000 mgr.a (mgr.14355) 7133 : audit [DBG] from='client.161844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:49 smithi131 bash[24745]: cluster 2024-09-14T01:05:48.765005+0000 mgr.a (mgr.14355) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:49 smithi171 bash[25040]: cluster 2024-09-14T01:05:48.765005+0000 mgr.a (mgr.14355) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:49 smithi007 bash[22722]: cluster 2024-09-14T01:05:48.765005+0000 mgr.a (mgr.14355) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:51 smithi131 bash[24745]: cluster 2024-09-14T01:05:50.767169+0000 mgr.a (mgr.14355) 7135 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:51 smithi171 bash[25040]: cluster 2024-09-14T01:05:50.767169+0000 mgr.a (mgr.14355) 7135 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:51 smithi007 bash[22722]: cluster 2024-09-14T01:05:50.767169+0000 mgr.a (mgr.14355) 7135 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:53.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:53.252 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:54.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:54.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:54.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:54.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:54.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:05:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:53 smithi131 bash[24745]: cluster 2024-09-14T01:05:52.767908+0000 mgr.a (mgr.14355) 7136 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:53 smithi171 bash[25040]: cluster 2024-09-14T01:05:52.767908+0000 mgr.a (mgr.14355) 7136 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:53 smithi007 bash[22722]: cluster 2024-09-14T01:05:52.767908+0000 mgr.a (mgr.14355) 7136 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:54 smithi131 bash[24745]: audit 2024-09-14T01:05:53.583778+0000 mgr.a (mgr.14355) 7137 : audit [DBG] from='client.161922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:54 smithi171 bash[25040]: audit 2024-09-14T01:05:53.583778+0000 mgr.a (mgr.14355) 7137 : audit [DBG] from='client.161922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:54 smithi007 bash[22722]: audit 2024-09-14T01:05:53.583778+0000 mgr.a (mgr.14355) 7137 : audit [DBG] from='client.161922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:05:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:55 smithi131 bash[24745]: cluster 2024-09-14T01:05:54.768793+0000 mgr.a (mgr.14355) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:55 smithi171 bash[25040]: cluster 2024-09-14T01:05:54.768793+0000 mgr.a (mgr.14355) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:55 smithi007 bash[22722]: cluster 2024-09-14T01:05:54.768793+0000 mgr.a (mgr.14355) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:05:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:05:57 smithi131 bash[24745]: cluster 2024-09-14T01:05:56.771035+0000 mgr.a (mgr.14355) 7139 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:05:57 smithi171 bash[25040]: cluster 2024-09-14T01:05:56.771035+0000 mgr.a (mgr.14355) 7139 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:05:57 smithi007 bash[22722]: cluster 2024-09-14T01:05:56.771035+0000 mgr.a (mgr.14355) 7139 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:05:59.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:05:59.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:05:59.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:05:59.778 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:05:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:05:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:05:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:05:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:00 smithi131 bash[24745]: cluster 2024-09-14T01:05:58.771783+0000 mgr.a (mgr.14355) 7140 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:00 smithi171 bash[25040]: cluster 2024-09-14T01:05:58.771783+0000 mgr.a (mgr.14355) 7140 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:00 smithi007 bash[22722]: cluster 2024-09-14T01:05:58.771783+0000 mgr.a (mgr.14355) 7140 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:01 smithi131 bash[24745]: audit 2024-09-14T01:05:59.361397+0000 mgr.a (mgr.14355) 7141 : audit [DBG] from='client.161997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:01 smithi171 bash[25040]: audit 2024-09-14T01:05:59.361397+0000 mgr.a (mgr.14355) 7141 : audit [DBG] from='client.161997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:01 smithi007 bash[22722]: audit 2024-09-14T01:05:59.361397+0000 mgr.a (mgr.14355) 7141 : audit [DBG] from='client.161997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:02 smithi131 bash[24745]: cluster 2024-09-14T01:06:00.773997+0000 mgr.a (mgr.14355) 7142 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:02 smithi171 bash[25040]: cluster 2024-09-14T01:06:00.773997+0000 mgr.a (mgr.14355) 7142 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:02 smithi007 bash[22722]: cluster 2024-09-14T01:06:00.773997+0000 mgr.a (mgr.14355) 7142 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:04 smithi131 bash[24745]: cluster 2024-09-14T01:06:02.774782+0000 mgr.a (mgr.14355) 7143 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:04 smithi171 bash[25040]: cluster 2024-09-14T01:06:02.774782+0000 mgr.a (mgr.14355) 7143 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:04 smithi007 bash[22722]: cluster 2024-09-14T01:06:02.774782+0000 mgr.a (mgr.14355) 7143 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:05.536 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:06 smithi131 bash[24745]: cluster 2024-09-14T01:06:04.775544+0000 mgr.a (mgr.14355) 7144 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:06 smithi131 bash[24745]: audit 2024-09-14T01:06:05.119589+0000 mgr.a (mgr.14355) 7145 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:06 smithi171 bash[25040]: cluster 2024-09-14T01:06:04.775544+0000 mgr.a (mgr.14355) 7144 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:06 smithi171 bash[25040]: audit 2024-09-14T01:06:05.119589+0000 mgr.a (mgr.14355) 7145 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:06 smithi007 bash[22722]: cluster 2024-09-14T01:06:04.775544+0000 mgr.a (mgr.14355) 7144 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:06 smithi007 bash[22722]: audit 2024-09-14T01:06:05.119589+0000 mgr.a (mgr.14355) 7145 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:08 smithi131 bash[24745]: cluster 2024-09-14T01:06:06.778238+0000 mgr.a (mgr.14355) 7146 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:06:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:08 smithi171 bash[25040]: cluster 2024-09-14T01:06:06.778238+0000 mgr.a (mgr.14355) 7146 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:06:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:08 smithi007 bash[22722]: cluster 2024-09-14T01:06:06.778238+0000 mgr.a (mgr.14355) 7146 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:06:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:10 smithi131 bash[24745]: cluster 2024-09-14T01:06:08.779026+0000 mgr.a (mgr.14355) 7147 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:06:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:10 smithi171 bash[25040]: cluster 2024-09-14T01:06:08.779026+0000 mgr.a (mgr.14355) 7147 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:06:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:10 smithi007 bash[22722]: cluster 2024-09-14T01:06:08.779026+0000 mgr.a (mgr.14355) 7147 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:06:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:10.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:10.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:11.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:12 smithi171 bash[25040]: cluster 2024-09-14T01:06:10.780218+0000 mgr.a (mgr.14355) 7148 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:12 smithi171 bash[25040]: audit 2024-09-14T01:06:10.876025+0000 mgr.a (mgr.14355) 7149 : audit [DBG] from='client.162150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:12 smithi007 bash[22722]: cluster 2024-09-14T01:06:10.780218+0000 mgr.a (mgr.14355) 7148 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:12 smithi007 bash[22722]: audit 2024-09-14T01:06:10.876025+0000 mgr.a (mgr.14355) 7149 : audit [DBG] from='client.162150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:12 smithi131 bash[24745]: cluster 2024-09-14T01:06:10.780218+0000 mgr.a (mgr.14355) 7148 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:12 smithi131 bash[24745]: audit 2024-09-14T01:06:10.876025+0000 mgr.a (mgr.14355) 7149 : audit [DBG] from='client.162150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:14 smithi171 bash[25040]: cluster 2024-09-14T01:06:12.781049+0000 mgr.a (mgr.14355) 7150 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:14 smithi007 bash[22722]: cluster 2024-09-14T01:06:12.781049+0000 mgr.a (mgr.14355) 7150 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:14 smithi131 bash[24745]: cluster 2024-09-14T01:06:12.781049+0000 mgr.a (mgr.14355) 7150 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:16 smithi171 bash[25040]: cluster 2024-09-14T01:06:14.781802+0000 mgr.a (mgr.14355) 7151 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:16.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:16.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:16 smithi007 bash[22722]: cluster 2024-09-14T01:06:14.781802+0000 mgr.a (mgr.14355) 7151 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:16 smithi131 bash[24745]: cluster 2024-09-14T01:06:14.781802+0000 mgr.a (mgr.14355) 7151 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:17.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:17.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:18 smithi007 bash[22722]: audit 2024-09-14T01:06:16.661782+0000 mgr.a (mgr.14355) 7152 : audit [DBG] from='client.162222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:18 smithi007 bash[22722]: cluster 2024-09-14T01:06:16.783339+0000 mgr.a (mgr.14355) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:18 smithi131 bash[24745]: audit 2024-09-14T01:06:16.661782+0000 mgr.a (mgr.14355) 7152 : audit [DBG] from='client.162222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:18 smithi131 bash[24745]: cluster 2024-09-14T01:06:16.783339+0000 mgr.a (mgr.14355) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:18 smithi171 bash[25040]: audit 2024-09-14T01:06:16.661782+0000 mgr.a (mgr.14355) 7152 : audit [DBG] from='client.162222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:18 smithi171 bash[25040]: cluster 2024-09-14T01:06:16.783339+0000 mgr.a (mgr.14355) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:20 smithi007 bash[22722]: cluster 2024-09-14T01:06:18.784440+0000 mgr.a (mgr.14355) 7154 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:06:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:20 smithi131 bash[24745]: cluster 2024-09-14T01:06:18.784440+0000 mgr.a (mgr.14355) 7154 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:06:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:20 smithi171 bash[25040]: cluster 2024-09-14T01:06:18.784440+0000 mgr.a (mgr.14355) 7154 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:06:22.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:22.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:22.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:22.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:22 smithi007 bash[22722]: cluster 2024-09-14T01:06:20.786725+0000 mgr.a (mgr.14355) 7155 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:06:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:22 smithi131 bash[24745]: cluster 2024-09-14T01:06:20.786725+0000 mgr.a (mgr.14355) 7155 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:06:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:22 smithi171 bash[25040]: cluster 2024-09-14T01:06:20.786725+0000 mgr.a (mgr.14355) 7155 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:06:22.884 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:22.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:24 smithi007 bash[22722]: audit 2024-09-14T01:06:22.449505+0000 mgr.a (mgr.14355) 7156 : audit [DBG] from='client.162300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:24 smithi007 bash[22722]: cluster 2024-09-14T01:06:22.787521+0000 mgr.a (mgr.14355) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:24 smithi131 bash[24745]: audit 2024-09-14T01:06:22.449505+0000 mgr.a (mgr.14355) 7156 : audit [DBG] from='client.162300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:24 smithi131 bash[24745]: cluster 2024-09-14T01:06:22.787521+0000 mgr.a (mgr.14355) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:24 smithi171 bash[25040]: audit 2024-09-14T01:06:22.449505+0000 mgr.a (mgr.14355) 7156 : audit [DBG] from='client.162300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:24 smithi171 bash[25040]: cluster 2024-09-14T01:06:22.787521+0000 mgr.a (mgr.14355) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:26 smithi007 bash[22722]: cluster 2024-09-14T01:06:24.788304+0000 mgr.a (mgr.14355) 7158 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:26 smithi131 bash[24745]: cluster 2024-09-14T01:06:24.788304+0000 mgr.a (mgr.14355) 7158 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:26 smithi171 bash[25040]: cluster 2024-09-14T01:06:24.788304+0000 mgr.a (mgr.14355) 7158 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:27.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:27.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:28 smithi007 bash[22722]: cluster 2024-09-14T01:06:26.790578+0000 mgr.a (mgr.14355) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:28 smithi131 bash[24745]: cluster 2024-09-14T01:06:26.790578+0000 mgr.a (mgr.14355) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:28 smithi171 bash[25040]: cluster 2024-09-14T01:06:26.790578+0000 mgr.a (mgr.14355) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:28.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:28.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:29 smithi007 bash[22722]: audit 2024-09-14T01:06:28.223488+0000 mgr.a (mgr.14355) 7160 : audit [DBG] from='client.162378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:29 smithi131 bash[24745]: audit 2024-09-14T01:06:28.223488+0000 mgr.a (mgr.14355) 7160 : audit [DBG] from='client.162378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:29 smithi171 bash[25040]: audit 2024-09-14T01:06:28.223488+0000 mgr.a (mgr.14355) 7160 : audit [DBG] from='client.162378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:30 smithi007 bash[22722]: cluster 2024-09-14T01:06:28.791527+0000 mgr.a (mgr.14355) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:30 smithi131 bash[24745]: cluster 2024-09-14T01:06:28.791527+0000 mgr.a (mgr.14355) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:30 smithi171 bash[25040]: cluster 2024-09-14T01:06:28.791527+0000 mgr.a (mgr.14355) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:32 smithi007 bash[22722]: cluster 2024-09-14T01:06:30.793713+0000 mgr.a (mgr.14355) 7162 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:32 smithi131 bash[24745]: cluster 2024-09-14T01:06:30.793713+0000 mgr.a (mgr.14355) 7162 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:32 smithi171 bash[25040]: cluster 2024-09-14T01:06:30.793713+0000 mgr.a (mgr.14355) 7162 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:33.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:33.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:34.394 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:34.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:34 smithi007 bash[22722]: cluster 2024-09-14T01:06:32.794505+0000 mgr.a (mgr.14355) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:34 smithi131 bash[24745]: cluster 2024-09-14T01:06:32.794505+0000 mgr.a (mgr.14355) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:34 smithi171 bash[25040]: cluster 2024-09-14T01:06:32.794505+0000 mgr.a (mgr.14355) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:35.095 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:35 smithi007 bash[22722]: audit 2024-09-14T01:06:33.984466+0000 mgr.a (mgr.14355) 7164 : audit [DBG] from='client.162456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:35.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:35 smithi007 bash[22722]: audit 2024-09-14T01:06:34.438512+0000 mon.a (mon.0) 1671 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:06:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:35 smithi131 bash[24745]: audit 2024-09-14T01:06:33.984466+0000 mgr.a (mgr.14355) 7164 : audit [DBG] from='client.162456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:35 smithi131 bash[24745]: audit 2024-09-14T01:06:34.438512+0000 mon.a (mon.0) 1671 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:06:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:35 smithi171 bash[25040]: audit 2024-09-14T01:06:33.984466+0000 mgr.a (mgr.14355) 7164 : audit [DBG] from='client.162456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:35 smithi171 bash[25040]: audit 2024-09-14T01:06:34.438512+0000 mon.a (mon.0) 1671 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:06:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:06:35 smithi007 bash[22972]: debug 2024-09-14T01:06:35.988+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:06:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:06:35 smithi007 bash[22972]: debug 2024-09-14T01:06:35.992+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:06:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: cluster 2024-09-14T01:06:34.795473+0000 mgr.a (mgr.14355) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: audit 2024-09-14T01:06:35.245135+0000 mon.a (mon.0) 1672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:06:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: audit 2024-09-14T01:06:35.246325+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:06:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: audit 2024-09-14T01:06:35.254671+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:06:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: audit 2024-09-14T01:06:35.259393+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:36 smithi007 bash[22722]: audit 2024-09-14T01:06:35.261602+0000 mgr.a (mgr.14355) 7166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: cluster 2024-09-14T01:06:34.795473+0000 mgr.a (mgr.14355) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: audit 2024-09-14T01:06:35.245135+0000 mon.a (mon.0) 1672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:06:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: audit 2024-09-14T01:06:35.246325+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:06:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: audit 2024-09-14T01:06:35.254671+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:06:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: audit 2024-09-14T01:06:35.259393+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:36 smithi131 bash[24745]: audit 2024-09-14T01:06:35.261602+0000 mgr.a (mgr.14355) 7166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: cluster 2024-09-14T01:06:34.795473+0000 mgr.a (mgr.14355) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: audit 2024-09-14T01:06:35.245135+0000 mon.a (mon.0) 1672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:06:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: audit 2024-09-14T01:06:35.246325+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:06:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: audit 2024-09-14T01:06:35.254671+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:06:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: audit 2024-09-14T01:06:35.259393+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:36 smithi171 bash[25040]: audit 2024-09-14T01:06:35.261602+0000 mgr.a (mgr.14355) 7166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:06:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:37 smithi007 bash[22722]: audit 2024-09-14T01:06:35.993729+0000 mgr.a (mgr.14355) 7167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:06:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:37 smithi007 bash[22722]: cephadm 2024-09-14T01:06:35.995715+0000 mgr.a (mgr.14355) 7168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:06:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:37 smithi131 bash[24745]: audit 2024-09-14T01:06:35.993729+0000 mgr.a (mgr.14355) 7167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:06:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:37 smithi131 bash[24745]: cephadm 2024-09-14T01:06:35.995715+0000 mgr.a (mgr.14355) 7168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:06:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:37 smithi171 bash[25040]: audit 2024-09-14T01:06:35.993729+0000 mgr.a (mgr.14355) 7167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:06:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:37 smithi171 bash[25040]: cephadm 2024-09-14T01:06:35.995715+0000 mgr.a (mgr.14355) 7168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:06:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:38 smithi007 bash[22722]: cluster 2024-09-14T01:06:36.798202+0000 mgr.a (mgr.14355) 7169 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:38 smithi131 bash[24745]: cluster 2024-09-14T01:06:36.798202+0000 mgr.a (mgr.14355) 7169 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:38 smithi171 bash[25040]: cluster 2024-09-14T01:06:36.798202+0000 mgr.a (mgr.14355) 7169 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:06:39.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:39.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:39.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:40.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:40 smithi007 bash[22722]: cluster 2024-09-14T01:06:38.799050+0000 mgr.a (mgr.14355) 7170 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:40 smithi131 bash[24745]: cluster 2024-09-14T01:06:38.799050+0000 mgr.a (mgr.14355) 7170 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:40 smithi171 bash[25040]: cluster 2024-09-14T01:06:38.799050+0000 mgr.a (mgr.14355) 7170 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:41 smithi007 bash[22722]: audit 2024-09-14T01:06:39.727440+0000 mgr.a (mgr.14355) 7171 : audit [DBG] from='client.162642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:41 smithi131 bash[24745]: audit 2024-09-14T01:06:39.727440+0000 mgr.a (mgr.14355) 7171 : audit [DBG] from='client.162642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:41 smithi171 bash[25040]: audit 2024-09-14T01:06:39.727440+0000 mgr.a (mgr.14355) 7171 : audit [DBG] from='client.162642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:42 smithi007 bash[22722]: cluster 2024-09-14T01:06:40.801461+0000 mgr.a (mgr.14355) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:42 smithi131 bash[24745]: cluster 2024-09-14T01:06:40.801461+0000 mgr.a (mgr.14355) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:42 smithi171 bash[25040]: cluster 2024-09-14T01:06:40.801461+0000 mgr.a (mgr.14355) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:44 smithi007 bash[22722]: cluster 2024-09-14T01:06:42.802254+0000 mgr.a (mgr.14355) 7173 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:44 smithi131 bash[24745]: cluster 2024-09-14T01:06:42.802254+0000 mgr.a (mgr.14355) 7173 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:44 smithi171 bash[25040]: cluster 2024-09-14T01:06:42.802254+0000 mgr.a (mgr.14355) 7173 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:45.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:45.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:45.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:45.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:45.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:46 smithi007 bash[22722]: cluster 2024-09-14T01:06:44.802996+0000 mgr.a (mgr.14355) 7174 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:46 smithi131 bash[24745]: cluster 2024-09-14T01:06:44.802996+0000 mgr.a (mgr.14355) 7174 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:46 smithi171 bash[25040]: cluster 2024-09-14T01:06:44.802996+0000 mgr.a (mgr.14355) 7174 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:47 smithi007 bash[22722]: audit 2024-09-14T01:06:45.472386+0000 mgr.a (mgr.14355) 7175 : audit [DBG] from='client.162717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:47 smithi131 bash[24745]: audit 2024-09-14T01:06:45.472386+0000 mgr.a (mgr.14355) 7175 : audit [DBG] from='client.162717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:47 smithi171 bash[25040]: audit 2024-09-14T01:06:45.472386+0000 mgr.a (mgr.14355) 7175 : audit [DBG] from='client.162717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:48.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:48 smithi007 bash[22722]: cluster 2024-09-14T01:06:46.805789+0000 mgr.a (mgr.14355) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:48 smithi131 bash[24745]: cluster 2024-09-14T01:06:46.805789+0000 mgr.a (mgr.14355) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:48 smithi171 bash[25040]: cluster 2024-09-14T01:06:46.805789+0000 mgr.a (mgr.14355) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:50 smithi007 bash[22722]: cluster 2024-09-14T01:06:48.806731+0000 mgr.a (mgr.14355) 7177 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:06:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:50 smithi131 bash[24745]: cluster 2024-09-14T01:06:48.806731+0000 mgr.a (mgr.14355) 7177 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:06:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:50 smithi171 bash[25040]: cluster 2024-09-14T01:06:48.806731+0000 mgr.a (mgr.14355) 7177 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:06:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:50.891 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:51.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:51.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:52 smithi007 bash[22722]: cluster 2024-09-14T01:06:50.808852+0000 mgr.a (mgr.14355) 7178 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:52 smithi007 bash[22722]: audit 2024-09-14T01:06:51.224479+0000 mgr.a (mgr.14355) 7179 : audit [DBG] from='client.162795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:52 smithi131 bash[24745]: cluster 2024-09-14T01:06:50.808852+0000 mgr.a (mgr.14355) 7178 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:52 smithi131 bash[24745]: audit 2024-09-14T01:06:51.224479+0000 mgr.a (mgr.14355) 7179 : audit [DBG] from='client.162795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:52 smithi171 bash[25040]: cluster 2024-09-14T01:06:50.808852+0000 mgr.a (mgr.14355) 7178 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:06:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:52 smithi171 bash[25040]: audit 2024-09-14T01:06:51.224479+0000 mgr.a (mgr.14355) 7179 : audit [DBG] from='client.162795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:54 smithi007 bash[22722]: cluster 2024-09-14T01:06:52.809844+0000 mgr.a (mgr.14355) 7180 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:06:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:54 smithi131 bash[24745]: cluster 2024-09-14T01:06:52.809844+0000 mgr.a (mgr.14355) 7180 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:06:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:54 smithi171 bash[25040]: cluster 2024-09-14T01:06:52.809844+0000 mgr.a (mgr.14355) 7180 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:06:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:56 smithi007 bash[22722]: cluster 2024-09-14T01:06:54.810640+0000 mgr.a (mgr.14355) 7181 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:56 smithi131 bash[24745]: cluster 2024-09-14T01:06:54.810640+0000 mgr.a (mgr.14355) 7181 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:56 smithi171 bash[25040]: cluster 2024-09-14T01:06:54.810640+0000 mgr.a (mgr.14355) 7181 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:06:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:06:56.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:06:56.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:06:57.379 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:06:57.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:06:57.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:06:57.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:06:57.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:06:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:58 smithi007 bash[22722]: cluster 2024-09-14T01:06:56.812822+0000 mgr.a (mgr.14355) 7182 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:06:58 smithi007 bash[22722]: audit 2024-09-14T01:06:56.971244+0000 mgr.a (mgr.14355) 7183 : audit [DBG] from='client.162873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:58 smithi131 bash[24745]: cluster 2024-09-14T01:06:56.812822+0000 mgr.a (mgr.14355) 7182 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:06:58 smithi131 bash[24745]: audit 2024-09-14T01:06:56.971244+0000 mgr.a (mgr.14355) 7183 : audit [DBG] from='client.162873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:06:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:58 smithi171 bash[25040]: cluster 2024-09-14T01:06:56.812822+0000 mgr.a (mgr.14355) 7182 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:06:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:06:58 smithi171 bash[25040]: audit 2024-09-14T01:06:56.971244+0000 mgr.a (mgr.14355) 7183 : audit [DBG] from='client.162873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:00 smithi007 bash[22722]: cluster 2024-09-14T01:06:58.813795+0000 mgr.a (mgr.14355) 7184 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:00 smithi131 bash[24745]: cluster 2024-09-14T01:06:58.813795+0000 mgr.a (mgr.14355) 7184 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:00 smithi171 bash[25040]: cluster 2024-09-14T01:06:58.813795+0000 mgr.a (mgr.14355) 7184 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:02 smithi007 bash[22722]: cluster 2024-09-14T01:07:00.816082+0000 mgr.a (mgr.14355) 7185 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:02 smithi131 bash[24745]: cluster 2024-09-14T01:07:00.816082+0000 mgr.a (mgr.14355) 7185 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:02 smithi171 bash[25040]: cluster 2024-09-14T01:07:00.816082+0000 mgr.a (mgr.14355) 7185 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:03.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:03.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:04 smithi007 bash[22722]: audit 2024-09-14T01:07:02.709025+0000 mgr.a (mgr.14355) 7186 : audit [DBG] from='client.162951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:04 smithi007 bash[22722]: cluster 2024-09-14T01:07:02.816575+0000 mgr.a (mgr.14355) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:04 smithi131 bash[24745]: audit 2024-09-14T01:07:02.709025+0000 mgr.a (mgr.14355) 7186 : audit [DBG] from='client.162951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:04 smithi131 bash[24745]: cluster 2024-09-14T01:07:02.816575+0000 mgr.a (mgr.14355) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:04 smithi171 bash[25040]: audit 2024-09-14T01:07:02.709025+0000 mgr.a (mgr.14355) 7186 : audit [DBG] from='client.162951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:04 smithi171 bash[25040]: cluster 2024-09-14T01:07:02.816575+0000 mgr.a (mgr.14355) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:06 smithi007 bash[22722]: cluster 2024-09-14T01:07:04.817437+0000 mgr.a (mgr.14355) 7188 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:06 smithi131 bash[24745]: cluster 2024-09-14T01:07:04.817437+0000 mgr.a (mgr.14355) 7188 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:06 smithi171 bash[25040]: cluster 2024-09-14T01:07:04.817437+0000 mgr.a (mgr.14355) 7188 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:08 smithi007 bash[22722]: cluster 2024-09-14T01:07:06.819702+0000 mgr.a (mgr.14355) 7189 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:08 smithi131 bash[24745]: cluster 2024-09-14T01:07:06.819702+0000 mgr.a (mgr.14355) 7189 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:08 smithi171 bash[25040]: cluster 2024-09-14T01:07:06.819702+0000 mgr.a (mgr.14355) 7189 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:08.887 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:08.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:10 smithi007 bash[22722]: audit 2024-09-14T01:07:08.471309+0000 mgr.a (mgr.14355) 7190 : audit [DBG] from='client.163029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:10 smithi007 bash[22722]: cluster 2024-09-14T01:07:08.820229+0000 mgr.a (mgr.14355) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:10 smithi131 bash[24745]: audit 2024-09-14T01:07:08.471309+0000 mgr.a (mgr.14355) 7190 : audit [DBG] from='client.163029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:10 smithi131 bash[24745]: cluster 2024-09-14T01:07:08.820229+0000 mgr.a (mgr.14355) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:10 smithi171 bash[25040]: audit 2024-09-14T01:07:08.471309+0000 mgr.a (mgr.14355) 7190 : audit [DBG] from='client.163029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:10 smithi171 bash[25040]: cluster 2024-09-14T01:07:08.820229+0000 mgr.a (mgr.14355) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:12 smithi007 bash[22722]: cluster 2024-09-14T01:07:10.822421+0000 mgr.a (mgr.14355) 7192 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:12 smithi131 bash[24745]: cluster 2024-09-14T01:07:10.822421+0000 mgr.a (mgr.14355) 7192 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:12 smithi171 bash[25040]: cluster 2024-09-14T01:07:10.822421+0000 mgr.a (mgr.14355) 7192 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:13.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:14 smithi007 bash[22722]: cluster 2024-09-14T01:07:12.823178+0000 mgr.a (mgr.14355) 7193 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:14 smithi131 bash[24745]: cluster 2024-09-14T01:07:12.823178+0000 mgr.a (mgr.14355) 7193 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:14 smithi171 bash[25040]: cluster 2024-09-14T01:07:12.823178+0000 mgr.a (mgr.14355) 7193 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:14.673 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:14.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:14.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:14.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:14.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:15 smithi007 bash[22722]: audit 2024-09-14T01:07:14.224037+0000 mgr.a (mgr.14355) 7194 : audit [DBG] from='client.163104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:15 smithi131 bash[24745]: audit 2024-09-14T01:07:14.224037+0000 mgr.a (mgr.14355) 7194 : audit [DBG] from='client.163104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:15 smithi171 bash[25040]: audit 2024-09-14T01:07:14.224037+0000 mgr.a (mgr.14355) 7194 : audit [DBG] from='client.163104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:16 smithi131 bash[24745]: cluster 2024-09-14T01:07:14.824183+0000 mgr.a (mgr.14355) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:16 smithi171 bash[25040]: cluster 2024-09-14T01:07:14.824183+0000 mgr.a (mgr.14355) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:16 smithi007 bash[22722]: cluster 2024-09-14T01:07:14.824183+0000 mgr.a (mgr.14355) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:18 smithi131 bash[24745]: cluster 2024-09-14T01:07:16.826531+0000 mgr.a (mgr.14355) 7196 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:18 smithi171 bash[25040]: cluster 2024-09-14T01:07:16.826531+0000 mgr.a (mgr.14355) 7196 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:18 smithi007 bash[22722]: cluster 2024-09-14T01:07:16.826531+0000 mgr.a (mgr.14355) 7196 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:19.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:19.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:19.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:20.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:20.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:20 smithi131 bash[24745]: cluster 2024-09-14T01:07:18.827333+0000 mgr.a (mgr.14355) 7197 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:20 smithi171 bash[25040]: cluster 2024-09-14T01:07:18.827333+0000 mgr.a (mgr.14355) 7197 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:20 smithi007 bash[22722]: cluster 2024-09-14T01:07:18.827333+0000 mgr.a (mgr.14355) 7197 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:21 smithi131 bash[24745]: audit 2024-09-14T01:07:20.003132+0000 mgr.a (mgr.14355) 7198 : audit [DBG] from='client.163179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:21 smithi171 bash[25040]: audit 2024-09-14T01:07:20.003132+0000 mgr.a (mgr.14355) 7198 : audit [DBG] from='client.163179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:21 smithi007 bash[22722]: audit 2024-09-14T01:07:20.003132+0000 mgr.a (mgr.14355) 7198 : audit [DBG] from='client.163179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:22 smithi131 bash[24745]: cluster 2024-09-14T01:07:20.830157+0000 mgr.a (mgr.14355) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:22 smithi171 bash[25040]: cluster 2024-09-14T01:07:20.830157+0000 mgr.a (mgr.14355) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:22 smithi007 bash[22722]: cluster 2024-09-14T01:07:20.830157+0000 mgr.a (mgr.14355) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:24 smithi131 bash[24745]: cluster 2024-09-14T01:07:22.831102+0000 mgr.a (mgr.14355) 7200 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:24 smithi171 bash[25040]: cluster 2024-09-14T01:07:22.831102+0000 mgr.a (mgr.14355) 7200 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:24 smithi007 bash[22722]: cluster 2024-09-14T01:07:22.831102+0000 mgr.a (mgr.14355) 7200 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:25.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:25.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:26.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:26.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:26.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:26.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:26.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:26 smithi131 bash[24745]: cluster 2024-09-14T01:07:24.832056+0000 mgr.a (mgr.14355) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:26 smithi171 bash[25040]: cluster 2024-09-14T01:07:24.832056+0000 mgr.a (mgr.14355) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:26 smithi007 bash[22722]: cluster 2024-09-14T01:07:24.832056+0000 mgr.a (mgr.14355) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:27 smithi131 bash[24745]: audit 2024-09-14T01:07:25.758721+0000 mgr.a (mgr.14355) 7202 : audit [DBG] from='client.163257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:27 smithi171 bash[25040]: audit 2024-09-14T01:07:25.758721+0000 mgr.a (mgr.14355) 7202 : audit [DBG] from='client.163257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:27 smithi007 bash[22722]: audit 2024-09-14T01:07:25.758721+0000 mgr.a (mgr.14355) 7202 : audit [DBG] from='client.163257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:28 smithi131 bash[24745]: cluster 2024-09-14T01:07:26.834963+0000 mgr.a (mgr.14355) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:28 smithi171 bash[25040]: cluster 2024-09-14T01:07:26.834963+0000 mgr.a (mgr.14355) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:28 smithi007 bash[22722]: cluster 2024-09-14T01:07:26.834963+0000 mgr.a (mgr.14355) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:30 smithi131 bash[24745]: cluster 2024-09-14T01:07:28.835763+0000 mgr.a (mgr.14355) 7204 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:30 smithi171 bash[25040]: cluster 2024-09-14T01:07:28.835763+0000 mgr.a (mgr.14355) 7204 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:30 smithi007 bash[22722]: cluster 2024-09-14T01:07:28.835763+0000 mgr.a (mgr.14355) 7204 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:07:31.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:31.174 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:31.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:31.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:31.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:32 smithi131 bash[24745]: cluster 2024-09-14T01:07:30.837778+0000 mgr.a (mgr.14355) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:32 smithi171 bash[25040]: cluster 2024-09-14T01:07:30.837778+0000 mgr.a (mgr.14355) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:32 smithi007 bash[22722]: cluster 2024-09-14T01:07:30.837778+0000 mgr.a (mgr.14355) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:33 smithi131 bash[24745]: audit 2024-09-14T01:07:31.511825+0000 mgr.a (mgr.14355) 7206 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:33 smithi171 bash[25040]: audit 2024-09-14T01:07:31.511825+0000 mgr.a (mgr.14355) 7206 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:33 smithi007 bash[22722]: audit 2024-09-14T01:07:31.511825+0000 mgr.a (mgr.14355) 7206 : audit [DBG] from='client.163335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:34 smithi131 bash[24745]: cluster 2024-09-14T01:07:32.838765+0000 mgr.a (mgr.14355) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:34 smithi171 bash[25040]: cluster 2024-09-14T01:07:32.838765+0000 mgr.a (mgr.14355) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:34 smithi007 bash[22722]: cluster 2024-09-14T01:07:32.838765+0000 mgr.a (mgr.14355) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:36 smithi131 bash[24745]: cluster 2024-09-14T01:07:34.839535+0000 mgr.a (mgr.14355) 7208 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:36 smithi131 bash[24745]: audit 2024-09-14T01:07:36.050824+0000 mon.a (mon.0) 1676 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:07:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:36 smithi171 bash[25040]: cluster 2024-09-14T01:07:34.839535+0000 mgr.a (mgr.14355) 7208 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:36 smithi171 bash[25040]: audit 2024-09-14T01:07:36.050824+0000 mon.a (mon.0) 1676 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:07:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:36 smithi007 bash[22722]: cluster 2024-09-14T01:07:34.839535+0000 mgr.a (mgr.14355) 7208 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:36 smithi007 bash[22722]: audit 2024-09-14T01:07:36.050824+0000 mon.a (mon.0) 1676 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:07:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:37 smithi131 bash[24745]: audit 2024-09-14T01:07:36.875397+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:07:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:37 smithi131 bash[24745]: audit 2024-09-14T01:07:36.877010+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:07:37.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:37 smithi131 bash[24745]: audit 2024-09-14T01:07:36.887184+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:07:37.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:37 smithi131 bash[24745]: audit 2024-09-14T01:07:36.889723+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:37 smithi171 bash[25040]: audit 2024-09-14T01:07:36.875397+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:07:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:37 smithi171 bash[25040]: audit 2024-09-14T01:07:36.877010+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:07:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:37 smithi171 bash[25040]: audit 2024-09-14T01:07:36.887184+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:07:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:37 smithi171 bash[25040]: audit 2024-09-14T01:07:36.889723+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:37.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22722]: audit 2024-09-14T01:07:36.875397+0000 mon.a (mon.0) 1677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:07:37.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22722]: audit 2024-09-14T01:07:36.877010+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:07:37.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22722]: audit 2024-09-14T01:07:36.887184+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:07:37.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22722]: audit 2024-09-14T01:07:36.889723+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:37.953 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22972]: debug 2024-09-14T01:07:37.623+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:07:37.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:07:37 smithi007 bash[22972]: debug 2024-09-14T01:07:37.635+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:07:38.024 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:38.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:38.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:38.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:38 smithi131 bash[24745]: cluster 2024-09-14T01:07:36.841816+0000 mgr.a (mgr.14355) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:38 smithi131 bash[24745]: audit 2024-09-14T01:07:36.890658+0000 mgr.a (mgr.14355) 7210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:38 smithi131 bash[24745]: audit 2024-09-14T01:07:37.279887+0000 mgr.a (mgr.14355) 7211 : audit [DBG] from='client.163431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:38 smithi171 bash[25040]: cluster 2024-09-14T01:07:36.841816+0000 mgr.a (mgr.14355) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:38 smithi171 bash[25040]: audit 2024-09-14T01:07:36.890658+0000 mgr.a (mgr.14355) 7210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:38 smithi171 bash[25040]: audit 2024-09-14T01:07:37.279887+0000 mgr.a (mgr.14355) 7211 : audit [DBG] from='client.163431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:38 smithi007 bash[22722]: cluster 2024-09-14T01:07:36.841816+0000 mgr.a (mgr.14355) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:07:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:38 smithi007 bash[22722]: audit 2024-09-14T01:07:36.890658+0000 mgr.a (mgr.14355) 7210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:07:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:38 smithi007 bash[22722]: audit 2024-09-14T01:07:37.279887+0000 mgr.a (mgr.14355) 7211 : audit [DBG] from='client.163431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:39 smithi171 bash[25040]: audit 2024-09-14T01:07:37.628025+0000 mgr.a (mgr.14355) 7212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:07:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:39 smithi171 bash[25040]: cephadm 2024-09-14T01:07:37.638452+0000 mgr.a (mgr.14355) 7213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:07:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:39 smithi007 bash[22722]: audit 2024-09-14T01:07:37.628025+0000 mgr.a (mgr.14355) 7212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:07:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:39 smithi007 bash[22722]: cephadm 2024-09-14T01:07:37.638452+0000 mgr.a (mgr.14355) 7213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:07:39.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:39 smithi131 bash[24745]: audit 2024-09-14T01:07:37.628025+0000 mgr.a (mgr.14355) 7212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:07:39.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:39 smithi131 bash[24745]: cephadm 2024-09-14T01:07:37.638452+0000 mgr.a (mgr.14355) 7213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:07:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:40 smithi171 bash[25040]: cluster 2024-09-14T01:07:38.842774+0000 mgr.a (mgr.14355) 7214 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:40 smithi007 bash[22722]: cluster 2024-09-14T01:07:38.842774+0000 mgr.a (mgr.14355) 7214 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:40 smithi131 bash[24745]: cluster 2024-09-14T01:07:38.842774+0000 mgr.a (mgr.14355) 7214 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:42 smithi171 bash[25040]: cluster 2024-09-14T01:07:40.845033+0000 mgr.a (mgr.14355) 7215 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:42 smithi007 bash[22722]: cluster 2024-09-14T01:07:40.845033+0000 mgr.a (mgr.14355) 7215 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:42 smithi131 bash[24745]: cluster 2024-09-14T01:07:40.845033+0000 mgr.a (mgr.14355) 7215 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:43.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:43.026 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:43.026 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:43.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:44 smithi007 bash[22722]: cluster 2024-09-14T01:07:42.845824+0000 mgr.a (mgr.14355) 7216 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:44 smithi131 bash[24745]: cluster 2024-09-14T01:07:42.845824+0000 mgr.a (mgr.14355) 7216 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:44 smithi171 bash[25040]: cluster 2024-09-14T01:07:42.845824+0000 mgr.a (mgr.14355) 7216 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:45 smithi007 bash[22722]: audit 2024-09-14T01:07:43.355922+0000 mgr.a (mgr.14355) 7217 : audit [DBG] from='client.163593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:45 smithi131 bash[24745]: audit 2024-09-14T01:07:43.355922+0000 mgr.a (mgr.14355) 7217 : audit [DBG] from='client.163593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:45 smithi171 bash[25040]: audit 2024-09-14T01:07:43.355922+0000 mgr.a (mgr.14355) 7217 : audit [DBG] from='client.163593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:46 smithi007 bash[22722]: cluster 2024-09-14T01:07:44.846744+0000 mgr.a (mgr.14355) 7218 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:46 smithi131 bash[24745]: cluster 2024-09-14T01:07:44.846744+0000 mgr.a (mgr.14355) 7218 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:46 smithi171 bash[25040]: cluster 2024-09-14T01:07:44.846744+0000 mgr.a (mgr.14355) 7218 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:48 smithi007 bash[22722]: cluster 2024-09-14T01:07:46.849014+0000 mgr.a (mgr.14355) 7219 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:48 smithi131 bash[24745]: cluster 2024-09-14T01:07:46.849014+0000 mgr.a (mgr.14355) 7219 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:48 smithi171 bash[25040]: cluster 2024-09-14T01:07:46.849014+0000 mgr.a (mgr.14355) 7219 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:49.551 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:49.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:49.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:49.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:50 smithi007 bash[22722]: cluster 2024-09-14T01:07:48.849701+0000 mgr.a (mgr.14355) 7220 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:50 smithi007 bash[22722]: audit 2024-09-14T01:07:49.106853+0000 mgr.a (mgr.14355) 7221 : audit [DBG] from='client.163668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:50 smithi131 bash[24745]: cluster 2024-09-14T01:07:48.849701+0000 mgr.a (mgr.14355) 7220 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:50 smithi131 bash[24745]: audit 2024-09-14T01:07:49.106853+0000 mgr.a (mgr.14355) 7221 : audit [DBG] from='client.163668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:50 smithi171 bash[25040]: cluster 2024-09-14T01:07:48.849701+0000 mgr.a (mgr.14355) 7220 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:07:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:50 smithi171 bash[25040]: audit 2024-09-14T01:07:49.106853+0000 mgr.a (mgr.14355) 7221 : audit [DBG] from='client.163668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:52 smithi007 bash[22722]: cluster 2024-09-14T01:07:50.852078+0000 mgr.a (mgr.14355) 7222 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:52 smithi131 bash[24745]: cluster 2024-09-14T01:07:50.852078+0000 mgr.a (mgr.14355) 7222 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:52 smithi171 bash[25040]: cluster 2024-09-14T01:07:50.852078+0000 mgr.a (mgr.14355) 7222 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T01:07:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:07:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:07:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:07:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:54 smithi007 bash[22722]: cluster 2024-09-14T01:07:52.853009+0000 mgr.a (mgr.14355) 7223 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:54 smithi131 bash[24745]: cluster 2024-09-14T01:07:52.853009+0000 mgr.a (mgr.14355) 7223 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:54 smithi171 bash[25040]: cluster 2024-09-14T01:07:52.853009+0000 mgr.a (mgr.14355) 7223 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:55.320 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:07:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:07:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:07:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:07:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:07:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:56 smithi007 bash[22722]: cluster 2024-09-14T01:07:54.853922+0000 mgr.a (mgr.14355) 7224 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:56 smithi007 bash[22722]: audit 2024-09-14T01:07:54.893002+0000 mgr.a (mgr.14355) 7225 : audit [DBG] from='client.163743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:56 smithi131 bash[24745]: cluster 2024-09-14T01:07:54.853922+0000 mgr.a (mgr.14355) 7224 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:56 smithi131 bash[24745]: audit 2024-09-14T01:07:54.893002+0000 mgr.a (mgr.14355) 7225 : audit [DBG] from='client.163743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:56 smithi171 bash[25040]: cluster 2024-09-14T01:07:54.853922+0000 mgr.a (mgr.14355) 7224 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:07:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:56 smithi171 bash[25040]: audit 2024-09-14T01:07:54.893002+0000 mgr.a (mgr.14355) 7225 : audit [DBG] from='client.163743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:07:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:07:58 smithi007 bash[22722]: cluster 2024-09-14T01:07:56.856736+0000 mgr.a (mgr.14355) 7226 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:07:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:07:58 smithi131 bash[24745]: cluster 2024-09-14T01:07:56.856736+0000 mgr.a (mgr.14355) 7226 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:07:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:07:58 smithi171 bash[25040]: cluster 2024-09-14T01:07:56.856736+0000 mgr.a (mgr.14355) 7226 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:08:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:00 smithi007 bash[22722]: cluster 2024-09-14T01:07:58.857675+0000 mgr.a (mgr.14355) 7227 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:08:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:00 smithi131 bash[24745]: cluster 2024-09-14T01:07:58.857675+0000 mgr.a (mgr.14355) 7227 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:08:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:00 smithi171 bash[25040]: cluster 2024-09-14T01:07:58.857675+0000 mgr.a (mgr.14355) 7227 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:08:01.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:02 smithi007 bash[22722]: audit 2024-09-14T01:08:00.657763+0000 mgr.a (mgr.14355) 7228 : audit [DBG] from='client.163818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:02 smithi007 bash[22722]: cluster 2024-09-14T01:08:00.859633+0000 mgr.a (mgr.14355) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:02 smithi131 bash[24745]: audit 2024-09-14T01:08:00.657763+0000 mgr.a (mgr.14355) 7228 : audit [DBG] from='client.163818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:02 smithi131 bash[24745]: cluster 2024-09-14T01:08:00.859633+0000 mgr.a (mgr.14355) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:02 smithi171 bash[25040]: audit 2024-09-14T01:08:00.657763+0000 mgr.a (mgr.14355) 7228 : audit [DBG] from='client.163818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:02 smithi171 bash[25040]: cluster 2024-09-14T01:08:00.859633+0000 mgr.a (mgr.14355) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:04 smithi007 bash[22722]: cluster 2024-09-14T01:08:02.860520+0000 mgr.a (mgr.14355) 7230 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:04 smithi131 bash[24745]: cluster 2024-09-14T01:08:02.860520+0000 mgr.a (mgr.14355) 7230 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:04 smithi171 bash[25040]: cluster 2024-09-14T01:08:02.860520+0000 mgr.a (mgr.14355) 7230 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:06.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:06 smithi007 bash[22722]: cluster 2024-09-14T01:08:04.861311+0000 mgr.a (mgr.14355) 7231 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:08:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:06 smithi131 bash[24745]: cluster 2024-09-14T01:08:04.861311+0000 mgr.a (mgr.14355) 7231 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:08:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:06 smithi171 bash[25040]: cluster 2024-09-14T01:08:04.861311+0000 mgr.a (mgr.14355) 7231 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:08:06.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:06.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:07 smithi007 bash[22722]: audit 2024-09-14T01:08:06.443129+0000 mgr.a (mgr.14355) 7232 : audit [DBG] from='client.163887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:07 smithi007 bash[22722]: cluster 2024-09-14T01:08:06.862545+0000 mgr.a (mgr.14355) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:07 smithi131 bash[24745]: audit 2024-09-14T01:08:06.443129+0000 mgr.a (mgr.14355) 7232 : audit [DBG] from='client.163887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:07 smithi131 bash[24745]: cluster 2024-09-14T01:08:06.862545+0000 mgr.a (mgr.14355) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:07 smithi171 bash[25040]: audit 2024-09-14T01:08:06.443129+0000 mgr.a (mgr.14355) 7232 : audit [DBG] from='client.163887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:07 smithi171 bash[25040]: cluster 2024-09-14T01:08:06.862545+0000 mgr.a (mgr.14355) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:09 smithi007 bash[22722]: cluster 2024-09-14T01:08:08.863281+0000 mgr.a (mgr.14355) 7234 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:08:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:09 smithi131 bash[24745]: cluster 2024-09-14T01:08:08.863281+0000 mgr.a (mgr.14355) 7234 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:08:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:09 smithi171 bash[25040]: cluster 2024-09-14T01:08:08.863281+0000 mgr.a (mgr.14355) 7234 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:08:11.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:11.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:11 smithi007 bash[22722]: cluster 2024-09-14T01:08:10.865212+0000 mgr.a (mgr.14355) 7235 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:08:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:11 smithi131 bash[24745]: cluster 2024-09-14T01:08:10.865212+0000 mgr.a (mgr.14355) 7235 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:08:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:11 smithi171 bash[25040]: cluster 2024-09-14T01:08:10.865212+0000 mgr.a (mgr.14355) 7235 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:08:12.682 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:12 smithi007 bash[22722]: audit 2024-09-14T01:08:12.234898+0000 mgr.a (mgr.14355) 7236 : audit [DBG] from='client.163962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:12 smithi131 bash[24745]: audit 2024-09-14T01:08:12.234898+0000 mgr.a (mgr.14355) 7236 : audit [DBG] from='client.163962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:12 smithi171 bash[25040]: audit 2024-09-14T01:08:12.234898+0000 mgr.a (mgr.14355) 7236 : audit [DBG] from='client.163962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:13 smithi007 bash[22722]: cluster 2024-09-14T01:08:12.866165+0000 mgr.a (mgr.14355) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:13 smithi131 bash[24745]: cluster 2024-09-14T01:08:12.866165+0000 mgr.a (mgr.14355) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:13 smithi171 bash[25040]: cluster 2024-09-14T01:08:12.866165+0000 mgr.a (mgr.14355) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:15 smithi007 bash[22722]: cluster 2024-09-14T01:08:14.866948+0000 mgr.a (mgr.14355) 7238 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:15 smithi131 bash[24745]: cluster 2024-09-14T01:08:14.866948+0000 mgr.a (mgr.14355) 7238 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:15 smithi171 bash[25040]: cluster 2024-09-14T01:08:14.866948+0000 mgr.a (mgr.14355) 7238 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:17.684 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:17.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:18.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:17 smithi007 bash[22722]: cluster 2024-09-14T01:08:16.869154+0000 mgr.a (mgr.14355) 7239 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:17 smithi131 bash[24745]: cluster 2024-09-14T01:08:16.869154+0000 mgr.a (mgr.14355) 7239 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:17 smithi171 bash[25040]: cluster 2024-09-14T01:08:16.869154+0000 mgr.a (mgr.14355) 7239 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:18.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:18.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:19.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:18 smithi007 bash[22722]: audit 2024-09-14T01:08:18.023366+0000 mgr.a (mgr.14355) 7240 : audit [DBG] from='client.164040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:18 smithi131 bash[24745]: audit 2024-09-14T01:08:18.023366+0000 mgr.a (mgr.14355) 7240 : audit [DBG] from='client.164040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:18 smithi171 bash[25040]: audit 2024-09-14T01:08:18.023366+0000 mgr.a (mgr.14355) 7240 : audit [DBG] from='client.164040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:19 smithi131 bash[24745]: cluster 2024-09-14T01:08:18.870104+0000 mgr.a (mgr.14355) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:19 smithi171 bash[25040]: cluster 2024-09-14T01:08:18.870104+0000 mgr.a (mgr.14355) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:19 smithi007 bash[22722]: cluster 2024-09-14T01:08:18.870104+0000 mgr.a (mgr.14355) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:21 smithi131 bash[24745]: cluster 2024-09-14T01:08:20.872319+0000 mgr.a (mgr.14355) 7242 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:21 smithi171 bash[25040]: cluster 2024-09-14T01:08:20.872319+0000 mgr.a (mgr.14355) 7242 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:21 smithi007 bash[22722]: cluster 2024-09-14T01:08:20.872319+0000 mgr.a (mgr.14355) 7242 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:23.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:23.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:24.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:24.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:24.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:23 smithi131 bash[24745]: cluster 2024-09-14T01:08:22.873071+0000 mgr.a (mgr.14355) 7243 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:23 smithi171 bash[25040]: cluster 2024-09-14T01:08:22.873071+0000 mgr.a (mgr.14355) 7243 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:23 smithi007 bash[22722]: cluster 2024-09-14T01:08:22.873071+0000 mgr.a (mgr.14355) 7243 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:24 smithi131 bash[24745]: audit 2024-09-14T01:08:23.767250+0000 mgr.a (mgr.14355) 7244 : audit [DBG] from='client.164118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:24 smithi171 bash[25040]: audit 2024-09-14T01:08:23.767250+0000 mgr.a (mgr.14355) 7244 : audit [DBG] from='client.164118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:24 smithi007 bash[22722]: audit 2024-09-14T01:08:23.767250+0000 mgr.a (mgr.14355) 7244 : audit [DBG] from='client.164118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:25 smithi131 bash[24745]: cluster 2024-09-14T01:08:24.873995+0000 mgr.a (mgr.14355) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:25 smithi171 bash[25040]: cluster 2024-09-14T01:08:24.873995+0000 mgr.a (mgr.14355) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:25 smithi007 bash[22722]: cluster 2024-09-14T01:08:24.873995+0000 mgr.a (mgr.14355) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:27 smithi131 bash[24745]: cluster 2024-09-14T01:08:26.876303+0000 mgr.a (mgr.14355) 7246 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:27 smithi171 bash[25040]: cluster 2024-09-14T01:08:26.876303+0000 mgr.a (mgr.14355) 7246 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:27 smithi007 bash[22722]: cluster 2024-09-14T01:08:26.876303+0000 mgr.a (mgr.14355) 7246 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:29.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:29 smithi131 bash[24745]: cluster 2024-09-14T01:08:28.877071+0000 mgr.a (mgr.14355) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:29 smithi171 bash[25040]: cluster 2024-09-14T01:08:28.877071+0000 mgr.a (mgr.14355) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:29 smithi007 bash[22722]: cluster 2024-09-14T01:08:28.877071+0000 mgr.a (mgr.14355) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:30 smithi131 bash[24745]: audit 2024-09-14T01:08:29.516590+0000 mgr.a (mgr.14355) 7248 : audit [DBG] from='client.164193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:30 smithi171 bash[25040]: audit 2024-09-14T01:08:29.516590+0000 mgr.a (mgr.14355) 7248 : audit [DBG] from='client.164193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:30 smithi007 bash[22722]: audit 2024-09-14T01:08:29.516590+0000 mgr.a (mgr.14355) 7248 : audit [DBG] from='client.164193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:31 smithi131 bash[24745]: cluster 2024-09-14T01:08:30.879344+0000 mgr.a (mgr.14355) 7249 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:31 smithi171 bash[25040]: cluster 2024-09-14T01:08:30.879344+0000 mgr.a (mgr.14355) 7249 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:31 smithi007 bash[22722]: cluster 2024-09-14T01:08:30.879344+0000 mgr.a (mgr.14355) 7249 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:33 smithi131 bash[24745]: cluster 2024-09-14T01:08:32.880118+0000 mgr.a (mgr.14355) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:33 smithi171 bash[25040]: cluster 2024-09-14T01:08:32.880118+0000 mgr.a (mgr.14355) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:33 smithi007 bash[22722]: cluster 2024-09-14T01:08:32.880118+0000 mgr.a (mgr.14355) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:34.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:34.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:35.703 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:36 smithi131 bash[24745]: cluster 2024-09-14T01:08:34.880862+0000 mgr.a (mgr.14355) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:36 smithi131 bash[24745]: audit 2024-09-14T01:08:35.280449+0000 mgr.a (mgr.14355) 7252 : audit [DBG] from='client.164271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:36 smithi171 bash[25040]: cluster 2024-09-14T01:08:34.880862+0000 mgr.a (mgr.14355) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:36 smithi171 bash[25040]: audit 2024-09-14T01:08:35.280449+0000 mgr.a (mgr.14355) 7252 : audit [DBG] from='client.164271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:36 smithi007 bash[22722]: cluster 2024-09-14T01:08:34.880862+0000 mgr.a (mgr.14355) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:36 smithi007 bash[22722]: audit 2024-09-14T01:08:35.280449+0000 mgr.a (mgr.14355) 7252 : audit [DBG] from='client.164271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:38 smithi131 bash[24745]: cluster 2024-09-14T01:08:36.883605+0000 mgr.a (mgr.14355) 7253 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:38 smithi131 bash[24745]: audit 2024-09-14T01:08:37.696614+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:08:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:38 smithi171 bash[25040]: cluster 2024-09-14T01:08:36.883605+0000 mgr.a (mgr.14355) 7253 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:38 smithi171 bash[25040]: audit 2024-09-14T01:08:37.696614+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:08:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:38 smithi007 bash[22722]: cluster 2024-09-14T01:08:36.883605+0000 mgr.a (mgr.14355) 7253 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:38 smithi007 bash[22722]: audit 2024-09-14T01:08:37.696614+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:08:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:39 smithi131 bash[24745]: audit 2024-09-14T01:08:38.544164+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:08:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:39 smithi131 bash[24745]: audit 2024-09-14T01:08:38.545869+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:08:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:39 smithi131 bash[24745]: audit 2024-09-14T01:08:38.556155+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:08:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:39 smithi131 bash[24745]: audit 2024-09-14T01:08:38.561551+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:39 smithi171 bash[25040]: audit 2024-09-14T01:08:38.544164+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:08:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:39 smithi171 bash[25040]: audit 2024-09-14T01:08:38.545869+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:08:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:39 smithi171 bash[25040]: audit 2024-09-14T01:08:38.556155+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:08:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:39 smithi171 bash[25040]: audit 2024-09-14T01:08:38.561551+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:39.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22722]: audit 2024-09-14T01:08:38.544164+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:08:39.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22722]: audit 2024-09-14T01:08:38.545869+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:08:39.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22722]: audit 2024-09-14T01:08:38.556155+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:08:39.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22722]: audit 2024-09-14T01:08:38.561551+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:39.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22972]: debug 2024-09-14T01:08:39.294+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:08:39.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:08:39 smithi007 bash[22972]: debug 2024-09-14T01:08:39.294+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:08:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:40 smithi131 bash[24745]: audit 2024-09-14T01:08:38.562766+0000 mgr.a (mgr.14355) 7254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:40 smithi131 bash[24745]: cluster 2024-09-14T01:08:38.884118+0000 mgr.a (mgr.14355) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:40 smithi131 bash[24745]: audit 2024-09-14T01:08:39.295796+0000 mgr.a (mgr.14355) 7256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:08:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:40 smithi131 bash[24745]: cephadm 2024-09-14T01:08:39.297429+0000 mgr.a (mgr.14355) 7257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:08:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:40 smithi171 bash[25040]: audit 2024-09-14T01:08:38.562766+0000 mgr.a (mgr.14355) 7254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:40 smithi171 bash[25040]: cluster 2024-09-14T01:08:38.884118+0000 mgr.a (mgr.14355) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:40 smithi171 bash[25040]: audit 2024-09-14T01:08:39.295796+0000 mgr.a (mgr.14355) 7256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:08:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:40 smithi171 bash[25040]: cephadm 2024-09-14T01:08:39.297429+0000 mgr.a (mgr.14355) 7257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:08:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:40 smithi007 bash[22722]: audit 2024-09-14T01:08:38.562766+0000 mgr.a (mgr.14355) 7254 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:08:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:40 smithi007 bash[22722]: cluster 2024-09-14T01:08:38.884118+0000 mgr.a (mgr.14355) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:08:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:40 smithi007 bash[22722]: audit 2024-09-14T01:08:39.295796+0000 mgr.a (mgr.14355) 7256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:08:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:40 smithi007 bash[22722]: cephadm 2024-09-14T01:08:39.297429+0000 mgr.a (mgr.14355) 7257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:08:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:40.705 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:40.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:41.478 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:41.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:41.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:41.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:41.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:42 smithi131 bash[24745]: cluster 2024-09-14T01:08:40.886349+0000 mgr.a (mgr.14355) 7258 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:42 smithi131 bash[24745]: audit 2024-09-14T01:08:41.041912+0000 mgr.a (mgr.14355) 7259 : audit [DBG] from='client.164457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:42 smithi171 bash[25040]: cluster 2024-09-14T01:08:40.886349+0000 mgr.a (mgr.14355) 7258 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:42 smithi171 bash[25040]: audit 2024-09-14T01:08:41.041912+0000 mgr.a (mgr.14355) 7259 : audit [DBG] from='client.164457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:42 smithi007 bash[22722]: cluster 2024-09-14T01:08:40.886349+0000 mgr.a (mgr.14355) 7258 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:42 smithi007 bash[22722]: audit 2024-09-14T01:08:41.041912+0000 mgr.a (mgr.14355) 7259 : audit [DBG] from='client.164457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:44 smithi131 bash[24745]: cluster 2024-09-14T01:08:42.887386+0000 mgr.a (mgr.14355) 7260 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:44 smithi171 bash[25040]: cluster 2024-09-14T01:08:42.887386+0000 mgr.a (mgr.14355) 7260 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:44 smithi007 bash[22722]: cluster 2024-09-14T01:08:42.887386+0000 mgr.a (mgr.14355) 7260 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:46 smithi131 bash[24745]: cluster 2024-09-14T01:08:44.888389+0000 mgr.a (mgr.14355) 7261 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:46 smithi171 bash[25040]: cluster 2024-09-14T01:08:44.888389+0000 mgr.a (mgr.14355) 7261 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:46 smithi007 bash[22722]: cluster 2024-09-14T01:08:44.888389+0000 mgr.a (mgr.14355) 7261 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:08:46.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:46.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:47.253 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:48 smithi131 bash[24745]: audit 2024-09-14T01:08:46.811047+0000 mgr.a (mgr.14355) 7262 : audit [DBG] from='client.164535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:48 smithi131 bash[24745]: cluster 2024-09-14T01:08:46.889890+0000 mgr.a (mgr.14355) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:48 smithi171 bash[25040]: audit 2024-09-14T01:08:46.811047+0000 mgr.a (mgr.14355) 7262 : audit [DBG] from='client.164535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:48 smithi171 bash[25040]: cluster 2024-09-14T01:08:46.889890+0000 mgr.a (mgr.14355) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:48 smithi007 bash[22722]: audit 2024-09-14T01:08:46.811047+0000 mgr.a (mgr.14355) 7262 : audit [DBG] from='client.164535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:48 smithi007 bash[22722]: cluster 2024-09-14T01:08:46.889890+0000 mgr.a (mgr.14355) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:50 smithi131 bash[24745]: cluster 2024-09-14T01:08:48.890832+0000 mgr.a (mgr.14355) 7264 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:50 smithi171 bash[25040]: cluster 2024-09-14T01:08:48.890832+0000 mgr.a (mgr.14355) 7264 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:50 smithi007 bash[22722]: cluster 2024-09-14T01:08:48.890832+0000 mgr.a (mgr.14355) 7264 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:52.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:52.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:52.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:52 smithi171 bash[25040]: cluster 2024-09-14T01:08:50.893047+0000 mgr.a (mgr.14355) 7265 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:52 smithi007 bash[22722]: cluster 2024-09-14T01:08:50.893047+0000 mgr.a (mgr.14355) 7265 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:52 smithi131 bash[24745]: cluster 2024-09-14T01:08:50.893047+0000 mgr.a (mgr.14355) 7265 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:08:53.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:53.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:53.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:53.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:53.010 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:54 smithi171 bash[25040]: audit 2024-09-14T01:08:52.586772+0000 mgr.a (mgr.14355) 7266 : audit [DBG] from='client.164607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:54 smithi171 bash[25040]: cluster 2024-09-14T01:08:52.893523+0000 mgr.a (mgr.14355) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:54 smithi007 bash[22722]: audit 2024-09-14T01:08:52.586772+0000 mgr.a (mgr.14355) 7266 : audit [DBG] from='client.164607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:54 smithi007 bash[22722]: cluster 2024-09-14T01:08:52.893523+0000 mgr.a (mgr.14355) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:54 smithi131 bash[24745]: audit 2024-09-14T01:08:52.586772+0000 mgr.a (mgr.14355) 7266 : audit [DBG] from='client.164607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:54 smithi131 bash[24745]: cluster 2024-09-14T01:08:52.893523+0000 mgr.a (mgr.14355) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:56 smithi171 bash[25040]: cluster 2024-09-14T01:08:54.894354+0000 mgr.a (mgr.14355) 7268 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:56 smithi007 bash[22722]: cluster 2024-09-14T01:08:54.894354+0000 mgr.a (mgr.14355) 7268 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:56 smithi131 bash[24745]: cluster 2024-09-14T01:08:54.894354+0000 mgr.a (mgr.14355) 7268 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:08:58.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:08:58.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:08:58.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:08:58.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:58 smithi007 bash[22722]: cluster 2024-09-14T01:08:56.896562+0000 mgr.a (mgr.14355) 7269 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:58 smithi131 bash[24745]: cluster 2024-09-14T01:08:56.896562+0000 mgr.a (mgr.14355) 7269 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:58 smithi171 bash[25040]: cluster 2024-09-14T01:08:56.896562+0000 mgr.a (mgr.14355) 7269 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:08:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:08:58.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:08:58.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:08:58.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:08:58.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:08:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:08:59 smithi007 bash[22722]: audit 2024-09-14T01:08:58.344459+0000 mgr.a (mgr.14355) 7270 : audit [DBG] from='client.164685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:08:59 smithi131 bash[24745]: audit 2024-09-14T01:08:58.344459+0000 mgr.a (mgr.14355) 7270 : audit [DBG] from='client.164685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:08:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:08:59 smithi171 bash[25040]: audit 2024-09-14T01:08:58.344459+0000 mgr.a (mgr.14355) 7270 : audit [DBG] from='client.164685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:00 smithi007 bash[22722]: cluster 2024-09-14T01:08:58.897493+0000 mgr.a (mgr.14355) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:00 smithi131 bash[24745]: cluster 2024-09-14T01:08:58.897493+0000 mgr.a (mgr.14355) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:00 smithi171 bash[25040]: cluster 2024-09-14T01:08:58.897493+0000 mgr.a (mgr.14355) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:02 smithi007 bash[22722]: cluster 2024-09-14T01:09:00.899748+0000 mgr.a (mgr.14355) 7272 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:02 smithi131 bash[24745]: cluster 2024-09-14T01:09:00.899748+0000 mgr.a (mgr.14355) 7272 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:02 smithi171 bash[25040]: cluster 2024-09-14T01:09:00.899748+0000 mgr.a (mgr.14355) 7272 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:03.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:03.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:04.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:04 smithi007 bash[22722]: cluster 2024-09-14T01:09:02.900482+0000 mgr.a (mgr.14355) 7273 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:04.527 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:04.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:04 smithi131 bash[24745]: cluster 2024-09-14T01:09:02.900482+0000 mgr.a (mgr.14355) 7273 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:04 smithi171 bash[25040]: cluster 2024-09-14T01:09:02.900482+0000 mgr.a (mgr.14355) 7273 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:05 smithi007 bash[22722]: audit 2024-09-14T01:09:04.105195+0000 mgr.a (mgr.14355) 7274 : audit [DBG] from='client.164760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:05 smithi131 bash[24745]: audit 2024-09-14T01:09:04.105195+0000 mgr.a (mgr.14355) 7274 : audit [DBG] from='client.164760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:05 smithi171 bash[25040]: audit 2024-09-14T01:09:04.105195+0000 mgr.a (mgr.14355) 7274 : audit [DBG] from='client.164760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:06 smithi007 bash[22722]: cluster 2024-09-14T01:09:04.901477+0000 mgr.a (mgr.14355) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:06 smithi131 bash[24745]: cluster 2024-09-14T01:09:04.901477+0000 mgr.a (mgr.14355) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:06 smithi171 bash[25040]: cluster 2024-09-14T01:09:04.901477+0000 mgr.a (mgr.14355) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:08 smithi007 bash[22722]: cluster 2024-09-14T01:09:06.903762+0000 mgr.a (mgr.14355) 7276 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:08 smithi131 bash[24745]: cluster 2024-09-14T01:09:06.903762+0000 mgr.a (mgr.14355) 7276 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:08 smithi171 bash[25040]: cluster 2024-09-14T01:09:06.903762+0000 mgr.a (mgr.14355) 7276 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:09.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:10.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:10.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:10.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:10 smithi007 bash[22722]: cluster 2024-09-14T01:09:08.904516+0000 mgr.a (mgr.14355) 7277 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:10 smithi131 bash[24745]: cluster 2024-09-14T01:09:08.904516+0000 mgr.a (mgr.14355) 7277 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:10 smithi171 bash[25040]: cluster 2024-09-14T01:09:08.904516+0000 mgr.a (mgr.14355) 7277 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:11 smithi007 bash[22722]: audit 2024-09-14T01:09:09.854591+0000 mgr.a (mgr.14355) 7278 : audit [DBG] from='client.164838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:11 smithi131 bash[24745]: audit 2024-09-14T01:09:09.854591+0000 mgr.a (mgr.14355) 7278 : audit [DBG] from='client.164838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:11 smithi171 bash[25040]: audit 2024-09-14T01:09:09.854591+0000 mgr.a (mgr.14355) 7278 : audit [DBG] from='client.164838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:12 smithi007 bash[22722]: cluster 2024-09-14T01:09:10.906892+0000 mgr.a (mgr.14355) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:09:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:12 smithi131 bash[24745]: cluster 2024-09-14T01:09:10.906892+0000 mgr.a (mgr.14355) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:09:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:12 smithi171 bash[25040]: cluster 2024-09-14T01:09:10.906892+0000 mgr.a (mgr.14355) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:09:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:14 smithi007 bash[22722]: cluster 2024-09-14T01:09:12.907658+0000 mgr.a (mgr.14355) 7280 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:14 smithi131 bash[24745]: cluster 2024-09-14T01:09:12.907658+0000 mgr.a (mgr.14355) 7280 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:14 smithi171 bash[25040]: cluster 2024-09-14T01:09:12.907658+0000 mgr.a (mgr.14355) 7280 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:15.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:15.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:15.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:16.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:16 smithi007 bash[22722]: cluster 2024-09-14T01:09:14.908411+0000 mgr.a (mgr.14355) 7281 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:16 smithi131 bash[24745]: cluster 2024-09-14T01:09:14.908411+0000 mgr.a (mgr.14355) 7281 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:16 smithi171 bash[25040]: cluster 2024-09-14T01:09:14.908411+0000 mgr.a (mgr.14355) 7281 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:09:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:17 smithi007 bash[22722]: audit 2024-09-14T01:09:15.600004+0000 mgr.a (mgr.14355) 7282 : audit [DBG] from='client.164916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:17 smithi131 bash[24745]: audit 2024-09-14T01:09:15.600004+0000 mgr.a (mgr.14355) 7282 : audit [DBG] from='client.164916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:17 smithi171 bash[25040]: audit 2024-09-14T01:09:15.600004+0000 mgr.a (mgr.14355) 7282 : audit [DBG] from='client.164916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:18 smithi007 bash[22722]: cluster 2024-09-14T01:09:16.911193+0000 mgr.a (mgr.14355) 7283 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:18 smithi131 bash[24745]: cluster 2024-09-14T01:09:16.911193+0000 mgr.a (mgr.14355) 7283 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:18 smithi171 bash[25040]: cluster 2024-09-14T01:09:16.911193+0000 mgr.a (mgr.14355) 7283 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:20 smithi007 bash[22722]: cluster 2024-09-14T01:09:18.911946+0000 mgr.a (mgr.14355) 7284 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:09:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:20 smithi131 bash[24745]: cluster 2024-09-14T01:09:18.911946+0000 mgr.a (mgr.14355) 7284 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:09:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:20 smithi171 bash[25040]: cluster 2024-09-14T01:09:18.911946+0000 mgr.a (mgr.14355) 7284 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:09:21.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:21.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:21.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:21.784 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:21.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:22 smithi007 bash[22722]: cluster 2024-09-14T01:09:20.913912+0000 mgr.a (mgr.14355) 7285 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:22 smithi131 bash[24745]: cluster 2024-09-14T01:09:20.913912+0000 mgr.a (mgr.14355) 7285 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:22 smithi171 bash[25040]: cluster 2024-09-14T01:09:20.913912+0000 mgr.a (mgr.14355) 7285 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:23 smithi007 bash[22722]: audit 2024-09-14T01:09:21.369598+0000 mgr.a (mgr.14355) 7286 : audit [DBG] from='client.164991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:23 smithi131 bash[24745]: audit 2024-09-14T01:09:21.369598+0000 mgr.a (mgr.14355) 7286 : audit [DBG] from='client.164991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:23 smithi171 bash[25040]: audit 2024-09-14T01:09:21.369598+0000 mgr.a (mgr.14355) 7286 : audit [DBG] from='client.164991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:24 smithi007 bash[22722]: cluster 2024-09-14T01:09:22.914819+0000 mgr.a (mgr.14355) 7287 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:24 smithi131 bash[24745]: cluster 2024-09-14T01:09:22.914819+0000 mgr.a (mgr.14355) 7287 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:24 smithi171 bash[25040]: cluster 2024-09-14T01:09:22.914819+0000 mgr.a (mgr.14355) 7287 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:26 smithi007 bash[22722]: cluster 2024-09-14T01:09:24.915586+0000 mgr.a (mgr.14355) 7288 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:26 smithi131 bash[24745]: cluster 2024-09-14T01:09:24.915586+0000 mgr.a (mgr.14355) 7288 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:26 smithi171 bash[25040]: cluster 2024-09-14T01:09:24.915586+0000 mgr.a (mgr.14355) 7288 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:09:26.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:27.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:27.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:27.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:27.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:27.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:28 smithi007 bash[22722]: cluster 2024-09-14T01:09:26.916651+0000 mgr.a (mgr.14355) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:09:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:28 smithi007 bash[22722]: audit 2024-09-14T01:09:27.122655+0000 mgr.a (mgr.14355) 7290 : audit [DBG] from='client.165066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:28 smithi131 bash[24745]: cluster 2024-09-14T01:09:26.916651+0000 mgr.a (mgr.14355) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:09:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:28 smithi131 bash[24745]: audit 2024-09-14T01:09:27.122655+0000 mgr.a (mgr.14355) 7290 : audit [DBG] from='client.165066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:28 smithi171 bash[25040]: cluster 2024-09-14T01:09:26.916651+0000 mgr.a (mgr.14355) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:09:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:28 smithi171 bash[25040]: audit 2024-09-14T01:09:27.122655+0000 mgr.a (mgr.14355) 7290 : audit [DBG] from='client.165066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:30 smithi007 bash[22722]: cluster 2024-09-14T01:09:28.917468+0000 mgr.a (mgr.14355) 7291 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:30 smithi131 bash[24745]: cluster 2024-09-14T01:09:28.917468+0000 mgr.a (mgr.14355) 7291 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:30 smithi171 bash[25040]: cluster 2024-09-14T01:09:28.917468+0000 mgr.a (mgr.14355) 7291 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:32 smithi007 bash[22722]: cluster 2024-09-14T01:09:30.919670+0000 mgr.a (mgr.14355) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:32 smithi131 bash[24745]: cluster 2024-09-14T01:09:30.919670+0000 mgr.a (mgr.14355) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:32 smithi171 bash[25040]: cluster 2024-09-14T01:09:30.919670+0000 mgr.a (mgr.14355) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:32.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:32.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:32.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:33.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:33.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:34 smithi007 bash[22722]: audit 2024-09-14T01:09:32.889975+0000 mgr.a (mgr.14355) 7293 : audit [DBG] from='client.165144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:34 smithi007 bash[22722]: cluster 2024-09-14T01:09:32.920329+0000 mgr.a (mgr.14355) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:34 smithi131 bash[24745]: audit 2024-09-14T01:09:32.889975+0000 mgr.a (mgr.14355) 7293 : audit [DBG] from='client.165144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:34 smithi131 bash[24745]: cluster 2024-09-14T01:09:32.920329+0000 mgr.a (mgr.14355) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:34 smithi171 bash[25040]: audit 2024-09-14T01:09:32.889975+0000 mgr.a (mgr.14355) 7293 : audit [DBG] from='client.165144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:34 smithi171 bash[25040]: cluster 2024-09-14T01:09:32.920329+0000 mgr.a (mgr.14355) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:36 smithi007 bash[22722]: cluster 2024-09-14T01:09:34.921216+0000 mgr.a (mgr.14355) 7295 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:36 smithi131 bash[24745]: cluster 2024-09-14T01:09:34.921216+0000 mgr.a (mgr.14355) 7295 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:36 smithi171 bash[25040]: cluster 2024-09-14T01:09:34.921216+0000 mgr.a (mgr.14355) 7295 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:38.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:38.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:38.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:38 smithi007 bash[22722]: cluster 2024-09-14T01:09:36.923458+0000 mgr.a (mgr.14355) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:38 smithi131 bash[24745]: cluster 2024-09-14T01:09:36.923458+0000 mgr.a (mgr.14355) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:38 smithi171 bash[25040]: cluster 2024-09-14T01:09:36.923458+0000 mgr.a (mgr.14355) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:39.080 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:39.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:39.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:40 smithi007 bash[22722]: audit 2024-09-14T01:09:38.642603+0000 mgr.a (mgr.14355) 7297 : audit [DBG] from='client.165222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:40 smithi007 bash[22722]: cluster 2024-09-14T01:09:38.924012+0000 mgr.a (mgr.14355) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:40 smithi007 bash[22722]: audit 2024-09-14T01:09:39.356231+0000 mon.a (mon.0) 1686 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:09:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:40 smithi131 bash[24745]: audit 2024-09-14T01:09:38.642603+0000 mgr.a (mgr.14355) 7297 : audit [DBG] from='client.165222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:40 smithi131 bash[24745]: cluster 2024-09-14T01:09:38.924012+0000 mgr.a (mgr.14355) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:40 smithi131 bash[24745]: audit 2024-09-14T01:09:39.356231+0000 mon.a (mon.0) 1686 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:09:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:40 smithi171 bash[25040]: audit 2024-09-14T01:09:38.642603+0000 mgr.a (mgr.14355) 7297 : audit [DBG] from='client.165222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:40 smithi171 bash[25040]: cluster 2024-09-14T01:09:38.924012+0000 mgr.a (mgr.14355) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:40 smithi171 bash[25040]: audit 2024-09-14T01:09:39.356231+0000 mon.a (mon.0) 1686 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:09:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:42 smithi007 bash[22722]: cluster 2024-09-14T01:09:40.926344+0000 mgr.a (mgr.14355) 7299 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:42 smithi131 bash[24745]: cluster 2024-09-14T01:09:40.926344+0000 mgr.a (mgr.14355) 7299 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:42 smithi171 bash[25040]: cluster 2024-09-14T01:09:40.926344+0000 mgr.a (mgr.14355) 7299 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:44.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:44.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:44.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:44 smithi007 bash[22722]: cluster 2024-09-14T01:09:42.927117+0000 mgr.a (mgr.14355) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:44 smithi131 bash[24745]: cluster 2024-09-14T01:09:42.927117+0000 mgr.a (mgr.14355) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:44 smithi171 bash[25040]: cluster 2024-09-14T01:09:42.927117+0000 mgr.a (mgr.14355) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:44.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:44.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:44.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:44.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:44.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.414450+0000 mgr.a (mgr.14355) 7301 : audit [DBG] from='client.165300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.697793+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.701990+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.705106+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.708143+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.725758+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:44.732840+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: cluster 2024-09-14T01:09:44.927905+0000 mgr.a (mgr.14355) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:45.442200+0000 mon.a (mon.0) 1693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:09:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:45.444025+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:09:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:45.453801+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:45 smithi007 bash[22722]: audit 2024-09-14T01:09:45.458498+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.414450+0000 mgr.a (mgr.14355) 7301 : audit [DBG] from='client.165300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.697793+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.701990+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.705106+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.708143+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.725758+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:44.732840+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: cluster 2024-09-14T01:09:44.927905+0000 mgr.a (mgr.14355) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:45.442200+0000 mon.a (mon.0) 1693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:45.444025+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:45.453801+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:45 smithi131 bash[24745]: audit 2024-09-14T01:09:45.458498+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.414450+0000 mgr.a (mgr.14355) 7301 : audit [DBG] from='client.165300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.697793+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.701990+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.705106+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.708143+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.725758+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:44.732840+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: cluster 2024-09-14T01:09:44.927905+0000 mgr.a (mgr.14355) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:45.442200+0000 mon.a (mon.0) 1693 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:45.444025+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:45.453801+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:09:46.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:45 smithi171 bash[25040]: audit 2024-09-14T01:09:45.458498+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:46.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:09:46 smithi007 bash[22972]: debug 2024-09-14T01:09:46.161+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:09:46.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:09:46 smithi007 bash[22972]: debug 2024-09-14T01:09:46.165+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:09:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:46 smithi131 bash[24745]: audit 2024-09-14T01:09:45.459731+0000 mgr.a (mgr.14355) 7303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:46 smithi131 bash[24745]: audit 2024-09-14T01:09:46.165084+0000 mgr.a (mgr.14355) 7304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:09:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:46 smithi131 bash[24745]: cephadm 2024-09-14T01:09:46.166317+0000 mgr.a (mgr.14355) 7305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:09:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:46 smithi171 bash[25040]: audit 2024-09-14T01:09:45.459731+0000 mgr.a (mgr.14355) 7303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:46 smithi171 bash[25040]: audit 2024-09-14T01:09:46.165084+0000 mgr.a (mgr.14355) 7304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:09:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:46 smithi171 bash[25040]: cephadm 2024-09-14T01:09:46.166317+0000 mgr.a (mgr.14355) 7305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:09:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:46 smithi007 bash[22722]: audit 2024-09-14T01:09:45.459731+0000 mgr.a (mgr.14355) 7303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:09:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:46 smithi007 bash[22722]: audit 2024-09-14T01:09:46.165084+0000 mgr.a (mgr.14355) 7304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:09:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:46 smithi007 bash[22722]: cephadm 2024-09-14T01:09:46.166317+0000 mgr.a (mgr.14355) 7305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:09:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:47 smithi131 bash[24745]: cluster 2024-09-14T01:09:46.930813+0000 mgr.a (mgr.14355) 7306 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:47 smithi171 bash[25040]: cluster 2024-09-14T01:09:46.930813+0000 mgr.a (mgr.14355) 7306 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:47 smithi007 bash[22722]: cluster 2024-09-14T01:09:46.930813+0000 mgr.a (mgr.14355) 7306 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:09:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:49 smithi131 bash[24745]: cluster 2024-09-14T01:09:48.931755+0000 mgr.a (mgr.14355) 7307 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:49 smithi171 bash[25040]: cluster 2024-09-14T01:09:48.931755+0000 mgr.a (mgr.14355) 7307 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:49 smithi007 bash[22722]: cluster 2024-09-14T01:09:48.931755+0000 mgr.a (mgr.14355) 7307 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:09:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:50.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:50 smithi131 bash[24745]: audit 2024-09-14T01:09:50.186044+0000 mgr.a (mgr.14355) 7308 : audit [DBG] from='client.165477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:50 smithi171 bash[25040]: audit 2024-09-14T01:09:50.186044+0000 mgr.a (mgr.14355) 7308 : audit [DBG] from='client.165477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:50 smithi007 bash[22722]: audit 2024-09-14T01:09:50.186044+0000 mgr.a (mgr.14355) 7308 : audit [DBG] from='client.165477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:51 smithi131 bash[24745]: cluster 2024-09-14T01:09:50.934633+0000 mgr.a (mgr.14355) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:09:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:51 smithi171 bash[25040]: cluster 2024-09-14T01:09:50.934633+0000 mgr.a (mgr.14355) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:09:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:51 smithi007 bash[22722]: cluster 2024-09-14T01:09:50.934633+0000 mgr.a (mgr.14355) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:09:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:54 smithi131 bash[24745]: cluster 2024-09-14T01:09:52.935435+0000 mgr.a (mgr.14355) 7310 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:54 smithi171 bash[25040]: cluster 2024-09-14T01:09:52.935435+0000 mgr.a (mgr.14355) 7310 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:54 smithi007 bash[22722]: cluster 2024-09-14T01:09:52.935435+0000 mgr.a (mgr.14355) 7310 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:55.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:09:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:09:55.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:09:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:56 smithi131 bash[24745]: cluster 2024-09-14T01:09:54.936202+0000 mgr.a (mgr.14355) 7311 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:56 smithi171 bash[25040]: cluster 2024-09-14T01:09:54.936202+0000 mgr.a (mgr.14355) 7311 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:56.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:09:56.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:09:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:09:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:09:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:09:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:56 smithi007 bash[22722]: cluster 2024-09-14T01:09:54.936202+0000 mgr.a (mgr.14355) 7311 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:09:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:57 smithi131 bash[24745]: audit 2024-09-14T01:09:55.959543+0000 mgr.a (mgr.14355) 7312 : audit [DBG] from='client.165552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:57 smithi171 bash[25040]: audit 2024-09-14T01:09:55.959543+0000 mgr.a (mgr.14355) 7312 : audit [DBG] from='client.165552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:57 smithi007 bash[22722]: audit 2024-09-14T01:09:55.959543+0000 mgr.a (mgr.14355) 7312 : audit [DBG] from='client.165552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:09:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:09:58 smithi131 bash[24745]: cluster 2024-09-14T01:09:56.939064+0000 mgr.a (mgr.14355) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:09:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:09:58 smithi171 bash[25040]: cluster 2024-09-14T01:09:56.939064+0000 mgr.a (mgr.14355) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:09:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:09:58 smithi007 bash[22722]: cluster 2024-09-14T01:09:56.939064+0000 mgr.a (mgr.14355) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:00 smithi131 bash[24745]: cluster 2024-09-14T01:09:58.939870+0000 mgr.a (mgr.14355) 7314 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:10:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:00 smithi131 bash[24745]: cluster 2024-09-14T01:10:00.000149+0000 mon.a (mon.0) 1697 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:10:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:00 smithi171 bash[25040]: cluster 2024-09-14T01:09:58.939870+0000 mgr.a (mgr.14355) 7314 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:10:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:00 smithi171 bash[25040]: cluster 2024-09-14T01:10:00.000149+0000 mon.a (mon.0) 1697 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:10:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:00 smithi007 bash[22722]: cluster 2024-09-14T01:09:58.939870+0000 mgr.a (mgr.14355) 7314 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:10:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:00 smithi007 bash[22722]: cluster 2024-09-14T01:10:00.000149+0000 mon.a (mon.0) 1697 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:10:01.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:01.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:02.151 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:02.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:02.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:02.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:02.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:02 smithi131 bash[24745]: cluster 2024-09-14T01:10:00.941841+0000 mgr.a (mgr.14355) 7315 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:02 smithi171 bash[25040]: cluster 2024-09-14T01:10:00.941841+0000 mgr.a (mgr.14355) 7315 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:02 smithi007 bash[22722]: cluster 2024-09-14T01:10:00.941841+0000 mgr.a (mgr.14355) 7315 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:03 smithi171 bash[25040]: audit 2024-09-14T01:10:01.706625+0000 mgr.a (mgr.14355) 7316 : audit [DBG] from='client.165630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:03 smithi007 bash[22722]: audit 2024-09-14T01:10:01.706625+0000 mgr.a (mgr.14355) 7316 : audit [DBG] from='client.165630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:03 smithi131 bash[24745]: audit 2024-09-14T01:10:01.706625+0000 mgr.a (mgr.14355) 7316 : audit [DBG] from='client.165630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:04 smithi171 bash[25040]: cluster 2024-09-14T01:10:02.942854+0000 mgr.a (mgr.14355) 7317 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:04 smithi007 bash[22722]: cluster 2024-09-14T01:10:02.942854+0000 mgr.a (mgr.14355) 7317 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:04 smithi131 bash[24745]: cluster 2024-09-14T01:10:02.942854+0000 mgr.a (mgr.14355) 7317 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:06 smithi171 bash[25040]: cluster 2024-09-14T01:10:04.943645+0000 mgr.a (mgr.14355) 7318 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:06.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:06 smithi007 bash[22722]: cluster 2024-09-14T01:10:04.943645+0000 mgr.a (mgr.14355) 7318 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:06 smithi131 bash[24745]: cluster 2024-09-14T01:10:04.943645+0000 mgr.a (mgr.14355) 7318 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:07.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:07.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:07.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:07.917 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:07.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:08 smithi171 bash[25040]: cluster 2024-09-14T01:10:06.945896+0000 mgr.a (mgr.14355) 7319 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:08 smithi007 bash[22722]: cluster 2024-09-14T01:10:06.945896+0000 mgr.a (mgr.14355) 7319 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:08 smithi131 bash[24745]: cluster 2024-09-14T01:10:06.945896+0000 mgr.a (mgr.14355) 7319 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:09 smithi007 bash[22722]: audit 2024-09-14T01:10:07.485623+0000 mgr.a (mgr.14355) 7320 : audit [DBG] from='client.165705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:09 smithi131 bash[24745]: audit 2024-09-14T01:10:07.485623+0000 mgr.a (mgr.14355) 7320 : audit [DBG] from='client.165705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:09 smithi171 bash[25040]: audit 2024-09-14T01:10:07.485623+0000 mgr.a (mgr.14355) 7320 : audit [DBG] from='client.165705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:10 smithi007 bash[22722]: cluster 2024-09-14T01:10:08.946913+0000 mgr.a (mgr.14355) 7321 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:10 smithi131 bash[24745]: cluster 2024-09-14T01:10:08.946913+0000 mgr.a (mgr.14355) 7321 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:10 smithi171 bash[25040]: cluster 2024-09-14T01:10:08.946913+0000 mgr.a (mgr.14355) 7321 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:12 smithi007 bash[22722]: cluster 2024-09-14T01:10:10.949086+0000 mgr.a (mgr.14355) 7322 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:12 smithi131 bash[24745]: cluster 2024-09-14T01:10:10.949086+0000 mgr.a (mgr.14355) 7322 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:12 smithi171 bash[25040]: cluster 2024-09-14T01:10:10.949086+0000 mgr.a (mgr.14355) 7322 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:13.694 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:13.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:13.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:14 smithi007 bash[22722]: cluster 2024-09-14T01:10:12.949903+0000 mgr.a (mgr.14355) 7323 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:14 smithi007 bash[22722]: audit 2024-09-14T01:10:13.254525+0000 mgr.a (mgr.14355) 7324 : audit [DBG] from='client.165783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:14 smithi131 bash[24745]: cluster 2024-09-14T01:10:12.949903+0000 mgr.a (mgr.14355) 7323 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:14 smithi131 bash[24745]: audit 2024-09-14T01:10:13.254525+0000 mgr.a (mgr.14355) 7324 : audit [DBG] from='client.165783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:14 smithi171 bash[25040]: cluster 2024-09-14T01:10:12.949903+0000 mgr.a (mgr.14355) 7323 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:14 smithi171 bash[25040]: audit 2024-09-14T01:10:13.254525+0000 mgr.a (mgr.14355) 7324 : audit [DBG] from='client.165783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:16 smithi007 bash[22722]: cluster 2024-09-14T01:10:14.951085+0000 mgr.a (mgr.14355) 7325 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:16 smithi131 bash[24745]: cluster 2024-09-14T01:10:14.951085+0000 mgr.a (mgr.14355) 7325 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:16 smithi171 bash[25040]: cluster 2024-09-14T01:10:14.951085+0000 mgr.a (mgr.14355) 7325 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:18 smithi007 bash[22722]: cluster 2024-09-14T01:10:16.953424+0000 mgr.a (mgr.14355) 7326 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:18.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:18 smithi131 bash[24745]: cluster 2024-09-14T01:10:16.953424+0000 mgr.a (mgr.14355) 7326 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:18 smithi171 bash[25040]: cluster 2024-09-14T01:10:16.953424+0000 mgr.a (mgr.14355) 7326 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:18.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:18.696 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:19.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:20 smithi007 bash[22722]: cluster 2024-09-14T01:10:18.954177+0000 mgr.a (mgr.14355) 7327 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:20 smithi007 bash[22722]: audit 2024-09-14T01:10:19.029576+0000 mgr.a (mgr.14355) 7328 : audit [DBG] from='client.165858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:20 smithi131 bash[24745]: cluster 2024-09-14T01:10:18.954177+0000 mgr.a (mgr.14355) 7327 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:20 smithi131 bash[24745]: audit 2024-09-14T01:10:19.029576+0000 mgr.a (mgr.14355) 7328 : audit [DBG] from='client.165858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:20 smithi171 bash[25040]: cluster 2024-09-14T01:10:18.954177+0000 mgr.a (mgr.14355) 7327 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:20 smithi171 bash[25040]: audit 2024-09-14T01:10:19.029576+0000 mgr.a (mgr.14355) 7328 : audit [DBG] from='client.165858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:22 smithi007 bash[22722]: cluster 2024-09-14T01:10:20.956514+0000 mgr.a (mgr.14355) 7329 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:22 smithi131 bash[24745]: cluster 2024-09-14T01:10:20.956514+0000 mgr.a (mgr.14355) 7329 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:22 smithi171 bash[25040]: cluster 2024-09-14T01:10:20.956514+0000 mgr.a (mgr.14355) 7329 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:24 smithi007 bash[22722]: cluster 2024-09-14T01:10:22.957290+0000 mgr.a (mgr.14355) 7330 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:24 smithi131 bash[24745]: cluster 2024-09-14T01:10:22.957290+0000 mgr.a (mgr.14355) 7330 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:24 smithi171 bash[25040]: cluster 2024-09-14T01:10:22.957290+0000 mgr.a (mgr.14355) 7330 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:25.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:26 smithi007 bash[22722]: audit 2024-09-14T01:10:24.825922+0000 mgr.a (mgr.14355) 7331 : audit [DBG] from='client.165930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:26 smithi007 bash[22722]: cluster 2024-09-14T01:10:24.966029+0000 mgr.a (mgr.14355) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:26 smithi131 bash[24745]: audit 2024-09-14T01:10:24.825922+0000 mgr.a (mgr.14355) 7331 : audit [DBG] from='client.165930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:26 smithi131 bash[24745]: cluster 2024-09-14T01:10:24.966029+0000 mgr.a (mgr.14355) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:26 smithi171 bash[25040]: audit 2024-09-14T01:10:24.825922+0000 mgr.a (mgr.14355) 7331 : audit [DBG] from='client.165930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:26 smithi171 bash[25040]: cluster 2024-09-14T01:10:24.966029+0000 mgr.a (mgr.14355) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:28 smithi007 bash[22722]: cluster 2024-09-14T01:10:26.968434+0000 mgr.a (mgr.14355) 7333 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:10:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:28 smithi131 bash[24745]: cluster 2024-09-14T01:10:26.968434+0000 mgr.a (mgr.14355) 7333 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:10:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:28 smithi171 bash[25040]: cluster 2024-09-14T01:10:26.968434+0000 mgr.a (mgr.14355) 7333 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:30 smithi007 bash[22722]: cluster 2024-09-14T01:10:28.969234+0000 mgr.a (mgr.14355) 7334 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:10:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:30 smithi131 bash[24745]: cluster 2024-09-14T01:10:28.969234+0000 mgr.a (mgr.14355) 7334 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:10:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:30 smithi171 bash[25040]: cluster 2024-09-14T01:10:28.969234+0000 mgr.a (mgr.14355) 7334 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:10:31.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:32 smithi007 bash[22722]: audit 2024-09-14T01:10:30.609647+0000 mgr.a (mgr.14355) 7335 : audit [DBG] from='client.166005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:32 smithi007 bash[22722]: cluster 2024-09-14T01:10:30.970585+0000 mgr.a (mgr.14355) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:32 smithi131 bash[24745]: audit 2024-09-14T01:10:30.609647+0000 mgr.a (mgr.14355) 7335 : audit [DBG] from='client.166005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:32 smithi131 bash[24745]: cluster 2024-09-14T01:10:30.970585+0000 mgr.a (mgr.14355) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:32 smithi171 bash[25040]: audit 2024-09-14T01:10:30.609647+0000 mgr.a (mgr.14355) 7335 : audit [DBG] from='client.166005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:32 smithi171 bash[25040]: cluster 2024-09-14T01:10:30.970585+0000 mgr.a (mgr.14355) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:34 smithi007 bash[22722]: cluster 2024-09-14T01:10:32.971337+0000 mgr.a (mgr.14355) 7337 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:34 smithi131 bash[24745]: cluster 2024-09-14T01:10:32.971337+0000 mgr.a (mgr.14355) 7337 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:34 smithi171 bash[25040]: cluster 2024-09-14T01:10:32.971337+0000 mgr.a (mgr.14355) 7337 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:36.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:36.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:36.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:36 smithi007 bash[22722]: cluster 2024-09-14T01:10:34.972123+0000 mgr.a (mgr.14355) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:36 smithi131 bash[24745]: cluster 2024-09-14T01:10:34.972123+0000 mgr.a (mgr.14355) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:36 smithi171 bash[25040]: cluster 2024-09-14T01:10:34.972123+0000 mgr.a (mgr.14355) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:10:36.819 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:37.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:37 smithi007 bash[22722]: audit 2024-09-14T01:10:36.380126+0000 mgr.a (mgr.14355) 7339 : audit [DBG] from='client.166083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:37 smithi131 bash[24745]: audit 2024-09-14T01:10:36.380126+0000 mgr.a (mgr.14355) 7339 : audit [DBG] from='client.166083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:37 smithi171 bash[25040]: audit 2024-09-14T01:10:36.380126+0000 mgr.a (mgr.14355) 7339 : audit [DBG] from='client.166083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:38 smithi007 bash[22722]: cluster 2024-09-14T01:10:36.975048+0000 mgr.a (mgr.14355) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:38 smithi131 bash[24745]: cluster 2024-09-14T01:10:36.975048+0000 mgr.a (mgr.14355) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:38 smithi171 bash[25040]: cluster 2024-09-14T01:10:36.975048+0000 mgr.a (mgr.14355) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:40 smithi007 bash[22722]: cluster 2024-09-14T01:10:38.975830+0000 mgr.a (mgr.14355) 7341 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:10:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:40 smithi131 bash[24745]: cluster 2024-09-14T01:10:38.975830+0000 mgr.a (mgr.14355) 7341 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:10:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:40 smithi171 bash[25040]: cluster 2024-09-14T01:10:38.975830+0000 mgr.a (mgr.14355) 7341 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:10:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:41.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:41.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:42.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:42 smithi007 bash[22722]: cluster 2024-09-14T01:10:40.977773+0000 mgr.a (mgr.14355) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:10:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:42 smithi131 bash[24745]: cluster 2024-09-14T01:10:40.977773+0000 mgr.a (mgr.14355) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:10:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:42 smithi171 bash[25040]: cluster 2024-09-14T01:10:40.977773+0000 mgr.a (mgr.14355) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:10:42.557 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:42.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:43 smithi007 bash[22722]: audit 2024-09-14T01:10:42.145319+0000 mgr.a (mgr.14355) 7343 : audit [DBG] from='client.166158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:43 smithi131 bash[24745]: audit 2024-09-14T01:10:42.145319+0000 mgr.a (mgr.14355) 7343 : audit [DBG] from='client.166158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:43 smithi171 bash[25040]: audit 2024-09-14T01:10:42.145319+0000 mgr.a (mgr.14355) 7343 : audit [DBG] from='client.166158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:44.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:44 smithi007 bash[22722]: cluster 2024-09-14T01:10:42.978725+0000 mgr.a (mgr.14355) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:44 smithi131 bash[24745]: cluster 2024-09-14T01:10:42.978725+0000 mgr.a (mgr.14355) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:44 smithi171 bash[25040]: cluster 2024-09-14T01:10:42.978725+0000 mgr.a (mgr.14355) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:46 smithi007 bash[22722]: cluster 2024-09-14T01:10:44.979495+0000 mgr.a (mgr.14355) 7345 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:46 smithi131 bash[24745]: cluster 2024-09-14T01:10:44.979495+0000 mgr.a (mgr.14355) 7345 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:46 smithi171 bash[25040]: cluster 2024-09-14T01:10:44.979495+0000 mgr.a (mgr.14355) 7345 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:47.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22722]: audit 2024-09-14T01:10:46.216876+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:10:47.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22722]: audit 2024-09-14T01:10:47.050869+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:10:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22722]: audit 2024-09-14T01:10:47.052663+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:10:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22722]: audit 2024-09-14T01:10:47.061505+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:10:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22722]: audit 2024-09-14T01:10:47.066356+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:47 smithi131 bash[24745]: audit 2024-09-14T01:10:46.216876+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:10:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:47 smithi131 bash[24745]: audit 2024-09-14T01:10:47.050869+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:10:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:47 smithi131 bash[24745]: audit 2024-09-14T01:10:47.052663+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:10:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:47 smithi131 bash[24745]: audit 2024-09-14T01:10:47.061505+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:10:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:47 smithi131 bash[24745]: audit 2024-09-14T01:10:47.066356+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:47 smithi171 bash[25040]: audit 2024-09-14T01:10:46.216876+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:47 smithi171 bash[25040]: audit 2024-09-14T01:10:47.050869+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:47 smithi171 bash[25040]: audit 2024-09-14T01:10:47.052663+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:47 smithi171 bash[25040]: audit 2024-09-14T01:10:47.061505+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:10:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:47 smithi171 bash[25040]: audit 2024-09-14T01:10:47.066356+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:47.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:47.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:48.151 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22972]: debug 2024-09-14T01:10:47.796+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:10:48.152 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:10:47 smithi007 bash[22972]: debug 2024-09-14T01:10:47.800+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:10:48.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:48.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:48.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:48.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:48.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:48 smithi007 bash[22722]: cluster 2024-09-14T01:10:46.981632+0000 mgr.a (mgr.14355) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:48 smithi007 bash[22722]: audit 2024-09-14T01:10:47.068687+0000 mgr.a (mgr.14355) 7347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:48 smithi131 bash[24745]: cluster 2024-09-14T01:10:46.981632+0000 mgr.a (mgr.14355) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:48 smithi131 bash[24745]: audit 2024-09-14T01:10:47.068687+0000 mgr.a (mgr.14355) 7347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:48 smithi171 bash[25040]: cluster 2024-09-14T01:10:46.981632+0000 mgr.a (mgr.14355) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:10:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:48 smithi171 bash[25040]: audit 2024-09-14T01:10:47.068687+0000 mgr.a (mgr.14355) 7347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:10:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:49 smithi007 bash[22722]: audit 2024-09-14T01:10:47.802047+0000 mgr.a (mgr.14355) 7348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:10:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:49 smithi007 bash[22722]: cephadm 2024-09-14T01:10:47.803234+0000 mgr.a (mgr.14355) 7349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:10:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:49 smithi007 bash[22722]: audit 2024-09-14T01:10:47.887555+0000 mgr.a (mgr.14355) 7350 : audit [DBG] from='client.166326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:49 smithi131 bash[24745]: audit 2024-09-14T01:10:47.802047+0000 mgr.a (mgr.14355) 7348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:10:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:49 smithi131 bash[24745]: cephadm 2024-09-14T01:10:47.803234+0000 mgr.a (mgr.14355) 7349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:10:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:49 smithi131 bash[24745]: audit 2024-09-14T01:10:47.887555+0000 mgr.a (mgr.14355) 7350 : audit [DBG] from='client.166326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:49 smithi171 bash[25040]: audit 2024-09-14T01:10:47.802047+0000 mgr.a (mgr.14355) 7348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:10:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:49 smithi171 bash[25040]: cephadm 2024-09-14T01:10:47.803234+0000 mgr.a (mgr.14355) 7349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:10:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:49 smithi171 bash[25040]: audit 2024-09-14T01:10:47.887555+0000 mgr.a (mgr.14355) 7350 : audit [DBG] from='client.166326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:50 smithi007 bash[22722]: cluster 2024-09-14T01:10:48.982695+0000 mgr.a (mgr.14355) 7351 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:50 smithi131 bash[24745]: cluster 2024-09-14T01:10:48.982695+0000 mgr.a (mgr.14355) 7351 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:50 smithi171 bash[25040]: cluster 2024-09-14T01:10:48.982695+0000 mgr.a (mgr.14355) 7351 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:10:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:52 smithi007 bash[22722]: cluster 2024-09-14T01:10:50.984840+0000 mgr.a (mgr.14355) 7352 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:52 smithi131 bash[24745]: cluster 2024-09-14T01:10:50.984840+0000 mgr.a (mgr.14355) 7352 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:52 smithi171 bash[25040]: cluster 2024-09-14T01:10:50.984840+0000 mgr.a (mgr.14355) 7352 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:53.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:53.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:54.046 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:54.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:54.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:54.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:54.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:10:54.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:54 smithi007 bash[22722]: cluster 2024-09-14T01:10:52.985627+0000 mgr.a (mgr.14355) 7353 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:54 smithi131 bash[24745]: cluster 2024-09-14T01:10:52.985627+0000 mgr.a (mgr.14355) 7353 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:54 smithi171 bash[25040]: cluster 2024-09-14T01:10:52.985627+0000 mgr.a (mgr.14355) 7353 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:55 smithi007 bash[22722]: audit 2024-09-14T01:10:53.631036+0000 mgr.a (mgr.14355) 7354 : audit [DBG] from='client.166419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:55 smithi131 bash[24745]: audit 2024-09-14T01:10:53.631036+0000 mgr.a (mgr.14355) 7354 : audit [DBG] from='client.166419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:55 smithi171 bash[25040]: audit 2024-09-14T01:10:53.631036+0000 mgr.a (mgr.14355) 7354 : audit [DBG] from='client.166419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:10:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:56 smithi007 bash[22722]: cluster 2024-09-14T01:10:54.986748+0000 mgr.a (mgr.14355) 7355 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:56 smithi131 bash[24745]: cluster 2024-09-14T01:10:54.986748+0000 mgr.a (mgr.14355) 7355 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:56 smithi171 bash[25040]: cluster 2024-09-14T01:10:54.986748+0000 mgr.a (mgr.14355) 7355 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:10:58 smithi007 bash[22722]: cluster 2024-09-14T01:10:56.989159+0000 mgr.a (mgr.14355) 7356 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:10:58 smithi131 bash[24745]: cluster 2024-09-14T01:10:56.989159+0000 mgr.a (mgr.14355) 7356 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:10:58 smithi171 bash[25040]: cluster 2024-09-14T01:10:56.989159+0000 mgr.a (mgr.14355) 7356 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:10:59.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:10:59.048 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:10:59.048 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:10:59.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:10:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:10:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:10:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:10:59.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:00 smithi007 bash[22722]: cluster 2024-09-14T01:10:58.990136+0000 mgr.a (mgr.14355) 7357 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:00 smithi007 bash[22722]: audit 2024-09-14T01:10:59.380728+0000 mgr.a (mgr.14355) 7358 : audit [DBG] from='client.166497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:00 smithi131 bash[24745]: cluster 2024-09-14T01:10:58.990136+0000 mgr.a (mgr.14355) 7357 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:00 smithi131 bash[24745]: audit 2024-09-14T01:10:59.380728+0000 mgr.a (mgr.14355) 7358 : audit [DBG] from='client.166497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:00 smithi171 bash[25040]: cluster 2024-09-14T01:10:58.990136+0000 mgr.a (mgr.14355) 7357 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:00 smithi171 bash[25040]: audit 2024-09-14T01:10:59.380728+0000 mgr.a (mgr.14355) 7358 : audit [DBG] from='client.166497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:02 smithi007 bash[22722]: cluster 2024-09-14T01:11:00.992530+0000 mgr.a (mgr.14355) 7359 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:02 smithi131 bash[24745]: cluster 2024-09-14T01:11:00.992530+0000 mgr.a (mgr.14355) 7359 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:02 smithi171 bash[25040]: cluster 2024-09-14T01:11:00.992530+0000 mgr.a (mgr.14355) 7359 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:04 smithi007 bash[22722]: cluster 2024-09-14T01:11:02.993310+0000 mgr.a (mgr.14355) 7360 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:04 smithi131 bash[24745]: cluster 2024-09-14T01:11:02.993310+0000 mgr.a (mgr.14355) 7360 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:04 smithi171 bash[25040]: cluster 2024-09-14T01:11:02.993310+0000 mgr.a (mgr.14355) 7360 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:04.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:04.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:04.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:05.540 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:06 smithi007 bash[22722]: cluster 2024-09-14T01:11:04.993935+0000 mgr.a (mgr.14355) 7361 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:06 smithi007 bash[22722]: audit 2024-09-14T01:11:05.126227+0000 mgr.a (mgr.14355) 7362 : audit [DBG] from='client.166575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:06 smithi131 bash[24745]: cluster 2024-09-14T01:11:04.993935+0000 mgr.a (mgr.14355) 7361 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:06 smithi131 bash[24745]: audit 2024-09-14T01:11:05.126227+0000 mgr.a (mgr.14355) 7362 : audit [DBG] from='client.166575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:06 smithi171 bash[25040]: cluster 2024-09-14T01:11:04.993935+0000 mgr.a (mgr.14355) 7361 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:06 smithi171 bash[25040]: audit 2024-09-14T01:11:05.126227+0000 mgr.a (mgr.14355) 7362 : audit [DBG] from='client.166575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:08 smithi131 bash[24745]: cluster 2024-09-14T01:11:06.996686+0000 mgr.a (mgr.14355) 7363 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:08 smithi171 bash[25040]: cluster 2024-09-14T01:11:06.996686+0000 mgr.a (mgr.14355) 7363 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:08 smithi007 bash[22722]: cluster 2024-09-14T01:11:06.996686+0000 mgr.a (mgr.14355) 7363 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:10 smithi131 bash[24745]: cluster 2024-09-14T01:11:08.997494+0000 mgr.a (mgr.14355) 7364 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:10.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:10.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:10.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:10 smithi171 bash[25040]: cluster 2024-09-14T01:11:08.997494+0000 mgr.a (mgr.14355) 7364 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:10 smithi007 bash[22722]: cluster 2024-09-14T01:11:08.997494+0000 mgr.a (mgr.14355) 7364 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:11.308 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:11.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:12 smithi131 bash[24745]: audit 2024-09-14T01:11:10.881335+0000 mgr.a (mgr.14355) 7365 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:12 smithi131 bash[24745]: cluster 2024-09-14T01:11:10.998989+0000 mgr.a (mgr.14355) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:12 smithi171 bash[25040]: audit 2024-09-14T01:11:10.881335+0000 mgr.a (mgr.14355) 7365 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:12 smithi171 bash[25040]: cluster 2024-09-14T01:11:10.998989+0000 mgr.a (mgr.14355) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:12 smithi007 bash[22722]: audit 2024-09-14T01:11:10.881335+0000 mgr.a (mgr.14355) 7365 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:12 smithi007 bash[22722]: cluster 2024-09-14T01:11:10.998989+0000 mgr.a (mgr.14355) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:14 smithi131 bash[24745]: cluster 2024-09-14T01:11:12.999855+0000 mgr.a (mgr.14355) 7367 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:14 smithi171 bash[25040]: cluster 2024-09-14T01:11:12.999855+0000 mgr.a (mgr.14355) 7367 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:14 smithi007 bash[22722]: cluster 2024-09-14T01:11:12.999855+0000 mgr.a (mgr.14355) 7367 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:16.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:16.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:16 smithi131 bash[24745]: cluster 2024-09-14T01:11:15.000657+0000 mgr.a (mgr.14355) 7368 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:11:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:16 smithi171 bash[25040]: cluster 2024-09-14T01:11:15.000657+0000 mgr.a (mgr.14355) 7368 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:11:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:16 smithi007 bash[22722]: cluster 2024-09-14T01:11:15.000657+0000 mgr.a (mgr.14355) 7368 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:11:17.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:17.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:17.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:17.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:17.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:18 smithi131 bash[24745]: audit 2024-09-14T01:11:16.647799+0000 mgr.a (mgr.14355) 7369 : audit [DBG] from='client.166731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:18 smithi131 bash[24745]: cluster 2024-09-14T01:11:17.002105+0000 mgr.a (mgr.14355) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:18 smithi171 bash[25040]: audit 2024-09-14T01:11:16.647799+0000 mgr.a (mgr.14355) 7369 : audit [DBG] from='client.166731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:18 smithi171 bash[25040]: cluster 2024-09-14T01:11:17.002105+0000 mgr.a (mgr.14355) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:18 smithi007 bash[22722]: audit 2024-09-14T01:11:16.647799+0000 mgr.a (mgr.14355) 7369 : audit [DBG] from='client.166731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:18 smithi007 bash[22722]: cluster 2024-09-14T01:11:17.002105+0000 mgr.a (mgr.14355) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:20 smithi131 bash[24745]: cluster 2024-09-14T01:11:19.002889+0000 mgr.a (mgr.14355) 7371 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:20 smithi171 bash[25040]: cluster 2024-09-14T01:11:19.002889+0000 mgr.a (mgr.14355) 7371 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:20 smithi007 bash[22722]: cluster 2024-09-14T01:11:19.002889+0000 mgr.a (mgr.14355) 7371 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:22.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:22 smithi131 bash[24745]: cluster 2024-09-14T01:11:21.004941+0000 mgr.a (mgr.14355) 7372 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:22 smithi171 bash[25040]: cluster 2024-09-14T01:11:21.004941+0000 mgr.a (mgr.14355) 7372 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:22 smithi007 bash[22722]: cluster 2024-09-14T01:11:21.004941+0000 mgr.a (mgr.14355) 7372 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:22.871 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:22.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:22.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:22.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:22.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:24 smithi131 bash[24745]: audit 2024-09-14T01:11:22.427460+0000 mgr.a (mgr.14355) 7373 : audit [DBG] from='client.166806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:24 smithi131 bash[24745]: cluster 2024-09-14T01:11:23.005917+0000 mgr.a (mgr.14355) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:24 smithi171 bash[25040]: audit 2024-09-14T01:11:22.427460+0000 mgr.a (mgr.14355) 7373 : audit [DBG] from='client.166806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:24 smithi171 bash[25040]: cluster 2024-09-14T01:11:23.005917+0000 mgr.a (mgr.14355) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:24 smithi007 bash[22722]: audit 2024-09-14T01:11:22.427460+0000 mgr.a (mgr.14355) 7373 : audit [DBG] from='client.166806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:24 smithi007 bash[22722]: cluster 2024-09-14T01:11:23.005917+0000 mgr.a (mgr.14355) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:26 smithi131 bash[24745]: cluster 2024-09-14T01:11:25.006730+0000 mgr.a (mgr.14355) 7375 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:26 smithi171 bash[25040]: cluster 2024-09-14T01:11:25.006730+0000 mgr.a (mgr.14355) 7375 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:26 smithi007 bash[22722]: cluster 2024-09-14T01:11:25.006730+0000 mgr.a (mgr.14355) 7375 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:27.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:27.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:27.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:28 smithi131 bash[24745]: cluster 2024-09-14T01:11:27.008974+0000 mgr.a (mgr.14355) 7376 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:28 smithi171 bash[25040]: cluster 2024-09-14T01:11:27.008974+0000 mgr.a (mgr.14355) 7376 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:28.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:28.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:28 smithi007 bash[22722]: cluster 2024-09-14T01:11:27.008974+0000 mgr.a (mgr.14355) 7376 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:29 smithi131 bash[24745]: audit 2024-09-14T01:11:28.205576+0000 mgr.a (mgr.14355) 7377 : audit [DBG] from='client.166884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:29 smithi171 bash[25040]: audit 2024-09-14T01:11:28.205576+0000 mgr.a (mgr.14355) 7377 : audit [DBG] from='client.166884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:29 smithi007 bash[22722]: audit 2024-09-14T01:11:28.205576+0000 mgr.a (mgr.14355) 7377 : audit [DBG] from='client.166884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:30 smithi131 bash[24745]: cluster 2024-09-14T01:11:29.010114+0000 mgr.a (mgr.14355) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:30 smithi171 bash[25040]: cluster 2024-09-14T01:11:29.010114+0000 mgr.a (mgr.14355) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:30 smithi007 bash[22722]: cluster 2024-09-14T01:11:29.010114+0000 mgr.a (mgr.14355) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:32 smithi131 bash[24745]: cluster 2024-09-14T01:11:31.012537+0000 mgr.a (mgr.14355) 7379 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:32 smithi171 bash[25040]: cluster 2024-09-14T01:11:31.012537+0000 mgr.a (mgr.14355) 7379 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:32 smithi007 bash[22722]: cluster 2024-09-14T01:11:31.012537+0000 mgr.a (mgr.14355) 7379 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:33.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:33.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:34.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:34 smithi131 bash[24745]: cluster 2024-09-14T01:11:33.013489+0000 mgr.a (mgr.14355) 7380 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:34 smithi171 bash[25040]: cluster 2024-09-14T01:11:33.013489+0000 mgr.a (mgr.14355) 7380 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:34.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:34 smithi007 bash[22722]: cluster 2024-09-14T01:11:33.013489+0000 mgr.a (mgr.14355) 7380 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:35 smithi131 bash[24745]: audit 2024-09-14T01:11:33.979182+0000 mgr.a (mgr.14355) 7381 : audit [DBG] from='client.166962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:35 smithi171 bash[25040]: audit 2024-09-14T01:11:33.979182+0000 mgr.a (mgr.14355) 7381 : audit [DBG] from='client.166962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:35 smithi007 bash[22722]: audit 2024-09-14T01:11:33.979182+0000 mgr.a (mgr.14355) 7381 : audit [DBG] from='client.166962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:36 smithi131 bash[24745]: cluster 2024-09-14T01:11:35.014505+0000 mgr.a (mgr.14355) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:36 smithi171 bash[25040]: cluster 2024-09-14T01:11:35.014505+0000 mgr.a (mgr.14355) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:36 smithi007 bash[22722]: cluster 2024-09-14T01:11:35.014505+0000 mgr.a (mgr.14355) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:38 smithi171 bash[25040]: cluster 2024-09-14T01:11:37.016694+0000 mgr.a (mgr.14355) 7383 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:38 smithi007 bash[22722]: cluster 2024-09-14T01:11:37.016694+0000 mgr.a (mgr.14355) 7383 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:38 smithi131 bash[24745]: cluster 2024-09-14T01:11:37.016694+0000 mgr.a (mgr.14355) 7383 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:40.139 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:40 smithi171 bash[25040]: cluster 2024-09-14T01:11:39.017471+0000 mgr.a (mgr.14355) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:40 smithi007 bash[22722]: cluster 2024-09-14T01:11:39.017471+0000 mgr.a (mgr.14355) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:40 smithi131 bash[24745]: cluster 2024-09-14T01:11:39.017471+0000 mgr.a (mgr.14355) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:41 smithi007 bash[22722]: audit 2024-09-14T01:11:39.721022+0000 mgr.a (mgr.14355) 7385 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:41 smithi131 bash[24745]: audit 2024-09-14T01:11:39.721022+0000 mgr.a (mgr.14355) 7385 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:41 smithi171 bash[25040]: audit 2024-09-14T01:11:39.721022+0000 mgr.a (mgr.14355) 7385 : audit [DBG] from='client.167040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:42 smithi007 bash[22722]: cluster 2024-09-14T01:11:41.019880+0000 mgr.a (mgr.14355) 7386 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:42 smithi131 bash[24745]: cluster 2024-09-14T01:11:41.019880+0000 mgr.a (mgr.14355) 7386 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:42 smithi171 bash[25040]: cluster 2024-09-14T01:11:41.019880+0000 mgr.a (mgr.14355) 7386 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:11:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:44 smithi007 bash[22722]: cluster 2024-09-14T01:11:43.020680+0000 mgr.a (mgr.14355) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:44 smithi131 bash[24745]: cluster 2024-09-14T01:11:43.020680+0000 mgr.a (mgr.14355) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:44 smithi171 bash[25040]: cluster 2024-09-14T01:11:43.020680+0000 mgr.a (mgr.14355) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:45.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:45.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:45.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:45.887 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:46 smithi007 bash[22722]: cluster 2024-09-14T01:11:45.021470+0000 mgr.a (mgr.14355) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:46 smithi131 bash[24745]: cluster 2024-09-14T01:11:45.021470+0000 mgr.a (mgr.14355) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:46.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:46 smithi171 bash[25040]: cluster 2024-09-14T01:11:45.021470+0000 mgr.a (mgr.14355) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:47 smithi007 bash[22722]: audit 2024-09-14T01:11:45.469277+0000 mgr.a (mgr.14355) 7389 : audit [DBG] from='client.167115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:47 smithi131 bash[24745]: audit 2024-09-14T01:11:45.469277+0000 mgr.a (mgr.14355) 7389 : audit [DBG] from='client.167115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:47 smithi171 bash[25040]: audit 2024-09-14T01:11:45.469277+0000 mgr.a (mgr.14355) 7389 : audit [DBG] from='client.167115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:48 smithi007 bash[22722]: cluster 2024-09-14T01:11:47.024232+0000 mgr.a (mgr.14355) 7390 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:48 smithi007 bash[22722]: audit 2024-09-14T01:11:47.854553+0000 mon.a (mon.0) 1703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:11:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:48 smithi131 bash[24745]: cluster 2024-09-14T01:11:47.024232+0000 mgr.a (mgr.14355) 7390 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:48 smithi131 bash[24745]: audit 2024-09-14T01:11:47.854553+0000 mon.a (mon.0) 1703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:11:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:48 smithi171 bash[25040]: cluster 2024-09-14T01:11:47.024232+0000 mgr.a (mgr.14355) 7390 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:11:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:48 smithi171 bash[25040]: audit 2024-09-14T01:11:47.854553+0000 mon.a (mon.0) 1703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:11:49.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22972]: debug 2024-09-14T01:11:49.447+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:11:49.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22972]: debug 2024-09-14T01:11:49.447+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:11:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22722]: audit 2024-09-14T01:11:48.699203+0000 mon.a (mon.0) 1704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:11:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22722]: audit 2024-09-14T01:11:48.701023+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:11:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22722]: audit 2024-09-14T01:11:48.711611+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:11:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:49 smithi007 bash[22722]: audit 2024-09-14T01:11:48.716643+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:49 smithi131 bash[24745]: audit 2024-09-14T01:11:48.699203+0000 mon.a (mon.0) 1704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:11:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:49 smithi131 bash[24745]: audit 2024-09-14T01:11:48.701023+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:11:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:49 smithi131 bash[24745]: audit 2024-09-14T01:11:48.711611+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:11:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:49 smithi131 bash[24745]: audit 2024-09-14T01:11:48.716643+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:49 smithi171 bash[25040]: audit 2024-09-14T01:11:48.699203+0000 mon.a (mon.0) 1704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:11:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:49 smithi171 bash[25040]: audit 2024-09-14T01:11:48.701023+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:11:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:49 smithi171 bash[25040]: audit 2024-09-14T01:11:48.711611+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:11:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:49 smithi171 bash[25040]: audit 2024-09-14T01:11:48.716643+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:50 smithi007 bash[22722]: audit 2024-09-14T01:11:48.719041+0000 mgr.a (mgr.14355) 7391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:50 smithi007 bash[22722]: cluster 2024-09-14T01:11:49.024768+0000 mgr.a (mgr.14355) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:50 smithi131 bash[24745]: audit 2024-09-14T01:11:48.719041+0000 mgr.a (mgr.14355) 7391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:50 smithi131 bash[24745]: cluster 2024-09-14T01:11:49.024768+0000 mgr.a (mgr.14355) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:50 smithi171 bash[25040]: audit 2024-09-14T01:11:48.719041+0000 mgr.a (mgr.14355) 7391 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:11:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:50 smithi171 bash[25040]: cluster 2024-09-14T01:11:49.024768+0000 mgr.a (mgr.14355) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:11:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:50.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:51.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:51.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:51.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:51.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:51.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:51 smithi007 bash[22722]: audit 2024-09-14T01:11:49.450689+0000 mgr.a (mgr.14355) 7393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:11:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:51 smithi007 bash[22722]: cephadm 2024-09-14T01:11:49.451881+0000 mgr.a (mgr.14355) 7394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:11:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:51 smithi131 bash[24745]: audit 2024-09-14T01:11:49.450689+0000 mgr.a (mgr.14355) 7393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:11:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:51 smithi131 bash[24745]: cephadm 2024-09-14T01:11:49.451881+0000 mgr.a (mgr.14355) 7394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:11:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:51 smithi171 bash[25040]: audit 2024-09-14T01:11:49.450689+0000 mgr.a (mgr.14355) 7393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:11:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:51 smithi171 bash[25040]: cephadm 2024-09-14T01:11:49.451881+0000 mgr.a (mgr.14355) 7394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:11:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:52 smithi007 bash[22722]: cluster 2024-09-14T01:11:51.026547+0000 mgr.a (mgr.14355) 7395 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:52 smithi007 bash[22722]: audit 2024-09-14T01:11:51.227828+0000 mgr.a (mgr.14355) 7396 : audit [DBG] from='client.167301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:52 smithi131 bash[24745]: cluster 2024-09-14T01:11:51.026547+0000 mgr.a (mgr.14355) 7395 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:52 smithi131 bash[24745]: audit 2024-09-14T01:11:51.227828+0000 mgr.a (mgr.14355) 7396 : audit [DBG] from='client.167301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:52 smithi171 bash[25040]: cluster 2024-09-14T01:11:51.026547+0000 mgr.a (mgr.14355) 7395 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:52 smithi171 bash[25040]: audit 2024-09-14T01:11:51.227828+0000 mgr.a (mgr.14355) 7396 : audit [DBG] from='client.167301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:54 smithi007 bash[22722]: cluster 2024-09-14T01:11:53.027434+0000 mgr.a (mgr.14355) 7397 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:54 smithi131 bash[24745]: cluster 2024-09-14T01:11:53.027434+0000 mgr.a (mgr.14355) 7397 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:54 smithi171 bash[25040]: cluster 2024-09-14T01:11:53.027434+0000 mgr.a (mgr.14355) 7397 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:56.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:11:56.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:11:56.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:11:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:56 smithi007 bash[22722]: cluster 2024-09-14T01:11:55.028227+0000 mgr.a (mgr.14355) 7398 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:56 smithi131 bash[24745]: cluster 2024-09-14T01:11:55.028227+0000 mgr.a (mgr.14355) 7398 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:56 smithi171 bash[25040]: cluster 2024-09-14T01:11:55.028227+0000 mgr.a (mgr.14355) 7398 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:11:57.432 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:11:57.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:11:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:58 smithi007 bash[22722]: audit 2024-09-14T01:11:56.984683+0000 mgr.a (mgr.14355) 7399 : audit [DBG] from='client.167379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:11:58 smithi007 bash[22722]: cluster 2024-09-14T01:11:57.031075+0000 mgr.a (mgr.14355) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:58 smithi131 bash[24745]: audit 2024-09-14T01:11:56.984683+0000 mgr.a (mgr.14355) 7399 : audit [DBG] from='client.167379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:11:58 smithi131 bash[24745]: cluster 2024-09-14T01:11:57.031075+0000 mgr.a (mgr.14355) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:11:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:58 smithi171 bash[25040]: audit 2024-09-14T01:11:56.984683+0000 mgr.a (mgr.14355) 7399 : audit [DBG] from='client.167379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:11:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:11:58 smithi171 bash[25040]: cluster 2024-09-14T01:11:57.031075+0000 mgr.a (mgr.14355) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:00 smithi007 bash[22722]: cluster 2024-09-14T01:11:59.032029+0000 mgr.a (mgr.14355) 7401 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:00 smithi131 bash[24745]: cluster 2024-09-14T01:11:59.032029+0000 mgr.a (mgr.14355) 7401 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:00 smithi171 bash[25040]: cluster 2024-09-14T01:11:59.032029+0000 mgr.a (mgr.14355) 7401 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:02.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:02.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:02.435 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:02 smithi007 bash[22722]: cluster 2024-09-14T01:12:01.034437+0000 mgr.a (mgr.14355) 7402 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:12:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:02 smithi131 bash[24745]: cluster 2024-09-14T01:12:01.034437+0000 mgr.a (mgr.14355) 7402 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:12:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:02 smithi171 bash[25040]: cluster 2024-09-14T01:12:01.034437+0000 mgr.a (mgr.14355) 7402 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:12:03.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:03.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:04 smithi007 bash[22722]: audit 2024-09-14T01:12:02.770552+0000 mgr.a (mgr.14355) 7403 : audit [DBG] from='client.167454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:04 smithi007 bash[22722]: cluster 2024-09-14T01:12:03.035457+0000 mgr.a (mgr.14355) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:04 smithi131 bash[24745]: audit 2024-09-14T01:12:02.770552+0000 mgr.a (mgr.14355) 7403 : audit [DBG] from='client.167454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:04 smithi131 bash[24745]: cluster 2024-09-14T01:12:03.035457+0000 mgr.a (mgr.14355) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:04 smithi171 bash[25040]: audit 2024-09-14T01:12:02.770552+0000 mgr.a (mgr.14355) 7403 : audit [DBG] from='client.167454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:04 smithi171 bash[25040]: cluster 2024-09-14T01:12:03.035457+0000 mgr.a (mgr.14355) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:06 smithi007 bash[22722]: cluster 2024-09-14T01:12:05.036382+0000 mgr.a (mgr.14355) 7405 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:06.953 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:06 smithi171 bash[25040]: cluster 2024-09-14T01:12:05.036382+0000 mgr.a (mgr.14355) 7405 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:06.953 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:06 smithi131 bash[24745]: cluster 2024-09-14T01:12:05.036382+0000 mgr.a (mgr.14355) 7405 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:08.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:08.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:08 smithi007 bash[22722]: cluster 2024-09-14T01:12:07.038692+0000 mgr.a (mgr.14355) 7406 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:12:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:08 smithi131 bash[24745]: cluster 2024-09-14T01:12:07.038692+0000 mgr.a (mgr.14355) 7406 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:12:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:08 smithi171 bash[25040]: cluster 2024-09-14T01:12:07.038692+0000 mgr.a (mgr.14355) 7406 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:12:08.982 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:10 smithi007 bash[22722]: audit 2024-09-14T01:12:08.548750+0000 mgr.a (mgr.14355) 7407 : audit [DBG] from='client.167529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:10 smithi007 bash[22722]: cluster 2024-09-14T01:12:09.039664+0000 mgr.a (mgr.14355) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:10 smithi131 bash[24745]: audit 2024-09-14T01:12:08.548750+0000 mgr.a (mgr.14355) 7407 : audit [DBG] from='client.167529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:10 smithi131 bash[24745]: cluster 2024-09-14T01:12:09.039664+0000 mgr.a (mgr.14355) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:10 smithi171 bash[25040]: audit 2024-09-14T01:12:08.548750+0000 mgr.a (mgr.14355) 7407 : audit [DBG] from='client.167529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:10 smithi171 bash[25040]: cluster 2024-09-14T01:12:09.039664+0000 mgr.a (mgr.14355) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:12:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:12 smithi007 bash[22722]: cluster 2024-09-14T01:12:11.042065+0000 mgr.a (mgr.14355) 7409 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:12:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:12 smithi131 bash[24745]: cluster 2024-09-14T01:12:11.042065+0000 mgr.a (mgr.14355) 7409 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:12:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:12 smithi171 bash[25040]: cluster 2024-09-14T01:12:11.042065+0000 mgr.a (mgr.14355) 7409 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:12:13.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:13.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:13.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:14 smithi007 bash[22722]: cluster 2024-09-14T01:12:13.042902+0000 mgr.a (mgr.14355) 7410 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:14.735 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:14.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:14.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:14 smithi131 bash[24745]: cluster 2024-09-14T01:12:13.042902+0000 mgr.a (mgr.14355) 7410 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:14 smithi171 bash[25040]: cluster 2024-09-14T01:12:13.042902+0000 mgr.a (mgr.14355) 7410 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:15 smithi007 bash[22722]: audit 2024-09-14T01:12:14.312720+0000 mgr.a (mgr.14355) 7411 : audit [DBG] from='client.167607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:15 smithi131 bash[24745]: audit 2024-09-14T01:12:14.312720+0000 mgr.a (mgr.14355) 7411 : audit [DBG] from='client.167607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:15 smithi171 bash[25040]: audit 2024-09-14T01:12:14.312720+0000 mgr.a (mgr.14355) 7411 : audit [DBG] from='client.167607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:16 smithi007 bash[22722]: cluster 2024-09-14T01:12:15.043855+0000 mgr.a (mgr.14355) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:16 smithi131 bash[24745]: cluster 2024-09-14T01:12:15.043855+0000 mgr.a (mgr.14355) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:16 smithi171 bash[25040]: cluster 2024-09-14T01:12:15.043855+0000 mgr.a (mgr.14355) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:18 smithi007 bash[22722]: cluster 2024-09-14T01:12:17.046144+0000 mgr.a (mgr.14355) 7413 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:12:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:18 smithi131 bash[24745]: cluster 2024-09-14T01:12:17.046144+0000 mgr.a (mgr.14355) 7413 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:12:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:18 smithi171 bash[25040]: cluster 2024-09-14T01:12:17.046144+0000 mgr.a (mgr.14355) 7413 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:12:19.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:19.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:19.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:20.485 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:20.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:20 smithi007 bash[22722]: cluster 2024-09-14T01:12:19.046931+0000 mgr.a (mgr.14355) 7414 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:20 smithi131 bash[24745]: cluster 2024-09-14T01:12:19.046931+0000 mgr.a (mgr.14355) 7414 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:20 smithi171 bash[25040]: cluster 2024-09-14T01:12:19.046931+0000 mgr.a (mgr.14355) 7414 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:21.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:21 smithi007 bash[22722]: audit 2024-09-14T01:12:20.066179+0000 mgr.a (mgr.14355) 7415 : audit [DBG] from='client.167679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:21 smithi131 bash[24745]: audit 2024-09-14T01:12:20.066179+0000 mgr.a (mgr.14355) 7415 : audit [DBG] from='client.167679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:21 smithi171 bash[25040]: audit 2024-09-14T01:12:20.066179+0000 mgr.a (mgr.14355) 7415 : audit [DBG] from='client.167679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:22 smithi007 bash[22722]: cluster 2024-09-14T01:12:21.049646+0000 mgr.a (mgr.14355) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:22 smithi131 bash[24745]: cluster 2024-09-14T01:12:21.049646+0000 mgr.a (mgr.14355) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:22 smithi171 bash[25040]: cluster 2024-09-14T01:12:21.049646+0000 mgr.a (mgr.14355) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:12:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:23 smithi131 bash[24745]: cluster 2024-09-14T01:12:23.050463+0000 mgr.a (mgr.14355) 7417 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:23 smithi171 bash[25040]: cluster 2024-09-14T01:12:23.050463+0000 mgr.a (mgr.14355) 7417 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:23 smithi007 bash[22722]: cluster 2024-09-14T01:12:23.050463+0000 mgr.a (mgr.14355) 7417 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:25.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:25.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:26.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:26.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:26.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:26 smithi007 bash[22722]: cluster 2024-09-14T01:12:25.051210+0000 mgr.a (mgr.14355) 7418 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:12:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:26 smithi131 bash[24745]: cluster 2024-09-14T01:12:25.051210+0000 mgr.a (mgr.14355) 7418 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:12:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:26 smithi171 bash[25040]: cluster 2024-09-14T01:12:25.051210+0000 mgr.a (mgr.14355) 7418 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:12:27.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:27 smithi007 bash[22722]: audit 2024-09-14T01:12:25.816978+0000 mgr.a (mgr.14355) 7419 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:27 smithi131 bash[24745]: audit 2024-09-14T01:12:25.816978+0000 mgr.a (mgr.14355) 7419 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:27.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:27 smithi171 bash[25040]: audit 2024-09-14T01:12:25.816978+0000 mgr.a (mgr.14355) 7419 : audit [DBG] from='client.167754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:28.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:28 smithi007 bash[22722]: cluster 2024-09-14T01:12:27.053889+0000 mgr.a (mgr.14355) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:28 smithi131 bash[24745]: cluster 2024-09-14T01:12:27.053889+0000 mgr.a (mgr.14355) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:28 smithi171 bash[25040]: cluster 2024-09-14T01:12:27.053889+0000 mgr.a (mgr.14355) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:30 smithi007 bash[22722]: cluster 2024-09-14T01:12:29.054686+0000 mgr.a (mgr.14355) 7421 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:30 smithi131 bash[24745]: cluster 2024-09-14T01:12:29.054686+0000 mgr.a (mgr.14355) 7421 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:30 smithi171 bash[25040]: cluster 2024-09-14T01:12:29.054686+0000 mgr.a (mgr.14355) 7421 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:12:31.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:31.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:31.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:31.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:32 smithi007 bash[22722]: cluster 2024-09-14T01:12:31.056635+0000 mgr.a (mgr.14355) 7422 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:32 smithi131 bash[24745]: cluster 2024-09-14T01:12:31.056635+0000 mgr.a (mgr.14355) 7422 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:32 smithi171 bash[25040]: cluster 2024-09-14T01:12:31.056635+0000 mgr.a (mgr.14355) 7422 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:33 smithi007 bash[22722]: audit 2024-09-14T01:12:31.567693+0000 mgr.a (mgr.14355) 7423 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:33 smithi131 bash[24745]: audit 2024-09-14T01:12:31.567693+0000 mgr.a (mgr.14355) 7423 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:33 smithi171 bash[25040]: audit 2024-09-14T01:12:31.567693+0000 mgr.a (mgr.14355) 7423 : audit [DBG] from='client.167832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:34.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:34 smithi007 bash[22722]: cluster 2024-09-14T01:12:33.057677+0000 mgr.a (mgr.14355) 7424 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:34 smithi131 bash[24745]: cluster 2024-09-14T01:12:33.057677+0000 mgr.a (mgr.14355) 7424 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:34 smithi171 bash[25040]: cluster 2024-09-14T01:12:33.057677+0000 mgr.a (mgr.14355) 7424 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:36 smithi007 bash[22722]: cluster 2024-09-14T01:12:35.058675+0000 mgr.a (mgr.14355) 7425 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:36 smithi131 bash[24745]: cluster 2024-09-14T01:12:35.058675+0000 mgr.a (mgr.14355) 7425 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:36 smithi171 bash[25040]: cluster 2024-09-14T01:12:35.058675+0000 mgr.a (mgr.14355) 7425 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:37.763 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:38 smithi007 bash[22722]: cluster 2024-09-14T01:12:37.060682+0000 mgr.a (mgr.14355) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:38 smithi007 bash[22722]: audit 2024-09-14T01:12:37.332804+0000 mgr.a (mgr.14355) 7427 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:38 smithi131 bash[24745]: cluster 2024-09-14T01:12:37.060682+0000 mgr.a (mgr.14355) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:38 smithi131 bash[24745]: audit 2024-09-14T01:12:37.332804+0000 mgr.a (mgr.14355) 7427 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:38 smithi171 bash[25040]: cluster 2024-09-14T01:12:37.060682+0000 mgr.a (mgr.14355) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:38 smithi171 bash[25040]: audit 2024-09-14T01:12:37.332804+0000 mgr.a (mgr.14355) 7427 : audit [DBG] from='client.167904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:40 smithi007 bash[22722]: cluster 2024-09-14T01:12:39.061584+0000 mgr.a (mgr.14355) 7428 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:40 smithi131 bash[24745]: cluster 2024-09-14T01:12:39.061584+0000 mgr.a (mgr.14355) 7428 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:40 smithi171 bash[25040]: cluster 2024-09-14T01:12:39.061584+0000 mgr.a (mgr.14355) 7428 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:42 smithi007 bash[22722]: cluster 2024-09-14T01:12:41.063786+0000 mgr.a (mgr.14355) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:42 smithi131 bash[24745]: cluster 2024-09-14T01:12:41.063786+0000 mgr.a (mgr.14355) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:42 smithi171 bash[25040]: cluster 2024-09-14T01:12:41.063786+0000 mgr.a (mgr.14355) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:42.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:42.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:43.524 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:43.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:44 smithi007 bash[22722]: cluster 2024-09-14T01:12:43.064512+0000 mgr.a (mgr.14355) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:44 smithi007 bash[22722]: audit 2024-09-14T01:12:43.095813+0000 mgr.a (mgr.14355) 7431 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:44 smithi131 bash[24745]: cluster 2024-09-14T01:12:43.064512+0000 mgr.a (mgr.14355) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:44 smithi131 bash[24745]: audit 2024-09-14T01:12:43.095813+0000 mgr.a (mgr.14355) 7431 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:44 smithi171 bash[25040]: cluster 2024-09-14T01:12:43.064512+0000 mgr.a (mgr.14355) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:44 smithi171 bash[25040]: audit 2024-09-14T01:12:43.095813+0000 mgr.a (mgr.14355) 7431 : audit [DBG] from='client.167982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:46 smithi007 bash[22722]: cluster 2024-09-14T01:12:45.065398+0000 mgr.a (mgr.14355) 7432 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:46 smithi131 bash[24745]: cluster 2024-09-14T01:12:45.065398+0000 mgr.a (mgr.14355) 7432 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:46 smithi171 bash[25040]: cluster 2024-09-14T01:12:45.065398+0000 mgr.a (mgr.14355) 7432 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:48 smithi007 bash[22722]: cluster 2024-09-14T01:12:47.067712+0000 mgr.a (mgr.14355) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:48.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:48.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:48.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:48 smithi131 bash[24745]: cluster 2024-09-14T01:12:47.067712+0000 mgr.a (mgr.14355) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:48 smithi171 bash[25040]: cluster 2024-09-14T01:12:47.067712+0000 mgr.a (mgr.14355) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:49.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:49.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:49.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:49.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:50.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:50 smithi007 bash[22722]: audit 2024-09-14T01:12:48.854547+0000 mgr.a (mgr.14355) 7434 : audit [DBG] from='client.168057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:50 smithi007 bash[22722]: cluster 2024-09-14T01:12:49.068199+0000 mgr.a (mgr.14355) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:50 smithi007 bash[22722]: audit 2024-09-14T01:12:49.501978+0000 mon.a (mon.0) 1708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:12:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:50 smithi131 bash[24745]: audit 2024-09-14T01:12:48.854547+0000 mgr.a (mgr.14355) 7434 : audit [DBG] from='client.168057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:50 smithi131 bash[24745]: cluster 2024-09-14T01:12:49.068199+0000 mgr.a (mgr.14355) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:50 smithi131 bash[24745]: audit 2024-09-14T01:12:49.501978+0000 mon.a (mon.0) 1708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:12:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:50 smithi171 bash[25040]: audit 2024-09-14T01:12:48.854547+0000 mgr.a (mgr.14355) 7434 : audit [DBG] from='client.168057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:50 smithi171 bash[25040]: cluster 2024-09-14T01:12:49.068199+0000 mgr.a (mgr.14355) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:50 smithi171 bash[25040]: audit 2024-09-14T01:12:49.501978+0000 mon.a (mon.0) 1708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:12:51.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22972]: debug 2024-09-14T01:12:51.090+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:12:51.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22972]: debug 2024-09-14T01:12:51.094+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22722]: audit 2024-09-14T01:12:50.342005+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22722]: audit 2024-09-14T01:12:50.343430+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22722]: audit 2024-09-14T01:12:50.352452+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:12:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22722]: audit 2024-09-14T01:12:50.357440+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:51 smithi007 bash[22722]: audit 2024-09-14T01:12:50.360127+0000 mgr.a (mgr.14355) 7436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:51 smithi131 bash[24745]: audit 2024-09-14T01:12:50.342005+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:12:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:51 smithi131 bash[24745]: audit 2024-09-14T01:12:50.343430+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:12:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:51 smithi131 bash[24745]: audit 2024-09-14T01:12:50.352452+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:12:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:51 smithi131 bash[24745]: audit 2024-09-14T01:12:50.357440+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:51 smithi131 bash[24745]: audit 2024-09-14T01:12:50.360127+0000 mgr.a (mgr.14355) 7436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:51 smithi171 bash[25040]: audit 2024-09-14T01:12:50.342005+0000 mon.a (mon.0) 1709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:12:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:51 smithi171 bash[25040]: audit 2024-09-14T01:12:50.343430+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:12:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:51 smithi171 bash[25040]: audit 2024-09-14T01:12:50.352452+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:12:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:51 smithi171 bash[25040]: audit 2024-09-14T01:12:50.357440+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:51 smithi171 bash[25040]: audit 2024-09-14T01:12:50.360127+0000 mgr.a (mgr.14355) 7436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:12:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:52 smithi007 bash[22722]: cluster 2024-09-14T01:12:51.069959+0000 mgr.a (mgr.14355) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:52 smithi007 bash[22722]: audit 2024-09-14T01:12:51.094039+0000 mgr.a (mgr.14355) 7438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:12:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:52 smithi007 bash[22722]: cephadm 2024-09-14T01:12:51.095227+0000 mgr.a (mgr.14355) 7439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:12:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:52 smithi131 bash[24745]: cluster 2024-09-14T01:12:51.069959+0000 mgr.a (mgr.14355) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:52 smithi131 bash[24745]: audit 2024-09-14T01:12:51.094039+0000 mgr.a (mgr.14355) 7438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:12:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:52 smithi131 bash[24745]: cephadm 2024-09-14T01:12:51.095227+0000 mgr.a (mgr.14355) 7439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:12:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:52 smithi171 bash[25040]: cluster 2024-09-14T01:12:51.069959+0000 mgr.a (mgr.14355) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:12:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:52 smithi171 bash[25040]: audit 2024-09-14T01:12:51.094039+0000 mgr.a (mgr.14355) 7438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:12:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:52 smithi171 bash[25040]: cephadm 2024-09-14T01:12:51.095227+0000 mgr.a (mgr.14355) 7439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:12:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:12:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:12:54.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:12:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:54 smithi007 bash[22722]: cluster 2024-09-14T01:12:53.070728+0000 mgr.a (mgr.14355) 7440 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:54 smithi131 bash[24745]: cluster 2024-09-14T01:12:53.070728+0000 mgr.a (mgr.14355) 7440 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:54 smithi171 bash[25040]: cluster 2024-09-14T01:12:53.070728+0000 mgr.a (mgr.14355) 7440 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:55.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:12:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:12:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:12:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:12:55.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:12:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:56 smithi007 bash[22722]: audit 2024-09-14T01:12:54.604673+0000 mgr.a (mgr.14355) 7441 : audit [DBG] from='client.168240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:56 smithi007 bash[22722]: cluster 2024-09-14T01:12:55.071254+0000 mgr.a (mgr.14355) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:56 smithi131 bash[24745]: audit 2024-09-14T01:12:54.604673+0000 mgr.a (mgr.14355) 7441 : audit [DBG] from='client.168240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:56 smithi131 bash[24745]: cluster 2024-09-14T01:12:55.071254+0000 mgr.a (mgr.14355) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:56 smithi171 bash[25040]: audit 2024-09-14T01:12:54.604673+0000 mgr.a (mgr.14355) 7441 : audit [DBG] from='client.168240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:12:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:56 smithi171 bash[25040]: cluster 2024-09-14T01:12:55.071254+0000 mgr.a (mgr.14355) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:12:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:12:58 smithi007 bash[22722]: cluster 2024-09-14T01:12:57.073457+0000 mgr.a (mgr.14355) 7443 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:12:58 smithi131 bash[24745]: cluster 2024-09-14T01:12:57.073457+0000 mgr.a (mgr.14355) 7443 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:12:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:12:58 smithi171 bash[25040]: cluster 2024-09-14T01:12:57.073457+0000 mgr.a (mgr.14355) 7443 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:00.035 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:00.035 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:00 smithi007 bash[22722]: cluster 2024-09-14T01:12:59.074219+0000 mgr.a (mgr.14355) 7444 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:00.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:00.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:00.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:00.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:00.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:00 smithi131 bash[24745]: cluster 2024-09-14T01:12:59.074219+0000 mgr.a (mgr.14355) 7444 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:00 smithi171 bash[25040]: cluster 2024-09-14T01:12:59.074219+0000 mgr.a (mgr.14355) 7444 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:01 smithi007 bash[22722]: audit 2024-09-14T01:13:00.370258+0000 mgr.a (mgr.14355) 7445 : audit [DBG] from='client.168318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:01 smithi131 bash[24745]: audit 2024-09-14T01:13:00.370258+0000 mgr.a (mgr.14355) 7445 : audit [DBG] from='client.168318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:01 smithi171 bash[25040]: audit 2024-09-14T01:13:00.370258+0000 mgr.a (mgr.14355) 7445 : audit [DBG] from='client.168318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:02 smithi007 bash[22722]: cluster 2024-09-14T01:13:01.076765+0000 mgr.a (mgr.14355) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:02 smithi131 bash[24745]: cluster 2024-09-14T01:13:01.076765+0000 mgr.a (mgr.14355) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:02 smithi171 bash[25040]: cluster 2024-09-14T01:13:01.076765+0000 mgr.a (mgr.14355) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:04 smithi007 bash[22722]: cluster 2024-09-14T01:13:03.077518+0000 mgr.a (mgr.14355) 7447 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:04 smithi131 bash[24745]: cluster 2024-09-14T01:13:03.077518+0000 mgr.a (mgr.14355) 7447 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:04 smithi171 bash[25040]: cluster 2024-09-14T01:13:03.077518+0000 mgr.a (mgr.14355) 7447 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:05.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:05.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:05.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:06.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:06 smithi007 bash[22722]: cluster 2024-09-14T01:13:05.078323+0000 mgr.a (mgr.14355) 7448 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:06 smithi131 bash[24745]: cluster 2024-09-14T01:13:05.078323+0000 mgr.a (mgr.14355) 7448 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:06 smithi171 bash[25040]: cluster 2024-09-14T01:13:05.078323+0000 mgr.a (mgr.14355) 7448 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:13:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:07 smithi007 bash[22722]: audit 2024-09-14T01:13:06.118696+0000 mgr.a (mgr.14355) 7449 : audit [DBG] from='client.168393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:07 smithi131 bash[24745]: audit 2024-09-14T01:13:06.118696+0000 mgr.a (mgr.14355) 7449 : audit [DBG] from='client.168393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:07 smithi171 bash[25040]: audit 2024-09-14T01:13:06.118696+0000 mgr.a (mgr.14355) 7449 : audit [DBG] from='client.168393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:08 smithi007 bash[22722]: cluster 2024-09-14T01:13:07.081090+0000 mgr.a (mgr.14355) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:08 smithi131 bash[24745]: cluster 2024-09-14T01:13:07.081090+0000 mgr.a (mgr.14355) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:08 smithi171 bash[25040]: cluster 2024-09-14T01:13:07.081090+0000 mgr.a (mgr.14355) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:10 smithi007 bash[22722]: cluster 2024-09-14T01:13:09.081864+0000 mgr.a (mgr.14355) 7451 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:10 smithi131 bash[24745]: cluster 2024-09-14T01:13:09.081864+0000 mgr.a (mgr.14355) 7451 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:10 smithi171 bash[25040]: cluster 2024-09-14T01:13:09.081864+0000 mgr.a (mgr.14355) 7451 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:11.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:11.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:11.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:12.295 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:12.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:12.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:12 smithi007 bash[22722]: cluster 2024-09-14T01:13:11.083924+0000 mgr.a (mgr.14355) 7452 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:12 smithi131 bash[24745]: cluster 2024-09-14T01:13:11.083924+0000 mgr.a (mgr.14355) 7452 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:12 smithi171 bash[25040]: cluster 2024-09-14T01:13:11.083924+0000 mgr.a (mgr.14355) 7452 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:13 smithi007 bash[22722]: audit 2024-09-14T01:13:11.883741+0000 mgr.a (mgr.14355) 7453 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:13 smithi131 bash[24745]: audit 2024-09-14T01:13:11.883741+0000 mgr.a (mgr.14355) 7453 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:13 smithi171 bash[25040]: audit 2024-09-14T01:13:11.883741+0000 mgr.a (mgr.14355) 7453 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:14 smithi007 bash[22722]: cluster 2024-09-14T01:13:13.084801+0000 mgr.a (mgr.14355) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:14 smithi131 bash[24745]: cluster 2024-09-14T01:13:13.084801+0000 mgr.a (mgr.14355) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:14 smithi171 bash[25040]: cluster 2024-09-14T01:13:13.084801+0000 mgr.a (mgr.14355) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:16 smithi007 bash[22722]: cluster 2024-09-14T01:13:15.085606+0000 mgr.a (mgr.14355) 7455 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:16 smithi131 bash[24745]: cluster 2024-09-14T01:13:15.085606+0000 mgr.a (mgr.14355) 7455 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:16 smithi171 bash[25040]: cluster 2024-09-14T01:13:15.085606+0000 mgr.a (mgr.14355) 7455 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:17.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:17.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:18.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:18 smithi007 bash[22722]: cluster 2024-09-14T01:13:17.087913+0000 mgr.a (mgr.14355) 7456 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:18 smithi131 bash[24745]: cluster 2024-09-14T01:13:17.087913+0000 mgr.a (mgr.14355) 7456 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:18 smithi171 bash[25040]: cluster 2024-09-14T01:13:17.087913+0000 mgr.a (mgr.14355) 7456 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:19.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:19 smithi007 bash[22722]: audit 2024-09-14T01:13:17.635673+0000 mgr.a (mgr.14355) 7457 : audit [DBG] from='client.168546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:19 smithi131 bash[24745]: audit 2024-09-14T01:13:17.635673+0000 mgr.a (mgr.14355) 7457 : audit [DBG] from='client.168546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:19 smithi171 bash[25040]: audit 2024-09-14T01:13:17.635673+0000 mgr.a (mgr.14355) 7457 : audit [DBG] from='client.168546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:20.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:20 smithi007 bash[22722]: cluster 2024-09-14T01:13:19.088794+0000 mgr.a (mgr.14355) 7458 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:20 smithi131 bash[24745]: cluster 2024-09-14T01:13:19.088794+0000 mgr.a (mgr.14355) 7458 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:20 smithi171 bash[25040]: cluster 2024-09-14T01:13:19.088794+0000 mgr.a (mgr.14355) 7458 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:22 smithi007 bash[22722]: cluster 2024-09-14T01:13:21.091010+0000 mgr.a (mgr.14355) 7459 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:22 smithi131 bash[24745]: cluster 2024-09-14T01:13:21.091010+0000 mgr.a (mgr.14355) 7459 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:22 smithi171 bash[25040]: cluster 2024-09-14T01:13:21.091010+0000 mgr.a (mgr.14355) 7459 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:23.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:23.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:24 smithi007 bash[22722]: cluster 2024-09-14T01:13:23.091564+0000 mgr.a (mgr.14355) 7460 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:24 smithi007 bash[22722]: audit 2024-09-14T01:13:23.412284+0000 mgr.a (mgr.14355) 7461 : audit [DBG] from='client.168621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:24 smithi131 bash[24745]: cluster 2024-09-14T01:13:23.091564+0000 mgr.a (mgr.14355) 7460 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:24 smithi131 bash[24745]: audit 2024-09-14T01:13:23.412284+0000 mgr.a (mgr.14355) 7461 : audit [DBG] from='client.168621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:24 smithi171 bash[25040]: cluster 2024-09-14T01:13:23.091564+0000 mgr.a (mgr.14355) 7460 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:24 smithi171 bash[25040]: audit 2024-09-14T01:13:23.412284+0000 mgr.a (mgr.14355) 7461 : audit [DBG] from='client.168621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:26 smithi007 bash[22722]: cluster 2024-09-14T01:13:25.092415+0000 mgr.a (mgr.14355) 7462 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:26 smithi131 bash[24745]: cluster 2024-09-14T01:13:25.092415+0000 mgr.a (mgr.14355) 7462 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:26 smithi171 bash[25040]: cluster 2024-09-14T01:13:25.092415+0000 mgr.a (mgr.14355) 7462 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:28 smithi007 bash[22722]: cluster 2024-09-14T01:13:27.094650+0000 mgr.a (mgr.14355) 7463 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:28 smithi131 bash[24745]: cluster 2024-09-14T01:13:27.094650+0000 mgr.a (mgr.14355) 7463 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:28 smithi171 bash[25040]: cluster 2024-09-14T01:13:27.094650+0000 mgr.a (mgr.14355) 7463 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:28.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:28.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:29.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:30.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:30 smithi007 bash[22722]: cluster 2024-09-14T01:13:29.095534+0000 mgr.a (mgr.14355) 7464 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:30 smithi007 bash[22722]: audit 2024-09-14T01:13:29.196936+0000 mgr.a (mgr.14355) 7465 : audit [DBG] from='client.168699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:30 smithi131 bash[24745]: cluster 2024-09-14T01:13:29.095534+0000 mgr.a (mgr.14355) 7464 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:30 smithi131 bash[24745]: audit 2024-09-14T01:13:29.196936+0000 mgr.a (mgr.14355) 7465 : audit [DBG] from='client.168699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:30 smithi171 bash[25040]: cluster 2024-09-14T01:13:29.095534+0000 mgr.a (mgr.14355) 7464 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:30 smithi171 bash[25040]: audit 2024-09-14T01:13:29.196936+0000 mgr.a (mgr.14355) 7465 : audit [DBG] from='client.168699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:32 smithi007 bash[22722]: cluster 2024-09-14T01:13:31.097939+0000 mgr.a (mgr.14355) 7466 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:32 smithi131 bash[24745]: cluster 2024-09-14T01:13:31.097939+0000 mgr.a (mgr.14355) 7466 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:32 smithi171 bash[25040]: cluster 2024-09-14T01:13:31.097939+0000 mgr.a (mgr.14355) 7466 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:13:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:34 smithi007 bash[22722]: cluster 2024-09-14T01:13:33.098740+0000 mgr.a (mgr.14355) 7467 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:34 smithi131 bash[24745]: cluster 2024-09-14T01:13:33.098740+0000 mgr.a (mgr.14355) 7467 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:34 smithi171 bash[25040]: cluster 2024-09-14T01:13:33.098740+0000 mgr.a (mgr.14355) 7467 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:34.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:34.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:35.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:36 smithi007 bash[22722]: audit 2024-09-14T01:13:34.973773+0000 mgr.a (mgr.14355) 7468 : audit [DBG] from='client.168777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:36 smithi007 bash[22722]: cluster 2024-09-14T01:13:35.099353+0000 mgr.a (mgr.14355) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:36 smithi131 bash[24745]: audit 2024-09-14T01:13:34.973773+0000 mgr.a (mgr.14355) 7468 : audit [DBG] from='client.168777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:36 smithi131 bash[24745]: cluster 2024-09-14T01:13:35.099353+0000 mgr.a (mgr.14355) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:36 smithi171 bash[25040]: audit 2024-09-14T01:13:34.973773+0000 mgr.a (mgr.14355) 7468 : audit [DBG] from='client.168777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:36 smithi171 bash[25040]: cluster 2024-09-14T01:13:35.099353+0000 mgr.a (mgr.14355) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:38.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:38 smithi007 bash[22722]: cluster 2024-09-14T01:13:37.102149+0000 mgr.a (mgr.14355) 7470 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:13:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:38 smithi131 bash[24745]: cluster 2024-09-14T01:13:37.102149+0000 mgr.a (mgr.14355) 7470 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:13:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:38 smithi171 bash[25040]: cluster 2024-09-14T01:13:37.102149+0000 mgr.a (mgr.14355) 7470 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:13:40.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:40.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:40 smithi007 bash[22722]: cluster 2024-09-14T01:13:39.102960+0000 mgr.a (mgr.14355) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:13:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:40 smithi131 bash[24745]: cluster 2024-09-14T01:13:39.102960+0000 mgr.a (mgr.14355) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:13:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:40 smithi171 bash[25040]: cluster 2024-09-14T01:13:39.102960+0000 mgr.a (mgr.14355) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:13:41.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:41.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:41.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:41.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:41.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:42 smithi007 bash[22722]: audit 2024-09-14T01:13:40.732588+0000 mgr.a (mgr.14355) 7472 : audit [DBG] from='client.168849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:42 smithi007 bash[22722]: cluster 2024-09-14T01:13:41.104334+0000 mgr.a (mgr.14355) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:42 smithi131 bash[24745]: audit 2024-09-14T01:13:40.732588+0000 mgr.a (mgr.14355) 7472 : audit [DBG] from='client.168849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:42 smithi131 bash[24745]: cluster 2024-09-14T01:13:41.104334+0000 mgr.a (mgr.14355) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:42 smithi171 bash[25040]: audit 2024-09-14T01:13:40.732588+0000 mgr.a (mgr.14355) 7472 : audit [DBG] from='client.168849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:42 smithi171 bash[25040]: cluster 2024-09-14T01:13:41.104334+0000 mgr.a (mgr.14355) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:44 smithi007 bash[22722]: cluster 2024-09-14T01:13:43.105102+0000 mgr.a (mgr.14355) 7474 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:44 smithi131 bash[24745]: cluster 2024-09-14T01:13:43.105102+0000 mgr.a (mgr.14355) 7474 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:44 smithi171 bash[25040]: cluster 2024-09-14T01:13:43.105102+0000 mgr.a (mgr.14355) 7474 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:13:46.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:46.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:46 smithi007 bash[22722]: cluster 2024-09-14T01:13:45.105876+0000 mgr.a (mgr.14355) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:13:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:46 smithi131 bash[24745]: cluster 2024-09-14T01:13:45.105876+0000 mgr.a (mgr.14355) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:13:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:46 smithi171 bash[25040]: cluster 2024-09-14T01:13:45.105876+0000 mgr.a (mgr.14355) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:13:46.927 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:46.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:46.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:46.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:46.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:48 smithi007 bash[22722]: audit 2024-09-14T01:13:46.496443+0000 mgr.a (mgr.14355) 7476 : audit [DBG] from='client.168927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:48 smithi007 bash[22722]: cluster 2024-09-14T01:13:47.108724+0000 mgr.a (mgr.14355) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:48 smithi131 bash[24745]: audit 2024-09-14T01:13:46.496443+0000 mgr.a (mgr.14355) 7476 : audit [DBG] from='client.168927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:48 smithi131 bash[24745]: cluster 2024-09-14T01:13:47.108724+0000 mgr.a (mgr.14355) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:48 smithi171 bash[25040]: audit 2024-09-14T01:13:46.496443+0000 mgr.a (mgr.14355) 7476 : audit [DBG] from='client.168927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:48 smithi171 bash[25040]: cluster 2024-09-14T01:13:47.108724+0000 mgr.a (mgr.14355) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:50 smithi007 bash[22722]: cluster 2024-09-14T01:13:49.109522+0000 mgr.a (mgr.14355) 7478 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:13:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:50 smithi131 bash[24745]: cluster 2024-09-14T01:13:49.109522+0000 mgr.a (mgr.14355) 7478 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:13:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:50 smithi171 bash[25040]: cluster 2024-09-14T01:13:49.109522+0000 mgr.a (mgr.14355) 7478 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:13:51.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:51 smithi007 bash[22722]: audit 2024-09-14T01:13:51.145816+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:13:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:51 smithi131 bash[24745]: audit 2024-09-14T01:13:51.145816+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:13:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:51 smithi171 bash[25040]: audit 2024-09-14T01:13:51.145816+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:13:51.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:52 smithi007 bash[22722]: cluster 2024-09-14T01:13:51.111565+0000 mgr.a (mgr.14355) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:13:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:52 smithi007 bash[22722]: audit 2024-09-14T01:13:51.776705+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:52 smithi007 bash[22722]: audit 2024-09-14T01:13:51.781197+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:52 smithi131 bash[24745]: cluster 2024-09-14T01:13:51.111565+0000 mgr.a (mgr.14355) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:13:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:52 smithi131 bash[24745]: audit 2024-09-14T01:13:51.776705+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:52 smithi131 bash[24745]: audit 2024-09-14T01:13:51.781197+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:52 smithi171 bash[25040]: cluster 2024-09-14T01:13:51.111565+0000 mgr.a (mgr.14355) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:13:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:52 smithi171 bash[25040]: audit 2024-09-14T01:13:51.776705+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:52 smithi171 bash[25040]: audit 2024-09-14T01:13:51.781197+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:52.678 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:52.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:52.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:52.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:53.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:53 smithi131 bash[24745]: audit 2024-09-14T01:13:52.261529+0000 mgr.a (mgr.14355) 7480 : audit [DBG] from='client.169005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:53.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:53 smithi131 bash[24745]: audit 2024-09-14T01:13:52.587019+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:13:53.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:53 smithi131 bash[24745]: audit 2024-09-14T01:13:52.588065+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:13:53.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:53 smithi131 bash[24745]: audit 2024-09-14T01:13:52.593746+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:53.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:53 smithi131 bash[24745]: audit 2024-09-14T01:13:52.596045+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:53 smithi171 bash[25040]: audit 2024-09-14T01:13:52.261529+0000 mgr.a (mgr.14355) 7480 : audit [DBG] from='client.169005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:53 smithi171 bash[25040]: audit 2024-09-14T01:13:52.587019+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:13:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:53 smithi171 bash[25040]: audit 2024-09-14T01:13:52.588065+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:13:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:53 smithi171 bash[25040]: audit 2024-09-14T01:13:52.593746+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:53 smithi171 bash[25040]: audit 2024-09-14T01:13:52.596045+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22972]: debug 2024-09-14T01:13:53.353+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22972]: debug 2024-09-14T01:13:53.353+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22722]: audit 2024-09-14T01:13:52.261529+0000 mgr.a (mgr.14355) 7480 : audit [DBG] from='client.169005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22722]: audit 2024-09-14T01:13:52.587019+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22722]: audit 2024-09-14T01:13:52.588065+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:13:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22722]: audit 2024-09-14T01:13:52.593746+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:13:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:53 smithi007 bash[22722]: audit 2024-09-14T01:13:52.596045+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:54 smithi131 bash[24745]: audit 2024-09-14T01:13:52.597203+0000 mgr.a (mgr.14355) 7481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:54 smithi131 bash[24745]: cluster 2024-09-14T01:13:53.112138+0000 mgr.a (mgr.14355) 7482 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:54 smithi131 bash[24745]: audit 2024-09-14T01:13:53.354480+0000 mgr.a (mgr.14355) 7483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:13:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:54 smithi131 bash[24745]: cephadm 2024-09-14T01:13:53.355688+0000 mgr.a (mgr.14355) 7484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:13:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:54 smithi171 bash[25040]: audit 2024-09-14T01:13:52.597203+0000 mgr.a (mgr.14355) 7481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:54 smithi171 bash[25040]: cluster 2024-09-14T01:13:53.112138+0000 mgr.a (mgr.14355) 7482 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:54 smithi171 bash[25040]: audit 2024-09-14T01:13:53.354480+0000 mgr.a (mgr.14355) 7483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:13:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:54 smithi171 bash[25040]: cephadm 2024-09-14T01:13:53.355688+0000 mgr.a (mgr.14355) 7484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:13:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:54 smithi007 bash[22722]: audit 2024-09-14T01:13:52.597203+0000 mgr.a (mgr.14355) 7481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:13:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:54 smithi007 bash[22722]: cluster 2024-09-14T01:13:53.112138+0000 mgr.a (mgr.14355) 7482 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:54 smithi007 bash[22722]: audit 2024-09-14T01:13:53.354480+0000 mgr.a (mgr.14355) 7483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:13:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:54 smithi007 bash[22722]: cephadm 2024-09-14T01:13:53.355688+0000 mgr.a (mgr.14355) 7484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:13:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:56 smithi131 bash[24745]: cluster 2024-09-14T01:13:55.112991+0000 mgr.a (mgr.14355) 7485 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:56 smithi171 bash[25040]: cluster 2024-09-14T01:13:55.112991+0000 mgr.a (mgr.14355) 7485 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:56 smithi007 bash[22722]: cluster 2024-09-14T01:13:55.112991+0000 mgr.a (mgr.14355) 7485 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:13:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:13:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:13:57.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:13:58.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:13:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:13:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:13:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:13:58.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:13:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:58 smithi131 bash[24745]: cluster 2024-09-14T01:13:57.115297+0000 mgr.a (mgr.14355) 7486 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:58 smithi171 bash[25040]: cluster 2024-09-14T01:13:57.115297+0000 mgr.a (mgr.14355) 7486 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:58 smithi007 bash[22722]: cluster 2024-09-14T01:13:57.115297+0000 mgr.a (mgr.14355) 7486 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:13:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:13:59 smithi131 bash[24745]: audit 2024-09-14T01:13:58.014908+0000 mgr.a (mgr.14355) 7487 : audit [DBG] from='client.169182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:13:59 smithi171 bash[25040]: audit 2024-09-14T01:13:58.014908+0000 mgr.a (mgr.14355) 7487 : audit [DBG] from='client.169182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:13:59.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:13:59 smithi007 bash[22722]: audit 2024-09-14T01:13:58.014908+0000 mgr.a (mgr.14355) 7487 : audit [DBG] from='client.169182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:00 smithi131 bash[24745]: cluster 2024-09-14T01:13:59.116404+0000 mgr.a (mgr.14355) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:00 smithi171 bash[25040]: cluster 2024-09-14T01:13:59.116404+0000 mgr.a (mgr.14355) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:00.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:00 smithi007 bash[22722]: cluster 2024-09-14T01:13:59.116404+0000 mgr.a (mgr.14355) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:02 smithi131 bash[24745]: cluster 2024-09-14T01:14:01.118876+0000 mgr.a (mgr.14355) 7489 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:02 smithi171 bash[25040]: cluster 2024-09-14T01:14:01.118876+0000 mgr.a (mgr.14355) 7489 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:02 smithi007 bash[22722]: cluster 2024-09-14T01:14:01.118876+0000 mgr.a (mgr.14355) 7489 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:04.180 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:04.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:04.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:04 smithi131 bash[24745]: cluster 2024-09-14T01:14:03.119696+0000 mgr.a (mgr.14355) 7490 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:04 smithi171 bash[25040]: cluster 2024-09-14T01:14:03.119696+0000 mgr.a (mgr.14355) 7490 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:04 smithi007 bash[22722]: cluster 2024-09-14T01:14:03.119696+0000 mgr.a (mgr.14355) 7490 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:05 smithi131 bash[24745]: audit 2024-09-14T01:14:03.765199+0000 mgr.a (mgr.14355) 7491 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:05 smithi171 bash[25040]: audit 2024-09-14T01:14:03.765199+0000 mgr.a (mgr.14355) 7491 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:05 smithi007 bash[22722]: audit 2024-09-14T01:14:03.765199+0000 mgr.a (mgr.14355) 7491 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:06 smithi131 bash[24745]: cluster 2024-09-14T01:14:05.120786+0000 mgr.a (mgr.14355) 7492 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:06 smithi171 bash[25040]: cluster 2024-09-14T01:14:05.120786+0000 mgr.a (mgr.14355) 7492 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:06 smithi007 bash[22722]: cluster 2024-09-14T01:14:05.120786+0000 mgr.a (mgr.14355) 7492 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:08 smithi131 bash[24745]: cluster 2024-09-14T01:14:07.123113+0000 mgr.a (mgr.14355) 7493 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:08 smithi171 bash[25040]: cluster 2024-09-14T01:14:07.123113+0000 mgr.a (mgr.14355) 7493 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:08 smithi007 bash[22722]: cluster 2024-09-14T01:14:07.123113+0000 mgr.a (mgr.14355) 7493 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:14:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:09.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:10 smithi131 bash[24745]: cluster 2024-09-14T01:14:09.123908+0000 mgr.a (mgr.14355) 7494 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:10 smithi171 bash[25040]: cluster 2024-09-14T01:14:09.123908+0000 mgr.a (mgr.14355) 7494 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:10 smithi007 bash[22722]: cluster 2024-09-14T01:14:09.123908+0000 mgr.a (mgr.14355) 7494 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:11 smithi131 bash[24745]: audit 2024-09-14T01:14:09.513462+0000 mgr.a (mgr.14355) 7495 : audit [DBG] from='client.169335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:11 smithi171 bash[25040]: audit 2024-09-14T01:14:09.513462+0000 mgr.a (mgr.14355) 7495 : audit [DBG] from='client.169335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:11 smithi007 bash[22722]: audit 2024-09-14T01:14:09.513462+0000 mgr.a (mgr.14355) 7495 : audit [DBG] from='client.169335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:12 smithi131 bash[24745]: cluster 2024-09-14T01:14:11.126381+0000 mgr.a (mgr.14355) 7496 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:12 smithi171 bash[25040]: cluster 2024-09-14T01:14:11.126381+0000 mgr.a (mgr.14355) 7496 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:12 smithi007 bash[22722]: cluster 2024-09-14T01:14:11.126381+0000 mgr.a (mgr.14355) 7496 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:14 smithi131 bash[24745]: cluster 2024-09-14T01:14:13.127208+0000 mgr.a (mgr.14355) 7497 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:14 smithi171 bash[25040]: cluster 2024-09-14T01:14:13.127208+0000 mgr.a (mgr.14355) 7497 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:14 smithi007 bash[22722]: cluster 2024-09-14T01:14:13.127208+0000 mgr.a (mgr.14355) 7497 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:14.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:14.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:14.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:15.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:15.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:16 smithi131 bash[24745]: cluster 2024-09-14T01:14:15.127866+0000 mgr.a (mgr.14355) 7498 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:16 smithi131 bash[24745]: audit 2024-09-14T01:14:15.266146+0000 mgr.a (mgr.14355) 7499 : audit [DBG] from='client.169410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:16 smithi171 bash[25040]: cluster 2024-09-14T01:14:15.127866+0000 mgr.a (mgr.14355) 7498 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:16 smithi171 bash[25040]: audit 2024-09-14T01:14:15.266146+0000 mgr.a (mgr.14355) 7499 : audit [DBG] from='client.169410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:16 smithi007 bash[22722]: cluster 2024-09-14T01:14:15.127866+0000 mgr.a (mgr.14355) 7498 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:16 smithi007 bash[22722]: audit 2024-09-14T01:14:15.266146+0000 mgr.a (mgr.14355) 7499 : audit [DBG] from='client.169410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:18 smithi131 bash[24745]: cluster 2024-09-14T01:14:17.131166+0000 mgr.a (mgr.14355) 7500 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:18 smithi171 bash[25040]: cluster 2024-09-14T01:14:17.131166+0000 mgr.a (mgr.14355) 7500 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:18 smithi007 bash[22722]: cluster 2024-09-14T01:14:17.131166+0000 mgr.a (mgr.14355) 7500 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:20 smithi131 bash[24745]: cluster 2024-09-14T01:14:19.131977+0000 mgr.a (mgr.14355) 7501 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:20 smithi171 bash[25040]: cluster 2024-09-14T01:14:19.131977+0000 mgr.a (mgr.14355) 7501 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:20 smithi007 bash[22722]: cluster 2024-09-14T01:14:19.131977+0000 mgr.a (mgr.14355) 7501 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:21.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:21.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:22 smithi171 bash[25040]: audit 2024-09-14T01:14:21.022692+0000 mgr.a (mgr.14355) 7502 : audit [DBG] from='client.169488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:22 smithi171 bash[25040]: cluster 2024-09-14T01:14:21.133330+0000 mgr.a (mgr.14355) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:22 smithi007 bash[22722]: audit 2024-09-14T01:14:21.022692+0000 mgr.a (mgr.14355) 7502 : audit [DBG] from='client.169488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:22 smithi007 bash[22722]: cluster 2024-09-14T01:14:21.133330+0000 mgr.a (mgr.14355) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:22 smithi131 bash[24745]: audit 2024-09-14T01:14:21.022692+0000 mgr.a (mgr.14355) 7502 : audit [DBG] from='client.169488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:22 smithi131 bash[24745]: cluster 2024-09-14T01:14:21.133330+0000 mgr.a (mgr.14355) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:24 smithi171 bash[25040]: cluster 2024-09-14T01:14:23.134180+0000 mgr.a (mgr.14355) 7504 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:24 smithi007 bash[22722]: cluster 2024-09-14T01:14:23.134180+0000 mgr.a (mgr.14355) 7504 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:24 smithi131 bash[24745]: cluster 2024-09-14T01:14:23.134180+0000 mgr.a (mgr.14355) 7504 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:14:26.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:26.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:26.458 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:26 smithi171 bash[25040]: cluster 2024-09-14T01:14:25.134961+0000 mgr.a (mgr.14355) 7505 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:14:26.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:26 smithi007 bash[22722]: cluster 2024-09-14T01:14:25.134961+0000 mgr.a (mgr.14355) 7505 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:14:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:26 smithi131 bash[24745]: cluster 2024-09-14T01:14:25.134961+0000 mgr.a (mgr.14355) 7505 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:14:27.227 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:27.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:28 smithi007 bash[22722]: audit 2024-09-14T01:14:26.795202+0000 mgr.a (mgr.14355) 7506 : audit [DBG] from='client.169566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:28 smithi007 bash[22722]: cluster 2024-09-14T01:14:27.136286+0000 mgr.a (mgr.14355) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:28 smithi131 bash[24745]: audit 2024-09-14T01:14:26.795202+0000 mgr.a (mgr.14355) 7506 : audit [DBG] from='client.169566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:28 smithi131 bash[24745]: cluster 2024-09-14T01:14:27.136286+0000 mgr.a (mgr.14355) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:28 smithi171 bash[25040]: audit 2024-09-14T01:14:26.795202+0000 mgr.a (mgr.14355) 7506 : audit [DBG] from='client.169566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:28 smithi171 bash[25040]: cluster 2024-09-14T01:14:27.136286+0000 mgr.a (mgr.14355) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:30 smithi007 bash[22722]: cluster 2024-09-14T01:14:29.137046+0000 mgr.a (mgr.14355) 7508 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:30.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:30 smithi131 bash[24745]: cluster 2024-09-14T01:14:29.137046+0000 mgr.a (mgr.14355) 7508 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:30 smithi171 bash[25040]: cluster 2024-09-14T01:14:29.137046+0000 mgr.a (mgr.14355) 7508 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:32.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:32.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:32 smithi007 bash[22722]: cluster 2024-09-14T01:14:31.139091+0000 mgr.a (mgr.14355) 7509 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:32 smithi131 bash[24745]: cluster 2024-09-14T01:14:31.139091+0000 mgr.a (mgr.14355) 7509 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:32 smithi171 bash[25040]: cluster 2024-09-14T01:14:31.139091+0000 mgr.a (mgr.14355) 7509 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:33.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:33.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:33.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:33.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:33.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:34 smithi007 bash[22722]: audit 2024-09-14T01:14:32.564733+0000 mgr.a (mgr.14355) 7510 : audit [DBG] from='client.169641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:34 smithi007 bash[22722]: cluster 2024-09-14T01:14:33.140027+0000 mgr.a (mgr.14355) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:34 smithi131 bash[24745]: audit 2024-09-14T01:14:32.564733+0000 mgr.a (mgr.14355) 7510 : audit [DBG] from='client.169641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:34 smithi131 bash[24745]: cluster 2024-09-14T01:14:33.140027+0000 mgr.a (mgr.14355) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:34 smithi171 bash[25040]: audit 2024-09-14T01:14:32.564733+0000 mgr.a (mgr.14355) 7510 : audit [DBG] from='client.169641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:34 smithi171 bash[25040]: cluster 2024-09-14T01:14:33.140027+0000 mgr.a (mgr.14355) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:36 smithi007 bash[22722]: cluster 2024-09-14T01:14:35.140769+0000 mgr.a (mgr.14355) 7512 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:36 smithi131 bash[24745]: cluster 2024-09-14T01:14:35.140769+0000 mgr.a (mgr.14355) 7512 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:36 smithi171 bash[25040]: cluster 2024-09-14T01:14:35.140769+0000 mgr.a (mgr.14355) 7512 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:38.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:38 smithi007 bash[22722]: cluster 2024-09-14T01:14:37.143011+0000 mgr.a (mgr.14355) 7513 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:38 smithi131 bash[24745]: cluster 2024-09-14T01:14:37.143011+0000 mgr.a (mgr.14355) 7513 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:38.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:38 smithi171 bash[25040]: cluster 2024-09-14T01:14:37.143011+0000 mgr.a (mgr.14355) 7513 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:39.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:39 smithi007 bash[22722]: audit 2024-09-14T01:14:38.348303+0000 mgr.a (mgr.14355) 7514 : audit [DBG] from='client.169719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:39 smithi131 bash[24745]: audit 2024-09-14T01:14:38.348303+0000 mgr.a (mgr.14355) 7514 : audit [DBG] from='client.169719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:39 smithi171 bash[25040]: audit 2024-09-14T01:14:38.348303+0000 mgr.a (mgr.14355) 7514 : audit [DBG] from='client.169719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:40 smithi007 bash[22722]: cluster 2024-09-14T01:14:39.144017+0000 mgr.a (mgr.14355) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:40 smithi131 bash[24745]: cluster 2024-09-14T01:14:39.144017+0000 mgr.a (mgr.14355) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:40 smithi171 bash[25040]: cluster 2024-09-14T01:14:39.144017+0000 mgr.a (mgr.14355) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:42 smithi007 bash[22722]: cluster 2024-09-14T01:14:41.146283+0000 mgr.a (mgr.14355) 7516 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:42 smithi131 bash[24745]: cluster 2024-09-14T01:14:41.146283+0000 mgr.a (mgr.14355) 7516 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:42 smithi171 bash[25040]: cluster 2024-09-14T01:14:41.146283+0000 mgr.a (mgr.14355) 7516 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:43.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:43.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:43.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:44.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:44.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:44 smithi007 bash[22722]: cluster 2024-09-14T01:14:43.147104+0000 mgr.a (mgr.14355) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:44 smithi131 bash[24745]: cluster 2024-09-14T01:14:43.147104+0000 mgr.a (mgr.14355) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:44 smithi171 bash[25040]: cluster 2024-09-14T01:14:43.147104+0000 mgr.a (mgr.14355) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:45.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:45 smithi007 bash[22722]: audit 2024-09-14T01:14:44.113115+0000 mgr.a (mgr.14355) 7518 : audit [DBG] from='client.169797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:45 smithi131 bash[24745]: audit 2024-09-14T01:14:44.113115+0000 mgr.a (mgr.14355) 7518 : audit [DBG] from='client.169797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:45 smithi171 bash[25040]: audit 2024-09-14T01:14:44.113115+0000 mgr.a (mgr.14355) 7518 : audit [DBG] from='client.169797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:46 smithi007 bash[22722]: cluster 2024-09-14T01:14:45.148074+0000 mgr.a (mgr.14355) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:46 smithi131 bash[24745]: cluster 2024-09-14T01:14:45.148074+0000 mgr.a (mgr.14355) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:46 smithi171 bash[25040]: cluster 2024-09-14T01:14:45.148074+0000 mgr.a (mgr.14355) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:48 smithi007 bash[22722]: cluster 2024-09-14T01:14:47.150285+0000 mgr.a (mgr.14355) 7520 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:48 smithi131 bash[24745]: cluster 2024-09-14T01:14:47.150285+0000 mgr.a (mgr.14355) 7520 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:48 smithi171 bash[25040]: cluster 2024-09-14T01:14:47.150285+0000 mgr.a (mgr.14355) 7520 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:14:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:50.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:50.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:50 smithi131 bash[24745]: cluster 2024-09-14T01:14:49.151102+0000 mgr.a (mgr.14355) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:50 smithi171 bash[25040]: cluster 2024-09-14T01:14:49.151102+0000 mgr.a (mgr.14355) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:50 smithi007 bash[22722]: cluster 2024-09-14T01:14:49.151102+0000 mgr.a (mgr.14355) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:14:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:51 smithi131 bash[24745]: audit 2024-09-14T01:14:49.852147+0000 mgr.a (mgr.14355) 7522 : audit [DBG] from='client.169869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:51 smithi171 bash[25040]: audit 2024-09-14T01:14:49.852147+0000 mgr.a (mgr.14355) 7522 : audit [DBG] from='client.169869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:51 smithi007 bash[22722]: audit 2024-09-14T01:14:49.852147+0000 mgr.a (mgr.14355) 7522 : audit [DBG] from='client.169869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:52 smithi131 bash[24745]: cluster 2024-09-14T01:14:51.153528+0000 mgr.a (mgr.14355) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:14:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:52 smithi171 bash[25040]: cluster 2024-09-14T01:14:51.153528+0000 mgr.a (mgr.14355) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:14:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:52 smithi007 bash[22722]: cluster 2024-09-14T01:14:51.153528+0000 mgr.a (mgr.14355) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:14:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: cluster 2024-09-14T01:14:53.154339+0000 mgr.a (mgr.14355) 7524 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: audit 2024-09-14T01:14:53.409751+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:14:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: audit 2024-09-14T01:14:54.015643+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: audit 2024-09-14T01:14:54.020382+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: audit 2024-09-14T01:14:54.023630+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:54 smithi131 bash[24745]: audit 2024-09-14T01:14:54.027862+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: cluster 2024-09-14T01:14:53.154339+0000 mgr.a (mgr.14355) 7524 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: audit 2024-09-14T01:14:53.409751+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: audit 2024-09-14T01:14:54.015643+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: audit 2024-09-14T01:14:54.020382+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: audit 2024-09-14T01:14:54.023630+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:54 smithi171 bash[25040]: audit 2024-09-14T01:14:54.027862+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: cluster 2024-09-14T01:14:53.154339+0000 mgr.a (mgr.14355) 7524 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: audit 2024-09-14T01:14:53.409751+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: audit 2024-09-14T01:14:54.015643+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: audit 2024-09-14T01:14:54.020382+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: audit 2024-09-14T01:14:54.023630+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:54 smithi007 bash[22722]: audit 2024-09-14T01:14:54.027862+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:14:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:14:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:14:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:55 smithi131 bash[24745]: audit 2024-09-14T01:14:54.697541+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:14:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:55 smithi131 bash[24745]: audit 2024-09-14T01:14:54.699367+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:14:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:55 smithi131 bash[24745]: audit 2024-09-14T01:14:54.710596+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:55 smithi131 bash[24745]: audit 2024-09-14T01:14:54.713169+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:55 smithi171 bash[25040]: audit 2024-09-14T01:14:54.697541+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:14:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:55 smithi171 bash[25040]: audit 2024-09-14T01:14:54.699367+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:14:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:55 smithi171 bash[25040]: audit 2024-09-14T01:14:54.710596+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:55 smithi171 bash[25040]: audit 2024-09-14T01:14:54.713169+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:55.703 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22972]: debug 2024-09-14T01:14:55.428+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:14:55.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22972]: debug 2024-09-14T01:14:55.428+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:14:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22722]: audit 2024-09-14T01:14:54.697541+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:14:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22722]: audit 2024-09-14T01:14:54.699367+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:14:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22722]: audit 2024-09-14T01:14:54.710596+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:14:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:55 smithi007 bash[22722]: audit 2024-09-14T01:14:54.713169+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:14:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:14:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:14:56.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:14:56.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:14:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:56 smithi131 bash[24745]: audit 2024-09-14T01:14:54.715432+0000 mgr.a (mgr.14355) 7525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:56 smithi131 bash[24745]: cluster 2024-09-14T01:14:55.154882+0000 mgr.a (mgr.14355) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:56 smithi131 bash[24745]: audit 2024-09-14T01:14:55.430982+0000 mgr.a (mgr.14355) 7527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:14:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:56 smithi131 bash[24745]: cephadm 2024-09-14T01:14:55.432098+0000 mgr.a (mgr.14355) 7528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:14:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:56 smithi171 bash[25040]: audit 2024-09-14T01:14:54.715432+0000 mgr.a (mgr.14355) 7525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:56 smithi171 bash[25040]: cluster 2024-09-14T01:14:55.154882+0000 mgr.a (mgr.14355) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:56 smithi171 bash[25040]: audit 2024-09-14T01:14:55.430982+0000 mgr.a (mgr.14355) 7527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:14:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:56 smithi171 bash[25040]: cephadm 2024-09-14T01:14:55.432098+0000 mgr.a (mgr.14355) 7528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:14:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:56 smithi007 bash[22722]: audit 2024-09-14T01:14:54.715432+0000 mgr.a (mgr.14355) 7525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:14:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:56 smithi007 bash[22722]: cluster 2024-09-14T01:14:55.154882+0000 mgr.a (mgr.14355) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:14:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:56 smithi007 bash[22722]: audit 2024-09-14T01:14:55.430982+0000 mgr.a (mgr.14355) 7527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:14:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:56 smithi007 bash[22722]: cephadm 2024-09-14T01:14:55.432098+0000 mgr.a (mgr.14355) 7528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:14:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:57 smithi131 bash[24745]: audit 2024-09-14T01:14:55.600973+0000 mgr.a (mgr.14355) 7529 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:57 smithi171 bash[25040]: audit 2024-09-14T01:14:55.600973+0000 mgr.a (mgr.14355) 7529 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:57 smithi007 bash[22722]: audit 2024-09-14T01:14:55.600973+0000 mgr.a (mgr.14355) 7529 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:14:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:14:58 smithi131 bash[24745]: cluster 2024-09-14T01:14:57.157572+0000 mgr.a (mgr.14355) 7530 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:14:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:14:58 smithi171 bash[25040]: cluster 2024-09-14T01:14:57.157572+0000 mgr.a (mgr.14355) 7530 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:14:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:14:58 smithi007 bash[22722]: cluster 2024-09-14T01:14:57.157572+0000 mgr.a (mgr.14355) 7530 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T01:15:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:00 smithi131 bash[24745]: cluster 2024-09-14T01:14:59.158408+0000 mgr.a (mgr.14355) 7531 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:15:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:00 smithi171 bash[25040]: cluster 2024-09-14T01:14:59.158408+0000 mgr.a (mgr.14355) 7531 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:15:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:00 smithi007 bash[22722]: cluster 2024-09-14T01:14:59.158408+0000 mgr.a (mgr.14355) 7531 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T01:15:01.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:01.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:01.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:01.757 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:01.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:02 smithi131 bash[24745]: cluster 2024-09-14T01:15:01.160230+0000 mgr.a (mgr.14355) 7532 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:02 smithi131 bash[24745]: audit 2024-09-14T01:15:01.338286+0000 mgr.a (mgr.14355) 7533 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:02 smithi171 bash[25040]: cluster 2024-09-14T01:15:01.160230+0000 mgr.a (mgr.14355) 7532 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:02 smithi171 bash[25040]: audit 2024-09-14T01:15:01.338286+0000 mgr.a (mgr.14355) 7533 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:02 smithi007 bash[22722]: cluster 2024-09-14T01:15:01.160230+0000 mgr.a (mgr.14355) 7532 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:02 smithi007 bash[22722]: audit 2024-09-14T01:15:01.338286+0000 mgr.a (mgr.14355) 7533 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:04 smithi131 bash[24745]: cluster 2024-09-14T01:15:03.161164+0000 mgr.a (mgr.14355) 7534 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:04 smithi171 bash[25040]: cluster 2024-09-14T01:15:03.161164+0000 mgr.a (mgr.14355) 7534 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:04 smithi007 bash[22722]: cluster 2024-09-14T01:15:03.161164+0000 mgr.a (mgr.14355) 7534 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:06 smithi131 bash[24745]: cluster 2024-09-14T01:15:05.161989+0000 mgr.a (mgr.14355) 7535 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:06 smithi171 bash[25040]: cluster 2024-09-14T01:15:05.161989+0000 mgr.a (mgr.14355) 7535 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:06 smithi007 bash[22722]: cluster 2024-09-14T01:15:05.161989+0000 mgr.a (mgr.14355) 7535 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:15:06.758 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:06.759 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:07.520 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:07.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:08 smithi131 bash[24745]: audit 2024-09-14T01:15:07.094163+0000 mgr.a (mgr.14355) 7536 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:08 smithi131 bash[24745]: cluster 2024-09-14T01:15:07.163971+0000 mgr.a (mgr.14355) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:08 smithi171 bash[25040]: audit 2024-09-14T01:15:07.094163+0000 mgr.a (mgr.14355) 7536 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:08 smithi171 bash[25040]: cluster 2024-09-14T01:15:07.163971+0000 mgr.a (mgr.14355) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:08 smithi007 bash[22722]: audit 2024-09-14T01:15:07.094163+0000 mgr.a (mgr.14355) 7536 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:08 smithi007 bash[22722]: cluster 2024-09-14T01:15:07.163971+0000 mgr.a (mgr.14355) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:15:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:10 smithi131 bash[24745]: cluster 2024-09-14T01:15:09.164871+0000 mgr.a (mgr.14355) 7538 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:15:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:10 smithi171 bash[25040]: cluster 2024-09-14T01:15:09.164871+0000 mgr.a (mgr.14355) 7538 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:15:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:10 smithi007 bash[22722]: cluster 2024-09-14T01:15:09.164871+0000 mgr.a (mgr.14355) 7538 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T01:15:12.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:12 smithi131 bash[24745]: cluster 2024-09-14T01:15:11.167149+0000 mgr.a (mgr.14355) 7539 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T01:15:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:12 smithi171 bash[25040]: cluster 2024-09-14T01:15:11.167149+0000 mgr.a (mgr.14355) 7539 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T01:15:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:12 smithi007 bash[22722]: cluster 2024-09-14T01:15:11.167149+0000 mgr.a (mgr.14355) 7539 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T01:15:13.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:13.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:13.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:14 smithi131 bash[24745]: audit 2024-09-14T01:15:12.856932+0000 mgr.a (mgr.14355) 7540 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:14 smithi131 bash[24745]: cluster 2024-09-14T01:15:13.167645+0000 mgr.a (mgr.14355) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:14 smithi171 bash[25040]: audit 2024-09-14T01:15:12.856932+0000 mgr.a (mgr.14355) 7540 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:14 smithi171 bash[25040]: cluster 2024-09-14T01:15:13.167645+0000 mgr.a (mgr.14355) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:14 smithi007 bash[22722]: audit 2024-09-14T01:15:12.856932+0000 mgr.a (mgr.14355) 7540 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:14 smithi007 bash[22722]: cluster 2024-09-14T01:15:13.167645+0000 mgr.a (mgr.14355) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:16 smithi131 bash[24745]: cluster 2024-09-14T01:15:15.168495+0000 mgr.a (mgr.14355) 7542 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:16 smithi171 bash[25040]: cluster 2024-09-14T01:15:15.168495+0000 mgr.a (mgr.14355) 7542 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:16 smithi007 bash[22722]: cluster 2024-09-14T01:15:15.168495+0000 mgr.a (mgr.14355) 7542 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:18.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:18 smithi131 bash[24745]: cluster 2024-09-14T01:15:17.170807+0000 mgr.a (mgr.14355) 7543 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:18 smithi171 bash[25040]: cluster 2024-09-14T01:15:17.170807+0000 mgr.a (mgr.14355) 7543 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:18 smithi007 bash[22722]: cluster 2024-09-14T01:15:17.170807+0000 mgr.a (mgr.14355) 7543 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:19.059 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:19.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:20 smithi171 bash[25040]: audit 2024-09-14T01:15:18.639257+0000 mgr.a (mgr.14355) 7544 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:20 smithi171 bash[25040]: cluster 2024-09-14T01:15:19.171745+0000 mgr.a (mgr.14355) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:20 smithi007 bash[22722]: audit 2024-09-14T01:15:18.639257+0000 mgr.a (mgr.14355) 7544 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:20 smithi007 bash[22722]: cluster 2024-09-14T01:15:19.171745+0000 mgr.a (mgr.14355) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:20 smithi131 bash[24745]: audit 2024-09-14T01:15:18.639257+0000 mgr.a (mgr.14355) 7544 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:20 smithi131 bash[24745]: cluster 2024-09-14T01:15:19.171745+0000 mgr.a (mgr.14355) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:22 smithi171 bash[25040]: cluster 2024-09-14T01:15:21.174006+0000 mgr.a (mgr.14355) 7546 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:22 smithi007 bash[22722]: cluster 2024-09-14T01:15:21.174006+0000 mgr.a (mgr.14355) 7546 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:22 smithi131 bash[24745]: cluster 2024-09-14T01:15:21.174006+0000 mgr.a (mgr.14355) 7546 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:24.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:24.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:24.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:24 smithi007 bash[22722]: cluster 2024-09-14T01:15:23.174813+0000 mgr.a (mgr.14355) 7547 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:24 smithi131 bash[24745]: cluster 2024-09-14T01:15:23.174813+0000 mgr.a (mgr.14355) 7547 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:24 smithi171 bash[25040]: cluster 2024-09-14T01:15:23.174813+0000 mgr.a (mgr.14355) 7547 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:24.824 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:24.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:25 smithi007 bash[22722]: audit 2024-09-14T01:15:24.400152+0000 mgr.a (mgr.14355) 7548 : audit [DBG] from='client.170439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:25 smithi131 bash[24745]: audit 2024-09-14T01:15:24.400152+0000 mgr.a (mgr.14355) 7548 : audit [DBG] from='client.170439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:25 smithi171 bash[25040]: audit 2024-09-14T01:15:24.400152+0000 mgr.a (mgr.14355) 7548 : audit [DBG] from='client.170439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:26 smithi007 bash[22722]: cluster 2024-09-14T01:15:25.175867+0000 mgr.a (mgr.14355) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:26 smithi131 bash[24745]: cluster 2024-09-14T01:15:25.175867+0000 mgr.a (mgr.14355) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:26 smithi171 bash[25040]: cluster 2024-09-14T01:15:25.175867+0000 mgr.a (mgr.14355) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:28 smithi007 bash[22722]: cluster 2024-09-14T01:15:27.178128+0000 mgr.a (mgr.14355) 7550 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:28 smithi131 bash[24745]: cluster 2024-09-14T01:15:27.178128+0000 mgr.a (mgr.14355) 7550 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:28 smithi171 bash[25040]: cluster 2024-09-14T01:15:27.178128+0000 mgr.a (mgr.14355) 7550 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:29.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:30.610 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:30 smithi007 bash[22722]: cluster 2024-09-14T01:15:29.178888+0000 mgr.a (mgr.14355) 7551 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:30 smithi131 bash[24745]: cluster 2024-09-14T01:15:29.178888+0000 mgr.a (mgr.14355) 7551 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:30 smithi171 bash[25040]: cluster 2024-09-14T01:15:29.178888+0000 mgr.a (mgr.14355) 7551 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:31 smithi007 bash[22722]: audit 2024-09-14T01:15:30.162353+0000 mgr.a (mgr.14355) 7552 : audit [DBG] from='client.170517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:31 smithi131 bash[24745]: audit 2024-09-14T01:15:30.162353+0000 mgr.a (mgr.14355) 7552 : audit [DBG] from='client.170517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:31 smithi171 bash[25040]: audit 2024-09-14T01:15:30.162353+0000 mgr.a (mgr.14355) 7552 : audit [DBG] from='client.170517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:32 smithi007 bash[22722]: cluster 2024-09-14T01:15:31.181786+0000 mgr.a (mgr.14355) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:32 smithi131 bash[24745]: cluster 2024-09-14T01:15:31.181786+0000 mgr.a (mgr.14355) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:32 smithi171 bash[25040]: cluster 2024-09-14T01:15:31.181786+0000 mgr.a (mgr.14355) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:34 smithi007 bash[22722]: cluster 2024-09-14T01:15:33.182754+0000 mgr.a (mgr.14355) 7554 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:34 smithi131 bash[24745]: cluster 2024-09-14T01:15:33.182754+0000 mgr.a (mgr.14355) 7554 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:34 smithi171 bash[25040]: cluster 2024-09-14T01:15:33.182754+0000 mgr.a (mgr.14355) 7554 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:35.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:35.613 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:36.369 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:36.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:36.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:36 smithi007 bash[22722]: cluster 2024-09-14T01:15:35.183642+0000 mgr.a (mgr.14355) 7555 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:36 smithi131 bash[24745]: cluster 2024-09-14T01:15:35.183642+0000 mgr.a (mgr.14355) 7555 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:36 smithi171 bash[25040]: cluster 2024-09-14T01:15:35.183642+0000 mgr.a (mgr.14355) 7555 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:37.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:37 smithi007 bash[22722]: audit 2024-09-14T01:15:35.942097+0000 mgr.a (mgr.14355) 7556 : audit [DBG] from='client.170595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:37 smithi131 bash[24745]: audit 2024-09-14T01:15:35.942097+0000 mgr.a (mgr.14355) 7556 : audit [DBG] from='client.170595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:37 smithi171 bash[25040]: audit 2024-09-14T01:15:35.942097+0000 mgr.a (mgr.14355) 7556 : audit [DBG] from='client.170595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:38 smithi007 bash[22722]: cluster 2024-09-14T01:15:37.186465+0000 mgr.a (mgr.14355) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:38 smithi131 bash[24745]: cluster 2024-09-14T01:15:37.186465+0000 mgr.a (mgr.14355) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:38 smithi171 bash[25040]: cluster 2024-09-14T01:15:37.186465+0000 mgr.a (mgr.14355) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:40 smithi007 bash[22722]: cluster 2024-09-14T01:15:39.187174+0000 mgr.a (mgr.14355) 7558 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:40 smithi131 bash[24745]: cluster 2024-09-14T01:15:39.187174+0000 mgr.a (mgr.14355) 7558 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:40 smithi171 bash[25040]: cluster 2024-09-14T01:15:39.187174+0000 mgr.a (mgr.14355) 7558 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:15:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:42.154 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:42 smithi007 bash[22722]: cluster 2024-09-14T01:15:41.189233+0000 mgr.a (mgr.14355) 7559 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:42 smithi131 bash[24745]: cluster 2024-09-14T01:15:41.189233+0000 mgr.a (mgr.14355) 7559 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:42 smithi171 bash[25040]: cluster 2024-09-14T01:15:41.189233+0000 mgr.a (mgr.14355) 7559 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:43.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:43 smithi007 bash[22722]: audit 2024-09-14T01:15:41.702753+0000 mgr.a (mgr.14355) 7560 : audit [DBG] from='client.170673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:43 smithi131 bash[24745]: audit 2024-09-14T01:15:41.702753+0000 mgr.a (mgr.14355) 7560 : audit [DBG] from='client.170673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:43 smithi171 bash[25040]: audit 2024-09-14T01:15:41.702753+0000 mgr.a (mgr.14355) 7560 : audit [DBG] from='client.170673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:44.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:44 smithi007 bash[22722]: cluster 2024-09-14T01:15:43.190177+0000 mgr.a (mgr.14355) 7561 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:44 smithi131 bash[24745]: cluster 2024-09-14T01:15:43.190177+0000 mgr.a (mgr.14355) 7561 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:44 smithi171 bash[25040]: cluster 2024-09-14T01:15:43.190177+0000 mgr.a (mgr.14355) 7561 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:46.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:46 smithi007 bash[22722]: cluster 2024-09-14T01:15:45.190931+0000 mgr.a (mgr.14355) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:46 smithi131 bash[24745]: cluster 2024-09-14T01:15:45.190931+0000 mgr.a (mgr.14355) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:46 smithi171 bash[25040]: cluster 2024-09-14T01:15:45.190931+0000 mgr.a (mgr.14355) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:47.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:47.953 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:47.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:47.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:47.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:47.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:48 smithi007 bash[22722]: cluster 2024-09-14T01:15:47.193022+0000 mgr.a (mgr.14355) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:48 smithi131 bash[24745]: cluster 2024-09-14T01:15:47.193022+0000 mgr.a (mgr.14355) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:48 smithi171 bash[25040]: cluster 2024-09-14T01:15:47.193022+0000 mgr.a (mgr.14355) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:49 smithi007 bash[22722]: audit 2024-09-14T01:15:47.496534+0000 mgr.a (mgr.14355) 7564 : audit [DBG] from='client.170751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:49 smithi131 bash[24745]: audit 2024-09-14T01:15:47.496534+0000 mgr.a (mgr.14355) 7564 : audit [DBG] from='client.170751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:49 smithi171 bash[25040]: audit 2024-09-14T01:15:47.496534+0000 mgr.a (mgr.14355) 7564 : audit [DBG] from='client.170751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:50.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:50 smithi007 bash[22722]: cluster 2024-09-14T01:15:49.193945+0000 mgr.a (mgr.14355) 7565 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:50 smithi131 bash[24745]: cluster 2024-09-14T01:15:49.193945+0000 mgr.a (mgr.14355) 7565 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:50 smithi171 bash[25040]: cluster 2024-09-14T01:15:49.193945+0000 mgr.a (mgr.14355) 7565 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:52 smithi007 bash[22722]: cluster 2024-09-14T01:15:51.196213+0000 mgr.a (mgr.14355) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:52 smithi131 bash[24745]: cluster 2024-09-14T01:15:51.196213+0000 mgr.a (mgr.14355) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:52 smithi171 bash[25040]: cluster 2024-09-14T01:15:51.196213+0000 mgr.a (mgr.14355) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:52.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:52.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:53.738 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:53.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:53.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:15:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:54 smithi007 bash[22722]: cluster 2024-09-14T01:15:53.196988+0000 mgr.a (mgr.14355) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:54 smithi007 bash[22722]: audit 2024-09-14T01:15:53.291207+0000 mgr.a (mgr.14355) 7568 : audit [DBG] from='client.170826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:54 smithi131 bash[24745]: cluster 2024-09-14T01:15:53.196988+0000 mgr.a (mgr.14355) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:54 smithi131 bash[24745]: audit 2024-09-14T01:15:53.291207+0000 mgr.a (mgr.14355) 7568 : audit [DBG] from='client.170826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:54 smithi171 bash[25040]: cluster 2024-09-14T01:15:53.196988+0000 mgr.a (mgr.14355) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:54 smithi171 bash[25040]: audit 2024-09-14T01:15:53.291207+0000 mgr.a (mgr.14355) 7568 : audit [DBG] from='client.170826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:15:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: cluster 2024-09-14T01:15:55.197900+0000 mgr.a (mgr.14355) 7569 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: audit 2024-09-14T01:15:55.480355+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:15:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: audit 2024-09-14T01:15:56.321970+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:15:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: audit 2024-09-14T01:15:56.323771+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:15:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: audit 2024-09-14T01:15:56.332089+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:15:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:56 smithi007 bash[22722]: audit 2024-09-14T01:15:56.337393+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: cluster 2024-09-14T01:15:55.197900+0000 mgr.a (mgr.14355) 7569 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: audit 2024-09-14T01:15:55.480355+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:15:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: audit 2024-09-14T01:15:56.321970+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:15:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: audit 2024-09-14T01:15:56.323771+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:15:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: audit 2024-09-14T01:15:56.332089+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:15:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:56 smithi131 bash[24745]: audit 2024-09-14T01:15:56.337393+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: cluster 2024-09-14T01:15:55.197900+0000 mgr.a (mgr.14355) 7569 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:15:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: audit 2024-09-14T01:15:55.480355+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:15:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: audit 2024-09-14T01:15:56.321970+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:15:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: audit 2024-09-14T01:15:56.323771+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:15:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: audit 2024-09-14T01:15:56.332089+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:15:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:56 smithi171 bash[25040]: audit 2024-09-14T01:15:56.337393+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:57.404 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:15:57 smithi007 bash[22972]: debug 2024-09-14T01:15:57.063+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:15:57.404 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:15:57 smithi007 bash[22972]: debug 2024-09-14T01:15:57.063+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:15:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:57 smithi007 bash[22722]: audit 2024-09-14T01:15:56.338452+0000 mgr.a (mgr.14355) 7570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:57 smithi131 bash[24745]: audit 2024-09-14T01:15:56.338452+0000 mgr.a (mgr.14355) 7570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:57 smithi171 bash[25040]: audit 2024-09-14T01:15:56.338452+0000 mgr.a (mgr.14355) 7570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:15:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:58 smithi007 bash[22722]: audit 2024-09-14T01:15:57.067398+0000 mgr.a (mgr.14355) 7571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:15:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:58 smithi007 bash[22722]: cephadm 2024-09-14T01:15:57.068553+0000 mgr.a (mgr.14355) 7572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:15:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:15:58 smithi007 bash[22722]: cluster 2024-09-14T01:15:57.200654+0000 mgr.a (mgr.14355) 7573 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:58.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:15:58.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:15:58.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:15:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:58 smithi131 bash[24745]: audit 2024-09-14T01:15:57.067398+0000 mgr.a (mgr.14355) 7571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:15:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:58 smithi131 bash[24745]: cephadm 2024-09-14T01:15:57.068553+0000 mgr.a (mgr.14355) 7572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:15:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:15:58 smithi131 bash[24745]: cluster 2024-09-14T01:15:57.200654+0000 mgr.a (mgr.14355) 7573 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:58 smithi171 bash[25040]: audit 2024-09-14T01:15:57.067398+0000 mgr.a (mgr.14355) 7571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:15:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:58 smithi171 bash[25040]: cephadm 2024-09-14T01:15:57.068553+0000 mgr.a (mgr.14355) 7572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:15:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:15:58 smithi171 bash[25040]: cluster 2024-09-14T01:15:57.200654+0000 mgr.a (mgr.14355) 7573 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:15:59.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:15:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:15:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:15:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:15:59.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:00 smithi007 bash[22722]: audit 2024-09-14T01:15:59.069548+0000 mgr.a (mgr.14355) 7574 : audit [DBG] from='client.171012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:00 smithi007 bash[22722]: cluster 2024-09-14T01:15:59.201250+0000 mgr.a (mgr.14355) 7575 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:00 smithi131 bash[24745]: audit 2024-09-14T01:15:59.069548+0000 mgr.a (mgr.14355) 7574 : audit [DBG] from='client.171012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:00 smithi131 bash[24745]: cluster 2024-09-14T01:15:59.201250+0000 mgr.a (mgr.14355) 7575 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:00 smithi171 bash[25040]: audit 2024-09-14T01:15:59.069548+0000 mgr.a (mgr.14355) 7574 : audit [DBG] from='client.171012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:00 smithi171 bash[25040]: cluster 2024-09-14T01:15:59.201250+0000 mgr.a (mgr.14355) 7575 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:02 smithi007 bash[22722]: cluster 2024-09-14T01:16:01.203603+0000 mgr.a (mgr.14355) 7576 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:02 smithi131 bash[24745]: cluster 2024-09-14T01:16:01.203603+0000 mgr.a (mgr.14355) 7576 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:02 smithi171 bash[25040]: cluster 2024-09-14T01:16:01.203603+0000 mgr.a (mgr.14355) 7576 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:04.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:04.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:04 smithi007 bash[22722]: cluster 2024-09-14T01:16:03.204398+0000 mgr.a (mgr.14355) 7577 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:04 smithi131 bash[24745]: cluster 2024-09-14T01:16:03.204398+0000 mgr.a (mgr.14355) 7577 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:04 smithi171 bash[25040]: cluster 2024-09-14T01:16:03.204398+0000 mgr.a (mgr.14355) 7577 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:05.237 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:06 smithi007 bash[22722]: audit 2024-09-14T01:16:04.817082+0000 mgr.a (mgr.14355) 7578 : audit [DBG] from='client.171090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:06 smithi007 bash[22722]: cluster 2024-09-14T01:16:05.204925+0000 mgr.a (mgr.14355) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:06 smithi131 bash[24745]: audit 2024-09-14T01:16:04.817082+0000 mgr.a (mgr.14355) 7578 : audit [DBG] from='client.171090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:06 smithi131 bash[24745]: cluster 2024-09-14T01:16:05.204925+0000 mgr.a (mgr.14355) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:06 smithi171 bash[25040]: audit 2024-09-14T01:16:04.817082+0000 mgr.a (mgr.14355) 7578 : audit [DBG] from='client.171090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:06 smithi171 bash[25040]: cluster 2024-09-14T01:16:05.204925+0000 mgr.a (mgr.14355) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:08 smithi007 bash[22722]: cluster 2024-09-14T01:16:07.207117+0000 mgr.a (mgr.14355) 7580 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:08 smithi131 bash[24745]: cluster 2024-09-14T01:16:07.207117+0000 mgr.a (mgr.14355) 7580 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:08 smithi171 bash[25040]: cluster 2024-09-14T01:16:07.207117+0000 mgr.a (mgr.14355) 7580 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:10.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:10.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:10.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:10 smithi007 bash[22722]: cluster 2024-09-14T01:16:09.207910+0000 mgr.a (mgr.14355) 7581 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:10 smithi131 bash[24745]: cluster 2024-09-14T01:16:09.207910+0000 mgr.a (mgr.14355) 7581 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:10 smithi171 bash[25040]: cluster 2024-09-14T01:16:09.207910+0000 mgr.a (mgr.14355) 7581 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:11.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:11.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:11.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:11.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:11.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:12 smithi007 bash[22722]: audit 2024-09-14T01:16:10.576089+0000 mgr.a (mgr.14355) 7582 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:12 smithi007 bash[22722]: cluster 2024-09-14T01:16:11.210785+0000 mgr.a (mgr.14355) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:12 smithi131 bash[24745]: audit 2024-09-14T01:16:10.576089+0000 mgr.a (mgr.14355) 7582 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:12 smithi131 bash[24745]: cluster 2024-09-14T01:16:11.210785+0000 mgr.a (mgr.14355) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:12 smithi171 bash[25040]: audit 2024-09-14T01:16:10.576089+0000 mgr.a (mgr.14355) 7582 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:12 smithi171 bash[25040]: cluster 2024-09-14T01:16:11.210785+0000 mgr.a (mgr.14355) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:16:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:14 smithi007 bash[22722]: cluster 2024-09-14T01:16:13.211717+0000 mgr.a (mgr.14355) 7584 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:14 smithi131 bash[24745]: cluster 2024-09-14T01:16:13.211717+0000 mgr.a (mgr.14355) 7584 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:14 smithi171 bash[25040]: cluster 2024-09-14T01:16:13.211717+0000 mgr.a (mgr.14355) 7584 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:16.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:16.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:16.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:16 smithi007 bash[22722]: cluster 2024-09-14T01:16:15.212510+0000 mgr.a (mgr.14355) 7585 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:16 smithi131 bash[24745]: cluster 2024-09-14T01:16:15.212510+0000 mgr.a (mgr.14355) 7585 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:16 smithi171 bash[25040]: cluster 2024-09-14T01:16:15.212510+0000 mgr.a (mgr.14355) 7585 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:16.802 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:16.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:17.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:17 smithi007 bash[22722]: audit 2024-09-14T01:16:16.356718+0000 mgr.a (mgr.14355) 7586 : audit [DBG] from='client.171240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:17 smithi131 bash[24745]: audit 2024-09-14T01:16:16.356718+0000 mgr.a (mgr.14355) 7586 : audit [DBG] from='client.171240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:17 smithi171 bash[25040]: audit 2024-09-14T01:16:16.356718+0000 mgr.a (mgr.14355) 7586 : audit [DBG] from='client.171240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:18 smithi131 bash[24745]: cluster 2024-09-14T01:16:17.215265+0000 mgr.a (mgr.14355) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:18 smithi171 bash[25040]: cluster 2024-09-14T01:16:17.215265+0000 mgr.a (mgr.14355) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:18.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:18 smithi007 bash[22722]: cluster 2024-09-14T01:16:17.215265+0000 mgr.a (mgr.14355) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:20 smithi131 bash[24745]: cluster 2024-09-14T01:16:19.216023+0000 mgr.a (mgr.14355) 7588 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:20 smithi171 bash[25040]: cluster 2024-09-14T01:16:19.216023+0000 mgr.a (mgr.14355) 7588 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:20 smithi007 bash[22722]: cluster 2024-09-14T01:16:19.216023+0000 mgr.a (mgr.14355) 7588 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:21.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:22.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:22.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:22.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:22.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:22 smithi131 bash[24745]: cluster 2024-09-14T01:16:21.218020+0000 mgr.a (mgr.14355) 7589 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:22 smithi171 bash[25040]: cluster 2024-09-14T01:16:21.218020+0000 mgr.a (mgr.14355) 7589 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:22 smithi007 bash[22722]: cluster 2024-09-14T01:16:21.218020+0000 mgr.a (mgr.14355) 7589 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:23 smithi131 bash[24745]: audit 2024-09-14T01:16:22.136497+0000 mgr.a (mgr.14355) 7590 : audit [DBG] from='client.171315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:23 smithi171 bash[25040]: audit 2024-09-14T01:16:22.136497+0000 mgr.a (mgr.14355) 7590 : audit [DBG] from='client.171315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:23 smithi007 bash[22722]: audit 2024-09-14T01:16:22.136497+0000 mgr.a (mgr.14355) 7590 : audit [DBG] from='client.171315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:24 smithi131 bash[24745]: cluster 2024-09-14T01:16:23.218967+0000 mgr.a (mgr.14355) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:24 smithi171 bash[25040]: cluster 2024-09-14T01:16:23.218967+0000 mgr.a (mgr.14355) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:24 smithi007 bash[22722]: cluster 2024-09-14T01:16:23.218967+0000 mgr.a (mgr.14355) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:25 smithi131 bash[24745]: cluster 2024-09-14T01:16:25.219733+0000 mgr.a (mgr.14355) 7592 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:25 smithi171 bash[25040]: cluster 2024-09-14T01:16:25.219733+0000 mgr.a (mgr.14355) 7592 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:25 smithi007 bash[22722]: cluster 2024-09-14T01:16:25.219733+0000 mgr.a (mgr.14355) 7592 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:28.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:28 smithi131 bash[24745]: cluster 2024-09-14T01:16:27.221979+0000 mgr.a (mgr.14355) 7593 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:28 smithi171 bash[25040]: cluster 2024-09-14T01:16:27.221979+0000 mgr.a (mgr.14355) 7593 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:28.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:28 smithi007 bash[22722]: cluster 2024-09-14T01:16:27.221979+0000 mgr.a (mgr.14355) 7593 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:29 smithi171 bash[25040]: audit 2024-09-14T01:16:27.893504+0000 mgr.a (mgr.14355) 7594 : audit [DBG] from='client.171390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:29 smithi007 bash[22722]: audit 2024-09-14T01:16:27.893504+0000 mgr.a (mgr.14355) 7594 : audit [DBG] from='client.171390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:29 smithi131 bash[24745]: audit 2024-09-14T01:16:27.893504+0000 mgr.a (mgr.14355) 7594 : audit [DBG] from='client.171390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:30 smithi171 bash[25040]: cluster 2024-09-14T01:16:29.222866+0000 mgr.a (mgr.14355) 7595 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:30 smithi007 bash[22722]: cluster 2024-09-14T01:16:29.222866+0000 mgr.a (mgr.14355) 7595 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:30 smithi131 bash[24745]: cluster 2024-09-14T01:16:29.222866+0000 mgr.a (mgr.14355) 7595 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:32 smithi171 bash[25040]: cluster 2024-09-14T01:16:31.225151+0000 mgr.a (mgr.14355) 7596 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:32.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:32 smithi007 bash[22722]: cluster 2024-09-14T01:16:31.225151+0000 mgr.a (mgr.14355) 7596 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:32 smithi131 bash[24745]: cluster 2024-09-14T01:16:31.225151+0000 mgr.a (mgr.14355) 7596 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:33.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:33.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:34.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:34 smithi007 bash[22722]: cluster 2024-09-14T01:16:33.225940+0000 mgr.a (mgr.14355) 7597 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:34 smithi131 bash[24745]: cluster 2024-09-14T01:16:33.225940+0000 mgr.a (mgr.14355) 7597 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:34 smithi171 bash[25040]: cluster 2024-09-14T01:16:33.225940+0000 mgr.a (mgr.14355) 7597 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:35.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:35 smithi007 bash[22722]: audit 2024-09-14T01:16:33.638782+0000 mgr.a (mgr.14355) 7598 : audit [DBG] from='client.171462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:35 smithi131 bash[24745]: audit 2024-09-14T01:16:33.638782+0000 mgr.a (mgr.14355) 7598 : audit [DBG] from='client.171462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:35 smithi171 bash[25040]: audit 2024-09-14T01:16:33.638782+0000 mgr.a (mgr.14355) 7598 : audit [DBG] from='client.171462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:36 smithi007 bash[22722]: cluster 2024-09-14T01:16:35.226855+0000 mgr.a (mgr.14355) 7599 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:36 smithi131 bash[24745]: cluster 2024-09-14T01:16:35.226855+0000 mgr.a (mgr.14355) 7599 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:36 smithi171 bash[25040]: cluster 2024-09-14T01:16:35.226855+0000 mgr.a (mgr.14355) 7599 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:38 smithi007 bash[22722]: cluster 2024-09-14T01:16:37.229095+0000 mgr.a (mgr.14355) 7600 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:38 smithi131 bash[24745]: cluster 2024-09-14T01:16:37.229095+0000 mgr.a (mgr.14355) 7600 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:38 smithi171 bash[25040]: cluster 2024-09-14T01:16:37.229095+0000 mgr.a (mgr.14355) 7600 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:39.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:39.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:39.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:39.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:39.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:39.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:39.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:39.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:40 smithi007 bash[22722]: cluster 2024-09-14T01:16:39.229543+0000 mgr.a (mgr.14355) 7601 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:40 smithi007 bash[22722]: audit 2024-09-14T01:16:39.412296+0000 mgr.a (mgr.14355) 7602 : audit [DBG] from='client.171537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:40 smithi131 bash[24745]: cluster 2024-09-14T01:16:39.229543+0000 mgr.a (mgr.14355) 7601 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:40 smithi131 bash[24745]: audit 2024-09-14T01:16:39.412296+0000 mgr.a (mgr.14355) 7602 : audit [DBG] from='client.171537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:40 smithi171 bash[25040]: cluster 2024-09-14T01:16:39.229543+0000 mgr.a (mgr.14355) 7601 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:40 smithi171 bash[25040]: audit 2024-09-14T01:16:39.412296+0000 mgr.a (mgr.14355) 7602 : audit [DBG] from='client.171537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:42 smithi007 bash[22722]: cluster 2024-09-14T01:16:41.231866+0000 mgr.a (mgr.14355) 7603 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:42 smithi131 bash[24745]: cluster 2024-09-14T01:16:41.231866+0000 mgr.a (mgr.14355) 7603 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:42 smithi171 bash[25040]: cluster 2024-09-14T01:16:41.231866+0000 mgr.a (mgr.14355) 7603 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:16:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:44 smithi007 bash[22722]: cluster 2024-09-14T01:16:43.232653+0000 mgr.a (mgr.14355) 7604 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:44 smithi131 bash[24745]: cluster 2024-09-14T01:16:43.232653+0000 mgr.a (mgr.14355) 7604 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:44 smithi171 bash[25040]: cluster 2024-09-14T01:16:43.232653+0000 mgr.a (mgr.14355) 7604 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:44.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:44.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:44.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:45.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:45.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:46 smithi007 bash[22722]: audit 2024-09-14T01:16:45.209719+0000 mgr.a (mgr.14355) 7605 : audit [DBG] from='client.171615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:46 smithi007 bash[22722]: cluster 2024-09-14T01:16:45.233638+0000 mgr.a (mgr.14355) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:46 smithi131 bash[24745]: audit 2024-09-14T01:16:45.209719+0000 mgr.a (mgr.14355) 7605 : audit [DBG] from='client.171615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:46 smithi131 bash[24745]: cluster 2024-09-14T01:16:45.233638+0000 mgr.a (mgr.14355) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:46 smithi171 bash[25040]: audit 2024-09-14T01:16:45.209719+0000 mgr.a (mgr.14355) 7605 : audit [DBG] from='client.171615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:46 smithi171 bash[25040]: cluster 2024-09-14T01:16:45.233638+0000 mgr.a (mgr.14355) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:48 smithi007 bash[22722]: cluster 2024-09-14T01:16:47.236439+0000 mgr.a (mgr.14355) 7607 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:48 smithi131 bash[24745]: cluster 2024-09-14T01:16:47.236439+0000 mgr.a (mgr.14355) 7607 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:48 smithi171 bash[25040]: cluster 2024-09-14T01:16:47.236439+0000 mgr.a (mgr.14355) 7607 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:50.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:50.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:50.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:50 smithi007 bash[22722]: cluster 2024-09-14T01:16:49.237195+0000 mgr.a (mgr.14355) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:50 smithi131 bash[24745]: cluster 2024-09-14T01:16:49.237195+0000 mgr.a (mgr.14355) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:50 smithi171 bash[25040]: cluster 2024-09-14T01:16:49.237195+0000 mgr.a (mgr.14355) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:51.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:51.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:52 smithi007 bash[22722]: audit 2024-09-14T01:16:50.983991+0000 mgr.a (mgr.14355) 7609 : audit [DBG] from='client.171693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:52 smithi007 bash[22722]: cluster 2024-09-14T01:16:51.238559+0000 mgr.a (mgr.14355) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:52 smithi131 bash[24745]: audit 2024-09-14T01:16:50.983991+0000 mgr.a (mgr.14355) 7609 : audit [DBG] from='client.171693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:52 smithi131 bash[24745]: cluster 2024-09-14T01:16:51.238559+0000 mgr.a (mgr.14355) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:52 smithi171 bash[25040]: audit 2024-09-14T01:16:50.983991+0000 mgr.a (mgr.14355) 7609 : audit [DBG] from='client.171693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:52 smithi171 bash[25040]: cluster 2024-09-14T01:16:51.238559+0000 mgr.a (mgr.14355) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:54 smithi007 bash[22722]: cluster 2024-09-14T01:16:53.239394+0000 mgr.a (mgr.14355) 7611 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:54 smithi131 bash[24745]: cluster 2024-09-14T01:16:53.239394+0000 mgr.a (mgr.14355) 7611 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:54 smithi171 bash[25040]: cluster 2024-09-14T01:16:53.239394+0000 mgr.a (mgr.14355) 7611 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:16:56.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:16:56.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:16:56.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:16:56.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:56 smithi007 bash[22722]: cluster 2024-09-14T01:16:55.240170+0000 mgr.a (mgr.14355) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:56 smithi131 bash[24745]: cluster 2024-09-14T01:16:55.240170+0000 mgr.a (mgr.14355) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:56 smithi171 bash[25040]: cluster 2024-09-14T01:16:55.240170+0000 mgr.a (mgr.14355) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:16:57.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:16:57.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:16:57.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:16:57.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:16:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:57 smithi007 bash[22722]: audit 2024-09-14T01:16:57.119369+0000 mon.a (mon.0) 1734 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:16:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:57 smithi131 bash[24745]: audit 2024-09-14T01:16:57.119369+0000 mon.a (mon.0) 1734 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:16:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:57 smithi171 bash[25040]: audit 2024-09-14T01:16:57.119369+0000 mon.a (mon.0) 1734 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:16:58.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: audit 2024-09-14T01:16:56.759487+0000 mgr.a (mgr.14355) 7613 : audit [DBG] from='client.171771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:58.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: cluster 2024-09-14T01:16:57.241440+0000 mgr.a (mgr.14355) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:58.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: audit 2024-09-14T01:16:57.898913+0000 mon.a (mon.0) 1735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:16:58.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: audit 2024-09-14T01:16:57.900360+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:16:58.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: audit 2024-09-14T01:16:57.910325+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:16:58.646 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22722]: audit 2024-09-14T01:16:57.913162+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:16:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: audit 2024-09-14T01:16:56.759487+0000 mgr.a (mgr.14355) 7613 : audit [DBG] from='client.171771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: cluster 2024-09-14T01:16:57.241440+0000 mgr.a (mgr.14355) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: audit 2024-09-14T01:16:57.898913+0000 mon.a (mon.0) 1735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:16:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: audit 2024-09-14T01:16:57.900360+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:16:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: audit 2024-09-14T01:16:57.910325+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:16:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:58 smithi131 bash[24745]: audit 2024-09-14T01:16:57.913162+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:16:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: audit 2024-09-14T01:16:56.759487+0000 mgr.a (mgr.14355) 7613 : audit [DBG] from='client.171771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:16:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: cluster 2024-09-14T01:16:57.241440+0000 mgr.a (mgr.14355) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:16:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: audit 2024-09-14T01:16:57.898913+0000 mon.a (mon.0) 1735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:16:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: audit 2024-09-14T01:16:57.900360+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:16:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: audit 2024-09-14T01:16:57.910325+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:16:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:58 smithi171 bash[25040]: audit 2024-09-14T01:16:57.913162+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:16:58.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22972]: debug 2024-09-14T01:16:58.638+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:16:58.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:16:58 smithi007 bash[22972]: debug 2024-09-14T01:16:58.642+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:16:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:16:59 smithi007 bash[22722]: audit 2024-09-14T01:16:57.915510+0000 mgr.a (mgr.14355) 7615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:16:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:16:59 smithi131 bash[24745]: audit 2024-09-14T01:16:57.915510+0000 mgr.a (mgr.14355) 7615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:16:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:16:59 smithi171 bash[25040]: audit 2024-09-14T01:16:57.915510+0000 mgr.a (mgr.14355) 7615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:17:00.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:00 smithi007 bash[22722]: audit 2024-09-14T01:16:58.645311+0000 mgr.a (mgr.14355) 7616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:17:00.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:00 smithi007 bash[22722]: cephadm 2024-09-14T01:16:58.647026+0000 mgr.a (mgr.14355) 7617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:17:00.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:00 smithi007 bash[22722]: cluster 2024-09-14T01:16:59.242314+0000 mgr.a (mgr.14355) 7618 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:00 smithi131 bash[24745]: audit 2024-09-14T01:16:58.645311+0000 mgr.a (mgr.14355) 7616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:17:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:00 smithi131 bash[24745]: cephadm 2024-09-14T01:16:58.647026+0000 mgr.a (mgr.14355) 7617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:17:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:00 smithi131 bash[24745]: cluster 2024-09-14T01:16:59.242314+0000 mgr.a (mgr.14355) 7618 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:00 smithi171 bash[25040]: audit 2024-09-14T01:16:58.645311+0000 mgr.a (mgr.14355) 7616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:17:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:00 smithi171 bash[25040]: cephadm 2024-09-14T01:16:58.647026+0000 mgr.a (mgr.14355) 7617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:17:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:00 smithi171 bash[25040]: cluster 2024-09-14T01:16:59.242314+0000 mgr.a (mgr.14355) 7618 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:02.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:02.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:02.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:02.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:02 smithi007 bash[22722]: cluster 2024-09-14T01:17:01.244680+0000 mgr.a (mgr.14355) 7619 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:02 smithi131 bash[24745]: cluster 2024-09-14T01:17:01.244680+0000 mgr.a (mgr.14355) 7619 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:02 smithi171 bash[25040]: cluster 2024-09-14T01:17:01.244680+0000 mgr.a (mgr.14355) 7619 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:02.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:04 smithi007 bash[22722]: audit 2024-09-14T01:17:02.545752+0000 mgr.a (mgr.14355) 7620 : audit [DBG] from='client.171957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:04 smithi007 bash[22722]: cluster 2024-09-14T01:17:03.245719+0000 mgr.a (mgr.14355) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:04 smithi131 bash[24745]: audit 2024-09-14T01:17:02.545752+0000 mgr.a (mgr.14355) 7620 : audit [DBG] from='client.171957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:04 smithi131 bash[24745]: cluster 2024-09-14T01:17:03.245719+0000 mgr.a (mgr.14355) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:04 smithi171 bash[25040]: audit 2024-09-14T01:17:02.545752+0000 mgr.a (mgr.14355) 7620 : audit [DBG] from='client.171957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:04 smithi171 bash[25040]: cluster 2024-09-14T01:17:03.245719+0000 mgr.a (mgr.14355) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:06 smithi007 bash[22722]: cluster 2024-09-14T01:17:05.246723+0000 mgr.a (mgr.14355) 7622 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:06 smithi131 bash[24745]: cluster 2024-09-14T01:17:05.246723+0000 mgr.a (mgr.14355) 7622 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:06 smithi171 bash[25040]: cluster 2024-09-14T01:17:05.246723+0000 mgr.a (mgr.14355) 7622 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:07.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:07.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:08 smithi007 bash[22722]: cluster 2024-09-14T01:17:07.249093+0000 mgr.a (mgr.14355) 7623 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:08.722 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:08.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:08.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:08 smithi131 bash[24745]: cluster 2024-09-14T01:17:07.249093+0000 mgr.a (mgr.14355) 7623 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:08 smithi171 bash[25040]: cluster 2024-09-14T01:17:07.249093+0000 mgr.a (mgr.14355) 7623 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:09 smithi007 bash[22722]: audit 2024-09-14T01:17:08.311404+0000 mgr.a (mgr.14355) 7624 : audit [DBG] from='client.172035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:09 smithi131 bash[24745]: audit 2024-09-14T01:17:08.311404+0000 mgr.a (mgr.14355) 7624 : audit [DBG] from='client.172035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:09 smithi171 bash[25040]: audit 2024-09-14T01:17:08.311404+0000 mgr.a (mgr.14355) 7624 : audit [DBG] from='client.172035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:10 smithi007 bash[22722]: cluster 2024-09-14T01:17:09.250114+0000 mgr.a (mgr.14355) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:10 smithi131 bash[24745]: cluster 2024-09-14T01:17:09.250114+0000 mgr.a (mgr.14355) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:10 smithi171 bash[25040]: cluster 2024-09-14T01:17:09.250114+0000 mgr.a (mgr.14355) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:12 smithi007 bash[22722]: cluster 2024-09-14T01:17:11.252422+0000 mgr.a (mgr.14355) 7626 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:12 smithi131 bash[24745]: cluster 2024-09-14T01:17:11.252422+0000 mgr.a (mgr.14355) 7626 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:12 smithi171 bash[25040]: cluster 2024-09-14T01:17:11.252422+0000 mgr.a (mgr.14355) 7626 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:17:13.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:13.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:13.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:14.506 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:14 smithi007 bash[22722]: cluster 2024-09-14T01:17:13.253200+0000 mgr.a (mgr.14355) 7627 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:14 smithi131 bash[24745]: cluster 2024-09-14T01:17:13.253200+0000 mgr.a (mgr.14355) 7627 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:14 smithi171 bash[25040]: cluster 2024-09-14T01:17:13.253200+0000 mgr.a (mgr.14355) 7627 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:15 smithi007 bash[22722]: audit 2024-09-14T01:17:14.059822+0000 mgr.a (mgr.14355) 7628 : audit [DBG] from='client.172113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:15 smithi131 bash[24745]: audit 2024-09-14T01:17:14.059822+0000 mgr.a (mgr.14355) 7628 : audit [DBG] from='client.172113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:15 smithi171 bash[25040]: audit 2024-09-14T01:17:14.059822+0000 mgr.a (mgr.14355) 7628 : audit [DBG] from='client.172113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:16.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:16 smithi007 bash[22722]: cluster 2024-09-14T01:17:15.254205+0000 mgr.a (mgr.14355) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:16 smithi131 bash[24745]: cluster 2024-09-14T01:17:15.254205+0000 mgr.a (mgr.14355) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:16 smithi171 bash[25040]: cluster 2024-09-14T01:17:15.254205+0000 mgr.a (mgr.14355) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:18 smithi007 bash[22722]: cluster 2024-09-14T01:17:17.256654+0000 mgr.a (mgr.14355) 7630 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:18 smithi131 bash[24745]: cluster 2024-09-14T01:17:17.256654+0000 mgr.a (mgr.14355) 7630 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:18 smithi171 bash[25040]: cluster 2024-09-14T01:17:17.256654+0000 mgr.a (mgr.14355) 7630 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:20.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:20.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:20 smithi007 bash[22722]: cluster 2024-09-14T01:17:19.257595+0000 mgr.a (mgr.14355) 7631 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:20 smithi131 bash[24745]: cluster 2024-09-14T01:17:19.257595+0000 mgr.a (mgr.14355) 7631 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:20 smithi171 bash[25040]: cluster 2024-09-14T01:17:19.257595+0000 mgr.a (mgr.14355) 7631 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:21.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:21 smithi007 bash[22722]: audit 2024-09-14T01:17:19.842878+0000 mgr.a (mgr.14355) 7632 : audit [DBG] from='client.172188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:21 smithi131 bash[24745]: audit 2024-09-14T01:17:19.842878+0000 mgr.a (mgr.14355) 7632 : audit [DBG] from='client.172188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:21 smithi171 bash[25040]: audit 2024-09-14T01:17:19.842878+0000 mgr.a (mgr.14355) 7632 : audit [DBG] from='client.172188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:22 smithi007 bash[22722]: cluster 2024-09-14T01:17:21.260041+0000 mgr.a (mgr.14355) 7633 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:22 smithi131 bash[24745]: cluster 2024-09-14T01:17:21.260041+0000 mgr.a (mgr.14355) 7633 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:22 smithi171 bash[25040]: cluster 2024-09-14T01:17:21.260041+0000 mgr.a (mgr.14355) 7633 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:24 smithi007 bash[22722]: cluster 2024-09-14T01:17:23.260832+0000 mgr.a (mgr.14355) 7634 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:24 smithi131 bash[24745]: cluster 2024-09-14T01:17:23.260832+0000 mgr.a (mgr.14355) 7634 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:24 smithi171 bash[25040]: cluster 2024-09-14T01:17:23.260832+0000 mgr.a (mgr.14355) 7634 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:25.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:26 smithi007 bash[22722]: cluster 2024-09-14T01:17:25.261572+0000 mgr.a (mgr.14355) 7635 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:26 smithi131 bash[24745]: cluster 2024-09-14T01:17:25.261572+0000 mgr.a (mgr.14355) 7635 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:26 smithi171 bash[25040]: cluster 2024-09-14T01:17:25.261572+0000 mgr.a (mgr.14355) 7635 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:27 smithi131 bash[24745]: audit 2024-09-14T01:17:25.605243+0000 mgr.a (mgr.14355) 7636 : audit [DBG] from='client.172266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:27 smithi171 bash[25040]: audit 2024-09-14T01:17:25.605243+0000 mgr.a (mgr.14355) 7636 : audit [DBG] from='client.172266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:27 smithi007 bash[22722]: audit 2024-09-14T01:17:25.605243+0000 mgr.a (mgr.14355) 7636 : audit [DBG] from='client.172266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:28 smithi131 bash[24745]: cluster 2024-09-14T01:17:27.264517+0000 mgr.a (mgr.14355) 7637 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:28 smithi171 bash[25040]: cluster 2024-09-14T01:17:27.264517+0000 mgr.a (mgr.14355) 7637 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:28 smithi007 bash[22722]: cluster 2024-09-14T01:17:27.264517+0000 mgr.a (mgr.14355) 7637 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:30 smithi131 bash[24745]: cluster 2024-09-14T01:17:29.265362+0000 mgr.a (mgr.14355) 7638 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:30 smithi171 bash[25040]: cluster 2024-09-14T01:17:29.265362+0000 mgr.a (mgr.14355) 7638 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:30 smithi007 bash[22722]: cluster 2024-09-14T01:17:29.265362+0000 mgr.a (mgr.14355) 7638 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:31.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:31.046 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:31.046 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:31.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:31.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:32 smithi131 bash[24745]: cluster 2024-09-14T01:17:31.266636+0000 mgr.a (mgr.14355) 7639 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:32 smithi131 bash[24745]: audit 2024-09-14T01:17:31.378512+0000 mgr.a (mgr.14355) 7640 : audit [DBG] from='client.172341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:32 smithi171 bash[25040]: cluster 2024-09-14T01:17:31.266636+0000 mgr.a (mgr.14355) 7639 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:32 smithi171 bash[25040]: audit 2024-09-14T01:17:31.378512+0000 mgr.a (mgr.14355) 7640 : audit [DBG] from='client.172341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:32 smithi007 bash[22722]: cluster 2024-09-14T01:17:31.266636+0000 mgr.a (mgr.14355) 7639 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:32 smithi007 bash[22722]: audit 2024-09-14T01:17:31.378512+0000 mgr.a (mgr.14355) 7640 : audit [DBG] from='client.172341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:34 smithi131 bash[24745]: cluster 2024-09-14T01:17:33.267682+0000 mgr.a (mgr.14355) 7641 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:34 smithi171 bash[25040]: cluster 2024-09-14T01:17:33.267682+0000 mgr.a (mgr.14355) 7641 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:34 smithi007 bash[22722]: cluster 2024-09-14T01:17:33.267682+0000 mgr.a (mgr.14355) 7641 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:17:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:36 smithi131 bash[24745]: cluster 2024-09-14T01:17:35.268497+0000 mgr.a (mgr.14355) 7642 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:17:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:36 smithi171 bash[25040]: cluster 2024-09-14T01:17:35.268497+0000 mgr.a (mgr.14355) 7642 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:17:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:36 smithi007 bash[22722]: cluster 2024-09-14T01:17:35.268497+0000 mgr.a (mgr.14355) 7642 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:17:37.538 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:37.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:37.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:37.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:37.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:38 smithi131 bash[24745]: audit 2024-09-14T01:17:37.126108+0000 mgr.a (mgr.14355) 7643 : audit [DBG] from='client.172419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:38 smithi131 bash[24745]: cluster 2024-09-14T01:17:37.269896+0000 mgr.a (mgr.14355) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:38 smithi171 bash[25040]: audit 2024-09-14T01:17:37.126108+0000 mgr.a (mgr.14355) 7643 : audit [DBG] from='client.172419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:38 smithi171 bash[25040]: cluster 2024-09-14T01:17:37.269896+0000 mgr.a (mgr.14355) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:38 smithi007 bash[22722]: audit 2024-09-14T01:17:37.126108+0000 mgr.a (mgr.14355) 7643 : audit [DBG] from='client.172419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:38 smithi007 bash[22722]: cluster 2024-09-14T01:17:37.269896+0000 mgr.a (mgr.14355) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:40 smithi131 bash[24745]: cluster 2024-09-14T01:17:39.270900+0000 mgr.a (mgr.14355) 7645 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:40 smithi171 bash[25040]: cluster 2024-09-14T01:17:39.270900+0000 mgr.a (mgr.14355) 7645 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:40 smithi007 bash[22722]: cluster 2024-09-14T01:17:39.270900+0000 mgr.a (mgr.14355) 7645 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:41 smithi171 bash[25040]: cluster 2024-09-14T01:17:41.273294+0000 mgr.a (mgr.14355) 7646 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:41 smithi007 bash[22722]: cluster 2024-09-14T01:17:41.273294+0000 mgr.a (mgr.14355) 7646 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:41 smithi131 bash[24745]: cluster 2024-09-14T01:17:41.273294+0000 mgr.a (mgr.14355) 7646 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:42.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:42.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:43.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:44 smithi007 bash[22722]: audit 2024-09-14T01:17:42.869737+0000 mgr.a (mgr.14355) 7647 : audit [DBG] from='client.172497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:44 smithi007 bash[22722]: cluster 2024-09-14T01:17:43.273804+0000 mgr.a (mgr.14355) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:44 smithi131 bash[24745]: audit 2024-09-14T01:17:42.869737+0000 mgr.a (mgr.14355) 7647 : audit [DBG] from='client.172497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:44 smithi131 bash[24745]: cluster 2024-09-14T01:17:43.273804+0000 mgr.a (mgr.14355) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:44 smithi171 bash[25040]: audit 2024-09-14T01:17:42.869737+0000 mgr.a (mgr.14355) 7647 : audit [DBG] from='client.172497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:44 smithi171 bash[25040]: cluster 2024-09-14T01:17:43.273804+0000 mgr.a (mgr.14355) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:46 smithi007 bash[22722]: cluster 2024-09-14T01:17:45.274558+0000 mgr.a (mgr.14355) 7649 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:46 smithi131 bash[24745]: cluster 2024-09-14T01:17:45.274558+0000 mgr.a (mgr.14355) 7649 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:46 smithi171 bash[25040]: cluster 2024-09-14T01:17:45.274558+0000 mgr.a (mgr.14355) 7649 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:48.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:48 smithi007 bash[22722]: cluster 2024-09-14T01:17:47.276769+0000 mgr.a (mgr.14355) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:48 smithi131 bash[24745]: cluster 2024-09-14T01:17:47.276769+0000 mgr.a (mgr.14355) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:48 smithi171 bash[25040]: cluster 2024-09-14T01:17:47.276769+0000 mgr.a (mgr.14355) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:49.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:49.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:49.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:49.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:49.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:50 smithi007 bash[22722]: audit 2024-09-14T01:17:48.618763+0000 mgr.a (mgr.14355) 7651 : audit [DBG] from='client.172572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:50 smithi007 bash[22722]: cluster 2024-09-14T01:17:49.277676+0000 mgr.a (mgr.14355) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:50 smithi131 bash[24745]: audit 2024-09-14T01:17:48.618763+0000 mgr.a (mgr.14355) 7651 : audit [DBG] from='client.172572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:50 smithi131 bash[24745]: cluster 2024-09-14T01:17:49.277676+0000 mgr.a (mgr.14355) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:50 smithi171 bash[25040]: audit 2024-09-14T01:17:48.618763+0000 mgr.a (mgr.14355) 7651 : audit [DBG] from='client.172572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:50 smithi171 bash[25040]: cluster 2024-09-14T01:17:49.277676+0000 mgr.a (mgr.14355) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:52 smithi007 bash[22722]: cluster 2024-09-14T01:17:51.279948+0000 mgr.a (mgr.14355) 7653 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:52 smithi131 bash[24745]: cluster 2024-09-14T01:17:51.279948+0000 mgr.a (mgr.14355) 7653 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:52 smithi171 bash[25040]: cluster 2024-09-14T01:17:51.279948+0000 mgr.a (mgr.14355) 7653 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:54.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:54.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:54.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:17:54.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:54 smithi007 bash[22722]: cluster 2024-09-14T01:17:53.280704+0000 mgr.a (mgr.14355) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:54 smithi131 bash[24745]: cluster 2024-09-14T01:17:53.280704+0000 mgr.a (mgr.14355) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:54 smithi171 bash[25040]: cluster 2024-09-14T01:17:53.280704+0000 mgr.a (mgr.14355) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:54.811 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:17:54.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:17:54.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:17:54.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:17:54.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:17:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:55 smithi007 bash[22722]: audit 2024-09-14T01:17:54.384538+0000 mgr.a (mgr.14355) 7655 : audit [DBG] from='client.172647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:55 smithi131 bash[24745]: audit 2024-09-14T01:17:54.384538+0000 mgr.a (mgr.14355) 7655 : audit [DBG] from='client.172647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:55 smithi171 bash[25040]: audit 2024-09-14T01:17:54.384538+0000 mgr.a (mgr.14355) 7655 : audit [DBG] from='client.172647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:17:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:56 smithi007 bash[22722]: cluster 2024-09-14T01:17:55.281563+0000 mgr.a (mgr.14355) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:56 smithi131 bash[24745]: cluster 2024-09-14T01:17:55.281563+0000 mgr.a (mgr.14355) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:56 smithi171 bash[25040]: cluster 2024-09-14T01:17:55.281563+0000 mgr.a (mgr.14355) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:17:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:58 smithi007 bash[22722]: cluster 2024-09-14T01:17:57.283910+0000 mgr.a (mgr.14355) 7657 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:58 smithi131 bash[24745]: cluster 2024-09-14T01:17:57.283910+0000 mgr.a (mgr.14355) 7657 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:58 smithi171 bash[25040]: cluster 2024-09-14T01:17:57.283910+0000 mgr.a (mgr.14355) 7657 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:17:59.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:17:59 smithi007 bash[22722]: audit 2024-09-14T01:17:58.702895+0000 mon.a (mon.0) 1739 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:17:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:17:59 smithi131 bash[24745]: audit 2024-09-14T01:17:58.702895+0000 mon.a (mon.0) 1739 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:17:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:17:59 smithi171 bash[25040]: audit 2024-09-14T01:17:58.702895+0000 mon.a (mon.0) 1739 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:17:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:17:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:17:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:00.694 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22972]: debug 2024-09-14T01:18:00.293+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22972]: debug 2024-09-14T01:18:00.305+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22722]: cluster 2024-09-14T01:17:59.284650+0000 mgr.a (mgr.14355) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22722]: audit 2024-09-14T01:17:59.528405+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22722]: audit 2024-09-14T01:17:59.530113+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:18:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22722]: audit 2024-09-14T01:17:59.540517+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:18:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:00 smithi007 bash[22722]: audit 2024-09-14T01:17:59.545455+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:00 smithi131 bash[24745]: cluster 2024-09-14T01:17:59.284650+0000 mgr.a (mgr.14355) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:00 smithi131 bash[24745]: audit 2024-09-14T01:17:59.528405+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:18:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:00 smithi131 bash[24745]: audit 2024-09-14T01:17:59.530113+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:18:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:00 smithi131 bash[24745]: audit 2024-09-14T01:17:59.540517+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:18:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:00 smithi131 bash[24745]: audit 2024-09-14T01:17:59.545455+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:00 smithi171 bash[25040]: cluster 2024-09-14T01:17:59.284650+0000 mgr.a (mgr.14355) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:00 smithi171 bash[25040]: audit 2024-09-14T01:17:59.528405+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:18:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:00 smithi171 bash[25040]: audit 2024-09-14T01:17:59.530113+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:18:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:00 smithi171 bash[25040]: audit 2024-09-14T01:17:59.540517+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:18:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:00 smithi171 bash[25040]: audit 2024-09-14T01:17:59.545455+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:01 smithi007 bash[22722]: audit 2024-09-14T01:17:59.546604+0000 mgr.a (mgr.14355) 7659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:01 smithi007 bash[22722]: audit 2024-09-14T01:18:00.162862+0000 mgr.a (mgr.14355) 7660 : audit [DBG] from='client.172779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:01 smithi007 bash[22722]: audit 2024-09-14T01:18:00.296964+0000 mgr.a (mgr.14355) 7661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:18:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:01 smithi007 bash[22722]: cephadm 2024-09-14T01:18:00.309915+0000 mgr.a (mgr.14355) 7662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:18:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:01 smithi131 bash[24745]: audit 2024-09-14T01:17:59.546604+0000 mgr.a (mgr.14355) 7659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:01 smithi131 bash[24745]: audit 2024-09-14T01:18:00.162862+0000 mgr.a (mgr.14355) 7660 : audit [DBG] from='client.172779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:01 smithi131 bash[24745]: audit 2024-09-14T01:18:00.296964+0000 mgr.a (mgr.14355) 7661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:18:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:01 smithi131 bash[24745]: cephadm 2024-09-14T01:18:00.309915+0000 mgr.a (mgr.14355) 7662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:18:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:01 smithi171 bash[25040]: audit 2024-09-14T01:17:59.546604+0000 mgr.a (mgr.14355) 7659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:18:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:01 smithi171 bash[25040]: audit 2024-09-14T01:18:00.162862+0000 mgr.a (mgr.14355) 7660 : audit [DBG] from='client.172779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:01 smithi171 bash[25040]: audit 2024-09-14T01:18:00.296964+0000 mgr.a (mgr.14355) 7661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:18:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:01 smithi171 bash[25040]: cephadm 2024-09-14T01:18:00.309915+0000 mgr.a (mgr.14355) 7662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:18:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:02 smithi007 bash[22722]: cluster 2024-09-14T01:18:01.287560+0000 mgr.a (mgr.14355) 7663 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:02 smithi131 bash[24745]: cluster 2024-09-14T01:18:01.287560+0000 mgr.a (mgr.14355) 7663 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:02 smithi171 bash[25040]: cluster 2024-09-14T01:18:01.287560+0000 mgr.a (mgr.14355) 7663 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:04 smithi007 bash[22722]: cluster 2024-09-14T01:18:03.288343+0000 mgr.a (mgr.14355) 7664 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:04 smithi131 bash[24745]: cluster 2024-09-14T01:18:03.288343+0000 mgr.a (mgr.14355) 7664 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:04 smithi171 bash[25040]: cluster 2024-09-14T01:18:03.288343+0000 mgr.a (mgr.14355) 7664 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:05.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:05.696 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:05.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:06.479 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:06.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:06.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:06.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:06.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:06 smithi007 bash[22722]: cluster 2024-09-14T01:18:05.289548+0000 mgr.a (mgr.14355) 7665 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:06 smithi131 bash[24745]: cluster 2024-09-14T01:18:05.289548+0000 mgr.a (mgr.14355) 7665 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:06 smithi171 bash[25040]: cluster 2024-09-14T01:18:05.289548+0000 mgr.a (mgr.14355) 7665 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:07 smithi007 bash[22722]: audit 2024-09-14T01:18:06.032755+0000 mgr.a (mgr.14355) 7666 : audit [DBG] from='client.172905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:07 smithi131 bash[24745]: audit 2024-09-14T01:18:06.032755+0000 mgr.a (mgr.14355) 7666 : audit [DBG] from='client.172905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:07 smithi171 bash[25040]: audit 2024-09-14T01:18:06.032755+0000 mgr.a (mgr.14355) 7666 : audit [DBG] from='client.172905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:08 smithi007 bash[22722]: cluster 2024-09-14T01:18:07.291904+0000 mgr.a (mgr.14355) 7667 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:08 smithi131 bash[24745]: cluster 2024-09-14T01:18:07.291904+0000 mgr.a (mgr.14355) 7667 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:08 smithi171 bash[25040]: cluster 2024-09-14T01:18:07.291904+0000 mgr.a (mgr.14355) 7667 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:10 smithi007 bash[22722]: cluster 2024-09-14T01:18:09.292700+0000 mgr.a (mgr.14355) 7668 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:10 smithi131 bash[24745]: cluster 2024-09-14T01:18:09.292700+0000 mgr.a (mgr.14355) 7668 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:10 smithi171 bash[25040]: cluster 2024-09-14T01:18:09.292700+0000 mgr.a (mgr.14355) 7668 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:18:11.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:11.481 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:12.253 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:12 smithi007 bash[22722]: cluster 2024-09-14T01:18:11.294788+0000 mgr.a (mgr.14355) 7669 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:12 smithi131 bash[24745]: cluster 2024-09-14T01:18:11.294788+0000 mgr.a (mgr.14355) 7669 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:12 smithi171 bash[25040]: cluster 2024-09-14T01:18:11.294788+0000 mgr.a (mgr.14355) 7669 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:18:13.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:13 smithi007 bash[22722]: audit 2024-09-14T01:18:11.814964+0000 mgr.a (mgr.14355) 7670 : audit [DBG] from='client.172977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:13 smithi131 bash[24745]: audit 2024-09-14T01:18:11.814964+0000 mgr.a (mgr.14355) 7670 : audit [DBG] from='client.172977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:13 smithi171 bash[25040]: audit 2024-09-14T01:18:11.814964+0000 mgr.a (mgr.14355) 7670 : audit [DBG] from='client.172977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:14 smithi007 bash[22722]: cluster 2024-09-14T01:18:13.295746+0000 mgr.a (mgr.14355) 7671 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:14 smithi131 bash[24745]: cluster 2024-09-14T01:18:13.295746+0000 mgr.a (mgr.14355) 7671 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:14 smithi171 bash[25040]: cluster 2024-09-14T01:18:13.295746+0000 mgr.a (mgr.14355) 7671 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:16 smithi007 bash[22722]: cluster 2024-09-14T01:18:15.297173+0000 mgr.a (mgr.14355) 7672 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:16 smithi131 bash[24745]: cluster 2024-09-14T01:18:15.297173+0000 mgr.a (mgr.14355) 7672 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:16 smithi171 bash[25040]: cluster 2024-09-14T01:18:15.297173+0000 mgr.a (mgr.14355) 7672 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:17.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:17.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:18.037 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:18 smithi007 bash[22722]: cluster 2024-09-14T01:18:17.298356+0000 mgr.a (mgr.14355) 7673 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:18 smithi131 bash[24745]: cluster 2024-09-14T01:18:17.298356+0000 mgr.a (mgr.14355) 7673 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:18 smithi171 bash[25040]: cluster 2024-09-14T01:18:17.298356+0000 mgr.a (mgr.14355) 7673 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:19.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:19 smithi007 bash[22722]: audit 2024-09-14T01:18:17.589954+0000 mgr.a (mgr.14355) 7674 : audit [DBG] from='client.173055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:19 smithi131 bash[24745]: audit 2024-09-14T01:18:17.589954+0000 mgr.a (mgr.14355) 7674 : audit [DBG] from='client.173055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:19 smithi171 bash[25040]: audit 2024-09-14T01:18:17.589954+0000 mgr.a (mgr.14355) 7674 : audit [DBG] from='client.173055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:20 smithi007 bash[22722]: cluster 2024-09-14T01:18:19.299262+0000 mgr.a (mgr.14355) 7675 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:20 smithi131 bash[24745]: cluster 2024-09-14T01:18:19.299262+0000 mgr.a (mgr.14355) 7675 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:20 smithi171 bash[25040]: cluster 2024-09-14T01:18:19.299262+0000 mgr.a (mgr.14355) 7675 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:22.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:22 smithi007 bash[22722]: cluster 2024-09-14T01:18:21.301541+0000 mgr.a (mgr.14355) 7676 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:22 smithi131 bash[24745]: cluster 2024-09-14T01:18:21.301541+0000 mgr.a (mgr.14355) 7676 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:22 smithi171 bash[25040]: cluster 2024-09-14T01:18:21.301541+0000 mgr.a (mgr.14355) 7676 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:23.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:23.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:23.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:23.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:23.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:23.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:23.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:23.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:24 smithi131 bash[24745]: cluster 2024-09-14T01:18:23.301969+0000 mgr.a (mgr.14355) 7677 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:24 smithi131 bash[24745]: audit 2024-09-14T01:18:23.361674+0000 mgr.a (mgr.14355) 7678 : audit [DBG] from='client.173133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:24 smithi171 bash[25040]: cluster 2024-09-14T01:18:23.301969+0000 mgr.a (mgr.14355) 7677 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:24 smithi171 bash[25040]: audit 2024-09-14T01:18:23.361674+0000 mgr.a (mgr.14355) 7678 : audit [DBG] from='client.173133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:24 smithi007 bash[22722]: cluster 2024-09-14T01:18:23.301969+0000 mgr.a (mgr.14355) 7677 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:24 smithi007 bash[22722]: audit 2024-09-14T01:18:23.361674+0000 mgr.a (mgr.14355) 7678 : audit [DBG] from='client.173133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:26 smithi131 bash[24745]: cluster 2024-09-14T01:18:25.303463+0000 mgr.a (mgr.14355) 7679 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:26 smithi171 bash[25040]: cluster 2024-09-14T01:18:25.303463+0000 mgr.a (mgr.14355) 7679 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:26 smithi007 bash[22722]: cluster 2024-09-14T01:18:25.303463+0000 mgr.a (mgr.14355) 7679 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:18:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:28 smithi131 bash[24745]: cluster 2024-09-14T01:18:27.305133+0000 mgr.a (mgr.14355) 7680 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:28 smithi171 bash[25040]: cluster 2024-09-14T01:18:27.305133+0000 mgr.a (mgr.14355) 7680 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:28 smithi007 bash[22722]: cluster 2024-09-14T01:18:27.305133+0000 mgr.a (mgr.14355) 7680 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:29.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:29.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:30 smithi131 bash[24745]: audit 2024-09-14T01:18:29.107677+0000 mgr.a (mgr.14355) 7681 : audit [DBG] from='client.173208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:30 smithi131 bash[24745]: cluster 2024-09-14T01:18:29.305714+0000 mgr.a (mgr.14355) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:30 smithi171 bash[25040]: audit 2024-09-14T01:18:29.107677+0000 mgr.a (mgr.14355) 7681 : audit [DBG] from='client.173208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:30 smithi171 bash[25040]: cluster 2024-09-14T01:18:29.305714+0000 mgr.a (mgr.14355) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:30 smithi007 bash[22722]: audit 2024-09-14T01:18:29.107677+0000 mgr.a (mgr.14355) 7681 : audit [DBG] from='client.173208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:30 smithi007 bash[22722]: cluster 2024-09-14T01:18:29.305714+0000 mgr.a (mgr.14355) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:32 smithi131 bash[24745]: cluster 2024-09-14T01:18:31.308067+0000 mgr.a (mgr.14355) 7683 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:32 smithi171 bash[25040]: cluster 2024-09-14T01:18:31.308067+0000 mgr.a (mgr.14355) 7683 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:32 smithi007 bash[22722]: cluster 2024-09-14T01:18:31.308067+0000 mgr.a (mgr.14355) 7683 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:34.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:34.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:34.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:34 smithi131 bash[24745]: cluster 2024-09-14T01:18:33.308850+0000 mgr.a (mgr.14355) 7684 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:34 smithi171 bash[25040]: cluster 2024-09-14T01:18:33.308850+0000 mgr.a (mgr.14355) 7684 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:34.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:34 smithi007 bash[22722]: cluster 2024-09-14T01:18:33.308850+0000 mgr.a (mgr.14355) 7684 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:35.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:36 smithi131 bash[24745]: audit 2024-09-14T01:18:34.892732+0000 mgr.a (mgr.14355) 7685 : audit [DBG] from='client.173286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:36 smithi131 bash[24745]: cluster 2024-09-14T01:18:35.309717+0000 mgr.a (mgr.14355) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:18:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:36 smithi171 bash[25040]: audit 2024-09-14T01:18:34.892732+0000 mgr.a (mgr.14355) 7685 : audit [DBG] from='client.173286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:36 smithi171 bash[25040]: cluster 2024-09-14T01:18:35.309717+0000 mgr.a (mgr.14355) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:18:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:36 smithi007 bash[22722]: audit 2024-09-14T01:18:34.892732+0000 mgr.a (mgr.14355) 7685 : audit [DBG] from='client.173286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:36 smithi007 bash[22722]: cluster 2024-09-14T01:18:35.309717+0000 mgr.a (mgr.14355) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:18:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:38 smithi131 bash[24745]: cluster 2024-09-14T01:18:37.310928+0000 mgr.a (mgr.14355) 7687 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:18:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:38 smithi171 bash[25040]: cluster 2024-09-14T01:18:37.310928+0000 mgr.a (mgr.14355) 7687 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:18:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:38 smithi007 bash[22722]: cluster 2024-09-14T01:18:37.310928+0000 mgr.a (mgr.14355) 7687 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:18:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:40 smithi131 bash[24745]: cluster 2024-09-14T01:18:39.311690+0000 mgr.a (mgr.14355) 7688 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:18:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:40 smithi171 bash[25040]: cluster 2024-09-14T01:18:39.311690+0000 mgr.a (mgr.14355) 7688 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:18:40.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:40 smithi007 bash[22722]: cluster 2024-09-14T01:18:39.311690+0000 mgr.a (mgr.14355) 7688 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:18:41.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:41.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:42 smithi131 bash[24745]: audit 2024-09-14T01:18:40.665935+0000 mgr.a (mgr.14355) 7689 : audit [DBG] from='client.173364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:42 smithi131 bash[24745]: cluster 2024-09-14T01:18:41.314499+0000 mgr.a (mgr.14355) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:42 smithi171 bash[25040]: audit 2024-09-14T01:18:40.665935+0000 mgr.a (mgr.14355) 7689 : audit [DBG] from='client.173364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:42 smithi171 bash[25040]: cluster 2024-09-14T01:18:41.314499+0000 mgr.a (mgr.14355) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:42 smithi007 bash[22722]: audit 2024-09-14T01:18:40.665935+0000 mgr.a (mgr.14355) 7689 : audit [DBG] from='client.173364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:42 smithi007 bash[22722]: cluster 2024-09-14T01:18:41.314499+0000 mgr.a (mgr.14355) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:44 smithi131 bash[24745]: cluster 2024-09-14T01:18:43.315268+0000 mgr.a (mgr.14355) 7691 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:18:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:44 smithi171 bash[25040]: cluster 2024-09-14T01:18:43.315268+0000 mgr.a (mgr.14355) 7691 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:18:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:44 smithi007 bash[22722]: cluster 2024-09-14T01:18:43.315268+0000 mgr.a (mgr.14355) 7691 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:18:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:45 smithi007 bash[22722]: cluster 2024-09-14T01:18:45.317169+0000 mgr.a (mgr.14355) 7692 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:45 smithi131 bash[24745]: cluster 2024-09-14T01:18:45.317169+0000 mgr.a (mgr.14355) 7692 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:45 smithi171 bash[25040]: cluster 2024-09-14T01:18:45.317169+0000 mgr.a (mgr.14355) 7692 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:46.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:46.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:46.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:46.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:46 smithi007 bash[22722]: audit 2024-09-14T01:18:46.414241+0000 mgr.a (mgr.14355) 7693 : audit [DBG] from='client.173439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:46 smithi131 bash[24745]: audit 2024-09-14T01:18:46.414241+0000 mgr.a (mgr.14355) 7693 : audit [DBG] from='client.173439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:46 smithi171 bash[25040]: audit 2024-09-14T01:18:46.414241+0000 mgr.a (mgr.14355) 7693 : audit [DBG] from='client.173439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:48 smithi007 bash[22722]: cluster 2024-09-14T01:18:47.318153+0000 mgr.a (mgr.14355) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:18:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:48 smithi131 bash[24745]: cluster 2024-09-14T01:18:47.318153+0000 mgr.a (mgr.14355) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:18:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:48 smithi171 bash[25040]: cluster 2024-09-14T01:18:47.318153+0000 mgr.a (mgr.14355) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:18:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:50 smithi007 bash[22722]: cluster 2024-09-14T01:18:49.318956+0000 mgr.a (mgr.14355) 7695 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:18:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:50 smithi131 bash[24745]: cluster 2024-09-14T01:18:49.318956+0000 mgr.a (mgr.14355) 7695 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:18:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:50 smithi171 bash[25040]: cluster 2024-09-14T01:18:49.318956+0000 mgr.a (mgr.14355) 7695 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:18:51.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:51.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:52.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:52 smithi007 bash[22722]: cluster 2024-09-14T01:18:51.321193+0000 mgr.a (mgr.14355) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T01:18:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:52 smithi131 bash[24745]: cluster 2024-09-14T01:18:51.321193+0000 mgr.a (mgr.14355) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T01:18:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:52 smithi171 bash[25040]: cluster 2024-09-14T01:18:51.321193+0000 mgr.a (mgr.14355) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T01:18:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:53 smithi007 bash[22722]: audit 2024-09-14T01:18:52.184939+0000 mgr.a (mgr.14355) 7697 : audit [DBG] from='client.173514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:53 smithi131 bash[24745]: audit 2024-09-14T01:18:52.184939+0000 mgr.a (mgr.14355) 7697 : audit [DBG] from='client.173514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:53 smithi171 bash[25040]: audit 2024-09-14T01:18:52.184939+0000 mgr.a (mgr.14355) 7697 : audit [DBG] from='client.173514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:54 smithi007 bash[22722]: cluster 2024-09-14T01:18:53.322284+0000 mgr.a (mgr.14355) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:54 smithi131 bash[24745]: cluster 2024-09-14T01:18:53.322284+0000 mgr.a (mgr.14355) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:54 smithi171 bash[25040]: cluster 2024-09-14T01:18:53.322284+0000 mgr.a (mgr.14355) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:56 smithi007 bash[22722]: cluster 2024-09-14T01:18:55.324463+0000 mgr.a (mgr.14355) 7699 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:56 smithi131 bash[24745]: cluster 2024-09-14T01:18:55.324463+0000 mgr.a (mgr.14355) 7699 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:56 smithi171 bash[25040]: cluster 2024-09-14T01:18:55.324463+0000 mgr.a (mgr.14355) 7699 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:18:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:18:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:18:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:18:58.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:18:58.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:18:58.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:18:58.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:18:58.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:18:58.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:58 smithi007 bash[22722]: cluster 2024-09-14T01:18:57.325260+0000 mgr.a (mgr.14355) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:58 smithi131 bash[24745]: cluster 2024-09-14T01:18:57.325260+0000 mgr.a (mgr.14355) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:58 smithi171 bash[25040]: cluster 2024-09-14T01:18:57.325260+0000 mgr.a (mgr.14355) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:18:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:18:59 smithi007 bash[22722]: audit 2024-09-14T01:18:57.949889+0000 mgr.a (mgr.14355) 7701 : audit [DBG] from='client.173592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:18:59 smithi131 bash[24745]: audit 2024-09-14T01:18:57.949889+0000 mgr.a (mgr.14355) 7701 : audit [DBG] from='client.173592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:18:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:18:59 smithi171 bash[25040]: audit 2024-09-14T01:18:57.949889+0000 mgr.a (mgr.14355) 7701 : audit [DBG] from='client.173592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:00 smithi007 bash[22722]: cluster 2024-09-14T01:18:59.326170+0000 mgr.a (mgr.14355) 7702 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:00 smithi007 bash[22722]: audit 2024-09-14T01:19:00.366630+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:19:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:00 smithi131 bash[24745]: cluster 2024-09-14T01:18:59.326170+0000 mgr.a (mgr.14355) 7702 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:00 smithi131 bash[24745]: audit 2024-09-14T01:19:00.366630+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:19:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:00 smithi171 bash[25040]: cluster 2024-09-14T01:18:59.326170+0000 mgr.a (mgr.14355) 7702 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:00 smithi171 bash[25040]: audit 2024-09-14T01:19:00.366630+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:19:01.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22722]: audit 2024-09-14T01:19:01.210799+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:19:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22722]: audit 2024-09-14T01:19:01.211865+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:19:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22722]: audit 2024-09-14T01:19:01.220036+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:19:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22722]: audit 2024-09-14T01:19:01.222652+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:01 smithi131 bash[24745]: audit 2024-09-14T01:19:01.210799+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:19:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:01 smithi131 bash[24745]: audit 2024-09-14T01:19:01.211865+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:19:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:01 smithi131 bash[24745]: audit 2024-09-14T01:19:01.220036+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:19:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:01 smithi131 bash[24745]: audit 2024-09-14T01:19:01.222652+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:01 smithi171 bash[25040]: audit 2024-09-14T01:19:01.210799+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:19:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:01 smithi171 bash[25040]: audit 2024-09-14T01:19:01.211865+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:19:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:01 smithi171 bash[25040]: audit 2024-09-14T01:19:01.220036+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:19:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:01 smithi171 bash[25040]: audit 2024-09-14T01:19:01.222652+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:02.422 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22972]: debug 2024-09-14T01:19:01.952+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:19:02.422 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:19:01 smithi007 bash[22972]: debug 2024-09-14T01:19:01.956+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:19:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:02 smithi007 bash[22722]: audit 2024-09-14T01:19:01.224881+0000 mgr.a (mgr.14355) 7703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:02 smithi007 bash[22722]: cluster 2024-09-14T01:19:01.327653+0000 mgr.a (mgr.14355) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:02.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:02 smithi131 bash[24745]: audit 2024-09-14T01:19:01.224881+0000 mgr.a (mgr.14355) 7703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:02.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:02 smithi131 bash[24745]: cluster 2024-09-14T01:19:01.327653+0000 mgr.a (mgr.14355) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:02 smithi171 bash[25040]: audit 2024-09-14T01:19:01.224881+0000 mgr.a (mgr.14355) 7703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:19:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:02 smithi171 bash[25040]: cluster 2024-09-14T01:19:01.327653+0000 mgr.a (mgr.14355) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:03.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:03 smithi007 bash[22722]: audit 2024-09-14T01:19:01.958022+0000 mgr.a (mgr.14355) 7705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:19:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:03 smithi007 bash[22722]: cephadm 2024-09-14T01:19:01.959663+0000 mgr.a (mgr.14355) 7706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:19:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:03 smithi131 bash[24745]: audit 2024-09-14T01:19:01.958022+0000 mgr.a (mgr.14355) 7705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:19:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:03 smithi131 bash[24745]: cephadm 2024-09-14T01:19:01.959663+0000 mgr.a (mgr.14355) 7706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:19:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:03 smithi171 bash[25040]: audit 2024-09-14T01:19:01.958022+0000 mgr.a (mgr.14355) 7705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:19:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:03 smithi171 bash[25040]: cephadm 2024-09-14T01:19:01.959663+0000 mgr.a (mgr.14355) 7706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:19:04.128 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:04.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:04 smithi007 bash[22722]: cluster 2024-09-14T01:19:03.328560+0000 mgr.a (mgr.14355) 7707 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:04 smithi131 bash[24745]: cluster 2024-09-14T01:19:03.328560+0000 mgr.a (mgr.14355) 7707 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:04.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:04 smithi171 bash[25040]: cluster 2024-09-14T01:19:03.328560+0000 mgr.a (mgr.14355) 7707 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:05 smithi007 bash[22722]: audit 2024-09-14T01:19:03.691850+0000 mgr.a (mgr.14355) 7708 : audit [DBG] from='client.173778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:05 smithi131 bash[24745]: audit 2024-09-14T01:19:03.691850+0000 mgr.a (mgr.14355) 7708 : audit [DBG] from='client.173778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:05 smithi171 bash[25040]: audit 2024-09-14T01:19:03.691850+0000 mgr.a (mgr.14355) 7708 : audit [DBG] from='client.173778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:06 smithi007 bash[22722]: cluster 2024-09-14T01:19:05.331001+0000 mgr.a (mgr.14355) 7709 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:06 smithi131 bash[24745]: cluster 2024-09-14T01:19:05.331001+0000 mgr.a (mgr.14355) 7709 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:06 smithi171 bash[25040]: cluster 2024-09-14T01:19:05.331001+0000 mgr.a (mgr.14355) 7709 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:08 smithi007 bash[22722]: cluster 2024-09-14T01:19:07.331954+0000 mgr.a (mgr.14355) 7710 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:08 smithi131 bash[24745]: cluster 2024-09-14T01:19:07.331954+0000 mgr.a (mgr.14355) 7710 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:08 smithi171 bash[25040]: cluster 2024-09-14T01:19:07.331954+0000 mgr.a (mgr.14355) 7710 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:09.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:09.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:09.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:09.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:09.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:10 smithi007 bash[22722]: cluster 2024-09-14T01:19:09.332878+0000 mgr.a (mgr.14355) 7711 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:10 smithi007 bash[22722]: audit 2024-09-14T01:19:09.468369+0000 mgr.a (mgr.14355) 7712 : audit [DBG] from='client.173853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:10 smithi131 bash[24745]: cluster 2024-09-14T01:19:09.332878+0000 mgr.a (mgr.14355) 7711 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:10 smithi131 bash[24745]: audit 2024-09-14T01:19:09.468369+0000 mgr.a (mgr.14355) 7712 : audit [DBG] from='client.173853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:10 smithi171 bash[25040]: cluster 2024-09-14T01:19:09.332878+0000 mgr.a (mgr.14355) 7711 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:10 smithi171 bash[25040]: audit 2024-09-14T01:19:09.468369+0000 mgr.a (mgr.14355) 7712 : audit [DBG] from='client.173853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:12 smithi131 bash[24745]: cluster 2024-09-14T01:19:11.335293+0000 mgr.a (mgr.14355) 7713 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:12 smithi171 bash[25040]: cluster 2024-09-14T01:19:11.335293+0000 mgr.a (mgr.14355) 7713 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:12 smithi007 bash[22722]: cluster 2024-09-14T01:19:11.335293+0000 mgr.a (mgr.14355) 7713 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:14 smithi131 bash[24745]: cluster 2024-09-14T01:19:13.336015+0000 mgr.a (mgr.14355) 7714 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:14 smithi171 bash[25040]: cluster 2024-09-14T01:19:13.336015+0000 mgr.a (mgr.14355) 7714 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:14.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:14.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:14.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:14.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:14 smithi007 bash[22722]: cluster 2024-09-14T01:19:13.336015+0000 mgr.a (mgr.14355) 7714 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:15.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:16 smithi131 bash[24745]: audit 2024-09-14T01:19:15.243029+0000 mgr.a (mgr.14355) 7715 : audit [DBG] from='client.173931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:16 smithi131 bash[24745]: cluster 2024-09-14T01:19:15.337132+0000 mgr.a (mgr.14355) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:16 smithi171 bash[25040]: audit 2024-09-14T01:19:15.243029+0000 mgr.a (mgr.14355) 7715 : audit [DBG] from='client.173931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:16 smithi171 bash[25040]: cluster 2024-09-14T01:19:15.337132+0000 mgr.a (mgr.14355) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:16 smithi007 bash[22722]: audit 2024-09-14T01:19:15.243029+0000 mgr.a (mgr.14355) 7715 : audit [DBG] from='client.173931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:16 smithi007 bash[22722]: cluster 2024-09-14T01:19:15.337132+0000 mgr.a (mgr.14355) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:19:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:18 smithi131 bash[24745]: cluster 2024-09-14T01:19:17.337973+0000 mgr.a (mgr.14355) 7717 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:18 smithi171 bash[25040]: cluster 2024-09-14T01:19:17.337973+0000 mgr.a (mgr.14355) 7717 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:18 smithi007 bash[22722]: cluster 2024-09-14T01:19:17.337973+0000 mgr.a (mgr.14355) 7717 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:20.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:20.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:20 smithi131 bash[24745]: cluster 2024-09-14T01:19:19.338757+0000 mgr.a (mgr.14355) 7718 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:20 smithi171 bash[25040]: cluster 2024-09-14T01:19:19.338757+0000 mgr.a (mgr.14355) 7718 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:20 smithi007 bash[22722]: cluster 2024-09-14T01:19:19.338757+0000 mgr.a (mgr.14355) 7718 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:21.432 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:21.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:22 smithi131 bash[24745]: audit 2024-09-14T01:19:21.012158+0000 mgr.a (mgr.14355) 7719 : audit [DBG] from='client.174006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:22 smithi131 bash[24745]: cluster 2024-09-14T01:19:21.340487+0000 mgr.a (mgr.14355) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:22 smithi171 bash[25040]: audit 2024-09-14T01:19:21.012158+0000 mgr.a (mgr.14355) 7719 : audit [DBG] from='client.174006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:22 smithi171 bash[25040]: cluster 2024-09-14T01:19:21.340487+0000 mgr.a (mgr.14355) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:22 smithi007 bash[22722]: audit 2024-09-14T01:19:21.012158+0000 mgr.a (mgr.14355) 7719 : audit [DBG] from='client.174006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:22 smithi007 bash[22722]: cluster 2024-09-14T01:19:21.340487+0000 mgr.a (mgr.14355) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:24 smithi131 bash[24745]: cluster 2024-09-14T01:19:23.341244+0000 mgr.a (mgr.14355) 7721 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:24 smithi171 bash[25040]: cluster 2024-09-14T01:19:23.341244+0000 mgr.a (mgr.14355) 7721 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:24 smithi007 bash[22722]: cluster 2024-09-14T01:19:23.341244+0000 mgr.a (mgr.14355) 7721 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:26.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:26.435 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:26 smithi131 bash[24745]: cluster 2024-09-14T01:19:25.343205+0000 mgr.a (mgr.14355) 7722 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:26 smithi171 bash[25040]: cluster 2024-09-14T01:19:25.343205+0000 mgr.a (mgr.14355) 7722 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:26 smithi007 bash[22722]: cluster 2024-09-14T01:19:25.343205+0000 mgr.a (mgr.14355) 7722 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:27.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:27.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:28 smithi131 bash[24745]: audit 2024-09-14T01:19:26.767140+0000 mgr.a (mgr.14355) 7723 : audit [DBG] from='client.174084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:28 smithi131 bash[24745]: cluster 2024-09-14T01:19:27.344284+0000 mgr.a (mgr.14355) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:28 smithi171 bash[25040]: audit 2024-09-14T01:19:26.767140+0000 mgr.a (mgr.14355) 7723 : audit [DBG] from='client.174084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:28 smithi171 bash[25040]: cluster 2024-09-14T01:19:27.344284+0000 mgr.a (mgr.14355) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:28 smithi007 bash[22722]: audit 2024-09-14T01:19:26.767140+0000 mgr.a (mgr.14355) 7723 : audit [DBG] from='client.174084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:28 smithi007 bash[22722]: cluster 2024-09-14T01:19:27.344284+0000 mgr.a (mgr.14355) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:30 smithi131 bash[24745]: cluster 2024-09-14T01:19:29.345268+0000 mgr.a (mgr.14355) 7725 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:30 smithi171 bash[25040]: cluster 2024-09-14T01:19:29.345268+0000 mgr.a (mgr.14355) 7725 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:30 smithi007 bash[22722]: cluster 2024-09-14T01:19:29.345268+0000 mgr.a (mgr.14355) 7725 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:32.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:32.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:32.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:32 smithi131 bash[24745]: cluster 2024-09-14T01:19:31.347652+0000 mgr.a (mgr.14355) 7726 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:32 smithi171 bash[25040]: cluster 2024-09-14T01:19:31.347652+0000 mgr.a (mgr.14355) 7726 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:32 smithi007 bash[22722]: cluster 2024-09-14T01:19:31.347652+0000 mgr.a (mgr.14355) 7726 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:32.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:32.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:32.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:32.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:32.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:34 smithi131 bash[24745]: audit 2024-09-14T01:19:32.519106+0000 mgr.a (mgr.14355) 7727 : audit [DBG] from='client.174162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:34 smithi131 bash[24745]: cluster 2024-09-14T01:19:33.348638+0000 mgr.a (mgr.14355) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:34 smithi171 bash[25040]: audit 2024-09-14T01:19:32.519106+0000 mgr.a (mgr.14355) 7727 : audit [DBG] from='client.174162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:34 smithi171 bash[25040]: cluster 2024-09-14T01:19:33.348638+0000 mgr.a (mgr.14355) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:34 smithi007 bash[22722]: audit 2024-09-14T01:19:32.519106+0000 mgr.a (mgr.14355) 7727 : audit [DBG] from='client.174162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:34 smithi007 bash[22722]: cluster 2024-09-14T01:19:33.348638+0000 mgr.a (mgr.14355) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:36 smithi131 bash[24745]: cluster 2024-09-14T01:19:35.350821+0000 mgr.a (mgr.14355) 7729 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:36 smithi171 bash[25040]: cluster 2024-09-14T01:19:35.350821+0000 mgr.a (mgr.14355) 7729 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:36 smithi007 bash[22722]: cluster 2024-09-14T01:19:35.350821+0000 mgr.a (mgr.14355) 7729 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:37.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:37.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:37.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:38.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:38.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:38.739 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:38 smithi131 bash[24745]: cluster 2024-09-14T01:19:37.351572+0000 mgr.a (mgr.14355) 7730 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:38 smithi171 bash[25040]: cluster 2024-09-14T01:19:37.351572+0000 mgr.a (mgr.14355) 7730 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:38 smithi007 bash[22722]: cluster 2024-09-14T01:19:37.351572+0000 mgr.a (mgr.14355) 7730 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:39 smithi131 bash[24745]: audit 2024-09-14T01:19:38.303867+0000 mgr.a (mgr.14355) 7731 : audit [DBG] from='client.174237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:39 smithi131 bash[24745]: cluster 2024-09-14T01:19:39.352439+0000 mgr.a (mgr.14355) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:39 smithi171 bash[25040]: audit 2024-09-14T01:19:38.303867+0000 mgr.a (mgr.14355) 7731 : audit [DBG] from='client.174237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:39 smithi171 bash[25040]: cluster 2024-09-14T01:19:39.352439+0000 mgr.a (mgr.14355) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:39 smithi007 bash[22722]: audit 2024-09-14T01:19:38.303867+0000 mgr.a (mgr.14355) 7731 : audit [DBG] from='client.174237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:39 smithi007 bash[22722]: cluster 2024-09-14T01:19:39.352439+0000 mgr.a (mgr.14355) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:42 smithi007 bash[22722]: cluster 2024-09-14T01:19:41.354622+0000 mgr.a (mgr.14355) 7733 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:42 smithi131 bash[24745]: cluster 2024-09-14T01:19:41.354622+0000 mgr.a (mgr.14355) 7733 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:42 smithi171 bash[25040]: cluster 2024-09-14T01:19:41.354622+0000 mgr.a (mgr.14355) 7733 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:43.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:43.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:43.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:44.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:44.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:44 smithi007 bash[22722]: cluster 2024-09-14T01:19:43.355376+0000 mgr.a (mgr.14355) 7734 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:44.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:44 smithi131 bash[24745]: cluster 2024-09-14T01:19:43.355376+0000 mgr.a (mgr.14355) 7734 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:44 smithi171 bash[25040]: cluster 2024-09-14T01:19:43.355376+0000 mgr.a (mgr.14355) 7734 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:45 smithi007 bash[22722]: audit 2024-09-14T01:19:44.078237+0000 mgr.a (mgr.14355) 7735 : audit [DBG] from='client.174315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:45 smithi131 bash[24745]: audit 2024-09-14T01:19:44.078237+0000 mgr.a (mgr.14355) 7735 : audit [DBG] from='client.174315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:45 smithi171 bash[25040]: audit 2024-09-14T01:19:44.078237+0000 mgr.a (mgr.14355) 7735 : audit [DBG] from='client.174315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:46 smithi007 bash[22722]: cluster 2024-09-14T01:19:45.357597+0000 mgr.a (mgr.14355) 7736 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:46 smithi131 bash[24745]: cluster 2024-09-14T01:19:45.357597+0000 mgr.a (mgr.14355) 7736 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:46 smithi171 bash[25040]: cluster 2024-09-14T01:19:45.357597+0000 mgr.a (mgr.14355) 7736 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:48 smithi007 bash[22722]: cluster 2024-09-14T01:19:47.358373+0000 mgr.a (mgr.14355) 7737 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:48 smithi131 bash[24745]: cluster 2024-09-14T01:19:47.358373+0000 mgr.a (mgr.14355) 7737 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:48 smithi171 bash[25040]: cluster 2024-09-14T01:19:47.358373+0000 mgr.a (mgr.14355) 7737 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:49.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:49.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:50.275 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:50 smithi007 bash[22722]: cluster 2024-09-14T01:19:49.359082+0000 mgr.a (mgr.14355) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:50 smithi131 bash[24745]: cluster 2024-09-14T01:19:49.359082+0000 mgr.a (mgr.14355) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:50 smithi171 bash[25040]: cluster 2024-09-14T01:19:49.359082+0000 mgr.a (mgr.14355) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:51 smithi007 bash[22722]: audit 2024-09-14T01:19:49.857298+0000 mgr.a (mgr.14355) 7739 : audit [DBG] from='client.174393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:51 smithi131 bash[24745]: audit 2024-09-14T01:19:49.857298+0000 mgr.a (mgr.14355) 7739 : audit [DBG] from='client.174393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:51 smithi171 bash[25040]: audit 2024-09-14T01:19:49.857298+0000 mgr.a (mgr.14355) 7739 : audit [DBG] from='client.174393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:52 smithi007 bash[22722]: cluster 2024-09-14T01:19:51.361422+0000 mgr.a (mgr.14355) 7740 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:52 smithi131 bash[24745]: cluster 2024-09-14T01:19:51.361422+0000 mgr.a (mgr.14355) 7740 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:52 smithi171 bash[25040]: cluster 2024-09-14T01:19:51.361422+0000 mgr.a (mgr.14355) 7740 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:19:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:54 smithi007 bash[22722]: cluster 2024-09-14T01:19:53.362171+0000 mgr.a (mgr.14355) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:54 smithi131 bash[24745]: cluster 2024-09-14T01:19:53.362171+0000 mgr.a (mgr.14355) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:54 smithi171 bash[25040]: cluster 2024-09-14T01:19:53.362171+0000 mgr.a (mgr.14355) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:19:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:19:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:19:56.050 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:19:56.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:19:56.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:19:56.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:19:56.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:19:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:56 smithi007 bash[22722]: cluster 2024-09-14T01:19:55.363127+0000 mgr.a (mgr.14355) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:56 smithi131 bash[24745]: cluster 2024-09-14T01:19:55.363127+0000 mgr.a (mgr.14355) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:56 smithi171 bash[25040]: cluster 2024-09-14T01:19:55.363127+0000 mgr.a (mgr.14355) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:19:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:57 smithi131 bash[24745]: audit 2024-09-14T01:19:55.612037+0000 mgr.a (mgr.14355) 7743 : audit [DBG] from='client.174468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:57 smithi171 bash[25040]: audit 2024-09-14T01:19:55.612037+0000 mgr.a (mgr.14355) 7743 : audit [DBG] from='client.174468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:57 smithi007 bash[22722]: audit 2024-09-14T01:19:55.612037+0000 mgr.a (mgr.14355) 7743 : audit [DBG] from='client.174468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:19:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:19:58 smithi131 bash[24745]: cluster 2024-09-14T01:19:57.363981+0000 mgr.a (mgr.14355) 7744 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:19:58 smithi171 bash[25040]: cluster 2024-09-14T01:19:57.363981+0000 mgr.a (mgr.14355) 7744 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:19:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:19:58 smithi007 bash[22722]: cluster 2024-09-14T01:19:57.363981+0000 mgr.a (mgr.14355) 7744 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:00 smithi131 bash[24745]: cluster 2024-09-14T01:19:59.364799+0000 mgr.a (mgr.14355) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:00 smithi131 bash[24745]: cluster 2024-09-14T01:20:00.000148+0000 mon.a (mon.0) 1749 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:20:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:00 smithi171 bash[25040]: cluster 2024-09-14T01:19:59.364799+0000 mgr.a (mgr.14355) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:00 smithi171 bash[25040]: cluster 2024-09-14T01:20:00.000148+0000 mon.a (mon.0) 1749 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:20:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:00 smithi007 bash[22722]: cluster 2024-09-14T01:19:59.364799+0000 mgr.a (mgr.14355) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:00 smithi007 bash[22722]: cluster 2024-09-14T01:20:00.000148+0000 mon.a (mon.0) 1749 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:20:01.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:01.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:01.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:01.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:01.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:02 smithi131 bash[24745]: cluster 2024-09-14T01:20:01.367004+0000 mgr.a (mgr.14355) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:02 smithi131 bash[24745]: audit 2024-09-14T01:20:01.386202+0000 mgr.a (mgr.14355) 7747 : audit [DBG] from='client.174543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:02 smithi131 bash[24745]: audit 2024-09-14T01:20:02.010165+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:20:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:02 smithi171 bash[25040]: cluster 2024-09-14T01:20:01.367004+0000 mgr.a (mgr.14355) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:02 smithi171 bash[25040]: audit 2024-09-14T01:20:01.386202+0000 mgr.a (mgr.14355) 7747 : audit [DBG] from='client.174543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:02 smithi171 bash[25040]: audit 2024-09-14T01:20:02.010165+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:20:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:02 smithi007 bash[22722]: cluster 2024-09-14T01:20:01.367004+0000 mgr.a (mgr.14355) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:02 smithi007 bash[22722]: audit 2024-09-14T01:20:01.386202+0000 mgr.a (mgr.14355) 7747 : audit [DBG] from='client.174543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:02 smithi007 bash[22722]: audit 2024-09-14T01:20:02.010165+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:20:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:04 smithi131 bash[24745]: cluster 2024-09-14T01:20:03.368020+0000 mgr.a (mgr.14355) 7748 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:04 smithi171 bash[25040]: cluster 2024-09-14T01:20:03.368020+0000 mgr.a (mgr.14355) 7748 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:04 smithi007 bash[22722]: cluster 2024-09-14T01:20:03.368020+0000 mgr.a (mgr.14355) 7748 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:06 smithi131 bash[24745]: cluster 2024-09-14T01:20:05.370360+0000 mgr.a (mgr.14355) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:06 smithi171 bash[25040]: cluster 2024-09-14T01:20:05.370360+0000 mgr.a (mgr.14355) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:06.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:06.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:06.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:06 smithi007 bash[22722]: cluster 2024-09-14T01:20:05.370360+0000 mgr.a (mgr.14355) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:07.595 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:08.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.171808+0000 mgr.a (mgr.14355) 7750 : audit [DBG] from='client.174615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.360831+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.367057+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: cluster 2024-09-14T01:20:07.374719+0000 mgr.a (mgr.14355) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.390804+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.393783+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.396559+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:07.406747+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:08.139500+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:08.141195+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:20:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:08.151428+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22722]: audit 2024-09-14T01:20:08.154203+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.171808+0000 mgr.a (mgr.14355) 7750 : audit [DBG] from='client.174615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.360831+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.367057+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: cluster 2024-09-14T01:20:07.374719+0000 mgr.a (mgr.14355) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.390804+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.393783+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.396559+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:07.406747+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:08.139500+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:08.141195+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:08.151428+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:08 smithi131 bash[24745]: audit 2024-09-14T01:20:08.154203+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.171808+0000 mgr.a (mgr.14355) 7750 : audit [DBG] from='client.174615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.360831+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.367057+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: cluster 2024-09-14T01:20:07.374719+0000 mgr.a (mgr.14355) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.390804+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.393783+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.396559+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:07.406747+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:08.139500+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:08.141195+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:08.151428+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:20:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:08 smithi171 bash[25040]: audit 2024-09-14T01:20:08.154203+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:09.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22972]: debug 2024-09-14T01:20:08.879+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:20:09.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:20:08 smithi007 bash[22972]: debug 2024-09-14T01:20:08.879+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:20:09.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:09 smithi007 bash[22722]: audit 2024-09-14T01:20:08.156903+0000 mgr.a (mgr.14355) 7752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:09 smithi131 bash[24745]: audit 2024-09-14T01:20:08.156903+0000 mgr.a (mgr.14355) 7752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:09 smithi171 bash[25040]: audit 2024-09-14T01:20:08.156903+0000 mgr.a (mgr.14355) 7752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:20:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:10 smithi007 bash[22722]: audit 2024-09-14T01:20:08.882460+0000 mgr.a (mgr.14355) 7753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:20:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:10 smithi007 bash[22722]: cephadm 2024-09-14T01:20:08.884248+0000 mgr.a (mgr.14355) 7754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:20:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:10 smithi007 bash[22722]: cluster 2024-09-14T01:20:09.375679+0000 mgr.a (mgr.14355) 7755 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:10 smithi131 bash[24745]: audit 2024-09-14T01:20:08.882460+0000 mgr.a (mgr.14355) 7753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:20:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:10 smithi131 bash[24745]: cephadm 2024-09-14T01:20:08.884248+0000 mgr.a (mgr.14355) 7754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:20:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:10 smithi131 bash[24745]: cluster 2024-09-14T01:20:09.375679+0000 mgr.a (mgr.14355) 7755 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:10 smithi171 bash[25040]: audit 2024-09-14T01:20:08.882460+0000 mgr.a (mgr.14355) 7753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:20:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:10 smithi171 bash[25040]: cephadm 2024-09-14T01:20:08.884248+0000 mgr.a (mgr.14355) 7754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:20:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:10 smithi171 bash[25040]: cluster 2024-09-14T01:20:09.375679+0000 mgr.a (mgr.14355) 7755 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:12.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:12.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:12.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:12.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:12 smithi007 bash[22722]: cluster 2024-09-14T01:20:11.377912+0000 mgr.a (mgr.14355) 7756 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:12 smithi131 bash[24745]: cluster 2024-09-14T01:20:11.377912+0000 mgr.a (mgr.14355) 7756 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:12 smithi171 bash[25040]: cluster 2024-09-14T01:20:11.377912+0000 mgr.a (mgr.14355) 7756 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:13.348 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:14 smithi007 bash[22722]: audit 2024-09-14T01:20:12.929026+0000 mgr.a (mgr.14355) 7757 : audit [DBG] from='client.174798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:14 smithi007 bash[22722]: cluster 2024-09-14T01:20:13.378671+0000 mgr.a (mgr.14355) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:14 smithi131 bash[24745]: audit 2024-09-14T01:20:12.929026+0000 mgr.a (mgr.14355) 7757 : audit [DBG] from='client.174798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:14 smithi131 bash[24745]: cluster 2024-09-14T01:20:13.378671+0000 mgr.a (mgr.14355) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:14 smithi171 bash[25040]: audit 2024-09-14T01:20:12.929026+0000 mgr.a (mgr.14355) 7757 : audit [DBG] from='client.174798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:14 smithi171 bash[25040]: cluster 2024-09-14T01:20:13.378671+0000 mgr.a (mgr.14355) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:16 smithi007 bash[22722]: cluster 2024-09-14T01:20:15.380738+0000 mgr.a (mgr.14355) 7759 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:16 smithi131 bash[24745]: cluster 2024-09-14T01:20:15.380738+0000 mgr.a (mgr.14355) 7759 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:16 smithi171 bash[25040]: cluster 2024-09-14T01:20:15.380738+0000 mgr.a (mgr.14355) 7759 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:18.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:18.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:18 smithi007 bash[22722]: cluster 2024-09-14T01:20:17.381492+0000 mgr.a (mgr.14355) 7760 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:18 smithi131 bash[24745]: cluster 2024-09-14T01:20:17.381492+0000 mgr.a (mgr.14355) 7760 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:18 smithi171 bash[25040]: cluster 2024-09-14T01:20:17.381492+0000 mgr.a (mgr.14355) 7760 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:19.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:19.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:20 smithi007 bash[22722]: audit 2024-09-14T01:20:18.684799+0000 mgr.a (mgr.14355) 7761 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:20 smithi007 bash[22722]: cluster 2024-09-14T01:20:19.382391+0000 mgr.a (mgr.14355) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:20 smithi131 bash[24745]: audit 2024-09-14T01:20:18.684799+0000 mgr.a (mgr.14355) 7761 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:20 smithi131 bash[24745]: cluster 2024-09-14T01:20:19.382391+0000 mgr.a (mgr.14355) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:20 smithi171 bash[25040]: audit 2024-09-14T01:20:18.684799+0000 mgr.a (mgr.14355) 7761 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:20 smithi171 bash[25040]: cluster 2024-09-14T01:20:19.382391+0000 mgr.a (mgr.14355) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:22 smithi007 bash[22722]: cluster 2024-09-14T01:20:21.384651+0000 mgr.a (mgr.14355) 7763 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:22 smithi131 bash[24745]: cluster 2024-09-14T01:20:21.384651+0000 mgr.a (mgr.14355) 7763 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:22 smithi171 bash[25040]: cluster 2024-09-14T01:20:21.384651+0000 mgr.a (mgr.14355) 7763 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:20:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:24.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:24 smithi007 bash[22722]: cluster 2024-09-14T01:20:23.385386+0000 mgr.a (mgr.14355) 7764 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:24 smithi131 bash[24745]: cluster 2024-09-14T01:20:23.385386+0000 mgr.a (mgr.14355) 7764 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:24 smithi171 bash[25040]: cluster 2024-09-14T01:20:23.385386+0000 mgr.a (mgr.14355) 7764 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:24.890 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:24.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:25 smithi007 bash[22722]: audit 2024-09-14T01:20:24.465042+0000 mgr.a (mgr.14355) 7765 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:25 smithi131 bash[24745]: audit 2024-09-14T01:20:24.465042+0000 mgr.a (mgr.14355) 7765 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:25 smithi171 bash[25040]: audit 2024-09-14T01:20:24.465042+0000 mgr.a (mgr.14355) 7765 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:26 smithi007 bash[22722]: cluster 2024-09-14T01:20:25.387655+0000 mgr.a (mgr.14355) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:26 smithi131 bash[24745]: cluster 2024-09-14T01:20:25.387655+0000 mgr.a (mgr.14355) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:26 smithi171 bash[25040]: cluster 2024-09-14T01:20:25.387655+0000 mgr.a (mgr.14355) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:28 smithi007 bash[22722]: cluster 2024-09-14T01:20:27.388461+0000 mgr.a (mgr.14355) 7767 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:28 smithi131 bash[24745]: cluster 2024-09-14T01:20:27.388461+0000 mgr.a (mgr.14355) 7767 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:28 smithi171 bash[25040]: cluster 2024-09-14T01:20:27.388461+0000 mgr.a (mgr.14355) 7767 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:30.631 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:30.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:30.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:30.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:30.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:30.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:30 smithi007 bash[22722]: cluster 2024-09-14T01:20:29.389254+0000 mgr.a (mgr.14355) 7768 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:30 smithi131 bash[24745]: cluster 2024-09-14T01:20:29.389254+0000 mgr.a (mgr.14355) 7768 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:30 smithi171 bash[25040]: cluster 2024-09-14T01:20:29.389254+0000 mgr.a (mgr.14355) 7768 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:31 smithi007 bash[22722]: audit 2024-09-14T01:20:30.225881+0000 mgr.a (mgr.14355) 7769 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:31 smithi131 bash[24745]: audit 2024-09-14T01:20:30.225881+0000 mgr.a (mgr.14355) 7769 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:31 smithi171 bash[25040]: audit 2024-09-14T01:20:30.225881+0000 mgr.a (mgr.14355) 7769 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:32 smithi007 bash[22722]: cluster 2024-09-14T01:20:31.392011+0000 mgr.a (mgr.14355) 7770 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:32 smithi131 bash[24745]: cluster 2024-09-14T01:20:31.392011+0000 mgr.a (mgr.14355) 7770 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:32 smithi171 bash[25040]: cluster 2024-09-14T01:20:31.392011+0000 mgr.a (mgr.14355) 7770 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:34 smithi007 bash[22722]: cluster 2024-09-14T01:20:33.392772+0000 mgr.a (mgr.14355) 7771 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:34 smithi131 bash[24745]: cluster 2024-09-14T01:20:33.392772+0000 mgr.a (mgr.14355) 7771 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:34 smithi171 bash[25040]: cluster 2024-09-14T01:20:33.392772+0000 mgr.a (mgr.14355) 7771 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:35.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:35.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:35.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:36.373 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:36 smithi007 bash[22722]: cluster 2024-09-14T01:20:35.394693+0000 mgr.a (mgr.14355) 7772 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:36 smithi131 bash[24745]: cluster 2024-09-14T01:20:35.394693+0000 mgr.a (mgr.14355) 7772 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:36 smithi171 bash[25040]: cluster 2024-09-14T01:20:35.394693+0000 mgr.a (mgr.14355) 7772 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:37 smithi131 bash[24745]: audit 2024-09-14T01:20:35.964667+0000 mgr.a (mgr.14355) 7773 : audit [DBG] from='client.175101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:37 smithi171 bash[25040]: audit 2024-09-14T01:20:35.964667+0000 mgr.a (mgr.14355) 7773 : audit [DBG] from='client.175101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:37 smithi007 bash[22722]: audit 2024-09-14T01:20:35.964667+0000 mgr.a (mgr.14355) 7773 : audit [DBG] from='client.175101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:38 smithi131 bash[24745]: cluster 2024-09-14T01:20:37.395548+0000 mgr.a (mgr.14355) 7774 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:38 smithi171 bash[25040]: cluster 2024-09-14T01:20:37.395548+0000 mgr.a (mgr.14355) 7774 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:38 smithi007 bash[22722]: cluster 2024-09-14T01:20:37.395548+0000 mgr.a (mgr.14355) 7774 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:20:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:40 smithi131 bash[24745]: cluster 2024-09-14T01:20:39.396445+0000 mgr.a (mgr.14355) 7775 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:40 smithi171 bash[25040]: cluster 2024-09-14T01:20:39.396445+0000 mgr.a (mgr.14355) 7775 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:40 smithi007 bash[22722]: cluster 2024-09-14T01:20:39.396445+0000 mgr.a (mgr.14355) 7775 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:20:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:41.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:42.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:42.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:42 smithi131 bash[24745]: cluster 2024-09-14T01:20:41.398849+0000 mgr.a (mgr.14355) 7776 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:42 smithi171 bash[25040]: cluster 2024-09-14T01:20:41.398849+0000 mgr.a (mgr.14355) 7776 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:42 smithi007 bash[22722]: cluster 2024-09-14T01:20:41.398849+0000 mgr.a (mgr.14355) 7776 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:43 smithi131 bash[24745]: audit 2024-09-14T01:20:41.712356+0000 mgr.a (mgr.14355) 7777 : audit [DBG] from='client.175176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:43 smithi171 bash[25040]: audit 2024-09-14T01:20:41.712356+0000 mgr.a (mgr.14355) 7777 : audit [DBG] from='client.175176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:43 smithi007 bash[22722]: audit 2024-09-14T01:20:41.712356+0000 mgr.a (mgr.14355) 7777 : audit [DBG] from='client.175176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:44 smithi131 bash[24745]: cluster 2024-09-14T01:20:43.399854+0000 mgr.a (mgr.14355) 7778 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:44 smithi171 bash[25040]: cluster 2024-09-14T01:20:43.399854+0000 mgr.a (mgr.14355) 7778 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:44 smithi007 bash[22722]: cluster 2024-09-14T01:20:43.399854+0000 mgr.a (mgr.14355) 7778 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:46 smithi131 bash[24745]: cluster 2024-09-14T01:20:45.402029+0000 mgr.a (mgr.14355) 7779 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:46 smithi171 bash[25040]: cluster 2024-09-14T01:20:45.402029+0000 mgr.a (mgr.14355) 7779 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:46 smithi007 bash[22722]: cluster 2024-09-14T01:20:45.402029+0000 mgr.a (mgr.14355) 7779 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:47.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:47.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:48 smithi131 bash[24745]: cluster 2024-09-14T01:20:47.402576+0000 mgr.a (mgr.14355) 7780 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:48 smithi131 bash[24745]: audit 2024-09-14T01:20:47.483252+0000 mgr.a (mgr.14355) 7781 : audit [DBG] from='client.175251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:48 smithi171 bash[25040]: cluster 2024-09-14T01:20:47.402576+0000 mgr.a (mgr.14355) 7780 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:48 smithi171 bash[25040]: audit 2024-09-14T01:20:47.483252+0000 mgr.a (mgr.14355) 7781 : audit [DBG] from='client.175251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:48 smithi007 bash[22722]: cluster 2024-09-14T01:20:47.402576+0000 mgr.a (mgr.14355) 7780 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:48 smithi007 bash[22722]: audit 2024-09-14T01:20:47.483252+0000 mgr.a (mgr.14355) 7781 : audit [DBG] from='client.175251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:50 smithi131 bash[24745]: cluster 2024-09-14T01:20:49.403676+0000 mgr.a (mgr.14355) 7782 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:50 smithi171 bash[25040]: cluster 2024-09-14T01:20:49.403676+0000 mgr.a (mgr.14355) 7782 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:50 smithi007 bash[22722]: cluster 2024-09-14T01:20:49.403676+0000 mgr.a (mgr.14355) 7782 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:52 smithi131 bash[24745]: cluster 2024-09-14T01:20:51.406078+0000 mgr.a (mgr.14355) 7783 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:52 smithi171 bash[25040]: cluster 2024-09-14T01:20:51.406078+0000 mgr.a (mgr.14355) 7783 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:52.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:52.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:52.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:52 smithi007 bash[22722]: cluster 2024-09-14T01:20:51.406078+0000 mgr.a (mgr.14355) 7783 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:20:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:54 smithi131 bash[24745]: audit 2024-09-14T01:20:53.266431+0000 mgr.a (mgr.14355) 7784 : audit [DBG] from='client.175323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:54 smithi131 bash[24745]: cluster 2024-09-14T01:20:53.406679+0000 mgr.a (mgr.14355) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:54 smithi171 bash[25040]: audit 2024-09-14T01:20:53.266431+0000 mgr.a (mgr.14355) 7784 : audit [DBG] from='client.175323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:54 smithi171 bash[25040]: cluster 2024-09-14T01:20:53.406679+0000 mgr.a (mgr.14355) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:54 smithi007 bash[22722]: audit 2024-09-14T01:20:53.266431+0000 mgr.a (mgr.14355) 7784 : audit [DBG] from='client.175323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:20:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:54 smithi007 bash[22722]: cluster 2024-09-14T01:20:53.406679+0000 mgr.a (mgr.14355) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:56 smithi131 bash[24745]: cluster 2024-09-14T01:20:55.408922+0000 mgr.a (mgr.14355) 7786 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:56 smithi171 bash[25040]: cluster 2024-09-14T01:20:55.408922+0000 mgr.a (mgr.14355) 7786 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:56 smithi007 bash[22722]: cluster 2024-09-14T01:20:55.408922+0000 mgr.a (mgr.14355) 7786 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:20:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:20:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:20:58.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:20:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:20:58 smithi131 bash[24745]: cluster 2024-09-14T01:20:57.409827+0000 mgr.a (mgr.14355) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:20:58 smithi171 bash[25040]: cluster 2024-09-14T01:20:57.409827+0000 mgr.a (mgr.14355) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:20:58 smithi007 bash[22722]: cluster 2024-09-14T01:20:57.409827+0000 mgr.a (mgr.14355) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:20:59.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:20:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:20:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:20:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:20:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:00 smithi131 bash[24745]: audit 2024-09-14T01:20:59.014406+0000 mgr.a (mgr.14355) 7788 : audit [DBG] from='client.175401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:00 smithi131 bash[24745]: cluster 2024-09-14T01:20:59.410429+0000 mgr.a (mgr.14355) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:00 smithi171 bash[25040]: audit 2024-09-14T01:20:59.014406+0000 mgr.a (mgr.14355) 7788 : audit [DBG] from='client.175401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:00 smithi171 bash[25040]: cluster 2024-09-14T01:20:59.410429+0000 mgr.a (mgr.14355) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:00 smithi007 bash[22722]: audit 2024-09-14T01:20:59.014406+0000 mgr.a (mgr.14355) 7788 : audit [DBG] from='client.175401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:00 smithi007 bash[22722]: cluster 2024-09-14T01:20:59.410429+0000 mgr.a (mgr.14355) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:02 smithi131 bash[24745]: cluster 2024-09-14T01:21:01.412581+0000 mgr.a (mgr.14355) 7790 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:02 smithi171 bash[25040]: cluster 2024-09-14T01:21:01.412581+0000 mgr.a (mgr.14355) 7790 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:02 smithi007 bash[22722]: cluster 2024-09-14T01:21:01.412581+0000 mgr.a (mgr.14355) 7790 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:04.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:04.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:04 smithi131 bash[24745]: cluster 2024-09-14T01:21:03.413336+0000 mgr.a (mgr.14355) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:04 smithi171 bash[25040]: cluster 2024-09-14T01:21:03.413336+0000 mgr.a (mgr.14355) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:04.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:04 smithi007 bash[22722]: cluster 2024-09-14T01:21:03.413336+0000 mgr.a (mgr.14355) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:05.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:05.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:05.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:06 smithi131 bash[24745]: audit 2024-09-14T01:21:04.787224+0000 mgr.a (mgr.14355) 7792 : audit [DBG] from='client.175479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:06 smithi131 bash[24745]: cluster 2024-09-14T01:21:05.415653+0000 mgr.a (mgr.14355) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:06 smithi171 bash[25040]: audit 2024-09-14T01:21:04.787224+0000 mgr.a (mgr.14355) 7792 : audit [DBG] from='client.175479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:06 smithi171 bash[25040]: cluster 2024-09-14T01:21:05.415653+0000 mgr.a (mgr.14355) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:06 smithi007 bash[22722]: audit 2024-09-14T01:21:04.787224+0000 mgr.a (mgr.14355) 7792 : audit [DBG] from='client.175479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:06 smithi007 bash[22722]: cluster 2024-09-14T01:21:05.415653+0000 mgr.a (mgr.14355) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:08 smithi131 bash[24745]: cluster 2024-09-14T01:21:07.416416+0000 mgr.a (mgr.14355) 7794 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:08 smithi171 bash[25040]: cluster 2024-09-14T01:21:07.416416+0000 mgr.a (mgr.14355) 7794 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:08 smithi007 bash[22722]: cluster 2024-09-14T01:21:07.416416+0000 mgr.a (mgr.14355) 7794 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:09 smithi171 bash[25040]: audit 2024-09-14T01:21:08.937516+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:21:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:09 smithi171 bash[25040]: cluster 2024-09-14T01:21:09.416958+0000 mgr.a (mgr.14355) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:09 smithi007 bash[22722]: audit 2024-09-14T01:21:08.937516+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:21:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:09 smithi007 bash[22722]: cluster 2024-09-14T01:21:09.416958+0000 mgr.a (mgr.14355) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:09 smithi131 bash[24745]: audit 2024-09-14T01:21:08.937516+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:21:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:09 smithi131 bash[24745]: cluster 2024-09-14T01:21:09.416958+0000 mgr.a (mgr.14355) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:10.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:10.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:10 smithi171 bash[25040]: audit 2024-09-14T01:21:10.513625+0000 mgr.a (mgr.14355) 7796 : audit [DBG] from='client.175557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:10.927 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:10.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:10.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:10 smithi007 bash[22722]: audit 2024-09-14T01:21:10.513625+0000 mgr.a (mgr.14355) 7796 : audit [DBG] from='client.175557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:10 smithi131 bash[24745]: audit 2024-09-14T01:21:10.513625+0000 mgr.a (mgr.14355) 7796 : audit [DBG] from='client.175557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:11 smithi007 bash[22722]: cluster 2024-09-14T01:21:11.419752+0000 mgr.a (mgr.14355) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:11 smithi131 bash[24745]: cluster 2024-09-14T01:21:11.419752+0000 mgr.a (mgr.14355) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:11 smithi171 bash[25040]: cluster 2024-09-14T01:21:11.419752+0000 mgr.a (mgr.14355) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:14 smithi131 bash[24745]: cluster 2024-09-14T01:21:13.420570+0000 mgr.a (mgr.14355) 7798 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:14 smithi171 bash[25040]: cluster 2024-09-14T01:21:13.420570+0000 mgr.a (mgr.14355) 7798 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:14.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:14 smithi007 bash[22722]: cluster 2024-09-14T01:21:13.420570+0000 mgr.a (mgr.14355) 7798 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:16.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:16.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:16.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:16.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:16 smithi007 bash[22722]: cluster 2024-09-14T01:21:15.422539+0000 mgr.a (mgr.14355) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:16 smithi131 bash[24745]: cluster 2024-09-14T01:21:15.422539+0000 mgr.a (mgr.14355) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:16 smithi171 bash[25040]: cluster 2024-09-14T01:21:15.422539+0000 mgr.a (mgr.14355) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:17.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:17 smithi007 bash[22722]: audit 2024-09-14T01:21:16.249579+0000 mgr.a (mgr.14355) 7800 : audit [DBG] from='client.175635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:17 smithi131 bash[24745]: audit 2024-09-14T01:21:16.249579+0000 mgr.a (mgr.14355) 7800 : audit [DBG] from='client.175635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:17 smithi171 bash[25040]: audit 2024-09-14T01:21:16.249579+0000 mgr.a (mgr.14355) 7800 : audit [DBG] from='client.175635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:18 smithi131 bash[24745]: cluster 2024-09-14T01:21:17.423504+0000 mgr.a (mgr.14355) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:18 smithi171 bash[25040]: cluster 2024-09-14T01:21:17.423504+0000 mgr.a (mgr.14355) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:18.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:18 smithi007 bash[22722]: cluster 2024-09-14T01:21:17.423504+0000 mgr.a (mgr.14355) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:20.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22972]: debug 2024-09-14T01:21:20.346+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:21:20.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22972]: debug 2024-09-14T01:21:20.350+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:21:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: cluster 2024-09-14T01:21:19.424331+0000 mgr.a (mgr.14355) 7802 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.534227+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.540742+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.542480+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.544082+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.552453+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:20 smithi007 bash[22722]: audit 2024-09-14T01:21:19.556661+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: cluster 2024-09-14T01:21:19.424331+0000 mgr.a (mgr.14355) 7802 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.534227+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.540742+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.542480+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.544082+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.552453+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:20.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:20 smithi171 bash[25040]: audit 2024-09-14T01:21:19.556661+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: cluster 2024-09-14T01:21:19.424331+0000 mgr.a (mgr.14355) 7802 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.534227+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.540742+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.542480+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:21:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.544082+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:21:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.552453+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:21:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:20 smithi131 bash[24745]: audit 2024-09-14T01:21:19.556661+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:21.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:21.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:21 smithi171 bash[25040]: audit 2024-09-14T01:21:19.559196+0000 mgr.a (mgr.14355) 7803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:21 smithi171 bash[25040]: audit 2024-09-14T01:21:20.349577+0000 mgr.a (mgr.14355) 7804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:21:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:21 smithi171 bash[25040]: cephadm 2024-09-14T01:21:20.351116+0000 mgr.a (mgr.14355) 7805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:21:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:21 smithi007 bash[22722]: audit 2024-09-14T01:21:19.559196+0000 mgr.a (mgr.14355) 7803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:21 smithi007 bash[22722]: audit 2024-09-14T01:21:20.349577+0000 mgr.a (mgr.14355) 7804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:21:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:21 smithi007 bash[22722]: cephadm 2024-09-14T01:21:20.351116+0000 mgr.a (mgr.14355) 7805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:21:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:21 smithi131 bash[24745]: audit 2024-09-14T01:21:19.559196+0000 mgr.a (mgr.14355) 7803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:21:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:21 smithi131 bash[24745]: audit 2024-09-14T01:21:20.349577+0000 mgr.a (mgr.14355) 7804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:21:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:21 smithi131 bash[24745]: cephadm 2024-09-14T01:21:20.351116+0000 mgr.a (mgr.14355) 7805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:21:22.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:22.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:22 smithi171 bash[25040]: cluster 2024-09-14T01:21:21.426785+0000 mgr.a (mgr.14355) 7806 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:22 smithi171 bash[25040]: audit 2024-09-14T01:21:22.006414+0000 mgr.a (mgr.14355) 7807 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:22 smithi007 bash[22722]: cluster 2024-09-14T01:21:21.426785+0000 mgr.a (mgr.14355) 7806 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:22 smithi007 bash[22722]: audit 2024-09-14T01:21:22.006414+0000 mgr.a (mgr.14355) 7807 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:22 smithi131 bash[24745]: cluster 2024-09-14T01:21:21.426785+0000 mgr.a (mgr.14355) 7806 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:22 smithi131 bash[24745]: audit 2024-09-14T01:21:22.006414+0000 mgr.a (mgr.14355) 7807 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:23 smithi007 bash[22722]: cluster 2024-09-14T01:21:23.427760+0000 mgr.a (mgr.14355) 7808 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:23 smithi131 bash[24745]: cluster 2024-09-14T01:21:23.427760+0000 mgr.a (mgr.14355) 7808 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:23 smithi171 bash[25040]: cluster 2024-09-14T01:21:23.427760+0000 mgr.a (mgr.14355) 7808 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:26 smithi131 bash[24745]: cluster 2024-09-14T01:21:25.429971+0000 mgr.a (mgr.14355) 7809 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:26 smithi171 bash[25040]: cluster 2024-09-14T01:21:25.429971+0000 mgr.a (mgr.14355) 7809 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:26 smithi007 bash[22722]: cluster 2024-09-14T01:21:25.429971+0000 mgr.a (mgr.14355) 7809 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:27.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:27.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:28.225 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:28 smithi131 bash[24745]: cluster 2024-09-14T01:21:27.430764+0000 mgr.a (mgr.14355) 7810 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:28 smithi171 bash[25040]: cluster 2024-09-14T01:21:27.430764+0000 mgr.a (mgr.14355) 7810 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:28 smithi007 bash[22722]: cluster 2024-09-14T01:21:27.430764+0000 mgr.a (mgr.14355) 7810 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:29 smithi131 bash[24745]: audit 2024-09-14T01:21:27.787043+0000 mgr.a (mgr.14355) 7811 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:29 smithi171 bash[25040]: audit 2024-09-14T01:21:27.787043+0000 mgr.a (mgr.14355) 7811 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:29 smithi007 bash[22722]: audit 2024-09-14T01:21:27.787043+0000 mgr.a (mgr.14355) 7811 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:30 smithi131 bash[24745]: cluster 2024-09-14T01:21:29.431728+0000 mgr.a (mgr.14355) 7812 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:30 smithi171 bash[25040]: cluster 2024-09-14T01:21:29.431728+0000 mgr.a (mgr.14355) 7812 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:30 smithi007 bash[22722]: cluster 2024-09-14T01:21:29.431728+0000 mgr.a (mgr.14355) 7812 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:32 smithi131 bash[24745]: cluster 2024-09-14T01:21:31.433963+0000 mgr.a (mgr.14355) 7813 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:32 smithi171 bash[25040]: cluster 2024-09-14T01:21:31.433963+0000 mgr.a (mgr.14355) 7813 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:32 smithi007 bash[22722]: cluster 2024-09-14T01:21:31.433963+0000 mgr.a (mgr.14355) 7813 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:21:33.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:33.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:33.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:33.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:33.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:33.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:33.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:33.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:34 smithi131 bash[24745]: cluster 2024-09-14T01:21:33.434628+0000 mgr.a (mgr.14355) 7814 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:34 smithi171 bash[25040]: cluster 2024-09-14T01:21:33.434628+0000 mgr.a (mgr.14355) 7814 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:34 smithi007 bash[22722]: cluster 2024-09-14T01:21:33.434628+0000 mgr.a (mgr.14355) 7814 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:35 smithi131 bash[24745]: audit 2024-09-14T01:21:33.565834+0000 mgr.a (mgr.14355) 7815 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:35 smithi171 bash[25040]: audit 2024-09-14T01:21:33.565834+0000 mgr.a (mgr.14355) 7815 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:35 smithi007 bash[22722]: audit 2024-09-14T01:21:33.565834+0000 mgr.a (mgr.14355) 7815 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:36 smithi131 bash[24745]: cluster 2024-09-14T01:21:35.436824+0000 mgr.a (mgr.14355) 7816 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:36 smithi171 bash[25040]: cluster 2024-09-14T01:21:35.436824+0000 mgr.a (mgr.14355) 7816 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:36 smithi007 bash[22722]: cluster 2024-09-14T01:21:35.436824+0000 mgr.a (mgr.14355) 7816 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:38 smithi131 bash[24745]: cluster 2024-09-14T01:21:37.437602+0000 mgr.a (mgr.14355) 7817 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:38 smithi171 bash[25040]: cluster 2024-09-14T01:21:37.437602+0000 mgr.a (mgr.14355) 7817 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:38 smithi007 bash[22722]: cluster 2024-09-14T01:21:37.437602+0000 mgr.a (mgr.14355) 7817 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:39.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:39.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:39.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:39.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:40 smithi131 bash[24745]: audit 2024-09-14T01:21:39.322770+0000 mgr.a (mgr.14355) 7818 : audit [DBG] from='client.176043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:40 smithi131 bash[24745]: cluster 2024-09-14T01:21:39.438332+0000 mgr.a (mgr.14355) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:40 smithi171 bash[25040]: audit 2024-09-14T01:21:39.322770+0000 mgr.a (mgr.14355) 7818 : audit [DBG] from='client.176043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:40 smithi171 bash[25040]: cluster 2024-09-14T01:21:39.438332+0000 mgr.a (mgr.14355) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:40 smithi007 bash[22722]: audit 2024-09-14T01:21:39.322770+0000 mgr.a (mgr.14355) 7818 : audit [DBG] from='client.176043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:40 smithi007 bash[22722]: cluster 2024-09-14T01:21:39.438332+0000 mgr.a (mgr.14355) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:42 smithi171 bash[25040]: cluster 2024-09-14T01:21:41.440615+0000 mgr.a (mgr.14355) 7820 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:42 smithi007 bash[22722]: cluster 2024-09-14T01:21:41.440615+0000 mgr.a (mgr.14355) 7820 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:42 smithi131 bash[24745]: cluster 2024-09-14T01:21:41.440615+0000 mgr.a (mgr.14355) 7820 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:21:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:44.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:44 smithi171 bash[25040]: cluster 2024-09-14T01:21:43.441409+0000 mgr.a (mgr.14355) 7821 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:44 smithi007 bash[22722]: cluster 2024-09-14T01:21:43.441409+0000 mgr.a (mgr.14355) 7821 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:44 smithi131 bash[24745]: cluster 2024-09-14T01:21:43.441409+0000 mgr.a (mgr.14355) 7821 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:45.520 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:46 smithi171 bash[25040]: audit 2024-09-14T01:21:45.079196+0000 mgr.a (mgr.14355) 7822 : audit [DBG] from='client.176121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:46 smithi171 bash[25040]: cluster 2024-09-14T01:21:45.442807+0000 mgr.a (mgr.14355) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:46 smithi007 bash[22722]: audit 2024-09-14T01:21:45.079196+0000 mgr.a (mgr.14355) 7822 : audit [DBG] from='client.176121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:46 smithi007 bash[22722]: cluster 2024-09-14T01:21:45.442807+0000 mgr.a (mgr.14355) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:46 smithi131 bash[24745]: audit 2024-09-14T01:21:45.079196+0000 mgr.a (mgr.14355) 7822 : audit [DBG] from='client.176121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:46 smithi131 bash[24745]: cluster 2024-09-14T01:21:45.442807+0000 mgr.a (mgr.14355) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:48 smithi131 bash[24745]: cluster 2024-09-14T01:21:47.443564+0000 mgr.a (mgr.14355) 7824 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:48 smithi171 bash[25040]: cluster 2024-09-14T01:21:47.443564+0000 mgr.a (mgr.14355) 7824 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:48 smithi007 bash[22722]: cluster 2024-09-14T01:21:47.443564+0000 mgr.a (mgr.14355) 7824 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:50.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:50.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:50 smithi131 bash[24745]: cluster 2024-09-14T01:21:49.444503+0000 mgr.a (mgr.14355) 7825 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:50 smithi171 bash[25040]: cluster 2024-09-14T01:21:49.444503+0000 mgr.a (mgr.14355) 7825 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:50 smithi007 bash[22722]: cluster 2024-09-14T01:21:49.444503+0000 mgr.a (mgr.14355) 7825 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:21:51.301 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:51.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:51.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:51.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:51.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:52 smithi131 bash[24745]: audit 2024-09-14T01:21:50.858072+0000 mgr.a (mgr.14355) 7826 : audit [DBG] from='client.176199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:52 smithi131 bash[24745]: cluster 2024-09-14T01:21:51.447420+0000 mgr.a (mgr.14355) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:52 smithi171 bash[25040]: audit 2024-09-14T01:21:50.858072+0000 mgr.a (mgr.14355) 7826 : audit [DBG] from='client.176199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:52 smithi171 bash[25040]: cluster 2024-09-14T01:21:51.447420+0000 mgr.a (mgr.14355) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:52 smithi007 bash[22722]: audit 2024-09-14T01:21:50.858072+0000 mgr.a (mgr.14355) 7826 : audit [DBG] from='client.176199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:52 smithi007 bash[22722]: cluster 2024-09-14T01:21:51.447420+0000 mgr.a (mgr.14355) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:54 smithi131 bash[24745]: cluster 2024-09-14T01:21:53.448225+0000 mgr.a (mgr.14355) 7828 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:54 smithi171 bash[25040]: cluster 2024-09-14T01:21:53.448225+0000 mgr.a (mgr.14355) 7828 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:54 smithi007 bash[22722]: cluster 2024-09-14T01:21:53.448225+0000 mgr.a (mgr.14355) 7828 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:21:56.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:21:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:21:56.304 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:21:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:56 smithi131 bash[24745]: cluster 2024-09-14T01:21:55.450145+0000 mgr.a (mgr.14355) 7829 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:56 smithi171 bash[25040]: cluster 2024-09-14T01:21:55.450145+0000 mgr.a (mgr.14355) 7829 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:56.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:56 smithi007 bash[22722]: cluster 2024-09-14T01:21:55.450145+0000 mgr.a (mgr.14355) 7829 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:57.061 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:21:57.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:21:57.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:21:57.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:21:57.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:21:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:58 smithi131 bash[24745]: audit 2024-09-14T01:21:56.637443+0000 mgr.a (mgr.14355) 7830 : audit [DBG] from='client.176274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:21:58 smithi131 bash[24745]: cluster 2024-09-14T01:21:57.451275+0000 mgr.a (mgr.14355) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:58 smithi171 bash[25040]: audit 2024-09-14T01:21:56.637443+0000 mgr.a (mgr.14355) 7830 : audit [DBG] from='client.176274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:21:58 smithi171 bash[25040]: cluster 2024-09-14T01:21:57.451275+0000 mgr.a (mgr.14355) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:21:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:58 smithi007 bash[22722]: audit 2024-09-14T01:21:56.637443+0000 mgr.a (mgr.14355) 7830 : audit [DBG] from='client.176274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:21:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:21:58 smithi007 bash[22722]: cluster 2024-09-14T01:21:57.451275+0000 mgr.a (mgr.14355) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:00 smithi131 bash[24745]: cluster 2024-09-14T01:21:59.452153+0000 mgr.a (mgr.14355) 7832 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:00 smithi171 bash[25040]: cluster 2024-09-14T01:21:59.452153+0000 mgr.a (mgr.14355) 7832 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:00 smithi007 bash[22722]: cluster 2024-09-14T01:21:59.452153+0000 mgr.a (mgr.14355) 7832 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 133 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:02 smithi131 bash[24745]: cluster 2024-09-14T01:22:01.454385+0000 mgr.a (mgr.14355) 7833 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:02 smithi171 bash[25040]: cluster 2024-09-14T01:22:01.454385+0000 mgr.a (mgr.14355) 7833 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:02.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:02.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:02.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:02.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:02 smithi007 bash[22722]: cluster 2024-09-14T01:22:01.454385+0000 mgr.a (mgr.14355) 7833 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:03 smithi131 bash[24745]: audit 2024-09-14T01:22:02.393088+0000 mgr.a (mgr.14355) 7834 : audit [DBG] from='client.176352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:03 smithi171 bash[25040]: audit 2024-09-14T01:22:02.393088+0000 mgr.a (mgr.14355) 7834 : audit [DBG] from='client.176352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:03 smithi007 bash[22722]: audit 2024-09-14T01:22:02.393088+0000 mgr.a (mgr.14355) 7834 : audit [DBG] from='client.176352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:04 smithi171 bash[25040]: cluster 2024-09-14T01:22:03.455348+0000 mgr.a (mgr.14355) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:04 smithi007 bash[22722]: cluster 2024-09-14T01:22:03.455348+0000 mgr.a (mgr.14355) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:04 smithi131 bash[24745]: cluster 2024-09-14T01:22:03.455348+0000 mgr.a (mgr.14355) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:05 smithi007 bash[22722]: cluster 2024-09-14T01:22:05.457546+0000 mgr.a (mgr.14355) 7836 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:05 smithi131 bash[24745]: cluster 2024-09-14T01:22:05.457546+0000 mgr.a (mgr.14355) 7836 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:05 smithi171 bash[25040]: cluster 2024-09-14T01:22:05.457546+0000 mgr.a (mgr.14355) 7836 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T01:22:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:07.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:08.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:08 smithi131 bash[24745]: cluster 2024-09-14T01:22:07.458496+0000 mgr.a (mgr.14355) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:08 smithi171 bash[25040]: cluster 2024-09-14T01:22:07.458496+0000 mgr.a (mgr.14355) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:08 smithi007 bash[22722]: cluster 2024-09-14T01:22:07.458496+0000 mgr.a (mgr.14355) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:09 smithi131 bash[24745]: audit 2024-09-14T01:22:08.140713+0000 mgr.a (mgr.14355) 7838 : audit [DBG] from='client.176430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:09 smithi171 bash[25040]: audit 2024-09-14T01:22:08.140713+0000 mgr.a (mgr.14355) 7838 : audit [DBG] from='client.176430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:09 smithi007 bash[22722]: audit 2024-09-14T01:22:08.140713+0000 mgr.a (mgr.14355) 7838 : audit [DBG] from='client.176430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:10 smithi131 bash[24745]: cluster 2024-09-14T01:22:09.459535+0000 mgr.a (mgr.14355) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:10 smithi171 bash[25040]: cluster 2024-09-14T01:22:09.459535+0000 mgr.a (mgr.14355) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:10 smithi007 bash[22722]: cluster 2024-09-14T01:22:09.459535+0000 mgr.a (mgr.14355) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T01:22:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:12 smithi131 bash[24745]: cluster 2024-09-14T01:22:11.461817+0000 mgr.a (mgr.14355) 7840 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-14T01:22:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:12 smithi171 bash[25040]: cluster 2024-09-14T01:22:11.461817+0000 mgr.a (mgr.14355) 7840 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-14T01:22:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:12 smithi007 bash[22722]: cluster 2024-09-14T01:22:11.461817+0000 mgr.a (mgr.14355) 7840 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-14T01:22:13.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:13.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:14.342 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:14 smithi171 bash[25040]: cluster 2024-09-14T01:22:13.462616+0000 mgr.a (mgr.14355) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:14 smithi007 bash[22722]: cluster 2024-09-14T01:22:13.462616+0000 mgr.a (mgr.14355) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:14 smithi131 bash[24745]: cluster 2024-09-14T01:22:13.462616+0000 mgr.a (mgr.14355) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:15 smithi171 bash[25040]: audit 2024-09-14T01:22:13.915957+0000 mgr.a (mgr.14355) 7842 : audit [DBG] from='client.176505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:15 smithi007 bash[22722]: audit 2024-09-14T01:22:13.915957+0000 mgr.a (mgr.14355) 7842 : audit [DBG] from='client.176505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:15 smithi131 bash[24745]: audit 2024-09-14T01:22:13.915957+0000 mgr.a (mgr.14355) 7842 : audit [DBG] from='client.176505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:16 smithi171 bash[25040]: cluster 2024-09-14T01:22:15.464892+0000 mgr.a (mgr.14355) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:16 smithi007 bash[22722]: cluster 2024-09-14T01:22:15.464892+0000 mgr.a (mgr.14355) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:16 smithi131 bash[24745]: cluster 2024-09-14T01:22:15.464892+0000 mgr.a (mgr.14355) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:17 smithi007 bash[22722]: cluster 2024-09-14T01:22:17.465668+0000 mgr.a (mgr.14355) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:17 smithi131 bash[24745]: cluster 2024-09-14T01:22:17.465668+0000 mgr.a (mgr.14355) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:17 smithi171 bash[25040]: cluster 2024-09-14T01:22:17.465668+0000 mgr.a (mgr.14355) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:20.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:20 smithi131 bash[24745]: cluster 2024-09-14T01:22:19.466128+0000 mgr.a (mgr.14355) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:20 smithi131 bash[24745]: audit 2024-09-14T01:22:20.429429+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:22:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:20 smithi171 bash[25040]: cluster 2024-09-14T01:22:19.466128+0000 mgr.a (mgr.14355) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:20 smithi171 bash[25040]: audit 2024-09-14T01:22:20.429429+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:22:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:20 smithi007 bash[22722]: cluster 2024-09-14T01:22:19.466128+0000 mgr.a (mgr.14355) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:22:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:20 smithi007 bash[22722]: audit 2024-09-14T01:22:20.429429+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:22:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:21 smithi131 bash[24745]: audit 2024-09-14T01:22:19.677460+0000 mgr.a (mgr.14355) 7846 : audit [DBG] from='client.176583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:21 smithi171 bash[25040]: audit 2024-09-14T01:22:19.677460+0000 mgr.a (mgr.14355) 7846 : audit [DBG] from='client.176583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:21 smithi007 bash[22722]: audit 2024-09-14T01:22:19.677460+0000 mgr.a (mgr.14355) 7846 : audit [DBG] from='client.176583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:22 smithi131 bash[24745]: cluster 2024-09-14T01:22:21.468400+0000 mgr.a (mgr.14355) 7847 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:22 smithi171 bash[25040]: cluster 2024-09-14T01:22:21.468400+0000 mgr.a (mgr.14355) 7847 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:22 smithi007 bash[22722]: cluster 2024-09-14T01:22:21.468400+0000 mgr.a (mgr.14355) 7847 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:22:24.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:24 smithi171 bash[25040]: cluster 2024-09-14T01:22:23.469180+0000 mgr.a (mgr.14355) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:24 smithi007 bash[22722]: cluster 2024-09-14T01:22:23.469180+0000 mgr.a (mgr.14355) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:24 smithi131 bash[24745]: cluster 2024-09-14T01:22:23.469180+0000 mgr.a (mgr.14355) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:25.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:25.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:25.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:25.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:25.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:26 smithi131 bash[24745]: audit 2024-09-14T01:22:25.436851+0000 mgr.a (mgr.14355) 7849 : audit [DBG] from='client.176661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:26 smithi131 bash[24745]: cluster 2024-09-14T01:22:25.472188+0000 mgr.a (mgr.14355) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:26 smithi171 bash[25040]: audit 2024-09-14T01:22:25.436851+0000 mgr.a (mgr.14355) 7849 : audit [DBG] from='client.176661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:26 smithi171 bash[25040]: cluster 2024-09-14T01:22:25.472188+0000 mgr.a (mgr.14355) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:26 smithi007 bash[22722]: audit 2024-09-14T01:22:25.436851+0000 mgr.a (mgr.14355) 7849 : audit [DBG] from='client.176661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:26 smithi007 bash[22722]: cluster 2024-09-14T01:22:25.472188+0000 mgr.a (mgr.14355) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:28 smithi171 bash[25040]: cluster 2024-09-14T01:22:27.473154+0000 mgr.a (mgr.14355) 7851 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:28.948 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:28 smithi131 bash[24745]: cluster 2024-09-14T01:22:27.473154+0000 mgr.a (mgr.14355) 7851 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:28 smithi007 bash[22722]: cluster 2024-09-14T01:22:27.473154+0000 mgr.a (mgr.14355) 7851 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:30.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:30.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:30 smithi007 bash[22722]: cluster 2024-09-14T01:22:29.473958+0000 mgr.a (mgr.14355) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:22:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:30 smithi131 bash[24745]: cluster 2024-09-14T01:22:29.473958+0000 mgr.a (mgr.14355) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:22:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:30 smithi171 bash[25040]: cluster 2024-09-14T01:22:29.473958+0000 mgr.a (mgr.14355) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22972]: debug 2024-09-14T01:22:31.684+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22972]: debug 2024-09-14T01:22:31.696+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.635228+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.643796+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.967316+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.972318+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.973372+0000 mon.a (mon.0) 1773 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.974320+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.979566+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.981758+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:30.983109+0000 mgr.a (mgr.14355) 7853 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: audit 2024-09-14T01:22:31.199881+0000 mgr.a (mgr.14355) 7854 : audit [DBG] from='client.176739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:31 smithi007 bash[22722]: cluster 2024-09-14T01:22:31.476891+0000 mgr.a (mgr.14355) 7855 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.635228+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.643796+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.967316+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.972318+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.973372+0000 mon.a (mon.0) 1773 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.974320+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.979566+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.981758+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:30.983109+0000 mgr.a (mgr.14355) 7853 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: audit 2024-09-14T01:22:31.199881+0000 mgr.a (mgr.14355) 7854 : audit [DBG] from='client.176739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:31 smithi131 bash[24745]: cluster 2024-09-14T01:22:31.476891+0000 mgr.a (mgr.14355) 7855 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.635228+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.643796+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.967316+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.972318+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.973372+0000 mon.a (mon.0) 1773 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.974320+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.979566+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.981758+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:30.983109+0000 mgr.a (mgr.14355) 7853 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: audit 2024-09-14T01:22:31.199881+0000 mgr.a (mgr.14355) 7854 : audit [DBG] from='client.176739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:31 smithi171 bash[25040]: cluster 2024-09-14T01:22:31.476891+0000 mgr.a (mgr.14355) 7855 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:32.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:32.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:32 smithi131 bash[24745]: audit 2024-09-14T01:22:31.687194+0000 mgr.a (mgr.14355) 7856 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:22:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:32 smithi131 bash[24745]: cephadm 2024-09-14T01:22:31.698910+0000 mgr.a (mgr.14355) 7857 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:22:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:32 smithi171 bash[25040]: audit 2024-09-14T01:22:31.687194+0000 mgr.a (mgr.14355) 7856 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:22:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:32 smithi171 bash[25040]: cephadm 2024-09-14T01:22:31.698910+0000 mgr.a (mgr.14355) 7857 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:22:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:32 smithi007 bash[22722]: audit 2024-09-14T01:22:31.687194+0000 mgr.a (mgr.14355) 7856 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:22:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:32 smithi007 bash[22722]: cephadm 2024-09-14T01:22:31.698910+0000 mgr.a (mgr.14355) 7857 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:22:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:33 smithi131 bash[24745]: cluster 2024-09-14T01:22:33.477776+0000 mgr.a (mgr.14355) 7858 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:33 smithi171 bash[25040]: cluster 2024-09-14T01:22:33.477776+0000 mgr.a (mgr.14355) 7858 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:33 smithi007 bash[22722]: cluster 2024-09-14T01:22:33.477776+0000 mgr.a (mgr.14355) 7858 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:22:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:36 smithi171 bash[25040]: cluster 2024-09-14T01:22:35.480070+0000 mgr.a (mgr.14355) 7859 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:36 smithi007 bash[22722]: cluster 2024-09-14T01:22:35.480070+0000 mgr.a (mgr.14355) 7859 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:36 smithi131 bash[24745]: cluster 2024-09-14T01:22:35.480070+0000 mgr.a (mgr.14355) 7859 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:37.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:37.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:37.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:37.871 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:37.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:37.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:37.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:37.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:38 smithi171 bash[25040]: audit 2024-09-14T01:22:37.432231+0000 mgr.a (mgr.14355) 7860 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:38 smithi171 bash[25040]: cluster 2024-09-14T01:22:37.481228+0000 mgr.a (mgr.14355) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:38.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:38 smithi007 bash[22722]: audit 2024-09-14T01:22:37.432231+0000 mgr.a (mgr.14355) 7860 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:38.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:38 smithi007 bash[22722]: cluster 2024-09-14T01:22:37.481228+0000 mgr.a (mgr.14355) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:38 smithi131 bash[24745]: audit 2024-09-14T01:22:37.432231+0000 mgr.a (mgr.14355) 7860 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:38 smithi131 bash[24745]: cluster 2024-09-14T01:22:37.481228+0000 mgr.a (mgr.14355) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:40 smithi171 bash[25040]: cluster 2024-09-14T01:22:39.482190+0000 mgr.a (mgr.14355) 7862 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:40 smithi007 bash[22722]: cluster 2024-09-14T01:22:39.482190+0000 mgr.a (mgr.14355) 7862 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:40 smithi131 bash[24745]: cluster 2024-09-14T01:22:39.482190+0000 mgr.a (mgr.14355) 7862 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:42.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:42.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:42.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:42 smithi007 bash[22722]: cluster 2024-09-14T01:22:41.484475+0000 mgr.a (mgr.14355) 7863 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:42 smithi131 bash[24745]: cluster 2024-09-14T01:22:41.484475+0000 mgr.a (mgr.14355) 7863 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:42 smithi171 bash[25040]: cluster 2024-09-14T01:22:41.484475+0000 mgr.a (mgr.14355) 7863 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:43.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:43.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:43.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:43.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:43.619 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:43 smithi007 bash[22722]: audit 2024-09-14T01:22:43.198496+0000 mgr.a (mgr.14355) 7864 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:43 smithi007 bash[22722]: cluster 2024-09-14T01:22:43.485042+0000 mgr.a (mgr.14355) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:43 smithi131 bash[24745]: audit 2024-09-14T01:22:43.198496+0000 mgr.a (mgr.14355) 7864 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:43 smithi131 bash[24745]: cluster 2024-09-14T01:22:43.485042+0000 mgr.a (mgr.14355) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:43 smithi171 bash[25040]: audit 2024-09-14T01:22:43.198496+0000 mgr.a (mgr.14355) 7864 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:43 smithi171 bash[25040]: cluster 2024-09-14T01:22:43.485042+0000 mgr.a (mgr.14355) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:46 smithi171 bash[25040]: cluster 2024-09-14T01:22:45.487427+0000 mgr.a (mgr.14355) 7866 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:46 smithi007 bash[22722]: cluster 2024-09-14T01:22:45.487427+0000 mgr.a (mgr.14355) 7866 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:46 smithi131 bash[24745]: cluster 2024-09-14T01:22:45.487427+0000 mgr.a (mgr.14355) 7866 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:22:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:48 smithi131 bash[24745]: cluster 2024-09-14T01:22:47.488377+0000 mgr.a (mgr.14355) 7867 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:48 smithi171 bash[25040]: cluster 2024-09-14T01:22:47.488377+0000 mgr.a (mgr.14355) 7867 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:48.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:48.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:48 smithi007 bash[22722]: cluster 2024-09-14T01:22:47.488377+0000 mgr.a (mgr.14355) 7867 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:49.361 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:49.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:50 smithi007 bash[22722]: audit 2024-09-14T01:22:48.948277+0000 mgr.a (mgr.14355) 7868 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:50 smithi007 bash[22722]: cluster 2024-09-14T01:22:49.489349+0000 mgr.a (mgr.14355) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:50 smithi131 bash[24745]: audit 2024-09-14T01:22:48.948277+0000 mgr.a (mgr.14355) 7868 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:50 smithi131 bash[24745]: cluster 2024-09-14T01:22:49.489349+0000 mgr.a (mgr.14355) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:50 smithi171 bash[25040]: audit 2024-09-14T01:22:48.948277+0000 mgr.a (mgr.14355) 7868 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:50 smithi171 bash[25040]: cluster 2024-09-14T01:22:49.489349+0000 mgr.a (mgr.14355) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:52 smithi007 bash[22722]: cluster 2024-09-14T01:22:51.491614+0000 mgr.a (mgr.14355) 7870 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:53.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:52 smithi131 bash[24745]: cluster 2024-09-14T01:22:51.491614+0000 mgr.a (mgr.14355) 7870 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:52 smithi171 bash[25040]: cluster 2024-09-14T01:22:51.491614+0000 mgr.a (mgr.14355) 7870 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:53 smithi007 bash[22722]: cluster 2024-09-14T01:22:53.492367+0000 mgr.a (mgr.14355) 7871 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:53 smithi131 bash[24745]: cluster 2024-09-14T01:22:53.492367+0000 mgr.a (mgr.14355) 7871 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:53 smithi171 bash[25040]: cluster 2024-09-14T01:22:53.492367+0000 mgr.a (mgr.14355) 7871 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:54.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:22:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:22:54.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:22:55.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:22:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:56 smithi007 bash[22722]: audit 2024-09-14T01:22:54.692381+0000 mgr.a (mgr.14355) 7872 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:56 smithi007 bash[22722]: cluster 2024-09-14T01:22:55.494664+0000 mgr.a (mgr.14355) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:56 smithi131 bash[24745]: audit 2024-09-14T01:22:54.692381+0000 mgr.a (mgr.14355) 7872 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:56 smithi131 bash[24745]: cluster 2024-09-14T01:22:55.494664+0000 mgr.a (mgr.14355) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:56 smithi171 bash[25040]: audit 2024-09-14T01:22:54.692381+0000 mgr.a (mgr.14355) 7872 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:22:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:56 smithi171 bash[25040]: cluster 2024-09-14T01:22:55.494664+0000 mgr.a (mgr.14355) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:22:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:22:57 smithi007 bash[22722]: cluster 2024-09-14T01:22:57.495425+0000 mgr.a (mgr.14355) 7874 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:22:57 smithi131 bash[24745]: cluster 2024-09-14T01:22:57.495425+0000 mgr.a (mgr.14355) 7874 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:22:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:22:57 smithi171 bash[25040]: cluster 2024-09-14T01:22:57.495425+0000 mgr.a (mgr.14355) 7874 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:00.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:00.116 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:00.898 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:00.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:00.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:00.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:00.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:00 smithi007 bash[22722]: cluster 2024-09-14T01:22:59.496188+0000 mgr.a (mgr.14355) 7875 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:00 smithi131 bash[24745]: cluster 2024-09-14T01:22:59.496188+0000 mgr.a (mgr.14355) 7875 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:00 smithi171 bash[25040]: cluster 2024-09-14T01:22:59.496188+0000 mgr.a (mgr.14355) 7875 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:01 smithi007 bash[22722]: audit 2024-09-14T01:23:00.455792+0000 mgr.a (mgr.14355) 7876 : audit [DBG] from='client.177225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:01 smithi131 bash[24745]: audit 2024-09-14T01:23:00.455792+0000 mgr.a (mgr.14355) 7876 : audit [DBG] from='client.177225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:01 smithi171 bash[25040]: audit 2024-09-14T01:23:00.455792+0000 mgr.a (mgr.14355) 7876 : audit [DBG] from='client.177225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:02 smithi007 bash[22722]: cluster 2024-09-14T01:23:01.499064+0000 mgr.a (mgr.14355) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:02 smithi131 bash[24745]: cluster 2024-09-14T01:23:01.499064+0000 mgr.a (mgr.14355) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:02 smithi171 bash[25040]: cluster 2024-09-14T01:23:01.499064+0000 mgr.a (mgr.14355) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:03 smithi007 bash[22722]: cluster 2024-09-14T01:23:03.500047+0000 mgr.a (mgr.14355) 7878 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:03 smithi131 bash[24745]: cluster 2024-09-14T01:23:03.500047+0000 mgr.a (mgr.14355) 7878 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:03 smithi171 bash[25040]: cluster 2024-09-14T01:23:03.500047+0000 mgr.a (mgr.14355) 7878 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:05.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:05 smithi007 bash[22722]: cluster 2024-09-14T01:23:05.502096+0000 mgr.a (mgr.14355) 7879 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:05 smithi131 bash[24745]: cluster 2024-09-14T01:23:05.502096+0000 mgr.a (mgr.14355) 7879 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:05 smithi171 bash[25040]: cluster 2024-09-14T01:23:05.502096+0000 mgr.a (mgr.14355) 7879 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:06.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:06.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:06 smithi007 bash[22722]: audit 2024-09-14T01:23:06.232840+0000 mgr.a (mgr.14355) 7880 : audit [DBG] from='client.177303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:06 smithi131 bash[24745]: audit 2024-09-14T01:23:06.232840+0000 mgr.a (mgr.14355) 7880 : audit [DBG] from='client.177303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:06 smithi171 bash[25040]: audit 2024-09-14T01:23:06.232840+0000 mgr.a (mgr.14355) 7880 : audit [DBG] from='client.177303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:07 smithi007 bash[22722]: cluster 2024-09-14T01:23:07.503014+0000 mgr.a (mgr.14355) 7881 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:07 smithi131 bash[24745]: cluster 2024-09-14T01:23:07.503014+0000 mgr.a (mgr.14355) 7881 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:07 smithi171 bash[25040]: cluster 2024-09-14T01:23:07.503014+0000 mgr.a (mgr.14355) 7881 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:23:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:09 smithi007 bash[22722]: cluster 2024-09-14T01:23:09.503786+0000 mgr.a (mgr.14355) 7882 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:23:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:09 smithi131 bash[24745]: cluster 2024-09-14T01:23:09.503786+0000 mgr.a (mgr.14355) 7882 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:23:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:09 smithi171 bash[25040]: cluster 2024-09-14T01:23:09.503786+0000 mgr.a (mgr.14355) 7882 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:23:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:11 smithi007 bash[22722]: cluster 2024-09-14T01:23:11.505932+0000 mgr.a (mgr.14355) 7883 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:11 smithi131 bash[24745]: cluster 2024-09-14T01:23:11.505932+0000 mgr.a (mgr.14355) 7883 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:11 smithi171 bash[25040]: cluster 2024-09-14T01:23:11.505932+0000 mgr.a (mgr.14355) 7883 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:12.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:12 smithi007 bash[22722]: audit 2024-09-14T01:23:11.975763+0000 mgr.a (mgr.14355) 7884 : audit [DBG] from='client.177378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:12 smithi131 bash[24745]: audit 2024-09-14T01:23:11.975763+0000 mgr.a (mgr.14355) 7884 : audit [DBG] from='client.177378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:12 smithi171 bash[25040]: audit 2024-09-14T01:23:11.975763+0000 mgr.a (mgr.14355) 7884 : audit [DBG] from='client.177378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:13 smithi007 bash[22722]: cluster 2024-09-14T01:23:13.506833+0000 mgr.a (mgr.14355) 7885 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:13 smithi131 bash[24745]: cluster 2024-09-14T01:23:13.506833+0000 mgr.a (mgr.14355) 7885 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:13 smithi171 bash[25040]: cluster 2024-09-14T01:23:13.506833+0000 mgr.a (mgr.14355) 7885 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:15 smithi007 bash[22722]: cluster 2024-09-14T01:23:15.508987+0000 mgr.a (mgr.14355) 7886 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:15 smithi131 bash[24745]: cluster 2024-09-14T01:23:15.508987+0000 mgr.a (mgr.14355) 7886 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:15 smithi171 bash[25040]: cluster 2024-09-14T01:23:15.508987+0000 mgr.a (mgr.14355) 7886 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:17.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:17.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:17.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:17 smithi007 bash[22722]: cluster 2024-09-14T01:23:17.509431+0000 mgr.a (mgr.14355) 7887 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:17 smithi131 bash[24745]: cluster 2024-09-14T01:23:17.509431+0000 mgr.a (mgr.14355) 7887 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:17 smithi171 bash[25040]: cluster 2024-09-14T01:23:17.509431+0000 mgr.a (mgr.14355) 7887 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:18.183 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:18 smithi007 bash[22722]: audit 2024-09-14T01:23:17.740919+0000 mgr.a (mgr.14355) 7888 : audit [DBG] from='client.177456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:18 smithi131 bash[24745]: audit 2024-09-14T01:23:17.740919+0000 mgr.a (mgr.14355) 7888 : audit [DBG] from='client.177456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:18 smithi171 bash[25040]: audit 2024-09-14T01:23:17.740919+0000 mgr.a (mgr.14355) 7888 : audit [DBG] from='client.177456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:19 smithi007 bash[22722]: cluster 2024-09-14T01:23:19.510260+0000 mgr.a (mgr.14355) 7889 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:19 smithi131 bash[24745]: cluster 2024-09-14T01:23:19.510260+0000 mgr.a (mgr.14355) 7889 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:19 smithi171 bash[25040]: cluster 2024-09-14T01:23:19.510260+0000 mgr.a (mgr.14355) 7889 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:21 smithi007 bash[22722]: cluster 2024-09-14T01:23:21.512524+0000 mgr.a (mgr.14355) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:21 smithi131 bash[24745]: cluster 2024-09-14T01:23:21.512524+0000 mgr.a (mgr.14355) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:21 smithi171 bash[25040]: cluster 2024-09-14T01:23:21.512524+0000 mgr.a (mgr.14355) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:23.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:23.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:23.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:23.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:23 smithi007 bash[22722]: cluster 2024-09-14T01:23:23.513274+0000 mgr.a (mgr.14355) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:23 smithi007 bash[22722]: audit 2024-09-14T01:23:23.516011+0000 mgr.a (mgr.14355) 7892 : audit [DBG] from='client.177534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:23 smithi131 bash[24745]: cluster 2024-09-14T01:23:23.513274+0000 mgr.a (mgr.14355) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:23 smithi131 bash[24745]: audit 2024-09-14T01:23:23.516011+0000 mgr.a (mgr.14355) 7892 : audit [DBG] from='client.177534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:23 smithi171 bash[25040]: cluster 2024-09-14T01:23:23.513274+0000 mgr.a (mgr.14355) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:23 smithi171 bash[25040]: audit 2024-09-14T01:23:23.516011+0000 mgr.a (mgr.14355) 7892 : audit [DBG] from='client.177534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:25 smithi007 bash[22722]: cluster 2024-09-14T01:23:25.515653+0000 mgr.a (mgr.14355) 7893 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:25 smithi131 bash[24745]: cluster 2024-09-14T01:23:25.515653+0000 mgr.a (mgr.14355) 7893 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:25 smithi171 bash[25040]: cluster 2024-09-14T01:23:25.515653+0000 mgr.a (mgr.14355) 7893 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:27 smithi007 bash[22722]: cluster 2024-09-14T01:23:27.516573+0000 mgr.a (mgr.14355) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:27 smithi131 bash[24745]: cluster 2024-09-14T01:23:27.516573+0000 mgr.a (mgr.14355) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:27 smithi171 bash[25040]: cluster 2024-09-14T01:23:27.516573+0000 mgr.a (mgr.14355) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:28.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:28.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:28.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:29.700 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:29.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:29 smithi007 bash[22722]: audit 2024-09-14T01:23:29.262635+0000 mgr.a (mgr.14355) 7895 : audit [DBG] from='client.177612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:29 smithi007 bash[22722]: cluster 2024-09-14T01:23:29.517319+0000 mgr.a (mgr.14355) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:29 smithi131 bash[24745]: audit 2024-09-14T01:23:29.262635+0000 mgr.a (mgr.14355) 7895 : audit [DBG] from='client.177612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:29 smithi131 bash[24745]: cluster 2024-09-14T01:23:29.517319+0000 mgr.a (mgr.14355) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:29 smithi171 bash[25040]: audit 2024-09-14T01:23:29.262635+0000 mgr.a (mgr.14355) 7895 : audit [DBG] from='client.177612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:29 smithi171 bash[25040]: cluster 2024-09-14T01:23:29.517319+0000 mgr.a (mgr.14355) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:31 smithi007 bash[22722]: cluster 2024-09-14T01:23:31.519623+0000 mgr.a (mgr.14355) 7897 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:31 smithi131 bash[24745]: cluster 2024-09-14T01:23:31.519623+0000 mgr.a (mgr.14355) 7897 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:31 smithi171 bash[25040]: cluster 2024-09-14T01:23:31.519623+0000 mgr.a (mgr.14355) 7897 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:32.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:32 smithi007 bash[22722]: audit 2024-09-14T01:23:31.757010+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:32 smithi007 bash[22722]: audit 2024-09-14T01:23:32.591479+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:32 smithi007 bash[22722]: audit 2024-09-14T01:23:32.593129+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:32 smithi007 bash[22722]: audit 2024-09-14T01:23:32.603352+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:32 smithi007 bash[22722]: audit 2024-09-14T01:23:32.607989+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:32 smithi131 bash[24745]: audit 2024-09-14T01:23:31.757010+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:32 smithi131 bash[24745]: audit 2024-09-14T01:23:32.591479+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:32 smithi131 bash[24745]: audit 2024-09-14T01:23:32.593129+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:32 smithi131 bash[24745]: audit 2024-09-14T01:23:32.603352+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:23:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:32 smithi131 bash[24745]: audit 2024-09-14T01:23:32.607989+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:32 smithi171 bash[25040]: audit 2024-09-14T01:23:31.757010+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:23:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:32 smithi171 bash[25040]: audit 2024-09-14T01:23:32.591479+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:23:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:32 smithi171 bash[25040]: audit 2024-09-14T01:23:32.593129+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:23:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:32 smithi171 bash[25040]: audit 2024-09-14T01:23:32.603352+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:23:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:32 smithi171 bash[25040]: audit 2024-09-14T01:23:32.607989+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:33.622 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22972]: debug 2024-09-14T01:23:33.343+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:23:33.622 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22972]: debug 2024-09-14T01:23:33.347+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:23:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22722]: audit 2024-09-14T01:23:32.610253+0000 mgr.a (mgr.14355) 7898 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22722]: audit 2024-09-14T01:23:33.349890+0000 mgr.a (mgr.14355) 7899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:23:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22722]: cephadm 2024-09-14T01:23:33.351273+0000 mgr.a (mgr.14355) 7900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:23:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:33 smithi007 bash[22722]: cluster 2024-09-14T01:23:33.520362+0000 mgr.a (mgr.14355) 7901 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:33 smithi131 bash[24745]: audit 2024-09-14T01:23:32.610253+0000 mgr.a (mgr.14355) 7898 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:33 smithi131 bash[24745]: audit 2024-09-14T01:23:33.349890+0000 mgr.a (mgr.14355) 7899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:23:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:33 smithi131 bash[24745]: cephadm 2024-09-14T01:23:33.351273+0000 mgr.a (mgr.14355) 7900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:23:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:33 smithi131 bash[24745]: cluster 2024-09-14T01:23:33.520362+0000 mgr.a (mgr.14355) 7901 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:33 smithi171 bash[25040]: audit 2024-09-14T01:23:32.610253+0000 mgr.a (mgr.14355) 7898 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:23:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:33 smithi171 bash[25040]: audit 2024-09-14T01:23:33.349890+0000 mgr.a (mgr.14355) 7899 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:23:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:33 smithi171 bash[25040]: cephadm 2024-09-14T01:23:33.351273+0000 mgr.a (mgr.14355) 7900 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:23:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:33 smithi171 bash[25040]: cluster 2024-09-14T01:23:33.520362+0000 mgr.a (mgr.14355) 7901 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:34.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:34.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:34.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:35.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:35.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:35.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:35.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:35.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:35 smithi007 bash[22722]: audit 2024-09-14T01:23:35.035356+0000 mgr.a (mgr.14355) 7902 : audit [DBG] from='client.177798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:35 smithi007 bash[22722]: cluster 2024-09-14T01:23:35.522856+0000 mgr.a (mgr.14355) 7903 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:35 smithi131 bash[24745]: audit 2024-09-14T01:23:35.035356+0000 mgr.a (mgr.14355) 7902 : audit [DBG] from='client.177798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:35 smithi131 bash[24745]: cluster 2024-09-14T01:23:35.522856+0000 mgr.a (mgr.14355) 7903 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:35 smithi171 bash[25040]: audit 2024-09-14T01:23:35.035356+0000 mgr.a (mgr.14355) 7902 : audit [DBG] from='client.177798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:35 smithi171 bash[25040]: cluster 2024-09-14T01:23:35.522856+0000 mgr.a (mgr.14355) 7903 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:37 smithi007 bash[22722]: cluster 2024-09-14T01:23:37.523582+0000 mgr.a (mgr.14355) 7904 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:37 smithi131 bash[24745]: cluster 2024-09-14T01:23:37.523582+0000 mgr.a (mgr.14355) 7904 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:37 smithi171 bash[25040]: cluster 2024-09-14T01:23:37.523582+0000 mgr.a (mgr.14355) 7904 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:39 smithi007 bash[22722]: cluster 2024-09-14T01:23:39.524367+0000 mgr.a (mgr.14355) 7905 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:39 smithi131 bash[24745]: cluster 2024-09-14T01:23:39.524367+0000 mgr.a (mgr.14355) 7905 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:39 smithi171 bash[25040]: cluster 2024-09-14T01:23:39.524367+0000 mgr.a (mgr.14355) 7905 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:40.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:40.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:40.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:41.236 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:41.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:41 smithi007 bash[22722]: audit 2024-09-14T01:23:40.795102+0000 mgr.a (mgr.14355) 7906 : audit [DBG] from='client.177876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:41 smithi007 bash[22722]: cluster 2024-09-14T01:23:41.527090+0000 mgr.a (mgr.14355) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:41 smithi131 bash[24745]: audit 2024-09-14T01:23:40.795102+0000 mgr.a (mgr.14355) 7906 : audit [DBG] from='client.177876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:41 smithi131 bash[24745]: cluster 2024-09-14T01:23:41.527090+0000 mgr.a (mgr.14355) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:41 smithi171 bash[25040]: audit 2024-09-14T01:23:40.795102+0000 mgr.a (mgr.14355) 7906 : audit [DBG] from='client.177876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:41 smithi171 bash[25040]: cluster 2024-09-14T01:23:41.527090+0000 mgr.a (mgr.14355) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:43 smithi007 bash[22722]: cluster 2024-09-14T01:23:43.527861+0000 mgr.a (mgr.14355) 7908 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:43 smithi131 bash[24745]: cluster 2024-09-14T01:23:43.527861+0000 mgr.a (mgr.14355) 7908 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:43 smithi171 bash[25040]: cluster 2024-09-14T01:23:43.527861+0000 mgr.a (mgr.14355) 7908 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:23:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:45 smithi007 bash[22722]: cluster 2024-09-14T01:23:45.529777+0000 mgr.a (mgr.14355) 7909 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:45 smithi131 bash[24745]: cluster 2024-09-14T01:23:45.529777+0000 mgr.a (mgr.14355) 7909 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:45 smithi171 bash[25040]: cluster 2024-09-14T01:23:45.529777+0000 mgr.a (mgr.14355) 7909 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:23:46.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:46.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:46.987 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:47 smithi007 bash[22722]: audit 2024-09-14T01:23:46.570290+0000 mgr.a (mgr.14355) 7910 : audit [DBG] from='client.177954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:47 smithi007 bash[22722]: cluster 2024-09-14T01:23:47.530635+0000 mgr.a (mgr.14355) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:47 smithi131 bash[24745]: audit 2024-09-14T01:23:46.570290+0000 mgr.a (mgr.14355) 7910 : audit [DBG] from='client.177954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:47 smithi131 bash[24745]: cluster 2024-09-14T01:23:47.530635+0000 mgr.a (mgr.14355) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:47 smithi171 bash[25040]: audit 2024-09-14T01:23:46.570290+0000 mgr.a (mgr.14355) 7910 : audit [DBG] from='client.177954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:47 smithi171 bash[25040]: cluster 2024-09-14T01:23:47.530635+0000 mgr.a (mgr.14355) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:49 smithi007 bash[22722]: cluster 2024-09-14T01:23:49.531530+0000 mgr.a (mgr.14355) 7912 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:49 smithi131 bash[24745]: cluster 2024-09-14T01:23:49.531530+0000 mgr.a (mgr.14355) 7912 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:49 smithi171 bash[25040]: cluster 2024-09-14T01:23:49.531530+0000 mgr.a (mgr.14355) 7912 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:51 smithi007 bash[22722]: cluster 2024-09-14T01:23:51.533872+0000 mgr.a (mgr.14355) 7913 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:51.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:51.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:51.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:51 smithi131 bash[24745]: cluster 2024-09-14T01:23:51.533872+0000 mgr.a (mgr.14355) 7913 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:51 smithi171 bash[25040]: cluster 2024-09-14T01:23:51.533872+0000 mgr.a (mgr.14355) 7913 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:52.769 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:52.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:52 smithi007 bash[22722]: audit 2024-09-14T01:23:52.328142+0000 mgr.a (mgr.14355) 7914 : audit [DBG] from='client.178032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:52 smithi131 bash[24745]: audit 2024-09-14T01:23:52.328142+0000 mgr.a (mgr.14355) 7914 : audit [DBG] from='client.178032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:52 smithi171 bash[25040]: audit 2024-09-14T01:23:52.328142+0000 mgr.a (mgr.14355) 7914 : audit [DBG] from='client.178032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:53 smithi007 bash[22722]: cluster 2024-09-14T01:23:53.534835+0000 mgr.a (mgr.14355) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:53 smithi131 bash[24745]: cluster 2024-09-14T01:23:53.534835+0000 mgr.a (mgr.14355) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:53 smithi171 bash[25040]: cluster 2024-09-14T01:23:53.534835+0000 mgr.a (mgr.14355) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:55 smithi007 bash[22722]: cluster 2024-09-14T01:23:55.537130+0000 mgr.a (mgr.14355) 7916 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:55 smithi131 bash[24745]: cluster 2024-09-14T01:23:55.537130+0000 mgr.a (mgr.14355) 7916 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:55 smithi171 bash[25040]: cluster 2024-09-14T01:23:55.537130+0000 mgr.a (mgr.14355) 7916 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:23:57.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:23:57.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:23:57.772 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:23:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:57 smithi007 bash[22722]: cluster 2024-09-14T01:23:57.538044+0000 mgr.a (mgr.14355) 7917 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:57 smithi131 bash[24745]: cluster 2024-09-14T01:23:57.538044+0000 mgr.a (mgr.14355) 7917 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:57 smithi171 bash[25040]: cluster 2024-09-14T01:23:57.538044+0000 mgr.a (mgr.14355) 7917 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:23:58.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:23:58.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:23:58.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:23:58.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:23:58.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:23:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:58 smithi007 bash[22722]: audit 2024-09-14T01:23:58.102415+0000 mgr.a (mgr.14355) 7918 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:58 smithi131 bash[24745]: audit 2024-09-14T01:23:58.102415+0000 mgr.a (mgr.14355) 7918 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:58 smithi171 bash[25040]: audit 2024-09-14T01:23:58.102415+0000 mgr.a (mgr.14355) 7918 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:23:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:23:59 smithi007 bash[22722]: cluster 2024-09-14T01:23:59.539131+0000 mgr.a (mgr.14355) 7919 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:23:59 smithi131 bash[24745]: cluster 2024-09-14T01:23:59.539131+0000 mgr.a (mgr.14355) 7919 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:23:59 smithi171 bash[25040]: cluster 2024-09-14T01:23:59.539131+0000 mgr.a (mgr.14355) 7919 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:01.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:01 smithi007 bash[22722]: cluster 2024-09-14T01:24:01.541480+0000 mgr.a (mgr.14355) 7920 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:01 smithi131 bash[24745]: cluster 2024-09-14T01:24:01.541480+0000 mgr.a (mgr.14355) 7920 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:01 smithi171 bash[25040]: cluster 2024-09-14T01:24:01.541480+0000 mgr.a (mgr.14355) 7920 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:03.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:03.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:03.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:03 smithi007 bash[22722]: cluster 2024-09-14T01:24:03.542274+0000 mgr.a (mgr.14355) 7921 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:03 smithi131 bash[24745]: cluster 2024-09-14T01:24:03.542274+0000 mgr.a (mgr.14355) 7921 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:03 smithi171 bash[25040]: cluster 2024-09-14T01:24:03.542274+0000 mgr.a (mgr.14355) 7921 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:04.329 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:04.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:04 smithi007 bash[22722]: audit 2024-09-14T01:24:03.892998+0000 mgr.a (mgr.14355) 7922 : audit [DBG] from='client.178182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:04 smithi131 bash[24745]: audit 2024-09-14T01:24:03.892998+0000 mgr.a (mgr.14355) 7922 : audit [DBG] from='client.178182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:04 smithi171 bash[25040]: audit 2024-09-14T01:24:03.892998+0000 mgr.a (mgr.14355) 7922 : audit [DBG] from='client.178182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:05 smithi007 bash[22722]: cluster 2024-09-14T01:24:05.544546+0000 mgr.a (mgr.14355) 7923 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:05 smithi131 bash[24745]: cluster 2024-09-14T01:24:05.544546+0000 mgr.a (mgr.14355) 7923 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:05 smithi171 bash[25040]: cluster 2024-09-14T01:24:05.544546+0000 mgr.a (mgr.14355) 7923 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:07 smithi007 bash[22722]: cluster 2024-09-14T01:24:07.545300+0000 mgr.a (mgr.14355) 7924 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:07 smithi131 bash[24745]: cluster 2024-09-14T01:24:07.545300+0000 mgr.a (mgr.14355) 7924 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:07 smithi171 bash[25040]: cluster 2024-09-14T01:24:07.545300+0000 mgr.a (mgr.14355) 7924 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:09.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:09.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:09.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:09.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:09 smithi007 bash[22722]: cluster 2024-09-14T01:24:09.545992+0000 mgr.a (mgr.14355) 7925 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:09 smithi131 bash[24745]: cluster 2024-09-14T01:24:09.545992+0000 mgr.a (mgr.14355) 7925 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:09 smithi171 bash[25040]: cluster 2024-09-14T01:24:09.545992+0000 mgr.a (mgr.14355) 7925 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:10.080 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:10 smithi007 bash[22722]: audit 2024-09-14T01:24:09.660893+0000 mgr.a (mgr.14355) 7926 : audit [DBG] from='client.178260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:10 smithi131 bash[24745]: audit 2024-09-14T01:24:09.660893+0000 mgr.a (mgr.14355) 7926 : audit [DBG] from='client.178260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:10 smithi171 bash[25040]: audit 2024-09-14T01:24:09.660893+0000 mgr.a (mgr.14355) 7926 : audit [DBG] from='client.178260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:11 smithi007 bash[22722]: cluster 2024-09-14T01:24:11.548355+0000 mgr.a (mgr.14355) 7927 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:11 smithi131 bash[24745]: cluster 2024-09-14T01:24:11.548355+0000 mgr.a (mgr.14355) 7927 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:11 smithi171 bash[25040]: cluster 2024-09-14T01:24:11.548355+0000 mgr.a (mgr.14355) 7927 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:13 smithi007 bash[22722]: cluster 2024-09-14T01:24:13.549139+0000 mgr.a (mgr.14355) 7928 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:13 smithi131 bash[24745]: cluster 2024-09-14T01:24:13.549139+0000 mgr.a (mgr.14355) 7928 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:13 smithi171 bash[25040]: cluster 2024-09-14T01:24:13.549139+0000 mgr.a (mgr.14355) 7928 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:15.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:15.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:15.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:15.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:15 smithi007 bash[22722]: audit 2024-09-14T01:24:15.412315+0000 mgr.a (mgr.14355) 7929 : audit [DBG] from='client.178338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:15 smithi007 bash[22722]: cluster 2024-09-14T01:24:15.551582+0000 mgr.a (mgr.14355) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:15 smithi131 bash[24745]: audit 2024-09-14T01:24:15.412315+0000 mgr.a (mgr.14355) 7929 : audit [DBG] from='client.178338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:15 smithi131 bash[24745]: cluster 2024-09-14T01:24:15.551582+0000 mgr.a (mgr.14355) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:15 smithi171 bash[25040]: audit 2024-09-14T01:24:15.412315+0000 mgr.a (mgr.14355) 7929 : audit [DBG] from='client.178338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:15 smithi171 bash[25040]: cluster 2024-09-14T01:24:15.551582+0000 mgr.a (mgr.14355) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:17 smithi007 bash[22722]: cluster 2024-09-14T01:24:17.552530+0000 mgr.a (mgr.14355) 7931 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:17 smithi131 bash[24745]: cluster 2024-09-14T01:24:17.552530+0000 mgr.a (mgr.14355) 7931 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:17 smithi171 bash[25040]: cluster 2024-09-14T01:24:17.552530+0000 mgr.a (mgr.14355) 7931 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:19 smithi007 bash[22722]: cluster 2024-09-14T01:24:19.553342+0000 mgr.a (mgr.14355) 7932 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:24:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:19 smithi131 bash[24745]: cluster 2024-09-14T01:24:19.553342+0000 mgr.a (mgr.14355) 7932 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:24:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:19 smithi171 bash[25040]: cluster 2024-09-14T01:24:19.553342+0000 mgr.a (mgr.14355) 7932 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:24:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:21.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:21.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:21 smithi007 bash[22722]: audit 2024-09-14T01:24:21.168707+0000 mgr.a (mgr.14355) 7933 : audit [DBG] from='client.178416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:21 smithi007 bash[22722]: cluster 2024-09-14T01:24:21.554801+0000 mgr.a (mgr.14355) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:21 smithi131 bash[24745]: audit 2024-09-14T01:24:21.168707+0000 mgr.a (mgr.14355) 7933 : audit [DBG] from='client.178416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:21 smithi131 bash[24745]: cluster 2024-09-14T01:24:21.554801+0000 mgr.a (mgr.14355) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:21 smithi171 bash[25040]: audit 2024-09-14T01:24:21.168707+0000 mgr.a (mgr.14355) 7933 : audit [DBG] from='client.178416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:21 smithi171 bash[25040]: cluster 2024-09-14T01:24:21.554801+0000 mgr.a (mgr.14355) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:23 smithi007 bash[22722]: cluster 2024-09-14T01:24:23.555703+0000 mgr.a (mgr.14355) 7935 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:23 smithi131 bash[24745]: cluster 2024-09-14T01:24:23.555703+0000 mgr.a (mgr.14355) 7935 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:23 smithi171 bash[25040]: cluster 2024-09-14T01:24:23.555703+0000 mgr.a (mgr.14355) 7935 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:25 smithi007 bash[22722]: cluster 2024-09-14T01:24:25.557687+0000 mgr.a (mgr.14355) 7936 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:25 smithi131 bash[24745]: cluster 2024-09-14T01:24:25.557687+0000 mgr.a (mgr.14355) 7936 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:25 smithi171 bash[25040]: cluster 2024-09-14T01:24:25.557687+0000 mgr.a (mgr.14355) 7936 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:26.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:26.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:27.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:27.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:27.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:27.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:27.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:27 smithi007 bash[22722]: audit 2024-09-14T01:24:26.935810+0000 mgr.a (mgr.14355) 7937 : audit [DBG] from='client.178494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:27 smithi007 bash[22722]: cluster 2024-09-14T01:24:27.558663+0000 mgr.a (mgr.14355) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:27 smithi131 bash[24745]: audit 2024-09-14T01:24:26.935810+0000 mgr.a (mgr.14355) 7937 : audit [DBG] from='client.178494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:27 smithi131 bash[24745]: cluster 2024-09-14T01:24:27.558663+0000 mgr.a (mgr.14355) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:27 smithi171 bash[25040]: audit 2024-09-14T01:24:26.935810+0000 mgr.a (mgr.14355) 7937 : audit [DBG] from='client.178494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:27 smithi171 bash[25040]: cluster 2024-09-14T01:24:27.558663+0000 mgr.a (mgr.14355) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:29 smithi007 bash[22722]: cluster 2024-09-14T01:24:29.559445+0000 mgr.a (mgr.14355) 7939 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:29 smithi131 bash[24745]: cluster 2024-09-14T01:24:29.559445+0000 mgr.a (mgr.14355) 7939 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:29 smithi171 bash[25040]: cluster 2024-09-14T01:24:29.559445+0000 mgr.a (mgr.14355) 7939 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:31 smithi007 bash[22722]: cluster 2024-09-14T01:24:31.561576+0000 mgr.a (mgr.14355) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:31 smithi131 bash[24745]: cluster 2024-09-14T01:24:31.561576+0000 mgr.a (mgr.14355) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:31 smithi171 bash[25040]: cluster 2024-09-14T01:24:31.561576+0000 mgr.a (mgr.14355) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:32.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:32.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:33.181 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:33.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:33.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:33.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:33.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:33 smithi131 bash[24745]: audit 2024-09-14T01:24:33.404334+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:24:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:33 smithi171 bash[25040]: audit 2024-09-14T01:24:33.404334+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:24:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:33 smithi007 bash[22722]: audit 2024-09-14T01:24:33.404334+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:24:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:34 smithi131 bash[24745]: audit 2024-09-14T01:24:32.732096+0000 mgr.a (mgr.14355) 7941 : audit [DBG] from='client.178572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:34 smithi131 bash[24745]: cluster 2024-09-14T01:24:33.562549+0000 mgr.a (mgr.14355) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:34 smithi131 bash[24745]: audit 2024-09-14T01:24:34.030743+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:34 smithi131 bash[24745]: audit 2024-09-14T01:24:34.034901+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:34 smithi171 bash[25040]: audit 2024-09-14T01:24:32.732096+0000 mgr.a (mgr.14355) 7941 : audit [DBG] from='client.178572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:34 smithi171 bash[25040]: cluster 2024-09-14T01:24:33.562549+0000 mgr.a (mgr.14355) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:34 smithi171 bash[25040]: audit 2024-09-14T01:24:34.030743+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:34 smithi171 bash[25040]: audit 2024-09-14T01:24:34.034901+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:34 smithi007 bash[22722]: audit 2024-09-14T01:24:32.732096+0000 mgr.a (mgr.14355) 7941 : audit [DBG] from='client.178572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:34 smithi007 bash[22722]: cluster 2024-09-14T01:24:33.562549+0000 mgr.a (mgr.14355) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:34 smithi007 bash[22722]: audit 2024-09-14T01:24:34.030743+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:34 smithi007 bash[22722]: audit 2024-09-14T01:24:34.034901+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:34.669510+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:34.675658+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:34.684874+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:34.692092+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.319870+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.326234+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.327632+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:24:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.328634+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:24:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.335540+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.340068+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: audit 2024-09-14T01:24:35.341362+0000 mgr.a (mgr.14355) 7943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:35 smithi007 bash[22722]: cluster 2024-09-14T01:24:35.564308+0000 mgr.a (mgr.14355) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:34.669510+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:34.675658+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:34.684874+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:34.692092+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.319870+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.326234+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.327632+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.328634+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.335540+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.340068+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: audit 2024-09-14T01:24:35.341362+0000 mgr.a (mgr.14355) 7943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:36.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:35 smithi131 bash[24745]: cluster 2024-09-14T01:24:35.564308+0000 mgr.a (mgr.14355) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:34.669510+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:34.675658+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:34.684874+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:34.692092+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.319870+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.326234+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.327632+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.328634+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.335540+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.340068+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: audit 2024-09-14T01:24:35.341362+0000 mgr.a (mgr.14355) 7943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:24:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:35 smithi171 bash[25040]: cluster 2024-09-14T01:24:35.564308+0000 mgr.a (mgr.14355) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:24:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:24:36 smithi007 bash[22972]: debug 2024-09-14T01:24:36.054+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:24:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:24:36 smithi007 bash[22972]: debug 2024-09-14T01:24:36.058+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:24:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:37 smithi007 bash[22722]: audit 2024-09-14T01:24:36.061888+0000 mgr.a (mgr.14355) 7945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:24:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:37 smithi007 bash[22722]: cephadm 2024-09-14T01:24:36.063230+0000 mgr.a (mgr.14355) 7946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:24:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:37 smithi131 bash[24745]: audit 2024-09-14T01:24:36.061888+0000 mgr.a (mgr.14355) 7945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:24:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:37 smithi131 bash[24745]: cephadm 2024-09-14T01:24:36.063230+0000 mgr.a (mgr.14355) 7946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:24:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:37 smithi171 bash[25040]: audit 2024-09-14T01:24:36.061888+0000 mgr.a (mgr.14355) 7945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:24:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:37 smithi171 bash[25040]: cephadm 2024-09-14T01:24:36.063230+0000 mgr.a (mgr.14355) 7946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:24:38.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:38.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:38.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:38 smithi007 bash[22722]: cluster 2024-09-14T01:24:37.565256+0000 mgr.a (mgr.14355) 7947 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:38 smithi131 bash[24745]: cluster 2024-09-14T01:24:37.565256+0000 mgr.a (mgr.14355) 7947 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:38 smithi171 bash[25040]: cluster 2024-09-14T01:24:37.565256+0000 mgr.a (mgr.14355) 7947 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:38.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:38.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:38.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:38.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:38.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:39 smithi007 bash[22722]: audit 2024-09-14T01:24:38.522771+0000 mgr.a (mgr.14355) 7948 : audit [DBG] from='client.178755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:39 smithi131 bash[24745]: audit 2024-09-14T01:24:38.522771+0000 mgr.a (mgr.14355) 7948 : audit [DBG] from='client.178755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:39 smithi171 bash[25040]: audit 2024-09-14T01:24:38.522771+0000 mgr.a (mgr.14355) 7948 : audit [DBG] from='client.178755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:40 smithi007 bash[22722]: cluster 2024-09-14T01:24:39.566236+0000 mgr.a (mgr.14355) 7949 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:40 smithi131 bash[24745]: cluster 2024-09-14T01:24:39.566236+0000 mgr.a (mgr.14355) 7949 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:40 smithi171 bash[25040]: cluster 2024-09-14T01:24:39.566236+0000 mgr.a (mgr.14355) 7949 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:41 smithi007 bash[22722]: cluster 2024-09-14T01:24:41.568514+0000 mgr.a (mgr.14355) 7950 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:41 smithi131 bash[24745]: cluster 2024-09-14T01:24:41.568514+0000 mgr.a (mgr.14355) 7950 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:41 smithi171 bash[25040]: cluster 2024-09-14T01:24:41.568514+0000 mgr.a (mgr.14355) 7950 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:43 smithi007 bash[22722]: cluster 2024-09-14T01:24:43.569293+0000 mgr.a (mgr.14355) 7951 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:43.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:43.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:43.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:43 smithi131 bash[24745]: cluster 2024-09-14T01:24:43.569293+0000 mgr.a (mgr.14355) 7951 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:43 smithi171 bash[25040]: cluster 2024-09-14T01:24:43.569293+0000 mgr.a (mgr.14355) 7951 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:44.739 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:44.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:44.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:44 smithi007 bash[22722]: audit 2024-09-14T01:24:44.299357+0000 mgr.a (mgr.14355) 7952 : audit [DBG] from='client.178833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:44 smithi131 bash[24745]: audit 2024-09-14T01:24:44.299357+0000 mgr.a (mgr.14355) 7952 : audit [DBG] from='client.178833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:44 smithi171 bash[25040]: audit 2024-09-14T01:24:44.299357+0000 mgr.a (mgr.14355) 7952 : audit [DBG] from='client.178833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:45 smithi007 bash[22722]: cluster 2024-09-14T01:24:45.571639+0000 mgr.a (mgr.14355) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:45 smithi131 bash[24745]: cluster 2024-09-14T01:24:45.571639+0000 mgr.a (mgr.14355) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:45 smithi171 bash[25040]: cluster 2024-09-14T01:24:45.571639+0000 mgr.a (mgr.14355) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:47 smithi007 bash[22722]: cluster 2024-09-14T01:24:47.572421+0000 mgr.a (mgr.14355) 7954 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:47 smithi131 bash[24745]: cluster 2024-09-14T01:24:47.572421+0000 mgr.a (mgr.14355) 7954 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:47 smithi171 bash[25040]: cluster 2024-09-14T01:24:47.572421+0000 mgr.a (mgr.14355) 7954 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:49.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:49.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:49.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:49 smithi007 bash[22722]: cluster 2024-09-14T01:24:49.573190+0000 mgr.a (mgr.14355) 7955 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:49 smithi131 bash[24745]: cluster 2024-09-14T01:24:49.573190+0000 mgr.a (mgr.14355) 7955 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:49 smithi171 bash[25040]: cluster 2024-09-14T01:24:49.573190+0000 mgr.a (mgr.14355) 7955 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:50.505 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:50.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:50.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:50.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:50.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:50 smithi007 bash[22722]: audit 2024-09-14T01:24:50.090829+0000 mgr.a (mgr.14355) 7956 : audit [DBG] from='client.178911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:50 smithi131 bash[24745]: audit 2024-09-14T01:24:50.090829+0000 mgr.a (mgr.14355) 7956 : audit [DBG] from='client.178911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:50 smithi171 bash[25040]: audit 2024-09-14T01:24:50.090829+0000 mgr.a (mgr.14355) 7956 : audit [DBG] from='client.178911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:52 smithi007 bash[22722]: cluster 2024-09-14T01:24:51.576123+0000 mgr.a (mgr.14355) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:52 smithi131 bash[24745]: cluster 2024-09-14T01:24:51.576123+0000 mgr.a (mgr.14355) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:52 smithi171 bash[25040]: cluster 2024-09-14T01:24:51.576123+0000 mgr.a (mgr.14355) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:24:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:54 smithi007 bash[22722]: cluster 2024-09-14T01:24:53.577123+0000 mgr.a (mgr.14355) 7958 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:54 smithi131 bash[24745]: cluster 2024-09-14T01:24:53.577123+0000 mgr.a (mgr.14355) 7958 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:54 smithi171 bash[25040]: cluster 2024-09-14T01:24:53.577123+0000 mgr.a (mgr.14355) 7958 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:55.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:24:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:24:55.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:24:56.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:24:56.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:24:56.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:24:56.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:24:56.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:24:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:56 smithi007 bash[22722]: cluster 2024-09-14T01:24:55.578481+0000 mgr.a (mgr.14355) 7959 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:56 smithi007 bash[22722]: audit 2024-09-14T01:24:55.833638+0000 mgr.a (mgr.14355) 7960 : audit [DBG] from='client.178986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:56 smithi131 bash[24745]: cluster 2024-09-14T01:24:55.578481+0000 mgr.a (mgr.14355) 7959 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:56 smithi131 bash[24745]: audit 2024-09-14T01:24:55.833638+0000 mgr.a (mgr.14355) 7960 : audit [DBG] from='client.178986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:56 smithi171 bash[25040]: cluster 2024-09-14T01:24:55.578481+0000 mgr.a (mgr.14355) 7959 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:24:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:56 smithi171 bash[25040]: audit 2024-09-14T01:24:55.833638+0000 mgr.a (mgr.14355) 7960 : audit [DBG] from='client.178986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:24:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:24:58 smithi007 bash[22722]: cluster 2024-09-14T01:24:57.579458+0000 mgr.a (mgr.14355) 7961 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:24:58 smithi131 bash[24745]: cluster 2024-09-14T01:24:57.579458+0000 mgr.a (mgr.14355) 7961 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:24:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:24:58 smithi171 bash[25040]: cluster 2024-09-14T01:24:57.579458+0000 mgr.a (mgr.14355) 7961 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:00 smithi007 bash[22722]: cluster 2024-09-14T01:24:59.580281+0000 mgr.a (mgr.14355) 7962 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:00 smithi131 bash[24745]: cluster 2024-09-14T01:24:59.580281+0000 mgr.a (mgr.14355) 7962 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:00 smithi171 bash[25040]: cluster 2024-09-14T01:24:59.580281+0000 mgr.a (mgr.14355) 7962 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:01.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:01.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:01.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:02.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:02.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:02.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:02.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:02.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:03 smithi171 bash[25040]: cluster 2024-09-14T01:25:01.581557+0000 mgr.a (mgr.14355) 7963 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:03 smithi171 bash[25040]: audit 2024-09-14T01:25:01.589677+0000 mgr.a (mgr.14355) 7964 : audit [DBG] from='client.179064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:03 smithi007 bash[22722]: cluster 2024-09-14T01:25:01.581557+0000 mgr.a (mgr.14355) 7963 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:03 smithi007 bash[22722]: audit 2024-09-14T01:25:01.589677+0000 mgr.a (mgr.14355) 7964 : audit [DBG] from='client.179064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:03 smithi131 bash[24745]: cluster 2024-09-14T01:25:01.581557+0000 mgr.a (mgr.14355) 7963 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:03 smithi131 bash[24745]: audit 2024-09-14T01:25:01.589677+0000 mgr.a (mgr.14355) 7964 : audit [DBG] from='client.179064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:05 smithi171 bash[25040]: cluster 2024-09-14T01:25:03.582454+0000 mgr.a (mgr.14355) 7965 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:05 smithi007 bash[22722]: cluster 2024-09-14T01:25:03.582454+0000 mgr.a (mgr.14355) 7965 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:05 smithi131 bash[24745]: cluster 2024-09-14T01:25:03.582454+0000 mgr.a (mgr.14355) 7965 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:07.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:07.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:07 smithi007 bash[22722]: cluster 2024-09-14T01:25:05.584668+0000 mgr.a (mgr.14355) 7966 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:07.756 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:07.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:07.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:07.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:07.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:07 smithi131 bash[24745]: cluster 2024-09-14T01:25:05.584668+0000 mgr.a (mgr.14355) 7966 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:07 smithi171 bash[25040]: cluster 2024-09-14T01:25:05.584668+0000 mgr.a (mgr.14355) 7966 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:08 smithi007 bash[22722]: audit 2024-09-14T01:25:07.333860+0000 mgr.a (mgr.14355) 7967 : audit [DBG] from='client.179139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:08 smithi131 bash[24745]: audit 2024-09-14T01:25:07.333860+0000 mgr.a (mgr.14355) 7967 : audit [DBG] from='client.179139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:08 smithi171 bash[25040]: audit 2024-09-14T01:25:07.333860+0000 mgr.a (mgr.14355) 7967 : audit [DBG] from='client.179139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:09 smithi007 bash[22722]: cluster 2024-09-14T01:25:07.585203+0000 mgr.a (mgr.14355) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:09 smithi131 bash[24745]: cluster 2024-09-14T01:25:07.585203+0000 mgr.a (mgr.14355) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:09 smithi171 bash[25040]: cluster 2024-09-14T01:25:07.585203+0000 mgr.a (mgr.14355) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:11 smithi007 bash[22722]: cluster 2024-09-14T01:25:09.586231+0000 mgr.a (mgr.14355) 7969 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:11 smithi131 bash[24745]: cluster 2024-09-14T01:25:09.586231+0000 mgr.a (mgr.14355) 7969 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:11 smithi171 bash[25040]: cluster 2024-09-14T01:25:09.586231+0000 mgr.a (mgr.14355) 7969 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:13.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:13.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:13 smithi007 bash[22722]: cluster 2024-09-14T01:25:11.588550+0000 mgr.a (mgr.14355) 7970 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:13 smithi131 bash[24745]: cluster 2024-09-14T01:25:11.588550+0000 mgr.a (mgr.14355) 7970 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:13 smithi171 bash[25040]: cluster 2024-09-14T01:25:11.588550+0000 mgr.a (mgr.14355) 7970 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:14 smithi007 bash[22722]: audit 2024-09-14T01:25:13.090878+0000 mgr.a (mgr.14355) 7971 : audit [DBG] from='client.179217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:14 smithi131 bash[24745]: audit 2024-09-14T01:25:13.090878+0000 mgr.a (mgr.14355) 7971 : audit [DBG] from='client.179217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:14 smithi171 bash[25040]: audit 2024-09-14T01:25:13.090878+0000 mgr.a (mgr.14355) 7971 : audit [DBG] from='client.179217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:15 smithi007 bash[22722]: cluster 2024-09-14T01:25:13.589487+0000 mgr.a (mgr.14355) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:15 smithi131 bash[24745]: cluster 2024-09-14T01:25:13.589487+0000 mgr.a (mgr.14355) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:15 smithi171 bash[25040]: cluster 2024-09-14T01:25:13.589487+0000 mgr.a (mgr.14355) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:17 smithi007 bash[22722]: cluster 2024-09-14T01:25:15.591764+0000 mgr.a (mgr.14355) 7973 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:17 smithi131 bash[24745]: cluster 2024-09-14T01:25:15.591764+0000 mgr.a (mgr.14355) 7973 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:17 smithi171 bash[25040]: cluster 2024-09-14T01:25:15.591764+0000 mgr.a (mgr.14355) 7973 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:18.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:18.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:19.308 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:19.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:19.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:19 smithi007 bash[22722]: cluster 2024-09-14T01:25:17.592545+0000 mgr.a (mgr.14355) 7974 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:19 smithi131 bash[24745]: cluster 2024-09-14T01:25:17.592545+0000 mgr.a (mgr.14355) 7974 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:19 smithi171 bash[25040]: cluster 2024-09-14T01:25:17.592545+0000 mgr.a (mgr.14355) 7974 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:20 smithi007 bash[22722]: audit 2024-09-14T01:25:18.863645+0000 mgr.a (mgr.14355) 7975 : audit [DBG] from='client.179292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:20 smithi131 bash[24745]: audit 2024-09-14T01:25:18.863645+0000 mgr.a (mgr.14355) 7975 : audit [DBG] from='client.179292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:20 smithi171 bash[25040]: audit 2024-09-14T01:25:18.863645+0000 mgr.a (mgr.14355) 7975 : audit [DBG] from='client.179292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:21 smithi007 bash[22722]: cluster 2024-09-14T01:25:19.593513+0000 mgr.a (mgr.14355) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:21 smithi131 bash[24745]: cluster 2024-09-14T01:25:19.593513+0000 mgr.a (mgr.14355) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:21 smithi171 bash[25040]: cluster 2024-09-14T01:25:19.593513+0000 mgr.a (mgr.14355) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:23 smithi007 bash[22722]: cluster 2024-09-14T01:25:21.595830+0000 mgr.a (mgr.14355) 7977 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:23 smithi131 bash[24745]: cluster 2024-09-14T01:25:21.595830+0000 mgr.a (mgr.14355) 7977 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:23 smithi171 bash[25040]: cluster 2024-09-14T01:25:21.595830+0000 mgr.a (mgr.14355) 7977 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:24.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:24.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:24.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:25.076 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:25.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:25.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:25.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:25.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:25 smithi007 bash[22722]: cluster 2024-09-14T01:25:23.596620+0000 mgr.a (mgr.14355) 7978 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:25 smithi131 bash[24745]: cluster 2024-09-14T01:25:23.596620+0000 mgr.a (mgr.14355) 7978 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:25.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:25 smithi171 bash[25040]: cluster 2024-09-14T01:25:23.596620+0000 mgr.a (mgr.14355) 7978 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:26 smithi007 bash[22722]: audit 2024-09-14T01:25:24.643635+0000 mgr.a (mgr.14355) 7979 : audit [DBG] from='client.179367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:26 smithi131 bash[24745]: audit 2024-09-14T01:25:24.643635+0000 mgr.a (mgr.14355) 7979 : audit [DBG] from='client.179367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:26 smithi171 bash[25040]: audit 2024-09-14T01:25:24.643635+0000 mgr.a (mgr.14355) 7979 : audit [DBG] from='client.179367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:27 smithi007 bash[22722]: cluster 2024-09-14T01:25:25.599071+0000 mgr.a (mgr.14355) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:27 smithi131 bash[24745]: cluster 2024-09-14T01:25:25.599071+0000 mgr.a (mgr.14355) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:27 smithi171 bash[25040]: cluster 2024-09-14T01:25:25.599071+0000 mgr.a (mgr.14355) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:29 smithi007 bash[22722]: cluster 2024-09-14T01:25:27.599871+0000 mgr.a (mgr.14355) 7981 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:29 smithi131 bash[24745]: cluster 2024-09-14T01:25:27.599871+0000 mgr.a (mgr.14355) 7981 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:29 smithi171 bash[25040]: cluster 2024-09-14T01:25:27.599871+0000 mgr.a (mgr.14355) 7981 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:30.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:30.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:31 smithi007 bash[22722]: cluster 2024-09-14T01:25:29.600682+0000 mgr.a (mgr.14355) 7982 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:31 smithi007 bash[22722]: audit 2024-09-14T01:25:30.419197+0000 mgr.a (mgr.14355) 7983 : audit [DBG] from='client.179445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:31 smithi131 bash[24745]: cluster 2024-09-14T01:25:29.600682+0000 mgr.a (mgr.14355) 7982 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:31 smithi131 bash[24745]: audit 2024-09-14T01:25:30.419197+0000 mgr.a (mgr.14355) 7983 : audit [DBG] from='client.179445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:31 smithi171 bash[25040]: cluster 2024-09-14T01:25:29.600682+0000 mgr.a (mgr.14355) 7982 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:31 smithi171 bash[25040]: audit 2024-09-14T01:25:30.419197+0000 mgr.a (mgr.14355) 7983 : audit [DBG] from='client.179445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:33 smithi007 bash[22722]: cluster 2024-09-14T01:25:31.603520+0000 mgr.a (mgr.14355) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:33 smithi131 bash[24745]: cluster 2024-09-14T01:25:31.603520+0000 mgr.a (mgr.14355) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:33 smithi171 bash[25040]: cluster 2024-09-14T01:25:31.603520+0000 mgr.a (mgr.14355) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:35 smithi007 bash[22722]: cluster 2024-09-14T01:25:33.604295+0000 mgr.a (mgr.14355) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:35 smithi131 bash[24745]: cluster 2024-09-14T01:25:33.604295+0000 mgr.a (mgr.14355) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:35 smithi171 bash[25040]: cluster 2024-09-14T01:25:33.604295+0000 mgr.a (mgr.14355) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:35.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:35.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:36.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:36.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:36.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:36.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:36.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:36.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:36 smithi007 bash[22722]: audit 2024-09-14T01:25:36.120218+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:25:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:36 smithi131 bash[24745]: audit 2024-09-14T01:25:36.120218+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:25:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:36 smithi171 bash[25040]: audit 2024-09-14T01:25:36.120218+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: cluster 2024-09-14T01:25:35.606284+0000 mgr.a (mgr.14355) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: audit 2024-09-14T01:25:36.204617+0000 mgr.a (mgr.14355) 7987 : audit [DBG] from='client.179520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: audit 2024-09-14T01:25:36.733638+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: audit 2024-09-14T01:25:36.739002+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: audit 2024-09-14T01:25:36.748459+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:37 smithi007 bash[22722]: audit 2024-09-14T01:25:36.752801+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: cluster 2024-09-14T01:25:35.606284+0000 mgr.a (mgr.14355) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: audit 2024-09-14T01:25:36.204617+0000 mgr.a (mgr.14355) 7987 : audit [DBG] from='client.179520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: audit 2024-09-14T01:25:36.733638+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: audit 2024-09-14T01:25:36.739002+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: audit 2024-09-14T01:25:36.748459+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:37 smithi131 bash[24745]: audit 2024-09-14T01:25:36.752801+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: cluster 2024-09-14T01:25:35.606284+0000 mgr.a (mgr.14355) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: audit 2024-09-14T01:25:36.204617+0000 mgr.a (mgr.14355) 7987 : audit [DBG] from='client.179520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: audit 2024-09-14T01:25:36.733638+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: audit 2024-09-14T01:25:36.739002+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: audit 2024-09-14T01:25:36.748459+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:37 smithi171 bash[25040]: audit 2024-09-14T01:25:36.752801+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22972]: debug 2024-09-14T01:25:38.165+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:25:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22972]: debug 2024-09-14T01:25:38.165+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:25:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22722]: audit 2024-09-14T01:25:37.418990+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:25:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22722]: audit 2024-09-14T01:25:37.420674+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:25:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22722]: audit 2024-09-14T01:25:37.430281+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22722]: audit 2024-09-14T01:25:37.435250+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:38 smithi007 bash[22722]: audit 2024-09-14T01:25:37.437896+0000 mgr.a (mgr.14355) 7988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:38 smithi131 bash[24745]: audit 2024-09-14T01:25:37.418990+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:25:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:38 smithi131 bash[24745]: audit 2024-09-14T01:25:37.420674+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:25:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:38 smithi131 bash[24745]: audit 2024-09-14T01:25:37.430281+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:38 smithi131 bash[24745]: audit 2024-09-14T01:25:37.435250+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:38 smithi131 bash[24745]: audit 2024-09-14T01:25:37.437896+0000 mgr.a (mgr.14355) 7988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:38 smithi171 bash[25040]: audit 2024-09-14T01:25:37.418990+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:38 smithi171 bash[25040]: audit 2024-09-14T01:25:37.420674+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:38 smithi171 bash[25040]: audit 2024-09-14T01:25:37.430281+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:38 smithi171 bash[25040]: audit 2024-09-14T01:25:37.435250+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:38 smithi171 bash[25040]: audit 2024-09-14T01:25:37.437896+0000 mgr.a (mgr.14355) 7988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:25:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:39 smithi007 bash[22722]: cluster 2024-09-14T01:25:37.606971+0000 mgr.a (mgr.14355) 7989 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:39 smithi007 bash[22722]: audit 2024-09-14T01:25:38.168450+0000 mgr.a (mgr.14355) 7990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:25:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:39 smithi007 bash[22722]: cephadm 2024-09-14T01:25:38.169815+0000 mgr.a (mgr.14355) 7991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:25:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:39 smithi131 bash[24745]: cluster 2024-09-14T01:25:37.606971+0000 mgr.a (mgr.14355) 7989 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:39 smithi131 bash[24745]: audit 2024-09-14T01:25:38.168450+0000 mgr.a (mgr.14355) 7990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:25:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:39 smithi131 bash[24745]: cephadm 2024-09-14T01:25:38.169815+0000 mgr.a (mgr.14355) 7991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:25:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:39 smithi171 bash[25040]: cluster 2024-09-14T01:25:37.606971+0000 mgr.a (mgr.14355) 7989 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:25:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:39 smithi171 bash[25040]: audit 2024-09-14T01:25:38.168450+0000 mgr.a (mgr.14355) 7990 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:25:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:39 smithi171 bash[25040]: cephadm 2024-09-14T01:25:38.169815+0000 mgr.a (mgr.14355) 7991 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:25:41.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:41.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:41.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:41 smithi007 bash[22722]: cluster 2024-09-14T01:25:39.607784+0000 mgr.a (mgr.14355) 7992 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:41 smithi131 bash[24745]: cluster 2024-09-14T01:25:39.607784+0000 mgr.a (mgr.14355) 7992 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:41 smithi171 bash[25040]: cluster 2024-09-14T01:25:39.607784+0000 mgr.a (mgr.14355) 7992 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:25:42.432 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:42.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:43 smithi007 bash[22722]: cluster 2024-09-14T01:25:41.610019+0000 mgr.a (mgr.14355) 7993 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:43 smithi007 bash[22722]: audit 2024-09-14T01:25:41.993744+0000 mgr.a (mgr.14355) 7994 : audit [DBG] from='client.179703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:43 smithi131 bash[24745]: cluster 2024-09-14T01:25:41.610019+0000 mgr.a (mgr.14355) 7993 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:43 smithi131 bash[24745]: audit 2024-09-14T01:25:41.993744+0000 mgr.a (mgr.14355) 7994 : audit [DBG] from='client.179703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:43 smithi171 bash[25040]: cluster 2024-09-14T01:25:41.610019+0000 mgr.a (mgr.14355) 7993 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:43 smithi171 bash[25040]: audit 2024-09-14T01:25:41.993744+0000 mgr.a (mgr.14355) 7994 : audit [DBG] from='client.179703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:45 smithi007 bash[22722]: cluster 2024-09-14T01:25:43.610920+0000 mgr.a (mgr.14355) 7995 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:45 smithi131 bash[24745]: cluster 2024-09-14T01:25:43.610920+0000 mgr.a (mgr.14355) 7995 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:45 smithi171 bash[25040]: cluster 2024-09-14T01:25:43.610920+0000 mgr.a (mgr.14355) 7995 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:47.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:47.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:47 smithi007 bash[22722]: cluster 2024-09-14T01:25:45.613143+0000 mgr.a (mgr.14355) 7996 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:47 smithi131 bash[24745]: cluster 2024-09-14T01:25:45.613143+0000 mgr.a (mgr.14355) 7996 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:47 smithi171 bash[25040]: cluster 2024-09-14T01:25:45.613143+0000 mgr.a (mgr.14355) 7996 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:48.175 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:49 smithi007 bash[22722]: cluster 2024-09-14T01:25:47.613778+0000 mgr.a (mgr.14355) 7997 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:49 smithi007 bash[22722]: audit 2024-09-14T01:25:47.760614+0000 mgr.a (mgr.14355) 7998 : audit [DBG] from='client.179781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:49 smithi131 bash[24745]: cluster 2024-09-14T01:25:47.613778+0000 mgr.a (mgr.14355) 7997 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:49 smithi131 bash[24745]: audit 2024-09-14T01:25:47.760614+0000 mgr.a (mgr.14355) 7998 : audit [DBG] from='client.179781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:49 smithi171 bash[25040]: cluster 2024-09-14T01:25:47.613778+0000 mgr.a (mgr.14355) 7997 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:49 smithi171 bash[25040]: audit 2024-09-14T01:25:47.760614+0000 mgr.a (mgr.14355) 7998 : audit [DBG] from='client.179781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:51 smithi131 bash[24745]: cluster 2024-09-14T01:25:49.614697+0000 mgr.a (mgr.14355) 7999 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:51 smithi171 bash[25040]: cluster 2024-09-14T01:25:49.614697+0000 mgr.a (mgr.14355) 7999 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:51 smithi007 bash[22722]: cluster 2024-09-14T01:25:49.614697+0000 mgr.a (mgr.14355) 7999 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:53 smithi131 bash[24745]: cluster 2024-09-14T01:25:51.616922+0000 mgr.a (mgr.14355) 8000 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:53 smithi171 bash[25040]: cluster 2024-09-14T01:25:51.616922+0000 mgr.a (mgr.14355) 8000 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:53.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:53.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:53.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:53 smithi007 bash[22722]: cluster 2024-09-14T01:25:51.616922+0000 mgr.a (mgr.14355) 8000 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:25:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:54 smithi131 bash[24745]: audit 2024-09-14T01:25:53.511053+0000 mgr.a (mgr.14355) 8001 : audit [DBG] from='client.179856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:54 smithi171 bash[25040]: audit 2024-09-14T01:25:53.511053+0000 mgr.a (mgr.14355) 8001 : audit [DBG] from='client.179856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:54 smithi007 bash[22722]: audit 2024-09-14T01:25:53.511053+0000 mgr.a (mgr.14355) 8001 : audit [DBG] from='client.179856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:25:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:55 smithi131 bash[24745]: cluster 2024-09-14T01:25:53.617379+0000 mgr.a (mgr.14355) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:55 smithi171 bash[25040]: cluster 2024-09-14T01:25:53.617379+0000 mgr.a (mgr.14355) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:55 smithi007 bash[22722]: cluster 2024-09-14T01:25:53.617379+0000 mgr.a (mgr.14355) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:57 smithi131 bash[24745]: cluster 2024-09-14T01:25:55.619666+0000 mgr.a (mgr.14355) 8003 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:57 smithi171 bash[25040]: cluster 2024-09-14T01:25:55.619666+0000 mgr.a (mgr.14355) 8003 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:57 smithi007 bash[22722]: cluster 2024-09-14T01:25:55.619666+0000 mgr.a (mgr.14355) 8003 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:25:58.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:25:58.925 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:25:58.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:25:59.702 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:25:59.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:25:59.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:25:59.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:25:59.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:25:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:25:59 smithi131 bash[24745]: cluster 2024-09-14T01:25:57.620487+0000 mgr.a (mgr.14355) 8004 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:25:59 smithi171 bash[25040]: cluster 2024-09-14T01:25:57.620487+0000 mgr.a (mgr.14355) 8004 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:25:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:25:59 smithi007 bash[22722]: cluster 2024-09-14T01:25:57.620487+0000 mgr.a (mgr.14355) 8004 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:00 smithi131 bash[24745]: audit 2024-09-14T01:25:59.260723+0000 mgr.a (mgr.14355) 8005 : audit [DBG] from='client.179934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:00 smithi171 bash[25040]: audit 2024-09-14T01:25:59.260723+0000 mgr.a (mgr.14355) 8005 : audit [DBG] from='client.179934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:00 smithi007 bash[22722]: audit 2024-09-14T01:25:59.260723+0000 mgr.a (mgr.14355) 8005 : audit [DBG] from='client.179934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:01 smithi131 bash[24745]: cluster 2024-09-14T01:25:59.621171+0000 mgr.a (mgr.14355) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:01 smithi171 bash[25040]: cluster 2024-09-14T01:25:59.621171+0000 mgr.a (mgr.14355) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:01 smithi007 bash[22722]: cluster 2024-09-14T01:25:59.621171+0000 mgr.a (mgr.14355) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:03 smithi131 bash[24745]: cluster 2024-09-14T01:26:01.623466+0000 mgr.a (mgr.14355) 8007 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:03 smithi171 bash[25040]: cluster 2024-09-14T01:26:01.623466+0000 mgr.a (mgr.14355) 8007 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:03 smithi007 bash[22722]: cluster 2024-09-14T01:26:01.623466+0000 mgr.a (mgr.14355) 8007 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:04.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:04.705 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:04.705 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:05.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:05 smithi131 bash[24745]: cluster 2024-09-14T01:26:03.624267+0000 mgr.a (mgr.14355) 8008 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:05 smithi171 bash[25040]: cluster 2024-09-14T01:26:03.624267+0000 mgr.a (mgr.14355) 8008 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:05 smithi007 bash[22722]: cluster 2024-09-14T01:26:03.624267+0000 mgr.a (mgr.14355) 8008 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:06 smithi131 bash[24745]: audit 2024-09-14T01:26:05.037690+0000 mgr.a (mgr.14355) 8009 : audit [DBG] from='client.180012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:06 smithi171 bash[25040]: audit 2024-09-14T01:26:05.037690+0000 mgr.a (mgr.14355) 8009 : audit [DBG] from='client.180012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:06 smithi007 bash[22722]: audit 2024-09-14T01:26:05.037690+0000 mgr.a (mgr.14355) 8009 : audit [DBG] from='client.180012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:07 smithi131 bash[24745]: cluster 2024-09-14T01:26:05.627015+0000 mgr.a (mgr.14355) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:07 smithi171 bash[25040]: cluster 2024-09-14T01:26:05.627015+0000 mgr.a (mgr.14355) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:07 smithi007 bash[22722]: cluster 2024-09-14T01:26:05.627015+0000 mgr.a (mgr.14355) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:09 smithi131 bash[24745]: cluster 2024-09-14T01:26:07.627795+0000 mgr.a (mgr.14355) 8011 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:09 smithi171 bash[25040]: cluster 2024-09-14T01:26:07.627795+0000 mgr.a (mgr.14355) 8011 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:09 smithi007 bash[22722]: cluster 2024-09-14T01:26:07.627795+0000 mgr.a (mgr.14355) 8011 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:10.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:10.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:11.208 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:11.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:11.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:11 smithi131 bash[24745]: cluster 2024-09-14T01:26:09.628560+0000 mgr.a (mgr.14355) 8012 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:26:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:11 smithi171 bash[25040]: cluster 2024-09-14T01:26:09.628560+0000 mgr.a (mgr.14355) 8012 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:26:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:11 smithi007 bash[22722]: cluster 2024-09-14T01:26:09.628560+0000 mgr.a (mgr.14355) 8012 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:26:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:12 smithi171 bash[25040]: audit 2024-09-14T01:26:10.789080+0000 mgr.a (mgr.14355) 8013 : audit [DBG] from='client.180090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:12 smithi007 bash[22722]: audit 2024-09-14T01:26:10.789080+0000 mgr.a (mgr.14355) 8013 : audit [DBG] from='client.180090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:12 smithi131 bash[24745]: audit 2024-09-14T01:26:10.789080+0000 mgr.a (mgr.14355) 8013 : audit [DBG] from='client.180090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:13 smithi171 bash[25040]: cluster 2024-09-14T01:26:11.631372+0000 mgr.a (mgr.14355) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:13 smithi007 bash[22722]: cluster 2024-09-14T01:26:11.631372+0000 mgr.a (mgr.14355) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:13 smithi131 bash[24745]: cluster 2024-09-14T01:26:11.631372+0000 mgr.a (mgr.14355) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:15 smithi171 bash[25040]: cluster 2024-09-14T01:26:13.632293+0000 mgr.a (mgr.14355) 8015 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:15 smithi007 bash[22722]: cluster 2024-09-14T01:26:13.632293+0000 mgr.a (mgr.14355) 8015 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:15 smithi131 bash[24745]: cluster 2024-09-14T01:26:13.632293+0000 mgr.a (mgr.14355) 8015 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:26:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:16.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:16.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:17 smithi007 bash[22722]: cluster 2024-09-14T01:26:15.634510+0000 mgr.a (mgr.14355) 8016 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:17 smithi007 bash[22722]: audit 2024-09-14T01:26:16.541099+0000 mgr.a (mgr.14355) 8017 : audit [DBG] from='client.180168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:17 smithi131 bash[24745]: cluster 2024-09-14T01:26:15.634510+0000 mgr.a (mgr.14355) 8016 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:17 smithi131 bash[24745]: audit 2024-09-14T01:26:16.541099+0000 mgr.a (mgr.14355) 8017 : audit [DBG] from='client.180168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:17 smithi171 bash[25040]: cluster 2024-09-14T01:26:15.634510+0000 mgr.a (mgr.14355) 8016 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:17 smithi171 bash[25040]: audit 2024-09-14T01:26:16.541099+0000 mgr.a (mgr.14355) 8017 : audit [DBG] from='client.180168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:19 smithi007 bash[22722]: cluster 2024-09-14T01:26:17.635657+0000 mgr.a (mgr.14355) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:19 smithi131 bash[24745]: cluster 2024-09-14T01:26:17.635657+0000 mgr.a (mgr.14355) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:19 smithi171 bash[25040]: cluster 2024-09-14T01:26:17.635657+0000 mgr.a (mgr.14355) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:21 smithi007 bash[22722]: cluster 2024-09-14T01:26:19.636502+0000 mgr.a (mgr.14355) 8019 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:21.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:21.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:21 smithi131 bash[24745]: cluster 2024-09-14T01:26:19.636502+0000 mgr.a (mgr.14355) 8019 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:21 smithi171 bash[25040]: cluster 2024-09-14T01:26:19.636502+0000 mgr.a (mgr.14355) 8019 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:22.712 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:22.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:22.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:23 smithi007 bash[22722]: cluster 2024-09-14T01:26:21.638763+0000 mgr.a (mgr.14355) 8020 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:23 smithi007 bash[22722]: audit 2024-09-14T01:26:22.286673+0000 mgr.a (mgr.14355) 8021 : audit [DBG] from='client.180240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:23 smithi131 bash[24745]: cluster 2024-09-14T01:26:21.638763+0000 mgr.a (mgr.14355) 8020 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:23 smithi131 bash[24745]: audit 2024-09-14T01:26:22.286673+0000 mgr.a (mgr.14355) 8021 : audit [DBG] from='client.180240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:23 smithi171 bash[25040]: cluster 2024-09-14T01:26:21.638763+0000 mgr.a (mgr.14355) 8020 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:23 smithi171 bash[25040]: audit 2024-09-14T01:26:22.286673+0000 mgr.a (mgr.14355) 8021 : audit [DBG] from='client.180240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:25 smithi007 bash[22722]: cluster 2024-09-14T01:26:23.639696+0000 mgr.a (mgr.14355) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:25 smithi131 bash[24745]: cluster 2024-09-14T01:26:23.639696+0000 mgr.a (mgr.14355) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:25 smithi171 bash[25040]: cluster 2024-09-14T01:26:23.639696+0000 mgr.a (mgr.14355) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:27.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:27.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:27.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:27 smithi007 bash[22722]: cluster 2024-09-14T01:26:25.641905+0000 mgr.a (mgr.14355) 8023 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:27 smithi131 bash[24745]: cluster 2024-09-14T01:26:25.641905+0000 mgr.a (mgr.14355) 8023 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:27 smithi171 bash[25040]: cluster 2024-09-14T01:26:25.641905+0000 mgr.a (mgr.14355) 8023 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:28.462 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:29 smithi007 bash[22722]: cluster 2024-09-14T01:26:27.642682+0000 mgr.a (mgr.14355) 8024 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:29 smithi007 bash[22722]: audit 2024-09-14T01:26:28.042939+0000 mgr.a (mgr.14355) 8025 : audit [DBG] from='client.180318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:29 smithi131 bash[24745]: cluster 2024-09-14T01:26:27.642682+0000 mgr.a (mgr.14355) 8024 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:29 smithi131 bash[24745]: audit 2024-09-14T01:26:28.042939+0000 mgr.a (mgr.14355) 8025 : audit [DBG] from='client.180318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:29 smithi171 bash[25040]: cluster 2024-09-14T01:26:27.642682+0000 mgr.a (mgr.14355) 8024 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:29 smithi171 bash[25040]: audit 2024-09-14T01:26:28.042939+0000 mgr.a (mgr.14355) 8025 : audit [DBG] from='client.180318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:31 smithi007 bash[22722]: cluster 2024-09-14T01:26:29.643604+0000 mgr.a (mgr.14355) 8026 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:31 smithi131 bash[24745]: cluster 2024-09-14T01:26:29.643604+0000 mgr.a (mgr.14355) 8026 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:31 smithi171 bash[25040]: cluster 2024-09-14T01:26:29.643604+0000 mgr.a (mgr.14355) 8026 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:33.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:33.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:33.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:33 smithi007 bash[22722]: cluster 2024-09-14T01:26:31.645831+0000 mgr.a (mgr.14355) 8027 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:33 smithi131 bash[24745]: cluster 2024-09-14T01:26:31.645831+0000 mgr.a (mgr.14355) 8027 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:33 smithi171 bash[25040]: cluster 2024-09-14T01:26:31.645831+0000 mgr.a (mgr.14355) 8027 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:34.207 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:34.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:34.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:35 smithi007 bash[22722]: cluster 2024-09-14T01:26:33.646274+0000 mgr.a (mgr.14355) 8028 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:35 smithi007 bash[22722]: audit 2024-09-14T01:26:33.796366+0000 mgr.a (mgr.14355) 8029 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:35 smithi131 bash[24745]: cluster 2024-09-14T01:26:33.646274+0000 mgr.a (mgr.14355) 8028 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:35 smithi131 bash[24745]: audit 2024-09-14T01:26:33.796366+0000 mgr.a (mgr.14355) 8029 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:35 smithi171 bash[25040]: cluster 2024-09-14T01:26:33.646274+0000 mgr.a (mgr.14355) 8028 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:35 smithi171 bash[25040]: audit 2024-09-14T01:26:33.796366+0000 mgr.a (mgr.14355) 8029 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:37 smithi007 bash[22722]: cluster 2024-09-14T01:26:35.648663+0000 mgr.a (mgr.14355) 8030 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:37 smithi131 bash[24745]: cluster 2024-09-14T01:26:35.648663+0000 mgr.a (mgr.14355) 8030 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:37 smithi171 bash[25040]: cluster 2024-09-14T01:26:35.648663+0000 mgr.a (mgr.14355) 8030 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:26:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:38 smithi007 bash[22722]: audit 2024-09-14T01:26:38.220030+0000 mon.a (mon.0) 1804 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:26:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:38 smithi131 bash[24745]: audit 2024-09-14T01:26:38.220030+0000 mon.a (mon.0) 1804 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:26:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:38 smithi171 bash[25040]: audit 2024-09-14T01:26:38.220030+0000 mon.a (mon.0) 1804 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:26:39.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:39.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:39.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:39.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22722]: cluster 2024-09-14T01:26:37.649490+0000 mgr.a (mgr.14355) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:39.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22722]: audit 2024-09-14T01:26:39.086748+0000 mon.a (mon.0) 1805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:26:39.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22722]: audit 2024-09-14T01:26:39.088457+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:26:39.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22722]: audit 2024-09-14T01:26:39.099442+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:26:39.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22722]: audit 2024-09-14T01:26:39.104312+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:39 smithi131 bash[24745]: cluster 2024-09-14T01:26:37.649490+0000 mgr.a (mgr.14355) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:39 smithi131 bash[24745]: audit 2024-09-14T01:26:39.086748+0000 mon.a (mon.0) 1805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:39 smithi131 bash[24745]: audit 2024-09-14T01:26:39.088457+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:39 smithi131 bash[24745]: audit 2024-09-14T01:26:39.099442+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:26:40.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:39 smithi131 bash[24745]: audit 2024-09-14T01:26:39.104312+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:39 smithi171 bash[25040]: cluster 2024-09-14T01:26:37.649490+0000 mgr.a (mgr.14355) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:39 smithi171 bash[25040]: audit 2024-09-14T01:26:39.086748+0000 mon.a (mon.0) 1805 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:39 smithi171 bash[25040]: audit 2024-09-14T01:26:39.088457+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:39 smithi171 bash[25040]: audit 2024-09-14T01:26:39.099442+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:39 smithi171 bash[25040]: audit 2024-09-14T01:26:39.104312+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:40.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22972]: debug 2024-09-14T01:26:39.861+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:26:40.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:26:39 smithi007 bash[22972]: debug 2024-09-14T01:26:39.877+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:26:40.268 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:40.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:40.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:40.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:40.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:40 smithi007 bash[22722]: audit 2024-09-14T01:26:39.106662+0000 mgr.a (mgr.14355) 8032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:40 smithi007 bash[22722]: audit 2024-09-14T01:26:39.568026+0000 mgr.a (mgr.14355) 8033 : audit [DBG] from='client.180492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:40 smithi131 bash[24745]: audit 2024-09-14T01:26:39.106662+0000 mgr.a (mgr.14355) 8032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:40 smithi131 bash[24745]: audit 2024-09-14T01:26:39.568026+0000 mgr.a (mgr.14355) 8033 : audit [DBG] from='client.180492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:40 smithi171 bash[25040]: audit 2024-09-14T01:26:39.106662+0000 mgr.a (mgr.14355) 8032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:26:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:40 smithi171 bash[25040]: audit 2024-09-14T01:26:39.568026+0000 mgr.a (mgr.14355) 8033 : audit [DBG] from='client.180492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:41 smithi007 bash[22722]: cluster 2024-09-14T01:26:39.650124+0000 mgr.a (mgr.14355) 8034 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:41 smithi007 bash[22722]: audit 2024-09-14T01:26:39.865449+0000 mgr.a (mgr.14355) 8035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:26:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:41 smithi007 bash[22722]: cephadm 2024-09-14T01:26:39.878864+0000 mgr.a (mgr.14355) 8036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:41 smithi131 bash[24745]: cluster 2024-09-14T01:26:39.650124+0000 mgr.a (mgr.14355) 8034 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:41 smithi131 bash[24745]: audit 2024-09-14T01:26:39.865449+0000 mgr.a (mgr.14355) 8035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:41 smithi131 bash[24745]: cephadm 2024-09-14T01:26:39.878864+0000 mgr.a (mgr.14355) 8036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:26:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:41 smithi171 bash[25040]: cluster 2024-09-14T01:26:39.650124+0000 mgr.a (mgr.14355) 8034 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:41 smithi171 bash[25040]: audit 2024-09-14T01:26:39.865449+0000 mgr.a (mgr.14355) 8035 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:26:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:41 smithi171 bash[25040]: cephadm 2024-09-14T01:26:39.878864+0000 mgr.a (mgr.14355) 8036 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:26:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:42 smithi007 bash[22722]: cluster 2024-09-14T01:26:41.652433+0000 mgr.a (mgr.14355) 8037 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:42 smithi131 bash[24745]: cluster 2024-09-14T01:26:41.652433+0000 mgr.a (mgr.14355) 8037 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:42 smithi171 bash[25040]: cluster 2024-09-14T01:26:41.652433+0000 mgr.a (mgr.14355) 8037 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:44 smithi131 bash[24745]: cluster 2024-09-14T01:26:43.653246+0000 mgr.a (mgr.14355) 8038 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:44 smithi171 bash[25040]: cluster 2024-09-14T01:26:43.653246+0000 mgr.a (mgr.14355) 8038 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:44 smithi007 bash[22722]: cluster 2024-09-14T01:26:43.653246+0000 mgr.a (mgr.14355) 8038 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:46.012 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:46.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:46.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:46.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:46.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:45 smithi131 bash[24745]: audit 2024-09-14T01:26:45.598112+0000 mgr.a (mgr.14355) 8039 : audit [DBG] from='client.180654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:45 smithi171 bash[25040]: audit 2024-09-14T01:26:45.598112+0000 mgr.a (mgr.14355) 8039 : audit [DBG] from='client.180654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:45 smithi007 bash[22722]: audit 2024-09-14T01:26:45.598112+0000 mgr.a (mgr.14355) 8039 : audit [DBG] from='client.180654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:46 smithi131 bash[24745]: cluster 2024-09-14T01:26:45.656445+0000 mgr.a (mgr.14355) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:46 smithi171 bash[25040]: cluster 2024-09-14T01:26:45.656445+0000 mgr.a (mgr.14355) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:46 smithi007 bash[22722]: cluster 2024-09-14T01:26:45.656445+0000 mgr.a (mgr.14355) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:49 smithi007 bash[22722]: cluster 2024-09-14T01:26:47.657365+0000 mgr.a (mgr.14355) 8041 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:49 smithi131 bash[24745]: cluster 2024-09-14T01:26:47.657365+0000 mgr.a (mgr.14355) 8041 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:49 smithi171 bash[25040]: cluster 2024-09-14T01:26:47.657365+0000 mgr.a (mgr.14355) 8041 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:51.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:51.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:51.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:51 smithi007 bash[22722]: cluster 2024-09-14T01:26:49.658127+0000 mgr.a (mgr.14355) 8042 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:51 smithi131 bash[24745]: cluster 2024-09-14T01:26:49.658127+0000 mgr.a (mgr.14355) 8042 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:51.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:51.792 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:51 smithi171 bash[25040]: cluster 2024-09-14T01:26:49.658127+0000 mgr.a (mgr.14355) 8042 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:26:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:52 smithi007 bash[22722]: audit 2024-09-14T01:26:51.350504+0000 mgr.a (mgr.14355) 8043 : audit [DBG] from='client.180729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:52 smithi131 bash[24745]: audit 2024-09-14T01:26:51.350504+0000 mgr.a (mgr.14355) 8043 : audit [DBG] from='client.180729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:52 smithi171 bash[25040]: audit 2024-09-14T01:26:51.350504+0000 mgr.a (mgr.14355) 8043 : audit [DBG] from='client.180729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:53 smithi007 bash[22722]: cluster 2024-09-14T01:26:51.659530+0000 mgr.a (mgr.14355) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:53 smithi131 bash[24745]: cluster 2024-09-14T01:26:51.659530+0000 mgr.a (mgr.14355) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:53 smithi171 bash[25040]: cluster 2024-09-14T01:26:51.659530+0000 mgr.a (mgr.14355) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:26:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:55 smithi007 bash[22722]: cluster 2024-09-14T01:26:53.660402+0000 mgr.a (mgr.14355) 8045 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:26:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:55 smithi131 bash[24745]: cluster 2024-09-14T01:26:53.660402+0000 mgr.a (mgr.14355) 8045 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:26:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:55 smithi171 bash[25040]: cluster 2024-09-14T01:26:53.660402+0000 mgr.a (mgr.14355) 8045 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:26:56.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:26:56.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:26:56.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:26:57.581 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:26:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:26:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:26:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:26:57.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:26:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:57 smithi007 bash[22722]: cluster 2024-09-14T01:26:55.662630+0000 mgr.a (mgr.14355) 8046 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:26:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:57 smithi131 bash[24745]: cluster 2024-09-14T01:26:55.662630+0000 mgr.a (mgr.14355) 8046 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:26:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:57 smithi171 bash[25040]: cluster 2024-09-14T01:26:55.662630+0000 mgr.a (mgr.14355) 8046 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:26:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:58 smithi007 bash[22722]: audit 2024-09-14T01:26:57.132372+0000 mgr.a (mgr.14355) 8047 : audit [DBG] from='client.180804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:58 smithi131 bash[24745]: audit 2024-09-14T01:26:57.132372+0000 mgr.a (mgr.14355) 8047 : audit [DBG] from='client.180804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:58 smithi171 bash[25040]: audit 2024-09-14T01:26:57.132372+0000 mgr.a (mgr.14355) 8047 : audit [DBG] from='client.180804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:26:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:26:59 smithi007 bash[22722]: cluster 2024-09-14T01:26:57.663532+0000 mgr.a (mgr.14355) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:26:59 smithi131 bash[24745]: cluster 2024-09-14T01:26:57.663532+0000 mgr.a (mgr.14355) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:26:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:26:59 smithi171 bash[25040]: cluster 2024-09-14T01:26:57.663532+0000 mgr.a (mgr.14355) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:01 smithi007 bash[22722]: cluster 2024-09-14T01:26:59.664304+0000 mgr.a (mgr.14355) 8049 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:01 smithi131 bash[24745]: cluster 2024-09-14T01:26:59.664304+0000 mgr.a (mgr.14355) 8049 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:01 smithi171 bash[25040]: cluster 2024-09-14T01:26:59.664304+0000 mgr.a (mgr.14355) 8049 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:03.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:03.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:03.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:03 smithi007 bash[22722]: cluster 2024-09-14T01:27:01.666562+0000 mgr.a (mgr.14355) 8050 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:03 smithi131 bash[24745]: cluster 2024-09-14T01:27:01.666562+0000 mgr.a (mgr.14355) 8050 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:03 smithi171 bash[25040]: cluster 2024-09-14T01:27:01.666562+0000 mgr.a (mgr.14355) 8050 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:04 smithi007 bash[22722]: audit 2024-09-14T01:27:02.921334+0000 mgr.a (mgr.14355) 8051 : audit [DBG] from='client.180876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:04 smithi131 bash[24745]: audit 2024-09-14T01:27:02.921334+0000 mgr.a (mgr.14355) 8051 : audit [DBG] from='client.180876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:04 smithi171 bash[25040]: audit 2024-09-14T01:27:02.921334+0000 mgr.a (mgr.14355) 8051 : audit [DBG] from='client.180876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:05 smithi007 bash[22722]: cluster 2024-09-14T01:27:03.667419+0000 mgr.a (mgr.14355) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:05 smithi131 bash[24745]: cluster 2024-09-14T01:27:03.667419+0000 mgr.a (mgr.14355) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:05 smithi171 bash[25040]: cluster 2024-09-14T01:27:03.667419+0000 mgr.a (mgr.14355) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:07 smithi007 bash[22722]: cluster 2024-09-14T01:27:05.669633+0000 mgr.a (mgr.14355) 8053 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:07 smithi131 bash[24745]: cluster 2024-09-14T01:27:05.669633+0000 mgr.a (mgr.14355) 8053 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:07 smithi171 bash[25040]: cluster 2024-09-14T01:27:05.669633+0000 mgr.a (mgr.14355) 8053 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:08.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:09.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:09.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:09.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:09 smithi007 bash[22722]: cluster 2024-09-14T01:27:07.670401+0000 mgr.a (mgr.14355) 8054 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:09 smithi131 bash[24745]: cluster 2024-09-14T01:27:07.670401+0000 mgr.a (mgr.14355) 8054 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:09 smithi171 bash[25040]: cluster 2024-09-14T01:27:07.670401+0000 mgr.a (mgr.14355) 8054 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:10 smithi007 bash[22722]: audit 2024-09-14T01:27:08.699009+0000 mgr.a (mgr.14355) 8055 : audit [DBG] from='client.180954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:10 smithi131 bash[24745]: audit 2024-09-14T01:27:08.699009+0000 mgr.a (mgr.14355) 8055 : audit [DBG] from='client.180954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:10 smithi171 bash[25040]: audit 2024-09-14T01:27:08.699009+0000 mgr.a (mgr.14355) 8055 : audit [DBG] from='client.180954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:11 smithi007 bash[22722]: cluster 2024-09-14T01:27:09.671488+0000 mgr.a (mgr.14355) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:11 smithi131 bash[24745]: cluster 2024-09-14T01:27:09.671488+0000 mgr.a (mgr.14355) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:11 smithi171 bash[25040]: cluster 2024-09-14T01:27:09.671488+0000 mgr.a (mgr.14355) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:13 smithi007 bash[22722]: cluster 2024-09-14T01:27:11.673859+0000 mgr.a (mgr.14355) 8057 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:13 smithi131 bash[24745]: cluster 2024-09-14T01:27:11.673859+0000 mgr.a (mgr.14355) 8057 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:13 smithi171 bash[25040]: cluster 2024-09-14T01:27:11.673859+0000 mgr.a (mgr.14355) 8057 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:14.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:14.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:14.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:14.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:14.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:14.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:14.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:14.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:15 smithi007 bash[22722]: cluster 2024-09-14T01:27:13.674812+0000 mgr.a (mgr.14355) 8058 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:15 smithi007 bash[22722]: audit 2024-09-14T01:27:14.486032+0000 mgr.a (mgr.14355) 8059 : audit [DBG] from='client.181032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:15 smithi131 bash[24745]: cluster 2024-09-14T01:27:13.674812+0000 mgr.a (mgr.14355) 8058 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:15 smithi131 bash[24745]: audit 2024-09-14T01:27:14.486032+0000 mgr.a (mgr.14355) 8059 : audit [DBG] from='client.181032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:15 smithi171 bash[25040]: cluster 2024-09-14T01:27:13.674812+0000 mgr.a (mgr.14355) 8058 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:15 smithi171 bash[25040]: audit 2024-09-14T01:27:14.486032+0000 mgr.a (mgr.14355) 8059 : audit [DBG] from='client.181032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:17 smithi007 bash[22722]: cluster 2024-09-14T01:27:15.677174+0000 mgr.a (mgr.14355) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:17 smithi131 bash[24745]: cluster 2024-09-14T01:27:15.677174+0000 mgr.a (mgr.14355) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:17 smithi171 bash[25040]: cluster 2024-09-14T01:27:15.677174+0000 mgr.a (mgr.14355) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:19 smithi007 bash[22722]: cluster 2024-09-14T01:27:17.677965+0000 mgr.a (mgr.14355) 8061 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:19 smithi131 bash[24745]: cluster 2024-09-14T01:27:17.677965+0000 mgr.a (mgr.14355) 8061 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:19 smithi171 bash[25040]: cluster 2024-09-14T01:27:17.677965+0000 mgr.a (mgr.14355) 8061 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:19.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:19.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:19.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:20.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:20.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:20.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:20.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:20.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:21 smithi007 bash[22722]: cluster 2024-09-14T01:27:19.678752+0000 mgr.a (mgr.14355) 8062 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:21 smithi007 bash[22722]: audit 2024-09-14T01:27:20.270479+0000 mgr.a (mgr.14355) 8063 : audit [DBG] from='client.181107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:21 smithi131 bash[24745]: cluster 2024-09-14T01:27:19.678752+0000 mgr.a (mgr.14355) 8062 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:21 smithi131 bash[24745]: audit 2024-09-14T01:27:20.270479+0000 mgr.a (mgr.14355) 8063 : audit [DBG] from='client.181107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:21 smithi171 bash[25040]: cluster 2024-09-14T01:27:19.678752+0000 mgr.a (mgr.14355) 8062 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:21 smithi171 bash[25040]: audit 2024-09-14T01:27:20.270479+0000 mgr.a (mgr.14355) 8063 : audit [DBG] from='client.181107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:23 smithi007 bash[22722]: cluster 2024-09-14T01:27:21.681490+0000 mgr.a (mgr.14355) 8064 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:23 smithi131 bash[24745]: cluster 2024-09-14T01:27:21.681490+0000 mgr.a (mgr.14355) 8064 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:23 smithi171 bash[25040]: cluster 2024-09-14T01:27:21.681490+0000 mgr.a (mgr.14355) 8064 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:25 smithi007 bash[22722]: cluster 2024-09-14T01:27:23.682264+0000 mgr.a (mgr.14355) 8065 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:25.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:25.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:25 smithi131 bash[24745]: cluster 2024-09-14T01:27:23.682264+0000 mgr.a (mgr.14355) 8065 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:25 smithi171 bash[25040]: cluster 2024-09-14T01:27:23.682264+0000 mgr.a (mgr.14355) 8065 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:26.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:26.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:26.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:27 smithi007 bash[22722]: cluster 2024-09-14T01:27:25.684239+0000 mgr.a (mgr.14355) 8066 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:27 smithi007 bash[22722]: audit 2024-09-14T01:27:26.056678+0000 mgr.a (mgr.14355) 8067 : audit [DBG] from='client.181182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:27 smithi131 bash[24745]: cluster 2024-09-14T01:27:25.684239+0000 mgr.a (mgr.14355) 8066 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:27 smithi131 bash[24745]: audit 2024-09-14T01:27:26.056678+0000 mgr.a (mgr.14355) 8067 : audit [DBG] from='client.181182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:27 smithi171 bash[25040]: cluster 2024-09-14T01:27:25.684239+0000 mgr.a (mgr.14355) 8066 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:27 smithi171 bash[25040]: audit 2024-09-14T01:27:26.056678+0000 mgr.a (mgr.14355) 8067 : audit [DBG] from='client.181182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:29 smithi007 bash[22722]: cluster 2024-09-14T01:27:27.685113+0000 mgr.a (mgr.14355) 8068 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:29 smithi131 bash[24745]: cluster 2024-09-14T01:27:27.685113+0000 mgr.a (mgr.14355) 8068 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:29 smithi171 bash[25040]: cluster 2024-09-14T01:27:27.685113+0000 mgr.a (mgr.14355) 8068 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:27:31.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:31.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:31 smithi007 bash[22722]: cluster 2024-09-14T01:27:29.685880+0000 mgr.a (mgr.14355) 8069 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:27:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:31 smithi131 bash[24745]: cluster 2024-09-14T01:27:29.685880+0000 mgr.a (mgr.14355) 8069 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:27:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:31 smithi171 bash[25040]: cluster 2024-09-14T01:27:29.685880+0000 mgr.a (mgr.14355) 8069 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:27:32.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:32.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:33 smithi007 bash[22722]: cluster 2024-09-14T01:27:31.688088+0000 mgr.a (mgr.14355) 8070 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:33 smithi007 bash[22722]: audit 2024-09-14T01:27:31.836333+0000 mgr.a (mgr.14355) 8071 : audit [DBG] from='client.181257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:33 smithi131 bash[24745]: cluster 2024-09-14T01:27:31.688088+0000 mgr.a (mgr.14355) 8070 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:33 smithi131 bash[24745]: audit 2024-09-14T01:27:31.836333+0000 mgr.a (mgr.14355) 8071 : audit [DBG] from='client.181257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:33 smithi171 bash[25040]: cluster 2024-09-14T01:27:31.688088+0000 mgr.a (mgr.14355) 8070 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:33 smithi171 bash[25040]: audit 2024-09-14T01:27:31.836333+0000 mgr.a (mgr.14355) 8071 : audit [DBG] from='client.181257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:35 smithi007 bash[22722]: cluster 2024-09-14T01:27:33.688981+0000 mgr.a (mgr.14355) 8072 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:35 smithi131 bash[24745]: cluster 2024-09-14T01:27:33.688981+0000 mgr.a (mgr.14355) 8072 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:35 smithi171 bash[25040]: cluster 2024-09-14T01:27:33.688981+0000 mgr.a (mgr.14355) 8072 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:37.289 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:37.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:37 smithi007 bash[22722]: cluster 2024-09-14T01:27:35.691194+0000 mgr.a (mgr.14355) 8073 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:37 smithi131 bash[24745]: cluster 2024-09-14T01:27:35.691194+0000 mgr.a (mgr.14355) 8073 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:37 smithi171 bash[25040]: cluster 2024-09-14T01:27:35.691194+0000 mgr.a (mgr.14355) 8073 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:38.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:38.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:39 smithi007 bash[22722]: audit 2024-09-14T01:27:37.623510+0000 mgr.a (mgr.14355) 8074 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:39 smithi007 bash[22722]: cluster 2024-09-14T01:27:37.691709+0000 mgr.a (mgr.14355) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:39 smithi131 bash[24745]: audit 2024-09-14T01:27:37.623510+0000 mgr.a (mgr.14355) 8074 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:39 smithi131 bash[24745]: cluster 2024-09-14T01:27:37.691709+0000 mgr.a (mgr.14355) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:39 smithi171 bash[25040]: audit 2024-09-14T01:27:37.623510+0000 mgr.a (mgr.14355) 8074 : audit [DBG] from='client.181335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:39 smithi171 bash[25040]: cluster 2024-09-14T01:27:37.691709+0000 mgr.a (mgr.14355) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:40 smithi131 bash[24745]: audit 2024-09-14T01:27:39.935113+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:27:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:40 smithi171 bash[25040]: audit 2024-09-14T01:27:39.935113+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:27:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:40 smithi007 bash[22722]: audit 2024-09-14T01:27:39.935113+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:41 smithi131 bash[24745]: cluster 2024-09-14T01:27:39.692563+0000 mgr.a (mgr.14355) 8076 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:41 smithi131 bash[24745]: audit 2024-09-14T01:27:40.766680+0000 mon.a (mon.0) 1810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:41 smithi131 bash[24745]: audit 2024-09-14T01:27:40.768721+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:41 smithi131 bash[24745]: audit 2024-09-14T01:27:40.778091+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:41 smithi131 bash[24745]: audit 2024-09-14T01:27:40.782875+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:41 smithi171 bash[25040]: cluster 2024-09-14T01:27:39.692563+0000 mgr.a (mgr.14355) 8076 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:41 smithi171 bash[25040]: audit 2024-09-14T01:27:40.766680+0000 mon.a (mon.0) 1810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:41 smithi171 bash[25040]: audit 2024-09-14T01:27:40.768721+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:41 smithi171 bash[25040]: audit 2024-09-14T01:27:40.778091+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:41 smithi171 bash[25040]: audit 2024-09-14T01:27:40.782875+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22972]: debug 2024-09-14T01:27:41.512+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:27:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22972]: debug 2024-09-14T01:27:41.516+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:27:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22722]: cluster 2024-09-14T01:27:39.692563+0000 mgr.a (mgr.14355) 8076 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22722]: audit 2024-09-14T01:27:40.766680+0000 mon.a (mon.0) 1810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:27:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22722]: audit 2024-09-14T01:27:40.768721+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:27:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22722]: audit 2024-09-14T01:27:40.778091+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:27:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:41 smithi007 bash[22722]: audit 2024-09-14T01:27:40.782875+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:42 smithi131 bash[24745]: audit 2024-09-14T01:27:40.785138+0000 mgr.a (mgr.14355) 8077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:42 smithi131 bash[24745]: audit 2024-09-14T01:27:41.517644+0000 mgr.a (mgr.14355) 8078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:27:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:42 smithi131 bash[24745]: cephadm 2024-09-14T01:27:41.518712+0000 mgr.a (mgr.14355) 8079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:27:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:42 smithi171 bash[25040]: audit 2024-09-14T01:27:40.785138+0000 mgr.a (mgr.14355) 8077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:42 smithi171 bash[25040]: audit 2024-09-14T01:27:41.517644+0000 mgr.a (mgr.14355) 8078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:27:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:42 smithi171 bash[25040]: cephadm 2024-09-14T01:27:41.518712+0000 mgr.a (mgr.14355) 8079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:27:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:42 smithi007 bash[22722]: audit 2024-09-14T01:27:40.785138+0000 mgr.a (mgr.14355) 8077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:27:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:42 smithi007 bash[22722]: audit 2024-09-14T01:27:41.517644+0000 mgr.a (mgr.14355) 8078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:27:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:42 smithi007 bash[22722]: cephadm 2024-09-14T01:27:41.518712+0000 mgr.a (mgr.14355) 8079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:27:43.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:43.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:43.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:43 smithi131 bash[24745]: cluster 2024-09-14T01:27:41.695185+0000 mgr.a (mgr.14355) 8080 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:43 smithi171 bash[25040]: cluster 2024-09-14T01:27:41.695185+0000 mgr.a (mgr.14355) 8080 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:43.797 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:43 smithi007 bash[22722]: cluster 2024-09-14T01:27:41.695185+0000 mgr.a (mgr.14355) 8080 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:27:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:44 smithi131 bash[24745]: audit 2024-09-14T01:27:43.385947+0000 mgr.a (mgr.14355) 8081 : audit [DBG] from='client.181518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:44 smithi171 bash[25040]: audit 2024-09-14T01:27:43.385947+0000 mgr.a (mgr.14355) 8081 : audit [DBG] from='client.181518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:44 smithi007 bash[22722]: audit 2024-09-14T01:27:43.385947+0000 mgr.a (mgr.14355) 8081 : audit [DBG] from='client.181518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:45 smithi131 bash[24745]: cluster 2024-09-14T01:27:43.700293+0000 mgr.a (mgr.14355) 8082 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:45 smithi171 bash[25040]: cluster 2024-09-14T01:27:43.700293+0000 mgr.a (mgr.14355) 8082 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:45 smithi007 bash[22722]: cluster 2024-09-14T01:27:43.700293+0000 mgr.a (mgr.14355) 8082 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:27:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:47 smithi131 bash[24745]: cluster 2024-09-14T01:27:45.702496+0000 mgr.a (mgr.14355) 8083 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:47 smithi171 bash[25040]: cluster 2024-09-14T01:27:45.702496+0000 mgr.a (mgr.14355) 8083 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:47 smithi007 bash[22722]: cluster 2024-09-14T01:27:45.702496+0000 mgr.a (mgr.14355) 8083 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:48.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:49.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:49.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:49.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:49.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:49.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:49 smithi131 bash[24745]: cluster 2024-09-14T01:27:47.703217+0000 mgr.a (mgr.14355) 8084 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:49 smithi171 bash[25040]: cluster 2024-09-14T01:27:47.703217+0000 mgr.a (mgr.14355) 8084 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:49 smithi007 bash[22722]: cluster 2024-09-14T01:27:47.703217+0000 mgr.a (mgr.14355) 8084 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:50 smithi131 bash[24745]: audit 2024-09-14T01:27:49.133021+0000 mgr.a (mgr.14355) 8085 : audit [DBG] from='client.181590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:50 smithi171 bash[25040]: audit 2024-09-14T01:27:49.133021+0000 mgr.a (mgr.14355) 8085 : audit [DBG] from='client.181590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:50 smithi007 bash[22722]: audit 2024-09-14T01:27:49.133021+0000 mgr.a (mgr.14355) 8085 : audit [DBG] from='client.181590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:51 smithi131 bash[24745]: cluster 2024-09-14T01:27:49.704250+0000 mgr.a (mgr.14355) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:51 smithi171 bash[25040]: cluster 2024-09-14T01:27:49.704250+0000 mgr.a (mgr.14355) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:51 smithi007 bash[22722]: cluster 2024-09-14T01:27:49.704250+0000 mgr.a (mgr.14355) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:53 smithi131 bash[24745]: cluster 2024-09-14T01:27:51.706587+0000 mgr.a (mgr.14355) 8087 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:53 smithi171 bash[25040]: cluster 2024-09-14T01:27:51.706587+0000 mgr.a (mgr.14355) 8087 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:53 smithi007 bash[22722]: cluster 2024-09-14T01:27:51.706587+0000 mgr.a (mgr.14355) 8087 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:27:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:27:54.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:27:55.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:27:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:27:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:27:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:27:55.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:27:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:55 smithi131 bash[24745]: cluster 2024-09-14T01:27:53.707350+0000 mgr.a (mgr.14355) 8088 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:55 smithi171 bash[25040]: cluster 2024-09-14T01:27:53.707350+0000 mgr.a (mgr.14355) 8088 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:55 smithi007 bash[22722]: cluster 2024-09-14T01:27:53.707350+0000 mgr.a (mgr.14355) 8088 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:56 smithi131 bash[24745]: audit 2024-09-14T01:27:54.886996+0000 mgr.a (mgr.14355) 8089 : audit [DBG] from='client.181668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:56 smithi171 bash[25040]: audit 2024-09-14T01:27:54.886996+0000 mgr.a (mgr.14355) 8089 : audit [DBG] from='client.181668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:56 smithi007 bash[22722]: audit 2024-09-14T01:27:54.886996+0000 mgr.a (mgr.14355) 8089 : audit [DBG] from='client.181668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:27:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:57 smithi131 bash[24745]: cluster 2024-09-14T01:27:55.709872+0000 mgr.a (mgr.14355) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:57 smithi171 bash[25040]: cluster 2024-09-14T01:27:55.709872+0000 mgr.a (mgr.14355) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:57 smithi007 bash[22722]: cluster 2024-09-14T01:27:55.709872+0000 mgr.a (mgr.14355) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:27:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:27:59 smithi131 bash[24745]: cluster 2024-09-14T01:27:57.710728+0000 mgr.a (mgr.14355) 8091 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:27:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:27:59 smithi171 bash[25040]: cluster 2024-09-14T01:27:57.710728+0000 mgr.a (mgr.14355) 8091 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:27:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:27:59 smithi007 bash[22722]: cluster 2024-09-14T01:27:57.710728+0000 mgr.a (mgr.14355) 8091 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:28:00.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:00.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:01.103 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:01 smithi131 bash[24745]: cluster 2024-09-14T01:27:59.711483+0000 mgr.a (mgr.14355) 8092 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:28:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:01 smithi171 bash[25040]: cluster 2024-09-14T01:27:59.711483+0000 mgr.a (mgr.14355) 8092 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:28:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:01 smithi007 bash[22722]: cluster 2024-09-14T01:27:59.711483+0000 mgr.a (mgr.14355) 8092 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:28:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:02 smithi171 bash[25040]: audit 2024-09-14T01:28:00.662174+0000 mgr.a (mgr.14355) 8093 : audit [DBG] from='client.181746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:02 smithi007 bash[22722]: audit 2024-09-14T01:28:00.662174+0000 mgr.a (mgr.14355) 8093 : audit [DBG] from='client.181746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:02 smithi131 bash[24745]: audit 2024-09-14T01:28:00.662174+0000 mgr.a (mgr.14355) 8093 : audit [DBG] from='client.181746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:03 smithi171 bash[25040]: cluster 2024-09-14T01:28:01.714273+0000 mgr.a (mgr.14355) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:03 smithi007 bash[22722]: cluster 2024-09-14T01:28:01.714273+0000 mgr.a (mgr.14355) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:03 smithi131 bash[24745]: cluster 2024-09-14T01:28:01.714273+0000 mgr.a (mgr.14355) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:05 smithi007 bash[22722]: cluster 2024-09-14T01:28:03.715081+0000 mgr.a (mgr.14355) 8095 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:05 smithi131 bash[24745]: cluster 2024-09-14T01:28:03.715081+0000 mgr.a (mgr.14355) 8095 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:05 smithi171 bash[25040]: cluster 2024-09-14T01:28:03.715081+0000 mgr.a (mgr.14355) 8095 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:06.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:07 smithi007 bash[22722]: cluster 2024-09-14T01:28:05.717053+0000 mgr.a (mgr.14355) 8096 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:07 smithi007 bash[22722]: audit 2024-09-14T01:28:06.440657+0000 mgr.a (mgr.14355) 8097 : audit [DBG] from='client.181821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:07 smithi131 bash[24745]: cluster 2024-09-14T01:28:05.717053+0000 mgr.a (mgr.14355) 8096 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:07 smithi131 bash[24745]: audit 2024-09-14T01:28:06.440657+0000 mgr.a (mgr.14355) 8097 : audit [DBG] from='client.181821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:07 smithi171 bash[25040]: cluster 2024-09-14T01:28:05.717053+0000 mgr.a (mgr.14355) 8096 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:07 smithi171 bash[25040]: audit 2024-09-14T01:28:06.440657+0000 mgr.a (mgr.14355) 8097 : audit [DBG] from='client.181821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:09 smithi007 bash[22722]: cluster 2024-09-14T01:28:07.717999+0000 mgr.a (mgr.14355) 8098 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:09 smithi131 bash[24745]: cluster 2024-09-14T01:28:07.717999+0000 mgr.a (mgr.14355) 8098 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:09 smithi171 bash[25040]: cluster 2024-09-14T01:28:07.717999+0000 mgr.a (mgr.14355) 8098 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:11 smithi007 bash[22722]: cluster 2024-09-14T01:28:09.718808+0000 mgr.a (mgr.14355) 8099 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:11 smithi131 bash[24745]: cluster 2024-09-14T01:28:09.718808+0000 mgr.a (mgr.14355) 8099 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:11 smithi171 bash[25040]: cluster 2024-09-14T01:28:09.718808+0000 mgr.a (mgr.14355) 8099 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:28:12.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:12.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:12.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:12.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:12.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:13 smithi007 bash[22722]: cluster 2024-09-14T01:28:11.721014+0000 mgr.a (mgr.14355) 8100 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:28:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:13 smithi007 bash[22722]: audit 2024-09-14T01:28:12.210311+0000 mgr.a (mgr.14355) 8101 : audit [DBG] from='client.181899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:13 smithi131 bash[24745]: cluster 2024-09-14T01:28:11.721014+0000 mgr.a (mgr.14355) 8100 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:28:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:13 smithi131 bash[24745]: audit 2024-09-14T01:28:12.210311+0000 mgr.a (mgr.14355) 8101 : audit [DBG] from='client.181899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:13 smithi171 bash[25040]: cluster 2024-09-14T01:28:11.721014+0000 mgr.a (mgr.14355) 8100 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:28:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:13 smithi171 bash[25040]: audit 2024-09-14T01:28:12.210311+0000 mgr.a (mgr.14355) 8101 : audit [DBG] from='client.181899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:15 smithi007 bash[22722]: cluster 2024-09-14T01:28:13.721990+0000 mgr.a (mgr.14355) 8102 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:15 smithi131 bash[24745]: cluster 2024-09-14T01:28:13.721990+0000 mgr.a (mgr.14355) 8102 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:15 smithi171 bash[25040]: cluster 2024-09-14T01:28:13.721990+0000 mgr.a (mgr.14355) 8102 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:17.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:17.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:17.658 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:17 smithi007 bash[22722]: cluster 2024-09-14T01:28:15.724371+0000 mgr.a (mgr.14355) 8103 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:17 smithi131 bash[24745]: cluster 2024-09-14T01:28:15.724371+0000 mgr.a (mgr.14355) 8103 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:17 smithi171 bash[25040]: cluster 2024-09-14T01:28:15.724371+0000 mgr.a (mgr.14355) 8103 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:18.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:19 smithi007 bash[22722]: cluster 2024-09-14T01:28:17.725163+0000 mgr.a (mgr.14355) 8104 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:19 smithi007 bash[22722]: audit 2024-09-14T01:28:17.991015+0000 mgr.a (mgr.14355) 8105 : audit [DBG] from='client.181977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:19 smithi131 bash[24745]: cluster 2024-09-14T01:28:17.725163+0000 mgr.a (mgr.14355) 8104 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:19 smithi131 bash[24745]: audit 2024-09-14T01:28:17.991015+0000 mgr.a (mgr.14355) 8105 : audit [DBG] from='client.181977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:19 smithi171 bash[25040]: cluster 2024-09-14T01:28:17.725163+0000 mgr.a (mgr.14355) 8104 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:19 smithi171 bash[25040]: audit 2024-09-14T01:28:17.991015+0000 mgr.a (mgr.14355) 8105 : audit [DBG] from='client.181977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:21 smithi007 bash[22722]: cluster 2024-09-14T01:28:19.726122+0000 mgr.a (mgr.14355) 8106 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:21 smithi131 bash[24745]: cluster 2024-09-14T01:28:19.726122+0000 mgr.a (mgr.14355) 8106 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:21 smithi171 bash[25040]: cluster 2024-09-14T01:28:19.726122+0000 mgr.a (mgr.14355) 8106 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:23.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:23 smithi007 bash[22722]: cluster 2024-09-14T01:28:21.728394+0000 mgr.a (mgr.14355) 8107 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:23 smithi131 bash[24745]: cluster 2024-09-14T01:28:21.728394+0000 mgr.a (mgr.14355) 8107 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:23 smithi171 bash[25040]: cluster 2024-09-14T01:28:21.728394+0000 mgr.a (mgr.14355) 8107 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:24.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:25 smithi007 bash[22722]: cluster 2024-09-14T01:28:23.729119+0000 mgr.a (mgr.14355) 8108 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:25 smithi007 bash[22722]: audit 2024-09-14T01:28:23.748475+0000 mgr.a (mgr.14355) 8109 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:25 smithi131 bash[24745]: cluster 2024-09-14T01:28:23.729119+0000 mgr.a (mgr.14355) 8108 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:25 smithi131 bash[24745]: audit 2024-09-14T01:28:23.748475+0000 mgr.a (mgr.14355) 8109 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:25 smithi171 bash[25040]: cluster 2024-09-14T01:28:23.729119+0000 mgr.a (mgr.14355) 8108 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:25 smithi171 bash[25040]: audit 2024-09-14T01:28:23.748475+0000 mgr.a (mgr.14355) 8109 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:27 smithi007 bash[22722]: cluster 2024-09-14T01:28:25.731510+0000 mgr.a (mgr.14355) 8110 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:27 smithi131 bash[24745]: cluster 2024-09-14T01:28:25.731510+0000 mgr.a (mgr.14355) 8110 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:27 smithi171 bash[25040]: cluster 2024-09-14T01:28:25.731510+0000 mgr.a (mgr.14355) 8110 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:29.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:29.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:29.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:29.949 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:29.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:29.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:29 smithi007 bash[22722]: cluster 2024-09-14T01:28:27.732300+0000 mgr.a (mgr.14355) 8111 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:29 smithi131 bash[24745]: cluster 2024-09-14T01:28:27.732300+0000 mgr.a (mgr.14355) 8111 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:29 smithi171 bash[25040]: cluster 2024-09-14T01:28:27.732300+0000 mgr.a (mgr.14355) 8111 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:30 smithi007 bash[22722]: audit 2024-09-14T01:28:29.525831+0000 mgr.a (mgr.14355) 8112 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:30 smithi131 bash[24745]: audit 2024-09-14T01:28:29.525831+0000 mgr.a (mgr.14355) 8112 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:30 smithi171 bash[25040]: audit 2024-09-14T01:28:29.525831+0000 mgr.a (mgr.14355) 8112 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:31 smithi007 bash[22722]: cluster 2024-09-14T01:28:29.732764+0000 mgr.a (mgr.14355) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:31 smithi131 bash[24745]: cluster 2024-09-14T01:28:29.732764+0000 mgr.a (mgr.14355) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:31 smithi171 bash[25040]: cluster 2024-09-14T01:28:29.732764+0000 mgr.a (mgr.14355) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:33 smithi007 bash[22722]: cluster 2024-09-14T01:28:31.735057+0000 mgr.a (mgr.14355) 8114 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:33 smithi131 bash[24745]: cluster 2024-09-14T01:28:31.735057+0000 mgr.a (mgr.14355) 8114 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:33 smithi171 bash[25040]: cluster 2024-09-14T01:28:31.735057+0000 mgr.a (mgr.14355) 8114 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:28:34.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:34.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:34.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:35.738 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:35.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:35 smithi007 bash[22722]: cluster 2024-09-14T01:28:33.735824+0000 mgr.a (mgr.14355) 8115 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:35 smithi131 bash[24745]: cluster 2024-09-14T01:28:33.735824+0000 mgr.a (mgr.14355) 8115 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:35 smithi171 bash[25040]: cluster 2024-09-14T01:28:33.735824+0000 mgr.a (mgr.14355) 8115 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:36 smithi007 bash[22722]: audit 2024-09-14T01:28:35.291367+0000 mgr.a (mgr.14355) 8116 : audit [DBG] from='client.182211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:36 smithi131 bash[24745]: audit 2024-09-14T01:28:35.291367+0000 mgr.a (mgr.14355) 8116 : audit [DBG] from='client.182211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:36 smithi171 bash[25040]: audit 2024-09-14T01:28:35.291367+0000 mgr.a (mgr.14355) 8116 : audit [DBG] from='client.182211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:37 smithi007 bash[22722]: cluster 2024-09-14T01:28:35.737077+0000 mgr.a (mgr.14355) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:37 smithi131 bash[24745]: cluster 2024-09-14T01:28:35.737077+0000 mgr.a (mgr.14355) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:37 smithi171 bash[25040]: cluster 2024-09-14T01:28:35.737077+0000 mgr.a (mgr.14355) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:39 smithi007 bash[22722]: cluster 2024-09-14T01:28:37.737813+0000 mgr.a (mgr.14355) 8118 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:39 smithi131 bash[24745]: cluster 2024-09-14T01:28:37.737813+0000 mgr.a (mgr.14355) 8118 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:39 smithi171 bash[25040]: cluster 2024-09-14T01:28:37.737813+0000 mgr.a (mgr.14355) 8118 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:40.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:40.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:41.513 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:41 smithi007 bash[22722]: cluster 2024-09-14T01:28:39.738596+0000 mgr.a (mgr.14355) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:41 smithi007 bash[22722]: audit 2024-09-14T01:28:41.568597+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:28:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:41 smithi131 bash[24745]: cluster 2024-09-14T01:28:39.738596+0000 mgr.a (mgr.14355) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:41 smithi131 bash[24745]: audit 2024-09-14T01:28:41.568597+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:28:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:41 smithi171 bash[25040]: cluster 2024-09-14T01:28:39.738596+0000 mgr.a (mgr.14355) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:28:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:41 smithi171 bash[25040]: audit 2024-09-14T01:28:41.568597+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:28:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:42 smithi007 bash[22722]: audit 2024-09-14T01:28:41.076867+0000 mgr.a (mgr.14355) 8120 : audit [DBG] from='client.182289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:42 smithi007 bash[22722]: audit 2024-09-14T01:28:42.398276+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:28:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:42 smithi007 bash[22722]: audit 2024-09-14T01:28:42.399943+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:28:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:42 smithi007 bash[22722]: audit 2024-09-14T01:28:42.410700+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:28:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:42 smithi007 bash[22722]: audit 2024-09-14T01:28:42.415397+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:42 smithi131 bash[24745]: audit 2024-09-14T01:28:41.076867+0000 mgr.a (mgr.14355) 8120 : audit [DBG] from='client.182289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:42 smithi131 bash[24745]: audit 2024-09-14T01:28:42.398276+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:28:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:42 smithi131 bash[24745]: audit 2024-09-14T01:28:42.399943+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:28:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:42 smithi131 bash[24745]: audit 2024-09-14T01:28:42.410700+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:28:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:42 smithi131 bash[24745]: audit 2024-09-14T01:28:42.415397+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:42 smithi171 bash[25040]: audit 2024-09-14T01:28:41.076867+0000 mgr.a (mgr.14355) 8120 : audit [DBG] from='client.182289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:42 smithi171 bash[25040]: audit 2024-09-14T01:28:42.398276+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:28:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:42 smithi171 bash[25040]: audit 2024-09-14T01:28:42.399943+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:28:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:42 smithi171 bash[25040]: audit 2024-09-14T01:28:42.410700+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:28:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:42 smithi171 bash[25040]: audit 2024-09-14T01:28:42.415397+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:43.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:28:43 smithi007 bash[22972]: debug 2024-09-14T01:28:43.171+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:28:43.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:28:43 smithi007 bash[22972]: debug 2024-09-14T01:28:43.175+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:28:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:43 smithi007 bash[22722]: cluster 2024-09-14T01:28:41.741304+0000 mgr.a (mgr.14355) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:43 smithi007 bash[22722]: audit 2024-09-14T01:28:42.416994+0000 mgr.a (mgr.14355) 8122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:43 smithi131 bash[24745]: cluster 2024-09-14T01:28:41.741304+0000 mgr.a (mgr.14355) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:43 smithi131 bash[24745]: audit 2024-09-14T01:28:42.416994+0000 mgr.a (mgr.14355) 8122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:43 smithi171 bash[25040]: cluster 2024-09-14T01:28:41.741304+0000 mgr.a (mgr.14355) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:43 smithi171 bash[25040]: audit 2024-09-14T01:28:42.416994+0000 mgr.a (mgr.14355) 8122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:28:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:44 smithi007 bash[22722]: audit 2024-09-14T01:28:43.176839+0000 mgr.a (mgr.14355) 8123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:28:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:44 smithi007 bash[22722]: cephadm 2024-09-14T01:28:43.178957+0000 mgr.a (mgr.14355) 8124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:28:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:44 smithi131 bash[24745]: audit 2024-09-14T01:28:43.176839+0000 mgr.a (mgr.14355) 8123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:28:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:44 smithi131 bash[24745]: cephadm 2024-09-14T01:28:43.178957+0000 mgr.a (mgr.14355) 8124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:28:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:44 smithi171 bash[25040]: audit 2024-09-14T01:28:43.176839+0000 mgr.a (mgr.14355) 8123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:28:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:44 smithi171 bash[25040]: cephadm 2024-09-14T01:28:43.178957+0000 mgr.a (mgr.14355) 8124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:28:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:45 smithi007 bash[22722]: cluster 2024-09-14T01:28:43.742453+0000 mgr.a (mgr.14355) 8125 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:45 smithi131 bash[24745]: cluster 2024-09-14T01:28:43.742453+0000 mgr.a (mgr.14355) 8125 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:45 smithi171 bash[25040]: cluster 2024-09-14T01:28:43.742453+0000 mgr.a (mgr.14355) 8125 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:28:46.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:46.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:46.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:46.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:46 smithi007 bash[22722]: cluster 2024-09-14T01:28:45.744818+0000 mgr.a (mgr.14355) 8126 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:46 smithi131 bash[24745]: cluster 2024-09-14T01:28:45.744818+0000 mgr.a (mgr.14355) 8126 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:46 smithi171 bash[25040]: cluster 2024-09-14T01:28:45.744818+0000 mgr.a (mgr.14355) 8126 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:47.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:47.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:47.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:47.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:47.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:47 smithi007 bash[22722]: audit 2024-09-14T01:28:46.857353+0000 mgr.a (mgr.14355) 8127 : audit [DBG] from='client.182475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:47 smithi131 bash[24745]: audit 2024-09-14T01:28:46.857353+0000 mgr.a (mgr.14355) 8127 : audit [DBG] from='client.182475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:47 smithi171 bash[25040]: audit 2024-09-14T01:28:46.857353+0000 mgr.a (mgr.14355) 8127 : audit [DBG] from='client.182475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:48 smithi007 bash[22722]: cluster 2024-09-14T01:28:47.745794+0000 mgr.a (mgr.14355) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:48 smithi131 bash[24745]: cluster 2024-09-14T01:28:47.745794+0000 mgr.a (mgr.14355) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:48 smithi171 bash[25040]: cluster 2024-09-14T01:28:47.745794+0000 mgr.a (mgr.14355) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:50 smithi007 bash[22722]: cluster 2024-09-14T01:28:49.746614+0000 mgr.a (mgr.14355) 8129 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:50 smithi131 bash[24745]: cluster 2024-09-14T01:28:49.746614+0000 mgr.a (mgr.14355) 8129 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:50 smithi171 bash[25040]: cluster 2024-09-14T01:28:49.746614+0000 mgr.a (mgr.14355) 8129 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:52.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:52.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:53.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:53.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:53.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:53.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:53.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:52 smithi007 bash[22722]: cluster 2024-09-14T01:28:51.748784+0000 mgr.a (mgr.14355) 8130 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:52 smithi007 bash[22722]: audit 2024-09-14T01:28:52.630530+0000 mgr.a (mgr.14355) 8131 : audit [DBG] from='client.182550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:52 smithi131 bash[24745]: cluster 2024-09-14T01:28:51.748784+0000 mgr.a (mgr.14355) 8130 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:52 smithi131 bash[24745]: audit 2024-09-14T01:28:52.630530+0000 mgr.a (mgr.14355) 8131 : audit [DBG] from='client.182550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:52 smithi171 bash[25040]: cluster 2024-09-14T01:28:51.748784+0000 mgr.a (mgr.14355) 8130 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:52 smithi171 bash[25040]: audit 2024-09-14T01:28:52.630530+0000 mgr.a (mgr.14355) 8131 : audit [DBG] from='client.182550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:54 smithi007 bash[22722]: cluster 2024-09-14T01:28:53.749886+0000 mgr.a (mgr.14355) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:54 smithi131 bash[24745]: cluster 2024-09-14T01:28:53.749886+0000 mgr.a (mgr.14355) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:54 smithi171 bash[25040]: cluster 2024-09-14T01:28:53.749886+0000 mgr.a (mgr.14355) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:56 smithi007 bash[22722]: cluster 2024-09-14T01:28:55.752020+0000 mgr.a (mgr.14355) 8133 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:56 smithi131 bash[24745]: cluster 2024-09-14T01:28:55.752020+0000 mgr.a (mgr.14355) 8133 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:56 smithi171 bash[25040]: cluster 2024-09-14T01:28:55.752020+0000 mgr.a (mgr.14355) 8133 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:28:58.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:28:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:28:58.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:28:58.795 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:28:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:28:58.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:28:58.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:28:58.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:28:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:58 smithi007 bash[22722]: cluster 2024-09-14T01:28:57.752826+0000 mgr.a (mgr.14355) 8134 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:28:58 smithi007 bash[22722]: audit 2024-09-14T01:28:58.385824+0000 mgr.a (mgr.14355) 8135 : audit [DBG] from='client.182628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:58 smithi131 bash[24745]: cluster 2024-09-14T01:28:57.752826+0000 mgr.a (mgr.14355) 8134 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:28:58 smithi131 bash[24745]: audit 2024-09-14T01:28:58.385824+0000 mgr.a (mgr.14355) 8135 : audit [DBG] from='client.182628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:28:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:58 smithi171 bash[25040]: cluster 2024-09-14T01:28:57.752826+0000 mgr.a (mgr.14355) 8134 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:28:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:28:58 smithi171 bash[25040]: audit 2024-09-14T01:28:58.385824+0000 mgr.a (mgr.14355) 8135 : audit [DBG] from='client.182628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:00 smithi007 bash[22722]: cluster 2024-09-14T01:28:59.753794+0000 mgr.a (mgr.14355) 8136 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:00 smithi131 bash[24745]: cluster 2024-09-14T01:28:59.753794+0000 mgr.a (mgr.14355) 8136 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:00 smithi171 bash[25040]: cluster 2024-09-14T01:28:59.753794+0000 mgr.a (mgr.14355) 8136 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:02 smithi007 bash[22722]: cluster 2024-09-14T01:29:01.756089+0000 mgr.a (mgr.14355) 8137 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:02 smithi131 bash[24745]: cluster 2024-09-14T01:29:01.756089+0000 mgr.a (mgr.14355) 8137 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:02 smithi171 bash[25040]: cluster 2024-09-14T01:29:01.756089+0000 mgr.a (mgr.14355) 8137 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:04.536 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:04.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:04 smithi007 bash[22722]: cluster 2024-09-14T01:29:03.756900+0000 mgr.a (mgr.14355) 8138 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:04 smithi007 bash[22722]: audit 2024-09-14T01:29:04.126881+0000 mgr.a (mgr.14355) 8139 : audit [DBG] from='client.182700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:04 smithi131 bash[24745]: cluster 2024-09-14T01:29:03.756900+0000 mgr.a (mgr.14355) 8138 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:04 smithi131 bash[24745]: audit 2024-09-14T01:29:04.126881+0000 mgr.a (mgr.14355) 8139 : audit [DBG] from='client.182700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:04 smithi171 bash[25040]: cluster 2024-09-14T01:29:03.756900+0000 mgr.a (mgr.14355) 8138 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:04 smithi171 bash[25040]: audit 2024-09-14T01:29:04.126881+0000 mgr.a (mgr.14355) 8139 : audit [DBG] from='client.182700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:06 smithi007 bash[22722]: cluster 2024-09-14T01:29:05.759188+0000 mgr.a (mgr.14355) 8140 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:06 smithi131 bash[24745]: cluster 2024-09-14T01:29:05.759188+0000 mgr.a (mgr.14355) 8140 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:06 smithi171 bash[25040]: cluster 2024-09-14T01:29:05.759188+0000 mgr.a (mgr.14355) 8140 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:08 smithi007 bash[22722]: cluster 2024-09-14T01:29:07.759964+0000 mgr.a (mgr.14355) 8141 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:08 smithi131 bash[24745]: cluster 2024-09-14T01:29:07.759964+0000 mgr.a (mgr.14355) 8141 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:08 smithi171 bash[25040]: cluster 2024-09-14T01:29:07.759964+0000 mgr.a (mgr.14355) 8141 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:09.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:09.538 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:09.538 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:10.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:10.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:10 smithi007 bash[22722]: cluster 2024-09-14T01:29:09.760696+0000 mgr.a (mgr.14355) 8142 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:10 smithi007 bash[22722]: audit 2024-09-14T01:29:09.873404+0000 mgr.a (mgr.14355) 8143 : audit [DBG] from='client.182778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:10 smithi131 bash[24745]: cluster 2024-09-14T01:29:09.760696+0000 mgr.a (mgr.14355) 8142 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:10 smithi131 bash[24745]: audit 2024-09-14T01:29:09.873404+0000 mgr.a (mgr.14355) 8143 : audit [DBG] from='client.182778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:10 smithi171 bash[25040]: cluster 2024-09-14T01:29:09.760696+0000 mgr.a (mgr.14355) 8142 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:10 smithi171 bash[25040]: audit 2024-09-14T01:29:09.873404+0000 mgr.a (mgr.14355) 8143 : audit [DBG] from='client.182778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:12 smithi007 bash[22722]: cluster 2024-09-14T01:29:11.763080+0000 mgr.a (mgr.14355) 8144 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:29:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:12 smithi131 bash[24745]: cluster 2024-09-14T01:29:11.763080+0000 mgr.a (mgr.14355) 8144 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:29:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:12 smithi171 bash[25040]: cluster 2024-09-14T01:29:11.763080+0000 mgr.a (mgr.14355) 8144 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:29:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:14 smithi007 bash[22722]: cluster 2024-09-14T01:29:13.763861+0000 mgr.a (mgr.14355) 8145 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:29:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:14 smithi131 bash[24745]: cluster 2024-09-14T01:29:13.763861+0000 mgr.a (mgr.14355) 8145 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:29:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:14 smithi171 bash[25040]: cluster 2024-09-14T01:29:13.763861+0000 mgr.a (mgr.14355) 8145 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:29:15.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:15.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:15.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:16.056 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:15 smithi007 bash[22722]: audit 2024-09-14T01:29:15.630082+0000 mgr.a (mgr.14355) 8146 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:15 smithi131 bash[24745]: audit 2024-09-14T01:29:15.630082+0000 mgr.a (mgr.14355) 8146 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:15 smithi171 bash[25040]: audit 2024-09-14T01:29:15.630082+0000 mgr.a (mgr.14355) 8146 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:16 smithi007 bash[22722]: cluster 2024-09-14T01:29:15.770840+0000 mgr.a (mgr.14355) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:16 smithi131 bash[24745]: cluster 2024-09-14T01:29:15.770840+0000 mgr.a (mgr.14355) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:16 smithi171 bash[25040]: cluster 2024-09-14T01:29:15.770840+0000 mgr.a (mgr.14355) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:18 smithi007 bash[22722]: cluster 2024-09-14T01:29:17.771728+0000 mgr.a (mgr.14355) 8148 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:18 smithi131 bash[24745]: cluster 2024-09-14T01:29:17.771728+0000 mgr.a (mgr.14355) 8148 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:18 smithi171 bash[25040]: cluster 2024-09-14T01:29:17.771728+0000 mgr.a (mgr.14355) 8148 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:21.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:21.059 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:21.059 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:20 smithi007 bash[22722]: cluster 2024-09-14T01:29:19.772502+0000 mgr.a (mgr.14355) 8149 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:20 smithi131 bash[24745]: cluster 2024-09-14T01:29:19.772502+0000 mgr.a (mgr.14355) 8149 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:20 smithi171 bash[25040]: cluster 2024-09-14T01:29:19.772502+0000 mgr.a (mgr.14355) 8149 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:21.798 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:21.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:21.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:21.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:21.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:21 smithi007 bash[22722]: audit 2024-09-14T01:29:21.391736+0000 mgr.a (mgr.14355) 8150 : audit [DBG] from='client.182925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:21 smithi131 bash[24745]: audit 2024-09-14T01:29:21.391736+0000 mgr.a (mgr.14355) 8150 : audit [DBG] from='client.182925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:21 smithi171 bash[25040]: audit 2024-09-14T01:29:21.391736+0000 mgr.a (mgr.14355) 8150 : audit [DBG] from='client.182925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:22 smithi007 bash[22722]: cluster 2024-09-14T01:29:21.773857+0000 mgr.a (mgr.14355) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:22 smithi131 bash[24745]: cluster 2024-09-14T01:29:21.773857+0000 mgr.a (mgr.14355) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:22 smithi171 bash[25040]: cluster 2024-09-14T01:29:21.773857+0000 mgr.a (mgr.14355) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:24 smithi007 bash[22722]: cluster 2024-09-14T01:29:23.774618+0000 mgr.a (mgr.14355) 8152 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:29:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:24 smithi131 bash[24745]: cluster 2024-09-14T01:29:23.774618+0000 mgr.a (mgr.14355) 8152 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:29:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:24 smithi171 bash[25040]: cluster 2024-09-14T01:29:23.774618+0000 mgr.a (mgr.14355) 8152 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:29:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:26.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:26 smithi007 bash[22722]: cluster 2024-09-14T01:29:25.776557+0000 mgr.a (mgr.14355) 8153 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:29:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:26 smithi131 bash[24745]: cluster 2024-09-14T01:29:25.776557+0000 mgr.a (mgr.14355) 8153 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:29:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:26 smithi171 bash[25040]: cluster 2024-09-14T01:29:25.776557+0000 mgr.a (mgr.14355) 8153 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:29:27.563 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:27 smithi007 bash[22722]: audit 2024-09-14T01:29:27.133894+0000 mgr.a (mgr.14355) 8154 : audit [DBG] from='client.183000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:27 smithi131 bash[24745]: audit 2024-09-14T01:29:27.133894+0000 mgr.a (mgr.14355) 8154 : audit [DBG] from='client.183000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:27 smithi171 bash[25040]: audit 2024-09-14T01:29:27.133894+0000 mgr.a (mgr.14355) 8154 : audit [DBG] from='client.183000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:28 smithi007 bash[22722]: cluster 2024-09-14T01:29:27.777483+0000 mgr.a (mgr.14355) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:28 smithi131 bash[24745]: cluster 2024-09-14T01:29:27.777483+0000 mgr.a (mgr.14355) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:29.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:28 smithi171 bash[25040]: cluster 2024-09-14T01:29:27.777483+0000 mgr.a (mgr.14355) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:30 smithi007 bash[22722]: cluster 2024-09-14T01:29:29.778234+0000 mgr.a (mgr.14355) 8156 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:30 smithi131 bash[24745]: cluster 2024-09-14T01:29:29.778234+0000 mgr.a (mgr.14355) 8156 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:30 smithi171 bash[25040]: cluster 2024-09-14T01:29:29.778234+0000 mgr.a (mgr.14355) 8156 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:32.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:32.566 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:32.566 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:32 smithi007 bash[22722]: cluster 2024-09-14T01:29:31.780447+0000 mgr.a (mgr.14355) 8157 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:32 smithi131 bash[24745]: cluster 2024-09-14T01:29:31.780447+0000 mgr.a (mgr.14355) 8157 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:32 smithi171 bash[25040]: cluster 2024-09-14T01:29:31.780447+0000 mgr.a (mgr.14355) 8157 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:33.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:33.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:33.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:33.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:33.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:33 smithi007 bash[22722]: audit 2024-09-14T01:29:32.893984+0000 mgr.a (mgr.14355) 8158 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:33 smithi131 bash[24745]: audit 2024-09-14T01:29:32.893984+0000 mgr.a (mgr.14355) 8158 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:33 smithi171 bash[25040]: audit 2024-09-14T01:29:32.893984+0000 mgr.a (mgr.14355) 8158 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:34 smithi007 bash[22722]: cluster 2024-09-14T01:29:33.781408+0000 mgr.a (mgr.14355) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:34 smithi131 bash[24745]: cluster 2024-09-14T01:29:33.781408+0000 mgr.a (mgr.14355) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:34 smithi171 bash[25040]: cluster 2024-09-14T01:29:33.781408+0000 mgr.a (mgr.14355) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:36 smithi007 bash[22722]: cluster 2024-09-14T01:29:35.783557+0000 mgr.a (mgr.14355) 8160 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:36 smithi131 bash[24745]: cluster 2024-09-14T01:29:35.783557+0000 mgr.a (mgr.14355) 8160 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:36 smithi171 bash[25040]: cluster 2024-09-14T01:29:35.783557+0000 mgr.a (mgr.14355) 8160 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:38.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:39.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:39.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:39.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:39.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:39.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:38 smithi007 bash[22722]: cluster 2024-09-14T01:29:37.784302+0000 mgr.a (mgr.14355) 8161 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:38 smithi007 bash[22722]: audit 2024-09-14T01:29:38.645490+0000 mgr.a (mgr.14355) 8162 : audit [DBG] from='client.77761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:38 smithi131 bash[24745]: cluster 2024-09-14T01:29:37.784302+0000 mgr.a (mgr.14355) 8161 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:38 smithi131 bash[24745]: audit 2024-09-14T01:29:38.645490+0000 mgr.a (mgr.14355) 8162 : audit [DBG] from='client.77761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:38 smithi171 bash[25040]: cluster 2024-09-14T01:29:37.784302+0000 mgr.a (mgr.14355) 8161 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:38 smithi171 bash[25040]: audit 2024-09-14T01:29:38.645490+0000 mgr.a (mgr.14355) 8162 : audit [DBG] from='client.77761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:40 smithi007 bash[22722]: cluster 2024-09-14T01:29:39.785288+0000 mgr.a (mgr.14355) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:40 smithi131 bash[24745]: cluster 2024-09-14T01:29:39.785288+0000 mgr.a (mgr.14355) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:40 smithi171 bash[25040]: cluster 2024-09-14T01:29:39.785288+0000 mgr.a (mgr.14355) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:42 smithi007 bash[22722]: cluster 2024-09-14T01:29:41.787468+0000 mgr.a (mgr.14355) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:42 smithi131 bash[24745]: cluster 2024-09-14T01:29:41.787468+0000 mgr.a (mgr.14355) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:42 smithi171 bash[25040]: cluster 2024-09-14T01:29:41.787468+0000 mgr.a (mgr.14355) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:29:44.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:44.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:44.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:43 smithi007 bash[22722]: audit 2024-09-14T01:29:43.235504+0000 mon.a (mon.0) 1819 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:29:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:43 smithi131 bash[24745]: audit 2024-09-14T01:29:43.235504+0000 mon.a (mon.0) 1819 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:29:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:43 smithi171 bash[25040]: audit 2024-09-14T01:29:43.235504+0000 mon.a (mon.0) 1819 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22972]: debug 2024-09-14T01:29:44.814+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22972]: debug 2024-09-14T01:29:44.826+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: cluster 2024-09-14T01:29:43.788116+0000 mgr.a (mgr.14355) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.055430+0000 mon.a (mon.0) 1820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.057199+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:29:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.067551+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:29:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.072680+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.073967+0000 mgr.a (mgr.14355) 8166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:44 smithi007 bash[22722]: audit 2024-09-14T01:29:44.465419+0000 mgr.a (mgr.14355) 8167 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:45.221 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:45.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: cluster 2024-09-14T01:29:43.788116+0000 mgr.a (mgr.14355) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.055430+0000 mon.a (mon.0) 1820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.057199+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.067551+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.072680+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.073967+0000 mgr.a (mgr.14355) 8166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:44 smithi131 bash[24745]: audit 2024-09-14T01:29:44.465419+0000 mgr.a (mgr.14355) 8167 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:44 smithi171 bash[25040]: cluster 2024-09-14T01:29:43.788116+0000 mgr.a (mgr.14355) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:29:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:44 smithi171 bash[25040]: audit 2024-09-14T01:29:44.055430+0000 mon.a (mon.0) 1820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:29:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:44 smithi171 bash[25040]: audit 2024-09-14T01:29:44.057199+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:29:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:44 smithi171 bash[25040]: audit 2024-09-14T01:29:44.067551+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:29:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:44 smithi171 bash[25040]: audit 2024-09-14T01:29:44.072680+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:45 smithi171 bash[25040]: audit 2024-09-14T01:29:44.073967+0000 mgr.a (mgr.14355) 8166 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:29:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:45 smithi171 bash[25040]: audit 2024-09-14T01:29:44.465419+0000 mgr.a (mgr.14355) 8167 : audit [DBG] from='client.183246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:45 smithi131 bash[24745]: audit 2024-09-14T01:29:44.815899+0000 mgr.a (mgr.14355) 8168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:29:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:45 smithi131 bash[24745]: cephadm 2024-09-14T01:29:44.829362+0000 mgr.a (mgr.14355) 8169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:29:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:45 smithi171 bash[25040]: audit 2024-09-14T01:29:44.815899+0000 mgr.a (mgr.14355) 8168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:29:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:45 smithi171 bash[25040]: cephadm 2024-09-14T01:29:44.829362+0000 mgr.a (mgr.14355) 8169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:29:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:45 smithi007 bash[22722]: audit 2024-09-14T01:29:44.815899+0000 mgr.a (mgr.14355) 8168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:29:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:45 smithi007 bash[22722]: cephadm 2024-09-14T01:29:44.829362+0000 mgr.a (mgr.14355) 8169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:29:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:46 smithi131 bash[24745]: cluster 2024-09-14T01:29:45.790464+0000 mgr.a (mgr.14355) 8170 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:46 smithi171 bash[25040]: cluster 2024-09-14T01:29:45.790464+0000 mgr.a (mgr.14355) 8170 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:46 smithi007 bash[22722]: cluster 2024-09-14T01:29:45.790464+0000 mgr.a (mgr.14355) 8170 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:48 smithi131 bash[24745]: cluster 2024-09-14T01:29:47.791211+0000 mgr.a (mgr.14355) 8171 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:48 smithi171 bash[25040]: cluster 2024-09-14T01:29:47.791211+0000 mgr.a (mgr.14355) 8171 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:48 smithi007 bash[22722]: cluster 2024-09-14T01:29:47.791211+0000 mgr.a (mgr.14355) 8171 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:50.223 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:50.223 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:51.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:51.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:50 smithi131 bash[24745]: cluster 2024-09-14T01:29:49.791951+0000 mgr.a (mgr.14355) 8172 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:50 smithi131 bash[24745]: audit 2024-09-14T01:29:50.554154+0000 mgr.a (mgr.14355) 8173 : audit [DBG] from='client.183411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:50 smithi171 bash[25040]: cluster 2024-09-14T01:29:49.791951+0000 mgr.a (mgr.14355) 8172 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:50 smithi171 bash[25040]: audit 2024-09-14T01:29:50.554154+0000 mgr.a (mgr.14355) 8173 : audit [DBG] from='client.183411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:50 smithi007 bash[22722]: cluster 2024-09-14T01:29:49.791951+0000 mgr.a (mgr.14355) 8172 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:50 smithi007 bash[22722]: audit 2024-09-14T01:29:50.554154+0000 mgr.a (mgr.14355) 8173 : audit [DBG] from='client.183411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:52 smithi131 bash[24745]: cluster 2024-09-14T01:29:51.794671+0000 mgr.a (mgr.14355) 8174 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:52 smithi171 bash[25040]: cluster 2024-09-14T01:29:51.794671+0000 mgr.a (mgr.14355) 8174 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:52 smithi007 bash[22722]: cluster 2024-09-14T01:29:51.794671+0000 mgr.a (mgr.14355) 8174 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:54 smithi131 bash[24745]: cluster 2024-09-14T01:29:53.795413+0000 mgr.a (mgr.14355) 8175 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:29:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:54 smithi171 bash[25040]: cluster 2024-09-14T01:29:53.795413+0000 mgr.a (mgr.14355) 8175 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:29:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:54 smithi007 bash[22722]: cluster 2024-09-14T01:29:53.795413+0000 mgr.a (mgr.14355) 8175 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:29:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:29:56.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:29:56.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:29:56.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:29:56.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:29:56.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:29:56.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:29:56.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:29:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:56 smithi131 bash[24745]: cluster 2024-09-14T01:29:55.797342+0000 mgr.a (mgr.14355) 8176 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:56 smithi131 bash[24745]: audit 2024-09-14T01:29:56.345132+0000 mgr.a (mgr.14355) 8177 : audit [DBG] from='client.183486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:56 smithi171 bash[25040]: cluster 2024-09-14T01:29:55.797342+0000 mgr.a (mgr.14355) 8176 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:56 smithi171 bash[25040]: audit 2024-09-14T01:29:56.345132+0000 mgr.a (mgr.14355) 8177 : audit [DBG] from='client.183486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:56 smithi007 bash[22722]: cluster 2024-09-14T01:29:55.797342+0000 mgr.a (mgr.14355) 8176 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:29:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:56 smithi007 bash[22722]: audit 2024-09-14T01:29:56.345132+0000 mgr.a (mgr.14355) 8177 : audit [DBG] from='client.183486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:29:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:29:58 smithi131 bash[24745]: cluster 2024-09-14T01:29:57.798358+0000 mgr.a (mgr.14355) 8178 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:29:58 smithi171 bash[25040]: cluster 2024-09-14T01:29:57.798358+0000 mgr.a (mgr.14355) 8178 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:29:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:29:58 smithi007 bash[22722]: cluster 2024-09-14T01:29:57.798358+0000 mgr.a (mgr.14355) 8178 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:00 smithi131 bash[24745]: cluster 2024-09-14T01:29:59.799116+0000 mgr.a (mgr.14355) 8179 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:00 smithi131 bash[24745]: cluster 2024-09-14T01:30:00.000153+0000 mon.a (mon.0) 1824 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:30:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:00 smithi171 bash[25040]: cluster 2024-09-14T01:29:59.799116+0000 mgr.a (mgr.14355) 8179 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:00 smithi171 bash[25040]: cluster 2024-09-14T01:30:00.000153+0000 mon.a (mon.0) 1824 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:30:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:00 smithi007 bash[22722]: cluster 2024-09-14T01:29:59.799116+0000 mgr.a (mgr.14355) 8179 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:00 smithi007 bash[22722]: cluster 2024-09-14T01:30:00.000153+0000 mon.a (mon.0) 1824 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:30:01.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:01.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:01.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:02.536 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:02 smithi131 bash[24745]: cluster 2024-09-14T01:30:01.800796+0000 mgr.a (mgr.14355) 8180 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:02 smithi131 bash[24745]: audit 2024-09-14T01:30:02.115972+0000 mgr.a (mgr.14355) 8181 : audit [DBG] from='client.183564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:02 smithi171 bash[25040]: cluster 2024-09-14T01:30:01.800796+0000 mgr.a (mgr.14355) 8180 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:02 smithi171 bash[25040]: audit 2024-09-14T01:30:02.115972+0000 mgr.a (mgr.14355) 8181 : audit [DBG] from='client.183564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:02 smithi007 bash[22722]: cluster 2024-09-14T01:30:01.800796+0000 mgr.a (mgr.14355) 8180 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:02 smithi007 bash[22722]: audit 2024-09-14T01:30:02.115972+0000 mgr.a (mgr.14355) 8181 : audit [DBG] from='client.183564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:05 smithi131 bash[24745]: cluster 2024-09-14T01:30:03.801715+0000 mgr.a (mgr.14355) 8182 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:05 smithi171 bash[25040]: cluster 2024-09-14T01:30:03.801715+0000 mgr.a (mgr.14355) 8182 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:05 smithi007 bash[22722]: cluster 2024-09-14T01:30:03.801715+0000 mgr.a (mgr.14355) 8182 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:07 smithi131 bash[24745]: cluster 2024-09-14T01:30:05.803879+0000 mgr.a (mgr.14355) 8183 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:07 smithi171 bash[25040]: cluster 2024-09-14T01:30:05.803879+0000 mgr.a (mgr.14355) 8183 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:07 smithi007 bash[22722]: cluster 2024-09-14T01:30:05.803879+0000 mgr.a (mgr.14355) 8183 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:07.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:07.538 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:08.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:08.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:08.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:08.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:08.313 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:09 smithi131 bash[24745]: cluster 2024-09-14T01:30:07.804605+0000 mgr.a (mgr.14355) 8184 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:09 smithi131 bash[24745]: audit 2024-09-14T01:30:07.870170+0000 mgr.a (mgr.14355) 8185 : audit [DBG] from='client.183642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:09 smithi171 bash[25040]: cluster 2024-09-14T01:30:07.804605+0000 mgr.a (mgr.14355) 8184 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:09 smithi171 bash[25040]: audit 2024-09-14T01:30:07.870170+0000 mgr.a (mgr.14355) 8185 : audit [DBG] from='client.183642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:09 smithi007 bash[22722]: cluster 2024-09-14T01:30:07.804605+0000 mgr.a (mgr.14355) 8184 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:09 smithi007 bash[22722]: audit 2024-09-14T01:30:07.870170+0000 mgr.a (mgr.14355) 8185 : audit [DBG] from='client.183642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:11 smithi131 bash[24745]: cluster 2024-09-14T01:30:09.805440+0000 mgr.a (mgr.14355) 8186 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:11 smithi171 bash[25040]: cluster 2024-09-14T01:30:09.805440+0000 mgr.a (mgr.14355) 8186 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:11 smithi007 bash[22722]: cluster 2024-09-14T01:30:09.805440+0000 mgr.a (mgr.14355) 8186 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:13 smithi131 bash[24745]: cluster 2024-09-14T01:30:11.807755+0000 mgr.a (mgr.14355) 8187 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:13 smithi171 bash[25040]: cluster 2024-09-14T01:30:11.807755+0000 mgr.a (mgr.14355) 8187 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:13.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:13.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:13 smithi007 bash[22722]: cluster 2024-09-14T01:30:11.807755+0000 mgr.a (mgr.14355) 8187 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:14.093 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:14 smithi131 bash[24745]: audit 2024-09-14T01:30:13.649833+0000 mgr.a (mgr.14355) 8188 : audit [DBG] from='client.183720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:14 smithi171 bash[25040]: audit 2024-09-14T01:30:13.649833+0000 mgr.a (mgr.14355) 8188 : audit [DBG] from='client.183720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:14 smithi007 bash[22722]: audit 2024-09-14T01:30:13.649833+0000 mgr.a (mgr.14355) 8188 : audit [DBG] from='client.183720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:15 smithi131 bash[24745]: cluster 2024-09-14T01:30:13.808348+0000 mgr.a (mgr.14355) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:15 smithi171 bash[25040]: cluster 2024-09-14T01:30:13.808348+0000 mgr.a (mgr.14355) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:15 smithi007 bash[22722]: cluster 2024-09-14T01:30:13.808348+0000 mgr.a (mgr.14355) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:17 smithi131 bash[24745]: cluster 2024-09-14T01:30:15.810598+0000 mgr.a (mgr.14355) 8190 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:17 smithi171 bash[25040]: cluster 2024-09-14T01:30:15.810598+0000 mgr.a (mgr.14355) 8190 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:17 smithi007 bash[22722]: cluster 2024-09-14T01:30:15.810598+0000 mgr.a (mgr.14355) 8190 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:19.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:19 smithi171 bash[25040]: cluster 2024-09-14T01:30:17.811318+0000 mgr.a (mgr.14355) 8191 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:19 smithi007 bash[22722]: cluster 2024-09-14T01:30:17.811318+0000 mgr.a (mgr.14355) 8191 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:19 smithi131 bash[24745]: cluster 2024-09-14T01:30:17.811318+0000 mgr.a (mgr.14355) 8191 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:19.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:20 smithi007 bash[22722]: audit 2024-09-14T01:30:19.431207+0000 mgr.a (mgr.14355) 8192 : audit [DBG] from='client.183795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:20 smithi131 bash[24745]: audit 2024-09-14T01:30:19.431207+0000 mgr.a (mgr.14355) 8192 : audit [DBG] from='client.183795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:20 smithi171 bash[25040]: audit 2024-09-14T01:30:19.431207+0000 mgr.a (mgr.14355) 8192 : audit [DBG] from='client.183795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:21 smithi007 bash[22722]: cluster 2024-09-14T01:30:19.811852+0000 mgr.a (mgr.14355) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:21 smithi131 bash[24745]: cluster 2024-09-14T01:30:19.811852+0000 mgr.a (mgr.14355) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:21 smithi171 bash[25040]: cluster 2024-09-14T01:30:19.811852+0000 mgr.a (mgr.14355) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:23 smithi007 bash[22722]: cluster 2024-09-14T01:30:21.814021+0000 mgr.a (mgr.14355) 8194 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:23 smithi131 bash[24745]: cluster 2024-09-14T01:30:21.814021+0000 mgr.a (mgr.14355) 8194 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:23 smithi171 bash[25040]: cluster 2024-09-14T01:30:21.814021+0000 mgr.a (mgr.14355) 8194 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:24.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:24.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:24.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:25 smithi007 bash[22722]: cluster 2024-09-14T01:30:23.814847+0000 mgr.a (mgr.14355) 8195 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:25 smithi131 bash[24745]: cluster 2024-09-14T01:30:23.814847+0000 mgr.a (mgr.14355) 8195 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:25 smithi171 bash[25040]: cluster 2024-09-14T01:30:23.814847+0000 mgr.a (mgr.14355) 8195 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:25.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:25.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:25.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:25.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:25.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:26 smithi007 bash[22722]: audit 2024-09-14T01:30:25.193588+0000 mgr.a (mgr.14355) 8196 : audit [DBG] from='client.183870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:26 smithi131 bash[24745]: audit 2024-09-14T01:30:25.193588+0000 mgr.a (mgr.14355) 8196 : audit [DBG] from='client.183870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:26 smithi171 bash[25040]: audit 2024-09-14T01:30:25.193588+0000 mgr.a (mgr.14355) 8196 : audit [DBG] from='client.183870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:27 smithi007 bash[22722]: cluster 2024-09-14T01:30:25.817630+0000 mgr.a (mgr.14355) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:27 smithi131 bash[24745]: cluster 2024-09-14T01:30:25.817630+0000 mgr.a (mgr.14355) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:27 smithi171 bash[25040]: cluster 2024-09-14T01:30:25.817630+0000 mgr.a (mgr.14355) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:29 smithi007 bash[22722]: cluster 2024-09-14T01:30:27.818390+0000 mgr.a (mgr.14355) 8198 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:29 smithi131 bash[24745]: cluster 2024-09-14T01:30:27.818390+0000 mgr.a (mgr.14355) 8198 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:29 smithi171 bash[25040]: cluster 2024-09-14T01:30:27.818390+0000 mgr.a (mgr.14355) 8198 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:30.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:30.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:31.402 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:31 smithi007 bash[22722]: cluster 2024-09-14T01:30:29.819146+0000 mgr.a (mgr.14355) 8199 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:31 smithi131 bash[24745]: cluster 2024-09-14T01:30:29.819146+0000 mgr.a (mgr.14355) 8199 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:31 smithi171 bash[25040]: cluster 2024-09-14T01:30:29.819146+0000 mgr.a (mgr.14355) 8199 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:30:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:32 smithi007 bash[22722]: audit 2024-09-14T01:30:30.959056+0000 mgr.a (mgr.14355) 8200 : audit [DBG] from='client.183945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:32 smithi131 bash[24745]: audit 2024-09-14T01:30:30.959056+0000 mgr.a (mgr.14355) 8200 : audit [DBG] from='client.183945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:32 smithi171 bash[25040]: audit 2024-09-14T01:30:30.959056+0000 mgr.a (mgr.14355) 8200 : audit [DBG] from='client.183945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:33 smithi007 bash[22722]: cluster 2024-09-14T01:30:31.821874+0000 mgr.a (mgr.14355) 8201 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:33 smithi131 bash[24745]: cluster 2024-09-14T01:30:31.821874+0000 mgr.a (mgr.14355) 8201 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:33 smithi171 bash[25040]: cluster 2024-09-14T01:30:31.821874+0000 mgr.a (mgr.14355) 8201 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:35 smithi007 bash[22722]: cluster 2024-09-14T01:30:33.822622+0000 mgr.a (mgr.14355) 8202 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:35 smithi131 bash[24745]: cluster 2024-09-14T01:30:33.822622+0000 mgr.a (mgr.14355) 8202 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:35 smithi171 bash[25040]: cluster 2024-09-14T01:30:33.822622+0000 mgr.a (mgr.14355) 8202 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:30:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:36.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:36.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:37.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:37.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:37 smithi007 bash[22722]: cluster 2024-09-14T01:30:35.824531+0000 mgr.a (mgr.14355) 8203 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:37 smithi131 bash[24745]: cluster 2024-09-14T01:30:35.824531+0000 mgr.a (mgr.14355) 8203 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:37 smithi171 bash[25040]: cluster 2024-09-14T01:30:35.824531+0000 mgr.a (mgr.14355) 8203 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:38 smithi007 bash[22722]: audit 2024-09-14T01:30:36.736827+0000 mgr.a (mgr.14355) 8204 : audit [DBG] from='client.184020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:38 smithi131 bash[24745]: audit 2024-09-14T01:30:36.736827+0000 mgr.a (mgr.14355) 8204 : audit [DBG] from='client.184020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:38 smithi171 bash[25040]: audit 2024-09-14T01:30:36.736827+0000 mgr.a (mgr.14355) 8204 : audit [DBG] from='client.184020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:39 smithi007 bash[22722]: cluster 2024-09-14T01:30:37.825394+0000 mgr.a (mgr.14355) 8205 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:39 smithi131 bash[24745]: cluster 2024-09-14T01:30:37.825394+0000 mgr.a (mgr.14355) 8205 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:39 smithi171 bash[25040]: cluster 2024-09-14T01:30:37.825394+0000 mgr.a (mgr.14355) 8205 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:41 smithi007 bash[22722]: cluster 2024-09-14T01:30:39.826160+0000 mgr.a (mgr.14355) 8206 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:41 smithi131 bash[24745]: cluster 2024-09-14T01:30:39.826160+0000 mgr.a (mgr.14355) 8206 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:41 smithi171 bash[25040]: cluster 2024-09-14T01:30:39.826160+0000 mgr.a (mgr.14355) 8206 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:42.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:42.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:43 smithi007 bash[22722]: cluster 2024-09-14T01:30:41.828364+0000 mgr.a (mgr.14355) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:43 smithi007 bash[22722]: audit 2024-09-14T01:30:42.509159+0000 mgr.a (mgr.14355) 8208 : audit [DBG] from='client.184098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:43 smithi131 bash[24745]: cluster 2024-09-14T01:30:41.828364+0000 mgr.a (mgr.14355) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:43 smithi131 bash[24745]: audit 2024-09-14T01:30:42.509159+0000 mgr.a (mgr.14355) 8208 : audit [DBG] from='client.184098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:43 smithi171 bash[25040]: cluster 2024-09-14T01:30:41.828364+0000 mgr.a (mgr.14355) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:43 smithi171 bash[25040]: audit 2024-09-14T01:30:42.509159+0000 mgr.a (mgr.14355) 8208 : audit [DBG] from='client.184098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:45 smithi007 bash[22722]: cluster 2024-09-14T01:30:43.829245+0000 mgr.a (mgr.14355) 8209 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:45 smithi007 bash[22722]: audit 2024-09-14T01:30:44.886599+0000 mon.a (mon.0) 1825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:30:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:45 smithi131 bash[24745]: cluster 2024-09-14T01:30:43.829245+0000 mgr.a (mgr.14355) 8209 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:45 smithi131 bash[24745]: audit 2024-09-14T01:30:44.886599+0000 mon.a (mon.0) 1825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:30:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:45 smithi171 bash[25040]: cluster 2024-09-14T01:30:43.829245+0000 mgr.a (mgr.14355) 8209 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:45 smithi171 bash[25040]: audit 2024-09-14T01:30:44.886599+0000 mon.a (mon.0) 1825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:30:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:47 smithi007 bash[22722]: cluster 2024-09-14T01:30:45.831497+0000 mgr.a (mgr.14355) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:47 smithi131 bash[24745]: cluster 2024-09-14T01:30:45.831497+0000 mgr.a (mgr.14355) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:47 smithi171 bash[25040]: cluster 2024-09-14T01:30:45.831497+0000 mgr.a (mgr.14355) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:47.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:47.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:48.671 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:48.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:49 smithi007 bash[22722]: cluster 2024-09-14T01:30:47.832255+0000 mgr.a (mgr.14355) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:49 smithi007 bash[22722]: audit 2024-09-14T01:30:48.262689+0000 mgr.a (mgr.14355) 8212 : audit [DBG] from='client.184173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:49 smithi131 bash[24745]: cluster 2024-09-14T01:30:47.832255+0000 mgr.a (mgr.14355) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:49 smithi131 bash[24745]: audit 2024-09-14T01:30:48.262689+0000 mgr.a (mgr.14355) 8212 : audit [DBG] from='client.184173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:49 smithi171 bash[25040]: cluster 2024-09-14T01:30:47.832255+0000 mgr.a (mgr.14355) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:49 smithi171 bash[25040]: audit 2024-09-14T01:30:48.262689+0000 mgr.a (mgr.14355) 8212 : audit [DBG] from='client.184173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: cluster 2024-09-14T01:30:49.833169+0000 mgr.a (mgr.14355) 8213 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.230825+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.234888+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.248923+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.253746+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.258980+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.265380+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.939690+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.941567+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.951456+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:51 smithi131 bash[24745]: audit 2024-09-14T01:30:50.956188+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: cluster 2024-09-14T01:30:49.833169+0000 mgr.a (mgr.14355) 8213 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.230825+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.234888+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.248923+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.253746+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.258980+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.265380+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.939690+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:30:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.941567+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:30:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.951456+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:51 smithi171 bash[25040]: audit 2024-09-14T01:30:50.956188+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: cluster 2024-09-14T01:30:49.833169+0000 mgr.a (mgr.14355) 8213 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.230825+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.234888+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.248923+0000 mon.a (mon.0) 1828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.253746+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.258980+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.265380+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.939690+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.941567+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:30:51.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.951456+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:30:51.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22722]: audit 2024-09-14T01:30:50.956188+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22972]: debug 2024-09-14T01:30:51.693+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:30:51.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:30:51 smithi007 bash[22972]: debug 2024-09-14T01:30:51.693+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:30:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:52 smithi131 bash[24745]: audit 2024-09-14T01:30:50.958532+0000 mgr.a (mgr.14355) 8214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:52 smithi171 bash[25040]: audit 2024-09-14T01:30:50.958532+0000 mgr.a (mgr.14355) 8214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:52 smithi007 bash[22722]: audit 2024-09-14T01:30:50.958532+0000 mgr.a (mgr.14355) 8214 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:30:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:53 smithi131 bash[24745]: audit 2024-09-14T01:30:51.695985+0000 mgr.a (mgr.14355) 8215 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:30:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:53 smithi131 bash[24745]: cephadm 2024-09-14T01:30:51.697182+0000 mgr.a (mgr.14355) 8216 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:30:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:53 smithi131 bash[24745]: cluster 2024-09-14T01:30:51.835943+0000 mgr.a (mgr.14355) 8217 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:53 smithi171 bash[25040]: audit 2024-09-14T01:30:51.695985+0000 mgr.a (mgr.14355) 8215 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:30:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:53 smithi171 bash[25040]: cephadm 2024-09-14T01:30:51.697182+0000 mgr.a (mgr.14355) 8216 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:30:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:53 smithi171 bash[25040]: cluster 2024-09-14T01:30:51.835943+0000 mgr.a (mgr.14355) 8217 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:53.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:53.673 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:53.674 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:53 smithi007 bash[22722]: audit 2024-09-14T01:30:51.695985+0000 mgr.a (mgr.14355) 8215 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:30:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:53 smithi007 bash[22722]: cephadm 2024-09-14T01:30:51.697182+0000 mgr.a (mgr.14355) 8216 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:30:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:53 smithi007 bash[22722]: cluster 2024-09-14T01:30:51.835943+0000 mgr.a (mgr.14355) 8217 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:30:54.447 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:30:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:30:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:30:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:30:54.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:30:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:55 smithi131 bash[24745]: cluster 2024-09-14T01:30:53.836624+0000 mgr.a (mgr.14355) 8218 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:55 smithi131 bash[24745]: audit 2024-09-14T01:30:54.006935+0000 mgr.a (mgr.14355) 8219 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:55 smithi171 bash[25040]: cluster 2024-09-14T01:30:53.836624+0000 mgr.a (mgr.14355) 8218 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:55 smithi171 bash[25040]: audit 2024-09-14T01:30:54.006935+0000 mgr.a (mgr.14355) 8219 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:55 smithi007 bash[22722]: cluster 2024-09-14T01:30:53.836624+0000 mgr.a (mgr.14355) 8218 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:30:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:55 smithi007 bash[22722]: audit 2024-09-14T01:30:54.006935+0000 mgr.a (mgr.14355) 8219 : audit [DBG] from='client.184350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:30:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:57 smithi131 bash[24745]: cluster 2024-09-14T01:30:55.838924+0000 mgr.a (mgr.14355) 8220 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:30:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:57 smithi171 bash[25040]: cluster 2024-09-14T01:30:55.838924+0000 mgr.a (mgr.14355) 8220 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:30:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:57 smithi007 bash[22722]: cluster 2024-09-14T01:30:55.838924+0000 mgr.a (mgr.14355) 8220 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:30:59.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:30:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:30:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:30:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:30:59 smithi131 bash[24745]: cluster 2024-09-14T01:30:57.839683+0000 mgr.a (mgr.14355) 8221 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:30:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:30:59 smithi171 bash[25040]: cluster 2024-09-14T01:30:57.839683+0000 mgr.a (mgr.14355) 8221 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:30:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:30:59 smithi007 bash[22722]: cluster 2024-09-14T01:30:57.839683+0000 mgr.a (mgr.14355) 8221 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:00.202 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:00.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:00.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:00.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:00.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:01 smithi131 bash[24745]: audit 2024-09-14T01:30:59.778900+0000 mgr.a (mgr.14355) 8222 : audit [DBG] from='client.184425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:01 smithi131 bash[24745]: cluster 2024-09-14T01:30:59.840359+0000 mgr.a (mgr.14355) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:01 smithi171 bash[25040]: audit 2024-09-14T01:30:59.778900+0000 mgr.a (mgr.14355) 8222 : audit [DBG] from='client.184425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:01 smithi171 bash[25040]: cluster 2024-09-14T01:30:59.840359+0000 mgr.a (mgr.14355) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:01 smithi007 bash[22722]: audit 2024-09-14T01:30:59.778900+0000 mgr.a (mgr.14355) 8222 : audit [DBG] from='client.184425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:01 smithi007 bash[22722]: cluster 2024-09-14T01:30:59.840359+0000 mgr.a (mgr.14355) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:03 smithi131 bash[24745]: cluster 2024-09-14T01:31:01.842736+0000 mgr.a (mgr.14355) 8224 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:03 smithi171 bash[25040]: cluster 2024-09-14T01:31:01.842736+0000 mgr.a (mgr.14355) 8224 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:03 smithi007 bash[22722]: cluster 2024-09-14T01:31:01.842736+0000 mgr.a (mgr.14355) 8224 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:05.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:05.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:05 smithi131 bash[24745]: cluster 2024-09-14T01:31:03.843507+0000 mgr.a (mgr.14355) 8225 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:05 smithi171 bash[25040]: cluster 2024-09-14T01:31:03.843507+0000 mgr.a (mgr.14355) 8225 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:05 smithi007 bash[22722]: cluster 2024-09-14T01:31:03.843507+0000 mgr.a (mgr.14355) 8225 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:05.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:05.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:06 smithi131 bash[24745]: audit 2024-09-14T01:31:05.542233+0000 mgr.a (mgr.14355) 8226 : audit [DBG] from='client.184503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:06 smithi171 bash[25040]: audit 2024-09-14T01:31:05.542233+0000 mgr.a (mgr.14355) 8226 : audit [DBG] from='client.184503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:06 smithi007 bash[22722]: audit 2024-09-14T01:31:05.542233+0000 mgr.a (mgr.14355) 8226 : audit [DBG] from='client.184503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:07 smithi131 bash[24745]: cluster 2024-09-14T01:31:05.844947+0000 mgr.a (mgr.14355) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:07 smithi171 bash[25040]: cluster 2024-09-14T01:31:05.844947+0000 mgr.a (mgr.14355) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:07 smithi007 bash[22722]: cluster 2024-09-14T01:31:05.844947+0000 mgr.a (mgr.14355) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:09 smithi171 bash[25040]: cluster 2024-09-14T01:31:07.845773+0000 mgr.a (mgr.14355) 8228 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:09 smithi007 bash[22722]: cluster 2024-09-14T01:31:07.845773+0000 mgr.a (mgr.14355) 8228 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:09 smithi131 bash[24745]: cluster 2024-09-14T01:31:07.845773+0000 mgr.a (mgr.14355) 8228 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:10.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:10.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:10.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:11 smithi171 bash[25040]: cluster 2024-09-14T01:31:09.846571+0000 mgr.a (mgr.14355) 8229 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:11 smithi007 bash[22722]: cluster 2024-09-14T01:31:09.846571+0000 mgr.a (mgr.14355) 8229 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:11.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:11.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:11 smithi131 bash[24745]: cluster 2024-09-14T01:31:09.846571+0000 mgr.a (mgr.14355) 8229 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:12 smithi007 bash[22722]: audit 2024-09-14T01:31:11.317270+0000 mgr.a (mgr.14355) 8230 : audit [DBG] from='client.184581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:12 smithi131 bash[24745]: audit 2024-09-14T01:31:11.317270+0000 mgr.a (mgr.14355) 8230 : audit [DBG] from='client.184581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:12 smithi171 bash[25040]: audit 2024-09-14T01:31:11.317270+0000 mgr.a (mgr.14355) 8230 : audit [DBG] from='client.184581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:13 smithi007 bash[22722]: cluster 2024-09-14T01:31:11.849303+0000 mgr.a (mgr.14355) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:13 smithi131 bash[24745]: cluster 2024-09-14T01:31:11.849303+0000 mgr.a (mgr.14355) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:13 smithi171 bash[25040]: cluster 2024-09-14T01:31:11.849303+0000 mgr.a (mgr.14355) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:15 smithi007 bash[22722]: cluster 2024-09-14T01:31:13.850078+0000 mgr.a (mgr.14355) 8232 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:15 smithi131 bash[24745]: cluster 2024-09-14T01:31:13.850078+0000 mgr.a (mgr.14355) 8232 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:15 smithi171 bash[25040]: cluster 2024-09-14T01:31:13.850078+0000 mgr.a (mgr.14355) 8232 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:16.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:16.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:16.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:17.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:17.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:17 smithi007 bash[22722]: cluster 2024-09-14T01:31:15.852037+0000 mgr.a (mgr.14355) 8233 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:17 smithi131 bash[24745]: cluster 2024-09-14T01:31:15.852037+0000 mgr.a (mgr.14355) 8233 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:17 smithi171 bash[25040]: cluster 2024-09-14T01:31:15.852037+0000 mgr.a (mgr.14355) 8233 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:18 smithi007 bash[22722]: audit 2024-09-14T01:31:17.103443+0000 mgr.a (mgr.14355) 8234 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:18 smithi131 bash[24745]: audit 2024-09-14T01:31:17.103443+0000 mgr.a (mgr.14355) 8234 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:18 smithi171 bash[25040]: audit 2024-09-14T01:31:17.103443+0000 mgr.a (mgr.14355) 8234 : audit [DBG] from='client.184659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:19 smithi007 bash[22722]: cluster 2024-09-14T01:31:17.852843+0000 mgr.a (mgr.14355) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:19 smithi131 bash[24745]: cluster 2024-09-14T01:31:17.852843+0000 mgr.a (mgr.14355) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:19 smithi171 bash[25040]: cluster 2024-09-14T01:31:17.852843+0000 mgr.a (mgr.14355) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:21 smithi007 bash[22722]: cluster 2024-09-14T01:31:19.853633+0000 mgr.a (mgr.14355) 8236 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:21 smithi131 bash[24745]: cluster 2024-09-14T01:31:19.853633+0000 mgr.a (mgr.14355) 8236 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:21 smithi171 bash[25040]: cluster 2024-09-14T01:31:19.853633+0000 mgr.a (mgr.14355) 8236 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:22.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:22.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:22.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:23.328 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:23 smithi007 bash[22722]: cluster 2024-09-14T01:31:21.856045+0000 mgr.a (mgr.14355) 8237 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:23 smithi131 bash[24745]: cluster 2024-09-14T01:31:21.856045+0000 mgr.a (mgr.14355) 8237 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:23 smithi171 bash[25040]: cluster 2024-09-14T01:31:21.856045+0000 mgr.a (mgr.14355) 8237 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:24 smithi007 bash[22722]: audit 2024-09-14T01:31:22.873624+0000 mgr.a (mgr.14355) 8238 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:24 smithi131 bash[24745]: audit 2024-09-14T01:31:22.873624+0000 mgr.a (mgr.14355) 8238 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:24 smithi171 bash[25040]: audit 2024-09-14T01:31:22.873624+0000 mgr.a (mgr.14355) 8238 : audit [DBG] from='client.184737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:25 smithi007 bash[22722]: cluster 2024-09-14T01:31:23.856952+0000 mgr.a (mgr.14355) 8239 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:25 smithi131 bash[24745]: cluster 2024-09-14T01:31:23.856952+0000 mgr.a (mgr.14355) 8239 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:25 smithi171 bash[25040]: cluster 2024-09-14T01:31:23.856952+0000 mgr.a (mgr.14355) 8239 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:27 smithi007 bash[22722]: cluster 2024-09-14T01:31:25.859215+0000 mgr.a (mgr.14355) 8240 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:27 smithi131 bash[24745]: cluster 2024-09-14T01:31:25.859215+0000 mgr.a (mgr.14355) 8240 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:27 smithi171 bash[25040]: cluster 2024-09-14T01:31:25.859215+0000 mgr.a (mgr.14355) 8240 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:28.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:29.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:29 smithi007 bash[22722]: cluster 2024-09-14T01:31:27.860004+0000 mgr.a (mgr.14355) 8241 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:29 smithi007 bash[22722]: audit 2024-09-14T01:31:28.659952+0000 mgr.a (mgr.14355) 8242 : audit [DBG] from='client.184815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:29 smithi131 bash[24745]: cluster 2024-09-14T01:31:27.860004+0000 mgr.a (mgr.14355) 8241 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:29 smithi131 bash[24745]: audit 2024-09-14T01:31:28.659952+0000 mgr.a (mgr.14355) 8242 : audit [DBG] from='client.184815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:29 smithi171 bash[25040]: cluster 2024-09-14T01:31:27.860004+0000 mgr.a (mgr.14355) 8241 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:29 smithi171 bash[25040]: audit 2024-09-14T01:31:28.659952+0000 mgr.a (mgr.14355) 8242 : audit [DBG] from='client.184815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:31 smithi007 bash[22722]: cluster 2024-09-14T01:31:29.860941+0000 mgr.a (mgr.14355) 8243 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:31 smithi131 bash[24745]: cluster 2024-09-14T01:31:29.860941+0000 mgr.a (mgr.14355) 8243 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:31 smithi171 bash[25040]: cluster 2024-09-14T01:31:29.860941+0000 mgr.a (mgr.14355) 8243 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:33 smithi007 bash[22722]: cluster 2024-09-14T01:31:31.863239+0000 mgr.a (mgr.14355) 8244 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:33 smithi131 bash[24745]: cluster 2024-09-14T01:31:31.863239+0000 mgr.a (mgr.14355) 8244 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:33 smithi171 bash[25040]: cluster 2024-09-14T01:31:31.863239+0000 mgr.a (mgr.14355) 8244 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:34.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:34.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:34.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:34.823 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:35 smithi007 bash[22722]: cluster 2024-09-14T01:31:33.864025+0000 mgr.a (mgr.14355) 8245 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:35 smithi007 bash[22722]: audit 2024-09-14T01:31:34.412847+0000 mgr.a (mgr.14355) 8246 : audit [DBG] from='client.184893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:35 smithi131 bash[24745]: cluster 2024-09-14T01:31:33.864025+0000 mgr.a (mgr.14355) 8245 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:35 smithi131 bash[24745]: audit 2024-09-14T01:31:34.412847+0000 mgr.a (mgr.14355) 8246 : audit [DBG] from='client.184893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:35 smithi171 bash[25040]: cluster 2024-09-14T01:31:33.864025+0000 mgr.a (mgr.14355) 8245 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:35 smithi171 bash[25040]: audit 2024-09-14T01:31:34.412847+0000 mgr.a (mgr.14355) 8246 : audit [DBG] from='client.184893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:37 smithi007 bash[22722]: cluster 2024-09-14T01:31:35.866457+0000 mgr.a (mgr.14355) 8247 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:37 smithi131 bash[24745]: cluster 2024-09-14T01:31:35.866457+0000 mgr.a (mgr.14355) 8247 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:37 smithi171 bash[25040]: cluster 2024-09-14T01:31:35.866457+0000 mgr.a (mgr.14355) 8247 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:31:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:39 smithi007 bash[22722]: cluster 2024-09-14T01:31:37.867233+0000 mgr.a (mgr.14355) 8248 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:39 smithi131 bash[24745]: cluster 2024-09-14T01:31:37.867233+0000 mgr.a (mgr.14355) 8248 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:39 smithi171 bash[25040]: cluster 2024-09-14T01:31:37.867233+0000 mgr.a (mgr.14355) 8248 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:39.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:39.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:40.598 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:41 smithi007 bash[22722]: cluster 2024-09-14T01:31:39.867779+0000 mgr.a (mgr.14355) 8249 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:41 smithi007 bash[22722]: audit 2024-09-14T01:31:40.157767+0000 mgr.a (mgr.14355) 8250 : audit [DBG] from='client.184971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:41 smithi131 bash[24745]: cluster 2024-09-14T01:31:39.867779+0000 mgr.a (mgr.14355) 8249 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:41 smithi131 bash[24745]: audit 2024-09-14T01:31:40.157767+0000 mgr.a (mgr.14355) 8250 : audit [DBG] from='client.184971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:41 smithi171 bash[25040]: cluster 2024-09-14T01:31:39.867779+0000 mgr.a (mgr.14355) 8249 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:41 smithi171 bash[25040]: audit 2024-09-14T01:31:40.157767+0000 mgr.a (mgr.14355) 8250 : audit [DBG] from='client.184971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:43 smithi007 bash[22722]: cluster 2024-09-14T01:31:41.870548+0000 mgr.a (mgr.14355) 8251 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:43 smithi131 bash[24745]: cluster 2024-09-14T01:31:41.870548+0000 mgr.a (mgr.14355) 8251 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:43 smithi171 bash[25040]: cluster 2024-09-14T01:31:41.870548+0000 mgr.a (mgr.14355) 8251 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:45 smithi007 bash[22722]: cluster 2024-09-14T01:31:43.871382+0000 mgr.a (mgr.14355) 8252 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:45 smithi131 bash[24745]: cluster 2024-09-14T01:31:43.871382+0000 mgr.a (mgr.14355) 8252 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:45 smithi171 bash[25040]: cluster 2024-09-14T01:31:43.871382+0000 mgr.a (mgr.14355) 8252 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:46.383 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:46.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:46.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:46.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:46.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:47 smithi007 bash[22722]: cluster 2024-09-14T01:31:45.873314+0000 mgr.a (mgr.14355) 8253 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:47 smithi007 bash[22722]: audit 2024-09-14T01:31:45.940634+0000 mgr.a (mgr.14355) 8254 : audit [DBG] from='client.185049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:47 smithi131 bash[24745]: cluster 2024-09-14T01:31:45.873314+0000 mgr.a (mgr.14355) 8253 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:47 smithi131 bash[24745]: audit 2024-09-14T01:31:45.940634+0000 mgr.a (mgr.14355) 8254 : audit [DBG] from='client.185049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:47 smithi171 bash[25040]: cluster 2024-09-14T01:31:45.873314+0000 mgr.a (mgr.14355) 8253 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:47 smithi171 bash[25040]: audit 2024-09-14T01:31:45.940634+0000 mgr.a (mgr.14355) 8254 : audit [DBG] from='client.185049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:49 smithi007 bash[22722]: cluster 2024-09-14T01:31:47.874229+0000 mgr.a (mgr.14355) 8255 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:49 smithi131 bash[24745]: cluster 2024-09-14T01:31:47.874229+0000 mgr.a (mgr.14355) 8255 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:49 smithi171 bash[25040]: cluster 2024-09-14T01:31:47.874229+0000 mgr.a (mgr.14355) 8255 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:31:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:51 smithi007 bash[22722]: cluster 2024-09-14T01:31:49.875077+0000 mgr.a (mgr.14355) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:51 smithi131 bash[24745]: cluster 2024-09-14T01:31:49.875077+0000 mgr.a (mgr.14355) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:51 smithi171 bash[25040]: cluster 2024-09-14T01:31:49.875077+0000 mgr.a (mgr.14355) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:31:52.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:52 smithi007 bash[22722]: audit 2024-09-14T01:31:51.749096+0000 mon.a (mon.0) 1836 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:31:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:52 smithi131 bash[24745]: audit 2024-09-14T01:31:51.749096+0000 mon.a (mon.0) 1836 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:31:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:52 smithi171 bash[25040]: audit 2024-09-14T01:31:51.749096+0000 mon.a (mon.0) 1836 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:31:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22972]: debug 2024-09-14T01:31:53.280+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:31:53.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22972]: debug 2024-09-14T01:31:53.280+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:31:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:51.716067+0000 mgr.a (mgr.14355) 8257 : audit [DBG] from='client.185124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: cluster 2024-09-14T01:31:51.876436+0000 mgr.a (mgr.14355) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:52.544354+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:52.546013+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:52.556241+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:52.561167+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:53 smithi007 bash[22722]: audit 2024-09-14T01:31:52.563747+0000 mgr.a (mgr.14355) 8259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:51.716067+0000 mgr.a (mgr.14355) 8257 : audit [DBG] from='client.185124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: cluster 2024-09-14T01:31:51.876436+0000 mgr.a (mgr.14355) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:52.544354+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:52.546013+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:52.556241+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:52.561167+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:53 smithi131 bash[24745]: audit 2024-09-14T01:31:52.563747+0000 mgr.a (mgr.14355) 8259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:51.716067+0000 mgr.a (mgr.14355) 8257 : audit [DBG] from='client.185124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: cluster 2024-09-14T01:31:51.876436+0000 mgr.a (mgr.14355) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:52.544354+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:52.546013+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:52.556241+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:52.561167+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:53 smithi171 bash[25040]: audit 2024-09-14T01:31:52.563747+0000 mgr.a (mgr.14355) 8259 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:31:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:54 smithi007 bash[22722]: audit 2024-09-14T01:31:53.282983+0000 mgr.a (mgr.14355) 8260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:31:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:54 smithi007 bash[22722]: cephadm 2024-09-14T01:31:53.284190+0000 mgr.a (mgr.14355) 8261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:31:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:54 smithi131 bash[24745]: audit 2024-09-14T01:31:53.282983+0000 mgr.a (mgr.14355) 8260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:31:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:54 smithi131 bash[24745]: cephadm 2024-09-14T01:31:53.284190+0000 mgr.a (mgr.14355) 8261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:31:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:54 smithi171 bash[25040]: audit 2024-09-14T01:31:53.282983+0000 mgr.a (mgr.14355) 8260 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:31:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:54 smithi171 bash[25040]: cephadm 2024-09-14T01:31:53.284190+0000 mgr.a (mgr.14355) 8261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:31:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:55 smithi007 bash[22722]: cluster 2024-09-14T01:31:53.877353+0000 mgr.a (mgr.14355) 8262 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:55 smithi131 bash[24745]: cluster 2024-09-14T01:31:53.877353+0000 mgr.a (mgr.14355) 8262 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:55 smithi171 bash[25040]: cluster 2024-09-14T01:31:53.877353+0000 mgr.a (mgr.14355) 8262 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:31:57.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:31:57.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:31:57.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:31:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:57 smithi007 bash[22722]: cluster 2024-09-14T01:31:55.879719+0000 mgr.a (mgr.14355) 8263 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:57 smithi131 bash[24745]: cluster 2024-09-14T01:31:55.879719+0000 mgr.a (mgr.14355) 8263 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:57 smithi171 bash[25040]: cluster 2024-09-14T01:31:55.879719+0000 mgr.a (mgr.14355) 8263 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:57.906 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:31:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:31:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:31:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:31:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:31:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:58 smithi007 bash[22722]: audit 2024-09-14T01:31:57.488032+0000 mgr.a (mgr.14355) 8264 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:58 smithi131 bash[24745]: audit 2024-09-14T01:31:57.488032+0000 mgr.a (mgr.14355) 8264 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:58 smithi171 bash[25040]: audit 2024-09-14T01:31:57.488032+0000 mgr.a (mgr.14355) 8264 : audit [DBG] from='client.185307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:31:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:31:59 smithi007 bash[22722]: cluster 2024-09-14T01:31:57.880212+0000 mgr.a (mgr.14355) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:31:59 smithi131 bash[24745]: cluster 2024-09-14T01:31:57.880212+0000 mgr.a (mgr.14355) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:31:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:31:59 smithi171 bash[25040]: cluster 2024-09-14T01:31:57.880212+0000 mgr.a (mgr.14355) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:01 smithi007 bash[22722]: cluster 2024-09-14T01:31:59.880967+0000 mgr.a (mgr.14355) 8266 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:01 smithi131 bash[24745]: cluster 2024-09-14T01:31:59.880967+0000 mgr.a (mgr.14355) 8266 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:01 smithi171 bash[25040]: cluster 2024-09-14T01:31:59.880967+0000 mgr.a (mgr.14355) 8266 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:02.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:02.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:02.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:03.663 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:03.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:03.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:03.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:03.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:03 smithi007 bash[22722]: cluster 2024-09-14T01:32:01.883281+0000 mgr.a (mgr.14355) 8267 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:03 smithi131 bash[24745]: cluster 2024-09-14T01:32:01.883281+0000 mgr.a (mgr.14355) 8267 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:03 smithi171 bash[25040]: cluster 2024-09-14T01:32:01.883281+0000 mgr.a (mgr.14355) 8267 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:04 smithi007 bash[22722]: audit 2024-09-14T01:32:03.241457+0000 mgr.a (mgr.14355) 8268 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:04 smithi131 bash[24745]: audit 2024-09-14T01:32:03.241457+0000 mgr.a (mgr.14355) 8268 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:04 smithi171 bash[25040]: audit 2024-09-14T01:32:03.241457+0000 mgr.a (mgr.14355) 8268 : audit [DBG] from='client.185382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:05 smithi007 bash[22722]: cluster 2024-09-14T01:32:03.884240+0000 mgr.a (mgr.14355) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T01:32:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:05 smithi131 bash[24745]: cluster 2024-09-14T01:32:03.884240+0000 mgr.a (mgr.14355) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T01:32:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:05 smithi171 bash[25040]: cluster 2024-09-14T01:32:03.884240+0000 mgr.a (mgr.14355) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T01:32:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:07 smithi007 bash[22722]: cluster 2024-09-14T01:32:05.886518+0000 mgr.a (mgr.14355) 8270 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:07 smithi131 bash[24745]: cluster 2024-09-14T01:32:05.886518+0000 mgr.a (mgr.14355) 8270 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:07 smithi171 bash[25040]: cluster 2024-09-14T01:32:05.886518+0000 mgr.a (mgr.14355) 8270 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:32:08.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:08.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:08.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:09.487 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:09 smithi131 bash[24745]: cluster 2024-09-14T01:32:07.887331+0000 mgr.a (mgr.14355) 8271 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:09 smithi171 bash[25040]: cluster 2024-09-14T01:32:07.887331+0000 mgr.a (mgr.14355) 8271 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:09 smithi007 bash[22722]: cluster 2024-09-14T01:32:07.887331+0000 mgr.a (mgr.14355) 8271 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:10 smithi131 bash[24745]: audit 2024-09-14T01:32:09.032404+0000 mgr.a (mgr.14355) 8272 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:10 smithi171 bash[25040]: audit 2024-09-14T01:32:09.032404+0000 mgr.a (mgr.14355) 8272 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:10 smithi007 bash[22722]: audit 2024-09-14T01:32:09.032404+0000 mgr.a (mgr.14355) 8272 : audit [DBG] from='client.185457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:11 smithi131 bash[24745]: cluster 2024-09-14T01:32:09.888460+0000 mgr.a (mgr.14355) 8273 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:11 smithi171 bash[25040]: cluster 2024-09-14T01:32:09.888460+0000 mgr.a (mgr.14355) 8273 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:11 smithi007 bash[22722]: cluster 2024-09-14T01:32:09.888460+0000 mgr.a (mgr.14355) 8273 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:32:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:13 smithi131 bash[24745]: cluster 2024-09-14T01:32:11.890938+0000 mgr.a (mgr.14355) 8274 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:32:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:13 smithi171 bash[25040]: cluster 2024-09-14T01:32:11.890938+0000 mgr.a (mgr.14355) 8274 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:32:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:13 smithi007 bash[22722]: cluster 2024-09-14T01:32:11.890938+0000 mgr.a (mgr.14355) 8274 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-14T01:32:14.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:14.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:14.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:15.261 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:15.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:15.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:15.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:15.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:15 smithi131 bash[24745]: cluster 2024-09-14T01:32:13.891892+0000 mgr.a (mgr.14355) 8275 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:15 smithi171 bash[25040]: cluster 2024-09-14T01:32:13.891892+0000 mgr.a (mgr.14355) 8275 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:15 smithi007 bash[22722]: cluster 2024-09-14T01:32:13.891892+0000 mgr.a (mgr.14355) 8275 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:16 smithi131 bash[24745]: audit 2024-09-14T01:32:14.823303+0000 mgr.a (mgr.14355) 8276 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:16 smithi171 bash[25040]: audit 2024-09-14T01:32:14.823303+0000 mgr.a (mgr.14355) 8276 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:16 smithi007 bash[22722]: audit 2024-09-14T01:32:14.823303+0000 mgr.a (mgr.14355) 8276 : audit [DBG] from='client.185532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:17 smithi131 bash[24745]: cluster 2024-09-14T01:32:15.894447+0000 mgr.a (mgr.14355) 8277 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:32:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:17 smithi171 bash[25040]: cluster 2024-09-14T01:32:15.894447+0000 mgr.a (mgr.14355) 8277 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:32:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:17 smithi007 bash[22722]: cluster 2024-09-14T01:32:15.894447+0000 mgr.a (mgr.14355) 8277 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T01:32:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:19 smithi131 bash[24745]: cluster 2024-09-14T01:32:17.895289+0000 mgr.a (mgr.14355) 8278 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:19 smithi171 bash[25040]: cluster 2024-09-14T01:32:17.895289+0000 mgr.a (mgr.14355) 8278 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:19 smithi007 bash[22722]: cluster 2024-09-14T01:32:17.895289+0000 mgr.a (mgr.14355) 8278 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:21.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:21.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:21.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:21.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:21.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:21 smithi131 bash[24745]: cluster 2024-09-14T01:32:19.896062+0000 mgr.a (mgr.14355) 8279 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:21 smithi131 bash[24745]: audit 2024-09-14T01:32:20.600113+0000 mgr.a (mgr.14355) 8280 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:21 smithi171 bash[25040]: cluster 2024-09-14T01:32:19.896062+0000 mgr.a (mgr.14355) 8279 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:21 smithi171 bash[25040]: audit 2024-09-14T01:32:20.600113+0000 mgr.a (mgr.14355) 8280 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:21 smithi007 bash[22722]: cluster 2024-09-14T01:32:19.896062+0000 mgr.a (mgr.14355) 8279 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:21 smithi007 bash[22722]: audit 2024-09-14T01:32:20.600113+0000 mgr.a (mgr.14355) 8280 : audit [DBG] from='client.185610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:23 smithi131 bash[24745]: cluster 2024-09-14T01:32:21.899009+0000 mgr.a (mgr.14355) 8281 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:23 smithi171 bash[25040]: cluster 2024-09-14T01:32:21.899009+0000 mgr.a (mgr.14355) 8281 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:23 smithi007 bash[22722]: cluster 2024-09-14T01:32:21.899009+0000 mgr.a (mgr.14355) 8281 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:32:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:25 smithi131 bash[24745]: cluster 2024-09-14T01:32:23.900001+0000 mgr.a (mgr.14355) 8282 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:25 smithi171 bash[25040]: cluster 2024-09-14T01:32:23.900001+0000 mgr.a (mgr.14355) 8282 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:25 smithi007 bash[22722]: cluster 2024-09-14T01:32:23.900001+0000 mgr.a (mgr.14355) 8282 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:26.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:26.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:26.819 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:27 smithi131 bash[24745]: cluster 2024-09-14T01:32:25.902164+0000 mgr.a (mgr.14355) 8283 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:27 smithi131 bash[24745]: audit 2024-09-14T01:32:26.367647+0000 mgr.a (mgr.14355) 8284 : audit [DBG] from='client.185688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:27 smithi171 bash[25040]: cluster 2024-09-14T01:32:25.902164+0000 mgr.a (mgr.14355) 8283 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:27 smithi171 bash[25040]: audit 2024-09-14T01:32:26.367647+0000 mgr.a (mgr.14355) 8284 : audit [DBG] from='client.185688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:27 smithi007 bash[22722]: cluster 2024-09-14T01:32:25.902164+0000 mgr.a (mgr.14355) 8283 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:27 smithi007 bash[22722]: audit 2024-09-14T01:32:26.367647+0000 mgr.a (mgr.14355) 8284 : audit [DBG] from='client.185688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:29 smithi131 bash[24745]: cluster 2024-09-14T01:32:27.903116+0000 mgr.a (mgr.14355) 8285 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:29 smithi171 bash[25040]: cluster 2024-09-14T01:32:27.903116+0000 mgr.a (mgr.14355) 8285 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:29 smithi007 bash[22722]: cluster 2024-09-14T01:32:27.903116+0000 mgr.a (mgr.14355) 8285 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:31 smithi131 bash[24745]: cluster 2024-09-14T01:32:29.903904+0000 mgr.a (mgr.14355) 8286 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:31 smithi171 bash[25040]: cluster 2024-09-14T01:32:29.903904+0000 mgr.a (mgr.14355) 8286 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:31.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:31.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:31.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:31 smithi007 bash[22722]: cluster 2024-09-14T01:32:29.903904+0000 mgr.a (mgr.14355) 8286 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:32:32.594 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:32.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:32.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:32.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:32.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:33 smithi131 bash[24745]: cluster 2024-09-14T01:32:31.906093+0000 mgr.a (mgr.14355) 8287 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:33 smithi131 bash[24745]: audit 2024-09-14T01:32:32.154675+0000 mgr.a (mgr.14355) 8288 : audit [DBG] from='client.185766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:33 smithi171 bash[25040]: cluster 2024-09-14T01:32:31.906093+0000 mgr.a (mgr.14355) 8287 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:33 smithi171 bash[25040]: audit 2024-09-14T01:32:32.154675+0000 mgr.a (mgr.14355) 8288 : audit [DBG] from='client.185766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:33 smithi007 bash[22722]: cluster 2024-09-14T01:32:31.906093+0000 mgr.a (mgr.14355) 8287 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:33 smithi007 bash[22722]: audit 2024-09-14T01:32:32.154675+0000 mgr.a (mgr.14355) 8288 : audit [DBG] from='client.185766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:35 smithi131 bash[24745]: cluster 2024-09-14T01:32:33.907003+0000 mgr.a (mgr.14355) 8289 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:35 smithi171 bash[25040]: cluster 2024-09-14T01:32:33.907003+0000 mgr.a (mgr.14355) 8289 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:35 smithi007 bash[22722]: cluster 2024-09-14T01:32:33.907003+0000 mgr.a (mgr.14355) 8289 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:37.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:37.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:37.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:37 smithi131 bash[24745]: cluster 2024-09-14T01:32:35.909305+0000 mgr.a (mgr.14355) 8290 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:37 smithi171 bash[25040]: cluster 2024-09-14T01:32:35.909305+0000 mgr.a (mgr.14355) 8290 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:37 smithi007 bash[22722]: cluster 2024-09-14T01:32:35.909305+0000 mgr.a (mgr.14355) 8290 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:38.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:39 smithi131 bash[24745]: cluster 2024-09-14T01:32:37.910064+0000 mgr.a (mgr.14355) 8291 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:39 smithi131 bash[24745]: audit 2024-09-14T01:32:37.933030+0000 mgr.a (mgr.14355) 8292 : audit [DBG] from='client.185841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:39 smithi171 bash[25040]: cluster 2024-09-14T01:32:37.910064+0000 mgr.a (mgr.14355) 8291 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:39 smithi171 bash[25040]: audit 2024-09-14T01:32:37.933030+0000 mgr.a (mgr.14355) 8292 : audit [DBG] from='client.185841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:39 smithi007 bash[22722]: cluster 2024-09-14T01:32:37.910064+0000 mgr.a (mgr.14355) 8291 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:39 smithi007 bash[22722]: audit 2024-09-14T01:32:37.933030+0000 mgr.a (mgr.14355) 8292 : audit [DBG] from='client.185841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:41 smithi171 bash[25040]: cluster 2024-09-14T01:32:39.911101+0000 mgr.a (mgr.14355) 8293 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:41 smithi007 bash[22722]: cluster 2024-09-14T01:32:39.911101+0000 mgr.a (mgr.14355) 8293 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:41 smithi131 bash[24745]: cluster 2024-09-14T01:32:39.911101+0000 mgr.a (mgr.14355) 8293 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:43.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:43 smithi171 bash[25040]: cluster 2024-09-14T01:32:41.913336+0000 mgr.a (mgr.14355) 8294 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:43 smithi007 bash[22722]: cluster 2024-09-14T01:32:41.913336+0000 mgr.a (mgr.14355) 8294 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:43 smithi131 bash[24745]: cluster 2024-09-14T01:32:41.913336+0000 mgr.a (mgr.14355) 8294 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:44.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:44.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:44.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:44.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:44.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:45 smithi007 bash[22722]: audit 2024-09-14T01:32:43.714211+0000 mgr.a (mgr.14355) 8295 : audit [DBG] from='client.185919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:45 smithi007 bash[22722]: cluster 2024-09-14T01:32:43.913906+0000 mgr.a (mgr.14355) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:45 smithi131 bash[24745]: audit 2024-09-14T01:32:43.714211+0000 mgr.a (mgr.14355) 8295 : audit [DBG] from='client.185919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:45 smithi131 bash[24745]: cluster 2024-09-14T01:32:43.913906+0000 mgr.a (mgr.14355) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:45 smithi171 bash[25040]: audit 2024-09-14T01:32:43.714211+0000 mgr.a (mgr.14355) 8295 : audit [DBG] from='client.185919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:45 smithi171 bash[25040]: cluster 2024-09-14T01:32:43.913906+0000 mgr.a (mgr.14355) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:47 smithi007 bash[22722]: cluster 2024-09-14T01:32:45.916212+0000 mgr.a (mgr.14355) 8297 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:47 smithi131 bash[24745]: cluster 2024-09-14T01:32:45.916212+0000 mgr.a (mgr.14355) 8297 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:47 smithi171 bash[25040]: cluster 2024-09-14T01:32:45.916212+0000 mgr.a (mgr.14355) 8297 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:49.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:49.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:49.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:49.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:49 smithi007 bash[22722]: cluster 2024-09-14T01:32:47.916981+0000 mgr.a (mgr.14355) 8298 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:49 smithi131 bash[24745]: cluster 2024-09-14T01:32:47.916981+0000 mgr.a (mgr.14355) 8298 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:49 smithi171 bash[25040]: cluster 2024-09-14T01:32:47.916981+0000 mgr.a (mgr.14355) 8298 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:50 smithi007 bash[22722]: audit 2024-09-14T01:32:49.496845+0000 mgr.a (mgr.14355) 8299 : audit [DBG] from='client.185994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:50 smithi131 bash[24745]: audit 2024-09-14T01:32:49.496845+0000 mgr.a (mgr.14355) 8299 : audit [DBG] from='client.185994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:50 smithi171 bash[25040]: audit 2024-09-14T01:32:49.496845+0000 mgr.a (mgr.14355) 8299 : audit [DBG] from='client.185994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:51 smithi007 bash[22722]: cluster 2024-09-14T01:32:49.917476+0000 mgr.a (mgr.14355) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:51 smithi131 bash[24745]: cluster 2024-09-14T01:32:49.917476+0000 mgr.a (mgr.14355) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:51 smithi171 bash[25040]: cluster 2024-09-14T01:32:49.917476+0000 mgr.a (mgr.14355) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:53 smithi007 bash[22722]: cluster 2024-09-14T01:32:51.919689+0000 mgr.a (mgr.14355) 8301 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:53 smithi007 bash[22722]: audit 2024-09-14T01:32:53.335444+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:32:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:53 smithi131 bash[24745]: cluster 2024-09-14T01:32:51.919689+0000 mgr.a (mgr.14355) 8301 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:53 smithi131 bash[24745]: audit 2024-09-14T01:32:53.335444+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:32:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:53 smithi171 bash[25040]: cluster 2024-09-14T01:32:51.919689+0000 mgr.a (mgr.14355) 8301 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:32:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:53 smithi171 bash[25040]: audit 2024-09-14T01:32:53.335444+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:32:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:32:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:32:54.921 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:32:54.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22722]: audit 2024-09-14T01:32:54.168583+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:32:54.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22722]: audit 2024-09-14T01:32:54.169953+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:32:54.928 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22722]: audit 2024-09-14T01:32:54.179484+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:32:54.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22722]: audit 2024-09-14T01:32:54.184696+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:54 smithi131 bash[24745]: audit 2024-09-14T01:32:54.168583+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:54 smithi131 bash[24745]: audit 2024-09-14T01:32:54.169953+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:54 smithi131 bash[24745]: audit 2024-09-14T01:32:54.179484+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:54 smithi131 bash[24745]: audit 2024-09-14T01:32:54.184696+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:54 smithi171 bash[25040]: audit 2024-09-14T01:32:54.168583+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:54 smithi171 bash[25040]: audit 2024-09-14T01:32:54.169953+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:54 smithi171 bash[25040]: audit 2024-09-14T01:32:54.179484+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:54 smithi171 bash[25040]: audit 2024-09-14T01:32:54.184696+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:55.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22972]: debug 2024-09-14T01:32:54.923+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:32:55.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:32:54 smithi007 bash[22972]: debug 2024-09-14T01:32:54.923+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:32:55.660 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:32:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:32:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:32:55.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:32:55.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:32:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:55 smithi007 bash[22722]: cluster 2024-09-14T01:32:53.920221+0000 mgr.a (mgr.14355) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:55 smithi007 bash[22722]: audit 2024-09-14T01:32:54.186964+0000 mgr.a (mgr.14355) 8303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:55 smithi131 bash[24745]: cluster 2024-09-14T01:32:53.920221+0000 mgr.a (mgr.14355) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:55 smithi131 bash[24745]: audit 2024-09-14T01:32:54.186964+0000 mgr.a (mgr.14355) 8303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:55 smithi171 bash[25040]: cluster 2024-09-14T01:32:53.920221+0000 mgr.a (mgr.14355) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:32:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:55 smithi171 bash[25040]: audit 2024-09-14T01:32:54.186964+0000 mgr.a (mgr.14355) 8303 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:32:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:56 smithi007 bash[22722]: audit 2024-09-14T01:32:54.928336+0000 mgr.a (mgr.14355) 8304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:32:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:56 smithi007 bash[22722]: cephadm 2024-09-14T01:32:54.929848+0000 mgr.a (mgr.14355) 8305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:32:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:56 smithi007 bash[22722]: audit 2024-09-14T01:32:55.243549+0000 mgr.a (mgr.14355) 8306 : audit [DBG] from='client.186180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:56 smithi131 bash[24745]: audit 2024-09-14T01:32:54.928336+0000 mgr.a (mgr.14355) 8304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:32:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:56 smithi131 bash[24745]: cephadm 2024-09-14T01:32:54.929848+0000 mgr.a (mgr.14355) 8305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:32:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:56 smithi131 bash[24745]: audit 2024-09-14T01:32:55.243549+0000 mgr.a (mgr.14355) 8306 : audit [DBG] from='client.186180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:56 smithi171 bash[25040]: audit 2024-09-14T01:32:54.928336+0000 mgr.a (mgr.14355) 8304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:32:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:56 smithi171 bash[25040]: cephadm 2024-09-14T01:32:54.929848+0000 mgr.a (mgr.14355) 8305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:32:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:56 smithi171 bash[25040]: audit 2024-09-14T01:32:55.243549+0000 mgr.a (mgr.14355) 8306 : audit [DBG] from='client.186180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:32:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:57 smithi007 bash[22722]: cluster 2024-09-14T01:32:55.922962+0000 mgr.a (mgr.14355) 8307 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:57 smithi131 bash[24745]: cluster 2024-09-14T01:32:55.922962+0000 mgr.a (mgr.14355) 8307 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:57 smithi171 bash[25040]: cluster 2024-09-14T01:32:55.922962+0000 mgr.a (mgr.14355) 8307 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:32:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:32:59 smithi007 bash[22722]: cluster 2024-09-14T01:32:57.923755+0000 mgr.a (mgr.14355) 8308 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:32:59 smithi131 bash[24745]: cluster 2024-09-14T01:32:57.923755+0000 mgr.a (mgr.14355) 8308 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:32:59 smithi171 bash[25040]: cluster 2024-09-14T01:32:57.923755+0000 mgr.a (mgr.14355) 8308 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:00.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:01.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:01.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:01.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:01.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:01.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:01 smithi007 bash[22722]: cluster 2024-09-14T01:32:59.924515+0000 mgr.a (mgr.14355) 8309 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:01 smithi131 bash[24745]: cluster 2024-09-14T01:32:59.924515+0000 mgr.a (mgr.14355) 8309 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:01 smithi171 bash[25040]: cluster 2024-09-14T01:32:59.924515+0000 mgr.a (mgr.14355) 8309 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:02 smithi007 bash[22722]: audit 2024-09-14T01:33:00.996899+0000 mgr.a (mgr.14355) 8310 : audit [DBG] from='client.186258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:02 smithi131 bash[24745]: audit 2024-09-14T01:33:00.996899+0000 mgr.a (mgr.14355) 8310 : audit [DBG] from='client.186258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:02 smithi171 bash[25040]: audit 2024-09-14T01:33:00.996899+0000 mgr.a (mgr.14355) 8310 : audit [DBG] from='client.186258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:03 smithi007 bash[22722]: cluster 2024-09-14T01:33:01.927395+0000 mgr.a (mgr.14355) 8311 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:03 smithi131 bash[24745]: cluster 2024-09-14T01:33:01.927395+0000 mgr.a (mgr.14355) 8311 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:03 smithi171 bash[25040]: cluster 2024-09-14T01:33:01.927395+0000 mgr.a (mgr.14355) 8311 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:05 smithi007 bash[22722]: cluster 2024-09-14T01:33:03.928211+0000 mgr.a (mgr.14355) 8312 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:05 smithi131 bash[24745]: cluster 2024-09-14T01:33:03.928211+0000 mgr.a (mgr.14355) 8312 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:05 smithi171 bash[25040]: cluster 2024-09-14T01:33:03.928211+0000 mgr.a (mgr.14355) 8312 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:33:06.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:06.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:07.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:07.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:07.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:07.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:07.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:07 smithi007 bash[22722]: cluster 2024-09-14T01:33:05.930200+0000 mgr.a (mgr.14355) 8313 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:07 smithi131 bash[24745]: cluster 2024-09-14T01:33:05.930200+0000 mgr.a (mgr.14355) 8313 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:07 smithi171 bash[25040]: cluster 2024-09-14T01:33:05.930200+0000 mgr.a (mgr.14355) 8313 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:33:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:08 smithi007 bash[22722]: audit 2024-09-14T01:33:06.767630+0000 mgr.a (mgr.14355) 8314 : audit [DBG] from='client.186336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:08 smithi131 bash[24745]: audit 2024-09-14T01:33:06.767630+0000 mgr.a (mgr.14355) 8314 : audit [DBG] from='client.186336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:08 smithi171 bash[25040]: audit 2024-09-14T01:33:06.767630+0000 mgr.a (mgr.14355) 8314 : audit [DBG] from='client.186336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:09 smithi007 bash[22722]: cluster 2024-09-14T01:33:07.931156+0000 mgr.a (mgr.14355) 8315 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:09 smithi131 bash[24745]: cluster 2024-09-14T01:33:07.931156+0000 mgr.a (mgr.14355) 8315 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:09 smithi171 bash[25040]: cluster 2024-09-14T01:33:07.931156+0000 mgr.a (mgr.14355) 8315 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:11 smithi007 bash[22722]: cluster 2024-09-14T01:33:09.931956+0000 mgr.a (mgr.14355) 8316 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:11 smithi131 bash[24745]: cluster 2024-09-14T01:33:09.931956+0000 mgr.a (mgr.14355) 8316 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:11 smithi171 bash[25040]: cluster 2024-09-14T01:33:09.931956+0000 mgr.a (mgr.14355) 8316 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:12.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:12.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:12.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:12.981 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:12.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:13 smithi007 bash[22722]: cluster 2024-09-14T01:33:11.934186+0000 mgr.a (mgr.14355) 8317 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:13 smithi007 bash[22722]: audit 2024-09-14T01:33:12.546140+0000 mgr.a (mgr.14355) 8318 : audit [DBG] from='client.186411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:13 smithi131 bash[24745]: cluster 2024-09-14T01:33:11.934186+0000 mgr.a (mgr.14355) 8317 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:13 smithi131 bash[24745]: audit 2024-09-14T01:33:12.546140+0000 mgr.a (mgr.14355) 8318 : audit [DBG] from='client.186411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:13 smithi171 bash[25040]: cluster 2024-09-14T01:33:11.934186+0000 mgr.a (mgr.14355) 8317 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:13 smithi171 bash[25040]: audit 2024-09-14T01:33:12.546140+0000 mgr.a (mgr.14355) 8318 : audit [DBG] from='client.186411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:15 smithi007 bash[22722]: cluster 2024-09-14T01:33:13.935105+0000 mgr.a (mgr.14355) 8319 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:15 smithi131 bash[24745]: cluster 2024-09-14T01:33:13.935105+0000 mgr.a (mgr.14355) 8319 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:15 smithi171 bash[25040]: cluster 2024-09-14T01:33:13.935105+0000 mgr.a (mgr.14355) 8319 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:17 smithi007 bash[22722]: cluster 2024-09-14T01:33:15.937339+0000 mgr.a (mgr.14355) 8320 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:17.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:17.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:17.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:17 smithi131 bash[24745]: cluster 2024-09-14T01:33:15.937339+0000 mgr.a (mgr.14355) 8320 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:17 smithi171 bash[25040]: cluster 2024-09-14T01:33:15.937339+0000 mgr.a (mgr.14355) 8320 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:18.760 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:18.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:18.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:18.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:18.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:19 smithi007 bash[22722]: cluster 2024-09-14T01:33:17.938086+0000 mgr.a (mgr.14355) 8321 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:19 smithi007 bash[22722]: audit 2024-09-14T01:33:18.319713+0000 mgr.a (mgr.14355) 8322 : audit [DBG] from='client.186489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:19 smithi131 bash[24745]: cluster 2024-09-14T01:33:17.938086+0000 mgr.a (mgr.14355) 8321 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:19 smithi131 bash[24745]: audit 2024-09-14T01:33:18.319713+0000 mgr.a (mgr.14355) 8322 : audit [DBG] from='client.186489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:19 smithi171 bash[25040]: cluster 2024-09-14T01:33:17.938086+0000 mgr.a (mgr.14355) 8321 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:19 smithi171 bash[25040]: audit 2024-09-14T01:33:18.319713+0000 mgr.a (mgr.14355) 8322 : audit [DBG] from='client.186489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:21 smithi007 bash[22722]: cluster 2024-09-14T01:33:19.938984+0000 mgr.a (mgr.14355) 8323 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:21 smithi131 bash[24745]: cluster 2024-09-14T01:33:19.938984+0000 mgr.a (mgr.14355) 8323 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:21 smithi171 bash[25040]: cluster 2024-09-14T01:33:19.938984+0000 mgr.a (mgr.14355) 8323 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:23.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:23.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:23 smithi007 bash[22722]: cluster 2024-09-14T01:33:21.941238+0000 mgr.a (mgr.14355) 8324 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:23 smithi131 bash[24745]: cluster 2024-09-14T01:33:21.941238+0000 mgr.a (mgr.14355) 8324 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:23 smithi171 bash[25040]: cluster 2024-09-14T01:33:21.941238+0000 mgr.a (mgr.14355) 8324 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:24.507 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:24.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:25 smithi007 bash[22722]: cluster 2024-09-14T01:33:23.941971+0000 mgr.a (mgr.14355) 8325 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:25 smithi007 bash[22722]: audit 2024-09-14T01:33:24.095453+0000 mgr.a (mgr.14355) 8326 : audit [DBG] from='client.186567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:25 smithi131 bash[24745]: cluster 2024-09-14T01:33:23.941971+0000 mgr.a (mgr.14355) 8325 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:25 smithi131 bash[24745]: audit 2024-09-14T01:33:24.095453+0000 mgr.a (mgr.14355) 8326 : audit [DBG] from='client.186567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:25 smithi171 bash[25040]: cluster 2024-09-14T01:33:23.941971+0000 mgr.a (mgr.14355) 8325 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:25 smithi171 bash[25040]: audit 2024-09-14T01:33:24.095453+0000 mgr.a (mgr.14355) 8326 : audit [DBG] from='client.186567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:27 smithi007 bash[22722]: cluster 2024-09-14T01:33:25.944307+0000 mgr.a (mgr.14355) 8327 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:27 smithi131 bash[24745]: cluster 2024-09-14T01:33:25.944307+0000 mgr.a (mgr.14355) 8327 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:27 smithi171 bash[25040]: cluster 2024-09-14T01:33:25.944307+0000 mgr.a (mgr.14355) 8327 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:29.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:29.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:29.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:29 smithi007 bash[22722]: cluster 2024-09-14T01:33:27.945072+0000 mgr.a (mgr.14355) 8328 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:29 smithi131 bash[24745]: cluster 2024-09-14T01:33:27.945072+0000 mgr.a (mgr.14355) 8328 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:29 smithi171 bash[25040]: cluster 2024-09-14T01:33:27.945072+0000 mgr.a (mgr.14355) 8328 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:30.275 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:30.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:30.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:31 smithi007 bash[22722]: audit 2024-09-14T01:33:29.843014+0000 mgr.a (mgr.14355) 8329 : audit [DBG] from='client.186642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:31 smithi007 bash[22722]: cluster 2024-09-14T01:33:29.945567+0000 mgr.a (mgr.14355) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:31 smithi131 bash[24745]: audit 2024-09-14T01:33:29.843014+0000 mgr.a (mgr.14355) 8329 : audit [DBG] from='client.186642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:31 smithi131 bash[24745]: cluster 2024-09-14T01:33:29.945567+0000 mgr.a (mgr.14355) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:31 smithi171 bash[25040]: audit 2024-09-14T01:33:29.843014+0000 mgr.a (mgr.14355) 8329 : audit [DBG] from='client.186642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:31 smithi171 bash[25040]: cluster 2024-09-14T01:33:29.945567+0000 mgr.a (mgr.14355) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:33 smithi007 bash[22722]: cluster 2024-09-14T01:33:31.947921+0000 mgr.a (mgr.14355) 8331 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:33 smithi131 bash[24745]: cluster 2024-09-14T01:33:31.947921+0000 mgr.a (mgr.14355) 8331 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:33 smithi171 bash[25040]: cluster 2024-09-14T01:33:31.947921+0000 mgr.a (mgr.14355) 8331 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:35.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:35.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:35.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:35 smithi007 bash[22722]: cluster 2024-09-14T01:33:33.948685+0000 mgr.a (mgr.14355) 8332 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:35 smithi131 bash[24745]: cluster 2024-09-14T01:33:33.948685+0000 mgr.a (mgr.14355) 8332 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:35 smithi171 bash[25040]: cluster 2024-09-14T01:33:33.948685+0000 mgr.a (mgr.14355) 8332 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:36.049 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:36 smithi007 bash[22722]: audit 2024-09-14T01:33:35.609734+0000 mgr.a (mgr.14355) 8333 : audit [DBG] from='client.186717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:36 smithi131 bash[24745]: audit 2024-09-14T01:33:35.609734+0000 mgr.a (mgr.14355) 8333 : audit [DBG] from='client.186717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:36 smithi171 bash[25040]: audit 2024-09-14T01:33:35.609734+0000 mgr.a (mgr.14355) 8333 : audit [DBG] from='client.186717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:37 smithi007 bash[22722]: cluster 2024-09-14T01:33:35.950660+0000 mgr.a (mgr.14355) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:37 smithi131 bash[24745]: cluster 2024-09-14T01:33:35.950660+0000 mgr.a (mgr.14355) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:37 smithi171 bash[25040]: cluster 2024-09-14T01:33:35.950660+0000 mgr.a (mgr.14355) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:39 smithi131 bash[24745]: cluster 2024-09-14T01:33:37.951451+0000 mgr.a (mgr.14355) 8335 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:39 smithi171 bash[25040]: cluster 2024-09-14T01:33:37.951451+0000 mgr.a (mgr.14355) 8335 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:39 smithi007 bash[22722]: cluster 2024-09-14T01:33:37.951451+0000 mgr.a (mgr.14355) 8335 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:41.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:41 smithi131 bash[24745]: cluster 2024-09-14T01:33:39.952212+0000 mgr.a (mgr.14355) 8336 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:33:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:41 smithi171 bash[25040]: cluster 2024-09-14T01:33:39.952212+0000 mgr.a (mgr.14355) 8336 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:33:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:41 smithi007 bash[22722]: cluster 2024-09-14T01:33:39.952212+0000 mgr.a (mgr.14355) 8336 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:33:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:42 smithi131 bash[24745]: audit 2024-09-14T01:33:41.388827+0000 mgr.a (mgr.14355) 8337 : audit [DBG] from='client.186795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:42 smithi171 bash[25040]: audit 2024-09-14T01:33:41.388827+0000 mgr.a (mgr.14355) 8337 : audit [DBG] from='client.186795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:42 smithi007 bash[22722]: audit 2024-09-14T01:33:41.388827+0000 mgr.a (mgr.14355) 8337 : audit [DBG] from='client.186795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:43 smithi131 bash[24745]: cluster 2024-09-14T01:33:41.955102+0000 mgr.a (mgr.14355) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:43 smithi171 bash[25040]: cluster 2024-09-14T01:33:41.955102+0000 mgr.a (mgr.14355) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:43 smithi007 bash[22722]: cluster 2024-09-14T01:33:41.955102+0000 mgr.a (mgr.14355) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:45 smithi131 bash[24745]: cluster 2024-09-14T01:33:43.955876+0000 mgr.a (mgr.14355) 8339 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:45 smithi171 bash[25040]: cluster 2024-09-14T01:33:43.955876+0000 mgr.a (mgr.14355) 8339 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:45 smithi007 bash[22722]: cluster 2024-09-14T01:33:43.955876+0000 mgr.a (mgr.14355) 8339 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:33:46.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:46.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:46 smithi131 bash[24745]: cluster 2024-09-14T01:33:45.957799+0000 mgr.a (mgr.14355) 8340 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:46 smithi171 bash[25040]: cluster 2024-09-14T01:33:45.957799+0000 mgr.a (mgr.14355) 8340 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:46 smithi007 bash[22722]: cluster 2024-09-14T01:33:45.957799+0000 mgr.a (mgr.14355) 8340 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:47.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:47.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:47.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:47.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:47.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:47 smithi131 bash[24745]: audit 2024-09-14T01:33:47.178218+0000 mgr.a (mgr.14355) 8341 : audit [DBG] from='client.186870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:47 smithi171 bash[25040]: audit 2024-09-14T01:33:47.178218+0000 mgr.a (mgr.14355) 8341 : audit [DBG] from='client.186870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:47 smithi007 bash[22722]: audit 2024-09-14T01:33:47.178218+0000 mgr.a (mgr.14355) 8341 : audit [DBG] from='client.186870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:48 smithi131 bash[24745]: cluster 2024-09-14T01:33:47.958783+0000 mgr.a (mgr.14355) 8342 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:48 smithi171 bash[25040]: cluster 2024-09-14T01:33:47.958783+0000 mgr.a (mgr.14355) 8342 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:48 smithi007 bash[22722]: cluster 2024-09-14T01:33:47.958783+0000 mgr.a (mgr.14355) 8342 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:51 smithi131 bash[24745]: cluster 2024-09-14T01:33:49.959567+0000 mgr.a (mgr.14355) 8343 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:51 smithi171 bash[25040]: cluster 2024-09-14T01:33:49.959567+0000 mgr.a (mgr.14355) 8343 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:51 smithi007 bash[22722]: cluster 2024-09-14T01:33:49.959567+0000 mgr.a (mgr.14355) 8343 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:52.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:52.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:53 smithi131 bash[24745]: cluster 2024-09-14T01:33:51.961777+0000 mgr.a (mgr.14355) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:53 smithi171 bash[25040]: cluster 2024-09-14T01:33:51.961777+0000 mgr.a (mgr.14355) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:53.411 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:53.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:53.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:53.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:53.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:53 smithi007 bash[22722]: cluster 2024-09-14T01:33:51.961777+0000 mgr.a (mgr.14355) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:54 smithi131 bash[24745]: audit 2024-09-14T01:33:52.967641+0000 mgr.a (mgr.14355) 8345 : audit [DBG] from='client.186945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:54 smithi171 bash[25040]: audit 2024-09-14T01:33:52.967641+0000 mgr.a (mgr.14355) 8345 : audit [DBG] from='client.186945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:54 smithi007 bash[22722]: audit 2024-09-14T01:33:52.967641+0000 mgr.a (mgr.14355) 8345 : audit [DBG] from='client.186945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:33:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:55 smithi171 bash[25040]: cluster 2024-09-14T01:33:53.962704+0000 mgr.a (mgr.14355) 8346 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:55 smithi171 bash[25040]: audit 2024-09-14T01:33:54.992156+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:33:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:55 smithi007 bash[22722]: cluster 2024-09-14T01:33:53.962704+0000 mgr.a (mgr.14355) 8346 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:55 smithi007 bash[22722]: audit 2024-09-14T01:33:54.992156+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:33:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:55 smithi131 bash[24745]: cluster 2024-09-14T01:33:53.962704+0000 mgr.a (mgr.14355) 8346 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:55 smithi131 bash[24745]: audit 2024-09-14T01:33:54.992156+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:33:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:56 smithi171 bash[25040]: audit 2024-09-14T01:33:55.814602+0000 mon.a (mon.0) 1847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:33:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:56 smithi171 bash[25040]: audit 2024-09-14T01:33:55.816621+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:33:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:56 smithi171 bash[25040]: audit 2024-09-14T01:33:55.827851+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:33:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:56 smithi171 bash[25040]: audit 2024-09-14T01:33:55.832789+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22722]: audit 2024-09-14T01:33:55.814602+0000 mon.a (mon.0) 1847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:33:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22722]: audit 2024-09-14T01:33:55.816621+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:33:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22722]: audit 2024-09-14T01:33:55.827851+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:33:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22722]: audit 2024-09-14T01:33:55.832789+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:56 smithi131 bash[24745]: audit 2024-09-14T01:33:55.814602+0000 mon.a (mon.0) 1847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:33:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:56 smithi131 bash[24745]: audit 2024-09-14T01:33:55.816621+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:33:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:56 smithi131 bash[24745]: audit 2024-09-14T01:33:55.827851+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:33:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:56 smithi131 bash[24745]: audit 2024-09-14T01:33:55.832789+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:56.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22972]: debug 2024-09-14T01:33:56.578+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:33:56.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:33:56 smithi007 bash[22972]: debug 2024-09-14T01:33:56.582+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:57 smithi171 bash[25040]: audit 2024-09-14T01:33:55.834428+0000 mgr.a (mgr.14355) 8347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:57 smithi171 bash[25040]: cluster 2024-09-14T01:33:55.964180+0000 mgr.a (mgr.14355) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:57 smithi171 bash[25040]: audit 2024-09-14T01:33:56.581476+0000 mgr.a (mgr.14355) 8349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:57 smithi171 bash[25040]: cephadm 2024-09-14T01:33:56.583064+0000 mgr.a (mgr.14355) 8350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:33:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:57 smithi007 bash[22722]: audit 2024-09-14T01:33:55.834428+0000 mgr.a (mgr.14355) 8347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:57 smithi007 bash[22722]: cluster 2024-09-14T01:33:55.964180+0000 mgr.a (mgr.14355) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:57 smithi007 bash[22722]: audit 2024-09-14T01:33:56.581476+0000 mgr.a (mgr.14355) 8349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:33:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:57 smithi007 bash[22722]: cephadm 2024-09-14T01:33:56.583064+0000 mgr.a (mgr.14355) 8350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:33:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:57 smithi131 bash[24745]: audit 2024-09-14T01:33:55.834428+0000 mgr.a (mgr.14355) 8347 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:33:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:57 smithi131 bash[24745]: cluster 2024-09-14T01:33:55.964180+0000 mgr.a (mgr.14355) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:33:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:57 smithi131 bash[24745]: audit 2024-09-14T01:33:56.581476+0000 mgr.a (mgr.14355) 8349 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:33:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:57 smithi131 bash[24745]: cephadm 2024-09-14T01:33:56.583064+0000 mgr.a (mgr.14355) 8350 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:33:58.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:33:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:33:58.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:33:59.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:33:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:33:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:33:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:33:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:33:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:33:59 smithi007 bash[22722]: cluster 2024-09-14T01:33:57.965188+0000 mgr.a (mgr.14355) 8351 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:33:59 smithi131 bash[24745]: cluster 2024-09-14T01:33:57.965188+0000 mgr.a (mgr.14355) 8351 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:33:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:33:59 smithi171 bash[25040]: cluster 2024-09-14T01:33:57.965188+0000 mgr.a (mgr.14355) 8351 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:00 smithi007 bash[22722]: audit 2024-09-14T01:33:58.738343+0000 mgr.a (mgr.14355) 8352 : audit [DBG] from='client.187131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:00 smithi131 bash[24745]: audit 2024-09-14T01:33:58.738343+0000 mgr.a (mgr.14355) 8352 : audit [DBG] from='client.187131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:00 smithi171 bash[25040]: audit 2024-09-14T01:33:58.738343+0000 mgr.a (mgr.14355) 8352 : audit [DBG] from='client.187131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:01 smithi007 bash[22722]: cluster 2024-09-14T01:33:59.966108+0000 mgr.a (mgr.14355) 8353 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:01 smithi131 bash[24745]: cluster 2024-09-14T01:33:59.966108+0000 mgr.a (mgr.14355) 8353 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:01 smithi171 bash[25040]: cluster 2024-09-14T01:33:59.966108+0000 mgr.a (mgr.14355) 8353 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:03 smithi007 bash[22722]: cluster 2024-09-14T01:34:01.968327+0000 mgr.a (mgr.14355) 8354 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:03 smithi131 bash[24745]: cluster 2024-09-14T01:34:01.968327+0000 mgr.a (mgr.14355) 8354 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:03 smithi171 bash[25040]: cluster 2024-09-14T01:34:01.968327+0000 mgr.a (mgr.14355) 8354 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:04.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:04.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:04.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:04.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:05 smithi007 bash[22722]: cluster 2024-09-14T01:34:03.969275+0000 mgr.a (mgr.14355) 8355 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:05 smithi007 bash[22722]: audit 2024-09-14T01:34:04.496633+0000 mgr.a (mgr.14355) 8356 : audit [DBG] from='client.187209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:05 smithi131 bash[24745]: cluster 2024-09-14T01:34:03.969275+0000 mgr.a (mgr.14355) 8355 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:05 smithi131 bash[24745]: audit 2024-09-14T01:34:04.496633+0000 mgr.a (mgr.14355) 8356 : audit [DBG] from='client.187209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:05 smithi171 bash[25040]: cluster 2024-09-14T01:34:03.969275+0000 mgr.a (mgr.14355) 8355 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:05 smithi171 bash[25040]: audit 2024-09-14T01:34:04.496633+0000 mgr.a (mgr.14355) 8356 : audit [DBG] from='client.187209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:07 smithi007 bash[22722]: cluster 2024-09-14T01:34:05.971777+0000 mgr.a (mgr.14355) 8357 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:07 smithi131 bash[24745]: cluster 2024-09-14T01:34:05.971777+0000 mgr.a (mgr.14355) 8357 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:07 smithi171 bash[25040]: cluster 2024-09-14T01:34:05.971777+0000 mgr.a (mgr.14355) 8357 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:09 smithi007 bash[22722]: cluster 2024-09-14T01:34:07.972726+0000 mgr.a (mgr.14355) 8358 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:09 smithi131 bash[24745]: cluster 2024-09-14T01:34:07.972726+0000 mgr.a (mgr.14355) 8358 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:09 smithi171 bash[25040]: cluster 2024-09-14T01:34:07.972726+0000 mgr.a (mgr.14355) 8358 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:09.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:10.734 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:10.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:11 smithi131 bash[24745]: cluster 2024-09-14T01:34:09.973402+0000 mgr.a (mgr.14355) 8359 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:11 smithi131 bash[24745]: audit 2024-09-14T01:34:10.287558+0000 mgr.a (mgr.14355) 8360 : audit [DBG] from='client.187284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:11 smithi171 bash[25040]: cluster 2024-09-14T01:34:09.973402+0000 mgr.a (mgr.14355) 8359 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:11 smithi171 bash[25040]: audit 2024-09-14T01:34:10.287558+0000 mgr.a (mgr.14355) 8360 : audit [DBG] from='client.187284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:11 smithi007 bash[22722]: cluster 2024-09-14T01:34:09.973402+0000 mgr.a (mgr.14355) 8359 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:11 smithi007 bash[22722]: audit 2024-09-14T01:34:10.287558+0000 mgr.a (mgr.14355) 8360 : audit [DBG] from='client.187284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:13 smithi131 bash[24745]: cluster 2024-09-14T01:34:11.976147+0000 mgr.a (mgr.14355) 8361 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:13 smithi171 bash[25040]: cluster 2024-09-14T01:34:11.976147+0000 mgr.a (mgr.14355) 8361 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:13 smithi007 bash[22722]: cluster 2024-09-14T01:34:11.976147+0000 mgr.a (mgr.14355) 8361 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:34:15.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:15.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:15.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:15.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:15 smithi131 bash[24745]: cluster 2024-09-14T01:34:13.976903+0000 mgr.a (mgr.14355) 8362 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:15 smithi171 bash[25040]: cluster 2024-09-14T01:34:13.976903+0000 mgr.a (mgr.14355) 8362 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:15 smithi007 bash[22722]: cluster 2024-09-14T01:34:13.976903+0000 mgr.a (mgr.14355) 8362 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:16.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:16.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:17 smithi131 bash[24745]: cluster 2024-09-14T01:34:15.978838+0000 mgr.a (mgr.14355) 8363 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:17 smithi131 bash[24745]: audit 2024-09-14T01:34:16.068101+0000 mgr.a (mgr.14355) 8364 : audit [DBG] from='client.187359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:17 smithi171 bash[25040]: cluster 2024-09-14T01:34:15.978838+0000 mgr.a (mgr.14355) 8363 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:17 smithi171 bash[25040]: audit 2024-09-14T01:34:16.068101+0000 mgr.a (mgr.14355) 8364 : audit [DBG] from='client.187359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:17 smithi007 bash[22722]: cluster 2024-09-14T01:34:15.978838+0000 mgr.a (mgr.14355) 8363 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:17 smithi007 bash[22722]: audit 2024-09-14T01:34:16.068101+0000 mgr.a (mgr.14355) 8364 : audit [DBG] from='client.187359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:19 smithi131 bash[24745]: cluster 2024-09-14T01:34:17.979834+0000 mgr.a (mgr.14355) 8365 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:19 smithi171 bash[25040]: cluster 2024-09-14T01:34:17.979834+0000 mgr.a (mgr.14355) 8365 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:19 smithi007 bash[22722]: cluster 2024-09-14T01:34:17.979834+0000 mgr.a (mgr.14355) 8365 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:21.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:21.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:21.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:21 smithi131 bash[24745]: cluster 2024-09-14T01:34:19.980662+0000 mgr.a (mgr.14355) 8366 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:34:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:21 smithi171 bash[25040]: cluster 2024-09-14T01:34:19.980662+0000 mgr.a (mgr.14355) 8366 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:34:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:21 smithi007 bash[22722]: cluster 2024-09-14T01:34:19.980662+0000 mgr.a (mgr.14355) 8366 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:34:22.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:23 smithi131 bash[24745]: audit 2024-09-14T01:34:21.824639+0000 mgr.a (mgr.14355) 8367 : audit [DBG] from='client.187437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:23 smithi131 bash[24745]: cluster 2024-09-14T01:34:21.982043+0000 mgr.a (mgr.14355) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:23 smithi171 bash[25040]: audit 2024-09-14T01:34:21.824639+0000 mgr.a (mgr.14355) 8367 : audit [DBG] from='client.187437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:23 smithi171 bash[25040]: cluster 2024-09-14T01:34:21.982043+0000 mgr.a (mgr.14355) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:23 smithi007 bash[22722]: audit 2024-09-14T01:34:21.824639+0000 mgr.a (mgr.14355) 8367 : audit [DBG] from='client.187437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:23 smithi007 bash[22722]: cluster 2024-09-14T01:34:21.982043+0000 mgr.a (mgr.14355) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:25 smithi131 bash[24745]: cluster 2024-09-14T01:34:23.982902+0000 mgr.a (mgr.14355) 8369 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:25 smithi171 bash[25040]: cluster 2024-09-14T01:34:23.982902+0000 mgr.a (mgr.14355) 8369 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:25 smithi007 bash[22722]: cluster 2024-09-14T01:34:23.982902+0000 mgr.a (mgr.14355) 8369 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:27.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:27 smithi131 bash[24745]: cluster 2024-09-14T01:34:25.985150+0000 mgr.a (mgr.14355) 8370 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:27 smithi171 bash[25040]: cluster 2024-09-14T01:34:25.985150+0000 mgr.a (mgr.14355) 8370 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:27 smithi007 bash[22722]: cluster 2024-09-14T01:34:25.985150+0000 mgr.a (mgr.14355) 8370 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:28.034 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:28.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:28 smithi131 bash[24745]: audit 2024-09-14T01:34:27.605027+0000 mgr.a (mgr.14355) 8371 : audit [DBG] from='client.187515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:28 smithi171 bash[25040]: audit 2024-09-14T01:34:27.605027+0000 mgr.a (mgr.14355) 8371 : audit [DBG] from='client.187515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:28 smithi007 bash[22722]: audit 2024-09-14T01:34:27.605027+0000 mgr.a (mgr.14355) 8371 : audit [DBG] from='client.187515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:29 smithi131 bash[24745]: cluster 2024-09-14T01:34:27.985735+0000 mgr.a (mgr.14355) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:29 smithi171 bash[25040]: cluster 2024-09-14T01:34:27.985735+0000 mgr.a (mgr.14355) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:29 smithi007 bash[22722]: cluster 2024-09-14T01:34:27.985735+0000 mgr.a (mgr.14355) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:31 smithi131 bash[24745]: cluster 2024-09-14T01:34:29.986489+0000 mgr.a (mgr.14355) 8373 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:31 smithi171 bash[25040]: cluster 2024-09-14T01:34:29.986489+0000 mgr.a (mgr.14355) 8373 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:31 smithi007 bash[22722]: cluster 2024-09-14T01:34:29.986489+0000 mgr.a (mgr.14355) 8373 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:33.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:33.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:33 smithi131 bash[24745]: cluster 2024-09-14T01:34:31.988612+0000 mgr.a (mgr.14355) 8374 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:33 smithi171 bash[25040]: cluster 2024-09-14T01:34:31.988612+0000 mgr.a (mgr.14355) 8374 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:33.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:33.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:33.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:33 smithi007 bash[22722]: cluster 2024-09-14T01:34:31.988612+0000 mgr.a (mgr.14355) 8374 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:34 smithi131 bash[24745]: audit 2024-09-14T01:34:33.365859+0000 mgr.a (mgr.14355) 8375 : audit [DBG] from='client.187587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:34 smithi171 bash[25040]: audit 2024-09-14T01:34:33.365859+0000 mgr.a (mgr.14355) 8375 : audit [DBG] from='client.187587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:34 smithi007 bash[22722]: audit 2024-09-14T01:34:33.365859+0000 mgr.a (mgr.14355) 8375 : audit [DBG] from='client.187587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:35 smithi131 bash[24745]: cluster 2024-09-14T01:34:33.989513+0000 mgr.a (mgr.14355) 8376 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:35 smithi171 bash[25040]: cluster 2024-09-14T01:34:33.989513+0000 mgr.a (mgr.14355) 8376 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:35 smithi007 bash[22722]: cluster 2024-09-14T01:34:33.989513+0000 mgr.a (mgr.14355) 8376 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:37 smithi131 bash[24745]: cluster 2024-09-14T01:34:35.991739+0000 mgr.a (mgr.14355) 8377 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:37 smithi171 bash[25040]: cluster 2024-09-14T01:34:35.991739+0000 mgr.a (mgr.14355) 8377 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:37 smithi007 bash[22722]: cluster 2024-09-14T01:34:35.991739+0000 mgr.a (mgr.14355) 8377 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:38.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:38.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:39.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:39.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:39.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:39.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:39.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:39 smithi131 bash[24745]: cluster 2024-09-14T01:34:37.992483+0000 mgr.a (mgr.14355) 8378 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:39 smithi171 bash[25040]: cluster 2024-09-14T01:34:37.992483+0000 mgr.a (mgr.14355) 8378 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:39 smithi007 bash[22722]: cluster 2024-09-14T01:34:37.992483+0000 mgr.a (mgr.14355) 8378 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:40 smithi171 bash[25040]: audit 2024-09-14T01:34:39.145609+0000 mgr.a (mgr.14355) 8379 : audit [DBG] from='client.187665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:40 smithi007 bash[22722]: audit 2024-09-14T01:34:39.145609+0000 mgr.a (mgr.14355) 8379 : audit [DBG] from='client.187665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:40 smithi131 bash[24745]: audit 2024-09-14T01:34:39.145609+0000 mgr.a (mgr.14355) 8379 : audit [DBG] from='client.187665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:41 smithi171 bash[25040]: cluster 2024-09-14T01:34:39.993354+0000 mgr.a (mgr.14355) 8380 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:41 smithi007 bash[22722]: cluster 2024-09-14T01:34:39.993354+0000 mgr.a (mgr.14355) 8380 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:41 smithi131 bash[24745]: cluster 2024-09-14T01:34:39.993354+0000 mgr.a (mgr.14355) 8380 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:43 smithi171 bash[25040]: cluster 2024-09-14T01:34:41.995615+0000 mgr.a (mgr.14355) 8381 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:43 smithi007 bash[22722]: cluster 2024-09-14T01:34:41.995615+0000 mgr.a (mgr.14355) 8381 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:43 smithi131 bash[24745]: cluster 2024-09-14T01:34:41.995615+0000 mgr.a (mgr.14355) 8381 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:34:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:45.348 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:45 smithi171 bash[25040]: cluster 2024-09-14T01:34:43.996359+0000 mgr.a (mgr.14355) 8382 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:45 smithi007 bash[22722]: cluster 2024-09-14T01:34:43.996359+0000 mgr.a (mgr.14355) 8382 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:45 smithi131 bash[24745]: cluster 2024-09-14T01:34:43.996359+0000 mgr.a (mgr.14355) 8382 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:46 smithi007 bash[22722]: audit 2024-09-14T01:34:44.907548+0000 mgr.a (mgr.14355) 8383 : audit [DBG] from='client.187743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:46 smithi131 bash[24745]: audit 2024-09-14T01:34:44.907548+0000 mgr.a (mgr.14355) 8383 : audit [DBG] from='client.187743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:46 smithi171 bash[25040]: audit 2024-09-14T01:34:44.907548+0000 mgr.a (mgr.14355) 8383 : audit [DBG] from='client.187743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:47 smithi007 bash[22722]: cluster 2024-09-14T01:34:45.998681+0000 mgr.a (mgr.14355) 8384 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:34:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:47 smithi131 bash[24745]: cluster 2024-09-14T01:34:45.998681+0000 mgr.a (mgr.14355) 8384 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:34:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:47 smithi171 bash[25040]: cluster 2024-09-14T01:34:45.998681+0000 mgr.a (mgr.14355) 8384 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:34:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:49 smithi007 bash[22722]: cluster 2024-09-14T01:34:47.999449+0000 mgr.a (mgr.14355) 8385 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:49 smithi131 bash[24745]: cluster 2024-09-14T01:34:47.999449+0000 mgr.a (mgr.14355) 8385 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:49 smithi171 bash[25040]: cluster 2024-09-14T01:34:47.999449+0000 mgr.a (mgr.14355) 8385 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:50.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:50.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:50.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:51.096 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:51 smithi007 bash[22722]: cluster 2024-09-14T01:34:50.000200+0000 mgr.a (mgr.14355) 8386 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:51 smithi007 bash[22722]: audit 2024-09-14T01:34:50.680953+0000 mgr.a (mgr.14355) 8387 : audit [DBG] from='client.187818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:51 smithi131 bash[24745]: cluster 2024-09-14T01:34:50.000200+0000 mgr.a (mgr.14355) 8386 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:51 smithi131 bash[24745]: audit 2024-09-14T01:34:50.680953+0000 mgr.a (mgr.14355) 8387 : audit [DBG] from='client.187818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:51 smithi171 bash[25040]: cluster 2024-09-14T01:34:50.000200+0000 mgr.a (mgr.14355) 8386 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:34:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:51 smithi171 bash[25040]: audit 2024-09-14T01:34:50.680953+0000 mgr.a (mgr.14355) 8387 : audit [DBG] from='client.187818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:53 smithi007 bash[22722]: cluster 2024-09-14T01:34:52.002910+0000 mgr.a (mgr.14355) 8388 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:53 smithi131 bash[24745]: cluster 2024-09-14T01:34:52.002910+0000 mgr.a (mgr.14355) 8388 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:53 smithi171 bash[25040]: cluster 2024-09-14T01:34:52.002910+0000 mgr.a (mgr.14355) 8388 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:55 smithi007 bash[22722]: cluster 2024-09-14T01:34:54.003600+0000 mgr.a (mgr.14355) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:55 smithi131 bash[24745]: cluster 2024-09-14T01:34:54.003600+0000 mgr.a (mgr.14355) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:55 smithi171 bash[25040]: cluster 2024-09-14T01:34:54.003600+0000 mgr.a (mgr.14355) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:34:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:34:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:34:56.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:34:56.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:34:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:34:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:34:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:34:56.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:57 smithi007 bash[22722]: cluster 2024-09-14T01:34:56.005555+0000 mgr.a (mgr.14355) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:57 smithi007 bash[22722]: audit 2024-09-14T01:34:56.436544+0000 mgr.a (mgr.14355) 8391 : audit [DBG] from='client.187896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:57 smithi007 bash[22722]: audit 2024-09-14T01:34:56.639038+0000 mon.a (mon.0) 1851 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:57 smithi007 bash[22722]: audit 2024-09-14T01:34:57.215106+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:57 smithi007 bash[22722]: audit 2024-09-14T01:34:57.219212+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:57 smithi131 bash[24745]: cluster 2024-09-14T01:34:56.005555+0000 mgr.a (mgr.14355) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:57 smithi131 bash[24745]: audit 2024-09-14T01:34:56.436544+0000 mgr.a (mgr.14355) 8391 : audit [DBG] from='client.187896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:57 smithi131 bash[24745]: audit 2024-09-14T01:34:56.639038+0000 mon.a (mon.0) 1851 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:57 smithi131 bash[24745]: audit 2024-09-14T01:34:57.215106+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:57 smithi131 bash[24745]: audit 2024-09-14T01:34:57.219212+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:57 smithi171 bash[25040]: cluster 2024-09-14T01:34:56.005555+0000 mgr.a (mgr.14355) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:57 smithi171 bash[25040]: audit 2024-09-14T01:34:56.436544+0000 mgr.a (mgr.14355) 8391 : audit [DBG] from='client.187896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:57 smithi171 bash[25040]: audit 2024-09-14T01:34:56.639038+0000 mon.a (mon.0) 1851 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:57 smithi171 bash[25040]: audit 2024-09-14T01:34:57.215106+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:57 smithi171 bash[25040]: audit 2024-09-14T01:34:57.219212+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22972]: debug 2024-09-14T01:34:58.549+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:34:58.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22972]: debug 2024-09-14T01:34:58.549+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:34:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22722]: audit 2024-09-14T01:34:57.828236+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:34:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22722]: audit 2024-09-14T01:34:57.829897+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:34:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22722]: audit 2024-09-14T01:34:57.839300+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:58 smithi007 bash[22722]: audit 2024-09-14T01:34:57.844192+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:34:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:58 smithi131 bash[24745]: audit 2024-09-14T01:34:57.828236+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:34:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:58 smithi131 bash[24745]: audit 2024-09-14T01:34:57.829897+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:34:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:58 smithi131 bash[24745]: audit 2024-09-14T01:34:57.839300+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:58 smithi131 bash[24745]: audit 2024-09-14T01:34:57.844192+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:34:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:58 smithi171 bash[25040]: audit 2024-09-14T01:34:57.828236+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:34:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:58 smithi171 bash[25040]: audit 2024-09-14T01:34:57.829897+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:34:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:58 smithi171 bash[25040]: audit 2024-09-14T01:34:57.839300+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:34:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:58 smithi171 bash[25040]: audit 2024-09-14T01:34:57.844192+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:34:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:59 smithi007 bash[22722]: audit 2024-09-14T01:34:57.846897+0000 mgr.a (mgr.14355) 8392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:34:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:59 smithi007 bash[22722]: cluster 2024-09-14T01:34:58.006409+0000 mgr.a (mgr.14355) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:34:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:59 smithi007 bash[22722]: audit 2024-09-14T01:34:58.550884+0000 mgr.a (mgr.14355) 8394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:34:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:34:59 smithi007 bash[22722]: cephadm 2024-09-14T01:34:58.552070+0000 mgr.a (mgr.14355) 8395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:35:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:59 smithi131 bash[24745]: audit 2024-09-14T01:34:57.846897+0000 mgr.a (mgr.14355) 8392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:35:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:59 smithi131 bash[24745]: cluster 2024-09-14T01:34:58.006409+0000 mgr.a (mgr.14355) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:35:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:59 smithi131 bash[24745]: audit 2024-09-14T01:34:58.550884+0000 mgr.a (mgr.14355) 8394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:35:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:34:59 smithi131 bash[24745]: cephadm 2024-09-14T01:34:58.552070+0000 mgr.a (mgr.14355) 8395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:35:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:59 smithi171 bash[25040]: audit 2024-09-14T01:34:57.846897+0000 mgr.a (mgr.14355) 8392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:35:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:59 smithi171 bash[25040]: cluster 2024-09-14T01:34:58.006409+0000 mgr.a (mgr.14355) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:35:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:59 smithi171 bash[25040]: audit 2024-09-14T01:34:58.550884+0000 mgr.a (mgr.14355) 8394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:35:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:34:59 smithi171 bash[25040]: cephadm 2024-09-14T01:34:58.552070+0000 mgr.a (mgr.14355) 8395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:35:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:01 smithi131 bash[24745]: cluster 2024-09-14T01:35:00.007126+0000 mgr.a (mgr.14355) 8396 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:35:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:01 smithi171 bash[25040]: cluster 2024-09-14T01:35:00.007126+0000 mgr.a (mgr.14355) 8396 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:35:01.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:01 smithi007 bash[22722]: cluster 2024-09-14T01:35:00.007126+0000 mgr.a (mgr.14355) 8396 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:35:01.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:01.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:02.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:02.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:02.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:02.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:02.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:03 smithi007 bash[22722]: cluster 2024-09-14T01:35:02.008343+0000 mgr.a (mgr.14355) 8397 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:03 smithi007 bash[22722]: audit 2024-09-14T01:35:02.219748+0000 mgr.a (mgr.14355) 8398 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:03 smithi131 bash[24745]: cluster 2024-09-14T01:35:02.008343+0000 mgr.a (mgr.14355) 8397 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:03 smithi131 bash[24745]: audit 2024-09-14T01:35:02.219748+0000 mgr.a (mgr.14355) 8398 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:03 smithi171 bash[25040]: cluster 2024-09-14T01:35:02.008343+0000 mgr.a (mgr.14355) 8397 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:03 smithi171 bash[25040]: audit 2024-09-14T01:35:02.219748+0000 mgr.a (mgr.14355) 8398 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:05 smithi007 bash[22722]: cluster 2024-09-14T01:35:04.009278+0000 mgr.a (mgr.14355) 8399 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:05 smithi131 bash[24745]: cluster 2024-09-14T01:35:04.009278+0000 mgr.a (mgr.14355) 8399 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:05 smithi171 bash[25040]: cluster 2024-09-14T01:35:04.009278+0000 mgr.a (mgr.14355) 8399 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:07.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:07.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:07 smithi007 bash[22722]: cluster 2024-09-14T01:35:06.011575+0000 mgr.a (mgr.14355) 8400 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:07 smithi131 bash[24745]: cluster 2024-09-14T01:35:06.011575+0000 mgr.a (mgr.14355) 8400 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:07 smithi171 bash[25040]: cluster 2024-09-14T01:35:06.011575+0000 mgr.a (mgr.14355) 8400 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:08.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:08.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:08.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:08.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:08.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:09 smithi007 bash[22722]: audit 2024-09-14T01:35:07.970714+0000 mgr.a (mgr.14355) 8401 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:09 smithi007 bash[22722]: cluster 2024-09-14T01:35:08.012312+0000 mgr.a (mgr.14355) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:09 smithi131 bash[24745]: audit 2024-09-14T01:35:07.970714+0000 mgr.a (mgr.14355) 8401 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:09 smithi131 bash[24745]: cluster 2024-09-14T01:35:08.012312+0000 mgr.a (mgr.14355) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:09 smithi171 bash[25040]: audit 2024-09-14T01:35:07.970714+0000 mgr.a (mgr.14355) 8401 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:09 smithi171 bash[25040]: cluster 2024-09-14T01:35:08.012312+0000 mgr.a (mgr.14355) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:11 smithi007 bash[22722]: cluster 2024-09-14T01:35:10.013119+0000 mgr.a (mgr.14355) 8403 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:11 smithi131 bash[24745]: cluster 2024-09-14T01:35:10.013119+0000 mgr.a (mgr.14355) 8403 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:11 smithi171 bash[25040]: cluster 2024-09-14T01:35:10.013119+0000 mgr.a (mgr.14355) 8403 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:13.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:13 smithi007 bash[22722]: cluster 2024-09-14T01:35:12.015380+0000 mgr.a (mgr.14355) 8404 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:13 smithi131 bash[24745]: cluster 2024-09-14T01:35:12.015380+0000 mgr.a (mgr.14355) 8404 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:13 smithi171 bash[25040]: cluster 2024-09-14T01:35:12.015380+0000 mgr.a (mgr.14355) 8404 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:35:14.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:14.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:14.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:14.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:14.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:14 smithi007 bash[22722]: audit 2024-09-14T01:35:13.723621+0000 mgr.a (mgr.14355) 8405 : audit [DBG] from='client.188238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:14 smithi131 bash[24745]: audit 2024-09-14T01:35:13.723621+0000 mgr.a (mgr.14355) 8405 : audit [DBG] from='client.188238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:14 smithi171 bash[25040]: audit 2024-09-14T01:35:13.723621+0000 mgr.a (mgr.14355) 8405 : audit [DBG] from='client.188238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:15.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:15 smithi007 bash[22722]: cluster 2024-09-14T01:35:14.015930+0000 mgr.a (mgr.14355) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:15 smithi131 bash[24745]: cluster 2024-09-14T01:35:14.015930+0000 mgr.a (mgr.14355) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:15 smithi171 bash[25040]: cluster 2024-09-14T01:35:14.015930+0000 mgr.a (mgr.14355) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:17 smithi007 bash[22722]: cluster 2024-09-14T01:35:16.018231+0000 mgr.a (mgr.14355) 8407 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:17 smithi131 bash[24745]: cluster 2024-09-14T01:35:16.018231+0000 mgr.a (mgr.14355) 8407 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:17 smithi171 bash[25040]: cluster 2024-09-14T01:35:16.018231+0000 mgr.a (mgr.14355) 8407 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:19.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:19.913 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:19.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:19 smithi007 bash[22722]: cluster 2024-09-14T01:35:18.019034+0000 mgr.a (mgr.14355) 8408 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:19 smithi131 bash[24745]: cluster 2024-09-14T01:35:18.019034+0000 mgr.a (mgr.14355) 8408 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:20.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:19 smithi171 bash[25040]: cluster 2024-09-14T01:35:18.019034+0000 mgr.a (mgr.14355) 8408 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:20 smithi007 bash[22722]: audit 2024-09-14T01:35:19.492738+0000 mgr.a (mgr.14355) 8409 : audit [DBG] from='client.188316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:20 smithi131 bash[24745]: audit 2024-09-14T01:35:19.492738+0000 mgr.a (mgr.14355) 8409 : audit [DBG] from='client.188316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:20 smithi171 bash[25040]: audit 2024-09-14T01:35:19.492738+0000 mgr.a (mgr.14355) 8409 : audit [DBG] from='client.188316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:21 smithi007 bash[22722]: cluster 2024-09-14T01:35:20.019972+0000 mgr.a (mgr.14355) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:21 smithi131 bash[24745]: cluster 2024-09-14T01:35:20.019972+0000 mgr.a (mgr.14355) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:21 smithi171 bash[25040]: cluster 2024-09-14T01:35:20.019972+0000 mgr.a (mgr.14355) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:23 smithi007 bash[22722]: cluster 2024-09-14T01:35:22.022283+0000 mgr.a (mgr.14355) 8411 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:23 smithi131 bash[24745]: cluster 2024-09-14T01:35:22.022283+0000 mgr.a (mgr.14355) 8411 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:23 smithi171 bash[25040]: cluster 2024-09-14T01:35:22.022283+0000 mgr.a (mgr.14355) 8411 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:24.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:24.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:25.683 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:25 smithi007 bash[22722]: cluster 2024-09-14T01:35:24.023062+0000 mgr.a (mgr.14355) 8412 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:25 smithi131 bash[24745]: cluster 2024-09-14T01:35:24.023062+0000 mgr.a (mgr.14355) 8412 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:25 smithi171 bash[25040]: cluster 2024-09-14T01:35:24.023062+0000 mgr.a (mgr.14355) 8412 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:26 smithi007 bash[22722]: audit 2024-09-14T01:35:25.250003+0000 mgr.a (mgr.14355) 8413 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:26 smithi131 bash[24745]: audit 2024-09-14T01:35:25.250003+0000 mgr.a (mgr.14355) 8413 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:26 smithi171 bash[25040]: audit 2024-09-14T01:35:25.250003+0000 mgr.a (mgr.14355) 8413 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:27 smithi007 bash[22722]: cluster 2024-09-14T01:35:26.025835+0000 mgr.a (mgr.14355) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:27 smithi131 bash[24745]: cluster 2024-09-14T01:35:26.025835+0000 mgr.a (mgr.14355) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:27 smithi171 bash[25040]: cluster 2024-09-14T01:35:26.025835+0000 mgr.a (mgr.14355) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:29 smithi007 bash[22722]: cluster 2024-09-14T01:35:28.026639+0000 mgr.a (mgr.14355) 8415 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:29 smithi131 bash[24745]: cluster 2024-09-14T01:35:28.026639+0000 mgr.a (mgr.14355) 8415 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:29 smithi171 bash[25040]: cluster 2024-09-14T01:35:28.026639+0000 mgr.a (mgr.14355) 8415 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:30.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:30.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:31.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:31.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:31.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:31.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:31.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:31 smithi007 bash[22722]: cluster 2024-09-14T01:35:30.027393+0000 mgr.a (mgr.14355) 8416 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:35:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:31 smithi131 bash[24745]: cluster 2024-09-14T01:35:30.027393+0000 mgr.a (mgr.14355) 8416 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:35:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:31 smithi171 bash[25040]: cluster 2024-09-14T01:35:30.027393+0000 mgr.a (mgr.14355) 8416 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:35:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:32 smithi007 bash[22722]: audit 2024-09-14T01:35:31.020942+0000 mgr.a (mgr.14355) 8417 : audit [DBG] from='client.188466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:32 smithi131 bash[24745]: audit 2024-09-14T01:35:31.020942+0000 mgr.a (mgr.14355) 8417 : audit [DBG] from='client.188466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:32 smithi171 bash[25040]: audit 2024-09-14T01:35:31.020942+0000 mgr.a (mgr.14355) 8417 : audit [DBG] from='client.188466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:33 smithi007 bash[22722]: cluster 2024-09-14T01:35:32.030381+0000 mgr.a (mgr.14355) 8418 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:33 smithi131 bash[24745]: cluster 2024-09-14T01:35:32.030381+0000 mgr.a (mgr.14355) 8418 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:33 smithi171 bash[25040]: cluster 2024-09-14T01:35:32.030381+0000 mgr.a (mgr.14355) 8418 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:35 smithi007 bash[22722]: cluster 2024-09-14T01:35:34.031228+0000 mgr.a (mgr.14355) 8419 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:35 smithi131 bash[24745]: cluster 2024-09-14T01:35:34.031228+0000 mgr.a (mgr.14355) 8419 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:35 smithi171 bash[25040]: cluster 2024-09-14T01:35:34.031228+0000 mgr.a (mgr.14355) 8419 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:35:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:36.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:37.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:37 smithi007 bash[22722]: cluster 2024-09-14T01:35:36.033193+0000 mgr.a (mgr.14355) 8420 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:37 smithi131 bash[24745]: cluster 2024-09-14T01:35:36.033193+0000 mgr.a (mgr.14355) 8420 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:37 smithi171 bash[25040]: cluster 2024-09-14T01:35:36.033193+0000 mgr.a (mgr.14355) 8420 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:38 smithi007 bash[22722]: audit 2024-09-14T01:35:36.790588+0000 mgr.a (mgr.14355) 8421 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:38 smithi131 bash[24745]: audit 2024-09-14T01:35:36.790588+0000 mgr.a (mgr.14355) 8421 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:38 smithi171 bash[25040]: audit 2024-09-14T01:35:36.790588+0000 mgr.a (mgr.14355) 8421 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:39 smithi007 bash[22722]: cluster 2024-09-14T01:35:38.034131+0000 mgr.a (mgr.14355) 8422 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:39 smithi131 bash[24745]: cluster 2024-09-14T01:35:38.034131+0000 mgr.a (mgr.14355) 8422 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:39 smithi171 bash[25040]: cluster 2024-09-14T01:35:38.034131+0000 mgr.a (mgr.14355) 8422 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:41 smithi007 bash[22722]: cluster 2024-09-14T01:35:40.034925+0000 mgr.a (mgr.14355) 8423 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:41 smithi131 bash[24745]: cluster 2024-09-14T01:35:40.034925+0000 mgr.a (mgr.14355) 8423 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:41 smithi171 bash[25040]: cluster 2024-09-14T01:35:40.034925+0000 mgr.a (mgr.14355) 8423 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:42.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:42.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:42.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:42.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:43 smithi131 bash[24745]: cluster 2024-09-14T01:35:42.037107+0000 mgr.a (mgr.14355) 8424 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:43 smithi131 bash[24745]: audit 2024-09-14T01:35:42.547389+0000 mgr.a (mgr.14355) 8425 : audit [DBG] from='client.188616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:43 smithi171 bash[25040]: cluster 2024-09-14T01:35:42.037107+0000 mgr.a (mgr.14355) 8424 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:43 smithi171 bash[25040]: audit 2024-09-14T01:35:42.547389+0000 mgr.a (mgr.14355) 8425 : audit [DBG] from='client.188616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:43 smithi007 bash[22722]: cluster 2024-09-14T01:35:42.037107+0000 mgr.a (mgr.14355) 8424 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:43 smithi007 bash[22722]: audit 2024-09-14T01:35:42.547389+0000 mgr.a (mgr.14355) 8425 : audit [DBG] from='client.188616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:45 smithi131 bash[24745]: cluster 2024-09-14T01:35:44.038230+0000 mgr.a (mgr.14355) 8426 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:46.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:45 smithi171 bash[25040]: cluster 2024-09-14T01:35:44.038230+0000 mgr.a (mgr.14355) 8426 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:45 smithi007 bash[22722]: cluster 2024-09-14T01:35:44.038230+0000 mgr.a (mgr.14355) 8426 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:47.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:47.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:47 smithi131 bash[24745]: cluster 2024-09-14T01:35:46.040612+0000 mgr.a (mgr.14355) 8427 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:47 smithi171 bash[25040]: cluster 2024-09-14T01:35:46.040612+0000 mgr.a (mgr.14355) 8427 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:47 smithi007 bash[22722]: cluster 2024-09-14T01:35:46.040612+0000 mgr.a (mgr.14355) 8427 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:48.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:48.715 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:49 smithi131 bash[24745]: cluster 2024-09-14T01:35:48.041531+0000 mgr.a (mgr.14355) 8428 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:49 smithi131 bash[24745]: audit 2024-09-14T01:35:48.305116+0000 mgr.a (mgr.14355) 8429 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:49 smithi171 bash[25040]: cluster 2024-09-14T01:35:48.041531+0000 mgr.a (mgr.14355) 8428 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:49 smithi171 bash[25040]: audit 2024-09-14T01:35:48.305116+0000 mgr.a (mgr.14355) 8429 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:49 smithi007 bash[22722]: cluster 2024-09-14T01:35:48.041531+0000 mgr.a (mgr.14355) 8428 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:49 smithi007 bash[22722]: audit 2024-09-14T01:35:48.305116+0000 mgr.a (mgr.14355) 8429 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:51 smithi131 bash[24745]: cluster 2024-09-14T01:35:50.042648+0000 mgr.a (mgr.14355) 8430 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:51 smithi171 bash[25040]: cluster 2024-09-14T01:35:50.042648+0000 mgr.a (mgr.14355) 8430 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:51 smithi007 bash[22722]: cluster 2024-09-14T01:35:50.042648+0000 mgr.a (mgr.14355) 8430 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:53.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:35:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:53 smithi131 bash[24745]: cluster 2024-09-14T01:35:52.045085+0000 mgr.a (mgr.14355) 8431 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:53 smithi171 bash[25040]: cluster 2024-09-14T01:35:52.045085+0000 mgr.a (mgr.14355) 8431 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:53 smithi007 bash[22722]: cluster 2024-09-14T01:35:52.045085+0000 mgr.a (mgr.14355) 8431 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:54.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:35:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:35:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:35:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:35:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:35:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:55 smithi131 bash[24745]: audit 2024-09-14T01:35:54.046762+0000 mgr.a (mgr.14355) 8432 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:55 smithi131 bash[24745]: cluster 2024-09-14T01:35:54.047384+0000 mgr.a (mgr.14355) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:55 smithi171 bash[25040]: audit 2024-09-14T01:35:54.046762+0000 mgr.a (mgr.14355) 8432 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:55 smithi171 bash[25040]: cluster 2024-09-14T01:35:54.047384+0000 mgr.a (mgr.14355) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:55 smithi007 bash[22722]: audit 2024-09-14T01:35:54.046762+0000 mgr.a (mgr.14355) 8432 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:35:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:55 smithi007 bash[22722]: cluster 2024-09-14T01:35:54.047384+0000 mgr.a (mgr.14355) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:35:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:57 smithi131 bash[24745]: cluster 2024-09-14T01:35:56.049713+0000 mgr.a (mgr.14355) 8434 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:57 smithi171 bash[25040]: cluster 2024-09-14T01:35:56.049713+0000 mgr.a (mgr.14355) 8434 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:57 smithi007 bash[22722]: cluster 2024-09-14T01:35:56.049713+0000 mgr.a (mgr.14355) 8434 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:35:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:58 smithi131 bash[24745]: audit 2024-09-14T01:35:58.603147+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:35:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:58 smithi171 bash[25040]: audit 2024-09-14T01:35:58.603147+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:35:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:58 smithi007 bash[22722]: audit 2024-09-14T01:35:58.603147+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:35:59.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:35:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:35:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:59 smithi131 bash[24745]: cluster 2024-09-14T01:35:58.050524+0000 mgr.a (mgr.14355) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:59 smithi131 bash[24745]: audit 2024-09-14T01:35:59.213017+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:59 smithi131 bash[24745]: audit 2024-09-14T01:35:59.218051+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:59 smithi131 bash[24745]: audit 2024-09-14T01:35:59.223432+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:35:59 smithi131 bash[24745]: audit 2024-09-14T01:35:59.226904+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:59 smithi171 bash[25040]: cluster 2024-09-14T01:35:58.050524+0000 mgr.a (mgr.14355) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:59 smithi171 bash[25040]: audit 2024-09-14T01:35:59.213017+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:59 smithi171 bash[25040]: audit 2024-09-14T01:35:59.218051+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:59 smithi171 bash[25040]: audit 2024-09-14T01:35:59.223432+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:35:59 smithi171 bash[25040]: audit 2024-09-14T01:35:59.226904+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:59 smithi007 bash[22722]: cluster 2024-09-14T01:35:58.050524+0000 mgr.a (mgr.14355) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:59 smithi007 bash[22722]: audit 2024-09-14T01:35:59.213017+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:59 smithi007 bash[22722]: audit 2024-09-14T01:35:59.218051+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:59 smithi007 bash[22722]: audit 2024-09-14T01:35:59.223432+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:35:59 smithi007 bash[22722]: audit 2024-09-14T01:35:59.226904+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:00.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:00.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:35:59.807308+0000 mgr.a (mgr.14355) 8436 : audit [DBG] from='client.188850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:36:00.014884+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:36:00.016055+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:36:00.021732+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:36:00.024353+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: audit 2024-09-14T01:36:00.034287+0000 mgr.a (mgr.14355) 8437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:00 smithi131 bash[24745]: cluster 2024-09-14T01:36:00.050996+0000 mgr.a (mgr.14355) 8438 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:35:59.807308+0000 mgr.a (mgr.14355) 8436 : audit [DBG] from='client.188850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:36:00.014884+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:36:00.016055+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:36:00.021732+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:36:00.024353+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: audit 2024-09-14T01:36:00.034287+0000 mgr.a (mgr.14355) 8437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:00 smithi171 bash[25040]: cluster 2024-09-14T01:36:00.050996+0000 mgr.a (mgr.14355) 8438 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:01.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22972]: debug 2024-09-14T01:36:00.904+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:36:01.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22972]: debug 2024-09-14T01:36:00.904+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:35:59.807308+0000 mgr.a (mgr.14355) 8436 : audit [DBG] from='client.188850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:36:00.014884+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:36:00.016055+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:36:00.021732+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:36:00.024353+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: audit 2024-09-14T01:36:00.034287+0000 mgr.a (mgr.14355) 8437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:36:01.207 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:00 smithi007 bash[22722]: cluster 2024-09-14T01:36:00.050996+0000 mgr.a (mgr.14355) 8438 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:02 smithi131 bash[24745]: audit 2024-09-14T01:36:00.907177+0000 mgr.a (mgr.14355) 8439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:36:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:02 smithi131 bash[24745]: cephadm 2024-09-14T01:36:00.908354+0000 mgr.a (mgr.14355) 8440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:36:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:02 smithi171 bash[25040]: audit 2024-09-14T01:36:00.907177+0000 mgr.a (mgr.14355) 8439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:36:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:02 smithi171 bash[25040]: cephadm 2024-09-14T01:36:00.908354+0000 mgr.a (mgr.14355) 8440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:36:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:02 smithi007 bash[22722]: audit 2024-09-14T01:36:00.907177+0000 mgr.a (mgr.14355) 8439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:36:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:02 smithi007 bash[22722]: cephadm 2024-09-14T01:36:00.908354+0000 mgr.a (mgr.14355) 8440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:36:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:03 smithi171 bash[25040]: cluster 2024-09-14T01:36:02.053722+0000 mgr.a (mgr.14355) 8441 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T01:36:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:03 smithi007 bash[22722]: cluster 2024-09-14T01:36:02.053722+0000 mgr.a (mgr.14355) 8441 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T01:36:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:03 smithi131 bash[24745]: cluster 2024-09-14T01:36:02.053722+0000 mgr.a (mgr.14355) 8441 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T01:36:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:05 smithi007 bash[22722]: cluster 2024-09-14T01:36:04.054525+0000 mgr.a (mgr.14355) 8442 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:36:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:05 smithi131 bash[24745]: cluster 2024-09-14T01:36:04.054525+0000 mgr.a (mgr.14355) 8442 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:36:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:05 smithi171 bash[25040]: cluster 2024-09-14T01:36:04.054525+0000 mgr.a (mgr.14355) 8442 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:36:05.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:06 smithi007 bash[22722]: audit 2024-09-14T01:36:05.554363+0000 mgr.a (mgr.14355) 8443 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:06 smithi131 bash[24745]: audit 2024-09-14T01:36:05.554363+0000 mgr.a (mgr.14355) 8443 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:06 smithi171 bash[25040]: audit 2024-09-14T01:36:05.554363+0000 mgr.a (mgr.14355) 8443 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:07 smithi007 bash[22722]: cluster 2024-09-14T01:36:06.055893+0000 mgr.a (mgr.14355) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:07 smithi131 bash[24745]: cluster 2024-09-14T01:36:06.055893+0000 mgr.a (mgr.14355) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:07 smithi171 bash[25040]: cluster 2024-09-14T01:36:06.055893+0000 mgr.a (mgr.14355) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:09 smithi007 bash[22722]: cluster 2024-09-14T01:36:08.056608+0000 mgr.a (mgr.14355) 8445 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:09 smithi131 bash[24745]: cluster 2024-09-14T01:36:08.056608+0000 mgr.a (mgr.14355) 8445 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:09 smithi171 bash[25040]: cluster 2024-09-14T01:36:08.056608+0000 mgr.a (mgr.14355) 8445 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:10.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:10.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:11.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:11.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:11.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:11 smithi131 bash[24745]: cluster 2024-09-14T01:36:10.057389+0000 mgr.a (mgr.14355) 8446 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:11 smithi171 bash[25040]: cluster 2024-09-14T01:36:10.057389+0000 mgr.a (mgr.14355) 8446 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:11 smithi007 bash[22722]: cluster 2024-09-14T01:36:10.057389+0000 mgr.a (mgr.14355) 8446 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:12 smithi131 bash[24745]: audit 2024-09-14T01:36:11.308206+0000 mgr.a (mgr.14355) 8447 : audit [DBG] from='client.79546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:12 smithi171 bash[25040]: audit 2024-09-14T01:36:11.308206+0000 mgr.a (mgr.14355) 8447 : audit [DBG] from='client.79546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:12 smithi007 bash[22722]: audit 2024-09-14T01:36:11.308206+0000 mgr.a (mgr.14355) 8447 : audit [DBG] from='client.79546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:13 smithi131 bash[24745]: cluster 2024-09-14T01:36:12.060194+0000 mgr.a (mgr.14355) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:13 smithi171 bash[25040]: cluster 2024-09-14T01:36:12.060194+0000 mgr.a (mgr.14355) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:13 smithi007 bash[22722]: cluster 2024-09-14T01:36:12.060194+0000 mgr.a (mgr.14355) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:36:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:15 smithi131 bash[24745]: cluster 2024-09-14T01:36:14.061135+0000 mgr.a (mgr.14355) 8449 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T01:36:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:15 smithi171 bash[25040]: cluster 2024-09-14T01:36:14.061135+0000 mgr.a (mgr.14355) 8449 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T01:36:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:15 smithi007 bash[22722]: cluster 2024-09-14T01:36:14.061135+0000 mgr.a (mgr.14355) 8449 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T01:36:16.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:16.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:17.485 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:17.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:17 smithi131 bash[24745]: cluster 2024-09-14T01:36:16.063229+0000 mgr.a (mgr.14355) 8450 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:17 smithi171 bash[25040]: cluster 2024-09-14T01:36:16.063229+0000 mgr.a (mgr.14355) 8450 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:17 smithi007 bash[22722]: cluster 2024-09-14T01:36:16.063229+0000 mgr.a (mgr.14355) 8450 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:36:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:18 smithi131 bash[24745]: audit 2024-09-14T01:36:17.047256+0000 mgr.a (mgr.14355) 8451 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:18 smithi171 bash[25040]: audit 2024-09-14T01:36:17.047256+0000 mgr.a (mgr.14355) 8451 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:18 smithi007 bash[22722]: audit 2024-09-14T01:36:17.047256+0000 mgr.a (mgr.14355) 8451 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:19 smithi131 bash[24745]: cluster 2024-09-14T01:36:18.064203+0000 mgr.a (mgr.14355) 8452 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:19 smithi171 bash[25040]: cluster 2024-09-14T01:36:18.064203+0000 mgr.a (mgr.14355) 8452 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:19 smithi007 bash[22722]: cluster 2024-09-14T01:36:18.064203+0000 mgr.a (mgr.14355) 8452 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:21 smithi131 bash[24745]: cluster 2024-09-14T01:36:20.064989+0000 mgr.a (mgr.14355) 8453 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:21 smithi171 bash[25040]: cluster 2024-09-14T01:36:20.064989+0000 mgr.a (mgr.14355) 8453 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:21 smithi007 bash[22722]: cluster 2024-09-14T01:36:20.064989+0000 mgr.a (mgr.14355) 8453 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:23.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:23.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:23 smithi131 bash[24745]: cluster 2024-09-14T01:36:22.067226+0000 mgr.a (mgr.14355) 8454 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:23 smithi171 bash[25040]: cluster 2024-09-14T01:36:22.067226+0000 mgr.a (mgr.14355) 8454 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:23 smithi007 bash[22722]: cluster 2024-09-14T01:36:22.067226+0000 mgr.a (mgr.14355) 8454 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:24 smithi131 bash[24745]: audit 2024-09-14T01:36:22.820776+0000 mgr.a (mgr.14355) 8455 : audit [DBG] from='client.189270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:24 smithi171 bash[25040]: audit 2024-09-14T01:36:22.820776+0000 mgr.a (mgr.14355) 8455 : audit [DBG] from='client.189270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:24 smithi007 bash[22722]: audit 2024-09-14T01:36:22.820776+0000 mgr.a (mgr.14355) 8455 : audit [DBG] from='client.189270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:25 smithi131 bash[24745]: cluster 2024-09-14T01:36:24.068325+0000 mgr.a (mgr.14355) 8456 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:25 smithi171 bash[25040]: cluster 2024-09-14T01:36:24.068325+0000 mgr.a (mgr.14355) 8456 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:25 smithi007 bash[22722]: cluster 2024-09-14T01:36:24.068325+0000 mgr.a (mgr.14355) 8456 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:27 smithi131 bash[24745]: cluster 2024-09-14T01:36:26.070731+0000 mgr.a (mgr.14355) 8457 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:27 smithi171 bash[25040]: cluster 2024-09-14T01:36:26.070731+0000 mgr.a (mgr.14355) 8457 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:27 smithi007 bash[22722]: cluster 2024-09-14T01:36:26.070731+0000 mgr.a (mgr.14355) 8457 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:28.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:28.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:29.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:29.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:29 smithi131 bash[24745]: cluster 2024-09-14T01:36:28.071683+0000 mgr.a (mgr.14355) 8458 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:29 smithi131 bash[24745]: audit 2024-09-14T01:36:28.583719+0000 mgr.a (mgr.14355) 8459 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:29 smithi171 bash[25040]: cluster 2024-09-14T01:36:28.071683+0000 mgr.a (mgr.14355) 8458 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:29 smithi171 bash[25040]: audit 2024-09-14T01:36:28.583719+0000 mgr.a (mgr.14355) 8459 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:29 smithi007 bash[22722]: cluster 2024-09-14T01:36:28.071683+0000 mgr.a (mgr.14355) 8458 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:29 smithi007 bash[22722]: audit 2024-09-14T01:36:28.583719+0000 mgr.a (mgr.14355) 8459 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:31 smithi131 bash[24745]: cluster 2024-09-14T01:36:30.072607+0000 mgr.a (mgr.14355) 8460 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:31 smithi171 bash[25040]: cluster 2024-09-14T01:36:30.072607+0000 mgr.a (mgr.14355) 8460 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:31 smithi007 bash[22722]: cluster 2024-09-14T01:36:30.072607+0000 mgr.a (mgr.14355) 8460 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:33 smithi131 bash[24745]: cluster 2024-09-14T01:36:32.074872+0000 mgr.a (mgr.14355) 8461 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:33 smithi171 bash[25040]: cluster 2024-09-14T01:36:32.074872+0000 mgr.a (mgr.14355) 8461 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:33 smithi007 bash[22722]: cluster 2024-09-14T01:36:32.074872+0000 mgr.a (mgr.14355) 8461 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:34.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:34.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:34.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:35 smithi131 bash[24745]: cluster 2024-09-14T01:36:34.075418+0000 mgr.a (mgr.14355) 8462 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:35 smithi131 bash[24745]: audit 2024-09-14T01:36:34.364467+0000 mgr.a (mgr.14355) 8463 : audit [DBG] from='client.189423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:35 smithi171 bash[25040]: cluster 2024-09-14T01:36:34.075418+0000 mgr.a (mgr.14355) 8462 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:35 smithi171 bash[25040]: audit 2024-09-14T01:36:34.364467+0000 mgr.a (mgr.14355) 8463 : audit [DBG] from='client.189423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:35 smithi007 bash[22722]: cluster 2024-09-14T01:36:34.075418+0000 mgr.a (mgr.14355) 8462 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:35 smithi007 bash[22722]: audit 2024-09-14T01:36:34.364467+0000 mgr.a (mgr.14355) 8463 : audit [DBG] from='client.189423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:37 smithi171 bash[25040]: cluster 2024-09-14T01:36:36.077719+0000 mgr.a (mgr.14355) 8464 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:37 smithi007 bash[22722]: cluster 2024-09-14T01:36:36.077719+0000 mgr.a (mgr.14355) 8464 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:37 smithi131 bash[24745]: cluster 2024-09-14T01:36:36.077719+0000 mgr.a (mgr.14355) 8464 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:39 smithi171 bash[25040]: cluster 2024-09-14T01:36:38.078530+0000 mgr.a (mgr.14355) 8465 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:39.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:39 smithi007 bash[22722]: cluster 2024-09-14T01:36:38.078530+0000 mgr.a (mgr.14355) 8465 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:39 smithi131 bash[24745]: cluster 2024-09-14T01:36:38.078530+0000 mgr.a (mgr.14355) 8465 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:40.544 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:40.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:41 smithi171 bash[25040]: cluster 2024-09-14T01:36:40.079254+0000 mgr.a (mgr.14355) 8466 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:41 smithi171 bash[25040]: audit 2024-09-14T01:36:40.140942+0000 mgr.a (mgr.14355) 8467 : audit [DBG] from='client.189495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:41 smithi007 bash[22722]: cluster 2024-09-14T01:36:40.079254+0000 mgr.a (mgr.14355) 8466 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:41 smithi007 bash[22722]: audit 2024-09-14T01:36:40.140942+0000 mgr.a (mgr.14355) 8467 : audit [DBG] from='client.189495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:41 smithi131 bash[24745]: cluster 2024-09-14T01:36:40.079254+0000 mgr.a (mgr.14355) 8466 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:41 smithi131 bash[24745]: audit 2024-09-14T01:36:40.140942+0000 mgr.a (mgr.14355) 8467 : audit [DBG] from='client.189495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:43 smithi171 bash[25040]: cluster 2024-09-14T01:36:42.082051+0000 mgr.a (mgr.14355) 8468 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:36:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:43 smithi007 bash[22722]: cluster 2024-09-14T01:36:42.082051+0000 mgr.a (mgr.14355) 8468 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:36:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:43 smithi131 bash[24745]: cluster 2024-09-14T01:36:42.082051+0000 mgr.a (mgr.14355) 8468 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:36:45.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:45.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:45 smithi007 bash[22722]: cluster 2024-09-14T01:36:44.083058+0000 mgr.a (mgr.14355) 8469 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:36:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:45 smithi131 bash[24745]: cluster 2024-09-14T01:36:44.083058+0000 mgr.a (mgr.14355) 8469 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:36:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:45 smithi171 bash[25040]: cluster 2024-09-14T01:36:44.083058+0000 mgr.a (mgr.14355) 8469 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:36:46.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:46.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:46.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:46.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:46.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:47 smithi007 bash[22722]: audit 2024-09-14T01:36:45.874609+0000 mgr.a (mgr.14355) 8470 : audit [DBG] from='client.189573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:47 smithi007 bash[22722]: cluster 2024-09-14T01:36:46.084320+0000 mgr.a (mgr.14355) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:47 smithi131 bash[24745]: audit 2024-09-14T01:36:45.874609+0000 mgr.a (mgr.14355) 8470 : audit [DBG] from='client.189573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:47 smithi131 bash[24745]: cluster 2024-09-14T01:36:46.084320+0000 mgr.a (mgr.14355) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:47 smithi171 bash[25040]: audit 2024-09-14T01:36:45.874609+0000 mgr.a (mgr.14355) 8470 : audit [DBG] from='client.189573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:47 smithi171 bash[25040]: cluster 2024-09-14T01:36:46.084320+0000 mgr.a (mgr.14355) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:49 smithi007 bash[22722]: cluster 2024-09-14T01:36:48.085346+0000 mgr.a (mgr.14355) 8472 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:36:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:49 smithi131 bash[24745]: cluster 2024-09-14T01:36:48.085346+0000 mgr.a (mgr.14355) 8472 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:36:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:49 smithi171 bash[25040]: cluster 2024-09-14T01:36:48.085346+0000 mgr.a (mgr.14355) 8472 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:36:51.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:51.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:51 smithi007 bash[22722]: cluster 2024-09-14T01:36:50.086166+0000 mgr.a (mgr.14355) 8473 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:36:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:51 smithi131 bash[24745]: cluster 2024-09-14T01:36:50.086166+0000 mgr.a (mgr.14355) 8473 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:36:52.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:52.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:51 smithi171 bash[25040]: cluster 2024-09-14T01:36:50.086166+0000 mgr.a (mgr.14355) 8473 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:36:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:52 smithi007 bash[22722]: audit 2024-09-14T01:36:51.620492+0000 mgr.a (mgr.14355) 8474 : audit [DBG] from='client.189651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:52 smithi131 bash[24745]: audit 2024-09-14T01:36:51.620492+0000 mgr.a (mgr.14355) 8474 : audit [DBG] from='client.189651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:52 smithi171 bash[25040]: audit 2024-09-14T01:36:51.620492+0000 mgr.a (mgr.14355) 8474 : audit [DBG] from='client.189651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:53 smithi007 bash[22722]: cluster 2024-09-14T01:36:52.087475+0000 mgr.a (mgr.14355) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:53 smithi131 bash[24745]: cluster 2024-09-14T01:36:52.087475+0000 mgr.a (mgr.14355) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:53 smithi171 bash[25040]: cluster 2024-09-14T01:36:52.087475+0000 mgr.a (mgr.14355) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:36:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:55 smithi007 bash[22722]: cluster 2024-09-14T01:36:54.088243+0000 mgr.a (mgr.14355) 8476 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:36:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:55 smithi131 bash[24745]: cluster 2024-09-14T01:36:54.088243+0000 mgr.a (mgr.14355) 8476 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:36:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:55 smithi171 bash[25040]: cluster 2024-09-14T01:36:54.088243+0000 mgr.a (mgr.14355) 8476 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:36:57.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:36:57.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:36:57.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:36:57.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:36:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:36:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:36:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:36:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:36:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:57 smithi007 bash[22722]: cluster 2024-09-14T01:36:56.090263+0000 mgr.a (mgr.14355) 8477 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:57 smithi131 bash[24745]: cluster 2024-09-14T01:36:56.090263+0000 mgr.a (mgr.14355) 8477 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:57 smithi171 bash[25040]: cluster 2024-09-14T01:36:56.090263+0000 mgr.a (mgr.14355) 8477 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:36:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:58 smithi007 bash[22722]: audit 2024-09-14T01:36:57.371559+0000 mgr.a (mgr.14355) 8478 : audit [DBG] from='client.189726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:58 smithi131 bash[24745]: audit 2024-09-14T01:36:57.371559+0000 mgr.a (mgr.14355) 8478 : audit [DBG] from='client.189726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:58 smithi171 bash[25040]: audit 2024-09-14T01:36:57.371559+0000 mgr.a (mgr.14355) 8478 : audit [DBG] from='client.189726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:36:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:36:59 smithi007 bash[22722]: cluster 2024-09-14T01:36:58.091253+0000 mgr.a (mgr.14355) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:36:59 smithi131 bash[24745]: cluster 2024-09-14T01:36:58.091253+0000 mgr.a (mgr.14355) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:36:59 smithi171 bash[25040]: cluster 2024-09-14T01:36:58.091253+0000 mgr.a (mgr.14355) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:01 smithi007 bash[22722]: cluster 2024-09-14T01:37:00.092202+0000 mgr.a (mgr.14355) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:01 smithi007 bash[22722]: audit 2024-09-14T01:37:00.959762+0000 mon.a (mon.0) 1867 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:37:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:01 smithi131 bash[24745]: cluster 2024-09-14T01:37:00.092202+0000 mgr.a (mgr.14355) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:01 smithi131 bash[24745]: audit 2024-09-14T01:37:00.959762+0000 mon.a (mon.0) 1867 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:37:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:01 smithi171 bash[25040]: cluster 2024-09-14T01:37:00.092202+0000 mgr.a (mgr.14355) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:01 smithi171 bash[25040]: audit 2024-09-14T01:37:00.959762+0000 mon.a (mon.0) 1867 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:37:02.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:02.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:02.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:02.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22972]: debug 2024-09-14T01:37:02.583+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:37:02.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22972]: debug 2024-09-14T01:37:02.583+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:37:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22722]: audit 2024-09-14T01:37:01.824704+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:37:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22722]: audit 2024-09-14T01:37:01.826441+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:37:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22722]: audit 2024-09-14T01:37:01.837002+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:37:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:02 smithi007 bash[22722]: audit 2024-09-14T01:37:01.841794+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:02 smithi131 bash[24745]: audit 2024-09-14T01:37:01.824704+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:02 smithi131 bash[24745]: audit 2024-09-14T01:37:01.826441+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:02 smithi131 bash[24745]: audit 2024-09-14T01:37:01.837002+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:02 smithi131 bash[24745]: audit 2024-09-14T01:37:01.841794+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:02 smithi171 bash[25040]: audit 2024-09-14T01:37:01.824704+0000 mon.a (mon.0) 1868 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:37:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:02 smithi171 bash[25040]: audit 2024-09-14T01:37:01.826441+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:37:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:02 smithi171 bash[25040]: audit 2024-09-14T01:37:01.837002+0000 mon.a (mon.0) 1870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:37:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:02 smithi171 bash[25040]: audit 2024-09-14T01:37:01.841794+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:03.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:03.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:03 smithi007 bash[22722]: audit 2024-09-14T01:37:01.844012+0000 mgr.a (mgr.14355) 8481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:03 smithi007 bash[22722]: cluster 2024-09-14T01:37:02.093586+0000 mgr.a (mgr.14355) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:03 smithi007 bash[22722]: audit 2024-09-14T01:37:02.587144+0000 mgr.a (mgr.14355) 8483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:37:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:03 smithi007 bash[22722]: cephadm 2024-09-14T01:37:02.588710+0000 mgr.a (mgr.14355) 8484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:37:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:03 smithi131 bash[24745]: audit 2024-09-14T01:37:01.844012+0000 mgr.a (mgr.14355) 8481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:03 smithi131 bash[24745]: cluster 2024-09-14T01:37:02.093586+0000 mgr.a (mgr.14355) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:03 smithi131 bash[24745]: audit 2024-09-14T01:37:02.587144+0000 mgr.a (mgr.14355) 8483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:37:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:03 smithi131 bash[24745]: cephadm 2024-09-14T01:37:02.588710+0000 mgr.a (mgr.14355) 8484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:37:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:03 smithi171 bash[25040]: audit 2024-09-14T01:37:01.844012+0000 mgr.a (mgr.14355) 8481 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:37:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:03 smithi171 bash[25040]: cluster 2024-09-14T01:37:02.093586+0000 mgr.a (mgr.14355) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:03 smithi171 bash[25040]: audit 2024-09-14T01:37:02.587144+0000 mgr.a (mgr.14355) 8483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:37:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:03 smithi171 bash[25040]: cephadm 2024-09-14T01:37:02.588710+0000 mgr.a (mgr.14355) 8484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:37:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:04 smithi007 bash[22722]: audit 2024-09-14T01:37:03.117873+0000 mgr.a (mgr.14355) 8485 : audit [DBG] from='client.189912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:04 smithi131 bash[24745]: audit 2024-09-14T01:37:03.117873+0000 mgr.a (mgr.14355) 8485 : audit [DBG] from='client.189912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:04 smithi171 bash[25040]: audit 2024-09-14T01:37:03.117873+0000 mgr.a (mgr.14355) 8485 : audit [DBG] from='client.189912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:05 smithi007 bash[22722]: cluster 2024-09-14T01:37:04.094673+0000 mgr.a (mgr.14355) 8486 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:05 smithi131 bash[24745]: cluster 2024-09-14T01:37:04.094673+0000 mgr.a (mgr.14355) 8486 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:05 smithi171 bash[25040]: cluster 2024-09-14T01:37:04.094673+0000 mgr.a (mgr.14355) 8486 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:07 smithi007 bash[22722]: cluster 2024-09-14T01:37:06.097095+0000 mgr.a (mgr.14355) 8487 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:07 smithi131 bash[24745]: cluster 2024-09-14T01:37:06.097095+0000 mgr.a (mgr.14355) 8487 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:07 smithi171 bash[25040]: cluster 2024-09-14T01:37:06.097095+0000 mgr.a (mgr.14355) 8487 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:08.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:08.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:09.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:09 smithi007 bash[22722]: cluster 2024-09-14T01:37:08.098057+0000 mgr.a (mgr.14355) 8488 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:09 smithi131 bash[24745]: cluster 2024-09-14T01:37:08.098057+0000 mgr.a (mgr.14355) 8488 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:09 smithi171 bash[25040]: cluster 2024-09-14T01:37:08.098057+0000 mgr.a (mgr.14355) 8488 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:10 smithi007 bash[22722]: audit 2024-09-14T01:37:08.880942+0000 mgr.a (mgr.14355) 8489 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:10 smithi131 bash[24745]: audit 2024-09-14T01:37:08.880942+0000 mgr.a (mgr.14355) 8489 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:10 smithi171 bash[25040]: audit 2024-09-14T01:37:08.880942+0000 mgr.a (mgr.14355) 8489 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:11 smithi007 bash[22722]: cluster 2024-09-14T01:37:10.099048+0000 mgr.a (mgr.14355) 8490 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:11 smithi131 bash[24745]: cluster 2024-09-14T01:37:10.099048+0000 mgr.a (mgr.14355) 8490 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:11 smithi171 bash[25040]: cluster 2024-09-14T01:37:10.099048+0000 mgr.a (mgr.14355) 8490 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:13 smithi007 bash[22722]: cluster 2024-09-14T01:37:12.101327+0000 mgr.a (mgr.14355) 8491 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:13 smithi131 bash[24745]: cluster 2024-09-14T01:37:12.101327+0000 mgr.a (mgr.14355) 8491 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:13 smithi171 bash[25040]: cluster 2024-09-14T01:37:12.101327+0000 mgr.a (mgr.14355) 8491 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:14.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:15.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:15.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:15 smithi007 bash[22722]: cluster 2024-09-14T01:37:14.102116+0000 mgr.a (mgr.14355) 8492 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:15 smithi007 bash[22722]: audit 2024-09-14T01:37:14.637075+0000 mgr.a (mgr.14355) 8493 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:15 smithi131 bash[24745]: cluster 2024-09-14T01:37:14.102116+0000 mgr.a (mgr.14355) 8492 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:15 smithi131 bash[24745]: audit 2024-09-14T01:37:14.637075+0000 mgr.a (mgr.14355) 8493 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:15 smithi171 bash[25040]: cluster 2024-09-14T01:37:14.102116+0000 mgr.a (mgr.14355) 8492 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:15 smithi171 bash[25040]: audit 2024-09-14T01:37:14.637075+0000 mgr.a (mgr.14355) 8493 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:17 smithi007 bash[22722]: cluster 2024-09-14T01:37:16.104475+0000 mgr.a (mgr.14355) 8494 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:17 smithi131 bash[24745]: cluster 2024-09-14T01:37:16.104475+0000 mgr.a (mgr.14355) 8494 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:17 smithi171 bash[25040]: cluster 2024-09-14T01:37:16.104475+0000 mgr.a (mgr.14355) 8494 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:37:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:19 smithi007 bash[22722]: cluster 2024-09-14T01:37:18.105248+0000 mgr.a (mgr.14355) 8495 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:19 smithi131 bash[24745]: cluster 2024-09-14T01:37:18.105248+0000 mgr.a (mgr.14355) 8495 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:19 smithi171 bash[25040]: cluster 2024-09-14T01:37:18.105248+0000 mgr.a (mgr.14355) 8495 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:20.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:20.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:20.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:20.862 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:21 smithi007 bash[22722]: cluster 2024-09-14T01:37:20.105898+0000 mgr.a (mgr.14355) 8496 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:21 smithi007 bash[22722]: audit 2024-09-14T01:37:20.417703+0000 mgr.a (mgr.14355) 8497 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:21 smithi131 bash[24745]: cluster 2024-09-14T01:37:20.105898+0000 mgr.a (mgr.14355) 8496 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:21 smithi131 bash[24745]: audit 2024-09-14T01:37:20.417703+0000 mgr.a (mgr.14355) 8497 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:21 smithi171 bash[25040]: cluster 2024-09-14T01:37:20.105898+0000 mgr.a (mgr.14355) 8496 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:21 smithi171 bash[25040]: audit 2024-09-14T01:37:20.417703+0000 mgr.a (mgr.14355) 8497 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:23 smithi007 bash[22722]: cluster 2024-09-14T01:37:22.108646+0000 mgr.a (mgr.14355) 8498 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:23 smithi131 bash[24745]: cluster 2024-09-14T01:37:22.108646+0000 mgr.a (mgr.14355) 8498 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:23 smithi171 bash[25040]: cluster 2024-09-14T01:37:22.108646+0000 mgr.a (mgr.14355) 8498 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:25.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:25.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:25.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:25 smithi007 bash[22722]: cluster 2024-09-14T01:37:24.109448+0000 mgr.a (mgr.14355) 8499 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:25 smithi131 bash[24745]: cluster 2024-09-14T01:37:24.109448+0000 mgr.a (mgr.14355) 8499 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:25 smithi171 bash[25040]: cluster 2024-09-14T01:37:24.109448+0000 mgr.a (mgr.14355) 8499 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:26.634 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:26.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:26.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:26.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:26.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:27 smithi007 bash[22722]: cluster 2024-09-14T01:37:26.111498+0000 mgr.a (mgr.14355) 8500 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:27 smithi007 bash[22722]: audit 2024-09-14T01:37:26.203017+0000 mgr.a (mgr.14355) 8501 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:27 smithi131 bash[24745]: cluster 2024-09-14T01:37:26.111498+0000 mgr.a (mgr.14355) 8500 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:27 smithi131 bash[24745]: audit 2024-09-14T01:37:26.203017+0000 mgr.a (mgr.14355) 8501 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:27 smithi171 bash[25040]: cluster 2024-09-14T01:37:26.111498+0000 mgr.a (mgr.14355) 8500 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:27 smithi171 bash[25040]: audit 2024-09-14T01:37:26.203017+0000 mgr.a (mgr.14355) 8501 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:29 smithi007 bash[22722]: cluster 2024-09-14T01:37:28.112598+0000 mgr.a (mgr.14355) 8502 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:29 smithi131 bash[24745]: cluster 2024-09-14T01:37:28.112598+0000 mgr.a (mgr.14355) 8502 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:29 smithi171 bash[25040]: cluster 2024-09-14T01:37:28.112598+0000 mgr.a (mgr.14355) 8502 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:37:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:31.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:31.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:31 smithi007 bash[22722]: cluster 2024-09-14T01:37:30.113583+0000 mgr.a (mgr.14355) 8503 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:37:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:31 smithi131 bash[24745]: cluster 2024-09-14T01:37:30.113583+0000 mgr.a (mgr.14355) 8503 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:37:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:31 smithi171 bash[25040]: cluster 2024-09-14T01:37:30.113583+0000 mgr.a (mgr.14355) 8503 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:37:32.414 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:32.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:32.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:32.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:33 smithi007 bash[22722]: audit 2024-09-14T01:37:31.970102+0000 mgr.a (mgr.14355) 8504 : audit [DBG] from='client.190290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:33 smithi007 bash[22722]: cluster 2024-09-14T01:37:32.115054+0000 mgr.a (mgr.14355) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:33 smithi131 bash[24745]: audit 2024-09-14T01:37:31.970102+0000 mgr.a (mgr.14355) 8504 : audit [DBG] from='client.190290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:33 smithi131 bash[24745]: cluster 2024-09-14T01:37:32.115054+0000 mgr.a (mgr.14355) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:33 smithi171 bash[25040]: audit 2024-09-14T01:37:31.970102+0000 mgr.a (mgr.14355) 8504 : audit [DBG] from='client.190290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:33 smithi171 bash[25040]: cluster 2024-09-14T01:37:32.115054+0000 mgr.a (mgr.14355) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:35 smithi007 bash[22722]: cluster 2024-09-14T01:37:34.115935+0000 mgr.a (mgr.14355) 8506 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:35 smithi131 bash[24745]: cluster 2024-09-14T01:37:34.115935+0000 mgr.a (mgr.14355) 8506 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:35 smithi171 bash[25040]: cluster 2024-09-14T01:37:34.115935+0000 mgr.a (mgr.14355) 8506 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:37.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:37.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:37.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:37 smithi007 bash[22722]: cluster 2024-09-14T01:37:36.118228+0000 mgr.a (mgr.14355) 8507 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:37 smithi131 bash[24745]: cluster 2024-09-14T01:37:36.118228+0000 mgr.a (mgr.14355) 8507 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:37 smithi171 bash[25040]: cluster 2024-09-14T01:37:36.118228+0000 mgr.a (mgr.14355) 8507 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:38.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:38.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:38 smithi007 bash[22722]: audit 2024-09-14T01:37:37.753507+0000 mgr.a (mgr.14355) 8508 : audit [DBG] from='client.190365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:38 smithi131 bash[24745]: audit 2024-09-14T01:37:37.753507+0000 mgr.a (mgr.14355) 8508 : audit [DBG] from='client.190365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:38 smithi171 bash[25040]: audit 2024-09-14T01:37:37.753507+0000 mgr.a (mgr.14355) 8508 : audit [DBG] from='client.190365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:39 smithi131 bash[24745]: cluster 2024-09-14T01:37:38.118803+0000 mgr.a (mgr.14355) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:39 smithi171 bash[25040]: cluster 2024-09-14T01:37:38.118803+0000 mgr.a (mgr.14355) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:39 smithi007 bash[22722]: cluster 2024-09-14T01:37:38.118803+0000 mgr.a (mgr.14355) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:41 smithi131 bash[24745]: cluster 2024-09-14T01:37:40.119543+0000 mgr.a (mgr.14355) 8510 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:41 smithi171 bash[25040]: cluster 2024-09-14T01:37:40.119543+0000 mgr.a (mgr.14355) 8510 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:41 smithi007 bash[22722]: cluster 2024-09-14T01:37:40.119543+0000 mgr.a (mgr.14355) 8510 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:43.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:43.949 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:43.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:43.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:43.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:43.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:43 smithi131 bash[24745]: cluster 2024-09-14T01:37:42.121764+0000 mgr.a (mgr.14355) 8511 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:43 smithi171 bash[25040]: cluster 2024-09-14T01:37:42.121764+0000 mgr.a (mgr.14355) 8511 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:43 smithi007 bash[22722]: cluster 2024-09-14T01:37:42.121764+0000 mgr.a (mgr.14355) 8511 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:44 smithi131 bash[24745]: audit 2024-09-14T01:37:43.523278+0000 mgr.a (mgr.14355) 8512 : audit [DBG] from='client.190443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:44 smithi171 bash[25040]: audit 2024-09-14T01:37:43.523278+0000 mgr.a (mgr.14355) 8512 : audit [DBG] from='client.190443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:44 smithi007 bash[22722]: audit 2024-09-14T01:37:43.523278+0000 mgr.a (mgr.14355) 8512 : audit [DBG] from='client.190443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:45 smithi131 bash[24745]: cluster 2024-09-14T01:37:44.122739+0000 mgr.a (mgr.14355) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:45 smithi171 bash[25040]: cluster 2024-09-14T01:37:44.122739+0000 mgr.a (mgr.14355) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:45 smithi007 bash[22722]: cluster 2024-09-14T01:37:44.122739+0000 mgr.a (mgr.14355) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:47 smithi131 bash[24745]: cluster 2024-09-14T01:37:46.125012+0000 mgr.a (mgr.14355) 8514 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:47 smithi171 bash[25040]: cluster 2024-09-14T01:37:46.125012+0000 mgr.a (mgr.14355) 8514 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:47 smithi007 bash[22722]: cluster 2024-09-14T01:37:46.125012+0000 mgr.a (mgr.14355) 8514 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:48.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:49.720 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:49.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:49 smithi131 bash[24745]: cluster 2024-09-14T01:37:48.125774+0000 mgr.a (mgr.14355) 8515 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:49 smithi171 bash[25040]: cluster 2024-09-14T01:37:48.125774+0000 mgr.a (mgr.14355) 8515 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:49 smithi007 bash[22722]: cluster 2024-09-14T01:37:48.125774+0000 mgr.a (mgr.14355) 8515 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:50 smithi131 bash[24745]: audit 2024-09-14T01:37:49.287749+0000 mgr.a (mgr.14355) 8516 : audit [DBG] from='client.190521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:50 smithi171 bash[25040]: audit 2024-09-14T01:37:49.287749+0000 mgr.a (mgr.14355) 8516 : audit [DBG] from='client.190521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:50 smithi007 bash[22722]: audit 2024-09-14T01:37:49.287749+0000 mgr.a (mgr.14355) 8516 : audit [DBG] from='client.190521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:51 smithi131 bash[24745]: cluster 2024-09-14T01:37:50.126682+0000 mgr.a (mgr.14355) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:51 smithi171 bash[25040]: cluster 2024-09-14T01:37:50.126682+0000 mgr.a (mgr.14355) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:51 smithi007 bash[22722]: cluster 2024-09-14T01:37:50.126682+0000 mgr.a (mgr.14355) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:53 smithi131 bash[24745]: cluster 2024-09-14T01:37:52.128950+0000 mgr.a (mgr.14355) 8518 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:53 smithi171 bash[25040]: cluster 2024-09-14T01:37:52.128950+0000 mgr.a (mgr.14355) 8518 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:53 smithi007 bash[22722]: cluster 2024-09-14T01:37:52.128950+0000 mgr.a (mgr.14355) 8518 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:37:54.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:37:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:37:54.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:37:55.481 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:37:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:37:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:37:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:37:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:37:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:55 smithi131 bash[24745]: cluster 2024-09-14T01:37:54.129721+0000 mgr.a (mgr.14355) 8519 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:55 smithi171 bash[25040]: cluster 2024-09-14T01:37:54.129721+0000 mgr.a (mgr.14355) 8519 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:55 smithi007 bash[22722]: cluster 2024-09-14T01:37:54.129721+0000 mgr.a (mgr.14355) 8519 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:37:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:56 smithi131 bash[24745]: audit 2024-09-14T01:37:55.055739+0000 mgr.a (mgr.14355) 8520 : audit [DBG] from='client.190599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:56 smithi171 bash[25040]: audit 2024-09-14T01:37:55.055739+0000 mgr.a (mgr.14355) 8520 : audit [DBG] from='client.190599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:56 smithi007 bash[22722]: audit 2024-09-14T01:37:55.055739+0000 mgr.a (mgr.14355) 8520 : audit [DBG] from='client.190599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:37:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:57 smithi131 bash[24745]: cluster 2024-09-14T01:37:56.132436+0000 mgr.a (mgr.14355) 8521 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:37:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:57 smithi171 bash[25040]: cluster 2024-09-14T01:37:56.132436+0000 mgr.a (mgr.14355) 8521 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:37:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:57 smithi007 bash[22722]: cluster 2024-09-14T01:37:56.132436+0000 mgr.a (mgr.14355) 8521 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:38:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:37:59 smithi131 bash[24745]: cluster 2024-09-14T01:37:58.133216+0000 mgr.a (mgr.14355) 8522 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:37:59 smithi171 bash[25040]: cluster 2024-09-14T01:37:58.133216+0000 mgr.a (mgr.14355) 8522 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:37:59 smithi007 bash[22722]: cluster 2024-09-14T01:37:58.133216+0000 mgr.a (mgr.14355) 8522 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:00.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:00.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:01.236 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:01.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:01.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:01.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:01.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:02.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:01 smithi131 bash[24745]: cluster 2024-09-14T01:38:00.134103+0000 mgr.a (mgr.14355) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:01 smithi171 bash[25040]: cluster 2024-09-14T01:38:00.134103+0000 mgr.a (mgr.14355) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:01 smithi007 bash[22722]: cluster 2024-09-14T01:38:00.134103+0000 mgr.a (mgr.14355) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:38:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:02 smithi131 bash[24745]: audit 2024-09-14T01:38:00.812666+0000 mgr.a (mgr.14355) 8524 : audit [DBG] from='client.190674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:02 smithi131 bash[24745]: audit 2024-09-14T01:38:02.642461+0000 mon.a (mon.0) 1872 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:38:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:02 smithi171 bash[25040]: audit 2024-09-14T01:38:00.812666+0000 mgr.a (mgr.14355) 8524 : audit [DBG] from='client.190674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:02 smithi171 bash[25040]: audit 2024-09-14T01:38:02.642461+0000 mon.a (mon.0) 1872 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:38:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:02 smithi007 bash[22722]: audit 2024-09-14T01:38:00.812666+0000 mgr.a (mgr.14355) 8524 : audit [DBG] from='client.190674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:02 smithi007 bash[22722]: audit 2024-09-14T01:38:02.642461+0000 mon.a (mon.0) 1872 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: cluster 2024-09-14T01:38:02.136883+0000 mgr.a (mgr.14355) 8525 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: audit 2024-09-14T01:38:03.508621+0000 mon.a (mon.0) 1873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: audit 2024-09-14T01:38:03.510383+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: audit 2024-09-14T01:38:03.520566+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: audit 2024-09-14T01:38:03.525466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:03 smithi131 bash[24745]: audit 2024-09-14T01:38:03.527915+0000 mgr.a (mgr.14355) 8526 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: cluster 2024-09-14T01:38:02.136883+0000 mgr.a (mgr.14355) 8525 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: audit 2024-09-14T01:38:03.508621+0000 mon.a (mon.0) 1873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: audit 2024-09-14T01:38:03.510383+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: audit 2024-09-14T01:38:03.520566+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: audit 2024-09-14T01:38:03.525466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:03 smithi171 bash[25040]: audit 2024-09-14T01:38:03.527915+0000 mgr.a (mgr.14355) 8526 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: cluster 2024-09-14T01:38:02.136883+0000 mgr.a (mgr.14355) 8525 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: audit 2024-09-14T01:38:03.508621+0000 mon.a (mon.0) 1873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: audit 2024-09-14T01:38:03.510383+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: audit 2024-09-14T01:38:03.520566+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: audit 2024-09-14T01:38:03.525466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:03 smithi007 bash[22722]: audit 2024-09-14T01:38:03.527915+0000 mgr.a (mgr.14355) 8526 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:38:04.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:38:04 smithi007 bash[22972]: debug 2024-09-14T01:38:04.262+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:38:04.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:38:04 smithi007 bash[22972]: debug 2024-09-14T01:38:04.262+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:38:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:04 smithi171 bash[25040]: cluster 2024-09-14T01:38:04.137358+0000 mgr.a (mgr.14355) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:04 smithi171 bash[25040]: audit 2024-09-14T01:38:04.263185+0000 mgr.a (mgr.14355) 8528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:38:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:04 smithi171 bash[25040]: cephadm 2024-09-14T01:38:04.264376+0000 mgr.a (mgr.14355) 8529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:38:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:04 smithi007 bash[22722]: cluster 2024-09-14T01:38:04.137358+0000 mgr.a (mgr.14355) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:04 smithi007 bash[22722]: audit 2024-09-14T01:38:04.263185+0000 mgr.a (mgr.14355) 8528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:38:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:04 smithi007 bash[22722]: cephadm 2024-09-14T01:38:04.264376+0000 mgr.a (mgr.14355) 8529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:38:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:04 smithi131 bash[24745]: cluster 2024-09-14T01:38:04.137358+0000 mgr.a (mgr.14355) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:04 smithi131 bash[24745]: audit 2024-09-14T01:38:04.263185+0000 mgr.a (mgr.14355) 8528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:38:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:04 smithi131 bash[24745]: cephadm 2024-09-14T01:38:04.264376+0000 mgr.a (mgr.14355) 8529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:38:06.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:06.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:06.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:07.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:07.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:07 smithi007 bash[22722]: cluster 2024-09-14T01:38:06.139509+0000 mgr.a (mgr.14355) 8530 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:07 smithi007 bash[22722]: audit 2024-09-14T01:38:06.569932+0000 mgr.a (mgr.14355) 8531 : audit [DBG] from='client.190854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:07 smithi131 bash[24745]: cluster 2024-09-14T01:38:06.139509+0000 mgr.a (mgr.14355) 8530 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:07 smithi131 bash[24745]: audit 2024-09-14T01:38:06.569932+0000 mgr.a (mgr.14355) 8531 : audit [DBG] from='client.190854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:07 smithi171 bash[25040]: cluster 2024-09-14T01:38:06.139509+0000 mgr.a (mgr.14355) 8530 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:07 smithi171 bash[25040]: audit 2024-09-14T01:38:06.569932+0000 mgr.a (mgr.14355) 8531 : audit [DBG] from='client.190854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:09 smithi007 bash[22722]: cluster 2024-09-14T01:38:08.140394+0000 mgr.a (mgr.14355) 8532 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:09 smithi131 bash[24745]: cluster 2024-09-14T01:38:08.140394+0000 mgr.a (mgr.14355) 8532 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:09 smithi171 bash[25040]: cluster 2024-09-14T01:38:08.140394+0000 mgr.a (mgr.14355) 8532 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:11 smithi131 bash[24745]: cluster 2024-09-14T01:38:10.141175+0000 mgr.a (mgr.14355) 8533 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:11 smithi171 bash[25040]: cluster 2024-09-14T01:38:10.141175+0000 mgr.a (mgr.14355) 8533 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:11 smithi007 bash[22722]: cluster 2024-09-14T01:38:10.141175+0000 mgr.a (mgr.14355) 8533 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:38:12.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:12.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:12.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:12.804 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:12.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:12.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:13 smithi131 bash[24745]: cluster 2024-09-14T01:38:12.142488+0000 mgr.a (mgr.14355) 8534 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:13 smithi131 bash[24745]: audit 2024-09-14T01:38:12.355208+0000 mgr.a (mgr.14355) 8535 : audit [DBG] from='client.190929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:13 smithi171 bash[25040]: cluster 2024-09-14T01:38:12.142488+0000 mgr.a (mgr.14355) 8534 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:13 smithi171 bash[25040]: audit 2024-09-14T01:38:12.355208+0000 mgr.a (mgr.14355) 8535 : audit [DBG] from='client.190929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:13 smithi007 bash[22722]: cluster 2024-09-14T01:38:12.142488+0000 mgr.a (mgr.14355) 8534 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:13 smithi007 bash[22722]: audit 2024-09-14T01:38:12.355208+0000 mgr.a (mgr.14355) 8535 : audit [DBG] from='client.190929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:15 smithi131 bash[24745]: cluster 2024-09-14T01:38:14.143344+0000 mgr.a (mgr.14355) 8536 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:15 smithi171 bash[25040]: cluster 2024-09-14T01:38:14.143344+0000 mgr.a (mgr.14355) 8536 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:15 smithi007 bash[22722]: cluster 2024-09-14T01:38:14.143344+0000 mgr.a (mgr.14355) 8536 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:17 smithi131 bash[24745]: cluster 2024-09-14T01:38:16.145513+0000 mgr.a (mgr.14355) 8537 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:17 smithi171 bash[25040]: cluster 2024-09-14T01:38:16.145513+0000 mgr.a (mgr.14355) 8537 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:17 smithi007 bash[22722]: cluster 2024-09-14T01:38:16.145513+0000 mgr.a (mgr.14355) 8537 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:38:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:18.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:19 smithi131 bash[24745]: cluster 2024-09-14T01:38:18.146240+0000 mgr.a (mgr.14355) 8538 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:19 smithi131 bash[24745]: audit 2024-09-14T01:38:18.148293+0000 mgr.a (mgr.14355) 8539 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:19 smithi171 bash[25040]: cluster 2024-09-14T01:38:18.146240+0000 mgr.a (mgr.14355) 8538 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:19 smithi171 bash[25040]: audit 2024-09-14T01:38:18.148293+0000 mgr.a (mgr.14355) 8539 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:19 smithi007 bash[22722]: cluster 2024-09-14T01:38:18.146240+0000 mgr.a (mgr.14355) 8538 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:19 smithi007 bash[22722]: audit 2024-09-14T01:38:18.148293+0000 mgr.a (mgr.14355) 8539 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:21 smithi131 bash[24745]: cluster 2024-09-14T01:38:20.147285+0000 mgr.a (mgr.14355) 8540 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:21 smithi171 bash[25040]: cluster 2024-09-14T01:38:20.147285+0000 mgr.a (mgr.14355) 8540 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:21 smithi007 bash[22722]: cluster 2024-09-14T01:38:20.147285+0000 mgr.a (mgr.14355) 8540 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:23 smithi131 bash[24745]: cluster 2024-09-14T01:38:22.149591+0000 mgr.a (mgr.14355) 8541 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:23 smithi171 bash[25040]: cluster 2024-09-14T01:38:22.149591+0000 mgr.a (mgr.14355) 8541 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:23.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:23.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:23 smithi007 bash[22722]: cluster 2024-09-14T01:38:22.149591+0000 mgr.a (mgr.14355) 8541 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:24.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:25 smithi131 bash[24745]: audit 2024-09-14T01:38:23.919507+0000 mgr.a (mgr.14355) 8542 : audit [DBG] from='client.191082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:25 smithi131 bash[24745]: cluster 2024-09-14T01:38:24.150340+0000 mgr.a (mgr.14355) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:25 smithi171 bash[25040]: audit 2024-09-14T01:38:23.919507+0000 mgr.a (mgr.14355) 8542 : audit [DBG] from='client.191082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:25 smithi171 bash[25040]: cluster 2024-09-14T01:38:24.150340+0000 mgr.a (mgr.14355) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:25 smithi007 bash[22722]: audit 2024-09-14T01:38:23.919507+0000 mgr.a (mgr.14355) 8542 : audit [DBG] from='client.191082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:25 smithi007 bash[22722]: cluster 2024-09-14T01:38:24.150340+0000 mgr.a (mgr.14355) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:27 smithi131 bash[24745]: cluster 2024-09-14T01:38:26.152666+0000 mgr.a (mgr.14355) 8544 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:27 smithi171 bash[25040]: cluster 2024-09-14T01:38:26.152666+0000 mgr.a (mgr.14355) 8544 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:27 smithi007 bash[22722]: cluster 2024-09-14T01:38:26.152666+0000 mgr.a (mgr.14355) 8544 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:29.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:29 smithi131 bash[24745]: cluster 2024-09-14T01:38:28.153412+0000 mgr.a (mgr.14355) 8545 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:29 smithi171 bash[25040]: cluster 2024-09-14T01:38:28.153412+0000 mgr.a (mgr.14355) 8545 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:29 smithi007 bash[22722]: cluster 2024-09-14T01:38:28.153412+0000 mgr.a (mgr.14355) 8545 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:30.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:30.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:30 smithi131 bash[24745]: audit 2024-09-14T01:38:29.674945+0000 mgr.a (mgr.14355) 8546 : audit [DBG] from='client.191160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:30 smithi171 bash[25040]: audit 2024-09-14T01:38:29.674945+0000 mgr.a (mgr.14355) 8546 : audit [DBG] from='client.191160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:30 smithi007 bash[22722]: audit 2024-09-14T01:38:29.674945+0000 mgr.a (mgr.14355) 8546 : audit [DBG] from='client.191160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:31 smithi131 bash[24745]: cluster 2024-09-14T01:38:30.153878+0000 mgr.a (mgr.14355) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:31 smithi171 bash[25040]: cluster 2024-09-14T01:38:30.153878+0000 mgr.a (mgr.14355) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:31 smithi007 bash[22722]: cluster 2024-09-14T01:38:30.153878+0000 mgr.a (mgr.14355) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:33 smithi131 bash[24745]: cluster 2024-09-14T01:38:32.156056+0000 mgr.a (mgr.14355) 8548 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:33 smithi171 bash[25040]: cluster 2024-09-14T01:38:32.156056+0000 mgr.a (mgr.14355) 8548 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:33 smithi007 bash[22722]: cluster 2024-09-14T01:38:32.156056+0000 mgr.a (mgr.14355) 8548 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:35.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:35.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:35 smithi131 bash[24745]: cluster 2024-09-14T01:38:34.156803+0000 mgr.a (mgr.14355) 8549 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:35 smithi171 bash[25040]: cluster 2024-09-14T01:38:34.156803+0000 mgr.a (mgr.14355) 8549 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:35 smithi007 bash[22722]: cluster 2024-09-14T01:38:34.156803+0000 mgr.a (mgr.14355) 8549 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:35.881 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:35.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:36 smithi131 bash[24745]: audit 2024-09-14T01:38:35.438010+0000 mgr.a (mgr.14355) 8550 : audit [DBG] from='client.191238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:36 smithi171 bash[25040]: audit 2024-09-14T01:38:35.438010+0000 mgr.a (mgr.14355) 8550 : audit [DBG] from='client.191238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:36 smithi007 bash[22722]: audit 2024-09-14T01:38:35.438010+0000 mgr.a (mgr.14355) 8550 : audit [DBG] from='client.191238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:37 smithi131 bash[24745]: cluster 2024-09-14T01:38:36.159570+0000 mgr.a (mgr.14355) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:37 smithi171 bash[25040]: cluster 2024-09-14T01:38:36.159570+0000 mgr.a (mgr.14355) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:37 smithi007 bash[22722]: cluster 2024-09-14T01:38:36.159570+0000 mgr.a (mgr.14355) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:39 smithi131 bash[24745]: cluster 2024-09-14T01:38:38.160345+0000 mgr.a (mgr.14355) 8552 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:39 smithi171 bash[25040]: cluster 2024-09-14T01:38:38.160345+0000 mgr.a (mgr.14355) 8552 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:39 smithi007 bash[22722]: cluster 2024-09-14T01:38:38.160345+0000 mgr.a (mgr.14355) 8552 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:41 smithi131 bash[24745]: cluster 2024-09-14T01:38:40.161105+0000 mgr.a (mgr.14355) 8553 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:38:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:41 smithi171 bash[25040]: cluster 2024-09-14T01:38:40.161105+0000 mgr.a (mgr.14355) 8553 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:38:41.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:41.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:41.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:41.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:41.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:41 smithi007 bash[22722]: cluster 2024-09-14T01:38:40.161105+0000 mgr.a (mgr.14355) 8553 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:38:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:42 smithi131 bash[24745]: audit 2024-09-14T01:38:41.217895+0000 mgr.a (mgr.14355) 8554 : audit [DBG] from='client.191310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:42 smithi171 bash[25040]: audit 2024-09-14T01:38:41.217895+0000 mgr.a (mgr.14355) 8554 : audit [DBG] from='client.191310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:42 smithi007 bash[22722]: audit 2024-09-14T01:38:41.217895+0000 mgr.a (mgr.14355) 8554 : audit [DBG] from='client.191310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:43 smithi171 bash[25040]: cluster 2024-09-14T01:38:42.164022+0000 mgr.a (mgr.14355) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:43 smithi007 bash[22722]: cluster 2024-09-14T01:38:42.164022+0000 mgr.a (mgr.14355) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:43 smithi131 bash[24745]: cluster 2024-09-14T01:38:42.164022+0000 mgr.a (mgr.14355) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:45 smithi007 bash[22722]: cluster 2024-09-14T01:38:44.164808+0000 mgr.a (mgr.14355) 8556 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:45 smithi131 bash[24745]: cluster 2024-09-14T01:38:44.164808+0000 mgr.a (mgr.14355) 8556 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:45 smithi171 bash[25040]: cluster 2024-09-14T01:38:44.164808+0000 mgr.a (mgr.14355) 8556 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:38:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:47.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:47.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:47.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:47 smithi007 bash[22722]: cluster 2024-09-14T01:38:46.166793+0000 mgr.a (mgr.14355) 8557 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:47 smithi131 bash[24745]: cluster 2024-09-14T01:38:46.166793+0000 mgr.a (mgr.14355) 8557 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:47.826 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:47 smithi171 bash[25040]: cluster 2024-09-14T01:38:46.166793+0000 mgr.a (mgr.14355) 8557 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:48 smithi131 bash[24745]: audit 2024-09-14T01:38:46.985661+0000 mgr.a (mgr.14355) 8558 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:48 smithi171 bash[25040]: audit 2024-09-14T01:38:46.985661+0000 mgr.a (mgr.14355) 8558 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:48 smithi007 bash[22722]: audit 2024-09-14T01:38:46.985661+0000 mgr.a (mgr.14355) 8558 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:49 smithi131 bash[24745]: cluster 2024-09-14T01:38:48.167933+0000 mgr.a (mgr.14355) 8559 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:49 smithi171 bash[25040]: cluster 2024-09-14T01:38:48.167933+0000 mgr.a (mgr.14355) 8559 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:49 smithi007 bash[22722]: cluster 2024-09-14T01:38:48.167933+0000 mgr.a (mgr.14355) 8559 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:51 smithi131 bash[24745]: cluster 2024-09-14T01:38:50.168901+0000 mgr.a (mgr.14355) 8560 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:51 smithi171 bash[25040]: cluster 2024-09-14T01:38:50.168901+0000 mgr.a (mgr.14355) 8560 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:51 smithi007 bash[22722]: cluster 2024-09-14T01:38:50.168901+0000 mgr.a (mgr.14355) 8560 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:52.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:52.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:53.187 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:53.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:53.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:53.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:53.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:53 smithi131 bash[24745]: cluster 2024-09-14T01:38:52.171305+0000 mgr.a (mgr.14355) 8561 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:53 smithi131 bash[24745]: audit 2024-09-14T01:38:52.746655+0000 mgr.a (mgr.14355) 8562 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:53 smithi171 bash[25040]: cluster 2024-09-14T01:38:52.171305+0000 mgr.a (mgr.14355) 8561 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:53 smithi171 bash[25040]: audit 2024-09-14T01:38:52.746655+0000 mgr.a (mgr.14355) 8562 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:53 smithi007 bash[22722]: cluster 2024-09-14T01:38:52.171305+0000 mgr.a (mgr.14355) 8561 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:53 smithi007 bash[22722]: audit 2024-09-14T01:38:52.746655+0000 mgr.a (mgr.14355) 8562 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:55 smithi131 bash[24745]: cluster 2024-09-14T01:38:54.172380+0000 mgr.a (mgr.14355) 8563 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:55 smithi171 bash[25040]: cluster 2024-09-14T01:38:54.172380+0000 mgr.a (mgr.14355) 8563 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:55 smithi007 bash[22722]: cluster 2024-09-14T01:38:54.172380+0000 mgr.a (mgr.14355) 8563 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:57 smithi131 bash[24745]: cluster 2024-09-14T01:38:56.174686+0000 mgr.a (mgr.14355) 8564 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:57 smithi171 bash[25040]: cluster 2024-09-14T01:38:56.174686+0000 mgr.a (mgr.14355) 8564 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:57 smithi007 bash[22722]: cluster 2024-09-14T01:38:56.174686+0000 mgr.a (mgr.14355) 8564 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:38:58.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:38:58.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:38:58.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:38:58.935 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:38:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:38:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:38:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:38:58.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:38:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:59 smithi131 bash[24745]: cluster 2024-09-14T01:38:58.175460+0000 mgr.a (mgr.14355) 8565 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:38:59 smithi131 bash[24745]: audit 2024-09-14T01:38:58.517143+0000 mgr.a (mgr.14355) 8566 : audit [DBG] from='client.191541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:59 smithi171 bash[25040]: cluster 2024-09-14T01:38:58.175460+0000 mgr.a (mgr.14355) 8565 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:38:59 smithi171 bash[25040]: audit 2024-09-14T01:38:58.517143+0000 mgr.a (mgr.14355) 8566 : audit [DBG] from='client.191541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:38:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:59 smithi007 bash[22722]: cluster 2024-09-14T01:38:58.175460+0000 mgr.a (mgr.14355) 8565 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:38:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:38:59 smithi007 bash[22722]: audit 2024-09-14T01:38:58.517143+0000 mgr.a (mgr.14355) 8566 : audit [DBG] from='client.191541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:01 smithi131 bash[24745]: cluster 2024-09-14T01:39:00.177058+0000 mgr.a (mgr.14355) 8567 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:39:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:01 smithi171 bash[25040]: cluster 2024-09-14T01:39:00.177058+0000 mgr.a (mgr.14355) 8567 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:39:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:01 smithi007 bash[22722]: cluster 2024-09-14T01:39:00.177058+0000 mgr.a (mgr.14355) 8567 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:39:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:03 smithi131 bash[24745]: cluster 2024-09-14T01:39:02.179101+0000 mgr.a (mgr.14355) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:03 smithi171 bash[25040]: cluster 2024-09-14T01:39:02.179101+0000 mgr.a (mgr.14355) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:03.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:03.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:03 smithi007 bash[22722]: cluster 2024-09-14T01:39:02.179101+0000 mgr.a (mgr.14355) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:04.721 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:04.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:04.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:04 smithi171 bash[25040]: audit 2024-09-14T01:39:04.320421+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:39:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:04 smithi007 bash[22722]: audit 2024-09-14T01:39:04.320421+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:39:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:04 smithi131 bash[24745]: audit 2024-09-14T01:39:04.320421+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:39:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: cluster 2024-09-14T01:39:04.179894+0000 mgr.a (mgr.14355) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: audit 2024-09-14T01:39:04.274230+0000 mgr.a (mgr.14355) 8570 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: audit 2024-09-14T01:39:05.116056+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:39:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: audit 2024-09-14T01:39:05.117834+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:39:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: audit 2024-09-14T01:39:05.128196+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:39:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:05 smithi171 bash[25040]: audit 2024-09-14T01:39:05.133012+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:05.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: cluster 2024-09-14T01:39:04.179894+0000 mgr.a (mgr.14355) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:05.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: audit 2024-09-14T01:39:04.274230+0000 mgr.a (mgr.14355) 8570 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:05.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: audit 2024-09-14T01:39:05.116056+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:39:05.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: audit 2024-09-14T01:39:05.117834+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:39:05.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: audit 2024-09-14T01:39:05.128196+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:39:05.858 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22722]: audit 2024-09-14T01:39:05.133012+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: cluster 2024-09-14T01:39:04.179894+0000 mgr.a (mgr.14355) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: audit 2024-09-14T01:39:04.274230+0000 mgr.a (mgr.14355) 8570 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: audit 2024-09-14T01:39:05.116056+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: audit 2024-09-14T01:39:05.117834+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: audit 2024-09-14T01:39:05.128196+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:39:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:05 smithi131 bash[24745]: audit 2024-09-14T01:39:05.133012+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22972]: debug 2024-09-14T01:39:05.853+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:39:06.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:39:05 smithi007 bash[22972]: debug 2024-09-14T01:39:05.857+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:39:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:06 smithi007 bash[22722]: audit 2024-09-14T01:39:05.135801+0000 mgr.a (mgr.14355) 8571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:06 smithi131 bash[24745]: audit 2024-09-14T01:39:05.135801+0000 mgr.a (mgr.14355) 8571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:06 smithi171 bash[25040]: audit 2024-09-14T01:39:05.135801+0000 mgr.a (mgr.14355) 8571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:39:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:07 smithi007 bash[22722]: audit 2024-09-14T01:39:05.857187+0000 mgr.a (mgr.14355) 8572 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:39:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:07 smithi007 bash[22722]: cephadm 2024-09-14T01:39:05.858524+0000 mgr.a (mgr.14355) 8573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:39:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:07 smithi007 bash[22722]: cluster 2024-09-14T01:39:06.182636+0000 mgr.a (mgr.14355) 8574 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:07 smithi131 bash[24745]: audit 2024-09-14T01:39:05.857187+0000 mgr.a (mgr.14355) 8572 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:39:08.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:07 smithi131 bash[24745]: cephadm 2024-09-14T01:39:05.858524+0000 mgr.a (mgr.14355) 8573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:39:08.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:07 smithi131 bash[24745]: cluster 2024-09-14T01:39:06.182636+0000 mgr.a (mgr.14355) 8574 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:07 smithi171 bash[25040]: audit 2024-09-14T01:39:05.857187+0000 mgr.a (mgr.14355) 8572 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:39:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:07 smithi171 bash[25040]: cephadm 2024-09-14T01:39:05.858524+0000 mgr.a (mgr.14355) 8573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:39:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:07 smithi171 bash[25040]: cluster 2024-09-14T01:39:06.182636+0000 mgr.a (mgr.14355) 8574 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:09.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:09.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:09 smithi007 bash[22722]: cluster 2024-09-14T01:39:08.183348+0000 mgr.a (mgr.14355) 8575 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:09 smithi131 bash[24745]: cluster 2024-09-14T01:39:08.183348+0000 mgr.a (mgr.14355) 8575 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:09 smithi171 bash[25040]: cluster 2024-09-14T01:39:08.183348+0000 mgr.a (mgr.14355) 8575 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:10.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:10.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:11 smithi007 bash[22722]: audit 2024-09-14T01:39:10.055920+0000 mgr.a (mgr.14355) 8576 : audit [DBG] from='client.191796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:11 smithi007 bash[22722]: cluster 2024-09-14T01:39:10.192089+0000 mgr.a (mgr.14355) 8577 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T01:39:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:11 smithi131 bash[24745]: audit 2024-09-14T01:39:10.055920+0000 mgr.a (mgr.14355) 8576 : audit [DBG] from='client.191796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:11 smithi131 bash[24745]: cluster 2024-09-14T01:39:10.192089+0000 mgr.a (mgr.14355) 8577 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T01:39:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:11 smithi171 bash[25040]: audit 2024-09-14T01:39:10.055920+0000 mgr.a (mgr.14355) 8576 : audit [DBG] from='client.191796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:11 smithi171 bash[25040]: cluster 2024-09-14T01:39:10.192089+0000 mgr.a (mgr.14355) 8577 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T01:39:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:13 smithi007 bash[22722]: cluster 2024-09-14T01:39:12.194089+0000 mgr.a (mgr.14355) 8578 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:13 smithi131 bash[24745]: cluster 2024-09-14T01:39:12.194089+0000 mgr.a (mgr.14355) 8578 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:13 smithi171 bash[25040]: cluster 2024-09-14T01:39:12.194089+0000 mgr.a (mgr.14355) 8578 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:15 smithi007 bash[22722]: cluster 2024-09-14T01:39:14.194913+0000 mgr.a (mgr.14355) 8579 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:15 smithi131 bash[24745]: cluster 2024-09-14T01:39:14.194913+0000 mgr.a (mgr.14355) 8579 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:15 smithi171 bash[25040]: cluster 2024-09-14T01:39:14.194913+0000 mgr.a (mgr.14355) 8579 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:16.233 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:16.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:16.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:17 smithi007 bash[22722]: audit 2024-09-14T01:39:15.806937+0000 mgr.a (mgr.14355) 8580 : audit [DBG] from='client.191874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:17 smithi007 bash[22722]: cluster 2024-09-14T01:39:16.196462+0000 mgr.a (mgr.14355) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:39:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:17 smithi131 bash[24745]: audit 2024-09-14T01:39:15.806937+0000 mgr.a (mgr.14355) 8580 : audit [DBG] from='client.191874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:17 smithi131 bash[24745]: cluster 2024-09-14T01:39:16.196462+0000 mgr.a (mgr.14355) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:39:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:17 smithi171 bash[25040]: audit 2024-09-14T01:39:15.806937+0000 mgr.a (mgr.14355) 8580 : audit [DBG] from='client.191874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:17 smithi171 bash[25040]: cluster 2024-09-14T01:39:16.196462+0000 mgr.a (mgr.14355) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:39:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:19 smithi007 bash[22722]: cluster 2024-09-14T01:39:18.197193+0000 mgr.a (mgr.14355) 8582 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:19 smithi131 bash[24745]: cluster 2024-09-14T01:39:18.197193+0000 mgr.a (mgr.14355) 8582 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:19 smithi171 bash[25040]: cluster 2024-09-14T01:39:18.197193+0000 mgr.a (mgr.14355) 8582 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:21.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:21.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:21 smithi007 bash[22722]: cluster 2024-09-14T01:39:20.198725+0000 mgr.a (mgr.14355) 8583 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:22.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:22.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:21 smithi131 bash[24745]: cluster 2024-09-14T01:39:20.198725+0000 mgr.a (mgr.14355) 8583 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:21 smithi171 bash[25040]: cluster 2024-09-14T01:39:20.198725+0000 mgr.a (mgr.14355) 8583 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:39:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:22 smithi007 bash[22722]: audit 2024-09-14T01:39:21.568016+0000 mgr.a (mgr.14355) 8584 : audit [DBG] from='client.191952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:22 smithi131 bash[24745]: audit 2024-09-14T01:39:21.568016+0000 mgr.a (mgr.14355) 8584 : audit [DBG] from='client.191952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:22 smithi171 bash[25040]: audit 2024-09-14T01:39:21.568016+0000 mgr.a (mgr.14355) 8584 : audit [DBG] from='client.191952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:23 smithi007 bash[22722]: cluster 2024-09-14T01:39:22.200655+0000 mgr.a (mgr.14355) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T01:39:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:23 smithi131 bash[24745]: cluster 2024-09-14T01:39:22.200655+0000 mgr.a (mgr.14355) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T01:39:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:23 smithi171 bash[25040]: cluster 2024-09-14T01:39:22.200655+0000 mgr.a (mgr.14355) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T01:39:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:25 smithi007 bash[22722]: cluster 2024-09-14T01:39:24.201414+0000 mgr.a (mgr.14355) 8586 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:39:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:25 smithi131 bash[24745]: cluster 2024-09-14T01:39:24.201414+0000 mgr.a (mgr.14355) 8586 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:39:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:25 smithi171 bash[25040]: cluster 2024-09-14T01:39:24.201414+0000 mgr.a (mgr.14355) 8586 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:39:27.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:27.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:27.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:27.767 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:27.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:27 smithi007 bash[22722]: cluster 2024-09-14T01:39:26.203514+0000 mgr.a (mgr.14355) 8587 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:27 smithi131 bash[24745]: cluster 2024-09-14T01:39:26.203514+0000 mgr.a (mgr.14355) 8587 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:27 smithi171 bash[25040]: cluster 2024-09-14T01:39:26.203514+0000 mgr.a (mgr.14355) 8587 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:28 smithi007 bash[22722]: audit 2024-09-14T01:39:27.341998+0000 mgr.a (mgr.14355) 8588 : audit [DBG] from='client.192030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:28 smithi131 bash[24745]: audit 2024-09-14T01:39:27.341998+0000 mgr.a (mgr.14355) 8588 : audit [DBG] from='client.192030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:28 smithi171 bash[25040]: audit 2024-09-14T01:39:27.341998+0000 mgr.a (mgr.14355) 8588 : audit [DBG] from='client.192030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:29 smithi007 bash[22722]: cluster 2024-09-14T01:39:28.204485+0000 mgr.a (mgr.14355) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:29 smithi131 bash[24745]: cluster 2024-09-14T01:39:28.204485+0000 mgr.a (mgr.14355) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:29 smithi171 bash[25040]: cluster 2024-09-14T01:39:28.204485+0000 mgr.a (mgr.14355) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:31 smithi007 bash[22722]: cluster 2024-09-14T01:39:30.206285+0000 mgr.a (mgr.14355) 8590 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:31 smithi131 bash[24745]: cluster 2024-09-14T01:39:30.206285+0000 mgr.a (mgr.14355) 8590 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:31 smithi171 bash[25040]: cluster 2024-09-14T01:39:30.206285+0000 mgr.a (mgr.14355) 8590 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:33.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:33 smithi007 bash[22722]: cluster 2024-09-14T01:39:32.207659+0000 mgr.a (mgr.14355) 8591 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:33 smithi131 bash[24745]: cluster 2024-09-14T01:39:32.207659+0000 mgr.a (mgr.14355) 8591 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:33 smithi171 bash[25040]: cluster 2024-09-14T01:39:32.207659+0000 mgr.a (mgr.14355) 8591 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:34 smithi007 bash[22722]: audit 2024-09-14T01:39:33.103451+0000 mgr.a (mgr.14355) 8592 : audit [DBG] from='client.192105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:34 smithi131 bash[24745]: audit 2024-09-14T01:39:33.103451+0000 mgr.a (mgr.14355) 8592 : audit [DBG] from='client.192105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:34 smithi171 bash[25040]: audit 2024-09-14T01:39:33.103451+0000 mgr.a (mgr.14355) 8592 : audit [DBG] from='client.192105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:35 smithi007 bash[22722]: cluster 2024-09-14T01:39:34.208692+0000 mgr.a (mgr.14355) 8593 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:35 smithi131 bash[24745]: cluster 2024-09-14T01:39:34.208692+0000 mgr.a (mgr.14355) 8593 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:35 smithi171 bash[25040]: cluster 2024-09-14T01:39:34.208692+0000 mgr.a (mgr.14355) 8593 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:37 smithi007 bash[22722]: cluster 2024-09-14T01:39:36.210965+0000 mgr.a (mgr.14355) 8594 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:37 smithi131 bash[24745]: cluster 2024-09-14T01:39:36.210965+0000 mgr.a (mgr.14355) 8594 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:37 smithi171 bash[25040]: cluster 2024-09-14T01:39:36.210965+0000 mgr.a (mgr.14355) 8594 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:39.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:39.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:39 smithi007 bash[22722]: cluster 2024-09-14T01:39:38.211742+0000 mgr.a (mgr.14355) 8595 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:40.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:39 smithi131 bash[24745]: cluster 2024-09-14T01:39:38.211742+0000 mgr.a (mgr.14355) 8595 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:39 smithi171 bash[25040]: cluster 2024-09-14T01:39:38.211742+0000 mgr.a (mgr.14355) 8595 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:40 smithi007 bash[22722]: audit 2024-09-14T01:39:38.893809+0000 mgr.a (mgr.14355) 8596 : audit [DBG] from='client.192180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:40 smithi131 bash[24745]: audit 2024-09-14T01:39:38.893809+0000 mgr.a (mgr.14355) 8596 : audit [DBG] from='client.192180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:40 smithi171 bash[25040]: audit 2024-09-14T01:39:38.893809+0000 mgr.a (mgr.14355) 8596 : audit [DBG] from='client.192180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:41 smithi007 bash[22722]: cluster 2024-09-14T01:39:40.213700+0000 mgr.a (mgr.14355) 8597 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:41 smithi131 bash[24745]: cluster 2024-09-14T01:39:40.213700+0000 mgr.a (mgr.14355) 8597 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:41 smithi171 bash[25040]: cluster 2024-09-14T01:39:40.213700+0000 mgr.a (mgr.14355) 8597 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:43 smithi007 bash[22722]: cluster 2024-09-14T01:39:42.215061+0000 mgr.a (mgr.14355) 8598 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:43 smithi131 bash[24745]: cluster 2024-09-14T01:39:42.215061+0000 mgr.a (mgr.14355) 8598 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:43 smithi171 bash[25040]: cluster 2024-09-14T01:39:42.215061+0000 mgr.a (mgr.14355) 8598 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:39:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:45.120 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:45 smithi007 bash[22722]: cluster 2024-09-14T01:39:44.215848+0000 mgr.a (mgr.14355) 8599 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:45 smithi007 bash[22722]: audit 2024-09-14T01:39:44.676313+0000 mgr.a (mgr.14355) 8600 : audit [DBG] from='client.192255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:45 smithi131 bash[24745]: cluster 2024-09-14T01:39:44.215848+0000 mgr.a (mgr.14355) 8599 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:45 smithi131 bash[24745]: audit 2024-09-14T01:39:44.676313+0000 mgr.a (mgr.14355) 8600 : audit [DBG] from='client.192255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:45 smithi171 bash[25040]: cluster 2024-09-14T01:39:44.215848+0000 mgr.a (mgr.14355) 8599 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:45 smithi171 bash[25040]: audit 2024-09-14T01:39:44.676313+0000 mgr.a (mgr.14355) 8600 : audit [DBG] from='client.192255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:47 smithi007 bash[22722]: cluster 2024-09-14T01:39:46.218332+0000 mgr.a (mgr.14355) 8601 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:47 smithi131 bash[24745]: cluster 2024-09-14T01:39:46.218332+0000 mgr.a (mgr.14355) 8601 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:47 smithi171 bash[25040]: cluster 2024-09-14T01:39:46.218332+0000 mgr.a (mgr.14355) 8601 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:39:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:49 smithi007 bash[22722]: cluster 2024-09-14T01:39:48.219106+0000 mgr.a (mgr.14355) 8602 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:49 smithi131 bash[24745]: cluster 2024-09-14T01:39:48.219106+0000 mgr.a (mgr.14355) 8602 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:49 smithi171 bash[25040]: cluster 2024-09-14T01:39:48.219106+0000 mgr.a (mgr.14355) 8602 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:50.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:50.123 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:50.899 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:50.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:51 smithi007 bash[22722]: cluster 2024-09-14T01:39:50.220101+0000 mgr.a (mgr.14355) 8603 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:51 smithi007 bash[22722]: audit 2024-09-14T01:39:50.453519+0000 mgr.a (mgr.14355) 8604 : audit [DBG] from='client.192333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:51 smithi131 bash[24745]: cluster 2024-09-14T01:39:50.220101+0000 mgr.a (mgr.14355) 8603 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:51 smithi131 bash[24745]: audit 2024-09-14T01:39:50.453519+0000 mgr.a (mgr.14355) 8604 : audit [DBG] from='client.192333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:51 smithi171 bash[25040]: cluster 2024-09-14T01:39:50.220101+0000 mgr.a (mgr.14355) 8603 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:51 smithi171 bash[25040]: audit 2024-09-14T01:39:50.453519+0000 mgr.a (mgr.14355) 8604 : audit [DBG] from='client.192333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:53 smithi007 bash[22722]: cluster 2024-09-14T01:39:52.221770+0000 mgr.a (mgr.14355) 8605 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:39:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:53 smithi131 bash[24745]: cluster 2024-09-14T01:39:52.221770+0000 mgr.a (mgr.14355) 8605 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:39:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:53 smithi171 bash[25040]: cluster 2024-09-14T01:39:52.221770+0000 mgr.a (mgr.14355) 8605 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:39:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:39:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:39:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:39:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:55 smithi007 bash[22722]: cluster 2024-09-14T01:39:54.222586+0000 mgr.a (mgr.14355) 8606 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:39:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:55 smithi131 bash[24745]: cluster 2024-09-14T01:39:54.222586+0000 mgr.a (mgr.14355) 8606 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:39:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:55 smithi171 bash[25040]: cluster 2024-09-14T01:39:54.222586+0000 mgr.a (mgr.14355) 8606 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:39:56.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:39:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:39:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:39:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:39:56.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:39:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:57 smithi007 bash[22722]: cluster 2024-09-14T01:39:56.224538+0000 mgr.a (mgr.14355) 8607 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:57 smithi007 bash[22722]: audit 2024-09-14T01:39:56.233261+0000 mgr.a (mgr.14355) 8608 : audit [DBG] from='client.192411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:57 smithi131 bash[24745]: cluster 2024-09-14T01:39:56.224538+0000 mgr.a (mgr.14355) 8607 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:57 smithi131 bash[24745]: audit 2024-09-14T01:39:56.233261+0000 mgr.a (mgr.14355) 8608 : audit [DBG] from='client.192411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:57 smithi171 bash[25040]: cluster 2024-09-14T01:39:56.224538+0000 mgr.a (mgr.14355) 8607 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:39:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:57 smithi171 bash[25040]: audit 2024-09-14T01:39:56.233261+0000 mgr.a (mgr.14355) 8608 : audit [DBG] from='client.192411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:39:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:39:59 smithi007 bash[22722]: cluster 2024-09-14T01:39:58.225443+0000 mgr.a (mgr.14355) 8609 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:39:59 smithi131 bash[24745]: cluster 2024-09-14T01:39:58.225443+0000 mgr.a (mgr.14355) 8609 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:39:59 smithi171 bash[25040]: cluster 2024-09-14T01:39:58.225443+0000 mgr.a (mgr.14355) 8609 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:00 smithi007 bash[22722]: cluster 2024-09-14T01:40:00.000148+0000 mon.a (mon.0) 1882 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:00 smithi131 bash[24745]: cluster 2024-09-14T01:40:00.000148+0000 mon.a (mon.0) 1882 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:00 smithi171 bash[25040]: cluster 2024-09-14T01:40:00.000148+0000 mon.a (mon.0) 1882 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:40:01.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:01.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:01.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:01 smithi007 bash[22722]: cluster 2024-09-14T01:40:00.227270+0000 mgr.a (mgr.14355) 8610 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:01 smithi131 bash[24745]: cluster 2024-09-14T01:40:00.227270+0000 mgr.a (mgr.14355) 8610 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:01 smithi171 bash[25040]: cluster 2024-09-14T01:40:00.227270+0000 mgr.a (mgr.14355) 8610 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:02.427 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:02.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:02.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:02.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:02.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:03 smithi007 bash[22722]: audit 2024-09-14T01:40:01.978732+0000 mgr.a (mgr.14355) 8611 : audit [DBG] from='client.192489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:03 smithi007 bash[22722]: cluster 2024-09-14T01:40:02.228253+0000 mgr.a (mgr.14355) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:03 smithi131 bash[24745]: audit 2024-09-14T01:40:01.978732+0000 mgr.a (mgr.14355) 8611 : audit [DBG] from='client.192489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:03 smithi131 bash[24745]: cluster 2024-09-14T01:40:02.228253+0000 mgr.a (mgr.14355) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:03 smithi171 bash[25040]: audit 2024-09-14T01:40:01.978732+0000 mgr.a (mgr.14355) 8611 : audit [DBG] from='client.192489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:03 smithi171 bash[25040]: cluster 2024-09-14T01:40:02.228253+0000 mgr.a (mgr.14355) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:06.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:05 smithi131 bash[24745]: cluster 2024-09-14T01:40:04.229132+0000 mgr.a (mgr.14355) 8613 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:05 smithi171 bash[25040]: cluster 2024-09-14T01:40:04.229132+0000 mgr.a (mgr.14355) 8613 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:05 smithi007 bash[22722]: cluster 2024-09-14T01:40:04.229132+0000 mgr.a (mgr.14355) 8613 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:06 smithi131 bash[24745]: audit 2024-09-14T01:40:05.908802+0000 mon.a (mon.0) 1883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:40:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:06 smithi171 bash[25040]: audit 2024-09-14T01:40:05.908802+0000 mon.a (mon.0) 1883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:40:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:06 smithi007 bash[22722]: audit 2024-09-14T01:40:05.908802+0000 mon.a (mon.0) 1883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:40:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:07.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:07.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22972]: debug 2024-09-14T01:40:07.492+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:40:07.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22972]: debug 2024-09-14T01:40:07.492+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:40:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: cluster 2024-09-14T01:40:06.231471+0000 mgr.a (mgr.14355) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: audit 2024-09-14T01:40:06.745453+0000 mon.a (mon.0) 1884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:40:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: audit 2024-09-14T01:40:06.747205+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:40:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: audit 2024-09-14T01:40:06.757346+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:40:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: audit 2024-09-14T01:40:06.760364+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:07 smithi007 bash[22722]: audit 2024-09-14T01:40:06.761701+0000 mgr.a (mgr.14355) 8615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: cluster 2024-09-14T01:40:06.231471+0000 mgr.a (mgr.14355) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: audit 2024-09-14T01:40:06.745453+0000 mon.a (mon.0) 1884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: audit 2024-09-14T01:40:06.747205+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: audit 2024-09-14T01:40:06.757346+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: audit 2024-09-14T01:40:06.760364+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:07 smithi131 bash[24745]: audit 2024-09-14T01:40:06.761701+0000 mgr.a (mgr.14355) 8615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: cluster 2024-09-14T01:40:06.231471+0000 mgr.a (mgr.14355) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: audit 2024-09-14T01:40:06.745453+0000 mon.a (mon.0) 1884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:40:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: audit 2024-09-14T01:40:06.747205+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:40:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: audit 2024-09-14T01:40:06.757346+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:40:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: audit 2024-09-14T01:40:06.760364+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:07 smithi171 bash[25040]: audit 2024-09-14T01:40:06.761701+0000 mgr.a (mgr.14355) 8615 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:40:08.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:08.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:08 smithi131 bash[24745]: audit 2024-09-14T01:40:07.497010+0000 mgr.a (mgr.14355) 8616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:40:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:08 smithi131 bash[24745]: cephadm 2024-09-14T01:40:07.498278+0000 mgr.a (mgr.14355) 8617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:40:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:08 smithi131 bash[24745]: audit 2024-09-14T01:40:07.751637+0000 mgr.a (mgr.14355) 8618 : audit [DBG] from='client.192669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:08 smithi171 bash[25040]: audit 2024-09-14T01:40:07.497010+0000 mgr.a (mgr.14355) 8616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:40:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:08 smithi171 bash[25040]: cephadm 2024-09-14T01:40:07.498278+0000 mgr.a (mgr.14355) 8617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:40:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:08 smithi171 bash[25040]: audit 2024-09-14T01:40:07.751637+0000 mgr.a (mgr.14355) 8618 : audit [DBG] from='client.192669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:08 smithi007 bash[22722]: audit 2024-09-14T01:40:07.497010+0000 mgr.a (mgr.14355) 8616 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:40:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:08 smithi007 bash[22722]: cephadm 2024-09-14T01:40:07.498278+0000 mgr.a (mgr.14355) 8617 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:40:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:08 smithi007 bash[22722]: audit 2024-09-14T01:40:07.751637+0000 mgr.a (mgr.14355) 8618 : audit [DBG] from='client.192669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:09 smithi131 bash[24745]: cluster 2024-09-14T01:40:08.232444+0000 mgr.a (mgr.14355) 8619 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:09 smithi171 bash[25040]: cluster 2024-09-14T01:40:08.232444+0000 mgr.a (mgr.14355) 8619 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:09 smithi007 bash[22722]: cluster 2024-09-14T01:40:08.232444+0000 mgr.a (mgr.14355) 8619 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:11 smithi131 bash[24745]: cluster 2024-09-14T01:40:10.234318+0000 mgr.a (mgr.14355) 8620 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:11 smithi171 bash[25040]: cluster 2024-09-14T01:40:10.234318+0000 mgr.a (mgr.14355) 8620 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:11 smithi007 bash[22722]: cluster 2024-09-14T01:40:10.234318+0000 mgr.a (mgr.14355) 8620 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:13.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:13.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:13.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:13.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:13 smithi131 bash[24745]: cluster 2024-09-14T01:40:12.235636+0000 mgr.a (mgr.14355) 8621 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:13 smithi171 bash[25040]: cluster 2024-09-14T01:40:12.235636+0000 mgr.a (mgr.14355) 8621 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:13 smithi007 bash[22722]: cluster 2024-09-14T01:40:12.235636+0000 mgr.a (mgr.14355) 8621 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:14 smithi131 bash[24745]: audit 2024-09-14T01:40:13.507835+0000 mgr.a (mgr.14355) 8622 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:14 smithi171 bash[25040]: audit 2024-09-14T01:40:13.507835+0000 mgr.a (mgr.14355) 8622 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:14 smithi007 bash[22722]: audit 2024-09-14T01:40:13.507835+0000 mgr.a (mgr.14355) 8622 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:15 smithi131 bash[24745]: cluster 2024-09-14T01:40:14.236646+0000 mgr.a (mgr.14355) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:15 smithi171 bash[25040]: cluster 2024-09-14T01:40:14.236646+0000 mgr.a (mgr.14355) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:15 smithi007 bash[22722]: cluster 2024-09-14T01:40:14.236646+0000 mgr.a (mgr.14355) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:18.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:17 smithi131 bash[24745]: cluster 2024-09-14T01:40:16.239483+0000 mgr.a (mgr.14355) 8624 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:17 smithi171 bash[25040]: cluster 2024-09-14T01:40:16.239483+0000 mgr.a (mgr.14355) 8624 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:17 smithi007 bash[22722]: cluster 2024-09-14T01:40:16.239483+0000 mgr.a (mgr.14355) 8624 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:18.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:18.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:18.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:19.735 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:19.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:19.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:19.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:19.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:19 smithi131 bash[24745]: cluster 2024-09-14T01:40:18.240295+0000 mgr.a (mgr.14355) 8625 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:19 smithi171 bash[25040]: cluster 2024-09-14T01:40:18.240295+0000 mgr.a (mgr.14355) 8625 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:19 smithi007 bash[22722]: cluster 2024-09-14T01:40:18.240295+0000 mgr.a (mgr.14355) 8625 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:20 smithi131 bash[24745]: audit 2024-09-14T01:40:19.293898+0000 mgr.a (mgr.14355) 8626 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:20 smithi171 bash[25040]: audit 2024-09-14T01:40:19.293898+0000 mgr.a (mgr.14355) 8626 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:20 smithi007 bash[22722]: audit 2024-09-14T01:40:19.293898+0000 mgr.a (mgr.14355) 8626 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:21 smithi131 bash[24745]: cluster 2024-09-14T01:40:20.242240+0000 mgr.a (mgr.14355) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:21 smithi171 bash[25040]: cluster 2024-09-14T01:40:20.242240+0000 mgr.a (mgr.14355) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:21 smithi007 bash[22722]: cluster 2024-09-14T01:40:20.242240+0000 mgr.a (mgr.14355) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:40:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:23 smithi131 bash[24745]: cluster 2024-09-14T01:40:22.243561+0000 mgr.a (mgr.14355) 8628 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:40:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:23 smithi171 bash[25040]: cluster 2024-09-14T01:40:22.243561+0000 mgr.a (mgr.14355) 8628 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:40:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:23 smithi007 bash[22722]: cluster 2024-09-14T01:40:22.243561+0000 mgr.a (mgr.14355) 8628 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:40:24.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:24.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:24.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:25.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:25.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:25 smithi131 bash[24745]: cluster 2024-09-14T01:40:24.244544+0000 mgr.a (mgr.14355) 8629 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:25 smithi171 bash[25040]: cluster 2024-09-14T01:40:24.244544+0000 mgr.a (mgr.14355) 8629 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:25 smithi007 bash[22722]: cluster 2024-09-14T01:40:24.244544+0000 mgr.a (mgr.14355) 8629 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:26 smithi131 bash[24745]: audit 2024-09-14T01:40:25.071640+0000 mgr.a (mgr.14355) 8630 : audit [DBG] from='client.192894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:26 smithi171 bash[25040]: audit 2024-09-14T01:40:25.071640+0000 mgr.a (mgr.14355) 8630 : audit [DBG] from='client.192894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:26 smithi007 bash[22722]: audit 2024-09-14T01:40:25.071640+0000 mgr.a (mgr.14355) 8630 : audit [DBG] from='client.192894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:27 smithi171 bash[25040]: cluster 2024-09-14T01:40:26.247118+0000 mgr.a (mgr.14355) 8631 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:27 smithi007 bash[22722]: cluster 2024-09-14T01:40:26.247118+0000 mgr.a (mgr.14355) 8631 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:27 smithi131 bash[24745]: cluster 2024-09-14T01:40:26.247118+0000 mgr.a (mgr.14355) 8631 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:29 smithi171 bash[25040]: cluster 2024-09-14T01:40:28.247891+0000 mgr.a (mgr.14355) 8632 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:29 smithi007 bash[22722]: cluster 2024-09-14T01:40:28.247891+0000 mgr.a (mgr.14355) 8632 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:29 smithi131 bash[24745]: cluster 2024-09-14T01:40:28.247891+0000 mgr.a (mgr.14355) 8632 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:30.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:30.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:30.516 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:31.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:31.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:31 smithi007 bash[22722]: cluster 2024-09-14T01:40:30.249411+0000 mgr.a (mgr.14355) 8633 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:32.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:31 smithi131 bash[24745]: cluster 2024-09-14T01:40:30.249411+0000 mgr.a (mgr.14355) 8633 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:31 smithi171 bash[25040]: cluster 2024-09-14T01:40:30.249411+0000 mgr.a (mgr.14355) 8633 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:32 smithi007 bash[22722]: audit 2024-09-14T01:40:30.848031+0000 mgr.a (mgr.14355) 8634 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:32 smithi131 bash[24745]: audit 2024-09-14T01:40:30.848031+0000 mgr.a (mgr.14355) 8634 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:32 smithi171 bash[25040]: audit 2024-09-14T01:40:30.848031+0000 mgr.a (mgr.14355) 8634 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:33 smithi007 bash[22722]: cluster 2024-09-14T01:40:32.251144+0000 mgr.a (mgr.14355) 8635 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:33 smithi131 bash[24745]: cluster 2024-09-14T01:40:32.251144+0000 mgr.a (mgr.14355) 8635 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:33 smithi171 bash[25040]: cluster 2024-09-14T01:40:32.251144+0000 mgr.a (mgr.14355) 8635 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:40:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:34 smithi007 bash[22722]: cluster 2024-09-14T01:40:34.252064+0000 mgr.a (mgr.14355) 8636 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:34 smithi131 bash[24745]: cluster 2024-09-14T01:40:34.252064+0000 mgr.a (mgr.14355) 8636 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:34 smithi171 bash[25040]: cluster 2024-09-14T01:40:34.252064+0000 mgr.a (mgr.14355) 8636 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:40:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:37.033 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:37 smithi007 bash[22722]: cluster 2024-09-14T01:40:36.254129+0000 mgr.a (mgr.14355) 8637 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:37 smithi007 bash[22722]: audit 2024-09-14T01:40:36.593677+0000 mgr.a (mgr.14355) 8638 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:37 smithi131 bash[24745]: cluster 2024-09-14T01:40:36.254129+0000 mgr.a (mgr.14355) 8637 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:37 smithi131 bash[24745]: audit 2024-09-14T01:40:36.593677+0000 mgr.a (mgr.14355) 8638 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:37 smithi171 bash[25040]: cluster 2024-09-14T01:40:36.254129+0000 mgr.a (mgr.14355) 8637 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:37 smithi171 bash[25040]: audit 2024-09-14T01:40:36.593677+0000 mgr.a (mgr.14355) 8638 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:39 smithi007 bash[22722]: cluster 2024-09-14T01:40:38.255019+0000 mgr.a (mgr.14355) 8639 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:39 smithi131 bash[24745]: cluster 2024-09-14T01:40:38.255019+0000 mgr.a (mgr.14355) 8639 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:39 smithi171 bash[25040]: cluster 2024-09-14T01:40:38.255019+0000 mgr.a (mgr.14355) 8639 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:40:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:41 smithi007 bash[22722]: cluster 2024-09-14T01:40:40.256795+0000 mgr.a (mgr.14355) 8640 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:40:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:41 smithi131 bash[24745]: cluster 2024-09-14T01:40:40.256795+0000 mgr.a (mgr.14355) 8640 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:40:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:41 smithi171 bash[25040]: cluster 2024-09-14T01:40:40.256795+0000 mgr.a (mgr.14355) 8640 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T01:40:42.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:42.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:42.036 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:42.808 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:43 smithi007 bash[22722]: cluster 2024-09-14T01:40:42.257979+0000 mgr.a (mgr.14355) 8641 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:43 smithi007 bash[22722]: audit 2024-09-14T01:40:42.374555+0000 mgr.a (mgr.14355) 8642 : audit [DBG] from='client.193122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:43 smithi131 bash[24745]: cluster 2024-09-14T01:40:42.257979+0000 mgr.a (mgr.14355) 8641 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:43 smithi131 bash[24745]: audit 2024-09-14T01:40:42.374555+0000 mgr.a (mgr.14355) 8642 : audit [DBG] from='client.193122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:43 smithi171 bash[25040]: cluster 2024-09-14T01:40:42.257979+0000 mgr.a (mgr.14355) 8641 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:43 smithi171 bash[25040]: audit 2024-09-14T01:40:42.374555+0000 mgr.a (mgr.14355) 8642 : audit [DBG] from='client.193122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:45 smithi007 bash[22722]: cluster 2024-09-14T01:40:44.258892+0000 mgr.a (mgr.14355) 8643 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:45 smithi131 bash[24745]: cluster 2024-09-14T01:40:44.258892+0000 mgr.a (mgr.14355) 8643 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:45 smithi171 bash[25040]: cluster 2024-09-14T01:40:44.258892+0000 mgr.a (mgr.14355) 8643 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:47 smithi007 bash[22722]: cluster 2024-09-14T01:40:46.261139+0000 mgr.a (mgr.14355) 8644 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:47 smithi131 bash[24745]: cluster 2024-09-14T01:40:46.261139+0000 mgr.a (mgr.14355) 8644 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:47 smithi171 bash[25040]: cluster 2024-09-14T01:40:46.261139+0000 mgr.a (mgr.14355) 8644 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:47.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:47.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:48.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:49 smithi007 bash[22722]: audit 2024-09-14T01:40:48.133040+0000 mgr.a (mgr.14355) 8645 : audit [DBG] from='client.193197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:49 smithi007 bash[22722]: cluster 2024-09-14T01:40:48.261697+0000 mgr.a (mgr.14355) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:49 smithi131 bash[24745]: audit 2024-09-14T01:40:48.133040+0000 mgr.a (mgr.14355) 8645 : audit [DBG] from='client.193197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:49 smithi131 bash[24745]: cluster 2024-09-14T01:40:48.261697+0000 mgr.a (mgr.14355) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:49 smithi171 bash[25040]: audit 2024-09-14T01:40:48.133040+0000 mgr.a (mgr.14355) 8645 : audit [DBG] from='client.193197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:49 smithi171 bash[25040]: cluster 2024-09-14T01:40:48.261697+0000 mgr.a (mgr.14355) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:51 smithi007 bash[22722]: cluster 2024-09-14T01:40:50.263491+0000 mgr.a (mgr.14355) 8647 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:51 smithi131 bash[24745]: cluster 2024-09-14T01:40:50.263491+0000 mgr.a (mgr.14355) 8647 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:51 smithi171 bash[25040]: cluster 2024-09-14T01:40:50.263491+0000 mgr.a (mgr.14355) 8647 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:53 smithi131 bash[24745]: cluster 2024-09-14T01:40:52.264777+0000 mgr.a (mgr.14355) 8648 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:53 smithi171 bash[25040]: cluster 2024-09-14T01:40:52.264777+0000 mgr.a (mgr.14355) 8648 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:53 smithi007 bash[22722]: cluster 2024-09-14T01:40:52.264777+0000 mgr.a (mgr.14355) 8648 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:40:54.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:40:54.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:40:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:40:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:40:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:40:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:55 smithi131 bash[24745]: audit 2024-09-14T01:40:53.889401+0000 mgr.a (mgr.14355) 8649 : audit [DBG] from='client.193272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:55 smithi131 bash[24745]: cluster 2024-09-14T01:40:54.265314+0000 mgr.a (mgr.14355) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:55 smithi171 bash[25040]: audit 2024-09-14T01:40:53.889401+0000 mgr.a (mgr.14355) 8649 : audit [DBG] from='client.193272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:55 smithi171 bash[25040]: cluster 2024-09-14T01:40:54.265314+0000 mgr.a (mgr.14355) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:55 smithi007 bash[22722]: audit 2024-09-14T01:40:53.889401+0000 mgr.a (mgr.14355) 8649 : audit [DBG] from='client.193272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:40:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:55 smithi007 bash[22722]: cluster 2024-09-14T01:40:54.265314+0000 mgr.a (mgr.14355) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:57.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:57 smithi131 bash[24745]: cluster 2024-09-14T01:40:56.267550+0000 mgr.a (mgr.14355) 8651 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:57 smithi171 bash[25040]: cluster 2024-09-14T01:40:56.267550+0000 mgr.a (mgr.14355) 8651 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:57.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:57 smithi007 bash[22722]: cluster 2024-09-14T01:40:56.267550+0000 mgr.a (mgr.14355) 8651 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:40:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:40:59.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:40:59.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:40:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:40:59 smithi171 bash[25040]: cluster 2024-09-14T01:40:58.268305+0000 mgr.a (mgr.14355) 8652 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:40:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:40:59 smithi007 bash[22722]: cluster 2024-09-14T01:40:58.268305+0000 mgr.a (mgr.14355) 8652 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:40:59 smithi131 bash[24745]: cluster 2024-09-14T01:40:58.268305+0000 mgr.a (mgr.14355) 8652 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:00.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:00 smithi171 bash[25040]: audit 2024-09-14T01:40:59.674994+0000 mgr.a (mgr.14355) 8653 : audit [DBG] from='client.193350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:00 smithi007 bash[22722]: audit 2024-09-14T01:40:59.674994+0000 mgr.a (mgr.14355) 8653 : audit [DBG] from='client.193350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:00 smithi131 bash[24745]: audit 2024-09-14T01:40:59.674994+0000 mgr.a (mgr.14355) 8653 : audit [DBG] from='client.193350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:01 smithi007 bash[22722]: cluster 2024-09-14T01:41:00.270212+0000 mgr.a (mgr.14355) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:01 smithi131 bash[24745]: cluster 2024-09-14T01:41:00.270212+0000 mgr.a (mgr.14355) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:01 smithi171 bash[25040]: cluster 2024-09-14T01:41:00.270212+0000 mgr.a (mgr.14355) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:03 smithi007 bash[22722]: cluster 2024-09-14T01:41:02.271543+0000 mgr.a (mgr.14355) 8655 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:03 smithi131 bash[24745]: cluster 2024-09-14T01:41:02.271543+0000 mgr.a (mgr.14355) 8655 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:03 smithi171 bash[25040]: cluster 2024-09-14T01:41:02.271543+0000 mgr.a (mgr.14355) 8655 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:05.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:05.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:05.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:05.859 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:05.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:05 smithi007 bash[22722]: cluster 2024-09-14T01:41:04.272293+0000 mgr.a (mgr.14355) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:05 smithi131 bash[24745]: cluster 2024-09-14T01:41:04.272293+0000 mgr.a (mgr.14355) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:05 smithi171 bash[25040]: cluster 2024-09-14T01:41:04.272293+0000 mgr.a (mgr.14355) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:06 smithi007 bash[22722]: audit 2024-09-14T01:41:05.446197+0000 mgr.a (mgr.14355) 8657 : audit [DBG] from='client.193428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:06 smithi131 bash[24745]: audit 2024-09-14T01:41:05.446197+0000 mgr.a (mgr.14355) 8657 : audit [DBG] from='client.193428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:06 smithi171 bash[25040]: audit 2024-09-14T01:41:05.446197+0000 mgr.a (mgr.14355) 8657 : audit [DBG] from='client.193428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:07 smithi007 bash[22722]: cluster 2024-09-14T01:41:06.275121+0000 mgr.a (mgr.14355) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:07 smithi007 bash[22722]: audit 2024-09-14T01:41:07.554908+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:41:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:07 smithi131 bash[24745]: cluster 2024-09-14T01:41:06.275121+0000 mgr.a (mgr.14355) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:07 smithi131 bash[24745]: audit 2024-09-14T01:41:07.554908+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:41:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:07 smithi171 bash[25040]: cluster 2024-09-14T01:41:06.275121+0000 mgr.a (mgr.14355) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:07 smithi171 bash[25040]: audit 2024-09-14T01:41:07.554908+0000 mon.a (mon.0) 1888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:41:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:09 smithi007 bash[22722]: cluster 2024-09-14T01:41:08.275872+0000 mgr.a (mgr.14355) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:09 smithi131 bash[24745]: cluster 2024-09-14T01:41:08.275872+0000 mgr.a (mgr.14355) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:09 smithi171 bash[25040]: cluster 2024-09-14T01:41:08.275872+0000 mgr.a (mgr.14355) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:10.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:11.626 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:11 smithi007 bash[22722]: cluster 2024-09-14T01:41:10.277424+0000 mgr.a (mgr.14355) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:11 smithi131 bash[24745]: cluster 2024-09-14T01:41:10.277424+0000 mgr.a (mgr.14355) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:11 smithi171 bash[25040]: cluster 2024-09-14T01:41:10.277424+0000 mgr.a (mgr.14355) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:12 smithi007 bash[22722]: audit 2024-09-14T01:41:11.193455+0000 mgr.a (mgr.14355) 8661 : audit [DBG] from='client.193503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:12 smithi131 bash[24745]: audit 2024-09-14T01:41:11.193455+0000 mgr.a (mgr.14355) 8661 : audit [DBG] from='client.193503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:12 smithi171 bash[25040]: audit 2024-09-14T01:41:11.193455+0000 mgr.a (mgr.14355) 8661 : audit [DBG] from='client.193503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: cluster 2024-09-14T01:41:12.279194+0000 mgr.a (mgr.14355) 8662 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.891654+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.894264+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.897323+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.903150+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.937874+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:13 smithi007 bash[22722]: audit 2024-09-14T01:41:12.943793+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: cluster 2024-09-14T01:41:12.279194+0000 mgr.a (mgr.14355) 8662 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.891654+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.894264+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.897323+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.903150+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.937874+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:13 smithi131 bash[24745]: audit 2024-09-14T01:41:12.943793+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: cluster 2024-09-14T01:41:12.279194+0000 mgr.a (mgr.14355) 8662 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.891654+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.894264+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.897323+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.903150+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.937874+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:13 smithi171 bash[25040]: audit 2024-09-14T01:41:12.943793+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22972]: debug 2024-09-14T01:41:14.419+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22972]: debug 2024-09-14T01:41:14.423+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22722]: audit 2024-09-14T01:41:13.665204+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22722]: audit 2024-09-14T01:41:13.667175+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22722]: audit 2024-09-14T01:41:13.677538+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22722]: audit 2024-09-14T01:41:13.680762+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:14 smithi007 bash[22722]: audit 2024-09-14T01:41:13.682032+0000 mgr.a (mgr.14355) 8663 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:14 smithi131 bash[24745]: audit 2024-09-14T01:41:13.665204+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:41:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:14 smithi131 bash[24745]: audit 2024-09-14T01:41:13.667175+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:41:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:14 smithi131 bash[24745]: audit 2024-09-14T01:41:13.677538+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:14 smithi131 bash[24745]: audit 2024-09-14T01:41:13.680762+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:14 smithi131 bash[24745]: audit 2024-09-14T01:41:13.682032+0000 mgr.a (mgr.14355) 8663 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:14 smithi171 bash[25040]: audit 2024-09-14T01:41:13.665204+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:41:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:14 smithi171 bash[25040]: audit 2024-09-14T01:41:13.667175+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:41:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:14 smithi171 bash[25040]: audit 2024-09-14T01:41:13.677538+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:41:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:14 smithi171 bash[25040]: audit 2024-09-14T01:41:13.680762+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:14 smithi171 bash[25040]: audit 2024-09-14T01:41:13.682032+0000 mgr.a (mgr.14355) 8663 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:41:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:15 smithi007 bash[22722]: cluster 2024-09-14T01:41:14.279703+0000 mgr.a (mgr.14355) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:15 smithi007 bash[22722]: audit 2024-09-14T01:41:14.425594+0000 mgr.a (mgr.14355) 8665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:41:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:15 smithi007 bash[22722]: cephadm 2024-09-14T01:41:14.427199+0000 mgr.a (mgr.14355) 8666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:41:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:15 smithi131 bash[24745]: cluster 2024-09-14T01:41:14.279703+0000 mgr.a (mgr.14355) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:15 smithi131 bash[24745]: audit 2024-09-14T01:41:14.425594+0000 mgr.a (mgr.14355) 8665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:41:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:15 smithi131 bash[24745]: cephadm 2024-09-14T01:41:14.427199+0000 mgr.a (mgr.14355) 8666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:41:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:15 smithi171 bash[25040]: cluster 2024-09-14T01:41:14.279703+0000 mgr.a (mgr.14355) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:15 smithi171 bash[25040]: audit 2024-09-14T01:41:14.425594+0000 mgr.a (mgr.14355) 8665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:41:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:15 smithi171 bash[25040]: cephadm 2024-09-14T01:41:14.427199+0000 mgr.a (mgr.14355) 8666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:41:16.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:16.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:17.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:17.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:17 smithi007 bash[22722]: cluster 2024-09-14T01:41:16.281913+0000 mgr.a (mgr.14355) 8667 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:17 smithi131 bash[24745]: cluster 2024-09-14T01:41:16.281913+0000 mgr.a (mgr.14355) 8667 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:17 smithi171 bash[25040]: cluster 2024-09-14T01:41:16.281913+0000 mgr.a (mgr.14355) 8667 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:18 smithi007 bash[22722]: audit 2024-09-14T01:41:16.962864+0000 mgr.a (mgr.14355) 8668 : audit [DBG] from='client.193683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:18 smithi131 bash[24745]: audit 2024-09-14T01:41:16.962864+0000 mgr.a (mgr.14355) 8668 : audit [DBG] from='client.193683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:18 smithi171 bash[25040]: audit 2024-09-14T01:41:16.962864+0000 mgr.a (mgr.14355) 8668 : audit [DBG] from='client.193683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:19 smithi007 bash[22722]: cluster 2024-09-14T01:41:18.282839+0000 mgr.a (mgr.14355) 8669 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:19 smithi131 bash[24745]: cluster 2024-09-14T01:41:18.282839+0000 mgr.a (mgr.14355) 8669 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:19 smithi171 bash[25040]: cluster 2024-09-14T01:41:18.282839+0000 mgr.a (mgr.14355) 8669 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:21 smithi007 bash[22722]: cluster 2024-09-14T01:41:20.284592+0000 mgr.a (mgr.14355) 8670 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:21 smithi131 bash[24745]: cluster 2024-09-14T01:41:20.284592+0000 mgr.a (mgr.14355) 8670 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:21 smithi171 bash[25040]: cluster 2024-09-14T01:41:20.284592+0000 mgr.a (mgr.14355) 8670 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:23.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:23.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:23.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:23.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:23.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:23 smithi007 bash[22722]: cluster 2024-09-14T01:41:22.285864+0000 mgr.a (mgr.14355) 8671 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:23 smithi007 bash[22722]: audit 2024-09-14T01:41:22.729747+0000 mgr.a (mgr.14355) 8672 : audit [DBG] from='client.193761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:23 smithi131 bash[24745]: cluster 2024-09-14T01:41:22.285864+0000 mgr.a (mgr.14355) 8671 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:23 smithi131 bash[24745]: audit 2024-09-14T01:41:22.729747+0000 mgr.a (mgr.14355) 8672 : audit [DBG] from='client.193761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:23 smithi171 bash[25040]: cluster 2024-09-14T01:41:22.285864+0000 mgr.a (mgr.14355) 8671 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:23 smithi171 bash[25040]: audit 2024-09-14T01:41:22.729747+0000 mgr.a (mgr.14355) 8672 : audit [DBG] from='client.193761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:25 smithi131 bash[24745]: cluster 2024-09-14T01:41:24.286770+0000 mgr.a (mgr.14355) 8673 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:25 smithi171 bash[25040]: cluster 2024-09-14T01:41:24.286770+0000 mgr.a (mgr.14355) 8673 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:25 smithi007 bash[22722]: cluster 2024-09-14T01:41:24.286770+0000 mgr.a (mgr.14355) 8673 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:27 smithi131 bash[24745]: cluster 2024-09-14T01:41:26.289030+0000 mgr.a (mgr.14355) 8674 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:27 smithi171 bash[25040]: cluster 2024-09-14T01:41:26.289030+0000 mgr.a (mgr.14355) 8674 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:28.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:28.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:27 smithi007 bash[22722]: cluster 2024-09-14T01:41:26.289030+0000 mgr.a (mgr.14355) 8674 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:41:28.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:28.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:28.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:28.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:28.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:29 smithi131 bash[24745]: cluster 2024-09-14T01:41:28.289523+0000 mgr.a (mgr.14355) 8675 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:29 smithi131 bash[24745]: audit 2024-09-14T01:41:28.477831+0000 mgr.a (mgr.14355) 8676 : audit [DBG] from='client.193839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:29 smithi171 bash[25040]: cluster 2024-09-14T01:41:28.289523+0000 mgr.a (mgr.14355) 8675 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:29 smithi171 bash[25040]: audit 2024-09-14T01:41:28.477831+0000 mgr.a (mgr.14355) 8676 : audit [DBG] from='client.193839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:29 smithi007 bash[22722]: cluster 2024-09-14T01:41:28.289523+0000 mgr.a (mgr.14355) 8675 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:29 smithi007 bash[22722]: audit 2024-09-14T01:41:28.477831+0000 mgr.a (mgr.14355) 8676 : audit [DBG] from='client.193839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:31 smithi131 bash[24745]: cluster 2024-09-14T01:41:30.291391+0000 mgr.a (mgr.14355) 8677 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:31 smithi171 bash[25040]: cluster 2024-09-14T01:41:30.291391+0000 mgr.a (mgr.14355) 8677 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:31 smithi007 bash[22722]: cluster 2024-09-14T01:41:30.291391+0000 mgr.a (mgr.14355) 8677 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:33.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:33.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:33.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:33 smithi131 bash[24745]: cluster 2024-09-14T01:41:32.292635+0000 mgr.a (mgr.14355) 8678 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:33 smithi171 bash[25040]: cluster 2024-09-14T01:41:32.292635+0000 mgr.a (mgr.14355) 8678 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:33 smithi007 bash[22722]: cluster 2024-09-14T01:41:32.292635+0000 mgr.a (mgr.14355) 8678 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:41:34.667 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:35 smithi131 bash[24745]: audit 2024-09-14T01:41:34.234581+0000 mgr.a (mgr.14355) 8679 : audit [DBG] from='client.193917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:35 smithi131 bash[24745]: cluster 2024-09-14T01:41:34.293226+0000 mgr.a (mgr.14355) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:35 smithi171 bash[25040]: audit 2024-09-14T01:41:34.234581+0000 mgr.a (mgr.14355) 8679 : audit [DBG] from='client.193917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:35 smithi171 bash[25040]: cluster 2024-09-14T01:41:34.293226+0000 mgr.a (mgr.14355) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:35 smithi007 bash[22722]: audit 2024-09-14T01:41:34.234581+0000 mgr.a (mgr.14355) 8679 : audit [DBG] from='client.193917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:35 smithi007 bash[22722]: cluster 2024-09-14T01:41:34.293226+0000 mgr.a (mgr.14355) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:37 smithi131 bash[24745]: cluster 2024-09-14T01:41:36.295583+0000 mgr.a (mgr.14355) 8681 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:37 smithi171 bash[25040]: cluster 2024-09-14T01:41:36.295583+0000 mgr.a (mgr.14355) 8681 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:37 smithi007 bash[22722]: cluster 2024-09-14T01:41:36.295583+0000 mgr.a (mgr.14355) 8681 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:39.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:39.669 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:39.669 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:39 smithi131 bash[24745]: cluster 2024-09-14T01:41:38.296361+0000 mgr.a (mgr.14355) 8682 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:39 smithi171 bash[25040]: cluster 2024-09-14T01:41:38.296361+0000 mgr.a (mgr.14355) 8682 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:39 smithi007 bash[22722]: cluster 2024-09-14T01:41:38.296361+0000 mgr.a (mgr.14355) 8682 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:40.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:40.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:41 smithi131 bash[24745]: audit 2024-09-14T01:41:40.007140+0000 mgr.a (mgr.14355) 8683 : audit [DBG] from='client.193989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:41 smithi131 bash[24745]: cluster 2024-09-14T01:41:40.297549+0000 mgr.a (mgr.14355) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:41 smithi171 bash[25040]: audit 2024-09-14T01:41:40.007140+0000 mgr.a (mgr.14355) 8683 : audit [DBG] from='client.193989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:41 smithi171 bash[25040]: cluster 2024-09-14T01:41:40.297549+0000 mgr.a (mgr.14355) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:41 smithi007 bash[22722]: audit 2024-09-14T01:41:40.007140+0000 mgr.a (mgr.14355) 8683 : audit [DBG] from='client.193989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:41 smithi007 bash[22722]: cluster 2024-09-14T01:41:40.297549+0000 mgr.a (mgr.14355) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:43 smithi131 bash[24745]: cluster 2024-09-14T01:41:42.299062+0000 mgr.a (mgr.14355) 8685 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:41:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:43 smithi171 bash[25040]: cluster 2024-09-14T01:41:42.299062+0000 mgr.a (mgr.14355) 8685 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:41:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:43 smithi007 bash[22722]: cluster 2024-09-14T01:41:42.299062+0000 mgr.a (mgr.14355) 8685 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:41:45.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:45.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:45 smithi131 bash[24745]: cluster 2024-09-14T01:41:44.299840+0000 mgr.a (mgr.14355) 8686 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:45 smithi171 bash[25040]: cluster 2024-09-14T01:41:44.299840+0000 mgr.a (mgr.14355) 8686 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:45 smithi007 bash[22722]: cluster 2024-09-14T01:41:44.299840+0000 mgr.a (mgr.14355) 8686 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:41:46.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:46.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:46.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:46.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:46.205 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:46 smithi131 bash[24745]: audit 2024-09-14T01:41:45.786936+0000 mgr.a (mgr.14355) 8687 : audit [DBG] from='client.194067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:46 smithi171 bash[25040]: audit 2024-09-14T01:41:45.786936+0000 mgr.a (mgr.14355) 8687 : audit [DBG] from='client.194067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:46 smithi007 bash[22722]: audit 2024-09-14T01:41:45.786936+0000 mgr.a (mgr.14355) 8687 : audit [DBG] from='client.194067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:47 smithi131 bash[24745]: cluster 2024-09-14T01:41:46.302676+0000 mgr.a (mgr.14355) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:47 smithi171 bash[25040]: cluster 2024-09-14T01:41:46.302676+0000 mgr.a (mgr.14355) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:47 smithi007 bash[22722]: cluster 2024-09-14T01:41:46.302676+0000 mgr.a (mgr.14355) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:49 smithi131 bash[24745]: cluster 2024-09-14T01:41:48.303438+0000 mgr.a (mgr.14355) 8689 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:49 smithi171 bash[25040]: cluster 2024-09-14T01:41:48.303438+0000 mgr.a (mgr.14355) 8689 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:49 smithi007 bash[22722]: cluster 2024-09-14T01:41:48.303438+0000 mgr.a (mgr.14355) 8689 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:41:51.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:51.207 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:51.973 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:51.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:51 smithi131 bash[24745]: cluster 2024-09-14T01:41:50.304966+0000 mgr.a (mgr.14355) 8690 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:51 smithi171 bash[25040]: cluster 2024-09-14T01:41:50.304966+0000 mgr.a (mgr.14355) 8690 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:51 smithi007 bash[22722]: cluster 2024-09-14T01:41:50.304966+0000 mgr.a (mgr.14355) 8690 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:52 smithi131 bash[24745]: audit 2024-09-14T01:41:51.541321+0000 mgr.a (mgr.14355) 8691 : audit [DBG] from='client.194145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:52 smithi171 bash[25040]: audit 2024-09-14T01:41:51.541321+0000 mgr.a (mgr.14355) 8691 : audit [DBG] from='client.194145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:52 smithi007 bash[22722]: audit 2024-09-14T01:41:51.541321+0000 mgr.a (mgr.14355) 8691 : audit [DBG] from='client.194145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:53 smithi131 bash[24745]: cluster 2024-09-14T01:41:52.306723+0000 mgr.a (mgr.14355) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:53 smithi171 bash[25040]: cluster 2024-09-14T01:41:52.306723+0000 mgr.a (mgr.14355) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:53 smithi007 bash[22722]: cluster 2024-09-14T01:41:52.306723+0000 mgr.a (mgr.14355) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:41:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:55 smithi131 bash[24745]: cluster 2024-09-14T01:41:54.307501+0000 mgr.a (mgr.14355) 8693 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:55 smithi171 bash[25040]: cluster 2024-09-14T01:41:54.307501+0000 mgr.a (mgr.14355) 8693 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:55 smithi007 bash[22722]: cluster 2024-09-14T01:41:54.307501+0000 mgr.a (mgr.14355) 8693 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:41:56.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:41:56.975 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:41:56.975 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:41:57.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:41:57.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:41:57.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:41:57.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:41:57.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:41:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:57 smithi171 bash[25040]: cluster 2024-09-14T01:41:56.309566+0000 mgr.a (mgr.14355) 8694 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:57 smithi007 bash[22722]: cluster 2024-09-14T01:41:56.309566+0000 mgr.a (mgr.14355) 8694 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:57 smithi131 bash[24745]: cluster 2024-09-14T01:41:56.309566+0000 mgr.a (mgr.14355) 8694 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:41:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:58 smithi171 bash[25040]: audit 2024-09-14T01:41:57.305400+0000 mgr.a (mgr.14355) 8695 : audit [DBG] from='client.194223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:58 smithi007 bash[22722]: audit 2024-09-14T01:41:57.305400+0000 mgr.a (mgr.14355) 8695 : audit [DBG] from='client.194223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:41:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:58 smithi131 bash[24745]: audit 2024-09-14T01:41:57.305400+0000 mgr.a (mgr.14355) 8695 : audit [DBG] from='client.194223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:41:59 smithi007 bash[22722]: cluster 2024-09-14T01:41:58.310467+0000 mgr.a (mgr.14355) 8696 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:41:59 smithi131 bash[24745]: cluster 2024-09-14T01:41:58.310467+0000 mgr.a (mgr.14355) 8696 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:41:59 smithi171 bash[25040]: cluster 2024-09-14T01:41:58.310467+0000 mgr.a (mgr.14355) 8696 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:01 smithi007 bash[22722]: cluster 2024-09-14T01:42:00.312241+0000 mgr.a (mgr.14355) 8697 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T01:42:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:01 smithi131 bash[24745]: cluster 2024-09-14T01:42:00.312241+0000 mgr.a (mgr.14355) 8697 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T01:42:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:01 smithi171 bash[25040]: cluster 2024-09-14T01:42:00.312241+0000 mgr.a (mgr.14355) 8697 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T01:42:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:02.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:03.491 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:03.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:03.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:03 smithi007 bash[22722]: cluster 2024-09-14T01:42:02.313509+0000 mgr.a (mgr.14355) 8698 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:03 smithi131 bash[24745]: cluster 2024-09-14T01:42:02.313509+0000 mgr.a (mgr.14355) 8698 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:03 smithi171 bash[25040]: cluster 2024-09-14T01:42:02.313509+0000 mgr.a (mgr.14355) 8698 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:04 smithi007 bash[22722]: audit 2024-09-14T01:42:03.050614+0000 mgr.a (mgr.14355) 8699 : audit [DBG] from='client.194298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:04 smithi131 bash[24745]: audit 2024-09-14T01:42:03.050614+0000 mgr.a (mgr.14355) 8699 : audit [DBG] from='client.194298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:04 smithi171 bash[25040]: audit 2024-09-14T01:42:03.050614+0000 mgr.a (mgr.14355) 8699 : audit [DBG] from='client.194298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:05 smithi007 bash[22722]: cluster 2024-09-14T01:42:04.314462+0000 mgr.a (mgr.14355) 8700 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:05 smithi131 bash[24745]: cluster 2024-09-14T01:42:04.314462+0000 mgr.a (mgr.14355) 8700 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:05 smithi171 bash[25040]: cluster 2024-09-14T01:42:04.314462+0000 mgr.a (mgr.14355) 8700 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:07 smithi007 bash[22722]: cluster 2024-09-14T01:42:06.316750+0000 mgr.a (mgr.14355) 8701 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:42:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:07 smithi131 bash[24745]: cluster 2024-09-14T01:42:06.316750+0000 mgr.a (mgr.14355) 8701 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:42:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:07 smithi171 bash[25040]: cluster 2024-09-14T01:42:06.316750+0000 mgr.a (mgr.14355) 8701 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:42:08.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:08.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:08.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:09.267 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:09.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:09.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:09 smithi007 bash[22722]: cluster 2024-09-14T01:42:08.317495+0000 mgr.a (mgr.14355) 8702 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:09 smithi007 bash[22722]: audit 2024-09-14T01:42:08.827747+0000 mgr.a (mgr.14355) 8703 : audit [DBG] from='client.194373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:09 smithi131 bash[24745]: cluster 2024-09-14T01:42:08.317495+0000 mgr.a (mgr.14355) 8702 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:09 smithi131 bash[24745]: audit 2024-09-14T01:42:08.827747+0000 mgr.a (mgr.14355) 8703 : audit [DBG] from='client.194373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:09 smithi171 bash[25040]: cluster 2024-09-14T01:42:08.317495+0000 mgr.a (mgr.14355) 8702 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:42:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:09 smithi171 bash[25040]: audit 2024-09-14T01:42:08.827747+0000 mgr.a (mgr.14355) 8703 : audit [DBG] from='client.194373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:11 smithi007 bash[22722]: cluster 2024-09-14T01:42:10.319391+0000 mgr.a (mgr.14355) 8704 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T01:42:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:11 smithi131 bash[24745]: cluster 2024-09-14T01:42:10.319391+0000 mgr.a (mgr.14355) 8704 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T01:42:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:11 smithi171 bash[25040]: cluster 2024-09-14T01:42:10.319391+0000 mgr.a (mgr.14355) 8704 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T01:42:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:12 smithi007 bash[22722]: cluster 2024-09-14T01:42:12.320664+0000 mgr.a (mgr.14355) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:42:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:12 smithi131 bash[24745]: cluster 2024-09-14T01:42:12.320664+0000 mgr.a (mgr.14355) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:42:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:12 smithi171 bash[25040]: cluster 2024-09-14T01:42:12.320664+0000 mgr.a (mgr.14355) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T01:42:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:14.269 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:14.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:15.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:15.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: cluster 2024-09-14T01:42:14.321443+0000 mgr.a (mgr.14355) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:14.479312+0000 mon.a (mon.0) 1899 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:14.632364+0000 mgr.a (mgr.14355) 8707 : audit [DBG] from='client.194445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:15.275223+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:15.277012+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:15.287141+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:15 smithi007 bash[22722]: audit 2024-09-14T01:42:15.292096+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: cluster 2024-09-14T01:42:14.321443+0000 mgr.a (mgr.14355) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:14.479312+0000 mon.a (mon.0) 1899 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:14.632364+0000 mgr.a (mgr.14355) 8707 : audit [DBG] from='client.194445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:15.275223+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:15.277012+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:15.287141+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:15 smithi131 bash[24745]: audit 2024-09-14T01:42:15.292096+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: cluster 2024-09-14T01:42:14.321443+0000 mgr.a (mgr.14355) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:14.479312+0000 mon.a (mon.0) 1899 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:42:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:14.632364+0000 mgr.a (mgr.14355) 8707 : audit [DBG] from='client.194445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:15.275223+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:42:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:15.277012+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:42:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:15.287141+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:42:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:15 smithi171 bash[25040]: audit 2024-09-14T01:42:15.292096+0000 mon.a (mon.0) 1903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:16.389 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:42:16 smithi007 bash[22972]: debug 2024-09-14T01:42:16.018+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:42:16.390 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:42:16 smithi007 bash[22972]: debug 2024-09-14T01:42:16.026+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:42:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:16 smithi007 bash[22722]: audit 2024-09-14T01:42:15.294650+0000 mgr.a (mgr.14355) 8708 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:16 smithi131 bash[24745]: audit 2024-09-14T01:42:15.294650+0000 mgr.a (mgr.14355) 8708 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:16 smithi171 bash[25040]: audit 2024-09-14T01:42:15.294650+0000 mgr.a (mgr.14355) 8708 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:42:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:17 smithi007 bash[22722]: audit 2024-09-14T01:42:16.024355+0000 mgr.a (mgr.14355) 8709 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:42:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:17 smithi007 bash[22722]: cephadm 2024-09-14T01:42:16.026353+0000 mgr.a (mgr.14355) 8710 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:42:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:17 smithi007 bash[22722]: cluster 2024-09-14T01:42:16.324292+0000 mgr.a (mgr.14355) 8711 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:42:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:17 smithi131 bash[24745]: audit 2024-09-14T01:42:16.024355+0000 mgr.a (mgr.14355) 8709 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:42:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:17 smithi131 bash[24745]: cephadm 2024-09-14T01:42:16.026353+0000 mgr.a (mgr.14355) 8710 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:42:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:17 smithi131 bash[24745]: cluster 2024-09-14T01:42:16.324292+0000 mgr.a (mgr.14355) 8711 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:42:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:17 smithi171 bash[25040]: audit 2024-09-14T01:42:16.024355+0000 mgr.a (mgr.14355) 8709 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:42:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:17 smithi171 bash[25040]: cephadm 2024-09-14T01:42:16.026353+0000 mgr.a (mgr.14355) 8710 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:42:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:17 smithi171 bash[25040]: cluster 2024-09-14T01:42:16.324292+0000 mgr.a (mgr.14355) 8711 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:42:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:19 smithi007 bash[22722]: cluster 2024-09-14T01:42:18.325081+0000 mgr.a (mgr.14355) 8712 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:19 smithi131 bash[24745]: cluster 2024-09-14T01:42:18.325081+0000 mgr.a (mgr.14355) 8712 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:19 smithi171 bash[25040]: cluster 2024-09-14T01:42:18.325081+0000 mgr.a (mgr.14355) 8712 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:42:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:20.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:20.808 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:20.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:21 smithi007 bash[22722]: cluster 2024-09-14T01:42:20.326749+0000 mgr.a (mgr.14355) 8713 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T01:42:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:21 smithi007 bash[22722]: audit 2024-09-14T01:42:20.396243+0000 mgr.a (mgr.14355) 8714 : audit [DBG] from='client.194622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:21 smithi131 bash[24745]: cluster 2024-09-14T01:42:20.326749+0000 mgr.a (mgr.14355) 8713 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T01:42:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:21 smithi131 bash[24745]: audit 2024-09-14T01:42:20.396243+0000 mgr.a (mgr.14355) 8714 : audit [DBG] from='client.194622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:21 smithi171 bash[25040]: cluster 2024-09-14T01:42:20.326749+0000 mgr.a (mgr.14355) 8713 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T01:42:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:21 smithi171 bash[25040]: audit 2024-09-14T01:42:20.396243+0000 mgr.a (mgr.14355) 8714 : audit [DBG] from='client.194622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:23 smithi007 bash[22722]: cluster 2024-09-14T01:42:22.328563+0000 mgr.a (mgr.14355) 8715 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 426 B/s wr, 30 op/s 2024-09-14T01:42:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:23 smithi131 bash[24745]: cluster 2024-09-14T01:42:22.328563+0000 mgr.a (mgr.14355) 8715 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 426 B/s wr, 30 op/s 2024-09-14T01:42:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:23 smithi171 bash[25040]: cluster 2024-09-14T01:42:22.328563+0000 mgr.a (mgr.14355) 8715 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 426 B/s wr, 30 op/s 2024-09-14T01:42:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:25 smithi007 bash[22722]: cluster 2024-09-14T01:42:24.329360+0000 mgr.a (mgr.14355) 8716 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:25 smithi131 bash[24745]: cluster 2024-09-14T01:42:24.329360+0000 mgr.a (mgr.14355) 8716 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:25 smithi171 bash[25040]: cluster 2024-09-14T01:42:24.329360+0000 mgr.a (mgr.14355) 8716 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:25.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:26.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:26.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:27 smithi007 bash[22722]: audit 2024-09-14T01:42:26.142384+0000 mgr.a (mgr.14355) 8717 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:27 smithi007 bash[22722]: cluster 2024-09-14T01:42:26.330682+0000 mgr.a (mgr.14355) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:42:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:27 smithi131 bash[24745]: audit 2024-09-14T01:42:26.142384+0000 mgr.a (mgr.14355) 8717 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:27 smithi131 bash[24745]: cluster 2024-09-14T01:42:26.330682+0000 mgr.a (mgr.14355) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:42:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:27 smithi171 bash[25040]: audit 2024-09-14T01:42:26.142384+0000 mgr.a (mgr.14355) 8717 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:27 smithi171 bash[25040]: cluster 2024-09-14T01:42:26.330682+0000 mgr.a (mgr.14355) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:42:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:29 smithi007 bash[22722]: cluster 2024-09-14T01:42:28.331679+0000 mgr.a (mgr.14355) 8719 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:29 smithi131 bash[24745]: cluster 2024-09-14T01:42:28.331679+0000 mgr.a (mgr.14355) 8719 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:29 smithi171 bash[25040]: cluster 2024-09-14T01:42:28.331679+0000 mgr.a (mgr.14355) 8719 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:31.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:31.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:31.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:31 smithi007 bash[22722]: cluster 2024-09-14T01:42:30.333584+0000 mgr.a (mgr.14355) 8720 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:31 smithi131 bash[24745]: cluster 2024-09-14T01:42:30.333584+0000 mgr.a (mgr.14355) 8720 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:31 smithi171 bash[25040]: cluster 2024-09-14T01:42:30.333584+0000 mgr.a (mgr.14355) 8720 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:42:32.302 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:32.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:33 smithi007 bash[22722]: audit 2024-09-14T01:42:31.890934+0000 mgr.a (mgr.14355) 8721 : audit [DBG] from='client.194775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:33 smithi007 bash[22722]: cluster 2024-09-14T01:42:32.334646+0000 mgr.a (mgr.14355) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:42:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:33 smithi131 bash[24745]: audit 2024-09-14T01:42:31.890934+0000 mgr.a (mgr.14355) 8721 : audit [DBG] from='client.194775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:33 smithi131 bash[24745]: cluster 2024-09-14T01:42:32.334646+0000 mgr.a (mgr.14355) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:42:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:33 smithi171 bash[25040]: audit 2024-09-14T01:42:31.890934+0000 mgr.a (mgr.14355) 8721 : audit [DBG] from='client.194775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:33 smithi171 bash[25040]: cluster 2024-09-14T01:42:32.334646+0000 mgr.a (mgr.14355) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:42:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:35 smithi007 bash[22722]: cluster 2024-09-14T01:42:34.335401+0000 mgr.a (mgr.14355) 8723 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:35 smithi131 bash[24745]: cluster 2024-09-14T01:42:34.335401+0000 mgr.a (mgr.14355) 8723 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:35 smithi171 bash[25040]: cluster 2024-09-14T01:42:34.335401+0000 mgr.a (mgr.14355) 8723 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:37.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:37.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:37 smithi007 bash[22722]: cluster 2024-09-14T01:42:36.337505+0000 mgr.a (mgr.14355) 8724 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:37 smithi131 bash[24745]: cluster 2024-09-14T01:42:36.337505+0000 mgr.a (mgr.14355) 8724 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:37 smithi171 bash[25040]: cluster 2024-09-14T01:42:36.337505+0000 mgr.a (mgr.14355) 8724 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:38.096 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:38 smithi007 bash[22722]: audit 2024-09-14T01:42:37.639725+0000 mgr.a (mgr.14355) 8725 : audit [DBG] from='client.194853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:38 smithi131 bash[24745]: audit 2024-09-14T01:42:37.639725+0000 mgr.a (mgr.14355) 8725 : audit [DBG] from='client.194853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:38 smithi171 bash[25040]: audit 2024-09-14T01:42:37.639725+0000 mgr.a (mgr.14355) 8725 : audit [DBG] from='client.194853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:39 smithi007 bash[22722]: cluster 2024-09-14T01:42:38.338675+0000 mgr.a (mgr.14355) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:39 smithi131 bash[24745]: cluster 2024-09-14T01:42:38.338675+0000 mgr.a (mgr.14355) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:39 smithi171 bash[25040]: cluster 2024-09-14T01:42:38.338675+0000 mgr.a (mgr.14355) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:41 smithi007 bash[22722]: cluster 2024-09-14T01:42:40.340519+0000 mgr.a (mgr.14355) 8727 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:41 smithi131 bash[24745]: cluster 2024-09-14T01:42:40.340519+0000 mgr.a (mgr.14355) 8727 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:41 smithi171 bash[25040]: cluster 2024-09-14T01:42:40.340519+0000 mgr.a (mgr.14355) 8727 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:43.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:43.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:43 smithi007 bash[22722]: cluster 2024-09-14T01:42:42.341801+0000 mgr.a (mgr.14355) 8728 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:43 smithi131 bash[24745]: cluster 2024-09-14T01:42:42.341801+0000 mgr.a (mgr.14355) 8728 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:43 smithi171 bash[25040]: cluster 2024-09-14T01:42:42.341801+0000 mgr.a (mgr.14355) 8728 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:43.838 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:43.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:43.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:44 smithi131 bash[24745]: audit 2024-09-14T01:42:43.426282+0000 mgr.a (mgr.14355) 8729 : audit [DBG] from='client.194928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:44 smithi171 bash[25040]: audit 2024-09-14T01:42:43.426282+0000 mgr.a (mgr.14355) 8729 : audit [DBG] from='client.194928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:44 smithi007 bash[22722]: audit 2024-09-14T01:42:43.426282+0000 mgr.a (mgr.14355) 8729 : audit [DBG] from='client.194928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:45 smithi131 bash[24745]: cluster 2024-09-14T01:42:44.342814+0000 mgr.a (mgr.14355) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:45 smithi171 bash[25040]: cluster 2024-09-14T01:42:44.342814+0000 mgr.a (mgr.14355) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:45 smithi007 bash[22722]: cluster 2024-09-14T01:42:44.342814+0000 mgr.a (mgr.14355) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:47 smithi131 bash[24745]: cluster 2024-09-14T01:42:46.345097+0000 mgr.a (mgr.14355) 8731 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:47 smithi171 bash[25040]: cluster 2024-09-14T01:42:46.345097+0000 mgr.a (mgr.14355) 8731 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:47 smithi007 bash[22722]: cluster 2024-09-14T01:42:46.345097+0000 mgr.a (mgr.14355) 8731 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:48.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:48.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:48.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:49.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:49.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:49.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:49.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:49.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:49 smithi007 bash[22722]: cluster 2024-09-14T01:42:48.345877+0000 mgr.a (mgr.14355) 8732 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:49 smithi131 bash[24745]: cluster 2024-09-14T01:42:48.345877+0000 mgr.a (mgr.14355) 8732 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:49 smithi171 bash[25040]: cluster 2024-09-14T01:42:48.345877+0000 mgr.a (mgr.14355) 8732 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:50 smithi007 bash[22722]: audit 2024-09-14T01:42:49.170631+0000 mgr.a (mgr.14355) 8733 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:50 smithi131 bash[24745]: audit 2024-09-14T01:42:49.170631+0000 mgr.a (mgr.14355) 8733 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:50 smithi171 bash[25040]: audit 2024-09-14T01:42:49.170631+0000 mgr.a (mgr.14355) 8733 : audit [DBG] from='client.195006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:51 smithi007 bash[22722]: cluster 2024-09-14T01:42:50.347820+0000 mgr.a (mgr.14355) 8734 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:51 smithi131 bash[24745]: cluster 2024-09-14T01:42:50.347820+0000 mgr.a (mgr.14355) 8734 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:51 smithi171 bash[25040]: cluster 2024-09-14T01:42:50.347820+0000 mgr.a (mgr.14355) 8734 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:42:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:53 smithi007 bash[22722]: cluster 2024-09-14T01:42:52.349130+0000 mgr.a (mgr.14355) 8735 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:53 smithi131 bash[24745]: cluster 2024-09-14T01:42:52.349130+0000 mgr.a (mgr.14355) 8735 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:53 smithi171 bash[25040]: cluster 2024-09-14T01:42:52.349130+0000 mgr.a (mgr.14355) 8735 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:42:54.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:42:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:42:54.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:42:55.345 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:42:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:42:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:42:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:42:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:42:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:55 smithi007 bash[22722]: cluster 2024-09-14T01:42:54.349922+0000 mgr.a (mgr.14355) 8736 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:55 smithi131 bash[24745]: cluster 2024-09-14T01:42:54.349922+0000 mgr.a (mgr.14355) 8736 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:55 smithi171 bash[25040]: cluster 2024-09-14T01:42:54.349922+0000 mgr.a (mgr.14355) 8736 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:42:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:56 smithi007 bash[22722]: audit 2024-09-14T01:42:54.919437+0000 mgr.a (mgr.14355) 8737 : audit [DBG] from='client.195084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:56 smithi131 bash[24745]: audit 2024-09-14T01:42:54.919437+0000 mgr.a (mgr.14355) 8737 : audit [DBG] from='client.195084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:56 smithi171 bash[25040]: audit 2024-09-14T01:42:54.919437+0000 mgr.a (mgr.14355) 8737 : audit [DBG] from='client.195084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:42:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:57 smithi007 bash[22722]: cluster 2024-09-14T01:42:56.352425+0000 mgr.a (mgr.14355) 8738 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:42:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:57 smithi131 bash[24745]: cluster 2024-09-14T01:42:56.352425+0000 mgr.a (mgr.14355) 8738 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:42:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:57 smithi171 bash[25040]: cluster 2024-09-14T01:42:56.352425+0000 mgr.a (mgr.14355) 8738 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:42:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:42:59 smithi007 bash[22722]: cluster 2024-09-14T01:42:58.353214+0000 mgr.a (mgr.14355) 8739 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:43:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:42:59 smithi131 bash[24745]: cluster 2024-09-14T01:42:58.353214+0000 mgr.a (mgr.14355) 8739 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:43:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:42:59 smithi171 bash[25040]: cluster 2024-09-14T01:42:58.353214+0000 mgr.a (mgr.14355) 8739 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:43:00.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:00.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:01.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:01 smithi007 bash[22722]: cluster 2024-09-14T01:43:00.354434+0000 mgr.a (mgr.14355) 8740 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:01 smithi007 bash[22722]: audit 2024-09-14T01:43:00.682760+0000 mgr.a (mgr.14355) 8741 : audit [DBG] from='client.195162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:01 smithi131 bash[24745]: cluster 2024-09-14T01:43:00.354434+0000 mgr.a (mgr.14355) 8740 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:01 smithi131 bash[24745]: audit 2024-09-14T01:43:00.682760+0000 mgr.a (mgr.14355) 8741 : audit [DBG] from='client.195162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:01 smithi171 bash[25040]: cluster 2024-09-14T01:43:00.354434+0000 mgr.a (mgr.14355) 8740 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:01 smithi171 bash[25040]: audit 2024-09-14T01:43:00.682760+0000 mgr.a (mgr.14355) 8741 : audit [DBG] from='client.195162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:03 smithi007 bash[22722]: cluster 2024-09-14T01:43:02.356158+0000 mgr.a (mgr.14355) 8742 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:03 smithi131 bash[24745]: cluster 2024-09-14T01:43:02.356158+0000 mgr.a (mgr.14355) 8742 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:03 smithi171 bash[25040]: cluster 2024-09-14T01:43:02.356158+0000 mgr.a (mgr.14355) 8742 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:05 smithi007 bash[22722]: cluster 2024-09-14T01:43:04.356939+0000 mgr.a (mgr.14355) 8743 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:43:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:05 smithi131 bash[24745]: cluster 2024-09-14T01:43:04.356939+0000 mgr.a (mgr.14355) 8743 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:43:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:05 smithi171 bash[25040]: cluster 2024-09-14T01:43:04.356939+0000 mgr.a (mgr.14355) 8743 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:43:06.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:06.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:06.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:06.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:07 smithi007 bash[22722]: cluster 2024-09-14T01:43:06.358994+0000 mgr.a (mgr.14355) 8744 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:07 smithi007 bash[22722]: audit 2024-09-14T01:43:06.443612+0000 mgr.a (mgr.14355) 8745 : audit [DBG] from='client.195237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:07 smithi131 bash[24745]: cluster 2024-09-14T01:43:06.358994+0000 mgr.a (mgr.14355) 8744 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:07 smithi131 bash[24745]: audit 2024-09-14T01:43:06.443612+0000 mgr.a (mgr.14355) 8745 : audit [DBG] from='client.195237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:07 smithi171 bash[25040]: cluster 2024-09-14T01:43:06.358994+0000 mgr.a (mgr.14355) 8744 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:07 smithi171 bash[25040]: audit 2024-09-14T01:43:06.443612+0000 mgr.a (mgr.14355) 8745 : audit [DBG] from='client.195237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:09 smithi007 bash[22722]: cluster 2024-09-14T01:43:08.359932+0000 mgr.a (mgr.14355) 8746 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:43:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:09 smithi131 bash[24745]: cluster 2024-09-14T01:43:08.359932+0000 mgr.a (mgr.14355) 8746 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:43:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:09 smithi171 bash[25040]: cluster 2024-09-14T01:43:08.359932+0000 mgr.a (mgr.14355) 8746 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:43:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:11.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:11 smithi007 bash[22722]: cluster 2024-09-14T01:43:10.361727+0000 mgr.a (mgr.14355) 8747 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:43:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:11 smithi131 bash[24745]: cluster 2024-09-14T01:43:10.361727+0000 mgr.a (mgr.14355) 8747 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:43:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:11 smithi171 bash[25040]: cluster 2024-09-14T01:43:10.361727+0000 mgr.a (mgr.14355) 8747 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:43:12.675 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:12.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:12.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:12.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:12.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:13 smithi007 bash[22722]: audit 2024-09-14T01:43:12.225068+0000 mgr.a (mgr.14355) 8748 : audit [DBG] from='client.195312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:13 smithi007 bash[22722]: cluster 2024-09-14T01:43:12.369423+0000 mgr.a (mgr.14355) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:13 smithi131 bash[24745]: audit 2024-09-14T01:43:12.225068+0000 mgr.a (mgr.14355) 8748 : audit [DBG] from='client.195312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:13 smithi131 bash[24745]: cluster 2024-09-14T01:43:12.369423+0000 mgr.a (mgr.14355) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:13 smithi171 bash[25040]: audit 2024-09-14T01:43:12.225068+0000 mgr.a (mgr.14355) 8748 : audit [DBG] from='client.195312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:13 smithi171 bash[25040]: cluster 2024-09-14T01:43:12.369423+0000 mgr.a (mgr.14355) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:15 smithi007 bash[22722]: cluster 2024-09-14T01:43:14.370341+0000 mgr.a (mgr.14355) 8750 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:15 smithi131 bash[24745]: cluster 2024-09-14T01:43:14.370341+0000 mgr.a (mgr.14355) 8750 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:15 smithi171 bash[25040]: cluster 2024-09-14T01:43:14.370341+0000 mgr.a (mgr.14355) 8750 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:16 smithi007 bash[22722]: audit 2024-09-14T01:43:16.083487+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:43:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:16 smithi131 bash[24745]: audit 2024-09-14T01:43:16.083487+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:43:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:16 smithi171 bash[25040]: audit 2024-09-14T01:43:16.083487+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:43:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:17.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22972]: debug 2024-09-14T01:43:17.677+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:43:17.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22972]: debug 2024-09-14T01:43:17.677+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:43:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22722]: cluster 2024-09-14T01:43:16.372505+0000 mgr.a (mgr.14355) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22722]: audit 2024-09-14T01:43:16.921830+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:43:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22722]: audit 2024-09-14T01:43:16.923425+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:43:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22722]: audit 2024-09-14T01:43:16.933309+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:43:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:17 smithi007 bash[22722]: audit 2024-09-14T01:43:16.938261+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:17 smithi131 bash[24745]: cluster 2024-09-14T01:43:16.372505+0000 mgr.a (mgr.14355) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:17 smithi131 bash[24745]: audit 2024-09-14T01:43:16.921830+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:43:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:17 smithi131 bash[24745]: audit 2024-09-14T01:43:16.923425+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:43:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:17 smithi131 bash[24745]: audit 2024-09-14T01:43:16.933309+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:43:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:17 smithi131 bash[24745]: audit 2024-09-14T01:43:16.938261+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:17 smithi171 bash[25040]: cluster 2024-09-14T01:43:16.372505+0000 mgr.a (mgr.14355) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:17 smithi171 bash[25040]: audit 2024-09-14T01:43:16.921830+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:43:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:17 smithi171 bash[25040]: audit 2024-09-14T01:43:16.923425+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:43:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:17 smithi171 bash[25040]: audit 2024-09-14T01:43:16.933309+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:43:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:17 smithi171 bash[25040]: audit 2024-09-14T01:43:16.938261+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:18.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:18.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:18.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:18.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:18.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:18 smithi007 bash[22722]: audit 2024-09-14T01:43:16.939676+0000 mgr.a (mgr.14355) 8752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:18 smithi007 bash[22722]: audit 2024-09-14T01:43:17.680438+0000 mgr.a (mgr.14355) 8753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:43:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:18 smithi007 bash[22722]: cephadm 2024-09-14T01:43:17.681675+0000 mgr.a (mgr.14355) 8754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:43:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:18 smithi131 bash[24745]: audit 2024-09-14T01:43:16.939676+0000 mgr.a (mgr.14355) 8752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:18 smithi131 bash[24745]: audit 2024-09-14T01:43:17.680438+0000 mgr.a (mgr.14355) 8753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:43:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:18 smithi131 bash[24745]: cephadm 2024-09-14T01:43:17.681675+0000 mgr.a (mgr.14355) 8754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:43:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:18 smithi171 bash[25040]: audit 2024-09-14T01:43:16.939676+0000 mgr.a (mgr.14355) 8752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:43:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:18 smithi171 bash[25040]: audit 2024-09-14T01:43:17.680438+0000 mgr.a (mgr.14355) 8753 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:43:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:18 smithi171 bash[25040]: cephadm 2024-09-14T01:43:17.681675+0000 mgr.a (mgr.14355) 8754 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:43:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:19 smithi007 bash[22722]: audit 2024-09-14T01:43:17.993775+0000 mgr.a (mgr.14355) 8755 : audit [DBG] from='client.195495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:19 smithi007 bash[22722]: cluster 2024-09-14T01:43:18.372986+0000 mgr.a (mgr.14355) 8756 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:19 smithi131 bash[24745]: audit 2024-09-14T01:43:17.993775+0000 mgr.a (mgr.14355) 8755 : audit [DBG] from='client.195495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:19 smithi131 bash[24745]: cluster 2024-09-14T01:43:18.372986+0000 mgr.a (mgr.14355) 8756 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:19 smithi171 bash[25040]: audit 2024-09-14T01:43:17.993775+0000 mgr.a (mgr.14355) 8755 : audit [DBG] from='client.195495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:19 smithi171 bash[25040]: cluster 2024-09-14T01:43:18.372986+0000 mgr.a (mgr.14355) 8756 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:21 smithi007 bash[22722]: cluster 2024-09-14T01:43:20.374737+0000 mgr.a (mgr.14355) 8757 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:21 smithi131 bash[24745]: cluster 2024-09-14T01:43:20.374737+0000 mgr.a (mgr.14355) 8757 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:21 smithi171 bash[25040]: cluster 2024-09-14T01:43:20.374737+0000 mgr.a (mgr.14355) 8757 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:23 smithi007 bash[22722]: cluster 2024-09-14T01:43:22.376010+0000 mgr.a (mgr.14355) 8758 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:23 smithi131 bash[24745]: cluster 2024-09-14T01:43:22.376010+0000 mgr.a (mgr.14355) 8758 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:23 smithi171 bash[25040]: cluster 2024-09-14T01:43:22.376010+0000 mgr.a (mgr.14355) 8758 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:24.181 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:24 smithi007 bash[22722]: audit 2024-09-14T01:43:23.743441+0000 mgr.a (mgr.14355) 8759 : audit [DBG] from='client.195573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:24 smithi131 bash[24745]: audit 2024-09-14T01:43:23.743441+0000 mgr.a (mgr.14355) 8759 : audit [DBG] from='client.195573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:24 smithi171 bash[25040]: audit 2024-09-14T01:43:23.743441+0000 mgr.a (mgr.14355) 8759 : audit [DBG] from='client.195573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:25 smithi007 bash[22722]: cluster 2024-09-14T01:43:24.377099+0000 mgr.a (mgr.14355) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:25 smithi131 bash[24745]: cluster 2024-09-14T01:43:24.377099+0000 mgr.a (mgr.14355) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:25 smithi171 bash[25040]: cluster 2024-09-14T01:43:24.377099+0000 mgr.a (mgr.14355) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:27 smithi007 bash[22722]: cluster 2024-09-14T01:43:26.379324+0000 mgr.a (mgr.14355) 8761 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:27 smithi131 bash[24745]: cluster 2024-09-14T01:43:26.379324+0000 mgr.a (mgr.14355) 8761 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:27 smithi171 bash[25040]: cluster 2024-09-14T01:43:26.379324+0000 mgr.a (mgr.14355) 8761 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:29 smithi007 bash[22722]: cluster 2024-09-14T01:43:28.380087+0000 mgr.a (mgr.14355) 8762 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:29.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:29.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:29 smithi131 bash[24745]: cluster 2024-09-14T01:43:28.380087+0000 mgr.a (mgr.14355) 8762 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:29 smithi171 bash[25040]: cluster 2024-09-14T01:43:28.380087+0000 mgr.a (mgr.14355) 8762 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:30 smithi007 bash[22722]: audit 2024-09-14T01:43:29.517744+0000 mgr.a (mgr.14355) 8763 : audit [DBG] from='client.195648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:30 smithi131 bash[24745]: audit 2024-09-14T01:43:29.517744+0000 mgr.a (mgr.14355) 8763 : audit [DBG] from='client.195648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:30 smithi171 bash[25040]: audit 2024-09-14T01:43:29.517744+0000 mgr.a (mgr.14355) 8763 : audit [DBG] from='client.195648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:31 smithi007 bash[22722]: cluster 2024-09-14T01:43:30.382067+0000 mgr.a (mgr.14355) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:31 smithi131 bash[24745]: cluster 2024-09-14T01:43:30.382067+0000 mgr.a (mgr.14355) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:31 smithi171 bash[25040]: cluster 2024-09-14T01:43:30.382067+0000 mgr.a (mgr.14355) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:43:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:33 smithi007 bash[22722]: cluster 2024-09-14T01:43:32.383344+0000 mgr.a (mgr.14355) 8765 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:43:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:33 smithi131 bash[24745]: cluster 2024-09-14T01:43:32.383344+0000 mgr.a (mgr.14355) 8765 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:43:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:33 smithi171 bash[25040]: cluster 2024-09-14T01:43:32.383344+0000 mgr.a (mgr.14355) 8765 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:43:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:35.710 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:35 smithi007 bash[22722]: cluster 2024-09-14T01:43:34.384124+0000 mgr.a (mgr.14355) 8766 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:35 smithi131 bash[24745]: cluster 2024-09-14T01:43:34.384124+0000 mgr.a (mgr.14355) 8766 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:35 smithi171 bash[25040]: cluster 2024-09-14T01:43:34.384124+0000 mgr.a (mgr.14355) 8766 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:36 smithi007 bash[22722]: audit 2024-09-14T01:43:35.286748+0000 mgr.a (mgr.14355) 8767 : audit [DBG] from='client.195723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:36 smithi131 bash[24745]: audit 2024-09-14T01:43:35.286748+0000 mgr.a (mgr.14355) 8767 : audit [DBG] from='client.195723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:36 smithi171 bash[25040]: audit 2024-09-14T01:43:35.286748+0000 mgr.a (mgr.14355) 8767 : audit [DBG] from='client.195723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:37 smithi007 bash[22722]: cluster 2024-09-14T01:43:36.386983+0000 mgr.a (mgr.14355) 8768 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:37 smithi131 bash[24745]: cluster 2024-09-14T01:43:36.386983+0000 mgr.a (mgr.14355) 8768 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:37 smithi171 bash[25040]: cluster 2024-09-14T01:43:36.386983+0000 mgr.a (mgr.14355) 8768 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:39 smithi007 bash[22722]: cluster 2024-09-14T01:43:38.387721+0000 mgr.a (mgr.14355) 8769 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:39 smithi131 bash[24745]: cluster 2024-09-14T01:43:38.387721+0000 mgr.a (mgr.14355) 8769 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:39 smithi171 bash[25040]: cluster 2024-09-14T01:43:38.387721+0000 mgr.a (mgr.14355) 8769 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:40.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:40.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:40.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:41.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:41.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:41.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:41.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:41.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:41 smithi007 bash[22722]: cluster 2024-09-14T01:43:40.389249+0000 mgr.a (mgr.14355) 8770 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:43:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:41 smithi131 bash[24745]: cluster 2024-09-14T01:43:40.389249+0000 mgr.a (mgr.14355) 8770 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:43:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:41 smithi171 bash[25040]: cluster 2024-09-14T01:43:40.389249+0000 mgr.a (mgr.14355) 8770 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:43:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:42 smithi131 bash[24745]: audit 2024-09-14T01:43:41.045604+0000 mgr.a (mgr.14355) 8771 : audit [DBG] from='client.195801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:42 smithi171 bash[25040]: audit 2024-09-14T01:43:41.045604+0000 mgr.a (mgr.14355) 8771 : audit [DBG] from='client.195801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:42 smithi007 bash[22722]: audit 2024-09-14T01:43:41.045604+0000 mgr.a (mgr.14355) 8771 : audit [DBG] from='client.195801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:43 smithi131 bash[24745]: cluster 2024-09-14T01:43:42.391130+0000 mgr.a (mgr.14355) 8772 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:43 smithi171 bash[25040]: cluster 2024-09-14T01:43:42.391130+0000 mgr.a (mgr.14355) 8772 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:43 smithi007 bash[22722]: cluster 2024-09-14T01:43:42.391130+0000 mgr.a (mgr.14355) 8772 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:43:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:45 smithi131 bash[24745]: cluster 2024-09-14T01:43:44.391924+0000 mgr.a (mgr.14355) 8773 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:45 smithi171 bash[25040]: cluster 2024-09-14T01:43:44.391924+0000 mgr.a (mgr.14355) 8773 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:45 smithi007 bash[22722]: cluster 2024-09-14T01:43:44.391924+0000 mgr.a (mgr.14355) 8773 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:43:46.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:47.212 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:47.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:47 smithi131 bash[24745]: cluster 2024-09-14T01:43:46.394000+0000 mgr.a (mgr.14355) 8774 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:47 smithi131 bash[24745]: audit 2024-09-14T01:43:46.786475+0000 mgr.a (mgr.14355) 8775 : audit [DBG] from='client.195879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:47 smithi171 bash[25040]: cluster 2024-09-14T01:43:46.394000+0000 mgr.a (mgr.14355) 8774 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:47 smithi171 bash[25040]: audit 2024-09-14T01:43:46.786475+0000 mgr.a (mgr.14355) 8775 : audit [DBG] from='client.195879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:47 smithi007 bash[22722]: cluster 2024-09-14T01:43:46.394000+0000 mgr.a (mgr.14355) 8774 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:47 smithi007 bash[22722]: audit 2024-09-14T01:43:46.786475+0000 mgr.a (mgr.14355) 8775 : audit [DBG] from='client.195879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:49 smithi131 bash[24745]: cluster 2024-09-14T01:43:48.394920+0000 mgr.a (mgr.14355) 8776 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:49 smithi171 bash[25040]: cluster 2024-09-14T01:43:48.394920+0000 mgr.a (mgr.14355) 8776 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:49 smithi007 bash[22722]: cluster 2024-09-14T01:43:48.394920+0000 mgr.a (mgr.14355) 8776 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:51 smithi131 bash[24745]: cluster 2024-09-14T01:43:50.396698+0000 mgr.a (mgr.14355) 8777 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:51 smithi171 bash[25040]: cluster 2024-09-14T01:43:50.396698+0000 mgr.a (mgr.14355) 8777 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:51 smithi007 bash[22722]: cluster 2024-09-14T01:43:50.396698+0000 mgr.a (mgr.14355) 8777 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:52.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:52.988 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:52.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:52.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:52.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:52.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:43:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:53 smithi131 bash[24745]: cluster 2024-09-14T01:43:52.397527+0000 mgr.a (mgr.14355) 8778 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:43:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:53 smithi131 bash[24745]: audit 2024-09-14T01:43:52.549199+0000 mgr.a (mgr.14355) 8779 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:53 smithi171 bash[25040]: cluster 2024-09-14T01:43:52.397527+0000 mgr.a (mgr.14355) 8778 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:43:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:53 smithi171 bash[25040]: audit 2024-09-14T01:43:52.549199+0000 mgr.a (mgr.14355) 8779 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:53 smithi007 bash[22722]: cluster 2024-09-14T01:43:52.397527+0000 mgr.a (mgr.14355) 8778 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:43:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:53 smithi007 bash[22722]: audit 2024-09-14T01:43:52.549199+0000 mgr.a (mgr.14355) 8779 : audit [DBG] from='client.195948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:43:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:55 smithi131 bash[24745]: cluster 2024-09-14T01:43:54.398433+0000 mgr.a (mgr.14355) 8780 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:55 smithi171 bash[25040]: cluster 2024-09-14T01:43:54.398433+0000 mgr.a (mgr.14355) 8780 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:55 smithi007 bash[22722]: cluster 2024-09-14T01:43:54.398433+0000 mgr.a (mgr.14355) 8780 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:43:57.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:43:57.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:43:57.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:43:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:57 smithi131 bash[24745]: cluster 2024-09-14T01:43:56.400652+0000 mgr.a (mgr.14355) 8781 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:57 smithi171 bash[25040]: cluster 2024-09-14T01:43:56.400652+0000 mgr.a (mgr.14355) 8781 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:57 smithi007 bash[22722]: cluster 2024-09-14T01:43:56.400652+0000 mgr.a (mgr.14355) 8781 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:43:58.763 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:43:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:43:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:43:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:43:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:59 smithi131 bash[24745]: audit 2024-09-14T01:43:58.325325+0000 mgr.a (mgr.14355) 8782 : audit [DBG] from='client.196026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:43:59 smithi131 bash[24745]: cluster 2024-09-14T01:43:58.401259+0000 mgr.a (mgr.14355) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:59 smithi171 bash[25040]: audit 2024-09-14T01:43:58.325325+0000 mgr.a (mgr.14355) 8782 : audit [DBG] from='client.196026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:43:59 smithi171 bash[25040]: cluster 2024-09-14T01:43:58.401259+0000 mgr.a (mgr.14355) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:59 smithi007 bash[22722]: audit 2024-09-14T01:43:58.325325+0000 mgr.a (mgr.14355) 8782 : audit [DBG] from='client.196026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:43:59 smithi007 bash[22722]: cluster 2024-09-14T01:43:58.401259+0000 mgr.a (mgr.14355) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:01 smithi131 bash[24745]: cluster 2024-09-14T01:44:00.403120+0000 mgr.a (mgr.14355) 8784 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:01 smithi171 bash[25040]: cluster 2024-09-14T01:44:00.403120+0000 mgr.a (mgr.14355) 8784 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:01 smithi007 bash[22722]: cluster 2024-09-14T01:44:00.403120+0000 mgr.a (mgr.14355) 8784 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:03 smithi131 bash[24745]: cluster 2024-09-14T01:44:02.404424+0000 mgr.a (mgr.14355) 8785 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:03 smithi171 bash[25040]: cluster 2024-09-14T01:44:02.404424+0000 mgr.a (mgr.14355) 8785 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:03 smithi007 bash[22722]: cluster 2024-09-14T01:44:02.404424+0000 mgr.a (mgr.14355) 8785 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:04.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:05 smithi131 bash[24745]: audit 2024-09-14T01:44:04.095942+0000 mgr.a (mgr.14355) 8786 : audit [DBG] from='client.196104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:05 smithi131 bash[24745]: cluster 2024-09-14T01:44:04.405029+0000 mgr.a (mgr.14355) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:05 smithi171 bash[25040]: audit 2024-09-14T01:44:04.095942+0000 mgr.a (mgr.14355) 8786 : audit [DBG] from='client.196104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:05 smithi171 bash[25040]: cluster 2024-09-14T01:44:04.405029+0000 mgr.a (mgr.14355) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:05 smithi007 bash[22722]: audit 2024-09-14T01:44:04.095942+0000 mgr.a (mgr.14355) 8786 : audit [DBG] from='client.196104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:05 smithi007 bash[22722]: cluster 2024-09-14T01:44:04.405029+0000 mgr.a (mgr.14355) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:08.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:07 smithi131 bash[24745]: cluster 2024-09-14T01:44:06.407421+0000 mgr.a (mgr.14355) 8788 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:07 smithi171 bash[25040]: cluster 2024-09-14T01:44:06.407421+0000 mgr.a (mgr.14355) 8788 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:07 smithi007 bash[22722]: cluster 2024-09-14T01:44:06.407421+0000 mgr.a (mgr.14355) 8788 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:09.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:09 smithi131 bash[24745]: cluster 2024-09-14T01:44:08.408201+0000 mgr.a (mgr.14355) 8789 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:09 smithi171 bash[25040]: cluster 2024-09-14T01:44:08.408201+0000 mgr.a (mgr.14355) 8789 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:09 smithi007 bash[22722]: cluster 2024-09-14T01:44:08.408201+0000 mgr.a (mgr.14355) 8789 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:10.317 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:11 smithi131 bash[24745]: audit 2024-09-14T01:44:09.876827+0000 mgr.a (mgr.14355) 8790 : audit [DBG] from='client.196182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:11 smithi131 bash[24745]: cluster 2024-09-14T01:44:10.409618+0000 mgr.a (mgr.14355) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:11 smithi171 bash[25040]: audit 2024-09-14T01:44:09.876827+0000 mgr.a (mgr.14355) 8790 : audit [DBG] from='client.196182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:11 smithi171 bash[25040]: cluster 2024-09-14T01:44:10.409618+0000 mgr.a (mgr.14355) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:11 smithi007 bash[22722]: audit 2024-09-14T01:44:09.876827+0000 mgr.a (mgr.14355) 8790 : audit [DBG] from='client.196182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:11 smithi007 bash[22722]: cluster 2024-09-14T01:44:10.409618+0000 mgr.a (mgr.14355) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:13 smithi171 bash[25040]: cluster 2024-09-14T01:44:12.410974+0000 mgr.a (mgr.14355) 8792 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:44:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:13 smithi007 bash[22722]: cluster 2024-09-14T01:44:12.410974+0000 mgr.a (mgr.14355) 8792 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:44:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:13 smithi131 bash[24745]: cluster 2024-09-14T01:44:12.410974+0000 mgr.a (mgr.14355) 8792 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:44:15.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:15.320 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:15.320 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:15 smithi171 bash[25040]: cluster 2024-09-14T01:44:14.411788+0000 mgr.a (mgr.14355) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:44:16.076 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:16.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:15 smithi007 bash[22722]: cluster 2024-09-14T01:44:14.411788+0000 mgr.a (mgr.14355) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:44:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:15 smithi131 bash[24745]: cluster 2024-09-14T01:44:14.411788+0000 mgr.a (mgr.14355) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:44:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:16 smithi171 bash[25040]: audit 2024-09-14T01:44:15.649384+0000 mgr.a (mgr.14355) 8794 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:16 smithi007 bash[22722]: audit 2024-09-14T01:44:15.649384+0000 mgr.a (mgr.14355) 8794 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:16 smithi131 bash[24745]: audit 2024-09-14T01:44:15.649384+0000 mgr.a (mgr.14355) 8794 : audit [DBG] from='client.196254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:17 smithi007 bash[22722]: cluster 2024-09-14T01:44:16.414761+0000 mgr.a (mgr.14355) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:17 smithi007 bash[22722]: audit 2024-09-14T01:44:17.734708+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:44:18.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:17 smithi131 bash[24745]: cluster 2024-09-14T01:44:16.414761+0000 mgr.a (mgr.14355) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:17 smithi131 bash[24745]: audit 2024-09-14T01:44:17.734708+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:44:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:17 smithi171 bash[25040]: cluster 2024-09-14T01:44:16.414761+0000 mgr.a (mgr.14355) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:17 smithi171 bash[25040]: audit 2024-09-14T01:44:17.734708+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:44:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:18 smithi007 bash[22722]: audit 2024-09-14T01:44:18.553305+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:44:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:18 smithi007 bash[22722]: audit 2024-09-14T01:44:18.554951+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:44:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:18 smithi007 bash[22722]: audit 2024-09-14T01:44:18.564844+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:44:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:18 smithi007 bash[22722]: audit 2024-09-14T01:44:18.569554+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:18 smithi131 bash[24745]: audit 2024-09-14T01:44:18.553305+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:44:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:18 smithi131 bash[24745]: audit 2024-09-14T01:44:18.554951+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:44:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:18 smithi131 bash[24745]: audit 2024-09-14T01:44:18.564844+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:44:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:18 smithi131 bash[24745]: audit 2024-09-14T01:44:18.569554+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:18 smithi171 bash[25040]: audit 2024-09-14T01:44:18.553305+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:44:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:18 smithi171 bash[25040]: audit 2024-09-14T01:44:18.554951+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:44:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:18 smithi171 bash[25040]: audit 2024-09-14T01:44:18.564844+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:44:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:18 smithi171 bash[25040]: audit 2024-09-14T01:44:18.569554+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:19.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:44:19 smithi007 bash[22972]: debug 2024-09-14T01:44:19.300+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:44:19.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:44:19 smithi007 bash[22972]: debug 2024-09-14T01:44:19.300+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:44:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:19 smithi007 bash[22722]: cluster 2024-09-14T01:44:18.415686+0000 mgr.a (mgr.14355) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:44:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:19 smithi007 bash[22722]: audit 2024-09-14T01:44:18.571883+0000 mgr.a (mgr.14355) 8797 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:19 smithi131 bash[24745]: cluster 2024-09-14T01:44:18.415686+0000 mgr.a (mgr.14355) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:44:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:19 smithi131 bash[24745]: audit 2024-09-14T01:44:18.571883+0000 mgr.a (mgr.14355) 8797 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:19 smithi171 bash[25040]: cluster 2024-09-14T01:44:18.415686+0000 mgr.a (mgr.14355) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:44:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:19 smithi171 bash[25040]: audit 2024-09-14T01:44:18.571883+0000 mgr.a (mgr.14355) 8797 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:44:21.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:20 smithi007 bash[22722]: audit 2024-09-14T01:44:19.303186+0000 mgr.a (mgr.14355) 8798 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:44:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:20 smithi007 bash[22722]: cephadm 2024-09-14T01:44:19.304800+0000 mgr.a (mgr.14355) 8799 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:44:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:20 smithi131 bash[24745]: audit 2024-09-14T01:44:19.303186+0000 mgr.a (mgr.14355) 8798 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:44:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:20 smithi131 bash[24745]: cephadm 2024-09-14T01:44:19.304800+0000 mgr.a (mgr.14355) 8799 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:44:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:20 smithi171 bash[25040]: audit 2024-09-14T01:44:19.303186+0000 mgr.a (mgr.14355) 8798 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:44:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:20 smithi171 bash[25040]: cephadm 2024-09-14T01:44:19.304800+0000 mgr.a (mgr.14355) 8799 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:44:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:21.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:21 smithi007 bash[22722]: cluster 2024-09-14T01:44:20.417712+0000 mgr.a (mgr.14355) 8800 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:21 smithi131 bash[24745]: cluster 2024-09-14T01:44:20.417712+0000 mgr.a (mgr.14355) 8800 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:21 smithi171 bash[25040]: cluster 2024-09-14T01:44:20.417712+0000 mgr.a (mgr.14355) 8800 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:22 smithi007 bash[22722]: audit 2024-09-14T01:44:21.409376+0000 mgr.a (mgr.14355) 8801 : audit [DBG] from='client.196437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:22 smithi131 bash[24745]: audit 2024-09-14T01:44:21.409376+0000 mgr.a (mgr.14355) 8801 : audit [DBG] from='client.196437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:22 smithi171 bash[25040]: audit 2024-09-14T01:44:21.409376+0000 mgr.a (mgr.14355) 8801 : audit [DBG] from='client.196437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:23 smithi007 bash[22722]: cluster 2024-09-14T01:44:22.419678+0000 mgr.a (mgr.14355) 8802 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:23 smithi131 bash[24745]: cluster 2024-09-14T01:44:22.419678+0000 mgr.a (mgr.14355) 8802 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:23 smithi171 bash[25040]: cluster 2024-09-14T01:44:22.419678+0000 mgr.a (mgr.14355) 8802 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:25 smithi007 bash[22722]: cluster 2024-09-14T01:44:24.420494+0000 mgr.a (mgr.14355) 8803 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:25 smithi131 bash[24745]: cluster 2024-09-14T01:44:24.420494+0000 mgr.a (mgr.14355) 8803 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:25 smithi171 bash[25040]: cluster 2024-09-14T01:44:24.420494+0000 mgr.a (mgr.14355) 8803 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:44:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:27.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:27.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:27 smithi007 bash[22722]: cluster 2024-09-14T01:44:26.422631+0000 mgr.a (mgr.14355) 8804 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:27 smithi131 bash[24745]: cluster 2024-09-14T01:44:26.422631+0000 mgr.a (mgr.14355) 8804 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:27 smithi171 bash[25040]: cluster 2024-09-14T01:44:26.422631+0000 mgr.a (mgr.14355) 8804 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:28 smithi007 bash[22722]: audit 2024-09-14T01:44:27.189643+0000 mgr.a (mgr.14355) 8805 : audit [DBG] from='client.196515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:28 smithi131 bash[24745]: audit 2024-09-14T01:44:27.189643+0000 mgr.a (mgr.14355) 8805 : audit [DBG] from='client.196515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:28 smithi171 bash[25040]: audit 2024-09-14T01:44:27.189643+0000 mgr.a (mgr.14355) 8805 : audit [DBG] from='client.196515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:29 smithi007 bash[22722]: cluster 2024-09-14T01:44:28.423564+0000 mgr.a (mgr.14355) 8806 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:29 smithi131 bash[24745]: cluster 2024-09-14T01:44:28.423564+0000 mgr.a (mgr.14355) 8806 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:29 smithi171 bash[25040]: cluster 2024-09-14T01:44:28.423564+0000 mgr.a (mgr.14355) 8806 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:31 smithi007 bash[22722]: cluster 2024-09-14T01:44:30.425337+0000 mgr.a (mgr.14355) 8807 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:31 smithi131 bash[24745]: cluster 2024-09-14T01:44:30.425337+0000 mgr.a (mgr.14355) 8807 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:31 smithi171 bash[25040]: cluster 2024-09-14T01:44:30.425337+0000 mgr.a (mgr.14355) 8807 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:44:32.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:32.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:32.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:33.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:33 smithi007 bash[22722]: cluster 2024-09-14T01:44:32.426617+0000 mgr.a (mgr.14355) 8808 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:33 smithi131 bash[24745]: cluster 2024-09-14T01:44:32.426617+0000 mgr.a (mgr.14355) 8808 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:33 smithi171 bash[25040]: cluster 2024-09-14T01:44:32.426617+0000 mgr.a (mgr.14355) 8808 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T01:44:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:34 smithi007 bash[22722]: audit 2024-09-14T01:44:32.960311+0000 mgr.a (mgr.14355) 8809 : audit [DBG] from='client.196593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:34 smithi007 bash[22722]: cluster 2024-09-14T01:44:34.427538+0000 mgr.a (mgr.14355) 8810 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:34 smithi131 bash[24745]: audit 2024-09-14T01:44:32.960311+0000 mgr.a (mgr.14355) 8809 : audit [DBG] from='client.196593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:34 smithi131 bash[24745]: cluster 2024-09-14T01:44:34.427538+0000 mgr.a (mgr.14355) 8810 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:34 smithi171 bash[25040]: audit 2024-09-14T01:44:32.960311+0000 mgr.a (mgr.14355) 8809 : audit [DBG] from='client.196593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:34 smithi171 bash[25040]: cluster 2024-09-14T01:44:34.427538+0000 mgr.a (mgr.14355) 8810 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:37 smithi131 bash[24745]: cluster 2024-09-14T01:44:36.429837+0000 mgr.a (mgr.14355) 8811 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:37 smithi171 bash[25040]: cluster 2024-09-14T01:44:36.429837+0000 mgr.a (mgr.14355) 8811 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:37 smithi007 bash[22722]: cluster 2024-09-14T01:44:36.429837+0000 mgr.a (mgr.14355) 8811 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:38.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:39.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:39 smithi131 bash[24745]: cluster 2024-09-14T01:44:38.430520+0000 mgr.a (mgr.14355) 8812 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:39 smithi131 bash[24745]: audit 2024-09-14T01:44:38.732893+0000 mgr.a (mgr.14355) 8813 : audit [DBG] from='client.196668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:39 smithi171 bash[25040]: cluster 2024-09-14T01:44:38.430520+0000 mgr.a (mgr.14355) 8812 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:39 smithi171 bash[25040]: audit 2024-09-14T01:44:38.732893+0000 mgr.a (mgr.14355) 8813 : audit [DBG] from='client.196668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:39 smithi007 bash[22722]: cluster 2024-09-14T01:44:38.430520+0000 mgr.a (mgr.14355) 8812 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:39 smithi007 bash[22722]: audit 2024-09-14T01:44:38.732893+0000 mgr.a (mgr.14355) 8813 : audit [DBG] from='client.196668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:41 smithi131 bash[24745]: cluster 2024-09-14T01:44:40.432341+0000 mgr.a (mgr.14355) 8814 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:41 smithi171 bash[25040]: cluster 2024-09-14T01:44:40.432341+0000 mgr.a (mgr.14355) 8814 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:41 smithi007 bash[22722]: cluster 2024-09-14T01:44:40.432341+0000 mgr.a (mgr.14355) 8814 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:43 smithi131 bash[24745]: cluster 2024-09-14T01:44:42.433616+0000 mgr.a (mgr.14355) 8815 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:43 smithi171 bash[25040]: cluster 2024-09-14T01:44:42.433616+0000 mgr.a (mgr.14355) 8815 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:43 smithi007 bash[22722]: cluster 2024-09-14T01:44:42.433616+0000 mgr.a (mgr.14355) 8815 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:44:44.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:44.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:44.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:44.901 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:45 smithi131 bash[24745]: cluster 2024-09-14T01:44:44.434365+0000 mgr.a (mgr.14355) 8816 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:45 smithi131 bash[24745]: audit 2024-09-14T01:44:44.478950+0000 mgr.a (mgr.14355) 8817 : audit [DBG] from='client.196743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:45 smithi171 bash[25040]: cluster 2024-09-14T01:44:44.434365+0000 mgr.a (mgr.14355) 8816 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:45 smithi171 bash[25040]: audit 2024-09-14T01:44:44.478950+0000 mgr.a (mgr.14355) 8817 : audit [DBG] from='client.196743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:45 smithi007 bash[22722]: cluster 2024-09-14T01:44:44.434365+0000 mgr.a (mgr.14355) 8816 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:45 smithi007 bash[22722]: audit 2024-09-14T01:44:44.478950+0000 mgr.a (mgr.14355) 8817 : audit [DBG] from='client.196743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:47 smithi131 bash[24745]: cluster 2024-09-14T01:44:46.436734+0000 mgr.a (mgr.14355) 8818 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:47 smithi171 bash[25040]: cluster 2024-09-14T01:44:46.436734+0000 mgr.a (mgr.14355) 8818 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:47 smithi007 bash[22722]: cluster 2024-09-14T01:44:46.436734+0000 mgr.a (mgr.14355) 8818 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:44:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:49 smithi131 bash[24745]: cluster 2024-09-14T01:44:48.437522+0000 mgr.a (mgr.14355) 8819 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:49 smithi171 bash[25040]: cluster 2024-09-14T01:44:48.437522+0000 mgr.a (mgr.14355) 8819 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:49.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:49.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:49 smithi007 bash[22722]: cluster 2024-09-14T01:44:48.437522+0000 mgr.a (mgr.14355) 8819 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:50.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:51 smithi131 bash[24745]: audit 2024-09-14T01:44:50.249509+0000 mgr.a (mgr.14355) 8820 : audit [DBG] from='client.196818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:51 smithi131 bash[24745]: cluster 2024-09-14T01:44:50.438664+0000 mgr.a (mgr.14355) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:51 smithi171 bash[25040]: audit 2024-09-14T01:44:50.249509+0000 mgr.a (mgr.14355) 8820 : audit [DBG] from='client.196818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:51 smithi171 bash[25040]: cluster 2024-09-14T01:44:50.438664+0000 mgr.a (mgr.14355) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:51 smithi007 bash[22722]: audit 2024-09-14T01:44:50.249509+0000 mgr.a (mgr.14355) 8820 : audit [DBG] from='client.196818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:51 smithi007 bash[22722]: cluster 2024-09-14T01:44:50.438664+0000 mgr.a (mgr.14355) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:53 smithi131 bash[24745]: cluster 2024-09-14T01:44:52.440385+0000 mgr.a (mgr.14355) 8822 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:53 smithi171 bash[25040]: cluster 2024-09-14T01:44:52.440385+0000 mgr.a (mgr.14355) 8822 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:44:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:53 smithi007 bash[22722]: cluster 2024-09-14T01:44:52.440385+0000 mgr.a (mgr.14355) 8822 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T01:44:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:44:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:44:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:44:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:55 smithi131 bash[24745]: cluster 2024-09-14T01:44:54.441156+0000 mgr.a (mgr.14355) 8823 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:44:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:55 smithi171 bash[25040]: cluster 2024-09-14T01:44:54.441156+0000 mgr.a (mgr.14355) 8823 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:44:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:55 smithi007 bash[22722]: cluster 2024-09-14T01:44:54.441156+0000 mgr.a (mgr.14355) 8823 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:44:56.412 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:44:56.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:44:56.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:44:56.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:44:56.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:44:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:57 smithi131 bash[24745]: audit 2024-09-14T01:44:55.989886+0000 mgr.a (mgr.14355) 8824 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:57 smithi131 bash[24745]: cluster 2024-09-14T01:44:56.442680+0000 mgr.a (mgr.14355) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:57 smithi171 bash[25040]: audit 2024-09-14T01:44:55.989886+0000 mgr.a (mgr.14355) 8824 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:57 smithi171 bash[25040]: cluster 2024-09-14T01:44:56.442680+0000 mgr.a (mgr.14355) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:57 smithi007 bash[22722]: audit 2024-09-14T01:44:55.989886+0000 mgr.a (mgr.14355) 8824 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:44:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:57 smithi007 bash[22722]: cluster 2024-09-14T01:44:56.442680+0000 mgr.a (mgr.14355) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:44:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:44:59 smithi131 bash[24745]: cluster 2024-09-14T01:44:58.443400+0000 mgr.a (mgr.14355) 8826 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:44:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:44:59 smithi171 bash[25040]: cluster 2024-09-14T01:44:58.443400+0000 mgr.a (mgr.14355) 8826 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:44:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:44:59 smithi007 bash[22722]: cluster 2024-09-14T01:44:58.443400+0000 mgr.a (mgr.14355) 8826 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:45:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:01.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:01 smithi131 bash[24745]: cluster 2024-09-14T01:45:00.444914+0000 mgr.a (mgr.14355) 8827 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:01 smithi171 bash[25040]: cluster 2024-09-14T01:45:00.444914+0000 mgr.a (mgr.14355) 8827 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:01.885 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:01 smithi007 bash[22722]: cluster 2024-09-14T01:45:00.444914+0000 mgr.a (mgr.14355) 8827 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:02.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:02.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:02.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:02.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:02.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:02 smithi171 bash[25040]: audit 2024-09-14T01:45:01.747844+0000 mgr.a (mgr.14355) 8828 : audit [DBG] from='client.196974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:02 smithi007 bash[22722]: audit 2024-09-14T01:45:01.747844+0000 mgr.a (mgr.14355) 8828 : audit [DBG] from='client.196974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:02 smithi131 bash[24745]: audit 2024-09-14T01:45:01.747844+0000 mgr.a (mgr.14355) 8828 : audit [DBG] from='client.196974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:03 smithi007 bash[22722]: cluster 2024-09-14T01:45:02.446763+0000 mgr.a (mgr.14355) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:03 smithi131 bash[24745]: cluster 2024-09-14T01:45:02.446763+0000 mgr.a (mgr.14355) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:03 smithi171 bash[25040]: cluster 2024-09-14T01:45:02.446763+0000 mgr.a (mgr.14355) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:05 smithi007 bash[22722]: cluster 2024-09-14T01:45:04.447558+0000 mgr.a (mgr.14355) 8830 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:05 smithi131 bash[24745]: cluster 2024-09-14T01:45:04.447558+0000 mgr.a (mgr.14355) 8830 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:05 smithi171 bash[25040]: cluster 2024-09-14T01:45:04.447558+0000 mgr.a (mgr.14355) 8830 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:07 smithi007 bash[22722]: cluster 2024-09-14T01:45:06.449647+0000 mgr.a (mgr.14355) 8831 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:07.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:07.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:07 smithi131 bash[24745]: cluster 2024-09-14T01:45:06.449647+0000 mgr.a (mgr.14355) 8831 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:07 smithi171 bash[25040]: cluster 2024-09-14T01:45:06.449647+0000 mgr.a (mgr.14355) 8831 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:08 smithi007 bash[22722]: audit 2024-09-14T01:45:07.527475+0000 mgr.a (mgr.14355) 8832 : audit [DBG] from='client.197052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:08 smithi131 bash[24745]: audit 2024-09-14T01:45:07.527475+0000 mgr.a (mgr.14355) 8832 : audit [DBG] from='client.197052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:08 smithi171 bash[25040]: audit 2024-09-14T01:45:07.527475+0000 mgr.a (mgr.14355) 8832 : audit [DBG] from='client.197052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:09 smithi007 bash[22722]: cluster 2024-09-14T01:45:08.450570+0000 mgr.a (mgr.14355) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:09 smithi131 bash[24745]: cluster 2024-09-14T01:45:08.450570+0000 mgr.a (mgr.14355) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:09 smithi171 bash[25040]: cluster 2024-09-14T01:45:08.450570+0000 mgr.a (mgr.14355) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:11 smithi007 bash[22722]: cluster 2024-09-14T01:45:10.452284+0000 mgr.a (mgr.14355) 8834 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:11 smithi131 bash[24745]: cluster 2024-09-14T01:45:10.452284+0000 mgr.a (mgr.14355) 8834 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:11 smithi171 bash[25040]: cluster 2024-09-14T01:45:10.452284+0000 mgr.a (mgr.14355) 8834 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:13.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:13.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:13.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:13.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:13.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:13 smithi007 bash[22722]: cluster 2024-09-14T01:45:12.453551+0000 mgr.a (mgr.14355) 8835 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:13 smithi131 bash[24745]: cluster 2024-09-14T01:45:12.453551+0000 mgr.a (mgr.14355) 8835 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:13 smithi171 bash[25040]: cluster 2024-09-14T01:45:12.453551+0000 mgr.a (mgr.14355) 8835 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:14 smithi007 bash[22722]: audit 2024-09-14T01:45:13.310240+0000 mgr.a (mgr.14355) 8836 : audit [DBG] from='client.197127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:14 smithi131 bash[24745]: audit 2024-09-14T01:45:13.310240+0000 mgr.a (mgr.14355) 8836 : audit [DBG] from='client.197127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:14 smithi171 bash[25040]: audit 2024-09-14T01:45:13.310240+0000 mgr.a (mgr.14355) 8836 : audit [DBG] from='client.197127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:15 smithi007 bash[22722]: cluster 2024-09-14T01:45:14.454471+0000 mgr.a (mgr.14355) 8837 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:15 smithi131 bash[24745]: cluster 2024-09-14T01:45:14.454471+0000 mgr.a (mgr.14355) 8837 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:15 smithi171 bash[25040]: cluster 2024-09-14T01:45:14.454471+0000 mgr.a (mgr.14355) 8837 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:17 smithi007 bash[22722]: cluster 2024-09-14T01:45:16.456724+0000 mgr.a (mgr.14355) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:17 smithi131 bash[24745]: cluster 2024-09-14T01:45:16.456724+0000 mgr.a (mgr.14355) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:17 smithi171 bash[25040]: cluster 2024-09-14T01:45:16.456724+0000 mgr.a (mgr.14355) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:18.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:18.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:19.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:19.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:19 smithi007 bash[22722]: cluster 2024-09-14T01:45:18.457482+0000 mgr.a (mgr.14355) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:19 smithi007 bash[22722]: audit 2024-09-14T01:45:19.357801+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:45:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:19 smithi131 bash[24745]: cluster 2024-09-14T01:45:18.457482+0000 mgr.a (mgr.14355) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:19 smithi131 bash[24745]: audit 2024-09-14T01:45:19.357801+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:45:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:19 smithi171 bash[25040]: cluster 2024-09-14T01:45:18.457482+0000 mgr.a (mgr.14355) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:19 smithi171 bash[25040]: audit 2024-09-14T01:45:19.357801+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:45:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:19.088049+0000 mgr.a (mgr.14355) 8840 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:19.908496+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:19.913697+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:20.511608+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:45:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:20.513131+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:45:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:20.519607+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:20 smithi007 bash[22722]: audit 2024-09-14T01:45:20.524491+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:19.088049+0000 mgr.a (mgr.14355) 8840 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:19.908496+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:19.913697+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:20.511608+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:20.513131+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:20.519607+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:20 smithi131 bash[24745]: audit 2024-09-14T01:45:20.524491+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:19.088049+0000 mgr.a (mgr.14355) 8840 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:19.908496+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:19.913697+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:20.511608+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:45:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:20.513131+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:45:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:20.519607+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:45:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:20 smithi171 bash[25040]: audit 2024-09-14T01:45:20.524491+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:21.622 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:45:21 smithi007 bash[22972]: debug 2024-09-14T01:45:21.247+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:45:21.622 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:45:21 smithi007 bash[22972]: debug 2024-09-14T01:45:21.251+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:45:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:21 smithi007 bash[22722]: cluster 2024-09-14T01:45:20.458533+0000 mgr.a (mgr.14355) 8841 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:21 smithi007 bash[22722]: audit 2024-09-14T01:45:20.525470+0000 mgr.a (mgr.14355) 8842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:21 smithi131 bash[24745]: cluster 2024-09-14T01:45:20.458533+0000 mgr.a (mgr.14355) 8841 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:21 smithi131 bash[24745]: audit 2024-09-14T01:45:20.525470+0000 mgr.a (mgr.14355) 8842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:21 smithi171 bash[25040]: cluster 2024-09-14T01:45:20.458533+0000 mgr.a (mgr.14355) 8841 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:21 smithi171 bash[25040]: audit 2024-09-14T01:45:20.525470+0000 mgr.a (mgr.14355) 8842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:45:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:22 smithi007 bash[22722]: audit 2024-09-14T01:45:21.253052+0000 mgr.a (mgr.14355) 8843 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:45:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:22 smithi007 bash[22722]: cephadm 2024-09-14T01:45:21.254391+0000 mgr.a (mgr.14355) 8844 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:45:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:22 smithi131 bash[24745]: audit 2024-09-14T01:45:21.253052+0000 mgr.a (mgr.14355) 8843 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:45:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:22 smithi131 bash[24745]: cephadm 2024-09-14T01:45:21.254391+0000 mgr.a (mgr.14355) 8844 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:45:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:22 smithi171 bash[25040]: audit 2024-09-14T01:45:21.253052+0000 mgr.a (mgr.14355) 8843 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:45:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:22 smithi171 bash[25040]: cephadm 2024-09-14T01:45:21.254391+0000 mgr.a (mgr.14355) 8844 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:45:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:23 smithi007 bash[22722]: cluster 2024-09-14T01:45:22.460274+0000 mgr.a (mgr.14355) 8845 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:23 smithi131 bash[24745]: cluster 2024-09-14T01:45:22.460274+0000 mgr.a (mgr.14355) 8845 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:23 smithi171 bash[25040]: cluster 2024-09-14T01:45:22.460274+0000 mgr.a (mgr.14355) 8845 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:24.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:24.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:24.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:25.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:25.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:25.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:25 smithi007 bash[22722]: cluster 2024-09-14T01:45:24.461033+0000 mgr.a (mgr.14355) 8846 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:25 smithi007 bash[22722]: audit 2024-09-14T01:45:24.851962+0000 mgr.a (mgr.14355) 8847 : audit [DBG] from='client.197385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:25 smithi131 bash[24745]: cluster 2024-09-14T01:45:24.461033+0000 mgr.a (mgr.14355) 8846 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:25 smithi131 bash[24745]: audit 2024-09-14T01:45:24.851962+0000 mgr.a (mgr.14355) 8847 : audit [DBG] from='client.197385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:25 smithi171 bash[25040]: cluster 2024-09-14T01:45:24.461033+0000 mgr.a (mgr.14355) 8846 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:25 smithi171 bash[25040]: audit 2024-09-14T01:45:24.851962+0000 mgr.a (mgr.14355) 8847 : audit [DBG] from='client.197385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:27 smithi007 bash[22722]: cluster 2024-09-14T01:45:26.463430+0000 mgr.a (mgr.14355) 8848 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:27 smithi131 bash[24745]: cluster 2024-09-14T01:45:26.463430+0000 mgr.a (mgr.14355) 8848 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:27 smithi171 bash[25040]: cluster 2024-09-14T01:45:26.463430+0000 mgr.a (mgr.14355) 8848 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:29 smithi007 bash[22722]: cluster 2024-09-14T01:45:28.464232+0000 mgr.a (mgr.14355) 8849 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:29 smithi131 bash[24745]: cluster 2024-09-14T01:45:28.464232+0000 mgr.a (mgr.14355) 8849 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:29 smithi171 bash[25040]: cluster 2024-09-14T01:45:28.464232+0000 mgr.a (mgr.14355) 8849 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:30.996 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:30.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:31 smithi007 bash[22722]: cluster 2024-09-14T01:45:30.465812+0000 mgr.a (mgr.14355) 8850 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:31 smithi007 bash[22722]: audit 2024-09-14T01:45:30.589725+0000 mgr.a (mgr.14355) 8851 : audit [DBG] from='client.197463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:31 smithi131 bash[24745]: cluster 2024-09-14T01:45:30.465812+0000 mgr.a (mgr.14355) 8850 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:31 smithi131 bash[24745]: audit 2024-09-14T01:45:30.589725+0000 mgr.a (mgr.14355) 8851 : audit [DBG] from='client.197463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:31 smithi171 bash[25040]: cluster 2024-09-14T01:45:30.465812+0000 mgr.a (mgr.14355) 8850 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:31 smithi171 bash[25040]: audit 2024-09-14T01:45:30.589725+0000 mgr.a (mgr.14355) 8851 : audit [DBG] from='client.197463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:33 smithi007 bash[22722]: cluster 2024-09-14T01:45:32.467603+0000 mgr.a (mgr.14355) 8852 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:33 smithi131 bash[24745]: cluster 2024-09-14T01:45:32.467603+0000 mgr.a (mgr.14355) 8852 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:33 smithi171 bash[25040]: cluster 2024-09-14T01:45:32.467603+0000 mgr.a (mgr.14355) 8852 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:35 smithi007 bash[22722]: cluster 2024-09-14T01:45:34.468387+0000 mgr.a (mgr.14355) 8853 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:35.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:35 smithi131 bash[24745]: cluster 2024-09-14T01:45:34.468387+0000 mgr.a (mgr.14355) 8853 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:35 smithi171 bash[25040]: cluster 2024-09-14T01:45:34.468387+0000 mgr.a (mgr.14355) 8853 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:45:36.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:36.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:37 smithi007 bash[22722]: audit 2024-09-14T01:45:36.345184+0000 mgr.a (mgr.14355) 8854 : audit [DBG] from='client.197541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:37 smithi007 bash[22722]: cluster 2024-09-14T01:45:36.469804+0000 mgr.a (mgr.14355) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:37 smithi131 bash[24745]: audit 2024-09-14T01:45:36.345184+0000 mgr.a (mgr.14355) 8854 : audit [DBG] from='client.197541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:37 smithi131 bash[24745]: cluster 2024-09-14T01:45:36.469804+0000 mgr.a (mgr.14355) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:37 smithi171 bash[25040]: audit 2024-09-14T01:45:36.345184+0000 mgr.a (mgr.14355) 8854 : audit [DBG] from='client.197541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:37 smithi171 bash[25040]: cluster 2024-09-14T01:45:36.469804+0000 mgr.a (mgr.14355) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:45:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:39 smithi007 bash[22722]: cluster 2024-09-14T01:45:38.470696+0000 mgr.a (mgr.14355) 8856 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:45:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:39 smithi131 bash[24745]: cluster 2024-09-14T01:45:38.470696+0000 mgr.a (mgr.14355) 8856 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:45:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:39 smithi171 bash[25040]: cluster 2024-09-14T01:45:38.470696+0000 mgr.a (mgr.14355) 8856 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:45:41.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:41.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:41.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:41 smithi007 bash[22722]: cluster 2024-09-14T01:45:40.472444+0000 mgr.a (mgr.14355) 8857 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:41 smithi131 bash[24745]: cluster 2024-09-14T01:45:40.472444+0000 mgr.a (mgr.14355) 8857 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:41 smithi171 bash[25040]: cluster 2024-09-14T01:45:40.472444+0000 mgr.a (mgr.14355) 8857 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:45:42.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:42.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:43 smithi007 bash[22722]: audit 2024-09-14T01:45:42.122348+0000 mgr.a (mgr.14355) 8858 : audit [DBG] from='client.197616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:43 smithi007 bash[22722]: cluster 2024-09-14T01:45:42.473475+0000 mgr.a (mgr.14355) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:43 smithi131 bash[24745]: audit 2024-09-14T01:45:42.122348+0000 mgr.a (mgr.14355) 8858 : audit [DBG] from='client.197616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:43 smithi131 bash[24745]: cluster 2024-09-14T01:45:42.473475+0000 mgr.a (mgr.14355) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:43 smithi171 bash[25040]: audit 2024-09-14T01:45:42.122348+0000 mgr.a (mgr.14355) 8858 : audit [DBG] from='client.197616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:43 smithi171 bash[25040]: cluster 2024-09-14T01:45:42.473475+0000 mgr.a (mgr.14355) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:45 smithi007 bash[22722]: cluster 2024-09-14T01:45:44.474213+0000 mgr.a (mgr.14355) 8860 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:45 smithi131 bash[24745]: cluster 2024-09-14T01:45:44.474213+0000 mgr.a (mgr.14355) 8860 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:45 smithi171 bash[25040]: cluster 2024-09-14T01:45:44.474213+0000 mgr.a (mgr.14355) 8860 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:47 smithi007 bash[22722]: cluster 2024-09-14T01:45:46.476409+0000 mgr.a (mgr.14355) 8861 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:47 smithi131 bash[24745]: cluster 2024-09-14T01:45:46.476409+0000 mgr.a (mgr.14355) 8861 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:47 smithi171 bash[25040]: cluster 2024-09-14T01:45:46.476409+0000 mgr.a (mgr.14355) 8861 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:48.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:49 smithi007 bash[22722]: audit 2024-09-14T01:45:47.880031+0000 mgr.a (mgr.14355) 8862 : audit [DBG] from='client.197691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:49 smithi007 bash[22722]: cluster 2024-09-14T01:45:48.477415+0000 mgr.a (mgr.14355) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:49 smithi131 bash[24745]: audit 2024-09-14T01:45:47.880031+0000 mgr.a (mgr.14355) 8862 : audit [DBG] from='client.197691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:49 smithi131 bash[24745]: cluster 2024-09-14T01:45:48.477415+0000 mgr.a (mgr.14355) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:49 smithi171 bash[25040]: audit 2024-09-14T01:45:47.880031+0000 mgr.a (mgr.14355) 8862 : audit [DBG] from='client.197691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:49 smithi171 bash[25040]: cluster 2024-09-14T01:45:48.477415+0000 mgr.a (mgr.14355) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:51 smithi007 bash[22722]: cluster 2024-09-14T01:45:50.479195+0000 mgr.a (mgr.14355) 8864 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:51 smithi131 bash[24745]: cluster 2024-09-14T01:45:50.479195+0000 mgr.a (mgr.14355) 8864 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:51 smithi171 bash[25040]: cluster 2024-09-14T01:45:50.479195+0000 mgr.a (mgr.14355) 8864 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:53.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:53.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:53.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:53 smithi007 bash[22722]: cluster 2024-09-14T01:45:52.480492+0000 mgr.a (mgr.14355) 8865 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:54.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:54.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:54.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:54.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:45:54.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:53 smithi131 bash[24745]: cluster 2024-09-14T01:45:52.480492+0000 mgr.a (mgr.14355) 8865 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:53 smithi171 bash[25040]: cluster 2024-09-14T01:45:52.480492+0000 mgr.a (mgr.14355) 8865 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:45:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:54 smithi007 bash[22722]: audit 2024-09-14T01:45:53.619431+0000 mgr.a (mgr.14355) 8866 : audit [DBG] from='client.197766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:54 smithi131 bash[24745]: audit 2024-09-14T01:45:53.619431+0000 mgr.a (mgr.14355) 8866 : audit [DBG] from='client.197766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:54 smithi171 bash[25040]: audit 2024-09-14T01:45:53.619431+0000 mgr.a (mgr.14355) 8866 : audit [DBG] from='client.197766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:45:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:55 smithi131 bash[24745]: cluster 2024-09-14T01:45:54.481485+0000 mgr.a (mgr.14355) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:55 smithi171 bash[25040]: cluster 2024-09-14T01:45:54.481485+0000 mgr.a (mgr.14355) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:55 smithi007 bash[22722]: cluster 2024-09-14T01:45:54.481485+0000 mgr.a (mgr.14355) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:45:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:57 smithi131 bash[24745]: cluster 2024-09-14T01:45:56.483823+0000 mgr.a (mgr.14355) 8868 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:57 smithi171 bash[25040]: cluster 2024-09-14T01:45:56.483823+0000 mgr.a (mgr.14355) 8868 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:57 smithi007 bash[22722]: cluster 2024-09-14T01:45:56.483823+0000 mgr.a (mgr.14355) 8868 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:45:59.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:45:59.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:45:59.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:45:59.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:45:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:45:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:45:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:45:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:45:59 smithi131 bash[24745]: cluster 2024-09-14T01:45:58.484585+0000 mgr.a (mgr.14355) 8869 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:45:59 smithi171 bash[25040]: cluster 2024-09-14T01:45:58.484585+0000 mgr.a (mgr.14355) 8869 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:45:59 smithi007 bash[22722]: cluster 2024-09-14T01:45:58.484585+0000 mgr.a (mgr.14355) 8869 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:00 smithi131 bash[24745]: audit 2024-09-14T01:45:59.366009+0000 mgr.a (mgr.14355) 8870 : audit [DBG] from='client.197841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:00 smithi171 bash[25040]: audit 2024-09-14T01:45:59.366009+0000 mgr.a (mgr.14355) 8870 : audit [DBG] from='client.197841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:00 smithi007 bash[22722]: audit 2024-09-14T01:45:59.366009+0000 mgr.a (mgr.14355) 8870 : audit [DBG] from='client.197841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:01 smithi131 bash[24745]: cluster 2024-09-14T01:46:00.486751+0000 mgr.a (mgr.14355) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:01 smithi171 bash[25040]: cluster 2024-09-14T01:46:00.486751+0000 mgr.a (mgr.14355) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:01 smithi007 bash[22722]: cluster 2024-09-14T01:46:00.486751+0000 mgr.a (mgr.14355) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:03 smithi131 bash[24745]: cluster 2024-09-14T01:46:02.488101+0000 mgr.a (mgr.14355) 8872 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:03 smithi171 bash[25040]: cluster 2024-09-14T01:46:02.488101+0000 mgr.a (mgr.14355) 8872 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:03 smithi007 bash[22722]: cluster 2024-09-14T01:46:02.488101+0000 mgr.a (mgr.14355) 8872 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:04.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:04.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:04.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:05.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:05.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:05.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:05.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:05.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:05 smithi131 bash[24745]: cluster 2024-09-14T01:46:04.488877+0000 mgr.a (mgr.14355) 8873 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:05 smithi171 bash[25040]: cluster 2024-09-14T01:46:04.488877+0000 mgr.a (mgr.14355) 8873 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:05 smithi007 bash[22722]: cluster 2024-09-14T01:46:04.488877+0000 mgr.a (mgr.14355) 8873 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:06 smithi131 bash[24745]: audit 2024-09-14T01:46:05.123842+0000 mgr.a (mgr.14355) 8874 : audit [DBG] from='client.197916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:06 smithi171 bash[25040]: audit 2024-09-14T01:46:05.123842+0000 mgr.a (mgr.14355) 8874 : audit [DBG] from='client.197916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:06 smithi007 bash[22722]: audit 2024-09-14T01:46:05.123842+0000 mgr.a (mgr.14355) 8874 : audit [DBG] from='client.197916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:07 smithi131 bash[24745]: cluster 2024-09-14T01:46:06.491439+0000 mgr.a (mgr.14355) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:07 smithi171 bash[25040]: cluster 2024-09-14T01:46:06.491439+0000 mgr.a (mgr.14355) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:07 smithi007 bash[22722]: cluster 2024-09-14T01:46:06.491439+0000 mgr.a (mgr.14355) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:46:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:09 smithi131 bash[24745]: cluster 2024-09-14T01:46:08.492238+0000 mgr.a (mgr.14355) 8876 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:09 smithi171 bash[25040]: cluster 2024-09-14T01:46:08.492238+0000 mgr.a (mgr.14355) 8876 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:09 smithi007 bash[22722]: cluster 2024-09-14T01:46:08.492238+0000 mgr.a (mgr.14355) 8876 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:10.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:10.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:10.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:11.322 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:11 smithi131 bash[24745]: cluster 2024-09-14T01:46:10.494193+0000 mgr.a (mgr.14355) 8877 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:11 smithi171 bash[25040]: cluster 2024-09-14T01:46:10.494193+0000 mgr.a (mgr.14355) 8877 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:11 smithi007 bash[22722]: cluster 2024-09-14T01:46:10.494193+0000 mgr.a (mgr.14355) 8877 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:12 smithi131 bash[24745]: audit 2024-09-14T01:46:10.891444+0000 mgr.a (mgr.14355) 8878 : audit [DBG] from='client.197994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:13.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:12 smithi171 bash[25040]: audit 2024-09-14T01:46:10.891444+0000 mgr.a (mgr.14355) 8878 : audit [DBG] from='client.197994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:12 smithi007 bash[22722]: audit 2024-09-14T01:46:10.891444+0000 mgr.a (mgr.14355) 8878 : audit [DBG] from='client.197994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:13 smithi131 bash[24745]: cluster 2024-09-14T01:46:12.495218+0000 mgr.a (mgr.14355) 8879 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:13 smithi171 bash[25040]: cluster 2024-09-14T01:46:12.495218+0000 mgr.a (mgr.14355) 8879 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:13 smithi007 bash[22722]: cluster 2024-09-14T01:46:12.495218+0000 mgr.a (mgr.14355) 8879 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:46:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:15 smithi131 bash[24745]: cluster 2024-09-14T01:46:14.496134+0000 mgr.a (mgr.14355) 8880 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:15 smithi171 bash[25040]: cluster 2024-09-14T01:46:14.496134+0000 mgr.a (mgr.14355) 8880 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:15 smithi007 bash[22722]: cluster 2024-09-14T01:46:14.496134+0000 mgr.a (mgr.14355) 8880 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:16.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:16.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:17.103 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:17 smithi131 bash[24745]: cluster 2024-09-14T01:46:16.498451+0000 mgr.a (mgr.14355) 8881 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:17 smithi131 bash[24745]: audit 2024-09-14T01:46:16.658045+0000 mgr.a (mgr.14355) 8882 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:17 smithi171 bash[25040]: cluster 2024-09-14T01:46:16.498451+0000 mgr.a (mgr.14355) 8881 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:17 smithi171 bash[25040]: audit 2024-09-14T01:46:16.658045+0000 mgr.a (mgr.14355) 8882 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:17 smithi007 bash[22722]: cluster 2024-09-14T01:46:16.498451+0000 mgr.a (mgr.14355) 8881 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:17 smithi007 bash[22722]: audit 2024-09-14T01:46:16.658045+0000 mgr.a (mgr.14355) 8882 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:19 smithi131 bash[24745]: cluster 2024-09-14T01:46:18.499407+0000 mgr.a (mgr.14355) 8883 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:46:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:19 smithi171 bash[25040]: cluster 2024-09-14T01:46:18.499407+0000 mgr.a (mgr.14355) 8883 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:46:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:19 smithi007 bash[22722]: cluster 2024-09-14T01:46:18.499407+0000 mgr.a (mgr.14355) 8883 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:46:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:21 smithi131 bash[24745]: cluster 2024-09-14T01:46:20.501580+0000 mgr.a (mgr.14355) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:21 smithi131 bash[24745]: audit 2024-09-14T01:46:21.307630+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:46:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:21 smithi171 bash[25040]: cluster 2024-09-14T01:46:20.501580+0000 mgr.a (mgr.14355) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:21 smithi171 bash[25040]: audit 2024-09-14T01:46:21.307630+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:46:22.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:22.105 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:22.105 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:21 smithi007 bash[22722]: cluster 2024-09-14T01:46:20.501580+0000 mgr.a (mgr.14355) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:21 smithi007 bash[22722]: audit 2024-09-14T01:46:21.307630+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:46:22.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:22.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:21.912487+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:21.920901+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:21.926152+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:21.932669+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.431251+0000 mgr.a (mgr.14355) 8885 : audit [DBG] from='client.198150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: cluster 2024-09-14T01:46:22.502139+0000 mgr.a (mgr.14355) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.655299+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.656577+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.661972+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.664404+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:22 smithi007 bash[22722]: audit 2024-09-14T01:46:22.665733+0000 mgr.a (mgr.14355) 8887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:21.912487+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:21.920901+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:21.926152+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:21.932669+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.431251+0000 mgr.a (mgr.14355) 8885 : audit [DBG] from='client.198150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: cluster 2024-09-14T01:46:22.502139+0000 mgr.a (mgr.14355) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.655299+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.656577+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.661972+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.664404+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:22 smithi131 bash[24745]: audit 2024-09-14T01:46:22.665733+0000 mgr.a (mgr.14355) 8887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:21.912487+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:21.920901+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:21.926152+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:21.932669+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.431251+0000 mgr.a (mgr.14355) 8885 : audit [DBG] from='client.198150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: cluster 2024-09-14T01:46:22.502139+0000 mgr.a (mgr.14355) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.655299+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.656577+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.661972+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.664404+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:22 smithi171 bash[25040]: audit 2024-09-14T01:46:22.665733+0000 mgr.a (mgr.14355) 8887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:46:23.935 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:46:23 smithi007 bash[22972]: debug 2024-09-14T01:46:23.566+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:46:23.935 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:46:23 smithi007 bash[22972]: debug 2024-09-14T01:46:23.566+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:46:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:23 smithi007 bash[22722]: audit 2024-09-14T01:46:23.571516+0000 mgr.a (mgr.14355) 8888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:46:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:23 smithi007 bash[22722]: cephadm 2024-09-14T01:46:23.572800+0000 mgr.a (mgr.14355) 8889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:46:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:23 smithi131 bash[24745]: audit 2024-09-14T01:46:23.571516+0000 mgr.a (mgr.14355) 8888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:46:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:23 smithi131 bash[24745]: cephadm 2024-09-14T01:46:23.572800+0000 mgr.a (mgr.14355) 8889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:46:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:23 smithi171 bash[25040]: audit 2024-09-14T01:46:23.571516+0000 mgr.a (mgr.14355) 8888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:46:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:23 smithi171 bash[25040]: cephadm 2024-09-14T01:46:23.572800+0000 mgr.a (mgr.14355) 8889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:46:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:24 smithi007 bash[22722]: cluster 2024-09-14T01:46:24.503072+0000 mgr.a (mgr.14355) 8890 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:24 smithi131 bash[24745]: cluster 2024-09-14T01:46:24.503072+0000 mgr.a (mgr.14355) 8890 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:24 smithi171 bash[25040]: cluster 2024-09-14T01:46:24.503072+0000 mgr.a (mgr.14355) 8890 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:27.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:27.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:27.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:27 smithi007 bash[22722]: cluster 2024-09-14T01:46:26.505325+0000 mgr.a (mgr.14355) 8891 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:27 smithi131 bash[24745]: cluster 2024-09-14T01:46:26.505325+0000 mgr.a (mgr.14355) 8891 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:27 smithi171 bash[25040]: cluster 2024-09-14T01:46:26.505325+0000 mgr.a (mgr.14355) 8891 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:28.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:28.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:29 smithi007 bash[22722]: audit 2024-09-14T01:46:28.211141+0000 mgr.a (mgr.14355) 8892 : audit [DBG] from='client.198333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:29 smithi007 bash[22722]: cluster 2024-09-14T01:46:28.505805+0000 mgr.a (mgr.14355) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:29 smithi131 bash[24745]: audit 2024-09-14T01:46:28.211141+0000 mgr.a (mgr.14355) 8892 : audit [DBG] from='client.198333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:29 smithi131 bash[24745]: cluster 2024-09-14T01:46:28.505805+0000 mgr.a (mgr.14355) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:29 smithi171 bash[25040]: audit 2024-09-14T01:46:28.211141+0000 mgr.a (mgr.14355) 8892 : audit [DBG] from='client.198333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:29 smithi171 bash[25040]: cluster 2024-09-14T01:46:28.505805+0000 mgr.a (mgr.14355) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:31 smithi007 bash[22722]: cluster 2024-09-14T01:46:30.508044+0000 mgr.a (mgr.14355) 8894 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:31 smithi131 bash[24745]: cluster 2024-09-14T01:46:30.508044+0000 mgr.a (mgr.14355) 8894 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:31 smithi171 bash[25040]: cluster 2024-09-14T01:46:30.508044+0000 mgr.a (mgr.14355) 8894 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:33.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:33.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:33.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:33 smithi007 bash[22722]: cluster 2024-09-14T01:46:32.508838+0000 mgr.a (mgr.14355) 8895 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:33 smithi131 bash[24745]: cluster 2024-09-14T01:46:32.508838+0000 mgr.a (mgr.14355) 8895 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:33 smithi171 bash[25040]: cluster 2024-09-14T01:46:32.508838+0000 mgr.a (mgr.14355) 8895 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:34.381 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:34.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:35 smithi007 bash[22722]: audit 2024-09-14T01:46:33.963613+0000 mgr.a (mgr.14355) 8896 : audit [DBG] from='client.198408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:35 smithi007 bash[22722]: cluster 2024-09-14T01:46:34.509805+0000 mgr.a (mgr.14355) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:35 smithi131 bash[24745]: audit 2024-09-14T01:46:33.963613+0000 mgr.a (mgr.14355) 8896 : audit [DBG] from='client.198408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:35 smithi131 bash[24745]: cluster 2024-09-14T01:46:34.509805+0000 mgr.a (mgr.14355) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:35 smithi171 bash[25040]: audit 2024-09-14T01:46:33.963613+0000 mgr.a (mgr.14355) 8896 : audit [DBG] from='client.198408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:35 smithi171 bash[25040]: cluster 2024-09-14T01:46:34.509805+0000 mgr.a (mgr.14355) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:37 smithi007 bash[22722]: cluster 2024-09-14T01:46:36.512254+0000 mgr.a (mgr.14355) 8898 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:37 smithi131 bash[24745]: cluster 2024-09-14T01:46:36.512254+0000 mgr.a (mgr.14355) 8898 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:37 smithi171 bash[25040]: cluster 2024-09-14T01:46:36.512254+0000 mgr.a (mgr.14355) 8898 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:46:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:39 smithi007 bash[22722]: cluster 2024-09-14T01:46:38.513203+0000 mgr.a (mgr.14355) 8899 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:39 smithi131 bash[24745]: cluster 2024-09-14T01:46:38.513203+0000 mgr.a (mgr.14355) 8899 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:39 smithi171 bash[25040]: cluster 2024-09-14T01:46:38.513203+0000 mgr.a (mgr.14355) 8899 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:40.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:40.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:40.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:40.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:40.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:40 smithi007 bash[22722]: audit 2024-09-14T01:46:39.712775+0000 mgr.a (mgr.14355) 8900 : audit [DBG] from='client.198483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:40 smithi131 bash[24745]: audit 2024-09-14T01:46:39.712775+0000 mgr.a (mgr.14355) 8900 : audit [DBG] from='client.198483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:40 smithi171 bash[25040]: audit 2024-09-14T01:46:39.712775+0000 mgr.a (mgr.14355) 8900 : audit [DBG] from='client.198483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:41 smithi007 bash[22722]: cluster 2024-09-14T01:46:40.515619+0000 mgr.a (mgr.14355) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:41 smithi131 bash[24745]: cluster 2024-09-14T01:46:40.515619+0000 mgr.a (mgr.14355) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:41 smithi171 bash[25040]: cluster 2024-09-14T01:46:40.515619+0000 mgr.a (mgr.14355) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:46:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:43 smithi007 bash[22722]: cluster 2024-09-14T01:46:42.516416+0000 mgr.a (mgr.14355) 8902 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:43 smithi131 bash[24745]: cluster 2024-09-14T01:46:42.516416+0000 mgr.a (mgr.14355) 8902 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:43 smithi171 bash[25040]: cluster 2024-09-14T01:46:42.516416+0000 mgr.a (mgr.14355) 8902 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:45.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:45.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:45.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:45.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:45.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:45.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:45 smithi007 bash[22722]: cluster 2024-09-14T01:46:44.517189+0000 mgr.a (mgr.14355) 8903 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:45 smithi131 bash[24745]: cluster 2024-09-14T01:46:44.517189+0000 mgr.a (mgr.14355) 8903 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:45 smithi171 bash[25040]: cluster 2024-09-14T01:46:44.517189+0000 mgr.a (mgr.14355) 8903 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:46 smithi007 bash[22722]: audit 2024-09-14T01:46:45.464480+0000 mgr.a (mgr.14355) 8904 : audit [DBG] from='client.198561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:46 smithi131 bash[24745]: audit 2024-09-14T01:46:45.464480+0000 mgr.a (mgr.14355) 8904 : audit [DBG] from='client.198561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:46 smithi171 bash[25040]: audit 2024-09-14T01:46:45.464480+0000 mgr.a (mgr.14355) 8904 : audit [DBG] from='client.198561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:47 smithi007 bash[22722]: cluster 2024-09-14T01:46:46.520079+0000 mgr.a (mgr.14355) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:47 smithi131 bash[24745]: cluster 2024-09-14T01:46:46.520079+0000 mgr.a (mgr.14355) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:47 smithi171 bash[25040]: cluster 2024-09-14T01:46:46.520079+0000 mgr.a (mgr.14355) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:49 smithi007 bash[22722]: cluster 2024-09-14T01:46:48.520880+0000 mgr.a (mgr.14355) 8906 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:49 smithi131 bash[24745]: cluster 2024-09-14T01:46:48.520880+0000 mgr.a (mgr.14355) 8906 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:49 smithi171 bash[25040]: cluster 2024-09-14T01:46:48.520880+0000 mgr.a (mgr.14355) 8906 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:50.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:50.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:51.633 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:51.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:51 smithi007 bash[22722]: cluster 2024-09-14T01:46:50.522838+0000 mgr.a (mgr.14355) 8907 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:51 smithi131 bash[24745]: cluster 2024-09-14T01:46:50.522838+0000 mgr.a (mgr.14355) 8907 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:51 smithi171 bash[25040]: cluster 2024-09-14T01:46:50.522838+0000 mgr.a (mgr.14355) 8907 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:52 smithi007 bash[22722]: audit 2024-09-14T01:46:51.218631+0000 mgr.a (mgr.14355) 8908 : audit [DBG] from='client.198639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:52 smithi131 bash[24745]: audit 2024-09-14T01:46:51.218631+0000 mgr.a (mgr.14355) 8908 : audit [DBG] from='client.198639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:52 smithi171 bash[25040]: audit 2024-09-14T01:46:51.218631+0000 mgr.a (mgr.14355) 8908 : audit [DBG] from='client.198639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:53 smithi007 bash[22722]: cluster 2024-09-14T01:46:52.523830+0000 mgr.a (mgr.14355) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:53 smithi131 bash[24745]: cluster 2024-09-14T01:46:52.523830+0000 mgr.a (mgr.14355) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:53 smithi171 bash[25040]: cluster 2024-09-14T01:46:52.523830+0000 mgr.a (mgr.14355) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:46:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:55 smithi007 bash[22722]: cluster 2024-09-14T01:46:54.524663+0000 mgr.a (mgr.14355) 8910 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:55 smithi131 bash[24745]: cluster 2024-09-14T01:46:54.524663+0000 mgr.a (mgr.14355) 8910 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:55 smithi171 bash[25040]: cluster 2024-09-14T01:46:54.524663+0000 mgr.a (mgr.14355) 8910 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:46:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:46:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:46:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:46:57.423 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:46:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:46:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:46:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:46:57.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:46:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:57 smithi007 bash[22722]: cluster 2024-09-14T01:46:56.526992+0000 mgr.a (mgr.14355) 8911 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:57 smithi131 bash[24745]: cluster 2024-09-14T01:46:56.526992+0000 mgr.a (mgr.14355) 8911 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:57 smithi171 bash[25040]: cluster 2024-09-14T01:46:56.526992+0000 mgr.a (mgr.14355) 8911 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:46:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:58 smithi007 bash[22722]: audit 2024-09-14T01:46:56.969743+0000 mgr.a (mgr.14355) 8912 : audit [DBG] from='client.198717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:58 smithi131 bash[24745]: audit 2024-09-14T01:46:56.969743+0000 mgr.a (mgr.14355) 8912 : audit [DBG] from='client.198717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:58 smithi171 bash[25040]: audit 2024-09-14T01:46:56.969743+0000 mgr.a (mgr.14355) 8912 : audit [DBG] from='client.198717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:46:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:46:59 smithi007 bash[22722]: cluster 2024-09-14T01:46:58.527989+0000 mgr.a (mgr.14355) 8913 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:46:59 smithi131 bash[24745]: cluster 2024-09-14T01:46:58.527989+0000 mgr.a (mgr.14355) 8913 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:46:59 smithi171 bash[25040]: cluster 2024-09-14T01:46:58.527989+0000 mgr.a (mgr.14355) 8913 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:01 smithi007 bash[22722]: cluster 2024-09-14T01:47:00.530149+0000 mgr.a (mgr.14355) 8914 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:01 smithi131 bash[24745]: cluster 2024-09-14T01:47:00.530149+0000 mgr.a (mgr.14355) 8914 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:01 smithi171 bash[25040]: cluster 2024-09-14T01:47:00.530149+0000 mgr.a (mgr.14355) 8914 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:02.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:02.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:02.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:03.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:03.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:03.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:03.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:03.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:03 smithi007 bash[22722]: cluster 2024-09-14T01:47:02.530579+0000 mgr.a (mgr.14355) 8915 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:03 smithi007 bash[22722]: audit 2024-09-14T01:47:02.757946+0000 mgr.a (mgr.14355) 8916 : audit [DBG] from='client.198795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:03 smithi131 bash[24745]: cluster 2024-09-14T01:47:02.530579+0000 mgr.a (mgr.14355) 8915 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:03 smithi131 bash[24745]: audit 2024-09-14T01:47:02.757946+0000 mgr.a (mgr.14355) 8916 : audit [DBG] from='client.198795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:03 smithi171 bash[25040]: cluster 2024-09-14T01:47:02.530579+0000 mgr.a (mgr.14355) 8915 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:03 smithi171 bash[25040]: audit 2024-09-14T01:47:02.757946+0000 mgr.a (mgr.14355) 8916 : audit [DBG] from='client.198795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:05.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:05 smithi007 bash[22722]: cluster 2024-09-14T01:47:04.531381+0000 mgr.a (mgr.14355) 8917 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:05 smithi131 bash[24745]: cluster 2024-09-14T01:47:04.531381+0000 mgr.a (mgr.14355) 8917 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:05 smithi171 bash[25040]: cluster 2024-09-14T01:47:04.531381+0000 mgr.a (mgr.14355) 8917 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:07 smithi007 bash[22722]: cluster 2024-09-14T01:47:06.533656+0000 mgr.a (mgr.14355) 8918 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:07 smithi131 bash[24745]: cluster 2024-09-14T01:47:06.533656+0000 mgr.a (mgr.14355) 8918 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:07 smithi171 bash[25040]: cluster 2024-09-14T01:47:06.533656+0000 mgr.a (mgr.14355) 8918 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:08.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:08.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:08.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:08.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:08.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:09 smithi007 bash[22722]: audit 2024-09-14T01:47:08.530972+0000 mgr.a (mgr.14355) 8919 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:09 smithi007 bash[22722]: cluster 2024-09-14T01:47:08.543604+0000 mgr.a (mgr.14355) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:09 smithi131 bash[24745]: audit 2024-09-14T01:47:08.530972+0000 mgr.a (mgr.14355) 8919 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:09 smithi131 bash[24745]: cluster 2024-09-14T01:47:08.543604+0000 mgr.a (mgr.14355) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:09 smithi171 bash[25040]: audit 2024-09-14T01:47:08.530972+0000 mgr.a (mgr.14355) 8919 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:09 smithi171 bash[25040]: cluster 2024-09-14T01:47:08.543604+0000 mgr.a (mgr.14355) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:11 smithi007 bash[22722]: cluster 2024-09-14T01:47:10.546006+0000 mgr.a (mgr.14355) 8921 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:11 smithi131 bash[24745]: cluster 2024-09-14T01:47:10.546006+0000 mgr.a (mgr.14355) 8921 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:11 smithi171 bash[25040]: cluster 2024-09-14T01:47:10.546006+0000 mgr.a (mgr.14355) 8921 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:13 smithi007 bash[22722]: cluster 2024-09-14T01:47:12.546948+0000 mgr.a (mgr.14355) 8922 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:13 smithi131 bash[24745]: cluster 2024-09-14T01:47:12.546948+0000 mgr.a (mgr.14355) 8922 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:13 smithi171 bash[25040]: cluster 2024-09-14T01:47:12.546948+0000 mgr.a (mgr.14355) 8922 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:14.729 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:15 smithi007 bash[22722]: audit 2024-09-14T01:47:14.306397+0000 mgr.a (mgr.14355) 8923 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:15 smithi007 bash[22722]: cluster 2024-09-14T01:47:14.547524+0000 mgr.a (mgr.14355) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:15 smithi131 bash[24745]: audit 2024-09-14T01:47:14.306397+0000 mgr.a (mgr.14355) 8923 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:16.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:15 smithi131 bash[24745]: cluster 2024-09-14T01:47:14.547524+0000 mgr.a (mgr.14355) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:15 smithi171 bash[25040]: audit 2024-09-14T01:47:14.306397+0000 mgr.a (mgr.14355) 8923 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:15 smithi171 bash[25040]: cluster 2024-09-14T01:47:14.547524+0000 mgr.a (mgr.14355) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:17 smithi007 bash[22722]: cluster 2024-09-14T01:47:16.549863+0000 mgr.a (mgr.14355) 8925 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:17 smithi131 bash[24745]: cluster 2024-09-14T01:47:16.549863+0000 mgr.a (mgr.14355) 8925 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:17 smithi171 bash[25040]: cluster 2024-09-14T01:47:16.549863+0000 mgr.a (mgr.14355) 8925 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:19.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:19.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:19.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:19 smithi007 bash[22722]: cluster 2024-09-14T01:47:18.550837+0000 mgr.a (mgr.14355) 8926 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:19 smithi131 bash[24745]: cluster 2024-09-14T01:47:18.550837+0000 mgr.a (mgr.14355) 8926 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:19 smithi171 bash[25040]: cluster 2024-09-14T01:47:18.550837+0000 mgr.a (mgr.14355) 8926 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:20.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:20.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:21 smithi007 bash[22722]: audit 2024-09-14T01:47:20.065746+0000 mgr.a (mgr.14355) 8927 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:21 smithi007 bash[22722]: cluster 2024-09-14T01:47:20.553307+0000 mgr.a (mgr.14355) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:47:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:21 smithi131 bash[24745]: audit 2024-09-14T01:47:20.065746+0000 mgr.a (mgr.14355) 8927 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:21 smithi131 bash[24745]: cluster 2024-09-14T01:47:20.553307+0000 mgr.a (mgr.14355) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:47:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:21 smithi171 bash[25040]: audit 2024-09-14T01:47:20.065746+0000 mgr.a (mgr.14355) 8927 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:21 smithi171 bash[25040]: cluster 2024-09-14T01:47:20.553307+0000 mgr.a (mgr.14355) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:47:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:23 smithi131 bash[24745]: cluster 2024-09-14T01:47:22.554112+0000 mgr.a (mgr.14355) 8929 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:23 smithi131 bash[24745]: audit 2024-09-14T01:47:23.622856+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:47:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:23 smithi171 bash[25040]: cluster 2024-09-14T01:47:22.554112+0000 mgr.a (mgr.14355) 8929 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:23 smithi171 bash[25040]: audit 2024-09-14T01:47:23.622856+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:47:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:23 smithi007 bash[22722]: cluster 2024-09-14T01:47:22.554112+0000 mgr.a (mgr.14355) 8929 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:23 smithi007 bash[22722]: audit 2024-09-14T01:47:23.622856+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:24 smithi131 bash[24745]: audit 2024-09-14T01:47:24.448479+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:24 smithi131 bash[24745]: audit 2024-09-14T01:47:24.450211+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:24 smithi131 bash[24745]: audit 2024-09-14T01:47:24.460657+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:24 smithi131 bash[24745]: audit 2024-09-14T01:47:24.465670+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:24 smithi171 bash[25040]: audit 2024-09-14T01:47:24.448479+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:24 smithi171 bash[25040]: audit 2024-09-14T01:47:24.450211+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:24 smithi171 bash[25040]: audit 2024-09-14T01:47:24.460657+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:24 smithi171 bash[25040]: audit 2024-09-14T01:47:24.465670+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:24 smithi007 bash[22722]: audit 2024-09-14T01:47:24.448479+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:24 smithi007 bash[22722]: audit 2024-09-14T01:47:24.450211+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:24 smithi007 bash[22722]: audit 2024-09-14T01:47:24.460657+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:24 smithi007 bash[22722]: audit 2024-09-14T01:47:24.465670+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:25.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:25.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:25.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:47:25 smithi007 bash[22972]: debug 2024-09-14T01:47:25.205+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:47:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:47:25 smithi007 bash[22972]: debug 2024-09-14T01:47:25.205+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:47:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:25 smithi131 bash[24745]: audit 2024-09-14T01:47:24.467039+0000 mgr.a (mgr.14355) 8930 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:25 smithi131 bash[24745]: cluster 2024-09-14T01:47:24.554612+0000 mgr.a (mgr.14355) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:25 smithi171 bash[25040]: audit 2024-09-14T01:47:24.467039+0000 mgr.a (mgr.14355) 8930 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:25 smithi171 bash[25040]: cluster 2024-09-14T01:47:24.554612+0000 mgr.a (mgr.14355) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:25 smithi007 bash[22722]: audit 2024-09-14T01:47:24.467039+0000 mgr.a (mgr.14355) 8930 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:47:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:25 smithi007 bash[22722]: cluster 2024-09-14T01:47:24.554612+0000 mgr.a (mgr.14355) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:47:26.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:26.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:26.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:26.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:26.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:26 smithi131 bash[24745]: audit 2024-09-14T01:47:25.206778+0000 mgr.a (mgr.14355) 8932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:26 smithi131 bash[24745]: cephadm 2024-09-14T01:47:25.208272+0000 mgr.a (mgr.14355) 8933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:26 smithi131 bash[24745]: audit 2024-09-14T01:47:25.825903+0000 mgr.a (mgr.14355) 8934 : audit [DBG] from='client.199212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:26 smithi171 bash[25040]: audit 2024-09-14T01:47:25.206778+0000 mgr.a (mgr.14355) 8932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:47:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:26 smithi171 bash[25040]: cephadm 2024-09-14T01:47:25.208272+0000 mgr.a (mgr.14355) 8933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:47:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:26 smithi171 bash[25040]: audit 2024-09-14T01:47:25.825903+0000 mgr.a (mgr.14355) 8934 : audit [DBG] from='client.199212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:26 smithi007 bash[22722]: audit 2024-09-14T01:47:25.206778+0000 mgr.a (mgr.14355) 8932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:47:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:26 smithi007 bash[22722]: cephadm 2024-09-14T01:47:25.208272+0000 mgr.a (mgr.14355) 8933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:47:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:26 smithi007 bash[22722]: audit 2024-09-14T01:47:25.825903+0000 mgr.a (mgr.14355) 8934 : audit [DBG] from='client.199212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:27 smithi131 bash[24745]: cluster 2024-09-14T01:47:26.557424+0000 mgr.a (mgr.14355) 8935 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:27 smithi171 bash[25040]: cluster 2024-09-14T01:47:26.557424+0000 mgr.a (mgr.14355) 8935 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:27 smithi007 bash[22722]: cluster 2024-09-14T01:47:26.557424+0000 mgr.a (mgr.14355) 8935 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:29 smithi131 bash[24745]: cluster 2024-09-14T01:47:28.558236+0000 mgr.a (mgr.14355) 8936 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:29 smithi171 bash[25040]: cluster 2024-09-14T01:47:28.558236+0000 mgr.a (mgr.14355) 8936 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:29 smithi007 bash[22722]: cluster 2024-09-14T01:47:28.558236+0000 mgr.a (mgr.14355) 8936 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:31.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:31.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:31.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:31.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:32.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:31 smithi131 bash[24745]: cluster 2024-09-14T01:47:30.560186+0000 mgr.a (mgr.14355) 8937 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:31 smithi171 bash[25040]: cluster 2024-09-14T01:47:30.560186+0000 mgr.a (mgr.14355) 8937 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:31 smithi007 bash[22722]: cluster 2024-09-14T01:47:30.560186+0000 mgr.a (mgr.14355) 8937 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:32 smithi131 bash[24745]: audit 2024-09-14T01:47:31.584382+0000 mgr.a (mgr.14355) 8938 : audit [DBG] from='client.199290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:32 smithi171 bash[25040]: audit 2024-09-14T01:47:31.584382+0000 mgr.a (mgr.14355) 8938 : audit [DBG] from='client.199290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:32 smithi007 bash[22722]: audit 2024-09-14T01:47:31.584382+0000 mgr.a (mgr.14355) 8938 : audit [DBG] from='client.199290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:33 smithi131 bash[24745]: cluster 2024-09-14T01:47:32.561182+0000 mgr.a (mgr.14355) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:33 smithi171 bash[25040]: cluster 2024-09-14T01:47:32.561182+0000 mgr.a (mgr.14355) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:33 smithi007 bash[22722]: cluster 2024-09-14T01:47:32.561182+0000 mgr.a (mgr.14355) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:35 smithi131 bash[24745]: cluster 2024-09-14T01:47:34.561989+0000 mgr.a (mgr.14355) 8940 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:35 smithi171 bash[25040]: cluster 2024-09-14T01:47:34.561989+0000 mgr.a (mgr.14355) 8940 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:35 smithi007 bash[22722]: cluster 2024-09-14T01:47:34.561989+0000 mgr.a (mgr.14355) 8940 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:47:37.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:37.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:37.771 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:37.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:37 smithi131 bash[24745]: cluster 2024-09-14T01:47:36.564287+0000 mgr.a (mgr.14355) 8941 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:37 smithi171 bash[25040]: cluster 2024-09-14T01:47:36.564287+0000 mgr.a (mgr.14355) 8941 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:37 smithi007 bash[22722]: cluster 2024-09-14T01:47:36.564287+0000 mgr.a (mgr.14355) 8941 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:47:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:38 smithi131 bash[24745]: audit 2024-09-14T01:47:37.335898+0000 mgr.a (mgr.14355) 8942 : audit [DBG] from='client.199368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:38 smithi171 bash[25040]: audit 2024-09-14T01:47:37.335898+0000 mgr.a (mgr.14355) 8942 : audit [DBG] from='client.199368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:38 smithi007 bash[22722]: audit 2024-09-14T01:47:37.335898+0000 mgr.a (mgr.14355) 8942 : audit [DBG] from='client.199368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:39 smithi131 bash[24745]: cluster 2024-09-14T01:47:38.565261+0000 mgr.a (mgr.14355) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:39 smithi171 bash[25040]: cluster 2024-09-14T01:47:38.565261+0000 mgr.a (mgr.14355) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:39 smithi007 bash[22722]: cluster 2024-09-14T01:47:38.565261+0000 mgr.a (mgr.14355) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:41 smithi131 bash[24745]: cluster 2024-09-14T01:47:40.567444+0000 mgr.a (mgr.14355) 8944 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:41 smithi171 bash[25040]: cluster 2024-09-14T01:47:40.567444+0000 mgr.a (mgr.14355) 8944 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:41 smithi007 bash[22722]: cluster 2024-09-14T01:47:40.567444+0000 mgr.a (mgr.14355) 8944 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:42.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:43.550 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:43 smithi131 bash[24745]: cluster 2024-09-14T01:47:42.568217+0000 mgr.a (mgr.14355) 8945 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:43 smithi171 bash[25040]: cluster 2024-09-14T01:47:42.568217+0000 mgr.a (mgr.14355) 8945 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:43 smithi007 bash[22722]: cluster 2024-09-14T01:47:42.568217+0000 mgr.a (mgr.14355) 8945 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:44 smithi171 bash[25040]: audit 2024-09-14T01:47:43.108167+0000 mgr.a (mgr.14355) 8946 : audit [DBG] from='client.199443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:44 smithi007 bash[22722]: audit 2024-09-14T01:47:43.108167+0000 mgr.a (mgr.14355) 8946 : audit [DBG] from='client.199443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:44 smithi131 bash[24745]: audit 2024-09-14T01:47:43.108167+0000 mgr.a (mgr.14355) 8946 : audit [DBG] from='client.199443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:45 smithi171 bash[25040]: cluster 2024-09-14T01:47:44.569128+0000 mgr.a (mgr.14355) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:45 smithi007 bash[22722]: cluster 2024-09-14T01:47:44.569128+0000 mgr.a (mgr.14355) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:45 smithi131 bash[24745]: cluster 2024-09-14T01:47:44.569128+0000 mgr.a (mgr.14355) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:47 smithi171 bash[25040]: cluster 2024-09-14T01:47:46.571421+0000 mgr.a (mgr.14355) 8948 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:47 smithi007 bash[22722]: cluster 2024-09-14T01:47:46.571421+0000 mgr.a (mgr.14355) 8948 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:47 smithi131 bash[24745]: cluster 2024-09-14T01:47:46.571421+0000 mgr.a (mgr.14355) 8948 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:48.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:48.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:48.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:49.322 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:49.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:49.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:49.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:49.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:49 smithi007 bash[22722]: cluster 2024-09-14T01:47:48.572102+0000 mgr.a (mgr.14355) 8949 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:49 smithi007 bash[22722]: audit 2024-09-14T01:47:48.886602+0000 mgr.a (mgr.14355) 8950 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:50.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:49 smithi131 bash[24745]: cluster 2024-09-14T01:47:48.572102+0000 mgr.a (mgr.14355) 8949 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:50.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:49 smithi131 bash[24745]: audit 2024-09-14T01:47:48.886602+0000 mgr.a (mgr.14355) 8950 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:49 smithi171 bash[25040]: cluster 2024-09-14T01:47:48.572102+0000 mgr.a (mgr.14355) 8949 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:49 smithi171 bash[25040]: audit 2024-09-14T01:47:48.886602+0000 mgr.a (mgr.14355) 8950 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:51 smithi007 bash[22722]: cluster 2024-09-14T01:47:50.574378+0000 mgr.a (mgr.14355) 8951 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:51 smithi131 bash[24745]: cluster 2024-09-14T01:47:50.574378+0000 mgr.a (mgr.14355) 8951 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:51 smithi171 bash[25040]: cluster 2024-09-14T01:47:50.574378+0000 mgr.a (mgr.14355) 8951 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:53 smithi007 bash[22722]: cluster 2024-09-14T01:47:52.575164+0000 mgr.a (mgr.14355) 8952 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:53 smithi131 bash[24745]: cluster 2024-09-14T01:47:52.575164+0000 mgr.a (mgr.14355) 8952 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:53 smithi171 bash[25040]: cluster 2024-09-14T01:47:52.575164+0000 mgr.a (mgr.14355) 8952 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:47:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:47:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:47:55.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:47:55.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:47:55.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:47:55.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:47:55.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:47:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:55 smithi007 bash[22722]: cluster 2024-09-14T01:47:54.575901+0000 mgr.a (mgr.14355) 8953 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:55 smithi007 bash[22722]: audit 2024-09-14T01:47:54.660075+0000 mgr.a (mgr.14355) 8954 : audit [DBG] from='client.199599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:55 smithi131 bash[24745]: cluster 2024-09-14T01:47:54.575901+0000 mgr.a (mgr.14355) 8953 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:55 smithi131 bash[24745]: audit 2024-09-14T01:47:54.660075+0000 mgr.a (mgr.14355) 8954 : audit [DBG] from='client.199599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:55 smithi171 bash[25040]: cluster 2024-09-14T01:47:54.575901+0000 mgr.a (mgr.14355) 8953 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:47:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:55 smithi171 bash[25040]: audit 2024-09-14T01:47:54.660075+0000 mgr.a (mgr.14355) 8954 : audit [DBG] from='client.199599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:47:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:57 smithi007 bash[22722]: cluster 2024-09-14T01:47:56.578324+0000 mgr.a (mgr.14355) 8955 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:57 smithi131 bash[24745]: cluster 2024-09-14T01:47:56.578324+0000 mgr.a (mgr.14355) 8955 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:47:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:57 smithi171 bash[25040]: cluster 2024-09-14T01:47:56.578324+0000 mgr.a (mgr.14355) 8955 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:00.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:00.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:47:59 smithi007 bash[22722]: cluster 2024-09-14T01:47:58.579088+0000 mgr.a (mgr.14355) 8956 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:47:59 smithi131 bash[24745]: cluster 2024-09-14T01:47:58.579088+0000 mgr.a (mgr.14355) 8956 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:47:59 smithi171 bash[25040]: cluster 2024-09-14T01:47:58.579088+0000 mgr.a (mgr.14355) 8956 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:00.862 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:00.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:00.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:00.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:00.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:01 smithi007 bash[22722]: audit 2024-09-14T01:48:00.435283+0000 mgr.a (mgr.14355) 8957 : audit [DBG] from='client.199677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:01 smithi007 bash[22722]: cluster 2024-09-14T01:48:00.581435+0000 mgr.a (mgr.14355) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:02.255 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:01 smithi171 bash[25040]: audit 2024-09-14T01:48:00.435283+0000 mgr.a (mgr.14355) 8957 : audit [DBG] from='client.199677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:02.255 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:01 smithi171 bash[25040]: cluster 2024-09-14T01:48:00.581435+0000 mgr.a (mgr.14355) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:01 smithi131 bash[24745]: audit 2024-09-14T01:48:00.435283+0000 mgr.a (mgr.14355) 8957 : audit [DBG] from='client.199677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:01 smithi131 bash[24745]: cluster 2024-09-14T01:48:00.581435+0000 mgr.a (mgr.14355) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:03 smithi007 bash[22722]: cluster 2024-09-14T01:48:02.582368+0000 mgr.a (mgr.14355) 8959 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:03 smithi131 bash[24745]: cluster 2024-09-14T01:48:02.582368+0000 mgr.a (mgr.14355) 8959 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:03 smithi171 bash[25040]: cluster 2024-09-14T01:48:02.582368+0000 mgr.a (mgr.14355) 8959 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:05.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:05.864 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:05 smithi007 bash[22722]: cluster 2024-09-14T01:48:04.583121+0000 mgr.a (mgr.14355) 8960 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:05 smithi131 bash[24745]: cluster 2024-09-14T01:48:04.583121+0000 mgr.a (mgr.14355) 8960 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:05 smithi171 bash[25040]: cluster 2024-09-14T01:48:04.583121+0000 mgr.a (mgr.14355) 8960 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:06.605 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:06.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:07 smithi007 bash[22722]: audit 2024-09-14T01:48:06.191115+0000 mgr.a (mgr.14355) 8961 : audit [DBG] from='client.199752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:07 smithi007 bash[22722]: cluster 2024-09-14T01:48:06.584595+0000 mgr.a (mgr.14355) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:07 smithi131 bash[24745]: audit 2024-09-14T01:48:06.191115+0000 mgr.a (mgr.14355) 8961 : audit [DBG] from='client.199752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:07 smithi131 bash[24745]: cluster 2024-09-14T01:48:06.584595+0000 mgr.a (mgr.14355) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:07 smithi171 bash[25040]: audit 2024-09-14T01:48:06.191115+0000 mgr.a (mgr.14355) 8961 : audit [DBG] from='client.199752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:07 smithi171 bash[25040]: cluster 2024-09-14T01:48:06.584595+0000 mgr.a (mgr.14355) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:09 smithi007 bash[22722]: cluster 2024-09-14T01:48:08.585480+0000 mgr.a (mgr.14355) 8963 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:09 smithi131 bash[24745]: cluster 2024-09-14T01:48:08.585480+0000 mgr.a (mgr.14355) 8963 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:09 smithi171 bash[25040]: cluster 2024-09-14T01:48:08.585480+0000 mgr.a (mgr.14355) 8963 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:11.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:11.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:11 smithi007 bash[22722]: cluster 2024-09-14T01:48:10.587475+0000 mgr.a (mgr.14355) 8964 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:11 smithi131 bash[24745]: cluster 2024-09-14T01:48:10.587475+0000 mgr.a (mgr.14355) 8964 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:11 smithi171 bash[25040]: cluster 2024-09-14T01:48:10.587475+0000 mgr.a (mgr.14355) 8964 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:12.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:12.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:13 smithi007 bash[22722]: audit 2024-09-14T01:48:11.942644+0000 mgr.a (mgr.14355) 8965 : audit [DBG] from='client.199830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:13 smithi007 bash[22722]: cluster 2024-09-14T01:48:12.588643+0000 mgr.a (mgr.14355) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:13 smithi131 bash[24745]: audit 2024-09-14T01:48:11.942644+0000 mgr.a (mgr.14355) 8965 : audit [DBG] from='client.199830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:13 smithi131 bash[24745]: cluster 2024-09-14T01:48:12.588643+0000 mgr.a (mgr.14355) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:13 smithi171 bash[25040]: audit 2024-09-14T01:48:11.942644+0000 mgr.a (mgr.14355) 8965 : audit [DBG] from='client.199830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:13 smithi171 bash[25040]: cluster 2024-09-14T01:48:12.588643+0000 mgr.a (mgr.14355) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:15 smithi007 bash[22722]: cluster 2024-09-14T01:48:14.589617+0000 mgr.a (mgr.14355) 8967 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:15 smithi131 bash[24745]: cluster 2024-09-14T01:48:14.589617+0000 mgr.a (mgr.14355) 8967 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:15 smithi171 bash[25040]: cluster 2024-09-14T01:48:14.589617+0000 mgr.a (mgr.14355) 8967 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:17.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:17.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:18.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:17 smithi007 bash[22722]: cluster 2024-09-14T01:48:16.591901+0000 mgr.a (mgr.14355) 8968 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:17 smithi131 bash[24745]: cluster 2024-09-14T01:48:16.591901+0000 mgr.a (mgr.14355) 8968 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:17 smithi171 bash[25040]: cluster 2024-09-14T01:48:16.591901+0000 mgr.a (mgr.14355) 8968 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:18 smithi007 bash[22722]: audit 2024-09-14T01:48:17.702970+0000 mgr.a (mgr.14355) 8969 : audit [DBG] from='client.199902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:18 smithi131 bash[24745]: audit 2024-09-14T01:48:17.702970+0000 mgr.a (mgr.14355) 8969 : audit [DBG] from='client.199902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:18 smithi171 bash[25040]: audit 2024-09-14T01:48:17.702970+0000 mgr.a (mgr.14355) 8969 : audit [DBG] from='client.199902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:19 smithi007 bash[22722]: cluster 2024-09-14T01:48:18.592876+0000 mgr.a (mgr.14355) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:19 smithi131 bash[24745]: cluster 2024-09-14T01:48:18.592876+0000 mgr.a (mgr.14355) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:19 smithi171 bash[25040]: cluster 2024-09-14T01:48:18.592876+0000 mgr.a (mgr.14355) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:21 smithi007 bash[22722]: cluster 2024-09-14T01:48:20.595076+0000 mgr.a (mgr.14355) 8971 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:21 smithi131 bash[24745]: cluster 2024-09-14T01:48:20.595076+0000 mgr.a (mgr.14355) 8971 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:21 smithi171 bash[25040]: cluster 2024-09-14T01:48:20.595076+0000 mgr.a (mgr.14355) 8971 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:23.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:23.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:23.850 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:23 smithi007 bash[22722]: cluster 2024-09-14T01:48:22.595840+0000 mgr.a (mgr.14355) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:23 smithi131 bash[24745]: cluster 2024-09-14T01:48:22.595840+0000 mgr.a (mgr.14355) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:23 smithi171 bash[25040]: cluster 2024-09-14T01:48:22.595840+0000 mgr.a (mgr.14355) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:24 smithi007 bash[22722]: audit 2024-09-14T01:48:23.439471+0000 mgr.a (mgr.14355) 8973 : audit [DBG] from='client.199977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:24 smithi131 bash[24745]: audit 2024-09-14T01:48:23.439471+0000 mgr.a (mgr.14355) 8973 : audit [DBG] from='client.199977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:24 smithi171 bash[25040]: audit 2024-09-14T01:48:23.439471+0000 mgr.a (mgr.14355) 8973 : audit [DBG] from='client.199977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:25 smithi007 bash[22722]: cluster 2024-09-14T01:48:24.596745+0000 mgr.a (mgr.14355) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:25 smithi007 bash[22722]: audit 2024-09-14T01:48:25.259986+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:48:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:25 smithi131 bash[24745]: cluster 2024-09-14T01:48:24.596745+0000 mgr.a (mgr.14355) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:25 smithi131 bash[24745]: audit 2024-09-14T01:48:25.259986+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:48:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:25 smithi171 bash[25040]: cluster 2024-09-14T01:48:24.596745+0000 mgr.a (mgr.14355) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:25 smithi171 bash[25040]: audit 2024-09-14T01:48:25.259986+0000 mon.a (mon.0) 1935 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:48:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22972]: debug 2024-09-14T01:48:26.860+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:48:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22972]: debug 2024-09-14T01:48:26.860+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:48:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22722]: audit 2024-09-14T01:48:26.111374+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:48:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22722]: audit 2024-09-14T01:48:26.112974+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:48:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22722]: audit 2024-09-14T01:48:26.123359+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:48:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:26 smithi007 bash[22722]: audit 2024-09-14T01:48:26.128271+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:26 smithi131 bash[24745]: audit 2024-09-14T01:48:26.111374+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:48:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:26 smithi131 bash[24745]: audit 2024-09-14T01:48:26.112974+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:48:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:26 smithi131 bash[24745]: audit 2024-09-14T01:48:26.123359+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:48:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:26 smithi131 bash[24745]: audit 2024-09-14T01:48:26.128271+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:26 smithi171 bash[25040]: audit 2024-09-14T01:48:26.111374+0000 mon.a (mon.0) 1936 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:48:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:26 smithi171 bash[25040]: audit 2024-09-14T01:48:26.112974+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:48:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:26 smithi171 bash[25040]: audit 2024-09-14T01:48:26.123359+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:48:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:26 smithi171 bash[25040]: audit 2024-09-14T01:48:26.128271+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:27 smithi007 bash[22722]: audit 2024-09-14T01:48:26.130628+0000 mgr.a (mgr.14355) 8975 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:27 smithi007 bash[22722]: cluster 2024-09-14T01:48:26.598040+0000 mgr.a (mgr.14355) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:27 smithi007 bash[22722]: audit 2024-09-14T01:48:26.863893+0000 mgr.a (mgr.14355) 8977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:48:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:27 smithi007 bash[22722]: cephadm 2024-09-14T01:48:26.865077+0000 mgr.a (mgr.14355) 8978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:48:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:27 smithi131 bash[24745]: audit 2024-09-14T01:48:26.130628+0000 mgr.a (mgr.14355) 8975 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:27 smithi131 bash[24745]: cluster 2024-09-14T01:48:26.598040+0000 mgr.a (mgr.14355) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:27 smithi131 bash[24745]: audit 2024-09-14T01:48:26.863893+0000 mgr.a (mgr.14355) 8977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:48:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:27 smithi131 bash[24745]: cephadm 2024-09-14T01:48:26.865077+0000 mgr.a (mgr.14355) 8978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:48:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:27 smithi171 bash[25040]: audit 2024-09-14T01:48:26.130628+0000 mgr.a (mgr.14355) 8975 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:48:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:27 smithi171 bash[25040]: cluster 2024-09-14T01:48:26.598040+0000 mgr.a (mgr.14355) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:27 smithi171 bash[25040]: audit 2024-09-14T01:48:26.863893+0000 mgr.a (mgr.14355) 8977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:48:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:27 smithi171 bash[25040]: cephadm 2024-09-14T01:48:26.865077+0000 mgr.a (mgr.14355) 8978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:48:28.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:28.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:29.597 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:29.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:29.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:29.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:29 smithi007 bash[22722]: cluster 2024-09-14T01:48:28.598875+0000 mgr.a (mgr.14355) 8979 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:29 smithi131 bash[24745]: cluster 2024-09-14T01:48:28.598875+0000 mgr.a (mgr.14355) 8979 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:29 smithi171 bash[25040]: cluster 2024-09-14T01:48:28.598875+0000 mgr.a (mgr.14355) 8979 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:30 smithi007 bash[22722]: audit 2024-09-14T01:48:29.179517+0000 mgr.a (mgr.14355) 8980 : audit [DBG] from='client.200157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:30 smithi131 bash[24745]: audit 2024-09-14T01:48:29.179517+0000 mgr.a (mgr.14355) 8980 : audit [DBG] from='client.200157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:30 smithi171 bash[25040]: audit 2024-09-14T01:48:29.179517+0000 mgr.a (mgr.14355) 8980 : audit [DBG] from='client.200157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:31 smithi007 bash[22722]: cluster 2024-09-14T01:48:30.601174+0000 mgr.a (mgr.14355) 8981 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:31 smithi131 bash[24745]: cluster 2024-09-14T01:48:30.601174+0000 mgr.a (mgr.14355) 8981 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:31 smithi171 bash[25040]: cluster 2024-09-14T01:48:30.601174+0000 mgr.a (mgr.14355) 8981 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:32 smithi131 bash[24745]: cluster 2024-09-14T01:48:32.601987+0000 mgr.a (mgr.14355) 8982 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:32 smithi171 bash[25040]: cluster 2024-09-14T01:48:32.601987+0000 mgr.a (mgr.14355) 8982 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:32 smithi007 bash[22722]: cluster 2024-09-14T01:48:32.601987+0000 mgr.a (mgr.14355) 8982 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:34.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:34.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:34.599 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:35.356 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:35.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:35 smithi007 bash[22722]: cluster 2024-09-14T01:48:34.602662+0000 mgr.a (mgr.14355) 8983 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:35 smithi131 bash[24745]: cluster 2024-09-14T01:48:34.602662+0000 mgr.a (mgr.14355) 8983 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:35 smithi171 bash[25040]: cluster 2024-09-14T01:48:34.602662+0000 mgr.a (mgr.14355) 8983 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:36 smithi007 bash[22722]: audit 2024-09-14T01:48:34.934447+0000 mgr.a (mgr.14355) 8984 : audit [DBG] from='client.200232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:36 smithi131 bash[24745]: audit 2024-09-14T01:48:34.934447+0000 mgr.a (mgr.14355) 8984 : audit [DBG] from='client.200232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:36 smithi171 bash[25040]: audit 2024-09-14T01:48:34.934447+0000 mgr.a (mgr.14355) 8984 : audit [DBG] from='client.200232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:37 smithi007 bash[22722]: cluster 2024-09-14T01:48:36.604994+0000 mgr.a (mgr.14355) 8985 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:37 smithi131 bash[24745]: cluster 2024-09-14T01:48:36.604994+0000 mgr.a (mgr.14355) 8985 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:37 smithi171 bash[25040]: cluster 2024-09-14T01:48:36.604994+0000 mgr.a (mgr.14355) 8985 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:39 smithi007 bash[22722]: cluster 2024-09-14T01:48:38.605894+0000 mgr.a (mgr.14355) 8986 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:48:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:39 smithi131 bash[24745]: cluster 2024-09-14T01:48:38.605894+0000 mgr.a (mgr.14355) 8986 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:48:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:39 smithi171 bash[25040]: cluster 2024-09-14T01:48:38.605894+0000 mgr.a (mgr.14355) 8986 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:48:40.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:40.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:40.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:41.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:41 smithi007 bash[22722]: cluster 2024-09-14T01:48:40.607970+0000 mgr.a (mgr.14355) 8987 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:41 smithi007 bash[22722]: audit 2024-09-14T01:48:40.683654+0000 mgr.a (mgr.14355) 8988 : audit [DBG] from='client.200310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:41 smithi131 bash[24745]: cluster 2024-09-14T01:48:40.607970+0000 mgr.a (mgr.14355) 8987 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:41 smithi131 bash[24745]: audit 2024-09-14T01:48:40.683654+0000 mgr.a (mgr.14355) 8988 : audit [DBG] from='client.200310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:41 smithi171 bash[25040]: cluster 2024-09-14T01:48:40.607970+0000 mgr.a (mgr.14355) 8987 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:48:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:41 smithi171 bash[25040]: audit 2024-09-14T01:48:40.683654+0000 mgr.a (mgr.14355) 8988 : audit [DBG] from='client.200310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:43 smithi007 bash[22722]: cluster 2024-09-14T01:48:42.608886+0000 mgr.a (mgr.14355) 8989 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:43 smithi131 bash[24745]: cluster 2024-09-14T01:48:42.608886+0000 mgr.a (mgr.14355) 8989 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:43 smithi171 bash[25040]: cluster 2024-09-14T01:48:42.608886+0000 mgr.a (mgr.14355) 8989 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:48:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:45 smithi007 bash[22722]: cluster 2024-09-14T01:48:44.609666+0000 mgr.a (mgr.14355) 8990 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:45 smithi131 bash[24745]: cluster 2024-09-14T01:48:44.609666+0000 mgr.a (mgr.14355) 8990 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:45 smithi171 bash[25040]: cluster 2024-09-14T01:48:44.609666+0000 mgr.a (mgr.14355) 8990 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:48:46.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:46.851 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:46.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:46.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:47 smithi007 bash[22722]: audit 2024-09-14T01:48:46.441101+0000 mgr.a (mgr.14355) 8991 : audit [DBG] from='client.200385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:47 smithi007 bash[22722]: cluster 2024-09-14T01:48:46.611098+0000 mgr.a (mgr.14355) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:47 smithi131 bash[24745]: audit 2024-09-14T01:48:46.441101+0000 mgr.a (mgr.14355) 8991 : audit [DBG] from='client.200385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:47 smithi131 bash[24745]: cluster 2024-09-14T01:48:46.611098+0000 mgr.a (mgr.14355) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:47 smithi171 bash[25040]: audit 2024-09-14T01:48:46.441101+0000 mgr.a (mgr.14355) 8991 : audit [DBG] from='client.200385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:47 smithi171 bash[25040]: cluster 2024-09-14T01:48:46.611098+0000 mgr.a (mgr.14355) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:49 smithi007 bash[22722]: cluster 2024-09-14T01:48:48.611982+0000 mgr.a (mgr.14355) 8993 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:48:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:49 smithi131 bash[24745]: cluster 2024-09-14T01:48:48.611982+0000 mgr.a (mgr.14355) 8993 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:48:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:49 smithi171 bash[25040]: cluster 2024-09-14T01:48:48.611982+0000 mgr.a (mgr.14355) 8993 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:48:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:51 smithi007 bash[22722]: cluster 2024-09-14T01:48:50.614114+0000 mgr.a (mgr.14355) 8994 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:48:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:51 smithi131 bash[24745]: cluster 2024-09-14T01:48:50.614114+0000 mgr.a (mgr.14355) 8994 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:48:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:51 smithi171 bash[25040]: cluster 2024-09-14T01:48:50.614114+0000 mgr.a (mgr.14355) 8994 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:48:52.626 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:52.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:48:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:53 smithi007 bash[22722]: audit 2024-09-14T01:48:52.186818+0000 mgr.a (mgr.14355) 8995 : audit [DBG] from='client.200457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:53 smithi007 bash[22722]: cluster 2024-09-14T01:48:52.614619+0000 mgr.a (mgr.14355) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:53 smithi131 bash[24745]: audit 2024-09-14T01:48:52.186818+0000 mgr.a (mgr.14355) 8995 : audit [DBG] from='client.200457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:53 smithi131 bash[24745]: cluster 2024-09-14T01:48:52.614619+0000 mgr.a (mgr.14355) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:53 smithi171 bash[25040]: audit 2024-09-14T01:48:52.186818+0000 mgr.a (mgr.14355) 8995 : audit [DBG] from='client.200457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:48:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:53 smithi171 bash[25040]: cluster 2024-09-14T01:48:52.614619+0000 mgr.a (mgr.14355) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:55 smithi131 bash[24745]: cluster 2024-09-14T01:48:54.615328+0000 mgr.a (mgr.14355) 8997 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:55 smithi171 bash[25040]: cluster 2024-09-14T01:48:54.615328+0000 mgr.a (mgr.14355) 8997 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:55 smithi007 bash[22722]: cluster 2024-09-14T01:48:54.615328+0000 mgr.a (mgr.14355) 8997 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:48:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:48:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:48:57.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:48:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:57 smithi131 bash[24745]: cluster 2024-09-14T01:48:56.617663+0000 mgr.a (mgr.14355) 8998 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:57 smithi171 bash[25040]: cluster 2024-09-14T01:48:56.617663+0000 mgr.a (mgr.14355) 8998 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:57 smithi007 bash[22722]: cluster 2024-09-14T01:48:56.617663+0000 mgr.a (mgr.14355) 8998 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:48:58.396 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:48:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:48:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:48:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:48:58.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:59 smithi131 bash[24745]: audit 2024-09-14T01:48:57.964159+0000 mgr.a (mgr.14355) 8999 : audit [DBG] from='client.200535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:48:59 smithi131 bash[24745]: cluster 2024-09-14T01:48:58.618590+0000 mgr.a (mgr.14355) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:59 smithi171 bash[25040]: audit 2024-09-14T01:48:57.964159+0000 mgr.a (mgr.14355) 8999 : audit [DBG] from='client.200535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:48:59 smithi171 bash[25040]: cluster 2024-09-14T01:48:58.618590+0000 mgr.a (mgr.14355) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:59 smithi007 bash[22722]: audit 2024-09-14T01:48:57.964159+0000 mgr.a (mgr.14355) 8999 : audit [DBG] from='client.200535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:48:59 smithi007 bash[22722]: cluster 2024-09-14T01:48:58.618590+0000 mgr.a (mgr.14355) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:01 smithi131 bash[24745]: cluster 2024-09-14T01:49:00.620782+0000 mgr.a (mgr.14355) 9001 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:01 smithi171 bash[25040]: cluster 2024-09-14T01:49:00.620782+0000 mgr.a (mgr.14355) 9001 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:01 smithi007 bash[22722]: cluster 2024-09-14T01:49:00.620782+0000 mgr.a (mgr.14355) 9001 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:03.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:03 smithi131 bash[24745]: cluster 2024-09-14T01:49:02.621544+0000 mgr.a (mgr.14355) 9002 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:03 smithi171 bash[25040]: cluster 2024-09-14T01:49:02.621544+0000 mgr.a (mgr.14355) 9002 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:04.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:04.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:04.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:04.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:04.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:03 smithi007 bash[22722]: cluster 2024-09-14T01:49:02.621544+0000 mgr.a (mgr.14355) 9002 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:04 smithi131 bash[24745]: audit 2024-09-14T01:49:03.730735+0000 mgr.a (mgr.14355) 9003 : audit [DBG] from='client.200610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:04 smithi171 bash[25040]: audit 2024-09-14T01:49:03.730735+0000 mgr.a (mgr.14355) 9003 : audit [DBG] from='client.200610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:04 smithi007 bash[22722]: audit 2024-09-14T01:49:03.730735+0000 mgr.a (mgr.14355) 9003 : audit [DBG] from='client.200610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:05 smithi131 bash[24745]: cluster 2024-09-14T01:49:04.622448+0000 mgr.a (mgr.14355) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:05 smithi171 bash[25040]: cluster 2024-09-14T01:49:04.622448+0000 mgr.a (mgr.14355) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:05 smithi007 bash[22722]: cluster 2024-09-14T01:49:04.622448+0000 mgr.a (mgr.14355) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:07 smithi131 bash[24745]: cluster 2024-09-14T01:49:06.624729+0000 mgr.a (mgr.14355) 9005 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:07 smithi171 bash[25040]: cluster 2024-09-14T01:49:06.624729+0000 mgr.a (mgr.14355) 9005 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:07 smithi007 bash[22722]: cluster 2024-09-14T01:49:06.624729+0000 mgr.a (mgr.14355) 9005 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:09.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:09.938 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:09 smithi131 bash[24745]: cluster 2024-09-14T01:49:08.625528+0000 mgr.a (mgr.14355) 9006 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:09 smithi171 bash[25040]: cluster 2024-09-14T01:49:08.625528+0000 mgr.a (mgr.14355) 9006 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:09 smithi007 bash[22722]: cluster 2024-09-14T01:49:08.625528+0000 mgr.a (mgr.14355) 9006 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:10 smithi131 bash[24745]: audit 2024-09-14T01:49:09.501526+0000 mgr.a (mgr.14355) 9007 : audit [DBG] from='client.200688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:10 smithi171 bash[25040]: audit 2024-09-14T01:49:09.501526+0000 mgr.a (mgr.14355) 9007 : audit [DBG] from='client.200688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:10 smithi007 bash[22722]: audit 2024-09-14T01:49:09.501526+0000 mgr.a (mgr.14355) 9007 : audit [DBG] from='client.200688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:11 smithi131 bash[24745]: cluster 2024-09-14T01:49:10.627846+0000 mgr.a (mgr.14355) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:11 smithi171 bash[25040]: cluster 2024-09-14T01:49:10.627846+0000 mgr.a (mgr.14355) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:11 smithi007 bash[22722]: cluster 2024-09-14T01:49:10.627846+0000 mgr.a (mgr.14355) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:13 smithi131 bash[24745]: cluster 2024-09-14T01:49:12.628619+0000 mgr.a (mgr.14355) 9009 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:13 smithi171 bash[25040]: cluster 2024-09-14T01:49:12.628619+0000 mgr.a (mgr.14355) 9009 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:13 smithi007 bash[22722]: cluster 2024-09-14T01:49:12.628619+0000 mgr.a (mgr.14355) 9009 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:14.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:14.940 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:14.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:15.689 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:15.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:15.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:15.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:15.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:15 smithi131 bash[24745]: cluster 2024-09-14T01:49:14.629372+0000 mgr.a (mgr.14355) 9010 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:15 smithi171 bash[25040]: cluster 2024-09-14T01:49:14.629372+0000 mgr.a (mgr.14355) 9010 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:15 smithi007 bash[22722]: cluster 2024-09-14T01:49:14.629372+0000 mgr.a (mgr.14355) 9010 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:16 smithi131 bash[24745]: audit 2024-09-14T01:49:15.271180+0000 mgr.a (mgr.14355) 9011 : audit [DBG] from='client.200763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:16 smithi171 bash[25040]: audit 2024-09-14T01:49:15.271180+0000 mgr.a (mgr.14355) 9011 : audit [DBG] from='client.200763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:16 smithi007 bash[22722]: audit 2024-09-14T01:49:15.271180+0000 mgr.a (mgr.14355) 9011 : audit [DBG] from='client.200763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:17 smithi131 bash[24745]: cluster 2024-09-14T01:49:16.632208+0000 mgr.a (mgr.14355) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:49:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:17 smithi171 bash[25040]: cluster 2024-09-14T01:49:16.632208+0000 mgr.a (mgr.14355) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:49:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:17 smithi007 bash[22722]: cluster 2024-09-14T01:49:16.632208+0000 mgr.a (mgr.14355) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T01:49:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:19 smithi131 bash[24745]: cluster 2024-09-14T01:49:18.633011+0000 mgr.a (mgr.14355) 9013 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:49:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:19 smithi171 bash[25040]: cluster 2024-09-14T01:49:18.633011+0000 mgr.a (mgr.14355) 9013 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:49:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:19 smithi007 bash[22722]: cluster 2024-09-14T01:49:18.633011+0000 mgr.a (mgr.14355) 9013 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T01:49:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:21.444 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:21.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:21 smithi131 bash[24745]: cluster 2024-09-14T01:49:20.634953+0000 mgr.a (mgr.14355) 9014 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:21 smithi171 bash[25040]: cluster 2024-09-14T01:49:20.634953+0000 mgr.a (mgr.14355) 9014 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:21 smithi007 bash[22722]: cluster 2024-09-14T01:49:20.634953+0000 mgr.a (mgr.14355) 9014 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:22 smithi171 bash[25040]: audit 2024-09-14T01:49:21.025806+0000 mgr.a (mgr.14355) 9015 : audit [DBG] from='client.200841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:22 smithi007 bash[22722]: audit 2024-09-14T01:49:21.025806+0000 mgr.a (mgr.14355) 9015 : audit [DBG] from='client.200841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:22 smithi131 bash[24745]: audit 2024-09-14T01:49:21.025806+0000 mgr.a (mgr.14355) 9015 : audit [DBG] from='client.200841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:23 smithi171 bash[25040]: cluster 2024-09-14T01:49:22.635842+0000 mgr.a (mgr.14355) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:49:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:23 smithi007 bash[22722]: cluster 2024-09-14T01:49:22.635842+0000 mgr.a (mgr.14355) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:49:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:23 smithi131 bash[24745]: cluster 2024-09-14T01:49:22.635842+0000 mgr.a (mgr.14355) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:49:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:25 smithi007 bash[22722]: cluster 2024-09-14T01:49:24.636650+0000 mgr.a (mgr.14355) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:49:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:25 smithi131 bash[24745]: cluster 2024-09-14T01:49:24.636650+0000 mgr.a (mgr.14355) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:49:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:25 smithi171 bash[25040]: cluster 2024-09-14T01:49:24.636650+0000 mgr.a (mgr.14355) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:49:26.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:26.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:26.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:27.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:27.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:27.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:27.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:27.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: cluster 2024-09-14T01:49:26.638840+0000 mgr.a (mgr.14355) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:26.777549+0000 mgr.a (mgr.14355) 9019 : audit [DBG] from='client.200919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:26.914772+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:27.686980+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:27.688924+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:27.697743+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:49:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:27 smithi007 bash[22722]: audit 2024-09-14T01:49:27.702726+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: cluster 2024-09-14T01:49:26.638840+0000 mgr.a (mgr.14355) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:26.777549+0000 mgr.a (mgr.14355) 9019 : audit [DBG] from='client.200919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:26.914772+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:27.686980+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:27.688924+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:27.697743+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:49:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:27 smithi131 bash[24745]: audit 2024-09-14T01:49:27.702726+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: cluster 2024-09-14T01:49:26.638840+0000 mgr.a (mgr.14355) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:26.777549+0000 mgr.a (mgr.14355) 9019 : audit [DBG] from='client.200919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:26.914772+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:49:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:27.686980+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:49:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:27.688924+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:49:28.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:27.697743+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:49:28.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:27 smithi171 bash[25040]: audit 2024-09-14T01:49:27.702726+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:28.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:49:28 smithi007 bash[22972]: debug 2024-09-14T01:49:28.415+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:49:28.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:49:28 smithi007 bash[22972]: debug 2024-09-14T01:49:28.415+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:49:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:28 smithi007 bash[22722]: audit 2024-09-14T01:49:27.705503+0000 mgr.a (mgr.14355) 9020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:28 smithi131 bash[24745]: audit 2024-09-14T01:49:27.705503+0000 mgr.a (mgr.14355) 9020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:28 smithi171 bash[25040]: audit 2024-09-14T01:49:27.705503+0000 mgr.a (mgr.14355) 9020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:49:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:29 smithi007 bash[22722]: audit 2024-09-14T01:49:28.419123+0000 mgr.a (mgr.14355) 9021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:49:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:29 smithi007 bash[22722]: cephadm 2024-09-14T01:49:28.420488+0000 mgr.a (mgr.14355) 9022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:49:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:29 smithi007 bash[22722]: cluster 2024-09-14T01:49:28.639739+0000 mgr.a (mgr.14355) 9023 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:49:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:29 smithi131 bash[24745]: audit 2024-09-14T01:49:28.419123+0000 mgr.a (mgr.14355) 9021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:49:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:29 smithi131 bash[24745]: cephadm 2024-09-14T01:49:28.420488+0000 mgr.a (mgr.14355) 9022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:49:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:29 smithi131 bash[24745]: cluster 2024-09-14T01:49:28.639739+0000 mgr.a (mgr.14355) 9023 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:49:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:29 smithi171 bash[25040]: audit 2024-09-14T01:49:28.419123+0000 mgr.a (mgr.14355) 9021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:49:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:29 smithi171 bash[25040]: cephadm 2024-09-14T01:49:28.420488+0000 mgr.a (mgr.14355) 9022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:49:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:29 smithi171 bash[25040]: cluster 2024-09-14T01:49:28.639739+0000 mgr.a (mgr.14355) 9023 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:49:32.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:32.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:31 smithi007 bash[22722]: cluster 2024-09-14T01:49:30.641991+0000 mgr.a (mgr.14355) 9024 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:31 smithi131 bash[24745]: cluster 2024-09-14T01:49:30.641991+0000 mgr.a (mgr.14355) 9024 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:31 smithi171 bash[25040]: cluster 2024-09-14T01:49:30.641991+0000 mgr.a (mgr.14355) 9024 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:32.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:32.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:33 smithi007 bash[22722]: audit 2024-09-14T01:49:32.531305+0000 mgr.a (mgr.14355) 9025 : audit [DBG] from='client.201102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:33 smithi007 bash[22722]: cluster 2024-09-14T01:49:32.642554+0000 mgr.a (mgr.14355) 9026 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:33 smithi131 bash[24745]: audit 2024-09-14T01:49:32.531305+0000 mgr.a (mgr.14355) 9025 : audit [DBG] from='client.201102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:33 smithi131 bash[24745]: cluster 2024-09-14T01:49:32.642554+0000 mgr.a (mgr.14355) 9026 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:33 smithi171 bash[25040]: audit 2024-09-14T01:49:32.531305+0000 mgr.a (mgr.14355) 9025 : audit [DBG] from='client.201102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:33 smithi171 bash[25040]: cluster 2024-09-14T01:49:32.642554+0000 mgr.a (mgr.14355) 9026 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:35 smithi007 bash[22722]: cluster 2024-09-14T01:49:34.643467+0000 mgr.a (mgr.14355) 9027 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:35 smithi131 bash[24745]: cluster 2024-09-14T01:49:34.643467+0000 mgr.a (mgr.14355) 9027 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:35 smithi171 bash[25040]: cluster 2024-09-14T01:49:34.643467+0000 mgr.a (mgr.14355) 9027 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:37.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:37.945 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:37.945 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:37 smithi007 bash[22722]: cluster 2024-09-14T01:49:36.645768+0000 mgr.a (mgr.14355) 9028 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:37 smithi131 bash[24745]: cluster 2024-09-14T01:49:36.645768+0000 mgr.a (mgr.14355) 9028 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:37 smithi171 bash[25040]: cluster 2024-09-14T01:49:36.645768+0000 mgr.a (mgr.14355) 9028 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:38.706 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:38.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:38.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:39 smithi007 bash[22722]: audit 2024-09-14T01:49:38.277448+0000 mgr.a (mgr.14355) 9029 : audit [DBG] from='client.201171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:39 smithi007 bash[22722]: cluster 2024-09-14T01:49:38.646333+0000 mgr.a (mgr.14355) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:39 smithi131 bash[24745]: audit 2024-09-14T01:49:38.277448+0000 mgr.a (mgr.14355) 9029 : audit [DBG] from='client.201171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:39 smithi131 bash[24745]: cluster 2024-09-14T01:49:38.646333+0000 mgr.a (mgr.14355) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:39 smithi171 bash[25040]: audit 2024-09-14T01:49:38.277448+0000 mgr.a (mgr.14355) 9029 : audit [DBG] from='client.201171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:39 smithi171 bash[25040]: cluster 2024-09-14T01:49:38.646333+0000 mgr.a (mgr.14355) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:41 smithi007 bash[22722]: cluster 2024-09-14T01:49:40.648573+0000 mgr.a (mgr.14355) 9031 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:41 smithi131 bash[24745]: cluster 2024-09-14T01:49:40.648573+0000 mgr.a (mgr.14355) 9031 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:41 smithi171 bash[25040]: cluster 2024-09-14T01:49:40.648573+0000 mgr.a (mgr.14355) 9031 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:49:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:43.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:43 smithi007 bash[22722]: cluster 2024-09-14T01:49:42.649501+0000 mgr.a (mgr.14355) 9032 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:43 smithi131 bash[24745]: cluster 2024-09-14T01:49:42.649501+0000 mgr.a (mgr.14355) 9032 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:43 smithi171 bash[25040]: cluster 2024-09-14T01:49:42.649501+0000 mgr.a (mgr.14355) 9032 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:44.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:44.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:44.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:44.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:44.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:45 smithi007 bash[22722]: audit 2024-09-14T01:49:44.046802+0000 mgr.a (mgr.14355) 9033 : audit [DBG] from='client.201243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:45 smithi007 bash[22722]: cluster 2024-09-14T01:49:44.650043+0000 mgr.a (mgr.14355) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:45 smithi131 bash[24745]: audit 2024-09-14T01:49:44.046802+0000 mgr.a (mgr.14355) 9033 : audit [DBG] from='client.201243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:45 smithi131 bash[24745]: cluster 2024-09-14T01:49:44.650043+0000 mgr.a (mgr.14355) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:45 smithi171 bash[25040]: audit 2024-09-14T01:49:44.046802+0000 mgr.a (mgr.14355) 9033 : audit [DBG] from='client.201243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:45 smithi171 bash[25040]: cluster 2024-09-14T01:49:44.650043+0000 mgr.a (mgr.14355) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:47 smithi007 bash[22722]: cluster 2024-09-14T01:49:46.652274+0000 mgr.a (mgr.14355) 9035 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:47 smithi131 bash[24745]: cluster 2024-09-14T01:49:46.652274+0000 mgr.a (mgr.14355) 9035 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:47 smithi171 bash[25040]: cluster 2024-09-14T01:49:46.652274+0000 mgr.a (mgr.14355) 9035 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:49.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:49 smithi007 bash[22722]: cluster 2024-09-14T01:49:48.653177+0000 mgr.a (mgr.14355) 9036 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:50.275 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:50.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:49 smithi131 bash[24745]: cluster 2024-09-14T01:49:48.653177+0000 mgr.a (mgr.14355) 9036 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:49 smithi171 bash[25040]: cluster 2024-09-14T01:49:48.653177+0000 mgr.a (mgr.14355) 9036 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:50 smithi007 bash[22722]: audit 2024-09-14T01:49:49.826358+0000 mgr.a (mgr.14355) 9037 : audit [DBG] from='client.201318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:50 smithi131 bash[24745]: audit 2024-09-14T01:49:49.826358+0000 mgr.a (mgr.14355) 9037 : audit [DBG] from='client.201318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:50 smithi171 bash[25040]: audit 2024-09-14T01:49:49.826358+0000 mgr.a (mgr.14355) 9037 : audit [DBG] from='client.201318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:51 smithi007 bash[22722]: cluster 2024-09-14T01:49:50.655730+0000 mgr.a (mgr.14355) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:51 smithi131 bash[24745]: cluster 2024-09-14T01:49:50.655730+0000 mgr.a (mgr.14355) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:51 smithi171 bash[25040]: cluster 2024-09-14T01:49:50.655730+0000 mgr.a (mgr.14355) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:49:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:53 smithi007 bash[22722]: cluster 2024-09-14T01:49:52.656707+0000 mgr.a (mgr.14355) 9039 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:53 smithi131 bash[24745]: cluster 2024-09-14T01:49:52.656707+0000 mgr.a (mgr.14355) 9039 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:53 smithi171 bash[25040]: cluster 2024-09-14T01:49:52.656707+0000 mgr.a (mgr.14355) 9039 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:49:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:49:55.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:49:56.058 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:49:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:49:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:49:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:49:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:49:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:55 smithi007 bash[22722]: cluster 2024-09-14T01:49:54.657665+0000 mgr.a (mgr.14355) 9040 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:55 smithi131 bash[24745]: cluster 2024-09-14T01:49:54.657665+0000 mgr.a (mgr.14355) 9040 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:55 smithi171 bash[25040]: cluster 2024-09-14T01:49:54.657665+0000 mgr.a (mgr.14355) 9040 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:56 smithi007 bash[22722]: audit 2024-09-14T01:49:55.610806+0000 mgr.a (mgr.14355) 9041 : audit [DBG] from='client.201390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:56 smithi131 bash[24745]: audit 2024-09-14T01:49:55.610806+0000 mgr.a (mgr.14355) 9041 : audit [DBG] from='client.201390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:56 smithi171 bash[25040]: audit 2024-09-14T01:49:55.610806+0000 mgr.a (mgr.14355) 9041 : audit [DBG] from='client.201390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:49:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:57 smithi007 bash[22722]: cluster 2024-09-14T01:49:56.660727+0000 mgr.a (mgr.14355) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:57 smithi131 bash[24745]: cluster 2024-09-14T01:49:56.660727+0000 mgr.a (mgr.14355) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:49:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:57 smithi171 bash[25040]: cluster 2024-09-14T01:49:56.660727+0000 mgr.a (mgr.14355) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:49:59 smithi007 bash[22722]: cluster 2024-09-14T01:49:58.661703+0000 mgr.a (mgr.14355) 9043 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:49:59 smithi131 bash[24745]: cluster 2024-09-14T01:49:58.661703+0000 mgr.a (mgr.14355) 9043 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:49:59 smithi171 bash[25040]: cluster 2024-09-14T01:49:58.661703+0000 mgr.a (mgr.14355) 9043 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:01.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:00 smithi007 bash[22722]: cluster 2024-09-14T01:50:00.000152+0000 mon.a (mon.0) 1945 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:50:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:00 smithi131 bash[24745]: cluster 2024-09-14T01:50:00.000152+0000 mon.a (mon.0) 1945 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:50:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:00 smithi171 bash[25040]: cluster 2024-09-14T01:50:00.000152+0000 mon.a (mon.0) 1945 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T01:50:01.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:01.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:01 smithi007 bash[22722]: cluster 2024-09-14T01:50:00.663839+0000 mgr.a (mgr.14355) 9044 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:01 smithi131 bash[24745]: cluster 2024-09-14T01:50:00.663839+0000 mgr.a (mgr.14355) 9044 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:01 smithi171 bash[25040]: cluster 2024-09-14T01:50:00.663839+0000 mgr.a (mgr.14355) 9044 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:02 smithi007 bash[22722]: audit 2024-09-14T01:50:01.400422+0000 mgr.a (mgr.14355) 9045 : audit [DBG] from='client.201468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:02 smithi131 bash[24745]: audit 2024-09-14T01:50:01.400422+0000 mgr.a (mgr.14355) 9045 : audit [DBG] from='client.201468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:02 smithi171 bash[25040]: audit 2024-09-14T01:50:01.400422+0000 mgr.a (mgr.14355) 9045 : audit [DBG] from='client.201468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:03 smithi007 bash[22722]: cluster 2024-09-14T01:50:02.664978+0000 mgr.a (mgr.14355) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:03 smithi131 bash[24745]: cluster 2024-09-14T01:50:02.664978+0000 mgr.a (mgr.14355) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:03 smithi171 bash[25040]: cluster 2024-09-14T01:50:02.664978+0000 mgr.a (mgr.14355) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:05 smithi007 bash[22722]: cluster 2024-09-14T01:50:04.665808+0000 mgr.a (mgr.14355) 9047 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:05 smithi131 bash[24745]: cluster 2024-09-14T01:50:04.665808+0000 mgr.a (mgr.14355) 9047 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:05 smithi171 bash[25040]: cluster 2024-09-14T01:50:04.665808+0000 mgr.a (mgr.14355) 9047 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:50:06.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:06.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:06.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:07.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:07 smithi007 bash[22722]: cluster 2024-09-14T01:50:06.668069+0000 mgr.a (mgr.14355) 9048 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:07 smithi131 bash[24745]: cluster 2024-09-14T01:50:06.668069+0000 mgr.a (mgr.14355) 9048 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:07 smithi171 bash[25040]: cluster 2024-09-14T01:50:06.668069+0000 mgr.a (mgr.14355) 9048 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:08 smithi007 bash[22722]: audit 2024-09-14T01:50:07.177124+0000 mgr.a (mgr.14355) 9049 : audit [DBG] from='client.201546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:08 smithi131 bash[24745]: audit 2024-09-14T01:50:07.177124+0000 mgr.a (mgr.14355) 9049 : audit [DBG] from='client.201546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:08 smithi171 bash[25040]: audit 2024-09-14T01:50:07.177124+0000 mgr.a (mgr.14355) 9049 : audit [DBG] from='client.201546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:09 smithi007 bash[22722]: cluster 2024-09-14T01:50:08.669040+0000 mgr.a (mgr.14355) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:09 smithi131 bash[24745]: cluster 2024-09-14T01:50:08.669040+0000 mgr.a (mgr.14355) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:09 smithi171 bash[25040]: cluster 2024-09-14T01:50:08.669040+0000 mgr.a (mgr.14355) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:10 smithi131 bash[24745]: cluster 2024-09-14T01:50:10.671242+0000 mgr.a (mgr.14355) 9051 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:10 smithi171 bash[25040]: cluster 2024-09-14T01:50:10.671242+0000 mgr.a (mgr.14355) 9051 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:10 smithi007 bash[22722]: cluster 2024-09-14T01:50:10.671242+0000 mgr.a (mgr.14355) 9051 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:12.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:12.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:13.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:13.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:13 smithi131 bash[24745]: cluster 2024-09-14T01:50:12.671986+0000 mgr.a (mgr.14355) 9052 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:13 smithi171 bash[25040]: cluster 2024-09-14T01:50:12.671986+0000 mgr.a (mgr.14355) 9052 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:13 smithi007 bash[22722]: cluster 2024-09-14T01:50:12.671986+0000 mgr.a (mgr.14355) 9052 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:14 smithi131 bash[24745]: audit 2024-09-14T01:50:12.962748+0000 mgr.a (mgr.14355) 9053 : audit [DBG] from='client.201624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:14 smithi171 bash[25040]: audit 2024-09-14T01:50:12.962748+0000 mgr.a (mgr.14355) 9053 : audit [DBG] from='client.201624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:14 smithi007 bash[22722]: audit 2024-09-14T01:50:12.962748+0000 mgr.a (mgr.14355) 9053 : audit [DBG] from='client.201624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:15 smithi131 bash[24745]: cluster 2024-09-14T01:50:14.672949+0000 mgr.a (mgr.14355) 9054 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:15 smithi171 bash[25040]: cluster 2024-09-14T01:50:14.672949+0000 mgr.a (mgr.14355) 9054 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:15 smithi007 bash[22722]: cluster 2024-09-14T01:50:14.672949+0000 mgr.a (mgr.14355) 9054 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:17 smithi131 bash[24745]: cluster 2024-09-14T01:50:16.675222+0000 mgr.a (mgr.14355) 9055 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:17 smithi171 bash[25040]: cluster 2024-09-14T01:50:16.675222+0000 mgr.a (mgr.14355) 9055 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:17 smithi007 bash[22722]: cluster 2024-09-14T01:50:16.675222+0000 mgr.a (mgr.14355) 9055 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:18.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:18.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:18.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:19.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:19.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:19.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:19.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:19.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:19 smithi131 bash[24745]: cluster 2024-09-14T01:50:18.675936+0000 mgr.a (mgr.14355) 9056 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:19 smithi131 bash[24745]: audit 2024-09-14T01:50:18.728584+0000 mgr.a (mgr.14355) 9057 : audit [DBG] from='client.201699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:19 smithi171 bash[25040]: cluster 2024-09-14T01:50:18.675936+0000 mgr.a (mgr.14355) 9056 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:19 smithi171 bash[25040]: audit 2024-09-14T01:50:18.728584+0000 mgr.a (mgr.14355) 9057 : audit [DBG] from='client.201699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:19 smithi007 bash[22722]: cluster 2024-09-14T01:50:18.675936+0000 mgr.a (mgr.14355) 9056 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:19 smithi007 bash[22722]: audit 2024-09-14T01:50:18.728584+0000 mgr.a (mgr.14355) 9057 : audit [DBG] from='client.201699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:21 smithi131 bash[24745]: cluster 2024-09-14T01:50:20.678203+0000 mgr.a (mgr.14355) 9058 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:21 smithi171 bash[25040]: cluster 2024-09-14T01:50:20.678203+0000 mgr.a (mgr.14355) 9058 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:21 smithi007 bash[22722]: cluster 2024-09-14T01:50:20.678203+0000 mgr.a (mgr.14355) 9058 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:23 smithi131 bash[24745]: cluster 2024-09-14T01:50:22.679027+0000 mgr.a (mgr.14355) 9059 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:23 smithi171 bash[25040]: cluster 2024-09-14T01:50:22.679027+0000 mgr.a (mgr.14355) 9059 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:24.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:24.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:23 smithi007 bash[22722]: cluster 2024-09-14T01:50:22.679027+0000 mgr.a (mgr.14355) 9059 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:24.929 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:24.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:24.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:25 smithi131 bash[24745]: audit 2024-09-14T01:50:24.511890+0000 mgr.a (mgr.14355) 9060 : audit [DBG] from='client.201777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:25 smithi131 bash[24745]: cluster 2024-09-14T01:50:24.679585+0000 mgr.a (mgr.14355) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:25 smithi171 bash[25040]: audit 2024-09-14T01:50:24.511890+0000 mgr.a (mgr.14355) 9060 : audit [DBG] from='client.201777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:25 smithi171 bash[25040]: cluster 2024-09-14T01:50:24.679585+0000 mgr.a (mgr.14355) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:25 smithi007 bash[22722]: audit 2024-09-14T01:50:24.511890+0000 mgr.a (mgr.14355) 9060 : audit [DBG] from='client.201777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:25 smithi007 bash[22722]: cluster 2024-09-14T01:50:24.679585+0000 mgr.a (mgr.14355) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:27 smithi131 bash[24745]: cluster 2024-09-14T01:50:26.681916+0000 mgr.a (mgr.14355) 9062 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:27 smithi171 bash[25040]: cluster 2024-09-14T01:50:26.681916+0000 mgr.a (mgr.14355) 9062 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:27 smithi007 bash[22722]: cluster 2024-09-14T01:50:26.681916+0000 mgr.a (mgr.14355) 9062 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:28 smithi131 bash[24745]: audit 2024-09-14T01:50:28.470844+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:50:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:28 smithi171 bash[25040]: audit 2024-09-14T01:50:28.470844+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:50:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:28 smithi007 bash[22722]: audit 2024-09-14T01:50:28.470844+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:50:29.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:29.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:29.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:29 smithi131 bash[24745]: cluster 2024-09-14T01:50:28.682702+0000 mgr.a (mgr.14355) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:29 smithi131 bash[24745]: audit 2024-09-14T01:50:29.313512+0000 mon.a (mon.0) 1947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:29 smithi131 bash[24745]: audit 2024-09-14T01:50:29.316316+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:29 smithi131 bash[24745]: audit 2024-09-14T01:50:29.326756+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:29 smithi131 bash[24745]: audit 2024-09-14T01:50:29.331509+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:29 smithi171 bash[25040]: cluster 2024-09-14T01:50:28.682702+0000 mgr.a (mgr.14355) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:29 smithi171 bash[25040]: audit 2024-09-14T01:50:29.313512+0000 mon.a (mon.0) 1947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:29 smithi171 bash[25040]: audit 2024-09-14T01:50:29.316316+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:29 smithi171 bash[25040]: audit 2024-09-14T01:50:29.326756+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:29 smithi171 bash[25040]: audit 2024-09-14T01:50:29.331509+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:30.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:29 smithi007 bash[22722]: cluster 2024-09-14T01:50:28.682702+0000 mgr.a (mgr.14355) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:30.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:29 smithi007 bash[22722]: audit 2024-09-14T01:50:29.313512+0000 mon.a (mon.0) 1947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:50:30.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:29 smithi007 bash[22722]: audit 2024-09-14T01:50:29.316316+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:50:30.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:29 smithi007 bash[22722]: audit 2024-09-14T01:50:29.326756+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:50:30.074 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:29 smithi007 bash[22722]: audit 2024-09-14T01:50:29.331509+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:30.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:50:30 smithi007 bash[22972]: debug 2024-09-14T01:50:30.066+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:50:30.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:50:30 smithi007 bash[22972]: debug 2024-09-14T01:50:30.070+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:50:30.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:30.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:30.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:30.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:30.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:30 smithi171 bash[25040]: audit 2024-09-14T01:50:29.333784+0000 mgr.a (mgr.14355) 9064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:30 smithi007 bash[22722]: audit 2024-09-14T01:50:29.333784+0000 mgr.a (mgr.14355) 9064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:30 smithi131 bash[24745]: audit 2024-09-14T01:50:29.333784+0000 mgr.a (mgr.14355) 9064 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:50:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:31 smithi171 bash[25040]: audit 2024-09-14T01:50:30.073544+0000 mgr.a (mgr.14355) 9065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:50:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:31 smithi171 bash[25040]: cephadm 2024-09-14T01:50:30.075014+0000 mgr.a (mgr.14355) 9066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:50:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:31 smithi171 bash[25040]: audit 2024-09-14T01:50:30.247066+0000 mgr.a (mgr.14355) 9067 : audit [DBG] from='client.201960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:31 smithi171 bash[25040]: cluster 2024-09-14T01:50:30.684238+0000 mgr.a (mgr.14355) 9068 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:31 smithi007 bash[22722]: audit 2024-09-14T01:50:30.073544+0000 mgr.a (mgr.14355) 9065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:50:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:31 smithi007 bash[22722]: cephadm 2024-09-14T01:50:30.075014+0000 mgr.a (mgr.14355) 9066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:50:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:31 smithi007 bash[22722]: audit 2024-09-14T01:50:30.247066+0000 mgr.a (mgr.14355) 9067 : audit [DBG] from='client.201960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:31 smithi007 bash[22722]: cluster 2024-09-14T01:50:30.684238+0000 mgr.a (mgr.14355) 9068 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:31 smithi131 bash[24745]: audit 2024-09-14T01:50:30.073544+0000 mgr.a (mgr.14355) 9065 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:50:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:31 smithi131 bash[24745]: cephadm 2024-09-14T01:50:30.075014+0000 mgr.a (mgr.14355) 9066 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:50:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:31 smithi131 bash[24745]: audit 2024-09-14T01:50:30.247066+0000 mgr.a (mgr.14355) 9067 : audit [DBG] from='client.201960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:31 smithi131 bash[24745]: cluster 2024-09-14T01:50:30.684238+0000 mgr.a (mgr.14355) 9068 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:33 smithi171 bash[25040]: cluster 2024-09-14T01:50:32.684976+0000 mgr.a (mgr.14355) 9069 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:33 smithi007 bash[22722]: cluster 2024-09-14T01:50:32.684976+0000 mgr.a (mgr.14355) 9069 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:33 smithi131 bash[24745]: cluster 2024-09-14T01:50:32.684976+0000 mgr.a (mgr.14355) 9069 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:35.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:35 smithi171 bash[25040]: cluster 2024-09-14T01:50:34.685745+0000 mgr.a (mgr.14355) 9070 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:35 smithi007 bash[22722]: cluster 2024-09-14T01:50:34.685745+0000 mgr.a (mgr.14355) 9070 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:35 smithi131 bash[24745]: cluster 2024-09-14T01:50:34.685745+0000 mgr.a (mgr.14355) 9070 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:36.449 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:36.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:36.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:37 smithi007 bash[22722]: audit 2024-09-14T01:50:36.001070+0000 mgr.a (mgr.14355) 9071 : audit [DBG] from='client.202038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:37 smithi007 bash[22722]: cluster 2024-09-14T01:50:36.688589+0000 mgr.a (mgr.14355) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:37 smithi131 bash[24745]: audit 2024-09-14T01:50:36.001070+0000 mgr.a (mgr.14355) 9071 : audit [DBG] from='client.202038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:37 smithi131 bash[24745]: cluster 2024-09-14T01:50:36.688589+0000 mgr.a (mgr.14355) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:37 smithi171 bash[25040]: audit 2024-09-14T01:50:36.001070+0000 mgr.a (mgr.14355) 9071 : audit [DBG] from='client.202038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:37 smithi171 bash[25040]: cluster 2024-09-14T01:50:36.688589+0000 mgr.a (mgr.14355) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:39 smithi007 bash[22722]: cluster 2024-09-14T01:50:38.689387+0000 mgr.a (mgr.14355) 9073 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:39 smithi131 bash[24745]: cluster 2024-09-14T01:50:38.689387+0000 mgr.a (mgr.14355) 9073 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:39 smithi171 bash[25040]: cluster 2024-09-14T01:50:38.689387+0000 mgr.a (mgr.14355) 9073 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:50:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:41 smithi007 bash[22722]: cluster 2024-09-14T01:50:40.691330+0000 mgr.a (mgr.14355) 9074 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:42.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:42.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:41 smithi131 bash[24745]: cluster 2024-09-14T01:50:40.691330+0000 mgr.a (mgr.14355) 9074 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:41 smithi171 bash[25040]: cluster 2024-09-14T01:50:40.691330+0000 mgr.a (mgr.14355) 9074 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:50:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:42 smithi007 bash[22722]: audit 2024-09-14T01:50:41.787227+0000 mgr.a (mgr.14355) 9075 : audit [DBG] from='client.202116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:42 smithi131 bash[24745]: audit 2024-09-14T01:50:41.787227+0000 mgr.a (mgr.14355) 9075 : audit [DBG] from='client.202116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:42 smithi171 bash[25040]: audit 2024-09-14T01:50:41.787227+0000 mgr.a (mgr.14355) 9075 : audit [DBG] from='client.202116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:43 smithi007 bash[22722]: cluster 2024-09-14T01:50:42.692298+0000 mgr.a (mgr.14355) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:43 smithi131 bash[24745]: cluster 2024-09-14T01:50:42.692298+0000 mgr.a (mgr.14355) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:43 smithi171 bash[25040]: cluster 2024-09-14T01:50:42.692298+0000 mgr.a (mgr.14355) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:45 smithi007 bash[22722]: cluster 2024-09-14T01:50:44.693080+0000 mgr.a (mgr.14355) 9077 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:45 smithi131 bash[24745]: cluster 2024-09-14T01:50:44.693080+0000 mgr.a (mgr.14355) 9077 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:45 smithi171 bash[25040]: cluster 2024-09-14T01:50:44.693080+0000 mgr.a (mgr.14355) 9077 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T01:50:47.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:47.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:48.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:48.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:48.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:48.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:48.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:47 smithi007 bash[22722]: cluster 2024-09-14T01:50:46.695319+0000 mgr.a (mgr.14355) 9078 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:47 smithi131 bash[24745]: cluster 2024-09-14T01:50:46.695319+0000 mgr.a (mgr.14355) 9078 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:47 smithi171 bash[25040]: cluster 2024-09-14T01:50:46.695319+0000 mgr.a (mgr.14355) 9078 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:48 smithi007 bash[22722]: audit 2024-09-14T01:50:47.571264+0000 mgr.a (mgr.14355) 9079 : audit [DBG] from='client.202191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:48 smithi131 bash[24745]: audit 2024-09-14T01:50:47.571264+0000 mgr.a (mgr.14355) 9079 : audit [DBG] from='client.202191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:48 smithi171 bash[25040]: audit 2024-09-14T01:50:47.571264+0000 mgr.a (mgr.14355) 9079 : audit [DBG] from='client.202191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:49 smithi007 bash[22722]: cluster 2024-09-14T01:50:48.696289+0000 mgr.a (mgr.14355) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:49 smithi131 bash[24745]: cluster 2024-09-14T01:50:48.696289+0000 mgr.a (mgr.14355) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:49 smithi171 bash[25040]: cluster 2024-09-14T01:50:48.696289+0000 mgr.a (mgr.14355) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:51 smithi007 bash[22722]: cluster 2024-09-14T01:50:50.698481+0000 mgr.a (mgr.14355) 9081 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:51 smithi131 bash[24745]: cluster 2024-09-14T01:50:50.698481+0000 mgr.a (mgr.14355) 9081 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:51 smithi171 bash[25040]: cluster 2024-09-14T01:50:50.698481+0000 mgr.a (mgr.14355) 9081 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:53.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:53.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:53.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:53.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:50:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:53 smithi007 bash[22722]: cluster 2024-09-14T01:50:52.699197+0000 mgr.a (mgr.14355) 9082 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:53 smithi131 bash[24745]: cluster 2024-09-14T01:50:52.699197+0000 mgr.a (mgr.14355) 9082 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:53 smithi171 bash[25040]: cluster 2024-09-14T01:50:52.699197+0000 mgr.a (mgr.14355) 9082 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:54 smithi007 bash[22722]: audit 2024-09-14T01:50:53.342780+0000 mgr.a (mgr.14355) 9083 : audit [DBG] from='client.202269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:54 smithi131 bash[24745]: audit 2024-09-14T01:50:53.342780+0000 mgr.a (mgr.14355) 9083 : audit [DBG] from='client.202269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:54 smithi171 bash[25040]: audit 2024-09-14T01:50:53.342780+0000 mgr.a (mgr.14355) 9083 : audit [DBG] from='client.202269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:50:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:55 smithi007 bash[22722]: cluster 2024-09-14T01:50:54.700136+0000 mgr.a (mgr.14355) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:55 smithi131 bash[24745]: cluster 2024-09-14T01:50:54.700136+0000 mgr.a (mgr.14355) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:55 smithi171 bash[25040]: cluster 2024-09-14T01:50:54.700136+0000 mgr.a (mgr.14355) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:50:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:57 smithi007 bash[22722]: cluster 2024-09-14T01:50:56.702458+0000 mgr.a (mgr.14355) 9085 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:57 smithi131 bash[24745]: cluster 2024-09-14T01:50:56.702458+0000 mgr.a (mgr.14355) 9085 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:57 smithi171 bash[25040]: cluster 2024-09-14T01:50:56.702458+0000 mgr.a (mgr.14355) 9085 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:50:58.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:50:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:50:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:50:59.544 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:50:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:50:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:50:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:50:59.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:50:59 smithi007 bash[22722]: cluster 2024-09-14T01:50:58.703238+0000 mgr.a (mgr.14355) 9086 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:50:59 smithi131 bash[24745]: cluster 2024-09-14T01:50:58.703238+0000 mgr.a (mgr.14355) 9086 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:50:59 smithi171 bash[25040]: cluster 2024-09-14T01:50:58.703238+0000 mgr.a (mgr.14355) 9086 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:00 smithi007 bash[22722]: audit 2024-09-14T01:50:59.115209+0000 mgr.a (mgr.14355) 9087 : audit [DBG] from='client.202347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:00 smithi131 bash[24745]: audit 2024-09-14T01:50:59.115209+0000 mgr.a (mgr.14355) 9087 : audit [DBG] from='client.202347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:00 smithi171 bash[25040]: audit 2024-09-14T01:50:59.115209+0000 mgr.a (mgr.14355) 9087 : audit [DBG] from='client.202347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:01 smithi007 bash[22722]: cluster 2024-09-14T01:51:00.705498+0000 mgr.a (mgr.14355) 9088 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:01 smithi131 bash[24745]: cluster 2024-09-14T01:51:00.705498+0000 mgr.a (mgr.14355) 9088 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:01 smithi171 bash[25040]: cluster 2024-09-14T01:51:00.705498+0000 mgr.a (mgr.14355) 9088 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:03 smithi007 bash[22722]: cluster 2024-09-14T01:51:02.706375+0000 mgr.a (mgr.14355) 9089 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:03 smithi131 bash[24745]: cluster 2024-09-14T01:51:02.706375+0000 mgr.a (mgr.14355) 9089 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:03 smithi171 bash[25040]: cluster 2024-09-14T01:51:02.706375+0000 mgr.a (mgr.14355) 9089 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:04.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:05.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:05.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:05.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:05 smithi007 bash[22722]: cluster 2024-09-14T01:51:04.706869+0000 mgr.a (mgr.14355) 9090 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:05 smithi007 bash[22722]: audit 2024-09-14T01:51:04.875789+0000 mgr.a (mgr.14355) 9091 : audit [DBG] from='client.202422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:05 smithi131 bash[24745]: cluster 2024-09-14T01:51:04.706869+0000 mgr.a (mgr.14355) 9090 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:05 smithi131 bash[24745]: audit 2024-09-14T01:51:04.875789+0000 mgr.a (mgr.14355) 9091 : audit [DBG] from='client.202422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:05 smithi171 bash[25040]: cluster 2024-09-14T01:51:04.706869+0000 mgr.a (mgr.14355) 9090 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:05 smithi171 bash[25040]: audit 2024-09-14T01:51:04.875789+0000 mgr.a (mgr.14355) 9091 : audit [DBG] from='client.202422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:07 smithi007 bash[22722]: cluster 2024-09-14T01:51:06.709241+0000 mgr.a (mgr.14355) 9092 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:07 smithi131 bash[24745]: cluster 2024-09-14T01:51:06.709241+0000 mgr.a (mgr.14355) 9092 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:07 smithi171 bash[25040]: cluster 2024-09-14T01:51:06.709241+0000 mgr.a (mgr.14355) 9092 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:09 smithi007 bash[22722]: cluster 2024-09-14T01:51:08.710035+0000 mgr.a (mgr.14355) 9093 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:09 smithi131 bash[24745]: cluster 2024-09-14T01:51:08.710035+0000 mgr.a (mgr.14355) 9093 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:09 smithi171 bash[25040]: cluster 2024-09-14T01:51:08.710035+0000 mgr.a (mgr.14355) 9093 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:10.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:11.046 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:11.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:11.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:11.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:11.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:11 smithi007 bash[22722]: audit 2024-09-14T01:51:10.629271+0000 mgr.a (mgr.14355) 9094 : audit [DBG] from='client.202494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:11 smithi007 bash[22722]: cluster 2024-09-14T01:51:10.711358+0000 mgr.a (mgr.14355) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:11 smithi131 bash[24745]: audit 2024-09-14T01:51:10.629271+0000 mgr.a (mgr.14355) 9094 : audit [DBG] from='client.202494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:11 smithi131 bash[24745]: cluster 2024-09-14T01:51:10.711358+0000 mgr.a (mgr.14355) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:11 smithi171 bash[25040]: audit 2024-09-14T01:51:10.629271+0000 mgr.a (mgr.14355) 9094 : audit [DBG] from='client.202494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:11 smithi171 bash[25040]: cluster 2024-09-14T01:51:10.711358+0000 mgr.a (mgr.14355) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:13 smithi007 bash[22722]: cluster 2024-09-14T01:51:12.712378+0000 mgr.a (mgr.14355) 9096 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:13 smithi131 bash[24745]: cluster 2024-09-14T01:51:12.712378+0000 mgr.a (mgr.14355) 9096 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:13 smithi171 bash[25040]: cluster 2024-09-14T01:51:12.712378+0000 mgr.a (mgr.14355) 9096 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:15 smithi007 bash[22722]: cluster 2024-09-14T01:51:14.713349+0000 mgr.a (mgr.14355) 9097 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:15 smithi131 bash[24745]: cluster 2024-09-14T01:51:14.713349+0000 mgr.a (mgr.14355) 9097 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:15 smithi171 bash[25040]: cluster 2024-09-14T01:51:14.713349+0000 mgr.a (mgr.14355) 9097 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:16.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:16.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:16.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:16.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:16.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:17 smithi007 bash[22722]: audit 2024-09-14T01:51:16.379692+0000 mgr.a (mgr.14355) 9098 : audit [DBG] from='client.202572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:17 smithi007 bash[22722]: cluster 2024-09-14T01:51:16.715237+0000 mgr.a (mgr.14355) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:17 smithi131 bash[24745]: audit 2024-09-14T01:51:16.379692+0000 mgr.a (mgr.14355) 9098 : audit [DBG] from='client.202572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:17 smithi131 bash[24745]: cluster 2024-09-14T01:51:16.715237+0000 mgr.a (mgr.14355) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:17 smithi171 bash[25040]: audit 2024-09-14T01:51:16.379692+0000 mgr.a (mgr.14355) 9098 : audit [DBG] from='client.202572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:17 smithi171 bash[25040]: cluster 2024-09-14T01:51:16.715237+0000 mgr.a (mgr.14355) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:19 smithi007 bash[22722]: cluster 2024-09-14T01:51:18.716002+0000 mgr.a (mgr.14355) 9100 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:19 smithi131 bash[24745]: cluster 2024-09-14T01:51:18.716002+0000 mgr.a (mgr.14355) 9100 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:19 smithi171 bash[25040]: cluster 2024-09-14T01:51:18.716002+0000 mgr.a (mgr.14355) 9100 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:21.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:21.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:21.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:21 smithi007 bash[22722]: cluster 2024-09-14T01:51:20.717950+0000 mgr.a (mgr.14355) 9101 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:21 smithi131 bash[24745]: cluster 2024-09-14T01:51:20.717950+0000 mgr.a (mgr.14355) 9101 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:21 smithi171 bash[25040]: cluster 2024-09-14T01:51:20.717950+0000 mgr.a (mgr.14355) 9101 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:22.583 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:23 smithi007 bash[22722]: audit 2024-09-14T01:51:22.128279+0000 mgr.a (mgr.14355) 9102 : audit [DBG] from='client.202647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:23 smithi007 bash[22722]: cluster 2024-09-14T01:51:22.718902+0000 mgr.a (mgr.14355) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:23 smithi131 bash[24745]: audit 2024-09-14T01:51:22.128279+0000 mgr.a (mgr.14355) 9102 : audit [DBG] from='client.202647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:23 smithi131 bash[24745]: cluster 2024-09-14T01:51:22.718902+0000 mgr.a (mgr.14355) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:23 smithi171 bash[25040]: audit 2024-09-14T01:51:22.128279+0000 mgr.a (mgr.14355) 9102 : audit [DBG] from='client.202647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:23 smithi171 bash[25040]: cluster 2024-09-14T01:51:22.718902+0000 mgr.a (mgr.14355) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:25 smithi007 bash[22722]: cluster 2024-09-14T01:51:24.719731+0000 mgr.a (mgr.14355) 9104 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:25 smithi131 bash[24745]: cluster 2024-09-14T01:51:24.719731+0000 mgr.a (mgr.14355) 9104 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:25 smithi171 bash[25040]: cluster 2024-09-14T01:51:24.719731+0000 mgr.a (mgr.14355) 9104 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:27.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:27.586 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:27.586 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:27 smithi007 bash[22722]: cluster 2024-09-14T01:51:26.722008+0000 mgr.a (mgr.14355) 9105 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:27 smithi131 bash[24745]: cluster 2024-09-14T01:51:26.722008+0000 mgr.a (mgr.14355) 9105 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:27 smithi171 bash[25040]: cluster 2024-09-14T01:51:26.722008+0000 mgr.a (mgr.14355) 9105 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:28.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:28.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:28 smithi007 bash[22722]: audit 2024-09-14T01:51:27.918826+0000 mgr.a (mgr.14355) 9106 : audit [DBG] from='client.202722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:28 smithi131 bash[24745]: audit 2024-09-14T01:51:27.918826+0000 mgr.a (mgr.14355) 9106 : audit [DBG] from='client.202722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:28 smithi171 bash[25040]: audit 2024-09-14T01:51:27.918826+0000 mgr.a (mgr.14355) 9106 : audit [DBG] from='client.202722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:29 smithi007 bash[22722]: cluster 2024-09-14T01:51:28.722983+0000 mgr.a (mgr.14355) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:29 smithi131 bash[24745]: cluster 2024-09-14T01:51:28.722983+0000 mgr.a (mgr.14355) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:29 smithi171 bash[25040]: cluster 2024-09-14T01:51:28.722983+0000 mgr.a (mgr.14355) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:30 smithi131 bash[24745]: audit 2024-09-14T01:51:30.129868+0000 mon.a (mon.0) 1951 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:51:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:30 smithi171 bash[25040]: audit 2024-09-14T01:51:30.129868+0000 mon.a (mon.0) 1951 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:51:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:30 smithi007 bash[22722]: audit 2024-09-14T01:51:30.129868+0000 mon.a (mon.0) 1951 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:51:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:31 smithi131 bash[24745]: cluster 2024-09-14T01:51:30.724091+0000 mgr.a (mgr.14355) 9108 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:31 smithi171 bash[25040]: cluster 2024-09-14T01:51:30.724091+0000 mgr.a (mgr.14355) 9108 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:31 smithi007 bash[22722]: cluster 2024-09-14T01:51:30.724091+0000 mgr.a (mgr.14355) 9108 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:32 smithi131 bash[24745]: cluster 2024-09-14T01:51:32.724839+0000 mgr.a (mgr.14355) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:32 smithi171 bash[25040]: cluster 2024-09-14T01:51:32.724839+0000 mgr.a (mgr.14355) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:33.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:33.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:32 smithi007 bash[22722]: cluster 2024-09-14T01:51:32.724839+0000 mgr.a (mgr.14355) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:34.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:33 smithi131 bash[24745]: audit 2024-09-14T01:51:33.700601+0000 mgr.a (mgr.14355) 9110 : audit [DBG] from='client.202794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:33 smithi171 bash[25040]: audit 2024-09-14T01:51:33.700601+0000 mgr.a (mgr.14355) 9110 : audit [DBG] from='client.202794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:33 smithi007 bash[22722]: audit 2024-09-14T01:51:33.700601+0000 mgr.a (mgr.14355) 9110 : audit [DBG] from='client.202794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:35.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:34 smithi131 bash[24745]: cluster 2024-09-14T01:51:34.725823+0000 mgr.a (mgr.14355) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:34 smithi171 bash[25040]: cluster 2024-09-14T01:51:34.725823+0000 mgr.a (mgr.14355) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:34 smithi007 bash[22722]: cluster 2024-09-14T01:51:34.725823+0000 mgr.a (mgr.14355) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.503738+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.507764+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.510820+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.514171+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.559845+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:36 smithi131 bash[24745]: audit 2024-09-14T01:51:35.565095+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.503738+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.507764+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.510820+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.514171+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.559845+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:36 smithi171 bash[25040]: audit 2024-09-14T01:51:35.565095+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.503738+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.507764+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.510820+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.514171+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.559845+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:36 smithi007 bash[22722]: audit 2024-09-14T01:51:35.565095+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:37 smithi131 bash[24745]: cluster 2024-09-14T01:51:36.727069+0000 mgr.a (mgr.14355) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:37 smithi171 bash[25040]: cluster 2024-09-14T01:51:36.727069+0000 mgr.a (mgr.14355) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:37 smithi007 bash[22722]: cluster 2024-09-14T01:51:36.727069+0000 mgr.a (mgr.14355) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:39.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:39.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:39.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:39 smithi171 bash[25040]: cluster 2024-09-14T01:51:38.727753+0000 mgr.a (mgr.14355) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:39 smithi007 bash[22722]: cluster 2024-09-14T01:51:38.727753+0000 mgr.a (mgr.14355) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:39 smithi131 bash[24745]: cluster 2024-09-14T01:51:38.727753+0000 mgr.a (mgr.14355) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:40 smithi171 bash[25040]: audit 2024-09-14T01:51:39.488693+0000 mgr.a (mgr.14355) 9114 : audit [DBG] from='client.202872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:40 smithi007 bash[22722]: audit 2024-09-14T01:51:39.488693+0000 mgr.a (mgr.14355) 9114 : audit [DBG] from='client.202872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:40 smithi131 bash[24745]: audit 2024-09-14T01:51:39.488693+0000 mgr.a (mgr.14355) 9114 : audit [DBG] from='client.202872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:41 smithi171 bash[25040]: cluster 2024-09-14T01:51:40.730126+0000 mgr.a (mgr.14355) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:41 smithi007 bash[22722]: cluster 2024-09-14T01:51:40.730126+0000 mgr.a (mgr.14355) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:41 smithi131 bash[24745]: cluster 2024-09-14T01:51:40.730126+0000 mgr.a (mgr.14355) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:51:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:43 smithi007 bash[22722]: cluster 2024-09-14T01:51:42.730858+0000 mgr.a (mgr.14355) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:43 smithi131 bash[24745]: cluster 2024-09-14T01:51:42.730858+0000 mgr.a (mgr.14355) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:43 smithi171 bash[25040]: cluster 2024-09-14T01:51:42.730858+0000 mgr.a (mgr.14355) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:45.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:45.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:45.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:45 smithi007 bash[22722]: cluster 2024-09-14T01:51:44.731729+0000 mgr.a (mgr.14355) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:45 smithi131 bash[24745]: cluster 2024-09-14T01:51:44.731729+0000 mgr.a (mgr.14355) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:45 smithi171 bash[25040]: cluster 2024-09-14T01:51:44.731729+0000 mgr.a (mgr.14355) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:47.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22972]: debug 2024-09-14T01:51:46.929+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:51:47.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22972]: debug 2024-09-14T01:51:46.933+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:51:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:45.229365+0000 mgr.a (mgr.14355) 9118 : audit [DBG] from='client.202947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.128573+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.136456+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.140372+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:51:47.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.142405+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:51:47.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.153020+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:46 smithi007 bash[22722]: audit 2024-09-14T01:51:46.157504+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:45.229365+0000 mgr.a (mgr.14355) 9118 : audit [DBG] from='client.202947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.128573+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.136456+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.140372+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.142405+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.153020+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:46 smithi131 bash[24745]: audit 2024-09-14T01:51:46.157504+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:45.229365+0000 mgr.a (mgr.14355) 9118 : audit [DBG] from='client.202947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.128573+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.136456+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.140372+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:51:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.142405+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:51:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.153020+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:51:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:46 smithi171 bash[25040]: audit 2024-09-14T01:51:46.157504+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:47 smithi007 bash[22722]: audit 2024-09-14T01:51:46.160025+0000 mgr.a (mgr.14355) 9119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:47 smithi007 bash[22722]: cluster 2024-09-14T01:51:46.733192+0000 mgr.a (mgr.14355) 9120 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:47 smithi007 bash[22722]: audit 2024-09-14T01:51:46.934276+0000 mgr.a (mgr.14355) 9121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:51:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:47 smithi007 bash[22722]: cephadm 2024-09-14T01:51:46.935566+0000 mgr.a (mgr.14355) 9122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:51:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:47 smithi131 bash[24745]: audit 2024-09-14T01:51:46.160025+0000 mgr.a (mgr.14355) 9119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:47 smithi131 bash[24745]: cluster 2024-09-14T01:51:46.733192+0000 mgr.a (mgr.14355) 9120 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:47 smithi131 bash[24745]: audit 2024-09-14T01:51:46.934276+0000 mgr.a (mgr.14355) 9121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:51:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:47 smithi131 bash[24745]: cephadm 2024-09-14T01:51:46.935566+0000 mgr.a (mgr.14355) 9122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:51:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:47 smithi171 bash[25040]: audit 2024-09-14T01:51:46.160025+0000 mgr.a (mgr.14355) 9119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:51:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:47 smithi171 bash[25040]: cluster 2024-09-14T01:51:46.733192+0000 mgr.a (mgr.14355) 9120 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:51:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:47 smithi171 bash[25040]: audit 2024-09-14T01:51:46.934276+0000 mgr.a (mgr.14355) 9121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:51:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:47 smithi171 bash[25040]: cephadm 2024-09-14T01:51:46.935566+0000 mgr.a (mgr.14355) 9122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:51:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:49 smithi007 bash[22722]: cluster 2024-09-14T01:51:48.733961+0000 mgr.a (mgr.14355) 9123 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:49 smithi131 bash[24745]: cluster 2024-09-14T01:51:48.733961+0000 mgr.a (mgr.14355) 9123 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:49 smithi171 bash[25040]: cluster 2024-09-14T01:51:48.733961+0000 mgr.a (mgr.14355) 9123 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:51:50.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:50.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:51.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:51.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:51.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:51.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:51.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:51 smithi007 bash[22722]: cluster 2024-09-14T01:51:50.735620+0000 mgr.a (mgr.14355) 9124 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:51 smithi131 bash[24745]: cluster 2024-09-14T01:51:50.735620+0000 mgr.a (mgr.14355) 9124 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:51 smithi171 bash[25040]: cluster 2024-09-14T01:51:50.735620+0000 mgr.a (mgr.14355) 9124 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:52 smithi007 bash[22722]: audit 2024-09-14T01:51:51.016094+0000 mgr.a (mgr.14355) 9125 : audit [DBG] from='client.203127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:52 smithi131 bash[24745]: audit 2024-09-14T01:51:51.016094+0000 mgr.a (mgr.14355) 9125 : audit [DBG] from='client.203127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:52 smithi171 bash[25040]: audit 2024-09-14T01:51:51.016094+0000 mgr.a (mgr.14355) 9125 : audit [DBG] from='client.203127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:53 smithi007 bash[22722]: cluster 2024-09-14T01:51:52.736495+0000 mgr.a (mgr.14355) 9126 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:53 smithi131 bash[24745]: cluster 2024-09-14T01:51:52.736495+0000 mgr.a (mgr.14355) 9126 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:53 smithi171 bash[25040]: cluster 2024-09-14T01:51:52.736495+0000 mgr.a (mgr.14355) 9126 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:55 smithi007 bash[22722]: cluster 2024-09-14T01:51:54.737290+0000 mgr.a (mgr.14355) 9127 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:55 smithi131 bash[24745]: cluster 2024-09-14T01:51:54.737290+0000 mgr.a (mgr.14355) 9127 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:55 smithi171 bash[25040]: cluster 2024-09-14T01:51:54.737290+0000 mgr.a (mgr.14355) 9127 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:51:56.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:51:56.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:51:56.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:51:57.200 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:51:57.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:51:57.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:51:57.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:51:57.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:51:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:57 smithi007 bash[22722]: cluster 2024-09-14T01:51:56.738576+0000 mgr.a (mgr.14355) 9128 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:57 smithi007 bash[22722]: audit 2024-09-14T01:51:56.771067+0000 mgr.a (mgr.14355) 9129 : audit [DBG] from='client.203202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:57 smithi131 bash[24745]: cluster 2024-09-14T01:51:56.738576+0000 mgr.a (mgr.14355) 9128 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:57 smithi131 bash[24745]: audit 2024-09-14T01:51:56.771067+0000 mgr.a (mgr.14355) 9129 : audit [DBG] from='client.203202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:51:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:57 smithi171 bash[25040]: cluster 2024-09-14T01:51:56.738576+0000 mgr.a (mgr.14355) 9128 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:51:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:57 smithi171 bash[25040]: audit 2024-09-14T01:51:56.771067+0000 mgr.a (mgr.14355) 9129 : audit [DBG] from='client.203202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:51:59 smithi007 bash[22722]: cluster 2024-09-14T01:51:58.739458+0000 mgr.a (mgr.14355) 9130 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:52:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:51:59 smithi131 bash[24745]: cluster 2024-09-14T01:51:58.739458+0000 mgr.a (mgr.14355) 9130 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:52:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:51:59 smithi171 bash[25040]: cluster 2024-09-14T01:51:58.739458+0000 mgr.a (mgr.14355) 9130 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:52:02.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:02.203 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:02.203 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:01 smithi007 bash[22722]: cluster 2024-09-14T01:52:00.741676+0000 mgr.a (mgr.14355) 9131 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:52:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:01 smithi131 bash[24745]: cluster 2024-09-14T01:52:00.741676+0000 mgr.a (mgr.14355) 9131 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:52:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:01 smithi171 bash[25040]: cluster 2024-09-14T01:52:00.741676+0000 mgr.a (mgr.14355) 9131 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T01:52:02.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:02.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:03 smithi007 bash[22722]: audit 2024-09-14T01:52:02.528383+0000 mgr.a (mgr.14355) 9132 : audit [DBG] from='client.203277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:03 smithi007 bash[22722]: cluster 2024-09-14T01:52:02.742174+0000 mgr.a (mgr.14355) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:03 smithi131 bash[24745]: audit 2024-09-14T01:52:02.528383+0000 mgr.a (mgr.14355) 9132 : audit [DBG] from='client.203277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:03 smithi131 bash[24745]: cluster 2024-09-14T01:52:02.742174+0000 mgr.a (mgr.14355) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:03 smithi171 bash[25040]: audit 2024-09-14T01:52:02.528383+0000 mgr.a (mgr.14355) 9132 : audit [DBG] from='client.203277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:03 smithi171 bash[25040]: cluster 2024-09-14T01:52:02.742174+0000 mgr.a (mgr.14355) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:05 smithi007 bash[22722]: cluster 2024-09-14T01:52:04.743041+0000 mgr.a (mgr.14355) 9134 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:05 smithi131 bash[24745]: cluster 2024-09-14T01:52:04.743041+0000 mgr.a (mgr.14355) 9134 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:05 smithi171 bash[25040]: cluster 2024-09-14T01:52:04.743041+0000 mgr.a (mgr.14355) 9134 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:07 smithi007 bash[22722]: cluster 2024-09-14T01:52:06.745302+0000 mgr.a (mgr.14355) 9135 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:52:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:07 smithi131 bash[24745]: cluster 2024-09-14T01:52:06.745302+0000 mgr.a (mgr.14355) 9135 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:52:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:07 smithi171 bash[25040]: cluster 2024-09-14T01:52:06.745302+0000 mgr.a (mgr.14355) 9135 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T01:52:08.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:08.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:09 smithi007 bash[22722]: audit 2024-09-14T01:52:08.274841+0000 mgr.a (mgr.14355) 9136 : audit [DBG] from='client.203352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:09 smithi007 bash[22722]: cluster 2024-09-14T01:52:08.745854+0000 mgr.a (mgr.14355) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:09 smithi131 bash[24745]: audit 2024-09-14T01:52:08.274841+0000 mgr.a (mgr.14355) 9136 : audit [DBG] from='client.203352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:09 smithi131 bash[24745]: cluster 2024-09-14T01:52:08.745854+0000 mgr.a (mgr.14355) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:09 smithi171 bash[25040]: audit 2024-09-14T01:52:08.274841+0000 mgr.a (mgr.14355) 9136 : audit [DBG] from='client.203352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:09 smithi171 bash[25040]: cluster 2024-09-14T01:52:08.745854+0000 mgr.a (mgr.14355) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T01:52:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:11 smithi007 bash[22722]: cluster 2024-09-14T01:52:10.748173+0000 mgr.a (mgr.14355) 9138 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-14T01:52:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:11 smithi131 bash[24745]: cluster 2024-09-14T01:52:10.748173+0000 mgr.a (mgr.14355) 9138 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-14T01:52:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:11 smithi171 bash[25040]: cluster 2024-09-14T01:52:10.748173+0000 mgr.a (mgr.14355) 9138 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-14T01:52:13.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:13.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:13.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:13 smithi007 bash[22722]: cluster 2024-09-14T01:52:12.748975+0000 mgr.a (mgr.14355) 9139 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:13 smithi131 bash[24745]: cluster 2024-09-14T01:52:12.748975+0000 mgr.a (mgr.14355) 9139 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:13 smithi171 bash[25040]: cluster 2024-09-14T01:52:12.748975+0000 mgr.a (mgr.14355) 9139 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:14.428 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:14.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:14.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:14.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:14.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:15 smithi007 bash[22722]: audit 2024-09-14T01:52:14.010940+0000 mgr.a (mgr.14355) 9140 : audit [DBG] from='client.203430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:15 smithi007 bash[22722]: cluster 2024-09-14T01:52:14.750026+0000 mgr.a (mgr.14355) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:15 smithi131 bash[24745]: audit 2024-09-14T01:52:14.010940+0000 mgr.a (mgr.14355) 9140 : audit [DBG] from='client.203430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:15 smithi131 bash[24745]: cluster 2024-09-14T01:52:14.750026+0000 mgr.a (mgr.14355) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:15 smithi171 bash[25040]: audit 2024-09-14T01:52:14.010940+0000 mgr.a (mgr.14355) 9140 : audit [DBG] from='client.203430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:15 smithi171 bash[25040]: cluster 2024-09-14T01:52:14.750026+0000 mgr.a (mgr.14355) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-14T01:52:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:17 smithi007 bash[22722]: cluster 2024-09-14T01:52:16.752419+0000 mgr.a (mgr.14355) 9142 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:17 smithi131 bash[24745]: cluster 2024-09-14T01:52:16.752419+0000 mgr.a (mgr.14355) 9142 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:17 smithi171 bash[25040]: cluster 2024-09-14T01:52:16.752419+0000 mgr.a (mgr.14355) 9142 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:19.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:19.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:19.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:19 smithi007 bash[22722]: cluster 2024-09-14T01:52:18.753230+0000 mgr.a (mgr.14355) 9143 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:52:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:20.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:20.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:20.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:19 smithi131 bash[24745]: cluster 2024-09-14T01:52:18.753230+0000 mgr.a (mgr.14355) 9143 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:52:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:19 smithi171 bash[25040]: cluster 2024-09-14T01:52:18.753230+0000 mgr.a (mgr.14355) 9143 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T01:52:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:20 smithi007 bash[22722]: audit 2024-09-14T01:52:19.764992+0000 mgr.a (mgr.14355) 9144 : audit [DBG] from='client.203508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:20 smithi131 bash[24745]: audit 2024-09-14T01:52:19.764992+0000 mgr.a (mgr.14355) 9144 : audit [DBG] from='client.203508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:20 smithi171 bash[25040]: audit 2024-09-14T01:52:19.764992+0000 mgr.a (mgr.14355) 9144 : audit [DBG] from='client.203508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:21 smithi007 bash[22722]: cluster 2024-09-14T01:52:20.755716+0000 mgr.a (mgr.14355) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:21 smithi131 bash[24745]: cluster 2024-09-14T01:52:20.755716+0000 mgr.a (mgr.14355) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:21 smithi171 bash[25040]: cluster 2024-09-14T01:52:20.755716+0000 mgr.a (mgr.14355) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T01:52:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:23 smithi007 bash[22722]: cluster 2024-09-14T01:52:22.756553+0000 mgr.a (mgr.14355) 9146 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:23 smithi131 bash[24745]: cluster 2024-09-14T01:52:22.756553+0000 mgr.a (mgr.14355) 9146 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:23 smithi171 bash[25040]: cluster 2024-09-14T01:52:22.756553+0000 mgr.a (mgr.14355) 9146 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:25.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:25.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:25.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:25.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:25.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:25.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:25 smithi007 bash[22722]: cluster 2024-09-14T01:52:24.757326+0000 mgr.a (mgr.14355) 9147 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:25 smithi131 bash[24745]: cluster 2024-09-14T01:52:24.757326+0000 mgr.a (mgr.14355) 9147 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:25 smithi171 bash[25040]: cluster 2024-09-14T01:52:24.757326+0000 mgr.a (mgr.14355) 9147 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:26 smithi007 bash[22722]: audit 2024-09-14T01:52:25.543419+0000 mgr.a (mgr.14355) 9148 : audit [DBG] from='client.203583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:26 smithi131 bash[24745]: audit 2024-09-14T01:52:25.543419+0000 mgr.a (mgr.14355) 9148 : audit [DBG] from='client.203583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:26 smithi171 bash[25040]: audit 2024-09-14T01:52:25.543419+0000 mgr.a (mgr.14355) 9148 : audit [DBG] from='client.203583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:27 smithi007 bash[22722]: cluster 2024-09-14T01:52:26.760056+0000 mgr.a (mgr.14355) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:27 smithi131 bash[24745]: cluster 2024-09-14T01:52:26.760056+0000 mgr.a (mgr.14355) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:27 smithi171 bash[25040]: cluster 2024-09-14T01:52:26.760056+0000 mgr.a (mgr.14355) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-09-14T01:52:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:29 smithi007 bash[22722]: cluster 2024-09-14T01:52:28.760843+0000 mgr.a (mgr.14355) 9150 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:52:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:29 smithi131 bash[24745]: cluster 2024-09-14T01:52:28.760843+0000 mgr.a (mgr.14355) 9150 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:52:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:29 smithi171 bash[25040]: cluster 2024-09-14T01:52:28.760843+0000 mgr.a (mgr.14355) 9150 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:52:30.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:30.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:30.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:31.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:31.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:31.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:31.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:31.738 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:31 smithi007 bash[22722]: cluster 2024-09-14T01:52:30.762798+0000 mgr.a (mgr.14355) 9151 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:31 smithi131 bash[24745]: cluster 2024-09-14T01:52:30.762798+0000 mgr.a (mgr.14355) 9151 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:31 smithi171 bash[25040]: cluster 2024-09-14T01:52:30.762798+0000 mgr.a (mgr.14355) 9151 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:32 smithi007 bash[22722]: audit 2024-09-14T01:52:31.306880+0000 mgr.a (mgr.14355) 9152 : audit [DBG] from='client.203658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:32 smithi131 bash[24745]: audit 2024-09-14T01:52:31.306880+0000 mgr.a (mgr.14355) 9152 : audit [DBG] from='client.203658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:32 smithi171 bash[25040]: audit 2024-09-14T01:52:31.306880+0000 mgr.a (mgr.14355) 9152 : audit [DBG] from='client.203658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:33 smithi007 bash[22722]: cluster 2024-09-14T01:52:32.763693+0000 mgr.a (mgr.14355) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:33 smithi131 bash[24745]: cluster 2024-09-14T01:52:32.763693+0000 mgr.a (mgr.14355) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:33 smithi171 bash[25040]: cluster 2024-09-14T01:52:32.763693+0000 mgr.a (mgr.14355) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:35 smithi007 bash[22722]: cluster 2024-09-14T01:52:34.764486+0000 mgr.a (mgr.14355) 9154 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:35 smithi131 bash[24745]: cluster 2024-09-14T01:52:34.764486+0000 mgr.a (mgr.14355) 9154 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:35 smithi171 bash[25040]: cluster 2024-09-14T01:52:34.764486+0000 mgr.a (mgr.14355) 9154 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:52:36.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:36.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:36.740 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:37.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:37.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:37.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:37.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:37.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:37 smithi007 bash[22722]: cluster 2024-09-14T01:52:36.766244+0000 mgr.a (mgr.14355) 9155 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:52:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:37 smithi131 bash[24745]: cluster 2024-09-14T01:52:36.766244+0000 mgr.a (mgr.14355) 9155 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:52:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:37 smithi171 bash[25040]: cluster 2024-09-14T01:52:36.766244+0000 mgr.a (mgr.14355) 9155 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:52:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:38 smithi007 bash[22722]: audit 2024-09-14T01:52:37.074332+0000 mgr.a (mgr.14355) 9156 : audit [DBG] from='client.203733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:38 smithi131 bash[24745]: audit 2024-09-14T01:52:37.074332+0000 mgr.a (mgr.14355) 9156 : audit [DBG] from='client.203733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:38 smithi171 bash[25040]: audit 2024-09-14T01:52:37.074332+0000 mgr.a (mgr.14355) 9156 : audit [DBG] from='client.203733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:39 smithi007 bash[22722]: cluster 2024-09-14T01:52:38.767110+0000 mgr.a (mgr.14355) 9157 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:39 smithi131 bash[24745]: cluster 2024-09-14T01:52:38.767110+0000 mgr.a (mgr.14355) 9157 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:39 smithi171 bash[25040]: cluster 2024-09-14T01:52:38.767110+0000 mgr.a (mgr.14355) 9157 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:41 smithi131 bash[24745]: cluster 2024-09-14T01:52:40.769286+0000 mgr.a (mgr.14355) 9158 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:41 smithi171 bash[25040]: cluster 2024-09-14T01:52:40.769286+0000 mgr.a (mgr.14355) 9158 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:41 smithi007 bash[22722]: cluster 2024-09-14T01:52:40.769286+0000 mgr.a (mgr.14355) 9158 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:43.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:43 smithi131 bash[24745]: cluster 2024-09-14T01:52:42.769995+0000 mgr.a (mgr.14355) 9159 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:43 smithi131 bash[24745]: audit 2024-09-14T01:52:42.830577+0000 mgr.a (mgr.14355) 9160 : audit [DBG] from='client.203805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:43 smithi171 bash[25040]: cluster 2024-09-14T01:52:42.769995+0000 mgr.a (mgr.14355) 9159 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:43 smithi171 bash[25040]: audit 2024-09-14T01:52:42.830577+0000 mgr.a (mgr.14355) 9160 : audit [DBG] from='client.203805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:43 smithi007 bash[22722]: cluster 2024-09-14T01:52:42.769995+0000 mgr.a (mgr.14355) 9159 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:43 smithi007 bash[22722]: audit 2024-09-14T01:52:42.830577+0000 mgr.a (mgr.14355) 9160 : audit [DBG] from='client.203805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:45 smithi131 bash[24745]: cluster 2024-09-14T01:52:44.770879+0000 mgr.a (mgr.14355) 9161 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:45 smithi171 bash[25040]: cluster 2024-09-14T01:52:44.770879+0000 mgr.a (mgr.14355) 9161 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:45 smithi007 bash[22722]: cluster 2024-09-14T01:52:44.770879+0000 mgr.a (mgr.14355) 9161 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:48.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:47 smithi131 bash[24745]: cluster 2024-09-14T01:52:46.773113+0000 mgr.a (mgr.14355) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:47 smithi131 bash[24745]: audit 2024-09-14T01:52:46.989448+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:52:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:48.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:47 smithi171 bash[25040]: cluster 2024-09-14T01:52:46.773113+0000 mgr.a (mgr.14355) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:47 smithi171 bash[25040]: audit 2024-09-14T01:52:46.989448+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:52:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:47 smithi007 bash[22722]: cluster 2024-09-14T01:52:46.773113+0000 mgr.a (mgr.14355) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:47 smithi007 bash[22722]: audit 2024-09-14T01:52:46.989448+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:52:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:49.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:49 smithi131 bash[24745]: audit 2024-09-14T01:52:48.604450+0000 mgr.a (mgr.14355) 9163 : audit [DBG] from='client.203880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:49 smithi131 bash[24745]: cluster 2024-09-14T01:52:48.773962+0000 mgr.a (mgr.14355) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:49 smithi171 bash[25040]: audit 2024-09-14T01:52:48.604450+0000 mgr.a (mgr.14355) 9163 : audit [DBG] from='client.203880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:49 smithi171 bash[25040]: cluster 2024-09-14T01:52:48.773962+0000 mgr.a (mgr.14355) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:49 smithi007 bash[22722]: audit 2024-09-14T01:52:48.604450+0000 mgr.a (mgr.14355) 9163 : audit [DBG] from='client.203880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:49 smithi007 bash[22722]: cluster 2024-09-14T01:52:48.773962+0000 mgr.a (mgr.14355) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:51 smithi131 bash[24745]: cluster 2024-09-14T01:52:50.776313+0000 mgr.a (mgr.14355) 9165 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:51 smithi171 bash[25040]: cluster 2024-09-14T01:52:50.776313+0000 mgr.a (mgr.14355) 9165 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:51 smithi007 bash[22722]: cluster 2024-09-14T01:52:50.776313+0000 mgr.a (mgr.14355) 9165 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:54.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:54.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:52:54.134 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:53 smithi171 bash[25040]: cluster 2024-09-14T01:52:52.777083+0000 mgr.a (mgr.14355) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:54.200 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:53 smithi131 bash[24745]: cluster 2024-09-14T01:52:52.777083+0000 mgr.a (mgr.14355) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:53 smithi007 bash[22722]: cluster 2024-09-14T01:52:52.777083+0000 mgr.a (mgr.14355) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:54.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:52:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:52:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:52:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:52:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:52:56.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:55 smithi171 bash[25040]: audit 2024-09-14T01:52:54.352499+0000 mgr.a (mgr.14355) 9167 : audit [DBG] from='client.203958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:56.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:55 smithi171 bash[25040]: cluster 2024-09-14T01:52:54.777669+0000 mgr.a (mgr.14355) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:55 smithi007 bash[22722]: audit 2024-09-14T01:52:54.352499+0000 mgr.a (mgr.14355) 9167 : audit [DBG] from='client.203958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:55 smithi007 bash[22722]: cluster 2024-09-14T01:52:54.777669+0000 mgr.a (mgr.14355) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:55 smithi131 bash[24745]: audit 2024-09-14T01:52:54.352499+0000 mgr.a (mgr.14355) 9167 : audit [DBG] from='client.203958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:52:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:55 smithi131 bash[24745]: cluster 2024-09-14T01:52:54.777669+0000 mgr.a (mgr.14355) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:52:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: cluster 2024-09-14T01:52:56.779887+0000 mgr.a (mgr.14355) 9169 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.128274+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.136698+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.407936+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.416769+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.418966+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.421021+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.433409+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:57 smithi007 bash[22722]: audit 2024-09-14T01:52:57.438636+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: cluster 2024-09-14T01:52:56.779887+0000 mgr.a (mgr.14355) 9169 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.128274+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.136698+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.407936+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.416769+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.418966+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:52:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.421021+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:52:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.433409+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:57 smithi131 bash[24745]: audit 2024-09-14T01:52:57.438636+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: cluster 2024-09-14T01:52:56.779887+0000 mgr.a (mgr.14355) 9169 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.128274+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.136698+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.407936+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.416769+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.418966+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.421021+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.433409+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:52:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:57 smithi171 bash[25040]: audit 2024-09-14T01:52:57.438636+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:52:58 smithi007 bash[22972]: debug 2024-09-14T01:52:58.204+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:52:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:52:58 smithi007 bash[22972]: debug 2024-09-14T01:52:58.204+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:52:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:58 smithi007 bash[22722]: audit 2024-09-14T01:52:57.441026+0000 mgr.a (mgr.14355) 9170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:58 smithi131 bash[24745]: audit 2024-09-14T01:52:57.441026+0000 mgr.a (mgr.14355) 9170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:58 smithi171 bash[25040]: audit 2024-09-14T01:52:57.441026+0000 mgr.a (mgr.14355) 9170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:52:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:52:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:52:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:59 smithi007 bash[22722]: audit 2024-09-14T01:52:58.208422+0000 mgr.a (mgr.14355) 9171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:53:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:59 smithi007 bash[22722]: cephadm 2024-09-14T01:52:58.210204+0000 mgr.a (mgr.14355) 9172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:53:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:52:59 smithi007 bash[22722]: cluster 2024-09-14T01:52:58.780768+0000 mgr.a (mgr.14355) 9173 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:59 smithi131 bash[24745]: audit 2024-09-14T01:52:58.208422+0000 mgr.a (mgr.14355) 9171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:53:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:59 smithi131 bash[24745]: cephadm 2024-09-14T01:52:58.210204+0000 mgr.a (mgr.14355) 9172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:53:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:52:59 smithi131 bash[24745]: cluster 2024-09-14T01:52:58.780768+0000 mgr.a (mgr.14355) 9173 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:59 smithi171 bash[25040]: audit 2024-09-14T01:52:58.208422+0000 mgr.a (mgr.14355) 9171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:53:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:59 smithi171 bash[25040]: cephadm 2024-09-14T01:52:58.210204+0000 mgr.a (mgr.14355) 9172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:53:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:52:59 smithi171 bash[25040]: cluster 2024-09-14T01:52:58.780768+0000 mgr.a (mgr.14355) 9173 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:00.544 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:00.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:00.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:00.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:00.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:01 smithi007 bash[22722]: audit 2024-09-14T01:53:00.118077+0000 mgr.a (mgr.14355) 9174 : audit [DBG] from='client.204141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:01 smithi007 bash[22722]: cluster 2024-09-14T01:53:00.783640+0000 mgr.a (mgr.14355) 9175 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:01 smithi131 bash[24745]: audit 2024-09-14T01:53:00.118077+0000 mgr.a (mgr.14355) 9174 : audit [DBG] from='client.204141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:01 smithi131 bash[24745]: cluster 2024-09-14T01:53:00.783640+0000 mgr.a (mgr.14355) 9175 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:01 smithi171 bash[25040]: audit 2024-09-14T01:53:00.118077+0000 mgr.a (mgr.14355) 9174 : audit [DBG] from='client.204141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:01 smithi171 bash[25040]: cluster 2024-09-14T01:53:00.783640+0000 mgr.a (mgr.14355) 9175 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:03 smithi007 bash[22722]: cluster 2024-09-14T01:53:02.784435+0000 mgr.a (mgr.14355) 9176 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:03 smithi131 bash[24745]: cluster 2024-09-14T01:53:02.784435+0000 mgr.a (mgr.14355) 9176 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:03 smithi171 bash[25040]: cluster 2024-09-14T01:53:02.784435+0000 mgr.a (mgr.14355) 9176 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:05.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:05.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:05 smithi007 bash[22722]: cluster 2024-09-14T01:53:04.785240+0000 mgr.a (mgr.14355) 9177 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:05 smithi131 bash[24745]: cluster 2024-09-14T01:53:04.785240+0000 mgr.a (mgr.14355) 9177 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:06.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:05 smithi171 bash[25040]: cluster 2024-09-14T01:53:04.785240+0000 mgr.a (mgr.14355) 9177 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:06.326 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:06 smithi007 bash[22722]: audit 2024-09-14T01:53:05.880712+0000 mgr.a (mgr.14355) 9178 : audit [DBG] from='client.204213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:06 smithi131 bash[24745]: audit 2024-09-14T01:53:05.880712+0000 mgr.a (mgr.14355) 9178 : audit [DBG] from='client.204213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:06 smithi171 bash[25040]: audit 2024-09-14T01:53:05.880712+0000 mgr.a (mgr.14355) 9178 : audit [DBG] from='client.204213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:07 smithi007 bash[22722]: cluster 2024-09-14T01:53:06.788185+0000 mgr.a (mgr.14355) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:07 smithi131 bash[24745]: cluster 2024-09-14T01:53:06.788185+0000 mgr.a (mgr.14355) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:07 smithi171 bash[25040]: cluster 2024-09-14T01:53:06.788185+0000 mgr.a (mgr.14355) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:09 smithi007 bash[22722]: cluster 2024-09-14T01:53:08.789185+0000 mgr.a (mgr.14355) 9180 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:09 smithi131 bash[24745]: cluster 2024-09-14T01:53:08.789185+0000 mgr.a (mgr.14355) 9180 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:09 smithi171 bash[25040]: cluster 2024-09-14T01:53:08.789185+0000 mgr.a (mgr.14355) 9180 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:53:11.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:11.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:11.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:12.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:12.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:12.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:12.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:12.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:11 smithi007 bash[22722]: cluster 2024-09-14T01:53:10.791333+0000 mgr.a (mgr.14355) 9181 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:11 smithi131 bash[24745]: cluster 2024-09-14T01:53:10.791333+0000 mgr.a (mgr.14355) 9181 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:11 smithi171 bash[25040]: cluster 2024-09-14T01:53:10.791333+0000 mgr.a (mgr.14355) 9181 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:53:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:12 smithi007 bash[22722]: audit 2024-09-14T01:53:11.659389+0000 mgr.a (mgr.14355) 9182 : audit [DBG] from='client.204288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:12 smithi131 bash[24745]: audit 2024-09-14T01:53:11.659389+0000 mgr.a (mgr.14355) 9182 : audit [DBG] from='client.204288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:12 smithi171 bash[25040]: audit 2024-09-14T01:53:11.659389+0000 mgr.a (mgr.14355) 9182 : audit [DBG] from='client.204288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:13 smithi007 bash[22722]: cluster 2024-09-14T01:53:12.792304+0000 mgr.a (mgr.14355) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:13 smithi131 bash[24745]: cluster 2024-09-14T01:53:12.792304+0000 mgr.a (mgr.14355) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:13 smithi171 bash[25040]: cluster 2024-09-14T01:53:12.792304+0000 mgr.a (mgr.14355) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:15 smithi007 bash[22722]: cluster 2024-09-14T01:53:14.793111+0000 mgr.a (mgr.14355) 9184 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:15 smithi131 bash[24745]: cluster 2024-09-14T01:53:14.793111+0000 mgr.a (mgr.14355) 9184 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:15 smithi171 bash[25040]: cluster 2024-09-14T01:53:14.793111+0000 mgr.a (mgr.14355) 9184 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:17.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:17.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:17.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:17 smithi007 bash[22722]: cluster 2024-09-14T01:53:16.795367+0000 mgr.a (mgr.14355) 9185 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:17 smithi131 bash[24745]: cluster 2024-09-14T01:53:16.795367+0000 mgr.a (mgr.14355) 9185 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:17 smithi171 bash[25040]: cluster 2024-09-14T01:53:16.795367+0000 mgr.a (mgr.14355) 9185 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:18 smithi007 bash[22722]: audit 2024-09-14T01:53:17.431394+0000 mgr.a (mgr.14355) 9186 : audit [DBG] from='client.204363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:18 smithi131 bash[24745]: audit 2024-09-14T01:53:17.431394+0000 mgr.a (mgr.14355) 9186 : audit [DBG] from='client.204363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:18 smithi171 bash[25040]: audit 2024-09-14T01:53:17.431394+0000 mgr.a (mgr.14355) 9186 : audit [DBG] from='client.204363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:19 smithi007 bash[22722]: cluster 2024-09-14T01:53:18.796342+0000 mgr.a (mgr.14355) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:19 smithi131 bash[24745]: cluster 2024-09-14T01:53:18.796342+0000 mgr.a (mgr.14355) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:19 smithi171 bash[25040]: cluster 2024-09-14T01:53:18.796342+0000 mgr.a (mgr.14355) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:21 smithi007 bash[22722]: cluster 2024-09-14T01:53:20.798559+0000 mgr.a (mgr.14355) 9188 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:21 smithi131 bash[24745]: cluster 2024-09-14T01:53:20.798559+0000 mgr.a (mgr.14355) 9188 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:21 smithi171 bash[25040]: cluster 2024-09-14T01:53:20.798559+0000 mgr.a (mgr.14355) 9188 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:22.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:22.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:22.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:23.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:23.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:23.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:23.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:23 smithi007 bash[22722]: cluster 2024-09-14T01:53:22.799352+0000 mgr.a (mgr.14355) 9189 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:23 smithi131 bash[24745]: cluster 2024-09-14T01:53:22.799352+0000 mgr.a (mgr.14355) 9189 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:23 smithi171 bash[25040]: cluster 2024-09-14T01:53:22.799352+0000 mgr.a (mgr.14355) 9189 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:24 smithi007 bash[22722]: audit 2024-09-14T01:53:23.177664+0000 mgr.a (mgr.14355) 9190 : audit [DBG] from='client.204441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:24 smithi131 bash[24745]: audit 2024-09-14T01:53:23.177664+0000 mgr.a (mgr.14355) 9190 : audit [DBG] from='client.204441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:24 smithi171 bash[25040]: audit 2024-09-14T01:53:23.177664+0000 mgr.a (mgr.14355) 9190 : audit [DBG] from='client.204441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:25 smithi007 bash[22722]: cluster 2024-09-14T01:53:24.800300+0000 mgr.a (mgr.14355) 9191 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:25 smithi131 bash[24745]: cluster 2024-09-14T01:53:24.800300+0000 mgr.a (mgr.14355) 9191 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:25 smithi171 bash[25040]: cluster 2024-09-14T01:53:24.800300+0000 mgr.a (mgr.14355) 9191 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:27 smithi007 bash[22722]: cluster 2024-09-14T01:53:26.802607+0000 mgr.a (mgr.14355) 9192 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:27 smithi131 bash[24745]: cluster 2024-09-14T01:53:26.802607+0000 mgr.a (mgr.14355) 9192 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:27 smithi171 bash[25040]: cluster 2024-09-14T01:53:26.802607+0000 mgr.a (mgr.14355) 9192 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:28.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:28.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:29.371 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:29.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:29 smithi007 bash[22722]: cluster 2024-09-14T01:53:28.803344+0000 mgr.a (mgr.14355) 9193 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:29 smithi007 bash[22722]: audit 2024-09-14T01:53:28.926403+0000 mgr.a (mgr.14355) 9194 : audit [DBG] from='client.204513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:29 smithi131 bash[24745]: cluster 2024-09-14T01:53:28.803344+0000 mgr.a (mgr.14355) 9193 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:29 smithi131 bash[24745]: audit 2024-09-14T01:53:28.926403+0000 mgr.a (mgr.14355) 9194 : audit [DBG] from='client.204513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:29 smithi171 bash[25040]: cluster 2024-09-14T01:53:28.803344+0000 mgr.a (mgr.14355) 9193 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:29 smithi171 bash[25040]: audit 2024-09-14T01:53:28.926403+0000 mgr.a (mgr.14355) 9194 : audit [DBG] from='client.204513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:31 smithi007 bash[22722]: cluster 2024-09-14T01:53:30.805725+0000 mgr.a (mgr.14355) 9195 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:32.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:31 smithi131 bash[24745]: cluster 2024-09-14T01:53:30.805725+0000 mgr.a (mgr.14355) 9195 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:31 smithi171 bash[25040]: cluster 2024-09-14T01:53:30.805725+0000 mgr.a (mgr.14355) 9195 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:33 smithi007 bash[22722]: cluster 2024-09-14T01:53:32.806527+0000 mgr.a (mgr.14355) 9196 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:33 smithi131 bash[24745]: cluster 2024-09-14T01:53:32.806527+0000 mgr.a (mgr.14355) 9196 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:33 smithi171 bash[25040]: cluster 2024-09-14T01:53:32.806527+0000 mgr.a (mgr.14355) 9196 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:34.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:34.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:35.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:35 smithi131 bash[24745]: audit 2024-09-14T01:53:34.707355+0000 mgr.a (mgr.14355) 9197 : audit [DBG] from='client.204588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:35 smithi131 bash[24745]: cluster 2024-09-14T01:53:34.807105+0000 mgr.a (mgr.14355) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:35 smithi171 bash[25040]: audit 2024-09-14T01:53:34.707355+0000 mgr.a (mgr.14355) 9197 : audit [DBG] from='client.204588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:35 smithi171 bash[25040]: cluster 2024-09-14T01:53:34.807105+0000 mgr.a (mgr.14355) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:35 smithi007 bash[22722]: audit 2024-09-14T01:53:34.707355+0000 mgr.a (mgr.14355) 9197 : audit [DBG] from='client.204588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:35 smithi007 bash[22722]: cluster 2024-09-14T01:53:34.807105+0000 mgr.a (mgr.14355) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:37 smithi131 bash[24745]: cluster 2024-09-14T01:53:36.809449+0000 mgr.a (mgr.14355) 9199 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:37 smithi171 bash[25040]: cluster 2024-09-14T01:53:36.809449+0000 mgr.a (mgr.14355) 9199 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:37 smithi007 bash[22722]: cluster 2024-09-14T01:53:36.809449+0000 mgr.a (mgr.14355) 9199 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:40.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:40.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:39 smithi131 bash[24745]: cluster 2024-09-14T01:53:38.810390+0000 mgr.a (mgr.14355) 9200 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:39 smithi171 bash[25040]: cluster 2024-09-14T01:53:38.810390+0000 mgr.a (mgr.14355) 9200 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:39 smithi007 bash[22722]: cluster 2024-09-14T01:53:38.810390+0000 mgr.a (mgr.14355) 9200 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:40.904 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:40.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:40.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:40.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:40.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:41 smithi131 bash[24745]: audit 2024-09-14T01:53:40.480658+0000 mgr.a (mgr.14355) 9201 : audit [DBG] from='client.204663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:41 smithi131 bash[24745]: cluster 2024-09-14T01:53:40.811695+0000 mgr.a (mgr.14355) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:41 smithi171 bash[25040]: audit 2024-09-14T01:53:40.480658+0000 mgr.a (mgr.14355) 9201 : audit [DBG] from='client.204663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:41 smithi171 bash[25040]: cluster 2024-09-14T01:53:40.811695+0000 mgr.a (mgr.14355) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:41 smithi007 bash[22722]: audit 2024-09-14T01:53:40.480658+0000 mgr.a (mgr.14355) 9201 : audit [DBG] from='client.204663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:41 smithi007 bash[22722]: cluster 2024-09-14T01:53:40.811695+0000 mgr.a (mgr.14355) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:43 smithi131 bash[24745]: cluster 2024-09-14T01:53:42.812412+0000 mgr.a (mgr.14355) 9203 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:43 smithi171 bash[25040]: cluster 2024-09-14T01:53:42.812412+0000 mgr.a (mgr.14355) 9203 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:43 smithi007 bash[22722]: cluster 2024-09-14T01:53:42.812412+0000 mgr.a (mgr.14355) 9203 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:45.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:45.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:45 smithi131 bash[24745]: cluster 2024-09-14T01:53:44.813185+0000 mgr.a (mgr.14355) 9204 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:45 smithi171 bash[25040]: cluster 2024-09-14T01:53:44.813185+0000 mgr.a (mgr.14355) 9204 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:45 smithi007 bash[22722]: cluster 2024-09-14T01:53:44.813185+0000 mgr.a (mgr.14355) 9204 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:53:46.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:47 smithi131 bash[24745]: audit 2024-09-14T01:53:46.242851+0000 mgr.a (mgr.14355) 9205 : audit [DBG] from='client.204741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:47 smithi131 bash[24745]: cluster 2024-09-14T01:53:46.816015+0000 mgr.a (mgr.14355) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:47 smithi171 bash[25040]: audit 2024-09-14T01:53:46.242851+0000 mgr.a (mgr.14355) 9205 : audit [DBG] from='client.204741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:47 smithi171 bash[25040]: cluster 2024-09-14T01:53:46.816015+0000 mgr.a (mgr.14355) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:47 smithi007 bash[22722]: audit 2024-09-14T01:53:46.242851+0000 mgr.a (mgr.14355) 9205 : audit [DBG] from='client.204741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:47 smithi007 bash[22722]: cluster 2024-09-14T01:53:46.816015+0000 mgr.a (mgr.14355) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:49 smithi131 bash[24745]: cluster 2024-09-14T01:53:48.816800+0000 mgr.a (mgr.14355) 9207 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:53:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:49 smithi171 bash[25040]: cluster 2024-09-14T01:53:48.816800+0000 mgr.a (mgr.14355) 9207 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:53:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:49 smithi007 bash[22722]: cluster 2024-09-14T01:53:48.816800+0000 mgr.a (mgr.14355) 9207 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:53:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:51.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:51 smithi131 bash[24745]: cluster 2024-09-14T01:53:50.818769+0000 mgr.a (mgr.14355) 9208 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:51 smithi171 bash[25040]: cluster 2024-09-14T01:53:50.818769+0000 mgr.a (mgr.14355) 9208 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:52.447 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:51 smithi007 bash[22722]: cluster 2024-09-14T01:53:50.818769+0000 mgr.a (mgr.14355) 9208 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:53 smithi131 bash[24745]: audit 2024-09-14T01:53:52.030329+0000 mgr.a (mgr.14355) 9209 : audit [DBG] from='client.204813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:53 smithi131 bash[24745]: cluster 2024-09-14T01:53:52.819724+0000 mgr.a (mgr.14355) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:53 smithi171 bash[25040]: audit 2024-09-14T01:53:52.030329+0000 mgr.a (mgr.14355) 9209 : audit [DBG] from='client.204813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:53 smithi171 bash[25040]: cluster 2024-09-14T01:53:52.819724+0000 mgr.a (mgr.14355) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:53 smithi007 bash[22722]: audit 2024-09-14T01:53:52.030329+0000 mgr.a (mgr.14355) 9209 : audit [DBG] from='client.204813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:53 smithi007 bash[22722]: cluster 2024-09-14T01:53:52.819724+0000 mgr.a (mgr.14355) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:55 smithi131 bash[24745]: cluster 2024-09-14T01:53:54.820512+0000 mgr.a (mgr.14355) 9211 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:55 smithi171 bash[25040]: cluster 2024-09-14T01:53:54.820512+0000 mgr.a (mgr.14355) 9211 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:55 smithi007 bash[22722]: cluster 2024-09-14T01:53:54.820512+0000 mgr.a (mgr.14355) 9211 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:53:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:53:57.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:53:57.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:53:58.195 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:53:58.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:53:58.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:53:58.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:53:58.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:53:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:57 smithi007 bash[22722]: cluster 2024-09-14T01:53:56.822786+0000 mgr.a (mgr.14355) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:57 smithi131 bash[24745]: cluster 2024-09-14T01:53:56.822786+0000 mgr.a (mgr.14355) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:57 smithi171 bash[25040]: cluster 2024-09-14T01:53:56.822786+0000 mgr.a (mgr.14355) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:53:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:58 smithi007 bash[22722]: audit 2024-09-14T01:53:57.779642+0000 mgr.a (mgr.14355) 9213 : audit [DBG] from='client.204888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:58 smithi007 bash[22722]: audit 2024-09-14T01:53:58.290767+0000 mon.a (mon.0) 1973 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:53:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:58 smithi131 bash[24745]: audit 2024-09-14T01:53:57.779642+0000 mgr.a (mgr.14355) 9213 : audit [DBG] from='client.204888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:58 smithi131 bash[24745]: audit 2024-09-14T01:53:58.290767+0000 mon.a (mon.0) 1973 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:53:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:58 smithi171 bash[25040]: audit 2024-09-14T01:53:57.779642+0000 mgr.a (mgr.14355) 9213 : audit [DBG] from='client.204888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:53:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:58 smithi171 bash[25040]: audit 2024-09-14T01:53:58.290767+0000 mon.a (mon.0) 1973 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:54:00.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22972]: debug 2024-09-14T01:53:59.851+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:54:00.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22972]: debug 2024-09-14T01:53:59.851+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:54:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22722]: cluster 2024-09-14T01:53:58.823860+0000 mgr.a (mgr.14355) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22722]: audit 2024-09-14T01:53:59.103435+0000 mon.a (mon.0) 1974 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:54:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22722]: audit 2024-09-14T01:53:59.105402+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:54:00.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22722]: audit 2024-09-14T01:53:59.116038+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:54:00.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:53:59 smithi007 bash[22722]: audit 2024-09-14T01:53:59.120818+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:59 smithi131 bash[24745]: cluster 2024-09-14T01:53:58.823860+0000 mgr.a (mgr.14355) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:59 smithi131 bash[24745]: audit 2024-09-14T01:53:59.103435+0000 mon.a (mon.0) 1974 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:54:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:59 smithi131 bash[24745]: audit 2024-09-14T01:53:59.105402+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:54:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:59 smithi131 bash[24745]: audit 2024-09-14T01:53:59.116038+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:54:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:53:59 smithi131 bash[24745]: audit 2024-09-14T01:53:59.120818+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:59 smithi171 bash[25040]: cluster 2024-09-14T01:53:58.823860+0000 mgr.a (mgr.14355) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:59 smithi171 bash[25040]: audit 2024-09-14T01:53:59.103435+0000 mon.a (mon.0) 1974 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:54:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:59 smithi171 bash[25040]: audit 2024-09-14T01:53:59.105402+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:54:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:59 smithi171 bash[25040]: audit 2024-09-14T01:53:59.116038+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:54:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:53:59 smithi171 bash[25040]: audit 2024-09-14T01:53:59.120818+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:00 smithi007 bash[22722]: audit 2024-09-14T01:53:59.123599+0000 mgr.a (mgr.14355) 9215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:00 smithi007 bash[22722]: audit 2024-09-14T01:53:59.856192+0000 mgr.a (mgr.14355) 9216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:54:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:00 smithi007 bash[22722]: cephadm 2024-09-14T01:53:59.857489+0000 mgr.a (mgr.14355) 9217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:54:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:00 smithi131 bash[24745]: audit 2024-09-14T01:53:59.123599+0000 mgr.a (mgr.14355) 9215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:00 smithi131 bash[24745]: audit 2024-09-14T01:53:59.856192+0000 mgr.a (mgr.14355) 9216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:54:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:00 smithi131 bash[24745]: cephadm 2024-09-14T01:53:59.857489+0000 mgr.a (mgr.14355) 9217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:54:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:00 smithi171 bash[25040]: audit 2024-09-14T01:53:59.123599+0000 mgr.a (mgr.14355) 9215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:54:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:00 smithi171 bash[25040]: audit 2024-09-14T01:53:59.856192+0000 mgr.a (mgr.14355) 9216 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:54:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:00 smithi171 bash[25040]: cephadm 2024-09-14T01:53:59.857489+0000 mgr.a (mgr.14355) 9217 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:54:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:01 smithi007 bash[22722]: cluster 2024-09-14T01:54:00.826270+0000 mgr.a (mgr.14355) 9218 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:01 smithi131 bash[24745]: cluster 2024-09-14T01:54:00.826270+0000 mgr.a (mgr.14355) 9218 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:01 smithi171 bash[25040]: cluster 2024-09-14T01:54:00.826270+0000 mgr.a (mgr.14355) 9218 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:03.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:03.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:03.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:03.988 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:03 smithi007 bash[22722]: cluster 2024-09-14T01:54:02.827033+0000 mgr.a (mgr.14355) 9219 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:03 smithi131 bash[24745]: cluster 2024-09-14T01:54:02.827033+0000 mgr.a (mgr.14355) 9219 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:03 smithi171 bash[25040]: cluster 2024-09-14T01:54:02.827033+0000 mgr.a (mgr.14355) 9219 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:04 smithi007 bash[22722]: audit 2024-09-14T01:54:03.536346+0000 mgr.a (mgr.14355) 9220 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:04 smithi131 bash[24745]: audit 2024-09-14T01:54:03.536346+0000 mgr.a (mgr.14355) 9220 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:04 smithi171 bash[25040]: audit 2024-09-14T01:54:03.536346+0000 mgr.a (mgr.14355) 9220 : audit [DBG] from='client.205068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:05 smithi007 bash[22722]: cluster 2024-09-14T01:54:04.827962+0000 mgr.a (mgr.14355) 9221 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:05 smithi131 bash[24745]: cluster 2024-09-14T01:54:04.827962+0000 mgr.a (mgr.14355) 9221 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:05 smithi171 bash[25040]: cluster 2024-09-14T01:54:04.827962+0000 mgr.a (mgr.14355) 9221 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:07 smithi007 bash[22722]: cluster 2024-09-14T01:54:06.830249+0000 mgr.a (mgr.14355) 9222 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:07 smithi131 bash[24745]: cluster 2024-09-14T01:54:06.830249+0000 mgr.a (mgr.14355) 9222 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:07 smithi171 bash[25040]: cluster 2024-09-14T01:54:06.830249+0000 mgr.a (mgr.14355) 9222 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:08.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:08.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:08.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:09.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:09 smithi007 bash[22722]: cluster 2024-09-14T01:54:08.831062+0000 mgr.a (mgr.14355) 9223 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:09 smithi131 bash[24745]: cluster 2024-09-14T01:54:08.831062+0000 mgr.a (mgr.14355) 9223 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:09 smithi171 bash[25040]: cluster 2024-09-14T01:54:08.831062+0000 mgr.a (mgr.14355) 9223 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:10 smithi007 bash[22722]: audit 2024-09-14T01:54:09.322801+0000 mgr.a (mgr.14355) 9224 : audit [DBG] from='client.205143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:10 smithi131 bash[24745]: audit 2024-09-14T01:54:09.322801+0000 mgr.a (mgr.14355) 9224 : audit [DBG] from='client.205143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:10 smithi171 bash[25040]: audit 2024-09-14T01:54:09.322801+0000 mgr.a (mgr.14355) 9224 : audit [DBG] from='client.205143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:11 smithi007 bash[22722]: cluster 2024-09-14T01:54:10.833408+0000 mgr.a (mgr.14355) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:11 smithi131 bash[24745]: cluster 2024-09-14T01:54:10.833408+0000 mgr.a (mgr.14355) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:11 smithi171 bash[25040]: cluster 2024-09-14T01:54:10.833408+0000 mgr.a (mgr.14355) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:54:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:13 smithi007 bash[22722]: cluster 2024-09-14T01:54:12.834209+0000 mgr.a (mgr.14355) 9226 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:13 smithi131 bash[24745]: cluster 2024-09-14T01:54:12.834209+0000 mgr.a (mgr.14355) 9226 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:13 smithi171 bash[25040]: cluster 2024-09-14T01:54:12.834209+0000 mgr.a (mgr.14355) 9226 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:14.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:14.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:15.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:15 smithi007 bash[22722]: cluster 2024-09-14T01:54:14.834968+0000 mgr.a (mgr.14355) 9227 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:15 smithi131 bash[24745]: cluster 2024-09-14T01:54:14.834968+0000 mgr.a (mgr.14355) 9227 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:15 smithi171 bash[25040]: cluster 2024-09-14T01:54:14.834968+0000 mgr.a (mgr.14355) 9227 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:16 smithi007 bash[22722]: audit 2024-09-14T01:54:15.097903+0000 mgr.a (mgr.14355) 9228 : audit [DBG] from='client.205221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:16 smithi131 bash[24745]: audit 2024-09-14T01:54:15.097903+0000 mgr.a (mgr.14355) 9228 : audit [DBG] from='client.205221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:16 smithi171 bash[25040]: audit 2024-09-14T01:54:15.097903+0000 mgr.a (mgr.14355) 9228 : audit [DBG] from='client.205221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:17 smithi007 bash[22722]: cluster 2024-09-14T01:54:16.837678+0000 mgr.a (mgr.14355) 9229 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:54:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:17 smithi131 bash[24745]: cluster 2024-09-14T01:54:16.837678+0000 mgr.a (mgr.14355) 9229 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:54:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:17 smithi171 bash[25040]: cluster 2024-09-14T01:54:16.837678+0000 mgr.a (mgr.14355) 9229 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:54:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:19 smithi131 bash[24745]: cluster 2024-09-14T01:54:18.838521+0000 mgr.a (mgr.14355) 9230 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:54:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:19 smithi171 bash[25040]: cluster 2024-09-14T01:54:18.838521+0000 mgr.a (mgr.14355) 9230 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:54:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:19 smithi007 bash[22722]: cluster 2024-09-14T01:54:18.838521+0000 mgr.a (mgr.14355) 9230 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:54:20.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:20.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:20.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:21.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:21 smithi131 bash[24745]: cluster 2024-09-14T01:54:20.839757+0000 mgr.a (mgr.14355) 9231 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:21 smithi131 bash[24745]: audit 2024-09-14T01:54:20.843997+0000 mgr.a (mgr.14355) 9232 : audit [DBG] from='client.205296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:21 smithi171 bash[25040]: cluster 2024-09-14T01:54:20.839757+0000 mgr.a (mgr.14355) 9231 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:21 smithi171 bash[25040]: audit 2024-09-14T01:54:20.843997+0000 mgr.a (mgr.14355) 9232 : audit [DBG] from='client.205296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:21 smithi007 bash[22722]: cluster 2024-09-14T01:54:20.839757+0000 mgr.a (mgr.14355) 9231 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:21 smithi007 bash[22722]: audit 2024-09-14T01:54:20.843997+0000 mgr.a (mgr.14355) 9232 : audit [DBG] from='client.205296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:23 smithi131 bash[24745]: cluster 2024-09-14T01:54:22.840630+0000 mgr.a (mgr.14355) 9233 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:54:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:23 smithi171 bash[25040]: cluster 2024-09-14T01:54:22.840630+0000 mgr.a (mgr.14355) 9233 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:54:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:23 smithi007 bash[22722]: cluster 2024-09-14T01:54:22.840630+0000 mgr.a (mgr.14355) 9233 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:54:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:25 smithi131 bash[24745]: cluster 2024-09-14T01:54:24.841424+0000 mgr.a (mgr.14355) 9234 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:54:26.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:26.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:26.291 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:25 smithi171 bash[25040]: cluster 2024-09-14T01:54:24.841424+0000 mgr.a (mgr.14355) 9234 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:54:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:25 smithi007 bash[22722]: cluster 2024-09-14T01:54:24.841424+0000 mgr.a (mgr.14355) 9234 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:54:27.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:27.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:27.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:27.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:27.057 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:27 smithi131 bash[24745]: audit 2024-09-14T01:54:26.623238+0000 mgr.a (mgr.14355) 9235 : audit [DBG] from='client.205374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:27 smithi131 bash[24745]: cluster 2024-09-14T01:54:26.842703+0000 mgr.a (mgr.14355) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:27 smithi171 bash[25040]: audit 2024-09-14T01:54:26.623238+0000 mgr.a (mgr.14355) 9235 : audit [DBG] from='client.205374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:27 smithi171 bash[25040]: cluster 2024-09-14T01:54:26.842703+0000 mgr.a (mgr.14355) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:27 smithi007 bash[22722]: audit 2024-09-14T01:54:26.623238+0000 mgr.a (mgr.14355) 9235 : audit [DBG] from='client.205374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:27 smithi007 bash[22722]: cluster 2024-09-14T01:54:26.842703+0000 mgr.a (mgr.14355) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:29 smithi131 bash[24745]: cluster 2024-09-14T01:54:28.843585+0000 mgr.a (mgr.14355) 9237 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:54:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:29 smithi171 bash[25040]: cluster 2024-09-14T01:54:28.843585+0000 mgr.a (mgr.14355) 9237 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:54:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:29 smithi007 bash[22722]: cluster 2024-09-14T01:54:28.843585+0000 mgr.a (mgr.14355) 9237 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:54:32.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:32.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:32.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:31 smithi131 bash[24745]: cluster 2024-09-14T01:54:30.845758+0000 mgr.a (mgr.14355) 9238 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:54:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:31 smithi171 bash[25040]: cluster 2024-09-14T01:54:30.845758+0000 mgr.a (mgr.14355) 9238 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:54:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:31 smithi007 bash[22722]: cluster 2024-09-14T01:54:30.845758+0000 mgr.a (mgr.14355) 9238 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:54:32.833 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:33 smithi131 bash[24745]: audit 2024-09-14T01:54:32.391307+0000 mgr.a (mgr.14355) 9239 : audit [DBG] from='client.205449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:33 smithi131 bash[24745]: cluster 2024-09-14T01:54:32.846352+0000 mgr.a (mgr.14355) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:33 smithi171 bash[25040]: audit 2024-09-14T01:54:32.391307+0000 mgr.a (mgr.14355) 9239 : audit [DBG] from='client.205449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:33 smithi171 bash[25040]: cluster 2024-09-14T01:54:32.846352+0000 mgr.a (mgr.14355) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:33 smithi007 bash[22722]: audit 2024-09-14T01:54:32.391307+0000 mgr.a (mgr.14355) 9239 : audit [DBG] from='client.205449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:33 smithi007 bash[22722]: cluster 2024-09-14T01:54:32.846352+0000 mgr.a (mgr.14355) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:35 smithi131 bash[24745]: cluster 2024-09-14T01:54:34.847087+0000 mgr.a (mgr.14355) 9241 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:35 smithi171 bash[25040]: cluster 2024-09-14T01:54:34.847087+0000 mgr.a (mgr.14355) 9241 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:35 smithi007 bash[22722]: cluster 2024-09-14T01:54:34.847087+0000 mgr.a (mgr.14355) 9241 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:37.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:37.836 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:37.836 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:37 smithi131 bash[24745]: cluster 2024-09-14T01:54:36.849353+0000 mgr.a (mgr.14355) 9242 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:37 smithi171 bash[25040]: cluster 2024-09-14T01:54:36.849353+0000 mgr.a (mgr.14355) 9242 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:37 smithi007 bash[22722]: cluster 2024-09-14T01:54:36.849353+0000 mgr.a (mgr.14355) 9242 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:38.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:38.587 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:39 smithi131 bash[24745]: audit 2024-09-14T01:54:38.169232+0000 mgr.a (mgr.14355) 9243 : audit [DBG] from='client.205524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:39 smithi131 bash[24745]: cluster 2024-09-14T01:54:38.850320+0000 mgr.a (mgr.14355) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:39 smithi171 bash[25040]: audit 2024-09-14T01:54:38.169232+0000 mgr.a (mgr.14355) 9243 : audit [DBG] from='client.205524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:39 smithi171 bash[25040]: cluster 2024-09-14T01:54:38.850320+0000 mgr.a (mgr.14355) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:39 smithi007 bash[22722]: audit 2024-09-14T01:54:38.169232+0000 mgr.a (mgr.14355) 9243 : audit [DBG] from='client.205524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:39 smithi007 bash[22722]: cluster 2024-09-14T01:54:38.850320+0000 mgr.a (mgr.14355) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:42 smithi131 bash[24745]: cluster 2024-09-14T01:54:40.852518+0000 mgr.a (mgr.14355) 9245 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:42 smithi171 bash[25040]: cluster 2024-09-14T01:54:40.852518+0000 mgr.a (mgr.14355) 9245 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:42 smithi007 bash[22722]: cluster 2024-09-14T01:54:40.852518+0000 mgr.a (mgr.14355) 9245 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:43.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:43.589 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:43.589 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:44.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:43 smithi131 bash[24745]: cluster 2024-09-14T01:54:42.853314+0000 mgr.a (mgr.14355) 9246 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:43 smithi171 bash[25040]: cluster 2024-09-14T01:54:42.853314+0000 mgr.a (mgr.14355) 9246 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:43 smithi007 bash[22722]: cluster 2024-09-14T01:54:42.853314+0000 mgr.a (mgr.14355) 9246 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:44.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:44 smithi131 bash[24745]: audit 2024-09-14T01:54:43.916153+0000 mgr.a (mgr.14355) 9247 : audit [DBG] from='client.205602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:44 smithi171 bash[25040]: audit 2024-09-14T01:54:43.916153+0000 mgr.a (mgr.14355) 9247 : audit [DBG] from='client.205602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:44 smithi007 bash[22722]: audit 2024-09-14T01:54:43.916153+0000 mgr.a (mgr.14355) 9247 : audit [DBG] from='client.205602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:45 smithi131 bash[24745]: cluster 2024-09-14T01:54:44.854260+0000 mgr.a (mgr.14355) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:45 smithi171 bash[25040]: cluster 2024-09-14T01:54:44.854260+0000 mgr.a (mgr.14355) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:45 smithi007 bash[22722]: cluster 2024-09-14T01:54:44.854260+0000 mgr.a (mgr.14355) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:47 smithi007 bash[22722]: cluster 2024-09-14T01:54:46.856629+0000 mgr.a (mgr.14355) 9249 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:47 smithi131 bash[24745]: cluster 2024-09-14T01:54:46.856629+0000 mgr.a (mgr.14355) 9249 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:47 smithi171 bash[25040]: cluster 2024-09-14T01:54:46.856629+0000 mgr.a (mgr.14355) 9249 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:49.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:49.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:50.100 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:50.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:49 smithi007 bash[22722]: cluster 2024-09-14T01:54:48.857439+0000 mgr.a (mgr.14355) 9250 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:49 smithi131 bash[24745]: cluster 2024-09-14T01:54:48.857439+0000 mgr.a (mgr.14355) 9250 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:49 smithi171 bash[25040]: cluster 2024-09-14T01:54:48.857439+0000 mgr.a (mgr.14355) 9250 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:50 smithi007 bash[22722]: audit 2024-09-14T01:54:49.675070+0000 mgr.a (mgr.14355) 9251 : audit [DBG] from='client.205677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:50 smithi131 bash[24745]: audit 2024-09-14T01:54:49.675070+0000 mgr.a (mgr.14355) 9251 : audit [DBG] from='client.205677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:50 smithi171 bash[25040]: audit 2024-09-14T01:54:49.675070+0000 mgr.a (mgr.14355) 9251 : audit [DBG] from='client.205677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:51 smithi007 bash[22722]: cluster 2024-09-14T01:54:50.859904+0000 mgr.a (mgr.14355) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:51 smithi131 bash[24745]: cluster 2024-09-14T01:54:50.859904+0000 mgr.a (mgr.14355) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:51 smithi171 bash[25040]: cluster 2024-09-14T01:54:50.859904+0000 mgr.a (mgr.14355) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:54:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:53 smithi007 bash[22722]: cluster 2024-09-14T01:54:52.860723+0000 mgr.a (mgr.14355) 9253 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:53 smithi131 bash[24745]: cluster 2024-09-14T01:54:52.860723+0000 mgr.a (mgr.14355) 9253 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:53 smithi171 bash[25040]: cluster 2024-09-14T01:54:52.860723+0000 mgr.a (mgr.14355) 9253 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:55.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:54:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:54:55.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:54:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:54:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:54:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:54:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:54:55.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:54:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:55 smithi007 bash[22722]: cluster 2024-09-14T01:54:54.861513+0000 mgr.a (mgr.14355) 9254 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:55 smithi131 bash[24745]: cluster 2024-09-14T01:54:54.861513+0000 mgr.a (mgr.14355) 9254 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:55 smithi171 bash[25040]: cluster 2024-09-14T01:54:54.861513+0000 mgr.a (mgr.14355) 9254 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:56 smithi131 bash[24745]: audit 2024-09-14T01:54:55.432332+0000 mgr.a (mgr.14355) 9255 : audit [DBG] from='client.205752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:56 smithi171 bash[25040]: audit 2024-09-14T01:54:55.432332+0000 mgr.a (mgr.14355) 9255 : audit [DBG] from='client.205752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:56 smithi007 bash[22722]: audit 2024-09-14T01:54:55.432332+0000 mgr.a (mgr.14355) 9255 : audit [DBG] from='client.205752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:54:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:57 smithi131 bash[24745]: cluster 2024-09-14T01:54:56.864252+0000 mgr.a (mgr.14355) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:57 smithi171 bash[25040]: cluster 2024-09-14T01:54:56.864252+0000 mgr.a (mgr.14355) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:54:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:57 smithi007 bash[22722]: cluster 2024-09-14T01:54:56.864252+0000 mgr.a (mgr.14355) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:59 smithi131 bash[24745]: cluster 2024-09-14T01:54:58.865022+0000 mgr.a (mgr.14355) 9257 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:54:59 smithi131 bash[24745]: audit 2024-09-14T01:54:59.908651+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:55:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:59 smithi171 bash[25040]: cluster 2024-09-14T01:54:58.865022+0000 mgr.a (mgr.14355) 9257 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:54:59 smithi171 bash[25040]: audit 2024-09-14T01:54:59.908651+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:55:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:59 smithi007 bash[22722]: cluster 2024-09-14T01:54:58.865022+0000 mgr.a (mgr.14355) 9257 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:54:59 smithi007 bash[22722]: audit 2024-09-14T01:54:59.908651+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:55:00.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:00.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:00.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:01.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:01.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: cluster 2024-09-14T01:55:00.866193+0000 mgr.a (mgr.14355) 9258 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.236724+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.240433+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.245929+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.251402+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.271936+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.278452+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.279299+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.280087+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.285382+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:01 smithi007 bash[22722]: audit 2024-09-14T01:55:01.287322+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: cluster 2024-09-14T01:55:00.866193+0000 mgr.a (mgr.14355) 9258 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.236724+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.240433+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.245929+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.251402+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.271936+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.278452+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.279299+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.280087+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.285382+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:01 smithi131 bash[24745]: audit 2024-09-14T01:55:01.287322+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: cluster 2024-09-14T01:55:00.866193+0000 mgr.a (mgr.14355) 9258 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.236724+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.240433+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.245929+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.251402+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.271936+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.278452+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.279299+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.280087+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.285382+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:55:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:01 smithi171 bash[25040]: audit 2024-09-14T01:55:01.287322+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:02.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:55:02 smithi007 bash[22972]: debug 2024-09-14T01:55:02.266+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:55:02.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:55:02 smithi007 bash[22972]: debug 2024-09-14T01:55:02.270+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:55:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:02 smithi131 bash[24745]: audit 2024-09-14T01:55:01.180165+0000 mgr.a (mgr.14355) 9259 : audit [DBG] from='client.205827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:02 smithi131 bash[24745]: audit 2024-09-14T01:55:01.288538+0000 mgr.a (mgr.14355) 9260 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:02 smithi171 bash[25040]: audit 2024-09-14T01:55:01.180165+0000 mgr.a (mgr.14355) 9259 : audit [DBG] from='client.205827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:02 smithi171 bash[25040]: audit 2024-09-14T01:55:01.288538+0000 mgr.a (mgr.14355) 9260 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:02 smithi007 bash[22722]: audit 2024-09-14T01:55:01.180165+0000 mgr.a (mgr.14355) 9259 : audit [DBG] from='client.205827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:02 smithi007 bash[22722]: audit 2024-09-14T01:55:01.288538+0000 mgr.a (mgr.14355) 9260 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:55:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:03 smithi131 bash[24745]: audit 2024-09-14T01:55:02.273816+0000 mgr.a (mgr.14355) 9261 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:55:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:03 smithi131 bash[24745]: cephadm 2024-09-14T01:55:02.275133+0000 mgr.a (mgr.14355) 9262 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:55:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:03 smithi131 bash[24745]: cluster 2024-09-14T01:55:02.867106+0000 mgr.a (mgr.14355) 9263 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:03 smithi171 bash[25040]: audit 2024-09-14T01:55:02.273816+0000 mgr.a (mgr.14355) 9261 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:55:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:03 smithi171 bash[25040]: cephadm 2024-09-14T01:55:02.275133+0000 mgr.a (mgr.14355) 9262 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:55:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:03 smithi171 bash[25040]: cluster 2024-09-14T01:55:02.867106+0000 mgr.a (mgr.14355) 9263 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:03 smithi007 bash[22722]: audit 2024-09-14T01:55:02.273816+0000 mgr.a (mgr.14355) 9261 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:55:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:03 smithi007 bash[22722]: cephadm 2024-09-14T01:55:02.275133+0000 mgr.a (mgr.14355) 9262 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:55:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:03 smithi007 bash[22722]: cluster 2024-09-14T01:55:02.867106+0000 mgr.a (mgr.14355) 9263 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:05 smithi131 bash[24745]: cluster 2024-09-14T01:55:04.867841+0000 mgr.a (mgr.14355) 9264 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:55:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:05 smithi171 bash[25040]: cluster 2024-09-14T01:55:04.867841+0000 mgr.a (mgr.14355) 9264 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:55:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:05 smithi007 bash[22722]: cluster 2024-09-14T01:55:04.867841+0000 mgr.a (mgr.14355) 9264 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:55:06.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:06.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:06.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:07.358 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:07 smithi131 bash[24745]: cluster 2024-09-14T01:55:06.869904+0000 mgr.a (mgr.14355) 9265 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:07 smithi131 bash[24745]: audit 2024-09-14T01:55:06.923506+0000 mgr.a (mgr.14355) 9266 : audit [DBG] from='client.206010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:07 smithi171 bash[25040]: cluster 2024-09-14T01:55:06.869904+0000 mgr.a (mgr.14355) 9265 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:07 smithi171 bash[25040]: audit 2024-09-14T01:55:06.923506+0000 mgr.a (mgr.14355) 9266 : audit [DBG] from='client.206010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:07 smithi007 bash[22722]: cluster 2024-09-14T01:55:06.869904+0000 mgr.a (mgr.14355) 9265 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:07 smithi007 bash[22722]: audit 2024-09-14T01:55:06.923506+0000 mgr.a (mgr.14355) 9266 : audit [DBG] from='client.206010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:09 smithi131 bash[24745]: cluster 2024-09-14T01:55:08.870830+0000 mgr.a (mgr.14355) 9267 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:09 smithi171 bash[25040]: cluster 2024-09-14T01:55:08.870830+0000 mgr.a (mgr.14355) 9267 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:09 smithi007 bash[22722]: cluster 2024-09-14T01:55:08.870830+0000 mgr.a (mgr.14355) 9267 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:11 smithi131 bash[24745]: cluster 2024-09-14T01:55:10.873030+0000 mgr.a (mgr.14355) 9268 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:11 smithi171 bash[25040]: cluster 2024-09-14T01:55:10.873030+0000 mgr.a (mgr.14355) 9268 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:12.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:12.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:12.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:11 smithi007 bash[22722]: cluster 2024-09-14T01:55:10.873030+0000 mgr.a (mgr.14355) 9268 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:13.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:13.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:13.139 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:13 smithi131 bash[24745]: audit 2024-09-14T01:55:12.692321+0000 mgr.a (mgr.14355) 9269 : audit [DBG] from='client.206085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:13 smithi131 bash[24745]: cluster 2024-09-14T01:55:12.873615+0000 mgr.a (mgr.14355) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:13 smithi171 bash[25040]: audit 2024-09-14T01:55:12.692321+0000 mgr.a (mgr.14355) 9269 : audit [DBG] from='client.206085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:13 smithi171 bash[25040]: cluster 2024-09-14T01:55:12.873615+0000 mgr.a (mgr.14355) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:13 smithi007 bash[22722]: audit 2024-09-14T01:55:12.692321+0000 mgr.a (mgr.14355) 9269 : audit [DBG] from='client.206085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:13 smithi007 bash[22722]: cluster 2024-09-14T01:55:12.873615+0000 mgr.a (mgr.14355) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:16 smithi131 bash[24745]: cluster 2024-09-14T01:55:14.874645+0000 mgr.a (mgr.14355) 9271 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:16 smithi171 bash[25040]: cluster 2024-09-14T01:55:14.874645+0000 mgr.a (mgr.14355) 9271 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:16 smithi007 bash[22722]: cluster 2024-09-14T01:55:14.874645+0000 mgr.a (mgr.14355) 9271 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:18.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:18 smithi131 bash[24745]: cluster 2024-09-14T01:55:16.877070+0000 mgr.a (mgr.14355) 9272 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:18 smithi171 bash[25040]: cluster 2024-09-14T01:55:16.877070+0000 mgr.a (mgr.14355) 9272 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:18 smithi007 bash[22722]: cluster 2024-09-14T01:55:16.877070+0000 mgr.a (mgr.14355) 9272 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:55:18.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:18.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:18.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:20 smithi131 bash[24745]: audit 2024-09-14T01:55:18.472690+0000 mgr.a (mgr.14355) 9273 : audit [DBG] from='client.206154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:20 smithi131 bash[24745]: cluster 2024-09-14T01:55:18.877722+0000 mgr.a (mgr.14355) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:20 smithi171 bash[25040]: audit 2024-09-14T01:55:18.472690+0000 mgr.a (mgr.14355) 9273 : audit [DBG] from='client.206154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:20 smithi171 bash[25040]: cluster 2024-09-14T01:55:18.877722+0000 mgr.a (mgr.14355) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:20 smithi007 bash[22722]: audit 2024-09-14T01:55:18.472690+0000 mgr.a (mgr.14355) 9273 : audit [DBG] from='client.206154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:20 smithi007 bash[22722]: cluster 2024-09-14T01:55:18.877722+0000 mgr.a (mgr.14355) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:21 smithi131 bash[24745]: cluster 2024-09-14T01:55:20.879940+0000 mgr.a (mgr.14355) 9275 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:21 smithi171 bash[25040]: cluster 2024-09-14T01:55:20.879940+0000 mgr.a (mgr.14355) 9275 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:21 smithi007 bash[22722]: cluster 2024-09-14T01:55:20.879940+0000 mgr.a (mgr.14355) 9275 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:23.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:23.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:23.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:23 smithi007 bash[22722]: cluster 2024-09-14T01:55:22.880709+0000 mgr.a (mgr.14355) 9276 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:23 smithi131 bash[24745]: cluster 2024-09-14T01:55:22.880709+0000 mgr.a (mgr.14355) 9276 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:23 smithi171 bash[25040]: cluster 2024-09-14T01:55:22.880709+0000 mgr.a (mgr.14355) 9276 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:24.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:24.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:25 smithi007 bash[22722]: audit 2024-09-14T01:55:24.251357+0000 mgr.a (mgr.14355) 9277 : audit [DBG] from='client.206232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:25 smithi007 bash[22722]: cluster 2024-09-14T01:55:24.881618+0000 mgr.a (mgr.14355) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:25 smithi131 bash[24745]: audit 2024-09-14T01:55:24.251357+0000 mgr.a (mgr.14355) 9277 : audit [DBG] from='client.206232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:25 smithi131 bash[24745]: cluster 2024-09-14T01:55:24.881618+0000 mgr.a (mgr.14355) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:25 smithi171 bash[25040]: audit 2024-09-14T01:55:24.251357+0000 mgr.a (mgr.14355) 9277 : audit [DBG] from='client.206232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:25 smithi171 bash[25040]: cluster 2024-09-14T01:55:24.881618+0000 mgr.a (mgr.14355) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:27 smithi007 bash[22722]: cluster 2024-09-14T01:55:26.883873+0000 mgr.a (mgr.14355) 9279 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:27 smithi131 bash[24745]: cluster 2024-09-14T01:55:26.883873+0000 mgr.a (mgr.14355) 9279 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:27 smithi171 bash[25040]: cluster 2024-09-14T01:55:26.883873+0000 mgr.a (mgr.14355) 9279 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:29.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:29 smithi007 bash[22722]: cluster 2024-09-14T01:55:28.884613+0000 mgr.a (mgr.14355) 9280 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:29 smithi131 bash[24745]: cluster 2024-09-14T01:55:28.884613+0000 mgr.a (mgr.14355) 9280 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:29 smithi171 bash[25040]: cluster 2024-09-14T01:55:28.884613+0000 mgr.a (mgr.14355) 9280 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:30.468 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:30.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:30.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:30.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:30.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:31 smithi131 bash[24745]: audit 2024-09-14T01:55:30.025319+0000 mgr.a (mgr.14355) 9281 : audit [DBG] from='client.206307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:31 smithi131 bash[24745]: cluster 2024-09-14T01:55:30.887178+0000 mgr.a (mgr.14355) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:55:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:31 smithi171 bash[25040]: audit 2024-09-14T01:55:30.025319+0000 mgr.a (mgr.14355) 9281 : audit [DBG] from='client.206307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:31 smithi171 bash[25040]: cluster 2024-09-14T01:55:30.887178+0000 mgr.a (mgr.14355) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:55:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:31 smithi007 bash[22722]: audit 2024-09-14T01:55:30.025319+0000 mgr.a (mgr.14355) 9281 : audit [DBG] from='client.206307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:31 smithi007 bash[22722]: cluster 2024-09-14T01:55:30.887178+0000 mgr.a (mgr.14355) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T01:55:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:33 smithi131 bash[24745]: cluster 2024-09-14T01:55:32.888004+0000 mgr.a (mgr.14355) 9283 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:33 smithi171 bash[25040]: cluster 2024-09-14T01:55:32.888004+0000 mgr.a (mgr.14355) 9283 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:33 smithi007 bash[22722]: cluster 2024-09-14T01:55:32.888004+0000 mgr.a (mgr.14355) 9283 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:35.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:36.249 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:35 smithi131 bash[24745]: cluster 2024-09-14T01:55:34.888759+0000 mgr.a (mgr.14355) 9284 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:35 smithi171 bash[25040]: cluster 2024-09-14T01:55:34.888759+0000 mgr.a (mgr.14355) 9284 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:35 smithi007 bash[22722]: cluster 2024-09-14T01:55:34.888759+0000 mgr.a (mgr.14355) 9284 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:55:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:36 smithi131 bash[24745]: audit 2024-09-14T01:55:35.804507+0000 mgr.a (mgr.14355) 9285 : audit [DBG] from='client.206382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:36 smithi171 bash[25040]: audit 2024-09-14T01:55:35.804507+0000 mgr.a (mgr.14355) 9285 : audit [DBG] from='client.206382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:36 smithi007 bash[22722]: audit 2024-09-14T01:55:35.804507+0000 mgr.a (mgr.14355) 9285 : audit [DBG] from='client.206382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:37 smithi131 bash[24745]: cluster 2024-09-14T01:55:36.891522+0000 mgr.a (mgr.14355) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:37 smithi171 bash[25040]: cluster 2024-09-14T01:55:36.891522+0000 mgr.a (mgr.14355) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:37 smithi007 bash[22722]: cluster 2024-09-14T01:55:36.891522+0000 mgr.a (mgr.14355) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:39 smithi131 bash[24745]: cluster 2024-09-14T01:55:38.892293+0000 mgr.a (mgr.14355) 9287 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:39 smithi171 bash[25040]: cluster 2024-09-14T01:55:38.892293+0000 mgr.a (mgr.14355) 9287 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:39 smithi007 bash[22722]: cluster 2024-09-14T01:55:38.892293+0000 mgr.a (mgr.14355) 9287 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:55:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:41.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:41.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:42.027 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:42.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:42.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:41 smithi131 bash[24745]: cluster 2024-09-14T01:55:40.894209+0000 mgr.a (mgr.14355) 9288 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:41 smithi171 bash[25040]: cluster 2024-09-14T01:55:40.894209+0000 mgr.a (mgr.14355) 9288 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:41 smithi007 bash[22722]: cluster 2024-09-14T01:55:40.894209+0000 mgr.a (mgr.14355) 9288 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:42 smithi131 bash[24745]: audit 2024-09-14T01:55:41.582866+0000 mgr.a (mgr.14355) 9289 : audit [DBG] from='client.206457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:42 smithi171 bash[25040]: audit 2024-09-14T01:55:41.582866+0000 mgr.a (mgr.14355) 9289 : audit [DBG] from='client.206457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:42 smithi007 bash[22722]: audit 2024-09-14T01:55:41.582866+0000 mgr.a (mgr.14355) 9289 : audit [DBG] from='client.206457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:43 smithi131 bash[24745]: cluster 2024-09-14T01:55:42.895107+0000 mgr.a (mgr.14355) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:43 smithi171 bash[25040]: cluster 2024-09-14T01:55:42.895107+0000 mgr.a (mgr.14355) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:43 smithi007 bash[22722]: cluster 2024-09-14T01:55:42.895107+0000 mgr.a (mgr.14355) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:45 smithi131 bash[24745]: cluster 2024-09-14T01:55:44.895888+0000 mgr.a (mgr.14355) 9291 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:45 smithi171 bash[25040]: cluster 2024-09-14T01:55:44.895888+0000 mgr.a (mgr.14355) 9291 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:45 smithi007 bash[22722]: cluster 2024-09-14T01:55:44.895888+0000 mgr.a (mgr.14355) 9291 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T01:55:47.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:47.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:47.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:47.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:47.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:47.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:47.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:47.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:48 smithi131 bash[24745]: cluster 2024-09-14T01:55:46.898139+0000 mgr.a (mgr.14355) 9292 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:55:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:48 smithi171 bash[25040]: cluster 2024-09-14T01:55:46.898139+0000 mgr.a (mgr.14355) 9292 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:55:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:48 smithi007 bash[22722]: cluster 2024-09-14T01:55:46.898139+0000 mgr.a (mgr.14355) 9292 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T01:55:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:49 smithi131 bash[24745]: audit 2024-09-14T01:55:47.356318+0000 mgr.a (mgr.14355) 9293 : audit [DBG] from='client.206532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:49 smithi171 bash[25040]: audit 2024-09-14T01:55:47.356318+0000 mgr.a (mgr.14355) 9293 : audit [DBG] from='client.206532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:49 smithi007 bash[22722]: audit 2024-09-14T01:55:47.356318+0000 mgr.a (mgr.14355) 9293 : audit [DBG] from='client.206532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:50 smithi131 bash[24745]: cluster 2024-09-14T01:55:48.898987+0000 mgr.a (mgr.14355) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:50 smithi171 bash[25040]: cluster 2024-09-14T01:55:48.898987+0000 mgr.a (mgr.14355) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:50 smithi007 bash[22722]: cluster 2024-09-14T01:55:48.898987+0000 mgr.a (mgr.14355) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:52 smithi131 bash[24745]: cluster 2024-09-14T01:55:50.901169+0000 mgr.a (mgr.14355) 9295 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:52 smithi171 bash[25040]: cluster 2024-09-14T01:55:50.901169+0000 mgr.a (mgr.14355) 9295 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:52 smithi007 bash[22722]: cluster 2024-09-14T01:55:50.901169+0000 mgr.a (mgr.14355) 9295 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:52.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:53 smithi131 bash[24745]: cluster 2024-09-14T01:55:52.901654+0000 mgr.a (mgr.14355) 9296 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:53 smithi171 bash[25040]: cluster 2024-09-14T01:55:52.901654+0000 mgr.a (mgr.14355) 9296 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:53 smithi007 bash[22722]: cluster 2024-09-14T01:55:52.901654+0000 mgr.a (mgr.14355) 9296 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:53.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:53.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:53.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:53.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:53.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:55:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:54 smithi131 bash[24745]: audit 2024-09-14T01:55:53.120051+0000 mgr.a (mgr.14355) 9297 : audit [DBG] from='client.206607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:54 smithi171 bash[25040]: audit 2024-09-14T01:55:53.120051+0000 mgr.a (mgr.14355) 9297 : audit [DBG] from='client.206607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:54 smithi007 bash[22722]: audit 2024-09-14T01:55:53.120051+0000 mgr.a (mgr.14355) 9297 : audit [DBG] from='client.206607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:55:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:55 smithi171 bash[25040]: cluster 2024-09-14T01:55:54.902654+0000 mgr.a (mgr.14355) 9298 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:55 smithi007 bash[22722]: cluster 2024-09-14T01:55:54.902654+0000 mgr.a (mgr.14355) 9298 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:55 smithi131 bash[24745]: cluster 2024-09-14T01:55:54.902654+0000 mgr.a (mgr.14355) 9298 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:55:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:57 smithi131 bash[24745]: cluster 2024-09-14T01:55:56.904995+0000 mgr.a (mgr.14355) 9299 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:57 smithi171 bash[25040]: cluster 2024-09-14T01:55:56.904995+0000 mgr.a (mgr.14355) 9299 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:57 smithi007 bash[22722]: cluster 2024-09-14T01:55:56.904995+0000 mgr.a (mgr.14355) 9299 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:55:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:55:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:55:58.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:55:59.349 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:55:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:55:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:55:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:55:59.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:59 smithi131 bash[24745]: audit 2024-09-14T01:55:58.906380+0000 mgr.a (mgr.14355) 9300 : audit [DBG] from='client.206679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:55:59 smithi131 bash[24745]: cluster 2024-09-14T01:55:58.907104+0000 mgr.a (mgr.14355) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:59 smithi171 bash[25040]: audit 2024-09-14T01:55:58.906380+0000 mgr.a (mgr.14355) 9300 : audit [DBG] from='client.206679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:55:59 smithi171 bash[25040]: cluster 2024-09-14T01:55:58.907104+0000 mgr.a (mgr.14355) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:59 smithi007 bash[22722]: audit 2024-09-14T01:55:58.906380+0000 mgr.a (mgr.14355) 9300 : audit [DBG] from='client.206679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:55:59 smithi007 bash[22722]: cluster 2024-09-14T01:55:58.907104+0000 mgr.a (mgr.14355) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:01 smithi131 bash[24745]: cluster 2024-09-14T01:56:00.909519+0000 mgr.a (mgr.14355) 9302 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:01 smithi171 bash[25040]: cluster 2024-09-14T01:56:00.909519+0000 mgr.a (mgr.14355) 9302 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:01 smithi007 bash[22722]: cluster 2024-09-14T01:56:00.909519+0000 mgr.a (mgr.14355) 9302 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:02 smithi131 bash[24745]: audit 2024-09-14T01:56:02.349816+0000 mon.a (mon.0) 1989 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:56:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:02 smithi171 bash[25040]: audit 2024-09-14T01:56:02.349816+0000 mon.a (mon.0) 1989 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:56:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:02 smithi007 bash[22722]: audit 2024-09-14T01:56:02.349816+0000 mon.a (mon.0) 1989 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:56:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: cluster 2024-09-14T01:56:02.910036+0000 mgr.a (mgr.14355) 9303 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:02.971715+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:02.979791+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:03.742763+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:56:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:03.744334+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:56:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:03.754186+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:03 smithi131 bash[24745]: audit 2024-09-14T01:56:03.759011+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: cluster 2024-09-14T01:56:02.910036+0000 mgr.a (mgr.14355) 9303 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:02.971715+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:02.979791+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:03.742763+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:56:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:03.744334+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:56:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:03.754186+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:03 smithi171 bash[25040]: audit 2024-09-14T01:56:03.759011+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:04.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: cluster 2024-09-14T01:56:02.910036+0000 mgr.a (mgr.14355) 9303 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:02.971715+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:02.979791+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:03.742763+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:03.744334+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:03.754186+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:56:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:03 smithi007 bash[22722]: audit 2024-09-14T01:56:03.759011+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:04.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:56:04 smithi007 bash[22972]: debug 2024-09-14T01:56:04.481+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:56:04.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:56:04 smithi007 bash[22972]: debug 2024-09-14T01:56:04.481+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:56:05.077 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:05.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:05.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:05.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:05.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:04 smithi131 bash[24745]: audit 2024-09-14T01:56:03.761241+0000 mgr.a (mgr.14355) 9304 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:04 smithi171 bash[25040]: audit 2024-09-14T01:56:03.761241+0000 mgr.a (mgr.14355) 9304 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:04 smithi007 bash[22722]: audit 2024-09-14T01:56:03.761241+0000 mgr.a (mgr.14355) 9304 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:56:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:05 smithi131 bash[24745]: audit 2024-09-14T01:56:04.482472+0000 mgr.a (mgr.14355) 9305 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:56:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:05 smithi131 bash[24745]: cephadm 2024-09-14T01:56:04.483626+0000 mgr.a (mgr.14355) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:56:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:05 smithi131 bash[24745]: audit 2024-09-14T01:56:04.665333+0000 mgr.a (mgr.14355) 9307 : audit [DBG] from='client.206862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:05 smithi131 bash[24745]: cluster 2024-09-14T01:56:04.910532+0000 mgr.a (mgr.14355) 9308 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:05 smithi171 bash[25040]: audit 2024-09-14T01:56:04.482472+0000 mgr.a (mgr.14355) 9305 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:56:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:05 smithi171 bash[25040]: cephadm 2024-09-14T01:56:04.483626+0000 mgr.a (mgr.14355) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:56:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:05 smithi171 bash[25040]: audit 2024-09-14T01:56:04.665333+0000 mgr.a (mgr.14355) 9307 : audit [DBG] from='client.206862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:05 smithi171 bash[25040]: cluster 2024-09-14T01:56:04.910532+0000 mgr.a (mgr.14355) 9308 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:05 smithi007 bash[22722]: audit 2024-09-14T01:56:04.482472+0000 mgr.a (mgr.14355) 9305 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:56:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:05 smithi007 bash[22722]: cephadm 2024-09-14T01:56:04.483626+0000 mgr.a (mgr.14355) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:56:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:05 smithi007 bash[22722]: audit 2024-09-14T01:56:04.665333+0000 mgr.a (mgr.14355) 9307 : audit [DBG] from='client.206862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:05 smithi007 bash[22722]: cluster 2024-09-14T01:56:04.910532+0000 mgr.a (mgr.14355) 9308 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:07 smithi131 bash[24745]: cluster 2024-09-14T01:56:06.912833+0000 mgr.a (mgr.14355) 9309 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:07 smithi171 bash[25040]: cluster 2024-09-14T01:56:06.912833+0000 mgr.a (mgr.14355) 9309 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:07 smithi007 bash[22722]: cluster 2024-09-14T01:56:06.912833+0000 mgr.a (mgr.14355) 9309 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:09 smithi131 bash[24745]: cluster 2024-09-14T01:56:08.913590+0000 mgr.a (mgr.14355) 9310 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:09 smithi171 bash[25040]: cluster 2024-09-14T01:56:08.913590+0000 mgr.a (mgr.14355) 9310 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:09 smithi007 bash[22722]: cluster 2024-09-14T01:56:08.913590+0000 mgr.a (mgr.14355) 9310 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:10.835 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:10.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:10.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:12 smithi131 bash[24745]: audit 2024-09-14T01:56:10.410470+0000 mgr.a (mgr.14355) 9311 : audit [DBG] from='client.206937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:12 smithi131 bash[24745]: cluster 2024-09-14T01:56:10.914983+0000 mgr.a (mgr.14355) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:12 smithi171 bash[25040]: audit 2024-09-14T01:56:10.410470+0000 mgr.a (mgr.14355) 9311 : audit [DBG] from='client.206937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:12 smithi171 bash[25040]: cluster 2024-09-14T01:56:10.914983+0000 mgr.a (mgr.14355) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:11 smithi007 bash[22722]: audit 2024-09-14T01:56:10.410470+0000 mgr.a (mgr.14355) 9311 : audit [DBG] from='client.206937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:11 smithi007 bash[22722]: cluster 2024-09-14T01:56:10.914983+0000 mgr.a (mgr.14355) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:14 smithi131 bash[24745]: cluster 2024-09-14T01:56:12.915678+0000 mgr.a (mgr.14355) 9313 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:14 smithi171 bash[25040]: cluster 2024-09-14T01:56:12.915678+0000 mgr.a (mgr.14355) 9313 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:14 smithi007 bash[22722]: cluster 2024-09-14T01:56:12.915678+0000 mgr.a (mgr.14355) 9313 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:15.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:15.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:16 smithi131 bash[24745]: cluster 2024-09-14T01:56:14.916454+0000 mgr.a (mgr.14355) 9314 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:16 smithi171 bash[25040]: cluster 2024-09-14T01:56:14.916454+0000 mgr.a (mgr.14355) 9314 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:16 smithi007 bash[22722]: cluster 2024-09-14T01:56:14.916454+0000 mgr.a (mgr.14355) 9314 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:56:16.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:18 smithi131 bash[24745]: audit 2024-09-14T01:56:16.181381+0000 mgr.a (mgr.14355) 9315 : audit [DBG] from='client.207015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:18 smithi131 bash[24745]: cluster 2024-09-14T01:56:16.919292+0000 mgr.a (mgr.14355) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:18 smithi171 bash[25040]: audit 2024-09-14T01:56:16.181381+0000 mgr.a (mgr.14355) 9315 : audit [DBG] from='client.207015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:18 smithi171 bash[25040]: cluster 2024-09-14T01:56:16.919292+0000 mgr.a (mgr.14355) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:18 smithi007 bash[22722]: audit 2024-09-14T01:56:16.181381+0000 mgr.a (mgr.14355) 9315 : audit [DBG] from='client.207015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:18 smithi007 bash[22722]: cluster 2024-09-14T01:56:16.919292+0000 mgr.a (mgr.14355) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:56:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:20 smithi131 bash[24745]: cluster 2024-09-14T01:56:18.920226+0000 mgr.a (mgr.14355) 9317 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:20 smithi171 bash[25040]: cluster 2024-09-14T01:56:18.920226+0000 mgr.a (mgr.14355) 9317 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:20 smithi007 bash[22722]: cluster 2024-09-14T01:56:18.920226+0000 mgr.a (mgr.14355) 9317 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:21.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:21.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:21.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:22 smithi131 bash[24745]: cluster 2024-09-14T01:56:20.922343+0000 mgr.a (mgr.14355) 9318 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:22 smithi171 bash[25040]: cluster 2024-09-14T01:56:20.922343+0000 mgr.a (mgr.14355) 9318 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:22.368 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:22.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:22 smithi007 bash[22722]: cluster 2024-09-14T01:56:20.922343+0000 mgr.a (mgr.14355) 9318 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:23 smithi131 bash[24745]: audit 2024-09-14T01:56:21.945426+0000 mgr.a (mgr.14355) 9319 : audit [DBG] from='client.207090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:23 smithi171 bash[25040]: audit 2024-09-14T01:56:21.945426+0000 mgr.a (mgr.14355) 9319 : audit [DBG] from='client.207090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:23 smithi007 bash[22722]: audit 2024-09-14T01:56:21.945426+0000 mgr.a (mgr.14355) 9319 : audit [DBG] from='client.207090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:24 smithi131 bash[24745]: cluster 2024-09-14T01:56:22.923204+0000 mgr.a (mgr.14355) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:24 smithi171 bash[25040]: cluster 2024-09-14T01:56:22.923204+0000 mgr.a (mgr.14355) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:24 smithi007 bash[22722]: cluster 2024-09-14T01:56:22.923204+0000 mgr.a (mgr.14355) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:25 smithi171 bash[25040]: cluster 2024-09-14T01:56:24.923963+0000 mgr.a (mgr.14355) 9321 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:25 smithi007 bash[22722]: cluster 2024-09-14T01:56:24.923963+0000 mgr.a (mgr.14355) 9321 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:25 smithi131 bash[24745]: cluster 2024-09-14T01:56:24.923963+0000 mgr.a (mgr.14355) 9321 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:27.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:27.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:28.121 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:28.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:28.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:28.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:28.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:27 smithi131 bash[24745]: cluster 2024-09-14T01:56:26.926197+0000 mgr.a (mgr.14355) 9322 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:27 smithi171 bash[25040]: cluster 2024-09-14T01:56:26.926197+0000 mgr.a (mgr.14355) 9322 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:27 smithi007 bash[22722]: cluster 2024-09-14T01:56:26.926197+0000 mgr.a (mgr.14355) 9322 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:28 smithi131 bash[24745]: audit 2024-09-14T01:56:27.699707+0000 mgr.a (mgr.14355) 9323 : audit [DBG] from='client.207168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:28 smithi171 bash[25040]: audit 2024-09-14T01:56:27.699707+0000 mgr.a (mgr.14355) 9323 : audit [DBG] from='client.207168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:28 smithi007 bash[22722]: audit 2024-09-14T01:56:27.699707+0000 mgr.a (mgr.14355) 9323 : audit [DBG] from='client.207168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:29 smithi131 bash[24745]: cluster 2024-09-14T01:56:28.927067+0000 mgr.a (mgr.14355) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:29 smithi171 bash[25040]: cluster 2024-09-14T01:56:28.927067+0000 mgr.a (mgr.14355) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:29 smithi007 bash[22722]: cluster 2024-09-14T01:56:28.927067+0000 mgr.a (mgr.14355) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:32 smithi131 bash[24745]: cluster 2024-09-14T01:56:30.929304+0000 mgr.a (mgr.14355) 9325 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:32 smithi171 bash[25040]: cluster 2024-09-14T01:56:30.929304+0000 mgr.a (mgr.14355) 9325 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:32 smithi007 bash[22722]: cluster 2024-09-14T01:56:30.929304+0000 mgr.a (mgr.14355) 9325 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:33.123 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:33.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:33.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:33.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:33.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:34 smithi131 bash[24745]: cluster 2024-09-14T01:56:32.930057+0000 mgr.a (mgr.14355) 9326 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:34 smithi171 bash[25040]: cluster 2024-09-14T01:56:32.930057+0000 mgr.a (mgr.14355) 9326 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:34 smithi007 bash[22722]: cluster 2024-09-14T01:56:32.930057+0000 mgr.a (mgr.14355) 9326 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:35 smithi131 bash[24745]: audit 2024-09-14T01:56:33.452752+0000 mgr.a (mgr.14355) 9327 : audit [DBG] from='client.207246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:35 smithi171 bash[25040]: audit 2024-09-14T01:56:33.452752+0000 mgr.a (mgr.14355) 9327 : audit [DBG] from='client.207246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:35 smithi007 bash[22722]: audit 2024-09-14T01:56:33.452752+0000 mgr.a (mgr.14355) 9327 : audit [DBG] from='client.207246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:36 smithi131 bash[24745]: cluster 2024-09-14T01:56:34.931076+0000 mgr.a (mgr.14355) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:36 smithi171 bash[25040]: cluster 2024-09-14T01:56:34.931076+0000 mgr.a (mgr.14355) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:36.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:36 smithi007 bash[22722]: cluster 2024-09-14T01:56:34.931076+0000 mgr.a (mgr.14355) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:38 smithi131 bash[24745]: cluster 2024-09-14T01:56:36.933474+0000 mgr.a (mgr.14355) 9329 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:38 smithi171 bash[25040]: cluster 2024-09-14T01:56:36.933474+0000 mgr.a (mgr.14355) 9329 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:38 smithi007 bash[22722]: cluster 2024-09-14T01:56:36.933474+0000 mgr.a (mgr.14355) 9329 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:38.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:38.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:39.659 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:40 smithi131 bash[24745]: cluster 2024-09-14T01:56:38.934273+0000 mgr.a (mgr.14355) 9330 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:40 smithi171 bash[25040]: cluster 2024-09-14T01:56:38.934273+0000 mgr.a (mgr.14355) 9330 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:40 smithi007 bash[22722]: cluster 2024-09-14T01:56:38.934273+0000 mgr.a (mgr.14355) 9330 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:41 smithi171 bash[25040]: audit 2024-09-14T01:56:39.220112+0000 mgr.a (mgr.14355) 9331 : audit [DBG] from='client.207321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:41 smithi171 bash[25040]: cluster 2024-09-14T01:56:40.936619+0000 mgr.a (mgr.14355) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:41 smithi007 bash[22722]: audit 2024-09-14T01:56:39.220112+0000 mgr.a (mgr.14355) 9331 : audit [DBG] from='client.207321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:41 smithi007 bash[22722]: cluster 2024-09-14T01:56:40.936619+0000 mgr.a (mgr.14355) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:41 smithi131 bash[24745]: audit 2024-09-14T01:56:39.220112+0000 mgr.a (mgr.14355) 9331 : audit [DBG] from='client.207321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:41 smithi131 bash[24745]: cluster 2024-09-14T01:56:40.936619+0000 mgr.a (mgr.14355) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:56:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:43 smithi131 bash[24745]: cluster 2024-09-14T01:56:42.937445+0000 mgr.a (mgr.14355) 9333 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:43 smithi171 bash[25040]: cluster 2024-09-14T01:56:42.937445+0000 mgr.a (mgr.14355) 9333 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:43 smithi007 bash[22722]: cluster 2024-09-14T01:56:42.937445+0000 mgr.a (mgr.14355) 9333 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:45.431 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:45.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:45 smithi131 bash[24745]: cluster 2024-09-14T01:56:44.938214+0000 mgr.a (mgr.14355) 9334 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:45 smithi131 bash[24745]: audit 2024-09-14T01:56:44.996846+0000 mgr.a (mgr.14355) 9335 : audit [DBG] from='client.207399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:45 smithi171 bash[25040]: cluster 2024-09-14T01:56:44.938214+0000 mgr.a (mgr.14355) 9334 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:45 smithi171 bash[25040]: audit 2024-09-14T01:56:44.996846+0000 mgr.a (mgr.14355) 9335 : audit [DBG] from='client.207399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:45 smithi007 bash[22722]: cluster 2024-09-14T01:56:44.938214+0000 mgr.a (mgr.14355) 9334 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:45 smithi007 bash[22722]: audit 2024-09-14T01:56:44.996846+0000 mgr.a (mgr.14355) 9335 : audit [DBG] from='client.207399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:48 smithi131 bash[24745]: cluster 2024-09-14T01:56:46.940684+0000 mgr.a (mgr.14355) 9336 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:56:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:48 smithi171 bash[25040]: cluster 2024-09-14T01:56:46.940684+0000 mgr.a (mgr.14355) 9336 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:56:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:48 smithi007 bash[22722]: cluster 2024-09-14T01:56:46.940684+0000 mgr.a (mgr.14355) 9336 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T01:56:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:50 smithi131 bash[24745]: cluster 2024-09-14T01:56:48.941486+0000 mgr.a (mgr.14355) 9337 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:56:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:50 smithi171 bash[25040]: cluster 2024-09-14T01:56:48.941486+0000 mgr.a (mgr.14355) 9337 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:56:50.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:50.433 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:50 smithi007 bash[22722]: cluster 2024-09-14T01:56:48.941486+0000 mgr.a (mgr.14355) 9337 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T01:56:51.209 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:51.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:51.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:51.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:51.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:52 smithi131 bash[24745]: audit 2024-09-14T01:56:50.768148+0000 mgr.a (mgr.14355) 9338 : audit [DBG] from='client.207477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:52 smithi131 bash[24745]: cluster 2024-09-14T01:56:50.943202+0000 mgr.a (mgr.14355) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:52 smithi171 bash[25040]: audit 2024-09-14T01:56:50.768148+0000 mgr.a (mgr.14355) 9338 : audit [DBG] from='client.207477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:52 smithi171 bash[25040]: cluster 2024-09-14T01:56:50.943202+0000 mgr.a (mgr.14355) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:52 smithi007 bash[22722]: audit 2024-09-14T01:56:50.768148+0000 mgr.a (mgr.14355) 9338 : audit [DBG] from='client.207477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:52 smithi007 bash[22722]: cluster 2024-09-14T01:56:50.943202+0000 mgr.a (mgr.14355) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:54 smithi131 bash[24745]: cluster 2024-09-14T01:56:52.944249+0000 mgr.a (mgr.14355) 9340 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:54 smithi171 bash[25040]: cluster 2024-09-14T01:56:52.944249+0000 mgr.a (mgr.14355) 9340 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:54 smithi007 bash[22722]: cluster 2024-09-14T01:56:52.944249+0000 mgr.a (mgr.14355) 9340 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:56:56.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:56:56.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:56:56.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:56:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:56 smithi131 bash[24745]: cluster 2024-09-14T01:56:54.945240+0000 mgr.a (mgr.14355) 9341 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:56:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:56 smithi171 bash[25040]: cluster 2024-09-14T01:56:54.945240+0000 mgr.a (mgr.14355) 9341 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:56:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:56 smithi007 bash[22722]: cluster 2024-09-14T01:56:54.945240+0000 mgr.a (mgr.14355) 9341 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:56:56.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:56:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:56:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:56:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:56:56.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:56:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:58 smithi131 bash[24745]: audit 2024-09-14T01:56:56.542887+0000 mgr.a (mgr.14355) 9342 : audit [DBG] from='client.207552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:56:58 smithi131 bash[24745]: cluster 2024-09-14T01:56:56.946836+0000 mgr.a (mgr.14355) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:58 smithi171 bash[25040]: audit 2024-09-14T01:56:56.542887+0000 mgr.a (mgr.14355) 9342 : audit [DBG] from='client.207552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:56:58 smithi171 bash[25040]: cluster 2024-09-14T01:56:56.946836+0000 mgr.a (mgr.14355) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:56:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:58 smithi007 bash[22722]: audit 2024-09-14T01:56:56.542887+0000 mgr.a (mgr.14355) 9342 : audit [DBG] from='client.207552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:56:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:56:58 smithi007 bash[22722]: cluster 2024-09-14T01:56:56.946836+0000 mgr.a (mgr.14355) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:00 smithi131 bash[24745]: cluster 2024-09-14T01:56:58.947776+0000 mgr.a (mgr.14355) 9344 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:57:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:00 smithi171 bash[25040]: cluster 2024-09-14T01:56:58.947776+0000 mgr.a (mgr.14355) 9344 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:57:00.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:00 smithi007 bash[22722]: cluster 2024-09-14T01:56:58.947776+0000 mgr.a (mgr.14355) 9344 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T01:57:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:01 smithi007 bash[22722]: cluster 2024-09-14T01:57:00.949916+0000 mgr.a (mgr.14355) 9345 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:57:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:01 smithi131 bash[24745]: cluster 2024-09-14T01:57:00.949916+0000 mgr.a (mgr.14355) 9345 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:57:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:01 smithi171 bash[25040]: cluster 2024-09-14T01:57:00.949916+0000 mgr.a (mgr.14355) 9345 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:57:01.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:01.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:01.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:02.742 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:02.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:04 smithi131 bash[24745]: audit 2024-09-14T01:57:02.329674+0000 mgr.a (mgr.14355) 9346 : audit [DBG] from='client.207630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:04 smithi131 bash[24745]: cluster 2024-09-14T01:57:02.950880+0000 mgr.a (mgr.14355) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:04 smithi171 bash[25040]: audit 2024-09-14T01:57:02.329674+0000 mgr.a (mgr.14355) 9346 : audit [DBG] from='client.207630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:04 smithi171 bash[25040]: cluster 2024-09-14T01:57:02.950880+0000 mgr.a (mgr.14355) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:04 smithi007 bash[22722]: audit 2024-09-14T01:57:02.329674+0000 mgr.a (mgr.14355) 9346 : audit [DBG] from='client.207630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:04 smithi007 bash[22722]: cluster 2024-09-14T01:57:02.950880+0000 mgr.a (mgr.14355) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:05 smithi131 bash[24745]: audit 2024-09-14T01:57:04.532008+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:57:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:05 smithi171 bash[25040]: audit 2024-09-14T01:57:04.532008+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:57:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:05 smithi007 bash[22722]: audit 2024-09-14T01:57:04.532008+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:57:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: cluster 2024-09-14T01:57:04.951652+0000 mgr.a (mgr.14355) 9348 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.152274+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.156063+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.159064+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.164277+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.820341+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.821943+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.832157+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:06 smithi131 bash[24745]: audit 2024-09-14T01:57:05.837022+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: cluster 2024-09-14T01:57:04.951652+0000 mgr.a (mgr.14355) 9348 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.152274+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.156063+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.159064+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.164277+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.820341+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.821943+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.832157+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:06 smithi171 bash[25040]: audit 2024-09-14T01:57:05.837022+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: cluster 2024-09-14T01:57:04.951652+0000 mgr.a (mgr.14355) 9348 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.152274+0000 mon.a (mon.0) 1997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.156063+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.159064+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.164277+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.820341+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:57:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.821943+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:57:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.832157+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:57:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22722]: audit 2024-09-14T01:57:05.837022+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:06.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22972]: debug 2024-09-14T01:57:06.588+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:57:06.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:57:06 smithi007 bash[22972]: debug 2024-09-14T01:57:06.588+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:57:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:07 smithi131 bash[24745]: audit 2024-09-14T01:57:05.839406+0000 mgr.a (mgr.14355) 9349 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:07 smithi171 bash[25040]: audit 2024-09-14T01:57:05.839406+0000 mgr.a (mgr.14355) 9349 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:07 smithi007 bash[22722]: audit 2024-09-14T01:57:05.839406+0000 mgr.a (mgr.14355) 9349 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:57:07.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:07.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:07.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:08 smithi131 bash[24745]: audit 2024-09-14T01:57:06.590596+0000 mgr.a (mgr.14355) 9350 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:57:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:08 smithi131 bash[24745]: cephadm 2024-09-14T01:57:06.592151+0000 mgr.a (mgr.14355) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:57:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:08 smithi131 bash[24745]: cluster 2024-09-14T01:57:06.954429+0000 mgr.a (mgr.14355) 9352 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:08 smithi171 bash[25040]: audit 2024-09-14T01:57:06.590596+0000 mgr.a (mgr.14355) 9350 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:57:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:08 smithi171 bash[25040]: cephadm 2024-09-14T01:57:06.592151+0000 mgr.a (mgr.14355) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:57:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:08 smithi171 bash[25040]: cluster 2024-09-14T01:57:06.954429+0000 mgr.a (mgr.14355) 9352 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:08 smithi007 bash[22722]: audit 2024-09-14T01:57:06.590596+0000 mgr.a (mgr.14355) 9350 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:57:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:08 smithi007 bash[22722]: cephadm 2024-09-14T01:57:06.592151+0000 mgr.a (mgr.14355) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:57:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:08 smithi007 bash[22722]: cluster 2024-09-14T01:57:06.954429+0000 mgr.a (mgr.14355) 9352 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:08.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:08.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:08.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:08.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:08.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:09 smithi007 bash[22722]: audit 2024-09-14T01:57:08.079082+0000 mgr.a (mgr.14355) 9353 : audit [DBG] from='client.207813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:09 smithi007 bash[22722]: cluster 2024-09-14T01:57:08.955422+0000 mgr.a (mgr.14355) 9354 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:09 smithi131 bash[24745]: audit 2024-09-14T01:57:08.079082+0000 mgr.a (mgr.14355) 9353 : audit [DBG] from='client.207813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:09 smithi131 bash[24745]: cluster 2024-09-14T01:57:08.955422+0000 mgr.a (mgr.14355) 9354 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:09 smithi171 bash[25040]: audit 2024-09-14T01:57:08.079082+0000 mgr.a (mgr.14355) 9353 : audit [DBG] from='client.207813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:09 smithi171 bash[25040]: cluster 2024-09-14T01:57:08.955422+0000 mgr.a (mgr.14355) 9354 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:12 smithi131 bash[24745]: cluster 2024-09-14T01:57:10.957768+0000 mgr.a (mgr.14355) 9355 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:12 smithi171 bash[25040]: cluster 2024-09-14T01:57:10.957768+0000 mgr.a (mgr.14355) 9355 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:12 smithi007 bash[22722]: cluster 2024-09-14T01:57:10.957768+0000 mgr.a (mgr.14355) 9355 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:14.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:14.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:14.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:14.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:14.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:14 smithi131 bash[24745]: cluster 2024-09-14T01:57:12.958735+0000 mgr.a (mgr.14355) 9356 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:14 smithi171 bash[25040]: cluster 2024-09-14T01:57:12.958735+0000 mgr.a (mgr.14355) 9356 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:14 smithi007 bash[22722]: cluster 2024-09-14T01:57:12.958735+0000 mgr.a (mgr.14355) 9356 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:15 smithi131 bash[24745]: audit 2024-09-14T01:57:13.838515+0000 mgr.a (mgr.14355) 9357 : audit [DBG] from='client.207891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:15 smithi171 bash[25040]: audit 2024-09-14T01:57:13.838515+0000 mgr.a (mgr.14355) 9357 : audit [DBG] from='client.207891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:15 smithi007 bash[22722]: audit 2024-09-14T01:57:13.838515+0000 mgr.a (mgr.14355) 9357 : audit [DBG] from='client.207891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:16 smithi131 bash[24745]: cluster 2024-09-14T01:57:14.959712+0000 mgr.a (mgr.14355) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:16 smithi171 bash[25040]: cluster 2024-09-14T01:57:14.959712+0000 mgr.a (mgr.14355) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:16 smithi007 bash[22722]: cluster 2024-09-14T01:57:14.959712+0000 mgr.a (mgr.14355) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:18 smithi171 bash[25040]: cluster 2024-09-14T01:57:16.961992+0000 mgr.a (mgr.14355) 9359 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:18 smithi007 bash[22722]: cluster 2024-09-14T01:57:16.961992+0000 mgr.a (mgr.14355) 9359 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:18 smithi131 bash[24745]: cluster 2024-09-14T01:57:16.961992+0000 mgr.a (mgr.14355) 9359 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:19.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:19.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:19.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:19 smithi171 bash[25040]: cluster 2024-09-14T01:57:18.962787+0000 mgr.a (mgr.14355) 9360 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:19 smithi007 bash[22722]: cluster 2024-09-14T01:57:18.962787+0000 mgr.a (mgr.14355) 9360 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:19 smithi131 bash[24745]: cluster 2024-09-14T01:57:18.962787+0000 mgr.a (mgr.14355) 9360 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:20.052 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:20.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:20.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:20 smithi171 bash[25040]: audit 2024-09-14T01:57:19.613008+0000 mgr.a (mgr.14355) 9361 : audit [DBG] from='client.207969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:20 smithi007 bash[22722]: audit 2024-09-14T01:57:19.613008+0000 mgr.a (mgr.14355) 9361 : audit [DBG] from='client.207969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:20 smithi131 bash[24745]: audit 2024-09-14T01:57:19.613008+0000 mgr.a (mgr.14355) 9361 : audit [DBG] from='client.207969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:21 smithi007 bash[22722]: cluster 2024-09-14T01:57:20.965296+0000 mgr.a (mgr.14355) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:21 smithi131 bash[24745]: cluster 2024-09-14T01:57:20.965296+0000 mgr.a (mgr.14355) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:21 smithi171 bash[25040]: cluster 2024-09-14T01:57:20.965296+0000 mgr.a (mgr.14355) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:57:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:24 smithi131 bash[24745]: cluster 2024-09-14T01:57:22.966290+0000 mgr.a (mgr.14355) 9363 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:24 smithi171 bash[25040]: cluster 2024-09-14T01:57:22.966290+0000 mgr.a (mgr.14355) 9363 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:24 smithi007 bash[22722]: cluster 2024-09-14T01:57:22.966290+0000 mgr.a (mgr.14355) 9363 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:25.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:25.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:25.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:25.799 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:25.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:26 smithi131 bash[24745]: cluster 2024-09-14T01:57:24.967225+0000 mgr.a (mgr.14355) 9364 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:26 smithi171 bash[25040]: cluster 2024-09-14T01:57:24.967225+0000 mgr.a (mgr.14355) 9364 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:26 smithi007 bash[22722]: cluster 2024-09-14T01:57:24.967225+0000 mgr.a (mgr.14355) 9364 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:27 smithi171 bash[25040]: audit 2024-09-14T01:57:25.384780+0000 mgr.a (mgr.14355) 9365 : audit [DBG] from='client.208044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:27 smithi007 bash[22722]: audit 2024-09-14T01:57:25.384780+0000 mgr.a (mgr.14355) 9365 : audit [DBG] from='client.208044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:27 smithi131 bash[24745]: audit 2024-09-14T01:57:25.384780+0000 mgr.a (mgr.14355) 9365 : audit [DBG] from='client.208044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:28 smithi171 bash[25040]: cluster 2024-09-14T01:57:26.970144+0000 mgr.a (mgr.14355) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:28 smithi007 bash[22722]: cluster 2024-09-14T01:57:26.970144+0000 mgr.a (mgr.14355) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:28 smithi131 bash[24745]: cluster 2024-09-14T01:57:26.970144+0000 mgr.a (mgr.14355) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:29 smithi007 bash[22722]: cluster 2024-09-14T01:57:28.970946+0000 mgr.a (mgr.14355) 9367 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:29 smithi131 bash[24745]: cluster 2024-09-14T01:57:28.970946+0000 mgr.a (mgr.14355) 9367 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:29 smithi171 bash[25040]: cluster 2024-09-14T01:57:28.970946+0000 mgr.a (mgr.14355) 9367 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:30.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:30.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:31.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:31.574 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:32 smithi131 bash[24745]: cluster 2024-09-14T01:57:30.972559+0000 mgr.a (mgr.14355) 9368 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:32 smithi171 bash[25040]: cluster 2024-09-14T01:57:30.972559+0000 mgr.a (mgr.14355) 9368 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:32 smithi007 bash[22722]: cluster 2024-09-14T01:57:30.972559+0000 mgr.a (mgr.14355) 9368 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:33 smithi171 bash[25040]: audit 2024-09-14T01:57:31.134046+0000 mgr.a (mgr.14355) 9369 : audit [DBG] from='client.208122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:33 smithi007 bash[22722]: audit 2024-09-14T01:57:31.134046+0000 mgr.a (mgr.14355) 9369 : audit [DBG] from='client.208122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:33 smithi131 bash[24745]: audit 2024-09-14T01:57:31.134046+0000 mgr.a (mgr.14355) 9369 : audit [DBG] from='client.208122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:34 smithi171 bash[25040]: cluster 2024-09-14T01:57:32.973482+0000 mgr.a (mgr.14355) 9370 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:34 smithi007 bash[22722]: cluster 2024-09-14T01:57:32.973482+0000 mgr.a (mgr.14355) 9370 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:34 smithi131 bash[24745]: cluster 2024-09-14T01:57:32.973482+0000 mgr.a (mgr.14355) 9370 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:57:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:35 smithi007 bash[22722]: cluster 2024-09-14T01:57:34.974251+0000 mgr.a (mgr.14355) 9371 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:57:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:35 smithi131 bash[24745]: cluster 2024-09-14T01:57:34.974251+0000 mgr.a (mgr.14355) 9371 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:57:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:35 smithi171 bash[25040]: cluster 2024-09-14T01:57:34.974251+0000 mgr.a (mgr.14355) 9371 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:57:36.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:36.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:37.358 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:37.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:38 smithi171 bash[25040]: audit 2024-09-14T01:57:36.910858+0000 mgr.a (mgr.14355) 9372 : audit [DBG] from='client.208200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:38 smithi171 bash[25040]: cluster 2024-09-14T01:57:36.977524+0000 mgr.a (mgr.14355) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:38 smithi007 bash[22722]: audit 2024-09-14T01:57:36.910858+0000 mgr.a (mgr.14355) 9372 : audit [DBG] from='client.208200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:38 smithi007 bash[22722]: cluster 2024-09-14T01:57:36.977524+0000 mgr.a (mgr.14355) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:38 smithi131 bash[24745]: audit 2024-09-14T01:57:36.910858+0000 mgr.a (mgr.14355) 9372 : audit [DBG] from='client.208200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:38 smithi131 bash[24745]: cluster 2024-09-14T01:57:36.977524+0000 mgr.a (mgr.14355) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:40 smithi171 bash[25040]: cluster 2024-09-14T01:57:38.978522+0000 mgr.a (mgr.14355) 9374 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:40 smithi007 bash[22722]: cluster 2024-09-14T01:57:38.978522+0000 mgr.a (mgr.14355) 9374 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:40 smithi131 bash[24745]: cluster 2024-09-14T01:57:38.978522+0000 mgr.a (mgr.14355) 9374 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:41 smithi007 bash[22722]: cluster 2024-09-14T01:57:40.980689+0000 mgr.a (mgr.14355) 9375 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:41 smithi131 bash[24745]: cluster 2024-09-14T01:57:40.980689+0000 mgr.a (mgr.14355) 9375 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:41 smithi171 bash[25040]: cluster 2024-09-14T01:57:40.980689+0000 mgr.a (mgr.14355) 9375 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:42.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:42.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:43.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:44 smithi171 bash[25040]: audit 2024-09-14T01:57:42.686378+0000 mgr.a (mgr.14355) 9376 : audit [DBG] from='client.208278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:44 smithi171 bash[25040]: cluster 2024-09-14T01:57:42.981153+0000 mgr.a (mgr.14355) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:44 smithi007 bash[22722]: audit 2024-09-14T01:57:42.686378+0000 mgr.a (mgr.14355) 9376 : audit [DBG] from='client.208278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:44 smithi007 bash[22722]: cluster 2024-09-14T01:57:42.981153+0000 mgr.a (mgr.14355) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:44 smithi131 bash[24745]: audit 2024-09-14T01:57:42.686378+0000 mgr.a (mgr.14355) 9376 : audit [DBG] from='client.208278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:44 smithi131 bash[24745]: cluster 2024-09-14T01:57:42.981153+0000 mgr.a (mgr.14355) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:45 smithi007 bash[22722]: cluster 2024-09-14T01:57:44.982014+0000 mgr.a (mgr.14355) 9378 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:45 smithi131 bash[24745]: cluster 2024-09-14T01:57:44.982014+0000 mgr.a (mgr.14355) 9378 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:45 smithi171 bash[25040]: cluster 2024-09-14T01:57:44.982014+0000 mgr.a (mgr.14355) 9378 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:47 smithi007 bash[22722]: cluster 2024-09-14T01:57:46.984274+0000 mgr.a (mgr.14355) 9379 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:47 smithi131 bash[24745]: cluster 2024-09-14T01:57:46.984274+0000 mgr.a (mgr.14355) 9379 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:47 smithi171 bash[25040]: cluster 2024-09-14T01:57:46.984274+0000 mgr.a (mgr.14355) 9379 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:48.864 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:48.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:49 smithi007 bash[22722]: audit 2024-09-14T01:57:48.440753+0000 mgr.a (mgr.14355) 9380 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:49 smithi007 bash[22722]: cluster 2024-09-14T01:57:48.985215+0000 mgr.a (mgr.14355) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:49 smithi131 bash[24745]: audit 2024-09-14T01:57:48.440753+0000 mgr.a (mgr.14355) 9380 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:49 smithi131 bash[24745]: cluster 2024-09-14T01:57:48.985215+0000 mgr.a (mgr.14355) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:49 smithi171 bash[25040]: audit 2024-09-14T01:57:48.440753+0000 mgr.a (mgr.14355) 9380 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:49 smithi171 bash[25040]: cluster 2024-09-14T01:57:48.985215+0000 mgr.a (mgr.14355) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:51 smithi007 bash[22722]: cluster 2024-09-14T01:57:50.987593+0000 mgr.a (mgr.14355) 9382 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:51 smithi131 bash[24745]: cluster 2024-09-14T01:57:50.987593+0000 mgr.a (mgr.14355) 9382 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:51 smithi171 bash[25040]: cluster 2024-09-14T01:57:50.987593+0000 mgr.a (mgr.14355) 9382 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:53 smithi007 bash[22722]: cluster 2024-09-14T01:57:52.988402+0000 mgr.a (mgr.14355) 9383 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:53 smithi131 bash[24745]: cluster 2024-09-14T01:57:52.988402+0000 mgr.a (mgr.14355) 9383 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:53 smithi171 bash[25040]: cluster 2024-09-14T01:57:52.988402+0000 mgr.a (mgr.14355) 9383 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:53.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:57:54.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:57:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:57:54.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:57:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:57:54.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:57:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:55 smithi007 bash[22722]: audit 2024-09-14T01:57:54.205943+0000 mgr.a (mgr.14355) 9384 : audit [DBG] from='client.208431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:55 smithi007 bash[22722]: cluster 2024-09-14T01:57:54.989347+0000 mgr.a (mgr.14355) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:55 smithi131 bash[24745]: audit 2024-09-14T01:57:54.205943+0000 mgr.a (mgr.14355) 9384 : audit [DBG] from='client.208431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:55 smithi131 bash[24745]: cluster 2024-09-14T01:57:54.989347+0000 mgr.a (mgr.14355) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:55 smithi171 bash[25040]: audit 2024-09-14T01:57:54.205943+0000 mgr.a (mgr.14355) 9384 : audit [DBG] from='client.208431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:57:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:55 smithi171 bash[25040]: cluster 2024-09-14T01:57:54.989347+0000 mgr.a (mgr.14355) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:57 smithi007 bash[22722]: cluster 2024-09-14T01:57:56.991583+0000 mgr.a (mgr.14355) 9386 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:57 smithi131 bash[24745]: cluster 2024-09-14T01:57:56.991583+0000 mgr.a (mgr.14355) 9386 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:57 smithi171 bash[25040]: cluster 2024-09-14T01:57:56.991583+0000 mgr.a (mgr.14355) 9386 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:57:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:57:59 smithi007 bash[22722]: cluster 2024-09-14T01:57:58.992364+0000 mgr.a (mgr.14355) 9387 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:57:59 smithi131 bash[24745]: cluster 2024-09-14T01:57:58.992364+0000 mgr.a (mgr.14355) 9387 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:57:59 smithi171 bash[25040]: cluster 2024-09-14T01:57:58.992364+0000 mgr.a (mgr.14355) 9387 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:57:59.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:57:59.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:57:59.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:00.379 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:00.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:00 smithi007 bash[22722]: audit 2024-09-14T01:57:59.971213+0000 mgr.a (mgr.14355) 9388 : audit [DBG] from='client.208509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:00 smithi131 bash[24745]: audit 2024-09-14T01:57:59.971213+0000 mgr.a (mgr.14355) 9388 : audit [DBG] from='client.208509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:00 smithi171 bash[25040]: audit 2024-09-14T01:57:59.971213+0000 mgr.a (mgr.14355) 9388 : audit [DBG] from='client.208509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:01 smithi007 bash[22722]: cluster 2024-09-14T01:58:00.994863+0000 mgr.a (mgr.14355) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:58:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:01 smithi131 bash[24745]: cluster 2024-09-14T01:58:00.994863+0000 mgr.a (mgr.14355) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:58:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:01 smithi171 bash[25040]: cluster 2024-09-14T01:58:00.994863+0000 mgr.a (mgr.14355) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T01:58:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:03 smithi007 bash[22722]: cluster 2024-09-14T01:58:02.995664+0000 mgr.a (mgr.14355) 9390 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:03 smithi131 bash[24745]: cluster 2024-09-14T01:58:02.995664+0000 mgr.a (mgr.14355) 9390 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:03 smithi171 bash[25040]: cluster 2024-09-14T01:58:02.995664+0000 mgr.a (mgr.14355) 9390 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:05.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:05.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:05 smithi007 bash[22722]: cluster 2024-09-14T01:58:04.996436+0000 mgr.a (mgr.14355) 9391 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:05 smithi131 bash[24745]: cluster 2024-09-14T01:58:04.996436+0000 mgr.a (mgr.14355) 9391 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:05 smithi171 bash[25040]: cluster 2024-09-14T01:58:04.996436+0000 mgr.a (mgr.14355) 9391 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T01:58:06.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:06 smithi007 bash[22722]: audit 2024-09-14T01:58:05.717642+0000 mgr.a (mgr.14355) 9392 : audit [DBG] from='client.208581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:06 smithi131 bash[24745]: audit 2024-09-14T01:58:05.717642+0000 mgr.a (mgr.14355) 9392 : audit [DBG] from='client.208581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:06 smithi171 bash[25040]: audit 2024-09-14T01:58:05.717642+0000 mgr.a (mgr.14355) 9392 : audit [DBG] from='client.208581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:07 smithi007 bash[22722]: audit 2024-09-14T01:58:06.641511+0000 mon.a (mon.0) 2005 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:58:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:07 smithi007 bash[22722]: cluster 2024-09-14T01:58:06.999179+0000 mgr.a (mgr.14355) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:07 smithi131 bash[24745]: audit 2024-09-14T01:58:06.641511+0000 mon.a (mon.0) 2005 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:58:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:07 smithi131 bash[24745]: cluster 2024-09-14T01:58:06.999179+0000 mgr.a (mgr.14355) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:07 smithi171 bash[25040]: audit 2024-09-14T01:58:06.641511+0000 mon.a (mon.0) 2005 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:58:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:07 smithi171 bash[25040]: cluster 2024-09-14T01:58:06.999179+0000 mgr.a (mgr.14355) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:08.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22972]: debug 2024-09-14T01:58:08.291+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:58:08.510 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22972]: debug 2024-09-14T01:58:08.295+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:58:08.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22722]: audit 2024-09-14T01:58:07.492769+0000 mon.a (mon.0) 2006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:58:08.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22722]: audit 2024-09-14T01:58:07.494489+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:58:08.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22722]: audit 2024-09-14T01:58:07.505521+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:58:08.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22722]: audit 2024-09-14T01:58:07.510878+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:08.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:08 smithi007 bash[22722]: audit 2024-09-14T01:58:07.513503+0000 mgr.a (mgr.14355) 9394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:08 smithi131 bash[24745]: audit 2024-09-14T01:58:07.492769+0000 mon.a (mon.0) 2006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:08 smithi131 bash[24745]: audit 2024-09-14T01:58:07.494489+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:08 smithi131 bash[24745]: audit 2024-09-14T01:58:07.505521+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:08 smithi131 bash[24745]: audit 2024-09-14T01:58:07.510878+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:08 smithi131 bash[24745]: audit 2024-09-14T01:58:07.513503+0000 mgr.a (mgr.14355) 9394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:08 smithi171 bash[25040]: audit 2024-09-14T01:58:07.492769+0000 mon.a (mon.0) 2006 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:58:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:08 smithi171 bash[25040]: audit 2024-09-14T01:58:07.494489+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:58:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:08 smithi171 bash[25040]: audit 2024-09-14T01:58:07.505521+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:58:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:08 smithi171 bash[25040]: audit 2024-09-14T01:58:07.510878+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:08 smithi171 bash[25040]: audit 2024-09-14T01:58:07.513503+0000 mgr.a (mgr.14355) 9394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:58:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:09 smithi007 bash[22722]: audit 2024-09-14T01:58:08.296680+0000 mgr.a (mgr.14355) 9395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:58:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:09 smithi007 bash[22722]: cephadm 2024-09-14T01:58:08.298509+0000 mgr.a (mgr.14355) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:58:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:09 smithi007 bash[22722]: cluster 2024-09-14T01:58:09.000114+0000 mgr.a (mgr.14355) 9397 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:09 smithi131 bash[24745]: audit 2024-09-14T01:58:08.296680+0000 mgr.a (mgr.14355) 9395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:58:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:09 smithi131 bash[24745]: cephadm 2024-09-14T01:58:08.298509+0000 mgr.a (mgr.14355) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:58:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:09 smithi131 bash[24745]: cluster 2024-09-14T01:58:09.000114+0000 mgr.a (mgr.14355) 9397 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:09 smithi171 bash[25040]: audit 2024-09-14T01:58:08.296680+0000 mgr.a (mgr.14355) 9395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:58:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:09 smithi171 bash[25040]: cephadm 2024-09-14T01:58:08.298509+0000 mgr.a (mgr.14355) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:58:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:09 smithi171 bash[25040]: cluster 2024-09-14T01:58:09.000114+0000 mgr.a (mgr.14355) 9397 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:11 smithi007 bash[22722]: cluster 2024-09-14T01:58:11.002316+0000 mgr.a (mgr.14355) 9398 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:11 smithi131 bash[24745]: cluster 2024-09-14T01:58:11.002316+0000 mgr.a (mgr.14355) 9398 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:11 smithi171 bash[25040]: cluster 2024-09-14T01:58:11.002316+0000 mgr.a (mgr.14355) 9398 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:11.952 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:11.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:11.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:12 smithi007 bash[22722]: audit 2024-09-14T01:58:11.504126+0000 mgr.a (mgr.14355) 9399 : audit [DBG] from='client.208761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:12 smithi131 bash[24745]: audit 2024-09-14T01:58:11.504126+0000 mgr.a (mgr.14355) 9399 : audit [DBG] from='client.208761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:12 smithi171 bash[25040]: audit 2024-09-14T01:58:11.504126+0000 mgr.a (mgr.14355) 9399 : audit [DBG] from='client.208761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:13 smithi007 bash[22722]: cluster 2024-09-14T01:58:13.003228+0000 mgr.a (mgr.14355) 9400 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:13 smithi131 bash[24745]: cluster 2024-09-14T01:58:13.003228+0000 mgr.a (mgr.14355) 9400 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:13 smithi171 bash[25040]: cluster 2024-09-14T01:58:13.003228+0000 mgr.a (mgr.14355) 9400 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:15 smithi007 bash[22722]: cluster 2024-09-14T01:58:15.004031+0000 mgr.a (mgr.14355) 9401 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:15 smithi131 bash[24745]: cluster 2024-09-14T01:58:15.004031+0000 mgr.a (mgr.14355) 9401 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:15 smithi171 bash[25040]: cluster 2024-09-14T01:58:15.004031+0000 mgr.a (mgr.14355) 9401 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:58:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:17 smithi007 bash[22722]: cluster 2024-09-14T01:58:17.006145+0000 mgr.a (mgr.14355) 9402 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:17 smithi131 bash[24745]: cluster 2024-09-14T01:58:17.006145+0000 mgr.a (mgr.14355) 9402 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:17 smithi171 bash[25040]: cluster 2024-09-14T01:58:17.006145+0000 mgr.a (mgr.14355) 9402 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:17.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:17.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:17.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:17.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:17.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:18 smithi007 bash[22722]: audit 2024-09-14T01:58:17.286099+0000 mgr.a (mgr.14355) 9403 : audit [DBG] from='client.208839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:18 smithi131 bash[24745]: audit 2024-09-14T01:58:17.286099+0000 mgr.a (mgr.14355) 9403 : audit [DBG] from='client.208839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:18 smithi171 bash[25040]: audit 2024-09-14T01:58:17.286099+0000 mgr.a (mgr.14355) 9403 : audit [DBG] from='client.208839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:19 smithi007 bash[22722]: cluster 2024-09-14T01:58:19.007047+0000 mgr.a (mgr.14355) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:19 smithi131 bash[24745]: cluster 2024-09-14T01:58:19.007047+0000 mgr.a (mgr.14355) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:19 smithi171 bash[25040]: cluster 2024-09-14T01:58:19.007047+0000 mgr.a (mgr.14355) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:21 smithi007 bash[22722]: cluster 2024-09-14T01:58:21.009255+0000 mgr.a (mgr.14355) 9405 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:21 smithi131 bash[24745]: cluster 2024-09-14T01:58:21.009255+0000 mgr.a (mgr.14355) 9405 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:21 smithi171 bash[25040]: cluster 2024-09-14T01:58:21.009255+0000 mgr.a (mgr.14355) 9405 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:58:22.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:23.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:23.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:23.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:23.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:23 smithi007 bash[22722]: cluster 2024-09-14T01:58:23.009968+0000 mgr.a (mgr.14355) 9406 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:23 smithi007 bash[22722]: audit 2024-09-14T01:58:23.042657+0000 mgr.a (mgr.14355) 9407 : audit [DBG] from='client.208917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:23 smithi131 bash[24745]: cluster 2024-09-14T01:58:23.009968+0000 mgr.a (mgr.14355) 9406 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:23 smithi131 bash[24745]: audit 2024-09-14T01:58:23.042657+0000 mgr.a (mgr.14355) 9407 : audit [DBG] from='client.208917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:23 smithi171 bash[25040]: cluster 2024-09-14T01:58:23.009968+0000 mgr.a (mgr.14355) 9406 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:23 smithi171 bash[25040]: audit 2024-09-14T01:58:23.042657+0000 mgr.a (mgr.14355) 9407 : audit [DBG] from='client.208917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:25 smithi007 bash[22722]: cluster 2024-09-14T01:58:25.010899+0000 mgr.a (mgr.14355) 9408 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:25 smithi131 bash[24745]: cluster 2024-09-14T01:58:25.010899+0000 mgr.a (mgr.14355) 9408 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:25 smithi171 bash[25040]: cluster 2024-09-14T01:58:25.010899+0000 mgr.a (mgr.14355) 9408 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:27 smithi007 bash[22722]: cluster 2024-09-14T01:58:27.013156+0000 mgr.a (mgr.14355) 9409 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:27 smithi131 bash[24745]: cluster 2024-09-14T01:58:27.013156+0000 mgr.a (mgr.14355) 9409 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:27 smithi171 bash[25040]: cluster 2024-09-14T01:58:27.013156+0000 mgr.a (mgr.14355) 9409 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:29.218 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:29 smithi007 bash[22722]: audit 2024-09-14T01:58:28.791049+0000 mgr.a (mgr.14355) 9410 : audit [DBG] from='client.208995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:29 smithi007 bash[22722]: cluster 2024-09-14T01:58:29.013665+0000 mgr.a (mgr.14355) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:29 smithi131 bash[24745]: audit 2024-09-14T01:58:28.791049+0000 mgr.a (mgr.14355) 9410 : audit [DBG] from='client.208995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:29 smithi131 bash[24745]: cluster 2024-09-14T01:58:29.013665+0000 mgr.a (mgr.14355) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:29 smithi171 bash[25040]: audit 2024-09-14T01:58:28.791049+0000 mgr.a (mgr.14355) 9410 : audit [DBG] from='client.208995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:29 smithi171 bash[25040]: cluster 2024-09-14T01:58:29.013665+0000 mgr.a (mgr.14355) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:31 smithi007 bash[22722]: cluster 2024-09-14T01:58:31.015912+0000 mgr.a (mgr.14355) 9412 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:31 smithi131 bash[24745]: cluster 2024-09-14T01:58:31.015912+0000 mgr.a (mgr.14355) 9412 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:31 smithi171 bash[25040]: cluster 2024-09-14T01:58:31.015912+0000 mgr.a (mgr.14355) 9412 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:33 smithi007 bash[22722]: cluster 2024-09-14T01:58:33.016692+0000 mgr.a (mgr.14355) 9413 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:33 smithi131 bash[24745]: cluster 2024-09-14T01:58:33.016692+0000 mgr.a (mgr.14355) 9413 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:33 smithi171 bash[25040]: cluster 2024-09-14T01:58:33.016692+0000 mgr.a (mgr.14355) 9413 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:34.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:35 smithi007 bash[22722]: audit 2024-09-14T01:58:34.548485+0000 mgr.a (mgr.14355) 9414 : audit [DBG] from='client.209070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:35 smithi007 bash[22722]: cluster 2024-09-14T01:58:35.017260+0000 mgr.a (mgr.14355) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:35 smithi131 bash[24745]: audit 2024-09-14T01:58:34.548485+0000 mgr.a (mgr.14355) 9414 : audit [DBG] from='client.209070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:35 smithi131 bash[24745]: cluster 2024-09-14T01:58:35.017260+0000 mgr.a (mgr.14355) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:35 smithi171 bash[25040]: audit 2024-09-14T01:58:34.548485+0000 mgr.a (mgr.14355) 9414 : audit [DBG] from='client.209070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:35 smithi171 bash[25040]: cluster 2024-09-14T01:58:35.017260+0000 mgr.a (mgr.14355) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:37 smithi007 bash[22722]: cluster 2024-09-14T01:58:37.019487+0000 mgr.a (mgr.14355) 9416 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:37 smithi131 bash[24745]: cluster 2024-09-14T01:58:37.019487+0000 mgr.a (mgr.14355) 9416 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:37 smithi171 bash[25040]: cluster 2024-09-14T01:58:37.019487+0000 mgr.a (mgr.14355) 9416 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:39 smithi007 bash[22722]: cluster 2024-09-14T01:58:39.020277+0000 mgr.a (mgr.14355) 9417 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:39 smithi131 bash[24745]: cluster 2024-09-14T01:58:39.020277+0000 mgr.a (mgr.14355) 9417 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:39 smithi171 bash[25040]: cluster 2024-09-14T01:58:39.020277+0000 mgr.a (mgr.14355) 9417 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:39.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:40.703 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:40.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:41 smithi007 bash[22722]: audit 2024-09-14T01:58:40.290444+0000 mgr.a (mgr.14355) 9418 : audit [DBG] from='client.209145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:41 smithi007 bash[22722]: cluster 2024-09-14T01:58:41.023092+0000 mgr.a (mgr.14355) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:41 smithi131 bash[24745]: audit 2024-09-14T01:58:40.290444+0000 mgr.a (mgr.14355) 9418 : audit [DBG] from='client.209145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:41 smithi131 bash[24745]: cluster 2024-09-14T01:58:41.023092+0000 mgr.a (mgr.14355) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:41 smithi171 bash[25040]: audit 2024-09-14T01:58:40.290444+0000 mgr.a (mgr.14355) 9418 : audit [DBG] from='client.209145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:41 smithi171 bash[25040]: cluster 2024-09-14T01:58:41.023092+0000 mgr.a (mgr.14355) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:43 smithi007 bash[22722]: cluster 2024-09-14T01:58:43.023857+0000 mgr.a (mgr.14355) 9420 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:43 smithi131 bash[24745]: cluster 2024-09-14T01:58:43.023857+0000 mgr.a (mgr.14355) 9420 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:43 smithi171 bash[25040]: cluster 2024-09-14T01:58:43.023857+0000 mgr.a (mgr.14355) 9420 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:45 smithi007 bash[22722]: cluster 2024-09-14T01:58:45.024617+0000 mgr.a (mgr.14355) 9421 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:58:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:45 smithi131 bash[24745]: cluster 2024-09-14T01:58:45.024617+0000 mgr.a (mgr.14355) 9421 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:58:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:45 smithi171 bash[25040]: cluster 2024-09-14T01:58:45.024617+0000 mgr.a (mgr.14355) 9421 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T01:58:45.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:45.706 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:46 smithi007 bash[22722]: audit 2024-09-14T01:58:46.036382+0000 mgr.a (mgr.14355) 9422 : audit [DBG] from='client.209217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:46.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:46.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:46 smithi131 bash[24745]: audit 2024-09-14T01:58:46.036382+0000 mgr.a (mgr.14355) 9422 : audit [DBG] from='client.209217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:46 smithi171 bash[25040]: audit 2024-09-14T01:58:46.036382+0000 mgr.a (mgr.14355) 9422 : audit [DBG] from='client.209217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:47 smithi007 bash[22722]: cluster 2024-09-14T01:58:47.027561+0000 mgr.a (mgr.14355) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:47 smithi131 bash[24745]: cluster 2024-09-14T01:58:47.027561+0000 mgr.a (mgr.14355) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:47 smithi171 bash[25040]: cluster 2024-09-14T01:58:47.027561+0000 mgr.a (mgr.14355) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:49 smithi007 bash[22722]: cluster 2024-09-14T01:58:49.028375+0000 mgr.a (mgr.14355) 9424 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:49 smithi131 bash[24745]: cluster 2024-09-14T01:58:49.028375+0000 mgr.a (mgr.14355) 9424 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:49 smithi171 bash[25040]: cluster 2024-09-14T01:58:49.028375+0000 mgr.a (mgr.14355) 9424 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:58:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:51 smithi007 bash[22722]: cluster 2024-09-14T01:58:51.030331+0000 mgr.a (mgr.14355) 9425 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:51.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:51.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:51 smithi131 bash[24745]: cluster 2024-09-14T01:58:51.030331+0000 mgr.a (mgr.14355) 9425 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:51 smithi171 bash[25040]: cluster 2024-09-14T01:58:51.030331+0000 mgr.a (mgr.14355) 9425 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:52.257 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:52.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:52 smithi007 bash[22722]: audit 2024-09-14T01:58:51.818104+0000 mgr.a (mgr.14355) 9426 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:52 smithi131 bash[24745]: audit 2024-09-14T01:58:51.818104+0000 mgr.a (mgr.14355) 9426 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:52 smithi171 bash[25040]: audit 2024-09-14T01:58:51.818104+0000 mgr.a (mgr.14355) 9426 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:53 smithi007 bash[22722]: cluster 2024-09-14T01:58:53.031233+0000 mgr.a (mgr.14355) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:53 smithi131 bash[24745]: cluster 2024-09-14T01:58:53.031233+0000 mgr.a (mgr.14355) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:53 smithi171 bash[25040]: cluster 2024-09-14T01:58:53.031233+0000 mgr.a (mgr.14355) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:55 smithi007 bash[22722]: cluster 2024-09-14T01:58:55.032015+0000 mgr.a (mgr.14355) 9428 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:55 smithi131 bash[24745]: cluster 2024-09-14T01:58:55.032015+0000 mgr.a (mgr.14355) 9428 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:55 smithi171 bash[25040]: cluster 2024-09-14T01:58:55.032015+0000 mgr.a (mgr.14355) 9428 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:57.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:58:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:58:57.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:58:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:57 smithi007 bash[22722]: cluster 2024-09-14T01:58:57.034212+0000 mgr.a (mgr.14355) 9429 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:57 smithi131 bash[24745]: cluster 2024-09-14T01:58:57.034212+0000 mgr.a (mgr.14355) 9429 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:57 smithi171 bash[25040]: cluster 2024-09-14T01:58:57.034212+0000 mgr.a (mgr.14355) 9429 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:58:58.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:58:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:58:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:58:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:58:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:58:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:58 smithi007 bash[22722]: audit 2024-09-14T01:58:57.590885+0000 mgr.a (mgr.14355) 9430 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:58 smithi131 bash[24745]: audit 2024-09-14T01:58:57.590885+0000 mgr.a (mgr.14355) 9430 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:58 smithi171 bash[25040]: audit 2024-09-14T01:58:57.590885+0000 mgr.a (mgr.14355) 9430 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:58:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:58:59 smithi007 bash[22722]: cluster 2024-09-14T01:58:59.035117+0000 mgr.a (mgr.14355) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:58:59 smithi131 bash[24745]: cluster 2024-09-14T01:58:59.035117+0000 mgr.a (mgr.14355) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:58:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:58:59 smithi171 bash[25040]: cluster 2024-09-14T01:58:59.035117+0000 mgr.a (mgr.14355) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:01 smithi007 bash[22722]: cluster 2024-09-14T01:59:01.037288+0000 mgr.a (mgr.14355) 9432 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:01 smithi131 bash[24745]: cluster 2024-09-14T01:59:01.037288+0000 mgr.a (mgr.14355) 9432 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:01 smithi171 bash[25040]: cluster 2024-09-14T01:59:01.037288+0000 mgr.a (mgr.14355) 9432 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:03.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:03.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:03.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:03 smithi007 bash[22722]: cluster 2024-09-14T01:59:03.038059+0000 mgr.a (mgr.14355) 9433 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:03 smithi131 bash[24745]: cluster 2024-09-14T01:59:03.038059+0000 mgr.a (mgr.14355) 9433 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:03 smithi171 bash[25040]: cluster 2024-09-14T01:59:03.038059+0000 mgr.a (mgr.14355) 9433 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:03.814 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:03.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:03.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:03.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:03.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:04 smithi007 bash[22722]: audit 2024-09-14T01:59:03.376003+0000 mgr.a (mgr.14355) 9434 : audit [DBG] from='client.209448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:04 smithi131 bash[24745]: audit 2024-09-14T01:59:03.376003+0000 mgr.a (mgr.14355) 9434 : audit [DBG] from='client.209448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:04 smithi171 bash[25040]: audit 2024-09-14T01:59:03.376003+0000 mgr.a (mgr.14355) 9434 : audit [DBG] from='client.209448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:05 smithi007 bash[22722]: cluster 2024-09-14T01:59:05.038996+0000 mgr.a (mgr.14355) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:05 smithi131 bash[24745]: cluster 2024-09-14T01:59:05.038996+0000 mgr.a (mgr.14355) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:05 smithi171 bash[25040]: cluster 2024-09-14T01:59:05.038996+0000 mgr.a (mgr.14355) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:07 smithi007 bash[22722]: cluster 2024-09-14T01:59:07.041219+0000 mgr.a (mgr.14355) 9436 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:07 smithi131 bash[24745]: cluster 2024-09-14T01:59:07.041219+0000 mgr.a (mgr.14355) 9436 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:07 smithi171 bash[25040]: cluster 2024-09-14T01:59:07.041219+0000 mgr.a (mgr.14355) 9436 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:08 smithi007 bash[22722]: audit 2024-09-14T01:59:08.361248+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:59:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:08 smithi131 bash[24745]: audit 2024-09-14T01:59:08.361248+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:59:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:08 smithi171 bash[25040]: audit 2024-09-14T01:59:08.361248+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T01:59:08.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:08.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:08.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:09.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:09.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:09 smithi007 bash[22722]: cluster 2024-09-14T01:59:09.041709+0000 mgr.a (mgr.14355) 9437 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:09 smithi007 bash[22722]: audit 2024-09-14T01:59:09.177206+0000 mon.a (mon.0) 2011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:59:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:09 smithi007 bash[22722]: audit 2024-09-14T01:59:09.178807+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:59:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:09 smithi007 bash[22722]: audit 2024-09-14T01:59:09.185990+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:59:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:09 smithi007 bash[22722]: audit 2024-09-14T01:59:09.189419+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:09 smithi131 bash[24745]: cluster 2024-09-14T01:59:09.041709+0000 mgr.a (mgr.14355) 9437 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:09 smithi131 bash[24745]: audit 2024-09-14T01:59:09.177206+0000 mon.a (mon.0) 2011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:09 smithi131 bash[24745]: audit 2024-09-14T01:59:09.178807+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:09 smithi131 bash[24745]: audit 2024-09-14T01:59:09.185990+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:09 smithi131 bash[24745]: audit 2024-09-14T01:59:09.189419+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:09 smithi171 bash[25040]: cluster 2024-09-14T01:59:09.041709+0000 mgr.a (mgr.14355) 9437 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:09 smithi171 bash[25040]: audit 2024-09-14T01:59:09.177206+0000 mon.a (mon.0) 2011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T01:59:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:09 smithi171 bash[25040]: audit 2024-09-14T01:59:09.178807+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T01:59:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:09 smithi171 bash[25040]: audit 2024-09-14T01:59:09.185990+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T01:59:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:09 smithi171 bash[25040]: audit 2024-09-14T01:59:09.189419+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:10 smithi007 bash[22722]: audit 2024-09-14T01:59:09.142889+0000 mgr.a (mgr.14355) 9438 : audit [DBG] from='client.209526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:10 smithi007 bash[22722]: audit 2024-09-14T01:59:09.191739+0000 mgr.a (mgr.14355) 9439 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:10.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:59:10 smithi007 bash[22972]: debug 2024-09-14T01:59:10.266+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:59:10.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 01:59:10 smithi007 bash[22972]: debug 2024-09-14T01:59:10.270+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:59:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:10 smithi131 bash[24745]: audit 2024-09-14T01:59:09.142889+0000 mgr.a (mgr.14355) 9438 : audit [DBG] from='client.209526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:10 smithi131 bash[24745]: audit 2024-09-14T01:59:09.191739+0000 mgr.a (mgr.14355) 9439 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:10 smithi171 bash[25040]: audit 2024-09-14T01:59:09.142889+0000 mgr.a (mgr.14355) 9438 : audit [DBG] from='client.209526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:10 smithi171 bash[25040]: audit 2024-09-14T01:59:09.191739+0000 mgr.a (mgr.14355) 9439 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T01:59:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:11 smithi007 bash[22722]: audit 2024-09-14T01:59:10.273306+0000 mgr.a (mgr.14355) 9440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:59:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:11 smithi007 bash[22722]: cephadm 2024-09-14T01:59:10.274784+0000 mgr.a (mgr.14355) 9441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:59:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:11 smithi007 bash[22722]: cluster 2024-09-14T01:59:11.043976+0000 mgr.a (mgr.14355) 9442 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:11 smithi131 bash[24745]: audit 2024-09-14T01:59:10.273306+0000 mgr.a (mgr.14355) 9440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:59:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:11 smithi131 bash[24745]: cephadm 2024-09-14T01:59:10.274784+0000 mgr.a (mgr.14355) 9441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:59:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:11 smithi131 bash[24745]: cluster 2024-09-14T01:59:11.043976+0000 mgr.a (mgr.14355) 9442 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:11 smithi171 bash[25040]: audit 2024-09-14T01:59:10.273306+0000 mgr.a (mgr.14355) 9440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T01:59:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:11 smithi171 bash[25040]: cephadm 2024-09-14T01:59:10.274784+0000 mgr.a (mgr.14355) 9441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T01:59:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:11 smithi171 bash[25040]: cluster 2024-09-14T01:59:11.043976+0000 mgr.a (mgr.14355) 9442 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:13 smithi007 bash[22722]: cluster 2024-09-14T01:59:13.044730+0000 mgr.a (mgr.14355) 9443 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:13 smithi131 bash[24745]: cluster 2024-09-14T01:59:13.044730+0000 mgr.a (mgr.14355) 9443 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:13 smithi171 bash[25040]: cluster 2024-09-14T01:59:13.044730+0000 mgr.a (mgr.14355) 9443 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:14.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:14.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:14.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:15.351 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:15.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:15 smithi007 bash[22722]: audit 2024-09-14T01:59:14.903541+0000 mgr.a (mgr.14355) 9444 : audit [DBG] from='client.209709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:15 smithi007 bash[22722]: cluster 2024-09-14T01:59:15.046686+0000 mgr.a (mgr.14355) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:15 smithi131 bash[24745]: audit 2024-09-14T01:59:14.903541+0000 mgr.a (mgr.14355) 9444 : audit [DBG] from='client.209709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:15 smithi131 bash[24745]: cluster 2024-09-14T01:59:15.046686+0000 mgr.a (mgr.14355) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:15 smithi171 bash[25040]: audit 2024-09-14T01:59:14.903541+0000 mgr.a (mgr.14355) 9444 : audit [DBG] from='client.209709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:15 smithi171 bash[25040]: cluster 2024-09-14T01:59:15.046686+0000 mgr.a (mgr.14355) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:17 smithi007 bash[22722]: cluster 2024-09-14T01:59:17.049133+0000 mgr.a (mgr.14355) 9446 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:17 smithi131 bash[24745]: cluster 2024-09-14T01:59:17.049133+0000 mgr.a (mgr.14355) 9446 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:17 smithi171 bash[25040]: cluster 2024-09-14T01:59:17.049133+0000 mgr.a (mgr.14355) 9446 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:19 smithi007 bash[22722]: cluster 2024-09-14T01:59:19.050063+0000 mgr.a (mgr.14355) 9447 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:59:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:19 smithi131 bash[24745]: cluster 2024-09-14T01:59:19.050063+0000 mgr.a (mgr.14355) 9447 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:59:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:19 smithi171 bash[25040]: cluster 2024-09-14T01:59:19.050063+0000 mgr.a (mgr.14355) 9447 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T01:59:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:21.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:21 smithi007 bash[22722]: audit 2024-09-14T01:59:20.686535+0000 mgr.a (mgr.14355) 9448 : audit [DBG] from='client.209787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:21 smithi007 bash[22722]: cluster 2024-09-14T01:59:21.051883+0000 mgr.a (mgr.14355) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:21 smithi131 bash[24745]: audit 2024-09-14T01:59:20.686535+0000 mgr.a (mgr.14355) 9448 : audit [DBG] from='client.209787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:21 smithi131 bash[24745]: cluster 2024-09-14T01:59:21.051883+0000 mgr.a (mgr.14355) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:21 smithi171 bash[25040]: audit 2024-09-14T01:59:20.686535+0000 mgr.a (mgr.14355) 9448 : audit [DBG] from='client.209787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:21 smithi171 bash[25040]: cluster 2024-09-14T01:59:21.051883+0000 mgr.a (mgr.14355) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T01:59:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:23 smithi007 bash[22722]: cluster 2024-09-14T01:59:23.052616+0000 mgr.a (mgr.14355) 9450 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:23 smithi131 bash[24745]: cluster 2024-09-14T01:59:23.052616+0000 mgr.a (mgr.14355) 9450 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:23 smithi171 bash[25040]: cluster 2024-09-14T01:59:23.052616+0000 mgr.a (mgr.14355) 9450 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:25 smithi007 bash[22722]: cluster 2024-09-14T01:59:25.053357+0000 mgr.a (mgr.14355) 9451 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:25 smithi131 bash[24745]: cluster 2024-09-14T01:59:25.053357+0000 mgr.a (mgr.14355) 9451 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:25 smithi171 bash[25040]: cluster 2024-09-14T01:59:25.053357+0000 mgr.a (mgr.14355) 9451 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T01:59:26.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:26.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:26.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:26.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:27 smithi007 bash[22722]: audit 2024-09-14T01:59:26.471443+0000 mgr.a (mgr.14355) 9452 : audit [DBG] from='client.209865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:27 smithi007 bash[22722]: cluster 2024-09-14T01:59:27.056173+0000 mgr.a (mgr.14355) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:27 smithi131 bash[24745]: audit 2024-09-14T01:59:26.471443+0000 mgr.a (mgr.14355) 9452 : audit [DBG] from='client.209865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:27 smithi131 bash[24745]: cluster 2024-09-14T01:59:27.056173+0000 mgr.a (mgr.14355) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:27 smithi171 bash[25040]: audit 2024-09-14T01:59:26.471443+0000 mgr.a (mgr.14355) 9452 : audit [DBG] from='client.209865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:27 smithi171 bash[25040]: cluster 2024-09-14T01:59:27.056173+0000 mgr.a (mgr.14355) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:29 smithi007 bash[22722]: cluster 2024-09-14T01:59:29.056976+0000 mgr.a (mgr.14355) 9454 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:59:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:29 smithi131 bash[24745]: cluster 2024-09-14T01:59:29.056976+0000 mgr.a (mgr.14355) 9454 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:59:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:29 smithi171 bash[25040]: cluster 2024-09-14T01:59:29.056976+0000 mgr.a (mgr.14355) 9454 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T01:59:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:31 smithi007 bash[22722]: cluster 2024-09-14T01:59:31.058941+0000 mgr.a (mgr.14355) 9455 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:59:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:31 smithi131 bash[24745]: cluster 2024-09-14T01:59:31.058941+0000 mgr.a (mgr.14355) 9455 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:59:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:31 smithi171 bash[25040]: cluster 2024-09-14T01:59:31.058941+0000 mgr.a (mgr.14355) 9455 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T01:59:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:31.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:31.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:32.678 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:32.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:32.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:33 smithi007 bash[22722]: audit 2024-09-14T01:59:32.244554+0000 mgr.a (mgr.14355) 9456 : audit [DBG] from='client.209940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:33 smithi007 bash[22722]: cluster 2024-09-14T01:59:33.059775+0000 mgr.a (mgr.14355) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:33 smithi131 bash[24745]: audit 2024-09-14T01:59:32.244554+0000 mgr.a (mgr.14355) 9456 : audit [DBG] from='client.209940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:33 smithi131 bash[24745]: cluster 2024-09-14T01:59:33.059775+0000 mgr.a (mgr.14355) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:33 smithi171 bash[25040]: audit 2024-09-14T01:59:32.244554+0000 mgr.a (mgr.14355) 9456 : audit [DBG] from='client.209940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:33 smithi171 bash[25040]: cluster 2024-09-14T01:59:33.059775+0000 mgr.a (mgr.14355) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:35 smithi007 bash[22722]: cluster 2024-09-14T01:59:35.060537+0000 mgr.a (mgr.14355) 9458 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:35 smithi131 bash[24745]: cluster 2024-09-14T01:59:35.060537+0000 mgr.a (mgr.14355) 9458 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:35 smithi171 bash[25040]: cluster 2024-09-14T01:59:35.060537+0000 mgr.a (mgr.14355) 9458 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:37 smithi007 bash[22722]: cluster 2024-09-14T01:59:37.062756+0000 mgr.a (mgr.14355) 9459 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:37 smithi131 bash[24745]: cluster 2024-09-14T01:59:37.062756+0000 mgr.a (mgr.14355) 9459 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:37 smithi171 bash[25040]: cluster 2024-09-14T01:59:37.062756+0000 mgr.a (mgr.14355) 9459 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:38.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:38 smithi007 bash[22722]: audit 2024-09-14T01:59:38.008002+0000 mgr.a (mgr.14355) 9460 : audit [DBG] from='client.210018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:38 smithi131 bash[24745]: audit 2024-09-14T01:59:38.008002+0000 mgr.a (mgr.14355) 9460 : audit [DBG] from='client.210018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:38 smithi171 bash[25040]: audit 2024-09-14T01:59:38.008002+0000 mgr.a (mgr.14355) 9460 : audit [DBG] from='client.210018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:39 smithi007 bash[22722]: cluster 2024-09-14T01:59:39.063641+0000 mgr.a (mgr.14355) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:39 smithi131 bash[24745]: cluster 2024-09-14T01:59:39.063641+0000 mgr.a (mgr.14355) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:39 smithi171 bash[25040]: cluster 2024-09-14T01:59:39.063641+0000 mgr.a (mgr.14355) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:41 smithi007 bash[22722]: cluster 2024-09-14T01:59:41.065807+0000 mgr.a (mgr.14355) 9462 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:41 smithi131 bash[24745]: cluster 2024-09-14T01:59:41.065807+0000 mgr.a (mgr.14355) 9462 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:41 smithi171 bash[25040]: cluster 2024-09-14T01:59:41.065807+0000 mgr.a (mgr.14355) 9462 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:43.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:43.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:43.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:43 smithi007 bash[22722]: cluster 2024-09-14T01:59:43.066577+0000 mgr.a (mgr.14355) 9463 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:43 smithi131 bash[24745]: cluster 2024-09-14T01:59:43.066577+0000 mgr.a (mgr.14355) 9463 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:43 smithi171 bash[25040]: cluster 2024-09-14T01:59:43.066577+0000 mgr.a (mgr.14355) 9463 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:44.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:44.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:44.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:44.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:44.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:44 smithi007 bash[22722]: audit 2024-09-14T01:59:43.765062+0000 mgr.a (mgr.14355) 9464 : audit [DBG] from='client.210090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:44 smithi131 bash[24745]: audit 2024-09-14T01:59:43.765062+0000 mgr.a (mgr.14355) 9464 : audit [DBG] from='client.210090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:44 smithi171 bash[25040]: audit 2024-09-14T01:59:43.765062+0000 mgr.a (mgr.14355) 9464 : audit [DBG] from='client.210090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:45 smithi007 bash[22722]: cluster 2024-09-14T01:59:45.067427+0000 mgr.a (mgr.14355) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:45 smithi131 bash[24745]: cluster 2024-09-14T01:59:45.067427+0000 mgr.a (mgr.14355) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:45 smithi171 bash[25040]: cluster 2024-09-14T01:59:45.067427+0000 mgr.a (mgr.14355) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:47 smithi007 bash[22722]: cluster 2024-09-14T01:59:47.069704+0000 mgr.a (mgr.14355) 9466 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:47 smithi131 bash[24745]: cluster 2024-09-14T01:59:47.069704+0000 mgr.a (mgr.14355) 9466 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:47 smithi171 bash[25040]: cluster 2024-09-14T01:59:47.069704+0000 mgr.a (mgr.14355) 9466 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:49.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:49.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:49.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:49 smithi007 bash[22722]: cluster 2024-09-14T01:59:49.070497+0000 mgr.a (mgr.14355) 9467 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:49 smithi131 bash[24745]: cluster 2024-09-14T01:59:49.070497+0000 mgr.a (mgr.14355) 9467 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:49 smithi171 bash[25040]: cluster 2024-09-14T01:59:49.070497+0000 mgr.a (mgr.14355) 9467 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:49.971 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:49.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:49.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:49.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:49.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:50 smithi007 bash[22722]: audit 2024-09-14T01:59:49.546909+0000 mgr.a (mgr.14355) 9468 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:50 smithi131 bash[24745]: audit 2024-09-14T01:59:49.546909+0000 mgr.a (mgr.14355) 9468 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:50.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:50 smithi171 bash[25040]: audit 2024-09-14T01:59:49.546909+0000 mgr.a (mgr.14355) 9468 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:51 smithi007 bash[22722]: cluster 2024-09-14T01:59:51.072872+0000 mgr.a (mgr.14355) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:51 smithi131 bash[24745]: cluster 2024-09-14T01:59:51.072872+0000 mgr.a (mgr.14355) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:51 smithi171 bash[25040]: cluster 2024-09-14T01:59:51.072872+0000 mgr.a (mgr.14355) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T01:59:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:53 smithi007 bash[22722]: cluster 2024-09-14T01:59:53.073805+0000 mgr.a (mgr.14355) 9470 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:53 smithi131 bash[24745]: cluster 2024-09-14T01:59:53.073805+0000 mgr.a (mgr.14355) 9470 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:53 smithi171 bash[25040]: cluster 2024-09-14T01:59:53.073805+0000 mgr.a (mgr.14355) 9470 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T01:59:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T01:59:54.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T01:59:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:55 smithi007 bash[22722]: cluster 2024-09-14T01:59:55.074337+0000 mgr.a (mgr.14355) 9471 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:55 smithi131 bash[24745]: cluster 2024-09-14T01:59:55.074337+0000 mgr.a (mgr.14355) 9471 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:55 smithi171 bash[25040]: cluster 2024-09-14T01:59:55.074337+0000 mgr.a (mgr.14355) 9471 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:55.718 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T01:59:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T01:59:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T01:59:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T01:59:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T01:59:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:56 smithi007 bash[22722]: audit 2024-09-14T01:59:55.304709+0000 mgr.a (mgr.14355) 9472 : audit [DBG] from='client.210240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:56 smithi131 bash[24745]: audit 2024-09-14T01:59:55.304709+0000 mgr.a (mgr.14355) 9472 : audit [DBG] from='client.210240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:56 smithi171 bash[25040]: audit 2024-09-14T01:59:55.304709+0000 mgr.a (mgr.14355) 9472 : audit [DBG] from='client.210240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T01:59:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 01:59:58 smithi007 bash[22722]: cluster 2024-09-14T01:59:57.076990+0000 mgr.a (mgr.14355) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 01:59:58 smithi131 bash[24745]: cluster 2024-09-14T01:59:57.076990+0000 mgr.a (mgr.14355) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T01:59:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 01:59:58 smithi171 bash[25040]: cluster 2024-09-14T01:59:57.076990+0000 mgr.a (mgr.14355) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:00 smithi007 bash[22722]: cluster 2024-09-14T01:59:59.077751+0000 mgr.a (mgr.14355) 9474 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:00.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:00 smithi007 bash[22722]: cluster 2024-09-14T02:00:00.000150+0000 mon.a (mon.0) 2015 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:00:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:00 smithi131 bash[24745]: cluster 2024-09-14T01:59:59.077751+0000 mgr.a (mgr.14355) 9474 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:00 smithi131 bash[24745]: cluster 2024-09-14T02:00:00.000150+0000 mon.a (mon.0) 2015 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:00:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:00 smithi171 bash[25040]: cluster 2024-09-14T01:59:59.077751+0000 mgr.a (mgr.14355) 9474 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:00 smithi171 bash[25040]: cluster 2024-09-14T02:00:00.000150+0000 mon.a (mon.0) 2015 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:00:00.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:00.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:01 smithi007 bash[22722]: audit 2024-09-14T02:00:01.052826+0000 mgr.a (mgr.14355) 9475 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:01.495 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:01.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:01.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:01.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:01.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:01 smithi131 bash[24745]: audit 2024-09-14T02:00:01.052826+0000 mgr.a (mgr.14355) 9475 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:01 smithi171 bash[25040]: audit 2024-09-14T02:00:01.052826+0000 mgr.a (mgr.14355) 9475 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:02 smithi007 bash[22722]: cluster 2024-09-14T02:00:01.080700+0000 mgr.a (mgr.14355) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:02 smithi131 bash[24745]: cluster 2024-09-14T02:00:01.080700+0000 mgr.a (mgr.14355) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:02 smithi171 bash[25040]: cluster 2024-09-14T02:00:01.080700+0000 mgr.a (mgr.14355) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:04 smithi007 bash[22722]: cluster 2024-09-14T02:00:03.081589+0000 mgr.a (mgr.14355) 9477 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:04 smithi131 bash[24745]: cluster 2024-09-14T02:00:03.081589+0000 mgr.a (mgr.14355) 9477 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:04 smithi171 bash[25040]: cluster 2024-09-14T02:00:03.081589+0000 mgr.a (mgr.14355) 9477 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:06 smithi007 bash[22722]: cluster 2024-09-14T02:00:05.082388+0000 mgr.a (mgr.14355) 9478 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:06.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:06.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:06 smithi131 bash[24745]: cluster 2024-09-14T02:00:05.082388+0000 mgr.a (mgr.14355) 9478 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:06 smithi171 bash[25040]: cluster 2024-09-14T02:00:05.082388+0000 mgr.a (mgr.14355) 9478 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:07.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:07 smithi007 bash[22722]: audit 2024-09-14T02:00:06.833579+0000 mgr.a (mgr.14355) 9479 : audit [DBG] from='client.210384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:07 smithi131 bash[24745]: audit 2024-09-14T02:00:06.833579+0000 mgr.a (mgr.14355) 9479 : audit [DBG] from='client.210384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:07.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:07 smithi171 bash[25040]: audit 2024-09-14T02:00:06.833579+0000 mgr.a (mgr.14355) 9479 : audit [DBG] from='client.210384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:08 smithi007 bash[22722]: cluster 2024-09-14T02:00:07.083727+0000 mgr.a (mgr.14355) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:08 smithi131 bash[24745]: cluster 2024-09-14T02:00:07.083727+0000 mgr.a (mgr.14355) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:08 smithi171 bash[25040]: cluster 2024-09-14T02:00:07.083727+0000 mgr.a (mgr.14355) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:10 smithi007 bash[22722]: cluster 2024-09-14T02:00:09.084556+0000 mgr.a (mgr.14355) 9481 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:10 smithi131 bash[24745]: cluster 2024-09-14T02:00:09.084556+0000 mgr.a (mgr.14355) 9481 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:10 smithi171 bash[25040]: cluster 2024-09-14T02:00:09.084556+0000 mgr.a (mgr.14355) 9481 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22722]: audit 2024-09-14T02:00:10.328185+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:00:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22722]: audit 2024-09-14T02:00:11.151667+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:00:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22722]: audit 2024-09-14T02:00:11.153572+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:00:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22722]: audit 2024-09-14T02:00:11.163931+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:00:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22722]: audit 2024-09-14T02:00:11.169214+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:11 smithi131 bash[24745]: audit 2024-09-14T02:00:10.328185+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:00:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:11 smithi131 bash[24745]: audit 2024-09-14T02:00:11.151667+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:00:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:11 smithi131 bash[24745]: audit 2024-09-14T02:00:11.153572+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:00:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:11 smithi131 bash[24745]: audit 2024-09-14T02:00:11.163931+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:00:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:11 smithi131 bash[24745]: audit 2024-09-14T02:00:11.169214+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:11 smithi171 bash[25040]: audit 2024-09-14T02:00:10.328185+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:11 smithi171 bash[25040]: audit 2024-09-14T02:00:11.151667+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:11 smithi171 bash[25040]: audit 2024-09-14T02:00:11.153572+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:11 smithi171 bash[25040]: audit 2024-09-14T02:00:11.163931+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:00:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:11 smithi171 bash[25040]: audit 2024-09-14T02:00:11.169214+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:12.187 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22972]: debug 2024-09-14T02:00:11.893+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:00:12.187 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:00:11 smithi007 bash[22972]: debug 2024-09-14T02:00:11.893+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:00:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:12 smithi007 bash[22722]: cluster 2024-09-14T02:00:11.086656+0000 mgr.a (mgr.14355) 9482 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:12 smithi007 bash[22722]: audit 2024-09-14T02:00:11.170606+0000 mgr.a (mgr.14355) 9483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:12 smithi007 bash[22722]: audit 2024-09-14T02:00:11.895520+0000 mgr.a (mgr.14355) 9484 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:00:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:12 smithi007 bash[22722]: cephadm 2024-09-14T02:00:11.896885+0000 mgr.a (mgr.14355) 9485 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:00:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:12 smithi131 bash[24745]: cluster 2024-09-14T02:00:11.086656+0000 mgr.a (mgr.14355) 9482 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:12 smithi131 bash[24745]: audit 2024-09-14T02:00:11.170606+0000 mgr.a (mgr.14355) 9483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:12 smithi131 bash[24745]: audit 2024-09-14T02:00:11.895520+0000 mgr.a (mgr.14355) 9484 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:00:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:12 smithi131 bash[24745]: cephadm 2024-09-14T02:00:11.896885+0000 mgr.a (mgr.14355) 9485 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:00:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:12 smithi171 bash[25040]: cluster 2024-09-14T02:00:11.086656+0000 mgr.a (mgr.14355) 9482 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:12 smithi171 bash[25040]: audit 2024-09-14T02:00:11.170606+0000 mgr.a (mgr.14355) 9483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:00:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:12 smithi171 bash[25040]: audit 2024-09-14T02:00:11.895520+0000 mgr.a (mgr.14355) 9484 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:00:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:12 smithi171 bash[25040]: cephadm 2024-09-14T02:00:11.896885+0000 mgr.a (mgr.14355) 9485 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:00:13.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:13.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:13.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:13.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:13.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:13 smithi007 bash[22722]: audit 2024-09-14T02:00:12.603177+0000 mgr.a (mgr.14355) 9486 : audit [DBG] from='client.210567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:13 smithi131 bash[24745]: audit 2024-09-14T02:00:12.603177+0000 mgr.a (mgr.14355) 9486 : audit [DBG] from='client.210567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:13 smithi171 bash[25040]: audit 2024-09-14T02:00:12.603177+0000 mgr.a (mgr.14355) 9486 : audit [DBG] from='client.210567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:14 smithi007 bash[22722]: cluster 2024-09-14T02:00:13.087094+0000 mgr.a (mgr.14355) 9487 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:14 smithi131 bash[24745]: cluster 2024-09-14T02:00:13.087094+0000 mgr.a (mgr.14355) 9487 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:14 smithi171 bash[25040]: cluster 2024-09-14T02:00:13.087094+0000 mgr.a (mgr.14355) 9487 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:16 smithi007 bash[22722]: cluster 2024-09-14T02:00:15.087827+0000 mgr.a (mgr.14355) 9488 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:16 smithi131 bash[24745]: cluster 2024-09-14T02:00:15.087827+0000 mgr.a (mgr.14355) 9488 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:16 smithi171 bash[25040]: cluster 2024-09-14T02:00:15.087827+0000 mgr.a (mgr.14355) 9488 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:18.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:18 smithi131 bash[24745]: cluster 2024-09-14T02:00:17.090053+0000 mgr.a (mgr.14355) 9489 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:18 smithi171 bash[25040]: cluster 2024-09-14T02:00:17.090053+0000 mgr.a (mgr.14355) 9489 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:18 smithi007 bash[22722]: cluster 2024-09-14T02:00:17.090053+0000 mgr.a (mgr.14355) 9489 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:18.794 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:18.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:19 smithi131 bash[24745]: audit 2024-09-14T02:00:18.358819+0000 mgr.a (mgr.14355) 9490 : audit [DBG] from='client.210642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:19 smithi171 bash[25040]: audit 2024-09-14T02:00:18.358819+0000 mgr.a (mgr.14355) 9490 : audit [DBG] from='client.210642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:19 smithi007 bash[22722]: audit 2024-09-14T02:00:18.358819+0000 mgr.a (mgr.14355) 9490 : audit [DBG] from='client.210642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:20 smithi131 bash[24745]: cluster 2024-09-14T02:00:19.091029+0000 mgr.a (mgr.14355) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:20 smithi171 bash[25040]: cluster 2024-09-14T02:00:19.091029+0000 mgr.a (mgr.14355) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:20 smithi007 bash[22722]: cluster 2024-09-14T02:00:19.091029+0000 mgr.a (mgr.14355) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:22 smithi131 bash[24745]: cluster 2024-09-14T02:00:21.093202+0000 mgr.a (mgr.14355) 9492 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:22 smithi171 bash[25040]: cluster 2024-09-14T02:00:21.093202+0000 mgr.a (mgr.14355) 9492 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:22 smithi007 bash[22722]: cluster 2024-09-14T02:00:21.093202+0000 mgr.a (mgr.14355) 9492 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:23.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:23.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:24 smithi131 bash[24745]: cluster 2024-09-14T02:00:23.093987+0000 mgr.a (mgr.14355) 9493 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:24 smithi171 bash[25040]: cluster 2024-09-14T02:00:23.093987+0000 mgr.a (mgr.14355) 9493 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:24.581 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:24.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:24 smithi007 bash[22722]: cluster 2024-09-14T02:00:23.093987+0000 mgr.a (mgr.14355) 9493 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:25 smithi131 bash[24745]: audit 2024-09-14T02:00:24.134046+0000 mgr.a (mgr.14355) 9494 : audit [DBG] from='client.210714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:25 smithi171 bash[25040]: audit 2024-09-14T02:00:24.134046+0000 mgr.a (mgr.14355) 9494 : audit [DBG] from='client.210714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:25 smithi007 bash[22722]: audit 2024-09-14T02:00:24.134046+0000 mgr.a (mgr.14355) 9494 : audit [DBG] from='client.210714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:26 smithi131 bash[24745]: cluster 2024-09-14T02:00:25.095103+0000 mgr.a (mgr.14355) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:26 smithi171 bash[25040]: cluster 2024-09-14T02:00:25.095103+0000 mgr.a (mgr.14355) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:26 smithi007 bash[22722]: cluster 2024-09-14T02:00:25.095103+0000 mgr.a (mgr.14355) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:28 smithi131 bash[24745]: cluster 2024-09-14T02:00:27.097438+0000 mgr.a (mgr.14355) 9496 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:28 smithi171 bash[25040]: cluster 2024-09-14T02:00:27.097438+0000 mgr.a (mgr.14355) 9496 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:28 smithi007 bash[22722]: cluster 2024-09-14T02:00:27.097438+0000 mgr.a (mgr.14355) 9496 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:00:29.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:29.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:29.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:30.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:30.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:30.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:30 smithi131 bash[24745]: cluster 2024-09-14T02:00:29.098208+0000 mgr.a (mgr.14355) 9497 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:30 smithi131 bash[24745]: audit 2024-09-14T02:00:29.917977+0000 mgr.a (mgr.14355) 9498 : audit [DBG] from='client.210792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:30 smithi171 bash[25040]: cluster 2024-09-14T02:00:29.098208+0000 mgr.a (mgr.14355) 9497 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:30 smithi171 bash[25040]: audit 2024-09-14T02:00:29.917977+0000 mgr.a (mgr.14355) 9498 : audit [DBG] from='client.210792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:30 smithi007 bash[22722]: cluster 2024-09-14T02:00:29.098208+0000 mgr.a (mgr.14355) 9497 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:30 smithi007 bash[22722]: audit 2024-09-14T02:00:29.917977+0000 mgr.a (mgr.14355) 9498 : audit [DBG] from='client.210792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:32 smithi131 bash[24745]: cluster 2024-09-14T02:00:31.100650+0000 mgr.a (mgr.14355) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:00:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:32 smithi171 bash[25040]: cluster 2024-09-14T02:00:31.100650+0000 mgr.a (mgr.14355) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:00:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:32 smithi007 bash[22722]: cluster 2024-09-14T02:00:31.100650+0000 mgr.a (mgr.14355) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:00:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:34 smithi131 bash[24745]: cluster 2024-09-14T02:00:33.101436+0000 mgr.a (mgr.14355) 9500 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:34 smithi171 bash[25040]: cluster 2024-09-14T02:00:33.101436+0000 mgr.a (mgr.14355) 9500 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:34 smithi007 bash[22722]: cluster 2024-09-14T02:00:33.101436+0000 mgr.a (mgr.14355) 9500 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:35.356 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:36.127 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:36.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:36.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:36.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:36.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:36 smithi131 bash[24745]: cluster 2024-09-14T02:00:35.102212+0000 mgr.a (mgr.14355) 9501 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:36 smithi131 bash[24745]: audit 2024-09-14T02:00:35.690340+0000 mgr.a (mgr.14355) 9502 : audit [DBG] from='client.210870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:36 smithi171 bash[25040]: cluster 2024-09-14T02:00:35.102212+0000 mgr.a (mgr.14355) 9501 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:36 smithi171 bash[25040]: audit 2024-09-14T02:00:35.690340+0000 mgr.a (mgr.14355) 9502 : audit [DBG] from='client.210870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:36 smithi007 bash[22722]: cluster 2024-09-14T02:00:35.102212+0000 mgr.a (mgr.14355) 9501 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T02:00:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:36 smithi007 bash[22722]: audit 2024-09-14T02:00:35.690340+0000 mgr.a (mgr.14355) 9502 : audit [DBG] from='client.210870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:38 smithi131 bash[24745]: cluster 2024-09-14T02:00:37.105039+0000 mgr.a (mgr.14355) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:38 smithi171 bash[25040]: cluster 2024-09-14T02:00:37.105039+0000 mgr.a (mgr.14355) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:38 smithi007 bash[22722]: cluster 2024-09-14T02:00:37.105039+0000 mgr.a (mgr.14355) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:40 smithi131 bash[24745]: cluster 2024-09-14T02:00:39.105839+0000 mgr.a (mgr.14355) 9504 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:40 smithi171 bash[25040]: cluster 2024-09-14T02:00:39.105839+0000 mgr.a (mgr.14355) 9504 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:40 smithi007 bash[22722]: cluster 2024-09-14T02:00:39.105839+0000 mgr.a (mgr.14355) 9504 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:00:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:41.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:42 smithi131 bash[24745]: cluster 2024-09-14T02:00:41.107829+0000 mgr.a (mgr.14355) 9505 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:42 smithi131 bash[24745]: audit 2024-09-14T02:00:41.462788+0000 mgr.a (mgr.14355) 9506 : audit [DBG] from='client.210948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:42 smithi171 bash[25040]: cluster 2024-09-14T02:00:41.107829+0000 mgr.a (mgr.14355) 9505 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:42 smithi171 bash[25040]: audit 2024-09-14T02:00:41.462788+0000 mgr.a (mgr.14355) 9506 : audit [DBG] from='client.210948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:42 smithi007 bash[22722]: cluster 2024-09-14T02:00:41.107829+0000 mgr.a (mgr.14355) 9505 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:42 smithi007 bash[22722]: audit 2024-09-14T02:00:41.462788+0000 mgr.a (mgr.14355) 9506 : audit [DBG] from='client.210948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:44 smithi131 bash[24745]: cluster 2024-09-14T02:00:43.108812+0000 mgr.a (mgr.14355) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:44 smithi171 bash[25040]: cluster 2024-09-14T02:00:43.108812+0000 mgr.a (mgr.14355) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:44 smithi007 bash[22722]: cluster 2024-09-14T02:00:43.108812+0000 mgr.a (mgr.14355) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:46 smithi131 bash[24745]: cluster 2024-09-14T02:00:45.109744+0000 mgr.a (mgr.14355) 9508 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:46 smithi171 bash[25040]: cluster 2024-09-14T02:00:45.109744+0000 mgr.a (mgr.14355) 9508 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:46 smithi007 bash[22722]: cluster 2024-09-14T02:00:45.109744+0000 mgr.a (mgr.14355) 9508 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:00:46.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:47.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:47.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:47.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:47.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:47.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:48 smithi131 bash[24745]: cluster 2024-09-14T02:00:47.111864+0000 mgr.a (mgr.14355) 9509 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:00:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:48 smithi131 bash[24745]: audit 2024-09-14T02:00:47.236800+0000 mgr.a (mgr.14355) 9510 : audit [DBG] from='client.211023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:48 smithi171 bash[25040]: cluster 2024-09-14T02:00:47.111864+0000 mgr.a (mgr.14355) 9509 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:00:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:48 smithi171 bash[25040]: audit 2024-09-14T02:00:47.236800+0000 mgr.a (mgr.14355) 9510 : audit [DBG] from='client.211023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:48 smithi007 bash[22722]: cluster 2024-09-14T02:00:47.111864+0000 mgr.a (mgr.14355) 9509 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:00:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:48 smithi007 bash[22722]: audit 2024-09-14T02:00:47.236800+0000 mgr.a (mgr.14355) 9510 : audit [DBG] from='client.211023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:50 smithi171 bash[25040]: cluster 2024-09-14T02:00:49.112857+0000 mgr.a (mgr.14355) 9511 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:50 smithi007 bash[22722]: cluster 2024-09-14T02:00:49.112857+0000 mgr.a (mgr.14355) 9511 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:50 smithi131 bash[24745]: cluster 2024-09-14T02:00:49.112857+0000 mgr.a (mgr.14355) 9511 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:52 smithi171 bash[25040]: cluster 2024-09-14T02:00:51.115107+0000 mgr.a (mgr.14355) 9512 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:52.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:52.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:52.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:52 smithi007 bash[22722]: cluster 2024-09-14T02:00:51.115107+0000 mgr.a (mgr.14355) 9512 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:52 smithi131 bash[24745]: cluster 2024-09-14T02:00:51.115107+0000 mgr.a (mgr.14355) 9512 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:53.385 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:53 smithi007 bash[22722]: audit 2024-09-14T02:00:52.979867+0000 mgr.a (mgr.14355) 9513 : audit [DBG] from='client.211101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:53 smithi131 bash[24745]: audit 2024-09-14T02:00:52.979867+0000 mgr.a (mgr.14355) 9513 : audit [DBG] from='client.211101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:53 smithi171 bash[25040]: audit 2024-09-14T02:00:52.979867+0000 mgr.a (mgr.14355) 9513 : audit [DBG] from='client.211101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:54 smithi007 bash[22722]: cluster 2024-09-14T02:00:53.115684+0000 mgr.a (mgr.14355) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:54 smithi131 bash[24745]: cluster 2024-09-14T02:00:53.115684+0000 mgr.a (mgr.14355) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:54 smithi171 bash[25040]: cluster 2024-09-14T02:00:53.115684+0000 mgr.a (mgr.14355) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:56 smithi007 bash[22722]: cluster 2024-09-14T02:00:55.116537+0000 mgr.a (mgr.14355) 9515 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:56 smithi131 bash[24745]: cluster 2024-09-14T02:00:55.116537+0000 mgr.a (mgr.14355) 9515 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:56 smithi171 bash[25040]: cluster 2024-09-14T02:00:55.116537+0000 mgr.a (mgr.14355) 9515 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:00:58.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:00:58.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:00:58.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:00:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:58 smithi007 bash[22722]: cluster 2024-09-14T02:00:57.118829+0000 mgr.a (mgr.14355) 9516 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:58 smithi131 bash[24745]: cluster 2024-09-14T02:00:57.118829+0000 mgr.a (mgr.14355) 9516 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:58 smithi171 bash[25040]: cluster 2024-09-14T02:00:57.118829+0000 mgr.a (mgr.14355) 9516 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:00:59.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:00:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:00:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:00:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:00:59.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:00:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:00:59 smithi007 bash[22722]: audit 2024-09-14T02:00:58.722147+0000 mgr.a (mgr.14355) 9517 : audit [DBG] from='client.211179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:00:59 smithi131 bash[24745]: audit 2024-09-14T02:00:58.722147+0000 mgr.a (mgr.14355) 9517 : audit [DBG] from='client.211179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:00:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:00:59 smithi171 bash[25040]: audit 2024-09-14T02:00:58.722147+0000 mgr.a (mgr.14355) 9517 : audit [DBG] from='client.211179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:00 smithi007 bash[22722]: cluster 2024-09-14T02:00:59.119544+0000 mgr.a (mgr.14355) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:00 smithi131 bash[24745]: cluster 2024-09-14T02:00:59.119544+0000 mgr.a (mgr.14355) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:00 smithi171 bash[25040]: cluster 2024-09-14T02:00:59.119544+0000 mgr.a (mgr.14355) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:02 smithi007 bash[22722]: cluster 2024-09-14T02:01:01.121859+0000 mgr.a (mgr.14355) 9519 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:02 smithi131 bash[24745]: cluster 2024-09-14T02:01:01.121859+0000 mgr.a (mgr.14355) 9519 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:02 smithi171 bash[25040]: cluster 2024-09-14T02:01:01.121859+0000 mgr.a (mgr.14355) 9519 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:04.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:04 smithi007 bash[22722]: cluster 2024-09-14T02:01:03.122833+0000 mgr.a (mgr.14355) 9520 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:04 smithi131 bash[24745]: cluster 2024-09-14T02:01:03.122833+0000 mgr.a (mgr.14355) 9520 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:04 smithi171 bash[25040]: cluster 2024-09-14T02:01:03.122833+0000 mgr.a (mgr.14355) 9520 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:04.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:05 smithi007 bash[22722]: audit 2024-09-14T02:01:04.511826+0000 mgr.a (mgr.14355) 9521 : audit [DBG] from='client.211254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:05 smithi131 bash[24745]: audit 2024-09-14T02:01:04.511826+0000 mgr.a (mgr.14355) 9521 : audit [DBG] from='client.211254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:05 smithi171 bash[25040]: audit 2024-09-14T02:01:04.511826+0000 mgr.a (mgr.14355) 9521 : audit [DBG] from='client.211254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:06 smithi007 bash[22722]: cluster 2024-09-14T02:01:05.123735+0000 mgr.a (mgr.14355) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:06 smithi131 bash[24745]: cluster 2024-09-14T02:01:05.123735+0000 mgr.a (mgr.14355) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:06 smithi171 bash[25040]: cluster 2024-09-14T02:01:05.123735+0000 mgr.a (mgr.14355) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:08 smithi007 bash[22722]: cluster 2024-09-14T02:01:07.125984+0000 mgr.a (mgr.14355) 9523 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:08.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:08 smithi131 bash[24745]: cluster 2024-09-14T02:01:07.125984+0000 mgr.a (mgr.14355) 9523 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:08 smithi171 bash[25040]: cluster 2024-09-14T02:01:07.125984+0000 mgr.a (mgr.14355) 9523 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:09.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:09.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:10 smithi007 bash[22722]: cluster 2024-09-14T02:01:09.126779+0000 mgr.a (mgr.14355) 9524 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:10.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:10.705 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:10 smithi131 bash[24745]: cluster 2024-09-14T02:01:09.126779+0000 mgr.a (mgr.14355) 9524 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:10 smithi171 bash[25040]: cluster 2024-09-14T02:01:09.126779+0000 mgr.a (mgr.14355) 9524 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:11 smithi007 bash[22722]: audit 2024-09-14T02:01:10.267989+0000 mgr.a (mgr.14355) 9525 : audit [DBG] from='client.211329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:11 smithi131 bash[24745]: audit 2024-09-14T02:01:10.267989+0000 mgr.a (mgr.14355) 9525 : audit [DBG] from='client.211329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:11 smithi171 bash[25040]: audit 2024-09-14T02:01:10.267989+0000 mgr.a (mgr.14355) 9525 : audit [DBG] from='client.211329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:12 smithi007 bash[22722]: cluster 2024-09-14T02:01:11.129479+0000 mgr.a (mgr.14355) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:12 smithi007 bash[22722]: audit 2024-09-14T02:01:11.952281+0000 mon.a (mon.0) 2021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:01:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:12 smithi131 bash[24745]: cluster 2024-09-14T02:01:11.129479+0000 mgr.a (mgr.14355) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:12 smithi131 bash[24745]: audit 2024-09-14T02:01:11.952281+0000 mon.a (mon.0) 2021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:01:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:12 smithi171 bash[25040]: cluster 2024-09-14T02:01:11.129479+0000 mgr.a (mgr.14355) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:12 smithi171 bash[25040]: audit 2024-09-14T02:01:11.952281+0000 mon.a (mon.0) 2021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:01:13.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22972]: debug 2024-09-14T02:01:13.516+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:01:13.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22972]: debug 2024-09-14T02:01:13.516+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:01:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22722]: audit 2024-09-14T02:01:12.774949+0000 mon.a (mon.0) 2022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:01:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22722]: audit 2024-09-14T02:01:12.776586+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:01:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22722]: audit 2024-09-14T02:01:12.786861+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:01:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22722]: audit 2024-09-14T02:01:12.790074+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:13 smithi007 bash[22722]: audit 2024-09-14T02:01:12.792466+0000 mgr.a (mgr.14355) 9527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:13 smithi131 bash[24745]: audit 2024-09-14T02:01:12.774949+0000 mon.a (mon.0) 2022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:01:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:13 smithi131 bash[24745]: audit 2024-09-14T02:01:12.776586+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:01:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:13 smithi131 bash[24745]: audit 2024-09-14T02:01:12.786861+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:01:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:13 smithi131 bash[24745]: audit 2024-09-14T02:01:12.790074+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:13 smithi131 bash[24745]: audit 2024-09-14T02:01:12.792466+0000 mgr.a (mgr.14355) 9527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:13 smithi171 bash[25040]: audit 2024-09-14T02:01:12.774949+0000 mon.a (mon.0) 2022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:01:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:13 smithi171 bash[25040]: audit 2024-09-14T02:01:12.776586+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:01:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:13 smithi171 bash[25040]: audit 2024-09-14T02:01:12.786861+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:01:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:13 smithi171 bash[25040]: audit 2024-09-14T02:01:12.790074+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:13 smithi171 bash[25040]: audit 2024-09-14T02:01:12.792466+0000 mgr.a (mgr.14355) 9527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:01:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:14 smithi171 bash[25040]: cluster 2024-09-14T02:01:13.130019+0000 mgr.a (mgr.14355) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:14 smithi171 bash[25040]: audit 2024-09-14T02:01:13.519276+0000 mgr.a (mgr.14355) 9529 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:01:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:14 smithi171 bash[25040]: cephadm 2024-09-14T02:01:13.520870+0000 mgr.a (mgr.14355) 9530 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:01:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:14 smithi007 bash[22722]: cluster 2024-09-14T02:01:13.130019+0000 mgr.a (mgr.14355) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:14 smithi007 bash[22722]: audit 2024-09-14T02:01:13.519276+0000 mgr.a (mgr.14355) 9529 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:01:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:14 smithi007 bash[22722]: cephadm 2024-09-14T02:01:13.520870+0000 mgr.a (mgr.14355) 9530 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:01:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:14 smithi131 bash[24745]: cluster 2024-09-14T02:01:13.130019+0000 mgr.a (mgr.14355) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:14 smithi131 bash[24745]: audit 2024-09-14T02:01:13.519276+0000 mgr.a (mgr.14355) 9529 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:01:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:14 smithi131 bash[24745]: cephadm 2024-09-14T02:01:13.520870+0000 mgr.a (mgr.14355) 9530 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:01:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:15.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:16.458 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:16 smithi171 bash[25040]: cluster 2024-09-14T02:01:15.130888+0000 mgr.a (mgr.14355) 9531 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:16 smithi171 bash[25040]: audit 2024-09-14T02:01:16.035842+0000 mgr.a (mgr.14355) 9532 : audit [DBG] from='client.211509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:16 smithi007 bash[22722]: cluster 2024-09-14T02:01:15.130888+0000 mgr.a (mgr.14355) 9531 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:16 smithi007 bash[22722]: audit 2024-09-14T02:01:16.035842+0000 mgr.a (mgr.14355) 9532 : audit [DBG] from='client.211509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:16 smithi131 bash[24745]: cluster 2024-09-14T02:01:15.130888+0000 mgr.a (mgr.14355) 9531 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:16 smithi131 bash[24745]: audit 2024-09-14T02:01:16.035842+0000 mgr.a (mgr.14355) 9532 : audit [DBG] from='client.211509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:18 smithi007 bash[22722]: cluster 2024-09-14T02:01:17.133767+0000 mgr.a (mgr.14355) 9533 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:18 smithi131 bash[24745]: cluster 2024-09-14T02:01:17.133767+0000 mgr.a (mgr.14355) 9533 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:18 smithi171 bash[25040]: cluster 2024-09-14T02:01:17.133767+0000 mgr.a (mgr.14355) 9533 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:20 smithi007 bash[22722]: cluster 2024-09-14T02:01:19.134601+0000 mgr.a (mgr.14355) 9534 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:01:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:20 smithi131 bash[24745]: cluster 2024-09-14T02:01:19.134601+0000 mgr.a (mgr.14355) 9534 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:01:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:20 smithi171 bash[25040]: cluster 2024-09-14T02:01:19.134601+0000 mgr.a (mgr.14355) 9534 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:01:21.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:21.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:22.239 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:22.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:22 smithi007 bash[22722]: cluster 2024-09-14T02:01:21.136611+0000 mgr.a (mgr.14355) 9535 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:22 smithi007 bash[22722]: audit 2024-09-14T02:01:21.797606+0000 mgr.a (mgr.14355) 9536 : audit [DBG] from='client.211587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:22 smithi131 bash[24745]: cluster 2024-09-14T02:01:21.136611+0000 mgr.a (mgr.14355) 9535 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:22 smithi131 bash[24745]: audit 2024-09-14T02:01:21.797606+0000 mgr.a (mgr.14355) 9536 : audit [DBG] from='client.211587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:22 smithi171 bash[25040]: cluster 2024-09-14T02:01:21.136611+0000 mgr.a (mgr.14355) 9535 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:22 smithi171 bash[25040]: audit 2024-09-14T02:01:21.797606+0000 mgr.a (mgr.14355) 9536 : audit [DBG] from='client.211587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:24 smithi007 bash[22722]: cluster 2024-09-14T02:01:23.137595+0000 mgr.a (mgr.14355) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:24 smithi131 bash[24745]: cluster 2024-09-14T02:01:23.137595+0000 mgr.a (mgr.14355) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:24 smithi171 bash[25040]: cluster 2024-09-14T02:01:23.137595+0000 mgr.a (mgr.14355) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:26 smithi007 bash[22722]: cluster 2024-09-14T02:01:25.138452+0000 mgr.a (mgr.14355) 9538 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:26 smithi131 bash[24745]: cluster 2024-09-14T02:01:25.138452+0000 mgr.a (mgr.14355) 9538 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:26 smithi171 bash[25040]: cluster 2024-09-14T02:01:25.138452+0000 mgr.a (mgr.14355) 9538 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:28.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:28.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:28 smithi007 bash[22722]: cluster 2024-09-14T02:01:27.140693+0000 mgr.a (mgr.14355) 9539 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:28 smithi007 bash[22722]: audit 2024-09-14T02:01:27.571555+0000 mgr.a (mgr.14355) 9540 : audit [DBG] from='client.211659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:28 smithi131 bash[24745]: cluster 2024-09-14T02:01:27.140693+0000 mgr.a (mgr.14355) 9539 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:28 smithi131 bash[24745]: audit 2024-09-14T02:01:27.571555+0000 mgr.a (mgr.14355) 9540 : audit [DBG] from='client.211659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:28 smithi171 bash[25040]: cluster 2024-09-14T02:01:27.140693+0000 mgr.a (mgr.14355) 9539 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:01:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:28 smithi171 bash[25040]: audit 2024-09-14T02:01:27.571555+0000 mgr.a (mgr.14355) 9540 : audit [DBG] from='client.211659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:30 smithi007 bash[22722]: cluster 2024-09-14T02:01:29.141667+0000 mgr.a (mgr.14355) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:30 smithi131 bash[24745]: cluster 2024-09-14T02:01:29.141667+0000 mgr.a (mgr.14355) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:30 smithi171 bash[25040]: cluster 2024-09-14T02:01:29.141667+0000 mgr.a (mgr.14355) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:33.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:33.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:33.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:32 smithi007 bash[22722]: cluster 2024-09-14T02:01:31.144035+0000 mgr.a (mgr.14355) 9542 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:32 smithi131 bash[24745]: cluster 2024-09-14T02:01:31.144035+0000 mgr.a (mgr.14355) 9542 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:32 smithi171 bash[25040]: cluster 2024-09-14T02:01:31.144035+0000 mgr.a (mgr.14355) 9542 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:33.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:34 smithi007 bash[22722]: cluster 2024-09-14T02:01:33.144587+0000 mgr.a (mgr.14355) 9543 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:34 smithi007 bash[22722]: audit 2024-09-14T02:01:33.345501+0000 mgr.a (mgr.14355) 9544 : audit [DBG] from='client.211734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:34 smithi131 bash[24745]: cluster 2024-09-14T02:01:33.144587+0000 mgr.a (mgr.14355) 9543 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:34 smithi131 bash[24745]: audit 2024-09-14T02:01:33.345501+0000 mgr.a (mgr.14355) 9544 : audit [DBG] from='client.211734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:34 smithi171 bash[25040]: cluster 2024-09-14T02:01:33.144587+0000 mgr.a (mgr.14355) 9543 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:34 smithi171 bash[25040]: audit 2024-09-14T02:01:33.345501+0000 mgr.a (mgr.14355) 9544 : audit [DBG] from='client.211734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:36 smithi007 bash[22722]: cluster 2024-09-14T02:01:35.145446+0000 mgr.a (mgr.14355) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:36 smithi131 bash[24745]: cluster 2024-09-14T02:01:35.145446+0000 mgr.a (mgr.14355) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:36 smithi171 bash[25040]: cluster 2024-09-14T02:01:35.145446+0000 mgr.a (mgr.14355) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:38.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:38.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:38.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:38 smithi007 bash[22722]: cluster 2024-09-14T02:01:37.147733+0000 mgr.a (mgr.14355) 9546 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:38 smithi131 bash[24745]: cluster 2024-09-14T02:01:37.147733+0000 mgr.a (mgr.14355) 9546 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:38 smithi171 bash[25040]: cluster 2024-09-14T02:01:37.147733+0000 mgr.a (mgr.14355) 9546 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:39.540 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:39.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:40 smithi007 bash[22722]: audit 2024-09-14T02:01:39.114770+0000 mgr.a (mgr.14355) 9547 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:40 smithi007 bash[22722]: cluster 2024-09-14T02:01:39.148656+0000 mgr.a (mgr.14355) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:40 smithi131 bash[24745]: audit 2024-09-14T02:01:39.114770+0000 mgr.a (mgr.14355) 9547 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:40 smithi131 bash[24745]: cluster 2024-09-14T02:01:39.148656+0000 mgr.a (mgr.14355) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:40 smithi171 bash[25040]: audit 2024-09-14T02:01:39.114770+0000 mgr.a (mgr.14355) 9547 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:40 smithi171 bash[25040]: cluster 2024-09-14T02:01:39.148656+0000 mgr.a (mgr.14355) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:42 smithi007 bash[22722]: cluster 2024-09-14T02:01:41.151011+0000 mgr.a (mgr.14355) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:42 smithi131 bash[24745]: cluster 2024-09-14T02:01:41.151011+0000 mgr.a (mgr.14355) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:42 smithi171 bash[25040]: cluster 2024-09-14T02:01:41.151011+0000 mgr.a (mgr.14355) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:44.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:44.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:44.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:44 smithi007 bash[22722]: cluster 2024-09-14T02:01:43.151810+0000 mgr.a (mgr.14355) 9550 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:44 smithi131 bash[24745]: cluster 2024-09-14T02:01:43.151810+0000 mgr.a (mgr.14355) 9550 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:45.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:45.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:45.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:45.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:45.294 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:44 smithi171 bash[25040]: cluster 2024-09-14T02:01:43.151810+0000 mgr.a (mgr.14355) 9550 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:45 smithi007 bash[22722]: audit 2024-09-14T02:01:44.872751+0000 mgr.a (mgr.14355) 9551 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:45 smithi131 bash[24745]: audit 2024-09-14T02:01:44.872751+0000 mgr.a (mgr.14355) 9551 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:45 smithi171 bash[25040]: audit 2024-09-14T02:01:44.872751+0000 mgr.a (mgr.14355) 9551 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:46 smithi007 bash[22722]: cluster 2024-09-14T02:01:45.152370+0000 mgr.a (mgr.14355) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:46 smithi131 bash[24745]: cluster 2024-09-14T02:01:45.152370+0000 mgr.a (mgr.14355) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:46 smithi171 bash[25040]: cluster 2024-09-14T02:01:45.152370+0000 mgr.a (mgr.14355) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:48 smithi007 bash[22722]: cluster 2024-09-14T02:01:47.154745+0000 mgr.a (mgr.14355) 9553 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:48 smithi131 bash[24745]: cluster 2024-09-14T02:01:47.154745+0000 mgr.a (mgr.14355) 9553 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:48 smithi171 bash[25040]: cluster 2024-09-14T02:01:47.154745+0000 mgr.a (mgr.14355) 9553 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:01:50.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:50.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:51.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:50 smithi007 bash[22722]: cluster 2024-09-14T02:01:49.155532+0000 mgr.a (mgr.14355) 9554 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:50 smithi131 bash[24745]: cluster 2024-09-14T02:01:49.155532+0000 mgr.a (mgr.14355) 9554 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:50 smithi171 bash[25040]: cluster 2024-09-14T02:01:49.155532+0000 mgr.a (mgr.14355) 9554 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:51 smithi007 bash[22722]: audit 2024-09-14T02:01:50.624053+0000 mgr.a (mgr.14355) 9555 : audit [DBG] from='client.211962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:51 smithi131 bash[24745]: audit 2024-09-14T02:01:50.624053+0000 mgr.a (mgr.14355) 9555 : audit [DBG] from='client.211962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:51 smithi171 bash[25040]: audit 2024-09-14T02:01:50.624053+0000 mgr.a (mgr.14355) 9555 : audit [DBG] from='client.211962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:52 smithi007 bash[22722]: cluster 2024-09-14T02:01:51.158269+0000 mgr.a (mgr.14355) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:52 smithi131 bash[24745]: cluster 2024-09-14T02:01:51.158269+0000 mgr.a (mgr.14355) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:52 smithi171 bash[25040]: cluster 2024-09-14T02:01:51.158269+0000 mgr.a (mgr.14355) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:54 smithi007 bash[22722]: cluster 2024-09-14T02:01:53.159078+0000 mgr.a (mgr.14355) 9557 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:54 smithi131 bash[24745]: cluster 2024-09-14T02:01:53.159078+0000 mgr.a (mgr.14355) 9557 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:54 smithi171 bash[25040]: cluster 2024-09-14T02:01:53.159078+0000 mgr.a (mgr.14355) 9557 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:01:56.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:01:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:01:56.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:01:56.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:01:56.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:01:56.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:01:56.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:01:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:56 smithi007 bash[22722]: cluster 2024-09-14T02:01:55.159891+0000 mgr.a (mgr.14355) 9558 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:56 smithi131 bash[24745]: cluster 2024-09-14T02:01:55.159891+0000 mgr.a (mgr.14355) 9558 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:56 smithi171 bash[25040]: cluster 2024-09-14T02:01:55.159891+0000 mgr.a (mgr.14355) 9558 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:01:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:57 smithi007 bash[22722]: audit 2024-09-14T02:01:56.401026+0000 mgr.a (mgr.14355) 9559 : audit [DBG] from='client.212040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:57 smithi131 bash[24745]: audit 2024-09-14T02:01:56.401026+0000 mgr.a (mgr.14355) 9559 : audit [DBG] from='client.212040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:57 smithi171 bash[25040]: audit 2024-09-14T02:01:56.401026+0000 mgr.a (mgr.14355) 9559 : audit [DBG] from='client.212040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:01:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:01:58 smithi007 bash[22722]: cluster 2024-09-14T02:01:57.162750+0000 mgr.a (mgr.14355) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:01:58 smithi131 bash[24745]: cluster 2024-09-14T02:01:57.162750+0000 mgr.a (mgr.14355) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:01:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:01:58 smithi171 bash[25040]: cluster 2024-09-14T02:01:57.162750+0000 mgr.a (mgr.14355) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:00 smithi007 bash[22722]: cluster 2024-09-14T02:01:59.163540+0000 mgr.a (mgr.14355) 9561 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:02:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:00 smithi131 bash[24745]: cluster 2024-09-14T02:01:59.163540+0000 mgr.a (mgr.14355) 9561 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:02:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:00 smithi171 bash[25040]: cluster 2024-09-14T02:01:59.163540+0000 mgr.a (mgr.14355) 9561 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:02:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:02.610 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:02.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:02.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:02 smithi007 bash[22722]: cluster 2024-09-14T02:02:01.165546+0000 mgr.a (mgr.14355) 9562 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:02 smithi131 bash[24745]: cluster 2024-09-14T02:02:01.165546+0000 mgr.a (mgr.14355) 9562 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:02 smithi171 bash[25040]: cluster 2024-09-14T02:02:01.165546+0000 mgr.a (mgr.14355) 9562 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:03 smithi007 bash[22722]: audit 2024-09-14T02:02:02.186253+0000 mgr.a (mgr.14355) 9563 : audit [DBG] from='client.212115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:03 smithi131 bash[24745]: audit 2024-09-14T02:02:02.186253+0000 mgr.a (mgr.14355) 9563 : audit [DBG] from='client.212115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:03 smithi171 bash[25040]: audit 2024-09-14T02:02:02.186253+0000 mgr.a (mgr.14355) 9563 : audit [DBG] from='client.212115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:04 smithi007 bash[22722]: cluster 2024-09-14T02:02:03.166526+0000 mgr.a (mgr.14355) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:04 smithi131 bash[24745]: cluster 2024-09-14T02:02:03.166526+0000 mgr.a (mgr.14355) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:04 smithi171 bash[25040]: cluster 2024-09-14T02:02:03.166526+0000 mgr.a (mgr.14355) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:06 smithi007 bash[22722]: cluster 2024-09-14T02:02:05.167313+0000 mgr.a (mgr.14355) 9565 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:06 smithi131 bash[24745]: cluster 2024-09-14T02:02:05.167313+0000 mgr.a (mgr.14355) 9565 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:06 smithi171 bash[25040]: cluster 2024-09-14T02:02:05.167313+0000 mgr.a (mgr.14355) 9565 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:07.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:07.612 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:08.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:08.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:08 smithi007 bash[22722]: cluster 2024-09-14T02:02:07.169561+0000 mgr.a (mgr.14355) 9566 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:08 smithi007 bash[22722]: audit 2024-09-14T02:02:07.946442+0000 mgr.a (mgr.14355) 9567 : audit [DBG] from='client.212190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:08 smithi131 bash[24745]: cluster 2024-09-14T02:02:07.169561+0000 mgr.a (mgr.14355) 9566 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:08 smithi131 bash[24745]: audit 2024-09-14T02:02:07.946442+0000 mgr.a (mgr.14355) 9567 : audit [DBG] from='client.212190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:08 smithi171 bash[25040]: cluster 2024-09-14T02:02:07.169561+0000 mgr.a (mgr.14355) 9566 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:08 smithi171 bash[25040]: audit 2024-09-14T02:02:07.946442+0000 mgr.a (mgr.14355) 9567 : audit [DBG] from='client.212190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:10 smithi007 bash[22722]: cluster 2024-09-14T02:02:09.170578+0000 mgr.a (mgr.14355) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:10 smithi131 bash[24745]: cluster 2024-09-14T02:02:09.170578+0000 mgr.a (mgr.14355) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:10 smithi171 bash[25040]: cluster 2024-09-14T02:02:09.170578+0000 mgr.a (mgr.14355) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:02:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:12 smithi007 bash[22722]: cluster 2024-09-14T02:02:11.172942+0000 mgr.a (mgr.14355) 9569 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:12 smithi131 bash[24745]: cluster 2024-09-14T02:02:11.172942+0000 mgr.a (mgr.14355) 9569 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:12 smithi171 bash[25040]: cluster 2024-09-14T02:02:11.172942+0000 mgr.a (mgr.14355) 9569 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:02:13.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:13.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:14.159 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:14.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:14.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:13 smithi131 bash[24745]: audit 2024-09-14T02:02:13.574008+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:02:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:13 smithi171 bash[25040]: audit 2024-09-14T02:02:13.574008+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:02:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:13 smithi007 bash[22722]: audit 2024-09-14T02:02:13.574008+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:02:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:14 smithi131 bash[24745]: cluster 2024-09-14T02:02:13.173714+0000 mgr.a (mgr.14355) 9570 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:14 smithi131 bash[24745]: audit 2024-09-14T02:02:13.730945+0000 mgr.a (mgr.14355) 9571 : audit [DBG] from='client.212265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:14 smithi171 bash[25040]: cluster 2024-09-14T02:02:13.173714+0000 mgr.a (mgr.14355) 9570 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:14 smithi171 bash[25040]: audit 2024-09-14T02:02:13.730945+0000 mgr.a (mgr.14355) 9571 : audit [DBG] from='client.212265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:14 smithi007 bash[22722]: cluster 2024-09-14T02:02:13.173714+0000 mgr.a (mgr.14355) 9570 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:14 smithi007 bash[22722]: audit 2024-09-14T02:02:13.730945+0000 mgr.a (mgr.14355) 9571 : audit [DBG] from='client.212265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:16 smithi131 bash[24745]: cluster 2024-09-14T02:02:15.174515+0000 mgr.a (mgr.14355) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:16 smithi171 bash[25040]: cluster 2024-09-14T02:02:15.174515+0000 mgr.a (mgr.14355) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:16 smithi007 bash[22722]: cluster 2024-09-14T02:02:15.174515+0000 mgr.a (mgr.14355) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:19.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:19.161 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:19.161 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:18 smithi131 bash[24745]: cluster 2024-09-14T02:02:17.177286+0000 mgr.a (mgr.14355) 9573 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:18 smithi131 bash[24745]: audit 2024-09-14T02:02:18.905816+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:18 smithi131 bash[24745]: audit 2024-09-14T02:02:18.914259+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:18 smithi131 bash[24745]: audit 2024-09-14T02:02:18.939397+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:18 smithi131 bash[24745]: audit 2024-09-14T02:02:18.946725+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:18 smithi171 bash[25040]: cluster 2024-09-14T02:02:17.177286+0000 mgr.a (mgr.14355) 9573 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:18 smithi171 bash[25040]: audit 2024-09-14T02:02:18.905816+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:18 smithi171 bash[25040]: audit 2024-09-14T02:02:18.914259+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:18 smithi171 bash[25040]: audit 2024-09-14T02:02:18.939397+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:18 smithi171 bash[25040]: audit 2024-09-14T02:02:18.946725+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:18 smithi007 bash[22722]: cluster 2024-09-14T02:02:17.177286+0000 mgr.a (mgr.14355) 9573 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:02:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:18 smithi007 bash[22722]: audit 2024-09-14T02:02:18.905816+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:18 smithi007 bash[22722]: audit 2024-09-14T02:02:18.914259+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:18 smithi007 bash[22722]: audit 2024-09-14T02:02:18.939397+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:18 smithi007 bash[22722]: audit 2024-09-14T02:02:18.946725+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:19.940 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:19.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:18.968705+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:18.979486+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:19.757072+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:02:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:19.758005+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:02:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:19.763648+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:19 smithi131 bash[24745]: audit 2024-09-14T02:02:19.766002+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:18.968705+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:18.979486+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:19.757072+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:19.758005+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:19.763648+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:19 smithi171 bash[25040]: audit 2024-09-14T02:02:19.766002+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:18.968705+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:18.979486+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:19.757072+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:02:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:19.758005+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:02:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:19.763648+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:02:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:19 smithi007 bash[22722]: audit 2024-09-14T02:02:19.766002+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:02:20 smithi007 bash[22972]: debug 2024-09-14T02:02:20.635+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:02:20.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:02:20 smithi007 bash[22972]: debug 2024-09-14T02:02:20.635+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:02:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:20 smithi131 bash[24745]: cluster 2024-09-14T02:02:19.178062+0000 mgr.a (mgr.14355) 9574 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:02:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:20 smithi131 bash[24745]: audit 2024-09-14T02:02:19.489111+0000 mgr.a (mgr.14355) 9575 : audit [DBG] from='client.212340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:20 smithi131 bash[24745]: audit 2024-09-14T02:02:19.767270+0000 mgr.a (mgr.14355) 9576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:20 smithi171 bash[25040]: cluster 2024-09-14T02:02:19.178062+0000 mgr.a (mgr.14355) 9574 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:02:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:20 smithi171 bash[25040]: audit 2024-09-14T02:02:19.489111+0000 mgr.a (mgr.14355) 9575 : audit [DBG] from='client.212340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:20 smithi171 bash[25040]: audit 2024-09-14T02:02:19.767270+0000 mgr.a (mgr.14355) 9576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:20 smithi007 bash[22722]: cluster 2024-09-14T02:02:19.178062+0000 mgr.a (mgr.14355) 9574 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:02:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:20 smithi007 bash[22722]: audit 2024-09-14T02:02:19.489111+0000 mgr.a (mgr.14355) 9575 : audit [DBG] from='client.212340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:20 smithi007 bash[22722]: audit 2024-09-14T02:02:19.767270+0000 mgr.a (mgr.14355) 9576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:02:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:21 smithi131 bash[24745]: audit 2024-09-14T02:02:20.640809+0000 mgr.a (mgr.14355) 9577 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:02:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:21 smithi131 bash[24745]: cephadm 2024-09-14T02:02:20.642156+0000 mgr.a (mgr.14355) 9578 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:02:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:21 smithi171 bash[25040]: audit 2024-09-14T02:02:20.640809+0000 mgr.a (mgr.14355) 9577 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:02:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:21 smithi171 bash[25040]: cephadm 2024-09-14T02:02:20.642156+0000 mgr.a (mgr.14355) 9578 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:02:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:21 smithi007 bash[22722]: audit 2024-09-14T02:02:20.640809+0000 mgr.a (mgr.14355) 9577 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:02:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:21 smithi007 bash[22722]: cephadm 2024-09-14T02:02:20.642156+0000 mgr.a (mgr.14355) 9578 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:02:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:22 smithi131 bash[24745]: cluster 2024-09-14T02:02:21.180541+0000 mgr.a (mgr.14355) 9579 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 58 op/s 2024-09-14T02:02:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:22 smithi171 bash[25040]: cluster 2024-09-14T02:02:21.180541+0000 mgr.a (mgr.14355) 9579 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 58 op/s 2024-09-14T02:02:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:22 smithi007 bash[22722]: cluster 2024-09-14T02:02:21.180541+0000 mgr.a (mgr.14355) 9579 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 58 op/s 2024-09-14T02:02:24.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:24.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:24 smithi131 bash[24745]: cluster 2024-09-14T02:02:23.181305+0000 mgr.a (mgr.14355) 9580 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:24 smithi171 bash[25040]: cluster 2024-09-14T02:02:23.181305+0000 mgr.a (mgr.14355) 9580 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:24 smithi007 bash[22722]: cluster 2024-09-14T02:02:23.181305+0000 mgr.a (mgr.14355) 9580 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:25.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:25.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:25.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:27 smithi131 bash[24745]: cluster 2024-09-14T02:02:25.182044+0000 mgr.a (mgr.14355) 9581 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:27 smithi131 bash[24745]: audit 2024-09-14T02:02:25.281354+0000 mgr.a (mgr.14355) 9582 : audit [DBG] from='client.212523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:27 smithi171 bash[25040]: cluster 2024-09-14T02:02:25.182044+0000 mgr.a (mgr.14355) 9581 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:27 smithi171 bash[25040]: audit 2024-09-14T02:02:25.281354+0000 mgr.a (mgr.14355) 9582 : audit [DBG] from='client.212523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:27 smithi007 bash[22722]: cluster 2024-09-14T02:02:25.182044+0000 mgr.a (mgr.14355) 9581 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 255 B/s wr, 57 op/s 2024-09-14T02:02:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:27 smithi007 bash[22722]: audit 2024-09-14T02:02:25.281354+0000 mgr.a (mgr.14355) 9582 : audit [DBG] from='client.212523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:29 smithi131 bash[24745]: cluster 2024-09-14T02:02:27.184743+0000 mgr.a (mgr.14355) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:02:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:29 smithi171 bash[25040]: cluster 2024-09-14T02:02:27.184743+0000 mgr.a (mgr.14355) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:02:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:29 smithi007 bash[22722]: cluster 2024-09-14T02:02:27.184743+0000 mgr.a (mgr.14355) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:02:30.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:30.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:31 smithi131 bash[24745]: cluster 2024-09-14T02:02:29.185545+0000 mgr.a (mgr.14355) 9584 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:02:31.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:31 smithi171 bash[25040]: cluster 2024-09-14T02:02:29.185545+0000 mgr.a (mgr.14355) 9584 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:02:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:31 smithi007 bash[22722]: cluster 2024-09-14T02:02:29.185545+0000 mgr.a (mgr.14355) 9584 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:02:31.488 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:32 smithi131 bash[24745]: audit 2024-09-14T02:02:31.051596+0000 mgr.a (mgr.14355) 9585 : audit [DBG] from='client.212598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:32 smithi171 bash[25040]: audit 2024-09-14T02:02:31.051596+0000 mgr.a (mgr.14355) 9585 : audit [DBG] from='client.212598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:32 smithi007 bash[22722]: audit 2024-09-14T02:02:31.051596+0000 mgr.a (mgr.14355) 9585 : audit [DBG] from='client.212598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:33 smithi131 bash[24745]: cluster 2024-09-14T02:02:31.191859+0000 mgr.a (mgr.14355) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:02:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:33 smithi171 bash[25040]: cluster 2024-09-14T02:02:31.191859+0000 mgr.a (mgr.14355) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:02:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:33 smithi007 bash[22722]: cluster 2024-09-14T02:02:31.191859+0000 mgr.a (mgr.14355) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:02:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:35 smithi131 bash[24745]: cluster 2024-09-14T02:02:33.192728+0000 mgr.a (mgr.14355) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:35 smithi171 bash[25040]: cluster 2024-09-14T02:02:33.192728+0000 mgr.a (mgr.14355) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:35 smithi007 bash[22722]: cluster 2024-09-14T02:02:33.192728+0000 mgr.a (mgr.14355) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:36.490 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:37.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:37.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:37.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:37.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:37 smithi131 bash[24745]: cluster 2024-09-14T02:02:35.193507+0000 mgr.a (mgr.14355) 9588 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:37 smithi171 bash[25040]: cluster 2024-09-14T02:02:35.193507+0000 mgr.a (mgr.14355) 9588 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:37 smithi007 bash[22722]: cluster 2024-09-14T02:02:35.193507+0000 mgr.a (mgr.14355) 9588 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:38 smithi171 bash[25040]: audit 2024-09-14T02:02:36.824350+0000 mgr.a (mgr.14355) 9589 : audit [DBG] from='client.212670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:38 smithi007 bash[22722]: audit 2024-09-14T02:02:36.824350+0000 mgr.a (mgr.14355) 9589 : audit [DBG] from='client.212670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:38 smithi131 bash[24745]: audit 2024-09-14T02:02:36.824350+0000 mgr.a (mgr.14355) 9589 : audit [DBG] from='client.212670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:39 smithi171 bash[25040]: cluster 2024-09-14T02:02:37.194875+0000 mgr.a (mgr.14355) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:39 smithi007 bash[22722]: cluster 2024-09-14T02:02:37.194875+0000 mgr.a (mgr.14355) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:39 smithi131 bash[24745]: cluster 2024-09-14T02:02:37.194875+0000 mgr.a (mgr.14355) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:02:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:41 smithi171 bash[25040]: cluster 2024-09-14T02:02:39.195613+0000 mgr.a (mgr.14355) 9591 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:41 smithi007 bash[22722]: cluster 2024-09-14T02:02:39.195613+0000 mgr.a (mgr.14355) 9591 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:41 smithi131 bash[24745]: cluster 2024-09-14T02:02:39.195613+0000 mgr.a (mgr.14355) 9591 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:43.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:43.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:43.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:43.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:43.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:43 smithi007 bash[22722]: cluster 2024-09-14T02:02:41.197646+0000 mgr.a (mgr.14355) 9592 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:43 smithi131 bash[24745]: cluster 2024-09-14T02:02:41.197646+0000 mgr.a (mgr.14355) 9592 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:43 smithi171 bash[25040]: cluster 2024-09-14T02:02:41.197646+0000 mgr.a (mgr.14355) 9592 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:44 smithi007 bash[22722]: audit 2024-09-14T02:02:42.587508+0000 mgr.a (mgr.14355) 9593 : audit [DBG] from='client.212748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:44 smithi131 bash[24745]: audit 2024-09-14T02:02:42.587508+0000 mgr.a (mgr.14355) 9593 : audit [DBG] from='client.212748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:44 smithi171 bash[25040]: audit 2024-09-14T02:02:42.587508+0000 mgr.a (mgr.14355) 9593 : audit [DBG] from='client.212748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:45 smithi007 bash[22722]: cluster 2024-09-14T02:02:43.198612+0000 mgr.a (mgr.14355) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:45 smithi131 bash[24745]: cluster 2024-09-14T02:02:43.198612+0000 mgr.a (mgr.14355) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:45 smithi171 bash[25040]: cluster 2024-09-14T02:02:43.198612+0000 mgr.a (mgr.14355) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:47 smithi007 bash[22722]: cluster 2024-09-14T02:02:45.199435+0000 mgr.a (mgr.14355) 9595 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:47 smithi131 bash[24745]: cluster 2024-09-14T02:02:45.199435+0000 mgr.a (mgr.14355) 9595 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:47 smithi171 bash[25040]: cluster 2024-09-14T02:02:45.199435+0000 mgr.a (mgr.14355) 9595 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:48.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:48.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:48.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:48.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:48.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:48.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:49 smithi007 bash[22722]: cluster 2024-09-14T02:02:47.201658+0000 mgr.a (mgr.14355) 9596 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:49 smithi131 bash[24745]: cluster 2024-09-14T02:02:47.201658+0000 mgr.a (mgr.14355) 9596 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:49 smithi171 bash[25040]: cluster 2024-09-14T02:02:47.201658+0000 mgr.a (mgr.14355) 9596 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:50 smithi007 bash[22722]: audit 2024-09-14T02:02:48.365580+0000 mgr.a (mgr.14355) 9597 : audit [DBG] from='client.212820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:50 smithi131 bash[24745]: audit 2024-09-14T02:02:48.365580+0000 mgr.a (mgr.14355) 9597 : audit [DBG] from='client.212820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:50 smithi171 bash[25040]: audit 2024-09-14T02:02:48.365580+0000 mgr.a (mgr.14355) 9597 : audit [DBG] from='client.212820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:51 smithi007 bash[22722]: cluster 2024-09-14T02:02:49.202632+0000 mgr.a (mgr.14355) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:51 smithi131 bash[24745]: cluster 2024-09-14T02:02:49.202632+0000 mgr.a (mgr.14355) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:51 smithi171 bash[25040]: cluster 2024-09-14T02:02:49.202632+0000 mgr.a (mgr.14355) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:53 smithi007 bash[22722]: cluster 2024-09-14T02:02:51.204993+0000 mgr.a (mgr.14355) 9599 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:53 smithi131 bash[24745]: cluster 2024-09-14T02:02:51.204993+0000 mgr.a (mgr.14355) 9599 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:53 smithi171 bash[25040]: cluster 2024-09-14T02:02:51.204993+0000 mgr.a (mgr.14355) 9599 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:53.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:02:54.567 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:02:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:02:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:02:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:02:54.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:02:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:55 smithi007 bash[22722]: cluster 2024-09-14T02:02:53.205913+0000 mgr.a (mgr.14355) 9600 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:55 smithi131 bash[24745]: cluster 2024-09-14T02:02:53.205913+0000 mgr.a (mgr.14355) 9600 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:55 smithi171 bash[25040]: cluster 2024-09-14T02:02:53.205913+0000 mgr.a (mgr.14355) 9600 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:56 smithi007 bash[22722]: audit 2024-09-14T02:02:54.127174+0000 mgr.a (mgr.14355) 9601 : audit [DBG] from='client.212895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:56 smithi131 bash[24745]: audit 2024-09-14T02:02:54.127174+0000 mgr.a (mgr.14355) 9601 : audit [DBG] from='client.212895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:56 smithi171 bash[25040]: audit 2024-09-14T02:02:54.127174+0000 mgr.a (mgr.14355) 9601 : audit [DBG] from='client.212895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:02:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:57 smithi007 bash[22722]: cluster 2024-09-14T02:02:55.206833+0000 mgr.a (mgr.14355) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:57 smithi131 bash[24745]: cluster 2024-09-14T02:02:55.206833+0000 mgr.a (mgr.14355) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:57 smithi171 bash[25040]: cluster 2024-09-14T02:02:55.206833+0000 mgr.a (mgr.14355) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:02:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:02:59 smithi007 bash[22722]: cluster 2024-09-14T02:02:57.209093+0000 mgr.a (mgr.14355) 9603 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:02:59 smithi131 bash[24745]: cluster 2024-09-14T02:02:57.209093+0000 mgr.a (mgr.14355) 9603 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:02:59 smithi171 bash[25040]: cluster 2024-09-14T02:02:57.209093+0000 mgr.a (mgr.14355) 9603 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:02:59.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:02:59.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:02:59.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:00.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:00.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:01 smithi007 bash[22722]: cluster 2024-09-14T02:02:59.209872+0000 mgr.a (mgr.14355) 9604 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:01 smithi007 bash[22722]: audit 2024-09-14T02:02:59.901067+0000 mgr.a (mgr.14355) 9605 : audit [DBG] from='client.212970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:01 smithi131 bash[24745]: cluster 2024-09-14T02:02:59.209872+0000 mgr.a (mgr.14355) 9604 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:01 smithi131 bash[24745]: audit 2024-09-14T02:02:59.901067+0000 mgr.a (mgr.14355) 9605 : audit [DBG] from='client.212970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:01 smithi171 bash[25040]: cluster 2024-09-14T02:02:59.209872+0000 mgr.a (mgr.14355) 9604 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:01 smithi171 bash[25040]: audit 2024-09-14T02:02:59.901067+0000 mgr.a (mgr.14355) 9605 : audit [DBG] from='client.212970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:03 smithi007 bash[22722]: cluster 2024-09-14T02:03:01.212360+0000 mgr.a (mgr.14355) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:03:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:03 smithi131 bash[24745]: cluster 2024-09-14T02:03:01.212360+0000 mgr.a (mgr.14355) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:03:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:03 smithi171 bash[25040]: cluster 2024-09-14T02:03:01.212360+0000 mgr.a (mgr.14355) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:03:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:05.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:05.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:05 smithi007 bash[22722]: cluster 2024-09-14T02:03:03.213173+0000 mgr.a (mgr.14355) 9607 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:05 smithi131 bash[24745]: cluster 2024-09-14T02:03:03.213173+0000 mgr.a (mgr.14355) 9607 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:05 smithi171 bash[25040]: cluster 2024-09-14T02:03:03.213173+0000 mgr.a (mgr.14355) 9607 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:06.112 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:06.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:07 smithi007 bash[22722]: cluster 2024-09-14T02:03:05.214071+0000 mgr.a (mgr.14355) 9608 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:07 smithi007 bash[22722]: audit 2024-09-14T02:03:05.664962+0000 mgr.a (mgr.14355) 9609 : audit [DBG] from='client.213048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:07 smithi131 bash[24745]: cluster 2024-09-14T02:03:05.214071+0000 mgr.a (mgr.14355) 9608 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:07 smithi131 bash[24745]: audit 2024-09-14T02:03:05.664962+0000 mgr.a (mgr.14355) 9609 : audit [DBG] from='client.213048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:07 smithi171 bash[25040]: cluster 2024-09-14T02:03:05.214071+0000 mgr.a (mgr.14355) 9608 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:07 smithi171 bash[25040]: audit 2024-09-14T02:03:05.664962+0000 mgr.a (mgr.14355) 9609 : audit [DBG] from='client.213048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:08 smithi007 bash[22722]: cluster 2024-09-14T02:03:07.216876+0000 mgr.a (mgr.14355) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:08 smithi131 bash[24745]: cluster 2024-09-14T02:03:07.216876+0000 mgr.a (mgr.14355) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:08 smithi171 bash[25040]: cluster 2024-09-14T02:03:07.216876+0000 mgr.a (mgr.14355) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:10 smithi131 bash[24745]: cluster 2024-09-14T02:03:09.217652+0000 mgr.a (mgr.14355) 9611 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:03:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:10 smithi171 bash[25040]: cluster 2024-09-14T02:03:09.217652+0000 mgr.a (mgr.14355) 9611 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:03:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:10 smithi007 bash[22722]: cluster 2024-09-14T02:03:09.217652+0000 mgr.a (mgr.14355) 9611 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:03:11.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:11.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:11.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:11.898 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:11.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:11.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:11.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:11.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:12 smithi131 bash[24745]: cluster 2024-09-14T02:03:11.218810+0000 mgr.a (mgr.14355) 9612 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:12 smithi131 bash[24745]: audit 2024-09-14T02:03:11.455279+0000 mgr.a (mgr.14355) 9613 : audit [DBG] from='client.213123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:12 smithi171 bash[25040]: cluster 2024-09-14T02:03:11.218810+0000 mgr.a (mgr.14355) 9612 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:12 smithi171 bash[25040]: audit 2024-09-14T02:03:11.455279+0000 mgr.a (mgr.14355) 9613 : audit [DBG] from='client.213123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:12 smithi007 bash[22722]: cluster 2024-09-14T02:03:11.218810+0000 mgr.a (mgr.14355) 9612 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:03:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:12 smithi007 bash[22722]: audit 2024-09-14T02:03:11.455279+0000 mgr.a (mgr.14355) 9613 : audit [DBG] from='client.213123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:14.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:14 smithi171 bash[25040]: cluster 2024-09-14T02:03:13.219649+0000 mgr.a (mgr.14355) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:14 smithi007 bash[22722]: cluster 2024-09-14T02:03:13.219649+0000 mgr.a (mgr.14355) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:14 smithi131 bash[24745]: cluster 2024-09-14T02:03:13.219649+0000 mgr.a (mgr.14355) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:16 smithi171 bash[25040]: cluster 2024-09-14T02:03:15.220419+0000 mgr.a (mgr.14355) 9615 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:16 smithi007 bash[22722]: cluster 2024-09-14T02:03:15.220419+0000 mgr.a (mgr.14355) 9615 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:16 smithi131 bash[24745]: cluster 2024-09-14T02:03:15.220419+0000 mgr.a (mgr.14355) 9615 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:16.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:16.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:17.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:17.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:17.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:17.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:17.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:18 smithi171 bash[25040]: cluster 2024-09-14T02:03:17.222539+0000 mgr.a (mgr.14355) 9616 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:18 smithi171 bash[25040]: audit 2024-09-14T02:03:17.227769+0000 mgr.a (mgr.14355) 9617 : audit [DBG] from='client.213198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:18 smithi007 bash[22722]: cluster 2024-09-14T02:03:17.222539+0000 mgr.a (mgr.14355) 9616 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:18 smithi007 bash[22722]: audit 2024-09-14T02:03:17.227769+0000 mgr.a (mgr.14355) 9617 : audit [DBG] from='client.213198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:18 smithi131 bash[24745]: cluster 2024-09-14T02:03:17.222539+0000 mgr.a (mgr.14355) 9616 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:18 smithi131 bash[24745]: audit 2024-09-14T02:03:17.227769+0000 mgr.a (mgr.14355) 9617 : audit [DBG] from='client.213198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:20 smithi007 bash[22722]: cluster 2024-09-14T02:03:19.223531+0000 mgr.a (mgr.14355) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:20 smithi131 bash[24745]: cluster 2024-09-14T02:03:19.223531+0000 mgr.a (mgr.14355) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:20 smithi171 bash[25040]: cluster 2024-09-14T02:03:19.223531+0000 mgr.a (mgr.14355) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:21 smithi007 bash[22722]: audit 2024-09-14T02:03:20.700517+0000 mon.a (mon.0) 2037 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:03:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:21 smithi131 bash[24745]: audit 2024-09-14T02:03:20.700517+0000 mon.a (mon.0) 2037 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:03:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:21 smithi171 bash[25040]: audit 2024-09-14T02:03:20.700517+0000 mon.a (mon.0) 2037 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:03:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:22.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: cluster 2024-09-14T02:03:21.225864+0000 mgr.a (mgr.14355) 9619 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: audit 2024-09-14T02:03:21.544160+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: audit 2024-09-14T02:03:21.546007+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: audit 2024-09-14T02:03:21.556001+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: audit 2024-09-14T02:03:21.561052+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22722]: audit 2024-09-14T02:03:21.563335+0000 mgr.a (mgr.14355) 9620 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22972]: debug 2024-09-14T02:03:22.286+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:03:22.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:03:22 smithi007 bash[22972]: debug 2024-09-14T02:03:22.286+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:03:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: cluster 2024-09-14T02:03:21.225864+0000 mgr.a (mgr.14355) 9619 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: audit 2024-09-14T02:03:21.544160+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:03:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: audit 2024-09-14T02:03:21.546007+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:03:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: audit 2024-09-14T02:03:21.556001+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:03:22.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: audit 2024-09-14T02:03:21.561052+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:22.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:22 smithi131 bash[24745]: audit 2024-09-14T02:03:21.563335+0000 mgr.a (mgr.14355) 9620 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: cluster 2024-09-14T02:03:21.225864+0000 mgr.a (mgr.14355) 9619 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: audit 2024-09-14T02:03:21.544160+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:03:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: audit 2024-09-14T02:03:21.546007+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:03:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: audit 2024-09-14T02:03:21.556001+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:03:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: audit 2024-09-14T02:03:21.561052+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:22 smithi171 bash[25040]: audit 2024-09-14T02:03:21.563335+0000 mgr.a (mgr.14355) 9620 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:03:23.383 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:23.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:23 smithi007 bash[22722]: audit 2024-09-14T02:03:22.292471+0000 mgr.a (mgr.14355) 9621 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:03:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:23 smithi007 bash[22722]: cephadm 2024-09-14T02:03:22.293969+0000 mgr.a (mgr.14355) 9622 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:03:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:23 smithi007 bash[22722]: audit 2024-09-14T02:03:22.974595+0000 mgr.a (mgr.14355) 9623 : audit [DBG] from='client.213381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:23 smithi131 bash[24745]: audit 2024-09-14T02:03:22.292471+0000 mgr.a (mgr.14355) 9621 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:03:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:23 smithi131 bash[24745]: cephadm 2024-09-14T02:03:22.293969+0000 mgr.a (mgr.14355) 9622 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:03:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:23 smithi131 bash[24745]: audit 2024-09-14T02:03:22.974595+0000 mgr.a (mgr.14355) 9623 : audit [DBG] from='client.213381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:23 smithi171 bash[25040]: audit 2024-09-14T02:03:22.292471+0000 mgr.a (mgr.14355) 9621 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:03:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:23 smithi171 bash[25040]: cephadm 2024-09-14T02:03:22.293969+0000 mgr.a (mgr.14355) 9622 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:03:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:23 smithi171 bash[25040]: audit 2024-09-14T02:03:22.974595+0000 mgr.a (mgr.14355) 9623 : audit [DBG] from='client.213381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:24 smithi007 bash[22722]: cluster 2024-09-14T02:03:23.227074+0000 mgr.a (mgr.14355) 9624 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:24 smithi131 bash[24745]: cluster 2024-09-14T02:03:23.227074+0000 mgr.a (mgr.14355) 9624 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:24 smithi171 bash[25040]: cluster 2024-09-14T02:03:23.227074+0000 mgr.a (mgr.14355) 9624 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:26 smithi007 bash[22722]: cluster 2024-09-14T02:03:25.228050+0000 mgr.a (mgr.14355) 9625 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:26 smithi131 bash[24745]: cluster 2024-09-14T02:03:25.228050+0000 mgr.a (mgr.14355) 9625 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:26 smithi171 bash[25040]: cluster 2024-09-14T02:03:25.228050+0000 mgr.a (mgr.14355) 9625 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:28 smithi007 bash[22722]: cluster 2024-09-14T02:03:27.230389+0000 mgr.a (mgr.14355) 9626 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:28 smithi131 bash[24745]: cluster 2024-09-14T02:03:27.230389+0000 mgr.a (mgr.14355) 9626 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:28 smithi171 bash[25040]: cluster 2024-09-14T02:03:27.230389+0000 mgr.a (mgr.14355) 9626 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:29.117 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:29.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:29.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:29 smithi007 bash[22722]: audit 2024-09-14T02:03:28.709041+0000 mgr.a (mgr.14355) 9627 : audit [DBG] from='client.213456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:29 smithi131 bash[24745]: audit 2024-09-14T02:03:28.709041+0000 mgr.a (mgr.14355) 9627 : audit [DBG] from='client.213456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:29 smithi171 bash[25040]: audit 2024-09-14T02:03:28.709041+0000 mgr.a (mgr.14355) 9627 : audit [DBG] from='client.213456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:30 smithi007 bash[22722]: cluster 2024-09-14T02:03:29.231244+0000 mgr.a (mgr.14355) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:30 smithi131 bash[24745]: cluster 2024-09-14T02:03:29.231244+0000 mgr.a (mgr.14355) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:30 smithi171 bash[25040]: cluster 2024-09-14T02:03:29.231244+0000 mgr.a (mgr.14355) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:32 smithi007 bash[22722]: cluster 2024-09-14T02:03:31.233459+0000 mgr.a (mgr.14355) 9629 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:32 smithi131 bash[24745]: cluster 2024-09-14T02:03:31.233459+0000 mgr.a (mgr.14355) 9629 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:32 smithi171 bash[25040]: cluster 2024-09-14T02:03:31.233459+0000 mgr.a (mgr.14355) 9629 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:34.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:34.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:34.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:34 smithi007 bash[22722]: cluster 2024-09-14T02:03:33.234196+0000 mgr.a (mgr.14355) 9630 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:34 smithi131 bash[24745]: cluster 2024-09-14T02:03:33.234196+0000 mgr.a (mgr.14355) 9630 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:34 smithi171 bash[25040]: cluster 2024-09-14T02:03:33.234196+0000 mgr.a (mgr.14355) 9630 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:34.896 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:34.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:34.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:34.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:34.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:35 smithi007 bash[22722]: audit 2024-09-14T02:03:34.458121+0000 mgr.a (mgr.14355) 9631 : audit [DBG] from='client.213531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:35 smithi131 bash[24745]: audit 2024-09-14T02:03:34.458121+0000 mgr.a (mgr.14355) 9631 : audit [DBG] from='client.213531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:35 smithi171 bash[25040]: audit 2024-09-14T02:03:34.458121+0000 mgr.a (mgr.14355) 9631 : audit [DBG] from='client.213531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:36 smithi007 bash[22722]: cluster 2024-09-14T02:03:35.235224+0000 mgr.a (mgr.14355) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:36 smithi131 bash[24745]: cluster 2024-09-14T02:03:35.235224+0000 mgr.a (mgr.14355) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:36 smithi171 bash[25040]: cluster 2024-09-14T02:03:35.235224+0000 mgr.a (mgr.14355) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:38 smithi007 bash[22722]: cluster 2024-09-14T02:03:37.237588+0000 mgr.a (mgr.14355) 9633 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:38 smithi131 bash[24745]: cluster 2024-09-14T02:03:37.237588+0000 mgr.a (mgr.14355) 9633 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:38 smithi171 bash[25040]: cluster 2024-09-14T02:03:37.237588+0000 mgr.a (mgr.14355) 9633 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:03:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:40.677 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:40.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:40.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:40 smithi007 bash[22722]: cluster 2024-09-14T02:03:39.238412+0000 mgr.a (mgr.14355) 9634 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:40 smithi131 bash[24745]: cluster 2024-09-14T02:03:39.238412+0000 mgr.a (mgr.14355) 9634 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:40 smithi171 bash[25040]: cluster 2024-09-14T02:03:39.238412+0000 mgr.a (mgr.14355) 9634 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:41 smithi007 bash[22722]: audit 2024-09-14T02:03:40.235644+0000 mgr.a (mgr.14355) 9635 : audit [DBG] from='client.213609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:41 smithi131 bash[24745]: audit 2024-09-14T02:03:40.235644+0000 mgr.a (mgr.14355) 9635 : audit [DBG] from='client.213609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:41 smithi171 bash[25040]: audit 2024-09-14T02:03:40.235644+0000 mgr.a (mgr.14355) 9635 : audit [DBG] from='client.213609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:42 smithi007 bash[22722]: cluster 2024-09-14T02:03:41.241109+0000 mgr.a (mgr.14355) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:42 smithi131 bash[24745]: cluster 2024-09-14T02:03:41.241109+0000 mgr.a (mgr.14355) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:42 smithi171 bash[25040]: cluster 2024-09-14T02:03:41.241109+0000 mgr.a (mgr.14355) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:44 smithi007 bash[22722]: cluster 2024-09-14T02:03:43.241877+0000 mgr.a (mgr.14355) 9637 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:44 smithi131 bash[24745]: cluster 2024-09-14T02:03:43.241877+0000 mgr.a (mgr.14355) 9637 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:44 smithi171 bash[25040]: cluster 2024-09-14T02:03:43.241877+0000 mgr.a (mgr.14355) 9637 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:45.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:45.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:46.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:46.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:46.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:46.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:46.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:46 smithi007 bash[22722]: cluster 2024-09-14T02:03:45.242636+0000 mgr.a (mgr.14355) 9638 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:46 smithi007 bash[22722]: audit 2024-09-14T02:03:46.007091+0000 mgr.a (mgr.14355) 9639 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:46 smithi131 bash[24745]: cluster 2024-09-14T02:03:45.242636+0000 mgr.a (mgr.14355) 9638 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:46 smithi131 bash[24745]: audit 2024-09-14T02:03:46.007091+0000 mgr.a (mgr.14355) 9639 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:46 smithi171 bash[25040]: cluster 2024-09-14T02:03:45.242636+0000 mgr.a (mgr.14355) 9638 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:03:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:46 smithi171 bash[25040]: audit 2024-09-14T02:03:46.007091+0000 mgr.a (mgr.14355) 9639 : audit [DBG] from='client.213681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:48 smithi007 bash[22722]: cluster 2024-09-14T02:03:47.245354+0000 mgr.a (mgr.14355) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:48 smithi131 bash[24745]: cluster 2024-09-14T02:03:47.245354+0000 mgr.a (mgr.14355) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:48 smithi171 bash[25040]: cluster 2024-09-14T02:03:47.245354+0000 mgr.a (mgr.14355) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:50 smithi007 bash[22722]: cluster 2024-09-14T02:03:49.246111+0000 mgr.a (mgr.14355) 9641 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:50 smithi131 bash[24745]: cluster 2024-09-14T02:03:49.246111+0000 mgr.a (mgr.14355) 9641 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:50 smithi171 bash[25040]: cluster 2024-09-14T02:03:49.246111+0000 mgr.a (mgr.14355) 9641 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:03:51.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:51.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:51.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:52.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:52.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:52 smithi007 bash[22722]: cluster 2024-09-14T02:03:51.248096+0000 mgr.a (mgr.14355) 9642 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:52 smithi007 bash[22722]: audit 2024-09-14T02:03:51.767074+0000 mgr.a (mgr.14355) 9643 : audit [DBG] from='client.213759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:52 smithi131 bash[24745]: cluster 2024-09-14T02:03:51.248096+0000 mgr.a (mgr.14355) 9642 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:52 smithi131 bash[24745]: audit 2024-09-14T02:03:51.767074+0000 mgr.a (mgr.14355) 9643 : audit [DBG] from='client.213759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:52 smithi171 bash[25040]: cluster 2024-09-14T02:03:51.248096+0000 mgr.a (mgr.14355) 9642 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:52 smithi171 bash[25040]: audit 2024-09-14T02:03:51.767074+0000 mgr.a (mgr.14355) 9643 : audit [DBG] from='client.213759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:54 smithi007 bash[22722]: cluster 2024-09-14T02:03:53.249228+0000 mgr.a (mgr.14355) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:54 smithi131 bash[24745]: cluster 2024-09-14T02:03:53.249228+0000 mgr.a (mgr.14355) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:54 smithi171 bash[25040]: cluster 2024-09-14T02:03:53.249228+0000 mgr.a (mgr.14355) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:56 smithi007 bash[22722]: cluster 2024-09-14T02:03:55.250202+0000 mgr.a (mgr.14355) 9645 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:56 smithi131 bash[24745]: cluster 2024-09-14T02:03:55.250202+0000 mgr.a (mgr.14355) 9645 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:56 smithi171 bash[25040]: cluster 2024-09-14T02:03:55.250202+0000 mgr.a (mgr.14355) 9645 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:03:57.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:03:57.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:03:57.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:03:57.953 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:03:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:03:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:03:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:03:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:03:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:58 smithi007 bash[22722]: cluster 2024-09-14T02:03:57.252494+0000 mgr.a (mgr.14355) 9646 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:03:58 smithi007 bash[22722]: audit 2024-09-14T02:03:57.540674+0000 mgr.a (mgr.14355) 9647 : audit [DBG] from='client.213837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:58.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:58 smithi131 bash[24745]: cluster 2024-09-14T02:03:57.252494+0000 mgr.a (mgr.14355) 9646 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:58.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:03:58 smithi131 bash[24745]: audit 2024-09-14T02:03:57.540674+0000 mgr.a (mgr.14355) 9647 : audit [DBG] from='client.213837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:03:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:58 smithi171 bash[25040]: cluster 2024-09-14T02:03:57.252494+0000 mgr.a (mgr.14355) 9646 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:03:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:03:58 smithi171 bash[25040]: audit 2024-09-14T02:03:57.540674+0000 mgr.a (mgr.14355) 9647 : audit [DBG] from='client.213837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:00 smithi007 bash[22722]: cluster 2024-09-14T02:03:59.253487+0000 mgr.a (mgr.14355) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:00 smithi131 bash[24745]: cluster 2024-09-14T02:03:59.253487+0000 mgr.a (mgr.14355) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:00 smithi171 bash[25040]: cluster 2024-09-14T02:03:59.253487+0000 mgr.a (mgr.14355) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:02 smithi007 bash[22722]: cluster 2024-09-14T02:04:01.255725+0000 mgr.a (mgr.14355) 9649 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:02 smithi131 bash[24745]: cluster 2024-09-14T02:04:01.255725+0000 mgr.a (mgr.14355) 9649 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:02 smithi171 bash[25040]: cluster 2024-09-14T02:04:01.255725+0000 mgr.a (mgr.14355) 9649 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:03.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:03.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:04 smithi007 bash[22722]: cluster 2024-09-14T02:04:03.256463+0000 mgr.a (mgr.14355) 9650 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:04 smithi007 bash[22722]: audit 2024-09-14T02:04:03.290025+0000 mgr.a (mgr.14355) 9651 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:04 smithi131 bash[24745]: cluster 2024-09-14T02:04:03.256463+0000 mgr.a (mgr.14355) 9650 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:04 smithi131 bash[24745]: audit 2024-09-14T02:04:03.290025+0000 mgr.a (mgr.14355) 9651 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:04 smithi171 bash[25040]: cluster 2024-09-14T02:04:03.256463+0000 mgr.a (mgr.14355) 9650 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:04 smithi171 bash[25040]: audit 2024-09-14T02:04:03.290025+0000 mgr.a (mgr.14355) 9651 : audit [DBG] from='client.213909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:06 smithi007 bash[22722]: cluster 2024-09-14T02:04:05.257383+0000 mgr.a (mgr.14355) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:06 smithi131 bash[24745]: cluster 2024-09-14T02:04:05.257383+0000 mgr.a (mgr.14355) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:06 smithi171 bash[25040]: cluster 2024-09-14T02:04:05.257383+0000 mgr.a (mgr.14355) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:08 smithi007 bash[22722]: cluster 2024-09-14T02:04:07.259666+0000 mgr.a (mgr.14355) 9653 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:08.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:08.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:08 smithi131 bash[24745]: cluster 2024-09-14T02:04:07.259666+0000 mgr.a (mgr.14355) 9653 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:08 smithi171 bash[25040]: cluster 2024-09-14T02:04:07.259666+0000 mgr.a (mgr.14355) 9653 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:09.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:09 smithi007 bash[22722]: audit 2024-09-14T02:04:09.059233+0000 mgr.a (mgr.14355) 9654 : audit [DBG] from='client.213984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:09 smithi131 bash[24745]: audit 2024-09-14T02:04:09.059233+0000 mgr.a (mgr.14355) 9654 : audit [DBG] from='client.213984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:09 smithi171 bash[25040]: audit 2024-09-14T02:04:09.059233+0000 mgr.a (mgr.14355) 9654 : audit [DBG] from='client.213984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:10 smithi007 bash[22722]: cluster 2024-09-14T02:04:09.260277+0000 mgr.a (mgr.14355) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:10 smithi131 bash[24745]: cluster 2024-09-14T02:04:09.260277+0000 mgr.a (mgr.14355) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:10 smithi171 bash[25040]: cluster 2024-09-14T02:04:09.260277+0000 mgr.a (mgr.14355) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:12 smithi007 bash[22722]: cluster 2024-09-14T02:04:11.262688+0000 mgr.a (mgr.14355) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:12 smithi131 bash[24745]: cluster 2024-09-14T02:04:11.262688+0000 mgr.a (mgr.14355) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:12 smithi171 bash[25040]: cluster 2024-09-14T02:04:11.262688+0000 mgr.a (mgr.14355) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:14.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:14.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:14.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:14 smithi007 bash[22722]: cluster 2024-09-14T02:04:13.263503+0000 mgr.a (mgr.14355) 9657 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:14 smithi131 bash[24745]: cluster 2024-09-14T02:04:13.263503+0000 mgr.a (mgr.14355) 9657 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:14 smithi171 bash[25040]: cluster 2024-09-14T02:04:13.263503+0000 mgr.a (mgr.14355) 9657 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:15.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:15.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:15.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:15.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:15.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:15 smithi131 bash[24745]: audit 2024-09-14T02:04:14.824325+0000 mgr.a (mgr.14355) 9658 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:15 smithi171 bash[25040]: audit 2024-09-14T02:04:14.824325+0000 mgr.a (mgr.14355) 9658 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:15 smithi007 bash[22722]: audit 2024-09-14T02:04:14.824325+0000 mgr.a (mgr.14355) 9658 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:16 smithi131 bash[24745]: cluster 2024-09-14T02:04:15.264207+0000 mgr.a (mgr.14355) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:16 smithi171 bash[25040]: cluster 2024-09-14T02:04:15.264207+0000 mgr.a (mgr.14355) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:16 smithi007 bash[22722]: cluster 2024-09-14T02:04:15.264207+0000 mgr.a (mgr.14355) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:18 smithi131 bash[24745]: cluster 2024-09-14T02:04:17.266578+0000 mgr.a (mgr.14355) 9660 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:18 smithi171 bash[25040]: cluster 2024-09-14T02:04:17.266578+0000 mgr.a (mgr.14355) 9660 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:18 smithi007 bash[22722]: cluster 2024-09-14T02:04:17.266578+0000 mgr.a (mgr.14355) 9660 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:20 smithi131 bash[24745]: cluster 2024-09-14T02:04:19.267377+0000 mgr.a (mgr.14355) 9661 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:20 smithi171 bash[25040]: cluster 2024-09-14T02:04:19.267377+0000 mgr.a (mgr.14355) 9661 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:20 smithi007 bash[22722]: cluster 2024-09-14T02:04:19.267377+0000 mgr.a (mgr.14355) 9661 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:20.993 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:20.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:21 smithi131 bash[24745]: audit 2024-09-14T02:04:20.587049+0000 mgr.a (mgr.14355) 9662 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:21 smithi171 bash[25040]: audit 2024-09-14T02:04:20.587049+0000 mgr.a (mgr.14355) 9662 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:21 smithi007 bash[22722]: audit 2024-09-14T02:04:20.587049+0000 mgr.a (mgr.14355) 9662 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:22 smithi131 bash[24745]: cluster 2024-09-14T02:04:21.270128+0000 mgr.a (mgr.14355) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:22 smithi131 bash[24745]: audit 2024-09-14T02:04:22.347076+0000 mon.a (mon.0) 2042 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:04:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:22 smithi171 bash[25040]: cluster 2024-09-14T02:04:21.270128+0000 mgr.a (mgr.14355) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:22 smithi171 bash[25040]: audit 2024-09-14T02:04:22.347076+0000 mon.a (mon.0) 2042 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:04:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:22 smithi007 bash[22722]: cluster 2024-09-14T02:04:21.270128+0000 mgr.a (mgr.14355) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:22 smithi007 bash[22722]: audit 2024-09-14T02:04:22.347076+0000 mon.a (mon.0) 2042 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:23 smithi131 bash[24745]: audit 2024-09-14T02:04:23.178407+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:23 smithi131 bash[24745]: audit 2024-09-14T02:04:23.180002+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:23 smithi131 bash[24745]: audit 2024-09-14T02:04:23.187952+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:04:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:23 smithi131 bash[24745]: audit 2024-09-14T02:04:23.190535+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:23 smithi171 bash[25040]: audit 2024-09-14T02:04:23.178407+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:04:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:23 smithi171 bash[25040]: audit 2024-09-14T02:04:23.180002+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:04:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:23 smithi171 bash[25040]: audit 2024-09-14T02:04:23.187952+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:04:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:23 smithi171 bash[25040]: audit 2024-09-14T02:04:23.190535+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:23.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22722]: audit 2024-09-14T02:04:23.178407+0000 mon.a (mon.0) 2043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:04:23.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22722]: audit 2024-09-14T02:04:23.180002+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:04:23.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22722]: audit 2024-09-14T02:04:23.187952+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:04:23.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22722]: audit 2024-09-14T02:04:23.190535+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:24.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22972]: debug 2024-09-14T02:04:23.917+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:04:24.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:04:23 smithi007 bash[22972]: debug 2024-09-14T02:04:23.917+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:04:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:24 smithi131 bash[24745]: audit 2024-09-14T02:04:23.192852+0000 mgr.a (mgr.14355) 9664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:24 smithi131 bash[24745]: cluster 2024-09-14T02:04:23.270717+0000 mgr.a (mgr.14355) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:04:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:24 smithi131 bash[24745]: audit 2024-09-14T02:04:23.919748+0000 mgr.a (mgr.14355) 9666 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:04:24.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:24 smithi131 bash[24745]: cephadm 2024-09-14T02:04:23.921193+0000 mgr.a (mgr.14355) 9667 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:04:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:24 smithi171 bash[25040]: audit 2024-09-14T02:04:23.192852+0000 mgr.a (mgr.14355) 9664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:24 smithi171 bash[25040]: cluster 2024-09-14T02:04:23.270717+0000 mgr.a (mgr.14355) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:04:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:24 smithi171 bash[25040]: audit 2024-09-14T02:04:23.919748+0000 mgr.a (mgr.14355) 9666 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:04:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:24 smithi171 bash[25040]: cephadm 2024-09-14T02:04:23.921193+0000 mgr.a (mgr.14355) 9667 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:04:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:24 smithi007 bash[22722]: audit 2024-09-14T02:04:23.192852+0000 mgr.a (mgr.14355) 9664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:04:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:24 smithi007 bash[22722]: cluster 2024-09-14T02:04:23.270717+0000 mgr.a (mgr.14355) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:04:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:24 smithi007 bash[22722]: audit 2024-09-14T02:04:23.919748+0000 mgr.a (mgr.14355) 9666 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:04:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:24 smithi007 bash[22722]: cephadm 2024-09-14T02:04:23.921193+0000 mgr.a (mgr.14355) 9667 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:04:25.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:25.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:26.742 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:26 smithi131 bash[24745]: cluster 2024-09-14T02:04:25.271590+0000 mgr.a (mgr.14355) 9668 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:04:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:26 smithi171 bash[25040]: cluster 2024-09-14T02:04:25.271590+0000 mgr.a (mgr.14355) 9668 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:04:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:26 smithi007 bash[22722]: cluster 2024-09-14T02:04:25.271590+0000 mgr.a (mgr.14355) 9668 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:04:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:27 smithi131 bash[24745]: audit 2024-09-14T02:04:26.324762+0000 mgr.a (mgr.14355) 9669 : audit [DBG] from='client.214308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:27 smithi171 bash[25040]: audit 2024-09-14T02:04:26.324762+0000 mgr.a (mgr.14355) 9669 : audit [DBG] from='client.214308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:27 smithi007 bash[22722]: audit 2024-09-14T02:04:26.324762+0000 mgr.a (mgr.14355) 9669 : audit [DBG] from='client.214308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:28 smithi131 bash[24745]: cluster 2024-09-14T02:04:27.274576+0000 mgr.a (mgr.14355) 9670 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:28 smithi171 bash[25040]: cluster 2024-09-14T02:04:27.274576+0000 mgr.a (mgr.14355) 9670 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:28 smithi007 bash[22722]: cluster 2024-09-14T02:04:27.274576+0000 mgr.a (mgr.14355) 9670 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:30 smithi131 bash[24745]: cluster 2024-09-14T02:04:29.275559+0000 mgr.a (mgr.14355) 9671 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:04:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:30 smithi171 bash[25040]: cluster 2024-09-14T02:04:29.275559+0000 mgr.a (mgr.14355) 9671 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:04:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:30 smithi007 bash[22722]: cluster 2024-09-14T02:04:29.275559+0000 mgr.a (mgr.14355) 9671 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:04:31.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:31.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:32.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:32.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:32 smithi131 bash[24745]: cluster 2024-09-14T02:04:31.277690+0000 mgr.a (mgr.14355) 9672 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:32 smithi131 bash[24745]: audit 2024-09-14T02:04:32.071969+0000 mgr.a (mgr.14355) 9673 : audit [DBG] from='client.214386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:32 smithi171 bash[25040]: cluster 2024-09-14T02:04:31.277690+0000 mgr.a (mgr.14355) 9672 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:32 smithi171 bash[25040]: audit 2024-09-14T02:04:32.071969+0000 mgr.a (mgr.14355) 9673 : audit [DBG] from='client.214386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:32 smithi007 bash[22722]: cluster 2024-09-14T02:04:31.277690+0000 mgr.a (mgr.14355) 9672 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:32.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:32 smithi007 bash[22722]: audit 2024-09-14T02:04:32.071969+0000 mgr.a (mgr.14355) 9673 : audit [DBG] from='client.214386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:34 smithi131 bash[24745]: cluster 2024-09-14T02:04:33.278678+0000 mgr.a (mgr.14355) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:34 smithi171 bash[25040]: cluster 2024-09-14T02:04:33.278678+0000 mgr.a (mgr.14355) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:34 smithi007 bash[22722]: cluster 2024-09-14T02:04:33.278678+0000 mgr.a (mgr.14355) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:36 smithi131 bash[24745]: cluster 2024-09-14T02:04:35.279447+0000 mgr.a (mgr.14355) 9675 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:36 smithi171 bash[25040]: cluster 2024-09-14T02:04:35.279447+0000 mgr.a (mgr.14355) 9675 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:36 smithi007 bash[22722]: cluster 2024-09-14T02:04:35.279447+0000 mgr.a (mgr.14355) 9675 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:37.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:38.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:38.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:38 smithi131 bash[24745]: cluster 2024-09-14T02:04:37.281668+0000 mgr.a (mgr.14355) 9676 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:38 smithi131 bash[24745]: audit 2024-09-14T02:04:37.832849+0000 mgr.a (mgr.14355) 9677 : audit [DBG] from='client.214464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:38 smithi171 bash[25040]: cluster 2024-09-14T02:04:37.281668+0000 mgr.a (mgr.14355) 9676 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:38 smithi171 bash[25040]: audit 2024-09-14T02:04:37.832849+0000 mgr.a (mgr.14355) 9677 : audit [DBG] from='client.214464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:38 smithi007 bash[22722]: cluster 2024-09-14T02:04:37.281668+0000 mgr.a (mgr.14355) 9676 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:04:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:38 smithi007 bash[22722]: audit 2024-09-14T02:04:37.832849+0000 mgr.a (mgr.14355) 9677 : audit [DBG] from='client.214464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:40 smithi131 bash[24745]: cluster 2024-09-14T02:04:39.282623+0000 mgr.a (mgr.14355) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:40 smithi171 bash[25040]: cluster 2024-09-14T02:04:39.282623+0000 mgr.a (mgr.14355) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:40 smithi007 bash[22722]: cluster 2024-09-14T02:04:39.282623+0000 mgr.a (mgr.14355) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:42 smithi131 bash[24745]: cluster 2024-09-14T02:04:41.284829+0000 mgr.a (mgr.14355) 9679 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:42 smithi171 bash[25040]: cluster 2024-09-14T02:04:41.284829+0000 mgr.a (mgr.14355) 9679 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:42 smithi007 bash[22722]: cluster 2024-09-14T02:04:41.284829+0000 mgr.a (mgr.14355) 9679 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:43.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:43.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:43.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:44.061 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:44 smithi131 bash[24745]: cluster 2024-09-14T02:04:43.285595+0000 mgr.a (mgr.14355) 9680 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:44 smithi131 bash[24745]: audit 2024-09-14T02:04:43.617270+0000 mgr.a (mgr.14355) 9681 : audit [DBG] from='client.214539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:44 smithi171 bash[25040]: cluster 2024-09-14T02:04:43.285595+0000 mgr.a (mgr.14355) 9680 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:44 smithi171 bash[25040]: audit 2024-09-14T02:04:43.617270+0000 mgr.a (mgr.14355) 9681 : audit [DBG] from='client.214539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:44 smithi007 bash[22722]: cluster 2024-09-14T02:04:43.285595+0000 mgr.a (mgr.14355) 9680 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:44 smithi007 bash[22722]: audit 2024-09-14T02:04:43.617270+0000 mgr.a (mgr.14355) 9681 : audit [DBG] from='client.214539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:46 smithi131 bash[24745]: cluster 2024-09-14T02:04:45.286699+0000 mgr.a (mgr.14355) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:46 smithi171 bash[25040]: cluster 2024-09-14T02:04:45.286699+0000 mgr.a (mgr.14355) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:46 smithi007 bash[22722]: cluster 2024-09-14T02:04:45.286699+0000 mgr.a (mgr.14355) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:48 smithi171 bash[25040]: cluster 2024-09-14T02:04:47.289158+0000 mgr.a (mgr.14355) 9683 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:48 smithi007 bash[22722]: cluster 2024-09-14T02:04:47.289158+0000 mgr.a (mgr.14355) 9683 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:48 smithi131 bash[24745]: cluster 2024-09-14T02:04:47.289158+0000 mgr.a (mgr.14355) 9683 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:49.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:49.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:49.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:50 smithi171 bash[25040]: cluster 2024-09-14T02:04:49.289935+0000 mgr.a (mgr.14355) 9684 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:50 smithi171 bash[25040]: audit 2024-09-14T02:04:49.401744+0000 mgr.a (mgr.14355) 9685 : audit [DBG] from='client.214614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:50 smithi007 bash[22722]: cluster 2024-09-14T02:04:49.289935+0000 mgr.a (mgr.14355) 9684 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:50 smithi007 bash[22722]: audit 2024-09-14T02:04:49.401744+0000 mgr.a (mgr.14355) 9685 : audit [DBG] from='client.214614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:50 smithi131 bash[24745]: cluster 2024-09-14T02:04:49.289935+0000 mgr.a (mgr.14355) 9684 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:50 smithi131 bash[24745]: audit 2024-09-14T02:04:49.401744+0000 mgr.a (mgr.14355) 9685 : audit [DBG] from='client.214614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:52 smithi171 bash[25040]: cluster 2024-09-14T02:04:51.292261+0000 mgr.a (mgr.14355) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:52 smithi007 bash[22722]: cluster 2024-09-14T02:04:51.292261+0000 mgr.a (mgr.14355) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:52 smithi131 bash[24745]: cluster 2024-09-14T02:04:51.292261+0000 mgr.a (mgr.14355) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:04:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:04:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:04:54.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:04:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:54 smithi007 bash[22722]: cluster 2024-09-14T02:04:53.293025+0000 mgr.a (mgr.14355) 9687 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:54 smithi131 bash[24745]: cluster 2024-09-14T02:04:53.293025+0000 mgr.a (mgr.14355) 9687 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:54 smithi171 bash[25040]: cluster 2024-09-14T02:04:53.293025+0000 mgr.a (mgr.14355) 9687 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:55.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:04:55.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:04:55.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:04:55.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:04:55.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:04:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:56 smithi007 bash[22722]: audit 2024-09-14T02:04:55.180573+0000 mgr.a (mgr.14355) 9688 : audit [DBG] from='client.214692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:56 smithi007 bash[22722]: cluster 2024-09-14T02:04:55.293593+0000 mgr.a (mgr.14355) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:56 smithi131 bash[24745]: audit 2024-09-14T02:04:55.180573+0000 mgr.a (mgr.14355) 9688 : audit [DBG] from='client.214692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:56 smithi131 bash[24745]: cluster 2024-09-14T02:04:55.293593+0000 mgr.a (mgr.14355) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:56 smithi171 bash[25040]: audit 2024-09-14T02:04:55.180573+0000 mgr.a (mgr.14355) 9688 : audit [DBG] from='client.214692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:04:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:56 smithi171 bash[25040]: cluster 2024-09-14T02:04:55.293593+0000 mgr.a (mgr.14355) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:04:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:04:58 smithi007 bash[22722]: cluster 2024-09-14T02:04:57.296012+0000 mgr.a (mgr.14355) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:04:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:04:58 smithi131 bash[24745]: cluster 2024-09-14T02:04:57.296012+0000 mgr.a (mgr.14355) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:04:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:04:58 smithi171 bash[25040]: cluster 2024-09-14T02:04:57.296012+0000 mgr.a (mgr.14355) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:05:00.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:00.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:00.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:00 smithi007 bash[22722]: cluster 2024-09-14T02:04:59.296807+0000 mgr.a (mgr.14355) 9691 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:05:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:00 smithi131 bash[24745]: cluster 2024-09-14T02:04:59.296807+0000 mgr.a (mgr.14355) 9691 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:05:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:00 smithi171 bash[25040]: cluster 2024-09-14T02:04:59.296807+0000 mgr.a (mgr.14355) 9691 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:05:01.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:01.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:01 smithi131 bash[24745]: audit 2024-09-14T02:05:00.958061+0000 mgr.a (mgr.14355) 9692 : audit [DBG] from='client.214767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:01 smithi171 bash[25040]: audit 2024-09-14T02:05:00.958061+0000 mgr.a (mgr.14355) 9692 : audit [DBG] from='client.214767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:01.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:01 smithi007 bash[22722]: audit 2024-09-14T02:05:00.958061+0000 mgr.a (mgr.14355) 9692 : audit [DBG] from='client.214767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:02 smithi007 bash[22722]: cluster 2024-09-14T02:05:01.298939+0000 mgr.a (mgr.14355) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:02 smithi131 bash[24745]: cluster 2024-09-14T02:05:01.298939+0000 mgr.a (mgr.14355) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:02 smithi171 bash[25040]: cluster 2024-09-14T02:05:01.298939+0000 mgr.a (mgr.14355) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:04 smithi007 bash[22722]: cluster 2024-09-14T02:05:03.299696+0000 mgr.a (mgr.14355) 9694 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:04 smithi131 bash[24745]: cluster 2024-09-14T02:05:03.299696+0000 mgr.a (mgr.14355) 9694 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:04 smithi171 bash[25040]: cluster 2024-09-14T02:05:03.299696+0000 mgr.a (mgr.14355) 9694 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:06.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:06.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:06.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:06 smithi131 bash[24745]: cluster 2024-09-14T02:05:05.300460+0000 mgr.a (mgr.14355) 9695 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:06 smithi007 bash[22722]: cluster 2024-09-14T02:05:05.300460+0000 mgr.a (mgr.14355) 9695 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:06 smithi171 bash[25040]: cluster 2024-09-14T02:05:05.300460+0000 mgr.a (mgr.14355) 9695 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:07.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:07.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:07.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:07.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:07.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:07 smithi007 bash[22722]: audit 2024-09-14T02:05:06.734815+0000 mgr.a (mgr.14355) 9696 : audit [DBG] from='client.214842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:07 smithi131 bash[24745]: audit 2024-09-14T02:05:06.734815+0000 mgr.a (mgr.14355) 9696 : audit [DBG] from='client.214842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:07 smithi171 bash[25040]: audit 2024-09-14T02:05:06.734815+0000 mgr.a (mgr.14355) 9696 : audit [DBG] from='client.214842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:08 smithi007 bash[22722]: cluster 2024-09-14T02:05:07.303195+0000 mgr.a (mgr.14355) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:08 smithi131 bash[24745]: cluster 2024-09-14T02:05:07.303195+0000 mgr.a (mgr.14355) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:08 smithi171 bash[25040]: cluster 2024-09-14T02:05:07.303195+0000 mgr.a (mgr.14355) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:10 smithi007 bash[22722]: cluster 2024-09-14T02:05:09.304138+0000 mgr.a (mgr.14355) 9698 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:05:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:10 smithi131 bash[24745]: cluster 2024-09-14T02:05:09.304138+0000 mgr.a (mgr.14355) 9698 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:05:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:10 smithi171 bash[25040]: cluster 2024-09-14T02:05:09.304138+0000 mgr.a (mgr.14355) 9698 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:05:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:12.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:12.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:12.929 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:12.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:12 smithi007 bash[22722]: cluster 2024-09-14T02:05:11.306106+0000 mgr.a (mgr.14355) 9699 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:05:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:12 smithi131 bash[24745]: cluster 2024-09-14T02:05:11.306106+0000 mgr.a (mgr.14355) 9699 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:05:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:12 smithi171 bash[25040]: cluster 2024-09-14T02:05:11.306106+0000 mgr.a (mgr.14355) 9699 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:05:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:13 smithi007 bash[22722]: audit 2024-09-14T02:05:12.502268+0000 mgr.a (mgr.14355) 9700 : audit [DBG] from='client.214917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:13 smithi131 bash[24745]: audit 2024-09-14T02:05:12.502268+0000 mgr.a (mgr.14355) 9700 : audit [DBG] from='client.214917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:13 smithi171 bash[25040]: audit 2024-09-14T02:05:12.502268+0000 mgr.a (mgr.14355) 9700 : audit [DBG] from='client.214917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:14 smithi007 bash[22722]: cluster 2024-09-14T02:05:13.307057+0000 mgr.a (mgr.14355) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:14 smithi131 bash[24745]: cluster 2024-09-14T02:05:13.307057+0000 mgr.a (mgr.14355) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:14 smithi171 bash[25040]: cluster 2024-09-14T02:05:13.307057+0000 mgr.a (mgr.14355) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:16 smithi007 bash[22722]: cluster 2024-09-14T02:05:15.307842+0000 mgr.a (mgr.14355) 9702 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:16 smithi131 bash[24745]: cluster 2024-09-14T02:05:15.307842+0000 mgr.a (mgr.14355) 9702 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:16 smithi171 bash[25040]: cluster 2024-09-14T02:05:15.307842+0000 mgr.a (mgr.14355) 9702 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:17.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:17.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:17.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:18.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:18.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:18.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:18.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:18.720 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:18 smithi007 bash[22722]: cluster 2024-09-14T02:05:17.310021+0000 mgr.a (mgr.14355) 9703 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:19.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:18 smithi131 bash[24745]: cluster 2024-09-14T02:05:17.310021+0000 mgr.a (mgr.14355) 9703 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:18 smithi171 bash[25040]: cluster 2024-09-14T02:05:17.310021+0000 mgr.a (mgr.14355) 9703 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:19 smithi007 bash[22722]: audit 2024-09-14T02:05:18.270493+0000 mgr.a (mgr.14355) 9704 : audit [DBG] from='client.214995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:19 smithi131 bash[24745]: audit 2024-09-14T02:05:18.270493+0000 mgr.a (mgr.14355) 9704 : audit [DBG] from='client.214995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:19 smithi171 bash[25040]: audit 2024-09-14T02:05:18.270493+0000 mgr.a (mgr.14355) 9704 : audit [DBG] from='client.214995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:20 smithi007 bash[22722]: cluster 2024-09-14T02:05:19.311040+0000 mgr.a (mgr.14355) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:20 smithi131 bash[24745]: cluster 2024-09-14T02:05:19.311040+0000 mgr.a (mgr.14355) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:20 smithi171 bash[25040]: cluster 2024-09-14T02:05:19.311040+0000 mgr.a (mgr.14355) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:22 smithi007 bash[22722]: cluster 2024-09-14T02:05:21.313226+0000 mgr.a (mgr.14355) 9706 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:22 smithi131 bash[24745]: cluster 2024-09-14T02:05:21.313226+0000 mgr.a (mgr.14355) 9706 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:22 smithi171 bash[25040]: cluster 2024-09-14T02:05:21.313226+0000 mgr.a (mgr.14355) 9706 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:24.498 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:24.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:24 smithi007 bash[22722]: cluster 2024-09-14T02:05:23.314007+0000 mgr.a (mgr.14355) 9707 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:24 smithi007 bash[22722]: audit 2024-09-14T02:05:23.972241+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:05:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:24 smithi007 bash[22722]: audit 2024-09-14T02:05:24.057174+0000 mgr.a (mgr.14355) 9708 : audit [DBG] from='client.215073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:24 smithi131 bash[24745]: cluster 2024-09-14T02:05:23.314007+0000 mgr.a (mgr.14355) 9707 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:24 smithi131 bash[24745]: audit 2024-09-14T02:05:23.972241+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:05:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:24 smithi131 bash[24745]: audit 2024-09-14T02:05:24.057174+0000 mgr.a (mgr.14355) 9708 : audit [DBG] from='client.215073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:24 smithi171 bash[25040]: cluster 2024-09-14T02:05:23.314007+0000 mgr.a (mgr.14355) 9707 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:24 smithi171 bash[25040]: audit 2024-09-14T02:05:23.972241+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:05:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:24 smithi171 bash[25040]: audit 2024-09-14T02:05:24.057174+0000 mgr.a (mgr.14355) 9708 : audit [DBG] from='client.215073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:25.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22972]: debug 2024-09-14T02:05:25.560+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22972]: debug 2024-09-14T02:05:25.564+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22722]: audit 2024-09-14T02:05:24.813673+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22722]: audit 2024-09-14T02:05:24.815488+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22722]: audit 2024-09-14T02:05:24.825892+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22722]: audit 2024-09-14T02:05:24.830774+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:25 smithi007 bash[22722]: audit 2024-09-14T02:05:24.833489+0000 mgr.a (mgr.14355) 9709 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:25 smithi131 bash[24745]: audit 2024-09-14T02:05:24.813673+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:05:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:25 smithi131 bash[24745]: audit 2024-09-14T02:05:24.815488+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:05:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:25 smithi131 bash[24745]: audit 2024-09-14T02:05:24.825892+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:05:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:25 smithi131 bash[24745]: audit 2024-09-14T02:05:24.830774+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:25 smithi131 bash[24745]: audit 2024-09-14T02:05:24.833489+0000 mgr.a (mgr.14355) 9709 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:25 smithi171 bash[25040]: audit 2024-09-14T02:05:24.813673+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:25 smithi171 bash[25040]: audit 2024-09-14T02:05:24.815488+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:25 smithi171 bash[25040]: audit 2024-09-14T02:05:24.825892+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:25 smithi171 bash[25040]: audit 2024-09-14T02:05:24.830774+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:25 smithi171 bash[25040]: audit 2024-09-14T02:05:24.833489+0000 mgr.a (mgr.14355) 9709 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:05:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:26 smithi007 bash[22722]: cluster 2024-09-14T02:05:25.314498+0000 mgr.a (mgr.14355) 9710 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:26 smithi007 bash[22722]: audit 2024-09-14T02:05:25.564296+0000 mgr.a (mgr.14355) 9711 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:05:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:26 smithi007 bash[22722]: cephadm 2024-09-14T02:05:25.566446+0000 mgr.a (mgr.14355) 9712 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:05:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:26 smithi131 bash[24745]: cluster 2024-09-14T02:05:25.314498+0000 mgr.a (mgr.14355) 9710 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:26 smithi131 bash[24745]: audit 2024-09-14T02:05:25.564296+0000 mgr.a (mgr.14355) 9711 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:05:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:26 smithi131 bash[24745]: cephadm 2024-09-14T02:05:25.566446+0000 mgr.a (mgr.14355) 9712 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:05:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:26 smithi171 bash[25040]: cluster 2024-09-14T02:05:25.314498+0000 mgr.a (mgr.14355) 9710 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:26 smithi171 bash[25040]: audit 2024-09-14T02:05:25.564296+0000 mgr.a (mgr.14355) 9711 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:05:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:26 smithi171 bash[25040]: cephadm 2024-09-14T02:05:25.566446+0000 mgr.a (mgr.14355) 9712 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:05:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:28 smithi007 bash[22722]: cluster 2024-09-14T02:05:27.316694+0000 mgr.a (mgr.14355) 9713 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T02:05:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:28 smithi131 bash[24745]: cluster 2024-09-14T02:05:27.316694+0000 mgr.a (mgr.14355) 9713 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T02:05:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:28 smithi171 bash[25040]: cluster 2024-09-14T02:05:27.316694+0000 mgr.a (mgr.14355) 9713 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T02:05:29.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:29.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:29.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:30.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:30 smithi007 bash[22722]: cluster 2024-09-14T02:05:29.317477+0000 mgr.a (mgr.14355) 9714 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:05:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:30 smithi007 bash[22722]: audit 2024-09-14T02:05:29.834473+0000 mgr.a (mgr.14355) 9715 : audit [DBG] from='client.215256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:30 smithi131 bash[24745]: cluster 2024-09-14T02:05:29.317477+0000 mgr.a (mgr.14355) 9714 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:05:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:30 smithi131 bash[24745]: audit 2024-09-14T02:05:29.834473+0000 mgr.a (mgr.14355) 9715 : audit [DBG] from='client.215256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:30 smithi171 bash[25040]: cluster 2024-09-14T02:05:29.317477+0000 mgr.a (mgr.14355) 9714 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:05:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:30 smithi171 bash[25040]: audit 2024-09-14T02:05:29.834473+0000 mgr.a (mgr.14355) 9715 : audit [DBG] from='client.215256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:32 smithi007 bash[22722]: cluster 2024-09-14T02:05:31.319837+0000 mgr.a (mgr.14355) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:32 smithi131 bash[24745]: cluster 2024-09-14T02:05:31.319837+0000 mgr.a (mgr.14355) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:32 smithi171 bash[25040]: cluster 2024-09-14T02:05:31.319837+0000 mgr.a (mgr.14355) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:34 smithi007 bash[22722]: cluster 2024-09-14T02:05:33.320633+0000 mgr.a (mgr.14355) 9717 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:35.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:35.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:34 smithi131 bash[24745]: cluster 2024-09-14T02:05:33.320633+0000 mgr.a (mgr.14355) 9717 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:34 smithi171 bash[25040]: cluster 2024-09-14T02:05:33.320633+0000 mgr.a (mgr.14355) 9717 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:36.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:36.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:36.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:36 smithi007 bash[22722]: cluster 2024-09-14T02:05:35.321291+0000 mgr.a (mgr.14355) 9718 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:36 smithi007 bash[22722]: audit 2024-09-14T02:05:35.593726+0000 mgr.a (mgr.14355) 9719 : audit [DBG] from='client.215334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:36 smithi131 bash[24745]: cluster 2024-09-14T02:05:35.321291+0000 mgr.a (mgr.14355) 9718 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:36 smithi131 bash[24745]: audit 2024-09-14T02:05:35.593726+0000 mgr.a (mgr.14355) 9719 : audit [DBG] from='client.215334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:36 smithi171 bash[25040]: cluster 2024-09-14T02:05:35.321291+0000 mgr.a (mgr.14355) 9718 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:36 smithi171 bash[25040]: audit 2024-09-14T02:05:35.593726+0000 mgr.a (mgr.14355) 9719 : audit [DBG] from='client.215334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:38 smithi007 bash[22722]: cluster 2024-09-14T02:05:37.324063+0000 mgr.a (mgr.14355) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:38 smithi131 bash[24745]: cluster 2024-09-14T02:05:37.324063+0000 mgr.a (mgr.14355) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:38 smithi171 bash[25040]: cluster 2024-09-14T02:05:37.324063+0000 mgr.a (mgr.14355) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:05:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:41.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:41.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:40 smithi007 bash[22722]: cluster 2024-09-14T02:05:39.324816+0000 mgr.a (mgr.14355) 9721 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:40 smithi131 bash[24745]: cluster 2024-09-14T02:05:39.324816+0000 mgr.a (mgr.14355) 9721 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:40 smithi171 bash[25040]: cluster 2024-09-14T02:05:39.324816+0000 mgr.a (mgr.14355) 9721 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:41.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:41.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:41.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:41.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:41.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:42 smithi007 bash[22722]: cluster 2024-09-14T02:05:41.326060+0000 mgr.a (mgr.14355) 9722 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:42 smithi007 bash[22722]: audit 2024-09-14T02:05:41.375194+0000 mgr.a (mgr.14355) 9723 : audit [DBG] from='client.215412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:42 smithi131 bash[24745]: cluster 2024-09-14T02:05:41.326060+0000 mgr.a (mgr.14355) 9722 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:42 smithi131 bash[24745]: audit 2024-09-14T02:05:41.375194+0000 mgr.a (mgr.14355) 9723 : audit [DBG] from='client.215412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:42 smithi171 bash[25040]: cluster 2024-09-14T02:05:41.326060+0000 mgr.a (mgr.14355) 9722 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T02:05:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:42 smithi171 bash[25040]: audit 2024-09-14T02:05:41.375194+0000 mgr.a (mgr.14355) 9723 : audit [DBG] from='client.215412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:44 smithi007 bash[22722]: cluster 2024-09-14T02:05:43.326969+0000 mgr.a (mgr.14355) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:44 smithi131 bash[24745]: cluster 2024-09-14T02:05:43.326969+0000 mgr.a (mgr.14355) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:44 smithi171 bash[25040]: cluster 2024-09-14T02:05:43.326969+0000 mgr.a (mgr.14355) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:05:46.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:46.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:46 smithi007 bash[22722]: cluster 2024-09-14T02:05:45.327905+0000 mgr.a (mgr.14355) 9725 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:46 smithi131 bash[24745]: cluster 2024-09-14T02:05:45.327905+0000 mgr.a (mgr.14355) 9725 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:46 smithi171 bash[25040]: cluster 2024-09-14T02:05:45.327905+0000 mgr.a (mgr.14355) 9725 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:05:47.599 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:47.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:47.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:47 smithi007 bash[22722]: audit 2024-09-14T02:05:47.153358+0000 mgr.a (mgr.14355) 9726 : audit [DBG] from='client.215484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:47 smithi131 bash[24745]: audit 2024-09-14T02:05:47.153358+0000 mgr.a (mgr.14355) 9726 : audit [DBG] from='client.215484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:47 smithi171 bash[25040]: audit 2024-09-14T02:05:47.153358+0000 mgr.a (mgr.14355) 9726 : audit [DBG] from='client.215484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:48 smithi007 bash[22722]: cluster 2024-09-14T02:05:47.329324+0000 mgr.a (mgr.14355) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:48 smithi131 bash[24745]: cluster 2024-09-14T02:05:47.329324+0000 mgr.a (mgr.14355) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:48 smithi171 bash[25040]: cluster 2024-09-14T02:05:47.329324+0000 mgr.a (mgr.14355) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:50 smithi007 bash[22722]: cluster 2024-09-14T02:05:49.330190+0000 mgr.a (mgr.14355) 9728 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:50 smithi131 bash[24745]: cluster 2024-09-14T02:05:49.330190+0000 mgr.a (mgr.14355) 9728 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:50 smithi171 bash[25040]: cluster 2024-09-14T02:05:49.330190+0000 mgr.a (mgr.14355) 9728 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:52.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:52.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:52.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:52 smithi007 bash[22722]: cluster 2024-09-14T02:05:51.332404+0000 mgr.a (mgr.14355) 9729 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:52 smithi131 bash[24745]: cluster 2024-09-14T02:05:51.332404+0000 mgr.a (mgr.14355) 9729 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:52 smithi171 bash[25040]: cluster 2024-09-14T02:05:51.332404+0000 mgr.a (mgr.14355) 9729 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:53.370 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:53 smithi007 bash[22722]: audit 2024-09-14T02:05:52.937442+0000 mgr.a (mgr.14355) 9730 : audit [DBG] from='client.215559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:53 smithi131 bash[24745]: audit 2024-09-14T02:05:52.937442+0000 mgr.a (mgr.14355) 9730 : audit [DBG] from='client.215559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:53 smithi171 bash[25040]: audit 2024-09-14T02:05:52.937442+0000 mgr.a (mgr.14355) 9730 : audit [DBG] from='client.215559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:05:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:54 smithi007 bash[22722]: cluster 2024-09-14T02:05:53.332958+0000 mgr.a (mgr.14355) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:54 smithi131 bash[24745]: cluster 2024-09-14T02:05:53.332958+0000 mgr.a (mgr.14355) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:54 smithi171 bash[25040]: cluster 2024-09-14T02:05:53.332958+0000 mgr.a (mgr.14355) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:56 smithi007 bash[22722]: cluster 2024-09-14T02:05:55.333725+0000 mgr.a (mgr.14355) 9732 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:56 smithi131 bash[24745]: cluster 2024-09-14T02:05:55.333725+0000 mgr.a (mgr.14355) 9732 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:56 smithi171 bash[25040]: cluster 2024-09-14T02:05:55.333725+0000 mgr.a (mgr.14355) 9732 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:05:58.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:05:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:05:58.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:05:59.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:05:59.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:05:59.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:05:59.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:05:59.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:05:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:58 smithi007 bash[22722]: cluster 2024-09-14T02:05:57.336016+0000 mgr.a (mgr.14355) 9733 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:58 smithi131 bash[24745]: cluster 2024-09-14T02:05:57.336016+0000 mgr.a (mgr.14355) 9733 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:05:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:58 smithi171 bash[25040]: cluster 2024-09-14T02:05:57.336016+0000 mgr.a (mgr.14355) 9733 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:05:59 smithi007 bash[22722]: audit 2024-09-14T02:05:58.706838+0000 mgr.a (mgr.14355) 9734 : audit [DBG] from='client.215631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:05:59 smithi131 bash[24745]: audit 2024-09-14T02:05:58.706838+0000 mgr.a (mgr.14355) 9734 : audit [DBG] from='client.215631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:05:59 smithi171 bash[25040]: audit 2024-09-14T02:05:58.706838+0000 mgr.a (mgr.14355) 9734 : audit [DBG] from='client.215631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:00 smithi007 bash[22722]: cluster 2024-09-14T02:05:59.336959+0000 mgr.a (mgr.14355) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:00 smithi131 bash[24745]: cluster 2024-09-14T02:05:59.336959+0000 mgr.a (mgr.14355) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:00 smithi171 bash[25040]: cluster 2024-09-14T02:05:59.336959+0000 mgr.a (mgr.14355) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:02 smithi007 bash[22722]: cluster 2024-09-14T02:06:01.339211+0000 mgr.a (mgr.14355) 9736 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:02 smithi131 bash[24745]: cluster 2024-09-14T02:06:01.339211+0000 mgr.a (mgr.14355) 9736 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:02 smithi171 bash[25040]: cluster 2024-09-14T02:06:01.339211+0000 mgr.a (mgr.14355) 9736 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:04.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:04.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:04.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:04.913 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:04.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:04.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:04.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:04.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:04 smithi007 bash[22722]: cluster 2024-09-14T02:06:03.339973+0000 mgr.a (mgr.14355) 9737 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:04 smithi131 bash[24745]: cluster 2024-09-14T02:06:03.339973+0000 mgr.a (mgr.14355) 9737 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:04 smithi171 bash[25040]: cluster 2024-09-14T02:06:03.339973+0000 mgr.a (mgr.14355) 9737 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:05 smithi007 bash[22722]: audit 2024-09-14T02:06:04.483143+0000 mgr.a (mgr.14355) 9738 : audit [DBG] from='client.215709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:05 smithi131 bash[24745]: audit 2024-09-14T02:06:04.483143+0000 mgr.a (mgr.14355) 9738 : audit [DBG] from='client.215709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:05 smithi171 bash[25040]: audit 2024-09-14T02:06:04.483143+0000 mgr.a (mgr.14355) 9738 : audit [DBG] from='client.215709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:06 smithi131 bash[24745]: cluster 2024-09-14T02:06:05.341418+0000 mgr.a (mgr.14355) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:06 smithi171 bash[25040]: cluster 2024-09-14T02:06:05.341418+0000 mgr.a (mgr.14355) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:06 smithi007 bash[22722]: cluster 2024-09-14T02:06:05.341418+0000 mgr.a (mgr.14355) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:08 smithi131 bash[24745]: cluster 2024-09-14T02:06:07.343954+0000 mgr.a (mgr.14355) 9740 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:08 smithi171 bash[25040]: cluster 2024-09-14T02:06:07.343954+0000 mgr.a (mgr.14355) 9740 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:08 smithi007 bash[22722]: cluster 2024-09-14T02:06:07.343954+0000 mgr.a (mgr.14355) 9740 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:06:09.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:09.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:10.694 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:10.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:10 smithi131 bash[24745]: cluster 2024-09-14T02:06:09.344727+0000 mgr.a (mgr.14355) 9741 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:10 smithi171 bash[25040]: cluster 2024-09-14T02:06:09.344727+0000 mgr.a (mgr.14355) 9741 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:10 smithi007 bash[22722]: cluster 2024-09-14T02:06:09.344727+0000 mgr.a (mgr.14355) 9741 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:11 smithi131 bash[24745]: audit 2024-09-14T02:06:10.251614+0000 mgr.a (mgr.14355) 9742 : audit [DBG] from='client.215784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:11 smithi171 bash[25040]: audit 2024-09-14T02:06:10.251614+0000 mgr.a (mgr.14355) 9742 : audit [DBG] from='client.215784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:11 smithi007 bash[22722]: audit 2024-09-14T02:06:10.251614+0000 mgr.a (mgr.14355) 9742 : audit [DBG] from='client.215784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:12 smithi131 bash[24745]: cluster 2024-09-14T02:06:11.347488+0000 mgr.a (mgr.14355) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:06:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:12 smithi171 bash[25040]: cluster 2024-09-14T02:06:11.347488+0000 mgr.a (mgr.14355) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:06:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:12 smithi007 bash[22722]: cluster 2024-09-14T02:06:11.347488+0000 mgr.a (mgr.14355) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:06:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:14 smithi131 bash[24745]: cluster 2024-09-14T02:06:13.348270+0000 mgr.a (mgr.14355) 9744 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:14 smithi171 bash[25040]: cluster 2024-09-14T02:06:13.348270+0000 mgr.a (mgr.14355) 9744 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:14 smithi007 bash[22722]: cluster 2024-09-14T02:06:13.348270+0000 mgr.a (mgr.14355) 9744 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:15.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:15.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:15.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:16.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:16.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:16.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:16.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:16.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:16 smithi131 bash[24745]: cluster 2024-09-14T02:06:15.349487+0000 mgr.a (mgr.14355) 9745 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:16 smithi131 bash[24745]: audit 2024-09-14T02:06:16.029902+0000 mgr.a (mgr.14355) 9746 : audit [DBG] from='client.215859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:16 smithi171 bash[25040]: cluster 2024-09-14T02:06:15.349487+0000 mgr.a (mgr.14355) 9745 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:16 smithi171 bash[25040]: audit 2024-09-14T02:06:16.029902+0000 mgr.a (mgr.14355) 9746 : audit [DBG] from='client.215859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:16 smithi007 bash[22722]: cluster 2024-09-14T02:06:15.349487+0000 mgr.a (mgr.14355) 9745 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:06:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:16 smithi007 bash[22722]: audit 2024-09-14T02:06:16.029902+0000 mgr.a (mgr.14355) 9746 : audit [DBG] from='client.215859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:18 smithi131 bash[24745]: cluster 2024-09-14T02:06:17.351907+0000 mgr.a (mgr.14355) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:18 smithi171 bash[25040]: cluster 2024-09-14T02:06:17.351907+0000 mgr.a (mgr.14355) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:18 smithi007 bash[22722]: cluster 2024-09-14T02:06:17.351907+0000 mgr.a (mgr.14355) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:20 smithi131 bash[24745]: cluster 2024-09-14T02:06:19.352873+0000 mgr.a (mgr.14355) 9748 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:06:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:20 smithi171 bash[25040]: cluster 2024-09-14T02:06:19.352873+0000 mgr.a (mgr.14355) 9748 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:06:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:20 smithi007 bash[22722]: cluster 2024-09-14T02:06:19.352873+0000 mgr.a (mgr.14355) 9748 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:06:21.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:21.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:22.258 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:22 smithi131 bash[24745]: cluster 2024-09-14T02:06:21.354941+0000 mgr.a (mgr.14355) 9749 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:22 smithi131 bash[24745]: audit 2024-09-14T02:06:21.812854+0000 mgr.a (mgr.14355) 9750 : audit [DBG] from='client.215937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:22 smithi171 bash[25040]: cluster 2024-09-14T02:06:21.354941+0000 mgr.a (mgr.14355) 9749 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:22 smithi171 bash[25040]: audit 2024-09-14T02:06:21.812854+0000 mgr.a (mgr.14355) 9750 : audit [DBG] from='client.215937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:22 smithi007 bash[22722]: cluster 2024-09-14T02:06:21.354941+0000 mgr.a (mgr.14355) 9749 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:22 smithi007 bash[22722]: audit 2024-09-14T02:06:21.812854+0000 mgr.a (mgr.14355) 9750 : audit [DBG] from='client.215937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:25 smithi131 bash[24745]: cluster 2024-09-14T02:06:23.355844+0000 mgr.a (mgr.14355) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:06:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:25 smithi171 bash[25040]: cluster 2024-09-14T02:06:23.355844+0000 mgr.a (mgr.14355) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:06:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:24 smithi007 bash[22722]: cluster 2024-09-14T02:06:23.355844+0000 mgr.a (mgr.14355) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:06:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:26 smithi131 bash[24745]: audit 2024-09-14T02:06:25.620622+0000 mon.a (mon.0) 2052 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:06:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:26 smithi171 bash[25040]: audit 2024-09-14T02:06:25.620622+0000 mon.a (mon.0) 2052 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:06:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:26 smithi007 bash[22722]: audit 2024-09-14T02:06:25.620622+0000 mon.a (mon.0) 2052 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:06:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:27.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: cluster 2024-09-14T02:06:25.357253+0000 mgr.a (mgr.14355) 9752 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:06:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:26.244090+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:26.247913+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:26.990055+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:06:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:26.991012+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:06:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:26.999177+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:27 smithi131 bash[24745]: audit 2024-09-14T02:06:27.001995+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: cluster 2024-09-14T02:06:25.357253+0000 mgr.a (mgr.14355) 9752 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:26.244090+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:26.247913+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:26.990055+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:26.991012+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:26.999177+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:27 smithi171 bash[25040]: audit 2024-09-14T02:06:27.001995+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: cluster 2024-09-14T02:06:25.357253+0000 mgr.a (mgr.14355) 9752 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:06:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:26.244090+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:26.247913+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:26.990055+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:06:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:26.991012+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:06:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:26.999177+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:06:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22722]: audit 2024-09-14T02:06:27.001995+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:28.010 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22972]: debug 2024-09-14T02:06:27.739+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:06:28.010 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:06:27 smithi007 bash[22972]: debug 2024-09-14T02:06:27.755+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:06:28.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:28 smithi131 bash[24745]: audit 2024-09-14T02:06:27.004234+0000 mgr.a (mgr.14355) 9753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:28 smithi171 bash[25040]: audit 2024-09-14T02:06:27.004234+0000 mgr.a (mgr.14355) 9753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:28 smithi007 bash[22722]: audit 2024-09-14T02:06:27.004234+0000 mgr.a (mgr.14355) 9753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:06:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:29 smithi131 bash[24745]: cluster 2024-09-14T02:06:27.358593+0000 mgr.a (mgr.14355) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:06:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:29 smithi131 bash[24745]: audit 2024-09-14T02:06:27.590895+0000 mgr.a (mgr.14355) 9755 : audit [DBG] from='client.216060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:29 smithi131 bash[24745]: audit 2024-09-14T02:06:27.744990+0000 mgr.a (mgr.14355) 9756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:06:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:29 smithi131 bash[24745]: cephadm 2024-09-14T02:06:27.758639+0000 mgr.a (mgr.14355) 9757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:06:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:29 smithi171 bash[25040]: cluster 2024-09-14T02:06:27.358593+0000 mgr.a (mgr.14355) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:06:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:29 smithi171 bash[25040]: audit 2024-09-14T02:06:27.590895+0000 mgr.a (mgr.14355) 9755 : audit [DBG] from='client.216060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:29 smithi171 bash[25040]: audit 2024-09-14T02:06:27.744990+0000 mgr.a (mgr.14355) 9756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:06:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:29 smithi171 bash[25040]: cephadm 2024-09-14T02:06:27.758639+0000 mgr.a (mgr.14355) 9757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:06:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:29 smithi007 bash[22722]: cluster 2024-09-14T02:06:27.358593+0000 mgr.a (mgr.14355) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:06:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:29 smithi007 bash[22722]: audit 2024-09-14T02:06:27.590895+0000 mgr.a (mgr.14355) 9755 : audit [DBG] from='client.216060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:29 smithi007 bash[22722]: audit 2024-09-14T02:06:27.744990+0000 mgr.a (mgr.14355) 9756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:06:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:29 smithi007 bash[22722]: cephadm 2024-09-14T02:06:27.758639+0000 mgr.a (mgr.14355) 9757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:06:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:31 smithi131 bash[24745]: cluster 2024-09-14T02:06:29.359461+0000 mgr.a (mgr.14355) 9758 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:31 smithi171 bash[25040]: cluster 2024-09-14T02:06:29.359461+0000 mgr.a (mgr.14355) 9758 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:31 smithi007 bash[22722]: cluster 2024-09-14T02:06:29.359461+0000 mgr.a (mgr.14355) 9758 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:33 smithi131 bash[24745]: cluster 2024-09-14T02:06:31.361701+0000 mgr.a (mgr.14355) 9759 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:33 smithi171 bash[25040]: cluster 2024-09-14T02:06:31.361701+0000 mgr.a (mgr.14355) 9759 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:33 smithi007 bash[22722]: cluster 2024-09-14T02:06:31.361701+0000 mgr.a (mgr.14355) 9759 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:33.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:33.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:35 smithi171 bash[25040]: cluster 2024-09-14T02:06:33.362387+0000 mgr.a (mgr.14355) 9760 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:35 smithi171 bash[25040]: audit 2024-09-14T02:06:33.491466+0000 mgr.a (mgr.14355) 9761 : audit [DBG] from='client.216192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:35 smithi007 bash[22722]: cluster 2024-09-14T02:06:33.362387+0000 mgr.a (mgr.14355) 9760 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:35 smithi007 bash[22722]: audit 2024-09-14T02:06:33.491466+0000 mgr.a (mgr.14355) 9761 : audit [DBG] from='client.216192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:35 smithi131 bash[24745]: cluster 2024-09-14T02:06:33.362387+0000 mgr.a (mgr.14355) 9760 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:35 smithi131 bash[24745]: audit 2024-09-14T02:06:33.491466+0000 mgr.a (mgr.14355) 9761 : audit [DBG] from='client.216192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:37 smithi171 bash[25040]: cluster 2024-09-14T02:06:35.364624+0000 mgr.a (mgr.14355) 9762 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:37 smithi007 bash[22722]: cluster 2024-09-14T02:06:35.364624+0000 mgr.a (mgr.14355) 9762 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:37 smithi131 bash[24745]: cluster 2024-09-14T02:06:35.364624+0000 mgr.a (mgr.14355) 9762 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:38.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:38.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:38.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:39 smithi171 bash[25040]: cluster 2024-09-14T02:06:37.365404+0000 mgr.a (mgr.14355) 9763 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:39 smithi007 bash[22722]: cluster 2024-09-14T02:06:37.365404+0000 mgr.a (mgr.14355) 9763 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:39 smithi131 bash[24745]: cluster 2024-09-14T02:06:37.365404+0000 mgr.a (mgr.14355) 9763 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:39.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:39.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:39.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:41 smithi007 bash[22722]: audit 2024-09-14T02:06:39.259904+0000 mgr.a (mgr.14355) 9764 : audit [DBG] from='client.216270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:41 smithi007 bash[22722]: cluster 2024-09-14T02:06:39.366046+0000 mgr.a (mgr.14355) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:41 smithi131 bash[24745]: audit 2024-09-14T02:06:39.259904+0000 mgr.a (mgr.14355) 9764 : audit [DBG] from='client.216270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:41 smithi131 bash[24745]: cluster 2024-09-14T02:06:39.366046+0000 mgr.a (mgr.14355) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:41 smithi171 bash[25040]: audit 2024-09-14T02:06:39.259904+0000 mgr.a (mgr.14355) 9764 : audit [DBG] from='client.216270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:41 smithi171 bash[25040]: cluster 2024-09-14T02:06:39.366046+0000 mgr.a (mgr.14355) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:43 smithi007 bash[22722]: cluster 2024-09-14T02:06:41.368337+0000 mgr.a (mgr.14355) 9766 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:43 smithi131 bash[24745]: cluster 2024-09-14T02:06:41.368337+0000 mgr.a (mgr.14355) 9766 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:43 smithi171 bash[25040]: cluster 2024-09-14T02:06:41.368337+0000 mgr.a (mgr.14355) 9766 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:06:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:45.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:45.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:45.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:45.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:45.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:45 smithi007 bash[22722]: cluster 2024-09-14T02:06:43.369130+0000 mgr.a (mgr.14355) 9767 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:45 smithi131 bash[24745]: cluster 2024-09-14T02:06:43.369130+0000 mgr.a (mgr.14355) 9767 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:45 smithi171 bash[25040]: cluster 2024-09-14T02:06:43.369130+0000 mgr.a (mgr.14355) 9767 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:46 smithi007 bash[22722]: audit 2024-09-14T02:06:45.008483+0000 mgr.a (mgr.14355) 9768 : audit [DBG] from='client.216348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:46 smithi131 bash[24745]: audit 2024-09-14T02:06:45.008483+0000 mgr.a (mgr.14355) 9768 : audit [DBG] from='client.216348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:46 smithi171 bash[25040]: audit 2024-09-14T02:06:45.008483+0000 mgr.a (mgr.14355) 9768 : audit [DBG] from='client.216348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:47 smithi007 bash[22722]: cluster 2024-09-14T02:06:45.370520+0000 mgr.a (mgr.14355) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:47 smithi131 bash[24745]: cluster 2024-09-14T02:06:45.370520+0000 mgr.a (mgr.14355) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:47 smithi171 bash[25040]: cluster 2024-09-14T02:06:45.370520+0000 mgr.a (mgr.14355) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:49 smithi007 bash[22722]: cluster 2024-09-14T02:06:47.371318+0000 mgr.a (mgr.14355) 9770 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:49 smithi131 bash[24745]: cluster 2024-09-14T02:06:47.371318+0000 mgr.a (mgr.14355) 9770 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:49 smithi171 bash[25040]: cluster 2024-09-14T02:06:47.371318+0000 mgr.a (mgr.14355) 9770 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:51.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:51.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:51 smithi007 bash[22722]: cluster 2024-09-14T02:06:49.372111+0000 mgr.a (mgr.14355) 9771 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:51 smithi131 bash[24745]: cluster 2024-09-14T02:06:49.372111+0000 mgr.a (mgr.14355) 9771 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:51 smithi171 bash[25040]: cluster 2024-09-14T02:06:49.372111+0000 mgr.a (mgr.14355) 9771 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:52 smithi007 bash[22722]: audit 2024-09-14T02:06:50.785975+0000 mgr.a (mgr.14355) 9772 : audit [DBG] from='client.216426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:52 smithi131 bash[24745]: audit 2024-09-14T02:06:50.785975+0000 mgr.a (mgr.14355) 9772 : audit [DBG] from='client.216426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:52 smithi171 bash[25040]: audit 2024-09-14T02:06:50.785975+0000 mgr.a (mgr.14355) 9772 : audit [DBG] from='client.216426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:53 smithi007 bash[22722]: cluster 2024-09-14T02:06:51.374278+0000 mgr.a (mgr.14355) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:53 smithi131 bash[24745]: cluster 2024-09-14T02:06:51.374278+0000 mgr.a (mgr.14355) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:53 smithi171 bash[25040]: cluster 2024-09-14T02:06:51.374278+0000 mgr.a (mgr.14355) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:55 smithi007 bash[22722]: cluster 2024-09-14T02:06:53.375118+0000 mgr.a (mgr.14355) 9774 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:55 smithi131 bash[24745]: cluster 2024-09-14T02:06:53.375118+0000 mgr.a (mgr.14355) 9774 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:55 smithi171 bash[25040]: cluster 2024-09-14T02:06:53.375118+0000 mgr.a (mgr.14355) 9774 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:06:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:06:56.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:06:56.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:06:56.991 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:06:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:06:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:06:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:06:56.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:06:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:57 smithi007 bash[22722]: cluster 2024-09-14T02:06:55.377068+0000 mgr.a (mgr.14355) 9775 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:57 smithi131 bash[24745]: cluster 2024-09-14T02:06:55.377068+0000 mgr.a (mgr.14355) 9775 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:57 smithi171 bash[25040]: cluster 2024-09-14T02:06:55.377068+0000 mgr.a (mgr.14355) 9775 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:58 smithi007 bash[22722]: audit 2024-09-14T02:06:56.560585+0000 mgr.a (mgr.14355) 9776 : audit [DBG] from='client.216504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:58 smithi131 bash[24745]: audit 2024-09-14T02:06:56.560585+0000 mgr.a (mgr.14355) 9776 : audit [DBG] from='client.216504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:58 smithi171 bash[25040]: audit 2024-09-14T02:06:56.560585+0000 mgr.a (mgr.14355) 9776 : audit [DBG] from='client.216504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:06:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:06:59 smithi007 bash[22722]: cluster 2024-09-14T02:06:57.377943+0000 mgr.a (mgr.14355) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:06:59 smithi131 bash[24745]: cluster 2024-09-14T02:06:57.377943+0000 mgr.a (mgr.14355) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:06:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:06:59 smithi171 bash[25040]: cluster 2024-09-14T02:06:57.377943+0000 mgr.a (mgr.14355) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:01 smithi007 bash[22722]: cluster 2024-09-14T02:06:59.378747+0000 mgr.a (mgr.14355) 9778 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:01 smithi131 bash[24745]: cluster 2024-09-14T02:06:59.378747+0000 mgr.a (mgr.14355) 9778 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:01 smithi171 bash[25040]: cluster 2024-09-14T02:06:59.378747+0000 mgr.a (mgr.14355) 9778 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:01.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:01.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:01.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:02.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:02.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:03 smithi007 bash[22722]: cluster 2024-09-14T02:07:01.380902+0000 mgr.a (mgr.14355) 9779 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:03 smithi131 bash[24745]: cluster 2024-09-14T02:07:01.380902+0000 mgr.a (mgr.14355) 9779 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:03 smithi171 bash[25040]: cluster 2024-09-14T02:07:01.380902+0000 mgr.a (mgr.14355) 9779 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:04 smithi007 bash[22722]: audit 2024-09-14T02:07:02.324187+0000 mgr.a (mgr.14355) 9780 : audit [DBG] from='client.216576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:04 smithi131 bash[24745]: audit 2024-09-14T02:07:02.324187+0000 mgr.a (mgr.14355) 9780 : audit [DBG] from='client.216576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:04 smithi171 bash[25040]: audit 2024-09-14T02:07:02.324187+0000 mgr.a (mgr.14355) 9780 : audit [DBG] from='client.216576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:05 smithi007 bash[22722]: cluster 2024-09-14T02:07:03.381786+0000 mgr.a (mgr.14355) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:05 smithi131 bash[24745]: cluster 2024-09-14T02:07:03.381786+0000 mgr.a (mgr.14355) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:05 smithi171 bash[25040]: cluster 2024-09-14T02:07:03.381786+0000 mgr.a (mgr.14355) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:07 smithi007 bash[22722]: cluster 2024-09-14T02:07:05.383975+0000 mgr.a (mgr.14355) 9782 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:07 smithi131 bash[24745]: cluster 2024-09-14T02:07:05.383975+0000 mgr.a (mgr.14355) 9782 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:07 smithi171 bash[25040]: cluster 2024-09-14T02:07:05.383975+0000 mgr.a (mgr.14355) 9782 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:07.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:08.491 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:08.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:09 smithi007 bash[22722]: cluster 2024-09-14T02:07:07.384728+0000 mgr.a (mgr.14355) 9783 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:09 smithi007 bash[22722]: audit 2024-09-14T02:07:08.073260+0000 mgr.a (mgr.14355) 9784 : audit [DBG] from='client.216648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:09 smithi131 bash[24745]: cluster 2024-09-14T02:07:07.384728+0000 mgr.a (mgr.14355) 9783 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:09 smithi131 bash[24745]: audit 2024-09-14T02:07:08.073260+0000 mgr.a (mgr.14355) 9784 : audit [DBG] from='client.216648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:09 smithi171 bash[25040]: cluster 2024-09-14T02:07:07.384728+0000 mgr.a (mgr.14355) 9783 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:09 smithi171 bash[25040]: audit 2024-09-14T02:07:08.073260+0000 mgr.a (mgr.14355) 9784 : audit [DBG] from='client.216648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:11 smithi007 bash[22722]: cluster 2024-09-14T02:07:09.385614+0000 mgr.a (mgr.14355) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:11 smithi131 bash[24745]: cluster 2024-09-14T02:07:09.385614+0000 mgr.a (mgr.14355) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:11 smithi171 bash[25040]: cluster 2024-09-14T02:07:09.385614+0000 mgr.a (mgr.14355) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:13 smithi007 bash[22722]: cluster 2024-09-14T02:07:11.387871+0000 mgr.a (mgr.14355) 9786 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:13 smithi131 bash[24745]: cluster 2024-09-14T02:07:11.387871+0000 mgr.a (mgr.14355) 9786 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:13 smithi171 bash[25040]: cluster 2024-09-14T02:07:11.387871+0000 mgr.a (mgr.14355) 9786 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:14.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:14.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:14.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:15 smithi007 bash[22722]: cluster 2024-09-14T02:07:13.388795+0000 mgr.a (mgr.14355) 9787 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:15 smithi007 bash[22722]: audit 2024-09-14T02:07:13.828263+0000 mgr.a (mgr.14355) 9788 : audit [DBG] from='client.216723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:15 smithi131 bash[24745]: cluster 2024-09-14T02:07:13.388795+0000 mgr.a (mgr.14355) 9787 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:15 smithi131 bash[24745]: audit 2024-09-14T02:07:13.828263+0000 mgr.a (mgr.14355) 9788 : audit [DBG] from='client.216723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:15 smithi171 bash[25040]: cluster 2024-09-14T02:07:13.388795+0000 mgr.a (mgr.14355) 9787 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:15 smithi171 bash[25040]: audit 2024-09-14T02:07:13.828263+0000 mgr.a (mgr.14355) 9788 : audit [DBG] from='client.216723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:17 smithi007 bash[22722]: cluster 2024-09-14T02:07:15.391093+0000 mgr.a (mgr.14355) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:17 smithi131 bash[24745]: cluster 2024-09-14T02:07:15.391093+0000 mgr.a (mgr.14355) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:17 smithi171 bash[25040]: cluster 2024-09-14T02:07:15.391093+0000 mgr.a (mgr.14355) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:19.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:19.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:19 smithi007 bash[22722]: cluster 2024-09-14T02:07:17.391843+0000 mgr.a (mgr.14355) 9790 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:19 smithi131 bash[24745]: cluster 2024-09-14T02:07:17.391843+0000 mgr.a (mgr.14355) 9790 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:19 smithi171 bash[25040]: cluster 2024-09-14T02:07:17.391843+0000 mgr.a (mgr.14355) 9790 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:20.020 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:20.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:20.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:20.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:20.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:21 smithi007 bash[22722]: cluster 2024-09-14T02:07:19.392289+0000 mgr.a (mgr.14355) 9791 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:21 smithi007 bash[22722]: audit 2024-09-14T02:07:19.591807+0000 mgr.a (mgr.14355) 9792 : audit [DBG] from='client.216801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:21 smithi131 bash[24745]: cluster 2024-09-14T02:07:19.392289+0000 mgr.a (mgr.14355) 9791 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:21 smithi131 bash[24745]: audit 2024-09-14T02:07:19.591807+0000 mgr.a (mgr.14355) 9792 : audit [DBG] from='client.216801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:21 smithi171 bash[25040]: cluster 2024-09-14T02:07:19.392289+0000 mgr.a (mgr.14355) 9791 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:21 smithi171 bash[25040]: audit 2024-09-14T02:07:19.591807+0000 mgr.a (mgr.14355) 9792 : audit [DBG] from='client.216801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:23 smithi007 bash[22722]: cluster 2024-09-14T02:07:21.394635+0000 mgr.a (mgr.14355) 9793 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:23 smithi131 bash[24745]: cluster 2024-09-14T02:07:21.394635+0000 mgr.a (mgr.14355) 9793 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:23 smithi171 bash[25040]: cluster 2024-09-14T02:07:21.394635+0000 mgr.a (mgr.14355) 9793 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:25.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:25.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:25.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:25 smithi007 bash[22722]: cluster 2024-09-14T02:07:23.395414+0000 mgr.a (mgr.14355) 9794 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:25 smithi131 bash[24745]: cluster 2024-09-14T02:07:23.395414+0000 mgr.a (mgr.14355) 9794 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:25 smithi171 bash[25040]: cluster 2024-09-14T02:07:23.395414+0000 mgr.a (mgr.14355) 9794 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:25.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:27 smithi007 bash[22722]: audit 2024-09-14T02:07:25.359138+0000 mgr.a (mgr.14355) 9795 : audit [DBG] from='client.216879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:27 smithi007 bash[22722]: cluster 2024-09-14T02:07:25.398257+0000 mgr.a (mgr.14355) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:27 smithi131 bash[24745]: audit 2024-09-14T02:07:25.359138+0000 mgr.a (mgr.14355) 9795 : audit [DBG] from='client.216879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:27 smithi131 bash[24745]: cluster 2024-09-14T02:07:25.398257+0000 mgr.a (mgr.14355) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:27 smithi171 bash[25040]: audit 2024-09-14T02:07:25.359138+0000 mgr.a (mgr.14355) 9795 : audit [DBG] from='client.216879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:27 smithi171 bash[25040]: cluster 2024-09-14T02:07:25.398257+0000 mgr.a (mgr.14355) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:28 smithi007 bash[22722]: audit 2024-09-14T02:07:27.815244+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:07:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:28 smithi131 bash[24745]: audit 2024-09-14T02:07:27.815244+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:07:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:28 smithi171 bash[25040]: audit 2024-09-14T02:07:27.815244+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:07:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: cluster 2024-09-14T02:07:27.399311+0000 mgr.a (mgr.14355) 9797 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:07:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:28.425338+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:28.428974+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:28.431979+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:28.435995+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:29.091772+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:29.093128+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:29.103453+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22722]: audit 2024-09-14T02:07:29.108267+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: cluster 2024-09-14T02:07:27.399311+0000 mgr.a (mgr.14355) 9797 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:07:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:28.425338+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:28.428974+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:28.431979+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:28.435995+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:29.091772+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:29.093128+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:29.103453+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:29 smithi131 bash[24745]: audit 2024-09-14T02:07:29.108267+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: cluster 2024-09-14T02:07:27.399311+0000 mgr.a (mgr.14355) 9797 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:07:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:28.425338+0000 mon.a (mon.0) 2060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:28.428974+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:28.431979+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:28.435995+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:29.091772+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:29.093128+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:29.103453+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:07:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:29 smithi171 bash[25040]: audit 2024-09-14T02:07:29.108267+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:30.189 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22972]: debug 2024-09-14T02:07:29.850+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:07:30.189 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:07:29 smithi007 bash[22972]: debug 2024-09-14T02:07:29.850+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:07:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:30 smithi007 bash[22722]: audit 2024-09-14T02:07:29.110668+0000 mgr.a (mgr.14355) 9798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:30 smithi131 bash[24745]: audit 2024-09-14T02:07:29.110668+0000 mgr.a (mgr.14355) 9798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:30 smithi171 bash[25040]: audit 2024-09-14T02:07:29.110668+0000 mgr.a (mgr.14355) 9798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:07:30.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:30.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:31 smithi007 bash[22722]: cluster 2024-09-14T02:07:29.400279+0000 mgr.a (mgr.14355) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:07:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:31 smithi007 bash[22722]: audit 2024-09-14T02:07:29.856053+0000 mgr.a (mgr.14355) 9800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:07:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:31 smithi007 bash[22722]: cephadm 2024-09-14T02:07:29.857210+0000 mgr.a (mgr.14355) 9801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:07:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:31 smithi131 bash[24745]: cluster 2024-09-14T02:07:29.400279+0000 mgr.a (mgr.14355) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:07:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:31 smithi131 bash[24745]: audit 2024-09-14T02:07:29.856053+0000 mgr.a (mgr.14355) 9800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:07:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:31 smithi131 bash[24745]: cephadm 2024-09-14T02:07:29.857210+0000 mgr.a (mgr.14355) 9801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:07:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:31 smithi171 bash[25040]: cluster 2024-09-14T02:07:29.400279+0000 mgr.a (mgr.14355) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:07:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:31 smithi171 bash[25040]: audit 2024-09-14T02:07:29.856053+0000 mgr.a (mgr.14355) 9800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:07:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:31 smithi171 bash[25040]: cephadm 2024-09-14T02:07:29.857210+0000 mgr.a (mgr.14355) 9801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:07:31.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:31.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:31.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:31.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:31.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:32 smithi007 bash[22722]: audit 2024-09-14T02:07:31.128731+0000 mgr.a (mgr.14355) 9802 : audit [DBG] from='client.217059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:32 smithi131 bash[24745]: audit 2024-09-14T02:07:31.128731+0000 mgr.a (mgr.14355) 9802 : audit [DBG] from='client.217059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:32 smithi171 bash[25040]: audit 2024-09-14T02:07:31.128731+0000 mgr.a (mgr.14355) 9802 : audit [DBG] from='client.217059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:33 smithi007 bash[22722]: cluster 2024-09-14T02:07:31.401573+0000 mgr.a (mgr.14355) 9803 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:33 smithi131 bash[24745]: cluster 2024-09-14T02:07:31.401573+0000 mgr.a (mgr.14355) 9803 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:33 smithi171 bash[25040]: cluster 2024-09-14T02:07:31.401573+0000 mgr.a (mgr.14355) 9803 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:34 smithi131 bash[24745]: cluster 2024-09-14T02:07:33.402485+0000 mgr.a (mgr.14355) 9804 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:07:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:34 smithi171 bash[25040]: cluster 2024-09-14T02:07:33.402485+0000 mgr.a (mgr.14355) 9804 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:07:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:34 smithi007 bash[22722]: cluster 2024-09-14T02:07:33.402485+0000 mgr.a (mgr.14355) 9804 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:07:36.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:36.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:36.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:36 smithi131 bash[24745]: cluster 2024-09-14T02:07:35.404720+0000 mgr.a (mgr.14355) 9805 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:36 smithi171 bash[25040]: cluster 2024-09-14T02:07:35.404720+0000 mgr.a (mgr.14355) 9805 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:36 smithi007 bash[22722]: cluster 2024-09-14T02:07:35.404720+0000 mgr.a (mgr.14355) 9805 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:37.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:37.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:37.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:37 smithi131 bash[24745]: audit 2024-09-14T02:07:36.889893+0000 mgr.a (mgr.14355) 9806 : audit [DBG] from='client.217137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:37 smithi171 bash[25040]: audit 2024-09-14T02:07:36.889893+0000 mgr.a (mgr.14355) 9806 : audit [DBG] from='client.217137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:37 smithi007 bash[22722]: audit 2024-09-14T02:07:36.889893+0000 mgr.a (mgr.14355) 9806 : audit [DBG] from='client.217137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:38 smithi131 bash[24745]: cluster 2024-09-14T02:07:37.405589+0000 mgr.a (mgr.14355) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:38 smithi171 bash[25040]: cluster 2024-09-14T02:07:37.405589+0000 mgr.a (mgr.14355) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:38 smithi007 bash[22722]: cluster 2024-09-14T02:07:37.405589+0000 mgr.a (mgr.14355) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:40 smithi131 bash[24745]: cluster 2024-09-14T02:07:39.406407+0000 mgr.a (mgr.14355) 9808 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:40 smithi171 bash[25040]: cluster 2024-09-14T02:07:39.406407+0000 mgr.a (mgr.14355) 9808 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:40 smithi007 bash[22722]: cluster 2024-09-14T02:07:39.406407+0000 mgr.a (mgr.14355) 9808 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:42.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:42.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:42 smithi131 bash[24745]: cluster 2024-09-14T02:07:41.408618+0000 mgr.a (mgr.14355) 9809 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:42 smithi171 bash[25040]: cluster 2024-09-14T02:07:41.408618+0000 mgr.a (mgr.14355) 9809 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:42 smithi007 bash[22722]: cluster 2024-09-14T02:07:41.408618+0000 mgr.a (mgr.14355) 9809 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:07:43.104 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:43 smithi131 bash[24745]: audit 2024-09-14T02:07:42.664623+0000 mgr.a (mgr.14355) 9810 : audit [DBG] from='client.217212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:43 smithi171 bash[25040]: audit 2024-09-14T02:07:42.664623+0000 mgr.a (mgr.14355) 9810 : audit [DBG] from='client.217212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:43 smithi007 bash[22722]: audit 2024-09-14T02:07:42.664623+0000 mgr.a (mgr.14355) 9810 : audit [DBG] from='client.217212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:44 smithi131 bash[24745]: cluster 2024-09-14T02:07:43.409560+0000 mgr.a (mgr.14355) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:44 smithi171 bash[25040]: cluster 2024-09-14T02:07:43.409560+0000 mgr.a (mgr.14355) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:44 smithi007 bash[22722]: cluster 2024-09-14T02:07:43.409560+0000 mgr.a (mgr.14355) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:46 smithi131 bash[24745]: cluster 2024-09-14T02:07:45.411772+0000 mgr.a (mgr.14355) 9812 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:46 smithi171 bash[25040]: cluster 2024-09-14T02:07:45.411772+0000 mgr.a (mgr.14355) 9812 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:46 smithi007 bash[22722]: cluster 2024-09-14T02:07:45.411772+0000 mgr.a (mgr.14355) 9812 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:48.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:48 smithi131 bash[24745]: cluster 2024-09-14T02:07:47.412553+0000 mgr.a (mgr.14355) 9813 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:48 smithi171 bash[25040]: cluster 2024-09-14T02:07:47.412553+0000 mgr.a (mgr.14355) 9813 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:48.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:48 smithi007 bash[22722]: cluster 2024-09-14T02:07:47.412553+0000 mgr.a (mgr.14355) 9813 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:49 smithi131 bash[24745]: audit 2024-09-14T02:07:48.445318+0000 mgr.a (mgr.14355) 9814 : audit [DBG] from='client.217287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:49 smithi171 bash[25040]: audit 2024-09-14T02:07:48.445318+0000 mgr.a (mgr.14355) 9814 : audit [DBG] from='client.217287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:49 smithi007 bash[22722]: audit 2024-09-14T02:07:48.445318+0000 mgr.a (mgr.14355) 9814 : audit [DBG] from='client.217287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:50 smithi131 bash[24745]: cluster 2024-09-14T02:07:49.413515+0000 mgr.a (mgr.14355) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:50 smithi171 bash[25040]: cluster 2024-09-14T02:07:49.413515+0000 mgr.a (mgr.14355) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:50 smithi007 bash[22722]: cluster 2024-09-14T02:07:49.413515+0000 mgr.a (mgr.14355) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:52 smithi131 bash[24745]: cluster 2024-09-14T02:07:51.415800+0000 mgr.a (mgr.14355) 9816 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:52 smithi171 bash[25040]: cluster 2024-09-14T02:07:51.415800+0000 mgr.a (mgr.14355) 9816 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:52 smithi007 bash[22722]: cluster 2024-09-14T02:07:51.415800+0000 mgr.a (mgr.14355) 9816 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:53.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:53.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:53.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:07:54.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:07:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:07:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:07:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:07:54.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:07:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:54 smithi131 bash[24745]: cluster 2024-09-14T02:07:53.416545+0000 mgr.a (mgr.14355) 9817 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:54 smithi171 bash[25040]: cluster 2024-09-14T02:07:53.416545+0000 mgr.a (mgr.14355) 9817 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:54 smithi007 bash[22722]: cluster 2024-09-14T02:07:53.416545+0000 mgr.a (mgr.14355) 9817 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:55 smithi131 bash[24745]: audit 2024-09-14T02:07:54.227728+0000 mgr.a (mgr.14355) 9818 : audit [DBG] from='client.217362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:55 smithi171 bash[25040]: audit 2024-09-14T02:07:54.227728+0000 mgr.a (mgr.14355) 9818 : audit [DBG] from='client.217362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:55 smithi007 bash[22722]: audit 2024-09-14T02:07:54.227728+0000 mgr.a (mgr.14355) 9818 : audit [DBG] from='client.217362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:07:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:56 smithi171 bash[25040]: cluster 2024-09-14T02:07:55.418876+0000 mgr.a (mgr.14355) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:56 smithi007 bash[22722]: cluster 2024-09-14T02:07:55.418876+0000 mgr.a (mgr.14355) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:56 smithi131 bash[24745]: cluster 2024-09-14T02:07:55.418876+0000 mgr.a (mgr.14355) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:07:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:07:58 smithi171 bash[25040]: cluster 2024-09-14T02:07:57.419659+0000 mgr.a (mgr.14355) 9820 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:07:58 smithi007 bash[22722]: cluster 2024-09-14T02:07:57.419659+0000 mgr.a (mgr.14355) 9820 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:07:58 smithi131 bash[24745]: cluster 2024-09-14T02:07:57.419659+0000 mgr.a (mgr.14355) 9820 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:07:59.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:07:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:07:59.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:00.421 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:00.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:00.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:00.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:00.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:00 smithi171 bash[25040]: cluster 2024-09-14T02:07:59.420437+0000 mgr.a (mgr.14355) 9821 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:00 smithi171 bash[25040]: audit 2024-09-14T02:08:00.003531+0000 mgr.a (mgr.14355) 9822 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:00 smithi007 bash[22722]: cluster 2024-09-14T02:07:59.420437+0000 mgr.a (mgr.14355) 9821 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:00 smithi007 bash[22722]: audit 2024-09-14T02:08:00.003531+0000 mgr.a (mgr.14355) 9822 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:00 smithi131 bash[24745]: cluster 2024-09-14T02:07:59.420437+0000 mgr.a (mgr.14355) 9821 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:00 smithi131 bash[24745]: audit 2024-09-14T02:08:00.003531+0000 mgr.a (mgr.14355) 9822 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:02 smithi007 bash[22722]: cluster 2024-09-14T02:08:01.423399+0000 mgr.a (mgr.14355) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:02 smithi131 bash[24745]: cluster 2024-09-14T02:08:01.423399+0000 mgr.a (mgr.14355) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:02 smithi171 bash[25040]: cluster 2024-09-14T02:08:01.423399+0000 mgr.a (mgr.14355) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:04 smithi007 bash[22722]: cluster 2024-09-14T02:08:03.424377+0000 mgr.a (mgr.14355) 9824 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:04 smithi131 bash[24745]: cluster 2024-09-14T02:08:03.424377+0000 mgr.a (mgr.14355) 9824 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:04 smithi171 bash[25040]: cluster 2024-09-14T02:08:03.424377+0000 mgr.a (mgr.14355) 9824 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:06.179 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:06.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:06 smithi007 bash[22722]: cluster 2024-09-14T02:08:05.425642+0000 mgr.a (mgr.14355) 9825 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:06 smithi007 bash[22722]: audit 2024-09-14T02:08:05.754729+0000 mgr.a (mgr.14355) 9826 : audit [DBG] from='client.217512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:06 smithi131 bash[24745]: cluster 2024-09-14T02:08:05.425642+0000 mgr.a (mgr.14355) 9825 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:06 smithi131 bash[24745]: audit 2024-09-14T02:08:05.754729+0000 mgr.a (mgr.14355) 9826 : audit [DBG] from='client.217512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:06 smithi171 bash[25040]: cluster 2024-09-14T02:08:05.425642+0000 mgr.a (mgr.14355) 9825 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:06 smithi171 bash[25040]: audit 2024-09-14T02:08:05.754729+0000 mgr.a (mgr.14355) 9826 : audit [DBG] from='client.217512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:08 smithi007 bash[22722]: cluster 2024-09-14T02:08:07.426620+0000 mgr.a (mgr.14355) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:08 smithi131 bash[24745]: cluster 2024-09-14T02:08:07.426620+0000 mgr.a (mgr.14355) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:08 smithi171 bash[25040]: cluster 2024-09-14T02:08:07.426620+0000 mgr.a (mgr.14355) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:10 smithi007 bash[22722]: cluster 2024-09-14T02:08:09.427411+0000 mgr.a (mgr.14355) 9828 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:10 smithi131 bash[24745]: cluster 2024-09-14T02:08:09.427411+0000 mgr.a (mgr.14355) 9828 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:10 smithi171 bash[25040]: cluster 2024-09-14T02:08:09.427411+0000 mgr.a (mgr.14355) 9828 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:11.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:11.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:11.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:12 smithi007 bash[22722]: cluster 2024-09-14T02:08:11.429589+0000 mgr.a (mgr.14355) 9829 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:12 smithi007 bash[22722]: audit 2024-09-14T02:08:11.512922+0000 mgr.a (mgr.14355) 9830 : audit [DBG] from='client.217590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:12 smithi131 bash[24745]: cluster 2024-09-14T02:08:11.429589+0000 mgr.a (mgr.14355) 9829 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:12 smithi131 bash[24745]: audit 2024-09-14T02:08:11.512922+0000 mgr.a (mgr.14355) 9830 : audit [DBG] from='client.217590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:12 smithi171 bash[25040]: cluster 2024-09-14T02:08:11.429589+0000 mgr.a (mgr.14355) 9829 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:12 smithi171 bash[25040]: audit 2024-09-14T02:08:11.512922+0000 mgr.a (mgr.14355) 9830 : audit [DBG] from='client.217590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:14 smithi007 bash[22722]: cluster 2024-09-14T02:08:13.430665+0000 mgr.a (mgr.14355) 9831 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:14 smithi131 bash[24745]: cluster 2024-09-14T02:08:13.430665+0000 mgr.a (mgr.14355) 9831 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:14 smithi171 bash[25040]: cluster 2024-09-14T02:08:13.430665+0000 mgr.a (mgr.14355) 9831 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:16.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:16.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:16.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:16 smithi007 bash[22722]: cluster 2024-09-14T02:08:15.432985+0000 mgr.a (mgr.14355) 9832 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:16 smithi131 bash[24745]: cluster 2024-09-14T02:08:15.432985+0000 mgr.a (mgr.14355) 9832 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:16 smithi171 bash[25040]: cluster 2024-09-14T02:08:15.432985+0000 mgr.a (mgr.14355) 9832 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:17.696 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:17.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:18 smithi007 bash[22722]: audit 2024-09-14T02:08:17.270356+0000 mgr.a (mgr.14355) 9833 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:18 smithi007 bash[22722]: cluster 2024-09-14T02:08:17.433556+0000 mgr.a (mgr.14355) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:18 smithi131 bash[24745]: audit 2024-09-14T02:08:17.270356+0000 mgr.a (mgr.14355) 9833 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:18 smithi131 bash[24745]: cluster 2024-09-14T02:08:17.433556+0000 mgr.a (mgr.14355) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:18 smithi171 bash[25040]: audit 2024-09-14T02:08:17.270356+0000 mgr.a (mgr.14355) 9833 : audit [DBG] from='client.217665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:18 smithi171 bash[25040]: cluster 2024-09-14T02:08:17.433556+0000 mgr.a (mgr.14355) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:20 smithi007 bash[22722]: cluster 2024-09-14T02:08:19.434601+0000 mgr.a (mgr.14355) 9835 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:20 smithi131 bash[24745]: cluster 2024-09-14T02:08:19.434601+0000 mgr.a (mgr.14355) 9835 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:20 smithi171 bash[25040]: cluster 2024-09-14T02:08:19.434601+0000 mgr.a (mgr.14355) 9835 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:22.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:22.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:22 smithi007 bash[22722]: cluster 2024-09-14T02:08:21.436916+0000 mgr.a (mgr.14355) 9836 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:22 smithi131 bash[24745]: cluster 2024-09-14T02:08:21.436916+0000 mgr.a (mgr.14355) 9836 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:22 smithi171 bash[25040]: cluster 2024-09-14T02:08:21.436916+0000 mgr.a (mgr.14355) 9836 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:23.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:23.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:23.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:23.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:23.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:23 smithi007 bash[22722]: audit 2024-09-14T02:08:23.032565+0000 mgr.a (mgr.14355) 9837 : audit [DBG] from='client.217740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:23 smithi131 bash[24745]: audit 2024-09-14T02:08:23.032565+0000 mgr.a (mgr.14355) 9837 : audit [DBG] from='client.217740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:23 smithi171 bash[25040]: audit 2024-09-14T02:08:23.032565+0000 mgr.a (mgr.14355) 9837 : audit [DBG] from='client.217740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:24 smithi007 bash[22722]: cluster 2024-09-14T02:08:23.437409+0000 mgr.a (mgr.14355) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:24 smithi131 bash[24745]: cluster 2024-09-14T02:08:23.437409+0000 mgr.a (mgr.14355) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:24 smithi171 bash[25040]: cluster 2024-09-14T02:08:23.437409+0000 mgr.a (mgr.14355) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:26 smithi007 bash[22722]: cluster 2024-09-14T02:08:25.439556+0000 mgr.a (mgr.14355) 9839 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:26 smithi131 bash[24745]: cluster 2024-09-14T02:08:25.439556+0000 mgr.a (mgr.14355) 9839 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:26 smithi171 bash[25040]: cluster 2024-09-14T02:08:25.439556+0000 mgr.a (mgr.14355) 9839 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:28.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:28 smithi007 bash[22722]: cluster 2024-09-14T02:08:27.440326+0000 mgr.a (mgr.14355) 9840 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:29.218 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:29.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:28 smithi131 bash[24745]: cluster 2024-09-14T02:08:27.440326+0000 mgr.a (mgr.14355) 9840 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:28 smithi171 bash[25040]: cluster 2024-09-14T02:08:27.440326+0000 mgr.a (mgr.14355) 9840 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:29 smithi007 bash[22722]: audit 2024-09-14T02:08:28.781637+0000 mgr.a (mgr.14355) 9841 : audit [DBG] from='client.217818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:29 smithi007 bash[22722]: audit 2024-09-14T02:08:29.909747+0000 mon.a (mon.0) 2068 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:08:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:29 smithi131 bash[24745]: audit 2024-09-14T02:08:28.781637+0000 mgr.a (mgr.14355) 9841 : audit [DBG] from='client.217818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:29 smithi131 bash[24745]: audit 2024-09-14T02:08:29.909747+0000 mon.a (mon.0) 2068 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:08:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:29 smithi171 bash[25040]: audit 2024-09-14T02:08:28.781637+0000 mgr.a (mgr.14355) 9841 : audit [DBG] from='client.217818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:29 smithi171 bash[25040]: audit 2024-09-14T02:08:29.909747+0000 mon.a (mon.0) 2068 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:08:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:30 smithi007 bash[22722]: cluster 2024-09-14T02:08:29.441262+0000 mgr.a (mgr.14355) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:30 smithi007 bash[22722]: audit 2024-09-14T02:08:30.748160+0000 mon.a (mon.0) 2069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:08:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:30 smithi007 bash[22722]: audit 2024-09-14T02:08:30.749867+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:08:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:30 smithi007 bash[22722]: audit 2024-09-14T02:08:30.760877+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:08:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:30 smithi007 bash[22722]: audit 2024-09-14T02:08:30.764091+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:30 smithi131 bash[24745]: cluster 2024-09-14T02:08:29.441262+0000 mgr.a (mgr.14355) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:30 smithi131 bash[24745]: audit 2024-09-14T02:08:30.748160+0000 mon.a (mon.0) 2069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:08:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:30 smithi131 bash[24745]: audit 2024-09-14T02:08:30.749867+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:08:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:30 smithi131 bash[24745]: audit 2024-09-14T02:08:30.760877+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:08:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:30 smithi131 bash[24745]: audit 2024-09-14T02:08:30.764091+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:30 smithi171 bash[25040]: cluster 2024-09-14T02:08:29.441262+0000 mgr.a (mgr.14355) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:30 smithi171 bash[25040]: audit 2024-09-14T02:08:30.748160+0000 mon.a (mon.0) 2069 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:08:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:30 smithi171 bash[25040]: audit 2024-09-14T02:08:30.749867+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:08:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:30 smithi171 bash[25040]: audit 2024-09-14T02:08:30.760877+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:08:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:30 smithi171 bash[25040]: audit 2024-09-14T02:08:30.764091+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:31.950 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:08:31 smithi007 bash[22972]: debug 2024-09-14T02:08:31.529+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:08:31.950 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:08:31 smithi007 bash[22972]: debug 2024-09-14T02:08:31.529+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:08:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:31 smithi007 bash[22722]: audit 2024-09-14T02:08:30.766337+0000 mgr.a (mgr.14355) 9843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:31 smithi131 bash[24745]: audit 2024-09-14T02:08:30.766337+0000 mgr.a (mgr.14355) 9843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:31 smithi171 bash[25040]: audit 2024-09-14T02:08:30.766337+0000 mgr.a (mgr.14355) 9843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:08:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:32 smithi007 bash[22722]: cluster 2024-09-14T02:08:31.442560+0000 mgr.a (mgr.14355) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:32 smithi007 bash[22722]: audit 2024-09-14T02:08:31.532148+0000 mgr.a (mgr.14355) 9845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:08:33.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:32 smithi007 bash[22722]: cephadm 2024-09-14T02:08:31.534143+0000 mgr.a (mgr.14355) 9846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:08:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:32 smithi131 bash[24745]: cluster 2024-09-14T02:08:31.442560+0000 mgr.a (mgr.14355) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:32 smithi131 bash[24745]: audit 2024-09-14T02:08:31.532148+0000 mgr.a (mgr.14355) 9845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:08:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:32 smithi131 bash[24745]: cephadm 2024-09-14T02:08:31.534143+0000 mgr.a (mgr.14355) 9846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:08:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:32 smithi171 bash[25040]: cluster 2024-09-14T02:08:31.442560+0000 mgr.a (mgr.14355) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:32 smithi171 bash[25040]: audit 2024-09-14T02:08:31.532148+0000 mgr.a (mgr.14355) 9845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:08:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:32 smithi171 bash[25040]: cephadm 2024-09-14T02:08:31.534143+0000 mgr.a (mgr.14355) 9846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:08:34.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:34.220 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:34.964 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:34 smithi131 bash[24745]: cluster 2024-09-14T02:08:33.443326+0000 mgr.a (mgr.14355) 9847 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:34 smithi171 bash[25040]: cluster 2024-09-14T02:08:33.443326+0000 mgr.a (mgr.14355) 9847 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:34 smithi007 bash[22722]: cluster 2024-09-14T02:08:33.443326+0000 mgr.a (mgr.14355) 9847 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:35 smithi131 bash[24745]: audit 2024-09-14T02:08:34.548995+0000 mgr.a (mgr.14355) 9848 : audit [DBG] from='client.217998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:35 smithi171 bash[25040]: audit 2024-09-14T02:08:34.548995+0000 mgr.a (mgr.14355) 9848 : audit [DBG] from='client.217998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:35 smithi007 bash[22722]: audit 2024-09-14T02:08:34.548995+0000 mgr.a (mgr.14355) 9848 : audit [DBG] from='client.217998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:36 smithi131 bash[24745]: cluster 2024-09-14T02:08:35.445661+0000 mgr.a (mgr.14355) 9849 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:36 smithi171 bash[25040]: cluster 2024-09-14T02:08:35.445661+0000 mgr.a (mgr.14355) 9849 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:36 smithi007 bash[22722]: cluster 2024-09-14T02:08:35.445661+0000 mgr.a (mgr.14355) 9849 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:38 smithi131 bash[24745]: cluster 2024-09-14T02:08:37.446455+0000 mgr.a (mgr.14355) 9850 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:38 smithi171 bash[25040]: cluster 2024-09-14T02:08:37.446455+0000 mgr.a (mgr.14355) 9850 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:38 smithi007 bash[22722]: cluster 2024-09-14T02:08:37.446455+0000 mgr.a (mgr.14355) 9850 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:39.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:39.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:39.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:40.731 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:40 smithi131 bash[24745]: cluster 2024-09-14T02:08:39.447185+0000 mgr.a (mgr.14355) 9851 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:40 smithi171 bash[25040]: cluster 2024-09-14T02:08:39.447185+0000 mgr.a (mgr.14355) 9851 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:40 smithi007 bash[22722]: cluster 2024-09-14T02:08:39.447185+0000 mgr.a (mgr.14355) 9851 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:41 smithi131 bash[24745]: audit 2024-09-14T02:08:40.301612+0000 mgr.a (mgr.14355) 9852 : audit [DBG] from='client.218073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:41 smithi171 bash[25040]: audit 2024-09-14T02:08:40.301612+0000 mgr.a (mgr.14355) 9852 : audit [DBG] from='client.218073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:41 smithi007 bash[22722]: audit 2024-09-14T02:08:40.301612+0000 mgr.a (mgr.14355) 9852 : audit [DBG] from='client.218073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:42 smithi131 bash[24745]: cluster 2024-09-14T02:08:41.449867+0000 mgr.a (mgr.14355) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:42 smithi171 bash[25040]: cluster 2024-09-14T02:08:41.449867+0000 mgr.a (mgr.14355) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:42 smithi007 bash[22722]: cluster 2024-09-14T02:08:41.449867+0000 mgr.a (mgr.14355) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:44 smithi131 bash[24745]: cluster 2024-09-14T02:08:43.450811+0000 mgr.a (mgr.14355) 9854 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:08:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:44 smithi171 bash[25040]: cluster 2024-09-14T02:08:43.450811+0000 mgr.a (mgr.14355) 9854 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:08:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:44 smithi007 bash[22722]: cluster 2024-09-14T02:08:43.450811+0000 mgr.a (mgr.14355) 9854 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:08:45.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:45.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:46.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:46.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:46.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:46 smithi131 bash[24745]: cluster 2024-09-14T02:08:45.452811+0000 mgr.a (mgr.14355) 9855 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:46 smithi131 bash[24745]: audit 2024-09-14T02:08:46.062925+0000 mgr.a (mgr.14355) 9856 : audit [DBG] from='client.218148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:46 smithi171 bash[25040]: cluster 2024-09-14T02:08:45.452811+0000 mgr.a (mgr.14355) 9855 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:46 smithi171 bash[25040]: audit 2024-09-14T02:08:46.062925+0000 mgr.a (mgr.14355) 9856 : audit [DBG] from='client.218148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:46 smithi007 bash[22722]: cluster 2024-09-14T02:08:45.452811+0000 mgr.a (mgr.14355) 9855 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:08:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:46 smithi007 bash[22722]: audit 2024-09-14T02:08:46.062925+0000 mgr.a (mgr.14355) 9856 : audit [DBG] from='client.218148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:48 smithi131 bash[24745]: cluster 2024-09-14T02:08:47.453789+0000 mgr.a (mgr.14355) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:49 smithi171 bash[25040]: cluster 2024-09-14T02:08:47.453789+0000 mgr.a (mgr.14355) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:48 smithi007 bash[22722]: cluster 2024-09-14T02:08:47.453789+0000 mgr.a (mgr.14355) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:08:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:51 smithi131 bash[24745]: cluster 2024-09-14T02:08:49.454763+0000 mgr.a (mgr.14355) 9858 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:51 smithi171 bash[25040]: cluster 2024-09-14T02:08:49.454763+0000 mgr.a (mgr.14355) 9858 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:51 smithi007 bash[22722]: cluster 2024-09-14T02:08:49.454763+0000 mgr.a (mgr.14355) 9858 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:08:51.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:51.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:52.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:53 smithi131 bash[24745]: cluster 2024-09-14T02:08:51.457017+0000 mgr.a (mgr.14355) 9859 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:53 smithi131 bash[24745]: audit 2024-09-14T02:08:51.810218+0000 mgr.a (mgr.14355) 9860 : audit [DBG] from='client.218226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:53 smithi171 bash[25040]: cluster 2024-09-14T02:08:51.457017+0000 mgr.a (mgr.14355) 9859 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:53 smithi171 bash[25040]: audit 2024-09-14T02:08:51.810218+0000 mgr.a (mgr.14355) 9860 : audit [DBG] from='client.218226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:53 smithi007 bash[22722]: cluster 2024-09-14T02:08:51.457017+0000 mgr.a (mgr.14355) 9859 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:53 smithi007 bash[22722]: audit 2024-09-14T02:08:51.810218+0000 mgr.a (mgr.14355) 9860 : audit [DBG] from='client.218226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:55 smithi131 bash[24745]: cluster 2024-09-14T02:08:53.457914+0000 mgr.a (mgr.14355) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:55 smithi171 bash[25040]: cluster 2024-09-14T02:08:53.457914+0000 mgr.a (mgr.14355) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:55 smithi007 bash[22722]: cluster 2024-09-14T02:08:53.457914+0000 mgr.a (mgr.14355) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:08:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:08:57.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:08:57.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:57 smithi131 bash[24745]: cluster 2024-09-14T02:08:55.460209+0000 mgr.a (mgr.14355) 9862 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:57 smithi171 bash[25040]: cluster 2024-09-14T02:08:55.460209+0000 mgr.a (mgr.14355) 9862 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:57 smithi007 bash[22722]: cluster 2024-09-14T02:08:55.460209+0000 mgr.a (mgr.14355) 9862 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:08:57.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:08:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:08:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:08:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:08:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:08:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:59 smithi131 bash[24745]: cluster 2024-09-14T02:08:57.460958+0000 mgr.a (mgr.14355) 9863 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:08:59 smithi131 bash[24745]: audit 2024-09-14T02:08:57.564973+0000 mgr.a (mgr.14355) 9864 : audit [DBG] from='client.218301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:59 smithi171 bash[25040]: cluster 2024-09-14T02:08:57.460958+0000 mgr.a (mgr.14355) 9863 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:08:59 smithi171 bash[25040]: audit 2024-09-14T02:08:57.564973+0000 mgr.a (mgr.14355) 9864 : audit [DBG] from='client.218301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:08:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:59 smithi007 bash[22722]: cluster 2024-09-14T02:08:57.460958+0000 mgr.a (mgr.14355) 9863 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:08:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:08:59 smithi007 bash[22722]: audit 2024-09-14T02:08:57.564973+0000 mgr.a (mgr.14355) 9864 : audit [DBG] from='client.218301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:01 smithi131 bash[24745]: cluster 2024-09-14T02:08:59.462025+0000 mgr.a (mgr.14355) 9865 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:01 smithi171 bash[25040]: cluster 2024-09-14T02:08:59.462025+0000 mgr.a (mgr.14355) 9865 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:01 smithi007 bash[22722]: cluster 2024-09-14T02:08:59.462025+0000 mgr.a (mgr.14355) 9865 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:02.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:03 smithi131 bash[24745]: cluster 2024-09-14T02:09:01.464319+0000 mgr.a (mgr.14355) 9866 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:03 smithi171 bash[25040]: cluster 2024-09-14T02:09:01.464319+0000 mgr.a (mgr.14355) 9866 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:03 smithi007 bash[22722]: cluster 2024-09-14T02:09:01.464319+0000 mgr.a (mgr.14355) 9866 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:03.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:03.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:05 smithi131 bash[24745]: audit 2024-09-14T02:09:03.311349+0000 mgr.a (mgr.14355) 9867 : audit [DBG] from='client.218376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:05 smithi131 bash[24745]: cluster 2024-09-14T02:09:03.464945+0000 mgr.a (mgr.14355) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:05 smithi171 bash[25040]: audit 2024-09-14T02:09:03.311349+0000 mgr.a (mgr.14355) 9867 : audit [DBG] from='client.218376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:05 smithi171 bash[25040]: cluster 2024-09-14T02:09:03.464945+0000 mgr.a (mgr.14355) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:05 smithi007 bash[22722]: audit 2024-09-14T02:09:03.311349+0000 mgr.a (mgr.14355) 9867 : audit [DBG] from='client.218376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:05 smithi007 bash[22722]: cluster 2024-09-14T02:09:03.464945+0000 mgr.a (mgr.14355) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:07 smithi171 bash[25040]: cluster 2024-09-14T02:09:05.467263+0000 mgr.a (mgr.14355) 9869 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:07 smithi007 bash[22722]: cluster 2024-09-14T02:09:05.467263+0000 mgr.a (mgr.14355) 9869 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:07.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:07 smithi131 bash[24745]: cluster 2024-09-14T02:09:05.467263+0000 mgr.a (mgr.14355) 9869 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:08.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:08.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:08.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:09 smithi171 bash[25040]: cluster 2024-09-14T02:09:07.468041+0000 mgr.a (mgr.14355) 9870 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:09 smithi007 bash[22722]: cluster 2024-09-14T02:09:07.468041+0000 mgr.a (mgr.14355) 9870 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:09.529 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:09.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:09 smithi131 bash[24745]: cluster 2024-09-14T02:09:07.468041+0000 mgr.a (mgr.14355) 9870 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:10 smithi007 bash[22722]: audit 2024-09-14T02:09:09.079199+0000 mgr.a (mgr.14355) 9871 : audit [DBG] from='client.218448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:10 smithi131 bash[24745]: audit 2024-09-14T02:09:09.079199+0000 mgr.a (mgr.14355) 9871 : audit [DBG] from='client.218448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:10 smithi171 bash[25040]: audit 2024-09-14T02:09:09.079199+0000 mgr.a (mgr.14355) 9871 : audit [DBG] from='client.218448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:11 smithi007 bash[22722]: cluster 2024-09-14T02:09:09.468675+0000 mgr.a (mgr.14355) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:11 smithi131 bash[24745]: cluster 2024-09-14T02:09:09.468675+0000 mgr.a (mgr.14355) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:11 smithi171 bash[25040]: cluster 2024-09-14T02:09:09.468675+0000 mgr.a (mgr.14355) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:13 smithi007 bash[22722]: cluster 2024-09-14T02:09:11.470929+0000 mgr.a (mgr.14355) 9873 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:13 smithi131 bash[24745]: cluster 2024-09-14T02:09:11.470929+0000 mgr.a (mgr.14355) 9873 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:13 smithi171 bash[25040]: cluster 2024-09-14T02:09:11.470929+0000 mgr.a (mgr.14355) 9873 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:15.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:15.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:15.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:15.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:15.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:15 smithi007 bash[22722]: cluster 2024-09-14T02:09:13.471687+0000 mgr.a (mgr.14355) 9874 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:15 smithi131 bash[24745]: cluster 2024-09-14T02:09:13.471687+0000 mgr.a (mgr.14355) 9874 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:15 smithi171 bash[25040]: cluster 2024-09-14T02:09:13.471687+0000 mgr.a (mgr.14355) 9874 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:16 smithi007 bash[22722]: audit 2024-09-14T02:09:14.865667+0000 mgr.a (mgr.14355) 9875 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:16 smithi131 bash[24745]: audit 2024-09-14T02:09:14.865667+0000 mgr.a (mgr.14355) 9875 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:16 smithi171 bash[25040]: audit 2024-09-14T02:09:14.865667+0000 mgr.a (mgr.14355) 9875 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:17 smithi007 bash[22722]: cluster 2024-09-14T02:09:15.474087+0000 mgr.a (mgr.14355) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:09:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:17 smithi131 bash[24745]: cluster 2024-09-14T02:09:15.474087+0000 mgr.a (mgr.14355) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:09:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:17 smithi171 bash[25040]: cluster 2024-09-14T02:09:15.474087+0000 mgr.a (mgr.14355) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:09:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:19 smithi007 bash[22722]: cluster 2024-09-14T02:09:17.474873+0000 mgr.a (mgr.14355) 9877 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:19 smithi131 bash[24745]: cluster 2024-09-14T02:09:17.474873+0000 mgr.a (mgr.14355) 9877 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:19 smithi171 bash[25040]: cluster 2024-09-14T02:09:17.474873+0000 mgr.a (mgr.14355) 9877 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:20.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:20.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:21.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:21.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:21.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:21.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:21.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:21 smithi007 bash[22722]: cluster 2024-09-14T02:09:19.475616+0000 mgr.a (mgr.14355) 9878 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:21 smithi131 bash[24745]: cluster 2024-09-14T02:09:19.475616+0000 mgr.a (mgr.14355) 9878 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:21 smithi171 bash[25040]: cluster 2024-09-14T02:09:19.475616+0000 mgr.a (mgr.14355) 9878 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:09:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:22 smithi007 bash[22722]: audit 2024-09-14T02:09:20.625303+0000 mgr.a (mgr.14355) 9879 : audit [DBG] from='client.218604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:22 smithi131 bash[24745]: audit 2024-09-14T02:09:20.625303+0000 mgr.a (mgr.14355) 9879 : audit [DBG] from='client.218604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:22 smithi171 bash[25040]: audit 2024-09-14T02:09:20.625303+0000 mgr.a (mgr.14355) 9879 : audit [DBG] from='client.218604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:23 smithi007 bash[22722]: cluster 2024-09-14T02:09:21.478492+0000 mgr.a (mgr.14355) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:23 smithi131 bash[24745]: cluster 2024-09-14T02:09:21.478492+0000 mgr.a (mgr.14355) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:23 smithi171 bash[25040]: cluster 2024-09-14T02:09:21.478492+0000 mgr.a (mgr.14355) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:25 smithi007 bash[22722]: cluster 2024-09-14T02:09:23.479249+0000 mgr.a (mgr.14355) 9881 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:09:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:25 smithi131 bash[24745]: cluster 2024-09-14T02:09:23.479249+0000 mgr.a (mgr.14355) 9881 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:09:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:25 smithi171 bash[25040]: cluster 2024-09-14T02:09:23.479249+0000 mgr.a (mgr.14355) 9881 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:09:26.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:26.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:26.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:26.824 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:27 smithi007 bash[22722]: cluster 2024-09-14T02:09:25.481228+0000 mgr.a (mgr.14355) 9882 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:27 smithi131 bash[24745]: cluster 2024-09-14T02:09:25.481228+0000 mgr.a (mgr.14355) 9882 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:27 smithi171 bash[25040]: cluster 2024-09-14T02:09:25.481228+0000 mgr.a (mgr.14355) 9882 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:28 smithi007 bash[22722]: audit 2024-09-14T02:09:26.402828+0000 mgr.a (mgr.14355) 9883 : audit [DBG] from='client.218676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:28 smithi131 bash[24745]: audit 2024-09-14T02:09:26.402828+0000 mgr.a (mgr.14355) 9883 : audit [DBG] from='client.218676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:28 smithi171 bash[25040]: audit 2024-09-14T02:09:26.402828+0000 mgr.a (mgr.14355) 9883 : audit [DBG] from='client.218676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:29 smithi007 bash[22722]: cluster 2024-09-14T02:09:27.482192+0000 mgr.a (mgr.14355) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:29 smithi131 bash[24745]: cluster 2024-09-14T02:09:27.482192+0000 mgr.a (mgr.14355) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:29 smithi171 bash[25040]: cluster 2024-09-14T02:09:27.482192+0000 mgr.a (mgr.14355) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:31 smithi007 bash[22722]: cluster 2024-09-14T02:09:29.482954+0000 mgr.a (mgr.14355) 9885 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:31 smithi131 bash[24745]: cluster 2024-09-14T02:09:29.482954+0000 mgr.a (mgr.14355) 9885 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:31 smithi171 bash[25040]: cluster 2024-09-14T02:09:29.482954+0000 mgr.a (mgr.14355) 9885 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:09:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:32 smithi007 bash[22722]: audit 2024-09-14T02:09:31.590738+0000 mon.a (mon.0) 2073 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:09:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:32 smithi131 bash[24745]: audit 2024-09-14T02:09:31.590738+0000 mon.a (mon.0) 2073 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:09:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:32 smithi171 bash[25040]: audit 2024-09-14T02:09:31.590738+0000 mon.a (mon.0) 2073 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:09:32.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:32.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:33.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22972]: debug 2024-09-14T02:09:33.276+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22972]: debug 2024-09-14T02:09:33.276+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: cluster 2024-09-14T02:09:31.485182+0000 mgr.a (mgr.14355) 9886 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: audit 2024-09-14T02:09:32.147367+0000 mgr.a (mgr.14355) 9887 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: audit 2024-09-14T02:09:32.433475+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: audit 2024-09-14T02:09:32.434441+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: audit 2024-09-14T02:09:32.440006+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:09:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:33 smithi007 bash[22722]: audit 2024-09-14T02:09:32.442177+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: cluster 2024-09-14T02:09:31.485182+0000 mgr.a (mgr.14355) 9886 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:09:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: audit 2024-09-14T02:09:32.147367+0000 mgr.a (mgr.14355) 9887 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: audit 2024-09-14T02:09:32.433475+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:09:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: audit 2024-09-14T02:09:32.434441+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:09:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: audit 2024-09-14T02:09:32.440006+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:09:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:33 smithi131 bash[24745]: audit 2024-09-14T02:09:32.442177+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: cluster 2024-09-14T02:09:31.485182+0000 mgr.a (mgr.14355) 9886 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:09:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: audit 2024-09-14T02:09:32.147367+0000 mgr.a (mgr.14355) 9887 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: audit 2024-09-14T02:09:32.433475+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:09:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: audit 2024-09-14T02:09:32.434441+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:09:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: audit 2024-09-14T02:09:32.440006+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:09:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:33 smithi171 bash[25040]: audit 2024-09-14T02:09:32.442177+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:34 smithi007 bash[22722]: audit 2024-09-14T02:09:32.443440+0000 mgr.a (mgr.14355) 9888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:34 smithi131 bash[24745]: audit 2024-09-14T02:09:32.443440+0000 mgr.a (mgr.14355) 9888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:34 smithi171 bash[25040]: audit 2024-09-14T02:09:32.443440+0000 mgr.a (mgr.14355) 9888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:09:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:35 smithi007 bash[22722]: audit 2024-09-14T02:09:33.279345+0000 mgr.a (mgr.14355) 9889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:09:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:35 smithi007 bash[22722]: cephadm 2024-09-14T02:09:33.280782+0000 mgr.a (mgr.14355) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:09:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:35 smithi007 bash[22722]: cluster 2024-09-14T02:09:33.486103+0000 mgr.a (mgr.14355) 9891 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:35 smithi131 bash[24745]: audit 2024-09-14T02:09:33.279345+0000 mgr.a (mgr.14355) 9889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:09:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:35 smithi131 bash[24745]: cephadm 2024-09-14T02:09:33.280782+0000 mgr.a (mgr.14355) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:09:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:35 smithi131 bash[24745]: cluster 2024-09-14T02:09:33.486103+0000 mgr.a (mgr.14355) 9891 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:35 smithi171 bash[25040]: audit 2024-09-14T02:09:33.279345+0000 mgr.a (mgr.14355) 9889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:09:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:35 smithi171 bash[25040]: cephadm 2024-09-14T02:09:33.280782+0000 mgr.a (mgr.14355) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:09:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:35 smithi171 bash[25040]: cluster 2024-09-14T02:09:33.486103+0000 mgr.a (mgr.14355) 9891 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:37 smithi007 bash[22722]: cluster 2024-09-14T02:09:35.488341+0000 mgr.a (mgr.14355) 9892 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:37 smithi131 bash[24745]: cluster 2024-09-14T02:09:35.488341+0000 mgr.a (mgr.14355) 9892 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:37 smithi171 bash[25040]: cluster 2024-09-14T02:09:35.488341+0000 mgr.a (mgr.14355) 9892 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:37.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:37.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:38.335 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:39 smithi007 bash[22722]: cluster 2024-09-14T02:09:37.489124+0000 mgr.a (mgr.14355) 9893 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:39 smithi007 bash[22722]: audit 2024-09-14T02:09:37.917082+0000 mgr.a (mgr.14355) 9894 : audit [DBG] from='client.218934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:39 smithi131 bash[24745]: cluster 2024-09-14T02:09:37.489124+0000 mgr.a (mgr.14355) 9893 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:39 smithi131 bash[24745]: audit 2024-09-14T02:09:37.917082+0000 mgr.a (mgr.14355) 9894 : audit [DBG] from='client.218934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:39 smithi171 bash[25040]: cluster 2024-09-14T02:09:37.489124+0000 mgr.a (mgr.14355) 9893 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:39 smithi171 bash[25040]: audit 2024-09-14T02:09:37.917082+0000 mgr.a (mgr.14355) 9894 : audit [DBG] from='client.218934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:41 smithi007 bash[22722]: cluster 2024-09-14T02:09:39.489955+0000 mgr.a (mgr.14355) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:41 smithi131 bash[24745]: cluster 2024-09-14T02:09:39.489955+0000 mgr.a (mgr.14355) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:41 smithi171 bash[25040]: cluster 2024-09-14T02:09:39.489955+0000 mgr.a (mgr.14355) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:43.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:43.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:43 smithi007 bash[22722]: cluster 2024-09-14T02:09:41.492195+0000 mgr.a (mgr.14355) 9896 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:43 smithi131 bash[24745]: cluster 2024-09-14T02:09:41.492195+0000 mgr.a (mgr.14355) 9896 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:43 smithi171 bash[25040]: cluster 2024-09-14T02:09:41.492195+0000 mgr.a (mgr.14355) 9896 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:44.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:45 smithi007 bash[22722]: cluster 2024-09-14T02:09:43.492852+0000 mgr.a (mgr.14355) 9897 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:45 smithi007 bash[22722]: audit 2024-09-14T02:09:43.664206+0000 mgr.a (mgr.14355) 9898 : audit [DBG] from='client.219012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:45 smithi131 bash[24745]: cluster 2024-09-14T02:09:43.492852+0000 mgr.a (mgr.14355) 9897 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:45 smithi131 bash[24745]: audit 2024-09-14T02:09:43.664206+0000 mgr.a (mgr.14355) 9898 : audit [DBG] from='client.219012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:45 smithi171 bash[25040]: cluster 2024-09-14T02:09:43.492852+0000 mgr.a (mgr.14355) 9897 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:45 smithi171 bash[25040]: audit 2024-09-14T02:09:43.664206+0000 mgr.a (mgr.14355) 9898 : audit [DBG] from='client.219012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:47 smithi007 bash[22722]: cluster 2024-09-14T02:09:45.495211+0000 mgr.a (mgr.14355) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:47 smithi131 bash[24745]: cluster 2024-09-14T02:09:45.495211+0000 mgr.a (mgr.14355) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:47 smithi171 bash[25040]: cluster 2024-09-14T02:09:45.495211+0000 mgr.a (mgr.14355) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:09:49.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:49.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:49 smithi007 bash[22722]: cluster 2024-09-14T02:09:47.495987+0000 mgr.a (mgr.14355) 9900 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:49 smithi131 bash[24745]: cluster 2024-09-14T02:09:47.495987+0000 mgr.a (mgr.14355) 9900 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:49 smithi171 bash[25040]: cluster 2024-09-14T02:09:47.495987+0000 mgr.a (mgr.14355) 9900 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:49.861 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:51 smithi007 bash[22722]: audit 2024-09-14T02:09:49.412124+0000 mgr.a (mgr.14355) 9901 : audit [DBG] from='client.219090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:51 smithi007 bash[22722]: cluster 2024-09-14T02:09:49.496535+0000 mgr.a (mgr.14355) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:51 smithi131 bash[24745]: audit 2024-09-14T02:09:49.412124+0000 mgr.a (mgr.14355) 9901 : audit [DBG] from='client.219090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:51 smithi131 bash[24745]: cluster 2024-09-14T02:09:49.496535+0000 mgr.a (mgr.14355) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:51 smithi171 bash[25040]: audit 2024-09-14T02:09:49.412124+0000 mgr.a (mgr.14355) 9901 : audit [DBG] from='client.219090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:51 smithi171 bash[25040]: cluster 2024-09-14T02:09:49.496535+0000 mgr.a (mgr.14355) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:53 smithi007 bash[22722]: cluster 2024-09-14T02:09:51.498821+0000 mgr.a (mgr.14355) 9903 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:53 smithi131 bash[24745]: cluster 2024-09-14T02:09:51.498821+0000 mgr.a (mgr.14355) 9903 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:53 smithi171 bash[25040]: cluster 2024-09-14T02:09:51.498821+0000 mgr.a (mgr.14355) 9903 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:09:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:09:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:09:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:09:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:55 smithi007 bash[22722]: cluster 2024-09-14T02:09:53.499583+0000 mgr.a (mgr.14355) 9904 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:55 smithi131 bash[24745]: cluster 2024-09-14T02:09:53.499583+0000 mgr.a (mgr.14355) 9904 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:55 smithi171 bash[25040]: cluster 2024-09-14T02:09:53.499583+0000 mgr.a (mgr.14355) 9904 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:55.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:09:55.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:09:55.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:09:55.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:09:55.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:09:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:56 smithi007 bash[22722]: audit 2024-09-14T02:09:55.190713+0000 mgr.a (mgr.14355) 9905 : audit [DBG] from='client.219165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:56 smithi131 bash[24745]: audit 2024-09-14T02:09:55.190713+0000 mgr.a (mgr.14355) 9905 : audit [DBG] from='client.219165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:56 smithi171 bash[25040]: audit 2024-09-14T02:09:55.190713+0000 mgr.a (mgr.14355) 9905 : audit [DBG] from='client.219165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:09:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:57 smithi007 bash[22722]: cluster 2024-09-14T02:09:55.500788+0000 mgr.a (mgr.14355) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:57 smithi131 bash[24745]: cluster 2024-09-14T02:09:55.500788+0000 mgr.a (mgr.14355) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:57 smithi171 bash[25040]: cluster 2024-09-14T02:09:55.500788+0000 mgr.a (mgr.14355) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:09:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:09:59 smithi007 bash[22722]: cluster 2024-09-14T02:09:57.501813+0000 mgr.a (mgr.14355) 9907 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:09:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:09:59 smithi131 bash[24745]: cluster 2024-09-14T02:09:57.501813+0000 mgr.a (mgr.14355) 9907 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:09:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:09:59 smithi171 bash[25040]: cluster 2024-09-14T02:09:57.501813+0000 mgr.a (mgr.14355) 9907 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:10:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:00 smithi131 bash[24745]: cluster 2024-09-14T02:10:00.000144+0000 mon.a (mon.0) 2078 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:10:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:00 smithi171 bash[25040]: cluster 2024-09-14T02:10:00.000144+0000 mon.a (mon.0) 2078 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:10:00.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:00.612 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:00 smithi007 bash[22722]: cluster 2024-09-14T02:10:00.000144+0000 mon.a (mon.0) 2078 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:10:01.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:01.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:01.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:01.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:01.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:01 smithi131 bash[24745]: cluster 2024-09-14T02:09:59.502663+0000 mgr.a (mgr.14355) 9908 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:10:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:01 smithi171 bash[25040]: cluster 2024-09-14T02:09:59.502663+0000 mgr.a (mgr.14355) 9908 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:10:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:01 smithi007 bash[22722]: cluster 2024-09-14T02:09:59.502663+0000 mgr.a (mgr.14355) 9908 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:10:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:02 smithi131 bash[24745]: audit 2024-09-14T02:10:00.951915+0000 mgr.a (mgr.14355) 9909 : audit [DBG] from='client.219237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:02 smithi171 bash[25040]: audit 2024-09-14T02:10:00.951915+0000 mgr.a (mgr.14355) 9909 : audit [DBG] from='client.219237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:02 smithi007 bash[22722]: audit 2024-09-14T02:10:00.951915+0000 mgr.a (mgr.14355) 9909 : audit [DBG] from='client.219237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:03 smithi131 bash[24745]: cluster 2024-09-14T02:10:01.505461+0000 mgr.a (mgr.14355) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:03 smithi171 bash[25040]: cluster 2024-09-14T02:10:01.505461+0000 mgr.a (mgr.14355) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:03 smithi007 bash[22722]: cluster 2024-09-14T02:10:01.505461+0000 mgr.a (mgr.14355) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:05 smithi131 bash[24745]: cluster 2024-09-14T02:10:03.506263+0000 mgr.a (mgr.14355) 9911 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:10:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:05 smithi171 bash[25040]: cluster 2024-09-14T02:10:03.506263+0000 mgr.a (mgr.14355) 9911 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:10:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:05 smithi007 bash[22722]: cluster 2024-09-14T02:10:03.506263+0000 mgr.a (mgr.14355) 9911 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:10:06.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:06.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:07.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:07.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:07 smithi131 bash[24745]: cluster 2024-09-14T02:10:05.508229+0000 mgr.a (mgr.14355) 9912 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:07 smithi171 bash[25040]: cluster 2024-09-14T02:10:05.508229+0000 mgr.a (mgr.14355) 9912 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:07 smithi007 bash[22722]: cluster 2024-09-14T02:10:05.508229+0000 mgr.a (mgr.14355) 9912 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:08 smithi131 bash[24745]: audit 2024-09-14T02:10:06.743423+0000 mgr.a (mgr.14355) 9913 : audit [DBG] from='client.219315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:08 smithi171 bash[25040]: audit 2024-09-14T02:10:06.743423+0000 mgr.a (mgr.14355) 9913 : audit [DBG] from='client.219315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:08 smithi007 bash[22722]: audit 2024-09-14T02:10:06.743423+0000 mgr.a (mgr.14355) 9913 : audit [DBG] from='client.219315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:09 smithi131 bash[24745]: cluster 2024-09-14T02:10:07.509172+0000 mgr.a (mgr.14355) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:09 smithi171 bash[25040]: cluster 2024-09-14T02:10:07.509172+0000 mgr.a (mgr.14355) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:09 smithi007 bash[22722]: cluster 2024-09-14T02:10:07.509172+0000 mgr.a (mgr.14355) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:10 smithi131 bash[24745]: cluster 2024-09-14T02:10:09.509962+0000 mgr.a (mgr.14355) 9915 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:10 smithi171 bash[25040]: cluster 2024-09-14T02:10:09.509962+0000 mgr.a (mgr.14355) 9915 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:10 smithi007 bash[22722]: cluster 2024-09-14T02:10:09.509962+0000 mgr.a (mgr.14355) 9915 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:12.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:12.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:12.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:12 smithi007 bash[22722]: cluster 2024-09-14T02:10:11.512172+0000 mgr.a (mgr.14355) 9916 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:12.957 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:12 smithi131 bash[24745]: cluster 2024-09-14T02:10:11.512172+0000 mgr.a (mgr.14355) 9916 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:12 smithi171 bash[25040]: cluster 2024-09-14T02:10:11.512172+0000 mgr.a (mgr.14355) 9916 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:13 smithi131 bash[24745]: audit 2024-09-14T02:10:12.517979+0000 mgr.a (mgr.14355) 9917 : audit [DBG] from='client.219393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:13 smithi171 bash[25040]: audit 2024-09-14T02:10:12.517979+0000 mgr.a (mgr.14355) 9917 : audit [DBG] from='client.219393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:13 smithi007 bash[22722]: audit 2024-09-14T02:10:12.517979+0000 mgr.a (mgr.14355) 9917 : audit [DBG] from='client.219393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:14 smithi131 bash[24745]: cluster 2024-09-14T02:10:13.513037+0000 mgr.a (mgr.14355) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:14 smithi171 bash[25040]: cluster 2024-09-14T02:10:13.513037+0000 mgr.a (mgr.14355) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:14 smithi007 bash[22722]: cluster 2024-09-14T02:10:13.513037+0000 mgr.a (mgr.14355) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:16 smithi131 bash[24745]: cluster 2024-09-14T02:10:15.515348+0000 mgr.a (mgr.14355) 9919 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:16 smithi171 bash[25040]: cluster 2024-09-14T02:10:15.515348+0000 mgr.a (mgr.14355) 9919 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:16 smithi007 bash[22722]: cluster 2024-09-14T02:10:15.515348+0000 mgr.a (mgr.14355) 9919 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:17.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:17.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:17.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:18.743 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:18.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:18.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:18.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:18.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:18 smithi131 bash[24745]: cluster 2024-09-14T02:10:17.516107+0000 mgr.a (mgr.14355) 9920 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:18 smithi171 bash[25040]: cluster 2024-09-14T02:10:17.516107+0000 mgr.a (mgr.14355) 9920 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:18 smithi007 bash[22722]: cluster 2024-09-14T02:10:17.516107+0000 mgr.a (mgr.14355) 9920 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:19 smithi131 bash[24745]: audit 2024-09-14T02:10:18.291538+0000 mgr.a (mgr.14355) 9921 : audit [DBG] from='client.219471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:19 smithi171 bash[25040]: audit 2024-09-14T02:10:18.291538+0000 mgr.a (mgr.14355) 9921 : audit [DBG] from='client.219471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:19 smithi007 bash[22722]: audit 2024-09-14T02:10:18.291538+0000 mgr.a (mgr.14355) 9921 : audit [DBG] from='client.219471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:20 smithi131 bash[24745]: cluster 2024-09-14T02:10:19.516984+0000 mgr.a (mgr.14355) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:20 smithi171 bash[25040]: cluster 2024-09-14T02:10:19.516984+0000 mgr.a (mgr.14355) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:20 smithi007 bash[22722]: cluster 2024-09-14T02:10:19.516984+0000 mgr.a (mgr.14355) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:22 smithi131 bash[24745]: cluster 2024-09-14T02:10:21.519213+0000 mgr.a (mgr.14355) 9923 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:22 smithi171 bash[25040]: cluster 2024-09-14T02:10:21.519213+0000 mgr.a (mgr.14355) 9923 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:22 smithi007 bash[22722]: cluster 2024-09-14T02:10:21.519213+0000 mgr.a (mgr.14355) 9923 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:23.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:24.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:24.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:24 smithi131 bash[24745]: cluster 2024-09-14T02:10:23.519976+0000 mgr.a (mgr.14355) 9924 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:24 smithi131 bash[24745]: audit 2024-09-14T02:10:24.084253+0000 mgr.a (mgr.14355) 9925 : audit [DBG] from='client.219543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:24 smithi171 bash[25040]: cluster 2024-09-14T02:10:23.519976+0000 mgr.a (mgr.14355) 9924 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:24 smithi171 bash[25040]: audit 2024-09-14T02:10:24.084253+0000 mgr.a (mgr.14355) 9925 : audit [DBG] from='client.219543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:24 smithi007 bash[22722]: cluster 2024-09-14T02:10:23.519976+0000 mgr.a (mgr.14355) 9924 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:24 smithi007 bash[22722]: audit 2024-09-14T02:10:24.084253+0000 mgr.a (mgr.14355) 9925 : audit [DBG] from='client.219543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:26 smithi131 bash[24745]: cluster 2024-09-14T02:10:25.522319+0000 mgr.a (mgr.14355) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:27 smithi171 bash[25040]: cluster 2024-09-14T02:10:25.522319+0000 mgr.a (mgr.14355) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:26 smithi007 bash[22722]: cluster 2024-09-14T02:10:25.522319+0000 mgr.a (mgr.14355) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:29 smithi131 bash[24745]: cluster 2024-09-14T02:10:27.523075+0000 mgr.a (mgr.14355) 9927 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:29 smithi171 bash[25040]: cluster 2024-09-14T02:10:27.523075+0000 mgr.a (mgr.14355) 9927 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:29 smithi007 bash[22722]: cluster 2024-09-14T02:10:27.523075+0000 mgr.a (mgr.14355) 9927 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:29.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:29.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:29.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:30.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:30.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:30.269 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:31 smithi131 bash[24745]: cluster 2024-09-14T02:10:29.523645+0000 mgr.a (mgr.14355) 9928 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:31 smithi131 bash[24745]: audit 2024-09-14T02:10:29.851729+0000 mgr.a (mgr.14355) 9929 : audit [DBG] from='client.219618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:31 smithi171 bash[25040]: cluster 2024-09-14T02:10:29.523645+0000 mgr.a (mgr.14355) 9928 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:31 smithi171 bash[25040]: audit 2024-09-14T02:10:29.851729+0000 mgr.a (mgr.14355) 9929 : audit [DBG] from='client.219618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:31 smithi007 bash[22722]: cluster 2024-09-14T02:10:29.523645+0000 mgr.a (mgr.14355) 9928 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:31 smithi007 bash[22722]: audit 2024-09-14T02:10:29.851729+0000 mgr.a (mgr.14355) 9929 : audit [DBG] from='client.219618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:33 smithi131 bash[24745]: cluster 2024-09-14T02:10:31.526018+0000 mgr.a (mgr.14355) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:10:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:33 smithi171 bash[25040]: cluster 2024-09-14T02:10:31.526018+0000 mgr.a (mgr.14355) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:10:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:33 smithi007 bash[22722]: cluster 2024-09-14T02:10:31.526018+0000 mgr.a (mgr.14355) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:10:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:34 smithi131 bash[24745]: audit 2024-09-14T02:10:33.330509+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:10:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:34 smithi171 bash[25040]: audit 2024-09-14T02:10:33.330509+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:10:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:34 smithi007 bash[22722]: audit 2024-09-14T02:10:33.330509+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:10:35.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:10:34 smithi007 bash[22972]: debug 2024-09-14T02:10:34.891+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:10:34 smithi007 bash[22972]: debug 2024-09-14T02:10:34.895+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: cluster 2024-09-14T02:10:33.526821+0000 mgr.a (mgr.14355) 9931 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: audit 2024-09-14T02:10:34.150838+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: audit 2024-09-14T02:10:34.152597+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: audit 2024-09-14T02:10:34.162224+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: audit 2024-09-14T02:10:34.164453+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:35 smithi007 bash[22722]: audit 2024-09-14T02:10:34.166695+0000 mgr.a (mgr.14355) 9932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:35.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:35.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: cluster 2024-09-14T02:10:33.526821+0000 mgr.a (mgr.14355) 9931 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:10:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: audit 2024-09-14T02:10:34.150838+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:10:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: audit 2024-09-14T02:10:34.152597+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:10:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: audit 2024-09-14T02:10:34.162224+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:10:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: audit 2024-09-14T02:10:34.164453+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:35 smithi131 bash[24745]: audit 2024-09-14T02:10:34.166695+0000 mgr.a (mgr.14355) 9932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: cluster 2024-09-14T02:10:33.526821+0000 mgr.a (mgr.14355) 9931 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:10:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: audit 2024-09-14T02:10:34.150838+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:10:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: audit 2024-09-14T02:10:34.152597+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:10:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: audit 2024-09-14T02:10:34.162224+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:10:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: audit 2024-09-14T02:10:34.164453+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:35 smithi171 bash[25040]: audit 2024-09-14T02:10:34.166695+0000 mgr.a (mgr.14355) 9932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:10:36.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:36.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:36.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:36.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:36.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:36 smithi131 bash[24745]: audit 2024-09-14T02:10:34.897462+0000 mgr.a (mgr.14355) 9933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:10:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:36 smithi131 bash[24745]: cephadm 2024-09-14T02:10:34.899196+0000 mgr.a (mgr.14355) 9934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:10:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:36 smithi171 bash[25040]: audit 2024-09-14T02:10:34.897462+0000 mgr.a (mgr.14355) 9933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:10:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:36 smithi171 bash[25040]: cephadm 2024-09-14T02:10:34.899196+0000 mgr.a (mgr.14355) 9934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:10:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:36 smithi007 bash[22722]: audit 2024-09-14T02:10:34.897462+0000 mgr.a (mgr.14355) 9933 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:10:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:36 smithi007 bash[22722]: cephadm 2024-09-14T02:10:34.899196+0000 mgr.a (mgr.14355) 9934 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:10:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:37 smithi131 bash[24745]: cluster 2024-09-14T02:10:35.529065+0000 mgr.a (mgr.14355) 9935 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:37 smithi131 bash[24745]: audit 2024-09-14T02:10:35.605552+0000 mgr.a (mgr.14355) 9936 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:37 smithi171 bash[25040]: cluster 2024-09-14T02:10:35.529065+0000 mgr.a (mgr.14355) 9935 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:37 smithi171 bash[25040]: audit 2024-09-14T02:10:35.605552+0000 mgr.a (mgr.14355) 9936 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:37 smithi007 bash[22722]: cluster 2024-09-14T02:10:35.529065+0000 mgr.a (mgr.14355) 9935 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:37 smithi007 bash[22722]: audit 2024-09-14T02:10:35.605552+0000 mgr.a (mgr.14355) 9936 : audit [DBG] from='client.219798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:39 smithi171 bash[25040]: cluster 2024-09-14T02:10:37.529975+0000 mgr.a (mgr.14355) 9937 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:39 smithi007 bash[22722]: cluster 2024-09-14T02:10:37.529975+0000 mgr.a (mgr.14355) 9937 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:39 smithi131 bash[24745]: cluster 2024-09-14T02:10:37.529975+0000 mgr.a (mgr.14355) 9937 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:41.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:41.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:41 smithi171 bash[25040]: cluster 2024-09-14T02:10:39.530905+0000 mgr.a (mgr.14355) 9938 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:41 smithi007 bash[22722]: cluster 2024-09-14T02:10:39.530905+0000 mgr.a (mgr.14355) 9938 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:41 smithi131 bash[24745]: cluster 2024-09-14T02:10:39.530905+0000 mgr.a (mgr.14355) 9938 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:41.790 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:41.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:41.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:41.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:41.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:43 smithi007 bash[22722]: audit 2024-09-14T02:10:41.363271+0000 mgr.a (mgr.14355) 9939 : audit [DBG] from='client.219876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:43 smithi007 bash[22722]: cluster 2024-09-14T02:10:41.532639+0000 mgr.a (mgr.14355) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:43 smithi131 bash[24745]: audit 2024-09-14T02:10:41.363271+0000 mgr.a (mgr.14355) 9939 : audit [DBG] from='client.219876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:43 smithi131 bash[24745]: cluster 2024-09-14T02:10:41.532639+0000 mgr.a (mgr.14355) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:43 smithi171 bash[25040]: audit 2024-09-14T02:10:41.363271+0000 mgr.a (mgr.14355) 9939 : audit [DBG] from='client.219876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:43 smithi171 bash[25040]: cluster 2024-09-14T02:10:41.532639+0000 mgr.a (mgr.14355) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:45 smithi007 bash[22722]: cluster 2024-09-14T02:10:43.533510+0000 mgr.a (mgr.14355) 9941 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:45 smithi131 bash[24745]: cluster 2024-09-14T02:10:43.533510+0000 mgr.a (mgr.14355) 9941 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:45 smithi171 bash[25040]: cluster 2024-09-14T02:10:43.533510+0000 mgr.a (mgr.14355) 9941 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:10:46.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:46.792 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:46.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:47 smithi007 bash[22722]: cluster 2024-09-14T02:10:45.535811+0000 mgr.a (mgr.14355) 9942 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:47 smithi131 bash[24745]: cluster 2024-09-14T02:10:45.535811+0000 mgr.a (mgr.14355) 9942 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:47 smithi171 bash[25040]: cluster 2024-09-14T02:10:45.535811+0000 mgr.a (mgr.14355) 9942 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:10:47.547 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:48 smithi007 bash[22722]: audit 2024-09-14T02:10:47.124129+0000 mgr.a (mgr.14355) 9943 : audit [DBG] from='client.219954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:48 smithi131 bash[24745]: audit 2024-09-14T02:10:47.124129+0000 mgr.a (mgr.14355) 9943 : audit [DBG] from='client.219954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:48 smithi171 bash[25040]: audit 2024-09-14T02:10:47.124129+0000 mgr.a (mgr.14355) 9943 : audit [DBG] from='client.219954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:49 smithi007 bash[22722]: cluster 2024-09-14T02:10:47.536307+0000 mgr.a (mgr.14355) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:49 smithi131 bash[24745]: cluster 2024-09-14T02:10:47.536307+0000 mgr.a (mgr.14355) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:49 smithi171 bash[25040]: cluster 2024-09-14T02:10:47.536307+0000 mgr.a (mgr.14355) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:51 smithi007 bash[22722]: cluster 2024-09-14T02:10:49.537031+0000 mgr.a (mgr.14355) 9945 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:51 smithi131 bash[24745]: cluster 2024-09-14T02:10:49.537031+0000 mgr.a (mgr.14355) 9945 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:51 smithi171 bash[25040]: cluster 2024-09-14T02:10:49.537031+0000 mgr.a (mgr.14355) 9945 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:52.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:52.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:52.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:53.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:53.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:53.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:53.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:53.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:53 smithi007 bash[22722]: cluster 2024-09-14T02:10:51.539298+0000 mgr.a (mgr.14355) 9946 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:53 smithi131 bash[24745]: cluster 2024-09-14T02:10:51.539298+0000 mgr.a (mgr.14355) 9946 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:53 smithi171 bash[25040]: cluster 2024-09-14T02:10:51.539298+0000 mgr.a (mgr.14355) 9946 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:54 smithi007 bash[22722]: audit 2024-09-14T02:10:52.884735+0000 mgr.a (mgr.14355) 9947 : audit [DBG] from='client.220032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:54 smithi131 bash[24745]: audit 2024-09-14T02:10:52.884735+0000 mgr.a (mgr.14355) 9947 : audit [DBG] from='client.220032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:54 smithi171 bash[25040]: audit 2024-09-14T02:10:52.884735+0000 mgr.a (mgr.14355) 9947 : audit [DBG] from='client.220032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:10:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:55 smithi007 bash[22722]: cluster 2024-09-14T02:10:53.540145+0000 mgr.a (mgr.14355) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:55 smithi131 bash[24745]: cluster 2024-09-14T02:10:53.540145+0000 mgr.a (mgr.14355) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:55 smithi171 bash[25040]: cluster 2024-09-14T02:10:53.540145+0000 mgr.a (mgr.14355) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:57 smithi007 bash[22722]: cluster 2024-09-14T02:10:55.542344+0000 mgr.a (mgr.14355) 9949 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:57 smithi131 bash[24745]: cluster 2024-09-14T02:10:55.542344+0000 mgr.a (mgr.14355) 9949 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:57 smithi171 bash[25040]: cluster 2024-09-14T02:10:55.542344+0000 mgr.a (mgr.14355) 9949 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:10:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:10:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:10:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:10:59.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:10:59.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:10:59.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:10:59.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:10:59.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:10:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:10:59 smithi007 bash[22722]: cluster 2024-09-14T02:10:57.543303+0000 mgr.a (mgr.14355) 9950 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:10:59 smithi131 bash[24745]: cluster 2024-09-14T02:10:57.543303+0000 mgr.a (mgr.14355) 9950 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:10:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:10:59 smithi171 bash[25040]: cluster 2024-09-14T02:10:57.543303+0000 mgr.a (mgr.14355) 9950 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:00 smithi007 bash[22722]: audit 2024-09-14T02:10:58.625340+0000 mgr.a (mgr.14355) 9951 : audit [DBG] from='client.220107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:00 smithi131 bash[24745]: audit 2024-09-14T02:10:58.625340+0000 mgr.a (mgr.14355) 9951 : audit [DBG] from='client.220107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:00 smithi171 bash[25040]: audit 2024-09-14T02:10:58.625340+0000 mgr.a (mgr.14355) 9951 : audit [DBG] from='client.220107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:01 smithi007 bash[22722]: cluster 2024-09-14T02:10:59.544308+0000 mgr.a (mgr.14355) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:01 smithi131 bash[24745]: cluster 2024-09-14T02:10:59.544308+0000 mgr.a (mgr.14355) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:01 smithi171 bash[25040]: cluster 2024-09-14T02:10:59.544308+0000 mgr.a (mgr.14355) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:03 smithi007 bash[22722]: cluster 2024-09-14T02:11:01.546568+0000 mgr.a (mgr.14355) 9953 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:03 smithi131 bash[24745]: cluster 2024-09-14T02:11:01.546568+0000 mgr.a (mgr.14355) 9953 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:03 smithi171 bash[25040]: cluster 2024-09-14T02:11:01.546568+0000 mgr.a (mgr.14355) 9953 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:04.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:04.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:04.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:04.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:04.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:05 smithi007 bash[22722]: cluster 2024-09-14T02:11:03.547358+0000 mgr.a (mgr.14355) 9954 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:05 smithi131 bash[24745]: cluster 2024-09-14T02:11:03.547358+0000 mgr.a (mgr.14355) 9954 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:05 smithi171 bash[25040]: cluster 2024-09-14T02:11:03.547358+0000 mgr.a (mgr.14355) 9954 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:06 smithi007 bash[22722]: audit 2024-09-14T02:11:04.385108+0000 mgr.a (mgr.14355) 9955 : audit [DBG] from='client.220185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:06 smithi131 bash[24745]: audit 2024-09-14T02:11:04.385108+0000 mgr.a (mgr.14355) 9955 : audit [DBG] from='client.220185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:06 smithi171 bash[25040]: audit 2024-09-14T02:11:04.385108+0000 mgr.a (mgr.14355) 9955 : audit [DBG] from='client.220185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:07 smithi007 bash[22722]: cluster 2024-09-14T02:11:05.549673+0000 mgr.a (mgr.14355) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:07 smithi131 bash[24745]: cluster 2024-09-14T02:11:05.549673+0000 mgr.a (mgr.14355) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:07 smithi171 bash[25040]: cluster 2024-09-14T02:11:05.549673+0000 mgr.a (mgr.14355) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:09 smithi007 bash[22722]: cluster 2024-09-14T02:11:07.550481+0000 mgr.a (mgr.14355) 9957 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:09 smithi131 bash[24745]: cluster 2024-09-14T02:11:07.550481+0000 mgr.a (mgr.14355) 9957 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:09 smithi171 bash[25040]: cluster 2024-09-14T02:11:07.550481+0000 mgr.a (mgr.14355) 9957 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:09.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:09.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:10.557 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:10.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:10.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:10.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:10.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:11 smithi007 bash[22722]: cluster 2024-09-14T02:11:09.551258+0000 mgr.a (mgr.14355) 9958 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:11 smithi007 bash[22722]: audit 2024-09-14T02:11:10.142506+0000 mgr.a (mgr.14355) 9959 : audit [DBG] from='client.220260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:11 smithi131 bash[24745]: cluster 2024-09-14T02:11:09.551258+0000 mgr.a (mgr.14355) 9958 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:11 smithi131 bash[24745]: audit 2024-09-14T02:11:10.142506+0000 mgr.a (mgr.14355) 9959 : audit [DBG] from='client.220260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:11 smithi171 bash[25040]: cluster 2024-09-14T02:11:09.551258+0000 mgr.a (mgr.14355) 9958 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:11 smithi171 bash[25040]: audit 2024-09-14T02:11:10.142506+0000 mgr.a (mgr.14355) 9959 : audit [DBG] from='client.220260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:13 smithi007 bash[22722]: cluster 2024-09-14T02:11:11.554113+0000 mgr.a (mgr.14355) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:13 smithi131 bash[24745]: cluster 2024-09-14T02:11:11.554113+0000 mgr.a (mgr.14355) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:13 smithi171 bash[25040]: cluster 2024-09-14T02:11:11.554113+0000 mgr.a (mgr.14355) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:15 smithi007 bash[22722]: cluster 2024-09-14T02:11:13.554924+0000 mgr.a (mgr.14355) 9961 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:15 smithi131 bash[24745]: cluster 2024-09-14T02:11:13.554924+0000 mgr.a (mgr.14355) 9961 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:15 smithi171 bash[25040]: cluster 2024-09-14T02:11:13.554924+0000 mgr.a (mgr.14355) 9961 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:16.300 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:17 smithi007 bash[22722]: cluster 2024-09-14T02:11:15.556882+0000 mgr.a (mgr.14355) 9962 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:17 smithi007 bash[22722]: audit 2024-09-14T02:11:15.889637+0000 mgr.a (mgr.14355) 9963 : audit [DBG] from='client.220335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:17 smithi131 bash[24745]: cluster 2024-09-14T02:11:15.556882+0000 mgr.a (mgr.14355) 9962 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:17 smithi131 bash[24745]: audit 2024-09-14T02:11:15.889637+0000 mgr.a (mgr.14355) 9963 : audit [DBG] from='client.220335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:17 smithi171 bash[25040]: cluster 2024-09-14T02:11:15.556882+0000 mgr.a (mgr.14355) 9962 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:17 smithi171 bash[25040]: audit 2024-09-14T02:11:15.889637+0000 mgr.a (mgr.14355) 9963 : audit [DBG] from='client.220335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:19 smithi007 bash[22722]: cluster 2024-09-14T02:11:17.557843+0000 mgr.a (mgr.14355) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:19 smithi131 bash[24745]: cluster 2024-09-14T02:11:17.557843+0000 mgr.a (mgr.14355) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:19 smithi171 bash[25040]: cluster 2024-09-14T02:11:17.557843+0000 mgr.a (mgr.14355) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:21.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:21 smithi007 bash[22722]: cluster 2024-09-14T02:11:19.558671+0000 mgr.a (mgr.14355) 9965 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:11:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:21 smithi131 bash[24745]: cluster 2024-09-14T02:11:19.558671+0000 mgr.a (mgr.14355) 9965 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:11:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:21 smithi171 bash[25040]: cluster 2024-09-14T02:11:19.558671+0000 mgr.a (mgr.14355) 9965 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:11:22.081 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:23 smithi007 bash[22722]: cluster 2024-09-14T02:11:21.560038+0000 mgr.a (mgr.14355) 9966 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:23 smithi007 bash[22722]: audit 2024-09-14T02:11:21.641418+0000 mgr.a (mgr.14355) 9967 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:23 smithi131 bash[24745]: cluster 2024-09-14T02:11:21.560038+0000 mgr.a (mgr.14355) 9966 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:23 smithi131 bash[24745]: audit 2024-09-14T02:11:21.641418+0000 mgr.a (mgr.14355) 9967 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:23 smithi171 bash[25040]: cluster 2024-09-14T02:11:21.560038+0000 mgr.a (mgr.14355) 9966 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:23 smithi171 bash[25040]: audit 2024-09-14T02:11:21.641418+0000 mgr.a (mgr.14355) 9967 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:25 smithi007 bash[22722]: cluster 2024-09-14T02:11:23.560989+0000 mgr.a (mgr.14355) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:25 smithi131 bash[24745]: cluster 2024-09-14T02:11:23.560989+0000 mgr.a (mgr.14355) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:25 smithi171 bash[25040]: cluster 2024-09-14T02:11:23.560989+0000 mgr.a (mgr.14355) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:27.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:27.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:27.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:27 smithi007 bash[22722]: cluster 2024-09-14T02:11:25.563227+0000 mgr.a (mgr.14355) 9969 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:27 smithi131 bash[24745]: cluster 2024-09-14T02:11:25.563227+0000 mgr.a (mgr.14355) 9969 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:27 smithi171 bash[25040]: cluster 2024-09-14T02:11:25.563227+0000 mgr.a (mgr.14355) 9969 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:27.865 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:27.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:29 smithi007 bash[22722]: audit 2024-09-14T02:11:27.422921+0000 mgr.a (mgr.14355) 9970 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:29 smithi007 bash[22722]: cluster 2024-09-14T02:11:27.566237+0000 mgr.a (mgr.14355) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:29 smithi131 bash[24745]: audit 2024-09-14T02:11:27.422921+0000 mgr.a (mgr.14355) 9970 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:29 smithi131 bash[24745]: cluster 2024-09-14T02:11:27.566237+0000 mgr.a (mgr.14355) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:29 smithi171 bash[25040]: audit 2024-09-14T02:11:27.422921+0000 mgr.a (mgr.14355) 9970 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:29 smithi171 bash[25040]: cluster 2024-09-14T02:11:27.566237+0000 mgr.a (mgr.14355) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:31 smithi007 bash[22722]: cluster 2024-09-14T02:11:29.567195+0000 mgr.a (mgr.14355) 9972 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:31 smithi131 bash[24745]: cluster 2024-09-14T02:11:29.567195+0000 mgr.a (mgr.14355) 9972 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:31 smithi171 bash[25040]: cluster 2024-09-14T02:11:29.567195+0000 mgr.a (mgr.14355) 9972 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:33 smithi007 bash[22722]: cluster 2024-09-14T02:11:31.569470+0000 mgr.a (mgr.14355) 9973 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:33 smithi131 bash[24745]: cluster 2024-09-14T02:11:31.569470+0000 mgr.a (mgr.14355) 9973 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:33 smithi171 bash[25040]: cluster 2024-09-14T02:11:31.569470+0000 mgr.a (mgr.14355) 9973 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:33.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:33.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:33.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:34 smithi007 bash[22722]: audit 2024-09-14T02:11:33.204491+0000 mgr.a (mgr.14355) 9974 : audit [DBG] from='client.220569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:34 smithi131 bash[24745]: audit 2024-09-14T02:11:33.204491+0000 mgr.a (mgr.14355) 9974 : audit [DBG] from='client.220569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:34 smithi171 bash[25040]: audit 2024-09-14T02:11:33.204491+0000 mgr.a (mgr.14355) 9974 : audit [DBG] from='client.220569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:35 smithi007 bash[22722]: cluster 2024-09-14T02:11:33.570525+0000 mgr.a (mgr.14355) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:35 smithi007 bash[22722]: audit 2024-09-14T02:11:34.952463+0000 mon.a (mon.0) 2084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:11:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:35 smithi131 bash[24745]: cluster 2024-09-14T02:11:33.570525+0000 mgr.a (mgr.14355) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:35 smithi131 bash[24745]: audit 2024-09-14T02:11:34.952463+0000 mon.a (mon.0) 2084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:11:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:35 smithi171 bash[25040]: cluster 2024-09-14T02:11:33.570525+0000 mgr.a (mgr.14355) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:35 smithi171 bash[25040]: audit 2024-09-14T02:11:34.952463+0000 mon.a (mon.0) 2084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:11:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22722]: audit 2024-09-14T02:11:35.804771+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:11:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22722]: audit 2024-09-14T02:11:35.806544+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:11:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22722]: audit 2024-09-14T02:11:35.817138+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:11:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22722]: audit 2024-09-14T02:11:35.822100+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:36 smithi131 bash[24745]: audit 2024-09-14T02:11:35.804771+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:11:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:36 smithi131 bash[24745]: audit 2024-09-14T02:11:35.806544+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:11:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:36 smithi131 bash[24745]: audit 2024-09-14T02:11:35.817138+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:11:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:36 smithi131 bash[24745]: audit 2024-09-14T02:11:35.822100+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:36 smithi171 bash[25040]: audit 2024-09-14T02:11:35.804771+0000 mon.a (mon.0) 2085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:11:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:36 smithi171 bash[25040]: audit 2024-09-14T02:11:35.806544+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:11:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:36 smithi171 bash[25040]: audit 2024-09-14T02:11:35.817138+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:11:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:36 smithi171 bash[25040]: audit 2024-09-14T02:11:35.822100+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22972]: debug 2024-09-14T02:11:36.566+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:11:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:11:36 smithi007 bash[22972]: debug 2024-09-14T02:11:36.566+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:11:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:37 smithi007 bash[22722]: cluster 2024-09-14T02:11:35.572711+0000 mgr.a (mgr.14355) 9976 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:37 smithi007 bash[22722]: audit 2024-09-14T02:11:35.824441+0000 mgr.a (mgr.14355) 9977 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:37 smithi131 bash[24745]: cluster 2024-09-14T02:11:35.572711+0000 mgr.a (mgr.14355) 9976 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:37 smithi131 bash[24745]: audit 2024-09-14T02:11:35.824441+0000 mgr.a (mgr.14355) 9977 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:37 smithi171 bash[25040]: cluster 2024-09-14T02:11:35.572711+0000 mgr.a (mgr.14355) 9976 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:11:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:37 smithi171 bash[25040]: audit 2024-09-14T02:11:35.824441+0000 mgr.a (mgr.14355) 9977 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:11:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:38 smithi131 bash[24745]: audit 2024-09-14T02:11:36.572668+0000 mgr.a (mgr.14355) 9978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:11:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:38 smithi131 bash[24745]: cephadm 2024-09-14T02:11:36.574099+0000 mgr.a (mgr.14355) 9979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:11:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:38 smithi171 bash[25040]: audit 2024-09-14T02:11:36.572668+0000 mgr.a (mgr.14355) 9978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:11:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:38 smithi171 bash[25040]: cephadm 2024-09-14T02:11:36.574099+0000 mgr.a (mgr.14355) 9979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:11:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:38 smithi007 bash[22722]: audit 2024-09-14T02:11:36.572668+0000 mgr.a (mgr.14355) 9978 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:11:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:38 smithi007 bash[22722]: cephadm 2024-09-14T02:11:36.574099+0000 mgr.a (mgr.14355) 9979 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:11:39.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:39.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:39 smithi131 bash[24745]: cluster 2024-09-14T02:11:37.573706+0000 mgr.a (mgr.14355) 9980 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:39 smithi171 bash[25040]: cluster 2024-09-14T02:11:37.573706+0000 mgr.a (mgr.14355) 9980 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:39 smithi007 bash[22722]: cluster 2024-09-14T02:11:37.573706+0000 mgr.a (mgr.14355) 9980 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:40 smithi131 bash[24745]: audit 2024-09-14T02:11:38.990967+0000 mgr.a (mgr.14355) 9981 : audit [DBG] from='client.220755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:40 smithi171 bash[25040]: audit 2024-09-14T02:11:38.990967+0000 mgr.a (mgr.14355) 9981 : audit [DBG] from='client.220755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:40 smithi007 bash[22722]: audit 2024-09-14T02:11:38.990967+0000 mgr.a (mgr.14355) 9981 : audit [DBG] from='client.220755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:41 smithi131 bash[24745]: cluster 2024-09-14T02:11:39.574678+0000 mgr.a (mgr.14355) 9982 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:41 smithi171 bash[25040]: cluster 2024-09-14T02:11:39.574678+0000 mgr.a (mgr.14355) 9982 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:41 smithi007 bash[22722]: cluster 2024-09-14T02:11:39.574678+0000 mgr.a (mgr.14355) 9982 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:43 smithi131 bash[24745]: cluster 2024-09-14T02:11:41.577068+0000 mgr.a (mgr.14355) 9983 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:43 smithi171 bash[25040]: cluster 2024-09-14T02:11:41.577068+0000 mgr.a (mgr.14355) 9983 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:43 smithi007 bash[22722]: cluster 2024-09-14T02:11:41.577068+0000 mgr.a (mgr.14355) 9983 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:45.220 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:45.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:45 smithi131 bash[24745]: cluster 2024-09-14T02:11:43.577869+0000 mgr.a (mgr.14355) 9984 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:45 smithi171 bash[25040]: cluster 2024-09-14T02:11:43.577869+0000 mgr.a (mgr.14355) 9984 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:45 smithi007 bash[22722]: cluster 2024-09-14T02:11:43.577869+0000 mgr.a (mgr.14355) 9984 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:46 smithi131 bash[24745]: audit 2024-09-14T02:11:44.787971+0000 mgr.a (mgr.14355) 9985 : audit [DBG] from='client.220833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:46 smithi171 bash[25040]: audit 2024-09-14T02:11:44.787971+0000 mgr.a (mgr.14355) 9985 : audit [DBG] from='client.220833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:46 smithi007 bash[22722]: audit 2024-09-14T02:11:44.787971+0000 mgr.a (mgr.14355) 9985 : audit [DBG] from='client.220833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:47 smithi131 bash[24745]: cluster 2024-09-14T02:11:45.580222+0000 mgr.a (mgr.14355) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:47 smithi171 bash[25040]: cluster 2024-09-14T02:11:45.580222+0000 mgr.a (mgr.14355) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:47 smithi007 bash[22722]: cluster 2024-09-14T02:11:45.580222+0000 mgr.a (mgr.14355) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:49 smithi131 bash[24745]: cluster 2024-09-14T02:11:47.581021+0000 mgr.a (mgr.14355) 9987 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:49 smithi171 bash[25040]: cluster 2024-09-14T02:11:47.581021+0000 mgr.a (mgr.14355) 9987 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:49 smithi007 bash[22722]: cluster 2024-09-14T02:11:47.581021+0000 mgr.a (mgr.14355) 9987 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:50.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:51.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:51 smithi131 bash[24745]: cluster 2024-09-14T02:11:49.581792+0000 mgr.a (mgr.14355) 9988 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:51 smithi171 bash[25040]: cluster 2024-09-14T02:11:49.581792+0000 mgr.a (mgr.14355) 9988 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:51 smithi007 bash[22722]: cluster 2024-09-14T02:11:49.581792+0000 mgr.a (mgr.14355) 9988 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:52 smithi131 bash[24745]: audit 2024-09-14T02:11:50.557793+0000 mgr.a (mgr.14355) 9989 : audit [DBG] from='client.220911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:52 smithi171 bash[25040]: audit 2024-09-14T02:11:50.557793+0000 mgr.a (mgr.14355) 9989 : audit [DBG] from='client.220911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:52 smithi007 bash[22722]: audit 2024-09-14T02:11:50.557793+0000 mgr.a (mgr.14355) 9989 : audit [DBG] from='client.220911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:53 smithi131 bash[24745]: cluster 2024-09-14T02:11:51.584638+0000 mgr.a (mgr.14355) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:53 smithi171 bash[25040]: cluster 2024-09-14T02:11:51.584638+0000 mgr.a (mgr.14355) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:53 smithi007 bash[22722]: cluster 2024-09-14T02:11:51.584638+0000 mgr.a (mgr.14355) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:11:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:54 smithi131 bash[24745]: cluster 2024-09-14T02:11:53.585436+0000 mgr.a (mgr.14355) 9991 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:54 smithi171 bash[25040]: cluster 2024-09-14T02:11:53.585436+0000 mgr.a (mgr.14355) 9991 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:54 smithi007 bash[22722]: cluster 2024-09-14T02:11:53.585436+0000 mgr.a (mgr.14355) 9991 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:56.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:11:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:11:56.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:11:56.761 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:11:56.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:11:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:11:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:11:56.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:11:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:56 smithi007 bash[22722]: cluster 2024-09-14T02:11:55.587368+0000 mgr.a (mgr.14355) 9992 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:56 smithi131 bash[24745]: cluster 2024-09-14T02:11:55.587368+0000 mgr.a (mgr.14355) 9992 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:56 smithi171 bash[25040]: cluster 2024-09-14T02:11:55.587368+0000 mgr.a (mgr.14355) 9992 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:11:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:57 smithi007 bash[22722]: audit 2024-09-14T02:11:56.337365+0000 mgr.a (mgr.14355) 9993 : audit [DBG] from='client.220989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:57 smithi131 bash[24745]: audit 2024-09-14T02:11:56.337365+0000 mgr.a (mgr.14355) 9993 : audit [DBG] from='client.220989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:57 smithi171 bash[25040]: audit 2024-09-14T02:11:56.337365+0000 mgr.a (mgr.14355) 9993 : audit [DBG] from='client.220989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:11:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:11:58 smithi007 bash[22722]: cluster 2024-09-14T02:11:57.588322+0000 mgr.a (mgr.14355) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:11:58 smithi131 bash[24745]: cluster 2024-09-14T02:11:57.588322+0000 mgr.a (mgr.14355) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:11:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:11:58 smithi171 bash[25040]: cluster 2024-09-14T02:11:57.588322+0000 mgr.a (mgr.14355) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:00 smithi007 bash[22722]: cluster 2024-09-14T02:11:59.589279+0000 mgr.a (mgr.14355) 9995 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:00 smithi131 bash[24745]: cluster 2024-09-14T02:11:59.589279+0000 mgr.a (mgr.14355) 9995 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:00 smithi171 bash[25040]: cluster 2024-09-14T02:11:59.589279+0000 mgr.a (mgr.14355) 9995 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:01.763 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:02.551 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:02.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:02 smithi007 bash[22722]: cluster 2024-09-14T02:12:01.591696+0000 mgr.a (mgr.14355) 9996 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:02 smithi007 bash[22722]: audit 2024-09-14T02:12:02.102403+0000 mgr.a (mgr.14355) 9997 : audit [DBG] from='client.221067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:02 smithi131 bash[24745]: cluster 2024-09-14T02:12:01.591696+0000 mgr.a (mgr.14355) 9996 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:02 smithi131 bash[24745]: audit 2024-09-14T02:12:02.102403+0000 mgr.a (mgr.14355) 9997 : audit [DBG] from='client.221067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:02 smithi171 bash[25040]: cluster 2024-09-14T02:12:01.591696+0000 mgr.a (mgr.14355) 9996 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:02 smithi171 bash[25040]: audit 2024-09-14T02:12:02.102403+0000 mgr.a (mgr.14355) 9997 : audit [DBG] from='client.221067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:04 smithi007 bash[22722]: cluster 2024-09-14T02:12:03.592716+0000 mgr.a (mgr.14355) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:05.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:04 smithi131 bash[24745]: cluster 2024-09-14T02:12:03.592716+0000 mgr.a (mgr.14355) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:04 smithi171 bash[25040]: cluster 2024-09-14T02:12:03.592716+0000 mgr.a (mgr.14355) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:06 smithi007 bash[22722]: cluster 2024-09-14T02:12:05.594900+0000 mgr.a (mgr.14355) 9999 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:06 smithi131 bash[24745]: cluster 2024-09-14T02:12:05.594900+0000 mgr.a (mgr.14355) 9999 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:06 smithi171 bash[25040]: cluster 2024-09-14T02:12:05.594900+0000 mgr.a (mgr.14355) 9999 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:07.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:07.553 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:07.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:08.288 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:08.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:08.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:08.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:08.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:08 smithi007 bash[22722]: cluster 2024-09-14T02:12:07.595648+0000 mgr.a (mgr.14355) 10000 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:08 smithi007 bash[22722]: audit 2024-09-14T02:12:07.879436+0000 mgr.a (mgr.14355) 10001 : audit [DBG] from='client.221136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:08 smithi131 bash[24745]: cluster 2024-09-14T02:12:07.595648+0000 mgr.a (mgr.14355) 10000 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:08 smithi131 bash[24745]: audit 2024-09-14T02:12:07.879436+0000 mgr.a (mgr.14355) 10001 : audit [DBG] from='client.221136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:08 smithi171 bash[25040]: cluster 2024-09-14T02:12:07.595648+0000 mgr.a (mgr.14355) 10000 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:08 smithi171 bash[25040]: audit 2024-09-14T02:12:07.879436+0000 mgr.a (mgr.14355) 10001 : audit [DBG] from='client.221136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:10 smithi007 bash[22722]: cluster 2024-09-14T02:12:09.596720+0000 mgr.a (mgr.14355) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:10 smithi131 bash[24745]: cluster 2024-09-14T02:12:09.596720+0000 mgr.a (mgr.14355) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:10 smithi171 bash[25040]: cluster 2024-09-14T02:12:09.596720+0000 mgr.a (mgr.14355) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:12:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:12 smithi007 bash[22722]: cluster 2024-09-14T02:12:11.599565+0000 mgr.a (mgr.14355) 10003 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:12 smithi131 bash[24745]: cluster 2024-09-14T02:12:11.599565+0000 mgr.a (mgr.14355) 10003 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:12 smithi171 bash[25040]: cluster 2024-09-14T02:12:11.599565+0000 mgr.a (mgr.14355) 10003 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:12:13.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:13.290 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:14.052 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:14 smithi007 bash[22722]: cluster 2024-09-14T02:12:13.600313+0000 mgr.a (mgr.14355) 10004 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:14 smithi007 bash[22722]: audit 2024-09-14T02:12:13.620193+0000 mgr.a (mgr.14355) 10005 : audit [DBG] from='client.221211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:14 smithi131 bash[24745]: cluster 2024-09-14T02:12:13.600313+0000 mgr.a (mgr.14355) 10004 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:14 smithi131 bash[24745]: audit 2024-09-14T02:12:13.620193+0000 mgr.a (mgr.14355) 10005 : audit [DBG] from='client.221211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:14 smithi171 bash[25040]: cluster 2024-09-14T02:12:13.600313+0000 mgr.a (mgr.14355) 10004 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:14 smithi171 bash[25040]: audit 2024-09-14T02:12:13.620193+0000 mgr.a (mgr.14355) 10005 : audit [DBG] from='client.221211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:16 smithi007 bash[22722]: cluster 2024-09-14T02:12:15.602709+0000 mgr.a (mgr.14355) 10006 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:16 smithi131 bash[24745]: cluster 2024-09-14T02:12:15.602709+0000 mgr.a (mgr.14355) 10006 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:16 smithi171 bash[25040]: cluster 2024-09-14T02:12:15.602709+0000 mgr.a (mgr.14355) 10006 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:18 smithi007 bash[22722]: cluster 2024-09-14T02:12:17.603665+0000 mgr.a (mgr.14355) 10007 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:18 smithi131 bash[24745]: cluster 2024-09-14T02:12:17.603665+0000 mgr.a (mgr.14355) 10007 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:18 smithi171 bash[25040]: cluster 2024-09-14T02:12:17.603665+0000 mgr.a (mgr.14355) 10007 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:19.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:19.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:19.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:19.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:20 smithi007 bash[22722]: audit 2024-09-14T02:12:19.383571+0000 mgr.a (mgr.14355) 10008 : audit [DBG] from='client.221286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:20 smithi007 bash[22722]: cluster 2024-09-14T02:12:19.605126+0000 mgr.a (mgr.14355) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:20 smithi131 bash[24745]: audit 2024-09-14T02:12:19.383571+0000 mgr.a (mgr.14355) 10008 : audit [DBG] from='client.221286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:20 smithi131 bash[24745]: cluster 2024-09-14T02:12:19.605126+0000 mgr.a (mgr.14355) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:20 smithi171 bash[25040]: audit 2024-09-14T02:12:19.383571+0000 mgr.a (mgr.14355) 10008 : audit [DBG] from='client.221286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:20 smithi171 bash[25040]: cluster 2024-09-14T02:12:19.605126+0000 mgr.a (mgr.14355) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:22 smithi007 bash[22722]: cluster 2024-09-14T02:12:21.607554+0000 mgr.a (mgr.14355) 10010 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:22 smithi131 bash[24745]: cluster 2024-09-14T02:12:21.607554+0000 mgr.a (mgr.14355) 10010 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:22 smithi171 bash[25040]: cluster 2024-09-14T02:12:21.607554+0000 mgr.a (mgr.14355) 10010 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:12:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:24 smithi131 bash[24745]: cluster 2024-09-14T02:12:23.608367+0000 mgr.a (mgr.14355) 10011 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:24 smithi171 bash[25040]: cluster 2024-09-14T02:12:23.608367+0000 mgr.a (mgr.14355) 10011 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:24 smithi007 bash[22722]: cluster 2024-09-14T02:12:23.608367+0000 mgr.a (mgr.14355) 10011 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:25.532 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:25.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:25 smithi131 bash[24745]: audit 2024-09-14T02:12:25.125288+0000 mgr.a (mgr.14355) 10012 : audit [DBG] from='client.221364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:25 smithi171 bash[25040]: audit 2024-09-14T02:12:25.125288+0000 mgr.a (mgr.14355) 10012 : audit [DBG] from='client.221364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:25 smithi007 bash[22722]: audit 2024-09-14T02:12:25.125288+0000 mgr.a (mgr.14355) 10012 : audit [DBG] from='client.221364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:26 smithi131 bash[24745]: cluster 2024-09-14T02:12:25.609730+0000 mgr.a (mgr.14355) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:26 smithi171 bash[25040]: cluster 2024-09-14T02:12:25.609730+0000 mgr.a (mgr.14355) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:26 smithi007 bash[22722]: cluster 2024-09-14T02:12:25.609730+0000 mgr.a (mgr.14355) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:12:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:28 smithi131 bash[24745]: cluster 2024-09-14T02:12:27.610661+0000 mgr.a (mgr.14355) 10014 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:28 smithi171 bash[25040]: cluster 2024-09-14T02:12:27.610661+0000 mgr.a (mgr.14355) 10014 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:28 smithi007 bash[22722]: cluster 2024-09-14T02:12:27.610661+0000 mgr.a (mgr.14355) 10014 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:30.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:30.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:30.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:30 smithi131 bash[24745]: cluster 2024-09-14T02:12:29.611590+0000 mgr.a (mgr.14355) 10015 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:30 smithi171 bash[25040]: cluster 2024-09-14T02:12:29.611590+0000 mgr.a (mgr.14355) 10015 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:30 smithi007 bash[22722]: cluster 2024-09-14T02:12:29.611590+0000 mgr.a (mgr.14355) 10015 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:12:31.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:31.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:31 smithi131 bash[24745]: audit 2024-09-14T02:12:30.869009+0000 mgr.a (mgr.14355) 10016 : audit [DBG] from='client.221439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:31 smithi171 bash[25040]: audit 2024-09-14T02:12:30.869009+0000 mgr.a (mgr.14355) 10016 : audit [DBG] from='client.221439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:31 smithi007 bash[22722]: audit 2024-09-14T02:12:30.869009+0000 mgr.a (mgr.14355) 10016 : audit [DBG] from='client.221439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:32 smithi131 bash[24745]: cluster 2024-09-14T02:12:31.614614+0000 mgr.a (mgr.14355) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:32 smithi171 bash[25040]: cluster 2024-09-14T02:12:31.614614+0000 mgr.a (mgr.14355) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:32 smithi007 bash[22722]: cluster 2024-09-14T02:12:31.614614+0000 mgr.a (mgr.14355) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:34 smithi131 bash[24745]: cluster 2024-09-14T02:12:33.615581+0000 mgr.a (mgr.14355) 10018 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:34 smithi171 bash[25040]: cluster 2024-09-14T02:12:33.615581+0000 mgr.a (mgr.14355) 10018 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:34 smithi007 bash[22722]: cluster 2024-09-14T02:12:33.615581+0000 mgr.a (mgr.14355) 10018 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:12:36.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:36.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:36.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:36 smithi131 bash[24745]: cluster 2024-09-14T02:12:35.617545+0000 mgr.a (mgr.14355) 10019 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:36 smithi131 bash[24745]: audit 2024-09-14T02:12:36.629844+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:12:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:36 smithi171 bash[25040]: cluster 2024-09-14T02:12:35.617545+0000 mgr.a (mgr.14355) 10019 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:36 smithi171 bash[25040]: audit 2024-09-14T02:12:36.629844+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:12:37.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:37.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:37.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:36 smithi007 bash[22722]: cluster 2024-09-14T02:12:35.617545+0000 mgr.a (mgr.14355) 10019 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:36 smithi007 bash[22722]: audit 2024-09-14T02:12:36.629844+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:12:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:37 smithi131 bash[24745]: audit 2024-09-14T02:12:36.651474+0000 mgr.a (mgr.14355) 10020 : audit [DBG] from='client.221514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:37 smithi171 bash[25040]: audit 2024-09-14T02:12:36.651474+0000 mgr.a (mgr.14355) 10020 : audit [DBG] from='client.221514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:37 smithi007 bash[22722]: audit 2024-09-14T02:12:36.651474+0000 mgr.a (mgr.14355) 10020 : audit [DBG] from='client.221514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:38 smithi131 bash[24745]: cluster 2024-09-14T02:12:37.618653+0000 mgr.a (mgr.14355) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:38 smithi171 bash[25040]: cluster 2024-09-14T02:12:37.618653+0000 mgr.a (mgr.14355) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:38 smithi007 bash[22722]: cluster 2024-09-14T02:12:37.618653+0000 mgr.a (mgr.14355) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:40 smithi131 bash[24745]: cluster 2024-09-14T02:12:39.619624+0000 mgr.a (mgr.14355) 10022 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:40 smithi171 bash[25040]: cluster 2024-09-14T02:12:39.619624+0000 mgr.a (mgr.14355) 10022 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:40 smithi007 bash[22722]: cluster 2024-09-14T02:12:39.619624+0000 mgr.a (mgr.14355) 10022 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:42.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:42.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: cluster 2024-09-14T02:12:41.622033+0000 mgr.a (mgr.14355) 10023 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:12:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:41.984817+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:41.992295+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.017607+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.021650+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.028237+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.034676+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.761829+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.762726+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.768053+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:42 smithi131 bash[24745]: audit 2024-09-14T02:12:42.770850+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: cluster 2024-09-14T02:12:41.622033+0000 mgr.a (mgr.14355) 10023 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:12:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:41.984817+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:41.992295+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.017607+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.021650+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.028237+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.034676+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.761829+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.762726+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.768053+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:42 smithi171 bash[25040]: audit 2024-09-14T02:12:42.770850+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: cluster 2024-09-14T02:12:41.622033+0000 mgr.a (mgr.14355) 10023 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:41.984817+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:41.992295+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.017607+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.021650+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.028237+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.034676+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.761829+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:12:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.762726+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:12:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.768053+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:12:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:42 smithi007 bash[22722]: audit 2024-09-14T02:12:42.770850+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:43.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:12:43 smithi007 bash[22972]: debug 2024-09-14T02:12:43.533+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:12:43.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:12:43 smithi007 bash[22972]: debug 2024-09-14T02:12:43.537+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:12:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:43 smithi131 bash[24745]: audit 2024-09-14T02:12:42.399166+0000 mgr.a (mgr.14355) 10024 : audit [DBG] from='client.221586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:43 smithi131 bash[24745]: audit 2024-09-14T02:12:42.772001+0000 mgr.a (mgr.14355) 10025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:43 smithi171 bash[25040]: audit 2024-09-14T02:12:42.399166+0000 mgr.a (mgr.14355) 10024 : audit [DBG] from='client.221586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:43 smithi171 bash[25040]: audit 2024-09-14T02:12:42.772001+0000 mgr.a (mgr.14355) 10025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:43 smithi007 bash[22722]: audit 2024-09-14T02:12:42.399166+0000 mgr.a (mgr.14355) 10024 : audit [DBG] from='client.221586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:43 smithi007 bash[22722]: audit 2024-09-14T02:12:42.772001+0000 mgr.a (mgr.14355) 10025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:12:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:45 smithi131 bash[24745]: audit 2024-09-14T02:12:43.537908+0000 mgr.a (mgr.14355) 10026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:12:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:45 smithi131 bash[24745]: cephadm 2024-09-14T02:12:43.539077+0000 mgr.a (mgr.14355) 10027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:12:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:45 smithi131 bash[24745]: cluster 2024-09-14T02:12:43.623016+0000 mgr.a (mgr.14355) 10028 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:45 smithi171 bash[25040]: audit 2024-09-14T02:12:43.537908+0000 mgr.a (mgr.14355) 10026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:12:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:45 smithi171 bash[25040]: cephadm 2024-09-14T02:12:43.539077+0000 mgr.a (mgr.14355) 10027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:12:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:45 smithi171 bash[25040]: cluster 2024-09-14T02:12:43.623016+0000 mgr.a (mgr.14355) 10028 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:45 smithi007 bash[22722]: audit 2024-09-14T02:12:43.537908+0000 mgr.a (mgr.14355) 10026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:12:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:45 smithi007 bash[22722]: cephadm 2024-09-14T02:12:43.539077+0000 mgr.a (mgr.14355) 10027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:12:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:45 smithi007 bash[22722]: cluster 2024-09-14T02:12:43.623016+0000 mgr.a (mgr.14355) 10028 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:47 smithi131 bash[24745]: cluster 2024-09-14T02:12:45.625201+0000 mgr.a (mgr.14355) 10029 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:47 smithi171 bash[25040]: cluster 2024-09-14T02:12:45.625201+0000 mgr.a (mgr.14355) 10029 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:47 smithi007 bash[22722]: cluster 2024-09-14T02:12:45.625201+0000 mgr.a (mgr.14355) 10029 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:47.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:47.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:48.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:48.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:48.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:48.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:48.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:49 smithi131 bash[24745]: cluster 2024-09-14T02:12:47.625998+0000 mgr.a (mgr.14355) 10030 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:49 smithi131 bash[24745]: audit 2024-09-14T02:12:48.183468+0000 mgr.a (mgr.14355) 10031 : audit [DBG] from='client.221769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:49 smithi171 bash[25040]: cluster 2024-09-14T02:12:47.625998+0000 mgr.a (mgr.14355) 10030 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:49 smithi171 bash[25040]: audit 2024-09-14T02:12:48.183468+0000 mgr.a (mgr.14355) 10031 : audit [DBG] from='client.221769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:49 smithi007 bash[22722]: cluster 2024-09-14T02:12:47.625998+0000 mgr.a (mgr.14355) 10030 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:49 smithi007 bash[22722]: audit 2024-09-14T02:12:48.183468+0000 mgr.a (mgr.14355) 10031 : audit [DBG] from='client.221769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:51 smithi131 bash[24745]: cluster 2024-09-14T02:12:49.626891+0000 mgr.a (mgr.14355) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:51 smithi171 bash[25040]: cluster 2024-09-14T02:12:49.626891+0000 mgr.a (mgr.14355) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:51 smithi007 bash[22722]: cluster 2024-09-14T02:12:49.626891+0000 mgr.a (mgr.14355) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:53 smithi131 bash[24745]: cluster 2024-09-14T02:12:51.629172+0000 mgr.a (mgr.14355) 10033 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:53 smithi171 bash[25040]: cluster 2024-09-14T02:12:51.629172+0000 mgr.a (mgr.14355) 10033 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:53 smithi007 bash[22722]: cluster 2024-09-14T02:12:51.629172+0000 mgr.a (mgr.14355) 10033 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:53.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:53.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:53.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:54.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:12:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:12:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:12:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:12:54.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:12:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:55 smithi131 bash[24745]: cluster 2024-09-14T02:12:53.629968+0000 mgr.a (mgr.14355) 10034 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:55 smithi131 bash[24745]: audit 2024-09-14T02:12:53.927794+0000 mgr.a (mgr.14355) 10035 : audit [DBG] from='client.221847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:55 smithi171 bash[25040]: cluster 2024-09-14T02:12:53.629968+0000 mgr.a (mgr.14355) 10034 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:55 smithi171 bash[25040]: audit 2024-09-14T02:12:53.927794+0000 mgr.a (mgr.14355) 10035 : audit [DBG] from='client.221847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:55 smithi007 bash[22722]: cluster 2024-09-14T02:12:53.629968+0000 mgr.a (mgr.14355) 10034 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:55 smithi007 bash[22722]: audit 2024-09-14T02:12:53.927794+0000 mgr.a (mgr.14355) 10035 : audit [DBG] from='client.221847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:12:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:57 smithi131 bash[24745]: cluster 2024-09-14T02:12:55.632386+0000 mgr.a (mgr.14355) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:57 smithi171 bash[25040]: cluster 2024-09-14T02:12:55.632386+0000 mgr.a (mgr.14355) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:57 smithi007 bash[22722]: cluster 2024-09-14T02:12:55.632386+0000 mgr.a (mgr.14355) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:12:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:12:59 smithi131 bash[24745]: cluster 2024-09-14T02:12:57.633347+0000 mgr.a (mgr.14355) 10037 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:12:59 smithi171 bash[25040]: cluster 2024-09-14T02:12:57.633347+0000 mgr.a (mgr.14355) 10037 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:12:59.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:12:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:12:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:12:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:12:59 smithi007 bash[22722]: cluster 2024-09-14T02:12:57.633347+0000 mgr.a (mgr.14355) 10037 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:00.117 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:00.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:01 smithi171 bash[25040]: cluster 2024-09-14T02:12:59.634125+0000 mgr.a (mgr.14355) 10038 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:01 smithi171 bash[25040]: audit 2024-09-14T02:12:59.672477+0000 mgr.a (mgr.14355) 10039 : audit [DBG] from='client.221925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:01 smithi007 bash[22722]: cluster 2024-09-14T02:12:59.634125+0000 mgr.a (mgr.14355) 10038 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:01 smithi007 bash[22722]: audit 2024-09-14T02:12:59.672477+0000 mgr.a (mgr.14355) 10039 : audit [DBG] from='client.221925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:01 smithi131 bash[24745]: cluster 2024-09-14T02:12:59.634125+0000 mgr.a (mgr.14355) 10038 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:01 smithi131 bash[24745]: audit 2024-09-14T02:12:59.672477+0000 mgr.a (mgr.14355) 10039 : audit [DBG] from='client.221925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:03 smithi171 bash[25040]: cluster 2024-09-14T02:13:01.636481+0000 mgr.a (mgr.14355) 10040 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:03 smithi007 bash[22722]: cluster 2024-09-14T02:13:01.636481+0000 mgr.a (mgr.14355) 10040 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:03 smithi131 bash[24745]: cluster 2024-09-14T02:13:01.636481+0000 mgr.a (mgr.14355) 10040 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:05.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:05.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:05.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:05 smithi007 bash[22722]: cluster 2024-09-14T02:13:03.637279+0000 mgr.a (mgr.14355) 10041 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:05 smithi131 bash[24745]: cluster 2024-09-14T02:13:03.637279+0000 mgr.a (mgr.14355) 10041 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:05 smithi171 bash[25040]: cluster 2024-09-14T02:13:03.637279+0000 mgr.a (mgr.14355) 10041 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:05.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:07 smithi007 bash[22722]: audit 2024-09-14T02:13:05.458686+0000 mgr.a (mgr.14355) 10042 : audit [DBG] from='client.222000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:07 smithi007 bash[22722]: cluster 2024-09-14T02:13:05.639040+0000 mgr.a (mgr.14355) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:07 smithi131 bash[24745]: audit 2024-09-14T02:13:05.458686+0000 mgr.a (mgr.14355) 10042 : audit [DBG] from='client.222000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:07 smithi131 bash[24745]: cluster 2024-09-14T02:13:05.639040+0000 mgr.a (mgr.14355) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:07 smithi171 bash[25040]: audit 2024-09-14T02:13:05.458686+0000 mgr.a (mgr.14355) 10042 : audit [DBG] from='client.222000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:07 smithi171 bash[25040]: cluster 2024-09-14T02:13:05.639040+0000 mgr.a (mgr.14355) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:09 smithi007 bash[22722]: cluster 2024-09-14T02:13:07.639934+0000 mgr.a (mgr.14355) 10044 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:09 smithi131 bash[24745]: cluster 2024-09-14T02:13:07.639934+0000 mgr.a (mgr.14355) 10044 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:09 smithi171 bash[25040]: cluster 2024-09-14T02:13:07.639934+0000 mgr.a (mgr.14355) 10044 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:10.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:11 smithi007 bash[22722]: cluster 2024-09-14T02:13:09.640707+0000 mgr.a (mgr.14355) 10045 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:11 smithi131 bash[24745]: cluster 2024-09-14T02:13:09.640707+0000 mgr.a (mgr.14355) 10045 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:11 smithi171 bash[25040]: cluster 2024-09-14T02:13:09.640707+0000 mgr.a (mgr.14355) 10045 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:11.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:11.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:11.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:12 smithi007 bash[22722]: audit 2024-09-14T02:13:11.237224+0000 mgr.a (mgr.14355) 10046 : audit [DBG] from='client.222078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:12 smithi131 bash[24745]: audit 2024-09-14T02:13:11.237224+0000 mgr.a (mgr.14355) 10046 : audit [DBG] from='client.222078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:12 smithi171 bash[25040]: audit 2024-09-14T02:13:11.237224+0000 mgr.a (mgr.14355) 10046 : audit [DBG] from='client.222078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:13 smithi007 bash[22722]: cluster 2024-09-14T02:13:11.642184+0000 mgr.a (mgr.14355) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:13 smithi131 bash[24745]: cluster 2024-09-14T02:13:11.642184+0000 mgr.a (mgr.14355) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:13 smithi171 bash[25040]: cluster 2024-09-14T02:13:11.642184+0000 mgr.a (mgr.14355) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:15 smithi007 bash[22722]: cluster 2024-09-14T02:13:13.643077+0000 mgr.a (mgr.14355) 10048 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:15 smithi131 bash[24745]: cluster 2024-09-14T02:13:13.643077+0000 mgr.a (mgr.14355) 10048 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:15 smithi171 bash[25040]: cluster 2024-09-14T02:13:13.643077+0000 mgr.a (mgr.14355) 10048 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:13:16.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:16.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:16.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:17 smithi007 bash[22722]: cluster 2024-09-14T02:13:15.645216+0000 mgr.a (mgr.14355) 10049 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:17.464 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:17.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:17.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:17.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:17 smithi131 bash[24745]: cluster 2024-09-14T02:13:15.645216+0000 mgr.a (mgr.14355) 10049 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:17 smithi171 bash[25040]: cluster 2024-09-14T02:13:15.645216+0000 mgr.a (mgr.14355) 10049 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:18 smithi007 bash[22722]: audit 2024-09-14T02:13:17.020584+0000 mgr.a (mgr.14355) 10050 : audit [DBG] from='client.222156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:18 smithi131 bash[24745]: audit 2024-09-14T02:13:17.020584+0000 mgr.a (mgr.14355) 10050 : audit [DBG] from='client.222156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:18 smithi171 bash[25040]: audit 2024-09-14T02:13:17.020584+0000 mgr.a (mgr.14355) 10050 : audit [DBG] from='client.222156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:19 smithi007 bash[22722]: cluster 2024-09-14T02:13:17.646226+0000 mgr.a (mgr.14355) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:19 smithi131 bash[24745]: cluster 2024-09-14T02:13:17.646226+0000 mgr.a (mgr.14355) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:19 smithi171 bash[25040]: cluster 2024-09-14T02:13:17.646226+0000 mgr.a (mgr.14355) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:21 smithi007 bash[22722]: cluster 2024-09-14T02:13:19.647062+0000 mgr.a (mgr.14355) 10052 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:21 smithi131 bash[24745]: cluster 2024-09-14T02:13:19.647062+0000 mgr.a (mgr.14355) 10052 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:21 smithi171 bash[25040]: cluster 2024-09-14T02:13:19.647062+0000 mgr.a (mgr.14355) 10052 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:23.235 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:23.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:23 smithi007 bash[22722]: cluster 2024-09-14T02:13:21.649312+0000 mgr.a (mgr.14355) 10053 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:23 smithi131 bash[24745]: cluster 2024-09-14T02:13:21.649312+0000 mgr.a (mgr.14355) 10053 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:23 smithi171 bash[25040]: cluster 2024-09-14T02:13:21.649312+0000 mgr.a (mgr.14355) 10053 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:24 smithi007 bash[22722]: audit 2024-09-14T02:13:22.803178+0000 mgr.a (mgr.14355) 10054 : audit [DBG] from='client.222234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:24 smithi131 bash[24745]: audit 2024-09-14T02:13:22.803178+0000 mgr.a (mgr.14355) 10054 : audit [DBG] from='client.222234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:24 smithi171 bash[25040]: audit 2024-09-14T02:13:22.803178+0000 mgr.a (mgr.14355) 10054 : audit [DBG] from='client.222234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:25 smithi007 bash[22722]: cluster 2024-09-14T02:13:23.650270+0000 mgr.a (mgr.14355) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:25 smithi131 bash[24745]: cluster 2024-09-14T02:13:23.650270+0000 mgr.a (mgr.14355) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:25 smithi171 bash[25040]: cluster 2024-09-14T02:13:23.650270+0000 mgr.a (mgr.14355) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:27 smithi007 bash[22722]: cluster 2024-09-14T02:13:25.652420+0000 mgr.a (mgr.14355) 10056 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:27 smithi131 bash[24745]: cluster 2024-09-14T02:13:25.652420+0000 mgr.a (mgr.14355) 10056 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:27 smithi171 bash[25040]: cluster 2024-09-14T02:13:25.652420+0000 mgr.a (mgr.14355) 10056 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:28.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:28.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:29.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:29.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:29 smithi007 bash[22722]: cluster 2024-09-14T02:13:27.653197+0000 mgr.a (mgr.14355) 10057 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:29 smithi131 bash[24745]: cluster 2024-09-14T02:13:27.653197+0000 mgr.a (mgr.14355) 10057 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:29 smithi171 bash[25040]: cluster 2024-09-14T02:13:27.653197+0000 mgr.a (mgr.14355) 10057 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:30 smithi007 bash[22722]: audit 2024-09-14T02:13:28.571106+0000 mgr.a (mgr.14355) 10058 : audit [DBG] from='client.222306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:30 smithi131 bash[24745]: audit 2024-09-14T02:13:28.571106+0000 mgr.a (mgr.14355) 10058 : audit [DBG] from='client.222306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:30 smithi171 bash[25040]: audit 2024-09-14T02:13:28.571106+0000 mgr.a (mgr.14355) 10058 : audit [DBG] from='client.222306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:31 smithi007 bash[22722]: cluster 2024-09-14T02:13:29.654090+0000 mgr.a (mgr.14355) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:31 smithi131 bash[24745]: cluster 2024-09-14T02:13:29.654090+0000 mgr.a (mgr.14355) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:31 smithi171 bash[25040]: cluster 2024-09-14T02:13:29.654090+0000 mgr.a (mgr.14355) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:33 smithi007 bash[22722]: cluster 2024-09-14T02:13:31.656344+0000 mgr.a (mgr.14355) 10060 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:33 smithi131 bash[24745]: cluster 2024-09-14T02:13:31.656344+0000 mgr.a (mgr.14355) 10060 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:33 smithi171 bash[25040]: cluster 2024-09-14T02:13:31.656344+0000 mgr.a (mgr.14355) 10060 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:34.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:34.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:34.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:34.797 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:35 smithi007 bash[22722]: cluster 2024-09-14T02:13:33.657106+0000 mgr.a (mgr.14355) 10061 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:35 smithi131 bash[24745]: cluster 2024-09-14T02:13:33.657106+0000 mgr.a (mgr.14355) 10061 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:35 smithi171 bash[25040]: cluster 2024-09-14T02:13:33.657106+0000 mgr.a (mgr.14355) 10061 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:36 smithi007 bash[22722]: audit 2024-09-14T02:13:34.355177+0000 mgr.a (mgr.14355) 10062 : audit [DBG] from='client.222384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:36 smithi131 bash[24745]: audit 2024-09-14T02:13:34.355177+0000 mgr.a (mgr.14355) 10062 : audit [DBG] from='client.222384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:36 smithi171 bash[25040]: audit 2024-09-14T02:13:34.355177+0000 mgr.a (mgr.14355) 10062 : audit [DBG] from='client.222384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:37 smithi007 bash[22722]: cluster 2024-09-14T02:13:35.659377+0000 mgr.a (mgr.14355) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:37 smithi131 bash[24745]: cluster 2024-09-14T02:13:35.659377+0000 mgr.a (mgr.14355) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:37 smithi171 bash[25040]: cluster 2024-09-14T02:13:35.659377+0000 mgr.a (mgr.14355) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:13:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:39 smithi007 bash[22722]: cluster 2024-09-14T02:13:37.660131+0000 mgr.a (mgr.14355) 10064 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:39 smithi131 bash[24745]: cluster 2024-09-14T02:13:37.660131+0000 mgr.a (mgr.14355) 10064 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:39 smithi171 bash[25040]: cluster 2024-09-14T02:13:37.660131+0000 mgr.a (mgr.14355) 10064 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:39.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:39.799 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:40.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:41 smithi007 bash[22722]: cluster 2024-09-14T02:13:39.660879+0000 mgr.a (mgr.14355) 10065 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:41 smithi007 bash[22722]: audit 2024-09-14T02:13:40.136742+0000 mgr.a (mgr.14355) 10066 : audit [DBG] from='client.222456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:41 smithi131 bash[24745]: cluster 2024-09-14T02:13:39.660879+0000 mgr.a (mgr.14355) 10065 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:41 smithi131 bash[24745]: audit 2024-09-14T02:13:40.136742+0000 mgr.a (mgr.14355) 10066 : audit [DBG] from='client.222456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:41 smithi171 bash[25040]: cluster 2024-09-14T02:13:39.660879+0000 mgr.a (mgr.14355) 10065 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:41 smithi171 bash[25040]: audit 2024-09-14T02:13:40.136742+0000 mgr.a (mgr.14355) 10066 : audit [DBG] from='client.222456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:43 smithi007 bash[22722]: cluster 2024-09-14T02:13:41.663621+0000 mgr.a (mgr.14355) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:43 smithi131 bash[24745]: cluster 2024-09-14T02:13:41.663621+0000 mgr.a (mgr.14355) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:43 smithi171 bash[25040]: cluster 2024-09-14T02:13:41.663621+0000 mgr.a (mgr.14355) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:44 smithi007 bash[22722]: audit 2024-09-14T02:13:43.588958+0000 mon.a (mon.0) 2100 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:13:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:44 smithi131 bash[24745]: audit 2024-09-14T02:13:43.588958+0000 mon.a (mon.0) 2100 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:13:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:44 smithi171 bash[25040]: audit 2024-09-14T02:13:43.588958+0000 mon.a (mon.0) 2100 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:13:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22972]: debug 2024-09-14T02:13:45.176+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22972]: debug 2024-09-14T02:13:45.180+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22722]: cluster 2024-09-14T02:13:43.664355+0000 mgr.a (mgr.14355) 10068 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22722]: audit 2024-09-14T02:13:44.428746+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22722]: audit 2024-09-14T02:13:44.430268+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22722]: audit 2024-09-14T02:13:44.440104+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:13:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:45 smithi007 bash[22722]: audit 2024-09-14T02:13:44.444917+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:45 smithi131 bash[24745]: cluster 2024-09-14T02:13:43.664355+0000 mgr.a (mgr.14355) 10068 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:45 smithi131 bash[24745]: audit 2024-09-14T02:13:44.428746+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:13:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:45 smithi131 bash[24745]: audit 2024-09-14T02:13:44.430268+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:13:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:45 smithi131 bash[24745]: audit 2024-09-14T02:13:44.440104+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:13:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:45 smithi131 bash[24745]: audit 2024-09-14T02:13:44.444917+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:45 smithi171 bash[25040]: cluster 2024-09-14T02:13:43.664355+0000 mgr.a (mgr.14355) 10068 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:13:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:45 smithi171 bash[25040]: audit 2024-09-14T02:13:44.428746+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:13:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:45 smithi171 bash[25040]: audit 2024-09-14T02:13:44.430268+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:13:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:45 smithi171 bash[25040]: audit 2024-09-14T02:13:44.440104+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:13:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:45 smithi171 bash[25040]: audit 2024-09-14T02:13:44.444917+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:45.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:45.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:45.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:46.294 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:46.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:46.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:46.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:46.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:46 smithi007 bash[22722]: audit 2024-09-14T02:13:44.447287+0000 mgr.a (mgr.14355) 10069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:46 smithi007 bash[22722]: audit 2024-09-14T02:13:45.181304+0000 mgr.a (mgr.14355) 10070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:13:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:46 smithi007 bash[22722]: cephadm 2024-09-14T02:13:45.182573+0000 mgr.a (mgr.14355) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:13:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:46 smithi131 bash[24745]: audit 2024-09-14T02:13:44.447287+0000 mgr.a (mgr.14355) 10069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:46 smithi131 bash[24745]: audit 2024-09-14T02:13:45.181304+0000 mgr.a (mgr.14355) 10070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:13:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:46 smithi131 bash[24745]: cephadm 2024-09-14T02:13:45.182573+0000 mgr.a (mgr.14355) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:13:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:46 smithi171 bash[25040]: audit 2024-09-14T02:13:44.447287+0000 mgr.a (mgr.14355) 10069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:13:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:46 smithi171 bash[25040]: audit 2024-09-14T02:13:45.181304+0000 mgr.a (mgr.14355) 10070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:13:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:46 smithi171 bash[25040]: cephadm 2024-09-14T02:13:45.182573+0000 mgr.a (mgr.14355) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:13:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:47 smithi007 bash[22722]: cluster 2024-09-14T02:13:45.665448+0000 mgr.a (mgr.14355) 10072 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:47 smithi007 bash[22722]: audit 2024-09-14T02:13:45.882114+0000 mgr.a (mgr.14355) 10073 : audit [DBG] from='client.222642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:47 smithi131 bash[24745]: cluster 2024-09-14T02:13:45.665448+0000 mgr.a (mgr.14355) 10072 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:47 smithi131 bash[24745]: audit 2024-09-14T02:13:45.882114+0000 mgr.a (mgr.14355) 10073 : audit [DBG] from='client.222642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:47 smithi171 bash[25040]: cluster 2024-09-14T02:13:45.665448+0000 mgr.a (mgr.14355) 10072 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:47 smithi171 bash[25040]: audit 2024-09-14T02:13:45.882114+0000 mgr.a (mgr.14355) 10073 : audit [DBG] from='client.222642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:49 smithi007 bash[22722]: cluster 2024-09-14T02:13:47.666477+0000 mgr.a (mgr.14355) 10074 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:49 smithi131 bash[24745]: cluster 2024-09-14T02:13:47.666477+0000 mgr.a (mgr.14355) 10074 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:49 smithi171 bash[25040]: cluster 2024-09-14T02:13:47.666477+0000 mgr.a (mgr.14355) 10074 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:51.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:51 smithi007 bash[22722]: cluster 2024-09-14T02:13:49.667449+0000 mgr.a (mgr.14355) 10075 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:51 smithi131 bash[24745]: cluster 2024-09-14T02:13:49.667449+0000 mgr.a (mgr.14355) 10075 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:51 smithi171 bash[25040]: cluster 2024-09-14T02:13:49.667449+0000 mgr.a (mgr.14355) 10075 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:13:52.063 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:52.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:53 smithi007 bash[22722]: audit 2024-09-14T02:13:51.626116+0000 mgr.a (mgr.14355) 10076 : audit [DBG] from='client.222717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:53 smithi007 bash[22722]: cluster 2024-09-14T02:13:51.670536+0000 mgr.a (mgr.14355) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:53 smithi131 bash[24745]: audit 2024-09-14T02:13:51.626116+0000 mgr.a (mgr.14355) 10076 : audit [DBG] from='client.222717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:53 smithi131 bash[24745]: cluster 2024-09-14T02:13:51.670536+0000 mgr.a (mgr.14355) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:53 smithi171 bash[25040]: audit 2024-09-14T02:13:51.626116+0000 mgr.a (mgr.14355) 10076 : audit [DBG] from='client.222717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:53 smithi171 bash[25040]: cluster 2024-09-14T02:13:51.670536+0000 mgr.a (mgr.14355) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:55 smithi007 bash[22722]: cluster 2024-09-14T02:13:53.671482+0000 mgr.a (mgr.14355) 10078 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:55 smithi131 bash[24745]: cluster 2024-09-14T02:13:53.671482+0000 mgr.a (mgr.14355) 10078 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:55 smithi171 bash[25040]: cluster 2024-09-14T02:13:53.671482+0000 mgr.a (mgr.14355) 10078 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:57.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:13:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:13:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:13:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:57 smithi007 bash[22722]: cluster 2024-09-14T02:13:55.673654+0000 mgr.a (mgr.14355) 10079 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:57 smithi131 bash[24745]: cluster 2024-09-14T02:13:55.673654+0000 mgr.a (mgr.14355) 10079 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:57 smithi171 bash[25040]: cluster 2024-09-14T02:13:55.673654+0000 mgr.a (mgr.14355) 10079 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:13:57.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:13:57.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:13:57.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:13:57.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:13:57.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:13:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:59 smithi007 bash[22722]: audit 2024-09-14T02:13:57.406941+0000 mgr.a (mgr.14355) 10080 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:13:59 smithi007 bash[22722]: cluster 2024-09-14T02:13:57.674266+0000 mgr.a (mgr.14355) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:59 smithi131 bash[24745]: audit 2024-09-14T02:13:57.406941+0000 mgr.a (mgr.14355) 10080 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:13:59 smithi131 bash[24745]: cluster 2024-09-14T02:13:57.674266+0000 mgr.a (mgr.14355) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:13:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:59 smithi171 bash[25040]: audit 2024-09-14T02:13:57.406941+0000 mgr.a (mgr.14355) 10080 : audit [DBG] from='client.222789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:13:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:13:59 smithi171 bash[25040]: cluster 2024-09-14T02:13:57.674266+0000 mgr.a (mgr.14355) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:01 smithi131 bash[24745]: cluster 2024-09-14T02:13:59.675171+0000 mgr.a (mgr.14355) 10082 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:01 smithi171 bash[25040]: cluster 2024-09-14T02:13:59.675171+0000 mgr.a (mgr.14355) 10082 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:01 smithi007 bash[22722]: cluster 2024-09-14T02:13:59.675171+0000 mgr.a (mgr.14355) 10082 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:02.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:02.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:02.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:03 smithi131 bash[24745]: cluster 2024-09-14T02:14:01.677419+0000 mgr.a (mgr.14355) 10083 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:03 smithi171 bash[25040]: cluster 2024-09-14T02:14:01.677419+0000 mgr.a (mgr.14355) 10083 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:03.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:03 smithi007 bash[22722]: cluster 2024-09-14T02:14:01.677419+0000 mgr.a (mgr.14355) 10083 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:04 smithi131 bash[24745]: audit 2024-09-14T02:14:03.177502+0000 mgr.a (mgr.14355) 10084 : audit [DBG] from='client.222867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:04 smithi171 bash[25040]: audit 2024-09-14T02:14:03.177502+0000 mgr.a (mgr.14355) 10084 : audit [DBG] from='client.222867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:04 smithi007 bash[22722]: audit 2024-09-14T02:14:03.177502+0000 mgr.a (mgr.14355) 10084 : audit [DBG] from='client.222867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:05 smithi131 bash[24745]: cluster 2024-09-14T02:14:03.677976+0000 mgr.a (mgr.14355) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:05 smithi171 bash[25040]: cluster 2024-09-14T02:14:03.677976+0000 mgr.a (mgr.14355) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:05 smithi007 bash[22722]: cluster 2024-09-14T02:14:03.677976+0000 mgr.a (mgr.14355) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:07 smithi131 bash[24745]: cluster 2024-09-14T02:14:05.680117+0000 mgr.a (mgr.14355) 10086 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:07 smithi171 bash[25040]: cluster 2024-09-14T02:14:05.680117+0000 mgr.a (mgr.14355) 10086 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:07 smithi007 bash[22722]: cluster 2024-09-14T02:14:05.680117+0000 mgr.a (mgr.14355) 10086 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:09.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:09.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:09.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:09 smithi131 bash[24745]: cluster 2024-09-14T02:14:07.680893+0000 mgr.a (mgr.14355) 10087 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:09 smithi171 bash[25040]: cluster 2024-09-14T02:14:07.680893+0000 mgr.a (mgr.14355) 10087 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:09 smithi007 bash[22722]: cluster 2024-09-14T02:14:07.680893+0000 mgr.a (mgr.14355) 10087 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:10 smithi131 bash[24745]: audit 2024-09-14T02:14:08.924842+0000 mgr.a (mgr.14355) 10088 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:10 smithi171 bash[25040]: audit 2024-09-14T02:14:08.924842+0000 mgr.a (mgr.14355) 10088 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:10 smithi007 bash[22722]: audit 2024-09-14T02:14:08.924842+0000 mgr.a (mgr.14355) 10088 : audit [DBG] from='client.222942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:11 smithi131 bash[24745]: cluster 2024-09-14T02:14:09.681877+0000 mgr.a (mgr.14355) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:11 smithi171 bash[25040]: cluster 2024-09-14T02:14:09.681877+0000 mgr.a (mgr.14355) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:11 smithi007 bash[22722]: cluster 2024-09-14T02:14:09.681877+0000 mgr.a (mgr.14355) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:13 smithi131 bash[24745]: cluster 2024-09-14T02:14:11.684168+0000 mgr.a (mgr.14355) 10090 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:13 smithi171 bash[25040]: cluster 2024-09-14T02:14:11.684168+0000 mgr.a (mgr.14355) 10090 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:13 smithi007 bash[22722]: cluster 2024-09-14T02:14:11.684168+0000 mgr.a (mgr.14355) 10090 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:14.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:14.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:14.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:15.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:15.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:15 smithi131 bash[24745]: cluster 2024-09-14T02:14:13.684915+0000 mgr.a (mgr.14355) 10091 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:15 smithi171 bash[25040]: cluster 2024-09-14T02:14:13.684915+0000 mgr.a (mgr.14355) 10091 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:15 smithi007 bash[22722]: cluster 2024-09-14T02:14:13.684915+0000 mgr.a (mgr.14355) 10091 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:16 smithi131 bash[24745]: audit 2024-09-14T02:14:14.682351+0000 mgr.a (mgr.14355) 10092 : audit [DBG] from='client.223017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:16 smithi171 bash[25040]: audit 2024-09-14T02:14:14.682351+0000 mgr.a (mgr.14355) 10092 : audit [DBG] from='client.223017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:16 smithi007 bash[22722]: audit 2024-09-14T02:14:14.682351+0000 mgr.a (mgr.14355) 10092 : audit [DBG] from='client.223017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:17 smithi131 bash[24745]: cluster 2024-09-14T02:14:15.687262+0000 mgr.a (mgr.14355) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:17 smithi171 bash[25040]: cluster 2024-09-14T02:14:15.687262+0000 mgr.a (mgr.14355) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:17 smithi007 bash[22722]: cluster 2024-09-14T02:14:15.687262+0000 mgr.a (mgr.14355) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:19 smithi131 bash[24745]: cluster 2024-09-14T02:14:17.688021+0000 mgr.a (mgr.14355) 10094 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:19 smithi171 bash[25040]: cluster 2024-09-14T02:14:17.688021+0000 mgr.a (mgr.14355) 10094 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:19 smithi007 bash[22722]: cluster 2024-09-14T02:14:17.688021+0000 mgr.a (mgr.14355) 10094 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:20.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:20.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:20.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:20.890 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:21 smithi131 bash[24745]: cluster 2024-09-14T02:14:19.688764+0000 mgr.a (mgr.14355) 10095 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:21 smithi171 bash[25040]: cluster 2024-09-14T02:14:19.688764+0000 mgr.a (mgr.14355) 10095 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:21 smithi007 bash[22722]: cluster 2024-09-14T02:14:19.688764+0000 mgr.a (mgr.14355) 10095 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:22 smithi131 bash[24745]: audit 2024-09-14T02:14:20.449152+0000 mgr.a (mgr.14355) 10096 : audit [DBG] from='client.223095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:22 smithi171 bash[25040]: audit 2024-09-14T02:14:20.449152+0000 mgr.a (mgr.14355) 10096 : audit [DBG] from='client.223095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:22 smithi007 bash[22722]: audit 2024-09-14T02:14:20.449152+0000 mgr.a (mgr.14355) 10096 : audit [DBG] from='client.223095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:23 smithi131 bash[24745]: cluster 2024-09-14T02:14:21.691535+0000 mgr.a (mgr.14355) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:23 smithi171 bash[25040]: cluster 2024-09-14T02:14:21.691535+0000 mgr.a (mgr.14355) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:23 smithi007 bash[22722]: cluster 2024-09-14T02:14:21.691535+0000 mgr.a (mgr.14355) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:25 smithi131 bash[24745]: cluster 2024-09-14T02:14:23.692297+0000 mgr.a (mgr.14355) 10098 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:25 smithi171 bash[25040]: cluster 2024-09-14T02:14:23.692297+0000 mgr.a (mgr.14355) 10098 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:25 smithi007 bash[22722]: cluster 2024-09-14T02:14:23.692297+0000 mgr.a (mgr.14355) 10098 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:25.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:25.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:25.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:26.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:26.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:26 smithi007 bash[22722]: cluster 2024-09-14T02:14:25.694269+0000 mgr.a (mgr.14355) 10099 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:26 smithi007 bash[22722]: audit 2024-09-14T02:14:26.225761+0000 mgr.a (mgr.14355) 10100 : audit [DBG] from='client.223170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:26 smithi131 bash[24745]: cluster 2024-09-14T02:14:25.694269+0000 mgr.a (mgr.14355) 10099 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:26 smithi131 bash[24745]: audit 2024-09-14T02:14:26.225761+0000 mgr.a (mgr.14355) 10100 : audit [DBG] from='client.223170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:26 smithi171 bash[25040]: cluster 2024-09-14T02:14:25.694269+0000 mgr.a (mgr.14355) 10099 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:26 smithi171 bash[25040]: audit 2024-09-14T02:14:26.225761+0000 mgr.a (mgr.14355) 10100 : audit [DBG] from='client.223170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:28 smithi131 bash[24745]: cluster 2024-09-14T02:14:27.695156+0000 mgr.a (mgr.14355) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:28 smithi171 bash[25040]: cluster 2024-09-14T02:14:27.695156+0000 mgr.a (mgr.14355) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:28 smithi007 bash[22722]: cluster 2024-09-14T02:14:27.695156+0000 mgr.a (mgr.14355) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:14:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:30 smithi131 bash[24745]: cluster 2024-09-14T02:14:29.695914+0000 mgr.a (mgr.14355) 10102 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:14:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:30 smithi171 bash[25040]: cluster 2024-09-14T02:14:29.695914+0000 mgr.a (mgr.14355) 10102 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:14:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:30 smithi007 bash[22722]: cluster 2024-09-14T02:14:29.695914+0000 mgr.a (mgr.14355) 10102 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:14:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:31.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:31.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:32.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:32 smithi131 bash[24745]: cluster 2024-09-14T02:14:31.698103+0000 mgr.a (mgr.14355) 10103 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:32 smithi131 bash[24745]: audit 2024-09-14T02:14:31.981627+0000 mgr.a (mgr.14355) 10104 : audit [DBG] from='client.223245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:32 smithi171 bash[25040]: cluster 2024-09-14T02:14:31.698103+0000 mgr.a (mgr.14355) 10103 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:32 smithi171 bash[25040]: audit 2024-09-14T02:14:31.981627+0000 mgr.a (mgr.14355) 10104 : audit [DBG] from='client.223245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:32 smithi007 bash[22722]: cluster 2024-09-14T02:14:31.698103+0000 mgr.a (mgr.14355) 10103 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:32 smithi007 bash[22722]: audit 2024-09-14T02:14:31.981627+0000 mgr.a (mgr.14355) 10104 : audit [DBG] from='client.223245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:34 smithi131 bash[24745]: cluster 2024-09-14T02:14:33.699077+0000 mgr.a (mgr.14355) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:34 smithi171 bash[25040]: cluster 2024-09-14T02:14:33.699077+0000 mgr.a (mgr.14355) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:34 smithi007 bash[22722]: cluster 2024-09-14T02:14:33.699077+0000 mgr.a (mgr.14355) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:36 smithi131 bash[24745]: cluster 2024-09-14T02:14:35.701262+0000 mgr.a (mgr.14355) 10106 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:36 smithi171 bash[25040]: cluster 2024-09-14T02:14:35.701262+0000 mgr.a (mgr.14355) 10106 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:36 smithi007 bash[22722]: cluster 2024-09-14T02:14:35.701262+0000 mgr.a (mgr.14355) 10106 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:37.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:37.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:37.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:38.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:38.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:38.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:38 smithi131 bash[24745]: cluster 2024-09-14T02:14:37.701928+0000 mgr.a (mgr.14355) 10107 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:38 smithi131 bash[24745]: audit 2024-09-14T02:14:37.745537+0000 mgr.a (mgr.14355) 10108 : audit [DBG] from='client.223317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:38 smithi171 bash[25040]: cluster 2024-09-14T02:14:37.701928+0000 mgr.a (mgr.14355) 10107 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:38 smithi171 bash[25040]: audit 2024-09-14T02:14:37.745537+0000 mgr.a (mgr.14355) 10108 : audit [DBG] from='client.223317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:38 smithi007 bash[22722]: cluster 2024-09-14T02:14:37.701928+0000 mgr.a (mgr.14355) 10107 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:38 smithi007 bash[22722]: audit 2024-09-14T02:14:37.745537+0000 mgr.a (mgr.14355) 10108 : audit [DBG] from='client.223317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:40 smithi131 bash[24745]: cluster 2024-09-14T02:14:39.703009+0000 mgr.a (mgr.14355) 10109 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:40 smithi171 bash[25040]: cluster 2024-09-14T02:14:39.703009+0000 mgr.a (mgr.14355) 10109 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:40 smithi007 bash[22722]: cluster 2024-09-14T02:14:39.703009+0000 mgr.a (mgr.14355) 10109 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:42 smithi171 bash[25040]: cluster 2024-09-14T02:14:41.705456+0000 mgr.a (mgr.14355) 10110 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:43.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:42 smithi007 bash[22722]: cluster 2024-09-14T02:14:41.705456+0000 mgr.a (mgr.14355) 10110 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:42 smithi131 bash[24745]: cluster 2024-09-14T02:14:41.705456+0000 mgr.a (mgr.14355) 10110 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:43.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:43.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:43.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:43.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:43.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:44 smithi171 bash[25040]: audit 2024-09-14T02:14:43.497140+0000 mgr.a (mgr.14355) 10111 : audit [DBG] from='client.223395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:44 smithi171 bash[25040]: cluster 2024-09-14T02:14:43.706047+0000 mgr.a (mgr.14355) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:44 smithi007 bash[22722]: audit 2024-09-14T02:14:43.497140+0000 mgr.a (mgr.14355) 10111 : audit [DBG] from='client.223395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:44 smithi007 bash[22722]: cluster 2024-09-14T02:14:43.706047+0000 mgr.a (mgr.14355) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:44 smithi131 bash[24745]: audit 2024-09-14T02:14:43.497140+0000 mgr.a (mgr.14355) 10111 : audit [DBG] from='client.223395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:44 smithi131 bash[24745]: cluster 2024-09-14T02:14:43.706047+0000 mgr.a (mgr.14355) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:45 smithi171 bash[25040]: audit 2024-09-14T02:14:45.234597+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:14:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:45 smithi007 bash[22722]: audit 2024-09-14T02:14:45.234597+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:14:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:45 smithi131 bash[24745]: audit 2024-09-14T02:14:45.234597+0000 mon.a (mon.0) 2105 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:14:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: cluster 2024-09-14T02:14:45.708337+0000 mgr.a (mgr.14355) 10113 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: audit 2024-09-14T02:14:46.079642+0000 mon.a (mon.0) 2106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:14:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: audit 2024-09-14T02:14:46.081187+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:14:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: audit 2024-09-14T02:14:46.090148+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:14:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: audit 2024-09-14T02:14:46.095151+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:46 smithi171 bash[25040]: audit 2024-09-14T02:14:46.097472+0000 mgr.a (mgr.14355) 10114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:47.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22972]: debug 2024-09-14T02:14:46.835+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:14:47.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22972]: debug 2024-09-14T02:14:46.835+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: cluster 2024-09-14T02:14:45.708337+0000 mgr.a (mgr.14355) 10113 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: audit 2024-09-14T02:14:46.079642+0000 mon.a (mon.0) 2106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: audit 2024-09-14T02:14:46.081187+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: audit 2024-09-14T02:14:46.090148+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: audit 2024-09-14T02:14:46.095151+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:46 smithi007 bash[22722]: audit 2024-09-14T02:14:46.097472+0000 mgr.a (mgr.14355) 10114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: cluster 2024-09-14T02:14:45.708337+0000 mgr.a (mgr.14355) 10113 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: audit 2024-09-14T02:14:46.079642+0000 mon.a (mon.0) 2106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: audit 2024-09-14T02:14:46.081187+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: audit 2024-09-14T02:14:46.090148+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: audit 2024-09-14T02:14:46.095151+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:46 smithi131 bash[24745]: audit 2024-09-14T02:14:46.097472+0000 mgr.a (mgr.14355) 10114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:14:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:47 smithi007 bash[22722]: audit 2024-09-14T02:14:46.839418+0000 mgr.a (mgr.14355) 10115 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:14:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:47 smithi007 bash[22722]: cephadm 2024-09-14T02:14:46.840616+0000 mgr.a (mgr.14355) 10116 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:14:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:47 smithi131 bash[24745]: audit 2024-09-14T02:14:46.839418+0000 mgr.a (mgr.14355) 10115 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:14:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:47 smithi131 bash[24745]: cephadm 2024-09-14T02:14:46.840616+0000 mgr.a (mgr.14355) 10116 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:14:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:47 smithi171 bash[25040]: audit 2024-09-14T02:14:46.839418+0000 mgr.a (mgr.14355) 10115 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:14:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:47 smithi171 bash[25040]: cephadm 2024-09-14T02:14:46.840616+0000 mgr.a (mgr.14355) 10116 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:14:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:48.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:49 smithi131 bash[24745]: cluster 2024-09-14T02:14:47.709297+0000 mgr.a (mgr.14355) 10117 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:49 smithi171 bash[25040]: cluster 2024-09-14T02:14:47.709297+0000 mgr.a (mgr.14355) 10117 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:49 smithi007 bash[22722]: cluster 2024-09-14T02:14:47.709297+0000 mgr.a (mgr.14355) 10117 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:49.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:49.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:49.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:50 smithi131 bash[24745]: audit 2024-09-14T02:14:49.249469+0000 mgr.a (mgr.14355) 10118 : audit [DBG] from='client.223575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:50 smithi171 bash[25040]: audit 2024-09-14T02:14:49.249469+0000 mgr.a (mgr.14355) 10118 : audit [DBG] from='client.223575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:50 smithi007 bash[22722]: audit 2024-09-14T02:14:49.249469+0000 mgr.a (mgr.14355) 10118 : audit [DBG] from='client.223575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:51 smithi131 bash[24745]: cluster 2024-09-14T02:14:49.709871+0000 mgr.a (mgr.14355) 10119 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:51 smithi171 bash[25040]: cluster 2024-09-14T02:14:49.709871+0000 mgr.a (mgr.14355) 10119 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:51 smithi007 bash[22722]: cluster 2024-09-14T02:14:49.709871+0000 mgr.a (mgr.14355) 10119 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:14:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:53 smithi171 bash[25040]: cluster 2024-09-14T02:14:51.712138+0000 mgr.a (mgr.14355) 10120 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:53 smithi007 bash[22722]: cluster 2024-09-14T02:14:51.712138+0000 mgr.a (mgr.14355) 10120 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:53 smithi131 bash[24745]: cluster 2024-09-14T02:14:51.712138+0000 mgr.a (mgr.14355) 10120 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:14:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:14:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:14:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:55 smithi171 bash[25040]: cluster 2024-09-14T02:14:53.712917+0000 mgr.a (mgr.14355) 10121 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:14:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:14:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:14:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:14:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:14:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:55 smithi007 bash[22722]: cluster 2024-09-14T02:14:53.712917+0000 mgr.a (mgr.14355) 10121 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:55 smithi131 bash[24745]: cluster 2024-09-14T02:14:53.712917+0000 mgr.a (mgr.14355) 10121 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:56 smithi007 bash[22722]: audit 2024-09-14T02:14:54.979808+0000 mgr.a (mgr.14355) 10122 : audit [DBG] from='client.223653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:56 smithi131 bash[24745]: audit 2024-09-14T02:14:54.979808+0000 mgr.a (mgr.14355) 10122 : audit [DBG] from='client.223653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:56 smithi171 bash[25040]: audit 2024-09-14T02:14:54.979808+0000 mgr.a (mgr.14355) 10122 : audit [DBG] from='client.223653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:14:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:57 smithi007 bash[22722]: cluster 2024-09-14T02:14:55.715779+0000 mgr.a (mgr.14355) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:57 smithi131 bash[24745]: cluster 2024-09-14T02:14:55.715779+0000 mgr.a (mgr.14355) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:57 smithi171 bash[25040]: cluster 2024-09-14T02:14:55.715779+0000 mgr.a (mgr.14355) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:14:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:14:59 smithi007 bash[22722]: cluster 2024-09-14T02:14:57.716581+0000 mgr.a (mgr.14355) 10124 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:14:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:14:59 smithi131 bash[24745]: cluster 2024-09-14T02:14:57.716581+0000 mgr.a (mgr.14355) 10124 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:14:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:14:59 smithi171 bash[25040]: cluster 2024-09-14T02:14:57.716581+0000 mgr.a (mgr.14355) 10124 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:15:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:00.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:00.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:01.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:01.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:01.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:01.424 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:01 smithi171 bash[25040]: cluster 2024-09-14T02:14:59.717514+0000 mgr.a (mgr.14355) 10125 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:15:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:01 smithi007 bash[22722]: cluster 2024-09-14T02:14:59.717514+0000 mgr.a (mgr.14355) 10125 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:15:01.472 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:01 smithi131 bash[24745]: cluster 2024-09-14T02:14:59.717514+0000 mgr.a (mgr.14355) 10125 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:15:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:02 smithi007 bash[22722]: audit 2024-09-14T02:15:00.739146+0000 mgr.a (mgr.14355) 10126 : audit [DBG] from='client.223731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:02 smithi131 bash[24745]: audit 2024-09-14T02:15:00.739146+0000 mgr.a (mgr.14355) 10126 : audit [DBG] from='client.223731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:02 smithi171 bash[25040]: audit 2024-09-14T02:15:00.739146+0000 mgr.a (mgr.14355) 10126 : audit [DBG] from='client.223731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:03 smithi007 bash[22722]: cluster 2024-09-14T02:15:01.720416+0000 mgr.a (mgr.14355) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:03 smithi131 bash[24745]: cluster 2024-09-14T02:15:01.720416+0000 mgr.a (mgr.14355) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:03 smithi171 bash[25040]: cluster 2024-09-14T02:15:01.720416+0000 mgr.a (mgr.14355) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:05 smithi007 bash[22722]: cluster 2024-09-14T02:15:03.721224+0000 mgr.a (mgr.14355) 10128 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:05 smithi131 bash[24745]: cluster 2024-09-14T02:15:03.721224+0000 mgr.a (mgr.14355) 10128 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:05 smithi171 bash[25040]: cluster 2024-09-14T02:15:03.721224+0000 mgr.a (mgr.14355) 10128 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:06.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:06.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:06.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:06.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:06.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:06.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:07 smithi007 bash[22722]: cluster 2024-09-14T02:15:05.723361+0000 mgr.a (mgr.14355) 10129 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:07 smithi131 bash[24745]: cluster 2024-09-14T02:15:05.723361+0000 mgr.a (mgr.14355) 10129 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:07 smithi171 bash[25040]: cluster 2024-09-14T02:15:05.723361+0000 mgr.a (mgr.14355) 10129 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:08 smithi007 bash[22722]: audit 2024-09-14T02:15:06.502184+0000 mgr.a (mgr.14355) 10130 : audit [DBG] from='client.223806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:08 smithi131 bash[24745]: audit 2024-09-14T02:15:06.502184+0000 mgr.a (mgr.14355) 10130 : audit [DBG] from='client.223806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:08 smithi171 bash[25040]: audit 2024-09-14T02:15:06.502184+0000 mgr.a (mgr.14355) 10130 : audit [DBG] from='client.223806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:09 smithi007 bash[22722]: cluster 2024-09-14T02:15:07.724419+0000 mgr.a (mgr.14355) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:09 smithi131 bash[24745]: cluster 2024-09-14T02:15:07.724419+0000 mgr.a (mgr.14355) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:09 smithi171 bash[25040]: cluster 2024-09-14T02:15:07.724419+0000 mgr.a (mgr.14355) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:11 smithi007 bash[22722]: cluster 2024-09-14T02:15:09.725212+0000 mgr.a (mgr.14355) 10132 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:11 smithi131 bash[24745]: cluster 2024-09-14T02:15:09.725212+0000 mgr.a (mgr.14355) 10132 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:11 smithi171 bash[25040]: cluster 2024-09-14T02:15:09.725212+0000 mgr.a (mgr.14355) 10132 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:15:11.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:11.925 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:12.698 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:12.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:12.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:12.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:13 smithi007 bash[22722]: cluster 2024-09-14T02:15:11.727495+0000 mgr.a (mgr.14355) 10133 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:15:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:13 smithi007 bash[22722]: audit 2024-09-14T02:15:12.260122+0000 mgr.a (mgr.14355) 10134 : audit [DBG] from='client.223881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:13 smithi131 bash[24745]: cluster 2024-09-14T02:15:11.727495+0000 mgr.a (mgr.14355) 10133 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:15:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:13 smithi131 bash[24745]: audit 2024-09-14T02:15:12.260122+0000 mgr.a (mgr.14355) 10134 : audit [DBG] from='client.223881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:13 smithi171 bash[25040]: cluster 2024-09-14T02:15:11.727495+0000 mgr.a (mgr.14355) 10133 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:15:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:13 smithi171 bash[25040]: audit 2024-09-14T02:15:12.260122+0000 mgr.a (mgr.14355) 10134 : audit [DBG] from='client.223881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:15 smithi007 bash[22722]: cluster 2024-09-14T02:15:13.728466+0000 mgr.a (mgr.14355) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:15 smithi131 bash[24745]: cluster 2024-09-14T02:15:13.728466+0000 mgr.a (mgr.14355) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:15 smithi171 bash[25040]: cluster 2024-09-14T02:15:13.728466+0000 mgr.a (mgr.14355) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:17 smithi007 bash[22722]: cluster 2024-09-14T02:15:15.730663+0000 mgr.a (mgr.14355) 10136 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:17 smithi131 bash[24745]: cluster 2024-09-14T02:15:15.730663+0000 mgr.a (mgr.14355) 10136 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:17 smithi171 bash[25040]: cluster 2024-09-14T02:15:15.730663+0000 mgr.a (mgr.14355) 10136 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:17.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:17.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:17.701 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:18.443 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:18.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:19 smithi007 bash[22722]: cluster 2024-09-14T02:15:17.731413+0000 mgr.a (mgr.14355) 10137 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:19 smithi007 bash[22722]: audit 2024-09-14T02:15:18.029743+0000 mgr.a (mgr.14355) 10138 : audit [DBG] from='client.223959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:19 smithi131 bash[24745]: cluster 2024-09-14T02:15:17.731413+0000 mgr.a (mgr.14355) 10137 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:19 smithi131 bash[24745]: audit 2024-09-14T02:15:18.029743+0000 mgr.a (mgr.14355) 10138 : audit [DBG] from='client.223959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:19 smithi171 bash[25040]: cluster 2024-09-14T02:15:17.731413+0000 mgr.a (mgr.14355) 10137 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:19 smithi171 bash[25040]: audit 2024-09-14T02:15:18.029743+0000 mgr.a (mgr.14355) 10138 : audit [DBG] from='client.223959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:21 smithi007 bash[22722]: cluster 2024-09-14T02:15:19.732405+0000 mgr.a (mgr.14355) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:21 smithi131 bash[24745]: cluster 2024-09-14T02:15:19.732405+0000 mgr.a (mgr.14355) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:21 smithi171 bash[25040]: cluster 2024-09-14T02:15:19.732405+0000 mgr.a (mgr.14355) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:23.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:23.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:23.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:23 smithi007 bash[22722]: cluster 2024-09-14T02:15:21.734714+0000 mgr.a (mgr.14355) 10140 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:23 smithi131 bash[24745]: cluster 2024-09-14T02:15:21.734714+0000 mgr.a (mgr.14355) 10140 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:23 smithi171 bash[25040]: cluster 2024-09-14T02:15:21.734714+0000 mgr.a (mgr.14355) 10140 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:24.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:25 smithi007 bash[22722]: cluster 2024-09-14T02:15:23.735222+0000 mgr.a (mgr.14355) 10141 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:25 smithi007 bash[22722]: audit 2024-09-14T02:15:23.776465+0000 mgr.a (mgr.14355) 10142 : audit [DBG] from='client.224037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:25 smithi131 bash[24745]: cluster 2024-09-14T02:15:23.735222+0000 mgr.a (mgr.14355) 10141 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:25 smithi131 bash[24745]: audit 2024-09-14T02:15:23.776465+0000 mgr.a (mgr.14355) 10142 : audit [DBG] from='client.224037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:25 smithi171 bash[25040]: cluster 2024-09-14T02:15:23.735222+0000 mgr.a (mgr.14355) 10141 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:25 smithi171 bash[25040]: audit 2024-09-14T02:15:23.776465+0000 mgr.a (mgr.14355) 10142 : audit [DBG] from='client.224037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:27 smithi007 bash[22722]: cluster 2024-09-14T02:15:25.737582+0000 mgr.a (mgr.14355) 10143 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:27 smithi131 bash[24745]: cluster 2024-09-14T02:15:25.737582+0000 mgr.a (mgr.14355) 10143 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:27 smithi171 bash[25040]: cluster 2024-09-14T02:15:25.737582+0000 mgr.a (mgr.14355) 10143 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:29.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:29.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:29.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:29 smithi007 bash[22722]: cluster 2024-09-14T02:15:27.738422+0000 mgr.a (mgr.14355) 10144 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:29 smithi131 bash[24745]: cluster 2024-09-14T02:15:27.738422+0000 mgr.a (mgr.14355) 10144 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:29 smithi171 bash[25040]: cluster 2024-09-14T02:15:27.738422+0000 mgr.a (mgr.14355) 10144 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:29.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:29.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:29.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:29.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:29.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:31 smithi007 bash[22722]: audit 2024-09-14T02:15:29.524830+0000 mgr.a (mgr.14355) 10145 : audit [DBG] from='client.224115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:31 smithi007 bash[22722]: cluster 2024-09-14T02:15:29.738950+0000 mgr.a (mgr.14355) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:31 smithi131 bash[24745]: audit 2024-09-14T02:15:29.524830+0000 mgr.a (mgr.14355) 10145 : audit [DBG] from='client.224115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:31 smithi131 bash[24745]: cluster 2024-09-14T02:15:29.738950+0000 mgr.a (mgr.14355) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:31 smithi171 bash[25040]: audit 2024-09-14T02:15:29.524830+0000 mgr.a (mgr.14355) 10145 : audit [DBG] from='client.224115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:31 smithi171 bash[25040]: cluster 2024-09-14T02:15:29.738950+0000 mgr.a (mgr.14355) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:33 smithi007 bash[22722]: cluster 2024-09-14T02:15:31.741284+0000 mgr.a (mgr.14355) 10147 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:33 smithi131 bash[24745]: cluster 2024-09-14T02:15:31.741284+0000 mgr.a (mgr.14355) 10147 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:33 smithi171 bash[25040]: cluster 2024-09-14T02:15:31.741284+0000 mgr.a (mgr.14355) 10147 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:15:34.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:34.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:34.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:35 smithi007 bash[22722]: cluster 2024-09-14T02:15:33.742071+0000 mgr.a (mgr.14355) 10148 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:35 smithi131 bash[24745]: cluster 2024-09-14T02:15:33.742071+0000 mgr.a (mgr.14355) 10148 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:35 smithi171 bash[25040]: cluster 2024-09-14T02:15:33.742071+0000 mgr.a (mgr.14355) 10148 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:35.728 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:35.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:36 smithi007 bash[22722]: audit 2024-09-14T02:15:35.286492+0000 mgr.a (mgr.14355) 10149 : audit [DBG] from='client.224187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:36 smithi131 bash[24745]: audit 2024-09-14T02:15:35.286492+0000 mgr.a (mgr.14355) 10149 : audit [DBG] from='client.224187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:36 smithi171 bash[25040]: audit 2024-09-14T02:15:35.286492+0000 mgr.a (mgr.14355) 10149 : audit [DBG] from='client.224187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:37 smithi007 bash[22722]: cluster 2024-09-14T02:15:35.743346+0000 mgr.a (mgr.14355) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:37 smithi131 bash[24745]: cluster 2024-09-14T02:15:35.743346+0000 mgr.a (mgr.14355) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:37 smithi171 bash[25040]: cluster 2024-09-14T02:15:35.743346+0000 mgr.a (mgr.14355) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:39 smithi007 bash[22722]: cluster 2024-09-14T02:15:37.744218+0000 mgr.a (mgr.14355) 10151 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:39 smithi131 bash[24745]: cluster 2024-09-14T02:15:37.744218+0000 mgr.a (mgr.14355) 10151 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:39 smithi171 bash[25040]: cluster 2024-09-14T02:15:37.744218+0000 mgr.a (mgr.14355) 10151 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:41 smithi007 bash[22722]: cluster 2024-09-14T02:15:39.745152+0000 mgr.a (mgr.14355) 10152 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:41.484 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:41.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:41 smithi131 bash[24745]: cluster 2024-09-14T02:15:39.745152+0000 mgr.a (mgr.14355) 10152 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:41 smithi171 bash[25040]: cluster 2024-09-14T02:15:39.745152+0000 mgr.a (mgr.14355) 10152 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:15:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:42 smithi007 bash[22722]: audit 2024-09-14T02:15:41.062961+0000 mgr.a (mgr.14355) 10153 : audit [DBG] from='client.224265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:42 smithi131 bash[24745]: audit 2024-09-14T02:15:41.062961+0000 mgr.a (mgr.14355) 10153 : audit [DBG] from='client.224265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:42 smithi171 bash[25040]: audit 2024-09-14T02:15:41.062961+0000 mgr.a (mgr.14355) 10153 : audit [DBG] from='client.224265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:43 smithi007 bash[22722]: cluster 2024-09-14T02:15:41.748017+0000 mgr.a (mgr.14355) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:43.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:43 smithi131 bash[24745]: cluster 2024-09-14T02:15:41.748017+0000 mgr.a (mgr.14355) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:43 smithi171 bash[25040]: cluster 2024-09-14T02:15:41.748017+0000 mgr.a (mgr.14355) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:45 smithi007 bash[22722]: cluster 2024-09-14T02:15:43.748831+0000 mgr.a (mgr.14355) 10155 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:45 smithi131 bash[24745]: cluster 2024-09-14T02:15:43.748831+0000 mgr.a (mgr.14355) 10155 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:45 smithi171 bash[25040]: cluster 2024-09-14T02:15:43.748831+0000 mgr.a (mgr.14355) 10155 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:15:46.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:46.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:46.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:47.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:47 smithi007 bash[22722]: cluster 2024-09-14T02:15:45.750809+0000 mgr.a (mgr.14355) 10156 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:47 smithi007 bash[22722]: audit 2024-09-14T02:15:46.890893+0000 mon.a (mon.0) 2110 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:15:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:47 smithi131 bash[24745]: cluster 2024-09-14T02:15:45.750809+0000 mgr.a (mgr.14355) 10156 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:47 smithi131 bash[24745]: audit 2024-09-14T02:15:46.890893+0000 mon.a (mon.0) 2110 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:15:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:47 smithi171 bash[25040]: cluster 2024-09-14T02:15:45.750809+0000 mgr.a (mgr.14355) 10156 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:47 smithi171 bash[25040]: audit 2024-09-14T02:15:46.890893+0000 mon.a (mon.0) 2110 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:15:48.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22972]: debug 2024-09-14T02:15:48.423+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:15:48.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22972]: debug 2024-09-14T02:15:48.427+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:15:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22722]: audit 2024-09-14T02:15:46.820045+0000 mgr.a (mgr.14355) 10157 : audit [DBG] from='client.224343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22722]: audit 2024-09-14T02:15:47.682438+0000 mon.a (mon.0) 2111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:15:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22722]: audit 2024-09-14T02:15:47.684085+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:15:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22722]: audit 2024-09-14T02:15:47.692016+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:15:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:48 smithi007 bash[22722]: audit 2024-09-14T02:15:47.696470+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:48 smithi131 bash[24745]: audit 2024-09-14T02:15:46.820045+0000 mgr.a (mgr.14355) 10157 : audit [DBG] from='client.224343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:48 smithi131 bash[24745]: audit 2024-09-14T02:15:47.682438+0000 mon.a (mon.0) 2111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:48 smithi131 bash[24745]: audit 2024-09-14T02:15:47.684085+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:48 smithi131 bash[24745]: audit 2024-09-14T02:15:47.692016+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:48 smithi131 bash[24745]: audit 2024-09-14T02:15:47.696470+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:48 smithi171 bash[25040]: audit 2024-09-14T02:15:46.820045+0000 mgr.a (mgr.14355) 10157 : audit [DBG] from='client.224343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:48 smithi171 bash[25040]: audit 2024-09-14T02:15:47.682438+0000 mon.a (mon.0) 2111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:48 smithi171 bash[25040]: audit 2024-09-14T02:15:47.684085+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:48 smithi171 bash[25040]: audit 2024-09-14T02:15:47.692016+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:48 smithi171 bash[25040]: audit 2024-09-14T02:15:47.696470+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:49 smithi007 bash[22722]: audit 2024-09-14T02:15:47.697987+0000 mgr.a (mgr.14355) 10158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:49 smithi007 bash[22722]: cluster 2024-09-14T02:15:47.751809+0000 mgr.a (mgr.14355) 10159 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:49 smithi131 bash[24745]: audit 2024-09-14T02:15:47.697987+0000 mgr.a (mgr.14355) 10158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:49 smithi131 bash[24745]: cluster 2024-09-14T02:15:47.751809+0000 mgr.a (mgr.14355) 10159 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:49 smithi171 bash[25040]: audit 2024-09-14T02:15:47.697987+0000 mgr.a (mgr.14355) 10158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:15:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:49 smithi171 bash[25040]: cluster 2024-09-14T02:15:47.751809+0000 mgr.a (mgr.14355) 10159 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:50 smithi007 bash[22722]: audit 2024-09-14T02:15:48.429971+0000 mgr.a (mgr.14355) 10160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:15:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:50 smithi007 bash[22722]: cephadm 2024-09-14T02:15:48.431412+0000 mgr.a (mgr.14355) 10161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:15:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:50 smithi131 bash[24745]: audit 2024-09-14T02:15:48.429971+0000 mgr.a (mgr.14355) 10160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:15:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:50 smithi131 bash[24745]: cephadm 2024-09-14T02:15:48.431412+0000 mgr.a (mgr.14355) 10161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:15:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:50 smithi171 bash[25040]: audit 2024-09-14T02:15:48.429971+0000 mgr.a (mgr.14355) 10160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:15:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:50 smithi171 bash[25040]: cephadm 2024-09-14T02:15:48.431412+0000 mgr.a (mgr.14355) 10161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:15:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:51 smithi007 bash[22722]: cluster 2024-09-14T02:15:49.752768+0000 mgr.a (mgr.14355) 10162 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:51 smithi131 bash[24745]: cluster 2024-09-14T02:15:49.752768+0000 mgr.a (mgr.14355) 10162 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:51 smithi171 bash[25040]: cluster 2024-09-14T02:15:49.752768+0000 mgr.a (mgr.14355) 10162 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:15:52.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:52.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:52.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:53.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:53.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:53.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:53.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:53.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:53 smithi007 bash[22722]: cluster 2024-09-14T02:15:51.755294+0000 mgr.a (mgr.14355) 10163 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:53 smithi131 bash[24745]: cluster 2024-09-14T02:15:51.755294+0000 mgr.a (mgr.14355) 10163 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:53 smithi171 bash[25040]: cluster 2024-09-14T02:15:51.755294+0000 mgr.a (mgr.14355) 10163 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:54 smithi131 bash[24745]: audit 2024-09-14T02:15:52.591366+0000 mgr.a (mgr.14355) 10164 : audit [DBG] from='client.224529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:54 smithi171 bash[25040]: audit 2024-09-14T02:15:52.591366+0000 mgr.a (mgr.14355) 10164 : audit [DBG] from='client.224529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:54 smithi007 bash[22722]: audit 2024-09-14T02:15:52.591366+0000 mgr.a (mgr.14355) 10164 : audit [DBG] from='client.224529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:15:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:55 smithi131 bash[24745]: cluster 2024-09-14T02:15:53.756255+0000 mgr.a (mgr.14355) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:55 smithi171 bash[25040]: cluster 2024-09-14T02:15:53.756255+0000 mgr.a (mgr.14355) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:55 smithi007 bash[22722]: cluster 2024-09-14T02:15:53.756255+0000 mgr.a (mgr.14355) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:57 smithi131 bash[24745]: cluster 2024-09-14T02:15:55.758505+0000 mgr.a (mgr.14355) 10166 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:57 smithi171 bash[25040]: cluster 2024-09-14T02:15:55.758505+0000 mgr.a (mgr.14355) 10166 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:57 smithi007 bash[22722]: cluster 2024-09-14T02:15:55.758505+0000 mgr.a (mgr.14355) 10166 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:15:58.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:15:58.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:15:58.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:15:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:15:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:15:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:15:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:15:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:15:59 smithi131 bash[24745]: cluster 2024-09-14T02:15:57.759239+0000 mgr.a (mgr.14355) 10167 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:15:59 smithi171 bash[25040]: cluster 2024-09-14T02:15:57.759239+0000 mgr.a (mgr.14355) 10167 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:15:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:15:59 smithi007 bash[22722]: cluster 2024-09-14T02:15:57.759239+0000 mgr.a (mgr.14355) 10167 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:00 smithi131 bash[24745]: audit 2024-09-14T02:15:58.329257+0000 mgr.a (mgr.14355) 10168 : audit [DBG] from='client.224607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:00 smithi171 bash[25040]: audit 2024-09-14T02:15:58.329257+0000 mgr.a (mgr.14355) 10168 : audit [DBG] from='client.224607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:00 smithi007 bash[22722]: audit 2024-09-14T02:15:58.329257+0000 mgr.a (mgr.14355) 10168 : audit [DBG] from='client.224607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:01 smithi131 bash[24745]: cluster 2024-09-14T02:15:59.760193+0000 mgr.a (mgr.14355) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:01 smithi171 bash[25040]: cluster 2024-09-14T02:15:59.760193+0000 mgr.a (mgr.14355) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:01 smithi007 bash[22722]: cluster 2024-09-14T02:15:59.760193+0000 mgr.a (mgr.14355) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:03 smithi131 bash[24745]: cluster 2024-09-14T02:16:01.762522+0000 mgr.a (mgr.14355) 10170 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:03 smithi171 bash[25040]: cluster 2024-09-14T02:16:01.762522+0000 mgr.a (mgr.14355) 10170 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:03 smithi007 bash[22722]: cluster 2024-09-14T02:16:01.762522+0000 mgr.a (mgr.14355) 10170 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:03.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:04.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:05 smithi131 bash[24745]: cluster 2024-09-14T02:16:03.763089+0000 mgr.a (mgr.14355) 10171 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:05 smithi131 bash[24745]: audit 2024-09-14T02:16:04.084514+0000 mgr.a (mgr.14355) 10172 : audit [DBG] from='client.224682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:05 smithi171 bash[25040]: cluster 2024-09-14T02:16:03.763089+0000 mgr.a (mgr.14355) 10171 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:05 smithi171 bash[25040]: audit 2024-09-14T02:16:04.084514+0000 mgr.a (mgr.14355) 10172 : audit [DBG] from='client.224682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:05 smithi007 bash[22722]: cluster 2024-09-14T02:16:03.763089+0000 mgr.a (mgr.14355) 10171 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:05 smithi007 bash[22722]: audit 2024-09-14T02:16:04.084514+0000 mgr.a (mgr.14355) 10172 : audit [DBG] from='client.224682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:07 smithi131 bash[24745]: cluster 2024-09-14T02:16:05.765313+0000 mgr.a (mgr.14355) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:07 smithi171 bash[25040]: cluster 2024-09-14T02:16:05.765313+0000 mgr.a (mgr.14355) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:07 smithi007 bash[22722]: cluster 2024-09-14T02:16:05.765313+0000 mgr.a (mgr.14355) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:09 smithi131 bash[24745]: cluster 2024-09-14T02:16:07.766231+0000 mgr.a (mgr.14355) 10174 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:09.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:09 smithi171 bash[25040]: cluster 2024-09-14T02:16:07.766231+0000 mgr.a (mgr.14355) 10174 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:09 smithi007 bash[22722]: cluster 2024-09-14T02:16:07.766231+0000 mgr.a (mgr.14355) 10174 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:10.318 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:11 smithi131 bash[24745]: cluster 2024-09-14T02:16:09.766815+0000 mgr.a (mgr.14355) 10175 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:11 smithi131 bash[24745]: audit 2024-09-14T02:16:09.867900+0000 mgr.a (mgr.14355) 10176 : audit [DBG] from='client.224757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:11 smithi171 bash[25040]: cluster 2024-09-14T02:16:09.766815+0000 mgr.a (mgr.14355) 10175 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:11 smithi171 bash[25040]: audit 2024-09-14T02:16:09.867900+0000 mgr.a (mgr.14355) 10176 : audit [DBG] from='client.224757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:11 smithi007 bash[22722]: cluster 2024-09-14T02:16:09.766815+0000 mgr.a (mgr.14355) 10175 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:11 smithi007 bash[22722]: audit 2024-09-14T02:16:09.867900+0000 mgr.a (mgr.14355) 10176 : audit [DBG] from='client.224757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:13.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:13 smithi131 bash[24745]: cluster 2024-09-14T02:16:11.769106+0000 mgr.a (mgr.14355) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:16:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:13 smithi171 bash[25040]: cluster 2024-09-14T02:16:11.769106+0000 mgr.a (mgr.14355) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:16:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:13 smithi007 bash[22722]: cluster 2024-09-14T02:16:11.769106+0000 mgr.a (mgr.14355) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:16:15.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:15.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:15 smithi131 bash[24745]: cluster 2024-09-14T02:16:13.769897+0000 mgr.a (mgr.14355) 10178 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:16:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:15 smithi171 bash[25040]: cluster 2024-09-14T02:16:13.769897+0000 mgr.a (mgr.14355) 10178 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:16:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:15 smithi007 bash[22722]: cluster 2024-09-14T02:16:13.769897+0000 mgr.a (mgr.14355) 10178 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:16:16.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:16.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:17 smithi131 bash[24745]: audit 2024-09-14T02:16:15.650100+0000 mgr.a (mgr.14355) 10179 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:17 smithi131 bash[24745]: cluster 2024-09-14T02:16:15.771148+0000 mgr.a (mgr.14355) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:17 smithi171 bash[25040]: audit 2024-09-14T02:16:15.650100+0000 mgr.a (mgr.14355) 10179 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:17 smithi171 bash[25040]: cluster 2024-09-14T02:16:15.771148+0000 mgr.a (mgr.14355) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:17 smithi007 bash[22722]: audit 2024-09-14T02:16:15.650100+0000 mgr.a (mgr.14355) 10179 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:17 smithi007 bash[22722]: cluster 2024-09-14T02:16:15.771148+0000 mgr.a (mgr.14355) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:19 smithi131 bash[24745]: cluster 2024-09-14T02:16:17.772005+0000 mgr.a (mgr.14355) 10181 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:19 smithi171 bash[25040]: cluster 2024-09-14T02:16:17.772005+0000 mgr.a (mgr.14355) 10181 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:19 smithi007 bash[22722]: cluster 2024-09-14T02:16:17.772005+0000 mgr.a (mgr.14355) 10181 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:21.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:21.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:21 smithi131 bash[24745]: cluster 2024-09-14T02:16:19.772799+0000 mgr.a (mgr.14355) 10182 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:21 smithi171 bash[25040]: cluster 2024-09-14T02:16:19.772799+0000 mgr.a (mgr.14355) 10182 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:21 smithi007 bash[22722]: cluster 2024-09-14T02:16:19.772799+0000 mgr.a (mgr.14355) 10182 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:16:21.823 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:21.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:23 smithi131 bash[24745]: audit 2024-09-14T02:16:21.411172+0000 mgr.a (mgr.14355) 10183 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:23 smithi131 bash[24745]: cluster 2024-09-14T02:16:21.774120+0000 mgr.a (mgr.14355) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:23 smithi171 bash[25040]: audit 2024-09-14T02:16:21.411172+0000 mgr.a (mgr.14355) 10183 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:23 smithi171 bash[25040]: cluster 2024-09-14T02:16:21.774120+0000 mgr.a (mgr.14355) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:23 smithi007 bash[22722]: audit 2024-09-14T02:16:21.411172+0000 mgr.a (mgr.14355) 10183 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:23 smithi007 bash[22722]: cluster 2024-09-14T02:16:21.774120+0000 mgr.a (mgr.14355) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:25 smithi171 bash[25040]: cluster 2024-09-14T02:16:23.774884+0000 mgr.a (mgr.14355) 10185 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:16:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:25 smithi007 bash[22722]: cluster 2024-09-14T02:16:23.774884+0000 mgr.a (mgr.14355) 10185 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:16:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:25 smithi131 bash[24745]: cluster 2024-09-14T02:16:23.774884+0000 mgr.a (mgr.14355) 10185 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:16:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:27.607 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:27.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:27 smithi007 bash[22722]: cluster 2024-09-14T02:16:25.776863+0000 mgr.a (mgr.14355) 10186 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:16:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:27 smithi131 bash[24745]: cluster 2024-09-14T02:16:25.776863+0000 mgr.a (mgr.14355) 10186 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:16:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:27 smithi171 bash[25040]: cluster 2024-09-14T02:16:25.776863+0000 mgr.a (mgr.14355) 10186 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:16:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:28 smithi007 bash[22722]: audit 2024-09-14T02:16:27.160872+0000 mgr.a (mgr.14355) 10187 : audit [DBG] from='client.224985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:28 smithi131 bash[24745]: audit 2024-09-14T02:16:27.160872+0000 mgr.a (mgr.14355) 10187 : audit [DBG] from='client.224985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:28 smithi171 bash[25040]: audit 2024-09-14T02:16:27.160872+0000 mgr.a (mgr.14355) 10187 : audit [DBG] from='client.224985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:29 smithi007 bash[22722]: cluster 2024-09-14T02:16:27.777939+0000 mgr.a (mgr.14355) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:29 smithi131 bash[24745]: cluster 2024-09-14T02:16:27.777939+0000 mgr.a (mgr.14355) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:29 smithi171 bash[25040]: cluster 2024-09-14T02:16:27.777939+0000 mgr.a (mgr.14355) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:31 smithi007 bash[22722]: cluster 2024-09-14T02:16:29.778767+0000 mgr.a (mgr.14355) 10189 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:31 smithi131 bash[24745]: cluster 2024-09-14T02:16:29.778767+0000 mgr.a (mgr.14355) 10189 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:31 smithi171 bash[25040]: cluster 2024-09-14T02:16:29.778767+0000 mgr.a (mgr.14355) 10189 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:32.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:32.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:33.360 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:33.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:33 smithi007 bash[22722]: cluster 2024-09-14T02:16:31.781144+0000 mgr.a (mgr.14355) 10190 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:33 smithi131 bash[24745]: cluster 2024-09-14T02:16:31.781144+0000 mgr.a (mgr.14355) 10190 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:33 smithi171 bash[25040]: cluster 2024-09-14T02:16:31.781144+0000 mgr.a (mgr.14355) 10190 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:34 smithi007 bash[22722]: audit 2024-09-14T02:16:32.937927+0000 mgr.a (mgr.14355) 10191 : audit [DBG] from='client.225063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:34 smithi131 bash[24745]: audit 2024-09-14T02:16:32.937927+0000 mgr.a (mgr.14355) 10191 : audit [DBG] from='client.225063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:34 smithi171 bash[25040]: audit 2024-09-14T02:16:32.937927+0000 mgr.a (mgr.14355) 10191 : audit [DBG] from='client.225063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:35 smithi007 bash[22722]: cluster 2024-09-14T02:16:33.782136+0000 mgr.a (mgr.14355) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:35 smithi131 bash[24745]: cluster 2024-09-14T02:16:33.782136+0000 mgr.a (mgr.14355) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:35 smithi171 bash[25040]: cluster 2024-09-14T02:16:33.782136+0000 mgr.a (mgr.14355) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:36 smithi007 bash[22722]: cluster 2024-09-14T02:16:35.784382+0000 mgr.a (mgr.14355) 10193 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:36 smithi131 bash[24745]: cluster 2024-09-14T02:16:35.784382+0000 mgr.a (mgr.14355) 10193 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:36 smithi171 bash[25040]: cluster 2024-09-14T02:16:35.784382+0000 mgr.a (mgr.14355) 10193 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:38.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:38.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:39.103 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:39.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:38 smithi007 bash[22722]: cluster 2024-09-14T02:16:37.785159+0000 mgr.a (mgr.14355) 10194 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:38 smithi131 bash[24745]: cluster 2024-09-14T02:16:37.785159+0000 mgr.a (mgr.14355) 10194 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:38 smithi171 bash[25040]: cluster 2024-09-14T02:16:37.785159+0000 mgr.a (mgr.14355) 10194 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:39 smithi007 bash[22722]: audit 2024-09-14T02:16:38.690110+0000 mgr.a (mgr.14355) 10195 : audit [DBG] from='client.225141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:39 smithi131 bash[24745]: audit 2024-09-14T02:16:38.690110+0000 mgr.a (mgr.14355) 10195 : audit [DBG] from='client.225141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:39 smithi171 bash[25040]: audit 2024-09-14T02:16:38.690110+0000 mgr.a (mgr.14355) 10195 : audit [DBG] from='client.225141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:40 smithi007 bash[22722]: cluster 2024-09-14T02:16:39.786084+0000 mgr.a (mgr.14355) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:40 smithi131 bash[24745]: cluster 2024-09-14T02:16:39.786084+0000 mgr.a (mgr.14355) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:40 smithi171 bash[25040]: cluster 2024-09-14T02:16:39.786084+0000 mgr.a (mgr.14355) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:42 smithi007 bash[22722]: cluster 2024-09-14T02:16:41.788361+0000 mgr.a (mgr.14355) 10197 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:42 smithi131 bash[24745]: cluster 2024-09-14T02:16:41.788361+0000 mgr.a (mgr.14355) 10197 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:42 smithi171 bash[25040]: cluster 2024-09-14T02:16:41.788361+0000 mgr.a (mgr.14355) 10197 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:44.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:44.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:44.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:44.835 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:44.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:44.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:44.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:44.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:44 smithi007 bash[22722]: cluster 2024-09-14T02:16:43.789130+0000 mgr.a (mgr.14355) 10198 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:44 smithi131 bash[24745]: cluster 2024-09-14T02:16:43.789130+0000 mgr.a (mgr.14355) 10198 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:44 smithi171 bash[25040]: cluster 2024-09-14T02:16:43.789130+0000 mgr.a (mgr.14355) 10198 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:45 smithi007 bash[22722]: audit 2024-09-14T02:16:44.430743+0000 mgr.a (mgr.14355) 10199 : audit [DBG] from='client.225216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:45 smithi131 bash[24745]: audit 2024-09-14T02:16:44.430743+0000 mgr.a (mgr.14355) 10199 : audit [DBG] from='client.225216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:45 smithi171 bash[25040]: audit 2024-09-14T02:16:44.430743+0000 mgr.a (mgr.14355) 10199 : audit [DBG] from='client.225216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:46 smithi007 bash[22722]: cluster 2024-09-14T02:16:45.791395+0000 mgr.a (mgr.14355) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:46 smithi131 bash[24745]: cluster 2024-09-14T02:16:45.791395+0000 mgr.a (mgr.14355) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:46 smithi171 bash[25040]: cluster 2024-09-14T02:16:45.791395+0000 mgr.a (mgr.14355) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:16:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:49 smithi007 bash[22722]: cluster 2024-09-14T02:16:47.792163+0000 mgr.a (mgr.14355) 10201 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:49 smithi007 bash[22722]: audit 2024-09-14T02:16:48.484071+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:16:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:49 smithi131 bash[24745]: cluster 2024-09-14T02:16:47.792163+0000 mgr.a (mgr.14355) 10201 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:49 smithi131 bash[24745]: audit 2024-09-14T02:16:48.484071+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:16:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:49 smithi171 bash[25040]: cluster 2024-09-14T02:16:47.792163+0000 mgr.a (mgr.14355) 10201 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:49 smithi171 bash[25040]: audit 2024-09-14T02:16:48.484071+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:16:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.112596+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.116289+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.915922+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.917214+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.924685+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22722]: audit 2024-09-14T02:16:49.927068+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.112596+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.116289+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.915922+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.917214+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.924685+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:50 smithi131 bash[24745]: audit 2024-09-14T02:16:49.927068+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.112596+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.116289+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.915922+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:16:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.917214+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:16:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.924685+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:16:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:50 smithi171 bash[25040]: audit 2024-09-14T02:16:49.927068+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:50.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22972]: debug 2024-09-14T02:16:50.674+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:16:50.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:16:50 smithi007 bash[22972]: debug 2024-09-14T02:16:50.686+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:16:51.081 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:51.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:51.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:51.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:51.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:51 smithi007 bash[22722]: cluster 2024-09-14T02:16:49.792878+0000 mgr.a (mgr.14355) 10202 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:51 smithi007 bash[22722]: audit 2024-09-14T02:16:49.928243+0000 mgr.a (mgr.14355) 10203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:51 smithi007 bash[22722]: audit 2024-09-14T02:16:50.192540+0000 mgr.a (mgr.14355) 10204 : audit [DBG] from='client.225294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:51 smithi131 bash[24745]: cluster 2024-09-14T02:16:49.792878+0000 mgr.a (mgr.14355) 10202 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:51 smithi131 bash[24745]: audit 2024-09-14T02:16:49.928243+0000 mgr.a (mgr.14355) 10203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:51 smithi131 bash[24745]: audit 2024-09-14T02:16:50.192540+0000 mgr.a (mgr.14355) 10204 : audit [DBG] from='client.225294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:51 smithi171 bash[25040]: cluster 2024-09-14T02:16:49.792878+0000 mgr.a (mgr.14355) 10202 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:16:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:51 smithi171 bash[25040]: audit 2024-09-14T02:16:49.928243+0000 mgr.a (mgr.14355) 10203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:16:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:51 smithi171 bash[25040]: audit 2024-09-14T02:16:50.192540+0000 mgr.a (mgr.14355) 10204 : audit [DBG] from='client.225294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:52 smithi007 bash[22722]: audit 2024-09-14T02:16:50.675318+0000 mgr.a (mgr.14355) 10205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:16:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:52 smithi007 bash[22722]: cephadm 2024-09-14T02:16:50.687488+0000 mgr.a (mgr.14355) 10206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:16:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:52 smithi131 bash[24745]: audit 2024-09-14T02:16:50.675318+0000 mgr.a (mgr.14355) 10205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:16:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:52 smithi131 bash[24745]: cephadm 2024-09-14T02:16:50.687488+0000 mgr.a (mgr.14355) 10206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:16:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:52 smithi171 bash[25040]: audit 2024-09-14T02:16:50.675318+0000 mgr.a (mgr.14355) 10205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:16:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:52 smithi171 bash[25040]: cephadm 2024-09-14T02:16:50.687488+0000 mgr.a (mgr.14355) 10206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:16:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:53 smithi007 bash[22722]: cluster 2024-09-14T02:16:51.795772+0000 mgr.a (mgr.14355) 10207 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:16:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:53 smithi131 bash[24745]: cluster 2024-09-14T02:16:51.795772+0000 mgr.a (mgr.14355) 10207 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:16:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:53 smithi171 bash[25040]: cluster 2024-09-14T02:16:51.795772+0000 mgr.a (mgr.14355) 10207 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:16:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:55 smithi007 bash[22722]: cluster 2024-09-14T02:16:53.796752+0000 mgr.a (mgr.14355) 10208 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:16:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:55 smithi131 bash[24745]: cluster 2024-09-14T02:16:53.796752+0000 mgr.a (mgr.14355) 10208 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:16:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:55 smithi171 bash[25040]: cluster 2024-09-14T02:16:53.796752+0000 mgr.a (mgr.14355) 10208 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:16:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:16:56.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:16:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:16:56.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:16:56.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:16:56.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:16:56.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:16:56.846 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:16:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:57 smithi007 bash[22722]: cluster 2024-09-14T02:16:55.798889+0000 mgr.a (mgr.14355) 10209 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:57 smithi131 bash[24745]: cluster 2024-09-14T02:16:55.798889+0000 mgr.a (mgr.14355) 10209 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:57 smithi171 bash[25040]: cluster 2024-09-14T02:16:55.798889+0000 mgr.a (mgr.14355) 10209 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:16:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:58 smithi007 bash[22722]: audit 2024-09-14T02:16:56.417317+0000 mgr.a (mgr.14355) 10210 : audit [DBG] from='client.225477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:58 smithi131 bash[24745]: audit 2024-09-14T02:16:56.417317+0000 mgr.a (mgr.14355) 10210 : audit [DBG] from='client.225477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:58 smithi171 bash[25040]: audit 2024-09-14T02:16:56.417317+0000 mgr.a (mgr.14355) 10210 : audit [DBG] from='client.225477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:16:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:16:59 smithi007 bash[22722]: cluster 2024-09-14T02:16:57.799803+0000 mgr.a (mgr.14355) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:16:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:16:59 smithi131 bash[24745]: cluster 2024-09-14T02:16:57.799803+0000 mgr.a (mgr.14355) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:16:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:16:59 smithi171 bash[25040]: cluster 2024-09-14T02:16:57.799803+0000 mgr.a (mgr.14355) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:17:01.433 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:01 smithi171 bash[25040]: cluster 2024-09-14T02:16:59.800733+0000 mgr.a (mgr.14355) 10212 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:17:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:01 smithi007 bash[22722]: cluster 2024-09-14T02:16:59.800733+0000 mgr.a (mgr.14355) 10212 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:17:01.481 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:01 smithi131 bash[24745]: cluster 2024-09-14T02:16:59.800733+0000 mgr.a (mgr.14355) 10212 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:17:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:01.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:01.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:02.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:03 smithi007 bash[22722]: cluster 2024-09-14T02:17:01.803067+0000 mgr.a (mgr.14355) 10213 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:03 smithi007 bash[22722]: audit 2024-09-14T02:17:02.178139+0000 mgr.a (mgr.14355) 10214 : audit [DBG] from='client.225549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:03 smithi131 bash[24745]: cluster 2024-09-14T02:17:01.803067+0000 mgr.a (mgr.14355) 10213 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:03 smithi131 bash[24745]: audit 2024-09-14T02:17:02.178139+0000 mgr.a (mgr.14355) 10214 : audit [DBG] from='client.225549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:03 smithi171 bash[25040]: cluster 2024-09-14T02:17:01.803067+0000 mgr.a (mgr.14355) 10213 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:03 smithi171 bash[25040]: audit 2024-09-14T02:17:02.178139+0000 mgr.a (mgr.14355) 10214 : audit [DBG] from='client.225549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:05 smithi007 bash[22722]: cluster 2024-09-14T02:17:03.804157+0000 mgr.a (mgr.14355) 10215 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:05 smithi131 bash[24745]: cluster 2024-09-14T02:17:03.804157+0000 mgr.a (mgr.14355) 10215 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:05 smithi171 bash[25040]: cluster 2024-09-14T02:17:03.804157+0000 mgr.a (mgr.14355) 10215 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:07 smithi007 bash[22722]: cluster 2024-09-14T02:17:05.806404+0000 mgr.a (mgr.14355) 10216 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:07 smithi131 bash[24745]: cluster 2024-09-14T02:17:05.806404+0000 mgr.a (mgr.14355) 10216 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:07 smithi171 bash[25040]: cluster 2024-09-14T02:17:05.806404+0000 mgr.a (mgr.14355) 10216 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:17:07.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:07.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:07.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:08.344 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:08.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:09 smithi007 bash[22722]: cluster 2024-09-14T02:17:07.807131+0000 mgr.a (mgr.14355) 10217 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:09 smithi007 bash[22722]: audit 2024-09-14T02:17:07.927258+0000 mgr.a (mgr.14355) 10218 : audit [DBG] from='client.225624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:09 smithi131 bash[24745]: cluster 2024-09-14T02:17:07.807131+0000 mgr.a (mgr.14355) 10217 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:09 smithi131 bash[24745]: audit 2024-09-14T02:17:07.927258+0000 mgr.a (mgr.14355) 10218 : audit [DBG] from='client.225624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:09 smithi171 bash[25040]: cluster 2024-09-14T02:17:07.807131+0000 mgr.a (mgr.14355) 10217 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:09 smithi171 bash[25040]: audit 2024-09-14T02:17:07.927258+0000 mgr.a (mgr.14355) 10218 : audit [DBG] from='client.225624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:11 smithi007 bash[22722]: cluster 2024-09-14T02:17:09.808008+0000 mgr.a (mgr.14355) 10219 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:11 smithi131 bash[24745]: cluster 2024-09-14T02:17:09.808008+0000 mgr.a (mgr.14355) 10219 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:11 smithi171 bash[25040]: cluster 2024-09-14T02:17:09.808008+0000 mgr.a (mgr.14355) 10219 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:13 smithi007 bash[22722]: cluster 2024-09-14T02:17:11.810275+0000 mgr.a (mgr.14355) 10220 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:13 smithi131 bash[24745]: cluster 2024-09-14T02:17:11.810275+0000 mgr.a (mgr.14355) 10220 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:13 smithi171 bash[25040]: cluster 2024-09-14T02:17:11.810275+0000 mgr.a (mgr.14355) 10220 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:14.123 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:14.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:14.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:14.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:14.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:15 smithi007 bash[22722]: audit 2024-09-14T02:17:13.678896+0000 mgr.a (mgr.14355) 10221 : audit [DBG] from='client.225699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:15 smithi007 bash[22722]: cluster 2024-09-14T02:17:13.810939+0000 mgr.a (mgr.14355) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:15 smithi131 bash[24745]: audit 2024-09-14T02:17:13.678896+0000 mgr.a (mgr.14355) 10221 : audit [DBG] from='client.225699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:15 smithi131 bash[24745]: cluster 2024-09-14T02:17:13.810939+0000 mgr.a (mgr.14355) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:15 smithi171 bash[25040]: audit 2024-09-14T02:17:13.678896+0000 mgr.a (mgr.14355) 10221 : audit [DBG] from='client.225699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:15 smithi171 bash[25040]: cluster 2024-09-14T02:17:13.810939+0000 mgr.a (mgr.14355) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:17 smithi007 bash[22722]: cluster 2024-09-14T02:17:15.813182+0000 mgr.a (mgr.14355) 10223 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:17 smithi131 bash[24745]: cluster 2024-09-14T02:17:15.813182+0000 mgr.a (mgr.14355) 10223 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:17 smithi171 bash[25040]: cluster 2024-09-14T02:17:15.813182+0000 mgr.a (mgr.14355) 10223 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:19 smithi007 bash[22722]: cluster 2024-09-14T02:17:17.813952+0000 mgr.a (mgr.14355) 10224 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:19 smithi131 bash[24745]: cluster 2024-09-14T02:17:17.813952+0000 mgr.a (mgr.14355) 10224 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:19 smithi171 bash[25040]: cluster 2024-09-14T02:17:17.813952+0000 mgr.a (mgr.14355) 10224 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:21 smithi007 bash[22722]: audit 2024-09-14T02:17:19.464669+0000 mgr.a (mgr.14355) 10225 : audit [DBG] from='client.225777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:21 smithi007 bash[22722]: cluster 2024-09-14T02:17:19.814618+0000 mgr.a (mgr.14355) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:21 smithi131 bash[24745]: audit 2024-09-14T02:17:19.464669+0000 mgr.a (mgr.14355) 10225 : audit [DBG] from='client.225777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:21 smithi131 bash[24745]: cluster 2024-09-14T02:17:19.814618+0000 mgr.a (mgr.14355) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:21 smithi171 bash[25040]: audit 2024-09-14T02:17:19.464669+0000 mgr.a (mgr.14355) 10225 : audit [DBG] from='client.225777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:21 smithi171 bash[25040]: cluster 2024-09-14T02:17:19.814618+0000 mgr.a (mgr.14355) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:23 smithi007 bash[22722]: cluster 2024-09-14T02:17:21.816790+0000 mgr.a (mgr.14355) 10227 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:23.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:23 smithi131 bash[24745]: cluster 2024-09-14T02:17:21.816790+0000 mgr.a (mgr.14355) 10227 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:23 smithi171 bash[25040]: cluster 2024-09-14T02:17:21.816790+0000 mgr.a (mgr.14355) 10227 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:24.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:25 smithi131 bash[24745]: cluster 2024-09-14T02:17:23.817498+0000 mgr.a (mgr.14355) 10228 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:25 smithi171 bash[25040]: cluster 2024-09-14T02:17:23.817498+0000 mgr.a (mgr.14355) 10228 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:25.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:25 smithi007 bash[22722]: cluster 2024-09-14T02:17:23.817498+0000 mgr.a (mgr.14355) 10228 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:26 smithi131 bash[24745]: audit 2024-09-14T02:17:25.231125+0000 mgr.a (mgr.14355) 10229 : audit [DBG] from='client.225855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:26 smithi171 bash[25040]: audit 2024-09-14T02:17:25.231125+0000 mgr.a (mgr.14355) 10229 : audit [DBG] from='client.225855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:26 smithi007 bash[22722]: audit 2024-09-14T02:17:25.231125+0000 mgr.a (mgr.14355) 10229 : audit [DBG] from='client.225855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:27 smithi131 bash[24745]: cluster 2024-09-14T02:17:25.820424+0000 mgr.a (mgr.14355) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:27 smithi171 bash[25040]: cluster 2024-09-14T02:17:25.820424+0000 mgr.a (mgr.14355) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:27 smithi007 bash[22722]: cluster 2024-09-14T02:17:25.820424+0000 mgr.a (mgr.14355) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:29 smithi131 bash[24745]: cluster 2024-09-14T02:17:27.821197+0000 mgr.a (mgr.14355) 10231 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:29 smithi171 bash[25040]: cluster 2024-09-14T02:17:27.821197+0000 mgr.a (mgr.14355) 10231 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:29 smithi007 bash[22722]: cluster 2024-09-14T02:17:27.821197+0000 mgr.a (mgr.14355) 10231 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:30.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:30.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:30.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:31.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:31.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:31 smithi131 bash[24745]: cluster 2024-09-14T02:17:29.821953+0000 mgr.a (mgr.14355) 10232 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:17:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:31 smithi171 bash[25040]: cluster 2024-09-14T02:17:29.821953+0000 mgr.a (mgr.14355) 10232 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:17:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:31 smithi007 bash[22722]: cluster 2024-09-14T02:17:29.821953+0000 mgr.a (mgr.14355) 10232 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:17:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:32 smithi131 bash[24745]: audit 2024-09-14T02:17:31.011886+0000 mgr.a (mgr.14355) 10233 : audit [DBG] from='client.225930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:32 smithi171 bash[25040]: audit 2024-09-14T02:17:31.011886+0000 mgr.a (mgr.14355) 10233 : audit [DBG] from='client.225930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:32 smithi007 bash[22722]: audit 2024-09-14T02:17:31.011886+0000 mgr.a (mgr.14355) 10233 : audit [DBG] from='client.225930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:33 smithi131 bash[24745]: cluster 2024-09-14T02:17:31.824674+0000 mgr.a (mgr.14355) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:33 smithi171 bash[25040]: cluster 2024-09-14T02:17:31.824674+0000 mgr.a (mgr.14355) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:33 smithi007 bash[22722]: cluster 2024-09-14T02:17:31.824674+0000 mgr.a (mgr.14355) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:35 smithi131 bash[24745]: cluster 2024-09-14T02:17:33.825493+0000 mgr.a (mgr.14355) 10235 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:35 smithi171 bash[25040]: cluster 2024-09-14T02:17:33.825493+0000 mgr.a (mgr.14355) 10235 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:35 smithi007 bash[22722]: cluster 2024-09-14T02:17:33.825493+0000 mgr.a (mgr.14355) 10235 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:17:36.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:36.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:36.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:37.249 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:37 smithi131 bash[24745]: cluster 2024-09-14T02:17:35.827466+0000 mgr.a (mgr.14355) 10236 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:37 smithi171 bash[25040]: cluster 2024-09-14T02:17:35.827466+0000 mgr.a (mgr.14355) 10236 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:37 smithi007 bash[22722]: cluster 2024-09-14T02:17:35.827466+0000 mgr.a (mgr.14355) 10236 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:38 smithi131 bash[24745]: audit 2024-09-14T02:17:36.800601+0000 mgr.a (mgr.14355) 10237 : audit [DBG] from='client.226008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:38 smithi171 bash[25040]: audit 2024-09-14T02:17:36.800601+0000 mgr.a (mgr.14355) 10237 : audit [DBG] from='client.226008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:38 smithi007 bash[22722]: audit 2024-09-14T02:17:36.800601+0000 mgr.a (mgr.14355) 10237 : audit [DBG] from='client.226008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:39 smithi131 bash[24745]: cluster 2024-09-14T02:17:37.828328+0000 mgr.a (mgr.14355) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:39 smithi171 bash[25040]: cluster 2024-09-14T02:17:37.828328+0000 mgr.a (mgr.14355) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:39 smithi007 bash[22722]: cluster 2024-09-14T02:17:37.828328+0000 mgr.a (mgr.14355) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:41 smithi131 bash[24745]: cluster 2024-09-14T02:17:39.829086+0000 mgr.a (mgr.14355) 10239 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:41 smithi171 bash[25040]: cluster 2024-09-14T02:17:39.829086+0000 mgr.a (mgr.14355) 10239 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:41 smithi007 bash[22722]: cluster 2024-09-14T02:17:39.829086+0000 mgr.a (mgr.14355) 10239 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:42.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:42.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:43.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:43.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:43 smithi131 bash[24745]: cluster 2024-09-14T02:17:41.831449+0000 mgr.a (mgr.14355) 10240 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:43 smithi171 bash[25040]: cluster 2024-09-14T02:17:41.831449+0000 mgr.a (mgr.14355) 10240 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:43 smithi007 bash[22722]: cluster 2024-09-14T02:17:41.831449+0000 mgr.a (mgr.14355) 10240 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:44 smithi131 bash[24745]: audit 2024-09-14T02:17:42.592217+0000 mgr.a (mgr.14355) 10241 : audit [DBG] from='client.226086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:44 smithi171 bash[25040]: audit 2024-09-14T02:17:42.592217+0000 mgr.a (mgr.14355) 10241 : audit [DBG] from='client.226086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:44 smithi007 bash[22722]: audit 2024-09-14T02:17:42.592217+0000 mgr.a (mgr.14355) 10241 : audit [DBG] from='client.226086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:45 smithi131 bash[24745]: cluster 2024-09-14T02:17:43.832381+0000 mgr.a (mgr.14355) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:45 smithi171 bash[25040]: cluster 2024-09-14T02:17:43.832381+0000 mgr.a (mgr.14355) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:45 smithi007 bash[22722]: cluster 2024-09-14T02:17:43.832381+0000 mgr.a (mgr.14355) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:47 smithi131 bash[24745]: cluster 2024-09-14T02:17:45.834771+0000 mgr.a (mgr.14355) 10243 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:47 smithi171 bash[25040]: cluster 2024-09-14T02:17:45.834771+0000 mgr.a (mgr.14355) 10243 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:47 smithi007 bash[22722]: cluster 2024-09-14T02:17:45.834771+0000 mgr.a (mgr.14355) 10243 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:48.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:48.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:48.825 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:49 smithi171 bash[25040]: cluster 2024-09-14T02:17:47.835704+0000 mgr.a (mgr.14355) 10244 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:49 smithi007 bash[22722]: cluster 2024-09-14T02:17:47.835704+0000 mgr.a (mgr.14355) 10244 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:49 smithi131 bash[24745]: cluster 2024-09-14T02:17:47.835704+0000 mgr.a (mgr.14355) 10244 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:50 smithi007 bash[22722]: audit 2024-09-14T02:17:48.373430+0000 mgr.a (mgr.14355) 10245 : audit [DBG] from='client.226164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:50 smithi131 bash[24745]: audit 2024-09-14T02:17:48.373430+0000 mgr.a (mgr.14355) 10245 : audit [DBG] from='client.226164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:50 smithi171 bash[25040]: audit 2024-09-14T02:17:48.373430+0000 mgr.a (mgr.14355) 10245 : audit [DBG] from='client.226164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:51 smithi007 bash[22722]: cluster 2024-09-14T02:17:49.836631+0000 mgr.a (mgr.14355) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:51 smithi007 bash[22722]: audit 2024-09-14T02:17:50.744761+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:17:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:51 smithi131 bash[24745]: cluster 2024-09-14T02:17:49.836631+0000 mgr.a (mgr.14355) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:51 smithi131 bash[24745]: audit 2024-09-14T02:17:50.744761+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:17:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:51 smithi171 bash[25040]: cluster 2024-09-14T02:17:49.836631+0000 mgr.a (mgr.14355) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:51 smithi171 bash[25040]: audit 2024-09-14T02:17:50.744761+0000 mon.a (mon.0) 2122 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:17:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:51.361416+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:51.367422+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:51.373370+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:51.379994+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: cluster 2024-09-14T02:17:51.838801+0000 mgr.a (mgr.14355) 10247 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:52.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:52.016925+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:17:52.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:52.020033+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:17:52.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:52.030602+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:52.033405+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:52.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22722]: audit 2024-09-14T02:17:52.035750+0000 mgr.a (mgr.14355) 10248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:51.361416+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:51.367422+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:51.373370+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:51.379994+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: cluster 2024-09-14T02:17:51.838801+0000 mgr.a (mgr.14355) 10247 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:52.016925+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:52.020033+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:52.030602+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:52.033405+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:52 smithi131 bash[24745]: audit 2024-09-14T02:17:52.035750+0000 mgr.a (mgr.14355) 10248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:51.361416+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:51.367422+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:51.373370+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:51.379994+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: cluster 2024-09-14T02:17:51.838801+0000 mgr.a (mgr.14355) 10247 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:52.016925+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:52.020033+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:52.030602+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:52.033405+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:52 smithi171 bash[25040]: audit 2024-09-14T02:17:52.035750+0000 mgr.a (mgr.14355) 10248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:17:53.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22972]: debug 2024-09-14T02:17:52.765+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:17:53.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:17:52 smithi007 bash[22972]: debug 2024-09-14T02:17:52.765+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:17:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:53 smithi007 bash[22722]: audit 2024-09-14T02:17:52.766344+0000 mgr.a (mgr.14355) 10249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:17:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:53 smithi007 bash[22722]: cephadm 2024-09-14T02:17:52.767546+0000 mgr.a (mgr.14355) 10250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:17:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:53 smithi131 bash[24745]: audit 2024-09-14T02:17:52.766344+0000 mgr.a (mgr.14355) 10249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:17:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:53 smithi131 bash[24745]: cephadm 2024-09-14T02:17:52.767546+0000 mgr.a (mgr.14355) 10250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:17:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:53 smithi171 bash[25040]: audit 2024-09-14T02:17:52.766344+0000 mgr.a (mgr.14355) 10249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:17:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:53 smithi171 bash[25040]: cephadm 2024-09-14T02:17:52.767546+0000 mgr.a (mgr.14355) 10250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:17:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:17:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:17:54.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:17:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:17:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:17:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:54 smithi007 bash[22722]: cluster 2024-09-14T02:17:53.839533+0000 mgr.a (mgr.14355) 10251 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:54 smithi007 bash[22722]: audit 2024-09-14T02:17:54.157045+0000 mgr.a (mgr.14355) 10252 : audit [DBG] from='client.226350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:54 smithi131 bash[24745]: cluster 2024-09-14T02:17:53.839533+0000 mgr.a (mgr.14355) 10251 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:54 smithi131 bash[24745]: audit 2024-09-14T02:17:54.157045+0000 mgr.a (mgr.14355) 10252 : audit [DBG] from='client.226350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:54 smithi171 bash[25040]: cluster 2024-09-14T02:17:53.839533+0000 mgr.a (mgr.14355) 10251 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:17:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:54 smithi171 bash[25040]: audit 2024-09-14T02:17:54.157045+0000 mgr.a (mgr.14355) 10252 : audit [DBG] from='client.226350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:17:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:56 smithi007 bash[22722]: cluster 2024-09-14T02:17:55.841780+0000 mgr.a (mgr.14355) 10253 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:56 smithi131 bash[24745]: cluster 2024-09-14T02:17:55.841780+0000 mgr.a (mgr.14355) 10253 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:56 smithi171 bash[25040]: cluster 2024-09-14T02:17:55.841780+0000 mgr.a (mgr.14355) 10253 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:17:58 smithi007 bash[22722]: cluster 2024-09-14T02:17:57.842601+0000 mgr.a (mgr.14355) 10254 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:17:58 smithi131 bash[24745]: cluster 2024-09-14T02:17:57.842601+0000 mgr.a (mgr.14355) 10254 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:17:58 smithi171 bash[25040]: cluster 2024-09-14T02:17:57.842601+0000 mgr.a (mgr.14355) 10254 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:17:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:17:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:17:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:00.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:00.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:00 smithi007 bash[22722]: cluster 2024-09-14T02:17:59.843459+0000 mgr.a (mgr.14355) 10255 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:00 smithi007 bash[22722]: audit 2024-09-14T02:17:59.911877+0000 mgr.a (mgr.14355) 10256 : audit [DBG] from='client.226428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:00 smithi131 bash[24745]: cluster 2024-09-14T02:17:59.843459+0000 mgr.a (mgr.14355) 10255 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:00 smithi131 bash[24745]: audit 2024-09-14T02:17:59.911877+0000 mgr.a (mgr.14355) 10256 : audit [DBG] from='client.226428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:00 smithi171 bash[25040]: cluster 2024-09-14T02:17:59.843459+0000 mgr.a (mgr.14355) 10255 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:00 smithi171 bash[25040]: audit 2024-09-14T02:17:59.911877+0000 mgr.a (mgr.14355) 10256 : audit [DBG] from='client.226428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:02 smithi007 bash[22722]: cluster 2024-09-14T02:18:01.845834+0000 mgr.a (mgr.14355) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:02 smithi131 bash[24745]: cluster 2024-09-14T02:18:01.845834+0000 mgr.a (mgr.14355) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:02 smithi171 bash[25040]: cluster 2024-09-14T02:18:01.845834+0000 mgr.a (mgr.14355) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:04 smithi007 bash[22722]: cluster 2024-09-14T02:18:03.846615+0000 mgr.a (mgr.14355) 10258 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:18:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:04 smithi131 bash[24745]: cluster 2024-09-14T02:18:03.846615+0000 mgr.a (mgr.14355) 10258 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:18:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:04 smithi171 bash[25040]: cluster 2024-09-14T02:18:03.846615+0000 mgr.a (mgr.14355) 10258 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:18:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:06.116 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:06.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:06 smithi007 bash[22722]: audit 2024-09-14T02:18:05.674405+0000 mgr.a (mgr.14355) 10259 : audit [DBG] from='client.226503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:06 smithi007 bash[22722]: cluster 2024-09-14T02:18:05.847870+0000 mgr.a (mgr.14355) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:06 smithi131 bash[24745]: audit 2024-09-14T02:18:05.674405+0000 mgr.a (mgr.14355) 10259 : audit [DBG] from='client.226503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:06 smithi131 bash[24745]: cluster 2024-09-14T02:18:05.847870+0000 mgr.a (mgr.14355) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:06 smithi171 bash[25040]: audit 2024-09-14T02:18:05.674405+0000 mgr.a (mgr.14355) 10259 : audit [DBG] from='client.226503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:06 smithi171 bash[25040]: cluster 2024-09-14T02:18:05.847870+0000 mgr.a (mgr.14355) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:08 smithi007 bash[22722]: cluster 2024-09-14T02:18:07.848929+0000 mgr.a (mgr.14355) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:08 smithi131 bash[24745]: cluster 2024-09-14T02:18:07.848929+0000 mgr.a (mgr.14355) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:08 smithi171 bash[25040]: cluster 2024-09-14T02:18:07.848929+0000 mgr.a (mgr.14355) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:11.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:11.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:11.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:10 smithi007 bash[22722]: cluster 2024-09-14T02:18:09.849908+0000 mgr.a (mgr.14355) 10262 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:10 smithi131 bash[24745]: cluster 2024-09-14T02:18:09.849908+0000 mgr.a (mgr.14355) 10262 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:10 smithi171 bash[25040]: cluster 2024-09-14T02:18:09.849908+0000 mgr.a (mgr.14355) 10262 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:18:11.890 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:12 smithi007 bash[22722]: audit 2024-09-14T02:18:11.452036+0000 mgr.a (mgr.14355) 10263 : audit [DBG] from='client.226578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:12 smithi007 bash[22722]: cluster 2024-09-14T02:18:11.851539+0000 mgr.a (mgr.14355) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:12 smithi131 bash[24745]: audit 2024-09-14T02:18:11.452036+0000 mgr.a (mgr.14355) 10263 : audit [DBG] from='client.226578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:12 smithi131 bash[24745]: cluster 2024-09-14T02:18:11.851539+0000 mgr.a (mgr.14355) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:12 smithi171 bash[25040]: audit 2024-09-14T02:18:11.452036+0000 mgr.a (mgr.14355) 10263 : audit [DBG] from='client.226578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:12 smithi171 bash[25040]: cluster 2024-09-14T02:18:11.851539+0000 mgr.a (mgr.14355) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:14 smithi007 bash[22722]: cluster 2024-09-14T02:18:13.852280+0000 mgr.a (mgr.14355) 10265 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:18:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:14 smithi131 bash[24745]: cluster 2024-09-14T02:18:13.852280+0000 mgr.a (mgr.14355) 10265 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:18:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:14 smithi171 bash[25040]: cluster 2024-09-14T02:18:13.852280+0000 mgr.a (mgr.14355) 10265 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:18:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:16 smithi007 bash[22722]: cluster 2024-09-14T02:18:15.854184+0000 mgr.a (mgr.14355) 10266 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:18:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:16 smithi131 bash[24745]: cluster 2024-09-14T02:18:15.854184+0000 mgr.a (mgr.14355) 10266 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:18:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:16 smithi171 bash[25040]: cluster 2024-09-14T02:18:15.854184+0000 mgr.a (mgr.14355) 10266 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:17.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:17.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:17.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:17 smithi007 bash[22722]: audit 2024-09-14T02:18:17.230879+0000 mgr.a (mgr.14355) 10267 : audit [DBG] from='client.226656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:17 smithi131 bash[24745]: audit 2024-09-14T02:18:17.230879+0000 mgr.a (mgr.14355) 10267 : audit [DBG] from='client.226656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:17 smithi171 bash[25040]: audit 2024-09-14T02:18:17.230879+0000 mgr.a (mgr.14355) 10267 : audit [DBG] from='client.226656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:18 smithi007 bash[22722]: cluster 2024-09-14T02:18:17.855104+0000 mgr.a (mgr.14355) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:18 smithi131 bash[24745]: cluster 2024-09-14T02:18:17.855104+0000 mgr.a (mgr.14355) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:18 smithi171 bash[25040]: cluster 2024-09-14T02:18:17.855104+0000 mgr.a (mgr.14355) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:20 smithi131 bash[24745]: cluster 2024-09-14T02:18:19.855892+0000 mgr.a (mgr.14355) 10269 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:20 smithi171 bash[25040]: cluster 2024-09-14T02:18:19.855892+0000 mgr.a (mgr.14355) 10269 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:20 smithi007 bash[22722]: cluster 2024-09-14T02:18:19.855892+0000 mgr.a (mgr.14355) 10269 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:22.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:22.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:22 smithi131 bash[24745]: cluster 2024-09-14T02:18:21.858143+0000 mgr.a (mgr.14355) 10270 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:22 smithi171 bash[25040]: cluster 2024-09-14T02:18:21.858143+0000 mgr.a (mgr.14355) 10270 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:23.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:22 smithi007 bash[22722]: cluster 2024-09-14T02:18:21.858143+0000 mgr.a (mgr.14355) 10270 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:23 smithi131 bash[24745]: audit 2024-09-14T02:18:22.997484+0000 mgr.a (mgr.14355) 10271 : audit [DBG] from='client.226734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:23 smithi171 bash[25040]: audit 2024-09-14T02:18:22.997484+0000 mgr.a (mgr.14355) 10271 : audit [DBG] from='client.226734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:23 smithi007 bash[22722]: audit 2024-09-14T02:18:22.997484+0000 mgr.a (mgr.14355) 10271 : audit [DBG] from='client.226734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:24 smithi131 bash[24745]: cluster 2024-09-14T02:18:23.859221+0000 mgr.a (mgr.14355) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:24 smithi171 bash[25040]: cluster 2024-09-14T02:18:23.859221+0000 mgr.a (mgr.14355) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:24 smithi007 bash[22722]: cluster 2024-09-14T02:18:23.859221+0000 mgr.a (mgr.14355) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:26 smithi131 bash[24745]: cluster 2024-09-14T02:18:25.861572+0000 mgr.a (mgr.14355) 10273 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:26 smithi171 bash[25040]: cluster 2024-09-14T02:18:25.861572+0000 mgr.a (mgr.14355) 10273 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:26 smithi007 bash[22722]: cluster 2024-09-14T02:18:25.861572+0000 mgr.a (mgr.14355) 10273 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:28.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:28.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:28.429 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:29.204 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:29.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:28 smithi131 bash[24745]: cluster 2024-09-14T02:18:27.862552+0000 mgr.a (mgr.14355) 10274 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:28 smithi171 bash[25040]: cluster 2024-09-14T02:18:27.862552+0000 mgr.a (mgr.14355) 10274 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:28 smithi007 bash[22722]: cluster 2024-09-14T02:18:27.862552+0000 mgr.a (mgr.14355) 10274 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:29 smithi131 bash[24745]: audit 2024-09-14T02:18:28.765768+0000 mgr.a (mgr.14355) 10275 : audit [DBG] from='client.226809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:29 smithi171 bash[25040]: audit 2024-09-14T02:18:28.765768+0000 mgr.a (mgr.14355) 10275 : audit [DBG] from='client.226809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:29 smithi007 bash[22722]: audit 2024-09-14T02:18:28.765768+0000 mgr.a (mgr.14355) 10275 : audit [DBG] from='client.226809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:31.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:30 smithi131 bash[24745]: cluster 2024-09-14T02:18:29.863537+0000 mgr.a (mgr.14355) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:30 smithi171 bash[25040]: cluster 2024-09-14T02:18:29.863537+0000 mgr.a (mgr.14355) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:30 smithi007 bash[22722]: cluster 2024-09-14T02:18:29.863537+0000 mgr.a (mgr.14355) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:33.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:32 smithi131 bash[24745]: cluster 2024-09-14T02:18:31.865785+0000 mgr.a (mgr.14355) 10277 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:32 smithi171 bash[25040]: cluster 2024-09-14T02:18:31.865785+0000 mgr.a (mgr.14355) 10277 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:32 smithi007 bash[22722]: cluster 2024-09-14T02:18:31.865785+0000 mgr.a (mgr.14355) 10277 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:34.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:34.206 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:34.946 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:34.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:35 smithi007 bash[22722]: cluster 2024-09-14T02:18:33.866585+0000 mgr.a (mgr.14355) 10278 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:35.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:35 smithi131 bash[24745]: cluster 2024-09-14T02:18:33.866585+0000 mgr.a (mgr.14355) 10278 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:35 smithi171 bash[25040]: cluster 2024-09-14T02:18:33.866585+0000 mgr.a (mgr.14355) 10278 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:36 smithi007 bash[22722]: audit 2024-09-14T02:18:34.539022+0000 mgr.a (mgr.14355) 10279 : audit [DBG] from='client.226884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:36.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:36 smithi131 bash[24745]: audit 2024-09-14T02:18:34.539022+0000 mgr.a (mgr.14355) 10279 : audit [DBG] from='client.226884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:36 smithi171 bash[25040]: audit 2024-09-14T02:18:34.539022+0000 mgr.a (mgr.14355) 10279 : audit [DBG] from='client.226884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:37 smithi007 bash[22722]: cluster 2024-09-14T02:18:35.868903+0000 mgr.a (mgr.14355) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:37 smithi131 bash[24745]: cluster 2024-09-14T02:18:35.868903+0000 mgr.a (mgr.14355) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:37 smithi171 bash[25040]: cluster 2024-09-14T02:18:35.868903+0000 mgr.a (mgr.14355) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:18:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:39 smithi007 bash[22722]: cluster 2024-09-14T02:18:37.869667+0000 mgr.a (mgr.14355) 10281 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:39 smithi131 bash[24745]: cluster 2024-09-14T02:18:37.869667+0000 mgr.a (mgr.14355) 10281 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:39 smithi171 bash[25040]: cluster 2024-09-14T02:18:37.869667+0000 mgr.a (mgr.14355) 10281 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:39.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:39.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:39.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:40.698 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:40.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:40.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:40.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:40.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:41 smithi007 bash[22722]: cluster 2024-09-14T02:18:39.870443+0000 mgr.a (mgr.14355) 10282 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:41 smithi007 bash[22722]: audit 2024-09-14T02:18:40.282373+0000 mgr.a (mgr.14355) 10283 : audit [DBG] from='client.226962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:41 smithi131 bash[24745]: cluster 2024-09-14T02:18:39.870443+0000 mgr.a (mgr.14355) 10282 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:41 smithi131 bash[24745]: audit 2024-09-14T02:18:40.282373+0000 mgr.a (mgr.14355) 10283 : audit [DBG] from='client.226962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:41 smithi171 bash[25040]: cluster 2024-09-14T02:18:39.870443+0000 mgr.a (mgr.14355) 10282 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:41 smithi171 bash[25040]: audit 2024-09-14T02:18:40.282373+0000 mgr.a (mgr.14355) 10283 : audit [DBG] from='client.226962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:43 smithi007 bash[22722]: cluster 2024-09-14T02:18:41.873363+0000 mgr.a (mgr.14355) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:43 smithi131 bash[24745]: cluster 2024-09-14T02:18:41.873363+0000 mgr.a (mgr.14355) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:43 smithi171 bash[25040]: cluster 2024-09-14T02:18:41.873363+0000 mgr.a (mgr.14355) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:45 smithi007 bash[22722]: cluster 2024-09-14T02:18:43.874198+0000 mgr.a (mgr.14355) 10285 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:45 smithi131 bash[24745]: cluster 2024-09-14T02:18:43.874198+0000 mgr.a (mgr.14355) 10285 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:45 smithi171 bash[25040]: cluster 2024-09-14T02:18:43.874198+0000 mgr.a (mgr.14355) 10285 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:45.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:45.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:46.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:46.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:47 smithi007 bash[22722]: cluster 2024-09-14T02:18:45.876157+0000 mgr.a (mgr.14355) 10286 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:47 smithi007 bash[22722]: audit 2024-09-14T02:18:46.029844+0000 mgr.a (mgr.14355) 10287 : audit [DBG] from='client.227037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:47 smithi131 bash[24745]: cluster 2024-09-14T02:18:45.876157+0000 mgr.a (mgr.14355) 10286 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:47 smithi131 bash[24745]: audit 2024-09-14T02:18:46.029844+0000 mgr.a (mgr.14355) 10287 : audit [DBG] from='client.227037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:47 smithi171 bash[25040]: cluster 2024-09-14T02:18:45.876157+0000 mgr.a (mgr.14355) 10286 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:47 smithi171 bash[25040]: audit 2024-09-14T02:18:46.029844+0000 mgr.a (mgr.14355) 10287 : audit [DBG] from='client.227037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:49 smithi007 bash[22722]: cluster 2024-09-14T02:18:47.877337+0000 mgr.a (mgr.14355) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:49 smithi131 bash[24745]: cluster 2024-09-14T02:18:47.877337+0000 mgr.a (mgr.14355) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:49 smithi171 bash[25040]: cluster 2024-09-14T02:18:47.877337+0000 mgr.a (mgr.14355) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:51.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:51.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:51.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:51 smithi007 bash[22722]: cluster 2024-09-14T02:18:49.878198+0000 mgr.a (mgr.14355) 10289 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:51 smithi131 bash[24745]: cluster 2024-09-14T02:18:49.878198+0000 mgr.a (mgr.14355) 10289 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:51 smithi171 bash[25040]: cluster 2024-09-14T02:18:49.878198+0000 mgr.a (mgr.14355) 10289 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:52.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:52.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:52.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:53 smithi007 bash[22722]: audit 2024-09-14T02:18:51.789660+0000 mgr.a (mgr.14355) 10290 : audit [DBG] from='client.227115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:53 smithi007 bash[22722]: cluster 2024-09-14T02:18:51.879671+0000 mgr.a (mgr.14355) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:53 smithi007 bash[22722]: audit 2024-09-14T02:18:52.816047+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:18:53.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:53 smithi131 bash[24745]: audit 2024-09-14T02:18:51.789660+0000 mgr.a (mgr.14355) 10290 : audit [DBG] from='client.227115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:53 smithi131 bash[24745]: cluster 2024-09-14T02:18:51.879671+0000 mgr.a (mgr.14355) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:53 smithi131 bash[24745]: audit 2024-09-14T02:18:52.816047+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:18:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:53 smithi171 bash[25040]: audit 2024-09-14T02:18:51.789660+0000 mgr.a (mgr.14355) 10290 : audit [DBG] from='client.227115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:53 smithi171 bash[25040]: cluster 2024-09-14T02:18:51.879671+0000 mgr.a (mgr.14355) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:53 smithi171 bash[25040]: audit 2024-09-14T02:18:52.816047+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:18:54.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22722]: audit 2024-09-14T02:18:53.665290+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:18:54.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22722]: audit 2024-09-14T02:18:53.666765+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:18:54.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22722]: audit 2024-09-14T02:18:53.674836+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:18:54.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22722]: audit 2024-09-14T02:18:53.677831+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:54 smithi131 bash[24745]: audit 2024-09-14T02:18:53.665290+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:18:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:54 smithi131 bash[24745]: audit 2024-09-14T02:18:53.666765+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:18:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:54 smithi131 bash[24745]: audit 2024-09-14T02:18:53.674836+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:18:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:54 smithi131 bash[24745]: audit 2024-09-14T02:18:53.677831+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:54 smithi171 bash[25040]: audit 2024-09-14T02:18:53.665290+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:18:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:54 smithi171 bash[25040]: audit 2024-09-14T02:18:53.666765+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:18:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:54 smithi171 bash[25040]: audit 2024-09-14T02:18:53.674836+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:18:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:54 smithi171 bash[25040]: audit 2024-09-14T02:18:53.677831+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:54.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22972]: debug 2024-09-14T02:18:54.412+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:18:54.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:18:54 smithi007 bash[22972]: debug 2024-09-14T02:18:54.412+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:18:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:55 smithi007 bash[22722]: audit 2024-09-14T02:18:53.679177+0000 mgr.a (mgr.14355) 10292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:55 smithi007 bash[22722]: cluster 2024-09-14T02:18:53.880149+0000 mgr.a (mgr.14355) 10293 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:55 smithi131 bash[24745]: audit 2024-09-14T02:18:53.679177+0000 mgr.a (mgr.14355) 10292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:55 smithi131 bash[24745]: cluster 2024-09-14T02:18:53.880149+0000 mgr.a (mgr.14355) 10293 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:55 smithi171 bash[25040]: audit 2024-09-14T02:18:53.679177+0000 mgr.a (mgr.14355) 10292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:18:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:55 smithi171 bash[25040]: cluster 2024-09-14T02:18:53.880149+0000 mgr.a (mgr.14355) 10293 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:18:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:56 smithi007 bash[22722]: audit 2024-09-14T02:18:54.414522+0000 mgr.a (mgr.14355) 10294 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:18:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:56 smithi007 bash[22722]: cephadm 2024-09-14T02:18:54.415862+0000 mgr.a (mgr.14355) 10295 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:18:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:56 smithi131 bash[24745]: audit 2024-09-14T02:18:54.414522+0000 mgr.a (mgr.14355) 10294 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:18:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:56 smithi131 bash[24745]: cephadm 2024-09-14T02:18:54.415862+0000 mgr.a (mgr.14355) 10295 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:18:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:56 smithi171 bash[25040]: audit 2024-09-14T02:18:54.414522+0000 mgr.a (mgr.14355) 10294 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:18:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:56 smithi171 bash[25040]: cephadm 2024-09-14T02:18:54.415862+0000 mgr.a (mgr.14355) 10295 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:18:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:18:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:18:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:18:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:57 smithi007 bash[22722]: cluster 2024-09-14T02:18:55.882412+0000 mgr.a (mgr.14355) 10296 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:57 smithi131 bash[24745]: cluster 2024-09-14T02:18:55.882412+0000 mgr.a (mgr.14355) 10296 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:57 smithi171 bash[25040]: cluster 2024-09-14T02:18:55.882412+0000 mgr.a (mgr.14355) 10296 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:57.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:18:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:18:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:18:57.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:18:57.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:18:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:59 smithi007 bash[22722]: audit 2024-09-14T02:18:57.561688+0000 mgr.a (mgr.14355) 10297 : audit [DBG] from='client.227298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:18:59 smithi007 bash[22722]: cluster 2024-09-14T02:18:57.882958+0000 mgr.a (mgr.14355) 10298 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:59 smithi131 bash[24745]: audit 2024-09-14T02:18:57.561688+0000 mgr.a (mgr.14355) 10297 : audit [DBG] from='client.227298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:18:59 smithi131 bash[24745]: cluster 2024-09-14T02:18:57.882958+0000 mgr.a (mgr.14355) 10298 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:18:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:59 smithi171 bash[25040]: audit 2024-09-14T02:18:57.561688+0000 mgr.a (mgr.14355) 10297 : audit [DBG] from='client.227298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:18:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:18:59 smithi171 bash[25040]: cluster 2024-09-14T02:18:57.882958+0000 mgr.a (mgr.14355) 10298 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:01 smithi007 bash[22722]: cluster 2024-09-14T02:18:59.883727+0000 mgr.a (mgr.14355) 10299 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:01 smithi131 bash[24745]: cluster 2024-09-14T02:18:59.883727+0000 mgr.a (mgr.14355) 10299 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:01 smithi171 bash[25040]: cluster 2024-09-14T02:18:59.883727+0000 mgr.a (mgr.14355) 10299 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:02.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:02.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:03 smithi007 bash[22722]: cluster 2024-09-14T02:19:01.885995+0000 mgr.a (mgr.14355) 10300 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:03 smithi131 bash[24745]: cluster 2024-09-14T02:19:01.885995+0000 mgr.a (mgr.14355) 10300 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:03 smithi171 bash[25040]: cluster 2024-09-14T02:19:01.885995+0000 mgr.a (mgr.14355) 10300 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:03.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:03.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:04 smithi007 bash[22722]: audit 2024-09-14T02:19:03.310572+0000 mgr.a (mgr.14355) 10301 : audit [DBG] from='client.227373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:04 smithi131 bash[24745]: audit 2024-09-14T02:19:03.310572+0000 mgr.a (mgr.14355) 10301 : audit [DBG] from='client.227373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:04 smithi171 bash[25040]: audit 2024-09-14T02:19:03.310572+0000 mgr.a (mgr.14355) 10301 : audit [DBG] from='client.227373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:05 smithi007 bash[22722]: cluster 2024-09-14T02:19:03.887004+0000 mgr.a (mgr.14355) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:05 smithi131 bash[24745]: cluster 2024-09-14T02:19:03.887004+0000 mgr.a (mgr.14355) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:05 smithi171 bash[25040]: cluster 2024-09-14T02:19:03.887004+0000 mgr.a (mgr.14355) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:07 smithi007 bash[22722]: cluster 2024-09-14T02:19:05.889195+0000 mgr.a (mgr.14355) 10303 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:07 smithi131 bash[24745]: cluster 2024-09-14T02:19:05.889195+0000 mgr.a (mgr.14355) 10303 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:07 smithi171 bash[25040]: cluster 2024-09-14T02:19:05.889195+0000 mgr.a (mgr.14355) 10303 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:19:08.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:08.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:09 smithi007 bash[22722]: cluster 2024-09-14T02:19:07.889953+0000 mgr.a (mgr.14355) 10304 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:09.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:09.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:09 smithi131 bash[24745]: cluster 2024-09-14T02:19:07.889953+0000 mgr.a (mgr.14355) 10304 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:09 smithi171 bash[25040]: cluster 2024-09-14T02:19:07.889953+0000 mgr.a (mgr.14355) 10304 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:10 smithi007 bash[22722]: audit 2024-09-14T02:19:09.065515+0000 mgr.a (mgr.14355) 10305 : audit [DBG] from='client.227448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:10 smithi131 bash[24745]: audit 2024-09-14T02:19:09.065515+0000 mgr.a (mgr.14355) 10305 : audit [DBG] from='client.227448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:10 smithi171 bash[25040]: audit 2024-09-14T02:19:09.065515+0000 mgr.a (mgr.14355) 10305 : audit [DBG] from='client.227448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:11 smithi007 bash[22722]: cluster 2024-09-14T02:19:09.890901+0000 mgr.a (mgr.14355) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:11.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:11 smithi131 bash[24745]: cluster 2024-09-14T02:19:09.890901+0000 mgr.a (mgr.14355) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:11 smithi171 bash[25040]: cluster 2024-09-14T02:19:09.890901+0000 mgr.a (mgr.14355) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:13.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:13 smithi007 bash[22722]: cluster 2024-09-14T02:19:11.893169+0000 mgr.a (mgr.14355) 10307 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:13 smithi131 bash[24745]: cluster 2024-09-14T02:19:11.893169+0000 mgr.a (mgr.14355) 10307 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:13 smithi171 bash[25040]: cluster 2024-09-14T02:19:11.893169+0000 mgr.a (mgr.14355) 10307 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:14.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:14.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:14.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:15.263 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:15.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:15 smithi007 bash[22722]: cluster 2024-09-14T02:19:13.893979+0000 mgr.a (mgr.14355) 10308 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:15 smithi131 bash[24745]: cluster 2024-09-14T02:19:13.893979+0000 mgr.a (mgr.14355) 10308 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:15 smithi171 bash[25040]: cluster 2024-09-14T02:19:13.893979+0000 mgr.a (mgr.14355) 10308 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:16 smithi007 bash[22722]: audit 2024-09-14T02:19:14.823018+0000 mgr.a (mgr.14355) 10309 : audit [DBG] from='client.227526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:16 smithi131 bash[24745]: audit 2024-09-14T02:19:14.823018+0000 mgr.a (mgr.14355) 10309 : audit [DBG] from='client.227526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:16 smithi171 bash[25040]: audit 2024-09-14T02:19:14.823018+0000 mgr.a (mgr.14355) 10309 : audit [DBG] from='client.227526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:17.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:17 smithi131 bash[24745]: cluster 2024-09-14T02:19:15.896540+0000 mgr.a (mgr.14355) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:17 smithi171 bash[25040]: cluster 2024-09-14T02:19:15.896540+0000 mgr.a (mgr.14355) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:17 smithi007 bash[22722]: cluster 2024-09-14T02:19:15.896540+0000 mgr.a (mgr.14355) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:19.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:19 smithi131 bash[24745]: cluster 2024-09-14T02:19:17.897518+0000 mgr.a (mgr.14355) 10311 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:19 smithi171 bash[25040]: cluster 2024-09-14T02:19:17.897518+0000 mgr.a (mgr.14355) 10311 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:19 smithi007 bash[22722]: cluster 2024-09-14T02:19:17.897518+0000 mgr.a (mgr.14355) 10311 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:20.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:20.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:20.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:21.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:21.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:21.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:21.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:21.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:21.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:21 smithi131 bash[24745]: cluster 2024-09-14T02:19:19.898359+0000 mgr.a (mgr.14355) 10312 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:21 smithi171 bash[25040]: cluster 2024-09-14T02:19:19.898359+0000 mgr.a (mgr.14355) 10312 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:21 smithi007 bash[22722]: cluster 2024-09-14T02:19:19.898359+0000 mgr.a (mgr.14355) 10312 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:22 smithi131 bash[24745]: audit 2024-09-14T02:19:20.599457+0000 mgr.a (mgr.14355) 10313 : audit [DBG] from='client.227601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:22 smithi171 bash[25040]: audit 2024-09-14T02:19:20.599457+0000 mgr.a (mgr.14355) 10313 : audit [DBG] from='client.227601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:22 smithi007 bash[22722]: audit 2024-09-14T02:19:20.599457+0000 mgr.a (mgr.14355) 10313 : audit [DBG] from='client.227601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:23 smithi131 bash[24745]: cluster 2024-09-14T02:19:21.901104+0000 mgr.a (mgr.14355) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:23 smithi171 bash[25040]: cluster 2024-09-14T02:19:21.901104+0000 mgr.a (mgr.14355) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:23 smithi007 bash[22722]: cluster 2024-09-14T02:19:21.901104+0000 mgr.a (mgr.14355) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:25 smithi131 bash[24745]: cluster 2024-09-14T02:19:23.901903+0000 mgr.a (mgr.14355) 10315 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:25 smithi171 bash[25040]: cluster 2024-09-14T02:19:23.901903+0000 mgr.a (mgr.14355) 10315 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:25 smithi007 bash[22722]: cluster 2024-09-14T02:19:23.901903+0000 mgr.a (mgr.14355) 10315 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:26.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:26.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:26.818 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:26.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:27 smithi131 bash[24745]: cluster 2024-09-14T02:19:25.903858+0000 mgr.a (mgr.14355) 10316 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:27 smithi171 bash[25040]: cluster 2024-09-14T02:19:25.903858+0000 mgr.a (mgr.14355) 10316 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:27 smithi007 bash[22722]: cluster 2024-09-14T02:19:25.903858+0000 mgr.a (mgr.14355) 10316 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:28 smithi131 bash[24745]: audit 2024-09-14T02:19:26.382080+0000 mgr.a (mgr.14355) 10317 : audit [DBG] from='client.227679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:28 smithi171 bash[25040]: audit 2024-09-14T02:19:26.382080+0000 mgr.a (mgr.14355) 10317 : audit [DBG] from='client.227679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:28 smithi007 bash[22722]: audit 2024-09-14T02:19:26.382080+0000 mgr.a (mgr.14355) 10317 : audit [DBG] from='client.227679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:29 smithi131 bash[24745]: cluster 2024-09-14T02:19:27.904816+0000 mgr.a (mgr.14355) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:29 smithi171 bash[25040]: cluster 2024-09-14T02:19:27.904816+0000 mgr.a (mgr.14355) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:29 smithi007 bash[22722]: cluster 2024-09-14T02:19:27.904816+0000 mgr.a (mgr.14355) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:31 smithi131 bash[24745]: cluster 2024-09-14T02:19:29.905595+0000 mgr.a (mgr.14355) 10319 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:19:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:31 smithi171 bash[25040]: cluster 2024-09-14T02:19:29.905595+0000 mgr.a (mgr.14355) 10319 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:19:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:31 smithi007 bash[22722]: cluster 2024-09-14T02:19:29.905595+0000 mgr.a (mgr.14355) 10319 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:19:31.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:31.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:32.579 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:32.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:33 smithi131 bash[24745]: cluster 2024-09-14T02:19:31.907832+0000 mgr.a (mgr.14355) 10320 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:33 smithi131 bash[24745]: audit 2024-09-14T02:19:32.149510+0000 mgr.a (mgr.14355) 10321 : audit [DBG] from='client.227754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:33 smithi171 bash[25040]: cluster 2024-09-14T02:19:31.907832+0000 mgr.a (mgr.14355) 10320 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:33 smithi171 bash[25040]: audit 2024-09-14T02:19:32.149510+0000 mgr.a (mgr.14355) 10321 : audit [DBG] from='client.227754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:33 smithi007 bash[22722]: cluster 2024-09-14T02:19:31.907832+0000 mgr.a (mgr.14355) 10320 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:33 smithi007 bash[22722]: audit 2024-09-14T02:19:32.149510+0000 mgr.a (mgr.14355) 10321 : audit [DBG] from='client.227754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:35 smithi131 bash[24745]: cluster 2024-09-14T02:19:33.908700+0000 mgr.a (mgr.14355) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:35 smithi171 bash[25040]: cluster 2024-09-14T02:19:33.908700+0000 mgr.a (mgr.14355) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:35 smithi007 bash[22722]: cluster 2024-09-14T02:19:33.908700+0000 mgr.a (mgr.14355) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:37 smithi131 bash[24745]: cluster 2024-09-14T02:19:35.910945+0000 mgr.a (mgr.14355) 10323 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:37 smithi171 bash[25040]: cluster 2024-09-14T02:19:35.910945+0000 mgr.a (mgr.14355) 10323 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:37 smithi007 bash[22722]: cluster 2024-09-14T02:19:35.910945+0000 mgr.a (mgr.14355) 10323 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:38.347 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:38.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:39 smithi131 bash[24745]: cluster 2024-09-14T02:19:37.911808+0000 mgr.a (mgr.14355) 10324 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:39 smithi131 bash[24745]: audit 2024-09-14T02:19:37.915030+0000 mgr.a (mgr.14355) 10325 : audit [DBG] from='client.227832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:39 smithi171 bash[25040]: cluster 2024-09-14T02:19:37.911808+0000 mgr.a (mgr.14355) 10324 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:39 smithi171 bash[25040]: audit 2024-09-14T02:19:37.915030+0000 mgr.a (mgr.14355) 10325 : audit [DBG] from='client.227832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:39 smithi007 bash[22722]: cluster 2024-09-14T02:19:37.911808+0000 mgr.a (mgr.14355) 10324 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:39 smithi007 bash[22722]: audit 2024-09-14T02:19:37.915030+0000 mgr.a (mgr.14355) 10325 : audit [DBG] from='client.227832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:41 smithi131 bash[24745]: cluster 2024-09-14T02:19:39.912687+0000 mgr.a (mgr.14355) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:41 smithi171 bash[25040]: cluster 2024-09-14T02:19:39.912687+0000 mgr.a (mgr.14355) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:41 smithi007 bash[22722]: cluster 2024-09-14T02:19:39.912687+0000 mgr.a (mgr.14355) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:43.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:43.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:43 smithi131 bash[24745]: cluster 2024-09-14T02:19:41.914945+0000 mgr.a (mgr.14355) 10327 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:43 smithi171 bash[25040]: cluster 2024-09-14T02:19:41.914945+0000 mgr.a (mgr.14355) 10327 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:43 smithi007 bash[22722]: cluster 2024-09-14T02:19:41.914945+0000 mgr.a (mgr.14355) 10327 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:44.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:44.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:44.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:44.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:44.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:45 smithi131 bash[24745]: audit 2024-09-14T02:19:43.682868+0000 mgr.a (mgr.14355) 10328 : audit [DBG] from='client.227907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:45 smithi131 bash[24745]: cluster 2024-09-14T02:19:43.916956+0000 mgr.a (mgr.14355) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:45 smithi171 bash[25040]: audit 2024-09-14T02:19:43.682868+0000 mgr.a (mgr.14355) 10328 : audit [DBG] from='client.227907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:45 smithi171 bash[25040]: cluster 2024-09-14T02:19:43.916956+0000 mgr.a (mgr.14355) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:45 smithi007 bash[22722]: audit 2024-09-14T02:19:43.682868+0000 mgr.a (mgr.14355) 10328 : audit [DBG] from='client.227907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:45 smithi007 bash[22722]: cluster 2024-09-14T02:19:43.916956+0000 mgr.a (mgr.14355) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:47 smithi131 bash[24745]: cluster 2024-09-14T02:19:45.919275+0000 mgr.a (mgr.14355) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:47 smithi171 bash[25040]: cluster 2024-09-14T02:19:45.919275+0000 mgr.a (mgr.14355) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:47 smithi007 bash[22722]: cluster 2024-09-14T02:19:45.919275+0000 mgr.a (mgr.14355) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:49.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:49.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:49 smithi171 bash[25040]: cluster 2024-09-14T02:19:47.920054+0000 mgr.a (mgr.14355) 10331 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:49 smithi007 bash[22722]: cluster 2024-09-14T02:19:47.920054+0000 mgr.a (mgr.14355) 10331 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:49 smithi131 bash[24745]: cluster 2024-09-14T02:19:47.920054+0000 mgr.a (mgr.14355) 10331 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:49.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:51 smithi171 bash[25040]: audit 2024-09-14T02:19:49.454153+0000 mgr.a (mgr.14355) 10332 : audit [DBG] from='client.227982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:51.992 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:51 smithi171 bash[25040]: cluster 2024-09-14T02:19:49.920656+0000 mgr.a (mgr.14355) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:51.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:51 smithi131 bash[24745]: audit 2024-09-14T02:19:49.454153+0000 mgr.a (mgr.14355) 10332 : audit [DBG] from='client.227982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:51.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:51 smithi131 bash[24745]: cluster 2024-09-14T02:19:49.920656+0000 mgr.a (mgr.14355) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:51.993 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:51 smithi007 bash[22722]: audit 2024-09-14T02:19:49.454153+0000 mgr.a (mgr.14355) 10332 : audit [DBG] from='client.227982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:51.993 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:51 smithi007 bash[22722]: cluster 2024-09-14T02:19:49.920656+0000 mgr.a (mgr.14355) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:53 smithi171 bash[25040]: cluster 2024-09-14T02:19:51.922919+0000 mgr.a (mgr.14355) 10334 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:53 smithi007 bash[22722]: cluster 2024-09-14T02:19:51.922919+0000 mgr.a (mgr.14355) 10334 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:53 smithi131 bash[24745]: cluster 2024-09-14T02:19:51.922919+0000 mgr.a (mgr.14355) 10334 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:19:54.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:19:54.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:19:54.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:19:55.644 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:19:55.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:19:55.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:19:55.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:19:55.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:19:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:55 smithi007 bash[22722]: cluster 2024-09-14T02:19:53.923680+0000 mgr.a (mgr.14355) 10335 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:55 smithi007 bash[22722]: audit 2024-09-14T02:19:54.465473+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:19:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:55 smithi131 bash[24745]: cluster 2024-09-14T02:19:53.923680+0000 mgr.a (mgr.14355) 10335 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:55 smithi131 bash[24745]: audit 2024-09-14T02:19:54.465473+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:19:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:55 smithi171 bash[25040]: cluster 2024-09-14T02:19:53.923680+0000 mgr.a (mgr.14355) 10335 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:55 smithi171 bash[25040]: audit 2024-09-14T02:19:54.465473+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:19:56.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22972]: debug 2024-09-14T02:19:56.327+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:19:56.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22972]: debug 2024-09-14T02:19:56.331+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:19:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.213570+0000 mgr.a (mgr.14355) 10336 : audit [DBG] from='client.228060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.320876+0000 mon.a (mon.0) 2137 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:19:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.321711+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:19:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.327006+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:19:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.328994+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:56 smithi007 bash[22722]: audit 2024-09-14T02:19:55.330051+0000 mgr.a (mgr.14355) 10337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.213570+0000 mgr.a (mgr.14355) 10336 : audit [DBG] from='client.228060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.320876+0000 mon.a (mon.0) 2137 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.321711+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.327006+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.328994+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:56 smithi131 bash[24745]: audit 2024-09-14T02:19:55.330051+0000 mgr.a (mgr.14355) 10337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.213570+0000 mgr.a (mgr.14355) 10336 : audit [DBG] from='client.228060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.320876+0000 mon.a (mon.0) 2137 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.321711+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.327006+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.328994+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:56 smithi171 bash[25040]: audit 2024-09-14T02:19:55.330051+0000 mgr.a (mgr.14355) 10337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:19:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:57 smithi007 bash[22722]: cluster 2024-09-14T02:19:55.933958+0000 mgr.a (mgr.14355) 10338 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:57 smithi007 bash[22722]: audit 2024-09-14T02:19:56.334022+0000 mgr.a (mgr.14355) 10339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:19:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:57 smithi007 bash[22722]: cephadm 2024-09-14T02:19:56.335216+0000 mgr.a (mgr.14355) 10340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:19:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:57 smithi131 bash[24745]: cluster 2024-09-14T02:19:55.933958+0000 mgr.a (mgr.14355) 10338 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:57 smithi131 bash[24745]: audit 2024-09-14T02:19:56.334022+0000 mgr.a (mgr.14355) 10339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:19:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:57 smithi131 bash[24745]: cephadm 2024-09-14T02:19:56.335216+0000 mgr.a (mgr.14355) 10340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:57 smithi171 bash[25040]: cluster 2024-09-14T02:19:55.933958+0000 mgr.a (mgr.14355) 10338 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:57 smithi171 bash[25040]: audit 2024-09-14T02:19:56.334022+0000 mgr.a (mgr.14355) 10339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:19:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:57 smithi171 bash[25040]: cephadm 2024-09-14T02:19:56.335216+0000 mgr.a (mgr.14355) 10340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:19:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:19:59 smithi007 bash[22722]: cluster 2024-09-14T02:19:57.934842+0000 mgr.a (mgr.14355) 10341 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:19:59 smithi131 bash[24745]: cluster 2024-09-14T02:19:57.934842+0000 mgr.a (mgr.14355) 10341 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:19:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:19:59 smithi171 bash[25040]: cluster 2024-09-14T02:19:57.934842+0000 mgr.a (mgr.14355) 10341 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:00.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:00.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:00.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:00 smithi007 bash[22722]: cluster 2024-09-14T02:20:00.000148+0000 mon.a (mon.0) 2141 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:20:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:00 smithi131 bash[24745]: cluster 2024-09-14T02:20:00.000148+0000 mon.a (mon.0) 2141 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:20:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:00 smithi171 bash[25040]: cluster 2024-09-14T02:20:00.000148+0000 mon.a (mon.0) 2141 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:20:01.409 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:01.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:01 smithi007 bash[22722]: cluster 2024-09-14T02:19:59.935650+0000 mgr.a (mgr.14355) 10342 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:01 smithi131 bash[24745]: cluster 2024-09-14T02:19:59.935650+0000 mgr.a (mgr.14355) 10342 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:01 smithi171 bash[25040]: cluster 2024-09-14T02:19:59.935650+0000 mgr.a (mgr.14355) 10342 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:02 smithi007 bash[22722]: audit 2024-09-14T02:20:00.978641+0000 mgr.a (mgr.14355) 10343 : audit [DBG] from='client.228243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:02 smithi131 bash[24745]: audit 2024-09-14T02:20:00.978641+0000 mgr.a (mgr.14355) 10343 : audit [DBG] from='client.228243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:02 smithi171 bash[25040]: audit 2024-09-14T02:20:00.978641+0000 mgr.a (mgr.14355) 10343 : audit [DBG] from='client.228243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:03 smithi007 bash[22722]: cluster 2024-09-14T02:20:01.938718+0000 mgr.a (mgr.14355) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:03 smithi131 bash[24745]: cluster 2024-09-14T02:20:01.938718+0000 mgr.a (mgr.14355) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:03 smithi171 bash[25040]: cluster 2024-09-14T02:20:01.938718+0000 mgr.a (mgr.14355) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:05 smithi007 bash[22722]: cluster 2024-09-14T02:20:03.939705+0000 mgr.a (mgr.14355) 10345 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:20:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:05 smithi131 bash[24745]: cluster 2024-09-14T02:20:03.939705+0000 mgr.a (mgr.14355) 10345 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:20:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:05 smithi171 bash[25040]: cluster 2024-09-14T02:20:03.939705+0000 mgr.a (mgr.14355) 10345 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:20:06.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:06.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:06 smithi007 bash[22722]: cluster 2024-09-14T02:20:05.941772+0000 mgr.a (mgr.14355) 10346 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:06 smithi131 bash[24745]: cluster 2024-09-14T02:20:05.941772+0000 mgr.a (mgr.14355) 10346 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:06 smithi171 bash[25040]: cluster 2024-09-14T02:20:05.941772+0000 mgr.a (mgr.14355) 10346 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:07.170 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:07 smithi007 bash[22722]: audit 2024-09-14T02:20:06.747986+0000 mgr.a (mgr.14355) 10347 : audit [DBG] from='client.228321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:07 smithi131 bash[24745]: audit 2024-09-14T02:20:06.747986+0000 mgr.a (mgr.14355) 10347 : audit [DBG] from='client.228321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:07 smithi171 bash[25040]: audit 2024-09-14T02:20:06.747986+0000 mgr.a (mgr.14355) 10347 : audit [DBG] from='client.228321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:08 smithi007 bash[22722]: cluster 2024-09-14T02:20:07.942728+0000 mgr.a (mgr.14355) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:08 smithi131 bash[24745]: cluster 2024-09-14T02:20:07.942728+0000 mgr.a (mgr.14355) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:08 smithi171 bash[25040]: cluster 2024-09-14T02:20:07.942728+0000 mgr.a (mgr.14355) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:11 smithi131 bash[24745]: cluster 2024-09-14T02:20:09.943500+0000 mgr.a (mgr.14355) 10349 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:11 smithi171 bash[25040]: cluster 2024-09-14T02:20:09.943500+0000 mgr.a (mgr.14355) 10349 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:11 smithi007 bash[22722]: cluster 2024-09-14T02:20:09.943500+0000 mgr.a (mgr.14355) 10349 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:12.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:12.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:12.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:12.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:13 smithi131 bash[24745]: cluster 2024-09-14T02:20:11.945902+0000 mgr.a (mgr.14355) 10350 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:13 smithi171 bash[25040]: cluster 2024-09-14T02:20:11.945902+0000 mgr.a (mgr.14355) 10350 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:13 smithi007 bash[22722]: cluster 2024-09-14T02:20:11.945902+0000 mgr.a (mgr.14355) 10350 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:20:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:14 smithi131 bash[24745]: audit 2024-09-14T02:20:12.503099+0000 mgr.a (mgr.14355) 10351 : audit [DBG] from='client.228396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:14 smithi171 bash[25040]: audit 2024-09-14T02:20:12.503099+0000 mgr.a (mgr.14355) 10351 : audit [DBG] from='client.228396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:14 smithi007 bash[22722]: audit 2024-09-14T02:20:12.503099+0000 mgr.a (mgr.14355) 10351 : audit [DBG] from='client.228396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:15.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:15 smithi131 bash[24745]: cluster 2024-09-14T02:20:13.946858+0000 mgr.a (mgr.14355) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:15 smithi171 bash[25040]: cluster 2024-09-14T02:20:13.946858+0000 mgr.a (mgr.14355) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:15 smithi007 bash[22722]: cluster 2024-09-14T02:20:13.946858+0000 mgr.a (mgr.14355) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:17.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:17 smithi131 bash[24745]: cluster 2024-09-14T02:20:15.949032+0000 mgr.a (mgr.14355) 10353 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:17 smithi171 bash[25040]: cluster 2024-09-14T02:20:15.949032+0000 mgr.a (mgr.14355) 10353 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:17 smithi007 bash[22722]: cluster 2024-09-14T02:20:15.949032+0000 mgr.a (mgr.14355) 10353 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:17.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:17.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:17.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:18.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:18.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:19 smithi131 bash[24745]: cluster 2024-09-14T02:20:17.949662+0000 mgr.a (mgr.14355) 10354 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:19 smithi131 bash[24745]: audit 2024-09-14T02:20:18.267575+0000 mgr.a (mgr.14355) 10355 : audit [DBG] from='client.228471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:19 smithi171 bash[25040]: cluster 2024-09-14T02:20:17.949662+0000 mgr.a (mgr.14355) 10354 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:19 smithi171 bash[25040]: audit 2024-09-14T02:20:18.267575+0000 mgr.a (mgr.14355) 10355 : audit [DBG] from='client.228471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:19 smithi007 bash[22722]: cluster 2024-09-14T02:20:17.949662+0000 mgr.a (mgr.14355) 10354 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:19 smithi007 bash[22722]: audit 2024-09-14T02:20:18.267575+0000 mgr.a (mgr.14355) 10355 : audit [DBG] from='client.228471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:21.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:21 smithi131 bash[24745]: cluster 2024-09-14T02:20:19.950547+0000 mgr.a (mgr.14355) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:21 smithi171 bash[25040]: cluster 2024-09-14T02:20:19.950547+0000 mgr.a (mgr.14355) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:21 smithi007 bash[22722]: cluster 2024-09-14T02:20:19.950547+0000 mgr.a (mgr.14355) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:23 smithi171 bash[25040]: cluster 2024-09-14T02:20:21.952776+0000 mgr.a (mgr.14355) 10357 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:23 smithi007 bash[22722]: cluster 2024-09-14T02:20:21.952776+0000 mgr.a (mgr.14355) 10357 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:23 smithi131 bash[24745]: cluster 2024-09-14T02:20:21.952776+0000 mgr.a (mgr.14355) 10357 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:24.469 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:24.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:24.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:24.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:24.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:25 smithi171 bash[25040]: cluster 2024-09-14T02:20:23.953511+0000 mgr.a (mgr.14355) 10358 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:25 smithi171 bash[25040]: audit 2024-09-14T02:20:24.044481+0000 mgr.a (mgr.14355) 10359 : audit [DBG] from='client.228543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:25 smithi007 bash[22722]: cluster 2024-09-14T02:20:23.953511+0000 mgr.a (mgr.14355) 10358 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:25 smithi007 bash[22722]: audit 2024-09-14T02:20:24.044481+0000 mgr.a (mgr.14355) 10359 : audit [DBG] from='client.228543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:25 smithi131 bash[24745]: cluster 2024-09-14T02:20:23.953511+0000 mgr.a (mgr.14355) 10358 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:25 smithi131 bash[24745]: audit 2024-09-14T02:20:24.044481+0000 mgr.a (mgr.14355) 10359 : audit [DBG] from='client.228543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:27 smithi171 bash[25040]: cluster 2024-09-14T02:20:25.955826+0000 mgr.a (mgr.14355) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:27 smithi007 bash[22722]: cluster 2024-09-14T02:20:25.955826+0000 mgr.a (mgr.14355) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:27.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:27 smithi131 bash[24745]: cluster 2024-09-14T02:20:25.955826+0000 mgr.a (mgr.14355) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:29 smithi007 bash[22722]: cluster 2024-09-14T02:20:27.956612+0000 mgr.a (mgr.14355) 10361 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:29 smithi131 bash[24745]: cluster 2024-09-14T02:20:27.956612+0000 mgr.a (mgr.14355) 10361 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:29 smithi171 bash[25040]: cluster 2024-09-14T02:20:27.956612+0000 mgr.a (mgr.14355) 10361 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:30.215 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:31 smithi007 bash[22722]: audit 2024-09-14T02:20:29.800034+0000 mgr.a (mgr.14355) 10362 : audit [DBG] from='client.228618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:31 smithi007 bash[22722]: cluster 2024-09-14T02:20:29.957276+0000 mgr.a (mgr.14355) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:31 smithi131 bash[24745]: audit 2024-09-14T02:20:29.800034+0000 mgr.a (mgr.14355) 10362 : audit [DBG] from='client.228618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:31 smithi131 bash[24745]: cluster 2024-09-14T02:20:29.957276+0000 mgr.a (mgr.14355) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:31 smithi171 bash[25040]: audit 2024-09-14T02:20:29.800034+0000 mgr.a (mgr.14355) 10362 : audit [DBG] from='client.228618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:31 smithi171 bash[25040]: cluster 2024-09-14T02:20:29.957276+0000 mgr.a (mgr.14355) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:33 smithi007 bash[22722]: cluster 2024-09-14T02:20:31.959780+0000 mgr.a (mgr.14355) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:33 smithi131 bash[24745]: cluster 2024-09-14T02:20:31.959780+0000 mgr.a (mgr.14355) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:33 smithi171 bash[25040]: cluster 2024-09-14T02:20:31.959780+0000 mgr.a (mgr.14355) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:35.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:35.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:35.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:35 smithi007 bash[22722]: cluster 2024-09-14T02:20:33.960595+0000 mgr.a (mgr.14355) 10365 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:35 smithi131 bash[24745]: cluster 2024-09-14T02:20:33.960595+0000 mgr.a (mgr.14355) 10365 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:35 smithi171 bash[25040]: cluster 2024-09-14T02:20:33.960595+0000 mgr.a (mgr.14355) 10365 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:35.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:37 smithi007 bash[22722]: audit 2024-09-14T02:20:35.550375+0000 mgr.a (mgr.14355) 10366 : audit [DBG] from='client.228696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:37 smithi007 bash[22722]: cluster 2024-09-14T02:20:35.961851+0000 mgr.a (mgr.14355) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:37 smithi131 bash[24745]: audit 2024-09-14T02:20:35.550375+0000 mgr.a (mgr.14355) 10366 : audit [DBG] from='client.228696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:37 smithi131 bash[24745]: cluster 2024-09-14T02:20:35.961851+0000 mgr.a (mgr.14355) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:37 smithi171 bash[25040]: audit 2024-09-14T02:20:35.550375+0000 mgr.a (mgr.14355) 10366 : audit [DBG] from='client.228696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:37 smithi171 bash[25040]: cluster 2024-09-14T02:20:35.961851+0000 mgr.a (mgr.14355) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:39 smithi007 bash[22722]: cluster 2024-09-14T02:20:37.962588+0000 mgr.a (mgr.14355) 10368 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:39.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:39 smithi131 bash[24745]: cluster 2024-09-14T02:20:37.962588+0000 mgr.a (mgr.14355) 10368 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:39 smithi171 bash[25040]: cluster 2024-09-14T02:20:37.962588+0000 mgr.a (mgr.14355) 10368 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:40.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:40.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:40.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:41 smithi007 bash[22722]: cluster 2024-09-14T02:20:39.963348+0000 mgr.a (mgr.14355) 10369 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:41.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:41 smithi131 bash[24745]: cluster 2024-09-14T02:20:39.963348+0000 mgr.a (mgr.14355) 10369 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:41 smithi171 bash[25040]: cluster 2024-09-14T02:20:39.963348+0000 mgr.a (mgr.14355) 10369 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:20:41.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:41.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:41.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:41.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:41.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:42 smithi007 bash[22722]: audit 2024-09-14T02:20:41.316799+0000 mgr.a (mgr.14355) 10370 : audit [DBG] from='client.228771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:42.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:42 smithi131 bash[24745]: audit 2024-09-14T02:20:41.316799+0000 mgr.a (mgr.14355) 10370 : audit [DBG] from='client.228771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:42 smithi171 bash[25040]: audit 2024-09-14T02:20:41.316799+0000 mgr.a (mgr.14355) 10370 : audit [DBG] from='client.228771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:43 smithi007 bash[22722]: cluster 2024-09-14T02:20:41.966360+0000 mgr.a (mgr.14355) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:43.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:43 smithi131 bash[24745]: cluster 2024-09-14T02:20:41.966360+0000 mgr.a (mgr.14355) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:43 smithi171 bash[25040]: cluster 2024-09-14T02:20:41.966360+0000 mgr.a (mgr.14355) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:45 smithi007 bash[22722]: cluster 2024-09-14T02:20:43.967188+0000 mgr.a (mgr.14355) 10372 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:45 smithi131 bash[24745]: cluster 2024-09-14T02:20:43.967188+0000 mgr.a (mgr.14355) 10372 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:45 smithi171 bash[25040]: cluster 2024-09-14T02:20:43.967188+0000 mgr.a (mgr.14355) 10372 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:20:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:46.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:47 smithi007 bash[22722]: cluster 2024-09-14T02:20:45.969171+0000 mgr.a (mgr.14355) 10373 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:47.532 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:47.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:47.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:47.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:47 smithi131 bash[24745]: cluster 2024-09-14T02:20:45.969171+0000 mgr.a (mgr.14355) 10373 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:47 smithi171 bash[25040]: cluster 2024-09-14T02:20:45.969171+0000 mgr.a (mgr.14355) 10373 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:48 smithi007 bash[22722]: audit 2024-09-14T02:20:47.101000+0000 mgr.a (mgr.14355) 10374 : audit [DBG] from='client.228843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:48 smithi131 bash[24745]: audit 2024-09-14T02:20:47.101000+0000 mgr.a (mgr.14355) 10374 : audit [DBG] from='client.228843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:48 smithi171 bash[25040]: audit 2024-09-14T02:20:47.101000+0000 mgr.a (mgr.14355) 10374 : audit [DBG] from='client.228843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:49 smithi007 bash[22722]: cluster 2024-09-14T02:20:47.970052+0000 mgr.a (mgr.14355) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:49 smithi131 bash[24745]: cluster 2024-09-14T02:20:47.970052+0000 mgr.a (mgr.14355) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:49 smithi171 bash[25040]: cluster 2024-09-14T02:20:47.970052+0000 mgr.a (mgr.14355) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:51 smithi007 bash[22722]: cluster 2024-09-14T02:20:49.971087+0000 mgr.a (mgr.14355) 10376 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:51 smithi131 bash[24745]: cluster 2024-09-14T02:20:49.971087+0000 mgr.a (mgr.14355) 10376 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:51 smithi171 bash[25040]: cluster 2024-09-14T02:20:49.971087+0000 mgr.a (mgr.14355) 10376 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:53.283 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:53.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:53.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:53.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:53.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:53 smithi007 bash[22722]: cluster 2024-09-14T02:20:51.973340+0000 mgr.a (mgr.14355) 10377 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:53.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:53 smithi131 bash[24745]: cluster 2024-09-14T02:20:51.973340+0000 mgr.a (mgr.14355) 10377 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:53 smithi171 bash[25040]: cluster 2024-09-14T02:20:51.973340+0000 mgr.a (mgr.14355) 10377 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:54 smithi007 bash[22722]: audit 2024-09-14T02:20:52.867344+0000 mgr.a (mgr.14355) 10378 : audit [DBG] from='client.228921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:54 smithi131 bash[24745]: audit 2024-09-14T02:20:52.867344+0000 mgr.a (mgr.14355) 10378 : audit [DBG] from='client.228921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:54 smithi171 bash[25040]: audit 2024-09-14T02:20:52.867344+0000 mgr.a (mgr.14355) 10378 : audit [DBG] from='client.228921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:20:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:55 smithi007 bash[22722]: cluster 2024-09-14T02:20:53.974224+0000 mgr.a (mgr.14355) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:55 smithi131 bash[24745]: cluster 2024-09-14T02:20:53.974224+0000 mgr.a (mgr.14355) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:55 smithi171 bash[25040]: cluster 2024-09-14T02:20:53.974224+0000 mgr.a (mgr.14355) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:57 smithi007 bash[22722]: cluster 2024-09-14T02:20:55.976446+0000 mgr.a (mgr.14355) 10380 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:57 smithi007 bash[22722]: audit 2024-09-14T02:20:56.384635+0000 mon.a (mon.0) 2142 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:20:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:57 smithi131 bash[24745]: cluster 2024-09-14T02:20:55.976446+0000 mgr.a (mgr.14355) 10380 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:57 smithi131 bash[24745]: audit 2024-09-14T02:20:56.384635+0000 mon.a (mon.0) 2142 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:20:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:57 smithi171 bash[25040]: cluster 2024-09-14T02:20:55.976446+0000 mgr.a (mgr.14355) 10380 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:20:57.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:57 smithi171 bash[25040]: audit 2024-09-14T02:20:56.384635+0000 mon.a (mon.0) 2142 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:20:58.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:20:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:20:58.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:20:58.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22972]: debug 2024-09-14T02:20:58.002+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:20:58.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22972]: debug 2024-09-14T02:20:58.002+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:20:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22722]: audit 2024-09-14T02:20:57.239701+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:20:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22722]: audit 2024-09-14T02:20:57.241470+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:20:58.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22722]: audit 2024-09-14T02:20:57.250010+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:20:58.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22722]: audit 2024-09-14T02:20:57.254859+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:58.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:58 smithi007 bash[22722]: audit 2024-09-14T02:20:57.257193+0000 mgr.a (mgr.14355) 10381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:58 smithi131 bash[24745]: audit 2024-09-14T02:20:57.239701+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:58 smithi131 bash[24745]: audit 2024-09-14T02:20:57.241470+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:58 smithi131 bash[24745]: audit 2024-09-14T02:20:57.250010+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:58 smithi131 bash[24745]: audit 2024-09-14T02:20:57.254859+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:58 smithi131 bash[24745]: audit 2024-09-14T02:20:57.257193+0000 mgr.a (mgr.14355) 10381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:58 smithi171 bash[25040]: audit 2024-09-14T02:20:57.239701+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:58 smithi171 bash[25040]: audit 2024-09-14T02:20:57.241470+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:58 smithi171 bash[25040]: audit 2024-09-14T02:20:57.250010+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:58 smithi171 bash[25040]: audit 2024-09-14T02:20:57.254859+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:58 smithi171 bash[25040]: audit 2024-09-14T02:20:57.257193+0000 mgr.a (mgr.14355) 10381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:20:59.017 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:20:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:20:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:20:59.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:20:59.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:20:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:59 smithi131 bash[24745]: cluster 2024-09-14T02:20:57.977037+0000 mgr.a (mgr.14355) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:59 smithi131 bash[24745]: audit 2024-09-14T02:20:58.003058+0000 mgr.a (mgr.14355) 10383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:20:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:20:59 smithi131 bash[24745]: cephadm 2024-09-14T02:20:58.004391+0000 mgr.a (mgr.14355) 10384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:20:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:59 smithi171 bash[25040]: cluster 2024-09-14T02:20:57.977037+0000 mgr.a (mgr.14355) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:59 smithi171 bash[25040]: audit 2024-09-14T02:20:58.003058+0000 mgr.a (mgr.14355) 10383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:20:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:20:59 smithi171 bash[25040]: cephadm 2024-09-14T02:20:58.004391+0000 mgr.a (mgr.14355) 10384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:20:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:59 smithi007 bash[22722]: cluster 2024-09-14T02:20:57.977037+0000 mgr.a (mgr.14355) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:20:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:59 smithi007 bash[22722]: audit 2024-09-14T02:20:58.003058+0000 mgr.a (mgr.14355) 10383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:20:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:20:59 smithi007 bash[22722]: cephadm 2024-09-14T02:20:58.004391+0000 mgr.a (mgr.14355) 10384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:21:00.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:00 smithi131 bash[24745]: audit 2024-09-14T02:20:58.603537+0000 mgr.a (mgr.14355) 10385 : audit [DBG] from='client.229107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:00 smithi171 bash[25040]: audit 2024-09-14T02:20:58.603537+0000 mgr.a (mgr.14355) 10385 : audit [DBG] from='client.229107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:00 smithi007 bash[22722]: audit 2024-09-14T02:20:58.603537+0000 mgr.a (mgr.14355) 10385 : audit [DBG] from='client.229107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:01 smithi131 bash[24745]: cluster 2024-09-14T02:20:59.977871+0000 mgr.a (mgr.14355) 10386 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:01 smithi171 bash[25040]: cluster 2024-09-14T02:20:59.977871+0000 mgr.a (mgr.14355) 10386 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:01 smithi007 bash[22722]: cluster 2024-09-14T02:20:59.977871+0000 mgr.a (mgr.14355) 10386 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:03.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:03 smithi131 bash[24745]: cluster 2024-09-14T02:21:01.980115+0000 mgr.a (mgr.14355) 10387 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:03 smithi171 bash[25040]: cluster 2024-09-14T02:21:01.980115+0000 mgr.a (mgr.14355) 10387 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:03 smithi007 bash[22722]: cluster 2024-09-14T02:21:01.980115+0000 mgr.a (mgr.14355) 10387 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:04.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:04.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:04.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:04.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:04.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:04.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:04.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:05 smithi131 bash[24745]: cluster 2024-09-14T02:21:03.980862+0000 mgr.a (mgr.14355) 10388 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:05 smithi131 bash[24745]: audit 2024-09-14T02:21:04.347580+0000 mgr.a (mgr.14355) 10389 : audit [DBG] from='client.229182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:05 smithi171 bash[25040]: cluster 2024-09-14T02:21:03.980862+0000 mgr.a (mgr.14355) 10388 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:05 smithi171 bash[25040]: audit 2024-09-14T02:21:04.347580+0000 mgr.a (mgr.14355) 10389 : audit [DBG] from='client.229182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:05 smithi007 bash[22722]: cluster 2024-09-14T02:21:03.980862+0000 mgr.a (mgr.14355) 10388 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:05 smithi007 bash[22722]: audit 2024-09-14T02:21:04.347580+0000 mgr.a (mgr.14355) 10389 : audit [DBG] from='client.229182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:07 smithi131 bash[24745]: cluster 2024-09-14T02:21:05.983304+0000 mgr.a (mgr.14355) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:07 smithi171 bash[25040]: cluster 2024-09-14T02:21:05.983304+0000 mgr.a (mgr.14355) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:07 smithi007 bash[22722]: cluster 2024-09-14T02:21:05.983304+0000 mgr.a (mgr.14355) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:09 smithi131 bash[24745]: cluster 2024-09-14T02:21:07.984264+0000 mgr.a (mgr.14355) 10391 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:09 smithi171 bash[25040]: cluster 2024-09-14T02:21:07.984264+0000 mgr.a (mgr.14355) 10391 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:09 smithi007 bash[22722]: cluster 2024-09-14T02:21:07.984264+0000 mgr.a (mgr.14355) 10391 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:09.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:09.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:09.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:10.520 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:11 smithi171 bash[25040]: cluster 2024-09-14T02:21:09.984791+0000 mgr.a (mgr.14355) 10392 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:11 smithi171 bash[25040]: audit 2024-09-14T02:21:10.097243+0000 mgr.a (mgr.14355) 10393 : audit [DBG] from='client.229257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:11 smithi007 bash[22722]: cluster 2024-09-14T02:21:09.984791+0000 mgr.a (mgr.14355) 10392 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:11 smithi007 bash[22722]: audit 2024-09-14T02:21:10.097243+0000 mgr.a (mgr.14355) 10393 : audit [DBG] from='client.229257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:11 smithi131 bash[24745]: cluster 2024-09-14T02:21:09.984791+0000 mgr.a (mgr.14355) 10392 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:11 smithi131 bash[24745]: audit 2024-09-14T02:21:10.097243+0000 mgr.a (mgr.14355) 10393 : audit [DBG] from='client.229257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:13 smithi171 bash[25040]: cluster 2024-09-14T02:21:11.987508+0000 mgr.a (mgr.14355) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:13 smithi007 bash[22722]: cluster 2024-09-14T02:21:11.987508+0000 mgr.a (mgr.14355) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:13 smithi131 bash[24745]: cluster 2024-09-14T02:21:11.987508+0000 mgr.a (mgr.14355) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:21:15.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:15.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:15 smithi171 bash[25040]: cluster 2024-09-14T02:21:13.988287+0000 mgr.a (mgr.14355) 10395 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:21:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:15 smithi007 bash[22722]: cluster 2024-09-14T02:21:13.988287+0000 mgr.a (mgr.14355) 10395 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:21:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:15 smithi131 bash[24745]: cluster 2024-09-14T02:21:13.988287+0000 mgr.a (mgr.14355) 10395 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:21:16.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:16.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:16.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:16.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:16.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:17 smithi007 bash[22722]: audit 2024-09-14T02:21:15.853179+0000 mgr.a (mgr.14355) 10396 : audit [DBG] from='client.229335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:17 smithi007 bash[22722]: cluster 2024-09-14T02:21:15.989653+0000 mgr.a (mgr.14355) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:17 smithi131 bash[24745]: audit 2024-09-14T02:21:15.853179+0000 mgr.a (mgr.14355) 10396 : audit [DBG] from='client.229335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:17 smithi131 bash[24745]: cluster 2024-09-14T02:21:15.989653+0000 mgr.a (mgr.14355) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:17 smithi171 bash[25040]: audit 2024-09-14T02:21:15.853179+0000 mgr.a (mgr.14355) 10396 : audit [DBG] from='client.229335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:17 smithi171 bash[25040]: cluster 2024-09-14T02:21:15.989653+0000 mgr.a (mgr.14355) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:19 smithi007 bash[22722]: cluster 2024-09-14T02:21:17.990520+0000 mgr.a (mgr.14355) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:19 smithi131 bash[24745]: cluster 2024-09-14T02:21:17.990520+0000 mgr.a (mgr.14355) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:19 smithi171 bash[25040]: cluster 2024-09-14T02:21:17.990520+0000 mgr.a (mgr.14355) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:21 smithi007 bash[22722]: cluster 2024-09-14T02:21:19.991281+0000 mgr.a (mgr.14355) 10399 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:21:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:21 smithi131 bash[24745]: cluster 2024-09-14T02:21:19.991281+0000 mgr.a (mgr.14355) 10399 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:21:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:21 smithi171 bash[25040]: cluster 2024-09-14T02:21:19.991281+0000 mgr.a (mgr.14355) 10399 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:21:22.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:22.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:23 smithi007 bash[22722]: audit 2024-09-14T02:21:21.602777+0000 mgr.a (mgr.14355) 10400 : audit [DBG] from='client.229413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:23 smithi007 bash[22722]: cluster 2024-09-14T02:21:21.992474+0000 mgr.a (mgr.14355) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:23 smithi131 bash[24745]: audit 2024-09-14T02:21:21.602777+0000 mgr.a (mgr.14355) 10400 : audit [DBG] from='client.229413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:23 smithi131 bash[24745]: cluster 2024-09-14T02:21:21.992474+0000 mgr.a (mgr.14355) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:23 smithi171 bash[25040]: audit 2024-09-14T02:21:21.602777+0000 mgr.a (mgr.14355) 10400 : audit [DBG] from='client.229413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:23 smithi171 bash[25040]: cluster 2024-09-14T02:21:21.992474+0000 mgr.a (mgr.14355) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:25 smithi007 bash[22722]: cluster 2024-09-14T02:21:23.993202+0000 mgr.a (mgr.14355) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:21:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:25 smithi131 bash[24745]: cluster 2024-09-14T02:21:23.993202+0000 mgr.a (mgr.14355) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:21:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:25 smithi171 bash[25040]: cluster 2024-09-14T02:21:23.993202+0000 mgr.a (mgr.14355) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:21:27.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:27.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:27.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:27 smithi007 bash[22722]: cluster 2024-09-14T02:21:25.995147+0000 mgr.a (mgr.14355) 10403 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:21:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:27 smithi131 bash[24745]: cluster 2024-09-14T02:21:25.995147+0000 mgr.a (mgr.14355) 10403 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:21:27.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:27.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:27.784 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:27 smithi171 bash[25040]: cluster 2024-09-14T02:21:25.995147+0000 mgr.a (mgr.14355) 10403 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:21:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:28 smithi007 bash[22722]: audit 2024-09-14T02:21:27.357269+0000 mgr.a (mgr.14355) 10404 : audit [DBG] from='client.229491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:28 smithi131 bash[24745]: audit 2024-09-14T02:21:27.357269+0000 mgr.a (mgr.14355) 10404 : audit [DBG] from='client.229491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:28 smithi171 bash[25040]: audit 2024-09-14T02:21:27.357269+0000 mgr.a (mgr.14355) 10404 : audit [DBG] from='client.229491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:29 smithi007 bash[22722]: cluster 2024-09-14T02:21:27.995991+0000 mgr.a (mgr.14355) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:29 smithi131 bash[24745]: cluster 2024-09-14T02:21:27.995991+0000 mgr.a (mgr.14355) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:29 smithi171 bash[25040]: cluster 2024-09-14T02:21:27.995991+0000 mgr.a (mgr.14355) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:31 smithi007 bash[22722]: cluster 2024-09-14T02:21:29.996765+0000 mgr.a (mgr.14355) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:31 smithi131 bash[24745]: cluster 2024-09-14T02:21:29.996765+0000 mgr.a (mgr.14355) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:31 smithi171 bash[25040]: cluster 2024-09-14T02:21:29.996765+0000 mgr.a (mgr.14355) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:32.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:32.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:33.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:33.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:33 smithi007 bash[22722]: cluster 2024-09-14T02:21:31.998986+0000 mgr.a (mgr.14355) 10407 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:33 smithi131 bash[24745]: cluster 2024-09-14T02:21:31.998986+0000 mgr.a (mgr.14355) 10407 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:33 smithi171 bash[25040]: cluster 2024-09-14T02:21:31.998986+0000 mgr.a (mgr.14355) 10407 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:34 smithi007 bash[22722]: audit 2024-09-14T02:21:33.117765+0000 mgr.a (mgr.14355) 10408 : audit [DBG] from='client.229569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:34 smithi131 bash[24745]: audit 2024-09-14T02:21:33.117765+0000 mgr.a (mgr.14355) 10408 : audit [DBG] from='client.229569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:34 smithi171 bash[25040]: audit 2024-09-14T02:21:33.117765+0000 mgr.a (mgr.14355) 10408 : audit [DBG] from='client.229569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:35 smithi007 bash[22722]: cluster 2024-09-14T02:21:33.999847+0000 mgr.a (mgr.14355) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:35 smithi131 bash[24745]: cluster 2024-09-14T02:21:33.999847+0000 mgr.a (mgr.14355) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:35 smithi171 bash[25040]: cluster 2024-09-14T02:21:33.999847+0000 mgr.a (mgr.14355) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:37 smithi007 bash[22722]: cluster 2024-09-14T02:21:36.002111+0000 mgr.a (mgr.14355) 10410 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:37 smithi131 bash[24745]: cluster 2024-09-14T02:21:36.002111+0000 mgr.a (mgr.14355) 10410 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:37 smithi171 bash[25040]: cluster 2024-09-14T02:21:36.002111+0000 mgr.a (mgr.14355) 10410 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:39.306 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:39.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:39.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:39.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:39.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:39 smithi007 bash[22722]: cluster 2024-09-14T02:21:38.002870+0000 mgr.a (mgr.14355) 10411 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:39 smithi131 bash[24745]: cluster 2024-09-14T02:21:38.002870+0000 mgr.a (mgr.14355) 10411 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:39 smithi171 bash[25040]: cluster 2024-09-14T02:21:38.002870+0000 mgr.a (mgr.14355) 10411 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:40 smithi007 bash[22722]: audit 2024-09-14T02:21:38.870269+0000 mgr.a (mgr.14355) 10412 : audit [DBG] from='client.229644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:40 smithi131 bash[24745]: audit 2024-09-14T02:21:38.870269+0000 mgr.a (mgr.14355) 10412 : audit [DBG] from='client.229644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:40 smithi171 bash[25040]: audit 2024-09-14T02:21:38.870269+0000 mgr.a (mgr.14355) 10412 : audit [DBG] from='client.229644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:41 smithi007 bash[22722]: cluster 2024-09-14T02:21:40.003707+0000 mgr.a (mgr.14355) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:41 smithi131 bash[24745]: cluster 2024-09-14T02:21:40.003707+0000 mgr.a (mgr.14355) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:41 smithi171 bash[25040]: cluster 2024-09-14T02:21:40.003707+0000 mgr.a (mgr.14355) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:43 smithi007 bash[22722]: cluster 2024-09-14T02:21:42.005975+0000 mgr.a (mgr.14355) 10414 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:43 smithi131 bash[24745]: cluster 2024-09-14T02:21:42.005975+0000 mgr.a (mgr.14355) 10414 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:43 smithi171 bash[25040]: cluster 2024-09-14T02:21:42.005975+0000 mgr.a (mgr.14355) 10414 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:44.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:45.050 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:45.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:45.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:45 smithi007 bash[22722]: cluster 2024-09-14T02:21:44.006792+0000 mgr.a (mgr.14355) 10415 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:45 smithi131 bash[24745]: cluster 2024-09-14T02:21:44.006792+0000 mgr.a (mgr.14355) 10415 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:45 smithi171 bash[25040]: cluster 2024-09-14T02:21:44.006792+0000 mgr.a (mgr.14355) 10415 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:46 smithi007 bash[22722]: audit 2024-09-14T02:21:44.637896+0000 mgr.a (mgr.14355) 10416 : audit [DBG] from='client.229722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:46 smithi131 bash[24745]: audit 2024-09-14T02:21:44.637896+0000 mgr.a (mgr.14355) 10416 : audit [DBG] from='client.229722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:46 smithi171 bash[25040]: audit 2024-09-14T02:21:44.637896+0000 mgr.a (mgr.14355) 10416 : audit [DBG] from='client.229722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:47 smithi007 bash[22722]: cluster 2024-09-14T02:21:46.009245+0000 mgr.a (mgr.14355) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:47 smithi131 bash[24745]: cluster 2024-09-14T02:21:46.009245+0000 mgr.a (mgr.14355) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:47 smithi171 bash[25040]: cluster 2024-09-14T02:21:46.009245+0000 mgr.a (mgr.14355) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:21:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:48 smithi007 bash[22722]: cluster 2024-09-14T02:21:48.010024+0000 mgr.a (mgr.14355) 10418 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:48 smithi131 bash[24745]: cluster 2024-09-14T02:21:48.010024+0000 mgr.a (mgr.14355) 10418 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:48 smithi171 bash[25040]: cluster 2024-09-14T02:21:48.010024+0000 mgr.a (mgr.14355) 10418 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:50.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:50.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:50.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:50.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:50.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:51 smithi007 bash[22722]: cluster 2024-09-14T02:21:50.010803+0000 mgr.a (mgr.14355) 10419 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:51 smithi007 bash[22722]: audit 2024-09-14T02:21:50.383089+0000 mgr.a (mgr.14355) 10420 : audit [DBG] from='client.229797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:51.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:51 smithi131 bash[24745]: cluster 2024-09-14T02:21:50.010803+0000 mgr.a (mgr.14355) 10419 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:51 smithi131 bash[24745]: audit 2024-09-14T02:21:50.383089+0000 mgr.a (mgr.14355) 10420 : audit [DBG] from='client.229797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:51 smithi171 bash[25040]: cluster 2024-09-14T02:21:50.010803+0000 mgr.a (mgr.14355) 10419 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:51 smithi171 bash[25040]: audit 2024-09-14T02:21:50.383089+0000 mgr.a (mgr.14355) 10420 : audit [DBG] from='client.229797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:53 smithi007 bash[22722]: cluster 2024-09-14T02:21:52.013598+0000 mgr.a (mgr.14355) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:53.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:53 smithi131 bash[24745]: cluster 2024-09-14T02:21:52.013598+0000 mgr.a (mgr.14355) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:53 smithi171 bash[25040]: cluster 2024-09-14T02:21:52.013598+0000 mgr.a (mgr.14355) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:55 smithi007 bash[22722]: cluster 2024-09-14T02:21:54.014412+0000 mgr.a (mgr.14355) 10422 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:55.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:55 smithi131 bash[24745]: cluster 2024-09-14T02:21:54.014412+0000 mgr.a (mgr.14355) 10422 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:55 smithi171 bash[25040]: cluster 2024-09-14T02:21:54.014412+0000 mgr.a (mgr.14355) 10422 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:55.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:21:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:21:55.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:21:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:21:56.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:21:56.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:21:56.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:21:56.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:21:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:57 smithi007 bash[22722]: cluster 2024-09-14T02:21:56.016382+0000 mgr.a (mgr.14355) 10423 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:57 smithi007 bash[22722]: audit 2024-09-14T02:21:56.126971+0000 mgr.a (mgr.14355) 10424 : audit [DBG] from='client.229875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:57 smithi131 bash[24745]: cluster 2024-09-14T02:21:56.016382+0000 mgr.a (mgr.14355) 10423 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:57 smithi131 bash[24745]: audit 2024-09-14T02:21:56.126971+0000 mgr.a (mgr.14355) 10424 : audit [DBG] from='client.229875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:57 smithi171 bash[25040]: cluster 2024-09-14T02:21:56.016382+0000 mgr.a (mgr.14355) 10423 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:21:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:57 smithi171 bash[25040]: audit 2024-09-14T02:21:56.126971+0000 mgr.a (mgr.14355) 10424 : audit [DBG] from='client.229875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:21:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:58 smithi007 bash[22722]: audit 2024-09-14T02:21:58.056187+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:21:58.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:58 smithi131 bash[24745]: audit 2024-09-14T02:21:58.056187+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:21:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:58 smithi171 bash[25040]: audit 2024-09-14T02:21:58.056187+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:21:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:21:59 smithi007 bash[22722]: cluster 2024-09-14T02:21:58.017369+0000 mgr.a (mgr.14355) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:21:59 smithi131 bash[24745]: cluster 2024-09-14T02:21:58.017369+0000 mgr.a (mgr.14355) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:21:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:21:59 smithi171 bash[25040]: cluster 2024-09-14T02:21:58.017369+0000 mgr.a (mgr.14355) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:01 smithi007 bash[22722]: cluster 2024-09-14T02:22:00.018190+0000 mgr.a (mgr.14355) 10426 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:01.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:01 smithi131 bash[24745]: cluster 2024-09-14T02:22:00.018190+0000 mgr.a (mgr.14355) 10426 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:01.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:01.544 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:01 smithi171 bash[25040]: cluster 2024-09-14T02:22:00.018190+0000 mgr.a (mgr.14355) 10426 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:02.329 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:02.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:03 smithi007 bash[22722]: audit 2024-09-14T02:22:01.876420+0000 mgr.a (mgr.14355) 10427 : audit [DBG] from='client.229953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:03 smithi007 bash[22722]: cluster 2024-09-14T02:22:02.027887+0000 mgr.a (mgr.14355) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:03 smithi131 bash[24745]: audit 2024-09-14T02:22:01.876420+0000 mgr.a (mgr.14355) 10427 : audit [DBG] from='client.229953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:03 smithi131 bash[24745]: cluster 2024-09-14T02:22:02.027887+0000 mgr.a (mgr.14355) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:03 smithi171 bash[25040]: audit 2024-09-14T02:22:01.876420+0000 mgr.a (mgr.14355) 10427 : audit [DBG] from='client.229953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:03 smithi171 bash[25040]: cluster 2024-09-14T02:22:02.027887+0000 mgr.a (mgr.14355) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:05.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:05 smithi007 bash[22722]: cluster 2024-09-14T02:22:04.028955+0000 mgr.a (mgr.14355) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:05 smithi131 bash[24745]: cluster 2024-09-14T02:22:04.028955+0000 mgr.a (mgr.14355) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:05 smithi171 bash[25040]: cluster 2024-09-14T02:22:04.028955+0000 mgr.a (mgr.14355) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:07 smithi007 bash[22722]: cluster 2024-09-14T02:22:06.031347+0000 mgr.a (mgr.14355) 10430 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T02:22:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:07.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:07 smithi131 bash[24745]: cluster 2024-09-14T02:22:06.031347+0000 mgr.a (mgr.14355) 10430 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T02:22:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:07 smithi171 bash[25040]: cluster 2024-09-14T02:22:06.031347+0000 mgr.a (mgr.14355) 10430 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T02:22:08.050 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:07.641368+0000 mgr.a (mgr.14355) 10431 : audit [DBG] from='client.230031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: cluster 2024-09-14T02:22:08.031970+0000 mgr.a (mgr.14355) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.699390+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.707755+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.709874+0000 mon.a (mon.0) 2150 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:22:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.712048+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:22:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.723182+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22722]: audit 2024-09-14T02:22:08.728596+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:07.641368+0000 mgr.a (mgr.14355) 10431 : audit [DBG] from='client.230031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: cluster 2024-09-14T02:22:08.031970+0000 mgr.a (mgr.14355) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.699390+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.707755+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.709874+0000 mon.a (mon.0) 2150 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:22:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.712048+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:22:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.723182+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:09 smithi131 bash[24745]: audit 2024-09-14T02:22:08.728596+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:07.641368+0000 mgr.a (mgr.14355) 10431 : audit [DBG] from='client.230031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: cluster 2024-09-14T02:22:08.031970+0000 mgr.a (mgr.14355) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.699390+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.707755+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.709874+0000 mon.a (mon.0) 2150 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.712048+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.723182+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:22:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:09 smithi171 bash[25040]: audit 2024-09-14T02:22:08.728596+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:09.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22972]: debug 2024-09-14T02:22:09.461+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:22:09.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:22:09 smithi007 bash[22972]: debug 2024-09-14T02:22:09.461+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:22:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:10 smithi007 bash[22722]: audit 2024-09-14T02:22:08.731201+0000 mgr.a (mgr.14355) 10433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:10.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:10 smithi131 bash[24745]: audit 2024-09-14T02:22:08.731201+0000 mgr.a (mgr.14355) 10433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:10 smithi171 bash[25040]: audit 2024-09-14T02:22:08.731201+0000 mgr.a (mgr.14355) 10433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:22:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:11 smithi007 bash[22722]: audit 2024-09-14T02:22:09.464793+0000 mgr.a (mgr.14355) 10434 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:22:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:11 smithi007 bash[22722]: cephadm 2024-09-14T02:22:09.465981+0000 mgr.a (mgr.14355) 10435 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:22:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:11 smithi007 bash[22722]: cluster 2024-09-14T02:22:10.032784+0000 mgr.a (mgr.14355) 10436 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:11 smithi131 bash[24745]: audit 2024-09-14T02:22:09.464793+0000 mgr.a (mgr.14355) 10434 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:22:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:11 smithi131 bash[24745]: cephadm 2024-09-14T02:22:09.465981+0000 mgr.a (mgr.14355) 10435 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:22:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:11 smithi131 bash[24745]: cluster 2024-09-14T02:22:10.032784+0000 mgr.a (mgr.14355) 10436 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:11 smithi171 bash[25040]: audit 2024-09-14T02:22:09.464793+0000 mgr.a (mgr.14355) 10434 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:22:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:11 smithi171 bash[25040]: cephadm 2024-09-14T02:22:09.465981+0000 mgr.a (mgr.14355) 10435 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:22:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:11 smithi171 bash[25040]: cluster 2024-09-14T02:22:10.032784+0000 mgr.a (mgr.14355) 10436 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T02:22:13.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:13.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:13 smithi007 bash[22722]: cluster 2024-09-14T02:22:12.035085+0000 mgr.a (mgr.14355) 10437 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T02:22:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:13 smithi131 bash[24745]: cluster 2024-09-14T02:22:12.035085+0000 mgr.a (mgr.14355) 10437 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T02:22:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:13 smithi171 bash[25040]: cluster 2024-09-14T02:22:12.035085+0000 mgr.a (mgr.14355) 10437 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T02:22:13.834 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:13.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:14 smithi007 bash[22722]: audit 2024-09-14T02:22:13.390512+0000 mgr.a (mgr.14355) 10438 : audit [DBG] from='client.230217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:14 smithi131 bash[24745]: audit 2024-09-14T02:22:13.390512+0000 mgr.a (mgr.14355) 10438 : audit [DBG] from='client.230217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:14 smithi171 bash[25040]: audit 2024-09-14T02:22:13.390512+0000 mgr.a (mgr.14355) 10438 : audit [DBG] from='client.230217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:15 smithi007 bash[22722]: cluster 2024-09-14T02:22:14.036075+0000 mgr.a (mgr.14355) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:22:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:15 smithi131 bash[24745]: cluster 2024-09-14T02:22:14.036075+0000 mgr.a (mgr.14355) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:22:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:15 smithi171 bash[25040]: cluster 2024-09-14T02:22:14.036075+0000 mgr.a (mgr.14355) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:22:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:17 smithi007 bash[22722]: cluster 2024-09-14T02:22:16.038353+0000 mgr.a (mgr.14355) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:17 smithi131 bash[24745]: cluster 2024-09-14T02:22:16.038353+0000 mgr.a (mgr.14355) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:17 smithi171 bash[25040]: cluster 2024-09-14T02:22:16.038353+0000 mgr.a (mgr.14355) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:19.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:19 smithi007 bash[22722]: cluster 2024-09-14T02:22:18.039083+0000 mgr.a (mgr.14355) 10441 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:19.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:19 smithi131 bash[24745]: cluster 2024-09-14T02:22:18.039083+0000 mgr.a (mgr.14355) 10441 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:19 smithi171 bash[25040]: cluster 2024-09-14T02:22:18.039083+0000 mgr.a (mgr.14355) 10441 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:19.607 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:19.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:19.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:19.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:19.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:20 smithi007 bash[22722]: audit 2024-09-14T02:22:19.175502+0000 mgr.a (mgr.14355) 10442 : audit [DBG] from='client.230295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:20.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:20 smithi131 bash[24745]: audit 2024-09-14T02:22:19.175502+0000 mgr.a (mgr.14355) 10442 : audit [DBG] from='client.230295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:20 smithi171 bash[25040]: audit 2024-09-14T02:22:19.175502+0000 mgr.a (mgr.14355) 10442 : audit [DBG] from='client.230295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:21 smithi007 bash[22722]: cluster 2024-09-14T02:22:20.040053+0000 mgr.a (mgr.14355) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:21 smithi131 bash[24745]: cluster 2024-09-14T02:22:20.040053+0000 mgr.a (mgr.14355) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:21 smithi171 bash[25040]: cluster 2024-09-14T02:22:20.040053+0000 mgr.a (mgr.14355) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T02:22:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:23 smithi007 bash[22722]: cluster 2024-09-14T02:22:22.042316+0000 mgr.a (mgr.14355) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:23 smithi131 bash[24745]: cluster 2024-09-14T02:22:22.042316+0000 mgr.a (mgr.14355) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:23 smithi171 bash[25040]: cluster 2024-09-14T02:22:22.042316+0000 mgr.a (mgr.14355) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T02:22:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:24.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:24.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:25.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:25.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:25.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:25 smithi007 bash[22722]: cluster 2024-09-14T02:22:24.043113+0000 mgr.a (mgr.14355) 10445 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:25 smithi131 bash[24745]: cluster 2024-09-14T02:22:24.043113+0000 mgr.a (mgr.14355) 10445 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:25 smithi171 bash[25040]: cluster 2024-09-14T02:22:24.043113+0000 mgr.a (mgr.14355) 10445 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:26 smithi131 bash[24745]: audit 2024-09-14T02:22:24.950207+0000 mgr.a (mgr.14355) 10446 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:26 smithi171 bash[25040]: audit 2024-09-14T02:22:24.950207+0000 mgr.a (mgr.14355) 10446 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:26 smithi007 bash[22722]: audit 2024-09-14T02:22:24.950207+0000 mgr.a (mgr.14355) 10446 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:27.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:27 smithi131 bash[24745]: cluster 2024-09-14T02:22:26.045992+0000 mgr.a (mgr.14355) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:27 smithi171 bash[25040]: cluster 2024-09-14T02:22:26.045992+0000 mgr.a (mgr.14355) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:27 smithi007 bash[22722]: cluster 2024-09-14T02:22:26.045992+0000 mgr.a (mgr.14355) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:22:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:29 smithi131 bash[24745]: cluster 2024-09-14T02:22:28.046790+0000 mgr.a (mgr.14355) 10448 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:29 smithi171 bash[25040]: cluster 2024-09-14T02:22:28.046790+0000 mgr.a (mgr.14355) 10448 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:29 smithi007 bash[22722]: cluster 2024-09-14T02:22:28.046790+0000 mgr.a (mgr.14355) 10448 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:30.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:31.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:31.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:31.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:31 smithi131 bash[24745]: cluster 2024-09-14T02:22:30.047546+0000 mgr.a (mgr.14355) 10449 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:31 smithi171 bash[25040]: cluster 2024-09-14T02:22:30.047546+0000 mgr.a (mgr.14355) 10449 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:31 smithi007 bash[22722]: cluster 2024-09-14T02:22:30.047546+0000 mgr.a (mgr.14355) 10449 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:22:32.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:32 smithi131 bash[24745]: audit 2024-09-14T02:22:30.733249+0000 mgr.a (mgr.14355) 10450 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:32 smithi171 bash[25040]: audit 2024-09-14T02:22:30.733249+0000 mgr.a (mgr.14355) 10450 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:32 smithi007 bash[22722]: audit 2024-09-14T02:22:30.733249+0000 mgr.a (mgr.14355) 10450 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:33 smithi131 bash[24745]: cluster 2024-09-14T02:22:32.050463+0000 mgr.a (mgr.14355) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:33 smithi171 bash[25040]: cluster 2024-09-14T02:22:32.050463+0000 mgr.a (mgr.14355) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:33 smithi007 bash[22722]: cluster 2024-09-14T02:22:32.050463+0000 mgr.a (mgr.14355) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:35 smithi131 bash[24745]: cluster 2024-09-14T02:22:34.051192+0000 mgr.a (mgr.14355) 10452 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:35 smithi171 bash[25040]: cluster 2024-09-14T02:22:34.051192+0000 mgr.a (mgr.14355) 10452 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:35 smithi007 bash[22722]: cluster 2024-09-14T02:22:34.051192+0000 mgr.a (mgr.14355) 10452 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:22:36.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:36.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:36.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:37.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:37 smithi131 bash[24745]: cluster 2024-09-14T02:22:36.053273+0000 mgr.a (mgr.14355) 10453 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:37 smithi171 bash[25040]: cluster 2024-09-14T02:22:36.053273+0000 mgr.a (mgr.14355) 10453 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:37 smithi007 bash[22722]: cluster 2024-09-14T02:22:36.053273+0000 mgr.a (mgr.14355) 10453 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:38 smithi131 bash[24745]: audit 2024-09-14T02:22:36.498914+0000 mgr.a (mgr.14355) 10454 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:38 smithi171 bash[25040]: audit 2024-09-14T02:22:36.498914+0000 mgr.a (mgr.14355) 10454 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:38 smithi007 bash[22722]: audit 2024-09-14T02:22:36.498914+0000 mgr.a (mgr.14355) 10454 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:39.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:39 smithi131 bash[24745]: cluster 2024-09-14T02:22:38.054213+0000 mgr.a (mgr.14355) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:39 smithi171 bash[25040]: cluster 2024-09-14T02:22:38.054213+0000 mgr.a (mgr.14355) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:39 smithi007 bash[22722]: cluster 2024-09-14T02:22:38.054213+0000 mgr.a (mgr.14355) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:41 smithi131 bash[24745]: cluster 2024-09-14T02:22:40.055015+0000 mgr.a (mgr.14355) 10456 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:41 smithi171 bash[25040]: cluster 2024-09-14T02:22:40.055015+0000 mgr.a (mgr.14355) 10456 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:41 smithi007 bash[22722]: cluster 2024-09-14T02:22:40.055015+0000 mgr.a (mgr.14355) 10456 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:41.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:41.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:41.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:42.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:42.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:43 smithi131 bash[24745]: cluster 2024-09-14T02:22:42.056413+0000 mgr.a (mgr.14355) 10457 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:43 smithi131 bash[24745]: audit 2024-09-14T02:22:42.276444+0000 mgr.a (mgr.14355) 10458 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:43 smithi171 bash[25040]: cluster 2024-09-14T02:22:42.056413+0000 mgr.a (mgr.14355) 10457 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:43 smithi171 bash[25040]: audit 2024-09-14T02:22:42.276444+0000 mgr.a (mgr.14355) 10458 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:43 smithi007 bash[22722]: cluster 2024-09-14T02:22:42.056413+0000 mgr.a (mgr.14355) 10457 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:43 smithi007 bash[22722]: audit 2024-09-14T02:22:42.276444+0000 mgr.a (mgr.14355) 10458 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:45 smithi131 bash[24745]: cluster 2024-09-14T02:22:44.057303+0000 mgr.a (mgr.14355) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:45 smithi171 bash[25040]: cluster 2024-09-14T02:22:44.057303+0000 mgr.a (mgr.14355) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:45 smithi007 bash[22722]: cluster 2024-09-14T02:22:44.057303+0000 mgr.a (mgr.14355) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:47 smithi131 bash[24745]: cluster 2024-09-14T02:22:46.059550+0000 mgr.a (mgr.14355) 10460 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:47 smithi171 bash[25040]: cluster 2024-09-14T02:22:46.059550+0000 mgr.a (mgr.14355) 10460 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:47 smithi007 bash[22722]: cluster 2024-09-14T02:22:46.059550+0000 mgr.a (mgr.14355) 10460 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:47.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:48.465 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:48.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:49 smithi131 bash[24745]: audit 2024-09-14T02:22:48.046667+0000 mgr.a (mgr.14355) 10461 : audit [DBG] from='client.230670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:49 smithi131 bash[24745]: cluster 2024-09-14T02:22:48.063895+0000 mgr.a (mgr.14355) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:49 smithi171 bash[25040]: audit 2024-09-14T02:22:48.046667+0000 mgr.a (mgr.14355) 10461 : audit [DBG] from='client.230670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:49 smithi171 bash[25040]: cluster 2024-09-14T02:22:48.063895+0000 mgr.a (mgr.14355) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:49 smithi007 bash[22722]: audit 2024-09-14T02:22:48.046667+0000 mgr.a (mgr.14355) 10461 : audit [DBG] from='client.230670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:49 smithi007 bash[22722]: cluster 2024-09-14T02:22:48.063895+0000 mgr.a (mgr.14355) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:51 smithi131 bash[24745]: cluster 2024-09-14T02:22:50.064883+0000 mgr.a (mgr.14355) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:51 smithi171 bash[25040]: cluster 2024-09-14T02:22:50.064883+0000 mgr.a (mgr.14355) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:51 smithi007 bash[22722]: cluster 2024-09-14T02:22:50.064883+0000 mgr.a (mgr.14355) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:53.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:53.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:53.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:53.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:53 smithi131 bash[24745]: cluster 2024-09-14T02:22:52.067175+0000 mgr.a (mgr.14355) 10464 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:53 smithi171 bash[25040]: cluster 2024-09-14T02:22:52.067175+0000 mgr.a (mgr.14355) 10464 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:53 smithi007 bash[22722]: cluster 2024-09-14T02:22:52.067175+0000 mgr.a (mgr.14355) 10464 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:54.238 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:54.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:54.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:54.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:54.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:22:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:55 smithi171 bash[25040]: audit 2024-09-14T02:22:53.804747+0000 mgr.a (mgr.14355) 10465 : audit [DBG] from='client.230748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:55 smithi171 bash[25040]: cluster 2024-09-14T02:22:54.067843+0000 mgr.a (mgr.14355) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:55 smithi007 bash[22722]: audit 2024-09-14T02:22:53.804747+0000 mgr.a (mgr.14355) 10465 : audit [DBG] from='client.230748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:55 smithi007 bash[22722]: cluster 2024-09-14T02:22:54.067843+0000 mgr.a (mgr.14355) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:55 smithi131 bash[24745]: audit 2024-09-14T02:22:53.804747+0000 mgr.a (mgr.14355) 10465 : audit [DBG] from='client.230748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:22:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:55 smithi131 bash[24745]: cluster 2024-09-14T02:22:54.067843+0000 mgr.a (mgr.14355) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:57 smithi171 bash[25040]: cluster 2024-09-14T02:22:56.070166+0000 mgr.a (mgr.14355) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:57 smithi007 bash[22722]: cluster 2024-09-14T02:22:56.070166+0000 mgr.a (mgr.14355) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:57 smithi131 bash[24745]: cluster 2024-09-14T02:22:56.070166+0000 mgr.a (mgr.14355) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:22:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:22:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:22:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:22:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:22:59 smithi171 bash[25040]: cluster 2024-09-14T02:22:58.070967+0000 mgr.a (mgr.14355) 10468 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:22:59 smithi007 bash[22722]: cluster 2024-09-14T02:22:58.070967+0000 mgr.a (mgr.14355) 10468 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:22:59 smithi131 bash[24745]: cluster 2024-09-14T02:22:58.070967+0000 mgr.a (mgr.14355) 10468 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:22:59.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:22:59.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:22:59.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:22:59.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:22:59.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:01 smithi007 bash[22722]: audit 2024-09-14T02:22:59.571344+0000 mgr.a (mgr.14355) 10469 : audit [DBG] from='client.230823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:01 smithi007 bash[22722]: cluster 2024-09-14T02:23:00.071904+0000 mgr.a (mgr.14355) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:01 smithi131 bash[24745]: audit 2024-09-14T02:22:59.571344+0000 mgr.a (mgr.14355) 10469 : audit [DBG] from='client.230823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:01 smithi131 bash[24745]: cluster 2024-09-14T02:23:00.071904+0000 mgr.a (mgr.14355) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:01 smithi171 bash[25040]: audit 2024-09-14T02:22:59.571344+0000 mgr.a (mgr.14355) 10469 : audit [DBG] from='client.230823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:01 smithi171 bash[25040]: cluster 2024-09-14T02:23:00.071904+0000 mgr.a (mgr.14355) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:03 smithi007 bash[22722]: cluster 2024-09-14T02:23:02.074104+0000 mgr.a (mgr.14355) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:03 smithi131 bash[24745]: cluster 2024-09-14T02:23:02.074104+0000 mgr.a (mgr.14355) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:03 smithi171 bash[25040]: cluster 2024-09-14T02:23:02.074104+0000 mgr.a (mgr.14355) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:05 smithi007 bash[22722]: cluster 2024-09-14T02:23:04.074873+0000 mgr.a (mgr.14355) 10472 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:05.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:05.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:05.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:05.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:05.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:05 smithi131 bash[24745]: cluster 2024-09-14T02:23:04.074873+0000 mgr.a (mgr.14355) 10472 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:05 smithi171 bash[25040]: cluster 2024-09-14T02:23:04.074873+0000 mgr.a (mgr.14355) 10472 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:06 smithi007 bash[22722]: audit 2024-09-14T02:23:05.325798+0000 mgr.a (mgr.14355) 10473 : audit [DBG] from='client.230898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:06 smithi131 bash[24745]: audit 2024-09-14T02:23:05.325798+0000 mgr.a (mgr.14355) 10473 : audit [DBG] from='client.230898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:06 smithi171 bash[25040]: audit 2024-09-14T02:23:05.325798+0000 mgr.a (mgr.14355) 10473 : audit [DBG] from='client.230898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:07 smithi007 bash[22722]: cluster 2024-09-14T02:23:06.077710+0000 mgr.a (mgr.14355) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:07 smithi131 bash[24745]: cluster 2024-09-14T02:23:06.077710+0000 mgr.a (mgr.14355) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:07 smithi171 bash[25040]: cluster 2024-09-14T02:23:06.077710+0000 mgr.a (mgr.14355) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:09 smithi007 bash[22722]: cluster 2024-09-14T02:23:08.078515+0000 mgr.a (mgr.14355) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:09 smithi131 bash[24745]: cluster 2024-09-14T02:23:08.078515+0000 mgr.a (mgr.14355) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:09 smithi171 bash[25040]: cluster 2024-09-14T02:23:08.078515+0000 mgr.a (mgr.14355) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:10 smithi007 bash[22722]: audit 2024-09-14T02:23:09.516548+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:23:10.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:10.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:10 smithi131 bash[24745]: audit 2024-09-14T02:23:09.516548+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:23:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:10 smithi171 bash[25040]: audit 2024-09-14T02:23:09.516548+0000 mon.a (mon.0) 2154 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:23:11.482 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:11 smithi007 bash[22722]: cluster 2024-09-14T02:23:10.079281+0000 mgr.a (mgr.14355) 10476 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:11 smithi131 bash[24745]: cluster 2024-09-14T02:23:10.079281+0000 mgr.a (mgr.14355) 10476 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:11 smithi171 bash[25040]: cluster 2024-09-14T02:23:10.079281+0000 mgr.a (mgr.14355) 10476 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:12 smithi007 bash[22722]: audit 2024-09-14T02:23:11.077633+0000 mgr.a (mgr.14355) 10477 : audit [DBG] from='client.230973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:12 smithi131 bash[24745]: audit 2024-09-14T02:23:11.077633+0000 mgr.a (mgr.14355) 10477 : audit [DBG] from='client.230973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:12 smithi171 bash[25040]: audit 2024-09-14T02:23:11.077633+0000 mgr.a (mgr.14355) 10477 : audit [DBG] from='client.230973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:13 smithi007 bash[22722]: cluster 2024-09-14T02:23:12.082102+0000 mgr.a (mgr.14355) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:13 smithi131 bash[24745]: cluster 2024-09-14T02:23:12.082102+0000 mgr.a (mgr.14355) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:13 smithi171 bash[25040]: cluster 2024-09-14T02:23:12.082102+0000 mgr.a (mgr.14355) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: cluster 2024-09-14T02:23:14.082883+0000 mgr.a (mgr.14355) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.866959+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.871353+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.891166+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.895879+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.900619+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:15 smithi007 bash[22722]: audit 2024-09-14T02:23:14.905399+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: cluster 2024-09-14T02:23:14.082883+0000 mgr.a (mgr.14355) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.866959+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.871353+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.891166+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.895879+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.900619+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:15 smithi131 bash[24745]: audit 2024-09-14T02:23:14.905399+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: cluster 2024-09-14T02:23:14.082883+0000 mgr.a (mgr.14355) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.866959+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.871353+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.891166+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.895879+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.900619+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:15 smithi171 bash[25040]: audit 2024-09-14T02:23:14.905399+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:16.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:16.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:16.485 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:17.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:17.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:17 smithi007 bash[22722]: cluster 2024-09-14T02:23:16.084905+0000 mgr.a (mgr.14355) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:17 smithi131 bash[24745]: cluster 2024-09-14T02:23:16.084905+0000 mgr.a (mgr.14355) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:17 smithi171 bash[25040]: cluster 2024-09-14T02:23:16.084905+0000 mgr.a (mgr.14355) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:18 smithi007 bash[22722]: audit 2024-09-14T02:23:16.820227+0000 mgr.a (mgr.14355) 10481 : audit [DBG] from='client.231051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:18 smithi131 bash[24745]: audit 2024-09-14T02:23:16.820227+0000 mgr.a (mgr.14355) 10481 : audit [DBG] from='client.231051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:18 smithi171 bash[25040]: audit 2024-09-14T02:23:16.820227+0000 mgr.a (mgr.14355) 10481 : audit [DBG] from='client.231051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:19 smithi007 bash[22722]: cluster 2024-09-14T02:23:18.085851+0000 mgr.a (mgr.14355) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:19 smithi131 bash[24745]: cluster 2024-09-14T02:23:18.085851+0000 mgr.a (mgr.14355) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:19 smithi171 bash[25040]: cluster 2024-09-14T02:23:18.085851+0000 mgr.a (mgr.14355) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:21.637 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:21 smithi171 bash[25040]: cluster 2024-09-14T02:23:20.086700+0000 mgr.a (mgr.14355) 10483 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:21 smithi007 bash[22722]: cluster 2024-09-14T02:23:20.086700+0000 mgr.a (mgr.14355) 10483 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:21 smithi131 bash[24745]: cluster 2024-09-14T02:23:20.086700+0000 mgr.a (mgr.14355) 10483 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:23.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:23.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:23.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:23.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:23.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:23.627 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:23 smithi131 bash[24745]: cluster 2024-09-14T02:23:22.088941+0000 mgr.a (mgr.14355) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:23 smithi007 bash[22722]: cluster 2024-09-14T02:23:22.088941+0000 mgr.a (mgr.14355) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:23 smithi171 bash[25040]: cluster 2024-09-14T02:23:22.088941+0000 mgr.a (mgr.14355) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:24 smithi007 bash[22722]: audit 2024-09-14T02:23:22.596842+0000 mgr.a (mgr.14355) 10485 : audit [DBG] from='client.231129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:24.706 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:24 smithi131 bash[24745]: audit 2024-09-14T02:23:22.596842+0000 mgr.a (mgr.14355) 10485 : audit [DBG] from='client.231129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:24 smithi171 bash[25040]: audit 2024-09-14T02:23:22.596842+0000 mgr.a (mgr.14355) 10485 : audit [DBG] from='client.231129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:25 smithi007 bash[22722]: cluster 2024-09-14T02:23:24.089861+0000 mgr.a (mgr.14355) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:25 smithi007 bash[22722]: audit 2024-09-14T02:23:25.164330+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:25 smithi007 bash[22722]: audit 2024-09-14T02:23:25.172687+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:25 smithi131 bash[24745]: cluster 2024-09-14T02:23:24.089861+0000 mgr.a (mgr.14355) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:25 smithi131 bash[24745]: audit 2024-09-14T02:23:25.164330+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:25 smithi131 bash[24745]: audit 2024-09-14T02:23:25.172687+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:25 smithi171 bash[25040]: cluster 2024-09-14T02:23:24.089861+0000 mgr.a (mgr.14355) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:25 smithi171 bash[25040]: audit 2024-09-14T02:23:25.164330+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:25 smithi171 bash[25040]: audit 2024-09-14T02:23:25.172687+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22972]: debug 2024-09-14T02:23:26.227+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:23:26.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22972]: debug 2024-09-14T02:23:26.231+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:23:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.418374+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.426689+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.429953+0000 mon.a (mon.0) 2165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:23:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.432076+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:23:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.442545+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:26 smithi007 bash[22722]: audit 2024-09-14T02:23:25.453740+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.418374+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.426689+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.429953+0000 mon.a (mon.0) 2165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.432076+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.442545+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:26 smithi131 bash[24745]: audit 2024-09-14T02:23:25.453740+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.418374+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.426689+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.429953+0000 mon.a (mon.0) 2165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:23:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.432076+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:23:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.442545+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:23:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:26 smithi171 bash[25040]: audit 2024-09-14T02:23:25.453740+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:27 smithi007 bash[22722]: audit 2024-09-14T02:23:25.454920+0000 mgr.a (mgr.14355) 10487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:27 smithi007 bash[22722]: cluster 2024-09-14T02:23:26.091321+0000 mgr.a (mgr.14355) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:27 smithi007 bash[22722]: audit 2024-09-14T02:23:26.233641+0000 mgr.a (mgr.14355) 10489 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:23:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:27 smithi007 bash[22722]: cephadm 2024-09-14T02:23:26.235643+0000 mgr.a (mgr.14355) 10490 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:23:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:27 smithi131 bash[24745]: audit 2024-09-14T02:23:25.454920+0000 mgr.a (mgr.14355) 10487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:27 smithi131 bash[24745]: cluster 2024-09-14T02:23:26.091321+0000 mgr.a (mgr.14355) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:27 smithi131 bash[24745]: audit 2024-09-14T02:23:26.233641+0000 mgr.a (mgr.14355) 10489 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:23:27.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:27 smithi131 bash[24745]: cephadm 2024-09-14T02:23:26.235643+0000 mgr.a (mgr.14355) 10490 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:23:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:27 smithi171 bash[25040]: audit 2024-09-14T02:23:25.454920+0000 mgr.a (mgr.14355) 10487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:23:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:27 smithi171 bash[25040]: cluster 2024-09-14T02:23:26.091321+0000 mgr.a (mgr.14355) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:23:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:27 smithi171 bash[25040]: audit 2024-09-14T02:23:26.233641+0000 mgr.a (mgr.14355) 10489 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:23:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:27 smithi171 bash[25040]: cephadm 2024-09-14T02:23:26.235643+0000 mgr.a (mgr.14355) 10490 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:23:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:28.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:28.811 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:28.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:29 smithi007 bash[22722]: cluster 2024-09-14T02:23:28.092046+0000 mgr.a (mgr.14355) 10491 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:29 smithi007 bash[22722]: audit 2024-09-14T02:23:28.375076+0000 mgr.a (mgr.14355) 10492 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:29 smithi131 bash[24745]: cluster 2024-09-14T02:23:28.092046+0000 mgr.a (mgr.14355) 10491 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:29 smithi131 bash[24745]: audit 2024-09-14T02:23:28.375076+0000 mgr.a (mgr.14355) 10492 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:29 smithi171 bash[25040]: cluster 2024-09-14T02:23:28.092046+0000 mgr.a (mgr.14355) 10491 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:29 smithi171 bash[25040]: audit 2024-09-14T02:23:28.375076+0000 mgr.a (mgr.14355) 10492 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:31 smithi007 bash[22722]: cluster 2024-09-14T02:23:30.092936+0000 mgr.a (mgr.14355) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:31 smithi131 bash[24745]: cluster 2024-09-14T02:23:30.092936+0000 mgr.a (mgr.14355) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:31 smithi171 bash[25040]: cluster 2024-09-14T02:23:30.092936+0000 mgr.a (mgr.14355) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:32 smithi131 bash[24745]: cluster 2024-09-14T02:23:32.095202+0000 mgr.a (mgr.14355) 10494 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:32 smithi171 bash[25040]: cluster 2024-09-14T02:23:32.095202+0000 mgr.a (mgr.14355) 10494 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:32 smithi007 bash[22722]: cluster 2024-09-14T02:23:32.095202+0000 mgr.a (mgr.14355) 10494 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:33.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:33.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:35 smithi007 bash[22722]: cluster 2024-09-14T02:23:34.095950+0000 mgr.a (mgr.14355) 10495 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:35 smithi007 bash[22722]: audit 2024-09-14T02:23:34.146103+0000 mgr.a (mgr.14355) 10496 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:35 smithi131 bash[24745]: cluster 2024-09-14T02:23:34.095950+0000 mgr.a (mgr.14355) 10495 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:35 smithi131 bash[24745]: audit 2024-09-14T02:23:34.146103+0000 mgr.a (mgr.14355) 10496 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:35 smithi171 bash[25040]: cluster 2024-09-14T02:23:34.095950+0000 mgr.a (mgr.14355) 10495 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:35 smithi171 bash[25040]: audit 2024-09-14T02:23:34.146103+0000 mgr.a (mgr.14355) 10496 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:37 smithi007 bash[22722]: cluster 2024-09-14T02:23:36.098219+0000 mgr.a (mgr.14355) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:37 smithi131 bash[24745]: cluster 2024-09-14T02:23:36.098219+0000 mgr.a (mgr.14355) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:37 smithi171 bash[25040]: cluster 2024-09-14T02:23:36.098219+0000 mgr.a (mgr.14355) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:39 smithi007 bash[22722]: cluster 2024-09-14T02:23:38.098991+0000 mgr.a (mgr.14355) 10498 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:39 smithi131 bash[24745]: cluster 2024-09-14T02:23:38.098991+0000 mgr.a (mgr.14355) 10498 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:39 smithi171 bash[25040]: cluster 2024-09-14T02:23:38.098991+0000 mgr.a (mgr.14355) 10498 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:40.349 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:41 smithi007 bash[22722]: audit 2024-09-14T02:23:39.935724+0000 mgr.a (mgr.14355) 10499 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:41 smithi007 bash[22722]: cluster 2024-09-14T02:23:40.099994+0000 mgr.a (mgr.14355) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:41 smithi131 bash[24745]: audit 2024-09-14T02:23:39.935724+0000 mgr.a (mgr.14355) 10499 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:41 smithi131 bash[24745]: cluster 2024-09-14T02:23:40.099994+0000 mgr.a (mgr.14355) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:41 smithi171 bash[25040]: audit 2024-09-14T02:23:39.935724+0000 mgr.a (mgr.14355) 10499 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:41 smithi171 bash[25040]: cluster 2024-09-14T02:23:40.099994+0000 mgr.a (mgr.14355) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:43 smithi007 bash[22722]: cluster 2024-09-14T02:23:42.102809+0000 mgr.a (mgr.14355) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:43 smithi131 bash[24745]: cluster 2024-09-14T02:23:42.102809+0000 mgr.a (mgr.14355) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:43 smithi171 bash[25040]: cluster 2024-09-14T02:23:42.102809+0000 mgr.a (mgr.14355) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:23:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:45.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:45 smithi007 bash[22722]: cluster 2024-09-14T02:23:44.103573+0000 mgr.a (mgr.14355) 10502 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:23:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:45 smithi131 bash[24745]: cluster 2024-09-14T02:23:44.103573+0000 mgr.a (mgr.14355) 10502 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:23:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:45 smithi171 bash[25040]: cluster 2024-09-14T02:23:44.103573+0000 mgr.a (mgr.14355) 10502 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:23:46.126 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:46.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:46.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:46.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:46.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:47 smithi007 bash[22722]: audit 2024-09-14T02:23:45.686129+0000 mgr.a (mgr.14355) 10503 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:47 smithi007 bash[22722]: cluster 2024-09-14T02:23:46.105196+0000 mgr.a (mgr.14355) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:47 smithi131 bash[24745]: audit 2024-09-14T02:23:45.686129+0000 mgr.a (mgr.14355) 10503 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:47 smithi131 bash[24745]: cluster 2024-09-14T02:23:46.105196+0000 mgr.a (mgr.14355) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:47 smithi171 bash[25040]: audit 2024-09-14T02:23:45.686129+0000 mgr.a (mgr.14355) 10503 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:47 smithi171 bash[25040]: cluster 2024-09-14T02:23:46.105196+0000 mgr.a (mgr.14355) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:49 smithi007 bash[22722]: cluster 2024-09-14T02:23:48.105948+0000 mgr.a (mgr.14355) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:49 smithi131 bash[24745]: cluster 2024-09-14T02:23:48.105948+0000 mgr.a (mgr.14355) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:49 smithi171 bash[25040]: cluster 2024-09-14T02:23:48.105948+0000 mgr.a (mgr.14355) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:23:51.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:51.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:51.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:51 smithi007 bash[22722]: cluster 2024-09-14T02:23:50.106723+0000 mgr.a (mgr.14355) 10506 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:51.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:51 smithi131 bash[24745]: cluster 2024-09-14T02:23:50.106723+0000 mgr.a (mgr.14355) 10506 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:51 smithi171 bash[25040]: cluster 2024-09-14T02:23:50.106723+0000 mgr.a (mgr.14355) 10506 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:23:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:51.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:53 smithi007 bash[22722]: audit 2024-09-14T02:23:51.458233+0000 mgr.a (mgr.14355) 10507 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:53 smithi007 bash[22722]: cluster 2024-09-14T02:23:52.109533+0000 mgr.a (mgr.14355) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:53 smithi131 bash[24745]: audit 2024-09-14T02:23:51.458233+0000 mgr.a (mgr.14355) 10507 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:53 smithi131 bash[24745]: cluster 2024-09-14T02:23:52.109533+0000 mgr.a (mgr.14355) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:53 smithi171 bash[25040]: audit 2024-09-14T02:23:51.458233+0000 mgr.a (mgr.14355) 10507 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:53 smithi171 bash[25040]: cluster 2024-09-14T02:23:52.109533+0000 mgr.a (mgr.14355) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:55 smithi007 bash[22722]: cluster 2024-09-14T02:23:54.110351+0000 mgr.a (mgr.14355) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:23:55.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:55 smithi131 bash[24745]: cluster 2024-09-14T02:23:54.110351+0000 mgr.a (mgr.14355) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:23:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:55 smithi171 bash[25040]: cluster 2024-09-14T02:23:54.110351+0000 mgr.a (mgr.14355) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:23:56.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:23:56.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:23:56.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:23:57.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:57 smithi007 bash[22722]: cluster 2024-09-14T02:23:56.112361+0000 mgr.a (mgr.14355) 10510 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:23:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:57 smithi131 bash[24745]: cluster 2024-09-14T02:23:56.112361+0000 mgr.a (mgr.14355) 10510 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:23:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:57 smithi171 bash[25040]: cluster 2024-09-14T02:23:56.112361+0000 mgr.a (mgr.14355) 10510 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:23:57.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:23:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:23:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:23:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:23:57.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:23:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:58 smithi131 bash[24745]: audit 2024-09-14T02:23:57.211165+0000 mgr.a (mgr.14355) 10511 : audit [DBG] from='client.231687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:58 smithi171 bash[25040]: audit 2024-09-14T02:23:57.211165+0000 mgr.a (mgr.14355) 10511 : audit [DBG] from='client.231687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:58 smithi007 bash[22722]: audit 2024-09-14T02:23:57.211165+0000 mgr.a (mgr.14355) 10511 : audit [DBG] from='client.231687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:23:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:23:59 smithi131 bash[24745]: cluster 2024-09-14T02:23:58.113352+0000 mgr.a (mgr.14355) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:23:59 smithi171 bash[25040]: cluster 2024-09-14T02:23:58.113352+0000 mgr.a (mgr.14355) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:23:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:23:59 smithi007 bash[22722]: cluster 2024-09-14T02:23:58.113352+0000 mgr.a (mgr.14355) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:01 smithi131 bash[24745]: cluster 2024-09-14T02:24:00.114133+0000 mgr.a (mgr.14355) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:01 smithi171 bash[25040]: cluster 2024-09-14T02:24:00.114133+0000 mgr.a (mgr.14355) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:01 smithi007 bash[22722]: cluster 2024-09-14T02:24:00.114133+0000 mgr.a (mgr.14355) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:03.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:03.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:03.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:03 smithi131 bash[24745]: cluster 2024-09-14T02:24:02.116380+0000 mgr.a (mgr.14355) 10514 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:03 smithi171 bash[25040]: cluster 2024-09-14T02:24:02.116380+0000 mgr.a (mgr.14355) 10514 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:03 smithi007 bash[22722]: cluster 2024-09-14T02:24:02.116380+0000 mgr.a (mgr.14355) 10514 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:04 smithi131 bash[24745]: audit 2024-09-14T02:24:02.993746+0000 mgr.a (mgr.14355) 10515 : audit [DBG] from='client.231765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:04 smithi171 bash[25040]: audit 2024-09-14T02:24:02.993746+0000 mgr.a (mgr.14355) 10515 : audit [DBG] from='client.231765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:04 smithi007 bash[22722]: audit 2024-09-14T02:24:02.993746+0000 mgr.a (mgr.14355) 10515 : audit [DBG] from='client.231765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:05.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:05 smithi131 bash[24745]: cluster 2024-09-14T02:24:04.117280+0000 mgr.a (mgr.14355) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:05 smithi171 bash[25040]: cluster 2024-09-14T02:24:04.117280+0000 mgr.a (mgr.14355) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:05 smithi007 bash[22722]: cluster 2024-09-14T02:24:04.117280+0000 mgr.a (mgr.14355) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:07 smithi131 bash[24745]: cluster 2024-09-14T02:24:06.119561+0000 mgr.a (mgr.14355) 10517 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:07 smithi171 bash[25040]: cluster 2024-09-14T02:24:06.119561+0000 mgr.a (mgr.14355) 10517 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:07 smithi007 bash[22722]: cluster 2024-09-14T02:24:06.119561+0000 mgr.a (mgr.14355) 10517 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:08.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:08.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:09.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:09.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:09.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:09 smithi131 bash[24745]: cluster 2024-09-14T02:24:08.120329+0000 mgr.a (mgr.14355) 10518 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:09 smithi171 bash[25040]: cluster 2024-09-14T02:24:08.120329+0000 mgr.a (mgr.14355) 10518 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:09 smithi007 bash[22722]: cluster 2024-09-14T02:24:08.120329+0000 mgr.a (mgr.14355) 10518 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:10 smithi131 bash[24745]: audit 2024-09-14T02:24:08.748902+0000 mgr.a (mgr.14355) 10519 : audit [DBG] from='client.231843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:10 smithi171 bash[25040]: audit 2024-09-14T02:24:08.748902+0000 mgr.a (mgr.14355) 10519 : audit [DBG] from='client.231843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:10 smithi007 bash[22722]: audit 2024-09-14T02:24:08.748902+0000 mgr.a (mgr.14355) 10519 : audit [DBG] from='client.231843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:11 smithi131 bash[24745]: cluster 2024-09-14T02:24:10.121212+0000 mgr.a (mgr.14355) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:11 smithi171 bash[25040]: cluster 2024-09-14T02:24:10.121212+0000 mgr.a (mgr.14355) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:11 smithi007 bash[22722]: cluster 2024-09-14T02:24:10.121212+0000 mgr.a (mgr.14355) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:13 smithi131 bash[24745]: cluster 2024-09-14T02:24:12.123521+0000 mgr.a (mgr.14355) 10521 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:13 smithi171 bash[25040]: cluster 2024-09-14T02:24:12.123521+0000 mgr.a (mgr.14355) 10521 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:13 smithi007 bash[22722]: cluster 2024-09-14T02:24:12.123521+0000 mgr.a (mgr.14355) 10521 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:14.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:14.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:14.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:14.908 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:14.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:15 smithi131 bash[24745]: cluster 2024-09-14T02:24:14.124336+0000 mgr.a (mgr.14355) 10522 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:15 smithi171 bash[25040]: cluster 2024-09-14T02:24:14.124336+0000 mgr.a (mgr.14355) 10522 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:15 smithi007 bash[22722]: cluster 2024-09-14T02:24:14.124336+0000 mgr.a (mgr.14355) 10522 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:16 smithi131 bash[24745]: audit 2024-09-14T02:24:14.501494+0000 mgr.a (mgr.14355) 10523 : audit [DBG] from='client.231921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:16 smithi171 bash[25040]: audit 2024-09-14T02:24:14.501494+0000 mgr.a (mgr.14355) 10523 : audit [DBG] from='client.231921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:16 smithi007 bash[22722]: audit 2024-09-14T02:24:14.501494+0000 mgr.a (mgr.14355) 10523 : audit [DBG] from='client.231921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:17.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:17 smithi131 bash[24745]: cluster 2024-09-14T02:24:16.126881+0000 mgr.a (mgr.14355) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:17 smithi171 bash[25040]: cluster 2024-09-14T02:24:16.126881+0000 mgr.a (mgr.14355) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:17 smithi007 bash[22722]: cluster 2024-09-14T02:24:16.126881+0000 mgr.a (mgr.14355) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:19.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:19 smithi131 bash[24745]: cluster 2024-09-14T02:24:18.127833+0000 mgr.a (mgr.14355) 10525 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:19 smithi171 bash[25040]: cluster 2024-09-14T02:24:18.127833+0000 mgr.a (mgr.14355) 10525 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:19 smithi007 bash[22722]: cluster 2024-09-14T02:24:18.127833+0000 mgr.a (mgr.14355) 10525 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:20.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:20.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:21 smithi131 bash[24745]: cluster 2024-09-14T02:24:20.128399+0000 mgr.a (mgr.14355) 10526 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:21 smithi131 bash[24745]: audit 2024-09-14T02:24:20.247163+0000 mgr.a (mgr.14355) 10527 : audit [DBG] from='client.231990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:21 smithi171 bash[25040]: cluster 2024-09-14T02:24:20.128399+0000 mgr.a (mgr.14355) 10526 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:21 smithi171 bash[25040]: audit 2024-09-14T02:24:20.247163+0000 mgr.a (mgr.14355) 10527 : audit [DBG] from='client.231990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:21 smithi007 bash[22722]: cluster 2024-09-14T02:24:20.128399+0000 mgr.a (mgr.14355) 10526 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:21 smithi007 bash[22722]: audit 2024-09-14T02:24:20.247163+0000 mgr.a (mgr.14355) 10527 : audit [DBG] from='client.231990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:23.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:23 smithi131 bash[24745]: cluster 2024-09-14T02:24:22.131086+0000 mgr.a (mgr.14355) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:23 smithi171 bash[25040]: cluster 2024-09-14T02:24:22.131086+0000 mgr.a (mgr.14355) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:23 smithi007 bash[22722]: cluster 2024-09-14T02:24:22.131086+0000 mgr.a (mgr.14355) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:25.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:25 smithi131 bash[24745]: cluster 2024-09-14T02:24:24.131852+0000 mgr.a (mgr.14355) 10529 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:25 smithi171 bash[25040]: cluster 2024-09-14T02:24:24.131852+0000 mgr.a (mgr.14355) 10529 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:25.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:25 smithi007 bash[22722]: cluster 2024-09-14T02:24:24.131852+0000 mgr.a (mgr.14355) 10529 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:26.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:26.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:26.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:26.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:26.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:26.031254+0000 mgr.a (mgr.14355) 10530 : audit [DBG] from='client.232068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: cluster 2024-09-14T02:24:26.133146+0000 mgr.a (mgr.14355) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:26.306142+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:24:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:27.078201+0000 mon.a (mon.0) 2170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:24:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:27.079938+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:24:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:27.088109+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:24:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:27 smithi171 bash[25040]: audit 2024-09-14T02:24:27.090668+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:26.031254+0000 mgr.a (mgr.14355) 10530 : audit [DBG] from='client.232068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: cluster 2024-09-14T02:24:26.133146+0000 mgr.a (mgr.14355) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:26.306142+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:27.078201+0000 mon.a (mon.0) 2170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:27.079938+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:27.088109+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:24:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22722]: audit 2024-09-14T02:24:27.090668+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:26.031254+0000 mgr.a (mgr.14355) 10530 : audit [DBG] from='client.232068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: cluster 2024-09-14T02:24:26.133146+0000 mgr.a (mgr.14355) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:26.306142+0000 mon.a (mon.0) 2169 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:24:27.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:27.078201+0000 mon.a (mon.0) 2170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:24:27.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:27.079938+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:24:27.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:27.088109+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:24:27.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:27 smithi131 bash[24745]: audit 2024-09-14T02:24:27.090668+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:28.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22972]: debug 2024-09-14T02:24:27.806+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:24:28.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:24:27 smithi007 bash[22972]: debug 2024-09-14T02:24:27.806+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:24:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:28 smithi171 bash[25040]: audit 2024-09-14T02:24:27.093480+0000 mgr.a (mgr.14355) 10532 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:28 smithi007 bash[22722]: audit 2024-09-14T02:24:27.093480+0000 mgr.a (mgr.14355) 10532 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:28 smithi131 bash[24745]: audit 2024-09-14T02:24:27.093480+0000 mgr.a (mgr.14355) 10532 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:24:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:29 smithi007 bash[22722]: audit 2024-09-14T02:24:27.812640+0000 mgr.a (mgr.14355) 10533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:24:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:29 smithi007 bash[22722]: cephadm 2024-09-14T02:24:27.813958+0000 mgr.a (mgr.14355) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:24:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:29 smithi007 bash[22722]: cluster 2024-09-14T02:24:28.133945+0000 mgr.a (mgr.14355) 10535 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:29 smithi131 bash[24745]: audit 2024-09-14T02:24:27.812640+0000 mgr.a (mgr.14355) 10533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:24:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:29 smithi131 bash[24745]: cephadm 2024-09-14T02:24:27.813958+0000 mgr.a (mgr.14355) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:24:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:29 smithi131 bash[24745]: cluster 2024-09-14T02:24:28.133945+0000 mgr.a (mgr.14355) 10535 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:29 smithi171 bash[25040]: audit 2024-09-14T02:24:27.812640+0000 mgr.a (mgr.14355) 10533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:24:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:29 smithi171 bash[25040]: cephadm 2024-09-14T02:24:27.813958+0000 mgr.a (mgr.14355) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:24:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:29 smithi171 bash[25040]: cluster 2024-09-14T02:24:28.133945+0000 mgr.a (mgr.14355) 10535 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:24:31.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:31.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:31 smithi007 bash[22722]: cluster 2024-09-14T02:24:30.134702+0000 mgr.a (mgr.14355) 10536 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:24:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:31 smithi131 bash[24745]: cluster 2024-09-14T02:24:30.134702+0000 mgr.a (mgr.14355) 10536 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:24:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:31 smithi171 bash[25040]: cluster 2024-09-14T02:24:30.134702+0000 mgr.a (mgr.14355) 10536 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:24:32.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:33 smithi007 bash[22722]: audit 2024-09-14T02:24:31.823865+0000 mgr.a (mgr.14355) 10537 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:33 smithi007 bash[22722]: cluster 2024-09-14T02:24:32.136013+0000 mgr.a (mgr.14355) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:33 smithi131 bash[24745]: audit 2024-09-14T02:24:31.823865+0000 mgr.a (mgr.14355) 10537 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:33 smithi131 bash[24745]: cluster 2024-09-14T02:24:32.136013+0000 mgr.a (mgr.14355) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:33 smithi171 bash[25040]: audit 2024-09-14T02:24:31.823865+0000 mgr.a (mgr.14355) 10537 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:33 smithi171 bash[25040]: cluster 2024-09-14T02:24:32.136013+0000 mgr.a (mgr.14355) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:35 smithi007 bash[22722]: cluster 2024-09-14T02:24:34.136877+0000 mgr.a (mgr.14355) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:35 smithi131 bash[24745]: cluster 2024-09-14T02:24:34.136877+0000 mgr.a (mgr.14355) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:35 smithi171 bash[25040]: cluster 2024-09-14T02:24:34.136877+0000 mgr.a (mgr.14355) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:37.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:37.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:37 smithi007 bash[22722]: cluster 2024-09-14T02:24:36.139115+0000 mgr.a (mgr.14355) 10540 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:37 smithi131 bash[24745]: cluster 2024-09-14T02:24:36.139115+0000 mgr.a (mgr.14355) 10540 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:37 smithi171 bash[25040]: cluster 2024-09-14T02:24:36.139115+0000 mgr.a (mgr.14355) 10540 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:38.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:38.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:39 smithi007 bash[22722]: audit 2024-09-14T02:24:37.592812+0000 mgr.a (mgr.14355) 10541 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:39 smithi007 bash[22722]: cluster 2024-09-14T02:24:38.140063+0000 mgr.a (mgr.14355) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:39 smithi131 bash[24745]: audit 2024-09-14T02:24:37.592812+0000 mgr.a (mgr.14355) 10541 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:39 smithi131 bash[24745]: cluster 2024-09-14T02:24:38.140063+0000 mgr.a (mgr.14355) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:39 smithi171 bash[25040]: audit 2024-09-14T02:24:37.592812+0000 mgr.a (mgr.14355) 10541 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:39 smithi171 bash[25040]: cluster 2024-09-14T02:24:38.140063+0000 mgr.a (mgr.14355) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:41 smithi007 bash[22722]: cluster 2024-09-14T02:24:40.140829+0000 mgr.a (mgr.14355) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:41 smithi131 bash[24745]: cluster 2024-09-14T02:24:40.140829+0000 mgr.a (mgr.14355) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:41 smithi171 bash[25040]: cluster 2024-09-14T02:24:40.140829+0000 mgr.a (mgr.14355) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:43.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:43.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:43.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:43 smithi007 bash[22722]: cluster 2024-09-14T02:24:42.143095+0000 mgr.a (mgr.14355) 10544 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:43.756 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:43 smithi131 bash[24745]: cluster 2024-09-14T02:24:42.143095+0000 mgr.a (mgr.14355) 10544 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:43 smithi171 bash[25040]: cluster 2024-09-14T02:24:42.143095+0000 mgr.a (mgr.14355) 10544 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:24:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:44 smithi007 bash[22722]: audit 2024-09-14T02:24:43.337326+0000 mgr.a (mgr.14355) 10545 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:44 smithi131 bash[24745]: audit 2024-09-14T02:24:43.337326+0000 mgr.a (mgr.14355) 10545 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:44 smithi171 bash[25040]: audit 2024-09-14T02:24:43.337326+0000 mgr.a (mgr.14355) 10545 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:45 smithi007 bash[22722]: cluster 2024-09-14T02:24:44.143947+0000 mgr.a (mgr.14355) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:45 smithi131 bash[24745]: cluster 2024-09-14T02:24:44.143947+0000 mgr.a (mgr.14355) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:45 smithi171 bash[25040]: cluster 2024-09-14T02:24:44.143947+0000 mgr.a (mgr.14355) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:47 smithi007 bash[22722]: cluster 2024-09-14T02:24:46.146191+0000 mgr.a (mgr.14355) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:47 smithi131 bash[24745]: cluster 2024-09-14T02:24:46.146191+0000 mgr.a (mgr.14355) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:47 smithi171 bash[25040]: cluster 2024-09-14T02:24:46.146191+0000 mgr.a (mgr.14355) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:48.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:48.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:48.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:49.504 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:49.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:49 smithi007 bash[22722]: cluster 2024-09-14T02:24:48.146953+0000 mgr.a (mgr.14355) 10548 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:49 smithi131 bash[24745]: cluster 2024-09-14T02:24:48.146953+0000 mgr.a (mgr.14355) 10548 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:49 smithi171 bash[25040]: cluster 2024-09-14T02:24:48.146953+0000 mgr.a (mgr.14355) 10548 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:50 smithi007 bash[22722]: audit 2024-09-14T02:24:49.089284+0000 mgr.a (mgr.14355) 10549 : audit [DBG] from='client.232482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:50 smithi131 bash[24745]: audit 2024-09-14T02:24:49.089284+0000 mgr.a (mgr.14355) 10549 : audit [DBG] from='client.232482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:50 smithi171 bash[25040]: audit 2024-09-14T02:24:49.089284+0000 mgr.a (mgr.14355) 10549 : audit [DBG] from='client.232482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:51 smithi007 bash[22722]: cluster 2024-09-14T02:24:50.147820+0000 mgr.a (mgr.14355) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:51 smithi131 bash[24745]: cluster 2024-09-14T02:24:50.147820+0000 mgr.a (mgr.14355) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:51 smithi171 bash[25040]: cluster 2024-09-14T02:24:50.147820+0000 mgr.a (mgr.14355) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:53 smithi007 bash[22722]: cluster 2024-09-14T02:24:52.150053+0000 mgr.a (mgr.14355) 10551 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:53 smithi131 bash[24745]: cluster 2024-09-14T02:24:52.150053+0000 mgr.a (mgr.14355) 10551 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:53 smithi171 bash[25040]: cluster 2024-09-14T02:24:52.150053+0000 mgr.a (mgr.14355) 10551 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:24:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:24:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:24:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:24:55.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:24:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:24:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:24:55.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:24:55.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:24:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:55 smithi007 bash[22722]: cluster 2024-09-14T02:24:54.150956+0000 mgr.a (mgr.14355) 10552 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:55 smithi131 bash[24745]: cluster 2024-09-14T02:24:54.150956+0000 mgr.a (mgr.14355) 10552 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:55 smithi171 bash[25040]: cluster 2024-09-14T02:24:54.150956+0000 mgr.a (mgr.14355) 10552 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:24:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:56 smithi007 bash[22722]: audit 2024-09-14T02:24:54.836627+0000 mgr.a (mgr.14355) 10553 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:56 smithi131 bash[24745]: audit 2024-09-14T02:24:54.836627+0000 mgr.a (mgr.14355) 10553 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:56 smithi171 bash[25040]: audit 2024-09-14T02:24:54.836627+0000 mgr.a (mgr.14355) 10553 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:24:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:57 smithi007 bash[22722]: cluster 2024-09-14T02:24:56.153365+0000 mgr.a (mgr.14355) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:24:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:57 smithi131 bash[24745]: cluster 2024-09-14T02:24:56.153365+0000 mgr.a (mgr.14355) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:24:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:57 smithi171 bash[25040]: cluster 2024-09-14T02:24:56.153365+0000 mgr.a (mgr.14355) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:24:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:24:59 smithi007 bash[22722]: cluster 2024-09-14T02:24:58.154155+0000 mgr.a (mgr.14355) 10555 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:24:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:24:59 smithi131 bash[24745]: cluster 2024-09-14T02:24:58.154155+0000 mgr.a (mgr.14355) 10555 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:24:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:24:59 smithi171 bash[25040]: cluster 2024-09-14T02:24:58.154155+0000 mgr.a (mgr.14355) 10555 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:25:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:00.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:01.071 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:01.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:01.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:01 smithi007 bash[22722]: cluster 2024-09-14T02:25:00.154906+0000 mgr.a (mgr.14355) 10556 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:25:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:01 smithi131 bash[24745]: cluster 2024-09-14T02:25:00.154906+0000 mgr.a (mgr.14355) 10556 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:25:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:01 smithi171 bash[25040]: cluster 2024-09-14T02:25:00.154906+0000 mgr.a (mgr.14355) 10556 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:25:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:02 smithi007 bash[22722]: audit 2024-09-14T02:25:00.630178+0000 mgr.a (mgr.14355) 10557 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:02.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:02 smithi131 bash[24745]: audit 2024-09-14T02:25:00.630178+0000 mgr.a (mgr.14355) 10557 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:02 smithi171 bash[25040]: audit 2024-09-14T02:25:00.630178+0000 mgr.a (mgr.14355) 10557 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:03 smithi007 bash[22722]: cluster 2024-09-14T02:25:02.157629+0000 mgr.a (mgr.14355) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:03 smithi131 bash[24745]: cluster 2024-09-14T02:25:02.157629+0000 mgr.a (mgr.14355) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:03 smithi171 bash[25040]: cluster 2024-09-14T02:25:02.157629+0000 mgr.a (mgr.14355) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:05 smithi007 bash[22722]: cluster 2024-09-14T02:25:04.158421+0000 mgr.a (mgr.14355) 10559 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:25:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:05 smithi131 bash[24745]: cluster 2024-09-14T02:25:04.158421+0000 mgr.a (mgr.14355) 10559 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:25:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:05 smithi171 bash[25040]: cluster 2024-09-14T02:25:04.158421+0000 mgr.a (mgr.14355) 10559 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:25:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:06.073 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:06.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:06.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:06.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:07 smithi007 bash[22722]: cluster 2024-09-14T02:25:06.160274+0000 mgr.a (mgr.14355) 10560 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:07 smithi007 bash[22722]: audit 2024-09-14T02:25:06.408410+0000 mgr.a (mgr.14355) 10561 : audit [DBG] from='client.232710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:07 smithi131 bash[24745]: cluster 2024-09-14T02:25:06.160274+0000 mgr.a (mgr.14355) 10560 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:07 smithi131 bash[24745]: audit 2024-09-14T02:25:06.408410+0000 mgr.a (mgr.14355) 10561 : audit [DBG] from='client.232710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:07 smithi171 bash[25040]: cluster 2024-09-14T02:25:06.160274+0000 mgr.a (mgr.14355) 10560 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:07 smithi171 bash[25040]: audit 2024-09-14T02:25:06.408410+0000 mgr.a (mgr.14355) 10561 : audit [DBG] from='client.232710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:09 smithi007 bash[22722]: cluster 2024-09-14T02:25:08.161171+0000 mgr.a (mgr.14355) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:09 smithi131 bash[24745]: cluster 2024-09-14T02:25:08.161171+0000 mgr.a (mgr.14355) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:09 smithi171 bash[25040]: cluster 2024-09-14T02:25:08.161171+0000 mgr.a (mgr.14355) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:11 smithi007 bash[22722]: cluster 2024-09-14T02:25:10.161960+0000 mgr.a (mgr.14355) 10563 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:11 smithi131 bash[24745]: cluster 2024-09-14T02:25:10.161960+0000 mgr.a (mgr.14355) 10563 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:11 smithi171 bash[25040]: cluster 2024-09-14T02:25:10.161960+0000 mgr.a (mgr.14355) 10563 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:25:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:12.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:12.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:12.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:12.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:12.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:13 smithi007 bash[22722]: cluster 2024-09-14T02:25:12.163286+0000 mgr.a (mgr.14355) 10564 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:25:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:13 smithi007 bash[22722]: audit 2024-09-14T02:25:12.186616+0000 mgr.a (mgr.14355) 10565 : audit [DBG] from='client.232788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:13 smithi131 bash[24745]: cluster 2024-09-14T02:25:12.163286+0000 mgr.a (mgr.14355) 10564 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:25:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:13 smithi131 bash[24745]: audit 2024-09-14T02:25:12.186616+0000 mgr.a (mgr.14355) 10565 : audit [DBG] from='client.232788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:13 smithi171 bash[25040]: cluster 2024-09-14T02:25:12.163286+0000 mgr.a (mgr.14355) 10564 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:25:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:13 smithi171 bash[25040]: audit 2024-09-14T02:25:12.186616+0000 mgr.a (mgr.14355) 10565 : audit [DBG] from='client.232788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:15 smithi007 bash[22722]: cluster 2024-09-14T02:25:14.164104+0000 mgr.a (mgr.14355) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:15 smithi131 bash[24745]: cluster 2024-09-14T02:25:14.164104+0000 mgr.a (mgr.14355) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:15 smithi171 bash[25040]: cluster 2024-09-14T02:25:14.164104+0000 mgr.a (mgr.14355) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:17.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:17.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:17.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:17 smithi007 bash[22722]: cluster 2024-09-14T02:25:16.166371+0000 mgr.a (mgr.14355) 10567 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:17 smithi131 bash[24745]: cluster 2024-09-14T02:25:16.166371+0000 mgr.a (mgr.14355) 10567 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:17 smithi171 bash[25040]: cluster 2024-09-14T02:25:16.166371+0000 mgr.a (mgr.14355) 10567 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:18.384 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:19 smithi007 bash[22722]: audit 2024-09-14T02:25:17.962954+0000 mgr.a (mgr.14355) 10568 : audit [DBG] from='client.232863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:19 smithi007 bash[22722]: cluster 2024-09-14T02:25:18.166873+0000 mgr.a (mgr.14355) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:19 smithi131 bash[24745]: audit 2024-09-14T02:25:17.962954+0000 mgr.a (mgr.14355) 10568 : audit [DBG] from='client.232863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:19 smithi131 bash[24745]: cluster 2024-09-14T02:25:18.166873+0000 mgr.a (mgr.14355) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:19 smithi171 bash[25040]: audit 2024-09-14T02:25:17.962954+0000 mgr.a (mgr.14355) 10568 : audit [DBG] from='client.232863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:19 smithi171 bash[25040]: cluster 2024-09-14T02:25:18.166873+0000 mgr.a (mgr.14355) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:21 smithi007 bash[22722]: cluster 2024-09-14T02:25:20.167804+0000 mgr.a (mgr.14355) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:21 smithi131 bash[24745]: cluster 2024-09-14T02:25:20.167804+0000 mgr.a (mgr.14355) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:21 smithi171 bash[25040]: cluster 2024-09-14T02:25:20.167804+0000 mgr.a (mgr.14355) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:23.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:23.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:23.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:23 smithi007 bash[22722]: cluster 2024-09-14T02:25:22.170120+0000 mgr.a (mgr.14355) 10571 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:23.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:23 smithi131 bash[24745]: cluster 2024-09-14T02:25:22.170120+0000 mgr.a (mgr.14355) 10571 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:23 smithi171 bash[25040]: cluster 2024-09-14T02:25:22.170120+0000 mgr.a (mgr.14355) 10571 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:24.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:24.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:25 smithi007 bash[22722]: audit 2024-09-14T02:25:23.708811+0000 mgr.a (mgr.14355) 10572 : audit [DBG] from='client.232941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:25 smithi007 bash[22722]: cluster 2024-09-14T02:25:24.170922+0000 mgr.a (mgr.14355) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:25 smithi131 bash[24745]: audit 2024-09-14T02:25:23.708811+0000 mgr.a (mgr.14355) 10572 : audit [DBG] from='client.232941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:25 smithi131 bash[24745]: cluster 2024-09-14T02:25:24.170922+0000 mgr.a (mgr.14355) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:25 smithi171 bash[25040]: audit 2024-09-14T02:25:23.708811+0000 mgr.a (mgr.14355) 10572 : audit [DBG] from='client.232941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:25 smithi171 bash[25040]: cluster 2024-09-14T02:25:24.170922+0000 mgr.a (mgr.14355) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:27 smithi007 bash[22722]: cluster 2024-09-14T02:25:26.173121+0000 mgr.a (mgr.14355) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:27 smithi131 bash[24745]: cluster 2024-09-14T02:25:26.173121+0000 mgr.a (mgr.14355) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:27 smithi171 bash[25040]: cluster 2024-09-14T02:25:26.173121+0000 mgr.a (mgr.14355) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:28 smithi131 bash[24745]: audit 2024-09-14T02:25:27.864552+0000 mon.a (mon.0) 2174 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:25:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:28 smithi171 bash[25040]: audit 2024-09-14T02:25:27.864552+0000 mon.a (mon.0) 2174 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:25:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:28 smithi007 bash[22722]: audit 2024-09-14T02:25:27.864552+0000 mon.a (mon.0) 2174 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:25:29.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:29.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:29.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: cluster 2024-09-14T02:25:28.173847+0000 mgr.a (mgr.14355) 10575 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.193501+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.200705+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.222119+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.226931+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.238540+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.242586+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.243310+0000 mon.a (mon.0) 2181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.244009+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.248306+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.250185+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:29.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:29 smithi131 bash[24745]: audit 2024-09-14T02:25:29.251129+0000 mgr.a (mgr.14355) 10576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: cluster 2024-09-14T02:25:28.173847+0000 mgr.a (mgr.14355) 10575 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.193501+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.200705+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.222119+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.226931+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.238540+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.242586+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.243310+0000 mon.a (mon.0) 2181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:25:29.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.244009+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:25:29.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.248306+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.250185+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:29.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:29 smithi171 bash[25040]: audit 2024-09-14T02:25:29.251129+0000 mgr.a (mgr.14355) 10576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: cluster 2024-09-14T02:25:28.173847+0000 mgr.a (mgr.14355) 10575 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.193501+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.200705+0000 mon.a (mon.0) 2176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.222119+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.226931+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.238540+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.242586+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.243310+0000 mon.a (mon.0) 2181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.244009+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.248306+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.250185+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22722]: audit 2024-09-14T02:25:29.251129+0000 mgr.a (mgr.14355) 10576 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:25:30.369 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:30.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:30.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22972]: debug 2024-09-14T02:25:29.957+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:25:30.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:25:29 smithi007 bash[22972]: debug 2024-09-14T02:25:29.969+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:25:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:30 smithi131 bash[24745]: audit 2024-09-14T02:25:29.475601+0000 mgr.a (mgr.14355) 10577 : audit [DBG] from='client.233016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:30 smithi131 bash[24745]: audit 2024-09-14T02:25:29.962116+0000 mgr.a (mgr.14355) 10578 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:30 smithi131 bash[24745]: cephadm 2024-09-14T02:25:29.973921+0000 mgr.a (mgr.14355) 10579 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:30 smithi131 bash[24745]: cluster 2024-09-14T02:25:30.179508+0000 mgr.a (mgr.14355) 10580 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:30 smithi171 bash[25040]: audit 2024-09-14T02:25:29.475601+0000 mgr.a (mgr.14355) 10577 : audit [DBG] from='client.233016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:30 smithi171 bash[25040]: audit 2024-09-14T02:25:29.962116+0000 mgr.a (mgr.14355) 10578 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:25:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:30 smithi171 bash[25040]: cephadm 2024-09-14T02:25:29.973921+0000 mgr.a (mgr.14355) 10579 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:25:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:30 smithi171 bash[25040]: cluster 2024-09-14T02:25:30.179508+0000 mgr.a (mgr.14355) 10580 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:30 smithi007 bash[22722]: audit 2024-09-14T02:25:29.475601+0000 mgr.a (mgr.14355) 10577 : audit [DBG] from='client.233016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:30 smithi007 bash[22722]: audit 2024-09-14T02:25:29.962116+0000 mgr.a (mgr.14355) 10578 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:25:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:30 smithi007 bash[22722]: cephadm 2024-09-14T02:25:29.973921+0000 mgr.a (mgr.14355) 10579 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:25:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:30 smithi007 bash[22722]: cluster 2024-09-14T02:25:30.179508+0000 mgr.a (mgr.14355) 10580 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:33 smithi131 bash[24745]: cluster 2024-09-14T02:25:32.182329+0000 mgr.a (mgr.14355) 10581 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:33 smithi171 bash[25040]: cluster 2024-09-14T02:25:32.182329+0000 mgr.a (mgr.14355) 10581 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:33 smithi007 bash[22722]: cluster 2024-09-14T02:25:32.182329+0000 mgr.a (mgr.14355) 10581 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:35.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:35.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:35 smithi131 bash[24745]: cluster 2024-09-14T02:25:34.183196+0000 mgr.a (mgr.14355) 10582 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:35 smithi171 bash[25040]: cluster 2024-09-14T02:25:34.183196+0000 mgr.a (mgr.14355) 10582 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:35 smithi007 bash[22722]: cluster 2024-09-14T02:25:34.183196+0000 mgr.a (mgr.14355) 10582 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:36.150 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:36.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:37 smithi131 bash[24745]: audit 2024-09-14T02:25:35.709243+0000 mgr.a (mgr.14355) 10583 : audit [DBG] from='client.233202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:37 smithi131 bash[24745]: cluster 2024-09-14T02:25:36.184486+0000 mgr.a (mgr.14355) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:37 smithi171 bash[25040]: audit 2024-09-14T02:25:35.709243+0000 mgr.a (mgr.14355) 10583 : audit [DBG] from='client.233202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:37 smithi171 bash[25040]: cluster 2024-09-14T02:25:36.184486+0000 mgr.a (mgr.14355) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:37 smithi007 bash[22722]: audit 2024-09-14T02:25:35.709243+0000 mgr.a (mgr.14355) 10583 : audit [DBG] from='client.233202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:37 smithi007 bash[22722]: cluster 2024-09-14T02:25:36.184486+0000 mgr.a (mgr.14355) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:39.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:39 smithi131 bash[24745]: cluster 2024-09-14T02:25:38.185215+0000 mgr.a (mgr.14355) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:39 smithi171 bash[25040]: cluster 2024-09-14T02:25:38.185215+0000 mgr.a (mgr.14355) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:39 smithi007 bash[22722]: cluster 2024-09-14T02:25:38.185215+0000 mgr.a (mgr.14355) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:41.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:41.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:41.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:41 smithi131 bash[24745]: cluster 2024-09-14T02:25:40.185963+0000 mgr.a (mgr.14355) 10586 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:41 smithi171 bash[25040]: cluster 2024-09-14T02:25:40.185963+0000 mgr.a (mgr.14355) 10586 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:41.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:41 smithi007 bash[22722]: cluster 2024-09-14T02:25:40.185963+0000 mgr.a (mgr.14355) 10586 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:25:41.901 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:43 smithi131 bash[24745]: audit 2024-09-14T02:25:41.480992+0000 mgr.a (mgr.14355) 10587 : audit [DBG] from='client.233280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:43 smithi131 bash[24745]: cluster 2024-09-14T02:25:42.188748+0000 mgr.a (mgr.14355) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:43 smithi171 bash[25040]: audit 2024-09-14T02:25:41.480992+0000 mgr.a (mgr.14355) 10587 : audit [DBG] from='client.233280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:43 smithi171 bash[25040]: cluster 2024-09-14T02:25:42.188748+0000 mgr.a (mgr.14355) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:43 smithi007 bash[22722]: audit 2024-09-14T02:25:41.480992+0000 mgr.a (mgr.14355) 10587 : audit [DBG] from='client.233280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:43 smithi007 bash[22722]: cluster 2024-09-14T02:25:42.188748+0000 mgr.a (mgr.14355) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:25:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:45 smithi131 bash[24745]: cluster 2024-09-14T02:25:44.189588+0000 mgr.a (mgr.14355) 10589 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:25:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:45 smithi171 bash[25040]: cluster 2024-09-14T02:25:44.189588+0000 mgr.a (mgr.14355) 10589 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:25:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:45 smithi007 bash[22722]: cluster 2024-09-14T02:25:44.189588+0000 mgr.a (mgr.14355) 10589 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:25:46.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:46.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:46.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:47 smithi131 bash[24745]: cluster 2024-09-14T02:25:46.191667+0000 mgr.a (mgr.14355) 10590 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:25:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:47 smithi171 bash[25040]: cluster 2024-09-14T02:25:46.191667+0000 mgr.a (mgr.14355) 10590 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:25:47.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:47 smithi007 bash[22722]: cluster 2024-09-14T02:25:46.191667+0000 mgr.a (mgr.14355) 10590 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:25:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:48 smithi131 bash[24745]: audit 2024-09-14T02:25:47.237220+0000 mgr.a (mgr.14355) 10591 : audit [DBG] from='client.233358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:48 smithi171 bash[25040]: audit 2024-09-14T02:25:47.237220+0000 mgr.a (mgr.14355) 10591 : audit [DBG] from='client.233358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:48 smithi007 bash[22722]: audit 2024-09-14T02:25:47.237220+0000 mgr.a (mgr.14355) 10591 : audit [DBG] from='client.233358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:49 smithi171 bash[25040]: cluster 2024-09-14T02:25:48.192652+0000 mgr.a (mgr.14355) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:49 smithi007 bash[22722]: cluster 2024-09-14T02:25:48.192652+0000 mgr.a (mgr.14355) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:49 smithi131 bash[24745]: cluster 2024-09-14T02:25:48.192652+0000 mgr.a (mgr.14355) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:51 smithi171 bash[25040]: cluster 2024-09-14T02:25:50.194018+0000 mgr.a (mgr.14355) 10593 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:25:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:51 smithi007 bash[22722]: cluster 2024-09-14T02:25:50.194018+0000 mgr.a (mgr.14355) 10593 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:25:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:51 smithi131 bash[24745]: cluster 2024-09-14T02:25:50.194018+0000 mgr.a (mgr.14355) 10593 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:25:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:53.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:53.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:53 smithi171 bash[25040]: cluster 2024-09-14T02:25:52.195692+0000 mgr.a (mgr.14355) 10594 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:53 smithi007 bash[22722]: cluster 2024-09-14T02:25:52.195692+0000 mgr.a (mgr.14355) 10594 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:53 smithi131 bash[24745]: cluster 2024-09-14T02:25:52.195692+0000 mgr.a (mgr.14355) 10594 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:54 smithi007 bash[22722]: audit 2024-09-14T02:25:53.017601+0000 mgr.a (mgr.14355) 10595 : audit [DBG] from='client.233436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:54.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:54 smithi131 bash[24745]: audit 2024-09-14T02:25:53.017601+0000 mgr.a (mgr.14355) 10595 : audit [DBG] from='client.233436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:54 smithi171 bash[25040]: audit 2024-09-14T02:25:53.017601+0000 mgr.a (mgr.14355) 10595 : audit [DBG] from='client.233436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:25:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:55 smithi007 bash[22722]: cluster 2024-09-14T02:25:54.196681+0000 mgr.a (mgr.14355) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:55 smithi131 bash[24745]: cluster 2024-09-14T02:25:54.196681+0000 mgr.a (mgr.14355) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:55 smithi171 bash[25040]: cluster 2024-09-14T02:25:54.196681+0000 mgr.a (mgr.14355) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:57 smithi007 bash[22722]: cluster 2024-09-14T02:25:56.198970+0000 mgr.a (mgr.14355) 10597 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:57 smithi131 bash[24745]: cluster 2024-09-14T02:25:56.198970+0000 mgr.a (mgr.14355) 10597 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:57 smithi171 bash[25040]: cluster 2024-09-14T02:25:56.198970+0000 mgr.a (mgr.14355) 10597 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:25:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:25:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:25:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:25:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:25:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:25:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:25:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:25:59.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:25:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:25:59 smithi007 bash[22722]: cluster 2024-09-14T02:25:58.199726+0000 mgr.a (mgr.14355) 10598 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:25:59 smithi131 bash[24745]: cluster 2024-09-14T02:25:58.199726+0000 mgr.a (mgr.14355) 10598 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:25:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:25:59 smithi171 bash[25040]: cluster 2024-09-14T02:25:58.199726+0000 mgr.a (mgr.14355) 10598 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:00 smithi007 bash[22722]: audit 2024-09-14T02:25:58.777974+0000 mgr.a (mgr.14355) 10599 : audit [DBG] from='client.233511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:00 smithi131 bash[24745]: audit 2024-09-14T02:25:58.777974+0000 mgr.a (mgr.14355) 10599 : audit [DBG] from='client.233511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:00 smithi171 bash[25040]: audit 2024-09-14T02:25:58.777974+0000 mgr.a (mgr.14355) 10599 : audit [DBG] from='client.233511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:01 smithi007 bash[22722]: cluster 2024-09-14T02:26:00.201280+0000 mgr.a (mgr.14355) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:26:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:01 smithi131 bash[24745]: cluster 2024-09-14T02:26:00.201280+0000 mgr.a (mgr.14355) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:26:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:01 smithi171 bash[25040]: cluster 2024-09-14T02:26:00.201280+0000 mgr.a (mgr.14355) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:26:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:03 smithi007 bash[22722]: cluster 2024-09-14T02:26:02.202978+0000 mgr.a (mgr.14355) 10601 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:03 smithi131 bash[24745]: cluster 2024-09-14T02:26:02.202978+0000 mgr.a (mgr.14355) 10601 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:03 smithi171 bash[25040]: cluster 2024-09-14T02:26:02.202978+0000 mgr.a (mgr.14355) 10601 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:04.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:04.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:04.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:05 smithi007 bash[22722]: cluster 2024-09-14T02:26:04.203772+0000 mgr.a (mgr.14355) 10602 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:05 smithi131 bash[24745]: cluster 2024-09-14T02:26:04.203772+0000 mgr.a (mgr.14355) 10602 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:05 smithi171 bash[25040]: cluster 2024-09-14T02:26:04.203772+0000 mgr.a (mgr.14355) 10602 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:06 smithi007 bash[22722]: audit 2024-09-14T02:26:04.546117+0000 mgr.a (mgr.14355) 10603 : audit [DBG] from='client.233589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:06 smithi131 bash[24745]: audit 2024-09-14T02:26:04.546117+0000 mgr.a (mgr.14355) 10603 : audit [DBG] from='client.233589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:06 smithi171 bash[25040]: audit 2024-09-14T02:26:04.546117+0000 mgr.a (mgr.14355) 10603 : audit [DBG] from='client.233589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:07 smithi007 bash[22722]: cluster 2024-09-14T02:26:06.206217+0000 mgr.a (mgr.14355) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:07 smithi131 bash[24745]: cluster 2024-09-14T02:26:06.206217+0000 mgr.a (mgr.14355) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:07 smithi171 bash[25040]: cluster 2024-09-14T02:26:06.206217+0000 mgr.a (mgr.14355) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:09 smithi007 bash[22722]: cluster 2024-09-14T02:26:08.206972+0000 mgr.a (mgr.14355) 10605 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:09 smithi131 bash[24745]: cluster 2024-09-14T02:26:08.206972+0000 mgr.a (mgr.14355) 10605 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:09 smithi171 bash[25040]: cluster 2024-09-14T02:26:08.206972+0000 mgr.a (mgr.14355) 10605 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:10.718 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:10.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:10.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:11 smithi007 bash[22722]: cluster 2024-09-14T02:26:10.208100+0000 mgr.a (mgr.14355) 10606 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:11 smithi007 bash[22722]: audit 2024-09-14T02:26:10.297866+0000 mgr.a (mgr.14355) 10607 : audit [DBG] from='client.233667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:11 smithi131 bash[24745]: cluster 2024-09-14T02:26:10.208100+0000 mgr.a (mgr.14355) 10606 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:11 smithi131 bash[24745]: audit 2024-09-14T02:26:10.297866+0000 mgr.a (mgr.14355) 10607 : audit [DBG] from='client.233667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:11 smithi171 bash[25040]: cluster 2024-09-14T02:26:10.208100+0000 mgr.a (mgr.14355) 10606 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:11 smithi171 bash[25040]: audit 2024-09-14T02:26:10.297866+0000 mgr.a (mgr.14355) 10607 : audit [DBG] from='client.233667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:13 smithi007 bash[22722]: cluster 2024-09-14T02:26:12.210364+0000 mgr.a (mgr.14355) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:26:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:13 smithi131 bash[24745]: cluster 2024-09-14T02:26:12.210364+0000 mgr.a (mgr.14355) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:26:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:13 smithi171 bash[25040]: cluster 2024-09-14T02:26:12.210364+0000 mgr.a (mgr.14355) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:26:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:15 smithi007 bash[22722]: cluster 2024-09-14T02:26:14.211155+0000 mgr.a (mgr.14355) 10609 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:15.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:15.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:15 smithi131 bash[24745]: cluster 2024-09-14T02:26:14.211155+0000 mgr.a (mgr.14355) 10609 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:15 smithi171 bash[25040]: cluster 2024-09-14T02:26:14.211155+0000 mgr.a (mgr.14355) 10609 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:16.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:16.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:17 smithi007 bash[22722]: audit 2024-09-14T02:26:16.057386+0000 mgr.a (mgr.14355) 10610 : audit [DBG] from='client.233742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:17 smithi007 bash[22722]: cluster 2024-09-14T02:26:16.212640+0000 mgr.a (mgr.14355) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:17 smithi131 bash[24745]: audit 2024-09-14T02:26:16.057386+0000 mgr.a (mgr.14355) 10610 : audit [DBG] from='client.233742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:17 smithi131 bash[24745]: cluster 2024-09-14T02:26:16.212640+0000 mgr.a (mgr.14355) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:17 smithi171 bash[25040]: audit 2024-09-14T02:26:16.057386+0000 mgr.a (mgr.14355) 10610 : audit [DBG] from='client.233742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:17 smithi171 bash[25040]: cluster 2024-09-14T02:26:16.212640+0000 mgr.a (mgr.14355) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:19 smithi007 bash[22722]: cluster 2024-09-14T02:26:18.213525+0000 mgr.a (mgr.14355) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:19 smithi131 bash[24745]: cluster 2024-09-14T02:26:18.213525+0000 mgr.a (mgr.14355) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:19 smithi171 bash[25040]: cluster 2024-09-14T02:26:18.213525+0000 mgr.a (mgr.14355) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:21.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:21.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:21.505 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:21 smithi007 bash[22722]: cluster 2024-09-14T02:26:20.214932+0000 mgr.a (mgr.14355) 10613 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:26:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:21 smithi131 bash[24745]: cluster 2024-09-14T02:26:20.214932+0000 mgr.a (mgr.14355) 10613 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:26:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:21 smithi171 bash[25040]: cluster 2024-09-14T02:26:20.214932+0000 mgr.a (mgr.14355) 10613 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:26:22.277 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:22.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:23 smithi007 bash[22722]: audit 2024-09-14T02:26:21.841924+0000 mgr.a (mgr.14355) 10614 : audit [DBG] from='client.233817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:23 smithi007 bash[22722]: cluster 2024-09-14T02:26:22.216090+0000 mgr.a (mgr.14355) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:23.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:23 smithi131 bash[24745]: audit 2024-09-14T02:26:21.841924+0000 mgr.a (mgr.14355) 10614 : audit [DBG] from='client.233817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:23 smithi131 bash[24745]: cluster 2024-09-14T02:26:22.216090+0000 mgr.a (mgr.14355) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:23 smithi171 bash[25040]: audit 2024-09-14T02:26:21.841924+0000 mgr.a (mgr.14355) 10614 : audit [DBG] from='client.233817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:23 smithi171 bash[25040]: cluster 2024-09-14T02:26:22.216090+0000 mgr.a (mgr.14355) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:25 smithi007 bash[22722]: cluster 2024-09-14T02:26:24.216858+0000 mgr.a (mgr.14355) 10616 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:25 smithi131 bash[24745]: cluster 2024-09-14T02:26:24.216858+0000 mgr.a (mgr.14355) 10616 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:25 smithi171 bash[25040]: cluster 2024-09-14T02:26:24.216858+0000 mgr.a (mgr.14355) 10616 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:27.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:27.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:27.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:27 smithi007 bash[22722]: cluster 2024-09-14T02:26:26.218936+0000 mgr.a (mgr.14355) 10617 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:27 smithi131 bash[24745]: cluster 2024-09-14T02:26:26.218936+0000 mgr.a (mgr.14355) 10617 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:27 smithi171 bash[25040]: cluster 2024-09-14T02:26:26.218936+0000 mgr.a (mgr.14355) 10617 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:28.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:29 smithi007 bash[22722]: audit 2024-09-14T02:26:27.619513+0000 mgr.a (mgr.14355) 10618 : audit [DBG] from='client.233892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:29 smithi007 bash[22722]: cluster 2024-09-14T02:26:28.219868+0000 mgr.a (mgr.14355) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:29 smithi131 bash[24745]: audit 2024-09-14T02:26:27.619513+0000 mgr.a (mgr.14355) 10618 : audit [DBG] from='client.233892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:29 smithi131 bash[24745]: cluster 2024-09-14T02:26:28.219868+0000 mgr.a (mgr.14355) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:29 smithi171 bash[25040]: audit 2024-09-14T02:26:27.619513+0000 mgr.a (mgr.14355) 10618 : audit [DBG] from='client.233892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:29 smithi171 bash[25040]: cluster 2024-09-14T02:26:28.219868+0000 mgr.a (mgr.14355) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:30 smithi007 bash[22722]: audit 2024-09-14T02:26:30.034474+0000 mon.a (mon.0) 2185 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:26:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:30 smithi131 bash[24745]: audit 2024-09-14T02:26:30.034474+0000 mon.a (mon.0) 2185 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:26:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:30 smithi171 bash[25040]: audit 2024-09-14T02:26:30.034474+0000 mon.a (mon.0) 2185 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:26:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22722]: cluster 2024-09-14T02:26:30.220973+0000 mgr.a (mgr.14355) 10620 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:26:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22722]: audit 2024-09-14T02:26:30.881848+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:26:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22722]: audit 2024-09-14T02:26:30.883642+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:26:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22722]: audit 2024-09-14T02:26:30.894432+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:26:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22722]: audit 2024-09-14T02:26:30.899276+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:31.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22972]: debug 2024-09-14T02:26:31.640+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:26:31.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:26:31 smithi007 bash[22972]: debug 2024-09-14T02:26:31.640+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:26:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:31 smithi131 bash[24745]: cluster 2024-09-14T02:26:30.220973+0000 mgr.a (mgr.14355) 10620 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:26:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:31 smithi131 bash[24745]: audit 2024-09-14T02:26:30.881848+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:26:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:31 smithi131 bash[24745]: audit 2024-09-14T02:26:30.883642+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:26:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:31 smithi131 bash[24745]: audit 2024-09-14T02:26:30.894432+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:26:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:31 smithi131 bash[24745]: audit 2024-09-14T02:26:30.899276+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:31 smithi171 bash[25040]: cluster 2024-09-14T02:26:30.220973+0000 mgr.a (mgr.14355) 10620 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T02:26:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:31 smithi171 bash[25040]: audit 2024-09-14T02:26:30.881848+0000 mon.a (mon.0) 2186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:26:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:31 smithi171 bash[25040]: audit 2024-09-14T02:26:30.883642+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:26:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:31 smithi171 bash[25040]: audit 2024-09-14T02:26:30.894432+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:26:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:31 smithi171 bash[25040]: audit 2024-09-14T02:26:30.899276+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:32 smithi007 bash[22722]: audit 2024-09-14T02:26:30.900648+0000 mgr.a (mgr.14355) 10621 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:32 smithi131 bash[24745]: audit 2024-09-14T02:26:30.900648+0000 mgr.a (mgr.14355) 10621 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:32 smithi171 bash[25040]: audit 2024-09-14T02:26:30.900648+0000 mgr.a (mgr.14355) 10621 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:26:33.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:33.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:33 smithi007 bash[22722]: audit 2024-09-14T02:26:31.643751+0000 mgr.a (mgr.14355) 10622 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:26:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:33 smithi007 bash[22722]: cephadm 2024-09-14T02:26:31.645211+0000 mgr.a (mgr.14355) 10623 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:26:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:33 smithi007 bash[22722]: cluster 2024-09-14T02:26:32.222768+0000 mgr.a (mgr.14355) 10624 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:33 smithi131 bash[24745]: audit 2024-09-14T02:26:31.643751+0000 mgr.a (mgr.14355) 10622 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:26:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:33 smithi131 bash[24745]: cephadm 2024-09-14T02:26:31.645211+0000 mgr.a (mgr.14355) 10623 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:26:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:33 smithi131 bash[24745]: cluster 2024-09-14T02:26:32.222768+0000 mgr.a (mgr.14355) 10624 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:33 smithi171 bash[25040]: audit 2024-09-14T02:26:31.643751+0000 mgr.a (mgr.14355) 10622 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:26:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:33 smithi171 bash[25040]: cephadm 2024-09-14T02:26:31.645211+0000 mgr.a (mgr.14355) 10623 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:26:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:33 smithi171 bash[25040]: cluster 2024-09-14T02:26:32.222768+0000 mgr.a (mgr.14355) 10624 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:26:33.843 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:34 smithi007 bash[22722]: audit 2024-09-14T02:26:33.399561+0000 mgr.a (mgr.14355) 10625 : audit [DBG] from='client.234078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:34 smithi131 bash[24745]: audit 2024-09-14T02:26:33.399561+0000 mgr.a (mgr.14355) 10625 : audit [DBG] from='client.234078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:34 smithi171 bash[25040]: audit 2024-09-14T02:26:33.399561+0000 mgr.a (mgr.14355) 10625 : audit [DBG] from='client.234078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:35 smithi007 bash[22722]: cluster 2024-09-14T02:26:34.223751+0000 mgr.a (mgr.14355) 10626 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:35 smithi131 bash[24745]: cluster 2024-09-14T02:26:34.223751+0000 mgr.a (mgr.14355) 10626 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:35 smithi171 bash[25040]: cluster 2024-09-14T02:26:34.223751+0000 mgr.a (mgr.14355) 10626 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:37 smithi007 bash[22722]: cluster 2024-09-14T02:26:36.225974+0000 mgr.a (mgr.14355) 10627 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:37 smithi131 bash[24745]: cluster 2024-09-14T02:26:36.225974+0000 mgr.a (mgr.14355) 10627 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:37 smithi171 bash[25040]: cluster 2024-09-14T02:26:36.225974+0000 mgr.a (mgr.14355) 10627 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:39.602 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:39 smithi007 bash[22722]: cluster 2024-09-14T02:26:38.226771+0000 mgr.a (mgr.14355) 10628 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:39 smithi131 bash[24745]: cluster 2024-09-14T02:26:38.226771+0000 mgr.a (mgr.14355) 10628 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:39 smithi171 bash[25040]: cluster 2024-09-14T02:26:38.226771+0000 mgr.a (mgr.14355) 10628 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:40 smithi007 bash[22722]: audit 2024-09-14T02:26:39.178685+0000 mgr.a (mgr.14355) 10629 : audit [DBG] from='client.234156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:40 smithi131 bash[24745]: audit 2024-09-14T02:26:39.178685+0000 mgr.a (mgr.14355) 10629 : audit [DBG] from='client.234156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:40 smithi171 bash[25040]: audit 2024-09-14T02:26:39.178685+0000 mgr.a (mgr.14355) 10629 : audit [DBG] from='client.234156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:41 smithi007 bash[22722]: cluster 2024-09-14T02:26:40.229128+0000 mgr.a (mgr.14355) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:41 smithi131 bash[24745]: cluster 2024-09-14T02:26:40.229128+0000 mgr.a (mgr.14355) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:41 smithi171 bash[25040]: cluster 2024-09-14T02:26:40.229128+0000 mgr.a (mgr.14355) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:43 smithi007 bash[22722]: cluster 2024-09-14T02:26:42.229912+0000 mgr.a (mgr.14355) 10631 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:43 smithi131 bash[24745]: cluster 2024-09-14T02:26:42.229912+0000 mgr.a (mgr.14355) 10631 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:43 smithi171 bash[25040]: cluster 2024-09-14T02:26:42.229912+0000 mgr.a (mgr.14355) 10631 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:44.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:44.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:45.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:45.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:45 smithi131 bash[24745]: cluster 2024-09-14T02:26:44.230724+0000 mgr.a (mgr.14355) 10632 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:45 smithi171 bash[25040]: cluster 2024-09-14T02:26:44.230724+0000 mgr.a (mgr.14355) 10632 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:45 smithi007 bash[22722]: cluster 2024-09-14T02:26:44.230724+0000 mgr.a (mgr.14355) 10632 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:46 smithi131 bash[24745]: audit 2024-09-14T02:26:44.932118+0000 mgr.a (mgr.14355) 10633 : audit [DBG] from='client.234234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:46 smithi171 bash[25040]: audit 2024-09-14T02:26:44.932118+0000 mgr.a (mgr.14355) 10633 : audit [DBG] from='client.234234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:46 smithi007 bash[22722]: audit 2024-09-14T02:26:44.932118+0000 mgr.a (mgr.14355) 10633 : audit [DBG] from='client.234234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:47 smithi131 bash[24745]: cluster 2024-09-14T02:26:46.233652+0000 mgr.a (mgr.14355) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:47 smithi171 bash[25040]: cluster 2024-09-14T02:26:46.233652+0000 mgr.a (mgr.14355) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:47 smithi007 bash[22722]: cluster 2024-09-14T02:26:46.233652+0000 mgr.a (mgr.14355) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:26:49.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:49 smithi131 bash[24745]: cluster 2024-09-14T02:26:48.234540+0000 mgr.a (mgr.14355) 10635 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:26:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:49 smithi171 bash[25040]: cluster 2024-09-14T02:26:48.234540+0000 mgr.a (mgr.14355) 10635 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:26:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:49 smithi007 bash[22722]: cluster 2024-09-14T02:26:48.234540+0000 mgr.a (mgr.14355) 10635 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:26:50.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:50.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:50.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:51.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:51.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:51.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:51 smithi171 bash[25040]: cluster 2024-09-14T02:26:50.236600+0000 mgr.a (mgr.14355) 10636 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:51 smithi007 bash[22722]: cluster 2024-09-14T02:26:50.236600+0000 mgr.a (mgr.14355) 10636 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:51 smithi131 bash[24745]: cluster 2024-09-14T02:26:50.236600+0000 mgr.a (mgr.14355) 10636 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:52 smithi007 bash[22722]: audit 2024-09-14T02:26:50.686181+0000 mgr.a (mgr.14355) 10637 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:52 smithi131 bash[24745]: audit 2024-09-14T02:26:50.686181+0000 mgr.a (mgr.14355) 10637 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:52 smithi171 bash[25040]: audit 2024-09-14T02:26:50.686181+0000 mgr.a (mgr.14355) 10637 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:53 smithi007 bash[22722]: cluster 2024-09-14T02:26:52.237533+0000 mgr.a (mgr.14355) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:53 smithi131 bash[24745]: cluster 2024-09-14T02:26:52.237533+0000 mgr.a (mgr.14355) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:53 smithi171 bash[25040]: cluster 2024-09-14T02:26:52.237533+0000 mgr.a (mgr.14355) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:26:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:55 smithi007 bash[22722]: cluster 2024-09-14T02:26:54.238352+0000 mgr.a (mgr.14355) 10639 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:26:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:55 smithi131 bash[24745]: cluster 2024-09-14T02:26:54.238352+0000 mgr.a (mgr.14355) 10639 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:26:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:55 smithi171 bash[25040]: cluster 2024-09-14T02:26:54.238352+0000 mgr.a (mgr.14355) 10639 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:26:56.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:26:56.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:26:56.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:26:56.872 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:26:56.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:26:56.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:26:56.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:26:56.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:26:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:57 smithi007 bash[22722]: cluster 2024-09-14T02:26:56.239433+0000 mgr.a (mgr.14355) 10640 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:57 smithi007 bash[22722]: audit 2024-09-14T02:26:56.451423+0000 mgr.a (mgr.14355) 10641 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:57 smithi131 bash[24745]: cluster 2024-09-14T02:26:56.239433+0000 mgr.a (mgr.14355) 10640 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:57 smithi131 bash[24745]: audit 2024-09-14T02:26:56.451423+0000 mgr.a (mgr.14355) 10641 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:57 smithi171 bash[25040]: cluster 2024-09-14T02:26:56.239433+0000 mgr.a (mgr.14355) 10640 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:26:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:57 smithi171 bash[25040]: audit 2024-09-14T02:26:56.451423+0000 mgr.a (mgr.14355) 10641 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:26:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:26:59 smithi007 bash[22722]: cluster 2024-09-14T02:26:58.240301+0000 mgr.a (mgr.14355) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:26:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:26:59 smithi131 bash[24745]: cluster 2024-09-14T02:26:58.240301+0000 mgr.a (mgr.14355) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:26:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:26:59 smithi171 bash[25040]: cluster 2024-09-14T02:26:58.240301+0000 mgr.a (mgr.14355) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:27:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:01 smithi007 bash[22722]: cluster 2024-09-14T02:27:00.242517+0000 mgr.a (mgr.14355) 10643 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:27:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:01 smithi131 bash[24745]: cluster 2024-09-14T02:27:00.242517+0000 mgr.a (mgr.14355) 10643 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:27:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:01 smithi171 bash[25040]: cluster 2024-09-14T02:27:00.242517+0000 mgr.a (mgr.14355) 10643 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:27:01.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:01.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:02.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:02.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:02.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:02.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:02.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:03 smithi007 bash[22722]: audit 2024-09-14T02:27:02.205946+0000 mgr.a (mgr.14355) 10644 : audit [DBG] from='client.234462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:03 smithi007 bash[22722]: cluster 2024-09-14T02:27:02.243694+0000 mgr.a (mgr.14355) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:03 smithi131 bash[24745]: audit 2024-09-14T02:27:02.205946+0000 mgr.a (mgr.14355) 10644 : audit [DBG] from='client.234462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:03 smithi131 bash[24745]: cluster 2024-09-14T02:27:02.243694+0000 mgr.a (mgr.14355) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:03 smithi171 bash[25040]: audit 2024-09-14T02:27:02.205946+0000 mgr.a (mgr.14355) 10644 : audit [DBG] from='client.234462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:03 smithi171 bash[25040]: cluster 2024-09-14T02:27:02.243694+0000 mgr.a (mgr.14355) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:05 smithi007 bash[22722]: cluster 2024-09-14T02:27:04.244716+0000 mgr.a (mgr.14355) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:05 smithi131 bash[24745]: cluster 2024-09-14T02:27:04.244716+0000 mgr.a (mgr.14355) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:05 smithi171 bash[25040]: cluster 2024-09-14T02:27:04.244716+0000 mgr.a (mgr.14355) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:07.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:07.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:07 smithi007 bash[22722]: cluster 2024-09-14T02:27:06.246995+0000 mgr.a (mgr.14355) 10647 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:07 smithi131 bash[24745]: cluster 2024-09-14T02:27:06.246995+0000 mgr.a (mgr.14355) 10647 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:07 smithi171 bash[25040]: cluster 2024-09-14T02:27:06.246995+0000 mgr.a (mgr.14355) 10647 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:08.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:08.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:09 smithi007 bash[22722]: audit 2024-09-14T02:27:07.971010+0000 mgr.a (mgr.14355) 10648 : audit [DBG] from='client.234537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:09 smithi007 bash[22722]: cluster 2024-09-14T02:27:08.247499+0000 mgr.a (mgr.14355) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:09 smithi131 bash[24745]: audit 2024-09-14T02:27:07.971010+0000 mgr.a (mgr.14355) 10648 : audit [DBG] from='client.234537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:09 smithi131 bash[24745]: cluster 2024-09-14T02:27:08.247499+0000 mgr.a (mgr.14355) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:09 smithi171 bash[25040]: audit 2024-09-14T02:27:07.971010+0000 mgr.a (mgr.14355) 10648 : audit [DBG] from='client.234537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:09 smithi171 bash[25040]: cluster 2024-09-14T02:27:08.247499+0000 mgr.a (mgr.14355) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:11 smithi007 bash[22722]: cluster 2024-09-14T02:27:10.249701+0000 mgr.a (mgr.14355) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:11 smithi131 bash[24745]: cluster 2024-09-14T02:27:10.249701+0000 mgr.a (mgr.14355) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:11 smithi171 bash[25040]: cluster 2024-09-14T02:27:10.249701+0000 mgr.a (mgr.14355) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:13.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:13 smithi007 bash[22722]: cluster 2024-09-14T02:27:12.250518+0000 mgr.a (mgr.14355) 10651 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:13 smithi131 bash[24745]: cluster 2024-09-14T02:27:12.250518+0000 mgr.a (mgr.14355) 10651 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:13 smithi171 bash[25040]: cluster 2024-09-14T02:27:12.250518+0000 mgr.a (mgr.14355) 10651 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:14.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:14.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:15 smithi007 bash[22722]: audit 2024-09-14T02:27:13.735605+0000 mgr.a (mgr.14355) 10652 : audit [DBG] from='client.234612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:15 smithi007 bash[22722]: cluster 2024-09-14T02:27:14.251292+0000 mgr.a (mgr.14355) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:15 smithi131 bash[24745]: audit 2024-09-14T02:27:13.735605+0000 mgr.a (mgr.14355) 10652 : audit [DBG] from='client.234612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:15 smithi131 bash[24745]: cluster 2024-09-14T02:27:14.251292+0000 mgr.a (mgr.14355) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:15 smithi171 bash[25040]: audit 2024-09-14T02:27:13.735605+0000 mgr.a (mgr.14355) 10652 : audit [DBG] from='client.234612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:15 smithi171 bash[25040]: cluster 2024-09-14T02:27:14.251292+0000 mgr.a (mgr.14355) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:17 smithi007 bash[22722]: cluster 2024-09-14T02:27:16.253564+0000 mgr.a (mgr.14355) 10654 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:17 smithi131 bash[24745]: cluster 2024-09-14T02:27:16.253564+0000 mgr.a (mgr.14355) 10654 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:17 smithi171 bash[25040]: cluster 2024-09-14T02:27:16.253564+0000 mgr.a (mgr.14355) 10654 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:19.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:19.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:19.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:19.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:19 smithi007 bash[22722]: cluster 2024-09-14T02:27:18.254344+0000 mgr.a (mgr.14355) 10655 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:19 smithi131 bash[24745]: cluster 2024-09-14T02:27:18.254344+0000 mgr.a (mgr.14355) 10655 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:19 smithi171 bash[25040]: cluster 2024-09-14T02:27:18.254344+0000 mgr.a (mgr.14355) 10655 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:19.936 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:19.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:21 smithi007 bash[22722]: audit 2024-09-14T02:27:19.491422+0000 mgr.a (mgr.14355) 10656 : audit [DBG] from='client.234687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:21 smithi007 bash[22722]: cluster 2024-09-14T02:27:20.256743+0000 mgr.a (mgr.14355) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:21 smithi131 bash[24745]: audit 2024-09-14T02:27:19.491422+0000 mgr.a (mgr.14355) 10656 : audit [DBG] from='client.234687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:21 smithi131 bash[24745]: cluster 2024-09-14T02:27:20.256743+0000 mgr.a (mgr.14355) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:21 smithi171 bash[25040]: audit 2024-09-14T02:27:19.491422+0000 mgr.a (mgr.14355) 10656 : audit [DBG] from='client.234687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:21 smithi171 bash[25040]: cluster 2024-09-14T02:27:20.256743+0000 mgr.a (mgr.14355) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:23 smithi007 bash[22722]: cluster 2024-09-14T02:27:22.257676+0000 mgr.a (mgr.14355) 10658 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:23 smithi131 bash[24745]: cluster 2024-09-14T02:27:22.257676+0000 mgr.a (mgr.14355) 10658 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:23 smithi171 bash[25040]: cluster 2024-09-14T02:27:22.257676+0000 mgr.a (mgr.14355) 10658 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:24.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:24.939 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:25.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:25.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:25.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:25 smithi007 bash[22722]: cluster 2024-09-14T02:27:24.258502+0000 mgr.a (mgr.14355) 10659 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:25 smithi131 bash[24745]: cluster 2024-09-14T02:27:24.258502+0000 mgr.a (mgr.14355) 10659 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:25 smithi171 bash[25040]: cluster 2024-09-14T02:27:24.258502+0000 mgr.a (mgr.14355) 10659 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:26 smithi007 bash[22722]: audit 2024-09-14T02:27:25.270743+0000 mgr.a (mgr.14355) 10660 : audit [DBG] from='client.234765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:26 smithi131 bash[24745]: audit 2024-09-14T02:27:25.270743+0000 mgr.a (mgr.14355) 10660 : audit [DBG] from='client.234765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:26 smithi171 bash[25040]: audit 2024-09-14T02:27:25.270743+0000 mgr.a (mgr.14355) 10660 : audit [DBG] from='client.234765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:27 smithi007 bash[22722]: cluster 2024-09-14T02:27:26.261396+0000 mgr.a (mgr.14355) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:27 smithi131 bash[24745]: cluster 2024-09-14T02:27:26.261396+0000 mgr.a (mgr.14355) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:27 smithi171 bash[25040]: cluster 2024-09-14T02:27:26.261396+0000 mgr.a (mgr.14355) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:29 smithi007 bash[22722]: cluster 2024-09-14T02:27:28.262198+0000 mgr.a (mgr.14355) 10662 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:29 smithi131 bash[24745]: cluster 2024-09-14T02:27:28.262198+0000 mgr.a (mgr.14355) 10662 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:29 smithi171 bash[25040]: cluster 2024-09-14T02:27:28.262198+0000 mgr.a (mgr.14355) 10662 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:30.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:30.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:31.449 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:31.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:31 smithi007 bash[22722]: cluster 2024-09-14T02:27:30.264092+0000 mgr.a (mgr.14355) 10663 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:31 smithi131 bash[24745]: cluster 2024-09-14T02:27:30.264092+0000 mgr.a (mgr.14355) 10663 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:31 smithi171 bash[25040]: cluster 2024-09-14T02:27:30.264092+0000 mgr.a (mgr.14355) 10663 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:32 smithi007 bash[22722]: audit 2024-09-14T02:27:31.022898+0000 mgr.a (mgr.14355) 10664 : audit [DBG] from='client.234843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:32 smithi007 bash[22722]: audit 2024-09-14T02:27:31.696514+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:32 smithi007 bash[22722]: audit 2024-09-14T02:27:32.322648+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:32 smithi007 bash[22722]: audit 2024-09-14T02:27:32.326850+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:32 smithi131 bash[24745]: audit 2024-09-14T02:27:31.022898+0000 mgr.a (mgr.14355) 10664 : audit [DBG] from='client.234843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:32 smithi131 bash[24745]: audit 2024-09-14T02:27:31.696514+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:27:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:32 smithi131 bash[24745]: audit 2024-09-14T02:27:32.322648+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:32 smithi131 bash[24745]: audit 2024-09-14T02:27:32.326850+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:32 smithi171 bash[25040]: audit 2024-09-14T02:27:31.022898+0000 mgr.a (mgr.14355) 10664 : audit [DBG] from='client.234843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:32 smithi171 bash[25040]: audit 2024-09-14T02:27:31.696514+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:27:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:32 smithi171 bash[25040]: audit 2024-09-14T02:27:32.322648+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:32 smithi171 bash[25040]: audit 2024-09-14T02:27:32.326850+0000 mon.a (mon.0) 2192 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22722]: cluster 2024-09-14T02:27:32.264908+0000 mgr.a (mgr.14355) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22722]: audit 2024-09-14T02:27:33.118163+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:27:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22722]: audit 2024-09-14T02:27:33.119814+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:27:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22722]: audit 2024-09-14T02:27:33.130419+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22722]: audit 2024-09-14T02:27:33.135232+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:33 smithi131 bash[24745]: cluster 2024-09-14T02:27:32.264908+0000 mgr.a (mgr.14355) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:33 smithi131 bash[24745]: audit 2024-09-14T02:27:33.118163+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:33 smithi131 bash[24745]: audit 2024-09-14T02:27:33.119814+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:33 smithi131 bash[24745]: audit 2024-09-14T02:27:33.130419+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:33 smithi131 bash[24745]: audit 2024-09-14T02:27:33.135232+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:33 smithi171 bash[25040]: cluster 2024-09-14T02:27:32.264908+0000 mgr.a (mgr.14355) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:33 smithi171 bash[25040]: audit 2024-09-14T02:27:33.118163+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:33 smithi171 bash[25040]: audit 2024-09-14T02:27:33.119814+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:33 smithi171 bash[25040]: audit 2024-09-14T02:27:33.130419+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:33 smithi171 bash[25040]: audit 2024-09-14T02:27:33.135232+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:34.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22972]: debug 2024-09-14T02:27:33.864+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:27:34.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:27:33 smithi007 bash[22972]: debug 2024-09-14T02:27:33.868+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:27:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:34 smithi007 bash[22722]: audit 2024-09-14T02:27:33.137762+0000 mgr.a (mgr.14355) 10666 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:34.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:34 smithi131 bash[24745]: audit 2024-09-14T02:27:33.137762+0000 mgr.a (mgr.14355) 10666 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:34 smithi171 bash[25040]: audit 2024-09-14T02:27:33.137762+0000 mgr.a (mgr.14355) 10666 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:27:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:35 smithi007 bash[22722]: audit 2024-09-14T02:27:33.869192+0000 mgr.a (mgr.14355) 10667 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:27:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:35 smithi007 bash[22722]: cephadm 2024-09-14T02:27:33.870850+0000 mgr.a (mgr.14355) 10668 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:27:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:35 smithi007 bash[22722]: cluster 2024-09-14T02:27:34.266001+0000 mgr.a (mgr.14355) 10669 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:27:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:35 smithi131 bash[24745]: audit 2024-09-14T02:27:33.869192+0000 mgr.a (mgr.14355) 10667 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:27:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:35 smithi131 bash[24745]: cephadm 2024-09-14T02:27:33.870850+0000 mgr.a (mgr.14355) 10668 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:27:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:35 smithi131 bash[24745]: cluster 2024-09-14T02:27:34.266001+0000 mgr.a (mgr.14355) 10669 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:27:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:35 smithi171 bash[25040]: audit 2024-09-14T02:27:33.869192+0000 mgr.a (mgr.14355) 10667 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:27:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:35 smithi171 bash[25040]: cephadm 2024-09-14T02:27:33.870850+0000 mgr.a (mgr.14355) 10668 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:27:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:35 smithi171 bash[25040]: cluster 2024-09-14T02:27:34.266001+0000 mgr.a (mgr.14355) 10669 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:27:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:36.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:37.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:37.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:37 smithi007 bash[22722]: cluster 2024-09-14T02:27:36.268325+0000 mgr.a (mgr.14355) 10670 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:37 smithi131 bash[24745]: cluster 2024-09-14T02:27:36.268325+0000 mgr.a (mgr.14355) 10670 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:37 smithi171 bash[25040]: cluster 2024-09-14T02:27:36.268325+0000 mgr.a (mgr.14355) 10670 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:38 smithi007 bash[22722]: audit 2024-09-14T02:27:36.787611+0000 mgr.a (mgr.14355) 10671 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:38 smithi131 bash[24745]: audit 2024-09-14T02:27:36.787611+0000 mgr.a (mgr.14355) 10671 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:38 smithi171 bash[25040]: audit 2024-09-14T02:27:36.787611+0000 mgr.a (mgr.14355) 10671 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:39 smithi007 bash[22722]: cluster 2024-09-14T02:27:38.269236+0000 mgr.a (mgr.14355) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:39 smithi131 bash[24745]: cluster 2024-09-14T02:27:38.269236+0000 mgr.a (mgr.14355) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:39 smithi171 bash[25040]: cluster 2024-09-14T02:27:38.269236+0000 mgr.a (mgr.14355) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:41 smithi007 bash[22722]: cluster 2024-09-14T02:27:40.271395+0000 mgr.a (mgr.14355) 10673 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:41 smithi131 bash[24745]: cluster 2024-09-14T02:27:40.271395+0000 mgr.a (mgr.14355) 10673 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:41 smithi171 bash[25040]: cluster 2024-09-14T02:27:40.271395+0000 mgr.a (mgr.14355) 10673 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:42.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:42.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:42.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:42.997 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:42.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:42.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:42.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:42.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:43 smithi007 bash[22722]: cluster 2024-09-14T02:27:42.272115+0000 mgr.a (mgr.14355) 10674 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:43 smithi131 bash[24745]: cluster 2024-09-14T02:27:42.272115+0000 mgr.a (mgr.14355) 10674 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:43 smithi171 bash[25040]: cluster 2024-09-14T02:27:42.272115+0000 mgr.a (mgr.14355) 10674 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:44 smithi007 bash[22722]: audit 2024-09-14T02:27:42.578504+0000 mgr.a (mgr.14355) 10675 : audit [DBG] from='client.235107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:44.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:44 smithi131 bash[24745]: audit 2024-09-14T02:27:42.578504+0000 mgr.a (mgr.14355) 10675 : audit [DBG] from='client.235107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:44 smithi171 bash[25040]: audit 2024-09-14T02:27:42.578504+0000 mgr.a (mgr.14355) 10675 : audit [DBG] from='client.235107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:45 smithi007 bash[22722]: cluster 2024-09-14T02:27:44.273022+0000 mgr.a (mgr.14355) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:45 smithi131 bash[24745]: cluster 2024-09-14T02:27:44.273022+0000 mgr.a (mgr.14355) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:45 smithi171 bash[25040]: cluster 2024-09-14T02:27:44.273022+0000 mgr.a (mgr.14355) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:47 smithi131 bash[24745]: cluster 2024-09-14T02:27:46.275295+0000 mgr.a (mgr.14355) 10677 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:47 smithi171 bash[25040]: cluster 2024-09-14T02:27:46.275295+0000 mgr.a (mgr.14355) 10677 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:47 smithi007 bash[22722]: cluster 2024-09-14T02:27:46.275295+0000 mgr.a (mgr.14355) 10677 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:27:47.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:48.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:48.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:48.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:48.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:48.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:49 smithi131 bash[24745]: cluster 2024-09-14T02:27:48.276017+0000 mgr.a (mgr.14355) 10678 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:49 smithi131 bash[24745]: audit 2024-09-14T02:27:48.339728+0000 mgr.a (mgr.14355) 10679 : audit [DBG] from='client.235185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:49 smithi171 bash[25040]: cluster 2024-09-14T02:27:48.276017+0000 mgr.a (mgr.14355) 10678 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:49 smithi171 bash[25040]: audit 2024-09-14T02:27:48.339728+0000 mgr.a (mgr.14355) 10679 : audit [DBG] from='client.235185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:49 smithi007 bash[22722]: cluster 2024-09-14T02:27:48.276017+0000 mgr.a (mgr.14355) 10678 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:49 smithi007 bash[22722]: audit 2024-09-14T02:27:48.339728+0000 mgr.a (mgr.14355) 10679 : audit [DBG] from='client.235185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:51 smithi007 bash[22722]: cluster 2024-09-14T02:27:50.278263+0000 mgr.a (mgr.14355) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:51 smithi131 bash[24745]: cluster 2024-09-14T02:27:50.278263+0000 mgr.a (mgr.14355) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:51 smithi171 bash[25040]: cluster 2024-09-14T02:27:50.278263+0000 mgr.a (mgr.14355) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:53 smithi007 bash[22722]: cluster 2024-09-14T02:27:52.279052+0000 mgr.a (mgr.14355) 10681 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:53 smithi131 bash[24745]: cluster 2024-09-14T02:27:52.279052+0000 mgr.a (mgr.14355) 10681 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:53.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:53.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:53 smithi171 bash[25040]: cluster 2024-09-14T02:27:52.279052+0000 mgr.a (mgr.14355) 10681 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:54.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:27:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:27:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:27:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:27:54.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:27:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:55 smithi007 bash[22722]: audit 2024-09-14T02:27:54.121560+0000 mgr.a (mgr.14355) 10682 : audit [DBG] from='client.235260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:55 smithi007 bash[22722]: cluster 2024-09-14T02:27:54.279601+0000 mgr.a (mgr.14355) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:55 smithi131 bash[24745]: audit 2024-09-14T02:27:54.121560+0000 mgr.a (mgr.14355) 10682 : audit [DBG] from='client.235260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:55 smithi131 bash[24745]: cluster 2024-09-14T02:27:54.279601+0000 mgr.a (mgr.14355) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:55 smithi171 bash[25040]: audit 2024-09-14T02:27:54.121560+0000 mgr.a (mgr.14355) 10682 : audit [DBG] from='client.235260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:27:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:55 smithi171 bash[25040]: cluster 2024-09-14T02:27:54.279601+0000 mgr.a (mgr.14355) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:57 smithi007 bash[22722]: cluster 2024-09-14T02:27:56.281898+0000 mgr.a (mgr.14355) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:57 smithi131 bash[24745]: cluster 2024-09-14T02:27:56.281898+0000 mgr.a (mgr.14355) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:57 smithi171 bash[25040]: cluster 2024-09-14T02:27:56.281898+0000 mgr.a (mgr.14355) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:27:59.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:27:59.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:27:59.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:27:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:27:59 smithi007 bash[22722]: cluster 2024-09-14T02:27:58.282662+0000 mgr.a (mgr.14355) 10685 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:27:59 smithi131 bash[24745]: cluster 2024-09-14T02:27:58.282662+0000 mgr.a (mgr.14355) 10685 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:27:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:27:59 smithi171 bash[25040]: cluster 2024-09-14T02:27:58.282662+0000 mgr.a (mgr.14355) 10685 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:00.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:00.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:01 smithi007 bash[22722]: audit 2024-09-14T02:27:59.879989+0000 mgr.a (mgr.14355) 10686 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:01 smithi007 bash[22722]: cluster 2024-09-14T02:28:00.283709+0000 mgr.a (mgr.14355) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:28:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:01 smithi131 bash[24745]: audit 2024-09-14T02:27:59.879989+0000 mgr.a (mgr.14355) 10686 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:01 smithi131 bash[24745]: cluster 2024-09-14T02:28:00.283709+0000 mgr.a (mgr.14355) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:28:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:01 smithi171 bash[25040]: audit 2024-09-14T02:27:59.879989+0000 mgr.a (mgr.14355) 10686 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:01 smithi171 bash[25040]: cluster 2024-09-14T02:28:00.283709+0000 mgr.a (mgr.14355) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:28:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:03 smithi007 bash[22722]: cluster 2024-09-14T02:28:02.284432+0000 mgr.a (mgr.14355) 10688 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:03 smithi131 bash[24745]: cluster 2024-09-14T02:28:02.284432+0000 mgr.a (mgr.14355) 10688 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:03 smithi171 bash[25040]: cluster 2024-09-14T02:28:02.284432+0000 mgr.a (mgr.14355) 10688 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:05.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:05.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:05.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:05.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:05 smithi007 bash[22722]: cluster 2024-09-14T02:28:04.285191+0000 mgr.a (mgr.14355) 10689 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:05 smithi131 bash[24745]: cluster 2024-09-14T02:28:04.285191+0000 mgr.a (mgr.14355) 10689 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:05 smithi171 bash[25040]: cluster 2024-09-14T02:28:04.285191+0000 mgr.a (mgr.14355) 10689 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:28:06.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:06.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:07 smithi007 bash[22722]: audit 2024-09-14T02:28:05.619627+0000 mgr.a (mgr.14355) 10690 : audit [DBG] from='client.235410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:07 smithi007 bash[22722]: cluster 2024-09-14T02:28:06.288023+0000 mgr.a (mgr.14355) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:07 smithi131 bash[24745]: audit 2024-09-14T02:28:05.619627+0000 mgr.a (mgr.14355) 10690 : audit [DBG] from='client.235410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:07 smithi131 bash[24745]: cluster 2024-09-14T02:28:06.288023+0000 mgr.a (mgr.14355) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:07 smithi171 bash[25040]: audit 2024-09-14T02:28:05.619627+0000 mgr.a (mgr.14355) 10690 : audit [DBG] from='client.235410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:07 smithi171 bash[25040]: cluster 2024-09-14T02:28:06.288023+0000 mgr.a (mgr.14355) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:09 smithi007 bash[22722]: cluster 2024-09-14T02:28:08.288800+0000 mgr.a (mgr.14355) 10692 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:28:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:09 smithi131 bash[24745]: cluster 2024-09-14T02:28:08.288800+0000 mgr.a (mgr.14355) 10692 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:28:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:09 smithi171 bash[25040]: cluster 2024-09-14T02:28:08.288800+0000 mgr.a (mgr.14355) 10692 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:28:11.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:11.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:11.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:11.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:11 smithi007 bash[22722]: cluster 2024-09-14T02:28:10.290769+0000 mgr.a (mgr.14355) 10693 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:11 smithi131 bash[24745]: cluster 2024-09-14T02:28:10.290769+0000 mgr.a (mgr.14355) 10693 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:11 smithi171 bash[25040]: cluster 2024-09-14T02:28:10.290769+0000 mgr.a (mgr.14355) 10693 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:11.823 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:12 smithi007 bash[22722]: audit 2024-09-14T02:28:11.383821+0000 mgr.a (mgr.14355) 10694 : audit [DBG] from='client.235488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:12 smithi131 bash[24745]: audit 2024-09-14T02:28:11.383821+0000 mgr.a (mgr.14355) 10694 : audit [DBG] from='client.235488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:12 smithi171 bash[25040]: audit 2024-09-14T02:28:11.383821+0000 mgr.a (mgr.14355) 10694 : audit [DBG] from='client.235488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:13 smithi007 bash[22722]: cluster 2024-09-14T02:28:12.291686+0000 mgr.a (mgr.14355) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:13 smithi131 bash[24745]: cluster 2024-09-14T02:28:12.291686+0000 mgr.a (mgr.14355) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:13 smithi171 bash[25040]: cluster 2024-09-14T02:28:12.291686+0000 mgr.a (mgr.14355) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:15 smithi007 bash[22722]: cluster 2024-09-14T02:28:14.292537+0000 mgr.a (mgr.14355) 10696 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:15 smithi131 bash[24745]: cluster 2024-09-14T02:28:14.292537+0000 mgr.a (mgr.14355) 10696 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:15 smithi171 bash[25040]: cluster 2024-09-14T02:28:14.292537+0000 mgr.a (mgr.14355) 10696 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:28:16.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:16.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:17.581 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:17.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:17.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:17 smithi007 bash[22722]: cluster 2024-09-14T02:28:16.294762+0000 mgr.a (mgr.14355) 10697 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:28:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:17 smithi131 bash[24745]: cluster 2024-09-14T02:28:16.294762+0000 mgr.a (mgr.14355) 10697 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:28:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:17 smithi171 bash[25040]: cluster 2024-09-14T02:28:16.294762+0000 mgr.a (mgr.14355) 10697 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:28:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:18 smithi007 bash[22722]: audit 2024-09-14T02:28:17.155264+0000 mgr.a (mgr.14355) 10698 : audit [DBG] from='client.235566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:18 smithi131 bash[24745]: audit 2024-09-14T02:28:17.155264+0000 mgr.a (mgr.14355) 10698 : audit [DBG] from='client.235566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:18 smithi171 bash[25040]: audit 2024-09-14T02:28:17.155264+0000 mgr.a (mgr.14355) 10698 : audit [DBG] from='client.235566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:19 smithi007 bash[22722]: cluster 2024-09-14T02:28:18.295651+0000 mgr.a (mgr.14355) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:19 smithi131 bash[24745]: cluster 2024-09-14T02:28:18.295651+0000 mgr.a (mgr.14355) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:19.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:19 smithi171 bash[25040]: cluster 2024-09-14T02:28:18.295651+0000 mgr.a (mgr.14355) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:21 smithi007 bash[22722]: cluster 2024-09-14T02:28:20.297800+0000 mgr.a (mgr.14355) 10700 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:21 smithi131 bash[24745]: cluster 2024-09-14T02:28:20.297800+0000 mgr.a (mgr.14355) 10700 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:21 smithi171 bash[25040]: cluster 2024-09-14T02:28:20.297800+0000 mgr.a (mgr.14355) 10700 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:22.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:22.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:23.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:23.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:23.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:23.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:23.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:23 smithi007 bash[22722]: cluster 2024-09-14T02:28:22.298570+0000 mgr.a (mgr.14355) 10701 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:23.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:23 smithi131 bash[24745]: cluster 2024-09-14T02:28:22.298570+0000 mgr.a (mgr.14355) 10701 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:23 smithi171 bash[25040]: cluster 2024-09-14T02:28:22.298570+0000 mgr.a (mgr.14355) 10701 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:24 smithi007 bash[22722]: audit 2024-09-14T02:28:22.914722+0000 mgr.a (mgr.14355) 10702 : audit [DBG] from='client.235644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:24.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:24 smithi131 bash[24745]: audit 2024-09-14T02:28:22.914722+0000 mgr.a (mgr.14355) 10702 : audit [DBG] from='client.235644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:24 smithi171 bash[25040]: audit 2024-09-14T02:28:22.914722+0000 mgr.a (mgr.14355) 10702 : audit [DBG] from='client.235644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:25 smithi007 bash[22722]: cluster 2024-09-14T02:28:24.299473+0000 mgr.a (mgr.14355) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:25 smithi131 bash[24745]: cluster 2024-09-14T02:28:24.299473+0000 mgr.a (mgr.14355) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:25 smithi171 bash[25040]: cluster 2024-09-14T02:28:24.299473+0000 mgr.a (mgr.14355) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:27 smithi007 bash[22722]: cluster 2024-09-14T02:28:26.301735+0000 mgr.a (mgr.14355) 10704 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:27 smithi131 bash[24745]: cluster 2024-09-14T02:28:26.301735+0000 mgr.a (mgr.14355) 10704 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:27 smithi171 bash[25040]: cluster 2024-09-14T02:28:26.301735+0000 mgr.a (mgr.14355) 10704 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:28.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:28.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:28.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:29.100 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:29.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:29.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:29.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:29.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:29 smithi007 bash[22722]: cluster 2024-09-14T02:28:28.302526+0000 mgr.a (mgr.14355) 10705 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:29 smithi131 bash[24745]: cluster 2024-09-14T02:28:28.302526+0000 mgr.a (mgr.14355) 10705 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:29 smithi171 bash[25040]: cluster 2024-09-14T02:28:28.302526+0000 mgr.a (mgr.14355) 10705 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:30 smithi007 bash[22722]: audit 2024-09-14T02:28:28.675400+0000 mgr.a (mgr.14355) 10706 : audit [DBG] from='client.235722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:30.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:30 smithi131 bash[24745]: audit 2024-09-14T02:28:28.675400+0000 mgr.a (mgr.14355) 10706 : audit [DBG] from='client.235722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:30 smithi171 bash[25040]: audit 2024-09-14T02:28:28.675400+0000 mgr.a (mgr.14355) 10706 : audit [DBG] from='client.235722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:31 smithi007 bash[22722]: cluster 2024-09-14T02:28:30.304751+0000 mgr.a (mgr.14355) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:31 smithi131 bash[24745]: cluster 2024-09-14T02:28:30.304751+0000 mgr.a (mgr.14355) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:31 smithi171 bash[25040]: cluster 2024-09-14T02:28:30.304751+0000 mgr.a (mgr.14355) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:33 smithi007 bash[22722]: cluster 2024-09-14T02:28:32.305471+0000 mgr.a (mgr.14355) 10708 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:33 smithi131 bash[24745]: cluster 2024-09-14T02:28:32.305471+0000 mgr.a (mgr.14355) 10708 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:33 smithi171 bash[25040]: cluster 2024-09-14T02:28:32.305471+0000 mgr.a (mgr.14355) 10708 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:34.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:34.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:34 smithi131 bash[24745]: audit 2024-09-14T02:28:33.928936+0000 mon.a (mon.0) 2197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:28:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:34 smithi171 bash[25040]: audit 2024-09-14T02:28:33.928936+0000 mon.a (mon.0) 2197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:28:34.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:34.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:34.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:34.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:34.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:34 smithi007 bash[22722]: audit 2024-09-14T02:28:33.928936+0000 mon.a (mon.0) 2197 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:28:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: cluster 2024-09-14T02:28:34.306216+0000 mgr.a (mgr.14355) 10709 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:34.426748+0000 mgr.a (mgr.14355) 10710 : audit [DBG] from='client.235791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:34.535811+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:34.542195+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:34.548257+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:34.553567+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:35.220565+0000 mon.a (mon.0) 2202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:28:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:35.222619+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:28:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:35.232951+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:35 smithi131 bash[24745]: audit 2024-09-14T02:28:35.238109+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: cluster 2024-09-14T02:28:34.306216+0000 mgr.a (mgr.14355) 10709 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:34.426748+0000 mgr.a (mgr.14355) 10710 : audit [DBG] from='client.235791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:34.535811+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:34.542195+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:34.548257+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:34.553567+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:35.220565+0000 mon.a (mon.0) 2202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:35.222619+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:35.232951+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:35 smithi171 bash[25040]: audit 2024-09-14T02:28:35.238109+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: cluster 2024-09-14T02:28:34.306216+0000 mgr.a (mgr.14355) 10709 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:34.426748+0000 mgr.a (mgr.14355) 10710 : audit [DBG] from='client.235791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:34.535811+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:34.542195+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:34.548257+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:34.553567+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:35.220565+0000 mon.a (mon.0) 2202 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:35.222619+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:35.232951+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:28:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22722]: audit 2024-09-14T02:28:35.238109+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22972]: debug 2024-09-14T02:28:35.967+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:28:36.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:28:35 smithi007 bash[22972]: debug 2024-09-14T02:28:35.971+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:28:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:36 smithi131 bash[24745]: audit 2024-09-14T02:28:35.240810+0000 mgr.a (mgr.14355) 10711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:36 smithi171 bash[25040]: audit 2024-09-14T02:28:35.240810+0000 mgr.a (mgr.14355) 10711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:36 smithi007 bash[22722]: audit 2024-09-14T02:28:35.240810+0000 mgr.a (mgr.14355) 10711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:28:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:37 smithi131 bash[24745]: audit 2024-09-14T02:28:35.974116+0000 mgr.a (mgr.14355) 10712 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:28:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:37 smithi131 bash[24745]: cephadm 2024-09-14T02:28:35.975425+0000 mgr.a (mgr.14355) 10713 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:28:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:37 smithi131 bash[24745]: cluster 2024-09-14T02:28:36.308845+0000 mgr.a (mgr.14355) 10714 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:37 smithi171 bash[25040]: audit 2024-09-14T02:28:35.974116+0000 mgr.a (mgr.14355) 10712 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:28:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:37 smithi171 bash[25040]: cephadm 2024-09-14T02:28:35.975425+0000 mgr.a (mgr.14355) 10713 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:28:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:37 smithi171 bash[25040]: cluster 2024-09-14T02:28:36.308845+0000 mgr.a (mgr.14355) 10714 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:37 smithi007 bash[22722]: audit 2024-09-14T02:28:35.974116+0000 mgr.a (mgr.14355) 10712 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:28:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:37 smithi007 bash[22722]: cephadm 2024-09-14T02:28:35.975425+0000 mgr.a (mgr.14355) 10713 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:28:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:37 smithi007 bash[22722]: cluster 2024-09-14T02:28:36.308845+0000 mgr.a (mgr.14355) 10714 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:39.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:39 smithi131 bash[24745]: cluster 2024-09-14T02:28:38.309668+0000 mgr.a (mgr.14355) 10715 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:39 smithi171 bash[25040]: cluster 2024-09-14T02:28:38.309668+0000 mgr.a (mgr.14355) 10715 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:39 smithi007 bash[22722]: cluster 2024-09-14T02:28:38.309668+0000 mgr.a (mgr.14355) 10715 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:39.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:39.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:39.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:40.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:40.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:40.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:40.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:40.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:41 smithi007 bash[22722]: audit 2024-09-14T02:28:40.187976+0000 mgr.a (mgr.14355) 10716 : audit [DBG] from='client.235971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:41 smithi007 bash[22722]: cluster 2024-09-14T02:28:40.310782+0000 mgr.a (mgr.14355) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:41 smithi131 bash[24745]: audit 2024-09-14T02:28:40.187976+0000 mgr.a (mgr.14355) 10716 : audit [DBG] from='client.235971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:41 smithi131 bash[24745]: cluster 2024-09-14T02:28:40.310782+0000 mgr.a (mgr.14355) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:41 smithi171 bash[25040]: audit 2024-09-14T02:28:40.187976+0000 mgr.a (mgr.14355) 10716 : audit [DBG] from='client.235971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:41 smithi171 bash[25040]: cluster 2024-09-14T02:28:40.310782+0000 mgr.a (mgr.14355) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:43 smithi007 bash[22722]: cluster 2024-09-14T02:28:42.311772+0000 mgr.a (mgr.14355) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:43 smithi131 bash[24745]: cluster 2024-09-14T02:28:42.311772+0000 mgr.a (mgr.14355) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:43 smithi171 bash[25040]: cluster 2024-09-14T02:28:42.311772+0000 mgr.a (mgr.14355) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:45.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:45.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:45 smithi007 bash[22722]: cluster 2024-09-14T02:28:44.312569+0000 mgr.a (mgr.14355) 10719 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:45 smithi131 bash[24745]: cluster 2024-09-14T02:28:44.312569+0000 mgr.a (mgr.14355) 10719 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:45 smithi171 bash[25040]: cluster 2024-09-14T02:28:44.312569+0000 mgr.a (mgr.14355) 10719 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:46.388 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:46.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:46.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:46.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:46.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:47 smithi007 bash[22722]: audit 2024-09-14T02:28:45.961258+0000 mgr.a (mgr.14355) 10720 : audit [DBG] from='client.236049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:47 smithi007 bash[22722]: cluster 2024-09-14T02:28:46.313794+0000 mgr.a (mgr.14355) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:47 smithi131 bash[24745]: audit 2024-09-14T02:28:45.961258+0000 mgr.a (mgr.14355) 10720 : audit [DBG] from='client.236049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:47 smithi131 bash[24745]: cluster 2024-09-14T02:28:46.313794+0000 mgr.a (mgr.14355) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:47 smithi171 bash[25040]: audit 2024-09-14T02:28:45.961258+0000 mgr.a (mgr.14355) 10720 : audit [DBG] from='client.236049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:47 smithi171 bash[25040]: cluster 2024-09-14T02:28:46.313794+0000 mgr.a (mgr.14355) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:49 smithi007 bash[22722]: cluster 2024-09-14T02:28:48.314696+0000 mgr.a (mgr.14355) 10722 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:49 smithi131 bash[24745]: cluster 2024-09-14T02:28:48.314696+0000 mgr.a (mgr.14355) 10722 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:49 smithi171 bash[25040]: cluster 2024-09-14T02:28:48.314696+0000 mgr.a (mgr.14355) 10722 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:28:51.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:51 smithi007 bash[22722]: cluster 2024-09-14T02:28:50.316635+0000 mgr.a (mgr.14355) 10723 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:51 smithi131 bash[24745]: cluster 2024-09-14T02:28:50.316635+0000 mgr.a (mgr.14355) 10723 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:51 smithi171 bash[25040]: cluster 2024-09-14T02:28:50.316635+0000 mgr.a (mgr.14355) 10723 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:28:52.137 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:52.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:52.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:52.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:52.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:53 smithi007 bash[22722]: audit 2024-09-14T02:28:51.718080+0000 mgr.a (mgr.14355) 10724 : audit [DBG] from='client.236124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:53 smithi007 bash[22722]: cluster 2024-09-14T02:28:52.317579+0000 mgr.a (mgr.14355) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:53 smithi131 bash[24745]: audit 2024-09-14T02:28:51.718080+0000 mgr.a (mgr.14355) 10724 : audit [DBG] from='client.236124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:53 smithi131 bash[24745]: cluster 2024-09-14T02:28:52.317579+0000 mgr.a (mgr.14355) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:53 smithi171 bash[25040]: audit 2024-09-14T02:28:51.718080+0000 mgr.a (mgr.14355) 10724 : audit [DBG] from='client.236124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:53 smithi171 bash[25040]: cluster 2024-09-14T02:28:52.317579+0000 mgr.a (mgr.14355) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:55 smithi007 bash[22722]: cluster 2024-09-14T02:28:54.318397+0000 mgr.a (mgr.14355) 10726 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:55 smithi131 bash[24745]: cluster 2024-09-14T02:28:54.318397+0000 mgr.a (mgr.14355) 10726 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:55 smithi171 bash[25040]: cluster 2024-09-14T02:28:54.318397+0000 mgr.a (mgr.14355) 10726 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:28:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:28:57.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:28:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:57 smithi007 bash[22722]: cluster 2024-09-14T02:28:56.320638+0000 mgr.a (mgr.14355) 10727 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:57 smithi131 bash[24745]: cluster 2024-09-14T02:28:56.320638+0000 mgr.a (mgr.14355) 10727 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:57 smithi171 bash[25040]: cluster 2024-09-14T02:28:56.320638+0000 mgr.a (mgr.14355) 10727 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:28:57.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:28:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:28:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:28:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:28:57.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:28:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:58 smithi007 bash[22722]: audit 2024-09-14T02:28:57.480254+0000 mgr.a (mgr.14355) 10728 : audit [DBG] from='client.236199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:58.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:58 smithi131 bash[24745]: audit 2024-09-14T02:28:57.480254+0000 mgr.a (mgr.14355) 10728 : audit [DBG] from='client.236199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:58 smithi171 bash[25040]: audit 2024-09-14T02:28:57.480254+0000 mgr.a (mgr.14355) 10728 : audit [DBG] from='client.236199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:28:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:28:59 smithi007 bash[22722]: cluster 2024-09-14T02:28:58.321613+0000 mgr.a (mgr.14355) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:28:59 smithi131 bash[24745]: cluster 2024-09-14T02:28:58.321613+0000 mgr.a (mgr.14355) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:28:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:28:59 smithi171 bash[25040]: cluster 2024-09-14T02:28:58.321613+0000 mgr.a (mgr.14355) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:01 smithi007 bash[22722]: cluster 2024-09-14T02:29:00.323810+0000 mgr.a (mgr.14355) 10730 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:01 smithi131 bash[24745]: cluster 2024-09-14T02:29:00.323810+0000 mgr.a (mgr.14355) 10730 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:01 smithi171 bash[25040]: cluster 2024-09-14T02:29:00.323810+0000 mgr.a (mgr.14355) 10730 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:02.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:02.925 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:02.925 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:03.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:03.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:03.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:03.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:03.678 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:03 smithi007 bash[22722]: cluster 2024-09-14T02:29:02.324573+0000 mgr.a (mgr.14355) 10731 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:03 smithi131 bash[24745]: cluster 2024-09-14T02:29:02.324573+0000 mgr.a (mgr.14355) 10731 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:03 smithi171 bash[25040]: cluster 2024-09-14T02:29:02.324573+0000 mgr.a (mgr.14355) 10731 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:04 smithi007 bash[22722]: audit 2024-09-14T02:29:03.256584+0000 mgr.a (mgr.14355) 10732 : audit [DBG] from='client.236277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:04 smithi131 bash[24745]: audit 2024-09-14T02:29:03.256584+0000 mgr.a (mgr.14355) 10732 : audit [DBG] from='client.236277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:04 smithi171 bash[25040]: audit 2024-09-14T02:29:03.256584+0000 mgr.a (mgr.14355) 10732 : audit [DBG] from='client.236277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:05 smithi007 bash[22722]: cluster 2024-09-14T02:29:04.325543+0000 mgr.a (mgr.14355) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:05 smithi131 bash[24745]: cluster 2024-09-14T02:29:04.325543+0000 mgr.a (mgr.14355) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:05 smithi171 bash[25040]: cluster 2024-09-14T02:29:04.325543+0000 mgr.a (mgr.14355) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:07 smithi007 bash[22722]: cluster 2024-09-14T02:29:06.327824+0000 mgr.a (mgr.14355) 10734 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:07 smithi131 bash[24745]: cluster 2024-09-14T02:29:06.327824+0000 mgr.a (mgr.14355) 10734 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:07 smithi171 bash[25040]: cluster 2024-09-14T02:29:06.327824+0000 mgr.a (mgr.14355) 10734 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:08.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:08.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:09.438 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:09.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:09 smithi007 bash[22722]: cluster 2024-09-14T02:29:08.328597+0000 mgr.a (mgr.14355) 10735 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:09 smithi131 bash[24745]: cluster 2024-09-14T02:29:08.328597+0000 mgr.a (mgr.14355) 10735 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:09 smithi171 bash[25040]: cluster 2024-09-14T02:29:08.328597+0000 mgr.a (mgr.14355) 10735 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:10 smithi007 bash[22722]: audit 2024-09-14T02:29:09.013604+0000 mgr.a (mgr.14355) 10736 : audit [DBG] from='client.236355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:10.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:10 smithi131 bash[24745]: audit 2024-09-14T02:29:09.013604+0000 mgr.a (mgr.14355) 10736 : audit [DBG] from='client.236355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:10 smithi171 bash[25040]: audit 2024-09-14T02:29:09.013604+0000 mgr.a (mgr.14355) 10736 : audit [DBG] from='client.236355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:11 smithi007 bash[22722]: cluster 2024-09-14T02:29:10.330933+0000 mgr.a (mgr.14355) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:11 smithi131 bash[24745]: cluster 2024-09-14T02:29:10.330933+0000 mgr.a (mgr.14355) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:11 smithi171 bash[25040]: cluster 2024-09-14T02:29:10.330933+0000 mgr.a (mgr.14355) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:13 smithi131 bash[24745]: cluster 2024-09-14T02:29:12.331671+0000 mgr.a (mgr.14355) 10738 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:13 smithi171 bash[25040]: cluster 2024-09-14T02:29:12.331671+0000 mgr.a (mgr.14355) 10738 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:13 smithi007 bash[22722]: cluster 2024-09-14T02:29:12.331671+0000 mgr.a (mgr.14355) 10738 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:14.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:15.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:15.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:15 smithi131 bash[24745]: cluster 2024-09-14T02:29:14.332437+0000 mgr.a (mgr.14355) 10739 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:15 smithi171 bash[25040]: cluster 2024-09-14T02:29:14.332437+0000 mgr.a (mgr.14355) 10739 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:15 smithi007 bash[22722]: cluster 2024-09-14T02:29:14.332437+0000 mgr.a (mgr.14355) 10739 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:16.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:16 smithi131 bash[24745]: audit 2024-09-14T02:29:14.778694+0000 mgr.a (mgr.14355) 10740 : audit [DBG] from='client.236433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:16 smithi171 bash[25040]: audit 2024-09-14T02:29:14.778694+0000 mgr.a (mgr.14355) 10740 : audit [DBG] from='client.236433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:16 smithi007 bash[22722]: audit 2024-09-14T02:29:14.778694+0000 mgr.a (mgr.14355) 10740 : audit [DBG] from='client.236433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:17 smithi131 bash[24745]: cluster 2024-09-14T02:29:16.334905+0000 mgr.a (mgr.14355) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:17 smithi171 bash[25040]: cluster 2024-09-14T02:29:16.334905+0000 mgr.a (mgr.14355) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:17 smithi007 bash[22722]: cluster 2024-09-14T02:29:16.334905+0000 mgr.a (mgr.14355) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:19 smithi131 bash[24745]: cluster 2024-09-14T02:29:18.335714+0000 mgr.a (mgr.14355) 10742 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:19 smithi171 bash[25040]: cluster 2024-09-14T02:29:18.335714+0000 mgr.a (mgr.14355) 10742 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:19 smithi007 bash[22722]: cluster 2024-09-14T02:29:18.335714+0000 mgr.a (mgr.14355) 10742 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:20.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:20.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:20.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:20.988 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:21 smithi131 bash[24745]: cluster 2024-09-14T02:29:20.336747+0000 mgr.a (mgr.14355) 10743 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:21 smithi171 bash[25040]: cluster 2024-09-14T02:29:20.336747+0000 mgr.a (mgr.14355) 10743 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:21 smithi007 bash[22722]: cluster 2024-09-14T02:29:20.336747+0000 mgr.a (mgr.14355) 10743 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:22 smithi131 bash[24745]: audit 2024-09-14T02:29:20.557802+0000 mgr.a (mgr.14355) 10744 : audit [DBG] from='client.236505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:22 smithi171 bash[25040]: audit 2024-09-14T02:29:20.557802+0000 mgr.a (mgr.14355) 10744 : audit [DBG] from='client.236505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:22 smithi007 bash[22722]: audit 2024-09-14T02:29:20.557802+0000 mgr.a (mgr.14355) 10744 : audit [DBG] from='client.236505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:23.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:23 smithi131 bash[24745]: cluster 2024-09-14T02:29:22.337684+0000 mgr.a (mgr.14355) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:23 smithi171 bash[25040]: cluster 2024-09-14T02:29:22.337684+0000 mgr.a (mgr.14355) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:23 smithi007 bash[22722]: cluster 2024-09-14T02:29:22.337684+0000 mgr.a (mgr.14355) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:25 smithi131 bash[24745]: cluster 2024-09-14T02:29:24.338555+0000 mgr.a (mgr.14355) 10746 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:25 smithi171 bash[25040]: cluster 2024-09-14T02:29:24.338555+0000 mgr.a (mgr.14355) 10746 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:25 smithi007 bash[22722]: cluster 2024-09-14T02:29:24.338555+0000 mgr.a (mgr.14355) 10746 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:29:25.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:26.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:27 smithi131 bash[24745]: audit 2024-09-14T02:29:26.329011+0000 mgr.a (mgr.14355) 10747 : audit [DBG] from='client.236580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:27 smithi131 bash[24745]: cluster 2024-09-14T02:29:26.348956+0000 mgr.a (mgr.14355) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:27 smithi171 bash[25040]: audit 2024-09-14T02:29:26.329011+0000 mgr.a (mgr.14355) 10747 : audit [DBG] from='client.236580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:27 smithi171 bash[25040]: cluster 2024-09-14T02:29:26.348956+0000 mgr.a (mgr.14355) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:27 smithi007 bash[22722]: audit 2024-09-14T02:29:26.329011+0000 mgr.a (mgr.14355) 10747 : audit [DBG] from='client.236580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:27 smithi007 bash[22722]: cluster 2024-09-14T02:29:26.348956+0000 mgr.a (mgr.14355) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:29 smithi131 bash[24745]: cluster 2024-09-14T02:29:28.350006+0000 mgr.a (mgr.14355) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:29:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:29 smithi171 bash[25040]: cluster 2024-09-14T02:29:28.350006+0000 mgr.a (mgr.14355) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:29:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:29 smithi007 bash[22722]: cluster 2024-09-14T02:29:28.350006+0000 mgr.a (mgr.14355) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:29:31.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:31.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:31.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:31 smithi131 bash[24745]: cluster 2024-09-14T02:29:30.352159+0000 mgr.a (mgr.14355) 10750 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:31 smithi171 bash[25040]: cluster 2024-09-14T02:29:30.352159+0000 mgr.a (mgr.14355) 10750 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:31 smithi007 bash[22722]: cluster 2024-09-14T02:29:30.352159+0000 mgr.a (mgr.14355) 10750 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:32.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:32.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:32 smithi007 bash[22722]: audit 2024-09-14T02:29:32.106870+0000 mgr.a (mgr.14355) 10751 : audit [DBG] from='client.236655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:32 smithi007 bash[22722]: cluster 2024-09-14T02:29:32.352686+0000 mgr.a (mgr.14355) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:32 smithi131 bash[24745]: audit 2024-09-14T02:29:32.106870+0000 mgr.a (mgr.14355) 10751 : audit [DBG] from='client.236655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:32 smithi131 bash[24745]: cluster 2024-09-14T02:29:32.352686+0000 mgr.a (mgr.14355) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:32 smithi171 bash[25040]: audit 2024-09-14T02:29:32.106870+0000 mgr.a (mgr.14355) 10751 : audit [DBG] from='client.236655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:32 smithi171 bash[25040]: cluster 2024-09-14T02:29:32.352686+0000 mgr.a (mgr.14355) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:35 smithi007 bash[22722]: cluster 2024-09-14T02:29:34.353575+0000 mgr.a (mgr.14355) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:35 smithi131 bash[24745]: cluster 2024-09-14T02:29:34.353575+0000 mgr.a (mgr.14355) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:35 smithi171 bash[25040]: cluster 2024-09-14T02:29:34.353575+0000 mgr.a (mgr.14355) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:36 smithi007 bash[22722]: audit 2024-09-14T02:29:36.023760+0000 mon.a (mon.0) 2206 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:29:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:36 smithi131 bash[24745]: audit 2024-09-14T02:29:36.023760+0000 mon.a (mon.0) 2206 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:29:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:36 smithi171 bash[25040]: audit 2024-09-14T02:29:36.023760+0000 mon.a (mon.0) 2206 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:29:37.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22972]: debug 2024-09-14T02:29:37.622+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22972]: debug 2024-09-14T02:29:37.622+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22722]: cluster 2024-09-14T02:29:36.355788+0000 mgr.a (mgr.14355) 10754 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22722]: audit 2024-09-14T02:29:36.874806+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22722]: audit 2024-09-14T02:29:36.876134+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:29:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22722]: audit 2024-09-14T02:29:36.882634+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:29:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:37 smithi007 bash[22722]: audit 2024-09-14T02:29:36.885064+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:37 smithi131 bash[24745]: cluster 2024-09-14T02:29:36.355788+0000 mgr.a (mgr.14355) 10754 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:37 smithi131 bash[24745]: audit 2024-09-14T02:29:36.874806+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:37 smithi131 bash[24745]: audit 2024-09-14T02:29:36.876134+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:37 smithi131 bash[24745]: audit 2024-09-14T02:29:36.882634+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:37 smithi131 bash[24745]: audit 2024-09-14T02:29:36.885064+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:37.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:37 smithi171 bash[25040]: cluster 2024-09-14T02:29:36.355788+0000 mgr.a (mgr.14355) 10754 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:29:37.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:37 smithi171 bash[25040]: audit 2024-09-14T02:29:36.874806+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:29:37.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:37 smithi171 bash[25040]: audit 2024-09-14T02:29:36.876134+0000 mon.a (mon.0) 2208 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:29:37.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:37 smithi171 bash[25040]: audit 2024-09-14T02:29:36.882634+0000 mon.a (mon.0) 2209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:29:37.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:37 smithi171 bash[25040]: audit 2024-09-14T02:29:36.885064+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:38.241 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:38 smithi007 bash[22722]: audit 2024-09-14T02:29:36.886435+0000 mgr.a (mgr.14355) 10755 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:38 smithi131 bash[24745]: audit 2024-09-14T02:29:36.886435+0000 mgr.a (mgr.14355) 10755 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:38 smithi171 bash[25040]: audit 2024-09-14T02:29:36.886435+0000 mgr.a (mgr.14355) 10755 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:39 smithi007 bash[22722]: audit 2024-09-14T02:29:37.622355+0000 mgr.a (mgr.14355) 10756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:39 smithi007 bash[22722]: cephadm 2024-09-14T02:29:37.623435+0000 mgr.a (mgr.14355) 10757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:39 smithi007 bash[22722]: audit 2024-09-14T02:29:37.834281+0000 mgr.a (mgr.14355) 10758 : audit [DBG] from='client.236838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:39 smithi007 bash[22722]: cluster 2024-09-14T02:29:38.356696+0000 mgr.a (mgr.14355) 10759 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:39 smithi131 bash[24745]: audit 2024-09-14T02:29:37.622355+0000 mgr.a (mgr.14355) 10756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:39 smithi131 bash[24745]: cephadm 2024-09-14T02:29:37.623435+0000 mgr.a (mgr.14355) 10757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:39 smithi131 bash[24745]: audit 2024-09-14T02:29:37.834281+0000 mgr.a (mgr.14355) 10758 : audit [DBG] from='client.236838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:39 smithi131 bash[24745]: cluster 2024-09-14T02:29:38.356696+0000 mgr.a (mgr.14355) 10759 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:39 smithi171 bash[25040]: audit 2024-09-14T02:29:37.622355+0000 mgr.a (mgr.14355) 10756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:29:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:39 smithi171 bash[25040]: cephadm 2024-09-14T02:29:37.623435+0000 mgr.a (mgr.14355) 10757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:29:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:39 smithi171 bash[25040]: audit 2024-09-14T02:29:37.834281+0000 mgr.a (mgr.14355) 10758 : audit [DBG] from='client.236838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:39 smithi171 bash[25040]: cluster 2024-09-14T02:29:38.356696+0000 mgr.a (mgr.14355) 10759 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:41 smithi007 bash[22722]: cluster 2024-09-14T02:29:40.358997+0000 mgr.a (mgr.14355) 10760 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:41 smithi131 bash[24745]: cluster 2024-09-14T02:29:40.358997+0000 mgr.a (mgr.14355) 10760 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:41 smithi171 bash[25040]: cluster 2024-09-14T02:29:40.358997+0000 mgr.a (mgr.14355) 10760 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:43 smithi007 bash[22722]: cluster 2024-09-14T02:29:42.359933+0000 mgr.a (mgr.14355) 10761 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:43 smithi131 bash[24745]: cluster 2024-09-14T02:29:42.359933+0000 mgr.a (mgr.14355) 10761 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:43 smithi171 bash[25040]: cluster 2024-09-14T02:29:42.359933+0000 mgr.a (mgr.14355) 10761 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:44.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:45 smithi007 bash[22722]: audit 2024-09-14T02:29:43.579356+0000 mgr.a (mgr.14355) 10762 : audit [DBG] from='client.236913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:45 smithi007 bash[22722]: cluster 2024-09-14T02:29:44.361083+0000 mgr.a (mgr.14355) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:45 smithi131 bash[24745]: audit 2024-09-14T02:29:43.579356+0000 mgr.a (mgr.14355) 10762 : audit [DBG] from='client.236913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:45 smithi131 bash[24745]: cluster 2024-09-14T02:29:44.361083+0000 mgr.a (mgr.14355) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:45 smithi171 bash[25040]: audit 2024-09-14T02:29:43.579356+0000 mgr.a (mgr.14355) 10762 : audit [DBG] from='client.236913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:45 smithi171 bash[25040]: cluster 2024-09-14T02:29:44.361083+0000 mgr.a (mgr.14355) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:47 smithi007 bash[22722]: cluster 2024-09-14T02:29:46.363562+0000 mgr.a (mgr.14355) 10764 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:47 smithi131 bash[24745]: cluster 2024-09-14T02:29:46.363562+0000 mgr.a (mgr.14355) 10764 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:47 smithi171 bash[25040]: cluster 2024-09-14T02:29:46.363562+0000 mgr.a (mgr.14355) 10764 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:49.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:49 smithi007 bash[22722]: cluster 2024-09-14T02:29:48.364474+0000 mgr.a (mgr.14355) 10765 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:49.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:49.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:49.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:49.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:49.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:49 smithi131 bash[24745]: cluster 2024-09-14T02:29:48.364474+0000 mgr.a (mgr.14355) 10765 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:49 smithi171 bash[25040]: cluster 2024-09-14T02:29:48.364474+0000 mgr.a (mgr.14355) 10765 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:50 smithi131 bash[24745]: audit 2024-09-14T02:29:49.361473+0000 mgr.a (mgr.14355) 10766 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:50 smithi171 bash[25040]: audit 2024-09-14T02:29:49.361473+0000 mgr.a (mgr.14355) 10766 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:50 smithi007 bash[22722]: audit 2024-09-14T02:29:49.361473+0000 mgr.a (mgr.14355) 10766 : audit [DBG] from='client.236988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:51 smithi131 bash[24745]: cluster 2024-09-14T02:29:50.366810+0000 mgr.a (mgr.14355) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:51 smithi171 bash[25040]: cluster 2024-09-14T02:29:50.366810+0000 mgr.a (mgr.14355) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:51 smithi007 bash[22722]: cluster 2024-09-14T02:29:50.366810+0000 mgr.a (mgr.14355) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:29:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:53 smithi131 bash[24745]: cluster 2024-09-14T02:29:52.367716+0000 mgr.a (mgr.14355) 10768 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:53.921 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:53 smithi171 bash[25040]: cluster 2024-09-14T02:29:52.367716+0000 mgr.a (mgr.14355) 10768 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:53 smithi007 bash[22722]: cluster 2024-09-14T02:29:52.367716+0000 mgr.a (mgr.14355) 10768 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:54.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:29:54.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:29:54.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:29:55.517 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:29:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:29:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:29:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:29:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:29:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:55 smithi131 bash[24745]: cluster 2024-09-14T02:29:54.368515+0000 mgr.a (mgr.14355) 10769 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:55 smithi171 bash[25040]: cluster 2024-09-14T02:29:54.368515+0000 mgr.a (mgr.14355) 10769 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:55 smithi007 bash[22722]: cluster 2024-09-14T02:29:54.368515+0000 mgr.a (mgr.14355) 10769 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:56 smithi131 bash[24745]: audit 2024-09-14T02:29:55.100440+0000 mgr.a (mgr.14355) 10770 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:56 smithi171 bash[25040]: audit 2024-09-14T02:29:55.100440+0000 mgr.a (mgr.14355) 10770 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:56 smithi007 bash[22722]: audit 2024-09-14T02:29:55.100440+0000 mgr.a (mgr.14355) 10770 : audit [DBG] from='client.237066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:29:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:57 smithi131 bash[24745]: cluster 2024-09-14T02:29:56.371513+0000 mgr.a (mgr.14355) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:57 smithi171 bash[25040]: cluster 2024-09-14T02:29:56.371513+0000 mgr.a (mgr.14355) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:57 smithi007 bash[22722]: cluster 2024-09-14T02:29:56.371513+0000 mgr.a (mgr.14355) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:29:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:29:59 smithi131 bash[24745]: cluster 2024-09-14T02:29:58.372484+0000 mgr.a (mgr.14355) 10772 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:29:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:29:59 smithi171 bash[25040]: cluster 2024-09-14T02:29:58.372484+0000 mgr.a (mgr.14355) 10772 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:29:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:29:59 smithi007 bash[22722]: cluster 2024-09-14T02:29:58.372484+0000 mgr.a (mgr.14355) 10772 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:00.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:00.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:00 smithi131 bash[24745]: cluster 2024-09-14T02:30:00.000149+0000 mon.a (mon.0) 2211 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:30:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:00 smithi171 bash[25040]: cluster 2024-09-14T02:30:00.000149+0000 mon.a (mon.0) 2211 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:30:00.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:00 smithi007 bash[22722]: cluster 2024-09-14T02:30:00.000149+0000 mon.a (mon.0) 2211 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:30:01.307 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:01.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:01 smithi131 bash[24745]: cluster 2024-09-14T02:30:00.374587+0000 mgr.a (mgr.14355) 10773 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:01 smithi171 bash[25040]: cluster 2024-09-14T02:30:00.374587+0000 mgr.a (mgr.14355) 10773 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:01 smithi007 bash[22722]: cluster 2024-09-14T02:30:00.374587+0000 mgr.a (mgr.14355) 10773 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:02 smithi131 bash[24745]: audit 2024-09-14T02:30:00.857885+0000 mgr.a (mgr.14355) 10774 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:02 smithi171 bash[25040]: audit 2024-09-14T02:30:00.857885+0000 mgr.a (mgr.14355) 10774 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:02 smithi007 bash[22722]: audit 2024-09-14T02:30:00.857885+0000 mgr.a (mgr.14355) 10774 : audit [DBG] from='client.237144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:03 smithi131 bash[24745]: cluster 2024-09-14T02:30:02.375540+0000 mgr.a (mgr.14355) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:03 smithi171 bash[25040]: cluster 2024-09-14T02:30:02.375540+0000 mgr.a (mgr.14355) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:03 smithi007 bash[22722]: cluster 2024-09-14T02:30:02.375540+0000 mgr.a (mgr.14355) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:05 smithi131 bash[24745]: cluster 2024-09-14T02:30:04.376309+0000 mgr.a (mgr.14355) 10776 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:05 smithi171 bash[25040]: cluster 2024-09-14T02:30:04.376309+0000 mgr.a (mgr.14355) 10776 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:05 smithi007 bash[22722]: cluster 2024-09-14T02:30:04.376309+0000 mgr.a (mgr.14355) 10776 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:06.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:06.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:06 smithi131 bash[24745]: cluster 2024-09-14T02:30:06.378509+0000 mgr.a (mgr.14355) 10777 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:06 smithi171 bash[25040]: cluster 2024-09-14T02:30:06.378509+0000 mgr.a (mgr.14355) 10777 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:06 smithi007 bash[22722]: cluster 2024-09-14T02:30:06.378509+0000 mgr.a (mgr.14355) 10777 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:07.093 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:07.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:07.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:07.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:07.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:07 smithi131 bash[24745]: audit 2024-09-14T02:30:06.645310+0000 mgr.a (mgr.14355) 10778 : audit [DBG] from='client.237216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:07 smithi171 bash[25040]: audit 2024-09-14T02:30:06.645310+0000 mgr.a (mgr.14355) 10778 : audit [DBG] from='client.237216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:07 smithi007 bash[22722]: audit 2024-09-14T02:30:06.645310+0000 mgr.a (mgr.14355) 10778 : audit [DBG] from='client.237216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:08 smithi171 bash[25040]: cluster 2024-09-14T02:30:08.379410+0000 mgr.a (mgr.14355) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:08 smithi007 bash[22722]: cluster 2024-09-14T02:30:08.379410+0000 mgr.a (mgr.14355) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:08 smithi131 bash[24745]: cluster 2024-09-14T02:30:08.379410+0000 mgr.a (mgr.14355) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:11 smithi007 bash[22722]: cluster 2024-09-14T02:30:10.381552+0000 mgr.a (mgr.14355) 10780 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:11.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:11 smithi131 bash[24745]: cluster 2024-09-14T02:30:10.381552+0000 mgr.a (mgr.14355) 10780 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:11.920 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:11 smithi171 bash[25040]: cluster 2024-09-14T02:30:10.381552+0000 mgr.a (mgr.14355) 10780 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:12.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:12.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:12.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:12.846 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:13 smithi007 bash[22722]: cluster 2024-09-14T02:30:12.382645+0000 mgr.a (mgr.14355) 10781 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:13 smithi007 bash[22722]: audit 2024-09-14T02:30:12.430651+0000 mgr.a (mgr.14355) 10782 : audit [DBG] from='client.237291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:13 smithi131 bash[24745]: cluster 2024-09-14T02:30:12.382645+0000 mgr.a (mgr.14355) 10781 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:13 smithi131 bash[24745]: audit 2024-09-14T02:30:12.430651+0000 mgr.a (mgr.14355) 10782 : audit [DBG] from='client.237291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:13 smithi171 bash[25040]: cluster 2024-09-14T02:30:12.382645+0000 mgr.a (mgr.14355) 10781 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:13 smithi171 bash[25040]: audit 2024-09-14T02:30:12.430651+0000 mgr.a (mgr.14355) 10782 : audit [DBG] from='client.237291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:15 smithi007 bash[22722]: cluster 2024-09-14T02:30:14.383603+0000 mgr.a (mgr.14355) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:15.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:15 smithi131 bash[24745]: cluster 2024-09-14T02:30:14.383603+0000 mgr.a (mgr.14355) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:15 smithi171 bash[25040]: cluster 2024-09-14T02:30:14.383603+0000 mgr.a (mgr.14355) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:17 smithi007 bash[22722]: cluster 2024-09-14T02:30:16.385871+0000 mgr.a (mgr.14355) 10784 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:17 smithi131 bash[24745]: cluster 2024-09-14T02:30:16.385871+0000 mgr.a (mgr.14355) 10784 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:17 smithi171 bash[25040]: cluster 2024-09-14T02:30:16.385871+0000 mgr.a (mgr.14355) 10784 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:18.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:18.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:19 smithi131 bash[24745]: audit 2024-09-14T02:30:18.183814+0000 mgr.a (mgr.14355) 10785 : audit [DBG] from='client.237369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:19 smithi131 bash[24745]: cluster 2024-09-14T02:30:18.386515+0000 mgr.a (mgr.14355) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:19 smithi171 bash[25040]: audit 2024-09-14T02:30:18.183814+0000 mgr.a (mgr.14355) 10785 : audit [DBG] from='client.237369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:19 smithi171 bash[25040]: cluster 2024-09-14T02:30:18.386515+0000 mgr.a (mgr.14355) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:19 smithi007 bash[22722]: audit 2024-09-14T02:30:18.183814+0000 mgr.a (mgr.14355) 10785 : audit [DBG] from='client.237369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:19 smithi007 bash[22722]: cluster 2024-09-14T02:30:18.386515+0000 mgr.a (mgr.14355) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:21 smithi131 bash[24745]: cluster 2024-09-14T02:30:20.388689+0000 mgr.a (mgr.14355) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:21 smithi171 bash[25040]: cluster 2024-09-14T02:30:20.388689+0000 mgr.a (mgr.14355) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:21 smithi007 bash[22722]: cluster 2024-09-14T02:30:20.388689+0000 mgr.a (mgr.14355) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:23.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:23.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:23.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:23 smithi131 bash[24745]: cluster 2024-09-14T02:30:22.389432+0000 mgr.a (mgr.14355) 10788 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:23 smithi171 bash[25040]: cluster 2024-09-14T02:30:22.389432+0000 mgr.a (mgr.14355) 10788 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:23 smithi007 bash[22722]: cluster 2024-09-14T02:30:22.389432+0000 mgr.a (mgr.14355) 10788 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:24.378 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:25 smithi131 bash[24745]: audit 2024-09-14T02:30:23.930618+0000 mgr.a (mgr.14355) 10789 : audit [DBG] from='client.237447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:25 smithi131 bash[24745]: cluster 2024-09-14T02:30:24.390015+0000 mgr.a (mgr.14355) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:25 smithi171 bash[25040]: audit 2024-09-14T02:30:23.930618+0000 mgr.a (mgr.14355) 10789 : audit [DBG] from='client.237447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:25 smithi171 bash[25040]: cluster 2024-09-14T02:30:24.390015+0000 mgr.a (mgr.14355) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:25 smithi007 bash[22722]: audit 2024-09-14T02:30:23.930618+0000 mgr.a (mgr.14355) 10789 : audit [DBG] from='client.237447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:25 smithi007 bash[22722]: cluster 2024-09-14T02:30:24.390015+0000 mgr.a (mgr.14355) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:27 smithi131 bash[24745]: cluster 2024-09-14T02:30:26.392229+0000 mgr.a (mgr.14355) 10791 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:27 smithi171 bash[25040]: cluster 2024-09-14T02:30:26.392229+0000 mgr.a (mgr.14355) 10791 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:27.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:27 smithi007 bash[22722]: cluster 2024-09-14T02:30:26.392229+0000 mgr.a (mgr.14355) 10791 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:29 smithi131 bash[24745]: cluster 2024-09-14T02:30:28.392951+0000 mgr.a (mgr.14355) 10792 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:29 smithi171 bash[25040]: cluster 2024-09-14T02:30:28.392951+0000 mgr.a (mgr.14355) 10792 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:29.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:29 smithi007 bash[22722]: cluster 2024-09-14T02:30:28.392951+0000 mgr.a (mgr.14355) 10792 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:30.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:30.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:30.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:31 smithi131 bash[24745]: audit 2024-09-14T02:30:29.709807+0000 mgr.a (mgr.14355) 10793 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:31 smithi131 bash[24745]: cluster 2024-09-14T02:30:30.395264+0000 mgr.a (mgr.14355) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:31 smithi171 bash[25040]: audit 2024-09-14T02:30:29.709807+0000 mgr.a (mgr.14355) 10793 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:31 smithi171 bash[25040]: cluster 2024-09-14T02:30:30.395264+0000 mgr.a (mgr.14355) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:31 smithi007 bash[22722]: audit 2024-09-14T02:30:29.709807+0000 mgr.a (mgr.14355) 10793 : audit [DBG] from='client.237525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:31 smithi007 bash[22722]: cluster 2024-09-14T02:30:30.395264+0000 mgr.a (mgr.14355) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:33 smithi131 bash[24745]: cluster 2024-09-14T02:30:32.396023+0000 mgr.a (mgr.14355) 10795 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:33 smithi171 bash[25040]: cluster 2024-09-14T02:30:32.396023+0000 mgr.a (mgr.14355) 10795 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:33 smithi007 bash[22722]: cluster 2024-09-14T02:30:32.396023+0000 mgr.a (mgr.14355) 10795 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:35.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:35.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:35.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:35.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:35 smithi131 bash[24745]: cluster 2024-09-14T02:30:34.396820+0000 mgr.a (mgr.14355) 10796 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:35 smithi171 bash[25040]: cluster 2024-09-14T02:30:34.396820+0000 mgr.a (mgr.14355) 10796 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:35.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:35.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:35.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:35.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:35.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:35 smithi007 bash[22722]: cluster 2024-09-14T02:30:34.396820+0000 mgr.a (mgr.14355) 10796 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:36 smithi131 bash[24745]: audit 2024-09-14T02:30:35.467927+0000 mgr.a (mgr.14355) 10797 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:36 smithi171 bash[25040]: audit 2024-09-14T02:30:35.467927+0000 mgr.a (mgr.14355) 10797 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:36 smithi007 bash[22722]: audit 2024-09-14T02:30:35.467927+0000 mgr.a (mgr.14355) 10797 : audit [DBG] from='client.237603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:37.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:37 smithi131 bash[24745]: cluster 2024-09-14T02:30:36.399718+0000 mgr.a (mgr.14355) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:37 smithi171 bash[25040]: cluster 2024-09-14T02:30:36.399718+0000 mgr.a (mgr.14355) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:37 smithi007 bash[22722]: cluster 2024-09-14T02:30:36.399718+0000 mgr.a (mgr.14355) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:38 smithi131 bash[24745]: audit 2024-09-14T02:30:37.671098+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:30:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:38 smithi171 bash[25040]: audit 2024-09-14T02:30:37.671098+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:30:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:38 smithi007 bash[22722]: audit 2024-09-14T02:30:37.671098+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22972]: debug 2024-09-14T02:30:39.309+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22972]: debug 2024-09-14T02:30:39.309+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22722]: cluster 2024-09-14T02:30:38.400316+0000 mgr.a (mgr.14355) 10799 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22722]: audit 2024-09-14T02:30:38.518808+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22722]: audit 2024-09-14T02:30:38.520237+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:30:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22722]: audit 2024-09-14T02:30:38.529882+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:30:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:39 smithi007 bash[22722]: audit 2024-09-14T02:30:38.534905+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:39 smithi131 bash[24745]: cluster 2024-09-14T02:30:38.400316+0000 mgr.a (mgr.14355) 10799 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:39 smithi131 bash[24745]: audit 2024-09-14T02:30:38.518808+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:30:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:39 smithi131 bash[24745]: audit 2024-09-14T02:30:38.520237+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:30:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:39 smithi131 bash[24745]: audit 2024-09-14T02:30:38.529882+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:30:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:39 smithi131 bash[24745]: audit 2024-09-14T02:30:38.534905+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:39 smithi171 bash[25040]: cluster 2024-09-14T02:30:38.400316+0000 mgr.a (mgr.14355) 10799 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:30:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:39 smithi171 bash[25040]: audit 2024-09-14T02:30:38.518808+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:30:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:39 smithi171 bash[25040]: audit 2024-09-14T02:30:38.520237+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:30:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:39 smithi171 bash[25040]: audit 2024-09-14T02:30:38.529882+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:30:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:39 smithi171 bash[25040]: audit 2024-09-14T02:30:38.534905+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:40 smithi131 bash[24745]: audit 2024-09-14T02:30:38.537362+0000 mgr.a (mgr.14355) 10800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:40 smithi131 bash[24745]: audit 2024-09-14T02:30:39.311031+0000 mgr.a (mgr.14355) 10801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:30:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:40 smithi131 bash[24745]: cephadm 2024-09-14T02:30:39.312372+0000 mgr.a (mgr.14355) 10802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:30:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:40 smithi171 bash[25040]: audit 2024-09-14T02:30:38.537362+0000 mgr.a (mgr.14355) 10800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:40 smithi171 bash[25040]: audit 2024-09-14T02:30:39.311031+0000 mgr.a (mgr.14355) 10801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:30:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:40 smithi171 bash[25040]: cephadm 2024-09-14T02:30:39.312372+0000 mgr.a (mgr.14355) 10802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:30:40.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:40.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:40 smithi007 bash[22722]: audit 2024-09-14T02:30:38.537362+0000 mgr.a (mgr.14355) 10800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:30:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:40 smithi007 bash[22722]: audit 2024-09-14T02:30:39.311031+0000 mgr.a (mgr.14355) 10801 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:30:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:40 smithi007 bash[22722]: cephadm 2024-09-14T02:30:39.312372+0000 mgr.a (mgr.14355) 10802 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:30:41.701 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:41.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:41.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:41 smithi131 bash[24745]: cluster 2024-09-14T02:30:40.402520+0000 mgr.a (mgr.14355) 10803 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:41 smithi131 bash[24745]: audit 2024-09-14T02:30:41.249227+0000 mgr.a (mgr.14355) 10804 : audit [DBG] from='client.237786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:41 smithi171 bash[25040]: cluster 2024-09-14T02:30:40.402520+0000 mgr.a (mgr.14355) 10803 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:41 smithi171 bash[25040]: audit 2024-09-14T02:30:41.249227+0000 mgr.a (mgr.14355) 10804 : audit [DBG] from='client.237786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:41 smithi007 bash[22722]: cluster 2024-09-14T02:30:40.402520+0000 mgr.a (mgr.14355) 10803 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:41 smithi007 bash[22722]: audit 2024-09-14T02:30:41.249227+0000 mgr.a (mgr.14355) 10804 : audit [DBG] from='client.237786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:42 smithi171 bash[25040]: cluster 2024-09-14T02:30:42.403585+0000 mgr.a (mgr.14355) 10805 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:42 smithi007 bash[22722]: cluster 2024-09-14T02:30:42.403585+0000 mgr.a (mgr.14355) 10805 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:42 smithi131 bash[24745]: cluster 2024-09-14T02:30:42.403585+0000 mgr.a (mgr.14355) 10805 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:45 smithi131 bash[24745]: cluster 2024-09-14T02:30:44.404592+0000 mgr.a (mgr.14355) 10806 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:45 smithi171 bash[25040]: cluster 2024-09-14T02:30:44.404592+0000 mgr.a (mgr.14355) 10806 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:45 smithi007 bash[22722]: cluster 2024-09-14T02:30:44.404592+0000 mgr.a (mgr.14355) 10806 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:30:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:47.480 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:47.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:47.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:47 smithi131 bash[24745]: cluster 2024-09-14T02:30:46.406988+0000 mgr.a (mgr.14355) 10807 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:47 smithi171 bash[25040]: cluster 2024-09-14T02:30:46.406988+0000 mgr.a (mgr.14355) 10807 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:47 smithi007 bash[22722]: cluster 2024-09-14T02:30:46.406988+0000 mgr.a (mgr.14355) 10807 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:48 smithi131 bash[24745]: audit 2024-09-14T02:30:47.035506+0000 mgr.a (mgr.14355) 10808 : audit [DBG] from='client.237864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:48 smithi171 bash[25040]: audit 2024-09-14T02:30:47.035506+0000 mgr.a (mgr.14355) 10808 : audit [DBG] from='client.237864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:48 smithi007 bash[22722]: audit 2024-09-14T02:30:47.035506+0000 mgr.a (mgr.14355) 10808 : audit [DBG] from='client.237864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:49 smithi131 bash[24745]: cluster 2024-09-14T02:30:48.407915+0000 mgr.a (mgr.14355) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:49 smithi171 bash[25040]: cluster 2024-09-14T02:30:48.407915+0000 mgr.a (mgr.14355) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:49 smithi007 bash[22722]: cluster 2024-09-14T02:30:48.407915+0000 mgr.a (mgr.14355) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:51 smithi131 bash[24745]: cluster 2024-09-14T02:30:50.410079+0000 mgr.a (mgr.14355) 10810 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:51 smithi171 bash[25040]: cluster 2024-09-14T02:30:50.410079+0000 mgr.a (mgr.14355) 10810 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:51 smithi007 bash[22722]: cluster 2024-09-14T02:30:50.410079+0000 mgr.a (mgr.14355) 10810 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:30:52.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:52.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:52.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:53.245 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:53.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:53.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:53.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:53.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:53 smithi131 bash[24745]: cluster 2024-09-14T02:30:52.410853+0000 mgr.a (mgr.14355) 10811 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:53 smithi171 bash[25040]: cluster 2024-09-14T02:30:52.410853+0000 mgr.a (mgr.14355) 10811 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:53 smithi007 bash[22722]: cluster 2024-09-14T02:30:52.410853+0000 mgr.a (mgr.14355) 10811 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:54 smithi131 bash[24745]: audit 2024-09-14T02:30:52.814100+0000 mgr.a (mgr.14355) 10812 : audit [DBG] from='client.237942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:54 smithi171 bash[25040]: audit 2024-09-14T02:30:52.814100+0000 mgr.a (mgr.14355) 10812 : audit [DBG] from='client.237942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:54 smithi007 bash[22722]: audit 2024-09-14T02:30:52.814100+0000 mgr.a (mgr.14355) 10812 : audit [DBG] from='client.237942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:30:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:55 smithi131 bash[24745]: cluster 2024-09-14T02:30:54.411765+0000 mgr.a (mgr.14355) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:55 smithi171 bash[25040]: cluster 2024-09-14T02:30:54.411765+0000 mgr.a (mgr.14355) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:55 smithi007 bash[22722]: cluster 2024-09-14T02:30:54.411765+0000 mgr.a (mgr.14355) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:57.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:57 smithi131 bash[24745]: cluster 2024-09-14T02:30:56.414030+0000 mgr.a (mgr.14355) 10814 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:57 smithi171 bash[25040]: cluster 2024-09-14T02:30:56.414030+0000 mgr.a (mgr.14355) 10814 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:57 smithi007 bash[22722]: cluster 2024-09-14T02:30:56.414030+0000 mgr.a (mgr.14355) 10814 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:30:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:30:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:30:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:30:59.025 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:30:59.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:30:59.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:30:59.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:30:59.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:30:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:30:59 smithi131 bash[24745]: cluster 2024-09-14T02:30:58.414756+0000 mgr.a (mgr.14355) 10815 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:30:59 smithi171 bash[25040]: cluster 2024-09-14T02:30:58.414756+0000 mgr.a (mgr.14355) 10815 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:30:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:30:59 smithi007 bash[22722]: cluster 2024-09-14T02:30:58.414756+0000 mgr.a (mgr.14355) 10815 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:00.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:00 smithi131 bash[24745]: audit 2024-09-14T02:30:58.589325+0000 mgr.a (mgr.14355) 10816 : audit [DBG] from='client.238020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:00 smithi171 bash[25040]: audit 2024-09-14T02:30:58.589325+0000 mgr.a (mgr.14355) 10816 : audit [DBG] from='client.238020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:00 smithi007 bash[22722]: audit 2024-09-14T02:30:58.589325+0000 mgr.a (mgr.14355) 10816 : audit [DBG] from='client.238020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:01 smithi131 bash[24745]: cluster 2024-09-14T02:31:00.417003+0000 mgr.a (mgr.14355) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:01 smithi171 bash[25040]: cluster 2024-09-14T02:31:00.417003+0000 mgr.a (mgr.14355) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:01 smithi007 bash[22722]: cluster 2024-09-14T02:31:00.417003+0000 mgr.a (mgr.14355) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:03.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:03 smithi131 bash[24745]: cluster 2024-09-14T02:31:02.417764+0000 mgr.a (mgr.14355) 10818 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:03 smithi171 bash[25040]: cluster 2024-09-14T02:31:02.417764+0000 mgr.a (mgr.14355) 10818 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:03 smithi007 bash[22722]: cluster 2024-09-14T02:31:02.417764+0000 mgr.a (mgr.14355) 10818 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:04.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:04.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:04.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:04.802 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:05.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:05 smithi131 bash[24745]: audit 2024-09-14T02:31:04.360792+0000 mgr.a (mgr.14355) 10819 : audit [DBG] from='client.238098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:05 smithi131 bash[24745]: cluster 2024-09-14T02:31:04.418336+0000 mgr.a (mgr.14355) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:05 smithi171 bash[25040]: audit 2024-09-14T02:31:04.360792+0000 mgr.a (mgr.14355) 10819 : audit [DBG] from='client.238098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:05 smithi171 bash[25040]: cluster 2024-09-14T02:31:04.418336+0000 mgr.a (mgr.14355) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:05 smithi007 bash[22722]: audit 2024-09-14T02:31:04.360792+0000 mgr.a (mgr.14355) 10819 : audit [DBG] from='client.238098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:05 smithi007 bash[22722]: cluster 2024-09-14T02:31:04.418336+0000 mgr.a (mgr.14355) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:07.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:07 smithi131 bash[24745]: cluster 2024-09-14T02:31:06.420658+0000 mgr.a (mgr.14355) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:07 smithi171 bash[25040]: cluster 2024-09-14T02:31:06.420658+0000 mgr.a (mgr.14355) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:07 smithi007 bash[22722]: cluster 2024-09-14T02:31:06.420658+0000 mgr.a (mgr.14355) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:09.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:09 smithi131 bash[24745]: cluster 2024-09-14T02:31:08.421429+0000 mgr.a (mgr.14355) 10822 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:09 smithi171 bash[25040]: cluster 2024-09-14T02:31:08.421429+0000 mgr.a (mgr.14355) 10822 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:09.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:09.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:09.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:09 smithi007 bash[22722]: cluster 2024-09-14T02:31:08.421429+0000 mgr.a (mgr.14355) 10822 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:10.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:10.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:10.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:10.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:11 smithi131 bash[24745]: audit 2024-09-14T02:31:10.138725+0000 mgr.a (mgr.14355) 10823 : audit [DBG] from='client.238176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:11 smithi131 bash[24745]: cluster 2024-09-14T02:31:10.422815+0000 mgr.a (mgr.14355) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:11 smithi171 bash[25040]: audit 2024-09-14T02:31:10.138725+0000 mgr.a (mgr.14355) 10823 : audit [DBG] from='client.238176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:11 smithi171 bash[25040]: cluster 2024-09-14T02:31:10.422815+0000 mgr.a (mgr.14355) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:11 smithi007 bash[22722]: audit 2024-09-14T02:31:10.138725+0000 mgr.a (mgr.14355) 10823 : audit [DBG] from='client.238176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:11 smithi007 bash[22722]: cluster 2024-09-14T02:31:10.422815+0000 mgr.a (mgr.14355) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:12 smithi007 bash[22722]: cluster 2024-09-14T02:31:12.423670+0000 mgr.a (mgr.14355) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:12 smithi131 bash[24745]: cluster 2024-09-14T02:31:12.423670+0000 mgr.a (mgr.14355) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:13.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:12 smithi171 bash[25040]: cluster 2024-09-14T02:31:12.423670+0000 mgr.a (mgr.14355) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:15.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:15.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:15 smithi131 bash[24745]: cluster 2024-09-14T02:31:14.424487+0000 mgr.a (mgr.14355) 10826 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:15 smithi171 bash[25040]: cluster 2024-09-14T02:31:14.424487+0000 mgr.a (mgr.14355) 10826 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:15 smithi007 bash[22722]: cluster 2024-09-14T02:31:14.424487+0000 mgr.a (mgr.14355) 10826 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:16.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:17 smithi131 bash[24745]: audit 2024-09-14T02:31:15.922755+0000 mgr.a (mgr.14355) 10827 : audit [DBG] from='client.238251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:17 smithi131 bash[24745]: cluster 2024-09-14T02:31:16.427275+0000 mgr.a (mgr.14355) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:17 smithi171 bash[25040]: audit 2024-09-14T02:31:15.922755+0000 mgr.a (mgr.14355) 10827 : audit [DBG] from='client.238251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:17 smithi171 bash[25040]: cluster 2024-09-14T02:31:16.427275+0000 mgr.a (mgr.14355) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:17 smithi007 bash[22722]: audit 2024-09-14T02:31:15.922755+0000 mgr.a (mgr.14355) 10827 : audit [DBG] from='client.238251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:17 smithi007 bash[22722]: cluster 2024-09-14T02:31:16.427275+0000 mgr.a (mgr.14355) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:19 smithi131 bash[24745]: cluster 2024-09-14T02:31:18.428059+0000 mgr.a (mgr.14355) 10829 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:31:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:19 smithi171 bash[25040]: cluster 2024-09-14T02:31:18.428059+0000 mgr.a (mgr.14355) 10829 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:31:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:19 smithi007 bash[22722]: cluster 2024-09-14T02:31:18.428059+0000 mgr.a (mgr.14355) 10829 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:31:21.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:21.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:21.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:21 smithi131 bash[24745]: cluster 2024-09-14T02:31:20.430611+0000 mgr.a (mgr.14355) 10830 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:21 smithi171 bash[25040]: cluster 2024-09-14T02:31:20.430611+0000 mgr.a (mgr.14355) 10830 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:21 smithi007 bash[22722]: cluster 2024-09-14T02:31:20.430611+0000 mgr.a (mgr.14355) 10830 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:22.138 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:22.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:22.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:22.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:22.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:23 smithi131 bash[24745]: audit 2024-09-14T02:31:21.692294+0000 mgr.a (mgr.14355) 10831 : audit [DBG] from='client.238326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:23 smithi131 bash[24745]: cluster 2024-09-14T02:31:22.431609+0000 mgr.a (mgr.14355) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:23 smithi171 bash[25040]: audit 2024-09-14T02:31:21.692294+0000 mgr.a (mgr.14355) 10831 : audit [DBG] from='client.238326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:23 smithi171 bash[25040]: cluster 2024-09-14T02:31:22.431609+0000 mgr.a (mgr.14355) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:23 smithi007 bash[22722]: audit 2024-09-14T02:31:21.692294+0000 mgr.a (mgr.14355) 10831 : audit [DBG] from='client.238326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:23 smithi007 bash[22722]: cluster 2024-09-14T02:31:22.431609+0000 mgr.a (mgr.14355) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:25 smithi131 bash[24745]: cluster 2024-09-14T02:31:24.432593+0000 mgr.a (mgr.14355) 10833 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:25 smithi171 bash[25040]: cluster 2024-09-14T02:31:24.432593+0000 mgr.a (mgr.14355) 10833 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:25 smithi007 bash[22722]: cluster 2024-09-14T02:31:24.432593+0000 mgr.a (mgr.14355) 10833 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:27.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:27 smithi131 bash[24745]: cluster 2024-09-14T02:31:26.434995+0000 mgr.a (mgr.14355) 10834 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:27 smithi171 bash[25040]: cluster 2024-09-14T02:31:26.434995+0000 mgr.a (mgr.14355) 10834 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:27.914 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:27.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:27.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:27.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:27.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:27.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:27 smithi007 bash[22722]: cluster 2024-09-14T02:31:26.434995+0000 mgr.a (mgr.14355) 10834 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:28 smithi131 bash[24745]: audit 2024-09-14T02:31:27.471418+0000 mgr.a (mgr.14355) 10835 : audit [DBG] from='client.238401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:28 smithi171 bash[25040]: audit 2024-09-14T02:31:27.471418+0000 mgr.a (mgr.14355) 10835 : audit [DBG] from='client.238401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:28 smithi007 bash[22722]: audit 2024-09-14T02:31:27.471418+0000 mgr.a (mgr.14355) 10835 : audit [DBG] from='client.238401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:29.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:29 smithi131 bash[24745]: cluster 2024-09-14T02:31:28.435887+0000 mgr.a (mgr.14355) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:29 smithi171 bash[25040]: cluster 2024-09-14T02:31:28.435887+0000 mgr.a (mgr.14355) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:29 smithi007 bash[22722]: cluster 2024-09-14T02:31:28.435887+0000 mgr.a (mgr.14355) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:31 smithi131 bash[24745]: cluster 2024-09-14T02:31:30.437999+0000 mgr.a (mgr.14355) 10837 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:31 smithi171 bash[25040]: cluster 2024-09-14T02:31:30.437999+0000 mgr.a (mgr.14355) 10837 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:31 smithi007 bash[22722]: cluster 2024-09-14T02:31:30.437999+0000 mgr.a (mgr.14355) 10837 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:33.695 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:33.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:33.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:33.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:33.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:33 smithi131 bash[24745]: cluster 2024-09-14T02:31:32.438778+0000 mgr.a (mgr.14355) 10838 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:33 smithi171 bash[25040]: cluster 2024-09-14T02:31:32.438778+0000 mgr.a (mgr.14355) 10838 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:33 smithi007 bash[22722]: cluster 2024-09-14T02:31:32.438778+0000 mgr.a (mgr.14355) 10838 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:34 smithi171 bash[25040]: audit 2024-09-14T02:31:33.257770+0000 mgr.a (mgr.14355) 10839 : audit [DBG] from='client.238479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:34 smithi007 bash[22722]: audit 2024-09-14T02:31:33.257770+0000 mgr.a (mgr.14355) 10839 : audit [DBG] from='client.238479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:34 smithi131 bash[24745]: audit 2024-09-14T02:31:33.257770+0000 mgr.a (mgr.14355) 10839 : audit [DBG] from='client.238479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:35 smithi171 bash[25040]: cluster 2024-09-14T02:31:34.439691+0000 mgr.a (mgr.14355) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:35 smithi007 bash[22722]: cluster 2024-09-14T02:31:34.439691+0000 mgr.a (mgr.14355) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:36.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:35 smithi131 bash[24745]: cluster 2024-09-14T02:31:34.439691+0000 mgr.a (mgr.14355) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:36 smithi007 bash[22722]: cluster 2024-09-14T02:31:36.441927+0000 mgr.a (mgr.14355) 10841 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:37.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:36 smithi131 bash[24745]: cluster 2024-09-14T02:31:36.441927+0000 mgr.a (mgr.14355) 10841 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:36 smithi171 bash[25040]: cluster 2024-09-14T02:31:36.441927+0000 mgr.a (mgr.14355) 10841 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:31:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:39.483 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:39.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:39.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:39.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:39.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:39.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:39 smithi131 bash[24745]: cluster 2024-09-14T02:31:38.442681+0000 mgr.a (mgr.14355) 10842 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:39 smithi131 bash[24745]: audit 2024-09-14T02:31:39.362863+0000 mon.a (mon.0) 2217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:31:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:39 smithi171 bash[25040]: cluster 2024-09-14T02:31:38.442681+0000 mgr.a (mgr.14355) 10842 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:39 smithi171 bash[25040]: audit 2024-09-14T02:31:39.362863+0000 mon.a (mon.0) 2217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:31:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:39 smithi007 bash[22722]: cluster 2024-09-14T02:31:38.442681+0000 mgr.a (mgr.14355) 10842 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:31:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:39 smithi007 bash[22722]: audit 2024-09-14T02:31:39.362863+0000 mon.a (mon.0) 2217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:40 smithi131 bash[24745]: audit 2024-09-14T02:31:39.030525+0000 mgr.a (mgr.14355) 10843 : audit [DBG] from='client.238551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:40 smithi131 bash[24745]: audit 2024-09-14T02:31:40.162904+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:40 smithi131 bash[24745]: audit 2024-09-14T02:31:40.164734+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:40 smithi131 bash[24745]: audit 2024-09-14T02:31:40.175119+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:40 smithi131 bash[24745]: audit 2024-09-14T02:31:40.177973+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:40 smithi171 bash[25040]: audit 2024-09-14T02:31:39.030525+0000 mgr.a (mgr.14355) 10843 : audit [DBG] from='client.238551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:40 smithi171 bash[25040]: audit 2024-09-14T02:31:40.162904+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:31:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:40 smithi171 bash[25040]: audit 2024-09-14T02:31:40.164734+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:31:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:40 smithi171 bash[25040]: audit 2024-09-14T02:31:40.175119+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:31:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:40 smithi171 bash[25040]: audit 2024-09-14T02:31:40.177973+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22722]: audit 2024-09-14T02:31:39.030525+0000 mgr.a (mgr.14355) 10843 : audit [DBG] from='client.238551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22722]: audit 2024-09-14T02:31:40.162904+0000 mon.a (mon.0) 2218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:31:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22722]: audit 2024-09-14T02:31:40.164734+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:31:40.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22722]: audit 2024-09-14T02:31:40.175119+0000 mon.a (mon.0) 2220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:31:40.933 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22722]: audit 2024-09-14T02:31:40.177973+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:41.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22972]: debug 2024-09-14T02:31:40.924+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:31:41.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:31:40 smithi007 bash[22972]: debug 2024-09-14T02:31:40.928+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:41 smithi131 bash[24745]: audit 2024-09-14T02:31:40.180412+0000 mgr.a (mgr.14355) 10844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:41 smithi131 bash[24745]: cluster 2024-09-14T02:31:40.443997+0000 mgr.a (mgr.14355) 10845 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:31:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:41 smithi171 bash[25040]: audit 2024-09-14T02:31:40.180412+0000 mgr.a (mgr.14355) 10844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:41 smithi171 bash[25040]: cluster 2024-09-14T02:31:40.443997+0000 mgr.a (mgr.14355) 10845 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:31:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:41 smithi007 bash[22722]: audit 2024-09-14T02:31:40.180412+0000 mgr.a (mgr.14355) 10844 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:31:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:41 smithi007 bash[22722]: cluster 2024-09-14T02:31:40.443997+0000 mgr.a (mgr.14355) 10845 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:31:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:42 smithi131 bash[24745]: audit 2024-09-14T02:31:40.928838+0000 mgr.a (mgr.14355) 10846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:31:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:42 smithi131 bash[24745]: cephadm 2024-09-14T02:31:40.930541+0000 mgr.a (mgr.14355) 10847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:31:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:42 smithi171 bash[25040]: audit 2024-09-14T02:31:40.928838+0000 mgr.a (mgr.14355) 10846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:31:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:42 smithi171 bash[25040]: cephadm 2024-09-14T02:31:40.930541+0000 mgr.a (mgr.14355) 10847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:31:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:42 smithi007 bash[22722]: audit 2024-09-14T02:31:40.928838+0000 mgr.a (mgr.14355) 10846 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:31:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:42 smithi007 bash[22722]: cephadm 2024-09-14T02:31:40.930541+0000 mgr.a (mgr.14355) 10847 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:31:43.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:43 smithi131 bash[24745]: cluster 2024-09-14T02:31:42.444797+0000 mgr.a (mgr.14355) 10848 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:43 smithi171 bash[25040]: cluster 2024-09-14T02:31:42.444797+0000 mgr.a (mgr.14355) 10848 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:43 smithi007 bash[22722]: cluster 2024-09-14T02:31:42.444797+0000 mgr.a (mgr.14355) 10848 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:44.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:44.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:44.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:45.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:45.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:45.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:45 smithi131 bash[24745]: cluster 2024-09-14T02:31:44.445591+0000 mgr.a (mgr.14355) 10849 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:45 smithi171 bash[25040]: cluster 2024-09-14T02:31:44.445591+0000 mgr.a (mgr.14355) 10849 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:45 smithi007 bash[22722]: cluster 2024-09-14T02:31:44.445591+0000 mgr.a (mgr.14355) 10849 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:31:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:46 smithi131 bash[24745]: audit 2024-09-14T02:31:44.821596+0000 mgr.a (mgr.14355) 10850 : audit [DBG] from='client.238728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:46 smithi171 bash[25040]: audit 2024-09-14T02:31:44.821596+0000 mgr.a (mgr.14355) 10850 : audit [DBG] from='client.238728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:46 smithi007 bash[22722]: audit 2024-09-14T02:31:44.821596+0000 mgr.a (mgr.14355) 10850 : audit [DBG] from='client.238728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:47 smithi131 bash[24745]: cluster 2024-09-14T02:31:46.447944+0000 mgr.a (mgr.14355) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:47 smithi171 bash[25040]: cluster 2024-09-14T02:31:46.447944+0000 mgr.a (mgr.14355) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:47 smithi007 bash[22722]: cluster 2024-09-14T02:31:46.447944+0000 mgr.a (mgr.14355) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:49 smithi171 bash[25040]: cluster 2024-09-14T02:31:48.448705+0000 mgr.a (mgr.14355) 10852 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:49 smithi007 bash[22722]: cluster 2024-09-14T02:31:48.448705+0000 mgr.a (mgr.14355) 10852 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:49 smithi131 bash[24745]: cluster 2024-09-14T02:31:48.448705+0000 mgr.a (mgr.14355) 10852 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:50.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:50.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:51.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:51.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:51.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:51 smithi171 bash[25040]: cluster 2024-09-14T02:31:50.450641+0000 mgr.a (mgr.14355) 10853 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:51 smithi007 bash[22722]: cluster 2024-09-14T02:31:50.450641+0000 mgr.a (mgr.14355) 10853 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:51 smithi131 bash[24745]: cluster 2024-09-14T02:31:50.450641+0000 mgr.a (mgr.14355) 10853 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:31:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:52 smithi007 bash[22722]: audit 2024-09-14T02:31:50.605278+0000 mgr.a (mgr.14355) 10854 : audit [DBG] from='client.238806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:52 smithi007 bash[22722]: cluster 2024-09-14T02:31:52.451634+0000 mgr.a (mgr.14355) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:52 smithi131 bash[24745]: audit 2024-09-14T02:31:50.605278+0000 mgr.a (mgr.14355) 10854 : audit [DBG] from='client.238806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:52 smithi131 bash[24745]: cluster 2024-09-14T02:31:52.451634+0000 mgr.a (mgr.14355) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:52 smithi171 bash[25040]: audit 2024-09-14T02:31:50.605278+0000 mgr.a (mgr.14355) 10854 : audit [DBG] from='client.238806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:52 smithi171 bash[25040]: cluster 2024-09-14T02:31:52.451634+0000 mgr.a (mgr.14355) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:55.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:55 smithi131 bash[24745]: cluster 2024-09-14T02:31:54.452474+0000 mgr.a (mgr.14355) 10856 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:55 smithi171 bash[25040]: cluster 2024-09-14T02:31:54.452474+0000 mgr.a (mgr.14355) 10856 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:55 smithi007 bash[22722]: cluster 2024-09-14T02:31:54.452474+0000 mgr.a (mgr.14355) 10856 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-14T02:31:56.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:31:56.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:31:56.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:31:56.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:31:56.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:31:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:31:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:31:56.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:31:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:57 smithi131 bash[24745]: audit 2024-09-14T02:31:56.366203+0000 mgr.a (mgr.14355) 10857 : audit [DBG] from='client.238884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:57 smithi131 bash[24745]: cluster 2024-09-14T02:31:56.453771+0000 mgr.a (mgr.14355) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:31:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:57 smithi171 bash[25040]: audit 2024-09-14T02:31:56.366203+0000 mgr.a (mgr.14355) 10857 : audit [DBG] from='client.238884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:57 smithi171 bash[25040]: cluster 2024-09-14T02:31:56.453771+0000 mgr.a (mgr.14355) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:31:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:57 smithi007 bash[22722]: audit 2024-09-14T02:31:56.366203+0000 mgr.a (mgr.14355) 10857 : audit [DBG] from='client.238884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:31:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:57 smithi007 bash[22722]: cluster 2024-09-14T02:31:56.453771+0000 mgr.a (mgr.14355) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:31:59.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:31:59 smithi131 bash[24745]: cluster 2024-09-14T02:31:58.454659+0000 mgr.a (mgr.14355) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:31:59 smithi171 bash[25040]: cluster 2024-09-14T02:31:58.454659+0000 mgr.a (mgr.14355) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:31:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:31:59 smithi007 bash[22722]: cluster 2024-09-14T02:31:58.454659+0000 mgr.a (mgr.14355) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:32:01.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:01.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:01.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:01.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:01 smithi131 bash[24745]: cluster 2024-09-14T02:32:00.456858+0000 mgr.a (mgr.14355) 10860 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:01 smithi171 bash[25040]: cluster 2024-09-14T02:32:00.456858+0000 mgr.a (mgr.14355) 10860 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:01 smithi007 bash[22722]: cluster 2024-09-14T02:32:00.456858+0000 mgr.a (mgr.14355) 10860 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:02.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:02.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:03 smithi131 bash[24745]: audit 2024-09-14T02:32:02.114664+0000 mgr.a (mgr.14355) 10861 : audit [DBG] from='client.238962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:03 smithi131 bash[24745]: cluster 2024-09-14T02:32:02.457402+0000 mgr.a (mgr.14355) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:03 smithi171 bash[25040]: audit 2024-09-14T02:32:02.114664+0000 mgr.a (mgr.14355) 10861 : audit [DBG] from='client.238962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:03 smithi171 bash[25040]: cluster 2024-09-14T02:32:02.457402+0000 mgr.a (mgr.14355) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:03 smithi007 bash[22722]: audit 2024-09-14T02:32:02.114664+0000 mgr.a (mgr.14355) 10861 : audit [DBG] from='client.238962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:03 smithi007 bash[22722]: cluster 2024-09-14T02:32:02.457402+0000 mgr.a (mgr.14355) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:05 smithi131 bash[24745]: cluster 2024-09-14T02:32:04.458153+0000 mgr.a (mgr.14355) 10863 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:05 smithi171 bash[25040]: cluster 2024-09-14T02:32:04.458153+0000 mgr.a (mgr.14355) 10863 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:05 smithi007 bash[22722]: cluster 2024-09-14T02:32:04.458153+0000 mgr.a (mgr.14355) 10863 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:07.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:07.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:07 smithi171 bash[25040]: cluster 2024-09-14T02:32:06.460498+0000 mgr.a (mgr.14355) 10864 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:07 smithi007 bash[22722]: cluster 2024-09-14T02:32:06.460498+0000 mgr.a (mgr.14355) 10864 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:07 smithi131 bash[24745]: cluster 2024-09-14T02:32:06.460498+0000 mgr.a (mgr.14355) 10864 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:08.324 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:09 smithi171 bash[25040]: audit 2024-09-14T02:32:07.887914+0000 mgr.a (mgr.14355) 10865 : audit [DBG] from='client.239037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:09 smithi171 bash[25040]: cluster 2024-09-14T02:32:08.461411+0000 mgr.a (mgr.14355) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:09 smithi007 bash[22722]: audit 2024-09-14T02:32:07.887914+0000 mgr.a (mgr.14355) 10865 : audit [DBG] from='client.239037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:09 smithi007 bash[22722]: cluster 2024-09-14T02:32:08.461411+0000 mgr.a (mgr.14355) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:09 smithi131 bash[24745]: audit 2024-09-14T02:32:07.887914+0000 mgr.a (mgr.14355) 10865 : audit [DBG] from='client.239037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:09 smithi131 bash[24745]: cluster 2024-09-14T02:32:08.461411+0000 mgr.a (mgr.14355) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:32:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:10 smithi007 bash[22722]: cluster 2024-09-14T02:32:10.463585+0000 mgr.a (mgr.14355) 10867 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:10 smithi131 bash[24745]: cluster 2024-09-14T02:32:10.463585+0000 mgr.a (mgr.14355) 10867 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:10 smithi171 bash[25040]: cluster 2024-09-14T02:32:10.463585+0000 mgr.a (mgr.14355) 10867 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:32:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:13.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:13 smithi131 bash[24745]: cluster 2024-09-14T02:32:12.464291+0000 mgr.a (mgr.14355) 10868 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:13 smithi171 bash[25040]: cluster 2024-09-14T02:32:12.464291+0000 mgr.a (mgr.14355) 10868 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:13.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:13 smithi007 bash[22722]: cluster 2024-09-14T02:32:12.464291+0000 mgr.a (mgr.14355) 10868 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:14.119 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:14.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:14.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:14.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:14.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:15 smithi131 bash[24745]: audit 2024-09-14T02:32:13.678528+0000 mgr.a (mgr.14355) 10869 : audit [DBG] from='client.239112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:15 smithi131 bash[24745]: cluster 2024-09-14T02:32:14.465174+0000 mgr.a (mgr.14355) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:15 smithi171 bash[25040]: audit 2024-09-14T02:32:13.678528+0000 mgr.a (mgr.14355) 10869 : audit [DBG] from='client.239112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:15 smithi171 bash[25040]: cluster 2024-09-14T02:32:14.465174+0000 mgr.a (mgr.14355) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:15 smithi007 bash[22722]: audit 2024-09-14T02:32:13.678528+0000 mgr.a (mgr.14355) 10869 : audit [DBG] from='client.239112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:15 smithi007 bash[22722]: cluster 2024-09-14T02:32:14.465174+0000 mgr.a (mgr.14355) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:17 smithi131 bash[24745]: cluster 2024-09-14T02:32:16.467455+0000 mgr.a (mgr.14355) 10871 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:17 smithi171 bash[25040]: cluster 2024-09-14T02:32:16.467455+0000 mgr.a (mgr.14355) 10871 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:17 smithi007 bash[22722]: cluster 2024-09-14T02:32:16.467455+0000 mgr.a (mgr.14355) 10871 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:19.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:19.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:19.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:19 smithi171 bash[25040]: cluster 2024-09-14T02:32:18.468232+0000 mgr.a (mgr.14355) 10872 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:19.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:19.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:19 smithi007 bash[22722]: cluster 2024-09-14T02:32:18.468232+0000 mgr.a (mgr.14355) 10872 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:20.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:19 smithi131 bash[24745]: cluster 2024-09-14T02:32:18.468232+0000 mgr.a (mgr.14355) 10872 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:20 smithi171 bash[25040]: audit 2024-09-14T02:32:19.459256+0000 mgr.a (mgr.14355) 10873 : audit [DBG] from='client.239187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:20 smithi007 bash[22722]: audit 2024-09-14T02:32:19.459256+0000 mgr.a (mgr.14355) 10873 : audit [DBG] from='client.239187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:20 smithi131 bash[24745]: audit 2024-09-14T02:32:19.459256+0000 mgr.a (mgr.14355) 10873 : audit [DBG] from='client.239187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:21 smithi171 bash[25040]: cluster 2024-09-14T02:32:20.470489+0000 mgr.a (mgr.14355) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:21 smithi007 bash[22722]: cluster 2024-09-14T02:32:20.470489+0000 mgr.a (mgr.14355) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:21 smithi131 bash[24745]: cluster 2024-09-14T02:32:20.470489+0000 mgr.a (mgr.14355) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:32:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:23 smithi171 bash[25040]: cluster 2024-09-14T02:32:22.471246+0000 mgr.a (mgr.14355) 10875 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:23 smithi007 bash[22722]: cluster 2024-09-14T02:32:22.471246+0000 mgr.a (mgr.14355) 10875 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:23 smithi131 bash[24745]: cluster 2024-09-14T02:32:22.471246+0000 mgr.a (mgr.14355) 10875 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:24.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:24 smithi007 bash[22722]: cluster 2024-09-14T02:32:24.472020+0000 mgr.a (mgr.14355) 10876 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:24 smithi131 bash[24745]: cluster 2024-09-14T02:32:24.472020+0000 mgr.a (mgr.14355) 10876 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:24 smithi171 bash[25040]: cluster 2024-09-14T02:32:24.472020+0000 mgr.a (mgr.14355) 10876 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:25.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:25.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:25.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:25.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:25.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:25 smithi007 bash[22722]: audit 2024-09-14T02:32:25.228351+0000 mgr.a (mgr.14355) 10877 : audit [DBG] from='client.239259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:25 smithi131 bash[24745]: audit 2024-09-14T02:32:25.228351+0000 mgr.a (mgr.14355) 10877 : audit [DBG] from='client.239259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:25 smithi171 bash[25040]: audit 2024-09-14T02:32:25.228351+0000 mgr.a (mgr.14355) 10877 : audit [DBG] from='client.239259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:26 smithi007 bash[22722]: cluster 2024-09-14T02:32:26.474874+0000 mgr.a (mgr.14355) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:26 smithi131 bash[24745]: cluster 2024-09-14T02:32:26.474874+0000 mgr.a (mgr.14355) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:26 smithi171 bash[25040]: cluster 2024-09-14T02:32:26.474874+0000 mgr.a (mgr.14355) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:32:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:29 smithi171 bash[25040]: cluster 2024-09-14T02:32:28.475635+0000 mgr.a (mgr.14355) 10879 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:29 smithi007 bash[22722]: cluster 2024-09-14T02:32:28.475635+0000 mgr.a (mgr.14355) 10879 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:30.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:29 smithi131 bash[24745]: cluster 2024-09-14T02:32:28.475635+0000 mgr.a (mgr.14355) 10879 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:30.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:31.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:31.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:31 smithi171 bash[25040]: cluster 2024-09-14T02:32:30.477564+0000 mgr.a (mgr.14355) 10880 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:31 smithi007 bash[22722]: cluster 2024-09-14T02:32:30.477564+0000 mgr.a (mgr.14355) 10880 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:32.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:31 smithi131 bash[24745]: cluster 2024-09-14T02:32:30.477564+0000 mgr.a (mgr.14355) 10880 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:32 smithi007 bash[22722]: audit 2024-09-14T02:32:30.985508+0000 mgr.a (mgr.14355) 10881 : audit [DBG] from='client.239331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:33.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:32 smithi131 bash[24745]: audit 2024-09-14T02:32:30.985508+0000 mgr.a (mgr.14355) 10881 : audit [DBG] from='client.239331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:32 smithi171 bash[25040]: audit 2024-09-14T02:32:30.985508+0000 mgr.a (mgr.14355) 10881 : audit [DBG] from='client.239331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:33 smithi007 bash[22722]: cluster 2024-09-14T02:32:32.478595+0000 mgr.a (mgr.14355) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:33 smithi131 bash[24745]: cluster 2024-09-14T02:32:32.478595+0000 mgr.a (mgr.14355) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:33 smithi171 bash[25040]: cluster 2024-09-14T02:32:32.478595+0000 mgr.a (mgr.14355) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:32:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:35 smithi007 bash[22722]: cluster 2024-09-14T02:32:34.479363+0000 mgr.a (mgr.14355) 10883 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:32:36.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:35 smithi131 bash[24745]: cluster 2024-09-14T02:32:34.479363+0000 mgr.a (mgr.14355) 10883 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:32:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:35 smithi171 bash[25040]: cluster 2024-09-14T02:32:34.479363+0000 mgr.a (mgr.14355) 10883 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:32:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:36.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:36 smithi007 bash[22722]: cluster 2024-09-14T02:32:36.481573+0000 mgr.a (mgr.14355) 10884 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:37.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:36 smithi131 bash[24745]: cluster 2024-09-14T02:32:36.481573+0000 mgr.a (mgr.14355) 10884 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:36 smithi171 bash[25040]: cluster 2024-09-14T02:32:36.481573+0000 mgr.a (mgr.14355) 10884 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:37.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:37.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:37 smithi007 bash[22722]: audit 2024-09-14T02:32:36.752884+0000 mgr.a (mgr.14355) 10885 : audit [DBG] from='client.239406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:37 smithi131 bash[24745]: audit 2024-09-14T02:32:36.752884+0000 mgr.a (mgr.14355) 10885 : audit [DBG] from='client.239406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:37 smithi171 bash[25040]: audit 2024-09-14T02:32:36.752884+0000 mgr.a (mgr.14355) 10885 : audit [DBG] from='client.239406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:38 smithi007 bash[22722]: cluster 2024-09-14T02:32:38.482559+0000 mgr.a (mgr.14355) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:39.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:38 smithi131 bash[24745]: cluster 2024-09-14T02:32:38.482559+0000 mgr.a (mgr.14355) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:39.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:38 smithi171 bash[25040]: cluster 2024-09-14T02:32:38.482559+0000 mgr.a (mgr.14355) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:41 smithi171 bash[25040]: cluster 2024-09-14T02:32:40.484710+0000 mgr.a (mgr.14355) 10887 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:32:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:41 smithi171 bash[25040]: audit 2024-09-14T02:32:40.982562+0000 mon.a (mon.0) 2222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:32:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:41 smithi007 bash[22722]: cluster 2024-09-14T02:32:40.484710+0000 mgr.a (mgr.14355) 10887 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:32:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:41 smithi007 bash[22722]: audit 2024-09-14T02:32:40.982562+0000 mon.a (mon.0) 2222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:32:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:41 smithi131 bash[24745]: cluster 2024-09-14T02:32:40.484710+0000 mgr.a (mgr.14355) 10887 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:32:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:41 smithi131 bash[24745]: audit 2024-09-14T02:32:40.982562+0000 mon.a (mon.0) 2222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:32:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:42 smithi171 bash[25040]: audit 2024-09-14T02:32:41.805660+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:32:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:42 smithi171 bash[25040]: audit 2024-09-14T02:32:41.806993+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:32:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:42 smithi171 bash[25040]: audit 2024-09-14T02:32:41.816098+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:32:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:42 smithi171 bash[25040]: audit 2024-09-14T02:32:41.818307+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:42.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22972]: debug 2024-09-14T02:32:42.551+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:32:42.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22972]: debug 2024-09-14T02:32:42.563+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:32:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22722]: audit 2024-09-14T02:32:41.805660+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:32:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22722]: audit 2024-09-14T02:32:41.806993+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:32:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22722]: audit 2024-09-14T02:32:41.816098+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:32:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:42 smithi007 bash[22722]: audit 2024-09-14T02:32:41.818307+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:42.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:42 smithi131 bash[24745]: audit 2024-09-14T02:32:41.805660+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:32:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:42 smithi131 bash[24745]: audit 2024-09-14T02:32:41.806993+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:32:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:42 smithi131 bash[24745]: audit 2024-09-14T02:32:41.816098+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:32:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:42 smithi131 bash[24745]: audit 2024-09-14T02:32:41.818307+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:43 smithi171 bash[25040]: audit 2024-09-14T02:32:41.820526+0000 mgr.a (mgr.14355) 10888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:43 smithi171 bash[25040]: cluster 2024-09-14T02:32:42.485182+0000 mgr.a (mgr.14355) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:43 smithi171 bash[25040]: audit 2024-09-14T02:32:42.517454+0000 mgr.a (mgr.14355) 10890 : audit [DBG] from='client.239556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:43 smithi007 bash[22722]: audit 2024-09-14T02:32:41.820526+0000 mgr.a (mgr.14355) 10888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:43 smithi007 bash[22722]: cluster 2024-09-14T02:32:42.485182+0000 mgr.a (mgr.14355) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:43 smithi007 bash[22722]: audit 2024-09-14T02:32:42.517454+0000 mgr.a (mgr.14355) 10890 : audit [DBG] from='client.239556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:43 smithi131 bash[24745]: audit 2024-09-14T02:32:41.820526+0000 mgr.a (mgr.14355) 10888 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:32:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:43 smithi131 bash[24745]: cluster 2024-09-14T02:32:42.485182+0000 mgr.a (mgr.14355) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:43 smithi131 bash[24745]: audit 2024-09-14T02:32:42.517454+0000 mgr.a (mgr.14355) 10890 : audit [DBG] from='client.239556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:44 smithi007 bash[22722]: audit 2024-09-14T02:32:42.554633+0000 mgr.a (mgr.14355) 10891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:32:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:44 smithi007 bash[22722]: cephadm 2024-09-14T02:32:42.566423+0000 mgr.a (mgr.14355) 10892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:32:45.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:44 smithi131 bash[24745]: audit 2024-09-14T02:32:42.554633+0000 mgr.a (mgr.14355) 10891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:32:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:44 smithi131 bash[24745]: cephadm 2024-09-14T02:32:42.566423+0000 mgr.a (mgr.14355) 10892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:32:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:44 smithi171 bash[25040]: audit 2024-09-14T02:32:42.554633+0000 mgr.a (mgr.14355) 10891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:32:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:44 smithi171 bash[25040]: cephadm 2024-09-14T02:32:42.566423+0000 mgr.a (mgr.14355) 10892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:32:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:45 smithi007 bash[22722]: cluster 2024-09-14T02:32:44.486268+0000 mgr.a (mgr.14355) 10893 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:45 smithi131 bash[24745]: cluster 2024-09-14T02:32:44.486268+0000 mgr.a (mgr.14355) 10893 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:45 smithi171 bash[25040]: cluster 2024-09-14T02:32:44.486268+0000 mgr.a (mgr.14355) 10893 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:32:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:46 smithi007 bash[22722]: cluster 2024-09-14T02:32:46.488581+0000 mgr.a (mgr.14355) 10894 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:46 smithi131 bash[24745]: cluster 2024-09-14T02:32:46.488581+0000 mgr.a (mgr.14355) 10894 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:46 smithi171 bash[25040]: cluster 2024-09-14T02:32:46.488581+0000 mgr.a (mgr.14355) 10894 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:47.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:47.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:48.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:48.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:49 smithi171 bash[25040]: audit 2024-09-14T02:32:48.289256+0000 mgr.a (mgr.14355) 10895 : audit [DBG] from='client.239667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:49 smithi171 bash[25040]: cluster 2024-09-14T02:32:48.489171+0000 mgr.a (mgr.14355) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:49 smithi007 bash[22722]: audit 2024-09-14T02:32:48.289256+0000 mgr.a (mgr.14355) 10895 : audit [DBG] from='client.239667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:49 smithi007 bash[22722]: cluster 2024-09-14T02:32:48.489171+0000 mgr.a (mgr.14355) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:49 smithi131 bash[24745]: audit 2024-09-14T02:32:48.289256+0000 mgr.a (mgr.14355) 10895 : audit [DBG] from='client.239667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:49 smithi131 bash[24745]: cluster 2024-09-14T02:32:48.489171+0000 mgr.a (mgr.14355) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:51 smithi007 bash[22722]: cluster 2024-09-14T02:32:50.491588+0000 mgr.a (mgr.14355) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:52.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:51 smithi131 bash[24745]: cluster 2024-09-14T02:32:50.491588+0000 mgr.a (mgr.14355) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:51 smithi171 bash[25040]: cluster 2024-09-14T02:32:50.491588+0000 mgr.a (mgr.14355) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:53 smithi007 bash[22722]: cluster 2024-09-14T02:32:52.492649+0000 mgr.a (mgr.14355) 10898 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:54.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:53 smithi131 bash[24745]: cluster 2024-09-14T02:32:52.492649+0000 mgr.a (mgr.14355) 10898 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:53 smithi171 bash[25040]: cluster 2024-09-14T02:32:52.492649+0000 mgr.a (mgr.14355) 10898 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:54.451 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:32:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:32:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:32:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:32:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:32:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:54 smithi007 bash[22722]: audit 2024-09-14T02:32:54.042566+0000 mgr.a (mgr.14355) 10899 : audit [DBG] from='client.239745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:54 smithi007 bash[22722]: cluster 2024-09-14T02:32:54.493340+0000 mgr.a (mgr.14355) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:55.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:54 smithi131 bash[24745]: audit 2024-09-14T02:32:54.042566+0000 mgr.a (mgr.14355) 10899 : audit [DBG] from='client.239745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:54 smithi131 bash[24745]: cluster 2024-09-14T02:32:54.493340+0000 mgr.a (mgr.14355) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:54 smithi171 bash[25040]: audit 2024-09-14T02:32:54.042566+0000 mgr.a (mgr.14355) 10899 : audit [DBG] from='client.239745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:32:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:54 smithi171 bash[25040]: cluster 2024-09-14T02:32:54.493340+0000 mgr.a (mgr.14355) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:57 smithi007 bash[22722]: cluster 2024-09-14T02:32:56.495539+0000 mgr.a (mgr.14355) 10901 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:57 smithi131 bash[24745]: cluster 2024-09-14T02:32:56.495539+0000 mgr.a (mgr.14355) 10901 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:57 smithi171 bash[25040]: cluster 2024-09-14T02:32:56.495539+0000 mgr.a (mgr.14355) 10901 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:32:59.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:32:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:32:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:32:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:32:59 smithi007 bash[22722]: cluster 2024-09-14T02:32:58.496313+0000 mgr.a (mgr.14355) 10902 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:32:59 smithi131 bash[24745]: cluster 2024-09-14T02:32:58.496313+0000 mgr.a (mgr.14355) 10902 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:32:59 smithi171 bash[25040]: cluster 2024-09-14T02:32:58.496313+0000 mgr.a (mgr.14355) 10902 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:00.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:00.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:00 smithi007 bash[22722]: audit 2024-09-14T02:32:59.785511+0000 mgr.a (mgr.14355) 10903 : audit [DBG] from='client.239823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:00 smithi007 bash[22722]: cluster 2024-09-14T02:33:00.498578+0000 mgr.a (mgr.14355) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:00 smithi131 bash[24745]: audit 2024-09-14T02:32:59.785511+0000 mgr.a (mgr.14355) 10903 : audit [DBG] from='client.239823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:00 smithi131 bash[24745]: cluster 2024-09-14T02:33:00.498578+0000 mgr.a (mgr.14355) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:00 smithi171 bash[25040]: audit 2024-09-14T02:32:59.785511+0000 mgr.a (mgr.14355) 10903 : audit [DBG] from='client.239823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:00 smithi171 bash[25040]: cluster 2024-09-14T02:33:00.498578+0000 mgr.a (mgr.14355) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:03 smithi007 bash[22722]: cluster 2024-09-14T02:33:02.499358+0000 mgr.a (mgr.14355) 10905 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:04.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:03 smithi131 bash[24745]: cluster 2024-09-14T02:33:02.499358+0000 mgr.a (mgr.14355) 10905 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:03 smithi171 bash[25040]: cluster 2024-09-14T02:33:02.499358+0000 mgr.a (mgr.14355) 10905 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:04 smithi007 bash[22722]: cluster 2024-09-14T02:33:04.500151+0000 mgr.a (mgr.14355) 10906 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:05.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:04 smithi131 bash[24745]: cluster 2024-09-14T02:33:04.500151+0000 mgr.a (mgr.14355) 10906 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:04 smithi171 bash[25040]: cluster 2024-09-14T02:33:04.500151+0000 mgr.a (mgr.14355) 10906 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:05.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:05.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:05 smithi007 bash[22722]: audit 2024-09-14T02:33:05.530577+0000 mgr.a (mgr.14355) 10907 : audit [DBG] from='client.239901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:05.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:05.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:05.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:05.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:05.958 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:05 smithi131 bash[24745]: audit 2024-09-14T02:33:05.530577+0000 mgr.a (mgr.14355) 10907 : audit [DBG] from='client.239901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:05 smithi171 bash[25040]: audit 2024-09-14T02:33:05.530577+0000 mgr.a (mgr.14355) 10907 : audit [DBG] from='client.239901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:06 smithi007 bash[22722]: cluster 2024-09-14T02:33:06.502993+0000 mgr.a (mgr.14355) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:06 smithi131 bash[24745]: cluster 2024-09-14T02:33:06.502993+0000 mgr.a (mgr.14355) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:06 smithi171 bash[25040]: cluster 2024-09-14T02:33:06.502993+0000 mgr.a (mgr.14355) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:08 smithi007 bash[22722]: cluster 2024-09-14T02:33:08.503761+0000 mgr.a (mgr.14355) 10909 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:09.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:08 smithi131 bash[24745]: cluster 2024-09-14T02:33:08.503761+0000 mgr.a (mgr.14355) 10909 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:08 smithi171 bash[25040]: cluster 2024-09-14T02:33:08.503761+0000 mgr.a (mgr.14355) 10909 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:10 smithi007 bash[22722]: cluster 2024-09-14T02:33:10.505700+0000 mgr.a (mgr.14355) 10910 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:10.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:10.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:10.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:10 smithi131 bash[24745]: cluster 2024-09-14T02:33:10.505700+0000 mgr.a (mgr.14355) 10910 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:10 smithi171 bash[25040]: cluster 2024-09-14T02:33:10.505700+0000 mgr.a (mgr.14355) 10910 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:11.741 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:11 smithi007 bash[22722]: audit 2024-09-14T02:33:11.298087+0000 mgr.a (mgr.14355) 10911 : audit [DBG] from='client.239976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:11 smithi131 bash[24745]: audit 2024-09-14T02:33:11.298087+0000 mgr.a (mgr.14355) 10911 : audit [DBG] from='client.239976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:11 smithi171 bash[25040]: audit 2024-09-14T02:33:11.298087+0000 mgr.a (mgr.14355) 10911 : audit [DBG] from='client.239976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:12 smithi007 bash[22722]: cluster 2024-09-14T02:33:12.506663+0000 mgr.a (mgr.14355) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:12 smithi131 bash[24745]: cluster 2024-09-14T02:33:12.506663+0000 mgr.a (mgr.14355) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:12 smithi171 bash[25040]: cluster 2024-09-14T02:33:12.506663+0000 mgr.a (mgr.14355) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:14 smithi007 bash[22722]: cluster 2024-09-14T02:33:14.507451+0000 mgr.a (mgr.14355) 10913 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:14 smithi131 bash[24745]: cluster 2024-09-14T02:33:14.507451+0000 mgr.a (mgr.14355) 10913 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:14 smithi171 bash[25040]: cluster 2024-09-14T02:33:14.507451+0000 mgr.a (mgr.14355) 10913 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:16.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:16.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:16.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:16 smithi007 bash[22722]: cluster 2024-09-14T02:33:16.509542+0000 mgr.a (mgr.14355) 10914 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:17.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:16 smithi131 bash[24745]: cluster 2024-09-14T02:33:16.509542+0000 mgr.a (mgr.14355) 10914 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:16 smithi171 bash[25040]: cluster 2024-09-14T02:33:16.509542+0000 mgr.a (mgr.14355) 10914 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:17.520 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:17.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:17 smithi007 bash[22722]: audit 2024-09-14T02:33:17.077300+0000 mgr.a (mgr.14355) 10915 : audit [DBG] from='client.240048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:18.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:17 smithi131 bash[24745]: audit 2024-09-14T02:33:17.077300+0000 mgr.a (mgr.14355) 10915 : audit [DBG] from='client.240048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:17 smithi171 bash[25040]: audit 2024-09-14T02:33:17.077300+0000 mgr.a (mgr.14355) 10915 : audit [DBG] from='client.240048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:18 smithi007 bash[22722]: cluster 2024-09-14T02:33:18.510518+0000 mgr.a (mgr.14355) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:19.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:18 smithi131 bash[24745]: cluster 2024-09-14T02:33:18.510518+0000 mgr.a (mgr.14355) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:18 smithi171 bash[25040]: cluster 2024-09-14T02:33:18.510518+0000 mgr.a (mgr.14355) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:20 smithi007 bash[22722]: cluster 2024-09-14T02:33:20.512690+0000 mgr.a (mgr.14355) 10917 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:20 smithi131 bash[24745]: cluster 2024-09-14T02:33:20.512690+0000 mgr.a (mgr.14355) 10917 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:20 smithi171 bash[25040]: cluster 2024-09-14T02:33:20.512690+0000 mgr.a (mgr.14355) 10917 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:22.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:22.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:22 smithi007 bash[22722]: cluster 2024-09-14T02:33:22.513441+0000 mgr.a (mgr.14355) 10918 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:22 smithi131 bash[24745]: cluster 2024-09-14T02:33:22.513441+0000 mgr.a (mgr.14355) 10918 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:22 smithi171 bash[25040]: cluster 2024-09-14T02:33:22.513441+0000 mgr.a (mgr.14355) 10918 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:23.302 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:23 smithi007 bash[22722]: audit 2024-09-14T02:33:22.865405+0000 mgr.a (mgr.14355) 10919 : audit [DBG] from='client.240126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:23 smithi131 bash[24745]: audit 2024-09-14T02:33:22.865405+0000 mgr.a (mgr.14355) 10919 : audit [DBG] from='client.240126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:23 smithi171 bash[25040]: audit 2024-09-14T02:33:22.865405+0000 mgr.a (mgr.14355) 10919 : audit [DBG] from='client.240126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:24 smithi007 bash[22722]: cluster 2024-09-14T02:33:24.514444+0000 mgr.a (mgr.14355) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:24 smithi131 bash[24745]: cluster 2024-09-14T02:33:24.514444+0000 mgr.a (mgr.14355) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:24 smithi171 bash[25040]: cluster 2024-09-14T02:33:24.514444+0000 mgr.a (mgr.14355) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:26 smithi007 bash[22722]: cluster 2024-09-14T02:33:26.516719+0000 mgr.a (mgr.14355) 10921 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:26 smithi131 bash[24745]: cluster 2024-09-14T02:33:26.516719+0000 mgr.a (mgr.14355) 10921 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:26 smithi171 bash[25040]: cluster 2024-09-14T02:33:26.516719+0000 mgr.a (mgr.14355) 10921 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:28.304 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:28.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:28.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:28 smithi007 bash[22722]: cluster 2024-09-14T02:33:28.517472+0000 mgr.a (mgr.14355) 10922 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:28 smithi131 bash[24745]: cluster 2024-09-14T02:33:28.517472+0000 mgr.a (mgr.14355) 10922 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:28 smithi171 bash[25040]: cluster 2024-09-14T02:33:28.517472+0000 mgr.a (mgr.14355) 10922 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:29.062 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:29 smithi007 bash[22722]: audit 2024-09-14T02:33:28.640024+0000 mgr.a (mgr.14355) 10923 : audit [DBG] from='client.240204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:30.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:29 smithi131 bash[24745]: audit 2024-09-14T02:33:28.640024+0000 mgr.a (mgr.14355) 10923 : audit [DBG] from='client.240204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:29 smithi171 bash[25040]: audit 2024-09-14T02:33:28.640024+0000 mgr.a (mgr.14355) 10923 : audit [DBG] from='client.240204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:30 smithi007 bash[22722]: cluster 2024-09-14T02:33:30.519763+0000 mgr.a (mgr.14355) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:31.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:30 smithi131 bash[24745]: cluster 2024-09-14T02:33:30.519763+0000 mgr.a (mgr.14355) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:30 smithi171 bash[25040]: cluster 2024-09-14T02:33:30.519763+0000 mgr.a (mgr.14355) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:32 smithi007 bash[22722]: cluster 2024-09-14T02:33:32.520550+0000 mgr.a (mgr.14355) 10925 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:32 smithi131 bash[24745]: cluster 2024-09-14T02:33:32.520550+0000 mgr.a (mgr.14355) 10925 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:32 smithi171 bash[25040]: cluster 2024-09-14T02:33:32.520550+0000 mgr.a (mgr.14355) 10925 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:34.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:34.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:34.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:34.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:34.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:34.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:34.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:34 smithi007 bash[22722]: audit 2024-09-14T02:33:34.402199+0000 mgr.a (mgr.14355) 10926 : audit [DBG] from='client.240282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:34 smithi007 bash[22722]: cluster 2024-09-14T02:33:34.521117+0000 mgr.a (mgr.14355) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:34 smithi131 bash[24745]: audit 2024-09-14T02:33:34.402199+0000 mgr.a (mgr.14355) 10926 : audit [DBG] from='client.240282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:34 smithi131 bash[24745]: cluster 2024-09-14T02:33:34.521117+0000 mgr.a (mgr.14355) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:34 smithi171 bash[25040]: audit 2024-09-14T02:33:34.402199+0000 mgr.a (mgr.14355) 10926 : audit [DBG] from='client.240282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:34 smithi171 bash[25040]: cluster 2024-09-14T02:33:34.521117+0000 mgr.a (mgr.14355) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:36 smithi007 bash[22722]: cluster 2024-09-14T02:33:36.523532+0000 mgr.a (mgr.14355) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:37.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:36 smithi131 bash[24745]: cluster 2024-09-14T02:33:36.523532+0000 mgr.a (mgr.14355) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:36 smithi171 bash[25040]: cluster 2024-09-14T02:33:36.523532+0000 mgr.a (mgr.14355) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:33:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:38 smithi007 bash[22722]: cluster 2024-09-14T02:33:38.524509+0000 mgr.a (mgr.14355) 10929 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:39.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:38 smithi131 bash[24745]: cluster 2024-09-14T02:33:38.524509+0000 mgr.a (mgr.14355) 10929 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:38 smithi171 bash[25040]: cluster 2024-09-14T02:33:38.524509+0000 mgr.a (mgr.14355) 10929 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:39.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:39.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:40.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:40 smithi007 bash[22722]: audit 2024-09-14T02:33:40.200320+0000 mgr.a (mgr.14355) 10930 : audit [DBG] from='client.240357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:40 smithi007 bash[22722]: cluster 2024-09-14T02:33:40.525898+0000 mgr.a (mgr.14355) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:40 smithi131 bash[24745]: audit 2024-09-14T02:33:40.200320+0000 mgr.a (mgr.14355) 10930 : audit [DBG] from='client.240357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:40 smithi131 bash[24745]: cluster 2024-09-14T02:33:40.525898+0000 mgr.a (mgr.14355) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:40 smithi171 bash[25040]: audit 2024-09-14T02:33:40.200320+0000 mgr.a (mgr.14355) 10930 : audit [DBG] from='client.240357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:40 smithi171 bash[25040]: cluster 2024-09-14T02:33:40.525898+0000 mgr.a (mgr.14355) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:42 smithi007 bash[22722]: cluster 2024-09-14T02:33:42.526760+0000 mgr.a (mgr.14355) 10932 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:43.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:42 smithi131 bash[24745]: cluster 2024-09-14T02:33:42.526760+0000 mgr.a (mgr.14355) 10932 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:42 smithi171 bash[25040]: cluster 2024-09-14T02:33:42.526760+0000 mgr.a (mgr.14355) 10932 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:43 smithi007 bash[22722]: audit 2024-09-14T02:33:42.621599+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:33:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:43 smithi131 bash[24745]: audit 2024-09-14T02:33:42.621599+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:33:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:43 smithi171 bash[25040]: audit 2024-09-14T02:33:42.621599+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:33:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:44 smithi007 bash[22722]: cluster 2024-09-14T02:33:44.527592+0000 mgr.a (mgr.14355) 10933 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:45.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:44 smithi131 bash[24745]: cluster 2024-09-14T02:33:44.527592+0000 mgr.a (mgr.14355) 10933 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:44 smithi171 bash[25040]: cluster 2024-09-14T02:33:44.527592+0000 mgr.a (mgr.14355) 10933 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:33:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:45.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:46.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:46 smithi007 bash[22722]: audit 2024-09-14T02:33:45.979862+0000 mgr.a (mgr.14355) 10934 : audit [DBG] from='client.240435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:46 smithi007 bash[22722]: cluster 2024-09-14T02:33:46.530438+0000 mgr.a (mgr.14355) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:47.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:46 smithi131 bash[24745]: audit 2024-09-14T02:33:45.979862+0000 mgr.a (mgr.14355) 10934 : audit [DBG] from='client.240435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:46 smithi131 bash[24745]: cluster 2024-09-14T02:33:46.530438+0000 mgr.a (mgr.14355) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:46 smithi171 bash[25040]: audit 2024-09-14T02:33:45.979862+0000 mgr.a (mgr.14355) 10934 : audit [DBG] from='client.240435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:46 smithi171 bash[25040]: cluster 2024-09-14T02:33:46.530438+0000 mgr.a (mgr.14355) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:33:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:47.963295+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:47.968458+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:47.974675+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:47.979390+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:47.997405+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:48.002991+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: cluster 2024-09-14T02:33:48.531137+0000 mgr.a (mgr.14355) 10936 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:49.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:48.722701+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:33:49.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:48.724594+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:33:49.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:48.734960+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:48 smithi131 bash[24745]: audit 2024-09-14T02:33:48.737766+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:47.963295+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:47.968458+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:47.974675+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:47.979390+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:47.997405+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:48.002991+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: cluster 2024-09-14T02:33:48.531137+0000 mgr.a (mgr.14355) 10936 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:48.722701+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:48.724594+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:48.734960+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:48 smithi171 bash[25040]: audit 2024-09-14T02:33:48.737766+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:47.963295+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:47.968458+0000 mon.a (mon.0) 2229 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:47.974675+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:47.979390+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:47.997405+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:48.002991+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: cluster 2024-09-14T02:33:48.531137+0000 mgr.a (mgr.14355) 10936 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:33:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:48.722701+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:33:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:48.724594+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:33:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:48.734960+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:33:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:48 smithi007 bash[22722]: audit 2024-09-14T02:33:48.737766+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:49.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:33:49 smithi007 bash[22972]: debug 2024-09-14T02:33:49.470+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:33:49.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:33:49 smithi007 bash[22972]: debug 2024-09-14T02:33:49.474+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:33:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:50 smithi131 bash[24745]: audit 2024-09-14T02:33:48.740150+0000 mgr.a (mgr.14355) 10937 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:50 smithi131 bash[24745]: audit 2024-09-14T02:33:49.474269+0000 mgr.a (mgr.14355) 10938 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:33:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:50 smithi131 bash[24745]: cephadm 2024-09-14T02:33:49.476152+0000 mgr.a (mgr.14355) 10939 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:33:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:50 smithi171 bash[25040]: audit 2024-09-14T02:33:48.740150+0000 mgr.a (mgr.14355) 10937 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:50 smithi171 bash[25040]: audit 2024-09-14T02:33:49.474269+0000 mgr.a (mgr.14355) 10938 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:33:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:50 smithi171 bash[25040]: cephadm 2024-09-14T02:33:49.476152+0000 mgr.a (mgr.14355) 10939 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:33:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:50 smithi007 bash[22722]: audit 2024-09-14T02:33:48.740150+0000 mgr.a (mgr.14355) 10937 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:33:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:50 smithi007 bash[22722]: audit 2024-09-14T02:33:49.474269+0000 mgr.a (mgr.14355) 10938 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:33:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:50 smithi007 bash[22722]: cephadm 2024-09-14T02:33:49.476152+0000 mgr.a (mgr.14355) 10939 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:33:51.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:51 smithi131 bash[24745]: cluster 2024-09-14T02:33:50.533375+0000 mgr.a (mgr.14355) 10940 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:51 smithi171 bash[25040]: cluster 2024-09-14T02:33:50.533375+0000 mgr.a (mgr.14355) 10940 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:51.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:51.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:51.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:51 smithi007 bash[22722]: cluster 2024-09-14T02:33:50.533375+0000 mgr.a (mgr.14355) 10940 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:52.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:52.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:52.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:52.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:52.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:52 smithi007 bash[22722]: audit 2024-09-14T02:33:51.740098+0000 mgr.a (mgr.14355) 10941 : audit [DBG] from='client.240618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:52 smithi007 bash[22722]: cluster 2024-09-14T02:33:52.534389+0000 mgr.a (mgr.14355) 10942 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:52 smithi131 bash[24745]: audit 2024-09-14T02:33:51.740098+0000 mgr.a (mgr.14355) 10941 : audit [DBG] from='client.240618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:52 smithi131 bash[24745]: cluster 2024-09-14T02:33:52.534389+0000 mgr.a (mgr.14355) 10942 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:52 smithi171 bash[25040]: audit 2024-09-14T02:33:51.740098+0000 mgr.a (mgr.14355) 10941 : audit [DBG] from='client.240618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:52 smithi171 bash[25040]: cluster 2024-09-14T02:33:52.534389+0000 mgr.a (mgr.14355) 10942 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:54 smithi007 bash[22722]: cluster 2024-09-14T02:33:54.535176+0000 mgr.a (mgr.14355) 10943 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:54 smithi131 bash[24745]: cluster 2024-09-14T02:33:54.535176+0000 mgr.a (mgr.14355) 10943 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:54 smithi171 bash[25040]: cluster 2024-09-14T02:33:54.535176+0000 mgr.a (mgr.14355) 10943 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:56 smithi007 bash[22722]: cluster 2024-09-14T02:33:56.537401+0000 mgr.a (mgr.14355) 10944 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:57.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:56 smithi131 bash[24745]: cluster 2024-09-14T02:33:56.537401+0000 mgr.a (mgr.14355) 10944 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:56 smithi171 bash[25040]: cluster 2024-09-14T02:33:56.537401+0000 mgr.a (mgr.14355) 10944 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:57.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:33:57.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:33:57.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:33:57.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:33:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:33:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:33:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:33:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:33:57.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:57 smithi007 bash[22722]: audit 2024-09-14T02:33:57.514340+0000 mgr.a (mgr.14355) 10945 : audit [DBG] from='client.240693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:57 smithi131 bash[24745]: audit 2024-09-14T02:33:57.514340+0000 mgr.a (mgr.14355) 10945 : audit [DBG] from='client.240693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:57 smithi171 bash[25040]: audit 2024-09-14T02:33:57.514340+0000 mgr.a (mgr.14355) 10945 : audit [DBG] from='client.240693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:33:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:33:58 smithi007 bash[22722]: cluster 2024-09-14T02:33:58.538459+0000 mgr.a (mgr.14355) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:33:58 smithi131 bash[24745]: cluster 2024-09-14T02:33:58.538459+0000 mgr.a (mgr.14355) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:33:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:33:58 smithi171 bash[25040]: cluster 2024-09-14T02:33:58.538459+0000 mgr.a (mgr.14355) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:00 smithi007 bash[22722]: cluster 2024-09-14T02:34:00.540638+0000 mgr.a (mgr.14355) 10947 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:00 smithi131 bash[24745]: cluster 2024-09-14T02:34:00.540638+0000 mgr.a (mgr.14355) 10947 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:00 smithi171 bash[25040]: cluster 2024-09-14T02:34:00.540638+0000 mgr.a (mgr.14355) 10947 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:02.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:02.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:02 smithi007 bash[22722]: cluster 2024-09-14T02:34:02.541436+0000 mgr.a (mgr.14355) 10948 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:02 smithi131 bash[24745]: cluster 2024-09-14T02:34:02.541436+0000 mgr.a (mgr.14355) 10948 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:02 smithi171 bash[25040]: cluster 2024-09-14T02:34:02.541436+0000 mgr.a (mgr.14355) 10948 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:03.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:03 smithi007 bash[22722]: audit 2024-09-14T02:34:03.283315+0000 mgr.a (mgr.14355) 10949 : audit [DBG] from='client.240771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:03 smithi131 bash[24745]: audit 2024-09-14T02:34:03.283315+0000 mgr.a (mgr.14355) 10949 : audit [DBG] from='client.240771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:03 smithi171 bash[25040]: audit 2024-09-14T02:34:03.283315+0000 mgr.a (mgr.14355) 10949 : audit [DBG] from='client.240771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:04 smithi007 bash[22722]: cluster 2024-09-14T02:34:04.542514+0000 mgr.a (mgr.14355) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:05.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:04 smithi131 bash[24745]: cluster 2024-09-14T02:34:04.542514+0000 mgr.a (mgr.14355) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:04 smithi171 bash[25040]: cluster 2024-09-14T02:34:04.542514+0000 mgr.a (mgr.14355) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:06 smithi007 bash[22722]: cluster 2024-09-14T02:34:06.544741+0000 mgr.a (mgr.14355) 10951 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:06 smithi131 bash[24745]: cluster 2024-09-14T02:34:06.544741+0000 mgr.a (mgr.14355) 10951 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:06 smithi171 bash[25040]: cluster 2024-09-14T02:34:06.544741+0000 mgr.a (mgr.14355) 10951 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:08.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:08 smithi007 bash[22722]: cluster 2024-09-14T02:34:08.545504+0000 mgr.a (mgr.14355) 10952 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:08 smithi131 bash[24745]: cluster 2024-09-14T02:34:08.545504+0000 mgr.a (mgr.14355) 10952 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:08 smithi171 bash[25040]: cluster 2024-09-14T02:34:08.545504+0000 mgr.a (mgr.14355) 10952 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:09.480 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:09 smithi007 bash[22722]: audit 2024-09-14T02:34:09.026330+0000 mgr.a (mgr.14355) 10953 : audit [DBG] from='client.240846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:09 smithi131 bash[24745]: audit 2024-09-14T02:34:09.026330+0000 mgr.a (mgr.14355) 10953 : audit [DBG] from='client.240846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:09 smithi171 bash[25040]: audit 2024-09-14T02:34:09.026330+0000 mgr.a (mgr.14355) 10953 : audit [DBG] from='client.240846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:10 smithi007 bash[22722]: cluster 2024-09-14T02:34:10.547793+0000 mgr.a (mgr.14355) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:10 smithi131 bash[24745]: cluster 2024-09-14T02:34:10.547793+0000 mgr.a (mgr.14355) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:10 smithi171 bash[25040]: cluster 2024-09-14T02:34:10.547793+0000 mgr.a (mgr.14355) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:12 smithi007 bash[22722]: cluster 2024-09-14T02:34:12.548571+0000 mgr.a (mgr.14355) 10955 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:12 smithi131 bash[24745]: cluster 2024-09-14T02:34:12.548571+0000 mgr.a (mgr.14355) 10955 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:12 smithi171 bash[25040]: cluster 2024-09-14T02:34:12.548571+0000 mgr.a (mgr.14355) 10955 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:14.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:14.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:14.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:14 smithi007 bash[22722]: cluster 2024-09-14T02:34:14.549316+0000 mgr.a (mgr.14355) 10956 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:14 smithi131 bash[24745]: cluster 2024-09-14T02:34:14.549316+0000 mgr.a (mgr.14355) 10956 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:14 smithi171 bash[25040]: cluster 2024-09-14T02:34:14.549316+0000 mgr.a (mgr.14355) 10956 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:15.233 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:15 smithi007 bash[22722]: audit 2024-09-14T02:34:14.814867+0000 mgr.a (mgr.14355) 10957 : audit [DBG] from='client.240924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:16.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:15 smithi131 bash[24745]: audit 2024-09-14T02:34:14.814867+0000 mgr.a (mgr.14355) 10957 : audit [DBG] from='client.240924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:15 smithi171 bash[25040]: audit 2024-09-14T02:34:14.814867+0000 mgr.a (mgr.14355) 10957 : audit [DBG] from='client.240924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:16 smithi007 bash[22722]: cluster 2024-09-14T02:34:16.551830+0000 mgr.a (mgr.14355) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:16 smithi131 bash[24745]: cluster 2024-09-14T02:34:16.551830+0000 mgr.a (mgr.14355) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:16 smithi171 bash[25040]: cluster 2024-09-14T02:34:16.551830+0000 mgr.a (mgr.14355) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:18 smithi007 bash[22722]: cluster 2024-09-14T02:34:18.552747+0000 mgr.a (mgr.14355) 10959 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:18 smithi131 bash[24745]: cluster 2024-09-14T02:34:18.552747+0000 mgr.a (mgr.14355) 10959 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:18 smithi171 bash[25040]: cluster 2024-09-14T02:34:18.552747+0000 mgr.a (mgr.14355) 10959 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:20.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:20.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:20 smithi007 bash[22722]: cluster 2024-09-14T02:34:20.553972+0000 mgr.a (mgr.14355) 10960 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:21.003 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:21.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:21.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:20 smithi131 bash[24745]: cluster 2024-09-14T02:34:20.553972+0000 mgr.a (mgr.14355) 10960 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:20 smithi171 bash[25040]: cluster 2024-09-14T02:34:20.553972+0000 mgr.a (mgr.14355) 10960 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:21 smithi007 bash[22722]: audit 2024-09-14T02:34:20.572469+0000 mgr.a (mgr.14355) 10961 : audit [DBG] from='client.241002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:22.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:21 smithi131 bash[24745]: audit 2024-09-14T02:34:20.572469+0000 mgr.a (mgr.14355) 10961 : audit [DBG] from='client.241002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:21 smithi171 bash[25040]: audit 2024-09-14T02:34:20.572469+0000 mgr.a (mgr.14355) 10961 : audit [DBG] from='client.241002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:22 smithi007 bash[22722]: cluster 2024-09-14T02:34:22.554844+0000 mgr.a (mgr.14355) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:22 smithi131 bash[24745]: cluster 2024-09-14T02:34:22.554844+0000 mgr.a (mgr.14355) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:22 smithi171 bash[25040]: cluster 2024-09-14T02:34:22.554844+0000 mgr.a (mgr.14355) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:24 smithi007 bash[22722]: cluster 2024-09-14T02:34:24.555721+0000 mgr.a (mgr.14355) 10963 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:24 smithi131 bash[24745]: cluster 2024-09-14T02:34:24.555721+0000 mgr.a (mgr.14355) 10963 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:24 smithi171 bash[25040]: cluster 2024-09-14T02:34:24.555721+0000 mgr.a (mgr.14355) 10963 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:26.799 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:26.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:26.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:26 smithi007 bash[22722]: audit 2024-09-14T02:34:26.348080+0000 mgr.a (mgr.14355) 10964 : audit [DBG] from='client.241080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:26 smithi007 bash[22722]: cluster 2024-09-14T02:34:26.557373+0000 mgr.a (mgr.14355) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:26 smithi131 bash[24745]: audit 2024-09-14T02:34:26.348080+0000 mgr.a (mgr.14355) 10964 : audit [DBG] from='client.241080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:26 smithi131 bash[24745]: cluster 2024-09-14T02:34:26.557373+0000 mgr.a (mgr.14355) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:26 smithi171 bash[25040]: audit 2024-09-14T02:34:26.348080+0000 mgr.a (mgr.14355) 10964 : audit [DBG] from='client.241080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:26 smithi171 bash[25040]: cluster 2024-09-14T02:34:26.557373+0000 mgr.a (mgr.14355) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:28 smithi007 bash[22722]: cluster 2024-09-14T02:34:28.558243+0000 mgr.a (mgr.14355) 10966 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:29.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:28 smithi131 bash[24745]: cluster 2024-09-14T02:34:28.558243+0000 mgr.a (mgr.14355) 10966 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:28 smithi171 bash[25040]: cluster 2024-09-14T02:34:28.558243+0000 mgr.a (mgr.14355) 10966 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:34:30.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:30 smithi007 bash[22722]: cluster 2024-09-14T02:34:30.560438+0000 mgr.a (mgr.14355) 10967 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:31.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:30 smithi131 bash[24745]: cluster 2024-09-14T02:34:30.560438+0000 mgr.a (mgr.14355) 10967 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:30 smithi171 bash[25040]: cluster 2024-09-14T02:34:30.560438+0000 mgr.a (mgr.14355) 10967 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:31.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:31.802 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:32.574 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:32.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:32.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:32 smithi007 bash[22722]: audit 2024-09-14T02:34:32.136306+0000 mgr.a (mgr.14355) 10968 : audit [DBG] from='client.241158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:32 smithi007 bash[22722]: cluster 2024-09-14T02:34:32.560929+0000 mgr.a (mgr.14355) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:33.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:32 smithi131 bash[24745]: audit 2024-09-14T02:34:32.136306+0000 mgr.a (mgr.14355) 10968 : audit [DBG] from='client.241158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:32 smithi131 bash[24745]: cluster 2024-09-14T02:34:32.560929+0000 mgr.a (mgr.14355) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:32 smithi171 bash[25040]: audit 2024-09-14T02:34:32.136306+0000 mgr.a (mgr.14355) 10968 : audit [DBG] from='client.241158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:32 smithi171 bash[25040]: cluster 2024-09-14T02:34:32.560929+0000 mgr.a (mgr.14355) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:34 smithi007 bash[22722]: cluster 2024-09-14T02:34:34.561686+0000 mgr.a (mgr.14355) 10970 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:35.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:34 smithi131 bash[24745]: cluster 2024-09-14T02:34:34.561686+0000 mgr.a (mgr.14355) 10970 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:34 smithi171 bash[25040]: cluster 2024-09-14T02:34:34.561686+0000 mgr.a (mgr.14355) 10970 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:36 smithi007 bash[22722]: cluster 2024-09-14T02:34:36.563929+0000 mgr.a (mgr.14355) 10971 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:37.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:36 smithi131 bash[24745]: cluster 2024-09-14T02:34:36.563929+0000 mgr.a (mgr.14355) 10971 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:36 smithi171 bash[25040]: cluster 2024-09-14T02:34:36.563929+0000 mgr.a (mgr.14355) 10971 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:38.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:38 smithi007 bash[22722]: audit 2024-09-14T02:34:37.912498+0000 mgr.a (mgr.14355) 10972 : audit [DBG] from='client.241230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:38 smithi007 bash[22722]: cluster 2024-09-14T02:34:38.564946+0000 mgr.a (mgr.14355) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:39.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:38 smithi131 bash[24745]: audit 2024-09-14T02:34:37.912498+0000 mgr.a (mgr.14355) 10972 : audit [DBG] from='client.241230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:38 smithi131 bash[24745]: cluster 2024-09-14T02:34:38.564946+0000 mgr.a (mgr.14355) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:38 smithi171 bash[25040]: audit 2024-09-14T02:34:37.912498+0000 mgr.a (mgr.14355) 10972 : audit [DBG] from='client.241230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:38 smithi171 bash[25040]: cluster 2024-09-14T02:34:38.564946+0000 mgr.a (mgr.14355) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:40 smithi007 bash[22722]: cluster 2024-09-14T02:34:40.567136+0000 mgr.a (mgr.14355) 10974 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:41.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:40 smithi131 bash[24745]: cluster 2024-09-14T02:34:40.567136+0000 mgr.a (mgr.14355) 10974 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:40 smithi171 bash[25040]: cluster 2024-09-14T02:34:40.567136+0000 mgr.a (mgr.14355) 10974 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:42 smithi007 bash[22722]: cluster 2024-09-14T02:34:42.567938+0000 mgr.a (mgr.14355) 10975 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:43.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:42 smithi131 bash[24745]: cluster 2024-09-14T02:34:42.567938+0000 mgr.a (mgr.14355) 10975 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:42 smithi171 bash[25040]: cluster 2024-09-14T02:34:42.567938+0000 mgr.a (mgr.14355) 10975 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:43.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:43.356 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:44.140 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:44.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:44.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:44.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:44.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:44 smithi007 bash[22722]: audit 2024-09-14T02:34:43.691443+0000 mgr.a (mgr.14355) 10976 : audit [DBG] from='client.241308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:44 smithi007 bash[22722]: cluster 2024-09-14T02:34:44.568950+0000 mgr.a (mgr.14355) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:44 smithi131 bash[24745]: audit 2024-09-14T02:34:43.691443+0000 mgr.a (mgr.14355) 10976 : audit [DBG] from='client.241308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:44 smithi131 bash[24745]: cluster 2024-09-14T02:34:44.568950+0000 mgr.a (mgr.14355) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:44 smithi171 bash[25040]: audit 2024-09-14T02:34:43.691443+0000 mgr.a (mgr.14355) 10976 : audit [DBG] from='client.241308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:44 smithi171 bash[25040]: cluster 2024-09-14T02:34:44.568950+0000 mgr.a (mgr.14355) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:46 smithi007 bash[22722]: cluster 2024-09-14T02:34:46.571252+0000 mgr.a (mgr.14355) 10978 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:47.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:46 smithi131 bash[24745]: cluster 2024-09-14T02:34:46.571252+0000 mgr.a (mgr.14355) 10978 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:46 smithi171 bash[25040]: cluster 2024-09-14T02:34:46.571252+0000 mgr.a (mgr.14355) 10978 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:49.141 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:49.142 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:49 smithi007 bash[22722]: cluster 2024-09-14T02:34:48.572038+0000 mgr.a (mgr.14355) 10979 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:49.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:49 smithi131 bash[24745]: cluster 2024-09-14T02:34:48.572038+0000 mgr.a (mgr.14355) 10979 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:49 smithi171 bash[25040]: cluster 2024-09-14T02:34:48.572038+0000 mgr.a (mgr.14355) 10979 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:49.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:49.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:49.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:49.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:49.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:50 smithi007 bash[22722]: audit 2024-09-14T02:34:49.475670+0000 mgr.a (mgr.14355) 10980 : audit [DBG] from='client.241386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:50 smithi007 bash[22722]: audit 2024-09-14T02:34:49.529572+0000 mon.a (mon.0) 2238 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:34:50.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:50 smithi131 bash[24745]: audit 2024-09-14T02:34:49.475670+0000 mgr.a (mgr.14355) 10980 : audit [DBG] from='client.241386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:50.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:50 smithi131 bash[24745]: audit 2024-09-14T02:34:49.529572+0000 mon.a (mon.0) 2238 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:34:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:50 smithi171 bash[25040]: audit 2024-09-14T02:34:49.475670+0000 mgr.a (mgr.14355) 10980 : audit [DBG] from='client.241386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:50 smithi171 bash[25040]: audit 2024-09-14T02:34:49.529572+0000 mon.a (mon.0) 2238 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:34:51.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22972]: debug 2024-09-14T02:34:51.085+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:34:51.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22972]: debug 2024-09-14T02:34:51.089+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:34:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: audit 2024-09-14T02:34:50.332699+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:34:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: audit 2024-09-14T02:34:50.333919+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:34:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: audit 2024-09-14T02:34:50.342198+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:34:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: audit 2024-09-14T02:34:50.347048+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: audit 2024-09-14T02:34:50.349293+0000 mgr.a (mgr.14355) 10981 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:51 smithi007 bash[22722]: cluster 2024-09-14T02:34:50.574311+0000 mgr.a (mgr.14355) 10982 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: audit 2024-09-14T02:34:50.332699+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: audit 2024-09-14T02:34:50.333919+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: audit 2024-09-14T02:34:50.342198+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: audit 2024-09-14T02:34:50.347048+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: audit 2024-09-14T02:34:50.349293+0000 mgr.a (mgr.14355) 10981 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:51 smithi131 bash[24745]: cluster 2024-09-14T02:34:50.574311+0000 mgr.a (mgr.14355) 10982 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: audit 2024-09-14T02:34:50.332699+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:34:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: audit 2024-09-14T02:34:50.333919+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:34:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: audit 2024-09-14T02:34:50.342198+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:34:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: audit 2024-09-14T02:34:50.347048+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: audit 2024-09-14T02:34:50.349293+0000 mgr.a (mgr.14355) 10981 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:34:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:51 smithi171 bash[25040]: cluster 2024-09-14T02:34:50.574311+0000 mgr.a (mgr.14355) 10982 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:34:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:52 smithi007 bash[22722]: audit 2024-09-14T02:34:51.090229+0000 mgr.a (mgr.14355) 10983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:34:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:52 smithi007 bash[22722]: cephadm 2024-09-14T02:34:51.092287+0000 mgr.a (mgr.14355) 10984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:34:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:52 smithi131 bash[24745]: audit 2024-09-14T02:34:51.090229+0000 mgr.a (mgr.14355) 10983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:34:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:52 smithi131 bash[24745]: cephadm 2024-09-14T02:34:51.092287+0000 mgr.a (mgr.14355) 10984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:34:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:52 smithi171 bash[25040]: audit 2024-09-14T02:34:51.090229+0000 mgr.a (mgr.14355) 10983 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:34:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:52 smithi171 bash[25040]: cephadm 2024-09-14T02:34:51.092287+0000 mgr.a (mgr.14355) 10984 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:34:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:53 smithi007 bash[22722]: cluster 2024-09-14T02:34:52.575152+0000 mgr.a (mgr.14355) 10985 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:53.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:53 smithi131 bash[24745]: cluster 2024-09-14T02:34:52.575152+0000 mgr.a (mgr.14355) 10985 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:53 smithi171 bash[25040]: cluster 2024-09-14T02:34:52.575152+0000 mgr.a (mgr.14355) 10985 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:54.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:34:54.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:34:54.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:34:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:54 smithi007 bash[22722]: cluster 2024-09-14T02:34:54.575919+0000 mgr.a (mgr.14355) 10986 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:54 smithi131 bash[24745]: cluster 2024-09-14T02:34:54.575919+0000 mgr.a (mgr.14355) 10986 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:54 smithi171 bash[25040]: cluster 2024-09-14T02:34:54.575919+0000 mgr.a (mgr.14355) 10986 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:34:55.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:34:55.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:34:55.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:34:55.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:34:55.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:34:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:55 smithi007 bash[22722]: audit 2024-09-14T02:34:55.229621+0000 mgr.a (mgr.14355) 10987 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:55 smithi131 bash[24745]: audit 2024-09-14T02:34:55.229621+0000 mgr.a (mgr.14355) 10987 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:55 smithi171 bash[25040]: audit 2024-09-14T02:34:55.229621+0000 mgr.a (mgr.14355) 10987 : audit [DBG] from='client.241572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:34:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:57 smithi007 bash[22722]: cluster 2024-09-14T02:34:56.578657+0000 mgr.a (mgr.14355) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:57 smithi131 bash[24745]: cluster 2024-09-14T02:34:56.578657+0000 mgr.a (mgr.14355) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:57 smithi171 bash[25040]: cluster 2024-09-14T02:34:56.578657+0000 mgr.a (mgr.14355) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:34:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:34:59 smithi007 bash[22722]: cluster 2024-09-14T02:34:58.579490+0000 mgr.a (mgr.14355) 10989 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:34:59 smithi131 bash[24745]: cluster 2024-09-14T02:34:58.579490+0000 mgr.a (mgr.14355) 10989 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:34:59 smithi171 bash[25040]: cluster 2024-09-14T02:34:58.579490+0000 mgr.a (mgr.14355) 10989 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:00.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:00.664 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:00.664 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:01.446 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:01.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:01.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:01.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:01.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:01 smithi131 bash[24745]: cluster 2024-09-14T02:35:00.581455+0000 mgr.a (mgr.14355) 10990 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:01 smithi131 bash[24745]: audit 2024-09-14T02:35:01.001021+0000 mgr.a (mgr.14355) 10991 : audit [DBG] from='client.241650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:01 smithi171 bash[25040]: cluster 2024-09-14T02:35:00.581455+0000 mgr.a (mgr.14355) 10990 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:01 smithi171 bash[25040]: audit 2024-09-14T02:35:01.001021+0000 mgr.a (mgr.14355) 10991 : audit [DBG] from='client.241650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:01.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:01 smithi007 bash[22722]: cluster 2024-09-14T02:35:00.581455+0000 mgr.a (mgr.14355) 10990 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:01.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:01 smithi007 bash[22722]: audit 2024-09-14T02:35:01.001021+0000 mgr.a (mgr.14355) 10991 : audit [DBG] from='client.241650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:03 smithi007 bash[22722]: cluster 2024-09-14T02:35:02.582351+0000 mgr.a (mgr.14355) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:04.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:03 smithi131 bash[24745]: cluster 2024-09-14T02:35:02.582351+0000 mgr.a (mgr.14355) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:03 smithi171 bash[25040]: cluster 2024-09-14T02:35:02.582351+0000 mgr.a (mgr.14355) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:05 smithi007 bash[22722]: cluster 2024-09-14T02:35:04.583136+0000 mgr.a (mgr.14355) 10993 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:05 smithi131 bash[24745]: cluster 2024-09-14T02:35:04.583136+0000 mgr.a (mgr.14355) 10993 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:05 smithi171 bash[25040]: cluster 2024-09-14T02:35:04.583136+0000 mgr.a (mgr.14355) 10993 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:35:06.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:07.242 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:07 smithi007 bash[22722]: cluster 2024-09-14T02:35:06.584484+0000 mgr.a (mgr.14355) 10994 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:07 smithi007 bash[22722]: audit 2024-09-14T02:35:06.790592+0000 mgr.a (mgr.14355) 10995 : audit [DBG] from='client.241728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:07 smithi131 bash[24745]: cluster 2024-09-14T02:35:06.584484+0000 mgr.a (mgr.14355) 10994 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:07 smithi131 bash[24745]: audit 2024-09-14T02:35:06.790592+0000 mgr.a (mgr.14355) 10995 : audit [DBG] from='client.241728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:07 smithi171 bash[25040]: cluster 2024-09-14T02:35:06.584484+0000 mgr.a (mgr.14355) 10994 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:07 smithi171 bash[25040]: audit 2024-09-14T02:35:06.790592+0000 mgr.a (mgr.14355) 10995 : audit [DBG] from='client.241728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:09 smithi007 bash[22722]: cluster 2024-09-14T02:35:08.585357+0000 mgr.a (mgr.14355) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:09 smithi131 bash[24745]: cluster 2024-09-14T02:35:08.585357+0000 mgr.a (mgr.14355) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:09 smithi171 bash[25040]: cluster 2024-09-14T02:35:08.585357+0000 mgr.a (mgr.14355) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:11 smithi007 bash[22722]: cluster 2024-09-14T02:35:10.587527+0000 mgr.a (mgr.14355) 10997 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:11 smithi131 bash[24745]: cluster 2024-09-14T02:35:10.587527+0000 mgr.a (mgr.14355) 10997 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:11 smithi171 bash[25040]: cluster 2024-09-14T02:35:10.587527+0000 mgr.a (mgr.14355) 10997 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:12 smithi007 bash[22722]: audit 2024-09-14T02:35:12.573824+0000 mgr.a (mgr.14355) 10998 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:12.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:12 smithi131 bash[24745]: audit 2024-09-14T02:35:12.573824+0000 mgr.a (mgr.14355) 10998 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:12 smithi171 bash[25040]: audit 2024-09-14T02:35:12.573824+0000 mgr.a (mgr.14355) 10998 : audit [DBG] from='client.241800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:14 smithi007 bash[22722]: cluster 2024-09-14T02:35:12.588760+0000 mgr.a (mgr.14355) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:14 smithi131 bash[24745]: cluster 2024-09-14T02:35:12.588760+0000 mgr.a (mgr.14355) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:14 smithi171 bash[25040]: cluster 2024-09-14T02:35:12.588760+0000 mgr.a (mgr.14355) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:16 smithi007 bash[22722]: cluster 2024-09-14T02:35:14.589714+0000 mgr.a (mgr.14355) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:16.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:16 smithi131 bash[24745]: cluster 2024-09-14T02:35:14.589714+0000 mgr.a (mgr.14355) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:16 smithi171 bash[25040]: cluster 2024-09-14T02:35:14.589714+0000 mgr.a (mgr.14355) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:17.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:18 smithi007 bash[22722]: cluster 2024-09-14T02:35:16.591967+0000 mgr.a (mgr.14355) 11001 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:18.755 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:18.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:18.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:18 smithi131 bash[24745]: cluster 2024-09-14T02:35:16.591967+0000 mgr.a (mgr.14355) 11001 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:18 smithi171 bash[25040]: cluster 2024-09-14T02:35:16.591967+0000 mgr.a (mgr.14355) 11001 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:19 smithi007 bash[22722]: audit 2024-09-14T02:35:18.322561+0000 mgr.a (mgr.14355) 11002 : audit [DBG] from='client.241869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:19.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:19 smithi131 bash[24745]: audit 2024-09-14T02:35:18.322561+0000 mgr.a (mgr.14355) 11002 : audit [DBG] from='client.241869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:19 smithi171 bash[25040]: audit 2024-09-14T02:35:18.322561+0000 mgr.a (mgr.14355) 11002 : audit [DBG] from='client.241869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:20 smithi007 bash[22722]: cluster 2024-09-14T02:35:18.592582+0000 mgr.a (mgr.14355) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:20 smithi131 bash[24745]: cluster 2024-09-14T02:35:18.592582+0000 mgr.a (mgr.14355) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:20 smithi171 bash[25040]: cluster 2024-09-14T02:35:18.592582+0000 mgr.a (mgr.14355) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:22 smithi007 bash[22722]: cluster 2024-09-14T02:35:20.594883+0000 mgr.a (mgr.14355) 11004 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:22 smithi131 bash[24745]: cluster 2024-09-14T02:35:20.594883+0000 mgr.a (mgr.14355) 11004 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:22 smithi171 bash[25040]: cluster 2024-09-14T02:35:20.594883+0000 mgr.a (mgr.14355) 11004 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:23.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:24.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:24.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:24.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:24.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:24.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:24 smithi007 bash[22722]: cluster 2024-09-14T02:35:22.595640+0000 mgr.a (mgr.14355) 11005 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:24 smithi131 bash[24745]: cluster 2024-09-14T02:35:22.595640+0000 mgr.a (mgr.14355) 11005 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:24 smithi171 bash[25040]: cluster 2024-09-14T02:35:22.595640+0000 mgr.a (mgr.14355) 11005 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:25 smithi007 bash[22722]: audit 2024-09-14T02:35:24.085927+0000 mgr.a (mgr.14355) 11006 : audit [DBG] from='client.241944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:25.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:25 smithi131 bash[24745]: audit 2024-09-14T02:35:24.085927+0000 mgr.a (mgr.14355) 11006 : audit [DBG] from='client.241944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:25 smithi171 bash[25040]: audit 2024-09-14T02:35:24.085927+0000 mgr.a (mgr.14355) 11006 : audit [DBG] from='client.241944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:26 smithi007 bash[22722]: cluster 2024-09-14T02:35:24.596135+0000 mgr.a (mgr.14355) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:26 smithi131 bash[24745]: cluster 2024-09-14T02:35:24.596135+0000 mgr.a (mgr.14355) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:26 smithi171 bash[25040]: cluster 2024-09-14T02:35:24.596135+0000 mgr.a (mgr.14355) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:28 smithi007 bash[22722]: cluster 2024-09-14T02:35:26.598357+0000 mgr.a (mgr.14355) 11008 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:28 smithi131 bash[24745]: cluster 2024-09-14T02:35:26.598357+0000 mgr.a (mgr.14355) 11008 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:28 smithi171 bash[25040]: cluster 2024-09-14T02:35:26.598357+0000 mgr.a (mgr.14355) 11008 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:29.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:29.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:30.312 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:30.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:30.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:30.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:30 smithi007 bash[22722]: cluster 2024-09-14T02:35:28.599107+0000 mgr.a (mgr.14355) 11009 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:30 smithi131 bash[24745]: cluster 2024-09-14T02:35:28.599107+0000 mgr.a (mgr.14355) 11009 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:30 smithi171 bash[25040]: cluster 2024-09-14T02:35:28.599107+0000 mgr.a (mgr.14355) 11009 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:31 smithi007 bash[22722]: audit 2024-09-14T02:35:29.868584+0000 mgr.a (mgr.14355) 11010 : audit [DBG] from='client.242016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:31.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:31 smithi131 bash[24745]: audit 2024-09-14T02:35:29.868584+0000 mgr.a (mgr.14355) 11010 : audit [DBG] from='client.242016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:31 smithi171 bash[25040]: audit 2024-09-14T02:35:29.868584+0000 mgr.a (mgr.14355) 11010 : audit [DBG] from='client.242016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:32 smithi007 bash[22722]: cluster 2024-09-14T02:35:30.601481+0000 mgr.a (mgr.14355) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:32 smithi131 bash[24745]: cluster 2024-09-14T02:35:30.601481+0000 mgr.a (mgr.14355) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:32 smithi171 bash[25040]: cluster 2024-09-14T02:35:30.601481+0000 mgr.a (mgr.14355) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:34 smithi007 bash[22722]: cluster 2024-09-14T02:35:32.602261+0000 mgr.a (mgr.14355) 11012 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:34 smithi131 bash[24745]: cluster 2024-09-14T02:35:32.602261+0000 mgr.a (mgr.14355) 11012 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:34 smithi171 bash[25040]: cluster 2024-09-14T02:35:32.602261+0000 mgr.a (mgr.14355) 11012 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:35.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:36.061 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:36.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:36 smithi007 bash[22722]: cluster 2024-09-14T02:35:34.603043+0000 mgr.a (mgr.14355) 11013 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:36 smithi131 bash[24745]: cluster 2024-09-14T02:35:34.603043+0000 mgr.a (mgr.14355) 11013 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:36 smithi171 bash[25040]: cluster 2024-09-14T02:35:34.603043+0000 mgr.a (mgr.14355) 11013 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:37 smithi007 bash[22722]: audit 2024-09-14T02:35:35.636749+0000 mgr.a (mgr.14355) 11014 : audit [DBG] from='client.242094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:37.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:37 smithi131 bash[24745]: audit 2024-09-14T02:35:35.636749+0000 mgr.a (mgr.14355) 11014 : audit [DBG] from='client.242094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:37 smithi171 bash[25040]: audit 2024-09-14T02:35:35.636749+0000 mgr.a (mgr.14355) 11014 : audit [DBG] from='client.242094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:38 smithi007 bash[22722]: cluster 2024-09-14T02:35:36.605702+0000 mgr.a (mgr.14355) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:38 smithi131 bash[24745]: cluster 2024-09-14T02:35:36.605702+0000 mgr.a (mgr.14355) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:38 smithi171 bash[25040]: cluster 2024-09-14T02:35:36.605702+0000 mgr.a (mgr.14355) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:40 smithi007 bash[22722]: cluster 2024-09-14T02:35:38.606669+0000 mgr.a (mgr.14355) 11016 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:40 smithi131 bash[24745]: cluster 2024-09-14T02:35:38.606669+0000 mgr.a (mgr.14355) 11016 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:40 smithi171 bash[25040]: cluster 2024-09-14T02:35:38.606669+0000 mgr.a (mgr.14355) 11016 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:41.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:41.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:41.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:41.816 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:41.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:41.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:41.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:41.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:42 smithi007 bash[22722]: cluster 2024-09-14T02:35:40.608702+0000 mgr.a (mgr.14355) 11017 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:42 smithi007 bash[22722]: audit 2024-09-14T02:35:41.395606+0000 mgr.a (mgr.14355) 11018 : audit [DBG] from='client.242169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:42.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:42 smithi131 bash[24745]: cluster 2024-09-14T02:35:40.608702+0000 mgr.a (mgr.14355) 11017 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:42 smithi131 bash[24745]: audit 2024-09-14T02:35:41.395606+0000 mgr.a (mgr.14355) 11018 : audit [DBG] from='client.242169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:42 smithi171 bash[25040]: cluster 2024-09-14T02:35:40.608702+0000 mgr.a (mgr.14355) 11017 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:42 smithi171 bash[25040]: audit 2024-09-14T02:35:41.395606+0000 mgr.a (mgr.14355) 11018 : audit [DBG] from='client.242169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:44 smithi007 bash[22722]: cluster 2024-09-14T02:35:42.609523+0000 mgr.a (mgr.14355) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:44 smithi131 bash[24745]: cluster 2024-09-14T02:35:42.609523+0000 mgr.a (mgr.14355) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:44 smithi171 bash[25040]: cluster 2024-09-14T02:35:42.609523+0000 mgr.a (mgr.14355) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:35:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:46 smithi007 bash[22722]: cluster 2024-09-14T02:35:44.610322+0000 mgr.a (mgr.14355) 11020 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:35:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:46 smithi131 bash[24745]: cluster 2024-09-14T02:35:44.610322+0000 mgr.a (mgr.14355) 11020 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:35:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:46 smithi171 bash[25040]: cluster 2024-09-14T02:35:44.610322+0000 mgr.a (mgr.14355) 11020 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:35:46.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:46.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:47.582 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:47.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:48 smithi007 bash[22722]: cluster 2024-09-14T02:35:46.612453+0000 mgr.a (mgr.14355) 11021 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:48 smithi007 bash[22722]: audit 2024-09-14T02:35:47.150851+0000 mgr.a (mgr.14355) 11022 : audit [DBG] from='client.242247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:48.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:48 smithi131 bash[24745]: cluster 2024-09-14T02:35:46.612453+0000 mgr.a (mgr.14355) 11021 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:48 smithi131 bash[24745]: audit 2024-09-14T02:35:47.150851+0000 mgr.a (mgr.14355) 11022 : audit [DBG] from='client.242247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:48 smithi171 bash[25040]: cluster 2024-09-14T02:35:46.612453+0000 mgr.a (mgr.14355) 11021 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:48 smithi171 bash[25040]: audit 2024-09-14T02:35:47.150851+0000 mgr.a (mgr.14355) 11022 : audit [DBG] from='client.242247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:50 smithi007 bash[22722]: cluster 2024-09-14T02:35:48.613469+0000 mgr.a (mgr.14355) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:50 smithi131 bash[24745]: cluster 2024-09-14T02:35:48.613469+0000 mgr.a (mgr.14355) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:50 smithi171 bash[25040]: cluster 2024-09-14T02:35:48.613469+0000 mgr.a (mgr.14355) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:51 smithi007 bash[22722]: audit 2024-09-14T02:35:51.145823+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:35:51.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:51 smithi131 bash[24745]: audit 2024-09-14T02:35:51.145823+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:35:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:51 smithi171 bash[25040]: audit 2024-09-14T02:35:51.145823+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:35:52.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:52.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:52.584 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:52.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22722]: cluster 2024-09-14T02:35:50.615753+0000 mgr.a (mgr.14355) 11024 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22722]: audit 2024-09-14T02:35:51.983777+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:35:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22722]: audit 2024-09-14T02:35:51.985385+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:35:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22722]: audit 2024-09-14T02:35:51.995840+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:35:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22722]: audit 2024-09-14T02:35:52.000727+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:52 smithi131 bash[24745]: cluster 2024-09-14T02:35:50.615753+0000 mgr.a (mgr.14355) 11024 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:52 smithi131 bash[24745]: audit 2024-09-14T02:35:51.983777+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:52 smithi131 bash[24745]: audit 2024-09-14T02:35:51.985385+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:52 smithi131 bash[24745]: audit 2024-09-14T02:35:51.995840+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:52 smithi131 bash[24745]: audit 2024-09-14T02:35:52.000727+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:52 smithi171 bash[25040]: cluster 2024-09-14T02:35:50.615753+0000 mgr.a (mgr.14355) 11024 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:35:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:52 smithi171 bash[25040]: audit 2024-09-14T02:35:51.983777+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:35:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:52 smithi171 bash[25040]: audit 2024-09-14T02:35:51.985385+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:35:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:52 smithi171 bash[25040]: audit 2024-09-14T02:35:51.995840+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:35:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:52 smithi171 bash[25040]: audit 2024-09-14T02:35:52.000727+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:53.203 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22972]: debug 2024-09-14T02:35:52.732+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:35:53.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:35:52 smithi007 bash[22972]: debug 2024-09-14T02:35:52.732+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:35:53.313 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:53.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:35:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:53 smithi007 bash[22722]: audit 2024-09-14T02:35:52.003080+0000 mgr.a (mgr.14355) 11025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:53 smithi131 bash[24745]: audit 2024-09-14T02:35:52.003080+0000 mgr.a (mgr.14355) 11025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:53 smithi171 bash[25040]: audit 2024-09-14T02:35:52.003080+0000 mgr.a (mgr.14355) 11025 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:35:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:54 smithi007 bash[22722]: cluster 2024-09-14T02:35:52.616306+0000 mgr.a (mgr.14355) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:54 smithi007 bash[22722]: audit 2024-09-14T02:35:52.736103+0000 mgr.a (mgr.14355) 11027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:35:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:54 smithi007 bash[22722]: cephadm 2024-09-14T02:35:52.737253+0000 mgr.a (mgr.14355) 11028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:35:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:54 smithi007 bash[22722]: audit 2024-09-14T02:35:52.897985+0000 mgr.a (mgr.14355) 11029 : audit [DBG] from='client.242430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:54 smithi131 bash[24745]: cluster 2024-09-14T02:35:52.616306+0000 mgr.a (mgr.14355) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:54 smithi131 bash[24745]: audit 2024-09-14T02:35:52.736103+0000 mgr.a (mgr.14355) 11027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:35:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:54 smithi131 bash[24745]: cephadm 2024-09-14T02:35:52.737253+0000 mgr.a (mgr.14355) 11028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:35:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:54 smithi131 bash[24745]: audit 2024-09-14T02:35:52.897985+0000 mgr.a (mgr.14355) 11029 : audit [DBG] from='client.242430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:54.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:54 smithi171 bash[25040]: cluster 2024-09-14T02:35:52.616306+0000 mgr.a (mgr.14355) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:54.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:54 smithi171 bash[25040]: audit 2024-09-14T02:35:52.736103+0000 mgr.a (mgr.14355) 11027 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:35:54.799 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:54 smithi171 bash[25040]: cephadm 2024-09-14T02:35:52.737253+0000 mgr.a (mgr.14355) 11028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:35:54.799 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:54 smithi171 bash[25040]: audit 2024-09-14T02:35:52.897985+0000 mgr.a (mgr.14355) 11029 : audit [DBG] from='client.242430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:35:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:56 smithi131 bash[24745]: cluster 2024-09-14T02:35:54.617154+0000 mgr.a (mgr.14355) 11030 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:56 smithi171 bash[25040]: cluster 2024-09-14T02:35:54.617154+0000 mgr.a (mgr.14355) 11030 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:56 smithi007 bash[22722]: cluster 2024-09-14T02:35:54.617154+0000 mgr.a (mgr.14355) 11030 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:35:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:35:58.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:35:58.315 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:35:58.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:35:58 smithi131 bash[24745]: cluster 2024-09-14T02:35:56.619417+0000 mgr.a (mgr.14355) 11031 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:35:58 smithi171 bash[25040]: cluster 2024-09-14T02:35:56.619417+0000 mgr.a (mgr.14355) 11031 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:58.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:35:58 smithi007 bash[22722]: cluster 2024-09-14T02:35:56.619417+0000 mgr.a (mgr.14355) 11031 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:35:59.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:35:59.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:35:59.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:35:59.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:35:59.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:00 smithi131 bash[24745]: cluster 2024-09-14T02:35:58.620140+0000 mgr.a (mgr.14355) 11032 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:00 smithi131 bash[24745]: audit 2024-09-14T02:35:58.653850+0000 mgr.a (mgr.14355) 11033 : audit [DBG] from='client.242508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:00 smithi171 bash[25040]: cluster 2024-09-14T02:35:58.620140+0000 mgr.a (mgr.14355) 11032 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:00 smithi171 bash[25040]: audit 2024-09-14T02:35:58.653850+0000 mgr.a (mgr.14355) 11033 : audit [DBG] from='client.242508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:00 smithi007 bash[22722]: cluster 2024-09-14T02:35:58.620140+0000 mgr.a (mgr.14355) 11032 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:00 smithi007 bash[22722]: audit 2024-09-14T02:35:58.653850+0000 mgr.a (mgr.14355) 11033 : audit [DBG] from='client.242508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:02 smithi131 bash[24745]: cluster 2024-09-14T02:36:00.622570+0000 mgr.a (mgr.14355) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:02 smithi171 bash[25040]: cluster 2024-09-14T02:36:00.622570+0000 mgr.a (mgr.14355) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:02 smithi007 bash[22722]: cluster 2024-09-14T02:36:00.622570+0000 mgr.a (mgr.14355) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:04.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:04 smithi131 bash[24745]: cluster 2024-09-14T02:36:02.623343+0000 mgr.a (mgr.14355) 11035 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:04 smithi171 bash[25040]: cluster 2024-09-14T02:36:02.623343+0000 mgr.a (mgr.14355) 11035 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:04.869 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:04.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:04.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:04.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:04.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:04 smithi007 bash[22722]: cluster 2024-09-14T02:36:02.623343+0000 mgr.a (mgr.14355) 11035 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:05 smithi131 bash[24745]: audit 2024-09-14T02:36:04.430516+0000 mgr.a (mgr.14355) 11036 : audit [DBG] from='client.242583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:05 smithi171 bash[25040]: audit 2024-09-14T02:36:04.430516+0000 mgr.a (mgr.14355) 11036 : audit [DBG] from='client.242583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:05 smithi007 bash[22722]: audit 2024-09-14T02:36:04.430516+0000 mgr.a (mgr.14355) 11036 : audit [DBG] from='client.242583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:06 smithi131 bash[24745]: cluster 2024-09-14T02:36:04.624044+0000 mgr.a (mgr.14355) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:06 smithi171 bash[25040]: cluster 2024-09-14T02:36:04.624044+0000 mgr.a (mgr.14355) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:06 smithi007 bash[22722]: cluster 2024-09-14T02:36:04.624044+0000 mgr.a (mgr.14355) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:08.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:08 smithi131 bash[24745]: cluster 2024-09-14T02:36:06.626466+0000 mgr.a (mgr.14355) 11038 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:08 smithi171 bash[25040]: cluster 2024-09-14T02:36:06.626466+0000 mgr.a (mgr.14355) 11038 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:08 smithi007 bash[22722]: cluster 2024-09-14T02:36:06.626466+0000 mgr.a (mgr.14355) 11038 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:09.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:10.612 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:10.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:10.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:10 smithi131 bash[24745]: cluster 2024-09-14T02:36:08.627189+0000 mgr.a (mgr.14355) 11039 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:10 smithi171 bash[25040]: cluster 2024-09-14T02:36:08.627189+0000 mgr.a (mgr.14355) 11039 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:10 smithi007 bash[22722]: cluster 2024-09-14T02:36:08.627189+0000 mgr.a (mgr.14355) 11039 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:11 smithi131 bash[24745]: audit 2024-09-14T02:36:10.203852+0000 mgr.a (mgr.14355) 11040 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:11 smithi171 bash[25040]: audit 2024-09-14T02:36:10.203852+0000 mgr.a (mgr.14355) 11040 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:11 smithi007 bash[22722]: audit 2024-09-14T02:36:10.203852+0000 mgr.a (mgr.14355) 11040 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:12 smithi131 bash[24745]: cluster 2024-09-14T02:36:10.628397+0000 mgr.a (mgr.14355) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:12 smithi171 bash[25040]: cluster 2024-09-14T02:36:10.628397+0000 mgr.a (mgr.14355) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:12 smithi007 bash[22722]: cluster 2024-09-14T02:36:10.628397+0000 mgr.a (mgr.14355) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:14 smithi131 bash[24745]: cluster 2024-09-14T02:36:12.629266+0000 mgr.a (mgr.14355) 11042 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:14 smithi171 bash[25040]: cluster 2024-09-14T02:36:12.629266+0000 mgr.a (mgr.14355) 11042 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:14 smithi007 bash[22722]: cluster 2024-09-14T02:36:12.629266+0000 mgr.a (mgr.14355) 11042 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:15.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:15.615 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:16.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:16.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:16.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:16.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:16 smithi131 bash[24745]: cluster 2024-09-14T02:36:14.630067+0000 mgr.a (mgr.14355) 11043 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:16 smithi171 bash[25040]: cluster 2024-09-14T02:36:14.630067+0000 mgr.a (mgr.14355) 11043 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:16 smithi007 bash[22722]: cluster 2024-09-14T02:36:14.630067+0000 mgr.a (mgr.14355) 11043 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:36:17.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:17 smithi131 bash[24745]: audit 2024-09-14T02:36:15.946584+0000 mgr.a (mgr.14355) 11044 : audit [DBG] from='client.242733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:17 smithi171 bash[25040]: audit 2024-09-14T02:36:15.946584+0000 mgr.a (mgr.14355) 11044 : audit [DBG] from='client.242733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:17 smithi007 bash[22722]: audit 2024-09-14T02:36:15.946584+0000 mgr.a (mgr.14355) 11044 : audit [DBG] from='client.242733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:18 smithi131 bash[24745]: cluster 2024-09-14T02:36:16.632908+0000 mgr.a (mgr.14355) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:18 smithi171 bash[25040]: cluster 2024-09-14T02:36:16.632908+0000 mgr.a (mgr.14355) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:18 smithi007 bash[22722]: cluster 2024-09-14T02:36:16.632908+0000 mgr.a (mgr.14355) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:20 smithi131 bash[24745]: cluster 2024-09-14T02:36:18.633728+0000 mgr.a (mgr.14355) 11046 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:20 smithi171 bash[25040]: cluster 2024-09-14T02:36:18.633728+0000 mgr.a (mgr.14355) 11046 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:20 smithi007 bash[22722]: cluster 2024-09-14T02:36:18.633728+0000 mgr.a (mgr.14355) 11046 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:22.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:22.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:22.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:22 smithi131 bash[24745]: cluster 2024-09-14T02:36:20.635758+0000 mgr.a (mgr.14355) 11047 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:22 smithi171 bash[25040]: cluster 2024-09-14T02:36:20.635758+0000 mgr.a (mgr.14355) 11047 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:22 smithi007 bash[22722]: cluster 2024-09-14T02:36:20.635758+0000 mgr.a (mgr.14355) 11047 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:23 smithi171 bash[25040]: audit 2024-09-14T02:36:21.718543+0000 mgr.a (mgr.14355) 11048 : audit [DBG] from='client.242808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:23 smithi007 bash[22722]: audit 2024-09-14T02:36:21.718543+0000 mgr.a (mgr.14355) 11048 : audit [DBG] from='client.242808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:24.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:23 smithi131 bash[24745]: audit 2024-09-14T02:36:21.718543+0000 mgr.a (mgr.14355) 11048 : audit [DBG] from='client.242808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:24 smithi171 bash[25040]: cluster 2024-09-14T02:36:22.636738+0000 mgr.a (mgr.14355) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:24 smithi007 bash[22722]: cluster 2024-09-14T02:36:22.636738+0000 mgr.a (mgr.14355) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:24 smithi131 bash[24745]: cluster 2024-09-14T02:36:22.636738+0000 mgr.a (mgr.14355) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:26 smithi171 bash[25040]: cluster 2024-09-14T02:36:24.637520+0000 mgr.a (mgr.14355) 11050 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:26 smithi007 bash[22722]: cluster 2024-09-14T02:36:24.637520+0000 mgr.a (mgr.14355) 11050 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:26 smithi131 bash[24745]: cluster 2024-09-14T02:36:24.637520+0000 mgr.a (mgr.14355) 11050 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:27.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:27.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:27.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:27.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:27.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:27.943 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:28 smithi007 bash[22722]: cluster 2024-09-14T02:36:26.639804+0000 mgr.a (mgr.14355) 11051 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:28 smithi007 bash[22722]: audit 2024-09-14T02:36:27.501024+0000 mgr.a (mgr.14355) 11052 : audit [DBG] from='client.242886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:28 smithi131 bash[24745]: cluster 2024-09-14T02:36:26.639804+0000 mgr.a (mgr.14355) 11051 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:28 smithi131 bash[24745]: audit 2024-09-14T02:36:27.501024+0000 mgr.a (mgr.14355) 11052 : audit [DBG] from='client.242886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:28 smithi171 bash[25040]: cluster 2024-09-14T02:36:26.639804+0000 mgr.a (mgr.14355) 11051 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:28 smithi171 bash[25040]: audit 2024-09-14T02:36:27.501024+0000 mgr.a (mgr.14355) 11052 : audit [DBG] from='client.242886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:30 smithi007 bash[22722]: cluster 2024-09-14T02:36:28.640808+0000 mgr.a (mgr.14355) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:31.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:30 smithi131 bash[24745]: cluster 2024-09-14T02:36:28.640808+0000 mgr.a (mgr.14355) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:30 smithi171 bash[25040]: cluster 2024-09-14T02:36:28.640808+0000 mgr.a (mgr.14355) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:32.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:32.945 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:32 smithi007 bash[22722]: cluster 2024-09-14T02:36:30.643104+0000 mgr.a (mgr.14355) 11054 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:33.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:32 smithi131 bash[24745]: cluster 2024-09-14T02:36:30.643104+0000 mgr.a (mgr.14355) 11054 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:32 smithi171 bash[25040]: cluster 2024-09-14T02:36:30.643104+0000 mgr.a (mgr.14355) 11054 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:33.731 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:33.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:34 smithi007 bash[22722]: cluster 2024-09-14T02:36:32.643859+0000 mgr.a (mgr.14355) 11055 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:34 smithi007 bash[22722]: audit 2024-09-14T02:36:33.279713+0000 mgr.a (mgr.14355) 11056 : audit [DBG] from='client.242958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:34 smithi131 bash[24745]: cluster 2024-09-14T02:36:32.643859+0000 mgr.a (mgr.14355) 11055 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:34 smithi131 bash[24745]: audit 2024-09-14T02:36:33.279713+0000 mgr.a (mgr.14355) 11056 : audit [DBG] from='client.242958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:34 smithi171 bash[25040]: cluster 2024-09-14T02:36:32.643859+0000 mgr.a (mgr.14355) 11055 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:34 smithi171 bash[25040]: audit 2024-09-14T02:36:33.279713+0000 mgr.a (mgr.14355) 11056 : audit [DBG] from='client.242958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:36 smithi007 bash[22722]: cluster 2024-09-14T02:36:34.644798+0000 mgr.a (mgr.14355) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:36 smithi131 bash[24745]: cluster 2024-09-14T02:36:34.644798+0000 mgr.a (mgr.14355) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:36 smithi171 bash[25040]: cluster 2024-09-14T02:36:34.644798+0000 mgr.a (mgr.14355) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:38.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:38 smithi007 bash[22722]: cluster 2024-09-14T02:36:36.647030+0000 mgr.a (mgr.14355) 11058 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:38 smithi131 bash[24745]: cluster 2024-09-14T02:36:36.647030+0000 mgr.a (mgr.14355) 11058 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:38 smithi171 bash[25040]: cluster 2024-09-14T02:36:36.647030+0000 mgr.a (mgr.14355) 11058 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:39.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:39.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:39.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:40 smithi007 bash[22722]: cluster 2024-09-14T02:36:38.647796+0000 mgr.a (mgr.14355) 11059 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:40 smithi007 bash[22722]: audit 2024-09-14T02:36:39.068889+0000 mgr.a (mgr.14355) 11060 : audit [DBG] from='client.243036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:40 smithi131 bash[24745]: cluster 2024-09-14T02:36:38.647796+0000 mgr.a (mgr.14355) 11059 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:40 smithi131 bash[24745]: audit 2024-09-14T02:36:39.068889+0000 mgr.a (mgr.14355) 11060 : audit [DBG] from='client.243036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:40 smithi171 bash[25040]: cluster 2024-09-14T02:36:38.647796+0000 mgr.a (mgr.14355) 11059 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:40 smithi171 bash[25040]: audit 2024-09-14T02:36:39.068889+0000 mgr.a (mgr.14355) 11060 : audit [DBG] from='client.243036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:42 smithi007 bash[22722]: cluster 2024-09-14T02:36:40.650219+0000 mgr.a (mgr.14355) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:42 smithi131 bash[24745]: cluster 2024-09-14T02:36:40.650219+0000 mgr.a (mgr.14355) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:42 smithi171 bash[25040]: cluster 2024-09-14T02:36:40.650219+0000 mgr.a (mgr.14355) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:36:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:44.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:44 smithi007 bash[22722]: cluster 2024-09-14T02:36:42.651017+0000 mgr.a (mgr.14355) 11062 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:45.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:44 smithi131 bash[24745]: cluster 2024-09-14T02:36:42.651017+0000 mgr.a (mgr.14355) 11062 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:44 smithi171 bash[25040]: cluster 2024-09-14T02:36:42.651017+0000 mgr.a (mgr.14355) 11062 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:45.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:45.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:46 smithi007 bash[22722]: cluster 2024-09-14T02:36:44.651463+0000 mgr.a (mgr.14355) 11063 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:46 smithi007 bash[22722]: audit 2024-09-14T02:36:44.846694+0000 mgr.a (mgr.14355) 11064 : audit [DBG] from='client.243111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:47.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:46 smithi131 bash[24745]: cluster 2024-09-14T02:36:44.651463+0000 mgr.a (mgr.14355) 11063 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:46 smithi131 bash[24745]: audit 2024-09-14T02:36:44.846694+0000 mgr.a (mgr.14355) 11064 : audit [DBG] from='client.243111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:46 smithi171 bash[25040]: cluster 2024-09-14T02:36:44.651463+0000 mgr.a (mgr.14355) 11063 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:46 smithi171 bash[25040]: audit 2024-09-14T02:36:44.846694+0000 mgr.a (mgr.14355) 11064 : audit [DBG] from='client.243111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:48 smithi007 bash[22722]: cluster 2024-09-14T02:36:46.654231+0000 mgr.a (mgr.14355) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:36:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:48 smithi131 bash[24745]: cluster 2024-09-14T02:36:46.654231+0000 mgr.a (mgr.14355) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:36:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:48 smithi171 bash[25040]: cluster 2024-09-14T02:36:46.654231+0000 mgr.a (mgr.14355) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:36:50.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:50.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:50 smithi007 bash[22722]: cluster 2024-09-14T02:36:48.655036+0000 mgr.a (mgr.14355) 11066 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:36:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:50 smithi131 bash[24745]: cluster 2024-09-14T02:36:48.655036+0000 mgr.a (mgr.14355) 11066 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:36:51.034 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:51.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:51.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:51.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:51.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:50 smithi171 bash[25040]: cluster 2024-09-14T02:36:48.655036+0000 mgr.a (mgr.14355) 11066 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:36:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:52 smithi007 bash[22722]: audit 2024-09-14T02:36:50.606408+0000 mgr.a (mgr.14355) 11067 : audit [DBG] from='client.243189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:52 smithi007 bash[22722]: cluster 2024-09-14T02:36:50.657954+0000 mgr.a (mgr.14355) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:52 smithi131 bash[24745]: audit 2024-09-14T02:36:50.606408+0000 mgr.a (mgr.14355) 11067 : audit [DBG] from='client.243189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:52 smithi131 bash[24745]: cluster 2024-09-14T02:36:50.657954+0000 mgr.a (mgr.14355) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:52 smithi171 bash[25040]: audit 2024-09-14T02:36:50.606408+0000 mgr.a (mgr.14355) 11067 : audit [DBG] from='client.243189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:52 smithi171 bash[25040]: cluster 2024-09-14T02:36:50.657954+0000 mgr.a (mgr.14355) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:36:53.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:53 smithi007 bash[22722]: audit 2024-09-14T02:36:52.785639+0000 mon.a (mon.0) 2248 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:36:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:53 smithi131 bash[24745]: audit 2024-09-14T02:36:52.785639+0000 mon.a (mon.0) 2248 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:36:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:53 smithi171 bash[25040]: audit 2024-09-14T02:36:52.785639+0000 mon.a (mon.0) 2248 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:36:54.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22972]: debug 2024-09-14T02:36:54.407+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:36:54.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22972]: debug 2024-09-14T02:36:54.411+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:36:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: cluster 2024-09-14T02:36:52.658932+0000 mgr.a (mgr.14355) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:53.652470+0000 mon.a (mon.0) 2249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:53.654103+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:53.664529+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:53.668398+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:53.670845+0000 mgr.a (mgr.14355) 11070 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: audit 2024-09-14T02:36:54.412811+0000 mgr.a (mgr.14355) 11071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:36:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:54 smithi007 bash[22722]: cephadm 2024-09-14T02:36:54.414368+0000 mgr.a (mgr.14355) 11072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: cluster 2024-09-14T02:36:52.658932+0000 mgr.a (mgr.14355) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:53.652470+0000 mon.a (mon.0) 2249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:53.654103+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:53.664529+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:53.668398+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:53.670845+0000 mgr.a (mgr.14355) 11070 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: audit 2024-09-14T02:36:54.412811+0000 mgr.a (mgr.14355) 11071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:36:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:54 smithi131 bash[24745]: cephadm 2024-09-14T02:36:54.414368+0000 mgr.a (mgr.14355) 11072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:36:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: cluster 2024-09-14T02:36:52.658932+0000 mgr.a (mgr.14355) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:53.652470+0000 mon.a (mon.0) 2249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:53.654103+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:53.664529+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:53.668398+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:53.670845+0000 mgr.a (mgr.14355) 11070 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: audit 2024-09-14T02:36:54.412811+0000 mgr.a (mgr.14355) 11071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:36:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:54 smithi171 bash[25040]: cephadm 2024-09-14T02:36:54.414368+0000 mgr.a (mgr.14355) 11072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:36:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:55 smithi007 bash[22722]: cluster 2024-09-14T02:36:54.659808+0000 mgr.a (mgr.14355) 11073 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:55 smithi131 bash[24745]: cluster 2024-09-14T02:36:54.659808+0000 mgr.a (mgr.14355) 11073 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:36:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:36:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:36:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:55 smithi171 bash[25040]: cluster 2024-09-14T02:36:54.659808+0000 mgr.a (mgr.14355) 11073 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:36:56.812 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:36:56.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:36:56.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:36:56.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:36:56.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:36:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:56 smithi007 bash[22722]: audit 2024-09-14T02:36:56.375123+0000 mgr.a (mgr.14355) 11074 : audit [DBG] from='client.243375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:56 smithi131 bash[24745]: audit 2024-09-14T02:36:56.375123+0000 mgr.a (mgr.14355) 11074 : audit [DBG] from='client.243375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:56 smithi171 bash[25040]: audit 2024-09-14T02:36:56.375123+0000 mgr.a (mgr.14355) 11074 : audit [DBG] from='client.243375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:36:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:57 smithi007 bash[22722]: cluster 2024-09-14T02:36:56.661663+0000 mgr.a (mgr.14355) 11075 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:58.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:57 smithi131 bash[24745]: cluster 2024-09-14T02:36:56.661663+0000 mgr.a (mgr.14355) 11075 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:36:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:57 smithi171 bash[25040]: cluster 2024-09-14T02:36:56.661663+0000 mgr.a (mgr.14355) 11075 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:36:59 smithi131 bash[24745]: cluster 2024-09-14T02:36:58.662580+0000 mgr.a (mgr.14355) 11076 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:37:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:36:59 smithi171 bash[25040]: cluster 2024-09-14T02:36:58.662580+0000 mgr.a (mgr.14355) 11076 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:37:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:36:59 smithi007 bash[22722]: cluster 2024-09-14T02:36:58.662580+0000 mgr.a (mgr.14355) 11076 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:37:01.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:01.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:01 smithi131 bash[24745]: cluster 2024-09-14T02:37:00.664781+0000 mgr.a (mgr.14355) 11077 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:01 smithi171 bash[25040]: cluster 2024-09-14T02:37:00.664781+0000 mgr.a (mgr.14355) 11077 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:01 smithi007 bash[22722]: cluster 2024-09-14T02:37:00.664781+0000 mgr.a (mgr.14355) 11077 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:02.578 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:02.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:02.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:02.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:02.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:02 smithi131 bash[24745]: audit 2024-09-14T02:37:02.148145+0000 mgr.a (mgr.14355) 11078 : audit [DBG] from='client.243453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:02 smithi171 bash[25040]: audit 2024-09-14T02:37:02.148145+0000 mgr.a (mgr.14355) 11078 : audit [DBG] from='client.243453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:02 smithi007 bash[22722]: audit 2024-09-14T02:37:02.148145+0000 mgr.a (mgr.14355) 11078 : audit [DBG] from='client.243453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:04.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:03 smithi131 bash[24745]: cluster 2024-09-14T02:37:02.665678+0000 mgr.a (mgr.14355) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:03 smithi171 bash[25040]: cluster 2024-09-14T02:37:02.665678+0000 mgr.a (mgr.14355) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:03 smithi007 bash[22722]: cluster 2024-09-14T02:37:02.665678+0000 mgr.a (mgr.14355) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:06.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:05 smithi131 bash[24745]: cluster 2024-09-14T02:37:04.666483+0000 mgr.a (mgr.14355) 11080 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:05 smithi171 bash[25040]: cluster 2024-09-14T02:37:04.666483+0000 mgr.a (mgr.14355) 11080 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:05 smithi007 bash[22722]: cluster 2024-09-14T02:37:04.666483+0000 mgr.a (mgr.14355) 11080 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:07.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:07.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:07.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:08.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:07 smithi131 bash[24745]: cluster 2024-09-14T02:37:06.668661+0000 mgr.a (mgr.14355) 11081 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:07 smithi171 bash[25040]: cluster 2024-09-14T02:37:06.668661+0000 mgr.a (mgr.14355) 11081 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:08.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:07 smithi007 bash[22722]: cluster 2024-09-14T02:37:06.668661+0000 mgr.a (mgr.14355) 11081 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:37:08.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:08.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:08 smithi131 bash[24745]: audit 2024-09-14T02:37:07.913952+0000 mgr.a (mgr.14355) 11082 : audit [DBG] from='client.243528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:08 smithi171 bash[25040]: audit 2024-09-14T02:37:07.913952+0000 mgr.a (mgr.14355) 11082 : audit [DBG] from='client.243528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:08 smithi007 bash[22722]: audit 2024-09-14T02:37:07.913952+0000 mgr.a (mgr.14355) 11082 : audit [DBG] from='client.243528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:10.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:09 smithi131 bash[24745]: cluster 2024-09-14T02:37:08.669630+0000 mgr.a (mgr.14355) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:09 smithi171 bash[25040]: cluster 2024-09-14T02:37:08.669630+0000 mgr.a (mgr.14355) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:09 smithi007 bash[22722]: cluster 2024-09-14T02:37:08.669630+0000 mgr.a (mgr.14355) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:12.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:11 smithi131 bash[24745]: cluster 2024-09-14T02:37:10.671900+0000 mgr.a (mgr.14355) 11084 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:11 smithi171 bash[25040]: cluster 2024-09-14T02:37:10.671900+0000 mgr.a (mgr.14355) 11084 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:11 smithi007 bash[22722]: cluster 2024-09-14T02:37:10.671900+0000 mgr.a (mgr.14355) 11084 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:13 smithi131 bash[24745]: cluster 2024-09-14T02:37:12.672690+0000 mgr.a (mgr.14355) 11085 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:13 smithi171 bash[25040]: cluster 2024-09-14T02:37:12.672690+0000 mgr.a (mgr.14355) 11085 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:14.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:14.116 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:13 smithi007 bash[22722]: cluster 2024-09-14T02:37:12.672690+0000 mgr.a (mgr.14355) 11085 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:14 smithi131 bash[24745]: audit 2024-09-14T02:37:13.691536+0000 mgr.a (mgr.14355) 11086 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:14 smithi171 bash[25040]: audit 2024-09-14T02:37:13.691536+0000 mgr.a (mgr.14355) 11086 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:14 smithi007 bash[22722]: audit 2024-09-14T02:37:13.691536+0000 mgr.a (mgr.14355) 11086 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:15 smithi131 bash[24745]: cluster 2024-09-14T02:37:14.673653+0000 mgr.a (mgr.14355) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:15 smithi171 bash[25040]: cluster 2024-09-14T02:37:14.673653+0000 mgr.a (mgr.14355) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:15 smithi007 bash[22722]: cluster 2024-09-14T02:37:14.673653+0000 mgr.a (mgr.14355) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:17 smithi131 bash[24745]: cluster 2024-09-14T02:37:16.675943+0000 mgr.a (mgr.14355) 11088 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:17 smithi171 bash[25040]: cluster 2024-09-14T02:37:16.675943+0000 mgr.a (mgr.14355) 11088 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:17 smithi007 bash[22722]: cluster 2024-09-14T02:37:16.675943+0000 mgr.a (mgr.14355) 11088 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:19.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:19.118 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:19.898 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:19 smithi171 bash[25040]: cluster 2024-09-14T02:37:18.676745+0000 mgr.a (mgr.14355) 11089 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:19 smithi171 bash[25040]: audit 2024-09-14T02:37:19.448642+0000 mgr.a (mgr.14355) 11090 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:19 smithi007 bash[22722]: cluster 2024-09-14T02:37:18.676745+0000 mgr.a (mgr.14355) 11089 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:19 smithi007 bash[22722]: audit 2024-09-14T02:37:19.448642+0000 mgr.a (mgr.14355) 11090 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:19 smithi131 bash[24745]: cluster 2024-09-14T02:37:18.676745+0000 mgr.a (mgr.14355) 11089 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:19 smithi131 bash[24745]: audit 2024-09-14T02:37:19.448642+0000 mgr.a (mgr.14355) 11090 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:21 smithi171 bash[25040]: cluster 2024-09-14T02:37:20.679238+0000 mgr.a (mgr.14355) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:21 smithi007 bash[22722]: cluster 2024-09-14T02:37:20.679238+0000 mgr.a (mgr.14355) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:21 smithi131 bash[24745]: cluster 2024-09-14T02:37:20.679238+0000 mgr.a (mgr.14355) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:23 smithi171 bash[25040]: cluster 2024-09-14T02:37:22.680030+0000 mgr.a (mgr.14355) 11092 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:23 smithi007 bash[22722]: cluster 2024-09-14T02:37:22.680030+0000 mgr.a (mgr.14355) 11092 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:24.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:23 smithi131 bash[24745]: cluster 2024-09-14T02:37:22.680030+0000 mgr.a (mgr.14355) 11092 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:24.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:24.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:25.644 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:25.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:25.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:25.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:25.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:25 smithi007 bash[22722]: cluster 2024-09-14T02:37:24.680820+0000 mgr.a (mgr.14355) 11093 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:25 smithi007 bash[22722]: audit 2024-09-14T02:37:25.223783+0000 mgr.a (mgr.14355) 11094 : audit [DBG] from='client.243756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:25 smithi131 bash[24745]: cluster 2024-09-14T02:37:24.680820+0000 mgr.a (mgr.14355) 11093 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:25 smithi131 bash[24745]: audit 2024-09-14T02:37:25.223783+0000 mgr.a (mgr.14355) 11094 : audit [DBG] from='client.243756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:25 smithi171 bash[25040]: cluster 2024-09-14T02:37:24.680820+0000 mgr.a (mgr.14355) 11093 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:25 smithi171 bash[25040]: audit 2024-09-14T02:37:25.223783+0000 mgr.a (mgr.14355) 11094 : audit [DBG] from='client.243756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:27 smithi007 bash[22722]: cluster 2024-09-14T02:37:26.683718+0000 mgr.a (mgr.14355) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:27 smithi131 bash[24745]: cluster 2024-09-14T02:37:26.683718+0000 mgr.a (mgr.14355) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:27 smithi171 bash[25040]: cluster 2024-09-14T02:37:26.683718+0000 mgr.a (mgr.14355) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:29 smithi007 bash[22722]: cluster 2024-09-14T02:37:28.684506+0000 mgr.a (mgr.14355) 11096 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:29 smithi131 bash[24745]: cluster 2024-09-14T02:37:28.684506+0000 mgr.a (mgr.14355) 11096 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:29 smithi171 bash[25040]: cluster 2024-09-14T02:37:28.684506+0000 mgr.a (mgr.14355) 11096 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:30.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:30.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:31.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:31.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:31.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:31.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:31.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:31 smithi007 bash[22722]: cluster 2024-09-14T02:37:30.685911+0000 mgr.a (mgr.14355) 11097 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:31 smithi007 bash[22722]: audit 2024-09-14T02:37:30.985421+0000 mgr.a (mgr.14355) 11098 : audit [DBG] from='client.243834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:31 smithi131 bash[24745]: cluster 2024-09-14T02:37:30.685911+0000 mgr.a (mgr.14355) 11097 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:31 smithi131 bash[24745]: audit 2024-09-14T02:37:30.985421+0000 mgr.a (mgr.14355) 11098 : audit [DBG] from='client.243834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:31 smithi171 bash[25040]: cluster 2024-09-14T02:37:30.685911+0000 mgr.a (mgr.14355) 11097 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:31 smithi171 bash[25040]: audit 2024-09-14T02:37:30.985421+0000 mgr.a (mgr.14355) 11098 : audit [DBG] from='client.243834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:33 smithi007 bash[22722]: cluster 2024-09-14T02:37:32.686828+0000 mgr.a (mgr.14355) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:34.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:33 smithi131 bash[24745]: cluster 2024-09-14T02:37:32.686828+0000 mgr.a (mgr.14355) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:33 smithi171 bash[25040]: cluster 2024-09-14T02:37:32.686828+0000 mgr.a (mgr.14355) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:37:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:35 smithi007 bash[22722]: cluster 2024-09-14T02:37:34.687581+0000 mgr.a (mgr.14355) 11100 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:37:36.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:35 smithi131 bash[24745]: cluster 2024-09-14T02:37:34.687581+0000 mgr.a (mgr.14355) 11100 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:37:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:35 smithi171 bash[25040]: cluster 2024-09-14T02:37:34.687581+0000 mgr.a (mgr.14355) 11100 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:37:36.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:36.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:36.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:37.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:37 smithi007 bash[22722]: cluster 2024-09-14T02:37:36.688980+0000 mgr.a (mgr.14355) 11101 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:37 smithi007 bash[22722]: audit 2024-09-14T02:37:36.763836+0000 mgr.a (mgr.14355) 11102 : audit [DBG] from='client.243909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:37 smithi131 bash[24745]: cluster 2024-09-14T02:37:36.688980+0000 mgr.a (mgr.14355) 11101 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:37 smithi131 bash[24745]: audit 2024-09-14T02:37:36.763836+0000 mgr.a (mgr.14355) 11102 : audit [DBG] from='client.243909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:37 smithi171 bash[25040]: cluster 2024-09-14T02:37:36.688980+0000 mgr.a (mgr.14355) 11101 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:37 smithi171 bash[25040]: audit 2024-09-14T02:37:36.763836+0000 mgr.a (mgr.14355) 11102 : audit [DBG] from='client.243909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:39 smithi007 bash[22722]: cluster 2024-09-14T02:37:38.689865+0000 mgr.a (mgr.14355) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:40.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:39 smithi131 bash[24745]: cluster 2024-09-14T02:37:38.689865+0000 mgr.a (mgr.14355) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:39 smithi171 bash[25040]: cluster 2024-09-14T02:37:38.689865+0000 mgr.a (mgr.14355) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:41 smithi007 bash[22722]: cluster 2024-09-14T02:37:40.692128+0000 mgr.a (mgr.14355) 11104 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:42.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:42.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:42.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:41 smithi131 bash[24745]: cluster 2024-09-14T02:37:40.692128+0000 mgr.a (mgr.14355) 11104 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:41 smithi171 bash[25040]: cluster 2024-09-14T02:37:40.692128+0000 mgr.a (mgr.14355) 11104 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:42.998 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:42.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:42.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:42.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:42.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:42 smithi007 bash[22722]: audit 2024-09-14T02:37:42.549745+0000 mgr.a (mgr.14355) 11105 : audit [DBG] from='client.243987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:43.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:42 smithi131 bash[24745]: audit 2024-09-14T02:37:42.549745+0000 mgr.a (mgr.14355) 11105 : audit [DBG] from='client.243987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:42 smithi171 bash[25040]: audit 2024-09-14T02:37:42.549745+0000 mgr.a (mgr.14355) 11105 : audit [DBG] from='client.243987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:43 smithi007 bash[22722]: cluster 2024-09-14T02:37:42.692923+0000 mgr.a (mgr.14355) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:44.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:43 smithi131 bash[24745]: cluster 2024-09-14T02:37:42.692923+0000 mgr.a (mgr.14355) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:43 smithi171 bash[25040]: cluster 2024-09-14T02:37:42.692923+0000 mgr.a (mgr.14355) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:45 smithi007 bash[22722]: cluster 2024-09-14T02:37:44.693941+0000 mgr.a (mgr.14355) 11107 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:46.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:45 smithi131 bash[24745]: cluster 2024-09-14T02:37:44.693941+0000 mgr.a (mgr.14355) 11107 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:45 smithi171 bash[25040]: cluster 2024-09-14T02:37:44.693941+0000 mgr.a (mgr.14355) 11107 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:47 smithi007 bash[22722]: cluster 2024-09-14T02:37:46.696370+0000 mgr.a (mgr.14355) 11108 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:47 smithi131 bash[24745]: cluster 2024-09-14T02:37:46.696370+0000 mgr.a (mgr.14355) 11108 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:47 smithi171 bash[25040]: cluster 2024-09-14T02:37:46.696370+0000 mgr.a (mgr.14355) 11108 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:48.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:48.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:48 smithi007 bash[22722]: audit 2024-09-14T02:37:48.334824+0000 mgr.a (mgr.14355) 11109 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:49.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:48 smithi131 bash[24745]: audit 2024-09-14T02:37:48.334824+0000 mgr.a (mgr.14355) 11109 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:48 smithi171 bash[25040]: audit 2024-09-14T02:37:48.334824+0000 mgr.a (mgr.14355) 11109 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:49 smithi007 bash[22722]: cluster 2024-09-14T02:37:48.696960+0000 mgr.a (mgr.14355) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:49 smithi131 bash[24745]: cluster 2024-09-14T02:37:48.696960+0000 mgr.a (mgr.14355) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:49 smithi171 bash[25040]: cluster 2024-09-14T02:37:48.696960+0000 mgr.a (mgr.14355) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:51 smithi007 bash[22722]: cluster 2024-09-14T02:37:50.699175+0000 mgr.a (mgr.14355) 11111 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:51 smithi131 bash[24745]: cluster 2024-09-14T02:37:50.699175+0000 mgr.a (mgr.14355) 11111 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:51 smithi171 bash[25040]: cluster 2024-09-14T02:37:50.699175+0000 mgr.a (mgr.14355) 11111 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:53.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:53.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:37:54.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:53 smithi007 bash[22722]: cluster 2024-09-14T02:37:52.699943+0000 mgr.a (mgr.14355) 11112 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:54.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:53 smithi131 bash[24745]: cluster 2024-09-14T02:37:52.699943+0000 mgr.a (mgr.14355) 11112 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:53 smithi171 bash[25040]: cluster 2024-09-14T02:37:52.699943+0000 mgr.a (mgr.14355) 11112 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:54.540 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:37:54.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:37:54.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:37:54.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:37:54.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:37:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:54 smithi007 bash[22722]: audit 2024-09-14T02:37:54.116123+0000 mgr.a (mgr.14355) 11113 : audit [DBG] from='client.244137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:54 smithi007 bash[22722]: audit 2024-09-14T02:37:54.466759+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:37:55.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:54 smithi131 bash[24745]: audit 2024-09-14T02:37:54.116123+0000 mgr.a (mgr.14355) 11113 : audit [DBG] from='client.244137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:54 smithi131 bash[24745]: audit 2024-09-14T02:37:54.466759+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:37:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:54 smithi171 bash[25040]: audit 2024-09-14T02:37:54.116123+0000 mgr.a (mgr.14355) 11113 : audit [DBG] from='client.244137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:37:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:54 smithi171 bash[25040]: audit 2024-09-14T02:37:54.466759+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: cluster 2024-09-14T02:37:54.700853+0000 mgr.a (mgr.14355) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.010540+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.015126+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.628192+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.629667+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.637007+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:56 smithi131 bash[24745]: audit 2024-09-14T02:37:55.641671+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: cluster 2024-09-14T02:37:54.700853+0000 mgr.a (mgr.14355) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.010540+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.015126+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.628192+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:37:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.629667+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:37:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.637007+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:56 smithi171 bash[25040]: audit 2024-09-14T02:37:55.641671+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:56.352 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: cluster 2024-09-14T02:37:54.700853+0000 mgr.a (mgr.14355) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.010540+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.015126+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.628192+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.629667+0000 mon.a (mon.0) 2257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.637007+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:37:56.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22722]: audit 2024-09-14T02:37:55.641671+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:56.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22972]: debug 2024-09-14T02:37:56.346+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:37:56.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:37:56 smithi007 bash[22972]: debug 2024-09-14T02:37:56.346+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:37:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:57 smithi131 bash[24745]: audit 2024-09-14T02:37:55.644122+0000 mgr.a (mgr.14355) 11115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:57 smithi131 bash[24745]: audit 2024-09-14T02:37:56.352583+0000 mgr.a (mgr.14355) 11116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:37:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:57 smithi131 bash[24745]: cephadm 2024-09-14T02:37:56.353943+0000 mgr.a (mgr.14355) 11117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:37:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:57 smithi171 bash[25040]: audit 2024-09-14T02:37:55.644122+0000 mgr.a (mgr.14355) 11115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:57 smithi171 bash[25040]: audit 2024-09-14T02:37:56.352583+0000 mgr.a (mgr.14355) 11116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:37:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:57 smithi171 bash[25040]: cephadm 2024-09-14T02:37:56.353943+0000 mgr.a (mgr.14355) 11117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:37:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:57 smithi007 bash[22722]: audit 2024-09-14T02:37:55.644122+0000 mgr.a (mgr.14355) 11115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:37:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:57 smithi007 bash[22722]: audit 2024-09-14T02:37:56.352583+0000 mgr.a (mgr.14355) 11116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:37:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:57 smithi007 bash[22722]: cephadm 2024-09-14T02:37:56.353943+0000 mgr.a (mgr.14355) 11117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:37:58.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:37:58 smithi131 bash[24745]: cluster 2024-09-14T02:37:56.703587+0000 mgr.a (mgr.14355) 11118 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:37:58 smithi171 bash[25040]: cluster 2024-09-14T02:37:56.703587+0000 mgr.a (mgr.14355) 11118 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:37:58 smithi007 bash[22722]: cluster 2024-09-14T02:37:56.703587+0000 mgr.a (mgr.14355) 11118 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:37:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:37:59.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:37:59.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:00.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:00 smithi131 bash[24745]: cluster 2024-09-14T02:37:58.704515+0000 mgr.a (mgr.14355) 11119 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:00.292 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:00.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:00 smithi171 bash[25040]: cluster 2024-09-14T02:37:58.704515+0000 mgr.a (mgr.14355) 11119 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:00 smithi007 bash[22722]: cluster 2024-09-14T02:37:58.704515+0000 mgr.a (mgr.14355) 11119 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:01 smithi171 bash[25040]: audit 2024-09-14T02:37:59.877461+0000 mgr.a (mgr.14355) 11120 : audit [DBG] from='client.244311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:01 smithi007 bash[22722]: audit 2024-09-14T02:37:59.877461+0000 mgr.a (mgr.14355) 11120 : audit [DBG] from='client.244311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:01.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:01 smithi131 bash[24745]: audit 2024-09-14T02:37:59.877461+0000 mgr.a (mgr.14355) 11120 : audit [DBG] from='client.244311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:02 smithi171 bash[25040]: cluster 2024-09-14T02:38:00.707325+0000 mgr.a (mgr.14355) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:02 smithi007 bash[22722]: cluster 2024-09-14T02:38:00.707325+0000 mgr.a (mgr.14355) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:02.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:02 smithi131 bash[24745]: cluster 2024-09-14T02:38:00.707325+0000 mgr.a (mgr.14355) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:04 smithi171 bash[25040]: cluster 2024-09-14T02:38:02.708107+0000 mgr.a (mgr.14355) 11122 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:04 smithi007 bash[22722]: cluster 2024-09-14T02:38:02.708107+0000 mgr.a (mgr.14355) 11122 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:04 smithi131 bash[24745]: cluster 2024-09-14T02:38:02.708107+0000 mgr.a (mgr.14355) 11122 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:05.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:06.088 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:06.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:06 smithi171 bash[25040]: cluster 2024-09-14T02:38:04.708873+0000 mgr.a (mgr.14355) 11123 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:06 smithi007 bash[22722]: cluster 2024-09-14T02:38:04.708873+0000 mgr.a (mgr.14355) 11123 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:06.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:06 smithi131 bash[24745]: cluster 2024-09-14T02:38:04.708873+0000 mgr.a (mgr.14355) 11123 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:07 smithi007 bash[22722]: audit 2024-09-14T02:38:05.630928+0000 mgr.a (mgr.14355) 11124 : audit [DBG] from='client.244389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:07.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:07 smithi131 bash[24745]: audit 2024-09-14T02:38:05.630928+0000 mgr.a (mgr.14355) 11124 : audit [DBG] from='client.244389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:07 smithi171 bash[25040]: audit 2024-09-14T02:38:05.630928+0000 mgr.a (mgr.14355) 11124 : audit [DBG] from='client.244389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:08.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:08 smithi007 bash[22722]: cluster 2024-09-14T02:38:06.711678+0000 mgr.a (mgr.14355) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:09.463 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:08 smithi171 bash[25040]: cluster 2024-09-14T02:38:06.711678+0000 mgr.a (mgr.14355) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:09.463 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:08 smithi131 bash[24745]: cluster 2024-09-14T02:38:06.711678+0000 mgr.a (mgr.14355) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:10 smithi007 bash[22722]: cluster 2024-09-14T02:38:08.712470+0000 mgr.a (mgr.14355) 11126 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:10 smithi131 bash[24745]: cluster 2024-09-14T02:38:08.712470+0000 mgr.a (mgr.14355) 11126 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:10 smithi171 bash[25040]: cluster 2024-09-14T02:38:08.712470+0000 mgr.a (mgr.14355) 11126 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:38:11.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:11.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:11.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:11.872 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:12 smithi007 bash[22722]: cluster 2024-09-14T02:38:10.714531+0000 mgr.a (mgr.14355) 11127 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:12 smithi007 bash[22722]: audit 2024-09-14T02:38:11.425451+0000 mgr.a (mgr.14355) 11128 : audit [DBG] from='client.244467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:12.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:12 smithi131 bash[24745]: cluster 2024-09-14T02:38:10.714531+0000 mgr.a (mgr.14355) 11127 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:12 smithi131 bash[24745]: audit 2024-09-14T02:38:11.425451+0000 mgr.a (mgr.14355) 11128 : audit [DBG] from='client.244467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:12 smithi171 bash[25040]: cluster 2024-09-14T02:38:10.714531+0000 mgr.a (mgr.14355) 11127 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:38:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:12 smithi171 bash[25040]: audit 2024-09-14T02:38:11.425451+0000 mgr.a (mgr.14355) 11128 : audit [DBG] from='client.244467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:14 smithi007 bash[22722]: cluster 2024-09-14T02:38:12.715414+0000 mgr.a (mgr.14355) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:14 smithi131 bash[24745]: cluster 2024-09-14T02:38:12.715414+0000 mgr.a (mgr.14355) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:14 smithi171 bash[25040]: cluster 2024-09-14T02:38:12.715414+0000 mgr.a (mgr.14355) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:16 smithi007 bash[22722]: cluster 2024-09-14T02:38:14.716200+0000 mgr.a (mgr.14355) 11130 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:16.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:16 smithi131 bash[24745]: cluster 2024-09-14T02:38:14.716200+0000 mgr.a (mgr.14355) 11130 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:16 smithi171 bash[25040]: cluster 2024-09-14T02:38:14.716200+0000 mgr.a (mgr.14355) 11130 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:38:16.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:17.659 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:17.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:17.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:17.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:17.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:18 smithi007 bash[22722]: cluster 2024-09-14T02:38:16.718507+0000 mgr.a (mgr.14355) 11131 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:38:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:18 smithi007 bash[22722]: audit 2024-09-14T02:38:17.213465+0000 mgr.a (mgr.14355) 11132 : audit [DBG] from='client.244542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:18.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:18 smithi131 bash[24745]: cluster 2024-09-14T02:38:16.718507+0000 mgr.a (mgr.14355) 11131 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:38:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:18 smithi131 bash[24745]: audit 2024-09-14T02:38:17.213465+0000 mgr.a (mgr.14355) 11132 : audit [DBG] from='client.244542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:18 smithi171 bash[25040]: cluster 2024-09-14T02:38:16.718507+0000 mgr.a (mgr.14355) 11131 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:38:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:18 smithi171 bash[25040]: audit 2024-09-14T02:38:17.213465+0000 mgr.a (mgr.14355) 11132 : audit [DBG] from='client.244542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:20 smithi007 bash[22722]: cluster 2024-09-14T02:38:18.719401+0000 mgr.a (mgr.14355) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:20.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:20 smithi131 bash[24745]: cluster 2024-09-14T02:38:18.719401+0000 mgr.a (mgr.14355) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:20 smithi171 bash[25040]: cluster 2024-09-14T02:38:18.719401+0000 mgr.a (mgr.14355) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:22 smithi007 bash[22722]: cluster 2024-09-14T02:38:20.721658+0000 mgr.a (mgr.14355) 11134 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:22 smithi131 bash[24745]: cluster 2024-09-14T02:38:20.721658+0000 mgr.a (mgr.14355) 11134 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:22 smithi171 bash[25040]: cluster 2024-09-14T02:38:20.721658+0000 mgr.a (mgr.14355) 11134 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:22.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:22.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:23.414 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:24 smithi007 bash[22722]: cluster 2024-09-14T02:38:22.722446+0000 mgr.a (mgr.14355) 11135 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:24 smithi007 bash[22722]: audit 2024-09-14T02:38:22.993129+0000 mgr.a (mgr.14355) 11136 : audit [DBG] from='client.244620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:24 smithi131 bash[24745]: cluster 2024-09-14T02:38:22.722446+0000 mgr.a (mgr.14355) 11135 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:24 smithi131 bash[24745]: audit 2024-09-14T02:38:22.993129+0000 mgr.a (mgr.14355) 11136 : audit [DBG] from='client.244620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:24 smithi171 bash[25040]: cluster 2024-09-14T02:38:22.722446+0000 mgr.a (mgr.14355) 11135 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:24 smithi171 bash[25040]: audit 2024-09-14T02:38:22.993129+0000 mgr.a (mgr.14355) 11136 : audit [DBG] from='client.244620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:26 smithi007 bash[22722]: cluster 2024-09-14T02:38:24.723301+0000 mgr.a (mgr.14355) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:26.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:26 smithi131 bash[24745]: cluster 2024-09-14T02:38:24.723301+0000 mgr.a (mgr.14355) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:26 smithi171 bash[25040]: cluster 2024-09-14T02:38:24.723301+0000 mgr.a (mgr.14355) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:28.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:28 smithi007 bash[22722]: cluster 2024-09-14T02:38:26.725570+0000 mgr.a (mgr.14355) 11138 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:28 smithi131 bash[24745]: cluster 2024-09-14T02:38:26.725570+0000 mgr.a (mgr.14355) 11138 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:28 smithi171 bash[25040]: cluster 2024-09-14T02:38:26.725570+0000 mgr.a (mgr.14355) 11138 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:29.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:29.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:29.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:29.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:29.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:30 smithi007 bash[22722]: cluster 2024-09-14T02:38:28.726273+0000 mgr.a (mgr.14355) 11139 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:30 smithi007 bash[22722]: audit 2024-09-14T02:38:28.750527+0000 mgr.a (mgr.14355) 11140 : audit [DBG] from='client.244698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:30.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:30 smithi131 bash[24745]: cluster 2024-09-14T02:38:28.726273+0000 mgr.a (mgr.14355) 11139 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:30 smithi131 bash[24745]: audit 2024-09-14T02:38:28.750527+0000 mgr.a (mgr.14355) 11140 : audit [DBG] from='client.244698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:30 smithi171 bash[25040]: cluster 2024-09-14T02:38:28.726273+0000 mgr.a (mgr.14355) 11139 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:30 smithi171 bash[25040]: audit 2024-09-14T02:38:28.750527+0000 mgr.a (mgr.14355) 11140 : audit [DBG] from='client.244698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:32 smithi007 bash[22722]: cluster 2024-09-14T02:38:30.728603+0000 mgr.a (mgr.14355) 11141 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:32 smithi131 bash[24745]: cluster 2024-09-14T02:38:30.728603+0000 mgr.a (mgr.14355) 11141 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:32 smithi171 bash[25040]: cluster 2024-09-14T02:38:30.728603+0000 mgr.a (mgr.14355) 11141 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:34.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:34.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:34 smithi007 bash[22722]: cluster 2024-09-14T02:38:32.729376+0000 mgr.a (mgr.14355) 11142 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:34.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:34 smithi131 bash[24745]: cluster 2024-09-14T02:38:32.729376+0000 mgr.a (mgr.14355) 11142 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:34 smithi171 bash[25040]: cluster 2024-09-14T02:38:32.729376+0000 mgr.a (mgr.14355) 11142 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:34.954 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:34.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:34.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:35 smithi007 bash[22722]: audit 2024-09-14T02:38:34.507222+0000 mgr.a (mgr.14355) 11143 : audit [DBG] from='client.244776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:35 smithi131 bash[24745]: audit 2024-09-14T02:38:34.507222+0000 mgr.a (mgr.14355) 11143 : audit [DBG] from='client.244776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:35 smithi171 bash[25040]: audit 2024-09-14T02:38:34.507222+0000 mgr.a (mgr.14355) 11143 : audit [DBG] from='client.244776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:36 smithi007 bash[22722]: cluster 2024-09-14T02:38:34.729991+0000 mgr.a (mgr.14355) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:36 smithi131 bash[24745]: cluster 2024-09-14T02:38:34.729991+0000 mgr.a (mgr.14355) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:36 smithi171 bash[25040]: cluster 2024-09-14T02:38:34.729991+0000 mgr.a (mgr.14355) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:38 smithi007 bash[22722]: cluster 2024-09-14T02:38:36.732324+0000 mgr.a (mgr.14355) 11145 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:38.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:38 smithi131 bash[24745]: cluster 2024-09-14T02:38:36.732324+0000 mgr.a (mgr.14355) 11145 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:38 smithi171 bash[25040]: cluster 2024-09-14T02:38:36.732324+0000 mgr.a (mgr.14355) 11145 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:39.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:39.956 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:39.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:40.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:40 smithi007 bash[22722]: cluster 2024-09-14T02:38:38.733111+0000 mgr.a (mgr.14355) 11146 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:40.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:40 smithi131 bash[24745]: cluster 2024-09-14T02:38:38.733111+0000 mgr.a (mgr.14355) 11146 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:40 smithi171 bash[25040]: cluster 2024-09-14T02:38:38.733111+0000 mgr.a (mgr.14355) 11146 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:40.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:41 smithi007 bash[22722]: audit 2024-09-14T02:38:40.299359+0000 mgr.a (mgr.14355) 11147 : audit [DBG] from='client.244851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:41 smithi131 bash[24745]: audit 2024-09-14T02:38:40.299359+0000 mgr.a (mgr.14355) 11147 : audit [DBG] from='client.244851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:41 smithi171 bash[25040]: audit 2024-09-14T02:38:40.299359+0000 mgr.a (mgr.14355) 11147 : audit [DBG] from='client.244851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:42 smithi007 bash[22722]: cluster 2024-09-14T02:38:40.734367+0000 mgr.a (mgr.14355) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:42.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:42 smithi131 bash[24745]: cluster 2024-09-14T02:38:40.734367+0000 mgr.a (mgr.14355) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:42 smithi171 bash[25040]: cluster 2024-09-14T02:38:40.734367+0000 mgr.a (mgr.14355) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:44 smithi007 bash[22722]: cluster 2024-09-14T02:38:42.735053+0000 mgr.a (mgr.14355) 11149 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:44.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:44 smithi131 bash[24745]: cluster 2024-09-14T02:38:42.735053+0000 mgr.a (mgr.14355) 11149 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:44 smithi171 bash[25040]: cluster 2024-09-14T02:38:42.735053+0000 mgr.a (mgr.14355) 11149 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:45.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:45.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:46.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:46 smithi007 bash[22722]: cluster 2024-09-14T02:38:44.735829+0000 mgr.a (mgr.14355) 11150 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:46.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:46.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:46.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:46.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:46.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:46 smithi131 bash[24745]: cluster 2024-09-14T02:38:44.735829+0000 mgr.a (mgr.14355) 11150 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:46 smithi171 bash[25040]: cluster 2024-09-14T02:38:44.735829+0000 mgr.a (mgr.14355) 11150 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:38:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:47 smithi007 bash[22722]: audit 2024-09-14T02:38:46.073537+0000 mgr.a (mgr.14355) 11151 : audit [DBG] from='client.244929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:47 smithi131 bash[24745]: audit 2024-09-14T02:38:46.073537+0000 mgr.a (mgr.14355) 11151 : audit [DBG] from='client.244929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:47 smithi171 bash[25040]: audit 2024-09-14T02:38:46.073537+0000 mgr.a (mgr.14355) 11151 : audit [DBG] from='client.244929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:48 smithi007 bash[22722]: cluster 2024-09-14T02:38:46.738604+0000 mgr.a (mgr.14355) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:48.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:48 smithi131 bash[24745]: cluster 2024-09-14T02:38:46.738604+0000 mgr.a (mgr.14355) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:48 smithi171 bash[25040]: cluster 2024-09-14T02:38:46.738604+0000 mgr.a (mgr.14355) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:50 smithi007 bash[22722]: cluster 2024-09-14T02:38:48.739383+0000 mgr.a (mgr.14355) 11153 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:38:50.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:50 smithi131 bash[24745]: cluster 2024-09-14T02:38:48.739383+0000 mgr.a (mgr.14355) 11153 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:38:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:50 smithi171 bash[25040]: cluster 2024-09-14T02:38:48.739383+0000 mgr.a (mgr.14355) 11153 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:38:51.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:51.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:52.313 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:52.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:52.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:52.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:52.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:52 smithi007 bash[22722]: cluster 2024-09-14T02:38:50.741433+0000 mgr.a (mgr.14355) 11154 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:52 smithi131 bash[24745]: cluster 2024-09-14T02:38:50.741433+0000 mgr.a (mgr.14355) 11154 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:52 smithi171 bash[25040]: cluster 2024-09-14T02:38:50.741433+0000 mgr.a (mgr.14355) 11154 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:53 smithi007 bash[22722]: audit 2024-09-14T02:38:51.858274+0000 mgr.a (mgr.14355) 11155 : audit [DBG] from='client.245004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:53 smithi131 bash[24745]: audit 2024-09-14T02:38:51.858274+0000 mgr.a (mgr.14355) 11155 : audit [DBG] from='client.245004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:53 smithi171 bash[25040]: audit 2024-09-14T02:38:51.858274+0000 mgr.a (mgr.14355) 11155 : audit [DBG] from='client.245004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:54 smithi007 bash[22722]: cluster 2024-09-14T02:38:52.742342+0000 mgr.a (mgr.14355) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:54.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:54 smithi131 bash[24745]: cluster 2024-09-14T02:38:52.742342+0000 mgr.a (mgr.14355) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:54 smithi171 bash[25040]: cluster 2024-09-14T02:38:52.742342+0000 mgr.a (mgr.14355) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:56 smithi007 bash[22722]: cluster 2024-09-14T02:38:54.743114+0000 mgr.a (mgr.14355) 11157 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:56.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:56 smithi131 bash[24745]: cluster 2024-09-14T02:38:54.743114+0000 mgr.a (mgr.14355) 11157 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:56 smithi171 bash[25040]: cluster 2024-09-14T02:38:54.743114+0000 mgr.a (mgr.14355) 11157 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:38:57.315 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:38:57.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:38:57.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:38:57.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:57 smithi007 bash[22722]: audit 2024-09-14T02:38:56.407729+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:38:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:57 smithi007 bash[22722]: audit 2024-09-14T02:38:57.022791+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:57 smithi007 bash[22722]: audit 2024-09-14T02:38:57.026029+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:57 smithi007 bash[22722]: audit 2024-09-14T02:38:57.028967+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:57 smithi007 bash[22722]: audit 2024-09-14T02:38:57.031952+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:57 smithi131 bash[24745]: audit 2024-09-14T02:38:56.407729+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:57 smithi131 bash[24745]: audit 2024-09-14T02:38:57.022791+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:57 smithi131 bash[24745]: audit 2024-09-14T02:38:57.026029+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:57 smithi131 bash[24745]: audit 2024-09-14T02:38:57.028967+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:57 smithi131 bash[24745]: audit 2024-09-14T02:38:57.031952+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:57 smithi171 bash[25040]: audit 2024-09-14T02:38:56.407729+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:57 smithi171 bash[25040]: audit 2024-09-14T02:38:57.022791+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:57 smithi171 bash[25040]: audit 2024-09-14T02:38:57.026029+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:57 smithi171 bash[25040]: audit 2024-09-14T02:38:57.028967+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:57 smithi171 bash[25040]: audit 2024-09-14T02:38:57.031952+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:58.067 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:38:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:38:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:38:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:38:58.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: cluster 2024-09-14T02:38:56.745276+0000 mgr.a (mgr.14355) 11158 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: audit 2024-09-14T02:38:57.636832+0000 mgr.a (mgr.14355) 11159 : audit [DBG] from='client.245079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: audit 2024-09-14T02:38:57.705402+0000 mon.a (mon.0) 2265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: audit 2024-09-14T02:38:57.706313+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: audit 2024-09-14T02:38:57.713725+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22722]: audit 2024-09-14T02:38:57.716106+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: cluster 2024-09-14T02:38:56.745276+0000 mgr.a (mgr.14355) 11158 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: audit 2024-09-14T02:38:57.636832+0000 mgr.a (mgr.14355) 11159 : audit [DBG] from='client.245079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: audit 2024-09-14T02:38:57.705402+0000 mon.a (mon.0) 2265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: audit 2024-09-14T02:38:57.706313+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: audit 2024-09-14T02:38:57.713725+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:58 smithi131 bash[24745]: audit 2024-09-14T02:38:57.716106+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:38:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: cluster 2024-09-14T02:38:56.745276+0000 mgr.a (mgr.14355) 11158 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:38:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: audit 2024-09-14T02:38:57.636832+0000 mgr.a (mgr.14355) 11159 : audit [DBG] from='client.245079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:38:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: audit 2024-09-14T02:38:57.705402+0000 mon.a (mon.0) 2265 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:38:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: audit 2024-09-14T02:38:57.706313+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:38:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: audit 2024-09-14T02:38:57.713725+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:38:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:58 smithi171 bash[25040]: audit 2024-09-14T02:38:57.716106+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:38:59.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22972]: debug 2024-09-14T02:38:58.749+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:38:59.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:38:58 smithi007 bash[22972]: debug 2024-09-14T02:38:58.749+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:38:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:38:59 smithi007 bash[22722]: audit 2024-09-14T02:38:57.717232+0000 mgr.a (mgr.14355) 11160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:38:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:38:59 smithi131 bash[24745]: audit 2024-09-14T02:38:57.717232+0000 mgr.a (mgr.14355) 11160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:38:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:38:59 smithi171 bash[25040]: audit 2024-09-14T02:38:57.717232+0000 mgr.a (mgr.14355) 11160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:39:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:00 smithi007 bash[22722]: cluster 2024-09-14T02:38:58.745820+0000 mgr.a (mgr.14355) 11161 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:00 smithi007 bash[22722]: audit 2024-09-14T02:38:58.752530+0000 mgr.a (mgr.14355) 11162 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:39:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:00 smithi007 bash[22722]: cephadm 2024-09-14T02:38:58.753573+0000 mgr.a (mgr.14355) 11163 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:39:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:00 smithi131 bash[24745]: cluster 2024-09-14T02:38:58.745820+0000 mgr.a (mgr.14355) 11161 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:00 smithi131 bash[24745]: audit 2024-09-14T02:38:58.752530+0000 mgr.a (mgr.14355) 11162 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:39:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:00 smithi131 bash[24745]: cephadm 2024-09-14T02:38:58.753573+0000 mgr.a (mgr.14355) 11163 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:39:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:00 smithi171 bash[25040]: cluster 2024-09-14T02:38:58.745820+0000 mgr.a (mgr.14355) 11161 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:00 smithi171 bash[25040]: audit 2024-09-14T02:38:58.752530+0000 mgr.a (mgr.14355) 11162 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:39:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:00 smithi171 bash[25040]: cephadm 2024-09-14T02:38:58.753573+0000 mgr.a (mgr.14355) 11163 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:39:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:02 smithi007 bash[22722]: cluster 2024-09-14T02:39:00.748029+0000 mgr.a (mgr.14355) 11164 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:02.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:02 smithi131 bash[24745]: cluster 2024-09-14T02:39:00.748029+0000 mgr.a (mgr.14355) 11164 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:02 smithi171 bash[25040]: cluster 2024-09-14T02:39:00.748029+0000 mgr.a (mgr.14355) 11164 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:03.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:03.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:03.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:03.851 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:04 smithi007 bash[22722]: cluster 2024-09-14T02:39:02.748794+0000 mgr.a (mgr.14355) 11165 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:04 smithi007 bash[22722]: audit 2024-09-14T02:39:03.406082+0000 mgr.a (mgr.14355) 11166 : audit [DBG] from='client.245256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:04.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:04 smithi131 bash[24745]: cluster 2024-09-14T02:39:02.748794+0000 mgr.a (mgr.14355) 11165 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:04 smithi131 bash[24745]: audit 2024-09-14T02:39:03.406082+0000 mgr.a (mgr.14355) 11166 : audit [DBG] from='client.245256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:04 smithi171 bash[25040]: cluster 2024-09-14T02:39:02.748794+0000 mgr.a (mgr.14355) 11165 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:04 smithi171 bash[25040]: audit 2024-09-14T02:39:03.406082+0000 mgr.a (mgr.14355) 11166 : audit [DBG] from='client.245256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:06 smithi007 bash[22722]: cluster 2024-09-14T02:39:04.749690+0000 mgr.a (mgr.14355) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:06.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:06 smithi131 bash[24745]: cluster 2024-09-14T02:39:04.749690+0000 mgr.a (mgr.14355) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:06 smithi171 bash[25040]: cluster 2024-09-14T02:39:04.749690+0000 mgr.a (mgr.14355) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:08 smithi007 bash[22722]: cluster 2024-09-14T02:39:06.751932+0000 mgr.a (mgr.14355) 11168 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:08.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:08 smithi131 bash[24745]: cluster 2024-09-14T02:39:06.751932+0000 mgr.a (mgr.14355) 11168 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:08 smithi171 bash[25040]: cluster 2024-09-14T02:39:06.751932+0000 mgr.a (mgr.14355) 11168 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:08.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:09.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:09.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:10 smithi007 bash[22722]: cluster 2024-09-14T02:39:08.752826+0000 mgr.a (mgr.14355) 11169 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:10 smithi007 bash[22722]: audit 2024-09-14T02:39:09.183346+0000 mgr.a (mgr.14355) 11170 : audit [DBG] from='client.245331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:10 smithi131 bash[24745]: cluster 2024-09-14T02:39:08.752826+0000 mgr.a (mgr.14355) 11169 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:10 smithi131 bash[24745]: audit 2024-09-14T02:39:09.183346+0000 mgr.a (mgr.14355) 11170 : audit [DBG] from='client.245331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:10 smithi171 bash[25040]: cluster 2024-09-14T02:39:08.752826+0000 mgr.a (mgr.14355) 11169 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:10 smithi171 bash[25040]: audit 2024-09-14T02:39:09.183346+0000 mgr.a (mgr.14355) 11170 : audit [DBG] from='client.245331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:12 smithi007 bash[22722]: cluster 2024-09-14T02:39:10.755359+0000 mgr.a (mgr.14355) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:12.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:12 smithi131 bash[24745]: cluster 2024-09-14T02:39:10.755359+0000 mgr.a (mgr.14355) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:12 smithi171 bash[25040]: cluster 2024-09-14T02:39:10.755359+0000 mgr.a (mgr.14355) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:39:14.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:14.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:14.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:14 smithi007 bash[22722]: cluster 2024-09-14T02:39:12.756167+0000 mgr.a (mgr.14355) 11172 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:14.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:14 smithi131 bash[24745]: cluster 2024-09-14T02:39:12.756167+0000 mgr.a (mgr.14355) 11172 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:14 smithi171 bash[25040]: cluster 2024-09-14T02:39:12.756167+0000 mgr.a (mgr.14355) 11172 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:15.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:15.388 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:16 smithi131 bash[24745]: cluster 2024-09-14T02:39:14.757033+0000 mgr.a (mgr.14355) 11173 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:16 smithi131 bash[24745]: audit 2024-09-14T02:39:14.940324+0000 mgr.a (mgr.14355) 11174 : audit [DBG] from='client.245409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:16 smithi171 bash[25040]: cluster 2024-09-14T02:39:14.757033+0000 mgr.a (mgr.14355) 11173 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:16 smithi171 bash[25040]: audit 2024-09-14T02:39:14.940324+0000 mgr.a (mgr.14355) 11174 : audit [DBG] from='client.245409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:16 smithi007 bash[22722]: cluster 2024-09-14T02:39:14.757033+0000 mgr.a (mgr.14355) 11173 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:16 smithi007 bash[22722]: audit 2024-09-14T02:39:14.940324+0000 mgr.a (mgr.14355) 11174 : audit [DBG] from='client.245409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:18.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:18 smithi131 bash[24745]: cluster 2024-09-14T02:39:16.759939+0000 mgr.a (mgr.14355) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:39:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:18 smithi171 bash[25040]: cluster 2024-09-14T02:39:16.759939+0000 mgr.a (mgr.14355) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:39:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:18 smithi007 bash[22722]: cluster 2024-09-14T02:39:16.759939+0000 mgr.a (mgr.14355) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:39:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:20.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:20 smithi131 bash[24745]: cluster 2024-09-14T02:39:18.760723+0000 mgr.a (mgr.14355) 11176 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:39:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:20 smithi171 bash[25040]: cluster 2024-09-14T02:39:18.760723+0000 mgr.a (mgr.14355) 11176 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:39:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:20 smithi007 bash[22722]: cluster 2024-09-14T02:39:18.760723+0000 mgr.a (mgr.14355) 11176 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:39:21.163 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:21.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:21.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:21.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:21.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:22 smithi131 bash[24745]: audit 2024-09-14T02:39:20.724373+0000 mgr.a (mgr.14355) 11177 : audit [DBG] from='client.245481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:22 smithi131 bash[24745]: cluster 2024-09-14T02:39:20.762809+0000 mgr.a (mgr.14355) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:22 smithi171 bash[25040]: audit 2024-09-14T02:39:20.724373+0000 mgr.a (mgr.14355) 11177 : audit [DBG] from='client.245481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:22 smithi171 bash[25040]: cluster 2024-09-14T02:39:20.762809+0000 mgr.a (mgr.14355) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:22 smithi007 bash[22722]: audit 2024-09-14T02:39:20.724373+0000 mgr.a (mgr.14355) 11177 : audit [DBG] from='client.245481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:22 smithi007 bash[22722]: cluster 2024-09-14T02:39:20.762809+0000 mgr.a (mgr.14355) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:24 smithi131 bash[24745]: cluster 2024-09-14T02:39:22.763667+0000 mgr.a (mgr.14355) 11179 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:39:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:24 smithi171 bash[25040]: cluster 2024-09-14T02:39:22.763667+0000 mgr.a (mgr.14355) 11179 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:39:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:24 smithi007 bash[22722]: cluster 2024-09-14T02:39:22.763667+0000 mgr.a (mgr.14355) 11179 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:39:26.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:26.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:26.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:26 smithi131 bash[24745]: cluster 2024-09-14T02:39:24.764436+0000 mgr.a (mgr.14355) 11180 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:39:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:26 smithi171 bash[25040]: cluster 2024-09-14T02:39:24.764436+0000 mgr.a (mgr.14355) 11180 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:39:26.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:26.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:26.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:26.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:26 smithi007 bash[22722]: cluster 2024-09-14T02:39:24.764436+0000 mgr.a (mgr.14355) 11180 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:39:27.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:27 smithi131 bash[24745]: audit 2024-09-14T02:39:26.500431+0000 mgr.a (mgr.14355) 11181 : audit [DBG] from='client.245559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:27 smithi171 bash[25040]: audit 2024-09-14T02:39:26.500431+0000 mgr.a (mgr.14355) 11181 : audit [DBG] from='client.245559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:27 smithi007 bash[22722]: audit 2024-09-14T02:39:26.500431+0000 mgr.a (mgr.14355) 11181 : audit [DBG] from='client.245559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:28.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:28 smithi131 bash[24745]: cluster 2024-09-14T02:39:26.765836+0000 mgr.a (mgr.14355) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:28 smithi171 bash[25040]: cluster 2024-09-14T02:39:26.765836+0000 mgr.a (mgr.14355) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:28 smithi007 bash[22722]: cluster 2024-09-14T02:39:26.765836+0000 mgr.a (mgr.14355) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:30.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:30 smithi131 bash[24745]: cluster 2024-09-14T02:39:28.766747+0000 mgr.a (mgr.14355) 11183 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:39:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:30 smithi171 bash[25040]: cluster 2024-09-14T02:39:28.766747+0000 mgr.a (mgr.14355) 11183 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:39:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:30 smithi007 bash[22722]: cluster 2024-09-14T02:39:28.766747+0000 mgr.a (mgr.14355) 11183 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:39:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:31.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:32.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:32.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:32.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:32 smithi131 bash[24745]: cluster 2024-09-14T02:39:30.769005+0000 mgr.a (mgr.14355) 11184 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:39:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:32 smithi171 bash[25040]: cluster 2024-09-14T02:39:30.769005+0000 mgr.a (mgr.14355) 11184 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:39:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:32 smithi007 bash[22722]: cluster 2024-09-14T02:39:30.769005+0000 mgr.a (mgr.14355) 11184 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:39:33.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:33 smithi131 bash[24745]: audit 2024-09-14T02:39:32.276722+0000 mgr.a (mgr.14355) 11185 : audit [DBG] from='client.245637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:33 smithi171 bash[25040]: audit 2024-09-14T02:39:32.276722+0000 mgr.a (mgr.14355) 11185 : audit [DBG] from='client.245637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:33 smithi007 bash[22722]: audit 2024-09-14T02:39:32.276722+0000 mgr.a (mgr.14355) 11185 : audit [DBG] from='client.245637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:34 smithi131 bash[24745]: cluster 2024-09-14T02:39:32.769459+0000 mgr.a (mgr.14355) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:34 smithi171 bash[25040]: cluster 2024-09-14T02:39:32.769459+0000 mgr.a (mgr.14355) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:34.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:34 smithi007 bash[22722]: cluster 2024-09-14T02:39:32.769459+0000 mgr.a (mgr.14355) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:36.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:36 smithi131 bash[24745]: cluster 2024-09-14T02:39:34.770152+0000 mgr.a (mgr.14355) 11187 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:36 smithi171 bash[25040]: cluster 2024-09-14T02:39:34.770152+0000 mgr.a (mgr.14355) 11187 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:36 smithi007 bash[22722]: cluster 2024-09-14T02:39:34.770152+0000 mgr.a (mgr.14355) 11187 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:38.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:38.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:38.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:38 smithi131 bash[24745]: cluster 2024-09-14T02:39:36.772406+0000 mgr.a (mgr.14355) 11188 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:38 smithi171 bash[25040]: cluster 2024-09-14T02:39:36.772406+0000 mgr.a (mgr.14355) 11188 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:38 smithi007 bash[22722]: cluster 2024-09-14T02:39:36.772406+0000 mgr.a (mgr.14355) 11188 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:39 smithi131 bash[24745]: audit 2024-09-14T02:39:38.019250+0000 mgr.a (mgr.14355) 11189 : audit [DBG] from='client.245715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:39 smithi171 bash[25040]: audit 2024-09-14T02:39:38.019250+0000 mgr.a (mgr.14355) 11189 : audit [DBG] from='client.245715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:39 smithi007 bash[22722]: audit 2024-09-14T02:39:38.019250+0000 mgr.a (mgr.14355) 11189 : audit [DBG] from='client.245715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:40.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:40 smithi131 bash[24745]: cluster 2024-09-14T02:39:38.773339+0000 mgr.a (mgr.14355) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:40 smithi171 bash[25040]: cluster 2024-09-14T02:39:38.773339+0000 mgr.a (mgr.14355) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:40 smithi007 bash[22722]: cluster 2024-09-14T02:39:38.773339+0000 mgr.a (mgr.14355) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:42 smithi171 bash[25040]: cluster 2024-09-14T02:39:40.775580+0000 mgr.a (mgr.14355) 11191 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:42 smithi007 bash[22722]: cluster 2024-09-14T02:39:40.775580+0000 mgr.a (mgr.14355) 11191 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:42 smithi131 bash[24745]: cluster 2024-09-14T02:39:40.775580+0000 mgr.a (mgr.14355) 11191 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:43.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:43.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:43.452 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:44.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:44.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:44 smithi171 bash[25040]: cluster 2024-09-14T02:39:42.776321+0000 mgr.a (mgr.14355) 11192 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:44 smithi007 bash[22722]: cluster 2024-09-14T02:39:42.776321+0000 mgr.a (mgr.14355) 11192 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:44 smithi131 bash[24745]: cluster 2024-09-14T02:39:42.776321+0000 mgr.a (mgr.14355) 11192 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:45 smithi007 bash[22722]: audit 2024-09-14T02:39:43.786520+0000 mgr.a (mgr.14355) 11193 : audit [DBG] from='client.245793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:46.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:45 smithi131 bash[24745]: audit 2024-09-14T02:39:43.786520+0000 mgr.a (mgr.14355) 11193 : audit [DBG] from='client.245793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:45 smithi171 bash[25040]: audit 2024-09-14T02:39:43.786520+0000 mgr.a (mgr.14355) 11193 : audit [DBG] from='client.245793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:46 smithi007 bash[22722]: cluster 2024-09-14T02:39:44.777280+0000 mgr.a (mgr.14355) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:47.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:46 smithi131 bash[24745]: cluster 2024-09-14T02:39:44.777280+0000 mgr.a (mgr.14355) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:47.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:46 smithi171 bash[25040]: cluster 2024-09-14T02:39:44.777280+0000 mgr.a (mgr.14355) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:48 smithi007 bash[22722]: cluster 2024-09-14T02:39:46.779578+0000 mgr.a (mgr.14355) 11195 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:48 smithi131 bash[24745]: cluster 2024-09-14T02:39:46.779578+0000 mgr.a (mgr.14355) 11195 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:48 smithi171 bash[25040]: cluster 2024-09-14T02:39:46.779578+0000 mgr.a (mgr.14355) 11195 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:49.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:49.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:49.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:49.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:49.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:49.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:49.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:49.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:50 smithi007 bash[22722]: cluster 2024-09-14T02:39:48.780346+0000 mgr.a (mgr.14355) 11196 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:50 smithi007 bash[22722]: audit 2024-09-14T02:39:49.553662+0000 mgr.a (mgr.14355) 11197 : audit [DBG] from='client.245871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:50 smithi131 bash[24745]: cluster 2024-09-14T02:39:48.780346+0000 mgr.a (mgr.14355) 11196 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:50 smithi131 bash[24745]: audit 2024-09-14T02:39:49.553662+0000 mgr.a (mgr.14355) 11197 : audit [DBG] from='client.245871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:50 smithi171 bash[25040]: cluster 2024-09-14T02:39:48.780346+0000 mgr.a (mgr.14355) 11196 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:50 smithi171 bash[25040]: audit 2024-09-14T02:39:49.553662+0000 mgr.a (mgr.14355) 11197 : audit [DBG] from='client.245871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:52 smithi007 bash[22722]: cluster 2024-09-14T02:39:50.782781+0000 mgr.a (mgr.14355) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:52 smithi131 bash[24745]: cluster 2024-09-14T02:39:50.782781+0000 mgr.a (mgr.14355) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:52 smithi171 bash[25040]: cluster 2024-09-14T02:39:50.782781+0000 mgr.a (mgr.14355) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:39:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:54 smithi007 bash[22722]: cluster 2024-09-14T02:39:52.783579+0000 mgr.a (mgr.14355) 11199 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:39:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:39:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:39:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:54 smithi131 bash[24745]: cluster 2024-09-14T02:39:52.783579+0000 mgr.a (mgr.14355) 11199 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:54 smithi171 bash[25040]: cluster 2024-09-14T02:39:52.783579+0000 mgr.a (mgr.14355) 11199 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:55.749 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:39:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:39:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:39:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:39:55.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:39:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:56 smithi007 bash[22722]: cluster 2024-09-14T02:39:54.784345+0000 mgr.a (mgr.14355) 11200 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:56 smithi007 bash[22722]: audit 2024-09-14T02:39:55.311334+0000 mgr.a (mgr.14355) 11201 : audit [DBG] from='client.245949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:56 smithi131 bash[24745]: cluster 2024-09-14T02:39:54.784345+0000 mgr.a (mgr.14355) 11200 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:56 smithi131 bash[24745]: audit 2024-09-14T02:39:55.311334+0000 mgr.a (mgr.14355) 11201 : audit [DBG] from='client.245949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:56 smithi171 bash[25040]: cluster 2024-09-14T02:39:54.784345+0000 mgr.a (mgr.14355) 11200 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:56 smithi171 bash[25040]: audit 2024-09-14T02:39:55.311334+0000 mgr.a (mgr.14355) 11201 : audit [DBG] from='client.245949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:39:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:58 smithi007 bash[22722]: cluster 2024-09-14T02:39:56.787248+0000 mgr.a (mgr.14355) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:59.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:58 smithi131 bash[24745]: cluster 2024-09-14T02:39:56.787248+0000 mgr.a (mgr.14355) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:58 smithi171 bash[25040]: cluster 2024-09-14T02:39:56.787248+0000 mgr.a (mgr.14355) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:39:59.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:39:59 smithi007 bash[22722]: audit 2024-09-14T02:39:58.801996+0000 mon.a (mon.0) 2269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:40:00.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:39:59 smithi131 bash[24745]: audit 2024-09-14T02:39:58.801996+0000 mon.a (mon.0) 2269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:40:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:39:59 smithi171 bash[25040]: audit 2024-09-14T02:39:58.801996+0000 mon.a (mon.0) 2269 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:40:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22972]: debug 2024-09-14T02:40:00.400+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:40:00.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22972]: debug 2024-09-14T02:40:00.400+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:40:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: cluster 2024-09-14T02:39:58.788053+0000 mgr.a (mgr.14355) 11203 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: audit 2024-09-14T02:39:59.651051+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:40:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: audit 2024-09-14T02:39:59.652750+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:40:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: audit 2024-09-14T02:39:59.662757+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:40:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: audit 2024-09-14T02:39:59.668112+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:00 smithi007 bash[22722]: cluster 2024-09-14T02:40:00.000114+0000 mon.a (mon.0) 2274 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:40:00.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:00.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:00.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: cluster 2024-09-14T02:39:58.788053+0000 mgr.a (mgr.14355) 11203 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: audit 2024-09-14T02:39:59.651051+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: audit 2024-09-14T02:39:59.652750+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: audit 2024-09-14T02:39:59.662757+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: audit 2024-09-14T02:39:59.668112+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:00 smithi131 bash[24745]: cluster 2024-09-14T02:40:00.000114+0000 mon.a (mon.0) 2274 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: cluster 2024-09-14T02:39:58.788053+0000 mgr.a (mgr.14355) 11203 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: audit 2024-09-14T02:39:59.651051+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: audit 2024-09-14T02:39:59.652750+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: audit 2024-09-14T02:39:59.662757+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:40:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: audit 2024-09-14T02:39:59.668112+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:00 smithi171 bash[25040]: cluster 2024-09-14T02:40:00.000114+0000 mon.a (mon.0) 2274 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:40:01.480 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:01.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:01.480 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:01.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:01.481 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:01 smithi007 bash[22722]: audit 2024-09-14T02:39:59.670487+0000 mgr.a (mgr.14355) 11204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:01 smithi007 bash[22722]: audit 2024-09-14T02:40:00.402726+0000 mgr.a (mgr.14355) 11205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:40:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:01 smithi007 bash[22722]: cephadm 2024-09-14T02:40:00.403928+0000 mgr.a (mgr.14355) 11206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:40:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:01 smithi131 bash[24745]: audit 2024-09-14T02:39:59.670487+0000 mgr.a (mgr.14355) 11204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:01 smithi131 bash[24745]: audit 2024-09-14T02:40:00.402726+0000 mgr.a (mgr.14355) 11205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:40:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:01 smithi131 bash[24745]: cephadm 2024-09-14T02:40:00.403928+0000 mgr.a (mgr.14355) 11206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:40:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:01 smithi171 bash[25040]: audit 2024-09-14T02:39:59.670487+0000 mgr.a (mgr.14355) 11204 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:40:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:01 smithi171 bash[25040]: audit 2024-09-14T02:40:00.402726+0000 mgr.a (mgr.14355) 11205 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:40:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:01 smithi171 bash[25040]: cephadm 2024-09-14T02:40:00.403928+0000 mgr.a (mgr.14355) 11206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:40:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:02 smithi007 bash[22722]: cluster 2024-09-14T02:40:00.790181+0000 mgr.a (mgr.14355) 11207 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:40:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:02 smithi007 bash[22722]: audit 2024-09-14T02:40:01.075556+0000 mgr.a (mgr.14355) 11208 : audit [DBG] from='client.246132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:02 smithi131 bash[24745]: cluster 2024-09-14T02:40:00.790181+0000 mgr.a (mgr.14355) 11207 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:40:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:02 smithi131 bash[24745]: audit 2024-09-14T02:40:01.075556+0000 mgr.a (mgr.14355) 11208 : audit [DBG] from='client.246132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:02 smithi171 bash[25040]: cluster 2024-09-14T02:40:00.790181+0000 mgr.a (mgr.14355) 11207 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:40:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:02 smithi171 bash[25040]: audit 2024-09-14T02:40:01.075556+0000 mgr.a (mgr.14355) 11208 : audit [DBG] from='client.246132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:04 smithi007 bash[22722]: cluster 2024-09-14T02:40:02.791117+0000 mgr.a (mgr.14355) 11209 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:04 smithi131 bash[24745]: cluster 2024-09-14T02:40:02.791117+0000 mgr.a (mgr.14355) 11209 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:04 smithi171 bash[25040]: cluster 2024-09-14T02:40:02.791117+0000 mgr.a (mgr.14355) 11209 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:06.482 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:06 smithi007 bash[22722]: cluster 2024-09-14T02:40:04.791923+0000 mgr.a (mgr.14355) 11210 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:07.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:06 smithi131 bash[24745]: cluster 2024-09-14T02:40:04.791923+0000 mgr.a (mgr.14355) 11210 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:06 smithi171 bash[25040]: cluster 2024-09-14T02:40:04.791923+0000 mgr.a (mgr.14355) 11210 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:40:07.251 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:07.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:07.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:08 smithi007 bash[22722]: cluster 2024-09-14T02:40:06.794061+0000 mgr.a (mgr.14355) 11211 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:08 smithi007 bash[22722]: audit 2024-09-14T02:40:06.818668+0000 mgr.a (mgr.14355) 11212 : audit [DBG] from='client.246210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:08 smithi131 bash[24745]: cluster 2024-09-14T02:40:06.794061+0000 mgr.a (mgr.14355) 11211 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:08 smithi131 bash[24745]: audit 2024-09-14T02:40:06.818668+0000 mgr.a (mgr.14355) 11212 : audit [DBG] from='client.246210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:08 smithi171 bash[25040]: cluster 2024-09-14T02:40:06.794061+0000 mgr.a (mgr.14355) 11211 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:08 smithi171 bash[25040]: audit 2024-09-14T02:40:06.818668+0000 mgr.a (mgr.14355) 11212 : audit [DBG] from='client.246210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:10 smithi007 bash[22722]: cluster 2024-09-14T02:40:08.795051+0000 mgr.a (mgr.14355) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:11.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:10 smithi131 bash[24745]: cluster 2024-09-14T02:40:08.795051+0000 mgr.a (mgr.14355) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:10 smithi171 bash[25040]: cluster 2024-09-14T02:40:08.795051+0000 mgr.a (mgr.14355) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:12.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:12.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:12.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:12 smithi007 bash[22722]: cluster 2024-09-14T02:40:10.797275+0000 mgr.a (mgr.14355) 11214 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:12.991 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:13.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:12 smithi131 bash[24745]: cluster 2024-09-14T02:40:10.797275+0000 mgr.a (mgr.14355) 11214 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:12 smithi171 bash[25040]: cluster 2024-09-14T02:40:10.797275+0000 mgr.a (mgr.14355) 11214 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:40:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:13 smithi007 bash[22722]: audit 2024-09-14T02:40:12.582461+0000 mgr.a (mgr.14355) 11215 : audit [DBG] from='client.246288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:14.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:13 smithi131 bash[24745]: audit 2024-09-14T02:40:12.582461+0000 mgr.a (mgr.14355) 11215 : audit [DBG] from='client.246288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:13 smithi171 bash[25040]: audit 2024-09-14T02:40:12.582461+0000 mgr.a (mgr.14355) 11215 : audit [DBG] from='client.246288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:14 smithi007 bash[22722]: cluster 2024-09-14T02:40:12.801005+0000 mgr.a (mgr.14355) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:15.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:14 smithi131 bash[24745]: cluster 2024-09-14T02:40:12.801005+0000 mgr.a (mgr.14355) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:14 smithi171 bash[25040]: cluster 2024-09-14T02:40:12.801005+0000 mgr.a (mgr.14355) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:16 smithi007 bash[22722]: cluster 2024-09-14T02:40:14.801891+0000 mgr.a (mgr.14355) 11217 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:16 smithi131 bash[24745]: cluster 2024-09-14T02:40:14.801891+0000 mgr.a (mgr.14355) 11217 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:16 smithi171 bash[25040]: cluster 2024-09-14T02:40:14.801891+0000 mgr.a (mgr.14355) 11217 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:40:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:17.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:18.730 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:18.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:18.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:18.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:18.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:18 smithi007 bash[22722]: cluster 2024-09-14T02:40:16.804141+0000 mgr.a (mgr.14355) 11218 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:40:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:18 smithi131 bash[24745]: cluster 2024-09-14T02:40:16.804141+0000 mgr.a (mgr.14355) 11218 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:40:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:18 smithi171 bash[25040]: cluster 2024-09-14T02:40:16.804141+0000 mgr.a (mgr.14355) 11218 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:40:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:19 smithi007 bash[22722]: audit 2024-09-14T02:40:18.318205+0000 mgr.a (mgr.14355) 11219 : audit [DBG] from='client.246366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:19 smithi131 bash[24745]: audit 2024-09-14T02:40:18.318205+0000 mgr.a (mgr.14355) 11219 : audit [DBG] from='client.246366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:19 smithi171 bash[25040]: audit 2024-09-14T02:40:18.318205+0000 mgr.a (mgr.14355) 11219 : audit [DBG] from='client.246366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:20 smithi007 bash[22722]: cluster 2024-09-14T02:40:18.805104+0000 mgr.a (mgr.14355) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:20 smithi131 bash[24745]: cluster 2024-09-14T02:40:18.805104+0000 mgr.a (mgr.14355) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:20 smithi171 bash[25040]: cluster 2024-09-14T02:40:18.805104+0000 mgr.a (mgr.14355) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:22 smithi007 bash[22722]: cluster 2024-09-14T02:40:20.807372+0000 mgr.a (mgr.14355) 11221 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:23.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:22 smithi131 bash[24745]: cluster 2024-09-14T02:40:20.807372+0000 mgr.a (mgr.14355) 11221 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:22 smithi171 bash[25040]: cluster 2024-09-14T02:40:20.807372+0000 mgr.a (mgr.14355) 11221 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:23.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:23.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:24.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:24.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:24 smithi007 bash[22722]: cluster 2024-09-14T02:40:22.808136+0000 mgr.a (mgr.14355) 11222 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:25.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:24 smithi131 bash[24745]: cluster 2024-09-14T02:40:22.808136+0000 mgr.a (mgr.14355) 11222 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:24 smithi171 bash[25040]: cluster 2024-09-14T02:40:22.808136+0000 mgr.a (mgr.14355) 11222 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:25 smithi007 bash[22722]: audit 2024-09-14T02:40:24.063257+0000 mgr.a (mgr.14355) 11223 : audit [DBG] from='client.246438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:26.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:25 smithi131 bash[24745]: audit 2024-09-14T02:40:24.063257+0000 mgr.a (mgr.14355) 11223 : audit [DBG] from='client.246438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:25 smithi171 bash[25040]: audit 2024-09-14T02:40:24.063257+0000 mgr.a (mgr.14355) 11223 : audit [DBG] from='client.246438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:26 smithi007 bash[22722]: cluster 2024-09-14T02:40:24.809201+0000 mgr.a (mgr.14355) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:27.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:26 smithi131 bash[24745]: cluster 2024-09-14T02:40:24.809201+0000 mgr.a (mgr.14355) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:26 smithi171 bash[25040]: cluster 2024-09-14T02:40:24.809201+0000 mgr.a (mgr.14355) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:27 smithi007 bash[22722]: cluster 2024-09-14T02:40:26.811524+0000 mgr.a (mgr.14355) 11225 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:27 smithi131 bash[24745]: cluster 2024-09-14T02:40:26.811524+0000 mgr.a (mgr.14355) 11225 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:27 smithi171 bash[25040]: cluster 2024-09-14T02:40:26.811524+0000 mgr.a (mgr.14355) 11225 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:29.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:29.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:29.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:30.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:29 smithi007 bash[22722]: cluster 2024-09-14T02:40:28.812278+0000 mgr.a (mgr.14355) 11226 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:30.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:30.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:30.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:29 smithi131 bash[24745]: cluster 2024-09-14T02:40:28.812278+0000 mgr.a (mgr.14355) 11226 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:29 smithi171 bash[25040]: cluster 2024-09-14T02:40:28.812278+0000 mgr.a (mgr.14355) 11226 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:30 smithi007 bash[22722]: audit 2024-09-14T02:40:29.827474+0000 mgr.a (mgr.14355) 11227 : audit [DBG] from='client.246516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:31.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:30 smithi131 bash[24745]: audit 2024-09-14T02:40:29.827474+0000 mgr.a (mgr.14355) 11227 : audit [DBG] from='client.246516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:30 smithi171 bash[25040]: audit 2024-09-14T02:40:29.827474+0000 mgr.a (mgr.14355) 11227 : audit [DBG] from='client.246516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:31 smithi007 bash[22722]: cluster 2024-09-14T02:40:30.814683+0000 mgr.a (mgr.14355) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:40:32.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:31 smithi131 bash[24745]: cluster 2024-09-14T02:40:30.814683+0000 mgr.a (mgr.14355) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:40:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:31 smithi171 bash[25040]: cluster 2024-09-14T02:40:30.814683+0000 mgr.a (mgr.14355) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:40:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:33 smithi007 bash[22722]: cluster 2024-09-14T02:40:32.815624+0000 mgr.a (mgr.14355) 11229 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:34.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:33 smithi131 bash[24745]: cluster 2024-09-14T02:40:32.815624+0000 mgr.a (mgr.14355) 11229 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:33 smithi171 bash[25040]: cluster 2024-09-14T02:40:32.815624+0000 mgr.a (mgr.14355) 11229 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:35.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:35.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:36.048 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:36.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:35 smithi007 bash[22722]: cluster 2024-09-14T02:40:34.816440+0000 mgr.a (mgr.14355) 11230 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:35 smithi007 bash[22722]: audit 2024-09-14T02:40:35.604231+0000 mgr.a (mgr.14355) 11231 : audit [DBG] from='client.246591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:35 smithi131 bash[24745]: cluster 2024-09-14T02:40:34.816440+0000 mgr.a (mgr.14355) 11230 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:35 smithi131 bash[24745]: audit 2024-09-14T02:40:35.604231+0000 mgr.a (mgr.14355) 11231 : audit [DBG] from='client.246591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:35 smithi171 bash[25040]: cluster 2024-09-14T02:40:34.816440+0000 mgr.a (mgr.14355) 11230 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T02:40:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:35 smithi171 bash[25040]: audit 2024-09-14T02:40:35.604231+0000 mgr.a (mgr.14355) 11231 : audit [DBG] from='client.246591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:37 smithi007 bash[22722]: cluster 2024-09-14T02:40:36.819248+0000 mgr.a (mgr.14355) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:38.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:37 smithi131 bash[24745]: cluster 2024-09-14T02:40:36.819248+0000 mgr.a (mgr.14355) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:37 smithi171 bash[25040]: cluster 2024-09-14T02:40:36.819248+0000 mgr.a (mgr.14355) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:39 smithi007 bash[22722]: cluster 2024-09-14T02:40:38.820044+0000 mgr.a (mgr.14355) 11233 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:39 smithi131 bash[24745]: cluster 2024-09-14T02:40:38.820044+0000 mgr.a (mgr.14355) 11233 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:39 smithi171 bash[25040]: cluster 2024-09-14T02:40:38.820044+0000 mgr.a (mgr.14355) 11233 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:40:41.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:41.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:41.831 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:41.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:41 smithi007 bash[22722]: cluster 2024-09-14T02:40:40.821966+0000 mgr.a (mgr.14355) 11234 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:41 smithi007 bash[22722]: audit 2024-09-14T02:40:41.385325+0000 mgr.a (mgr.14355) 11235 : audit [DBG] from='client.246666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:41 smithi131 bash[24745]: cluster 2024-09-14T02:40:40.821966+0000 mgr.a (mgr.14355) 11234 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:41 smithi131 bash[24745]: audit 2024-09-14T02:40:41.385325+0000 mgr.a (mgr.14355) 11235 : audit [DBG] from='client.246666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:41 smithi171 bash[25040]: cluster 2024-09-14T02:40:40.821966+0000 mgr.a (mgr.14355) 11234 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:41 smithi171 bash[25040]: audit 2024-09-14T02:40:41.385325+0000 mgr.a (mgr.14355) 11235 : audit [DBG] from='client.246666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:43 smithi007 bash[22722]: cluster 2024-09-14T02:40:42.822903+0000 mgr.a (mgr.14355) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:44.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:43 smithi131 bash[24745]: cluster 2024-09-14T02:40:42.822903+0000 mgr.a (mgr.14355) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:43 smithi171 bash[25040]: cluster 2024-09-14T02:40:42.822903+0000 mgr.a (mgr.14355) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:45 smithi007 bash[22722]: cluster 2024-09-14T02:40:44.823882+0000 mgr.a (mgr.14355) 11237 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:45 smithi131 bash[24745]: cluster 2024-09-14T02:40:44.823882+0000 mgr.a (mgr.14355) 11237 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:46.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:45 smithi171 bash[25040]: cluster 2024-09-14T02:40:44.823882+0000 mgr.a (mgr.14355) 11237 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:40:46.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:46.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:47.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:47.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:47.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:47.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:47.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:47 smithi007 bash[22722]: cluster 2024-09-14T02:40:46.826132+0000 mgr.a (mgr.14355) 11238 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:40:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:47 smithi007 bash[22722]: audit 2024-09-14T02:40:47.173515+0000 mgr.a (mgr.14355) 11239 : audit [DBG] from='client.246738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:47 smithi131 bash[24745]: cluster 2024-09-14T02:40:46.826132+0000 mgr.a (mgr.14355) 11238 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:40:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:47 smithi131 bash[24745]: audit 2024-09-14T02:40:47.173515+0000 mgr.a (mgr.14355) 11239 : audit [DBG] from='client.246738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:47 smithi171 bash[25040]: cluster 2024-09-14T02:40:46.826132+0000 mgr.a (mgr.14355) 11238 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:40:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:47 smithi171 bash[25040]: audit 2024-09-14T02:40:47.173515+0000 mgr.a (mgr.14355) 11239 : audit [DBG] from='client.246738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:49 smithi007 bash[22722]: cluster 2024-09-14T02:40:48.827051+0000 mgr.a (mgr.14355) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:50.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:49 smithi131 bash[24745]: cluster 2024-09-14T02:40:48.827051+0000 mgr.a (mgr.14355) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:49 smithi171 bash[25040]: cluster 2024-09-14T02:40:48.827051+0000 mgr.a (mgr.14355) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:51 smithi007 bash[22722]: cluster 2024-09-14T02:40:50.829270+0000 mgr.a (mgr.14355) 11241 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:51 smithi131 bash[24745]: cluster 2024-09-14T02:40:50.829270+0000 mgr.a (mgr.14355) 11241 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:51 smithi171 bash[25040]: cluster 2024-09-14T02:40:50.829270+0000 mgr.a (mgr.14355) 11241 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:52.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:52.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:52.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:53.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:53.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:53.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:53.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:40:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:53 smithi007 bash[22722]: cluster 2024-09-14T02:40:52.830007+0000 mgr.a (mgr.14355) 11242 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:53 smithi007 bash[22722]: audit 2024-09-14T02:40:52.934748+0000 mgr.a (mgr.14355) 11243 : audit [DBG] from='client.246816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:53 smithi131 bash[24745]: cluster 2024-09-14T02:40:52.830007+0000 mgr.a (mgr.14355) 11242 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:53 smithi131 bash[24745]: audit 2024-09-14T02:40:52.934748+0000 mgr.a (mgr.14355) 11243 : audit [DBG] from='client.246816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:53 smithi171 bash[25040]: cluster 2024-09-14T02:40:52.830007+0000 mgr.a (mgr.14355) 11242 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:53 smithi171 bash[25040]: audit 2024-09-14T02:40:52.934748+0000 mgr.a (mgr.14355) 11243 : audit [DBG] from='client.246816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:40:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:55 smithi007 bash[22722]: cluster 2024-09-14T02:40:54.830963+0000 mgr.a (mgr.14355) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:56.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:55 smithi131 bash[24745]: cluster 2024-09-14T02:40:54.830963+0000 mgr.a (mgr.14355) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:55 smithi171 bash[25040]: cluster 2024-09-14T02:40:54.830963+0000 mgr.a (mgr.14355) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:40:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:57 smithi007 bash[22722]: cluster 2024-09-14T02:40:56.833221+0000 mgr.a (mgr.14355) 11245 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:57 smithi131 bash[24745]: cluster 2024-09-14T02:40:56.833221+0000 mgr.a (mgr.14355) 11245 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:57 smithi171 bash[25040]: cluster 2024-09-14T02:40:56.833221+0000 mgr.a (mgr.14355) 11245 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:40:58.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:40:58.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:40:58.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:40:59.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:40:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:40:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:40:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:40:59.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:59 smithi007 bash[22722]: audit 2024-09-14T02:40:58.708943+0000 mgr.a (mgr.14355) 11246 : audit [DBG] from='client.246894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:40:59 smithi007 bash[22722]: cluster 2024-09-14T02:40:58.842579+0000 mgr.a (mgr.14355) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:59 smithi131 bash[24745]: audit 2024-09-14T02:40:58.708943+0000 mgr.a (mgr.14355) 11246 : audit [DBG] from='client.246894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:40:59 smithi131 bash[24745]: cluster 2024-09-14T02:40:58.842579+0000 mgr.a (mgr.14355) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:59 smithi171 bash[25040]: audit 2024-09-14T02:40:58.708943+0000 mgr.a (mgr.14355) 11246 : audit [DBG] from='client.246894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:40:59 smithi171 bash[25040]: cluster 2024-09-14T02:40:58.842579+0000 mgr.a (mgr.14355) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:01.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:00 smithi007 bash[22722]: audit 2024-09-14T02:41:00.452607+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:41:01.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:00 smithi131 bash[24745]: audit 2024-09-14T02:41:00.452607+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:41:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:00 smithi171 bash[25040]: audit 2024-09-14T02:41:00.452607+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:41:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:41:02 smithi007 bash[22972]: debug 2024-09-14T02:41:02.039+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:41:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:41:02 smithi007 bash[22972]: debug 2024-09-14T02:41:02.043+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:41:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: cluster 2024-09-14T02:41:00.844856+0000 mgr.a (mgr.14355) 11248 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: audit 2024-09-14T02:41:01.290339+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:41:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: audit 2024-09-14T02:41:01.291563+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:41:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: audit 2024-09-14T02:41:01.300110+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:41:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: audit 2024-09-14T02:41:01.304997+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:01 smithi007 bash[22722]: audit 2024-09-14T02:41:01.307327+0000 mgr.a (mgr.14355) 11249 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: cluster 2024-09-14T02:41:00.844856+0000 mgr.a (mgr.14355) 11248 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: audit 2024-09-14T02:41:01.290339+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: audit 2024-09-14T02:41:01.291563+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: audit 2024-09-14T02:41:01.300110+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: audit 2024-09-14T02:41:01.304997+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:01 smithi131 bash[24745]: audit 2024-09-14T02:41:01.307327+0000 mgr.a (mgr.14355) 11249 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: cluster 2024-09-14T02:41:00.844856+0000 mgr.a (mgr.14355) 11248 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: audit 2024-09-14T02:41:01.290339+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: audit 2024-09-14T02:41:01.291563+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: audit 2024-09-14T02:41:01.300110+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: audit 2024-09-14T02:41:01.304997+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:01 smithi171 bash[25040]: audit 2024-09-14T02:41:01.307327+0000 mgr.a (mgr.14355) 11249 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:41:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:02 smithi131 bash[24745]: audit 2024-09-14T02:41:02.046207+0000 mgr.a (mgr.14355) 11250 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:41:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:02 smithi131 bash[24745]: cephadm 2024-09-14T02:41:02.047550+0000 mgr.a (mgr.14355) 11251 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:41:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:02 smithi171 bash[25040]: audit 2024-09-14T02:41:02.046207+0000 mgr.a (mgr.14355) 11250 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:41:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:02 smithi171 bash[25040]: cephadm 2024-09-14T02:41:02.047550+0000 mgr.a (mgr.14355) 11251 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:41:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:02 smithi007 bash[22722]: audit 2024-09-14T02:41:02.046207+0000 mgr.a (mgr.14355) 11250 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:41:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:02 smithi007 bash[22722]: cephadm 2024-09-14T02:41:02.047550+0000 mgr.a (mgr.14355) 11251 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:41:04.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:04.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:04.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:04.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:03 smithi131 bash[24745]: cluster 2024-09-14T02:41:02.845786+0000 mgr.a (mgr.14355) 11252 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:03 smithi171 bash[25040]: cluster 2024-09-14T02:41:02.845786+0000 mgr.a (mgr.14355) 11252 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:03 smithi007 bash[22722]: cluster 2024-09-14T02:41:02.845786+0000 mgr.a (mgr.14355) 11252 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:04.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:05.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:04 smithi131 bash[24745]: audit 2024-09-14T02:41:04.470043+0000 mgr.a (mgr.14355) 11253 : audit [DBG] from='client.247080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:04 smithi171 bash[25040]: audit 2024-09-14T02:41:04.470043+0000 mgr.a (mgr.14355) 11253 : audit [DBG] from='client.247080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:04 smithi007 bash[22722]: audit 2024-09-14T02:41:04.470043+0000 mgr.a (mgr.14355) 11253 : audit [DBG] from='client.247080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:05 smithi131 bash[24745]: cluster 2024-09-14T02:41:04.846352+0000 mgr.a (mgr.14355) 11254 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:05 smithi171 bash[25040]: cluster 2024-09-14T02:41:04.846352+0000 mgr.a (mgr.14355) 11254 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:05 smithi007 bash[22722]: cluster 2024-09-14T02:41:04.846352+0000 mgr.a (mgr.14355) 11254 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:07 smithi131 bash[24745]: cluster 2024-09-14T02:41:06.848577+0000 mgr.a (mgr.14355) 11255 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:07 smithi171 bash[25040]: cluster 2024-09-14T02:41:06.848577+0000 mgr.a (mgr.14355) 11255 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:07 smithi007 bash[22722]: cluster 2024-09-14T02:41:06.848577+0000 mgr.a (mgr.14355) 11255 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:09.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:09.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:10.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:09 smithi131 bash[24745]: cluster 2024-09-14T02:41:08.849338+0000 mgr.a (mgr.14355) 11256 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:09 smithi171 bash[25040]: cluster 2024-09-14T02:41:08.849338+0000 mgr.a (mgr.14355) 11256 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:10.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:09 smithi007 bash[22722]: cluster 2024-09-14T02:41:08.849338+0000 mgr.a (mgr.14355) 11256 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:10.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:10.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:11.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:10 smithi131 bash[24745]: audit 2024-09-14T02:41:10.240146+0000 mgr.a (mgr.14355) 11257 : audit [DBG] from='client.247155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:10 smithi171 bash[25040]: audit 2024-09-14T02:41:10.240146+0000 mgr.a (mgr.14355) 11257 : audit [DBG] from='client.247155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:10 smithi007 bash[22722]: audit 2024-09-14T02:41:10.240146+0000 mgr.a (mgr.14355) 11257 : audit [DBG] from='client.247155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:12.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:11 smithi131 bash[24745]: cluster 2024-09-14T02:41:10.852167+0000 mgr.a (mgr.14355) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:11 smithi171 bash[25040]: cluster 2024-09-14T02:41:10.852167+0000 mgr.a (mgr.14355) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:11 smithi007 bash[22722]: cluster 2024-09-14T02:41:10.852167+0000 mgr.a (mgr.14355) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:13 smithi131 bash[24745]: cluster 2024-09-14T02:41:12.852959+0000 mgr.a (mgr.14355) 11259 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:13 smithi171 bash[25040]: cluster 2024-09-14T02:41:12.852959+0000 mgr.a (mgr.14355) 11259 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:13 smithi007 bash[22722]: cluster 2024-09-14T02:41:12.852959+0000 mgr.a (mgr.14355) 11259 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:15.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:15.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:15 smithi131 bash[24745]: cluster 2024-09-14T02:41:14.853734+0000 mgr.a (mgr.14355) 11260 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:15 smithi171 bash[25040]: cluster 2024-09-14T02:41:14.853734+0000 mgr.a (mgr.14355) 11260 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:16.428 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:16.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:15 smithi007 bash[22722]: cluster 2024-09-14T02:41:14.853734+0000 mgr.a (mgr.14355) 11260 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:41:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:17 smithi131 bash[24745]: audit 2024-09-14T02:41:15.987372+0000 mgr.a (mgr.14355) 11261 : audit [DBG] from='client.247227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:17 smithi171 bash[25040]: audit 2024-09-14T02:41:15.987372+0000 mgr.a (mgr.14355) 11261 : audit [DBG] from='client.247227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:17 smithi007 bash[22722]: audit 2024-09-14T02:41:15.987372+0000 mgr.a (mgr.14355) 11261 : audit [DBG] from='client.247227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:18 smithi131 bash[24745]: cluster 2024-09-14T02:41:16.856566+0000 mgr.a (mgr.14355) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:18 smithi171 bash[25040]: cluster 2024-09-14T02:41:16.856566+0000 mgr.a (mgr.14355) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:18 smithi007 bash[22722]: cluster 2024-09-14T02:41:16.856566+0000 mgr.a (mgr.14355) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:41:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:20 smithi131 bash[24745]: cluster 2024-09-14T02:41:18.857407+0000 mgr.a (mgr.14355) 11263 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:20 smithi171 bash[25040]: cluster 2024-09-14T02:41:18.857407+0000 mgr.a (mgr.14355) 11263 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:20 smithi007 bash[22722]: cluster 2024-09-14T02:41:18.857407+0000 mgr.a (mgr.14355) 11263 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:21.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:21.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:22.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:22.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:22.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:22 smithi131 bash[24745]: cluster 2024-09-14T02:41:20.859393+0000 mgr.a (mgr.14355) 11264 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:22 smithi171 bash[25040]: cluster 2024-09-14T02:41:20.859393+0000 mgr.a (mgr.14355) 11264 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:22 smithi007 bash[22722]: cluster 2024-09-14T02:41:20.859393+0000 mgr.a (mgr.14355) 11264 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:23.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:23 smithi131 bash[24745]: audit 2024-09-14T02:41:21.758049+0000 mgr.a (mgr.14355) 11265 : audit [DBG] from='client.247302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:23 smithi171 bash[25040]: audit 2024-09-14T02:41:21.758049+0000 mgr.a (mgr.14355) 11265 : audit [DBG] from='client.247302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:23 smithi007 bash[22722]: audit 2024-09-14T02:41:21.758049+0000 mgr.a (mgr.14355) 11265 : audit [DBG] from='client.247302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:24 smithi131 bash[24745]: cluster 2024-09-14T02:41:22.860505+0000 mgr.a (mgr.14355) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:24 smithi171 bash[25040]: cluster 2024-09-14T02:41:22.860505+0000 mgr.a (mgr.14355) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:24 smithi007 bash[22722]: cluster 2024-09-14T02:41:22.860505+0000 mgr.a (mgr.14355) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:26 smithi171 bash[25040]: cluster 2024-09-14T02:41:24.861345+0000 mgr.a (mgr.14355) 11267 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:26 smithi007 bash[22722]: cluster 2024-09-14T02:41:24.861345+0000 mgr.a (mgr.14355) 11267 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:26 smithi131 bash[24745]: cluster 2024-09-14T02:41:24.861345+0000 mgr.a (mgr.14355) 11267 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:27.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:27.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:27.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:27.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:27.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:27.929 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:28 smithi171 bash[25040]: cluster 2024-09-14T02:41:26.863582+0000 mgr.a (mgr.14355) 11268 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:28 smithi171 bash[25040]: audit 2024-09-14T02:41:27.509264+0000 mgr.a (mgr.14355) 11269 : audit [DBG] from='client.247380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:28 smithi007 bash[22722]: cluster 2024-09-14T02:41:26.863582+0000 mgr.a (mgr.14355) 11268 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:28 smithi007 bash[22722]: audit 2024-09-14T02:41:27.509264+0000 mgr.a (mgr.14355) 11269 : audit [DBG] from='client.247380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:28 smithi131 bash[24745]: cluster 2024-09-14T02:41:26.863582+0000 mgr.a (mgr.14355) 11268 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:28 smithi131 bash[24745]: audit 2024-09-14T02:41:27.509264+0000 mgr.a (mgr.14355) 11269 : audit [DBG] from='client.247380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:30 smithi007 bash[22722]: cluster 2024-09-14T02:41:28.864473+0000 mgr.a (mgr.14355) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:30 smithi131 bash[24745]: cluster 2024-09-14T02:41:28.864473+0000 mgr.a (mgr.14355) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:30 smithi171 bash[25040]: cluster 2024-09-14T02:41:28.864473+0000 mgr.a (mgr.14355) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:32 smithi007 bash[22722]: cluster 2024-09-14T02:41:30.866681+0000 mgr.a (mgr.14355) 11271 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:32 smithi131 bash[24745]: cluster 2024-09-14T02:41:30.866681+0000 mgr.a (mgr.14355) 11271 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:32 smithi171 bash[25040]: cluster 2024-09-14T02:41:30.866681+0000 mgr.a (mgr.14355) 11271 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:33.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:33.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:33.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:33.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:33.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:34 smithi007 bash[22722]: cluster 2024-09-14T02:41:32.867440+0000 mgr.a (mgr.14355) 11272 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:34 smithi007 bash[22722]: audit 2024-09-14T02:41:33.264178+0000 mgr.a (mgr.14355) 11273 : audit [DBG] from='client.247455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:34 smithi131 bash[24745]: cluster 2024-09-14T02:41:32.867440+0000 mgr.a (mgr.14355) 11272 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:34 smithi131 bash[24745]: audit 2024-09-14T02:41:33.264178+0000 mgr.a (mgr.14355) 11273 : audit [DBG] from='client.247455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:34 smithi171 bash[25040]: cluster 2024-09-14T02:41:32.867440+0000 mgr.a (mgr.14355) 11272 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:34 smithi171 bash[25040]: audit 2024-09-14T02:41:33.264178+0000 mgr.a (mgr.14355) 11273 : audit [DBG] from='client.247455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:36 smithi007 bash[22722]: cluster 2024-09-14T02:41:34.868496+0000 mgr.a (mgr.14355) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:36 smithi131 bash[24745]: cluster 2024-09-14T02:41:34.868496+0000 mgr.a (mgr.14355) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:36 smithi171 bash[25040]: cluster 2024-09-14T02:41:34.868496+0000 mgr.a (mgr.14355) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:38 smithi007 bash[22722]: cluster 2024-09-14T02:41:36.870942+0000 mgr.a (mgr.14355) 11275 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:38 smithi131 bash[24745]: cluster 2024-09-14T02:41:36.870942+0000 mgr.a (mgr.14355) 11275 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:38 smithi171 bash[25040]: cluster 2024-09-14T02:41:36.870942+0000 mgr.a (mgr.14355) 11275 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:39.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:39.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:40 smithi007 bash[22722]: cluster 2024-09-14T02:41:38.871531+0000 mgr.a (mgr.14355) 11276 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:40 smithi007 bash[22722]: audit 2024-09-14T02:41:39.030975+0000 mgr.a (mgr.14355) 11277 : audit [DBG] from='client.247527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:40 smithi131 bash[24745]: cluster 2024-09-14T02:41:38.871531+0000 mgr.a (mgr.14355) 11276 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:40 smithi131 bash[24745]: audit 2024-09-14T02:41:39.030975+0000 mgr.a (mgr.14355) 11277 : audit [DBG] from='client.247527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:40 smithi171 bash[25040]: cluster 2024-09-14T02:41:38.871531+0000 mgr.a (mgr.14355) 11276 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:40 smithi171 bash[25040]: audit 2024-09-14T02:41:39.030975+0000 mgr.a (mgr.14355) 11277 : audit [DBG] from='client.247527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:42 smithi007 bash[22722]: cluster 2024-09-14T02:41:40.873756+0000 mgr.a (mgr.14355) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:42 smithi131 bash[24745]: cluster 2024-09-14T02:41:40.873756+0000 mgr.a (mgr.14355) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:42 smithi171 bash[25040]: cluster 2024-09-14T02:41:40.873756+0000 mgr.a (mgr.14355) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:44 smithi007 bash[22722]: cluster 2024-09-14T02:41:42.874599+0000 mgr.a (mgr.14355) 11279 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:44.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:44.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:44.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:44 smithi131 bash[24745]: cluster 2024-09-14T02:41:42.874599+0000 mgr.a (mgr.14355) 11279 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:44 smithi171 bash[25040]: cluster 2024-09-14T02:41:42.874599+0000 mgr.a (mgr.14355) 11279 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:45.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:45.231 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:46 smithi007 bash[22722]: audit 2024-09-14T02:41:44.800823+0000 mgr.a (mgr.14355) 11280 : audit [DBG] from='client.247605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:46 smithi007 bash[22722]: cluster 2024-09-14T02:41:44.875347+0000 mgr.a (mgr.14355) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:46 smithi131 bash[24745]: audit 2024-09-14T02:41:44.800823+0000 mgr.a (mgr.14355) 11280 : audit [DBG] from='client.247605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:46 smithi131 bash[24745]: cluster 2024-09-14T02:41:44.875347+0000 mgr.a (mgr.14355) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:46 smithi171 bash[25040]: audit 2024-09-14T02:41:44.800823+0000 mgr.a (mgr.14355) 11280 : audit [DBG] from='client.247605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:46 smithi171 bash[25040]: cluster 2024-09-14T02:41:44.875347+0000 mgr.a (mgr.14355) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:48 smithi007 bash[22722]: cluster 2024-09-14T02:41:46.877724+0000 mgr.a (mgr.14355) 11282 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:48 smithi131 bash[24745]: cluster 2024-09-14T02:41:46.877724+0000 mgr.a (mgr.14355) 11282 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:48 smithi171 bash[25040]: cluster 2024-09-14T02:41:46.877724+0000 mgr.a (mgr.14355) 11282 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:41:50.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:50.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:50.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:50 smithi007 bash[22722]: cluster 2024-09-14T02:41:48.878554+0000 mgr.a (mgr.14355) 11283 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:50 smithi131 bash[24745]: cluster 2024-09-14T02:41:48.878554+0000 mgr.a (mgr.14355) 11283 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:50 smithi171 bash[25040]: cluster 2024-09-14T02:41:48.878554+0000 mgr.a (mgr.14355) 11283 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:51.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:51.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:51 smithi007 bash[22722]: audit 2024-09-14T02:41:50.567766+0000 mgr.a (mgr.14355) 11284 : audit [DBG] from='client.247680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:51.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:51 smithi131 bash[24745]: audit 2024-09-14T02:41:50.567766+0000 mgr.a (mgr.14355) 11284 : audit [DBG] from='client.247680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:51 smithi171 bash[25040]: audit 2024-09-14T02:41:50.567766+0000 mgr.a (mgr.14355) 11284 : audit [DBG] from='client.247680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:52 smithi007 bash[22722]: cluster 2024-09-14T02:41:50.880163+0000 mgr.a (mgr.14355) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:52 smithi131 bash[24745]: cluster 2024-09-14T02:41:50.880163+0000 mgr.a (mgr.14355) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:52 smithi171 bash[25040]: cluster 2024-09-14T02:41:50.880163+0000 mgr.a (mgr.14355) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:54 smithi007 bash[22722]: cluster 2024-09-14T02:41:52.881040+0000 mgr.a (mgr.14355) 11286 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:54 smithi131 bash[24745]: cluster 2024-09-14T02:41:52.881040+0000 mgr.a (mgr.14355) 11286 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:54 smithi171 bash[25040]: cluster 2024-09-14T02:41:52.881040+0000 mgr.a (mgr.14355) 11286 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:41:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:41:56.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:41:56.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:41:56.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:56 smithi007 bash[22722]: cluster 2024-09-14T02:41:54.881863+0000 mgr.a (mgr.14355) 11287 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:41:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:56 smithi131 bash[24745]: cluster 2024-09-14T02:41:54.881863+0000 mgr.a (mgr.14355) 11287 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:41:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:56 smithi171 bash[25040]: cluster 2024-09-14T02:41:54.881863+0000 mgr.a (mgr.14355) 11287 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:41:56.771 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:41:56.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:41:56.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:41:56.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:41:56.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:41:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:57 smithi007 bash[22722]: audit 2024-09-14T02:41:56.349411+0000 mgr.a (mgr.14355) 11288 : audit [DBG] from='client.247755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:57 smithi131 bash[24745]: audit 2024-09-14T02:41:56.349411+0000 mgr.a (mgr.14355) 11288 : audit [DBG] from='client.247755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:57 smithi171 bash[25040]: audit 2024-09-14T02:41:56.349411+0000 mgr.a (mgr.14355) 11288 : audit [DBG] from='client.247755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:41:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:41:58 smithi007 bash[22722]: cluster 2024-09-14T02:41:56.884640+0000 mgr.a (mgr.14355) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:41:58 smithi131 bash[24745]: cluster 2024-09-14T02:41:56.884640+0000 mgr.a (mgr.14355) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:41:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:41:58 smithi171 bash[25040]: cluster 2024-09-14T02:41:56.884640+0000 mgr.a (mgr.14355) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:00 smithi007 bash[22722]: cluster 2024-09-14T02:41:58.885425+0000 mgr.a (mgr.14355) 11290 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:00 smithi131 bash[24745]: cluster 2024-09-14T02:41:58.885425+0000 mgr.a (mgr.14355) 11290 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:00 smithi171 bash[25040]: cluster 2024-09-14T02:41:58.885425+0000 mgr.a (mgr.14355) 11290 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:01.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:01.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:01.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:02 smithi007 bash[22722]: cluster 2024-09-14T02:42:00.887609+0000 mgr.a (mgr.14355) 11291 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:02 smithi007 bash[22722]: audit 2024-09-14T02:42:02.096410+0000 mon.a (mon.0) 2280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:42:02.531 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:02 smithi131 bash[24745]: cluster 2024-09-14T02:42:00.887609+0000 mgr.a (mgr.14355) 11291 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:02 smithi131 bash[24745]: audit 2024-09-14T02:42:02.096410+0000 mon.a (mon.0) 2280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:42:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:02 smithi171 bash[25040]: cluster 2024-09-14T02:42:00.887609+0000 mgr.a (mgr.14355) 11291 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:02 smithi171 bash[25040]: audit 2024-09-14T02:42:02.096410+0000 mon.a (mon.0) 2280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:42:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22722]: audit 2024-09-14T02:42:02.103827+0000 mgr.a (mgr.14355) 11292 : audit [DBG] from='client.247830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22722]: audit 2024-09-14T02:42:02.945669+0000 mon.a (mon.0) 2281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:42:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22722]: audit 2024-09-14T02:42:02.947553+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:42:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22722]: audit 2024-09-14T02:42:02.958163+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:42:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22722]: audit 2024-09-14T02:42:02.963403+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:03 smithi131 bash[24745]: audit 2024-09-14T02:42:02.103827+0000 mgr.a (mgr.14355) 11292 : audit [DBG] from='client.247830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:03 smithi131 bash[24745]: audit 2024-09-14T02:42:02.945669+0000 mon.a (mon.0) 2281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:03 smithi131 bash[24745]: audit 2024-09-14T02:42:02.947553+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:03 smithi131 bash[24745]: audit 2024-09-14T02:42:02.958163+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:42:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:03 smithi131 bash[24745]: audit 2024-09-14T02:42:02.963403+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:03 smithi171 bash[25040]: audit 2024-09-14T02:42:02.103827+0000 mgr.a (mgr.14355) 11292 : audit [DBG] from='client.247830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:03 smithi171 bash[25040]: audit 2024-09-14T02:42:02.945669+0000 mon.a (mon.0) 2281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:03 smithi171 bash[25040]: audit 2024-09-14T02:42:02.947553+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:03 smithi171 bash[25040]: audit 2024-09-14T02:42:02.958163+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:42:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:03 smithi171 bash[25040]: audit 2024-09-14T02:42:02.963403+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:04.134 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22972]: debug 2024-09-14T02:42:03.702+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:42:04.134 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:42:03 smithi007 bash[22972]: debug 2024-09-14T02:42:03.702+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:42:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:04 smithi007 bash[22722]: cluster 2024-09-14T02:42:02.888519+0000 mgr.a (mgr.14355) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:04 smithi007 bash[22722]: audit 2024-09-14T02:42:02.966175+0000 mgr.a (mgr.14355) 11294 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:04 smithi131 bash[24745]: cluster 2024-09-14T02:42:02.888519+0000 mgr.a (mgr.14355) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:04 smithi131 bash[24745]: audit 2024-09-14T02:42:02.966175+0000 mgr.a (mgr.14355) 11294 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:04 smithi171 bash[25040]: cluster 2024-09-14T02:42:02.888519+0000 mgr.a (mgr.14355) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:04 smithi171 bash[25040]: audit 2024-09-14T02:42:02.966175+0000 mgr.a (mgr.14355) 11294 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:42:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:05 smithi007 bash[22722]: audit 2024-09-14T02:42:03.708553+0000 mgr.a (mgr.14355) 11295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:42:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:05 smithi007 bash[22722]: cephadm 2024-09-14T02:42:03.709974+0000 mgr.a (mgr.14355) 11296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:42:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:05 smithi131 bash[24745]: audit 2024-09-14T02:42:03.708553+0000 mgr.a (mgr.14355) 11295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:42:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:05 smithi131 bash[24745]: cephadm 2024-09-14T02:42:03.709974+0000 mgr.a (mgr.14355) 11296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:42:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:05 smithi171 bash[25040]: audit 2024-09-14T02:42:03.708553+0000 mgr.a (mgr.14355) 11295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:42:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:05 smithi171 bash[25040]: cephadm 2024-09-14T02:42:03.709974+0000 mgr.a (mgr.14355) 11296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:42:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:06 smithi007 bash[22722]: cluster 2024-09-14T02:42:04.889422+0000 mgr.a (mgr.14355) 11297 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:06 smithi131 bash[24745]: cluster 2024-09-14T02:42:04.889422+0000 mgr.a (mgr.14355) 11297 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:06 smithi171 bash[25040]: cluster 2024-09-14T02:42:04.889422+0000 mgr.a (mgr.14355) 11297 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:42:07.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:07.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:08.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:08.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:08.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:08.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:08.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:08 smithi007 bash[22722]: cluster 2024-09-14T02:42:06.891687+0000 mgr.a (mgr.14355) 11298 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:08 smithi131 bash[24745]: cluster 2024-09-14T02:42:06.891687+0000 mgr.a (mgr.14355) 11298 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:08 smithi171 bash[25040]: cluster 2024-09-14T02:42:06.891687+0000 mgr.a (mgr.14355) 11298 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:09 smithi007 bash[22722]: audit 2024-09-14T02:42:07.861418+0000 mgr.a (mgr.14355) 11299 : audit [DBG] from='client.248013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:09 smithi131 bash[24745]: audit 2024-09-14T02:42:07.861418+0000 mgr.a (mgr.14355) 11299 : audit [DBG] from='client.248013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:09 smithi171 bash[25040]: audit 2024-09-14T02:42:07.861418+0000 mgr.a (mgr.14355) 11299 : audit [DBG] from='client.248013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:10 smithi007 bash[22722]: cluster 2024-09-14T02:42:08.892598+0000 mgr.a (mgr.14355) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T02:42:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:10 smithi131 bash[24745]: cluster 2024-09-14T02:42:08.892598+0000 mgr.a (mgr.14355) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T02:42:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:10 smithi171 bash[25040]: cluster 2024-09-14T02:42:08.892598+0000 mgr.a (mgr.14355) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T02:42:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:12 smithi007 bash[22722]: cluster 2024-09-14T02:42:10.894844+0000 mgr.a (mgr.14355) 11301 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:12 smithi131 bash[24745]: cluster 2024-09-14T02:42:10.894844+0000 mgr.a (mgr.14355) 11301 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:12 smithi171 bash[25040]: cluster 2024-09-14T02:42:10.894844+0000 mgr.a (mgr.14355) 11301 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T02:42:13.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:13.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:13.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:14.077 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:14.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:14 smithi007 bash[22722]: cluster 2024-09-14T02:42:12.895744+0000 mgr.a (mgr.14355) 11302 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:14 smithi007 bash[22722]: audit 2024-09-14T02:42:13.634247+0000 mgr.a (mgr.14355) 11303 : audit [DBG] from='client.248088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:14 smithi131 bash[24745]: cluster 2024-09-14T02:42:12.895744+0000 mgr.a (mgr.14355) 11302 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:14 smithi131 bash[24745]: audit 2024-09-14T02:42:13.634247+0000 mgr.a (mgr.14355) 11303 : audit [DBG] from='client.248088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:14 smithi171 bash[25040]: cluster 2024-09-14T02:42:12.895744+0000 mgr.a (mgr.14355) 11302 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:14 smithi171 bash[25040]: audit 2024-09-14T02:42:13.634247+0000 mgr.a (mgr.14355) 11303 : audit [DBG] from='client.248088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:16 smithi007 bash[22722]: cluster 2024-09-14T02:42:14.896669+0000 mgr.a (mgr.14355) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:16 smithi131 bash[24745]: cluster 2024-09-14T02:42:14.896669+0000 mgr.a (mgr.14355) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:16 smithi171 bash[25040]: cluster 2024-09-14T02:42:14.896669+0000 mgr.a (mgr.14355) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:42:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:18 smithi007 bash[22722]: cluster 2024-09-14T02:42:16.898997+0000 mgr.a (mgr.14355) 11305 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-14T02:42:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:18 smithi131 bash[24745]: cluster 2024-09-14T02:42:16.898997+0000 mgr.a (mgr.14355) 11305 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-14T02:42:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:18 smithi171 bash[25040]: cluster 2024-09-14T02:42:16.898997+0000 mgr.a (mgr.14355) 11305 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-09-14T02:42:19.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:19.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:19.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:19.865 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:20 smithi007 bash[22722]: cluster 2024-09-14T02:42:18.899757+0000 mgr.a (mgr.14355) 11306 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:20 smithi007 bash[22722]: audit 2024-09-14T02:42:19.413899+0000 mgr.a (mgr.14355) 11307 : audit [DBG] from='client.248166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:20 smithi131 bash[24745]: cluster 2024-09-14T02:42:18.899757+0000 mgr.a (mgr.14355) 11306 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:20 smithi131 bash[24745]: audit 2024-09-14T02:42:19.413899+0000 mgr.a (mgr.14355) 11307 : audit [DBG] from='client.248166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:20 smithi171 bash[25040]: cluster 2024-09-14T02:42:18.899757+0000 mgr.a (mgr.14355) 11306 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:20 smithi171 bash[25040]: audit 2024-09-14T02:42:19.413899+0000 mgr.a (mgr.14355) 11307 : audit [DBG] from='client.248166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:22 smithi007 bash[22722]: cluster 2024-09-14T02:42:20.902092+0000 mgr.a (mgr.14355) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T02:42:22.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:22 smithi131 bash[24745]: cluster 2024-09-14T02:42:20.902092+0000 mgr.a (mgr.14355) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T02:42:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:22 smithi171 bash[25040]: cluster 2024-09-14T02:42:20.902092+0000 mgr.a (mgr.14355) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T02:42:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:24 smithi007 bash[22722]: cluster 2024-09-14T02:42:22.902882+0000 mgr.a (mgr.14355) 11309 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:24 smithi131 bash[24745]: cluster 2024-09-14T02:42:22.902882+0000 mgr.a (mgr.14355) 11309 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:24 smithi171 bash[25040]: cluster 2024-09-14T02:42:22.902882+0000 mgr.a (mgr.14355) 11309 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:24.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:24.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:25.611 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:25.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:25.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:25.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:25.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:26 smithi007 bash[22722]: cluster 2024-09-14T02:42:24.903505+0000 mgr.a (mgr.14355) 11310 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:26 smithi007 bash[22722]: audit 2024-09-14T02:42:25.201122+0000 mgr.a (mgr.14355) 11311 : audit [DBG] from='client.248244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:26 smithi131 bash[24745]: cluster 2024-09-14T02:42:24.903505+0000 mgr.a (mgr.14355) 11310 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:26 smithi131 bash[24745]: audit 2024-09-14T02:42:25.201122+0000 mgr.a (mgr.14355) 11311 : audit [DBG] from='client.248244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:26 smithi171 bash[25040]: cluster 2024-09-14T02:42:24.903505+0000 mgr.a (mgr.14355) 11310 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:26 smithi171 bash[25040]: audit 2024-09-14T02:42:25.201122+0000 mgr.a (mgr.14355) 11311 : audit [DBG] from='client.248244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:28 smithi007 bash[22722]: cluster 2024-09-14T02:42:26.906187+0000 mgr.a (mgr.14355) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:28 smithi131 bash[24745]: cluster 2024-09-14T02:42:26.906187+0000 mgr.a (mgr.14355) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:28 smithi171 bash[25040]: cluster 2024-09-14T02:42:26.906187+0000 mgr.a (mgr.14355) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:42:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:30 smithi007 bash[22722]: cluster 2024-09-14T02:42:28.906955+0000 mgr.a (mgr.14355) 11313 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:30 smithi131 bash[24745]: cluster 2024-09-14T02:42:28.906955+0000 mgr.a (mgr.14355) 11313 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:30 smithi171 bash[25040]: cluster 2024-09-14T02:42:28.906955+0000 mgr.a (mgr.14355) 11313 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:30.613 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:30.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:31.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:31.363 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:32 smithi131 bash[24745]: cluster 2024-09-14T02:42:30.908880+0000 mgr.a (mgr.14355) 11314 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:32 smithi131 bash[24745]: audit 2024-09-14T02:42:30.941922+0000 mgr.a (mgr.14355) 11315 : audit [DBG] from='client.248319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:32 smithi171 bash[25040]: cluster 2024-09-14T02:42:30.908880+0000 mgr.a (mgr.14355) 11314 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:32 smithi171 bash[25040]: audit 2024-09-14T02:42:30.941922+0000 mgr.a (mgr.14355) 11315 : audit [DBG] from='client.248319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:32 smithi007 bash[22722]: cluster 2024-09-14T02:42:30.908880+0000 mgr.a (mgr.14355) 11314 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:32 smithi007 bash[22722]: audit 2024-09-14T02:42:30.941922+0000 mgr.a (mgr.14355) 11315 : audit [DBG] from='client.248319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:34 smithi131 bash[24745]: cluster 2024-09-14T02:42:32.909791+0000 mgr.a (mgr.14355) 11316 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:34 smithi171 bash[25040]: cluster 2024-09-14T02:42:32.909791+0000 mgr.a (mgr.14355) 11316 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:34 smithi007 bash[22722]: cluster 2024-09-14T02:42:32.909791+0000 mgr.a (mgr.14355) 11316 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:42:36.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:36.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:36.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:36 smithi131 bash[24745]: cluster 2024-09-14T02:42:34.910540+0000 mgr.a (mgr.14355) 11317 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:42:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:36 smithi171 bash[25040]: cluster 2024-09-14T02:42:34.910540+0000 mgr.a (mgr.14355) 11317 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:42:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:36 smithi007 bash[22722]: cluster 2024-09-14T02:42:34.910540+0000 mgr.a (mgr.14355) 11317 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:42:37.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:37.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:38 smithi131 bash[24745]: audit 2024-09-14T02:42:36.703125+0000 mgr.a (mgr.14355) 11318 : audit [DBG] from='client.248394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:38 smithi131 bash[24745]: cluster 2024-09-14T02:42:36.911843+0000 mgr.a (mgr.14355) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:38 smithi171 bash[25040]: audit 2024-09-14T02:42:36.703125+0000 mgr.a (mgr.14355) 11318 : audit [DBG] from='client.248394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:38 smithi171 bash[25040]: cluster 2024-09-14T02:42:36.911843+0000 mgr.a (mgr.14355) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:38 smithi007 bash[22722]: audit 2024-09-14T02:42:36.703125+0000 mgr.a (mgr.14355) 11318 : audit [DBG] from='client.248394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:38 smithi007 bash[22722]: cluster 2024-09-14T02:42:36.911843+0000 mgr.a (mgr.14355) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:40 smithi007 bash[22722]: cluster 2024-09-14T02:42:38.912698+0000 mgr.a (mgr.14355) 11320 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:40 smithi131 bash[24745]: cluster 2024-09-14T02:42:38.912698+0000 mgr.a (mgr.14355) 11320 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:40 smithi171 bash[25040]: cluster 2024-09-14T02:42:38.912698+0000 mgr.a (mgr.14355) 11320 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:42.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:42.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:42 smithi007 bash[22722]: cluster 2024-09-14T02:42:40.914965+0000 mgr.a (mgr.14355) 11321 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:42 smithi131 bash[24745]: cluster 2024-09-14T02:42:40.914965+0000 mgr.a (mgr.14355) 11321 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:42 smithi171 bash[25040]: cluster 2024-09-14T02:42:40.914965+0000 mgr.a (mgr.14355) 11321 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:42.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:42.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:43 smithi007 bash[22722]: audit 2024-09-14T02:42:42.465817+0000 mgr.a (mgr.14355) 11322 : audit [DBG] from='client.248472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:43 smithi131 bash[24745]: audit 2024-09-14T02:42:42.465817+0000 mgr.a (mgr.14355) 11322 : audit [DBG] from='client.248472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:43 smithi171 bash[25040]: audit 2024-09-14T02:42:42.465817+0000 mgr.a (mgr.14355) 11322 : audit [DBG] from='client.248472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:44 smithi007 bash[22722]: cluster 2024-09-14T02:42:42.915572+0000 mgr.a (mgr.14355) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:44 smithi131 bash[24745]: cluster 2024-09-14T02:42:42.915572+0000 mgr.a (mgr.14355) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:44 smithi171 bash[25040]: cluster 2024-09-14T02:42:42.915572+0000 mgr.a (mgr.14355) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:46.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:46 smithi131 bash[24745]: cluster 2024-09-14T02:42:44.916324+0000 mgr.a (mgr.14355) 11324 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:46 smithi171 bash[25040]: cluster 2024-09-14T02:42:44.916324+0000 mgr.a (mgr.14355) 11324 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:46 smithi007 bash[22722]: cluster 2024-09-14T02:42:44.916324+0000 mgr.a (mgr.14355) 11324 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:48.656 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:48 smithi131 bash[24745]: cluster 2024-09-14T02:42:46.918700+0000 mgr.a (mgr.14355) 11325 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:48 smithi171 bash[25040]: cluster 2024-09-14T02:42:46.918700+0000 mgr.a (mgr.14355) 11325 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:48 smithi007 bash[22722]: cluster 2024-09-14T02:42:46.918700+0000 mgr.a (mgr.14355) 11325 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:49 smithi131 bash[24745]: audit 2024-09-14T02:42:48.239089+0000 mgr.a (mgr.14355) 11326 : audit [DBG] from='client.248550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:49 smithi171 bash[25040]: audit 2024-09-14T02:42:48.239089+0000 mgr.a (mgr.14355) 11326 : audit [DBG] from='client.248550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:49 smithi007 bash[22722]: audit 2024-09-14T02:42:48.239089+0000 mgr.a (mgr.14355) 11326 : audit [DBG] from='client.248550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:50 smithi131 bash[24745]: cluster 2024-09-14T02:42:48.919589+0000 mgr.a (mgr.14355) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:50 smithi171 bash[25040]: cluster 2024-09-14T02:42:48.919589+0000 mgr.a (mgr.14355) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:50 smithi007 bash[22722]: cluster 2024-09-14T02:42:48.919589+0000 mgr.a (mgr.14355) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:52.782 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:52 smithi131 bash[24745]: cluster 2024-09-14T02:42:50.921777+0000 mgr.a (mgr.14355) 11328 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:52 smithi171 bash[25040]: cluster 2024-09-14T02:42:50.921777+0000 mgr.a (mgr.14355) 11328 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:52 smithi007 bash[22722]: cluster 2024-09-14T02:42:50.921777+0000 mgr.a (mgr.14355) 11328 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:53.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:53.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:53.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:42:54.427 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:42:54.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:42:54.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:42:54.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:42:54.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:42:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:54 smithi131 bash[24745]: cluster 2024-09-14T02:42:52.922543+0000 mgr.a (mgr.14355) 11329 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:54 smithi171 bash[25040]: cluster 2024-09-14T02:42:52.922543+0000 mgr.a (mgr.14355) 11329 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:54 smithi007 bash[22722]: cluster 2024-09-14T02:42:52.922543+0000 mgr.a (mgr.14355) 11329 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:55 smithi131 bash[24745]: audit 2024-09-14T02:42:53.991120+0000 mgr.a (mgr.14355) 11330 : audit [DBG] from='client.248628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:55 smithi171 bash[25040]: audit 2024-09-14T02:42:53.991120+0000 mgr.a (mgr.14355) 11330 : audit [DBG] from='client.248628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:55 smithi007 bash[22722]: audit 2024-09-14T02:42:53.991120+0000 mgr.a (mgr.14355) 11330 : audit [DBG] from='client.248628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:42:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:56 smithi131 bash[24745]: cluster 2024-09-14T02:42:54.923396+0000 mgr.a (mgr.14355) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:56 smithi171 bash[25040]: cluster 2024-09-14T02:42:54.923396+0000 mgr.a (mgr.14355) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:56 smithi007 bash[22722]: cluster 2024-09-14T02:42:54.923396+0000 mgr.a (mgr.14355) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:42:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:42:58 smithi131 bash[24745]: cluster 2024-09-14T02:42:56.925615+0000 mgr.a (mgr.14355) 11332 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:42:58 smithi171 bash[25040]: cluster 2024-09-14T02:42:56.925615+0000 mgr.a (mgr.14355) 11332 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:42:58 smithi007 bash[22722]: cluster 2024-09-14T02:42:56.925615+0000 mgr.a (mgr.14355) 11332 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:42:59.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:42:59.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:42:59.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:00.177 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:00.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:00 smithi131 bash[24745]: cluster 2024-09-14T02:42:58.926389+0000 mgr.a (mgr.14355) 11333 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:00 smithi171 bash[25040]: cluster 2024-09-14T02:42:58.926389+0000 mgr.a (mgr.14355) 11333 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:00 smithi007 bash[22722]: cluster 2024-09-14T02:42:58.926389+0000 mgr.a (mgr.14355) 11333 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:01 smithi131 bash[24745]: audit 2024-09-14T02:42:59.762106+0000 mgr.a (mgr.14355) 11334 : audit [DBG] from='client.248706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:01 smithi171 bash[25040]: audit 2024-09-14T02:42:59.762106+0000 mgr.a (mgr.14355) 11334 : audit [DBG] from='client.248706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:01 smithi007 bash[22722]: audit 2024-09-14T02:42:59.762106+0000 mgr.a (mgr.14355) 11334 : audit [DBG] from='client.248706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:02 smithi131 bash[24745]: cluster 2024-09-14T02:43:00.928726+0000 mgr.a (mgr.14355) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:02 smithi171 bash[25040]: cluster 2024-09-14T02:43:00.928726+0000 mgr.a (mgr.14355) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:02 smithi007 bash[22722]: cluster 2024-09-14T02:43:00.928726+0000 mgr.a (mgr.14355) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:04 smithi131 bash[24745]: cluster 2024-09-14T02:43:02.929485+0000 mgr.a (mgr.14355) 11336 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:04 smithi131 bash[24745]: audit 2024-09-14T02:43:03.762228+0000 mon.a (mon.0) 2285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:43:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:04 smithi171 bash[25040]: cluster 2024-09-14T02:43:02.929485+0000 mgr.a (mgr.14355) 11336 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:04 smithi171 bash[25040]: audit 2024-09-14T02:43:03.762228+0000 mon.a (mon.0) 2285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:43:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:04 smithi007 bash[22722]: cluster 2024-09-14T02:43:02.929485+0000 mgr.a (mgr.14355) 11336 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:04 smithi007 bash[22722]: audit 2024-09-14T02:43:03.762228+0000 mon.a (mon.0) 2285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:43:05.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22972]: debug 2024-09-14T02:43:05.357+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22972]: debug 2024-09-14T02:43:05.357+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22722]: audit 2024-09-14T02:43:04.609358+0000 mon.a (mon.0) 2286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22722]: audit 2024-09-14T02:43:04.611364+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22722]: audit 2024-09-14T02:43:04.620005+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22722]: audit 2024-09-14T02:43:04.624949+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:05 smithi007 bash[22722]: audit 2024-09-14T02:43:04.627271+0000 mgr.a (mgr.14355) 11337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:05 smithi131 bash[24745]: audit 2024-09-14T02:43:04.609358+0000 mon.a (mon.0) 2286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:05 smithi131 bash[24745]: audit 2024-09-14T02:43:04.611364+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:05 smithi131 bash[24745]: audit 2024-09-14T02:43:04.620005+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:05 smithi131 bash[24745]: audit 2024-09-14T02:43:04.624949+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:05 smithi131 bash[24745]: audit 2024-09-14T02:43:04.627271+0000 mgr.a (mgr.14355) 11337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:05 smithi171 bash[25040]: audit 2024-09-14T02:43:04.609358+0000 mon.a (mon.0) 2286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:43:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:05 smithi171 bash[25040]: audit 2024-09-14T02:43:04.611364+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:43:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:05 smithi171 bash[25040]: audit 2024-09-14T02:43:04.620005+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:43:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:05 smithi171 bash[25040]: audit 2024-09-14T02:43:04.624949+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:05 smithi171 bash[25040]: audit 2024-09-14T02:43:04.627271+0000 mgr.a (mgr.14355) 11337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:43:05.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:05.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:06 smithi007 bash[22722]: cluster 2024-09-14T02:43:04.929975+0000 mgr.a (mgr.14355) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:06 smithi007 bash[22722]: audit 2024-09-14T02:43:05.361117+0000 mgr.a (mgr.14355) 11339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:43:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:06 smithi007 bash[22722]: cephadm 2024-09-14T02:43:05.362255+0000 mgr.a (mgr.14355) 11340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:43:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:06 smithi007 bash[22722]: audit 2024-09-14T02:43:05.503226+0000 mgr.a (mgr.14355) 11341 : audit [DBG] from='client.248886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:06 smithi131 bash[24745]: cluster 2024-09-14T02:43:04.929975+0000 mgr.a (mgr.14355) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:06 smithi131 bash[24745]: audit 2024-09-14T02:43:05.361117+0000 mgr.a (mgr.14355) 11339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:43:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:06 smithi131 bash[24745]: cephadm 2024-09-14T02:43:05.362255+0000 mgr.a (mgr.14355) 11340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:43:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:06 smithi131 bash[24745]: audit 2024-09-14T02:43:05.503226+0000 mgr.a (mgr.14355) 11341 : audit [DBG] from='client.248886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:06 smithi171 bash[25040]: cluster 2024-09-14T02:43:04.929975+0000 mgr.a (mgr.14355) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:06 smithi171 bash[25040]: audit 2024-09-14T02:43:05.361117+0000 mgr.a (mgr.14355) 11339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:43:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:06 smithi171 bash[25040]: cephadm 2024-09-14T02:43:05.362255+0000 mgr.a (mgr.14355) 11340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:43:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:06 smithi171 bash[25040]: audit 2024-09-14T02:43:05.503226+0000 mgr.a (mgr.14355) 11341 : audit [DBG] from='client.248886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:08 smithi007 bash[22722]: cluster 2024-09-14T02:43:06.932660+0000 mgr.a (mgr.14355) 11342 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:08 smithi131 bash[24745]: cluster 2024-09-14T02:43:06.932660+0000 mgr.a (mgr.14355) 11342 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:08 smithi171 bash[25040]: cluster 2024-09-14T02:43:06.932660+0000 mgr.a (mgr.14355) 11342 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:10.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:10.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:10 smithi007 bash[22722]: cluster 2024-09-14T02:43:08.933437+0000 mgr.a (mgr.14355) 11343 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:10 smithi131 bash[24745]: cluster 2024-09-14T02:43:08.933437+0000 mgr.a (mgr.14355) 11343 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:10 smithi171 bash[25040]: cluster 2024-09-14T02:43:08.933437+0000 mgr.a (mgr.14355) 11343 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:43:11.690 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:11.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:12 smithi007 bash[22722]: cluster 2024-09-14T02:43:10.934989+0000 mgr.a (mgr.14355) 11344 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:12 smithi007 bash[22722]: audit 2024-09-14T02:43:11.248880+0000 mgr.a (mgr.14355) 11345 : audit [DBG] from='client.248961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:12 smithi131 bash[24745]: cluster 2024-09-14T02:43:10.934989+0000 mgr.a (mgr.14355) 11344 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:12 smithi131 bash[24745]: audit 2024-09-14T02:43:11.248880+0000 mgr.a (mgr.14355) 11345 : audit [DBG] from='client.248961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:12 smithi171 bash[25040]: cluster 2024-09-14T02:43:10.934989+0000 mgr.a (mgr.14355) 11344 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:12 smithi171 bash[25040]: audit 2024-09-14T02:43:11.248880+0000 mgr.a (mgr.14355) 11345 : audit [DBG] from='client.248961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:14 smithi007 bash[22722]: cluster 2024-09-14T02:43:12.935959+0000 mgr.a (mgr.14355) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:14 smithi131 bash[24745]: cluster 2024-09-14T02:43:12.935959+0000 mgr.a (mgr.14355) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:14 smithi171 bash[25040]: cluster 2024-09-14T02:43:12.935959+0000 mgr.a (mgr.14355) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:16.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:16.693 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:16 smithi007 bash[22722]: cluster 2024-09-14T02:43:14.936789+0000 mgr.a (mgr.14355) 11347 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:16 smithi131 bash[24745]: cluster 2024-09-14T02:43:14.936789+0000 mgr.a (mgr.14355) 11347 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:16 smithi171 bash[25040]: cluster 2024-09-14T02:43:14.936789+0000 mgr.a (mgr.14355) 11347 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:43:17.475 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:17.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:18 smithi007 bash[22722]: cluster 2024-09-14T02:43:16.939115+0000 mgr.a (mgr.14355) 11348 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:18 smithi007 bash[22722]: audit 2024-09-14T02:43:17.026655+0000 mgr.a (mgr.14355) 11349 : audit [DBG] from='client.249036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:18 smithi131 bash[24745]: cluster 2024-09-14T02:43:16.939115+0000 mgr.a (mgr.14355) 11348 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:18 smithi131 bash[24745]: audit 2024-09-14T02:43:17.026655+0000 mgr.a (mgr.14355) 11349 : audit [DBG] from='client.249036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:18 smithi171 bash[25040]: cluster 2024-09-14T02:43:16.939115+0000 mgr.a (mgr.14355) 11348 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:43:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:18 smithi171 bash[25040]: audit 2024-09-14T02:43:17.026655+0000 mgr.a (mgr.14355) 11349 : audit [DBG] from='client.249036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:20 smithi007 bash[22722]: cluster 2024-09-14T02:43:18.940099+0000 mgr.a (mgr.14355) 11350 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:43:21.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:20 smithi131 bash[24745]: cluster 2024-09-14T02:43:18.940099+0000 mgr.a (mgr.14355) 11350 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:43:21.119 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:20 smithi171 bash[25040]: cluster 2024-09-14T02:43:18.940099+0000 mgr.a (mgr.14355) 11350 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:43:22.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:22.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:22 smithi007 bash[22722]: cluster 2024-09-14T02:43:20.942397+0000 mgr.a (mgr.14355) 11351 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:43:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:22 smithi131 bash[24745]: cluster 2024-09-14T02:43:20.942397+0000 mgr.a (mgr.14355) 11351 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:43:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:22 smithi171 bash[25040]: cluster 2024-09-14T02:43:20.942397+0000 mgr.a (mgr.14355) 11351 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:43:23.224 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:23.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:23.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:24 smithi007 bash[22722]: audit 2024-09-14T02:43:22.803383+0000 mgr.a (mgr.14355) 11352 : audit [DBG] from='client.249114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:24 smithi007 bash[22722]: cluster 2024-09-14T02:43:22.943152+0000 mgr.a (mgr.14355) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:24 smithi131 bash[24745]: audit 2024-09-14T02:43:22.803383+0000 mgr.a (mgr.14355) 11352 : audit [DBG] from='client.249114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:24 smithi131 bash[24745]: cluster 2024-09-14T02:43:22.943152+0000 mgr.a (mgr.14355) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:24 smithi171 bash[25040]: audit 2024-09-14T02:43:22.803383+0000 mgr.a (mgr.14355) 11352 : audit [DBG] from='client.249114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:24 smithi171 bash[25040]: cluster 2024-09-14T02:43:22.943152+0000 mgr.a (mgr.14355) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:26 smithi007 bash[22722]: cluster 2024-09-14T02:43:24.944121+0000 mgr.a (mgr.14355) 11354 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:26 smithi131 bash[24745]: cluster 2024-09-14T02:43:24.944121+0000 mgr.a (mgr.14355) 11354 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:26 smithi171 bash[25040]: cluster 2024-09-14T02:43:24.944121+0000 mgr.a (mgr.14355) 11354 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:28.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:28 smithi007 bash[22722]: cluster 2024-09-14T02:43:26.946437+0000 mgr.a (mgr.14355) 11355 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:29.002 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:29.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:29.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:29.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:29.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:28 smithi131 bash[24745]: cluster 2024-09-14T02:43:26.946437+0000 mgr.a (mgr.14355) 11355 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:28 smithi171 bash[25040]: cluster 2024-09-14T02:43:26.946437+0000 mgr.a (mgr.14355) 11355 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:29 smithi007 bash[22722]: audit 2024-09-14T02:43:28.563906+0000 mgr.a (mgr.14355) 11356 : audit [DBG] from='client.249192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:29 smithi131 bash[24745]: audit 2024-09-14T02:43:28.563906+0000 mgr.a (mgr.14355) 11356 : audit [DBG] from='client.249192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:29 smithi171 bash[25040]: audit 2024-09-14T02:43:28.563906+0000 mgr.a (mgr.14355) 11356 : audit [DBG] from='client.249192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:30 smithi007 bash[22722]: cluster 2024-09-14T02:43:28.946997+0000 mgr.a (mgr.14355) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:30 smithi131 bash[24745]: cluster 2024-09-14T02:43:28.946997+0000 mgr.a (mgr.14355) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:30 smithi171 bash[25040]: cluster 2024-09-14T02:43:28.946997+0000 mgr.a (mgr.14355) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:32 smithi007 bash[22722]: cluster 2024-09-14T02:43:30.949201+0000 mgr.a (mgr.14355) 11358 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:32 smithi131 bash[24745]: cluster 2024-09-14T02:43:30.949201+0000 mgr.a (mgr.14355) 11358 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:32 smithi171 bash[25040]: cluster 2024-09-14T02:43:30.949201+0000 mgr.a (mgr.14355) 11358 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:34.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:34.004 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:34.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:34.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:34.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:34 smithi007 bash[22722]: cluster 2024-09-14T02:43:32.949986+0000 mgr.a (mgr.14355) 11359 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:34 smithi131 bash[24745]: cluster 2024-09-14T02:43:32.949986+0000 mgr.a (mgr.14355) 11359 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:34 smithi171 bash[25040]: cluster 2024-09-14T02:43:32.949986+0000 mgr.a (mgr.14355) 11359 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:35 smithi007 bash[22722]: audit 2024-09-14T02:43:34.333031+0000 mgr.a (mgr.14355) 11360 : audit [DBG] from='client.249267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:35 smithi131 bash[24745]: audit 2024-09-14T02:43:34.333031+0000 mgr.a (mgr.14355) 11360 : audit [DBG] from='client.249267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:35 smithi171 bash[25040]: audit 2024-09-14T02:43:34.333031+0000 mgr.a (mgr.14355) 11360 : audit [DBG] from='client.249267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:36.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:36 smithi007 bash[22722]: cluster 2024-09-14T02:43:34.951075+0000 mgr.a (mgr.14355) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:36 smithi131 bash[24745]: cluster 2024-09-14T02:43:34.951075+0000 mgr.a (mgr.14355) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:36 smithi171 bash[25040]: cluster 2024-09-14T02:43:34.951075+0000 mgr.a (mgr.14355) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:38 smithi007 bash[22722]: cluster 2024-09-14T02:43:36.953509+0000 mgr.a (mgr.14355) 11362 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:38 smithi131 bash[24745]: cluster 2024-09-14T02:43:36.953509+0000 mgr.a (mgr.14355) 11362 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:38 smithi171 bash[25040]: cluster 2024-09-14T02:43:36.953509+0000 mgr.a (mgr.14355) 11362 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:39.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:39.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:39.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:39 smithi131 bash[24745]: cluster 2024-09-14T02:43:38.954487+0000 mgr.a (mgr.14355) 11363 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:39 smithi171 bash[25040]: cluster 2024-09-14T02:43:38.954487+0000 mgr.a (mgr.14355) 11363 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:39 smithi007 bash[22722]: cluster 2024-09-14T02:43:38.954487+0000 mgr.a (mgr.14355) 11363 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:40.510 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:40.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:40.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:40 smithi131 bash[24745]: audit 2024-09-14T02:43:40.077444+0000 mgr.a (mgr.14355) 11364 : audit [DBG] from='client.249342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:40 smithi171 bash[25040]: audit 2024-09-14T02:43:40.077444+0000 mgr.a (mgr.14355) 11364 : audit [DBG] from='client.249342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:40 smithi007 bash[22722]: audit 2024-09-14T02:43:40.077444+0000 mgr.a (mgr.14355) 11364 : audit [DBG] from='client.249342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:41 smithi131 bash[24745]: cluster 2024-09-14T02:43:40.957380+0000 mgr.a (mgr.14355) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:41 smithi171 bash[25040]: cluster 2024-09-14T02:43:40.957380+0000 mgr.a (mgr.14355) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:41 smithi007 bash[22722]: cluster 2024-09-14T02:43:40.957380+0000 mgr.a (mgr.14355) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:44 smithi131 bash[24745]: cluster 2024-09-14T02:43:42.958151+0000 mgr.a (mgr.14355) 11366 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:44 smithi171 bash[25040]: cluster 2024-09-14T02:43:42.958151+0000 mgr.a (mgr.14355) 11366 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:44 smithi007 bash[22722]: cluster 2024-09-14T02:43:42.958151+0000 mgr.a (mgr.14355) 11366 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:45.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:45.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:45.513 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:46.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:46.282 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:46 smithi131 bash[24745]: cluster 2024-09-14T02:43:44.958912+0000 mgr.a (mgr.14355) 11367 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:46 smithi171 bash[25040]: cluster 2024-09-14T02:43:44.958912+0000 mgr.a (mgr.14355) 11367 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:46 smithi007 bash[22722]: cluster 2024-09-14T02:43:44.958912+0000 mgr.a (mgr.14355) 11367 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:47 smithi131 bash[24745]: audit 2024-09-14T02:43:45.838720+0000 mgr.a (mgr.14355) 11368 : audit [DBG] from='client.249414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:47 smithi171 bash[25040]: audit 2024-09-14T02:43:45.838720+0000 mgr.a (mgr.14355) 11368 : audit [DBG] from='client.249414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:47 smithi007 bash[22722]: audit 2024-09-14T02:43:45.838720+0000 mgr.a (mgr.14355) 11368 : audit [DBG] from='client.249414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:48 smithi131 bash[24745]: cluster 2024-09-14T02:43:46.961721+0000 mgr.a (mgr.14355) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:48 smithi171 bash[25040]: cluster 2024-09-14T02:43:46.961721+0000 mgr.a (mgr.14355) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:48 smithi007 bash[22722]: cluster 2024-09-14T02:43:46.961721+0000 mgr.a (mgr.14355) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:50 smithi171 bash[25040]: cluster 2024-09-14T02:43:48.962571+0000 mgr.a (mgr.14355) 11370 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:50 smithi007 bash[22722]: cluster 2024-09-14T02:43:48.962571+0000 mgr.a (mgr.14355) 11370 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:50 smithi131 bash[24745]: cluster 2024-09-14T02:43:48.962571+0000 mgr.a (mgr.14355) 11370 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:43:51.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:51.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:51.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:52.020 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:52.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:52.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:52 smithi171 bash[25040]: cluster 2024-09-14T02:43:50.964443+0000 mgr.a (mgr.14355) 11371 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:52 smithi171 bash[25040]: audit 2024-09-14T02:43:51.588311+0000 mgr.a (mgr.14355) 11372 : audit [DBG] from='client.249492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:52 smithi007 bash[22722]: cluster 2024-09-14T02:43:50.964443+0000 mgr.a (mgr.14355) 11371 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:52 smithi007 bash[22722]: audit 2024-09-14T02:43:51.588311+0000 mgr.a (mgr.14355) 11372 : audit [DBG] from='client.249492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:52 smithi131 bash[24745]: cluster 2024-09-14T02:43:50.964443+0000 mgr.a (mgr.14355) 11371 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:52 smithi131 bash[24745]: audit 2024-09-14T02:43:51.588311+0000 mgr.a (mgr.14355) 11372 : audit [DBG] from='client.249492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:54 smithi171 bash[25040]: cluster 2024-09-14T02:43:52.965414+0000 mgr.a (mgr.14355) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:54 smithi007 bash[22722]: cluster 2024-09-14T02:43:52.965414+0000 mgr.a (mgr.14355) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:54 smithi131 bash[24745]: cluster 2024-09-14T02:43:52.965414+0000 mgr.a (mgr.14355) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:56 smithi007 bash[22722]: cluster 2024-09-14T02:43:54.966201+0000 mgr.a (mgr.14355) 11374 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:56 smithi131 bash[24745]: cluster 2024-09-14T02:43:54.966201+0000 mgr.a (mgr.14355) 11374 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:56 smithi171 bash[25040]: cluster 2024-09-14T02:43:54.966201+0000 mgr.a (mgr.14355) 11374 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:43:57.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:43:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:43:57.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:43:57.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:43:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:43:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:43:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:43:57.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:43:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:58 smithi007 bash[22722]: cluster 2024-09-14T02:43:56.968451+0000 mgr.a (mgr.14355) 11375 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:43:58 smithi007 bash[22722]: audit 2024-09-14T02:43:57.351174+0000 mgr.a (mgr.14355) 11376 : audit [DBG] from='client.249567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:58 smithi131 bash[24745]: cluster 2024-09-14T02:43:56.968451+0000 mgr.a (mgr.14355) 11375 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:43:58 smithi131 bash[24745]: audit 2024-09-14T02:43:57.351174+0000 mgr.a (mgr.14355) 11376 : audit [DBG] from='client.249567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:43:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:58 smithi171 bash[25040]: cluster 2024-09-14T02:43:56.968451+0000 mgr.a (mgr.14355) 11375 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:43:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:43:58 smithi171 bash[25040]: audit 2024-09-14T02:43:57.351174+0000 mgr.a (mgr.14355) 11376 : audit [DBG] from='client.249567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:00 smithi007 bash[22722]: cluster 2024-09-14T02:43:58.969420+0000 mgr.a (mgr.14355) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:00 smithi131 bash[24745]: cluster 2024-09-14T02:43:58.969420+0000 mgr.a (mgr.14355) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:00 smithi171 bash[25040]: cluster 2024-09-14T02:43:58.969420+0000 mgr.a (mgr.14355) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:02 smithi007 bash[22722]: cluster 2024-09-14T02:44:00.971641+0000 mgr.a (mgr.14355) 11378 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:02 smithi131 bash[24745]: cluster 2024-09-14T02:44:00.971641+0000 mgr.a (mgr.14355) 11378 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:02 smithi171 bash[25040]: cluster 2024-09-14T02:44:00.971641+0000 mgr.a (mgr.14355) 11378 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:02.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:02.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:02.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:03.565 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:04 smithi007 bash[22722]: cluster 2024-09-14T02:44:02.972347+0000 mgr.a (mgr.14355) 11379 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:04 smithi007 bash[22722]: audit 2024-09-14T02:44:03.119710+0000 mgr.a (mgr.14355) 11380 : audit [DBG] from='client.249642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:04 smithi131 bash[24745]: cluster 2024-09-14T02:44:02.972347+0000 mgr.a (mgr.14355) 11379 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:04 smithi131 bash[24745]: audit 2024-09-14T02:44:03.119710+0000 mgr.a (mgr.14355) 11380 : audit [DBG] from='client.249642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:04 smithi171 bash[25040]: cluster 2024-09-14T02:44:02.972347+0000 mgr.a (mgr.14355) 11379 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:04 smithi171 bash[25040]: audit 2024-09-14T02:44:03.119710+0000 mgr.a (mgr.14355) 11380 : audit [DBG] from='client.249642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:06 smithi007 bash[22722]: cluster 2024-09-14T02:44:04.973275+0000 mgr.a (mgr.14355) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:06 smithi007 bash[22722]: audit 2024-09-14T02:44:05.411869+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:44:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:06 smithi131 bash[24745]: cluster 2024-09-14T02:44:04.973275+0000 mgr.a (mgr.14355) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:06 smithi131 bash[24745]: audit 2024-09-14T02:44:05.411869+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:44:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:06 smithi171 bash[25040]: cluster 2024-09-14T02:44:04.973275+0000 mgr.a (mgr.14355) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:06 smithi171 bash[25040]: audit 2024-09-14T02:44:05.411869+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:44:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:08 smithi007 bash[22722]: cluster 2024-09-14T02:44:06.975569+0000 mgr.a (mgr.14355) 11382 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:08.532 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:08 smithi131 bash[24745]: cluster 2024-09-14T02:44:06.975569+0000 mgr.a (mgr.14355) 11382 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:08 smithi171 bash[25040]: cluster 2024-09-14T02:44:06.975569+0000 mgr.a (mgr.14355) 11382 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:09.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:09.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:10 smithi007 bash[22722]: audit 2024-09-14T02:44:08.900050+0000 mgr.a (mgr.14355) 11383 : audit [DBG] from='client.249720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:10 smithi007 bash[22722]: cluster 2024-09-14T02:44:08.976198+0000 mgr.a (mgr.14355) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:10 smithi131 bash[24745]: audit 2024-09-14T02:44:08.900050+0000 mgr.a (mgr.14355) 11383 : audit [DBG] from='client.249720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:10 smithi131 bash[24745]: cluster 2024-09-14T02:44:08.976198+0000 mgr.a (mgr.14355) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:10 smithi171 bash[25040]: audit 2024-09-14T02:44:08.900050+0000 mgr.a (mgr.14355) 11383 : audit [DBG] from='client.249720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:10 smithi171 bash[25040]: cluster 2024-09-14T02:44:08.976198+0000 mgr.a (mgr.14355) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.773630+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.778116+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.795111+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.799799+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.818520+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:10.822903+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: cluster 2024-09-14T02:44:10.978512+0000 mgr.a (mgr.14355) 11385 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:11.520627+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:11.522052+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:11.529133+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:11.533943+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:11 smithi131 bash[24745]: audit 2024-09-14T02:44:11.536175+0000 mgr.a (mgr.14355) 11386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.773630+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.778116+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.795111+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.799799+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.818520+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:10.822903+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: cluster 2024-09-14T02:44:10.978512+0000 mgr.a (mgr.14355) 11385 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:11.520627+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:11.522052+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:11.529133+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:11.533943+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:11 smithi171 bash[25040]: audit 2024-09-14T02:44:11.536175+0000 mgr.a (mgr.14355) 11386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.773630+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.778116+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.795111+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.799799+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.818520+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:10.822903+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: cluster 2024-09-14T02:44:10.978512+0000 mgr.a (mgr.14355) 11385 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:11.520627+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:11.522052+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:11.529133+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:11.533943+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:11 smithi007 bash[22722]: audit 2024-09-14T02:44:11.536175+0000 mgr.a (mgr.14355) 11386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:44:12.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:44:12 smithi007 bash[22972]: debug 2024-09-14T02:44:12.276+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:44:12.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:44:12 smithi007 bash[22972]: debug 2024-09-14T02:44:12.276+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:44:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:12 smithi007 bash[22722]: audit 2024-09-14T02:44:12.279001+0000 mgr.a (mgr.14355) 11387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:44:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:12 smithi007 bash[22722]: cephadm 2024-09-14T02:44:12.280855+0000 mgr.a (mgr.14355) 11388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:44:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:12 smithi131 bash[24745]: audit 2024-09-14T02:44:12.279001+0000 mgr.a (mgr.14355) 11387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:44:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:12 smithi131 bash[24745]: cephadm 2024-09-14T02:44:12.280855+0000 mgr.a (mgr.14355) 11388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:44:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:12 smithi171 bash[25040]: audit 2024-09-14T02:44:12.279001+0000 mgr.a (mgr.14355) 11387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:44:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:12 smithi171 bash[25040]: cephadm 2024-09-14T02:44:12.280855+0000 mgr.a (mgr.14355) 11388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:44:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:13 smithi007 bash[22722]: cluster 2024-09-14T02:44:12.979401+0000 mgr.a (mgr.14355) 11389 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:13 smithi131 bash[24745]: cluster 2024-09-14T02:44:12.979401+0000 mgr.a (mgr.14355) 11389 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:13 smithi171 bash[25040]: cluster 2024-09-14T02:44:12.979401+0000 mgr.a (mgr.14355) 11389 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:14.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:15.124 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:15.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:14 smithi007 bash[22722]: audit 2024-09-14T02:44:14.674220+0000 mgr.a (mgr.14355) 11390 : audit [DBG] from='client.249903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:14 smithi131 bash[24745]: audit 2024-09-14T02:44:14.674220+0000 mgr.a (mgr.14355) 11390 : audit [DBG] from='client.249903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:14 smithi171 bash[25040]: audit 2024-09-14T02:44:14.674220+0000 mgr.a (mgr.14355) 11390 : audit [DBG] from='client.249903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:15 smithi007 bash[22722]: cluster 2024-09-14T02:44:14.979962+0000 mgr.a (mgr.14355) 11391 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:15 smithi131 bash[24745]: cluster 2024-09-14T02:44:14.979962+0000 mgr.a (mgr.14355) 11391 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:15 smithi171 bash[25040]: cluster 2024-09-14T02:44:14.979962+0000 mgr.a (mgr.14355) 11391 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:18 smithi171 bash[25040]: cluster 2024-09-14T02:44:16.982376+0000 mgr.a (mgr.14355) 11392 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:18 smithi007 bash[22722]: cluster 2024-09-14T02:44:16.982376+0000 mgr.a (mgr.14355) 11392 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:18 smithi131 bash[24745]: cluster 2024-09-14T02:44:16.982376+0000 mgr.a (mgr.14355) 11392 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:20.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:20 smithi171 bash[25040]: cluster 2024-09-14T02:44:18.983196+0000 mgr.a (mgr.14355) 11393 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:20 smithi007 bash[22722]: cluster 2024-09-14T02:44:18.983196+0000 mgr.a (mgr.14355) 11393 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:20 smithi131 bash[24745]: cluster 2024-09-14T02:44:18.983196+0000 mgr.a (mgr.14355) 11393 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:20.909 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:20.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:20.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:20.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:20.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:21 smithi007 bash[22722]: audit 2024-09-14T02:44:20.460577+0000 mgr.a (mgr.14355) 11394 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:21 smithi131 bash[24745]: audit 2024-09-14T02:44:20.460577+0000 mgr.a (mgr.14355) 11394 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:21 smithi171 bash[25040]: audit 2024-09-14T02:44:20.460577+0000 mgr.a (mgr.14355) 11394 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:22 smithi007 bash[22722]: cluster 2024-09-14T02:44:20.986045+0000 mgr.a (mgr.14355) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:22 smithi131 bash[24745]: cluster 2024-09-14T02:44:20.986045+0000 mgr.a (mgr.14355) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:22 smithi171 bash[25040]: cluster 2024-09-14T02:44:20.986045+0000 mgr.a (mgr.14355) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:24 smithi007 bash[22722]: cluster 2024-09-14T02:44:22.987005+0000 mgr.a (mgr.14355) 11396 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:24 smithi131 bash[24745]: cluster 2024-09-14T02:44:22.987005+0000 mgr.a (mgr.14355) 11396 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:24 smithi171 bash[25040]: cluster 2024-09-14T02:44:22.987005+0000 mgr.a (mgr.14355) 11396 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:25.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:25.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:26 smithi007 bash[22722]: cluster 2024-09-14T02:44:24.987961+0000 mgr.a (mgr.14355) 11397 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:26 smithi131 bash[24745]: cluster 2024-09-14T02:44:24.987961+0000 mgr.a (mgr.14355) 11397 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:26 smithi171 bash[25040]: cluster 2024-09-14T02:44:24.987961+0000 mgr.a (mgr.14355) 11397 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:44:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:26.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:26.672 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:27 smithi007 bash[22722]: audit 2024-09-14T02:44:26.244093+0000 mgr.a (mgr.14355) 11398 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:27 smithi131 bash[24745]: audit 2024-09-14T02:44:26.244093+0000 mgr.a (mgr.14355) 11398 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:27.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:27 smithi171 bash[25040]: audit 2024-09-14T02:44:26.244093+0000 mgr.a (mgr.14355) 11398 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:28 smithi007 bash[22722]: cluster 2024-09-14T02:44:26.990769+0000 mgr.a (mgr.14355) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:28 smithi131 bash[24745]: cluster 2024-09-14T02:44:26.990769+0000 mgr.a (mgr.14355) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:28 smithi171 bash[25040]: cluster 2024-09-14T02:44:26.990769+0000 mgr.a (mgr.14355) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:44:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:30 smithi007 bash[22722]: cluster 2024-09-14T02:44:28.991526+0000 mgr.a (mgr.14355) 11400 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:44:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:30 smithi131 bash[24745]: cluster 2024-09-14T02:44:28.991526+0000 mgr.a (mgr.14355) 11400 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:44:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:30 smithi171 bash[25040]: cluster 2024-09-14T02:44:28.991526+0000 mgr.a (mgr.14355) 11400 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:44:31.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:31.674 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:31.674 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:32.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:32.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:32.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:32.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:32.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:32.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:32 smithi007 bash[22722]: cluster 2024-09-14T02:44:30.993622+0000 mgr.a (mgr.14355) 11401 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:32 smithi131 bash[24745]: cluster 2024-09-14T02:44:30.993622+0000 mgr.a (mgr.14355) 11401 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:32 smithi171 bash[25040]: cluster 2024-09-14T02:44:30.993622+0000 mgr.a (mgr.14355) 11401 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:33 smithi007 bash[22722]: audit 2024-09-14T02:44:32.007562+0000 mgr.a (mgr.14355) 11402 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:33 smithi131 bash[24745]: audit 2024-09-14T02:44:32.007562+0000 mgr.a (mgr.14355) 11402 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:33 smithi171 bash[25040]: audit 2024-09-14T02:44:32.007562+0000 mgr.a (mgr.14355) 11402 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:34 smithi007 bash[22722]: cluster 2024-09-14T02:44:32.994633+0000 mgr.a (mgr.14355) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:34 smithi131 bash[24745]: cluster 2024-09-14T02:44:32.994633+0000 mgr.a (mgr.14355) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:34 smithi171 bash[25040]: cluster 2024-09-14T02:44:32.994633+0000 mgr.a (mgr.14355) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:36 smithi007 bash[22722]: cluster 2024-09-14T02:44:34.995381+0000 mgr.a (mgr.14355) 11404 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:36 smithi131 bash[24745]: cluster 2024-09-14T02:44:34.995381+0000 mgr.a (mgr.14355) 11404 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:36 smithi171 bash[25040]: cluster 2024-09-14T02:44:34.995381+0000 mgr.a (mgr.14355) 11404 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:37.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:37.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:37.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:38.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:38.231 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:38 smithi007 bash[22722]: cluster 2024-09-14T02:44:36.997643+0000 mgr.a (mgr.14355) 11405 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:38 smithi131 bash[24745]: cluster 2024-09-14T02:44:36.997643+0000 mgr.a (mgr.14355) 11405 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:38 smithi171 bash[25040]: cluster 2024-09-14T02:44:36.997643+0000 mgr.a (mgr.14355) 11405 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:39 smithi007 bash[22722]: audit 2024-09-14T02:44:37.779910+0000 mgr.a (mgr.14355) 11406 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:39 smithi131 bash[24745]: audit 2024-09-14T02:44:37.779910+0000 mgr.a (mgr.14355) 11406 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:39 smithi171 bash[25040]: audit 2024-09-14T02:44:37.779910+0000 mgr.a (mgr.14355) 11406 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:40 smithi007 bash[22722]: cluster 2024-09-14T02:44:38.998666+0000 mgr.a (mgr.14355) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:40 smithi131 bash[24745]: cluster 2024-09-14T02:44:38.998666+0000 mgr.a (mgr.14355) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:40 smithi171 bash[25040]: cluster 2024-09-14T02:44:38.998666+0000 mgr.a (mgr.14355) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:42 smithi007 bash[22722]: cluster 2024-09-14T02:44:41.000907+0000 mgr.a (mgr.14355) 11408 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:42 smithi131 bash[24745]: cluster 2024-09-14T02:44:41.000907+0000 mgr.a (mgr.14355) 11408 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:42 smithi171 bash[25040]: cluster 2024-09-14T02:44:41.000907+0000 mgr.a (mgr.14355) 11408 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:44.010 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:44.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:44.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:44.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:44.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:44 smithi007 bash[22722]: cluster 2024-09-14T02:44:43.001654+0000 mgr.a (mgr.14355) 11409 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:44 smithi007 bash[22722]: audit 2024-09-14T02:44:43.565215+0000 mgr.a (mgr.14355) 11410 : audit [DBG] from='client.250290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:44 smithi131 bash[24745]: cluster 2024-09-14T02:44:43.001654+0000 mgr.a (mgr.14355) 11409 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:44 smithi131 bash[24745]: audit 2024-09-14T02:44:43.565215+0000 mgr.a (mgr.14355) 11410 : audit [DBG] from='client.250290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:44 smithi171 bash[25040]: cluster 2024-09-14T02:44:43.001654+0000 mgr.a (mgr.14355) 11409 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:44 smithi171 bash[25040]: audit 2024-09-14T02:44:43.565215+0000 mgr.a (mgr.14355) 11410 : audit [DBG] from='client.250290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:46 smithi007 bash[22722]: cluster 2024-09-14T02:44:45.002676+0000 mgr.a (mgr.14355) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:46 smithi131 bash[24745]: cluster 2024-09-14T02:44:45.002676+0000 mgr.a (mgr.14355) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:46 smithi171 bash[25040]: cluster 2024-09-14T02:44:45.002676+0000 mgr.a (mgr.14355) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:48 smithi007 bash[22722]: cluster 2024-09-14T02:44:47.005029+0000 mgr.a (mgr.14355) 11412 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:48 smithi131 bash[24745]: cluster 2024-09-14T02:44:47.005029+0000 mgr.a (mgr.14355) 11412 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:48 smithi171 bash[25040]: cluster 2024-09-14T02:44:47.005029+0000 mgr.a (mgr.14355) 11412 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:49.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:49.013 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:49.792 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:49.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:50 smithi007 bash[22722]: cluster 2024-09-14T02:44:49.005829+0000 mgr.a (mgr.14355) 11413 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:50 smithi007 bash[22722]: audit 2024-09-14T02:44:49.348284+0000 mgr.a (mgr.14355) 11414 : audit [DBG] from='client.250365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:50 smithi131 bash[24745]: cluster 2024-09-14T02:44:49.005829+0000 mgr.a (mgr.14355) 11413 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:50 smithi131 bash[24745]: audit 2024-09-14T02:44:49.348284+0000 mgr.a (mgr.14355) 11414 : audit [DBG] from='client.250365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:50 smithi171 bash[25040]: cluster 2024-09-14T02:44:49.005829+0000 mgr.a (mgr.14355) 11413 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:50 smithi171 bash[25040]: audit 2024-09-14T02:44:49.348284+0000 mgr.a (mgr.14355) 11414 : audit [DBG] from='client.250365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:52 smithi007 bash[22722]: cluster 2024-09-14T02:44:51.008170+0000 mgr.a (mgr.14355) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:52 smithi131 bash[24745]: cluster 2024-09-14T02:44:51.008170+0000 mgr.a (mgr.14355) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:52 smithi171 bash[25040]: cluster 2024-09-14T02:44:51.008170+0000 mgr.a (mgr.14355) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:44:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:54 smithi007 bash[22722]: cluster 2024-09-14T02:44:53.008970+0000 mgr.a (mgr.14355) 11416 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:54 smithi131 bash[24745]: cluster 2024-09-14T02:44:53.008970+0000 mgr.a (mgr.14355) 11416 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:54 smithi171 bash[25040]: cluster 2024-09-14T02:44:53.008970+0000 mgr.a (mgr.14355) 11416 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:54.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:44:54.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:44:54.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:44:55.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:44:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:44:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:44:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:44:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:44:56.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:56 smithi007 bash[22722]: cluster 2024-09-14T02:44:55.009494+0000 mgr.a (mgr.14355) 11417 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:56.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:56 smithi007 bash[22722]: audit 2024-09-14T02:44:55.127888+0000 mgr.a (mgr.14355) 11418 : audit [DBG] from='client.250440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:56 smithi131 bash[24745]: cluster 2024-09-14T02:44:55.009494+0000 mgr.a (mgr.14355) 11417 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:56 smithi131 bash[24745]: audit 2024-09-14T02:44:55.127888+0000 mgr.a (mgr.14355) 11418 : audit [DBG] from='client.250440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:56 smithi171 bash[25040]: cluster 2024-09-14T02:44:55.009494+0000 mgr.a (mgr.14355) 11417 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:56 smithi171 bash[25040]: audit 2024-09-14T02:44:55.127888+0000 mgr.a (mgr.14355) 11418 : audit [DBG] from='client.250440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:44:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:44:58 smithi007 bash[22722]: cluster 2024-09-14T02:44:57.012205+0000 mgr.a (mgr.14355) 11419 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:44:58 smithi131 bash[24745]: cluster 2024-09-14T02:44:57.012205+0000 mgr.a (mgr.14355) 11419 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:44:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:44:58 smithi171 bash[25040]: cluster 2024-09-14T02:44:57.012205+0000 mgr.a (mgr.14355) 11419 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:00 smithi007 bash[22722]: cluster 2024-09-14T02:44:59.013002+0000 mgr.a (mgr.14355) 11420 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:00 smithi131 bash[24745]: cluster 2024-09-14T02:44:59.013002+0000 mgr.a (mgr.14355) 11420 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:00 smithi171 bash[25040]: cluster 2024-09-14T02:44:59.013002+0000 mgr.a (mgr.14355) 11420 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:00.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:00.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:00.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:01.311 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:01.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:01.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:01.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:01.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:02 smithi007 bash[22722]: audit 2024-09-14T02:45:00.884997+0000 mgr.a (mgr.14355) 11421 : audit [DBG] from='client.250518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:02 smithi007 bash[22722]: cluster 2024-09-14T02:45:01.019932+0000 mgr.a (mgr.14355) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:02 smithi131 bash[24745]: audit 2024-09-14T02:45:00.884997+0000 mgr.a (mgr.14355) 11421 : audit [DBG] from='client.250518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:02 smithi131 bash[24745]: cluster 2024-09-14T02:45:01.019932+0000 mgr.a (mgr.14355) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:02 smithi171 bash[25040]: audit 2024-09-14T02:45:00.884997+0000 mgr.a (mgr.14355) 11421 : audit [DBG] from='client.250518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:02 smithi171 bash[25040]: cluster 2024-09-14T02:45:01.019932+0000 mgr.a (mgr.14355) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:04 smithi007 bash[22722]: cluster 2024-09-14T02:45:03.020841+0000 mgr.a (mgr.14355) 11423 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:04 smithi131 bash[24745]: cluster 2024-09-14T02:45:03.020841+0000 mgr.a (mgr.14355) 11423 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:04 smithi171 bash[25040]: cluster 2024-09-14T02:45:03.020841+0000 mgr.a (mgr.14355) 11423 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:06.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:06.313 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:06.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:06 smithi007 bash[22722]: cluster 2024-09-14T02:45:05.021642+0000 mgr.a (mgr.14355) 11424 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:06 smithi131 bash[24745]: cluster 2024-09-14T02:45:05.021642+0000 mgr.a (mgr.14355) 11424 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:06 smithi171 bash[25040]: cluster 2024-09-14T02:45:05.021642+0000 mgr.a (mgr.14355) 11424 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:07.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:07 smithi007 bash[22722]: audit 2024-09-14T02:45:06.640608+0000 mgr.a (mgr.14355) 11425 : audit [DBG] from='client.250596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:07 smithi131 bash[24745]: audit 2024-09-14T02:45:06.640608+0000 mgr.a (mgr.14355) 11425 : audit [DBG] from='client.250596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:07 smithi171 bash[25040]: audit 2024-09-14T02:45:06.640608+0000 mgr.a (mgr.14355) 11425 : audit [DBG] from='client.250596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:08 smithi007 bash[22722]: cluster 2024-09-14T02:45:07.023146+0000 mgr.a (mgr.14355) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:08 smithi131 bash[24745]: cluster 2024-09-14T02:45:07.023146+0000 mgr.a (mgr.14355) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:08 smithi171 bash[25040]: cluster 2024-09-14T02:45:07.023146+0000 mgr.a (mgr.14355) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:10 smithi007 bash[22722]: cluster 2024-09-14T02:45:09.023899+0000 mgr.a (mgr.14355) 11427 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:10 smithi131 bash[24745]: cluster 2024-09-14T02:45:09.023899+0000 mgr.a (mgr.14355) 11427 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:10 smithi171 bash[25040]: cluster 2024-09-14T02:45:09.023899+0000 mgr.a (mgr.14355) 11427 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:12.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:12.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:12 smithi007 bash[22722]: cluster 2024-09-14T02:45:11.025861+0000 mgr.a (mgr.14355) 11428 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:12 smithi131 bash[24745]: cluster 2024-09-14T02:45:11.025861+0000 mgr.a (mgr.14355) 11428 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:12 smithi171 bash[25040]: cluster 2024-09-14T02:45:11.025861+0000 mgr.a (mgr.14355) 11428 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:12.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:12.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:12.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:12.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:13 smithi007 bash[22722]: audit 2024-09-14T02:45:12.333153+0000 mon.a (mon.0) 2301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:45:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:13 smithi007 bash[22722]: audit 2024-09-14T02:45:12.393228+0000 mgr.a (mgr.14355) 11429 : audit [DBG] from='client.250671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:13 smithi131 bash[24745]: audit 2024-09-14T02:45:12.333153+0000 mon.a (mon.0) 2301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:45:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:13 smithi131 bash[24745]: audit 2024-09-14T02:45:12.393228+0000 mgr.a (mgr.14355) 11429 : audit [DBG] from='client.250671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:13 smithi171 bash[25040]: audit 2024-09-14T02:45:12.333153+0000 mon.a (mon.0) 2301 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:45:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:13 smithi171 bash[25040]: audit 2024-09-14T02:45:12.393228+0000 mgr.a (mgr.14355) 11429 : audit [DBG] from='client.250671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:14.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:45:13 smithi007 bash[22972]: debug 2024-09-14T02:45:13.983+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:45:14.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:45:13 smithi007 bash[22972]: debug 2024-09-14T02:45:13.987+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:45:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: cluster 2024-09-14T02:45:13.026377+0000 mgr.a (mgr.14355) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: audit 2024-09-14T02:45:13.224670+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:45:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: audit 2024-09-14T02:45:13.226692+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:45:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: audit 2024-09-14T02:45:13.237250+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:45:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: audit 2024-09-14T02:45:13.242241+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:14 smithi007 bash[22722]: audit 2024-09-14T02:45:13.245058+0000 mgr.a (mgr.14355) 11431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: cluster 2024-09-14T02:45:13.026377+0000 mgr.a (mgr.14355) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: audit 2024-09-14T02:45:13.224670+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: audit 2024-09-14T02:45:13.226692+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: audit 2024-09-14T02:45:13.237250+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: audit 2024-09-14T02:45:13.242241+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:14 smithi131 bash[24745]: audit 2024-09-14T02:45:13.245058+0000 mgr.a (mgr.14355) 11431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: cluster 2024-09-14T02:45:13.026377+0000 mgr.a (mgr.14355) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: audit 2024-09-14T02:45:13.224670+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:45:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: audit 2024-09-14T02:45:13.226692+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:45:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: audit 2024-09-14T02:45:13.237250+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:45:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: audit 2024-09-14T02:45:13.242241+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:14 smithi171 bash[25040]: audit 2024-09-14T02:45:13.245058+0000 mgr.a (mgr.14355) 11431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:45:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:15 smithi131 bash[24745]: audit 2024-09-14T02:45:13.989895+0000 mgr.a (mgr.14355) 11432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:45:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:15 smithi131 bash[24745]: cephadm 2024-09-14T02:45:13.991504+0000 mgr.a (mgr.14355) 11433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:45:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:15 smithi171 bash[25040]: audit 2024-09-14T02:45:13.989895+0000 mgr.a (mgr.14355) 11432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:45:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:15 smithi171 bash[25040]: cephadm 2024-09-14T02:45:13.991504+0000 mgr.a (mgr.14355) 11433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:45:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:15 smithi007 bash[22722]: audit 2024-09-14T02:45:13.989895+0000 mgr.a (mgr.14355) 11432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:45:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:15 smithi007 bash[22722]: cephadm 2024-09-14T02:45:13.991504+0000 mgr.a (mgr.14355) 11433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:45:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:16 smithi131 bash[24745]: cluster 2024-09-14T02:45:15.027219+0000 mgr.a (mgr.14355) 11434 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:16 smithi171 bash[25040]: cluster 2024-09-14T02:45:15.027219+0000 mgr.a (mgr.14355) 11434 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:16 smithi007 bash[22722]: cluster 2024-09-14T02:45:15.027219+0000 mgr.a (mgr.14355) 11434 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:17.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:17.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:17.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:18 smithi131 bash[24745]: cluster 2024-09-14T02:45:17.029503+0000 mgr.a (mgr.14355) 11435 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:18 smithi171 bash[25040]: cluster 2024-09-14T02:45:17.029503+0000 mgr.a (mgr.14355) 11435 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:18.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:18.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:18 smithi007 bash[22722]: cluster 2024-09-14T02:45:17.029503+0000 mgr.a (mgr.14355) 11435 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:19 smithi131 bash[24745]: audit 2024-09-14T02:45:18.166598+0000 mgr.a (mgr.14355) 11436 : audit [DBG] from='client.250851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:19 smithi171 bash[25040]: audit 2024-09-14T02:45:18.166598+0000 mgr.a (mgr.14355) 11436 : audit [DBG] from='client.250851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:19 smithi007 bash[22722]: audit 2024-09-14T02:45:18.166598+0000 mgr.a (mgr.14355) 11436 : audit [DBG] from='client.250851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:20 smithi131 bash[24745]: cluster 2024-09-14T02:45:19.030479+0000 mgr.a (mgr.14355) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:20 smithi171 bash[25040]: cluster 2024-09-14T02:45:19.030479+0000 mgr.a (mgr.14355) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:20 smithi007 bash[22722]: cluster 2024-09-14T02:45:19.030479+0000 mgr.a (mgr.14355) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:22 smithi131 bash[24745]: cluster 2024-09-14T02:45:21.032662+0000 mgr.a (mgr.14355) 11438 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:22 smithi171 bash[25040]: cluster 2024-09-14T02:45:21.032662+0000 mgr.a (mgr.14355) 11438 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:22 smithi007 bash[22722]: cluster 2024-09-14T02:45:21.032662+0000 mgr.a (mgr.14355) 11438 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:23.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:23.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:24.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:24 smithi131 bash[24745]: cluster 2024-09-14T02:45:23.033417+0000 mgr.a (mgr.14355) 11439 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:24 smithi171 bash[25040]: cluster 2024-09-14T02:45:23.033417+0000 mgr.a (mgr.14355) 11439 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:24 smithi007 bash[22722]: cluster 2024-09-14T02:45:23.033417+0000 mgr.a (mgr.14355) 11439 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:25 smithi131 bash[24745]: audit 2024-09-14T02:45:23.942414+0000 mgr.a (mgr.14355) 11440 : audit [DBG] from='client.250926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:25 smithi171 bash[25040]: audit 2024-09-14T02:45:23.942414+0000 mgr.a (mgr.14355) 11440 : audit [DBG] from='client.250926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:25 smithi007 bash[22722]: audit 2024-09-14T02:45:23.942414+0000 mgr.a (mgr.14355) 11440 : audit [DBG] from='client.250926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:26 smithi131 bash[24745]: cluster 2024-09-14T02:45:25.034342+0000 mgr.a (mgr.14355) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:26 smithi171 bash[25040]: cluster 2024-09-14T02:45:25.034342+0000 mgr.a (mgr.14355) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:26 smithi007 bash[22722]: cluster 2024-09-14T02:45:25.034342+0000 mgr.a (mgr.14355) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:28 smithi131 bash[24745]: cluster 2024-09-14T02:45:27.036515+0000 mgr.a (mgr.14355) 11442 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:28 smithi171 bash[25040]: cluster 2024-09-14T02:45:27.036515+0000 mgr.a (mgr.14355) 11442 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:28 smithi007 bash[22722]: cluster 2024-09-14T02:45:27.036515+0000 mgr.a (mgr.14355) 11442 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:45:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:30.121 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:30.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:30.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:30 smithi131 bash[24745]: cluster 2024-09-14T02:45:29.037279+0000 mgr.a (mgr.14355) 11443 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:30 smithi131 bash[24745]: audit 2024-09-14T02:45:29.692206+0000 mgr.a (mgr.14355) 11444 : audit [DBG] from='client.251004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:30 smithi171 bash[25040]: cluster 2024-09-14T02:45:29.037279+0000 mgr.a (mgr.14355) 11443 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:30 smithi171 bash[25040]: audit 2024-09-14T02:45:29.692206+0000 mgr.a (mgr.14355) 11444 : audit [DBG] from='client.251004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:30 smithi007 bash[22722]: cluster 2024-09-14T02:45:29.037279+0000 mgr.a (mgr.14355) 11443 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:30 smithi007 bash[22722]: audit 2024-09-14T02:45:29.692206+0000 mgr.a (mgr.14355) 11444 : audit [DBG] from='client.251004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:32 smithi131 bash[24745]: cluster 2024-09-14T02:45:31.039636+0000 mgr.a (mgr.14355) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:32 smithi171 bash[25040]: cluster 2024-09-14T02:45:31.039636+0000 mgr.a (mgr.14355) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:32 smithi007 bash[22722]: cluster 2024-09-14T02:45:31.039636+0000 mgr.a (mgr.14355) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:34 smithi131 bash[24745]: cluster 2024-09-14T02:45:33.040411+0000 mgr.a (mgr.14355) 11446 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:34 smithi171 bash[25040]: cluster 2024-09-14T02:45:33.040411+0000 mgr.a (mgr.14355) 11446 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:34 smithi007 bash[22722]: cluster 2024-09-14T02:45:33.040411+0000 mgr.a (mgr.14355) 11446 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:35.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:35.123 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:35.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:35.893 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:35.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:36 smithi131 bash[24745]: cluster 2024-09-14T02:45:35.041170+0000 mgr.a (mgr.14355) 11447 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:36 smithi131 bash[24745]: audit 2024-09-14T02:45:35.462870+0000 mgr.a (mgr.14355) 11448 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:36 smithi171 bash[25040]: cluster 2024-09-14T02:45:35.041170+0000 mgr.a (mgr.14355) 11447 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:36 smithi171 bash[25040]: audit 2024-09-14T02:45:35.462870+0000 mgr.a (mgr.14355) 11448 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:36 smithi007 bash[22722]: cluster 2024-09-14T02:45:35.041170+0000 mgr.a (mgr.14355) 11447 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:36 smithi007 bash[22722]: audit 2024-09-14T02:45:35.462870+0000 mgr.a (mgr.14355) 11448 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:38 smithi131 bash[24745]: cluster 2024-09-14T02:45:37.043916+0000 mgr.a (mgr.14355) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:38 smithi171 bash[25040]: cluster 2024-09-14T02:45:37.043916+0000 mgr.a (mgr.14355) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:38 smithi007 bash[22722]: cluster 2024-09-14T02:45:37.043916+0000 mgr.a (mgr.14355) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:40 smithi131 bash[24745]: cluster 2024-09-14T02:45:39.044690+0000 mgr.a (mgr.14355) 11450 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:40 smithi171 bash[25040]: cluster 2024-09-14T02:45:39.044690+0000 mgr.a (mgr.14355) 11450 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:40 smithi007 bash[22722]: cluster 2024-09-14T02:45:39.044690+0000 mgr.a (mgr.14355) 11450 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:40.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:40.895 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:40.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:41.672 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:41.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:42 smithi131 bash[24745]: cluster 2024-09-14T02:45:41.046052+0000 mgr.a (mgr.14355) 11451 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:42 smithi131 bash[24745]: audit 2024-09-14T02:45:41.232934+0000 mgr.a (mgr.14355) 11452 : audit [DBG] from='client.251157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:42 smithi171 bash[25040]: cluster 2024-09-14T02:45:41.046052+0000 mgr.a (mgr.14355) 11451 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:42 smithi171 bash[25040]: audit 2024-09-14T02:45:41.232934+0000 mgr.a (mgr.14355) 11452 : audit [DBG] from='client.251157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:42 smithi007 bash[22722]: cluster 2024-09-14T02:45:41.046052+0000 mgr.a (mgr.14355) 11451 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:42 smithi007 bash[22722]: audit 2024-09-14T02:45:41.232934+0000 mgr.a (mgr.14355) 11452 : audit [DBG] from='client.251157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:44 smithi171 bash[25040]: cluster 2024-09-14T02:45:43.046913+0000 mgr.a (mgr.14355) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:44 smithi007 bash[22722]: cluster 2024-09-14T02:45:43.046913+0000 mgr.a (mgr.14355) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:44 smithi131 bash[24745]: cluster 2024-09-14T02:45:43.046913+0000 mgr.a (mgr.14355) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:45:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:46 smithi171 bash[25040]: cluster 2024-09-14T02:45:45.047688+0000 mgr.a (mgr.14355) 11454 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:45:46.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:46.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:46 smithi007 bash[22722]: cluster 2024-09-14T02:45:45.047688+0000 mgr.a (mgr.14355) 11454 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:45:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:46 smithi131 bash[24745]: cluster 2024-09-14T02:45:45.047688+0000 mgr.a (mgr.14355) 11454 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:45:47.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:47.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:47.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:47.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:47.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:48 smithi171 bash[25040]: audit 2024-09-14T02:45:47.006131+0000 mgr.a (mgr.14355) 11455 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:48 smithi171 bash[25040]: cluster 2024-09-14T02:45:47.049914+0000 mgr.a (mgr.14355) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:48 smithi007 bash[22722]: audit 2024-09-14T02:45:47.006131+0000 mgr.a (mgr.14355) 11455 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:48 smithi007 bash[22722]: cluster 2024-09-14T02:45:47.049914+0000 mgr.a (mgr.14355) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:48 smithi131 bash[24745]: audit 2024-09-14T02:45:47.006131+0000 mgr.a (mgr.14355) 11455 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:48 smithi131 bash[24745]: cluster 2024-09-14T02:45:47.049914+0000 mgr.a (mgr.14355) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:50 smithi007 bash[22722]: cluster 2024-09-14T02:45:49.050968+0000 mgr.a (mgr.14355) 11457 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:50 smithi131 bash[24745]: cluster 2024-09-14T02:45:49.050968+0000 mgr.a (mgr.14355) 11457 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:50 smithi171 bash[25040]: cluster 2024-09-14T02:45:49.050968+0000 mgr.a (mgr.14355) 11457 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:52.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:52.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:52 smithi007 bash[22722]: cluster 2024-09-14T02:45:51.053361+0000 mgr.a (mgr.14355) 11458 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:52 smithi131 bash[24745]: cluster 2024-09-14T02:45:51.053361+0000 mgr.a (mgr.14355) 11458 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:52 smithi171 bash[25040]: cluster 2024-09-14T02:45:51.053361+0000 mgr.a (mgr.14355) 11458 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:53.209 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:53.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:53.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:53.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:53.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:54 smithi007 bash[22722]: audit 2024-09-14T02:45:52.766510+0000 mgr.a (mgr.14355) 11459 : audit [DBG] from='client.251304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:54 smithi007 bash[22722]: cluster 2024-09-14T02:45:53.053945+0000 mgr.a (mgr.14355) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:54 smithi131 bash[24745]: audit 2024-09-14T02:45:52.766510+0000 mgr.a (mgr.14355) 11459 : audit [DBG] from='client.251304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:54 smithi131 bash[24745]: cluster 2024-09-14T02:45:53.053945+0000 mgr.a (mgr.14355) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:54 smithi171 bash[25040]: audit 2024-09-14T02:45:52.766510+0000 mgr.a (mgr.14355) 11459 : audit [DBG] from='client.251304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:54 smithi171 bash[25040]: cluster 2024-09-14T02:45:53.053945+0000 mgr.a (mgr.14355) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:56 smithi007 bash[22722]: cluster 2024-09-14T02:45:55.054828+0000 mgr.a (mgr.14355) 11461 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:56 smithi131 bash[24745]: cluster 2024-09-14T02:45:55.054828+0000 mgr.a (mgr.14355) 11461 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:56 smithi171 bash[25040]: cluster 2024-09-14T02:45:55.054828+0000 mgr.a (mgr.14355) 11461 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:45:58.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:45:58.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:45:58.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:45:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:58 smithi007 bash[22722]: cluster 2024-09-14T02:45:57.057225+0000 mgr.a (mgr.14355) 11462 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:58 smithi131 bash[24745]: cluster 2024-09-14T02:45:57.057225+0000 mgr.a (mgr.14355) 11462 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:58 smithi171 bash[25040]: cluster 2024-09-14T02:45:57.057225+0000 mgr.a (mgr.14355) 11462 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:45:58.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:45:58.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:45:58.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:45:58.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:45:58.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:45:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:45:59 smithi007 bash[22722]: audit 2024-09-14T02:45:58.544340+0000 mgr.a (mgr.14355) 11463 : audit [DBG] from='client.251382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:45:59 smithi131 bash[24745]: audit 2024-09-14T02:45:58.544340+0000 mgr.a (mgr.14355) 11463 : audit [DBG] from='client.251382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:45:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:45:59 smithi171 bash[25040]: audit 2024-09-14T02:45:58.544340+0000 mgr.a (mgr.14355) 11463 : audit [DBG] from='client.251382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:00 smithi007 bash[22722]: cluster 2024-09-14T02:45:59.058204+0000 mgr.a (mgr.14355) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:00 smithi131 bash[24745]: cluster 2024-09-14T02:45:59.058204+0000 mgr.a (mgr.14355) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:00 smithi171 bash[25040]: cluster 2024-09-14T02:45:59.058204+0000 mgr.a (mgr.14355) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:02 smithi007 bash[22722]: cluster 2024-09-14T02:46:01.060461+0000 mgr.a (mgr.14355) 11465 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:02 smithi131 bash[24745]: cluster 2024-09-14T02:46:01.060461+0000 mgr.a (mgr.14355) 11465 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:02 smithi171 bash[25040]: cluster 2024-09-14T02:46:01.060461+0000 mgr.a (mgr.14355) 11465 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:03.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:03.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:03.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:04 smithi007 bash[22722]: cluster 2024-09-14T02:46:03.061230+0000 mgr.a (mgr.14355) 11466 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:04.734 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:04.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:04 smithi131 bash[24745]: cluster 2024-09-14T02:46:03.061230+0000 mgr.a (mgr.14355) 11466 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:04 smithi171 bash[25040]: cluster 2024-09-14T02:46:03.061230+0000 mgr.a (mgr.14355) 11466 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:05 smithi007 bash[22722]: audit 2024-09-14T02:46:04.294988+0000 mgr.a (mgr.14355) 11467 : audit [DBG] from='client.251454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:05 smithi131 bash[24745]: audit 2024-09-14T02:46:04.294988+0000 mgr.a (mgr.14355) 11467 : audit [DBG] from='client.251454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:05 smithi171 bash[25040]: audit 2024-09-14T02:46:04.294988+0000 mgr.a (mgr.14355) 11467 : audit [DBG] from='client.251454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:06 smithi007 bash[22722]: cluster 2024-09-14T02:46:05.062093+0000 mgr.a (mgr.14355) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:06 smithi131 bash[24745]: cluster 2024-09-14T02:46:05.062093+0000 mgr.a (mgr.14355) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:06 smithi171 bash[25040]: cluster 2024-09-14T02:46:05.062093+0000 mgr.a (mgr.14355) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:08 smithi007 bash[22722]: cluster 2024-09-14T02:46:07.064341+0000 mgr.a (mgr.14355) 11469 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:08 smithi131 bash[24745]: cluster 2024-09-14T02:46:07.064341+0000 mgr.a (mgr.14355) 11469 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:08 smithi171 bash[25040]: cluster 2024-09-14T02:46:07.064341+0000 mgr.a (mgr.14355) 11469 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:09.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:09.737 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:10.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:10.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:10 smithi007 bash[22722]: cluster 2024-09-14T02:46:09.065121+0000 mgr.a (mgr.14355) 11470 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:10 smithi131 bash[24745]: cluster 2024-09-14T02:46:09.065121+0000 mgr.a (mgr.14355) 11470 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:10 smithi171 bash[25040]: cluster 2024-09-14T02:46:09.065121+0000 mgr.a (mgr.14355) 11470 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:11 smithi007 bash[22722]: audit 2024-09-14T02:46:10.070212+0000 mgr.a (mgr.14355) 11471 : audit [DBG] from='client.251532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:11 smithi131 bash[24745]: audit 2024-09-14T02:46:10.070212+0000 mgr.a (mgr.14355) 11471 : audit [DBG] from='client.251532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:11 smithi171 bash[25040]: audit 2024-09-14T02:46:10.070212+0000 mgr.a (mgr.14355) 11471 : audit [DBG] from='client.251532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:12 smithi007 bash[22722]: cluster 2024-09-14T02:46:11.067973+0000 mgr.a (mgr.14355) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:46:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:12 smithi131 bash[24745]: cluster 2024-09-14T02:46:11.067973+0000 mgr.a (mgr.14355) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:46:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:12 smithi171 bash[25040]: cluster 2024-09-14T02:46:11.067973+0000 mgr.a (mgr.14355) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T02:46:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:14 smithi007 bash[22722]: cluster 2024-09-14T02:46:13.068758+0000 mgr.a (mgr.14355) 11473 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:14 smithi007 bash[22722]: audit 2024-09-14T02:46:14.042385+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:46:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:14 smithi131 bash[24745]: cluster 2024-09-14T02:46:13.068758+0000 mgr.a (mgr.14355) 11473 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:14 smithi131 bash[24745]: audit 2024-09-14T02:46:14.042385+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:46:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:14 smithi171 bash[25040]: cluster 2024-09-14T02:46:13.068758+0000 mgr.a (mgr.14355) 11473 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:14 smithi171 bash[25040]: audit 2024-09-14T02:46:14.042385+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:46:15.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:15.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:15.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:15.672 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22722]: audit 2024-09-14T02:46:14.918133+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:46:15.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22722]: audit 2024-09-14T02:46:14.919633+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:46:15.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22722]: audit 2024-09-14T02:46:14.929781+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:46:15.673 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22722]: audit 2024-09-14T02:46:14.934737+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:15 smithi131 bash[24745]: audit 2024-09-14T02:46:14.918133+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:46:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:15 smithi131 bash[24745]: audit 2024-09-14T02:46:14.919633+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:46:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:15 smithi131 bash[24745]: audit 2024-09-14T02:46:14.929781+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:46:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:15 smithi131 bash[24745]: audit 2024-09-14T02:46:14.934737+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:15 smithi171 bash[25040]: audit 2024-09-14T02:46:14.918133+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:46:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:15 smithi171 bash[25040]: audit 2024-09-14T02:46:14.919633+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:46:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:15 smithi171 bash[25040]: audit 2024-09-14T02:46:14.929781+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:46:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:15 smithi171 bash[25040]: audit 2024-09-14T02:46:14.934737+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:15.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22972]: debug 2024-09-14T02:46:15.666+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:46:15.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:46:15 smithi007 bash[22972]: debug 2024-09-14T02:46:15.666+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:46:16.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:16.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:16 smithi007 bash[22722]: audit 2024-09-14T02:46:14.937112+0000 mgr.a (mgr.14355) 11474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:16 smithi007 bash[22722]: cluster 2024-09-14T02:46:15.069343+0000 mgr.a (mgr.14355) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:16 smithi007 bash[22722]: audit 2024-09-14T02:46:15.672386+0000 mgr.a (mgr.14355) 11476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:46:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:16 smithi007 bash[22722]: cephadm 2024-09-14T02:46:15.673579+0000 mgr.a (mgr.14355) 11477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:46:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:16 smithi131 bash[24745]: audit 2024-09-14T02:46:14.937112+0000 mgr.a (mgr.14355) 11474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:16 smithi131 bash[24745]: cluster 2024-09-14T02:46:15.069343+0000 mgr.a (mgr.14355) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:16 smithi131 bash[24745]: audit 2024-09-14T02:46:15.672386+0000 mgr.a (mgr.14355) 11476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:46:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:16 smithi131 bash[24745]: cephadm 2024-09-14T02:46:15.673579+0000 mgr.a (mgr.14355) 11477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:46:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:16 smithi171 bash[25040]: audit 2024-09-14T02:46:14.937112+0000 mgr.a (mgr.14355) 11474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:46:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:16 smithi171 bash[25040]: cluster 2024-09-14T02:46:15.069343+0000 mgr.a (mgr.14355) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T02:46:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:16 smithi171 bash[25040]: audit 2024-09-14T02:46:15.672386+0000 mgr.a (mgr.14355) 11476 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:46:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:16 smithi171 bash[25040]: cephadm 2024-09-14T02:46:15.673579+0000 mgr.a (mgr.14355) 11477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:46:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:17 smithi007 bash[22722]: audit 2024-09-14T02:46:15.854256+0000 mgr.a (mgr.14355) 11478 : audit [DBG] from='client.251715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:17 smithi131 bash[24745]: audit 2024-09-14T02:46:15.854256+0000 mgr.a (mgr.14355) 11478 : audit [DBG] from='client.251715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:17 smithi171 bash[25040]: audit 2024-09-14T02:46:15.854256+0000 mgr.a (mgr.14355) 11478 : audit [DBG] from='client.251715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:18 smithi007 bash[22722]: cluster 2024-09-14T02:46:17.072077+0000 mgr.a (mgr.14355) 11479 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:46:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:18 smithi131 bash[24745]: cluster 2024-09-14T02:46:17.072077+0000 mgr.a (mgr.14355) 11479 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:46:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:18 smithi171 bash[25040]: cluster 2024-09-14T02:46:17.072077+0000 mgr.a (mgr.14355) 11479 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T02:46:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:20 smithi007 bash[22722]: cluster 2024-09-14T02:46:19.072851+0000 mgr.a (mgr.14355) 11480 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:46:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:20 smithi131 bash[24745]: cluster 2024-09-14T02:46:19.072851+0000 mgr.a (mgr.14355) 11480 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:46:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:20 smithi171 bash[25040]: cluster 2024-09-14T02:46:19.072851+0000 mgr.a (mgr.14355) 11480 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T02:46:21.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:21.263 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:22.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:22.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:22 smithi007 bash[22722]: cluster 2024-09-14T02:46:21.074864+0000 mgr.a (mgr.14355) 11481 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:22 smithi007 bash[22722]: audit 2024-09-14T02:46:21.597384+0000 mgr.a (mgr.14355) 11482 : audit [DBG] from='client.251790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:22 smithi131 bash[24745]: cluster 2024-09-14T02:46:21.074864+0000 mgr.a (mgr.14355) 11481 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:22 smithi131 bash[24745]: audit 2024-09-14T02:46:21.597384+0000 mgr.a (mgr.14355) 11482 : audit [DBG] from='client.251790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:22 smithi171 bash[25040]: cluster 2024-09-14T02:46:21.074864+0000 mgr.a (mgr.14355) 11481 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:22 smithi171 bash[25040]: audit 2024-09-14T02:46:21.597384+0000 mgr.a (mgr.14355) 11482 : audit [DBG] from='client.251790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:24 smithi007 bash[22722]: cluster 2024-09-14T02:46:23.075753+0000 mgr.a (mgr.14355) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:24 smithi131 bash[24745]: cluster 2024-09-14T02:46:23.075753+0000 mgr.a (mgr.14355) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:24 smithi171 bash[25040]: cluster 2024-09-14T02:46:23.075753+0000 mgr.a (mgr.14355) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:26 smithi007 bash[22722]: cluster 2024-09-14T02:46:25.076550+0000 mgr.a (mgr.14355) 11484 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:26 smithi131 bash[24745]: cluster 2024-09-14T02:46:25.076550+0000 mgr.a (mgr.14355) 11484 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:26 smithi171 bash[25040]: cluster 2024-09-14T02:46:25.076550+0000 mgr.a (mgr.14355) 11484 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:46:27.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:27.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:27.831 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:28 smithi007 bash[22722]: cluster 2024-09-14T02:46:27.077985+0000 mgr.a (mgr.14355) 11485 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:28 smithi007 bash[22722]: audit 2024-09-14T02:46:27.380522+0000 mgr.a (mgr.14355) 11486 : audit [DBG] from='client.251868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:28 smithi131 bash[24745]: cluster 2024-09-14T02:46:27.077985+0000 mgr.a (mgr.14355) 11485 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:28 smithi131 bash[24745]: audit 2024-09-14T02:46:27.380522+0000 mgr.a (mgr.14355) 11486 : audit [DBG] from='client.251868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:28 smithi171 bash[25040]: cluster 2024-09-14T02:46:27.077985+0000 mgr.a (mgr.14355) 11485 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:46:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:28 smithi171 bash[25040]: audit 2024-09-14T02:46:27.380522+0000 mgr.a (mgr.14355) 11486 : audit [DBG] from='client.251868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:30 smithi007 bash[22722]: cluster 2024-09-14T02:46:29.078872+0000 mgr.a (mgr.14355) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:30 smithi131 bash[24745]: cluster 2024-09-14T02:46:29.078872+0000 mgr.a (mgr.14355) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:30 smithi171 bash[25040]: cluster 2024-09-14T02:46:29.078872+0000 mgr.a (mgr.14355) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:32 smithi007 bash[22722]: cluster 2024-09-14T02:46:31.081106+0000 mgr.a (mgr.14355) 11488 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:32 smithi131 bash[24745]: cluster 2024-09-14T02:46:31.081106+0000 mgr.a (mgr.14355) 11488 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:32 smithi171 bash[25040]: cluster 2024-09-14T02:46:31.081106+0000 mgr.a (mgr.14355) 11488 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T02:46:32.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:32.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:33.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:34 smithi007 bash[22722]: cluster 2024-09-14T02:46:33.081862+0000 mgr.a (mgr.14355) 11489 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:34 smithi007 bash[22722]: audit 2024-09-14T02:46:33.166200+0000 mgr.a (mgr.14355) 11490 : audit [DBG] from='client.251946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:34 smithi131 bash[24745]: cluster 2024-09-14T02:46:33.081862+0000 mgr.a (mgr.14355) 11489 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:34 smithi131 bash[24745]: audit 2024-09-14T02:46:33.166200+0000 mgr.a (mgr.14355) 11490 : audit [DBG] from='client.251946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:34 smithi171 bash[25040]: cluster 2024-09-14T02:46:33.081862+0000 mgr.a (mgr.14355) 11489 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:34 smithi171 bash[25040]: audit 2024-09-14T02:46:33.166200+0000 mgr.a (mgr.14355) 11490 : audit [DBG] from='client.251946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:36 smithi007 bash[22722]: cluster 2024-09-14T02:46:35.082779+0000 mgr.a (mgr.14355) 11491 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:36 smithi131 bash[24745]: cluster 2024-09-14T02:46:35.082779+0000 mgr.a (mgr.14355) 11491 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:36 smithi171 bash[25040]: cluster 2024-09-14T02:46:35.082779+0000 mgr.a (mgr.14355) 11491 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:38.610 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:38.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:38.611 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:38 smithi007 bash[22722]: cluster 2024-09-14T02:46:37.085017+0000 mgr.a (mgr.14355) 11492 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:38 smithi131 bash[24745]: cluster 2024-09-14T02:46:37.085017+0000 mgr.a (mgr.14355) 11492 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:38 smithi171 bash[25040]: cluster 2024-09-14T02:46:37.085017+0000 mgr.a (mgr.14355) 11492 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:39.364 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:40 smithi007 bash[22722]: audit 2024-09-14T02:46:38.938510+0000 mgr.a (mgr.14355) 11493 : audit [DBG] from='client.252021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:40 smithi007 bash[22722]: cluster 2024-09-14T02:46:39.085672+0000 mgr.a (mgr.14355) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:40 smithi131 bash[24745]: audit 2024-09-14T02:46:38.938510+0000 mgr.a (mgr.14355) 11493 : audit [DBG] from='client.252021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:40 smithi131 bash[24745]: cluster 2024-09-14T02:46:39.085672+0000 mgr.a (mgr.14355) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:40 smithi171 bash[25040]: audit 2024-09-14T02:46:38.938510+0000 mgr.a (mgr.14355) 11493 : audit [DBG] from='client.252021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:40 smithi171 bash[25040]: cluster 2024-09-14T02:46:39.085672+0000 mgr.a (mgr.14355) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:42 smithi007 bash[22722]: cluster 2024-09-14T02:46:41.087966+0000 mgr.a (mgr.14355) 11495 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:42 smithi131 bash[24745]: cluster 2024-09-14T02:46:41.087966+0000 mgr.a (mgr.14355) 11495 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:42 smithi171 bash[25040]: cluster 2024-09-14T02:46:41.087966+0000 mgr.a (mgr.14355) 11495 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:44.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:44.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:44.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:44 smithi007 bash[22722]: cluster 2024-09-14T02:46:43.088721+0000 mgr.a (mgr.14355) 11496 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:44 smithi131 bash[24745]: cluster 2024-09-14T02:46:43.088721+0000 mgr.a (mgr.14355) 11496 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:44 smithi171 bash[25040]: cluster 2024-09-14T02:46:43.088721+0000 mgr.a (mgr.14355) 11496 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:45.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:45.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:45 smithi007 bash[22722]: audit 2024-09-14T02:46:44.700663+0000 mgr.a (mgr.14355) 11497 : audit [DBG] from='client.252099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:45 smithi131 bash[24745]: audit 2024-09-14T02:46:44.700663+0000 mgr.a (mgr.14355) 11497 : audit [DBG] from='client.252099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:45 smithi171 bash[25040]: audit 2024-09-14T02:46:44.700663+0000 mgr.a (mgr.14355) 11497 : audit [DBG] from='client.252099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:46 smithi007 bash[22722]: cluster 2024-09-14T02:46:45.089374+0000 mgr.a (mgr.14355) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:46 smithi131 bash[24745]: cluster 2024-09-14T02:46:45.089374+0000 mgr.a (mgr.14355) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:46 smithi171 bash[25040]: cluster 2024-09-14T02:46:45.089374+0000 mgr.a (mgr.14355) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:48 smithi131 bash[24745]: cluster 2024-09-14T02:46:47.091672+0000 mgr.a (mgr.14355) 11499 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:48 smithi171 bash[25040]: cluster 2024-09-14T02:46:47.091672+0000 mgr.a (mgr.14355) 11499 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:48 smithi007 bash[22722]: cluster 2024-09-14T02:46:47.091672+0000 mgr.a (mgr.14355) 11499 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:46:50.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:50.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:50 smithi131 bash[24745]: cluster 2024-09-14T02:46:49.092446+0000 mgr.a (mgr.14355) 11500 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:50 smithi171 bash[25040]: cluster 2024-09-14T02:46:49.092446+0000 mgr.a (mgr.14355) 11500 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:50.917 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:50.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:50.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:50 smithi007 bash[22722]: cluster 2024-09-14T02:46:49.092446+0000 mgr.a (mgr.14355) 11500 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:51 smithi131 bash[24745]: audit 2024-09-14T02:46:50.477656+0000 mgr.a (mgr.14355) 11501 : audit [DBG] from='client.252174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:51 smithi171 bash[25040]: audit 2024-09-14T02:46:50.477656+0000 mgr.a (mgr.14355) 11501 : audit [DBG] from='client.252174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:51 smithi007 bash[22722]: audit 2024-09-14T02:46:50.477656+0000 mgr.a (mgr.14355) 11501 : audit [DBG] from='client.252174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:52 smithi131 bash[24745]: cluster 2024-09-14T02:46:51.095284+0000 mgr.a (mgr.14355) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:52 smithi171 bash[25040]: cluster 2024-09-14T02:46:51.095284+0000 mgr.a (mgr.14355) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:52 smithi007 bash[22722]: cluster 2024-09-14T02:46:51.095284+0000 mgr.a (mgr.14355) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:54 smithi131 bash[24745]: cluster 2024-09-14T02:46:53.096090+0000 mgr.a (mgr.14355) 11503 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:46:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:54 smithi171 bash[25040]: cluster 2024-09-14T02:46:53.096090+0000 mgr.a (mgr.14355) 11503 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:46:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:54 smithi007 bash[22722]: cluster 2024-09-14T02:46:53.096090+0000 mgr.a (mgr.14355) 11503 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:46:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:46:55.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:46:55.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:46:56.697 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:46:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:56 smithi131 bash[24745]: cluster 2024-09-14T02:46:55.096898+0000 mgr.a (mgr.14355) 11504 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:46:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:56 smithi171 bash[25040]: cluster 2024-09-14T02:46:55.096898+0000 mgr.a (mgr.14355) 11504 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:46:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:56 smithi007 bash[22722]: cluster 2024-09-14T02:46:55.096898+0000 mgr.a (mgr.14355) 11504 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:46:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:57 smithi131 bash[24745]: audit 2024-09-14T02:46:56.253828+0000 mgr.a (mgr.14355) 11505 : audit [DBG] from='client.252249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:57 smithi171 bash[25040]: audit 2024-09-14T02:46:56.253828+0000 mgr.a (mgr.14355) 11505 : audit [DBG] from='client.252249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:57 smithi007 bash[22722]: audit 2024-09-14T02:46:56.253828+0000 mgr.a (mgr.14355) 11505 : audit [DBG] from='client.252249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:46:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:46:58 smithi131 bash[24745]: cluster 2024-09-14T02:46:57.099779+0000 mgr.a (mgr.14355) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:46:58 smithi171 bash[25040]: cluster 2024-09-14T02:46:57.099779+0000 mgr.a (mgr.14355) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:46:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:46:58 smithi007 bash[22722]: cluster 2024-09-14T02:46:57.099779+0000 mgr.a (mgr.14355) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:00 smithi131 bash[24745]: cluster 2024-09-14T02:46:59.100585+0000 mgr.a (mgr.14355) 11507 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:00 smithi171 bash[25040]: cluster 2024-09-14T02:46:59.100585+0000 mgr.a (mgr.14355) 11507 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:00.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:00 smithi007 bash[22722]: cluster 2024-09-14T02:46:59.100585+0000 mgr.a (mgr.14355) 11507 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:01.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:02.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:02 smithi171 bash[25040]: cluster 2024-09-14T02:47:01.102642+0000 mgr.a (mgr.14355) 11508 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:02 smithi007 bash[22722]: cluster 2024-09-14T02:47:01.102642+0000 mgr.a (mgr.14355) 11508 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:02 smithi131 bash[24745]: cluster 2024-09-14T02:47:01.102642+0000 mgr.a (mgr.14355) 11508 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:03 smithi171 bash[25040]: audit 2024-09-14T02:47:02.027738+0000 mgr.a (mgr.14355) 11509 : audit [DBG] from='client.252324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:03 smithi007 bash[22722]: audit 2024-09-14T02:47:02.027738+0000 mgr.a (mgr.14355) 11509 : audit [DBG] from='client.252324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:03 smithi131 bash[24745]: audit 2024-09-14T02:47:02.027738+0000 mgr.a (mgr.14355) 11509 : audit [DBG] from='client.252324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:04 smithi171 bash[25040]: cluster 2024-09-14T02:47:03.103623+0000 mgr.a (mgr.14355) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:04 smithi007 bash[22722]: cluster 2024-09-14T02:47:03.103623+0000 mgr.a (mgr.14355) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:04 smithi131 bash[24745]: cluster 2024-09-14T02:47:03.103623+0000 mgr.a (mgr.14355) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:06 smithi007 bash[22722]: cluster 2024-09-14T02:47:05.104394+0000 mgr.a (mgr.14355) 11511 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:06 smithi131 bash[24745]: cluster 2024-09-14T02:47:05.104394+0000 mgr.a (mgr.14355) 11511 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:06 smithi171 bash[25040]: cluster 2024-09-14T02:47:05.104394+0000 mgr.a (mgr.14355) 11511 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:07.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:07.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:08 smithi007 bash[22722]: cluster 2024-09-14T02:47:07.106695+0000 mgr.a (mgr.14355) 11512 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:08 smithi131 bash[24745]: cluster 2024-09-14T02:47:07.106695+0000 mgr.a (mgr.14355) 11512 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:08 smithi171 bash[25040]: cluster 2024-09-14T02:47:07.106695+0000 mgr.a (mgr.14355) 11512 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:09 smithi007 bash[22722]: audit 2024-09-14T02:47:07.789120+0000 mgr.a (mgr.14355) 11513 : audit [DBG] from='client.252399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:09 smithi131 bash[24745]: audit 2024-09-14T02:47:07.789120+0000 mgr.a (mgr.14355) 11513 : audit [DBG] from='client.252399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:09 smithi171 bash[25040]: audit 2024-09-14T02:47:07.789120+0000 mgr.a (mgr.14355) 11513 : audit [DBG] from='client.252399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:10 smithi007 bash[22722]: cluster 2024-09-14T02:47:09.107789+0000 mgr.a (mgr.14355) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:10 smithi131 bash[24745]: cluster 2024-09-14T02:47:09.107789+0000 mgr.a (mgr.14355) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:10 smithi171 bash[25040]: cluster 2024-09-14T02:47:09.107789+0000 mgr.a (mgr.14355) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:12 smithi007 bash[22722]: cluster 2024-09-14T02:47:11.110100+0000 mgr.a (mgr.14355) 11515 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:12 smithi131 bash[24745]: cluster 2024-09-14T02:47:11.110100+0000 mgr.a (mgr.14355) 11515 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:12 smithi171 bash[25040]: cluster 2024-09-14T02:47:11.110100+0000 mgr.a (mgr.14355) 11515 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:13.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:13.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:13.987 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:14 smithi007 bash[22722]: cluster 2024-09-14T02:47:13.110880+0000 mgr.a (mgr.14355) 11516 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:14 smithi007 bash[22722]: audit 2024-09-14T02:47:13.549697+0000 mgr.a (mgr.14355) 11517 : audit [DBG] from='client.252477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:14 smithi131 bash[24745]: cluster 2024-09-14T02:47:13.110880+0000 mgr.a (mgr.14355) 11516 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:14 smithi131 bash[24745]: audit 2024-09-14T02:47:13.549697+0000 mgr.a (mgr.14355) 11517 : audit [DBG] from='client.252477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:14 smithi171 bash[25040]: cluster 2024-09-14T02:47:13.110880+0000 mgr.a (mgr.14355) 11516 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:14 smithi171 bash[25040]: audit 2024-09-14T02:47:13.549697+0000 mgr.a (mgr.14355) 11517 : audit [DBG] from='client.252477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:16 smithi007 bash[22722]: cluster 2024-09-14T02:47:15.111951+0000 mgr.a (mgr.14355) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:16 smithi007 bash[22722]: audit 2024-09-14T02:47:15.730457+0000 mon.a (mon.0) 2311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:47:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:16 smithi007 bash[22722]: audit 2024-09-14T02:47:16.562708+0000 mon.a (mon.0) 2312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:47:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:16 smithi007 bash[22722]: audit 2024-09-14T02:47:16.564109+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:47:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:16 smithi131 bash[24745]: cluster 2024-09-14T02:47:15.111951+0000 mgr.a (mgr.14355) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:16 smithi131 bash[24745]: audit 2024-09-14T02:47:15.730457+0000 mon.a (mon.0) 2311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:47:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:16 smithi131 bash[24745]: audit 2024-09-14T02:47:16.562708+0000 mon.a (mon.0) 2312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:47:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:16 smithi131 bash[24745]: audit 2024-09-14T02:47:16.564109+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:47:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:16 smithi171 bash[25040]: cluster 2024-09-14T02:47:15.111951+0000 mgr.a (mgr.14355) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:16 smithi171 bash[25040]: audit 2024-09-14T02:47:15.730457+0000 mon.a (mon.0) 2311 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:47:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:16 smithi171 bash[25040]: audit 2024-09-14T02:47:16.562708+0000 mon.a (mon.0) 2312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:47:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:16 smithi171 bash[25040]: audit 2024-09-14T02:47:16.564109+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:47:17.585 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:47:17 smithi007 bash[22972]: debug 2024-09-14T02:47:17.317+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:47:17.585 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:47:17 smithi007 bash[22972]: debug 2024-09-14T02:47:17.317+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:47:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:17 smithi007 bash[22722]: audit 2024-09-14T02:47:16.573898+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:47:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:17 smithi007 bash[22722]: audit 2024-09-14T02:47:16.582943+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:17 smithi007 bash[22722]: audit 2024-09-14T02:47:16.585264+0000 mgr.a (mgr.14355) 11519 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:17 smithi131 bash[24745]: audit 2024-09-14T02:47:16.573898+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:47:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:17 smithi131 bash[24745]: audit 2024-09-14T02:47:16.582943+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:17 smithi131 bash[24745]: audit 2024-09-14T02:47:16.585264+0000 mgr.a (mgr.14355) 11519 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:17 smithi171 bash[25040]: audit 2024-09-14T02:47:16.573898+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:47:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:17 smithi171 bash[25040]: audit 2024-09-14T02:47:16.582943+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:17 smithi171 bash[25040]: audit 2024-09-14T02:47:16.585264+0000 mgr.a (mgr.14355) 11519 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:47:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:18 smithi007 bash[22722]: cluster 2024-09-14T02:47:17.113364+0000 mgr.a (mgr.14355) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:18 smithi007 bash[22722]: audit 2024-09-14T02:47:17.320058+0000 mgr.a (mgr.14355) 11521 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:47:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:18 smithi007 bash[22722]: cephadm 2024-09-14T02:47:17.321365+0000 mgr.a (mgr.14355) 11522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:47:18.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:18.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:18 smithi131 bash[24745]: cluster 2024-09-14T02:47:17.113364+0000 mgr.a (mgr.14355) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:18 smithi131 bash[24745]: audit 2024-09-14T02:47:17.320058+0000 mgr.a (mgr.14355) 11521 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:47:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:18 smithi131 bash[24745]: cephadm 2024-09-14T02:47:17.321365+0000 mgr.a (mgr.14355) 11522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:47:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:18 smithi171 bash[25040]: cluster 2024-09-14T02:47:17.113364+0000 mgr.a (mgr.14355) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:18 smithi171 bash[25040]: audit 2024-09-14T02:47:17.320058+0000 mgr.a (mgr.14355) 11521 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:47:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:18 smithi171 bash[25040]: cephadm 2024-09-14T02:47:17.321365+0000 mgr.a (mgr.14355) 11522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:47:19.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:19.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:20 smithi007 bash[22722]: cluster 2024-09-14T02:47:19.113776+0000 mgr.a (mgr.14355) 11523 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:20 smithi007 bash[22722]: audit 2024-09-14T02:47:19.323128+0000 mgr.a (mgr.14355) 11524 : audit [DBG] from='client.252660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:20 smithi131 bash[24745]: cluster 2024-09-14T02:47:19.113776+0000 mgr.a (mgr.14355) 11523 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:20 smithi131 bash[24745]: audit 2024-09-14T02:47:19.323128+0000 mgr.a (mgr.14355) 11524 : audit [DBG] from='client.252660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:20 smithi171 bash[25040]: cluster 2024-09-14T02:47:19.113776+0000 mgr.a (mgr.14355) 11523 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:20 smithi171 bash[25040]: audit 2024-09-14T02:47:19.323128+0000 mgr.a (mgr.14355) 11524 : audit [DBG] from='client.252660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:22 smithi007 bash[22722]: cluster 2024-09-14T02:47:21.116181+0000 mgr.a (mgr.14355) 11525 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:22 smithi131 bash[24745]: cluster 2024-09-14T02:47:21.116181+0000 mgr.a (mgr.14355) 11525 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:22 smithi171 bash[25040]: cluster 2024-09-14T02:47:21.116181+0000 mgr.a (mgr.14355) 11525 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:24.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:24.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:24.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:24 smithi007 bash[22722]: cluster 2024-09-14T02:47:23.116970+0000 mgr.a (mgr.14355) 11526 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:24 smithi131 bash[24745]: cluster 2024-09-14T02:47:23.116970+0000 mgr.a (mgr.14355) 11526 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:24 smithi171 bash[25040]: cluster 2024-09-14T02:47:23.116970+0000 mgr.a (mgr.14355) 11526 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:25.498 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:25.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:26 smithi007 bash[22722]: audit 2024-09-14T02:47:25.078844+0000 mgr.a (mgr.14355) 11527 : audit [DBG] from='client.252735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:26 smithi007 bash[22722]: cluster 2024-09-14T02:47:25.117727+0000 mgr.a (mgr.14355) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:26 smithi131 bash[24745]: audit 2024-09-14T02:47:25.078844+0000 mgr.a (mgr.14355) 11527 : audit [DBG] from='client.252735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:26 smithi131 bash[24745]: cluster 2024-09-14T02:47:25.117727+0000 mgr.a (mgr.14355) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:26 smithi171 bash[25040]: audit 2024-09-14T02:47:25.078844+0000 mgr.a (mgr.14355) 11527 : audit [DBG] from='client.252735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:26 smithi171 bash[25040]: cluster 2024-09-14T02:47:25.117727+0000 mgr.a (mgr.14355) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:28 smithi007 bash[22722]: cluster 2024-09-14T02:47:27.120451+0000 mgr.a (mgr.14355) 11529 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:28 smithi131 bash[24745]: cluster 2024-09-14T02:47:27.120451+0000 mgr.a (mgr.14355) 11529 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:28 smithi171 bash[25040]: cluster 2024-09-14T02:47:27.120451+0000 mgr.a (mgr.14355) 11529 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:30.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:30.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:30.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:30 smithi007 bash[22722]: cluster 2024-09-14T02:47:29.121255+0000 mgr.a (mgr.14355) 11530 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:47:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:30 smithi131 bash[24745]: cluster 2024-09-14T02:47:29.121255+0000 mgr.a (mgr.14355) 11530 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:47:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:30 smithi171 bash[25040]: cluster 2024-09-14T02:47:29.121255+0000 mgr.a (mgr.14355) 11530 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:47:31.282 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:31.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:31.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:31.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:31.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:32 smithi007 bash[22722]: audit 2024-09-14T02:47:30.835241+0000 mgr.a (mgr.14355) 11531 : audit [DBG] from='client.252813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:32 smithi007 bash[22722]: cluster 2024-09-14T02:47:31.122722+0000 mgr.a (mgr.14355) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:32 smithi131 bash[24745]: audit 2024-09-14T02:47:30.835241+0000 mgr.a (mgr.14355) 11531 : audit [DBG] from='client.252813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:32 smithi131 bash[24745]: cluster 2024-09-14T02:47:31.122722+0000 mgr.a (mgr.14355) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:32 smithi171 bash[25040]: audit 2024-09-14T02:47:30.835241+0000 mgr.a (mgr.14355) 11531 : audit [DBG] from='client.252813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:32 smithi171 bash[25040]: cluster 2024-09-14T02:47:31.122722+0000 mgr.a (mgr.14355) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:47:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:34 smithi007 bash[22722]: cluster 2024-09-14T02:47:33.123597+0000 mgr.a (mgr.14355) 11533 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:34 smithi131 bash[24745]: cluster 2024-09-14T02:47:33.123597+0000 mgr.a (mgr.14355) 11533 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:34 smithi171 bash[25040]: cluster 2024-09-14T02:47:33.123597+0000 mgr.a (mgr.14355) 11533 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:47:36.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:36.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:36 smithi007 bash[22722]: cluster 2024-09-14T02:47:35.124372+0000 mgr.a (mgr.14355) 11534 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:47:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:36 smithi131 bash[24745]: cluster 2024-09-14T02:47:35.124372+0000 mgr.a (mgr.14355) 11534 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:47:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:36 smithi171 bash[25040]: cluster 2024-09-14T02:47:35.124372+0000 mgr.a (mgr.14355) 11534 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:47:37.047 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:37.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:37 smithi007 bash[22722]: audit 2024-09-14T02:47:36.619650+0000 mgr.a (mgr.14355) 11535 : audit [DBG] from='client.252888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:37 smithi131 bash[24745]: audit 2024-09-14T02:47:36.619650+0000 mgr.a (mgr.14355) 11535 : audit [DBG] from='client.252888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:37 smithi171 bash[25040]: audit 2024-09-14T02:47:36.619650+0000 mgr.a (mgr.14355) 11535 : audit [DBG] from='client.252888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:38 smithi007 bash[22722]: cluster 2024-09-14T02:47:37.127156+0000 mgr.a (mgr.14355) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:38 smithi131 bash[24745]: cluster 2024-09-14T02:47:37.127156+0000 mgr.a (mgr.14355) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:38 smithi171 bash[25040]: cluster 2024-09-14T02:47:37.127156+0000 mgr.a (mgr.14355) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:40 smithi007 bash[22722]: cluster 2024-09-14T02:47:39.127960+0000 mgr.a (mgr.14355) 11537 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:47:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:40 smithi131 bash[24745]: cluster 2024-09-14T02:47:39.127960+0000 mgr.a (mgr.14355) 11537 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:47:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:40 smithi171 bash[25040]: cluster 2024-09-14T02:47:39.127960+0000 mgr.a (mgr.14355) 11537 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:47:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:42.050 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:42.820 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:42.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:42 smithi007 bash[22722]: cluster 2024-09-14T02:47:41.129948+0000 mgr.a (mgr.14355) 11538 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:47:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:42 smithi131 bash[24745]: cluster 2024-09-14T02:47:41.129948+0000 mgr.a (mgr.14355) 11538 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:47:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:42 smithi171 bash[25040]: cluster 2024-09-14T02:47:41.129948+0000 mgr.a (mgr.14355) 11538 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:47:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:43 smithi007 bash[22722]: audit 2024-09-14T02:47:42.384761+0000 mgr.a (mgr.14355) 11539 : audit [DBG] from='client.252966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:43 smithi131 bash[24745]: audit 2024-09-14T02:47:42.384761+0000 mgr.a (mgr.14355) 11539 : audit [DBG] from='client.252966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:43 smithi171 bash[25040]: audit 2024-09-14T02:47:42.384761+0000 mgr.a (mgr.14355) 11539 : audit [DBG] from='client.252966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:44 smithi007 bash[22722]: cluster 2024-09-14T02:47:43.130845+0000 mgr.a (mgr.14355) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:44 smithi131 bash[24745]: cluster 2024-09-14T02:47:43.130845+0000 mgr.a (mgr.14355) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:44 smithi171 bash[25040]: cluster 2024-09-14T02:47:43.130845+0000 mgr.a (mgr.14355) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:46 smithi007 bash[22722]: cluster 2024-09-14T02:47:45.131619+0000 mgr.a (mgr.14355) 11541 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:46 smithi131 bash[24745]: cluster 2024-09-14T02:47:45.131619+0000 mgr.a (mgr.14355) 11541 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:46 smithi171 bash[25040]: cluster 2024-09-14T02:47:45.131619+0000 mgr.a (mgr.14355) 11541 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:47.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:47.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:47.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:48.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:48.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:48 smithi007 bash[22722]: cluster 2024-09-14T02:47:47.133845+0000 mgr.a (mgr.14355) 11542 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:48 smithi131 bash[24745]: cluster 2024-09-14T02:47:47.133845+0000 mgr.a (mgr.14355) 11542 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:48 smithi171 bash[25040]: cluster 2024-09-14T02:47:47.133845+0000 mgr.a (mgr.14355) 11542 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:49 smithi007 bash[22722]: audit 2024-09-14T02:47:48.155832+0000 mgr.a (mgr.14355) 11543 : audit [DBG] from='client.253041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:49 smithi131 bash[24745]: audit 2024-09-14T02:47:48.155832+0000 mgr.a (mgr.14355) 11543 : audit [DBG] from='client.253041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:49 smithi171 bash[25040]: audit 2024-09-14T02:47:48.155832+0000 mgr.a (mgr.14355) 11543 : audit [DBG] from='client.253041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:50 smithi007 bash[22722]: cluster 2024-09-14T02:47:49.134799+0000 mgr.a (mgr.14355) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:50 smithi131 bash[24745]: cluster 2024-09-14T02:47:49.134799+0000 mgr.a (mgr.14355) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:50 smithi171 bash[25040]: cluster 2024-09-14T02:47:49.134799+0000 mgr.a (mgr.14355) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:52 smithi007 bash[22722]: cluster 2024-09-14T02:47:51.137053+0000 mgr.a (mgr.14355) 11545 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:52 smithi131 bash[24745]: cluster 2024-09-14T02:47:51.137053+0000 mgr.a (mgr.14355) 11545 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:52 smithi171 bash[25040]: cluster 2024-09-14T02:47:51.137053+0000 mgr.a (mgr.14355) 11545 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:53.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:53.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:53.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:47:54.365 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:47:54.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:47:54.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:47:54.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:47:54.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:47:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:54 smithi007 bash[22722]: cluster 2024-09-14T02:47:53.137803+0000 mgr.a (mgr.14355) 11546 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:54 smithi131 bash[24745]: cluster 2024-09-14T02:47:53.137803+0000 mgr.a (mgr.14355) 11546 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:54 smithi171 bash[25040]: cluster 2024-09-14T02:47:53.137803+0000 mgr.a (mgr.14355) 11546 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:55 smithi007 bash[22722]: audit 2024-09-14T02:47:53.931520+0000 mgr.a (mgr.14355) 11547 : audit [DBG] from='client.253116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:55 smithi131 bash[24745]: audit 2024-09-14T02:47:53.931520+0000 mgr.a (mgr.14355) 11547 : audit [DBG] from='client.253116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:55 smithi171 bash[25040]: audit 2024-09-14T02:47:53.931520+0000 mgr.a (mgr.14355) 11547 : audit [DBG] from='client.253116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:47:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:56 smithi007 bash[22722]: cluster 2024-09-14T02:47:55.138792+0000 mgr.a (mgr.14355) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:56 smithi131 bash[24745]: cluster 2024-09-14T02:47:55.138792+0000 mgr.a (mgr.14355) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:56 smithi171 bash[25040]: cluster 2024-09-14T02:47:55.138792+0000 mgr.a (mgr.14355) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:47:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:47:58 smithi007 bash[22722]: cluster 2024-09-14T02:47:57.141058+0000 mgr.a (mgr.14355) 11549 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:47:58 smithi131 bash[24745]: cluster 2024-09-14T02:47:57.141058+0000 mgr.a (mgr.14355) 11549 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:47:58 smithi171 bash[25040]: cluster 2024-09-14T02:47:57.141058+0000 mgr.a (mgr.14355) 11549 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:47:59.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:47:59.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:47:59.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:00.119 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:00.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:00.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:00.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:00.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:00 smithi131 bash[24745]: cluster 2024-09-14T02:47:59.141827+0000 mgr.a (mgr.14355) 11550 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:00 smithi131 bash[24745]: audit 2024-09-14T02:47:59.690272+0000 mgr.a (mgr.14355) 11551 : audit [DBG] from='client.253194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:00 smithi171 bash[25040]: cluster 2024-09-14T02:47:59.141827+0000 mgr.a (mgr.14355) 11550 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:00 smithi171 bash[25040]: audit 2024-09-14T02:47:59.690272+0000 mgr.a (mgr.14355) 11551 : audit [DBG] from='client.253194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:00 smithi007 bash[22722]: cluster 2024-09-14T02:47:59.141827+0000 mgr.a (mgr.14355) 11550 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:00 smithi007 bash[22722]: audit 2024-09-14T02:47:59.690272+0000 mgr.a (mgr.14355) 11551 : audit [DBG] from='client.253194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:02 smithi131 bash[24745]: cluster 2024-09-14T02:48:01.144313+0000 mgr.a (mgr.14355) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:02 smithi171 bash[25040]: cluster 2024-09-14T02:48:01.144313+0000 mgr.a (mgr.14355) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:02 smithi007 bash[22722]: cluster 2024-09-14T02:48:01.144313+0000 mgr.a (mgr.14355) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:04 smithi131 bash[24745]: cluster 2024-09-14T02:48:03.145112+0000 mgr.a (mgr.14355) 11553 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:04 smithi171 bash[25040]: cluster 2024-09-14T02:48:03.145112+0000 mgr.a (mgr.14355) 11553 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:05.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:05.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:05.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:04 smithi007 bash[22722]: cluster 2024-09-14T02:48:03.145112+0000 mgr.a (mgr.14355) 11553 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:05.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:05.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:06 smithi131 bash[24745]: cluster 2024-09-14T02:48:05.145833+0000 mgr.a (mgr.14355) 11554 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:06 smithi131 bash[24745]: audit 2024-09-14T02:48:05.459676+0000 mgr.a (mgr.14355) 11555 : audit [DBG] from='client.253269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:06 smithi171 bash[25040]: cluster 2024-09-14T02:48:05.145833+0000 mgr.a (mgr.14355) 11554 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:06 smithi171 bash[25040]: audit 2024-09-14T02:48:05.459676+0000 mgr.a (mgr.14355) 11555 : audit [DBG] from='client.253269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:06 smithi007 bash[22722]: cluster 2024-09-14T02:48:05.145833+0000 mgr.a (mgr.14355) 11554 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:06 smithi007 bash[22722]: audit 2024-09-14T02:48:05.459676+0000 mgr.a (mgr.14355) 11555 : audit [DBG] from='client.253269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:08 smithi131 bash[24745]: cluster 2024-09-14T02:48:07.148548+0000 mgr.a (mgr.14355) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:08 smithi171 bash[25040]: cluster 2024-09-14T02:48:07.148548+0000 mgr.a (mgr.14355) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:08 smithi007 bash[22722]: cluster 2024-09-14T02:48:07.148548+0000 mgr.a (mgr.14355) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:10.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:10.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:10.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:10 smithi131 bash[24745]: cluster 2024-09-14T02:48:09.149350+0000 mgr.a (mgr.14355) 11557 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:10 smithi171 bash[25040]: cluster 2024-09-14T02:48:09.149350+0000 mgr.a (mgr.14355) 11557 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:10 smithi007 bash[22722]: cluster 2024-09-14T02:48:09.149350+0000 mgr.a (mgr.14355) 11557 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:11.680 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:11.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:12 smithi131 bash[24745]: cluster 2024-09-14T02:48:11.150653+0000 mgr.a (mgr.14355) 11558 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:12 smithi131 bash[24745]: audit 2024-09-14T02:48:11.240854+0000 mgr.a (mgr.14355) 11559 : audit [DBG] from='client.253344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:12 smithi171 bash[25040]: cluster 2024-09-14T02:48:11.150653+0000 mgr.a (mgr.14355) 11558 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:12 smithi171 bash[25040]: audit 2024-09-14T02:48:11.240854+0000 mgr.a (mgr.14355) 11559 : audit [DBG] from='client.253344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:12 smithi007 bash[22722]: cluster 2024-09-14T02:48:11.150653+0000 mgr.a (mgr.14355) 11558 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:12 smithi007 bash[22722]: audit 2024-09-14T02:48:11.240854+0000 mgr.a (mgr.14355) 11559 : audit [DBG] from='client.253344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:14 smithi131 bash[24745]: cluster 2024-09-14T02:48:13.151521+0000 mgr.a (mgr.14355) 11560 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:14 smithi171 bash[25040]: cluster 2024-09-14T02:48:13.151521+0000 mgr.a (mgr.14355) 11560 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:14 smithi007 bash[22722]: cluster 2024-09-14T02:48:13.151521+0000 mgr.a (mgr.14355) 11560 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:16.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:16.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:16 smithi131 bash[24745]: cluster 2024-09-14T02:48:15.152322+0000 mgr.a (mgr.14355) 11561 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:48:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:16 smithi171 bash[25040]: cluster 2024-09-14T02:48:15.152322+0000 mgr.a (mgr.14355) 11561 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:48:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:16 smithi007 bash[22722]: cluster 2024-09-14T02:48:15.152322+0000 mgr.a (mgr.14355) 11561 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:48:17.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:17 smithi131 bash[24745]: audit 2024-09-14T02:48:17.372518+0000 mon.a (mon.0) 2316 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:48:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:17 smithi171 bash[25040]: audit 2024-09-14T02:48:17.372518+0000 mon.a (mon.0) 2316 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:48:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:17 smithi007 bash[22722]: audit 2024-09-14T02:48:17.372518+0000 mon.a (mon.0) 2316 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:48:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:17.017612+0000 mgr.a (mgr.14355) 11562 : audit [DBG] from='client.253419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: cluster 2024-09-14T02:48:17.153814+0000 mgr.a (mgr.14355) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:17.925741+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:17.930469+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:18.532812+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:48:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:18.534486+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:48:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:18.544465+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:18 smithi131 bash[24745]: audit 2024-09-14T02:48:18.547477+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:17.017612+0000 mgr.a (mgr.14355) 11562 : audit [DBG] from='client.253419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: cluster 2024-09-14T02:48:17.153814+0000 mgr.a (mgr.14355) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:17.925741+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:17.930469+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:18.532812+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:18.534486+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:18.544465+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:18 smithi171 bash[25040]: audit 2024-09-14T02:48:18.547477+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:17.017612+0000 mgr.a (mgr.14355) 11562 : audit [DBG] from='client.253419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: cluster 2024-09-14T02:48:17.153814+0000 mgr.a (mgr.14355) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:17.925741+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:17.930469+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:18.532812+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:18.534486+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:48:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:18.544465+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:48:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:18 smithi007 bash[22722]: audit 2024-09-14T02:48:18.547477+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:19.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:48:19 smithi007 bash[22972]: debug 2024-09-14T02:48:19.300+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:48:19.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:48:19 smithi007 bash[22972]: debug 2024-09-14T02:48:19.300+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:48:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:19 smithi131 bash[24745]: audit 2024-09-14T02:48:18.548864+0000 mgr.a (mgr.14355) 11564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:19 smithi171 bash[25040]: audit 2024-09-14T02:48:18.548864+0000 mgr.a (mgr.14355) 11564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:19 smithi007 bash[22722]: audit 2024-09-14T02:48:18.548864+0000 mgr.a (mgr.14355) 11564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:48:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:20 smithi131 bash[24745]: cluster 2024-09-14T02:48:19.154290+0000 mgr.a (mgr.14355) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:20 smithi131 bash[24745]: audit 2024-09-14T02:48:19.302380+0000 mgr.a (mgr.14355) 11566 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:48:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:20 smithi131 bash[24745]: cephadm 2024-09-14T02:48:19.304121+0000 mgr.a (mgr.14355) 11567 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:48:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:20 smithi171 bash[25040]: cluster 2024-09-14T02:48:19.154290+0000 mgr.a (mgr.14355) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:20 smithi171 bash[25040]: audit 2024-09-14T02:48:19.302380+0000 mgr.a (mgr.14355) 11566 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:48:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:20 smithi171 bash[25040]: cephadm 2024-09-14T02:48:19.304121+0000 mgr.a (mgr.14355) 11567 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:48:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:20 smithi007 bash[22722]: cluster 2024-09-14T02:48:19.154290+0000 mgr.a (mgr.14355) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:20 smithi007 bash[22722]: audit 2024-09-14T02:48:19.302380+0000 mgr.a (mgr.14355) 11566 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:48:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:20 smithi007 bash[22722]: cephadm 2024-09-14T02:48:19.304121+0000 mgr.a (mgr.14355) 11567 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:48:22.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:22.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:23.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:22 smithi131 bash[24745]: cluster 2024-09-14T02:48:21.156584+0000 mgr.a (mgr.14355) 11568 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:22 smithi171 bash[25040]: cluster 2024-09-14T02:48:21.156584+0000 mgr.a (mgr.14355) 11568 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:22 smithi007 bash[22722]: cluster 2024-09-14T02:48:21.156584+0000 mgr.a (mgr.14355) 11568 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:23.233 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:23.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:23.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:23.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:23.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:25.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:24 smithi131 bash[24745]: audit 2024-09-14T02:48:22.797573+0000 mgr.a (mgr.14355) 11569 : audit [DBG] from='client.253605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:25.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:24 smithi131 bash[24745]: cluster 2024-09-14T02:48:23.157180+0000 mgr.a (mgr.14355) 11570 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:24 smithi171 bash[25040]: audit 2024-09-14T02:48:22.797573+0000 mgr.a (mgr.14355) 11569 : audit [DBG] from='client.253605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:24 smithi171 bash[25040]: cluster 2024-09-14T02:48:23.157180+0000 mgr.a (mgr.14355) 11570 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:24 smithi007 bash[22722]: audit 2024-09-14T02:48:22.797573+0000 mgr.a (mgr.14355) 11569 : audit [DBG] from='client.253605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:24 smithi007 bash[22722]: cluster 2024-09-14T02:48:23.157180+0000 mgr.a (mgr.14355) 11570 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:26 smithi131 bash[24745]: cluster 2024-09-14T02:48:25.157912+0000 mgr.a (mgr.14355) 11571 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:26 smithi171 bash[25040]: cluster 2024-09-14T02:48:25.157912+0000 mgr.a (mgr.14355) 11571 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:26 smithi007 bash[22722]: cluster 2024-09-14T02:48:25.157912+0000 mgr.a (mgr.14355) 11571 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:27 smithi007 bash[22722]: cluster 2024-09-14T02:48:27.160181+0000 mgr.a (mgr.14355) 11572 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:28.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:27 smithi131 bash[24745]: cluster 2024-09-14T02:48:27.160181+0000 mgr.a (mgr.14355) 11572 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:27 smithi171 bash[25040]: cluster 2024-09-14T02:48:27.160181+0000 mgr.a (mgr.14355) 11572 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:28.998 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:28.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:28.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:28.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:28.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:28 smithi007 bash[22722]: audit 2024-09-14T02:48:28.565829+0000 mgr.a (mgr.14355) 11573 : audit [DBG] from='client.253683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:28 smithi131 bash[24745]: audit 2024-09-14T02:48:28.565829+0000 mgr.a (mgr.14355) 11573 : audit [DBG] from='client.253683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:28 smithi171 bash[25040]: audit 2024-09-14T02:48:28.565829+0000 mgr.a (mgr.14355) 11573 : audit [DBG] from='client.253683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:29 smithi007 bash[22722]: cluster 2024-09-14T02:48:29.160837+0000 mgr.a (mgr.14355) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:29 smithi131 bash[24745]: cluster 2024-09-14T02:48:29.160837+0000 mgr.a (mgr.14355) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:29 smithi171 bash[25040]: cluster 2024-09-14T02:48:29.160837+0000 mgr.a (mgr.14355) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:32 smithi131 bash[24745]: cluster 2024-09-14T02:48:31.163205+0000 mgr.a (mgr.14355) 11575 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:32 smithi171 bash[25040]: cluster 2024-09-14T02:48:31.163205+0000 mgr.a (mgr.14355) 11575 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:32 smithi007 bash[22722]: cluster 2024-09-14T02:48:31.163205+0000 mgr.a (mgr.14355) 11575 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:48:34.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:34.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:34.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:34 smithi131 bash[24745]: cluster 2024-09-14T02:48:33.164167+0000 mgr.a (mgr.14355) 11576 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:34 smithi171 bash[25040]: cluster 2024-09-14T02:48:33.164167+0000 mgr.a (mgr.14355) 11576 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:34 smithi007 bash[22722]: cluster 2024-09-14T02:48:33.164167+0000 mgr.a (mgr.14355) 11576 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:34.771 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:34.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:35 smithi131 bash[24745]: audit 2024-09-14T02:48:34.344383+0000 mgr.a (mgr.14355) 11577 : audit [DBG] from='client.253761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:35 smithi171 bash[25040]: audit 2024-09-14T02:48:34.344383+0000 mgr.a (mgr.14355) 11577 : audit [DBG] from='client.253761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:35 smithi007 bash[22722]: audit 2024-09-14T02:48:34.344383+0000 mgr.a (mgr.14355) 11577 : audit [DBG] from='client.253761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:36 smithi131 bash[24745]: cluster 2024-09-14T02:48:35.165109+0000 mgr.a (mgr.14355) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:36 smithi171 bash[25040]: cluster 2024-09-14T02:48:35.165109+0000 mgr.a (mgr.14355) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:36 smithi007 bash[22722]: cluster 2024-09-14T02:48:35.165109+0000 mgr.a (mgr.14355) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:38 smithi131 bash[24745]: cluster 2024-09-14T02:48:37.167383+0000 mgr.a (mgr.14355) 11579 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:38 smithi171 bash[25040]: cluster 2024-09-14T02:48:37.167383+0000 mgr.a (mgr.14355) 11579 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:38 smithi007 bash[22722]: cluster 2024-09-14T02:48:37.167383+0000 mgr.a (mgr.14355) 11579 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:39.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:39.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:39.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:40 smithi131 bash[24745]: cluster 2024-09-14T02:48:39.168174+0000 mgr.a (mgr.14355) 11580 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:40 smithi171 bash[25040]: cluster 2024-09-14T02:48:39.168174+0000 mgr.a (mgr.14355) 11580 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:40.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:40.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:40.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:40 smithi007 bash[22722]: cluster 2024-09-14T02:48:39.168174+0000 mgr.a (mgr.14355) 11580 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:41 smithi131 bash[24745]: audit 2024-09-14T02:48:40.111012+0000 mgr.a (mgr.14355) 11581 : audit [DBG] from='client.253839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:41 smithi171 bash[25040]: audit 2024-09-14T02:48:40.111012+0000 mgr.a (mgr.14355) 11581 : audit [DBG] from='client.253839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:41 smithi007 bash[22722]: audit 2024-09-14T02:48:40.111012+0000 mgr.a (mgr.14355) 11581 : audit [DBG] from='client.253839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:42 smithi131 bash[24745]: cluster 2024-09-14T02:48:41.171075+0000 mgr.a (mgr.14355) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:42 smithi171 bash[25040]: cluster 2024-09-14T02:48:41.171075+0000 mgr.a (mgr.14355) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:42 smithi007 bash[22722]: cluster 2024-09-14T02:48:41.171075+0000 mgr.a (mgr.14355) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:44 smithi131 bash[24745]: cluster 2024-09-14T02:48:43.171830+0000 mgr.a (mgr.14355) 11583 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:44 smithi171 bash[25040]: cluster 2024-09-14T02:48:43.171830+0000 mgr.a (mgr.14355) 11583 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:44 smithi007 bash[22722]: cluster 2024-09-14T02:48:43.171830+0000 mgr.a (mgr.14355) 11583 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:45.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:45.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:45.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:46.306 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:46.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:46.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:46.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:46.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:46 smithi131 bash[24745]: cluster 2024-09-14T02:48:45.172595+0000 mgr.a (mgr.14355) 11584 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:46 smithi171 bash[25040]: cluster 2024-09-14T02:48:45.172595+0000 mgr.a (mgr.14355) 11584 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:46 smithi007 bash[22722]: cluster 2024-09-14T02:48:45.172595+0000 mgr.a (mgr.14355) 11584 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:47 smithi131 bash[24745]: audit 2024-09-14T02:48:45.885195+0000 mgr.a (mgr.14355) 11585 : audit [DBG] from='client.253917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:47 smithi171 bash[25040]: audit 2024-09-14T02:48:45.885195+0000 mgr.a (mgr.14355) 11585 : audit [DBG] from='client.253917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:47 smithi007 bash[22722]: audit 2024-09-14T02:48:45.885195+0000 mgr.a (mgr.14355) 11585 : audit [DBG] from='client.253917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:48 smithi131 bash[24745]: cluster 2024-09-14T02:48:47.175321+0000 mgr.a (mgr.14355) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:48 smithi171 bash[25040]: cluster 2024-09-14T02:48:47.175321+0000 mgr.a (mgr.14355) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:48 smithi007 bash[22722]: cluster 2024-09-14T02:48:47.175321+0000 mgr.a (mgr.14355) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:50 smithi171 bash[25040]: cluster 2024-09-14T02:48:49.176134+0000 mgr.a (mgr.14355) 11587 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:50 smithi007 bash[22722]: cluster 2024-09-14T02:48:49.176134+0000 mgr.a (mgr.14355) 11587 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:50 smithi131 bash[24745]: cluster 2024-09-14T02:48:49.176134+0000 mgr.a (mgr.14355) 11587 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:48:51.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:51.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:51.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:52.062 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:52.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:52.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:52 smithi171 bash[25040]: cluster 2024-09-14T02:48:51.178109+0000 mgr.a (mgr.14355) 11588 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:52 smithi171 bash[25040]: audit 2024-09-14T02:48:51.644094+0000 mgr.a (mgr.14355) 11589 : audit [DBG] from='client.253992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:52 smithi007 bash[22722]: cluster 2024-09-14T02:48:51.178109+0000 mgr.a (mgr.14355) 11588 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:52 smithi007 bash[22722]: audit 2024-09-14T02:48:51.644094+0000 mgr.a (mgr.14355) 11589 : audit [DBG] from='client.253992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:52 smithi131 bash[24745]: cluster 2024-09-14T02:48:51.178109+0000 mgr.a (mgr.14355) 11588 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:52 smithi131 bash[24745]: audit 2024-09-14T02:48:51.644094+0000 mgr.a (mgr.14355) 11589 : audit [DBG] from='client.253992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:54 smithi171 bash[25040]: cluster 2024-09-14T02:48:53.179009+0000 mgr.a (mgr.14355) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:54 smithi007 bash[22722]: cluster 2024-09-14T02:48:53.179009+0000 mgr.a (mgr.14355) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:54 smithi131 bash[24745]: cluster 2024-09-14T02:48:53.179009+0000 mgr.a (mgr.14355) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:56 smithi007 bash[22722]: cluster 2024-09-14T02:48:55.179811+0000 mgr.a (mgr.14355) 11591 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:56 smithi131 bash[24745]: cluster 2024-09-14T02:48:55.179811+0000 mgr.a (mgr.14355) 11591 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:56 smithi171 bash[25040]: cluster 2024-09-14T02:48:55.179811+0000 mgr.a (mgr.14355) 11591 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:48:57.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:48:57.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:48:57.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:48:57.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:48:57.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:48:57.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:48:57.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:48:57.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:48:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:58 smithi007 bash[22722]: cluster 2024-09-14T02:48:57.180944+0000 mgr.a (mgr.14355) 11592 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:48:58 smithi007 bash[22722]: audit 2024-09-14T02:48:57.398711+0000 mgr.a (mgr.14355) 11593 : audit [DBG] from='client.254067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:58 smithi131 bash[24745]: cluster 2024-09-14T02:48:57.180944+0000 mgr.a (mgr.14355) 11592 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:48:58 smithi131 bash[24745]: audit 2024-09-14T02:48:57.398711+0000 mgr.a (mgr.14355) 11593 : audit [DBG] from='client.254067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:48:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:58 smithi171 bash[25040]: cluster 2024-09-14T02:48:57.180944+0000 mgr.a (mgr.14355) 11592 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:48:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:48:58 smithi171 bash[25040]: audit 2024-09-14T02:48:57.398711+0000 mgr.a (mgr.14355) 11593 : audit [DBG] from='client.254067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:00 smithi007 bash[22722]: cluster 2024-09-14T02:48:59.181832+0000 mgr.a (mgr.14355) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:00 smithi131 bash[24745]: cluster 2024-09-14T02:48:59.181832+0000 mgr.a (mgr.14355) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:00 smithi171 bash[25040]: cluster 2024-09-14T02:48:59.181832+0000 mgr.a (mgr.14355) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:02 smithi007 bash[22722]: cluster 2024-09-14T02:49:01.184058+0000 mgr.a (mgr.14355) 11595 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:02 smithi131 bash[24745]: cluster 2024-09-14T02:49:01.184058+0000 mgr.a (mgr.14355) 11595 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:02 smithi171 bash[25040]: cluster 2024-09-14T02:49:01.184058+0000 mgr.a (mgr.14355) 11595 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:02.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:02.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:02.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:03.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:03.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:03.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:03.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:03.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:04 smithi007 bash[22722]: audit 2024-09-14T02:49:03.182787+0000 mgr.a (mgr.14355) 11596 : audit [DBG] from='client.254145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:04 smithi007 bash[22722]: cluster 2024-09-14T02:49:03.201014+0000 mgr.a (mgr.14355) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:04 smithi131 bash[24745]: audit 2024-09-14T02:49:03.182787+0000 mgr.a (mgr.14355) 11596 : audit [DBG] from='client.254145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:04 smithi131 bash[24745]: cluster 2024-09-14T02:49:03.201014+0000 mgr.a (mgr.14355) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:04 smithi171 bash[25040]: audit 2024-09-14T02:49:03.182787+0000 mgr.a (mgr.14355) 11596 : audit [DBG] from='client.254145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:04 smithi171 bash[25040]: cluster 2024-09-14T02:49:03.201014+0000 mgr.a (mgr.14355) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:06 smithi007 bash[22722]: cluster 2024-09-14T02:49:05.202001+0000 mgr.a (mgr.14355) 11598 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:06 smithi131 bash[24745]: cluster 2024-09-14T02:49:05.202001+0000 mgr.a (mgr.14355) 11598 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:06 smithi171 bash[25040]: cluster 2024-09-14T02:49:05.202001+0000 mgr.a (mgr.14355) 11598 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:08.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:08 smithi007 bash[22722]: cluster 2024-09-14T02:49:07.204285+0000 mgr.a (mgr.14355) 11599 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:08 smithi131 bash[24745]: cluster 2024-09-14T02:49:07.204285+0000 mgr.a (mgr.14355) 11599 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:08 smithi171 bash[25040]: cluster 2024-09-14T02:49:07.204285+0000 mgr.a (mgr.14355) 11599 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:09.369 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:09.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:09.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:10 smithi007 bash[22722]: audit 2024-09-14T02:49:08.957156+0000 mgr.a (mgr.14355) 11600 : audit [DBG] from='client.254220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:10 smithi007 bash[22722]: cluster 2024-09-14T02:49:09.205283+0000 mgr.a (mgr.14355) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:10 smithi131 bash[24745]: audit 2024-09-14T02:49:08.957156+0000 mgr.a (mgr.14355) 11600 : audit [DBG] from='client.254220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:10 smithi131 bash[24745]: cluster 2024-09-14T02:49:09.205283+0000 mgr.a (mgr.14355) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:10 smithi171 bash[25040]: audit 2024-09-14T02:49:08.957156+0000 mgr.a (mgr.14355) 11600 : audit [DBG] from='client.254220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:10 smithi171 bash[25040]: cluster 2024-09-14T02:49:09.205283+0000 mgr.a (mgr.14355) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:12 smithi007 bash[22722]: cluster 2024-09-14T02:49:11.207724+0000 mgr.a (mgr.14355) 11602 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:12 smithi131 bash[24745]: cluster 2024-09-14T02:49:11.207724+0000 mgr.a (mgr.14355) 11602 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:12 smithi171 bash[25040]: cluster 2024-09-14T02:49:11.207724+0000 mgr.a (mgr.14355) 11602 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:14 smithi007 bash[22722]: cluster 2024-09-14T02:49:13.208648+0000 mgr.a (mgr.14355) 11603 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:14 smithi131 bash[24745]: cluster 2024-09-14T02:49:13.208648+0000 mgr.a (mgr.14355) 11603 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:14 smithi171 bash[25040]: cluster 2024-09-14T02:49:13.208648+0000 mgr.a (mgr.14355) 11603 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:15.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:15.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:15 smithi007 bash[22722]: audit 2024-09-14T02:49:14.704879+0000 mgr.a (mgr.14355) 11604 : audit [DBG] from='client.254298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:15 smithi131 bash[24745]: audit 2024-09-14T02:49:14.704879+0000 mgr.a (mgr.14355) 11604 : audit [DBG] from='client.254298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:15 smithi171 bash[25040]: audit 2024-09-14T02:49:14.704879+0000 mgr.a (mgr.14355) 11604 : audit [DBG] from='client.254298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:16 smithi007 bash[22722]: cluster 2024-09-14T02:49:15.209175+0000 mgr.a (mgr.14355) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:16 smithi131 bash[24745]: cluster 2024-09-14T02:49:15.209175+0000 mgr.a (mgr.14355) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:16 smithi171 bash[25040]: cluster 2024-09-14T02:49:15.209175+0000 mgr.a (mgr.14355) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:18 smithi007 bash[22722]: cluster 2024-09-14T02:49:17.211360+0000 mgr.a (mgr.14355) 11606 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:18 smithi131 bash[24745]: cluster 2024-09-14T02:49:17.211360+0000 mgr.a (mgr.14355) 11606 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:18 smithi171 bash[25040]: cluster 2024-09-14T02:49:17.211360+0000 mgr.a (mgr.14355) 11606 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:20.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:20.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:20.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: cluster 2024-09-14T02:49:19.212114+0000 mgr.a (mgr.14355) 11607 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: audit 2024-09-14T02:49:19.373248+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: audit 2024-09-14T02:49:19.972802+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: audit 2024-09-14T02:49:19.979874+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: audit 2024-09-14T02:49:19.989510+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:20 smithi007 bash[22722]: audit 2024-09-14T02:49:20.000245+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: cluster 2024-09-14T02:49:19.212114+0000 mgr.a (mgr.14355) 11607 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: audit 2024-09-14T02:49:19.373248+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: audit 2024-09-14T02:49:19.972802+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: audit 2024-09-14T02:49:19.979874+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: audit 2024-09-14T02:49:19.989510+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:20 smithi131 bash[24745]: audit 2024-09-14T02:49:20.000245+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: cluster 2024-09-14T02:49:19.212114+0000 mgr.a (mgr.14355) 11607 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: audit 2024-09-14T02:49:19.373248+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:49:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: audit 2024-09-14T02:49:19.972802+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: audit 2024-09-14T02:49:19.979874+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: audit 2024-09-14T02:49:19.989510+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:20 smithi171 bash[25040]: audit 2024-09-14T02:49:20.000245+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:20.896 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:20.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:20.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:20.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:20.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:21.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.475934+0000 mgr.a (mgr.14355) 11608 : audit [DBG] from='client.254376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:21.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.717109+0000 mon.a (mon.0) 2328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:49:21.618 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.718211+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:49:21.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.723433+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:21.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.725571+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.619 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22722]: audit 2024-09-14T02:49:20.726812+0000 mgr.a (mgr.14355) 11609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.475934+0000 mgr.a (mgr.14355) 11608 : audit [DBG] from='client.254376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.717109+0000 mon.a (mon.0) 2328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.718211+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.723433+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:21.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.725571+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:21 smithi131 bash[24745]: audit 2024-09-14T02:49:20.726812+0000 mgr.a (mgr.14355) 11609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.475934+0000 mgr.a (mgr.14355) 11608 : audit [DBG] from='client.254376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.717109+0000 mon.a (mon.0) 2328 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.718211+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.723433+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.725571+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:21 smithi171 bash[25040]: audit 2024-09-14T02:49:20.726812+0000 mgr.a (mgr.14355) 11609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:49:21.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22972]: debug 2024-09-14T02:49:21.611+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:49:21.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:49:21 smithi007 bash[22972]: debug 2024-09-14T02:49:21.615+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:49:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:22 smithi131 bash[24745]: cluster 2024-09-14T02:49:21.213412+0000 mgr.a (mgr.14355) 11610 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:22 smithi131 bash[24745]: audit 2024-09-14T02:49:21.617967+0000 mgr.a (mgr.14355) 11611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:49:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:22 smithi131 bash[24745]: cephadm 2024-09-14T02:49:21.619647+0000 mgr.a (mgr.14355) 11612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:49:23.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:22 smithi171 bash[25040]: cluster 2024-09-14T02:49:21.213412+0000 mgr.a (mgr.14355) 11610 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:23.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:22 smithi171 bash[25040]: audit 2024-09-14T02:49:21.617967+0000 mgr.a (mgr.14355) 11611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:49:23.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:22 smithi171 bash[25040]: cephadm 2024-09-14T02:49:21.619647+0000 mgr.a (mgr.14355) 11612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:49:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:22 smithi007 bash[22722]: cluster 2024-09-14T02:49:21.213412+0000 mgr.a (mgr.14355) 11610 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:22 smithi007 bash[22722]: audit 2024-09-14T02:49:21.617967+0000 mgr.a (mgr.14355) 11611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:49:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:22 smithi007 bash[22722]: cephadm 2024-09-14T02:49:21.619647+0000 mgr.a (mgr.14355) 11612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:49:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:24 smithi131 bash[24745]: cluster 2024-09-14T02:49:23.214239+0000 mgr.a (mgr.14355) 11613 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:24 smithi171 bash[25040]: cluster 2024-09-14T02:49:23.214239+0000 mgr.a (mgr.14355) 11613 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:24 smithi007 bash[22722]: cluster 2024-09-14T02:49:23.214239+0000 mgr.a (mgr.14355) 11613 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:25.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:25.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:26.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:26.664 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:26 smithi131 bash[24745]: cluster 2024-09-14T02:49:25.214979+0000 mgr.a (mgr.14355) 11614 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:26 smithi171 bash[25040]: cluster 2024-09-14T02:49:25.214979+0000 mgr.a (mgr.14355) 11614 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:26 smithi007 bash[22722]: cluster 2024-09-14T02:49:25.214979+0000 mgr.a (mgr.14355) 11614 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:49:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:27 smithi131 bash[24745]: audit 2024-09-14T02:49:26.233621+0000 mgr.a (mgr.14355) 11615 : audit [DBG] from='client.254562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:27 smithi171 bash[25040]: audit 2024-09-14T02:49:26.233621+0000 mgr.a (mgr.14355) 11615 : audit [DBG] from='client.254562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:27 smithi007 bash[22722]: audit 2024-09-14T02:49:26.233621+0000 mgr.a (mgr.14355) 11615 : audit [DBG] from='client.254562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:28 smithi131 bash[24745]: cluster 2024-09-14T02:49:27.217625+0000 mgr.a (mgr.14355) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:28 smithi171 bash[25040]: cluster 2024-09-14T02:49:27.217625+0000 mgr.a (mgr.14355) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:28 smithi007 bash[22722]: cluster 2024-09-14T02:49:27.217625+0000 mgr.a (mgr.14355) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:30 smithi131 bash[24745]: cluster 2024-09-14T02:49:29.218424+0000 mgr.a (mgr.14355) 11617 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:49:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:30 smithi171 bash[25040]: cluster 2024-09-14T02:49:29.218424+0000 mgr.a (mgr.14355) 11617 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:49:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:30 smithi007 bash[22722]: cluster 2024-09-14T02:49:29.218424+0000 mgr.a (mgr.14355) 11617 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:49:31.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:31.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:31.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:32.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:32.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:32.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:32 smithi131 bash[24745]: cluster 2024-09-14T02:49:31.220347+0000 mgr.a (mgr.14355) 11618 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:32 smithi171 bash[25040]: cluster 2024-09-14T02:49:31.220347+0000 mgr.a (mgr.14355) 11618 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:32 smithi007 bash[22722]: cluster 2024-09-14T02:49:31.220347+0000 mgr.a (mgr.14355) 11618 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:33 smithi131 bash[24745]: audit 2024-09-14T02:49:31.994680+0000 mgr.a (mgr.14355) 11619 : audit [DBG] from='client.254637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:33 smithi171 bash[25040]: audit 2024-09-14T02:49:31.994680+0000 mgr.a (mgr.14355) 11619 : audit [DBG] from='client.254637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:33 smithi007 bash[22722]: audit 2024-09-14T02:49:31.994680+0000 mgr.a (mgr.14355) 11619 : audit [DBG] from='client.254637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:35.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:34 smithi131 bash[24745]: cluster 2024-09-14T02:49:33.221220+0000 mgr.a (mgr.14355) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:34 smithi171 bash[25040]: cluster 2024-09-14T02:49:33.221220+0000 mgr.a (mgr.14355) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:34 smithi007 bash[22722]: cluster 2024-09-14T02:49:33.221220+0000 mgr.a (mgr.14355) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:36 smithi131 bash[24745]: cluster 2024-09-14T02:49:35.221992+0000 mgr.a (mgr.14355) 11621 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:36 smithi171 bash[25040]: cluster 2024-09-14T02:49:35.221992+0000 mgr.a (mgr.14355) 11621 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:36 smithi007 bash[22722]: cluster 2024-09-14T02:49:35.221992+0000 mgr.a (mgr.14355) 11621 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:37.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:37.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:38.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:38.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:38 smithi131 bash[24745]: cluster 2024-09-14T02:49:37.224233+0000 mgr.a (mgr.14355) 11622 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:38 smithi131 bash[24745]: audit 2024-09-14T02:49:37.763092+0000 mgr.a (mgr.14355) 11623 : audit [DBG] from='client.254715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:38 smithi171 bash[25040]: cluster 2024-09-14T02:49:37.224233+0000 mgr.a (mgr.14355) 11622 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:38 smithi171 bash[25040]: audit 2024-09-14T02:49:37.763092+0000 mgr.a (mgr.14355) 11623 : audit [DBG] from='client.254715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:38 smithi007 bash[22722]: cluster 2024-09-14T02:49:37.224233+0000 mgr.a (mgr.14355) 11622 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:49:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:38 smithi007 bash[22722]: audit 2024-09-14T02:49:37.763092+0000 mgr.a (mgr.14355) 11623 : audit [DBG] from='client.254715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:40 smithi131 bash[24745]: cluster 2024-09-14T02:49:39.225107+0000 mgr.a (mgr.14355) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:40 smithi171 bash[25040]: cluster 2024-09-14T02:49:39.225107+0000 mgr.a (mgr.14355) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:40 smithi007 bash[22722]: cluster 2024-09-14T02:49:39.225107+0000 mgr.a (mgr.14355) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:42 smithi131 bash[24745]: cluster 2024-09-14T02:49:41.227346+0000 mgr.a (mgr.14355) 11625 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:42 smithi171 bash[25040]: cluster 2024-09-14T02:49:41.227346+0000 mgr.a (mgr.14355) 11625 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:43.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:42 smithi007 bash[22722]: cluster 2024-09-14T02:49:41.227346+0000 mgr.a (mgr.14355) 11625 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:43.966 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:43.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:43.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:43.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:43.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:44 smithi171 bash[25040]: cluster 2024-09-14T02:49:43.228111+0000 mgr.a (mgr.14355) 11626 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:44 smithi171 bash[25040]: audit 2024-09-14T02:49:43.526097+0000 mgr.a (mgr.14355) 11627 : audit [DBG] from='client.254793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:44 smithi007 bash[22722]: cluster 2024-09-14T02:49:43.228111+0000 mgr.a (mgr.14355) 11626 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:44 smithi007 bash[22722]: audit 2024-09-14T02:49:43.526097+0000 mgr.a (mgr.14355) 11627 : audit [DBG] from='client.254793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:44 smithi131 bash[24745]: cluster 2024-09-14T02:49:43.228111+0000 mgr.a (mgr.14355) 11626 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:45.342 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:44 smithi131 bash[24745]: audit 2024-09-14T02:49:43.526097+0000 mgr.a (mgr.14355) 11627 : audit [DBG] from='client.254793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:46 smithi171 bash[25040]: cluster 2024-09-14T02:49:45.228979+0000 mgr.a (mgr.14355) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:46 smithi007 bash[22722]: cluster 2024-09-14T02:49:45.228979+0000 mgr.a (mgr.14355) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:46 smithi131 bash[24745]: cluster 2024-09-14T02:49:45.228979+0000 mgr.a (mgr.14355) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:47 smithi007 bash[22722]: cluster 2024-09-14T02:49:47.231285+0000 mgr.a (mgr.14355) 11629 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:47 smithi131 bash[24745]: cluster 2024-09-14T02:49:47.231285+0000 mgr.a (mgr.14355) 11629 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:47 smithi171 bash[25040]: cluster 2024-09-14T02:49:47.231285+0000 mgr.a (mgr.14355) 11629 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:48.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:48.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:48.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:49.747 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:49.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:49.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:49.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:49.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:50 smithi171 bash[25040]: cluster 2024-09-14T02:49:49.232051+0000 mgr.a (mgr.14355) 11630 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:50 smithi171 bash[25040]: audit 2024-09-14T02:49:49.301976+0000 mgr.a (mgr.14355) 11631 : audit [DBG] from='client.254868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:50 smithi007 bash[22722]: cluster 2024-09-14T02:49:49.232051+0000 mgr.a (mgr.14355) 11630 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:50 smithi007 bash[22722]: audit 2024-09-14T02:49:49.301976+0000 mgr.a (mgr.14355) 11631 : audit [DBG] from='client.254868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:50 smithi131 bash[24745]: cluster 2024-09-14T02:49:49.232051+0000 mgr.a (mgr.14355) 11630 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:50 smithi131 bash[24745]: audit 2024-09-14T02:49:49.301976+0000 mgr.a (mgr.14355) 11631 : audit [DBG] from='client.254868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:52.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:52 smithi007 bash[22722]: cluster 2024-09-14T02:49:51.234710+0000 mgr.a (mgr.14355) 11632 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:52 smithi131 bash[24745]: cluster 2024-09-14T02:49:51.234710+0000 mgr.a (mgr.14355) 11632 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:52 smithi171 bash[25040]: cluster 2024-09-14T02:49:51.234710+0000 mgr.a (mgr.14355) 11632 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:49:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:49:54.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:49:54.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:49:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:54 smithi007 bash[22722]: cluster 2024-09-14T02:49:53.235474+0000 mgr.a (mgr.14355) 11633 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:54 smithi131 bash[24745]: cluster 2024-09-14T02:49:53.235474+0000 mgr.a (mgr.14355) 11633 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:54 smithi171 bash[25040]: cluster 2024-09-14T02:49:53.235474+0000 mgr.a (mgr.14355) 11633 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:55.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:49:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:49:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:49:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:49:55.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:49:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:56 smithi007 bash[22722]: audit 2024-09-14T02:49:55.081138+0000 mgr.a (mgr.14355) 11634 : audit [DBG] from='client.254943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:56 smithi007 bash[22722]: cluster 2024-09-14T02:49:55.236071+0000 mgr.a (mgr.14355) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:56 smithi131 bash[24745]: audit 2024-09-14T02:49:55.081138+0000 mgr.a (mgr.14355) 11634 : audit [DBG] from='client.254943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:56 smithi131 bash[24745]: cluster 2024-09-14T02:49:55.236071+0000 mgr.a (mgr.14355) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:56 smithi171 bash[25040]: audit 2024-09-14T02:49:55.081138+0000 mgr.a (mgr.14355) 11634 : audit [DBG] from='client.254943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:49:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:56 smithi171 bash[25040]: cluster 2024-09-14T02:49:55.236071+0000 mgr.a (mgr.14355) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:49:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:49:58 smithi007 bash[22722]: cluster 2024-09-14T02:49:57.238786+0000 mgr.a (mgr.14355) 11636 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:49:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:49:58 smithi131 bash[24745]: cluster 2024-09-14T02:49:57.238786+0000 mgr.a (mgr.14355) 11636 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:49:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:49:58 smithi171 bash[25040]: cluster 2024-09-14T02:49:57.238786+0000 mgr.a (mgr.14355) 11636 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:50:00.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:00.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:00.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:00 smithi007 bash[22722]: cluster 2024-09-14T02:49:59.239565+0000 mgr.a (mgr.14355) 11637 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:50:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:00 smithi007 bash[22722]: cluster 2024-09-14T02:50:00.000148+0000 mon.a (mon.0) 2332 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:50:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:00 smithi131 bash[24745]: cluster 2024-09-14T02:49:59.239565+0000 mgr.a (mgr.14355) 11637 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:50:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:00 smithi131 bash[24745]: cluster 2024-09-14T02:50:00.000148+0000 mon.a (mon.0) 2332 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:50:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:00 smithi171 bash[25040]: cluster 2024-09-14T02:49:59.239565+0000 mgr.a (mgr.14355) 11637 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:50:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:00 smithi171 bash[25040]: cluster 2024-09-14T02:50:00.000148+0000 mon.a (mon.0) 2332 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T02:50:01.239 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:01.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:01.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:01.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:01.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:02 smithi007 bash[22722]: audit 2024-09-14T02:50:00.836006+0000 mgr.a (mgr.14355) 11638 : audit [DBG] from='client.255021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:02 smithi007 bash[22722]: cluster 2024-09-14T02:50:01.240745+0000 mgr.a (mgr.14355) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:02 smithi131 bash[24745]: audit 2024-09-14T02:50:00.836006+0000 mgr.a (mgr.14355) 11638 : audit [DBG] from='client.255021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:02 smithi131 bash[24745]: cluster 2024-09-14T02:50:01.240745+0000 mgr.a (mgr.14355) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:02 smithi171 bash[25040]: audit 2024-09-14T02:50:00.836006+0000 mgr.a (mgr.14355) 11638 : audit [DBG] from='client.255021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:02 smithi171 bash[25040]: cluster 2024-09-14T02:50:01.240745+0000 mgr.a (mgr.14355) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:04 smithi007 bash[22722]: cluster 2024-09-14T02:50:03.241404+0000 mgr.a (mgr.14355) 11640 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:04 smithi131 bash[24745]: cluster 2024-09-14T02:50:03.241404+0000 mgr.a (mgr.14355) 11640 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:04 smithi171 bash[25040]: cluster 2024-09-14T02:50:03.241404+0000 mgr.a (mgr.14355) 11640 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:06.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:06.241 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:06.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:06 smithi007 bash[22722]: cluster 2024-09-14T02:50:05.242322+0000 mgr.a (mgr.14355) 11641 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:07.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:07.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:07.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:07.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:07.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:06 smithi131 bash[24745]: cluster 2024-09-14T02:50:05.242322+0000 mgr.a (mgr.14355) 11641 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:06 smithi171 bash[25040]: cluster 2024-09-14T02:50:05.242322+0000 mgr.a (mgr.14355) 11641 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:07 smithi007 bash[22722]: audit 2024-09-14T02:50:06.581443+0000 mgr.a (mgr.14355) 11642 : audit [DBG] from='client.255099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:07 smithi131 bash[24745]: audit 2024-09-14T02:50:06.581443+0000 mgr.a (mgr.14355) 11642 : audit [DBG] from='client.255099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:07 smithi171 bash[25040]: audit 2024-09-14T02:50:06.581443+0000 mgr.a (mgr.14355) 11642 : audit [DBG] from='client.255099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:08 smithi007 bash[22722]: cluster 2024-09-14T02:50:07.244970+0000 mgr.a (mgr.14355) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:08 smithi131 bash[24745]: cluster 2024-09-14T02:50:07.244970+0000 mgr.a (mgr.14355) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:08 smithi171 bash[25040]: cluster 2024-09-14T02:50:07.244970+0000 mgr.a (mgr.14355) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:10 smithi007 bash[22722]: cluster 2024-09-14T02:50:09.245743+0000 mgr.a (mgr.14355) 11644 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:50:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:10 smithi131 bash[24745]: cluster 2024-09-14T02:50:09.245743+0000 mgr.a (mgr.14355) 11644 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:50:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:10 smithi171 bash[25040]: cluster 2024-09-14T02:50:09.245743+0000 mgr.a (mgr.14355) 11644 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:50:12.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:12.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:12.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:12.759 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:12.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:12 smithi007 bash[22722]: cluster 2024-09-14T02:50:11.247759+0000 mgr.a (mgr.14355) 11645 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:50:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:12 smithi131 bash[24745]: cluster 2024-09-14T02:50:11.247759+0000 mgr.a (mgr.14355) 11645 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:50:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:12 smithi171 bash[25040]: cluster 2024-09-14T02:50:11.247759+0000 mgr.a (mgr.14355) 11645 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:50:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:13 smithi007 bash[22722]: audit 2024-09-14T02:50:12.337272+0000 mgr.a (mgr.14355) 11646 : audit [DBG] from='client.255177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:13 smithi131 bash[24745]: audit 2024-09-14T02:50:12.337272+0000 mgr.a (mgr.14355) 11646 : audit [DBG] from='client.255177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:13 smithi171 bash[25040]: audit 2024-09-14T02:50:12.337272+0000 mgr.a (mgr.14355) 11646 : audit [DBG] from='client.255177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:14 smithi007 bash[22722]: cluster 2024-09-14T02:50:13.248766+0000 mgr.a (mgr.14355) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:14 smithi131 bash[24745]: cluster 2024-09-14T02:50:13.248766+0000 mgr.a (mgr.14355) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:15.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:14 smithi171 bash[25040]: cluster 2024-09-14T02:50:13.248766+0000 mgr.a (mgr.14355) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:16 smithi007 bash[22722]: cluster 2024-09-14T02:50:15.249629+0000 mgr.a (mgr.14355) 11648 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:16 smithi131 bash[24745]: cluster 2024-09-14T02:50:15.249629+0000 mgr.a (mgr.14355) 11648 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:16 smithi171 bash[25040]: cluster 2024-09-14T02:50:15.249629+0000 mgr.a (mgr.14355) 11648 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:18.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:18.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:18 smithi007 bash[22722]: cluster 2024-09-14T02:50:17.251989+0000 mgr.a (mgr.14355) 11649 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:18 smithi131 bash[24745]: cluster 2024-09-14T02:50:17.251989+0000 mgr.a (mgr.14355) 11649 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:18 smithi171 bash[25040]: cluster 2024-09-14T02:50:17.251989+0000 mgr.a (mgr.14355) 11649 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:19 smithi007 bash[22722]: audit 2024-09-14T02:50:18.099002+0000 mgr.a (mgr.14355) 11650 : audit [DBG] from='client.255252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:19 smithi131 bash[24745]: audit 2024-09-14T02:50:18.099002+0000 mgr.a (mgr.14355) 11650 : audit [DBG] from='client.255252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:19 smithi171 bash[25040]: audit 2024-09-14T02:50:18.099002+0000 mgr.a (mgr.14355) 11650 : audit [DBG] from='client.255252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:20 smithi007 bash[22722]: cluster 2024-09-14T02:50:19.252831+0000 mgr.a (mgr.14355) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:20 smithi131 bash[24745]: cluster 2024-09-14T02:50:19.252831+0000 mgr.a (mgr.14355) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:20 smithi171 bash[25040]: cluster 2024-09-14T02:50:19.252831+0000 mgr.a (mgr.14355) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: cluster 2024-09-14T02:50:21.255081+0000 mgr.a (mgr.14355) 11652 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: audit 2024-09-14T02:50:21.674107+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: audit 2024-09-14T02:50:22.526092+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: audit 2024-09-14T02:50:22.527559+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: audit 2024-09-14T02:50:22.537191+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:50:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:22 smithi007 bash[22722]: audit 2024-09-14T02:50:22.539993+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: cluster 2024-09-14T02:50:21.255081+0000 mgr.a (mgr.14355) 11652 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: audit 2024-09-14T02:50:21.674107+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:50:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: audit 2024-09-14T02:50:22.526092+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:50:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: audit 2024-09-14T02:50:22.527559+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:50:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: audit 2024-09-14T02:50:22.537191+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:50:23.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:22 smithi131 bash[24745]: audit 2024-09-14T02:50:22.539993+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: cluster 2024-09-14T02:50:21.255081+0000 mgr.a (mgr.14355) 11652 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: audit 2024-09-14T02:50:21.674107+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:50:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: audit 2024-09-14T02:50:22.526092+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:50:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: audit 2024-09-14T02:50:22.527559+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:50:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: audit 2024-09-14T02:50:22.537191+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:50:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:22 smithi171 bash[25040]: audit 2024-09-14T02:50:22.539993+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:23.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:23.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:23.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:23.637 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:50:23 smithi007 bash[22972]: debug 2024-09-14T02:50:23.302+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:50:23.637 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:50:23 smithi007 bash[22972]: debug 2024-09-14T02:50:23.302+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:50:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:23 smithi007 bash[22722]: audit 2024-09-14T02:50:22.542279+0000 mgr.a (mgr.14355) 11653 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:23 smithi131 bash[24745]: audit 2024-09-14T02:50:22.542279+0000 mgr.a (mgr.14355) 11653 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:23 smithi171 bash[25040]: audit 2024-09-14T02:50:22.542279+0000 mgr.a (mgr.14355) 11653 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:50:24.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:24 smithi007 bash[22722]: cluster 2024-09-14T02:50:23.255668+0000 mgr.a (mgr.14355) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:24 smithi007 bash[22722]: audit 2024-09-14T02:50:23.306780+0000 mgr.a (mgr.14355) 11655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:50:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:24 smithi007 bash[22722]: cephadm 2024-09-14T02:50:23.308082+0000 mgr.a (mgr.14355) 11656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:50:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:24 smithi131 bash[24745]: cluster 2024-09-14T02:50:23.255668+0000 mgr.a (mgr.14355) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:24 smithi131 bash[24745]: audit 2024-09-14T02:50:23.306780+0000 mgr.a (mgr.14355) 11655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:50:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:24 smithi131 bash[24745]: cephadm 2024-09-14T02:50:23.308082+0000 mgr.a (mgr.14355) 11656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:50:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:24 smithi171 bash[25040]: cluster 2024-09-14T02:50:23.255668+0000 mgr.a (mgr.14355) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:24 smithi171 bash[25040]: audit 2024-09-14T02:50:23.306780+0000 mgr.a (mgr.14355) 11655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:50:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:24 smithi171 bash[25040]: cephadm 2024-09-14T02:50:23.308082+0000 mgr.a (mgr.14355) 11656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:50:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:25 smithi007 bash[22722]: audit 2024-09-14T02:50:23.881009+0000 mgr.a (mgr.14355) 11657 : audit [DBG] from='client.255432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:25 smithi131 bash[24745]: audit 2024-09-14T02:50:23.881009+0000 mgr.a (mgr.14355) 11657 : audit [DBG] from='client.255432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:25 smithi171 bash[25040]: audit 2024-09-14T02:50:23.881009+0000 mgr.a (mgr.14355) 11657 : audit [DBG] from='client.255432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:26 smithi007 bash[22722]: cluster 2024-09-14T02:50:25.256581+0000 mgr.a (mgr.14355) 11658 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:26 smithi131 bash[24745]: cluster 2024-09-14T02:50:25.256581+0000 mgr.a (mgr.14355) 11658 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:26 smithi171 bash[25040]: cluster 2024-09-14T02:50:25.256581+0000 mgr.a (mgr.14355) 11658 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:28 smithi007 bash[22722]: cluster 2024-09-14T02:50:27.259015+0000 mgr.a (mgr.14355) 11659 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:28 smithi131 bash[24745]: cluster 2024-09-14T02:50:27.259015+0000 mgr.a (mgr.14355) 11659 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:28 smithi171 bash[25040]: cluster 2024-09-14T02:50:27.259015+0000 mgr.a (mgr.14355) 11659 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:29.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:29.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:30.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:30 smithi007 bash[22722]: cluster 2024-09-14T02:50:29.259975+0000 mgr.a (mgr.14355) 11660 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:30 smithi007 bash[22722]: audit 2024-09-14T02:50:29.645105+0000 mgr.a (mgr.14355) 11661 : audit [DBG] from='client.255507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:30 smithi131 bash[24745]: cluster 2024-09-14T02:50:29.259975+0000 mgr.a (mgr.14355) 11660 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:30 smithi131 bash[24745]: audit 2024-09-14T02:50:29.645105+0000 mgr.a (mgr.14355) 11661 : audit [DBG] from='client.255507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:30 smithi171 bash[25040]: cluster 2024-09-14T02:50:29.259975+0000 mgr.a (mgr.14355) 11660 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:30 smithi171 bash[25040]: audit 2024-09-14T02:50:29.645105+0000 mgr.a (mgr.14355) 11661 : audit [DBG] from='client.255507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:32 smithi007 bash[22722]: cluster 2024-09-14T02:50:31.262468+0000 mgr.a (mgr.14355) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:32 smithi131 bash[24745]: cluster 2024-09-14T02:50:31.262468+0000 mgr.a (mgr.14355) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:32 smithi171 bash[25040]: cluster 2024-09-14T02:50:31.262468+0000 mgr.a (mgr.14355) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:34 smithi007 bash[22722]: cluster 2024-09-14T02:50:33.263268+0000 mgr.a (mgr.14355) 11663 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:34 smithi131 bash[24745]: cluster 2024-09-14T02:50:33.263268+0000 mgr.a (mgr.14355) 11663 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:34 smithi171 bash[25040]: cluster 2024-09-14T02:50:33.263268+0000 mgr.a (mgr.14355) 11663 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:35.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:35.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:35.851 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:36 smithi007 bash[22722]: cluster 2024-09-14T02:50:35.264003+0000 mgr.a (mgr.14355) 11664 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:36 smithi007 bash[22722]: audit 2024-09-14T02:50:35.422241+0000 mgr.a (mgr.14355) 11665 : audit [DBG] from='client.255582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:36 smithi131 bash[24745]: cluster 2024-09-14T02:50:35.264003+0000 mgr.a (mgr.14355) 11664 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:36 smithi131 bash[24745]: audit 2024-09-14T02:50:35.422241+0000 mgr.a (mgr.14355) 11665 : audit [DBG] from='client.255582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:36 smithi171 bash[25040]: cluster 2024-09-14T02:50:35.264003+0000 mgr.a (mgr.14355) 11664 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:36 smithi171 bash[25040]: audit 2024-09-14T02:50:35.422241+0000 mgr.a (mgr.14355) 11665 : audit [DBG] from='client.255582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:38 smithi007 bash[22722]: cluster 2024-09-14T02:50:37.266865+0000 mgr.a (mgr.14355) 11666 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:38 smithi131 bash[24745]: cluster 2024-09-14T02:50:37.266865+0000 mgr.a (mgr.14355) 11666 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:38 smithi171 bash[25040]: cluster 2024-09-14T02:50:37.266865+0000 mgr.a (mgr.14355) 11666 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:50:40.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:40.854 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:40 smithi007 bash[22722]: cluster 2024-09-14T02:50:39.267652+0000 mgr.a (mgr.14355) 11667 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:40 smithi131 bash[24745]: cluster 2024-09-14T02:50:39.267652+0000 mgr.a (mgr.14355) 11667 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:40 smithi171 bash[25040]: cluster 2024-09-14T02:50:39.267652+0000 mgr.a (mgr.14355) 11667 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:41.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:41.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:41.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:41.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:41.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:42 smithi007 bash[22722]: audit 2024-09-14T02:50:41.182749+0000 mgr.a (mgr.14355) 11668 : audit [DBG] from='client.255660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:42 smithi007 bash[22722]: cluster 2024-09-14T02:50:41.269512+0000 mgr.a (mgr.14355) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:42 smithi131 bash[24745]: audit 2024-09-14T02:50:41.182749+0000 mgr.a (mgr.14355) 11668 : audit [DBG] from='client.255660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:42 smithi131 bash[24745]: cluster 2024-09-14T02:50:41.269512+0000 mgr.a (mgr.14355) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:42 smithi171 bash[25040]: audit 2024-09-14T02:50:41.182749+0000 mgr.a (mgr.14355) 11668 : audit [DBG] from='client.255660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:42 smithi171 bash[25040]: cluster 2024-09-14T02:50:41.269512+0000 mgr.a (mgr.14355) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:44.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:44 smithi007 bash[22722]: cluster 2024-09-14T02:50:43.270462+0000 mgr.a (mgr.14355) 11670 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:44 smithi131 bash[24745]: cluster 2024-09-14T02:50:43.270462+0000 mgr.a (mgr.14355) 11670 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:44 smithi171 bash[25040]: cluster 2024-09-14T02:50:43.270462+0000 mgr.a (mgr.14355) 11670 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:50:46.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:46.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:46.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:46 smithi007 bash[22722]: cluster 2024-09-14T02:50:45.271291+0000 mgr.a (mgr.14355) 11671 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:46 smithi131 bash[24745]: cluster 2024-09-14T02:50:45.271291+0000 mgr.a (mgr.14355) 11671 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:46 smithi171 bash[25040]: cluster 2024-09-14T02:50:45.271291+0000 mgr.a (mgr.14355) 11671 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:50:47.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:48 smithi007 bash[22722]: audit 2024-09-14T02:50:46.944514+0000 mgr.a (mgr.14355) 11672 : audit [DBG] from='client.255738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:48 smithi007 bash[22722]: cluster 2024-09-14T02:50:47.272586+0000 mgr.a (mgr.14355) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:48 smithi131 bash[24745]: audit 2024-09-14T02:50:46.944514+0000 mgr.a (mgr.14355) 11672 : audit [DBG] from='client.255738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:48 smithi131 bash[24745]: cluster 2024-09-14T02:50:47.272586+0000 mgr.a (mgr.14355) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:48 smithi171 bash[25040]: audit 2024-09-14T02:50:46.944514+0000 mgr.a (mgr.14355) 11672 : audit [DBG] from='client.255738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:48 smithi171 bash[25040]: cluster 2024-09-14T02:50:47.272586+0000 mgr.a (mgr.14355) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:50 smithi007 bash[22722]: cluster 2024-09-14T02:50:49.273468+0000 mgr.a (mgr.14355) 11674 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:50 smithi131 bash[24745]: cluster 2024-09-14T02:50:49.273468+0000 mgr.a (mgr.14355) 11674 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:50 smithi171 bash[25040]: cluster 2024-09-14T02:50:49.273468+0000 mgr.a (mgr.14355) 11674 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:52.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:52.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:52 smithi131 bash[24745]: cluster 2024-09-14T02:50:51.275736+0000 mgr.a (mgr.14355) 11675 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:52 smithi171 bash[25040]: cluster 2024-09-14T02:50:51.275736+0000 mgr.a (mgr.14355) 11675 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:53.175 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:52 smithi007 bash[22722]: cluster 2024-09-14T02:50:51.275736+0000 mgr.a (mgr.14355) 11675 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:53 smithi131 bash[24745]: audit 2024-09-14T02:50:52.736765+0000 mgr.a (mgr.14355) 11676 : audit [DBG] from='client.255813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:53 smithi171 bash[25040]: audit 2024-09-14T02:50:52.736765+0000 mgr.a (mgr.14355) 11676 : audit [DBG] from='client.255813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:53 smithi007 bash[22722]: audit 2024-09-14T02:50:52.736765+0000 mgr.a (mgr.14355) 11676 : audit [DBG] from='client.255813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:50:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:54 smithi131 bash[24745]: cluster 2024-09-14T02:50:53.276699+0000 mgr.a (mgr.14355) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:54 smithi171 bash[25040]: cluster 2024-09-14T02:50:53.276699+0000 mgr.a (mgr.14355) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:54 smithi007 bash[22722]: cluster 2024-09-14T02:50:53.276699+0000 mgr.a (mgr.14355) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:56 smithi131 bash[24745]: cluster 2024-09-14T02:50:55.277487+0000 mgr.a (mgr.14355) 11678 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:56 smithi171 bash[25040]: cluster 2024-09-14T02:50:55.277487+0000 mgr.a (mgr.14355) 11678 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:56 smithi007 bash[22722]: cluster 2024-09-14T02:50:55.277487+0000 mgr.a (mgr.14355) 11678 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:50:58.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:50:58.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:50:58.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:50:58.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:50:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:50:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:50:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:50:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:50:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:58 smithi131 bash[24745]: cluster 2024-09-14T02:50:57.279736+0000 mgr.a (mgr.14355) 11679 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:58 smithi171 bash[25040]: cluster 2024-09-14T02:50:57.279736+0000 mgr.a (mgr.14355) 11679 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:50:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:58 smithi007 bash[22722]: cluster 2024-09-14T02:50:57.279736+0000 mgr.a (mgr.14355) 11679 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:50:59 smithi131 bash[24745]: audit 2024-09-14T02:50:58.513723+0000 mgr.a (mgr.14355) 11680 : audit [DBG] from='client.255891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:50:59 smithi171 bash[25040]: audit 2024-09-14T02:50:58.513723+0000 mgr.a (mgr.14355) 11680 : audit [DBG] from='client.255891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:50:59 smithi007 bash[22722]: audit 2024-09-14T02:50:58.513723+0000 mgr.a (mgr.14355) 11680 : audit [DBG] from='client.255891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:00 smithi131 bash[24745]: cluster 2024-09-14T02:50:59.280721+0000 mgr.a (mgr.14355) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:00 smithi171 bash[25040]: cluster 2024-09-14T02:50:59.280721+0000 mgr.a (mgr.14355) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:00 smithi007 bash[22722]: cluster 2024-09-14T02:50:59.280721+0000 mgr.a (mgr.14355) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:02 smithi131 bash[24745]: cluster 2024-09-14T02:51:01.283024+0000 mgr.a (mgr.14355) 11682 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:02 smithi171 bash[25040]: cluster 2024-09-14T02:51:01.283024+0000 mgr.a (mgr.14355) 11682 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:02 smithi007 bash[22722]: cluster 2024-09-14T02:51:01.283024+0000 mgr.a (mgr.14355) 11682 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:03.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:03.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:04.733 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:04.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:04.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:04.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:04.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:04 smithi131 bash[24745]: cluster 2024-09-14T02:51:03.283814+0000 mgr.a (mgr.14355) 11683 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:04 smithi171 bash[25040]: cluster 2024-09-14T02:51:03.283814+0000 mgr.a (mgr.14355) 11683 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:04 smithi007 bash[22722]: cluster 2024-09-14T02:51:03.283814+0000 mgr.a (mgr.14355) 11683 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:05 smithi131 bash[24745]: audit 2024-09-14T02:51:04.284503+0000 mgr.a (mgr.14355) 11684 : audit [DBG] from='client.255969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:05 smithi171 bash[25040]: audit 2024-09-14T02:51:04.284503+0000 mgr.a (mgr.14355) 11684 : audit [DBG] from='client.255969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:05 smithi007 bash[22722]: audit 2024-09-14T02:51:04.284503+0000 mgr.a (mgr.14355) 11684 : audit [DBG] from='client.255969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:06 smithi131 bash[24745]: cluster 2024-09-14T02:51:05.284719+0000 mgr.a (mgr.14355) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:06 smithi171 bash[25040]: cluster 2024-09-14T02:51:05.284719+0000 mgr.a (mgr.14355) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:06 smithi007 bash[22722]: cluster 2024-09-14T02:51:05.284719+0000 mgr.a (mgr.14355) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:08 smithi131 bash[24745]: cluster 2024-09-14T02:51:07.287005+0000 mgr.a (mgr.14355) 11686 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:08 smithi171 bash[25040]: cluster 2024-09-14T02:51:07.287005+0000 mgr.a (mgr.14355) 11686 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:08 smithi007 bash[22722]: cluster 2024-09-14T02:51:07.287005+0000 mgr.a (mgr.14355) 11686 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:09.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:09.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:10.495 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:10.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:10.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:10.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:10.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:10 smithi131 bash[24745]: cluster 2024-09-14T02:51:09.287799+0000 mgr.a (mgr.14355) 11687 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:10 smithi171 bash[25040]: cluster 2024-09-14T02:51:09.287799+0000 mgr.a (mgr.14355) 11687 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:10 smithi007 bash[22722]: cluster 2024-09-14T02:51:09.287799+0000 mgr.a (mgr.14355) 11687 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:11 smithi131 bash[24745]: audit 2024-09-14T02:51:10.068743+0000 mgr.a (mgr.14355) 11688 : audit [DBG] from='client.256044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:11 smithi171 bash[25040]: audit 2024-09-14T02:51:10.068743+0000 mgr.a (mgr.14355) 11688 : audit [DBG] from='client.256044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:11 smithi007 bash[22722]: audit 2024-09-14T02:51:10.068743+0000 mgr.a (mgr.14355) 11688 : audit [DBG] from='client.256044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:12 smithi131 bash[24745]: cluster 2024-09-14T02:51:11.290714+0000 mgr.a (mgr.14355) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:51:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:12 smithi171 bash[25040]: cluster 2024-09-14T02:51:11.290714+0000 mgr.a (mgr.14355) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:51:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:12 smithi007 bash[22722]: cluster 2024-09-14T02:51:11.290714+0000 mgr.a (mgr.14355) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:51:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:14 smithi131 bash[24745]: cluster 2024-09-14T02:51:13.291524+0000 mgr.a (mgr.14355) 11690 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:14 smithi171 bash[25040]: cluster 2024-09-14T02:51:13.291524+0000 mgr.a (mgr.14355) 11690 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:14 smithi007 bash[22722]: cluster 2024-09-14T02:51:13.291524+0000 mgr.a (mgr.14355) 11690 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:16.276 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:16.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:16.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:16 smithi131 bash[24745]: cluster 2024-09-14T02:51:15.292428+0000 mgr.a (mgr.14355) 11691 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:16 smithi171 bash[25040]: cluster 2024-09-14T02:51:15.292428+0000 mgr.a (mgr.14355) 11691 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:16 smithi007 bash[22722]: cluster 2024-09-14T02:51:15.292428+0000 mgr.a (mgr.14355) 11691 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:51:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:17 smithi171 bash[25040]: audit 2024-09-14T02:51:15.831941+0000 mgr.a (mgr.14355) 11692 : audit [DBG] from='client.256122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:17 smithi007 bash[22722]: audit 2024-09-14T02:51:15.831941+0000 mgr.a (mgr.14355) 11692 : audit [DBG] from='client.256122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:17 smithi131 bash[24745]: audit 2024-09-14T02:51:15.831941+0000 mgr.a (mgr.14355) 11692 : audit [DBG] from='client.256122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:18 smithi171 bash[25040]: cluster 2024-09-14T02:51:17.295323+0000 mgr.a (mgr.14355) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:18 smithi007 bash[22722]: cluster 2024-09-14T02:51:17.295323+0000 mgr.a (mgr.14355) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:18 smithi131 bash[24745]: cluster 2024-09-14T02:51:17.295323+0000 mgr.a (mgr.14355) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:20 smithi007 bash[22722]: cluster 2024-09-14T02:51:19.296129+0000 mgr.a (mgr.14355) 11694 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:21.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:21.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:20 smithi131 bash[24745]: cluster 2024-09-14T02:51:19.296129+0000 mgr.a (mgr.14355) 11694 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:20 smithi171 bash[25040]: cluster 2024-09-14T02:51:19.296129+0000 mgr.a (mgr.14355) 11694 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:22.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:22 smithi007 bash[22722]: cluster 2024-09-14T02:51:21.298117+0000 mgr.a (mgr.14355) 11695 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:22 smithi007 bash[22722]: audit 2024-09-14T02:51:21.609143+0000 mgr.a (mgr.14355) 11696 : audit [DBG] from='client.256197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:22 smithi131 bash[24745]: cluster 2024-09-14T02:51:21.298117+0000 mgr.a (mgr.14355) 11695 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:22 smithi131 bash[24745]: audit 2024-09-14T02:51:21.609143+0000 mgr.a (mgr.14355) 11696 : audit [DBG] from='client.256197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:22 smithi171 bash[25040]: cluster 2024-09-14T02:51:21.298117+0000 mgr.a (mgr.14355) 11695 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:22 smithi171 bash[25040]: audit 2024-09-14T02:51:21.609143+0000 mgr.a (mgr.14355) 11696 : audit [DBG] from='client.256197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:23 smithi007 bash[22722]: audit 2024-09-14T02:51:23.360267+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:51:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:23 smithi131 bash[24745]: audit 2024-09-14T02:51:23.360267+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:51:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:23 smithi171 bash[25040]: audit 2024-09-14T02:51:23.360267+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:51:25.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22972]: debug 2024-09-14T02:51:24.961+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:51:25.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22972]: debug 2024-09-14T02:51:24.961+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:51:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22722]: cluster 2024-09-14T02:51:23.299136+0000 mgr.a (mgr.14355) 11697 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22722]: audit 2024-09-14T02:51:24.205962+0000 mon.a (mon.0) 2339 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:51:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22722]: audit 2024-09-14T02:51:24.207898+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:51:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22722]: audit 2024-09-14T02:51:24.218660+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:51:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:24 smithi007 bash[22722]: audit 2024-09-14T02:51:24.223742+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:24 smithi131 bash[24745]: cluster 2024-09-14T02:51:23.299136+0000 mgr.a (mgr.14355) 11697 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:24 smithi131 bash[24745]: audit 2024-09-14T02:51:24.205962+0000 mon.a (mon.0) 2339 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:51:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:24 smithi131 bash[24745]: audit 2024-09-14T02:51:24.207898+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:51:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:24 smithi131 bash[24745]: audit 2024-09-14T02:51:24.218660+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:51:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:24 smithi131 bash[24745]: audit 2024-09-14T02:51:24.223742+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:24 smithi171 bash[25040]: cluster 2024-09-14T02:51:23.299136+0000 mgr.a (mgr.14355) 11697 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:24 smithi171 bash[25040]: audit 2024-09-14T02:51:24.205962+0000 mon.a (mon.0) 2339 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:51:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:24 smithi171 bash[25040]: audit 2024-09-14T02:51:24.207898+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:51:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:24 smithi171 bash[25040]: audit 2024-09-14T02:51:24.218660+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:51:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:24 smithi171 bash[25040]: audit 2024-09-14T02:51:24.223742+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:25 smithi007 bash[22722]: audit 2024-09-14T02:51:24.225031+0000 mgr.a (mgr.14355) 11698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:25 smithi131 bash[24745]: audit 2024-09-14T02:51:24.225031+0000 mgr.a (mgr.14355) 11698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:25 smithi171 bash[25040]: audit 2024-09-14T02:51:24.225031+0000 mgr.a (mgr.14355) 11698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:51:27.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:27.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:26 smithi007 bash[22722]: audit 2024-09-14T02:51:24.964962+0000 mgr.a (mgr.14355) 11699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:51:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:26 smithi007 bash[22722]: cephadm 2024-09-14T02:51:24.966176+0000 mgr.a (mgr.14355) 11700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:51:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:26 smithi007 bash[22722]: cluster 2024-09-14T02:51:25.300045+0000 mgr.a (mgr.14355) 11701 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:26 smithi131 bash[24745]: audit 2024-09-14T02:51:24.964962+0000 mgr.a (mgr.14355) 11699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:51:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:26 smithi131 bash[24745]: cephadm 2024-09-14T02:51:24.966176+0000 mgr.a (mgr.14355) 11700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:51:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:26 smithi131 bash[24745]: cluster 2024-09-14T02:51:25.300045+0000 mgr.a (mgr.14355) 11701 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:26 smithi171 bash[25040]: audit 2024-09-14T02:51:24.964962+0000 mgr.a (mgr.14355) 11699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:51:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:26 smithi171 bash[25040]: cephadm 2024-09-14T02:51:24.966176+0000 mgr.a (mgr.14355) 11700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:51:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:26 smithi171 bash[25040]: cluster 2024-09-14T02:51:25.300045+0000 mgr.a (mgr.14355) 11701 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:51:27.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:27 smithi007 bash[22722]: cluster 2024-09-14T02:51:27.302173+0000 mgr.a (mgr.14355) 11702 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:27 smithi007 bash[22722]: audit 2024-09-14T02:51:27.364515+0000 mgr.a (mgr.14355) 11703 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:27 smithi131 bash[24745]: cluster 2024-09-14T02:51:27.302173+0000 mgr.a (mgr.14355) 11702 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:27 smithi131 bash[24745]: audit 2024-09-14T02:51:27.364515+0000 mgr.a (mgr.14355) 11703 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:27 smithi171 bash[25040]: cluster 2024-09-14T02:51:27.302173+0000 mgr.a (mgr.14355) 11702 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:27 smithi171 bash[25040]: audit 2024-09-14T02:51:27.364515+0000 mgr.a (mgr.14355) 11703 : audit [DBG] from='client.256383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:30 smithi007 bash[22722]: cluster 2024-09-14T02:51:29.303085+0000 mgr.a (mgr.14355) 11704 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:30 smithi131 bash[24745]: cluster 2024-09-14T02:51:29.303085+0000 mgr.a (mgr.14355) 11704 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:30 smithi171 bash[25040]: cluster 2024-09-14T02:51:29.303085+0000 mgr.a (mgr.14355) 11704 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:32 smithi007 bash[22722]: cluster 2024-09-14T02:51:31.305273+0000 mgr.a (mgr.14355) 11705 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:32.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:32 smithi131 bash[24745]: cluster 2024-09-14T02:51:31.305273+0000 mgr.a (mgr.14355) 11705 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:32 smithi171 bash[25040]: cluster 2024-09-14T02:51:31.305273+0000 mgr.a (mgr.14355) 11705 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:33.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:33.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:34 smithi007 bash[22722]: audit 2024-09-14T02:51:33.109525+0000 mgr.a (mgr.14355) 11706 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:34 smithi007 bash[22722]: cluster 2024-09-14T02:51:33.305789+0000 mgr.a (mgr.14355) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:34 smithi131 bash[24745]: audit 2024-09-14T02:51:33.109525+0000 mgr.a (mgr.14355) 11706 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:34 smithi131 bash[24745]: cluster 2024-09-14T02:51:33.305789+0000 mgr.a (mgr.14355) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:34 smithi171 bash[25040]: audit 2024-09-14T02:51:33.109525+0000 mgr.a (mgr.14355) 11706 : audit [DBG] from='client.256461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:34 smithi171 bash[25040]: cluster 2024-09-14T02:51:33.305789+0000 mgr.a (mgr.14355) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:36 smithi007 bash[22722]: cluster 2024-09-14T02:51:35.307583+0000 mgr.a (mgr.14355) 11708 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:36 smithi131 bash[24745]: cluster 2024-09-14T02:51:35.307583+0000 mgr.a (mgr.14355) 11708 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:36 smithi171 bash[25040]: cluster 2024-09-14T02:51:35.307583+0000 mgr.a (mgr.14355) 11708 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:38.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:38 smithi007 bash[22722]: cluster 2024-09-14T02:51:37.308873+0000 mgr.a (mgr.14355) 11709 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:38 smithi131 bash[24745]: cluster 2024-09-14T02:51:37.308873+0000 mgr.a (mgr.14355) 11709 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:38 smithi171 bash[25040]: cluster 2024-09-14T02:51:37.308873+0000 mgr.a (mgr.14355) 11709 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:51:39.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:39.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:40 smithi007 bash[22722]: audit 2024-09-14T02:51:38.865702+0000 mgr.a (mgr.14355) 11710 : audit [DBG] from='client.256539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:40 smithi007 bash[22722]: cluster 2024-09-14T02:51:39.309842+0000 mgr.a (mgr.14355) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:40 smithi131 bash[24745]: audit 2024-09-14T02:51:38.865702+0000 mgr.a (mgr.14355) 11710 : audit [DBG] from='client.256539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:40 smithi131 bash[24745]: cluster 2024-09-14T02:51:39.309842+0000 mgr.a (mgr.14355) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:40 smithi171 bash[25040]: audit 2024-09-14T02:51:38.865702+0000 mgr.a (mgr.14355) 11710 : audit [DBG] from='client.256539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:40 smithi171 bash[25040]: cluster 2024-09-14T02:51:39.309842+0000 mgr.a (mgr.14355) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:42 smithi007 bash[22722]: cluster 2024-09-14T02:51:41.312125+0000 mgr.a (mgr.14355) 11712 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:42 smithi131 bash[24745]: cluster 2024-09-14T02:51:41.312125+0000 mgr.a (mgr.14355) 11712 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:42 smithi171 bash[25040]: cluster 2024-09-14T02:51:41.312125+0000 mgr.a (mgr.14355) 11712 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:44 smithi007 bash[22722]: cluster 2024-09-14T02:51:43.312882+0000 mgr.a (mgr.14355) 11713 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:44 smithi131 bash[24745]: cluster 2024-09-14T02:51:43.312882+0000 mgr.a (mgr.14355) 11713 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:44 smithi171 bash[25040]: cluster 2024-09-14T02:51:43.312882+0000 mgr.a (mgr.14355) 11713 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:45.049 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:45.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:45 smithi007 bash[22722]: audit 2024-09-14T02:51:44.624391+0000 mgr.a (mgr.14355) 11714 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:45 smithi131 bash[24745]: audit 2024-09-14T02:51:44.624391+0000 mgr.a (mgr.14355) 11714 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:45 smithi171 bash[25040]: audit 2024-09-14T02:51:44.624391+0000 mgr.a (mgr.14355) 11714 : audit [DBG] from='client.256614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:46 smithi007 bash[22722]: cluster 2024-09-14T02:51:45.314816+0000 mgr.a (mgr.14355) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:46 smithi131 bash[24745]: cluster 2024-09-14T02:51:45.314816+0000 mgr.a (mgr.14355) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:46 smithi171 bash[25040]: cluster 2024-09-14T02:51:45.314816+0000 mgr.a (mgr.14355) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:51:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:48 smithi007 bash[22722]: cluster 2024-09-14T02:51:47.316094+0000 mgr.a (mgr.14355) 11716 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:51:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:48 smithi131 bash[24745]: cluster 2024-09-14T02:51:47.316094+0000 mgr.a (mgr.14355) 11716 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:51:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:48 smithi171 bash[25040]: cluster 2024-09-14T02:51:47.316094+0000 mgr.a (mgr.14355) 11716 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:51:50.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:50.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:50 smithi007 bash[22722]: cluster 2024-09-14T02:51:49.316871+0000 mgr.a (mgr.14355) 11717 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:50 smithi131 bash[24745]: cluster 2024-09-14T02:51:49.316871+0000 mgr.a (mgr.14355) 11717 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:50 smithi171 bash[25040]: cluster 2024-09-14T02:51:49.316871+0000 mgr.a (mgr.14355) 11717 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:50.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:50.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:50.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:50.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:50.823 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:51 smithi007 bash[22722]: audit 2024-09-14T02:51:50.387131+0000 mgr.a (mgr.14355) 11718 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:51 smithi131 bash[24745]: audit 2024-09-14T02:51:50.387131+0000 mgr.a (mgr.14355) 11718 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:51 smithi171 bash[25040]: audit 2024-09-14T02:51:50.387131+0000 mgr.a (mgr.14355) 11718 : audit [DBG] from='client.256692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:52 smithi007 bash[22722]: cluster 2024-09-14T02:51:51.319811+0000 mgr.a (mgr.14355) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:52 smithi131 bash[24745]: cluster 2024-09-14T02:51:51.319811+0000 mgr.a (mgr.14355) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:52 smithi171 bash[25040]: cluster 2024-09-14T02:51:51.319811+0000 mgr.a (mgr.14355) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:51:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:54 smithi007 bash[22722]: cluster 2024-09-14T02:51:53.320624+0000 mgr.a (mgr.14355) 11720 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:54 smithi131 bash[24745]: cluster 2024-09-14T02:51:53.320624+0000 mgr.a (mgr.14355) 11720 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:54 smithi171 bash[25040]: cluster 2024-09-14T02:51:53.320624+0000 mgr.a (mgr.14355) 11720 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:51:55.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:51:55.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:51:55.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:51:56.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:51:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:51:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:51:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:51:56.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:51:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:56 smithi007 bash[22722]: cluster 2024-09-14T02:51:55.322146+0000 mgr.a (mgr.14355) 11721 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:51:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:56 smithi131 bash[24745]: cluster 2024-09-14T02:51:55.322146+0000 mgr.a (mgr.14355) 11721 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:51:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:56 smithi171 bash[25040]: cluster 2024-09-14T02:51:55.322146+0000 mgr.a (mgr.14355) 11721 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:51:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:57 smithi007 bash[22722]: audit 2024-09-14T02:51:56.152745+0000 mgr.a (mgr.14355) 11722 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:57 smithi131 bash[24745]: audit 2024-09-14T02:51:56.152745+0000 mgr.a (mgr.14355) 11722 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:57 smithi171 bash[25040]: audit 2024-09-14T02:51:56.152745+0000 mgr.a (mgr.14355) 11722 : audit [DBG] from='client.256770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:51:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:51:58 smithi007 bash[22722]: cluster 2024-09-14T02:51:57.323997+0000 mgr.a (mgr.14355) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:51:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:51:58 smithi131 bash[24745]: cluster 2024-09-14T02:51:57.323997+0000 mgr.a (mgr.14355) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:51:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:51:58 smithi171 bash[25040]: cluster 2024-09-14T02:51:57.323997+0000 mgr.a (mgr.14355) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:52:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:00 smithi007 bash[22722]: cluster 2024-09-14T02:51:59.324820+0000 mgr.a (mgr.14355) 11724 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:00 smithi131 bash[24745]: cluster 2024-09-14T02:51:59.324820+0000 mgr.a (mgr.14355) 11724 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:00 smithi171 bash[25040]: cluster 2024-09-14T02:51:59.324820+0000 mgr.a (mgr.14355) 11724 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:01.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:02.326 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:02.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:02.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:02 smithi007 bash[22722]: cluster 2024-09-14T02:52:01.326932+0000 mgr.a (mgr.14355) 11725 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:02 smithi131 bash[24745]: cluster 2024-09-14T02:52:01.326932+0000 mgr.a (mgr.14355) 11725 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:02 smithi171 bash[25040]: cluster 2024-09-14T02:52:01.326932+0000 mgr.a (mgr.14355) 11725 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:03 smithi007 bash[22722]: audit 2024-09-14T02:52:01.908885+0000 mgr.a (mgr.14355) 11726 : audit [DBG] from='client.256845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:03 smithi131 bash[24745]: audit 2024-09-14T02:52:01.908885+0000 mgr.a (mgr.14355) 11726 : audit [DBG] from='client.256845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:03 smithi171 bash[25040]: audit 2024-09-14T02:52:01.908885+0000 mgr.a (mgr.14355) 11726 : audit [DBG] from='client.256845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:04 smithi007 bash[22722]: cluster 2024-09-14T02:52:03.328049+0000 mgr.a (mgr.14355) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:04 smithi131 bash[24745]: cluster 2024-09-14T02:52:03.328049+0000 mgr.a (mgr.14355) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:04 smithi171 bash[25040]: cluster 2024-09-14T02:52:03.328049+0000 mgr.a (mgr.14355) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:06 smithi007 bash[22722]: cluster 2024-09-14T02:52:05.329993+0000 mgr.a (mgr.14355) 11728 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:06 smithi131 bash[24745]: cluster 2024-09-14T02:52:05.329993+0000 mgr.a (mgr.14355) 11728 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:06 smithi171 bash[25040]: cluster 2024-09-14T02:52:05.329993+0000 mgr.a (mgr.14355) 11728 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:07.328 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:08.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:08.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:08.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:08 smithi007 bash[22722]: cluster 2024-09-14T02:52:07.331048+0000 mgr.a (mgr.14355) 11729 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:08 smithi007 bash[22722]: audit 2024-09-14T02:52:07.659194+0000 mgr.a (mgr.14355) 11730 : audit [DBG] from='client.256920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:08 smithi131 bash[24745]: cluster 2024-09-14T02:52:07.331048+0000 mgr.a (mgr.14355) 11729 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:08 smithi131 bash[24745]: audit 2024-09-14T02:52:07.659194+0000 mgr.a (mgr.14355) 11730 : audit [DBG] from='client.256920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:08 smithi171 bash[25040]: cluster 2024-09-14T02:52:07.331048+0000 mgr.a (mgr.14355) 11729 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:08 smithi171 bash[25040]: audit 2024-09-14T02:52:07.659194+0000 mgr.a (mgr.14355) 11730 : audit [DBG] from='client.256920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:10 smithi007 bash[22722]: cluster 2024-09-14T02:52:09.331995+0000 mgr.a (mgr.14355) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:10 smithi131 bash[24745]: cluster 2024-09-14T02:52:09.331995+0000 mgr.a (mgr.14355) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:10 smithi171 bash[25040]: cluster 2024-09-14T02:52:09.331995+0000 mgr.a (mgr.14355) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T02:52:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:12 smithi007 bash[22722]: cluster 2024-09-14T02:52:11.334261+0000 mgr.a (mgr.14355) 11732 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:12 smithi131 bash[24745]: cluster 2024-09-14T02:52:11.334261+0000 mgr.a (mgr.14355) 11732 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:12 smithi171 bash[25040]: cluster 2024-09-14T02:52:11.334261+0000 mgr.a (mgr.14355) 11732 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T02:52:13.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:13.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:13.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:14 smithi007 bash[22722]: cluster 2024-09-14T02:52:13.335052+0000 mgr.a (mgr.14355) 11733 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:14 smithi007 bash[22722]: audit 2024-09-14T02:52:13.419642+0000 mgr.a (mgr.14355) 11734 : audit [DBG] from='client.256995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:14 smithi131 bash[24745]: cluster 2024-09-14T02:52:13.335052+0000 mgr.a (mgr.14355) 11733 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:14 smithi131 bash[24745]: audit 2024-09-14T02:52:13.419642+0000 mgr.a (mgr.14355) 11734 : audit [DBG] from='client.256995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:14 smithi171 bash[25040]: cluster 2024-09-14T02:52:13.335052+0000 mgr.a (mgr.14355) 11733 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:14 smithi171 bash[25040]: audit 2024-09-14T02:52:13.419642+0000 mgr.a (mgr.14355) 11734 : audit [DBG] from='client.256995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:16 smithi007 bash[22722]: cluster 2024-09-14T02:52:15.336920+0000 mgr.a (mgr.14355) 11735 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T02:52:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:16 smithi131 bash[24745]: cluster 2024-09-14T02:52:15.336920+0000 mgr.a (mgr.14355) 11735 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T02:52:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:16 smithi171 bash[25040]: cluster 2024-09-14T02:52:15.336920+0000 mgr.a (mgr.14355) 11735 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T02:52:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:18 smithi007 bash[22722]: cluster 2024-09-14T02:52:17.338237+0000 mgr.a (mgr.14355) 11736 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:18 smithi131 bash[24745]: cluster 2024-09-14T02:52:17.338237+0000 mgr.a (mgr.14355) 11736 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:18 smithi171 bash[25040]: cluster 2024-09-14T02:52:17.338237+0000 mgr.a (mgr.14355) 11736 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:19.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:20 smithi007 bash[22722]: audit 2024-09-14T02:52:19.166523+0000 mgr.a (mgr.14355) 11737 : audit [DBG] from='client.257073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:20 smithi007 bash[22722]: cluster 2024-09-14T02:52:19.339470+0000 mgr.a (mgr.14355) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:20 smithi131 bash[24745]: audit 2024-09-14T02:52:19.166523+0000 mgr.a (mgr.14355) 11737 : audit [DBG] from='client.257073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:20 smithi131 bash[24745]: cluster 2024-09-14T02:52:19.339470+0000 mgr.a (mgr.14355) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:20 smithi171 bash[25040]: audit 2024-09-14T02:52:19.166523+0000 mgr.a (mgr.14355) 11737 : audit [DBG] from='client.257073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:20 smithi171 bash[25040]: cluster 2024-09-14T02:52:19.339470+0000 mgr.a (mgr.14355) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:22 smithi007 bash[22722]: cluster 2024-09-14T02:52:21.341924+0000 mgr.a (mgr.14355) 11739 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:52:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:22 smithi131 bash[24745]: cluster 2024-09-14T02:52:21.341924+0000 mgr.a (mgr.14355) 11739 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:52:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:22 smithi171 bash[25040]: cluster 2024-09-14T02:52:21.341924+0000 mgr.a (mgr.14355) 11739 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T02:52:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:24.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:24 smithi007 bash[22722]: cluster 2024-09-14T02:52:23.342754+0000 mgr.a (mgr.14355) 11740 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:24 smithi131 bash[24745]: cluster 2024-09-14T02:52:23.342754+0000 mgr.a (mgr.14355) 11740 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:24 smithi171 bash[25040]: cluster 2024-09-14T02:52:23.342754+0000 mgr.a (mgr.14355) 11740 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:25.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:25.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:25 smithi007 bash[22722]: audit 2024-09-14T02:52:25.017941+0000 mon.a (mon.0) 2343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:25 smithi131 bash[24745]: audit 2024-09-14T02:52:25.017941+0000 mon.a (mon.0) 2343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:25 smithi171 bash[25040]: audit 2024-09-14T02:52:25.017941+0000 mon.a (mon.0) 2343 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:52:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:26 smithi007 bash[22722]: audit 2024-09-14T02:52:24.960320+0000 mgr.a (mgr.14355) 11741 : audit [DBG] from='client.257148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:26 smithi007 bash[22722]: cluster 2024-09-14T02:52:25.344168+0000 mgr.a (mgr.14355) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:26 smithi131 bash[24745]: audit 2024-09-14T02:52:24.960320+0000 mgr.a (mgr.14355) 11741 : audit [DBG] from='client.257148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:26 smithi131 bash[24745]: cluster 2024-09-14T02:52:25.344168+0000 mgr.a (mgr.14355) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:26 smithi171 bash[25040]: audit 2024-09-14T02:52:24.960320+0000 mgr.a (mgr.14355) 11741 : audit [DBG] from='client.257148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:26 smithi171 bash[25040]: cluster 2024-09-14T02:52:25.344168+0000 mgr.a (mgr.14355) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T02:52:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:28 smithi007 bash[22722]: cluster 2024-09-14T02:52:27.345294+0000 mgr.a (mgr.14355) 11743 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T02:52:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:28 smithi131 bash[24745]: cluster 2024-09-14T02:52:27.345294+0000 mgr.a (mgr.14355) 11743 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T02:52:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:28 smithi171 bash[25040]: cluster 2024-09-14T02:52:27.345294+0000 mgr.a (mgr.14355) 11743 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T02:52:30.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:30.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:30 smithi007 bash[22722]: cluster 2024-09-14T02:52:29.346123+0000 mgr.a (mgr.14355) 11744 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:52:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:30 smithi131 bash[24745]: cluster 2024-09-14T02:52:29.346123+0000 mgr.a (mgr.14355) 11744 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:52:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:30 smithi171 bash[25040]: cluster 2024-09-14T02:52:29.346123+0000 mgr.a (mgr.14355) 11744 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:52:31.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:31.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:31.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:31 smithi007 bash[22722]: audit 2024-09-14T02:52:30.735352+0000 mgr.a (mgr.14355) 11745 : audit [DBG] from='client.257226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:31 smithi131 bash[24745]: audit 2024-09-14T02:52:30.735352+0000 mgr.a (mgr.14355) 11745 : audit [DBG] from='client.257226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:31 smithi171 bash[25040]: audit 2024-09-14T02:52:30.735352+0000 mgr.a (mgr.14355) 11745 : audit [DBG] from='client.257226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:32 smithi007 bash[22722]: cluster 2024-09-14T02:52:31.348894+0000 mgr.a (mgr.14355) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:32 smithi131 bash[24745]: cluster 2024-09-14T02:52:31.348894+0000 mgr.a (mgr.14355) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:32 smithi171 bash[25040]: cluster 2024-09-14T02:52:31.348894+0000 mgr.a (mgr.14355) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:34 smithi007 bash[22722]: cluster 2024-09-14T02:52:33.349693+0000 mgr.a (mgr.14355) 11747 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:34 smithi131 bash[24745]: cluster 2024-09-14T02:52:33.349693+0000 mgr.a (mgr.14355) 11747 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:34 smithi171 bash[25040]: cluster 2024-09-14T02:52:33.349693+0000 mgr.a (mgr.14355) 11747 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:52:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:36.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22972]: debug 2024-09-14T02:52:36.592+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:52:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22972]: debug 2024-09-14T02:52:36.604+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:52:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: cluster 2024-09-14T02:52:35.351337+0000 mgr.a (mgr.14355) 11748 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.797456+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.805639+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.807579+0000 mon.a (mon.0) 2346 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:52:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.809513+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:52:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.819387+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:36 smithi007 bash[22722]: audit 2024-09-14T02:52:35.823933+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:36.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:36.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:36.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:36.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: cluster 2024-09-14T02:52:35.351337+0000 mgr.a (mgr.14355) 11748 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.797456+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.805639+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.807579+0000 mon.a (mon.0) 2346 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:52:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.809513+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:52:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.819387+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:36 smithi131 bash[24745]: audit 2024-09-14T02:52:35.823933+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: cluster 2024-09-14T02:52:35.351337+0000 mgr.a (mgr.14355) 11748 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.797456+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.805639+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.807579+0000 mon.a (mon.0) 2346 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.809513+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.819387+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:36 smithi171 bash[25040]: audit 2024-09-14T02:52:35.823933+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:37 smithi007 bash[22722]: audit 2024-09-14T02:52:35.826027+0000 mgr.a (mgr.14355) 11749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:37 smithi007 bash[22722]: audit 2024-09-14T02:52:36.479918+0000 mgr.a (mgr.14355) 11750 : audit [DBG] from='client.257355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:37 smithi007 bash[22722]: audit 2024-09-14T02:52:36.594436+0000 mgr.a (mgr.14355) 11751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:52:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:37 smithi007 bash[22722]: cephadm 2024-09-14T02:52:36.607428+0000 mgr.a (mgr.14355) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:52:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:37 smithi131 bash[24745]: audit 2024-09-14T02:52:35.826027+0000 mgr.a (mgr.14355) 11749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:37 smithi131 bash[24745]: audit 2024-09-14T02:52:36.479918+0000 mgr.a (mgr.14355) 11750 : audit [DBG] from='client.257355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:37 smithi131 bash[24745]: audit 2024-09-14T02:52:36.594436+0000 mgr.a (mgr.14355) 11751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:52:38.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:37 smithi131 bash[24745]: cephadm 2024-09-14T02:52:36.607428+0000 mgr.a (mgr.14355) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:52:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:37 smithi171 bash[25040]: audit 2024-09-14T02:52:35.826027+0000 mgr.a (mgr.14355) 11749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:52:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:37 smithi171 bash[25040]: audit 2024-09-14T02:52:36.479918+0000 mgr.a (mgr.14355) 11750 : audit [DBG] from='client.257355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:37 smithi171 bash[25040]: audit 2024-09-14T02:52:36.594436+0000 mgr.a (mgr.14355) 11751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:52:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:37 smithi171 bash[25040]: cephadm 2024-09-14T02:52:36.607428+0000 mgr.a (mgr.14355) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:52:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:38 smithi007 bash[22722]: cluster 2024-09-14T02:52:37.353188+0000 mgr.a (mgr.14355) 11753 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:38 smithi131 bash[24745]: cluster 2024-09-14T02:52:37.353188+0000 mgr.a (mgr.14355) 11753 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:38 smithi171 bash[25040]: cluster 2024-09-14T02:52:37.353188+0000 mgr.a (mgr.14355) 11753 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:40 smithi007 bash[22722]: cluster 2024-09-14T02:52:39.353987+0000 mgr.a (mgr.14355) 11754 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:40 smithi131 bash[24745]: cluster 2024-09-14T02:52:39.353987+0000 mgr.a (mgr.14355) 11754 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:40 smithi171 bash[25040]: cluster 2024-09-14T02:52:39.353987+0000 mgr.a (mgr.14355) 11754 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:52:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:41.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:42.779 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:42.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:42 smithi007 bash[22722]: cluster 2024-09-14T02:52:41.356095+0000 mgr.a (mgr.14355) 11755 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:42 smithi131 bash[24745]: cluster 2024-09-14T02:52:41.356095+0000 mgr.a (mgr.14355) 11755 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:42 smithi171 bash[25040]: cluster 2024-09-14T02:52:41.356095+0000 mgr.a (mgr.14355) 11755 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:43 smithi007 bash[22722]: audit 2024-09-14T02:52:42.330020+0000 mgr.a (mgr.14355) 11756 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:43 smithi131 bash[24745]: audit 2024-09-14T02:52:42.330020+0000 mgr.a (mgr.14355) 11756 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:43 smithi171 bash[25040]: audit 2024-09-14T02:52:42.330020+0000 mgr.a (mgr.14355) 11756 : audit [DBG] from='client.257484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:44 smithi007 bash[22722]: cluster 2024-09-14T02:52:43.357016+0000 mgr.a (mgr.14355) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:44 smithi131 bash[24745]: cluster 2024-09-14T02:52:43.357016+0000 mgr.a (mgr.14355) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:44 smithi171 bash[25040]: cluster 2024-09-14T02:52:43.357016+0000 mgr.a (mgr.14355) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:45 smithi007 bash[22722]: cluster 2024-09-14T02:52:45.358782+0000 mgr.a (mgr.14355) 11758 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:45 smithi131 bash[24745]: cluster 2024-09-14T02:52:45.358782+0000 mgr.a (mgr.14355) 11758 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:45 smithi171 bash[25040]: cluster 2024-09-14T02:52:45.358782+0000 mgr.a (mgr.14355) 11758 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:47.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:47.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:47.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:48.563 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:48.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:48.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:48.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:48.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:48 smithi007 bash[22722]: cluster 2024-09-14T02:52:47.360044+0000 mgr.a (mgr.14355) 11759 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:48 smithi131 bash[24745]: cluster 2024-09-14T02:52:47.360044+0000 mgr.a (mgr.14355) 11759 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:48 smithi171 bash[25040]: cluster 2024-09-14T02:52:47.360044+0000 mgr.a (mgr.14355) 11759 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:49 smithi007 bash[22722]: audit 2024-09-14T02:52:48.120655+0000 mgr.a (mgr.14355) 11760 : audit [DBG] from='client.257556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:49 smithi131 bash[24745]: audit 2024-09-14T02:52:48.120655+0000 mgr.a (mgr.14355) 11760 : audit [DBG] from='client.257556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:49 smithi171 bash[25040]: audit 2024-09-14T02:52:48.120655+0000 mgr.a (mgr.14355) 11760 : audit [DBG] from='client.257556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:50 smithi007 bash[22722]: cluster 2024-09-14T02:52:49.360929+0000 mgr.a (mgr.14355) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:50 smithi131 bash[24745]: cluster 2024-09-14T02:52:49.360929+0000 mgr.a (mgr.14355) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:50 smithi171 bash[25040]: cluster 2024-09-14T02:52:49.360929+0000 mgr.a (mgr.14355) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:52 smithi007 bash[22722]: cluster 2024-09-14T02:52:51.363201+0000 mgr.a (mgr.14355) 11762 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:52 smithi131 bash[24745]: cluster 2024-09-14T02:52:51.363201+0000 mgr.a (mgr.14355) 11762 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:52 smithi171 bash[25040]: cluster 2024-09-14T02:52:51.363201+0000 mgr.a (mgr.14355) 11762 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:52:53.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:53.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:53.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:52:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:52:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:52:54.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:52:54.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:52:54.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:52:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:54 smithi007 bash[22722]: cluster 2024-09-14T02:52:53.363966+0000 mgr.a (mgr.14355) 11763 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:54 smithi131 bash[24745]: cluster 2024-09-14T02:52:53.363966+0000 mgr.a (mgr.14355) 11763 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:54 smithi171 bash[25040]: cluster 2024-09-14T02:52:53.363966+0000 mgr.a (mgr.14355) 11763 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:52:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:55 smithi007 bash[22722]: audit 2024-09-14T02:52:53.901399+0000 mgr.a (mgr.14355) 11764 : audit [DBG] from='client.257634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:55 smithi131 bash[24745]: audit 2024-09-14T02:52:53.901399+0000 mgr.a (mgr.14355) 11764 : audit [DBG] from='client.257634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:55 smithi171 bash[25040]: audit 2024-09-14T02:52:53.901399+0000 mgr.a (mgr.14355) 11764 : audit [DBG] from='client.257634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:52:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:56 smithi007 bash[22722]: cluster 2024-09-14T02:52:55.365786+0000 mgr.a (mgr.14355) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:52:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:56 smithi131 bash[24745]: cluster 2024-09-14T02:52:55.365786+0000 mgr.a (mgr.14355) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:52:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:56 smithi171 bash[25040]: cluster 2024-09-14T02:52:55.365786+0000 mgr.a (mgr.14355) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:52:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:52:58 smithi007 bash[22722]: cluster 2024-09-14T02:52:57.367073+0000 mgr.a (mgr.14355) 11766 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:52:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:52:58 smithi131 bash[24745]: cluster 2024-09-14T02:52:57.367073+0000 mgr.a (mgr.14355) 11766 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:52:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:52:58 smithi171 bash[25040]: cluster 2024-09-14T02:52:57.367073+0000 mgr.a (mgr.14355) 11766 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:52:59.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:52:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:52:59.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:00.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:00.069 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:00 smithi007 bash[22722]: cluster 2024-09-14T02:52:59.367851+0000 mgr.a (mgr.14355) 11767 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:00 smithi007 bash[22722]: audit 2024-09-14T02:52:59.663799+0000 mgr.a (mgr.14355) 11768 : audit [DBG] from='client.257712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:00 smithi131 bash[24745]: cluster 2024-09-14T02:52:59.367851+0000 mgr.a (mgr.14355) 11767 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:00.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:00 smithi131 bash[24745]: audit 2024-09-14T02:52:59.663799+0000 mgr.a (mgr.14355) 11768 : audit [DBG] from='client.257712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:00 smithi171 bash[25040]: cluster 2024-09-14T02:52:59.367851+0000 mgr.a (mgr.14355) 11767 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:00 smithi171 bash[25040]: audit 2024-09-14T02:52:59.663799+0000 mgr.a (mgr.14355) 11768 : audit [DBG] from='client.257712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:02 smithi131 bash[24745]: cluster 2024-09-14T02:53:01.370185+0000 mgr.a (mgr.14355) 11769 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:02 smithi171 bash[25040]: cluster 2024-09-14T02:53:01.370185+0000 mgr.a (mgr.14355) 11769 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:02 smithi007 bash[22722]: cluster 2024-09-14T02:53:01.370185+0000 mgr.a (mgr.14355) 11769 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:04 smithi131 bash[24745]: cluster 2024-09-14T02:53:03.370954+0000 mgr.a (mgr.14355) 11770 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:04 smithi171 bash[25040]: cluster 2024-09-14T02:53:03.370954+0000 mgr.a (mgr.14355) 11770 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:04 smithi007 bash[22722]: cluster 2024-09-14T02:53:03.370954+0000 mgr.a (mgr.14355) 11770 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:05.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:05.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:05.071 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:05.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:05.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:05.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:05.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:05.857 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:06 smithi131 bash[24745]: cluster 2024-09-14T02:53:05.371996+0000 mgr.a (mgr.14355) 11771 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:06 smithi131 bash[24745]: audit 2024-09-14T02:53:05.408418+0000 mgr.a (mgr.14355) 11772 : audit [DBG] from='client.257790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:06 smithi171 bash[25040]: cluster 2024-09-14T02:53:05.371996+0000 mgr.a (mgr.14355) 11771 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:06 smithi171 bash[25040]: audit 2024-09-14T02:53:05.408418+0000 mgr.a (mgr.14355) 11772 : audit [DBG] from='client.257790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:06 smithi007 bash[22722]: cluster 2024-09-14T02:53:05.371996+0000 mgr.a (mgr.14355) 11771 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:06 smithi007 bash[22722]: audit 2024-09-14T02:53:05.408418+0000 mgr.a (mgr.14355) 11772 : audit [DBG] from='client.257790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:08 smithi131 bash[24745]: cluster 2024-09-14T02:53:07.373656+0000 mgr.a (mgr.14355) 11773 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:08 smithi171 bash[25040]: cluster 2024-09-14T02:53:07.373656+0000 mgr.a (mgr.14355) 11773 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:08 smithi007 bash[22722]: cluster 2024-09-14T02:53:07.373656+0000 mgr.a (mgr.14355) 11773 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:10 smithi131 bash[24745]: cluster 2024-09-14T02:53:09.374441+0000 mgr.a (mgr.14355) 11774 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:10 smithi171 bash[25040]: cluster 2024-09-14T02:53:09.374441+0000 mgr.a (mgr.14355) 11774 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:10 smithi007 bash[22722]: cluster 2024-09-14T02:53:09.374441+0000 mgr.a (mgr.14355) 11774 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:11.639 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:11.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:11.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:11.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:11.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:12 smithi131 bash[24745]: audit 2024-09-14T02:53:11.193053+0000 mgr.a (mgr.14355) 11775 : audit [DBG] from='client.257868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:12 smithi131 bash[24745]: cluster 2024-09-14T02:53:11.375884+0000 mgr.a (mgr.14355) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:12 smithi171 bash[25040]: audit 2024-09-14T02:53:11.193053+0000 mgr.a (mgr.14355) 11775 : audit [DBG] from='client.257868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:12 smithi171 bash[25040]: cluster 2024-09-14T02:53:11.375884+0000 mgr.a (mgr.14355) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:12 smithi007 bash[22722]: audit 2024-09-14T02:53:11.193053+0000 mgr.a (mgr.14355) 11775 : audit [DBG] from='client.257868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:12 smithi007 bash[22722]: cluster 2024-09-14T02:53:11.375884+0000 mgr.a (mgr.14355) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:14 smithi131 bash[24745]: cluster 2024-09-14T02:53:13.376762+0000 mgr.a (mgr.14355) 11777 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:14 smithi171 bash[25040]: cluster 2024-09-14T02:53:13.376762+0000 mgr.a (mgr.14355) 11777 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:14 smithi007 bash[22722]: cluster 2024-09-14T02:53:13.376762+0000 mgr.a (mgr.14355) 11777 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:16.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:16.641 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:16 smithi131 bash[24745]: cluster 2024-09-14T02:53:15.378996+0000 mgr.a (mgr.14355) 11778 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:16 smithi171 bash[25040]: cluster 2024-09-14T02:53:15.378996+0000 mgr.a (mgr.14355) 11778 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:16.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:16 smithi007 bash[22722]: cluster 2024-09-14T02:53:15.378996+0000 mgr.a (mgr.14355) 11778 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:17.399 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:17.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:18 smithi131 bash[24745]: audit 2024-09-14T02:53:16.973055+0000 mgr.a (mgr.14355) 11779 : audit [DBG] from='client.257946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:18 smithi131 bash[24745]: cluster 2024-09-14T02:53:17.379618+0000 mgr.a (mgr.14355) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:18 smithi171 bash[25040]: audit 2024-09-14T02:53:16.973055+0000 mgr.a (mgr.14355) 11779 : audit [DBG] from='client.257946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:18 smithi171 bash[25040]: cluster 2024-09-14T02:53:17.379618+0000 mgr.a (mgr.14355) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:18 smithi007 bash[22722]: audit 2024-09-14T02:53:16.973055+0000 mgr.a (mgr.14355) 11779 : audit [DBG] from='client.257946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:18 smithi007 bash[22722]: cluster 2024-09-14T02:53:17.379618+0000 mgr.a (mgr.14355) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:20 smithi131 bash[24745]: cluster 2024-09-14T02:53:19.380338+0000 mgr.a (mgr.14355) 11781 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:20 smithi171 bash[25040]: cluster 2024-09-14T02:53:19.380338+0000 mgr.a (mgr.14355) 11781 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:20 smithi007 bash[22722]: cluster 2024-09-14T02:53:19.380338+0000 mgr.a (mgr.14355) 11781 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:22.400 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:22.401 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:22.401 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:22 smithi131 bash[24745]: cluster 2024-09-14T02:53:21.382588+0000 mgr.a (mgr.14355) 11782 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:22 smithi171 bash[25040]: cluster 2024-09-14T02:53:21.382588+0000 mgr.a (mgr.14355) 11782 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:22 smithi007 bash[22722]: cluster 2024-09-14T02:53:21.382588+0000 mgr.a (mgr.14355) 11782 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:23.173 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:23.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:23.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:23.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:23.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:23 smithi131 bash[24745]: audit 2024-09-14T02:53:22.733877+0000 mgr.a (mgr.14355) 11783 : audit [DBG] from='client.258021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:23 smithi171 bash[25040]: audit 2024-09-14T02:53:22.733877+0000 mgr.a (mgr.14355) 11783 : audit [DBG] from='client.258021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:23 smithi007 bash[22722]: audit 2024-09-14T02:53:22.733877+0000 mgr.a (mgr.14355) 11783 : audit [DBG] from='client.258021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:24 smithi131 bash[24745]: cluster 2024-09-14T02:53:23.383540+0000 mgr.a (mgr.14355) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:24 smithi171 bash[25040]: cluster 2024-09-14T02:53:23.383540+0000 mgr.a (mgr.14355) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:24 smithi007 bash[22722]: cluster 2024-09-14T02:53:23.383540+0000 mgr.a (mgr.14355) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:26 smithi131 bash[24745]: cluster 2024-09-14T02:53:25.385707+0000 mgr.a (mgr.14355) 11785 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:26 smithi171 bash[25040]: cluster 2024-09-14T02:53:25.385707+0000 mgr.a (mgr.14355) 11785 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:26 smithi007 bash[22722]: cluster 2024-09-14T02:53:25.385707+0000 mgr.a (mgr.14355) 11785 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:28.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:28.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:28 smithi131 bash[24745]: cluster 2024-09-14T02:53:27.386503+0000 mgr.a (mgr.14355) 11786 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:28 smithi171 bash[25040]: cluster 2024-09-14T02:53:27.386503+0000 mgr.a (mgr.14355) 11786 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:28.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:28.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:28.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:28 smithi007 bash[22722]: cluster 2024-09-14T02:53:27.386503+0000 mgr.a (mgr.14355) 11786 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:29 smithi131 bash[24745]: audit 2024-09-14T02:53:28.512755+0000 mgr.a (mgr.14355) 11787 : audit [DBG] from='client.258096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:29 smithi171 bash[25040]: audit 2024-09-14T02:53:28.512755+0000 mgr.a (mgr.14355) 11787 : audit [DBG] from='client.258096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:29 smithi007 bash[22722]: audit 2024-09-14T02:53:28.512755+0000 mgr.a (mgr.14355) 11787 : audit [DBG] from='client.258096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:30 smithi131 bash[24745]: cluster 2024-09-14T02:53:29.387560+0000 mgr.a (mgr.14355) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:30 smithi171 bash[25040]: cluster 2024-09-14T02:53:29.387560+0000 mgr.a (mgr.14355) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:30 smithi007 bash[22722]: cluster 2024-09-14T02:53:29.387560+0000 mgr.a (mgr.14355) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:32 smithi171 bash[25040]: cluster 2024-09-14T02:53:31.389925+0000 mgr.a (mgr.14355) 11789 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:32 smithi007 bash[22722]: cluster 2024-09-14T02:53:31.389925+0000 mgr.a (mgr.14355) 11789 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:32 smithi131 bash[24745]: cluster 2024-09-14T02:53:31.389925+0000 mgr.a (mgr.14355) 11789 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:33.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:33.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:34.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:34.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:34 smithi171 bash[25040]: cluster 2024-09-14T02:53:33.390890+0000 mgr.a (mgr.14355) 11790 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:34 smithi007 bash[22722]: cluster 2024-09-14T02:53:33.390890+0000 mgr.a (mgr.14355) 11790 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:34 smithi131 bash[24745]: cluster 2024-09-14T02:53:33.390890+0000 mgr.a (mgr.14355) 11790 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:35 smithi007 bash[22722]: audit 2024-09-14T02:53:34.277868+0000 mgr.a (mgr.14355) 11791 : audit [DBG] from='client.258174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:35 smithi131 bash[24745]: audit 2024-09-14T02:53:34.277868+0000 mgr.a (mgr.14355) 11791 : audit [DBG] from='client.258174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:35 smithi171 bash[25040]: audit 2024-09-14T02:53:34.277868+0000 mgr.a (mgr.14355) 11791 : audit [DBG] from='client.258174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:36 smithi007 bash[22722]: cluster 2024-09-14T02:53:35.393227+0000 mgr.a (mgr.14355) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:36 smithi131 bash[24745]: cluster 2024-09-14T02:53:35.393227+0000 mgr.a (mgr.14355) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:36 smithi171 bash[25040]: cluster 2024-09-14T02:53:35.393227+0000 mgr.a (mgr.14355) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:53:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:37 smithi007 bash[22722]: audit 2024-09-14T02:53:36.661809+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:53:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:37 smithi131 bash[24745]: audit 2024-09-14T02:53:36.661809+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:53:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:37 smithi171 bash[25040]: audit 2024-09-14T02:53:36.661809+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:53:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:38 smithi007 bash[22722]: cluster 2024-09-14T02:53:37.393709+0000 mgr.a (mgr.14355) 11793 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:38 smithi131 bash[24745]: cluster 2024-09-14T02:53:37.393709+0000 mgr.a (mgr.14355) 11793 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:38 smithi171 bash[25040]: cluster 2024-09-14T02:53:37.393709+0000 mgr.a (mgr.14355) 11793 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:39.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:39.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:39.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:40.445 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:40.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:40 smithi007 bash[22722]: cluster 2024-09-14T02:53:39.394434+0000 mgr.a (mgr.14355) 11794 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:40 smithi131 bash[24745]: cluster 2024-09-14T02:53:39.394434+0000 mgr.a (mgr.14355) 11794 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:40 smithi171 bash[25040]: cluster 2024-09-14T02:53:39.394434+0000 mgr.a (mgr.14355) 11794 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:41 smithi007 bash[22722]: audit 2024-09-14T02:53:40.038854+0000 mgr.a (mgr.14355) 11795 : audit [DBG] from='client.258252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:41 smithi131 bash[24745]: audit 2024-09-14T02:53:40.038854+0000 mgr.a (mgr.14355) 11795 : audit [DBG] from='client.258252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:41 smithi171 bash[25040]: audit 2024-09-14T02:53:40.038854+0000 mgr.a (mgr.14355) 11795 : audit [DBG] from='client.258252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:42 smithi007 bash[22722]: cluster 2024-09-14T02:53:41.396762+0000 mgr.a (mgr.14355) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:53:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:42 smithi131 bash[24745]: cluster 2024-09-14T02:53:41.396762+0000 mgr.a (mgr.14355) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:53:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:42 smithi171 bash[25040]: cluster 2024-09-14T02:53:41.396762+0000 mgr.a (mgr.14355) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:53:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:44 smithi131 bash[24745]: cluster 2024-09-14T02:53:43.397520+0000 mgr.a (mgr.14355) 11797 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:44 smithi171 bash[25040]: cluster 2024-09-14T02:53:43.397520+0000 mgr.a (mgr.14355) 11797 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:44 smithi007 bash[22722]: cluster 2024-09-14T02:53:43.397520+0000 mgr.a (mgr.14355) 11797 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:53:45.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:46.187 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:46.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:46.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:46.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:46.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:46 smithi131 bash[24745]: cluster 2024-09-14T02:53:45.399501+0000 mgr.a (mgr.14355) 11798 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:46 smithi131 bash[24745]: audit 2024-09-14T02:53:45.774778+0000 mgr.a (mgr.14355) 11799 : audit [DBG] from='client.258324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:46 smithi171 bash[25040]: cluster 2024-09-14T02:53:45.399501+0000 mgr.a (mgr.14355) 11798 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:46 smithi171 bash[25040]: audit 2024-09-14T02:53:45.774778+0000 mgr.a (mgr.14355) 11799 : audit [DBG] from='client.258324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:46 smithi007 bash[22722]: cluster 2024-09-14T02:53:45.399501+0000 mgr.a (mgr.14355) 11798 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:53:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:46 smithi007 bash[22722]: audit 2024-09-14T02:53:45.774778+0000 mgr.a (mgr.14355) 11799 : audit [DBG] from='client.258324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:48.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22972]: debug 2024-09-14T02:53:47.915+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22972]: debug 2024-09-14T02:53:47.919+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:46.999631+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.008147+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.147195+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.155720+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.157987+0000 mon.a (mon.0) 2355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.160146+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:53:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.170766+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.176134+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: audit 2024-09-14T02:53:47.178940+0000 mgr.a (mgr.14355) 11800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:47 smithi007 bash[22722]: cluster 2024-09-14T02:53:47.400051+0000 mgr.a (mgr.14355) 11801 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:46.999631+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:47.008147+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:47.147195+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:47.155720+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:47.157987+0000 mon.a (mon.0) 2355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:47 smithi131 bash[24745]: audit 2024-09-14T02:53:47.160146+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:48 smithi131 bash[24745]: audit 2024-09-14T02:53:47.170766+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:48 smithi131 bash[24745]: audit 2024-09-14T02:53:47.176134+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:48 smithi131 bash[24745]: audit 2024-09-14T02:53:47.178940+0000 mgr.a (mgr.14355) 11800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:48 smithi131 bash[24745]: cluster 2024-09-14T02:53:47.400051+0000 mgr.a (mgr.14355) 11801 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:46.999631+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:47.008147+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:47.147195+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:47.155720+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:47.157987+0000 mon.a (mon.0) 2355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:47 smithi171 bash[25040]: audit 2024-09-14T02:53:47.160146+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:53:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:48 smithi171 bash[25040]: audit 2024-09-14T02:53:47.170766+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:53:48.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:48 smithi171 bash[25040]: audit 2024-09-14T02:53:47.176134+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:48 smithi171 bash[25040]: audit 2024-09-14T02:53:47.178940+0000 mgr.a (mgr.14355) 11800 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:53:48.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:48 smithi171 bash[25040]: cluster 2024-09-14T02:53:47.400051+0000 mgr.a (mgr.14355) 11801 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:49 smithi007 bash[22722]: audit 2024-09-14T02:53:47.921251+0000 mgr.a (mgr.14355) 11802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:53:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:49 smithi007 bash[22722]: cephadm 2024-09-14T02:53:47.922706+0000 mgr.a (mgr.14355) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:53:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:49 smithi131 bash[24745]: audit 2024-09-14T02:53:47.921251+0000 mgr.a (mgr.14355) 11802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:53:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:49 smithi131 bash[24745]: cephadm 2024-09-14T02:53:47.922706+0000 mgr.a (mgr.14355) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:53:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:49 smithi171 bash[25040]: audit 2024-09-14T02:53:47.921251+0000 mgr.a (mgr.14355) 11802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:53:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:49 smithi171 bash[25040]: cephadm 2024-09-14T02:53:47.922706+0000 mgr.a (mgr.14355) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:53:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:50 smithi007 bash[22722]: cluster 2024-09-14T02:53:49.400912+0000 mgr.a (mgr.14355) 11804 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:50 smithi131 bash[24745]: cluster 2024-09-14T02:53:49.400912+0000 mgr.a (mgr.14355) 11804 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:50 smithi171 bash[25040]: cluster 2024-09-14T02:53:49.400912+0000 mgr.a (mgr.14355) 11804 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:53:51.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:51.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:51.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:52 smithi131 bash[24745]: cluster 2024-09-14T02:53:51.403087+0000 mgr.a (mgr.14355) 11805 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:52 smithi131 bash[24745]: audit 2024-09-14T02:53:51.509648+0000 mgr.a (mgr.14355) 11806 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:52 smithi171 bash[25040]: cluster 2024-09-14T02:53:51.403087+0000 mgr.a (mgr.14355) 11805 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:52 smithi171 bash[25040]: audit 2024-09-14T02:53:51.509648+0000 mgr.a (mgr.14355) 11806 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:52 smithi007 bash[22722]: cluster 2024-09-14T02:53:51.403087+0000 mgr.a (mgr.14355) 11805 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:52 smithi007 bash[22722]: audit 2024-09-14T02:53:51.509648+0000 mgr.a (mgr.14355) 11806 : audit [DBG] from='client.258504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:54 smithi131 bash[24745]: cluster 2024-09-14T02:53:53.403975+0000 mgr.a (mgr.14355) 11807 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:53:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:54 smithi171 bash[25040]: cluster 2024-09-14T02:53:53.403975+0000 mgr.a (mgr.14355) 11807 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:53:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:54 smithi007 bash[22722]: cluster 2024-09-14T02:53:53.403975+0000 mgr.a (mgr.14355) 11807 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:53:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:56 smithi131 bash[24745]: cluster 2024-09-14T02:53:55.406182+0000 mgr.a (mgr.14355) 11808 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:56 smithi171 bash[25040]: cluster 2024-09-14T02:53:55.406182+0000 mgr.a (mgr.14355) 11808 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:53:56.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:53:56.931 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:53:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:56 smithi007 bash[22722]: cluster 2024-09-14T02:53:55.406182+0000 mgr.a (mgr.14355) 11808 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:57.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:53:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:53:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:53:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:53:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:53:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:58 smithi131 bash[24745]: audit 2024-09-14T02:53:57.262986+0000 mgr.a (mgr.14355) 11809 : audit [DBG] from='client.258582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:53:58 smithi131 bash[24745]: cluster 2024-09-14T02:53:57.406737+0000 mgr.a (mgr.14355) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:58 smithi171 bash[25040]: audit 2024-09-14T02:53:57.262986+0000 mgr.a (mgr.14355) 11809 : audit [DBG] from='client.258582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:53:58 smithi171 bash[25040]: cluster 2024-09-14T02:53:57.406737+0000 mgr.a (mgr.14355) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:53:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:58 smithi007 bash[22722]: audit 2024-09-14T02:53:57.262986+0000 mgr.a (mgr.14355) 11809 : audit [DBG] from='client.258582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:53:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:53:58 smithi007 bash[22722]: cluster 2024-09-14T02:53:57.406737+0000 mgr.a (mgr.14355) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:00 smithi131 bash[24745]: cluster 2024-09-14T02:53:59.407599+0000 mgr.a (mgr.14355) 11811 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:00 smithi171 bash[25040]: cluster 2024-09-14T02:53:59.407599+0000 mgr.a (mgr.14355) 11811 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:00 smithi007 bash[22722]: cluster 2024-09-14T02:53:59.407599+0000 mgr.a (mgr.14355) 11811 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:02 smithi131 bash[24745]: cluster 2024-09-14T02:54:01.409850+0000 mgr.a (mgr.14355) 11812 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:02 smithi171 bash[25040]: cluster 2024-09-14T02:54:01.409850+0000 mgr.a (mgr.14355) 11812 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:02 smithi007 bash[22722]: cluster 2024-09-14T02:54:01.409850+0000 mgr.a (mgr.14355) 11812 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:03.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:03.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:04 smithi131 bash[24745]: audit 2024-09-14T02:54:03.026865+0000 mgr.a (mgr.14355) 11813 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:04 smithi131 bash[24745]: cluster 2024-09-14T02:54:03.410381+0000 mgr.a (mgr.14355) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:04 smithi171 bash[25040]: audit 2024-09-14T02:54:03.026865+0000 mgr.a (mgr.14355) 11813 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:04 smithi171 bash[25040]: cluster 2024-09-14T02:54:03.410381+0000 mgr.a (mgr.14355) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:04 smithi007 bash[22722]: audit 2024-09-14T02:54:03.026865+0000 mgr.a (mgr.14355) 11813 : audit [DBG] from='client.258654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:04 smithi007 bash[22722]: cluster 2024-09-14T02:54:03.410381+0000 mgr.a (mgr.14355) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:06 smithi131 bash[24745]: cluster 2024-09-14T02:54:05.412497+0000 mgr.a (mgr.14355) 11815 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:06 smithi171 bash[25040]: cluster 2024-09-14T02:54:05.412497+0000 mgr.a (mgr.14355) 11815 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:06 smithi007 bash[22722]: cluster 2024-09-14T02:54:05.412497+0000 mgr.a (mgr.14355) 11815 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:08.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:08.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:08.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:08 smithi131 bash[24745]: cluster 2024-09-14T02:54:07.413268+0000 mgr.a (mgr.14355) 11816 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:08 smithi171 bash[25040]: cluster 2024-09-14T02:54:07.413268+0000 mgr.a (mgr.14355) 11816 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:08 smithi007 bash[22722]: cluster 2024-09-14T02:54:07.413268+0000 mgr.a (mgr.14355) 11816 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:09.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:09.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:09.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:09 smithi131 bash[24745]: audit 2024-09-14T02:54:08.786185+0000 mgr.a (mgr.14355) 11817 : audit [DBG] from='client.258732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:09 smithi171 bash[25040]: audit 2024-09-14T02:54:08.786185+0000 mgr.a (mgr.14355) 11817 : audit [DBG] from='client.258732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:09 smithi007 bash[22722]: audit 2024-09-14T02:54:08.786185+0000 mgr.a (mgr.14355) 11817 : audit [DBG] from='client.258732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:10 smithi131 bash[24745]: cluster 2024-09-14T02:54:09.414209+0000 mgr.a (mgr.14355) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:10 smithi171 bash[25040]: cluster 2024-09-14T02:54:09.414209+0000 mgr.a (mgr.14355) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:10 smithi007 bash[22722]: cluster 2024-09-14T02:54:09.414209+0000 mgr.a (mgr.14355) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:12 smithi131 bash[24745]: cluster 2024-09-14T02:54:11.416637+0000 mgr.a (mgr.14355) 11819 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:12 smithi171 bash[25040]: cluster 2024-09-14T02:54:11.416637+0000 mgr.a (mgr.14355) 11819 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:12 smithi007 bash[22722]: cluster 2024-09-14T02:54:11.416637+0000 mgr.a (mgr.14355) 11819 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:14.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:14.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:14.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:14 smithi131 bash[24745]: cluster 2024-09-14T02:54:13.417592+0000 mgr.a (mgr.14355) 11820 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:14 smithi171 bash[25040]: cluster 2024-09-14T02:54:13.417592+0000 mgr.a (mgr.14355) 11820 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:14 smithi007 bash[22722]: cluster 2024-09-14T02:54:13.417592+0000 mgr.a (mgr.14355) 11820 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:14.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:14.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:15 smithi131 bash[24745]: audit 2024-09-14T02:54:14.545979+0000 mgr.a (mgr.14355) 11821 : audit [DBG] from='client.258804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:15 smithi171 bash[25040]: audit 2024-09-14T02:54:14.545979+0000 mgr.a (mgr.14355) 11821 : audit [DBG] from='client.258804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:15 smithi007 bash[22722]: audit 2024-09-14T02:54:14.545979+0000 mgr.a (mgr.14355) 11821 : audit [DBG] from='client.258804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:16.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:16 smithi131 bash[24745]: cluster 2024-09-14T02:54:15.420044+0000 mgr.a (mgr.14355) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:16 smithi171 bash[25040]: cluster 2024-09-14T02:54:15.420044+0000 mgr.a (mgr.14355) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:16 smithi007 bash[22722]: cluster 2024-09-14T02:54:15.420044+0000 mgr.a (mgr.14355) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:18 smithi131 bash[24745]: cluster 2024-09-14T02:54:17.420831+0000 mgr.a (mgr.14355) 11823 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:18 smithi171 bash[25040]: cluster 2024-09-14T02:54:17.420831+0000 mgr.a (mgr.14355) 11823 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:18 smithi007 bash[22722]: cluster 2024-09-14T02:54:17.420831+0000 mgr.a (mgr.14355) 11823 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:19.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:19.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:20.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:20.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:20.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:20.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:20.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:20 smithi131 bash[24745]: cluster 2024-09-14T02:54:19.421620+0000 mgr.a (mgr.14355) 11824 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:20 smithi171 bash[25040]: cluster 2024-09-14T02:54:19.421620+0000 mgr.a (mgr.14355) 11824 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:20 smithi007 bash[22722]: cluster 2024-09-14T02:54:19.421620+0000 mgr.a (mgr.14355) 11824 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:21 smithi171 bash[25040]: audit 2024-09-14T02:54:20.315307+0000 mgr.a (mgr.14355) 11825 : audit [DBG] from='client.258882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:21 smithi007 bash[22722]: audit 2024-09-14T02:54:20.315307+0000 mgr.a (mgr.14355) 11825 : audit [DBG] from='client.258882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:21 smithi131 bash[24745]: audit 2024-09-14T02:54:20.315307+0000 mgr.a (mgr.14355) 11825 : audit [DBG] from='client.258882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:22 smithi171 bash[25040]: cluster 2024-09-14T02:54:21.424503+0000 mgr.a (mgr.14355) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:22 smithi007 bash[22722]: cluster 2024-09-14T02:54:21.424503+0000 mgr.a (mgr.14355) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:22 smithi131 bash[24745]: cluster 2024-09-14T02:54:21.424503+0000 mgr.a (mgr.14355) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:24 smithi007 bash[22722]: cluster 2024-09-14T02:54:23.425247+0000 mgr.a (mgr.14355) 11827 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:24 smithi131 bash[24745]: cluster 2024-09-14T02:54:23.425247+0000 mgr.a (mgr.14355) 11827 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:24 smithi171 bash[25040]: cluster 2024-09-14T02:54:23.425247+0000 mgr.a (mgr.14355) 11827 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:25.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:25.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:25.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:26.506 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:26.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:26 smithi007 bash[22722]: cluster 2024-09-14T02:54:25.427203+0000 mgr.a (mgr.14355) 11828 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:26 smithi131 bash[24745]: cluster 2024-09-14T02:54:25.427203+0000 mgr.a (mgr.14355) 11828 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:26 smithi171 bash[25040]: cluster 2024-09-14T02:54:25.427203+0000 mgr.a (mgr.14355) 11828 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:27 smithi007 bash[22722]: audit 2024-09-14T02:54:26.070636+0000 mgr.a (mgr.14355) 11829 : audit [DBG] from='client.258957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:27 smithi131 bash[24745]: audit 2024-09-14T02:54:26.070636+0000 mgr.a (mgr.14355) 11829 : audit [DBG] from='client.258957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:27 smithi171 bash[25040]: audit 2024-09-14T02:54:26.070636+0000 mgr.a (mgr.14355) 11829 : audit [DBG] from='client.258957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:28 smithi007 bash[22722]: cluster 2024-09-14T02:54:27.428182+0000 mgr.a (mgr.14355) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:28 smithi131 bash[24745]: cluster 2024-09-14T02:54:27.428182+0000 mgr.a (mgr.14355) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:28 smithi171 bash[25040]: cluster 2024-09-14T02:54:27.428182+0000 mgr.a (mgr.14355) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:54:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:30 smithi007 bash[22722]: cluster 2024-09-14T02:54:29.429106+0000 mgr.a (mgr.14355) 11831 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:54:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:30 smithi131 bash[24745]: cluster 2024-09-14T02:54:29.429106+0000 mgr.a (mgr.14355) 11831 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:54:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:30 smithi171 bash[25040]: cluster 2024-09-14T02:54:29.429106+0000 mgr.a (mgr.14355) 11831 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:54:31.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:31.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:31.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:32.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:32.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:32.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:32.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:32.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:32 smithi007 bash[22722]: cluster 2024-09-14T02:54:31.431408+0000 mgr.a (mgr.14355) 11832 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:32 smithi007 bash[22722]: audit 2024-09-14T02:54:31.840032+0000 mgr.a (mgr.14355) 11833 : audit [DBG] from='client.259035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:32 smithi131 bash[24745]: cluster 2024-09-14T02:54:31.431408+0000 mgr.a (mgr.14355) 11832 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:32 smithi131 bash[24745]: audit 2024-09-14T02:54:31.840032+0000 mgr.a (mgr.14355) 11833 : audit [DBG] from='client.259035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:32 smithi171 bash[25040]: cluster 2024-09-14T02:54:31.431408+0000 mgr.a (mgr.14355) 11832 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:32 smithi171 bash[25040]: audit 2024-09-14T02:54:31.840032+0000 mgr.a (mgr.14355) 11833 : audit [DBG] from='client.259035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:34 smithi007 bash[22722]: cluster 2024-09-14T02:54:33.432370+0000 mgr.a (mgr.14355) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:34 smithi131 bash[24745]: cluster 2024-09-14T02:54:33.432370+0000 mgr.a (mgr.14355) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:35.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:34 smithi171 bash[25040]: cluster 2024-09-14T02:54:33.432370+0000 mgr.a (mgr.14355) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:36 smithi007 bash[22722]: cluster 2024-09-14T02:54:35.434536+0000 mgr.a (mgr.14355) 11835 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:36 smithi131 bash[24745]: cluster 2024-09-14T02:54:35.434536+0000 mgr.a (mgr.14355) 11835 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:36 smithi171 bash[25040]: cluster 2024-09-14T02:54:35.434536+0000 mgr.a (mgr.14355) 11835 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:37.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:37.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:37.277 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:38.015 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:38.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:38.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:38 smithi007 bash[22722]: cluster 2024-09-14T02:54:37.435084+0000 mgr.a (mgr.14355) 11836 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:38 smithi007 bash[22722]: audit 2024-09-14T02:54:37.606543+0000 mgr.a (mgr.14355) 11837 : audit [DBG] from='client.259113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:38 smithi131 bash[24745]: cluster 2024-09-14T02:54:37.435084+0000 mgr.a (mgr.14355) 11836 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:38 smithi131 bash[24745]: audit 2024-09-14T02:54:37.606543+0000 mgr.a (mgr.14355) 11837 : audit [DBG] from='client.259113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:38 smithi171 bash[25040]: cluster 2024-09-14T02:54:37.435084+0000 mgr.a (mgr.14355) 11836 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:38 smithi171 bash[25040]: audit 2024-09-14T02:54:37.606543+0000 mgr.a (mgr.14355) 11837 : audit [DBG] from='client.259113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:40 smithi007 bash[22722]: cluster 2024-09-14T02:54:39.436033+0000 mgr.a (mgr.14355) 11838 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:40 smithi131 bash[24745]: cluster 2024-09-14T02:54:39.436033+0000 mgr.a (mgr.14355) 11838 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:40 smithi171 bash[25040]: cluster 2024-09-14T02:54:39.436033+0000 mgr.a (mgr.14355) 11838 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:42 smithi007 bash[22722]: cluster 2024-09-14T02:54:41.438275+0000 mgr.a (mgr.14355) 11839 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:43.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:43.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:43.018 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:42 smithi131 bash[24745]: cluster 2024-09-14T02:54:41.438275+0000 mgr.a (mgr.14355) 11839 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:42 smithi171 bash[25040]: cluster 2024-09-14T02:54:41.438275+0000 mgr.a (mgr.14355) 11839 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:43.798 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:44 smithi007 bash[22722]: audit 2024-09-14T02:54:43.354528+0000 mgr.a (mgr.14355) 11840 : audit [DBG] from='client.259191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:44 smithi007 bash[22722]: cluster 2024-09-14T02:54:43.438979+0000 mgr.a (mgr.14355) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:44 smithi131 bash[24745]: audit 2024-09-14T02:54:43.354528+0000 mgr.a (mgr.14355) 11840 : audit [DBG] from='client.259191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:44 smithi131 bash[24745]: cluster 2024-09-14T02:54:43.438979+0000 mgr.a (mgr.14355) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:44 smithi171 bash[25040]: audit 2024-09-14T02:54:43.354528+0000 mgr.a (mgr.14355) 11840 : audit [DBG] from='client.259191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:44 smithi171 bash[25040]: cluster 2024-09-14T02:54:43.438979+0000 mgr.a (mgr.14355) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:46 smithi007 bash[22722]: cluster 2024-09-14T02:54:45.441196+0000 mgr.a (mgr.14355) 11842 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:46 smithi131 bash[24745]: cluster 2024-09-14T02:54:45.441196+0000 mgr.a (mgr.14355) 11842 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:46 smithi171 bash[25040]: cluster 2024-09-14T02:54:45.441196+0000 mgr.a (mgr.14355) 11842 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:48 smithi007 bash[22722]: cluster 2024-09-14T02:54:47.442010+0000 mgr.a (mgr.14355) 11843 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:48 smithi007 bash[22722]: audit 2024-09-14T02:54:47.997687+0000 mon.a (mon.0) 2359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:54:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:48 smithi131 bash[24745]: cluster 2024-09-14T02:54:47.442010+0000 mgr.a (mgr.14355) 11843 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:48 smithi131 bash[24745]: audit 2024-09-14T02:54:47.997687+0000 mon.a (mon.0) 2359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:54:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:48 smithi171 bash[25040]: cluster 2024-09-14T02:54:47.442010+0000 mgr.a (mgr.14355) 11843 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:48 smithi171 bash[25040]: audit 2024-09-14T02:54:47.997687+0000 mon.a (mon.0) 2359 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:54:49.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:49.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:49.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:49.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:49.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:50 smithi007 bash[22722]: audit 2024-09-14T02:54:49.119841+0000 mgr.a (mgr.14355) 11844 : audit [DBG] from='client.259269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:50 smithi007 bash[22722]: cluster 2024-09-14T02:54:49.442606+0000 mgr.a (mgr.14355) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:50 smithi131 bash[24745]: audit 2024-09-14T02:54:49.119841+0000 mgr.a (mgr.14355) 11844 : audit [DBG] from='client.259269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:50 smithi131 bash[24745]: cluster 2024-09-14T02:54:49.442606+0000 mgr.a (mgr.14355) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:50 smithi171 bash[25040]: audit 2024-09-14T02:54:49.119841+0000 mgr.a (mgr.14355) 11844 : audit [DBG] from='client.259269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:50 smithi171 bash[25040]: cluster 2024-09-14T02:54:49.442606+0000 mgr.a (mgr.14355) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:52 smithi007 bash[22722]: cluster 2024-09-14T02:54:51.444903+0000 mgr.a (mgr.14355) 11846 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:52 smithi131 bash[24745]: cluster 2024-09-14T02:54:51.444903+0000 mgr.a (mgr.14355) 11846 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:52 smithi171 bash[25040]: cluster 2024-09-14T02:54:51.444903+0000 mgr.a (mgr.14355) 11846 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:54:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:54:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:54:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:54:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.343598+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.348361+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.371630+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.376671+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.386042+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:53.391289+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: cluster 2024-09-14T02:54:53.445501+0000 mgr.a (mgr.14355) 11847 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:54.113963+0000 mon.a (mon.0) 2366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:54.115497+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:54.122807+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22722]: audit 2024-09-14T02:54:54.125604+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.343598+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.348361+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.371630+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.376671+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.386042+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:53.391289+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: cluster 2024-09-14T02:54:53.445501+0000 mgr.a (mgr.14355) 11847 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:54.113963+0000 mon.a (mon.0) 2366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:54.115497+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:54.122807+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:54 smithi131 bash[24745]: audit 2024-09-14T02:54:54.125604+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.343598+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.348361+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.371630+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.376671+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.386042+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:53.391289+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: cluster 2024-09-14T02:54:53.445501+0000 mgr.a (mgr.14355) 11847 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:54.113963+0000 mon.a (mon.0) 2366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:54:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:54.115497+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:54:54.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:54.122807+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:54:54.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:54 smithi171 bash[25040]: audit 2024-09-14T02:54:54.125604+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:55.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22972]: debug 2024-09-14T02:54:54.862+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:54:55.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:54:54 smithi007 bash[22972]: debug 2024-09-14T02:54:54.874+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:54:55.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:54:55.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:54:55.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:54:55.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:54:55.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:54:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:55 smithi007 bash[22722]: audit 2024-09-14T02:54:54.126934+0000 mgr.a (mgr.14355) 11848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:55 smithi007 bash[22722]: audit 2024-09-14T02:54:54.850704+0000 mgr.a (mgr.14355) 11849 : audit [DBG] from='client.259422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:55 smithi131 bash[24745]: audit 2024-09-14T02:54:54.126934+0000 mgr.a (mgr.14355) 11848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:55 smithi131 bash[24745]: audit 2024-09-14T02:54:54.850704+0000 mgr.a (mgr.14355) 11849 : audit [DBG] from='client.259422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:55 smithi171 bash[25040]: audit 2024-09-14T02:54:54.126934+0000 mgr.a (mgr.14355) 11848 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:54:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:55 smithi171 bash[25040]: audit 2024-09-14T02:54:54.850704+0000 mgr.a (mgr.14355) 11849 : audit [DBG] from='client.259422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:56 smithi007 bash[22722]: audit 2024-09-14T02:54:54.866349+0000 mgr.a (mgr.14355) 11850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:56 smithi007 bash[22722]: cephadm 2024-09-14T02:54:54.879711+0000 mgr.a (mgr.14355) 11851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:56 smithi007 bash[22722]: cluster 2024-09-14T02:54:55.447796+0000 mgr.a (mgr.14355) 11852 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:56 smithi131 bash[24745]: audit 2024-09-14T02:54:54.866349+0000 mgr.a (mgr.14355) 11850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:56 smithi131 bash[24745]: cephadm 2024-09-14T02:54:54.879711+0000 mgr.a (mgr.14355) 11851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:56 smithi131 bash[24745]: cluster 2024-09-14T02:54:55.447796+0000 mgr.a (mgr.14355) 11852 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:56 smithi171 bash[25040]: audit 2024-09-14T02:54:54.866349+0000 mgr.a (mgr.14355) 11850 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:54:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:56 smithi171 bash[25040]: cephadm 2024-09-14T02:54:54.879711+0000 mgr.a (mgr.14355) 11851 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:54:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:56 smithi171 bash[25040]: cluster 2024-09-14T02:54:55.447796+0000 mgr.a (mgr.14355) 11852 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:54:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:54:58 smithi131 bash[24745]: cluster 2024-09-14T02:54:57.448704+0000 mgr.a (mgr.14355) 11853 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:54:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:54:58 smithi171 bash[25040]: cluster 2024-09-14T02:54:57.448704+0000 mgr.a (mgr.14355) 11853 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:54:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:54:58 smithi007 bash[22722]: cluster 2024-09-14T02:54:57.448704+0000 mgr.a (mgr.14355) 11853 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:00.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:00.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:00.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:00 smithi131 bash[24745]: cluster 2024-09-14T02:54:59.449693+0000 mgr.a (mgr.14355) 11854 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:00 smithi171 bash[25040]: cluster 2024-09-14T02:54:59.449693+0000 mgr.a (mgr.14355) 11854 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:00 smithi007 bash[22722]: cluster 2024-09-14T02:54:59.449693+0000 mgr.a (mgr.14355) 11854 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:01.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:01.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:01.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:01.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:01.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:01 smithi131 bash[24745]: audit 2024-09-14T02:55:00.591363+0000 mgr.a (mgr.14355) 11855 : audit [DBG] from='client.259521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:01 smithi171 bash[25040]: audit 2024-09-14T02:55:00.591363+0000 mgr.a (mgr.14355) 11855 : audit [DBG] from='client.259521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:01 smithi007 bash[22722]: audit 2024-09-14T02:55:00.591363+0000 mgr.a (mgr.14355) 11855 : audit [DBG] from='client.259521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:02 smithi131 bash[24745]: cluster 2024-09-14T02:55:01.452730+0000 mgr.a (mgr.14355) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:02 smithi171 bash[25040]: cluster 2024-09-14T02:55:01.452730+0000 mgr.a (mgr.14355) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:02 smithi007 bash[22722]: cluster 2024-09-14T02:55:01.452730+0000 mgr.a (mgr.14355) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:04 smithi131 bash[24745]: cluster 2024-09-14T02:55:03.453705+0000 mgr.a (mgr.14355) 11857 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:04 smithi171 bash[25040]: cluster 2024-09-14T02:55:03.453705+0000 mgr.a (mgr.14355) 11857 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:04 smithi007 bash[22722]: cluster 2024-09-14T02:55:03.453705+0000 mgr.a (mgr.14355) 11857 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:55:06.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:06 smithi131 bash[24745]: cluster 2024-09-14T02:55:05.455707+0000 mgr.a (mgr.14355) 11858 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:06 smithi171 bash[25040]: cluster 2024-09-14T02:55:05.455707+0000 mgr.a (mgr.14355) 11858 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:06.797 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:06.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:06.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:06 smithi007 bash[22722]: cluster 2024-09-14T02:55:05.455707+0000 mgr.a (mgr.14355) 11858 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:55:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:07 smithi171 bash[25040]: audit 2024-09-14T02:55:06.350223+0000 mgr.a (mgr.14355) 11859 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:07 smithi007 bash[22722]: audit 2024-09-14T02:55:06.350223+0000 mgr.a (mgr.14355) 11859 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:07 smithi131 bash[24745]: audit 2024-09-14T02:55:06.350223+0000 mgr.a (mgr.14355) 11859 : audit [DBG] from='client.259599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:08 smithi171 bash[25040]: cluster 2024-09-14T02:55:07.456686+0000 mgr.a (mgr.14355) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:08 smithi007 bash[22722]: cluster 2024-09-14T02:55:07.456686+0000 mgr.a (mgr.14355) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:08 smithi131 bash[24745]: cluster 2024-09-14T02:55:07.456686+0000 mgr.a (mgr.14355) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:10 smithi171 bash[25040]: cluster 2024-09-14T02:55:09.457499+0000 mgr.a (mgr.14355) 11861 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:10 smithi007 bash[22722]: cluster 2024-09-14T02:55:09.457499+0000 mgr.a (mgr.14355) 11861 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:10 smithi131 bash[24745]: cluster 2024-09-14T02:55:09.457499+0000 mgr.a (mgr.14355) 11861 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T02:55:11.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:12.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:12 smithi007 bash[22722]: cluster 2024-09-14T02:55:11.459753+0000 mgr.a (mgr.14355) 11862 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:55:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:12 smithi131 bash[24745]: cluster 2024-09-14T02:55:11.459753+0000 mgr.a (mgr.14355) 11862 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:55:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:12 smithi171 bash[25040]: cluster 2024-09-14T02:55:11.459753+0000 mgr.a (mgr.14355) 11862 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T02:55:13.962 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:13 smithi007 bash[22722]: audit 2024-09-14T02:55:12.131319+0000 mgr.a (mgr.14355) 11863 : audit [DBG] from='client.259671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:13 smithi131 bash[24745]: audit 2024-09-14T02:55:12.131319+0000 mgr.a (mgr.14355) 11863 : audit [DBG] from='client.259671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:13 smithi171 bash[25040]: audit 2024-09-14T02:55:12.131319+0000 mgr.a (mgr.14355) 11863 : audit [DBG] from='client.259671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:14 smithi007 bash[22722]: cluster 2024-09-14T02:55:13.460848+0000 mgr.a (mgr.14355) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:14 smithi131 bash[24745]: cluster 2024-09-14T02:55:13.460848+0000 mgr.a (mgr.14355) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:14 smithi171 bash[25040]: cluster 2024-09-14T02:55:13.460848+0000 mgr.a (mgr.14355) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:16 smithi007 bash[22722]: cluster 2024-09-14T02:55:15.463182+0000 mgr.a (mgr.14355) 11865 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:16 smithi131 bash[24745]: cluster 2024-09-14T02:55:15.463182+0000 mgr.a (mgr.14355) 11865 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:16 smithi171 bash[25040]: cluster 2024-09-14T02:55:15.463182+0000 mgr.a (mgr.14355) 11865 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:18.339 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:18.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:18.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:18.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:18.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:18 smithi007 bash[22722]: cluster 2024-09-14T02:55:17.463991+0000 mgr.a (mgr.14355) 11866 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:18 smithi131 bash[24745]: cluster 2024-09-14T02:55:17.463991+0000 mgr.a (mgr.14355) 11866 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:18 smithi171 bash[25040]: cluster 2024-09-14T02:55:17.463991+0000 mgr.a (mgr.14355) 11866 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:19 smithi007 bash[22722]: audit 2024-09-14T02:55:17.894195+0000 mgr.a (mgr.14355) 11867 : audit [DBG] from='client.259743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:19 smithi131 bash[24745]: audit 2024-09-14T02:55:17.894195+0000 mgr.a (mgr.14355) 11867 : audit [DBG] from='client.259743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:19 smithi171 bash[25040]: audit 2024-09-14T02:55:17.894195+0000 mgr.a (mgr.14355) 11867 : audit [DBG] from='client.259743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:20 smithi007 bash[22722]: cluster 2024-09-14T02:55:19.464905+0000 mgr.a (mgr.14355) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:20 smithi131 bash[24745]: cluster 2024-09-14T02:55:19.464905+0000 mgr.a (mgr.14355) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:20 smithi171 bash[25040]: cluster 2024-09-14T02:55:19.464905+0000 mgr.a (mgr.14355) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:22 smithi007 bash[22722]: cluster 2024-09-14T02:55:21.467181+0000 mgr.a (mgr.14355) 11869 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:22 smithi131 bash[24745]: cluster 2024-09-14T02:55:21.467181+0000 mgr.a (mgr.14355) 11869 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:22 smithi171 bash[25040]: cluster 2024-09-14T02:55:21.467181+0000 mgr.a (mgr.14355) 11869 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:23.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:23.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:23.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:24.125 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:24 smithi007 bash[22722]: cluster 2024-09-14T02:55:23.467617+0000 mgr.a (mgr.14355) 11870 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:24 smithi007 bash[22722]: audit 2024-09-14T02:55:23.676441+0000 mgr.a (mgr.14355) 11871 : audit [DBG] from='client.259818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:24 smithi131 bash[24745]: cluster 2024-09-14T02:55:23.467617+0000 mgr.a (mgr.14355) 11870 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:24 smithi131 bash[24745]: audit 2024-09-14T02:55:23.676441+0000 mgr.a (mgr.14355) 11871 : audit [DBG] from='client.259818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:24 smithi171 bash[25040]: cluster 2024-09-14T02:55:23.467617+0000 mgr.a (mgr.14355) 11870 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:24 smithi171 bash[25040]: audit 2024-09-14T02:55:23.676441+0000 mgr.a (mgr.14355) 11871 : audit [DBG] from='client.259818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:26 smithi007 bash[22722]: cluster 2024-09-14T02:55:25.469828+0000 mgr.a (mgr.14355) 11872 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:26 smithi131 bash[24745]: cluster 2024-09-14T02:55:25.469828+0000 mgr.a (mgr.14355) 11872 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:26 smithi171 bash[25040]: cluster 2024-09-14T02:55:25.469828+0000 mgr.a (mgr.14355) 11872 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:28 smithi007 bash[22722]: cluster 2024-09-14T02:55:27.470756+0000 mgr.a (mgr.14355) 11873 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:28 smithi131 bash[24745]: cluster 2024-09-14T02:55:27.470756+0000 mgr.a (mgr.14355) 11873 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:28 smithi171 bash[25040]: cluster 2024-09-14T02:55:27.470756+0000 mgr.a (mgr.14355) 11873 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:29.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:29.884 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:29.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:30 smithi007 bash[22722]: audit 2024-09-14T02:55:29.455331+0000 mgr.a (mgr.14355) 11874 : audit [DBG] from='client.259896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:30 smithi007 bash[22722]: cluster 2024-09-14T02:55:29.471829+0000 mgr.a (mgr.14355) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:30 smithi131 bash[24745]: audit 2024-09-14T02:55:29.455331+0000 mgr.a (mgr.14355) 11874 : audit [DBG] from='client.259896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:30 smithi131 bash[24745]: cluster 2024-09-14T02:55:29.471829+0000 mgr.a (mgr.14355) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:30 smithi171 bash[25040]: audit 2024-09-14T02:55:29.455331+0000 mgr.a (mgr.14355) 11874 : audit [DBG] from='client.259896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:30 smithi171 bash[25040]: cluster 2024-09-14T02:55:29.471829+0000 mgr.a (mgr.14355) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:32 smithi007 bash[22722]: cluster 2024-09-14T02:55:31.474155+0000 mgr.a (mgr.14355) 11876 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:32 smithi131 bash[24745]: cluster 2024-09-14T02:55:31.474155+0000 mgr.a (mgr.14355) 11876 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:32 smithi171 bash[25040]: cluster 2024-09-14T02:55:31.474155+0000 mgr.a (mgr.14355) 11876 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:34.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:34 smithi007 bash[22722]: cluster 2024-09-14T02:55:33.474936+0000 mgr.a (mgr.14355) 11877 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:34 smithi131 bash[24745]: cluster 2024-09-14T02:55:33.474936+0000 mgr.a (mgr.14355) 11877 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:34 smithi171 bash[25040]: cluster 2024-09-14T02:55:33.474936+0000 mgr.a (mgr.14355) 11877 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:35.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:35.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:35.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:35.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:36 smithi007 bash[22722]: audit 2024-09-14T02:55:35.215957+0000 mgr.a (mgr.14355) 11878 : audit [DBG] from='client.259971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:36 smithi007 bash[22722]: cluster 2024-09-14T02:55:35.476657+0000 mgr.a (mgr.14355) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:36 smithi131 bash[24745]: audit 2024-09-14T02:55:35.215957+0000 mgr.a (mgr.14355) 11878 : audit [DBG] from='client.259971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:36 smithi131 bash[24745]: cluster 2024-09-14T02:55:35.476657+0000 mgr.a (mgr.14355) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:36 smithi171 bash[25040]: audit 2024-09-14T02:55:35.215957+0000 mgr.a (mgr.14355) 11878 : audit [DBG] from='client.259971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:36 smithi171 bash[25040]: cluster 2024-09-14T02:55:35.476657+0000 mgr.a (mgr.14355) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:38 smithi007 bash[22722]: cluster 2024-09-14T02:55:37.477501+0000 mgr.a (mgr.14355) 11880 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:55:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:38 smithi131 bash[24745]: cluster 2024-09-14T02:55:37.477501+0000 mgr.a (mgr.14355) 11880 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:55:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:38 smithi171 bash[25040]: cluster 2024-09-14T02:55:37.477501+0000 mgr.a (mgr.14355) 11880 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:55:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:40.650 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:40 smithi007 bash[22722]: cluster 2024-09-14T02:55:39.478324+0000 mgr.a (mgr.14355) 11881 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:40 smithi131 bash[24745]: cluster 2024-09-14T02:55:39.478324+0000 mgr.a (mgr.14355) 11881 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:40 smithi171 bash[25040]: cluster 2024-09-14T02:55:39.478324+0000 mgr.a (mgr.14355) 11881 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:41.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:41.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:42 smithi007 bash[22722]: audit 2024-09-14T02:55:40.989209+0000 mgr.a (mgr.14355) 11882 : audit [DBG] from='client.260046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:42 smithi007 bash[22722]: cluster 2024-09-14T02:55:41.479665+0000 mgr.a (mgr.14355) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:42 smithi131 bash[24745]: audit 2024-09-14T02:55:40.989209+0000 mgr.a (mgr.14355) 11882 : audit [DBG] from='client.260046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:42 smithi131 bash[24745]: cluster 2024-09-14T02:55:41.479665+0000 mgr.a (mgr.14355) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:42 smithi171 bash[25040]: audit 2024-09-14T02:55:40.989209+0000 mgr.a (mgr.14355) 11882 : audit [DBG] from='client.260046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:42 smithi171 bash[25040]: cluster 2024-09-14T02:55:41.479665+0000 mgr.a (mgr.14355) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:44.960 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:44 smithi007 bash[22722]: cluster 2024-09-14T02:55:43.480383+0000 mgr.a (mgr.14355) 11884 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:45.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:44 smithi131 bash[24745]: cluster 2024-09-14T02:55:43.480383+0000 mgr.a (mgr.14355) 11884 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:45.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:44 smithi171 bash[25040]: cluster 2024-09-14T02:55:43.480383+0000 mgr.a (mgr.14355) 11884 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:55:46.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:46.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:46 smithi007 bash[22722]: cluster 2024-09-14T02:55:45.482320+0000 mgr.a (mgr.14355) 11885 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:46 smithi131 bash[24745]: cluster 2024-09-14T02:55:45.482320+0000 mgr.a (mgr.14355) 11885 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:46 smithi171 bash[25040]: cluster 2024-09-14T02:55:45.482320+0000 mgr.a (mgr.14355) 11885 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:47.181 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:47.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:47 smithi007 bash[22722]: audit 2024-09-14T02:55:46.765303+0000 mgr.a (mgr.14355) 11886 : audit [DBG] from='client.260124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:47 smithi131 bash[24745]: audit 2024-09-14T02:55:46.765303+0000 mgr.a (mgr.14355) 11886 : audit [DBG] from='client.260124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:47 smithi171 bash[25040]: audit 2024-09-14T02:55:46.765303+0000 mgr.a (mgr.14355) 11886 : audit [DBG] from='client.260124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:48 smithi007 bash[22722]: cluster 2024-09-14T02:55:47.483219+0000 mgr.a (mgr.14355) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:48 smithi131 bash[24745]: cluster 2024-09-14T02:55:47.483219+0000 mgr.a (mgr.14355) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:48 smithi171 bash[25040]: cluster 2024-09-14T02:55:47.483219+0000 mgr.a (mgr.14355) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:50 smithi007 bash[22722]: cluster 2024-09-14T02:55:49.484013+0000 mgr.a (mgr.14355) 11888 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:50 smithi131 bash[24745]: cluster 2024-09-14T02:55:49.484013+0000 mgr.a (mgr.14355) 11888 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:50 smithi171 bash[25040]: cluster 2024-09-14T02:55:49.484013+0000 mgr.a (mgr.14355) 11888 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:52.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:52.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:52.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:52 smithi007 bash[22722]: cluster 2024-09-14T02:55:51.486239+0000 mgr.a (mgr.14355) 11889 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:52.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:52.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:52.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:52.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:52.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:52 smithi131 bash[24745]: cluster 2024-09-14T02:55:51.486239+0000 mgr.a (mgr.14355) 11889 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:52 smithi171 bash[25040]: cluster 2024-09-14T02:55:51.486239+0000 mgr.a (mgr.14355) 11889 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:53 smithi007 bash[22722]: audit 2024-09-14T02:55:52.525050+0000 mgr.a (mgr.14355) 11890 : audit [DBG] from='client.260199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:53 smithi131 bash[24745]: audit 2024-09-14T02:55:52.525050+0000 mgr.a (mgr.14355) 11890 : audit [DBG] from='client.260199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:53 smithi171 bash[25040]: audit 2024-09-14T02:55:52.525050+0000 mgr.a (mgr.14355) 11890 : audit [DBG] from='client.260199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:55:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:54 smithi007 bash[22722]: cluster 2024-09-14T02:55:53.487405+0000 mgr.a (mgr.14355) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:54 smithi131 bash[24745]: cluster 2024-09-14T02:55:53.487405+0000 mgr.a (mgr.14355) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:54 smithi171 bash[25040]: cluster 2024-09-14T02:55:53.487405+0000 mgr.a (mgr.14355) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:55 smithi007 bash[22722]: audit 2024-09-14T02:55:54.934946+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:55:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:55 smithi131 bash[24745]: audit 2024-09-14T02:55:54.934946+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:55:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:55 smithi171 bash[25040]: audit 2024-09-14T02:55:54.934946+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: cluster 2024-09-14T02:55:55.488440+0000 mgr.a (mgr.14355) 11892 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.312742+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.317992+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.324065+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.330272+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.334545+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.338907+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.340449+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:55:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.342151+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:55:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.351127+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:56 smithi007 bash[22722]: audit 2024-09-14T02:55:56.355775+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: cluster 2024-09-14T02:55:55.488440+0000 mgr.a (mgr.14355) 11892 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.312742+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.317992+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.324065+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.330272+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.334545+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.338907+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.340449+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.342151+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.351127+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:56 smithi131 bash[24745]: audit 2024-09-14T02:55:56.355775+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: cluster 2024-09-14T02:55:55.488440+0000 mgr.a (mgr.14355) 11892 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.312742+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.317992+0000 mon.a (mon.0) 2372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.324065+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.330272+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.334545+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.338907+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.340449+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.342151+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.351127+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:55:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:56 smithi171 bash[25040]: audit 2024-09-14T02:55:56.355775+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:57.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:55:57 smithi007 bash[22972]: debug 2024-09-14T02:55:57.101+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:55:57.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:55:57 smithi007 bash[22972]: debug 2024-09-14T02:55:57.101+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:55:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:57 smithi007 bash[22722]: audit 2024-09-14T02:55:56.356767+0000 mgr.a (mgr.14355) 11893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:57.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:55:57.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:55:57.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:55:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:57 smithi131 bash[24745]: audit 2024-09-14T02:55:56.356767+0000 mgr.a (mgr.14355) 11893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:57 smithi171 bash[25040]: audit 2024-09-14T02:55:56.356767+0000 mgr.a (mgr.14355) 11893 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:55:58.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:55:58.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:55:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:55:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:55:58.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:55:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:58 smithi007 bash[22722]: audit 2024-09-14T02:55:57.103401+0000 mgr.a (mgr.14355) 11894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:55:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:58 smithi007 bash[22722]: cephadm 2024-09-14T02:55:57.104849+0000 mgr.a (mgr.14355) 11895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:55:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:58 smithi007 bash[22722]: cluster 2024-09-14T02:55:57.489331+0000 mgr.a (mgr.14355) 11896 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:58 smithi131 bash[24745]: audit 2024-09-14T02:55:57.103401+0000 mgr.a (mgr.14355) 11894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:55:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:58 smithi131 bash[24745]: cephadm 2024-09-14T02:55:57.104849+0000 mgr.a (mgr.14355) 11895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:55:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:58 smithi131 bash[24745]: cluster 2024-09-14T02:55:57.489331+0000 mgr.a (mgr.14355) 11896 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:58 smithi171 bash[25040]: audit 2024-09-14T02:55:57.103401+0000 mgr.a (mgr.14355) 11894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:55:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:58 smithi171 bash[25040]: cephadm 2024-09-14T02:55:57.104849+0000 mgr.a (mgr.14355) 11895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:55:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:58 smithi171 bash[25040]: cluster 2024-09-14T02:55:57.489331+0000 mgr.a (mgr.14355) 11896 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:55:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:55:59 smithi007 bash[22722]: audit 2024-09-14T02:55:58.290484+0000 mgr.a (mgr.14355) 11897 : audit [DBG] from='client.260382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:55:59 smithi131 bash[24745]: audit 2024-09-14T02:55:58.290484+0000 mgr.a (mgr.14355) 11897 : audit [DBG] from='client.260382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:55:59 smithi171 bash[25040]: audit 2024-09-14T02:55:58.290484+0000 mgr.a (mgr.14355) 11897 : audit [DBG] from='client.260382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:00 smithi131 bash[24745]: cluster 2024-09-14T02:55:59.490272+0000 mgr.a (mgr.14355) 11898 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:00 smithi171 bash[25040]: cluster 2024-09-14T02:55:59.490272+0000 mgr.a (mgr.14355) 11898 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:00 smithi007 bash[22722]: cluster 2024-09-14T02:55:59.490272+0000 mgr.a (mgr.14355) 11898 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:02 smithi131 bash[24745]: cluster 2024-09-14T02:56:01.492556+0000 mgr.a (mgr.14355) 11899 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:02 smithi171 bash[25040]: cluster 2024-09-14T02:56:01.492556+0000 mgr.a (mgr.14355) 11899 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:02 smithi007 bash[22722]: cluster 2024-09-14T02:56:01.492556+0000 mgr.a (mgr.14355) 11899 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:03.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:03.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:04.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:04.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:04.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:04.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:04.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:04 smithi131 bash[24745]: cluster 2024-09-14T02:56:03.493319+0000 mgr.a (mgr.14355) 11900 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:04 smithi171 bash[25040]: cluster 2024-09-14T02:56:03.493319+0000 mgr.a (mgr.14355) 11900 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:04 smithi007 bash[22722]: cluster 2024-09-14T02:56:03.493319+0000 mgr.a (mgr.14355) 11900 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:05 smithi131 bash[24745]: audit 2024-09-14T02:56:04.051299+0000 mgr.a (mgr.14355) 11901 : audit [DBG] from='client.260460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:05 smithi171 bash[25040]: audit 2024-09-14T02:56:04.051299+0000 mgr.a (mgr.14355) 11901 : audit [DBG] from='client.260460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:05 smithi007 bash[22722]: audit 2024-09-14T02:56:04.051299+0000 mgr.a (mgr.14355) 11901 : audit [DBG] from='client.260460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:06 smithi131 bash[24745]: cluster 2024-09-14T02:56:05.495565+0000 mgr.a (mgr.14355) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:06 smithi171 bash[25040]: cluster 2024-09-14T02:56:05.495565+0000 mgr.a (mgr.14355) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:06 smithi007 bash[22722]: cluster 2024-09-14T02:56:05.495565+0000 mgr.a (mgr.14355) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:08 smithi131 bash[24745]: cluster 2024-09-14T02:56:07.496342+0000 mgr.a (mgr.14355) 11903 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:08 smithi171 bash[25040]: cluster 2024-09-14T02:56:07.496342+0000 mgr.a (mgr.14355) 11903 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:08 smithi007 bash[22722]: cluster 2024-09-14T02:56:07.496342+0000 mgr.a (mgr.14355) 11903 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:10.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:10.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:10 smithi131 bash[24745]: cluster 2024-09-14T02:56:09.497103+0000 mgr.a (mgr.14355) 11904 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:10 smithi131 bash[24745]: audit 2024-09-14T02:56:09.820809+0000 mgr.a (mgr.14355) 11905 : audit [DBG] from='client.260538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:10 smithi171 bash[25040]: cluster 2024-09-14T02:56:09.497103+0000 mgr.a (mgr.14355) 11904 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:10 smithi171 bash[25040]: audit 2024-09-14T02:56:09.820809+0000 mgr.a (mgr.14355) 11905 : audit [DBG] from='client.260538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:10 smithi007 bash[22722]: cluster 2024-09-14T02:56:09.497103+0000 mgr.a (mgr.14355) 11904 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:10 smithi007 bash[22722]: audit 2024-09-14T02:56:09.820809+0000 mgr.a (mgr.14355) 11905 : audit [DBG] from='client.260538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:12 smithi131 bash[24745]: cluster 2024-09-14T02:56:11.499491+0000 mgr.a (mgr.14355) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:12 smithi171 bash[25040]: cluster 2024-09-14T02:56:11.499491+0000 mgr.a (mgr.14355) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:12 smithi007 bash[22722]: cluster 2024-09-14T02:56:11.499491+0000 mgr.a (mgr.14355) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:56:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:14 smithi131 bash[24745]: cluster 2024-09-14T02:56:13.500263+0000 mgr.a (mgr.14355) 11907 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:14 smithi171 bash[25040]: cluster 2024-09-14T02:56:13.500263+0000 mgr.a (mgr.14355) 11907 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:14 smithi007 bash[22722]: cluster 2024-09-14T02:56:13.500263+0000 mgr.a (mgr.14355) 11907 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:15.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:15.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:16 smithi131 bash[24745]: cluster 2024-09-14T02:56:15.501426+0000 mgr.a (mgr.14355) 11908 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:16 smithi131 bash[24745]: audit 2024-09-14T02:56:15.569710+0000 mgr.a (mgr.14355) 11909 : audit [DBG] from='client.260613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:16 smithi171 bash[25040]: cluster 2024-09-14T02:56:15.501426+0000 mgr.a (mgr.14355) 11908 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:16 smithi171 bash[25040]: audit 2024-09-14T02:56:15.569710+0000 mgr.a (mgr.14355) 11909 : audit [DBG] from='client.260613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:16 smithi007 bash[22722]: cluster 2024-09-14T02:56:15.501426+0000 mgr.a (mgr.14355) 11908 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:16 smithi007 bash[22722]: audit 2024-09-14T02:56:15.569710+0000 mgr.a (mgr.14355) 11909 : audit [DBG] from='client.260613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:18 smithi131 bash[24745]: cluster 2024-09-14T02:56:17.502280+0000 mgr.a (mgr.14355) 11910 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:18 smithi171 bash[25040]: cluster 2024-09-14T02:56:17.502280+0000 mgr.a (mgr.14355) 11910 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:18 smithi007 bash[22722]: cluster 2024-09-14T02:56:17.502280+0000 mgr.a (mgr.14355) 11910 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:20.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:20.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:20.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:20 smithi131 bash[24745]: cluster 2024-09-14T02:56:19.503066+0000 mgr.a (mgr.14355) 11911 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:20 smithi171 bash[25040]: cluster 2024-09-14T02:56:19.503066+0000 mgr.a (mgr.14355) 11911 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:20 smithi007 bash[22722]: cluster 2024-09-14T02:56:19.503066+0000 mgr.a (mgr.14355) 11911 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:21.723 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:21.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:22 smithi131 bash[24745]: audit 2024-09-14T02:56:21.314467+0000 mgr.a (mgr.14355) 11912 : audit [DBG] from='client.260688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:22 smithi131 bash[24745]: cluster 2024-09-14T02:56:21.504422+0000 mgr.a (mgr.14355) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:22 smithi171 bash[25040]: audit 2024-09-14T02:56:21.314467+0000 mgr.a (mgr.14355) 11912 : audit [DBG] from='client.260688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:22 smithi171 bash[25040]: cluster 2024-09-14T02:56:21.504422+0000 mgr.a (mgr.14355) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:22 smithi007 bash[22722]: audit 2024-09-14T02:56:21.314467+0000 mgr.a (mgr.14355) 11912 : audit [DBG] from='client.260688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:22 smithi007 bash[22722]: cluster 2024-09-14T02:56:21.504422+0000 mgr.a (mgr.14355) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:24 smithi131 bash[24745]: cluster 2024-09-14T02:56:23.505278+0000 mgr.a (mgr.14355) 11914 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:24 smithi171 bash[25040]: cluster 2024-09-14T02:56:23.505278+0000 mgr.a (mgr.14355) 11914 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:24 smithi007 bash[22722]: cluster 2024-09-14T02:56:23.505278+0000 mgr.a (mgr.14355) 11914 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:56:26.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:26.726 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:26.726 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:26 smithi131 bash[24745]: cluster 2024-09-14T02:56:25.507527+0000 mgr.a (mgr.14355) 11915 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:26 smithi171 bash[25040]: cluster 2024-09-14T02:56:25.507527+0000 mgr.a (mgr.14355) 11915 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:26 smithi007 bash[22722]: cluster 2024-09-14T02:56:25.507527+0000 mgr.a (mgr.14355) 11915 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:27.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:27.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:27.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:27.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:27.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:28 smithi131 bash[24745]: audit 2024-09-14T02:56:27.061936+0000 mgr.a (mgr.14355) 11916 : audit [DBG] from='client.260763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:28 smithi131 bash[24745]: cluster 2024-09-14T02:56:27.508475+0000 mgr.a (mgr.14355) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:28 smithi171 bash[25040]: audit 2024-09-14T02:56:27.061936+0000 mgr.a (mgr.14355) 11916 : audit [DBG] from='client.260763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:28 smithi171 bash[25040]: cluster 2024-09-14T02:56:27.508475+0000 mgr.a (mgr.14355) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:28 smithi007 bash[22722]: audit 2024-09-14T02:56:27.061936+0000 mgr.a (mgr.14355) 11916 : audit [DBG] from='client.260763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:28 smithi007 bash[22722]: cluster 2024-09-14T02:56:27.508475+0000 mgr.a (mgr.14355) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:30 smithi131 bash[24745]: cluster 2024-09-14T02:56:29.509297+0000 mgr.a (mgr.14355) 11918 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:30 smithi171 bash[25040]: cluster 2024-09-14T02:56:29.509297+0000 mgr.a (mgr.14355) 11918 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:30 smithi007 bash[22722]: cluster 2024-09-14T02:56:29.509297+0000 mgr.a (mgr.14355) 11918 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:32.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:32.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:32 smithi131 bash[24745]: cluster 2024-09-14T02:56:31.511518+0000 mgr.a (mgr.14355) 11919 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:32 smithi171 bash[25040]: cluster 2024-09-14T02:56:31.511518+0000 mgr.a (mgr.14355) 11919 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:32 smithi007 bash[22722]: cluster 2024-09-14T02:56:31.511518+0000 mgr.a (mgr.14355) 11919 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:33.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:33.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:33 smithi171 bash[25040]: audit 2024-09-14T02:56:32.821632+0000 mgr.a (mgr.14355) 11920 : audit [DBG] from='client.260841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:33 smithi007 bash[22722]: audit 2024-09-14T02:56:32.821632+0000 mgr.a (mgr.14355) 11920 : audit [DBG] from='client.260841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:33 smithi131 bash[24745]: audit 2024-09-14T02:56:32.821632+0000 mgr.a (mgr.14355) 11920 : audit [DBG] from='client.260841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:34 smithi171 bash[25040]: cluster 2024-09-14T02:56:33.512478+0000 mgr.a (mgr.14355) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:34 smithi007 bash[22722]: cluster 2024-09-14T02:56:33.512478+0000 mgr.a (mgr.14355) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:34 smithi131 bash[24745]: cluster 2024-09-14T02:56:33.512478+0000 mgr.a (mgr.14355) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:36 smithi171 bash[25040]: cluster 2024-09-14T02:56:35.514674+0000 mgr.a (mgr.14355) 11922 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:36 smithi007 bash[22722]: cluster 2024-09-14T02:56:35.514674+0000 mgr.a (mgr.14355) 11922 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:36 smithi131 bash[24745]: cluster 2024-09-14T02:56:35.514674+0000 mgr.a (mgr.14355) 11922 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:38.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:38.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:39.035 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:39.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:39.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:39.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:39.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:38 smithi007 bash[22722]: cluster 2024-09-14T02:56:37.515545+0000 mgr.a (mgr.14355) 11923 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:38 smithi131 bash[24745]: cluster 2024-09-14T02:56:37.515545+0000 mgr.a (mgr.14355) 11923 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:38 smithi171 bash[25040]: cluster 2024-09-14T02:56:37.515545+0000 mgr.a (mgr.14355) 11923 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:39 smithi007 bash[22722]: audit 2024-09-14T02:56:38.592878+0000 mgr.a (mgr.14355) 11924 : audit [DBG] from='client.260919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:39 smithi131 bash[24745]: audit 2024-09-14T02:56:38.592878+0000 mgr.a (mgr.14355) 11924 : audit [DBG] from='client.260919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:39 smithi171 bash[25040]: audit 2024-09-14T02:56:38.592878+0000 mgr.a (mgr.14355) 11924 : audit [DBG] from='client.260919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:40 smithi007 bash[22722]: cluster 2024-09-14T02:56:39.516506+0000 mgr.a (mgr.14355) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:40 smithi131 bash[24745]: cluster 2024-09-14T02:56:39.516506+0000 mgr.a (mgr.14355) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:40 smithi171 bash[25040]: cluster 2024-09-14T02:56:39.516506+0000 mgr.a (mgr.14355) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:42 smithi007 bash[22722]: cluster 2024-09-14T02:56:41.518912+0000 mgr.a (mgr.14355) 11926 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:42 smithi131 bash[24745]: cluster 2024-09-14T02:56:41.518912+0000 mgr.a (mgr.14355) 11926 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:42 smithi171 bash[25040]: cluster 2024-09-14T02:56:41.518912+0000 mgr.a (mgr.14355) 11926 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:44.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:44.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:44.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:44.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:44.810 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:44.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:44 smithi007 bash[22722]: cluster 2024-09-14T02:56:43.519675+0000 mgr.a (mgr.14355) 11927 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:44 smithi131 bash[24745]: cluster 2024-09-14T02:56:43.519675+0000 mgr.a (mgr.14355) 11927 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:44 smithi171 bash[25040]: cluster 2024-09-14T02:56:43.519675+0000 mgr.a (mgr.14355) 11927 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:45 smithi007 bash[22722]: audit 2024-09-14T02:56:44.374791+0000 mgr.a (mgr.14355) 11928 : audit [DBG] from='client.260994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:45 smithi131 bash[24745]: audit 2024-09-14T02:56:44.374791+0000 mgr.a (mgr.14355) 11928 : audit [DBG] from='client.260994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:45 smithi171 bash[25040]: audit 2024-09-14T02:56:44.374791+0000 mgr.a (mgr.14355) 11928 : audit [DBG] from='client.260994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:46 smithi007 bash[22722]: cluster 2024-09-14T02:56:45.521919+0000 mgr.a (mgr.14355) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:46 smithi131 bash[24745]: cluster 2024-09-14T02:56:45.521919+0000 mgr.a (mgr.14355) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:46 smithi171 bash[25040]: cluster 2024-09-14T02:56:45.521919+0000 mgr.a (mgr.14355) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:56:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:48 smithi007 bash[22722]: cluster 2024-09-14T02:56:47.522726+0000 mgr.a (mgr.14355) 11930 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:48 smithi131 bash[24745]: cluster 2024-09-14T02:56:47.522726+0000 mgr.a (mgr.14355) 11930 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:48 smithi171 bash[25040]: cluster 2024-09-14T02:56:47.522726+0000 mgr.a (mgr.14355) 11930 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:49.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:49.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:49.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:50.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:50 smithi007 bash[22722]: cluster 2024-09-14T02:56:49.523491+0000 mgr.a (mgr.14355) 11931 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:50 smithi131 bash[24745]: cluster 2024-09-14T02:56:49.523491+0000 mgr.a (mgr.14355) 11931 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:50 smithi171 bash[25040]: cluster 2024-09-14T02:56:49.523491+0000 mgr.a (mgr.14355) 11931 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:51 smithi007 bash[22722]: audit 2024-09-14T02:56:50.143026+0000 mgr.a (mgr.14355) 11932 : audit [DBG] from='client.261072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:51 smithi131 bash[24745]: audit 2024-09-14T02:56:50.143026+0000 mgr.a (mgr.14355) 11932 : audit [DBG] from='client.261072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:51 smithi171 bash[25040]: audit 2024-09-14T02:56:50.143026+0000 mgr.a (mgr.14355) 11932 : audit [DBG] from='client.261072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:52 smithi007 bash[22722]: cluster 2024-09-14T02:56:51.526225+0000 mgr.a (mgr.14355) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:56:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:52 smithi131 bash[24745]: cluster 2024-09-14T02:56:51.526225+0000 mgr.a (mgr.14355) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:56:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:52 smithi171 bash[25040]: cluster 2024-09-14T02:56:51.526225+0000 mgr.a (mgr.14355) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T02:56:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:54 smithi007 bash[22722]: cluster 2024-09-14T02:56:53.527053+0000 mgr.a (mgr.14355) 11934 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:56:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:54 smithi131 bash[24745]: cluster 2024-09-14T02:56:53.527053+0000 mgr.a (mgr.14355) 11934 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:56:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:54 smithi171 bash[25040]: cluster 2024-09-14T02:56:53.527053+0000 mgr.a (mgr.14355) 11934 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T02:56:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:56:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:56:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:56:56.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:56:56.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:56:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:56:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:56:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:56:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:56 smithi007 bash[22722]: cluster 2024-09-14T02:56:55.529021+0000 mgr.a (mgr.14355) 11935 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:56 smithi131 bash[24745]: cluster 2024-09-14T02:56:55.529021+0000 mgr.a (mgr.14355) 11935 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:56 smithi171 bash[25040]: cluster 2024-09-14T02:56:55.529021+0000 mgr.a (mgr.14355) 11935 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:56:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:57 smithi007 bash[22722]: audit 2024-09-14T02:56:55.898902+0000 mgr.a (mgr.14355) 11936 : audit [DBG] from='client.261150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:57 smithi007 bash[22722]: audit 2024-09-14T02:56:57.164484+0000 mon.a (mon.0) 2381 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:56:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:57 smithi131 bash[24745]: audit 2024-09-14T02:56:55.898902+0000 mgr.a (mgr.14355) 11936 : audit [DBG] from='client.261150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:57 smithi131 bash[24745]: audit 2024-09-14T02:56:57.164484+0000 mon.a (mon.0) 2381 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:56:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:57 smithi171 bash[25040]: audit 2024-09-14T02:56:55.898902+0000 mgr.a (mgr.14355) 11936 : audit [DBG] from='client.261150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:56:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:57 smithi171 bash[25040]: audit 2024-09-14T02:56:57.164484+0000 mon.a (mon.0) 2381 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:56:59.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22972]: debug 2024-09-14T02:56:58.756+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:56:59.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22972]: debug 2024-09-14T02:56:58.756+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:56:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22722]: cluster 2024-09-14T02:56:57.529879+0000 mgr.a (mgr.14355) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:56:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22722]: audit 2024-09-14T02:56:57.989357+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:56:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22722]: audit 2024-09-14T02:56:57.991152+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:56:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22722]: audit 2024-09-14T02:56:58.001253+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:56:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:58 smithi007 bash[22722]: audit 2024-09-14T02:56:58.006153+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:56:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:58 smithi131 bash[24745]: cluster 2024-09-14T02:56:57.529879+0000 mgr.a (mgr.14355) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:56:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:58 smithi131 bash[24745]: audit 2024-09-14T02:56:57.989357+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:56:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:58 smithi131 bash[24745]: audit 2024-09-14T02:56:57.991152+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:56:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:58 smithi131 bash[24745]: audit 2024-09-14T02:56:58.001253+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:56:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:58 smithi131 bash[24745]: audit 2024-09-14T02:56:58.006153+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:56:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:58 smithi171 bash[25040]: cluster 2024-09-14T02:56:57.529879+0000 mgr.a (mgr.14355) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:56:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:58 smithi171 bash[25040]: audit 2024-09-14T02:56:57.989357+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:56:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:58 smithi171 bash[25040]: audit 2024-09-14T02:56:57.991152+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:56:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:58 smithi171 bash[25040]: audit 2024-09-14T02:56:58.001253+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:56:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:58 smithi171 bash[25040]: audit 2024-09-14T02:56:58.006153+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:57:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:59 smithi007 bash[22722]: audit 2024-09-14T02:56:58.008518+0000 mgr.a (mgr.14355) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:57:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:59 smithi007 bash[22722]: audit 2024-09-14T02:56:58.759598+0000 mgr.a (mgr.14355) 11939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:57:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:56:59 smithi007 bash[22722]: cephadm 2024-09-14T02:56:58.761029+0000 mgr.a (mgr.14355) 11940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:57:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:59 smithi131 bash[24745]: audit 2024-09-14T02:56:58.008518+0000 mgr.a (mgr.14355) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:57:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:59 smithi131 bash[24745]: audit 2024-09-14T02:56:58.759598+0000 mgr.a (mgr.14355) 11939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:57:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:56:59 smithi131 bash[24745]: cephadm 2024-09-14T02:56:58.761029+0000 mgr.a (mgr.14355) 11940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:57:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:59 smithi171 bash[25040]: audit 2024-09-14T02:56:58.008518+0000 mgr.a (mgr.14355) 11938 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:57:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:59 smithi171 bash[25040]: audit 2024-09-14T02:56:58.759598+0000 mgr.a (mgr.14355) 11939 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:57:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:56:59 smithi171 bash[25040]: cephadm 2024-09-14T02:56:58.761029+0000 mgr.a (mgr.14355) 11940 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:57:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:00 smithi007 bash[22722]: cluster 2024-09-14T02:56:59.530790+0000 mgr.a (mgr.14355) 11941 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:00 smithi131 bash[24745]: cluster 2024-09-14T02:56:59.530790+0000 mgr.a (mgr.14355) 11941 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:00 smithi171 bash[25040]: cluster 2024-09-14T02:56:59.530790+0000 mgr.a (mgr.14355) 11941 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:01.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:01.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:01.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:02.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:02.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:02.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:02.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:02.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:02 smithi007 bash[22722]: cluster 2024-09-14T02:57:01.532958+0000 mgr.a (mgr.14355) 11942 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:02 smithi007 bash[22722]: audit 2024-09-14T02:57:01.670151+0000 mgr.a (mgr.14355) 11943 : audit [DBG] from='client.261333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:02 smithi131 bash[24745]: cluster 2024-09-14T02:57:01.532958+0000 mgr.a (mgr.14355) 11942 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:02 smithi131 bash[24745]: audit 2024-09-14T02:57:01.670151+0000 mgr.a (mgr.14355) 11943 : audit [DBG] from='client.261333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:02 smithi171 bash[25040]: cluster 2024-09-14T02:57:01.532958+0000 mgr.a (mgr.14355) 11942 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:02 smithi171 bash[25040]: audit 2024-09-14T02:57:01.670151+0000 mgr.a (mgr.14355) 11943 : audit [DBG] from='client.261333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:04 smithi007 bash[22722]: cluster 2024-09-14T02:57:03.533814+0000 mgr.a (mgr.14355) 11944 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:57:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:04 smithi131 bash[24745]: cluster 2024-09-14T02:57:03.533814+0000 mgr.a (mgr.14355) 11944 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:57:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:04 smithi171 bash[25040]: cluster 2024-09-14T02:57:03.533814+0000 mgr.a (mgr.14355) 11944 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:57:07.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:06 smithi007 bash[22722]: cluster 2024-09-14T02:57:05.536003+0000 mgr.a (mgr.14355) 11945 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:06 smithi131 bash[24745]: cluster 2024-09-14T02:57:05.536003+0000 mgr.a (mgr.14355) 11945 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:06 smithi171 bash[25040]: cluster 2024-09-14T02:57:05.536003+0000 mgr.a (mgr.14355) 11945 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:07.874 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:07.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:07.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:07.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:07.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:08 smithi007 bash[22722]: audit 2024-09-14T02:57:07.444905+0000 mgr.a (mgr.14355) 11946 : audit [DBG] from='client.261411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:08 smithi007 bash[22722]: cluster 2024-09-14T02:57:07.536475+0000 mgr.a (mgr.14355) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:08 smithi131 bash[24745]: audit 2024-09-14T02:57:07.444905+0000 mgr.a (mgr.14355) 11946 : audit [DBG] from='client.261411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:08 smithi131 bash[24745]: cluster 2024-09-14T02:57:07.536475+0000 mgr.a (mgr.14355) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:08 smithi171 bash[25040]: audit 2024-09-14T02:57:07.444905+0000 mgr.a (mgr.14355) 11946 : audit [DBG] from='client.261411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:08 smithi171 bash[25040]: cluster 2024-09-14T02:57:07.536475+0000 mgr.a (mgr.14355) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:10 smithi007 bash[22722]: cluster 2024-09-14T02:57:09.537327+0000 mgr.a (mgr.14355) 11948 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:10 smithi131 bash[24745]: cluster 2024-09-14T02:57:09.537327+0000 mgr.a (mgr.14355) 11948 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:10 smithi171 bash[25040]: cluster 2024-09-14T02:57:09.537327+0000 mgr.a (mgr.14355) 11948 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:12.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:12.876 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:12.876 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:12 smithi007 bash[22722]: cluster 2024-09-14T02:57:11.539628+0000 mgr.a (mgr.14355) 11949 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:12 smithi131 bash[24745]: cluster 2024-09-14T02:57:11.539628+0000 mgr.a (mgr.14355) 11949 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:12 smithi171 bash[25040]: cluster 2024-09-14T02:57:11.539628+0000 mgr.a (mgr.14355) 11949 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:57:13.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:13.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:13.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:13.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:13.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:13 smithi007 bash[22722]: audit 2024-09-14T02:57:13.215532+0000 mgr.a (mgr.14355) 11950 : audit [DBG] from='client.261489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:13 smithi007 bash[22722]: cluster 2024-09-14T02:57:13.540241+0000 mgr.a (mgr.14355) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:13 smithi131 bash[24745]: audit 2024-09-14T02:57:13.215532+0000 mgr.a (mgr.14355) 11950 : audit [DBG] from='client.261489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:13 smithi131 bash[24745]: cluster 2024-09-14T02:57:13.540241+0000 mgr.a (mgr.14355) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:13 smithi171 bash[25040]: audit 2024-09-14T02:57:13.215532+0000 mgr.a (mgr.14355) 11950 : audit [DBG] from='client.261489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:13 smithi171 bash[25040]: cluster 2024-09-14T02:57:13.540241+0000 mgr.a (mgr.14355) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:16 smithi007 bash[22722]: cluster 2024-09-14T02:57:15.542557+0000 mgr.a (mgr.14355) 11952 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:16 smithi131 bash[24745]: cluster 2024-09-14T02:57:15.542557+0000 mgr.a (mgr.14355) 11952 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:16 smithi171 bash[25040]: cluster 2024-09-14T02:57:15.542557+0000 mgr.a (mgr.14355) 11952 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:18.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:18.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:18.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:18 smithi007 bash[22722]: cluster 2024-09-14T02:57:17.543301+0000 mgr.a (mgr.14355) 11953 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:18 smithi131 bash[24745]: cluster 2024-09-14T02:57:17.543301+0000 mgr.a (mgr.14355) 11953 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:18 smithi171 bash[25040]: cluster 2024-09-14T02:57:17.543301+0000 mgr.a (mgr.14355) 11953 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:19.394 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:20 smithi007 bash[22722]: audit 2024-09-14T02:57:18.982932+0000 mgr.a (mgr.14355) 11954 : audit [DBG] from='client.261567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:20 smithi007 bash[22722]: cluster 2024-09-14T02:57:19.544151+0000 mgr.a (mgr.14355) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:20 smithi131 bash[24745]: audit 2024-09-14T02:57:18.982932+0000 mgr.a (mgr.14355) 11954 : audit [DBG] from='client.261567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:20 smithi131 bash[24745]: cluster 2024-09-14T02:57:19.544151+0000 mgr.a (mgr.14355) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:20 smithi171 bash[25040]: audit 2024-09-14T02:57:18.982932+0000 mgr.a (mgr.14355) 11954 : audit [DBG] from='client.261567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:20 smithi171 bash[25040]: cluster 2024-09-14T02:57:19.544151+0000 mgr.a (mgr.14355) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:22 smithi007 bash[22722]: cluster 2024-09-14T02:57:21.546396+0000 mgr.a (mgr.14355) 11956 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:22 smithi131 bash[24745]: cluster 2024-09-14T02:57:21.546396+0000 mgr.a (mgr.14355) 11956 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:22 smithi171 bash[25040]: cluster 2024-09-14T02:57:21.546396+0000 mgr.a (mgr.14355) 11956 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:24.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:24.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:24 smithi007 bash[22722]: cluster 2024-09-14T02:57:23.547144+0000 mgr.a (mgr.14355) 11957 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:24 smithi131 bash[24745]: cluster 2024-09-14T02:57:23.547144+0000 mgr.a (mgr.14355) 11957 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:24 smithi171 bash[25040]: cluster 2024-09-14T02:57:23.547144+0000 mgr.a (mgr.14355) 11957 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:25.159 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:25 smithi007 bash[22722]: audit 2024-09-14T02:57:24.731528+0000 mgr.a (mgr.14355) 11958 : audit [DBG] from='client.261639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:25 smithi131 bash[24745]: audit 2024-09-14T02:57:24.731528+0000 mgr.a (mgr.14355) 11958 : audit [DBG] from='client.261639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:25 smithi171 bash[25040]: audit 2024-09-14T02:57:24.731528+0000 mgr.a (mgr.14355) 11958 : audit [DBG] from='client.261639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:26 smithi007 bash[22722]: cluster 2024-09-14T02:57:25.549439+0000 mgr.a (mgr.14355) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:26 smithi131 bash[24745]: cluster 2024-09-14T02:57:25.549439+0000 mgr.a (mgr.14355) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:26 smithi171 bash[25040]: cluster 2024-09-14T02:57:25.549439+0000 mgr.a (mgr.14355) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:28 smithi007 bash[22722]: cluster 2024-09-14T02:57:27.550196+0000 mgr.a (mgr.14355) 11960 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:28 smithi131 bash[24745]: cluster 2024-09-14T02:57:27.550196+0000 mgr.a (mgr.14355) 11960 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:28 smithi171 bash[25040]: cluster 2024-09-14T02:57:27.550196+0000 mgr.a (mgr.14355) 11960 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:30.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:30.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:30.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:30.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:30.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:30.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:30.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:30 smithi007 bash[22722]: cluster 2024-09-14T02:57:29.550933+0000 mgr.a (mgr.14355) 11961 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:30 smithi131 bash[24745]: cluster 2024-09-14T02:57:29.550933+0000 mgr.a (mgr.14355) 11961 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:30 smithi171 bash[25040]: cluster 2024-09-14T02:57:29.550933+0000 mgr.a (mgr.14355) 11961 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:31 smithi007 bash[22722]: audit 2024-09-14T02:57:30.494618+0000 mgr.a (mgr.14355) 11962 : audit [DBG] from='client.261717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:31 smithi131 bash[24745]: audit 2024-09-14T02:57:30.494618+0000 mgr.a (mgr.14355) 11962 : audit [DBG] from='client.261717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:31 smithi171 bash[25040]: audit 2024-09-14T02:57:30.494618+0000 mgr.a (mgr.14355) 11962 : audit [DBG] from='client.261717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:32 smithi007 bash[22722]: cluster 2024-09-14T02:57:31.553604+0000 mgr.a (mgr.14355) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:32 smithi131 bash[24745]: cluster 2024-09-14T02:57:31.553604+0000 mgr.a (mgr.14355) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:32 smithi171 bash[25040]: cluster 2024-09-14T02:57:31.553604+0000 mgr.a (mgr.14355) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:34 smithi007 bash[22722]: cluster 2024-09-14T02:57:33.554391+0000 mgr.a (mgr.14355) 11964 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:34 smithi131 bash[24745]: cluster 2024-09-14T02:57:33.554391+0000 mgr.a (mgr.14355) 11964 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:34 smithi171 bash[25040]: cluster 2024-09-14T02:57:33.554391+0000 mgr.a (mgr.14355) 11964 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:35.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:35.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:35.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:36.703 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:36.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:36 smithi007 bash[22722]: cluster 2024-09-14T02:57:35.556334+0000 mgr.a (mgr.14355) 11965 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:36 smithi131 bash[24745]: cluster 2024-09-14T02:57:35.556334+0000 mgr.a (mgr.14355) 11965 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:36 smithi171 bash[25040]: cluster 2024-09-14T02:57:35.556334+0000 mgr.a (mgr.14355) 11965 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:37 smithi007 bash[22722]: audit 2024-09-14T02:57:36.264443+0000 mgr.a (mgr.14355) 11966 : audit [DBG] from='client.261789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:37 smithi131 bash[24745]: audit 2024-09-14T02:57:36.264443+0000 mgr.a (mgr.14355) 11966 : audit [DBG] from='client.261789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:37 smithi171 bash[25040]: audit 2024-09-14T02:57:36.264443+0000 mgr.a (mgr.14355) 11966 : audit [DBG] from='client.261789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:38 smithi007 bash[22722]: cluster 2024-09-14T02:57:37.557288+0000 mgr.a (mgr.14355) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:38 smithi131 bash[24745]: cluster 2024-09-14T02:57:37.557288+0000 mgr.a (mgr.14355) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:38 smithi171 bash[25040]: cluster 2024-09-14T02:57:37.557288+0000 mgr.a (mgr.14355) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:57:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:40 smithi007 bash[22722]: cluster 2024-09-14T02:57:39.558101+0000 mgr.a (mgr.14355) 11968 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:40 smithi131 bash[24745]: cluster 2024-09-14T02:57:39.558101+0000 mgr.a (mgr.14355) 11968 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:40 smithi171 bash[25040]: cluster 2024-09-14T02:57:39.558101+0000 mgr.a (mgr.14355) 11968 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:57:41.704 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:41.705 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:41.705 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:42.474 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:42 smithi007 bash[22722]: cluster 2024-09-14T02:57:41.560358+0000 mgr.a (mgr.14355) 11969 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:42 smithi131 bash[24745]: cluster 2024-09-14T02:57:41.560358+0000 mgr.a (mgr.14355) 11969 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:42 smithi171 bash[25040]: cluster 2024-09-14T02:57:41.560358+0000 mgr.a (mgr.14355) 11969 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:43 smithi007 bash[22722]: audit 2024-09-14T02:57:42.036334+0000 mgr.a (mgr.14355) 11970 : audit [DBG] from='client.261867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:43 smithi131 bash[24745]: audit 2024-09-14T02:57:42.036334+0000 mgr.a (mgr.14355) 11970 : audit [DBG] from='client.261867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:43 smithi171 bash[25040]: audit 2024-09-14T02:57:42.036334+0000 mgr.a (mgr.14355) 11970 : audit [DBG] from='client.261867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:44 smithi007 bash[22722]: cluster 2024-09-14T02:57:43.561281+0000 mgr.a (mgr.14355) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:44 smithi131 bash[24745]: cluster 2024-09-14T02:57:43.561281+0000 mgr.a (mgr.14355) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:44 smithi171 bash[25040]: cluster 2024-09-14T02:57:43.561281+0000 mgr.a (mgr.14355) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:46 smithi007 bash[22722]: cluster 2024-09-14T02:57:45.563515+0000 mgr.a (mgr.14355) 11972 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:46 smithi131 bash[24745]: cluster 2024-09-14T02:57:45.563515+0000 mgr.a (mgr.14355) 11972 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:46 smithi171 bash[25040]: cluster 2024-09-14T02:57:45.563515+0000 mgr.a (mgr.14355) 11972 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:47.477 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:48.234 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:48.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:48 smithi007 bash[22722]: cluster 2024-09-14T02:57:47.564250+0000 mgr.a (mgr.14355) 11973 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:48 smithi007 bash[22722]: audit 2024-09-14T02:57:47.810479+0000 mgr.a (mgr.14355) 11974 : audit [DBG] from='client.261945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:48 smithi131 bash[24745]: cluster 2024-09-14T02:57:47.564250+0000 mgr.a (mgr.14355) 11973 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:48 smithi131 bash[24745]: audit 2024-09-14T02:57:47.810479+0000 mgr.a (mgr.14355) 11974 : audit [DBG] from='client.261945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:48 smithi171 bash[25040]: cluster 2024-09-14T02:57:47.564250+0000 mgr.a (mgr.14355) 11973 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:48 smithi171 bash[25040]: audit 2024-09-14T02:57:47.810479+0000 mgr.a (mgr.14355) 11974 : audit [DBG] from='client.261945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:50 smithi007 bash[22722]: cluster 2024-09-14T02:57:49.565212+0000 mgr.a (mgr.14355) 11975 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:50 smithi131 bash[24745]: cluster 2024-09-14T02:57:49.565212+0000 mgr.a (mgr.14355) 11975 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:50 smithi171 bash[25040]: cluster 2024-09-14T02:57:49.565212+0000 mgr.a (mgr.14355) 11975 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:52 smithi007 bash[22722]: cluster 2024-09-14T02:57:51.567531+0000 mgr.a (mgr.14355) 11976 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:52 smithi131 bash[24745]: cluster 2024-09-14T02:57:51.567531+0000 mgr.a (mgr.14355) 11976 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:52 smithi171 bash[25040]: cluster 2024-09-14T02:57:51.567531+0000 mgr.a (mgr.14355) 11976 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:53.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:53.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:53.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:53.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:53.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:57:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:54 smithi131 bash[24745]: audit 2024-09-14T02:57:53.569602+0000 mgr.a (mgr.14355) 11977 : audit [DBG] from='client.262020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:54 smithi131 bash[24745]: cluster 2024-09-14T02:57:53.570224+0000 mgr.a (mgr.14355) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:55.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:54 smithi171 bash[25040]: audit 2024-09-14T02:57:53.569602+0000 mgr.a (mgr.14355) 11977 : audit [DBG] from='client.262020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:55.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:54 smithi171 bash[25040]: cluster 2024-09-14T02:57:53.570224+0000 mgr.a (mgr.14355) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:54 smithi007 bash[22722]: audit 2024-09-14T02:57:53.569602+0000 mgr.a (mgr.14355) 11977 : audit [DBG] from='client.262020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:57:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:54 smithi007 bash[22722]: cluster 2024-09-14T02:57:53.570224+0000 mgr.a (mgr.14355) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:56 smithi131 bash[24745]: cluster 2024-09-14T02:57:55.572596+0000 mgr.a (mgr.14355) 11979 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:56 smithi171 bash[25040]: cluster 2024-09-14T02:57:55.572596+0000 mgr.a (mgr.14355) 11979 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:56 smithi007 bash[22722]: cluster 2024-09-14T02:57:55.572596+0000 mgr.a (mgr.14355) 11979 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:57:58.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:57:58.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:57:58.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:57:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:58 smithi131 bash[24745]: cluster 2024-09-14T02:57:57.573386+0000 mgr.a (mgr.14355) 11980 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:58 smithi171 bash[25040]: cluster 2024-09-14T02:57:57.573386+0000 mgr.a (mgr.14355) 11980 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:58 smithi007 bash[22722]: cluster 2024-09-14T02:57:57.573386+0000 mgr.a (mgr.14355) 11980 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:57:59.755 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:57:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:57:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:57:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:57:59.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:59 smithi131 bash[24745]: audit 2024-09-14T02:57:58.814232+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:58:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:59 smithi131 bash[24745]: audit 2024-09-14T02:57:59.665423+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:58:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:59 smithi131 bash[24745]: audit 2024-09-14T02:57:59.666282+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:58:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:59 smithi131 bash[24745]: audit 2024-09-14T02:57:59.671396+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:58:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:57:59 smithi131 bash[24745]: audit 2024-09-14T02:57:59.674049+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:59 smithi171 bash[25040]: audit 2024-09-14T02:57:58.814232+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:58:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:59 smithi171 bash[25040]: audit 2024-09-14T02:57:59.665423+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:58:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:59 smithi171 bash[25040]: audit 2024-09-14T02:57:59.666282+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:58:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:59 smithi171 bash[25040]: audit 2024-09-14T02:57:59.671396+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:58:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:57:59 smithi171 bash[25040]: audit 2024-09-14T02:57:59.674049+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:59 smithi007 bash[22722]: audit 2024-09-14T02:57:58.814232+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:58:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:59 smithi007 bash[22722]: audit 2024-09-14T02:57:59.665423+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:58:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:59 smithi007 bash[22722]: audit 2024-09-14T02:57:59.666282+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:58:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:59 smithi007 bash[22722]: audit 2024-09-14T02:57:59.671396+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:58:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:57:59 smithi007 bash[22722]: audit 2024-09-14T02:57:59.674049+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:00.723 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:58:00 smithi007 bash[22972]: debug 2024-09-14T02:58:00.451+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:58:00.723 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:58:00 smithi007 bash[22972]: debug 2024-09-14T02:58:00.455+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:58:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:00 smithi131 bash[24745]: audit 2024-09-14T02:57:59.322561+0000 mgr.a (mgr.14355) 11981 : audit [DBG] from='client.262095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:00 smithi131 bash[24745]: cluster 2024-09-14T02:57:59.574017+0000 mgr.a (mgr.14355) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:00 smithi131 bash[24745]: audit 2024-09-14T02:57:59.675225+0000 mgr.a (mgr.14355) 11983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:00 smithi171 bash[25040]: audit 2024-09-14T02:57:59.322561+0000 mgr.a (mgr.14355) 11981 : audit [DBG] from='client.262095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:00 smithi171 bash[25040]: cluster 2024-09-14T02:57:59.574017+0000 mgr.a (mgr.14355) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:00 smithi171 bash[25040]: audit 2024-09-14T02:57:59.675225+0000 mgr.a (mgr.14355) 11983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:00 smithi007 bash[22722]: audit 2024-09-14T02:57:59.322561+0000 mgr.a (mgr.14355) 11981 : audit [DBG] from='client.262095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:00 smithi007 bash[22722]: cluster 2024-09-14T02:57:59.574017+0000 mgr.a (mgr.14355) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:00 smithi007 bash[22722]: audit 2024-09-14T02:57:59.675225+0000 mgr.a (mgr.14355) 11983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:58:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:01 smithi131 bash[24745]: audit 2024-09-14T02:58:00.457300+0000 mgr.a (mgr.14355) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:58:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:01 smithi131 bash[24745]: cephadm 2024-09-14T02:58:00.459257+0000 mgr.a (mgr.14355) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:58:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:01 smithi171 bash[25040]: audit 2024-09-14T02:58:00.457300+0000 mgr.a (mgr.14355) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:58:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:01 smithi171 bash[25040]: cephadm 2024-09-14T02:58:00.459257+0000 mgr.a (mgr.14355) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:58:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:01 smithi007 bash[22722]: audit 2024-09-14T02:58:00.457300+0000 mgr.a (mgr.14355) 11984 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:58:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:01 smithi007 bash[22722]: cephadm 2024-09-14T02:58:00.459257+0000 mgr.a (mgr.14355) 11985 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:58:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:02 smithi131 bash[24745]: cluster 2024-09-14T02:58:01.576446+0000 mgr.a (mgr.14355) 11986 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:58:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:02 smithi171 bash[25040]: cluster 2024-09-14T02:58:01.576446+0000 mgr.a (mgr.14355) 11986 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:58:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:02 smithi007 bash[22722]: cluster 2024-09-14T02:58:01.576446+0000 mgr.a (mgr.14355) 11986 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T02:58:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:04.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:04 smithi131 bash[24745]: cluster 2024-09-14T02:58:03.577229+0000 mgr.a (mgr.14355) 11987 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:58:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:04 smithi171 bash[25040]: cluster 2024-09-14T02:58:03.577229+0000 mgr.a (mgr.14355) 11987 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:58:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:04 smithi007 bash[22722]: cluster 2024-09-14T02:58:03.577229+0000 mgr.a (mgr.14355) 11987 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T02:58:05.506 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:05.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:06 smithi131 bash[24745]: audit 2024-09-14T02:58:05.085336+0000 mgr.a (mgr.14355) 11988 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:06 smithi131 bash[24745]: cluster 2024-09-14T02:58:05.579029+0000 mgr.a (mgr.14355) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:06 smithi171 bash[25040]: audit 2024-09-14T02:58:05.085336+0000 mgr.a (mgr.14355) 11988 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:06 smithi171 bash[25040]: cluster 2024-09-14T02:58:05.579029+0000 mgr.a (mgr.14355) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:06 smithi007 bash[22722]: audit 2024-09-14T02:58:05.085336+0000 mgr.a (mgr.14355) 11988 : audit [DBG] from='client.262272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:06 smithi007 bash[22722]: cluster 2024-09-14T02:58:05.579029+0000 mgr.a (mgr.14355) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:08 smithi131 bash[24745]: cluster 2024-09-14T02:58:07.579739+0000 mgr.a (mgr.14355) 11990 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:08 smithi171 bash[25040]: cluster 2024-09-14T02:58:07.579739+0000 mgr.a (mgr.14355) 11990 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:08 smithi007 bash[22722]: cluster 2024-09-14T02:58:07.579739+0000 mgr.a (mgr.14355) 11990 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:10.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:10.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:10.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:10 smithi131 bash[24745]: cluster 2024-09-14T02:58:09.580530+0000 mgr.a (mgr.14355) 11991 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:10 smithi171 bash[25040]: cluster 2024-09-14T02:58:09.580530+0000 mgr.a (mgr.14355) 11991 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:10 smithi007 bash[22722]: cluster 2024-09-14T02:58:09.580530+0000 mgr.a (mgr.14355) 11991 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T02:58:11.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:11.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:11 smithi131 bash[24745]: audit 2024-09-14T02:58:10.843777+0000 mgr.a (mgr.14355) 11992 : audit [DBG] from='client.262344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:11 smithi171 bash[25040]: audit 2024-09-14T02:58:10.843777+0000 mgr.a (mgr.14355) 11992 : audit [DBG] from='client.262344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:11 smithi007 bash[22722]: audit 2024-09-14T02:58:10.843777+0000 mgr.a (mgr.14355) 11992 : audit [DBG] from='client.262344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:12 smithi131 bash[24745]: cluster 2024-09-14T02:58:11.583319+0000 mgr.a (mgr.14355) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:12 smithi171 bash[25040]: cluster 2024-09-14T02:58:11.583319+0000 mgr.a (mgr.14355) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:12 smithi007 bash[22722]: cluster 2024-09-14T02:58:11.583319+0000 mgr.a (mgr.14355) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:58:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:14 smithi131 bash[24745]: cluster 2024-09-14T02:58:13.584102+0000 mgr.a (mgr.14355) 11994 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:58:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:14 smithi171 bash[25040]: cluster 2024-09-14T02:58:13.584102+0000 mgr.a (mgr.14355) 11994 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:58:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:14 smithi007 bash[22722]: cluster 2024-09-14T02:58:13.584102+0000 mgr.a (mgr.14355) 11994 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T02:58:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:16 smithi131 bash[24745]: cluster 2024-09-14T02:58:15.586051+0000 mgr.a (mgr.14355) 11995 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:58:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:16 smithi171 bash[25040]: cluster 2024-09-14T02:58:15.586051+0000 mgr.a (mgr.14355) 11995 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:58:17.049 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:17.049 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:17.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:16 smithi007 bash[22722]: cluster 2024-09-14T02:58:15.586051+0000 mgr.a (mgr.14355) 11995 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T02:58:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:17 smithi131 bash[24745]: audit 2024-09-14T02:58:16.622589+0000 mgr.a (mgr.14355) 11996 : audit [DBG] from='client.262422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:17 smithi171 bash[25040]: audit 2024-09-14T02:58:16.622589+0000 mgr.a (mgr.14355) 11996 : audit [DBG] from='client.262422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:17 smithi007 bash[22722]: audit 2024-09-14T02:58:16.622589+0000 mgr.a (mgr.14355) 11996 : audit [DBG] from='client.262422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:18 smithi171 bash[25040]: cluster 2024-09-14T02:58:17.587081+0000 mgr.a (mgr.14355) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:18 smithi007 bash[22722]: cluster 2024-09-14T02:58:17.587081+0000 mgr.a (mgr.14355) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:18 smithi131 bash[24745]: cluster 2024-09-14T02:58:17.587081+0000 mgr.a (mgr.14355) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:20 smithi171 bash[25040]: cluster 2024-09-14T02:58:19.587891+0000 mgr.a (mgr.14355) 11998 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:20 smithi007 bash[22722]: cluster 2024-09-14T02:58:19.587891+0000 mgr.a (mgr.14355) 11998 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:20 smithi131 bash[24745]: cluster 2024-09-14T02:58:19.587891+0000 mgr.a (mgr.14355) 11998 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T02:58:22.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:22.800 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:22.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:22.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:22.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:22.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:22 smithi171 bash[25040]: cluster 2024-09-14T02:58:21.590129+0000 mgr.a (mgr.14355) 11999 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:22 smithi007 bash[22722]: cluster 2024-09-14T02:58:21.590129+0000 mgr.a (mgr.14355) 11999 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:22 smithi131 bash[24745]: cluster 2024-09-14T02:58:21.590129+0000 mgr.a (mgr.14355) 11999 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:23 smithi007 bash[22722]: audit 2024-09-14T02:58:22.383278+0000 mgr.a (mgr.14355) 12000 : audit [DBG] from='client.262500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:23 smithi131 bash[24745]: audit 2024-09-14T02:58:22.383278+0000 mgr.a (mgr.14355) 12000 : audit [DBG] from='client.262500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:23 smithi171 bash[25040]: audit 2024-09-14T02:58:22.383278+0000 mgr.a (mgr.14355) 12000 : audit [DBG] from='client.262500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:24 smithi007 bash[22722]: cluster 2024-09-14T02:58:23.591065+0000 mgr.a (mgr.14355) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:24 smithi131 bash[24745]: cluster 2024-09-14T02:58:23.591065+0000 mgr.a (mgr.14355) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:24 smithi171 bash[25040]: cluster 2024-09-14T02:58:23.591065+0000 mgr.a (mgr.14355) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:26 smithi007 bash[22722]: cluster 2024-09-14T02:58:25.593241+0000 mgr.a (mgr.14355) 12002 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:26 smithi131 bash[24745]: cluster 2024-09-14T02:58:25.593241+0000 mgr.a (mgr.14355) 12002 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:26 smithi171 bash[25040]: cluster 2024-09-14T02:58:25.593241+0000 mgr.a (mgr.14355) 12002 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:27.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:27.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:27.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:28.563 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:28.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:28 smithi007 bash[22722]: cluster 2024-09-14T02:58:27.594016+0000 mgr.a (mgr.14355) 12003 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:28 smithi131 bash[24745]: cluster 2024-09-14T02:58:27.594016+0000 mgr.a (mgr.14355) 12003 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:28 smithi171 bash[25040]: cluster 2024-09-14T02:58:27.594016+0000 mgr.a (mgr.14355) 12003 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:29 smithi007 bash[22722]: audit 2024-09-14T02:58:28.137266+0000 mgr.a (mgr.14355) 12004 : audit [DBG] from='client.262575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:29 smithi131 bash[24745]: audit 2024-09-14T02:58:28.137266+0000 mgr.a (mgr.14355) 12004 : audit [DBG] from='client.262575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:29 smithi171 bash[25040]: audit 2024-09-14T02:58:28.137266+0000 mgr.a (mgr.14355) 12004 : audit [DBG] from='client.262575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:30 smithi007 bash[22722]: cluster 2024-09-14T02:58:29.595027+0000 mgr.a (mgr.14355) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:30 smithi131 bash[24745]: cluster 2024-09-14T02:58:29.595027+0000 mgr.a (mgr.14355) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:30 smithi171 bash[25040]: cluster 2024-09-14T02:58:29.595027+0000 mgr.a (mgr.14355) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:32 smithi007 bash[22722]: cluster 2024-09-14T02:58:31.597419+0000 mgr.a (mgr.14355) 12006 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:32 smithi131 bash[24745]: cluster 2024-09-14T02:58:31.597419+0000 mgr.a (mgr.14355) 12006 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:32 smithi171 bash[25040]: cluster 2024-09-14T02:58:31.597419+0000 mgr.a (mgr.14355) 12006 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:33.564 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:33.565 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:33.566 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:34.308 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:34.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:34 smithi007 bash[22722]: cluster 2024-09-14T02:58:33.598124+0000 mgr.a (mgr.14355) 12007 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:34 smithi007 bash[22722]: audit 2024-09-14T02:58:33.892806+0000 mgr.a (mgr.14355) 12008 : audit [DBG] from='client.262650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:34 smithi131 bash[24745]: cluster 2024-09-14T02:58:33.598124+0000 mgr.a (mgr.14355) 12007 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:34 smithi131 bash[24745]: audit 2024-09-14T02:58:33.892806+0000 mgr.a (mgr.14355) 12008 : audit [DBG] from='client.262650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:34 smithi171 bash[25040]: cluster 2024-09-14T02:58:33.598124+0000 mgr.a (mgr.14355) 12007 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T02:58:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:34 smithi171 bash[25040]: audit 2024-09-14T02:58:33.892806+0000 mgr.a (mgr.14355) 12008 : audit [DBG] from='client.262650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:36 smithi007 bash[22722]: cluster 2024-09-14T02:58:35.600476+0000 mgr.a (mgr.14355) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:36 smithi131 bash[24745]: cluster 2024-09-14T02:58:35.600476+0000 mgr.a (mgr.14355) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:36 smithi171 bash[25040]: cluster 2024-09-14T02:58:35.600476+0000 mgr.a (mgr.14355) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T02:58:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:38 smithi007 bash[22722]: cluster 2024-09-14T02:58:37.601302+0000 mgr.a (mgr.14355) 12010 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:38 smithi131 bash[24745]: cluster 2024-09-14T02:58:37.601302+0000 mgr.a (mgr.14355) 12010 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:38 smithi171 bash[25040]: cluster 2024-09-14T02:58:37.601302+0000 mgr.a (mgr.14355) 12010 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:39.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:39.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:39.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:40.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:40 smithi007 bash[22722]: cluster 2024-09-14T02:58:39.601825+0000 mgr.a (mgr.14355) 12011 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:40 smithi007 bash[22722]: audit 2024-09-14T02:58:39.640432+0000 mgr.a (mgr.14355) 12012 : audit [DBG] from='client.262725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:40 smithi131 bash[24745]: cluster 2024-09-14T02:58:39.601825+0000 mgr.a (mgr.14355) 12011 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:40 smithi131 bash[24745]: audit 2024-09-14T02:58:39.640432+0000 mgr.a (mgr.14355) 12012 : audit [DBG] from='client.262725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:40 smithi171 bash[25040]: cluster 2024-09-14T02:58:39.601825+0000 mgr.a (mgr.14355) 12011 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:40 smithi171 bash[25040]: audit 2024-09-14T02:58:39.640432+0000 mgr.a (mgr.14355) 12012 : audit [DBG] from='client.262725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:42 smithi007 bash[22722]: cluster 2024-09-14T02:58:41.604146+0000 mgr.a (mgr.14355) 12013 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:42 smithi131 bash[24745]: cluster 2024-09-14T02:58:41.604146+0000 mgr.a (mgr.14355) 12013 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:42 smithi171 bash[25040]: cluster 2024-09-14T02:58:41.604146+0000 mgr.a (mgr.14355) 12013 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:58:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:45.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:45.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:44 smithi007 bash[22722]: cluster 2024-09-14T02:58:43.604895+0000 mgr.a (mgr.14355) 12014 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:44 smithi131 bash[24745]: cluster 2024-09-14T02:58:43.604895+0000 mgr.a (mgr.14355) 12014 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:44 smithi171 bash[25040]: cluster 2024-09-14T02:58:43.604895+0000 mgr.a (mgr.14355) 12014 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:45.832 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:45.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:45.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:45.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:45.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:46 smithi007 bash[22722]: audit 2024-09-14T02:58:45.397189+0000 mgr.a (mgr.14355) 12015 : audit [DBG] from='client.262803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:46 smithi007 bash[22722]: cluster 2024-09-14T02:58:45.606417+0000 mgr.a (mgr.14355) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:46 smithi131 bash[24745]: audit 2024-09-14T02:58:45.397189+0000 mgr.a (mgr.14355) 12015 : audit [DBG] from='client.262803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:46 smithi131 bash[24745]: cluster 2024-09-14T02:58:45.606417+0000 mgr.a (mgr.14355) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:46 smithi171 bash[25040]: audit 2024-09-14T02:58:45.397189+0000 mgr.a (mgr.14355) 12015 : audit [DBG] from='client.262803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:46 smithi171 bash[25040]: cluster 2024-09-14T02:58:45.606417+0000 mgr.a (mgr.14355) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:48 smithi007 bash[22722]: cluster 2024-09-14T02:58:47.607300+0000 mgr.a (mgr.14355) 12017 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:48 smithi131 bash[24745]: cluster 2024-09-14T02:58:47.607300+0000 mgr.a (mgr.14355) 12017 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:48 smithi171 bash[25040]: cluster 2024-09-14T02:58:47.607300+0000 mgr.a (mgr.14355) 12017 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:50.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:50.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:50.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:50 smithi007 bash[22722]: cluster 2024-09-14T02:58:49.608247+0000 mgr.a (mgr.14355) 12018 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:50 smithi131 bash[24745]: cluster 2024-09-14T02:58:49.608247+0000 mgr.a (mgr.14355) 12018 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:50 smithi171 bash[25040]: cluster 2024-09-14T02:58:49.608247+0000 mgr.a (mgr.14355) 12018 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:51.591 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:51.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:51.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:51.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:51.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:52 smithi007 bash[22722]: audit 2024-09-14T02:58:51.163245+0000 mgr.a (mgr.14355) 12019 : audit [DBG] from='client.262881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:52 smithi007 bash[22722]: cluster 2024-09-14T02:58:51.609628+0000 mgr.a (mgr.14355) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:52 smithi131 bash[24745]: audit 2024-09-14T02:58:51.163245+0000 mgr.a (mgr.14355) 12019 : audit [DBG] from='client.262881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:52 smithi131 bash[24745]: cluster 2024-09-14T02:58:51.609628+0000 mgr.a (mgr.14355) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:52 smithi171 bash[25040]: audit 2024-09-14T02:58:51.163245+0000 mgr.a (mgr.14355) 12019 : audit [DBG] from='client.262881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:52 smithi171 bash[25040]: cluster 2024-09-14T02:58:51.609628+0000 mgr.a (mgr.14355) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:54 smithi007 bash[22722]: cluster 2024-09-14T02:58:53.610395+0000 mgr.a (mgr.14355) 12021 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:54 smithi131 bash[24745]: cluster 2024-09-14T02:58:53.610395+0000 mgr.a (mgr.14355) 12021 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:54 smithi171 bash[25040]: cluster 2024-09-14T02:58:53.610395+0000 mgr.a (mgr.14355) 12021 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:58:56.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:58:56.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:58:56.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:58:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:56 smithi007 bash[22722]: cluster 2024-09-14T02:58:55.612329+0000 mgr.a (mgr.14355) 12022 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:56 smithi131 bash[24745]: cluster 2024-09-14T02:58:55.612329+0000 mgr.a (mgr.14355) 12022 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:56 smithi171 bash[25040]: cluster 2024-09-14T02:58:55.612329+0000 mgr.a (mgr.14355) 12022 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:57.375 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:58:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:58:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:58:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:58:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:58:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:58 smithi007 bash[22722]: audit 2024-09-14T02:58:56.927493+0000 mgr.a (mgr.14355) 12023 : audit [DBG] from='client.262959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:58:58 smithi007 bash[22722]: cluster 2024-09-14T02:58:57.613337+0000 mgr.a (mgr.14355) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:58 smithi131 bash[24745]: audit 2024-09-14T02:58:56.927493+0000 mgr.a (mgr.14355) 12023 : audit [DBG] from='client.262959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:58:58 smithi131 bash[24745]: cluster 2024-09-14T02:58:57.613337+0000 mgr.a (mgr.14355) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:58:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:58 smithi171 bash[25040]: audit 2024-09-14T02:58:56.927493+0000 mgr.a (mgr.14355) 12023 : audit [DBG] from='client.262959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:58:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:58:58 smithi171 bash[25040]: cluster 2024-09-14T02:58:57.613337+0000 mgr.a (mgr.14355) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:00 smithi007 bash[22722]: cluster 2024-09-14T02:58:59.614148+0000 mgr.a (mgr.14355) 12025 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:00 smithi007 bash[22722]: audit 2024-09-14T02:59:00.514723+0000 mon.a (mon.0) 2391 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:59:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:00 smithi131 bash[24745]: cluster 2024-09-14T02:58:59.614148+0000 mgr.a (mgr.14355) 12025 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:00 smithi131 bash[24745]: audit 2024-09-14T02:59:00.514723+0000 mon.a (mon.0) 2391 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:59:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:00 smithi171 bash[25040]: cluster 2024-09-14T02:58:59.614148+0000 mgr.a (mgr.14355) 12025 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:00 smithi171 bash[25040]: audit 2024-09-14T02:59:00.514723+0000 mon.a (mon.0) 2391 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T02:59:02.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:02.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:02.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.141658+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.145802+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: cluster 2024-09-14T02:59:01.616329+0000 mgr.a (mgr.14355) 12026 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.954436+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.955758+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:59:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.964964+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22722]: audit 2024-09-14T02:59:01.968688+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.141658+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.145802+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: cluster 2024-09-14T02:59:01.616329+0000 mgr.a (mgr.14355) 12026 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.954436+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:59:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.955758+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:59:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.964964+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:02 smithi131 bash[24745]: audit 2024-09-14T02:59:01.968688+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.141658+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.145802+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: cluster 2024-09-14T02:59:01.616329+0000 mgr.a (mgr.14355) 12026 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.954436+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.955758+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.964964+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T02:59:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:02 smithi171 bash[25040]: audit 2024-09-14T02:59:01.968688+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:03.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:03.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:03.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:03.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:03.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:03.149 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22972]: debug 2024-09-14T02:59:02.714+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:59:03.149 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 02:59:02 smithi007 bash[22972]: debug 2024-09-14T02:59:02.726+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:59:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:03 smithi007 bash[22722]: audit 2024-09-14T02:59:01.970884+0000 mgr.a (mgr.14355) 12027 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:03 smithi007 bash[22722]: audit 2024-09-14T02:59:02.700544+0000 mgr.a (mgr.14355) 12028 : audit [DBG] from='client.263112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:03 smithi007 bash[22722]: audit 2024-09-14T02:59:02.720824+0000 mgr.a (mgr.14355) 12029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:59:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:03 smithi007 bash[22722]: cephadm 2024-09-14T02:59:02.732016+0000 mgr.a (mgr.14355) 12030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:59:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:03 smithi131 bash[24745]: audit 2024-09-14T02:59:01.970884+0000 mgr.a (mgr.14355) 12027 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:03 smithi131 bash[24745]: audit 2024-09-14T02:59:02.700544+0000 mgr.a (mgr.14355) 12028 : audit [DBG] from='client.263112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:03 smithi131 bash[24745]: audit 2024-09-14T02:59:02.720824+0000 mgr.a (mgr.14355) 12029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:59:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:03 smithi131 bash[24745]: cephadm 2024-09-14T02:59:02.732016+0000 mgr.a (mgr.14355) 12030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:59:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:03 smithi171 bash[25040]: audit 2024-09-14T02:59:01.970884+0000 mgr.a (mgr.14355) 12027 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T02:59:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:03 smithi171 bash[25040]: audit 2024-09-14T02:59:02.700544+0000 mgr.a (mgr.14355) 12028 : audit [DBG] from='client.263112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:03 smithi171 bash[25040]: audit 2024-09-14T02:59:02.720824+0000 mgr.a (mgr.14355) 12029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T02:59:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:03 smithi171 bash[25040]: cephadm 2024-09-14T02:59:02.732016+0000 mgr.a (mgr.14355) 12030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T02:59:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:04 smithi007 bash[22722]: cluster 2024-09-14T02:59:03.617244+0000 mgr.a (mgr.14355) 12031 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:04 smithi131 bash[24745]: cluster 2024-09-14T02:59:03.617244+0000 mgr.a (mgr.14355) 12031 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:04 smithi171 bash[25040]: cluster 2024-09-14T02:59:03.617244+0000 mgr.a (mgr.14355) 12031 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:06 smithi007 bash[22722]: cluster 2024-09-14T02:59:05.619433+0000 mgr.a (mgr.14355) 12032 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:06 smithi131 bash[24745]: cluster 2024-09-14T02:59:05.619433+0000 mgr.a (mgr.14355) 12032 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:06 smithi171 bash[25040]: cluster 2024-09-14T02:59:05.619433+0000 mgr.a (mgr.14355) 12032 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:08.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:08.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:08.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:08.876 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:08 smithi007 bash[22722]: cluster 2024-09-14T02:59:07.620213+0000 mgr.a (mgr.14355) 12033 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:08 smithi131 bash[24745]: cluster 2024-09-14T02:59:07.620213+0000 mgr.a (mgr.14355) 12033 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:08 smithi171 bash[25040]: cluster 2024-09-14T02:59:07.620213+0000 mgr.a (mgr.14355) 12033 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:09 smithi007 bash[22722]: audit 2024-09-14T02:59:08.463018+0000 mgr.a (mgr.14355) 12034 : audit [DBG] from='client.263223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:09 smithi131 bash[24745]: audit 2024-09-14T02:59:08.463018+0000 mgr.a (mgr.14355) 12034 : audit [DBG] from='client.263223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:09 smithi171 bash[25040]: audit 2024-09-14T02:59:08.463018+0000 mgr.a (mgr.14355) 12034 : audit [DBG] from='client.263223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:10 smithi007 bash[22722]: cluster 2024-09-14T02:59:09.621176+0000 mgr.a (mgr.14355) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:10 smithi131 bash[24745]: cluster 2024-09-14T02:59:09.621176+0000 mgr.a (mgr.14355) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:10 smithi171 bash[25040]: cluster 2024-09-14T02:59:09.621176+0000 mgr.a (mgr.14355) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:12 smithi007 bash[22722]: cluster 2024-09-14T02:59:11.623457+0000 mgr.a (mgr.14355) 12036 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:12 smithi131 bash[24745]: cluster 2024-09-14T02:59:11.623457+0000 mgr.a (mgr.14355) 12036 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:12 smithi171 bash[25040]: cluster 2024-09-14T02:59:11.623457+0000 mgr.a (mgr.14355) 12036 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:14.642 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:14.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:14 smithi007 bash[22722]: cluster 2024-09-14T02:59:13.624232+0000 mgr.a (mgr.14355) 12037 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:14 smithi131 bash[24745]: cluster 2024-09-14T02:59:13.624232+0000 mgr.a (mgr.14355) 12037 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:14 smithi171 bash[25040]: cluster 2024-09-14T02:59:13.624232+0000 mgr.a (mgr.14355) 12037 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:15 smithi131 bash[24745]: audit 2024-09-14T02:59:14.212278+0000 mgr.a (mgr.14355) 12038 : audit [DBG] from='client.263298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:15 smithi171 bash[25040]: audit 2024-09-14T02:59:14.212278+0000 mgr.a (mgr.14355) 12038 : audit [DBG] from='client.263298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:15 smithi007 bash[22722]: audit 2024-09-14T02:59:14.212278+0000 mgr.a (mgr.14355) 12038 : audit [DBG] from='client.263298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:16 smithi131 bash[24745]: cluster 2024-09-14T02:59:15.626644+0000 mgr.a (mgr.14355) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:16 smithi171 bash[25040]: cluster 2024-09-14T02:59:15.626644+0000 mgr.a (mgr.14355) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:16 smithi007 bash[22722]: cluster 2024-09-14T02:59:15.626644+0000 mgr.a (mgr.14355) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T02:59:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:18 smithi131 bash[24745]: cluster 2024-09-14T02:59:17.627619+0000 mgr.a (mgr.14355) 12040 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:18 smithi171 bash[25040]: cluster 2024-09-14T02:59:17.627619+0000 mgr.a (mgr.14355) 12040 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:18 smithi007 bash[22722]: cluster 2024-09-14T02:59:17.627619+0000 mgr.a (mgr.14355) 12040 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:19.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:19.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:20.400 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:20.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:20 smithi131 bash[24745]: cluster 2024-09-14T02:59:19.628433+0000 mgr.a (mgr.14355) 12041 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:20 smithi171 bash[25040]: cluster 2024-09-14T02:59:19.628433+0000 mgr.a (mgr.14355) 12041 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:20 smithi007 bash[22722]: cluster 2024-09-14T02:59:19.628433+0000 mgr.a (mgr.14355) 12041 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:21 smithi131 bash[24745]: audit 2024-09-14T02:59:19.971274+0000 mgr.a (mgr.14355) 12042 : audit [DBG] from='client.263373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:21 smithi171 bash[25040]: audit 2024-09-14T02:59:19.971274+0000 mgr.a (mgr.14355) 12042 : audit [DBG] from='client.263373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:21 smithi007 bash[22722]: audit 2024-09-14T02:59:19.971274+0000 mgr.a (mgr.14355) 12042 : audit [DBG] from='client.263373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:22 smithi131 bash[24745]: cluster 2024-09-14T02:59:21.630906+0000 mgr.a (mgr.14355) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:59:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:22 smithi171 bash[25040]: cluster 2024-09-14T02:59:21.630906+0000 mgr.a (mgr.14355) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:59:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:22 smithi007 bash[22722]: cluster 2024-09-14T02:59:21.630906+0000 mgr.a (mgr.14355) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T02:59:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:24 smithi131 bash[24745]: cluster 2024-09-14T02:59:23.631697+0000 mgr.a (mgr.14355) 12044 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:59:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:24 smithi171 bash[25040]: cluster 2024-09-14T02:59:23.631697+0000 mgr.a (mgr.14355) 12044 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:59:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:24 smithi007 bash[22722]: cluster 2024-09-14T02:59:23.631697+0000 mgr.a (mgr.14355) 12044 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T02:59:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:25.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:25.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:26.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:26.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:26 smithi131 bash[24745]: cluster 2024-09-14T02:59:25.632946+0000 mgr.a (mgr.14355) 12045 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:26 smithi131 bash[24745]: audit 2024-09-14T02:59:25.740039+0000 mgr.a (mgr.14355) 12046 : audit [DBG] from='client.263445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:26 smithi171 bash[25040]: cluster 2024-09-14T02:59:25.632946+0000 mgr.a (mgr.14355) 12045 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:26 smithi171 bash[25040]: audit 2024-09-14T02:59:25.740039+0000 mgr.a (mgr.14355) 12046 : audit [DBG] from='client.263445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:26 smithi007 bash[22722]: cluster 2024-09-14T02:59:25.632946+0000 mgr.a (mgr.14355) 12045 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:26 smithi007 bash[22722]: audit 2024-09-14T02:59:25.740039+0000 mgr.a (mgr.14355) 12046 : audit [DBG] from='client.263445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:28 smithi131 bash[24745]: cluster 2024-09-14T02:59:27.633841+0000 mgr.a (mgr.14355) 12047 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:59:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:28 smithi171 bash[25040]: cluster 2024-09-14T02:59:27.633841+0000 mgr.a (mgr.14355) 12047 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:59:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:28 smithi007 bash[22722]: cluster 2024-09-14T02:59:27.633841+0000 mgr.a (mgr.14355) 12047 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T02:59:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:30 smithi131 bash[24745]: cluster 2024-09-14T02:59:29.634648+0000 mgr.a (mgr.14355) 12048 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:59:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:30 smithi171 bash[25040]: cluster 2024-09-14T02:59:29.634648+0000 mgr.a (mgr.14355) 12048 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:59:31.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:31.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:31.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:30 smithi007 bash[22722]: cluster 2024-09-14T02:59:29.634648+0000 mgr.a (mgr.14355) 12048 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T02:59:31.935 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:31.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:32 smithi131 bash[24745]: audit 2024-09-14T02:59:31.500222+0000 mgr.a (mgr.14355) 12049 : audit [DBG] from='client.263523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:32 smithi131 bash[24745]: cluster 2024-09-14T02:59:31.642117+0000 mgr.a (mgr.14355) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:32 smithi171 bash[25040]: audit 2024-09-14T02:59:31.500222+0000 mgr.a (mgr.14355) 12049 : audit [DBG] from='client.263523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:32 smithi171 bash[25040]: cluster 2024-09-14T02:59:31.642117+0000 mgr.a (mgr.14355) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:32 smithi007 bash[22722]: audit 2024-09-14T02:59:31.500222+0000 mgr.a (mgr.14355) 12049 : audit [DBG] from='client.263523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:32 smithi007 bash[22722]: cluster 2024-09-14T02:59:31.642117+0000 mgr.a (mgr.14355) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:34 smithi131 bash[24745]: cluster 2024-09-14T02:59:33.643035+0000 mgr.a (mgr.14355) 12051 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:59:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:34 smithi171 bash[25040]: cluster 2024-09-14T02:59:33.643035+0000 mgr.a (mgr.14355) 12051 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:59:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:34 smithi007 bash[22722]: cluster 2024-09-14T02:59:33.643035+0000 mgr.a (mgr.14355) 12051 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T02:59:36.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:36.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:36.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:36 smithi131 bash[24745]: cluster 2024-09-14T02:59:35.645246+0000 mgr.a (mgr.14355) 12052 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:59:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:36 smithi171 bash[25040]: cluster 2024-09-14T02:59:35.645246+0000 mgr.a (mgr.14355) 12052 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:59:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:36 smithi007 bash[22722]: cluster 2024-09-14T02:59:35.645246+0000 mgr.a (mgr.14355) 12052 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T02:59:37.682 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:37.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:37.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:37.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:37.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:38 smithi131 bash[24745]: audit 2024-09-14T02:59:37.263924+0000 mgr.a (mgr.14355) 12053 : audit [DBG] from='client.263601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:38 smithi131 bash[24745]: cluster 2024-09-14T02:59:37.645858+0000 mgr.a (mgr.14355) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:38 smithi171 bash[25040]: audit 2024-09-14T02:59:37.263924+0000 mgr.a (mgr.14355) 12053 : audit [DBG] from='client.263601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:38 smithi171 bash[25040]: cluster 2024-09-14T02:59:37.645858+0000 mgr.a (mgr.14355) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:38 smithi007 bash[22722]: audit 2024-09-14T02:59:37.263924+0000 mgr.a (mgr.14355) 12053 : audit [DBG] from='client.263601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:38 smithi007 bash[22722]: cluster 2024-09-14T02:59:37.645858+0000 mgr.a (mgr.14355) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:40 smithi131 bash[24745]: cluster 2024-09-14T02:59:39.646640+0000 mgr.a (mgr.14355) 12055 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:40 smithi171 bash[25040]: cluster 2024-09-14T02:59:39.646640+0000 mgr.a (mgr.14355) 12055 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:40 smithi007 bash[22722]: cluster 2024-09-14T02:59:39.646640+0000 mgr.a (mgr.14355) 12055 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:42.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:42 smithi131 bash[24745]: cluster 2024-09-14T02:59:41.648996+0000 mgr.a (mgr.14355) 12056 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:42 smithi171 bash[25040]: cluster 2024-09-14T02:59:41.648996+0000 mgr.a (mgr.14355) 12056 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:42 smithi007 bash[22722]: cluster 2024-09-14T02:59:41.648996+0000 mgr.a (mgr.14355) 12056 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:43.459 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:43.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:44 smithi171 bash[25040]: audit 2024-09-14T02:59:43.023259+0000 mgr.a (mgr.14355) 12057 : audit [DBG] from='client.263676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:44 smithi171 bash[25040]: cluster 2024-09-14T02:59:43.650124+0000 mgr.a (mgr.14355) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:44 smithi007 bash[22722]: audit 2024-09-14T02:59:43.023259+0000 mgr.a (mgr.14355) 12057 : audit [DBG] from='client.263676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:44 smithi007 bash[22722]: cluster 2024-09-14T02:59:43.650124+0000 mgr.a (mgr.14355) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:44 smithi131 bash[24745]: audit 2024-09-14T02:59:43.023259+0000 mgr.a (mgr.14355) 12057 : audit [DBG] from='client.263676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:44 smithi131 bash[24745]: cluster 2024-09-14T02:59:43.650124+0000 mgr.a (mgr.14355) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:46 smithi171 bash[25040]: cluster 2024-09-14T02:59:45.652493+0000 mgr.a (mgr.14355) 12059 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:46 smithi007 bash[22722]: cluster 2024-09-14T02:59:45.652493+0000 mgr.a (mgr.14355) 12059 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:46 smithi131 bash[24745]: cluster 2024-09-14T02:59:45.652493+0000 mgr.a (mgr.14355) 12059 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:48.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:48.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:48 smithi171 bash[25040]: cluster 2024-09-14T02:59:47.653430+0000 mgr.a (mgr.14355) 12060 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:48 smithi007 bash[22722]: cluster 2024-09-14T02:59:47.653430+0000 mgr.a (mgr.14355) 12060 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:49.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:49.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:49.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:49.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:48 smithi131 bash[24745]: cluster 2024-09-14T02:59:47.653430+0000 mgr.a (mgr.14355) 12060 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:49 smithi007 bash[22722]: audit 2024-09-14T02:59:48.795443+0000 mgr.a (mgr.14355) 12061 : audit [DBG] from='client.263751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:49 smithi131 bash[24745]: audit 2024-09-14T02:59:48.795443+0000 mgr.a (mgr.14355) 12061 : audit [DBG] from='client.263751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:49 smithi171 bash[25040]: audit 2024-09-14T02:59:48.795443+0000 mgr.a (mgr.14355) 12061 : audit [DBG] from='client.263751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:50 smithi007 bash[22722]: cluster 2024-09-14T02:59:49.654489+0000 mgr.a (mgr.14355) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:50 smithi131 bash[24745]: cluster 2024-09-14T02:59:49.654489+0000 mgr.a (mgr.14355) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:50 smithi171 bash[25040]: cluster 2024-09-14T02:59:49.654489+0000 mgr.a (mgr.14355) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:52 smithi007 bash[22722]: cluster 2024-09-14T02:59:51.656727+0000 mgr.a (mgr.14355) 12063 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:52 smithi131 bash[24745]: cluster 2024-09-14T02:59:51.656727+0000 mgr.a (mgr.14355) 12063 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:52 smithi171 bash[25040]: cluster 2024-09-14T02:59:51.656727+0000 mgr.a (mgr.14355) 12063 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T02:59:54.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T02:59:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T02:59:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T02:59:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T02:59:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T02:59:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:54 smithi007 bash[22722]: cluster 2024-09-14T02:59:53.657475+0000 mgr.a (mgr.14355) 12064 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:54 smithi131 bash[24745]: cluster 2024-09-14T02:59:53.657475+0000 mgr.a (mgr.14355) 12064 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:54 smithi171 bash[25040]: cluster 2024-09-14T02:59:53.657475+0000 mgr.a (mgr.14355) 12064 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:55 smithi007 bash[22722]: audit 2024-09-14T02:59:54.545961+0000 mgr.a (mgr.14355) 12065 : audit [DBG] from='client.263826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:55 smithi131 bash[24745]: audit 2024-09-14T02:59:54.545961+0000 mgr.a (mgr.14355) 12065 : audit [DBG] from='client.263826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:55 smithi171 bash[25040]: audit 2024-09-14T02:59:54.545961+0000 mgr.a (mgr.14355) 12065 : audit [DBG] from='client.263826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T02:59:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:56 smithi007 bash[22722]: cluster 2024-09-14T02:59:55.659914+0000 mgr.a (mgr.14355) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:56 smithi131 bash[24745]: cluster 2024-09-14T02:59:55.659914+0000 mgr.a (mgr.14355) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:56 smithi171 bash[25040]: cluster 2024-09-14T02:59:55.659914+0000 mgr.a (mgr.14355) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T02:59:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 02:59:58 smithi007 bash[22722]: cluster 2024-09-14T02:59:57.660735+0000 mgr.a (mgr.14355) 12067 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 02:59:58 smithi131 bash[24745]: cluster 2024-09-14T02:59:57.660735+0000 mgr.a (mgr.14355) 12067 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 02:59:58 smithi171 bash[25040]: cluster 2024-09-14T02:59:57.660735+0000 mgr.a (mgr.14355) 12067 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T02:59:59.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T02:59:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T02:59:59.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:00.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:00.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:00.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:00.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:00.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:00 smithi007 bash[22722]: cluster 2024-09-14T02:59:59.661486+0000 mgr.a (mgr.14355) 12068 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:00 smithi007 bash[22722]: cluster 2024-09-14T03:00:00.000169+0000 mon.a (mon.0) 2398 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:00:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:00 smithi131 bash[24745]: cluster 2024-09-14T02:59:59.661486+0000 mgr.a (mgr.14355) 12068 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:00 smithi131 bash[24745]: cluster 2024-09-14T03:00:00.000169+0000 mon.a (mon.0) 2398 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:00:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:00 smithi171 bash[25040]: cluster 2024-09-14T02:59:59.661486+0000 mgr.a (mgr.14355) 12068 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:00 smithi171 bash[25040]: cluster 2024-09-14T03:00:00.000169+0000 mon.a (mon.0) 2398 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:00:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:01 smithi007 bash[22722]: audit 2024-09-14T03:00:00.308673+0000 mgr.a (mgr.14355) 12069 : audit [DBG] from='client.263904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:01 smithi131 bash[24745]: audit 2024-09-14T03:00:00.308673+0000 mgr.a (mgr.14355) 12069 : audit [DBG] from='client.263904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:01 smithi171 bash[25040]: audit 2024-09-14T03:00:00.308673+0000 mgr.a (mgr.14355) 12069 : audit [DBG] from='client.263904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:02 smithi007 bash[22722]: cluster 2024-09-14T03:00:01.664233+0000 mgr.a (mgr.14355) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:02 smithi007 bash[22722]: audit 2024-09-14T03:00:02.793184+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:00:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:02 smithi131 bash[24745]: cluster 2024-09-14T03:00:01.664233+0000 mgr.a (mgr.14355) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:02 smithi131 bash[24745]: audit 2024-09-14T03:00:02.793184+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:00:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:02 smithi171 bash[25040]: cluster 2024-09-14T03:00:01.664233+0000 mgr.a (mgr.14355) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:02 smithi171 bash[25040]: audit 2024-09-14T03:00:02.793184+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:00:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:03.403058+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:03.407600+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:03.413041+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:03.417581+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: cluster 2024-09-14T03:00:03.664981+0000 mgr.a (mgr.14355) 12071 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:04.177494+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:04.179280+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:04.189693+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22722]: audit 2024-09-14T03:00:04.194574+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:03.403058+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:03.407600+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:03.413041+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:03.417581+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: cluster 2024-09-14T03:00:03.664981+0000 mgr.a (mgr.14355) 12071 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:04.177494+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:04.179280+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:04.189693+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:04 smithi131 bash[24745]: audit 2024-09-14T03:00:04.194574+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:03.403058+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:03.407600+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:03.413041+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:03.417581+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: cluster 2024-09-14T03:00:03.664981+0000 mgr.a (mgr.14355) 12071 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:04.177494+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:04.179280+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:04.189693+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:00:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:04 smithi171 bash[25040]: audit 2024-09-14T03:00:04.194574+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:05.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22972]: debug 2024-09-14T03:00:04.945+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:00:05.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:00:04 smithi007 bash[22972]: debug 2024-09-14T03:00:04.945+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:00:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:05 smithi007 bash[22722]: audit 2024-09-14T03:00:04.196922+0000 mgr.a (mgr.14355) 12072 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:05.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:05.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:05 smithi131 bash[24745]: audit 2024-09-14T03:00:04.196922+0000 mgr.a (mgr.14355) 12072 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:05 smithi171 bash[25040]: audit 2024-09-14T03:00:04.196922+0000 mgr.a (mgr.14355) 12072 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:00:06.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:06 smithi007 bash[22722]: audit 2024-09-14T03:00:04.948247+0000 mgr.a (mgr.14355) 12073 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:00:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:06 smithi007 bash[22722]: cephadm 2024-09-14T03:00:04.949782+0000 mgr.a (mgr.14355) 12074 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:00:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:06 smithi007 bash[22722]: cluster 2024-09-14T03:00:05.667306+0000 mgr.a (mgr.14355) 12075 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:06 smithi131 bash[24745]: audit 2024-09-14T03:00:04.948247+0000 mgr.a (mgr.14355) 12073 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:00:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:06 smithi131 bash[24745]: cephadm 2024-09-14T03:00:04.949782+0000 mgr.a (mgr.14355) 12074 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:00:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:06 smithi131 bash[24745]: cluster 2024-09-14T03:00:05.667306+0000 mgr.a (mgr.14355) 12075 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:06 smithi171 bash[25040]: audit 2024-09-14T03:00:04.948247+0000 mgr.a (mgr.14355) 12073 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:00:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:06 smithi171 bash[25040]: cephadm 2024-09-14T03:00:04.949782+0000 mgr.a (mgr.14355) 12074 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:00:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:06 smithi171 bash[25040]: cluster 2024-09-14T03:00:05.667306+0000 mgr.a (mgr.14355) 12075 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:07 smithi007 bash[22722]: audit 2024-09-14T03:00:06.089141+0000 mgr.a (mgr.14355) 12076 : audit [DBG] from='client.264087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:07 smithi131 bash[24745]: audit 2024-09-14T03:00:06.089141+0000 mgr.a (mgr.14355) 12076 : audit [DBG] from='client.264087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:07 smithi171 bash[25040]: audit 2024-09-14T03:00:06.089141+0000 mgr.a (mgr.14355) 12076 : audit [DBG] from='client.264087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:08 smithi007 bash[22722]: cluster 2024-09-14T03:00:07.668385+0000 mgr.a (mgr.14355) 12077 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:08 smithi131 bash[24745]: cluster 2024-09-14T03:00:07.668385+0000 mgr.a (mgr.14355) 12077 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:08 smithi171 bash[25040]: cluster 2024-09-14T03:00:07.668385+0000 mgr.a (mgr.14355) 12077 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:10 smithi131 bash[24745]: cluster 2024-09-14T03:00:09.669368+0000 mgr.a (mgr.14355) 12078 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:10 smithi171 bash[25040]: cluster 2024-09-14T03:00:09.669368+0000 mgr.a (mgr.14355) 12078 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:10 smithi007 bash[22722]: cluster 2024-09-14T03:00:09.669368+0000 mgr.a (mgr.14355) 12078 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:00:11.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:11.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:12.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:12 smithi131 bash[24745]: cluster 2024-09-14T03:00:11.670811+0000 mgr.a (mgr.14355) 12079 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:12 smithi131 bash[24745]: audit 2024-09-14T03:00:11.852835+0000 mgr.a (mgr.14355) 12080 : audit [DBG] from='client.264162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:12 smithi171 bash[25040]: cluster 2024-09-14T03:00:11.670811+0000 mgr.a (mgr.14355) 12079 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:12 smithi171 bash[25040]: audit 2024-09-14T03:00:11.852835+0000 mgr.a (mgr.14355) 12080 : audit [DBG] from='client.264162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:12 smithi007 bash[22722]: cluster 2024-09-14T03:00:11.670811+0000 mgr.a (mgr.14355) 12079 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:12 smithi007 bash[22722]: audit 2024-09-14T03:00:11.852835+0000 mgr.a (mgr.14355) 12080 : audit [DBG] from='client.264162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:14 smithi131 bash[24745]: cluster 2024-09-14T03:00:13.671681+0000 mgr.a (mgr.14355) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:14 smithi171 bash[25040]: cluster 2024-09-14T03:00:13.671681+0000 mgr.a (mgr.14355) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:14 smithi007 bash[22722]: cluster 2024-09-14T03:00:13.671681+0000 mgr.a (mgr.14355) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:16 smithi131 bash[24745]: cluster 2024-09-14T03:00:15.673857+0000 mgr.a (mgr.14355) 12082 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:16 smithi171 bash[25040]: cluster 2024-09-14T03:00:15.673857+0000 mgr.a (mgr.14355) 12082 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:16 smithi007 bash[22722]: cluster 2024-09-14T03:00:15.673857+0000 mgr.a (mgr.14355) 12082 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:00:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:18.059 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:18 smithi131 bash[24745]: audit 2024-09-14T03:00:17.629819+0000 mgr.a (mgr.14355) 12083 : audit [DBG] from='client.264237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:18 smithi131 bash[24745]: cluster 2024-09-14T03:00:17.674865+0000 mgr.a (mgr.14355) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:18 smithi171 bash[25040]: audit 2024-09-14T03:00:17.629819+0000 mgr.a (mgr.14355) 12083 : audit [DBG] from='client.264237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:18 smithi171 bash[25040]: cluster 2024-09-14T03:00:17.674865+0000 mgr.a (mgr.14355) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:18 smithi007 bash[22722]: audit 2024-09-14T03:00:17.629819+0000 mgr.a (mgr.14355) 12083 : audit [DBG] from='client.264237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:18 smithi007 bash[22722]: cluster 2024-09-14T03:00:17.674865+0000 mgr.a (mgr.14355) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:20 smithi131 bash[24745]: cluster 2024-09-14T03:00:19.675786+0000 mgr.a (mgr.14355) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:20 smithi171 bash[25040]: cluster 2024-09-14T03:00:19.675786+0000 mgr.a (mgr.14355) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:20 smithi007 bash[22722]: cluster 2024-09-14T03:00:19.675786+0000 mgr.a (mgr.14355) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:22 smithi131 bash[24745]: cluster 2024-09-14T03:00:21.678001+0000 mgr.a (mgr.14355) 12086 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:22 smithi171 bash[25040]: cluster 2024-09-14T03:00:21.678001+0000 mgr.a (mgr.14355) 12086 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:23.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:23.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:22 smithi007 bash[22722]: cluster 2024-09-14T03:00:21.678001+0000 mgr.a (mgr.14355) 12086 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:23.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:23.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:24 smithi131 bash[24745]: audit 2024-09-14T03:00:23.390514+0000 mgr.a (mgr.14355) 12087 : audit [DBG] from='client.264315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:24 smithi131 bash[24745]: cluster 2024-09-14T03:00:23.678547+0000 mgr.a (mgr.14355) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:24 smithi171 bash[25040]: audit 2024-09-14T03:00:23.390514+0000 mgr.a (mgr.14355) 12087 : audit [DBG] from='client.264315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:24 smithi171 bash[25040]: cluster 2024-09-14T03:00:23.678547+0000 mgr.a (mgr.14355) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:24 smithi007 bash[22722]: audit 2024-09-14T03:00:23.390514+0000 mgr.a (mgr.14355) 12087 : audit [DBG] from='client.264315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:24 smithi007 bash[22722]: cluster 2024-09-14T03:00:23.678547+0000 mgr.a (mgr.14355) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:26 smithi131 bash[24745]: cluster 2024-09-14T03:00:25.680801+0000 mgr.a (mgr.14355) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:26 smithi171 bash[25040]: cluster 2024-09-14T03:00:25.680801+0000 mgr.a (mgr.14355) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:26 smithi007 bash[22722]: cluster 2024-09-14T03:00:25.680801+0000 mgr.a (mgr.14355) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:28.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:28.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:28.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:28 smithi131 bash[24745]: cluster 2024-09-14T03:00:27.681572+0000 mgr.a (mgr.14355) 12090 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:28 smithi171 bash[25040]: cluster 2024-09-14T03:00:27.681572+0000 mgr.a (mgr.14355) 12090 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:28 smithi007 bash[22722]: cluster 2024-09-14T03:00:27.681572+0000 mgr.a (mgr.14355) 12090 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:29.561 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:29.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:29.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:29.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:29.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:30 smithi131 bash[24745]: audit 2024-09-14T03:00:29.145730+0000 mgr.a (mgr.14355) 12091 : audit [DBG] from='client.264390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:30 smithi131 bash[24745]: cluster 2024-09-14T03:00:29.682503+0000 mgr.a (mgr.14355) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:30 smithi171 bash[25040]: audit 2024-09-14T03:00:29.145730+0000 mgr.a (mgr.14355) 12091 : audit [DBG] from='client.264390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:30 smithi171 bash[25040]: cluster 2024-09-14T03:00:29.682503+0000 mgr.a (mgr.14355) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:30 smithi007 bash[22722]: audit 2024-09-14T03:00:29.145730+0000 mgr.a (mgr.14355) 12091 : audit [DBG] from='client.264390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:30 smithi007 bash[22722]: cluster 2024-09-14T03:00:29.682503+0000 mgr.a (mgr.14355) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:32 smithi131 bash[24745]: cluster 2024-09-14T03:00:31.684716+0000 mgr.a (mgr.14355) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:32 smithi171 bash[25040]: cluster 2024-09-14T03:00:31.684716+0000 mgr.a (mgr.14355) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:32 smithi007 bash[22722]: cluster 2024-09-14T03:00:31.684716+0000 mgr.a (mgr.14355) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:34.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:34.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:34.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:34 smithi131 bash[24745]: cluster 2024-09-14T03:00:33.685466+0000 mgr.a (mgr.14355) 12094 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:34 smithi171 bash[25040]: cluster 2024-09-14T03:00:33.685466+0000 mgr.a (mgr.14355) 12094 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:34 smithi007 bash[22722]: cluster 2024-09-14T03:00:33.685466+0000 mgr.a (mgr.14355) 12094 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:35.331 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:35 smithi171 bash[25040]: audit 2024-09-14T03:00:34.899074+0000 mgr.a (mgr.14355) 12095 : audit [DBG] from='client.264468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:35 smithi007 bash[22722]: audit 2024-09-14T03:00:34.899074+0000 mgr.a (mgr.14355) 12095 : audit [DBG] from='client.264468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:35 smithi131 bash[24745]: audit 2024-09-14T03:00:34.899074+0000 mgr.a (mgr.14355) 12095 : audit [DBG] from='client.264468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:36 smithi171 bash[25040]: cluster 2024-09-14T03:00:35.687757+0000 mgr.a (mgr.14355) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:00:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:36 smithi007 bash[22722]: cluster 2024-09-14T03:00:35.687757+0000 mgr.a (mgr.14355) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:00:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:36 smithi131 bash[24745]: cluster 2024-09-14T03:00:35.687757+0000 mgr.a (mgr.14355) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:00:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:38 smithi171 bash[25040]: cluster 2024-09-14T03:00:37.688528+0000 mgr.a (mgr.14355) 12097 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:38 smithi007 bash[22722]: cluster 2024-09-14T03:00:37.688528+0000 mgr.a (mgr.14355) 12097 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:38 smithi131 bash[24745]: cluster 2024-09-14T03:00:37.688528+0000 mgr.a (mgr.14355) 12097 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:41.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:41.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:41.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:40 smithi007 bash[22722]: cluster 2024-09-14T03:00:39.689286+0000 mgr.a (mgr.14355) 12098 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:40 smithi131 bash[24745]: cluster 2024-09-14T03:00:39.689286+0000 mgr.a (mgr.14355) 12098 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:40 smithi171 bash[25040]: cluster 2024-09-14T03:00:39.689286+0000 mgr.a (mgr.14355) 12098 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:00:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:41 smithi007 bash[22722]: audit 2024-09-14T03:00:40.671011+0000 mgr.a (mgr.14355) 12099 : audit [DBG] from='client.264543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:41 smithi131 bash[24745]: audit 2024-09-14T03:00:40.671011+0000 mgr.a (mgr.14355) 12099 : audit [DBG] from='client.264543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:41 smithi171 bash[25040]: audit 2024-09-14T03:00:40.671011+0000 mgr.a (mgr.14355) 12099 : audit [DBG] from='client.264543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:42 smithi007 bash[22722]: cluster 2024-09-14T03:00:41.692133+0000 mgr.a (mgr.14355) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:42 smithi131 bash[24745]: cluster 2024-09-14T03:00:41.692133+0000 mgr.a (mgr.14355) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:42 smithi171 bash[25040]: cluster 2024-09-14T03:00:41.692133+0000 mgr.a (mgr.14355) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:44 smithi007 bash[22722]: cluster 2024-09-14T03:00:43.692885+0000 mgr.a (mgr.14355) 12101 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:44 smithi131 bash[24745]: cluster 2024-09-14T03:00:43.692885+0000 mgr.a (mgr.14355) 12101 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:44 smithi171 bash[25040]: cluster 2024-09-14T03:00:43.692885+0000 mgr.a (mgr.14355) 12101 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:00:46.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:46.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:46.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:46.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:46 smithi007 bash[22722]: cluster 2024-09-14T03:00:45.694858+0000 mgr.a (mgr.14355) 12102 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:46 smithi131 bash[24745]: cluster 2024-09-14T03:00:45.694858+0000 mgr.a (mgr.14355) 12102 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:46 smithi171 bash[25040]: cluster 2024-09-14T03:00:45.694858+0000 mgr.a (mgr.14355) 12102 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:47 smithi007 bash[22722]: audit 2024-09-14T03:00:46.445817+0000 mgr.a (mgr.14355) 12103 : audit [DBG] from='client.264618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:47 smithi131 bash[24745]: audit 2024-09-14T03:00:46.445817+0000 mgr.a (mgr.14355) 12103 : audit [DBG] from='client.264618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:47 smithi171 bash[25040]: audit 2024-09-14T03:00:46.445817+0000 mgr.a (mgr.14355) 12103 : audit [DBG] from='client.264618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:48 smithi007 bash[22722]: cluster 2024-09-14T03:00:47.695799+0000 mgr.a (mgr.14355) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:48 smithi131 bash[24745]: cluster 2024-09-14T03:00:47.695799+0000 mgr.a (mgr.14355) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:48 smithi171 bash[25040]: cluster 2024-09-14T03:00:47.695799+0000 mgr.a (mgr.14355) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:50 smithi007 bash[22722]: cluster 2024-09-14T03:00:49.696591+0000 mgr.a (mgr.14355) 12105 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:50 smithi131 bash[24745]: cluster 2024-09-14T03:00:49.696591+0000 mgr.a (mgr.14355) 12105 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:50 smithi171 bash[25040]: cluster 2024-09-14T03:00:49.696591+0000 mgr.a (mgr.14355) 12105 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:00:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:51.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:51.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:52.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:52.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:52.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:52.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:52.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:52 smithi007 bash[22722]: cluster 2024-09-14T03:00:51.698951+0000 mgr.a (mgr.14355) 12106 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:00:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:52 smithi131 bash[24745]: cluster 2024-09-14T03:00:51.698951+0000 mgr.a (mgr.14355) 12106 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:00:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:52 smithi171 bash[25040]: cluster 2024-09-14T03:00:51.698951+0000 mgr.a (mgr.14355) 12106 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:00:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:53 smithi007 bash[22722]: audit 2024-09-14T03:00:52.222791+0000 mgr.a (mgr.14355) 12107 : audit [DBG] from='client.264696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:53 smithi131 bash[24745]: audit 2024-09-14T03:00:52.222791+0000 mgr.a (mgr.14355) 12107 : audit [DBG] from='client.264696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:53 smithi171 bash[25040]: audit 2024-09-14T03:00:52.222791+0000 mgr.a (mgr.14355) 12107 : audit [DBG] from='client.264696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:00:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:54 smithi007 bash[22722]: cluster 2024-09-14T03:00:53.699824+0000 mgr.a (mgr.14355) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:54 smithi131 bash[24745]: cluster 2024-09-14T03:00:53.699824+0000 mgr.a (mgr.14355) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:54 smithi171 bash[25040]: cluster 2024-09-14T03:00:53.699824+0000 mgr.a (mgr.14355) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:56 smithi007 bash[22722]: cluster 2024-09-14T03:00:55.702027+0000 mgr.a (mgr.14355) 12109 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:56 smithi131 bash[24745]: cluster 2024-09-14T03:00:55.702027+0000 mgr.a (mgr.14355) 12109 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:56 smithi171 bash[25040]: cluster 2024-09-14T03:00:55.702027+0000 mgr.a (mgr.14355) 12109 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:00:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:00:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:00:57.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:00:58.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:00:58.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:00:58.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:00:58.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:00:58.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:00:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:58 smithi007 bash[22722]: cluster 2024-09-14T03:00:57.702762+0000 mgr.a (mgr.14355) 12110 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:58 smithi131 bash[24745]: cluster 2024-09-14T03:00:57.702762+0000 mgr.a (mgr.14355) 12110 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:00:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:58 smithi171 bash[25040]: cluster 2024-09-14T03:00:57.702762+0000 mgr.a (mgr.14355) 12110 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:00:59 smithi007 bash[22722]: audit 2024-09-14T03:00:57.988019+0000 mgr.a (mgr.14355) 12111 : audit [DBG] from='client.264774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:00:59 smithi131 bash[24745]: audit 2024-09-14T03:00:57.988019+0000 mgr.a (mgr.14355) 12111 : audit [DBG] from='client.264774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:00:59 smithi171 bash[25040]: audit 2024-09-14T03:00:57.988019+0000 mgr.a (mgr.14355) 12111 : audit [DBG] from='client.264774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:00 smithi007 bash[22722]: cluster 2024-09-14T03:00:59.703636+0000 mgr.a (mgr.14355) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:00 smithi131 bash[24745]: cluster 2024-09-14T03:00:59.703636+0000 mgr.a (mgr.14355) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:00 smithi171 bash[25040]: cluster 2024-09-14T03:00:59.703636+0000 mgr.a (mgr.14355) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:02 smithi007 bash[22722]: cluster 2024-09-14T03:01:01.705891+0000 mgr.a (mgr.14355) 12113 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:02 smithi131 bash[24745]: cluster 2024-09-14T03:01:01.705891+0000 mgr.a (mgr.14355) 12113 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:02 smithi171 bash[25040]: cluster 2024-09-14T03:01:01.705891+0000 mgr.a (mgr.14355) 12113 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:04.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:04.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:04 smithi007 bash[22722]: cluster 2024-09-14T03:01:03.706618+0000 mgr.a (mgr.14355) 12114 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:04 smithi007 bash[22722]: audit 2024-09-14T03:01:03.749331+0000 mgr.a (mgr.14355) 12115 : audit [DBG] from='client.264849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:04 smithi131 bash[24745]: cluster 2024-09-14T03:01:03.706618+0000 mgr.a (mgr.14355) 12114 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:04 smithi131 bash[24745]: audit 2024-09-14T03:01:03.749331+0000 mgr.a (mgr.14355) 12115 : audit [DBG] from='client.264849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:04 smithi171 bash[25040]: cluster 2024-09-14T03:01:03.706618+0000 mgr.a (mgr.14355) 12114 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:04 smithi171 bash[25040]: audit 2024-09-14T03:01:03.749331+0000 mgr.a (mgr.14355) 12115 : audit [DBG] from='client.264849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:05 smithi007 bash[22722]: audit 2024-09-14T03:01:05.010462+0000 mon.a (mon.0) 2408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:01:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:05 smithi007 bash[22722]: audit 2024-09-14T03:01:05.849493+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:01:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:05 smithi007 bash[22722]: audit 2024-09-14T03:01:05.851284+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:01:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:05 smithi007 bash[22722]: audit 2024-09-14T03:01:05.861767+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:01:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:05 smithi007 bash[22722]: audit 2024-09-14T03:01:05.866553+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:05 smithi131 bash[24745]: audit 2024-09-14T03:01:05.010462+0000 mon.a (mon.0) 2408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:01:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:05 smithi131 bash[24745]: audit 2024-09-14T03:01:05.849493+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:01:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:05 smithi131 bash[24745]: audit 2024-09-14T03:01:05.851284+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:01:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:05 smithi131 bash[24745]: audit 2024-09-14T03:01:05.861767+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:01:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:05 smithi131 bash[24745]: audit 2024-09-14T03:01:05.866553+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:05 smithi171 bash[25040]: audit 2024-09-14T03:01:05.010462+0000 mon.a (mon.0) 2408 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:01:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:05 smithi171 bash[25040]: audit 2024-09-14T03:01:05.849493+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:01:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:05 smithi171 bash[25040]: audit 2024-09-14T03:01:05.851284+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:01:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:05 smithi171 bash[25040]: audit 2024-09-14T03:01:05.861767+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:01:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:05 smithi171 bash[25040]: audit 2024-09-14T03:01:05.866553+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:06.887 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:01:06 smithi007 bash[22972]: debug 2024-09-14T03:01:06.604+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:01:06.888 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:01:06 smithi007 bash[22972]: debug 2024-09-14T03:01:06.604+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:01:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:06 smithi007 bash[22722]: cluster 2024-09-14T03:01:05.708890+0000 mgr.a (mgr.14355) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:06 smithi007 bash[22722]: audit 2024-09-14T03:01:05.868942+0000 mgr.a (mgr.14355) 12117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:06 smithi131 bash[24745]: cluster 2024-09-14T03:01:05.708890+0000 mgr.a (mgr.14355) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:06 smithi131 bash[24745]: audit 2024-09-14T03:01:05.868942+0000 mgr.a (mgr.14355) 12117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:06 smithi171 bash[25040]: cluster 2024-09-14T03:01:05.708890+0000 mgr.a (mgr.14355) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:06 smithi171 bash[25040]: audit 2024-09-14T03:01:05.868942+0000 mgr.a (mgr.14355) 12117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:01:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:07 smithi007 bash[22722]: audit 2024-09-14T03:01:06.607809+0000 mgr.a (mgr.14355) 12118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:01:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:07 smithi007 bash[22722]: cephadm 2024-09-14T03:01:06.609030+0000 mgr.a (mgr.14355) 12119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:01:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:07 smithi131 bash[24745]: audit 2024-09-14T03:01:06.607809+0000 mgr.a (mgr.14355) 12118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:01:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:07 smithi131 bash[24745]: cephadm 2024-09-14T03:01:06.609030+0000 mgr.a (mgr.14355) 12119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:01:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:07 smithi171 bash[25040]: audit 2024-09-14T03:01:06.607809+0000 mgr.a (mgr.14355) 12118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:01:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:07 smithi171 bash[25040]: cephadm 2024-09-14T03:01:06.609030+0000 mgr.a (mgr.14355) 12119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:01:09.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:09.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:09.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:08 smithi007 bash[22722]: cluster 2024-09-14T03:01:07.709769+0000 mgr.a (mgr.14355) 12120 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:08 smithi131 bash[24745]: cluster 2024-09-14T03:01:07.709769+0000 mgr.a (mgr.14355) 12120 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:08 smithi171 bash[25040]: cluster 2024-09-14T03:01:07.709769+0000 mgr.a (mgr.14355) 12120 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:09.962 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:09.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:10 smithi007 bash[22722]: audit 2024-09-14T03:01:09.530807+0000 mgr.a (mgr.14355) 12121 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:10 smithi007 bash[22722]: cluster 2024-09-14T03:01:09.710265+0000 mgr.a (mgr.14355) 12122 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:10 smithi131 bash[24745]: audit 2024-09-14T03:01:09.530807+0000 mgr.a (mgr.14355) 12121 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:10 smithi131 bash[24745]: cluster 2024-09-14T03:01:09.710265+0000 mgr.a (mgr.14355) 12122 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:10 smithi171 bash[25040]: audit 2024-09-14T03:01:09.530807+0000 mgr.a (mgr.14355) 12121 : audit [DBG] from='client.265035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:10 smithi171 bash[25040]: cluster 2024-09-14T03:01:09.710265+0000 mgr.a (mgr.14355) 12122 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:12 smithi007 bash[22722]: cluster 2024-09-14T03:01:11.713306+0000 mgr.a (mgr.14355) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:12 smithi131 bash[24745]: cluster 2024-09-14T03:01:11.713306+0000 mgr.a (mgr.14355) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:12 smithi171 bash[25040]: cluster 2024-09-14T03:01:11.713306+0000 mgr.a (mgr.14355) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:14.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:14 smithi007 bash[22722]: cluster 2024-09-14T03:01:13.714106+0000 mgr.a (mgr.14355) 12124 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:14 smithi131 bash[24745]: cluster 2024-09-14T03:01:13.714106+0000 mgr.a (mgr.14355) 12124 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:14 smithi171 bash[25040]: cluster 2024-09-14T03:01:13.714106+0000 mgr.a (mgr.14355) 12124 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:15.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:15.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:15.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:15.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:16 smithi007 bash[22722]: audit 2024-09-14T03:01:15.301761+0000 mgr.a (mgr.14355) 12125 : audit [DBG] from='client.265113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:16 smithi007 bash[22722]: cluster 2024-09-14T03:01:15.715372+0000 mgr.a (mgr.14355) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:16 smithi131 bash[24745]: audit 2024-09-14T03:01:15.301761+0000 mgr.a (mgr.14355) 12125 : audit [DBG] from='client.265113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:16 smithi131 bash[24745]: cluster 2024-09-14T03:01:15.715372+0000 mgr.a (mgr.14355) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:16 smithi171 bash[25040]: audit 2024-09-14T03:01:15.301761+0000 mgr.a (mgr.14355) 12125 : audit [DBG] from='client.265113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:16 smithi171 bash[25040]: cluster 2024-09-14T03:01:15.715372+0000 mgr.a (mgr.14355) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:18 smithi007 bash[22722]: cluster 2024-09-14T03:01:17.716103+0000 mgr.a (mgr.14355) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:18 smithi131 bash[24745]: cluster 2024-09-14T03:01:17.716103+0000 mgr.a (mgr.14355) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:18 smithi171 bash[25040]: cluster 2024-09-14T03:01:17.716103+0000 mgr.a (mgr.14355) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:20.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:20.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:20.747 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:20 smithi007 bash[22722]: cluster 2024-09-14T03:01:19.716899+0000 mgr.a (mgr.14355) 12128 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:20 smithi131 bash[24745]: cluster 2024-09-14T03:01:19.716899+0000 mgr.a (mgr.14355) 12128 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:20 smithi171 bash[25040]: cluster 2024-09-14T03:01:19.716899+0000 mgr.a (mgr.14355) 12128 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:01:21.504 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:21.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:21.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:21.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:21.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:22 smithi007 bash[22722]: audit 2024-09-14T03:01:21.086156+0000 mgr.a (mgr.14355) 12129 : audit [DBG] from='client.265185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:22 smithi007 bash[22722]: cluster 2024-09-14T03:01:21.719847+0000 mgr.a (mgr.14355) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:22 smithi131 bash[24745]: audit 2024-09-14T03:01:21.086156+0000 mgr.a (mgr.14355) 12129 : audit [DBG] from='client.265185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:22 smithi131 bash[24745]: cluster 2024-09-14T03:01:21.719847+0000 mgr.a (mgr.14355) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:22 smithi171 bash[25040]: audit 2024-09-14T03:01:21.086156+0000 mgr.a (mgr.14355) 12129 : audit [DBG] from='client.265185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:22 smithi171 bash[25040]: cluster 2024-09-14T03:01:21.719847+0000 mgr.a (mgr.14355) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:01:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:24 smithi007 bash[22722]: cluster 2024-09-14T03:01:23.720865+0000 mgr.a (mgr.14355) 12131 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:01:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:24 smithi131 bash[24745]: cluster 2024-09-14T03:01:23.720865+0000 mgr.a (mgr.14355) 12131 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:01:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:24 smithi171 bash[25040]: cluster 2024-09-14T03:01:23.720865+0000 mgr.a (mgr.14355) 12131 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:01:26.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:26.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:26 smithi007 bash[22722]: cluster 2024-09-14T03:01:25.723007+0000 mgr.a (mgr.14355) 12132 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:27.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:26 smithi131 bash[24745]: cluster 2024-09-14T03:01:25.723007+0000 mgr.a (mgr.14355) 12132 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:26 smithi171 bash[25040]: cluster 2024-09-14T03:01:25.723007+0000 mgr.a (mgr.14355) 12132 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:27 smithi007 bash[22722]: audit 2024-09-14T03:01:26.838811+0000 mgr.a (mgr.14355) 12133 : audit [DBG] from='client.265260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:27 smithi131 bash[24745]: audit 2024-09-14T03:01:26.838811+0000 mgr.a (mgr.14355) 12133 : audit [DBG] from='client.265260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:27 smithi171 bash[25040]: audit 2024-09-14T03:01:26.838811+0000 mgr.a (mgr.14355) 12133 : audit [DBG] from='client.265260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:28 smithi007 bash[22722]: cluster 2024-09-14T03:01:27.724003+0000 mgr.a (mgr.14355) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:28 smithi131 bash[24745]: cluster 2024-09-14T03:01:27.724003+0000 mgr.a (mgr.14355) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:28 smithi171 bash[25040]: cluster 2024-09-14T03:01:27.724003+0000 mgr.a (mgr.14355) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:30 smithi007 bash[22722]: cluster 2024-09-14T03:01:29.724857+0000 mgr.a (mgr.14355) 12135 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:30 smithi131 bash[24745]: cluster 2024-09-14T03:01:29.724857+0000 mgr.a (mgr.14355) 12135 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:30 smithi171 bash[25040]: cluster 2024-09-14T03:01:29.724857+0000 mgr.a (mgr.14355) 12135 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:32.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:31 smithi131 bash[24745]: cluster 2024-09-14T03:01:31.727134+0000 mgr.a (mgr.14355) 12136 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:31 smithi171 bash[25040]: cluster 2024-09-14T03:01:31.727134+0000 mgr.a (mgr.14355) 12136 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:32.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:31 smithi007 bash[22722]: cluster 2024-09-14T03:01:31.727134+0000 mgr.a (mgr.14355) 12136 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:33.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:33.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:32 smithi131 bash[24745]: audit 2024-09-14T03:01:32.592837+0000 mgr.a (mgr.14355) 12137 : audit [DBG] from='client.265338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:32 smithi171 bash[25040]: audit 2024-09-14T03:01:32.592837+0000 mgr.a (mgr.14355) 12137 : audit [DBG] from='client.265338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:32 smithi007 bash[22722]: audit 2024-09-14T03:01:32.592837+0000 mgr.a (mgr.14355) 12137 : audit [DBG] from='client.265338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:33 smithi131 bash[24745]: cluster 2024-09-14T03:01:33.728108+0000 mgr.a (mgr.14355) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:33 smithi171 bash[25040]: cluster 2024-09-14T03:01:33.728108+0000 mgr.a (mgr.14355) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:33 smithi007 bash[22722]: cluster 2024-09-14T03:01:33.728108+0000 mgr.a (mgr.14355) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:36 smithi171 bash[25040]: cluster 2024-09-14T03:01:35.730434+0000 mgr.a (mgr.14355) 12139 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:36 smithi007 bash[22722]: cluster 2024-09-14T03:01:35.730434+0000 mgr.a (mgr.14355) 12139 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:36 smithi131 bash[24745]: cluster 2024-09-14T03:01:35.730434+0000 mgr.a (mgr.14355) 12139 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:38.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:38.787 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:38 smithi171 bash[25040]: cluster 2024-09-14T03:01:37.731186+0000 mgr.a (mgr.14355) 12140 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:38 smithi007 bash[22722]: cluster 2024-09-14T03:01:37.731186+0000 mgr.a (mgr.14355) 12140 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:38 smithi131 bash[24745]: cluster 2024-09-14T03:01:37.731186+0000 mgr.a (mgr.14355) 12140 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:39 smithi007 bash[22722]: audit 2024-09-14T03:01:38.361708+0000 mgr.a (mgr.14355) 12141 : audit [DBG] from='client.265413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:39 smithi131 bash[24745]: audit 2024-09-14T03:01:38.361708+0000 mgr.a (mgr.14355) 12141 : audit [DBG] from='client.265413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:39 smithi171 bash[25040]: audit 2024-09-14T03:01:38.361708+0000 mgr.a (mgr.14355) 12141 : audit [DBG] from='client.265413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:40 smithi007 bash[22722]: cluster 2024-09-14T03:01:39.732141+0000 mgr.a (mgr.14355) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:40 smithi131 bash[24745]: cluster 2024-09-14T03:01:39.732141+0000 mgr.a (mgr.14355) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:40 smithi171 bash[25040]: cluster 2024-09-14T03:01:39.732141+0000 mgr.a (mgr.14355) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:42 smithi007 bash[22722]: cluster 2024-09-14T03:01:41.734477+0000 mgr.a (mgr.14355) 12143 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:42 smithi131 bash[24745]: cluster 2024-09-14T03:01:41.734477+0000 mgr.a (mgr.14355) 12143 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:42 smithi171 bash[25040]: cluster 2024-09-14T03:01:41.734477+0000 mgr.a (mgr.14355) 12143 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:43.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:43.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:43.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:44.547 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:44.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:44.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:44.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:44.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:44 smithi007 bash[22722]: cluster 2024-09-14T03:01:43.735233+0000 mgr.a (mgr.14355) 12144 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:44 smithi131 bash[24745]: cluster 2024-09-14T03:01:43.735233+0000 mgr.a (mgr.14355) 12144 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:44 smithi171 bash[25040]: cluster 2024-09-14T03:01:43.735233+0000 mgr.a (mgr.14355) 12144 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:45 smithi007 bash[22722]: audit 2024-09-14T03:01:44.121401+0000 mgr.a (mgr.14355) 12145 : audit [DBG] from='client.265491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:45 smithi131 bash[24745]: audit 2024-09-14T03:01:44.121401+0000 mgr.a (mgr.14355) 12145 : audit [DBG] from='client.265491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:45 smithi171 bash[25040]: audit 2024-09-14T03:01:44.121401+0000 mgr.a (mgr.14355) 12145 : audit [DBG] from='client.265491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:46 smithi007 bash[22722]: cluster 2024-09-14T03:01:45.737566+0000 mgr.a (mgr.14355) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:46 smithi131 bash[24745]: cluster 2024-09-14T03:01:45.737566+0000 mgr.a (mgr.14355) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:46 smithi171 bash[25040]: cluster 2024-09-14T03:01:45.737566+0000 mgr.a (mgr.14355) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:01:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:48 smithi007 bash[22722]: cluster 2024-09-14T03:01:47.738365+0000 mgr.a (mgr.14355) 12147 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:48 smithi131 bash[24745]: cluster 2024-09-14T03:01:47.738365+0000 mgr.a (mgr.14355) 12147 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:48 smithi171 bash[25040]: cluster 2024-09-14T03:01:47.738365+0000 mgr.a (mgr.14355) 12147 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:50.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:50.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:50.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:50.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:50.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:50 smithi007 bash[22722]: cluster 2024-09-14T03:01:49.739089+0000 mgr.a (mgr.14355) 12148 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:50 smithi007 bash[22722]: audit 2024-09-14T03:01:49.886881+0000 mgr.a (mgr.14355) 12149 : audit [DBG] from='client.265566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:50 smithi131 bash[24745]: cluster 2024-09-14T03:01:49.739089+0000 mgr.a (mgr.14355) 12148 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:50 smithi131 bash[24745]: audit 2024-09-14T03:01:49.886881+0000 mgr.a (mgr.14355) 12149 : audit [DBG] from='client.265566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:50 smithi171 bash[25040]: cluster 2024-09-14T03:01:49.739089+0000 mgr.a (mgr.14355) 12148 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:50 smithi171 bash[25040]: audit 2024-09-14T03:01:49.886881+0000 mgr.a (mgr.14355) 12149 : audit [DBG] from='client.265566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:52 smithi007 bash[22722]: cluster 2024-09-14T03:01:51.741481+0000 mgr.a (mgr.14355) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:01:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:52 smithi131 bash[24745]: cluster 2024-09-14T03:01:51.741481+0000 mgr.a (mgr.14355) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:01:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:52 smithi171 bash[25040]: cluster 2024-09-14T03:01:51.741481+0000 mgr.a (mgr.14355) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:01:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:54 smithi007 bash[22722]: cluster 2024-09-14T03:01:53.742285+0000 mgr.a (mgr.14355) 12151 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:01:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:54 smithi131 bash[24745]: cluster 2024-09-14T03:01:53.742285+0000 mgr.a (mgr.14355) 12151 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:01:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:54 smithi171 bash[25040]: cluster 2024-09-14T03:01:53.742285+0000 mgr.a (mgr.14355) 12151 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:01:55.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:01:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:01:55.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:01:56.085 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:01:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:01:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:01:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:01:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:01:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:56 smithi007 bash[22722]: audit 2024-09-14T03:01:55.663751+0000 mgr.a (mgr.14355) 12152 : audit [DBG] from='client.265641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:56 smithi007 bash[22722]: cluster 2024-09-14T03:01:55.743653+0000 mgr.a (mgr.14355) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:56 smithi131 bash[24745]: audit 2024-09-14T03:01:55.663751+0000 mgr.a (mgr.14355) 12152 : audit [DBG] from='client.265641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:56 smithi131 bash[24745]: cluster 2024-09-14T03:01:55.743653+0000 mgr.a (mgr.14355) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:56 smithi171 bash[25040]: audit 2024-09-14T03:01:55.663751+0000 mgr.a (mgr.14355) 12152 : audit [DBG] from='client.265641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:01:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:56 smithi171 bash[25040]: cluster 2024-09-14T03:01:55.743653+0000 mgr.a (mgr.14355) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:01:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:01:58 smithi007 bash[22722]: cluster 2024-09-14T03:01:57.744525+0000 mgr.a (mgr.14355) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:01:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:01:58 smithi131 bash[24745]: cluster 2024-09-14T03:01:57.744525+0000 mgr.a (mgr.14355) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:01:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:01:58 smithi171 bash[25040]: cluster 2024-09-14T03:01:57.744525+0000 mgr.a (mgr.14355) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:01.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:01.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:00 smithi007 bash[22722]: cluster 2024-09-14T03:01:59.745347+0000 mgr.a (mgr.14355) 12155 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:00 smithi131 bash[24745]: cluster 2024-09-14T03:01:59.745347+0000 mgr.a (mgr.14355) 12155 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:00 smithi171 bash[25040]: cluster 2024-09-14T03:01:59.745347+0000 mgr.a (mgr.14355) 12155 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:01.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:01.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:01.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:01.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:01.866 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:02 smithi007 bash[22722]: audit 2024-09-14T03:02:01.421701+0000 mgr.a (mgr.14355) 12156 : audit [DBG] from='client.265719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:02 smithi007 bash[22722]: cluster 2024-09-14T03:02:01.746659+0000 mgr.a (mgr.14355) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:02 smithi131 bash[24745]: audit 2024-09-14T03:02:01.421701+0000 mgr.a (mgr.14355) 12156 : audit [DBG] from='client.265719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:02 smithi131 bash[24745]: cluster 2024-09-14T03:02:01.746659+0000 mgr.a (mgr.14355) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:02 smithi171 bash[25040]: audit 2024-09-14T03:02:01.421701+0000 mgr.a (mgr.14355) 12156 : audit [DBG] from='client.265719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:02 smithi171 bash[25040]: cluster 2024-09-14T03:02:01.746659+0000 mgr.a (mgr.14355) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:04 smithi007 bash[22722]: cluster 2024-09-14T03:02:03.747536+0000 mgr.a (mgr.14355) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:02:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:04 smithi131 bash[24745]: cluster 2024-09-14T03:02:03.747536+0000 mgr.a (mgr.14355) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:02:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:04 smithi171 bash[25040]: cluster 2024-09-14T03:02:03.747536+0000 mgr.a (mgr.14355) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:02:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:06.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:06 smithi007 bash[22722]: cluster 2024-09-14T03:02:05.749739+0000 mgr.a (mgr.14355) 12159 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:06 smithi007 bash[22722]: audit 2024-09-14T03:02:06.660414+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:02:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:06 smithi131 bash[24745]: cluster 2024-09-14T03:02:05.749739+0000 mgr.a (mgr.14355) 12159 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:07.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:06 smithi131 bash[24745]: audit 2024-09-14T03:02:06.660414+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:02:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:06 smithi171 bash[25040]: cluster 2024-09-14T03:02:05.749739+0000 mgr.a (mgr.14355) 12159 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:06 smithi171 bash[25040]: audit 2024-09-14T03:02:06.660414+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:02:07.627 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:07.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:07.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:07 smithi007 bash[22722]: audit 2024-09-14T03:02:07.512026+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:02:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:07 smithi007 bash[22722]: audit 2024-09-14T03:02:07.513297+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:02:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:07 smithi007 bash[22722]: audit 2024-09-14T03:02:07.519384+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:02:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:07 smithi007 bash[22722]: audit 2024-09-14T03:02:07.521491+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:07 smithi131 bash[24745]: audit 2024-09-14T03:02:07.512026+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:02:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:07 smithi131 bash[24745]: audit 2024-09-14T03:02:07.513297+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:02:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:07 smithi131 bash[24745]: audit 2024-09-14T03:02:07.519384+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:02:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:07 smithi131 bash[24745]: audit 2024-09-14T03:02:07.521491+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:07 smithi171 bash[25040]: audit 2024-09-14T03:02:07.512026+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:02:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:07 smithi171 bash[25040]: audit 2024-09-14T03:02:07.513297+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:02:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:07 smithi171 bash[25040]: audit 2024-09-14T03:02:07.519384+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:02:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:07 smithi171 bash[25040]: audit 2024-09-14T03:02:07.521491+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:08.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:02:08 smithi007 bash[22972]: debug 2024-09-14T03:02:08.319+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:02:08.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:02:08 smithi007 bash[22972]: debug 2024-09-14T03:02:08.319+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:02:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:08 smithi007 bash[22722]: audit 2024-09-14T03:02:07.200865+0000 mgr.a (mgr.14355) 12160 : audit [DBG] from='client.265797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:08 smithi007 bash[22722]: audit 2024-09-14T03:02:07.531712+0000 mgr.a (mgr.14355) 12161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:08 smithi007 bash[22722]: cluster 2024-09-14T03:02:07.750233+0000 mgr.a (mgr.14355) 12162 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:08 smithi131 bash[24745]: audit 2024-09-14T03:02:07.200865+0000 mgr.a (mgr.14355) 12160 : audit [DBG] from='client.265797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:08 smithi131 bash[24745]: audit 2024-09-14T03:02:07.531712+0000 mgr.a (mgr.14355) 12161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:08 smithi131 bash[24745]: cluster 2024-09-14T03:02:07.750233+0000 mgr.a (mgr.14355) 12162 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:08 smithi171 bash[25040]: audit 2024-09-14T03:02:07.200865+0000 mgr.a (mgr.14355) 12160 : audit [DBG] from='client.265797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:08 smithi171 bash[25040]: audit 2024-09-14T03:02:07.531712+0000 mgr.a (mgr.14355) 12161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:02:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:08 smithi171 bash[25040]: cluster 2024-09-14T03:02:07.750233+0000 mgr.a (mgr.14355) 12162 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:09 smithi007 bash[22722]: audit 2024-09-14T03:02:08.322544+0000 mgr.a (mgr.14355) 12163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:02:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:09 smithi007 bash[22722]: cephadm 2024-09-14T03:02:08.324003+0000 mgr.a (mgr.14355) 12164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:02:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:09 smithi131 bash[24745]: audit 2024-09-14T03:02:08.322544+0000 mgr.a (mgr.14355) 12163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:02:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:09 smithi131 bash[24745]: cephadm 2024-09-14T03:02:08.324003+0000 mgr.a (mgr.14355) 12164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:02:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:09 smithi171 bash[25040]: audit 2024-09-14T03:02:08.322544+0000 mgr.a (mgr.14355) 12163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:02:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:09 smithi171 bash[25040]: cephadm 2024-09-14T03:02:08.324003+0000 mgr.a (mgr.14355) 12164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:02:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:10 smithi007 bash[22722]: cluster 2024-09-14T03:02:09.751087+0000 mgr.a (mgr.14355) 12165 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:10 smithi131 bash[24745]: cluster 2024-09-14T03:02:09.751087+0000 mgr.a (mgr.14355) 12165 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:10 smithi171 bash[25040]: cluster 2024-09-14T03:02:09.751087+0000 mgr.a (mgr.14355) 12165 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:02:12.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:12.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:12.630 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:12 smithi007 bash[22722]: cluster 2024-09-14T03:02:11.753328+0000 mgr.a (mgr.14355) 12166 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:02:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:12 smithi131 bash[24745]: cluster 2024-09-14T03:02:11.753328+0000 mgr.a (mgr.14355) 12166 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:02:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:12 smithi171 bash[25040]: cluster 2024-09-14T03:02:11.753328+0000 mgr.a (mgr.14355) 12166 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:02:13.381 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:14 smithi007 bash[22722]: audit 2024-09-14T03:02:12.962376+0000 mgr.a (mgr.14355) 12167 : audit [DBG] from='client.265977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:14 smithi007 bash[22722]: cluster 2024-09-14T03:02:13.754275+0000 mgr.a (mgr.14355) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:02:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:14 smithi131 bash[24745]: audit 2024-09-14T03:02:12.962376+0000 mgr.a (mgr.14355) 12167 : audit [DBG] from='client.265977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:14 smithi131 bash[24745]: cluster 2024-09-14T03:02:13.754275+0000 mgr.a (mgr.14355) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:02:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:14 smithi171 bash[25040]: audit 2024-09-14T03:02:12.962376+0000 mgr.a (mgr.14355) 12167 : audit [DBG] from='client.265977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:14 smithi171 bash[25040]: cluster 2024-09-14T03:02:13.754275+0000 mgr.a (mgr.14355) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:02:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:16 smithi007 bash[22722]: cluster 2024-09-14T03:02:15.756496+0000 mgr.a (mgr.14355) 12169 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 426 B/s wr, 50 op/s 2024-09-14T03:02:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:16 smithi131 bash[24745]: cluster 2024-09-14T03:02:15.756496+0000 mgr.a (mgr.14355) 12169 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 426 B/s wr, 50 op/s 2024-09-14T03:02:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:16 smithi171 bash[25040]: cluster 2024-09-14T03:02:15.756496+0000 mgr.a (mgr.14355) 12169 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 426 B/s wr, 50 op/s 2024-09-14T03:02:18.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:18.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:19.125 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:19.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:18 smithi007 bash[22722]: cluster 2024-09-14T03:02:17.757296+0000 mgr.a (mgr.14355) 12170 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:18 smithi131 bash[24745]: cluster 2024-09-14T03:02:17.757296+0000 mgr.a (mgr.14355) 12170 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:18 smithi171 bash[25040]: cluster 2024-09-14T03:02:17.757296+0000 mgr.a (mgr.14355) 12170 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:19 smithi007 bash[22722]: audit 2024-09-14T03:02:18.712903+0000 mgr.a (mgr.14355) 12171 : audit [DBG] from='client.266055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:19 smithi131 bash[24745]: audit 2024-09-14T03:02:18.712903+0000 mgr.a (mgr.14355) 12171 : audit [DBG] from='client.266055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:19 smithi171 bash[25040]: audit 2024-09-14T03:02:18.712903+0000 mgr.a (mgr.14355) 12171 : audit [DBG] from='client.266055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:20 smithi007 bash[22722]: cluster 2024-09-14T03:02:19.758323+0000 mgr.a (mgr.14355) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:20 smithi131 bash[24745]: cluster 2024-09-14T03:02:19.758323+0000 mgr.a (mgr.14355) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:20 smithi171 bash[25040]: cluster 2024-09-14T03:02:19.758323+0000 mgr.a (mgr.14355) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 426 B/s wr, 49 op/s 2024-09-14T03:02:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:22 smithi007 bash[22722]: cluster 2024-09-14T03:02:21.760584+0000 mgr.a (mgr.14355) 12173 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T03:02:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:22 smithi131 bash[24745]: cluster 2024-09-14T03:02:21.760584+0000 mgr.a (mgr.14355) 12173 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T03:02:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:22 smithi171 bash[25040]: cluster 2024-09-14T03:02:21.760584+0000 mgr.a (mgr.14355) 12173 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T03:02:24.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:24.872 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:24.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:24 smithi007 bash[22722]: cluster 2024-09-14T03:02:23.761364+0000 mgr.a (mgr.14355) 12174 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:02:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:24 smithi131 bash[24745]: cluster 2024-09-14T03:02:23.761364+0000 mgr.a (mgr.14355) 12174 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:02:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:24 smithi171 bash[25040]: cluster 2024-09-14T03:02:23.761364+0000 mgr.a (mgr.14355) 12174 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:02:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:25 smithi007 bash[22722]: audit 2024-09-14T03:02:24.454651+0000 mgr.a (mgr.14355) 12175 : audit [DBG] from='client.266133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:25 smithi131 bash[24745]: audit 2024-09-14T03:02:24.454651+0000 mgr.a (mgr.14355) 12175 : audit [DBG] from='client.266133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:25 smithi171 bash[25040]: audit 2024-09-14T03:02:24.454651+0000 mgr.a (mgr.14355) 12175 : audit [DBG] from='client.266133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:26 smithi007 bash[22722]: cluster 2024-09-14T03:02:25.763747+0000 mgr.a (mgr.14355) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:02:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:26 smithi131 bash[24745]: cluster 2024-09-14T03:02:25.763747+0000 mgr.a (mgr.14355) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:02:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:26 smithi171 bash[25040]: cluster 2024-09-14T03:02:25.763747+0000 mgr.a (mgr.14355) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:02:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:28 smithi007 bash[22722]: cluster 2024-09-14T03:02:27.764534+0000 mgr.a (mgr.14355) 12177 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:28 smithi131 bash[24745]: cluster 2024-09-14T03:02:27.764534+0000 mgr.a (mgr.14355) 12177 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:28 smithi171 bash[25040]: cluster 2024-09-14T03:02:27.764534+0000 mgr.a (mgr.14355) 12177 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:29.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:29.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:29.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:30.654 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:30.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:30 smithi007 bash[22722]: cluster 2024-09-14T03:02:29.765310+0000 mgr.a (mgr.14355) 12178 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:30 smithi131 bash[24745]: cluster 2024-09-14T03:02:29.765310+0000 mgr.a (mgr.14355) 12178 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:30 smithi171 bash[25040]: cluster 2024-09-14T03:02:29.765310+0000 mgr.a (mgr.14355) 12178 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:31 smithi007 bash[22722]: audit 2024-09-14T03:02:30.207413+0000 mgr.a (mgr.14355) 12179 : audit [DBG] from='client.266211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:31 smithi131 bash[24745]: audit 2024-09-14T03:02:30.207413+0000 mgr.a (mgr.14355) 12179 : audit [DBG] from='client.266211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:31 smithi171 bash[25040]: audit 2024-09-14T03:02:30.207413+0000 mgr.a (mgr.14355) 12179 : audit [DBG] from='client.266211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:32 smithi007 bash[22722]: cluster 2024-09-14T03:02:31.768133+0000 mgr.a (mgr.14355) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:32 smithi131 bash[24745]: cluster 2024-09-14T03:02:31.768133+0000 mgr.a (mgr.14355) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:32 smithi171 bash[25040]: cluster 2024-09-14T03:02:31.768133+0000 mgr.a (mgr.14355) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-14T03:02:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:34 smithi007 bash[22722]: cluster 2024-09-14T03:02:33.768931+0000 mgr.a (mgr.14355) 12181 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:02:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:34 smithi131 bash[24745]: cluster 2024-09-14T03:02:33.768931+0000 mgr.a (mgr.14355) 12181 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:02:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:34 smithi171 bash[25040]: cluster 2024-09-14T03:02:33.768931+0000 mgr.a (mgr.14355) 12181 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:02:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:35.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:35.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:36.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:36 smithi007 bash[22722]: cluster 2024-09-14T03:02:35.769950+0000 mgr.a (mgr.14355) 12182 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:36 smithi131 bash[24745]: cluster 2024-09-14T03:02:35.769950+0000 mgr.a (mgr.14355) 12182 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:36 smithi171 bash[25040]: cluster 2024-09-14T03:02:35.769950+0000 mgr.a (mgr.14355) 12182 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:37 smithi131 bash[24745]: audit 2024-09-14T03:02:35.983944+0000 mgr.a (mgr.14355) 12183 : audit [DBG] from='client.266289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:37 smithi171 bash[25040]: audit 2024-09-14T03:02:35.983944+0000 mgr.a (mgr.14355) 12183 : audit [DBG] from='client.266289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:37 smithi007 bash[22722]: audit 2024-09-14T03:02:35.983944+0000 mgr.a (mgr.14355) 12183 : audit [DBG] from='client.266289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:38 smithi131 bash[24745]: cluster 2024-09-14T03:02:37.770767+0000 mgr.a (mgr.14355) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:38 smithi171 bash[25040]: cluster 2024-09-14T03:02:37.770767+0000 mgr.a (mgr.14355) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:38 smithi007 bash[22722]: cluster 2024-09-14T03:02:37.770767+0000 mgr.a (mgr.14355) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:40 smithi131 bash[24745]: cluster 2024-09-14T03:02:39.771558+0000 mgr.a (mgr.14355) 12185 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:40 smithi171 bash[25040]: cluster 2024-09-14T03:02:39.771558+0000 mgr.a (mgr.14355) 12185 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:40 smithi007 bash[22722]: cluster 2024-09-14T03:02:39.771558+0000 mgr.a (mgr.14355) 12185 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:02:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:42.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:42.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:42 smithi007 bash[22722]: audit 2024-09-14T03:02:41.745818+0000 mgr.a (mgr.14355) 12186 : audit [DBG] from='client.266364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:42 smithi007 bash[22722]: cluster 2024-09-14T03:02:41.773258+0000 mgr.a (mgr.14355) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:42 smithi131 bash[24745]: audit 2024-09-14T03:02:41.745818+0000 mgr.a (mgr.14355) 12186 : audit [DBG] from='client.266364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:42 smithi131 bash[24745]: cluster 2024-09-14T03:02:41.773258+0000 mgr.a (mgr.14355) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:42 smithi171 bash[25040]: audit 2024-09-14T03:02:41.745818+0000 mgr.a (mgr.14355) 12186 : audit [DBG] from='client.266364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:42 smithi171 bash[25040]: cluster 2024-09-14T03:02:41.773258+0000 mgr.a (mgr.14355) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:44 smithi007 bash[22722]: cluster 2024-09-14T03:02:43.774109+0000 mgr.a (mgr.14355) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:02:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:44 smithi131 bash[24745]: cluster 2024-09-14T03:02:43.774109+0000 mgr.a (mgr.14355) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:02:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:44 smithi171 bash[25040]: cluster 2024-09-14T03:02:43.774109+0000 mgr.a (mgr.14355) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:02:47.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:47.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:46 smithi007 bash[22722]: cluster 2024-09-14T03:02:45.776255+0000 mgr.a (mgr.14355) 12189 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:46 smithi131 bash[24745]: cluster 2024-09-14T03:02:45.776255+0000 mgr.a (mgr.14355) 12189 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:46 smithi171 bash[25040]: cluster 2024-09-14T03:02:45.776255+0000 mgr.a (mgr.14355) 12189 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:47.962 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:47.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:47.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:47.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:47.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:48 smithi007 bash[22722]: audit 2024-09-14T03:02:47.528436+0000 mgr.a (mgr.14355) 12190 : audit [DBG] from='client.266442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:48 smithi007 bash[22722]: cluster 2024-09-14T03:02:47.776811+0000 mgr.a (mgr.14355) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:48 smithi131 bash[24745]: audit 2024-09-14T03:02:47.528436+0000 mgr.a (mgr.14355) 12190 : audit [DBG] from='client.266442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:48 smithi131 bash[24745]: cluster 2024-09-14T03:02:47.776811+0000 mgr.a (mgr.14355) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:48 smithi171 bash[25040]: audit 2024-09-14T03:02:47.528436+0000 mgr.a (mgr.14355) 12190 : audit [DBG] from='client.266442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:48 smithi171 bash[25040]: cluster 2024-09-14T03:02:47.776811+0000 mgr.a (mgr.14355) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:50 smithi007 bash[22722]: cluster 2024-09-14T03:02:49.777672+0000 mgr.a (mgr.14355) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:50 smithi131 bash[24745]: cluster 2024-09-14T03:02:49.777672+0000 mgr.a (mgr.14355) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:50 smithi171 bash[25040]: cluster 2024-09-14T03:02:49.777672+0000 mgr.a (mgr.14355) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:52 smithi007 bash[22722]: cluster 2024-09-14T03:02:51.779975+0000 mgr.a (mgr.14355) 12193 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:52 smithi131 bash[24745]: cluster 2024-09-14T03:02:51.779975+0000 mgr.a (mgr.14355) 12193 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:52 smithi171 bash[25040]: cluster 2024-09-14T03:02:51.779975+0000 mgr.a (mgr.14355) 12193 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:53.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:53.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:53.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:02:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:54 smithi007 bash[22722]: audit 2024-09-14T03:02:53.297355+0000 mgr.a (mgr.14355) 12194 : audit [DBG] from='client.266520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:54 smithi007 bash[22722]: cluster 2024-09-14T03:02:53.780647+0000 mgr.a (mgr.14355) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:54 smithi131 bash[24745]: audit 2024-09-14T03:02:53.297355+0000 mgr.a (mgr.14355) 12194 : audit [DBG] from='client.266520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:54 smithi131 bash[24745]: cluster 2024-09-14T03:02:53.780647+0000 mgr.a (mgr.14355) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:54 smithi171 bash[25040]: audit 2024-09-14T03:02:53.297355+0000 mgr.a (mgr.14355) 12194 : audit [DBG] from='client.266520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:02:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:54 smithi171 bash[25040]: cluster 2024-09-14T03:02:53.780647+0000 mgr.a (mgr.14355) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:56 smithi007 bash[22722]: cluster 2024-09-14T03:02:55.782790+0000 mgr.a (mgr.14355) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:56 smithi131 bash[24745]: cluster 2024-09-14T03:02:55.782790+0000 mgr.a (mgr.14355) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:56 smithi171 bash[25040]: cluster 2024-09-14T03:02:55.782790+0000 mgr.a (mgr.14355) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:02:58.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:02:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:02:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:02:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:02:58 smithi007 bash[22722]: cluster 2024-09-14T03:02:57.783560+0000 mgr.a (mgr.14355) 12197 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:02:58 smithi131 bash[24745]: cluster 2024-09-14T03:02:57.783560+0000 mgr.a (mgr.14355) 12197 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:02:58 smithi171 bash[25040]: cluster 2024-09-14T03:02:57.783560+0000 mgr.a (mgr.14355) 12197 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:02:59.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:02:59.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:02:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:02:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:02:59.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:00 smithi007 bash[22722]: audit 2024-09-14T03:02:59.085434+0000 mgr.a (mgr.14355) 12198 : audit [DBG] from='client.266598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:00 smithi007 bash[22722]: cluster 2024-09-14T03:02:59.784552+0000 mgr.a (mgr.14355) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:00 smithi131 bash[24745]: audit 2024-09-14T03:02:59.085434+0000 mgr.a (mgr.14355) 12198 : audit [DBG] from='client.266598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:00 smithi131 bash[24745]: cluster 2024-09-14T03:02:59.784552+0000 mgr.a (mgr.14355) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:00 smithi171 bash[25040]: audit 2024-09-14T03:02:59.085434+0000 mgr.a (mgr.14355) 12198 : audit [DBG] from='client.266598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:00 smithi171 bash[25040]: cluster 2024-09-14T03:02:59.784552+0000 mgr.a (mgr.14355) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:02 smithi007 bash[22722]: cluster 2024-09-14T03:03:01.786871+0000 mgr.a (mgr.14355) 12200 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:02 smithi131 bash[24745]: cluster 2024-09-14T03:03:01.786871+0000 mgr.a (mgr.14355) 12200 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:02 smithi171 bash[25040]: cluster 2024-09-14T03:03:01.786871+0000 mgr.a (mgr.14355) 12200 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:04.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:04 smithi007 bash[22722]: cluster 2024-09-14T03:03:03.787668+0000 mgr.a (mgr.14355) 12201 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:04 smithi131 bash[24745]: cluster 2024-09-14T03:03:03.787668+0000 mgr.a (mgr.14355) 12201 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:04 smithi171 bash[25040]: cluster 2024-09-14T03:03:03.787668+0000 mgr.a (mgr.14355) 12201 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:05.320 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:05 smithi007 bash[22722]: audit 2024-09-14T03:03:04.877425+0000 mgr.a (mgr.14355) 12202 : audit [DBG] from='client.266673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:05 smithi131 bash[24745]: audit 2024-09-14T03:03:04.877425+0000 mgr.a (mgr.14355) 12202 : audit [DBG] from='client.266673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:05 smithi171 bash[25040]: audit 2024-09-14T03:03:04.877425+0000 mgr.a (mgr.14355) 12202 : audit [DBG] from='client.266673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:06 smithi007 bash[22722]: cluster 2024-09-14T03:03:05.790144+0000 mgr.a (mgr.14355) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:06 smithi131 bash[24745]: cluster 2024-09-14T03:03:05.790144+0000 mgr.a (mgr.14355) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:06 smithi171 bash[25040]: cluster 2024-09-14T03:03:05.790144+0000 mgr.a (mgr.14355) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:08 smithi007 bash[22722]: cluster 2024-09-14T03:03:07.790943+0000 mgr.a (mgr.14355) 12204 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:08 smithi007 bash[22722]: audit 2024-09-14T03:03:08.374514+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:03:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:08 smithi131 bash[24745]: cluster 2024-09-14T03:03:07.790943+0000 mgr.a (mgr.14355) 12204 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:08 smithi131 bash[24745]: audit 2024-09-14T03:03:08.374514+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:03:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:08 smithi171 bash[25040]: cluster 2024-09-14T03:03:07.790943+0000 mgr.a (mgr.14355) 12204 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:08 smithi171 bash[25040]: audit 2024-09-14T03:03:08.374514+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:03:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22972]: debug 2024-09-14T03:03:09.934+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:03:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22972]: debug 2024-09-14T03:03:09.934+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:03:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22722]: audit 2024-09-14T03:03:09.186549+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:03:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22722]: audit 2024-09-14T03:03:09.188075+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:03:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22722]: audit 2024-09-14T03:03:09.198048+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:03:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:09 smithi007 bash[22722]: audit 2024-09-14T03:03:09.203231+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:09 smithi131 bash[24745]: audit 2024-09-14T03:03:09.186549+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:03:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:09 smithi131 bash[24745]: audit 2024-09-14T03:03:09.188075+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:03:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:09 smithi131 bash[24745]: audit 2024-09-14T03:03:09.198048+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:03:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:09 smithi131 bash[24745]: audit 2024-09-14T03:03:09.203231+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:09 smithi171 bash[25040]: audit 2024-09-14T03:03:09.186549+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:03:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:09 smithi171 bash[25040]: audit 2024-09-14T03:03:09.188075+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:03:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:09 smithi171 bash[25040]: audit 2024-09-14T03:03:09.198048+0000 mon.a (mon.0) 2421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:03:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:09 smithi171 bash[25040]: audit 2024-09-14T03:03:09.203231+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:10.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:11.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:11.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:11.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:11.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:11.058 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:10 smithi007 bash[22722]: audit 2024-09-14T03:03:09.205468+0000 mgr.a (mgr.14355) 12205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:10 smithi007 bash[22722]: cluster 2024-09-14T03:03:09.791450+0000 mgr.a (mgr.14355) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:10 smithi007 bash[22722]: audit 2024-09-14T03:03:09.939016+0000 mgr.a (mgr.14355) 12207 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:03:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:10 smithi007 bash[22722]: cephadm 2024-09-14T03:03:09.940346+0000 mgr.a (mgr.14355) 12208 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:03:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:10 smithi131 bash[24745]: audit 2024-09-14T03:03:09.205468+0000 mgr.a (mgr.14355) 12205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:10 smithi131 bash[24745]: cluster 2024-09-14T03:03:09.791450+0000 mgr.a (mgr.14355) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:10 smithi131 bash[24745]: audit 2024-09-14T03:03:09.939016+0000 mgr.a (mgr.14355) 12207 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:03:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:10 smithi131 bash[24745]: cephadm 2024-09-14T03:03:09.940346+0000 mgr.a (mgr.14355) 12208 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:03:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:10 smithi171 bash[25040]: audit 2024-09-14T03:03:09.205468+0000 mgr.a (mgr.14355) 12205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:03:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:10 smithi171 bash[25040]: cluster 2024-09-14T03:03:09.791450+0000 mgr.a (mgr.14355) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:10 smithi171 bash[25040]: audit 2024-09-14T03:03:09.939016+0000 mgr.a (mgr.14355) 12207 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:03:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:10 smithi171 bash[25040]: cephadm 2024-09-14T03:03:09.940346+0000 mgr.a (mgr.14355) 12208 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:03:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:11 smithi007 bash[22722]: audit 2024-09-14T03:03:10.645263+0000 mgr.a (mgr.14355) 12209 : audit [DBG] from='client.266856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:11 smithi131 bash[24745]: audit 2024-09-14T03:03:10.645263+0000 mgr.a (mgr.14355) 12209 : audit [DBG] from='client.266856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:11 smithi171 bash[25040]: audit 2024-09-14T03:03:10.645263+0000 mgr.a (mgr.14355) 12209 : audit [DBG] from='client.266856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:12 smithi007 bash[22722]: cluster 2024-09-14T03:03:11.794285+0000 mgr.a (mgr.14355) 12210 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:12 smithi131 bash[24745]: cluster 2024-09-14T03:03:11.794285+0000 mgr.a (mgr.14355) 12210 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:12 smithi171 bash[25040]: cluster 2024-09-14T03:03:11.794285+0000 mgr.a (mgr.14355) 12210 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:14 smithi007 bash[22722]: cluster 2024-09-14T03:03:13.795046+0000 mgr.a (mgr.14355) 12211 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:14 smithi131 bash[24745]: cluster 2024-09-14T03:03:13.795046+0000 mgr.a (mgr.14355) 12211 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:14 smithi171 bash[25040]: cluster 2024-09-14T03:03:13.795046+0000 mgr.a (mgr.14355) 12211 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:16.811 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:16.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:16 smithi007 bash[22722]: cluster 2024-09-14T03:03:15.797065+0000 mgr.a (mgr.14355) 12212 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:16 smithi131 bash[24745]: cluster 2024-09-14T03:03:15.797065+0000 mgr.a (mgr.14355) 12212 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:16 smithi171 bash[25040]: cluster 2024-09-14T03:03:15.797065+0000 mgr.a (mgr.14355) 12212 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:17 smithi007 bash[22722]: audit 2024-09-14T03:03:16.388402+0000 mgr.a (mgr.14355) 12213 : audit [DBG] from='client.266931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:17 smithi131 bash[24745]: audit 2024-09-14T03:03:16.388402+0000 mgr.a (mgr.14355) 12213 : audit [DBG] from='client.266931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:17 smithi171 bash[25040]: audit 2024-09-14T03:03:16.388402+0000 mgr.a (mgr.14355) 12213 : audit [DBG] from='client.266931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:18 smithi007 bash[22722]: cluster 2024-09-14T03:03:17.797892+0000 mgr.a (mgr.14355) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:18 smithi131 bash[24745]: cluster 2024-09-14T03:03:17.797892+0000 mgr.a (mgr.14355) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:18 smithi171 bash[25040]: cluster 2024-09-14T03:03:17.797892+0000 mgr.a (mgr.14355) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:20 smithi007 bash[22722]: cluster 2024-09-14T03:03:19.798710+0000 mgr.a (mgr.14355) 12215 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:20 smithi131 bash[24745]: cluster 2024-09-14T03:03:19.798710+0000 mgr.a (mgr.14355) 12215 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:20 smithi171 bash[25040]: cluster 2024-09-14T03:03:19.798710+0000 mgr.a (mgr.14355) 12215 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:03:21.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:21.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:21.812 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:22.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:22.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:22.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:22.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:22.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:22 smithi007 bash[22722]: cluster 2024-09-14T03:03:21.800954+0000 mgr.a (mgr.14355) 12216 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:22 smithi131 bash[24745]: cluster 2024-09-14T03:03:21.800954+0000 mgr.a (mgr.14355) 12216 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:22 smithi171 bash[25040]: cluster 2024-09-14T03:03:21.800954+0000 mgr.a (mgr.14355) 12216 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:03:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:23 smithi007 bash[22722]: audit 2024-09-14T03:03:22.143105+0000 mgr.a (mgr.14355) 12217 : audit [DBG] from='client.267009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:23 smithi131 bash[24745]: audit 2024-09-14T03:03:22.143105+0000 mgr.a (mgr.14355) 12217 : audit [DBG] from='client.267009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:23 smithi171 bash[25040]: audit 2024-09-14T03:03:22.143105+0000 mgr.a (mgr.14355) 12217 : audit [DBG] from='client.267009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:24 smithi007 bash[22722]: cluster 2024-09-14T03:03:23.801854+0000 mgr.a (mgr.14355) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:24 smithi131 bash[24745]: cluster 2024-09-14T03:03:23.801854+0000 mgr.a (mgr.14355) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:24 smithi171 bash[25040]: cluster 2024-09-14T03:03:23.801854+0000 mgr.a (mgr.14355) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:26 smithi131 bash[24745]: cluster 2024-09-14T03:03:25.804057+0000 mgr.a (mgr.14355) 12219 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:26 smithi171 bash[25040]: cluster 2024-09-14T03:03:25.804057+0000 mgr.a (mgr.14355) 12219 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:26 smithi007 bash[22722]: cluster 2024-09-14T03:03:25.804057+0000 mgr.a (mgr.14355) 12219 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:27.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:27.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:27.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:28.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:28.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:28.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:28 smithi131 bash[24745]: cluster 2024-09-14T03:03:27.804745+0000 mgr.a (mgr.14355) 12220 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:28 smithi131 bash[24745]: audit 2024-09-14T03:03:27.871007+0000 mgr.a (mgr.14355) 12221 : audit [DBG] from='client.267087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:28 smithi171 bash[25040]: cluster 2024-09-14T03:03:27.804745+0000 mgr.a (mgr.14355) 12220 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:28 smithi171 bash[25040]: audit 2024-09-14T03:03:27.871007+0000 mgr.a (mgr.14355) 12221 : audit [DBG] from='client.267087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:28 smithi007 bash[22722]: cluster 2024-09-14T03:03:27.804745+0000 mgr.a (mgr.14355) 12220 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:28 smithi007 bash[22722]: audit 2024-09-14T03:03:27.871007+0000 mgr.a (mgr.14355) 12221 : audit [DBG] from='client.267087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:30 smithi131 bash[24745]: cluster 2024-09-14T03:03:29.805629+0000 mgr.a (mgr.14355) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:30 smithi171 bash[25040]: cluster 2024-09-14T03:03:29.805629+0000 mgr.a (mgr.14355) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:30 smithi007 bash[22722]: cluster 2024-09-14T03:03:29.805629+0000 mgr.a (mgr.14355) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:32 smithi131 bash[24745]: cluster 2024-09-14T03:03:31.807913+0000 mgr.a (mgr.14355) 12223 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:33.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:33.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:33.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:32 smithi171 bash[25040]: cluster 2024-09-14T03:03:31.807913+0000 mgr.a (mgr.14355) 12223 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:32 smithi007 bash[22722]: cluster 2024-09-14T03:03:31.807913+0000 mgr.a (mgr.14355) 12223 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:34.080 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:34.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:34 smithi131 bash[24745]: audit 2024-09-14T03:03:33.634438+0000 mgr.a (mgr.14355) 12224 : audit [DBG] from='client.267165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:34 smithi131 bash[24745]: cluster 2024-09-14T03:03:33.808529+0000 mgr.a (mgr.14355) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:34 smithi171 bash[25040]: audit 2024-09-14T03:03:33.634438+0000 mgr.a (mgr.14355) 12224 : audit [DBG] from='client.267165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:34 smithi171 bash[25040]: cluster 2024-09-14T03:03:33.808529+0000 mgr.a (mgr.14355) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:34 smithi007 bash[22722]: audit 2024-09-14T03:03:33.634438+0000 mgr.a (mgr.14355) 12224 : audit [DBG] from='client.267165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:34 smithi007 bash[22722]: cluster 2024-09-14T03:03:33.808529+0000 mgr.a (mgr.14355) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:36 smithi131 bash[24745]: cluster 2024-09-14T03:03:35.810811+0000 mgr.a (mgr.14355) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:36 smithi171 bash[25040]: cluster 2024-09-14T03:03:35.810811+0000 mgr.a (mgr.14355) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:36 smithi007 bash[22722]: cluster 2024-09-14T03:03:35.810811+0000 mgr.a (mgr.14355) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:39.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:38 smithi131 bash[24745]: cluster 2024-09-14T03:03:37.811569+0000 mgr.a (mgr.14355) 12227 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:38 smithi171 bash[25040]: cluster 2024-09-14T03:03:37.811569+0000 mgr.a (mgr.14355) 12227 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:38 smithi007 bash[22722]: cluster 2024-09-14T03:03:37.811569+0000 mgr.a (mgr.14355) 12227 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:39.830 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:39.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:39 smithi131 bash[24745]: audit 2024-09-14T03:03:39.411842+0000 mgr.a (mgr.14355) 12228 : audit [DBG] from='client.267243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:39 smithi131 bash[24745]: cluster 2024-09-14T03:03:39.812049+0000 mgr.a (mgr.14355) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:39 smithi171 bash[25040]: audit 2024-09-14T03:03:39.411842+0000 mgr.a (mgr.14355) 12228 : audit [DBG] from='client.267243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:39 smithi171 bash[25040]: cluster 2024-09-14T03:03:39.812049+0000 mgr.a (mgr.14355) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:39 smithi007 bash[22722]: audit 2024-09-14T03:03:39.411842+0000 mgr.a (mgr.14355) 12228 : audit [DBG] from='client.267243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:39 smithi007 bash[22722]: cluster 2024-09-14T03:03:39.812049+0000 mgr.a (mgr.14355) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:42 smithi007 bash[22722]: cluster 2024-09-14T03:03:41.814196+0000 mgr.a (mgr.14355) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:42 smithi131 bash[24745]: cluster 2024-09-14T03:03:41.814196+0000 mgr.a (mgr.14355) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:42 smithi171 bash[25040]: cluster 2024-09-14T03:03:41.814196+0000 mgr.a (mgr.14355) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:03:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:44 smithi007 bash[22722]: cluster 2024-09-14T03:03:43.814952+0000 mgr.a (mgr.14355) 12231 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:44 smithi131 bash[24745]: cluster 2024-09-14T03:03:43.814952+0000 mgr.a (mgr.14355) 12231 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:44 smithi171 bash[25040]: cluster 2024-09-14T03:03:43.814952+0000 mgr.a (mgr.14355) 12231 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:45.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:46 smithi007 bash[22722]: audit 2024-09-14T03:03:45.157341+0000 mgr.a (mgr.14355) 12232 : audit [DBG] from='client.267321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:46 smithi007 bash[22722]: cluster 2024-09-14T03:03:45.817366+0000 mgr.a (mgr.14355) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T03:03:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:46 smithi131 bash[24745]: audit 2024-09-14T03:03:45.157341+0000 mgr.a (mgr.14355) 12232 : audit [DBG] from='client.267321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:46 smithi131 bash[24745]: cluster 2024-09-14T03:03:45.817366+0000 mgr.a (mgr.14355) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T03:03:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:46 smithi171 bash[25040]: audit 2024-09-14T03:03:45.157341+0000 mgr.a (mgr.14355) 12232 : audit [DBG] from='client.267321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:46 smithi171 bash[25040]: cluster 2024-09-14T03:03:45.817366+0000 mgr.a (mgr.14355) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T03:03:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:48 smithi007 bash[22722]: cluster 2024-09-14T03:03:47.818177+0000 mgr.a (mgr.14355) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:48 smithi131 bash[24745]: cluster 2024-09-14T03:03:47.818177+0000 mgr.a (mgr.14355) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:48 smithi171 bash[25040]: cluster 2024-09-14T03:03:47.818177+0000 mgr.a (mgr.14355) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:50.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:50.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:50.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:50 smithi007 bash[22722]: cluster 2024-09-14T03:03:49.818924+0000 mgr.a (mgr.14355) 12235 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:50 smithi131 bash[24745]: cluster 2024-09-14T03:03:49.818924+0000 mgr.a (mgr.14355) 12235 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:50 smithi171 bash[25040]: cluster 2024-09-14T03:03:49.818924+0000 mgr.a (mgr.14355) 12235 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:03:51.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:51.350 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:51 smithi007 bash[22722]: audit 2024-09-14T03:03:50.906856+0000 mgr.a (mgr.14355) 12236 : audit [DBG] from='client.267399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:51 smithi131 bash[24745]: audit 2024-09-14T03:03:50.906856+0000 mgr.a (mgr.14355) 12236 : audit [DBG] from='client.267399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:51 smithi171 bash[25040]: audit 2024-09-14T03:03:50.906856+0000 mgr.a (mgr.14355) 12236 : audit [DBG] from='client.267399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:52 smithi007 bash[22722]: cluster 2024-09-14T03:03:51.821665+0000 mgr.a (mgr.14355) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:52 smithi131 bash[24745]: cluster 2024-09-14T03:03:51.821665+0000 mgr.a (mgr.14355) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:52 smithi171 bash[25040]: cluster 2024-09-14T03:03:51.821665+0000 mgr.a (mgr.14355) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:54 smithi007 bash[22722]: cluster 2024-09-14T03:03:53.822469+0000 mgr.a (mgr.14355) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:03:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:54 smithi131 bash[24745]: cluster 2024-09-14T03:03:53.822469+0000 mgr.a (mgr.14355) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:03:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:54 smithi171 bash[25040]: cluster 2024-09-14T03:03:53.822469+0000 mgr.a (mgr.14355) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:03:56.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:03:56.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:03:56.352 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:03:57.107 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:03:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:03:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:03:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:03:57.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:03:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:56 smithi007 bash[22722]: cluster 2024-09-14T03:03:55.824373+0000 mgr.a (mgr.14355) 12239 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:56 smithi131 bash[24745]: cluster 2024-09-14T03:03:55.824373+0000 mgr.a (mgr.14355) 12239 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:56 smithi171 bash[25040]: cluster 2024-09-14T03:03:55.824373+0000 mgr.a (mgr.14355) 12239 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:03:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:57 smithi007 bash[22722]: audit 2024-09-14T03:03:56.686085+0000 mgr.a (mgr.14355) 12240 : audit [DBG] from='client.267477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:57 smithi131 bash[24745]: audit 2024-09-14T03:03:56.686085+0000 mgr.a (mgr.14355) 12240 : audit [DBG] from='client.267477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:57 smithi171 bash[25040]: audit 2024-09-14T03:03:56.686085+0000 mgr.a (mgr.14355) 12240 : audit [DBG] from='client.267477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:03:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:03:58 smithi007 bash[22722]: cluster 2024-09-14T03:03:57.825249+0000 mgr.a (mgr.14355) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:03:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:03:58 smithi131 bash[24745]: cluster 2024-09-14T03:03:57.825249+0000 mgr.a (mgr.14355) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:03:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:03:58 smithi171 bash[25040]: cluster 2024-09-14T03:03:57.825249+0000 mgr.a (mgr.14355) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:04:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:00 smithi007 bash[22722]: cluster 2024-09-14T03:03:59.826061+0000 mgr.a (mgr.14355) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:04:01.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:00 smithi131 bash[24745]: cluster 2024-09-14T03:03:59.826061+0000 mgr.a (mgr.14355) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:04:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:00 smithi171 bash[25040]: cluster 2024-09-14T03:03:59.826061+0000 mgr.a (mgr.14355) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:04:02.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:02.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:02.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:02.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:02.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:02.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:02.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:02.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:02 smithi007 bash[22722]: cluster 2024-09-14T03:04:01.828318+0000 mgr.a (mgr.14355) 12243 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:02 smithi131 bash[24745]: cluster 2024-09-14T03:04:01.828318+0000 mgr.a (mgr.14355) 12243 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:02 smithi171 bash[25040]: cluster 2024-09-14T03:04:01.828318+0000 mgr.a (mgr.14355) 12243 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:03 smithi007 bash[22722]: audit 2024-09-14T03:04:02.438192+0000 mgr.a (mgr.14355) 12244 : audit [DBG] from='client.267552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:03 smithi131 bash[24745]: audit 2024-09-14T03:04:02.438192+0000 mgr.a (mgr.14355) 12244 : audit [DBG] from='client.267552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:03 smithi171 bash[25040]: audit 2024-09-14T03:04:02.438192+0000 mgr.a (mgr.14355) 12244 : audit [DBG] from='client.267552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:04 smithi007 bash[22722]: cluster 2024-09-14T03:04:03.829233+0000 mgr.a (mgr.14355) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:04 smithi131 bash[24745]: cluster 2024-09-14T03:04:03.829233+0000 mgr.a (mgr.14355) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:04 smithi171 bash[25040]: cluster 2024-09-14T03:04:03.829233+0000 mgr.a (mgr.14355) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:06 smithi007 bash[22722]: cluster 2024-09-14T03:04:05.831415+0000 mgr.a (mgr.14355) 12246 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:06 smithi131 bash[24745]: cluster 2024-09-14T03:04:05.831415+0000 mgr.a (mgr.14355) 12246 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:06 smithi171 bash[25040]: cluster 2024-09-14T03:04:05.831415+0000 mgr.a (mgr.14355) 12246 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:07.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:07.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:08.612 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:08 smithi007 bash[22722]: cluster 2024-09-14T03:04:07.832231+0000 mgr.a (mgr.14355) 12247 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:08 smithi131 bash[24745]: cluster 2024-09-14T03:04:07.832231+0000 mgr.a (mgr.14355) 12247 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:08 smithi171 bash[25040]: cluster 2024-09-14T03:04:07.832231+0000 mgr.a (mgr.14355) 12247 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:09 smithi007 bash[22722]: audit 2024-09-14T03:04:08.185370+0000 mgr.a (mgr.14355) 12248 : audit [DBG] from='client.267630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:09 smithi131 bash[24745]: audit 2024-09-14T03:04:08.185370+0000 mgr.a (mgr.14355) 12248 : audit [DBG] from='client.267630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:09 smithi171 bash[25040]: audit 2024-09-14T03:04:08.185370+0000 mgr.a (mgr.14355) 12248 : audit [DBG] from='client.267630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: cluster 2024-09-14T03:04:09.833108+0000 mgr.a (mgr.14355) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: audit 2024-09-14T03:04:09.993220+0000 mon.a (mon.0) 2423 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:04:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: audit 2024-09-14T03:04:10.821914+0000 mon.a (mon.0) 2424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:04:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: audit 2024-09-14T03:04:10.823675+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:04:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: audit 2024-09-14T03:04:10.834745+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:04:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:10 smithi131 bash[24745]: audit 2024-09-14T03:04:10.837607+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: cluster 2024-09-14T03:04:09.833108+0000 mgr.a (mgr.14355) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: audit 2024-09-14T03:04:09.993220+0000 mon.a (mon.0) 2423 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:04:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: audit 2024-09-14T03:04:10.821914+0000 mon.a (mon.0) 2424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:04:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: audit 2024-09-14T03:04:10.823675+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:04:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: audit 2024-09-14T03:04:10.834745+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:04:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:10 smithi171 bash[25040]: audit 2024-09-14T03:04:10.837607+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: cluster 2024-09-14T03:04:09.833108+0000 mgr.a (mgr.14355) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: audit 2024-09-14T03:04:09.993220+0000 mon.a (mon.0) 2423 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: audit 2024-09-14T03:04:10.821914+0000 mon.a (mon.0) 2424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: audit 2024-09-14T03:04:10.823675+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: audit 2024-09-14T03:04:10.834745+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:04:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:10 smithi007 bash[22722]: audit 2024-09-14T03:04:10.837607+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:11.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:04:11 smithi007 bash[22972]: debug 2024-09-14T03:04:11.565+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:04:11.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:04:11 smithi007 bash[22972]: debug 2024-09-14T03:04:11.565+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:04:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:11 smithi131 bash[24745]: audit 2024-09-14T03:04:10.839970+0000 mgr.a (mgr.14355) 12250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:11 smithi171 bash[25040]: audit 2024-09-14T03:04:10.839970+0000 mgr.a (mgr.14355) 12250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:11 smithi007 bash[22722]: audit 2024-09-14T03:04:10.839970+0000 mgr.a (mgr.14355) 12250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:04:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:12 smithi131 bash[24745]: audit 2024-09-14T03:04:11.568636+0000 mgr.a (mgr.14355) 12251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:04:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:12 smithi131 bash[24745]: cephadm 2024-09-14T03:04:11.569897+0000 mgr.a (mgr.14355) 12252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:04:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:12 smithi131 bash[24745]: cluster 2024-09-14T03:04:11.835777+0000 mgr.a (mgr.14355) 12253 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:12 smithi171 bash[25040]: audit 2024-09-14T03:04:11.568636+0000 mgr.a (mgr.14355) 12251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:04:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:12 smithi171 bash[25040]: cephadm 2024-09-14T03:04:11.569897+0000 mgr.a (mgr.14355) 12252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:04:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:12 smithi171 bash[25040]: cluster 2024-09-14T03:04:11.835777+0000 mgr.a (mgr.14355) 12253 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:12 smithi007 bash[22722]: audit 2024-09-14T03:04:11.568636+0000 mgr.a (mgr.14355) 12251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:04:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:12 smithi007 bash[22722]: cephadm 2024-09-14T03:04:11.569897+0000 mgr.a (mgr.14355) 12252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:04:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:12 smithi007 bash[22722]: cluster 2024-09-14T03:04:11.835777+0000 mgr.a (mgr.14355) 12253 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:13.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:13.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:13.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:14.388 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:14 smithi131 bash[24745]: cluster 2024-09-14T03:04:13.836544+0000 mgr.a (mgr.14355) 12254 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:14 smithi131 bash[24745]: audit 2024-09-14T03:04:13.950579+0000 mgr.a (mgr.14355) 12255 : audit [DBG] from='client.267816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:14 smithi171 bash[25040]: cluster 2024-09-14T03:04:13.836544+0000 mgr.a (mgr.14355) 12254 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:14 smithi171 bash[25040]: audit 2024-09-14T03:04:13.950579+0000 mgr.a (mgr.14355) 12255 : audit [DBG] from='client.267816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:14 smithi007 bash[22722]: cluster 2024-09-14T03:04:13.836544+0000 mgr.a (mgr.14355) 12254 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:14 smithi007 bash[22722]: audit 2024-09-14T03:04:13.950579+0000 mgr.a (mgr.14355) 12255 : audit [DBG] from='client.267816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:16 smithi131 bash[24745]: cluster 2024-09-14T03:04:15.838827+0000 mgr.a (mgr.14355) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:16 smithi171 bash[25040]: cluster 2024-09-14T03:04:15.838827+0000 mgr.a (mgr.14355) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:16 smithi007 bash[22722]: cluster 2024-09-14T03:04:15.838827+0000 mgr.a (mgr.14355) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:18 smithi131 bash[24745]: cluster 2024-09-14T03:04:17.839791+0000 mgr.a (mgr.14355) 12257 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:18 smithi171 bash[25040]: cluster 2024-09-14T03:04:17.839791+0000 mgr.a (mgr.14355) 12257 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:19.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:19.390 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:18 smithi007 bash[22722]: cluster 2024-09-14T03:04:17.839791+0000 mgr.a (mgr.14355) 12257 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:20.136 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:20 smithi131 bash[24745]: audit 2024-09-14T03:04:19.723737+0000 mgr.a (mgr.14355) 12258 : audit [DBG] from='client.267894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:20 smithi131 bash[24745]: cluster 2024-09-14T03:04:19.840432+0000 mgr.a (mgr.14355) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:20 smithi171 bash[25040]: audit 2024-09-14T03:04:19.723737+0000 mgr.a (mgr.14355) 12258 : audit [DBG] from='client.267894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:20 smithi171 bash[25040]: cluster 2024-09-14T03:04:19.840432+0000 mgr.a (mgr.14355) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:20 smithi007 bash[22722]: audit 2024-09-14T03:04:19.723737+0000 mgr.a (mgr.14355) 12258 : audit [DBG] from='client.267894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:20 smithi007 bash[22722]: cluster 2024-09-14T03:04:19.840432+0000 mgr.a (mgr.14355) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:22 smithi171 bash[25040]: cluster 2024-09-14T03:04:21.842749+0000 mgr.a (mgr.14355) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:22 smithi007 bash[22722]: cluster 2024-09-14T03:04:21.842749+0000 mgr.a (mgr.14355) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:22 smithi131 bash[24745]: cluster 2024-09-14T03:04:21.842749+0000 mgr.a (mgr.14355) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:25.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:24 smithi007 bash[22722]: cluster 2024-09-14T03:04:23.843637+0000 mgr.a (mgr.14355) 12261 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:24 smithi131 bash[24745]: cluster 2024-09-14T03:04:23.843637+0000 mgr.a (mgr.14355) 12261 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:24 smithi171 bash[25040]: cluster 2024-09-14T03:04:23.843637+0000 mgr.a (mgr.14355) 12261 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:25.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:25.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:25.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:25.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:25.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:26 smithi007 bash[22722]: audit 2024-09-14T03:04:25.471021+0000 mgr.a (mgr.14355) 12262 : audit [DBG] from='client.267969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:26 smithi007 bash[22722]: cluster 2024-09-14T03:04:25.845294+0000 mgr.a (mgr.14355) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:26 smithi131 bash[24745]: audit 2024-09-14T03:04:25.471021+0000 mgr.a (mgr.14355) 12262 : audit [DBG] from='client.267969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:26 smithi131 bash[24745]: cluster 2024-09-14T03:04:25.845294+0000 mgr.a (mgr.14355) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:26 smithi171 bash[25040]: audit 2024-09-14T03:04:25.471021+0000 mgr.a (mgr.14355) 12262 : audit [DBG] from='client.267969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:26 smithi171 bash[25040]: cluster 2024-09-14T03:04:25.845294+0000 mgr.a (mgr.14355) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:04:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:28 smithi007 bash[22722]: cluster 2024-09-14T03:04:27.846054+0000 mgr.a (mgr.14355) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:28 smithi131 bash[24745]: cluster 2024-09-14T03:04:27.846054+0000 mgr.a (mgr.14355) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:28 smithi171 bash[25040]: cluster 2024-09-14T03:04:27.846054+0000 mgr.a (mgr.14355) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:30.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:30.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:30 smithi007 bash[22722]: cluster 2024-09-14T03:04:29.846842+0000 mgr.a (mgr.14355) 12265 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:04:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:30 smithi131 bash[24745]: cluster 2024-09-14T03:04:29.846842+0000 mgr.a (mgr.14355) 12265 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:04:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:30 smithi171 bash[25040]: cluster 2024-09-14T03:04:29.846842+0000 mgr.a (mgr.14355) 12265 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:04:31.634 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:31.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:32 smithi007 bash[22722]: audit 2024-09-14T03:04:31.207805+0000 mgr.a (mgr.14355) 12266 : audit [DBG] from='client.268047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:32 smithi007 bash[22722]: cluster 2024-09-14T03:04:31.849593+0000 mgr.a (mgr.14355) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:32 smithi131 bash[24745]: audit 2024-09-14T03:04:31.207805+0000 mgr.a (mgr.14355) 12266 : audit [DBG] from='client.268047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:32 smithi131 bash[24745]: cluster 2024-09-14T03:04:31.849593+0000 mgr.a (mgr.14355) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:32 smithi171 bash[25040]: audit 2024-09-14T03:04:31.207805+0000 mgr.a (mgr.14355) 12266 : audit [DBG] from='client.268047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:32 smithi171 bash[25040]: cluster 2024-09-14T03:04:31.849593+0000 mgr.a (mgr.14355) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:34 smithi007 bash[22722]: cluster 2024-09-14T03:04:33.850545+0000 mgr.a (mgr.14355) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:34 smithi131 bash[24745]: cluster 2024-09-14T03:04:33.850545+0000 mgr.a (mgr.14355) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:34 smithi171 bash[25040]: cluster 2024-09-14T03:04:33.850545+0000 mgr.a (mgr.14355) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:04:36.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:36.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:36.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:36 smithi007 bash[22722]: cluster 2024-09-14T03:04:35.852631+0000 mgr.a (mgr.14355) 12269 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:36 smithi131 bash[24745]: cluster 2024-09-14T03:04:35.852631+0000 mgr.a (mgr.14355) 12269 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:36 smithi171 bash[25040]: cluster 2024-09-14T03:04:35.852631+0000 mgr.a (mgr.14355) 12269 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:37.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:37.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:37.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:37.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:37.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:37 smithi007 bash[22722]: audit 2024-09-14T03:04:36.970243+0000 mgr.a (mgr.14355) 12270 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:37 smithi131 bash[24745]: audit 2024-09-14T03:04:36.970243+0000 mgr.a (mgr.14355) 12270 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:37 smithi171 bash[25040]: audit 2024-09-14T03:04:36.970243+0000 mgr.a (mgr.14355) 12270 : audit [DBG] from='client.268122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:38 smithi007 bash[22722]: cluster 2024-09-14T03:04:37.853529+0000 mgr.a (mgr.14355) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:38 smithi131 bash[24745]: cluster 2024-09-14T03:04:37.853529+0000 mgr.a (mgr.14355) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:38 smithi171 bash[25040]: cluster 2024-09-14T03:04:37.853529+0000 mgr.a (mgr.14355) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:40 smithi007 bash[22722]: cluster 2024-09-14T03:04:39.854330+0000 mgr.a (mgr.14355) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:40 smithi131 bash[24745]: cluster 2024-09-14T03:04:39.854330+0000 mgr.a (mgr.14355) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:40 smithi171 bash[25040]: cluster 2024-09-14T03:04:39.854330+0000 mgr.a (mgr.14355) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:42.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:43.179 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:43.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:42 smithi007 bash[22722]: cluster 2024-09-14T03:04:41.856511+0000 mgr.a (mgr.14355) 12273 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:42 smithi131 bash[24745]: cluster 2024-09-14T03:04:41.856511+0000 mgr.a (mgr.14355) 12273 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:42 smithi171 bash[25040]: cluster 2024-09-14T03:04:41.856511+0000 mgr.a (mgr.14355) 12273 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:43 smithi007 bash[22722]: audit 2024-09-14T03:04:42.756950+0000 mgr.a (mgr.14355) 12274 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:43 smithi131 bash[24745]: audit 2024-09-14T03:04:42.756950+0000 mgr.a (mgr.14355) 12274 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:43 smithi171 bash[25040]: audit 2024-09-14T03:04:42.756950+0000 mgr.a (mgr.14355) 12274 : audit [DBG] from='client.268194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:44 smithi131 bash[24745]: cluster 2024-09-14T03:04:43.857377+0000 mgr.a (mgr.14355) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:44 smithi171 bash[25040]: cluster 2024-09-14T03:04:43.857377+0000 mgr.a (mgr.14355) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:44 smithi007 bash[22722]: cluster 2024-09-14T03:04:43.857377+0000 mgr.a (mgr.14355) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:46 smithi131 bash[24745]: cluster 2024-09-14T03:04:45.859554+0000 mgr.a (mgr.14355) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:46 smithi171 bash[25040]: cluster 2024-09-14T03:04:45.859554+0000 mgr.a (mgr.14355) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:46 smithi007 bash[22722]: cluster 2024-09-14T03:04:45.859554+0000 mgr.a (mgr.14355) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:48.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:48.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:48.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:48.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:48.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:48 smithi131 bash[24745]: cluster 2024-09-14T03:04:47.860299+0000 mgr.a (mgr.14355) 12277 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:48 smithi171 bash[25040]: cluster 2024-09-14T03:04:47.860299+0000 mgr.a (mgr.14355) 12277 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:48 smithi007 bash[22722]: cluster 2024-09-14T03:04:47.860299+0000 mgr.a (mgr.14355) 12277 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:49 smithi131 bash[24745]: audit 2024-09-14T03:04:48.509094+0000 mgr.a (mgr.14355) 12278 : audit [DBG] from='client.268272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:49 smithi171 bash[25040]: audit 2024-09-14T03:04:48.509094+0000 mgr.a (mgr.14355) 12278 : audit [DBG] from='client.268272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:49 smithi007 bash[22722]: audit 2024-09-14T03:04:48.509094+0000 mgr.a (mgr.14355) 12278 : audit [DBG] from='client.268272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:50 smithi131 bash[24745]: cluster 2024-09-14T03:04:49.861392+0000 mgr.a (mgr.14355) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:50 smithi171 bash[25040]: cluster 2024-09-14T03:04:49.861392+0000 mgr.a (mgr.14355) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:50 smithi007 bash[22722]: cluster 2024-09-14T03:04:49.861392+0000 mgr.a (mgr.14355) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:52 smithi131 bash[24745]: cluster 2024-09-14T03:04:51.863694+0000 mgr.a (mgr.14355) 12280 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:52 smithi171 bash[25040]: cluster 2024-09-14T03:04:51.863694+0000 mgr.a (mgr.14355) 12280 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:52 smithi007 bash[22722]: cluster 2024-09-14T03:04:51.863694+0000 mgr.a (mgr.14355) 12280 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:53.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:53.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:53.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:04:54.690 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:04:54.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:04:54.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:04:54.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:04:54.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:04:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:54 smithi131 bash[24745]: cluster 2024-09-14T03:04:53.864597+0000 mgr.a (mgr.14355) 12281 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:54 smithi171 bash[25040]: cluster 2024-09-14T03:04:53.864597+0000 mgr.a (mgr.14355) 12281 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:54 smithi007 bash[22722]: cluster 2024-09-14T03:04:53.864597+0000 mgr.a (mgr.14355) 12281 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:55 smithi131 bash[24745]: audit 2024-09-14T03:04:54.266683+0000 mgr.a (mgr.14355) 12282 : audit [DBG] from='client.268350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:55 smithi171 bash[25040]: audit 2024-09-14T03:04:54.266683+0000 mgr.a (mgr.14355) 12282 : audit [DBG] from='client.268350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:55 smithi007 bash[22722]: audit 2024-09-14T03:04:54.266683+0000 mgr.a (mgr.14355) 12282 : audit [DBG] from='client.268350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:04:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:56 smithi131 bash[24745]: cluster 2024-09-14T03:04:55.867027+0000 mgr.a (mgr.14355) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:56 smithi171 bash[25040]: cluster 2024-09-14T03:04:55.867027+0000 mgr.a (mgr.14355) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:56 smithi007 bash[22722]: cluster 2024-09-14T03:04:55.867027+0000 mgr.a (mgr.14355) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:04:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:04:58 smithi007 bash[22722]: cluster 2024-09-14T03:04:57.867929+0000 mgr.a (mgr.14355) 12284 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:04:58 smithi131 bash[24745]: cluster 2024-09-14T03:04:57.867929+0000 mgr.a (mgr.14355) 12284 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:04:58 smithi171 bash[25040]: cluster 2024-09-14T03:04:57.867929+0000 mgr.a (mgr.14355) 12284 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:04:59.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:04:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:04:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:00.446 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:00.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:00.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:00.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:00.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:00 smithi007 bash[22722]: cluster 2024-09-14T03:04:59.868706+0000 mgr.a (mgr.14355) 12285 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:00 smithi131 bash[24745]: cluster 2024-09-14T03:04:59.868706+0000 mgr.a (mgr.14355) 12285 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:00 smithi171 bash[25040]: cluster 2024-09-14T03:04:59.868706+0000 mgr.a (mgr.14355) 12285 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:01 smithi007 bash[22722]: audit 2024-09-14T03:05:00.025988+0000 mgr.a (mgr.14355) 12286 : audit [DBG] from='client.268428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:01 smithi131 bash[24745]: audit 2024-09-14T03:05:00.025988+0000 mgr.a (mgr.14355) 12286 : audit [DBG] from='client.268428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:01 smithi171 bash[25040]: audit 2024-09-14T03:05:00.025988+0000 mgr.a (mgr.14355) 12286 : audit [DBG] from='client.268428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:02 smithi007 bash[22722]: cluster 2024-09-14T03:05:01.871159+0000 mgr.a (mgr.14355) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:05:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:02 smithi131 bash[24745]: cluster 2024-09-14T03:05:01.871159+0000 mgr.a (mgr.14355) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:05:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:02 smithi171 bash[25040]: cluster 2024-09-14T03:05:01.871159+0000 mgr.a (mgr.14355) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:05:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:04 smithi007 bash[22722]: cluster 2024-09-14T03:05:03.871990+0000 mgr.a (mgr.14355) 12288 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:05:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:04 smithi131 bash[24745]: cluster 2024-09-14T03:05:03.871990+0000 mgr.a (mgr.14355) 12288 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:05:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:04 smithi171 bash[25040]: cluster 2024-09-14T03:05:03.871990+0000 mgr.a (mgr.14355) 12288 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:05:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:05.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:06.200 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:06.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:06 smithi007 bash[22722]: audit 2024-09-14T03:05:05.781051+0000 mgr.a (mgr.14355) 12289 : audit [DBG] from='client.268506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:06 smithi007 bash[22722]: cluster 2024-09-14T03:05:05.873382+0000 mgr.a (mgr.14355) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:06 smithi131 bash[24745]: audit 2024-09-14T03:05:05.781051+0000 mgr.a (mgr.14355) 12289 : audit [DBG] from='client.268506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:06 smithi131 bash[24745]: cluster 2024-09-14T03:05:05.873382+0000 mgr.a (mgr.14355) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:06 smithi171 bash[25040]: audit 2024-09-14T03:05:05.781051+0000 mgr.a (mgr.14355) 12289 : audit [DBG] from='client.268506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:06 smithi171 bash[25040]: cluster 2024-09-14T03:05:05.873382+0000 mgr.a (mgr.14355) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:08 smithi007 bash[22722]: cluster 2024-09-14T03:05:07.874316+0000 mgr.a (mgr.14355) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:08 smithi131 bash[24745]: cluster 2024-09-14T03:05:07.874316+0000 mgr.a (mgr.14355) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:08 smithi171 bash[25040]: cluster 2024-09-14T03:05:07.874316+0000 mgr.a (mgr.14355) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:11.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:11.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:10 smithi007 bash[22722]: cluster 2024-09-14T03:05:09.875093+0000 mgr.a (mgr.14355) 12292 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:10 smithi131 bash[24745]: cluster 2024-09-14T03:05:09.875093+0000 mgr.a (mgr.14355) 12292 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:10 smithi171 bash[25040]: cluster 2024-09-14T03:05:09.875093+0000 mgr.a (mgr.14355) 12292 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:11.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:11.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:11.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:11.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:11 smithi131 bash[24745]: audit 2024-09-14T03:05:11.618236+0000 mon.a (mon.0) 2428 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:05:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:11 smithi171 bash[25040]: audit 2024-09-14T03:05:11.618236+0000 mon.a (mon.0) 2428 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:05:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:11 smithi007 bash[22722]: audit 2024-09-14T03:05:11.618236+0000 mon.a (mon.0) 2428 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:05:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:12 smithi131 bash[24745]: audit 2024-09-14T03:05:11.537771+0000 mgr.a (mgr.14355) 12293 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:12 smithi131 bash[24745]: cluster 2024-09-14T03:05:11.880959+0000 mgr.a (mgr.14355) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:12 smithi171 bash[25040]: audit 2024-09-14T03:05:11.537771+0000 mgr.a (mgr.14355) 12293 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:12 smithi171 bash[25040]: cluster 2024-09-14T03:05:11.880959+0000 mgr.a (mgr.14355) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:12 smithi007 bash[22722]: audit 2024-09-14T03:05:11.537771+0000 mgr.a (mgr.14355) 12293 : audit [DBG] from='client.268578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:12 smithi007 bash[22722]: cluster 2024-09-14T03:05:11.880959+0000 mgr.a (mgr.14355) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:14 smithi131 bash[24745]: cluster 2024-09-14T03:05:13.881781+0000 mgr.a (mgr.14355) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:05:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:14 smithi171 bash[25040]: cluster 2024-09-14T03:05:13.881781+0000 mgr.a (mgr.14355) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:05:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:14 smithi007 bash[22722]: cluster 2024-09-14T03:05:13.881781+0000 mgr.a (mgr.14355) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:05:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:16.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: cluster 2024-09-14T03:05:15.883785+0000 mgr.a (mgr.14355) 12296 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:05:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: audit 2024-09-14T03:05:16.931768+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: audit 2024-09-14T03:05:16.936297+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: audit 2024-09-14T03:05:16.954984+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: audit 2024-09-14T03:05:16.959748+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:16 smithi131 bash[24745]: audit 2024-09-14T03:05:16.965652+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: cluster 2024-09-14T03:05:15.883785+0000 mgr.a (mgr.14355) 12296 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:05:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: audit 2024-09-14T03:05:16.931768+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: audit 2024-09-14T03:05:16.936297+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: audit 2024-09-14T03:05:16.954984+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: audit 2024-09-14T03:05:16.959748+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:16 smithi171 bash[25040]: audit 2024-09-14T03:05:16.965652+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: cluster 2024-09-14T03:05:15.883785+0000 mgr.a (mgr.14355) 12296 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: audit 2024-09-14T03:05:16.931768+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: audit 2024-09-14T03:05:16.936297+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: audit 2024-09-14T03:05:16.954984+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: audit 2024-09-14T03:05:16.959748+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:16 smithi007 bash[22722]: audit 2024-09-14T03:05:16.965652+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:17.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:17.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:17 smithi131 bash[24745]: audit 2024-09-14T03:05:16.971101+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:17 smithi131 bash[24745]: audit 2024-09-14T03:05:17.727912+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:05:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:17 smithi131 bash[24745]: audit 2024-09-14T03:05:17.728648+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:05:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:17 smithi131 bash[24745]: audit 2024-09-14T03:05:17.733523+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:17 smithi131 bash[24745]: audit 2024-09-14T03:05:17.735569+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:17 smithi171 bash[25040]: audit 2024-09-14T03:05:16.971101+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:17 smithi171 bash[25040]: audit 2024-09-14T03:05:17.727912+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:05:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:17 smithi171 bash[25040]: audit 2024-09-14T03:05:17.728648+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:05:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:17 smithi171 bash[25040]: audit 2024-09-14T03:05:17.733523+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:17 smithi171 bash[25040]: audit 2024-09-14T03:05:17.735569+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:18.449 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:17 smithi007 bash[22722]: audit 2024-09-14T03:05:16.971101+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.449 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:17 smithi007 bash[22722]: audit 2024-09-14T03:05:17.727912+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:05:18.450 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:17 smithi007 bash[22722]: audit 2024-09-14T03:05:17.728648+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:05:18.450 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:17 smithi007 bash[22722]: audit 2024-09-14T03:05:17.733523+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:05:18.450 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:17 smithi007 bash[22722]: audit 2024-09-14T03:05:17.735569+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:18.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:05:18 smithi007 bash[22972]: debug 2024-09-14T03:05:18.444+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:05:18.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:05:18 smithi007 bash[22972]: debug 2024-09-14T03:05:18.448+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:05:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:18 smithi131 bash[24745]: audit 2024-09-14T03:05:17.304480+0000 mgr.a (mgr.14355) 12297 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:18 smithi131 bash[24745]: audit 2024-09-14T03:05:17.736624+0000 mgr.a (mgr.14355) 12298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:18 smithi131 bash[24745]: cluster 2024-09-14T03:05:17.884430+0000 mgr.a (mgr.14355) 12299 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:19.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:18 smithi171 bash[25040]: audit 2024-09-14T03:05:17.304480+0000 mgr.a (mgr.14355) 12297 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:19.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:18 smithi171 bash[25040]: audit 2024-09-14T03:05:17.736624+0000 mgr.a (mgr.14355) 12298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:19.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:18 smithi171 bash[25040]: cluster 2024-09-14T03:05:17.884430+0000 mgr.a (mgr.14355) 12299 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:18 smithi007 bash[22722]: audit 2024-09-14T03:05:17.304480+0000 mgr.a (mgr.14355) 12297 : audit [DBG] from='client.268653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:18 smithi007 bash[22722]: audit 2024-09-14T03:05:17.736624+0000 mgr.a (mgr.14355) 12298 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:05:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:18 smithi007 bash[22722]: cluster 2024-09-14T03:05:17.884430+0000 mgr.a (mgr.14355) 12299 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:19 smithi131 bash[24745]: audit 2024-09-14T03:05:18.449384+0000 mgr.a (mgr.14355) 12300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:05:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:19 smithi131 bash[24745]: cephadm 2024-09-14T03:05:18.451497+0000 mgr.a (mgr.14355) 12301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:05:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:19 smithi171 bash[25040]: audit 2024-09-14T03:05:18.449384+0000 mgr.a (mgr.14355) 12300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:05:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:19 smithi171 bash[25040]: cephadm 2024-09-14T03:05:18.451497+0000 mgr.a (mgr.14355) 12301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:05:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:19 smithi007 bash[22722]: audit 2024-09-14T03:05:18.449384+0000 mgr.a (mgr.14355) 12300 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:05:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:19 smithi007 bash[22722]: cephadm 2024-09-14T03:05:18.451497+0000 mgr.a (mgr.14355) 12301 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:05:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:20 smithi131 bash[24745]: cluster 2024-09-14T03:05:19.885364+0000 mgr.a (mgr.14355) 12302 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:20 smithi171 bash[25040]: cluster 2024-09-14T03:05:19.885364+0000 mgr.a (mgr.14355) 12302 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:20 smithi007 bash[22722]: cluster 2024-09-14T03:05:19.885364+0000 mgr.a (mgr.14355) 12302 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:22.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:22.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:22 smithi131 bash[24745]: cluster 2024-09-14T03:05:21.887645+0000 mgr.a (mgr.14355) 12303 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:22 smithi171 bash[25040]: cluster 2024-09-14T03:05:21.887645+0000 mgr.a (mgr.14355) 12303 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:22 smithi007 bash[22722]: cluster 2024-09-14T03:05:21.887645+0000 mgr.a (mgr.14355) 12303 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:23.507 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:23.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:24 smithi131 bash[24745]: audit 2024-09-14T03:05:23.060666+0000 mgr.a (mgr.14355) 12304 : audit [DBG] from='client.268839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:24 smithi131 bash[24745]: cluster 2024-09-14T03:05:23.888626+0000 mgr.a (mgr.14355) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:24 smithi171 bash[25040]: audit 2024-09-14T03:05:23.060666+0000 mgr.a (mgr.14355) 12304 : audit [DBG] from='client.268839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:24 smithi171 bash[25040]: cluster 2024-09-14T03:05:23.888626+0000 mgr.a (mgr.14355) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:24 smithi007 bash[22722]: audit 2024-09-14T03:05:23.060666+0000 mgr.a (mgr.14355) 12304 : audit [DBG] from='client.268839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:24 smithi007 bash[22722]: cluster 2024-09-14T03:05:23.888626+0000 mgr.a (mgr.14355) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:27 smithi131 bash[24745]: cluster 2024-09-14T03:05:25.890873+0000 mgr.a (mgr.14355) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:27 smithi171 bash[25040]: cluster 2024-09-14T03:05:25.890873+0000 mgr.a (mgr.14355) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:27 smithi007 bash[22722]: cluster 2024-09-14T03:05:25.890873+0000 mgr.a (mgr.14355) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:28 smithi131 bash[24745]: cluster 2024-09-14T03:05:27.891624+0000 mgr.a (mgr.14355) 12307 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:28 smithi171 bash[25040]: cluster 2024-09-14T03:05:27.891624+0000 mgr.a (mgr.14355) 12307 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:28 smithi007 bash[22722]: cluster 2024-09-14T03:05:27.891624+0000 mgr.a (mgr.14355) 12307 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:28.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:28.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:28.510 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:29.277 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:29.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:29.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:29.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:29.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:29 smithi131 bash[24745]: audit 2024-09-14T03:05:28.848714+0000 mgr.a (mgr.14355) 12308 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:29 smithi171 bash[25040]: audit 2024-09-14T03:05:28.848714+0000 mgr.a (mgr.14355) 12308 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:29 smithi007 bash[22722]: audit 2024-09-14T03:05:28.848714+0000 mgr.a (mgr.14355) 12308 : audit [DBG] from='client.268914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:30 smithi131 bash[24745]: cluster 2024-09-14T03:05:29.892715+0000 mgr.a (mgr.14355) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:30 smithi171 bash[25040]: cluster 2024-09-14T03:05:29.892715+0000 mgr.a (mgr.14355) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:30 smithi007 bash[22722]: cluster 2024-09-14T03:05:29.892715+0000 mgr.a (mgr.14355) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:32 smithi007 bash[22722]: cluster 2024-09-14T03:05:31.895003+0000 mgr.a (mgr.14355) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:32 smithi131 bash[24745]: cluster 2024-09-14T03:05:31.895003+0000 mgr.a (mgr.14355) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:32 smithi171 bash[25040]: cluster 2024-09-14T03:05:31.895003+0000 mgr.a (mgr.14355) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:05:34.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:35.063 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:34 smithi131 bash[24745]: cluster 2024-09-14T03:05:33.895777+0000 mgr.a (mgr.14355) 12311 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:34 smithi171 bash[25040]: cluster 2024-09-14T03:05:33.895777+0000 mgr.a (mgr.14355) 12311 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:34 smithi007 bash[22722]: cluster 2024-09-14T03:05:33.895777+0000 mgr.a (mgr.14355) 12311 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:36.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:35 smithi131 bash[24745]: audit 2024-09-14T03:05:34.613982+0000 mgr.a (mgr.14355) 12312 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:35 smithi171 bash[25040]: audit 2024-09-14T03:05:34.613982+0000 mgr.a (mgr.14355) 12312 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:35 smithi007 bash[22722]: audit 2024-09-14T03:05:34.613982+0000 mgr.a (mgr.14355) 12312 : audit [DBG] from='client.268989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:36 smithi131 bash[24745]: cluster 2024-09-14T03:05:35.898124+0000 mgr.a (mgr.14355) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:36 smithi171 bash[25040]: cluster 2024-09-14T03:05:35.898124+0000 mgr.a (mgr.14355) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:36 smithi007 bash[22722]: cluster 2024-09-14T03:05:35.898124+0000 mgr.a (mgr.14355) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:38 smithi131 bash[24745]: cluster 2024-09-14T03:05:37.898896+0000 mgr.a (mgr.14355) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:38 smithi171 bash[25040]: cluster 2024-09-14T03:05:37.898896+0000 mgr.a (mgr.14355) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:39.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:38 smithi007 bash[22722]: cluster 2024-09-14T03:05:37.898896+0000 mgr.a (mgr.14355) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:40.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:40.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:40 smithi131 bash[24745]: cluster 2024-09-14T03:05:39.899650+0000 mgr.a (mgr.14355) 12315 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:40 smithi171 bash[25040]: cluster 2024-09-14T03:05:39.899650+0000 mgr.a (mgr.14355) 12315 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:40 smithi007 bash[22722]: cluster 2024-09-14T03:05:39.899650+0000 mgr.a (mgr.14355) 12315 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:41 smithi131 bash[24745]: audit 2024-09-14T03:05:40.400435+0000 mgr.a (mgr.14355) 12316 : audit [DBG] from='client.269064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:41 smithi171 bash[25040]: audit 2024-09-14T03:05:40.400435+0000 mgr.a (mgr.14355) 12316 : audit [DBG] from='client.269064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:41 smithi007 bash[22722]: audit 2024-09-14T03:05:40.400435+0000 mgr.a (mgr.14355) 12316 : audit [DBG] from='client.269064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:42 smithi131 bash[24745]: cluster 2024-09-14T03:05:41.902555+0000 mgr.a (mgr.14355) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:42 smithi171 bash[25040]: cluster 2024-09-14T03:05:41.902555+0000 mgr.a (mgr.14355) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:42 smithi007 bash[22722]: cluster 2024-09-14T03:05:41.902555+0000 mgr.a (mgr.14355) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:44 smithi131 bash[24745]: cluster 2024-09-14T03:05:43.903312+0000 mgr.a (mgr.14355) 12318 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:44 smithi171 bash[25040]: cluster 2024-09-14T03:05:43.903312+0000 mgr.a (mgr.14355) 12318 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:44 smithi007 bash[22722]: cluster 2024-09-14T03:05:43.903312+0000 mgr.a (mgr.14355) 12318 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:45.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:45.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:46.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:46 smithi131 bash[24745]: cluster 2024-09-14T03:05:45.905350+0000 mgr.a (mgr.14355) 12319 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:46 smithi171 bash[25040]: cluster 2024-09-14T03:05:45.905350+0000 mgr.a (mgr.14355) 12319 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:46 smithi007 bash[22722]: cluster 2024-09-14T03:05:45.905350+0000 mgr.a (mgr.14355) 12319 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:47 smithi131 bash[24745]: audit 2024-09-14T03:05:46.190343+0000 mgr.a (mgr.14355) 12320 : audit [DBG] from='client.269142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:47 smithi171 bash[25040]: audit 2024-09-14T03:05:46.190343+0000 mgr.a (mgr.14355) 12320 : audit [DBG] from='client.269142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:47 smithi007 bash[22722]: audit 2024-09-14T03:05:46.190343+0000 mgr.a (mgr.14355) 12320 : audit [DBG] from='client.269142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:48 smithi131 bash[24745]: cluster 2024-09-14T03:05:47.906329+0000 mgr.a (mgr.14355) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:48 smithi171 bash[25040]: cluster 2024-09-14T03:05:47.906329+0000 mgr.a (mgr.14355) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:48 smithi007 bash[22722]: cluster 2024-09-14T03:05:47.906329+0000 mgr.a (mgr.14355) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:05:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:50 smithi131 bash[24745]: cluster 2024-09-14T03:05:49.907103+0000 mgr.a (mgr.14355) 12322 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:50 smithi171 bash[25040]: cluster 2024-09-14T03:05:49.907103+0000 mgr.a (mgr.14355) 12322 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:50 smithi007 bash[22722]: cluster 2024-09-14T03:05:49.907103+0000 mgr.a (mgr.14355) 12322 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:05:51.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:51.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:51.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:52.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:52.403 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:52 smithi131 bash[24745]: cluster 2024-09-14T03:05:51.909256+0000 mgr.a (mgr.14355) 12323 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:52 smithi131 bash[24745]: audit 2024-09-14T03:05:51.964208+0000 mgr.a (mgr.14355) 12324 : audit [DBG] from='client.269214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:52 smithi171 bash[25040]: cluster 2024-09-14T03:05:51.909256+0000 mgr.a (mgr.14355) 12323 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:52 smithi171 bash[25040]: audit 2024-09-14T03:05:51.964208+0000 mgr.a (mgr.14355) 12324 : audit [DBG] from='client.269214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:52 smithi007 bash[22722]: cluster 2024-09-14T03:05:51.909256+0000 mgr.a (mgr.14355) 12323 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:52 smithi007 bash[22722]: audit 2024-09-14T03:05:51.964208+0000 mgr.a (mgr.14355) 12324 : audit [DBG] from='client.269214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:54 smithi131 bash[24745]: cluster 2024-09-14T03:05:53.910335+0000 mgr.a (mgr.14355) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:54 smithi171 bash[25040]: cluster 2024-09-14T03:05:53.910335+0000 mgr.a (mgr.14355) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:54 smithi007 bash[22722]: cluster 2024-09-14T03:05:53.910335+0000 mgr.a (mgr.14355) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:56 smithi131 bash[24745]: cluster 2024-09-14T03:05:55.912734+0000 mgr.a (mgr.14355) 12326 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:56 smithi171 bash[25040]: cluster 2024-09-14T03:05:55.912734+0000 mgr.a (mgr.14355) 12326 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:57.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:05:57.404 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:05:57.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:05:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:56 smithi007 bash[22722]: cluster 2024-09-14T03:05:55.912734+0000 mgr.a (mgr.14355) 12326 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:05:58.143 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:05:58.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:05:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:05:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:05:58.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:05:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:58 smithi131 bash[24745]: audit 2024-09-14T03:05:57.725335+0000 mgr.a (mgr.14355) 12327 : audit [DBG] from='client.269292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:05:58 smithi131 bash[24745]: cluster 2024-09-14T03:05:57.913355+0000 mgr.a (mgr.14355) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:58 smithi171 bash[25040]: audit 2024-09-14T03:05:57.725335+0000 mgr.a (mgr.14355) 12327 : audit [DBG] from='client.269292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:05:58 smithi171 bash[25040]: cluster 2024-09-14T03:05:57.913355+0000 mgr.a (mgr.14355) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:05:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:58 smithi007 bash[22722]: audit 2024-09-14T03:05:57.725335+0000 mgr.a (mgr.14355) 12327 : audit [DBG] from='client.269292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:05:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:05:58 smithi007 bash[22722]: cluster 2024-09-14T03:05:57.913355+0000 mgr.a (mgr.14355) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:00 smithi131 bash[24745]: cluster 2024-09-14T03:05:59.914461+0000 mgr.a (mgr.14355) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:00 smithi171 bash[25040]: cluster 2024-09-14T03:05:59.914461+0000 mgr.a (mgr.14355) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:00 smithi007 bash[22722]: cluster 2024-09-14T03:05:59.914461+0000 mgr.a (mgr.14355) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:03.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:03.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:03.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:03 smithi131 bash[24745]: cluster 2024-09-14T03:06:01.916838+0000 mgr.a (mgr.14355) 12330 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:03 smithi171 bash[25040]: cluster 2024-09-14T03:06:01.916838+0000 mgr.a (mgr.14355) 12330 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:03 smithi007 bash[22722]: cluster 2024-09-14T03:06:01.916838+0000 mgr.a (mgr.14355) 12330 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:03.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:03.912 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:05 smithi131 bash[24745]: audit 2024-09-14T03:06:03.478064+0000 mgr.a (mgr.14355) 12331 : audit [DBG] from='client.269370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:05 smithi131 bash[24745]: cluster 2024-09-14T03:06:03.917534+0000 mgr.a (mgr.14355) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:05 smithi171 bash[25040]: audit 2024-09-14T03:06:03.478064+0000 mgr.a (mgr.14355) 12331 : audit [DBG] from='client.269370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:05 smithi171 bash[25040]: cluster 2024-09-14T03:06:03.917534+0000 mgr.a (mgr.14355) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:05 smithi007 bash[22722]: audit 2024-09-14T03:06:03.478064+0000 mgr.a (mgr.14355) 12331 : audit [DBG] from='client.269370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:05 smithi007 bash[22722]: cluster 2024-09-14T03:06:03.917534+0000 mgr.a (mgr.14355) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:06 smithi007 bash[22722]: cluster 2024-09-14T03:06:05.919979+0000 mgr.a (mgr.14355) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:06 smithi131 bash[24745]: cluster 2024-09-14T03:06:05.919979+0000 mgr.a (mgr.14355) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:06 smithi171 bash[25040]: cluster 2024-09-14T03:06:05.919979+0000 mgr.a (mgr.14355) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:08.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:08.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:08.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:08 smithi131 bash[24745]: cluster 2024-09-14T03:06:07.920808+0000 mgr.a (mgr.14355) 12334 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:08 smithi171 bash[25040]: cluster 2024-09-14T03:06:07.920808+0000 mgr.a (mgr.14355) 12334 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:08 smithi007 bash[22722]: cluster 2024-09-14T03:06:07.920808+0000 mgr.a (mgr.14355) 12334 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:09.680 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:10 smithi131 bash[24745]: audit 2024-09-14T03:06:09.249905+0000 mgr.a (mgr.14355) 12335 : audit [DBG] from='client.269448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:10 smithi131 bash[24745]: cluster 2024-09-14T03:06:09.921875+0000 mgr.a (mgr.14355) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:10 smithi171 bash[25040]: audit 2024-09-14T03:06:09.249905+0000 mgr.a (mgr.14355) 12335 : audit [DBG] from='client.269448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:10 smithi171 bash[25040]: cluster 2024-09-14T03:06:09.921875+0000 mgr.a (mgr.14355) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:10 smithi007 bash[22722]: audit 2024-09-14T03:06:09.249905+0000 mgr.a (mgr.14355) 12335 : audit [DBG] from='client.269448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:10 smithi007 bash[22722]: cluster 2024-09-14T03:06:09.921875+0000 mgr.a (mgr.14355) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:12 smithi131 bash[24745]: cluster 2024-09-14T03:06:11.924315+0000 mgr.a (mgr.14355) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:12 smithi171 bash[25040]: cluster 2024-09-14T03:06:11.924315+0000 mgr.a (mgr.14355) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:12 smithi007 bash[22722]: cluster 2024-09-14T03:06:11.924315+0000 mgr.a (mgr.14355) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:14 smithi131 bash[24745]: cluster 2024-09-14T03:06:13.925287+0000 mgr.a (mgr.14355) 12338 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:14 smithi171 bash[25040]: cluster 2024-09-14T03:06:13.925287+0000 mgr.a (mgr.14355) 12338 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:14 smithi007 bash[22722]: cluster 2024-09-14T03:06:13.925287+0000 mgr.a (mgr.14355) 12338 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:15.476 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:16 smithi131 bash[24745]: audit 2024-09-14T03:06:15.023947+0000 mgr.a (mgr.14355) 12339 : audit [DBG] from='client.269526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:16 smithi131 bash[24745]: cluster 2024-09-14T03:06:15.928062+0000 mgr.a (mgr.14355) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:06:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:16 smithi171 bash[25040]: audit 2024-09-14T03:06:15.023947+0000 mgr.a (mgr.14355) 12339 : audit [DBG] from='client.269526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:16 smithi171 bash[25040]: cluster 2024-09-14T03:06:15.928062+0000 mgr.a (mgr.14355) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:06:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:16 smithi007 bash[22722]: audit 2024-09-14T03:06:15.023947+0000 mgr.a (mgr.14355) 12339 : audit [DBG] from='client.269526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:16 smithi007 bash[22722]: cluster 2024-09-14T03:06:15.928062+0000 mgr.a (mgr.14355) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:06:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:18 smithi131 bash[24745]: cluster 2024-09-14T03:06:17.928866+0000 mgr.a (mgr.14355) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:18 smithi131 bash[24745]: audit 2024-09-14T03:06:18.502855+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:06:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:18 smithi171 bash[25040]: cluster 2024-09-14T03:06:17.928866+0000 mgr.a (mgr.14355) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:18 smithi171 bash[25040]: audit 2024-09-14T03:06:18.502855+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:06:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:18 smithi007 bash[22722]: cluster 2024-09-14T03:06:17.928866+0000 mgr.a (mgr.14355) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:18 smithi007 bash[22722]: audit 2024-09-14T03:06:18.502855+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:06:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:20 smithi131 bash[24745]: audit 2024-09-14T03:06:19.319133+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:06:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:20 smithi131 bash[24745]: audit 2024-09-14T03:06:19.320955+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:06:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:20 smithi131 bash[24745]: audit 2024-09-14T03:06:19.329840+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:06:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:20 smithi131 bash[24745]: audit 2024-09-14T03:06:19.334646+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:20 smithi171 bash[25040]: audit 2024-09-14T03:06:19.319133+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:06:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:20 smithi171 bash[25040]: audit 2024-09-14T03:06:19.320955+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:06:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:20 smithi171 bash[25040]: audit 2024-09-14T03:06:19.329840+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:06:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:20 smithi171 bash[25040]: audit 2024-09-14T03:06:19.334646+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:20.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22972]: debug 2024-09-14T03:06:20.079+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:06:20.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22972]: debug 2024-09-14T03:06:20.079+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:06:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22722]: audit 2024-09-14T03:06:19.319133+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:06:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22722]: audit 2024-09-14T03:06:19.320955+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:06:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22722]: audit 2024-09-14T03:06:19.329840+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:06:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:20 smithi007 bash[22722]: audit 2024-09-14T03:06:19.334646+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:20.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:20.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:21.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:21.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:21 smithi131 bash[24745]: audit 2024-09-14T03:06:19.337007+0000 mgr.a (mgr.14355) 12342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:21 smithi131 bash[24745]: cluster 2024-09-14T03:06:19.929387+0000 mgr.a (mgr.14355) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:21 smithi171 bash[25040]: audit 2024-09-14T03:06:19.337007+0000 mgr.a (mgr.14355) 12342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:21 smithi171 bash[25040]: cluster 2024-09-14T03:06:19.929387+0000 mgr.a (mgr.14355) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:21 smithi007 bash[22722]: audit 2024-09-14T03:06:19.337007+0000 mgr.a (mgr.14355) 12342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:06:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:21 smithi007 bash[22722]: cluster 2024-09-14T03:06:19.929387+0000 mgr.a (mgr.14355) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:06:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:22 smithi131 bash[24745]: audit 2024-09-14T03:06:20.084288+0000 mgr.a (mgr.14355) 12344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:06:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:22 smithi131 bash[24745]: cephadm 2024-09-14T03:06:20.085417+0000 mgr.a (mgr.14355) 12345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:06:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:22 smithi131 bash[24745]: audit 2024-09-14T03:06:20.811194+0000 mgr.a (mgr.14355) 12346 : audit [DBG] from='client.269709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:22 smithi171 bash[25040]: audit 2024-09-14T03:06:20.084288+0000 mgr.a (mgr.14355) 12344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:06:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:22 smithi171 bash[25040]: cephadm 2024-09-14T03:06:20.085417+0000 mgr.a (mgr.14355) 12345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:06:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:22 smithi171 bash[25040]: audit 2024-09-14T03:06:20.811194+0000 mgr.a (mgr.14355) 12346 : audit [DBG] from='client.269709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:22 smithi007 bash[22722]: audit 2024-09-14T03:06:20.084288+0000 mgr.a (mgr.14355) 12344 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:06:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:22 smithi007 bash[22722]: cephadm 2024-09-14T03:06:20.085417+0000 mgr.a (mgr.14355) 12345 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:06:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:22 smithi007 bash[22722]: audit 2024-09-14T03:06:20.811194+0000 mgr.a (mgr.14355) 12346 : audit [DBG] from='client.269709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:23 smithi131 bash[24745]: cluster 2024-09-14T03:06:21.932203+0000 mgr.a (mgr.14355) 12347 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:23 smithi171 bash[25040]: cluster 2024-09-14T03:06:21.932203+0000 mgr.a (mgr.14355) 12347 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:23 smithi007 bash[22722]: cluster 2024-09-14T03:06:21.932203+0000 mgr.a (mgr.14355) 12347 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:24.287 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:24 smithi131 bash[24745]: cluster 2024-09-14T03:06:23.933016+0000 mgr.a (mgr.14355) 12348 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:24 smithi171 bash[25040]: cluster 2024-09-14T03:06:23.933016+0000 mgr.a (mgr.14355) 12348 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:24 smithi007 bash[22722]: cluster 2024-09-14T03:06:23.933016+0000 mgr.a (mgr.14355) 12348 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:26.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:26.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:26.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:26.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:26.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:26.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:26.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:26 smithi131 bash[24745]: cluster 2024-09-14T03:06:25.935035+0000 mgr.a (mgr.14355) 12349 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:26 smithi171 bash[25040]: cluster 2024-09-14T03:06:25.935035+0000 mgr.a (mgr.14355) 12349 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:26 smithi007 bash[22722]: cluster 2024-09-14T03:06:25.935035+0000 mgr.a (mgr.14355) 12349 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:27 smithi131 bash[24745]: audit 2024-09-14T03:06:26.565226+0000 mgr.a (mgr.14355) 12350 : audit [DBG] from='client.269787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:27 smithi171 bash[25040]: audit 2024-09-14T03:06:26.565226+0000 mgr.a (mgr.14355) 12350 : audit [DBG] from='client.269787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:27 smithi007 bash[22722]: audit 2024-09-14T03:06:26.565226+0000 mgr.a (mgr.14355) 12350 : audit [DBG] from='client.269787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:29 smithi131 bash[24745]: cluster 2024-09-14T03:06:27.935937+0000 mgr.a (mgr.14355) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:29 smithi171 bash[25040]: cluster 2024-09-14T03:06:27.935937+0000 mgr.a (mgr.14355) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:29 smithi007 bash[22722]: cluster 2024-09-14T03:06:27.935937+0000 mgr.a (mgr.14355) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:31 smithi131 bash[24745]: cluster 2024-09-14T03:06:29.936743+0000 mgr.a (mgr.14355) 12352 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:31 smithi171 bash[25040]: cluster 2024-09-14T03:06:29.936743+0000 mgr.a (mgr.14355) 12352 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:31 smithi007 bash[22722]: cluster 2024-09-14T03:06:29.936743+0000 mgr.a (mgr.14355) 12352 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:06:31.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:31.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:31.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:32 smithi131 bash[24745]: cluster 2024-09-14T03:06:31.939033+0000 mgr.a (mgr.14355) 12353 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:32 smithi171 bash[25040]: cluster 2024-09-14T03:06:31.939033+0000 mgr.a (mgr.14355) 12353 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:32 smithi007 bash[22722]: cluster 2024-09-14T03:06:31.939033+0000 mgr.a (mgr.14355) 12353 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:06:32.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:32.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:32.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:32.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:32.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:33 smithi131 bash[24745]: audit 2024-09-14T03:06:32.324841+0000 mgr.a (mgr.14355) 12354 : audit [DBG] from='client.269862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:33 smithi171 bash[25040]: audit 2024-09-14T03:06:32.324841+0000 mgr.a (mgr.14355) 12354 : audit [DBG] from='client.269862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:33 smithi007 bash[22722]: audit 2024-09-14T03:06:32.324841+0000 mgr.a (mgr.14355) 12354 : audit [DBG] from='client.269862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:34 smithi171 bash[25040]: cluster 2024-09-14T03:06:33.939948+0000 mgr.a (mgr.14355) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:34 smithi007 bash[22722]: cluster 2024-09-14T03:06:33.939948+0000 mgr.a (mgr.14355) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:34 smithi131 bash[24745]: cluster 2024-09-14T03:06:33.939948+0000 mgr.a (mgr.14355) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:36 smithi131 bash[24745]: cluster 2024-09-14T03:06:35.942158+0000 mgr.a (mgr.14355) 12356 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:36 smithi171 bash[25040]: cluster 2024-09-14T03:06:35.942158+0000 mgr.a (mgr.14355) 12356 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:36 smithi007 bash[22722]: cluster 2024-09-14T03:06:35.942158+0000 mgr.a (mgr.14355) 12356 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:37.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:37.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:38.525 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:39 smithi131 bash[24745]: cluster 2024-09-14T03:06:37.943073+0000 mgr.a (mgr.14355) 12357 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:39 smithi171 bash[25040]: cluster 2024-09-14T03:06:37.943073+0000 mgr.a (mgr.14355) 12357 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:39 smithi007 bash[22722]: cluster 2024-09-14T03:06:37.943073+0000 mgr.a (mgr.14355) 12357 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:40 smithi131 bash[24745]: audit 2024-09-14T03:06:38.113475+0000 mgr.a (mgr.14355) 12358 : audit [DBG] from='client.269934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:40 smithi171 bash[25040]: audit 2024-09-14T03:06:38.113475+0000 mgr.a (mgr.14355) 12358 : audit [DBG] from='client.269934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:40 smithi007 bash[22722]: audit 2024-09-14T03:06:38.113475+0000 mgr.a (mgr.14355) 12358 : audit [DBG] from='client.269934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:41 smithi131 bash[24745]: cluster 2024-09-14T03:06:39.944037+0000 mgr.a (mgr.14355) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:41 smithi171 bash[25040]: cluster 2024-09-14T03:06:39.944037+0000 mgr.a (mgr.14355) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:41 smithi007 bash[22722]: cluster 2024-09-14T03:06:39.944037+0000 mgr.a (mgr.14355) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:42 smithi007 bash[22722]: cluster 2024-09-14T03:06:41.946318+0000 mgr.a (mgr.14355) 12360 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:42 smithi131 bash[24745]: cluster 2024-09-14T03:06:41.946318+0000 mgr.a (mgr.14355) 12360 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:42 smithi171 bash[25040]: cluster 2024-09-14T03:06:41.946318+0000 mgr.a (mgr.14355) 12360 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:43.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:43.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:43.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:44.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:44.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:45 smithi131 bash[24745]: audit 2024-09-14T03:06:43.863121+0000 mgr.a (mgr.14355) 12361 : audit [DBG] from='client.270012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:45 smithi131 bash[24745]: cluster 2024-09-14T03:06:43.946913+0000 mgr.a (mgr.14355) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:45 smithi171 bash[25040]: audit 2024-09-14T03:06:43.863121+0000 mgr.a (mgr.14355) 12361 : audit [DBG] from='client.270012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:45 smithi171 bash[25040]: cluster 2024-09-14T03:06:43.946913+0000 mgr.a (mgr.14355) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:45 smithi007 bash[22722]: audit 2024-09-14T03:06:43.863121+0000 mgr.a (mgr.14355) 12361 : audit [DBG] from='client.270012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:45 smithi007 bash[22722]: cluster 2024-09-14T03:06:43.946913+0000 mgr.a (mgr.14355) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:47 smithi131 bash[24745]: cluster 2024-09-14T03:06:45.949171+0000 mgr.a (mgr.14355) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:47 smithi171 bash[25040]: cluster 2024-09-14T03:06:45.949171+0000 mgr.a (mgr.14355) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:47 smithi007 bash[22722]: cluster 2024-09-14T03:06:45.949171+0000 mgr.a (mgr.14355) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:49 smithi131 bash[24745]: cluster 2024-09-14T03:06:47.949947+0000 mgr.a (mgr.14355) 12364 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:49 smithi171 bash[25040]: cluster 2024-09-14T03:06:47.949947+0000 mgr.a (mgr.14355) 12364 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:49.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:49 smithi007 bash[22722]: cluster 2024-09-14T03:06:47.949947+0000 mgr.a (mgr.14355) 12364 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:50.091 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:50.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:50.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:50.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:50.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:51 smithi131 bash[24745]: audit 2024-09-14T03:06:49.642265+0000 mgr.a (mgr.14355) 12365 : audit [DBG] from='client.270087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:51 smithi131 bash[24745]: cluster 2024-09-14T03:06:49.950499+0000 mgr.a (mgr.14355) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:51 smithi171 bash[25040]: audit 2024-09-14T03:06:49.642265+0000 mgr.a (mgr.14355) 12365 : audit [DBG] from='client.270087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:51 smithi171 bash[25040]: cluster 2024-09-14T03:06:49.950499+0000 mgr.a (mgr.14355) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:51 smithi007 bash[22722]: audit 2024-09-14T03:06:49.642265+0000 mgr.a (mgr.14355) 12365 : audit [DBG] from='client.270087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:51 smithi007 bash[22722]: cluster 2024-09-14T03:06:49.950499+0000 mgr.a (mgr.14355) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:52 smithi007 bash[22722]: cluster 2024-09-14T03:06:51.952929+0000 mgr.a (mgr.14355) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:52 smithi131 bash[24745]: cluster 2024-09-14T03:06:51.952929+0000 mgr.a (mgr.14355) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:52 smithi171 bash[25040]: cluster 2024-09-14T03:06:51.952929+0000 mgr.a (mgr.14355) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:06:55.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:06:55.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:06:55.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:06:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:55 smithi131 bash[24745]: cluster 2024-09-14T03:06:53.953708+0000 mgr.a (mgr.14355) 12368 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:55 smithi171 bash[25040]: cluster 2024-09-14T03:06:53.953708+0000 mgr.a (mgr.14355) 12368 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:55 smithi007 bash[22722]: cluster 2024-09-14T03:06:53.953708+0000 mgr.a (mgr.14355) 12368 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:55.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:06:55.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:06:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:57 smithi131 bash[24745]: audit 2024-09-14T03:06:55.420820+0000 mgr.a (mgr.14355) 12369 : audit [DBG] from='client.270159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:57 smithi131 bash[24745]: cluster 2024-09-14T03:06:55.956149+0000 mgr.a (mgr.14355) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:57 smithi171 bash[25040]: audit 2024-09-14T03:06:55.420820+0000 mgr.a (mgr.14355) 12369 : audit [DBG] from='client.270159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:57 smithi171 bash[25040]: cluster 2024-09-14T03:06:55.956149+0000 mgr.a (mgr.14355) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:57 smithi007 bash[22722]: audit 2024-09-14T03:06:55.420820+0000 mgr.a (mgr.14355) 12369 : audit [DBG] from='client.270159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:06:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:57 smithi007 bash[22722]: cluster 2024-09-14T03:06:55.956149+0000 mgr.a (mgr.14355) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:06:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:06:59 smithi131 bash[24745]: cluster 2024-09-14T03:06:57.956897+0000 mgr.a (mgr.14355) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:06:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:06:59 smithi171 bash[25040]: cluster 2024-09-14T03:06:57.956897+0000 mgr.a (mgr.14355) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:06:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:06:59 smithi007 bash[22722]: cluster 2024-09-14T03:06:57.956897+0000 mgr.a (mgr.14355) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:00 smithi007 bash[22722]: cluster 2024-09-14T03:06:59.957641+0000 mgr.a (mgr.14355) 12372 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:00 smithi131 bash[24745]: cluster 2024-09-14T03:06:59.957641+0000 mgr.a (mgr.14355) 12372 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:00 smithi171 bash[25040]: cluster 2024-09-14T03:06:59.957641+0000 mgr.a (mgr.14355) 12372 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:00.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:00.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:00.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:01.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:01.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:01.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:01.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:01.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:03 smithi131 bash[24745]: audit 2024-09-14T03:07:01.184283+0000 mgr.a (mgr.14355) 12373 : audit [DBG] from='client.270237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:03 smithi131 bash[24745]: cluster 2024-09-14T03:07:01.960555+0000 mgr.a (mgr.14355) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:03.299 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:03 smithi171 bash[25040]: audit 2024-09-14T03:07:01.184283+0000 mgr.a (mgr.14355) 12373 : audit [DBG] from='client.270237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:03.299 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:03 smithi171 bash[25040]: cluster 2024-09-14T03:07:01.960555+0000 mgr.a (mgr.14355) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:03 smithi007 bash[22722]: audit 2024-09-14T03:07:01.184283+0000 mgr.a (mgr.14355) 12373 : audit [DBG] from='client.270237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:03 smithi007 bash[22722]: cluster 2024-09-14T03:07:01.960555+0000 mgr.a (mgr.14355) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:04 smithi007 bash[22722]: cluster 2024-09-14T03:07:03.961350+0000 mgr.a (mgr.14355) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:04 smithi131 bash[24745]: cluster 2024-09-14T03:07:03.961350+0000 mgr.a (mgr.14355) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:04 smithi171 bash[25040]: cluster 2024-09-14T03:07:03.961350+0000 mgr.a (mgr.14355) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:06.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:07 smithi131 bash[24745]: cluster 2024-09-14T03:07:05.963635+0000 mgr.a (mgr.14355) 12376 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:07 smithi171 bash[25040]: cluster 2024-09-14T03:07:05.963635+0000 mgr.a (mgr.14355) 12376 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:07.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:07.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:07.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:07.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:07.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:07 smithi007 bash[22722]: cluster 2024-09-14T03:07:05.963635+0000 mgr.a (mgr.14355) 12376 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:08 smithi131 bash[24745]: audit 2024-09-14T03:07:06.961897+0000 mgr.a (mgr.14355) 12377 : audit [DBG] from='client.270315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:08 smithi171 bash[25040]: audit 2024-09-14T03:07:06.961897+0000 mgr.a (mgr.14355) 12377 : audit [DBG] from='client.270315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:08 smithi007 bash[22722]: audit 2024-09-14T03:07:06.961897+0000 mgr.a (mgr.14355) 12377 : audit [DBG] from='client.270315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:09 smithi131 bash[24745]: cluster 2024-09-14T03:07:07.964546+0000 mgr.a (mgr.14355) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:09 smithi171 bash[25040]: cluster 2024-09-14T03:07:07.964546+0000 mgr.a (mgr.14355) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:09 smithi007 bash[22722]: cluster 2024-09-14T03:07:07.964546+0000 mgr.a (mgr.14355) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:10 smithi131 bash[24745]: cluster 2024-09-14T03:07:09.965335+0000 mgr.a (mgr.14355) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:10 smithi171 bash[25040]: cluster 2024-09-14T03:07:09.965335+0000 mgr.a (mgr.14355) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:10 smithi007 bash[22722]: cluster 2024-09-14T03:07:09.965335+0000 mgr.a (mgr.14355) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:12.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:12.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:12 smithi007 bash[22722]: cluster 2024-09-14T03:07:11.967610+0000 mgr.a (mgr.14355) 12380 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:12 smithi131 bash[24745]: cluster 2024-09-14T03:07:11.967610+0000 mgr.a (mgr.14355) 12380 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:12 smithi171 bash[25040]: cluster 2024-09-14T03:07:11.967610+0000 mgr.a (mgr.14355) 12380 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:13.177 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:13 smithi007 bash[22722]: audit 2024-09-14T03:07:12.734366+0000 mgr.a (mgr.14355) 12381 : audit [DBG] from='client.270393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:13 smithi131 bash[24745]: audit 2024-09-14T03:07:12.734366+0000 mgr.a (mgr.14355) 12381 : audit [DBG] from='client.270393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:13 smithi171 bash[25040]: audit 2024-09-14T03:07:12.734366+0000 mgr.a (mgr.14355) 12381 : audit [DBG] from='client.270393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:14 smithi007 bash[22722]: cluster 2024-09-14T03:07:13.968542+0000 mgr.a (mgr.14355) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:14 smithi131 bash[24745]: cluster 2024-09-14T03:07:13.968542+0000 mgr.a (mgr.14355) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:14 smithi171 bash[25040]: cluster 2024-09-14T03:07:13.968542+0000 mgr.a (mgr.14355) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:16 smithi007 bash[22722]: cluster 2024-09-14T03:07:15.971090+0000 mgr.a (mgr.14355) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:16 smithi131 bash[24745]: cluster 2024-09-14T03:07:15.971090+0000 mgr.a (mgr.14355) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:16 smithi171 bash[25040]: cluster 2024-09-14T03:07:15.971090+0000 mgr.a (mgr.14355) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:18 smithi007 bash[22722]: cluster 2024-09-14T03:07:17.971902+0000 mgr.a (mgr.14355) 12384 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:18 smithi131 bash[24745]: cluster 2024-09-14T03:07:17.971902+0000 mgr.a (mgr.14355) 12384 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:18 smithi171 bash[25040]: cluster 2024-09-14T03:07:17.971902+0000 mgr.a (mgr.14355) 12384 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:18.960 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:18.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:18.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:18.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:18.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:19 smithi007 bash[22722]: audit 2024-09-14T03:07:18.518463+0000 mgr.a (mgr.14355) 12385 : audit [DBG] from='client.270471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:19 smithi131 bash[24745]: audit 2024-09-14T03:07:18.518463+0000 mgr.a (mgr.14355) 12385 : audit [DBG] from='client.270471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:19 smithi171 bash[25040]: audit 2024-09-14T03:07:18.518463+0000 mgr.a (mgr.14355) 12385 : audit [DBG] from='client.270471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:20 smithi007 bash[22722]: cluster 2024-09-14T03:07:19.972791+0000 mgr.a (mgr.14355) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:20 smithi131 bash[24745]: cluster 2024-09-14T03:07:19.972791+0000 mgr.a (mgr.14355) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:20 smithi171 bash[25040]: cluster 2024-09-14T03:07:19.972791+0000 mgr.a (mgr.14355) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:20.136864+0000 mon.a (mon.0) 2444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:20.988605+0000 mon.a (mon.0) 2445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:20.990198+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:21.000250+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:21.005214+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22722]: audit 2024-09-14T03:07:21.007555+0000 mgr.a (mgr.14355) 12387 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:20.136864+0000 mon.a (mon.0) 2444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:20.988605+0000 mon.a (mon.0) 2445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:20.990198+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:21.000250+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:07:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:21.005214+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:21 smithi131 bash[24745]: audit 2024-09-14T03:07:21.007555+0000 mgr.a (mgr.14355) 12387 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:20.136864+0000 mon.a (mon.0) 2444 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:20.988605+0000 mon.a (mon.0) 2445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:20.990198+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:21.000250+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:21.005214+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:21 smithi171 bash[25040]: audit 2024-09-14T03:07:21.007555+0000 mgr.a (mgr.14355) 12387 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:07:22.096 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22972]: debug 2024-09-14T03:07:21.746+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:07:22.096 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:07:21 smithi007 bash[22972]: debug 2024-09-14T03:07:21.750+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:07:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:22 smithi007 bash[22722]: audit 2024-09-14T03:07:21.753229+0000 mgr.a (mgr.14355) 12388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:07:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:22 smithi007 bash[22722]: cephadm 2024-09-14T03:07:21.754787+0000 mgr.a (mgr.14355) 12389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:07:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:22 smithi007 bash[22722]: cluster 2024-09-14T03:07:21.975703+0000 mgr.a (mgr.14355) 12390 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:22 smithi131 bash[24745]: audit 2024-09-14T03:07:21.753229+0000 mgr.a (mgr.14355) 12388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:07:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:22 smithi131 bash[24745]: cephadm 2024-09-14T03:07:21.754787+0000 mgr.a (mgr.14355) 12389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:07:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:22 smithi131 bash[24745]: cluster 2024-09-14T03:07:21.975703+0000 mgr.a (mgr.14355) 12390 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:22 smithi171 bash[25040]: audit 2024-09-14T03:07:21.753229+0000 mgr.a (mgr.14355) 12388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:07:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:22 smithi171 bash[25040]: cephadm 2024-09-14T03:07:21.754787+0000 mgr.a (mgr.14355) 12389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:07:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:22 smithi171 bash[25040]: cluster 2024-09-14T03:07:21.975703+0000 mgr.a (mgr.14355) 12390 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:23.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:23.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:23.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:24 smithi007 bash[22722]: cluster 2024-09-14T03:07:23.976523+0000 mgr.a (mgr.14355) 12391 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:24 smithi131 bash[24745]: cluster 2024-09-14T03:07:23.976523+0000 mgr.a (mgr.14355) 12391 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:24 smithi171 bash[25040]: cluster 2024-09-14T03:07:23.976523+0000 mgr.a (mgr.14355) 12391 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:24.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:24.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:24.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:25 smithi007 bash[22722]: audit 2024-09-14T03:07:24.289635+0000 mgr.a (mgr.14355) 12392 : audit [DBG] from='client.270654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:25 smithi131 bash[24745]: audit 2024-09-14T03:07:24.289635+0000 mgr.a (mgr.14355) 12392 : audit [DBG] from='client.270654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:25 smithi171 bash[25040]: audit 2024-09-14T03:07:24.289635+0000 mgr.a (mgr.14355) 12392 : audit [DBG] from='client.270654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:26 smithi007 bash[22722]: cluster 2024-09-14T03:07:25.979118+0000 mgr.a (mgr.14355) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:26 smithi131 bash[24745]: cluster 2024-09-14T03:07:25.979118+0000 mgr.a (mgr.14355) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:26 smithi171 bash[25040]: cluster 2024-09-14T03:07:25.979118+0000 mgr.a (mgr.14355) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:28 smithi007 bash[22722]: cluster 2024-09-14T03:07:27.979937+0000 mgr.a (mgr.14355) 12394 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:28 smithi131 bash[24745]: cluster 2024-09-14T03:07:27.979937+0000 mgr.a (mgr.14355) 12394 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:28 smithi171 bash[25040]: cluster 2024-09-14T03:07:27.979937+0000 mgr.a (mgr.14355) 12394 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:29.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:29.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:29.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:30 smithi007 bash[22722]: cluster 2024-09-14T03:07:29.980675+0000 mgr.a (mgr.14355) 12395 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:30.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:30.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:30.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:30 smithi131 bash[24745]: cluster 2024-09-14T03:07:29.980675+0000 mgr.a (mgr.14355) 12395 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:30 smithi171 bash[25040]: cluster 2024-09-14T03:07:29.980675+0000 mgr.a (mgr.14355) 12395 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:31 smithi007 bash[22722]: audit 2024-09-14T03:07:30.054970+0000 mgr.a (mgr.14355) 12396 : audit [DBG] from='client.270732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:31 smithi131 bash[24745]: audit 2024-09-14T03:07:30.054970+0000 mgr.a (mgr.14355) 12396 : audit [DBG] from='client.270732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:31 smithi171 bash[25040]: audit 2024-09-14T03:07:30.054970+0000 mgr.a (mgr.14355) 12396 : audit [DBG] from='client.270732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:32 smithi007 bash[22722]: cluster 2024-09-14T03:07:31.983569+0000 mgr.a (mgr.14355) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:32 smithi131 bash[24745]: cluster 2024-09-14T03:07:31.983569+0000 mgr.a (mgr.14355) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:32 smithi171 bash[25040]: cluster 2024-09-14T03:07:31.983569+0000 mgr.a (mgr.14355) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:34 smithi007 bash[22722]: cluster 2024-09-14T03:07:33.984517+0000 mgr.a (mgr.14355) 12398 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:07:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:34 smithi131 bash[24745]: cluster 2024-09-14T03:07:33.984517+0000 mgr.a (mgr.14355) 12398 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:07:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:34 smithi171 bash[25040]: cluster 2024-09-14T03:07:33.984517+0000 mgr.a (mgr.14355) 12398 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:07:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:35.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:35.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:36.261 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:36 smithi007 bash[22722]: audit 2024-09-14T03:07:35.832527+0000 mgr.a (mgr.14355) 12399 : audit [DBG] from='client.270807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:36 smithi007 bash[22722]: cluster 2024-09-14T03:07:35.985997+0000 mgr.a (mgr.14355) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:36 smithi131 bash[24745]: audit 2024-09-14T03:07:35.832527+0000 mgr.a (mgr.14355) 12399 : audit [DBG] from='client.270807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:36 smithi131 bash[24745]: cluster 2024-09-14T03:07:35.985997+0000 mgr.a (mgr.14355) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:36 smithi171 bash[25040]: audit 2024-09-14T03:07:35.832527+0000 mgr.a (mgr.14355) 12399 : audit [DBG] from='client.270807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:36 smithi171 bash[25040]: cluster 2024-09-14T03:07:35.985997+0000 mgr.a (mgr.14355) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:07:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:38 smithi007 bash[22722]: cluster 2024-09-14T03:07:37.987011+0000 mgr.a (mgr.14355) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:38 smithi131 bash[24745]: cluster 2024-09-14T03:07:37.987011+0000 mgr.a (mgr.14355) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:38 smithi171 bash[25040]: cluster 2024-09-14T03:07:37.987011+0000 mgr.a (mgr.14355) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:07:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:40 smithi007 bash[22722]: cluster 2024-09-14T03:07:39.987965+0000 mgr.a (mgr.14355) 12402 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:40 smithi131 bash[24745]: cluster 2024-09-14T03:07:39.987965+0000 mgr.a (mgr.14355) 12402 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:40 smithi171 bash[25040]: cluster 2024-09-14T03:07:39.987965+0000 mgr.a (mgr.14355) 12402 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:07:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:42.013 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:42.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:42 smithi007 bash[22722]: audit 2024-09-14T03:07:41.595579+0000 mgr.a (mgr.14355) 12403 : audit [DBG] from='client.270882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:42 smithi007 bash[22722]: cluster 2024-09-14T03:07:41.989458+0000 mgr.a (mgr.14355) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:42 smithi131 bash[24745]: audit 2024-09-14T03:07:41.595579+0000 mgr.a (mgr.14355) 12403 : audit [DBG] from='client.270882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:42 smithi131 bash[24745]: cluster 2024-09-14T03:07:41.989458+0000 mgr.a (mgr.14355) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:42 smithi171 bash[25040]: audit 2024-09-14T03:07:41.595579+0000 mgr.a (mgr.14355) 12403 : audit [DBG] from='client.270882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:42 smithi171 bash[25040]: cluster 2024-09-14T03:07:41.989458+0000 mgr.a (mgr.14355) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:44 smithi007 bash[22722]: cluster 2024-09-14T03:07:43.990182+0000 mgr.a (mgr.14355) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:44 smithi131 bash[24745]: cluster 2024-09-14T03:07:43.990182+0000 mgr.a (mgr.14355) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:44 smithi171 bash[25040]: cluster 2024-09-14T03:07:43.990182+0000 mgr.a (mgr.14355) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:46 smithi007 bash[22722]: cluster 2024-09-14T03:07:45.992170+0000 mgr.a (mgr.14355) 12406 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:46 smithi131 bash[24745]: cluster 2024-09-14T03:07:45.992170+0000 mgr.a (mgr.14355) 12406 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:46 smithi171 bash[25040]: cluster 2024-09-14T03:07:45.992170+0000 mgr.a (mgr.14355) 12406 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:47.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:47.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:47.015 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:47.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:47.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:47.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:47.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:47.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:48 smithi007 bash[22722]: audit 2024-09-14T03:07:47.349549+0000 mgr.a (mgr.14355) 12407 : audit [DBG] from='client.270960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:48 smithi007 bash[22722]: cluster 2024-09-14T03:07:47.993034+0000 mgr.a (mgr.14355) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:48 smithi131 bash[24745]: audit 2024-09-14T03:07:47.349549+0000 mgr.a (mgr.14355) 12407 : audit [DBG] from='client.270960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:48 smithi131 bash[24745]: cluster 2024-09-14T03:07:47.993034+0000 mgr.a (mgr.14355) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:48 smithi171 bash[25040]: audit 2024-09-14T03:07:47.349549+0000 mgr.a (mgr.14355) 12407 : audit [DBG] from='client.270960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:48 smithi171 bash[25040]: cluster 2024-09-14T03:07:47.993034+0000 mgr.a (mgr.14355) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:50 smithi007 bash[22722]: cluster 2024-09-14T03:07:49.993812+0000 mgr.a (mgr.14355) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:50 smithi131 bash[24745]: cluster 2024-09-14T03:07:49.993812+0000 mgr.a (mgr.14355) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:50 smithi171 bash[25040]: cluster 2024-09-14T03:07:49.993812+0000 mgr.a (mgr.14355) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:52 smithi007 bash[22722]: cluster 2024-09-14T03:07:51.996070+0000 mgr.a (mgr.14355) 12410 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:52 smithi131 bash[24745]: cluster 2024-09-14T03:07:51.996070+0000 mgr.a (mgr.14355) 12410 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:52 smithi171 bash[25040]: cluster 2024-09-14T03:07:51.996070+0000 mgr.a (mgr.14355) 12410 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:52.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:53.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:54 smithi007 bash[22722]: audit 2024-09-14T03:07:53.122673+0000 mgr.a (mgr.14355) 12411 : audit [DBG] from='client.271035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:54 smithi007 bash[22722]: cluster 2024-09-14T03:07:53.996980+0000 mgr.a (mgr.14355) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:54 smithi131 bash[24745]: audit 2024-09-14T03:07:53.122673+0000 mgr.a (mgr.14355) 12411 : audit [DBG] from='client.271035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:54 smithi131 bash[24745]: cluster 2024-09-14T03:07:53.996980+0000 mgr.a (mgr.14355) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:54 smithi171 bash[25040]: audit 2024-09-14T03:07:53.122673+0000 mgr.a (mgr.14355) 12411 : audit [DBG] from='client.271035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:54 smithi171 bash[25040]: cluster 2024-09-14T03:07:53.996980+0000 mgr.a (mgr.14355) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:56 smithi007 bash[22722]: cluster 2024-09-14T03:07:55.999311+0000 mgr.a (mgr.14355) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:56 smithi131 bash[24745]: cluster 2024-09-14T03:07:55.999311+0000 mgr.a (mgr.14355) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:56 smithi171 bash[25040]: cluster 2024-09-14T03:07:55.999311+0000 mgr.a (mgr.14355) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:07:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:58 smithi007 bash[22722]: cluster 2024-09-14T03:07:58.000241+0000 mgr.a (mgr.14355) 12414 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:58 smithi131 bash[24745]: cluster 2024-09-14T03:07:58.000241+0000 mgr.a (mgr.14355) 12414 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:58 smithi171 bash[25040]: cluster 2024-09-14T03:07:58.000241+0000 mgr.a (mgr.14355) 12414 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:07:58.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:07:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:07:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:07:59.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:07:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:07:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:07:59.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:07:59.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:07:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:07:59 smithi007 bash[22722]: audit 2024-09-14T03:07:58.885973+0000 mgr.a (mgr.14355) 12415 : audit [DBG] from='client.271107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:07:59 smithi131 bash[24745]: audit 2024-09-14T03:07:58.885973+0000 mgr.a (mgr.14355) 12415 : audit [DBG] from='client.271107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:07:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:07:59 smithi171 bash[25040]: audit 2024-09-14T03:07:58.885973+0000 mgr.a (mgr.14355) 12415 : audit [DBG] from='client.271107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:00 smithi007 bash[22722]: cluster 2024-09-14T03:08:00.001219+0000 mgr.a (mgr.14355) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:00 smithi131 bash[24745]: cluster 2024-09-14T03:08:00.001219+0000 mgr.a (mgr.14355) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:00 smithi171 bash[25040]: cluster 2024-09-14T03:08:00.001219+0000 mgr.a (mgr.14355) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:02 smithi007 bash[22722]: cluster 2024-09-14T03:08:02.003524+0000 mgr.a (mgr.14355) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:02 smithi131 bash[24745]: cluster 2024-09-14T03:08:02.003524+0000 mgr.a (mgr.14355) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:02 smithi171 bash[25040]: cluster 2024-09-14T03:08:02.003524+0000 mgr.a (mgr.14355) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:04.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:04.307 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:04.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:04 smithi007 bash[22722]: cluster 2024-09-14T03:08:04.004284+0000 mgr.a (mgr.14355) 12418 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:04 smithi131 bash[24745]: cluster 2024-09-14T03:08:04.004284+0000 mgr.a (mgr.14355) 12418 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:04 smithi171 bash[25040]: cluster 2024-09-14T03:08:04.004284+0000 mgr.a (mgr.14355) 12418 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:05.068 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:05.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:05.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:05.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:05.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:05 smithi007 bash[22722]: audit 2024-09-14T03:08:04.637904+0000 mgr.a (mgr.14355) 12419 : audit [DBG] from='client.271182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:05 smithi131 bash[24745]: audit 2024-09-14T03:08:04.637904+0000 mgr.a (mgr.14355) 12419 : audit [DBG] from='client.271182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:05 smithi171 bash[25040]: audit 2024-09-14T03:08:04.637904+0000 mgr.a (mgr.14355) 12419 : audit [DBG] from='client.271182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:06 smithi007 bash[22722]: cluster 2024-09-14T03:08:06.006733+0000 mgr.a (mgr.14355) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:06 smithi131 bash[24745]: cluster 2024-09-14T03:08:06.006733+0000 mgr.a (mgr.14355) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:06 smithi171 bash[25040]: cluster 2024-09-14T03:08:06.006733+0000 mgr.a (mgr.14355) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:08 smithi007 bash[22722]: cluster 2024-09-14T03:08:08.007658+0000 mgr.a (mgr.14355) 12421 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:08 smithi131 bash[24745]: cluster 2024-09-14T03:08:08.007658+0000 mgr.a (mgr.14355) 12421 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:08 smithi171 bash[25040]: cluster 2024-09-14T03:08:08.007658+0000 mgr.a (mgr.14355) 12421 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:10 smithi007 bash[22722]: cluster 2024-09-14T03:08:10.008484+0000 mgr.a (mgr.14355) 12422 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:10 smithi131 bash[24745]: cluster 2024-09-14T03:08:10.008484+0000 mgr.a (mgr.14355) 12422 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:10 smithi171 bash[25040]: cluster 2024-09-14T03:08:10.008484+0000 mgr.a (mgr.14355) 12422 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:10.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:10.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:10.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:10.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:10.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:11 smithi007 bash[22722]: audit 2024-09-14T03:08:10.404628+0000 mgr.a (mgr.14355) 12423 : audit [DBG] from='client.271257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:11 smithi131 bash[24745]: audit 2024-09-14T03:08:10.404628+0000 mgr.a (mgr.14355) 12423 : audit [DBG] from='client.271257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:11 smithi171 bash[25040]: audit 2024-09-14T03:08:10.404628+0000 mgr.a (mgr.14355) 12423 : audit [DBG] from='client.271257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:12 smithi007 bash[22722]: cluster 2024-09-14T03:08:12.011199+0000 mgr.a (mgr.14355) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:12 smithi131 bash[24745]: cluster 2024-09-14T03:08:12.011199+0000 mgr.a (mgr.14355) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:12 smithi171 bash[25040]: cluster 2024-09-14T03:08:12.011199+0000 mgr.a (mgr.14355) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:14 smithi007 bash[22722]: cluster 2024-09-14T03:08:14.012000+0000 mgr.a (mgr.14355) 12425 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:14 smithi131 bash[24745]: cluster 2024-09-14T03:08:14.012000+0000 mgr.a (mgr.14355) 12425 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:14 smithi171 bash[25040]: cluster 2024-09-14T03:08:14.012000+0000 mgr.a (mgr.14355) 12425 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:15.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:16 smithi007 bash[22722]: cluster 2024-09-14T03:08:16.013258+0000 mgr.a (mgr.14355) 12426 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:16 smithi131 bash[24745]: cluster 2024-09-14T03:08:16.013258+0000 mgr.a (mgr.14355) 12426 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:16 smithi171 bash[25040]: cluster 2024-09-14T03:08:16.013258+0000 mgr.a (mgr.14355) 12426 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:16.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:17 smithi007 bash[22722]: audit 2024-09-14T03:08:16.198624+0000 mgr.a (mgr.14355) 12427 : audit [DBG] from='client.271335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:17 smithi131 bash[24745]: audit 2024-09-14T03:08:16.198624+0000 mgr.a (mgr.14355) 12427 : audit [DBG] from='client.271335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:17 smithi171 bash[25040]: audit 2024-09-14T03:08:16.198624+0000 mgr.a (mgr.14355) 12427 : audit [DBG] from='client.271335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:18 smithi007 bash[22722]: cluster 2024-09-14T03:08:18.014119+0000 mgr.a (mgr.14355) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:18 smithi131 bash[24745]: cluster 2024-09-14T03:08:18.014119+0000 mgr.a (mgr.14355) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:18 smithi171 bash[25040]: cluster 2024-09-14T03:08:18.014119+0000 mgr.a (mgr.14355) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:20 smithi007 bash[22722]: cluster 2024-09-14T03:08:20.014915+0000 mgr.a (mgr.14355) 12429 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:20 smithi131 bash[24745]: cluster 2024-09-14T03:08:20.014915+0000 mgr.a (mgr.14355) 12429 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:20 smithi171 bash[25040]: cluster 2024-09-14T03:08:20.014915+0000 mgr.a (mgr.14355) 12429 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:21.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:21 smithi007 bash[22722]: audit 2024-09-14T03:08:21.808406+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:08:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:21 smithi131 bash[24745]: audit 2024-09-14T03:08:21.808406+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:08:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:21 smithi171 bash[25040]: audit 2024-09-14T03:08:21.808406+0000 mon.a (mon.0) 2449 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:08:22.427 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:22.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:22.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:22.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:22.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: audit 2024-09-14T03:08:21.974259+0000 mgr.a (mgr.14355) 12430 : audit [DBG] from='client.271410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: cluster 2024-09-14T03:08:22.017868+0000 mgr.a (mgr.14355) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: audit 2024-09-14T03:08:22.603374+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: audit 2024-09-14T03:08:22.604894+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: audit 2024-09-14T03:08:22.612667+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:08:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:22 smithi007 bash[22722]: audit 2024-09-14T03:08:22.614921+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: audit 2024-09-14T03:08:21.974259+0000 mgr.a (mgr.14355) 12430 : audit [DBG] from='client.271410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: cluster 2024-09-14T03:08:22.017868+0000 mgr.a (mgr.14355) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: audit 2024-09-14T03:08:22.603374+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:08:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: audit 2024-09-14T03:08:22.604894+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:08:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: audit 2024-09-14T03:08:22.612667+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:08:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:22 smithi131 bash[24745]: audit 2024-09-14T03:08:22.614921+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: audit 2024-09-14T03:08:21.974259+0000 mgr.a (mgr.14355) 12430 : audit [DBG] from='client.271410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: cluster 2024-09-14T03:08:22.017868+0000 mgr.a (mgr.14355) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: audit 2024-09-14T03:08:22.603374+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:08:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: audit 2024-09-14T03:08:22.604894+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:08:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: audit 2024-09-14T03:08:22.612667+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:08:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:22 smithi171 bash[25040]: audit 2024-09-14T03:08:22.614921+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:08:23 smithi007 bash[22972]: debug 2024-09-14T03:08:23.333+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:08:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:08:23 smithi007 bash[22972]: debug 2024-09-14T03:08:23.333+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:08:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:23 smithi007 bash[22722]: audit 2024-09-14T03:08:22.617706+0000 mgr.a (mgr.14355) 12432 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:23 smithi131 bash[24745]: audit 2024-09-14T03:08:22.617706+0000 mgr.a (mgr.14355) 12432 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:23 smithi171 bash[25040]: audit 2024-09-14T03:08:22.617706+0000 mgr.a (mgr.14355) 12432 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:08:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:24 smithi007 bash[22722]: audit 2024-09-14T03:08:23.335523+0000 mgr.a (mgr.14355) 12433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:08:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:24 smithi007 bash[22722]: cephadm 2024-09-14T03:08:23.336751+0000 mgr.a (mgr.14355) 12434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:08:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:24 smithi007 bash[22722]: cluster 2024-09-14T03:08:24.018898+0000 mgr.a (mgr.14355) 12435 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:24 smithi131 bash[24745]: audit 2024-09-14T03:08:23.335523+0000 mgr.a (mgr.14355) 12433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:08:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:24 smithi131 bash[24745]: cephadm 2024-09-14T03:08:23.336751+0000 mgr.a (mgr.14355) 12434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:08:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:24 smithi131 bash[24745]: cluster 2024-09-14T03:08:24.018898+0000 mgr.a (mgr.14355) 12435 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:24 smithi171 bash[25040]: audit 2024-09-14T03:08:23.335523+0000 mgr.a (mgr.14355) 12433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:08:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:24 smithi171 bash[25040]: cephadm 2024-09-14T03:08:23.336751+0000 mgr.a (mgr.14355) 12434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:08:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:24 smithi171 bash[25040]: cluster 2024-09-14T03:08:24.018898+0000 mgr.a (mgr.14355) 12435 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:26 smithi007 bash[22722]: cluster 2024-09-14T03:08:26.021117+0000 mgr.a (mgr.14355) 12436 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:26 smithi131 bash[24745]: cluster 2024-09-14T03:08:26.021117+0000 mgr.a (mgr.14355) 12436 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:26 smithi171 bash[25040]: cluster 2024-09-14T03:08:26.021117+0000 mgr.a (mgr.14355) 12436 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:27.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:27.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:27.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:28.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:28.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:28.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:28 smithi007 bash[22722]: audit 2024-09-14T03:08:27.767241+0000 mgr.a (mgr.14355) 12437 : audit [DBG] from='client.271587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:28.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:28 smithi007 bash[22722]: cluster 2024-09-14T03:08:28.021684+0000 mgr.a (mgr.14355) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:28 smithi131 bash[24745]: audit 2024-09-14T03:08:27.767241+0000 mgr.a (mgr.14355) 12437 : audit [DBG] from='client.271587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:28 smithi131 bash[24745]: cluster 2024-09-14T03:08:28.021684+0000 mgr.a (mgr.14355) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:28 smithi171 bash[25040]: audit 2024-09-14T03:08:27.767241+0000 mgr.a (mgr.14355) 12437 : audit [DBG] from='client.271587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:28 smithi171 bash[25040]: cluster 2024-09-14T03:08:28.021684+0000 mgr.a (mgr.14355) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:30 smithi007 bash[22722]: cluster 2024-09-14T03:08:30.022592+0000 mgr.a (mgr.14355) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:30 smithi131 bash[24745]: cluster 2024-09-14T03:08:30.022592+0000 mgr.a (mgr.14355) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:30 smithi171 bash[25040]: cluster 2024-09-14T03:08:30.022592+0000 mgr.a (mgr.14355) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:32 smithi007 bash[22722]: cluster 2024-09-14T03:08:32.024796+0000 mgr.a (mgr.14355) 12440 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:32 smithi131 bash[24745]: cluster 2024-09-14T03:08:32.024796+0000 mgr.a (mgr.14355) 12440 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:32 smithi171 bash[25040]: cluster 2024-09-14T03:08:32.024796+0000 mgr.a (mgr.14355) 12440 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:33.966 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:33.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:34 smithi007 bash[22722]: audit 2024-09-14T03:08:33.549004+0000 mgr.a (mgr.14355) 12441 : audit [DBG] from='client.271662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:34 smithi007 bash[22722]: cluster 2024-09-14T03:08:34.025738+0000 mgr.a (mgr.14355) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:34 smithi131 bash[24745]: audit 2024-09-14T03:08:33.549004+0000 mgr.a (mgr.14355) 12441 : audit [DBG] from='client.271662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:34 smithi131 bash[24745]: cluster 2024-09-14T03:08:34.025738+0000 mgr.a (mgr.14355) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:34 smithi171 bash[25040]: audit 2024-09-14T03:08:33.549004+0000 mgr.a (mgr.14355) 12441 : audit [DBG] from='client.271662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:34 smithi171 bash[25040]: cluster 2024-09-14T03:08:34.025738+0000 mgr.a (mgr.14355) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:36 smithi007 bash[22722]: cluster 2024-09-14T03:08:36.027977+0000 mgr.a (mgr.14355) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:36 smithi131 bash[24745]: cluster 2024-09-14T03:08:36.027977+0000 mgr.a (mgr.14355) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:36 smithi171 bash[25040]: cluster 2024-09-14T03:08:36.027977+0000 mgr.a (mgr.14355) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:08:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:38 smithi007 bash[22722]: cluster 2024-09-14T03:08:38.028781+0000 mgr.a (mgr.14355) 12444 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:38 smithi131 bash[24745]: cluster 2024-09-14T03:08:38.028781+0000 mgr.a (mgr.14355) 12444 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:38 smithi171 bash[25040]: cluster 2024-09-14T03:08:38.028781+0000 mgr.a (mgr.14355) 12444 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:38.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:38.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:38.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:39.720 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:39.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:39.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:39.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:39.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:40 smithi007 bash[22722]: audit 2024-09-14T03:08:39.295560+0000 mgr.a (mgr.14355) 12445 : audit [DBG] from='client.271737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:40 smithi007 bash[22722]: cluster 2024-09-14T03:08:40.029754+0000 mgr.a (mgr.14355) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:40 smithi131 bash[24745]: audit 2024-09-14T03:08:39.295560+0000 mgr.a (mgr.14355) 12445 : audit [DBG] from='client.271737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:40 smithi131 bash[24745]: cluster 2024-09-14T03:08:40.029754+0000 mgr.a (mgr.14355) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:40 smithi171 bash[25040]: audit 2024-09-14T03:08:39.295560+0000 mgr.a (mgr.14355) 12445 : audit [DBG] from='client.271737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:40 smithi171 bash[25040]: cluster 2024-09-14T03:08:40.029754+0000 mgr.a (mgr.14355) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:42 smithi007 bash[22722]: cluster 2024-09-14T03:08:42.032034+0000 mgr.a (mgr.14355) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:42 smithi131 bash[24745]: cluster 2024-09-14T03:08:42.032034+0000 mgr.a (mgr.14355) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:42 smithi171 bash[25040]: cluster 2024-09-14T03:08:42.032034+0000 mgr.a (mgr.14355) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:08:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:44 smithi007 bash[22722]: cluster 2024-09-14T03:08:44.032760+0000 mgr.a (mgr.14355) 12448 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:44 smithi131 bash[24745]: cluster 2024-09-14T03:08:44.032760+0000 mgr.a (mgr.14355) 12448 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:44 smithi171 bash[25040]: cluster 2024-09-14T03:08:44.032760+0000 mgr.a (mgr.14355) 12448 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:45.507 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:46.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:46 smithi007 bash[22722]: audit 2024-09-14T03:08:45.061007+0000 mgr.a (mgr.14355) 12449 : audit [DBG] from='client.271815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:46.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:46 smithi007 bash[22722]: cluster 2024-09-14T03:08:46.035677+0000 mgr.a (mgr.14355) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:46 smithi131 bash[24745]: audit 2024-09-14T03:08:45.061007+0000 mgr.a (mgr.14355) 12449 : audit [DBG] from='client.271815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:46 smithi131 bash[24745]: cluster 2024-09-14T03:08:46.035677+0000 mgr.a (mgr.14355) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:46 smithi171 bash[25040]: audit 2024-09-14T03:08:45.061007+0000 mgr.a (mgr.14355) 12449 : audit [DBG] from='client.271815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:46 smithi171 bash[25040]: cluster 2024-09-14T03:08:46.035677+0000 mgr.a (mgr.14355) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:48 smithi007 bash[22722]: cluster 2024-09-14T03:08:48.036485+0000 mgr.a (mgr.14355) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:48 smithi131 bash[24745]: cluster 2024-09-14T03:08:48.036485+0000 mgr.a (mgr.14355) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:48 smithi171 bash[25040]: cluster 2024-09-14T03:08:48.036485+0000 mgr.a (mgr.14355) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:50 smithi007 bash[22722]: cluster 2024-09-14T03:08:50.037455+0000 mgr.a (mgr.14355) 12452 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:50.508 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:50.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:50.509 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:50 smithi131 bash[24745]: cluster 2024-09-14T03:08:50.037455+0000 mgr.a (mgr.14355) 12452 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:50 smithi171 bash[25040]: cluster 2024-09-14T03:08:50.037455+0000 mgr.a (mgr.14355) 12452 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:08:51.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:51 smithi007 bash[22722]: audit 2024-09-14T03:08:50.843045+0000 mgr.a (mgr.14355) 12453 : audit [DBG] from='client.271893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:51 smithi131 bash[24745]: audit 2024-09-14T03:08:50.843045+0000 mgr.a (mgr.14355) 12453 : audit [DBG] from='client.271893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:51 smithi171 bash[25040]: audit 2024-09-14T03:08:50.843045+0000 mgr.a (mgr.14355) 12453 : audit [DBG] from='client.271893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:52 smithi007 bash[22722]: cluster 2024-09-14T03:08:52.040355+0000 mgr.a (mgr.14355) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:52 smithi131 bash[24745]: cluster 2024-09-14T03:08:52.040355+0000 mgr.a (mgr.14355) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:52 smithi171 bash[25040]: cluster 2024-09-14T03:08:52.040355+0000 mgr.a (mgr.14355) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:55 smithi007 bash[22722]: cluster 2024-09-14T03:08:54.041136+0000 mgr.a (mgr.14355) 12455 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:55 smithi131 bash[24745]: cluster 2024-09-14T03:08:54.041136+0000 mgr.a (mgr.14355) 12455 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:55 smithi171 bash[25040]: cluster 2024-09-14T03:08:54.041136+0000 mgr.a (mgr.14355) 12455 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:08:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:08:56.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:08:56.289 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:08:57.056 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:08:57.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:08:57.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:08:57.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:08:57.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:08:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:57 smithi007 bash[22722]: cluster 2024-09-14T03:08:56.043212+0000 mgr.a (mgr.14355) 12456 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:57 smithi007 bash[22722]: audit 2024-09-14T03:08:56.625471+0000 mgr.a (mgr.14355) 12457 : audit [DBG] from='client.271971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:57 smithi131 bash[24745]: cluster 2024-09-14T03:08:56.043212+0000 mgr.a (mgr.14355) 12456 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:57 smithi131 bash[24745]: audit 2024-09-14T03:08:56.625471+0000 mgr.a (mgr.14355) 12457 : audit [DBG] from='client.271971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:57 smithi171 bash[25040]: cluster 2024-09-14T03:08:56.043212+0000 mgr.a (mgr.14355) 12456 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:57 smithi171 bash[25040]: audit 2024-09-14T03:08:56.625471+0000 mgr.a (mgr.14355) 12457 : audit [DBG] from='client.271971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:08:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:08:59 smithi007 bash[22722]: cluster 2024-09-14T03:08:58.044110+0000 mgr.a (mgr.14355) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:08:59 smithi131 bash[24745]: cluster 2024-09-14T03:08:58.044110+0000 mgr.a (mgr.14355) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:08:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:08:59 smithi171 bash[25040]: cluster 2024-09-14T03:08:58.044110+0000 mgr.a (mgr.14355) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:01 smithi007 bash[22722]: cluster 2024-09-14T03:09:00.044900+0000 mgr.a (mgr.14355) 12459 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:01 smithi131 bash[24745]: cluster 2024-09-14T03:09:00.044900+0000 mgr.a (mgr.14355) 12459 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:01 smithi171 bash[25040]: cluster 2024-09-14T03:09:00.044900+0000 mgr.a (mgr.14355) 12459 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:02.817 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:02.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:02.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:02.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:02.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:03 smithi007 bash[22722]: cluster 2024-09-14T03:09:02.047155+0000 mgr.a (mgr.14355) 12460 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:03 smithi007 bash[22722]: audit 2024-09-14T03:09:02.389168+0000 mgr.a (mgr.14355) 12461 : audit [DBG] from='client.272046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:03 smithi131 bash[24745]: cluster 2024-09-14T03:09:02.047155+0000 mgr.a (mgr.14355) 12460 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:03 smithi131 bash[24745]: audit 2024-09-14T03:09:02.389168+0000 mgr.a (mgr.14355) 12461 : audit [DBG] from='client.272046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:03 smithi171 bash[25040]: cluster 2024-09-14T03:09:02.047155+0000 mgr.a (mgr.14355) 12460 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:03 smithi171 bash[25040]: audit 2024-09-14T03:09:02.389168+0000 mgr.a (mgr.14355) 12461 : audit [DBG] from='client.272046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:05 smithi007 bash[22722]: cluster 2024-09-14T03:09:04.048101+0000 mgr.a (mgr.14355) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:05 smithi131 bash[24745]: cluster 2024-09-14T03:09:04.048101+0000 mgr.a (mgr.14355) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:05 smithi171 bash[25040]: cluster 2024-09-14T03:09:04.048101+0000 mgr.a (mgr.14355) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:07 smithi007 bash[22722]: cluster 2024-09-14T03:09:06.050324+0000 mgr.a (mgr.14355) 12463 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:07 smithi131 bash[24745]: cluster 2024-09-14T03:09:06.050324+0000 mgr.a (mgr.14355) 12463 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:07 smithi171 bash[25040]: cluster 2024-09-14T03:09:06.050324+0000 mgr.a (mgr.14355) 12463 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:07.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:07.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:07.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:08.569 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:09 smithi007 bash[22722]: cluster 2024-09-14T03:09:08.051010+0000 mgr.a (mgr.14355) 12464 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:09 smithi007 bash[22722]: audit 2024-09-14T03:09:08.140237+0000 mgr.a (mgr.14355) 12465 : audit [DBG] from='client.272121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:09 smithi131 bash[24745]: cluster 2024-09-14T03:09:08.051010+0000 mgr.a (mgr.14355) 12464 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:09 smithi131 bash[24745]: audit 2024-09-14T03:09:08.140237+0000 mgr.a (mgr.14355) 12465 : audit [DBG] from='client.272121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:09 smithi171 bash[25040]: cluster 2024-09-14T03:09:08.051010+0000 mgr.a (mgr.14355) 12464 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:09 smithi171 bash[25040]: audit 2024-09-14T03:09:08.140237+0000 mgr.a (mgr.14355) 12465 : audit [DBG] from='client.272121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:11 smithi007 bash[22722]: cluster 2024-09-14T03:09:10.051884+0000 mgr.a (mgr.14355) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:11 smithi131 bash[24745]: cluster 2024-09-14T03:09:10.051884+0000 mgr.a (mgr.14355) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:11 smithi171 bash[25040]: cluster 2024-09-14T03:09:10.051884+0000 mgr.a (mgr.14355) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:13 smithi007 bash[22722]: cluster 2024-09-14T03:09:12.054173+0000 mgr.a (mgr.14355) 12467 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:13 smithi131 bash[24745]: cluster 2024-09-14T03:09:12.054173+0000 mgr.a (mgr.14355) 12467 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:13 smithi171 bash[25040]: cluster 2024-09-14T03:09:12.054173+0000 mgr.a (mgr.14355) 12467 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:14.328 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:14.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:14.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:14.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:14.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:14 smithi007 bash[22722]: audit 2024-09-14T03:09:13.901676+0000 mgr.a (mgr.14355) 12468 : audit [DBG] from='client.272199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:14 smithi131 bash[24745]: audit 2024-09-14T03:09:13.901676+0000 mgr.a (mgr.14355) 12468 : audit [DBG] from='client.272199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:14 smithi171 bash[25040]: audit 2024-09-14T03:09:13.901676+0000 mgr.a (mgr.14355) 12468 : audit [DBG] from='client.272199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:15 smithi007 bash[22722]: cluster 2024-09-14T03:09:14.054788+0000 mgr.a (mgr.14355) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:15 smithi131 bash[24745]: cluster 2024-09-14T03:09:14.054788+0000 mgr.a (mgr.14355) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:15 smithi171 bash[25040]: cluster 2024-09-14T03:09:14.054788+0000 mgr.a (mgr.14355) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:17 smithi007 bash[22722]: cluster 2024-09-14T03:09:16.057053+0000 mgr.a (mgr.14355) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:17 smithi131 bash[24745]: cluster 2024-09-14T03:09:16.057053+0000 mgr.a (mgr.14355) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:17 smithi171 bash[25040]: cluster 2024-09-14T03:09:16.057053+0000 mgr.a (mgr.14355) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:19.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:19.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:19 smithi007 bash[22722]: cluster 2024-09-14T03:09:18.057825+0000 mgr.a (mgr.14355) 12471 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:19 smithi131 bash[24745]: cluster 2024-09-14T03:09:18.057825+0000 mgr.a (mgr.14355) 12471 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:19 smithi171 bash[25040]: cluster 2024-09-14T03:09:18.057825+0000 mgr.a (mgr.14355) 12471 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:20.096 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:20 smithi007 bash[22722]: audit 2024-09-14T03:09:19.664901+0000 mgr.a (mgr.14355) 12472 : audit [DBG] from='client.272277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:20 smithi131 bash[24745]: audit 2024-09-14T03:09:19.664901+0000 mgr.a (mgr.14355) 12472 : audit [DBG] from='client.272277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:20 smithi171 bash[25040]: audit 2024-09-14T03:09:19.664901+0000 mgr.a (mgr.14355) 12472 : audit [DBG] from='client.272277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:21 smithi007 bash[22722]: cluster 2024-09-14T03:09:20.058453+0000 mgr.a (mgr.14355) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:21 smithi131 bash[24745]: cluster 2024-09-14T03:09:20.058453+0000 mgr.a (mgr.14355) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:21 smithi171 bash[25040]: cluster 2024-09-14T03:09:20.058453+0000 mgr.a (mgr.14355) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:23 smithi007 bash[22722]: cluster 2024-09-14T03:09:22.060610+0000 mgr.a (mgr.14355) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:23 smithi131 bash[24745]: cluster 2024-09-14T03:09:22.060610+0000 mgr.a (mgr.14355) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:23.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:23 smithi171 bash[25040]: cluster 2024-09-14T03:09:22.060610+0000 mgr.a (mgr.14355) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:24 smithi007 bash[22722]: audit 2024-09-14T03:09:23.385909+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:09:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:24 smithi007 bash[22722]: audit 2024-09-14T03:09:24.007853+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:24 smithi007 bash[22722]: audit 2024-09-14T03:09:24.011023+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:24 smithi131 bash[24745]: audit 2024-09-14T03:09:23.385909+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:09:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:24 smithi131 bash[24745]: audit 2024-09-14T03:09:24.007853+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:24 smithi131 bash[24745]: audit 2024-09-14T03:09:24.011023+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:24 smithi171 bash[25040]: audit 2024-09-14T03:09:23.385909+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:09:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:24 smithi171 bash[25040]: audit 2024-09-14T03:09:24.007853+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:24 smithi171 bash[25040]: audit 2024-09-14T03:09:24.011023+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:25.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:25.098 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:25.098 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: cluster 2024-09-14T03:09:24.061344+0000 mgr.a (mgr.14355) 12475 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: audit 2024-09-14T03:09:24.797751+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: audit 2024-09-14T03:09:24.798992+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: audit 2024-09-14T03:09:24.808566+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: audit 2024-09-14T03:09:24.813263+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22722]: audit 2024-09-14T03:09:24.815508+0000 mgr.a (mgr.14355) 12476 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: cluster 2024-09-14T03:09:24.061344+0000 mgr.a (mgr.14355) 12475 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: audit 2024-09-14T03:09:24.797751+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:09:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: audit 2024-09-14T03:09:24.798992+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:09:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: audit 2024-09-14T03:09:24.808566+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: audit 2024-09-14T03:09:24.813263+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:25 smithi131 bash[24745]: audit 2024-09-14T03:09:24.815508+0000 mgr.a (mgr.14355) 12476 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: cluster 2024-09-14T03:09:24.061344+0000 mgr.a (mgr.14355) 12475 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: audit 2024-09-14T03:09:24.797751+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: audit 2024-09-14T03:09:24.798992+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: audit 2024-09-14T03:09:24.808566+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: audit 2024-09-14T03:09:24.813263+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:25 smithi171 bash[25040]: audit 2024-09-14T03:09:24.815508+0000 mgr.a (mgr.14355) 12476 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:09:25.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22972]: debug 2024-09-14T03:09:25.572+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:09:25.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:09:25 smithi007 bash[22972]: debug 2024-09-14T03:09:25.584+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:09:25.990 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:25.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:26 smithi007 bash[22722]: audit 2024-09-14T03:09:25.448743+0000 mgr.a (mgr.14355) 12477 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:26 smithi007 bash[22722]: audit 2024-09-14T03:09:25.574987+0000 mgr.a (mgr.14355) 12478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:09:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:26 smithi007 bash[22722]: cephadm 2024-09-14T03:09:25.587873+0000 mgr.a (mgr.14355) 12479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:09:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:26 smithi131 bash[24745]: audit 2024-09-14T03:09:25.448743+0000 mgr.a (mgr.14355) 12477 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:26 smithi131 bash[24745]: audit 2024-09-14T03:09:25.574987+0000 mgr.a (mgr.14355) 12478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:09:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:26 smithi131 bash[24745]: cephadm 2024-09-14T03:09:25.587873+0000 mgr.a (mgr.14355) 12479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:09:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:26 smithi171 bash[25040]: audit 2024-09-14T03:09:25.448743+0000 mgr.a (mgr.14355) 12477 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:26 smithi171 bash[25040]: audit 2024-09-14T03:09:25.574987+0000 mgr.a (mgr.14355) 12478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:09:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:26 smithi171 bash[25040]: cephadm 2024-09-14T03:09:25.587873+0000 mgr.a (mgr.14355) 12479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:09:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:27 smithi007 bash[22722]: cluster 2024-09-14T03:09:26.063097+0000 mgr.a (mgr.14355) 12480 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:09:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:27 smithi131 bash[24745]: cluster 2024-09-14T03:09:26.063097+0000 mgr.a (mgr.14355) 12480 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:09:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:27 smithi171 bash[25040]: cluster 2024-09-14T03:09:26.063097+0000 mgr.a (mgr.14355) 12480 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:09:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:29 smithi007 bash[22722]: cluster 2024-09-14T03:09:28.063828+0000 mgr.a (mgr.14355) 12481 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:29 smithi131 bash[24745]: cluster 2024-09-14T03:09:28.063828+0000 mgr.a (mgr.14355) 12481 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:29 smithi171 bash[25040]: cluster 2024-09-14T03:09:28.063828+0000 mgr.a (mgr.14355) 12481 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:30.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:30.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:31.453 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:31 smithi007 bash[22722]: cluster 2024-09-14T03:09:30.064623+0000 mgr.a (mgr.14355) 12482 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:31 smithi131 bash[24745]: cluster 2024-09-14T03:09:30.064623+0000 mgr.a (mgr.14355) 12482 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:31 smithi171 bash[25040]: cluster 2024-09-14T03:09:30.064623+0000 mgr.a (mgr.14355) 12482 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:09:31.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:31.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:32 smithi007 bash[22722]: audit 2024-09-14T03:09:31.323219+0000 mgr.a (mgr.14355) 12483 : audit [DBG] from='client.272541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:32 smithi131 bash[24745]: audit 2024-09-14T03:09:31.323219+0000 mgr.a (mgr.14355) 12483 : audit [DBG] from='client.272541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:32.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:32 smithi171 bash[25040]: audit 2024-09-14T03:09:31.323219+0000 mgr.a (mgr.14355) 12483 : audit [DBG] from='client.272541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:33 smithi007 bash[22722]: cluster 2024-09-14T03:09:32.067425+0000 mgr.a (mgr.14355) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:33 smithi131 bash[24745]: cluster 2024-09-14T03:09:32.067425+0000 mgr.a (mgr.14355) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:33 smithi171 bash[25040]: cluster 2024-09-14T03:09:32.067425+0000 mgr.a (mgr.14355) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:35 smithi007 bash[22722]: cluster 2024-09-14T03:09:34.068216+0000 mgr.a (mgr.14355) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:09:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:35 smithi131 bash[24745]: cluster 2024-09-14T03:09:34.068216+0000 mgr.a (mgr.14355) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:09:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:35 smithi171 bash[25040]: cluster 2024-09-14T03:09:34.068216+0000 mgr.a (mgr.14355) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:09:36.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:36.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:36.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:37 smithi131 bash[24745]: cluster 2024-09-14T03:09:36.070190+0000 mgr.a (mgr.14355) 12486 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:37.535 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:37.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:37 smithi171 bash[25040]: cluster 2024-09-14T03:09:36.070190+0000 mgr.a (mgr.14355) 12486 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:37 smithi007 bash[22722]: cluster 2024-09-14T03:09:36.070190+0000 mgr.a (mgr.14355) 12486 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:09:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:38 smithi131 bash[24745]: audit 2024-09-14T03:09:37.086530+0000 mgr.a (mgr.14355) 12487 : audit [DBG] from='client.272616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:38 smithi171 bash[25040]: audit 2024-09-14T03:09:37.086530+0000 mgr.a (mgr.14355) 12487 : audit [DBG] from='client.272616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:38 smithi007 bash[22722]: audit 2024-09-14T03:09:37.086530+0000 mgr.a (mgr.14355) 12487 : audit [DBG] from='client.272616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:39 smithi131 bash[24745]: cluster 2024-09-14T03:09:38.071124+0000 mgr.a (mgr.14355) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:39 smithi171 bash[25040]: cluster 2024-09-14T03:09:38.071124+0000 mgr.a (mgr.14355) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:39 smithi007 bash[22722]: cluster 2024-09-14T03:09:38.071124+0000 mgr.a (mgr.14355) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:41 smithi131 bash[24745]: cluster 2024-09-14T03:09:40.071907+0000 mgr.a (mgr.14355) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:41 smithi171 bash[25040]: cluster 2024-09-14T03:09:40.071907+0000 mgr.a (mgr.14355) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:41 smithi007 bash[22722]: cluster 2024-09-14T03:09:40.071907+0000 mgr.a (mgr.14355) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:42.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:42.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:42.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:43.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:43.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:43 smithi131 bash[24745]: cluster 2024-09-14T03:09:42.074148+0000 mgr.a (mgr.14355) 12490 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:43 smithi131 bash[24745]: audit 2024-09-14T03:09:42.865595+0000 mgr.a (mgr.14355) 12491 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:43 smithi171 bash[25040]: cluster 2024-09-14T03:09:42.074148+0000 mgr.a (mgr.14355) 12490 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:43 smithi171 bash[25040]: audit 2024-09-14T03:09:42.865595+0000 mgr.a (mgr.14355) 12491 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:43 smithi007 bash[22722]: cluster 2024-09-14T03:09:42.074148+0000 mgr.a (mgr.14355) 12490 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:09:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:43 smithi007 bash[22722]: audit 2024-09-14T03:09:42.865595+0000 mgr.a (mgr.14355) 12491 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:45 smithi131 bash[24745]: cluster 2024-09-14T03:09:44.075095+0000 mgr.a (mgr.14355) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:45 smithi171 bash[25040]: cluster 2024-09-14T03:09:44.075095+0000 mgr.a (mgr.14355) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:45 smithi007 bash[22722]: cluster 2024-09-14T03:09:44.075095+0000 mgr.a (mgr.14355) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:47 smithi131 bash[24745]: cluster 2024-09-14T03:09:46.077369+0000 mgr.a (mgr.14355) 12493 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:47 smithi171 bash[25040]: cluster 2024-09-14T03:09:46.077369+0000 mgr.a (mgr.14355) 12493 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:47 smithi007 bash[22722]: cluster 2024-09-14T03:09:46.077369+0000 mgr.a (mgr.14355) 12493 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:48.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:48.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:49 smithi131 bash[24745]: cluster 2024-09-14T03:09:48.078173+0000 mgr.a (mgr.14355) 12494 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:49 smithi131 bash[24745]: audit 2024-09-14T03:09:48.614870+0000 mgr.a (mgr.14355) 12495 : audit [DBG] from='client.272766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:49 smithi171 bash[25040]: cluster 2024-09-14T03:09:48.078173+0000 mgr.a (mgr.14355) 12494 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:49 smithi171 bash[25040]: audit 2024-09-14T03:09:48.614870+0000 mgr.a (mgr.14355) 12495 : audit [DBG] from='client.272766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:49 smithi007 bash[22722]: cluster 2024-09-14T03:09:48.078173+0000 mgr.a (mgr.14355) 12494 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:49 smithi007 bash[22722]: audit 2024-09-14T03:09:48.614870+0000 mgr.a (mgr.14355) 12495 : audit [DBG] from='client.272766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:51 smithi131 bash[24745]: cluster 2024-09-14T03:09:50.079162+0000 mgr.a (mgr.14355) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:51 smithi171 bash[25040]: cluster 2024-09-14T03:09:50.079162+0000 mgr.a (mgr.14355) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:51 smithi007 bash[22722]: cluster 2024-09-14T03:09:50.079162+0000 mgr.a (mgr.14355) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:53 smithi131 bash[24745]: cluster 2024-09-14T03:09:52.081434+0000 mgr.a (mgr.14355) 12497 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:53 smithi171 bash[25040]: cluster 2024-09-14T03:09:52.081434+0000 mgr.a (mgr.14355) 12497 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:53 smithi007 bash[22722]: cluster 2024-09-14T03:09:52.081434+0000 mgr.a (mgr.14355) 12497 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:54.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:54.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:54.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:09:54.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:09:54.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:09:54.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:09:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:09:54.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:09:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:55 smithi131 bash[24745]: cluster 2024-09-14T03:09:54.082186+0000 mgr.a (mgr.14355) 12498 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:55 smithi131 bash[24745]: audit 2024-09-14T03:09:54.355498+0000 mgr.a (mgr.14355) 12499 : audit [DBG] from='client.272844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:55 smithi171 bash[25040]: cluster 2024-09-14T03:09:54.082186+0000 mgr.a (mgr.14355) 12498 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:55 smithi171 bash[25040]: audit 2024-09-14T03:09:54.355498+0000 mgr.a (mgr.14355) 12499 : audit [DBG] from='client.272844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:55 smithi007 bash[22722]: cluster 2024-09-14T03:09:54.082186+0000 mgr.a (mgr.14355) 12498 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:55 smithi007 bash[22722]: audit 2024-09-14T03:09:54.355498+0000 mgr.a (mgr.14355) 12499 : audit [DBG] from='client.272844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:09:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:57 smithi131 bash[24745]: cluster 2024-09-14T03:09:56.084526+0000 mgr.a (mgr.14355) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:57 smithi171 bash[25040]: cluster 2024-09-14T03:09:56.084526+0000 mgr.a (mgr.14355) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:57 smithi007 bash[22722]: cluster 2024-09-14T03:09:56.084526+0000 mgr.a (mgr.14355) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:09:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:09:59 smithi131 bash[24745]: cluster 2024-09-14T03:09:58.085310+0000 mgr.a (mgr.14355) 12501 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:09:59 smithi171 bash[25040]: cluster 2024-09-14T03:09:58.085310+0000 mgr.a (mgr.14355) 12501 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:09:59 smithi007 bash[22722]: cluster 2024-09-14T03:09:58.085310+0000 mgr.a (mgr.14355) 12501 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:09:59.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:09:59.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:09:59.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:00 smithi131 bash[24745]: cluster 2024-09-14T03:10:00.000129+0000 mon.a (mon.0) 2461 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:10:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:00 smithi171 bash[25040]: cluster 2024-09-14T03:10:00.000129+0000 mon.a (mon.0) 2461 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:10:00.565 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:00.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:00 smithi007 bash[22722]: cluster 2024-09-14T03:10:00.000129+0000 mon.a (mon.0) 2461 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:10:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:01 smithi131 bash[24745]: cluster 2024-09-14T03:10:00.086032+0000 mgr.a (mgr.14355) 12502 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:01 smithi131 bash[24745]: audit 2024-09-14T03:10:00.122650+0000 mgr.a (mgr.14355) 12503 : audit [DBG] from='client.272922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:01 smithi171 bash[25040]: cluster 2024-09-14T03:10:00.086032+0000 mgr.a (mgr.14355) 12502 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:01 smithi171 bash[25040]: audit 2024-09-14T03:10:00.122650+0000 mgr.a (mgr.14355) 12503 : audit [DBG] from='client.272922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:01 smithi007 bash[22722]: cluster 2024-09-14T03:10:00.086032+0000 mgr.a (mgr.14355) 12502 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:01 smithi007 bash[22722]: audit 2024-09-14T03:10:00.122650+0000 mgr.a (mgr.14355) 12503 : audit [DBG] from='client.272922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:03 smithi131 bash[24745]: cluster 2024-09-14T03:10:02.088801+0000 mgr.a (mgr.14355) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:03 smithi171 bash[25040]: cluster 2024-09-14T03:10:02.088801+0000 mgr.a (mgr.14355) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:03 smithi007 bash[22722]: cluster 2024-09-14T03:10:02.088801+0000 mgr.a (mgr.14355) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:05 smithi131 bash[24745]: cluster 2024-09-14T03:10:04.089592+0000 mgr.a (mgr.14355) 12505 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:05 smithi171 bash[25040]: cluster 2024-09-14T03:10:04.089592+0000 mgr.a (mgr.14355) 12505 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:05.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:05.567 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:05 smithi007 bash[22722]: cluster 2024-09-14T03:10:04.089592+0000 mgr.a (mgr.14355) 12505 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:06.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:06.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:06 smithi171 bash[25040]: audit 2024-09-14T03:10:05.896494+0000 mgr.a (mgr.14355) 12506 : audit [DBG] from='client.272997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:06 smithi007 bash[22722]: audit 2024-09-14T03:10:05.896494+0000 mgr.a (mgr.14355) 12506 : audit [DBG] from='client.272997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:06 smithi131 bash[24745]: audit 2024-09-14T03:10:05.896494+0000 mgr.a (mgr.14355) 12506 : audit [DBG] from='client.272997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:07 smithi171 bash[25040]: cluster 2024-09-14T03:10:06.091125+0000 mgr.a (mgr.14355) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:07 smithi007 bash[22722]: cluster 2024-09-14T03:10:06.091125+0000 mgr.a (mgr.14355) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:07 smithi131 bash[24745]: cluster 2024-09-14T03:10:06.091125+0000 mgr.a (mgr.14355) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:09 smithi171 bash[25040]: cluster 2024-09-14T03:10:08.091987+0000 mgr.a (mgr.14355) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:09 smithi007 bash[22722]: cluster 2024-09-14T03:10:08.091987+0000 mgr.a (mgr.14355) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:09 smithi131 bash[24745]: cluster 2024-09-14T03:10:08.091987+0000 mgr.a (mgr.14355) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:11.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:11 smithi007 bash[22722]: cluster 2024-09-14T03:10:10.092756+0000 mgr.a (mgr.14355) 12509 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:11 smithi131 bash[24745]: cluster 2024-09-14T03:10:10.092756+0000 mgr.a (mgr.14355) 12509 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:11 smithi171 bash[25040]: cluster 2024-09-14T03:10:10.092756+0000 mgr.a (mgr.14355) 12509 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:12.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:12 smithi007 bash[22722]: audit 2024-09-14T03:10:11.666277+0000 mgr.a (mgr.14355) 12510 : audit [DBG] from='client.273075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:12 smithi131 bash[24745]: audit 2024-09-14T03:10:11.666277+0000 mgr.a (mgr.14355) 12510 : audit [DBG] from='client.273075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:12 smithi171 bash[25040]: audit 2024-09-14T03:10:11.666277+0000 mgr.a (mgr.14355) 12510 : audit [DBG] from='client.273075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:13 smithi007 bash[22722]: cluster 2024-09-14T03:10:12.093982+0000 mgr.a (mgr.14355) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:13 smithi131 bash[24745]: cluster 2024-09-14T03:10:12.093982+0000 mgr.a (mgr.14355) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:13 smithi171 bash[25040]: cluster 2024-09-14T03:10:12.093982+0000 mgr.a (mgr.14355) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:15 smithi007 bash[22722]: cluster 2024-09-14T03:10:14.094769+0000 mgr.a (mgr.14355) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:15 smithi131 bash[24745]: cluster 2024-09-14T03:10:14.094769+0000 mgr.a (mgr.14355) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:15 smithi171 bash[25040]: cluster 2024-09-14T03:10:14.094769+0000 mgr.a (mgr.14355) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:17.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:17.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:17.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:17.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:17.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:17.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:17 smithi007 bash[22722]: cluster 2024-09-14T03:10:16.096785+0000 mgr.a (mgr.14355) 12513 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:17 smithi131 bash[24745]: cluster 2024-09-14T03:10:16.096785+0000 mgr.a (mgr.14355) 12513 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:17 smithi171 bash[25040]: cluster 2024-09-14T03:10:16.096785+0000 mgr.a (mgr.14355) 12513 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:18 smithi007 bash[22722]: audit 2024-09-14T03:10:17.421360+0000 mgr.a (mgr.14355) 12514 : audit [DBG] from='client.273153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:18 smithi131 bash[24745]: audit 2024-09-14T03:10:17.421360+0000 mgr.a (mgr.14355) 12514 : audit [DBG] from='client.273153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:18 smithi171 bash[25040]: audit 2024-09-14T03:10:17.421360+0000 mgr.a (mgr.14355) 12514 : audit [DBG] from='client.273153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:19 smithi007 bash[22722]: cluster 2024-09-14T03:10:18.097740+0000 mgr.a (mgr.14355) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:19 smithi131 bash[24745]: cluster 2024-09-14T03:10:18.097740+0000 mgr.a (mgr.14355) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:19 smithi171 bash[25040]: cluster 2024-09-14T03:10:18.097740+0000 mgr.a (mgr.14355) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:21 smithi007 bash[22722]: cluster 2024-09-14T03:10:20.098551+0000 mgr.a (mgr.14355) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:21 smithi131 bash[24745]: cluster 2024-09-14T03:10:20.098551+0000 mgr.a (mgr.14355) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:21 smithi171 bash[25040]: cluster 2024-09-14T03:10:20.098551+0000 mgr.a (mgr.14355) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:22.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:23.619 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:23.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:23.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:23.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:23.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:23 smithi007 bash[22722]: cluster 2024-09-14T03:10:22.100814+0000 mgr.a (mgr.14355) 12517 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:23 smithi131 bash[24745]: cluster 2024-09-14T03:10:22.100814+0000 mgr.a (mgr.14355) 12517 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:23 smithi171 bash[25040]: cluster 2024-09-14T03:10:22.100814+0000 mgr.a (mgr.14355) 12517 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:24 smithi007 bash[22722]: audit 2024-09-14T03:10:23.174602+0000 mgr.a (mgr.14355) 12518 : audit [DBG] from='client.273231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:24 smithi131 bash[24745]: audit 2024-09-14T03:10:23.174602+0000 mgr.a (mgr.14355) 12518 : audit [DBG] from='client.273231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:24 smithi171 bash[25040]: audit 2024-09-14T03:10:23.174602+0000 mgr.a (mgr.14355) 12518 : audit [DBG] from='client.273231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:25 smithi007 bash[22722]: cluster 2024-09-14T03:10:24.101778+0000 mgr.a (mgr.14355) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:25 smithi007 bash[22722]: audit 2024-09-14T03:10:25.652169+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:10:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:25 smithi131 bash[24745]: cluster 2024-09-14T03:10:24.101778+0000 mgr.a (mgr.14355) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:25 smithi131 bash[24745]: audit 2024-09-14T03:10:25.652169+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:10:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:25 smithi171 bash[25040]: cluster 2024-09-14T03:10:24.101778+0000 mgr.a (mgr.14355) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:25 smithi171 bash[25040]: audit 2024-09-14T03:10:25.652169+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:10:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: cluster 2024-09-14T03:10:26.103981+0000 mgr.a (mgr.14355) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.266762+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.271739+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.277031+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.282283+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.985780+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.987295+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:26.997662+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:27.002687+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:27 smithi131 bash[24745]: audit 2024-09-14T03:10:27.004980+0000 mgr.a (mgr.14355) 12521 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: cluster 2024-09-14T03:10:26.103981+0000 mgr.a (mgr.14355) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.266762+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.271739+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.277031+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.282283+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.985780+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.987295+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:26.997662+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:27.002687+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:27 smithi171 bash[25040]: audit 2024-09-14T03:10:27.004980+0000 mgr.a (mgr.14355) 12521 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: cluster 2024-09-14T03:10:26.103981+0000 mgr.a (mgr.14355) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.266762+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.271739+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.277031+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.282283+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.985780+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:10:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.987295+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:10:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:26.997662+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:10:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:27.002687+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22722]: audit 2024-09-14T03:10:27.004980+0000 mgr.a (mgr.14355) 12521 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:10:28.209 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22972]: debug 2024-09-14T03:10:27.748+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:10:28.209 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:10:27 smithi007 bash[22972]: debug 2024-09-14T03:10:27.748+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:10:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:28 smithi131 bash[24745]: audit 2024-09-14T03:10:27.751076+0000 mgr.a (mgr.14355) 12522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:10:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:28 smithi131 bash[24745]: cephadm 2024-09-14T03:10:27.752923+0000 mgr.a (mgr.14355) 12523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:10:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:28 smithi171 bash[25040]: audit 2024-09-14T03:10:27.751076+0000 mgr.a (mgr.14355) 12522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:10:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:28 smithi171 bash[25040]: cephadm 2024-09-14T03:10:27.752923+0000 mgr.a (mgr.14355) 12523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:10:28.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:28.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:28.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:28 smithi007 bash[22722]: audit 2024-09-14T03:10:27.751076+0000 mgr.a (mgr.14355) 12522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:10:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:28 smithi007 bash[22722]: cephadm 2024-09-14T03:10:27.752923+0000 mgr.a (mgr.14355) 12523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:10:29.365 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:29.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:29.366 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:29 smithi131 bash[24745]: cluster 2024-09-14T03:10:28.104937+0000 mgr.a (mgr.14355) 12524 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:29 smithi131 bash[24745]: audit 2024-09-14T03:10:28.953561+0000 mgr.a (mgr.14355) 12525 : audit [DBG] from='client.273408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:29 smithi171 bash[25040]: cluster 2024-09-14T03:10:28.104937+0000 mgr.a (mgr.14355) 12524 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:29 smithi171 bash[25040]: audit 2024-09-14T03:10:28.953561+0000 mgr.a (mgr.14355) 12525 : audit [DBG] from='client.273408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:29 smithi007 bash[22722]: cluster 2024-09-14T03:10:28.104937+0000 mgr.a (mgr.14355) 12524 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:29 smithi007 bash[22722]: audit 2024-09-14T03:10:28.953561+0000 mgr.a (mgr.14355) 12525 : audit [DBG] from='client.273408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:31 smithi131 bash[24745]: cluster 2024-09-14T03:10:30.105850+0000 mgr.a (mgr.14355) 12526 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:31 smithi171 bash[25040]: cluster 2024-09-14T03:10:30.105850+0000 mgr.a (mgr.14355) 12526 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:31 smithi007 bash[22722]: cluster 2024-09-14T03:10:30.105850+0000 mgr.a (mgr.14355) 12526 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:33 smithi171 bash[25040]: cluster 2024-09-14T03:10:32.108153+0000 mgr.a (mgr.14355) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:33 smithi007 bash[22722]: cluster 2024-09-14T03:10:32.108153+0000 mgr.a (mgr.14355) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:33 smithi131 bash[24745]: cluster 2024-09-14T03:10:32.108153+0000 mgr.a (mgr.14355) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:34.367 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:34.368 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:35.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:35.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:35 smithi171 bash[25040]: cluster 2024-09-14T03:10:34.108904+0000 mgr.a (mgr.14355) 12528 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:35 smithi171 bash[25040]: audit 2024-09-14T03:10:34.705526+0000 mgr.a (mgr.14355) 12529 : audit [DBG] from='client.273483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:35 smithi007 bash[22722]: cluster 2024-09-14T03:10:34.108904+0000 mgr.a (mgr.14355) 12528 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:35 smithi007 bash[22722]: audit 2024-09-14T03:10:34.705526+0000 mgr.a (mgr.14355) 12529 : audit [DBG] from='client.273483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:35 smithi131 bash[24745]: cluster 2024-09-14T03:10:34.108904+0000 mgr.a (mgr.14355) 12528 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:35 smithi131 bash[24745]: audit 2024-09-14T03:10:34.705526+0000 mgr.a (mgr.14355) 12529 : audit [DBG] from='client.273483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:37 smithi007 bash[22722]: cluster 2024-09-14T03:10:36.111249+0000 mgr.a (mgr.14355) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:37 smithi131 bash[24745]: cluster 2024-09-14T03:10:36.111249+0000 mgr.a (mgr.14355) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:37 smithi171 bash[25040]: cluster 2024-09-14T03:10:36.111249+0000 mgr.a (mgr.14355) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:39 smithi007 bash[22722]: cluster 2024-09-14T03:10:38.112012+0000 mgr.a (mgr.14355) 12531 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:39 smithi131 bash[24745]: cluster 2024-09-14T03:10:38.112012+0000 mgr.a (mgr.14355) 12531 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:39 smithi171 bash[25040]: cluster 2024-09-14T03:10:38.112012+0000 mgr.a (mgr.14355) 12531 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:40.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:40.889 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:41 smithi007 bash[22722]: cluster 2024-09-14T03:10:40.112762+0000 mgr.a (mgr.14355) 12532 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:41 smithi007 bash[22722]: audit 2024-09-14T03:10:40.475457+0000 mgr.a (mgr.14355) 12533 : audit [DBG] from='client.273561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:41 smithi131 bash[24745]: cluster 2024-09-14T03:10:40.112762+0000 mgr.a (mgr.14355) 12532 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:41 smithi131 bash[24745]: audit 2024-09-14T03:10:40.475457+0000 mgr.a (mgr.14355) 12533 : audit [DBG] from='client.273561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:41 smithi171 bash[25040]: cluster 2024-09-14T03:10:40.112762+0000 mgr.a (mgr.14355) 12532 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:41 smithi171 bash[25040]: audit 2024-09-14T03:10:40.475457+0000 mgr.a (mgr.14355) 12533 : audit [DBG] from='client.273561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:43 smithi007 bash[22722]: cluster 2024-09-14T03:10:42.115511+0000 mgr.a (mgr.14355) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:43 smithi131 bash[24745]: cluster 2024-09-14T03:10:42.115511+0000 mgr.a (mgr.14355) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:43 smithi171 bash[25040]: cluster 2024-09-14T03:10:42.115511+0000 mgr.a (mgr.14355) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:10:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:45 smithi007 bash[22722]: cluster 2024-09-14T03:10:44.116303+0000 mgr.a (mgr.14355) 12535 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:45 smithi131 bash[24745]: cluster 2024-09-14T03:10:44.116303+0000 mgr.a (mgr.14355) 12535 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:45 smithi171 bash[25040]: cluster 2024-09-14T03:10:44.116303+0000 mgr.a (mgr.14355) 12535 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:46.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:46.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:47 smithi007 bash[22722]: cluster 2024-09-14T03:10:46.118269+0000 mgr.a (mgr.14355) 12536 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:47 smithi007 bash[22722]: audit 2024-09-14T03:10:46.227690+0000 mgr.a (mgr.14355) 12537 : audit [DBG] from='client.273639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:47 smithi131 bash[24745]: cluster 2024-09-14T03:10:46.118269+0000 mgr.a (mgr.14355) 12536 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:47 smithi131 bash[24745]: audit 2024-09-14T03:10:46.227690+0000 mgr.a (mgr.14355) 12537 : audit [DBG] from='client.273639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:47 smithi171 bash[25040]: cluster 2024-09-14T03:10:46.118269+0000 mgr.a (mgr.14355) 12536 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:47 smithi171 bash[25040]: audit 2024-09-14T03:10:46.227690+0000 mgr.a (mgr.14355) 12537 : audit [DBG] from='client.273639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:49 smithi007 bash[22722]: cluster 2024-09-14T03:10:48.119196+0000 mgr.a (mgr.14355) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:49 smithi131 bash[24745]: cluster 2024-09-14T03:10:48.119196+0000 mgr.a (mgr.14355) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:49 smithi171 bash[25040]: cluster 2024-09-14T03:10:48.119196+0000 mgr.a (mgr.14355) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:10:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:51 smithi007 bash[22722]: cluster 2024-09-14T03:10:50.119951+0000 mgr.a (mgr.14355) 12539 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:51 smithi131 bash[24745]: cluster 2024-09-14T03:10:50.119951+0000 mgr.a (mgr.14355) 12539 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:51 smithi171 bash[25040]: cluster 2024-09-14T03:10:50.119951+0000 mgr.a (mgr.14355) 12539 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:10:52.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:52 smithi007 bash[22722]: audit 2024-09-14T03:10:52.013402+0000 mgr.a (mgr.14355) 12540 : audit [DBG] from='client.273717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:52 smithi131 bash[24745]: audit 2024-09-14T03:10:52.013402+0000 mgr.a (mgr.14355) 12540 : audit [DBG] from='client.273717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:52 smithi171 bash[25040]: audit 2024-09-14T03:10:52.013402+0000 mgr.a (mgr.14355) 12540 : audit [DBG] from='client.273717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:53 smithi007 bash[22722]: cluster 2024-09-14T03:10:52.121314+0000 mgr.a (mgr.14355) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:53 smithi131 bash[24745]: cluster 2024-09-14T03:10:52.121314+0000 mgr.a (mgr.14355) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:53 smithi171 bash[25040]: cluster 2024-09-14T03:10:52.121314+0000 mgr.a (mgr.14355) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:55 smithi007 bash[22722]: cluster 2024-09-14T03:10:54.122197+0000 mgr.a (mgr.14355) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:55 smithi131 bash[24745]: cluster 2024-09-14T03:10:54.122197+0000 mgr.a (mgr.14355) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:55 smithi171 bash[25040]: cluster 2024-09-14T03:10:54.122197+0000 mgr.a (mgr.14355) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:10:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:10:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:10:57.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:10:58.187 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:10:58.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:10:58.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:10:58.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:10:58.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:10:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:57 smithi007 bash[22722]: cluster 2024-09-14T03:10:56.124473+0000 mgr.a (mgr.14355) 12543 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:57 smithi131 bash[24745]: cluster 2024-09-14T03:10:56.124473+0000 mgr.a (mgr.14355) 12543 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:57 smithi171 bash[25040]: cluster 2024-09-14T03:10:56.124473+0000 mgr.a (mgr.14355) 12543 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:10:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:58 smithi007 bash[22722]: audit 2024-09-14T03:10:57.778505+0000 mgr.a (mgr.14355) 12544 : audit [DBG] from='client.273795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:58 smithi131 bash[24745]: audit 2024-09-14T03:10:57.778505+0000 mgr.a (mgr.14355) 12544 : audit [DBG] from='client.273795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:10:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:58 smithi171 bash[25040]: audit 2024-09-14T03:10:57.778505+0000 mgr.a (mgr.14355) 12544 : audit [DBG] from='client.273795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:10:59 smithi007 bash[22722]: cluster 2024-09-14T03:10:58.125002+0000 mgr.a (mgr.14355) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:10:59 smithi131 bash[24745]: cluster 2024-09-14T03:10:58.125002+0000 mgr.a (mgr.14355) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:10:59 smithi171 bash[25040]: cluster 2024-09-14T03:10:58.125002+0000 mgr.a (mgr.14355) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:01 smithi007 bash[22722]: cluster 2024-09-14T03:11:00.125732+0000 mgr.a (mgr.14355) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:01 smithi131 bash[24745]: cluster 2024-09-14T03:11:00.125732+0000 mgr.a (mgr.14355) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:01 smithi171 bash[25040]: cluster 2024-09-14T03:11:00.125732+0000 mgr.a (mgr.14355) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:03.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:03.978 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:03.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:03 smithi007 bash[22722]: cluster 2024-09-14T03:11:02.127995+0000 mgr.a (mgr.14355) 12547 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:03 smithi131 bash[24745]: cluster 2024-09-14T03:11:02.127995+0000 mgr.a (mgr.14355) 12547 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:03 smithi171 bash[25040]: cluster 2024-09-14T03:11:02.127995+0000 mgr.a (mgr.14355) 12547 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:04 smithi007 bash[22722]: audit 2024-09-14T03:11:03.526141+0000 mgr.a (mgr.14355) 12548 : audit [DBG] from='client.273873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:04 smithi131 bash[24745]: audit 2024-09-14T03:11:03.526141+0000 mgr.a (mgr.14355) 12548 : audit [DBG] from='client.273873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:04 smithi171 bash[25040]: audit 2024-09-14T03:11:03.526141+0000 mgr.a (mgr.14355) 12548 : audit [DBG] from='client.273873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:05 smithi007 bash[22722]: cluster 2024-09-14T03:11:04.128909+0000 mgr.a (mgr.14355) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:05 smithi131 bash[24745]: cluster 2024-09-14T03:11:04.128909+0000 mgr.a (mgr.14355) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:05 smithi171 bash[25040]: cluster 2024-09-14T03:11:04.128909+0000 mgr.a (mgr.14355) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:07 smithi007 bash[22722]: cluster 2024-09-14T03:11:06.131224+0000 mgr.a (mgr.14355) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:07 smithi131 bash[24745]: cluster 2024-09-14T03:11:06.131224+0000 mgr.a (mgr.14355) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:07 smithi171 bash[25040]: cluster 2024-09-14T03:11:06.131224+0000 mgr.a (mgr.14355) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:08.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:09.740 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:09.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:09.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:09 smithi007 bash[22722]: cluster 2024-09-14T03:11:08.131973+0000 mgr.a (mgr.14355) 12551 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:09 smithi131 bash[24745]: cluster 2024-09-14T03:11:08.131973+0000 mgr.a (mgr.14355) 12551 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:09 smithi171 bash[25040]: cluster 2024-09-14T03:11:08.131973+0000 mgr.a (mgr.14355) 12551 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:10 smithi007 bash[22722]: audit 2024-09-14T03:11:09.307416+0000 mgr.a (mgr.14355) 12552 : audit [DBG] from='client.273951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:10 smithi131 bash[24745]: audit 2024-09-14T03:11:09.307416+0000 mgr.a (mgr.14355) 12552 : audit [DBG] from='client.273951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:10 smithi171 bash[25040]: audit 2024-09-14T03:11:09.307416+0000 mgr.a (mgr.14355) 12552 : audit [DBG] from='client.273951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:11 smithi007 bash[22722]: cluster 2024-09-14T03:11:10.132858+0000 mgr.a (mgr.14355) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:11 smithi131 bash[24745]: cluster 2024-09-14T03:11:10.132858+0000 mgr.a (mgr.14355) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:11 smithi171 bash[25040]: cluster 2024-09-14T03:11:10.132858+0000 mgr.a (mgr.14355) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:13 smithi007 bash[22722]: cluster 2024-09-14T03:11:12.135131+0000 mgr.a (mgr.14355) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:13 smithi131 bash[24745]: cluster 2024-09-14T03:11:12.135131+0000 mgr.a (mgr.14355) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:13 smithi171 bash[25040]: cluster 2024-09-14T03:11:12.135131+0000 mgr.a (mgr.14355) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:14.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:14.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:14.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:15.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:15.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:15 smithi007 bash[22722]: cluster 2024-09-14T03:11:14.135880+0000 mgr.a (mgr.14355) 12555 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:15 smithi131 bash[24745]: cluster 2024-09-14T03:11:14.135880+0000 mgr.a (mgr.14355) 12555 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:15 smithi171 bash[25040]: cluster 2024-09-14T03:11:14.135880+0000 mgr.a (mgr.14355) 12555 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:16 smithi007 bash[22722]: audit 2024-09-14T03:11:15.081033+0000 mgr.a (mgr.14355) 12556 : audit [DBG] from='client.274023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:16 smithi131 bash[24745]: audit 2024-09-14T03:11:15.081033+0000 mgr.a (mgr.14355) 12556 : audit [DBG] from='client.274023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:16 smithi171 bash[25040]: audit 2024-09-14T03:11:15.081033+0000 mgr.a (mgr.14355) 12556 : audit [DBG] from='client.274023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:17 smithi007 bash[22722]: cluster 2024-09-14T03:11:16.138737+0000 mgr.a (mgr.14355) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:17 smithi131 bash[24745]: cluster 2024-09-14T03:11:16.138737+0000 mgr.a (mgr.14355) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:17 smithi171 bash[25040]: cluster 2024-09-14T03:11:16.138737+0000 mgr.a (mgr.14355) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:19 smithi007 bash[22722]: cluster 2024-09-14T03:11:18.139697+0000 mgr.a (mgr.14355) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:19 smithi131 bash[24745]: cluster 2024-09-14T03:11:18.139697+0000 mgr.a (mgr.14355) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:19 smithi171 bash[25040]: cluster 2024-09-14T03:11:18.139697+0000 mgr.a (mgr.14355) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:20.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:20.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:21.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:21 smithi131 bash[24745]: cluster 2024-09-14T03:11:20.140537+0000 mgr.a (mgr.14355) 12559 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:21 smithi131 bash[24745]: audit 2024-09-14T03:11:20.882454+0000 mgr.a (mgr.14355) 12560 : audit [DBG] from='client.274101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:21 smithi171 bash[25040]: cluster 2024-09-14T03:11:20.140537+0000 mgr.a (mgr.14355) 12559 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:21 smithi171 bash[25040]: audit 2024-09-14T03:11:20.882454+0000 mgr.a (mgr.14355) 12560 : audit [DBG] from='client.274101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:21 smithi007 bash[22722]: cluster 2024-09-14T03:11:20.140537+0000 mgr.a (mgr.14355) 12559 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:21 smithi007 bash[22722]: audit 2024-09-14T03:11:20.882454+0000 mgr.a (mgr.14355) 12560 : audit [DBG] from='client.274101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:23 smithi131 bash[24745]: cluster 2024-09-14T03:11:22.143313+0000 mgr.a (mgr.14355) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:23 smithi171 bash[25040]: cluster 2024-09-14T03:11:22.143313+0000 mgr.a (mgr.14355) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:23 smithi007 bash[22722]: cluster 2024-09-14T03:11:22.143313+0000 mgr.a (mgr.14355) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:25 smithi131 bash[24745]: cluster 2024-09-14T03:11:24.144095+0000 mgr.a (mgr.14355) 12562 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:25 smithi171 bash[25040]: cluster 2024-09-14T03:11:24.144095+0000 mgr.a (mgr.14355) 12562 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:25 smithi007 bash[22722]: cluster 2024-09-14T03:11:24.144095+0000 mgr.a (mgr.14355) 12562 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:11:27.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:27 smithi131 bash[24745]: cluster 2024-09-14T03:11:26.146077+0000 mgr.a (mgr.14355) 12563 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:27 smithi131 bash[24745]: audit 2024-09-14T03:11:26.673855+0000 mgr.a (mgr.14355) 12564 : audit [DBG] from='client.274179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:27 smithi131 bash[24745]: audit 2024-09-14T03:11:27.811057+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:11:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:27 smithi171 bash[25040]: cluster 2024-09-14T03:11:26.146077+0000 mgr.a (mgr.14355) 12563 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:27 smithi171 bash[25040]: audit 2024-09-14T03:11:26.673855+0000 mgr.a (mgr.14355) 12564 : audit [DBG] from='client.274179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:27 smithi171 bash[25040]: audit 2024-09-14T03:11:27.811057+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:11:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:27 smithi007 bash[22722]: cluster 2024-09-14T03:11:26.146077+0000 mgr.a (mgr.14355) 12563 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:27 smithi007 bash[22722]: audit 2024-09-14T03:11:26.673855+0000 mgr.a (mgr.14355) 12564 : audit [DBG] from='client.274179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:27 smithi007 bash[22722]: audit 2024-09-14T03:11:27.811057+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:11:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:28 smithi131 bash[24745]: audit 2024-09-14T03:11:28.643379+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:11:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:28 smithi131 bash[24745]: audit 2024-09-14T03:11:28.645244+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:11:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:28 smithi131 bash[24745]: audit 2024-09-14T03:11:28.656794+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:11:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:28 smithi131 bash[24745]: audit 2024-09-14T03:11:28.661627+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:28 smithi171 bash[25040]: audit 2024-09-14T03:11:28.643379+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:11:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:28 smithi171 bash[25040]: audit 2024-09-14T03:11:28.645244+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:11:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:28 smithi171 bash[25040]: audit 2024-09-14T03:11:28.656794+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:11:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:28 smithi171 bash[25040]: audit 2024-09-14T03:11:28.661627+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:29.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:28 smithi007 bash[22722]: audit 2024-09-14T03:11:28.643379+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:11:29.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:28 smithi007 bash[22722]: audit 2024-09-14T03:11:28.645244+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:11:29.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:28 smithi007 bash[22722]: audit 2024-09-14T03:11:28.656794+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:11:29.421 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:28 smithi007 bash[22722]: audit 2024-09-14T03:11:28.661627+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:29.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:11:29 smithi007 bash[22972]: debug 2024-09-14T03:11:29.415+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:11:29.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:11:29 smithi007 bash[22972]: debug 2024-09-14T03:11:29.419+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:11:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:29 smithi131 bash[24745]: cluster 2024-09-14T03:11:28.146996+0000 mgr.a (mgr.14355) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:29 smithi131 bash[24745]: audit 2024-09-14T03:11:28.664141+0000 mgr.a (mgr.14355) 12566 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:29 smithi171 bash[25040]: cluster 2024-09-14T03:11:28.146996+0000 mgr.a (mgr.14355) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:29 smithi171 bash[25040]: audit 2024-09-14T03:11:28.664141+0000 mgr.a (mgr.14355) 12566 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:29 smithi007 bash[22722]: cluster 2024-09-14T03:11:28.146996+0000 mgr.a (mgr.14355) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:29 smithi007 bash[22722]: audit 2024-09-14T03:11:28.664141+0000 mgr.a (mgr.14355) 12566 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:11:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:30 smithi131 bash[24745]: audit 2024-09-14T03:11:29.421186+0000 mgr.a (mgr.14355) 12567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:11:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:30 smithi131 bash[24745]: cephadm 2024-09-14T03:11:29.423000+0000 mgr.a (mgr.14355) 12568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:11:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:30 smithi171 bash[25040]: audit 2024-09-14T03:11:29.421186+0000 mgr.a (mgr.14355) 12567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:11:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:30 smithi171 bash[25040]: cephadm 2024-09-14T03:11:29.423000+0000 mgr.a (mgr.14355) 12568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:11:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:30 smithi007 bash[22722]: audit 2024-09-14T03:11:29.421186+0000 mgr.a (mgr.14355) 12567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:11:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:30 smithi007 bash[22722]: cephadm 2024-09-14T03:11:29.423000+0000 mgr.a (mgr.14355) 12568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:11:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:32.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:32.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:31 smithi131 bash[24745]: cluster 2024-09-14T03:11:30.147914+0000 mgr.a (mgr.14355) 12569 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:31 smithi171 bash[25040]: cluster 2024-09-14T03:11:30.147914+0000 mgr.a (mgr.14355) 12569 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:31 smithi007 bash[22722]: cluster 2024-09-14T03:11:30.147914+0000 mgr.a (mgr.14355) 12569 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:32.895 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:32.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:33 smithi131 bash[24745]: cluster 2024-09-14T03:11:32.150247+0000 mgr.a (mgr.14355) 12570 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:33 smithi131 bash[24745]: audit 2024-09-14T03:11:32.481923+0000 mgr.a (mgr.14355) 12571 : audit [DBG] from='client.274359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:33 smithi171 bash[25040]: cluster 2024-09-14T03:11:32.150247+0000 mgr.a (mgr.14355) 12570 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:33 smithi171 bash[25040]: audit 2024-09-14T03:11:32.481923+0000 mgr.a (mgr.14355) 12571 : audit [DBG] from='client.274359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:33 smithi007 bash[22722]: cluster 2024-09-14T03:11:32.150247+0000 mgr.a (mgr.14355) 12570 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:33 smithi007 bash[22722]: audit 2024-09-14T03:11:32.481923+0000 mgr.a (mgr.14355) 12571 : audit [DBG] from='client.274359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:36 smithi131 bash[24745]: cluster 2024-09-14T03:11:34.151136+0000 mgr.a (mgr.14355) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:36 smithi171 bash[25040]: cluster 2024-09-14T03:11:34.151136+0000 mgr.a (mgr.14355) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:35 smithi007 bash[22722]: cluster 2024-09-14T03:11:34.151136+0000 mgr.a (mgr.14355) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:37.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:38 smithi131 bash[24745]: cluster 2024-09-14T03:11:36.153384+0000 mgr.a (mgr.14355) 12573 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:38 smithi171 bash[25040]: cluster 2024-09-14T03:11:36.153384+0000 mgr.a (mgr.14355) 12573 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:38 smithi007 bash[22722]: cluster 2024-09-14T03:11:36.153384+0000 mgr.a (mgr.14355) 12573 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:38.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:38.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:38.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:40 smithi131 bash[24745]: cluster 2024-09-14T03:11:38.154392+0000 mgr.a (mgr.14355) 12574 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:40 smithi131 bash[24745]: audit 2024-09-14T03:11:38.225559+0000 mgr.a (mgr.14355) 12575 : audit [DBG] from='client.274437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:40 smithi171 bash[25040]: cluster 2024-09-14T03:11:38.154392+0000 mgr.a (mgr.14355) 12574 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:40 smithi171 bash[25040]: audit 2024-09-14T03:11:38.225559+0000 mgr.a (mgr.14355) 12575 : audit [DBG] from='client.274437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:40 smithi007 bash[22722]: cluster 2024-09-14T03:11:38.154392+0000 mgr.a (mgr.14355) 12574 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:40 smithi007 bash[22722]: audit 2024-09-14T03:11:38.225559+0000 mgr.a (mgr.14355) 12575 : audit [DBG] from='client.274437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:42 smithi131 bash[24745]: cluster 2024-09-14T03:11:40.155280+0000 mgr.a (mgr.14355) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:42 smithi171 bash[25040]: cluster 2024-09-14T03:11:40.155280+0000 mgr.a (mgr.14355) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:42 smithi007 bash[22722]: cluster 2024-09-14T03:11:40.155280+0000 mgr.a (mgr.14355) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:44 smithi131 bash[24745]: cluster 2024-09-14T03:11:42.157516+0000 mgr.a (mgr.14355) 12577 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:44 smithi171 bash[25040]: cluster 2024-09-14T03:11:42.157516+0000 mgr.a (mgr.14355) 12577 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:44.435 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:44.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:44 smithi007 bash[22722]: cluster 2024-09-14T03:11:42.157516+0000 mgr.a (mgr.14355) 12577 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:11:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:45 smithi131 bash[24745]: audit 2024-09-14T03:11:43.988959+0000 mgr.a (mgr.14355) 12578 : audit [DBG] from='client.274515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:45 smithi171 bash[25040]: audit 2024-09-14T03:11:43.988959+0000 mgr.a (mgr.14355) 12578 : audit [DBG] from='client.274515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:45 smithi007 bash[22722]: audit 2024-09-14T03:11:43.988959+0000 mgr.a (mgr.14355) 12578 : audit [DBG] from='client.274515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:46 smithi131 bash[24745]: cluster 2024-09-14T03:11:44.158192+0000 mgr.a (mgr.14355) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:46 smithi171 bash[25040]: cluster 2024-09-14T03:11:44.158192+0000 mgr.a (mgr.14355) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:46 smithi007 bash[22722]: cluster 2024-09-14T03:11:44.158192+0000 mgr.a (mgr.14355) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:48 smithi171 bash[25040]: cluster 2024-09-14T03:11:46.160423+0000 mgr.a (mgr.14355) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:48 smithi007 bash[22722]: cluster 2024-09-14T03:11:46.160423+0000 mgr.a (mgr.14355) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:48 smithi131 bash[24745]: cluster 2024-09-14T03:11:46.160423+0000 mgr.a (mgr.14355) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:50.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:50.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:50 smithi171 bash[25040]: cluster 2024-09-14T03:11:48.161173+0000 mgr.a (mgr.14355) 12581 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:50 smithi007 bash[22722]: cluster 2024-09-14T03:11:48.161173+0000 mgr.a (mgr.14355) 12581 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:50 smithi131 bash[24745]: cluster 2024-09-14T03:11:48.161173+0000 mgr.a (mgr.14355) 12581 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:51 smithi007 bash[22722]: audit 2024-09-14T03:11:49.765483+0000 mgr.a (mgr.14355) 12582 : audit [DBG] from='client.274590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:51 smithi131 bash[24745]: audit 2024-09-14T03:11:49.765483+0000 mgr.a (mgr.14355) 12582 : audit [DBG] from='client.274590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:51 smithi171 bash[25040]: audit 2024-09-14T03:11:49.765483+0000 mgr.a (mgr.14355) 12582 : audit [DBG] from='client.274590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:52 smithi007 bash[22722]: cluster 2024-09-14T03:11:50.161614+0000 mgr.a (mgr.14355) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:52 smithi131 bash[24745]: cluster 2024-09-14T03:11:50.161614+0000 mgr.a (mgr.14355) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:52 smithi171 bash[25040]: cluster 2024-09-14T03:11:50.161614+0000 mgr.a (mgr.14355) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:54 smithi007 bash[22722]: cluster 2024-09-14T03:11:52.163938+0000 mgr.a (mgr.14355) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:54 smithi131 bash[24745]: cluster 2024-09-14T03:11:52.163938+0000 mgr.a (mgr.14355) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:54 smithi171 bash[25040]: cluster 2024-09-14T03:11:52.163938+0000 mgr.a (mgr.14355) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:11:55.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:11:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:11:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:11:55.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:11:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:11:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:11:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:11:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:11:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:56 smithi007 bash[22722]: cluster 2024-09-14T03:11:54.164704+0000 mgr.a (mgr.14355) 12585 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:56 smithi131 bash[24745]: cluster 2024-09-14T03:11:54.164704+0000 mgr.a (mgr.14355) 12585 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:56 smithi171 bash[25040]: cluster 2024-09-14T03:11:54.164704+0000 mgr.a (mgr.14355) 12585 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:57 smithi007 bash[22722]: audit 2024-09-14T03:11:55.526099+0000 mgr.a (mgr.14355) 12586 : audit [DBG] from='client.274668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:57 smithi131 bash[24745]: audit 2024-09-14T03:11:55.526099+0000 mgr.a (mgr.14355) 12586 : audit [DBG] from='client.274668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:57 smithi171 bash[25040]: audit 2024-09-14T03:11:55.526099+0000 mgr.a (mgr.14355) 12586 : audit [DBG] from='client.274668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:11:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:11:58 smithi007 bash[22722]: cluster 2024-09-14T03:11:56.167498+0000 mgr.a (mgr.14355) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:11:58 smithi131 bash[24745]: cluster 2024-09-14T03:11:56.167498+0000 mgr.a (mgr.14355) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:11:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:11:58 smithi171 bash[25040]: cluster 2024-09-14T03:11:56.167498+0000 mgr.a (mgr.14355) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:00 smithi007 bash[22722]: cluster 2024-09-14T03:11:58.168277+0000 mgr.a (mgr.14355) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:00 smithi131 bash[24745]: cluster 2024-09-14T03:11:58.168277+0000 mgr.a (mgr.14355) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:00 smithi171 bash[25040]: cluster 2024-09-14T03:11:58.168277+0000 mgr.a (mgr.14355) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:00.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:00.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:00.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:01.697 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:01.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:02 smithi007 bash[22722]: cluster 2024-09-14T03:12:00.169057+0000 mgr.a (mgr.14355) 12589 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:12:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:02 smithi131 bash[24745]: cluster 2024-09-14T03:12:00.169057+0000 mgr.a (mgr.14355) 12589 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:12:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:02 smithi171 bash[25040]: cluster 2024-09-14T03:12:00.169057+0000 mgr.a (mgr.14355) 12589 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:12:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:03 smithi007 bash[22722]: audit 2024-09-14T03:12:01.273970+0000 mgr.a (mgr.14355) 12590 : audit [DBG] from='client.274746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:03 smithi131 bash[24745]: audit 2024-09-14T03:12:01.273970+0000 mgr.a (mgr.14355) 12590 : audit [DBG] from='client.274746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:03 smithi171 bash[25040]: audit 2024-09-14T03:12:01.273970+0000 mgr.a (mgr.14355) 12590 : audit [DBG] from='client.274746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:04 smithi007 bash[22722]: cluster 2024-09-14T03:12:02.171936+0000 mgr.a (mgr.14355) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:04 smithi131 bash[24745]: cluster 2024-09-14T03:12:02.171936+0000 mgr.a (mgr.14355) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:04 smithi171 bash[25040]: cluster 2024-09-14T03:12:02.171936+0000 mgr.a (mgr.14355) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:05 smithi007 bash[22722]: cluster 2024-09-14T03:12:04.172708+0000 mgr.a (mgr.14355) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:12:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:05 smithi131 bash[24745]: cluster 2024-09-14T03:12:04.172708+0000 mgr.a (mgr.14355) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:12:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:05 smithi171 bash[25040]: cluster 2024-09-14T03:12:04.172708+0000 mgr.a (mgr.14355) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:12:06.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:06.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:06.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:07.460 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:07 smithi131 bash[24745]: cluster 2024-09-14T03:12:06.174641+0000 mgr.a (mgr.14355) 12593 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:07 smithi131 bash[24745]: audit 2024-09-14T03:12:07.033709+0000 mgr.a (mgr.14355) 12594 : audit [DBG] from='client.274824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:07 smithi171 bash[25040]: cluster 2024-09-14T03:12:06.174641+0000 mgr.a (mgr.14355) 12593 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:07 smithi171 bash[25040]: audit 2024-09-14T03:12:07.033709+0000 mgr.a (mgr.14355) 12594 : audit [DBG] from='client.274824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:07 smithi007 bash[22722]: cluster 2024-09-14T03:12:06.174641+0000 mgr.a (mgr.14355) 12593 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:07 smithi007 bash[22722]: audit 2024-09-14T03:12:07.033709+0000 mgr.a (mgr.14355) 12594 : audit [DBG] from='client.274824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:09 smithi131 bash[24745]: cluster 2024-09-14T03:12:08.175624+0000 mgr.a (mgr.14355) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:09.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:09 smithi171 bash[25040]: cluster 2024-09-14T03:12:08.175624+0000 mgr.a (mgr.14355) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:09 smithi007 bash[22722]: cluster 2024-09-14T03:12:08.175624+0000 mgr.a (mgr.14355) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:11 smithi131 bash[24745]: cluster 2024-09-14T03:12:10.176417+0000 mgr.a (mgr.14355) 12596 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:11 smithi171 bash[25040]: cluster 2024-09-14T03:12:10.176417+0000 mgr.a (mgr.14355) 12596 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:11 smithi007 bash[22722]: cluster 2024-09-14T03:12:10.176417+0000 mgr.a (mgr.14355) 12596 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:12:12.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:12.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:13.209 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:13.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:13.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:13 smithi131 bash[24745]: cluster 2024-09-14T03:12:12.178686+0000 mgr.a (mgr.14355) 12597 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:12:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:13 smithi131 bash[24745]: audit 2024-09-14T03:12:12.792823+0000 mgr.a (mgr.14355) 12598 : audit [DBG] from='client.274902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:13 smithi171 bash[25040]: cluster 2024-09-14T03:12:12.178686+0000 mgr.a (mgr.14355) 12597 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:12:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:13 smithi171 bash[25040]: audit 2024-09-14T03:12:12.792823+0000 mgr.a (mgr.14355) 12598 : audit [DBG] from='client.274902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:13 smithi007 bash[22722]: cluster 2024-09-14T03:12:12.178686+0000 mgr.a (mgr.14355) 12597 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:12:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:13 smithi007 bash[22722]: audit 2024-09-14T03:12:12.792823+0000 mgr.a (mgr.14355) 12598 : audit [DBG] from='client.274902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:15 smithi131 bash[24745]: cluster 2024-09-14T03:12:14.179624+0000 mgr.a (mgr.14355) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:15 smithi171 bash[25040]: cluster 2024-09-14T03:12:14.179624+0000 mgr.a (mgr.14355) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:15 smithi007 bash[22722]: cluster 2024-09-14T03:12:14.179624+0000 mgr.a (mgr.14355) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:17 smithi131 bash[24745]: cluster 2024-09-14T03:12:16.182083+0000 mgr.a (mgr.14355) 12600 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:17 smithi171 bash[25040]: cluster 2024-09-14T03:12:16.182083+0000 mgr.a (mgr.14355) 12600 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:17 smithi007 bash[22722]: cluster 2024-09-14T03:12:16.182083+0000 mgr.a (mgr.14355) 12600 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:18.979 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:18.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:19 smithi131 bash[24745]: cluster 2024-09-14T03:12:18.182917+0000 mgr.a (mgr.14355) 12601 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:19 smithi131 bash[24745]: audit 2024-09-14T03:12:18.541012+0000 mgr.a (mgr.14355) 12602 : audit [DBG] from='client.274980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:19 smithi171 bash[25040]: cluster 2024-09-14T03:12:18.182917+0000 mgr.a (mgr.14355) 12601 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:19 smithi171 bash[25040]: audit 2024-09-14T03:12:18.541012+0000 mgr.a (mgr.14355) 12602 : audit [DBG] from='client.274980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:19 smithi007 bash[22722]: cluster 2024-09-14T03:12:18.182917+0000 mgr.a (mgr.14355) 12601 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:19 smithi007 bash[22722]: audit 2024-09-14T03:12:18.541012+0000 mgr.a (mgr.14355) 12602 : audit [DBG] from='client.274980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:21 smithi131 bash[24745]: cluster 2024-09-14T03:12:20.183864+0000 mgr.a (mgr.14355) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:21 smithi171 bash[25040]: cluster 2024-09-14T03:12:20.183864+0000 mgr.a (mgr.14355) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:21 smithi007 bash[22722]: cluster 2024-09-14T03:12:20.183864+0000 mgr.a (mgr.14355) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:23 smithi131 bash[24745]: cluster 2024-09-14T03:12:22.186132+0000 mgr.a (mgr.14355) 12604 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:23 smithi171 bash[25040]: cluster 2024-09-14T03:12:22.186132+0000 mgr.a (mgr.14355) 12604 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:23 smithi007 bash[22722]: cluster 2024-09-14T03:12:22.186132+0000 mgr.a (mgr.14355) 12604 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:23.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:23.982 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:23.982 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:24.756 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:24.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:25 smithi131 bash[24745]: cluster 2024-09-14T03:12:24.186687+0000 mgr.a (mgr.14355) 12605 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:25 smithi131 bash[24745]: audit 2024-09-14T03:12:24.316779+0000 mgr.a (mgr.14355) 12606 : audit [DBG] from='client.275058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:25 smithi171 bash[25040]: cluster 2024-09-14T03:12:24.186687+0000 mgr.a (mgr.14355) 12605 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:25 smithi171 bash[25040]: audit 2024-09-14T03:12:24.316779+0000 mgr.a (mgr.14355) 12606 : audit [DBG] from='client.275058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:25 smithi007 bash[22722]: cluster 2024-09-14T03:12:24.186687+0000 mgr.a (mgr.14355) 12605 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:25 smithi007 bash[22722]: audit 2024-09-14T03:12:24.316779+0000 mgr.a (mgr.14355) 12606 : audit [DBG] from='client.275058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:27 smithi131 bash[24745]: cluster 2024-09-14T03:12:26.189096+0000 mgr.a (mgr.14355) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:27 smithi171 bash[25040]: cluster 2024-09-14T03:12:26.189096+0000 mgr.a (mgr.14355) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:27 smithi007 bash[22722]: cluster 2024-09-14T03:12:26.189096+0000 mgr.a (mgr.14355) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T03:12:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:29 smithi131 bash[24745]: cluster 2024-09-14T03:12:28.189875+0000 mgr.a (mgr.14355) 12608 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:29 smithi171 bash[25040]: cluster 2024-09-14T03:12:28.189875+0000 mgr.a (mgr.14355) 12608 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:29 smithi007 bash[22722]: cluster 2024-09-14T03:12:28.189875+0000 mgr.a (mgr.14355) 12608 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:29.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:29.758 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:30 smithi171 bash[25040]: audit 2024-09-14T03:12:29.476644+0000 mon.a (mon.0) 2476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:12:30.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:30 smithi007 bash[22722]: audit 2024-09-14T03:12:29.476644+0000 mon.a (mon.0) 2476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:12:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:30 smithi131 bash[24745]: audit 2024-09-14T03:12:29.476644+0000 mon.a (mon.0) 2476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.177740+0000 mgr.a (mgr.14355) 12609 : audit [DBG] from='client.275136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: cluster 2024-09-14T03:12:30.196603+0000 mgr.a (mgr.14355) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.347139+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.348192+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.353446+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:12:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.355607+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:31.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:31 smithi171 bash[25040]: audit 2024-09-14T03:12:30.356795+0000 mgr.a (mgr.14355) 12611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:31.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22972]: debug 2024-09-14T03:12:31.314+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:12:31.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22972]: debug 2024-09-14T03:12:31.318+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:12:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.177740+0000 mgr.a (mgr.14355) 12609 : audit [DBG] from='client.275136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: cluster 2024-09-14T03:12:30.196603+0000 mgr.a (mgr.14355) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.347139+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.348192+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.353446+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.355607+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:31 smithi007 bash[22722]: audit 2024-09-14T03:12:30.356795+0000 mgr.a (mgr.14355) 12611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.177740+0000 mgr.a (mgr.14355) 12609 : audit [DBG] from='client.275136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: cluster 2024-09-14T03:12:30.196603+0000 mgr.a (mgr.14355) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.347139+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:12:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.348192+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:12:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.353446+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:12:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.355607+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:31 smithi131 bash[24745]: audit 2024-09-14T03:12:30.356795+0000 mgr.a (mgr.14355) 12611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:12:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:32 smithi007 bash[22722]: audit 2024-09-14T03:12:31.317029+0000 mgr.a (mgr.14355) 12612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:12:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:32 smithi007 bash[22722]: cephadm 2024-09-14T03:12:31.318317+0000 mgr.a (mgr.14355) 12613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:12:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:32 smithi131 bash[24745]: audit 2024-09-14T03:12:31.317029+0000 mgr.a (mgr.14355) 12612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:12:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:32 smithi131 bash[24745]: cephadm 2024-09-14T03:12:31.318317+0000 mgr.a (mgr.14355) 12613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:12:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:32 smithi171 bash[25040]: audit 2024-09-14T03:12:31.317029+0000 mgr.a (mgr.14355) 12612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:12:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:32 smithi171 bash[25040]: cephadm 2024-09-14T03:12:31.318317+0000 mgr.a (mgr.14355) 12613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:12:33.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:33 smithi007 bash[22722]: cluster 2024-09-14T03:12:32.199396+0000 mgr.a (mgr.14355) 12614 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:33 smithi131 bash[24745]: cluster 2024-09-14T03:12:32.199396+0000 mgr.a (mgr.14355) 12614 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:33 smithi171 bash[25040]: cluster 2024-09-14T03:12:32.199396+0000 mgr.a (mgr.14355) 12614 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:12:35.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:35.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:35 smithi007 bash[22722]: cluster 2024-09-14T03:12:34.200201+0000 mgr.a (mgr.14355) 12615 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:35 smithi131 bash[24745]: cluster 2024-09-14T03:12:34.200201+0000 mgr.a (mgr.14355) 12615 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:35 smithi171 bash[25040]: cluster 2024-09-14T03:12:34.200201+0000 mgr.a (mgr.14355) 12615 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:12:36.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:36.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:36 smithi007 bash[22722]: audit 2024-09-14T03:12:35.965558+0000 mgr.a (mgr.14355) 12616 : audit [DBG] from='client.275316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:36 smithi131 bash[24745]: audit 2024-09-14T03:12:35.965558+0000 mgr.a (mgr.14355) 12616 : audit [DBG] from='client.275316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:36 smithi171 bash[25040]: audit 2024-09-14T03:12:35.965558+0000 mgr.a (mgr.14355) 12616 : audit [DBG] from='client.275316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:37 smithi007 bash[22722]: cluster 2024-09-14T03:12:36.202167+0000 mgr.a (mgr.14355) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:37 smithi131 bash[24745]: cluster 2024-09-14T03:12:36.202167+0000 mgr.a (mgr.14355) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:37 smithi171 bash[25040]: cluster 2024-09-14T03:12:36.202167+0000 mgr.a (mgr.14355) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:39 smithi007 bash[22722]: cluster 2024-09-14T03:12:38.203082+0000 mgr.a (mgr.14355) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:39 smithi131 bash[24745]: cluster 2024-09-14T03:12:38.203082+0000 mgr.a (mgr.14355) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:39 smithi171 bash[25040]: cluster 2024-09-14T03:12:38.203082+0000 mgr.a (mgr.14355) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:41.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:41 smithi007 bash[22722]: cluster 2024-09-14T03:12:40.203868+0000 mgr.a (mgr.14355) 12619 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:41 smithi131 bash[24745]: cluster 2024-09-14T03:12:40.203868+0000 mgr.a (mgr.14355) 12619 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:41 smithi171 bash[25040]: cluster 2024-09-14T03:12:40.203868+0000 mgr.a (mgr.14355) 12619 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:12:42.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:42 smithi007 bash[22722]: audit 2024-09-14T03:12:41.741208+0000 mgr.a (mgr.14355) 12620 : audit [DBG] from='client.275394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:42 smithi131 bash[24745]: audit 2024-09-14T03:12:41.741208+0000 mgr.a (mgr.14355) 12620 : audit [DBG] from='client.275394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:42 smithi171 bash[25040]: audit 2024-09-14T03:12:41.741208+0000 mgr.a (mgr.14355) 12620 : audit [DBG] from='client.275394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:43 smithi007 bash[22722]: cluster 2024-09-14T03:12:42.205119+0000 mgr.a (mgr.14355) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:43 smithi131 bash[24745]: cluster 2024-09-14T03:12:42.205119+0000 mgr.a (mgr.14355) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:43 smithi171 bash[25040]: cluster 2024-09-14T03:12:42.205119+0000 mgr.a (mgr.14355) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:45 smithi007 bash[22722]: cluster 2024-09-14T03:12:44.205837+0000 mgr.a (mgr.14355) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:45 smithi131 bash[24745]: cluster 2024-09-14T03:12:44.205837+0000 mgr.a (mgr.14355) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:45 smithi171 bash[25040]: cluster 2024-09-14T03:12:44.205837+0000 mgr.a (mgr.14355) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:47.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:47.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:47.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:47 smithi007 bash[22722]: cluster 2024-09-14T03:12:46.207864+0000 mgr.a (mgr.14355) 12623 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:47 smithi131 bash[24745]: cluster 2024-09-14T03:12:46.207864+0000 mgr.a (mgr.14355) 12623 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:47 smithi171 bash[25040]: cluster 2024-09-14T03:12:46.207864+0000 mgr.a (mgr.14355) 12623 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:12:47.908 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:48 smithi007 bash[22722]: audit 2024-09-14T03:12:47.498539+0000 mgr.a (mgr.14355) 12624 : audit [DBG] from='client.275472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:48 smithi131 bash[24745]: audit 2024-09-14T03:12:47.498539+0000 mgr.a (mgr.14355) 12624 : audit [DBG] from='client.275472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:48 smithi171 bash[25040]: audit 2024-09-14T03:12:47.498539+0000 mgr.a (mgr.14355) 12624 : audit [DBG] from='client.275472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:49 smithi007 bash[22722]: cluster 2024-09-14T03:12:48.208782+0000 mgr.a (mgr.14355) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:49 smithi131 bash[24745]: cluster 2024-09-14T03:12:48.208782+0000 mgr.a (mgr.14355) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:49 smithi171 bash[25040]: cluster 2024-09-14T03:12:48.208782+0000 mgr.a (mgr.14355) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:51 smithi007 bash[22722]: cluster 2024-09-14T03:12:50.209608+0000 mgr.a (mgr.14355) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:51 smithi131 bash[24745]: cluster 2024-09-14T03:12:50.209608+0000 mgr.a (mgr.14355) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:51 smithi171 bash[25040]: cluster 2024-09-14T03:12:50.209608+0000 mgr.a (mgr.14355) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:52.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:52.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:52.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:53.680 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:53 smithi007 bash[22722]: cluster 2024-09-14T03:12:52.211922+0000 mgr.a (mgr.14355) 12627 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:53 smithi131 bash[24745]: cluster 2024-09-14T03:12:52.211922+0000 mgr.a (mgr.14355) 12627 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:53 smithi171 bash[25040]: cluster 2024-09-14T03:12:52.211922+0000 mgr.a (mgr.14355) 12627 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:54 smithi007 bash[22722]: audit 2024-09-14T03:12:53.243857+0000 mgr.a (mgr.14355) 12628 : audit [DBG] from='client.275550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:54 smithi131 bash[24745]: audit 2024-09-14T03:12:53.243857+0000 mgr.a (mgr.14355) 12628 : audit [DBG] from='client.275550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:54 smithi171 bash[25040]: audit 2024-09-14T03:12:53.243857+0000 mgr.a (mgr.14355) 12628 : audit [DBG] from='client.275550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:55 smithi007 bash[22722]: cluster 2024-09-14T03:12:54.212894+0000 mgr.a (mgr.14355) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:55 smithi131 bash[24745]: cluster 2024-09-14T03:12:54.212894+0000 mgr.a (mgr.14355) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:55 smithi171 bash[25040]: cluster 2024-09-14T03:12:54.212894+0000 mgr.a (mgr.14355) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:57 smithi007 bash[22722]: cluster 2024-09-14T03:12:56.215211+0000 mgr.a (mgr.14355) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:57 smithi131 bash[24745]: cluster 2024-09-14T03:12:56.215211+0000 mgr.a (mgr.14355) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:57 smithi171 bash[25040]: cluster 2024-09-14T03:12:56.215211+0000 mgr.a (mgr.14355) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:12:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:12:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:12:58.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:12:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:12:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:12:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:12:59.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:12:59.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:12:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:59 smithi007 bash[22722]: cluster 2024-09-14T03:12:58.216023+0000 mgr.a (mgr.14355) 12631 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:12:59 smithi007 bash[22722]: audit 2024-09-14T03:12:59.023328+0000 mgr.a (mgr.14355) 12632 : audit [DBG] from='client.275628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:59 smithi131 bash[24745]: cluster 2024-09-14T03:12:58.216023+0000 mgr.a (mgr.14355) 12631 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:12:59 smithi131 bash[24745]: audit 2024-09-14T03:12:59.023328+0000 mgr.a (mgr.14355) 12632 : audit [DBG] from='client.275628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:12:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:59 smithi171 bash[25040]: cluster 2024-09-14T03:12:58.216023+0000 mgr.a (mgr.14355) 12631 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:12:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:12:59 smithi171 bash[25040]: audit 2024-09-14T03:12:59.023328+0000 mgr.a (mgr.14355) 12632 : audit [DBG] from='client.275628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:01 smithi007 bash[22722]: cluster 2024-09-14T03:13:00.217009+0000 mgr.a (mgr.14355) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:01 smithi131 bash[24745]: cluster 2024-09-14T03:13:00.217009+0000 mgr.a (mgr.14355) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:01 smithi171 bash[25040]: cluster 2024-09-14T03:13:00.217009+0000 mgr.a (mgr.14355) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:03 smithi007 bash[22722]: cluster 2024-09-14T03:13:02.219304+0000 mgr.a (mgr.14355) 12634 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:03 smithi131 bash[24745]: cluster 2024-09-14T03:13:02.219304+0000 mgr.a (mgr.14355) 12634 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:03 smithi171 bash[25040]: cluster 2024-09-14T03:13:02.219304+0000 mgr.a (mgr.14355) 12634 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:04.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:04.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:05.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:05.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:05.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:05.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:05.207 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:05 smithi007 bash[22722]: cluster 2024-09-14T03:13:04.220081+0000 mgr.a (mgr.14355) 12635 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:05 smithi007 bash[22722]: audit 2024-09-14T03:13:04.789314+0000 mgr.a (mgr.14355) 12636 : audit [DBG] from='client.275706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:05 smithi131 bash[24745]: cluster 2024-09-14T03:13:04.220081+0000 mgr.a (mgr.14355) 12635 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:05 smithi131 bash[24745]: audit 2024-09-14T03:13:04.789314+0000 mgr.a (mgr.14355) 12636 : audit [DBG] from='client.275706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:05 smithi171 bash[25040]: cluster 2024-09-14T03:13:04.220081+0000 mgr.a (mgr.14355) 12635 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:05 smithi171 bash[25040]: audit 2024-09-14T03:13:04.789314+0000 mgr.a (mgr.14355) 12636 : audit [DBG] from='client.275706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:07 smithi007 bash[22722]: cluster 2024-09-14T03:13:06.222576+0000 mgr.a (mgr.14355) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:07 smithi131 bash[24745]: cluster 2024-09-14T03:13:06.222576+0000 mgr.a (mgr.14355) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:07 smithi171 bash[25040]: cluster 2024-09-14T03:13:06.222576+0000 mgr.a (mgr.14355) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:09 smithi007 bash[22722]: cluster 2024-09-14T03:13:08.223375+0000 mgr.a (mgr.14355) 12638 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:09 smithi131 bash[24745]: cluster 2024-09-14T03:13:08.223375+0000 mgr.a (mgr.14355) 12638 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:09 smithi171 bash[25040]: cluster 2024-09-14T03:13:08.223375+0000 mgr.a (mgr.14355) 12638 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:10.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:10.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:10.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:10.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:10.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:10.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:10.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:10.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:11 smithi007 bash[22722]: cluster 2024-09-14T03:13:10.224028+0000 mgr.a (mgr.14355) 12639 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:11 smithi007 bash[22722]: audit 2024-09-14T03:13:10.545640+0000 mgr.a (mgr.14355) 12640 : audit [DBG] from='client.275784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:11 smithi131 bash[24745]: cluster 2024-09-14T03:13:10.224028+0000 mgr.a (mgr.14355) 12639 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:11 smithi131 bash[24745]: audit 2024-09-14T03:13:10.545640+0000 mgr.a (mgr.14355) 12640 : audit [DBG] from='client.275784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:11 smithi171 bash[25040]: cluster 2024-09-14T03:13:10.224028+0000 mgr.a (mgr.14355) 12639 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:11 smithi171 bash[25040]: audit 2024-09-14T03:13:10.545640+0000 mgr.a (mgr.14355) 12640 : audit [DBG] from='client.275784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:13 smithi007 bash[22722]: cluster 2024-09-14T03:13:12.226764+0000 mgr.a (mgr.14355) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:13 smithi131 bash[24745]: cluster 2024-09-14T03:13:12.226764+0000 mgr.a (mgr.14355) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:13 smithi171 bash[25040]: cluster 2024-09-14T03:13:12.226764+0000 mgr.a (mgr.14355) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:15 smithi007 bash[22722]: cluster 2024-09-14T03:13:14.227589+0000 mgr.a (mgr.14355) 12642 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:15 smithi131 bash[24745]: cluster 2024-09-14T03:13:14.227589+0000 mgr.a (mgr.14355) 12642 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:15 smithi171 bash[25040]: cluster 2024-09-14T03:13:14.227589+0000 mgr.a (mgr.14355) 12642 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:16.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:16.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:17 smithi007 bash[22722]: cluster 2024-09-14T03:13:16.228874+0000 mgr.a (mgr.14355) 12643 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:17 smithi007 bash[22722]: audit 2024-09-14T03:13:16.286387+0000 mgr.a (mgr.14355) 12644 : audit [DBG] from='client.275862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:17 smithi131 bash[24745]: cluster 2024-09-14T03:13:16.228874+0000 mgr.a (mgr.14355) 12643 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:17 smithi131 bash[24745]: audit 2024-09-14T03:13:16.286387+0000 mgr.a (mgr.14355) 12644 : audit [DBG] from='client.275862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:17 smithi171 bash[25040]: cluster 2024-09-14T03:13:16.228874+0000 mgr.a (mgr.14355) 12643 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:17 smithi171 bash[25040]: audit 2024-09-14T03:13:16.286387+0000 mgr.a (mgr.14355) 12644 : audit [DBG] from='client.275862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:19 smithi007 bash[22722]: cluster 2024-09-14T03:13:18.229719+0000 mgr.a (mgr.14355) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:19 smithi131 bash[24745]: cluster 2024-09-14T03:13:18.229719+0000 mgr.a (mgr.14355) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:19 smithi171 bash[25040]: cluster 2024-09-14T03:13:18.229719+0000 mgr.a (mgr.14355) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:21 smithi007 bash[22722]: cluster 2024-09-14T03:13:20.230539+0000 mgr.a (mgr.14355) 12646 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:21 smithi131 bash[24745]: cluster 2024-09-14T03:13:20.230539+0000 mgr.a (mgr.14355) 12646 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:13:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:21 smithi171 bash[25040]: cluster 2024-09-14T03:13:20.230539+0000 mgr.a (mgr.14355) 12646 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:13:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:22.502 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:22 smithi007 bash[22722]: audit 2024-09-14T03:13:22.052769+0000 mgr.a (mgr.14355) 12647 : audit [DBG] from='client.275937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:22 smithi131 bash[24745]: audit 2024-09-14T03:13:22.052769+0000 mgr.a (mgr.14355) 12647 : audit [DBG] from='client.275937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:22 smithi171 bash[25040]: audit 2024-09-14T03:13:22.052769+0000 mgr.a (mgr.14355) 12647 : audit [DBG] from='client.275937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:23 smithi007 bash[22722]: cluster 2024-09-14T03:13:22.231922+0000 mgr.a (mgr.14355) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:23 smithi131 bash[24745]: cluster 2024-09-14T03:13:22.231922+0000 mgr.a (mgr.14355) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:23 smithi171 bash[25040]: cluster 2024-09-14T03:13:22.231922+0000 mgr.a (mgr.14355) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:25 smithi007 bash[22722]: cluster 2024-09-14T03:13:24.232786+0000 mgr.a (mgr.14355) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:25 smithi131 bash[24745]: cluster 2024-09-14T03:13:24.232786+0000 mgr.a (mgr.14355) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:25 smithi171 bash[25040]: cluster 2024-09-14T03:13:24.232786+0000 mgr.a (mgr.14355) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:27.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:27.504 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:27 smithi007 bash[22722]: cluster 2024-09-14T03:13:26.235047+0000 mgr.a (mgr.14355) 12650 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:27 smithi131 bash[24745]: cluster 2024-09-14T03:13:26.235047+0000 mgr.a (mgr.14355) 12650 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:27 smithi171 bash[25040]: cluster 2024-09-14T03:13:26.235047+0000 mgr.a (mgr.14355) 12650 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:28.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:28 smithi007 bash[22722]: audit 2024-09-14T03:13:27.842137+0000 mgr.a (mgr.14355) 12651 : audit [DBG] from='client.276015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:28 smithi131 bash[24745]: audit 2024-09-14T03:13:27.842137+0000 mgr.a (mgr.14355) 12651 : audit [DBG] from='client.276015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:28 smithi171 bash[25040]: audit 2024-09-14T03:13:27.842137+0000 mgr.a (mgr.14355) 12651 : audit [DBG] from='client.276015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:29 smithi007 bash[22722]: cluster 2024-09-14T03:13:28.235587+0000 mgr.a (mgr.14355) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:29 smithi131 bash[24745]: cluster 2024-09-14T03:13:28.235587+0000 mgr.a (mgr.14355) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:29 smithi171 bash[25040]: cluster 2024-09-14T03:13:28.235587+0000 mgr.a (mgr.14355) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:31 smithi131 bash[24745]: cluster 2024-09-14T03:13:30.236473+0000 mgr.a (mgr.14355) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:31 smithi131 bash[24745]: audit 2024-09-14T03:13:31.368432+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:13:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:31 smithi171 bash[25040]: cluster 2024-09-14T03:13:30.236473+0000 mgr.a (mgr.14355) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:31 smithi171 bash[25040]: audit 2024-09-14T03:13:31.368432+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:13:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:31 smithi007 bash[22722]: cluster 2024-09-14T03:13:30.236473+0000 mgr.a (mgr.14355) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:31 smithi007 bash[22722]: audit 2024-09-14T03:13:31.368432+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:13:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:32 smithi131 bash[24745]: audit 2024-09-14T03:13:32.209995+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:13:32.842 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:32 smithi131 bash[24745]: audit 2024-09-14T03:13:32.211746+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:13:32.842 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:32 smithi131 bash[24745]: audit 2024-09-14T03:13:32.221965+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:13:32.842 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:32 smithi131 bash[24745]: audit 2024-09-14T03:13:32.224870+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:32.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:32 smithi171 bash[25040]: audit 2024-09-14T03:13:32.209995+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:13:32.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:32 smithi171 bash[25040]: audit 2024-09-14T03:13:32.211746+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:13:32.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:32 smithi171 bash[25040]: audit 2024-09-14T03:13:32.221965+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:13:32.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:32 smithi171 bash[25040]: audit 2024-09-14T03:13:32.224870+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22722]: audit 2024-09-14T03:13:32.209995+0000 mon.a (mon.0) 2482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22722]: audit 2024-09-14T03:13:32.211746+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22722]: audit 2024-09-14T03:13:32.221965+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22722]: audit 2024-09-14T03:13:32.224870+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:33.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:33.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:33.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:33.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22972]: debug 2024-09-14T03:13:32.957+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:13:33.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:13:32 smithi007 bash[22972]: debug 2024-09-14T03:13:32.961+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:13:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:33 smithi131 bash[24745]: audit 2024-09-14T03:13:32.227198+0000 mgr.a (mgr.14355) 12654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:33 smithi131 bash[24745]: cluster 2024-09-14T03:13:32.246180+0000 mgr.a (mgr.14355) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:33 smithi131 bash[24745]: audit 2024-09-14T03:13:32.962266+0000 mgr.a (mgr.14355) 12656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:13:33.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:33 smithi131 bash[24745]: cephadm 2024-09-14T03:13:32.963495+0000 mgr.a (mgr.14355) 12657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:13:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:33 smithi171 bash[25040]: audit 2024-09-14T03:13:32.227198+0000 mgr.a (mgr.14355) 12654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:33 smithi171 bash[25040]: cluster 2024-09-14T03:13:32.246180+0000 mgr.a (mgr.14355) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:33 smithi171 bash[25040]: audit 2024-09-14T03:13:32.962266+0000 mgr.a (mgr.14355) 12656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:13:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:33 smithi171 bash[25040]: cephadm 2024-09-14T03:13:32.963495+0000 mgr.a (mgr.14355) 12657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:13:33.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:33 smithi007 bash[22722]: audit 2024-09-14T03:13:32.227198+0000 mgr.a (mgr.14355) 12654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:13:33.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:33 smithi007 bash[22722]: cluster 2024-09-14T03:13:32.246180+0000 mgr.a (mgr.14355) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:13:33.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:33 smithi007 bash[22722]: audit 2024-09-14T03:13:32.962266+0000 mgr.a (mgr.14355) 12656 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:13:33.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:33 smithi007 bash[22722]: cephadm 2024-09-14T03:13:32.963495+0000 mgr.a (mgr.14355) 12657 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:13:34.023 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:34 smithi131 bash[24745]: audit 2024-09-14T03:13:33.602356+0000 mgr.a (mgr.14355) 12658 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:34 smithi171 bash[25040]: audit 2024-09-14T03:13:33.602356+0000 mgr.a (mgr.14355) 12658 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:34 smithi007 bash[22722]: audit 2024-09-14T03:13:33.602356+0000 mgr.a (mgr.14355) 12658 : audit [DBG] from='client.276198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:35 smithi131 bash[24745]: cluster 2024-09-14T03:13:34.247213+0000 mgr.a (mgr.14355) 12659 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:35 smithi171 bash[25040]: cluster 2024-09-14T03:13:34.247213+0000 mgr.a (mgr.14355) 12659 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:35 smithi007 bash[22722]: cluster 2024-09-14T03:13:34.247213+0000 mgr.a (mgr.14355) 12659 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:37 smithi131 bash[24745]: cluster 2024-09-14T03:13:36.249445+0000 mgr.a (mgr.14355) 12660 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:37 smithi171 bash[25040]: cluster 2024-09-14T03:13:36.249445+0000 mgr.a (mgr.14355) 12660 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:37 smithi007 bash[22722]: cluster 2024-09-14T03:13:36.249445+0000 mgr.a (mgr.14355) 12660 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:39 smithi131 bash[24745]: cluster 2024-09-14T03:13:38.250326+0000 mgr.a (mgr.14355) 12661 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:39.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:39.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:39.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:39.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:39 smithi171 bash[25040]: cluster 2024-09-14T03:13:38.250326+0000 mgr.a (mgr.14355) 12661 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:39 smithi007 bash[22722]: cluster 2024-09-14T03:13:38.250326+0000 mgr.a (mgr.14355) 12661 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:40 smithi131 bash[24745]: audit 2024-09-14T03:13:39.356375+0000 mgr.a (mgr.14355) 12662 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:40 smithi171 bash[25040]: audit 2024-09-14T03:13:39.356375+0000 mgr.a (mgr.14355) 12662 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:40 smithi007 bash[22722]: audit 2024-09-14T03:13:39.356375+0000 mgr.a (mgr.14355) 12662 : audit [DBG] from='client.276276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:41 smithi131 bash[24745]: cluster 2024-09-14T03:13:40.251939+0000 mgr.a (mgr.14355) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:41 smithi171 bash[25040]: cluster 2024-09-14T03:13:40.251939+0000 mgr.a (mgr.14355) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:41.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:41 smithi007 bash[22722]: cluster 2024-09-14T03:13:40.251939+0000 mgr.a (mgr.14355) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:43 smithi131 bash[24745]: cluster 2024-09-14T03:13:42.253633+0000 mgr.a (mgr.14355) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:43 smithi171 bash[25040]: cluster 2024-09-14T03:13:42.253633+0000 mgr.a (mgr.14355) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:43 smithi007 bash[22722]: cluster 2024-09-14T03:13:42.253633+0000 mgr.a (mgr.14355) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:44.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:44.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:45.579 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:45.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:45.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:45.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:45.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:45 smithi131 bash[24745]: cluster 2024-09-14T03:13:44.254458+0000 mgr.a (mgr.14355) 12665 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:45 smithi171 bash[25040]: cluster 2024-09-14T03:13:44.254458+0000 mgr.a (mgr.14355) 12665 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:45 smithi007 bash[22722]: cluster 2024-09-14T03:13:44.254458+0000 mgr.a (mgr.14355) 12665 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:46 smithi131 bash[24745]: audit 2024-09-14T03:13:45.134529+0000 mgr.a (mgr.14355) 12666 : audit [DBG] from='client.276354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:46 smithi171 bash[25040]: audit 2024-09-14T03:13:45.134529+0000 mgr.a (mgr.14355) 12666 : audit [DBG] from='client.276354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:46 smithi007 bash[22722]: audit 2024-09-14T03:13:45.134529+0000 mgr.a (mgr.14355) 12666 : audit [DBG] from='client.276354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:47 smithi131 bash[24745]: cluster 2024-09-14T03:13:46.257313+0000 mgr.a (mgr.14355) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:47 smithi171 bash[25040]: cluster 2024-09-14T03:13:46.257313+0000 mgr.a (mgr.14355) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:47 smithi007 bash[22722]: cluster 2024-09-14T03:13:46.257313+0000 mgr.a (mgr.14355) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:13:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:49 smithi131 bash[24745]: cluster 2024-09-14T03:13:48.258112+0000 mgr.a (mgr.14355) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:49 smithi171 bash[25040]: cluster 2024-09-14T03:13:48.258112+0000 mgr.a (mgr.14355) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:49 smithi007 bash[22722]: cluster 2024-09-14T03:13:48.258112+0000 mgr.a (mgr.14355) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:50.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:50.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:50.581 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:51.345 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:51.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:51 smithi131 bash[24745]: cluster 2024-09-14T03:13:50.259320+0000 mgr.a (mgr.14355) 12669 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:13:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:51 smithi131 bash[24745]: audit 2024-09-14T03:13:50.915141+0000 mgr.a (mgr.14355) 12670 : audit [DBG] from='client.276429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:51 smithi171 bash[25040]: cluster 2024-09-14T03:13:50.259320+0000 mgr.a (mgr.14355) 12669 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:13:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:51 smithi171 bash[25040]: audit 2024-09-14T03:13:50.915141+0000 mgr.a (mgr.14355) 12670 : audit [DBG] from='client.276429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:51 smithi007 bash[22722]: cluster 2024-09-14T03:13:50.259320+0000 mgr.a (mgr.14355) 12669 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T03:13:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:51 smithi007 bash[22722]: audit 2024-09-14T03:13:50.915141+0000 mgr.a (mgr.14355) 12670 : audit [DBG] from='client.276429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:53 smithi131 bash[24745]: cluster 2024-09-14T03:13:52.261528+0000 mgr.a (mgr.14355) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:13:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:53 smithi171 bash[25040]: cluster 2024-09-14T03:13:52.261528+0000 mgr.a (mgr.14355) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:13:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:53 smithi007 bash[22722]: cluster 2024-09-14T03:13:52.261528+0000 mgr.a (mgr.14355) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:13:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:55 smithi171 bash[25040]: cluster 2024-09-14T03:13:54.262341+0000 mgr.a (mgr.14355) 12672 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:55 smithi007 bash[22722]: cluster 2024-09-14T03:13:54.262341+0000 mgr.a (mgr.14355) 12672 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:55 smithi131 bash[24745]: cluster 2024-09-14T03:13:54.262341+0000 mgr.a (mgr.14355) 12672 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:13:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:13:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:13:56.348 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:13:57.137 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:13:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:13:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:13:57.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:13:57.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:13:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:57 smithi171 bash[25040]: cluster 2024-09-14T03:13:56.264364+0000 mgr.a (mgr.14355) 12673 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:57 smithi171 bash[25040]: audit 2024-09-14T03:13:56.689144+0000 mgr.a (mgr.14355) 12674 : audit [DBG] from='client.276504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:57.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:57 smithi007 bash[22722]: cluster 2024-09-14T03:13:56.264364+0000 mgr.a (mgr.14355) 12673 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:57.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:57 smithi007 bash[22722]: audit 2024-09-14T03:13:56.689144+0000 mgr.a (mgr.14355) 12674 : audit [DBG] from='client.276504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:57 smithi131 bash[24745]: cluster 2024-09-14T03:13:56.264364+0000 mgr.a (mgr.14355) 12673 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:57 smithi131 bash[24745]: audit 2024-09-14T03:13:56.689144+0000 mgr.a (mgr.14355) 12674 : audit [DBG] from='client.276504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:13:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:13:59 smithi171 bash[25040]: cluster 2024-09-14T03:13:58.265257+0000 mgr.a (mgr.14355) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:13:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:13:59 smithi007 bash[22722]: cluster 2024-09-14T03:13:58.265257+0000 mgr.a (mgr.14355) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:13:59 smithi131 bash[24745]: cluster 2024-09-14T03:13:58.265257+0000 mgr.a (mgr.14355) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:01 smithi007 bash[22722]: cluster 2024-09-14T03:14:00.267386+0000 mgr.a (mgr.14355) 12676 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T03:14:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:01 smithi131 bash[24745]: cluster 2024-09-14T03:14:00.267386+0000 mgr.a (mgr.14355) 12676 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T03:14:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:01 smithi171 bash[25040]: cluster 2024-09-14T03:14:00.267386+0000 mgr.a (mgr.14355) 12676 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T03:14:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:02.925 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:02.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:02.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:02.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:03 smithi007 bash[22722]: cluster 2024-09-14T03:14:02.268180+0000 mgr.a (mgr.14355) 12677 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:03 smithi007 bash[22722]: audit 2024-09-14T03:14:02.478734+0000 mgr.a (mgr.14355) 12678 : audit [DBG] from='client.276582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:03 smithi131 bash[24745]: cluster 2024-09-14T03:14:02.268180+0000 mgr.a (mgr.14355) 12677 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:03 smithi131 bash[24745]: audit 2024-09-14T03:14:02.478734+0000 mgr.a (mgr.14355) 12678 : audit [DBG] from='client.276582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:03 smithi171 bash[25040]: cluster 2024-09-14T03:14:02.268180+0000 mgr.a (mgr.14355) 12677 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:03 smithi171 bash[25040]: audit 2024-09-14T03:14:02.478734+0000 mgr.a (mgr.14355) 12678 : audit [DBG] from='client.276582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:05.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:05 smithi007 bash[22722]: cluster 2024-09-14T03:14:04.269033+0000 mgr.a (mgr.14355) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:05 smithi131 bash[24745]: cluster 2024-09-14T03:14:04.269033+0000 mgr.a (mgr.14355) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:05 smithi171 bash[25040]: cluster 2024-09-14T03:14:04.269033+0000 mgr.a (mgr.14355) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:07 smithi007 bash[22722]: cluster 2024-09-14T03:14:06.271286+0000 mgr.a (mgr.14355) 12680 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:07 smithi131 bash[24745]: cluster 2024-09-14T03:14:06.271286+0000 mgr.a (mgr.14355) 12680 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:07 smithi171 bash[25040]: cluster 2024-09-14T03:14:06.271286+0000 mgr.a (mgr.14355) 12680 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:08.673 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:09 smithi007 bash[22722]: audit 2024-09-14T03:14:08.254477+0000 mgr.a (mgr.14355) 12681 : audit [DBG] from='client.276657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:09 smithi007 bash[22722]: cluster 2024-09-14T03:14:08.272922+0000 mgr.a (mgr.14355) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:09 smithi131 bash[24745]: audit 2024-09-14T03:14:08.254477+0000 mgr.a (mgr.14355) 12681 : audit [DBG] from='client.276657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:09 smithi131 bash[24745]: cluster 2024-09-14T03:14:08.272922+0000 mgr.a (mgr.14355) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:09 smithi171 bash[25040]: audit 2024-09-14T03:14:08.254477+0000 mgr.a (mgr.14355) 12681 : audit [DBG] from='client.276657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:09 smithi171 bash[25040]: cluster 2024-09-14T03:14:08.272922+0000 mgr.a (mgr.14355) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:11 smithi007 bash[22722]: cluster 2024-09-14T03:14:10.275476+0000 mgr.a (mgr.14355) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:11 smithi131 bash[24745]: cluster 2024-09-14T03:14:10.275476+0000 mgr.a (mgr.14355) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:11 smithi171 bash[25040]: cluster 2024-09-14T03:14:10.275476+0000 mgr.a (mgr.14355) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:13.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:13.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:13.675 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:13 smithi007 bash[22722]: cluster 2024-09-14T03:14:12.276432+0000 mgr.a (mgr.14355) 12684 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:14:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:13 smithi131 bash[24745]: cluster 2024-09-14T03:14:12.276432+0000 mgr.a (mgr.14355) 12684 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:14:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:13 smithi171 bash[25040]: cluster 2024-09-14T03:14:12.276432+0000 mgr.a (mgr.14355) 12684 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:14:14.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:14 smithi007 bash[22722]: audit 2024-09-14T03:14:14.014035+0000 mgr.a (mgr.14355) 12685 : audit [DBG] from='client.276735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:14 smithi131 bash[24745]: audit 2024-09-14T03:14:14.014035+0000 mgr.a (mgr.14355) 12685 : audit [DBG] from='client.276735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:14 smithi171 bash[25040]: audit 2024-09-14T03:14:14.014035+0000 mgr.a (mgr.14355) 12685 : audit [DBG] from='client.276735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:15 smithi007 bash[22722]: cluster 2024-09-14T03:14:14.277040+0000 mgr.a (mgr.14355) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:15 smithi131 bash[24745]: cluster 2024-09-14T03:14:14.277040+0000 mgr.a (mgr.14355) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:15 smithi171 bash[25040]: cluster 2024-09-14T03:14:14.277040+0000 mgr.a (mgr.14355) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:17 smithi007 bash[22722]: cluster 2024-09-14T03:14:16.279356+0000 mgr.a (mgr.14355) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:17 smithi131 bash[24745]: cluster 2024-09-14T03:14:16.279356+0000 mgr.a (mgr.14355) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:17 smithi171 bash[25040]: cluster 2024-09-14T03:14:16.279356+0000 mgr.a (mgr.14355) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:19.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:19 smithi007 bash[22722]: cluster 2024-09-14T03:14:18.280142+0000 mgr.a (mgr.14355) 12688 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:19 smithi131 bash[24745]: cluster 2024-09-14T03:14:18.280142+0000 mgr.a (mgr.14355) 12688 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:19 smithi171 bash[25040]: cluster 2024-09-14T03:14:18.280142+0000 mgr.a (mgr.14355) 12688 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:20.245 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:20.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:20 smithi007 bash[22722]: audit 2024-09-14T03:14:19.794504+0000 mgr.a (mgr.14355) 12689 : audit [DBG] from='client.276810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:20 smithi131 bash[24745]: audit 2024-09-14T03:14:19.794504+0000 mgr.a (mgr.14355) 12689 : audit [DBG] from='client.276810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:20 smithi171 bash[25040]: audit 2024-09-14T03:14:19.794504+0000 mgr.a (mgr.14355) 12689 : audit [DBG] from='client.276810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:21 smithi007 bash[22722]: cluster 2024-09-14T03:14:20.282464+0000 mgr.a (mgr.14355) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:21 smithi131 bash[24745]: cluster 2024-09-14T03:14:20.282464+0000 mgr.a (mgr.14355) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:21 smithi171 bash[25040]: cluster 2024-09-14T03:14:20.282464+0000 mgr.a (mgr.14355) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:23 smithi007 bash[22722]: cluster 2024-09-14T03:14:22.283312+0000 mgr.a (mgr.14355) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:23 smithi131 bash[24745]: cluster 2024-09-14T03:14:22.283312+0000 mgr.a (mgr.14355) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:23 smithi171 bash[25040]: cluster 2024-09-14T03:14:22.283312+0000 mgr.a (mgr.14355) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:25.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:25.248 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:25.248 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:25 smithi007 bash[22722]: cluster 2024-09-14T03:14:24.284250+0000 mgr.a (mgr.14355) 12692 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:26.027 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:26.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:26.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:26.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:26.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:25 smithi131 bash[24745]: cluster 2024-09-14T03:14:24.284250+0000 mgr.a (mgr.14355) 12692 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:25 smithi171 bash[25040]: cluster 2024-09-14T03:14:24.284250+0000 mgr.a (mgr.14355) 12692 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:26 smithi007 bash[22722]: audit 2024-09-14T03:14:25.582430+0000 mgr.a (mgr.14355) 12693 : audit [DBG] from='client.276885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:26 smithi131 bash[24745]: audit 2024-09-14T03:14:25.582430+0000 mgr.a (mgr.14355) 12693 : audit [DBG] from='client.276885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:26 smithi171 bash[25040]: audit 2024-09-14T03:14:25.582430+0000 mgr.a (mgr.14355) 12693 : audit [DBG] from='client.276885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:27 smithi007 bash[22722]: cluster 2024-09-14T03:14:26.287115+0000 mgr.a (mgr.14355) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:27 smithi131 bash[24745]: cluster 2024-09-14T03:14:26.287115+0000 mgr.a (mgr.14355) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:27 smithi171 bash[25040]: cluster 2024-09-14T03:14:26.287115+0000 mgr.a (mgr.14355) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:29 smithi007 bash[22722]: cluster 2024-09-14T03:14:28.287883+0000 mgr.a (mgr.14355) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:29 smithi131 bash[24745]: cluster 2024-09-14T03:14:28.287883+0000 mgr.a (mgr.14355) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:29 smithi171 bash[25040]: cluster 2024-09-14T03:14:28.287883+0000 mgr.a (mgr.14355) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:31.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:31.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:31.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:31.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:31.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:31.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:31.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:31 smithi007 bash[22722]: cluster 2024-09-14T03:14:30.289796+0000 mgr.a (mgr.14355) 12696 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:31 smithi131 bash[24745]: cluster 2024-09-14T03:14:30.289796+0000 mgr.a (mgr.14355) 12696 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:31 smithi171 bash[25040]: cluster 2024-09-14T03:14:30.289796+0000 mgr.a (mgr.14355) 12696 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:32 smithi007 bash[22722]: audit 2024-09-14T03:14:31.355547+0000 mgr.a (mgr.14355) 12697 : audit [DBG] from='client.276960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:32 smithi131 bash[24745]: audit 2024-09-14T03:14:31.355547+0000 mgr.a (mgr.14355) 12697 : audit [DBG] from='client.276960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:32 smithi171 bash[25040]: audit 2024-09-14T03:14:31.355547+0000 mgr.a (mgr.14355) 12697 : audit [DBG] from='client.276960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:33.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:33 smithi007 bash[22722]: cluster 2024-09-14T03:14:32.290708+0000 mgr.a (mgr.14355) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:33 smithi007 bash[22722]: audit 2024-09-14T03:14:33.015637+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:14:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:33 smithi131 bash[24745]: cluster 2024-09-14T03:14:32.290708+0000 mgr.a (mgr.14355) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:33 smithi131 bash[24745]: audit 2024-09-14T03:14:33.015637+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:14:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:33 smithi171 bash[25040]: cluster 2024-09-14T03:14:32.290708+0000 mgr.a (mgr.14355) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:14:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:33 smithi171 bash[25040]: audit 2024-09-14T03:14:33.015637+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:14:34.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22972]: debug 2024-09-14T03:14:34.612+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:14:34.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22972]: debug 2024-09-14T03:14:34.616+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:14:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22722]: audit 2024-09-14T03:14:33.875765+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:14:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22722]: audit 2024-09-14T03:14:33.877231+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:14:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22722]: audit 2024-09-14T03:14:33.886078+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:14:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22722]: audit 2024-09-14T03:14:33.889123+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:34 smithi007 bash[22722]: audit 2024-09-14T03:14:33.891610+0000 mgr.a (mgr.14355) 12699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:34 smithi131 bash[24745]: audit 2024-09-14T03:14:33.875765+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:34 smithi131 bash[24745]: audit 2024-09-14T03:14:33.877231+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:34 smithi131 bash[24745]: audit 2024-09-14T03:14:33.886078+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:34 smithi131 bash[24745]: audit 2024-09-14T03:14:33.889123+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:35.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:34 smithi131 bash[24745]: audit 2024-09-14T03:14:33.891610+0000 mgr.a (mgr.14355) 12699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:34 smithi171 bash[25040]: audit 2024-09-14T03:14:33.875765+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:34 smithi171 bash[25040]: audit 2024-09-14T03:14:33.877231+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:14:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:34 smithi171 bash[25040]: audit 2024-09-14T03:14:33.886078+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:14:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:34 smithi171 bash[25040]: audit 2024-09-14T03:14:33.889123+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:34 smithi171 bash[25040]: audit 2024-09-14T03:14:33.891610+0000 mgr.a (mgr.14355) 12699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:14:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:35 smithi007 bash[22722]: cluster 2024-09-14T03:14:34.291222+0000 mgr.a (mgr.14355) 12700 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:14:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:35 smithi007 bash[22722]: audit 2024-09-14T03:14:34.618182+0000 mgr.a (mgr.14355) 12701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:14:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:35 smithi007 bash[22722]: cephadm 2024-09-14T03:14:34.619396+0000 mgr.a (mgr.14355) 12702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:14:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:35 smithi131 bash[24745]: cluster 2024-09-14T03:14:34.291222+0000 mgr.a (mgr.14355) 12700 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:14:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:35 smithi131 bash[24745]: audit 2024-09-14T03:14:34.618182+0000 mgr.a (mgr.14355) 12701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:14:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:35 smithi131 bash[24745]: cephadm 2024-09-14T03:14:34.619396+0000 mgr.a (mgr.14355) 12702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:14:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:35 smithi171 bash[25040]: cluster 2024-09-14T03:14:34.291222+0000 mgr.a (mgr.14355) 12700 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:14:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:35 smithi171 bash[25040]: audit 2024-09-14T03:14:34.618182+0000 mgr.a (mgr.14355) 12701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:14:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:35 smithi171 bash[25040]: cephadm 2024-09-14T03:14:34.619396+0000 mgr.a (mgr.14355) 12702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:14:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:36.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:36.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:37.561 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:37.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:37.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:37 smithi007 bash[22722]: cluster 2024-09-14T03:14:36.293517+0000 mgr.a (mgr.14355) 12703 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:37 smithi131 bash[24745]: cluster 2024-09-14T03:14:36.293517+0000 mgr.a (mgr.14355) 12703 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:37 smithi171 bash[25040]: cluster 2024-09-14T03:14:36.293517+0000 mgr.a (mgr.14355) 12703 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:38 smithi007 bash[22722]: audit 2024-09-14T03:14:37.117827+0000 mgr.a (mgr.14355) 12704 : audit [DBG] from='client.277146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:38 smithi131 bash[24745]: audit 2024-09-14T03:14:37.117827+0000 mgr.a (mgr.14355) 12704 : audit [DBG] from='client.277146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:38 smithi171 bash[25040]: audit 2024-09-14T03:14:37.117827+0000 mgr.a (mgr.14355) 12704 : audit [DBG] from='client.277146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:39 smithi007 bash[22722]: cluster 2024-09-14T03:14:38.294437+0000 mgr.a (mgr.14355) 12705 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:39 smithi131 bash[24745]: cluster 2024-09-14T03:14:38.294437+0000 mgr.a (mgr.14355) 12705 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:39 smithi171 bash[25040]: cluster 2024-09-14T03:14:38.294437+0000 mgr.a (mgr.14355) 12705 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:41 smithi007 bash[22722]: cluster 2024-09-14T03:14:40.296551+0000 mgr.a (mgr.14355) 12706 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:41 smithi131 bash[24745]: cluster 2024-09-14T03:14:40.296551+0000 mgr.a (mgr.14355) 12706 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:41 smithi171 bash[25040]: cluster 2024-09-14T03:14:40.296551+0000 mgr.a (mgr.14355) 12706 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:42.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:42.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:43.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:43.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:43.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:43.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:43.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:43 smithi007 bash[22722]: cluster 2024-09-14T03:14:42.297466+0000 mgr.a (mgr.14355) 12707 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:43 smithi007 bash[22722]: audit 2024-09-14T03:14:42.901425+0000 mgr.a (mgr.14355) 12708 : audit [DBG] from='client.277221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:43 smithi131 bash[24745]: cluster 2024-09-14T03:14:42.297466+0000 mgr.a (mgr.14355) 12707 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:43 smithi131 bash[24745]: audit 2024-09-14T03:14:42.901425+0000 mgr.a (mgr.14355) 12708 : audit [DBG] from='client.277221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:43 smithi171 bash[25040]: cluster 2024-09-14T03:14:42.297466+0000 mgr.a (mgr.14355) 12707 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:43 smithi171 bash[25040]: audit 2024-09-14T03:14:42.901425+0000 mgr.a (mgr.14355) 12708 : audit [DBG] from='client.277221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:45 smithi007 bash[22722]: cluster 2024-09-14T03:14:44.298408+0000 mgr.a (mgr.14355) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:45 smithi131 bash[24745]: cluster 2024-09-14T03:14:44.298408+0000 mgr.a (mgr.14355) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:45 smithi171 bash[25040]: cluster 2024-09-14T03:14:44.298408+0000 mgr.a (mgr.14355) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:47 smithi007 bash[22722]: cluster 2024-09-14T03:14:46.300646+0000 mgr.a (mgr.14355) 12710 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:47 smithi131 bash[24745]: cluster 2024-09-14T03:14:46.300646+0000 mgr.a (mgr.14355) 12710 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:47 smithi171 bash[25040]: cluster 2024-09-14T03:14:46.300646+0000 mgr.a (mgr.14355) 12710 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:14:48.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:49.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:49.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:49 smithi007 bash[22722]: cluster 2024-09-14T03:14:48.301416+0000 mgr.a (mgr.14355) 12711 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:49 smithi007 bash[22722]: audit 2024-09-14T03:14:48.664387+0000 mgr.a (mgr.14355) 12712 : audit [DBG] from='client.277293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:49 smithi131 bash[24745]: cluster 2024-09-14T03:14:48.301416+0000 mgr.a (mgr.14355) 12711 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:49 smithi131 bash[24745]: audit 2024-09-14T03:14:48.664387+0000 mgr.a (mgr.14355) 12712 : audit [DBG] from='client.277293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:49 smithi171 bash[25040]: cluster 2024-09-14T03:14:48.301416+0000 mgr.a (mgr.14355) 12711 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:49 smithi171 bash[25040]: audit 2024-09-14T03:14:48.664387+0000 mgr.a (mgr.14355) 12712 : audit [DBG] from='client.277293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:51 smithi007 bash[22722]: cluster 2024-09-14T03:14:50.303794+0000 mgr.a (mgr.14355) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:51 smithi131 bash[24745]: cluster 2024-09-14T03:14:50.303794+0000 mgr.a (mgr.14355) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:51 smithi171 bash[25040]: cluster 2024-09-14T03:14:50.303794+0000 mgr.a (mgr.14355) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:54.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:54.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:54.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:14:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:53 smithi007 bash[22722]: cluster 2024-09-14T03:14:52.304597+0000 mgr.a (mgr.14355) 12714 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:53 smithi131 bash[24745]: cluster 2024-09-14T03:14:52.304597+0000 mgr.a (mgr.14355) 12714 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:53 smithi171 bash[25040]: cluster 2024-09-14T03:14:52.304597+0000 mgr.a (mgr.14355) 12714 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:54.849 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:14:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:14:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:14:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:14:54.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:14:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:55 smithi007 bash[22722]: cluster 2024-09-14T03:14:54.305337+0000 mgr.a (mgr.14355) 12715 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:55 smithi007 bash[22722]: audit 2024-09-14T03:14:54.431592+0000 mgr.a (mgr.14355) 12716 : audit [DBG] from='client.277371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:55 smithi131 bash[24745]: cluster 2024-09-14T03:14:54.305337+0000 mgr.a (mgr.14355) 12715 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:55 smithi131 bash[24745]: audit 2024-09-14T03:14:54.431592+0000 mgr.a (mgr.14355) 12716 : audit [DBG] from='client.277371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:55 smithi171 bash[25040]: cluster 2024-09-14T03:14:54.305337+0000 mgr.a (mgr.14355) 12715 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:14:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:55 smithi171 bash[25040]: audit 2024-09-14T03:14:54.431592+0000 mgr.a (mgr.14355) 12716 : audit [DBG] from='client.277371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:14:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:57 smithi007 bash[22722]: cluster 2024-09-14T03:14:56.307832+0000 mgr.a (mgr.14355) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:57 smithi131 bash[24745]: cluster 2024-09-14T03:14:56.307832+0000 mgr.a (mgr.14355) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:57 smithi171 bash[25040]: cluster 2024-09-14T03:14:56.307832+0000 mgr.a (mgr.14355) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:14:59.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:14:59.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:14:59.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:14:59 smithi007 bash[22722]: cluster 2024-09-14T03:14:58.308765+0000 mgr.a (mgr.14355) 12718 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:14:59 smithi131 bash[24745]: cluster 2024-09-14T03:14:58.308765+0000 mgr.a (mgr.14355) 12718 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:14:59 smithi171 bash[25040]: cluster 2024-09-14T03:14:58.308765+0000 mgr.a (mgr.14355) 12718 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:00.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:01 smithi007 bash[22722]: audit 2024-09-14T03:15:00.186615+0000 mgr.a (mgr.14355) 12719 : audit [DBG] from='client.277443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:01 smithi007 bash[22722]: cluster 2024-09-14T03:15:00.310096+0000 mgr.a (mgr.14355) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:01 smithi131 bash[24745]: audit 2024-09-14T03:15:00.186615+0000 mgr.a (mgr.14355) 12719 : audit [DBG] from='client.277443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:01 smithi131 bash[24745]: cluster 2024-09-14T03:15:00.310096+0000 mgr.a (mgr.14355) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:01 smithi171 bash[25040]: audit 2024-09-14T03:15:00.186615+0000 mgr.a (mgr.14355) 12719 : audit [DBG] from='client.277443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:01 smithi171 bash[25040]: cluster 2024-09-14T03:15:00.310096+0000 mgr.a (mgr.14355) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:03 smithi007 bash[22722]: cluster 2024-09-14T03:15:02.310981+0000 mgr.a (mgr.14355) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:15:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:03 smithi131 bash[24745]: cluster 2024-09-14T03:15:02.310981+0000 mgr.a (mgr.14355) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:15:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:03 smithi171 bash[25040]: cluster 2024-09-14T03:15:02.310981+0000 mgr.a (mgr.14355) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:15:05.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:05.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:05 smithi131 bash[24745]: cluster 2024-09-14T03:15:04.311753+0000 mgr.a (mgr.14355) 12722 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:05 smithi171 bash[25040]: cluster 2024-09-14T03:15:04.311753+0000 mgr.a (mgr.14355) 12722 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:06.367 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:06.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:06.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:05 smithi007 bash[22722]: cluster 2024-09-14T03:15:04.311753+0000 mgr.a (mgr.14355) 12722 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:06 smithi131 bash[24745]: audit 2024-09-14T03:15:05.956493+0000 mgr.a (mgr.14355) 12723 : audit [DBG] from='client.277518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:06 smithi171 bash[25040]: audit 2024-09-14T03:15:05.956493+0000 mgr.a (mgr.14355) 12723 : audit [DBG] from='client.277518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:06 smithi007 bash[22722]: audit 2024-09-14T03:15:05.956493+0000 mgr.a (mgr.14355) 12723 : audit [DBG] from='client.277518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:07 smithi131 bash[24745]: cluster 2024-09-14T03:15:06.313595+0000 mgr.a (mgr.14355) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:07 smithi171 bash[25040]: cluster 2024-09-14T03:15:06.313595+0000 mgr.a (mgr.14355) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:07 smithi007 bash[22722]: cluster 2024-09-14T03:15:06.313595+0000 mgr.a (mgr.14355) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:09 smithi131 bash[24745]: cluster 2024-09-14T03:15:08.314351+0000 mgr.a (mgr.14355) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:09 smithi171 bash[25040]: cluster 2024-09-14T03:15:08.314351+0000 mgr.a (mgr.14355) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:09 smithi007 bash[22722]: cluster 2024-09-14T03:15:08.314351+0000 mgr.a (mgr.14355) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:11.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:12.124 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:12.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:12.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:12.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:12.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:11 smithi131 bash[24745]: cluster 2024-09-14T03:15:10.316245+0000 mgr.a (mgr.14355) 12726 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:11 smithi171 bash[25040]: cluster 2024-09-14T03:15:10.316245+0000 mgr.a (mgr.14355) 12726 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:11 smithi007 bash[22722]: cluster 2024-09-14T03:15:10.316245+0000 mgr.a (mgr.14355) 12726 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:12 smithi131 bash[24745]: audit 2024-09-14T03:15:11.699588+0000 mgr.a (mgr.14355) 12727 : audit [DBG] from='client.277593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:12 smithi171 bash[25040]: audit 2024-09-14T03:15:11.699588+0000 mgr.a (mgr.14355) 12727 : audit [DBG] from='client.277593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:12 smithi007 bash[22722]: audit 2024-09-14T03:15:11.699588+0000 mgr.a (mgr.14355) 12727 : audit [DBG] from='client.277593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:13 smithi131 bash[24745]: cluster 2024-09-14T03:15:12.318139+0000 mgr.a (mgr.14355) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:13 smithi171 bash[25040]: cluster 2024-09-14T03:15:12.318139+0000 mgr.a (mgr.14355) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:13 smithi007 bash[22722]: cluster 2024-09-14T03:15:12.318139+0000 mgr.a (mgr.14355) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:15 smithi131 bash[24745]: cluster 2024-09-14T03:15:14.318928+0000 mgr.a (mgr.14355) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:15 smithi171 bash[25040]: cluster 2024-09-14T03:15:14.318928+0000 mgr.a (mgr.14355) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:15 smithi007 bash[22722]: cluster 2024-09-14T03:15:14.318928+0000 mgr.a (mgr.14355) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:17.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:17.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:17.126 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:17.873 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:17.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:17 smithi131 bash[24745]: cluster 2024-09-14T03:15:16.321068+0000 mgr.a (mgr.14355) 12730 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:17 smithi171 bash[25040]: cluster 2024-09-14T03:15:16.321068+0000 mgr.a (mgr.14355) 12730 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:17 smithi007 bash[22722]: cluster 2024-09-14T03:15:16.321068+0000 mgr.a (mgr.14355) 12730 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:19 smithi131 bash[24745]: audit 2024-09-14T03:15:17.448086+0000 mgr.a (mgr.14355) 12731 : audit [DBG] from='client.277671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:19 smithi171 bash[25040]: audit 2024-09-14T03:15:17.448086+0000 mgr.a (mgr.14355) 12731 : audit [DBG] from='client.277671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:19 smithi007 bash[22722]: audit 2024-09-14T03:15:17.448086+0000 mgr.a (mgr.14355) 12731 : audit [DBG] from='client.277671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:20 smithi131 bash[24745]: cluster 2024-09-14T03:15:18.321930+0000 mgr.a (mgr.14355) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:20 smithi171 bash[25040]: cluster 2024-09-14T03:15:18.321930+0000 mgr.a (mgr.14355) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:20 smithi007 bash[22722]: cluster 2024-09-14T03:15:18.321930+0000 mgr.a (mgr.14355) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:22 smithi131 bash[24745]: cluster 2024-09-14T03:15:20.324104+0000 mgr.a (mgr.14355) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:22 smithi171 bash[25040]: cluster 2024-09-14T03:15:20.324104+0000 mgr.a (mgr.14355) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:22 smithi007 bash[22722]: cluster 2024-09-14T03:15:20.324104+0000 mgr.a (mgr.14355) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:22.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:22.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:22.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:23.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:23.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:23.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:23.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:24 smithi131 bash[24745]: cluster 2024-09-14T03:15:22.324863+0000 mgr.a (mgr.14355) 12734 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:24 smithi171 bash[25040]: cluster 2024-09-14T03:15:22.324863+0000 mgr.a (mgr.14355) 12734 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:24 smithi007 bash[22722]: cluster 2024-09-14T03:15:22.324863+0000 mgr.a (mgr.14355) 12734 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:25 smithi131 bash[24745]: audit 2024-09-14T03:15:23.209779+0000 mgr.a (mgr.14355) 12735 : audit [DBG] from='client.277746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:25 smithi171 bash[25040]: audit 2024-09-14T03:15:23.209779+0000 mgr.a (mgr.14355) 12735 : audit [DBG] from='client.277746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:25 smithi007 bash[22722]: audit 2024-09-14T03:15:23.209779+0000 mgr.a (mgr.14355) 12735 : audit [DBG] from='client.277746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:26 smithi131 bash[24745]: cluster 2024-09-14T03:15:24.325740+0000 mgr.a (mgr.14355) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:26 smithi171 bash[25040]: cluster 2024-09-14T03:15:24.325740+0000 mgr.a (mgr.14355) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:26 smithi007 bash[22722]: cluster 2024-09-14T03:15:24.325740+0000 mgr.a (mgr.14355) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:28 smithi131 bash[24745]: cluster 2024-09-14T03:15:26.327947+0000 mgr.a (mgr.14355) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:28 smithi171 bash[25040]: cluster 2024-09-14T03:15:26.327947+0000 mgr.a (mgr.14355) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:28 smithi007 bash[22722]: cluster 2024-09-14T03:15:26.327947+0000 mgr.a (mgr.14355) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:28.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:28.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:28.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:29.407 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:29.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:30 smithi131 bash[24745]: cluster 2024-09-14T03:15:28.328690+0000 mgr.a (mgr.14355) 12738 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:30 smithi131 bash[24745]: audit 2024-09-14T03:15:28.974926+0000 mgr.a (mgr.14355) 12739 : audit [DBG] from='client.277821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:30 smithi171 bash[25040]: cluster 2024-09-14T03:15:28.328690+0000 mgr.a (mgr.14355) 12738 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:30 smithi171 bash[25040]: audit 2024-09-14T03:15:28.974926+0000 mgr.a (mgr.14355) 12739 : audit [DBG] from='client.277821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:30 smithi007 bash[22722]: cluster 2024-09-14T03:15:28.328690+0000 mgr.a (mgr.14355) 12738 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:30 smithi007 bash[22722]: audit 2024-09-14T03:15:28.974926+0000 mgr.a (mgr.14355) 12739 : audit [DBG] from='client.277821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:32 smithi171 bash[25040]: cluster 2024-09-14T03:15:30.330899+0000 mgr.a (mgr.14355) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:32 smithi007 bash[22722]: cluster 2024-09-14T03:15:30.330899+0000 mgr.a (mgr.14355) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:32 smithi131 bash[24745]: cluster 2024-09-14T03:15:30.330899+0000 mgr.a (mgr.14355) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:34 smithi171 bash[25040]: cluster 2024-09-14T03:15:32.331684+0000 mgr.a (mgr.14355) 12741 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:34.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:34.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:34.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:34 smithi007 bash[22722]: cluster 2024-09-14T03:15:32.331684+0000 mgr.a (mgr.14355) 12741 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:34 smithi131 bash[24745]: cluster 2024-09-14T03:15:32.331684+0000 mgr.a (mgr.14355) 12741 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:35.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:35.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:35 smithi007 bash[22722]: audit 2024-09-14T03:15:34.670174+0000 mon.a (mon.0) 2491 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:15:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:35 smithi131 bash[24745]: audit 2024-09-14T03:15:34.670174+0000 mon.a (mon.0) 2491 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:15:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:35 smithi171 bash[25040]: audit 2024-09-14T03:15:34.670174+0000 mon.a (mon.0) 2491 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:15:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:36 smithi007 bash[22722]: cluster 2024-09-14T03:15:34.332497+0000 mgr.a (mgr.14355) 12742 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:36 smithi007 bash[22722]: audit 2024-09-14T03:15:34.747600+0000 mgr.a (mgr.14355) 12743 : audit [DBG] from='client.277899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:36 smithi131 bash[24745]: cluster 2024-09-14T03:15:34.332497+0000 mgr.a (mgr.14355) 12742 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:36 smithi131 bash[24745]: audit 2024-09-14T03:15:34.747600+0000 mgr.a (mgr.14355) 12743 : audit [DBG] from='client.277899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:36 smithi171 bash[25040]: cluster 2024-09-14T03:15:34.332497+0000 mgr.a (mgr.14355) 12742 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:36 smithi171 bash[25040]: audit 2024-09-14T03:15:34.747600+0000 mgr.a (mgr.14355) 12743 : audit [DBG] from='client.277899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:38 smithi007 bash[22722]: cluster 2024-09-14T03:15:36.334932+0000 mgr.a (mgr.14355) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:38 smithi131 bash[24745]: cluster 2024-09-14T03:15:36.334932+0000 mgr.a (mgr.14355) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:38 smithi171 bash[25040]: cluster 2024-09-14T03:15:36.334932+0000 mgr.a (mgr.14355) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:15:40.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:40.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:40.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:40 smithi007 bash[22722]: cluster 2024-09-14T03:15:38.335708+0000 mgr.a (mgr.14355) 12745 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:40 smithi007 bash[22722]: audit 2024-09-14T03:15:40.043731+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:40 smithi007 bash[22722]: audit 2024-09-14T03:15:40.048032+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:40 smithi131 bash[24745]: cluster 2024-09-14T03:15:38.335708+0000 mgr.a (mgr.14355) 12745 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:40 smithi131 bash[24745]: audit 2024-09-14T03:15:40.043731+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:40 smithi131 bash[24745]: audit 2024-09-14T03:15:40.048032+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:40 smithi171 bash[25040]: cluster 2024-09-14T03:15:38.335708+0000 mgr.a (mgr.14355) 12745 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:40 smithi171 bash[25040]: audit 2024-09-14T03:15:40.043731+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:40 smithi171 bash[25040]: audit 2024-09-14T03:15:40.048032+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:40.964 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.057743+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.070219+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.124245+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.131173+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.812420+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.813333+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.818795+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22722]: audit 2024-09-14T03:15:40.821198+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.057743+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.070219+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.124245+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.131173+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.812420+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:15:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.813333+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:15:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.818795+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:41 smithi131 bash[24745]: audit 2024-09-14T03:15:40.821198+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.057743+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.070219+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.124245+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.131173+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.812420+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.813333+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.818795+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:15:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:41 smithi171 bash[25040]: audit 2024-09-14T03:15:40.821198+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22972]: debug 2024-09-14T03:15:41.655+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:15:41.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:15:41 smithi007 bash[22972]: debug 2024-09-14T03:15:41.659+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:15:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:42 smithi007 bash[22722]: cluster 2024-09-14T03:15:40.336971+0000 mgr.a (mgr.14355) 12746 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:42 smithi007 bash[22722]: audit 2024-09-14T03:15:40.521756+0000 mgr.a (mgr.14355) 12747 : audit [DBG] from='client.277974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:42 smithi007 bash[22722]: audit 2024-09-14T03:15:40.822381+0000 mgr.a (mgr.14355) 12748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:42 smithi131 bash[24745]: cluster 2024-09-14T03:15:40.336971+0000 mgr.a (mgr.14355) 12746 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:42 smithi131 bash[24745]: audit 2024-09-14T03:15:40.521756+0000 mgr.a (mgr.14355) 12747 : audit [DBG] from='client.277974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:42 smithi131 bash[24745]: audit 2024-09-14T03:15:40.822381+0000 mgr.a (mgr.14355) 12748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:42 smithi171 bash[25040]: cluster 2024-09-14T03:15:40.336971+0000 mgr.a (mgr.14355) 12746 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:15:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:42 smithi171 bash[25040]: audit 2024-09-14T03:15:40.521756+0000 mgr.a (mgr.14355) 12747 : audit [DBG] from='client.277974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:42 smithi171 bash[25040]: audit 2024-09-14T03:15:40.822381+0000 mgr.a (mgr.14355) 12748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:15:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:43 smithi007 bash[22722]: audit 2024-09-14T03:15:41.660807+0000 mgr.a (mgr.14355) 12749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:15:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:43 smithi007 bash[22722]: cephadm 2024-09-14T03:15:41.662607+0000 mgr.a (mgr.14355) 12750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:15:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:43 smithi131 bash[24745]: audit 2024-09-14T03:15:41.660807+0000 mgr.a (mgr.14355) 12749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:15:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:43 smithi131 bash[24745]: cephadm 2024-09-14T03:15:41.662607+0000 mgr.a (mgr.14355) 12750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:15:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:43 smithi171 bash[25040]: audit 2024-09-14T03:15:41.660807+0000 mgr.a (mgr.14355) 12749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:15:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:43 smithi171 bash[25040]: cephadm 2024-09-14T03:15:41.662607+0000 mgr.a (mgr.14355) 12750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:15:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:44 smithi007 bash[22722]: cluster 2024-09-14T03:15:42.337913+0000 mgr.a (mgr.14355) 12751 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:44 smithi131 bash[24745]: cluster 2024-09-14T03:15:42.337913+0000 mgr.a (mgr.14355) 12751 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:44 smithi171 bash[25040]: cluster 2024-09-14T03:15:42.337913+0000 mgr.a (mgr.14355) 12751 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:45.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:45.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:46 smithi007 bash[22722]: cluster 2024-09-14T03:15:44.338712+0000 mgr.a (mgr.14355) 12752 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:46 smithi131 bash[24745]: cluster 2024-09-14T03:15:44.338712+0000 mgr.a (mgr.14355) 12752 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:46 smithi171 bash[25040]: cluster 2024-09-14T03:15:44.338712+0000 mgr.a (mgr.14355) 12752 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:15:46.739 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:46.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:48 smithi007 bash[22722]: audit 2024-09-14T03:15:46.306088+0000 mgr.a (mgr.14355) 12753 : audit [DBG] from='client.278157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:48 smithi007 bash[22722]: cluster 2024-09-14T03:15:46.341851+0000 mgr.a (mgr.14355) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:48 smithi131 bash[24745]: audit 2024-09-14T03:15:46.306088+0000 mgr.a (mgr.14355) 12753 : audit [DBG] from='client.278157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:48 smithi131 bash[24745]: cluster 2024-09-14T03:15:46.341851+0000 mgr.a (mgr.14355) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:48 smithi171 bash[25040]: audit 2024-09-14T03:15:46.306088+0000 mgr.a (mgr.14355) 12753 : audit [DBG] from='client.278157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:48 smithi171 bash[25040]: cluster 2024-09-14T03:15:46.341851+0000 mgr.a (mgr.14355) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:50 smithi007 bash[22722]: cluster 2024-09-14T03:15:48.342915+0000 mgr.a (mgr.14355) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:15:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:50 smithi131 bash[24745]: cluster 2024-09-14T03:15:48.342915+0000 mgr.a (mgr.14355) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:15:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:50 smithi171 bash[25040]: cluster 2024-09-14T03:15:48.342915+0000 mgr.a (mgr.14355) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:15:51.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:51.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:52 smithi007 bash[22722]: cluster 2024-09-14T03:15:50.345058+0000 mgr.a (mgr.14355) 12756 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:52.525 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:52 smithi131 bash[24745]: cluster 2024-09-14T03:15:50.345058+0000 mgr.a (mgr.14355) 12756 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:52 smithi171 bash[25040]: cluster 2024-09-14T03:15:50.345058+0000 mgr.a (mgr.14355) 12756 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:53 smithi007 bash[22722]: audit 2024-09-14T03:15:52.081360+0000 mgr.a (mgr.14355) 12757 : audit [DBG] from='client.278235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:53 smithi131 bash[24745]: audit 2024-09-14T03:15:52.081360+0000 mgr.a (mgr.14355) 12757 : audit [DBG] from='client.278235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:53 smithi171 bash[25040]: audit 2024-09-14T03:15:52.081360+0000 mgr.a (mgr.14355) 12757 : audit [DBG] from='client.278235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:54 smithi007 bash[22722]: cluster 2024-09-14T03:15:52.345622+0000 mgr.a (mgr.14355) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:54 smithi131 bash[24745]: cluster 2024-09-14T03:15:52.345622+0000 mgr.a (mgr.14355) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:54 smithi171 bash[25040]: cluster 2024-09-14T03:15:52.345622+0000 mgr.a (mgr.14355) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:56 smithi007 bash[22722]: cluster 2024-09-14T03:15:54.346670+0000 mgr.a (mgr.14355) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:56 smithi131 bash[24745]: cluster 2024-09-14T03:15:54.346670+0000 mgr.a (mgr.14355) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:56 smithi171 bash[25040]: cluster 2024-09-14T03:15:54.346670+0000 mgr.a (mgr.14355) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:57.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:15:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:15:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:15:58.308 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:15:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:15:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:15:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:15:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:15:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:58 smithi007 bash[22722]: cluster 2024-09-14T03:15:56.349041+0000 mgr.a (mgr.14355) 12760 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:58 smithi131 bash[24745]: cluster 2024-09-14T03:15:56.349041+0000 mgr.a (mgr.14355) 12760 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:58 smithi171 bash[25040]: cluster 2024-09-14T03:15:56.349041+0000 mgr.a (mgr.14355) 12760 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:15:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:15:59 smithi007 bash[22722]: audit 2024-09-14T03:15:57.869400+0000 mgr.a (mgr.14355) 12761 : audit [DBG] from='client.278313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:15:59 smithi131 bash[24745]: audit 2024-09-14T03:15:57.869400+0000 mgr.a (mgr.14355) 12761 : audit [DBG] from='client.278313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:15:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:15:59 smithi171 bash[25040]: audit 2024-09-14T03:15:57.869400+0000 mgr.a (mgr.14355) 12761 : audit [DBG] from='client.278313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:00 smithi007 bash[22722]: cluster 2024-09-14T03:15:58.349631+0000 mgr.a (mgr.14355) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:00 smithi131 bash[24745]: cluster 2024-09-14T03:15:58.349631+0000 mgr.a (mgr.14355) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:00 smithi171 bash[25040]: cluster 2024-09-14T03:15:58.349631+0000 mgr.a (mgr.14355) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:02 smithi007 bash[22722]: cluster 2024-09-14T03:16:00.351763+0000 mgr.a (mgr.14355) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:02 smithi131 bash[24745]: cluster 2024-09-14T03:16:00.351763+0000 mgr.a (mgr.14355) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:02 smithi171 bash[25040]: cluster 2024-09-14T03:16:00.351763+0000 mgr.a (mgr.14355) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:03.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:03.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:03.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:04.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:04.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:04 smithi007 bash[22722]: cluster 2024-09-14T03:16:02.352531+0000 mgr.a (mgr.14355) 12764 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:04 smithi131 bash[24745]: cluster 2024-09-14T03:16:02.352531+0000 mgr.a (mgr.14355) 12764 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:04.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:04 smithi171 bash[25040]: cluster 2024-09-14T03:16:02.352531+0000 mgr.a (mgr.14355) 12764 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:05 smithi007 bash[22722]: audit 2024-09-14T03:16:03.643324+0000 mgr.a (mgr.14355) 12765 : audit [DBG] from='client.278391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:05 smithi007 bash[22722]: cluster 2024-09-14T03:16:04.353679+0000 mgr.a (mgr.14355) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:05 smithi131 bash[24745]: audit 2024-09-14T03:16:03.643324+0000 mgr.a (mgr.14355) 12765 : audit [DBG] from='client.278391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:05 smithi131 bash[24745]: cluster 2024-09-14T03:16:04.353679+0000 mgr.a (mgr.14355) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:05 smithi171 bash[25040]: audit 2024-09-14T03:16:03.643324+0000 mgr.a (mgr.14355) 12765 : audit [DBG] from='client.278391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:05 smithi171 bash[25040]: cluster 2024-09-14T03:16:04.353679+0000 mgr.a (mgr.14355) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:07 smithi007 bash[22722]: cluster 2024-09-14T03:16:06.356015+0000 mgr.a (mgr.14355) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:07 smithi131 bash[24745]: cluster 2024-09-14T03:16:06.356015+0000 mgr.a (mgr.14355) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:07 smithi171 bash[25040]: cluster 2024-09-14T03:16:06.356015+0000 mgr.a (mgr.14355) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:09.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:09 smithi007 bash[22722]: cluster 2024-09-14T03:16:08.356978+0000 mgr.a (mgr.14355) 12768 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:09 smithi131 bash[24745]: cluster 2024-09-14T03:16:08.356978+0000 mgr.a (mgr.14355) 12768 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:09 smithi171 bash[25040]: cluster 2024-09-14T03:16:08.356978+0000 mgr.a (mgr.14355) 12768 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:09.878 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:09.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:10 smithi007 bash[22722]: audit 2024-09-14T03:16:09.428172+0000 mgr.a (mgr.14355) 12769 : audit [DBG] from='client.278469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:10 smithi131 bash[24745]: audit 2024-09-14T03:16:09.428172+0000 mgr.a (mgr.14355) 12769 : audit [DBG] from='client.278469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:10 smithi171 bash[25040]: audit 2024-09-14T03:16:09.428172+0000 mgr.a (mgr.14355) 12769 : audit [DBG] from='client.278469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:11 smithi007 bash[22722]: cluster 2024-09-14T03:16:10.359336+0000 mgr.a (mgr.14355) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:11 smithi131 bash[24745]: cluster 2024-09-14T03:16:10.359336+0000 mgr.a (mgr.14355) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:11 smithi171 bash[25040]: cluster 2024-09-14T03:16:10.359336+0000 mgr.a (mgr.14355) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:13 smithi007 bash[22722]: cluster 2024-09-14T03:16:12.360110+0000 mgr.a (mgr.14355) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:13 smithi131 bash[24745]: cluster 2024-09-14T03:16:12.360110+0000 mgr.a (mgr.14355) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:13 smithi171 bash[25040]: cluster 2024-09-14T03:16:12.360110+0000 mgr.a (mgr.14355) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:14.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:14.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:14.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:15.635 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:15.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:15 smithi007 bash[22722]: cluster 2024-09-14T03:16:14.360900+0000 mgr.a (mgr.14355) 12772 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:15 smithi131 bash[24745]: cluster 2024-09-14T03:16:14.360900+0000 mgr.a (mgr.14355) 12772 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:15 smithi171 bash[25040]: cluster 2024-09-14T03:16:14.360900+0000 mgr.a (mgr.14355) 12772 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:16 smithi007 bash[22722]: audit 2024-09-14T03:16:15.209412+0000 mgr.a (mgr.14355) 12773 : audit [DBG] from='client.278538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:16 smithi131 bash[24745]: audit 2024-09-14T03:16:15.209412+0000 mgr.a (mgr.14355) 12773 : audit [DBG] from='client.278538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:16 smithi171 bash[25040]: audit 2024-09-14T03:16:15.209412+0000 mgr.a (mgr.14355) 12773 : audit [DBG] from='client.278538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:17 smithi007 bash[22722]: cluster 2024-09-14T03:16:16.363702+0000 mgr.a (mgr.14355) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:17 smithi131 bash[24745]: cluster 2024-09-14T03:16:16.363702+0000 mgr.a (mgr.14355) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:17 smithi171 bash[25040]: cluster 2024-09-14T03:16:16.363702+0000 mgr.a (mgr.14355) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:19 smithi007 bash[22722]: cluster 2024-09-14T03:16:18.364492+0000 mgr.a (mgr.14355) 12775 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:19 smithi131 bash[24745]: cluster 2024-09-14T03:16:18.364492+0000 mgr.a (mgr.14355) 12775 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:19 smithi171 bash[25040]: cluster 2024-09-14T03:16:18.364492+0000 mgr.a (mgr.14355) 12775 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:20.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:21.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:21.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:21 smithi131 bash[24745]: cluster 2024-09-14T03:16:20.366427+0000 mgr.a (mgr.14355) 12776 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:21 smithi131 bash[24745]: audit 2024-09-14T03:16:20.967026+0000 mgr.a (mgr.14355) 12777 : audit [DBG] from='client.278610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:21 smithi171 bash[25040]: cluster 2024-09-14T03:16:20.366427+0000 mgr.a (mgr.14355) 12776 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:21 smithi171 bash[25040]: audit 2024-09-14T03:16:20.967026+0000 mgr.a (mgr.14355) 12777 : audit [DBG] from='client.278610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:21.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:21 smithi007 bash[22722]: cluster 2024-09-14T03:16:20.366427+0000 mgr.a (mgr.14355) 12776 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:21.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:21 smithi007 bash[22722]: audit 2024-09-14T03:16:20.967026+0000 mgr.a (mgr.14355) 12777 : audit [DBG] from='client.278610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:23 smithi131 bash[24745]: cluster 2024-09-14T03:16:22.367318+0000 mgr.a (mgr.14355) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:23 smithi171 bash[25040]: cluster 2024-09-14T03:16:22.367318+0000 mgr.a (mgr.14355) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:23 smithi007 bash[22722]: cluster 2024-09-14T03:16:22.367318+0000 mgr.a (mgr.14355) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:16:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:25 smithi131 bash[24745]: cluster 2024-09-14T03:16:24.368162+0000 mgr.a (mgr.14355) 12779 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:16:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:25 smithi171 bash[25040]: cluster 2024-09-14T03:16:24.368162+0000 mgr.a (mgr.14355) 12779 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:16:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:25 smithi007 bash[22722]: cluster 2024-09-14T03:16:24.368162+0000 mgr.a (mgr.14355) 12779 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:16:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:26.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:27.169 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:27 smithi131 bash[24745]: cluster 2024-09-14T03:16:26.370428+0000 mgr.a (mgr.14355) 12780 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:27 smithi131 bash[24745]: audit 2024-09-14T03:16:26.731354+0000 mgr.a (mgr.14355) 12781 : audit [DBG] from='client.278688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:27 smithi171 bash[25040]: cluster 2024-09-14T03:16:26.370428+0000 mgr.a (mgr.14355) 12780 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:27 smithi171 bash[25040]: audit 2024-09-14T03:16:26.731354+0000 mgr.a (mgr.14355) 12781 : audit [DBG] from='client.278688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:27 smithi007 bash[22722]: cluster 2024-09-14T03:16:26.370428+0000 mgr.a (mgr.14355) 12780 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:27 smithi007 bash[22722]: audit 2024-09-14T03:16:26.731354+0000 mgr.a (mgr.14355) 12781 : audit [DBG] from='client.278688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:29 smithi131 bash[24745]: cluster 2024-09-14T03:16:28.371337+0000 mgr.a (mgr.14355) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:29 smithi171 bash[25040]: cluster 2024-09-14T03:16:28.371337+0000 mgr.a (mgr.14355) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:29 smithi007 bash[22722]: cluster 2024-09-14T03:16:28.371337+0000 mgr.a (mgr.14355) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:31 smithi131 bash[24745]: cluster 2024-09-14T03:16:30.373465+0000 mgr.a (mgr.14355) 12783 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:31 smithi171 bash[25040]: cluster 2024-09-14T03:16:30.373465+0000 mgr.a (mgr.14355) 12783 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:31 smithi007 bash[22722]: cluster 2024-09-14T03:16:30.373465+0000 mgr.a (mgr.14355) 12783 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:32.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:32.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:32.960 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:32.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:33 smithi131 bash[24745]: cluster 2024-09-14T03:16:32.374131+0000 mgr.a (mgr.14355) 12784 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:33 smithi131 bash[24745]: audit 2024-09-14T03:16:32.516259+0000 mgr.a (mgr.14355) 12785 : audit [DBG] from='client.278760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:33 smithi171 bash[25040]: cluster 2024-09-14T03:16:32.374131+0000 mgr.a (mgr.14355) 12784 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:33 smithi171 bash[25040]: audit 2024-09-14T03:16:32.516259+0000 mgr.a (mgr.14355) 12785 : audit [DBG] from='client.278760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:33 smithi007 bash[22722]: cluster 2024-09-14T03:16:32.374131+0000 mgr.a (mgr.14355) 12784 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:33 smithi007 bash[22722]: audit 2024-09-14T03:16:32.516259+0000 mgr.a (mgr.14355) 12785 : audit [DBG] from='client.278760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:35 smithi131 bash[24745]: cluster 2024-09-14T03:16:34.375015+0000 mgr.a (mgr.14355) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:35 smithi171 bash[25040]: cluster 2024-09-14T03:16:34.375015+0000 mgr.a (mgr.14355) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:35 smithi007 bash[22722]: cluster 2024-09-14T03:16:34.375015+0000 mgr.a (mgr.14355) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:37 smithi131 bash[24745]: cluster 2024-09-14T03:16:36.377210+0000 mgr.a (mgr.14355) 12787 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:37 smithi171 bash[25040]: cluster 2024-09-14T03:16:36.377210+0000 mgr.a (mgr.14355) 12787 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:37 smithi007 bash[22722]: cluster 2024-09-14T03:16:36.377210+0000 mgr.a (mgr.14355) 12787 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:37.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:37.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:37.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:38.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:39 smithi131 bash[24745]: audit 2024-09-14T03:16:38.286899+0000 mgr.a (mgr.14355) 12788 : audit [DBG] from='client.278838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:39 smithi131 bash[24745]: cluster 2024-09-14T03:16:38.377793+0000 mgr.a (mgr.14355) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:39 smithi171 bash[25040]: audit 2024-09-14T03:16:38.286899+0000 mgr.a (mgr.14355) 12788 : audit [DBG] from='client.278838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:39 smithi171 bash[25040]: cluster 2024-09-14T03:16:38.377793+0000 mgr.a (mgr.14355) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:39 smithi007 bash[22722]: audit 2024-09-14T03:16:38.286899+0000 mgr.a (mgr.14355) 12788 : audit [DBG] from='client.278838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:39 smithi007 bash[22722]: cluster 2024-09-14T03:16:38.377793+0000 mgr.a (mgr.14355) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:41 smithi131 bash[24745]: cluster 2024-09-14T03:16:40.380001+0000 mgr.a (mgr.14355) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:41 smithi171 bash[25040]: cluster 2024-09-14T03:16:40.380001+0000 mgr.a (mgr.14355) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:41 smithi007 bash[22722]: cluster 2024-09-14T03:16:40.380001+0000 mgr.a (mgr.14355) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:16:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:42 smithi131 bash[24745]: audit 2024-09-14T03:16:41.716222+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:16:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:42 smithi171 bash[25040]: audit 2024-09-14T03:16:41.716222+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:16:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:42 smithi007 bash[22722]: audit 2024-09-14T03:16:41.716222+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:16:43.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:43.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:43.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22972]: debug 2024-09-14T03:16:43.362+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22972]: debug 2024-09-14T03:16:43.362+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: cluster 2024-09-14T03:16:42.380679+0000 mgr.a (mgr.14355) 12791 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: audit 2024-09-14T03:16:42.597306+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: audit 2024-09-14T03:16:42.598786+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:16:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: audit 2024-09-14T03:16:42.608838+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:16:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: audit 2024-09-14T03:16:42.613703+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:43 smithi007 bash[22722]: audit 2024-09-14T03:16:42.615930+0000 mgr.a (mgr.14355) 12792 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: cluster 2024-09-14T03:16:42.380679+0000 mgr.a (mgr.14355) 12791 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: audit 2024-09-14T03:16:42.597306+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:16:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: audit 2024-09-14T03:16:42.598786+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:16:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: audit 2024-09-14T03:16:42.608838+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:16:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: audit 2024-09-14T03:16:42.613703+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:43 smithi131 bash[24745]: audit 2024-09-14T03:16:42.615930+0000 mgr.a (mgr.14355) 12792 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: cluster 2024-09-14T03:16:42.380679+0000 mgr.a (mgr.14355) 12791 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: audit 2024-09-14T03:16:42.597306+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: audit 2024-09-14T03:16:42.598786+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: audit 2024-09-14T03:16:42.608838+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: audit 2024-09-14T03:16:42.613703+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:43 smithi171 bash[25040]: audit 2024-09-14T03:16:42.615930+0000 mgr.a (mgr.14355) 12792 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:16:44.432 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:44.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:44.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:44.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:44.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:44 smithi131 bash[24745]: audit 2024-09-14T03:16:43.362729+0000 mgr.a (mgr.14355) 12793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:16:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:44 smithi131 bash[24745]: cephadm 2024-09-14T03:16:43.364393+0000 mgr.a (mgr.14355) 12794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:16:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:44 smithi131 bash[24745]: audit 2024-09-14T03:16:44.027361+0000 mgr.a (mgr.14355) 12795 : audit [DBG] from='client.279015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:44 smithi171 bash[25040]: audit 2024-09-14T03:16:43.362729+0000 mgr.a (mgr.14355) 12793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:16:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:44 smithi171 bash[25040]: cephadm 2024-09-14T03:16:43.364393+0000 mgr.a (mgr.14355) 12794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:16:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:44 smithi171 bash[25040]: audit 2024-09-14T03:16:44.027361+0000 mgr.a (mgr.14355) 12795 : audit [DBG] from='client.279015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:44 smithi007 bash[22722]: audit 2024-09-14T03:16:43.362729+0000 mgr.a (mgr.14355) 12793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:16:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:44 smithi007 bash[22722]: cephadm 2024-09-14T03:16:43.364393+0000 mgr.a (mgr.14355) 12794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:16:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:44 smithi007 bash[22722]: audit 2024-09-14T03:16:44.027361+0000 mgr.a (mgr.14355) 12795 : audit [DBG] from='client.279015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:45 smithi131 bash[24745]: cluster 2024-09-14T03:16:44.381307+0000 mgr.a (mgr.14355) 12796 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:45 smithi171 bash[25040]: cluster 2024-09-14T03:16:44.381307+0000 mgr.a (mgr.14355) 12796 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:45 smithi007 bash[22722]: cluster 2024-09-14T03:16:44.381307+0000 mgr.a (mgr.14355) 12796 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:16:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:47 smithi131 bash[24745]: cluster 2024-09-14T03:16:46.383535+0000 mgr.a (mgr.14355) 12797 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:47 smithi171 bash[25040]: cluster 2024-09-14T03:16:46.383535+0000 mgr.a (mgr.14355) 12797 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:47 smithi007 bash[22722]: cluster 2024-09-14T03:16:46.383535+0000 mgr.a (mgr.14355) 12797 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:49.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:49 smithi131 bash[24745]: cluster 2024-09-14T03:16:48.384302+0000 mgr.a (mgr.14355) 12798 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:49 smithi171 bash[25040]: cluster 2024-09-14T03:16:48.384302+0000 mgr.a (mgr.14355) 12798 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:49 smithi007 bash[22722]: cluster 2024-09-14T03:16:48.384302+0000 mgr.a (mgr.14355) 12798 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:50.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:50.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:50.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:50 smithi131 bash[24745]: audit 2024-09-14T03:16:49.769719+0000 mgr.a (mgr.14355) 12799 : audit [DBG] from='client.279093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:50 smithi171 bash[25040]: audit 2024-09-14T03:16:49.769719+0000 mgr.a (mgr.14355) 12799 : audit [DBG] from='client.279093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:50 smithi007 bash[22722]: audit 2024-09-14T03:16:49.769719+0000 mgr.a (mgr.14355) 12799 : audit [DBG] from='client.279093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:51 smithi171 bash[25040]: cluster 2024-09-14T03:16:50.386609+0000 mgr.a (mgr.14355) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:51 smithi007 bash[22722]: cluster 2024-09-14T03:16:50.386609+0000 mgr.a (mgr.14355) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:51 smithi131 bash[24745]: cluster 2024-09-14T03:16:50.386609+0000 mgr.a (mgr.14355) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:53 smithi171 bash[25040]: cluster 2024-09-14T03:16:52.387378+0000 mgr.a (mgr.14355) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:53 smithi007 bash[22722]: cluster 2024-09-14T03:16:52.387378+0000 mgr.a (mgr.14355) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:53 smithi131 bash[24745]: cluster 2024-09-14T03:16:52.387378+0000 mgr.a (mgr.14355) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:16:55.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:16:55.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:16:55.946 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:16:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:16:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:16:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:16:55.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:16:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:55 smithi007 bash[22722]: cluster 2024-09-14T03:16:54.388142+0000 mgr.a (mgr.14355) 12802 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:55 smithi131 bash[24745]: cluster 2024-09-14T03:16:54.388142+0000 mgr.a (mgr.14355) 12802 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:55 smithi171 bash[25040]: cluster 2024-09-14T03:16:54.388142+0000 mgr.a (mgr.14355) 12802 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:56 smithi007 bash[22722]: audit 2024-09-14T03:16:55.528243+0000 mgr.a (mgr.14355) 12803 : audit [DBG] from='client.279171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:56 smithi131 bash[24745]: audit 2024-09-14T03:16:55.528243+0000 mgr.a (mgr.14355) 12803 : audit [DBG] from='client.279171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:56 smithi171 bash[25040]: audit 2024-09-14T03:16:55.528243+0000 mgr.a (mgr.14355) 12803 : audit [DBG] from='client.279171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:16:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:57 smithi007 bash[22722]: cluster 2024-09-14T03:16:56.390941+0000 mgr.a (mgr.14355) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:57 smithi131 bash[24745]: cluster 2024-09-14T03:16:56.390941+0000 mgr.a (mgr.14355) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:16:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:57 smithi171 bash[25040]: cluster 2024-09-14T03:16:56.390941+0000 mgr.a (mgr.14355) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:16:59 smithi007 bash[22722]: cluster 2024-09-14T03:16:58.391765+0000 mgr.a (mgr.14355) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:16:59 smithi131 bash[24745]: cluster 2024-09-14T03:16:58.391765+0000 mgr.a (mgr.14355) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:16:59 smithi171 bash[25040]: cluster 2024-09-14T03:16:58.391765+0000 mgr.a (mgr.14355) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:00.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:00.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:01.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:01.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:01.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:01.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:01.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:01 smithi007 bash[22722]: cluster 2024-09-14T03:17:00.393711+0000 mgr.a (mgr.14355) 12806 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:01 smithi131 bash[24745]: cluster 2024-09-14T03:17:00.393711+0000 mgr.a (mgr.14355) 12806 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:01 smithi171 bash[25040]: cluster 2024-09-14T03:17:00.393711+0000 mgr.a (mgr.14355) 12806 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:02 smithi131 bash[24745]: audit 2024-09-14T03:17:01.273433+0000 mgr.a (mgr.14355) 12807 : audit [DBG] from='client.279246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:02 smithi171 bash[25040]: audit 2024-09-14T03:17:01.273433+0000 mgr.a (mgr.14355) 12807 : audit [DBG] from='client.279246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:02 smithi007 bash[22722]: audit 2024-09-14T03:17:01.273433+0000 mgr.a (mgr.14355) 12807 : audit [DBG] from='client.279246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:03 smithi131 bash[24745]: cluster 2024-09-14T03:17:02.394711+0000 mgr.a (mgr.14355) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:03 smithi171 bash[25040]: cluster 2024-09-14T03:17:02.394711+0000 mgr.a (mgr.14355) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:03 smithi007 bash[22722]: cluster 2024-09-14T03:17:02.394711+0000 mgr.a (mgr.14355) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:05 smithi131 bash[24745]: cluster 2024-09-14T03:17:04.395560+0000 mgr.a (mgr.14355) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:17:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:05 smithi171 bash[25040]: cluster 2024-09-14T03:17:04.395560+0000 mgr.a (mgr.14355) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:17:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:05 smithi007 bash[22722]: cluster 2024-09-14T03:17:04.395560+0000 mgr.a (mgr.14355) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:17:06.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:06.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:06.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:07.449 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:07.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:07 smithi131 bash[24745]: cluster 2024-09-14T03:17:06.397921+0000 mgr.a (mgr.14355) 12810 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:07 smithi131 bash[24745]: audit 2024-09-14T03:17:07.024786+0000 mgr.a (mgr.14355) 12811 : audit [DBG] from='client.279318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:07 smithi171 bash[25040]: cluster 2024-09-14T03:17:06.397921+0000 mgr.a (mgr.14355) 12810 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:07 smithi171 bash[25040]: audit 2024-09-14T03:17:07.024786+0000 mgr.a (mgr.14355) 12811 : audit [DBG] from='client.279318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:07 smithi007 bash[22722]: cluster 2024-09-14T03:17:06.397921+0000 mgr.a (mgr.14355) 12810 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:07 smithi007 bash[22722]: audit 2024-09-14T03:17:07.024786+0000 mgr.a (mgr.14355) 12811 : audit [DBG] from='client.279318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:09 smithi131 bash[24745]: cluster 2024-09-14T03:17:08.398963+0000 mgr.a (mgr.14355) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:09 smithi171 bash[25040]: cluster 2024-09-14T03:17:08.398963+0000 mgr.a (mgr.14355) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:09 smithi007 bash[22722]: cluster 2024-09-14T03:17:08.398963+0000 mgr.a (mgr.14355) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:11 smithi131 bash[24745]: cluster 2024-09-14T03:17:10.401114+0000 mgr.a (mgr.14355) 12813 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:11 smithi171 bash[25040]: cluster 2024-09-14T03:17:10.401114+0000 mgr.a (mgr.14355) 12813 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:12.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:12.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:12.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:11 smithi007 bash[22722]: cluster 2024-09-14T03:17:10.401114+0000 mgr.a (mgr.14355) 12813 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:13.203 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:13.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:13.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:13.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:13.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:13 smithi131 bash[24745]: cluster 2024-09-14T03:17:12.401908+0000 mgr.a (mgr.14355) 12814 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:13 smithi131 bash[24745]: audit 2024-09-14T03:17:12.788288+0000 mgr.a (mgr.14355) 12815 : audit [DBG] from='client.279396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:13 smithi171 bash[25040]: cluster 2024-09-14T03:17:12.401908+0000 mgr.a (mgr.14355) 12814 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:13 smithi171 bash[25040]: audit 2024-09-14T03:17:12.788288+0000 mgr.a (mgr.14355) 12815 : audit [DBG] from='client.279396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:13 smithi007 bash[22722]: cluster 2024-09-14T03:17:12.401908+0000 mgr.a (mgr.14355) 12814 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:13 smithi007 bash[22722]: audit 2024-09-14T03:17:12.788288+0000 mgr.a (mgr.14355) 12815 : audit [DBG] from='client.279396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:15 smithi131 bash[24745]: cluster 2024-09-14T03:17:14.402848+0000 mgr.a (mgr.14355) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:15 smithi171 bash[25040]: cluster 2024-09-14T03:17:14.402848+0000 mgr.a (mgr.14355) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:15 smithi007 bash[22722]: cluster 2024-09-14T03:17:14.402848+0000 mgr.a (mgr.14355) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:17 smithi131 bash[24745]: cluster 2024-09-14T03:17:16.405076+0000 mgr.a (mgr.14355) 12817 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:17 smithi171 bash[25040]: cluster 2024-09-14T03:17:16.405076+0000 mgr.a (mgr.14355) 12817 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:17 smithi007 bash[22722]: cluster 2024-09-14T03:17:16.405076+0000 mgr.a (mgr.14355) 12817 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:18.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:18.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:18.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:20 smithi131 bash[24745]: cluster 2024-09-14T03:17:18.405810+0000 mgr.a (mgr.14355) 12818 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:20 smithi131 bash[24745]: audit 2024-09-14T03:17:18.541572+0000 mgr.a (mgr.14355) 12819 : audit [DBG] from='client.279471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:20 smithi171 bash[25040]: cluster 2024-09-14T03:17:18.405810+0000 mgr.a (mgr.14355) 12818 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:20 smithi171 bash[25040]: audit 2024-09-14T03:17:18.541572+0000 mgr.a (mgr.14355) 12819 : audit [DBG] from='client.279471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:20 smithi007 bash[22722]: cluster 2024-09-14T03:17:18.405810+0000 mgr.a (mgr.14355) 12818 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:20 smithi007 bash[22722]: audit 2024-09-14T03:17:18.541572+0000 mgr.a (mgr.14355) 12819 : audit [DBG] from='client.279471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:22 smithi131 bash[24745]: cluster 2024-09-14T03:17:20.408057+0000 mgr.a (mgr.14355) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:22 smithi171 bash[25040]: cluster 2024-09-14T03:17:20.408057+0000 mgr.a (mgr.14355) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:22 smithi007 bash[22722]: cluster 2024-09-14T03:17:20.408057+0000 mgr.a (mgr.14355) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:24 smithi131 bash[24745]: cluster 2024-09-14T03:17:22.408846+0000 mgr.a (mgr.14355) 12821 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:24 smithi171 bash[25040]: cluster 2024-09-14T03:17:22.408846+0000 mgr.a (mgr.14355) 12821 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:24 smithi007 bash[22722]: cluster 2024-09-14T03:17:22.408846+0000 mgr.a (mgr.14355) 12821 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:24.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:24.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:26 smithi131 bash[24745]: audit 2024-09-14T03:17:24.320813+0000 mgr.a (mgr.14355) 12822 : audit [DBG] from='client.279549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:26 smithi131 bash[24745]: cluster 2024-09-14T03:17:24.409434+0000 mgr.a (mgr.14355) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:26 smithi171 bash[25040]: audit 2024-09-14T03:17:24.320813+0000 mgr.a (mgr.14355) 12822 : audit [DBG] from='client.279549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:26 smithi171 bash[25040]: cluster 2024-09-14T03:17:24.409434+0000 mgr.a (mgr.14355) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:26 smithi007 bash[22722]: audit 2024-09-14T03:17:24.320813+0000 mgr.a (mgr.14355) 12822 : audit [DBG] from='client.279549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:26 smithi007 bash[22722]: cluster 2024-09-14T03:17:24.409434+0000 mgr.a (mgr.14355) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:28 smithi131 bash[24745]: cluster 2024-09-14T03:17:26.411812+0000 mgr.a (mgr.14355) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:28 smithi171 bash[25040]: cluster 2024-09-14T03:17:26.411812+0000 mgr.a (mgr.14355) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:28 smithi007 bash[22722]: cluster 2024-09-14T03:17:26.411812+0000 mgr.a (mgr.14355) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:17:29.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:29.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:29.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:30 smithi131 bash[24745]: cluster 2024-09-14T03:17:28.412589+0000 mgr.a (mgr.14355) 12825 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:30 smithi171 bash[25040]: cluster 2024-09-14T03:17:28.412589+0000 mgr.a (mgr.14355) 12825 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:30 smithi007 bash[22722]: cluster 2024-09-14T03:17:28.412589+0000 mgr.a (mgr.14355) 12825 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:30.527 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:31 smithi171 bash[25040]: audit 2024-09-14T03:17:30.106500+0000 mgr.a (mgr.14355) 12826 : audit [DBG] from='client.279627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:31 smithi007 bash[22722]: audit 2024-09-14T03:17:30.106500+0000 mgr.a (mgr.14355) 12826 : audit [DBG] from='client.279627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:31 smithi131 bash[24745]: audit 2024-09-14T03:17:30.106500+0000 mgr.a (mgr.14355) 12826 : audit [DBG] from='client.279627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:32 smithi171 bash[25040]: cluster 2024-09-14T03:17:30.413825+0000 mgr.a (mgr.14355) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:17:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:32 smithi007 bash[22722]: cluster 2024-09-14T03:17:30.413825+0000 mgr.a (mgr.14355) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:17:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:32 smithi131 bash[24745]: cluster 2024-09-14T03:17:30.413825+0000 mgr.a (mgr.14355) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:17:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:34 smithi171 bash[25040]: cluster 2024-09-14T03:17:32.414707+0000 mgr.a (mgr.14355) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:34 smithi007 bash[22722]: cluster 2024-09-14T03:17:32.414707+0000 mgr.a (mgr.14355) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:34 smithi131 bash[24745]: cluster 2024-09-14T03:17:32.414707+0000 mgr.a (mgr.14355) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:35.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:35.529 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:36.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:36 smithi007 bash[22722]: cluster 2024-09-14T03:17:34.415622+0000 mgr.a (mgr.14355) 12829 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:36 smithi131 bash[24745]: cluster 2024-09-14T03:17:34.415622+0000 mgr.a (mgr.14355) 12829 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:36 smithi171 bash[25040]: cluster 2024-09-14T03:17:34.415622+0000 mgr.a (mgr.14355) 12829 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:17:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:37 smithi007 bash[22722]: audit 2024-09-14T03:17:35.855645+0000 mgr.a (mgr.14355) 12830 : audit [DBG] from='client.279705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:37 smithi131 bash[24745]: audit 2024-09-14T03:17:35.855645+0000 mgr.a (mgr.14355) 12830 : audit [DBG] from='client.279705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:37 smithi171 bash[25040]: audit 2024-09-14T03:17:35.855645+0000 mgr.a (mgr.14355) 12830 : audit [DBG] from='client.279705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:38 smithi007 bash[22722]: cluster 2024-09-14T03:17:36.418401+0000 mgr.a (mgr.14355) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:38 smithi131 bash[24745]: cluster 2024-09-14T03:17:36.418401+0000 mgr.a (mgr.14355) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:38 smithi171 bash[25040]: cluster 2024-09-14T03:17:36.418401+0000 mgr.a (mgr.14355) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:40 smithi007 bash[22722]: cluster 2024-09-14T03:17:38.419311+0000 mgr.a (mgr.14355) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:40 smithi131 bash[24745]: cluster 2024-09-14T03:17:38.419311+0000 mgr.a (mgr.14355) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:40 smithi171 bash[25040]: cluster 2024-09-14T03:17:38.419311+0000 mgr.a (mgr.14355) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:17:41.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:41.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:41.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:42.025 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:42.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:42.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:42.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:42.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:42 smithi007 bash[22722]: cluster 2024-09-14T03:17:40.421272+0000 mgr.a (mgr.14355) 12833 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:42 smithi131 bash[24745]: cluster 2024-09-14T03:17:40.421272+0000 mgr.a (mgr.14355) 12833 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:42 smithi171 bash[25040]: cluster 2024-09-14T03:17:40.421272+0000 mgr.a (mgr.14355) 12833 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:17:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:43 smithi007 bash[22722]: audit 2024-09-14T03:17:41.607497+0000 mgr.a (mgr.14355) 12834 : audit [DBG] from='client.279783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:43 smithi131 bash[24745]: audit 2024-09-14T03:17:41.607497+0000 mgr.a (mgr.14355) 12834 : audit [DBG] from='client.279783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:43 smithi171 bash[25040]: audit 2024-09-14T03:17:41.607497+0000 mgr.a (mgr.14355) 12834 : audit [DBG] from='client.279783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:44 smithi007 bash[22722]: cluster 2024-09-14T03:17:42.422203+0000 mgr.a (mgr.14355) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:44 smithi007 bash[22722]: audit 2024-09-14T03:17:43.419729+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:44 smithi131 bash[24745]: cluster 2024-09-14T03:17:42.422203+0000 mgr.a (mgr.14355) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:44 smithi131 bash[24745]: audit 2024-09-14T03:17:43.419729+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:44 smithi171 bash[25040]: cluster 2024-09-14T03:17:42.422203+0000 mgr.a (mgr.14355) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:44 smithi171 bash[25040]: audit 2024-09-14T03:17:43.419729+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:17:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22972]: debug 2024-09-14T03:17:45.005+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:17:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22972]: debug 2024-09-14T03:17:45.009+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:17:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22722]: audit 2024-09-14T03:17:44.258203+0000 mon.a (mon.0) 2508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:17:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22722]: audit 2024-09-14T03:17:44.259963+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:17:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22722]: audit 2024-09-14T03:17:44.270461+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:17:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:45 smithi007 bash[22722]: audit 2024-09-14T03:17:44.275150+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:45 smithi131 bash[24745]: audit 2024-09-14T03:17:44.258203+0000 mon.a (mon.0) 2508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:17:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:45 smithi131 bash[24745]: audit 2024-09-14T03:17:44.259963+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:17:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:45 smithi131 bash[24745]: audit 2024-09-14T03:17:44.270461+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:17:45.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:45 smithi131 bash[24745]: audit 2024-09-14T03:17:44.275150+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:45 smithi171 bash[25040]: audit 2024-09-14T03:17:44.258203+0000 mon.a (mon.0) 2508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:17:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:45 smithi171 bash[25040]: audit 2024-09-14T03:17:44.259963+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:17:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:45 smithi171 bash[25040]: audit 2024-09-14T03:17:44.270461+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:17:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:45 smithi171 bash[25040]: audit 2024-09-14T03:17:44.275150+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:46 smithi007 bash[22722]: audit 2024-09-14T03:17:44.277695+0000 mgr.a (mgr.14355) 12836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:46 smithi007 bash[22722]: cluster 2024-09-14T03:17:44.422896+0000 mgr.a (mgr.14355) 12837 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:46 smithi007 bash[22722]: audit 2024-09-14T03:17:45.010015+0000 mgr.a (mgr.14355) 12838 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:17:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:46 smithi007 bash[22722]: cephadm 2024-09-14T03:17:45.011379+0000 mgr.a (mgr.14355) 12839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:17:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:46 smithi131 bash[24745]: audit 2024-09-14T03:17:44.277695+0000 mgr.a (mgr.14355) 12836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:46 smithi131 bash[24745]: cluster 2024-09-14T03:17:44.422896+0000 mgr.a (mgr.14355) 12837 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:46 smithi131 bash[24745]: audit 2024-09-14T03:17:45.010015+0000 mgr.a (mgr.14355) 12838 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:17:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:46 smithi131 bash[24745]: cephadm 2024-09-14T03:17:45.011379+0000 mgr.a (mgr.14355) 12839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:17:46.550 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:46 smithi171 bash[25040]: audit 2024-09-14T03:17:44.277695+0000 mgr.a (mgr.14355) 12836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:17:46.550 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:46 smithi171 bash[25040]: cluster 2024-09-14T03:17:44.422896+0000 mgr.a (mgr.14355) 12837 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:17:46.550 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:46 smithi171 bash[25040]: audit 2024-09-14T03:17:45.010015+0000 mgr.a (mgr.14355) 12838 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:17:46.550 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:46 smithi171 bash[25040]: cephadm 2024-09-14T03:17:45.011379+0000 mgr.a (mgr.14355) 12839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:17:47.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:47.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:47.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:47.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:48 smithi007 bash[22722]: cluster 2024-09-14T03:17:46.425190+0000 mgr.a (mgr.14355) 12840 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:48 smithi131 bash[24745]: cluster 2024-09-14T03:17:46.425190+0000 mgr.a (mgr.14355) 12840 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:48 smithi171 bash[25040]: cluster 2024-09-14T03:17:46.425190+0000 mgr.a (mgr.14355) 12840 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:49 smithi007 bash[22722]: audit 2024-09-14T03:17:47.360979+0000 mgr.a (mgr.14355) 12841 : audit [DBG] from='client.279966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:49 smithi131 bash[24745]: audit 2024-09-14T03:17:47.360979+0000 mgr.a (mgr.14355) 12841 : audit [DBG] from='client.279966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:49 smithi171 bash[25040]: audit 2024-09-14T03:17:47.360979+0000 mgr.a (mgr.14355) 12841 : audit [DBG] from='client.279966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:50 smithi007 bash[22722]: cluster 2024-09-14T03:17:48.426096+0000 mgr.a (mgr.14355) 12842 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:50 smithi131 bash[24745]: cluster 2024-09-14T03:17:48.426096+0000 mgr.a (mgr.14355) 12842 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:50 smithi171 bash[25040]: cluster 2024-09-14T03:17:48.426096+0000 mgr.a (mgr.14355) 12842 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:52 smithi007 bash[22722]: cluster 2024-09-14T03:17:50.428236+0000 mgr.a (mgr.14355) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:52 smithi131 bash[24745]: cluster 2024-09-14T03:17:50.428236+0000 mgr.a (mgr.14355) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:52 smithi171 bash[25040]: cluster 2024-09-14T03:17:50.428236+0000 mgr.a (mgr.14355) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:52.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:53.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:53.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:53.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:53.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:17:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:54 smithi007 bash[22722]: cluster 2024-09-14T03:17:52.429020+0000 mgr.a (mgr.14355) 12844 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:54 smithi007 bash[22722]: audit 2024-09-14T03:17:53.139504+0000 mgr.a (mgr.14355) 12845 : audit [DBG] from='client.280044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:54 smithi131 bash[24745]: cluster 2024-09-14T03:17:52.429020+0000 mgr.a (mgr.14355) 12844 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:54 smithi131 bash[24745]: audit 2024-09-14T03:17:53.139504+0000 mgr.a (mgr.14355) 12845 : audit [DBG] from='client.280044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:54 smithi171 bash[25040]: cluster 2024-09-14T03:17:52.429020+0000 mgr.a (mgr.14355) 12844 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:54 smithi171 bash[25040]: audit 2024-09-14T03:17:53.139504+0000 mgr.a (mgr.14355) 12845 : audit [DBG] from='client.280044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:17:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:56 smithi007 bash[22722]: cluster 2024-09-14T03:17:54.429923+0000 mgr.a (mgr.14355) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:56 smithi131 bash[24745]: cluster 2024-09-14T03:17:54.429923+0000 mgr.a (mgr.14355) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:56 smithi171 bash[25040]: cluster 2024-09-14T03:17:54.429923+0000 mgr.a (mgr.14355) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:17:58 smithi007 bash[22722]: cluster 2024-09-14T03:17:56.432180+0000 mgr.a (mgr.14355) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:17:58 smithi131 bash[24745]: cluster 2024-09-14T03:17:56.432180+0000 mgr.a (mgr.14355) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:17:58 smithi171 bash[25040]: cluster 2024-09-14T03:17:56.432180+0000 mgr.a (mgr.14355) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:17:58.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:17:58.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:17:58.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:17:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:17:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:17:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:17:59.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:00 smithi007 bash[22722]: cluster 2024-09-14T03:17:58.432935+0000 mgr.a (mgr.14355) 12848 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:00 smithi007 bash[22722]: audit 2024-09-14T03:17:58.906550+0000 mgr.a (mgr.14355) 12849 : audit [DBG] from='client.280119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:00 smithi131 bash[24745]: cluster 2024-09-14T03:17:58.432935+0000 mgr.a (mgr.14355) 12848 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:00 smithi131 bash[24745]: audit 2024-09-14T03:17:58.906550+0000 mgr.a (mgr.14355) 12849 : audit [DBG] from='client.280119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:00 smithi171 bash[25040]: cluster 2024-09-14T03:17:58.432935+0000 mgr.a (mgr.14355) 12848 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:00 smithi171 bash[25040]: audit 2024-09-14T03:17:58.906550+0000 mgr.a (mgr.14355) 12849 : audit [DBG] from='client.280119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:02 smithi007 bash[22722]: cluster 2024-09-14T03:18:00.435329+0000 mgr.a (mgr.14355) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:02 smithi131 bash[24745]: cluster 2024-09-14T03:18:00.435329+0000 mgr.a (mgr.14355) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:02 smithi171 bash[25040]: cluster 2024-09-14T03:18:00.435329+0000 mgr.a (mgr.14355) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:04.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:04.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:04 smithi007 bash[22722]: cluster 2024-09-14T03:18:02.436281+0000 mgr.a (mgr.14355) 12851 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:04 smithi131 bash[24745]: cluster 2024-09-14T03:18:02.436281+0000 mgr.a (mgr.14355) 12851 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:04 smithi171 bash[25040]: cluster 2024-09-14T03:18:02.436281+0000 mgr.a (mgr.14355) 12851 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:05.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:05.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:05.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:05.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:05.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:06 smithi007 bash[22722]: cluster 2024-09-14T03:18:04.436811+0000 mgr.a (mgr.14355) 12852 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:06 smithi007 bash[22722]: audit 2024-09-14T03:18:04.661305+0000 mgr.a (mgr.14355) 12853 : audit [DBG] from='client.280197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:06 smithi131 bash[24745]: cluster 2024-09-14T03:18:04.436811+0000 mgr.a (mgr.14355) 12852 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:06 smithi131 bash[24745]: audit 2024-09-14T03:18:04.661305+0000 mgr.a (mgr.14355) 12853 : audit [DBG] from='client.280197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:06 smithi171 bash[25040]: cluster 2024-09-14T03:18:04.436811+0000 mgr.a (mgr.14355) 12852 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:06 smithi171 bash[25040]: audit 2024-09-14T03:18:04.661305+0000 mgr.a (mgr.14355) 12853 : audit [DBG] from='client.280197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:08 smithi007 bash[22722]: cluster 2024-09-14T03:18:06.439148+0000 mgr.a (mgr.14355) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:08 smithi131 bash[24745]: cluster 2024-09-14T03:18:06.439148+0000 mgr.a (mgr.14355) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:08 smithi171 bash[25040]: cluster 2024-09-14T03:18:06.439148+0000 mgr.a (mgr.14355) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:10 smithi007 bash[22722]: cluster 2024-09-14T03:18:08.439907+0000 mgr.a (mgr.14355) 12855 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:10 smithi131 bash[24745]: cluster 2024-09-14T03:18:08.439907+0000 mgr.a (mgr.14355) 12855 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:10 smithi171 bash[25040]: cluster 2024-09-14T03:18:08.439907+0000 mgr.a (mgr.14355) 12855 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:10.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:12 smithi007 bash[22722]: audit 2024-09-14T03:18:10.432501+0000 mgr.a (mgr.14355) 12856 : audit [DBG] from='client.280272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:12 smithi007 bash[22722]: cluster 2024-09-14T03:18:10.453733+0000 mgr.a (mgr.14355) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:12 smithi131 bash[24745]: audit 2024-09-14T03:18:10.432501+0000 mgr.a (mgr.14355) 12856 : audit [DBG] from='client.280272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:12 smithi131 bash[24745]: cluster 2024-09-14T03:18:10.453733+0000 mgr.a (mgr.14355) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:12 smithi171 bash[25040]: audit 2024-09-14T03:18:10.432501+0000 mgr.a (mgr.14355) 12856 : audit [DBG] from='client.280272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:12 smithi171 bash[25040]: cluster 2024-09-14T03:18:10.453733+0000 mgr.a (mgr.14355) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:14 smithi007 bash[22722]: cluster 2024-09-14T03:18:12.454936+0000 mgr.a (mgr.14355) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:14 smithi131 bash[24745]: cluster 2024-09-14T03:18:12.454936+0000 mgr.a (mgr.14355) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:14 smithi171 bash[25040]: cluster 2024-09-14T03:18:12.454936+0000 mgr.a (mgr.14355) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:15.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:16 smithi007 bash[22722]: cluster 2024-09-14T03:18:14.455764+0000 mgr.a (mgr.14355) 12859 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:16 smithi131 bash[24745]: cluster 2024-09-14T03:18:14.455764+0000 mgr.a (mgr.14355) 12859 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:16 smithi171 bash[25040]: cluster 2024-09-14T03:18:14.455764+0000 mgr.a (mgr.14355) 12859 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:16.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:16.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:18 smithi007 bash[22722]: audit 2024-09-14T03:18:16.194645+0000 mgr.a (mgr.14355) 12860 : audit [DBG] from='client.280347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:18 smithi007 bash[22722]: cluster 2024-09-14T03:18:16.457178+0000 mgr.a (mgr.14355) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:18 smithi131 bash[24745]: audit 2024-09-14T03:18:16.194645+0000 mgr.a (mgr.14355) 12860 : audit [DBG] from='client.280347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:18 smithi131 bash[24745]: cluster 2024-09-14T03:18:16.457178+0000 mgr.a (mgr.14355) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:18 smithi171 bash[25040]: audit 2024-09-14T03:18:16.194645+0000 mgr.a (mgr.14355) 12860 : audit [DBG] from='client.280347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:18 smithi171 bash[25040]: cluster 2024-09-14T03:18:16.457178+0000 mgr.a (mgr.14355) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:20 smithi007 bash[22722]: cluster 2024-09-14T03:18:18.458059+0000 mgr.a (mgr.14355) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:20 smithi131 bash[24745]: cluster 2024-09-14T03:18:18.458059+0000 mgr.a (mgr.14355) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:20 smithi171 bash[25040]: cluster 2024-09-14T03:18:18.458059+0000 mgr.a (mgr.14355) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:18:21.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:21.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:21.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:22.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:22.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:22 smithi007 bash[22722]: cluster 2024-09-14T03:18:20.460208+0000 mgr.a (mgr.14355) 12863 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:22 smithi131 bash[24745]: cluster 2024-09-14T03:18:20.460208+0000 mgr.a (mgr.14355) 12863 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:22 smithi171 bash[25040]: cluster 2024-09-14T03:18:20.460208+0000 mgr.a (mgr.14355) 12863 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:23 smithi007 bash[22722]: audit 2024-09-14T03:18:21.973130+0000 mgr.a (mgr.14355) 12864 : audit [DBG] from='client.280425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:23 smithi131 bash[24745]: audit 2024-09-14T03:18:21.973130+0000 mgr.a (mgr.14355) 12864 : audit [DBG] from='client.280425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:23 smithi171 bash[25040]: audit 2024-09-14T03:18:21.973130+0000 mgr.a (mgr.14355) 12864 : audit [DBG] from='client.280425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:24 smithi007 bash[22722]: cluster 2024-09-14T03:18:22.460979+0000 mgr.a (mgr.14355) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:24 smithi131 bash[24745]: cluster 2024-09-14T03:18:22.460979+0000 mgr.a (mgr.14355) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:24 smithi171 bash[25040]: cluster 2024-09-14T03:18:22.460979+0000 mgr.a (mgr.14355) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:25 smithi007 bash[22722]: cluster 2024-09-14T03:18:24.461893+0000 mgr.a (mgr.14355) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:25 smithi131 bash[24745]: cluster 2024-09-14T03:18:24.461893+0000 mgr.a (mgr.14355) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:25 smithi171 bash[25040]: cluster 2024-09-14T03:18:24.461893+0000 mgr.a (mgr.14355) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:27.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:27.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:27.397 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:27 smithi131 bash[24745]: cluster 2024-09-14T03:18:26.464241+0000 mgr.a (mgr.14355) 12867 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:27 smithi171 bash[25040]: cluster 2024-09-14T03:18:26.464241+0000 mgr.a (mgr.14355) 12867 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:27 smithi007 bash[22722]: cluster 2024-09-14T03:18:26.464241+0000 mgr.a (mgr.14355) 12867 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:28 smithi131 bash[24745]: audit 2024-09-14T03:18:27.726520+0000 mgr.a (mgr.14355) 12868 : audit [DBG] from='client.280500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:28 smithi171 bash[25040]: audit 2024-09-14T03:18:27.726520+0000 mgr.a (mgr.14355) 12868 : audit [DBG] from='client.280500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:28 smithi007 bash[22722]: audit 2024-09-14T03:18:27.726520+0000 mgr.a (mgr.14355) 12868 : audit [DBG] from='client.280500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:29 smithi131 bash[24745]: cluster 2024-09-14T03:18:28.465135+0000 mgr.a (mgr.14355) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:29 smithi171 bash[25040]: cluster 2024-09-14T03:18:28.465135+0000 mgr.a (mgr.14355) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:29 smithi007 bash[22722]: cluster 2024-09-14T03:18:28.465135+0000 mgr.a (mgr.14355) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:31 smithi171 bash[25040]: cluster 2024-09-14T03:18:30.467283+0000 mgr.a (mgr.14355) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:31 smithi007 bash[22722]: cluster 2024-09-14T03:18:30.467283+0000 mgr.a (mgr.14355) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:31 smithi131 bash[24745]: cluster 2024-09-14T03:18:30.467283+0000 mgr.a (mgr.14355) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:33 smithi171 bash[25040]: cluster 2024-09-14T03:18:32.468053+0000 mgr.a (mgr.14355) 12871 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:33.935 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:33 smithi007 bash[22722]: cluster 2024-09-14T03:18:32.468053+0000 mgr.a (mgr.14355) 12871 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:33 smithi131 bash[24745]: cluster 2024-09-14T03:18:32.468053+0000 mgr.a (mgr.14355) 12871 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:34 smithi007 bash[22722]: audit 2024-09-14T03:18:33.492354+0000 mgr.a (mgr.14355) 12872 : audit [DBG] from='client.280575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:34 smithi131 bash[24745]: audit 2024-09-14T03:18:33.492354+0000 mgr.a (mgr.14355) 12872 : audit [DBG] from='client.280575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:34 smithi171 bash[25040]: audit 2024-09-14T03:18:33.492354+0000 mgr.a (mgr.14355) 12872 : audit [DBG] from='client.280575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:35 smithi007 bash[22722]: cluster 2024-09-14T03:18:34.468965+0000 mgr.a (mgr.14355) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:35 smithi131 bash[24745]: cluster 2024-09-14T03:18:34.468965+0000 mgr.a (mgr.14355) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:35 smithi171 bash[25040]: cluster 2024-09-14T03:18:34.468965+0000 mgr.a (mgr.14355) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:37 smithi007 bash[22722]: cluster 2024-09-14T03:18:36.471214+0000 mgr.a (mgr.14355) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:37 smithi131 bash[24745]: cluster 2024-09-14T03:18:36.471214+0000 mgr.a (mgr.14355) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:37 smithi171 bash[25040]: cluster 2024-09-14T03:18:36.471214+0000 mgr.a (mgr.14355) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:38.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:38.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:39.715 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:39.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:39.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:39 smithi007 bash[22722]: cluster 2024-09-14T03:18:38.471975+0000 mgr.a (mgr.14355) 12875 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:39 smithi131 bash[24745]: cluster 2024-09-14T03:18:38.471975+0000 mgr.a (mgr.14355) 12875 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:39 smithi171 bash[25040]: cluster 2024-09-14T03:18:38.471975+0000 mgr.a (mgr.14355) 12875 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:40 smithi007 bash[22722]: audit 2024-09-14T03:18:39.269636+0000 mgr.a (mgr.14355) 12876 : audit [DBG] from='client.280647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:40 smithi131 bash[24745]: audit 2024-09-14T03:18:39.269636+0000 mgr.a (mgr.14355) 12876 : audit [DBG] from='client.280647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:40 smithi171 bash[25040]: audit 2024-09-14T03:18:39.269636+0000 mgr.a (mgr.14355) 12876 : audit [DBG] from='client.280647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:41 smithi007 bash[22722]: cluster 2024-09-14T03:18:40.474186+0000 mgr.a (mgr.14355) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:41 smithi131 bash[24745]: cluster 2024-09-14T03:18:40.474186+0000 mgr.a (mgr.14355) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:41 smithi171 bash[25040]: cluster 2024-09-14T03:18:40.474186+0000 mgr.a (mgr.14355) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:18:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:43 smithi007 bash[22722]: cluster 2024-09-14T03:18:42.474950+0000 mgr.a (mgr.14355) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:43 smithi131 bash[24745]: cluster 2024-09-14T03:18:42.474950+0000 mgr.a (mgr.14355) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:43 smithi171 bash[25040]: cluster 2024-09-14T03:18:42.474950+0000 mgr.a (mgr.14355) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:44.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:44.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:44.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:45.508 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:45.509 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:45 smithi007 bash[22722]: cluster 2024-09-14T03:18:44.475683+0000 mgr.a (mgr.14355) 12879 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:45 smithi007 bash[22722]: audit 2024-09-14T03:18:45.049294+0000 mgr.a (mgr.14355) 12880 : audit [DBG] from='client.280725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:45 smithi007 bash[22722]: audit 2024-09-14T03:18:45.066521+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:18:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:45 smithi131 bash[24745]: cluster 2024-09-14T03:18:44.475683+0000 mgr.a (mgr.14355) 12879 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:45 smithi131 bash[24745]: audit 2024-09-14T03:18:45.049294+0000 mgr.a (mgr.14355) 12880 : audit [DBG] from='client.280725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:45 smithi131 bash[24745]: audit 2024-09-14T03:18:45.066521+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:18:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:45 smithi171 bash[25040]: cluster 2024-09-14T03:18:44.475683+0000 mgr.a (mgr.14355) 12879 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:18:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:45 smithi171 bash[25040]: audit 2024-09-14T03:18:45.049294+0000 mgr.a (mgr.14355) 12880 : audit [DBG] from='client.280725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:45 smithi171 bash[25040]: audit 2024-09-14T03:18:45.066521+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:18:46.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22972]: debug 2024-09-14T03:18:46.648+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:18:46.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22972]: debug 2024-09-14T03:18:46.648+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:18:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22722]: audit 2024-09-14T03:18:45.913213+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:18:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22722]: audit 2024-09-14T03:18:45.914979+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:18:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22722]: audit 2024-09-14T03:18:45.925195+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:18:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22722]: audit 2024-09-14T03:18:45.928217+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:46 smithi007 bash[22722]: audit 2024-09-14T03:18:45.930970+0000 mgr.a (mgr.14355) 12881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:46 smithi131 bash[24745]: audit 2024-09-14T03:18:45.913213+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:18:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:46 smithi131 bash[24745]: audit 2024-09-14T03:18:45.914979+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:18:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:46 smithi131 bash[24745]: audit 2024-09-14T03:18:45.925195+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:18:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:46 smithi131 bash[24745]: audit 2024-09-14T03:18:45.928217+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:46 smithi131 bash[24745]: audit 2024-09-14T03:18:45.930970+0000 mgr.a (mgr.14355) 12881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:46 smithi171 bash[25040]: audit 2024-09-14T03:18:45.913213+0000 mon.a (mon.0) 2513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:46 smithi171 bash[25040]: audit 2024-09-14T03:18:45.914979+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:46 smithi171 bash[25040]: audit 2024-09-14T03:18:45.925195+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:46 smithi171 bash[25040]: audit 2024-09-14T03:18:45.928217+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:46 smithi171 bash[25040]: audit 2024-09-14T03:18:45.930970+0000 mgr.a (mgr.14355) 12881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:47 smithi007 bash[22722]: cluster 2024-09-14T03:18:46.476962+0000 mgr.a (mgr.14355) 12882 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:47 smithi007 bash[22722]: audit 2024-09-14T03:18:46.652648+0000 mgr.a (mgr.14355) 12883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:47 smithi007 bash[22722]: cephadm 2024-09-14T03:18:46.654040+0000 mgr.a (mgr.14355) 12884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:18:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:47 smithi131 bash[24745]: cluster 2024-09-14T03:18:46.476962+0000 mgr.a (mgr.14355) 12882 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:18:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:47 smithi131 bash[24745]: audit 2024-09-14T03:18:46.652648+0000 mgr.a (mgr.14355) 12883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:18:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:47 smithi131 bash[24745]: cephadm 2024-09-14T03:18:46.654040+0000 mgr.a (mgr.14355) 12884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:18:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:47 smithi171 bash[25040]: cluster 2024-09-14T03:18:46.476962+0000 mgr.a (mgr.14355) 12882 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:18:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:47 smithi171 bash[25040]: audit 2024-09-14T03:18:46.652648+0000 mgr.a (mgr.14355) 12883 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:18:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:47 smithi171 bash[25040]: cephadm 2024-09-14T03:18:46.654040+0000 mgr.a (mgr.14355) 12884 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:18:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:49 smithi131 bash[24745]: cluster 2024-09-14T03:18:48.477703+0000 mgr.a (mgr.14355) 12885 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:18:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:49 smithi171 bash[25040]: cluster 2024-09-14T03:18:48.477703+0000 mgr.a (mgr.14355) 12885 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:18:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:49 smithi007 bash[22722]: cluster 2024-09-14T03:18:48.477703+0000 mgr.a (mgr.14355) 12885 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:18:50.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:50.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:50.511 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:51.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:51.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:51 smithi131 bash[24745]: cluster 2024-09-14T03:18:50.479635+0000 mgr.a (mgr.14355) 12886 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:51 smithi131 bash[24745]: audit 2024-09-14T03:18:50.844521+0000 mgr.a (mgr.14355) 12887 : audit [DBG] from='client.280905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:51 smithi171 bash[25040]: cluster 2024-09-14T03:18:50.479635+0000 mgr.a (mgr.14355) 12886 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:51 smithi171 bash[25040]: audit 2024-09-14T03:18:50.844521+0000 mgr.a (mgr.14355) 12887 : audit [DBG] from='client.280905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:51 smithi007 bash[22722]: cluster 2024-09-14T03:18:50.479635+0000 mgr.a (mgr.14355) 12886 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:51 smithi007 bash[22722]: audit 2024-09-14T03:18:50.844521+0000 mgr.a (mgr.14355) 12887 : audit [DBG] from='client.280905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:53 smithi131 bash[24745]: cluster 2024-09-14T03:18:52.480520+0000 mgr.a (mgr.14355) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:53 smithi171 bash[25040]: cluster 2024-09-14T03:18:52.480520+0000 mgr.a (mgr.14355) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:53 smithi007 bash[22722]: cluster 2024-09-14T03:18:52.480520+0000 mgr.a (mgr.14355) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:55 smithi131 bash[24745]: cluster 2024-09-14T03:18:54.481307+0000 mgr.a (mgr.14355) 12889 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:56.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:18:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:18:56.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:18:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:55 smithi171 bash[25040]: cluster 2024-09-14T03:18:54.481307+0000 mgr.a (mgr.14355) 12889 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:55 smithi007 bash[22722]: cluster 2024-09-14T03:18:54.481307+0000 mgr.a (mgr.14355) 12889 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:18:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:18:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:18:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:18:57.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:18:57.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:18:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:57 smithi131 bash[24745]: cluster 2024-09-14T03:18:56.483479+0000 mgr.a (mgr.14355) 12890 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:57 smithi131 bash[24745]: audit 2024-09-14T03:18:56.626747+0000 mgr.a (mgr.14355) 12891 : audit [DBG] from='client.280983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:57 smithi171 bash[25040]: cluster 2024-09-14T03:18:56.483479+0000 mgr.a (mgr.14355) 12890 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:57 smithi171 bash[25040]: audit 2024-09-14T03:18:56.626747+0000 mgr.a (mgr.14355) 12891 : audit [DBG] from='client.280983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:18:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:57 smithi007 bash[22722]: cluster 2024-09-14T03:18:56.483479+0000 mgr.a (mgr.14355) 12890 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:18:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:57 smithi007 bash[22722]: audit 2024-09-14T03:18:56.626747+0000 mgr.a (mgr.14355) 12891 : audit [DBG] from='client.280983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:18:59 smithi131 bash[24745]: cluster 2024-09-14T03:18:58.484393+0000 mgr.a (mgr.14355) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:19:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:18:59 smithi171 bash[25040]: cluster 2024-09-14T03:18:58.484393+0000 mgr.a (mgr.14355) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:19:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:18:59 smithi007 bash[22722]: cluster 2024-09-14T03:18:58.484393+0000 mgr.a (mgr.14355) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:19:02.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:02.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:02.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:01 smithi131 bash[24745]: cluster 2024-09-14T03:19:00.486575+0000 mgr.a (mgr.14355) 12893 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:01 smithi171 bash[25040]: cluster 2024-09-14T03:19:00.486575+0000 mgr.a (mgr.14355) 12893 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:01 smithi007 bash[22722]: cluster 2024-09-14T03:19:00.486575+0000 mgr.a (mgr.14355) 12893 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:02.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:02.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:02.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:02.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:03 smithi131 bash[24745]: audit 2024-09-14T03:19:02.385177+0000 mgr.a (mgr.14355) 12894 : audit [DBG] from='client.281061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:03 smithi131 bash[24745]: cluster 2024-09-14T03:19:02.487012+0000 mgr.a (mgr.14355) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:03 smithi171 bash[25040]: audit 2024-09-14T03:19:02.385177+0000 mgr.a (mgr.14355) 12894 : audit [DBG] from='client.281061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:03 smithi171 bash[25040]: cluster 2024-09-14T03:19:02.487012+0000 mgr.a (mgr.14355) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:03 smithi007 bash[22722]: audit 2024-09-14T03:19:02.385177+0000 mgr.a (mgr.14355) 12894 : audit [DBG] from='client.281061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:03 smithi007 bash[22722]: cluster 2024-09-14T03:19:02.487012+0000 mgr.a (mgr.14355) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:06 smithi131 bash[24745]: cluster 2024-09-14T03:19:04.487848+0000 mgr.a (mgr.14355) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:06 smithi171 bash[25040]: cluster 2024-09-14T03:19:04.487848+0000 mgr.a (mgr.14355) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:05 smithi007 bash[22722]: cluster 2024-09-14T03:19:04.487848+0000 mgr.a (mgr.14355) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:08 smithi131 bash[24745]: cluster 2024-09-14T03:19:06.490074+0000 mgr.a (mgr.14355) 12897 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:08 smithi171 bash[25040]: cluster 2024-09-14T03:19:06.490074+0000 mgr.a (mgr.14355) 12897 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:08 smithi007 bash[22722]: cluster 2024-09-14T03:19:06.490074+0000 mgr.a (mgr.14355) 12897 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:08.565 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:09 smithi131 bash[24745]: audit 2024-09-14T03:19:08.142731+0000 mgr.a (mgr.14355) 12898 : audit [DBG] from='client.281136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:09 smithi171 bash[25040]: audit 2024-09-14T03:19:08.142731+0000 mgr.a (mgr.14355) 12898 : audit [DBG] from='client.281136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:09 smithi007 bash[22722]: audit 2024-09-14T03:19:08.142731+0000 mgr.a (mgr.14355) 12898 : audit [DBG] from='client.281136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:10 smithi131 bash[24745]: cluster 2024-09-14T03:19:08.490570+0000 mgr.a (mgr.14355) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:10 smithi171 bash[25040]: cluster 2024-09-14T03:19:08.490570+0000 mgr.a (mgr.14355) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:10 smithi007 bash[22722]: cluster 2024-09-14T03:19:08.490570+0000 mgr.a (mgr.14355) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:12 smithi131 bash[24745]: cluster 2024-09-14T03:19:10.492618+0000 mgr.a (mgr.14355) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:12 smithi171 bash[25040]: cluster 2024-09-14T03:19:10.492618+0000 mgr.a (mgr.14355) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:12 smithi007 bash[22722]: cluster 2024-09-14T03:19:10.492618+0000 mgr.a (mgr.14355) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:14 smithi131 bash[24745]: cluster 2024-09-14T03:19:12.493415+0000 mgr.a (mgr.14355) 12901 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:14 smithi171 bash[25040]: cluster 2024-09-14T03:19:12.493415+0000 mgr.a (mgr.14355) 12901 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:14.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:14 smithi007 bash[22722]: cluster 2024-09-14T03:19:12.493415+0000 mgr.a (mgr.14355) 12901 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:15.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:15 smithi171 bash[25040]: audit 2024-09-14T03:19:13.900972+0000 mgr.a (mgr.14355) 12902 : audit [DBG] from='client.281211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:15 smithi007 bash[22722]: audit 2024-09-14T03:19:13.900972+0000 mgr.a (mgr.14355) 12902 : audit [DBG] from='client.281211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:15 smithi131 bash[24745]: audit 2024-09-14T03:19:13.900972+0000 mgr.a (mgr.14355) 12902 : audit [DBG] from='client.281211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:16 smithi171 bash[25040]: cluster 2024-09-14T03:19:14.494412+0000 mgr.a (mgr.14355) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:16 smithi007 bash[22722]: cluster 2024-09-14T03:19:14.494412+0000 mgr.a (mgr.14355) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:16 smithi131 bash[24745]: cluster 2024-09-14T03:19:14.494412+0000 mgr.a (mgr.14355) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:18 smithi171 bash[25040]: cluster 2024-09-14T03:19:16.496635+0000 mgr.a (mgr.14355) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:18 smithi007 bash[22722]: cluster 2024-09-14T03:19:16.496635+0000 mgr.a (mgr.14355) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:18 smithi131 bash[24745]: cluster 2024-09-14T03:19:16.496635+0000 mgr.a (mgr.14355) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:19.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:19.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:20.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:20.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:20.108 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:20 smithi171 bash[25040]: cluster 2024-09-14T03:19:18.497410+0000 mgr.a (mgr.14355) 12905 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:20 smithi007 bash[22722]: cluster 2024-09-14T03:19:18.497410+0000 mgr.a (mgr.14355) 12905 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:20 smithi131 bash[24745]: cluster 2024-09-14T03:19:18.497410+0000 mgr.a (mgr.14355) 12905 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:21 smithi007 bash[22722]: audit 2024-09-14T03:19:19.672197+0000 mgr.a (mgr.14355) 12906 : audit [DBG] from='client.281289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:21 smithi131 bash[24745]: audit 2024-09-14T03:19:19.672197+0000 mgr.a (mgr.14355) 12906 : audit [DBG] from='client.281289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:21 smithi171 bash[25040]: audit 2024-09-14T03:19:19.672197+0000 mgr.a (mgr.14355) 12906 : audit [DBG] from='client.281289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:22 smithi007 bash[22722]: cluster 2024-09-14T03:19:20.499716+0000 mgr.a (mgr.14355) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:22 smithi131 bash[24745]: cluster 2024-09-14T03:19:20.499716+0000 mgr.a (mgr.14355) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:22 smithi171 bash[25040]: cluster 2024-09-14T03:19:20.499716+0000 mgr.a (mgr.14355) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:24 smithi007 bash[22722]: cluster 2024-09-14T03:19:22.500539+0000 mgr.a (mgr.14355) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:24 smithi131 bash[24745]: cluster 2024-09-14T03:19:22.500539+0000 mgr.a (mgr.14355) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:24 smithi171 bash[25040]: cluster 2024-09-14T03:19:22.500539+0000 mgr.a (mgr.14355) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:25.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:25.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:25.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:25.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:25.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:25.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:25.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:25.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:26 smithi007 bash[22722]: cluster 2024-09-14T03:19:24.501320+0000 mgr.a (mgr.14355) 12909 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:26 smithi131 bash[24745]: cluster 2024-09-14T03:19:24.501320+0000 mgr.a (mgr.14355) 12909 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:26 smithi171 bash[25040]: cluster 2024-09-14T03:19:24.501320+0000 mgr.a (mgr.14355) 12909 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:27 smithi007 bash[22722]: audit 2024-09-14T03:19:25.439612+0000 mgr.a (mgr.14355) 12910 : audit [DBG] from='client.281364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:27 smithi131 bash[24745]: audit 2024-09-14T03:19:25.439612+0000 mgr.a (mgr.14355) 12910 : audit [DBG] from='client.281364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:27 smithi171 bash[25040]: audit 2024-09-14T03:19:25.439612+0000 mgr.a (mgr.14355) 12910 : audit [DBG] from='client.281364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:28 smithi007 bash[22722]: cluster 2024-09-14T03:19:26.504130+0000 mgr.a (mgr.14355) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:28 smithi131 bash[24745]: cluster 2024-09-14T03:19:26.504130+0000 mgr.a (mgr.14355) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:28 smithi171 bash[25040]: cluster 2024-09-14T03:19:26.504130+0000 mgr.a (mgr.14355) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:30 smithi007 bash[22722]: cluster 2024-09-14T03:19:28.504933+0000 mgr.a (mgr.14355) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:30 smithi131 bash[24745]: cluster 2024-09-14T03:19:28.504933+0000 mgr.a (mgr.14355) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:30 smithi171 bash[25040]: cluster 2024-09-14T03:19:28.504933+0000 mgr.a (mgr.14355) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:30.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:30.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:31.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:31.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:32 smithi007 bash[22722]: cluster 2024-09-14T03:19:30.506868+0000 mgr.a (mgr.14355) 12913 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:32 smithi131 bash[24745]: cluster 2024-09-14T03:19:30.506868+0000 mgr.a (mgr.14355) 12913 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:32 smithi171 bash[25040]: cluster 2024-09-14T03:19:30.506868+0000 mgr.a (mgr.14355) 12913 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:33 smithi007 bash[22722]: audit 2024-09-14T03:19:31.199666+0000 mgr.a (mgr.14355) 12914 : audit [DBG] from='client.281442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:33 smithi131 bash[24745]: audit 2024-09-14T03:19:31.199666+0000 mgr.a (mgr.14355) 12914 : audit [DBG] from='client.281442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:33 smithi171 bash[25040]: audit 2024-09-14T03:19:31.199666+0000 mgr.a (mgr.14355) 12914 : audit [DBG] from='client.281442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:34 smithi007 bash[22722]: cluster 2024-09-14T03:19:32.507838+0000 mgr.a (mgr.14355) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:34 smithi131 bash[24745]: cluster 2024-09-14T03:19:32.507838+0000 mgr.a (mgr.14355) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:34 smithi171 bash[25040]: cluster 2024-09-14T03:19:32.507838+0000 mgr.a (mgr.14355) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:19:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:36 smithi007 bash[22722]: cluster 2024-09-14T03:19:34.508660+0000 mgr.a (mgr.14355) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:19:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:36 smithi131 bash[24745]: cluster 2024-09-14T03:19:34.508660+0000 mgr.a (mgr.14355) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:19:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:36 smithi171 bash[25040]: cluster 2024-09-14T03:19:34.508660+0000 mgr.a (mgr.14355) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:19:36.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:37.412 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:38 smithi007 bash[22722]: cluster 2024-09-14T03:19:36.510902+0000 mgr.a (mgr.14355) 12917 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:38 smithi007 bash[22722]: audit 2024-09-14T03:19:36.961645+0000 mgr.a (mgr.14355) 12918 : audit [DBG] from='client.281517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:38 smithi131 bash[24745]: cluster 2024-09-14T03:19:36.510902+0000 mgr.a (mgr.14355) 12917 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:38 smithi131 bash[24745]: audit 2024-09-14T03:19:36.961645+0000 mgr.a (mgr.14355) 12918 : audit [DBG] from='client.281517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:38 smithi171 bash[25040]: cluster 2024-09-14T03:19:36.510902+0000 mgr.a (mgr.14355) 12917 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:38 smithi171 bash[25040]: audit 2024-09-14T03:19:36.961645+0000 mgr.a (mgr.14355) 12918 : audit [DBG] from='client.281517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:40 smithi007 bash[22722]: cluster 2024-09-14T03:19:38.511860+0000 mgr.a (mgr.14355) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:40 smithi131 bash[24745]: cluster 2024-09-14T03:19:38.511860+0000 mgr.a (mgr.14355) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:40 smithi171 bash[25040]: cluster 2024-09-14T03:19:38.511860+0000 mgr.a (mgr.14355) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:42 smithi007 bash[22722]: cluster 2024-09-14T03:19:40.514009+0000 mgr.a (mgr.14355) 12920 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:42 smithi131 bash[24745]: cluster 2024-09-14T03:19:40.514009+0000 mgr.a (mgr.14355) 12920 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:42 smithi171 bash[25040]: cluster 2024-09-14T03:19:40.514009+0000 mgr.a (mgr.14355) 12920 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:43.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:43.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:44 smithi007 bash[22722]: cluster 2024-09-14T03:19:42.514455+0000 mgr.a (mgr.14355) 12921 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:44 smithi007 bash[22722]: audit 2024-09-14T03:19:42.748493+0000 mgr.a (mgr.14355) 12922 : audit [DBG] from='client.281595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:44 smithi131 bash[24745]: cluster 2024-09-14T03:19:42.514455+0000 mgr.a (mgr.14355) 12921 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:44 smithi131 bash[24745]: audit 2024-09-14T03:19:42.748493+0000 mgr.a (mgr.14355) 12922 : audit [DBG] from='client.281595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:44 smithi171 bash[25040]: cluster 2024-09-14T03:19:42.514455+0000 mgr.a (mgr.14355) 12921 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:44 smithi171 bash[25040]: audit 2024-09-14T03:19:42.748493+0000 mgr.a (mgr.14355) 12922 : audit [DBG] from='client.281595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:46.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:46 smithi007 bash[22722]: cluster 2024-09-14T03:19:44.515382+0000 mgr.a (mgr.14355) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:46 smithi131 bash[24745]: cluster 2024-09-14T03:19:44.515382+0000 mgr.a (mgr.14355) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:46 smithi171 bash[25040]: cluster 2024-09-14T03:19:44.515382+0000 mgr.a (mgr.14355) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:47 smithi007 bash[22722]: audit 2024-09-14T03:19:46.704982+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:19:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:47 smithi131 bash[24745]: audit 2024-09-14T03:19:46.704982+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:19:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:47 smithi171 bash[25040]: audit 2024-09-14T03:19:46.704982+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:19:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: cluster 2024-09-14T03:19:46.517612+0000 mgr.a (mgr.14355) 12924 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: audit 2024-09-14T03:19:47.328407+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: audit 2024-09-14T03:19:47.333219+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: audit 2024-09-14T03:19:48.113187+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:19:48.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: audit 2024-09-14T03:19:48.114375+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:19:48.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22722]: audit 2024-09-14T03:19:48.123069+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: cluster 2024-09-14T03:19:46.517612+0000 mgr.a (mgr.14355) 12924 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: audit 2024-09-14T03:19:47.328407+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: audit 2024-09-14T03:19:47.333219+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: audit 2024-09-14T03:19:48.113187+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:19:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: audit 2024-09-14T03:19:48.114375+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:19:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:48 smithi131 bash[24745]: audit 2024-09-14T03:19:48.123069+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: cluster 2024-09-14T03:19:46.517612+0000 mgr.a (mgr.14355) 12924 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:19:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: audit 2024-09-14T03:19:47.328407+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: audit 2024-09-14T03:19:47.333219+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: audit 2024-09-14T03:19:48.113187+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:19:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: audit 2024-09-14T03:19:48.114375+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:19:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:48 smithi171 bash[25040]: audit 2024-09-14T03:19:48.123069+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:19:49.134 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22972]: debug 2024-09-14T03:19:48.851+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:19:49.134 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:19:48 smithi007 bash[22972]: debug 2024-09-14T03:19:48.863+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:19:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:49.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:49.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:49.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:49.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:49 smithi007 bash[22722]: audit 2024-09-14T03:19:48.125437+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:49 smithi007 bash[22722]: audit 2024-09-14T03:19:48.127653+0000 mgr.a (mgr.14355) 12925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:49 smithi131 bash[24745]: audit 2024-09-14T03:19:48.125437+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:49.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:49 smithi131 bash[24745]: audit 2024-09-14T03:19:48.127653+0000 mgr.a (mgr.14355) 12925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:49 smithi171 bash[25040]: audit 2024-09-14T03:19:48.125437+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:49 smithi171 bash[25040]: audit 2024-09-14T03:19:48.127653+0000 mgr.a (mgr.14355) 12925 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:19:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:50 smithi007 bash[22722]: cluster 2024-09-14T03:19:48.518109+0000 mgr.a (mgr.14355) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:50 smithi007 bash[22722]: audit 2024-09-14T03:19:48.523995+0000 mgr.a (mgr.14355) 12927 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:50 smithi007 bash[22722]: audit 2024-09-14T03:19:48.857782+0000 mgr.a (mgr.14355) 12928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:19:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:50 smithi007 bash[22722]: cephadm 2024-09-14T03:19:48.870197+0000 mgr.a (mgr.14355) 12929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:19:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:50 smithi131 bash[24745]: cluster 2024-09-14T03:19:48.518109+0000 mgr.a (mgr.14355) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:50 smithi131 bash[24745]: audit 2024-09-14T03:19:48.523995+0000 mgr.a (mgr.14355) 12927 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:50.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:50 smithi131 bash[24745]: audit 2024-09-14T03:19:48.857782+0000 mgr.a (mgr.14355) 12928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:19:50.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:50 smithi131 bash[24745]: cephadm 2024-09-14T03:19:48.870197+0000 mgr.a (mgr.14355) 12929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:19:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:50 smithi171 bash[25040]: cluster 2024-09-14T03:19:48.518109+0000 mgr.a (mgr.14355) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:19:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:50 smithi171 bash[25040]: audit 2024-09-14T03:19:48.523995+0000 mgr.a (mgr.14355) 12927 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:50 smithi171 bash[25040]: audit 2024-09-14T03:19:48.857782+0000 mgr.a (mgr.14355) 12928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:19:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:50 smithi171 bash[25040]: cephadm 2024-09-14T03:19:48.870197+0000 mgr.a (mgr.14355) 12929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:19:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:52 smithi007 bash[22722]: cluster 2024-09-14T03:19:50.520385+0000 mgr.a (mgr.14355) 12930 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:52 smithi131 bash[24745]: cluster 2024-09-14T03:19:50.520385+0000 mgr.a (mgr.14355) 12930 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:52 smithi171 bash[25040]: cluster 2024-09-14T03:19:50.520385+0000 mgr.a (mgr.14355) 12930 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:19:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:19:54.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:19:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:54 smithi007 bash[22722]: cluster 2024-09-14T03:19:52.521189+0000 mgr.a (mgr.14355) 12931 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:54 smithi131 bash[24745]: cluster 2024-09-14T03:19:52.521189+0000 mgr.a (mgr.14355) 12931 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:54 smithi171 bash[25040]: cluster 2024-09-14T03:19:52.521189+0000 mgr.a (mgr.14355) 12931 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:55.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:19:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:19:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:19:55.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:19:55.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:19:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:56 smithi007 bash[22722]: cluster 2024-09-14T03:19:54.521964+0000 mgr.a (mgr.14355) 12932 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:56 smithi007 bash[22722]: audit 2024-09-14T03:19:54.639031+0000 mgr.a (mgr.14355) 12933 : audit [DBG] from='client.281850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:56 smithi131 bash[24745]: cluster 2024-09-14T03:19:54.521964+0000 mgr.a (mgr.14355) 12932 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:56 smithi131 bash[24745]: audit 2024-09-14T03:19:54.639031+0000 mgr.a (mgr.14355) 12933 : audit [DBG] from='client.281850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:56 smithi171 bash[25040]: cluster 2024-09-14T03:19:54.521964+0000 mgr.a (mgr.14355) 12932 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:56 smithi171 bash[25040]: audit 2024-09-14T03:19:54.639031+0000 mgr.a (mgr.14355) 12933 : audit [DBG] from='client.281850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:19:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:19:58 smithi007 bash[22722]: cluster 2024-09-14T03:19:56.524356+0000 mgr.a (mgr.14355) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:19:58 smithi131 bash[24745]: cluster 2024-09-14T03:19:56.524356+0000 mgr.a (mgr.14355) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:19:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:19:58 smithi171 bash[25040]: cluster 2024-09-14T03:19:56.524356+0000 mgr.a (mgr.14355) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:00.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:00.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:00 smithi007 bash[22722]: cluster 2024-09-14T03:19:58.525151+0000 mgr.a (mgr.14355) 12935 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:00 smithi007 bash[22722]: cluster 2024-09-14T03:20:00.000156+0000 mon.a (mon.0) 2524 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:20:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:00 smithi131 bash[24745]: cluster 2024-09-14T03:19:58.525151+0000 mgr.a (mgr.14355) 12935 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:00 smithi131 bash[24745]: cluster 2024-09-14T03:20:00.000156+0000 mon.a (mon.0) 2524 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:20:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:00 smithi171 bash[25040]: cluster 2024-09-14T03:19:58.525151+0000 mgr.a (mgr.14355) 12935 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:00 smithi171 bash[25040]: cluster 2024-09-14T03:20:00.000156+0000 mon.a (mon.0) 2524 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:20:00.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:00.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:02 smithi007 bash[22722]: audit 2024-09-14T03:20:00.397398+0000 mgr.a (mgr.14355) 12936 : audit [DBG] from='client.281925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:02 smithi007 bash[22722]: cluster 2024-09-14T03:20:00.529228+0000 mgr.a (mgr.14355) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:02 smithi131 bash[24745]: audit 2024-09-14T03:20:00.397398+0000 mgr.a (mgr.14355) 12936 : audit [DBG] from='client.281925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:02 smithi131 bash[24745]: cluster 2024-09-14T03:20:00.529228+0000 mgr.a (mgr.14355) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:02 smithi171 bash[25040]: audit 2024-09-14T03:20:00.397398+0000 mgr.a (mgr.14355) 12936 : audit [DBG] from='client.281925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:02 smithi171 bash[25040]: cluster 2024-09-14T03:20:00.529228+0000 mgr.a (mgr.14355) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:04 smithi007 bash[22722]: cluster 2024-09-14T03:20:02.530125+0000 mgr.a (mgr.14355) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:04 smithi131 bash[24745]: cluster 2024-09-14T03:20:02.530125+0000 mgr.a (mgr.14355) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:04 smithi171 bash[25040]: cluster 2024-09-14T03:20:02.530125+0000 mgr.a (mgr.14355) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:06 smithi007 bash[22722]: cluster 2024-09-14T03:20:04.531075+0000 mgr.a (mgr.14355) 12939 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:06 smithi131 bash[24745]: cluster 2024-09-14T03:20:04.531075+0000 mgr.a (mgr.14355) 12939 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:06 smithi171 bash[25040]: cluster 2024-09-14T03:20:04.531075+0000 mgr.a (mgr.14355) 12939 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:06.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:06.562 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:07 smithi007 bash[22722]: audit 2024-09-14T03:20:06.147704+0000 mgr.a (mgr.14355) 12940 : audit [DBG] from='client.282003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:07 smithi131 bash[24745]: audit 2024-09-14T03:20:06.147704+0000 mgr.a (mgr.14355) 12940 : audit [DBG] from='client.282003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:07 smithi171 bash[25040]: audit 2024-09-14T03:20:06.147704+0000 mgr.a (mgr.14355) 12940 : audit [DBG] from='client.282003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:08 smithi007 bash[22722]: cluster 2024-09-14T03:20:06.532356+0000 mgr.a (mgr.14355) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:08 smithi131 bash[24745]: cluster 2024-09-14T03:20:06.532356+0000 mgr.a (mgr.14355) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:08 smithi171 bash[25040]: cluster 2024-09-14T03:20:06.532356+0000 mgr.a (mgr.14355) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:10 smithi007 bash[22722]: cluster 2024-09-14T03:20:08.533101+0000 mgr.a (mgr.14355) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:10 smithi131 bash[24745]: cluster 2024-09-14T03:20:08.533101+0000 mgr.a (mgr.14355) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:10 smithi171 bash[25040]: cluster 2024-09-14T03:20:08.533101+0000 mgr.a (mgr.14355) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:20:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:11 smithi131 bash[24745]: cluster 2024-09-14T03:20:10.535049+0000 mgr.a (mgr.14355) 12943 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:11 smithi171 bash[25040]: cluster 2024-09-14T03:20:10.535049+0000 mgr.a (mgr.14355) 12943 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:11.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:11.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:11.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:11 smithi007 bash[22722]: cluster 2024-09-14T03:20:10.535049+0000 mgr.a (mgr.14355) 12943 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:12.328 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:12 smithi131 bash[24745]: audit 2024-09-14T03:20:11.895179+0000 mgr.a (mgr.14355) 12944 : audit [DBG] from='client.282081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:12 smithi171 bash[25040]: audit 2024-09-14T03:20:11.895179+0000 mgr.a (mgr.14355) 12944 : audit [DBG] from='client.282081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:12 smithi007 bash[22722]: audit 2024-09-14T03:20:11.895179+0000 mgr.a (mgr.14355) 12944 : audit [DBG] from='client.282081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:13 smithi131 bash[24745]: cluster 2024-09-14T03:20:12.535991+0000 mgr.a (mgr.14355) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:13 smithi171 bash[25040]: cluster 2024-09-14T03:20:12.535991+0000 mgr.a (mgr.14355) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:13 smithi007 bash[22722]: cluster 2024-09-14T03:20:12.535991+0000 mgr.a (mgr.14355) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:15 smithi007 bash[22722]: cluster 2024-09-14T03:20:14.536778+0000 mgr.a (mgr.14355) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:15 smithi131 bash[24745]: cluster 2024-09-14T03:20:14.536778+0000 mgr.a (mgr.14355) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:15 smithi171 bash[25040]: cluster 2024-09-14T03:20:14.536778+0000 mgr.a (mgr.14355) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:17.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:17.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:17 smithi007 bash[22722]: cluster 2024-09-14T03:20:16.539010+0000 mgr.a (mgr.14355) 12947 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:17 smithi131 bash[24745]: cluster 2024-09-14T03:20:16.539010+0000 mgr.a (mgr.14355) 12947 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:17 smithi171 bash[25040]: cluster 2024-09-14T03:20:16.539010+0000 mgr.a (mgr.14355) 12947 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:18.116 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:18 smithi007 bash[22722]: audit 2024-09-14T03:20:17.663576+0000 mgr.a (mgr.14355) 12948 : audit [DBG] from='client.282159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:18 smithi131 bash[24745]: audit 2024-09-14T03:20:17.663576+0000 mgr.a (mgr.14355) 12948 : audit [DBG] from='client.282159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:18 smithi171 bash[25040]: audit 2024-09-14T03:20:17.663576+0000 mgr.a (mgr.14355) 12948 : audit [DBG] from='client.282159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:19 smithi007 bash[22722]: cluster 2024-09-14T03:20:18.540131+0000 mgr.a (mgr.14355) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:19 smithi131 bash[24745]: cluster 2024-09-14T03:20:18.540131+0000 mgr.a (mgr.14355) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:19 smithi171 bash[25040]: cluster 2024-09-14T03:20:18.540131+0000 mgr.a (mgr.14355) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:21 smithi007 bash[22722]: cluster 2024-09-14T03:20:20.542358+0000 mgr.a (mgr.14355) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:21 smithi131 bash[24745]: cluster 2024-09-14T03:20:20.542358+0000 mgr.a (mgr.14355) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:21 smithi171 bash[25040]: cluster 2024-09-14T03:20:20.542358+0000 mgr.a (mgr.14355) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:23.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:23.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:23.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:23.908 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:23 smithi007 bash[22722]: cluster 2024-09-14T03:20:22.543109+0000 mgr.a (mgr.14355) 12951 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:23 smithi131 bash[24745]: cluster 2024-09-14T03:20:22.543109+0000 mgr.a (mgr.14355) 12951 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:23 smithi171 bash[25040]: cluster 2024-09-14T03:20:22.543109+0000 mgr.a (mgr.14355) 12951 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:24 smithi007 bash[22722]: audit 2024-09-14T03:20:23.457634+0000 mgr.a (mgr.14355) 12952 : audit [DBG] from='client.282234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:24 smithi131 bash[24745]: audit 2024-09-14T03:20:23.457634+0000 mgr.a (mgr.14355) 12952 : audit [DBG] from='client.282234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:24 smithi171 bash[25040]: audit 2024-09-14T03:20:23.457634+0000 mgr.a (mgr.14355) 12952 : audit [DBG] from='client.282234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:25 smithi007 bash[22722]: cluster 2024-09-14T03:20:24.544096+0000 mgr.a (mgr.14355) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:25 smithi131 bash[24745]: cluster 2024-09-14T03:20:24.544096+0000 mgr.a (mgr.14355) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:25 smithi171 bash[25040]: cluster 2024-09-14T03:20:24.544096+0000 mgr.a (mgr.14355) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:27 smithi007 bash[22722]: cluster 2024-09-14T03:20:26.546400+0000 mgr.a (mgr.14355) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:27 smithi131 bash[24745]: cluster 2024-09-14T03:20:26.546400+0000 mgr.a (mgr.14355) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:27 smithi171 bash[25040]: cluster 2024-09-14T03:20:26.546400+0000 mgr.a (mgr.14355) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:28.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:28.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:29.686 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:29.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:29 smithi007 bash[22722]: cluster 2024-09-14T03:20:28.547195+0000 mgr.a (mgr.14355) 12955 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:29 smithi131 bash[24745]: cluster 2024-09-14T03:20:28.547195+0000 mgr.a (mgr.14355) 12955 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:29 smithi171 bash[25040]: cluster 2024-09-14T03:20:28.547195+0000 mgr.a (mgr.14355) 12955 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:30 smithi007 bash[22722]: audit 2024-09-14T03:20:29.242827+0000 mgr.a (mgr.14355) 12956 : audit [DBG] from='client.282312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:30 smithi131 bash[24745]: audit 2024-09-14T03:20:29.242827+0000 mgr.a (mgr.14355) 12956 : audit [DBG] from='client.282312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:30 smithi171 bash[25040]: audit 2024-09-14T03:20:29.242827+0000 mgr.a (mgr.14355) 12956 : audit [DBG] from='client.282312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:31 smithi007 bash[22722]: cluster 2024-09-14T03:20:30.549752+0000 mgr.a (mgr.14355) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:31 smithi131 bash[24745]: cluster 2024-09-14T03:20:30.549752+0000 mgr.a (mgr.14355) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:31 smithi171 bash[25040]: cluster 2024-09-14T03:20:30.549752+0000 mgr.a (mgr.14355) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:33 smithi007 bash[22722]: cluster 2024-09-14T03:20:32.550572+0000 mgr.a (mgr.14355) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:33 smithi131 bash[24745]: cluster 2024-09-14T03:20:32.550572+0000 mgr.a (mgr.14355) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:33 smithi171 bash[25040]: cluster 2024-09-14T03:20:32.550572+0000 mgr.a (mgr.14355) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:34.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:34.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:34.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:35.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:35.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:35 smithi007 bash[22722]: cluster 2024-09-14T03:20:34.551346+0000 mgr.a (mgr.14355) 12959 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:35 smithi007 bash[22722]: audit 2024-09-14T03:20:35.026201+0000 mgr.a (mgr.14355) 12960 : audit [DBG] from='client.282390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:35 smithi131 bash[24745]: cluster 2024-09-14T03:20:34.551346+0000 mgr.a (mgr.14355) 12959 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:35 smithi131 bash[24745]: audit 2024-09-14T03:20:35.026201+0000 mgr.a (mgr.14355) 12960 : audit [DBG] from='client.282390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:35 smithi171 bash[25040]: cluster 2024-09-14T03:20:34.551346+0000 mgr.a (mgr.14355) 12959 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:35 smithi171 bash[25040]: audit 2024-09-14T03:20:35.026201+0000 mgr.a (mgr.14355) 12960 : audit [DBG] from='client.282390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:37 smithi007 bash[22722]: cluster 2024-09-14T03:20:36.553717+0000 mgr.a (mgr.14355) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:20:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:37 smithi131 bash[24745]: cluster 2024-09-14T03:20:36.553717+0000 mgr.a (mgr.14355) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:20:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:37 smithi171 bash[25040]: cluster 2024-09-14T03:20:36.553717+0000 mgr.a (mgr.14355) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:20:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:39 smithi007 bash[22722]: cluster 2024-09-14T03:20:38.554536+0000 mgr.a (mgr.14355) 12962 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:20:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:39 smithi131 bash[24745]: cluster 2024-09-14T03:20:38.554536+0000 mgr.a (mgr.14355) 12962 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:20:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:39 smithi171 bash[25040]: cluster 2024-09-14T03:20:38.554536+0000 mgr.a (mgr.14355) 12962 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:20:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:40.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:40.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:41.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:41.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:41.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:41 smithi007 bash[22722]: cluster 2024-09-14T03:20:40.555534+0000 mgr.a (mgr.14355) 12963 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:41 smithi007 bash[22722]: audit 2024-09-14T03:20:40.805330+0000 mgr.a (mgr.14355) 12964 : audit [DBG] from='client.282468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:41 smithi131 bash[24745]: cluster 2024-09-14T03:20:40.555534+0000 mgr.a (mgr.14355) 12963 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:41 smithi131 bash[24745]: audit 2024-09-14T03:20:40.805330+0000 mgr.a (mgr.14355) 12964 : audit [DBG] from='client.282468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:41 smithi171 bash[25040]: cluster 2024-09-14T03:20:40.555534+0000 mgr.a (mgr.14355) 12963 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:41 smithi171 bash[25040]: audit 2024-09-14T03:20:40.805330+0000 mgr.a (mgr.14355) 12964 : audit [DBG] from='client.282468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:43 smithi007 bash[22722]: cluster 2024-09-14T03:20:42.556546+0000 mgr.a (mgr.14355) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:43 smithi131 bash[24745]: cluster 2024-09-14T03:20:42.556546+0000 mgr.a (mgr.14355) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:43 smithi171 bash[25040]: cluster 2024-09-14T03:20:42.556546+0000 mgr.a (mgr.14355) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:45 smithi007 bash[22722]: cluster 2024-09-14T03:20:44.557557+0000 mgr.a (mgr.14355) 12966 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:45 smithi131 bash[24745]: cluster 2024-09-14T03:20:44.557557+0000 mgr.a (mgr.14355) 12966 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:45 smithi171 bash[25040]: cluster 2024-09-14T03:20:44.557557+0000 mgr.a (mgr.14355) 12966 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:20:46.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:46.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:46.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:47.005 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:47.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:47.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:47.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:47.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:47 smithi007 bash[22722]: cluster 2024-09-14T03:20:46.559799+0000 mgr.a (mgr.14355) 12967 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:47 smithi007 bash[22722]: audit 2024-09-14T03:20:46.561915+0000 mgr.a (mgr.14355) 12968 : audit [DBG] from='client.282546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:47 smithi131 bash[24745]: cluster 2024-09-14T03:20:46.559799+0000 mgr.a (mgr.14355) 12967 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:48.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:47 smithi131 bash[24745]: audit 2024-09-14T03:20:46.561915+0000 mgr.a (mgr.14355) 12968 : audit [DBG] from='client.282546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:47 smithi171 bash[25040]: cluster 2024-09-14T03:20:46.559799+0000 mgr.a (mgr.14355) 12967 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:20:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:47 smithi171 bash[25040]: audit 2024-09-14T03:20:46.561915+0000 mgr.a (mgr.14355) 12968 : audit [DBG] from='client.282546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: cluster 2024-09-14T03:20:48.560815+0000 mgr.a (mgr.14355) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: audit 2024-09-14T03:20:48.926339+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:20:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: audit 2024-09-14T03:20:49.527295+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: audit 2024-09-14T03:20:49.534800+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: audit 2024-09-14T03:20:49.539707+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:49 smithi007 bash[22722]: audit 2024-09-14T03:20:49.544741+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: cluster 2024-09-14T03:20:48.560815+0000 mgr.a (mgr.14355) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:20:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: audit 2024-09-14T03:20:48.926339+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:20:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: audit 2024-09-14T03:20:49.527295+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: audit 2024-09-14T03:20:49.534800+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: audit 2024-09-14T03:20:49.539707+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:49 smithi131 bash[24745]: audit 2024-09-14T03:20:49.544741+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: cluster 2024-09-14T03:20:48.560815+0000 mgr.a (mgr.14355) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: audit 2024-09-14T03:20:48.926339+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: audit 2024-09-14T03:20:49.527295+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: audit 2024-09-14T03:20:49.534800+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: audit 2024-09-14T03:20:49.539707+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:49 smithi171 bash[25040]: audit 2024-09-14T03:20:49.544741+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22722]: audit 2024-09-14T03:20:50.196935+0000 mon.a (mon.0) 2530 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:20:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22722]: audit 2024-09-14T03:20:50.198653+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:20:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22722]: audit 2024-09-14T03:20:50.208722+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22722]: audit 2024-09-14T03:20:50.213560+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:50 smithi131 bash[24745]: audit 2024-09-14T03:20:50.196935+0000 mon.a (mon.0) 2530 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:20:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:50 smithi131 bash[24745]: audit 2024-09-14T03:20:50.198653+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:20:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:50 smithi131 bash[24745]: audit 2024-09-14T03:20:50.208722+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:50 smithi131 bash[24745]: audit 2024-09-14T03:20:50.213560+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:50 smithi171 bash[25040]: audit 2024-09-14T03:20:50.196935+0000 mon.a (mon.0) 2530 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:20:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:50 smithi171 bash[25040]: audit 2024-09-14T03:20:50.198653+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:20:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:50 smithi171 bash[25040]: audit 2024-09-14T03:20:50.208722+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:20:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:50 smithi171 bash[25040]: audit 2024-09-14T03:20:50.213560+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:51.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22972]: debug 2024-09-14T03:20:50.946+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:20:51.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:20:50 smithi007 bash[22972]: debug 2024-09-14T03:20:50.950+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:20:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:51 smithi007 bash[22722]: audit 2024-09-14T03:20:50.216061+0000 mgr.a (mgr.14355) 12970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:51 smithi007 bash[22722]: cluster 2024-09-14T03:20:50.562211+0000 mgr.a (mgr.14355) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:51 smithi007 bash[22722]: audit 2024-09-14T03:20:50.953510+0000 mgr.a (mgr.14355) 12972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:20:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:51 smithi007 bash[22722]: cephadm 2024-09-14T03:20:50.954936+0000 mgr.a (mgr.14355) 12973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:20:52.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:52.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:52.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:51 smithi131 bash[24745]: audit 2024-09-14T03:20:50.216061+0000 mgr.a (mgr.14355) 12970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:51 smithi131 bash[24745]: cluster 2024-09-14T03:20:50.562211+0000 mgr.a (mgr.14355) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:51 smithi131 bash[24745]: audit 2024-09-14T03:20:50.953510+0000 mgr.a (mgr.14355) 12972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:20:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:51 smithi131 bash[24745]: cephadm 2024-09-14T03:20:50.954936+0000 mgr.a (mgr.14355) 12973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:20:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:51 smithi171 bash[25040]: audit 2024-09-14T03:20:50.216061+0000 mgr.a (mgr.14355) 12970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:20:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:51 smithi171 bash[25040]: cluster 2024-09-14T03:20:50.562211+0000 mgr.a (mgr.14355) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:20:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:51 smithi171 bash[25040]: audit 2024-09-14T03:20:50.953510+0000 mgr.a (mgr.14355) 12972 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:20:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:51 smithi171 bash[25040]: cephadm 2024-09-14T03:20:50.954936+0000 mgr.a (mgr.14355) 12973 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:20:52.757 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:52.757 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:52.758 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:53 smithi007 bash[22722]: audit 2024-09-14T03:20:52.339270+0000 mgr.a (mgr.14355) 12974 : audit [DBG] from='client.282726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:53 smithi007 bash[22722]: cluster 2024-09-14T03:20:52.562913+0000 mgr.a (mgr.14355) 12975 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:53 smithi131 bash[24745]: audit 2024-09-14T03:20:52.339270+0000 mgr.a (mgr.14355) 12974 : audit [DBG] from='client.282726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:53 smithi131 bash[24745]: cluster 2024-09-14T03:20:52.562913+0000 mgr.a (mgr.14355) 12975 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:53 smithi171 bash[25040]: audit 2024-09-14T03:20:52.339270+0000 mgr.a (mgr.14355) 12974 : audit [DBG] from='client.282726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:53 smithi171 bash[25040]: cluster 2024-09-14T03:20:52.562913+0000 mgr.a (mgr.14355) 12975 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:55 smithi131 bash[24745]: cluster 2024-09-14T03:20:54.563807+0000 mgr.a (mgr.14355) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:55 smithi171 bash[25040]: cluster 2024-09-14T03:20:54.563807+0000 mgr.a (mgr.14355) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:55 smithi007 bash[22722]: cluster 2024-09-14T03:20:54.563807+0000 mgr.a (mgr.14355) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:20:57.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:20:57.759 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:20:57.760 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:20:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:57 smithi131 bash[24745]: cluster 2024-09-14T03:20:56.566083+0000 mgr.a (mgr.14355) 12977 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:57 smithi171 bash[25040]: cluster 2024-09-14T03:20:56.566083+0000 mgr.a (mgr.14355) 12977 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:57 smithi007 bash[22722]: cluster 2024-09-14T03:20:56.566083+0000 mgr.a (mgr.14355) 12977 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:20:58.543 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:20:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:20:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:20:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:20:58.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:20:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:58 smithi131 bash[24745]: audit 2024-09-14T03:20:58.095177+0000 mgr.a (mgr.14355) 12978 : audit [DBG] from='client.282801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:58 smithi171 bash[25040]: audit 2024-09-14T03:20:58.095177+0000 mgr.a (mgr.14355) 12978 : audit [DBG] from='client.282801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:20:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:58 smithi007 bash[22722]: audit 2024-09-14T03:20:58.095177+0000 mgr.a (mgr.14355) 12978 : audit [DBG] from='client.282801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:20:59 smithi131 bash[24745]: cluster 2024-09-14T03:20:58.566935+0000 mgr.a (mgr.14355) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:20:59 smithi171 bash[25040]: cluster 2024-09-14T03:20:58.566935+0000 mgr.a (mgr.14355) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:20:59 smithi007 bash[22722]: cluster 2024-09-14T03:20:58.566935+0000 mgr.a (mgr.14355) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:01 smithi131 bash[24745]: cluster 2024-09-14T03:21:00.569207+0000 mgr.a (mgr.14355) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:01 smithi171 bash[25040]: cluster 2024-09-14T03:21:00.569207+0000 mgr.a (mgr.14355) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:01 smithi007 bash[22722]: cluster 2024-09-14T03:21:00.569207+0000 mgr.a (mgr.14355) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:03.544 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:03.545 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:03 smithi131 bash[24745]: cluster 2024-09-14T03:21:02.569951+0000 mgr.a (mgr.14355) 12981 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:03 smithi171 bash[25040]: cluster 2024-09-14T03:21:02.569951+0000 mgr.a (mgr.14355) 12981 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:03 smithi007 bash[22722]: cluster 2024-09-14T03:21:02.569951+0000 mgr.a (mgr.14355) 12981 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:04.307 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:04.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:04.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:04.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:04.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:04 smithi131 bash[24745]: audit 2024-09-14T03:21:03.875907+0000 mgr.a (mgr.14355) 12982 : audit [DBG] from='client.282879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:04 smithi171 bash[25040]: audit 2024-09-14T03:21:03.875907+0000 mgr.a (mgr.14355) 12982 : audit [DBG] from='client.282879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:04 smithi007 bash[22722]: audit 2024-09-14T03:21:03.875907+0000 mgr.a (mgr.14355) 12982 : audit [DBG] from='client.282879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:05 smithi131 bash[24745]: cluster 2024-09-14T03:21:04.570940+0000 mgr.a (mgr.14355) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:05 smithi171 bash[25040]: cluster 2024-09-14T03:21:04.570940+0000 mgr.a (mgr.14355) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:05 smithi007 bash[22722]: cluster 2024-09-14T03:21:04.570940+0000 mgr.a (mgr.14355) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:21:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:07 smithi131 bash[24745]: cluster 2024-09-14T03:21:06.573211+0000 mgr.a (mgr.14355) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:07 smithi171 bash[25040]: cluster 2024-09-14T03:21:06.573211+0000 mgr.a (mgr.14355) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:07 smithi007 bash[22722]: cluster 2024-09-14T03:21:06.573211+0000 mgr.a (mgr.14355) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:09.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:09.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:09.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:09 smithi131 bash[24745]: cluster 2024-09-14T03:21:08.574004+0000 mgr.a (mgr.14355) 12985 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:09 smithi171 bash[25040]: cluster 2024-09-14T03:21:08.574004+0000 mgr.a (mgr.14355) 12985 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:10.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:09 smithi007 bash[22722]: cluster 2024-09-14T03:21:08.574004+0000 mgr.a (mgr.14355) 12985 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:10 smithi131 bash[24745]: audit 2024-09-14T03:21:09.640440+0000 mgr.a (mgr.14355) 12986 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:10 smithi171 bash[25040]: audit 2024-09-14T03:21:09.640440+0000 mgr.a (mgr.14355) 12986 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:10 smithi007 bash[22722]: audit 2024-09-14T03:21:09.640440+0000 mgr.a (mgr.14355) 12986 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:11 smithi131 bash[24745]: cluster 2024-09-14T03:21:10.576388+0000 mgr.a (mgr.14355) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:11 smithi171 bash[25040]: cluster 2024-09-14T03:21:10.576388+0000 mgr.a (mgr.14355) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:11 smithi007 bash[22722]: cluster 2024-09-14T03:21:10.576388+0000 mgr.a (mgr.14355) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:13 smithi131 bash[24745]: cluster 2024-09-14T03:21:12.577244+0000 mgr.a (mgr.14355) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:13 smithi171 bash[25040]: cluster 2024-09-14T03:21:12.577244+0000 mgr.a (mgr.14355) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:13 smithi007 bash[22722]: cluster 2024-09-14T03:21:12.577244+0000 mgr.a (mgr.14355) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:15.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:15.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:15 smithi131 bash[24745]: cluster 2024-09-14T03:21:14.578050+0000 mgr.a (mgr.14355) 12989 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:15 smithi171 bash[25040]: cluster 2024-09-14T03:21:14.578050+0000 mgr.a (mgr.14355) 12989 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:15 smithi007 bash[22722]: cluster 2024-09-14T03:21:14.578050+0000 mgr.a (mgr.14355) 12989 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:16 smithi131 bash[24745]: audit 2024-09-14T03:21:15.411160+0000 mgr.a (mgr.14355) 12990 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:16 smithi171 bash[25040]: audit 2024-09-14T03:21:15.411160+0000 mgr.a (mgr.14355) 12990 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:16 smithi007 bash[22722]: audit 2024-09-14T03:21:15.411160+0000 mgr.a (mgr.14355) 12990 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:17 smithi131 bash[24745]: cluster 2024-09-14T03:21:16.580742+0000 mgr.a (mgr.14355) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:17 smithi171 bash[25040]: cluster 2024-09-14T03:21:16.580742+0000 mgr.a (mgr.14355) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:17 smithi007 bash[22722]: cluster 2024-09-14T03:21:16.580742+0000 mgr.a (mgr.14355) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:19 smithi131 bash[24745]: cluster 2024-09-14T03:21:18.581512+0000 mgr.a (mgr.14355) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:19 smithi171 bash[25040]: cluster 2024-09-14T03:21:18.581512+0000 mgr.a (mgr.14355) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:19 smithi007 bash[22722]: cluster 2024-09-14T03:21:18.581512+0000 mgr.a (mgr.14355) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:20.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:20.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:20.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:21.615 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:21.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:21.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:21.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:21.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:21 smithi171 bash[25040]: cluster 2024-09-14T03:21:20.583432+0000 mgr.a (mgr.14355) 12993 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:21 smithi171 bash[25040]: audit 2024-09-14T03:21:21.182944+0000 mgr.a (mgr.14355) 12994 : audit [DBG] from='client.283107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:21 smithi007 bash[22722]: cluster 2024-09-14T03:21:20.583432+0000 mgr.a (mgr.14355) 12993 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:21 smithi007 bash[22722]: audit 2024-09-14T03:21:21.182944+0000 mgr.a (mgr.14355) 12994 : audit [DBG] from='client.283107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:21 smithi131 bash[24745]: cluster 2024-09-14T03:21:20.583432+0000 mgr.a (mgr.14355) 12993 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:21 smithi131 bash[24745]: audit 2024-09-14T03:21:21.182944+0000 mgr.a (mgr.14355) 12994 : audit [DBG] from='client.283107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:23 smithi171 bash[25040]: cluster 2024-09-14T03:21:22.584332+0000 mgr.a (mgr.14355) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:23 smithi007 bash[22722]: cluster 2024-09-14T03:21:22.584332+0000 mgr.a (mgr.14355) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:23 smithi131 bash[24745]: cluster 2024-09-14T03:21:22.584332+0000 mgr.a (mgr.14355) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:25 smithi171 bash[25040]: cluster 2024-09-14T03:21:24.585105+0000 mgr.a (mgr.14355) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:21:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:25 smithi007 bash[22722]: cluster 2024-09-14T03:21:24.585105+0000 mgr.a (mgr.14355) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:21:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:25 smithi131 bash[24745]: cluster 2024-09-14T03:21:24.585105+0000 mgr.a (mgr.14355) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:21:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:27.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:27.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:27.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:27.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:27.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:27 smithi007 bash[22722]: cluster 2024-09-14T03:21:26.587318+0000 mgr.a (mgr.14355) 12997 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:27 smithi007 bash[22722]: audit 2024-09-14T03:21:26.950611+0000 mgr.a (mgr.14355) 12998 : audit [DBG] from='client.283185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:27 smithi131 bash[24745]: cluster 2024-09-14T03:21:26.587318+0000 mgr.a (mgr.14355) 12997 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:27 smithi131 bash[24745]: audit 2024-09-14T03:21:26.950611+0000 mgr.a (mgr.14355) 12998 : audit [DBG] from='client.283185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:27 smithi171 bash[25040]: cluster 2024-09-14T03:21:26.587318+0000 mgr.a (mgr.14355) 12997 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:27 smithi171 bash[25040]: audit 2024-09-14T03:21:26.950611+0000 mgr.a (mgr.14355) 12998 : audit [DBG] from='client.283185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:29 smithi007 bash[22722]: cluster 2024-09-14T03:21:28.588201+0000 mgr.a (mgr.14355) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:29 smithi131 bash[24745]: cluster 2024-09-14T03:21:28.588201+0000 mgr.a (mgr.14355) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:29 smithi171 bash[25040]: cluster 2024-09-14T03:21:28.588201+0000 mgr.a (mgr.14355) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:31 smithi007 bash[22722]: cluster 2024-09-14T03:21:30.590377+0000 mgr.a (mgr.14355) 13000 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:31 smithi131 bash[24745]: cluster 2024-09-14T03:21:30.590377+0000 mgr.a (mgr.14355) 13000 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:31 smithi171 bash[25040]: cluster 2024-09-14T03:21:30.590377+0000 mgr.a (mgr.14355) 13000 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:32.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:32.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:33.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:33.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:33 smithi007 bash[22722]: cluster 2024-09-14T03:21:32.591083+0000 mgr.a (mgr.14355) 13001 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:33 smithi007 bash[22722]: audit 2024-09-14T03:21:32.730509+0000 mgr.a (mgr.14355) 13002 : audit [DBG] from='client.283263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:33 smithi131 bash[24745]: cluster 2024-09-14T03:21:32.591083+0000 mgr.a (mgr.14355) 13001 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:33 smithi131 bash[24745]: audit 2024-09-14T03:21:32.730509+0000 mgr.a (mgr.14355) 13002 : audit [DBG] from='client.283263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:33 smithi171 bash[25040]: cluster 2024-09-14T03:21:32.591083+0000 mgr.a (mgr.14355) 13001 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:33 smithi171 bash[25040]: audit 2024-09-14T03:21:32.730509+0000 mgr.a (mgr.14355) 13002 : audit [DBG] from='client.283263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:35 smithi007 bash[22722]: cluster 2024-09-14T03:21:34.591978+0000 mgr.a (mgr.14355) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:35 smithi131 bash[24745]: cluster 2024-09-14T03:21:34.591978+0000 mgr.a (mgr.14355) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:35 smithi171 bash[25040]: cluster 2024-09-14T03:21:34.591978+0000 mgr.a (mgr.14355) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:38.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:38.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:37 smithi007 bash[22722]: cluster 2024-09-14T03:21:36.594199+0000 mgr.a (mgr.14355) 13004 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:37 smithi131 bash[24745]: cluster 2024-09-14T03:21:36.594199+0000 mgr.a (mgr.14355) 13004 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:37 smithi171 bash[25040]: cluster 2024-09-14T03:21:36.594199+0000 mgr.a (mgr.14355) 13004 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:38.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:38.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:39 smithi007 bash[22722]: audit 2024-09-14T03:21:38.495966+0000 mgr.a (mgr.14355) 13005 : audit [DBG] from='client.283341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:39 smithi007 bash[22722]: cluster 2024-09-14T03:21:38.594663+0000 mgr.a (mgr.14355) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:40.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:39 smithi131 bash[24745]: audit 2024-09-14T03:21:38.495966+0000 mgr.a (mgr.14355) 13005 : audit [DBG] from='client.283341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:40.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:39 smithi131 bash[24745]: cluster 2024-09-14T03:21:38.594663+0000 mgr.a (mgr.14355) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:39 smithi171 bash[25040]: audit 2024-09-14T03:21:38.495966+0000 mgr.a (mgr.14355) 13005 : audit [DBG] from='client.283341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:39 smithi171 bash[25040]: cluster 2024-09-14T03:21:38.594663+0000 mgr.a (mgr.14355) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:41 smithi007 bash[22722]: cluster 2024-09-14T03:21:40.596894+0000 mgr.a (mgr.14355) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:41 smithi131 bash[24745]: cluster 2024-09-14T03:21:40.596894+0000 mgr.a (mgr.14355) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:41 smithi171 bash[25040]: cluster 2024-09-14T03:21:40.596894+0000 mgr.a (mgr.14355) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:43.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:43.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:43.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:43 smithi007 bash[22722]: cluster 2024-09-14T03:21:42.597800+0000 mgr.a (mgr.14355) 13008 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:43 smithi131 bash[24745]: cluster 2024-09-14T03:21:42.597800+0000 mgr.a (mgr.14355) 13008 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:43 smithi171 bash[25040]: cluster 2024-09-14T03:21:42.597800+0000 mgr.a (mgr.14355) 13008 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:44.722 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:45 smithi007 bash[22722]: audit 2024-09-14T03:21:44.285168+0000 mgr.a (mgr.14355) 13009 : audit [DBG] from='client.283419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:45 smithi007 bash[22722]: cluster 2024-09-14T03:21:44.598377+0000 mgr.a (mgr.14355) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:45 smithi131 bash[24745]: audit 2024-09-14T03:21:44.285168+0000 mgr.a (mgr.14355) 13009 : audit [DBG] from='client.283419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:45 smithi131 bash[24745]: cluster 2024-09-14T03:21:44.598377+0000 mgr.a (mgr.14355) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:45 smithi171 bash[25040]: audit 2024-09-14T03:21:44.285168+0000 mgr.a (mgr.14355) 13009 : audit [DBG] from='client.283419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:45 smithi171 bash[25040]: cluster 2024-09-14T03:21:44.598377+0000 mgr.a (mgr.14355) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:47 smithi007 bash[22722]: cluster 2024-09-14T03:21:46.601352+0000 mgr.a (mgr.14355) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:47 smithi131 bash[24745]: cluster 2024-09-14T03:21:46.601352+0000 mgr.a (mgr.14355) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:47 smithi171 bash[25040]: cluster 2024-09-14T03:21:46.601352+0000 mgr.a (mgr.14355) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:21:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:49.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:49.724 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:49 smithi007 bash[22722]: cluster 2024-09-14T03:21:48.602193+0000 mgr.a (mgr.14355) 13012 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:49 smithi131 bash[24745]: cluster 2024-09-14T03:21:48.602193+0000 mgr.a (mgr.14355) 13012 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:49 smithi171 bash[25040]: cluster 2024-09-14T03:21:48.602193+0000 mgr.a (mgr.14355) 13012 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:50.499 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:50.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:50.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:50 smithi007 bash[22722]: audit 2024-09-14T03:21:50.058573+0000 mgr.a (mgr.14355) 13013 : audit [DBG] from='client.283497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:50 smithi131 bash[24745]: audit 2024-09-14T03:21:50.058573+0000 mgr.a (mgr.14355) 13013 : audit [DBG] from='client.283497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:50 smithi171 bash[25040]: audit 2024-09-14T03:21:50.058573+0000 mgr.a (mgr.14355) 13013 : audit [DBG] from='client.283497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:51 smithi007 bash[22722]: cluster 2024-09-14T03:21:50.605035+0000 mgr.a (mgr.14355) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:51 smithi007 bash[22722]: audit 2024-09-14T03:21:51.013301+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:21:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:51 smithi131 bash[24745]: cluster 2024-09-14T03:21:50.605035+0000 mgr.a (mgr.14355) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:51 smithi131 bash[24745]: audit 2024-09-14T03:21:51.013301+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:21:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:51 smithi171 bash[25040]: cluster 2024-09-14T03:21:50.605035+0000 mgr.a (mgr.14355) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:21:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:51 smithi171 bash[25040]: audit 2024-09-14T03:21:51.013301+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:21:52.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22972]: debug 2024-09-14T03:21:52.629+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:21:52.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22972]: debug 2024-09-14T03:21:52.629+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22722]: audit 2024-09-14T03:21:51.892180+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22722]: audit 2024-09-14T03:21:51.893708+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22722]: audit 2024-09-14T03:21:51.903763+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22722]: audit 2024-09-14T03:21:51.906320+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:52 smithi007 bash[22722]: audit 2024-09-14T03:21:51.908860+0000 mgr.a (mgr.14355) 13015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:52 smithi131 bash[24745]: audit 2024-09-14T03:21:51.892180+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:21:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:52 smithi131 bash[24745]: audit 2024-09-14T03:21:51.893708+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:21:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:52 smithi131 bash[24745]: audit 2024-09-14T03:21:51.903763+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:21:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:52 smithi131 bash[24745]: audit 2024-09-14T03:21:51.906320+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:52 smithi131 bash[24745]: audit 2024-09-14T03:21:51.908860+0000 mgr.a (mgr.14355) 13015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:52 smithi171 bash[25040]: audit 2024-09-14T03:21:51.892180+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:21:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:52 smithi171 bash[25040]: audit 2024-09-14T03:21:51.893708+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:21:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:52 smithi171 bash[25040]: audit 2024-09-14T03:21:51.903763+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:21:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:52 smithi171 bash[25040]: audit 2024-09-14T03:21:51.906320+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:53.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:52 smithi171 bash[25040]: audit 2024-09-14T03:21:51.908860+0000 mgr.a (mgr.14355) 13015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:21:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:53 smithi007 bash[22722]: cluster 2024-09-14T03:21:52.605549+0000 mgr.a (mgr.14355) 13016 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:53 smithi007 bash[22722]: audit 2024-09-14T03:21:52.632326+0000 mgr.a (mgr.14355) 13017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:21:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:53 smithi007 bash[22722]: cephadm 2024-09-14T03:21:52.633519+0000 mgr.a (mgr.14355) 13018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:21:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:53 smithi131 bash[24745]: cluster 2024-09-14T03:21:52.605549+0000 mgr.a (mgr.14355) 13016 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:53 smithi131 bash[24745]: audit 2024-09-14T03:21:52.632326+0000 mgr.a (mgr.14355) 13017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:21:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:53 smithi131 bash[24745]: cephadm 2024-09-14T03:21:52.633519+0000 mgr.a (mgr.14355) 13018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:21:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:53 smithi171 bash[25040]: cluster 2024-09-14T03:21:52.605549+0000 mgr.a (mgr.14355) 13016 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:53 smithi171 bash[25040]: audit 2024-09-14T03:21:52.632326+0000 mgr.a (mgr.14355) 13017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:21:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:53 smithi171 bash[25040]: cephadm 2024-09-14T03:21:52.633519+0000 mgr.a (mgr.14355) 13018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:21:55.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:21:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:21:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:21:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:55 smithi007 bash[22722]: cluster 2024-09-14T03:21:54.606255+0000 mgr.a (mgr.14355) 13019 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:55 smithi131 bash[24745]: cluster 2024-09-14T03:21:54.606255+0000 mgr.a (mgr.14355) 13019 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:56.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:21:56.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:21:56.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:21:56.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:21:56.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:21:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:55 smithi171 bash[25040]: cluster 2024-09-14T03:21:54.606255+0000 mgr.a (mgr.14355) 13019 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:21:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:56 smithi007 bash[22722]: audit 2024-09-14T03:21:55.838647+0000 mgr.a (mgr.14355) 13020 : audit [DBG] from='client.283683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:56 smithi131 bash[24745]: audit 2024-09-14T03:21:55.838647+0000 mgr.a (mgr.14355) 13020 : audit [DBG] from='client.283683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:56 smithi171 bash[25040]: audit 2024-09-14T03:21:55.838647+0000 mgr.a (mgr.14355) 13020 : audit [DBG] from='client.283683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:21:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:57 smithi007 bash[22722]: cluster 2024-09-14T03:21:56.609131+0000 mgr.a (mgr.14355) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:57 smithi131 bash[24745]: cluster 2024-09-14T03:21:56.609131+0000 mgr.a (mgr.14355) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:21:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:57 smithi171 bash[25040]: cluster 2024-09-14T03:21:56.609131+0000 mgr.a (mgr.14355) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:22:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:21:59 smithi007 bash[22722]: cluster 2024-09-14T03:21:58.609971+0000 mgr.a (mgr.14355) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:22:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:21:59 smithi131 bash[24745]: cluster 2024-09-14T03:21:58.609971+0000 mgr.a (mgr.14355) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:22:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:21:59 smithi171 bash[25040]: cluster 2024-09-14T03:21:58.609971+0000 mgr.a (mgr.14355) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:22:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:02.062 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:02.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:02.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:01 smithi007 bash[22722]: cluster 2024-09-14T03:22:00.611944+0000 mgr.a (mgr.14355) 13023 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:01 smithi131 bash[24745]: cluster 2024-09-14T03:22:00.611944+0000 mgr.a (mgr.14355) 13023 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:01 smithi171 bash[25040]: cluster 2024-09-14T03:22:00.611944+0000 mgr.a (mgr.14355) 13023 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:02 smithi007 bash[22722]: audit 2024-09-14T03:22:01.620635+0000 mgr.a (mgr.14355) 13024 : audit [DBG] from='client.283761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:02 smithi131 bash[24745]: audit 2024-09-14T03:22:01.620635+0000 mgr.a (mgr.14355) 13024 : audit [DBG] from='client.283761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:02 smithi171 bash[25040]: audit 2024-09-14T03:22:01.620635+0000 mgr.a (mgr.14355) 13024 : audit [DBG] from='client.283761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:03 smithi007 bash[22722]: cluster 2024-09-14T03:22:02.612965+0000 mgr.a (mgr.14355) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:03 smithi131 bash[24745]: cluster 2024-09-14T03:22:02.612965+0000 mgr.a (mgr.14355) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:03 smithi171 bash[25040]: cluster 2024-09-14T03:22:02.612965+0000 mgr.a (mgr.14355) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:05 smithi007 bash[22722]: cluster 2024-09-14T03:22:04.613944+0000 mgr.a (mgr.14355) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:05 smithi131 bash[24745]: cluster 2024-09-14T03:22:04.613944+0000 mgr.a (mgr.14355) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:05 smithi171 bash[25040]: cluster 2024-09-14T03:22:04.613944+0000 mgr.a (mgr.14355) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-14T03:22:07.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:07.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:07.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:07.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:07.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:07.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:07 smithi007 bash[22722]: cluster 2024-09-14T03:22:06.616367+0000 mgr.a (mgr.14355) 13027 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T03:22:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:07 smithi131 bash[24745]: cluster 2024-09-14T03:22:06.616367+0000 mgr.a (mgr.14355) 13027 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T03:22:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:07 smithi171 bash[25040]: cluster 2024-09-14T03:22:06.616367+0000 mgr.a (mgr.14355) 13027 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T03:22:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:08 smithi131 bash[24745]: audit 2024-09-14T03:22:07.399132+0000 mgr.a (mgr.14355) 13028 : audit [DBG] from='client.283839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:08 smithi171 bash[25040]: audit 2024-09-14T03:22:07.399132+0000 mgr.a (mgr.14355) 13028 : audit [DBG] from='client.283839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:08 smithi007 bash[22722]: audit 2024-09-14T03:22:07.399132+0000 mgr.a (mgr.14355) 13028 : audit [DBG] from='client.283839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:09 smithi131 bash[24745]: cluster 2024-09-14T03:22:08.617731+0000 mgr.a (mgr.14355) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T03:22:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:09 smithi171 bash[25040]: cluster 2024-09-14T03:22:08.617731+0000 mgr.a (mgr.14355) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T03:22:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:09 smithi007 bash[22722]: cluster 2024-09-14T03:22:08.617731+0000 mgr.a (mgr.14355) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T03:22:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:11 smithi131 bash[24745]: cluster 2024-09-14T03:22:10.620295+0000 mgr.a (mgr.14355) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T03:22:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:11 smithi171 bash[25040]: cluster 2024-09-14T03:22:10.620295+0000 mgr.a (mgr.14355) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T03:22:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:11 smithi007 bash[22722]: cluster 2024-09-14T03:22:10.620295+0000 mgr.a (mgr.14355) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T03:22:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:13.600 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:13 smithi131 bash[24745]: cluster 2024-09-14T03:22:12.621081+0000 mgr.a (mgr.14355) 13031 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:13 smithi131 bash[24745]: audit 2024-09-14T03:22:13.177336+0000 mgr.a (mgr.14355) 13032 : audit [DBG] from='client.283917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:13 smithi171 bash[25040]: cluster 2024-09-14T03:22:12.621081+0000 mgr.a (mgr.14355) 13031 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:13 smithi171 bash[25040]: audit 2024-09-14T03:22:13.177336+0000 mgr.a (mgr.14355) 13032 : audit [DBG] from='client.283917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:13 smithi007 bash[22722]: cluster 2024-09-14T03:22:12.621081+0000 mgr.a (mgr.14355) 13031 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:13 smithi007 bash[22722]: audit 2024-09-14T03:22:13.177336+0000 mgr.a (mgr.14355) 13032 : audit [DBG] from='client.283917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:15 smithi131 bash[24745]: cluster 2024-09-14T03:22:14.621971+0000 mgr.a (mgr.14355) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:15 smithi171 bash[25040]: cluster 2024-09-14T03:22:14.621971+0000 mgr.a (mgr.14355) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:15 smithi007 bash[22722]: cluster 2024-09-14T03:22:14.621971+0000 mgr.a (mgr.14355) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:17 smithi131 bash[24745]: cluster 2024-09-14T03:22:16.624244+0000 mgr.a (mgr.14355) 13034 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:17 smithi171 bash[25040]: cluster 2024-09-14T03:22:16.624244+0000 mgr.a (mgr.14355) 13034 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:17 smithi007 bash[22722]: cluster 2024-09-14T03:22:16.624244+0000 mgr.a (mgr.14355) 13034 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:18.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:18.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:18.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:19.374 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:19.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:19 smithi131 bash[24745]: cluster 2024-09-14T03:22:18.625021+0000 mgr.a (mgr.14355) 13035 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:19 smithi131 bash[24745]: audit 2024-09-14T03:22:18.933122+0000 mgr.a (mgr.14355) 13036 : audit [DBG] from='client.283995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:19 smithi171 bash[25040]: cluster 2024-09-14T03:22:18.625021+0000 mgr.a (mgr.14355) 13035 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:19 smithi171 bash[25040]: audit 2024-09-14T03:22:18.933122+0000 mgr.a (mgr.14355) 13036 : audit [DBG] from='client.283995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:19 smithi007 bash[22722]: cluster 2024-09-14T03:22:18.625021+0000 mgr.a (mgr.14355) 13035 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:19 smithi007 bash[22722]: audit 2024-09-14T03:22:18.933122+0000 mgr.a (mgr.14355) 13036 : audit [DBG] from='client.283995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:21 smithi131 bash[24745]: cluster 2024-09-14T03:22:20.627521+0000 mgr.a (mgr.14355) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:21 smithi171 bash[25040]: cluster 2024-09-14T03:22:20.627521+0000 mgr.a (mgr.14355) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:22.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:21 smithi007 bash[22722]: cluster 2024-09-14T03:22:20.627521+0000 mgr.a (mgr.14355) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:23 smithi131 bash[24745]: cluster 2024-09-14T03:22:22.628360+0000 mgr.a (mgr.14355) 13038 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:23 smithi171 bash[25040]: cluster 2024-09-14T03:22:22.628360+0000 mgr.a (mgr.14355) 13038 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:24.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:24.376 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:24.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:23 smithi007 bash[22722]: cluster 2024-09-14T03:22:22.628360+0000 mgr.a (mgr.14355) 13038 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:25.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:25.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:25 smithi131 bash[24745]: cluster 2024-09-14T03:22:24.628899+0000 mgr.a (mgr.14355) 13039 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:25 smithi131 bash[24745]: audit 2024-09-14T03:22:24.714277+0000 mgr.a (mgr.14355) 13040 : audit [DBG] from='client.284073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:25 smithi171 bash[25040]: cluster 2024-09-14T03:22:24.628899+0000 mgr.a (mgr.14355) 13039 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:25 smithi171 bash[25040]: audit 2024-09-14T03:22:24.714277+0000 mgr.a (mgr.14355) 13040 : audit [DBG] from='client.284073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:25 smithi007 bash[22722]: cluster 2024-09-14T03:22:24.628899+0000 mgr.a (mgr.14355) 13039 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:25 smithi007 bash[22722]: audit 2024-09-14T03:22:24.714277+0000 mgr.a (mgr.14355) 13040 : audit [DBG] from='client.284073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:27 smithi131 bash[24745]: cluster 2024-09-14T03:22:26.631242+0000 mgr.a (mgr.14355) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:27 smithi171 bash[25040]: cluster 2024-09-14T03:22:26.631242+0000 mgr.a (mgr.14355) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:27 smithi007 bash[22722]: cluster 2024-09-14T03:22:26.631242+0000 mgr.a (mgr.14355) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:30.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:30.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:30.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:30 smithi131 bash[24745]: cluster 2024-09-14T03:22:28.632017+0000 mgr.a (mgr.14355) 13042 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:29 smithi171 bash[25040]: cluster 2024-09-14T03:22:28.632017+0000 mgr.a (mgr.14355) 13042 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:29 smithi007 bash[22722]: cluster 2024-09-14T03:22:28.632017+0000 mgr.a (mgr.14355) 13042 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:30.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:30.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:30.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:30.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:30.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:32 smithi131 bash[24745]: audit 2024-09-14T03:22:30.483814+0000 mgr.a (mgr.14355) 13043 : audit [DBG] from='client.284145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:32 smithi131 bash[24745]: cluster 2024-09-14T03:22:30.633410+0000 mgr.a (mgr.14355) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:32 smithi171 bash[25040]: audit 2024-09-14T03:22:30.483814+0000 mgr.a (mgr.14355) 13043 : audit [DBG] from='client.284145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:32 smithi171 bash[25040]: cluster 2024-09-14T03:22:30.633410+0000 mgr.a (mgr.14355) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:32 smithi007 bash[22722]: audit 2024-09-14T03:22:30.483814+0000 mgr.a (mgr.14355) 13043 : audit [DBG] from='client.284145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:32 smithi007 bash[22722]: cluster 2024-09-14T03:22:30.633410+0000 mgr.a (mgr.14355) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-09-14T03:22:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:34 smithi131 bash[24745]: cluster 2024-09-14T03:22:32.634284+0000 mgr.a (mgr.14355) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:34 smithi171 bash[25040]: cluster 2024-09-14T03:22:32.634284+0000 mgr.a (mgr.14355) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:34 smithi007 bash[22722]: cluster 2024-09-14T03:22:32.634284+0000 mgr.a (mgr.14355) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:35.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:35.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:35.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:36 smithi131 bash[24745]: cluster 2024-09-14T03:22:34.635111+0000 mgr.a (mgr.14355) 13046 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:36 smithi171 bash[25040]: cluster 2024-09-14T03:22:34.635111+0000 mgr.a (mgr.14355) 13046 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:36 smithi007 bash[22722]: cluster 2024-09-14T03:22:34.635111+0000 mgr.a (mgr.14355) 13046 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:36.660 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:36.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:36.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:36.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:36.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:38 smithi131 bash[24745]: audit 2024-09-14T03:22:36.235883+0000 mgr.a (mgr.14355) 13047 : audit [DBG] from='client.284223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:38 smithi131 bash[24745]: cluster 2024-09-14T03:22:36.636600+0000 mgr.a (mgr.14355) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:38 smithi171 bash[25040]: audit 2024-09-14T03:22:36.235883+0000 mgr.a (mgr.14355) 13047 : audit [DBG] from='client.284223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:38 smithi171 bash[25040]: cluster 2024-09-14T03:22:36.636600+0000 mgr.a (mgr.14355) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:38 smithi007 bash[22722]: audit 2024-09-14T03:22:36.235883+0000 mgr.a (mgr.14355) 13047 : audit [DBG] from='client.284223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:38 smithi007 bash[22722]: cluster 2024-09-14T03:22:36.636600+0000 mgr.a (mgr.14355) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:40 smithi131 bash[24745]: cluster 2024-09-14T03:22:38.637329+0000 mgr.a (mgr.14355) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:40 smithi171 bash[25040]: cluster 2024-09-14T03:22:38.637329+0000 mgr.a (mgr.14355) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:40 smithi007 bash[22722]: cluster 2024-09-14T03:22:38.637329+0000 mgr.a (mgr.14355) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:22:41.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:41.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:42 smithi131 bash[24745]: cluster 2024-09-14T03:22:40.639343+0000 mgr.a (mgr.14355) 13050 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:42 smithi171 bash[25040]: cluster 2024-09-14T03:22:40.639343+0000 mgr.a (mgr.14355) 13050 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:42.438 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:42.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:42 smithi007 bash[22722]: cluster 2024-09-14T03:22:40.639343+0000 mgr.a (mgr.14355) 13050 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:43 smithi171 bash[25040]: audit 2024-09-14T03:22:41.999011+0000 mgr.a (mgr.14355) 13051 : audit [DBG] from='client.284301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:43 smithi007 bash[22722]: audit 2024-09-14T03:22:41.999011+0000 mgr.a (mgr.14355) 13051 : audit [DBG] from='client.284301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:43 smithi131 bash[24745]: audit 2024-09-14T03:22:41.999011+0000 mgr.a (mgr.14355) 13051 : audit [DBG] from='client.284301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:44 smithi171 bash[25040]: cluster 2024-09-14T03:22:42.640231+0000 mgr.a (mgr.14355) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:44 smithi007 bash[22722]: cluster 2024-09-14T03:22:42.640231+0000 mgr.a (mgr.14355) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:44 smithi131 bash[24745]: cluster 2024-09-14T03:22:42.640231+0000 mgr.a (mgr.14355) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:46 smithi171 bash[25040]: cluster 2024-09-14T03:22:44.641019+0000 mgr.a (mgr.14355) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:46 smithi007 bash[22722]: cluster 2024-09-14T03:22:44.641019+0000 mgr.a (mgr.14355) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:46 smithi131 bash[24745]: cluster 2024-09-14T03:22:44.641019+0000 mgr.a (mgr.14355) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:47.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:47.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:48.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:48 smithi007 bash[22722]: cluster 2024-09-14T03:22:46.643282+0000 mgr.a (mgr.14355) 13054 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:48 smithi131 bash[24745]: cluster 2024-09-14T03:22:46.643282+0000 mgr.a (mgr.14355) 13054 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:48 smithi171 bash[25040]: cluster 2024-09-14T03:22:46.643282+0000 mgr.a (mgr.14355) 13054 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:49 smithi007 bash[22722]: audit 2024-09-14T03:22:47.768118+0000 mgr.a (mgr.14355) 13055 : audit [DBG] from='client.284379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:49 smithi131 bash[24745]: audit 2024-09-14T03:22:47.768118+0000 mgr.a (mgr.14355) 13055 : audit [DBG] from='client.284379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:49 smithi171 bash[25040]: audit 2024-09-14T03:22:47.768118+0000 mgr.a (mgr.14355) 13055 : audit [DBG] from='client.284379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:50 smithi007 bash[22722]: cluster 2024-09-14T03:22:48.644200+0000 mgr.a (mgr.14355) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:50 smithi131 bash[24745]: cluster 2024-09-14T03:22:48.644200+0000 mgr.a (mgr.14355) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:50 smithi171 bash[25040]: cluster 2024-09-14T03:22:48.644200+0000 mgr.a (mgr.14355) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:52 smithi007 bash[22722]: cluster 2024-09-14T03:22:50.646551+0000 mgr.a (mgr.14355) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:52 smithi131 bash[24745]: cluster 2024-09-14T03:22:50.646551+0000 mgr.a (mgr.14355) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:52 smithi171 bash[25040]: cluster 2024-09-14T03:22:50.646551+0000 mgr.a (mgr.14355) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:53.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:53.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:53 smithi007 bash[22722]: audit 2024-09-14T03:22:52.685943+0000 mon.a (mon.0) 2539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:22:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:53 smithi131 bash[24745]: audit 2024-09-14T03:22:52.685943+0000 mon.a (mon.0) 2539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:22:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:53 smithi171 bash[25040]: audit 2024-09-14T03:22:52.685943+0000 mon.a (mon.0) 2539 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:22:53.946 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:53.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:22:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:54 smithi007 bash[22722]: cluster 2024-09-14T03:22:52.647359+0000 mgr.a (mgr.14355) 13058 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:54 smithi131 bash[24745]: cluster 2024-09-14T03:22:52.647359+0000 mgr.a (mgr.14355) 13058 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:54 smithi171 bash[25040]: cluster 2024-09-14T03:22:52.647359+0000 mgr.a (mgr.14355) 13058 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:55 smithi007 bash[22722]: audit 2024-09-14T03:22:53.527939+0000 mgr.a (mgr.14355) 13059 : audit [DBG] from='client.284454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:55 smithi131 bash[24745]: audit 2024-09-14T03:22:53.527939+0000 mgr.a (mgr.14355) 13059 : audit [DBG] from='client.284454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:55 smithi171 bash[25040]: audit 2024-09-14T03:22:53.527939+0000 mgr.a (mgr.14355) 13059 : audit [DBG] from='client.284454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:22:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:56 smithi007 bash[22722]: cluster 2024-09-14T03:22:54.648328+0000 mgr.a (mgr.14355) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:56 smithi131 bash[24745]: cluster 2024-09-14T03:22:54.648328+0000 mgr.a (mgr.14355) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:56 smithi171 bash[25040]: cluster 2024-09-14T03:22:54.648328+0000 mgr.a (mgr.14355) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:22:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:22:58 smithi007 bash[22722]: cluster 2024-09-14T03:22:56.649542+0000 mgr.a (mgr.14355) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:22:58 smithi131 bash[24745]: cluster 2024-09-14T03:22:56.649542+0000 mgr.a (mgr.14355) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:22:58 smithi171 bash[25040]: cluster 2024-09-14T03:22:56.649542+0000 mgr.a (mgr.14355) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:22:58.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:22:58.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:22:58.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:22:59.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:22:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:22:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:22:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:22:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:00 smithi007 bash[22722]: cluster 2024-09-14T03:22:58.650209+0000 mgr.a (mgr.14355) 13062 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:00 smithi131 bash[24745]: cluster 2024-09-14T03:22:58.650209+0000 mgr.a (mgr.14355) 13062 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:00 smithi171 bash[25040]: cluster 2024-09-14T03:22:58.650209+0000 mgr.a (mgr.14355) 13062 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:01 smithi007 bash[22722]: audit 2024-09-14T03:22:59.284556+0000 mgr.a (mgr.14355) 13063 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:01 smithi131 bash[24745]: audit 2024-09-14T03:22:59.284556+0000 mgr.a (mgr.14355) 13063 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:01 smithi171 bash[25040]: audit 2024-09-14T03:22:59.284556+0000 mgr.a (mgr.14355) 13063 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:02 smithi007 bash[22722]: cluster 2024-09-14T03:23:00.652372+0000 mgr.a (mgr.14355) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:02 smithi131 bash[24745]: cluster 2024-09-14T03:23:00.652372+0000 mgr.a (mgr.14355) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:02 smithi171 bash[25040]: cluster 2024-09-14T03:23:00.652372+0000 mgr.a (mgr.14355) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:04.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: cluster 2024-09-14T03:23:02.652908+0000 mgr.a (mgr.14355) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:04.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.620213+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.628643+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.440 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.630965+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:23:04.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.632808+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:23:04.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.643255+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.441 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22722]: audit 2024-09-14T03:23:03.648503+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: cluster 2024-09-14T03:23:02.652908+0000 mgr.a (mgr.14355) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.620213+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.628643+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.630965+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.632808+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.643255+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:04 smithi131 bash[24745]: audit 2024-09-14T03:23:03.648503+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: cluster 2024-09-14T03:23:02.652908+0000 mgr.a (mgr.14355) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.620213+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.628643+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.630965+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.632808+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.643255+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:23:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:04 smithi171 bash[25040]: audit 2024-09-14T03:23:03.648503+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:04.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22972]: debug 2024-09-14T03:23:04.436+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:23:04.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:23:04 smithi007 bash[22972]: debug 2024-09-14T03:23:04.436+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:23:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:05 smithi007 bash[22722]: audit 2024-09-14T03:23:03.650493+0000 mgr.a (mgr.14355) 13066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:05.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:05.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:05.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:05 smithi131 bash[24745]: audit 2024-09-14T03:23:03.650493+0000 mgr.a (mgr.14355) 13066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:05 smithi171 bash[25040]: audit 2024-09-14T03:23:03.650493+0000 mgr.a (mgr.14355) 13066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:23:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:06 smithi007 bash[22722]: audit 2024-09-14T03:23:04.439855+0000 mgr.a (mgr.14355) 13067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:23:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:06 smithi007 bash[22722]: cephadm 2024-09-14T03:23:04.442177+0000 mgr.a (mgr.14355) 13068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:23:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:06 smithi007 bash[22722]: cluster 2024-09-14T03:23:04.653826+0000 mgr.a (mgr.14355) 13069 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:06 smithi007 bash[22722]: audit 2024-09-14T03:23:05.065892+0000 mgr.a (mgr.14355) 13070 : audit [DBG] from='client.284712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:06 smithi131 bash[24745]: audit 2024-09-14T03:23:04.439855+0000 mgr.a (mgr.14355) 13067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:23:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:06 smithi131 bash[24745]: cephadm 2024-09-14T03:23:04.442177+0000 mgr.a (mgr.14355) 13068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:23:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:06 smithi131 bash[24745]: cluster 2024-09-14T03:23:04.653826+0000 mgr.a (mgr.14355) 13069 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:06 smithi131 bash[24745]: audit 2024-09-14T03:23:05.065892+0000 mgr.a (mgr.14355) 13070 : audit [DBG] from='client.284712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:06 smithi171 bash[25040]: audit 2024-09-14T03:23:04.439855+0000 mgr.a (mgr.14355) 13067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:23:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:06 smithi171 bash[25040]: cephadm 2024-09-14T03:23:04.442177+0000 mgr.a (mgr.14355) 13068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:23:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:06 smithi171 bash[25040]: cluster 2024-09-14T03:23:04.653826+0000 mgr.a (mgr.14355) 13069 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:06 smithi171 bash[25040]: audit 2024-09-14T03:23:05.065892+0000 mgr.a (mgr.14355) 13070 : audit [DBG] from='client.284712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:08 smithi007 bash[22722]: cluster 2024-09-14T03:23:06.656718+0000 mgr.a (mgr.14355) 13071 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:08 smithi131 bash[24745]: cluster 2024-09-14T03:23:06.656718+0000 mgr.a (mgr.14355) 13071 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:08 smithi171 bash[25040]: cluster 2024-09-14T03:23:06.656718+0000 mgr.a (mgr.14355) 13071 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:10 smithi007 bash[22722]: cluster 2024-09-14T03:23:08.657753+0000 mgr.a (mgr.14355) 13072 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:10.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:10 smithi131 bash[24745]: cluster 2024-09-14T03:23:08.657753+0000 mgr.a (mgr.14355) 13072 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:10 smithi171 bash[25040]: cluster 2024-09-14T03:23:08.657753+0000 mgr.a (mgr.14355) 13072 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:11.289 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:11.289 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:12 smithi007 bash[22722]: cluster 2024-09-14T03:23:10.659725+0000 mgr.a (mgr.14355) 13073 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:12 smithi007 bash[22722]: audit 2024-09-14T03:23:10.854146+0000 mgr.a (mgr.14355) 13074 : audit [DBG] from='client.284784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:12 smithi131 bash[24745]: cluster 2024-09-14T03:23:10.659725+0000 mgr.a (mgr.14355) 13073 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:12 smithi131 bash[24745]: audit 2024-09-14T03:23:10.854146+0000 mgr.a (mgr.14355) 13074 : audit [DBG] from='client.284784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:12 smithi171 bash[25040]: cluster 2024-09-14T03:23:10.659725+0000 mgr.a (mgr.14355) 13073 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:12 smithi171 bash[25040]: audit 2024-09-14T03:23:10.854146+0000 mgr.a (mgr.14355) 13074 : audit [DBG] from='client.284784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:14.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:14 smithi007 bash[22722]: cluster 2024-09-14T03:23:12.660674+0000 mgr.a (mgr.14355) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:14 smithi131 bash[24745]: cluster 2024-09-14T03:23:12.660674+0000 mgr.a (mgr.14355) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:14 smithi171 bash[25040]: cluster 2024-09-14T03:23:12.660674+0000 mgr.a (mgr.14355) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:16.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:16.291 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:16 smithi007 bash[22722]: cluster 2024-09-14T03:23:14.661505+0000 mgr.a (mgr.14355) 13076 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:16 smithi131 bash[24745]: cluster 2024-09-14T03:23:14.661505+0000 mgr.a (mgr.14355) 13076 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:16 smithi171 bash[25040]: cluster 2024-09-14T03:23:14.661505+0000 mgr.a (mgr.14355) 13076 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:23:17.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:17.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:17.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:17.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:17.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:18 smithi007 bash[22722]: audit 2024-09-14T03:23:16.629144+0000 mgr.a (mgr.14355) 13077 : audit [DBG] from='client.284859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:18 smithi007 bash[22722]: cluster 2024-09-14T03:23:16.664563+0000 mgr.a (mgr.14355) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:18 smithi131 bash[24745]: audit 2024-09-14T03:23:16.629144+0000 mgr.a (mgr.14355) 13077 : audit [DBG] from='client.284859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:18 smithi131 bash[24745]: cluster 2024-09-14T03:23:16.664563+0000 mgr.a (mgr.14355) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:18 smithi171 bash[25040]: audit 2024-09-14T03:23:16.629144+0000 mgr.a (mgr.14355) 13077 : audit [DBG] from='client.284859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:18 smithi171 bash[25040]: cluster 2024-09-14T03:23:16.664563+0000 mgr.a (mgr.14355) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:23:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:20 smithi007 bash[22722]: cluster 2024-09-14T03:23:18.665509+0000 mgr.a (mgr.14355) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:20 smithi131 bash[24745]: cluster 2024-09-14T03:23:18.665509+0000 mgr.a (mgr.14355) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:20 smithi171 bash[25040]: cluster 2024-09-14T03:23:18.665509+0000 mgr.a (mgr.14355) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:22.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:22 smithi007 bash[22722]: cluster 2024-09-14T03:23:20.667705+0000 mgr.a (mgr.14355) 13080 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:22 smithi131 bash[24745]: cluster 2024-09-14T03:23:20.667705+0000 mgr.a (mgr.14355) 13080 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:22 smithi171 bash[25040]: cluster 2024-09-14T03:23:20.667705+0000 mgr.a (mgr.14355) 13080 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:22.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:22.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:24 smithi007 bash[22722]: audit 2024-09-14T03:23:22.412816+0000 mgr.a (mgr.14355) 13081 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:24 smithi007 bash[22722]: cluster 2024-09-14T03:23:22.668233+0000 mgr.a (mgr.14355) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:24 smithi131 bash[24745]: audit 2024-09-14T03:23:22.412816+0000 mgr.a (mgr.14355) 13081 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:24 smithi131 bash[24745]: cluster 2024-09-14T03:23:22.668233+0000 mgr.a (mgr.14355) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:24 smithi171 bash[25040]: audit 2024-09-14T03:23:22.412816+0000 mgr.a (mgr.14355) 13081 : audit [DBG] from='client.284928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:24 smithi171 bash[25040]: cluster 2024-09-14T03:23:22.668233+0000 mgr.a (mgr.14355) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:26 smithi007 bash[22722]: cluster 2024-09-14T03:23:24.669104+0000 mgr.a (mgr.14355) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:26 smithi131 bash[24745]: cluster 2024-09-14T03:23:24.669104+0000 mgr.a (mgr.14355) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:26 smithi171 bash[25040]: cluster 2024-09-14T03:23:24.669104+0000 mgr.a (mgr.14355) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:27.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:27.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:27.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:28 smithi007 bash[22722]: cluster 2024-09-14T03:23:26.671403+0000 mgr.a (mgr.14355) 13084 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:28 smithi131 bash[24745]: cluster 2024-09-14T03:23:26.671403+0000 mgr.a (mgr.14355) 13084 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:28 smithi171 bash[25040]: cluster 2024-09-14T03:23:26.671403+0000 mgr.a (mgr.14355) 13084 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:28.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:29 smithi007 bash[22722]: audit 2024-09-14T03:23:28.161932+0000 mgr.a (mgr.14355) 13085 : audit [DBG] from='client.285006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:29 smithi131 bash[24745]: audit 2024-09-14T03:23:28.161932+0000 mgr.a (mgr.14355) 13085 : audit [DBG] from='client.285006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:29 smithi171 bash[25040]: audit 2024-09-14T03:23:28.161932+0000 mgr.a (mgr.14355) 13085 : audit [DBG] from='client.285006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:30 smithi007 bash[22722]: cluster 2024-09-14T03:23:28.672407+0000 mgr.a (mgr.14355) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:30 smithi131 bash[24745]: cluster 2024-09-14T03:23:28.672407+0000 mgr.a (mgr.14355) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:30 smithi171 bash[25040]: cluster 2024-09-14T03:23:28.672407+0000 mgr.a (mgr.14355) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:32 smithi007 bash[22722]: cluster 2024-09-14T03:23:30.674680+0000 mgr.a (mgr.14355) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:32 smithi131 bash[24745]: cluster 2024-09-14T03:23:30.674680+0000 mgr.a (mgr.14355) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:32 smithi171 bash[25040]: cluster 2024-09-14T03:23:30.674680+0000 mgr.a (mgr.14355) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:34.335 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:34.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:34.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:34.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:34.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:34 smithi007 bash[22722]: cluster 2024-09-14T03:23:32.675460+0000 mgr.a (mgr.14355) 13088 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:34 smithi131 bash[24745]: cluster 2024-09-14T03:23:32.675460+0000 mgr.a (mgr.14355) 13088 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:34 smithi171 bash[25040]: cluster 2024-09-14T03:23:32.675460+0000 mgr.a (mgr.14355) 13088 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:35 smithi007 bash[22722]: audit 2024-09-14T03:23:33.910190+0000 mgr.a (mgr.14355) 13089 : audit [DBG] from='client.285084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:35 smithi131 bash[24745]: audit 2024-09-14T03:23:33.910190+0000 mgr.a (mgr.14355) 13089 : audit [DBG] from='client.285084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:35 smithi171 bash[25040]: audit 2024-09-14T03:23:33.910190+0000 mgr.a (mgr.14355) 13089 : audit [DBG] from='client.285084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:36 smithi007 bash[22722]: cluster 2024-09-14T03:23:34.676452+0000 mgr.a (mgr.14355) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:36 smithi131 bash[24745]: cluster 2024-09-14T03:23:34.676452+0000 mgr.a (mgr.14355) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:36 smithi171 bash[25040]: cluster 2024-09-14T03:23:34.676452+0000 mgr.a (mgr.14355) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:38 smithi007 bash[22722]: cluster 2024-09-14T03:23:36.678751+0000 mgr.a (mgr.14355) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:38 smithi131 bash[24745]: cluster 2024-09-14T03:23:36.678751+0000 mgr.a (mgr.14355) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:38 smithi171 bash[25040]: cluster 2024-09-14T03:23:36.678751+0000 mgr.a (mgr.14355) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:39.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:39.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:39.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:40.088 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:40.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:40.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:40.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:40.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:40 smithi007 bash[22722]: cluster 2024-09-14T03:23:38.679513+0000 mgr.a (mgr.14355) 13092 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:40 smithi131 bash[24745]: cluster 2024-09-14T03:23:38.679513+0000 mgr.a (mgr.14355) 13092 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:40 smithi171 bash[25040]: cluster 2024-09-14T03:23:38.679513+0000 mgr.a (mgr.14355) 13092 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:41 smithi131 bash[24745]: audit 2024-09-14T03:23:39.670697+0000 mgr.a (mgr.14355) 13093 : audit [DBG] from='client.285162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:41 smithi171 bash[25040]: audit 2024-09-14T03:23:39.670697+0000 mgr.a (mgr.14355) 13093 : audit [DBG] from='client.285162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:41 smithi007 bash[22722]: audit 2024-09-14T03:23:39.670697+0000 mgr.a (mgr.14355) 13093 : audit [DBG] from='client.285162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:42 smithi131 bash[24745]: cluster 2024-09-14T03:23:40.682040+0000 mgr.a (mgr.14355) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:42 smithi171 bash[25040]: cluster 2024-09-14T03:23:40.682040+0000 mgr.a (mgr.14355) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:42 smithi007 bash[22722]: cluster 2024-09-14T03:23:40.682040+0000 mgr.a (mgr.14355) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:23:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:44 smithi131 bash[24745]: cluster 2024-09-14T03:23:42.682868+0000 mgr.a (mgr.14355) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:44 smithi171 bash[25040]: cluster 2024-09-14T03:23:42.682868+0000 mgr.a (mgr.14355) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:44 smithi007 bash[22722]: cluster 2024-09-14T03:23:42.682868+0000 mgr.a (mgr.14355) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:45.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:45.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:45.091 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:45.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:46 smithi131 bash[24745]: cluster 2024-09-14T03:23:44.683805+0000 mgr.a (mgr.14355) 13096 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:46 smithi171 bash[25040]: cluster 2024-09-14T03:23:44.683805+0000 mgr.a (mgr.14355) 13096 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:46 smithi007 bash[22722]: cluster 2024-09-14T03:23:44.683805+0000 mgr.a (mgr.14355) 13096 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:47 smithi131 bash[24745]: audit 2024-09-14T03:23:45.421942+0000 mgr.a (mgr.14355) 13097 : audit [DBG] from='client.285240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:47 smithi171 bash[25040]: audit 2024-09-14T03:23:45.421942+0000 mgr.a (mgr.14355) 13097 : audit [DBG] from='client.285240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:47 smithi007 bash[22722]: audit 2024-09-14T03:23:45.421942+0000 mgr.a (mgr.14355) 13097 : audit [DBG] from='client.285240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:48 smithi131 bash[24745]: cluster 2024-09-14T03:23:46.686707+0000 mgr.a (mgr.14355) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:48 smithi171 bash[25040]: cluster 2024-09-14T03:23:46.686707+0000 mgr.a (mgr.14355) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:48 smithi007 bash[22722]: cluster 2024-09-14T03:23:46.686707+0000 mgr.a (mgr.14355) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:49 smithi171 bash[25040]: cluster 2024-09-14T03:23:48.687503+0000 mgr.a (mgr.14355) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:49 smithi007 bash[22722]: cluster 2024-09-14T03:23:48.687503+0000 mgr.a (mgr.14355) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:49 smithi131 bash[24745]: cluster 2024-09-14T03:23:48.687503+0000 mgr.a (mgr.14355) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:51.654 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:51 smithi131 bash[24745]: cluster 2024-09-14T03:23:50.689480+0000 mgr.a (mgr.14355) 13100 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:51 smithi131 bash[24745]: audit 2024-09-14T03:23:51.201355+0000 mgr.a (mgr.14355) 13101 : audit [DBG] from='client.285315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:51 smithi171 bash[25040]: cluster 2024-09-14T03:23:50.689480+0000 mgr.a (mgr.14355) 13100 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:51 smithi171 bash[25040]: audit 2024-09-14T03:23:51.201355+0000 mgr.a (mgr.14355) 13101 : audit [DBG] from='client.285315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:51 smithi007 bash[22722]: cluster 2024-09-14T03:23:50.689480+0000 mgr.a (mgr.14355) 13100 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:51 smithi007 bash[22722]: audit 2024-09-14T03:23:51.201355+0000 mgr.a (mgr.14355) 13101 : audit [DBG] from='client.285315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:53 smithi131 bash[24745]: cluster 2024-09-14T03:23:52.690506+0000 mgr.a (mgr.14355) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:53 smithi171 bash[25040]: cluster 2024-09-14T03:23:52.690506+0000 mgr.a (mgr.14355) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:53 smithi007 bash[22722]: cluster 2024-09-14T03:23:52.690506+0000 mgr.a (mgr.14355) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:23:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:55 smithi131 bash[24745]: cluster 2024-09-14T03:23:54.691331+0000 mgr.a (mgr.14355) 13103 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:23:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:55 smithi171 bash[25040]: cluster 2024-09-14T03:23:54.691331+0000 mgr.a (mgr.14355) 13103 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:23:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:55 smithi007 bash[22722]: cluster 2024-09-14T03:23:54.691331+0000 mgr.a (mgr.14355) 13103 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:23:56.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:23:56.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:23:56.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:23:57.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:23:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:23:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:23:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:23:57.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:23:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:57 smithi131 bash[24745]: cluster 2024-09-14T03:23:56.693588+0000 mgr.a (mgr.14355) 13104 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:23:57 smithi131 bash[24745]: audit 2024-09-14T03:23:56.986897+0000 mgr.a (mgr.14355) 13105 : audit [DBG] from='client.285393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:57 smithi171 bash[25040]: cluster 2024-09-14T03:23:56.693588+0000 mgr.a (mgr.14355) 13104 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:23:57 smithi171 bash[25040]: audit 2024-09-14T03:23:56.986897+0000 mgr.a (mgr.14355) 13105 : audit [DBG] from='client.285393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:23:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:57 smithi007 bash[22722]: cluster 2024-09-14T03:23:56.693588+0000 mgr.a (mgr.14355) 13104 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:23:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:23:57 smithi007 bash[22722]: audit 2024-09-14T03:23:56.986897+0000 mgr.a (mgr.14355) 13105 : audit [DBG] from='client.285393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:00 smithi171 bash[25040]: cluster 2024-09-14T03:23:58.694519+0000 mgr.a (mgr.14355) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:00 smithi007 bash[22722]: cluster 2024-09-14T03:23:58.694519+0000 mgr.a (mgr.14355) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:00 smithi131 bash[24745]: cluster 2024-09-14T03:23:58.694519+0000 mgr.a (mgr.14355) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:02.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:02.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:02 smithi007 bash[22722]: cluster 2024-09-14T03:24:00.696730+0000 mgr.a (mgr.14355) 13107 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:02 smithi131 bash[24745]: cluster 2024-09-14T03:24:00.696730+0000 mgr.a (mgr.14355) 13107 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:02 smithi171 bash[25040]: cluster 2024-09-14T03:24:00.696730+0000 mgr.a (mgr.14355) 13107 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:03.164 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:03.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:04 smithi007 bash[22722]: cluster 2024-09-14T03:24:02.697558+0000 mgr.a (mgr.14355) 13108 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:04 smithi007 bash[22722]: audit 2024-09-14T03:24:02.749473+0000 mgr.a (mgr.14355) 13109 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:04 smithi131 bash[24745]: cluster 2024-09-14T03:24:02.697558+0000 mgr.a (mgr.14355) 13108 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:04 smithi131 bash[24745]: audit 2024-09-14T03:24:02.749473+0000 mgr.a (mgr.14355) 13109 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:04 smithi171 bash[25040]: cluster 2024-09-14T03:24:02.697558+0000 mgr.a (mgr.14355) 13108 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:04 smithi171 bash[25040]: audit 2024-09-14T03:24:02.749473+0000 mgr.a (mgr.14355) 13109 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:05 smithi007 bash[22722]: audit 2024-09-14T03:24:04.535585+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:24:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:05 smithi131 bash[24745]: audit 2024-09-14T03:24:04.535585+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:24:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:05 smithi171 bash[25040]: audit 2024-09-14T03:24:04.535585+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:24:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:06 smithi007 bash[22722]: cluster 2024-09-14T03:24:04.698468+0000 mgr.a (mgr.14355) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:06 smithi131 bash[24745]: cluster 2024-09-14T03:24:04.698468+0000 mgr.a (mgr.14355) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:06 smithi171 bash[25040]: cluster 2024-09-14T03:24:04.698468+0000 mgr.a (mgr.14355) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:08.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:08 smithi007 bash[22722]: cluster 2024-09-14T03:24:06.700732+0000 mgr.a (mgr.14355) 13111 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:08 smithi131 bash[24745]: cluster 2024-09-14T03:24:06.700732+0000 mgr.a (mgr.14355) 13111 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:08 smithi171 bash[25040]: cluster 2024-09-14T03:24:06.700732+0000 mgr.a (mgr.14355) 13111 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:08.935 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:10 smithi007 bash[22722]: audit 2024-09-14T03:24:08.498258+0000 mgr.a (mgr.14355) 13112 : audit [DBG] from='client.285546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:10 smithi007 bash[22722]: cluster 2024-09-14T03:24:08.701303+0000 mgr.a (mgr.14355) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:10.472 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:10 smithi171 bash[25040]: audit 2024-09-14T03:24:08.498258+0000 mgr.a (mgr.14355) 13112 : audit [DBG] from='client.285546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:10.472 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:10 smithi171 bash[25040]: cluster 2024-09-14T03:24:08.701303+0000 mgr.a (mgr.14355) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:10.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:10 smithi131 bash[24745]: audit 2024-09-14T03:24:08.498258+0000 mgr.a (mgr.14355) 13112 : audit [DBG] from='client.285546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:10.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:10 smithi131 bash[24745]: cluster 2024-09-14T03:24:08.701303+0000 mgr.a (mgr.14355) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:12.365 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:12 smithi131 bash[24745]: cluster 2024-09-14T03:24:10.703580+0000 mgr.a (mgr.14355) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:12 smithi007 bash[22722]: cluster 2024-09-14T03:24:10.703580+0000 mgr.a (mgr.14355) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:12 smithi171 bash[25040]: cluster 2024-09-14T03:24:10.703580+0000 mgr.a (mgr.14355) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:13.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:13.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:13.937 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:14.369 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:14 smithi171 bash[25040]: cluster 2024-09-14T03:24:12.704368+0000 mgr.a (mgr.14355) 13115 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:14.371 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:14 smithi131 bash[24745]: cluster 2024-09-14T03:24:12.704368+0000 mgr.a (mgr.14355) 13115 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:14 smithi007 bash[22722]: cluster 2024-09-14T03:24:12.704368+0000 mgr.a (mgr.14355) 13115 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:14.697 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:16.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22972]: debug 2024-09-14T03:24:15.855+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:24:16.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22972]: debug 2024-09-14T03:24:15.855+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:14.269301+0000 mgr.a (mgr.14355) 13116 : audit [DBG] from='client.285624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: cluster 2024-09-14T03:24:14.704919+0000 mgr.a (mgr.14355) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:14.909279+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:14.917273+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.075166+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.083739+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.086050+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.092147+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:24:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.102841+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.108262+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:16.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:15 smithi007 bash[22722]: audit 2024-09-14T03:24:15.111069+0000 mgr.a (mgr.14355) 13118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:14.269301+0000 mgr.a (mgr.14355) 13116 : audit [DBG] from='client.285624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: cluster 2024-09-14T03:24:14.704919+0000 mgr.a (mgr.14355) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:14.909279+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:14.917273+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.075166+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.083739+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.086050+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.092147+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.102841+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.108262+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:15 smithi131 bash[24745]: audit 2024-09-14T03:24:15.111069+0000 mgr.a (mgr.14355) 13118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:14.269301+0000 mgr.a (mgr.14355) 13116 : audit [DBG] from='client.285624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: cluster 2024-09-14T03:24:14.704919+0000 mgr.a (mgr.14355) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:14.909279+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:14.917273+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.075166+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.083739+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.086050+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.092147+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.102841+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:24:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.108262+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:15 smithi171 bash[25040]: audit 2024-09-14T03:24:15.111069+0000 mgr.a (mgr.14355) 13118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:24:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:16 smithi007 bash[22722]: audit 2024-09-14T03:24:15.859627+0000 mgr.a (mgr.14355) 13119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:24:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:16 smithi007 bash[22722]: cephadm 2024-09-14T03:24:15.860875+0000 mgr.a (mgr.14355) 13120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:24:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:16 smithi131 bash[24745]: audit 2024-09-14T03:24:15.859627+0000 mgr.a (mgr.14355) 13119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:24:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:16 smithi131 bash[24745]: cephadm 2024-09-14T03:24:15.860875+0000 mgr.a (mgr.14355) 13120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:24:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:16 smithi171 bash[25040]: audit 2024-09-14T03:24:15.859627+0000 mgr.a (mgr.14355) 13119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:24:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:16 smithi171 bash[25040]: cephadm 2024-09-14T03:24:15.860875+0000 mgr.a (mgr.14355) 13120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:24:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:17 smithi007 bash[22722]: cluster 2024-09-14T03:24:16.707687+0000 mgr.a (mgr.14355) 13121 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:17 smithi131 bash[24745]: cluster 2024-09-14T03:24:16.707687+0000 mgr.a (mgr.14355) 13121 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:17 smithi171 bash[25040]: cluster 2024-09-14T03:24:16.707687+0000 mgr.a (mgr.14355) 13121 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:19.700 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:19 smithi007 bash[22722]: cluster 2024-09-14T03:24:18.708461+0000 mgr.a (mgr.14355) 13122 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:19 smithi131 bash[24745]: cluster 2024-09-14T03:24:18.708461+0000 mgr.a (mgr.14355) 13122 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:19 smithi171 bash[25040]: cluster 2024-09-14T03:24:18.708461+0000 mgr.a (mgr.14355) 13122 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:20.483 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:20.484 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:20 smithi007 bash[22722]: audit 2024-09-14T03:24:20.036110+0000 mgr.a (mgr.14355) 13123 : audit [DBG] from='client.285807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:20 smithi131 bash[24745]: audit 2024-09-14T03:24:20.036110+0000 mgr.a (mgr.14355) 13123 : audit [DBG] from='client.285807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:20 smithi171 bash[25040]: audit 2024-09-14T03:24:20.036110+0000 mgr.a (mgr.14355) 13123 : audit [DBG] from='client.285807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:21 smithi007 bash[22722]: cluster 2024-09-14T03:24:20.711339+0000 mgr.a (mgr.14355) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:21 smithi131 bash[24745]: cluster 2024-09-14T03:24:20.711339+0000 mgr.a (mgr.14355) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:21 smithi171 bash[25040]: cluster 2024-09-14T03:24:20.711339+0000 mgr.a (mgr.14355) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:23 smithi007 bash[22722]: cluster 2024-09-14T03:24:22.712146+0000 mgr.a (mgr.14355) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:23 smithi131 bash[24745]: cluster 2024-09-14T03:24:22.712146+0000 mgr.a (mgr.14355) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:23 smithi171 bash[25040]: cluster 2024-09-14T03:24:22.712146+0000 mgr.a (mgr.14355) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:25.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:25.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:25.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:25 smithi007 bash[22722]: cluster 2024-09-14T03:24:24.712955+0000 mgr.a (mgr.14355) 13126 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:26.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:26.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:25 smithi131 bash[24745]: cluster 2024-09-14T03:24:24.712955+0000 mgr.a (mgr.14355) 13126 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:25 smithi171 bash[25040]: cluster 2024-09-14T03:24:24.712955+0000 mgr.a (mgr.14355) 13126 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:26 smithi007 bash[22722]: audit 2024-09-14T03:24:25.823877+0000 mgr.a (mgr.14355) 13127 : audit [DBG] from='client.285882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:26 smithi131 bash[24745]: audit 2024-09-14T03:24:25.823877+0000 mgr.a (mgr.14355) 13127 : audit [DBG] from='client.285882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:26 smithi171 bash[25040]: audit 2024-09-14T03:24:25.823877+0000 mgr.a (mgr.14355) 13127 : audit [DBG] from='client.285882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:27 smithi131 bash[24745]: cluster 2024-09-14T03:24:26.715833+0000 mgr.a (mgr.14355) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:27 smithi171 bash[25040]: cluster 2024-09-14T03:24:26.715833+0000 mgr.a (mgr.14355) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:27 smithi007 bash[22722]: cluster 2024-09-14T03:24:26.715833+0000 mgr.a (mgr.14355) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:29 smithi131 bash[24745]: cluster 2024-09-14T03:24:28.716829+0000 mgr.a (mgr.14355) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:29 smithi171 bash[25040]: cluster 2024-09-14T03:24:28.716829+0000 mgr.a (mgr.14355) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:29 smithi007 bash[22722]: cluster 2024-09-14T03:24:28.716829+0000 mgr.a (mgr.14355) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:24:31.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:31.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:31.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:32.019 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:32.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:32.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:31 smithi131 bash[24745]: cluster 2024-09-14T03:24:30.718831+0000 mgr.a (mgr.14355) 13130 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:31 smithi171 bash[25040]: cluster 2024-09-14T03:24:30.718831+0000 mgr.a (mgr.14355) 13130 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:31 smithi007 bash[22722]: cluster 2024-09-14T03:24:30.718831+0000 mgr.a (mgr.14355) 13130 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:24:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:32 smithi131 bash[24745]: audit 2024-09-14T03:24:31.597872+0000 mgr.a (mgr.14355) 13131 : audit [DBG] from='client.285957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:32 smithi171 bash[25040]: audit 2024-09-14T03:24:31.597872+0000 mgr.a (mgr.14355) 13131 : audit [DBG] from='client.285957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:32 smithi007 bash[22722]: audit 2024-09-14T03:24:31.597872+0000 mgr.a (mgr.14355) 13131 : audit [DBG] from='client.285957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:33 smithi131 bash[24745]: cluster 2024-09-14T03:24:32.719784+0000 mgr.a (mgr.14355) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:33 smithi171 bash[25040]: cluster 2024-09-14T03:24:32.719784+0000 mgr.a (mgr.14355) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:33 smithi007 bash[22722]: cluster 2024-09-14T03:24:32.719784+0000 mgr.a (mgr.14355) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:35 smithi131 bash[24745]: cluster 2024-09-14T03:24:34.720619+0000 mgr.a (mgr.14355) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:35 smithi171 bash[25040]: cluster 2024-09-14T03:24:34.720619+0000 mgr.a (mgr.14355) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:35 smithi007 bash[22722]: cluster 2024-09-14T03:24:34.720619+0000 mgr.a (mgr.14355) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:37.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:37.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:37.806 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:37.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:37 smithi131 bash[24745]: cluster 2024-09-14T03:24:36.722903+0000 mgr.a (mgr.14355) 13134 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:37 smithi171 bash[25040]: cluster 2024-09-14T03:24:36.722903+0000 mgr.a (mgr.14355) 13134 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:37 smithi007 bash[22722]: cluster 2024-09-14T03:24:36.722903+0000 mgr.a (mgr.14355) 13134 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:38 smithi131 bash[24745]: audit 2024-09-14T03:24:37.355024+0000 mgr.a (mgr.14355) 13135 : audit [DBG] from='client.286035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:38 smithi171 bash[25040]: audit 2024-09-14T03:24:37.355024+0000 mgr.a (mgr.14355) 13135 : audit [DBG] from='client.286035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:38 smithi007 bash[22722]: audit 2024-09-14T03:24:37.355024+0000 mgr.a (mgr.14355) 13135 : audit [DBG] from='client.286035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:40 smithi131 bash[24745]: cluster 2024-09-14T03:24:38.723842+0000 mgr.a (mgr.14355) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:40 smithi171 bash[25040]: cluster 2024-09-14T03:24:38.723842+0000 mgr.a (mgr.14355) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:39 smithi007 bash[22722]: cluster 2024-09-14T03:24:38.723842+0000 mgr.a (mgr.14355) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:42 smithi131 bash[24745]: cluster 2024-09-14T03:24:40.726010+0000 mgr.a (mgr.14355) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:42 smithi171 bash[25040]: cluster 2024-09-14T03:24:40.726010+0000 mgr.a (mgr.14355) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:42 smithi007 bash[22722]: cluster 2024-09-14T03:24:40.726010+0000 mgr.a (mgr.14355) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:42.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:42.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:43.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:43.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:44 smithi131 bash[24745]: cluster 2024-09-14T03:24:42.726785+0000 mgr.a (mgr.14355) 13138 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:44 smithi131 bash[24745]: audit 2024-09-14T03:24:43.149192+0000 mgr.a (mgr.14355) 13139 : audit [DBG] from='client.286110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:44 smithi171 bash[25040]: cluster 2024-09-14T03:24:42.726785+0000 mgr.a (mgr.14355) 13138 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:44 smithi171 bash[25040]: audit 2024-09-14T03:24:43.149192+0000 mgr.a (mgr.14355) 13139 : audit [DBG] from='client.286110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:44 smithi007 bash[22722]: cluster 2024-09-14T03:24:42.726785+0000 mgr.a (mgr.14355) 13138 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:44 smithi007 bash[22722]: audit 2024-09-14T03:24:43.149192+0000 mgr.a (mgr.14355) 13139 : audit [DBG] from='client.286110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:46 smithi131 bash[24745]: cluster 2024-09-14T03:24:44.727634+0000 mgr.a (mgr.14355) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:46 smithi171 bash[25040]: cluster 2024-09-14T03:24:44.727634+0000 mgr.a (mgr.14355) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:46 smithi007 bash[22722]: cluster 2024-09-14T03:24:44.727634+0000 mgr.a (mgr.14355) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:48 smithi131 bash[24745]: cluster 2024-09-14T03:24:46.729906+0000 mgr.a (mgr.14355) 13141 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:48 smithi171 bash[25040]: cluster 2024-09-14T03:24:46.729906+0000 mgr.a (mgr.14355) 13141 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:48 smithi007 bash[22722]: cluster 2024-09-14T03:24:46.729906+0000 mgr.a (mgr.14355) 13141 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:48.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:48.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:48.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:49.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:50 smithi131 bash[24745]: cluster 2024-09-14T03:24:48.730406+0000 mgr.a (mgr.14355) 13142 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:50 smithi131 bash[24745]: audit 2024-09-14T03:24:48.935598+0000 mgr.a (mgr.14355) 13143 : audit [DBG] from='client.286188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:50 smithi007 bash[22722]: cluster 2024-09-14T03:24:48.730406+0000 mgr.a (mgr.14355) 13142 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:50 smithi007 bash[22722]: audit 2024-09-14T03:24:48.935598+0000 mgr.a (mgr.14355) 13143 : audit [DBG] from='client.286188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:50 smithi171 bash[25040]: cluster 2024-09-14T03:24:48.730406+0000 mgr.a (mgr.14355) 13142 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:50 smithi171 bash[25040]: audit 2024-09-14T03:24:48.935598+0000 mgr.a (mgr.14355) 13143 : audit [DBG] from='client.286188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:52 smithi131 bash[24745]: cluster 2024-09-14T03:24:50.732676+0000 mgr.a (mgr.14355) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:52 smithi171 bash[25040]: cluster 2024-09-14T03:24:50.732676+0000 mgr.a (mgr.14355) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:52 smithi007 bash[22722]: cluster 2024-09-14T03:24:50.732676+0000 mgr.a (mgr.14355) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:54 smithi131 bash[24745]: cluster 2024-09-14T03:24:52.733462+0000 mgr.a (mgr.14355) 13145 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:54 smithi171 bash[25040]: cluster 2024-09-14T03:24:52.733462+0000 mgr.a (mgr.14355) 13145 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:54.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:24:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:24:54.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:24:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:54 smithi007 bash[22722]: cluster 2024-09-14T03:24:52.733462+0000 mgr.a (mgr.14355) 13145 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:55.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:24:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:24:55.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:24:55.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:24:55.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:24:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:56 smithi131 bash[24745]: audit 2024-09-14T03:24:54.690266+0000 mgr.a (mgr.14355) 13146 : audit [DBG] from='client.286263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:56 smithi131 bash[24745]: cluster 2024-09-14T03:24:54.734349+0000 mgr.a (mgr.14355) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:56 smithi171 bash[25040]: audit 2024-09-14T03:24:54.690266+0000 mgr.a (mgr.14355) 13146 : audit [DBG] from='client.286263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:56 smithi171 bash[25040]: cluster 2024-09-14T03:24:54.734349+0000 mgr.a (mgr.14355) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:56 smithi007 bash[22722]: audit 2024-09-14T03:24:54.690266+0000 mgr.a (mgr.14355) 13146 : audit [DBG] from='client.286263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:24:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:56 smithi007 bash[22722]: cluster 2024-09-14T03:24:54.734349+0000 mgr.a (mgr.14355) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:24:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:24:58 smithi171 bash[25040]: cluster 2024-09-14T03:24:56.736702+0000 mgr.a (mgr.14355) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:24:58 smithi007 bash[22722]: cluster 2024-09-14T03:24:56.736702+0000 mgr.a (mgr.14355) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:24:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:24:58 smithi131 bash[24745]: cluster 2024-09-14T03:24:56.736702+0000 mgr.a (mgr.14355) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:00.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:00.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:00.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:00 smithi171 bash[25040]: cluster 2024-09-14T03:24:58.737489+0000 mgr.a (mgr.14355) 13149 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:00 smithi007 bash[22722]: cluster 2024-09-14T03:24:58.737489+0000 mgr.a (mgr.14355) 13149 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:00 smithi131 bash[24745]: cluster 2024-09-14T03:24:58.737489+0000 mgr.a (mgr.14355) 13149 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:00.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:00.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:00.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:00.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:00.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:02 smithi171 bash[25040]: audit 2024-09-14T03:25:00.434223+0000 mgr.a (mgr.14355) 13150 : audit [DBG] from='client.286338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:02 smithi171 bash[25040]: cluster 2024-09-14T03:25:00.746344+0000 mgr.a (mgr.14355) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:02 smithi007 bash[22722]: audit 2024-09-14T03:25:00.434223+0000 mgr.a (mgr.14355) 13150 : audit [DBG] from='client.286338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:02 smithi007 bash[22722]: cluster 2024-09-14T03:25:00.746344+0000 mgr.a (mgr.14355) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:02 smithi131 bash[24745]: audit 2024-09-14T03:25:00.434223+0000 mgr.a (mgr.14355) 13150 : audit [DBG] from='client.286338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:02 smithi131 bash[24745]: cluster 2024-09-14T03:25:00.746344+0000 mgr.a (mgr.14355) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:04 smithi007 bash[22722]: cluster 2024-09-14T03:25:02.747084+0000 mgr.a (mgr.14355) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:04 smithi131 bash[24745]: cluster 2024-09-14T03:25:02.747084+0000 mgr.a (mgr.14355) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:04 smithi171 bash[25040]: cluster 2024-09-14T03:25:02.747084+0000 mgr.a (mgr.14355) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:05.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:05.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:05.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:06 smithi007 bash[22722]: cluster 2024-09-14T03:25:04.747846+0000 mgr.a (mgr.14355) 13153 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:06 smithi131 bash[24745]: cluster 2024-09-14T03:25:04.747846+0000 mgr.a (mgr.14355) 13153 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:06 smithi171 bash[25040]: cluster 2024-09-14T03:25:04.747846+0000 mgr.a (mgr.14355) 13153 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:06.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:06.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:07 smithi007 bash[22722]: audit 2024-09-14T03:25:06.185796+0000 mgr.a (mgr.14355) 13154 : audit [DBG] from='client.286416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:07 smithi131 bash[24745]: audit 2024-09-14T03:25:06.185796+0000 mgr.a (mgr.14355) 13154 : audit [DBG] from='client.286416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:07 smithi171 bash[25040]: audit 2024-09-14T03:25:06.185796+0000 mgr.a (mgr.14355) 13154 : audit [DBG] from='client.286416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:08 smithi007 bash[22722]: cluster 2024-09-14T03:25:06.750662+0000 mgr.a (mgr.14355) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:08 smithi131 bash[24745]: cluster 2024-09-14T03:25:06.750662+0000 mgr.a (mgr.14355) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:08 smithi171 bash[25040]: cluster 2024-09-14T03:25:06.750662+0000 mgr.a (mgr.14355) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:10 smithi007 bash[22722]: cluster 2024-09-14T03:25:08.751452+0000 mgr.a (mgr.14355) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:10 smithi131 bash[24745]: cluster 2024-09-14T03:25:08.751452+0000 mgr.a (mgr.14355) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:10 smithi171 bash[25040]: cluster 2024-09-14T03:25:08.751452+0000 mgr.a (mgr.14355) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:11.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:11.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:12.412 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:12.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:12.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:12 smithi007 bash[22722]: cluster 2024-09-14T03:25:10.753419+0000 mgr.a (mgr.14355) 13157 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:12 smithi131 bash[24745]: cluster 2024-09-14T03:25:10.753419+0000 mgr.a (mgr.14355) 13157 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:12 smithi171 bash[25040]: cluster 2024-09-14T03:25:10.753419+0000 mgr.a (mgr.14355) 13157 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:13 smithi007 bash[22722]: audit 2024-09-14T03:25:11.966743+0000 mgr.a (mgr.14355) 13158 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:13 smithi131 bash[24745]: audit 2024-09-14T03:25:11.966743+0000 mgr.a (mgr.14355) 13158 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:13 smithi171 bash[25040]: audit 2024-09-14T03:25:11.966743+0000 mgr.a (mgr.14355) 13158 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:14 smithi007 bash[22722]: cluster 2024-09-14T03:25:12.754486+0000 mgr.a (mgr.14355) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:14 smithi131 bash[24745]: cluster 2024-09-14T03:25:12.754486+0000 mgr.a (mgr.14355) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:14 smithi171 bash[25040]: cluster 2024-09-14T03:25:12.754486+0000 mgr.a (mgr.14355) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:16 smithi007 bash[22722]: cluster 2024-09-14T03:25:14.755322+0000 mgr.a (mgr.14355) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:16 smithi007 bash[22722]: audit 2024-09-14T03:25:15.915254+0000 mon.a (mon.0) 2555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:25:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:16 smithi131 bash[24745]: cluster 2024-09-14T03:25:14.755322+0000 mgr.a (mgr.14355) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:16 smithi131 bash[24745]: audit 2024-09-14T03:25:15.915254+0000 mon.a (mon.0) 2555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:25:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:16 smithi171 bash[25040]: cluster 2024-09-14T03:25:14.755322+0000 mgr.a (mgr.14355) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:16 smithi171 bash[25040]: audit 2024-09-14T03:25:15.915254+0000 mon.a (mon.0) 2555 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:25:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:17.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:17.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22722]: audit 2024-09-14T03:25:16.746956+0000 mon.a (mon.0) 2556 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:25:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22722]: audit 2024-09-14T03:25:16.748671+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:25:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22722]: audit 2024-09-14T03:25:16.757133+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:25:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22722]: audit 2024-09-14T03:25:16.761976+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:17 smithi131 bash[24745]: audit 2024-09-14T03:25:16.746956+0000 mon.a (mon.0) 2556 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:25:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:17 smithi131 bash[24745]: audit 2024-09-14T03:25:16.748671+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:25:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:17 smithi131 bash[24745]: audit 2024-09-14T03:25:16.757133+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:25:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:17 smithi131 bash[24745]: audit 2024-09-14T03:25:16.761976+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:17 smithi171 bash[25040]: audit 2024-09-14T03:25:16.746956+0000 mon.a (mon.0) 2556 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:25:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:17 smithi171 bash[25040]: audit 2024-09-14T03:25:16.748671+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:25:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:17 smithi171 bash[25040]: audit 2024-09-14T03:25:16.757133+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:25:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:17 smithi171 bash[25040]: audit 2024-09-14T03:25:16.761976+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:17.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22972]: debug 2024-09-14T03:25:17.506+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:25:17.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:25:17 smithi007 bash[22972]: debug 2024-09-14T03:25:17.506+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:25:18.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:18 smithi007 bash[22722]: cluster 2024-09-14T03:25:16.757509+0000 mgr.a (mgr.14355) 13161 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:18 smithi007 bash[22722]: audit 2024-09-14T03:25:16.764212+0000 mgr.a (mgr.14355) 13162 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:18 smithi131 bash[24745]: cluster 2024-09-14T03:25:16.757509+0000 mgr.a (mgr.14355) 13161 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:18 smithi131 bash[24745]: audit 2024-09-14T03:25:16.764212+0000 mgr.a (mgr.14355) 13162 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:18 smithi171 bash[25040]: cluster 2024-09-14T03:25:16.757509+0000 mgr.a (mgr.14355) 13161 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:18 smithi171 bash[25040]: audit 2024-09-14T03:25:16.764212+0000 mgr.a (mgr.14355) 13162 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:25:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:19 smithi007 bash[22722]: audit 2024-09-14T03:25:17.508412+0000 mgr.a (mgr.14355) 13163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:25:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:19 smithi007 bash[22722]: cephadm 2024-09-14T03:25:17.509593+0000 mgr.a (mgr.14355) 13164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:25:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:19 smithi007 bash[22722]: audit 2024-09-14T03:25:17.725176+0000 mgr.a (mgr.14355) 13165 : audit [DBG] from='client.286677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:19 smithi131 bash[24745]: audit 2024-09-14T03:25:17.508412+0000 mgr.a (mgr.14355) 13163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:25:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:19 smithi131 bash[24745]: cephadm 2024-09-14T03:25:17.509593+0000 mgr.a (mgr.14355) 13164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:25:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:19 smithi131 bash[24745]: audit 2024-09-14T03:25:17.725176+0000 mgr.a (mgr.14355) 13165 : audit [DBG] from='client.286677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:19 smithi171 bash[25040]: audit 2024-09-14T03:25:17.508412+0000 mgr.a (mgr.14355) 13163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:25:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:19 smithi171 bash[25040]: cephadm 2024-09-14T03:25:17.509593+0000 mgr.a (mgr.14355) 13164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:25:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:19 smithi171 bash[25040]: audit 2024-09-14T03:25:17.725176+0000 mgr.a (mgr.14355) 13165 : audit [DBG] from='client.286677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:20 smithi007 bash[22722]: cluster 2024-09-14T03:25:18.758422+0000 mgr.a (mgr.14355) 13166 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:20 smithi131 bash[24745]: cluster 2024-09-14T03:25:18.758422+0000 mgr.a (mgr.14355) 13166 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:20 smithi171 bash[25040]: cluster 2024-09-14T03:25:18.758422+0000 mgr.a (mgr.14355) 13166 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:22 smithi007 bash[22722]: cluster 2024-09-14T03:25:20.760564+0000 mgr.a (mgr.14355) 13167 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:22 smithi131 bash[24745]: cluster 2024-09-14T03:25:20.760564+0000 mgr.a (mgr.14355) 13167 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:22 smithi171 bash[25040]: cluster 2024-09-14T03:25:20.760564+0000 mgr.a (mgr.14355) 13167 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:23.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:23.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:23.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:23.902 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:23.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:23.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:23.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:23.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:24 smithi007 bash[22722]: cluster 2024-09-14T03:25:22.761318+0000 mgr.a (mgr.14355) 13168 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:24 smithi131 bash[24745]: cluster 2024-09-14T03:25:22.761318+0000 mgr.a (mgr.14355) 13168 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:24 smithi171 bash[25040]: cluster 2024-09-14T03:25:22.761318+0000 mgr.a (mgr.14355) 13168 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:25 smithi007 bash[22722]: audit 2024-09-14T03:25:23.475470+0000 mgr.a (mgr.14355) 13169 : audit [DBG] from='client.286755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:25 smithi131 bash[24745]: audit 2024-09-14T03:25:23.475470+0000 mgr.a (mgr.14355) 13169 : audit [DBG] from='client.286755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:25 smithi171 bash[25040]: audit 2024-09-14T03:25:23.475470+0000 mgr.a (mgr.14355) 13169 : audit [DBG] from='client.286755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:26 smithi007 bash[22722]: cluster 2024-09-14T03:25:24.762212+0000 mgr.a (mgr.14355) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:26 smithi131 bash[24745]: cluster 2024-09-14T03:25:24.762212+0000 mgr.a (mgr.14355) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:26 smithi171 bash[25040]: cluster 2024-09-14T03:25:24.762212+0000 mgr.a (mgr.14355) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:28 smithi007 bash[22722]: cluster 2024-09-14T03:25:26.764456+0000 mgr.a (mgr.14355) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:28 smithi131 bash[24745]: cluster 2024-09-14T03:25:26.764456+0000 mgr.a (mgr.14355) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:28 smithi171 bash[25040]: cluster 2024-09-14T03:25:26.764456+0000 mgr.a (mgr.14355) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:28.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:28.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:28.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:29.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:29.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:29.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:29.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:29.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:30 smithi007 bash[22722]: cluster 2024-09-14T03:25:28.765223+0000 mgr.a (mgr.14355) 13172 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:30 smithi007 bash[22722]: audit 2024-09-14T03:25:29.241662+0000 mgr.a (mgr.14355) 13173 : audit [DBG] from='client.286833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:30 smithi131 bash[24745]: cluster 2024-09-14T03:25:28.765223+0000 mgr.a (mgr.14355) 13172 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:30 smithi131 bash[24745]: audit 2024-09-14T03:25:29.241662+0000 mgr.a (mgr.14355) 13173 : audit [DBG] from='client.286833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:30 smithi171 bash[25040]: cluster 2024-09-14T03:25:28.765223+0000 mgr.a (mgr.14355) 13172 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:30 smithi171 bash[25040]: audit 2024-09-14T03:25:29.241662+0000 mgr.a (mgr.14355) 13173 : audit [DBG] from='client.286833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:32 smithi007 bash[22722]: cluster 2024-09-14T03:25:30.767544+0000 mgr.a (mgr.14355) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:32 smithi131 bash[24745]: cluster 2024-09-14T03:25:30.767544+0000 mgr.a (mgr.14355) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:32 smithi171 bash[25040]: cluster 2024-09-14T03:25:30.767544+0000 mgr.a (mgr.14355) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:25:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:34 smithi007 bash[22722]: cluster 2024-09-14T03:25:32.768314+0000 mgr.a (mgr.14355) 13175 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:34 smithi131 bash[24745]: cluster 2024-09-14T03:25:32.768314+0000 mgr.a (mgr.14355) 13175 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:34 smithi171 bash[25040]: cluster 2024-09-14T03:25:32.768314+0000 mgr.a (mgr.14355) 13175 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:34.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:34.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:34.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:35.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:35.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:36 smithi007 bash[22722]: cluster 2024-09-14T03:25:34.769040+0000 mgr.a (mgr.14355) 13176 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:36 smithi007 bash[22722]: audit 2024-09-14T03:25:35.013354+0000 mgr.a (mgr.14355) 13177 : audit [DBG] from='client.286908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:36 smithi131 bash[24745]: cluster 2024-09-14T03:25:34.769040+0000 mgr.a (mgr.14355) 13176 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:36 smithi131 bash[24745]: audit 2024-09-14T03:25:35.013354+0000 mgr.a (mgr.14355) 13177 : audit [DBG] from='client.286908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:36 smithi171 bash[25040]: cluster 2024-09-14T03:25:34.769040+0000 mgr.a (mgr.14355) 13176 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:36 smithi171 bash[25040]: audit 2024-09-14T03:25:35.013354+0000 mgr.a (mgr.14355) 13177 : audit [DBG] from='client.286908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:38 smithi007 bash[22722]: cluster 2024-09-14T03:25:36.771794+0000 mgr.a (mgr.14355) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:38 smithi131 bash[24745]: cluster 2024-09-14T03:25:36.771794+0000 mgr.a (mgr.14355) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:38 smithi171 bash[25040]: cluster 2024-09-14T03:25:36.771794+0000 mgr.a (mgr.14355) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:40 smithi007 bash[22722]: cluster 2024-09-14T03:25:38.772590+0000 mgr.a (mgr.14355) 13179 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:40.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:40 smithi131 bash[24745]: cluster 2024-09-14T03:25:38.772590+0000 mgr.a (mgr.14355) 13179 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:40.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:40 smithi171 bash[25040]: cluster 2024-09-14T03:25:38.772590+0000 mgr.a (mgr.14355) 13179 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:41.198 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:41.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:41.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:41.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:42 smithi007 bash[22722]: cluster 2024-09-14T03:25:40.774500+0000 mgr.a (mgr.14355) 13180 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:42 smithi007 bash[22722]: audit 2024-09-14T03:25:40.787037+0000 mgr.a (mgr.14355) 13181 : audit [DBG] from='client.286986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:42 smithi131 bash[24745]: cluster 2024-09-14T03:25:40.774500+0000 mgr.a (mgr.14355) 13180 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:42 smithi131 bash[24745]: audit 2024-09-14T03:25:40.787037+0000 mgr.a (mgr.14355) 13181 : audit [DBG] from='client.286986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:42 smithi171 bash[25040]: cluster 2024-09-14T03:25:40.774500+0000 mgr.a (mgr.14355) 13180 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:42 smithi171 bash[25040]: audit 2024-09-14T03:25:40.787037+0000 mgr.a (mgr.14355) 13181 : audit [DBG] from='client.286986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:44 smithi007 bash[22722]: cluster 2024-09-14T03:25:42.775340+0000 mgr.a (mgr.14355) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:44 smithi131 bash[24745]: cluster 2024-09-14T03:25:42.775340+0000 mgr.a (mgr.14355) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:44 smithi171 bash[25040]: cluster 2024-09-14T03:25:42.775340+0000 mgr.a (mgr.14355) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:25:46.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:46.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:46.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:46 smithi007 bash[22722]: cluster 2024-09-14T03:25:44.776120+0000 mgr.a (mgr.14355) 13183 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:25:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:46 smithi131 bash[24745]: cluster 2024-09-14T03:25:44.776120+0000 mgr.a (mgr.14355) 13183 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:25:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:46 smithi171 bash[25040]: cluster 2024-09-14T03:25:44.776120+0000 mgr.a (mgr.14355) 13183 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:25:46.949 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:46.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:48 smithi007 bash[22722]: audit 2024-09-14T03:25:46.525495+0000 mgr.a (mgr.14355) 13184 : audit [DBG] from='client.287061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:48 smithi007 bash[22722]: cluster 2024-09-14T03:25:46.777443+0000 mgr.a (mgr.14355) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:48 smithi131 bash[24745]: audit 2024-09-14T03:25:46.525495+0000 mgr.a (mgr.14355) 13184 : audit [DBG] from='client.287061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:48 smithi131 bash[24745]: cluster 2024-09-14T03:25:46.777443+0000 mgr.a (mgr.14355) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:48 smithi171 bash[25040]: audit 2024-09-14T03:25:46.525495+0000 mgr.a (mgr.14355) 13184 : audit [DBG] from='client.287061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:48 smithi171 bash[25040]: cluster 2024-09-14T03:25:46.777443+0000 mgr.a (mgr.14355) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:50 smithi007 bash[22722]: cluster 2024-09-14T03:25:48.778334+0000 mgr.a (mgr.14355) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:50 smithi131 bash[24745]: cluster 2024-09-14T03:25:48.778334+0000 mgr.a (mgr.14355) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:50 smithi171 bash[25040]: cluster 2024-09-14T03:25:48.778334+0000 mgr.a (mgr.14355) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:51.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:51.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:51.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:52 smithi007 bash[22722]: cluster 2024-09-14T03:25:50.780524+0000 mgr.a (mgr.14355) 13187 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:52 smithi131 bash[24745]: cluster 2024-09-14T03:25:50.780524+0000 mgr.a (mgr.14355) 13187 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:52 smithi171 bash[25040]: cluster 2024-09-14T03:25:50.780524+0000 mgr.a (mgr.14355) 13187 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:52.730 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:52.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:54 smithi007 bash[22722]: audit 2024-09-14T03:25:52.292040+0000 mgr.a (mgr.14355) 13188 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:54 smithi007 bash[22722]: cluster 2024-09-14T03:25:52.781479+0000 mgr.a (mgr.14355) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:54 smithi131 bash[24745]: audit 2024-09-14T03:25:52.292040+0000 mgr.a (mgr.14355) 13188 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:54 smithi131 bash[24745]: cluster 2024-09-14T03:25:52.781479+0000 mgr.a (mgr.14355) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:54 smithi171 bash[25040]: audit 2024-09-14T03:25:52.292040+0000 mgr.a (mgr.14355) 13188 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:54 smithi171 bash[25040]: cluster 2024-09-14T03:25:52.781479+0000 mgr.a (mgr.14355) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:56 smithi007 bash[22722]: cluster 2024-09-14T03:25:54.782278+0000 mgr.a (mgr.14355) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:56 smithi131 bash[24745]: cluster 2024-09-14T03:25:54.782278+0000 mgr.a (mgr.14355) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:56 smithi171 bash[25040]: cluster 2024-09-14T03:25:54.782278+0000 mgr.a (mgr.14355) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:25:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:25:57.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:25:57.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:25:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:58 smithi007 bash[22722]: cluster 2024-09-14T03:25:56.784528+0000 mgr.a (mgr.14355) 13191 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:58.515 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:25:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:25:58.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:25:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:25:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:25:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:58 smithi131 bash[24745]: cluster 2024-09-14T03:25:56.784528+0000 mgr.a (mgr.14355) 13191 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:58 smithi171 bash[25040]: cluster 2024-09-14T03:25:56.784528+0000 mgr.a (mgr.14355) 13191 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:25:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:25:59 smithi007 bash[22722]: audit 2024-09-14T03:25:58.067392+0000 mgr.a (mgr.14355) 13192 : audit [DBG] from='client.287214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:25:59 smithi131 bash[24745]: audit 2024-09-14T03:25:58.067392+0000 mgr.a (mgr.14355) 13192 : audit [DBG] from='client.287214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:25:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:25:59 smithi171 bash[25040]: audit 2024-09-14T03:25:58.067392+0000 mgr.a (mgr.14355) 13192 : audit [DBG] from='client.287214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:00 smithi007 bash[22722]: cluster 2024-09-14T03:25:58.785409+0000 mgr.a (mgr.14355) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:00 smithi131 bash[24745]: cluster 2024-09-14T03:25:58.785409+0000 mgr.a (mgr.14355) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:00 smithi171 bash[25040]: cluster 2024-09-14T03:25:58.785409+0000 mgr.a (mgr.14355) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:02 smithi007 bash[22722]: cluster 2024-09-14T03:26:00.787651+0000 mgr.a (mgr.14355) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:02 smithi131 bash[24745]: cluster 2024-09-14T03:26:00.787651+0000 mgr.a (mgr.14355) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:02 smithi171 bash[25040]: cluster 2024-09-14T03:26:00.787651+0000 mgr.a (mgr.14355) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:03.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:03.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:03.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:04.286 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:04.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:04 smithi131 bash[24745]: cluster 2024-09-14T03:26:02.788417+0000 mgr.a (mgr.14355) 13195 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:04 smithi171 bash[25040]: cluster 2024-09-14T03:26:02.788417+0000 mgr.a (mgr.14355) 13195 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:04 smithi007 bash[22722]: cluster 2024-09-14T03:26:02.788417+0000 mgr.a (mgr.14355) 13195 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:05 smithi131 bash[24745]: audit 2024-09-14T03:26:03.852353+0000 mgr.a (mgr.14355) 13196 : audit [DBG] from='client.287286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:05 smithi171 bash[25040]: audit 2024-09-14T03:26:03.852353+0000 mgr.a (mgr.14355) 13196 : audit [DBG] from='client.287286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:05 smithi007 bash[22722]: audit 2024-09-14T03:26:03.852353+0000 mgr.a (mgr.14355) 13196 : audit [DBG] from='client.287286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:06.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:06 smithi131 bash[24745]: cluster 2024-09-14T03:26:04.789297+0000 mgr.a (mgr.14355) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:06 smithi171 bash[25040]: cluster 2024-09-14T03:26:04.789297+0000 mgr.a (mgr.14355) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:06 smithi007 bash[22722]: cluster 2024-09-14T03:26:04.789297+0000 mgr.a (mgr.14355) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:08 smithi131 bash[24745]: cluster 2024-09-14T03:26:06.791585+0000 mgr.a (mgr.14355) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:08 smithi171 bash[25040]: cluster 2024-09-14T03:26:06.791585+0000 mgr.a (mgr.14355) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:08 smithi007 bash[22722]: cluster 2024-09-14T03:26:06.791585+0000 mgr.a (mgr.14355) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:09.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:10.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:10.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:10 smithi131 bash[24745]: cluster 2024-09-14T03:26:08.792344+0000 mgr.a (mgr.14355) 13199 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:10 smithi171 bash[25040]: cluster 2024-09-14T03:26:08.792344+0000 mgr.a (mgr.14355) 13199 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:10 smithi007 bash[22722]: cluster 2024-09-14T03:26:08.792344+0000 mgr.a (mgr.14355) 13199 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:11 smithi131 bash[24745]: audit 2024-09-14T03:26:09.609080+0000 mgr.a (mgr.14355) 13200 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:11 smithi171 bash[25040]: audit 2024-09-14T03:26:09.609080+0000 mgr.a (mgr.14355) 13200 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:11 smithi007 bash[22722]: audit 2024-09-14T03:26:09.609080+0000 mgr.a (mgr.14355) 13200 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:12 smithi131 bash[24745]: cluster 2024-09-14T03:26:10.794703+0000 mgr.a (mgr.14355) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:12 smithi171 bash[25040]: cluster 2024-09-14T03:26:10.794703+0000 mgr.a (mgr.14355) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:12 smithi007 bash[22722]: cluster 2024-09-14T03:26:10.794703+0000 mgr.a (mgr.14355) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:14 smithi131 bash[24745]: cluster 2024-09-14T03:26:12.795654+0000 mgr.a (mgr.14355) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:14 smithi171 bash[25040]: cluster 2024-09-14T03:26:12.795654+0000 mgr.a (mgr.14355) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:14 smithi007 bash[22722]: cluster 2024-09-14T03:26:12.795654+0000 mgr.a (mgr.14355) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:15.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:15.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:15.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:15.794 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:16 smithi131 bash[24745]: cluster 2024-09-14T03:26:14.796458+0000 mgr.a (mgr.14355) 13203 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:16 smithi171 bash[25040]: cluster 2024-09-14T03:26:14.796458+0000 mgr.a (mgr.14355) 13203 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:16 smithi007 bash[22722]: cluster 2024-09-14T03:26:14.796458+0000 mgr.a (mgr.14355) 13203 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:17 smithi131 bash[24745]: audit 2024-09-14T03:26:15.377917+0000 mgr.a (mgr.14355) 13204 : audit [DBG] from='client.287439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:17 smithi171 bash[25040]: audit 2024-09-14T03:26:15.377917+0000 mgr.a (mgr.14355) 13204 : audit [DBG] from='client.287439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:17 smithi007 bash[22722]: audit 2024-09-14T03:26:15.377917+0000 mgr.a (mgr.14355) 13204 : audit [DBG] from='client.287439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:18 smithi131 bash[24745]: cluster 2024-09-14T03:26:16.799353+0000 mgr.a (mgr.14355) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:18 smithi131 bash[24745]: audit 2024-09-14T03:26:17.559916+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:26:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:18 smithi171 bash[25040]: cluster 2024-09-14T03:26:16.799353+0000 mgr.a (mgr.14355) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:18 smithi171 bash[25040]: audit 2024-09-14T03:26:17.559916+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:26:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:18 smithi007 bash[22722]: cluster 2024-09-14T03:26:16.799353+0000 mgr.a (mgr.14355) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:18 smithi007 bash[22722]: audit 2024-09-14T03:26:17.559916+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:26:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:20 smithi131 bash[24745]: cluster 2024-09-14T03:26:18.800205+0000 mgr.a (mgr.14355) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:20 smithi171 bash[25040]: cluster 2024-09-14T03:26:18.800205+0000 mgr.a (mgr.14355) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:20 smithi007 bash[22722]: cluster 2024-09-14T03:26:18.800205+0000 mgr.a (mgr.14355) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:20.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:20.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:20.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:21.550 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:22 smithi131 bash[24745]: cluster 2024-09-14T03:26:20.801483+0000 mgr.a (mgr.14355) 13207 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:22 smithi131 bash[24745]: audit 2024-09-14T03:26:21.128289+0000 mgr.a (mgr.14355) 13208 : audit [DBG] from='client.287517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:22 smithi171 bash[25040]: cluster 2024-09-14T03:26:20.801483+0000 mgr.a (mgr.14355) 13207 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:22 smithi171 bash[25040]: audit 2024-09-14T03:26:21.128289+0000 mgr.a (mgr.14355) 13208 : audit [DBG] from='client.287517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:22 smithi007 bash[22722]: cluster 2024-09-14T03:26:20.801483+0000 mgr.a (mgr.14355) 13207 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:22 smithi007 bash[22722]: audit 2024-09-14T03:26:21.128289+0000 mgr.a (mgr.14355) 13208 : audit [DBG] from='client.287517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: cluster 2024-09-14T03:26:22.801993+0000 mgr.a (mgr.14355) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.891945+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.896172+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.934667+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.937462+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.940007+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:23 smithi007 bash[22722]: audit 2024-09-14T03:26:22.945934+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: cluster 2024-09-14T03:26:22.801993+0000 mgr.a (mgr.14355) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.891945+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.896172+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.934667+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.937462+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.940007+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:23 smithi131 bash[24745]: audit 2024-09-14T03:26:22.945934+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: cluster 2024-09-14T03:26:22.801993+0000 mgr.a (mgr.14355) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.891945+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.896172+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.934667+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.937462+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.940007+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:23 smithi171 bash[25040]: audit 2024-09-14T03:26:22.945934+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:26:24 smithi007 bash[22972]: debug 2024-09-14T03:26:24.901+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:26:25.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:26:24 smithi007 bash[22972]: debug 2024-09-14T03:26:24.901+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:26:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.149406+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.153869+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.157240+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.160368+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.164100+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.167305+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.169295+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.170045+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:26:25.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.177423+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.207 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.179591+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:25.207 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:25 smithi007 bash[22722]: audit 2024-09-14T03:26:24.180496+0000 mgr.a (mgr.14355) 13210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.149406+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.153869+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.157240+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.160368+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.164100+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.167305+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.169295+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.170045+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.177423+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.179591+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:25.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:25 smithi131 bash[24745]: audit 2024-09-14T03:26:24.180496+0000 mgr.a (mgr.14355) 13210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.149406+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.153869+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.157240+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.160368+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.164100+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.167305+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.169295+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.170045+0000 mon.a (mon.0) 2574 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.177423+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:26:25.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.179591+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:25.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:25 smithi171 bash[25040]: audit 2024-09-14T03:26:24.180496+0000 mgr.a (mgr.14355) 13210 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:26:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:26 smithi007 bash[22722]: cluster 2024-09-14T03:26:24.802499+0000 mgr.a (mgr.14355) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:26:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:26 smithi007 bash[22722]: audit 2024-09-14T03:26:24.902874+0000 mgr.a (mgr.14355) 13212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:26:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:26 smithi007 bash[22722]: cephadm 2024-09-14T03:26:24.904107+0000 mgr.a (mgr.14355) 13213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:26:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:26 smithi131 bash[24745]: cluster 2024-09-14T03:26:24.802499+0000 mgr.a (mgr.14355) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:26:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:26 smithi131 bash[24745]: audit 2024-09-14T03:26:24.902874+0000 mgr.a (mgr.14355) 13212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:26:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:26 smithi131 bash[24745]: cephadm 2024-09-14T03:26:24.904107+0000 mgr.a (mgr.14355) 13213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:26:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:26 smithi171 bash[25040]: cluster 2024-09-14T03:26:24.802499+0000 mgr.a (mgr.14355) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:26:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:26 smithi171 bash[25040]: audit 2024-09-14T03:26:24.902874+0000 mgr.a (mgr.14355) 13212 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:26:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:26 smithi171 bash[25040]: cephadm 2024-09-14T03:26:24.904107+0000 mgr.a (mgr.14355) 13213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:26:26.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:27.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:28 smithi007 bash[22722]: cluster 2024-09-14T03:26:26.804638+0000 mgr.a (mgr.14355) 13214 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:28 smithi007 bash[22722]: audit 2024-09-14T03:26:26.887307+0000 mgr.a (mgr.14355) 13215 : audit [DBG] from='client.287703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:28 smithi131 bash[24745]: cluster 2024-09-14T03:26:26.804638+0000 mgr.a (mgr.14355) 13214 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:28 smithi131 bash[24745]: audit 2024-09-14T03:26:26.887307+0000 mgr.a (mgr.14355) 13215 : audit [DBG] from='client.287703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:28 smithi171 bash[25040]: cluster 2024-09-14T03:26:26.804638+0000 mgr.a (mgr.14355) 13214 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:28 smithi171 bash[25040]: audit 2024-09-14T03:26:26.887307+0000 mgr.a (mgr.14355) 13215 : audit [DBG] from='client.287703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:30 smithi007 bash[22722]: cluster 2024-09-14T03:26:28.805588+0000 mgr.a (mgr.14355) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:30 smithi131 bash[24745]: cluster 2024-09-14T03:26:28.805588+0000 mgr.a (mgr.14355) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:30 smithi171 bash[25040]: cluster 2024-09-14T03:26:28.805588+0000 mgr.a (mgr.14355) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:32.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:32.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:32.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:32 smithi007 bash[22722]: cluster 2024-09-14T03:26:30.807812+0000 mgr.a (mgr.14355) 13217 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:32 smithi131 bash[24745]: cluster 2024-09-14T03:26:30.807812+0000 mgr.a (mgr.14355) 13217 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:32 smithi171 bash[25040]: cluster 2024-09-14T03:26:30.807812+0000 mgr.a (mgr.14355) 13217 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:33.128 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:33.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:34 smithi007 bash[22722]: audit 2024-09-14T03:26:32.671464+0000 mgr.a (mgr.14355) 13218 : audit [DBG] from='client.287781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:34 smithi007 bash[22722]: cluster 2024-09-14T03:26:32.808464+0000 mgr.a (mgr.14355) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:34 smithi131 bash[24745]: audit 2024-09-14T03:26:32.671464+0000 mgr.a (mgr.14355) 13218 : audit [DBG] from='client.287781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:34 smithi131 bash[24745]: cluster 2024-09-14T03:26:32.808464+0000 mgr.a (mgr.14355) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:34 smithi171 bash[25040]: audit 2024-09-14T03:26:32.671464+0000 mgr.a (mgr.14355) 13218 : audit [DBG] from='client.287781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:34 smithi171 bash[25040]: cluster 2024-09-14T03:26:32.808464+0000 mgr.a (mgr.14355) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:36 smithi007 bash[22722]: cluster 2024-09-14T03:26:34.809413+0000 mgr.a (mgr.14355) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:36 smithi131 bash[24745]: cluster 2024-09-14T03:26:34.809413+0000 mgr.a (mgr.14355) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:36 smithi171 bash[25040]: cluster 2024-09-14T03:26:34.809413+0000 mgr.a (mgr.14355) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:38.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:38.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:38.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:38 smithi007 bash[22722]: cluster 2024-09-14T03:26:36.811820+0000 mgr.a (mgr.14355) 13221 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:38 smithi131 bash[24745]: cluster 2024-09-14T03:26:36.811820+0000 mgr.a (mgr.14355) 13221 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:38 smithi171 bash[25040]: cluster 2024-09-14T03:26:36.811820+0000 mgr.a (mgr.14355) 13221 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:26:38.896 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:38.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:40 smithi131 bash[24745]: audit 2024-09-14T03:26:38.464867+0000 mgr.a (mgr.14355) 13222 : audit [DBG] from='client.287859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:40 smithi131 bash[24745]: cluster 2024-09-14T03:26:38.812486+0000 mgr.a (mgr.14355) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:40 smithi171 bash[25040]: audit 2024-09-14T03:26:38.464867+0000 mgr.a (mgr.14355) 13222 : audit [DBG] from='client.287859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:40 smithi171 bash[25040]: cluster 2024-09-14T03:26:38.812486+0000 mgr.a (mgr.14355) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:40 smithi007 bash[22722]: audit 2024-09-14T03:26:38.464867+0000 mgr.a (mgr.14355) 13222 : audit [DBG] from='client.287859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:40 smithi007 bash[22722]: cluster 2024-09-14T03:26:38.812486+0000 mgr.a (mgr.14355) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:42 smithi131 bash[24745]: cluster 2024-09-14T03:26:40.814677+0000 mgr.a (mgr.14355) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:42 smithi171 bash[25040]: cluster 2024-09-14T03:26:40.814677+0000 mgr.a (mgr.14355) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:42 smithi007 bash[22722]: cluster 2024-09-14T03:26:40.814677+0000 mgr.a (mgr.14355) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:43.898 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:44 smithi131 bash[24745]: cluster 2024-09-14T03:26:42.815460+0000 mgr.a (mgr.14355) 13225 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:44 smithi171 bash[25040]: cluster 2024-09-14T03:26:42.815460+0000 mgr.a (mgr.14355) 13225 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:44.654 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:44.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:44.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:44.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:44.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:44 smithi007 bash[22722]: cluster 2024-09-14T03:26:42.815460+0000 mgr.a (mgr.14355) 13225 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:45 smithi131 bash[24745]: audit 2024-09-14T03:26:44.228315+0000 mgr.a (mgr.14355) 13226 : audit [DBG] from='client.287937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:45 smithi171 bash[25040]: audit 2024-09-14T03:26:44.228315+0000 mgr.a (mgr.14355) 13226 : audit [DBG] from='client.287937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:45 smithi007 bash[22722]: audit 2024-09-14T03:26:44.228315+0000 mgr.a (mgr.14355) 13226 : audit [DBG] from='client.287937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:46.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:46 smithi131 bash[24745]: cluster 2024-09-14T03:26:44.816332+0000 mgr.a (mgr.14355) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:46 smithi171 bash[25040]: cluster 2024-09-14T03:26:44.816332+0000 mgr.a (mgr.14355) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:46 smithi007 bash[22722]: cluster 2024-09-14T03:26:44.816332+0000 mgr.a (mgr.14355) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:48 smithi131 bash[24745]: cluster 2024-09-14T03:26:46.818628+0000 mgr.a (mgr.14355) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:48 smithi171 bash[25040]: cluster 2024-09-14T03:26:46.818628+0000 mgr.a (mgr.14355) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:48 smithi007 bash[22722]: cluster 2024-09-14T03:26:46.818628+0000 mgr.a (mgr.14355) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:26:49.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:49.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:50.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:50.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:50.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:50 smithi131 bash[24745]: cluster 2024-09-14T03:26:48.819408+0000 mgr.a (mgr.14355) 13229 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:50 smithi171 bash[25040]: cluster 2024-09-14T03:26:48.819408+0000 mgr.a (mgr.14355) 13229 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:50 smithi007 bash[22722]: cluster 2024-09-14T03:26:48.819408+0000 mgr.a (mgr.14355) 13229 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:51 smithi131 bash[24745]: audit 2024-09-14T03:26:49.990793+0000 mgr.a (mgr.14355) 13230 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:51 smithi171 bash[25040]: audit 2024-09-14T03:26:49.990793+0000 mgr.a (mgr.14355) 13230 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:51 smithi007 bash[22722]: audit 2024-09-14T03:26:49.990793+0000 mgr.a (mgr.14355) 13230 : audit [DBG] from='client.288012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:52 smithi131 bash[24745]: cluster 2024-09-14T03:26:50.822225+0000 mgr.a (mgr.14355) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:26:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:52 smithi171 bash[25040]: cluster 2024-09-14T03:26:50.822225+0000 mgr.a (mgr.14355) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:26:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:52 smithi007 bash[22722]: cluster 2024-09-14T03:26:50.822225+0000 mgr.a (mgr.14355) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:26:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:54 smithi131 bash[24745]: cluster 2024-09-14T03:26:52.823181+0000 mgr.a (mgr.14355) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:54 smithi171 bash[25040]: cluster 2024-09-14T03:26:52.823181+0000 mgr.a (mgr.14355) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:54 smithi007 bash[22722]: cluster 2024-09-14T03:26:52.823181+0000 mgr.a (mgr.14355) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:55.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:26:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:26:55.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:26:56.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:26:56.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:26:56.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:26:56.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:26:56.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:26:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:56 smithi131 bash[24745]: cluster 2024-09-14T03:26:54.824137+0000 mgr.a (mgr.14355) 13233 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:56 smithi171 bash[25040]: cluster 2024-09-14T03:26:54.824137+0000 mgr.a (mgr.14355) 13233 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:56 smithi007 bash[22722]: cluster 2024-09-14T03:26:54.824137+0000 mgr.a (mgr.14355) 13233 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:26:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:57 smithi131 bash[24745]: audit 2024-09-14T03:26:55.764376+0000 mgr.a (mgr.14355) 13234 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:57 smithi171 bash[25040]: audit 2024-09-14T03:26:55.764376+0000 mgr.a (mgr.14355) 13234 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:57 smithi007 bash[22722]: audit 2024-09-14T03:26:55.764376+0000 mgr.a (mgr.14355) 13234 : audit [DBG] from='client.288087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:26:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:26:58 smithi131 bash[24745]: cluster 2024-09-14T03:26:56.827046+0000 mgr.a (mgr.14355) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:58.609 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:26:58 smithi171 bash[25040]: cluster 2024-09-14T03:26:56.827046+0000 mgr.a (mgr.14355) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:26:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:26:58 smithi007 bash[22722]: cluster 2024-09-14T03:26:56.827046+0000 mgr.a (mgr.14355) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:00 smithi131 bash[24745]: cluster 2024-09-14T03:26:58.827853+0000 mgr.a (mgr.14355) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:27:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:00 smithi171 bash[25040]: cluster 2024-09-14T03:26:58.827853+0000 mgr.a (mgr.14355) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:27:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:00 smithi007 bash[22722]: cluster 2024-09-14T03:26:58.827853+0000 mgr.a (mgr.14355) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:27:01.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:01.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:01.947 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:01.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:02 smithi131 bash[24745]: cluster 2024-09-14T03:27:00.829859+0000 mgr.a (mgr.14355) 13237 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:02 smithi171 bash[25040]: cluster 2024-09-14T03:27:00.829859+0000 mgr.a (mgr.14355) 13237 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:02 smithi007 bash[22722]: cluster 2024-09-14T03:27:00.829859+0000 mgr.a (mgr.14355) 13237 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:03 smithi131 bash[24745]: audit 2024-09-14T03:27:01.519327+0000 mgr.a (mgr.14355) 13238 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:03 smithi171 bash[25040]: audit 2024-09-14T03:27:01.519327+0000 mgr.a (mgr.14355) 13238 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:03 smithi007 bash[22722]: audit 2024-09-14T03:27:01.519327+0000 mgr.a (mgr.14355) 13238 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:04 smithi171 bash[25040]: cluster 2024-09-14T03:27:02.830822+0000 mgr.a (mgr.14355) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:04 smithi007 bash[22722]: cluster 2024-09-14T03:27:02.830822+0000 mgr.a (mgr.14355) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:04 smithi131 bash[24745]: cluster 2024-09-14T03:27:02.830822+0000 mgr.a (mgr.14355) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:05 smithi171 bash[25040]: cluster 2024-09-14T03:27:04.831644+0000 mgr.a (mgr.14355) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:05 smithi007 bash[22722]: cluster 2024-09-14T03:27:04.831644+0000 mgr.a (mgr.14355) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:05 smithi131 bash[24745]: cluster 2024-09-14T03:27:04.831644+0000 mgr.a (mgr.14355) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:27:06.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:06.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:06.949 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:07.696 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:07 smithi007 bash[22722]: cluster 2024-09-14T03:27:06.833943+0000 mgr.a (mgr.14355) 13241 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:27:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:07 smithi131 bash[24745]: cluster 2024-09-14T03:27:06.833943+0000 mgr.a (mgr.14355) 13241 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:27:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:07 smithi171 bash[25040]: cluster 2024-09-14T03:27:06.833943+0000 mgr.a (mgr.14355) 13241 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:27:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:08 smithi007 bash[22722]: audit 2024-09-14T03:27:07.282325+0000 mgr.a (mgr.14355) 13242 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:08 smithi131 bash[24745]: audit 2024-09-14T03:27:07.282325+0000 mgr.a (mgr.14355) 13242 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:08 smithi171 bash[25040]: audit 2024-09-14T03:27:07.282325+0000 mgr.a (mgr.14355) 13242 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:09 smithi007 bash[22722]: cluster 2024-09-14T03:27:08.834941+0000 mgr.a (mgr.14355) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:09 smithi131 bash[24745]: cluster 2024-09-14T03:27:08.834941+0000 mgr.a (mgr.14355) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:09 smithi171 bash[25040]: cluster 2024-09-14T03:27:08.834941+0000 mgr.a (mgr.14355) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:11 smithi007 bash[22722]: cluster 2024-09-14T03:27:10.837086+0000 mgr.a (mgr.14355) 13244 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:11 smithi131 bash[24745]: cluster 2024-09-14T03:27:10.837086+0000 mgr.a (mgr.14355) 13244 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:11 smithi171 bash[25040]: cluster 2024-09-14T03:27:10.837086+0000 mgr.a (mgr.14355) 13244 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:12.698 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:12.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:13.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:13 smithi007 bash[22722]: cluster 2024-09-14T03:27:12.837547+0000 mgr.a (mgr.14355) 13245 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:13 smithi007 bash[22722]: audit 2024-09-14T03:27:13.031406+0000 mgr.a (mgr.14355) 13246 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:13 smithi131 bash[24745]: cluster 2024-09-14T03:27:12.837547+0000 mgr.a (mgr.14355) 13245 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:13 smithi131 bash[24745]: audit 2024-09-14T03:27:13.031406+0000 mgr.a (mgr.14355) 13246 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:13 smithi171 bash[25040]: cluster 2024-09-14T03:27:12.837547+0000 mgr.a (mgr.14355) 13245 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:13 smithi171 bash[25040]: audit 2024-09-14T03:27:13.031406+0000 mgr.a (mgr.14355) 13246 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:15 smithi007 bash[22722]: cluster 2024-09-14T03:27:14.838493+0000 mgr.a (mgr.14355) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:15 smithi131 bash[24745]: cluster 2024-09-14T03:27:14.838493+0000 mgr.a (mgr.14355) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:15 smithi171 bash[25040]: cluster 2024-09-14T03:27:14.838493+0000 mgr.a (mgr.14355) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:17 smithi007 bash[22722]: cluster 2024-09-14T03:27:16.840904+0000 mgr.a (mgr.14355) 13248 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:17 smithi131 bash[24745]: cluster 2024-09-14T03:27:16.840904+0000 mgr.a (mgr.14355) 13248 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:17 smithi171 bash[25040]: cluster 2024-09-14T03:27:16.840904+0000 mgr.a (mgr.14355) 13248 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:18.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:18.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:19.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:19 smithi007 bash[22722]: audit 2024-09-14T03:27:18.792176+0000 mgr.a (mgr.14355) 13249 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:19 smithi007 bash[22722]: cluster 2024-09-14T03:27:18.841665+0000 mgr.a (mgr.14355) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:19 smithi131 bash[24745]: audit 2024-09-14T03:27:18.792176+0000 mgr.a (mgr.14355) 13249 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:19 smithi131 bash[24745]: cluster 2024-09-14T03:27:18.841665+0000 mgr.a (mgr.14355) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:19 smithi171 bash[25040]: audit 2024-09-14T03:27:18.792176+0000 mgr.a (mgr.14355) 13249 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:19 smithi171 bash[25040]: cluster 2024-09-14T03:27:18.841665+0000 mgr.a (mgr.14355) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:21 smithi007 bash[22722]: cluster 2024-09-14T03:27:20.843959+0000 mgr.a (mgr.14355) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:21 smithi131 bash[24745]: cluster 2024-09-14T03:27:20.843959+0000 mgr.a (mgr.14355) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:21 smithi171 bash[25040]: cluster 2024-09-14T03:27:20.843959+0000 mgr.a (mgr.14355) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:23 smithi007 bash[22722]: cluster 2024-09-14T03:27:22.844794+0000 mgr.a (mgr.14355) 13252 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:24.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:24.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:24.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:23 smithi131 bash[24745]: cluster 2024-09-14T03:27:22.844794+0000 mgr.a (mgr.14355) 13252 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:23 smithi171 bash[25040]: cluster 2024-09-14T03:27:22.844794+0000 mgr.a (mgr.14355) 13252 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:24.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:24.547694+0000 mgr.a (mgr.14355) 13253 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: cluster 2024-09-14T03:27:24.845346+0000 mgr.a (mgr.14355) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:24.953681+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:27:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:25.719261+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:27:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:25.720557+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:27:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:25.730645+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:27:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:25 smithi007 bash[22722]: audit 2024-09-14T03:27:25.735509+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:24.547694+0000 mgr.a (mgr.14355) 13253 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: cluster 2024-09-14T03:27:24.845346+0000 mgr.a (mgr.14355) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:24.953681+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:25.719261+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:25.720557+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:25.730645+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:27:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:25 smithi131 bash[24745]: audit 2024-09-14T03:27:25.735509+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:24.547694+0000 mgr.a (mgr.14355) 13253 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: cluster 2024-09-14T03:27:24.845346+0000 mgr.a (mgr.14355) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:24.953681+0000 mon.a (mon.0) 2577 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:25.719261+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:25.720557+0000 mon.a (mon.0) 2579 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:25.730645+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:27:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:25 smithi171 bash[25040]: audit 2024-09-14T03:27:25.735509+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:26.943 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:27:26 smithi007 bash[22972]: debug 2024-09-14T03:27:26.480+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:27:26.943 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:27:26 smithi007 bash[22972]: debug 2024-09-14T03:27:26.484+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:27:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:26 smithi007 bash[22722]: audit 2024-09-14T03:27:25.737799+0000 mgr.a (mgr.14355) 13255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:26 smithi131 bash[24745]: audit 2024-09-14T03:27:25.737799+0000 mgr.a (mgr.14355) 13255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:26 smithi171 bash[25040]: audit 2024-09-14T03:27:25.737799+0000 mgr.a (mgr.14355) 13255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:27:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:27 smithi007 bash[22722]: audit 2024-09-14T03:27:26.485941+0000 mgr.a (mgr.14355) 13256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:27:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:27 smithi007 bash[22722]: cephadm 2024-09-14T03:27:26.487360+0000 mgr.a (mgr.14355) 13257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:27:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:27 smithi007 bash[22722]: cluster 2024-09-14T03:27:26.848089+0000 mgr.a (mgr.14355) 13258 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:27 smithi131 bash[24745]: audit 2024-09-14T03:27:26.485941+0000 mgr.a (mgr.14355) 13256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:27:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:27 smithi131 bash[24745]: cephadm 2024-09-14T03:27:26.487360+0000 mgr.a (mgr.14355) 13257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:27:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:27 smithi131 bash[24745]: cluster 2024-09-14T03:27:26.848089+0000 mgr.a (mgr.14355) 13258 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:27 smithi171 bash[25040]: audit 2024-09-14T03:27:26.485941+0000 mgr.a (mgr.14355) 13256 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:27:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:27 smithi171 bash[25040]: cephadm 2024-09-14T03:27:26.487360+0000 mgr.a (mgr.14355) 13257 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:27:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:27 smithi171 bash[25040]: cluster 2024-09-14T03:27:26.848089+0000 mgr.a (mgr.14355) 13258 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:29.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:29.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:29 smithi007 bash[22722]: cluster 2024-09-14T03:27:28.848868+0000 mgr.a (mgr.14355) 13259 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:29 smithi131 bash[24745]: cluster 2024-09-14T03:27:28.848868+0000 mgr.a (mgr.14355) 13259 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:29 smithi171 bash[25040]: cluster 2024-09-14T03:27:28.848868+0000 mgr.a (mgr.14355) 13259 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:30.724 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:30.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:30.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:30.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:30.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:31 smithi007 bash[22722]: audit 2024-09-14T03:27:30.305792+0000 mgr.a (mgr.14355) 13260 : audit [DBG] from='client.288654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:31 smithi007 bash[22722]: cluster 2024-09-14T03:27:30.851689+0000 mgr.a (mgr.14355) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:31 smithi131 bash[24745]: audit 2024-09-14T03:27:30.305792+0000 mgr.a (mgr.14355) 13260 : audit [DBG] from='client.288654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:31 smithi131 bash[24745]: cluster 2024-09-14T03:27:30.851689+0000 mgr.a (mgr.14355) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:31 smithi171 bash[25040]: audit 2024-09-14T03:27:30.305792+0000 mgr.a (mgr.14355) 13260 : audit [DBG] from='client.288654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:31 smithi171 bash[25040]: cluster 2024-09-14T03:27:30.851689+0000 mgr.a (mgr.14355) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:33 smithi131 bash[24745]: cluster 2024-09-14T03:27:32.852489+0000 mgr.a (mgr.14355) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:33 smithi171 bash[25040]: cluster 2024-09-14T03:27:32.852489+0000 mgr.a (mgr.14355) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:33 smithi007 bash[22722]: cluster 2024-09-14T03:27:32.852489+0000 mgr.a (mgr.14355) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:35.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:35 smithi131 bash[24745]: cluster 2024-09-14T03:27:34.853414+0000 mgr.a (mgr.14355) 13263 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:35 smithi171 bash[25040]: cluster 2024-09-14T03:27:34.853414+0000 mgr.a (mgr.14355) 13263 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:35 smithi007 bash[22722]: cluster 2024-09-14T03:27:34.853414+0000 mgr.a (mgr.14355) 13263 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:36.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:36.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:36.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:36.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:36.518 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:36 smithi131 bash[24745]: audit 2024-09-14T03:27:36.067321+0000 mgr.a (mgr.14355) 13264 : audit [DBG] from='client.288732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:36 smithi171 bash[25040]: audit 2024-09-14T03:27:36.067321+0000 mgr.a (mgr.14355) 13264 : audit [DBG] from='client.288732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:36 smithi007 bash[22722]: audit 2024-09-14T03:27:36.067321+0000 mgr.a (mgr.14355) 13264 : audit [DBG] from='client.288732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:37 smithi131 bash[24745]: cluster 2024-09-14T03:27:36.856348+0000 mgr.a (mgr.14355) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:37 smithi171 bash[25040]: cluster 2024-09-14T03:27:36.856348+0000 mgr.a (mgr.14355) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:37 smithi007 bash[22722]: cluster 2024-09-14T03:27:36.856348+0000 mgr.a (mgr.14355) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:39 smithi131 bash[24745]: cluster 2024-09-14T03:27:38.857147+0000 mgr.a (mgr.14355) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:39 smithi171 bash[25040]: cluster 2024-09-14T03:27:38.857147+0000 mgr.a (mgr.14355) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:39 smithi007 bash[22722]: cluster 2024-09-14T03:27:38.857147+0000 mgr.a (mgr.14355) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:27:41.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:41.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:41.521 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:42.266 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:41 smithi131 bash[24745]: cluster 2024-09-14T03:27:40.859153+0000 mgr.a (mgr.14355) 13267 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:41 smithi171 bash[25040]: cluster 2024-09-14T03:27:40.859153+0000 mgr.a (mgr.14355) 13267 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:41 smithi007 bash[22722]: cluster 2024-09-14T03:27:40.859153+0000 mgr.a (mgr.14355) 13267 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:27:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:42 smithi131 bash[24745]: audit 2024-09-14T03:27:41.849629+0000 mgr.a (mgr.14355) 13268 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:42 smithi171 bash[25040]: audit 2024-09-14T03:27:41.849629+0000 mgr.a (mgr.14355) 13268 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:42 smithi007 bash[22722]: audit 2024-09-14T03:27:41.849629+0000 mgr.a (mgr.14355) 13268 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:43 smithi131 bash[24745]: cluster 2024-09-14T03:27:42.860090+0000 mgr.a (mgr.14355) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:43 smithi171 bash[25040]: cluster 2024-09-14T03:27:42.860090+0000 mgr.a (mgr.14355) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:43 smithi007 bash[22722]: cluster 2024-09-14T03:27:42.860090+0000 mgr.a (mgr.14355) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:45 smithi131 bash[24745]: cluster 2024-09-14T03:27:44.860889+0000 mgr.a (mgr.14355) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:45 smithi171 bash[25040]: cluster 2024-09-14T03:27:44.860889+0000 mgr.a (mgr.14355) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:45 smithi007 bash[22722]: cluster 2024-09-14T03:27:44.860889+0000 mgr.a (mgr.14355) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:47.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:47.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:48.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:48.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:48 smithi131 bash[24745]: cluster 2024-09-14T03:27:46.863150+0000 mgr.a (mgr.14355) 13271 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:48 smithi171 bash[25040]: cluster 2024-09-14T03:27:46.863150+0000 mgr.a (mgr.14355) 13271 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:48 smithi007 bash[22722]: cluster 2024-09-14T03:27:46.863150+0000 mgr.a (mgr.14355) 13271 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:49 smithi131 bash[24745]: audit 2024-09-14T03:27:47.604218+0000 mgr.a (mgr.14355) 13272 : audit [DBG] from='client.288879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:49 smithi171 bash[25040]: audit 2024-09-14T03:27:47.604218+0000 mgr.a (mgr.14355) 13272 : audit [DBG] from='client.288879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:49 smithi007 bash[22722]: audit 2024-09-14T03:27:47.604218+0000 mgr.a (mgr.14355) 13272 : audit [DBG] from='client.288879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:50 smithi131 bash[24745]: cluster 2024-09-14T03:27:48.864243+0000 mgr.a (mgr.14355) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:50 smithi171 bash[25040]: cluster 2024-09-14T03:27:48.864243+0000 mgr.a (mgr.14355) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:50 smithi007 bash[22722]: cluster 2024-09-14T03:27:48.864243+0000 mgr.a (mgr.14355) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:52 smithi131 bash[24745]: cluster 2024-09-14T03:27:50.866510+0000 mgr.a (mgr.14355) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:52 smithi171 bash[25040]: cluster 2024-09-14T03:27:50.866510+0000 mgr.a (mgr.14355) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:52 smithi007 bash[22722]: cluster 2024-09-14T03:27:50.866510+0000 mgr.a (mgr.14355) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:53.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:53.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:53.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:53.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:53.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:27:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:54 smithi131 bash[24745]: cluster 2024-09-14T03:27:52.867290+0000 mgr.a (mgr.14355) 13275 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:54 smithi171 bash[25040]: cluster 2024-09-14T03:27:52.867290+0000 mgr.a (mgr.14355) 13275 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:54 smithi007 bash[22722]: cluster 2024-09-14T03:27:52.867290+0000 mgr.a (mgr.14355) 13275 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:55 smithi131 bash[24745]: audit 2024-09-14T03:27:53.385489+0000 mgr.a (mgr.14355) 13276 : audit [DBG] from='client.288954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:55 smithi171 bash[25040]: audit 2024-09-14T03:27:53.385489+0000 mgr.a (mgr.14355) 13276 : audit [DBG] from='client.288954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:55 smithi007 bash[22722]: audit 2024-09-14T03:27:53.385489+0000 mgr.a (mgr.14355) 13276 : audit [DBG] from='client.288954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:27:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:56 smithi131 bash[24745]: cluster 2024-09-14T03:27:54.868212+0000 mgr.a (mgr.14355) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:56 smithi171 bash[25040]: cluster 2024-09-14T03:27:54.868212+0000 mgr.a (mgr.14355) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:56 smithi007 bash[22722]: cluster 2024-09-14T03:27:54.868212+0000 mgr.a (mgr.14355) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:27:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:27:58 smithi171 bash[25040]: cluster 2024-09-14T03:27:56.870509+0000 mgr.a (mgr.14355) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:27:58 smithi007 bash[22722]: cluster 2024-09-14T03:27:56.870509+0000 mgr.a (mgr.14355) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:27:58 smithi131 bash[24745]: cluster 2024-09-14T03:27:56.870509+0000 mgr.a (mgr.14355) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:27:58.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:27:58.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:27:58.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:27:59.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:27:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:27:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:27:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:27:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:00 smithi171 bash[25040]: cluster 2024-09-14T03:27:58.871080+0000 mgr.a (mgr.14355) 13279 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:00 smithi171 bash[25040]: audit 2024-09-14T03:27:59.169594+0000 mgr.a (mgr.14355) 13280 : audit [DBG] from='client.289029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:00 smithi007 bash[22722]: cluster 2024-09-14T03:27:58.871080+0000 mgr.a (mgr.14355) 13279 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:00 smithi007 bash[22722]: audit 2024-09-14T03:27:59.169594+0000 mgr.a (mgr.14355) 13280 : audit [DBG] from='client.289029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:00 smithi131 bash[24745]: cluster 2024-09-14T03:27:58.871080+0000 mgr.a (mgr.14355) 13279 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:00 smithi131 bash[24745]: audit 2024-09-14T03:27:59.169594+0000 mgr.a (mgr.14355) 13280 : audit [DBG] from='client.289029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:02 smithi171 bash[25040]: cluster 2024-09-14T03:28:00.873373+0000 mgr.a (mgr.14355) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:02 smithi007 bash[22722]: cluster 2024-09-14T03:28:00.873373+0000 mgr.a (mgr.14355) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:02 smithi131 bash[24745]: cluster 2024-09-14T03:28:00.873373+0000 mgr.a (mgr.14355) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:04 smithi007 bash[22722]: cluster 2024-09-14T03:28:02.874140+0000 mgr.a (mgr.14355) 13282 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:04 smithi131 bash[24745]: cluster 2024-09-14T03:28:02.874140+0000 mgr.a (mgr.14355) 13282 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:04 smithi171 bash[25040]: cluster 2024-09-14T03:28:02.874140+0000 mgr.a (mgr.14355) 13282 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:04.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:04.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:05.359 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:06 smithi007 bash[22722]: cluster 2024-09-14T03:28:04.874697+0000 mgr.a (mgr.14355) 13283 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:06 smithi007 bash[22722]: audit 2024-09-14T03:28:04.918620+0000 mgr.a (mgr.14355) 13284 : audit [DBG] from='client.289104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:06 smithi131 bash[24745]: cluster 2024-09-14T03:28:04.874697+0000 mgr.a (mgr.14355) 13283 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:06 smithi131 bash[24745]: audit 2024-09-14T03:28:04.918620+0000 mgr.a (mgr.14355) 13284 : audit [DBG] from='client.289104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:06 smithi171 bash[25040]: cluster 2024-09-14T03:28:04.874697+0000 mgr.a (mgr.14355) 13283 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:06 smithi171 bash[25040]: audit 2024-09-14T03:28:04.918620+0000 mgr.a (mgr.14355) 13284 : audit [DBG] from='client.289104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:08 smithi007 bash[22722]: cluster 2024-09-14T03:28:06.877020+0000 mgr.a (mgr.14355) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:28:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:08 smithi131 bash[24745]: cluster 2024-09-14T03:28:06.877020+0000 mgr.a (mgr.14355) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:28:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:08 smithi171 bash[25040]: cluster 2024-09-14T03:28:06.877020+0000 mgr.a (mgr.14355) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:28:10.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:10.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:10.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:10 smithi007 bash[22722]: cluster 2024-09-14T03:28:08.877832+0000 mgr.a (mgr.14355) 13286 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:28:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:10 smithi131 bash[24745]: cluster 2024-09-14T03:28:08.877832+0000 mgr.a (mgr.14355) 13286 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:28:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:10 smithi171 bash[25040]: cluster 2024-09-14T03:28:08.877832+0000 mgr.a (mgr.14355) 13286 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:28:11.117 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:11.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:11.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:11.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:11.117 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:12 smithi007 bash[22722]: audit 2024-09-14T03:28:10.693192+0000 mgr.a (mgr.14355) 13287 : audit [DBG] from='client.289182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:12 smithi007 bash[22722]: cluster 2024-09-14T03:28:10.879265+0000 mgr.a (mgr.14355) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:12 smithi131 bash[24745]: audit 2024-09-14T03:28:10.693192+0000 mgr.a (mgr.14355) 13287 : audit [DBG] from='client.289182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:12 smithi131 bash[24745]: cluster 2024-09-14T03:28:10.879265+0000 mgr.a (mgr.14355) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:12 smithi171 bash[25040]: audit 2024-09-14T03:28:10.693192+0000 mgr.a (mgr.14355) 13287 : audit [DBG] from='client.289182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:12 smithi171 bash[25040]: cluster 2024-09-14T03:28:10.879265+0000 mgr.a (mgr.14355) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:14 smithi007 bash[22722]: cluster 2024-09-14T03:28:12.880127+0000 mgr.a (mgr.14355) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:14 smithi131 bash[24745]: cluster 2024-09-14T03:28:12.880127+0000 mgr.a (mgr.14355) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:14 smithi171 bash[25040]: cluster 2024-09-14T03:28:12.880127+0000 mgr.a (mgr.14355) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:16.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:16.120 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:16 smithi007 bash[22722]: cluster 2024-09-14T03:28:14.880908+0000 mgr.a (mgr.14355) 13290 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:16 smithi131 bash[24745]: cluster 2024-09-14T03:28:14.880908+0000 mgr.a (mgr.14355) 13290 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:16 smithi171 bash[25040]: cluster 2024-09-14T03:28:14.880908+0000 mgr.a (mgr.14355) 13290 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:16.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:16.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:16.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:18 smithi007 bash[22722]: audit 2024-09-14T03:28:16.455572+0000 mgr.a (mgr.14355) 13291 : audit [DBG] from='client.289260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:18 smithi007 bash[22722]: cluster 2024-09-14T03:28:16.882221+0000 mgr.a (mgr.14355) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:18 smithi131 bash[24745]: audit 2024-09-14T03:28:16.455572+0000 mgr.a (mgr.14355) 13291 : audit [DBG] from='client.289260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:18 smithi131 bash[24745]: cluster 2024-09-14T03:28:16.882221+0000 mgr.a (mgr.14355) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:18 smithi171 bash[25040]: audit 2024-09-14T03:28:16.455572+0000 mgr.a (mgr.14355) 13291 : audit [DBG] from='client.289260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:18 smithi171 bash[25040]: cluster 2024-09-14T03:28:16.882221+0000 mgr.a (mgr.14355) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:20 smithi007 bash[22722]: cluster 2024-09-14T03:28:18.882962+0000 mgr.a (mgr.14355) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:28:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:20 smithi131 bash[24745]: cluster 2024-09-14T03:28:18.882962+0000 mgr.a (mgr.14355) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:28:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:20 smithi171 bash[25040]: cluster 2024-09-14T03:28:18.882962+0000 mgr.a (mgr.14355) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:28:21.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:21.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:21.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:22 smithi007 bash[22722]: cluster 2024-09-14T03:28:20.884914+0000 mgr.a (mgr.14355) 13294 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:28:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:22 smithi131 bash[24745]: cluster 2024-09-14T03:28:20.884914+0000 mgr.a (mgr.14355) 13294 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:28:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:22 smithi171 bash[25040]: cluster 2024-09-14T03:28:20.884914+0000 mgr.a (mgr.14355) 13294 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:28:22.642 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:23 smithi007 bash[22722]: audit 2024-09-14T03:28:22.222137+0000 mgr.a (mgr.14355) 13295 : audit [DBG] from='client.289335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:23 smithi131 bash[24745]: audit 2024-09-14T03:28:22.222137+0000 mgr.a (mgr.14355) 13295 : audit [DBG] from='client.289335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:23 smithi171 bash[25040]: audit 2024-09-14T03:28:22.222137+0000 mgr.a (mgr.14355) 13295 : audit [DBG] from='client.289335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:24 smithi007 bash[22722]: cluster 2024-09-14T03:28:22.885857+0000 mgr.a (mgr.14355) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:24 smithi131 bash[24745]: cluster 2024-09-14T03:28:22.885857+0000 mgr.a (mgr.14355) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:24 smithi171 bash[25040]: cluster 2024-09-14T03:28:22.885857+0000 mgr.a (mgr.14355) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:26 smithi007 bash[22722]: cluster 2024-09-14T03:28:24.886673+0000 mgr.a (mgr.14355) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:26 smithi131 bash[24745]: cluster 2024-09-14T03:28:24.886673+0000 mgr.a (mgr.14355) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:26 smithi171 bash[25040]: cluster 2024-09-14T03:28:24.886673+0000 mgr.a (mgr.14355) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:27 smithi007 bash[22722]: audit 2024-09-14T03:28:26.538713+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:28:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:27 smithi131 bash[24745]: audit 2024-09-14T03:28:26.538713+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:28:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:27 smithi171 bash[25040]: audit 2024-09-14T03:28:26.538713+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:28:27.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:27.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:27.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:28.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22972]: debug 2024-09-14T03:28:28.135+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:28:28.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22972]: debug 2024-09-14T03:28:28.147+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:28:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22722]: cluster 2024-09-14T03:28:26.888870+0000 mgr.a (mgr.14355) 13298 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22722]: audit 2024-09-14T03:28:27.377382+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:28:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22722]: audit 2024-09-14T03:28:27.378659+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:28:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22722]: audit 2024-09-14T03:28:27.387268+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:28:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:28 smithi007 bash[22722]: audit 2024-09-14T03:28:27.392633+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:28 smithi131 bash[24745]: cluster 2024-09-14T03:28:26.888870+0000 mgr.a (mgr.14355) 13298 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:28 smithi131 bash[24745]: audit 2024-09-14T03:28:27.377382+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:28:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:28 smithi131 bash[24745]: audit 2024-09-14T03:28:27.378659+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:28:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:28 smithi131 bash[24745]: audit 2024-09-14T03:28:27.387268+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:28:28.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:28 smithi131 bash[24745]: audit 2024-09-14T03:28:27.392633+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:28.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:28 smithi171 bash[25040]: cluster 2024-09-14T03:28:26.888870+0000 mgr.a (mgr.14355) 13298 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:28:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:28 smithi171 bash[25040]: audit 2024-09-14T03:28:27.377382+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:28:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:28 smithi171 bash[25040]: audit 2024-09-14T03:28:27.378659+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:28:28.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:28 smithi171 bash[25040]: audit 2024-09-14T03:28:27.387268+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:28:28.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:28 smithi171 bash[25040]: audit 2024-09-14T03:28:27.392633+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:29 smithi007 bash[22722]: audit 2024-09-14T03:28:27.394988+0000 mgr.a (mgr.14355) 13299 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:29 smithi007 bash[22722]: audit 2024-09-14T03:28:27.980272+0000 mgr.a (mgr.14355) 13300 : audit [DBG] from='client.289464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:29 smithi007 bash[22722]: audit 2024-09-14T03:28:28.141592+0000 mgr.a (mgr.14355) 13301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:28:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:29 smithi007 bash[22722]: cephadm 2024-09-14T03:28:28.153215+0000 mgr.a (mgr.14355) 13302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:28:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:29 smithi131 bash[24745]: audit 2024-09-14T03:28:27.394988+0000 mgr.a (mgr.14355) 13299 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:29 smithi131 bash[24745]: audit 2024-09-14T03:28:27.980272+0000 mgr.a (mgr.14355) 13300 : audit [DBG] from='client.289464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:29 smithi131 bash[24745]: audit 2024-09-14T03:28:28.141592+0000 mgr.a (mgr.14355) 13301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:28:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:29 smithi131 bash[24745]: cephadm 2024-09-14T03:28:28.153215+0000 mgr.a (mgr.14355) 13302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:28:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:29 smithi171 bash[25040]: audit 2024-09-14T03:28:27.394988+0000 mgr.a (mgr.14355) 13299 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:28:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:29 smithi171 bash[25040]: audit 2024-09-14T03:28:27.980272+0000 mgr.a (mgr.14355) 13300 : audit [DBG] from='client.289464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:29 smithi171 bash[25040]: audit 2024-09-14T03:28:28.141592+0000 mgr.a (mgr.14355) 13301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:28:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:29 smithi171 bash[25040]: cephadm 2024-09-14T03:28:28.153215+0000 mgr.a (mgr.14355) 13302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:28:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:30 smithi007 bash[22722]: cluster 2024-09-14T03:28:28.889870+0000 mgr.a (mgr.14355) 13303 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:30 smithi131 bash[24745]: cluster 2024-09-14T03:28:28.889870+0000 mgr.a (mgr.14355) 13303 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:30 smithi171 bash[25040]: cluster 2024-09-14T03:28:28.889870+0000 mgr.a (mgr.14355) 13303 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:32 smithi007 bash[22722]: cluster 2024-09-14T03:28:30.892054+0000 mgr.a (mgr.14355) 13304 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:32 smithi131 bash[24745]: cluster 2024-09-14T03:28:30.892054+0000 mgr.a (mgr.14355) 13304 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:32 smithi171 bash[25040]: cluster 2024-09-14T03:28:30.892054+0000 mgr.a (mgr.14355) 13304 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:33.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:33.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:33.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:34.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:34.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:34 smithi007 bash[22722]: cluster 2024-09-14T03:28:32.892821+0000 mgr.a (mgr.14355) 13305 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:34 smithi131 bash[24745]: cluster 2024-09-14T03:28:32.892821+0000 mgr.a (mgr.14355) 13305 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:34 smithi171 bash[25040]: cluster 2024-09-14T03:28:32.892821+0000 mgr.a (mgr.14355) 13305 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:35 smithi007 bash[22722]: audit 2024-09-14T03:28:33.869024+0000 mgr.a (mgr.14355) 13306 : audit [DBG] from='client.289596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:35 smithi131 bash[24745]: audit 2024-09-14T03:28:33.869024+0000 mgr.a (mgr.14355) 13306 : audit [DBG] from='client.289596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:35 smithi171 bash[25040]: audit 2024-09-14T03:28:33.869024+0000 mgr.a (mgr.14355) 13306 : audit [DBG] from='client.289596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:36 smithi007 bash[22722]: cluster 2024-09-14T03:28:34.893816+0000 mgr.a (mgr.14355) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:36 smithi131 bash[24745]: cluster 2024-09-14T03:28:34.893816+0000 mgr.a (mgr.14355) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:36 smithi171 bash[25040]: cluster 2024-09-14T03:28:34.893816+0000 mgr.a (mgr.14355) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:38 smithi007 bash[22722]: cluster 2024-09-14T03:28:36.896109+0000 mgr.a (mgr.14355) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:38 smithi131 bash[24745]: cluster 2024-09-14T03:28:36.896109+0000 mgr.a (mgr.14355) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:38 smithi171 bash[25040]: cluster 2024-09-14T03:28:36.896109+0000 mgr.a (mgr.14355) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:39.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:39.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:39.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:40.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:40.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:40 smithi007 bash[22722]: cluster 2024-09-14T03:28:38.896892+0000 mgr.a (mgr.14355) 13309 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:40 smithi131 bash[24745]: cluster 2024-09-14T03:28:38.896892+0000 mgr.a (mgr.14355) 13309 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:40 smithi171 bash[25040]: cluster 2024-09-14T03:28:38.896892+0000 mgr.a (mgr.14355) 13309 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:41 smithi131 bash[24745]: audit 2024-09-14T03:28:39.636899+0000 mgr.a (mgr.14355) 13310 : audit [DBG] from='client.289674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:41 smithi171 bash[25040]: audit 2024-09-14T03:28:39.636899+0000 mgr.a (mgr.14355) 13310 : audit [DBG] from='client.289674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:41 smithi007 bash[22722]: audit 2024-09-14T03:28:39.636899+0000 mgr.a (mgr.14355) 13310 : audit [DBG] from='client.289674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:42 smithi131 bash[24745]: cluster 2024-09-14T03:28:40.899248+0000 mgr.a (mgr.14355) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:42 smithi171 bash[25040]: cluster 2024-09-14T03:28:40.899248+0000 mgr.a (mgr.14355) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:42 smithi007 bash[22722]: cluster 2024-09-14T03:28:40.899248+0000 mgr.a (mgr.14355) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:28:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:44 smithi131 bash[24745]: cluster 2024-09-14T03:28:42.900022+0000 mgr.a (mgr.14355) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:44 smithi171 bash[25040]: cluster 2024-09-14T03:28:42.900022+0000 mgr.a (mgr.14355) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:44 smithi007 bash[22722]: cluster 2024-09-14T03:28:42.900022+0000 mgr.a (mgr.14355) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:45.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:45.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:45.815 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:45.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:45.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:45.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:45.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:46 smithi131 bash[24745]: cluster 2024-09-14T03:28:44.900800+0000 mgr.a (mgr.14355) 13313 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:46 smithi171 bash[25040]: cluster 2024-09-14T03:28:44.900800+0000 mgr.a (mgr.14355) 13313 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:46 smithi007 bash[22722]: cluster 2024-09-14T03:28:44.900800+0000 mgr.a (mgr.14355) 13313 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:47 smithi131 bash[24745]: audit 2024-09-14T03:28:45.402337+0000 mgr.a (mgr.14355) 13314 : audit [DBG] from='client.289752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:47 smithi171 bash[25040]: audit 2024-09-14T03:28:45.402337+0000 mgr.a (mgr.14355) 13314 : audit [DBG] from='client.289752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:47 smithi007 bash[22722]: audit 2024-09-14T03:28:45.402337+0000 mgr.a (mgr.14355) 13314 : audit [DBG] from='client.289752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:48 smithi131 bash[24745]: cluster 2024-09-14T03:28:46.903557+0000 mgr.a (mgr.14355) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:48 smithi171 bash[25040]: cluster 2024-09-14T03:28:46.903557+0000 mgr.a (mgr.14355) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:48 smithi007 bash[22722]: cluster 2024-09-14T03:28:46.903557+0000 mgr.a (mgr.14355) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:50 smithi131 bash[24745]: cluster 2024-09-14T03:28:48.904324+0000 mgr.a (mgr.14355) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:50 smithi171 bash[25040]: cluster 2024-09-14T03:28:48.904324+0000 mgr.a (mgr.14355) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:50 smithi007 bash[22722]: cluster 2024-09-14T03:28:48.904324+0000 mgr.a (mgr.14355) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:50.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:50.818 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:50.818 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:51.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:51.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:52 smithi131 bash[24745]: cluster 2024-09-14T03:28:50.906286+0000 mgr.a (mgr.14355) 13317 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:52 smithi131 bash[24745]: audit 2024-09-14T03:28:51.155616+0000 mgr.a (mgr.14355) 13318 : audit [DBG] from='client.289830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:52 smithi171 bash[25040]: cluster 2024-09-14T03:28:50.906286+0000 mgr.a (mgr.14355) 13317 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:52 smithi171 bash[25040]: audit 2024-09-14T03:28:51.155616+0000 mgr.a (mgr.14355) 13318 : audit [DBG] from='client.289830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:52 smithi007 bash[22722]: cluster 2024-09-14T03:28:50.906286+0000 mgr.a (mgr.14355) 13317 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:52 smithi007 bash[22722]: audit 2024-09-14T03:28:51.155616+0000 mgr.a (mgr.14355) 13318 : audit [DBG] from='client.289830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:54 smithi131 bash[24745]: cluster 2024-09-14T03:28:52.907181+0000 mgr.a (mgr.14355) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:54 smithi171 bash[25040]: cluster 2024-09-14T03:28:52.907181+0000 mgr.a (mgr.14355) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:54 smithi007 bash[22722]: cluster 2024-09-14T03:28:52.907181+0000 mgr.a (mgr.14355) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:28:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:56 smithi131 bash[24745]: cluster 2024-09-14T03:28:54.907969+0000 mgr.a (mgr.14355) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:56 smithi171 bash[25040]: cluster 2024-09-14T03:28:54.907969+0000 mgr.a (mgr.14355) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:56.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:28:56.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:28:56.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:28:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:56 smithi007 bash[22722]: cluster 2024-09-14T03:28:54.907969+0000 mgr.a (mgr.14355) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:28:57.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:28:57.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:28:57.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:28:57.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:28:57.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:28:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:58 smithi131 bash[24745]: cluster 2024-09-14T03:28:56.910166+0000 mgr.a (mgr.14355) 13321 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:28:58 smithi131 bash[24745]: audit 2024-09-14T03:28:56.948584+0000 mgr.a (mgr.14355) 13322 : audit [DBG] from='client.289908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:58 smithi171 bash[25040]: cluster 2024-09-14T03:28:56.910166+0000 mgr.a (mgr.14355) 13321 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:28:58 smithi171 bash[25040]: audit 2024-09-14T03:28:56.948584+0000 mgr.a (mgr.14355) 13322 : audit [DBG] from='client.289908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:28:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:58 smithi007 bash[22722]: cluster 2024-09-14T03:28:56.910166+0000 mgr.a (mgr.14355) 13321 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:28:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:28:58 smithi007 bash[22722]: audit 2024-09-14T03:28:56.948584+0000 mgr.a (mgr.14355) 13322 : audit [DBG] from='client.289908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:00 smithi131 bash[24745]: cluster 2024-09-14T03:28:58.911057+0000 mgr.a (mgr.14355) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:00 smithi171 bash[25040]: cluster 2024-09-14T03:28:58.911057+0000 mgr.a (mgr.14355) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:00 smithi007 bash[22722]: cluster 2024-09-14T03:28:58.911057+0000 mgr.a (mgr.14355) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:02.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:02.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:02.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:02 smithi131 bash[24745]: cluster 2024-09-14T03:29:00.913319+0000 mgr.a (mgr.14355) 13324 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:02 smithi171 bash[25040]: cluster 2024-09-14T03:29:00.913319+0000 mgr.a (mgr.14355) 13324 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:02 smithi007 bash[22722]: cluster 2024-09-14T03:29:00.913319+0000 mgr.a (mgr.14355) 13324 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:03.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:03.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:04 smithi131 bash[24745]: audit 2024-09-14T03:29:02.730016+0000 mgr.a (mgr.14355) 13325 : audit [DBG] from='client.289983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:04 smithi131 bash[24745]: cluster 2024-09-14T03:29:02.914128+0000 mgr.a (mgr.14355) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:04 smithi171 bash[25040]: audit 2024-09-14T03:29:02.730016+0000 mgr.a (mgr.14355) 13325 : audit [DBG] from='client.289983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:04 smithi171 bash[25040]: cluster 2024-09-14T03:29:02.914128+0000 mgr.a (mgr.14355) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:04 smithi007 bash[22722]: audit 2024-09-14T03:29:02.730016+0000 mgr.a (mgr.14355) 13325 : audit [DBG] from='client.289983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:04 smithi007 bash[22722]: cluster 2024-09-14T03:29:02.914128+0000 mgr.a (mgr.14355) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:06 smithi131 bash[24745]: cluster 2024-09-14T03:29:04.915089+0000 mgr.a (mgr.14355) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:06 smithi171 bash[25040]: cluster 2024-09-14T03:29:04.915089+0000 mgr.a (mgr.14355) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:06 smithi007 bash[22722]: cluster 2024-09-14T03:29:04.915089+0000 mgr.a (mgr.14355) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:08 smithi131 bash[24745]: cluster 2024-09-14T03:29:06.917353+0000 mgr.a (mgr.14355) 13328 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:08 smithi171 bash[25040]: cluster 2024-09-14T03:29:06.917353+0000 mgr.a (mgr.14355) 13328 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:08 smithi007 bash[22722]: cluster 2024-09-14T03:29:06.917353+0000 mgr.a (mgr.14355) 13328 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:08.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:08.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:08.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:08.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:08.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:10 smithi131 bash[24745]: audit 2024-09-14T03:29:08.508715+0000 mgr.a (mgr.14355) 13329 : audit [DBG] from='client.290061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:10 smithi131 bash[24745]: cluster 2024-09-14T03:29:08.917838+0000 mgr.a (mgr.14355) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:10 smithi171 bash[25040]: audit 2024-09-14T03:29:08.508715+0000 mgr.a (mgr.14355) 13329 : audit [DBG] from='client.290061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:10 smithi171 bash[25040]: cluster 2024-09-14T03:29:08.917838+0000 mgr.a (mgr.14355) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:10 smithi007 bash[22722]: audit 2024-09-14T03:29:08.508715+0000 mgr.a (mgr.14355) 13329 : audit [DBG] from='client.290061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:10 smithi007 bash[22722]: cluster 2024-09-14T03:29:08.917838+0000 mgr.a (mgr.14355) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:12 smithi131 bash[24745]: cluster 2024-09-14T03:29:10.920180+0000 mgr.a (mgr.14355) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:12 smithi171 bash[25040]: cluster 2024-09-14T03:29:10.920180+0000 mgr.a (mgr.14355) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:12 smithi007 bash[22722]: cluster 2024-09-14T03:29:10.920180+0000 mgr.a (mgr.14355) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:13.935 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:13.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:13.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:14 smithi171 bash[25040]: cluster 2024-09-14T03:29:12.920990+0000 mgr.a (mgr.14355) 13332 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:14.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:14 smithi007 bash[22722]: cluster 2024-09-14T03:29:12.920990+0000 mgr.a (mgr.14355) 13332 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:14 smithi131 bash[24745]: cluster 2024-09-14T03:29:12.920990+0000 mgr.a (mgr.14355) 13332 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:15 smithi171 bash[25040]: audit 2024-09-14T03:29:14.265715+0000 mgr.a (mgr.14355) 13333 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:15 smithi007 bash[22722]: audit 2024-09-14T03:29:14.265715+0000 mgr.a (mgr.14355) 13333 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:15 smithi131 bash[24745]: audit 2024-09-14T03:29:14.265715+0000 mgr.a (mgr.14355) 13333 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:16 smithi007 bash[22722]: cluster 2024-09-14T03:29:14.921910+0000 mgr.a (mgr.14355) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:16 smithi131 bash[24745]: cluster 2024-09-14T03:29:14.921910+0000 mgr.a (mgr.14355) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:16 smithi171 bash[25040]: cluster 2024-09-14T03:29:14.921910+0000 mgr.a (mgr.14355) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:18 smithi007 bash[22722]: cluster 2024-09-14T03:29:16.924333+0000 mgr.a (mgr.14355) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:18 smithi131 bash[24745]: cluster 2024-09-14T03:29:16.924333+0000 mgr.a (mgr.14355) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:18 smithi171 bash[25040]: cluster 2024-09-14T03:29:16.924333+0000 mgr.a (mgr.14355) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:19.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:20.469 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:20.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:20.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:20.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:20.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:20 smithi007 bash[22722]: cluster 2024-09-14T03:29:18.925257+0000 mgr.a (mgr.14355) 13336 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:20 smithi131 bash[24745]: cluster 2024-09-14T03:29:18.925257+0000 mgr.a (mgr.14355) 13336 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:20 smithi171 bash[25040]: cluster 2024-09-14T03:29:18.925257+0000 mgr.a (mgr.14355) 13336 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:21 smithi007 bash[22722]: audit 2024-09-14T03:29:20.020474+0000 mgr.a (mgr.14355) 13337 : audit [DBG] from='client.290217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:21 smithi131 bash[24745]: audit 2024-09-14T03:29:20.020474+0000 mgr.a (mgr.14355) 13337 : audit [DBG] from='client.290217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:21 smithi171 bash[25040]: audit 2024-09-14T03:29:20.020474+0000 mgr.a (mgr.14355) 13337 : audit [DBG] from='client.290217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:22 smithi007 bash[22722]: cluster 2024-09-14T03:29:20.928023+0000 mgr.a (mgr.14355) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:29:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:22 smithi131 bash[24745]: cluster 2024-09-14T03:29:20.928023+0000 mgr.a (mgr.14355) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:29:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:22 smithi171 bash[25040]: cluster 2024-09-14T03:29:20.928023+0000 mgr.a (mgr.14355) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:29:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:23 smithi007 bash[22722]: cluster 2024-09-14T03:29:22.928832+0000 mgr.a (mgr.14355) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:23 smithi131 bash[24745]: cluster 2024-09-14T03:29:22.928832+0000 mgr.a (mgr.14355) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:23 smithi171 bash[25040]: cluster 2024-09-14T03:29:22.928832+0000 mgr.a (mgr.14355) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:25.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:25.471 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:25.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:26.262 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:26.262 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:26.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:25 smithi131 bash[24745]: cluster 2024-09-14T03:29:24.929637+0000 mgr.a (mgr.14355) 13340 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:25 smithi171 bash[25040]: cluster 2024-09-14T03:29:24.929637+0000 mgr.a (mgr.14355) 13340 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:25 smithi007 bash[22722]: cluster 2024-09-14T03:29:24.929637+0000 mgr.a (mgr.14355) 13340 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:29:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:26 smithi131 bash[24745]: audit 2024-09-14T03:29:25.808427+0000 mgr.a (mgr.14355) 13341 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:26 smithi171 bash[25040]: audit 2024-09-14T03:29:25.808427+0000 mgr.a (mgr.14355) 13341 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:26 smithi007 bash[22722]: audit 2024-09-14T03:29:25.808427+0000 mgr.a (mgr.14355) 13341 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:27 smithi131 bash[24745]: cluster 2024-09-14T03:29:26.932449+0000 mgr.a (mgr.14355) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:27 smithi171 bash[25040]: cluster 2024-09-14T03:29:26.932449+0000 mgr.a (mgr.14355) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:27 smithi007 bash[22722]: cluster 2024-09-14T03:29:26.932449+0000 mgr.a (mgr.14355) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:29 smithi131 bash[24745]: audit 2024-09-14T03:29:28.210145+0000 mon.a (mon.0) 2587 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:29:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:29 smithi171 bash[25040]: audit 2024-09-14T03:29:28.210145+0000 mon.a (mon.0) 2587 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:29:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:29 smithi007 bash[22722]: audit 2024-09-14T03:29:28.210145+0000 mon.a (mon.0) 2587 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:29:30.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:29:29 smithi007 bash[22972]: debug 2024-09-14T03:29:29.786+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:29:30.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:29:29 smithi007 bash[22972]: debug 2024-09-14T03:29:29.790+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: cluster 2024-09-14T03:29:28.933251+0000 mgr.a (mgr.14355) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: audit 2024-09-14T03:29:29.050552+0000 mon.a (mon.0) 2588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: audit 2024-09-14T03:29:29.052292+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: audit 2024-09-14T03:29:29.059577+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: audit 2024-09-14T03:29:29.062122+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:30 smithi007 bash[22722]: audit 2024-09-14T03:29:29.064413+0000 mgr.a (mgr.14355) 13344 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: cluster 2024-09-14T03:29:28.933251+0000 mgr.a (mgr.14355) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:29:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: audit 2024-09-14T03:29:29.050552+0000 mon.a (mon.0) 2588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:29:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: audit 2024-09-14T03:29:29.052292+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:29:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: audit 2024-09-14T03:29:29.059577+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:29:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: audit 2024-09-14T03:29:29.062122+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:30 smithi131 bash[24745]: audit 2024-09-14T03:29:29.064413+0000 mgr.a (mgr.14355) 13344 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: cluster 2024-09-14T03:29:28.933251+0000 mgr.a (mgr.14355) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: audit 2024-09-14T03:29:29.050552+0000 mon.a (mon.0) 2588 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: audit 2024-09-14T03:29:29.052292+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: audit 2024-09-14T03:29:29.059577+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: audit 2024-09-14T03:29:29.062122+0000 mon.a (mon.0) 2591 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:30 smithi171 bash[25040]: audit 2024-09-14T03:29:29.064413+0000 mgr.a (mgr.14355) 13344 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:29:31.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:31.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:31.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:31 smithi131 bash[24745]: audit 2024-09-14T03:29:29.790240+0000 mgr.a (mgr.14355) 13345 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:29:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:31 smithi131 bash[24745]: cephadm 2024-09-14T03:29:29.791893+0000 mgr.a (mgr.14355) 13346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:29:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:31 smithi171 bash[25040]: audit 2024-09-14T03:29:29.790240+0000 mgr.a (mgr.14355) 13345 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:29:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:31 smithi171 bash[25040]: cephadm 2024-09-14T03:29:29.791893+0000 mgr.a (mgr.14355) 13346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:29:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:31 smithi007 bash[22722]: audit 2024-09-14T03:29:29.790240+0000 mgr.a (mgr.14355) 13345 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:29:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:31 smithi007 bash[22722]: cephadm 2024-09-14T03:29:29.791893+0000 mgr.a (mgr.14355) 13346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:29:32.003 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:32.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:32.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:32 smithi131 bash[24745]: cluster 2024-09-14T03:29:30.935621+0000 mgr.a (mgr.14355) 13347 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:32 smithi171 bash[25040]: cluster 2024-09-14T03:29:30.935621+0000 mgr.a (mgr.14355) 13347 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:32 smithi007 bash[22722]: cluster 2024-09-14T03:29:30.935621+0000 mgr.a (mgr.14355) 13347 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:33 smithi131 bash[24745]: audit 2024-09-14T03:29:31.593440+0000 mgr.a (mgr.14355) 13348 : audit [DBG] from='client.290475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:33 smithi171 bash[25040]: audit 2024-09-14T03:29:31.593440+0000 mgr.a (mgr.14355) 13348 : audit [DBG] from='client.290475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:33 smithi007 bash[22722]: audit 2024-09-14T03:29:31.593440+0000 mgr.a (mgr.14355) 13348 : audit [DBG] from='client.290475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:34 smithi131 bash[24745]: cluster 2024-09-14T03:29:32.936520+0000 mgr.a (mgr.14355) 13349 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:34 smithi171 bash[25040]: cluster 2024-09-14T03:29:32.936520+0000 mgr.a (mgr.14355) 13349 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:34 smithi007 bash[22722]: cluster 2024-09-14T03:29:32.936520+0000 mgr.a (mgr.14355) 13349 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:36 smithi131 bash[24745]: cluster 2024-09-14T03:29:34.937295+0000 mgr.a (mgr.14355) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:36 smithi171 bash[25040]: cluster 2024-09-14T03:29:34.937295+0000 mgr.a (mgr.14355) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:36 smithi007 bash[22722]: cluster 2024-09-14T03:29:34.937295+0000 mgr.a (mgr.14355) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:29:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:37.005 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:37.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:37.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:38 smithi171 bash[25040]: cluster 2024-09-14T03:29:36.939533+0000 mgr.a (mgr.14355) 13351 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:38 smithi007 bash[22722]: cluster 2024-09-14T03:29:36.939533+0000 mgr.a (mgr.14355) 13351 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:38 smithi131 bash[24745]: cluster 2024-09-14T03:29:36.939533+0000 mgr.a (mgr.14355) 13351 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:39 smithi171 bash[25040]: audit 2024-09-14T03:29:37.343729+0000 mgr.a (mgr.14355) 13352 : audit [DBG] from='client.290553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:39 smithi007 bash[22722]: audit 2024-09-14T03:29:37.343729+0000 mgr.a (mgr.14355) 13352 : audit [DBG] from='client.290553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:39 smithi131 bash[24745]: audit 2024-09-14T03:29:37.343729+0000 mgr.a (mgr.14355) 13352 : audit [DBG] from='client.290553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:40 smithi007 bash[22722]: cluster 2024-09-14T03:29:38.940656+0000 mgr.a (mgr.14355) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:40 smithi131 bash[24745]: cluster 2024-09-14T03:29:38.940656+0000 mgr.a (mgr.14355) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:40 smithi171 bash[25040]: cluster 2024-09-14T03:29:38.940656+0000 mgr.a (mgr.14355) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:42 smithi007 bash[22722]: cluster 2024-09-14T03:29:40.942914+0000 mgr.a (mgr.14355) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:42 smithi131 bash[24745]: cluster 2024-09-14T03:29:40.942914+0000 mgr.a (mgr.14355) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:42 smithi171 bash[25040]: cluster 2024-09-14T03:29:40.942914+0000 mgr.a (mgr.14355) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:29:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:43.555 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:44 smithi007 bash[22722]: cluster 2024-09-14T03:29:42.943490+0000 mgr.a (mgr.14355) 13355 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:44 smithi007 bash[22722]: audit 2024-09-14T03:29:43.126262+0000 mgr.a (mgr.14355) 13356 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:44 smithi131 bash[24745]: cluster 2024-09-14T03:29:42.943490+0000 mgr.a (mgr.14355) 13355 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:44 smithi131 bash[24745]: audit 2024-09-14T03:29:43.126262+0000 mgr.a (mgr.14355) 13356 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:44 smithi171 bash[25040]: cluster 2024-09-14T03:29:42.943490+0000 mgr.a (mgr.14355) 13355 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:44 smithi171 bash[25040]: audit 2024-09-14T03:29:43.126262+0000 mgr.a (mgr.14355) 13356 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:46 smithi007 bash[22722]: cluster 2024-09-14T03:29:44.944492+0000 mgr.a (mgr.14355) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:46 smithi131 bash[24745]: cluster 2024-09-14T03:29:44.944492+0000 mgr.a (mgr.14355) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:46 smithi171 bash[25040]: cluster 2024-09-14T03:29:44.944492+0000 mgr.a (mgr.14355) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:48 smithi007 bash[22722]: cluster 2024-09-14T03:29:46.946929+0000 mgr.a (mgr.14355) 13358 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:48 smithi131 bash[24745]: cluster 2024-09-14T03:29:46.946929+0000 mgr.a (mgr.14355) 13358 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:48 smithi171 bash[25040]: cluster 2024-09-14T03:29:46.946929+0000 mgr.a (mgr.14355) 13358 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:48.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:48.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:48.558 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:49.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:49.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:49.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:50 smithi007 bash[22722]: audit 2024-09-14T03:29:48.888984+0000 mgr.a (mgr.14355) 13359 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:50 smithi007 bash[22722]: cluster 2024-09-14T03:29:48.947559+0000 mgr.a (mgr.14355) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:50 smithi131 bash[24745]: audit 2024-09-14T03:29:48.888984+0000 mgr.a (mgr.14355) 13359 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:50 smithi131 bash[24745]: cluster 2024-09-14T03:29:48.947559+0000 mgr.a (mgr.14355) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:50 smithi171 bash[25040]: audit 2024-09-14T03:29:48.888984+0000 mgr.a (mgr.14355) 13359 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:50 smithi171 bash[25040]: cluster 2024-09-14T03:29:48.947559+0000 mgr.a (mgr.14355) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:52 smithi007 bash[22722]: cluster 2024-09-14T03:29:50.949851+0000 mgr.a (mgr.14355) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:52 smithi131 bash[24745]: cluster 2024-09-14T03:29:50.949851+0000 mgr.a (mgr.14355) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:52 smithi171 bash[25040]: cluster 2024-09-14T03:29:50.949851+0000 mgr.a (mgr.14355) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:54.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:29:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:29:54.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:29:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:54 smithi007 bash[22722]: cluster 2024-09-14T03:29:52.950604+0000 mgr.a (mgr.14355) 13362 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:54 smithi131 bash[24745]: cluster 2024-09-14T03:29:52.950604+0000 mgr.a (mgr.14355) 13362 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:54 smithi171 bash[25040]: cluster 2024-09-14T03:29:52.950604+0000 mgr.a (mgr.14355) 13362 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:55.057 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:29:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:29:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:29:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:29:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:29:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:56 smithi007 bash[22722]: audit 2024-09-14T03:29:54.642144+0000 mgr.a (mgr.14355) 13363 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:56 smithi007 bash[22722]: cluster 2024-09-14T03:29:54.959443+0000 mgr.a (mgr.14355) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:56 smithi131 bash[24745]: audit 2024-09-14T03:29:54.642144+0000 mgr.a (mgr.14355) 13363 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:56 smithi131 bash[24745]: cluster 2024-09-14T03:29:54.959443+0000 mgr.a (mgr.14355) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:56 smithi171 bash[25040]: audit 2024-09-14T03:29:54.642144+0000 mgr.a (mgr.14355) 13363 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:29:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:56 smithi171 bash[25040]: cluster 2024-09-14T03:29:54.959443+0000 mgr.a (mgr.14355) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:29:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:29:58 smithi007 bash[22722]: cluster 2024-09-14T03:29:56.961687+0000 mgr.a (mgr.14355) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:29:58 smithi131 bash[24745]: cluster 2024-09-14T03:29:56.961687+0000 mgr.a (mgr.14355) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:29:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:29:58 smithi171 bash[25040]: cluster 2024-09-14T03:29:56.961687+0000 mgr.a (mgr.14355) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:00.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:00.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:00.060 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:00 smithi007 bash[22722]: cluster 2024-09-14T03:29:58.962493+0000 mgr.a (mgr.14355) 13366 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:00 smithi007 bash[22722]: cluster 2024-09-14T03:30:00.000154+0000 mon.a (mon.0) 2592 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:30:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:00 smithi131 bash[24745]: cluster 2024-09-14T03:29:58.962493+0000 mgr.a (mgr.14355) 13366 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:00 smithi131 bash[24745]: cluster 2024-09-14T03:30:00.000154+0000 mon.a (mon.0) 2592 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:30:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:00 smithi171 bash[25040]: cluster 2024-09-14T03:29:58.962493+0000 mgr.a (mgr.14355) 13366 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:00 smithi171 bash[25040]: cluster 2024-09-14T03:30:00.000154+0000 mon.a (mon.0) 2592 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:30:00.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:00.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:00.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:02 smithi007 bash[22722]: audit 2024-09-14T03:30:00.395205+0000 mgr.a (mgr.14355) 13367 : audit [DBG] from='client.290862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:02 smithi007 bash[22722]: cluster 2024-09-14T03:30:00.965214+0000 mgr.a (mgr.14355) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:02 smithi131 bash[24745]: audit 2024-09-14T03:30:00.395205+0000 mgr.a (mgr.14355) 13367 : audit [DBG] from='client.290862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:02 smithi131 bash[24745]: cluster 2024-09-14T03:30:00.965214+0000 mgr.a (mgr.14355) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:02 smithi171 bash[25040]: audit 2024-09-14T03:30:00.395205+0000 mgr.a (mgr.14355) 13367 : audit [DBG] from='client.290862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:02 smithi171 bash[25040]: cluster 2024-09-14T03:30:00.965214+0000 mgr.a (mgr.14355) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:04 smithi007 bash[22722]: cluster 2024-09-14T03:30:02.965968+0000 mgr.a (mgr.14355) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:04 smithi131 bash[24745]: cluster 2024-09-14T03:30:02.965968+0000 mgr.a (mgr.14355) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:04 smithi171 bash[25040]: cluster 2024-09-14T03:30:02.965968+0000 mgr.a (mgr.14355) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:05.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:06 smithi007 bash[22722]: cluster 2024-09-14T03:30:04.966780+0000 mgr.a (mgr.14355) 13370 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:06 smithi131 bash[24745]: cluster 2024-09-14T03:30:04.966780+0000 mgr.a (mgr.14355) 13370 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:06 smithi171 bash[25040]: cluster 2024-09-14T03:30:04.966780+0000 mgr.a (mgr.14355) 13370 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:06.598 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:06.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:07 smithi007 bash[22722]: audit 2024-09-14T03:30:06.154207+0000 mgr.a (mgr.14355) 13371 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:07 smithi131 bash[24745]: audit 2024-09-14T03:30:06.154207+0000 mgr.a (mgr.14355) 13371 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:07 smithi171 bash[25040]: audit 2024-09-14T03:30:06.154207+0000 mgr.a (mgr.14355) 13371 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:08 smithi007 bash[22722]: cluster 2024-09-14T03:30:06.969637+0000 mgr.a (mgr.14355) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:08 smithi131 bash[24745]: cluster 2024-09-14T03:30:06.969637+0000 mgr.a (mgr.14355) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:08 smithi171 bash[25040]: cluster 2024-09-14T03:30:06.969637+0000 mgr.a (mgr.14355) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:10 smithi007 bash[22722]: cluster 2024-09-14T03:30:08.970497+0000 mgr.a (mgr.14355) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:10 smithi131 bash[24745]: cluster 2024-09-14T03:30:08.970497+0000 mgr.a (mgr.14355) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:10 smithi171 bash[25040]: cluster 2024-09-14T03:30:08.970497+0000 mgr.a (mgr.14355) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:30:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:12.378 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:12.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:12 smithi007 bash[22722]: cluster 2024-09-14T03:30:10.972466+0000 mgr.a (mgr.14355) 13374 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:12 smithi131 bash[24745]: cluster 2024-09-14T03:30:10.972466+0000 mgr.a (mgr.14355) 13374 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:12 smithi171 bash[25040]: cluster 2024-09-14T03:30:10.972466+0000 mgr.a (mgr.14355) 13374 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:13 smithi007 bash[22722]: audit 2024-09-14T03:30:11.931775+0000 mgr.a (mgr.14355) 13375 : audit [DBG] from='client.291012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:13 smithi131 bash[24745]: audit 2024-09-14T03:30:11.931775+0000 mgr.a (mgr.14355) 13375 : audit [DBG] from='client.291012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:13 smithi171 bash[25040]: audit 2024-09-14T03:30:11.931775+0000 mgr.a (mgr.14355) 13375 : audit [DBG] from='client.291012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:14 smithi007 bash[22722]: cluster 2024-09-14T03:30:12.973416+0000 mgr.a (mgr.14355) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:14 smithi131 bash[24745]: cluster 2024-09-14T03:30:12.973416+0000 mgr.a (mgr.14355) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:14 smithi171 bash[25040]: cluster 2024-09-14T03:30:12.973416+0000 mgr.a (mgr.14355) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:16 smithi007 bash[22722]: cluster 2024-09-14T03:30:14.974210+0000 mgr.a (mgr.14355) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:16 smithi131 bash[24745]: cluster 2024-09-14T03:30:14.974210+0000 mgr.a (mgr.14355) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:16 smithi171 bash[25040]: cluster 2024-09-14T03:30:14.974210+0000 mgr.a (mgr.14355) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:17.380 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:17.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:18.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:18.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:18.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:18.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:18.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:18 smithi007 bash[22722]: cluster 2024-09-14T03:30:16.976471+0000 mgr.a (mgr.14355) 13378 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:18 smithi131 bash[24745]: cluster 2024-09-14T03:30:16.976471+0000 mgr.a (mgr.14355) 13378 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:18 smithi171 bash[25040]: cluster 2024-09-14T03:30:16.976471+0000 mgr.a (mgr.14355) 13378 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:19 smithi007 bash[22722]: audit 2024-09-14T03:30:17.711223+0000 mgr.a (mgr.14355) 13379 : audit [DBG] from='client.291090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:19 smithi131 bash[24745]: audit 2024-09-14T03:30:17.711223+0000 mgr.a (mgr.14355) 13379 : audit [DBG] from='client.291090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:19 smithi171 bash[25040]: audit 2024-09-14T03:30:17.711223+0000 mgr.a (mgr.14355) 13379 : audit [DBG] from='client.291090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:20 smithi007 bash[22722]: cluster 2024-09-14T03:30:18.977433+0000 mgr.a (mgr.14355) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:20 smithi131 bash[24745]: cluster 2024-09-14T03:30:18.977433+0000 mgr.a (mgr.14355) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:20 smithi171 bash[25040]: cluster 2024-09-14T03:30:18.977433+0000 mgr.a (mgr.14355) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:22 smithi007 bash[22722]: cluster 2024-09-14T03:30:20.979703+0000 mgr.a (mgr.14355) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:22 smithi131 bash[24745]: cluster 2024-09-14T03:30:20.979703+0000 mgr.a (mgr.14355) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:22 smithi171 bash[25040]: cluster 2024-09-14T03:30:20.979703+0000 mgr.a (mgr.14355) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:23.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:23.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:23.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:23.908 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:23.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:23.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:24 smithi007 bash[22722]: cluster 2024-09-14T03:30:22.980471+0000 mgr.a (mgr.14355) 13382 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:24 smithi131 bash[24745]: cluster 2024-09-14T03:30:22.980471+0000 mgr.a (mgr.14355) 13382 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:24 smithi171 bash[25040]: cluster 2024-09-14T03:30:22.980471+0000 mgr.a (mgr.14355) 13382 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:25 smithi007 bash[22722]: audit 2024-09-14T03:30:23.482737+0000 mgr.a (mgr.14355) 13383 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:25 smithi131 bash[24745]: audit 2024-09-14T03:30:23.482737+0000 mgr.a (mgr.14355) 13383 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:25 smithi171 bash[25040]: audit 2024-09-14T03:30:23.482737+0000 mgr.a (mgr.14355) 13383 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:26 smithi007 bash[22722]: cluster 2024-09-14T03:30:24.981429+0000 mgr.a (mgr.14355) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:26 smithi131 bash[24745]: cluster 2024-09-14T03:30:24.981429+0000 mgr.a (mgr.14355) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:26 smithi171 bash[25040]: cluster 2024-09-14T03:30:24.981429+0000 mgr.a (mgr.14355) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:28 smithi007 bash[22722]: cluster 2024-09-14T03:30:26.983710+0000 mgr.a (mgr.14355) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:28 smithi131 bash[24745]: cluster 2024-09-14T03:30:26.983710+0000 mgr.a (mgr.14355) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:28 smithi171 bash[25040]: cluster 2024-09-14T03:30:26.983710+0000 mgr.a (mgr.14355) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:28.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:29.666 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:30 smithi007 bash[22722]: cluster 2024-09-14T03:30:28.984276+0000 mgr.a (mgr.14355) 13386 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:30 smithi007 bash[22722]: audit 2024-09-14T03:30:29.241881+0000 mgr.a (mgr.14355) 13387 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:30 smithi007 bash[22722]: audit 2024-09-14T03:30:29.843762+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:30:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:30 smithi131 bash[24745]: cluster 2024-09-14T03:30:28.984276+0000 mgr.a (mgr.14355) 13386 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:30 smithi131 bash[24745]: audit 2024-09-14T03:30:29.241881+0000 mgr.a (mgr.14355) 13387 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:30 smithi131 bash[24745]: audit 2024-09-14T03:30:29.843762+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:30:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:30 smithi171 bash[25040]: cluster 2024-09-14T03:30:28.984276+0000 mgr.a (mgr.14355) 13386 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:30 smithi171 bash[25040]: audit 2024-09-14T03:30:29.241881+0000 mgr.a (mgr.14355) 13387 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:30 smithi171 bash[25040]: audit 2024-09-14T03:30:29.843762+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:30:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:30.459233+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:30.463200+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: cluster 2024-09-14T03:30:30.985669+0000 mgr.a (mgr.14355) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:31.095458+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:31.097330+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:31.106252+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:31.111137+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:31.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:31 smithi131 bash[24745]: audit 2024-09-14T03:30:31.112611+0000 mgr.a (mgr.14355) 13389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:30.459233+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:30.463200+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: cluster 2024-09-14T03:30:30.985669+0000 mgr.a (mgr.14355) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:31.095458+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:31.097330+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:31.106252+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:31.111137+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:31 smithi171 bash[25040]: audit 2024-09-14T03:30:31.112611+0000 mgr.a (mgr.14355) 13389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:31.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:30.459233+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:30.463200+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: cluster 2024-09-14T03:30:30.985669+0000 mgr.a (mgr.14355) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:31.095458+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:31.097330+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:31.106252+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:31.111137+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:31.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22722]: audit 2024-09-14T03:30:31.112611+0000 mgr.a (mgr.14355) 13389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:30:32.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22972]: debug 2024-09-14T03:30:31.865+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:30:32.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:30:31 smithi007 bash[22972]: debug 2024-09-14T03:30:31.865+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:30:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:32 smithi131 bash[24745]: audit 2024-09-14T03:30:31.868181+0000 mgr.a (mgr.14355) 13390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:30:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:32 smithi131 bash[24745]: cephadm 2024-09-14T03:30:31.869709+0000 mgr.a (mgr.14355) 13391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:30:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:32 smithi171 bash[25040]: audit 2024-09-14T03:30:31.868181+0000 mgr.a (mgr.14355) 13390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:30:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:32 smithi171 bash[25040]: cephadm 2024-09-14T03:30:31.869709+0000 mgr.a (mgr.14355) 13391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:30:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:32 smithi007 bash[22722]: audit 2024-09-14T03:30:31.868181+0000 mgr.a (mgr.14355) 13390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:30:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:32 smithi007 bash[22722]: cephadm 2024-09-14T03:30:31.869709+0000 mgr.a (mgr.14355) 13391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:30:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:33 smithi131 bash[24745]: cluster 2024-09-14T03:30:32.986761+0000 mgr.a (mgr.14355) 13392 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:33 smithi171 bash[25040]: cluster 2024-09-14T03:30:32.986761+0000 mgr.a (mgr.14355) 13392 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:33 smithi007 bash[22722]: cluster 2024-09-14T03:30:32.986761+0000 mgr.a (mgr.14355) 13392 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:35.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:35.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:36 smithi171 bash[25040]: cluster 2024-09-14T03:30:34.987551+0000 mgr.a (mgr.14355) 13393 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:36 smithi171 bash[25040]: audit 2024-09-14T03:30:35.005011+0000 mgr.a (mgr.14355) 13394 : audit [DBG] from='client.291414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:36 smithi007 bash[22722]: cluster 2024-09-14T03:30:34.987551+0000 mgr.a (mgr.14355) 13393 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:36 smithi007 bash[22722]: audit 2024-09-14T03:30:35.005011+0000 mgr.a (mgr.14355) 13394 : audit [DBG] from='client.291414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:36 smithi131 bash[24745]: cluster 2024-09-14T03:30:34.987551+0000 mgr.a (mgr.14355) 13393 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:36 smithi131 bash[24745]: audit 2024-09-14T03:30:35.005011+0000 mgr.a (mgr.14355) 13394 : audit [DBG] from='client.291414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:38 smithi007 bash[22722]: cluster 2024-09-14T03:30:36.990260+0000 mgr.a (mgr.14355) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:38 smithi131 bash[24745]: cluster 2024-09-14T03:30:36.990260+0000 mgr.a (mgr.14355) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:38.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:38 smithi171 bash[25040]: cluster 2024-09-14T03:30:36.990260+0000 mgr.a (mgr.14355) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:40.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:40 smithi007 bash[22722]: cluster 2024-09-14T03:30:38.991094+0000 mgr.a (mgr.14355) 13396 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:40 smithi131 bash[24745]: cluster 2024-09-14T03:30:38.991094+0000 mgr.a (mgr.14355) 13396 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:40 smithi171 bash[25040]: cluster 2024-09-14T03:30:38.991094+0000 mgr.a (mgr.14355) 13396 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:41.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:41.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:41.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:41.206 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:41.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:42 smithi007 bash[22722]: audit 2024-09-14T03:30:40.783464+0000 mgr.a (mgr.14355) 13397 : audit [DBG] from='client.291489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:42 smithi007 bash[22722]: cluster 2024-09-14T03:30:40.992348+0000 mgr.a (mgr.14355) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:42 smithi131 bash[24745]: audit 2024-09-14T03:30:40.783464+0000 mgr.a (mgr.14355) 13397 : audit [DBG] from='client.291489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:42 smithi131 bash[24745]: cluster 2024-09-14T03:30:40.992348+0000 mgr.a (mgr.14355) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:42 smithi171 bash[25040]: audit 2024-09-14T03:30:40.783464+0000 mgr.a (mgr.14355) 13397 : audit [DBG] from='client.291489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:42 smithi171 bash[25040]: cluster 2024-09-14T03:30:40.992348+0000 mgr.a (mgr.14355) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:44 smithi007 bash[22722]: cluster 2024-09-14T03:30:42.993188+0000 mgr.a (mgr.14355) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:44 smithi131 bash[24745]: cluster 2024-09-14T03:30:42.993188+0000 mgr.a (mgr.14355) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:44 smithi171 bash[25040]: cluster 2024-09-14T03:30:42.993188+0000 mgr.a (mgr.14355) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:46.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:46.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:46 smithi007 bash[22722]: cluster 2024-09-14T03:30:44.993979+0000 mgr.a (mgr.14355) 13400 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:46 smithi131 bash[24745]: cluster 2024-09-14T03:30:44.993979+0000 mgr.a (mgr.14355) 13400 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:46 smithi171 bash[25040]: cluster 2024-09-14T03:30:44.993979+0000 mgr.a (mgr.14355) 13400 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:30:46.992 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:46.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:46.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:46.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:46.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:48 smithi007 bash[22722]: audit 2024-09-14T03:30:46.543402+0000 mgr.a (mgr.14355) 13401 : audit [DBG] from='client.291567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:48 smithi007 bash[22722]: cluster 2024-09-14T03:30:46.995511+0000 mgr.a (mgr.14355) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:48 smithi131 bash[24745]: audit 2024-09-14T03:30:46.543402+0000 mgr.a (mgr.14355) 13401 : audit [DBG] from='client.291567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:48 smithi131 bash[24745]: cluster 2024-09-14T03:30:46.995511+0000 mgr.a (mgr.14355) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:48 smithi171 bash[25040]: audit 2024-09-14T03:30:46.543402+0000 mgr.a (mgr.14355) 13401 : audit [DBG] from='client.291567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:48 smithi171 bash[25040]: cluster 2024-09-14T03:30:46.995511+0000 mgr.a (mgr.14355) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:30:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:50 smithi007 bash[22722]: cluster 2024-09-14T03:30:48.996307+0000 mgr.a (mgr.14355) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:30:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:50 smithi131 bash[24745]: cluster 2024-09-14T03:30:48.996307+0000 mgr.a (mgr.14355) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:30:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:50 smithi171 bash[25040]: cluster 2024-09-14T03:30:48.996307+0000 mgr.a (mgr.14355) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:30:51.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:51.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:51.995 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:52 smithi007 bash[22722]: cluster 2024-09-14T03:30:50.998257+0000 mgr.a (mgr.14355) 13404 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:30:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:52 smithi131 bash[24745]: cluster 2024-09-14T03:30:50.998257+0000 mgr.a (mgr.14355) 13404 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:30:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:52 smithi171 bash[25040]: cluster 2024-09-14T03:30:50.998257+0000 mgr.a (mgr.14355) 13404 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:30:52.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:53 smithi007 bash[22722]: audit 2024-09-14T03:30:52.324498+0000 mgr.a (mgr.14355) 13405 : audit [DBG] from='client.291642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:53 smithi131 bash[24745]: audit 2024-09-14T03:30:52.324498+0000 mgr.a (mgr.14355) 13405 : audit [DBG] from='client.291642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:53 smithi171 bash[25040]: audit 2024-09-14T03:30:52.324498+0000 mgr.a (mgr.14355) 13405 : audit [DBG] from='client.291642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:54 smithi007 bash[22722]: cluster 2024-09-14T03:30:52.999312+0000 mgr.a (mgr.14355) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:54 smithi131 bash[24745]: cluster 2024-09-14T03:30:52.999312+0000 mgr.a (mgr.14355) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:54 smithi171 bash[25040]: cluster 2024-09-14T03:30:52.999312+0000 mgr.a (mgr.14355) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:56 smithi007 bash[22722]: cluster 2024-09-14T03:30:55.000157+0000 mgr.a (mgr.14355) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:56 smithi131 bash[24745]: cluster 2024-09-14T03:30:55.000157+0000 mgr.a (mgr.14355) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:56 smithi171 bash[25040]: cluster 2024-09-14T03:30:55.000157+0000 mgr.a (mgr.14355) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:30:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:30:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:30:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:30:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:58 smithi007 bash[22722]: cluster 2024-09-14T03:30:57.002375+0000 mgr.a (mgr.14355) 13408 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:58.483 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:30:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:30:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:30:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:30:58.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:30:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:58 smithi131 bash[24745]: cluster 2024-09-14T03:30:57.002375+0000 mgr.a (mgr.14355) 13408 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:58 smithi171 bash[25040]: cluster 2024-09-14T03:30:57.002375+0000 mgr.a (mgr.14355) 13408 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:30:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:30:59 smithi007 bash[22722]: audit 2024-09-14T03:30:58.065541+0000 mgr.a (mgr.14355) 13409 : audit [DBG] from='client.291714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:30:59 smithi131 bash[24745]: audit 2024-09-14T03:30:58.065541+0000 mgr.a (mgr.14355) 13409 : audit [DBG] from='client.291714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:30:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:30:59 smithi171 bash[25040]: audit 2024-09-14T03:30:58.065541+0000 mgr.a (mgr.14355) 13409 : audit [DBG] from='client.291714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:00 smithi007 bash[22722]: cluster 2024-09-14T03:30:59.003353+0000 mgr.a (mgr.14355) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:00 smithi131 bash[24745]: cluster 2024-09-14T03:30:59.003353+0000 mgr.a (mgr.14355) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:00 smithi171 bash[25040]: cluster 2024-09-14T03:30:59.003353+0000 mgr.a (mgr.14355) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:02 smithi007 bash[22722]: cluster 2024-09-14T03:31:01.005565+0000 mgr.a (mgr.14355) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:02 smithi131 bash[24745]: cluster 2024-09-14T03:31:01.005565+0000 mgr.a (mgr.14355) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:02 smithi171 bash[25040]: cluster 2024-09-14T03:31:01.005565+0000 mgr.a (mgr.14355) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:04.270 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:04 smithi007 bash[22722]: cluster 2024-09-14T03:31:03.006367+0000 mgr.a (mgr.14355) 13412 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:04 smithi131 bash[24745]: cluster 2024-09-14T03:31:03.006367+0000 mgr.a (mgr.14355) 13412 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:04 smithi171 bash[25040]: cluster 2024-09-14T03:31:03.006367+0000 mgr.a (mgr.14355) 13412 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:05 smithi007 bash[22722]: audit 2024-09-14T03:31:03.821808+0000 mgr.a (mgr.14355) 13413 : audit [DBG] from='client.291789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:05 smithi131 bash[24745]: audit 2024-09-14T03:31:03.821808+0000 mgr.a (mgr.14355) 13413 : audit [DBG] from='client.291789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:05 smithi171 bash[25040]: audit 2024-09-14T03:31:03.821808+0000 mgr.a (mgr.14355) 13413 : audit [DBG] from='client.291789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:06 smithi007 bash[22722]: cluster 2024-09-14T03:31:05.007266+0000 mgr.a (mgr.14355) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:06 smithi131 bash[24745]: cluster 2024-09-14T03:31:05.007266+0000 mgr.a (mgr.14355) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:06 smithi171 bash[25040]: cluster 2024-09-14T03:31:05.007266+0000 mgr.a (mgr.14355) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:08 smithi007 bash[22722]: cluster 2024-09-14T03:31:07.009553+0000 mgr.a (mgr.14355) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:08 smithi131 bash[24745]: cluster 2024-09-14T03:31:07.009553+0000 mgr.a (mgr.14355) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:08 smithi171 bash[25040]: cluster 2024-09-14T03:31:07.009553+0000 mgr.a (mgr.14355) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:09.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:09.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:10.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:10.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:10 smithi007 bash[22722]: cluster 2024-09-14T03:31:09.010356+0000 mgr.a (mgr.14355) 13416 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:10 smithi131 bash[24745]: cluster 2024-09-14T03:31:09.010356+0000 mgr.a (mgr.14355) 13416 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:10 smithi171 bash[25040]: cluster 2024-09-14T03:31:09.010356+0000 mgr.a (mgr.14355) 13416 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:11 smithi131 bash[24745]: audit 2024-09-14T03:31:09.603722+0000 mgr.a (mgr.14355) 13417 : audit [DBG] from='client.291864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:11 smithi171 bash[25040]: audit 2024-09-14T03:31:09.603722+0000 mgr.a (mgr.14355) 13417 : audit [DBG] from='client.291864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:11 smithi007 bash[22722]: audit 2024-09-14T03:31:09.603722+0000 mgr.a (mgr.14355) 13417 : audit [DBG] from='client.291864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:12 smithi131 bash[24745]: cluster 2024-09-14T03:31:11.012695+0000 mgr.a (mgr.14355) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:12 smithi171 bash[25040]: cluster 2024-09-14T03:31:11.012695+0000 mgr.a (mgr.14355) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:12 smithi007 bash[22722]: cluster 2024-09-14T03:31:11.012695+0000 mgr.a (mgr.14355) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:14 smithi131 bash[24745]: cluster 2024-09-14T03:31:13.013452+0000 mgr.a (mgr.14355) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:14 smithi171 bash[25040]: cluster 2024-09-14T03:31:13.013452+0000 mgr.a (mgr.14355) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:14 smithi007 bash[22722]: cluster 2024-09-14T03:31:13.013452+0000 mgr.a (mgr.14355) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:15.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:15.028 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:15.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:16 smithi131 bash[24745]: cluster 2024-09-14T03:31:15.014223+0000 mgr.a (mgr.14355) 13420 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:16.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:16 smithi171 bash[25040]: cluster 2024-09-14T03:31:15.014223+0000 mgr.a (mgr.14355) 13420 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:16 smithi007 bash[22722]: cluster 2024-09-14T03:31:15.014223+0000 mgr.a (mgr.14355) 13420 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:17 smithi131 bash[24745]: audit 2024-09-14T03:31:15.363742+0000 mgr.a (mgr.14355) 13421 : audit [DBG] from='client.291939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:17 smithi171 bash[25040]: audit 2024-09-14T03:31:15.363742+0000 mgr.a (mgr.14355) 13421 : audit [DBG] from='client.291939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:17 smithi007 bash[22722]: audit 2024-09-14T03:31:15.363742+0000 mgr.a (mgr.14355) 13421 : audit [DBG] from='client.291939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:18 smithi131 bash[24745]: cluster 2024-09-14T03:31:17.016976+0000 mgr.a (mgr.14355) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:18 smithi171 bash[25040]: cluster 2024-09-14T03:31:17.016976+0000 mgr.a (mgr.14355) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:18 smithi007 bash[22722]: cluster 2024-09-14T03:31:17.016976+0000 mgr.a (mgr.14355) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:20 smithi131 bash[24745]: cluster 2024-09-14T03:31:19.017767+0000 mgr.a (mgr.14355) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:20 smithi171 bash[25040]: cluster 2024-09-14T03:31:19.017767+0000 mgr.a (mgr.14355) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:20 smithi007 bash[22722]: cluster 2024-09-14T03:31:19.017767+0000 mgr.a (mgr.14355) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:20.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:20.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:20.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:21.531 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:21.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:21.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:21.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:21.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:22 smithi131 bash[24745]: cluster 2024-09-14T03:31:21.018956+0000 mgr.a (mgr.14355) 13424 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:22.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:22 smithi131 bash[24745]: audit 2024-09-14T03:31:21.108389+0000 mgr.a (mgr.14355) 13425 : audit [DBG] from='client.292017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:22 smithi171 bash[25040]: cluster 2024-09-14T03:31:21.018956+0000 mgr.a (mgr.14355) 13424 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:22 smithi171 bash[25040]: audit 2024-09-14T03:31:21.108389+0000 mgr.a (mgr.14355) 13425 : audit [DBG] from='client.292017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:22 smithi007 bash[22722]: cluster 2024-09-14T03:31:21.018956+0000 mgr.a (mgr.14355) 13424 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:22 smithi007 bash[22722]: audit 2024-09-14T03:31:21.108389+0000 mgr.a (mgr.14355) 13425 : audit [DBG] from='client.292017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:24 smithi131 bash[24745]: cluster 2024-09-14T03:31:23.019789+0000 mgr.a (mgr.14355) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:24 smithi171 bash[25040]: cluster 2024-09-14T03:31:23.019789+0000 mgr.a (mgr.14355) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:24 smithi007 bash[22722]: cluster 2024-09-14T03:31:23.019789+0000 mgr.a (mgr.14355) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:31:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:26 smithi131 bash[24745]: cluster 2024-09-14T03:31:25.020734+0000 mgr.a (mgr.14355) 13427 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:31:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:26 smithi171 bash[25040]: cluster 2024-09-14T03:31:25.020734+0000 mgr.a (mgr.14355) 13427 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:31:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:26 smithi007 bash[22722]: cluster 2024-09-14T03:31:25.020734+0000 mgr.a (mgr.14355) 13427 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:31:27.292 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:27.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:27.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:27.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:27.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:28 smithi131 bash[24745]: audit 2024-09-14T03:31:26.863140+0000 mgr.a (mgr.14355) 13428 : audit [DBG] from='client.292092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:28 smithi131 bash[24745]: cluster 2024-09-14T03:31:27.022163+0000 mgr.a (mgr.14355) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:28 smithi171 bash[25040]: audit 2024-09-14T03:31:26.863140+0000 mgr.a (mgr.14355) 13428 : audit [DBG] from='client.292092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:28 smithi171 bash[25040]: cluster 2024-09-14T03:31:27.022163+0000 mgr.a (mgr.14355) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:28 smithi007 bash[22722]: audit 2024-09-14T03:31:26.863140+0000 mgr.a (mgr.14355) 13428 : audit [DBG] from='client.292092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:28.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:28 smithi007 bash[22722]: cluster 2024-09-14T03:31:27.022163+0000 mgr.a (mgr.14355) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:30 smithi131 bash[24745]: cluster 2024-09-14T03:31:29.023041+0000 mgr.a (mgr.14355) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:30 smithi171 bash[25040]: cluster 2024-09-14T03:31:29.023041+0000 mgr.a (mgr.14355) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:30 smithi007 bash[22722]: cluster 2024-09-14T03:31:29.023041+0000 mgr.a (mgr.14355) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:32.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:32 smithi131 bash[24745]: cluster 2024-09-14T03:31:31.025229+0000 mgr.a (mgr.14355) 13431 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:32 smithi131 bash[24745]: audit 2024-09-14T03:31:31.935271+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:31:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:32 smithi171 bash[25040]: cluster 2024-09-14T03:31:31.025229+0000 mgr.a (mgr.14355) 13431 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:32 smithi171 bash[25040]: audit 2024-09-14T03:31:31.935271+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:31:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:32 smithi007 bash[22722]: cluster 2024-09-14T03:31:31.025229+0000 mgr.a (mgr.14355) 13431 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:31:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:32 smithi007 bash[22722]: audit 2024-09-14T03:31:31.935271+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:31:33.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:32.550357+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:32.556789+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:32.563461+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:32.567496+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:32.679302+0000 mgr.a (mgr.14355) 13432 : audit [DBG] from='client.292167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: cluster 2024-09-14T03:31:33.025751+0000 mgr.a (mgr.14355) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:33.240269+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:33.241715+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:33.251360+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:33.255901+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:33 smithi007 bash[22722]: audit 2024-09-14T03:31:33.258578+0000 mgr.a (mgr.14355) 13434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:32.550357+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:32.556789+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:32.563461+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:32.567496+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:32.679302+0000 mgr.a (mgr.14355) 13432 : audit [DBG] from='client.292167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: cluster 2024-09-14T03:31:33.025751+0000 mgr.a (mgr.14355) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:33.240269+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:33.241715+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:33.251360+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:33.255901+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:33 smithi131 bash[24745]: audit 2024-09-14T03:31:33.258578+0000 mgr.a (mgr.14355) 13434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:32.550357+0000 mon.a (mon.0) 2601 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:32.556789+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:32.563461+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:32.567496+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:32.679302+0000 mgr.a (mgr.14355) 13432 : audit [DBG] from='client.292167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: cluster 2024-09-14T03:31:33.025751+0000 mgr.a (mgr.14355) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:33.240269+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:33.241715+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:33.251360+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:33.255901+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:34.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:33 smithi171 bash[25040]: audit 2024-09-14T03:31:33.258578+0000 mgr.a (mgr.14355) 13434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:31:34.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:31:34 smithi007 bash[22972]: debug 2024-09-14T03:31:34.008+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:31:34.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:31:34 smithi007 bash[22972]: debug 2024-09-14T03:31:34.008+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:31:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:34 smithi007 bash[22722]: audit 2024-09-14T03:31:34.010807+0000 mgr.a (mgr.14355) 13435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:31:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:34 smithi007 bash[22722]: cephadm 2024-09-14T03:31:34.012238+0000 mgr.a (mgr.14355) 13436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:31:35.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:34 smithi131 bash[24745]: audit 2024-09-14T03:31:34.010807+0000 mgr.a (mgr.14355) 13435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:31:35.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:34 smithi131 bash[24745]: cephadm 2024-09-14T03:31:34.012238+0000 mgr.a (mgr.14355) 13436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:31:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:34 smithi171 bash[25040]: audit 2024-09-14T03:31:34.010807+0000 mgr.a (mgr.14355) 13435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:31:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:34 smithi171 bash[25040]: cephadm 2024-09-14T03:31:34.012238+0000 mgr.a (mgr.14355) 13436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:31:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:35 smithi007 bash[22722]: cluster 2024-09-14T03:31:35.026779+0000 mgr.a (mgr.14355) 13437 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:35 smithi131 bash[24745]: cluster 2024-09-14T03:31:35.026779+0000 mgr.a (mgr.14355) 13437 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:35 smithi171 bash[25040]: cluster 2024-09-14T03:31:35.026779+0000 mgr.a (mgr.14355) 13437 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:38.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:38.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:38.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:38 smithi007 bash[22722]: cluster 2024-09-14T03:31:37.029172+0000 mgr.a (mgr.14355) 13438 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:38 smithi131 bash[24745]: cluster 2024-09-14T03:31:37.029172+0000 mgr.a (mgr.14355) 13438 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:38 smithi171 bash[25040]: cluster 2024-09-14T03:31:37.029172+0000 mgr.a (mgr.14355) 13438 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:38.843 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:38.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:40 smithi007 bash[22722]: audit 2024-09-14T03:31:38.415899+0000 mgr.a (mgr.14355) 13439 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:40 smithi007 bash[22722]: cluster 2024-09-14T03:31:39.030124+0000 mgr.a (mgr.14355) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:40 smithi131 bash[24745]: audit 2024-09-14T03:31:38.415899+0000 mgr.a (mgr.14355) 13439 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:40 smithi131 bash[24745]: cluster 2024-09-14T03:31:39.030124+0000 mgr.a (mgr.14355) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:40 smithi171 bash[25040]: audit 2024-09-14T03:31:38.415899+0000 mgr.a (mgr.14355) 13439 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:40 smithi171 bash[25040]: cluster 2024-09-14T03:31:39.030124+0000 mgr.a (mgr.14355) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:42 smithi007 bash[22722]: cluster 2024-09-14T03:31:41.032328+0000 mgr.a (mgr.14355) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:42 smithi131 bash[24745]: cluster 2024-09-14T03:31:41.032328+0000 mgr.a (mgr.14355) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:42 smithi171 bash[25040]: cluster 2024-09-14T03:31:41.032328+0000 mgr.a (mgr.14355) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:43.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:44 smithi007 bash[22722]: cluster 2024-09-14T03:31:43.033096+0000 mgr.a (mgr.14355) 13442 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:44 smithi131 bash[24745]: cluster 2024-09-14T03:31:43.033096+0000 mgr.a (mgr.14355) 13442 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:44 smithi171 bash[25040]: cluster 2024-09-14T03:31:43.033096+0000 mgr.a (mgr.14355) 13442 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:44.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:44.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:44.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:44.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:44.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:45 smithi007 bash[22722]: audit 2024-09-14T03:31:44.173906+0000 mgr.a (mgr.14355) 13443 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:45 smithi131 bash[24745]: audit 2024-09-14T03:31:44.173906+0000 mgr.a (mgr.14355) 13443 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:45 smithi171 bash[25040]: audit 2024-09-14T03:31:44.173906+0000 mgr.a (mgr.14355) 13443 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:46 smithi007 bash[22722]: cluster 2024-09-14T03:31:45.034071+0000 mgr.a (mgr.14355) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:46 smithi131 bash[24745]: cluster 2024-09-14T03:31:45.034071+0000 mgr.a (mgr.14355) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:46 smithi171 bash[25040]: cluster 2024-09-14T03:31:45.034071+0000 mgr.a (mgr.14355) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:48 smithi007 bash[22722]: cluster 2024-09-14T03:31:47.036372+0000 mgr.a (mgr.14355) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:48 smithi131 bash[24745]: cluster 2024-09-14T03:31:47.036372+0000 mgr.a (mgr.14355) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:48 smithi171 bash[25040]: cluster 2024-09-14T03:31:47.036372+0000 mgr.a (mgr.14355) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:31:49.598 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:49.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:49.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:50.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:50 smithi007 bash[22722]: cluster 2024-09-14T03:31:49.037135+0000 mgr.a (mgr.14355) 13446 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:50 smithi131 bash[24745]: cluster 2024-09-14T03:31:49.037135+0000 mgr.a (mgr.14355) 13446 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:50 smithi171 bash[25040]: cluster 2024-09-14T03:31:49.037135+0000 mgr.a (mgr.14355) 13446 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:51.453 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:51 smithi171 bash[25040]: audit 2024-09-14T03:31:49.934928+0000 mgr.a (mgr.14355) 13447 : audit [DBG] from='client.292506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:51 smithi007 bash[22722]: audit 2024-09-14T03:31:49.934928+0000 mgr.a (mgr.14355) 13447 : audit [DBG] from='client.292506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:51 smithi131 bash[24745]: audit 2024-09-14T03:31:49.934928+0000 mgr.a (mgr.14355) 13447 : audit [DBG] from='client.292506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:52 smithi007 bash[22722]: cluster 2024-09-14T03:31:51.039613+0000 mgr.a (mgr.14355) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:31:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:52 smithi131 bash[24745]: cluster 2024-09-14T03:31:51.039613+0000 mgr.a (mgr.14355) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:31:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:52 smithi171 bash[25040]: cluster 2024-09-14T03:31:51.039613+0000 mgr.a (mgr.14355) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:31:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:54 smithi007 bash[22722]: cluster 2024-09-14T03:31:53.040373+0000 mgr.a (mgr.14355) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:54 smithi131 bash[24745]: cluster 2024-09-14T03:31:53.040373+0000 mgr.a (mgr.14355) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:54 smithi171 bash[25040]: cluster 2024-09-14T03:31:53.040373+0000 mgr.a (mgr.14355) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:55.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:31:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:31:55.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:31:56.184 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:31:56.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:31:56.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:31:56.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:31:56.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:31:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:56 smithi007 bash[22722]: cluster 2024-09-14T03:31:55.041134+0000 mgr.a (mgr.14355) 13450 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:56 smithi131 bash[24745]: cluster 2024-09-14T03:31:55.041134+0000 mgr.a (mgr.14355) 13450 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:56 smithi171 bash[25040]: cluster 2024-09-14T03:31:55.041134+0000 mgr.a (mgr.14355) 13450 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:31:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:57 smithi007 bash[22722]: audit 2024-09-14T03:31:55.728631+0000 mgr.a (mgr.14355) 13451 : audit [DBG] from='client.292581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:57 smithi131 bash[24745]: audit 2024-09-14T03:31:55.728631+0000 mgr.a (mgr.14355) 13451 : audit [DBG] from='client.292581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:57 smithi171 bash[25040]: audit 2024-09-14T03:31:55.728631+0000 mgr.a (mgr.14355) 13451 : audit [DBG] from='client.292581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:31:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:31:58 smithi007 bash[22722]: cluster 2024-09-14T03:31:57.043998+0000 mgr.a (mgr.14355) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:31:58 smithi131 bash[24745]: cluster 2024-09-14T03:31:57.043998+0000 mgr.a (mgr.14355) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:31:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:31:58 smithi171 bash[25040]: cluster 2024-09-14T03:31:57.043998+0000 mgr.a (mgr.14355) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:00 smithi007 bash[22722]: cluster 2024-09-14T03:31:59.044896+0000 mgr.a (mgr.14355) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:00 smithi131 bash[24745]: cluster 2024-09-14T03:31:59.044896+0000 mgr.a (mgr.14355) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:00 smithi171 bash[25040]: cluster 2024-09-14T03:31:59.044896+0000 mgr.a (mgr.14355) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:01.970 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:01.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:01.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:01.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:01.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:02 smithi007 bash[22722]: cluster 2024-09-14T03:32:01.047048+0000 mgr.a (mgr.14355) 13454 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:02 smithi131 bash[24745]: cluster 2024-09-14T03:32:01.047048+0000 mgr.a (mgr.14355) 13454 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:02 smithi171 bash[25040]: cluster 2024-09-14T03:32:01.047048+0000 mgr.a (mgr.14355) 13454 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:03 smithi007 bash[22722]: audit 2024-09-14T03:32:01.518920+0000 mgr.a (mgr.14355) 13455 : audit [DBG] from='client.292656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:03 smithi131 bash[24745]: audit 2024-09-14T03:32:01.518920+0000 mgr.a (mgr.14355) 13455 : audit [DBG] from='client.292656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:03 smithi171 bash[25040]: audit 2024-09-14T03:32:01.518920+0000 mgr.a (mgr.14355) 13455 : audit [DBG] from='client.292656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:04 smithi007 bash[22722]: cluster 2024-09-14T03:32:03.048140+0000 mgr.a (mgr.14355) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:04 smithi131 bash[24745]: cluster 2024-09-14T03:32:03.048140+0000 mgr.a (mgr.14355) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:04 smithi171 bash[25040]: cluster 2024-09-14T03:32:03.048140+0000 mgr.a (mgr.14355) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:06 smithi007 bash[22722]: cluster 2024-09-14T03:32:05.049125+0000 mgr.a (mgr.14355) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:06 smithi131 bash[24745]: cluster 2024-09-14T03:32:05.049125+0000 mgr.a (mgr.14355) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:06 smithi171 bash[25040]: cluster 2024-09-14T03:32:05.049125+0000 mgr.a (mgr.14355) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:32:06.972 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:06.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:06.973 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:07.746 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:07.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:08 smithi007 bash[22722]: cluster 2024-09-14T03:32:07.051469+0000 mgr.a (mgr.14355) 13458 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:08 smithi007 bash[22722]: audit 2024-09-14T03:32:07.307095+0000 mgr.a (mgr.14355) 13459 : audit [DBG] from='client.292734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:08 smithi131 bash[24745]: cluster 2024-09-14T03:32:07.051469+0000 mgr.a (mgr.14355) 13458 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:08 smithi131 bash[24745]: audit 2024-09-14T03:32:07.307095+0000 mgr.a (mgr.14355) 13459 : audit [DBG] from='client.292734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:08 smithi171 bash[25040]: cluster 2024-09-14T03:32:07.051469+0000 mgr.a (mgr.14355) 13458 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:08 smithi171 bash[25040]: audit 2024-09-14T03:32:07.307095+0000 mgr.a (mgr.14355) 13459 : audit [DBG] from='client.292734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:10 smithi007 bash[22722]: cluster 2024-09-14T03:32:09.052407+0000 mgr.a (mgr.14355) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:10 smithi131 bash[24745]: cluster 2024-09-14T03:32:09.052407+0000 mgr.a (mgr.14355) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:10 smithi171 bash[25040]: cluster 2024-09-14T03:32:09.052407+0000 mgr.a (mgr.14355) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:32:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:12 smithi007 bash[22722]: cluster 2024-09-14T03:32:11.054625+0000 mgr.a (mgr.14355) 13461 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:32:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:12 smithi131 bash[24745]: cluster 2024-09-14T03:32:11.054625+0000 mgr.a (mgr.14355) 13461 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:32:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:12 smithi171 bash[25040]: cluster 2024-09-14T03:32:11.054625+0000 mgr.a (mgr.14355) 13461 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:32:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:13.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:14 smithi007 bash[22722]: cluster 2024-09-14T03:32:13.055369+0000 mgr.a (mgr.14355) 13462 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:14 smithi007 bash[22722]: audit 2024-09-14T03:32:13.080646+0000 mgr.a (mgr.14355) 13463 : audit [DBG] from='client.292812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:14 smithi131 bash[24745]: cluster 2024-09-14T03:32:13.055369+0000 mgr.a (mgr.14355) 13462 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:14 smithi131 bash[24745]: audit 2024-09-14T03:32:13.080646+0000 mgr.a (mgr.14355) 13463 : audit [DBG] from='client.292812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:14 smithi171 bash[25040]: cluster 2024-09-14T03:32:13.055369+0000 mgr.a (mgr.14355) 13462 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:14 smithi171 bash[25040]: audit 2024-09-14T03:32:13.080646+0000 mgr.a (mgr.14355) 13463 : audit [DBG] from='client.292812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:16 smithi007 bash[22722]: cluster 2024-09-14T03:32:15.056430+0000 mgr.a (mgr.14355) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:16 smithi131 bash[24745]: cluster 2024-09-14T03:32:15.056430+0000 mgr.a (mgr.14355) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:16 smithi171 bash[25040]: cluster 2024-09-14T03:32:15.056430+0000 mgr.a (mgr.14355) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:18 smithi007 bash[22722]: cluster 2024-09-14T03:32:17.058928+0000 mgr.a (mgr.14355) 13465 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:18.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:18.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:18.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:18 smithi131 bash[24745]: cluster 2024-09-14T03:32:17.058928+0000 mgr.a (mgr.14355) 13465 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:18 smithi171 bash[25040]: cluster 2024-09-14T03:32:17.058928+0000 mgr.a (mgr.14355) 13465 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:19.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:20 smithi007 bash[22722]: audit 2024-09-14T03:32:18.835140+0000 mgr.a (mgr.14355) 13466 : audit [DBG] from='client.292887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:20 smithi007 bash[22722]: cluster 2024-09-14T03:32:19.059569+0000 mgr.a (mgr.14355) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:20 smithi131 bash[24745]: audit 2024-09-14T03:32:18.835140+0000 mgr.a (mgr.14355) 13466 : audit [DBG] from='client.292887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:20 smithi131 bash[24745]: cluster 2024-09-14T03:32:19.059569+0000 mgr.a (mgr.14355) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:20 smithi171 bash[25040]: audit 2024-09-14T03:32:18.835140+0000 mgr.a (mgr.14355) 13466 : audit [DBG] from='client.292887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:20 smithi171 bash[25040]: cluster 2024-09-14T03:32:19.059569+0000 mgr.a (mgr.14355) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:22 smithi131 bash[24745]: cluster 2024-09-14T03:32:21.061875+0000 mgr.a (mgr.14355) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:22 smithi171 bash[25040]: cluster 2024-09-14T03:32:21.061875+0000 mgr.a (mgr.14355) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:22 smithi007 bash[22722]: cluster 2024-09-14T03:32:21.061875+0000 mgr.a (mgr.14355) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:24.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:24 smithi131 bash[24745]: cluster 2024-09-14T03:32:23.062665+0000 mgr.a (mgr.14355) 13469 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:24 smithi171 bash[25040]: cluster 2024-09-14T03:32:23.062665+0000 mgr.a (mgr.14355) 13469 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:24 smithi007 bash[22722]: cluster 2024-09-14T03:32:23.062665+0000 mgr.a (mgr.14355) 13469 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:25.045 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:26 smithi131 bash[24745]: audit 2024-09-14T03:32:24.620286+0000 mgr.a (mgr.14355) 13470 : audit [DBG] from='client.292965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:26 smithi131 bash[24745]: cluster 2024-09-14T03:32:25.063391+0000 mgr.a (mgr.14355) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:26 smithi171 bash[25040]: audit 2024-09-14T03:32:24.620286+0000 mgr.a (mgr.14355) 13470 : audit [DBG] from='client.292965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:26 smithi171 bash[25040]: cluster 2024-09-14T03:32:25.063391+0000 mgr.a (mgr.14355) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:26 smithi007 bash[22722]: audit 2024-09-14T03:32:24.620286+0000 mgr.a (mgr.14355) 13470 : audit [DBG] from='client.292965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:26 smithi007 bash[22722]: cluster 2024-09-14T03:32:25.063391+0000 mgr.a (mgr.14355) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:28 smithi131 bash[24745]: cluster 2024-09-14T03:32:27.065635+0000 mgr.a (mgr.14355) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:28 smithi171 bash[25040]: cluster 2024-09-14T03:32:27.065635+0000 mgr.a (mgr.14355) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:28 smithi007 bash[22722]: cluster 2024-09-14T03:32:27.065635+0000 mgr.a (mgr.14355) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:32:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:30 smithi131 bash[24745]: cluster 2024-09-14T03:32:29.066432+0000 mgr.a (mgr.14355) 13473 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:30 smithi171 bash[25040]: cluster 2024-09-14T03:32:29.066432+0000 mgr.a (mgr.14355) 13473 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:30 smithi007 bash[22722]: cluster 2024-09-14T03:32:29.066432+0000 mgr.a (mgr.14355) 13473 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:30.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:30.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:30.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:30.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:30.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:32 smithi131 bash[24745]: audit 2024-09-14T03:32:30.380597+0000 mgr.a (mgr.14355) 13474 : audit [DBG] from='client.293043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:32 smithi131 bash[24745]: cluster 2024-09-14T03:32:31.069148+0000 mgr.a (mgr.14355) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:32 smithi171 bash[25040]: audit 2024-09-14T03:32:30.380597+0000 mgr.a (mgr.14355) 13474 : audit [DBG] from='client.293043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:32 smithi171 bash[25040]: cluster 2024-09-14T03:32:31.069148+0000 mgr.a (mgr.14355) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:32 smithi007 bash[22722]: audit 2024-09-14T03:32:30.380597+0000 mgr.a (mgr.14355) 13474 : audit [DBG] from='client.293043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:32 smithi007 bash[22722]: cluster 2024-09-14T03:32:31.069148+0000 mgr.a (mgr.14355) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:32:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:34 smithi131 bash[24745]: cluster 2024-09-14T03:32:33.069918+0000 mgr.a (mgr.14355) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:34 smithi131 bash[24745]: audit 2024-09-14T03:32:34.061782+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:32:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:34 smithi171 bash[25040]: cluster 2024-09-14T03:32:33.069918+0000 mgr.a (mgr.14355) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:34 smithi171 bash[25040]: audit 2024-09-14T03:32:34.061782+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:32:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:34 smithi007 bash[22722]: cluster 2024-09-14T03:32:33.069918+0000 mgr.a (mgr.14355) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:32:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:34 smithi007 bash[22722]: audit 2024-09-14T03:32:34.061782+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:32:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:35 smithi131 bash[24745]: audit 2024-09-14T03:32:34.928762+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:32:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:35 smithi131 bash[24745]: audit 2024-09-14T03:32:34.930456+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:32:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:35 smithi131 bash[24745]: audit 2024-09-14T03:32:34.938785+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:32:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:35 smithi131 bash[24745]: audit 2024-09-14T03:32:34.943578+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:35 smithi171 bash[25040]: audit 2024-09-14T03:32:34.928762+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:32:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:35 smithi171 bash[25040]: audit 2024-09-14T03:32:34.930456+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:32:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:35 smithi171 bash[25040]: audit 2024-09-14T03:32:34.938785+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:32:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:35 smithi171 bash[25040]: audit 2024-09-14T03:32:34.943578+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:35.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22722]: audit 2024-09-14T03:32:34.928762+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:32:35.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22722]: audit 2024-09-14T03:32:34.930456+0000 mon.a (mon.0) 2611 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:32:35.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22722]: audit 2024-09-14T03:32:34.938785+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:32:35.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22722]: audit 2024-09-14T03:32:34.943578+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:35.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:35.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:35.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:35.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22972]: debug 2024-09-14T03:32:35.675+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:32:35.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:32:35 smithi007 bash[22972]: debug 2024-09-14T03:32:35.675+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:32:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:36 smithi131 bash[24745]: audit 2024-09-14T03:32:34.944792+0000 mgr.a (mgr.14355) 13477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:36 smithi131 bash[24745]: cluster 2024-09-14T03:32:35.070491+0000 mgr.a (mgr.14355) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:32:36.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:36.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:36 smithi171 bash[25040]: audit 2024-09-14T03:32:34.944792+0000 mgr.a (mgr.14355) 13477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:36 smithi171 bash[25040]: cluster 2024-09-14T03:32:35.070491+0000 mgr.a (mgr.14355) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:32:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:36 smithi007 bash[22722]: audit 2024-09-14T03:32:34.944792+0000 mgr.a (mgr.14355) 13477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:32:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:36 smithi007 bash[22722]: cluster 2024-09-14T03:32:35.070491+0000 mgr.a (mgr.14355) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:32:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:37 smithi131 bash[24745]: audit 2024-09-14T03:32:35.678660+0000 mgr.a (mgr.14355) 13479 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:32:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:37 smithi131 bash[24745]: cephadm 2024-09-14T03:32:35.679870+0000 mgr.a (mgr.14355) 13480 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:32:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:37 smithi131 bash[24745]: audit 2024-09-14T03:32:36.122177+0000 mgr.a (mgr.14355) 13481 : audit [DBG] from='client.293223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:37 smithi171 bash[25040]: audit 2024-09-14T03:32:35.678660+0000 mgr.a (mgr.14355) 13479 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:32:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:37 smithi171 bash[25040]: cephadm 2024-09-14T03:32:35.679870+0000 mgr.a (mgr.14355) 13480 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:32:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:37 smithi171 bash[25040]: audit 2024-09-14T03:32:36.122177+0000 mgr.a (mgr.14355) 13481 : audit [DBG] from='client.293223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:37 smithi007 bash[22722]: audit 2024-09-14T03:32:35.678660+0000 mgr.a (mgr.14355) 13479 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:32:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:37 smithi007 bash[22722]: cephadm 2024-09-14T03:32:35.679870+0000 mgr.a (mgr.14355) 13480 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:32:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:37 smithi007 bash[22722]: audit 2024-09-14T03:32:36.122177+0000 mgr.a (mgr.14355) 13481 : audit [DBG] from='client.293223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:38 smithi131 bash[24745]: cluster 2024-09-14T03:32:37.073287+0000 mgr.a (mgr.14355) 13482 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:32:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:38 smithi171 bash[25040]: cluster 2024-09-14T03:32:37.073287+0000 mgr.a (mgr.14355) 13482 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:32:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:38 smithi007 bash[22722]: cluster 2024-09-14T03:32:37.073287+0000 mgr.a (mgr.14355) 13482 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:32:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:40 smithi131 bash[24745]: cluster 2024-09-14T03:32:39.074114+0000 mgr.a (mgr.14355) 13483 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:32:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:40 smithi171 bash[25040]: cluster 2024-09-14T03:32:39.074114+0000 mgr.a (mgr.14355) 13483 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:32:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:40 smithi007 bash[22722]: cluster 2024-09-14T03:32:39.074114+0000 mgr.a (mgr.14355) 13483 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:32:41.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:42.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:42.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:42 smithi131 bash[24745]: cluster 2024-09-14T03:32:41.076090+0000 mgr.a (mgr.14355) 13484 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:42 smithi171 bash[25040]: cluster 2024-09-14T03:32:41.076090+0000 mgr.a (mgr.14355) 13484 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:42 smithi007 bash[22722]: cluster 2024-09-14T03:32:41.076090+0000 mgr.a (mgr.14355) 13484 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:43 smithi131 bash[24745]: audit 2024-09-14T03:32:41.866075+0000 mgr.a (mgr.14355) 13485 : audit [DBG] from='client.293298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:43 smithi171 bash[25040]: audit 2024-09-14T03:32:41.866075+0000 mgr.a (mgr.14355) 13485 : audit [DBG] from='client.293298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:43 smithi007 bash[22722]: audit 2024-09-14T03:32:41.866075+0000 mgr.a (mgr.14355) 13485 : audit [DBG] from='client.293298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:44 smithi131 bash[24745]: cluster 2024-09-14T03:32:43.076992+0000 mgr.a (mgr.14355) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:44 smithi171 bash[25040]: cluster 2024-09-14T03:32:43.076992+0000 mgr.a (mgr.14355) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:44 smithi007 bash[22722]: cluster 2024-09-14T03:32:43.076992+0000 mgr.a (mgr.14355) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:46 smithi131 bash[24745]: cluster 2024-09-14T03:32:45.077897+0000 mgr.a (mgr.14355) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:46 smithi171 bash[25040]: cluster 2024-09-14T03:32:45.077897+0000 mgr.a (mgr.14355) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:46 smithi007 bash[22722]: cluster 2024-09-14T03:32:45.077897+0000 mgr.a (mgr.14355) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:47.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:47.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:47.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:48.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:48 smithi131 bash[24745]: cluster 2024-09-14T03:32:47.080196+0000 mgr.a (mgr.14355) 13488 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:48 smithi171 bash[25040]: cluster 2024-09-14T03:32:47.080196+0000 mgr.a (mgr.14355) 13488 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:48 smithi007 bash[22722]: cluster 2024-09-14T03:32:47.080196+0000 mgr.a (mgr.14355) 13488 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:32:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:49 smithi171 bash[25040]: audit 2024-09-14T03:32:47.634406+0000 mgr.a (mgr.14355) 13489 : audit [DBG] from='client.293376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:49 smithi007 bash[22722]: audit 2024-09-14T03:32:47.634406+0000 mgr.a (mgr.14355) 13489 : audit [DBG] from='client.293376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:49 smithi131 bash[24745]: audit 2024-09-14T03:32:47.634406+0000 mgr.a (mgr.14355) 13489 : audit [DBG] from='client.293376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:50 smithi171 bash[25040]: cluster 2024-09-14T03:32:49.081091+0000 mgr.a (mgr.14355) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:50 smithi007 bash[22722]: cluster 2024-09-14T03:32:49.081091+0000 mgr.a (mgr.14355) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:50 smithi131 bash[24745]: cluster 2024-09-14T03:32:49.081091+0000 mgr.a (mgr.14355) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:52 smithi171 bash[25040]: cluster 2024-09-14T03:32:51.083353+0000 mgr.a (mgr.14355) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:52 smithi007 bash[22722]: cluster 2024-09-14T03:32:51.083353+0000 mgr.a (mgr.14355) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:52 smithi131 bash[24745]: cluster 2024-09-14T03:32:51.083353+0000 mgr.a (mgr.14355) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:32:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:53.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:53.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:53.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:32:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:54 smithi171 bash[25040]: cluster 2024-09-14T03:32:53.083905+0000 mgr.a (mgr.14355) 13492 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:54 smithi007 bash[22722]: cluster 2024-09-14T03:32:53.083905+0000 mgr.a (mgr.14355) 13492 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:54 smithi131 bash[24745]: cluster 2024-09-14T03:32:53.083905+0000 mgr.a (mgr.14355) 13492 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:55 smithi007 bash[22722]: audit 2024-09-14T03:32:53.416714+0000 mgr.a (mgr.14355) 13493 : audit [DBG] from='client.293451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:55 smithi131 bash[24745]: audit 2024-09-14T03:32:53.416714+0000 mgr.a (mgr.14355) 13493 : audit [DBG] from='client.293451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:55 smithi171 bash[25040]: audit 2024-09-14T03:32:53.416714+0000 mgr.a (mgr.14355) 13493 : audit [DBG] from='client.293451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:32:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:56 smithi007 bash[22722]: cluster 2024-09-14T03:32:55.084760+0000 mgr.a (mgr.14355) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:56 smithi131 bash[24745]: cluster 2024-09-14T03:32:55.084760+0000 mgr.a (mgr.14355) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:56.808 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:56 smithi171 bash[25040]: cluster 2024-09-14T03:32:55.084760+0000 mgr.a (mgr.14355) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:32:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:32:58 smithi007 bash[22722]: cluster 2024-09-14T03:32:57.087039+0000 mgr.a (mgr.14355) 13495 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:32:58 smithi131 bash[24745]: cluster 2024-09-14T03:32:57.087039+0000 mgr.a (mgr.14355) 13495 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:32:58 smithi171 bash[25040]: cluster 2024-09-14T03:32:57.087039+0000 mgr.a (mgr.14355) 13495 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:32:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:32:58.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:32:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:32:59.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:32:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:32:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:32:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:32:59.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:00 smithi007 bash[22722]: cluster 2024-09-14T03:32:59.087597+0000 mgr.a (mgr.14355) 13496 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:00 smithi007 bash[22722]: audit 2024-09-14T03:32:59.200943+0000 mgr.a (mgr.14355) 13497 : audit [DBG] from='client.293529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:00 smithi131 bash[24745]: cluster 2024-09-14T03:32:59.087597+0000 mgr.a (mgr.14355) 13496 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:00 smithi131 bash[24745]: audit 2024-09-14T03:32:59.200943+0000 mgr.a (mgr.14355) 13497 : audit [DBG] from='client.293529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:00 smithi171 bash[25040]: cluster 2024-09-14T03:32:59.087597+0000 mgr.a (mgr.14355) 13496 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:00 smithi171 bash[25040]: audit 2024-09-14T03:32:59.200943+0000 mgr.a (mgr.14355) 13497 : audit [DBG] from='client.293529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:02 smithi007 bash[22722]: cluster 2024-09-14T03:33:01.089933+0000 mgr.a (mgr.14355) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:02 smithi131 bash[24745]: cluster 2024-09-14T03:33:01.089933+0000 mgr.a (mgr.14355) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:02 smithi171 bash[25040]: cluster 2024-09-14T03:33:01.089933+0000 mgr.a (mgr.14355) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:04.652 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:04.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:04.653 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:04 smithi007 bash[22722]: cluster 2024-09-14T03:33:03.090708+0000 mgr.a (mgr.14355) 13499 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:04 smithi131 bash[24745]: cluster 2024-09-14T03:33:03.090708+0000 mgr.a (mgr.14355) 13499 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:04 smithi171 bash[25040]: cluster 2024-09-14T03:33:03.090708+0000 mgr.a (mgr.14355) 13499 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:05.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:05.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:06 smithi007 bash[22722]: audit 2024-09-14T03:33:04.987693+0000 mgr.a (mgr.14355) 13500 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:06 smithi007 bash[22722]: cluster 2024-09-14T03:33:05.091226+0000 mgr.a (mgr.14355) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:06 smithi131 bash[24745]: audit 2024-09-14T03:33:04.987693+0000 mgr.a (mgr.14355) 13500 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:06 smithi131 bash[24745]: cluster 2024-09-14T03:33:05.091226+0000 mgr.a (mgr.14355) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:06 smithi171 bash[25040]: audit 2024-09-14T03:33:04.987693+0000 mgr.a (mgr.14355) 13500 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:06 smithi171 bash[25040]: cluster 2024-09-14T03:33:05.091226+0000 mgr.a (mgr.14355) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:08 smithi007 bash[22722]: cluster 2024-09-14T03:33:07.093527+0000 mgr.a (mgr.14355) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:33:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:08 smithi131 bash[24745]: cluster 2024-09-14T03:33:07.093527+0000 mgr.a (mgr.14355) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:33:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:08 smithi171 bash[25040]: cluster 2024-09-14T03:33:07.093527+0000 mgr.a (mgr.14355) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:33:10.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:10.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:10 smithi007 bash[22722]: cluster 2024-09-14T03:33:09.094326+0000 mgr.a (mgr.14355) 13503 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:33:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:10 smithi131 bash[24745]: cluster 2024-09-14T03:33:09.094326+0000 mgr.a (mgr.14355) 13503 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:33:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:10 smithi171 bash[25040]: cluster 2024-09-14T03:33:09.094326+0000 mgr.a (mgr.14355) 13503 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:33:11.187 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:11.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:11.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:11.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:11.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:12 smithi007 bash[22722]: audit 2024-09-14T03:33:10.754008+0000 mgr.a (mgr.14355) 13504 : audit [DBG] from='client.293685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:12 smithi007 bash[22722]: cluster 2024-09-14T03:33:11.095650+0000 mgr.a (mgr.14355) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:12 smithi131 bash[24745]: audit 2024-09-14T03:33:10.754008+0000 mgr.a (mgr.14355) 13504 : audit [DBG] from='client.293685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:12 smithi131 bash[24745]: cluster 2024-09-14T03:33:11.095650+0000 mgr.a (mgr.14355) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:12 smithi171 bash[25040]: audit 2024-09-14T03:33:10.754008+0000 mgr.a (mgr.14355) 13504 : audit [DBG] from='client.293685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:12.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:12 smithi171 bash[25040]: cluster 2024-09-14T03:33:11.095650+0000 mgr.a (mgr.14355) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:14 smithi007 bash[22722]: cluster 2024-09-14T03:33:13.096381+0000 mgr.a (mgr.14355) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:14 smithi131 bash[24745]: cluster 2024-09-14T03:33:13.096381+0000 mgr.a (mgr.14355) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:14 smithi171 bash[25040]: cluster 2024-09-14T03:33:13.096381+0000 mgr.a (mgr.14355) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:16.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:16 smithi007 bash[22722]: cluster 2024-09-14T03:33:15.097175+0000 mgr.a (mgr.14355) 13507 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:16 smithi131 bash[24745]: cluster 2024-09-14T03:33:15.097175+0000 mgr.a (mgr.14355) 13507 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:16 smithi171 bash[25040]: cluster 2024-09-14T03:33:15.097175+0000 mgr.a (mgr.14355) 13507 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:16.941 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:18 smithi007 bash[22722]: audit 2024-09-14T03:33:16.524247+0000 mgr.a (mgr.14355) 13508 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:18 smithi007 bash[22722]: cluster 2024-09-14T03:33:17.099854+0000 mgr.a (mgr.14355) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:18 smithi131 bash[24745]: audit 2024-09-14T03:33:16.524247+0000 mgr.a (mgr.14355) 13508 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:18 smithi131 bash[24745]: cluster 2024-09-14T03:33:17.099854+0000 mgr.a (mgr.14355) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:18 smithi171 bash[25040]: audit 2024-09-14T03:33:16.524247+0000 mgr.a (mgr.14355) 13508 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:18 smithi171 bash[25040]: cluster 2024-09-14T03:33:17.099854+0000 mgr.a (mgr.14355) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:20 smithi007 bash[22722]: cluster 2024-09-14T03:33:19.100616+0000 mgr.a (mgr.14355) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:33:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:20 smithi131 bash[24745]: cluster 2024-09-14T03:33:19.100616+0000 mgr.a (mgr.14355) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:33:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:20 smithi171 bash[25040]: cluster 2024-09-14T03:33:19.100616+0000 mgr.a (mgr.14355) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:33:21.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:21.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:21.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:22 smithi007 bash[22722]: cluster 2024-09-14T03:33:21.102671+0000 mgr.a (mgr.14355) 13511 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:33:22.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:22.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:22.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:22 smithi131 bash[24745]: cluster 2024-09-14T03:33:21.102671+0000 mgr.a (mgr.14355) 13511 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:33:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:22 smithi171 bash[25040]: cluster 2024-09-14T03:33:21.102671+0000 mgr.a (mgr.14355) 13511 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:33:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:23 smithi007 bash[22722]: audit 2024-09-14T03:33:22.276990+0000 mgr.a (mgr.14355) 13512 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:23 smithi131 bash[24745]: audit 2024-09-14T03:33:22.276990+0000 mgr.a (mgr.14355) 13512 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:23 smithi171 bash[25040]: audit 2024-09-14T03:33:22.276990+0000 mgr.a (mgr.14355) 13512 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:24 smithi007 bash[22722]: cluster 2024-09-14T03:33:23.103583+0000 mgr.a (mgr.14355) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:24 smithi131 bash[24745]: cluster 2024-09-14T03:33:23.103583+0000 mgr.a (mgr.14355) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:24 smithi171 bash[25040]: cluster 2024-09-14T03:33:23.103583+0000 mgr.a (mgr.14355) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:25 smithi007 bash[22722]: cluster 2024-09-14T03:33:25.104351+0000 mgr.a (mgr.14355) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:25 smithi131 bash[24745]: cluster 2024-09-14T03:33:25.104351+0000 mgr.a (mgr.14355) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:25 smithi171 bash[25040]: cluster 2024-09-14T03:33:25.104351+0000 mgr.a (mgr.14355) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:27.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:27.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:28 smithi007 bash[22722]: cluster 2024-09-14T03:33:27.106610+0000 mgr.a (mgr.14355) 13515 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:28.473 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:28.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:28 smithi131 bash[24745]: cluster 2024-09-14T03:33:27.106610+0000 mgr.a (mgr.14355) 13515 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:28 smithi171 bash[25040]: cluster 2024-09-14T03:33:27.106610+0000 mgr.a (mgr.14355) 13515 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:29 smithi007 bash[22722]: audit 2024-09-14T03:33:28.045550+0000 mgr.a (mgr.14355) 13516 : audit [DBG] from='client.293913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:29 smithi131 bash[24745]: audit 2024-09-14T03:33:28.045550+0000 mgr.a (mgr.14355) 13516 : audit [DBG] from='client.293913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:29 smithi171 bash[25040]: audit 2024-09-14T03:33:28.045550+0000 mgr.a (mgr.14355) 13516 : audit [DBG] from='client.293913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:30 smithi007 bash[22722]: cluster 2024-09-14T03:33:29.107595+0000 mgr.a (mgr.14355) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:30 smithi131 bash[24745]: cluster 2024-09-14T03:33:29.107595+0000 mgr.a (mgr.14355) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:30 smithi171 bash[25040]: cluster 2024-09-14T03:33:29.107595+0000 mgr.a (mgr.14355) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:32 smithi007 bash[22722]: cluster 2024-09-14T03:33:31.109870+0000 mgr.a (mgr.14355) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:32 smithi131 bash[24745]: cluster 2024-09-14T03:33:31.109870+0000 mgr.a (mgr.14355) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:32 smithi171 bash[25040]: cluster 2024-09-14T03:33:31.109870+0000 mgr.a (mgr.14355) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:33.475 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:34.238 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:34.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:34 smithi007 bash[22722]: cluster 2024-09-14T03:33:33.110657+0000 mgr.a (mgr.14355) 13519 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:34 smithi131 bash[24745]: cluster 2024-09-14T03:33:33.110657+0000 mgr.a (mgr.14355) 13519 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:34 smithi171 bash[25040]: cluster 2024-09-14T03:33:33.110657+0000 mgr.a (mgr.14355) 13519 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:35 smithi007 bash[22722]: audit 2024-09-14T03:33:33.809277+0000 mgr.a (mgr.14355) 13520 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:35 smithi131 bash[24745]: audit 2024-09-14T03:33:33.809277+0000 mgr.a (mgr.14355) 13520 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:35 smithi171 bash[25040]: audit 2024-09-14T03:33:33.809277+0000 mgr.a (mgr.14355) 13520 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:36 smithi007 bash[22722]: cluster 2024-09-14T03:33:35.111593+0000 mgr.a (mgr.14355) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:36 smithi007 bash[22722]: audit 2024-09-14T03:33:35.729216+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:33:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:36 smithi131 bash[24745]: cluster 2024-09-14T03:33:35.111593+0000 mgr.a (mgr.14355) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:36 smithi131 bash[24745]: audit 2024-09-14T03:33:35.729216+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:33:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:36 smithi171 bash[25040]: cluster 2024-09-14T03:33:35.111593+0000 mgr.a (mgr.14355) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:36 smithi171 bash[25040]: audit 2024-09-14T03:33:35.729216+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:33:37.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22972]: debug 2024-09-14T03:33:37.326+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:33:37.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22972]: debug 2024-09-14T03:33:37.326+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:33:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22722]: audit 2024-09-14T03:33:36.570895+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:33:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22722]: audit 2024-09-14T03:33:36.572267+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:33:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22722]: audit 2024-09-14T03:33:36.581474+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:33:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:37 smithi007 bash[22722]: audit 2024-09-14T03:33:36.586325+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:37 smithi131 bash[24745]: audit 2024-09-14T03:33:36.570895+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:33:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:37 smithi131 bash[24745]: audit 2024-09-14T03:33:36.572267+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:33:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:37 smithi131 bash[24745]: audit 2024-09-14T03:33:36.581474+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:33:37.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:37 smithi131 bash[24745]: audit 2024-09-14T03:33:36.586325+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:37 smithi171 bash[25040]: audit 2024-09-14T03:33:36.570895+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:33:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:37 smithi171 bash[25040]: audit 2024-09-14T03:33:36.572267+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:33:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:37 smithi171 bash[25040]: audit 2024-09-14T03:33:36.581474+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:33:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:37 smithi171 bash[25040]: audit 2024-09-14T03:33:36.586325+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:38 smithi007 bash[22722]: audit 2024-09-14T03:33:36.588605+0000 mgr.a (mgr.14355) 13522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:38 smithi007 bash[22722]: cluster 2024-09-14T03:33:37.113447+0000 mgr.a (mgr.14355) 13523 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:38 smithi007 bash[22722]: audit 2024-09-14T03:33:37.332960+0000 mgr.a (mgr.14355) 13524 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:33:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:38 smithi007 bash[22722]: cephadm 2024-09-14T03:33:37.334200+0000 mgr.a (mgr.14355) 13525 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:33:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:38 smithi131 bash[24745]: audit 2024-09-14T03:33:36.588605+0000 mgr.a (mgr.14355) 13522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:38 smithi131 bash[24745]: cluster 2024-09-14T03:33:37.113447+0000 mgr.a (mgr.14355) 13523 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:38 smithi131 bash[24745]: audit 2024-09-14T03:33:37.332960+0000 mgr.a (mgr.14355) 13524 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:33:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:38 smithi131 bash[24745]: cephadm 2024-09-14T03:33:37.334200+0000 mgr.a (mgr.14355) 13525 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:33:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:38 smithi171 bash[25040]: audit 2024-09-14T03:33:36.588605+0000 mgr.a (mgr.14355) 13522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:33:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:38 smithi171 bash[25040]: cluster 2024-09-14T03:33:37.113447+0000 mgr.a (mgr.14355) 13523 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:33:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:38 smithi171 bash[25040]: audit 2024-09-14T03:33:37.332960+0000 mgr.a (mgr.14355) 13524 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:33:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:38 smithi171 bash[25040]: cephadm 2024-09-14T03:33:37.334200+0000 mgr.a (mgr.14355) 13525 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:33:39.239 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:39.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:39.994 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:39.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:40 smithi007 bash[22722]: cluster 2024-09-14T03:33:39.114180+0000 mgr.a (mgr.14355) 13526 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:40 smithi131 bash[24745]: cluster 2024-09-14T03:33:39.114180+0000 mgr.a (mgr.14355) 13526 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:40 smithi171 bash[25040]: cluster 2024-09-14T03:33:39.114180+0000 mgr.a (mgr.14355) 13526 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:41 smithi131 bash[24745]: audit 2024-09-14T03:33:39.569932+0000 mgr.a (mgr.14355) 13527 : audit [DBG] from='client.294174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:41 smithi171 bash[25040]: audit 2024-09-14T03:33:39.569932+0000 mgr.a (mgr.14355) 13527 : audit [DBG] from='client.294174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:41 smithi007 bash[22722]: audit 2024-09-14T03:33:39.569932+0000 mgr.a (mgr.14355) 13527 : audit [DBG] from='client.294174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:42 smithi131 bash[24745]: cluster 2024-09-14T03:33:41.116561+0000 mgr.a (mgr.14355) 13528 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:42 smithi171 bash[25040]: cluster 2024-09-14T03:33:41.116561+0000 mgr.a (mgr.14355) 13528 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:42 smithi007 bash[22722]: cluster 2024-09-14T03:33:41.116561+0000 mgr.a (mgr.14355) 13528 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:44 smithi131 bash[24745]: cluster 2024-09-14T03:33:43.117337+0000 mgr.a (mgr.14355) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:44 smithi171 bash[25040]: cluster 2024-09-14T03:33:43.117337+0000 mgr.a (mgr.14355) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:44 smithi007 bash[22722]: cluster 2024-09-14T03:33:43.117337+0000 mgr.a (mgr.14355) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:44.995 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:45.767 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:45.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:46 smithi131 bash[24745]: cluster 2024-09-14T03:33:45.117782+0000 mgr.a (mgr.14355) 13530 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:46 smithi131 bash[24745]: audit 2024-09-14T03:33:45.332509+0000 mgr.a (mgr.14355) 13531 : audit [DBG] from='client.294252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:46 smithi171 bash[25040]: cluster 2024-09-14T03:33:45.117782+0000 mgr.a (mgr.14355) 13530 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:46 smithi171 bash[25040]: audit 2024-09-14T03:33:45.332509+0000 mgr.a (mgr.14355) 13531 : audit [DBG] from='client.294252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:46 smithi007 bash[22722]: cluster 2024-09-14T03:33:45.117782+0000 mgr.a (mgr.14355) 13530 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:46 smithi007 bash[22722]: audit 2024-09-14T03:33:45.332509+0000 mgr.a (mgr.14355) 13531 : audit [DBG] from='client.294252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:48 smithi131 bash[24745]: cluster 2024-09-14T03:33:47.120555+0000 mgr.a (mgr.14355) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:48 smithi171 bash[25040]: cluster 2024-09-14T03:33:47.120555+0000 mgr.a (mgr.14355) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:48 smithi007 bash[22722]: cluster 2024-09-14T03:33:47.120555+0000 mgr.a (mgr.14355) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:50 smithi131 bash[24745]: cluster 2024-09-14T03:33:49.121373+0000 mgr.a (mgr.14355) 13533 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:33:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:50 smithi171 bash[25040]: cluster 2024-09-14T03:33:49.121373+0000 mgr.a (mgr.14355) 13533 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:33:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:50 smithi007 bash[22722]: cluster 2024-09-14T03:33:49.121373+0000 mgr.a (mgr.14355) 13533 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:33:50.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:50.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:50.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:51.524 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:51.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:51.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:52 smithi131 bash[24745]: audit 2024-09-14T03:33:51.097715+0000 mgr.a (mgr.14355) 13534 : audit [DBG] from='client.294327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:52 smithi131 bash[24745]: cluster 2024-09-14T03:33:51.124052+0000 mgr.a (mgr.14355) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:52 smithi171 bash[25040]: audit 2024-09-14T03:33:51.097715+0000 mgr.a (mgr.14355) 13534 : audit [DBG] from='client.294327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:52 smithi171 bash[25040]: cluster 2024-09-14T03:33:51.124052+0000 mgr.a (mgr.14355) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:52 smithi007 bash[22722]: audit 2024-09-14T03:33:51.097715+0000 mgr.a (mgr.14355) 13534 : audit [DBG] from='client.294327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:52 smithi007 bash[22722]: cluster 2024-09-14T03:33:51.124052+0000 mgr.a (mgr.14355) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:33:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:54 smithi131 bash[24745]: cluster 2024-09-14T03:33:53.125055+0000 mgr.a (mgr.14355) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:33:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:54 smithi171 bash[25040]: cluster 2024-09-14T03:33:53.125055+0000 mgr.a (mgr.14355) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:33:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:54 smithi007 bash[22722]: cluster 2024-09-14T03:33:53.125055+0000 mgr.a (mgr.14355) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:33:56.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:33:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:33:56.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:33:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:56 smithi131 bash[24745]: cluster 2024-09-14T03:33:55.125857+0000 mgr.a (mgr.14355) 13537 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:56 smithi171 bash[25040]: cluster 2024-09-14T03:33:55.125857+0000 mgr.a (mgr.14355) 13537 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:56 smithi007 bash[22722]: cluster 2024-09-14T03:33:55.125857+0000 mgr.a (mgr.14355) 13537 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:33:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:33:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:33:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:33:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:33:57.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:33:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:58 smithi131 bash[24745]: audit 2024-09-14T03:33:56.863151+0000 mgr.a (mgr.14355) 13538 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:33:58 smithi131 bash[24745]: cluster 2024-09-14T03:33:57.127699+0000 mgr.a (mgr.14355) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:58 smithi171 bash[25040]: audit 2024-09-14T03:33:56.863151+0000 mgr.a (mgr.14355) 13538 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:33:58 smithi171 bash[25040]: cluster 2024-09-14T03:33:57.127699+0000 mgr.a (mgr.14355) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:33:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:58 smithi007 bash[22722]: audit 2024-09-14T03:33:56.863151+0000 mgr.a (mgr.14355) 13538 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:33:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:33:58 smithi007 bash[22722]: cluster 2024-09-14T03:33:57.127699+0000 mgr.a (mgr.14355) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:00 smithi131 bash[24745]: cluster 2024-09-14T03:33:59.128581+0000 mgr.a (mgr.14355) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:00 smithi171 bash[25040]: cluster 2024-09-14T03:33:59.128581+0000 mgr.a (mgr.14355) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:00 smithi007 bash[22722]: cluster 2024-09-14T03:33:59.128581+0000 mgr.a (mgr.14355) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:02.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:02 smithi131 bash[24745]: cluster 2024-09-14T03:34:01.130864+0000 mgr.a (mgr.14355) 13541 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:02 smithi171 bash[25040]: cluster 2024-09-14T03:34:01.130864+0000 mgr.a (mgr.14355) 13541 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:02 smithi007 bash[22722]: cluster 2024-09-14T03:34:01.130864+0000 mgr.a (mgr.14355) 13541 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:03.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:04 smithi131 bash[24745]: audit 2024-09-14T03:34:02.607608+0000 mgr.a (mgr.14355) 13542 : audit [DBG] from='client.294477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:04 smithi131 bash[24745]: cluster 2024-09-14T03:34:03.131800+0000 mgr.a (mgr.14355) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:04 smithi171 bash[25040]: audit 2024-09-14T03:34:02.607608+0000 mgr.a (mgr.14355) 13542 : audit [DBG] from='client.294477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:04 smithi171 bash[25040]: cluster 2024-09-14T03:34:03.131800+0000 mgr.a (mgr.14355) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:04 smithi007 bash[22722]: audit 2024-09-14T03:34:02.607608+0000 mgr.a (mgr.14355) 13542 : audit [DBG] from='client.294477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:04 smithi007 bash[22722]: cluster 2024-09-14T03:34:03.131800+0000 mgr.a (mgr.14355) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:06 smithi131 bash[24745]: cluster 2024-09-14T03:34:05.132765+0000 mgr.a (mgr.14355) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:06 smithi171 bash[25040]: cluster 2024-09-14T03:34:05.132765+0000 mgr.a (mgr.14355) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:06 smithi007 bash[22722]: cluster 2024-09-14T03:34:05.132765+0000 mgr.a (mgr.14355) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:08.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:08 smithi131 bash[24745]: cluster 2024-09-14T03:34:07.135075+0000 mgr.a (mgr.14355) 13545 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:08 smithi171 bash[25040]: cluster 2024-09-14T03:34:07.135075+0000 mgr.a (mgr.14355) 13545 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:08 smithi007 bash[22722]: cluster 2024-09-14T03:34:07.135075+0000 mgr.a (mgr.14355) 13545 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:08.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:08.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:08.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:08.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:08.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:09 smithi131 bash[24745]: audit 2024-09-14T03:34:08.361289+0000 mgr.a (mgr.14355) 13546 : audit [DBG] from='client.294555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:09 smithi171 bash[25040]: audit 2024-09-14T03:34:08.361289+0000 mgr.a (mgr.14355) 13546 : audit [DBG] from='client.294555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:09 smithi007 bash[22722]: audit 2024-09-14T03:34:08.361289+0000 mgr.a (mgr.14355) 13546 : audit [DBG] from='client.294555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:10 smithi131 bash[24745]: cluster 2024-09-14T03:34:09.136061+0000 mgr.a (mgr.14355) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:10 smithi171 bash[25040]: cluster 2024-09-14T03:34:09.136061+0000 mgr.a (mgr.14355) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:10 smithi007 bash[22722]: cluster 2024-09-14T03:34:09.136061+0000 mgr.a (mgr.14355) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:12 smithi131 bash[24745]: cluster 2024-09-14T03:34:11.138365+0000 mgr.a (mgr.14355) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:12 smithi171 bash[25040]: cluster 2024-09-14T03:34:11.138365+0000 mgr.a (mgr.14355) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:12 smithi007 bash[22722]: cluster 2024-09-14T03:34:11.138365+0000 mgr.a (mgr.14355) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:13.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:13.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:13.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:14 smithi171 bash[25040]: cluster 2024-09-14T03:34:13.139119+0000 mgr.a (mgr.14355) 13549 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:14.566 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:14.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:14.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:14.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:14.567 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:14 smithi007 bash[22722]: cluster 2024-09-14T03:34:13.139119+0000 mgr.a (mgr.14355) 13549 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:14 smithi131 bash[24745]: cluster 2024-09-14T03:34:13.139119+0000 mgr.a (mgr.14355) 13549 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:15 smithi171 bash[25040]: audit 2024-09-14T03:34:14.134937+0000 mgr.a (mgr.14355) 13550 : audit [DBG] from='client.294633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:15 smithi007 bash[22722]: audit 2024-09-14T03:34:14.134937+0000 mgr.a (mgr.14355) 13550 : audit [DBG] from='client.294633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:15 smithi131 bash[24745]: audit 2024-09-14T03:34:14.134937+0000 mgr.a (mgr.14355) 13550 : audit [DBG] from='client.294633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:16 smithi007 bash[22722]: cluster 2024-09-14T03:34:15.140058+0000 mgr.a (mgr.14355) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:16 smithi131 bash[24745]: cluster 2024-09-14T03:34:15.140058+0000 mgr.a (mgr.14355) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:16 smithi171 bash[25040]: cluster 2024-09-14T03:34:15.140058+0000 mgr.a (mgr.14355) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:18 smithi007 bash[22722]: cluster 2024-09-14T03:34:17.142391+0000 mgr.a (mgr.14355) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:18 smithi131 bash[24745]: cluster 2024-09-14T03:34:17.142391+0000 mgr.a (mgr.14355) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:18 smithi171 bash[25040]: cluster 2024-09-14T03:34:17.142391+0000 mgr.a (mgr.14355) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:19.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:19.569 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:20.351 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:20.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:20.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:20.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:20.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:20 smithi007 bash[22722]: cluster 2024-09-14T03:34:19.143170+0000 mgr.a (mgr.14355) 13553 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:20 smithi131 bash[24745]: cluster 2024-09-14T03:34:19.143170+0000 mgr.a (mgr.14355) 13553 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:20 smithi171 bash[25040]: cluster 2024-09-14T03:34:19.143170+0000 mgr.a (mgr.14355) 13553 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:21 smithi007 bash[22722]: audit 2024-09-14T03:34:19.909248+0000 mgr.a (mgr.14355) 13554 : audit [DBG] from='client.294708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:21 smithi131 bash[24745]: audit 2024-09-14T03:34:19.909248+0000 mgr.a (mgr.14355) 13554 : audit [DBG] from='client.294708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:21 smithi171 bash[25040]: audit 2024-09-14T03:34:19.909248+0000 mgr.a (mgr.14355) 13554 : audit [DBG] from='client.294708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:22 smithi007 bash[22722]: cluster 2024-09-14T03:34:21.145625+0000 mgr.a (mgr.14355) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:22 smithi131 bash[24745]: cluster 2024-09-14T03:34:21.145625+0000 mgr.a (mgr.14355) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:22 smithi171 bash[25040]: cluster 2024-09-14T03:34:21.145625+0000 mgr.a (mgr.14355) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:24 smithi007 bash[22722]: cluster 2024-09-14T03:34:23.146417+0000 mgr.a (mgr.14355) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:24 smithi131 bash[24745]: cluster 2024-09-14T03:34:23.146417+0000 mgr.a (mgr.14355) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:24 smithi171 bash[25040]: cluster 2024-09-14T03:34:23.146417+0000 mgr.a (mgr.14355) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:26.122 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:26.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:26.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:26.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:26.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:26 smithi007 bash[22722]: cluster 2024-09-14T03:34:25.147210+0000 mgr.a (mgr.14355) 13557 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:26 smithi131 bash[24745]: cluster 2024-09-14T03:34:25.147210+0000 mgr.a (mgr.14355) 13557 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:26 smithi171 bash[25040]: cluster 2024-09-14T03:34:25.147210+0000 mgr.a (mgr.14355) 13557 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:27 smithi007 bash[22722]: audit 2024-09-14T03:34:25.686422+0000 mgr.a (mgr.14355) 13558 : audit [DBG] from='client.294783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:27 smithi131 bash[24745]: audit 2024-09-14T03:34:25.686422+0000 mgr.a (mgr.14355) 13558 : audit [DBG] from='client.294783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:27 smithi171 bash[25040]: audit 2024-09-14T03:34:25.686422+0000 mgr.a (mgr.14355) 13558 : audit [DBG] from='client.294783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:28 smithi007 bash[22722]: cluster 2024-09-14T03:34:27.150035+0000 mgr.a (mgr.14355) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:28 smithi131 bash[24745]: cluster 2024-09-14T03:34:27.150035+0000 mgr.a (mgr.14355) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:28 smithi171 bash[25040]: cluster 2024-09-14T03:34:27.150035+0000 mgr.a (mgr.14355) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:30 smithi007 bash[22722]: cluster 2024-09-14T03:34:29.150842+0000 mgr.a (mgr.14355) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:30 smithi131 bash[24745]: cluster 2024-09-14T03:34:29.150842+0000 mgr.a (mgr.14355) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:30 smithi171 bash[25040]: cluster 2024-09-14T03:34:29.150842+0000 mgr.a (mgr.14355) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:31.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:31.125 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:31.880 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:31.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:32 smithi007 bash[22722]: cluster 2024-09-14T03:34:31.152871+0000 mgr.a (mgr.14355) 13561 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:32 smithi131 bash[24745]: cluster 2024-09-14T03:34:31.152871+0000 mgr.a (mgr.14355) 13561 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:32 smithi171 bash[25040]: cluster 2024-09-14T03:34:31.152871+0000 mgr.a (mgr.14355) 13561 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:33 smithi007 bash[22722]: audit 2024-09-14T03:34:31.455704+0000 mgr.a (mgr.14355) 13562 : audit [DBG] from='client.294861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:33 smithi131 bash[24745]: audit 2024-09-14T03:34:31.455704+0000 mgr.a (mgr.14355) 13562 : audit [DBG] from='client.294861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:33 smithi171 bash[25040]: audit 2024-09-14T03:34:31.455704+0000 mgr.a (mgr.14355) 13562 : audit [DBG] from='client.294861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:34 smithi007 bash[22722]: cluster 2024-09-14T03:34:33.153833+0000 mgr.a (mgr.14355) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:34 smithi131 bash[24745]: cluster 2024-09-14T03:34:33.153833+0000 mgr.a (mgr.14355) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:34 smithi171 bash[25040]: cluster 2024-09-14T03:34:33.153833+0000 mgr.a (mgr.14355) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:34:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:36 smithi007 bash[22722]: cluster 2024-09-14T03:34:35.154637+0000 mgr.a (mgr.14355) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:34:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:36 smithi131 bash[24745]: cluster 2024-09-14T03:34:35.154637+0000 mgr.a (mgr.14355) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:34:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:36 smithi171 bash[25040]: cluster 2024-09-14T03:34:35.154637+0000 mgr.a (mgr.14355) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:34:36.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:36.883 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:37.663 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:37.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: cluster 2024-09-14T03:34:37.156821+0000 mgr.a (mgr.14355) 13565 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:37.218589+0000 mgr.a (mgr.14355) 13566 : audit [DBG] from='client.294936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:37.389207+0000 mon.a (mon.0) 2619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:34:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:38.219863+0000 mon.a (mon.0) 2620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:34:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:38.221667+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:34:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:38.230408+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:34:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22722]: audit 2024-09-14T03:34:38.235306+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: cluster 2024-09-14T03:34:37.156821+0000 mgr.a (mgr.14355) 13565 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:37.218589+0000 mgr.a (mgr.14355) 13566 : audit [DBG] from='client.294936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:37.389207+0000 mon.a (mon.0) 2619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:38.219863+0000 mon.a (mon.0) 2620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:38.221667+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:38.230408+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:34:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:38 smithi131 bash[24745]: audit 2024-09-14T03:34:38.235306+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: cluster 2024-09-14T03:34:37.156821+0000 mgr.a (mgr.14355) 13565 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:37.218589+0000 mgr.a (mgr.14355) 13566 : audit [DBG] from='client.294936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:37.389207+0000 mon.a (mon.0) 2619 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:38.219863+0000 mon.a (mon.0) 2620 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:38.221667+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:38.230408+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:34:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:38 smithi171 bash[25040]: audit 2024-09-14T03:34:38.235306+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:39.362 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22972]: debug 2024-09-14T03:34:38.985+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:34:39.363 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:34:38 smithi007 bash[22972]: debug 2024-09-14T03:34:38.989+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:34:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:39 smithi007 bash[22722]: audit 2024-09-14T03:34:38.236664+0000 mgr.a (mgr.14355) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:39 smithi131 bash[24745]: audit 2024-09-14T03:34:38.236664+0000 mgr.a (mgr.14355) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:39 smithi171 bash[25040]: audit 2024-09-14T03:34:38.236664+0000 mgr.a (mgr.14355) 13567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:34:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:40 smithi007 bash[22722]: audit 2024-09-14T03:34:38.988594+0000 mgr.a (mgr.14355) 13568 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:34:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:40 smithi007 bash[22722]: cephadm 2024-09-14T03:34:38.990629+0000 mgr.a (mgr.14355) 13569 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:34:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:40 smithi007 bash[22722]: cluster 2024-09-14T03:34:39.157791+0000 mgr.a (mgr.14355) 13570 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:40 smithi131 bash[24745]: audit 2024-09-14T03:34:38.988594+0000 mgr.a (mgr.14355) 13568 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:34:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:40 smithi131 bash[24745]: cephadm 2024-09-14T03:34:38.990629+0000 mgr.a (mgr.14355) 13569 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:34:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:40 smithi131 bash[24745]: cluster 2024-09-14T03:34:39.157791+0000 mgr.a (mgr.14355) 13570 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:40 smithi171 bash[25040]: audit 2024-09-14T03:34:38.988594+0000 mgr.a (mgr.14355) 13568 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:34:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:40 smithi171 bash[25040]: cephadm 2024-09-14T03:34:38.990629+0000 mgr.a (mgr.14355) 13569 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:34:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:40 smithi171 bash[25040]: cluster 2024-09-14T03:34:39.157791+0000 mgr.a (mgr.14355) 13570 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:42.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:42.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:42 smithi007 bash[22722]: cluster 2024-09-14T03:34:41.160075+0000 mgr.a (mgr.14355) 13571 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:42 smithi131 bash[24745]: cluster 2024-09-14T03:34:41.160075+0000 mgr.a (mgr.14355) 13571 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:42 smithi171 bash[25040]: cluster 2024-09-14T03:34:41.160075+0000 mgr.a (mgr.14355) 13571 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:43.444 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:43.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:44 smithi007 bash[22722]: audit 2024-09-14T03:34:43.001064+0000 mgr.a (mgr.14355) 13572 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:44 smithi007 bash[22722]: cluster 2024-09-14T03:34:43.160640+0000 mgr.a (mgr.14355) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:44 smithi131 bash[24745]: audit 2024-09-14T03:34:43.001064+0000 mgr.a (mgr.14355) 13572 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:44 smithi131 bash[24745]: cluster 2024-09-14T03:34:43.160640+0000 mgr.a (mgr.14355) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:44 smithi171 bash[25040]: audit 2024-09-14T03:34:43.001064+0000 mgr.a (mgr.14355) 13572 : audit [DBG] from='client.295119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:44 smithi171 bash[25040]: cluster 2024-09-14T03:34:43.160640+0000 mgr.a (mgr.14355) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:46 smithi007 bash[22722]: cluster 2024-09-14T03:34:45.161498+0000 mgr.a (mgr.14355) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:46 smithi131 bash[24745]: cluster 2024-09-14T03:34:45.161498+0000 mgr.a (mgr.14355) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:46 smithi171 bash[25040]: cluster 2024-09-14T03:34:45.161498+0000 mgr.a (mgr.14355) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:48.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:48 smithi007 bash[22722]: cluster 2024-09-14T03:34:47.163787+0000 mgr.a (mgr.14355) 13575 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:48 smithi131 bash[24745]: cluster 2024-09-14T03:34:47.163787+0000 mgr.a (mgr.14355) 13575 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:48 smithi171 bash[25040]: cluster 2024-09-14T03:34:47.163787+0000 mgr.a (mgr.14355) 13575 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:49.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:50 smithi131 bash[24745]: audit 2024-09-14T03:34:48.781183+0000 mgr.a (mgr.14355) 13576 : audit [DBG] from='client.295197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:50 smithi131 bash[24745]: cluster 2024-09-14T03:34:49.164543+0000 mgr.a (mgr.14355) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:50 smithi171 bash[25040]: audit 2024-09-14T03:34:48.781183+0000 mgr.a (mgr.14355) 13576 : audit [DBG] from='client.295197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:50 smithi171 bash[25040]: cluster 2024-09-14T03:34:49.164543+0000 mgr.a (mgr.14355) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:50 smithi007 bash[22722]: audit 2024-09-14T03:34:48.781183+0000 mgr.a (mgr.14355) 13576 : audit [DBG] from='client.295197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:50 smithi007 bash[22722]: cluster 2024-09-14T03:34:49.164543+0000 mgr.a (mgr.14355) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:52 smithi131 bash[24745]: cluster 2024-09-14T03:34:51.166749+0000 mgr.a (mgr.14355) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:52 smithi171 bash[25040]: cluster 2024-09-14T03:34:51.166749+0000 mgr.a (mgr.14355) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:52 smithi007 bash[22722]: cluster 2024-09-14T03:34:51.166749+0000 mgr.a (mgr.14355) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:34:54.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:54.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:54.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:34:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:54 smithi131 bash[24745]: cluster 2024-09-14T03:34:53.167553+0000 mgr.a (mgr.14355) 13579 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:54 smithi171 bash[25040]: cluster 2024-09-14T03:34:53.167553+0000 mgr.a (mgr.14355) 13579 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:54 smithi007 bash[22722]: cluster 2024-09-14T03:34:53.167553+0000 mgr.a (mgr.14355) 13579 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:54.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:34:54.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:34:54.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:34:54.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:34:54.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:34:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:56 smithi131 bash[24745]: audit 2024-09-14T03:34:54.529625+0000 mgr.a (mgr.14355) 13580 : audit [DBG] from='client.295275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:56 smithi131 bash[24745]: cluster 2024-09-14T03:34:55.168521+0000 mgr.a (mgr.14355) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:56 smithi171 bash[25040]: audit 2024-09-14T03:34:54.529625+0000 mgr.a (mgr.14355) 13580 : audit [DBG] from='client.295275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:56 smithi171 bash[25040]: cluster 2024-09-14T03:34:55.168521+0000 mgr.a (mgr.14355) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:56 smithi007 bash[22722]: audit 2024-09-14T03:34:54.529625+0000 mgr.a (mgr.14355) 13580 : audit [DBG] from='client.295275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:34:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:56 smithi007 bash[22722]: cluster 2024-09-14T03:34:55.168521+0000 mgr.a (mgr.14355) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:34:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:34:58 smithi131 bash[24745]: cluster 2024-09-14T03:34:57.170851+0000 mgr.a (mgr.14355) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:34:58 smithi171 bash[25040]: cluster 2024-09-14T03:34:57.170851+0000 mgr.a (mgr.14355) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:34:58 smithi007 bash[22722]: cluster 2024-09-14T03:34:57.170851+0000 mgr.a (mgr.14355) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:34:59.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:34:59.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:34:59.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:00 smithi131 bash[24745]: cluster 2024-09-14T03:34:59.171567+0000 mgr.a (mgr.14355) 13583 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:00 smithi171 bash[25040]: cluster 2024-09-14T03:34:59.171567+0000 mgr.a (mgr.14355) 13583 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:00 smithi007 bash[22722]: cluster 2024-09-14T03:34:59.171567+0000 mgr.a (mgr.14355) 13583 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:00.739 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:00.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:00.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:01 smithi007 bash[22722]: audit 2024-09-14T03:35:00.289412+0000 mgr.a (mgr.14355) 13584 : audit [DBG] from='client.295353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:01.529 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:01 smithi171 bash[25040]: audit 2024-09-14T03:35:00.289412+0000 mgr.a (mgr.14355) 13584 : audit [DBG] from='client.295353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:01 smithi131 bash[24745]: audit 2024-09-14T03:35:00.289412+0000 mgr.a (mgr.14355) 13584 : audit [DBG] from='client.295353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:02 smithi131 bash[24745]: cluster 2024-09-14T03:35:01.174465+0000 mgr.a (mgr.14355) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:02 smithi171 bash[25040]: cluster 2024-09-14T03:35:01.174465+0000 mgr.a (mgr.14355) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:02 smithi007 bash[22722]: cluster 2024-09-14T03:35:01.174465+0000 mgr.a (mgr.14355) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:04 smithi131 bash[24745]: cluster 2024-09-14T03:35:03.175254+0000 mgr.a (mgr.14355) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:04 smithi171 bash[25040]: cluster 2024-09-14T03:35:03.175254+0000 mgr.a (mgr.14355) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:04 smithi007 bash[22722]: cluster 2024-09-14T03:35:03.175254+0000 mgr.a (mgr.14355) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:05.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:06.488 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:06.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:06 smithi131 bash[24745]: cluster 2024-09-14T03:35:05.176016+0000 mgr.a (mgr.14355) 13587 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:35:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:06 smithi171 bash[25040]: cluster 2024-09-14T03:35:05.176016+0000 mgr.a (mgr.14355) 13587 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:35:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:06 smithi007 bash[22722]: cluster 2024-09-14T03:35:05.176016+0000 mgr.a (mgr.14355) 13587 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:35:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:07 smithi131 bash[24745]: audit 2024-09-14T03:35:06.070112+0000 mgr.a (mgr.14355) 13588 : audit [DBG] from='client.295428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:07 smithi171 bash[25040]: audit 2024-09-14T03:35:06.070112+0000 mgr.a (mgr.14355) 13588 : audit [DBG] from='client.295428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:07 smithi007 bash[22722]: audit 2024-09-14T03:35:06.070112+0000 mgr.a (mgr.14355) 13588 : audit [DBG] from='client.295428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:08 smithi131 bash[24745]: cluster 2024-09-14T03:35:07.178871+0000 mgr.a (mgr.14355) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:08 smithi171 bash[25040]: cluster 2024-09-14T03:35:07.178871+0000 mgr.a (mgr.14355) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:08 smithi007 bash[22722]: cluster 2024-09-14T03:35:07.178871+0000 mgr.a (mgr.14355) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:10 smithi131 bash[24745]: cluster 2024-09-14T03:35:09.179649+0000 mgr.a (mgr.14355) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:10 smithi171 bash[25040]: cluster 2024-09-14T03:35:09.179649+0000 mgr.a (mgr.14355) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:10 smithi007 bash[22722]: cluster 2024-09-14T03:35:09.179649+0000 mgr.a (mgr.14355) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:35:11.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:11.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:12.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:12.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:12 smithi131 bash[24745]: cluster 2024-09-14T03:35:11.181620+0000 mgr.a (mgr.14355) 13591 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:12 smithi171 bash[25040]: cluster 2024-09-14T03:35:11.181620+0000 mgr.a (mgr.14355) 13591 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:12 smithi007 bash[22722]: cluster 2024-09-14T03:35:11.181620+0000 mgr.a (mgr.14355) 13591 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:13 smithi131 bash[24745]: audit 2024-09-14T03:35:11.821075+0000 mgr.a (mgr.14355) 13592 : audit [DBG] from='client.295506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:13 smithi171 bash[25040]: audit 2024-09-14T03:35:11.821075+0000 mgr.a (mgr.14355) 13592 : audit [DBG] from='client.295506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:13 smithi007 bash[22722]: audit 2024-09-14T03:35:11.821075+0000 mgr.a (mgr.14355) 13592 : audit [DBG] from='client.295506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:14 smithi131 bash[24745]: cluster 2024-09-14T03:35:13.182554+0000 mgr.a (mgr.14355) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:14 smithi171 bash[25040]: cluster 2024-09-14T03:35:13.182554+0000 mgr.a (mgr.14355) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:14 smithi007 bash[22722]: cluster 2024-09-14T03:35:13.182554+0000 mgr.a (mgr.14355) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:16 smithi131 bash[24745]: cluster 2024-09-14T03:35:15.183342+0000 mgr.a (mgr.14355) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:16.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:16 smithi171 bash[25040]: cluster 2024-09-14T03:35:15.183342+0000 mgr.a (mgr.14355) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:16 smithi007 bash[22722]: cluster 2024-09-14T03:35:15.183342+0000 mgr.a (mgr.14355) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:17.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:17.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:18.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:18.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:18.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:18.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:18.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:18 smithi171 bash[25040]: cluster 2024-09-14T03:35:17.185579+0000 mgr.a (mgr.14355) 13595 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:18 smithi007 bash[22722]: cluster 2024-09-14T03:35:17.185579+0000 mgr.a (mgr.14355) 13595 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:18 smithi131 bash[24745]: cluster 2024-09-14T03:35:17.185579+0000 mgr.a (mgr.14355) 13595 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:19 smithi007 bash[22722]: audit 2024-09-14T03:35:17.570192+0000 mgr.a (mgr.14355) 13596 : audit [DBG] from='client.295584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:19 smithi131 bash[24745]: audit 2024-09-14T03:35:17.570192+0000 mgr.a (mgr.14355) 13596 : audit [DBG] from='client.295584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:19 smithi171 bash[25040]: audit 2024-09-14T03:35:17.570192+0000 mgr.a (mgr.14355) 13596 : audit [DBG] from='client.295584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:20 smithi007 bash[22722]: cluster 2024-09-14T03:35:19.186525+0000 mgr.a (mgr.14355) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:20 smithi131 bash[24745]: cluster 2024-09-14T03:35:19.186525+0000 mgr.a (mgr.14355) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:20 smithi171 bash[25040]: cluster 2024-09-14T03:35:19.186525+0000 mgr.a (mgr.14355) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:22 smithi007 bash[22722]: cluster 2024-09-14T03:35:21.188787+0000 mgr.a (mgr.14355) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:22 smithi131 bash[24745]: cluster 2024-09-14T03:35:21.188787+0000 mgr.a (mgr.14355) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:22 smithi171 bash[25040]: cluster 2024-09-14T03:35:21.188787+0000 mgr.a (mgr.14355) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:23.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:23.786 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:23.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:23.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:23.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:23.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:24 smithi007 bash[22722]: cluster 2024-09-14T03:35:23.189536+0000 mgr.a (mgr.14355) 13599 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:24 smithi007 bash[22722]: audit 2024-09-14T03:35:23.351014+0000 mgr.a (mgr.14355) 13600 : audit [DBG] from='client.295659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:24 smithi131 bash[24745]: cluster 2024-09-14T03:35:23.189536+0000 mgr.a (mgr.14355) 13599 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:24 smithi131 bash[24745]: audit 2024-09-14T03:35:23.351014+0000 mgr.a (mgr.14355) 13600 : audit [DBG] from='client.295659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:24 smithi171 bash[25040]: cluster 2024-09-14T03:35:23.189536+0000 mgr.a (mgr.14355) 13599 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:24 smithi171 bash[25040]: audit 2024-09-14T03:35:23.351014+0000 mgr.a (mgr.14355) 13600 : audit [DBG] from='client.295659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:26 smithi007 bash[22722]: cluster 2024-09-14T03:35:25.190505+0000 mgr.a (mgr.14355) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:26 smithi131 bash[24745]: cluster 2024-09-14T03:35:25.190505+0000 mgr.a (mgr.14355) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:26 smithi171 bash[25040]: cluster 2024-09-14T03:35:25.190505+0000 mgr.a (mgr.14355) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:28 smithi007 bash[22722]: cluster 2024-09-14T03:35:27.192810+0000 mgr.a (mgr.14355) 13602 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:28 smithi131 bash[24745]: cluster 2024-09-14T03:35:27.192810+0000 mgr.a (mgr.14355) 13602 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:28.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:28.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:28.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:28 smithi171 bash[25040]: cluster 2024-09-14T03:35:27.192810+0000 mgr.a (mgr.14355) 13602 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:29.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:29.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:30 smithi007 bash[22722]: audit 2024-09-14T03:35:29.121999+0000 mgr.a (mgr.14355) 13603 : audit [DBG] from='client.295737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:30 smithi007 bash[22722]: cluster 2024-09-14T03:35:29.193529+0000 mgr.a (mgr.14355) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:30 smithi131 bash[24745]: audit 2024-09-14T03:35:29.121999+0000 mgr.a (mgr.14355) 13603 : audit [DBG] from='client.295737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:30 smithi131 bash[24745]: cluster 2024-09-14T03:35:29.193529+0000 mgr.a (mgr.14355) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:30 smithi171 bash[25040]: audit 2024-09-14T03:35:29.121999+0000 mgr.a (mgr.14355) 13603 : audit [DBG] from='client.295737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:30 smithi171 bash[25040]: cluster 2024-09-14T03:35:29.193529+0000 mgr.a (mgr.14355) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:32 smithi007 bash[22722]: cluster 2024-09-14T03:35:31.195916+0000 mgr.a (mgr.14355) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:32 smithi131 bash[24745]: cluster 2024-09-14T03:35:31.195916+0000 mgr.a (mgr.14355) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:32 smithi171 bash[25040]: cluster 2024-09-14T03:35:31.195916+0000 mgr.a (mgr.14355) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:34.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:34.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:34.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:34 smithi007 bash[22722]: cluster 2024-09-14T03:35:33.196741+0000 mgr.a (mgr.14355) 13606 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:34 smithi131 bash[24745]: cluster 2024-09-14T03:35:33.196741+0000 mgr.a (mgr.14355) 13606 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:34 smithi171 bash[25040]: cluster 2024-09-14T03:35:33.196741+0000 mgr.a (mgr.14355) 13606 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:35.342 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:36 smithi007 bash[22722]: audit 2024-09-14T03:35:34.890612+0000 mgr.a (mgr.14355) 13607 : audit [DBG] from='client.295815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:36 smithi007 bash[22722]: cluster 2024-09-14T03:35:35.197356+0000 mgr.a (mgr.14355) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:36 smithi131 bash[24745]: audit 2024-09-14T03:35:34.890612+0000 mgr.a (mgr.14355) 13607 : audit [DBG] from='client.295815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:36 smithi131 bash[24745]: cluster 2024-09-14T03:35:35.197356+0000 mgr.a (mgr.14355) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:36 smithi171 bash[25040]: audit 2024-09-14T03:35:34.890612+0000 mgr.a (mgr.14355) 13607 : audit [DBG] from='client.295815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:36 smithi171 bash[25040]: cluster 2024-09-14T03:35:35.197356+0000 mgr.a (mgr.14355) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:38 smithi007 bash[22722]: cluster 2024-09-14T03:35:37.199726+0000 mgr.a (mgr.14355) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:38 smithi131 bash[24745]: cluster 2024-09-14T03:35:37.199726+0000 mgr.a (mgr.14355) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:38 smithi171 bash[25040]: cluster 2024-09-14T03:35:37.199726+0000 mgr.a (mgr.14355) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:35:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:39 smithi007 bash[22722]: audit 2024-09-14T03:35:39.044075+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:35:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:39 smithi131 bash[24745]: audit 2024-09-14T03:35:39.044075+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:35:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:39 smithi171 bash[25040]: audit 2024-09-14T03:35:39.044075+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:35:40.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:40.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22722]: cluster 2024-09-14T03:35:39.200436+0000 mgr.a (mgr.14355) 13610 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22722]: audit 2024-09-14T03:35:39.888182+0000 mon.a (mon.0) 2625 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:35:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22722]: audit 2024-09-14T03:35:39.889705+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:35:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22722]: audit 2024-09-14T03:35:39.896083+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:35:40.654 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22722]: audit 2024-09-14T03:35:39.901023+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:40 smithi131 bash[24745]: cluster 2024-09-14T03:35:39.200436+0000 mgr.a (mgr.14355) 13610 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:40 smithi131 bash[24745]: audit 2024-09-14T03:35:39.888182+0000 mon.a (mon.0) 2625 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:35:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:40 smithi131 bash[24745]: audit 2024-09-14T03:35:39.889705+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:35:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:40 smithi131 bash[24745]: audit 2024-09-14T03:35:39.896083+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:35:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:40 smithi131 bash[24745]: audit 2024-09-14T03:35:39.901023+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:40 smithi171 bash[25040]: cluster 2024-09-14T03:35:39.200436+0000 mgr.a (mgr.14355) 13610 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:40 smithi171 bash[25040]: audit 2024-09-14T03:35:39.888182+0000 mon.a (mon.0) 2625 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:35:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:40 smithi171 bash[25040]: audit 2024-09-14T03:35:39.889705+0000 mon.a (mon.0) 2626 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:35:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:40 smithi171 bash[25040]: audit 2024-09-14T03:35:39.896083+0000 mon.a (mon.0) 2627 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:35:40.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:40 smithi171 bash[25040]: audit 2024-09-14T03:35:39.901023+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22972]: debug 2024-09-14T03:35:40.648+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:35:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:35:40 smithi007 bash[22972]: debug 2024-09-14T03:35:40.652+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:35:41.076 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:41.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:41.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:41 smithi007 bash[22722]: audit 2024-09-14T03:35:39.903306+0000 mgr.a (mgr.14355) 13611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:41 smithi131 bash[24745]: audit 2024-09-14T03:35:39.903306+0000 mgr.a (mgr.14355) 13611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:41 smithi171 bash[25040]: audit 2024-09-14T03:35:39.903306+0000 mgr.a (mgr.14355) 13611 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:35:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:42 smithi007 bash[22722]: audit 2024-09-14T03:35:40.653836+0000 mgr.a (mgr.14355) 13612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:35:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:42 smithi007 bash[22722]: cephadm 2024-09-14T03:35:40.655565+0000 mgr.a (mgr.14355) 13613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:35:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:42 smithi007 bash[22722]: audit 2024-09-14T03:35:40.672102+0000 mgr.a (mgr.14355) 13614 : audit [DBG] from='client.295971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:42 smithi007 bash[22722]: cluster 2024-09-14T03:35:41.203161+0000 mgr.a (mgr.14355) 13615 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:35:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:42 smithi131 bash[24745]: audit 2024-09-14T03:35:40.653836+0000 mgr.a (mgr.14355) 13612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:35:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:42 smithi131 bash[24745]: cephadm 2024-09-14T03:35:40.655565+0000 mgr.a (mgr.14355) 13613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:35:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:42 smithi131 bash[24745]: audit 2024-09-14T03:35:40.672102+0000 mgr.a (mgr.14355) 13614 : audit [DBG] from='client.295971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:42 smithi131 bash[24745]: cluster 2024-09-14T03:35:41.203161+0000 mgr.a (mgr.14355) 13615 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:35:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:42 smithi171 bash[25040]: audit 2024-09-14T03:35:40.653836+0000 mgr.a (mgr.14355) 13612 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:35:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:42 smithi171 bash[25040]: cephadm 2024-09-14T03:35:40.655565+0000 mgr.a (mgr.14355) 13613 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:35:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:42 smithi171 bash[25040]: audit 2024-09-14T03:35:40.672102+0000 mgr.a (mgr.14355) 13614 : audit [DBG] from='client.295971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:42 smithi171 bash[25040]: cluster 2024-09-14T03:35:41.203161+0000 mgr.a (mgr.14355) 13615 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T03:35:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:44 smithi007 bash[22722]: cluster 2024-09-14T03:35:43.203945+0000 mgr.a (mgr.14355) 13616 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:44 smithi131 bash[24745]: cluster 2024-09-14T03:35:43.203945+0000 mgr.a (mgr.14355) 13616 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:44 smithi171 bash[25040]: cluster 2024-09-14T03:35:43.203945+0000 mgr.a (mgr.14355) 13616 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:46.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:46.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:46.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:46 smithi007 bash[22722]: cluster 2024-09-14T03:35:45.204687+0000 mgr.a (mgr.14355) 13617 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:46 smithi131 bash[24745]: cluster 2024-09-14T03:35:45.204687+0000 mgr.a (mgr.14355) 13617 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:46 smithi171 bash[25040]: cluster 2024-09-14T03:35:45.204687+0000 mgr.a (mgr.14355) 13617 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T03:35:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:46.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:46.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:48 smithi007 bash[22722]: audit 2024-09-14T03:35:46.413616+0000 mgr.a (mgr.14355) 13618 : audit [DBG] from='client.296067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:48 smithi007 bash[22722]: cluster 2024-09-14T03:35:47.207494+0000 mgr.a (mgr.14355) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:48 smithi131 bash[24745]: audit 2024-09-14T03:35:46.413616+0000 mgr.a (mgr.14355) 13618 : audit [DBG] from='client.296067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:48 smithi131 bash[24745]: cluster 2024-09-14T03:35:47.207494+0000 mgr.a (mgr.14355) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:48 smithi171 bash[25040]: audit 2024-09-14T03:35:46.413616+0000 mgr.a (mgr.14355) 13618 : audit [DBG] from='client.296067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:48 smithi171 bash[25040]: cluster 2024-09-14T03:35:47.207494+0000 mgr.a (mgr.14355) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:50 smithi007 bash[22722]: cluster 2024-09-14T03:35:49.208281+0000 mgr.a (mgr.14355) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:35:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:50 smithi131 bash[24745]: cluster 2024-09-14T03:35:49.208281+0000 mgr.a (mgr.14355) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:35:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:50 smithi171 bash[25040]: cluster 2024-09-14T03:35:49.208281+0000 mgr.a (mgr.14355) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:35:51.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:51.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:52.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:52.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:52 smithi007 bash[22722]: cluster 2024-09-14T03:35:51.210353+0000 mgr.a (mgr.14355) 13621 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:52 smithi131 bash[24745]: cluster 2024-09-14T03:35:51.210353+0000 mgr.a (mgr.14355) 13621 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:52 smithi171 bash[25040]: cluster 2024-09-14T03:35:51.210353+0000 mgr.a (mgr.14355) 13621 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:35:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:53 smithi007 bash[22722]: audit 2024-09-14T03:35:52.191507+0000 mgr.a (mgr.14355) 13622 : audit [DBG] from='client.296145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:53 smithi131 bash[24745]: audit 2024-09-14T03:35:52.191507+0000 mgr.a (mgr.14355) 13622 : audit [DBG] from='client.296145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:53 smithi171 bash[25040]: audit 2024-09-14T03:35:52.191507+0000 mgr.a (mgr.14355) 13622 : audit [DBG] from='client.296145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:54 smithi007 bash[22722]: cluster 2024-09-14T03:35:53.211255+0000 mgr.a (mgr.14355) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:54 smithi131 bash[24745]: cluster 2024-09-14T03:35:53.211255+0000 mgr.a (mgr.14355) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:54 smithi171 bash[25040]: cluster 2024-09-14T03:35:53.211255+0000 mgr.a (mgr.14355) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:56 smithi007 bash[22722]: cluster 2024-09-14T03:35:55.212027+0000 mgr.a (mgr.14355) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:56 smithi131 bash[24745]: cluster 2024-09-14T03:35:55.212027+0000 mgr.a (mgr.14355) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:56 smithi171 bash[25040]: cluster 2024-09-14T03:35:55.212027+0000 mgr.a (mgr.14355) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T03:35:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:35:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:35:57.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:35:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:57 smithi007 bash[22722]: cluster 2024-09-14T03:35:57.214267+0000 mgr.a (mgr.14355) 13625 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:35:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:57 smithi131 bash[24745]: cluster 2024-09-14T03:35:57.214267+0000 mgr.a (mgr.14355) 13625 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:35:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:57 smithi171 bash[25040]: cluster 2024-09-14T03:35:57.214267+0000 mgr.a (mgr.14355) 13625 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T03:35:58.398 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:35:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:35:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:35:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:35:58.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:35:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:58 smithi007 bash[22722]: audit 2024-09-14T03:35:57.956740+0000 mgr.a (mgr.14355) 13626 : audit [DBG] from='client.296220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:58 smithi131 bash[24745]: audit 2024-09-14T03:35:57.956740+0000 mgr.a (mgr.14355) 13626 : audit [DBG] from='client.296220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:58 smithi171 bash[25040]: audit 2024-09-14T03:35:57.956740+0000 mgr.a (mgr.14355) 13626 : audit [DBG] from='client.296220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:35:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:35:59 smithi007 bash[22722]: cluster 2024-09-14T03:35:59.215292+0000 mgr.a (mgr.14355) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:35:59 smithi131 bash[24745]: cluster 2024-09-14T03:35:59.215292+0000 mgr.a (mgr.14355) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:35:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:35:59 smithi171 bash[25040]: cluster 2024-09-14T03:35:59.215292+0000 mgr.a (mgr.14355) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:02 smithi131 bash[24745]: cluster 2024-09-14T03:36:01.217731+0000 mgr.a (mgr.14355) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:02 smithi171 bash[25040]: cluster 2024-09-14T03:36:01.217731+0000 mgr.a (mgr.14355) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:02 smithi007 bash[22722]: cluster 2024-09-14T03:36:01.217731+0000 mgr.a (mgr.14355) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:03.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:03.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:03.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:04.164 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:04.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:04.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:04.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:04.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:04 smithi131 bash[24745]: cluster 2024-09-14T03:36:03.218631+0000 mgr.a (mgr.14355) 13629 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:04 smithi171 bash[25040]: cluster 2024-09-14T03:36:03.218631+0000 mgr.a (mgr.14355) 13629 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:04 smithi007 bash[22722]: cluster 2024-09-14T03:36:03.218631+0000 mgr.a (mgr.14355) 13629 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:05 smithi171 bash[25040]: audit 2024-09-14T03:36:03.736987+0000 mgr.a (mgr.14355) 13630 : audit [DBG] from='client.296295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:05 smithi007 bash[22722]: audit 2024-09-14T03:36:03.736987+0000 mgr.a (mgr.14355) 13630 : audit [DBG] from='client.296295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:05 smithi131 bash[24745]: audit 2024-09-14T03:36:03.736987+0000 mgr.a (mgr.14355) 13630 : audit [DBG] from='client.296295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:06 smithi171 bash[25040]: cluster 2024-09-14T03:36:05.219692+0000 mgr.a (mgr.14355) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:06 smithi007 bash[22722]: cluster 2024-09-14T03:36:05.219692+0000 mgr.a (mgr.14355) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:06 smithi131 bash[24745]: cluster 2024-09-14T03:36:05.219692+0000 mgr.a (mgr.14355) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:08 smithi007 bash[22722]: cluster 2024-09-14T03:36:07.221963+0000 mgr.a (mgr.14355) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:08 smithi131 bash[24745]: cluster 2024-09-14T03:36:07.221963+0000 mgr.a (mgr.14355) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:08 smithi171 bash[25040]: cluster 2024-09-14T03:36:07.221963+0000 mgr.a (mgr.14355) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:09.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:09.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:09.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:09.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:09.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:10 smithi007 bash[22722]: cluster 2024-09-14T03:36:09.222730+0000 mgr.a (mgr.14355) 13633 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:10 smithi131 bash[24745]: cluster 2024-09-14T03:36:09.222730+0000 mgr.a (mgr.14355) 13633 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:10 smithi171 bash[25040]: cluster 2024-09-14T03:36:09.222730+0000 mgr.a (mgr.14355) 13633 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:11 smithi007 bash[22722]: audit 2024-09-14T03:36:09.500408+0000 mgr.a (mgr.14355) 13634 : audit [DBG] from='client.296367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:11 smithi131 bash[24745]: audit 2024-09-14T03:36:09.500408+0000 mgr.a (mgr.14355) 13634 : audit [DBG] from='client.296367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:11 smithi171 bash[25040]: audit 2024-09-14T03:36:09.500408+0000 mgr.a (mgr.14355) 13634 : audit [DBG] from='client.296367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:12 smithi007 bash[22722]: cluster 2024-09-14T03:36:11.225080+0000 mgr.a (mgr.14355) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:12 smithi131 bash[24745]: cluster 2024-09-14T03:36:11.225080+0000 mgr.a (mgr.14355) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:12.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:12 smithi171 bash[25040]: cluster 2024-09-14T03:36:11.225080+0000 mgr.a (mgr.14355) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:14 smithi007 bash[22722]: cluster 2024-09-14T03:36:13.225850+0000 mgr.a (mgr.14355) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:14 smithi131 bash[24745]: cluster 2024-09-14T03:36:13.225850+0000 mgr.a (mgr.14355) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:14 smithi171 bash[25040]: cluster 2024-09-14T03:36:13.225850+0000 mgr.a (mgr.14355) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:14.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:14.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:14.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:15.706 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:15.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:15.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:16 smithi007 bash[22722]: cluster 2024-09-14T03:36:15.226548+0000 mgr.a (mgr.14355) 13637 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:16 smithi007 bash[22722]: audit 2024-09-14T03:36:15.282920+0000 mgr.a (mgr.14355) 13638 : audit [DBG] from='client.296442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:16 smithi131 bash[24745]: cluster 2024-09-14T03:36:15.226548+0000 mgr.a (mgr.14355) 13637 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:16 smithi131 bash[24745]: audit 2024-09-14T03:36:15.282920+0000 mgr.a (mgr.14355) 13638 : audit [DBG] from='client.296442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:16 smithi171 bash[25040]: cluster 2024-09-14T03:36:15.226548+0000 mgr.a (mgr.14355) 13637 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:16 smithi171 bash[25040]: audit 2024-09-14T03:36:15.282920+0000 mgr.a (mgr.14355) 13638 : audit [DBG] from='client.296442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:18 smithi007 bash[22722]: cluster 2024-09-14T03:36:17.229371+0000 mgr.a (mgr.14355) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:18 smithi131 bash[24745]: cluster 2024-09-14T03:36:17.229371+0000 mgr.a (mgr.14355) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:18 smithi171 bash[25040]: cluster 2024-09-14T03:36:17.229371+0000 mgr.a (mgr.14355) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:20 smithi007 bash[22722]: cluster 2024-09-14T03:36:19.230333+0000 mgr.a (mgr.14355) 13640 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:20.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:20 smithi131 bash[24745]: cluster 2024-09-14T03:36:19.230333+0000 mgr.a (mgr.14355) 13640 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:20 smithi171 bash[25040]: cluster 2024-09-14T03:36:19.230333+0000 mgr.a (mgr.14355) 13640 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:21.464 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:21.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:22 smithi007 bash[22722]: audit 2024-09-14T03:36:21.046313+0000 mgr.a (mgr.14355) 13641 : audit [DBG] from='client.296520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:22 smithi007 bash[22722]: cluster 2024-09-14T03:36:21.231689+0000 mgr.a (mgr.14355) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:22 smithi131 bash[24745]: audit 2024-09-14T03:36:21.046313+0000 mgr.a (mgr.14355) 13641 : audit [DBG] from='client.296520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:22 smithi131 bash[24745]: cluster 2024-09-14T03:36:21.231689+0000 mgr.a (mgr.14355) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:22 smithi171 bash[25040]: audit 2024-09-14T03:36:21.046313+0000 mgr.a (mgr.14355) 13641 : audit [DBG] from='client.296520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:22 smithi171 bash[25040]: cluster 2024-09-14T03:36:21.231689+0000 mgr.a (mgr.14355) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:24 smithi007 bash[22722]: cluster 2024-09-14T03:36:23.232676+0000 mgr.a (mgr.14355) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:24 smithi131 bash[24745]: cluster 2024-09-14T03:36:23.232676+0000 mgr.a (mgr.14355) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:24 smithi171 bash[25040]: cluster 2024-09-14T03:36:23.232676+0000 mgr.a (mgr.14355) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:36:26.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:26.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:26.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:26 smithi007 bash[22722]: cluster 2024-09-14T03:36:25.233961+0000 mgr.a (mgr.14355) 13644 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:36:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:26 smithi131 bash[24745]: cluster 2024-09-14T03:36:25.233961+0000 mgr.a (mgr.14355) 13644 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:36:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:26 smithi171 bash[25040]: cluster 2024-09-14T03:36:25.233961+0000 mgr.a (mgr.14355) 13644 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:36:27.235 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:28 smithi007 bash[22722]: audit 2024-09-14T03:36:26.800815+0000 mgr.a (mgr.14355) 13645 : audit [DBG] from='client.296598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:28 smithi007 bash[22722]: cluster 2024-09-14T03:36:27.235229+0000 mgr.a (mgr.14355) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:28 smithi131 bash[24745]: audit 2024-09-14T03:36:26.800815+0000 mgr.a (mgr.14355) 13645 : audit [DBG] from='client.296598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:28 smithi131 bash[24745]: cluster 2024-09-14T03:36:27.235229+0000 mgr.a (mgr.14355) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:28 smithi171 bash[25040]: audit 2024-09-14T03:36:26.800815+0000 mgr.a (mgr.14355) 13645 : audit [DBG] from='client.296598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:28 smithi171 bash[25040]: cluster 2024-09-14T03:36:27.235229+0000 mgr.a (mgr.14355) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:30 smithi007 bash[22722]: cluster 2024-09-14T03:36:29.235971+0000 mgr.a (mgr.14355) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:30 smithi131 bash[24745]: cluster 2024-09-14T03:36:29.235971+0000 mgr.a (mgr.14355) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:30 smithi171 bash[25040]: cluster 2024-09-14T03:36:29.235971+0000 mgr.a (mgr.14355) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:32.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:32.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:32 smithi007 bash[22722]: cluster 2024-09-14T03:36:31.237987+0000 mgr.a (mgr.14355) 13648 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:32 smithi131 bash[24745]: cluster 2024-09-14T03:36:31.237987+0000 mgr.a (mgr.14355) 13648 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:32 smithi171 bash[25040]: cluster 2024-09-14T03:36:31.237987+0000 mgr.a (mgr.14355) 13648 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:33.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:33.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:34 smithi007 bash[22722]: audit 2024-09-14T03:36:32.574168+0000 mgr.a (mgr.14355) 13649 : audit [DBG] from='client.296676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:34 smithi007 bash[22722]: cluster 2024-09-14T03:36:33.238928+0000 mgr.a (mgr.14355) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:34 smithi131 bash[24745]: audit 2024-09-14T03:36:32.574168+0000 mgr.a (mgr.14355) 13649 : audit [DBG] from='client.296676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:34 smithi131 bash[24745]: cluster 2024-09-14T03:36:33.238928+0000 mgr.a (mgr.14355) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:34 smithi171 bash[25040]: audit 2024-09-14T03:36:32.574168+0000 mgr.a (mgr.14355) 13649 : audit [DBG] from='client.296676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:34 smithi171 bash[25040]: cluster 2024-09-14T03:36:33.238928+0000 mgr.a (mgr.14355) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:36 smithi007 bash[22722]: cluster 2024-09-14T03:36:35.241224+0000 mgr.a (mgr.14355) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:36 smithi131 bash[24745]: cluster 2024-09-14T03:36:35.241224+0000 mgr.a (mgr.14355) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:36 smithi171 bash[25040]: cluster 2024-09-14T03:36:35.241224+0000 mgr.a (mgr.14355) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:38.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:38.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:38 smithi007 bash[22722]: cluster 2024-09-14T03:36:37.242173+0000 mgr.a (mgr.14355) 13652 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:38 smithi131 bash[24745]: cluster 2024-09-14T03:36:37.242173+0000 mgr.a (mgr.14355) 13652 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:38.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:38.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:38.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:38.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:38.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:38 smithi171 bash[25040]: cluster 2024-09-14T03:36:37.242173+0000 mgr.a (mgr.14355) 13652 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:39 smithi007 bash[22722]: audit 2024-09-14T03:36:38.366347+0000 mgr.a (mgr.14355) 13653 : audit [DBG] from='client.296751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:39 smithi131 bash[24745]: audit 2024-09-14T03:36:38.366347+0000 mgr.a (mgr.14355) 13653 : audit [DBG] from='client.296751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:39 smithi171 bash[25040]: audit 2024-09-14T03:36:38.366347+0000 mgr.a (mgr.14355) 13653 : audit [DBG] from='client.296751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:40 smithi007 bash[22722]: cluster 2024-09-14T03:36:39.243057+0000 mgr.a (mgr.14355) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:40 smithi131 bash[24745]: cluster 2024-09-14T03:36:39.243057+0000 mgr.a (mgr.14355) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:40 smithi171 bash[25040]: cluster 2024-09-14T03:36:39.243057+0000 mgr.a (mgr.14355) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:41 smithi007 bash[22722]: audit 2024-09-14T03:36:40.721141+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:36:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:41 smithi131 bash[24745]: audit 2024-09-14T03:36:40.721141+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:36:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:41 smithi171 bash[25040]: audit 2024-09-14T03:36:40.721141+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:36:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:42 smithi007 bash[22722]: cluster 2024-09-14T03:36:41.245269+0000 mgr.a (mgr.14355) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:42 smithi131 bash[24745]: cluster 2024-09-14T03:36:41.245269+0000 mgr.a (mgr.14355) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:42 smithi171 bash[25040]: cluster 2024-09-14T03:36:41.245269+0000 mgr.a (mgr.14355) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:43.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:43.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:43.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:44.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:44.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:44.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:44.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:44.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:44 smithi007 bash[22722]: cluster 2024-09-14T03:36:43.246179+0000 mgr.a (mgr.14355) 13656 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:44 smithi131 bash[24745]: cluster 2024-09-14T03:36:43.246179+0000 mgr.a (mgr.14355) 13656 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:44 smithi171 bash[25040]: cluster 2024-09-14T03:36:43.246179+0000 mgr.a (mgr.14355) 13656 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:45 smithi007 bash[22722]: audit 2024-09-14T03:36:44.114897+0000 mgr.a (mgr.14355) 13657 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:45 smithi131 bash[24745]: audit 2024-09-14T03:36:44.114897+0000 mgr.a (mgr.14355) 13657 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:45 smithi171 bash[25040]: audit 2024-09-14T03:36:44.114897+0000 mgr.a (mgr.14355) 13657 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: cluster 2024-09-14T03:36:45.248510+0000 mgr.a (mgr.14355) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.069805+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.073905+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.087723+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.091469+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.094329+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:46 smithi007 bash[22722]: audit 2024-09-14T03:36:46.097158+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: cluster 2024-09-14T03:36:45.248510+0000 mgr.a (mgr.14355) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.069805+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.073905+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.087723+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.091469+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.094329+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:46 smithi131 bash[24745]: audit 2024-09-14T03:36:46.097158+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: cluster 2024-09-14T03:36:45.248510+0000 mgr.a (mgr.14355) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:36:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.069805+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.073905+0000 mon.a (mon.0) 2631 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.087723+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.091469+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.094329+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:46 smithi171 bash[25040]: audit 2024-09-14T03:36:46.097158+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:47.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22972]: debug 2024-09-14T03:36:47.579+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:36:47.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22972]: debug 2024-09-14T03:36:47.583+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:36:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22722]: audit 2024-09-14T03:36:46.824955+0000 mon.a (mon.0) 2636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:36:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22722]: audit 2024-09-14T03:36:46.826992+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:36:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22722]: audit 2024-09-14T03:36:46.835530+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:47 smithi007 bash[22722]: audit 2024-09-14T03:36:46.838049+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:47 smithi131 bash[24745]: audit 2024-09-14T03:36:46.824955+0000 mon.a (mon.0) 2636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:36:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:47 smithi131 bash[24745]: audit 2024-09-14T03:36:46.826992+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:36:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:47 smithi131 bash[24745]: audit 2024-09-14T03:36:46.835530+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:47.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:47 smithi131 bash[24745]: audit 2024-09-14T03:36:46.838049+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:47 smithi171 bash[25040]: audit 2024-09-14T03:36:46.824955+0000 mon.a (mon.0) 2636 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:36:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:47 smithi171 bash[25040]: audit 2024-09-14T03:36:46.826992+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:36:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:47 smithi171 bash[25040]: audit 2024-09-14T03:36:46.835530+0000 mon.a (mon.0) 2638 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:36:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:47 smithi171 bash[25040]: audit 2024-09-14T03:36:46.838049+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:48 smithi007 bash[22722]: audit 2024-09-14T03:36:46.840430+0000 mgr.a (mgr.14355) 13659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:48 smithi007 bash[22722]: cluster 2024-09-14T03:36:47.249006+0000 mgr.a (mgr.14355) 13660 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:48 smithi131 bash[24745]: audit 2024-09-14T03:36:46.840430+0000 mgr.a (mgr.14355) 13659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:48.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:48 smithi131 bash[24745]: cluster 2024-09-14T03:36:47.249006+0000 mgr.a (mgr.14355) 13660 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:48 smithi171 bash[25040]: audit 2024-09-14T03:36:46.840430+0000 mgr.a (mgr.14355) 13659 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:36:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:48 smithi171 bash[25040]: cluster 2024-09-14T03:36:47.249006+0000 mgr.a (mgr.14355) 13660 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:49.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:49.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:49.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:49 smithi007 bash[22722]: audit 2024-09-14T03:36:47.586271+0000 mgr.a (mgr.14355) 13661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:36:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:49 smithi007 bash[22722]: cephadm 2024-09-14T03:36:47.587961+0000 mgr.a (mgr.14355) 13662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:36:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:49 smithi131 bash[24745]: audit 2024-09-14T03:36:47.586271+0000 mgr.a (mgr.14355) 13661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:36:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:49 smithi131 bash[24745]: cephadm 2024-09-14T03:36:47.587961+0000 mgr.a (mgr.14355) 13662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:36:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:49 smithi171 bash[25040]: audit 2024-09-14T03:36:47.586271+0000 mgr.a (mgr.14355) 13661 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:36:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:49 smithi171 bash[25040]: cephadm 2024-09-14T03:36:47.587961+0000 mgr.a (mgr.14355) 13662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:36:50.344 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:50 smithi007 bash[22722]: cluster 2024-09-14T03:36:49.249830+0000 mgr.a (mgr.14355) 13663 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:50 smithi007 bash[22722]: audit 2024-09-14T03:36:49.892635+0000 mgr.a (mgr.14355) 13664 : audit [DBG] from='client.297015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:50 smithi131 bash[24745]: cluster 2024-09-14T03:36:49.249830+0000 mgr.a (mgr.14355) 13663 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:50 smithi131 bash[24745]: audit 2024-09-14T03:36:49.892635+0000 mgr.a (mgr.14355) 13664 : audit [DBG] from='client.297015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:50 smithi171 bash[25040]: cluster 2024-09-14T03:36:49.249830+0000 mgr.a (mgr.14355) 13663 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:36:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:50 smithi171 bash[25040]: audit 2024-09-14T03:36:49.892635+0000 mgr.a (mgr.14355) 13664 : audit [DBG] from='client.297015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:51 smithi007 bash[22722]: cluster 2024-09-14T03:36:51.252604+0000 mgr.a (mgr.14355) 13665 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:51 smithi131 bash[24745]: cluster 2024-09-14T03:36:51.252604+0000 mgr.a (mgr.14355) 13665 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:51 smithi171 bash[25040]: cluster 2024-09-14T03:36:51.252604+0000 mgr.a (mgr.14355) 13665 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:54 smithi007 bash[22722]: cluster 2024-09-14T03:36:53.253385+0000 mgr.a (mgr.14355) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:36:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:54 smithi131 bash[24745]: cluster 2024-09-14T03:36:53.253385+0000 mgr.a (mgr.14355) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:36:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:54 smithi171 bash[25040]: cluster 2024-09-14T03:36:53.253385+0000 mgr.a (mgr.14355) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:36:55.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:36:55.346 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:36:56.114 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:36:56.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:36:56.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:36:56.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:36:56.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:36:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:56 smithi007 bash[22722]: cluster 2024-09-14T03:36:55.255323+0000 mgr.a (mgr.14355) 13667 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:56 smithi131 bash[24745]: cluster 2024-09-14T03:36:55.255323+0000 mgr.a (mgr.14355) 13667 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:56 smithi171 bash[25040]: cluster 2024-09-14T03:36:55.255323+0000 mgr.a (mgr.14355) 13667 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:36:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:57 smithi007 bash[22722]: audit 2024-09-14T03:36:55.676795+0000 mgr.a (mgr.14355) 13668 : audit [DBG] from='client.297090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:57 smithi131 bash[24745]: audit 2024-09-14T03:36:55.676795+0000 mgr.a (mgr.14355) 13668 : audit [DBG] from='client.297090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:57 smithi171 bash[25040]: audit 2024-09-14T03:36:55.676795+0000 mgr.a (mgr.14355) 13668 : audit [DBG] from='client.297090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:36:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:36:58 smithi007 bash[22722]: cluster 2024-09-14T03:36:57.256230+0000 mgr.a (mgr.14355) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:36:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:36:58 smithi131 bash[24745]: cluster 2024-09-14T03:36:57.256230+0000 mgr.a (mgr.14355) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:36:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:36:58 smithi171 bash[25040]: cluster 2024-09-14T03:36:57.256230+0000 mgr.a (mgr.14355) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:37:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:00 smithi007 bash[22722]: cluster 2024-09-14T03:36:59.257001+0000 mgr.a (mgr.14355) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:37:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:00 smithi131 bash[24745]: cluster 2024-09-14T03:36:59.257001+0000 mgr.a (mgr.14355) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:37:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:00 smithi171 bash[25040]: cluster 2024-09-14T03:36:59.257001+0000 mgr.a (mgr.14355) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:37:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:01.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:02.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:02 smithi007 bash[22722]: cluster 2024-09-14T03:37:01.259010+0000 mgr.a (mgr.14355) 13671 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:02 smithi131 bash[24745]: cluster 2024-09-14T03:37:01.259010+0000 mgr.a (mgr.14355) 13671 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:02 smithi171 bash[25040]: cluster 2024-09-14T03:37:01.259010+0000 mgr.a (mgr.14355) 13671 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:03 smithi007 bash[22722]: audit 2024-09-14T03:37:01.448538+0000 mgr.a (mgr.14355) 13672 : audit [DBG] from='client.297165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:03 smithi131 bash[24745]: audit 2024-09-14T03:37:01.448538+0000 mgr.a (mgr.14355) 13672 : audit [DBG] from='client.297165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:03 smithi171 bash[25040]: audit 2024-09-14T03:37:01.448538+0000 mgr.a (mgr.14355) 13672 : audit [DBG] from='client.297165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:04 smithi007 bash[22722]: cluster 2024-09-14T03:37:03.259890+0000 mgr.a (mgr.14355) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:37:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:04 smithi131 bash[24745]: cluster 2024-09-14T03:37:03.259890+0000 mgr.a (mgr.14355) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:37:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:04 smithi171 bash[25040]: cluster 2024-09-14T03:37:03.259890+0000 mgr.a (mgr.14355) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:37:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:06 smithi007 bash[22722]: cluster 2024-09-14T03:37:05.262216+0000 mgr.a (mgr.14355) 13674 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:37:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:06 smithi131 bash[24745]: cluster 2024-09-14T03:37:05.262216+0000 mgr.a (mgr.14355) 13674 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:37:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:06 smithi171 bash[25040]: cluster 2024-09-14T03:37:05.262216+0000 mgr.a (mgr.14355) 13674 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:37:06.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:06.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:07.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:08 smithi007 bash[22722]: audit 2024-09-14T03:37:07.202185+0000 mgr.a (mgr.14355) 13675 : audit [DBG] from='client.297243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:08 smithi007 bash[22722]: cluster 2024-09-14T03:37:07.262886+0000 mgr.a (mgr.14355) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:08 smithi131 bash[24745]: audit 2024-09-14T03:37:07.202185+0000 mgr.a (mgr.14355) 13675 : audit [DBG] from='client.297243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:08 smithi131 bash[24745]: cluster 2024-09-14T03:37:07.262886+0000 mgr.a (mgr.14355) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:08 smithi171 bash[25040]: audit 2024-09-14T03:37:07.202185+0000 mgr.a (mgr.14355) 13675 : audit [DBG] from='client.297243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:08 smithi171 bash[25040]: cluster 2024-09-14T03:37:07.262886+0000 mgr.a (mgr.14355) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:10 smithi007 bash[22722]: cluster 2024-09-14T03:37:09.263832+0000 mgr.a (mgr.14355) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:10 smithi131 bash[24745]: cluster 2024-09-14T03:37:09.263832+0000 mgr.a (mgr.14355) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:10 smithi171 bash[25040]: cluster 2024-09-14T03:37:09.263832+0000 mgr.a (mgr.14355) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:12.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:12.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:12.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:12 smithi007 bash[22722]: cluster 2024-09-14T03:37:11.266111+0000 mgr.a (mgr.14355) 13678 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:12 smithi131 bash[24745]: cluster 2024-09-14T03:37:11.266111+0000 mgr.a (mgr.14355) 13678 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:12 smithi171 bash[25040]: cluster 2024-09-14T03:37:11.266111+0000 mgr.a (mgr.14355) 13678 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:13.384 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:14 smithi007 bash[22722]: audit 2024-09-14T03:37:12.956907+0000 mgr.a (mgr.14355) 13679 : audit [DBG] from='client.297318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:14 smithi007 bash[22722]: cluster 2024-09-14T03:37:13.266707+0000 mgr.a (mgr.14355) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:14 smithi131 bash[24745]: audit 2024-09-14T03:37:12.956907+0000 mgr.a (mgr.14355) 13679 : audit [DBG] from='client.297318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:14 smithi131 bash[24745]: cluster 2024-09-14T03:37:13.266707+0000 mgr.a (mgr.14355) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:14 smithi171 bash[25040]: audit 2024-09-14T03:37:12.956907+0000 mgr.a (mgr.14355) 13679 : audit [DBG] from='client.297318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:14 smithi171 bash[25040]: cluster 2024-09-14T03:37:13.266707+0000 mgr.a (mgr.14355) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:16 smithi007 bash[22722]: cluster 2024-09-14T03:37:15.268936+0000 mgr.a (mgr.14355) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:16 smithi131 bash[24745]: cluster 2024-09-14T03:37:15.268936+0000 mgr.a (mgr.14355) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:16 smithi171 bash[25040]: cluster 2024-09-14T03:37:15.268936+0000 mgr.a (mgr.14355) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:18.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:18.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:18 smithi007 bash[22722]: cluster 2024-09-14T03:37:17.269738+0000 mgr.a (mgr.14355) 13682 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:18 smithi131 bash[24745]: cluster 2024-09-14T03:37:17.269738+0000 mgr.a (mgr.14355) 13682 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:18 smithi171 bash[25040]: cluster 2024-09-14T03:37:17.269738+0000 mgr.a (mgr.14355) 13682 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:19.163 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:19.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:20 smithi007 bash[22722]: audit 2024-09-14T03:37:18.722641+0000 mgr.a (mgr.14355) 13683 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:20 smithi007 bash[22722]: cluster 2024-09-14T03:37:19.270346+0000 mgr.a (mgr.14355) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:20 smithi131 bash[24745]: audit 2024-09-14T03:37:18.722641+0000 mgr.a (mgr.14355) 13683 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:20 smithi131 bash[24745]: cluster 2024-09-14T03:37:19.270346+0000 mgr.a (mgr.14355) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:20 smithi171 bash[25040]: audit 2024-09-14T03:37:18.722641+0000 mgr.a (mgr.14355) 13683 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:20 smithi171 bash[25040]: cluster 2024-09-14T03:37:19.270346+0000 mgr.a (mgr.14355) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:22 smithi007 bash[22722]: cluster 2024-09-14T03:37:21.272576+0000 mgr.a (mgr.14355) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:22 smithi131 bash[24745]: cluster 2024-09-14T03:37:21.272576+0000 mgr.a (mgr.14355) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:22 smithi171 bash[25040]: cluster 2024-09-14T03:37:21.272576+0000 mgr.a (mgr.14355) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:24.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:24.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:24.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:24 smithi007 bash[22722]: cluster 2024-09-14T03:37:23.273350+0000 mgr.a (mgr.14355) 13686 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:24 smithi131 bash[24745]: cluster 2024-09-14T03:37:23.273350+0000 mgr.a (mgr.14355) 13686 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:24 smithi171 bash[25040]: cluster 2024-09-14T03:37:23.273350+0000 mgr.a (mgr.14355) 13686 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:24.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:24.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:26 smithi007 bash[22722]: audit 2024-09-14T03:37:24.502313+0000 mgr.a (mgr.14355) 13687 : audit [DBG] from='client.297465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:26 smithi007 bash[22722]: cluster 2024-09-14T03:37:25.275743+0000 mgr.a (mgr.14355) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:26 smithi131 bash[24745]: audit 2024-09-14T03:37:24.502313+0000 mgr.a (mgr.14355) 13687 : audit [DBG] from='client.297465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:26 smithi131 bash[24745]: cluster 2024-09-14T03:37:25.275743+0000 mgr.a (mgr.14355) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:26 smithi171 bash[25040]: audit 2024-09-14T03:37:24.502313+0000 mgr.a (mgr.14355) 13687 : audit [DBG] from='client.297465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:26 smithi171 bash[25040]: cluster 2024-09-14T03:37:25.275743+0000 mgr.a (mgr.14355) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:28 smithi007 bash[22722]: cluster 2024-09-14T03:37:27.276566+0000 mgr.a (mgr.14355) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:28 smithi131 bash[24745]: cluster 2024-09-14T03:37:27.276566+0000 mgr.a (mgr.14355) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:28 smithi171 bash[25040]: cluster 2024-09-14T03:37:27.276566+0000 mgr.a (mgr.14355) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:30 smithi007 bash[22722]: cluster 2024-09-14T03:37:29.277327+0000 mgr.a (mgr.14355) 13690 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:30.719 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:30.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:30 smithi131 bash[24745]: cluster 2024-09-14T03:37:29.277327+0000 mgr.a (mgr.14355) 13690 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:30 smithi171 bash[25040]: cluster 2024-09-14T03:37:29.277327+0000 mgr.a (mgr.14355) 13690 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:31 smithi007 bash[22722]: audit 2024-09-14T03:37:30.288567+0000 mgr.a (mgr.14355) 13691 : audit [DBG] from='client.297540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:31 smithi131 bash[24745]: audit 2024-09-14T03:37:30.288567+0000 mgr.a (mgr.14355) 13691 : audit [DBG] from='client.297540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:31 smithi171 bash[25040]: audit 2024-09-14T03:37:30.288567+0000 mgr.a (mgr.14355) 13691 : audit [DBG] from='client.297540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:32 smithi007 bash[22722]: cluster 2024-09-14T03:37:31.280167+0000 mgr.a (mgr.14355) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:32 smithi131 bash[24745]: cluster 2024-09-14T03:37:31.280167+0000 mgr.a (mgr.14355) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:32 smithi171 bash[25040]: cluster 2024-09-14T03:37:31.280167+0000 mgr.a (mgr.14355) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:34 smithi007 bash[22722]: cluster 2024-09-14T03:37:33.280980+0000 mgr.a (mgr.14355) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:34 smithi131 bash[24745]: cluster 2024-09-14T03:37:33.280980+0000 mgr.a (mgr.14355) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:34 smithi171 bash[25040]: cluster 2024-09-14T03:37:33.280980+0000 mgr.a (mgr.14355) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:35.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:36.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:36.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:36.494 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:36 smithi007 bash[22722]: cluster 2024-09-14T03:37:35.283066+0000 mgr.a (mgr.14355) 13694 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:36 smithi131 bash[24745]: cluster 2024-09-14T03:37:35.283066+0000 mgr.a (mgr.14355) 13694 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:36 smithi171 bash[25040]: cluster 2024-09-14T03:37:35.283066+0000 mgr.a (mgr.14355) 13694 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:37 smithi007 bash[22722]: audit 2024-09-14T03:37:36.059455+0000 mgr.a (mgr.14355) 13695 : audit [DBG] from='client.297618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:37 smithi131 bash[24745]: audit 2024-09-14T03:37:36.059455+0000 mgr.a (mgr.14355) 13695 : audit [DBG] from='client.297618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:37 smithi171 bash[25040]: audit 2024-09-14T03:37:36.059455+0000 mgr.a (mgr.14355) 13695 : audit [DBG] from='client.297618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:38 smithi007 bash[22722]: cluster 2024-09-14T03:37:37.284018+0000 mgr.a (mgr.14355) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:38 smithi131 bash[24745]: cluster 2024-09-14T03:37:37.284018+0000 mgr.a (mgr.14355) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:38 smithi171 bash[25040]: cluster 2024-09-14T03:37:37.284018+0000 mgr.a (mgr.14355) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:37:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:39 smithi131 bash[24745]: cluster 2024-09-14T03:37:39.284982+0000 mgr.a (mgr.14355) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:37:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:39 smithi171 bash[25040]: cluster 2024-09-14T03:37:39.284982+0000 mgr.a (mgr.14355) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:37:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:39 smithi007 bash[22722]: cluster 2024-09-14T03:37:39.284982+0000 mgr.a (mgr.14355) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:37:41.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:41.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:42.275 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:42 smithi007 bash[22722]: cluster 2024-09-14T03:37:41.287254+0000 mgr.a (mgr.14355) 13698 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:42 smithi131 bash[24745]: cluster 2024-09-14T03:37:41.287254+0000 mgr.a (mgr.14355) 13698 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:42 smithi171 bash[25040]: cluster 2024-09-14T03:37:41.287254+0000 mgr.a (mgr.14355) 13698 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:43 smithi007 bash[22722]: audit 2024-09-14T03:37:41.831394+0000 mgr.a (mgr.14355) 13699 : audit [DBG] from='client.297693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:43 smithi131 bash[24745]: audit 2024-09-14T03:37:41.831394+0000 mgr.a (mgr.14355) 13699 : audit [DBG] from='client.297693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:43 smithi171 bash[25040]: audit 2024-09-14T03:37:41.831394+0000 mgr.a (mgr.14355) 13699 : audit [DBG] from='client.297693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:44 smithi007 bash[22722]: cluster 2024-09-14T03:37:43.288222+0000 mgr.a (mgr.14355) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:44 smithi131 bash[24745]: cluster 2024-09-14T03:37:43.288222+0000 mgr.a (mgr.14355) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:44 smithi171 bash[25040]: cluster 2024-09-14T03:37:43.288222+0000 mgr.a (mgr.14355) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:46 smithi007 bash[22722]: cluster 2024-09-14T03:37:45.290434+0000 mgr.a (mgr.14355) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:46 smithi131 bash[24745]: cluster 2024-09-14T03:37:45.290434+0000 mgr.a (mgr.14355) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:46 smithi171 bash[25040]: cluster 2024-09-14T03:37:45.290434+0000 mgr.a (mgr.14355) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:37:47.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:47.278 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:48.059 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:48 smithi007 bash[22722]: cluster 2024-09-14T03:37:47.290965+0000 mgr.a (mgr.14355) 13702 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:48 smithi007 bash[22722]: audit 2024-09-14T03:37:47.638610+0000 mon.a (mon.0) 2640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:37:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:48 smithi131 bash[24745]: cluster 2024-09-14T03:37:47.290965+0000 mgr.a (mgr.14355) 13702 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:48 smithi131 bash[24745]: audit 2024-09-14T03:37:47.638610+0000 mon.a (mon.0) 2640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:37:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:48 smithi171 bash[25040]: cluster 2024-09-14T03:37:47.290965+0000 mgr.a (mgr.14355) 13702 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:48 smithi171 bash[25040]: audit 2024-09-14T03:37:47.638610+0000 mon.a (mon.0) 2640 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:37:49.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22972]: debug 2024-09-14T03:37:49.198+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22972]: debug 2024-09-14T03:37:49.202+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22722]: audit 2024-09-14T03:37:47.613462+0000 mgr.a (mgr.14355) 13703 : audit [DBG] from='client.297768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22722]: audit 2024-09-14T03:37:48.437551+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22722]: audit 2024-09-14T03:37:48.439699+0000 mon.a (mon.0) 2642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22722]: audit 2024-09-14T03:37:48.450440+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:37:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:49 smithi007 bash[22722]: audit 2024-09-14T03:37:48.453415+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:49 smithi131 bash[24745]: audit 2024-09-14T03:37:47.613462+0000 mgr.a (mgr.14355) 13703 : audit [DBG] from='client.297768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:49 smithi131 bash[24745]: audit 2024-09-14T03:37:48.437551+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:37:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:49 smithi131 bash[24745]: audit 2024-09-14T03:37:48.439699+0000 mon.a (mon.0) 2642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:37:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:49 smithi131 bash[24745]: audit 2024-09-14T03:37:48.450440+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:37:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:49 smithi131 bash[24745]: audit 2024-09-14T03:37:48.453415+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:49 smithi171 bash[25040]: audit 2024-09-14T03:37:47.613462+0000 mgr.a (mgr.14355) 13703 : audit [DBG] from='client.297768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:49 smithi171 bash[25040]: audit 2024-09-14T03:37:48.437551+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:37:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:49 smithi171 bash[25040]: audit 2024-09-14T03:37:48.439699+0000 mon.a (mon.0) 2642 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:37:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:49 smithi171 bash[25040]: audit 2024-09-14T03:37:48.450440+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:37:49.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:49 smithi171 bash[25040]: audit 2024-09-14T03:37:48.453415+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:50 smithi007 bash[22722]: audit 2024-09-14T03:37:48.456193+0000 mgr.a (mgr.14355) 13704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:50 smithi007 bash[22722]: audit 2024-09-14T03:37:49.205345+0000 mgr.a (mgr.14355) 13705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:37:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:50 smithi007 bash[22722]: cephadm 2024-09-14T03:37:49.206717+0000 mgr.a (mgr.14355) 13706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:37:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:50 smithi007 bash[22722]: cluster 2024-09-14T03:37:49.291826+0000 mgr.a (mgr.14355) 13707 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:50 smithi131 bash[24745]: audit 2024-09-14T03:37:48.456193+0000 mgr.a (mgr.14355) 13704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:50.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:50 smithi131 bash[24745]: audit 2024-09-14T03:37:49.205345+0000 mgr.a (mgr.14355) 13705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:37:50.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:50 smithi131 bash[24745]: cephadm 2024-09-14T03:37:49.206717+0000 mgr.a (mgr.14355) 13706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:37:50.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:50 smithi131 bash[24745]: cluster 2024-09-14T03:37:49.291826+0000 mgr.a (mgr.14355) 13707 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:50 smithi171 bash[25040]: audit 2024-09-14T03:37:48.456193+0000 mgr.a (mgr.14355) 13704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:37:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:50 smithi171 bash[25040]: audit 2024-09-14T03:37:49.205345+0000 mgr.a (mgr.14355) 13705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:37:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:50 smithi171 bash[25040]: cephadm 2024-09-14T03:37:49.206717+0000 mgr.a (mgr.14355) 13706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:37:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:50 smithi171 bash[25040]: cluster 2024-09-14T03:37:49.291826+0000 mgr.a (mgr.14355) 13707 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:37:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:52 smithi007 bash[22722]: cluster 2024-09-14T03:37:51.294117+0000 mgr.a (mgr.14355) 13708 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:52 smithi131 bash[24745]: cluster 2024-09-14T03:37:51.294117+0000 mgr.a (mgr.14355) 13708 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:52 smithi171 bash[25040]: cluster 2024-09-14T03:37:51.294117+0000 mgr.a (mgr.14355) 13708 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:53.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:53.061 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:37:53.846 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:54 smithi007 bash[22722]: cluster 2024-09-14T03:37:53.294992+0000 mgr.a (mgr.14355) 13709 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:54 smithi007 bash[22722]: audit 2024-09-14T03:37:53.396715+0000 mgr.a (mgr.14355) 13710 : audit [DBG] from='client.297954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:54 smithi131 bash[24745]: cluster 2024-09-14T03:37:53.294992+0000 mgr.a (mgr.14355) 13709 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:54 smithi131 bash[24745]: audit 2024-09-14T03:37:53.396715+0000 mgr.a (mgr.14355) 13710 : audit [DBG] from='client.297954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:54 smithi171 bash[25040]: cluster 2024-09-14T03:37:53.294992+0000 mgr.a (mgr.14355) 13709 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:54 smithi171 bash[25040]: audit 2024-09-14T03:37:53.396715+0000 mgr.a (mgr.14355) 13710 : audit [DBG] from='client.297954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:37:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:56 smithi007 bash[22722]: cluster 2024-09-14T03:37:55.297299+0000 mgr.a (mgr.14355) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:56 smithi131 bash[24745]: cluster 2024-09-14T03:37:55.297299+0000 mgr.a (mgr.14355) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:56 smithi171 bash[25040]: cluster 2024-09-14T03:37:55.297299+0000 mgr.a (mgr.14355) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:37:58 smithi007 bash[22722]: cluster 2024-09-14T03:37:57.298080+0000 mgr.a (mgr.14355) 13712 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:37:58 smithi131 bash[24745]: cluster 2024-09-14T03:37:57.298080+0000 mgr.a (mgr.14355) 13712 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:37:58 smithi171 bash[25040]: cluster 2024-09-14T03:37:57.298080+0000 mgr.a (mgr.14355) 13712 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:37:58.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:37:58.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:37:58.848 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:37:59.626 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:37:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:37:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:37:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:37:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:00 smithi007 bash[22722]: audit 2024-09-14T03:37:59.182706+0000 mgr.a (mgr.14355) 13713 : audit [DBG] from='client.298032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:00 smithi007 bash[22722]: cluster 2024-09-14T03:37:59.298699+0000 mgr.a (mgr.14355) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:00 smithi131 bash[24745]: audit 2024-09-14T03:37:59.182706+0000 mgr.a (mgr.14355) 13713 : audit [DBG] from='client.298032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:00 smithi131 bash[24745]: cluster 2024-09-14T03:37:59.298699+0000 mgr.a (mgr.14355) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:00 smithi171 bash[25040]: audit 2024-09-14T03:37:59.182706+0000 mgr.a (mgr.14355) 13713 : audit [DBG] from='client.298032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:00 smithi171 bash[25040]: cluster 2024-09-14T03:37:59.298699+0000 mgr.a (mgr.14355) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:02 smithi007 bash[22722]: cluster 2024-09-14T03:38:01.301064+0000 mgr.a (mgr.14355) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:02 smithi131 bash[24745]: cluster 2024-09-14T03:38:01.301064+0000 mgr.a (mgr.14355) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:02 smithi171 bash[25040]: cluster 2024-09-14T03:38:01.301064+0000 mgr.a (mgr.14355) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:04.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:04.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:04.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:04 smithi007 bash[22722]: cluster 2024-09-14T03:38:03.301805+0000 mgr.a (mgr.14355) 13716 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:04 smithi131 bash[24745]: cluster 2024-09-14T03:38:03.301805+0000 mgr.a (mgr.14355) 13716 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:04 smithi171 bash[25040]: cluster 2024-09-14T03:38:03.301805+0000 mgr.a (mgr.14355) 13716 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:05.391 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:06.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:06 smithi007 bash[22722]: audit 2024-09-14T03:38:04.966017+0000 mgr.a (mgr.14355) 13717 : audit [DBG] from='client.298107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:06.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:06 smithi007 bash[22722]: cluster 2024-09-14T03:38:05.303230+0000 mgr.a (mgr.14355) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:38:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:06 smithi131 bash[24745]: audit 2024-09-14T03:38:04.966017+0000 mgr.a (mgr.14355) 13717 : audit [DBG] from='client.298107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:06 smithi131 bash[24745]: cluster 2024-09-14T03:38:05.303230+0000 mgr.a (mgr.14355) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:38:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:06 smithi171 bash[25040]: audit 2024-09-14T03:38:04.966017+0000 mgr.a (mgr.14355) 13717 : audit [DBG] from='client.298107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:06 smithi171 bash[25040]: cluster 2024-09-14T03:38:05.303230+0000 mgr.a (mgr.14355) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T03:38:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:08 smithi007 bash[22722]: cluster 2024-09-14T03:38:07.304027+0000 mgr.a (mgr.14355) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:08 smithi131 bash[24745]: cluster 2024-09-14T03:38:07.304027+0000 mgr.a (mgr.14355) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:08 smithi171 bash[25040]: cluster 2024-09-14T03:38:07.304027+0000 mgr.a (mgr.14355) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:10.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:10 smithi007 bash[22722]: cluster 2024-09-14T03:38:09.304805+0000 mgr.a (mgr.14355) 13720 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:10 smithi131 bash[24745]: cluster 2024-09-14T03:38:09.304805+0000 mgr.a (mgr.14355) 13720 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:10 smithi171 bash[25040]: cluster 2024-09-14T03:38:09.304805+0000 mgr.a (mgr.14355) 13720 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T03:38:11.170 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:11.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:11.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:11.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:11.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:12 smithi007 bash[22722]: audit 2024-09-14T03:38:10.732421+0000 mgr.a (mgr.14355) 13721 : audit [DBG] from='client.298182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:12 smithi007 bash[22722]: cluster 2024-09-14T03:38:11.307640+0000 mgr.a (mgr.14355) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:12 smithi131 bash[24745]: audit 2024-09-14T03:38:10.732421+0000 mgr.a (mgr.14355) 13721 : audit [DBG] from='client.298182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:12.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:12 smithi131 bash[24745]: cluster 2024-09-14T03:38:11.307640+0000 mgr.a (mgr.14355) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:12 smithi171 bash[25040]: audit 2024-09-14T03:38:10.732421+0000 mgr.a (mgr.14355) 13721 : audit [DBG] from='client.298182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:12 smithi171 bash[25040]: cluster 2024-09-14T03:38:11.307640+0000 mgr.a (mgr.14355) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:14 smithi007 bash[22722]: cluster 2024-09-14T03:38:13.308426+0000 mgr.a (mgr.14355) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:14 smithi131 bash[24745]: cluster 2024-09-14T03:38:13.308426+0000 mgr.a (mgr.14355) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:14 smithi171 bash[25040]: cluster 2024-09-14T03:38:13.308426+0000 mgr.a (mgr.14355) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:16.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:16.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:16 smithi007 bash[22722]: cluster 2024-09-14T03:38:15.310366+0000 mgr.a (mgr.14355) 13724 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:16 smithi131 bash[24745]: cluster 2024-09-14T03:38:15.310366+0000 mgr.a (mgr.14355) 13724 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:16 smithi171 bash[25040]: cluster 2024-09-14T03:38:15.310366+0000 mgr.a (mgr.14355) 13724 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:16.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:16.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:18 smithi007 bash[22722]: audit 2024-09-14T03:38:16.501576+0000 mgr.a (mgr.14355) 13725 : audit [DBG] from='client.298260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:18 smithi007 bash[22722]: cluster 2024-09-14T03:38:17.311286+0000 mgr.a (mgr.14355) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:18 smithi131 bash[24745]: audit 2024-09-14T03:38:16.501576+0000 mgr.a (mgr.14355) 13725 : audit [DBG] from='client.298260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:18 smithi131 bash[24745]: cluster 2024-09-14T03:38:17.311286+0000 mgr.a (mgr.14355) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:18 smithi171 bash[25040]: audit 2024-09-14T03:38:16.501576+0000 mgr.a (mgr.14355) 13725 : audit [DBG] from='client.298260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:18 smithi171 bash[25040]: cluster 2024-09-14T03:38:17.311286+0000 mgr.a (mgr.14355) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:20 smithi007 bash[22722]: cluster 2024-09-14T03:38:19.312082+0000 mgr.a (mgr.14355) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:20 smithi131 bash[24745]: cluster 2024-09-14T03:38:19.312082+0000 mgr.a (mgr.14355) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:20 smithi171 bash[25040]: cluster 2024-09-14T03:38:19.312082+0000 mgr.a (mgr.14355) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:38:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:21 smithi131 bash[24745]: cluster 2024-09-14T03:38:21.314290+0000 mgr.a (mgr.14355) 13728 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T03:38:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:21 smithi171 bash[25040]: cluster 2024-09-14T03:38:21.314290+0000 mgr.a (mgr.14355) 13728 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T03:38:21.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:21.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:21.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:21 smithi007 bash[22722]: cluster 2024-09-14T03:38:21.314290+0000 mgr.a (mgr.14355) 13728 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T03:38:22.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:22 smithi131 bash[24745]: audit 2024-09-14T03:38:22.256041+0000 mgr.a (mgr.14355) 13729 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:22 smithi171 bash[25040]: audit 2024-09-14T03:38:22.256041+0000 mgr.a (mgr.14355) 13729 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:22 smithi007 bash[22722]: audit 2024-09-14T03:38:22.256041+0000 mgr.a (mgr.14355) 13729 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:23 smithi131 bash[24745]: cluster 2024-09-14T03:38:23.315310+0000 mgr.a (mgr.14355) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:23 smithi171 bash[25040]: cluster 2024-09-14T03:38:23.315310+0000 mgr.a (mgr.14355) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:23 smithi007 bash[22722]: cluster 2024-09-14T03:38:23.315310+0000 mgr.a (mgr.14355) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:26 smithi007 bash[22722]: cluster 2024-09-14T03:38:25.317465+0000 mgr.a (mgr.14355) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:26 smithi131 bash[24745]: cluster 2024-09-14T03:38:25.317465+0000 mgr.a (mgr.14355) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:26 smithi171 bash[25040]: cluster 2024-09-14T03:38:25.317465+0000 mgr.a (mgr.14355) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:27.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:27.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:27.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:28.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:28.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:28.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:28.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:28.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:28 smithi007 bash[22722]: cluster 2024-09-14T03:38:27.318252+0000 mgr.a (mgr.14355) 13732 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:28 smithi131 bash[24745]: cluster 2024-09-14T03:38:27.318252+0000 mgr.a (mgr.14355) 13732 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:28 smithi171 bash[25040]: cluster 2024-09-14T03:38:27.318252+0000 mgr.a (mgr.14355) 13732 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:29 smithi007 bash[22722]: audit 2024-09-14T03:38:28.017187+0000 mgr.a (mgr.14355) 13733 : audit [DBG] from='client.298410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:29 smithi131 bash[24745]: audit 2024-09-14T03:38:28.017187+0000 mgr.a (mgr.14355) 13733 : audit [DBG] from='client.298410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:29 smithi171 bash[25040]: audit 2024-09-14T03:38:28.017187+0000 mgr.a (mgr.14355) 13733 : audit [DBG] from='client.298410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:30 smithi007 bash[22722]: cluster 2024-09-14T03:38:29.319197+0000 mgr.a (mgr.14355) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:30 smithi131 bash[24745]: cluster 2024-09-14T03:38:29.319197+0000 mgr.a (mgr.14355) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:30 smithi171 bash[25040]: cluster 2024-09-14T03:38:29.319197+0000 mgr.a (mgr.14355) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:32 smithi007 bash[22722]: cluster 2024-09-14T03:38:31.321468+0000 mgr.a (mgr.14355) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:32 smithi131 bash[24745]: cluster 2024-09-14T03:38:31.321468+0000 mgr.a (mgr.14355) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:32 smithi171 bash[25040]: cluster 2024-09-14T03:38:31.321468+0000 mgr.a (mgr.14355) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:33.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:33.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:33.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:34.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:34.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:34 smithi007 bash[22722]: cluster 2024-09-14T03:38:33.322270+0000 mgr.a (mgr.14355) 13736 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:34 smithi131 bash[24745]: cluster 2024-09-14T03:38:33.322270+0000 mgr.a (mgr.14355) 13736 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:34 smithi171 bash[25040]: cluster 2024-09-14T03:38:33.322270+0000 mgr.a (mgr.14355) 13736 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:35 smithi007 bash[22722]: audit 2024-09-14T03:38:33.769694+0000 mgr.a (mgr.14355) 13737 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:35 smithi131 bash[24745]: audit 2024-09-14T03:38:33.769694+0000 mgr.a (mgr.14355) 13737 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:35 smithi171 bash[25040]: audit 2024-09-14T03:38:33.769694+0000 mgr.a (mgr.14355) 13737 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:36 smithi007 bash[22722]: cluster 2024-09-14T03:38:35.324591+0000 mgr.a (mgr.14355) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:36 smithi131 bash[24745]: cluster 2024-09-14T03:38:35.324591+0000 mgr.a (mgr.14355) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:36 smithi171 bash[25040]: cluster 2024-09-14T03:38:35.324591+0000 mgr.a (mgr.14355) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:38 smithi007 bash[22722]: cluster 2024-09-14T03:38:37.325406+0000 mgr.a (mgr.14355) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:38 smithi131 bash[24745]: cluster 2024-09-14T03:38:37.325406+0000 mgr.a (mgr.14355) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:38 smithi171 bash[25040]: cluster 2024-09-14T03:38:37.325406+0000 mgr.a (mgr.14355) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:39.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:39.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:39.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:39.945 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:39.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:39.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:39.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:39.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:40 smithi007 bash[22722]: cluster 2024-09-14T03:38:39.325941+0000 mgr.a (mgr.14355) 13740 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:40 smithi131 bash[24745]: cluster 2024-09-14T03:38:39.325941+0000 mgr.a (mgr.14355) 13740 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:40 smithi171 bash[25040]: cluster 2024-09-14T03:38:39.325941+0000 mgr.a (mgr.14355) 13740 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:41 smithi007 bash[22722]: audit 2024-09-14T03:38:39.520730+0000 mgr.a (mgr.14355) 13741 : audit [DBG] from='client.298563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:41 smithi131 bash[24745]: audit 2024-09-14T03:38:39.520730+0000 mgr.a (mgr.14355) 13741 : audit [DBG] from='client.298563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:41 smithi171 bash[25040]: audit 2024-09-14T03:38:39.520730+0000 mgr.a (mgr.14355) 13741 : audit [DBG] from='client.298563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:42 smithi007 bash[22722]: cluster 2024-09-14T03:38:41.328269+0000 mgr.a (mgr.14355) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:42 smithi131 bash[24745]: cluster 2024-09-14T03:38:41.328269+0000 mgr.a (mgr.14355) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:42 smithi171 bash[25040]: cluster 2024-09-14T03:38:41.328269+0000 mgr.a (mgr.14355) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:38:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:44 smithi007 bash[22722]: cluster 2024-09-14T03:38:43.329033+0000 mgr.a (mgr.14355) 13743 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:44 smithi131 bash[24745]: cluster 2024-09-14T03:38:43.329033+0000 mgr.a (mgr.14355) 13743 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:44 smithi171 bash[25040]: cluster 2024-09-14T03:38:43.329033+0000 mgr.a (mgr.14355) 13743 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:44.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:45.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:45.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:46 smithi007 bash[22722]: audit 2024-09-14T03:38:45.290530+0000 mgr.a (mgr.14355) 13744 : audit [DBG] from='client.298635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:46 smithi007 bash[22722]: cluster 2024-09-14T03:38:45.331979+0000 mgr.a (mgr.14355) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:46 smithi131 bash[24745]: audit 2024-09-14T03:38:45.290530+0000 mgr.a (mgr.14355) 13744 : audit [DBG] from='client.298635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:46 smithi131 bash[24745]: cluster 2024-09-14T03:38:45.331979+0000 mgr.a (mgr.14355) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:46 smithi171 bash[25040]: audit 2024-09-14T03:38:45.290530+0000 mgr.a (mgr.14355) 13744 : audit [DBG] from='client.298635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:46 smithi171 bash[25040]: cluster 2024-09-14T03:38:45.331979+0000 mgr.a (mgr.14355) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:47 smithi131 bash[24745]: cluster 2024-09-14T03:38:47.332927+0000 mgr.a (mgr.14355) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:47 smithi171 bash[25040]: cluster 2024-09-14T03:38:47.332927+0000 mgr.a (mgr.14355) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:47 smithi007 bash[22722]: cluster 2024-09-14T03:38:47.332927+0000 mgr.a (mgr.14355) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:49 smithi007 bash[22722]: audit 2024-09-14T03:38:49.258089+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:38:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:49 smithi131 bash[24745]: audit 2024-09-14T03:38:49.258089+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:38:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:49 smithi171 bash[25040]: audit 2024-09-14T03:38:49.258089+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:38:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22722]: cluster 2024-09-14T03:38:49.333698+0000 mgr.a (mgr.14355) 13747 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:38:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22722]: audit 2024-09-14T03:38:50.094818+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:38:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22722]: audit 2024-09-14T03:38:50.096460+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:38:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22722]: audit 2024-09-14T03:38:50.104506+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:38:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22722]: audit 2024-09-14T03:38:50.109106+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:50.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:50.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:50.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:50 smithi131 bash[24745]: cluster 2024-09-14T03:38:49.333698+0000 mgr.a (mgr.14355) 13747 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:38:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:50 smithi131 bash[24745]: audit 2024-09-14T03:38:50.094818+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:38:50.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:50 smithi131 bash[24745]: audit 2024-09-14T03:38:50.096460+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:38:50.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:50 smithi131 bash[24745]: audit 2024-09-14T03:38:50.104506+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:38:50.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:50 smithi131 bash[24745]: audit 2024-09-14T03:38:50.109106+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:50 smithi171 bash[25040]: cluster 2024-09-14T03:38:49.333698+0000 mgr.a (mgr.14355) 13747 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:38:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:50 smithi171 bash[25040]: audit 2024-09-14T03:38:50.094818+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:38:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:50 smithi171 bash[25040]: audit 2024-09-14T03:38:50.096460+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:38:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:50 smithi171 bash[25040]: audit 2024-09-14T03:38:50.104506+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:38:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:50 smithi171 bash[25040]: audit 2024-09-14T03:38:50.109106+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:51.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22972]: debug 2024-09-14T03:38:50.837+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:38:51.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:38:50 smithi007 bash[22972]: debug 2024-09-14T03:38:50.841+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:38:51.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:51.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:51.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:51.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:51.472 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:51 smithi007 bash[22722]: audit 2024-09-14T03:38:50.111439+0000 mgr.a (mgr.14355) 13748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:51 smithi131 bash[24745]: audit 2024-09-14T03:38:50.111439+0000 mgr.a (mgr.14355) 13748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:51 smithi171 bash[25040]: audit 2024-09-14T03:38:50.111439+0000 mgr.a (mgr.14355) 13748 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:38:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:52 smithi007 bash[22722]: audit 2024-09-14T03:38:50.841992+0000 mgr.a (mgr.14355) 13749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:38:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:52 smithi007 bash[22722]: cephadm 2024-09-14T03:38:50.843140+0000 mgr.a (mgr.14355) 13750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:38:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:52 smithi007 bash[22722]: audit 2024-09-14T03:38:51.051603+0000 mgr.a (mgr.14355) 13751 : audit [DBG] from='client.298812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:52 smithi007 bash[22722]: cluster 2024-09-14T03:38:51.334997+0000 mgr.a (mgr.14355) 13752 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:52 smithi131 bash[24745]: audit 2024-09-14T03:38:50.841992+0000 mgr.a (mgr.14355) 13749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:38:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:52 smithi131 bash[24745]: cephadm 2024-09-14T03:38:50.843140+0000 mgr.a (mgr.14355) 13750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:38:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:52 smithi131 bash[24745]: audit 2024-09-14T03:38:51.051603+0000 mgr.a (mgr.14355) 13751 : audit [DBG] from='client.298812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:52 smithi131 bash[24745]: cluster 2024-09-14T03:38:51.334997+0000 mgr.a (mgr.14355) 13752 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:52 smithi171 bash[25040]: audit 2024-09-14T03:38:50.841992+0000 mgr.a (mgr.14355) 13749 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:38:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:52 smithi171 bash[25040]: cephadm 2024-09-14T03:38:50.843140+0000 mgr.a (mgr.14355) 13750 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:38:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:52 smithi171 bash[25040]: audit 2024-09-14T03:38:51.051603+0000 mgr.a (mgr.14355) 13751 : audit [DBG] from='client.298812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:52 smithi171 bash[25040]: cluster 2024-09-14T03:38:51.334997+0000 mgr.a (mgr.14355) 13752 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:38:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:54 smithi007 bash[22722]: cluster 2024-09-14T03:38:53.335841+0000 mgr.a (mgr.14355) 13753 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:54 smithi131 bash[24745]: cluster 2024-09-14T03:38:53.335841+0000 mgr.a (mgr.14355) 13753 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:54 smithi171 bash[25040]: cluster 2024-09-14T03:38:53.335841+0000 mgr.a (mgr.14355) 13753 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:38:56.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:38:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:38:56.474 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:38:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:56 smithi007 bash[22722]: cluster 2024-09-14T03:38:55.338004+0000 mgr.a (mgr.14355) 13754 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:56 smithi131 bash[24745]: cluster 2024-09-14T03:38:55.338004+0000 mgr.a (mgr.14355) 13754 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:56 smithi171 bash[25040]: cluster 2024-09-14T03:38:55.338004+0000 mgr.a (mgr.14355) 13754 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:57.247 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:38:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:38:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:38:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:38:57.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:58 smithi007 bash[22722]: audit 2024-09-14T03:38:56.810892+0000 mgr.a (mgr.14355) 13755 : audit [DBG] from='client.298887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:38:58 smithi007 bash[22722]: cluster 2024-09-14T03:38:57.338997+0000 mgr.a (mgr.14355) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:58 smithi131 bash[24745]: audit 2024-09-14T03:38:56.810892+0000 mgr.a (mgr.14355) 13755 : audit [DBG] from='client.298887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:38:58 smithi131 bash[24745]: cluster 2024-09-14T03:38:57.338997+0000 mgr.a (mgr.14355) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:38:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:58 smithi171 bash[25040]: audit 2024-09-14T03:38:56.810892+0000 mgr.a (mgr.14355) 13755 : audit [DBG] from='client.298887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:38:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:38:58 smithi171 bash[25040]: cluster 2024-09-14T03:38:57.338997+0000 mgr.a (mgr.14355) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:00 smithi007 bash[22722]: cluster 2024-09-14T03:38:59.339827+0000 mgr.a (mgr.14355) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:00 smithi131 bash[24745]: cluster 2024-09-14T03:38:59.339827+0000 mgr.a (mgr.14355) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:00 smithi171 bash[25040]: cluster 2024-09-14T03:38:59.339827+0000 mgr.a (mgr.14355) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:02.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:02 smithi007 bash[22722]: cluster 2024-09-14T03:39:01.342097+0000 mgr.a (mgr.14355) 13758 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:02 smithi131 bash[24745]: cluster 2024-09-14T03:39:01.342097+0000 mgr.a (mgr.14355) 13758 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:02 smithi171 bash[25040]: cluster 2024-09-14T03:39:01.342097+0000 mgr.a (mgr.14355) 13758 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:03.024 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:04 smithi007 bash[22722]: audit 2024-09-14T03:39:02.585592+0000 mgr.a (mgr.14355) 13759 : audit [DBG] from='client.298965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:04 smithi007 bash[22722]: cluster 2024-09-14T03:39:03.343080+0000 mgr.a (mgr.14355) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:04 smithi131 bash[24745]: audit 2024-09-14T03:39:02.585592+0000 mgr.a (mgr.14355) 13759 : audit [DBG] from='client.298965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:04 smithi131 bash[24745]: cluster 2024-09-14T03:39:03.343080+0000 mgr.a (mgr.14355) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:04 smithi171 bash[25040]: audit 2024-09-14T03:39:02.585592+0000 mgr.a (mgr.14355) 13759 : audit [DBG] from='client.298965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:04 smithi171 bash[25040]: cluster 2024-09-14T03:39:03.343080+0000 mgr.a (mgr.14355) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:06 smithi007 bash[22722]: cluster 2024-09-14T03:39:05.345269+0000 mgr.a (mgr.14355) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:06 smithi131 bash[24745]: cluster 2024-09-14T03:39:05.345269+0000 mgr.a (mgr.14355) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:06 smithi171 bash[25040]: cluster 2024-09-14T03:39:05.345269+0000 mgr.a (mgr.14355) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:08.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:08.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:08.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:08 smithi007 bash[22722]: cluster 2024-09-14T03:39:07.346001+0000 mgr.a (mgr.14355) 13762 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:08 smithi131 bash[24745]: cluster 2024-09-14T03:39:07.346001+0000 mgr.a (mgr.14355) 13762 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:08.798 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:08.798 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:08 smithi171 bash[25040]: cluster 2024-09-14T03:39:07.346001+0000 mgr.a (mgr.14355) 13762 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:08.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:08.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:08.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:08.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:09 smithi007 bash[22722]: audit 2024-09-14T03:39:08.360321+0000 mgr.a (mgr.14355) 13763 : audit [DBG] from='client.299040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:09 smithi131 bash[24745]: audit 2024-09-14T03:39:08.360321+0000 mgr.a (mgr.14355) 13763 : audit [DBG] from='client.299040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:09 smithi171 bash[25040]: audit 2024-09-14T03:39:08.360321+0000 mgr.a (mgr.14355) 13763 : audit [DBG] from='client.299040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:10 smithi007 bash[22722]: cluster 2024-09-14T03:39:09.346981+0000 mgr.a (mgr.14355) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:10 smithi131 bash[24745]: cluster 2024-09-14T03:39:09.346981+0000 mgr.a (mgr.14355) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:10 smithi171 bash[25040]: cluster 2024-09-14T03:39:09.346981+0000 mgr.a (mgr.14355) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:12 smithi007 bash[22722]: cluster 2024-09-14T03:39:11.349194+0000 mgr.a (mgr.14355) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:12 smithi131 bash[24745]: cluster 2024-09-14T03:39:11.349194+0000 mgr.a (mgr.14355) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:12 smithi171 bash[25040]: cluster 2024-09-14T03:39:11.349194+0000 mgr.a (mgr.14355) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:13.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:13.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:13.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:14.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:14.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:14.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:14.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:14.568 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:14 smithi007 bash[22722]: cluster 2024-09-14T03:39:13.349930+0000 mgr.a (mgr.14355) 13766 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:14.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:14 smithi131 bash[24745]: cluster 2024-09-14T03:39:13.349930+0000 mgr.a (mgr.14355) 13766 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:14 smithi171 bash[25040]: cluster 2024-09-14T03:39:13.349930+0000 mgr.a (mgr.14355) 13766 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:15 smithi007 bash[22722]: audit 2024-09-14T03:39:14.135661+0000 mgr.a (mgr.14355) 13767 : audit [DBG] from='client.299115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:15 smithi131 bash[24745]: audit 2024-09-14T03:39:14.135661+0000 mgr.a (mgr.14355) 13767 : audit [DBG] from='client.299115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:15 smithi171 bash[25040]: audit 2024-09-14T03:39:14.135661+0000 mgr.a (mgr.14355) 13767 : audit [DBG] from='client.299115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:16 smithi007 bash[22722]: cluster 2024-09-14T03:39:15.352223+0000 mgr.a (mgr.14355) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:16 smithi131 bash[24745]: cluster 2024-09-14T03:39:15.352223+0000 mgr.a (mgr.14355) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:16 smithi171 bash[25040]: cluster 2024-09-14T03:39:15.352223+0000 mgr.a (mgr.14355) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:17 smithi131 bash[24745]: cluster 2024-09-14T03:39:17.353002+0000 mgr.a (mgr.14355) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:17 smithi171 bash[25040]: cluster 2024-09-14T03:39:17.353002+0000 mgr.a (mgr.14355) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:17 smithi007 bash[22722]: cluster 2024-09-14T03:39:17.353002+0000 mgr.a (mgr.14355) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:19.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:20.341 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:20.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:20 smithi007 bash[22722]: cluster 2024-09-14T03:39:19.353739+0000 mgr.a (mgr.14355) 13770 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:20 smithi131 bash[24745]: cluster 2024-09-14T03:39:19.353739+0000 mgr.a (mgr.14355) 13770 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:20 smithi171 bash[25040]: cluster 2024-09-14T03:39:19.353739+0000 mgr.a (mgr.14355) 13770 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:21 smithi007 bash[22722]: audit 2024-09-14T03:39:19.904434+0000 mgr.a (mgr.14355) 13771 : audit [DBG] from='client.299193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:21 smithi131 bash[24745]: audit 2024-09-14T03:39:19.904434+0000 mgr.a (mgr.14355) 13771 : audit [DBG] from='client.299193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:21 smithi171 bash[25040]: audit 2024-09-14T03:39:19.904434+0000 mgr.a (mgr.14355) 13771 : audit [DBG] from='client.299193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:22 smithi007 bash[22722]: cluster 2024-09-14T03:39:21.356526+0000 mgr.a (mgr.14355) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:39:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:22 smithi131 bash[24745]: cluster 2024-09-14T03:39:21.356526+0000 mgr.a (mgr.14355) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:39:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:22 smithi171 bash[25040]: cluster 2024-09-14T03:39:21.356526+0000 mgr.a (mgr.14355) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:39:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:24 smithi007 bash[22722]: cluster 2024-09-14T03:39:23.357276+0000 mgr.a (mgr.14355) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:39:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:24 smithi131 bash[24745]: cluster 2024-09-14T03:39:23.357276+0000 mgr.a (mgr.14355) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:39:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:24 smithi171 bash[25040]: cluster 2024-09-14T03:39:23.357276+0000 mgr.a (mgr.14355) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:39:25.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:25.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:25.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:26.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:26.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:26.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:26.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:26.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:26 smithi007 bash[22722]: cluster 2024-09-14T03:39:25.359290+0000 mgr.a (mgr.14355) 13774 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:26 smithi131 bash[24745]: cluster 2024-09-14T03:39:25.359290+0000 mgr.a (mgr.14355) 13774 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:26 smithi171 bash[25040]: cluster 2024-09-14T03:39:25.359290+0000 mgr.a (mgr.14355) 13774 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:27 smithi007 bash[22722]: audit 2024-09-14T03:39:25.678427+0000 mgr.a (mgr.14355) 13775 : audit [DBG] from='client.299268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:27 smithi131 bash[24745]: audit 2024-09-14T03:39:25.678427+0000 mgr.a (mgr.14355) 13775 : audit [DBG] from='client.299268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:27 smithi171 bash[25040]: audit 2024-09-14T03:39:25.678427+0000 mgr.a (mgr.14355) 13775 : audit [DBG] from='client.299268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:28 smithi007 bash[22722]: cluster 2024-09-14T03:39:27.360170+0000 mgr.a (mgr.14355) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:39:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:28 smithi131 bash[24745]: cluster 2024-09-14T03:39:27.360170+0000 mgr.a (mgr.14355) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:39:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:28 smithi171 bash[25040]: cluster 2024-09-14T03:39:27.360170+0000 mgr.a (mgr.14355) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:39:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:30 smithi007 bash[22722]: cluster 2024-09-14T03:39:29.360982+0000 mgr.a (mgr.14355) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:39:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:30 smithi131 bash[24745]: cluster 2024-09-14T03:39:29.360982+0000 mgr.a (mgr.14355) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:39:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:30 smithi171 bash[25040]: cluster 2024-09-14T03:39:29.360982+0000 mgr.a (mgr.14355) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:39:31.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:31.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:31.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:31.909 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:31.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:31.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:32 smithi007 bash[22722]: cluster 2024-09-14T03:39:31.363218+0000 mgr.a (mgr.14355) 13778 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:32 smithi131 bash[24745]: cluster 2024-09-14T03:39:31.363218+0000 mgr.a (mgr.14355) 13778 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:32 smithi171 bash[25040]: cluster 2024-09-14T03:39:31.363218+0000 mgr.a (mgr.14355) 13778 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:33 smithi131 bash[24745]: audit 2024-09-14T03:39:31.465014+0000 mgr.a (mgr.14355) 13779 : audit [DBG] from='client.299346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:33 smithi171 bash[25040]: audit 2024-09-14T03:39:31.465014+0000 mgr.a (mgr.14355) 13779 : audit [DBG] from='client.299346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:33 smithi007 bash[22722]: audit 2024-09-14T03:39:31.465014+0000 mgr.a (mgr.14355) 13779 : audit [DBG] from='client.299346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:34 smithi131 bash[24745]: cluster 2024-09-14T03:39:33.364126+0000 mgr.a (mgr.14355) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:39:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:34 smithi171 bash[25040]: cluster 2024-09-14T03:39:33.364126+0000 mgr.a (mgr.14355) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:39:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:34 smithi007 bash[22722]: cluster 2024-09-14T03:39:33.364126+0000 mgr.a (mgr.14355) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:39:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:35 smithi131 bash[24745]: cluster 2024-09-14T03:39:35.366271+0000 mgr.a (mgr.14355) 13781 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:39:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:35 smithi171 bash[25040]: cluster 2024-09-14T03:39:35.366271+0000 mgr.a (mgr.14355) 13781 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:39:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:35 smithi007 bash[22722]: cluster 2024-09-14T03:39:35.366271+0000 mgr.a (mgr.14355) 13781 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:39:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:36.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:37.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:37.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:38 smithi007 bash[22722]: audit 2024-09-14T03:39:37.248673+0000 mgr.a (mgr.14355) 13782 : audit [DBG] from='client.299424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:38 smithi007 bash[22722]: cluster 2024-09-14T03:39:37.366836+0000 mgr.a (mgr.14355) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:38 smithi131 bash[24745]: audit 2024-09-14T03:39:37.248673+0000 mgr.a (mgr.14355) 13782 : audit [DBG] from='client.299424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:38 smithi131 bash[24745]: cluster 2024-09-14T03:39:37.366836+0000 mgr.a (mgr.14355) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:38 smithi171 bash[25040]: audit 2024-09-14T03:39:37.248673+0000 mgr.a (mgr.14355) 13782 : audit [DBG] from='client.299424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:38 smithi171 bash[25040]: cluster 2024-09-14T03:39:37.366836+0000 mgr.a (mgr.14355) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:40 smithi007 bash[22722]: cluster 2024-09-14T03:39:39.367702+0000 mgr.a (mgr.14355) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:40 smithi131 bash[24745]: cluster 2024-09-14T03:39:39.367702+0000 mgr.a (mgr.14355) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:40 smithi171 bash[25040]: cluster 2024-09-14T03:39:39.367702+0000 mgr.a (mgr.14355) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:42.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:42.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:42 smithi007 bash[22722]: cluster 2024-09-14T03:39:41.370040+0000 mgr.a (mgr.14355) 13785 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:42.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:42 smithi131 bash[24745]: cluster 2024-09-14T03:39:41.370040+0000 mgr.a (mgr.14355) 13785 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:42 smithi171 bash[25040]: cluster 2024-09-14T03:39:41.370040+0000 mgr.a (mgr.14355) 13785 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:43.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:43.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:44 smithi007 bash[22722]: audit 2024-09-14T03:39:43.031327+0000 mgr.a (mgr.14355) 13786 : audit [DBG] from='client.299502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:44 smithi007 bash[22722]: cluster 2024-09-14T03:39:43.378498+0000 mgr.a (mgr.14355) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:44 smithi131 bash[24745]: audit 2024-09-14T03:39:43.031327+0000 mgr.a (mgr.14355) 13786 : audit [DBG] from='client.299502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:44 smithi131 bash[24745]: cluster 2024-09-14T03:39:43.378498+0000 mgr.a (mgr.14355) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:44 smithi171 bash[25040]: audit 2024-09-14T03:39:43.031327+0000 mgr.a (mgr.14355) 13786 : audit [DBG] from='client.299502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:44 smithi171 bash[25040]: cluster 2024-09-14T03:39:43.378498+0000 mgr.a (mgr.14355) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:46 smithi007 bash[22722]: cluster 2024-09-14T03:39:45.380606+0000 mgr.a (mgr.14355) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:46 smithi131 bash[24745]: cluster 2024-09-14T03:39:45.380606+0000 mgr.a (mgr.14355) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:46 smithi171 bash[25040]: cluster 2024-09-14T03:39:45.380606+0000 mgr.a (mgr.14355) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:48.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:48 smithi007 bash[22722]: cluster 2024-09-14T03:39:47.381358+0000 mgr.a (mgr.14355) 13789 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:48 smithi131 bash[24745]: cluster 2024-09-14T03:39:47.381358+0000 mgr.a (mgr.14355) 13789 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:48 smithi171 bash[25040]: cluster 2024-09-14T03:39:47.381358+0000 mgr.a (mgr.14355) 13789 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:49.255 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:49.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:49.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:49.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:49.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:50 smithi007 bash[22722]: audit 2024-09-14T03:39:48.817058+0000 mgr.a (mgr.14355) 13790 : audit [DBG] from='client.299580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:50 smithi007 bash[22722]: cluster 2024-09-14T03:39:49.382325+0000 mgr.a (mgr.14355) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:50 smithi131 bash[24745]: audit 2024-09-14T03:39:48.817058+0000 mgr.a (mgr.14355) 13790 : audit [DBG] from='client.299580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:50 smithi131 bash[24745]: cluster 2024-09-14T03:39:49.382325+0000 mgr.a (mgr.14355) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:50 smithi171 bash[25040]: audit 2024-09-14T03:39:48.817058+0000 mgr.a (mgr.14355) 13790 : audit [DBG] from='client.299580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:50 smithi171 bash[25040]: cluster 2024-09-14T03:39:49.382325+0000 mgr.a (mgr.14355) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:51 smithi007 bash[22722]: audit 2024-09-14T03:39:50.891097+0000 mon.a (mon.0) 2650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:39:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:51 smithi131 bash[24745]: audit 2024-09-14T03:39:50.891097+0000 mon.a (mon.0) 2650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:39:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:51 smithi171 bash[25040]: audit 2024-09-14T03:39:50.891097+0000 mon.a (mon.0) 2650 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:39:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:52 smithi131 bash[24745]: cluster 2024-09-14T03:39:51.384567+0000 mgr.a (mgr.14355) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:52 smithi131 bash[24745]: audit 2024-09-14T03:39:51.725533+0000 mon.a (mon.0) 2651 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:39:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:52 smithi131 bash[24745]: audit 2024-09-14T03:39:51.727002+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:39:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:52 smithi131 bash[24745]: audit 2024-09-14T03:39:51.736830+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:39:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:52 smithi131 bash[24745]: audit 2024-09-14T03:39:51.740038+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:52 smithi171 bash[25040]: cluster 2024-09-14T03:39:51.384567+0000 mgr.a (mgr.14355) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:52 smithi171 bash[25040]: audit 2024-09-14T03:39:51.725533+0000 mon.a (mon.0) 2651 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:39:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:52 smithi171 bash[25040]: audit 2024-09-14T03:39:51.727002+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:39:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:52 smithi171 bash[25040]: audit 2024-09-14T03:39:51.736830+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:39:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:52 smithi171 bash[25040]: audit 2024-09-14T03:39:51.740038+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:52.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22972]: debug 2024-09-14T03:39:52.480+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:39:52.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22972]: debug 2024-09-14T03:39:52.480+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:39:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22722]: cluster 2024-09-14T03:39:51.384567+0000 mgr.a (mgr.14355) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:39:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22722]: audit 2024-09-14T03:39:51.725533+0000 mon.a (mon.0) 2651 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:39:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22722]: audit 2024-09-14T03:39:51.727002+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:39:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22722]: audit 2024-09-14T03:39:51.736830+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:39:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:52 smithi007 bash[22722]: audit 2024-09-14T03:39:51.740038+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:53 smithi131 bash[24745]: audit 2024-09-14T03:39:51.741251+0000 mgr.a (mgr.14355) 13793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:53 smithi131 bash[24745]: audit 2024-09-14T03:39:52.484826+0000 mgr.a (mgr.14355) 13794 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:39:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:53 smithi131 bash[24745]: cephadm 2024-09-14T03:39:52.486023+0000 mgr.a (mgr.14355) 13795 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:39:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:53 smithi131 bash[24745]: cluster 2024-09-14T03:39:53.385472+0000 mgr.a (mgr.14355) 13796 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:53 smithi171 bash[25040]: audit 2024-09-14T03:39:51.741251+0000 mgr.a (mgr.14355) 13793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:53 smithi171 bash[25040]: audit 2024-09-14T03:39:52.484826+0000 mgr.a (mgr.14355) 13794 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:39:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:53 smithi171 bash[25040]: cephadm 2024-09-14T03:39:52.486023+0000 mgr.a (mgr.14355) 13795 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:39:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:53 smithi171 bash[25040]: cluster 2024-09-14T03:39:53.385472+0000 mgr.a (mgr.14355) 13796 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:53 smithi007 bash[22722]: audit 2024-09-14T03:39:51.741251+0000 mgr.a (mgr.14355) 13793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:39:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:53 smithi007 bash[22722]: audit 2024-09-14T03:39:52.484826+0000 mgr.a (mgr.14355) 13794 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:39:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:53 smithi007 bash[22722]: cephadm 2024-09-14T03:39:52.486023+0000 mgr.a (mgr.14355) 13795 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:39:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:53 smithi007 bash[22722]: cluster 2024-09-14T03:39:53.385472+0000 mgr.a (mgr.14355) 13796 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:39:54.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:39:54.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:39:54.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:39:55.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:39:55.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:39:55.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:39:55.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:39:55.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:39:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:56 smithi007 bash[22722]: audit 2024-09-14T03:39:54.606036+0000 mgr.a (mgr.14355) 13797 : audit [DBG] from='client.299766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:56 smithi007 bash[22722]: cluster 2024-09-14T03:39:55.387741+0000 mgr.a (mgr.14355) 13798 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:56 smithi131 bash[24745]: audit 2024-09-14T03:39:54.606036+0000 mgr.a (mgr.14355) 13797 : audit [DBG] from='client.299766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:56 smithi131 bash[24745]: cluster 2024-09-14T03:39:55.387741+0000 mgr.a (mgr.14355) 13798 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:56 smithi171 bash[25040]: audit 2024-09-14T03:39:54.606036+0000 mgr.a (mgr.14355) 13797 : audit [DBG] from='client.299766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:39:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:56 smithi171 bash[25040]: cluster 2024-09-14T03:39:55.387741+0000 mgr.a (mgr.14355) 13798 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:39:58 smithi007 bash[22722]: cluster 2024-09-14T03:39:57.388529+0000 mgr.a (mgr.14355) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:39:58 smithi131 bash[24745]: cluster 2024-09-14T03:39:57.388529+0000 mgr.a (mgr.14355) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:39:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:39:58 smithi171 bash[25040]: cluster 2024-09-14T03:39:57.388529+0000 mgr.a (mgr.14355) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:00.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:00 smithi007 bash[22722]: cluster 2024-09-14T03:39:59.389265+0000 mgr.a (mgr.14355) 13800 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:00 smithi007 bash[22722]: cluster 2024-09-14T03:40:00.000150+0000 mon.a (mon.0) 2655 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:40:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:00 smithi131 bash[24745]: cluster 2024-09-14T03:39:59.389265+0000 mgr.a (mgr.14355) 13800 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:00 smithi131 bash[24745]: cluster 2024-09-14T03:40:00.000150+0000 mon.a (mon.0) 2655 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:40:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:00 smithi171 bash[25040]: cluster 2024-09-14T03:39:59.389265+0000 mgr.a (mgr.14355) 13800 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:00 smithi171 bash[25040]: cluster 2024-09-14T03:40:00.000150+0000 mon.a (mon.0) 2655 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:40:00.803 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:00.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:01 smithi131 bash[24745]: audit 2024-09-14T03:40:00.367184+0000 mgr.a (mgr.14355) 13801 : audit [DBG] from='client.299844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:01 smithi171 bash[25040]: audit 2024-09-14T03:40:00.367184+0000 mgr.a (mgr.14355) 13801 : audit [DBG] from='client.299844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:01 smithi007 bash[22722]: audit 2024-09-14T03:40:00.367184+0000 mgr.a (mgr.14355) 13801 : audit [DBG] from='client.299844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:02 smithi131 bash[24745]: cluster 2024-09-14T03:40:01.392010+0000 mgr.a (mgr.14355) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:02 smithi171 bash[25040]: cluster 2024-09-14T03:40:01.392010+0000 mgr.a (mgr.14355) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:02 smithi007 bash[22722]: cluster 2024-09-14T03:40:01.392010+0000 mgr.a (mgr.14355) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:03 smithi131 bash[24745]: cluster 2024-09-14T03:40:03.392784+0000 mgr.a (mgr.14355) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:40:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:03 smithi171 bash[25040]: cluster 2024-09-14T03:40:03.392784+0000 mgr.a (mgr.14355) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:40:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:03 smithi007 bash[22722]: cluster 2024-09-14T03:40:03.392784+0000 mgr.a (mgr.14355) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:40:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:06.560 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:06.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:06 smithi007 bash[22722]: cluster 2024-09-14T03:40:05.394710+0000 mgr.a (mgr.14355) 13804 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:06 smithi131 bash[24745]: cluster 2024-09-14T03:40:05.394710+0000 mgr.a (mgr.14355) 13804 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:06 smithi171 bash[25040]: cluster 2024-09-14T03:40:05.394710+0000 mgr.a (mgr.14355) 13804 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:07 smithi007 bash[22722]: audit 2024-09-14T03:40:06.135943+0000 mgr.a (mgr.14355) 13805 : audit [DBG] from='client.299916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:07 smithi131 bash[24745]: audit 2024-09-14T03:40:06.135943+0000 mgr.a (mgr.14355) 13805 : audit [DBG] from='client.299916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:07 smithi171 bash[25040]: audit 2024-09-14T03:40:06.135943+0000 mgr.a (mgr.14355) 13805 : audit [DBG] from='client.299916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:08 smithi131 bash[24745]: cluster 2024-09-14T03:40:07.395579+0000 mgr.a (mgr.14355) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:08 smithi171 bash[25040]: cluster 2024-09-14T03:40:07.395579+0000 mgr.a (mgr.14355) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:08 smithi007 bash[22722]: cluster 2024-09-14T03:40:07.395579+0000 mgr.a (mgr.14355) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:10 smithi131 bash[24745]: cluster 2024-09-14T03:40:09.396313+0000 mgr.a (mgr.14355) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:40:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:10 smithi171 bash[25040]: cluster 2024-09-14T03:40:09.396313+0000 mgr.a (mgr.14355) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:40:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:10 smithi007 bash[22722]: cluster 2024-09-14T03:40:09.396313+0000 mgr.a (mgr.14355) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:40:11.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:11.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:11.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:11 smithi131 bash[24745]: cluster 2024-09-14T03:40:11.398553+0000 mgr.a (mgr.14355) 13808 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:11 smithi171 bash[25040]: cluster 2024-09-14T03:40:11.398553+0000 mgr.a (mgr.14355) 13808 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:11 smithi007 bash[22722]: cluster 2024-09-14T03:40:11.398553+0000 mgr.a (mgr.14355) 13808 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:12.320 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:12.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:12.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:12.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:12.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:12 smithi131 bash[24745]: audit 2024-09-14T03:40:11.889430+0000 mgr.a (mgr.14355) 13809 : audit [DBG] from='client.299991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:12 smithi171 bash[25040]: audit 2024-09-14T03:40:11.889430+0000 mgr.a (mgr.14355) 13809 : audit [DBG] from='client.299991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:12 smithi007 bash[22722]: audit 2024-09-14T03:40:11.889430+0000 mgr.a (mgr.14355) 13809 : audit [DBG] from='client.299991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:13 smithi131 bash[24745]: cluster 2024-09-14T03:40:13.399414+0000 mgr.a (mgr.14355) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:13 smithi171 bash[25040]: cluster 2024-09-14T03:40:13.399414+0000 mgr.a (mgr.14355) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:13 smithi007 bash[22722]: cluster 2024-09-14T03:40:13.399414+0000 mgr.a (mgr.14355) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:16 smithi131 bash[24745]: cluster 2024-09-14T03:40:15.401552+0000 mgr.a (mgr.14355) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:16 smithi171 bash[25040]: cluster 2024-09-14T03:40:15.401552+0000 mgr.a (mgr.14355) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:16 smithi007 bash[22722]: cluster 2024-09-14T03:40:15.401552+0000 mgr.a (mgr.14355) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:18.100 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:18 smithi131 bash[24745]: cluster 2024-09-14T03:40:17.402313+0000 mgr.a (mgr.14355) 13812 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:18 smithi171 bash[25040]: cluster 2024-09-14T03:40:17.402313+0000 mgr.a (mgr.14355) 13812 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:18 smithi007 bash[22722]: cluster 2024-09-14T03:40:17.402313+0000 mgr.a (mgr.14355) 13812 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:19 smithi131 bash[24745]: audit 2024-09-14T03:40:17.661294+0000 mgr.a (mgr.14355) 13813 : audit [DBG] from='client.300066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:19 smithi171 bash[25040]: audit 2024-09-14T03:40:17.661294+0000 mgr.a (mgr.14355) 13813 : audit [DBG] from='client.300066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:19 smithi007 bash[22722]: audit 2024-09-14T03:40:17.661294+0000 mgr.a (mgr.14355) 13813 : audit [DBG] from='client.300066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:20 smithi131 bash[24745]: cluster 2024-09-14T03:40:19.403146+0000 mgr.a (mgr.14355) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:20.799 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:20 smithi171 bash[25040]: cluster 2024-09-14T03:40:19.403146+0000 mgr.a (mgr.14355) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:20 smithi007 bash[22722]: cluster 2024-09-14T03:40:19.403146+0000 mgr.a (mgr.14355) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:21 smithi131 bash[24745]: cluster 2024-09-14T03:40:21.405382+0000 mgr.a (mgr.14355) 13815 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:21 smithi171 bash[25040]: cluster 2024-09-14T03:40:21.405382+0000 mgr.a (mgr.14355) 13815 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:21 smithi007 bash[22722]: cluster 2024-09-14T03:40:21.405382+0000 mgr.a (mgr.14355) 13815 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:23.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:23.103 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:23.877 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:24 smithi131 bash[24745]: cluster 2024-09-14T03:40:23.406114+0000 mgr.a (mgr.14355) 13816 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:24 smithi131 bash[24745]: audit 2024-09-14T03:40:23.437770+0000 mgr.a (mgr.14355) 13817 : audit [DBG] from='client.300144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:24 smithi171 bash[25040]: cluster 2024-09-14T03:40:23.406114+0000 mgr.a (mgr.14355) 13816 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:24 smithi171 bash[25040]: audit 2024-09-14T03:40:23.437770+0000 mgr.a (mgr.14355) 13817 : audit [DBG] from='client.300144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:24 smithi007 bash[22722]: cluster 2024-09-14T03:40:23.406114+0000 mgr.a (mgr.14355) 13816 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:24 smithi007 bash[22722]: audit 2024-09-14T03:40:23.437770+0000 mgr.a (mgr.14355) 13817 : audit [DBG] from='client.300144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:26 smithi131 bash[24745]: cluster 2024-09-14T03:40:25.408391+0000 mgr.a (mgr.14355) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:26 smithi171 bash[25040]: cluster 2024-09-14T03:40:25.408391+0000 mgr.a (mgr.14355) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:26 smithi007 bash[22722]: cluster 2024-09-14T03:40:25.408391+0000 mgr.a (mgr.14355) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:27 smithi131 bash[24745]: cluster 2024-09-14T03:40:27.409163+0000 mgr.a (mgr.14355) 13819 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:27 smithi171 bash[25040]: cluster 2024-09-14T03:40:27.409163+0000 mgr.a (mgr.14355) 13819 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:27.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:27 smithi007 bash[22722]: cluster 2024-09-14T03:40:27.409163+0000 mgr.a (mgr.14355) 13819 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:28.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:28.879 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:28.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:29.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:29.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:29.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:29.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:29.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:30 smithi131 bash[24745]: audit 2024-09-14T03:40:29.214195+0000 mgr.a (mgr.14355) 13820 : audit [DBG] from='client.300222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:30 smithi131 bash[24745]: cluster 2024-09-14T03:40:29.409733+0000 mgr.a (mgr.14355) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:30 smithi171 bash[25040]: audit 2024-09-14T03:40:29.214195+0000 mgr.a (mgr.14355) 13820 : audit [DBG] from='client.300222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:30 smithi171 bash[25040]: cluster 2024-09-14T03:40:29.409733+0000 mgr.a (mgr.14355) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:30 smithi007 bash[22722]: audit 2024-09-14T03:40:29.214195+0000 mgr.a (mgr.14355) 13820 : audit [DBG] from='client.300222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:30 smithi007 bash[22722]: cluster 2024-09-14T03:40:29.409733+0000 mgr.a (mgr.14355) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:32 smithi131 bash[24745]: cluster 2024-09-14T03:40:31.412063+0000 mgr.a (mgr.14355) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:32 smithi171 bash[25040]: cluster 2024-09-14T03:40:31.412063+0000 mgr.a (mgr.14355) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:32 smithi007 bash[22722]: cluster 2024-09-14T03:40:31.412063+0000 mgr.a (mgr.14355) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:40:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:33 smithi131 bash[24745]: cluster 2024-09-14T03:40:33.412827+0000 mgr.a (mgr.14355) 13823 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:33 smithi171 bash[25040]: cluster 2024-09-14T03:40:33.412827+0000 mgr.a (mgr.14355) 13823 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:33 smithi007 bash[22722]: cluster 2024-09-14T03:40:33.412827+0000 mgr.a (mgr.14355) 13823 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:35.369 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:36.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:36 smithi131 bash[24745]: audit 2024-09-14T03:40:34.961127+0000 mgr.a (mgr.14355) 13824 : audit [DBG] from='client.300297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:36.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:36 smithi131 bash[24745]: cluster 2024-09-14T03:40:35.414270+0000 mgr.a (mgr.14355) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:40:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:36 smithi171 bash[25040]: audit 2024-09-14T03:40:34.961127+0000 mgr.a (mgr.14355) 13824 : audit [DBG] from='client.300297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:36 smithi171 bash[25040]: cluster 2024-09-14T03:40:35.414270+0000 mgr.a (mgr.14355) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:40:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:36 smithi007 bash[22722]: audit 2024-09-14T03:40:34.961127+0000 mgr.a (mgr.14355) 13824 : audit [DBG] from='client.300297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:36 smithi007 bash[22722]: cluster 2024-09-14T03:40:35.414270+0000 mgr.a (mgr.14355) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:40:37.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:37 smithi131 bash[24745]: cluster 2024-09-14T03:40:37.414998+0000 mgr.a (mgr.14355) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:37 smithi171 bash[25040]: cluster 2024-09-14T03:40:37.414998+0000 mgr.a (mgr.14355) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:37 smithi007 bash[22722]: cluster 2024-09-14T03:40:37.414998+0000 mgr.a (mgr.14355) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:40.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:40.371 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:40.372 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:40 smithi131 bash[24745]: cluster 2024-09-14T03:40:39.415783+0000 mgr.a (mgr.14355) 13827 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:40 smithi171 bash[25040]: cluster 2024-09-14T03:40:39.415783+0000 mgr.a (mgr.14355) 13827 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:40 smithi007 bash[22722]: cluster 2024-09-14T03:40:39.415783+0000 mgr.a (mgr.14355) 13827 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:40:41.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:41.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:41 smithi131 bash[24745]: audit 2024-09-14T03:40:40.710255+0000 mgr.a (mgr.14355) 13828 : audit [DBG] from='client.300375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:41 smithi131 bash[24745]: cluster 2024-09-14T03:40:41.418843+0000 mgr.a (mgr.14355) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:41 smithi171 bash[25040]: audit 2024-09-14T03:40:40.710255+0000 mgr.a (mgr.14355) 13828 : audit [DBG] from='client.300375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:41 smithi171 bash[25040]: cluster 2024-09-14T03:40:41.418843+0000 mgr.a (mgr.14355) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:41 smithi007 bash[22722]: audit 2024-09-14T03:40:40.710255+0000 mgr.a (mgr.14355) 13828 : audit [DBG] from='client.300375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:41 smithi007 bash[22722]: cluster 2024-09-14T03:40:41.418843+0000 mgr.a (mgr.14355) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:43 smithi131 bash[24745]: cluster 2024-09-14T03:40:43.419833+0000 mgr.a (mgr.14355) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:43 smithi171 bash[25040]: cluster 2024-09-14T03:40:43.419833+0000 mgr.a (mgr.14355) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:43 smithi007 bash[22722]: cluster 2024-09-14T03:40:43.419833+0000 mgr.a (mgr.14355) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:40:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:45 smithi131 bash[24745]: cluster 2024-09-14T03:40:45.421792+0000 mgr.a (mgr.14355) 13831 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:45 smithi171 bash[25040]: cluster 2024-09-14T03:40:45.421792+0000 mgr.a (mgr.14355) 13831 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:45 smithi007 bash[22722]: cluster 2024-09-14T03:40:45.421792+0000 mgr.a (mgr.14355) 13831 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:46.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:46.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:46.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:46.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:47 smithi131 bash[24745]: audit 2024-09-14T03:40:46.478953+0000 mgr.a (mgr.14355) 13832 : audit [DBG] from='client.300450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:47 smithi131 bash[24745]: cluster 2024-09-14T03:40:47.422761+0000 mgr.a (mgr.14355) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:47 smithi171 bash[25040]: audit 2024-09-14T03:40:46.478953+0000 mgr.a (mgr.14355) 13832 : audit [DBG] from='client.300450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:47 smithi171 bash[25040]: cluster 2024-09-14T03:40:47.422761+0000 mgr.a (mgr.14355) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:47 smithi007 bash[22722]: audit 2024-09-14T03:40:46.478953+0000 mgr.a (mgr.14355) 13832 : audit [DBG] from='client.300450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:47 smithi007 bash[22722]: cluster 2024-09-14T03:40:47.422761+0000 mgr.a (mgr.14355) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:49 smithi131 bash[24745]: cluster 2024-09-14T03:40:49.423570+0000 mgr.a (mgr.14355) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:49 smithi171 bash[25040]: cluster 2024-09-14T03:40:49.423570+0000 mgr.a (mgr.14355) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:49 smithi007 bash[22722]: cluster 2024-09-14T03:40:49.423570+0000 mgr.a (mgr.14355) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:40:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:51 smithi131 bash[24745]: cluster 2024-09-14T03:40:51.425757+0000 mgr.a (mgr.14355) 13835 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:40:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:51 smithi171 bash[25040]: cluster 2024-09-14T03:40:51.425757+0000 mgr.a (mgr.14355) 13835 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:40:51.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:51.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:51 smithi007 bash[22722]: cluster 2024-09-14T03:40:51.425757+0000 mgr.a (mgr.14355) 13835 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:40:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:52.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:52.689 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:52 smithi131 bash[24745]: audit 2024-09-14T03:40:52.233719+0000 mgr.a (mgr.14355) 13836 : audit [DBG] from='client.300528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:52 smithi171 bash[25040]: audit 2024-09-14T03:40:52.233719+0000 mgr.a (mgr.14355) 13836 : audit [DBG] from='client.300528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:52 smithi007 bash[22722]: audit 2024-09-14T03:40:52.233719+0000 mgr.a (mgr.14355) 13836 : audit [DBG] from='client.300528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:53 smithi131 bash[24745]: audit 2024-09-14T03:40:52.534605+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:40:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:53 smithi131 bash[24745]: audit 2024-09-14T03:40:53.104746+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:53 smithi131 bash[24745]: audit 2024-09-14T03:40:53.109543+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:53 smithi131 bash[24745]: cluster 2024-09-14T03:40:53.426672+0000 mgr.a (mgr.14355) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:53 smithi171 bash[25040]: audit 2024-09-14T03:40:52.534605+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:40:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:53 smithi171 bash[25040]: audit 2024-09-14T03:40:53.104746+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:53 smithi171 bash[25040]: audit 2024-09-14T03:40:53.109543+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:53 smithi171 bash[25040]: cluster 2024-09-14T03:40:53.426672+0000 mgr.a (mgr.14355) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:53 smithi007 bash[22722]: audit 2024-09-14T03:40:52.534605+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:40:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:53 smithi007 bash[22722]: audit 2024-09-14T03:40:53.104746+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:53 smithi007 bash[22722]: audit 2024-09-14T03:40:53.109543+0000 mon.a (mon.0) 2658 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:53 smithi007 bash[22722]: cluster 2024-09-14T03:40:53.426672+0000 mgr.a (mgr.14355) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:40:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:54 smithi131 bash[24745]: audit 2024-09-14T03:40:53.736405+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:40:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:54 smithi131 bash[24745]: audit 2024-09-14T03:40:53.737695+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:40:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:54 smithi131 bash[24745]: audit 2024-09-14T03:40:53.746457+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:54 smithi131 bash[24745]: audit 2024-09-14T03:40:53.751316+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:54 smithi131 bash[24745]: audit 2024-09-14T03:40:53.753736+0000 mgr.a (mgr.14355) 13838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:54 smithi171 bash[25040]: audit 2024-09-14T03:40:53.736405+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:40:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:54 smithi171 bash[25040]: audit 2024-09-14T03:40:53.737695+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:40:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:54 smithi171 bash[25040]: audit 2024-09-14T03:40:53.746457+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:54 smithi171 bash[25040]: audit 2024-09-14T03:40:53.751316+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:54 smithi171 bash[25040]: audit 2024-09-14T03:40:53.753736+0000 mgr.a (mgr.14355) 13838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22972]: debug 2024-09-14T03:40:54.471+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22972]: debug 2024-09-14T03:40:54.471+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22722]: audit 2024-09-14T03:40:53.736405+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22722]: audit 2024-09-14T03:40:53.737695+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22722]: audit 2024-09-14T03:40:53.746457+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22722]: audit 2024-09-14T03:40:53.751316+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:54 smithi007 bash[22722]: audit 2024-09-14T03:40:53.753736+0000 mgr.a (mgr.14355) 13838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:40:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:55 smithi171 bash[25040]: audit 2024-09-14T03:40:54.476257+0000 mgr.a (mgr.14355) 13839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:40:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:55 smithi171 bash[25040]: cephadm 2024-09-14T03:40:54.477486+0000 mgr.a (mgr.14355) 13840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:40:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:55 smithi171 bash[25040]: cluster 2024-09-14T03:40:55.428951+0000 mgr.a (mgr.14355) 13841 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:55 smithi007 bash[22722]: audit 2024-09-14T03:40:54.476257+0000 mgr.a (mgr.14355) 13839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:40:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:55 smithi007 bash[22722]: cephadm 2024-09-14T03:40:54.477486+0000 mgr.a (mgr.14355) 13840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:40:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:55 smithi007 bash[22722]: cluster 2024-09-14T03:40:55.428951+0000 mgr.a (mgr.14355) 13841 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:55 smithi131 bash[24745]: audit 2024-09-14T03:40:54.476257+0000 mgr.a (mgr.14355) 13839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:40:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:55 smithi131 bash[24745]: cephadm 2024-09-14T03:40:54.477486+0000 mgr.a (mgr.14355) 13840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:40:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:55 smithi131 bash[24745]: cluster 2024-09-14T03:40:55.428951+0000 mgr.a (mgr.14355) 13841 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:40:57.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:40:57.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:40:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:57 smithi131 bash[24745]: cluster 2024-09-14T03:40:57.429738+0000 mgr.a (mgr.14355) 13842 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:57 smithi171 bash[25040]: cluster 2024-09-14T03:40:57.429738+0000 mgr.a (mgr.14355) 13842 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:57 smithi007 bash[22722]: cluster 2024-09-14T03:40:57.429738+0000 mgr.a (mgr.14355) 13842 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:58.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:40:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:40:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:40:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:40:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:40:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:58 smithi131 bash[24745]: audit 2024-09-14T03:40:58.028859+0000 mgr.a (mgr.14355) 13843 : audit [DBG] from='client.300708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:58 smithi171 bash[25040]: audit 2024-09-14T03:40:58.028859+0000 mgr.a (mgr.14355) 13843 : audit [DBG] from='client.300708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:58 smithi007 bash[22722]: audit 2024-09-14T03:40:58.028859+0000 mgr.a (mgr.14355) 13843 : audit [DBG] from='client.300708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:40:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:40:59 smithi171 bash[25040]: cluster 2024-09-14T03:40:59.430742+0000 mgr.a (mgr.14355) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:40:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:40:59 smithi007 bash[22722]: cluster 2024-09-14T03:40:59.430742+0000 mgr.a (mgr.14355) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:40:59 smithi131 bash[24745]: cluster 2024-09-14T03:40:59.430742+0000 mgr.a (mgr.14355) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:01 smithi131 bash[24745]: cluster 2024-09-14T03:41:01.433004+0000 mgr.a (mgr.14355) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:01 smithi171 bash[25040]: cluster 2024-09-14T03:41:01.433004+0000 mgr.a (mgr.14355) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:01 smithi007 bash[22722]: cluster 2024-09-14T03:41:01.433004+0000 mgr.a (mgr.14355) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:03 smithi131 bash[24745]: cluster 2024-09-14T03:41:03.433784+0000 mgr.a (mgr.14355) 13846 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:03 smithi171 bash[25040]: cluster 2024-09-14T03:41:03.433784+0000 mgr.a (mgr.14355) 13846 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:03 smithi007 bash[22722]: cluster 2024-09-14T03:41:03.433784+0000 mgr.a (mgr.14355) 13846 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:04.216 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:04.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:04.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:04 smithi131 bash[24745]: audit 2024-09-14T03:41:03.794357+0000 mgr.a (mgr.14355) 13847 : audit [DBG] from='client.300786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:04 smithi171 bash[25040]: audit 2024-09-14T03:41:03.794357+0000 mgr.a (mgr.14355) 13847 : audit [DBG] from='client.300786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:04 smithi007 bash[22722]: audit 2024-09-14T03:41:03.794357+0000 mgr.a (mgr.14355) 13847 : audit [DBG] from='client.300786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:05 smithi171 bash[25040]: cluster 2024-09-14T03:41:05.436144+0000 mgr.a (mgr.14355) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:05 smithi007 bash[22722]: cluster 2024-09-14T03:41:05.436144+0000 mgr.a (mgr.14355) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:05 smithi131 bash[24745]: cluster 2024-09-14T03:41:05.436144+0000 mgr.a (mgr.14355) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:41:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:07 smithi131 bash[24745]: cluster 2024-09-14T03:41:07.436899+0000 mgr.a (mgr.14355) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:07 smithi171 bash[25040]: cluster 2024-09-14T03:41:07.436899+0000 mgr.a (mgr.14355) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:07 smithi007 bash[22722]: cluster 2024-09-14T03:41:07.436899+0000 mgr.a (mgr.14355) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:09 smithi131 bash[24745]: cluster 2024-09-14T03:41:09.437503+0000 mgr.a (mgr.14355) 13850 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:09 smithi171 bash[25040]: cluster 2024-09-14T03:41:09.437503+0000 mgr.a (mgr.14355) 13850 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:09 smithi007 bash[22722]: cluster 2024-09-14T03:41:09.437503+0000 mgr.a (mgr.14355) 13850 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:09.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:10 smithi131 bash[24745]: audit 2024-09-14T03:41:09.557005+0000 mgr.a (mgr.14355) 13851 : audit [DBG] from='client.300864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:10 smithi171 bash[25040]: audit 2024-09-14T03:41:09.557005+0000 mgr.a (mgr.14355) 13851 : audit [DBG] from='client.300864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:10 smithi007 bash[22722]: audit 2024-09-14T03:41:09.557005+0000 mgr.a (mgr.14355) 13851 : audit [DBG] from='client.300864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:11 smithi171 bash[25040]: cluster 2024-09-14T03:41:11.439980+0000 mgr.a (mgr.14355) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:11 smithi007 bash[22722]: cluster 2024-09-14T03:41:11.439980+0000 mgr.a (mgr.14355) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:11 smithi131 bash[24745]: cluster 2024-09-14T03:41:11.439980+0000 mgr.a (mgr.14355) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:13 smithi131 bash[24745]: cluster 2024-09-14T03:41:13.440887+0000 mgr.a (mgr.14355) 13853 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:13 smithi171 bash[25040]: cluster 2024-09-14T03:41:13.440887+0000 mgr.a (mgr.14355) 13853 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:13 smithi007 bash[22722]: cluster 2024-09-14T03:41:13.440887+0000 mgr.a (mgr.14355) 13853 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:14.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:14.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:15.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:15.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:15.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:15.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:15.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:15 smithi131 bash[24745]: audit 2024-09-14T03:41:15.316039+0000 mgr.a (mgr.14355) 13854 : audit [DBG] from='client.300939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:15 smithi131 bash[24745]: cluster 2024-09-14T03:41:15.442493+0000 mgr.a (mgr.14355) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:15 smithi171 bash[25040]: audit 2024-09-14T03:41:15.316039+0000 mgr.a (mgr.14355) 13854 : audit [DBG] from='client.300939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:15 smithi171 bash[25040]: cluster 2024-09-14T03:41:15.442493+0000 mgr.a (mgr.14355) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:15 smithi007 bash[22722]: audit 2024-09-14T03:41:15.316039+0000 mgr.a (mgr.14355) 13854 : audit [DBG] from='client.300939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:15 smithi007 bash[22722]: cluster 2024-09-14T03:41:15.442493+0000 mgr.a (mgr.14355) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:17 smithi131 bash[24745]: cluster 2024-09-14T03:41:17.443302+0000 mgr.a (mgr.14355) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:41:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:17 smithi171 bash[25040]: cluster 2024-09-14T03:41:17.443302+0000 mgr.a (mgr.14355) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:41:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:17 smithi007 bash[22722]: cluster 2024-09-14T03:41:17.443302+0000 mgr.a (mgr.14355) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:41:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:19 smithi131 bash[24745]: cluster 2024-09-14T03:41:19.444212+0000 mgr.a (mgr.14355) 13857 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:19 smithi171 bash[25040]: cluster 2024-09-14T03:41:19.444212+0000 mgr.a (mgr.14355) 13857 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:19 smithi007 bash[22722]: cluster 2024-09-14T03:41:19.444212+0000 mgr.a (mgr.14355) 13857 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:20.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:20.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:20.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:21.524 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:21 smithi131 bash[24745]: audit 2024-09-14T03:41:21.098017+0000 mgr.a (mgr.14355) 13858 : audit [DBG] from='client.301014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:21 smithi131 bash[24745]: cluster 2024-09-14T03:41:21.445593+0000 mgr.a (mgr.14355) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:21 smithi171 bash[25040]: audit 2024-09-14T03:41:21.098017+0000 mgr.a (mgr.14355) 13858 : audit [DBG] from='client.301014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:21 smithi171 bash[25040]: cluster 2024-09-14T03:41:21.445593+0000 mgr.a (mgr.14355) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:21 smithi007 bash[22722]: audit 2024-09-14T03:41:21.098017+0000 mgr.a (mgr.14355) 13858 : audit [DBG] from='client.301014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:21 smithi007 bash[22722]: cluster 2024-09-14T03:41:21.445593+0000 mgr.a (mgr.14355) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:23 smithi131 bash[24745]: cluster 2024-09-14T03:41:23.446356+0000 mgr.a (mgr.14355) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:23 smithi171 bash[25040]: cluster 2024-09-14T03:41:23.446356+0000 mgr.a (mgr.14355) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:23 smithi007 bash[22722]: cluster 2024-09-14T03:41:23.446356+0000 mgr.a (mgr.14355) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:25 smithi131 bash[24745]: cluster 2024-09-14T03:41:25.448304+0000 mgr.a (mgr.14355) 13861 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:25 smithi171 bash[25040]: cluster 2024-09-14T03:41:25.448304+0000 mgr.a (mgr.14355) 13861 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:25 smithi007 bash[22722]: cluster 2024-09-14T03:41:25.448304+0000 mgr.a (mgr.14355) 13861 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:26.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:26.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:27.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:27.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:27.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:27.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:27.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:27 smithi171 bash[25040]: audit 2024-09-14T03:41:26.862538+0000 mgr.a (mgr.14355) 13862 : audit [DBG] from='client.301092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:27 smithi171 bash[25040]: cluster 2024-09-14T03:41:27.449285+0000 mgr.a (mgr.14355) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:27 smithi007 bash[22722]: audit 2024-09-14T03:41:26.862538+0000 mgr.a (mgr.14355) 13862 : audit [DBG] from='client.301092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:27 smithi007 bash[22722]: cluster 2024-09-14T03:41:27.449285+0000 mgr.a (mgr.14355) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:27 smithi131 bash[24745]: audit 2024-09-14T03:41:26.862538+0000 mgr.a (mgr.14355) 13862 : audit [DBG] from='client.301092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:27 smithi131 bash[24745]: cluster 2024-09-14T03:41:27.449285+0000 mgr.a (mgr.14355) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:29 smithi171 bash[25040]: cluster 2024-09-14T03:41:29.450076+0000 mgr.a (mgr.14355) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:29 smithi007 bash[22722]: cluster 2024-09-14T03:41:29.450076+0000 mgr.a (mgr.14355) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:29 smithi131 bash[24745]: cluster 2024-09-14T03:41:29.450076+0000 mgr.a (mgr.14355) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:31 smithi171 bash[25040]: cluster 2024-09-14T03:41:31.452246+0000 mgr.a (mgr.14355) 13865 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:31 smithi007 bash[22722]: cluster 2024-09-14T03:41:31.452246+0000 mgr.a (mgr.14355) 13865 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:31 smithi131 bash[24745]: cluster 2024-09-14T03:41:31.452246+0000 mgr.a (mgr.14355) 13865 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:32.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:32.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:33.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:33.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:33.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:33.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:33.080 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:33 smithi171 bash[25040]: audit 2024-09-14T03:41:32.639745+0000 mgr.a (mgr.14355) 13866 : audit [DBG] from='client.301161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:33 smithi171 bash[25040]: cluster 2024-09-14T03:41:33.453204+0000 mgr.a (mgr.14355) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:33 smithi007 bash[22722]: audit 2024-09-14T03:41:32.639745+0000 mgr.a (mgr.14355) 13866 : audit [DBG] from='client.301161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:33 smithi007 bash[22722]: cluster 2024-09-14T03:41:33.453204+0000 mgr.a (mgr.14355) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:33 smithi131 bash[24745]: audit 2024-09-14T03:41:32.639745+0000 mgr.a (mgr.14355) 13866 : audit [DBG] from='client.301161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:33 smithi131 bash[24745]: cluster 2024-09-14T03:41:33.453204+0000 mgr.a (mgr.14355) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:35 smithi171 bash[25040]: cluster 2024-09-14T03:41:35.455417+0000 mgr.a (mgr.14355) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:35 smithi007 bash[22722]: cluster 2024-09-14T03:41:35.455417+0000 mgr.a (mgr.14355) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:35 smithi131 bash[24745]: cluster 2024-09-14T03:41:35.455417+0000 mgr.a (mgr.14355) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:37 smithi171 bash[25040]: cluster 2024-09-14T03:41:37.456191+0000 mgr.a (mgr.14355) 13869 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:37 smithi007 bash[22722]: cluster 2024-09-14T03:41:37.456191+0000 mgr.a (mgr.14355) 13869 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:37 smithi131 bash[24745]: cluster 2024-09-14T03:41:37.456191+0000 mgr.a (mgr.14355) 13869 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:38.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:38.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:38 smithi171 bash[25040]: audit 2024-09-14T03:41:38.413760+0000 mgr.a (mgr.14355) 13870 : audit [DBG] from='client.301236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:38.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:38.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:38 smithi007 bash[22722]: audit 2024-09-14T03:41:38.413760+0000 mgr.a (mgr.14355) 13870 : audit [DBG] from='client.301236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:38 smithi131 bash[24745]: audit 2024-09-14T03:41:38.413760+0000 mgr.a (mgr.14355) 13870 : audit [DBG] from='client.301236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:39 smithi171 bash[25040]: cluster 2024-09-14T03:41:39.457183+0000 mgr.a (mgr.14355) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:39 smithi007 bash[22722]: cluster 2024-09-14T03:41:39.457183+0000 mgr.a (mgr.14355) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:39 smithi131 bash[24745]: cluster 2024-09-14T03:41:39.457183+0000 mgr.a (mgr.14355) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:41 smithi171 bash[25040]: cluster 2024-09-14T03:41:41.459451+0000 mgr.a (mgr.14355) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:41 smithi007 bash[22722]: cluster 2024-09-14T03:41:41.459451+0000 mgr.a (mgr.14355) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:41 smithi131 bash[24745]: cluster 2024-09-14T03:41:41.459451+0000 mgr.a (mgr.14355) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:43 smithi171 bash[25040]: cluster 2024-09-14T03:41:43.460191+0000 mgr.a (mgr.14355) 13873 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:43.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:43 smithi007 bash[22722]: cluster 2024-09-14T03:41:43.460191+0000 mgr.a (mgr.14355) 13873 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:43 smithi131 bash[24745]: cluster 2024-09-14T03:41:43.460191+0000 mgr.a (mgr.14355) 13873 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:44.611 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:44.611 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:44 smithi171 bash[25040]: audit 2024-09-14T03:41:44.189999+0000 mgr.a (mgr.14355) 13874 : audit [DBG] from='client.301314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:44 smithi007 bash[22722]: audit 2024-09-14T03:41:44.189999+0000 mgr.a (mgr.14355) 13874 : audit [DBG] from='client.301314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:44 smithi131 bash[24745]: audit 2024-09-14T03:41:44.189999+0000 mgr.a (mgr.14355) 13874 : audit [DBG] from='client.301314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:45 smithi007 bash[22722]: cluster 2024-09-14T03:41:45.462497+0000 mgr.a (mgr.14355) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:45 smithi131 bash[24745]: cluster 2024-09-14T03:41:45.462497+0000 mgr.a (mgr.14355) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:45 smithi171 bash[25040]: cluster 2024-09-14T03:41:45.462497+0000 mgr.a (mgr.14355) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:41:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:47 smithi171 bash[25040]: cluster 2024-09-14T03:41:47.463288+0000 mgr.a (mgr.14355) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:47 smithi007 bash[22722]: cluster 2024-09-14T03:41:47.463288+0000 mgr.a (mgr.14355) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:47 smithi131 bash[24745]: cluster 2024-09-14T03:41:47.463288+0000 mgr.a (mgr.14355) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:49.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:49.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:49.614 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:49 smithi171 bash[25040]: cluster 2024-09-14T03:41:49.464056+0000 mgr.a (mgr.14355) 13877 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:49 smithi007 bash[22722]: cluster 2024-09-14T03:41:49.464056+0000 mgr.a (mgr.14355) 13877 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:49 smithi131 bash[24745]: cluster 2024-09-14T03:41:49.464056+0000 mgr.a (mgr.14355) 13877 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:50.358 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:50.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:50.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:50.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:50.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:50 smithi171 bash[25040]: audit 2024-09-14T03:41:49.937732+0000 mgr.a (mgr.14355) 13878 : audit [DBG] from='client.301389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:50 smithi007 bash[22722]: audit 2024-09-14T03:41:49.937732+0000 mgr.a (mgr.14355) 13878 : audit [DBG] from='client.301389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:50 smithi131 bash[24745]: audit 2024-09-14T03:41:49.937732+0000 mgr.a (mgr.14355) 13878 : audit [DBG] from='client.301389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:51 smithi007 bash[22722]: cluster 2024-09-14T03:41:51.466837+0000 mgr.a (mgr.14355) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:41:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:51 smithi131 bash[24745]: cluster 2024-09-14T03:41:51.466837+0000 mgr.a (mgr.14355) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:41:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:51 smithi171 bash[25040]: cluster 2024-09-14T03:41:51.466837+0000 mgr.a (mgr.14355) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:41:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:53 smithi171 bash[25040]: cluster 2024-09-14T03:41:53.467624+0000 mgr.a (mgr.14355) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:41:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:53 smithi007 bash[22722]: cluster 2024-09-14T03:41:53.467624+0000 mgr.a (mgr.14355) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:41:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:53 smithi131 bash[24745]: cluster 2024-09-14T03:41:53.467624+0000 mgr.a (mgr.14355) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:41:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:54 smithi171 bash[25040]: audit 2024-09-14T03:41:54.531018+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:41:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:54 smithi007 bash[22722]: audit 2024-09-14T03:41:54.531018+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:41:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:54 smithi131 bash[24745]: audit 2024-09-14T03:41:54.531018+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:41:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:41:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:41:55.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:41:56.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:41:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:41:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:41:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:41:56.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:41:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.146937+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.152571+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.157592+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.163859+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: cluster 2024-09-14T03:41:55.468582+0000 mgr.a (mgr.14355) 13881 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.878706+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.879693+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.885115+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22722]: audit 2024-09-14T03:41:55.887438+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.146937+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.152571+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.157592+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.163859+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: cluster 2024-09-14T03:41:55.468582+0000 mgr.a (mgr.14355) 13881 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.878706+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.879693+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.885115+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:56 smithi131 bash[24745]: audit 2024-09-14T03:41:55.887438+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.146937+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.152571+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.157592+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.163859+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: cluster 2024-09-14T03:41:55.468582+0000 mgr.a (mgr.14355) 13881 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.878706+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.879693+0000 mon.a (mon.0) 2669 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.885115+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:41:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:56 smithi171 bash[25040]: audit 2024-09-14T03:41:55.887438+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:57.167 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22972]: debug 2024-09-14T03:41:56.822+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:41:57.167 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:41:56 smithi007 bash[22972]: debug 2024-09-14T03:41:56.822+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:41:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:57 smithi007 bash[22722]: audit 2024-09-14T03:41:55.694755+0000 mgr.a (mgr.14355) 13882 : audit [DBG] from='client.301467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:57 smithi007 bash[22722]: audit 2024-09-14T03:41:55.888703+0000 mgr.a (mgr.14355) 13883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:57 smithi131 bash[24745]: audit 2024-09-14T03:41:55.694755+0000 mgr.a (mgr.14355) 13882 : audit [DBG] from='client.301467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:57 smithi131 bash[24745]: audit 2024-09-14T03:41:55.888703+0000 mgr.a (mgr.14355) 13883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:57 smithi171 bash[25040]: audit 2024-09-14T03:41:55.694755+0000 mgr.a (mgr.14355) 13882 : audit [DBG] from='client.301467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:41:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:57 smithi171 bash[25040]: audit 2024-09-14T03:41:55.888703+0000 mgr.a (mgr.14355) 13883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:41:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:58 smithi007 bash[22722]: audit 2024-09-14T03:41:56.827011+0000 mgr.a (mgr.14355) 13884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:41:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:58 smithi007 bash[22722]: cephadm 2024-09-14T03:41:56.828158+0000 mgr.a (mgr.14355) 13885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:41:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:58 smithi007 bash[22722]: cluster 2024-09-14T03:41:57.469490+0000 mgr.a (mgr.14355) 13886 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:58 smithi131 bash[24745]: audit 2024-09-14T03:41:56.827011+0000 mgr.a (mgr.14355) 13884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:41:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:58 smithi131 bash[24745]: cephadm 2024-09-14T03:41:56.828158+0000 mgr.a (mgr.14355) 13885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:41:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:58 smithi131 bash[24745]: cluster 2024-09-14T03:41:57.469490+0000 mgr.a (mgr.14355) 13886 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:58 smithi171 bash[25040]: audit 2024-09-14T03:41:56.827011+0000 mgr.a (mgr.14355) 13884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:41:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:58 smithi171 bash[25040]: cephadm 2024-09-14T03:41:56.828158+0000 mgr.a (mgr.14355) 13885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:41:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:58 smithi171 bash[25040]: cluster 2024-09-14T03:41:57.469490+0000 mgr.a (mgr.14355) 13886 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:41:59 smithi171 bash[25040]: cluster 2024-09-14T03:41:59.470289+0000 mgr.a (mgr.14355) 13887 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:41:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:41:59 smithi007 bash[22722]: cluster 2024-09-14T03:41:59.470289+0000 mgr.a (mgr.14355) 13887 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:42:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:41:59 smithi131 bash[24745]: cluster 2024-09-14T03:41:59.470289+0000 mgr.a (mgr.14355) 13887 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:42:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:01.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:01.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:01 smithi171 bash[25040]: audit 2024-09-14T03:42:01.466228+0000 mgr.a (mgr.14355) 13888 : audit [DBG] from='client.301644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:01 smithi171 bash[25040]: cluster 2024-09-14T03:42:01.483480+0000 mgr.a (mgr.14355) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:01.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:01.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:01.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:01 smithi007 bash[22722]: audit 2024-09-14T03:42:01.466228+0000 mgr.a (mgr.14355) 13888 : audit [DBG] from='client.301644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:01.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:01 smithi007 bash[22722]: cluster 2024-09-14T03:42:01.483480+0000 mgr.a (mgr.14355) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:01 smithi131 bash[24745]: audit 2024-09-14T03:42:01.466228+0000 mgr.a (mgr.14355) 13888 : audit [DBG] from='client.301644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:01 smithi131 bash[24745]: cluster 2024-09-14T03:42:01.483480+0000 mgr.a (mgr.14355) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:03 smithi007 bash[22722]: cluster 2024-09-14T03:42:03.484624+0000 mgr.a (mgr.14355) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:03 smithi131 bash[24745]: cluster 2024-09-14T03:42:03.484624+0000 mgr.a (mgr.14355) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:03 smithi171 bash[25040]: cluster 2024-09-14T03:42:03.484624+0000 mgr.a (mgr.14355) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:06 smithi171 bash[25040]: cluster 2024-09-14T03:42:05.486874+0000 mgr.a (mgr.14355) 13891 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:06.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:06.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:06 smithi007 bash[22722]: cluster 2024-09-14T03:42:05.486874+0000 mgr.a (mgr.14355) 13891 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:06 smithi131 bash[24745]: cluster 2024-09-14T03:42:05.486874+0000 mgr.a (mgr.14355) 13891 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:07.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:07.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:07 smithi007 bash[22722]: audit 2024-09-14T03:42:07.229853+0000 mgr.a (mgr.14355) 13892 : audit [DBG] from='client.301719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:07 smithi131 bash[24745]: audit 2024-09-14T03:42:07.229853+0000 mgr.a (mgr.14355) 13892 : audit [DBG] from='client.301719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:07 smithi171 bash[25040]: audit 2024-09-14T03:42:07.229853+0000 mgr.a (mgr.14355) 13892 : audit [DBG] from='client.301719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:08 smithi007 bash[22722]: cluster 2024-09-14T03:42:07.487347+0000 mgr.a (mgr.14355) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:08 smithi131 bash[24745]: cluster 2024-09-14T03:42:07.487347+0000 mgr.a (mgr.14355) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:08 smithi171 bash[25040]: cluster 2024-09-14T03:42:07.487347+0000 mgr.a (mgr.14355) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 425 B/s wr, 13 op/s 2024-09-14T03:42:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:10 smithi007 bash[22722]: cluster 2024-09-14T03:42:09.488158+0000 mgr.a (mgr.14355) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:10 smithi131 bash[24745]: cluster 2024-09-14T03:42:09.488158+0000 mgr.a (mgr.14355) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:10 smithi171 bash[25040]: cluster 2024-09-14T03:42:09.488158+0000 mgr.a (mgr.14355) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T03:42:12.642 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:12.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:12.643 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:12 smithi007 bash[22722]: cluster 2024-09-14T03:42:11.490477+0000 mgr.a (mgr.14355) 13895 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:12 smithi131 bash[24745]: cluster 2024-09-14T03:42:11.490477+0000 mgr.a (mgr.14355) 13895 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:12 smithi171 bash[25040]: cluster 2024-09-14T03:42:11.490477+0000 mgr.a (mgr.14355) 13895 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T03:42:13.383 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:13.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:13 smithi007 bash[22722]: audit 2024-09-14T03:42:12.976385+0000 mgr.a (mgr.14355) 13896 : audit [DBG] from='client.301797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:13 smithi131 bash[24745]: audit 2024-09-14T03:42:12.976385+0000 mgr.a (mgr.14355) 13896 : audit [DBG] from='client.301797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:13 smithi171 bash[25040]: audit 2024-09-14T03:42:12.976385+0000 mgr.a (mgr.14355) 13896 : audit [DBG] from='client.301797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:14 smithi007 bash[22722]: cluster 2024-09-14T03:42:13.490961+0000 mgr.a (mgr.14355) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:14 smithi131 bash[24745]: cluster 2024-09-14T03:42:13.490961+0000 mgr.a (mgr.14355) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:14 smithi171 bash[25040]: cluster 2024-09-14T03:42:13.490961+0000 mgr.a (mgr.14355) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:16 smithi007 bash[22722]: cluster 2024-09-14T03:42:15.493065+0000 mgr.a (mgr.14355) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:16 smithi131 bash[24745]: cluster 2024-09-14T03:42:15.493065+0000 mgr.a (mgr.14355) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:16 smithi171 bash[25040]: cluster 2024-09-14T03:42:15.493065+0000 mgr.a (mgr.14355) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:18.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:18.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:18 smithi007 bash[22722]: cluster 2024-09-14T03:42:17.493846+0000 mgr.a (mgr.14355) 13899 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:18 smithi131 bash[24745]: cluster 2024-09-14T03:42:17.493846+0000 mgr.a (mgr.14355) 13899 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:18 smithi171 bash[25040]: cluster 2024-09-14T03:42:17.493846+0000 mgr.a (mgr.14355) 13899 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:19.175 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:19.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:19.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:19 smithi007 bash[22722]: audit 2024-09-14T03:42:18.729645+0000 mgr.a (mgr.14355) 13900 : audit [DBG] from='client.301875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:19 smithi131 bash[24745]: audit 2024-09-14T03:42:18.729645+0000 mgr.a (mgr.14355) 13900 : audit [DBG] from='client.301875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:19 smithi171 bash[25040]: audit 2024-09-14T03:42:18.729645+0000 mgr.a (mgr.14355) 13900 : audit [DBG] from='client.301875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:20 smithi007 bash[22722]: cluster 2024-09-14T03:42:19.494836+0000 mgr.a (mgr.14355) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:20 smithi131 bash[24745]: cluster 2024-09-14T03:42:19.494836+0000 mgr.a (mgr.14355) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:20 smithi171 bash[25040]: cluster 2024-09-14T03:42:19.494836+0000 mgr.a (mgr.14355) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:22 smithi007 bash[22722]: cluster 2024-09-14T03:42:21.497143+0000 mgr.a (mgr.14355) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:22 smithi131 bash[24745]: cluster 2024-09-14T03:42:21.497143+0000 mgr.a (mgr.14355) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:22 smithi171 bash[25040]: cluster 2024-09-14T03:42:21.497143+0000 mgr.a (mgr.14355) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:24.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:24.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:24.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:24.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:24.941 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:24 smithi007 bash[22722]: cluster 2024-09-14T03:42:23.497920+0000 mgr.a (mgr.14355) 13903 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:24 smithi131 bash[24745]: cluster 2024-09-14T03:42:23.497920+0000 mgr.a (mgr.14355) 13903 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:24 smithi171 bash[25040]: cluster 2024-09-14T03:42:23.497920+0000 mgr.a (mgr.14355) 13903 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:25 smithi007 bash[22722]: audit 2024-09-14T03:42:24.511433+0000 mgr.a (mgr.14355) 13904 : audit [DBG] from='client.301947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:25 smithi131 bash[24745]: audit 2024-09-14T03:42:24.511433+0000 mgr.a (mgr.14355) 13904 : audit [DBG] from='client.301947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:25 smithi171 bash[25040]: audit 2024-09-14T03:42:24.511433+0000 mgr.a (mgr.14355) 13904 : audit [DBG] from='client.301947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:26 smithi007 bash[22722]: cluster 2024-09-14T03:42:25.500297+0000 mgr.a (mgr.14355) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:26 smithi131 bash[24745]: cluster 2024-09-14T03:42:25.500297+0000 mgr.a (mgr.14355) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:26 smithi171 bash[25040]: cluster 2024-09-14T03:42:25.500297+0000 mgr.a (mgr.14355) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T03:42:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:28 smithi007 bash[22722]: cluster 2024-09-14T03:42:27.501095+0000 mgr.a (mgr.14355) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:28 smithi131 bash[24745]: cluster 2024-09-14T03:42:27.501095+0000 mgr.a (mgr.14355) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:28 smithi171 bash[25040]: cluster 2024-09-14T03:42:27.501095+0000 mgr.a (mgr.14355) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:29.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:30.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:30.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:30.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:30.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:30.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:30 smithi007 bash[22722]: cluster 2024-09-14T03:42:29.501881+0000 mgr.a (mgr.14355) 13907 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:30 smithi007 bash[22722]: audit 2024-09-14T03:42:30.276518+0000 mgr.a (mgr.14355) 13908 : audit [DBG] from='client.302022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:30 smithi131 bash[24745]: cluster 2024-09-14T03:42:29.501881+0000 mgr.a (mgr.14355) 13907 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:30 smithi131 bash[24745]: audit 2024-09-14T03:42:30.276518+0000 mgr.a (mgr.14355) 13908 : audit [DBG] from='client.302022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:30 smithi171 bash[25040]: cluster 2024-09-14T03:42:29.501881+0000 mgr.a (mgr.14355) 13907 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:30 smithi171 bash[25040]: audit 2024-09-14T03:42:30.276518+0000 mgr.a (mgr.14355) 13908 : audit [DBG] from='client.302022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:32 smithi007 bash[22722]: cluster 2024-09-14T03:42:31.504665+0000 mgr.a (mgr.14355) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:32 smithi131 bash[24745]: cluster 2024-09-14T03:42:31.504665+0000 mgr.a (mgr.14355) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:32 smithi171 bash[25040]: cluster 2024-09-14T03:42:31.504665+0000 mgr.a (mgr.14355) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T03:42:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:34 smithi007 bash[22722]: cluster 2024-09-14T03:42:33.505438+0000 mgr.a (mgr.14355) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:34 smithi131 bash[24745]: cluster 2024-09-14T03:42:33.505438+0000 mgr.a (mgr.14355) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:34 smithi171 bash[25040]: cluster 2024-09-14T03:42:33.505438+0000 mgr.a (mgr.14355) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:36.478 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:36.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:36.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:36.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:36.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:36 smithi007 bash[22722]: cluster 2024-09-14T03:42:35.507391+0000 mgr.a (mgr.14355) 13911 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:36 smithi007 bash[22722]: audit 2024-09-14T03:42:36.042329+0000 mgr.a (mgr.14355) 13912 : audit [DBG] from='client.302097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:36 smithi131 bash[24745]: cluster 2024-09-14T03:42:35.507391+0000 mgr.a (mgr.14355) 13911 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:36 smithi131 bash[24745]: audit 2024-09-14T03:42:36.042329+0000 mgr.a (mgr.14355) 13912 : audit [DBG] from='client.302097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:36 smithi171 bash[25040]: cluster 2024-09-14T03:42:35.507391+0000 mgr.a (mgr.14355) 13911 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:36 smithi171 bash[25040]: audit 2024-09-14T03:42:36.042329+0000 mgr.a (mgr.14355) 13912 : audit [DBG] from='client.302097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:38 smithi007 bash[22722]: cluster 2024-09-14T03:42:37.508277+0000 mgr.a (mgr.14355) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:38 smithi131 bash[24745]: cluster 2024-09-14T03:42:37.508277+0000 mgr.a (mgr.14355) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:38 smithi171 bash[25040]: cluster 2024-09-14T03:42:37.508277+0000 mgr.a (mgr.14355) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:42:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:40 smithi007 bash[22722]: cluster 2024-09-14T03:42:39.509086+0000 mgr.a (mgr.14355) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:42:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:40 smithi131 bash[24745]: cluster 2024-09-14T03:42:39.509086+0000 mgr.a (mgr.14355) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:42:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:40 smithi171 bash[25040]: cluster 2024-09-14T03:42:39.509086+0000 mgr.a (mgr.14355) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:42:41.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:41.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:41.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:42.237 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:42.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:42.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:42 smithi007 bash[22722]: cluster 2024-09-14T03:42:41.510814+0000 mgr.a (mgr.14355) 13915 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:42 smithi007 bash[22722]: audit 2024-09-14T03:42:41.811244+0000 mgr.a (mgr.14355) 13916 : audit [DBG] from='client.302172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:42 smithi131 bash[24745]: cluster 2024-09-14T03:42:41.510814+0000 mgr.a (mgr.14355) 13915 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:42 smithi131 bash[24745]: audit 2024-09-14T03:42:41.811244+0000 mgr.a (mgr.14355) 13916 : audit [DBG] from='client.302172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:42 smithi171 bash[25040]: cluster 2024-09-14T03:42:41.510814+0000 mgr.a (mgr.14355) 13915 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:42 smithi171 bash[25040]: audit 2024-09-14T03:42:41.811244+0000 mgr.a (mgr.14355) 13916 : audit [DBG] from='client.302172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:44 smithi007 bash[22722]: cluster 2024-09-14T03:42:43.511658+0000 mgr.a (mgr.14355) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:44 smithi131 bash[24745]: cluster 2024-09-14T03:42:43.511658+0000 mgr.a (mgr.14355) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:44 smithi171 bash[25040]: cluster 2024-09-14T03:42:43.511658+0000 mgr.a (mgr.14355) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:46 smithi007 bash[22722]: cluster 2024-09-14T03:42:45.513810+0000 mgr.a (mgr.14355) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:46 smithi131 bash[24745]: cluster 2024-09-14T03:42:45.513810+0000 mgr.a (mgr.14355) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:46 smithi171 bash[25040]: cluster 2024-09-14T03:42:45.513810+0000 mgr.a (mgr.14355) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:47.238 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:47.239 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:47.240 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:47.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:48 smithi007 bash[22722]: cluster 2024-09-14T03:42:47.514567+0000 mgr.a (mgr.14355) 13919 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:48.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:48 smithi007 bash[22722]: audit 2024-09-14T03:42:47.571459+0000 mgr.a (mgr.14355) 13920 : audit [DBG] from='client.302247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:48 smithi131 bash[24745]: cluster 2024-09-14T03:42:47.514567+0000 mgr.a (mgr.14355) 13919 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:48 smithi131 bash[24745]: audit 2024-09-14T03:42:47.571459+0000 mgr.a (mgr.14355) 13920 : audit [DBG] from='client.302247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:48 smithi171 bash[25040]: cluster 2024-09-14T03:42:47.514567+0000 mgr.a (mgr.14355) 13919 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:48 smithi171 bash[25040]: audit 2024-09-14T03:42:47.571459+0000 mgr.a (mgr.14355) 13920 : audit [DBG] from='client.302247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:51 smithi007 bash[22722]: cluster 2024-09-14T03:42:49.515510+0000 mgr.a (mgr.14355) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:51 smithi131 bash[24745]: cluster 2024-09-14T03:42:49.515510+0000 mgr.a (mgr.14355) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:51 smithi171 bash[25040]: cluster 2024-09-14T03:42:49.515510+0000 mgr.a (mgr.14355) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:53.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:53.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:53.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:53 smithi007 bash[22722]: cluster 2024-09-14T03:42:51.517784+0000 mgr.a (mgr.14355) 13922 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:53.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:53.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:53.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:53.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:53.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:53 smithi131 bash[24745]: cluster 2024-09-14T03:42:51.517784+0000 mgr.a (mgr.14355) 13922 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:53 smithi171 bash[25040]: cluster 2024-09-14T03:42:51.517784+0000 mgr.a (mgr.14355) 13922 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:54 smithi007 bash[22722]: audit 2024-09-14T03:42:53.329666+0000 mgr.a (mgr.14355) 13923 : audit [DBG] from='client.302319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:54 smithi131 bash[24745]: audit 2024-09-14T03:42:53.329666+0000 mgr.a (mgr.14355) 13923 : audit [DBG] from='client.302319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:54 smithi171 bash[25040]: audit 2024-09-14T03:42:53.329666+0000 mgr.a (mgr.14355) 13923 : audit [DBG] from='client.302319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:42:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:55 smithi007 bash[22722]: cluster 2024-09-14T03:42:53.518408+0000 mgr.a (mgr.14355) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:55 smithi131 bash[24745]: cluster 2024-09-14T03:42:53.518408+0000 mgr.a (mgr.14355) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:55 smithi171 bash[25040]: cluster 2024-09-14T03:42:53.518408+0000 mgr.a (mgr.14355) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:57 smithi007 bash[22722]: cluster 2024-09-14T03:42:55.520682+0000 mgr.a (mgr.14355) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:57 smithi007 bash[22722]: audit 2024-09-14T03:42:56.877589+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:42:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:57 smithi131 bash[24745]: cluster 2024-09-14T03:42:55.520682+0000 mgr.a (mgr.14355) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:57 smithi131 bash[24745]: audit 2024-09-14T03:42:56.877589+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:42:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:57 smithi171 bash[25040]: cluster 2024-09-14T03:42:55.520682+0000 mgr.a (mgr.14355) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:42:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:57 smithi171 bash[25040]: audit 2024-09-14T03:42:56.877589+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:42:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22972]: debug 2024-09-14T03:42:58.469+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:42:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22972]: debug 2024-09-14T03:42:58.469+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:42:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22722]: audit 2024-09-14T03:42:57.720525+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:42:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22722]: audit 2024-09-14T03:42:57.722242+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:42:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22722]: audit 2024-09-14T03:42:57.733010+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:42:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:58 smithi007 bash[22722]: audit 2024-09-14T03:42:57.738012+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:42:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:42:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:42:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:58 smithi131 bash[24745]: audit 2024-09-14T03:42:57.720525+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:42:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:58 smithi131 bash[24745]: audit 2024-09-14T03:42:57.722242+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:42:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:58 smithi131 bash[24745]: audit 2024-09-14T03:42:57.733010+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:42:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:58 smithi131 bash[24745]: audit 2024-09-14T03:42:57.738012+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:58 smithi171 bash[25040]: audit 2024-09-14T03:42:57.720525+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:42:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:58 smithi171 bash[25040]: audit 2024-09-14T03:42:57.722242+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:42:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:58 smithi171 bash[25040]: audit 2024-09-14T03:42:57.733010+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:42:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:58 smithi171 bash[25040]: audit 2024-09-14T03:42:57.738012+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:59.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:42:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:42:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:42:59.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:42:59.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:42:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:59 smithi007 bash[22722]: cluster 2024-09-14T03:42:57.521391+0000 mgr.a (mgr.14355) 13926 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:59 smithi007 bash[22722]: audit 2024-09-14T03:42:57.739284+0000 mgr.a (mgr.14355) 13927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:59 smithi007 bash[22722]: audit 2024-09-14T03:42:58.472826+0000 mgr.a (mgr.14355) 13928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:42:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:42:59 smithi007 bash[22722]: cephadm 2024-09-14T03:42:58.474123+0000 mgr.a (mgr.14355) 13929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:42:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:59 smithi131 bash[24745]: cluster 2024-09-14T03:42:57.521391+0000 mgr.a (mgr.14355) 13926 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:59 smithi131 bash[24745]: audit 2024-09-14T03:42:57.739284+0000 mgr.a (mgr.14355) 13927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:59 smithi131 bash[24745]: audit 2024-09-14T03:42:58.472826+0000 mgr.a (mgr.14355) 13928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:42:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:42:59 smithi131 bash[24745]: cephadm 2024-09-14T03:42:58.474123+0000 mgr.a (mgr.14355) 13929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:42:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:59 smithi171 bash[25040]: cluster 2024-09-14T03:42:57.521391+0000 mgr.a (mgr.14355) 13926 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:42:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:59 smithi171 bash[25040]: audit 2024-09-14T03:42:57.739284+0000 mgr.a (mgr.14355) 13927 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:42:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:59 smithi171 bash[25040]: audit 2024-09-14T03:42:58.472826+0000 mgr.a (mgr.14355) 13928 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:42:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:42:59 smithi171 bash[25040]: cephadm 2024-09-14T03:42:58.474123+0000 mgr.a (mgr.14355) 13929 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:43:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:00 smithi007 bash[22722]: audit 2024-09-14T03:42:59.073719+0000 mgr.a (mgr.14355) 13930 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:00 smithi131 bash[24745]: audit 2024-09-14T03:42:59.073719+0000 mgr.a (mgr.14355) 13930 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:00 smithi171 bash[25040]: audit 2024-09-14T03:42:59.073719+0000 mgr.a (mgr.14355) 13930 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:01 smithi007 bash[22722]: cluster 2024-09-14T03:42:59.522105+0000 mgr.a (mgr.14355) 13931 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:01 smithi131 bash[24745]: cluster 2024-09-14T03:42:59.522105+0000 mgr.a (mgr.14355) 13931 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:01 smithi171 bash[25040]: cluster 2024-09-14T03:42:59.522105+0000 mgr.a (mgr.14355) 13931 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:03 smithi007 bash[22722]: cluster 2024-09-14T03:43:01.524343+0000 mgr.a (mgr.14355) 13932 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:03 smithi131 bash[24745]: cluster 2024-09-14T03:43:01.524343+0000 mgr.a (mgr.14355) 13932 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:03 smithi171 bash[25040]: cluster 2024-09-14T03:43:01.524343+0000 mgr.a (mgr.14355) 13932 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:04.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:04.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:04.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:05.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:05.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:05.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:05 smithi007 bash[22722]: cluster 2024-09-14T03:43:03.525112+0000 mgr.a (mgr.14355) 13933 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:05 smithi131 bash[24745]: cluster 2024-09-14T03:43:03.525112+0000 mgr.a (mgr.14355) 13933 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:05 smithi171 bash[25040]: cluster 2024-09-14T03:43:03.525112+0000 mgr.a (mgr.14355) 13933 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:06 smithi007 bash[22722]: audit 2024-09-14T03:43:04.832496+0000 mgr.a (mgr.14355) 13934 : audit [DBG] from='client.302580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:06 smithi131 bash[24745]: audit 2024-09-14T03:43:04.832496+0000 mgr.a (mgr.14355) 13934 : audit [DBG] from='client.302580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:06 smithi171 bash[25040]: audit 2024-09-14T03:43:04.832496+0000 mgr.a (mgr.14355) 13934 : audit [DBG] from='client.302580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:07 smithi007 bash[22722]: cluster 2024-09-14T03:43:05.527610+0000 mgr.a (mgr.14355) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:07 smithi131 bash[24745]: cluster 2024-09-14T03:43:05.527610+0000 mgr.a (mgr.14355) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:07 smithi171 bash[25040]: cluster 2024-09-14T03:43:05.527610+0000 mgr.a (mgr.14355) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:09 smithi007 bash[22722]: cluster 2024-09-14T03:43:07.528445+0000 mgr.a (mgr.14355) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:09 smithi131 bash[24745]: cluster 2024-09-14T03:43:07.528445+0000 mgr.a (mgr.14355) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:09 smithi171 bash[25040]: cluster 2024-09-14T03:43:07.528445+0000 mgr.a (mgr.14355) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:10.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:10.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:10.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:11.038 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:11.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:11.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:11.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:11.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:11 smithi007 bash[22722]: cluster 2024-09-14T03:43:09.529258+0000 mgr.a (mgr.14355) 13937 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:11 smithi131 bash[24745]: cluster 2024-09-14T03:43:09.529258+0000 mgr.a (mgr.14355) 13937 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:11 smithi171 bash[25040]: cluster 2024-09-14T03:43:09.529258+0000 mgr.a (mgr.14355) 13937 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:12 smithi007 bash[22722]: audit 2024-09-14T03:43:10.605511+0000 mgr.a (mgr.14355) 13938 : audit [DBG] from='client.302658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:12 smithi131 bash[24745]: audit 2024-09-14T03:43:10.605511+0000 mgr.a (mgr.14355) 13938 : audit [DBG] from='client.302658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:12.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:12 smithi171 bash[25040]: audit 2024-09-14T03:43:10.605511+0000 mgr.a (mgr.14355) 13938 : audit [DBG] from='client.302658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:13 smithi007 bash[22722]: cluster 2024-09-14T03:43:11.531952+0000 mgr.a (mgr.14355) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:13 smithi131 bash[24745]: cluster 2024-09-14T03:43:11.531952+0000 mgr.a (mgr.14355) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:13 smithi171 bash[25040]: cluster 2024-09-14T03:43:11.531952+0000 mgr.a (mgr.14355) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:43:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:15 smithi007 bash[22722]: cluster 2024-09-14T03:43:13.532700+0000 mgr.a (mgr.14355) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:15 smithi131 bash[24745]: cluster 2024-09-14T03:43:13.532700+0000 mgr.a (mgr.14355) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:15 smithi171 bash[25040]: cluster 2024-09-14T03:43:13.532700+0000 mgr.a (mgr.14355) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:16.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:16.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:17 smithi007 bash[22722]: cluster 2024-09-14T03:43:15.534686+0000 mgr.a (mgr.14355) 13941 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:17 smithi007 bash[22722]: audit 2024-09-14T03:43:16.367058+0000 mgr.a (mgr.14355) 13942 : audit [DBG] from='client.302733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:17 smithi131 bash[24745]: cluster 2024-09-14T03:43:15.534686+0000 mgr.a (mgr.14355) 13941 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:17 smithi131 bash[24745]: audit 2024-09-14T03:43:16.367058+0000 mgr.a (mgr.14355) 13942 : audit [DBG] from='client.302733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:17 smithi171 bash[25040]: cluster 2024-09-14T03:43:15.534686+0000 mgr.a (mgr.14355) 13941 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:17 smithi171 bash[25040]: audit 2024-09-14T03:43:16.367058+0000 mgr.a (mgr.14355) 13942 : audit [DBG] from='client.302733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:19 smithi007 bash[22722]: cluster 2024-09-14T03:43:17.535588+0000 mgr.a (mgr.14355) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:19 smithi131 bash[24745]: cluster 2024-09-14T03:43:17.535588+0000 mgr.a (mgr.14355) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:19 smithi171 bash[25040]: cluster 2024-09-14T03:43:17.535588+0000 mgr.a (mgr.14355) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:43:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:21 smithi007 bash[22722]: cluster 2024-09-14T03:43:19.536449+0000 mgr.a (mgr.14355) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:21 smithi131 bash[24745]: cluster 2024-09-14T03:43:19.536449+0000 mgr.a (mgr.14355) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:21.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:21.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:21 smithi171 bash[25040]: cluster 2024-09-14T03:43:19.536449+0000 mgr.a (mgr.14355) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:22.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:22.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:22.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:22.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:22.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:23 smithi007 bash[22722]: cluster 2024-09-14T03:43:21.538699+0000 mgr.a (mgr.14355) 13945 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:23 smithi007 bash[22722]: audit 2024-09-14T03:43:22.117444+0000 mgr.a (mgr.14355) 13946 : audit [DBG] from='client.302811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:23 smithi131 bash[24745]: cluster 2024-09-14T03:43:21.538699+0000 mgr.a (mgr.14355) 13945 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:23 smithi131 bash[24745]: audit 2024-09-14T03:43:22.117444+0000 mgr.a (mgr.14355) 13946 : audit [DBG] from='client.302811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:23 smithi171 bash[25040]: cluster 2024-09-14T03:43:21.538699+0000 mgr.a (mgr.14355) 13945 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:23 smithi171 bash[25040]: audit 2024-09-14T03:43:22.117444+0000 mgr.a (mgr.14355) 13946 : audit [DBG] from='client.302811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:25 smithi007 bash[22722]: cluster 2024-09-14T03:43:23.539610+0000 mgr.a (mgr.14355) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:25 smithi131 bash[24745]: cluster 2024-09-14T03:43:23.539610+0000 mgr.a (mgr.14355) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:25 smithi171 bash[25040]: cluster 2024-09-14T03:43:23.539610+0000 mgr.a (mgr.14355) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:27.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:27 smithi007 bash[22722]: cluster 2024-09-14T03:43:25.541877+0000 mgr.a (mgr.14355) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:27 smithi131 bash[24745]: cluster 2024-09-14T03:43:25.541877+0000 mgr.a (mgr.14355) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:27 smithi171 bash[25040]: cluster 2024-09-14T03:43:25.541877+0000 mgr.a (mgr.14355) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:28.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:29 smithi007 bash[22722]: cluster 2024-09-14T03:43:27.542624+0000 mgr.a (mgr.14355) 13949 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:29.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:29 smithi007 bash[22722]: audit 2024-09-14T03:43:27.870235+0000 mgr.a (mgr.14355) 13950 : audit [DBG] from='client.302889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:29 smithi131 bash[24745]: cluster 2024-09-14T03:43:27.542624+0000 mgr.a (mgr.14355) 13949 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:29 smithi131 bash[24745]: audit 2024-09-14T03:43:27.870235+0000 mgr.a (mgr.14355) 13950 : audit [DBG] from='client.302889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:29 smithi171 bash[25040]: cluster 2024-09-14T03:43:27.542624+0000 mgr.a (mgr.14355) 13949 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:29 smithi171 bash[25040]: audit 2024-09-14T03:43:27.870235+0000 mgr.a (mgr.14355) 13950 : audit [DBG] from='client.302889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:31 smithi007 bash[22722]: cluster 2024-09-14T03:43:29.543554+0000 mgr.a (mgr.14355) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:31 smithi131 bash[24745]: cluster 2024-09-14T03:43:29.543554+0000 mgr.a (mgr.14355) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:31 smithi171 bash[25040]: cluster 2024-09-14T03:43:29.543554+0000 mgr.a (mgr.14355) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:33.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:33.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:33.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:33 smithi007 bash[22722]: cluster 2024-09-14T03:43:31.545812+0000 mgr.a (mgr.14355) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:33 smithi131 bash[24745]: cluster 2024-09-14T03:43:31.545812+0000 mgr.a (mgr.14355) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:33 smithi171 bash[25040]: cluster 2024-09-14T03:43:31.545812+0000 mgr.a (mgr.14355) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:34.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:34.072 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:35 smithi007 bash[22722]: cluster 2024-09-14T03:43:33.546536+0000 mgr.a (mgr.14355) 13953 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:35 smithi007 bash[22722]: audit 2024-09-14T03:43:33.634187+0000 mgr.a (mgr.14355) 13954 : audit [DBG] from='client.302964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:35 smithi131 bash[24745]: cluster 2024-09-14T03:43:33.546536+0000 mgr.a (mgr.14355) 13953 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:35 smithi131 bash[24745]: audit 2024-09-14T03:43:33.634187+0000 mgr.a (mgr.14355) 13954 : audit [DBG] from='client.302964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:35 smithi171 bash[25040]: cluster 2024-09-14T03:43:33.546536+0000 mgr.a (mgr.14355) 13953 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:35 smithi171 bash[25040]: audit 2024-09-14T03:43:33.634187+0000 mgr.a (mgr.14355) 13954 : audit [DBG] from='client.302964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:37 smithi131 bash[24745]: cluster 2024-09-14T03:43:35.548983+0000 mgr.a (mgr.14355) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:37 smithi171 bash[25040]: cluster 2024-09-14T03:43:35.548983+0000 mgr.a (mgr.14355) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:37 smithi007 bash[22722]: cluster 2024-09-14T03:43:35.548983+0000 mgr.a (mgr.14355) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:39.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:39.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:39 smithi131 bash[24745]: cluster 2024-09-14T03:43:37.549858+0000 mgr.a (mgr.14355) 13956 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:39 smithi171 bash[25040]: cluster 2024-09-14T03:43:37.549858+0000 mgr.a (mgr.14355) 13956 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:39.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:39.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:39 smithi007 bash[22722]: cluster 2024-09-14T03:43:37.549858+0000 mgr.a (mgr.14355) 13956 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:40 smithi131 bash[24745]: audit 2024-09-14T03:43:39.406166+0000 mgr.a (mgr.14355) 13957 : audit [DBG] from='client.303042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:40 smithi171 bash[25040]: audit 2024-09-14T03:43:39.406166+0000 mgr.a (mgr.14355) 13957 : audit [DBG] from='client.303042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:40 smithi007 bash[22722]: audit 2024-09-14T03:43:39.406166+0000 mgr.a (mgr.14355) 13957 : audit [DBG] from='client.303042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:41 smithi131 bash[24745]: cluster 2024-09-14T03:43:39.550380+0000 mgr.a (mgr.14355) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:41 smithi171 bash[25040]: cluster 2024-09-14T03:43:39.550380+0000 mgr.a (mgr.14355) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:41 smithi007 bash[22722]: cluster 2024-09-14T03:43:39.550380+0000 mgr.a (mgr.14355) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:43 smithi131 bash[24745]: cluster 2024-09-14T03:43:41.552568+0000 mgr.a (mgr.14355) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:43 smithi171 bash[25040]: cluster 2024-09-14T03:43:41.552568+0000 mgr.a (mgr.14355) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:43 smithi007 bash[22722]: cluster 2024-09-14T03:43:41.552568+0000 mgr.a (mgr.14355) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:43:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:44.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:45.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:45 smithi131 bash[24745]: cluster 2024-09-14T03:43:43.553337+0000 mgr.a (mgr.14355) 13960 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:45 smithi171 bash[25040]: cluster 2024-09-14T03:43:43.553337+0000 mgr.a (mgr.14355) 13960 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:45 smithi007 bash[22722]: cluster 2024-09-14T03:43:43.553337+0000 mgr.a (mgr.14355) 13960 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:46 smithi131 bash[24745]: audit 2024-09-14T03:43:45.147097+0000 mgr.a (mgr.14355) 13961 : audit [DBG] from='client.303117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:46 smithi171 bash[25040]: audit 2024-09-14T03:43:45.147097+0000 mgr.a (mgr.14355) 13961 : audit [DBG] from='client.303117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:46 smithi007 bash[22722]: audit 2024-09-14T03:43:45.147097+0000 mgr.a (mgr.14355) 13961 : audit [DBG] from='client.303117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:47 smithi131 bash[24745]: cluster 2024-09-14T03:43:45.554608+0000 mgr.a (mgr.14355) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:47 smithi171 bash[25040]: cluster 2024-09-14T03:43:45.554608+0000 mgr.a (mgr.14355) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:47 smithi007 bash[22722]: cluster 2024-09-14T03:43:45.554608+0000 mgr.a (mgr.14355) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:49 smithi131 bash[24745]: cluster 2024-09-14T03:43:47.555283+0000 mgr.a (mgr.14355) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:49 smithi171 bash[25040]: cluster 2024-09-14T03:43:47.555283+0000 mgr.a (mgr.14355) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:49 smithi007 bash[22722]: cluster 2024-09-14T03:43:47.555283+0000 mgr.a (mgr.14355) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:50.574 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:51.351 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:51.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:51.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:51.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:51.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:51 smithi131 bash[24745]: cluster 2024-09-14T03:43:49.556056+0000 mgr.a (mgr.14355) 13964 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:51 smithi171 bash[25040]: cluster 2024-09-14T03:43:49.556056+0000 mgr.a (mgr.14355) 13964 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:51 smithi007 bash[22722]: cluster 2024-09-14T03:43:49.556056+0000 mgr.a (mgr.14355) 13964 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:52 smithi131 bash[24745]: audit 2024-09-14T03:43:50.906812+0000 mgr.a (mgr.14355) 13965 : audit [DBG] from='client.303195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:52 smithi171 bash[25040]: audit 2024-09-14T03:43:50.906812+0000 mgr.a (mgr.14355) 13965 : audit [DBG] from='client.303195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:52 smithi007 bash[22722]: audit 2024-09-14T03:43:50.906812+0000 mgr.a (mgr.14355) 13965 : audit [DBG] from='client.303195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:53 smithi131 bash[24745]: cluster 2024-09-14T03:43:51.558772+0000 mgr.a (mgr.14355) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:53 smithi171 bash[25040]: cluster 2024-09-14T03:43:51.558772+0000 mgr.a (mgr.14355) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:53 smithi007 bash[22722]: cluster 2024-09-14T03:43:51.558772+0000 mgr.a (mgr.14355) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:55 smithi131 bash[24745]: cluster 2024-09-14T03:43:53.559543+0000 mgr.a (mgr.14355) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:55 smithi171 bash[25040]: cluster 2024-09-14T03:43:53.559543+0000 mgr.a (mgr.14355) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:55 smithi007 bash[22722]: cluster 2024-09-14T03:43:53.559543+0000 mgr.a (mgr.14355) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:43:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:43:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:43:56.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:43:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:56 smithi131 bash[24745]: cluster 2024-09-14T03:43:55.561556+0000 mgr.a (mgr.14355) 13968 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:56 smithi171 bash[25040]: cluster 2024-09-14T03:43:55.561556+0000 mgr.a (mgr.14355) 13968 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:56 smithi007 bash[22722]: cluster 2024-09-14T03:43:55.561556+0000 mgr.a (mgr.14355) 13968 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:57.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:43:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:43:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:43:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:43:57.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:43:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:57 smithi131 bash[24745]: audit 2024-09-14T03:43:56.681976+0000 mgr.a (mgr.14355) 13969 : audit [DBG] from='client.303273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:57 smithi171 bash[25040]: audit 2024-09-14T03:43:56.681976+0000 mgr.a (mgr.14355) 13969 : audit [DBG] from='client.303273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:57 smithi007 bash[22722]: audit 2024-09-14T03:43:56.681976+0000 mgr.a (mgr.14355) 13969 : audit [DBG] from='client.303273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:43:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:58 smithi131 bash[24745]: cluster 2024-09-14T03:43:57.562454+0000 mgr.a (mgr.14355) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:58 smithi171 bash[25040]: cluster 2024-09-14T03:43:57.562454+0000 mgr.a (mgr.14355) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:58 smithi007 bash[22722]: cluster 2024-09-14T03:43:57.562454+0000 mgr.a (mgr.14355) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:58.527998+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:59.373760+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:59.374908+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:59.383264+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:59.387969+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:43:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:43:59 smithi131 bash[24745]: audit 2024-09-14T03:43:59.390365+0000 mgr.a (mgr.14355) 13971 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:43:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:58.527998+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:43:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:59.373760+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:43:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:59.374908+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:43:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:59.383264+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:43:59.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:59.387969+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:43:59.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:43:59 smithi171 bash[25040]: audit 2024-09-14T03:43:59.390365+0000 mgr.a (mgr.14355) 13971 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:43:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:58.527998+0000 mon.a (mon.0) 2677 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:43:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:59.373760+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:43:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:59.374908+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:43:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:59.383264+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:43:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:59.387969+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:43:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:43:59 smithi007 bash[22722]: audit 2024-09-14T03:43:59.390365+0000 mgr.a (mgr.14355) 13971 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:44:00.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:44:00 smithi007 bash[22972]: debug 2024-09-14T03:44:00.116+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:44:00.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:44:00 smithi007 bash[22972]: debug 2024-09-14T03:44:00.116+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:44:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:00 smithi171 bash[25040]: cluster 2024-09-14T03:43:59.562975+0000 mgr.a (mgr.14355) 13972 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:00 smithi171 bash[25040]: audit 2024-09-14T03:44:00.120417+0000 mgr.a (mgr.14355) 13973 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:44:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:00 smithi171 bash[25040]: cephadm 2024-09-14T03:44:00.121742+0000 mgr.a (mgr.14355) 13974 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:44:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:00 smithi007 bash[22722]: cluster 2024-09-14T03:43:59.562975+0000 mgr.a (mgr.14355) 13972 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:00 smithi007 bash[22722]: audit 2024-09-14T03:44:00.120417+0000 mgr.a (mgr.14355) 13973 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:44:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:00 smithi007 bash[22722]: cephadm 2024-09-14T03:44:00.121742+0000 mgr.a (mgr.14355) 13974 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:44:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:00 smithi131 bash[24745]: cluster 2024-09-14T03:43:59.562975+0000 mgr.a (mgr.14355) 13972 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:00 smithi131 bash[24745]: audit 2024-09-14T03:44:00.120417+0000 mgr.a (mgr.14355) 13973 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:44:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:00 smithi131 bash[24745]: cephadm 2024-09-14T03:44:00.121742+0000 mgr.a (mgr.14355) 13974 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:44:02.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:02.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:02.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:02.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:02.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:02.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:02.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:02.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:02 smithi007 bash[22722]: cluster 2024-09-14T03:44:01.565273+0000 mgr.a (mgr.14355) 13975 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:02 smithi007 bash[22722]: audit 2024-09-14T03:44:02.428727+0000 mgr.a (mgr.14355) 13976 : audit [DBG] from='client.303459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:02 smithi131 bash[24745]: cluster 2024-09-14T03:44:01.565273+0000 mgr.a (mgr.14355) 13975 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:02 smithi131 bash[24745]: audit 2024-09-14T03:44:02.428727+0000 mgr.a (mgr.14355) 13976 : audit [DBG] from='client.303459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:03.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:02 smithi171 bash[25040]: cluster 2024-09-14T03:44:01.565273+0000 mgr.a (mgr.14355) 13975 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:03.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:02 smithi171 bash[25040]: audit 2024-09-14T03:44:02.428727+0000 mgr.a (mgr.14355) 13976 : audit [DBG] from='client.303459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:04 smithi007 bash[22722]: cluster 2024-09-14T03:44:03.566171+0000 mgr.a (mgr.14355) 13977 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:04 smithi131 bash[24745]: cluster 2024-09-14T03:44:03.566171+0000 mgr.a (mgr.14355) 13977 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:04 smithi171 bash[25040]: cluster 2024-09-14T03:44:03.566171+0000 mgr.a (mgr.14355) 13977 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:06 smithi007 bash[22722]: cluster 2024-09-14T03:44:05.568334+0000 mgr.a (mgr.14355) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:06 smithi131 bash[24745]: cluster 2024-09-14T03:44:05.568334+0000 mgr.a (mgr.14355) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:06 smithi171 bash[25040]: cluster 2024-09-14T03:44:05.568334+0000 mgr.a (mgr.14355) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:07.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:07.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:07.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:08.600 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:08 smithi007 bash[22722]: cluster 2024-09-14T03:44:07.569094+0000 mgr.a (mgr.14355) 13979 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:08 smithi007 bash[22722]: audit 2024-09-14T03:44:08.187979+0000 mgr.a (mgr.14355) 13980 : audit [DBG] from='client.303537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:08 smithi131 bash[24745]: cluster 2024-09-14T03:44:07.569094+0000 mgr.a (mgr.14355) 13979 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:08 smithi131 bash[24745]: audit 2024-09-14T03:44:08.187979+0000 mgr.a (mgr.14355) 13980 : audit [DBG] from='client.303537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:08 smithi171 bash[25040]: cluster 2024-09-14T03:44:07.569094+0000 mgr.a (mgr.14355) 13979 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:08 smithi171 bash[25040]: audit 2024-09-14T03:44:08.187979+0000 mgr.a (mgr.14355) 13980 : audit [DBG] from='client.303537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:10 smithi007 bash[22722]: cluster 2024-09-14T03:44:09.569969+0000 mgr.a (mgr.14355) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:10 smithi131 bash[24745]: cluster 2024-09-14T03:44:09.569969+0000 mgr.a (mgr.14355) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:10 smithi171 bash[25040]: cluster 2024-09-14T03:44:09.569969+0000 mgr.a (mgr.14355) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:12 smithi007 bash[22722]: cluster 2024-09-14T03:44:11.572242+0000 mgr.a (mgr.14355) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:12 smithi131 bash[24745]: cluster 2024-09-14T03:44:11.572242+0000 mgr.a (mgr.14355) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:12 smithi171 bash[25040]: cluster 2024-09-14T03:44:11.572242+0000 mgr.a (mgr.14355) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:44:13.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:14.380 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:14.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:14.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:14.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:14.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:14 smithi007 bash[22722]: cluster 2024-09-14T03:44:13.573004+0000 mgr.a (mgr.14355) 13983 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:14 smithi007 bash[22722]: audit 2024-09-14T03:44:13.936580+0000 mgr.a (mgr.14355) 13984 : audit [DBG] from='client.303609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:14 smithi131 bash[24745]: cluster 2024-09-14T03:44:13.573004+0000 mgr.a (mgr.14355) 13983 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:14 smithi131 bash[24745]: audit 2024-09-14T03:44:13.936580+0000 mgr.a (mgr.14355) 13984 : audit [DBG] from='client.303609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:14 smithi171 bash[25040]: cluster 2024-09-14T03:44:13.573004+0000 mgr.a (mgr.14355) 13983 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:14 smithi171 bash[25040]: audit 2024-09-14T03:44:13.936580+0000 mgr.a (mgr.14355) 13984 : audit [DBG] from='client.303609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:16 smithi007 bash[22722]: cluster 2024-09-14T03:44:15.575364+0000 mgr.a (mgr.14355) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:16 smithi131 bash[24745]: cluster 2024-09-14T03:44:15.575364+0000 mgr.a (mgr.14355) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:16 smithi171 bash[25040]: cluster 2024-09-14T03:44:15.575364+0000 mgr.a (mgr.14355) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:18 smithi007 bash[22722]: cluster 2024-09-14T03:44:17.576148+0000 mgr.a (mgr.14355) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:18 smithi131 bash[24745]: cluster 2024-09-14T03:44:17.576148+0000 mgr.a (mgr.14355) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:18 smithi171 bash[25040]: cluster 2024-09-14T03:44:17.576148+0000 mgr.a (mgr.14355) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:19.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:19.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:20.167 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:20.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:20 smithi007 bash[22722]: cluster 2024-09-14T03:44:19.576677+0000 mgr.a (mgr.14355) 13987 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:20 smithi007 bash[22722]: audit 2024-09-14T03:44:19.717112+0000 mgr.a (mgr.14355) 13988 : audit [DBG] from='client.303687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:20 smithi131 bash[24745]: cluster 2024-09-14T03:44:19.576677+0000 mgr.a (mgr.14355) 13987 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:20 smithi131 bash[24745]: audit 2024-09-14T03:44:19.717112+0000 mgr.a (mgr.14355) 13988 : audit [DBG] from='client.303687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:20 smithi171 bash[25040]: cluster 2024-09-14T03:44:19.576677+0000 mgr.a (mgr.14355) 13987 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:20 smithi171 bash[25040]: audit 2024-09-14T03:44:19.717112+0000 mgr.a (mgr.14355) 13988 : audit [DBG] from='client.303687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:22 smithi007 bash[22722]: cluster 2024-09-14T03:44:21.579266+0000 mgr.a (mgr.14355) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:22 smithi131 bash[24745]: cluster 2024-09-14T03:44:21.579266+0000 mgr.a (mgr.14355) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:22 smithi171 bash[25040]: cluster 2024-09-14T03:44:21.579266+0000 mgr.a (mgr.14355) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:24 smithi007 bash[22722]: cluster 2024-09-14T03:44:23.580259+0000 mgr.a (mgr.14355) 13990 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:24 smithi131 bash[24745]: cluster 2024-09-14T03:44:23.580259+0000 mgr.a (mgr.14355) 13990 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:24 smithi171 bash[25040]: cluster 2024-09-14T03:44:23.580259+0000 mgr.a (mgr.14355) 13990 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:25.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:25.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:25.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:25.949 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:25 smithi007 bash[22722]: audit 2024-09-14T03:44:25.503975+0000 mgr.a (mgr.14355) 13991 : audit [DBG] from='client.303765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:25 smithi131 bash[24745]: audit 2024-09-14T03:44:25.503975+0000 mgr.a (mgr.14355) 13991 : audit [DBG] from='client.303765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:25 smithi171 bash[25040]: audit 2024-09-14T03:44:25.503975+0000 mgr.a (mgr.14355) 13991 : audit [DBG] from='client.303765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:26 smithi007 bash[22722]: cluster 2024-09-14T03:44:25.581899+0000 mgr.a (mgr.14355) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:26 smithi131 bash[24745]: cluster 2024-09-14T03:44:25.581899+0000 mgr.a (mgr.14355) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:26 smithi171 bash[25040]: cluster 2024-09-14T03:44:25.581899+0000 mgr.a (mgr.14355) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:28 smithi007 bash[22722]: cluster 2024-09-14T03:44:27.582837+0000 mgr.a (mgr.14355) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:44:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:28 smithi131 bash[24745]: cluster 2024-09-14T03:44:27.582837+0000 mgr.a (mgr.14355) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:44:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:28 smithi171 bash[25040]: cluster 2024-09-14T03:44:27.582837+0000 mgr.a (mgr.14355) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:44:30.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:30.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:30 smithi007 bash[22722]: cluster 2024-09-14T03:44:29.583641+0000 mgr.a (mgr.14355) 13994 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:30 smithi131 bash[24745]: cluster 2024-09-14T03:44:29.583641+0000 mgr.a (mgr.14355) 13994 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:30 smithi171 bash[25040]: cluster 2024-09-14T03:44:29.583641+0000 mgr.a (mgr.14355) 13994 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:31.716 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:31.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:31.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:31.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:31.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:31 smithi007 bash[22722]: audit 2024-09-14T03:44:31.282406+0000 mgr.a (mgr.14355) 13995 : audit [DBG] from='client.303840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:31 smithi131 bash[24745]: audit 2024-09-14T03:44:31.282406+0000 mgr.a (mgr.14355) 13995 : audit [DBG] from='client.303840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:31 smithi171 bash[25040]: audit 2024-09-14T03:44:31.282406+0000 mgr.a (mgr.14355) 13995 : audit [DBG] from='client.303840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:32 smithi007 bash[22722]: cluster 2024-09-14T03:44:31.584874+0000 mgr.a (mgr.14355) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:32 smithi131 bash[24745]: cluster 2024-09-14T03:44:31.584874+0000 mgr.a (mgr.14355) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:32 smithi171 bash[25040]: cluster 2024-09-14T03:44:31.584874+0000 mgr.a (mgr.14355) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:34 smithi131 bash[24745]: cluster 2024-09-14T03:44:33.585732+0000 mgr.a (mgr.14355) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:34 smithi171 bash[25040]: cluster 2024-09-14T03:44:33.585732+0000 mgr.a (mgr.14355) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:34 smithi007 bash[22722]: cluster 2024-09-14T03:44:33.585732+0000 mgr.a (mgr.14355) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:44:36.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:36.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:36 smithi131 bash[24745]: cluster 2024-09-14T03:44:35.587954+0000 mgr.a (mgr.14355) 13998 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:36 smithi171 bash[25040]: cluster 2024-09-14T03:44:35.587954+0000 mgr.a (mgr.14355) 13998 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:36 smithi007 bash[22722]: cluster 2024-09-14T03:44:35.587954+0000 mgr.a (mgr.14355) 13998 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:37.500 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:37 smithi131 bash[24745]: audit 2024-09-14T03:44:37.050982+0000 mgr.a (mgr.14355) 13999 : audit [DBG] from='client.303909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:37 smithi171 bash[25040]: audit 2024-09-14T03:44:37.050982+0000 mgr.a (mgr.14355) 13999 : audit [DBG] from='client.303909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:37 smithi007 bash[22722]: audit 2024-09-14T03:44:37.050982+0000 mgr.a (mgr.14355) 13999 : audit [DBG] from='client.303909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:38 smithi131 bash[24745]: cluster 2024-09-14T03:44:37.588942+0000 mgr.a (mgr.14355) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:38 smithi171 bash[25040]: cluster 2024-09-14T03:44:37.588942+0000 mgr.a (mgr.14355) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:38 smithi007 bash[22722]: cluster 2024-09-14T03:44:37.588942+0000 mgr.a (mgr.14355) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:41 smithi007 bash[22722]: cluster 2024-09-14T03:44:39.589790+0000 mgr.a (mgr.14355) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:41 smithi131 bash[24745]: cluster 2024-09-14T03:44:39.589790+0000 mgr.a (mgr.14355) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:41 smithi171 bash[25040]: cluster 2024-09-14T03:44:39.589790+0000 mgr.a (mgr.14355) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:42.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:42.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:42.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:43.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:43.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:43.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:43 smithi007 bash[22722]: cluster 2024-09-14T03:44:41.592269+0000 mgr.a (mgr.14355) 14002 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:43 smithi131 bash[24745]: cluster 2024-09-14T03:44:41.592269+0000 mgr.a (mgr.14355) 14002 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:43 smithi171 bash[25040]: cluster 2024-09-14T03:44:41.592269+0000 mgr.a (mgr.14355) 14002 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:44 smithi007 bash[22722]: audit 2024-09-14T03:44:42.840126+0000 mgr.a (mgr.14355) 14003 : audit [DBG] from='client.303984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:44 smithi131 bash[24745]: audit 2024-09-14T03:44:42.840126+0000 mgr.a (mgr.14355) 14003 : audit [DBG] from='client.303984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:44 smithi171 bash[25040]: audit 2024-09-14T03:44:42.840126+0000 mgr.a (mgr.14355) 14003 : audit [DBG] from='client.303984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:45 smithi007 bash[22722]: cluster 2024-09-14T03:44:43.593269+0000 mgr.a (mgr.14355) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:45 smithi131 bash[24745]: cluster 2024-09-14T03:44:43.593269+0000 mgr.a (mgr.14355) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:45 smithi171 bash[25040]: cluster 2024-09-14T03:44:43.593269+0000 mgr.a (mgr.14355) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:47 smithi007 bash[22722]: cluster 2024-09-14T03:44:45.595471+0000 mgr.a (mgr.14355) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:47 smithi131 bash[24745]: cluster 2024-09-14T03:44:45.595471+0000 mgr.a (mgr.14355) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:47 smithi171 bash[25040]: cluster 2024-09-14T03:44:45.595471+0000 mgr.a (mgr.14355) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:48.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:48.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:49.024 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:49 smithi007 bash[22722]: cluster 2024-09-14T03:44:47.596328+0000 mgr.a (mgr.14355) 14006 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:49 smithi131 bash[24745]: cluster 2024-09-14T03:44:47.596328+0000 mgr.a (mgr.14355) 14006 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:49 smithi171 bash[25040]: cluster 2024-09-14T03:44:47.596328+0000 mgr.a (mgr.14355) 14006 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:50 smithi007 bash[22722]: audit 2024-09-14T03:44:48.612586+0000 mgr.a (mgr.14355) 14007 : audit [DBG] from='client.304062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:50 smithi131 bash[24745]: audit 2024-09-14T03:44:48.612586+0000 mgr.a (mgr.14355) 14007 : audit [DBG] from='client.304062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:50 smithi171 bash[25040]: audit 2024-09-14T03:44:48.612586+0000 mgr.a (mgr.14355) 14007 : audit [DBG] from='client.304062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:51 smithi007 bash[22722]: cluster 2024-09-14T03:44:49.597483+0000 mgr.a (mgr.14355) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:51 smithi131 bash[24745]: cluster 2024-09-14T03:44:49.597483+0000 mgr.a (mgr.14355) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:51 smithi171 bash[25040]: cluster 2024-09-14T03:44:49.597483+0000 mgr.a (mgr.14355) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:53 smithi007 bash[22722]: cluster 2024-09-14T03:44:51.599799+0000 mgr.a (mgr.14355) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:53 smithi131 bash[24745]: cluster 2024-09-14T03:44:51.599799+0000 mgr.a (mgr.14355) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:53 smithi171 bash[25040]: cluster 2024-09-14T03:44:51.599799+0000 mgr.a (mgr.14355) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:54.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:54.026 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:54.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:54.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:44:54.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:44:54.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:44:54.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:44:54.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:44:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:55 smithi007 bash[22722]: cluster 2024-09-14T03:44:53.600719+0000 mgr.a (mgr.14355) 14010 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:55 smithi007 bash[22722]: audit 2024-09-14T03:44:54.357169+0000 mgr.a (mgr.14355) 14011 : audit [DBG] from='client.304140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:55 smithi131 bash[24745]: cluster 2024-09-14T03:44:53.600719+0000 mgr.a (mgr.14355) 14010 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:55 smithi131 bash[24745]: audit 2024-09-14T03:44:54.357169+0000 mgr.a (mgr.14355) 14011 : audit [DBG] from='client.304140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:55 smithi171 bash[25040]: cluster 2024-09-14T03:44:53.600719+0000 mgr.a (mgr.14355) 14010 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:55 smithi171 bash[25040]: audit 2024-09-14T03:44:54.357169+0000 mgr.a (mgr.14355) 14011 : audit [DBG] from='client.304140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:44:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:57 smithi007 bash[22722]: cluster 2024-09-14T03:44:55.603153+0000 mgr.a (mgr.14355) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:57 smithi131 bash[24745]: cluster 2024-09-14T03:44:55.603153+0000 mgr.a (mgr.14355) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:57 smithi171 bash[25040]: cluster 2024-09-14T03:44:55.603153+0000 mgr.a (mgr.14355) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:44:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:44:59 smithi007 bash[22722]: cluster 2024-09-14T03:44:57.603945+0000 mgr.a (mgr.14355) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:59.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:44:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:44:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:44:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:44:59 smithi131 bash[24745]: cluster 2024-09-14T03:44:57.603945+0000 mgr.a (mgr.14355) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:44:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:44:59 smithi171 bash[25040]: cluster 2024-09-14T03:44:57.603945+0000 mgr.a (mgr.14355) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:00.550 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:00.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:00 smithi007 bash[22722]: audit 2024-09-14T03:45:00.174698+0000 mon.a (mon.0) 2682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:45:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:00 smithi131 bash[24745]: audit 2024-09-14T03:45:00.174698+0000 mon.a (mon.0) 2682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:45:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:00 smithi171 bash[25040]: audit 2024-09-14T03:45:00.174698+0000 mon.a (mon.0) 2682 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:45:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: cluster 2024-09-14T03:44:59.604714+0000 mgr.a (mgr.14355) 14014 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: audit 2024-09-14T03:45:00.119895+0000 mgr.a (mgr.14355) 14015 : audit [DBG] from='client.304215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: audit 2024-09-14T03:45:00.975053+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:45:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: audit 2024-09-14T03:45:00.976735+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:45:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: audit 2024-09-14T03:45:00.986764+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:45:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22722]: audit 2024-09-14T03:45:00.991674+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: cluster 2024-09-14T03:44:59.604714+0000 mgr.a (mgr.14355) 14014 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: audit 2024-09-14T03:45:00.119895+0000 mgr.a (mgr.14355) 14015 : audit [DBG] from='client.304215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: audit 2024-09-14T03:45:00.975053+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:45:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: audit 2024-09-14T03:45:00.976735+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:45:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: audit 2024-09-14T03:45:00.986764+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:45:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:01 smithi131 bash[24745]: audit 2024-09-14T03:45:00.991674+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: cluster 2024-09-14T03:44:59.604714+0000 mgr.a (mgr.14355) 14014 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: audit 2024-09-14T03:45:00.119895+0000 mgr.a (mgr.14355) 14015 : audit [DBG] from='client.304215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: audit 2024-09-14T03:45:00.975053+0000 mon.a (mon.0) 2683 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: audit 2024-09-14T03:45:00.976735+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: audit 2024-09-14T03:45:00.986764+0000 mon.a (mon.0) 2685 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:45:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:01 smithi171 bash[25040]: audit 2024-09-14T03:45:00.991674+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22972]: debug 2024-09-14T03:45:01.707+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:45:02.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:45:01 smithi007 bash[22972]: debug 2024-09-14T03:45:01.707+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:45:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:02 smithi007 bash[22722]: audit 2024-09-14T03:45:00.994499+0000 mgr.a (mgr.14355) 14016 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:02 smithi131 bash[24745]: audit 2024-09-14T03:45:00.994499+0000 mgr.a (mgr.14355) 14016 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:02 smithi171 bash[25040]: audit 2024-09-14T03:45:00.994499+0000 mgr.a (mgr.14355) 14016 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:45:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:03 smithi007 bash[22722]: cluster 2024-09-14T03:45:01.605895+0000 mgr.a (mgr.14355) 14017 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:03 smithi007 bash[22722]: audit 2024-09-14T03:45:01.711424+0000 mgr.a (mgr.14355) 14018 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:45:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:03 smithi007 bash[22722]: cephadm 2024-09-14T03:45:01.713048+0000 mgr.a (mgr.14355) 14019 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:45:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:03 smithi131 bash[24745]: cluster 2024-09-14T03:45:01.605895+0000 mgr.a (mgr.14355) 14017 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:03 smithi131 bash[24745]: audit 2024-09-14T03:45:01.711424+0000 mgr.a (mgr.14355) 14018 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:45:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:03 smithi131 bash[24745]: cephadm 2024-09-14T03:45:01.713048+0000 mgr.a (mgr.14355) 14019 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:45:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:03 smithi171 bash[25040]: cluster 2024-09-14T03:45:01.605895+0000 mgr.a (mgr.14355) 14017 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:03 smithi171 bash[25040]: audit 2024-09-14T03:45:01.711424+0000 mgr.a (mgr.14355) 14018 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:45:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:03 smithi171 bash[25040]: cephadm 2024-09-14T03:45:01.713048+0000 mgr.a (mgr.14355) 14019 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:45:05.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:05.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:05.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:05 smithi007 bash[22722]: cluster 2024-09-14T03:45:03.606582+0000 mgr.a (mgr.14355) 14020 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:05 smithi131 bash[24745]: cluster 2024-09-14T03:45:03.606582+0000 mgr.a (mgr.14355) 14020 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:05 smithi171 bash[25040]: cluster 2024-09-14T03:45:03.606582+0000 mgr.a (mgr.14355) 14020 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:06.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:06.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:07 smithi007 bash[22722]: cluster 2024-09-14T03:45:05.607946+0000 mgr.a (mgr.14355) 14021 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:07 smithi007 bash[22722]: audit 2024-09-14T03:45:05.891329+0000 mgr.a (mgr.14355) 14022 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:07 smithi131 bash[24745]: cluster 2024-09-14T03:45:05.607946+0000 mgr.a (mgr.14355) 14021 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:07 smithi131 bash[24745]: audit 2024-09-14T03:45:05.891329+0000 mgr.a (mgr.14355) 14022 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:07 smithi171 bash[25040]: cluster 2024-09-14T03:45:05.607946+0000 mgr.a (mgr.14355) 14021 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:07 smithi171 bash[25040]: audit 2024-09-14T03:45:05.891329+0000 mgr.a (mgr.14355) 14022 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:09 smithi007 bash[22722]: cluster 2024-09-14T03:45:07.608873+0000 mgr.a (mgr.14355) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:09 smithi131 bash[24745]: cluster 2024-09-14T03:45:07.608873+0000 mgr.a (mgr.14355) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:09 smithi171 bash[25040]: cluster 2024-09-14T03:45:07.608873+0000 mgr.a (mgr.14355) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:11.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:11.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:11 smithi007 bash[22722]: cluster 2024-09-14T03:45:09.609698+0000 mgr.a (mgr.14355) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:11 smithi131 bash[24745]: cluster 2024-09-14T03:45:09.609698+0000 mgr.a (mgr.14355) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:11 smithi171 bash[25040]: cluster 2024-09-14T03:45:09.609698+0000 mgr.a (mgr.14355) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:45:12.126 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:12.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:13 smithi007 bash[22722]: cluster 2024-09-14T03:45:11.611882+0000 mgr.a (mgr.14355) 14025 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:13 smithi007 bash[22722]: audit 2024-09-14T03:45:11.679284+0000 mgr.a (mgr.14355) 14026 : audit [DBG] from='client.304476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:13 smithi131 bash[24745]: cluster 2024-09-14T03:45:11.611882+0000 mgr.a (mgr.14355) 14025 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:13 smithi131 bash[24745]: audit 2024-09-14T03:45:11.679284+0000 mgr.a (mgr.14355) 14026 : audit [DBG] from='client.304476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:13 smithi171 bash[25040]: cluster 2024-09-14T03:45:11.611882+0000 mgr.a (mgr.14355) 14025 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:13 smithi171 bash[25040]: audit 2024-09-14T03:45:11.679284+0000 mgr.a (mgr.14355) 14026 : audit [DBG] from='client.304476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:15 smithi007 bash[22722]: cluster 2024-09-14T03:45:13.612813+0000 mgr.a (mgr.14355) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:15 smithi131 bash[24745]: cluster 2024-09-14T03:45:13.612813+0000 mgr.a (mgr.14355) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:15 smithi171 bash[25040]: cluster 2024-09-14T03:45:13.612813+0000 mgr.a (mgr.14355) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:17.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:17.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:17.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:17 smithi131 bash[24745]: cluster 2024-09-14T03:45:15.615041+0000 mgr.a (mgr.14355) 14028 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:17 smithi171 bash[25040]: cluster 2024-09-14T03:45:15.615041+0000 mgr.a (mgr.14355) 14028 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:17.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:17.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:17.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:17.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:17.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:17 smithi007 bash[22722]: cluster 2024-09-14T03:45:15.615041+0000 mgr.a (mgr.14355) 14028 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:45:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:18 smithi131 bash[24745]: audit 2024-09-14T03:45:17.458302+0000 mgr.a (mgr.14355) 14029 : audit [DBG] from='client.304554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:18 smithi171 bash[25040]: audit 2024-09-14T03:45:17.458302+0000 mgr.a (mgr.14355) 14029 : audit [DBG] from='client.304554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:18.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:18 smithi007 bash[22722]: audit 2024-09-14T03:45:17.458302+0000 mgr.a (mgr.14355) 14029 : audit [DBG] from='client.304554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:19 smithi131 bash[24745]: cluster 2024-09-14T03:45:17.615562+0000 mgr.a (mgr.14355) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:19 smithi171 bash[25040]: cluster 2024-09-14T03:45:17.615562+0000 mgr.a (mgr.14355) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:19 smithi007 bash[22722]: cluster 2024-09-14T03:45:17.615562+0000 mgr.a (mgr.14355) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:21 smithi131 bash[24745]: cluster 2024-09-14T03:45:19.616453+0000 mgr.a (mgr.14355) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:21 smithi171 bash[25040]: cluster 2024-09-14T03:45:19.616453+0000 mgr.a (mgr.14355) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:21 smithi007 bash[22722]: cluster 2024-09-14T03:45:19.616453+0000 mgr.a (mgr.14355) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:22.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:23.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:23.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:23 smithi131 bash[24745]: cluster 2024-09-14T03:45:21.618719+0000 mgr.a (mgr.14355) 14032 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:23 smithi171 bash[25040]: cluster 2024-09-14T03:45:21.618719+0000 mgr.a (mgr.14355) 14032 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:23 smithi007 bash[22722]: cluster 2024-09-14T03:45:21.618719+0000 mgr.a (mgr.14355) 14032 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:24 smithi131 bash[24745]: audit 2024-09-14T03:45:23.218650+0000 mgr.a (mgr.14355) 14033 : audit [DBG] from='client.304629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:24 smithi171 bash[25040]: audit 2024-09-14T03:45:23.218650+0000 mgr.a (mgr.14355) 14033 : audit [DBG] from='client.304629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:24 smithi007 bash[22722]: audit 2024-09-14T03:45:23.218650+0000 mgr.a (mgr.14355) 14033 : audit [DBG] from='client.304629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:25 smithi131 bash[24745]: cluster 2024-09-14T03:45:23.619301+0000 mgr.a (mgr.14355) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:25 smithi171 bash[25040]: cluster 2024-09-14T03:45:23.619301+0000 mgr.a (mgr.14355) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:25.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:25 smithi007 bash[22722]: cluster 2024-09-14T03:45:23.619301+0000 mgr.a (mgr.14355) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:27 smithi131 bash[24745]: cluster 2024-09-14T03:45:25.621555+0000 mgr.a (mgr.14355) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:27 smithi171 bash[25040]: cluster 2024-09-14T03:45:25.621555+0000 mgr.a (mgr.14355) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:27 smithi007 bash[22722]: cluster 2024-09-14T03:45:25.621555+0000 mgr.a (mgr.14355) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:28.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:28.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:28.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:29.462 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:29 smithi131 bash[24745]: cluster 2024-09-14T03:45:27.622334+0000 mgr.a (mgr.14355) 14036 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:29 smithi171 bash[25040]: cluster 2024-09-14T03:45:27.622334+0000 mgr.a (mgr.14355) 14036 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:29 smithi007 bash[22722]: cluster 2024-09-14T03:45:27.622334+0000 mgr.a (mgr.14355) 14036 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:30 smithi131 bash[24745]: audit 2024-09-14T03:45:29.013658+0000 mgr.a (mgr.14355) 14037 : audit [DBG] from='client.304704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:30 smithi171 bash[25040]: audit 2024-09-14T03:45:29.013658+0000 mgr.a (mgr.14355) 14037 : audit [DBG] from='client.304704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:30 smithi007 bash[22722]: audit 2024-09-14T03:45:29.013658+0000 mgr.a (mgr.14355) 14037 : audit [DBG] from='client.304704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:31 smithi131 bash[24745]: cluster 2024-09-14T03:45:29.623237+0000 mgr.a (mgr.14355) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:31 smithi171 bash[25040]: cluster 2024-09-14T03:45:29.623237+0000 mgr.a (mgr.14355) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:31 smithi007 bash[22722]: cluster 2024-09-14T03:45:29.623237+0000 mgr.a (mgr.14355) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:33 smithi131 bash[24745]: cluster 2024-09-14T03:45:31.625478+0000 mgr.a (mgr.14355) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:33 smithi171 bash[25040]: cluster 2024-09-14T03:45:31.625478+0000 mgr.a (mgr.14355) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:33 smithi007 bash[22722]: cluster 2024-09-14T03:45:31.625478+0000 mgr.a (mgr.14355) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:34.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:34.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:35.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:35.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:35.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:35.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:35.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:35 smithi131 bash[24745]: cluster 2024-09-14T03:45:33.626257+0000 mgr.a (mgr.14355) 14040 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:35 smithi171 bash[25040]: cluster 2024-09-14T03:45:33.626257+0000 mgr.a (mgr.14355) 14040 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:35 smithi007 bash[22722]: cluster 2024-09-14T03:45:33.626257+0000 mgr.a (mgr.14355) 14040 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:36 smithi131 bash[24745]: audit 2024-09-14T03:45:34.797266+0000 mgr.a (mgr.14355) 14041 : audit [DBG] from='client.304779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:36 smithi171 bash[25040]: audit 2024-09-14T03:45:34.797266+0000 mgr.a (mgr.14355) 14041 : audit [DBG] from='client.304779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:36 smithi007 bash[22722]: audit 2024-09-14T03:45:34.797266+0000 mgr.a (mgr.14355) 14041 : audit [DBG] from='client.304779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:37 smithi131 bash[24745]: cluster 2024-09-14T03:45:35.628649+0000 mgr.a (mgr.14355) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:37 smithi171 bash[25040]: cluster 2024-09-14T03:45:35.628649+0000 mgr.a (mgr.14355) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:37 smithi007 bash[22722]: cluster 2024-09-14T03:45:35.628649+0000 mgr.a (mgr.14355) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:39 smithi131 bash[24745]: cluster 2024-09-14T03:45:37.629433+0000 mgr.a (mgr.14355) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:39 smithi171 bash[25040]: cluster 2024-09-14T03:45:37.629433+0000 mgr.a (mgr.14355) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:39 smithi007 bash[22722]: cluster 2024-09-14T03:45:37.629433+0000 mgr.a (mgr.14355) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:40.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:40.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:40.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:41.016 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:41.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:41 smithi131 bash[24745]: cluster 2024-09-14T03:45:39.630200+0000 mgr.a (mgr.14355) 14044 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:41 smithi171 bash[25040]: cluster 2024-09-14T03:45:39.630200+0000 mgr.a (mgr.14355) 14044 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:41 smithi007 bash[22722]: cluster 2024-09-14T03:45:39.630200+0000 mgr.a (mgr.14355) 14044 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:42 smithi171 bash[25040]: audit 2024-09-14T03:45:40.567454+0000 mgr.a (mgr.14355) 14045 : audit [DBG] from='client.304857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:42 smithi007 bash[22722]: audit 2024-09-14T03:45:40.567454+0000 mgr.a (mgr.14355) 14045 : audit [DBG] from='client.304857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:42 smithi131 bash[24745]: audit 2024-09-14T03:45:40.567454+0000 mgr.a (mgr.14355) 14045 : audit [DBG] from='client.304857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:43 smithi171 bash[25040]: cluster 2024-09-14T03:45:41.632962+0000 mgr.a (mgr.14355) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:43 smithi007 bash[22722]: cluster 2024-09-14T03:45:41.632962+0000 mgr.a (mgr.14355) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:43 smithi131 bash[24745]: cluster 2024-09-14T03:45:41.632962+0000 mgr.a (mgr.14355) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:44 smithi007 bash[22722]: cluster 2024-09-14T03:45:43.633777+0000 mgr.a (mgr.14355) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:44 smithi131 bash[24745]: cluster 2024-09-14T03:45:43.633777+0000 mgr.a (mgr.14355) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:44 smithi171 bash[25040]: cluster 2024-09-14T03:45:43.633777+0000 mgr.a (mgr.14355) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:46.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:46.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:46.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:46 smithi007 bash[22722]: cluster 2024-09-14T03:45:45.635766+0000 mgr.a (mgr.14355) 14048 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:46 smithi007 bash[22722]: audit 2024-09-14T03:45:46.351829+0000 mgr.a (mgr.14355) 14049 : audit [DBG] from='client.304935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:46 smithi131 bash[24745]: cluster 2024-09-14T03:45:45.635766+0000 mgr.a (mgr.14355) 14048 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:46 smithi131 bash[24745]: audit 2024-09-14T03:45:46.351829+0000 mgr.a (mgr.14355) 14049 : audit [DBG] from='client.304935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:46 smithi171 bash[25040]: cluster 2024-09-14T03:45:45.635766+0000 mgr.a (mgr.14355) 14048 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:46 smithi171 bash[25040]: audit 2024-09-14T03:45:46.351829+0000 mgr.a (mgr.14355) 14049 : audit [DBG] from='client.304935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:48 smithi007 bash[22722]: cluster 2024-09-14T03:45:47.636757+0000 mgr.a (mgr.14355) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:48 smithi131 bash[24745]: cluster 2024-09-14T03:45:47.636757+0000 mgr.a (mgr.14355) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:48 smithi171 bash[25040]: cluster 2024-09-14T03:45:47.636757+0000 mgr.a (mgr.14355) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:45:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:50 smithi007 bash[22722]: cluster 2024-09-14T03:45:49.637569+0000 mgr.a (mgr.14355) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:50 smithi131 bash[24745]: cluster 2024-09-14T03:45:49.637569+0000 mgr.a (mgr.14355) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:50 smithi171 bash[25040]: cluster 2024-09-14T03:45:49.637569+0000 mgr.a (mgr.14355) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:45:51.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:51.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:51.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:52.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:52 smithi131 bash[24745]: cluster 2024-09-14T03:45:51.639827+0000 mgr.a (mgr.14355) 14052 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:52 smithi131 bash[24745]: audit 2024-09-14T03:45:52.110321+0000 mgr.a (mgr.14355) 14053 : audit [DBG] from='client.305013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:52 smithi171 bash[25040]: cluster 2024-09-14T03:45:51.639827+0000 mgr.a (mgr.14355) 14052 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:52 smithi171 bash[25040]: audit 2024-09-14T03:45:52.110321+0000 mgr.a (mgr.14355) 14053 : audit [DBG] from='client.305013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:52 smithi007 bash[22722]: cluster 2024-09-14T03:45:51.639827+0000 mgr.a (mgr.14355) 14052 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:52 smithi007 bash[22722]: audit 2024-09-14T03:45:52.110321+0000 mgr.a (mgr.14355) 14053 : audit [DBG] from='client.305013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:54 smithi131 bash[24745]: cluster 2024-09-14T03:45:53.640722+0000 mgr.a (mgr.14355) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:54 smithi171 bash[25040]: cluster 2024-09-14T03:45:53.640722+0000 mgr.a (mgr.14355) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:54 smithi007 bash[22722]: cluster 2024-09-14T03:45:53.640722+0000 mgr.a (mgr.14355) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:56 smithi131 bash[24745]: cluster 2024-09-14T03:45:55.642878+0000 mgr.a (mgr.14355) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:56 smithi171 bash[25040]: cluster 2024-09-14T03:45:55.642878+0000 mgr.a (mgr.14355) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:56 smithi007 bash[22722]: cluster 2024-09-14T03:45:55.642878+0000 mgr.a (mgr.14355) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:45:57.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:45:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:45:57.535 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:45:58.316 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:45:58.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:45:58.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:45:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:45:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:45:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:58 smithi131 bash[24745]: cluster 2024-09-14T03:45:57.643413+0000 mgr.a (mgr.14355) 14056 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:45:58 smithi131 bash[24745]: audit 2024-09-14T03:45:57.869228+0000 mgr.a (mgr.14355) 14057 : audit [DBG] from='client.305091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:58 smithi171 bash[25040]: cluster 2024-09-14T03:45:57.643413+0000 mgr.a (mgr.14355) 14056 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:45:58 smithi171 bash[25040]: audit 2024-09-14T03:45:57.869228+0000 mgr.a (mgr.14355) 14057 : audit [DBG] from='client.305091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:45:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:58 smithi007 bash[22722]: cluster 2024-09-14T03:45:57.643413+0000 mgr.a (mgr.14355) 14056 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:45:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:45:58 smithi007 bash[22722]: audit 2024-09-14T03:45:57.869228+0000 mgr.a (mgr.14355) 14057 : audit [DBG] from='client.305091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:00 smithi131 bash[24745]: cluster 2024-09-14T03:45:59.644304+0000 mgr.a (mgr.14355) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:00 smithi171 bash[25040]: cluster 2024-09-14T03:45:59.644304+0000 mgr.a (mgr.14355) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:00 smithi007 bash[22722]: cluster 2024-09-14T03:45:59.644304+0000 mgr.a (mgr.14355) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: cluster 2024-09-14T03:46:01.646567+0000 mgr.a (mgr.14355) 14059 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: audit 2024-09-14T03:46:01.765474+0000 mon.a (mon.0) 2687 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:46:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: audit 2024-09-14T03:46:02.606538+0000 mon.a (mon.0) 2688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:46:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: audit 2024-09-14T03:46:02.608224+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:46:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: audit 2024-09-14T03:46:02.618558+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:46:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:02 smithi131 bash[24745]: audit 2024-09-14T03:46:02.621435+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: cluster 2024-09-14T03:46:01.646567+0000 mgr.a (mgr.14355) 14059 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: audit 2024-09-14T03:46:01.765474+0000 mon.a (mon.0) 2687 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: audit 2024-09-14T03:46:02.606538+0000 mon.a (mon.0) 2688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: audit 2024-09-14T03:46:02.608224+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: audit 2024-09-14T03:46:02.618558+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:46:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:02 smithi171 bash[25040]: audit 2024-09-14T03:46:02.621435+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: cluster 2024-09-14T03:46:01.646567+0000 mgr.a (mgr.14355) 14059 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: audit 2024-09-14T03:46:01.765474+0000 mon.a (mon.0) 2687 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:46:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: audit 2024-09-14T03:46:02.606538+0000 mon.a (mon.0) 2688 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:46:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: audit 2024-09-14T03:46:02.608224+0000 mon.a (mon.0) 2689 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:46:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: audit 2024-09-14T03:46:02.618558+0000 mon.a (mon.0) 2690 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:46:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:02 smithi007 bash[22722]: audit 2024-09-14T03:46:02.621435+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:03.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:03.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:46:03 smithi007 bash[22972]: debug 2024-09-14T03:46:03.358+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:46:03.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:46:03 smithi007 bash[22972]: debug 2024-09-14T03:46:03.362+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:46:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:03 smithi131 bash[24745]: audit 2024-09-14T03:46:02.623676+0000 mgr.a (mgr.14355) 14060 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:03 smithi131 bash[24745]: audit 2024-09-14T03:46:03.364957+0000 mgr.a (mgr.14355) 14061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:46:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:03 smithi131 bash[24745]: cephadm 2024-09-14T03:46:03.366476+0000 mgr.a (mgr.14355) 14062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:46:04.043 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:04.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:03 smithi171 bash[25040]: audit 2024-09-14T03:46:02.623676+0000 mgr.a (mgr.14355) 14060 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:03 smithi171 bash[25040]: audit 2024-09-14T03:46:03.364957+0000 mgr.a (mgr.14355) 14061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:46:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:03 smithi171 bash[25040]: cephadm 2024-09-14T03:46:03.366476+0000 mgr.a (mgr.14355) 14062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:46:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:03 smithi007 bash[22722]: audit 2024-09-14T03:46:02.623676+0000 mgr.a (mgr.14355) 14060 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:46:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:03 smithi007 bash[22722]: audit 2024-09-14T03:46:03.364957+0000 mgr.a (mgr.14355) 14061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:46:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:03 smithi007 bash[22722]: cephadm 2024-09-14T03:46:03.366476+0000 mgr.a (mgr.14355) 14062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:46:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:04 smithi131 bash[24745]: audit 2024-09-14T03:46:03.626328+0000 mgr.a (mgr.14355) 14063 : audit [DBG] from='client.305268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:04 smithi131 bash[24745]: cluster 2024-09-14T03:46:03.647782+0000 mgr.a (mgr.14355) 14064 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:04 smithi171 bash[25040]: audit 2024-09-14T03:46:03.626328+0000 mgr.a (mgr.14355) 14063 : audit [DBG] from='client.305268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:04 smithi171 bash[25040]: cluster 2024-09-14T03:46:03.647782+0000 mgr.a (mgr.14355) 14064 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:04 smithi007 bash[22722]: audit 2024-09-14T03:46:03.626328+0000 mgr.a (mgr.14355) 14063 : audit [DBG] from='client.305268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:04 smithi007 bash[22722]: cluster 2024-09-14T03:46:03.647782+0000 mgr.a (mgr.14355) 14064 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:06 smithi131 bash[24745]: cluster 2024-09-14T03:46:05.650121+0000 mgr.a (mgr.14355) 14065 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:06 smithi171 bash[25040]: cluster 2024-09-14T03:46:05.650121+0000 mgr.a (mgr.14355) 14065 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:06 smithi007 bash[22722]: cluster 2024-09-14T03:46:05.650121+0000 mgr.a (mgr.14355) 14065 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:08 smithi131 bash[24745]: cluster 2024-09-14T03:46:07.650878+0000 mgr.a (mgr.14355) 14066 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:09.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:09.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:08 smithi171 bash[25040]: cluster 2024-09-14T03:46:07.650878+0000 mgr.a (mgr.14355) 14066 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:08 smithi007 bash[22722]: cluster 2024-09-14T03:46:07.650878+0000 mgr.a (mgr.14355) 14066 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:09.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:09.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:09.823 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:09 smithi131 bash[24745]: audit 2024-09-14T03:46:09.378486+0000 mgr.a (mgr.14355) 14067 : audit [DBG] from='client.305343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:09 smithi171 bash[25040]: audit 2024-09-14T03:46:09.378486+0000 mgr.a (mgr.14355) 14067 : audit [DBG] from='client.305343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:09 smithi007 bash[22722]: audit 2024-09-14T03:46:09.378486+0000 mgr.a (mgr.14355) 14067 : audit [DBG] from='client.305343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:10 smithi131 bash[24745]: cluster 2024-09-14T03:46:09.651530+0000 mgr.a (mgr.14355) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:10 smithi171 bash[25040]: cluster 2024-09-14T03:46:09.651530+0000 mgr.a (mgr.14355) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:10 smithi007 bash[22722]: cluster 2024-09-14T03:46:09.651530+0000 mgr.a (mgr.14355) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:12 smithi131 bash[24745]: cluster 2024-09-14T03:46:11.653867+0000 mgr.a (mgr.14355) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:12 smithi171 bash[25040]: cluster 2024-09-14T03:46:11.653867+0000 mgr.a (mgr.14355) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:12 smithi007 bash[22722]: cluster 2024-09-14T03:46:11.653867+0000 mgr.a (mgr.14355) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:14.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:14.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:14.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:14 smithi131 bash[24745]: cluster 2024-09-14T03:46:13.654692+0000 mgr.a (mgr.14355) 14070 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:14 smithi171 bash[25040]: cluster 2024-09-14T03:46:13.654692+0000 mgr.a (mgr.14355) 14070 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:14 smithi007 bash[22722]: cluster 2024-09-14T03:46:13.654692+0000 mgr.a (mgr.14355) 14070 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:15.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:15.607 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:15 smithi131 bash[24745]: audit 2024-09-14T03:46:15.157088+0000 mgr.a (mgr.14355) 14071 : audit [DBG] from='client.305421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:15 smithi171 bash[25040]: audit 2024-09-14T03:46:15.157088+0000 mgr.a (mgr.14355) 14071 : audit [DBG] from='client.305421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:15 smithi007 bash[22722]: audit 2024-09-14T03:46:15.157088+0000 mgr.a (mgr.14355) 14071 : audit [DBG] from='client.305421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:16 smithi131 bash[24745]: cluster 2024-09-14T03:46:15.656015+0000 mgr.a (mgr.14355) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:16 smithi171 bash[25040]: cluster 2024-09-14T03:46:15.656015+0000 mgr.a (mgr.14355) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:16 smithi007 bash[22722]: cluster 2024-09-14T03:46:15.656015+0000 mgr.a (mgr.14355) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:46:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:18 smithi171 bash[25040]: cluster 2024-09-14T03:46:17.656907+0000 mgr.a (mgr.14355) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:18 smithi007 bash[22722]: cluster 2024-09-14T03:46:17.656907+0000 mgr.a (mgr.14355) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:18 smithi131 bash[24745]: cluster 2024-09-14T03:46:17.656907+0000 mgr.a (mgr.14355) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:20.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:20.608 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:20.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:20 smithi171 bash[25040]: cluster 2024-09-14T03:46:19.657842+0000 mgr.a (mgr.14355) 14074 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:20 smithi007 bash[22722]: cluster 2024-09-14T03:46:19.657842+0000 mgr.a (mgr.14355) 14074 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:20 smithi131 bash[24745]: cluster 2024-09-14T03:46:19.657842+0000 mgr.a (mgr.14355) 14074 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:21.390 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:21 smithi007 bash[22722]: audit 2024-09-14T03:46:20.950637+0000 mgr.a (mgr.14355) 14075 : audit [DBG] from='client.305499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:21 smithi131 bash[24745]: audit 2024-09-14T03:46:20.950637+0000 mgr.a (mgr.14355) 14075 : audit [DBG] from='client.305499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:21 smithi171 bash[25040]: audit 2024-09-14T03:46:20.950637+0000 mgr.a (mgr.14355) 14075 : audit [DBG] from='client.305499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:22 smithi007 bash[22722]: cluster 2024-09-14T03:46:21.660771+0000 mgr.a (mgr.14355) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:22 smithi131 bash[24745]: cluster 2024-09-14T03:46:21.660771+0000 mgr.a (mgr.14355) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:22 smithi171 bash[25040]: cluster 2024-09-14T03:46:21.660771+0000 mgr.a (mgr.14355) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:24 smithi007 bash[22722]: cluster 2024-09-14T03:46:23.661558+0000 mgr.a (mgr.14355) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:46:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:24 smithi131 bash[24745]: cluster 2024-09-14T03:46:23.661558+0000 mgr.a (mgr.14355) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:46:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:24 smithi171 bash[25040]: cluster 2024-09-14T03:46:23.661558+0000 mgr.a (mgr.14355) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:46:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:26.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:27.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:27.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:26 smithi007 bash[22722]: cluster 2024-09-14T03:46:25.663521+0000 mgr.a (mgr.14355) 14078 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:26 smithi131 bash[24745]: cluster 2024-09-14T03:46:25.663521+0000 mgr.a (mgr.14355) 14078 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:26 smithi171 bash[25040]: cluster 2024-09-14T03:46:25.663521+0000 mgr.a (mgr.14355) 14078 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:27 smithi007 bash[22722]: audit 2024-09-14T03:46:26.721787+0000 mgr.a (mgr.14355) 14079 : audit [DBG] from='client.305574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:27 smithi131 bash[24745]: audit 2024-09-14T03:46:26.721787+0000 mgr.a (mgr.14355) 14079 : audit [DBG] from='client.305574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:27 smithi171 bash[25040]: audit 2024-09-14T03:46:26.721787+0000 mgr.a (mgr.14355) 14079 : audit [DBG] from='client.305574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:28 smithi007 bash[22722]: cluster 2024-09-14T03:46:27.664450+0000 mgr.a (mgr.14355) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:28 smithi131 bash[24745]: cluster 2024-09-14T03:46:27.664450+0000 mgr.a (mgr.14355) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:28 smithi171 bash[25040]: cluster 2024-09-14T03:46:27.664450+0000 mgr.a (mgr.14355) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:30 smithi007 bash[22722]: cluster 2024-09-14T03:46:29.665234+0000 mgr.a (mgr.14355) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:30 smithi131 bash[24745]: cluster 2024-09-14T03:46:29.665234+0000 mgr.a (mgr.14355) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:30 smithi171 bash[25040]: cluster 2024-09-14T03:46:29.665234+0000 mgr.a (mgr.14355) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:32.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:32.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:32.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:32 smithi007 bash[22722]: cluster 2024-09-14T03:46:31.667500+0000 mgr.a (mgr.14355) 14082 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:32 smithi007 bash[22722]: audit 2024-09-14T03:46:32.491491+0000 mgr.a (mgr.14355) 14083 : audit [DBG] from='client.305649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:32 smithi131 bash[24745]: cluster 2024-09-14T03:46:31.667500+0000 mgr.a (mgr.14355) 14082 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:32 smithi131 bash[24745]: audit 2024-09-14T03:46:32.491491+0000 mgr.a (mgr.14355) 14083 : audit [DBG] from='client.305649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:32 smithi171 bash[25040]: cluster 2024-09-14T03:46:31.667500+0000 mgr.a (mgr.14355) 14082 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:32 smithi171 bash[25040]: audit 2024-09-14T03:46:32.491491+0000 mgr.a (mgr.14355) 14083 : audit [DBG] from='client.305649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:34 smithi007 bash[22722]: cluster 2024-09-14T03:46:33.668389+0000 mgr.a (mgr.14355) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:34 smithi131 bash[24745]: cluster 2024-09-14T03:46:33.668389+0000 mgr.a (mgr.14355) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:34 smithi171 bash[25040]: cluster 2024-09-14T03:46:33.668389+0000 mgr.a (mgr.14355) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:36 smithi007 bash[22722]: cluster 2024-09-14T03:46:35.670699+0000 mgr.a (mgr.14355) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:36 smithi131 bash[24745]: cluster 2024-09-14T03:46:35.670699+0000 mgr.a (mgr.14355) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:36 smithi171 bash[25040]: cluster 2024-09-14T03:46:35.670699+0000 mgr.a (mgr.14355) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:37.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:37.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:37.932 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:38.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:38 smithi007 bash[22722]: cluster 2024-09-14T03:46:37.671501+0000 mgr.a (mgr.14355) 14086 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:38 smithi007 bash[22722]: audit 2024-09-14T03:46:38.261851+0000 mgr.a (mgr.14355) 14087 : audit [DBG] from='client.305724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:38 smithi131 bash[24745]: cluster 2024-09-14T03:46:37.671501+0000 mgr.a (mgr.14355) 14086 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:38 smithi131 bash[24745]: audit 2024-09-14T03:46:38.261851+0000 mgr.a (mgr.14355) 14087 : audit [DBG] from='client.305724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:38 smithi171 bash[25040]: cluster 2024-09-14T03:46:37.671501+0000 mgr.a (mgr.14355) 14086 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:38 smithi171 bash[25040]: audit 2024-09-14T03:46:38.261851+0000 mgr.a (mgr.14355) 14087 : audit [DBG] from='client.305724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:40 smithi007 bash[22722]: cluster 2024-09-14T03:46:39.672545+0000 mgr.a (mgr.14355) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:40 smithi131 bash[24745]: cluster 2024-09-14T03:46:39.672545+0000 mgr.a (mgr.14355) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:40 smithi171 bash[25040]: cluster 2024-09-14T03:46:39.672545+0000 mgr.a (mgr.14355) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:42 smithi007 bash[22722]: cluster 2024-09-14T03:46:41.674978+0000 mgr.a (mgr.14355) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:42 smithi131 bash[24745]: cluster 2024-09-14T03:46:41.674978+0000 mgr.a (mgr.14355) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:42 smithi171 bash[25040]: cluster 2024-09-14T03:46:41.674978+0000 mgr.a (mgr.14355) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:43.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:43.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:43.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:44.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:44.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:44 smithi007 bash[22722]: cluster 2024-09-14T03:46:43.675913+0000 mgr.a (mgr.14355) 14090 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:44 smithi007 bash[22722]: audit 2024-09-14T03:46:44.022692+0000 mgr.a (mgr.14355) 14091 : audit [DBG] from='client.305802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:44 smithi131 bash[24745]: cluster 2024-09-14T03:46:43.675913+0000 mgr.a (mgr.14355) 14090 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:44 smithi131 bash[24745]: audit 2024-09-14T03:46:44.022692+0000 mgr.a (mgr.14355) 14091 : audit [DBG] from='client.305802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:44 smithi171 bash[25040]: cluster 2024-09-14T03:46:43.675913+0000 mgr.a (mgr.14355) 14090 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:44 smithi171 bash[25040]: audit 2024-09-14T03:46:44.022692+0000 mgr.a (mgr.14355) 14091 : audit [DBG] from='client.305802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:46 smithi007 bash[22722]: cluster 2024-09-14T03:46:45.678189+0000 mgr.a (mgr.14355) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:46 smithi131 bash[24745]: cluster 2024-09-14T03:46:45.678189+0000 mgr.a (mgr.14355) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:46 smithi171 bash[25040]: cluster 2024-09-14T03:46:45.678189+0000 mgr.a (mgr.14355) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:48 smithi007 bash[22722]: cluster 2024-09-14T03:46:47.678936+0000 mgr.a (mgr.14355) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:48 smithi131 bash[24745]: cluster 2024-09-14T03:46:47.678936+0000 mgr.a (mgr.14355) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:48 smithi171 bash[25040]: cluster 2024-09-14T03:46:47.678936+0000 mgr.a (mgr.14355) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:49.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:50.188 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:50.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:50.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:50.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:50.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:51 smithi007 bash[22722]: cluster 2024-09-14T03:46:49.679804+0000 mgr.a (mgr.14355) 14094 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:51 smithi007 bash[22722]: audit 2024-09-14T03:46:49.771359+0000 mgr.a (mgr.14355) 14095 : audit [DBG] from='client.305880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:51 smithi131 bash[24745]: cluster 2024-09-14T03:46:49.679804+0000 mgr.a (mgr.14355) 14094 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:51 smithi131 bash[24745]: audit 2024-09-14T03:46:49.771359+0000 mgr.a (mgr.14355) 14095 : audit [DBG] from='client.305880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:51 smithi171 bash[25040]: cluster 2024-09-14T03:46:49.679804+0000 mgr.a (mgr.14355) 14094 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:51 smithi171 bash[25040]: audit 2024-09-14T03:46:49.771359+0000 mgr.a (mgr.14355) 14095 : audit [DBG] from='client.305880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:53 smithi007 bash[22722]: cluster 2024-09-14T03:46:51.682184+0000 mgr.a (mgr.14355) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:53 smithi131 bash[24745]: cluster 2024-09-14T03:46:51.682184+0000 mgr.a (mgr.14355) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:53 smithi171 bash[25040]: cluster 2024-09-14T03:46:51.682184+0000 mgr.a (mgr.14355) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:46:55.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:46:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:46:55.190 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:46:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:55 smithi007 bash[22722]: cluster 2024-09-14T03:46:53.682974+0000 mgr.a (mgr.14355) 14097 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:55 smithi131 bash[24745]: cluster 2024-09-14T03:46:53.682974+0000 mgr.a (mgr.14355) 14097 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:55 smithi171 bash[25040]: cluster 2024-09-14T03:46:53.682974+0000 mgr.a (mgr.14355) 14097 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:55.973 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:46:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:46:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:46:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:46:55.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:46:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:56 smithi007 bash[22722]: audit 2024-09-14T03:46:55.528334+0000 mgr.a (mgr.14355) 14098 : audit [DBG] from='client.305955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:56 smithi131 bash[24745]: audit 2024-09-14T03:46:55.528334+0000 mgr.a (mgr.14355) 14098 : audit [DBG] from='client.305955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:56 smithi171 bash[25040]: audit 2024-09-14T03:46:55.528334+0000 mgr.a (mgr.14355) 14098 : audit [DBG] from='client.305955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:46:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:57 smithi007 bash[22722]: cluster 2024-09-14T03:46:55.684372+0000 mgr.a (mgr.14355) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:57 smithi131 bash[24745]: cluster 2024-09-14T03:46:55.684372+0000 mgr.a (mgr.14355) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:57 smithi171 bash[25040]: cluster 2024-09-14T03:46:55.684372+0000 mgr.a (mgr.14355) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:46:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:46:59 smithi007 bash[22722]: cluster 2024-09-14T03:46:57.685252+0000 mgr.a (mgr.14355) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:46:59 smithi131 bash[24745]: cluster 2024-09-14T03:46:57.685252+0000 mgr.a (mgr.14355) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:46:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:46:59 smithi171 bash[25040]: cluster 2024-09-14T03:46:57.685252+0000 mgr.a (mgr.14355) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:00.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:00.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:01 smithi007 bash[22722]: cluster 2024-09-14T03:46:59.686073+0000 mgr.a (mgr.14355) 14101 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:01.738 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:01 smithi131 bash[24745]: cluster 2024-09-14T03:46:59.686073+0000 mgr.a (mgr.14355) 14101 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:01 smithi171 bash[25040]: cluster 2024-09-14T03:46:59.686073+0000 mgr.a (mgr.14355) 14101 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:02 smithi007 bash[22722]: audit 2024-09-14T03:47:01.303824+0000 mgr.a (mgr.14355) 14102 : audit [DBG] from='client.306033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:02 smithi131 bash[24745]: audit 2024-09-14T03:47:01.303824+0000 mgr.a (mgr.14355) 14102 : audit [DBG] from='client.306033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:02 smithi171 bash[25040]: audit 2024-09-14T03:47:01.303824+0000 mgr.a (mgr.14355) 14102 : audit [DBG] from='client.306033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:03 smithi007 bash[22722]: cluster 2024-09-14T03:47:01.687469+0000 mgr.a (mgr.14355) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:03 smithi007 bash[22722]: audit 2024-09-14T03:47:03.419763+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:47:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:03 smithi131 bash[24745]: cluster 2024-09-14T03:47:01.687469+0000 mgr.a (mgr.14355) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:03 smithi131 bash[24745]: audit 2024-09-14T03:47:03.419763+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:47:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:03 smithi171 bash[25040]: cluster 2024-09-14T03:47:01.687469+0000 mgr.a (mgr.14355) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:03 smithi171 bash[25040]: audit 2024-09-14T03:47:03.419763+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:47:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:05 smithi007 bash[22722]: cluster 2024-09-14T03:47:03.688182+0000 mgr.a (mgr.14355) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:05 smithi131 bash[24745]: cluster 2024-09-14T03:47:03.688182+0000 mgr.a (mgr.14355) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:05 smithi171 bash[25040]: cluster 2024-09-14T03:47:03.688182+0000 mgr.a (mgr.14355) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:06.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:06.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:06.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:07.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:07.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:07.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:07 smithi007 bash[22722]: cluster 2024-09-14T03:47:05.690183+0000 mgr.a (mgr.14355) 14105 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:07 smithi131 bash[24745]: cluster 2024-09-14T03:47:05.690183+0000 mgr.a (mgr.14355) 14105 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:07 smithi171 bash[25040]: cluster 2024-09-14T03:47:05.690183+0000 mgr.a (mgr.14355) 14105 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:08 smithi007 bash[22722]: audit 2024-09-14T03:47:07.075759+0000 mgr.a (mgr.14355) 14106 : audit [DBG] from='client.306111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:08 smithi131 bash[24745]: audit 2024-09-14T03:47:07.075759+0000 mgr.a (mgr.14355) 14106 : audit [DBG] from='client.306111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:08 smithi171 bash[25040]: audit 2024-09-14T03:47:07.075759+0000 mgr.a (mgr.14355) 14106 : audit [DBG] from='client.306111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: cluster 2024-09-14T03:47:07.691119+0000 mgr.a (mgr.14355) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.774526+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.783344+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.799675+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.803846+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.820925+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:09 smithi007 bash[22722]: audit 2024-09-14T03:47:08.824502+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: cluster 2024-09-14T03:47:07.691119+0000 mgr.a (mgr.14355) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.774526+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.783344+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.799675+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.803846+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.820925+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:09 smithi131 bash[24745]: audit 2024-09-14T03:47:08.824502+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: cluster 2024-09-14T03:47:07.691119+0000 mgr.a (mgr.14355) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.774526+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.783344+0000 mon.a (mon.0) 2694 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.799675+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.803846+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.820925+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:09 smithi171 bash[25040]: audit 2024-09-14T03:47:08.824502+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:10.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22972]: debug 2024-09-14T03:47:10.293+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22972]: debug 2024-09-14T03:47:10.293+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22722]: audit 2024-09-14T03:47:09.515853+0000 mon.a (mon.0) 2699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22722]: audit 2024-09-14T03:47:09.517444+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22722]: audit 2024-09-14T03:47:09.527352+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22722]: audit 2024-09-14T03:47:09.532156+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:10 smithi007 bash[22722]: audit 2024-09-14T03:47:09.534542+0000 mgr.a (mgr.14355) 14108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:10 smithi131 bash[24745]: audit 2024-09-14T03:47:09.515853+0000 mon.a (mon.0) 2699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:47:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:10 smithi131 bash[24745]: audit 2024-09-14T03:47:09.517444+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:47:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:10 smithi131 bash[24745]: audit 2024-09-14T03:47:09.527352+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:10 smithi131 bash[24745]: audit 2024-09-14T03:47:09.532156+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:10 smithi131 bash[24745]: audit 2024-09-14T03:47:09.534542+0000 mgr.a (mgr.14355) 14108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:10 smithi171 bash[25040]: audit 2024-09-14T03:47:09.515853+0000 mon.a (mon.0) 2699 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:47:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:10 smithi171 bash[25040]: audit 2024-09-14T03:47:09.517444+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:47:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:10 smithi171 bash[25040]: audit 2024-09-14T03:47:09.527352+0000 mon.a (mon.0) 2701 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:47:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:10 smithi171 bash[25040]: audit 2024-09-14T03:47:09.532156+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:10 smithi171 bash[25040]: audit 2024-09-14T03:47:09.534542+0000 mgr.a (mgr.14355) 14108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:47:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:11 smithi131 bash[24745]: cluster 2024-09-14T03:47:09.691987+0000 mgr.a (mgr.14355) 14109 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:11 smithi131 bash[24745]: audit 2024-09-14T03:47:10.295023+0000 mgr.a (mgr.14355) 14110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:47:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:11 smithi131 bash[24745]: cephadm 2024-09-14T03:47:10.296495+0000 mgr.a (mgr.14355) 14111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:47:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:11 smithi171 bash[25040]: cluster 2024-09-14T03:47:09.691987+0000 mgr.a (mgr.14355) 14109 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:11 smithi171 bash[25040]: audit 2024-09-14T03:47:10.295023+0000 mgr.a (mgr.14355) 14110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:47:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:11 smithi171 bash[25040]: cephadm 2024-09-14T03:47:10.296495+0000 mgr.a (mgr.14355) 14111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:47:12.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:11 smithi007 bash[22722]: cluster 2024-09-14T03:47:09.691987+0000 mgr.a (mgr.14355) 14109 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:12.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:11 smithi007 bash[22722]: audit 2024-09-14T03:47:10.295023+0000 mgr.a (mgr.14355) 14110 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:47:12.163 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:11 smithi007 bash[22722]: cephadm 2024-09-14T03:47:10.296495+0000 mgr.a (mgr.14355) 14111 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:47:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:13.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:13.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:13 smithi171 bash[25040]: cluster 2024-09-14T03:47:11.694412+0000 mgr.a (mgr.14355) 14112 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:13 smithi007 bash[22722]: cluster 2024-09-14T03:47:11.694412+0000 mgr.a (mgr.14355) 14112 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:13 smithi131 bash[24745]: cluster 2024-09-14T03:47:11.694412+0000 mgr.a (mgr.14355) 14112 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:14 smithi171 bash[25040]: audit 2024-09-14T03:47:12.834431+0000 mgr.a (mgr.14355) 14113 : audit [DBG] from='client.306291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:14 smithi007 bash[22722]: audit 2024-09-14T03:47:12.834431+0000 mgr.a (mgr.14355) 14113 : audit [DBG] from='client.306291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:14 smithi131 bash[24745]: audit 2024-09-14T03:47:12.834431+0000 mgr.a (mgr.14355) 14113 : audit [DBG] from='client.306291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:15 smithi171 bash[25040]: cluster 2024-09-14T03:47:13.695249+0000 mgr.a (mgr.14355) 14114 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:15 smithi007 bash[22722]: cluster 2024-09-14T03:47:13.695249+0000 mgr.a (mgr.14355) 14114 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:15 smithi131 bash[24745]: cluster 2024-09-14T03:47:13.695249+0000 mgr.a (mgr.14355) 14114 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:17 smithi007 bash[22722]: cluster 2024-09-14T03:47:15.697506+0000 mgr.a (mgr.14355) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:17 smithi131 bash[24745]: cluster 2024-09-14T03:47:15.697506+0000 mgr.a (mgr.14355) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:17 smithi171 bash[25040]: cluster 2024-09-14T03:47:15.697506+0000 mgr.a (mgr.14355) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:18.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:19.020 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:19.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:19.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:19.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:19.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:19 smithi007 bash[22722]: cluster 2024-09-14T03:47:17.698279+0000 mgr.a (mgr.14355) 14116 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:19 smithi131 bash[24745]: cluster 2024-09-14T03:47:17.698279+0000 mgr.a (mgr.14355) 14116 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:19 smithi171 bash[25040]: cluster 2024-09-14T03:47:17.698279+0000 mgr.a (mgr.14355) 14116 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:20 smithi007 bash[22722]: audit 2024-09-14T03:47:18.574446+0000 mgr.a (mgr.14355) 14117 : audit [DBG] from='client.306369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:20 smithi131 bash[24745]: audit 2024-09-14T03:47:18.574446+0000 mgr.a (mgr.14355) 14117 : audit [DBG] from='client.306369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:20 smithi171 bash[25040]: audit 2024-09-14T03:47:18.574446+0000 mgr.a (mgr.14355) 14117 : audit [DBG] from='client.306369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:21 smithi007 bash[22722]: cluster 2024-09-14T03:47:19.699240+0000 mgr.a (mgr.14355) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:21 smithi131 bash[24745]: cluster 2024-09-14T03:47:19.699240+0000 mgr.a (mgr.14355) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:21 smithi171 bash[25040]: cluster 2024-09-14T03:47:19.699240+0000 mgr.a (mgr.14355) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:22 smithi007 bash[22722]: cluster 2024-09-14T03:47:21.701510+0000 mgr.a (mgr.14355) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:22 smithi131 bash[24745]: cluster 2024-09-14T03:47:21.701510+0000 mgr.a (mgr.14355) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:22 smithi171 bash[25040]: cluster 2024-09-14T03:47:21.701510+0000 mgr.a (mgr.14355) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:47:24.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:24.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:24.022 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:24.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:24.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:24 smithi131 bash[24745]: cluster 2024-09-14T03:47:23.702246+0000 mgr.a (mgr.14355) 14120 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:24 smithi131 bash[24745]: audit 2024-09-14T03:47:24.355363+0000 mgr.a (mgr.14355) 14121 : audit [DBG] from='client.306444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:24 smithi171 bash[25040]: cluster 2024-09-14T03:47:23.702246+0000 mgr.a (mgr.14355) 14120 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:24 smithi171 bash[25040]: audit 2024-09-14T03:47:24.355363+0000 mgr.a (mgr.14355) 14121 : audit [DBG] from='client.306444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:24 smithi007 bash[22722]: cluster 2024-09-14T03:47:23.702246+0000 mgr.a (mgr.14355) 14120 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:24 smithi007 bash[22722]: audit 2024-09-14T03:47:24.355363+0000 mgr.a (mgr.14355) 14121 : audit [DBG] from='client.306444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:26 smithi131 bash[24745]: cluster 2024-09-14T03:47:25.704496+0000 mgr.a (mgr.14355) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:26 smithi171 bash[25040]: cluster 2024-09-14T03:47:25.704496+0000 mgr.a (mgr.14355) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:26 smithi007 bash[22722]: cluster 2024-09-14T03:47:25.704496+0000 mgr.a (mgr.14355) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:28 smithi131 bash[24745]: cluster 2024-09-14T03:47:27.705257+0000 mgr.a (mgr.14355) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:28 smithi171 bash[25040]: cluster 2024-09-14T03:47:27.705257+0000 mgr.a (mgr.14355) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:28 smithi007 bash[22722]: cluster 2024-09-14T03:47:27.705257+0000 mgr.a (mgr.14355) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:29.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:29.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:30.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:30.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:30 smithi131 bash[24745]: cluster 2024-09-14T03:47:29.706022+0000 mgr.a (mgr.14355) 14124 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:30 smithi131 bash[24745]: audit 2024-09-14T03:47:30.096477+0000 mgr.a (mgr.14355) 14125 : audit [DBG] from='client.306519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:30 smithi171 bash[25040]: cluster 2024-09-14T03:47:29.706022+0000 mgr.a (mgr.14355) 14124 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:30 smithi171 bash[25040]: audit 2024-09-14T03:47:30.096477+0000 mgr.a (mgr.14355) 14125 : audit [DBG] from='client.306519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:30 smithi007 bash[22722]: cluster 2024-09-14T03:47:29.706022+0000 mgr.a (mgr.14355) 14124 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:30 smithi007 bash[22722]: audit 2024-09-14T03:47:30.096477+0000 mgr.a (mgr.14355) 14125 : audit [DBG] from='client.306519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:32 smithi131 bash[24745]: cluster 2024-09-14T03:47:31.708763+0000 mgr.a (mgr.14355) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:47:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:32 smithi171 bash[25040]: cluster 2024-09-14T03:47:31.708763+0000 mgr.a (mgr.14355) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:47:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:32 smithi007 bash[22722]: cluster 2024-09-14T03:47:31.708763+0000 mgr.a (mgr.14355) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:47:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:34 smithi131 bash[24745]: cluster 2024-09-14T03:47:33.709574+0000 mgr.a (mgr.14355) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:47:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:34 smithi171 bash[25040]: cluster 2024-09-14T03:47:33.709574+0000 mgr.a (mgr.14355) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:47:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:34 smithi007 bash[22722]: cluster 2024-09-14T03:47:33.709574+0000 mgr.a (mgr.14355) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:47:35.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:35.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:36.282 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:36.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:36 smithi171 bash[25040]: cluster 2024-09-14T03:47:35.711136+0000 mgr.a (mgr.14355) 14128 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:36 smithi171 bash[25040]: audit 2024-09-14T03:47:35.857175+0000 mgr.a (mgr.14355) 14129 : audit [DBG] from='client.306594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:36 smithi007 bash[22722]: cluster 2024-09-14T03:47:35.711136+0000 mgr.a (mgr.14355) 14128 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:36 smithi007 bash[22722]: audit 2024-09-14T03:47:35.857175+0000 mgr.a (mgr.14355) 14129 : audit [DBG] from='client.306594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:36 smithi131 bash[24745]: cluster 2024-09-14T03:47:35.711136+0000 mgr.a (mgr.14355) 14128 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:36 smithi131 bash[24745]: audit 2024-09-14T03:47:35.857175+0000 mgr.a (mgr.14355) 14129 : audit [DBG] from='client.306594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:38 smithi171 bash[25040]: cluster 2024-09-14T03:47:37.712030+0000 mgr.a (mgr.14355) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:47:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:38 smithi007 bash[22722]: cluster 2024-09-14T03:47:37.712030+0000 mgr.a (mgr.14355) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:47:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:38 smithi131 bash[24745]: cluster 2024-09-14T03:47:37.712030+0000 mgr.a (mgr.14355) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:47:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:40 smithi171 bash[25040]: cluster 2024-09-14T03:47:39.712826+0000 mgr.a (mgr.14355) 14131 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:40 smithi007 bash[22722]: cluster 2024-09-14T03:47:39.712826+0000 mgr.a (mgr.14355) 14131 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:40 smithi131 bash[24745]: cluster 2024-09-14T03:47:39.712826+0000 mgr.a (mgr.14355) 14131 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:47:41.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:41.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:41.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:42.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:42 smithi007 bash[22722]: audit 2024-09-14T03:47:41.620886+0000 mgr.a (mgr.14355) 14132 : audit [DBG] from='client.306669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:42 smithi007 bash[22722]: cluster 2024-09-14T03:47:41.714185+0000 mgr.a (mgr.14355) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:42 smithi131 bash[24745]: audit 2024-09-14T03:47:41.620886+0000 mgr.a (mgr.14355) 14132 : audit [DBG] from='client.306669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:42 smithi131 bash[24745]: cluster 2024-09-14T03:47:41.714185+0000 mgr.a (mgr.14355) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:42 smithi171 bash[25040]: audit 2024-09-14T03:47:41.620886+0000 mgr.a (mgr.14355) 14132 : audit [DBG] from='client.306669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:42 smithi171 bash[25040]: cluster 2024-09-14T03:47:41.714185+0000 mgr.a (mgr.14355) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:44 smithi007 bash[22722]: cluster 2024-09-14T03:47:43.715059+0000 mgr.a (mgr.14355) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:47:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:44 smithi131 bash[24745]: cluster 2024-09-14T03:47:43.715059+0000 mgr.a (mgr.14355) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:47:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:44 smithi171 bash[25040]: cluster 2024-09-14T03:47:43.715059+0000 mgr.a (mgr.14355) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:47:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:47.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:46 smithi007 bash[22722]: cluster 2024-09-14T03:47:45.717213+0000 mgr.a (mgr.14355) 14135 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:47:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:46 smithi131 bash[24745]: cluster 2024-09-14T03:47:45.717213+0000 mgr.a (mgr.14355) 14135 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:47:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:46 smithi171 bash[25040]: cluster 2024-09-14T03:47:45.717213+0000 mgr.a (mgr.14355) 14135 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:47:47.826 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:47.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:47 smithi007 bash[22722]: audit 2024-09-14T03:47:47.384506+0000 mgr.a (mgr.14355) 14136 : audit [DBG] from='client.306747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:47 smithi131 bash[24745]: audit 2024-09-14T03:47:47.384506+0000 mgr.a (mgr.14355) 14136 : audit [DBG] from='client.306747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:47 smithi171 bash[25040]: audit 2024-09-14T03:47:47.384506+0000 mgr.a (mgr.14355) 14136 : audit [DBG] from='client.306747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:48 smithi007 bash[22722]: cluster 2024-09-14T03:47:47.723833+0000 mgr.a (mgr.14355) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:48 smithi131 bash[24745]: cluster 2024-09-14T03:47:47.723833+0000 mgr.a (mgr.14355) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:48 smithi171 bash[25040]: cluster 2024-09-14T03:47:47.723833+0000 mgr.a (mgr.14355) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:50 smithi007 bash[22722]: cluster 2024-09-14T03:47:49.724703+0000 mgr.a (mgr.14355) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:50 smithi131 bash[24745]: cluster 2024-09-14T03:47:49.724703+0000 mgr.a (mgr.14355) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:50 smithi171 bash[25040]: cluster 2024-09-14T03:47:49.724703+0000 mgr.a (mgr.14355) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:52 smithi007 bash[22722]: cluster 2024-09-14T03:47:51.726987+0000 mgr.a (mgr.14355) 14139 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:52 smithi131 bash[24745]: cluster 2024-09-14T03:47:51.726987+0000 mgr.a (mgr.14355) 14139 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:52 smithi171 bash[25040]: cluster 2024-09-14T03:47:51.726987+0000 mgr.a (mgr.14355) 14139 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:53.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:47:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:53 smithi007 bash[22722]: audit 2024-09-14T03:47:53.168364+0000 mgr.a (mgr.14355) 14140 : audit [DBG] from='client.306825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:53 smithi131 bash[24745]: audit 2024-09-14T03:47:53.168364+0000 mgr.a (mgr.14355) 14140 : audit [DBG] from='client.306825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:53 smithi171 bash[25040]: audit 2024-09-14T03:47:53.168364+0000 mgr.a (mgr.14355) 14140 : audit [DBG] from='client.306825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:47:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:54 smithi007 bash[22722]: cluster 2024-09-14T03:47:53.727917+0000 mgr.a (mgr.14355) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:54 smithi131 bash[24745]: cluster 2024-09-14T03:47:53.727917+0000 mgr.a (mgr.14355) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:54 smithi171 bash[25040]: cluster 2024-09-14T03:47:53.727917+0000 mgr.a (mgr.14355) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:56 smithi007 bash[22722]: cluster 2024-09-14T03:47:55.730066+0000 mgr.a (mgr.14355) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:56 smithi131 bash[24745]: cluster 2024-09-14T03:47:55.730066+0000 mgr.a (mgr.14355) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:56 smithi171 bash[25040]: cluster 2024-09-14T03:47:55.730066+0000 mgr.a (mgr.14355) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:47:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:47:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:47:58.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:47:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:58 smithi007 bash[22722]: cluster 2024-09-14T03:47:57.730832+0000 mgr.a (mgr.14355) 14143 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:58 smithi131 bash[24745]: cluster 2024-09-14T03:47:57.730832+0000 mgr.a (mgr.14355) 14143 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:58 smithi171 bash[25040]: cluster 2024-09-14T03:47:57.730832+0000 mgr.a (mgr.14355) 14143 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:47:59.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:47:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:47:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:47:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:47:59.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:47:59 smithi007 bash[22722]: audit 2024-09-14T03:47:58.926846+0000 mgr.a (mgr.14355) 14144 : audit [DBG] from='client.306900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:47:59 smithi131 bash[24745]: audit 2024-09-14T03:47:58.926846+0000 mgr.a (mgr.14355) 14144 : audit [DBG] from='client.306900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:47:59 smithi171 bash[25040]: audit 2024-09-14T03:47:58.926846+0000 mgr.a (mgr.14355) 14144 : audit [DBG] from='client.306900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:00 smithi007 bash[22722]: cluster 2024-09-14T03:47:59.731736+0000 mgr.a (mgr.14355) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:00 smithi131 bash[24745]: cluster 2024-09-14T03:47:59.731736+0000 mgr.a (mgr.14355) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:00 smithi171 bash[25040]: cluster 2024-09-14T03:47:59.731736+0000 mgr.a (mgr.14355) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:02 smithi007 bash[22722]: cluster 2024-09-14T03:48:01.734009+0000 mgr.a (mgr.14355) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:02 smithi131 bash[24745]: cluster 2024-09-14T03:48:01.734009+0000 mgr.a (mgr.14355) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:02 smithi171 bash[25040]: cluster 2024-09-14T03:48:01.734009+0000 mgr.a (mgr.14355) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:04.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:04.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:05.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:05.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:05.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:05.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:05.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:04 smithi007 bash[22722]: cluster 2024-09-14T03:48:03.734790+0000 mgr.a (mgr.14355) 14147 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:04 smithi131 bash[24745]: cluster 2024-09-14T03:48:03.734790+0000 mgr.a (mgr.14355) 14147 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:04 smithi171 bash[25040]: cluster 2024-09-14T03:48:03.734790+0000 mgr.a (mgr.14355) 14147 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:05 smithi007 bash[22722]: audit 2024-09-14T03:48:04.673706+0000 mgr.a (mgr.14355) 14148 : audit [DBG] from='client.306978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:05 smithi131 bash[24745]: audit 2024-09-14T03:48:04.673706+0000 mgr.a (mgr.14355) 14148 : audit [DBG] from='client.306978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:05 smithi171 bash[25040]: audit 2024-09-14T03:48:04.673706+0000 mgr.a (mgr.14355) 14148 : audit [DBG] from='client.306978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:06 smithi007 bash[22722]: cluster 2024-09-14T03:48:05.737099+0000 mgr.a (mgr.14355) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:06 smithi131 bash[24745]: cluster 2024-09-14T03:48:05.737099+0000 mgr.a (mgr.14355) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:06 smithi171 bash[25040]: cluster 2024-09-14T03:48:05.737099+0000 mgr.a (mgr.14355) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:08 smithi007 bash[22722]: cluster 2024-09-14T03:48:07.737881+0000 mgr.a (mgr.14355) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:08 smithi131 bash[24745]: cluster 2024-09-14T03:48:07.737881+0000 mgr.a (mgr.14355) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:08 smithi171 bash[25040]: cluster 2024-09-14T03:48:07.737881+0000 mgr.a (mgr.14355) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:10.918 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:10 smithi007 bash[22722]: cluster 2024-09-14T03:48:09.738659+0000 mgr.a (mgr.14355) 14151 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:10 smithi007 bash[22722]: audit 2024-09-14T03:48:10.350286+0000 mon.a (mon.0) 2703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:48:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:10 smithi007 bash[22722]: audit 2024-09-14T03:48:10.472541+0000 mgr.a (mgr.14355) 14152 : audit [DBG] from='client.307053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:10 smithi131 bash[24745]: cluster 2024-09-14T03:48:09.738659+0000 mgr.a (mgr.14355) 14151 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:10 smithi131 bash[24745]: audit 2024-09-14T03:48:10.350286+0000 mon.a (mon.0) 2703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:48:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:10 smithi131 bash[24745]: audit 2024-09-14T03:48:10.472541+0000 mgr.a (mgr.14355) 14152 : audit [DBG] from='client.307053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:10 smithi171 bash[25040]: cluster 2024-09-14T03:48:09.738659+0000 mgr.a (mgr.14355) 14151 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:10 smithi171 bash[25040]: audit 2024-09-14T03:48:10.350286+0000 mon.a (mon.0) 2703 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:48:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:10 smithi171 bash[25040]: audit 2024-09-14T03:48:10.472541+0000 mgr.a (mgr.14355) 14152 : audit [DBG] from='client.307053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:12.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22972]: debug 2024-09-14T03:48:11.892+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22972]: debug 2024-09-14T03:48:11.892+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22722]: audit 2024-09-14T03:48:11.145533+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22722]: audit 2024-09-14T03:48:11.147433+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22722]: audit 2024-09-14T03:48:11.158218+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22722]: audit 2024-09-14T03:48:11.160656+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:11 smithi007 bash[22722]: audit 2024-09-14T03:48:11.163476+0000 mgr.a (mgr.14355) 14153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:11 smithi131 bash[24745]: audit 2024-09-14T03:48:11.145533+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:48:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:11 smithi131 bash[24745]: audit 2024-09-14T03:48:11.147433+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:48:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:11 smithi131 bash[24745]: audit 2024-09-14T03:48:11.158218+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:48:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:11 smithi131 bash[24745]: audit 2024-09-14T03:48:11.160656+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:11 smithi131 bash[24745]: audit 2024-09-14T03:48:11.163476+0000 mgr.a (mgr.14355) 14153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:11 smithi171 bash[25040]: audit 2024-09-14T03:48:11.145533+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:48:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:11 smithi171 bash[25040]: audit 2024-09-14T03:48:11.147433+0000 mon.a (mon.0) 2705 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:48:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:11 smithi171 bash[25040]: audit 2024-09-14T03:48:11.158218+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:48:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:11 smithi171 bash[25040]: audit 2024-09-14T03:48:11.160656+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:11 smithi171 bash[25040]: audit 2024-09-14T03:48:11.163476+0000 mgr.a (mgr.14355) 14153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:48:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:13 smithi007 bash[22722]: cluster 2024-09-14T03:48:11.740002+0000 mgr.a (mgr.14355) 14154 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:13 smithi007 bash[22722]: audit 2024-09-14T03:48:11.895271+0000 mgr.a (mgr.14355) 14155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:48:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:13 smithi007 bash[22722]: cephadm 2024-09-14T03:48:11.896548+0000 mgr.a (mgr.14355) 14156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:13 smithi131 bash[24745]: cluster 2024-09-14T03:48:11.740002+0000 mgr.a (mgr.14355) 14154 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:13 smithi131 bash[24745]: audit 2024-09-14T03:48:11.895271+0000 mgr.a (mgr.14355) 14155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:13 smithi131 bash[24745]: cephadm 2024-09-14T03:48:11.896548+0000 mgr.a (mgr.14355) 14156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:48:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:13 smithi171 bash[25040]: cluster 2024-09-14T03:48:11.740002+0000 mgr.a (mgr.14355) 14154 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:13 smithi171 bash[25040]: audit 2024-09-14T03:48:11.895271+0000 mgr.a (mgr.14355) 14155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:48:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:13 smithi171 bash[25040]: cephadm 2024-09-14T03:48:11.896548+0000 mgr.a (mgr.14355) 14156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:48:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:15 smithi007 bash[22722]: cluster 2024-09-14T03:48:13.740713+0000 mgr.a (mgr.14355) 14157 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:48:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:15 smithi131 bash[24745]: cluster 2024-09-14T03:48:13.740713+0000 mgr.a (mgr.14355) 14157 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:48:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:15 smithi171 bash[25040]: cluster 2024-09-14T03:48:13.740713+0000 mgr.a (mgr.14355) 14157 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:48:15.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:16.681 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:16.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:16.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:16.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:16.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:17 smithi007 bash[22722]: cluster 2024-09-14T03:48:15.742653+0000 mgr.a (mgr.14355) 14158 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:17 smithi007 bash[22722]: audit 2024-09-14T03:48:16.254103+0000 mgr.a (mgr.14355) 14159 : audit [DBG] from='client.307230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:17 smithi131 bash[24745]: cluster 2024-09-14T03:48:15.742653+0000 mgr.a (mgr.14355) 14158 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:17 smithi131 bash[24745]: audit 2024-09-14T03:48:16.254103+0000 mgr.a (mgr.14355) 14159 : audit [DBG] from='client.307230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:17 smithi171 bash[25040]: cluster 2024-09-14T03:48:15.742653+0000 mgr.a (mgr.14355) 14158 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:17 smithi171 bash[25040]: audit 2024-09-14T03:48:16.254103+0000 mgr.a (mgr.14355) 14159 : audit [DBG] from='client.307230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:19 smithi007 bash[22722]: cluster 2024-09-14T03:48:17.743597+0000 mgr.a (mgr.14355) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:19 smithi131 bash[24745]: cluster 2024-09-14T03:48:17.743597+0000 mgr.a (mgr.14355) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:19 smithi171 bash[25040]: cluster 2024-09-14T03:48:17.743597+0000 mgr.a (mgr.14355) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:21 smithi007 bash[22722]: cluster 2024-09-14T03:48:19.744405+0000 mgr.a (mgr.14355) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:21 smithi131 bash[24745]: cluster 2024-09-14T03:48:19.744405+0000 mgr.a (mgr.14355) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:21 smithi171 bash[25040]: cluster 2024-09-14T03:48:19.744405+0000 mgr.a (mgr.14355) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:48:21.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:22.466 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:23 smithi007 bash[22722]: cluster 2024-09-14T03:48:21.746561+0000 mgr.a (mgr.14355) 14162 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:23 smithi007 bash[22722]: audit 2024-09-14T03:48:22.020489+0000 mgr.a (mgr.14355) 14163 : audit [DBG] from='client.307305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:23 smithi131 bash[24745]: cluster 2024-09-14T03:48:21.746561+0000 mgr.a (mgr.14355) 14162 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:23 smithi131 bash[24745]: audit 2024-09-14T03:48:22.020489+0000 mgr.a (mgr.14355) 14163 : audit [DBG] from='client.307305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:23 smithi171 bash[25040]: cluster 2024-09-14T03:48:21.746561+0000 mgr.a (mgr.14355) 14162 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:23 smithi171 bash[25040]: audit 2024-09-14T03:48:22.020489+0000 mgr.a (mgr.14355) 14163 : audit [DBG] from='client.307305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:25 smithi007 bash[22722]: cluster 2024-09-14T03:48:23.747534+0000 mgr.a (mgr.14355) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:25 smithi131 bash[24745]: cluster 2024-09-14T03:48:23.747534+0000 mgr.a (mgr.14355) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:25 smithi171 bash[25040]: cluster 2024-09-14T03:48:23.747534+0000 mgr.a (mgr.14355) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:27 smithi007 bash[22722]: cluster 2024-09-14T03:48:25.749750+0000 mgr.a (mgr.14355) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:27.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:27 smithi131 bash[24745]: cluster 2024-09-14T03:48:25.749750+0000 mgr.a (mgr.14355) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:27 smithi171 bash[25040]: cluster 2024-09-14T03:48:25.749750+0000 mgr.a (mgr.14355) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:28.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:28.234 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:29 smithi007 bash[22722]: cluster 2024-09-14T03:48:27.750259+0000 mgr.a (mgr.14355) 14166 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:29 smithi007 bash[22722]: audit 2024-09-14T03:48:27.803390+0000 mgr.a (mgr.14355) 14167 : audit [DBG] from='client.307383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:29 smithi131 bash[24745]: cluster 2024-09-14T03:48:27.750259+0000 mgr.a (mgr.14355) 14166 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:29 smithi131 bash[24745]: audit 2024-09-14T03:48:27.803390+0000 mgr.a (mgr.14355) 14167 : audit [DBG] from='client.307383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:29 smithi171 bash[25040]: cluster 2024-09-14T03:48:27.750259+0000 mgr.a (mgr.14355) 14166 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:29 smithi171 bash[25040]: audit 2024-09-14T03:48:27.803390+0000 mgr.a (mgr.14355) 14167 : audit [DBG] from='client.307383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:31 smithi007 bash[22722]: cluster 2024-09-14T03:48:29.751120+0000 mgr.a (mgr.14355) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:31 smithi131 bash[24745]: cluster 2024-09-14T03:48:29.751120+0000 mgr.a (mgr.14355) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:31 smithi171 bash[25040]: cluster 2024-09-14T03:48:29.751120+0000 mgr.a (mgr.14355) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:33.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:33.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:33.236 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:33 smithi007 bash[22722]: cluster 2024-09-14T03:48:31.753345+0000 mgr.a (mgr.14355) 14169 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:33 smithi131 bash[24745]: cluster 2024-09-14T03:48:31.753345+0000 mgr.a (mgr.14355) 14169 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:33 smithi171 bash[25040]: cluster 2024-09-14T03:48:31.753345+0000 mgr.a (mgr.14355) 14169 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:33.982 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:34 smithi131 bash[24745]: audit 2024-09-14T03:48:33.567449+0000 mgr.a (mgr.14355) 14170 : audit [DBG] from='client.307461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:34 smithi171 bash[25040]: audit 2024-09-14T03:48:33.567449+0000 mgr.a (mgr.14355) 14170 : audit [DBG] from='client.307461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:34 smithi007 bash[22722]: audit 2024-09-14T03:48:33.567449+0000 mgr.a (mgr.14355) 14170 : audit [DBG] from='client.307461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:35.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:35 smithi131 bash[24745]: cluster 2024-09-14T03:48:33.753914+0000 mgr.a (mgr.14355) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:35 smithi171 bash[25040]: cluster 2024-09-14T03:48:33.753914+0000 mgr.a (mgr.14355) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:35 smithi007 bash[22722]: cluster 2024-09-14T03:48:33.753914+0000 mgr.a (mgr.14355) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:37 smithi131 bash[24745]: cluster 2024-09-14T03:48:35.756176+0000 mgr.a (mgr.14355) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:37 smithi171 bash[25040]: cluster 2024-09-14T03:48:35.756176+0000 mgr.a (mgr.14355) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:37 smithi007 bash[22722]: cluster 2024-09-14T03:48:35.756176+0000 mgr.a (mgr.14355) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:38.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:38.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:39 smithi131 bash[24745]: cluster 2024-09-14T03:48:37.756960+0000 mgr.a (mgr.14355) 14173 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:39 smithi171 bash[25040]: cluster 2024-09-14T03:48:37.756960+0000 mgr.a (mgr.14355) 14173 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:39 smithi007 bash[22722]: cluster 2024-09-14T03:48:37.756960+0000 mgr.a (mgr.14355) 14173 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:39.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:39.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:40 smithi131 bash[24745]: audit 2024-09-14T03:48:39.317230+0000 mgr.a (mgr.14355) 14174 : audit [DBG] from='client.307536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:40 smithi171 bash[25040]: audit 2024-09-14T03:48:39.317230+0000 mgr.a (mgr.14355) 14174 : audit [DBG] from='client.307536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:40 smithi007 bash[22722]: audit 2024-09-14T03:48:39.317230+0000 mgr.a (mgr.14355) 14174 : audit [DBG] from='client.307536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:41 smithi131 bash[24745]: cluster 2024-09-14T03:48:39.757537+0000 mgr.a (mgr.14355) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:41 smithi171 bash[25040]: cluster 2024-09-14T03:48:39.757537+0000 mgr.a (mgr.14355) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:41 smithi007 bash[22722]: cluster 2024-09-14T03:48:39.757537+0000 mgr.a (mgr.14355) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:43 smithi131 bash[24745]: cluster 2024-09-14T03:48:41.759781+0000 mgr.a (mgr.14355) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:43 smithi171 bash[25040]: cluster 2024-09-14T03:48:41.759781+0000 mgr.a (mgr.14355) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:43 smithi007 bash[22722]: cluster 2024-09-14T03:48:41.759781+0000 mgr.a (mgr.14355) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:48:44.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:45.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:45.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:45.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:45.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:45 smithi131 bash[24745]: cluster 2024-09-14T03:48:43.760545+0000 mgr.a (mgr.14355) 14177 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:45 smithi171 bash[25040]: cluster 2024-09-14T03:48:43.760545+0000 mgr.a (mgr.14355) 14177 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:45 smithi007 bash[22722]: cluster 2024-09-14T03:48:43.760545+0000 mgr.a (mgr.14355) 14177 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:46 smithi131 bash[24745]: audit 2024-09-14T03:48:45.103547+0000 mgr.a (mgr.14355) 14178 : audit [DBG] from='client.307614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:46 smithi171 bash[25040]: audit 2024-09-14T03:48:45.103547+0000 mgr.a (mgr.14355) 14178 : audit [DBG] from='client.307614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:46 smithi007 bash[22722]: audit 2024-09-14T03:48:45.103547+0000 mgr.a (mgr.14355) 14178 : audit [DBG] from='client.307614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:47 smithi131 bash[24745]: cluster 2024-09-14T03:48:45.763354+0000 mgr.a (mgr.14355) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:48:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:47 smithi171 bash[25040]: cluster 2024-09-14T03:48:45.763354+0000 mgr.a (mgr.14355) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:48:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:47 smithi007 bash[22722]: cluster 2024-09-14T03:48:45.763354+0000 mgr.a (mgr.14355) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:48:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:49 smithi131 bash[24745]: cluster 2024-09-14T03:48:47.764300+0000 mgr.a (mgr.14355) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:49 smithi171 bash[25040]: cluster 2024-09-14T03:48:47.764300+0000 mgr.a (mgr.14355) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:49 smithi007 bash[22722]: cluster 2024-09-14T03:48:47.764300+0000 mgr.a (mgr.14355) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:50.522 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:50.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:51.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:51.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:51.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:51.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:51.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:51 smithi131 bash[24745]: cluster 2024-09-14T03:48:49.765259+0000 mgr.a (mgr.14355) 14181 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:51 smithi171 bash[25040]: cluster 2024-09-14T03:48:49.765259+0000 mgr.a (mgr.14355) 14181 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:51 smithi007 bash[22722]: cluster 2024-09-14T03:48:49.765259+0000 mgr.a (mgr.14355) 14181 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:48:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:52 smithi131 bash[24745]: audit 2024-09-14T03:48:50.854429+0000 mgr.a (mgr.14355) 14182 : audit [DBG] from='client.307692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:52 smithi171 bash[25040]: audit 2024-09-14T03:48:50.854429+0000 mgr.a (mgr.14355) 14182 : audit [DBG] from='client.307692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:52 smithi007 bash[22722]: audit 2024-09-14T03:48:50.854429+0000 mgr.a (mgr.14355) 14182 : audit [DBG] from='client.307692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:53 smithi131 bash[24745]: cluster 2024-09-14T03:48:51.768104+0000 mgr.a (mgr.14355) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:53 smithi171 bash[25040]: cluster 2024-09-14T03:48:51.768104+0000 mgr.a (mgr.14355) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:53 smithi007 bash[22722]: cluster 2024-09-14T03:48:51.768104+0000 mgr.a (mgr.14355) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:55 smithi131 bash[24745]: cluster 2024-09-14T03:48:53.768906+0000 mgr.a (mgr.14355) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:48:55.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:55 smithi171 bash[25040]: cluster 2024-09-14T03:48:53.768906+0000 mgr.a (mgr.14355) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:48:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:55 smithi007 bash[22722]: cluster 2024-09-14T03:48:53.768906+0000 mgr.a (mgr.14355) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:48:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:48:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:48:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:48:57.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:48:57.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:48:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:48:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:48:57.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:48:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:57 smithi131 bash[24745]: cluster 2024-09-14T03:48:55.770860+0000 mgr.a (mgr.14355) 14185 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:57 smithi171 bash[25040]: cluster 2024-09-14T03:48:55.770860+0000 mgr.a (mgr.14355) 14185 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:57 smithi007 bash[22722]: cluster 2024-09-14T03:48:55.770860+0000 mgr.a (mgr.14355) 14185 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:48:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:58 smithi171 bash[25040]: audit 2024-09-14T03:48:56.610334+0000 mgr.a (mgr.14355) 14186 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:58 smithi007 bash[22722]: audit 2024-09-14T03:48:56.610334+0000 mgr.a (mgr.14355) 14186 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:58 smithi131 bash[24745]: audit 2024-09-14T03:48:56.610334+0000 mgr.a (mgr.14355) 14186 : audit [DBG] from='client.307767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:48:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:48:59 smithi171 bash[25040]: cluster 2024-09-14T03:48:57.771977+0000 mgr.a (mgr.14355) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:48:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:48:59 smithi007 bash[22722]: cluster 2024-09-14T03:48:57.771977+0000 mgr.a (mgr.14355) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:48:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:48:59 smithi131 bash[24745]: cluster 2024-09-14T03:48:57.771977+0000 mgr.a (mgr.14355) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:49:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:01 smithi171 bash[25040]: cluster 2024-09-14T03:48:59.772951+0000 mgr.a (mgr.14355) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:49:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:01 smithi007 bash[22722]: cluster 2024-09-14T03:48:59.772951+0000 mgr.a (mgr.14355) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:49:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:01 smithi131 bash[24745]: cluster 2024-09-14T03:48:59.772951+0000 mgr.a (mgr.14355) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:49:02.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:02.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:02.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:02.820 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:02.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:02.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:02.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:02.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:03 smithi007 bash[22722]: cluster 2024-09-14T03:49:01.775222+0000 mgr.a (mgr.14355) 14189 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:49:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:03 smithi007 bash[22722]: audit 2024-09-14T03:49:02.383037+0000 mgr.a (mgr.14355) 14190 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:03 smithi131 bash[24745]: cluster 2024-09-14T03:49:01.775222+0000 mgr.a (mgr.14355) 14189 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:49:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:03 smithi131 bash[24745]: audit 2024-09-14T03:49:02.383037+0000 mgr.a (mgr.14355) 14190 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:03 smithi171 bash[25040]: cluster 2024-09-14T03:49:01.775222+0000 mgr.a (mgr.14355) 14189 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:49:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:03 smithi171 bash[25040]: audit 2024-09-14T03:49:02.383037+0000 mgr.a (mgr.14355) 14190 : audit [DBG] from='client.307845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:05 smithi007 bash[22722]: cluster 2024-09-14T03:49:03.776166+0000 mgr.a (mgr.14355) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:05 smithi131 bash[24745]: cluster 2024-09-14T03:49:03.776166+0000 mgr.a (mgr.14355) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:05 smithi171 bash[25040]: cluster 2024-09-14T03:49:03.776166+0000 mgr.a (mgr.14355) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:07 smithi007 bash[22722]: cluster 2024-09-14T03:49:05.778474+0000 mgr.a (mgr.14355) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:07 smithi131 bash[24745]: cluster 2024-09-14T03:49:05.778474+0000 mgr.a (mgr.14355) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:07 smithi171 bash[25040]: cluster 2024-09-14T03:49:05.778474+0000 mgr.a (mgr.14355) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:07.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:07.822 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:08.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:09 smithi007 bash[22722]: cluster 2024-09-14T03:49:07.779258+0000 mgr.a (mgr.14355) 14193 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:09 smithi007 bash[22722]: audit 2024-09-14T03:49:08.155680+0000 mgr.a (mgr.14355) 14194 : audit [DBG] from='client.307920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:09 smithi131 bash[24745]: cluster 2024-09-14T03:49:07.779258+0000 mgr.a (mgr.14355) 14193 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:09 smithi131 bash[24745]: audit 2024-09-14T03:49:08.155680+0000 mgr.a (mgr.14355) 14194 : audit [DBG] from='client.307920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:09 smithi171 bash[25040]: cluster 2024-09-14T03:49:07.779258+0000 mgr.a (mgr.14355) 14193 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:09 smithi171 bash[25040]: audit 2024-09-14T03:49:08.155680+0000 mgr.a (mgr.14355) 14194 : audit [DBG] from='client.307920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:11 smithi007 bash[22722]: cluster 2024-09-14T03:49:09.780151+0000 mgr.a (mgr.14355) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:11 smithi131 bash[24745]: cluster 2024-09-14T03:49:09.780151+0000 mgr.a (mgr.14355) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:11 smithi171 bash[25040]: cluster 2024-09-14T03:49:09.780151+0000 mgr.a (mgr.14355) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:12 smithi007 bash[22722]: audit 2024-09-14T03:49:11.954143+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:49:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:12 smithi131 bash[24745]: audit 2024-09-14T03:49:11.954143+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:49:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:12 smithi171 bash[25040]: audit 2024-09-14T03:49:11.954143+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:49:13.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:13.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:13.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22972]: debug 2024-09-14T03:49:13.563+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22972]: debug 2024-09-14T03:49:13.563+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22722]: cluster 2024-09-14T03:49:11.782448+0000 mgr.a (mgr.14355) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22722]: audit 2024-09-14T03:49:12.783720+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22722]: audit 2024-09-14T03:49:12.784765+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22722]: audit 2024-09-14T03:49:12.790946+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:49:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:13 smithi007 bash[22722]: audit 2024-09-14T03:49:12.793184+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:13 smithi131 bash[24745]: cluster 2024-09-14T03:49:11.782448+0000 mgr.a (mgr.14355) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:13 smithi131 bash[24745]: audit 2024-09-14T03:49:12.783720+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:49:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:13 smithi131 bash[24745]: audit 2024-09-14T03:49:12.784765+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:49:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:13 smithi131 bash[24745]: audit 2024-09-14T03:49:12.790946+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:49:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:13 smithi131 bash[24745]: audit 2024-09-14T03:49:12.793184+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:13 smithi171 bash[25040]: cluster 2024-09-14T03:49:11.782448+0000 mgr.a (mgr.14355) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:13 smithi171 bash[25040]: audit 2024-09-14T03:49:12.783720+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:49:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:13 smithi171 bash[25040]: audit 2024-09-14T03:49:12.784765+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:49:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:13 smithi171 bash[25040]: audit 2024-09-14T03:49:12.790946+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:49:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:13 smithi171 bash[25040]: audit 2024-09-14T03:49:12.793184+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:14.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:14.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:14.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:14.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:14.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:14 smithi007 bash[22722]: audit 2024-09-14T03:49:12.795439+0000 mgr.a (mgr.14355) 14197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:14 smithi007 bash[22722]: audit 2024-09-14T03:49:13.567420+0000 mgr.a (mgr.14355) 14198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:49:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:14 smithi007 bash[22722]: cephadm 2024-09-14T03:49:13.569173+0000 mgr.a (mgr.14355) 14199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:49:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:14 smithi131 bash[24745]: audit 2024-09-14T03:49:12.795439+0000 mgr.a (mgr.14355) 14197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:14 smithi131 bash[24745]: audit 2024-09-14T03:49:13.567420+0000 mgr.a (mgr.14355) 14198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:49:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:14 smithi131 bash[24745]: cephadm 2024-09-14T03:49:13.569173+0000 mgr.a (mgr.14355) 14199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:49:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:14 smithi171 bash[25040]: audit 2024-09-14T03:49:12.795439+0000 mgr.a (mgr.14355) 14197 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:49:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:14 smithi171 bash[25040]: audit 2024-09-14T03:49:13.567420+0000 mgr.a (mgr.14355) 14198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:49:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:14 smithi171 bash[25040]: cephadm 2024-09-14T03:49:13.569173+0000 mgr.a (mgr.14355) 14199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:49:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:15 smithi007 bash[22722]: cluster 2024-09-14T03:49:13.783543+0000 mgr.a (mgr.14355) 14200 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:15 smithi007 bash[22722]: audit 2024-09-14T03:49:13.924041+0000 mgr.a (mgr.14355) 14201 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:15 smithi131 bash[24745]: cluster 2024-09-14T03:49:13.783543+0000 mgr.a (mgr.14355) 14200 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:15 smithi131 bash[24745]: audit 2024-09-14T03:49:13.924041+0000 mgr.a (mgr.14355) 14201 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:15 smithi171 bash[25040]: cluster 2024-09-14T03:49:13.783543+0000 mgr.a (mgr.14355) 14200 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:15 smithi171 bash[25040]: audit 2024-09-14T03:49:13.924041+0000 mgr.a (mgr.14355) 14201 : audit [DBG] from='client.308103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:17 smithi007 bash[22722]: cluster 2024-09-14T03:49:15.785864+0000 mgr.a (mgr.14355) 14202 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:17 smithi131 bash[24745]: cluster 2024-09-14T03:49:15.785864+0000 mgr.a (mgr.14355) 14202 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:17 smithi171 bash[25040]: cluster 2024-09-14T03:49:15.785864+0000 mgr.a (mgr.14355) 14202 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:19.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:19 smithi007 bash[22722]: cluster 2024-09-14T03:49:17.786799+0000 mgr.a (mgr.14355) 14203 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:19 smithi131 bash[24745]: cluster 2024-09-14T03:49:17.786799+0000 mgr.a (mgr.14355) 14203 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:19 smithi171 bash[25040]: cluster 2024-09-14T03:49:17.786799+0000 mgr.a (mgr.14355) 14203 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:20.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:20.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:21 smithi007 bash[22722]: audit 2024-09-14T03:49:19.694454+0000 mgr.a (mgr.14355) 14204 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:21 smithi007 bash[22722]: cluster 2024-09-14T03:49:19.787371+0000 mgr.a (mgr.14355) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:21 smithi131 bash[24745]: audit 2024-09-14T03:49:19.694454+0000 mgr.a (mgr.14355) 14204 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:21 smithi131 bash[24745]: cluster 2024-09-14T03:49:19.787371+0000 mgr.a (mgr.14355) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:21 smithi171 bash[25040]: audit 2024-09-14T03:49:19.694454+0000 mgr.a (mgr.14355) 14204 : audit [DBG] from='client.308181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:21 smithi171 bash[25040]: cluster 2024-09-14T03:49:19.787371+0000 mgr.a (mgr.14355) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:23 smithi007 bash[22722]: cluster 2024-09-14T03:49:21.789675+0000 mgr.a (mgr.14355) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:23 smithi131 bash[24745]: cluster 2024-09-14T03:49:21.789675+0000 mgr.a (mgr.14355) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:23 smithi171 bash[25040]: cluster 2024-09-14T03:49:21.789675+0000 mgr.a (mgr.14355) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:25 smithi007 bash[22722]: cluster 2024-09-14T03:49:23.790479+0000 mgr.a (mgr.14355) 14207 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:25 smithi131 bash[24745]: cluster 2024-09-14T03:49:23.790479+0000 mgr.a (mgr.14355) 14207 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:25 smithi171 bash[25040]: cluster 2024-09-14T03:49:23.790479+0000 mgr.a (mgr.14355) 14207 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:25.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:25.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:25.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:25.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:25.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:26 smithi007 bash[22722]: audit 2024-09-14T03:49:25.465246+0000 mgr.a (mgr.14355) 14208 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:26 smithi131 bash[24745]: audit 2024-09-14T03:49:25.465246+0000 mgr.a (mgr.14355) 14208 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:26 smithi171 bash[25040]: audit 2024-09-14T03:49:25.465246+0000 mgr.a (mgr.14355) 14208 : audit [DBG] from='client.308259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:27 smithi007 bash[22722]: cluster 2024-09-14T03:49:25.791762+0000 mgr.a (mgr.14355) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:27 smithi131 bash[24745]: cluster 2024-09-14T03:49:25.791762+0000 mgr.a (mgr.14355) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:27 smithi171 bash[25040]: cluster 2024-09-14T03:49:25.791762+0000 mgr.a (mgr.14355) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:49:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:29 smithi007 bash[22722]: cluster 2024-09-14T03:49:27.792514+0000 mgr.a (mgr.14355) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:29 smithi131 bash[24745]: cluster 2024-09-14T03:49:27.792514+0000 mgr.a (mgr.14355) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:29 smithi171 bash[25040]: cluster 2024-09-14T03:49:27.792514+0000 mgr.a (mgr.14355) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:30.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:30.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:30.886 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:31.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:31.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:31 smithi007 bash[22722]: cluster 2024-09-14T03:49:29.793278+0000 mgr.a (mgr.14355) 14211 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:31 smithi131 bash[24745]: cluster 2024-09-14T03:49:29.793278+0000 mgr.a (mgr.14355) 14211 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:31 smithi171 bash[25040]: cluster 2024-09-14T03:49:29.793278+0000 mgr.a (mgr.14355) 14211 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:49:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:32 smithi007 bash[22722]: audit 2024-09-14T03:49:31.218383+0000 mgr.a (mgr.14355) 14212 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:32 smithi131 bash[24745]: audit 2024-09-14T03:49:31.218383+0000 mgr.a (mgr.14355) 14212 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:32 smithi171 bash[25040]: audit 2024-09-14T03:49:31.218383+0000 mgr.a (mgr.14355) 14212 : audit [DBG] from='client.308337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:33 smithi007 bash[22722]: cluster 2024-09-14T03:49:31.796085+0000 mgr.a (mgr.14355) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:33 smithi131 bash[24745]: cluster 2024-09-14T03:49:31.796085+0000 mgr.a (mgr.14355) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:33 smithi171 bash[25040]: cluster 2024-09-14T03:49:31.796085+0000 mgr.a (mgr.14355) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:35 smithi007 bash[22722]: cluster 2024-09-14T03:49:33.796879+0000 mgr.a (mgr.14355) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:49:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:35 smithi131 bash[24745]: cluster 2024-09-14T03:49:33.796879+0000 mgr.a (mgr.14355) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:49:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:35 smithi171 bash[25040]: cluster 2024-09-14T03:49:33.796879+0000 mgr.a (mgr.14355) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:49:36.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:36.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:36.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:37.413 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:37.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:37.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:37.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:37.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:37 smithi007 bash[22722]: cluster 2024-09-14T03:49:35.798870+0000 mgr.a (mgr.14355) 14215 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:37 smithi131 bash[24745]: cluster 2024-09-14T03:49:35.798870+0000 mgr.a (mgr.14355) 14215 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:37 smithi171 bash[25040]: cluster 2024-09-14T03:49:35.798870+0000 mgr.a (mgr.14355) 14215 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:38 smithi007 bash[22722]: audit 2024-09-14T03:49:36.998538+0000 mgr.a (mgr.14355) 14216 : audit [DBG] from='client.308415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:38 smithi131 bash[24745]: audit 2024-09-14T03:49:36.998538+0000 mgr.a (mgr.14355) 14216 : audit [DBG] from='client.308415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:38 smithi171 bash[25040]: audit 2024-09-14T03:49:36.998538+0000 mgr.a (mgr.14355) 14216 : audit [DBG] from='client.308415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:39 smithi007 bash[22722]: cluster 2024-09-14T03:49:37.799791+0000 mgr.a (mgr.14355) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:39 smithi131 bash[24745]: cluster 2024-09-14T03:49:37.799791+0000 mgr.a (mgr.14355) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:39 smithi171 bash[25040]: cluster 2024-09-14T03:49:37.799791+0000 mgr.a (mgr.14355) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:41 smithi007 bash[22722]: cluster 2024-09-14T03:49:39.800542+0000 mgr.a (mgr.14355) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:41 smithi131 bash[24745]: cluster 2024-09-14T03:49:39.800542+0000 mgr.a (mgr.14355) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:41 smithi171 bash[25040]: cluster 2024-09-14T03:49:39.800542+0000 mgr.a (mgr.14355) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:42.415 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:42.416 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:43.173 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:43.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:43 smithi007 bash[22722]: cluster 2024-09-14T03:49:41.802779+0000 mgr.a (mgr.14355) 14219 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:43 smithi131 bash[24745]: cluster 2024-09-14T03:49:41.802779+0000 mgr.a (mgr.14355) 14219 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:43 smithi171 bash[25040]: cluster 2024-09-14T03:49:41.802779+0000 mgr.a (mgr.14355) 14219 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:44 smithi007 bash[22722]: audit 2024-09-14T03:49:42.744970+0000 mgr.a (mgr.14355) 14220 : audit [DBG] from='client.308490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:44 smithi131 bash[24745]: audit 2024-09-14T03:49:42.744970+0000 mgr.a (mgr.14355) 14220 : audit [DBG] from='client.308490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:44 smithi171 bash[25040]: audit 2024-09-14T03:49:42.744970+0000 mgr.a (mgr.14355) 14220 : audit [DBG] from='client.308490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:45 smithi007 bash[22722]: cluster 2024-09-14T03:49:43.803749+0000 mgr.a (mgr.14355) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:45 smithi131 bash[24745]: cluster 2024-09-14T03:49:43.803749+0000 mgr.a (mgr.14355) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:45 smithi171 bash[25040]: cluster 2024-09-14T03:49:43.803749+0000 mgr.a (mgr.14355) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:47 smithi007 bash[22722]: cluster 2024-09-14T03:49:45.805976+0000 mgr.a (mgr.14355) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:47 smithi131 bash[24745]: cluster 2024-09-14T03:49:45.805976+0000 mgr.a (mgr.14355) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:47 smithi171 bash[25040]: cluster 2024-09-14T03:49:45.805976+0000 mgr.a (mgr.14355) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:48.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:48.176 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:48.963 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:48.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:48.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:48.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:48.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:49 smithi007 bash[22722]: cluster 2024-09-14T03:49:47.806890+0000 mgr.a (mgr.14355) 14223 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:49 smithi007 bash[22722]: audit 2024-09-14T03:49:48.514000+0000 mgr.a (mgr.14355) 14224 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:49 smithi131 bash[24745]: cluster 2024-09-14T03:49:47.806890+0000 mgr.a (mgr.14355) 14223 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:49 smithi131 bash[24745]: audit 2024-09-14T03:49:48.514000+0000 mgr.a (mgr.14355) 14224 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:49 smithi171 bash[25040]: cluster 2024-09-14T03:49:47.806890+0000 mgr.a (mgr.14355) 14223 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:49 smithi171 bash[25040]: audit 2024-09-14T03:49:48.514000+0000 mgr.a (mgr.14355) 14224 : audit [DBG] from='client.308565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:51 smithi007 bash[22722]: cluster 2024-09-14T03:49:49.807972+0000 mgr.a (mgr.14355) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:51 smithi131 bash[24745]: cluster 2024-09-14T03:49:49.807972+0000 mgr.a (mgr.14355) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:51 smithi171 bash[25040]: cluster 2024-09-14T03:49:49.807972+0000 mgr.a (mgr.14355) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:53 smithi007 bash[22722]: cluster 2024-09-14T03:49:51.810403+0000 mgr.a (mgr.14355) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:53 smithi131 bash[24745]: cluster 2024-09-14T03:49:51.810403+0000 mgr.a (mgr.14355) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:53 smithi171 bash[25040]: cluster 2024-09-14T03:49:51.810403+0000 mgr.a (mgr.14355) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:53.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:53.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:53.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:49:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:49:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:49:54.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:49:54.729 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:49:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:55 smithi131 bash[24745]: cluster 2024-09-14T03:49:53.811292+0000 mgr.a (mgr.14355) 14227 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:55 smithi131 bash[24745]: audit 2024-09-14T03:49:54.298215+0000 mgr.a (mgr.14355) 14228 : audit [DBG] from='client.308643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:55 smithi171 bash[25040]: cluster 2024-09-14T03:49:53.811292+0000 mgr.a (mgr.14355) 14227 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:55 smithi171 bash[25040]: audit 2024-09-14T03:49:54.298215+0000 mgr.a (mgr.14355) 14228 : audit [DBG] from='client.308643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:55 smithi007 bash[22722]: cluster 2024-09-14T03:49:53.811292+0000 mgr.a (mgr.14355) 14227 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:55 smithi007 bash[22722]: audit 2024-09-14T03:49:54.298215+0000 mgr.a (mgr.14355) 14228 : audit [DBG] from='client.308643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:49:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:57 smithi131 bash[24745]: cluster 2024-09-14T03:49:55.813662+0000 mgr.a (mgr.14355) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:57 smithi171 bash[25040]: cluster 2024-09-14T03:49:55.813662+0000 mgr.a (mgr.14355) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:57 smithi007 bash[22722]: cluster 2024-09-14T03:49:55.813662+0000 mgr.a (mgr.14355) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:49:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:49:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:49:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:49:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:49:59 smithi131 bash[24745]: cluster 2024-09-14T03:49:57.814444+0000 mgr.a (mgr.14355) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:49:59 smithi171 bash[25040]: cluster 2024-09-14T03:49:57.814444+0000 mgr.a (mgr.14355) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:49:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:49:59 smithi007 bash[22722]: cluster 2024-09-14T03:49:57.814444+0000 mgr.a (mgr.14355) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:00.517 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:00.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:00.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:00 smithi131 bash[24745]: cluster 2024-09-14T03:50:00.000154+0000 mon.a (mon.0) 2713 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:50:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:00 smithi171 bash[25040]: cluster 2024-09-14T03:50:00.000154+0000 mon.a (mon.0) 2713 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:50:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:00 smithi007 bash[22722]: cluster 2024-09-14T03:50:00.000154+0000 mon.a (mon.0) 2713 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T03:50:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:01 smithi131 bash[24745]: cluster 2024-09-14T03:49:59.814911+0000 mgr.a (mgr.14355) 14231 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:01 smithi131 bash[24745]: audit 2024-09-14T03:50:00.065987+0000 mgr.a (mgr.14355) 14232 : audit [DBG] from='client.308721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:01 smithi171 bash[25040]: cluster 2024-09-14T03:49:59.814911+0000 mgr.a (mgr.14355) 14231 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:01 smithi171 bash[25040]: audit 2024-09-14T03:50:00.065987+0000 mgr.a (mgr.14355) 14232 : audit [DBG] from='client.308721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:01 smithi007 bash[22722]: cluster 2024-09-14T03:49:59.814911+0000 mgr.a (mgr.14355) 14231 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:01 smithi007 bash[22722]: audit 2024-09-14T03:50:00.065987+0000 mgr.a (mgr.14355) 14232 : audit [DBG] from='client.308721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:03.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:03 smithi131 bash[24745]: cluster 2024-09-14T03:50:01.817543+0000 mgr.a (mgr.14355) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:50:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:03 smithi171 bash[25040]: cluster 2024-09-14T03:50:01.817543+0000 mgr.a (mgr.14355) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:50:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:03 smithi007 bash[22722]: cluster 2024-09-14T03:50:01.817543+0000 mgr.a (mgr.14355) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T03:50:05.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:05.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:05 smithi131 bash[24745]: cluster 2024-09-14T03:50:03.818378+0000 mgr.a (mgr.14355) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:50:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:05 smithi171 bash[25040]: cluster 2024-09-14T03:50:03.818378+0000 mgr.a (mgr.14355) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:50:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:05 smithi007 bash[22722]: cluster 2024-09-14T03:50:03.818378+0000 mgr.a (mgr.14355) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T03:50:06.265 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:06.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:06.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:06.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:06.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:07 smithi131 bash[24745]: cluster 2024-09-14T03:50:05.820269+0000 mgr.a (mgr.14355) 14235 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:07 smithi131 bash[24745]: audit 2024-09-14T03:50:05.849869+0000 mgr.a (mgr.14355) 14236 : audit [DBG] from='client.308799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:07 smithi171 bash[25040]: cluster 2024-09-14T03:50:05.820269+0000 mgr.a (mgr.14355) 14235 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:07 smithi171 bash[25040]: audit 2024-09-14T03:50:05.849869+0000 mgr.a (mgr.14355) 14236 : audit [DBG] from='client.308799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:07 smithi007 bash[22722]: cluster 2024-09-14T03:50:05.820269+0000 mgr.a (mgr.14355) 14235 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:07 smithi007 bash[22722]: audit 2024-09-14T03:50:05.849869+0000 mgr.a (mgr.14355) 14236 : audit [DBG] from='client.308799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:09 smithi131 bash[24745]: cluster 2024-09-14T03:50:07.821155+0000 mgr.a (mgr.14355) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:09 smithi171 bash[25040]: cluster 2024-09-14T03:50:07.821155+0000 mgr.a (mgr.14355) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:09 smithi007 bash[22722]: cluster 2024-09-14T03:50:07.821155+0000 mgr.a (mgr.14355) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:11.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:11.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:11.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:11 smithi131 bash[24745]: cluster 2024-09-14T03:50:09.821931+0000 mgr.a (mgr.14355) 14238 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:11 smithi171 bash[25040]: cluster 2024-09-14T03:50:09.821931+0000 mgr.a (mgr.14355) 14238 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:11 smithi007 bash[22722]: cluster 2024-09-14T03:50:09.821931+0000 mgr.a (mgr.14355) 14238 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:12.031 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:13 smithi131 bash[24745]: audit 2024-09-14T03:50:11.600736+0000 mgr.a (mgr.14355) 14239 : audit [DBG] from='client.308871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:13 smithi131 bash[24745]: cluster 2024-09-14T03:50:11.831533+0000 mgr.a (mgr.14355) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:13 smithi171 bash[25040]: audit 2024-09-14T03:50:11.600736+0000 mgr.a (mgr.14355) 14239 : audit [DBG] from='client.308871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:13 smithi171 bash[25040]: cluster 2024-09-14T03:50:11.831533+0000 mgr.a (mgr.14355) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:13 smithi007 bash[22722]: audit 2024-09-14T03:50:11.600736+0000 mgr.a (mgr.14355) 14239 : audit [DBG] from='client.308871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:13 smithi007 bash[22722]: cluster 2024-09-14T03:50:11.831533+0000 mgr.a (mgr.14355) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:14 smithi131 bash[24745]: audit 2024-09-14T03:50:13.623628+0000 mon.a (mon.0) 2714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:50:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:14 smithi131 bash[24745]: audit 2024-09-14T03:50:14.457048+0000 mon.a (mon.0) 2715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:50:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:14 smithi131 bash[24745]: audit 2024-09-14T03:50:14.458536+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:50:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:14 smithi131 bash[24745]: audit 2024-09-14T03:50:14.467679+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:50:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:14 smithi131 bash[24745]: audit 2024-09-14T03:50:14.472575+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:14 smithi171 bash[25040]: audit 2024-09-14T03:50:13.623628+0000 mon.a (mon.0) 2714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:14 smithi171 bash[25040]: audit 2024-09-14T03:50:14.457048+0000 mon.a (mon.0) 2715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:14 smithi171 bash[25040]: audit 2024-09-14T03:50:14.458536+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:14 smithi171 bash[25040]: audit 2024-09-14T03:50:14.467679+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:14 smithi171 bash[25040]: audit 2024-09-14T03:50:14.472575+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:14 smithi007 bash[22722]: audit 2024-09-14T03:50:13.623628+0000 mon.a (mon.0) 2714 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:50:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:14 smithi007 bash[22722]: audit 2024-09-14T03:50:14.457048+0000 mon.a (mon.0) 2715 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:50:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:14 smithi007 bash[22722]: audit 2024-09-14T03:50:14.458536+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:50:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:14 smithi007 bash[22722]: audit 2024-09-14T03:50:14.467679+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:50:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:14 smithi007 bash[22722]: audit 2024-09-14T03:50:14.472575+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:15.510 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:50:15 smithi007 bash[22972]: debug 2024-09-14T03:50:15.222+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:50:15.511 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:50:15 smithi007 bash[22972]: debug 2024-09-14T03:50:15.222+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:50:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:15 smithi131 bash[24745]: cluster 2024-09-14T03:50:13.832536+0000 mgr.a (mgr.14355) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:50:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:15 smithi131 bash[24745]: audit 2024-09-14T03:50:14.475044+0000 mgr.a (mgr.14355) 14242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:15 smithi171 bash[25040]: cluster 2024-09-14T03:50:13.832536+0000 mgr.a (mgr.14355) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:50:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:15 smithi171 bash[25040]: audit 2024-09-14T03:50:14.475044+0000 mgr.a (mgr.14355) 14242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:15 smithi007 bash[22722]: cluster 2024-09-14T03:50:13.832536+0000 mgr.a (mgr.14355) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:50:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:15 smithi007 bash[22722]: audit 2024-09-14T03:50:14.475044+0000 mgr.a (mgr.14355) 14242 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:50:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:16 smithi131 bash[24745]: audit 2024-09-14T03:50:15.227241+0000 mgr.a (mgr.14355) 14243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:50:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:16 smithi131 bash[24745]: cephadm 2024-09-14T03:50:15.228612+0000 mgr.a (mgr.14355) 14244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:50:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:16 smithi171 bash[25040]: audit 2024-09-14T03:50:15.227241+0000 mgr.a (mgr.14355) 14243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:50:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:16 smithi171 bash[25040]: cephadm 2024-09-14T03:50:15.228612+0000 mgr.a (mgr.14355) 14244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:50:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:16 smithi007 bash[22722]: audit 2024-09-14T03:50:15.227241+0000 mgr.a (mgr.14355) 14243 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:50:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:16 smithi007 bash[22722]: cephadm 2024-09-14T03:50:15.228612+0000 mgr.a (mgr.14355) 14244 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:50:17.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:17.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:17 smithi131 bash[24745]: cluster 2024-09-14T03:50:15.834965+0000 mgr.a (mgr.14355) 14245 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:17 smithi171 bash[25040]: cluster 2024-09-14T03:50:15.834965+0000 mgr.a (mgr.14355) 14245 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:17.801 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:17 smithi007 bash[22722]: cluster 2024-09-14T03:50:15.834965+0000 mgr.a (mgr.14355) 14245 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:18 smithi131 bash[24745]: audit 2024-09-14T03:50:17.369762+0000 mgr.a (mgr.14355) 14246 : audit [DBG] from='client.309057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:18 smithi171 bash[25040]: audit 2024-09-14T03:50:17.369762+0000 mgr.a (mgr.14355) 14246 : audit [DBG] from='client.309057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:18 smithi007 bash[22722]: audit 2024-09-14T03:50:17.369762+0000 mgr.a (mgr.14355) 14246 : audit [DBG] from='client.309057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:19 smithi131 bash[24745]: cluster 2024-09-14T03:50:17.835932+0000 mgr.a (mgr.14355) 14247 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:19 smithi171 bash[25040]: cluster 2024-09-14T03:50:17.835932+0000 mgr.a (mgr.14355) 14247 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:19 smithi007 bash[22722]: cluster 2024-09-14T03:50:17.835932+0000 mgr.a (mgr.14355) 14247 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:21 smithi171 bash[25040]: cluster 2024-09-14T03:50:19.836752+0000 mgr.a (mgr.14355) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:21 smithi007 bash[22722]: cluster 2024-09-14T03:50:19.836752+0000 mgr.a (mgr.14355) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:21 smithi131 bash[24745]: cluster 2024-09-14T03:50:19.836752+0000 mgr.a (mgr.14355) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:22.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:22.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:22.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:23.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:23.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:23.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:23.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:23.578 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:23 smithi171 bash[25040]: cluster 2024-09-14T03:50:21.838997+0000 mgr.a (mgr.14355) 14249 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:23 smithi007 bash[22722]: cluster 2024-09-14T03:50:21.838997+0000 mgr.a (mgr.14355) 14249 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:23 smithi131 bash[24745]: cluster 2024-09-14T03:50:21.838997+0000 mgr.a (mgr.14355) 14249 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:24 smithi171 bash[25040]: audit 2024-09-14T03:50:23.139415+0000 mgr.a (mgr.14355) 14250 : audit [DBG] from='client.309135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:24 smithi007 bash[22722]: audit 2024-09-14T03:50:23.139415+0000 mgr.a (mgr.14355) 14250 : audit [DBG] from='client.309135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:24 smithi131 bash[24745]: audit 2024-09-14T03:50:23.139415+0000 mgr.a (mgr.14355) 14250 : audit [DBG] from='client.309135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:25 smithi007 bash[22722]: cluster 2024-09-14T03:50:23.839950+0000 mgr.a (mgr.14355) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:25 smithi131 bash[24745]: cluster 2024-09-14T03:50:23.839950+0000 mgr.a (mgr.14355) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:25 smithi171 bash[25040]: cluster 2024-09-14T03:50:23.839950+0000 mgr.a (mgr.14355) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:27 smithi007 bash[22722]: cluster 2024-09-14T03:50:25.842204+0000 mgr.a (mgr.14355) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:27 smithi131 bash[24745]: cluster 2024-09-14T03:50:25.842204+0000 mgr.a (mgr.14355) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:27 smithi171 bash[25040]: cluster 2024-09-14T03:50:25.842204+0000 mgr.a (mgr.14355) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:50:28.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:28.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:28.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:29.341 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:29.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:29 smithi007 bash[22722]: cluster 2024-09-14T03:50:27.842948+0000 mgr.a (mgr.14355) 14253 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:29 smithi131 bash[24745]: cluster 2024-09-14T03:50:27.842948+0000 mgr.a (mgr.14355) 14253 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:29 smithi171 bash[25040]: cluster 2024-09-14T03:50:27.842948+0000 mgr.a (mgr.14355) 14253 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:30 smithi007 bash[22722]: audit 2024-09-14T03:50:28.914875+0000 mgr.a (mgr.14355) 14254 : audit [DBG] from='client.309210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:30 smithi131 bash[24745]: audit 2024-09-14T03:50:28.914875+0000 mgr.a (mgr.14355) 14254 : audit [DBG] from='client.309210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:30 smithi171 bash[25040]: audit 2024-09-14T03:50:28.914875+0000 mgr.a (mgr.14355) 14254 : audit [DBG] from='client.309210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:31 smithi007 bash[22722]: cluster 2024-09-14T03:50:29.843995+0000 mgr.a (mgr.14355) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:31 smithi131 bash[24745]: cluster 2024-09-14T03:50:29.843995+0000 mgr.a (mgr.14355) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:31 smithi171 bash[25040]: cluster 2024-09-14T03:50:29.843995+0000 mgr.a (mgr.14355) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:33 smithi007 bash[22722]: cluster 2024-09-14T03:50:31.846257+0000 mgr.a (mgr.14355) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:33 smithi131 bash[24745]: cluster 2024-09-14T03:50:31.846257+0000 mgr.a (mgr.14355) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:33 smithi171 bash[25040]: cluster 2024-09-14T03:50:31.846257+0000 mgr.a (mgr.14355) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:34.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:34.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:34.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:35.091 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:35.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:35 smithi007 bash[22722]: cluster 2024-09-14T03:50:33.847149+0000 mgr.a (mgr.14355) 14257 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:35 smithi131 bash[24745]: cluster 2024-09-14T03:50:33.847149+0000 mgr.a (mgr.14355) 14257 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:35 smithi171 bash[25040]: cluster 2024-09-14T03:50:33.847149+0000 mgr.a (mgr.14355) 14257 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:36 smithi007 bash[22722]: audit 2024-09-14T03:50:34.673786+0000 mgr.a (mgr.14355) 14258 : audit [DBG] from='client.309288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:36 smithi131 bash[24745]: audit 2024-09-14T03:50:34.673786+0000 mgr.a (mgr.14355) 14258 : audit [DBG] from='client.309288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:36 smithi171 bash[25040]: audit 2024-09-14T03:50:34.673786+0000 mgr.a (mgr.14355) 14258 : audit [DBG] from='client.309288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:37 smithi007 bash[22722]: cluster 2024-09-14T03:50:35.849473+0000 mgr.a (mgr.14355) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:37 smithi131 bash[24745]: cluster 2024-09-14T03:50:35.849473+0000 mgr.a (mgr.14355) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:37 smithi171 bash[25040]: cluster 2024-09-14T03:50:35.849473+0000 mgr.a (mgr.14355) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:39 smithi007 bash[22722]: cluster 2024-09-14T03:50:37.850244+0000 mgr.a (mgr.14355) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:39 smithi131 bash[24745]: cluster 2024-09-14T03:50:37.850244+0000 mgr.a (mgr.14355) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:39 smithi171 bash[25040]: cluster 2024-09-14T03:50:37.850244+0000 mgr.a (mgr.14355) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:40.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:40.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:40.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:41 smithi007 bash[22722]: cluster 2024-09-14T03:50:39.851002+0000 mgr.a (mgr.14355) 14261 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:41 smithi007 bash[22722]: audit 2024-09-14T03:50:40.420374+0000 mgr.a (mgr.14355) 14262 : audit [DBG] from='client.309366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:41 smithi131 bash[24745]: cluster 2024-09-14T03:50:39.851002+0000 mgr.a (mgr.14355) 14261 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:41 smithi131 bash[24745]: audit 2024-09-14T03:50:40.420374+0000 mgr.a (mgr.14355) 14262 : audit [DBG] from='client.309366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:41 smithi171 bash[25040]: cluster 2024-09-14T03:50:39.851002+0000 mgr.a (mgr.14355) 14261 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:41 smithi171 bash[25040]: audit 2024-09-14T03:50:40.420374+0000 mgr.a (mgr.14355) 14262 : audit [DBG] from='client.309366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:43 smithi007 bash[22722]: cluster 2024-09-14T03:50:41.853648+0000 mgr.a (mgr.14355) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:43 smithi131 bash[24745]: cluster 2024-09-14T03:50:41.853648+0000 mgr.a (mgr.14355) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:43 smithi171 bash[25040]: cluster 2024-09-14T03:50:41.853648+0000 mgr.a (mgr.14355) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:45.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:45 smithi007 bash[22722]: cluster 2024-09-14T03:50:43.854460+0000 mgr.a (mgr.14355) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:45 smithi131 bash[24745]: cluster 2024-09-14T03:50:43.854460+0000 mgr.a (mgr.14355) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:45 smithi171 bash[25040]: cluster 2024-09-14T03:50:43.854460+0000 mgr.a (mgr.14355) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:46.631 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:46.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:47 smithi007 bash[22722]: cluster 2024-09-14T03:50:45.856424+0000 mgr.a (mgr.14355) 14265 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:47 smithi007 bash[22722]: audit 2024-09-14T03:50:46.184835+0000 mgr.a (mgr.14355) 14266 : audit [DBG] from='client.309441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:47 smithi131 bash[24745]: cluster 2024-09-14T03:50:45.856424+0000 mgr.a (mgr.14355) 14265 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:47 smithi131 bash[24745]: audit 2024-09-14T03:50:46.184835+0000 mgr.a (mgr.14355) 14266 : audit [DBG] from='client.309441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:47 smithi171 bash[25040]: cluster 2024-09-14T03:50:45.856424+0000 mgr.a (mgr.14355) 14265 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:47 smithi171 bash[25040]: audit 2024-09-14T03:50:46.184835+0000 mgr.a (mgr.14355) 14266 : audit [DBG] from='client.309441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:49 smithi007 bash[22722]: cluster 2024-09-14T03:50:47.857325+0000 mgr.a (mgr.14355) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:49 smithi131 bash[24745]: cluster 2024-09-14T03:50:47.857325+0000 mgr.a (mgr.14355) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:49 smithi171 bash[25040]: cluster 2024-09-14T03:50:47.857325+0000 mgr.a (mgr.14355) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:50:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:50 smithi007 bash[22722]: cluster 2024-09-14T03:50:49.858147+0000 mgr.a (mgr.14355) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:50 smithi131 bash[24745]: cluster 2024-09-14T03:50:49.858147+0000 mgr.a (mgr.14355) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:50 smithi171 bash[25040]: cluster 2024-09-14T03:50:49.858147+0000 mgr.a (mgr.14355) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:50:51.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:51.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:51.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:52.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:52.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:52 smithi007 bash[22722]: cluster 2024-09-14T03:50:51.859949+0000 mgr.a (mgr.14355) 14269 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:52 smithi007 bash[22722]: audit 2024-09-14T03:50:51.971438+0000 mgr.a (mgr.14355) 14270 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:52 smithi131 bash[24745]: cluster 2024-09-14T03:50:51.859949+0000 mgr.a (mgr.14355) 14269 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:52 smithi131 bash[24745]: audit 2024-09-14T03:50:51.971438+0000 mgr.a (mgr.14355) 14270 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:52 smithi171 bash[25040]: cluster 2024-09-14T03:50:51.859949+0000 mgr.a (mgr.14355) 14269 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:52 smithi171 bash[25040]: audit 2024-09-14T03:50:51.971438+0000 mgr.a (mgr.14355) 14270 : audit [DBG] from='client.309516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:54 smithi007 bash[22722]: cluster 2024-09-14T03:50:53.860843+0000 mgr.a (mgr.14355) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:54 smithi131 bash[24745]: cluster 2024-09-14T03:50:53.860843+0000 mgr.a (mgr.14355) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:54 smithi171 bash[25040]: cluster 2024-09-14T03:50:53.860843+0000 mgr.a (mgr.14355) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:56 smithi007 bash[22722]: cluster 2024-09-14T03:50:55.863028+0000 mgr.a (mgr.14355) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:57.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:56 smithi131 bash[24745]: cluster 2024-09-14T03:50:55.863028+0000 mgr.a (mgr.14355) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:56 smithi171 bash[25040]: cluster 2024-09-14T03:50:55.863028+0000 mgr.a (mgr.14355) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:50:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:50:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:50:57.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:50:58.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:50:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:50:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:50:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:50:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:50:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:58 smithi007 bash[22722]: audit 2024-09-14T03:50:57.743420+0000 mgr.a (mgr.14355) 14273 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:50:58 smithi007 bash[22722]: cluster 2024-09-14T03:50:57.863566+0000 mgr.a (mgr.14355) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:58 smithi131 bash[24745]: audit 2024-09-14T03:50:57.743420+0000 mgr.a (mgr.14355) 14273 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:50:58 smithi131 bash[24745]: cluster 2024-09-14T03:50:57.863566+0000 mgr.a (mgr.14355) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:50:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:58 smithi171 bash[25040]: audit 2024-09-14T03:50:57.743420+0000 mgr.a (mgr.14355) 14273 : audit [DBG] from='client.309594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:50:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:50:58 smithi171 bash[25040]: cluster 2024-09-14T03:50:57.863566+0000 mgr.a (mgr.14355) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:00 smithi007 bash[22722]: cluster 2024-09-14T03:50:59.864432+0000 mgr.a (mgr.14355) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:00 smithi131 bash[24745]: cluster 2024-09-14T03:50:59.864432+0000 mgr.a (mgr.14355) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:00 smithi171 bash[25040]: cluster 2024-09-14T03:50:59.864432+0000 mgr.a (mgr.14355) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:03.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:03.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:03.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:02 smithi007 bash[22722]: cluster 2024-09-14T03:51:01.866678+0000 mgr.a (mgr.14355) 14276 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:02 smithi131 bash[24745]: cluster 2024-09-14T03:51:01.866678+0000 mgr.a (mgr.14355) 14276 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:02 smithi171 bash[25040]: cluster 2024-09-14T03:51:01.866678+0000 mgr.a (mgr.14355) 14276 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:03.928 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:03.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:03.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:03.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:03.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:03 smithi007 bash[22722]: audit 2024-09-14T03:51:03.519339+0000 mgr.a (mgr.14355) 14277 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:03 smithi131 bash[24745]: audit 2024-09-14T03:51:03.519339+0000 mgr.a (mgr.14355) 14277 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:03 smithi171 bash[25040]: audit 2024-09-14T03:51:03.519339+0000 mgr.a (mgr.14355) 14277 : audit [DBG] from='client.309672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:04 smithi007 bash[22722]: cluster 2024-09-14T03:51:03.867186+0000 mgr.a (mgr.14355) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:04 smithi131 bash[24745]: cluster 2024-09-14T03:51:03.867186+0000 mgr.a (mgr.14355) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:04 smithi171 bash[25040]: cluster 2024-09-14T03:51:03.867186+0000 mgr.a (mgr.14355) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:06 smithi007 bash[22722]: cluster 2024-09-14T03:51:05.869319+0000 mgr.a (mgr.14355) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:06 smithi131 bash[24745]: cluster 2024-09-14T03:51:05.869319+0000 mgr.a (mgr.14355) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:06 smithi171 bash[25040]: cluster 2024-09-14T03:51:05.869319+0000 mgr.a (mgr.14355) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:08.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:08.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:08 smithi131 bash[24745]: cluster 2024-09-14T03:51:07.870048+0000 mgr.a (mgr.14355) 14280 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:08 smithi171 bash[25040]: cluster 2024-09-14T03:51:07.870048+0000 mgr.a (mgr.14355) 14280 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:08 smithi007 bash[22722]: cluster 2024-09-14T03:51:07.870048+0000 mgr.a (mgr.14355) 14280 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:09.681 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:09 smithi131 bash[24745]: audit 2024-09-14T03:51:09.256896+0000 mgr.a (mgr.14355) 14281 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:09 smithi171 bash[25040]: audit 2024-09-14T03:51:09.256896+0000 mgr.a (mgr.14355) 14281 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:09 smithi007 bash[22722]: audit 2024-09-14T03:51:09.256896+0000 mgr.a (mgr.14355) 14281 : audit [DBG] from='client.309750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:10 smithi131 bash[24745]: cluster 2024-09-14T03:51:09.870909+0000 mgr.a (mgr.14355) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:10 smithi171 bash[25040]: cluster 2024-09-14T03:51:09.870909+0000 mgr.a (mgr.14355) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:10 smithi007 bash[22722]: cluster 2024-09-14T03:51:09.870909+0000 mgr.a (mgr.14355) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:12 smithi131 bash[24745]: cluster 2024-09-14T03:51:11.873125+0000 mgr.a (mgr.14355) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:12 smithi171 bash[25040]: cluster 2024-09-14T03:51:11.873125+0000 mgr.a (mgr.14355) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:12 smithi007 bash[22722]: cluster 2024-09-14T03:51:11.873125+0000 mgr.a (mgr.14355) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:14.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:14.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:14 smithi131 bash[24745]: cluster 2024-09-14T03:51:13.873868+0000 mgr.a (mgr.14355) 14284 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:14 smithi171 bash[25040]: cluster 2024-09-14T03:51:13.873868+0000 mgr.a (mgr.14355) 14284 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:15.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:15.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:15.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:14 smithi007 bash[22722]: cluster 2024-09-14T03:51:13.873868+0000 mgr.a (mgr.14355) 14284 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:15 smithi131 bash[24745]: audit 2024-09-14T03:51:15.017107+0000 mgr.a (mgr.14355) 14285 : audit [DBG] from='client.309825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:15 smithi131 bash[24745]: audit 2024-09-14T03:51:15.283131+0000 mon.a (mon.0) 2719 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:51:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:15 smithi131 bash[24745]: audit 2024-09-14T03:51:15.848317+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:15 smithi131 bash[24745]: audit 2024-09-14T03:51:15.851614+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:15 smithi171 bash[25040]: audit 2024-09-14T03:51:15.017107+0000 mgr.a (mgr.14355) 14285 : audit [DBG] from='client.309825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:15 smithi171 bash[25040]: audit 2024-09-14T03:51:15.283131+0000 mon.a (mon.0) 2719 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:51:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:15 smithi171 bash[25040]: audit 2024-09-14T03:51:15.848317+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:15 smithi171 bash[25040]: audit 2024-09-14T03:51:15.851614+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:15 smithi007 bash[22722]: audit 2024-09-14T03:51:15.017107+0000 mgr.a (mgr.14355) 14285 : audit [DBG] from='client.309825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:15 smithi007 bash[22722]: audit 2024-09-14T03:51:15.283131+0000 mon.a (mon.0) 2719 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:51:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:15 smithi007 bash[22722]: audit 2024-09-14T03:51:15.848317+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:15 smithi007 bash[22722]: audit 2024-09-14T03:51:15.851614+0000 mon.a (mon.0) 2721 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: cluster 2024-09-14T03:51:15.875094+0000 mgr.a (mgr.14355) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:51:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: audit 2024-09-14T03:51:16.464529+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:51:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: audit 2024-09-14T03:51:16.465911+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:51:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: audit 2024-09-14T03:51:16.474211+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: audit 2024-09-14T03:51:16.476317+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:16 smithi131 bash[24745]: audit 2024-09-14T03:51:16.478671+0000 mgr.a (mgr.14355) 14287 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: cluster 2024-09-14T03:51:15.875094+0000 mgr.a (mgr.14355) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: audit 2024-09-14T03:51:16.464529+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: audit 2024-09-14T03:51:16.465911+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: audit 2024-09-14T03:51:16.474211+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: audit 2024-09-14T03:51:16.476317+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:16 smithi171 bash[25040]: audit 2024-09-14T03:51:16.478671+0000 mgr.a (mgr.14355) 14287 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:17.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:51:17 smithi007 bash[22972]: debug 2024-09-14T03:51:17.197+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:51:17 smithi007 bash[22972]: debug 2024-09-14T03:51:17.197+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: cluster 2024-09-14T03:51:15.875094+0000 mgr.a (mgr.14355) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: audit 2024-09-14T03:51:16.464529+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: audit 2024-09-14T03:51:16.465911+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: audit 2024-09-14T03:51:16.474211+0000 mon.a (mon.0) 2724 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: audit 2024-09-14T03:51:16.476317+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:16 smithi007 bash[22722]: audit 2024-09-14T03:51:16.478671+0000 mgr.a (mgr.14355) 14287 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:17 smithi131 bash[24745]: audit 2024-09-14T03:51:17.200458+0000 mgr.a (mgr.14355) 14288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:51:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:17 smithi131 bash[24745]: cephadm 2024-09-14T03:51:17.201986+0000 mgr.a (mgr.14355) 14289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:51:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:17 smithi171 bash[25040]: audit 2024-09-14T03:51:17.200458+0000 mgr.a (mgr.14355) 14288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:51:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:17 smithi171 bash[25040]: cephadm 2024-09-14T03:51:17.201986+0000 mgr.a (mgr.14355) 14289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:51:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:17 smithi007 bash[22722]: audit 2024-09-14T03:51:17.200458+0000 mgr.a (mgr.14355) 14288 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:51:18.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:17 smithi007 bash[22722]: cephadm 2024-09-14T03:51:17.201986+0000 mgr.a (mgr.14355) 14289 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:51:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:18 smithi131 bash[24745]: cluster 2024-09-14T03:51:17.875915+0000 mgr.a (mgr.14355) 14290 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:18 smithi171 bash[25040]: cluster 2024-09-14T03:51:17.875915+0000 mgr.a (mgr.14355) 14290 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:18 smithi007 bash[22722]: cluster 2024-09-14T03:51:17.875915+0000 mgr.a (mgr.14355) 14290 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:20.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:21.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:21.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:21.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:20 smithi131 bash[24745]: cluster 2024-09-14T03:51:19.876680+0000 mgr.a (mgr.14355) 14291 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:20 smithi171 bash[25040]: cluster 2024-09-14T03:51:19.876680+0000 mgr.a (mgr.14355) 14291 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:20 smithi007 bash[22722]: cluster 2024-09-14T03:51:19.876680+0000 mgr.a (mgr.14355) 14291 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:51:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:22 smithi131 bash[24745]: audit 2024-09-14T03:51:20.780145+0000 mgr.a (mgr.14355) 14292 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:22 smithi171 bash[25040]: audit 2024-09-14T03:51:20.780145+0000 mgr.a (mgr.14355) 14292 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:22 smithi007 bash[22722]: audit 2024-09-14T03:51:20.780145+0000 mgr.a (mgr.14355) 14292 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:23 smithi131 bash[24745]: cluster 2024-09-14T03:51:21.879392+0000 mgr.a (mgr.14355) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:23 smithi171 bash[25040]: cluster 2024-09-14T03:51:21.879392+0000 mgr.a (mgr.14355) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:23 smithi007 bash[22722]: cluster 2024-09-14T03:51:21.879392+0000 mgr.a (mgr.14355) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:25 smithi007 bash[22722]: cluster 2024-09-14T03:51:23.880178+0000 mgr.a (mgr.14355) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:25 smithi131 bash[24745]: cluster 2024-09-14T03:51:23.880178+0000 mgr.a (mgr.14355) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:25 smithi171 bash[25040]: cluster 2024-09-14T03:51:23.880178+0000 mgr.a (mgr.14355) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:26.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:26.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:26.974 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:27 smithi131 bash[24745]: cluster 2024-09-14T03:51:25.882175+0000 mgr.a (mgr.14355) 14295 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:27 smithi131 bash[24745]: audit 2024-09-14T03:51:26.561180+0000 mgr.a (mgr.14355) 14296 : audit [DBG] from='client.310086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:27 smithi171 bash[25040]: cluster 2024-09-14T03:51:25.882175+0000 mgr.a (mgr.14355) 14295 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:27 smithi171 bash[25040]: audit 2024-09-14T03:51:26.561180+0000 mgr.a (mgr.14355) 14296 : audit [DBG] from='client.310086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:27 smithi007 bash[22722]: cluster 2024-09-14T03:51:25.882175+0000 mgr.a (mgr.14355) 14295 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:27 smithi007 bash[22722]: audit 2024-09-14T03:51:26.561180+0000 mgr.a (mgr.14355) 14296 : audit [DBG] from='client.310086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:29 smithi131 bash[24745]: cluster 2024-09-14T03:51:27.883138+0000 mgr.a (mgr.14355) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:29 smithi171 bash[25040]: cluster 2024-09-14T03:51:27.883138+0000 mgr.a (mgr.14355) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:29 smithi007 bash[22722]: cluster 2024-09-14T03:51:27.883138+0000 mgr.a (mgr.14355) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:31 smithi131 bash[24745]: cluster 2024-09-14T03:51:29.883918+0000 mgr.a (mgr.14355) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:31 smithi171 bash[25040]: cluster 2024-09-14T03:51:29.883918+0000 mgr.a (mgr.14355) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:31 smithi007 bash[22722]: cluster 2024-09-14T03:51:29.883918+0000 mgr.a (mgr.14355) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:51:31.975 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:31.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:32.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:32.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:33 smithi131 bash[24745]: cluster 2024-09-14T03:51:31.886163+0000 mgr.a (mgr.14355) 14299 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:33 smithi131 bash[24745]: audit 2024-09-14T03:51:32.308695+0000 mgr.a (mgr.14355) 14300 : audit [DBG] from='client.310161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:33 smithi171 bash[25040]: cluster 2024-09-14T03:51:31.886163+0000 mgr.a (mgr.14355) 14299 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:33 smithi171 bash[25040]: audit 2024-09-14T03:51:32.308695+0000 mgr.a (mgr.14355) 14300 : audit [DBG] from='client.310161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:33 smithi007 bash[22722]: cluster 2024-09-14T03:51:31.886163+0000 mgr.a (mgr.14355) 14299 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:51:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:33 smithi007 bash[22722]: audit 2024-09-14T03:51:32.308695+0000 mgr.a (mgr.14355) 14300 : audit [DBG] from='client.310161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:35 smithi131 bash[24745]: cluster 2024-09-14T03:51:33.887131+0000 mgr.a (mgr.14355) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:35 smithi171 bash[25040]: cluster 2024-09-14T03:51:33.887131+0000 mgr.a (mgr.14355) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:35 smithi007 bash[22722]: cluster 2024-09-14T03:51:33.887131+0000 mgr.a (mgr.14355) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:37.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:37.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:37 smithi131 bash[24745]: cluster 2024-09-14T03:51:35.889374+0000 mgr.a (mgr.14355) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:37 smithi171 bash[25040]: cluster 2024-09-14T03:51:35.889374+0000 mgr.a (mgr.14355) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:37 smithi007 bash[22722]: cluster 2024-09-14T03:51:35.889374+0000 mgr.a (mgr.14355) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:38.494 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:38.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:39 smithi131 bash[24745]: cluster 2024-09-14T03:51:37.889917+0000 mgr.a (mgr.14355) 14303 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:39 smithi131 bash[24745]: audit 2024-09-14T03:51:38.076212+0000 mgr.a (mgr.14355) 14304 : audit [DBG] from='client.310233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:39 smithi171 bash[25040]: cluster 2024-09-14T03:51:37.889917+0000 mgr.a (mgr.14355) 14303 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:39 smithi171 bash[25040]: audit 2024-09-14T03:51:38.076212+0000 mgr.a (mgr.14355) 14304 : audit [DBG] from='client.310233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:39 smithi007 bash[22722]: cluster 2024-09-14T03:51:37.889917+0000 mgr.a (mgr.14355) 14303 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:39 smithi007 bash[22722]: audit 2024-09-14T03:51:38.076212+0000 mgr.a (mgr.14355) 14304 : audit [DBG] from='client.310233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:41 smithi131 bash[24745]: cluster 2024-09-14T03:51:39.890923+0000 mgr.a (mgr.14355) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:41 smithi171 bash[25040]: cluster 2024-09-14T03:51:39.890923+0000 mgr.a (mgr.14355) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:41 smithi007 bash[22722]: cluster 2024-09-14T03:51:39.890923+0000 mgr.a (mgr.14355) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:43.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:43.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:43 smithi131 bash[24745]: cluster 2024-09-14T03:51:41.893133+0000 mgr.a (mgr.14355) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:43 smithi171 bash[25040]: cluster 2024-09-14T03:51:41.893133+0000 mgr.a (mgr.14355) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:43 smithi007 bash[22722]: cluster 2024-09-14T03:51:41.893133+0000 mgr.a (mgr.14355) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:44.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:44.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:44.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:44.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:44.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:45 smithi131 bash[24745]: audit 2024-09-14T03:51:43.824640+0000 mgr.a (mgr.14355) 14307 : audit [DBG] from='client.310311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:45 smithi131 bash[24745]: cluster 2024-09-14T03:51:43.893709+0000 mgr.a (mgr.14355) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:45 smithi171 bash[25040]: audit 2024-09-14T03:51:43.824640+0000 mgr.a (mgr.14355) 14307 : audit [DBG] from='client.310311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:45 smithi171 bash[25040]: cluster 2024-09-14T03:51:43.893709+0000 mgr.a (mgr.14355) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:45 smithi007 bash[22722]: audit 2024-09-14T03:51:43.824640+0000 mgr.a (mgr.14355) 14307 : audit [DBG] from='client.310311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:45 smithi007 bash[22722]: cluster 2024-09-14T03:51:43.893709+0000 mgr.a (mgr.14355) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:47 smithi131 bash[24745]: cluster 2024-09-14T03:51:45.896115+0000 mgr.a (mgr.14355) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:47 smithi171 bash[25040]: cluster 2024-09-14T03:51:45.896115+0000 mgr.a (mgr.14355) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:47 smithi007 bash[22722]: cluster 2024-09-14T03:51:45.896115+0000 mgr.a (mgr.14355) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:49.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:49.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:49.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:49 smithi131 bash[24745]: cluster 2024-09-14T03:51:47.896868+0000 mgr.a (mgr.14355) 14310 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:49 smithi171 bash[25040]: cluster 2024-09-14T03:51:47.896868+0000 mgr.a (mgr.14355) 14310 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:49 smithi007 bash[22722]: cluster 2024-09-14T03:51:47.896868+0000 mgr.a (mgr.14355) 14310 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:50.022 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:50.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:50.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:50.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:50.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:50 smithi131 bash[24745]: audit 2024-09-14T03:51:49.586886+0000 mgr.a (mgr.14355) 14311 : audit [DBG] from='client.310389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:50 smithi171 bash[25040]: audit 2024-09-14T03:51:49.586886+0000 mgr.a (mgr.14355) 14311 : audit [DBG] from='client.310389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:50 smithi007 bash[22722]: audit 2024-09-14T03:51:49.586886+0000 mgr.a (mgr.14355) 14311 : audit [DBG] from='client.310389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:51 smithi131 bash[24745]: cluster 2024-09-14T03:51:49.897326+0000 mgr.a (mgr.14355) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:51 smithi171 bash[25040]: cluster 2024-09-14T03:51:49.897326+0000 mgr.a (mgr.14355) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:51 smithi007 bash[22722]: cluster 2024-09-14T03:51:49.897326+0000 mgr.a (mgr.14355) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:53 smithi131 bash[24745]: cluster 2024-09-14T03:51:51.899657+0000 mgr.a (mgr.14355) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:53 smithi171 bash[25040]: cluster 2024-09-14T03:51:51.899657+0000 mgr.a (mgr.14355) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:53 smithi007 bash[22722]: cluster 2024-09-14T03:51:51.899657+0000 mgr.a (mgr.14355) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:51:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:51:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:51:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:51:55.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:51:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:51:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:51:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:51:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:51:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:55 smithi131 bash[24745]: cluster 2024-09-14T03:51:53.900449+0000 mgr.a (mgr.14355) 14314 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:55 smithi171 bash[25040]: cluster 2024-09-14T03:51:53.900449+0000 mgr.a (mgr.14355) 14314 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:55 smithi007 bash[22722]: cluster 2024-09-14T03:51:53.900449+0000 mgr.a (mgr.14355) 14314 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:56 smithi131 bash[24745]: audit 2024-09-14T03:51:55.356335+0000 mgr.a (mgr.14355) 14315 : audit [DBG] from='client.310467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:56 smithi171 bash[25040]: audit 2024-09-14T03:51:55.356335+0000 mgr.a (mgr.14355) 14315 : audit [DBG] from='client.310467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:56 smithi007 bash[22722]: audit 2024-09-14T03:51:55.356335+0000 mgr.a (mgr.14355) 14315 : audit [DBG] from='client.310467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:51:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:57 smithi171 bash[25040]: cluster 2024-09-14T03:51:55.903316+0000 mgr.a (mgr.14355) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:57 smithi007 bash[22722]: cluster 2024-09-14T03:51:55.903316+0000 mgr.a (mgr.14355) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:57 smithi131 bash[24745]: cluster 2024-09-14T03:51:55.903316+0000 mgr.a (mgr.14355) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:51:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:51:59 smithi171 bash[25040]: cluster 2024-09-14T03:51:57.904123+0000 mgr.a (mgr.14355) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:51:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:51:59 smithi007 bash[22722]: cluster 2024-09-14T03:51:57.904123+0000 mgr.a (mgr.14355) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:51:59 smithi131 bash[24745]: cluster 2024-09-14T03:51:57.904123+0000 mgr.a (mgr.14355) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:00.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:00.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:01.533 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:01.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:01 smithi171 bash[25040]: cluster 2024-09-14T03:51:59.904905+0000 mgr.a (mgr.14355) 14318 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:01 smithi007 bash[22722]: cluster 2024-09-14T03:51:59.904905+0000 mgr.a (mgr.14355) 14318 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:01 smithi131 bash[24745]: cluster 2024-09-14T03:51:59.904905+0000 mgr.a (mgr.14355) 14318 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:02 smithi007 bash[22722]: audit 2024-09-14T03:52:01.104816+0000 mgr.a (mgr.14355) 14319 : audit [DBG] from='client.310545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:02 smithi131 bash[24745]: audit 2024-09-14T03:52:01.104816+0000 mgr.a (mgr.14355) 14319 : audit [DBG] from='client.310545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:02 smithi171 bash[25040]: audit 2024-09-14T03:52:01.104816+0000 mgr.a (mgr.14355) 14319 : audit [DBG] from='client.310545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:03.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:03 smithi007 bash[22722]: cluster 2024-09-14T03:52:01.907786+0000 mgr.a (mgr.14355) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:03 smithi131 bash[24745]: cluster 2024-09-14T03:52:01.907786+0000 mgr.a (mgr.14355) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:03 smithi171 bash[25040]: cluster 2024-09-14T03:52:01.907786+0000 mgr.a (mgr.14355) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:05 smithi007 bash[22722]: cluster 2024-09-14T03:52:03.908587+0000 mgr.a (mgr.14355) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:52:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:05 smithi131 bash[24745]: cluster 2024-09-14T03:52:03.908587+0000 mgr.a (mgr.14355) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:52:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:05 smithi171 bash[25040]: cluster 2024-09-14T03:52:03.908587+0000 mgr.a (mgr.14355) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-14T03:52:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:07.326 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:07.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:07 smithi007 bash[22722]: cluster 2024-09-14T03:52:05.910789+0000 mgr.a (mgr.14355) 14322 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:07 smithi131 bash[24745]: cluster 2024-09-14T03:52:05.910789+0000 mgr.a (mgr.14355) 14322 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:07 smithi171 bash[25040]: cluster 2024-09-14T03:52:05.910789+0000 mgr.a (mgr.14355) 14322 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:08 smithi007 bash[22722]: audit 2024-09-14T03:52:06.872659+0000 mgr.a (mgr.14355) 14323 : audit [DBG] from='client.310620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:08 smithi131 bash[24745]: audit 2024-09-14T03:52:06.872659+0000 mgr.a (mgr.14355) 14323 : audit [DBG] from='client.310620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:09.049 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:08 smithi171 bash[25040]: audit 2024-09-14T03:52:06.872659+0000 mgr.a (mgr.14355) 14323 : audit [DBG] from='client.310620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:09 smithi007 bash[22722]: cluster 2024-09-14T03:52:07.911771+0000 mgr.a (mgr.14355) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:09 smithi131 bash[24745]: cluster 2024-09-14T03:52:07.911771+0000 mgr.a (mgr.14355) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:09 smithi171 bash[25040]: cluster 2024-09-14T03:52:07.911771+0000 mgr.a (mgr.14355) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:11 smithi007 bash[22722]: cluster 2024-09-14T03:52:09.912726+0000 mgr.a (mgr.14355) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:11 smithi131 bash[24745]: cluster 2024-09-14T03:52:09.912726+0000 mgr.a (mgr.14355) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:11 smithi171 bash[25040]: cluster 2024-09-14T03:52:09.912726+0000 mgr.a (mgr.14355) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T03:52:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:12.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:13.106 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:13.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:13.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:13 smithi007 bash[22722]: cluster 2024-09-14T03:52:11.915140+0000 mgr.a (mgr.14355) 14326 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:52:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:13 smithi131 bash[24745]: cluster 2024-09-14T03:52:11.915140+0000 mgr.a (mgr.14355) 14326 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:52:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:13 smithi171 bash[25040]: cluster 2024-09-14T03:52:11.915140+0000 mgr.a (mgr.14355) 14326 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T03:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:14 smithi007 bash[22722]: audit 2024-09-14T03:52:12.663865+0000 mgr.a (mgr.14355) 14327 : audit [DBG] from='client.310698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:14 smithi131 bash[24745]: audit 2024-09-14T03:52:12.663865+0000 mgr.a (mgr.14355) 14327 : audit [DBG] from='client.310698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:14 smithi171 bash[25040]: audit 2024-09-14T03:52:12.663865+0000 mgr.a (mgr.14355) 14327 : audit [DBG] from='client.310698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:15 smithi007 bash[22722]: cluster 2024-09-14T03:52:13.916143+0000 mgr.a (mgr.14355) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:15 smithi131 bash[24745]: cluster 2024-09-14T03:52:13.916143+0000 mgr.a (mgr.14355) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:15 smithi171 bash[25040]: cluster 2024-09-14T03:52:13.916143+0000 mgr.a (mgr.14355) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:17 smithi007 bash[22722]: cluster 2024-09-14T03:52:15.918404+0000 mgr.a (mgr.14355) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:17 smithi007 bash[22722]: audit 2024-09-14T03:52:17.254020+0000 mon.a (mon.0) 2726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:52:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:17 smithi131 bash[24745]: cluster 2024-09-14T03:52:15.918404+0000 mgr.a (mgr.14355) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:17 smithi131 bash[24745]: audit 2024-09-14T03:52:17.254020+0000 mon.a (mon.0) 2726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:52:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:17 smithi171 bash[25040]: cluster 2024-09-14T03:52:15.918404+0000 mgr.a (mgr.14355) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:17 smithi171 bash[25040]: audit 2024-09-14T03:52:17.254020+0000 mon.a (mon.0) 2726 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:52:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:18.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:18.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:17.847658+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:17.851885+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:17.872811+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:17.878655+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: cluster 2024-09-14T03:52:17.919167+0000 mgr.a (mgr.14355) 14330 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:18.438927+0000 mgr.a (mgr.14355) 14331 : audit [DBG] from='client.310773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:18.632323+0000 mon.a (mon.0) 2731 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:18.633407+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:18.639147+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:18 smithi007 bash[22722]: audit 2024-09-14T03:52:18.641925+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:17.847658+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:17.851885+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:17.872811+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:17.878655+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: cluster 2024-09-14T03:52:17.919167+0000 mgr.a (mgr.14355) 14330 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:18.438927+0000 mgr.a (mgr.14355) 14331 : audit [DBG] from='client.310773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:18.632323+0000 mon.a (mon.0) 2731 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:18.633407+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:18.639147+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:18 smithi131 bash[24745]: audit 2024-09-14T03:52:18.641925+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:17.847658+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:17.851885+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:17.872811+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:17.878655+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: cluster 2024-09-14T03:52:17.919167+0000 mgr.a (mgr.14355) 14330 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:18.438927+0000 mgr.a (mgr.14355) 14331 : audit [DBG] from='client.310773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:18.632323+0000 mon.a (mon.0) 2731 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:52:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:18.633407+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:52:19.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:18.639147+0000 mon.a (mon.0) 2733 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:52:19.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:18 smithi171 bash[25040]: audit 2024-09-14T03:52:18.641925+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:19.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:19 smithi007 bash[22722]: audit 2024-09-14T03:52:18.643131+0000 mgr.a (mgr.14355) 14332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:19.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:52:19 smithi007 bash[22972]: debug 2024-09-14T03:52:19.644+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:52:19.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:52:19 smithi007 bash[22972]: debug 2024-09-14T03:52:19.648+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:52:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:19 smithi131 bash[24745]: audit 2024-09-14T03:52:18.643131+0000 mgr.a (mgr.14355) 14332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:19 smithi171 bash[25040]: audit 2024-09-14T03:52:18.643131+0000 mgr.a (mgr.14355) 14332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:52:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:20 smithi007 bash[22722]: audit 2024-09-14T03:52:19.649443+0000 mgr.a (mgr.14355) 14333 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:52:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:20 smithi007 bash[22722]: cephadm 2024-09-14T03:52:19.650836+0000 mgr.a (mgr.14355) 14334 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:52:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:20 smithi007 bash[22722]: cluster 2024-09-14T03:52:19.920068+0000 mgr.a (mgr.14355) 14335 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:20 smithi131 bash[24745]: audit 2024-09-14T03:52:19.649443+0000 mgr.a (mgr.14355) 14333 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:52:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:20 smithi131 bash[24745]: cephadm 2024-09-14T03:52:19.650836+0000 mgr.a (mgr.14355) 14334 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:52:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:20 smithi131 bash[24745]: cluster 2024-09-14T03:52:19.920068+0000 mgr.a (mgr.14355) 14335 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:20 smithi171 bash[25040]: audit 2024-09-14T03:52:19.649443+0000 mgr.a (mgr.14355) 14333 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:52:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:20 smithi171 bash[25040]: cephadm 2024-09-14T03:52:19.650836+0000 mgr.a (mgr.14355) 14334 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:52:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:20 smithi171 bash[25040]: cluster 2024-09-14T03:52:19.920068+0000 mgr.a (mgr.14355) 14335 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:22 smithi131 bash[24745]: cluster 2024-09-14T03:52:21.922344+0000 mgr.a (mgr.14355) 14336 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:22 smithi171 bash[25040]: cluster 2024-09-14T03:52:21.922344+0000 mgr.a (mgr.14355) 14336 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:22 smithi007 bash[22722]: cluster 2024-09-14T03:52:21.922344+0000 mgr.a (mgr.14355) 14336 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:23.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:23.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:24.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:24.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:24 smithi131 bash[24745]: cluster 2024-09-14T03:52:23.923121+0000 mgr.a (mgr.14355) 14337 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:24 smithi131 bash[24745]: audit 2024-09-14T03:52:24.271455+0000 mgr.a (mgr.14355) 14338 : audit [DBG] from='client.310953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:24 smithi171 bash[25040]: cluster 2024-09-14T03:52:23.923121+0000 mgr.a (mgr.14355) 14337 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:24 smithi171 bash[25040]: audit 2024-09-14T03:52:24.271455+0000 mgr.a (mgr.14355) 14338 : audit [DBG] from='client.310953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:24 smithi007 bash[22722]: cluster 2024-09-14T03:52:23.923121+0000 mgr.a (mgr.14355) 14337 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:24 smithi007 bash[22722]: audit 2024-09-14T03:52:24.271455+0000 mgr.a (mgr.14355) 14338 : audit [DBG] from='client.310953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:26 smithi131 bash[24745]: cluster 2024-09-14T03:52:25.925465+0000 mgr.a (mgr.14355) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:26 smithi171 bash[25040]: cluster 2024-09-14T03:52:25.925465+0000 mgr.a (mgr.14355) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:26 smithi007 bash[22722]: cluster 2024-09-14T03:52:25.925465+0000 mgr.a (mgr.14355) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 426 B/s wr, 75 op/s 2024-09-14T03:52:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:28 smithi131 bash[24745]: cluster 2024-09-14T03:52:27.926266+0000 mgr.a (mgr.14355) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:28 smithi171 bash[25040]: cluster 2024-09-14T03:52:27.926266+0000 mgr.a (mgr.14355) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:29.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:28 smithi007 bash[22722]: cluster 2024-09-14T03:52:27.926266+0000 mgr.a (mgr.14355) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:29.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:29.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:29.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:30.478 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:30.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:30 smithi131 bash[24745]: cluster 2024-09-14T03:52:29.926857+0000 mgr.a (mgr.14355) 14341 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:30 smithi131 bash[24745]: audit 2024-09-14T03:52:30.031177+0000 mgr.a (mgr.14355) 14342 : audit [DBG] from='client.311031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:30 smithi171 bash[25040]: cluster 2024-09-14T03:52:29.926857+0000 mgr.a (mgr.14355) 14341 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:30 smithi171 bash[25040]: audit 2024-09-14T03:52:30.031177+0000 mgr.a (mgr.14355) 14342 : audit [DBG] from='client.311031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:30 smithi007 bash[22722]: cluster 2024-09-14T03:52:29.926857+0000 mgr.a (mgr.14355) 14341 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:30 smithi007 bash[22722]: audit 2024-09-14T03:52:30.031177+0000 mgr.a (mgr.14355) 14342 : audit [DBG] from='client.311031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:33 smithi131 bash[24745]: cluster 2024-09-14T03:52:31.929558+0000 mgr.a (mgr.14355) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:33 smithi171 bash[25040]: cluster 2024-09-14T03:52:31.929558+0000 mgr.a (mgr.14355) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:32 smithi007 bash[22722]: cluster 2024-09-14T03:52:31.929558+0000 mgr.a (mgr.14355) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-09-14T03:52:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:35 smithi131 bash[24745]: cluster 2024-09-14T03:52:33.930382+0000 mgr.a (mgr.14355) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:35 smithi171 bash[25040]: cluster 2024-09-14T03:52:33.930382+0000 mgr.a (mgr.14355) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:35 smithi007 bash[22722]: cluster 2024-09-14T03:52:33.930382+0000 mgr.a (mgr.14355) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:36.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:36.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:37 smithi131 bash[24745]: audit 2024-09-14T03:52:35.813080+0000 mgr.a (mgr.14355) 14345 : audit [DBG] from='client.311109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:37 smithi131 bash[24745]: cluster 2024-09-14T03:52:35.931708+0000 mgr.a (mgr.14355) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:37 smithi171 bash[25040]: audit 2024-09-14T03:52:35.813080+0000 mgr.a (mgr.14355) 14345 : audit [DBG] from='client.311109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:37 smithi171 bash[25040]: cluster 2024-09-14T03:52:35.931708+0000 mgr.a (mgr.14355) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:37 smithi007 bash[22722]: audit 2024-09-14T03:52:35.813080+0000 mgr.a (mgr.14355) 14345 : audit [DBG] from='client.311109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:37 smithi007 bash[22722]: cluster 2024-09-14T03:52:35.931708+0000 mgr.a (mgr.14355) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:39 smithi131 bash[24745]: cluster 2024-09-14T03:52:37.932562+0000 mgr.a (mgr.14355) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:39 smithi171 bash[25040]: cluster 2024-09-14T03:52:37.932562+0000 mgr.a (mgr.14355) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:39 smithi007 bash[22722]: cluster 2024-09-14T03:52:37.932562+0000 mgr.a (mgr.14355) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:52:41.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:41.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:41.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:41 smithi131 bash[24745]: cluster 2024-09-14T03:52:39.933346+0000 mgr.a (mgr.14355) 14348 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:41 smithi171 bash[25040]: cluster 2024-09-14T03:52:39.933346+0000 mgr.a (mgr.14355) 14348 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:41 smithi007 bash[22722]: cluster 2024-09-14T03:52:39.933346+0000 mgr.a (mgr.14355) 14348 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:52:42.010 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:42.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:42 smithi131 bash[24745]: audit 2024-09-14T03:52:41.587373+0000 mgr.a (mgr.14355) 14349 : audit [DBG] from='client.311184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:42 smithi171 bash[25040]: audit 2024-09-14T03:52:41.587373+0000 mgr.a (mgr.14355) 14349 : audit [DBG] from='client.311184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:42 smithi007 bash[22722]: audit 2024-09-14T03:52:41.587373+0000 mgr.a (mgr.14355) 14349 : audit [DBG] from='client.311184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:43 smithi131 bash[24745]: cluster 2024-09-14T03:52:41.934703+0000 mgr.a (mgr.14355) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:43 smithi171 bash[25040]: cluster 2024-09-14T03:52:41.934703+0000 mgr.a (mgr.14355) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:43 smithi007 bash[22722]: cluster 2024-09-14T03:52:41.934703+0000 mgr.a (mgr.14355) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:45 smithi131 bash[24745]: cluster 2024-09-14T03:52:43.935454+0000 mgr.a (mgr.14355) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:45 smithi171 bash[25040]: cluster 2024-09-14T03:52:43.935454+0000 mgr.a (mgr.14355) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:45 smithi007 bash[22722]: cluster 2024-09-14T03:52:43.935454+0000 mgr.a (mgr.14355) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:47.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:47.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:47.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:47 smithi171 bash[25040]: cluster 2024-09-14T03:52:45.937406+0000 mgr.a (mgr.14355) 14352 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:47 smithi007 bash[22722]: cluster 2024-09-14T03:52:45.937406+0000 mgr.a (mgr.14355) 14352 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:47 smithi131 bash[24745]: cluster 2024-09-14T03:52:45.937406+0000 mgr.a (mgr.14355) 14352 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:47.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:47.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:47.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:48 smithi171 bash[25040]: audit 2024-09-14T03:52:47.339262+0000 mgr.a (mgr.14355) 14353 : audit [DBG] from='client.311259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:48 smithi007 bash[22722]: audit 2024-09-14T03:52:47.339262+0000 mgr.a (mgr.14355) 14353 : audit [DBG] from='client.311259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:48 smithi131 bash[24745]: audit 2024-09-14T03:52:47.339262+0000 mgr.a (mgr.14355) 14353 : audit [DBG] from='client.311259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:49 smithi171 bash[25040]: cluster 2024-09-14T03:52:47.938386+0000 mgr.a (mgr.14355) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:49.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:49 smithi007 bash[22722]: cluster 2024-09-14T03:52:47.938386+0000 mgr.a (mgr.14355) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:49 smithi131 bash[24745]: cluster 2024-09-14T03:52:47.938386+0000 mgr.a (mgr.14355) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:51 smithi007 bash[22722]: cluster 2024-09-14T03:52:49.939169+0000 mgr.a (mgr.14355) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:51 smithi131 bash[24745]: cluster 2024-09-14T03:52:49.939169+0000 mgr.a (mgr.14355) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:51 smithi171 bash[25040]: cluster 2024-09-14T03:52:49.939169+0000 mgr.a (mgr.14355) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:52.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:53 smithi007 bash[22722]: cluster 2024-09-14T03:52:51.941437+0000 mgr.a (mgr.14355) 14356 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:53.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:53.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:53 smithi131 bash[24745]: cluster 2024-09-14T03:52:51.941437+0000 mgr.a (mgr.14355) 14356 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:53 smithi171 bash[25040]: cluster 2024-09-14T03:52:51.941437+0000 mgr.a (mgr.14355) 14356 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:54 smithi007 bash[22722]: audit 2024-09-14T03:52:53.088380+0000 mgr.a (mgr.14355) 14357 : audit [DBG] from='client.311334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:54 smithi131 bash[24745]: audit 2024-09-14T03:52:53.088380+0000 mgr.a (mgr.14355) 14357 : audit [DBG] from='client.311334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:54 smithi171 bash[25040]: audit 2024-09-14T03:52:53.088380+0000 mgr.a (mgr.14355) 14357 : audit [DBG] from='client.311334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:52:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:55 smithi007 bash[22722]: cluster 2024-09-14T03:52:53.942416+0000 mgr.a (mgr.14355) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:55 smithi131 bash[24745]: cluster 2024-09-14T03:52:53.942416+0000 mgr.a (mgr.14355) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:55 smithi171 bash[25040]: cluster 2024-09-14T03:52:53.942416+0000 mgr.a (mgr.14355) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:57 smithi007 bash[22722]: cluster 2024-09-14T03:52:55.944584+0000 mgr.a (mgr.14355) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:57 smithi131 bash[24745]: cluster 2024-09-14T03:52:55.944584+0000 mgr.a (mgr.14355) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:57 smithi171 bash[25040]: cluster 2024-09-14T03:52:55.944584+0000 mgr.a (mgr.14355) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:52:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:52:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:52:58.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:52:59.263 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:52:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:52:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:52:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:52:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:52:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:52:59 smithi007 bash[22722]: cluster 2024-09-14T03:52:57.945332+0000 mgr.a (mgr.14355) 14360 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:52:59 smithi131 bash[24745]: cluster 2024-09-14T03:52:57.945332+0000 mgr.a (mgr.14355) 14360 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:52:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:52:59 smithi171 bash[25040]: cluster 2024-09-14T03:52:57.945332+0000 mgr.a (mgr.14355) 14360 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:00 smithi007 bash[22722]: audit 2024-09-14T03:52:58.855933+0000 mgr.a (mgr.14355) 14361 : audit [DBG] from='client.311412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:00 smithi131 bash[24745]: audit 2024-09-14T03:52:58.855933+0000 mgr.a (mgr.14355) 14361 : audit [DBG] from='client.311412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:00 smithi171 bash[25040]: audit 2024-09-14T03:52:58.855933+0000 mgr.a (mgr.14355) 14361 : audit [DBG] from='client.311412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:01 smithi007 bash[22722]: cluster 2024-09-14T03:52:59.946281+0000 mgr.a (mgr.14355) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:01 smithi131 bash[24745]: cluster 2024-09-14T03:52:59.946281+0000 mgr.a (mgr.14355) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:01 smithi171 bash[25040]: cluster 2024-09-14T03:52:59.946281+0000 mgr.a (mgr.14355) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:03 smithi007 bash[22722]: cluster 2024-09-14T03:53:01.948606+0000 mgr.a (mgr.14355) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:03 smithi131 bash[24745]: cluster 2024-09-14T03:53:01.948606+0000 mgr.a (mgr.14355) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:03 smithi171 bash[25040]: cluster 2024-09-14T03:53:01.948606+0000 mgr.a (mgr.14355) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:04.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:04.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:04.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:05.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:05 smithi007 bash[22722]: cluster 2024-09-14T03:53:03.949358+0000 mgr.a (mgr.14355) 14364 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:05 smithi007 bash[22722]: audit 2024-09-14T03:53:04.593372+0000 mgr.a (mgr.14355) 14365 : audit [DBG] from='client.311490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:05 smithi131 bash[24745]: cluster 2024-09-14T03:53:03.949358+0000 mgr.a (mgr.14355) 14364 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:05 smithi131 bash[24745]: audit 2024-09-14T03:53:04.593372+0000 mgr.a (mgr.14355) 14365 : audit [DBG] from='client.311490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:05 smithi171 bash[25040]: cluster 2024-09-14T03:53:03.949358+0000 mgr.a (mgr.14355) 14364 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:05 smithi171 bash[25040]: audit 2024-09-14T03:53:04.593372+0000 mgr.a (mgr.14355) 14365 : audit [DBG] from='client.311490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:07 smithi007 bash[22722]: cluster 2024-09-14T03:53:05.951725+0000 mgr.a (mgr.14355) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:07 smithi131 bash[24745]: cluster 2024-09-14T03:53:05.951725+0000 mgr.a (mgr.14355) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:07 smithi171 bash[25040]: cluster 2024-09-14T03:53:05.951725+0000 mgr.a (mgr.14355) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:09 smithi007 bash[22722]: cluster 2024-09-14T03:53:07.952517+0000 mgr.a (mgr.14355) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:09 smithi131 bash[24745]: cluster 2024-09-14T03:53:07.952517+0000 mgr.a (mgr.14355) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:09 smithi171 bash[25040]: cluster 2024-09-14T03:53:07.952517+0000 mgr.a (mgr.14355) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:10.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:10.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:10.759 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:10.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:11 smithi007 bash[22722]: cluster 2024-09-14T03:53:09.953288+0000 mgr.a (mgr.14355) 14368 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:11 smithi007 bash[22722]: audit 2024-09-14T03:53:10.341353+0000 mgr.a (mgr.14355) 14369 : audit [DBG] from='client.311568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:11 smithi131 bash[24745]: cluster 2024-09-14T03:53:09.953288+0000 mgr.a (mgr.14355) 14368 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:11 smithi131 bash[24745]: audit 2024-09-14T03:53:10.341353+0000 mgr.a (mgr.14355) 14369 : audit [DBG] from='client.311568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:11 smithi171 bash[25040]: cluster 2024-09-14T03:53:09.953288+0000 mgr.a (mgr.14355) 14368 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:11 smithi171 bash[25040]: audit 2024-09-14T03:53:10.341353+0000 mgr.a (mgr.14355) 14369 : audit [DBG] from='client.311568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:13 smithi007 bash[22722]: cluster 2024-09-14T03:53:11.956030+0000 mgr.a (mgr.14355) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:13 smithi131 bash[24745]: cluster 2024-09-14T03:53:11.956030+0000 mgr.a (mgr.14355) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:13 smithi171 bash[25040]: cluster 2024-09-14T03:53:11.956030+0000 mgr.a (mgr.14355) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:15 smithi007 bash[22722]: cluster 2024-09-14T03:53:13.956821+0000 mgr.a (mgr.14355) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:15 smithi131 bash[24745]: cluster 2024-09-14T03:53:13.956821+0000 mgr.a (mgr.14355) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:15 smithi171 bash[25040]: cluster 2024-09-14T03:53:13.956821+0000 mgr.a (mgr.14355) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:15.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:15.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:16.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:16.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:17 smithi007 bash[22722]: cluster 2024-09-14T03:53:15.958725+0000 mgr.a (mgr.14355) 14372 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:17 smithi007 bash[22722]: audit 2024-09-14T03:53:16.095180+0000 mgr.a (mgr.14355) 14373 : audit [DBG] from='client.311643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:17 smithi131 bash[24745]: cluster 2024-09-14T03:53:15.958725+0000 mgr.a (mgr.14355) 14372 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:17 smithi131 bash[24745]: audit 2024-09-14T03:53:16.095180+0000 mgr.a (mgr.14355) 14373 : audit [DBG] from='client.311643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:17 smithi171 bash[25040]: cluster 2024-09-14T03:53:15.958725+0000 mgr.a (mgr.14355) 14372 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:17 smithi171 bash[25040]: audit 2024-09-14T03:53:16.095180+0000 mgr.a (mgr.14355) 14373 : audit [DBG] from='client.311643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:19 smithi007 bash[22722]: cluster 2024-09-14T03:53:17.959619+0000 mgr.a (mgr.14355) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:19 smithi131 bash[24745]: cluster 2024-09-14T03:53:17.959619+0000 mgr.a (mgr.14355) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:19 smithi171 bash[25040]: cluster 2024-09-14T03:53:17.959619+0000 mgr.a (mgr.14355) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:53:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:20 smithi007 bash[22722]: audit 2024-09-14T03:53:19.707828+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:53:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:20 smithi131 bash[24745]: audit 2024-09-14T03:53:19.707828+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:53:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:20 smithi171 bash[25040]: audit 2024-09-14T03:53:19.707828+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:53:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:21 smithi007 bash[22722]: cluster 2024-09-14T03:53:19.960419+0000 mgr.a (mgr.14355) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:53:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:21.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:21.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:21 smithi131 bash[24745]: cluster 2024-09-14T03:53:19.960419+0000 mgr.a (mgr.14355) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:53:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:21 smithi171 bash[25040]: cluster 2024-09-14T03:53:19.960419+0000 mgr.a (mgr.14355) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:53:22.290 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:22.290 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:23 smithi007 bash[22722]: audit 2024-09-14T03:53:21.859628+0000 mgr.a (mgr.14355) 14376 : audit [DBG] from='client.311721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:23 smithi007 bash[22722]: cluster 2024-09-14T03:53:21.961708+0000 mgr.a (mgr.14355) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:23 smithi131 bash[24745]: audit 2024-09-14T03:53:21.859628+0000 mgr.a (mgr.14355) 14376 : audit [DBG] from='client.311721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:23 smithi131 bash[24745]: cluster 2024-09-14T03:53:21.961708+0000 mgr.a (mgr.14355) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:23 smithi171 bash[25040]: audit 2024-09-14T03:53:21.859628+0000 mgr.a (mgr.14355) 14376 : audit [DBG] from='client.311721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:23 smithi171 bash[25040]: cluster 2024-09-14T03:53:21.961708+0000 mgr.a (mgr.14355) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:25 smithi007 bash[22722]: cluster 2024-09-14T03:53:23.962601+0000 mgr.a (mgr.14355) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:25 smithi131 bash[24745]: cluster 2024-09-14T03:53:23.962601+0000 mgr.a (mgr.14355) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:25 smithi171 bash[25040]: cluster 2024-09-14T03:53:23.962601+0000 mgr.a (mgr.14355) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:27.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:27.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:27.292 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:27.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:27 smithi007 bash[22722]: cluster 2024-09-14T03:53:25.964857+0000 mgr.a (mgr.14355) 14379 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:27 smithi131 bash[24745]: cluster 2024-09-14T03:53:25.964857+0000 mgr.a (mgr.14355) 14379 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:27 smithi171 bash[25040]: cluster 2024-09-14T03:53:25.964857+0000 mgr.a (mgr.14355) 14379 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:28.052 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:28.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:28 smithi007 bash[22722]: audit 2024-09-14T03:53:27.628723+0000 mgr.a (mgr.14355) 14380 : audit [DBG] from='client.311799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:28 smithi131 bash[24745]: audit 2024-09-14T03:53:27.628723+0000 mgr.a (mgr.14355) 14380 : audit [DBG] from='client.311799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:28 smithi171 bash[25040]: audit 2024-09-14T03:53:27.628723+0000 mgr.a (mgr.14355) 14380 : audit [DBG] from='client.311799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:29 smithi007 bash[22722]: cluster 2024-09-14T03:53:27.965398+0000 mgr.a (mgr.14355) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:29 smithi131 bash[24745]: cluster 2024-09-14T03:53:27.965398+0000 mgr.a (mgr.14355) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:29 smithi171 bash[25040]: cluster 2024-09-14T03:53:27.965398+0000 mgr.a (mgr.14355) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:31.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22972]: debug 2024-09-14T03:53:31.443+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:53:31.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22972]: debug 2024-09-14T03:53:31.443+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:53:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: cluster 2024-09-14T03:53:29.966059+0000 mgr.a (mgr.14355) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.634662+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.643062+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:31.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.645214+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:53:31.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.647287+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:53:31.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.658025+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:31.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:31 smithi007 bash[22722]: audit 2024-09-14T03:53:30.663188+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: cluster 2024-09-14T03:53:29.966059+0000 mgr.a (mgr.14355) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.634662+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.643062+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.645214+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.647287+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.658025+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:31 smithi131 bash[24745]: audit 2024-09-14T03:53:30.663188+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: cluster 2024-09-14T03:53:29.966059+0000 mgr.a (mgr.14355) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.634662+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.643062+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.645214+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.647287+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.658025+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:53:32.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:31 smithi171 bash[25040]: audit 2024-09-14T03:53:30.663188+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:32 smithi007 bash[22722]: audit 2024-09-14T03:53:30.665527+0000 mgr.a (mgr.14355) 14383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:32 smithi007 bash[22722]: audit 2024-09-14T03:53:31.447181+0000 mgr.a (mgr.14355) 14384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:53:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:32 smithi007 bash[22722]: cephadm 2024-09-14T03:53:31.448720+0000 mgr.a (mgr.14355) 14385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:53:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:32 smithi131 bash[24745]: audit 2024-09-14T03:53:30.665527+0000 mgr.a (mgr.14355) 14383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:32 smithi131 bash[24745]: audit 2024-09-14T03:53:31.447181+0000 mgr.a (mgr.14355) 14384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:53:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:32 smithi131 bash[24745]: cephadm 2024-09-14T03:53:31.448720+0000 mgr.a (mgr.14355) 14385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:53:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:32 smithi171 bash[25040]: audit 2024-09-14T03:53:30.665527+0000 mgr.a (mgr.14355) 14383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:53:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:32 smithi171 bash[25040]: audit 2024-09-14T03:53:31.447181+0000 mgr.a (mgr.14355) 14384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:53:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:32 smithi171 bash[25040]: cephadm 2024-09-14T03:53:31.448720+0000 mgr.a (mgr.14355) 14385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:53:33.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:33.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:33.840 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:33.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:33 smithi007 bash[22722]: cluster 2024-09-14T03:53:31.968853+0000 mgr.a (mgr.14355) 14386 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:33 smithi131 bash[24745]: cluster 2024-09-14T03:53:31.968853+0000 mgr.a (mgr.14355) 14386 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:33 smithi171 bash[25040]: cluster 2024-09-14T03:53:31.968853+0000 mgr.a (mgr.14355) 14386 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:53:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:34 smithi007 bash[22722]: audit 2024-09-14T03:53:33.394950+0000 mgr.a (mgr.14355) 14387 : audit [DBG] from='client.311982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:34 smithi131 bash[24745]: audit 2024-09-14T03:53:33.394950+0000 mgr.a (mgr.14355) 14387 : audit [DBG] from='client.311982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:34 smithi171 bash[25040]: audit 2024-09-14T03:53:33.394950+0000 mgr.a (mgr.14355) 14387 : audit [DBG] from='client.311982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:35 smithi007 bash[22722]: cluster 2024-09-14T03:53:33.969828+0000 mgr.a (mgr.14355) 14388 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:35 smithi131 bash[24745]: cluster 2024-09-14T03:53:33.969828+0000 mgr.a (mgr.14355) 14388 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:35 smithi171 bash[25040]: cluster 2024-09-14T03:53:33.969828+0000 mgr.a (mgr.14355) 14388 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:53:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:36 smithi007 bash[22722]: cluster 2024-09-14T03:53:35.972213+0000 mgr.a (mgr.14355) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:36 smithi131 bash[24745]: cluster 2024-09-14T03:53:35.972213+0000 mgr.a (mgr.14355) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:36 smithi171 bash[25040]: cluster 2024-09-14T03:53:35.972213+0000 mgr.a (mgr.14355) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:38.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:38.842 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:39 smithi131 bash[24745]: cluster 2024-09-14T03:53:37.972983+0000 mgr.a (mgr.14355) 14390 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:39 smithi171 bash[25040]: cluster 2024-09-14T03:53:37.972983+0000 mgr.a (mgr.14355) 14390 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:39 smithi007 bash[22722]: cluster 2024-09-14T03:53:37.972983+0000 mgr.a (mgr.14355) 14390 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:39.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:39.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:40 smithi171 bash[25040]: audit 2024-09-14T03:53:39.174406+0000 mgr.a (mgr.14355) 14391 : audit [DBG] from='client.312060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:40 smithi007 bash[22722]: audit 2024-09-14T03:53:39.174406+0000 mgr.a (mgr.14355) 14391 : audit [DBG] from='client.312060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:40 smithi131 bash[24745]: audit 2024-09-14T03:53:39.174406+0000 mgr.a (mgr.14355) 14391 : audit [DBG] from='client.312060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:41 smithi171 bash[25040]: cluster 2024-09-14T03:53:39.973928+0000 mgr.a (mgr.14355) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:41 smithi007 bash[22722]: cluster 2024-09-14T03:53:39.973928+0000 mgr.a (mgr.14355) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:41 smithi131 bash[24745]: cluster 2024-09-14T03:53:39.973928+0000 mgr.a (mgr.14355) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:43 smithi171 bash[25040]: cluster 2024-09-14T03:53:41.976214+0000 mgr.a (mgr.14355) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:43 smithi007 bash[22722]: cluster 2024-09-14T03:53:41.976214+0000 mgr.a (mgr.14355) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:43 smithi131 bash[24745]: cluster 2024-09-14T03:53:41.976214+0000 mgr.a (mgr.14355) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:44.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:44.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:45.367 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:45.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:45 smithi007 bash[22722]: cluster 2024-09-14T03:53:43.977009+0000 mgr.a (mgr.14355) 14394 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:45 smithi131 bash[24745]: cluster 2024-09-14T03:53:43.977009+0000 mgr.a (mgr.14355) 14394 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:45 smithi171 bash[25040]: cluster 2024-09-14T03:53:43.977009+0000 mgr.a (mgr.14355) 14394 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:46 smithi007 bash[22722]: audit 2024-09-14T03:53:44.941170+0000 mgr.a (mgr.14355) 14395 : audit [DBG] from='client.312138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:46 smithi131 bash[24745]: audit 2024-09-14T03:53:44.941170+0000 mgr.a (mgr.14355) 14395 : audit [DBG] from='client.312138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:46 smithi171 bash[25040]: audit 2024-09-14T03:53:44.941170+0000 mgr.a (mgr.14355) 14395 : audit [DBG] from='client.312138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:47 smithi007 bash[22722]: cluster 2024-09-14T03:53:45.979837+0000 mgr.a (mgr.14355) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:47 smithi131 bash[24745]: cluster 2024-09-14T03:53:45.979837+0000 mgr.a (mgr.14355) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:47 smithi171 bash[25040]: cluster 2024-09-14T03:53:45.979837+0000 mgr.a (mgr.14355) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:53:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:49 smithi007 bash[22722]: cluster 2024-09-14T03:53:47.980633+0000 mgr.a (mgr.14355) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:49 smithi131 bash[24745]: cluster 2024-09-14T03:53:47.980633+0000 mgr.a (mgr.14355) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:49 smithi171 bash[25040]: cluster 2024-09-14T03:53:47.980633+0000 mgr.a (mgr.14355) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:50.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:50.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:51.120 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:51.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:51.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:51.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:51.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:51 smithi007 bash[22722]: cluster 2024-09-14T03:53:49.981431+0000 mgr.a (mgr.14355) 14398 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:51 smithi131 bash[24745]: cluster 2024-09-14T03:53:49.981431+0000 mgr.a (mgr.14355) 14398 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:51 smithi171 bash[25040]: cluster 2024-09-14T03:53:49.981431+0000 mgr.a (mgr.14355) 14398 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T03:53:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:52 smithi007 bash[22722]: audit 2024-09-14T03:53:50.690595+0000 mgr.a (mgr.14355) 14399 : audit [DBG] from='client.312213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:52 smithi131 bash[24745]: audit 2024-09-14T03:53:50.690595+0000 mgr.a (mgr.14355) 14399 : audit [DBG] from='client.312213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:52 smithi171 bash[25040]: audit 2024-09-14T03:53:50.690595+0000 mgr.a (mgr.14355) 14399 : audit [DBG] from='client.312213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:53 smithi007 bash[22722]: cluster 2024-09-14T03:53:51.984178+0000 mgr.a (mgr.14355) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:53 smithi131 bash[24745]: cluster 2024-09-14T03:53:51.984178+0000 mgr.a (mgr.14355) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:53 smithi171 bash[25040]: cluster 2024-09-14T03:53:51.984178+0000 mgr.a (mgr.14355) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:55 smithi007 bash[22722]: cluster 2024-09-14T03:53:53.984947+0000 mgr.a (mgr.14355) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:53:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:55 smithi131 bash[24745]: cluster 2024-09-14T03:53:53.984947+0000 mgr.a (mgr.14355) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:53:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:55 smithi171 bash[25040]: cluster 2024-09-14T03:53:53.984947+0000 mgr.a (mgr.14355) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:53:56.121 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:53:56.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:53:56.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:53:56.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:53:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:53:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:53:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:53:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:53:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:57 smithi007 bash[22722]: cluster 2024-09-14T03:53:55.986886+0000 mgr.a (mgr.14355) 14402 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:57 smithi007 bash[22722]: audit 2024-09-14T03:53:56.456886+0000 mgr.a (mgr.14355) 14403 : audit [DBG] from='client.312291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:57 smithi131 bash[24745]: cluster 2024-09-14T03:53:55.986886+0000 mgr.a (mgr.14355) 14402 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:57 smithi131 bash[24745]: audit 2024-09-14T03:53:56.456886+0000 mgr.a (mgr.14355) 14403 : audit [DBG] from='client.312291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:57 smithi171 bash[25040]: cluster 2024-09-14T03:53:55.986886+0000 mgr.a (mgr.14355) 14402 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:53:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:57 smithi171 bash[25040]: audit 2024-09-14T03:53:56.456886+0000 mgr.a (mgr.14355) 14403 : audit [DBG] from='client.312291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:53:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:53:59 smithi007 bash[22722]: cluster 2024-09-14T03:53:57.987780+0000 mgr.a (mgr.14355) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:53:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:53:59 smithi131 bash[24745]: cluster 2024-09-14T03:53:57.987780+0000 mgr.a (mgr.14355) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:53:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:53:59 smithi171 bash[25040]: cluster 2024-09-14T03:53:57.987780+0000 mgr.a (mgr.14355) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:54:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:01 smithi007 bash[22722]: cluster 2024-09-14T03:53:59.988562+0000 mgr.a (mgr.14355) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:54:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:01 smithi131 bash[24745]: cluster 2024-09-14T03:53:59.988562+0000 mgr.a (mgr.14355) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:54:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:01 smithi171 bash[25040]: cluster 2024-09-14T03:53:59.988562+0000 mgr.a (mgr.14355) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T03:54:01.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:01.899 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:01.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:02.690 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:02.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:03 smithi007 bash[22722]: cluster 2024-09-14T03:54:01.990573+0000 mgr.a (mgr.14355) 14406 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:54:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:03 smithi007 bash[22722]: audit 2024-09-14T03:54:02.235717+0000 mgr.a (mgr.14355) 14407 : audit [DBG] from='client.312363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:03 smithi131 bash[24745]: cluster 2024-09-14T03:54:01.990573+0000 mgr.a (mgr.14355) 14406 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:54:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:03 smithi131 bash[24745]: audit 2024-09-14T03:54:02.235717+0000 mgr.a (mgr.14355) 14407 : audit [DBG] from='client.312363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:03 smithi171 bash[25040]: cluster 2024-09-14T03:54:01.990573+0000 mgr.a (mgr.14355) 14406 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T03:54:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:03 smithi171 bash[25040]: audit 2024-09-14T03:54:02.235717+0000 mgr.a (mgr.14355) 14407 : audit [DBG] from='client.312363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:05 smithi007 bash[22722]: cluster 2024-09-14T03:54:03.991454+0000 mgr.a (mgr.14355) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:05 smithi131 bash[24745]: cluster 2024-09-14T03:54:03.991454+0000 mgr.a (mgr.14355) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:05 smithi171 bash[25040]: cluster 2024-09-14T03:54:03.991454+0000 mgr.a (mgr.14355) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:07 smithi007 bash[22722]: cluster 2024-09-14T03:54:05.993740+0000 mgr.a (mgr.14355) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:07 smithi131 bash[24745]: cluster 2024-09-14T03:54:05.993740+0000 mgr.a (mgr.14355) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:07 smithi171 bash[25040]: cluster 2024-09-14T03:54:05.993740+0000 mgr.a (mgr.14355) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:07.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:07.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:07.693 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:08.460 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:09 smithi007 bash[22722]: cluster 2024-09-14T03:54:07.994529+0000 mgr.a (mgr.14355) 14410 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:09 smithi007 bash[22722]: audit 2024-09-14T03:54:08.026662+0000 mgr.a (mgr.14355) 14411 : audit [DBG] from='client.312441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:09 smithi131 bash[24745]: cluster 2024-09-14T03:54:07.994529+0000 mgr.a (mgr.14355) 14410 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:09 smithi131 bash[24745]: audit 2024-09-14T03:54:08.026662+0000 mgr.a (mgr.14355) 14411 : audit [DBG] from='client.312441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:09 smithi171 bash[25040]: cluster 2024-09-14T03:54:07.994529+0000 mgr.a (mgr.14355) 14410 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:09 smithi171 bash[25040]: audit 2024-09-14T03:54:08.026662+0000 mgr.a (mgr.14355) 14411 : audit [DBG] from='client.312441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:11 smithi007 bash[22722]: cluster 2024-09-14T03:54:09.995403+0000 mgr.a (mgr.14355) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:11 smithi131 bash[24745]: cluster 2024-09-14T03:54:09.995403+0000 mgr.a (mgr.14355) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:11 smithi171 bash[25040]: cluster 2024-09-14T03:54:09.995403+0000 mgr.a (mgr.14355) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:13 smithi007 bash[22722]: cluster 2024-09-14T03:54:11.997663+0000 mgr.a (mgr.14355) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:13.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:13.463 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:13 smithi131 bash[24745]: cluster 2024-09-14T03:54:11.997663+0000 mgr.a (mgr.14355) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:13 smithi171 bash[25040]: cluster 2024-09-14T03:54:11.997663+0000 mgr.a (mgr.14355) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:14.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:15 smithi007 bash[22722]: audit 2024-09-14T03:54:13.798883+0000 mgr.a (mgr.14355) 14414 : audit [DBG] from='client.312519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:15 smithi007 bash[22722]: cluster 2024-09-14T03:54:13.998265+0000 mgr.a (mgr.14355) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:15 smithi131 bash[24745]: audit 2024-09-14T03:54:13.798883+0000 mgr.a (mgr.14355) 14414 : audit [DBG] from='client.312519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:15 smithi131 bash[24745]: cluster 2024-09-14T03:54:13.998265+0000 mgr.a (mgr.14355) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:15 smithi171 bash[25040]: audit 2024-09-14T03:54:13.798883+0000 mgr.a (mgr.14355) 14414 : audit [DBG] from='client.312519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:15 smithi171 bash[25040]: cluster 2024-09-14T03:54:13.998265+0000 mgr.a (mgr.14355) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:17 smithi007 bash[22722]: cluster 2024-09-14T03:54:16.000545+0000 mgr.a (mgr.14355) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:17 smithi131 bash[24745]: cluster 2024-09-14T03:54:16.000545+0000 mgr.a (mgr.14355) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:17 smithi171 bash[25040]: cluster 2024-09-14T03:54:16.000545+0000 mgr.a (mgr.14355) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:19.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:19 smithi007 bash[22722]: cluster 2024-09-14T03:54:18.001313+0000 mgr.a (mgr.14355) 14417 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:19 smithi131 bash[24745]: cluster 2024-09-14T03:54:18.001313+0000 mgr.a (mgr.14355) 14417 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:19 smithi171 bash[25040]: cluster 2024-09-14T03:54:18.001313+0000 mgr.a (mgr.14355) 14417 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:20.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:20.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:20.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:20.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:20.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:20 smithi007 bash[22722]: audit 2024-09-14T03:54:19.586830+0000 mgr.a (mgr.14355) 14418 : audit [DBG] from='client.312594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:20 smithi131 bash[24745]: audit 2024-09-14T03:54:19.586830+0000 mgr.a (mgr.14355) 14418 : audit [DBG] from='client.312594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:20 smithi171 bash[25040]: audit 2024-09-14T03:54:19.586830+0000 mgr.a (mgr.14355) 14418 : audit [DBG] from='client.312594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:21 smithi007 bash[22722]: cluster 2024-09-14T03:54:20.001809+0000 mgr.a (mgr.14355) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:21 smithi131 bash[24745]: cluster 2024-09-14T03:54:20.001809+0000 mgr.a (mgr.14355) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:21 smithi171 bash[25040]: cluster 2024-09-14T03:54:20.001809+0000 mgr.a (mgr.14355) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:23 smithi007 bash[22722]: cluster 2024-09-14T03:54:22.003984+0000 mgr.a (mgr.14355) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:23 smithi131 bash[24745]: cluster 2024-09-14T03:54:22.003984+0000 mgr.a (mgr.14355) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:23 smithi171 bash[25040]: cluster 2024-09-14T03:54:22.003984+0000 mgr.a (mgr.14355) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:25.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:25.020 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:25 smithi007 bash[22722]: cluster 2024-09-14T03:54:24.004784+0000 mgr.a (mgr.14355) 14421 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:25 smithi131 bash[24745]: cluster 2024-09-14T03:54:24.004784+0000 mgr.a (mgr.14355) 14421 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:25 smithi171 bash[25040]: cluster 2024-09-14T03:54:24.004784+0000 mgr.a (mgr.14355) 14421 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:25.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:25.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:25.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:25.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:25.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:26 smithi007 bash[22722]: audit 2024-09-14T03:54:25.356464+0000 mgr.a (mgr.14355) 14422 : audit [DBG] from='client.312672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:26 smithi131 bash[24745]: audit 2024-09-14T03:54:25.356464+0000 mgr.a (mgr.14355) 14422 : audit [DBG] from='client.312672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:26 smithi171 bash[25040]: audit 2024-09-14T03:54:25.356464+0000 mgr.a (mgr.14355) 14422 : audit [DBG] from='client.312672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:27 smithi007 bash[22722]: cluster 2024-09-14T03:54:26.007505+0000 mgr.a (mgr.14355) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:27 smithi131 bash[24745]: cluster 2024-09-14T03:54:26.007505+0000 mgr.a (mgr.14355) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:27 smithi171 bash[25040]: cluster 2024-09-14T03:54:26.007505+0000 mgr.a (mgr.14355) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:29 smithi007 bash[22722]: cluster 2024-09-14T03:54:28.008308+0000 mgr.a (mgr.14355) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:29 smithi131 bash[24745]: cluster 2024-09-14T03:54:28.008308+0000 mgr.a (mgr.14355) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:29 smithi171 bash[25040]: cluster 2024-09-14T03:54:28.008308+0000 mgr.a (mgr.14355) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:30.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:30.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:30.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:31 smithi007 bash[22722]: cluster 2024-09-14T03:54:30.009087+0000 mgr.a (mgr.14355) 14425 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:54:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:31 smithi131 bash[24745]: cluster 2024-09-14T03:54:30.009087+0000 mgr.a (mgr.14355) 14425 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:54:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:31 smithi171 bash[25040]: cluster 2024-09-14T03:54:30.009087+0000 mgr.a (mgr.14355) 14425 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:54:31.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:31.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:31.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:31.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:31.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:32 smithi007 bash[22722]: audit 2024-09-14T03:54:31.120102+0000 mgr.a (mgr.14355) 14426 : audit [DBG] from='client.312744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:32.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:32 smithi007 bash[22722]: audit 2024-09-14T03:54:31.505697+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:54:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:32 smithi131 bash[24745]: audit 2024-09-14T03:54:31.120102+0000 mgr.a (mgr.14355) 14426 : audit [DBG] from='client.312744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:32 smithi131 bash[24745]: audit 2024-09-14T03:54:31.505697+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:54:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:32 smithi171 bash[25040]: audit 2024-09-14T03:54:31.120102+0000 mgr.a (mgr.14355) 14426 : audit [DBG] from='client.312744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:32 smithi171 bash[25040]: audit 2024-09-14T03:54:31.505697+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:54:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:33 smithi007 bash[22722]: cluster 2024-09-14T03:54:32.010608+0000 mgr.a (mgr.14355) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:33 smithi131 bash[24745]: cluster 2024-09-14T03:54:32.010608+0000 mgr.a (mgr.14355) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:33 smithi171 bash[25040]: cluster 2024-09-14T03:54:32.010608+0000 mgr.a (mgr.14355) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:35 smithi007 bash[22722]: cluster 2024-09-14T03:54:34.011353+0000 mgr.a (mgr.14355) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:35 smithi131 bash[24745]: cluster 2024-09-14T03:54:34.011353+0000 mgr.a (mgr.14355) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:35 smithi171 bash[25040]: cluster 2024-09-14T03:54:34.011353+0000 mgr.a (mgr.14355) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:54:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:36.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:36.558 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:37.313 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:37.314 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:37 smithi007 bash[22722]: cluster 2024-09-14T03:54:36.013290+0000 mgr.a (mgr.14355) 14429 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:37.507 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:37 smithi171 bash[25040]: cluster 2024-09-14T03:54:36.013290+0000 mgr.a (mgr.14355) 14429 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:37 smithi131 bash[24745]: cluster 2024-09-14T03:54:36.013290+0000 mgr.a (mgr.14355) 14429 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:38 smithi007 bash[22722]: audit 2024-09-14T03:54:36.887415+0000 mgr.a (mgr.14355) 14430 : audit [DBG] from='client.312822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:38.476 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:38 smithi131 bash[24745]: audit 2024-09-14T03:54:36.887415+0000 mgr.a (mgr.14355) 14430 : audit [DBG] from='client.312822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:38.506 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:38 smithi171 bash[25040]: audit 2024-09-14T03:54:36.887415+0000 mgr.a (mgr.14355) 14430 : audit [DBG] from='client.312822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:39 smithi007 bash[22722]: cluster 2024-09-14T03:54:38.014169+0000 mgr.a (mgr.14355) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:39 smithi131 bash[24745]: cluster 2024-09-14T03:54:38.014169+0000 mgr.a (mgr.14355) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:39.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:39 smithi171 bash[25040]: cluster 2024-09-14T03:54:38.014169+0000 mgr.a (mgr.14355) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:41 smithi007 bash[22722]: cluster 2024-09-14T03:54:40.014935+0000 mgr.a (mgr.14355) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:41.461 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:41 smithi131 bash[24745]: cluster 2024-09-14T03:54:40.014935+0000 mgr.a (mgr.14355) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:41 smithi171 bash[25040]: cluster 2024-09-14T03:54:40.014935+0000 mgr.a (mgr.14355) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:42.315 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:42.316 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:43.163 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:43.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22972]: debug 2024-09-14T03:54:42.770+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22972]: debug 2024-09-14T03:54:42.778+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.860383+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.868965+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.973600+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.982148+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.984536+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.986607+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:41.997290+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:42.002498+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:42.004882+0000 mgr.a (mgr.14355) 14433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: cluster 2024-09-14T03:54:42.026735+0000 mgr.a (mgr.14355) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:43.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:42 smithi007 bash[22722]: audit 2024-09-14T03:54:42.653045+0000 mgr.a (mgr.14355) 14435 : audit [DBG] from='client.312951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.860383+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.868965+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.973600+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.982148+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.984536+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.986607+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:41.997290+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:42.002498+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:42.004882+0000 mgr.a (mgr.14355) 14433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: cluster 2024-09-14T03:54:42.026735+0000 mgr.a (mgr.14355) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:43.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:42 smithi131 bash[24745]: audit 2024-09-14T03:54:42.653045+0000 mgr.a (mgr.14355) 14435 : audit [DBG] from='client.312951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.860383+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.868965+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.973600+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.982148+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.984536+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.986607+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:54:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:41.997290+0000 mon.a (mon.0) 2749 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:54:43.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:42.002498+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:42.004882+0000 mgr.a (mgr.14355) 14433 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:54:43.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: cluster 2024-09-14T03:54:42.026735+0000 mgr.a (mgr.14355) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:54:43.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:42 smithi171 bash[25040]: audit 2024-09-14T03:54:42.653045+0000 mgr.a (mgr.14355) 14435 : audit [DBG] from='client.312951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:43 smithi131 bash[24745]: audit 2024-09-14T03:54:42.775026+0000 mgr.a (mgr.14355) 14436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:54:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:43 smithi131 bash[24745]: cephadm 2024-09-14T03:54:42.784964+0000 mgr.a (mgr.14355) 14437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:54:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:43 smithi171 bash[25040]: audit 2024-09-14T03:54:42.775026+0000 mgr.a (mgr.14355) 14436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:54:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:43 smithi171 bash[25040]: cephadm 2024-09-14T03:54:42.784964+0000 mgr.a (mgr.14355) 14437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:54:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:43 smithi007 bash[22722]: audit 2024-09-14T03:54:42.775026+0000 mgr.a (mgr.14355) 14436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:54:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:43 smithi007 bash[22722]: cephadm 2024-09-14T03:54:42.784964+0000 mgr.a (mgr.14355) 14437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:54:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:45 smithi131 bash[24745]: cluster 2024-09-14T03:54:44.027870+0000 mgr.a (mgr.14355) 14438 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:45 smithi171 bash[25040]: cluster 2024-09-14T03:54:44.027870+0000 mgr.a (mgr.14355) 14438 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:45 smithi007 bash[22722]: cluster 2024-09-14T03:54:44.027870+0000 mgr.a (mgr.14355) 14438 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:47 smithi007 bash[22722]: cluster 2024-09-14T03:54:46.030071+0000 mgr.a (mgr.14355) 14439 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:47 smithi131 bash[24745]: cluster 2024-09-14T03:54:46.030071+0000 mgr.a (mgr.14355) 14439 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:47 smithi171 bash[25040]: cluster 2024-09-14T03:54:46.030071+0000 mgr.a (mgr.14355) 14439 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:48.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:48.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:48.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:48.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:48.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:49 smithi007 bash[22722]: cluster 2024-09-14T03:54:48.030833+0000 mgr.a (mgr.14355) 14440 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:49 smithi007 bash[22722]: audit 2024-09-14T03:54:48.493649+0000 mgr.a (mgr.14355) 14441 : audit [DBG] from='client.313080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:49 smithi131 bash[24745]: cluster 2024-09-14T03:54:48.030833+0000 mgr.a (mgr.14355) 14440 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:49 smithi131 bash[24745]: audit 2024-09-14T03:54:48.493649+0000 mgr.a (mgr.14355) 14441 : audit [DBG] from='client.313080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:49 smithi171 bash[25040]: cluster 2024-09-14T03:54:48.030833+0000 mgr.a (mgr.14355) 14440 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:49 smithi171 bash[25040]: audit 2024-09-14T03:54:48.493649+0000 mgr.a (mgr.14355) 14441 : audit [DBG] from='client.313080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:51 smithi131 bash[24745]: cluster 2024-09-14T03:54:50.031699+0000 mgr.a (mgr.14355) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:51 smithi171 bash[25040]: cluster 2024-09-14T03:54:50.031699+0000 mgr.a (mgr.14355) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:51 smithi007 bash[22722]: cluster 2024-09-14T03:54:50.031699+0000 mgr.a (mgr.14355) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:53 smithi131 bash[24745]: cluster 2024-09-14T03:54:52.033919+0000 mgr.a (mgr.14355) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:53 smithi171 bash[25040]: cluster 2024-09-14T03:54:52.033919+0000 mgr.a (mgr.14355) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:53.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:53.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:53.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:53 smithi007 bash[22722]: cluster 2024-09-14T03:54:52.033919+0000 mgr.a (mgr.14355) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:54.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:54:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:54:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:54:54.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:54:54.694 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:54:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:55 smithi131 bash[24745]: cluster 2024-09-14T03:54:54.034604+0000 mgr.a (mgr.14355) 14444 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:55 smithi131 bash[24745]: audit 2024-09-14T03:54:54.247922+0000 mgr.a (mgr.14355) 14445 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:55 smithi171 bash[25040]: cluster 2024-09-14T03:54:54.034604+0000 mgr.a (mgr.14355) 14444 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:55 smithi171 bash[25040]: audit 2024-09-14T03:54:54.247922+0000 mgr.a (mgr.14355) 14445 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:55 smithi007 bash[22722]: cluster 2024-09-14T03:54:54.034604+0000 mgr.a (mgr.14355) 14444 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:55 smithi007 bash[22722]: audit 2024-09-14T03:54:54.247922+0000 mgr.a (mgr.14355) 14445 : audit [DBG] from='client.313158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:54:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:57 smithi131 bash[24745]: cluster 2024-09-14T03:54:56.036868+0000 mgr.a (mgr.14355) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:57 smithi171 bash[25040]: cluster 2024-09-14T03:54:56.036868+0000 mgr.a (mgr.14355) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:57 smithi007 bash[22722]: cluster 2024-09-14T03:54:56.036868+0000 mgr.a (mgr.14355) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:54:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:54:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:54:59.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:54:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:54:59 smithi131 bash[24745]: cluster 2024-09-14T03:54:58.037602+0000 mgr.a (mgr.14355) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:54:59 smithi171 bash[25040]: cluster 2024-09-14T03:54:58.037602+0000 mgr.a (mgr.14355) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:54:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:54:59 smithi007 bash[22722]: cluster 2024-09-14T03:54:58.037602+0000 mgr.a (mgr.14355) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:00.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:01 smithi131 bash[24745]: audit 2024-09-14T03:55:00.021669+0000 mgr.a (mgr.14355) 14448 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:01 smithi131 bash[24745]: cluster 2024-09-14T03:55:00.038514+0000 mgr.a (mgr.14355) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:01 smithi171 bash[25040]: audit 2024-09-14T03:55:00.021669+0000 mgr.a (mgr.14355) 14448 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:01 smithi171 bash[25040]: cluster 2024-09-14T03:55:00.038514+0000 mgr.a (mgr.14355) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:01 smithi007 bash[22722]: audit 2024-09-14T03:55:00.021669+0000 mgr.a (mgr.14355) 14448 : audit [DBG] from='client.313236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:01 smithi007 bash[22722]: cluster 2024-09-14T03:55:00.038514+0000 mgr.a (mgr.14355) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:03 smithi131 bash[24745]: cluster 2024-09-14T03:55:02.041353+0000 mgr.a (mgr.14355) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:03 smithi171 bash[25040]: cluster 2024-09-14T03:55:02.041353+0000 mgr.a (mgr.14355) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:03 smithi007 bash[22722]: cluster 2024-09-14T03:55:02.041353+0000 mgr.a (mgr.14355) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:05.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:05 smithi131 bash[24745]: cluster 2024-09-14T03:55:04.042135+0000 mgr.a (mgr.14355) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:05 smithi171 bash[25040]: cluster 2024-09-14T03:55:04.042135+0000 mgr.a (mgr.14355) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:05 smithi007 bash[22722]: cluster 2024-09-14T03:55:04.042135+0000 mgr.a (mgr.14355) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:06.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:06.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:06.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:06.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:06.221 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:07 smithi171 bash[25040]: audit 2024-09-14T03:55:05.777251+0000 mgr.a (mgr.14355) 14452 : audit [DBG] from='client.313308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:07 smithi171 bash[25040]: cluster 2024-09-14T03:55:06.044841+0000 mgr.a (mgr.14355) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:07 smithi007 bash[22722]: audit 2024-09-14T03:55:05.777251+0000 mgr.a (mgr.14355) 14452 : audit [DBG] from='client.313308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:07 smithi007 bash[22722]: cluster 2024-09-14T03:55:06.044841+0000 mgr.a (mgr.14355) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:07 smithi131 bash[24745]: audit 2024-09-14T03:55:05.777251+0000 mgr.a (mgr.14355) 14452 : audit [DBG] from='client.313308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:07 smithi131 bash[24745]: cluster 2024-09-14T03:55:06.044841+0000 mgr.a (mgr.14355) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:09 smithi171 bash[25040]: cluster 2024-09-14T03:55:08.045795+0000 mgr.a (mgr.14355) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:09 smithi007 bash[22722]: cluster 2024-09-14T03:55:08.045795+0000 mgr.a (mgr.14355) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:09 smithi131 bash[24745]: cluster 2024-09-14T03:55:08.045795+0000 mgr.a (mgr.14355) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:11.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:11.223 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:11 smithi171 bash[25040]: cluster 2024-09-14T03:55:10.046613+0000 mgr.a (mgr.14355) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:11 smithi007 bash[22722]: cluster 2024-09-14T03:55:10.046613+0000 mgr.a (mgr.14355) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:12.005 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:12.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:12.005 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:12.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:12.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:11 smithi131 bash[24745]: cluster 2024-09-14T03:55:10.046613+0000 mgr.a (mgr.14355) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:12 smithi007 bash[22722]: audit 2024-09-14T03:55:11.560758+0000 mgr.a (mgr.14355) 14456 : audit [DBG] from='client.313386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:12 smithi131 bash[24745]: audit 2024-09-14T03:55:11.560758+0000 mgr.a (mgr.14355) 14456 : audit [DBG] from='client.313386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:12 smithi171 bash[25040]: audit 2024-09-14T03:55:11.560758+0000 mgr.a (mgr.14355) 14456 : audit [DBG] from='client.313386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:13 smithi007 bash[22722]: cluster 2024-09-14T03:55:12.047981+0000 mgr.a (mgr.14355) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:13 smithi131 bash[24745]: cluster 2024-09-14T03:55:12.047981+0000 mgr.a (mgr.14355) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:13 smithi171 bash[25040]: cluster 2024-09-14T03:55:12.047981+0000 mgr.a (mgr.14355) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:15 smithi007 bash[22722]: cluster 2024-09-14T03:55:14.048722+0000 mgr.a (mgr.14355) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:15 smithi131 bash[24745]: cluster 2024-09-14T03:55:14.048722+0000 mgr.a (mgr.14355) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:15 smithi171 bash[25040]: cluster 2024-09-14T03:55:14.048722+0000 mgr.a (mgr.14355) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:17.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:17.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:17.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:17.758 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:17 smithi007 bash[22722]: cluster 2024-09-14T03:55:16.050744+0000 mgr.a (mgr.14355) 14459 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:17 smithi131 bash[24745]: cluster 2024-09-14T03:55:16.050744+0000 mgr.a (mgr.14355) 14459 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:17 smithi171 bash[25040]: cluster 2024-09-14T03:55:16.050744+0000 mgr.a (mgr.14355) 14459 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:18 smithi007 bash[22722]: audit 2024-09-14T03:55:17.336705+0000 mgr.a (mgr.14355) 14460 : audit [DBG] from='client.313464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:18 smithi131 bash[24745]: audit 2024-09-14T03:55:17.336705+0000 mgr.a (mgr.14355) 14460 : audit [DBG] from='client.313464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:18 smithi171 bash[25040]: audit 2024-09-14T03:55:17.336705+0000 mgr.a (mgr.14355) 14460 : audit [DBG] from='client.313464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:19 smithi007 bash[22722]: cluster 2024-09-14T03:55:18.051693+0000 mgr.a (mgr.14355) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:19 smithi131 bash[24745]: cluster 2024-09-14T03:55:18.051693+0000 mgr.a (mgr.14355) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:19 smithi171 bash[25040]: cluster 2024-09-14T03:55:18.051693+0000 mgr.a (mgr.14355) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:21 smithi007 bash[22722]: cluster 2024-09-14T03:55:20.052490+0000 mgr.a (mgr.14355) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:21 smithi131 bash[24745]: cluster 2024-09-14T03:55:20.052490+0000 mgr.a (mgr.14355) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:21 smithi171 bash[25040]: cluster 2024-09-14T03:55:20.052490+0000 mgr.a (mgr.14355) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:22.760 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:22.761 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:23.536 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:23.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:23 smithi007 bash[22722]: cluster 2024-09-14T03:55:22.054735+0000 mgr.a (mgr.14355) 14463 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:23 smithi131 bash[24745]: cluster 2024-09-14T03:55:22.054735+0000 mgr.a (mgr.14355) 14463 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:23 smithi171 bash[25040]: cluster 2024-09-14T03:55:22.054735+0000 mgr.a (mgr.14355) 14463 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:24 smithi007 bash[22722]: audit 2024-09-14T03:55:23.095377+0000 mgr.a (mgr.14355) 14464 : audit [DBG] from='client.313542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:24 smithi131 bash[24745]: audit 2024-09-14T03:55:23.095377+0000 mgr.a (mgr.14355) 14464 : audit [DBG] from='client.313542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:24 smithi171 bash[25040]: audit 2024-09-14T03:55:23.095377+0000 mgr.a (mgr.14355) 14464 : audit [DBG] from='client.313542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:25 smithi007 bash[22722]: cluster 2024-09-14T03:55:24.055869+0000 mgr.a (mgr.14355) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:25 smithi131 bash[24745]: cluster 2024-09-14T03:55:24.055869+0000 mgr.a (mgr.14355) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:25 smithi171 bash[25040]: cluster 2024-09-14T03:55:24.055869+0000 mgr.a (mgr.14355) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:27 smithi007 bash[22722]: cluster 2024-09-14T03:55:26.058154+0000 mgr.a (mgr.14355) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:27 smithi131 bash[24745]: cluster 2024-09-14T03:55:26.058154+0000 mgr.a (mgr.14355) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:27 smithi171 bash[25040]: cluster 2024-09-14T03:55:26.058154+0000 mgr.a (mgr.14355) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:29.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:29 smithi007 bash[22722]: cluster 2024-09-14T03:55:28.058944+0000 mgr.a (mgr.14355) 14467 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:29 smithi131 bash[24745]: cluster 2024-09-14T03:55:28.058944+0000 mgr.a (mgr.14355) 14467 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:29 smithi171 bash[25040]: cluster 2024-09-14T03:55:28.058944+0000 mgr.a (mgr.14355) 14467 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:30 smithi007 bash[22722]: audit 2024-09-14T03:55:28.868551+0000 mgr.a (mgr.14355) 14468 : audit [DBG] from='client.313620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:30 smithi131 bash[24745]: audit 2024-09-14T03:55:28.868551+0000 mgr.a (mgr.14355) 14468 : audit [DBG] from='client.313620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:30 smithi171 bash[25040]: audit 2024-09-14T03:55:28.868551+0000 mgr.a (mgr.14355) 14468 : audit [DBG] from='client.313620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:31 smithi007 bash[22722]: cluster 2024-09-14T03:55:30.059930+0000 mgr.a (mgr.14355) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:31 smithi131 bash[24745]: cluster 2024-09-14T03:55:30.059930+0000 mgr.a (mgr.14355) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:31 smithi171 bash[25040]: cluster 2024-09-14T03:55:30.059930+0000 mgr.a (mgr.14355) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:33 smithi007 bash[22722]: cluster 2024-09-14T03:55:32.062187+0000 mgr.a (mgr.14355) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:33 smithi131 bash[24745]: cluster 2024-09-14T03:55:32.062187+0000 mgr.a (mgr.14355) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:33 smithi171 bash[25040]: cluster 2024-09-14T03:55:32.062187+0000 mgr.a (mgr.14355) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:34.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:34.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:35.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:35.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:35.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:35 smithi007 bash[22722]: cluster 2024-09-14T03:55:34.062961+0000 mgr.a (mgr.14355) 14471 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:35 smithi007 bash[22722]: audit 2024-09-14T03:55:34.633099+0000 mgr.a (mgr.14355) 14472 : audit [DBG] from='client.313695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:35 smithi131 bash[24745]: cluster 2024-09-14T03:55:34.062961+0000 mgr.a (mgr.14355) 14471 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:35 smithi131 bash[24745]: audit 2024-09-14T03:55:34.633099+0000 mgr.a (mgr.14355) 14472 : audit [DBG] from='client.313695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:35 smithi171 bash[25040]: cluster 2024-09-14T03:55:34.062961+0000 mgr.a (mgr.14355) 14471 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:35 smithi171 bash[25040]: audit 2024-09-14T03:55:34.633099+0000 mgr.a (mgr.14355) 14472 : audit [DBG] from='client.313695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:37 smithi007 bash[22722]: cluster 2024-09-14T03:55:36.065342+0000 mgr.a (mgr.14355) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:37 smithi131 bash[24745]: cluster 2024-09-14T03:55:36.065342+0000 mgr.a (mgr.14355) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:37 smithi171 bash[25040]: cluster 2024-09-14T03:55:36.065342+0000 mgr.a (mgr.14355) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:55:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:39 smithi007 bash[22722]: cluster 2024-09-14T03:55:38.066158+0000 mgr.a (mgr.14355) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:39 smithi131 bash[24745]: cluster 2024-09-14T03:55:38.066158+0000 mgr.a (mgr.14355) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:39 smithi171 bash[25040]: cluster 2024-09-14T03:55:38.066158+0000 mgr.a (mgr.14355) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:40.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:40.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:40.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:40.815 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:40.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:41 smithi007 bash[22722]: cluster 2024-09-14T03:55:40.066738+0000 mgr.a (mgr.14355) 14475 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:41 smithi007 bash[22722]: audit 2024-09-14T03:55:40.393207+0000 mgr.a (mgr.14355) 14476 : audit [DBG] from='client.313773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:41 smithi131 bash[24745]: cluster 2024-09-14T03:55:40.066738+0000 mgr.a (mgr.14355) 14475 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:41 smithi131 bash[24745]: audit 2024-09-14T03:55:40.393207+0000 mgr.a (mgr.14355) 14476 : audit [DBG] from='client.313773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:41 smithi171 bash[25040]: cluster 2024-09-14T03:55:40.066738+0000 mgr.a (mgr.14355) 14475 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:41 smithi171 bash[25040]: audit 2024-09-14T03:55:40.393207+0000 mgr.a (mgr.14355) 14476 : audit [DBG] from='client.313773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:43 smithi007 bash[22722]: cluster 2024-09-14T03:55:42.069460+0000 mgr.a (mgr.14355) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:43 smithi007 bash[22722]: audit 2024-09-14T03:55:42.836730+0000 mon.a (mon.0) 2751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:55:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:43 smithi131 bash[24745]: cluster 2024-09-14T03:55:42.069460+0000 mgr.a (mgr.14355) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:43 smithi131 bash[24745]: audit 2024-09-14T03:55:42.836730+0000 mon.a (mon.0) 2751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:55:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:43 smithi171 bash[25040]: cluster 2024-09-14T03:55:42.069460+0000 mgr.a (mgr.14355) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:55:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:43 smithi171 bash[25040]: audit 2024-09-14T03:55:42.836730+0000 mon.a (mon.0) 2751 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22972]: debug 2024-09-14T03:55:44.433+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22972]: debug 2024-09-14T03:55:44.433+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22722]: audit 2024-09-14T03:55:43.680830+0000 mon.a (mon.0) 2752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22722]: audit 2024-09-14T03:55:43.682344+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22722]: audit 2024-09-14T03:55:43.692459+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:55:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:44 smithi007 bash[22722]: audit 2024-09-14T03:55:43.695670+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:44 smithi131 bash[24745]: audit 2024-09-14T03:55:43.680830+0000 mon.a (mon.0) 2752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:55:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:44 smithi131 bash[24745]: audit 2024-09-14T03:55:43.682344+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:55:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:44 smithi131 bash[24745]: audit 2024-09-14T03:55:43.692459+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:55:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:44 smithi131 bash[24745]: audit 2024-09-14T03:55:43.695670+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:44 smithi171 bash[25040]: audit 2024-09-14T03:55:43.680830+0000 mon.a (mon.0) 2752 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:55:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:44 smithi171 bash[25040]: audit 2024-09-14T03:55:43.682344+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:55:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:44 smithi171 bash[25040]: audit 2024-09-14T03:55:43.692459+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:55:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:44 smithi171 bash[25040]: audit 2024-09-14T03:55:43.695670+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:45.816 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:45.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:45.817 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:45 smithi007 bash[22722]: audit 2024-09-14T03:55:43.698102+0000 mgr.a (mgr.14355) 14478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:45 smithi007 bash[22722]: cluster 2024-09-14T03:55:44.069999+0000 mgr.a (mgr.14355) 14479 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:45 smithi007 bash[22722]: audit 2024-09-14T03:55:44.436582+0000 mgr.a (mgr.14355) 14480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:55:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:45 smithi007 bash[22722]: cephadm 2024-09-14T03:55:44.438186+0000 mgr.a (mgr.14355) 14481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:55:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:45 smithi131 bash[24745]: audit 2024-09-14T03:55:43.698102+0000 mgr.a (mgr.14355) 14478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:45 smithi131 bash[24745]: cluster 2024-09-14T03:55:44.069999+0000 mgr.a (mgr.14355) 14479 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:45 smithi131 bash[24745]: audit 2024-09-14T03:55:44.436582+0000 mgr.a (mgr.14355) 14480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:55:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:45 smithi131 bash[24745]: cephadm 2024-09-14T03:55:44.438186+0000 mgr.a (mgr.14355) 14481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:55:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:45 smithi171 bash[25040]: audit 2024-09-14T03:55:43.698102+0000 mgr.a (mgr.14355) 14478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:55:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:45 smithi171 bash[25040]: cluster 2024-09-14T03:55:44.069999+0000 mgr.a (mgr.14355) 14479 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:55:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:45 smithi171 bash[25040]: audit 2024-09-14T03:55:44.436582+0000 mgr.a (mgr.14355) 14480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:55:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:45 smithi171 bash[25040]: cephadm 2024-09-14T03:55:44.438186+0000 mgr.a (mgr.14355) 14481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:55:46.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:46.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:47 smithi007 bash[22722]: cluster 2024-09-14T03:55:46.072245+0000 mgr.a (mgr.14355) 14482 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:47 smithi007 bash[22722]: audit 2024-09-14T03:55:46.148340+0000 mgr.a (mgr.14355) 14483 : audit [DBG] from='client.313956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:47 smithi131 bash[24745]: cluster 2024-09-14T03:55:46.072245+0000 mgr.a (mgr.14355) 14482 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:47 smithi131 bash[24745]: audit 2024-09-14T03:55:46.148340+0000 mgr.a (mgr.14355) 14483 : audit [DBG] from='client.313956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:47 smithi171 bash[25040]: cluster 2024-09-14T03:55:46.072245+0000 mgr.a (mgr.14355) 14482 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:47 smithi171 bash[25040]: audit 2024-09-14T03:55:46.148340+0000 mgr.a (mgr.14355) 14483 : audit [DBG] from='client.313956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:49 smithi007 bash[22722]: cluster 2024-09-14T03:55:48.073152+0000 mgr.a (mgr.14355) 14484 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:49 smithi131 bash[24745]: cluster 2024-09-14T03:55:48.073152+0000 mgr.a (mgr.14355) 14484 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:49 smithi171 bash[25040]: cluster 2024-09-14T03:55:48.073152+0000 mgr.a (mgr.14355) 14484 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:51.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:51.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:51.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:51 smithi007 bash[22722]: cluster 2024-09-14T03:55:50.073935+0000 mgr.a (mgr.14355) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:51 smithi131 bash[24745]: cluster 2024-09-14T03:55:50.073935+0000 mgr.a (mgr.14355) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:51 smithi171 bash[25040]: cluster 2024-09-14T03:55:50.073935+0000 mgr.a (mgr.14355) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:55:52.328 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:52.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:53 smithi007 bash[22722]: audit 2024-09-14T03:55:51.908926+0000 mgr.a (mgr.14355) 14486 : audit [DBG] from='client.314034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:53 smithi007 bash[22722]: cluster 2024-09-14T03:55:52.075514+0000 mgr.a (mgr.14355) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:53 smithi131 bash[24745]: audit 2024-09-14T03:55:51.908926+0000 mgr.a (mgr.14355) 14486 : audit [DBG] from='client.314034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:53 smithi131 bash[24745]: cluster 2024-09-14T03:55:52.075514+0000 mgr.a (mgr.14355) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:53 smithi171 bash[25040]: audit 2024-09-14T03:55:51.908926+0000 mgr.a (mgr.14355) 14486 : audit [DBG] from='client.314034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:53 smithi171 bash[25040]: cluster 2024-09-14T03:55:52.075514+0000 mgr.a (mgr.14355) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:55 smithi007 bash[22722]: cluster 2024-09-14T03:55:54.076402+0000 mgr.a (mgr.14355) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:55 smithi131 bash[24745]: cluster 2024-09-14T03:55:54.076402+0000 mgr.a (mgr.14355) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:55 smithi171 bash[25040]: cluster 2024-09-14T03:55:54.076402+0000 mgr.a (mgr.14355) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:57.329 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:55:57.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:55:57.330 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:55:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:57 smithi007 bash[22722]: cluster 2024-09-14T03:55:56.078651+0000 mgr.a (mgr.14355) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:57 smithi131 bash[24745]: cluster 2024-09-14T03:55:56.078651+0000 mgr.a (mgr.14355) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:57 smithi171 bash[25040]: cluster 2024-09-14T03:55:56.078651+0000 mgr.a (mgr.14355) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:55:58.074 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:55:58.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:55:58.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:55:58.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:55:58.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:55:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:58 smithi007 bash[22722]: audit 2024-09-14T03:55:57.657947+0000 mgr.a (mgr.14355) 14490 : audit [DBG] from='client.314112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:58 smithi131 bash[24745]: audit 2024-09-14T03:55:57.657947+0000 mgr.a (mgr.14355) 14490 : audit [DBG] from='client.314112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:58 smithi171 bash[25040]: audit 2024-09-14T03:55:57.657947+0000 mgr.a (mgr.14355) 14490 : audit [DBG] from='client.314112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:55:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:55:59 smithi007 bash[22722]: cluster 2024-09-14T03:55:58.079168+0000 mgr.a (mgr.14355) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:55:59 smithi131 bash[24745]: cluster 2024-09-14T03:55:58.079168+0000 mgr.a (mgr.14355) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:55:59 smithi171 bash[25040]: cluster 2024-09-14T03:55:58.079168+0000 mgr.a (mgr.14355) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:00 smithi007 bash[22722]: cluster 2024-09-14T03:56:00.079913+0000 mgr.a (mgr.14355) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:00 smithi131 bash[24745]: cluster 2024-09-14T03:56:00.079913+0000 mgr.a (mgr.14355) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:00 smithi171 bash[25040]: cluster 2024-09-14T03:56:00.079913+0000 mgr.a (mgr.14355) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:03.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:03.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:03 smithi007 bash[22722]: cluster 2024-09-14T03:56:02.082144+0000 mgr.a (mgr.14355) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:03 smithi131 bash[24745]: cluster 2024-09-14T03:56:02.082144+0000 mgr.a (mgr.14355) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:03 smithi171 bash[25040]: cluster 2024-09-14T03:56:02.082144+0000 mgr.a (mgr.14355) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:03.851 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:03.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:04 smithi007 bash[22722]: audit 2024-09-14T03:56:03.405454+0000 mgr.a (mgr.14355) 14494 : audit [DBG] from='client.314190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:04 smithi131 bash[24745]: audit 2024-09-14T03:56:03.405454+0000 mgr.a (mgr.14355) 14494 : audit [DBG] from='client.314190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:04 smithi171 bash[25040]: audit 2024-09-14T03:56:03.405454+0000 mgr.a (mgr.14355) 14494 : audit [DBG] from='client.314190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:05 smithi007 bash[22722]: cluster 2024-09-14T03:56:04.083111+0000 mgr.a (mgr.14355) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:05 smithi131 bash[24745]: cluster 2024-09-14T03:56:04.083111+0000 mgr.a (mgr.14355) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:05 smithi171 bash[25040]: cluster 2024-09-14T03:56:04.083111+0000 mgr.a (mgr.14355) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:07 smithi007 bash[22722]: cluster 2024-09-14T03:56:06.085287+0000 mgr.a (mgr.14355) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:07 smithi131 bash[24745]: cluster 2024-09-14T03:56:06.085287+0000 mgr.a (mgr.14355) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:07 smithi171 bash[25040]: cluster 2024-09-14T03:56:06.085287+0000 mgr.a (mgr.14355) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:08.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:08.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:09 smithi007 bash[22722]: cluster 2024-09-14T03:56:08.086195+0000 mgr.a (mgr.14355) 14497 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:09 smithi131 bash[24745]: cluster 2024-09-14T03:56:08.086195+0000 mgr.a (mgr.14355) 14497 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:09 smithi171 bash[25040]: cluster 2024-09-14T03:56:08.086195+0000 mgr.a (mgr.14355) 14497 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:09.608 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:09.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:10 smithi007 bash[22722]: audit 2024-09-14T03:56:09.185736+0000 mgr.a (mgr.14355) 14498 : audit [DBG] from='client.314265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:10 smithi131 bash[24745]: audit 2024-09-14T03:56:09.185736+0000 mgr.a (mgr.14355) 14498 : audit [DBG] from='client.314265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:10 smithi171 bash[25040]: audit 2024-09-14T03:56:09.185736+0000 mgr.a (mgr.14355) 14498 : audit [DBG] from='client.314265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:11 smithi007 bash[22722]: cluster 2024-09-14T03:56:10.087240+0000 mgr.a (mgr.14355) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:11 smithi131 bash[24745]: cluster 2024-09-14T03:56:10.087240+0000 mgr.a (mgr.14355) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:11 smithi171 bash[25040]: cluster 2024-09-14T03:56:10.087240+0000 mgr.a (mgr.14355) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:13 smithi007 bash[22722]: cluster 2024-09-14T03:56:12.089462+0000 mgr.a (mgr.14355) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:13 smithi131 bash[24745]: cluster 2024-09-14T03:56:12.089462+0000 mgr.a (mgr.14355) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:13 smithi171 bash[25040]: cluster 2024-09-14T03:56:12.089462+0000 mgr.a (mgr.14355) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:14.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:14.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:15.363 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:15.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:15 smithi007 bash[22722]: cluster 2024-09-14T03:56:14.090216+0000 mgr.a (mgr.14355) 14501 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:15 smithi131 bash[24745]: cluster 2024-09-14T03:56:14.090216+0000 mgr.a (mgr.14355) 14501 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:15 smithi171 bash[25040]: cluster 2024-09-14T03:56:14.090216+0000 mgr.a (mgr.14355) 14501 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:16 smithi007 bash[22722]: audit 2024-09-14T03:56:14.939567+0000 mgr.a (mgr.14355) 14502 : audit [DBG] from='client.314343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:16 smithi131 bash[24745]: audit 2024-09-14T03:56:14.939567+0000 mgr.a (mgr.14355) 14502 : audit [DBG] from='client.314343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:16 smithi171 bash[25040]: audit 2024-09-14T03:56:14.939567+0000 mgr.a (mgr.14355) 14502 : audit [DBG] from='client.314343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:17 smithi007 bash[22722]: cluster 2024-09-14T03:56:16.093087+0000 mgr.a (mgr.14355) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:56:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:17 smithi131 bash[24745]: cluster 2024-09-14T03:56:16.093087+0000 mgr.a (mgr.14355) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:56:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:17 smithi171 bash[25040]: cluster 2024-09-14T03:56:16.093087+0000 mgr.a (mgr.14355) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:56:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:19 smithi007 bash[22722]: cluster 2024-09-14T03:56:18.093861+0000 mgr.a (mgr.14355) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:19 smithi131 bash[24745]: cluster 2024-09-14T03:56:18.093861+0000 mgr.a (mgr.14355) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:19 smithi171 bash[25040]: cluster 2024-09-14T03:56:18.093861+0000 mgr.a (mgr.14355) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:20.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:20.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:21.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:21.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:21.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:21.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:21.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:21 smithi007 bash[22722]: cluster 2024-09-14T03:56:20.094644+0000 mgr.a (mgr.14355) 14505 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:21 smithi131 bash[24745]: cluster 2024-09-14T03:56:20.094644+0000 mgr.a (mgr.14355) 14505 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:21 smithi171 bash[25040]: cluster 2024-09-14T03:56:20.094644+0000 mgr.a (mgr.14355) 14505 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:56:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:22 smithi131 bash[24745]: audit 2024-09-14T03:56:20.695665+0000 mgr.a (mgr.14355) 14506 : audit [DBG] from='client.314418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:22 smithi171 bash[25040]: audit 2024-09-14T03:56:20.695665+0000 mgr.a (mgr.14355) 14506 : audit [DBG] from='client.314418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:22 smithi007 bash[22722]: audit 2024-09-14T03:56:20.695665+0000 mgr.a (mgr.14355) 14506 : audit [DBG] from='client.314418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:23 smithi131 bash[24745]: cluster 2024-09-14T03:56:22.097460+0000 mgr.a (mgr.14355) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:23 smithi171 bash[25040]: cluster 2024-09-14T03:56:22.097460+0000 mgr.a (mgr.14355) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:23 smithi007 bash[22722]: cluster 2024-09-14T03:56:22.097460+0000 mgr.a (mgr.14355) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:25 smithi131 bash[24745]: cluster 2024-09-14T03:56:24.098265+0000 mgr.a (mgr.14355) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:56:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:25 smithi171 bash[25040]: cluster 2024-09-14T03:56:24.098265+0000 mgr.a (mgr.14355) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:56:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:25 smithi007 bash[22722]: cluster 2024-09-14T03:56:24.098265+0000 mgr.a (mgr.14355) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:56:26.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:26.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:26.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:26.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:27 smithi131 bash[24745]: cluster 2024-09-14T03:56:26.100858+0000 mgr.a (mgr.14355) 14509 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:27 smithi131 bash[24745]: audit 2024-09-14T03:56:26.485380+0000 mgr.a (mgr.14355) 14510 : audit [DBG] from='client.314493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:27 smithi171 bash[25040]: cluster 2024-09-14T03:56:26.100858+0000 mgr.a (mgr.14355) 14509 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:27 smithi171 bash[25040]: audit 2024-09-14T03:56:26.485380+0000 mgr.a (mgr.14355) 14510 : audit [DBG] from='client.314493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:27 smithi007 bash[22722]: cluster 2024-09-14T03:56:26.100858+0000 mgr.a (mgr.14355) 14509 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:27 smithi007 bash[22722]: audit 2024-09-14T03:56:26.485380+0000 mgr.a (mgr.14355) 14510 : audit [DBG] from='client.314493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:29 smithi131 bash[24745]: cluster 2024-09-14T03:56:28.101886+0000 mgr.a (mgr.14355) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:29 smithi171 bash[25040]: cluster 2024-09-14T03:56:28.101886+0000 mgr.a (mgr.14355) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:29.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:29 smithi007 bash[22722]: cluster 2024-09-14T03:56:28.101886+0000 mgr.a (mgr.14355) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:31 smithi131 bash[24745]: cluster 2024-09-14T03:56:30.102884+0000 mgr.a (mgr.14355) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:31 smithi171 bash[25040]: cluster 2024-09-14T03:56:30.102884+0000 mgr.a (mgr.14355) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:31 smithi007 bash[22722]: cluster 2024-09-14T03:56:30.102884+0000 mgr.a (mgr.14355) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:56:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:32.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:32.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:33 smithi131 bash[24745]: cluster 2024-09-14T03:56:32.104730+0000 mgr.a (mgr.14355) 14513 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:56:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:33 smithi131 bash[24745]: audit 2024-09-14T03:56:32.238960+0000 mgr.a (mgr.14355) 14514 : audit [DBG] from='client.314571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:33 smithi171 bash[25040]: cluster 2024-09-14T03:56:32.104730+0000 mgr.a (mgr.14355) 14513 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:56:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:33 smithi171 bash[25040]: audit 2024-09-14T03:56:32.238960+0000 mgr.a (mgr.14355) 14514 : audit [DBG] from='client.314571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:33 smithi007 bash[22722]: cluster 2024-09-14T03:56:32.104730+0000 mgr.a (mgr.14355) 14513 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:56:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:33 smithi007 bash[22722]: audit 2024-09-14T03:56:32.238960+0000 mgr.a (mgr.14355) 14514 : audit [DBG] from='client.314571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:35 smithi131 bash[24745]: cluster 2024-09-14T03:56:34.105627+0000 mgr.a (mgr.14355) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:35 smithi171 bash[25040]: cluster 2024-09-14T03:56:34.105627+0000 mgr.a (mgr.14355) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:35 smithi007 bash[22722]: cluster 2024-09-14T03:56:34.105627+0000 mgr.a (mgr.14355) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:37 smithi131 bash[24745]: cluster 2024-09-14T03:56:36.107854+0000 mgr.a (mgr.14355) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:37 smithi171 bash[25040]: cluster 2024-09-14T03:56:36.107854+0000 mgr.a (mgr.14355) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:37.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:37 smithi007 bash[22722]: cluster 2024-09-14T03:56:36.107854+0000 mgr.a (mgr.14355) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:38.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:39 smithi131 bash[24745]: audit 2024-09-14T03:56:38.018806+0000 mgr.a (mgr.14355) 14517 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:39 smithi131 bash[24745]: cluster 2024-09-14T03:56:38.108389+0000 mgr.a (mgr.14355) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:39 smithi171 bash[25040]: audit 2024-09-14T03:56:38.018806+0000 mgr.a (mgr.14355) 14517 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:39 smithi171 bash[25040]: cluster 2024-09-14T03:56:38.108389+0000 mgr.a (mgr.14355) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:39 smithi007 bash[22722]: audit 2024-09-14T03:56:38.018806+0000 mgr.a (mgr.14355) 14517 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:39 smithi007 bash[22722]: cluster 2024-09-14T03:56:38.108389+0000 mgr.a (mgr.14355) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:41 smithi131 bash[24745]: cluster 2024-09-14T03:56:40.109434+0000 mgr.a (mgr.14355) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:41 smithi171 bash[25040]: cluster 2024-09-14T03:56:40.109434+0000 mgr.a (mgr.14355) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:41 smithi007 bash[22722]: cluster 2024-09-14T03:56:40.109434+0000 mgr.a (mgr.14355) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:43.443 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:43.443 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:43.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:43 smithi131 bash[24745]: cluster 2024-09-14T03:56:42.111839+0000 mgr.a (mgr.14355) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:43 smithi171 bash[25040]: cluster 2024-09-14T03:56:42.111839+0000 mgr.a (mgr.14355) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:43 smithi007 bash[22722]: cluster 2024-09-14T03:56:42.111839+0000 mgr.a (mgr.14355) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:44.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:44.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:44.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:44.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:45 smithi131 bash[24745]: audit 2024-09-14T03:56:43.772613+0000 mgr.a (mgr.14355) 14521 : audit [DBG] from='client.314727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:45 smithi131 bash[24745]: cluster 2024-09-14T03:56:44.112411+0000 mgr.a (mgr.14355) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:45.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:45 smithi131 bash[24745]: audit 2024-09-14T03:56:44.493182+0000 mon.a (mon.0) 2756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:56:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:45 smithi171 bash[25040]: audit 2024-09-14T03:56:43.772613+0000 mgr.a (mgr.14355) 14521 : audit [DBG] from='client.314727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:45 smithi171 bash[25040]: cluster 2024-09-14T03:56:44.112411+0000 mgr.a (mgr.14355) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:45 smithi171 bash[25040]: audit 2024-09-14T03:56:44.493182+0000 mon.a (mon.0) 2756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:56:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:45 smithi007 bash[22722]: audit 2024-09-14T03:56:43.772613+0000 mgr.a (mgr.14355) 14521 : audit [DBG] from='client.314727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:45 smithi007 bash[22722]: cluster 2024-09-14T03:56:44.112411+0000 mgr.a (mgr.14355) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:45 smithi007 bash[22722]: audit 2024-09-14T03:56:44.493182+0000 mon.a (mon.0) 2756 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:56:46.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22972]: debug 2024-09-14T03:56:46.620+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:56:46.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22972]: debug 2024-09-14T03:56:46.620+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:56:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.829173+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.836513+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.857690+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.865011+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.873097+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.879283+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.880603+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.881646+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.889364+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.891666+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:45.892591+0000 mgr.a (mgr.14355) 14523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: cluster 2024-09-14T03:56:46.114137+0000 mgr.a (mgr.14355) 14524 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:46.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: audit 2024-09-14T03:56:46.624052+0000 mgr.a (mgr.14355) 14525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:56:46.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:46 smithi007 bash[22722]: cephadm 2024-09-14T03:56:46.625903+0000 mgr.a (mgr.14355) 14526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.829173+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.836513+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.857690+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.865011+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.873097+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.879283+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.880603+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.881646+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.889364+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.891666+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:45.892591+0000 mgr.a (mgr.14355) 14523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: cluster 2024-09-14T03:56:46.114137+0000 mgr.a (mgr.14355) 14524 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: audit 2024-09-14T03:56:46.624052+0000 mgr.a (mgr.14355) 14525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:56:47.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:46 smithi131 bash[24745]: cephadm 2024-09-14T03:56:46.625903+0000 mgr.a (mgr.14355) 14526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:56:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.829173+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.836513+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.857690+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.865011+0000 mon.a (mon.0) 2760 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.873097+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.879283+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.880603+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.881646+0000 mon.a (mon.0) 2764 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.889364+0000 mon.a (mon.0) 2765 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.891666+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:45.892591+0000 mgr.a (mgr.14355) 14523 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: cluster 2024-09-14T03:56:46.114137+0000 mgr.a (mgr.14355) 14524 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: audit 2024-09-14T03:56:46.624052+0000 mgr.a (mgr.14355) 14525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:56:47.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:46 smithi171 bash[25040]: cephadm 2024-09-14T03:56:46.625903+0000 mgr.a (mgr.14355) 14526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:56:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:49.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:49 smithi007 bash[22722]: cluster 2024-09-14T03:56:48.115006+0000 mgr.a (mgr.14355) 14527 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:49 smithi131 bash[24745]: cluster 2024-09-14T03:56:48.115006+0000 mgr.a (mgr.14355) 14527 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:49 smithi171 bash[25040]: cluster 2024-09-14T03:56:48.115006+0000 mgr.a (mgr.14355) 14527 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:49.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:49.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:50 smithi007 bash[22722]: audit 2024-09-14T03:56:49.531546+0000 mgr.a (mgr.14355) 14528 : audit [DBG] from='client.314913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:50 smithi131 bash[24745]: audit 2024-09-14T03:56:49.531546+0000 mgr.a (mgr.14355) 14528 : audit [DBG] from='client.314913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:50 smithi171 bash[25040]: audit 2024-09-14T03:56:49.531546+0000 mgr.a (mgr.14355) 14528 : audit [DBG] from='client.314913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:51 smithi007 bash[22722]: cluster 2024-09-14T03:56:50.115984+0000 mgr.a (mgr.14355) 14529 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:51 smithi131 bash[24745]: cluster 2024-09-14T03:56:50.115984+0000 mgr.a (mgr.14355) 14529 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:51 smithi171 bash[25040]: cluster 2024-09-14T03:56:50.115984+0000 mgr.a (mgr.14355) 14529 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:56:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:53 smithi007 bash[22722]: cluster 2024-09-14T03:56:52.118261+0000 mgr.a (mgr.14355) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:53 smithi131 bash[24745]: cluster 2024-09-14T03:56:52.118261+0000 mgr.a (mgr.14355) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:53 smithi171 bash[25040]: cluster 2024-09-14T03:56:52.118261+0000 mgr.a (mgr.14355) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:56:54.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:56:54.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:56:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:55 smithi007 bash[22722]: cluster 2024-09-14T03:56:54.119099+0000 mgr.a (mgr.14355) 14531 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:55 smithi131 bash[24745]: cluster 2024-09-14T03:56:54.119099+0000 mgr.a (mgr.14355) 14531 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:55 smithi171 bash[25040]: cluster 2024-09-14T03:56:54.119099+0000 mgr.a (mgr.14355) 14531 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:55.732 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:56:55.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:56:55.732 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:56:55.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:56:55.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:56:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:56 smithi007 bash[22722]: audit 2024-09-14T03:56:55.310581+0000 mgr.a (mgr.14355) 14532 : audit [DBG] from='client.314991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:56 smithi131 bash[24745]: audit 2024-09-14T03:56:55.310581+0000 mgr.a (mgr.14355) 14532 : audit [DBG] from='client.314991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:56 smithi171 bash[25040]: audit 2024-09-14T03:56:55.310581+0000 mgr.a (mgr.14355) 14532 : audit [DBG] from='client.314991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:56:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:57 smithi007 bash[22722]: cluster 2024-09-14T03:56:56.121973+0000 mgr.a (mgr.14355) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:57 smithi131 bash[24745]: cluster 2024-09-14T03:56:56.121973+0000 mgr.a (mgr.14355) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:57 smithi171 bash[25040]: cluster 2024-09-14T03:56:56.121973+0000 mgr.a (mgr.14355) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:56:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:56:59 smithi131 bash[24745]: cluster 2024-09-14T03:56:58.122752+0000 mgr.a (mgr.14355) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:56:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:56:59 smithi171 bash[25040]: cluster 2024-09-14T03:56:58.122752+0000 mgr.a (mgr.14355) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:56:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:56:59 smithi007 bash[22722]: cluster 2024-09-14T03:56:58.122752+0000 mgr.a (mgr.14355) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:57:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:00.734 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:01.488 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:01.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:01.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:01.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:01.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:01 smithi131 bash[24745]: cluster 2024-09-14T03:57:00.123548+0000 mgr.a (mgr.14355) 14535 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:57:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:01 smithi171 bash[25040]: cluster 2024-09-14T03:57:00.123548+0000 mgr.a (mgr.14355) 14535 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:57:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:01 smithi007 bash[22722]: cluster 2024-09-14T03:57:00.123548+0000 mgr.a (mgr.14355) 14535 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T03:57:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:02 smithi131 bash[24745]: audit 2024-09-14T03:57:01.061758+0000 mgr.a (mgr.14355) 14536 : audit [DBG] from='client.315066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:02 smithi171 bash[25040]: audit 2024-09-14T03:57:01.061758+0000 mgr.a (mgr.14355) 14536 : audit [DBG] from='client.315066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:02 smithi007 bash[22722]: audit 2024-09-14T03:57:01.061758+0000 mgr.a (mgr.14355) 14536 : audit [DBG] from='client.315066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:03 smithi131 bash[24745]: cluster 2024-09-14T03:57:02.126595+0000 mgr.a (mgr.14355) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:03 smithi171 bash[25040]: cluster 2024-09-14T03:57:02.126595+0000 mgr.a (mgr.14355) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:03 smithi007 bash[22722]: cluster 2024-09-14T03:57:02.126595+0000 mgr.a (mgr.14355) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:05 smithi131 bash[24745]: cluster 2024-09-14T03:57:04.127546+0000 mgr.a (mgr.14355) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:57:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:05 smithi171 bash[25040]: cluster 2024-09-14T03:57:04.127546+0000 mgr.a (mgr.14355) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:57:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:05 smithi007 bash[22722]: cluster 2024-09-14T03:57:04.127546+0000 mgr.a (mgr.14355) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:57:06.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:06.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:07.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:07.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:07 smithi131 bash[24745]: cluster 2024-09-14T03:57:06.129537+0000 mgr.a (mgr.14355) 14539 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:07 smithi171 bash[25040]: cluster 2024-09-14T03:57:06.129537+0000 mgr.a (mgr.14355) 14539 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:07 smithi007 bash[22722]: cluster 2024-09-14T03:57:06.129537+0000 mgr.a (mgr.14355) 14539 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:08 smithi131 bash[24745]: audit 2024-09-14T03:57:06.825852+0000 mgr.a (mgr.14355) 14540 : audit [DBG] from='client.315141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:08 smithi171 bash[25040]: audit 2024-09-14T03:57:06.825852+0000 mgr.a (mgr.14355) 14540 : audit [DBG] from='client.315141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:08 smithi007 bash[22722]: audit 2024-09-14T03:57:06.825852+0000 mgr.a (mgr.14355) 14540 : audit [DBG] from='client.315141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:09 smithi131 bash[24745]: cluster 2024-09-14T03:57:08.130456+0000 mgr.a (mgr.14355) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:09 smithi171 bash[25040]: cluster 2024-09-14T03:57:08.130456+0000 mgr.a (mgr.14355) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:09 smithi007 bash[22722]: cluster 2024-09-14T03:57:08.130456+0000 mgr.a (mgr.14355) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:11 smithi131 bash[24745]: cluster 2024-09-14T03:57:10.131244+0000 mgr.a (mgr.14355) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:11 smithi171 bash[25040]: cluster 2024-09-14T03:57:10.131244+0000 mgr.a (mgr.14355) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:11 smithi007 bash[22722]: cluster 2024-09-14T03:57:10.131244+0000 mgr.a (mgr.14355) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:13.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:13.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:13.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:13.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:13.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:13 smithi131 bash[24745]: cluster 2024-09-14T03:57:12.133462+0000 mgr.a (mgr.14355) 14543 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:13 smithi131 bash[24745]: audit 2024-09-14T03:57:12.579929+0000 mgr.a (mgr.14355) 14544 : audit [DBG] from='client.315219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:13 smithi171 bash[25040]: cluster 2024-09-14T03:57:12.133462+0000 mgr.a (mgr.14355) 14543 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:13 smithi171 bash[25040]: audit 2024-09-14T03:57:12.579929+0000 mgr.a (mgr.14355) 14544 : audit [DBG] from='client.315219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:13 smithi007 bash[22722]: cluster 2024-09-14T03:57:12.133462+0000 mgr.a (mgr.14355) 14543 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:13 smithi007 bash[22722]: audit 2024-09-14T03:57:12.579929+0000 mgr.a (mgr.14355) 14544 : audit [DBG] from='client.315219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:15 smithi131 bash[24745]: cluster 2024-09-14T03:57:14.134377+0000 mgr.a (mgr.14355) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:15 smithi171 bash[25040]: cluster 2024-09-14T03:57:14.134377+0000 mgr.a (mgr.14355) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:15 smithi007 bash[22722]: cluster 2024-09-14T03:57:14.134377+0000 mgr.a (mgr.14355) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:17 smithi131 bash[24745]: cluster 2024-09-14T03:57:16.136563+0000 mgr.a (mgr.14355) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:17 smithi171 bash[25040]: cluster 2024-09-14T03:57:16.136563+0000 mgr.a (mgr.14355) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:17 smithi007 bash[22722]: cluster 2024-09-14T03:57:16.136563+0000 mgr.a (mgr.14355) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:18.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:18.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:18.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:18.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:18.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:18.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:18.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:19 smithi131 bash[24745]: cluster 2024-09-14T03:57:18.137044+0000 mgr.a (mgr.14355) 14547 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:19 smithi131 bash[24745]: audit 2024-09-14T03:57:18.366540+0000 mgr.a (mgr.14355) 14548 : audit [DBG] from='client.315294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:19 smithi171 bash[25040]: cluster 2024-09-14T03:57:18.137044+0000 mgr.a (mgr.14355) 14547 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:19 smithi171 bash[25040]: audit 2024-09-14T03:57:18.366540+0000 mgr.a (mgr.14355) 14548 : audit [DBG] from='client.315294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:19 smithi007 bash[22722]: cluster 2024-09-14T03:57:18.137044+0000 mgr.a (mgr.14355) 14547 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:19 smithi007 bash[22722]: audit 2024-09-14T03:57:18.366540+0000 mgr.a (mgr.14355) 14548 : audit [DBG] from='client.315294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:21 smithi131 bash[24745]: cluster 2024-09-14T03:57:20.137931+0000 mgr.a (mgr.14355) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:21 smithi171 bash[25040]: cluster 2024-09-14T03:57:20.137931+0000 mgr.a (mgr.14355) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:21 smithi007 bash[22722]: cluster 2024-09-14T03:57:20.137931+0000 mgr.a (mgr.14355) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:23 smithi131 bash[24745]: cluster 2024-09-14T03:57:22.140209+0000 mgr.a (mgr.14355) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:23 smithi171 bash[25040]: cluster 2024-09-14T03:57:22.140209+0000 mgr.a (mgr.14355) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:23 smithi007 bash[22722]: cluster 2024-09-14T03:57:22.140209+0000 mgr.a (mgr.14355) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:23.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:23.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:23.791 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:24.538 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:24.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:24.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:24.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:24.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:25 smithi131 bash[24745]: audit 2024-09-14T03:57:24.122456+0000 mgr.a (mgr.14355) 14551 : audit [DBG] from='client.315369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:25 smithi131 bash[24745]: cluster 2024-09-14T03:57:24.141565+0000 mgr.a (mgr.14355) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:25 smithi171 bash[25040]: audit 2024-09-14T03:57:24.122456+0000 mgr.a (mgr.14355) 14551 : audit [DBG] from='client.315369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:25 smithi171 bash[25040]: cluster 2024-09-14T03:57:24.141565+0000 mgr.a (mgr.14355) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:25 smithi007 bash[22722]: audit 2024-09-14T03:57:24.122456+0000 mgr.a (mgr.14355) 14551 : audit [DBG] from='client.315369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:25 smithi007 bash[22722]: cluster 2024-09-14T03:57:24.141565+0000 mgr.a (mgr.14355) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:27 smithi131 bash[24745]: cluster 2024-09-14T03:57:26.144028+0000 mgr.a (mgr.14355) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:27 smithi171 bash[25040]: cluster 2024-09-14T03:57:26.144028+0000 mgr.a (mgr.14355) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:27 smithi007 bash[22722]: cluster 2024-09-14T03:57:26.144028+0000 mgr.a (mgr.14355) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:29 smithi131 bash[24745]: cluster 2024-09-14T03:57:28.144795+0000 mgr.a (mgr.14355) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:29.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:29.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:29.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:29 smithi171 bash[25040]: cluster 2024-09-14T03:57:28.144795+0000 mgr.a (mgr.14355) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:29 smithi007 bash[22722]: cluster 2024-09-14T03:57:28.144795+0000 mgr.a (mgr.14355) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:30.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:31 smithi171 bash[25040]: audit 2024-09-14T03:57:29.872470+0000 mgr.a (mgr.14355) 14555 : audit [DBG] from='client.315444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:31 smithi171 bash[25040]: cluster 2024-09-14T03:57:30.145398+0000 mgr.a (mgr.14355) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:31 smithi007 bash[22722]: audit 2024-09-14T03:57:29.872470+0000 mgr.a (mgr.14355) 14555 : audit [DBG] from='client.315444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:31 smithi007 bash[22722]: cluster 2024-09-14T03:57:30.145398+0000 mgr.a (mgr.14355) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:31 smithi131 bash[24745]: audit 2024-09-14T03:57:29.872470+0000 mgr.a (mgr.14355) 14555 : audit [DBG] from='client.315444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:31 smithi131 bash[24745]: cluster 2024-09-14T03:57:30.145398+0000 mgr.a (mgr.14355) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:33 smithi171 bash[25040]: cluster 2024-09-14T03:57:32.147704+0000 mgr.a (mgr.14355) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:57:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:33 smithi007 bash[22722]: cluster 2024-09-14T03:57:32.147704+0000 mgr.a (mgr.14355) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:57:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:33 smithi131 bash[24745]: cluster 2024-09-14T03:57:32.147704+0000 mgr.a (mgr.14355) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T03:57:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:35 smithi171 bash[25040]: cluster 2024-09-14T03:57:34.148480+0000 mgr.a (mgr.14355) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:57:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:35 smithi007 bash[22722]: cluster 2024-09-14T03:57:34.148480+0000 mgr.a (mgr.14355) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:57:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:35 smithi131 bash[24745]: cluster 2024-09-14T03:57:34.148480+0000 mgr.a (mgr.14355) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T03:57:36.045 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:36.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:36 smithi007 bash[22722]: audit 2024-09-14T03:57:35.632262+0000 mgr.a (mgr.14355) 14559 : audit [DBG] from='client.315522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:36 smithi131 bash[24745]: audit 2024-09-14T03:57:35.632262+0000 mgr.a (mgr.14355) 14559 : audit [DBG] from='client.315522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:36 smithi171 bash[25040]: audit 2024-09-14T03:57:35.632262+0000 mgr.a (mgr.14355) 14559 : audit [DBG] from='client.315522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:37 smithi007 bash[22722]: cluster 2024-09-14T03:57:36.149719+0000 mgr.a (mgr.14355) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:37 smithi131 bash[24745]: cluster 2024-09-14T03:57:36.149719+0000 mgr.a (mgr.14355) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:37 smithi171 bash[25040]: cluster 2024-09-14T03:57:36.149719+0000 mgr.a (mgr.14355) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:39 smithi007 bash[22722]: cluster 2024-09-14T03:57:38.150555+0000 mgr.a (mgr.14355) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:39 smithi131 bash[24745]: cluster 2024-09-14T03:57:38.150555+0000 mgr.a (mgr.14355) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:39 smithi171 bash[25040]: cluster 2024-09-14T03:57:38.150555+0000 mgr.a (mgr.14355) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:41.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:41.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:41.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:41 smithi007 bash[22722]: cluster 2024-09-14T03:57:40.151330+0000 mgr.a (mgr.14355) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:41 smithi131 bash[24745]: cluster 2024-09-14T03:57:40.151330+0000 mgr.a (mgr.14355) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:41 smithi171 bash[25040]: cluster 2024-09-14T03:57:40.151330+0000 mgr.a (mgr.14355) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:57:41.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:41.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:42 smithi007 bash[22722]: audit 2024-09-14T03:57:41.385331+0000 mgr.a (mgr.14355) 14563 : audit [DBG] from='client.315597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:42 smithi131 bash[24745]: audit 2024-09-14T03:57:41.385331+0000 mgr.a (mgr.14355) 14563 : audit [DBG] from='client.315597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:42 smithi171 bash[25040]: audit 2024-09-14T03:57:41.385331+0000 mgr.a (mgr.14355) 14563 : audit [DBG] from='client.315597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:43 smithi007 bash[22722]: cluster 2024-09-14T03:57:42.154110+0000 mgr.a (mgr.14355) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:43 smithi131 bash[24745]: cluster 2024-09-14T03:57:42.154110+0000 mgr.a (mgr.14355) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:43 smithi171 bash[25040]: cluster 2024-09-14T03:57:42.154110+0000 mgr.a (mgr.14355) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:45 smithi007 bash[22722]: cluster 2024-09-14T03:57:44.154941+0000 mgr.a (mgr.14355) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:57:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:45 smithi131 bash[24745]: cluster 2024-09-14T03:57:44.154941+0000 mgr.a (mgr.14355) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:57:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:45 smithi171 bash[25040]: cluster 2024-09-14T03:57:44.154941+0000 mgr.a (mgr.14355) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T03:57:46.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:46.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:47.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:47.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:47 smithi007 bash[22722]: cluster 2024-09-14T03:57:46.156948+0000 mgr.a (mgr.14355) 14566 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:57:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:47 smithi007 bash[22722]: audit 2024-09-14T03:57:46.702722+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:57:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:47 smithi131 bash[24745]: cluster 2024-09-14T03:57:46.156948+0000 mgr.a (mgr.14355) 14566 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:57:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:47 smithi131 bash[24745]: audit 2024-09-14T03:57:46.702722+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:57:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:47 smithi171 bash[25040]: cluster 2024-09-14T03:57:46.156948+0000 mgr.a (mgr.14355) 14566 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T03:57:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:47 smithi171 bash[25040]: audit 2024-09-14T03:57:46.702722+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:57:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:48 smithi007 bash[22722]: audit 2024-09-14T03:57:47.173854+0000 mgr.a (mgr.14355) 14567 : audit [DBG] from='client.315672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:48 smithi131 bash[24745]: audit 2024-09-14T03:57:47.173854+0000 mgr.a (mgr.14355) 14567 : audit [DBG] from='client.315672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:48 smithi171 bash[25040]: audit 2024-09-14T03:57:47.173854+0000 mgr.a (mgr.14355) 14567 : audit [DBG] from='client.315672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:49 smithi007 bash[22722]: cluster 2024-09-14T03:57:48.158025+0000 mgr.a (mgr.14355) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:49 smithi131 bash[24745]: cluster 2024-09-14T03:57:48.158025+0000 mgr.a (mgr.14355) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:49 smithi171 bash[25040]: cluster 2024-09-14T03:57:48.158025+0000 mgr.a (mgr.14355) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:51 smithi007 bash[22722]: cluster 2024-09-14T03:57:50.159009+0000 mgr.a (mgr.14355) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:51 smithi131 bash[24745]: cluster 2024-09-14T03:57:50.159009+0000 mgr.a (mgr.14355) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:51 smithi171 bash[25040]: cluster 2024-09-14T03:57:50.159009+0000 mgr.a (mgr.14355) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:52.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:52.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:52.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.048455+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.052707+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.066205+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.070399+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.098625+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.103153+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: cluster 2024-09-14T03:57:52.160225+0000 mgr.a (mgr.14355) 14570 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.809433+0000 mon.a (mon.0) 2774 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.810521+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.818643+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22722]: audit 2024-09-14T03:57:52.820987+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.048455+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.052707+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.066205+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.070399+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.098625+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.103153+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: cluster 2024-09-14T03:57:52.160225+0000 mgr.a (mgr.14355) 14570 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.809433+0000 mon.a (mon.0) 2774 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:57:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.810521+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:57:53.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.818643+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:53 smithi131 bash[24745]: audit 2024-09-14T03:57:52.820987+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.048455+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.052707+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.066205+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.070399+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.098625+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.103153+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: cluster 2024-09-14T03:57:52.160225+0000 mgr.a (mgr.14355) 14570 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.809433+0000 mon.a (mon.0) 2774 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.810521+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.818643+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:57:53.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:53 smithi171 bash[25040]: audit 2024-09-14T03:57:52.820987+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:53.952 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:57:53.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:53.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:53.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:53.953 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:53.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22972]: debug 2024-09-14T03:57:53.543+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:57:53.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:57:53 smithi007 bash[22972]: debug 2024-09-14T03:57:53.555+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:57:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:54 smithi007 bash[22722]: audit 2024-09-14T03:57:52.823225+0000 mgr.a (mgr.14355) 14571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:54 smithi007 bash[22722]: audit 2024-09-14T03:57:52.925623+0000 mgr.a (mgr.14355) 14572 : audit [DBG] from='client.315750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:54 smithi007 bash[22722]: audit 2024-09-14T03:57:53.549807+0000 mgr.a (mgr.14355) 14573 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:57:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:54 smithi007 bash[22722]: cephadm 2024-09-14T03:57:53.560701+0000 mgr.a (mgr.14355) 14574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:57:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:54 smithi131 bash[24745]: audit 2024-09-14T03:57:52.823225+0000 mgr.a (mgr.14355) 14571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:54 smithi131 bash[24745]: audit 2024-09-14T03:57:52.925623+0000 mgr.a (mgr.14355) 14572 : audit [DBG] from='client.315750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:54 smithi131 bash[24745]: audit 2024-09-14T03:57:53.549807+0000 mgr.a (mgr.14355) 14573 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:57:54.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:54 smithi131 bash[24745]: cephadm 2024-09-14T03:57:53.560701+0000 mgr.a (mgr.14355) 14574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:57:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:54 smithi171 bash[25040]: audit 2024-09-14T03:57:52.823225+0000 mgr.a (mgr.14355) 14571 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:57:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:54 smithi171 bash[25040]: audit 2024-09-14T03:57:52.925623+0000 mgr.a (mgr.14355) 14572 : audit [DBG] from='client.315750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:57:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:54 smithi171 bash[25040]: audit 2024-09-14T03:57:53.549807+0000 mgr.a (mgr.14355) 14573 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:57:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:54 smithi171 bash[25040]: cephadm 2024-09-14T03:57:53.560701+0000 mgr.a (mgr.14355) 14574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:57:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:55 smithi007 bash[22722]: cluster 2024-09-14T03:57:54.161130+0000 mgr.a (mgr.14355) 14575 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:55 smithi131 bash[24745]: cluster 2024-09-14T03:57:54.161130+0000 mgr.a (mgr.14355) 14575 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:55 smithi171 bash[25040]: cluster 2024-09-14T03:57:54.161130+0000 mgr.a (mgr.14355) 14575 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:57:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:57 smithi131 bash[24745]: cluster 2024-09-14T03:57:56.163340+0000 mgr.a (mgr.14355) 14576 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:57 smithi171 bash[25040]: cluster 2024-09-14T03:57:56.163340+0000 mgr.a (mgr.14355) 14576 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:57 smithi007 bash[22722]: cluster 2024-09-14T03:57:56.163340+0000 mgr.a (mgr.14355) 14576 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:57:58.954 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:57:58.955 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:57:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:57:59 smithi131 bash[24745]: cluster 2024-09-14T03:57:58.164077+0000 mgr.a (mgr.14355) 14577 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:57:59 smithi171 bash[25040]: cluster 2024-09-14T03:57:58.164077+0000 mgr.a (mgr.14355) 14577 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:57:59 smithi007 bash[22722]: cluster 2024-09-14T03:57:58.164077+0000 mgr.a (mgr.14355) 14577 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:57:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:57:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:57:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:57:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:57:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:00 smithi131 bash[24745]: audit 2024-09-14T03:57:59.282644+0000 mgr.a (mgr.14355) 14578 : audit [DBG] from='client.315930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:00 smithi171 bash[25040]: audit 2024-09-14T03:57:59.282644+0000 mgr.a (mgr.14355) 14578 : audit [DBG] from='client.315930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:00 smithi007 bash[22722]: audit 2024-09-14T03:57:59.282644+0000 mgr.a (mgr.14355) 14578 : audit [DBG] from='client.315930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:01 smithi131 bash[24745]: cluster 2024-09-14T03:58:00.165011+0000 mgr.a (mgr.14355) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:01 smithi171 bash[25040]: cluster 2024-09-14T03:58:00.165011+0000 mgr.a (mgr.14355) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:01 smithi007 bash[22722]: cluster 2024-09-14T03:58:00.165011+0000 mgr.a (mgr.14355) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:03 smithi131 bash[24745]: cluster 2024-09-14T03:58:02.167310+0000 mgr.a (mgr.14355) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:03 smithi171 bash[25040]: cluster 2024-09-14T03:58:02.167310+0000 mgr.a (mgr.14355) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:03 smithi007 bash[22722]: cluster 2024-09-14T03:58:02.167310+0000 mgr.a (mgr.14355) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:04.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:04.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:04.708 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:05.491 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:05.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:05 smithi131 bash[24745]: cluster 2024-09-14T03:58:04.168106+0000 mgr.a (mgr.14355) 14581 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:05 smithi171 bash[25040]: cluster 2024-09-14T03:58:04.168106+0000 mgr.a (mgr.14355) 14581 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:05 smithi007 bash[22722]: cluster 2024-09-14T03:58:04.168106+0000 mgr.a (mgr.14355) 14581 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:06 smithi131 bash[24745]: audit 2024-09-14T03:58:05.043739+0000 mgr.a (mgr.14355) 14582 : audit [DBG] from='client.316008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:06 smithi171 bash[25040]: audit 2024-09-14T03:58:05.043739+0000 mgr.a (mgr.14355) 14582 : audit [DBG] from='client.316008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:06 smithi007 bash[22722]: audit 2024-09-14T03:58:05.043739+0000 mgr.a (mgr.14355) 14582 : audit [DBG] from='client.316008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:07 smithi131 bash[24745]: cluster 2024-09-14T03:58:06.170940+0000 mgr.a (mgr.14355) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:07 smithi171 bash[25040]: cluster 2024-09-14T03:58:06.170940+0000 mgr.a (mgr.14355) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:07 smithi007 bash[22722]: cluster 2024-09-14T03:58:06.170940+0000 mgr.a (mgr.14355) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:09 smithi131 bash[24745]: cluster 2024-09-14T03:58:08.171719+0000 mgr.a (mgr.14355) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:09 smithi171 bash[25040]: cluster 2024-09-14T03:58:08.171719+0000 mgr.a (mgr.14355) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:09 smithi007 bash[22722]: cluster 2024-09-14T03:58:08.171719+0000 mgr.a (mgr.14355) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:10.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:11.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:11 smithi131 bash[24745]: cluster 2024-09-14T03:58:10.172483+0000 mgr.a (mgr.14355) 14585 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:11 smithi171 bash[25040]: cluster 2024-09-14T03:58:10.172483+0000 mgr.a (mgr.14355) 14585 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:11 smithi007 bash[22722]: cluster 2024-09-14T03:58:10.172483+0000 mgr.a (mgr.14355) 14585 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:12 smithi131 bash[24745]: audit 2024-09-14T03:58:10.828760+0000 mgr.a (mgr.14355) 14586 : audit [DBG] from='client.316083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:12 smithi171 bash[25040]: audit 2024-09-14T03:58:10.828760+0000 mgr.a (mgr.14355) 14586 : audit [DBG] from='client.316083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:12 smithi007 bash[22722]: audit 2024-09-14T03:58:10.828760+0000 mgr.a (mgr.14355) 14586 : audit [DBG] from='client.316083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:13.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:13 smithi131 bash[24745]: cluster 2024-09-14T03:58:12.175220+0000 mgr.a (mgr.14355) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:13 smithi171 bash[25040]: cluster 2024-09-14T03:58:12.175220+0000 mgr.a (mgr.14355) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:13 smithi007 bash[22722]: cluster 2024-09-14T03:58:12.175220+0000 mgr.a (mgr.14355) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:15 smithi131 bash[24745]: cluster 2024-09-14T03:58:14.175975+0000 mgr.a (mgr.14355) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:15 smithi171 bash[25040]: cluster 2024-09-14T03:58:14.175975+0000 mgr.a (mgr.14355) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:15 smithi007 bash[22722]: cluster 2024-09-14T03:58:14.175975+0000 mgr.a (mgr.14355) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:17.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:17.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:17.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:17 smithi171 bash[25040]: cluster 2024-09-14T03:58:16.177965+0000 mgr.a (mgr.14355) 14589 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:17 smithi171 bash[25040]: audit 2024-09-14T03:58:16.613054+0000 mgr.a (mgr.14355) 14590 : audit [DBG] from='client.316161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:17 smithi007 bash[22722]: cluster 2024-09-14T03:58:16.177965+0000 mgr.a (mgr.14355) 14589 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:17 smithi007 bash[22722]: audit 2024-09-14T03:58:16.613054+0000 mgr.a (mgr.14355) 14590 : audit [DBG] from='client.316161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:17 smithi131 bash[24745]: cluster 2024-09-14T03:58:16.177965+0000 mgr.a (mgr.14355) 14589 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:17 smithi131 bash[24745]: audit 2024-09-14T03:58:16.613054+0000 mgr.a (mgr.14355) 14590 : audit [DBG] from='client.316161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:19 smithi171 bash[25040]: cluster 2024-09-14T03:58:18.178880+0000 mgr.a (mgr.14355) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:19 smithi007 bash[22722]: cluster 2024-09-14T03:58:18.178880+0000 mgr.a (mgr.14355) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:19 smithi131 bash[24745]: cluster 2024-09-14T03:58:18.178880+0000 mgr.a (mgr.14355) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:21 smithi007 bash[22722]: cluster 2024-09-14T03:58:20.179648+0000 mgr.a (mgr.14355) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:21 smithi131 bash[24745]: cluster 2024-09-14T03:58:20.179648+0000 mgr.a (mgr.14355) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:21 smithi171 bash[25040]: cluster 2024-09-14T03:58:20.179648+0000 mgr.a (mgr.14355) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:22.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:22.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:22.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:23 smithi007 bash[22722]: cluster 2024-09-14T03:58:22.181574+0000 mgr.a (mgr.14355) 14593 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:23 smithi007 bash[22722]: audit 2024-09-14T03:58:22.388252+0000 mgr.a (mgr.14355) 14594 : audit [DBG] from='client.316236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:23 smithi131 bash[24745]: cluster 2024-09-14T03:58:22.181574+0000 mgr.a (mgr.14355) 14593 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:23 smithi131 bash[24745]: audit 2024-09-14T03:58:22.388252+0000 mgr.a (mgr.14355) 14594 : audit [DBG] from='client.316236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:23 smithi171 bash[25040]: cluster 2024-09-14T03:58:22.181574+0000 mgr.a (mgr.14355) 14593 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:23 smithi171 bash[25040]: audit 2024-09-14T03:58:22.388252+0000 mgr.a (mgr.14355) 14594 : audit [DBG] from='client.316236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:25 smithi007 bash[22722]: cluster 2024-09-14T03:58:24.182461+0000 mgr.a (mgr.14355) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:25 smithi131 bash[24745]: cluster 2024-09-14T03:58:24.182461+0000 mgr.a (mgr.14355) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:25 smithi171 bash[25040]: cluster 2024-09-14T03:58:24.182461+0000 mgr.a (mgr.14355) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:27.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:27 smithi007 bash[22722]: cluster 2024-09-14T03:58:26.184692+0000 mgr.a (mgr.14355) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:27 smithi131 bash[24745]: cluster 2024-09-14T03:58:26.184692+0000 mgr.a (mgr.14355) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:27 smithi171 bash[25040]: cluster 2024-09-14T03:58:26.184692+0000 mgr.a (mgr.14355) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:28.613 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:28.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:28.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:28.613 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:28.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:29 smithi007 bash[22722]: audit 2024-09-14T03:58:28.181220+0000 mgr.a (mgr.14355) 14597 : audit [DBG] from='client.316314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:29 smithi007 bash[22722]: cluster 2024-09-14T03:58:28.199863+0000 mgr.a (mgr.14355) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:29 smithi131 bash[24745]: audit 2024-09-14T03:58:28.181220+0000 mgr.a (mgr.14355) 14597 : audit [DBG] from='client.316314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:29 smithi131 bash[24745]: cluster 2024-09-14T03:58:28.199863+0000 mgr.a (mgr.14355) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:29 smithi171 bash[25040]: audit 2024-09-14T03:58:28.181220+0000 mgr.a (mgr.14355) 14597 : audit [DBG] from='client.316314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:29 smithi171 bash[25040]: cluster 2024-09-14T03:58:28.199863+0000 mgr.a (mgr.14355) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:31 smithi007 bash[22722]: cluster 2024-09-14T03:58:30.200856+0000 mgr.a (mgr.14355) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:31 smithi131 bash[24745]: cluster 2024-09-14T03:58:30.200856+0000 mgr.a (mgr.14355) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:31 smithi171 bash[25040]: cluster 2024-09-14T03:58:30.200856+0000 mgr.a (mgr.14355) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:33.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:33.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:33.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:33 smithi007 bash[22722]: cluster 2024-09-14T03:58:32.203117+0000 mgr.a (mgr.14355) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:33 smithi131 bash[24745]: cluster 2024-09-14T03:58:32.203117+0000 mgr.a (mgr.14355) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:33 smithi171 bash[25040]: cluster 2024-09-14T03:58:32.203117+0000 mgr.a (mgr.14355) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:34.377 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:34.377 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:35 smithi007 bash[22722]: audit 2024-09-14T03:58:33.943457+0000 mgr.a (mgr.14355) 14601 : audit [DBG] from='client.316389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:35 smithi007 bash[22722]: cluster 2024-09-14T03:58:34.203601+0000 mgr.a (mgr.14355) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:35 smithi131 bash[24745]: audit 2024-09-14T03:58:33.943457+0000 mgr.a (mgr.14355) 14601 : audit [DBG] from='client.316389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:35 smithi131 bash[24745]: cluster 2024-09-14T03:58:34.203601+0000 mgr.a (mgr.14355) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:35 smithi171 bash[25040]: audit 2024-09-14T03:58:33.943457+0000 mgr.a (mgr.14355) 14601 : audit [DBG] from='client.316389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:35 smithi171 bash[25040]: cluster 2024-09-14T03:58:34.203601+0000 mgr.a (mgr.14355) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:37 smithi007 bash[22722]: cluster 2024-09-14T03:58:36.205864+0000 mgr.a (mgr.14355) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:37 smithi131 bash[24745]: cluster 2024-09-14T03:58:36.205864+0000 mgr.a (mgr.14355) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:37 smithi171 bash[25040]: cluster 2024-09-14T03:58:36.205864+0000 mgr.a (mgr.14355) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:39.379 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:39 smithi007 bash[22722]: cluster 2024-09-14T03:58:38.206659+0000 mgr.a (mgr.14355) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:39 smithi131 bash[24745]: cluster 2024-09-14T03:58:38.206659+0000 mgr.a (mgr.14355) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:39 smithi171 bash[25040]: cluster 2024-09-14T03:58:38.206659+0000 mgr.a (mgr.14355) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:40.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:41 smithi007 bash[22722]: audit 2024-09-14T03:58:39.715264+0000 mgr.a (mgr.14355) 14605 : audit [DBG] from='client.316467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:41 smithi007 bash[22722]: cluster 2024-09-14T03:58:40.207540+0000 mgr.a (mgr.14355) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:41 smithi131 bash[24745]: audit 2024-09-14T03:58:39.715264+0000 mgr.a (mgr.14355) 14605 : audit [DBG] from='client.316467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:41 smithi131 bash[24745]: cluster 2024-09-14T03:58:40.207540+0000 mgr.a (mgr.14355) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:41 smithi171 bash[25040]: audit 2024-09-14T03:58:39.715264+0000 mgr.a (mgr.14355) 14605 : audit [DBG] from='client.316467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:41 smithi171 bash[25040]: cluster 2024-09-14T03:58:40.207540+0000 mgr.a (mgr.14355) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:43 smithi007 bash[22722]: cluster 2024-09-14T03:58:42.209762+0000 mgr.a (mgr.14355) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:43 smithi131 bash[24745]: cluster 2024-09-14T03:58:42.209762+0000 mgr.a (mgr.14355) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:43 smithi171 bash[25040]: cluster 2024-09-14T03:58:42.209762+0000 mgr.a (mgr.14355) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:58:45.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:45.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:45.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:45.925 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:45 smithi007 bash[22722]: cluster 2024-09-14T03:58:44.210559+0000 mgr.a (mgr.14355) 14608 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:45 smithi131 bash[24745]: cluster 2024-09-14T03:58:44.210559+0000 mgr.a (mgr.14355) 14608 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:45 smithi171 bash[25040]: cluster 2024-09-14T03:58:44.210559+0000 mgr.a (mgr.14355) 14608 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:46 smithi007 bash[22722]: audit 2024-09-14T03:58:45.484697+0000 mgr.a (mgr.14355) 14609 : audit [DBG] from='client.316542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:46 smithi131 bash[24745]: audit 2024-09-14T03:58:45.484697+0000 mgr.a (mgr.14355) 14609 : audit [DBG] from='client.316542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:46 smithi171 bash[25040]: audit 2024-09-14T03:58:45.484697+0000 mgr.a (mgr.14355) 14609 : audit [DBG] from='client.316542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:47 smithi007 bash[22722]: cluster 2024-09-14T03:58:46.213377+0000 mgr.a (mgr.14355) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:47 smithi131 bash[24745]: cluster 2024-09-14T03:58:46.213377+0000 mgr.a (mgr.14355) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:47 smithi171 bash[25040]: cluster 2024-09-14T03:58:46.213377+0000 mgr.a (mgr.14355) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:49.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:49 smithi007 bash[22722]: cluster 2024-09-14T03:58:48.214157+0000 mgr.a (mgr.14355) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:49 smithi131 bash[24745]: cluster 2024-09-14T03:58:48.214157+0000 mgr.a (mgr.14355) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:49 smithi171 bash[25040]: cluster 2024-09-14T03:58:48.214157+0000 mgr.a (mgr.14355) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:50.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:50.927 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:50.927 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:51.712 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:51.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:51 smithi007 bash[22722]: cluster 2024-09-14T03:58:50.215059+0000 mgr.a (mgr.14355) 14612 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:51 smithi131 bash[24745]: cluster 2024-09-14T03:58:50.215059+0000 mgr.a (mgr.14355) 14612 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:51 smithi171 bash[25040]: cluster 2024-09-14T03:58:50.215059+0000 mgr.a (mgr.14355) 14612 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:58:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:52 smithi007 bash[22722]: audit 2024-09-14T03:58:51.258221+0000 mgr.a (mgr.14355) 14613 : audit [DBG] from='client.316617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:52 smithi131 bash[24745]: audit 2024-09-14T03:58:51.258221+0000 mgr.a (mgr.14355) 14613 : audit [DBG] from='client.316617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:52 smithi171 bash[25040]: audit 2024-09-14T03:58:51.258221+0000 mgr.a (mgr.14355) 14613 : audit [DBG] from='client.316617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:53 smithi007 bash[22722]: cluster 2024-09-14T03:58:52.218051+0000 mgr.a (mgr.14355) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:53 smithi007 bash[22722]: audit 2024-09-14T03:58:53.614675+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:58:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:53 smithi131 bash[24745]: cluster 2024-09-14T03:58:52.218051+0000 mgr.a (mgr.14355) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:53 smithi131 bash[24745]: audit 2024-09-14T03:58:53.614675+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:58:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:53 smithi171 bash[25040]: cluster 2024-09-14T03:58:52.218051+0000 mgr.a (mgr.14355) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:58:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:53 smithi171 bash[25040]: audit 2024-09-14T03:58:53.614675+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:58:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:54 smithi007 bash[22722]: audit 2024-09-14T03:58:54.467499+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:58:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:54 smithi007 bash[22722]: audit 2024-09-14T03:58:54.469153+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:58:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:54 smithi007 bash[22722]: audit 2024-09-14T03:58:54.479057+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:58:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:54 smithi007 bash[22722]: audit 2024-09-14T03:58:54.483665+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:54 smithi131 bash[24745]: audit 2024-09-14T03:58:54.467499+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:58:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:54 smithi131 bash[24745]: audit 2024-09-14T03:58:54.469153+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:58:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:54 smithi131 bash[24745]: audit 2024-09-14T03:58:54.479057+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:58:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:54 smithi131 bash[24745]: audit 2024-09-14T03:58:54.483665+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:54 smithi171 bash[25040]: audit 2024-09-14T03:58:54.467499+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:58:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:54 smithi171 bash[25040]: audit 2024-09-14T03:58:54.469153+0000 mon.a (mon.0) 2780 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:58:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:54 smithi171 bash[25040]: audit 2024-09-14T03:58:54.479057+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:58:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:54 smithi171 bash[25040]: audit 2024-09-14T03:58:54.483665+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:55.640 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:58:55 smithi007 bash[22972]: debug 2024-09-14T03:58:55.214+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:58:55.640 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:58:55 smithi007 bash[22972]: debug 2024-09-14T03:58:55.214+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:58:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:55 smithi007 bash[22722]: cluster 2024-09-14T03:58:54.218880+0000 mgr.a (mgr.14355) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:55 smithi007 bash[22722]: audit 2024-09-14T03:58:54.486100+0000 mgr.a (mgr.14355) 14616 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:55 smithi131 bash[24745]: cluster 2024-09-14T03:58:54.218880+0000 mgr.a (mgr.14355) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:55 smithi131 bash[24745]: audit 2024-09-14T03:58:54.486100+0000 mgr.a (mgr.14355) 14616 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:55 smithi171 bash[25040]: cluster 2024-09-14T03:58:54.218880+0000 mgr.a (mgr.14355) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:58:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:55 smithi171 bash[25040]: audit 2024-09-14T03:58:54.486100+0000 mgr.a (mgr.14355) 14616 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:58:56.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:58:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:58:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:58:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:56 smithi007 bash[22722]: audit 2024-09-14T03:58:55.220038+0000 mgr.a (mgr.14355) 14617 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:58:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:56 smithi007 bash[22722]: cephadm 2024-09-14T03:58:55.221186+0000 mgr.a (mgr.14355) 14618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:58:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:56 smithi131 bash[24745]: audit 2024-09-14T03:58:55.220038+0000 mgr.a (mgr.14355) 14617 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:58:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:56 smithi131 bash[24745]: cephadm 2024-09-14T03:58:55.221186+0000 mgr.a (mgr.14355) 14618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:58:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:56 smithi171 bash[25040]: audit 2024-09-14T03:58:55.220038+0000 mgr.a (mgr.14355) 14617 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:58:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:56 smithi171 bash[25040]: cephadm 2024-09-14T03:58:55.221186+0000 mgr.a (mgr.14355) 14618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:58:57.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:58:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:58:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:58:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:58:57.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:58:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:57 smithi007 bash[22722]: cluster 2024-09-14T03:58:56.221256+0000 mgr.a (mgr.14355) 14619 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:57 smithi131 bash[24745]: cluster 2024-09-14T03:58:56.221256+0000 mgr.a (mgr.14355) 14619 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:57 smithi171 bash[25040]: cluster 2024-09-14T03:58:56.221256+0000 mgr.a (mgr.14355) 14619 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:58:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:58 smithi007 bash[22722]: audit 2024-09-14T03:58:57.040968+0000 mgr.a (mgr.14355) 14620 : audit [DBG] from='client.316797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:58 smithi131 bash[24745]: audit 2024-09-14T03:58:57.040968+0000 mgr.a (mgr.14355) 14620 : audit [DBG] from='client.316797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:58 smithi171 bash[25040]: audit 2024-09-14T03:58:57.040968+0000 mgr.a (mgr.14355) 14620 : audit [DBG] from='client.316797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:58:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:58:59 smithi007 bash[22722]: cluster 2024-09-14T03:58:58.222219+0000 mgr.a (mgr.14355) 14621 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:58:59 smithi131 bash[24745]: cluster 2024-09-14T03:58:58.222219+0000 mgr.a (mgr.14355) 14621 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:58:59 smithi171 bash[25040]: cluster 2024-09-14T03:58:58.222219+0000 mgr.a (mgr.14355) 14621 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:01 smithi007 bash[22722]: cluster 2024-09-14T03:59:00.222961+0000 mgr.a (mgr.14355) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:01 smithi131 bash[24745]: cluster 2024-09-14T03:59:00.222961+0000 mgr.a (mgr.14355) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:01 smithi171 bash[25040]: cluster 2024-09-14T03:59:00.222961+0000 mgr.a (mgr.14355) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:02.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:03.228 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:03.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:03.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:03.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:03.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:03 smithi007 bash[22722]: cluster 2024-09-14T03:59:02.225141+0000 mgr.a (mgr.14355) 14623 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:03 smithi131 bash[24745]: cluster 2024-09-14T03:59:02.225141+0000 mgr.a (mgr.14355) 14623 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:03 smithi171 bash[25040]: cluster 2024-09-14T03:59:02.225141+0000 mgr.a (mgr.14355) 14623 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:04 smithi007 bash[22722]: audit 2024-09-14T03:59:02.790518+0000 mgr.a (mgr.14355) 14624 : audit [DBG] from='client.316875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:04 smithi131 bash[24745]: audit 2024-09-14T03:59:02.790518+0000 mgr.a (mgr.14355) 14624 : audit [DBG] from='client.316875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:05.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:04 smithi171 bash[25040]: audit 2024-09-14T03:59:02.790518+0000 mgr.a (mgr.14355) 14624 : audit [DBG] from='client.316875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:05 smithi007 bash[22722]: cluster 2024-09-14T03:59:04.226112+0000 mgr.a (mgr.14355) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:05 smithi131 bash[24745]: cluster 2024-09-14T03:59:04.226112+0000 mgr.a (mgr.14355) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:05 smithi171 bash[25040]: cluster 2024-09-14T03:59:04.226112+0000 mgr.a (mgr.14355) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:07 smithi007 bash[22722]: cluster 2024-09-14T03:59:06.228370+0000 mgr.a (mgr.14355) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:07 smithi131 bash[24745]: cluster 2024-09-14T03:59:06.228370+0000 mgr.a (mgr.14355) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:07 smithi171 bash[25040]: cluster 2024-09-14T03:59:06.228370+0000 mgr.a (mgr.14355) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T03:59:08.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:08.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:09.019 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:09.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:09 smithi007 bash[22722]: cluster 2024-09-14T03:59:08.229176+0000 mgr.a (mgr.14355) 14627 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:09.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:09 smithi007 bash[22722]: audit 2024-09-14T03:59:08.570045+0000 mgr.a (mgr.14355) 14628 : audit [DBG] from='client.316953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:09 smithi131 bash[24745]: cluster 2024-09-14T03:59:08.229176+0000 mgr.a (mgr.14355) 14627 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:09 smithi131 bash[24745]: audit 2024-09-14T03:59:08.570045+0000 mgr.a (mgr.14355) 14628 : audit [DBG] from='client.316953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:09 smithi171 bash[25040]: cluster 2024-09-14T03:59:08.229176+0000 mgr.a (mgr.14355) 14627 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:09 smithi171 bash[25040]: audit 2024-09-14T03:59:08.570045+0000 mgr.a (mgr.14355) 14628 : audit [DBG] from='client.316953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:11 smithi007 bash[22722]: cluster 2024-09-14T03:59:10.230133+0000 mgr.a (mgr.14355) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:11 smithi131 bash[24745]: cluster 2024-09-14T03:59:10.230133+0000 mgr.a (mgr.14355) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:11 smithi171 bash[25040]: cluster 2024-09-14T03:59:10.230133+0000 mgr.a (mgr.14355) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:13 smithi007 bash[22722]: cluster 2024-09-14T03:59:12.232402+0000 mgr.a (mgr.14355) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:14.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:14.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:14.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:13 smithi131 bash[24745]: cluster 2024-09-14T03:59:12.232402+0000 mgr.a (mgr.14355) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:13 smithi171 bash[25040]: cluster 2024-09-14T03:59:12.232402+0000 mgr.a (mgr.14355) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:14.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:15 smithi007 bash[22722]: cluster 2024-09-14T03:59:14.233148+0000 mgr.a (mgr.14355) 14631 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:15 smithi007 bash[22722]: audit 2024-09-14T03:59:14.356159+0000 mgr.a (mgr.14355) 14632 : audit [DBG] from='client.317031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:15 smithi131 bash[24745]: cluster 2024-09-14T03:59:14.233148+0000 mgr.a (mgr.14355) 14631 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:15 smithi131 bash[24745]: audit 2024-09-14T03:59:14.356159+0000 mgr.a (mgr.14355) 14632 : audit [DBG] from='client.317031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:15 smithi171 bash[25040]: cluster 2024-09-14T03:59:14.233148+0000 mgr.a (mgr.14355) 14631 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:15 smithi171 bash[25040]: audit 2024-09-14T03:59:14.356159+0000 mgr.a (mgr.14355) 14632 : audit [DBG] from='client.317031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:17 smithi131 bash[24745]: cluster 2024-09-14T03:59:16.235570+0000 mgr.a (mgr.14355) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:17 smithi171 bash[25040]: cluster 2024-09-14T03:59:16.235570+0000 mgr.a (mgr.14355) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:17 smithi007 bash[22722]: cluster 2024-09-14T03:59:16.235570+0000 mgr.a (mgr.14355) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:19.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:19.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:19 smithi131 bash[24745]: cluster 2024-09-14T03:59:18.236348+0000 mgr.a (mgr.14355) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:19 smithi171 bash[25040]: cluster 2024-09-14T03:59:18.236348+0000 mgr.a (mgr.14355) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:19 smithi007 bash[22722]: cluster 2024-09-14T03:59:18.236348+0000 mgr.a (mgr.14355) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:20.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:20.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:20.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:20.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:21 smithi131 bash[24745]: audit 2024-09-14T03:59:20.137191+0000 mgr.a (mgr.14355) 14635 : audit [DBG] from='client.317106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:21 smithi131 bash[24745]: cluster 2024-09-14T03:59:20.236801+0000 mgr.a (mgr.14355) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:21 smithi171 bash[25040]: audit 2024-09-14T03:59:20.137191+0000 mgr.a (mgr.14355) 14635 : audit [DBG] from='client.317106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:21 smithi171 bash[25040]: cluster 2024-09-14T03:59:20.236801+0000 mgr.a (mgr.14355) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:21 smithi007 bash[22722]: audit 2024-09-14T03:59:20.137191+0000 mgr.a (mgr.14355) 14635 : audit [DBG] from='client.317106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:21 smithi007 bash[22722]: cluster 2024-09-14T03:59:20.236801+0000 mgr.a (mgr.14355) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:23 smithi131 bash[24745]: cluster 2024-09-14T03:59:22.239488+0000 mgr.a (mgr.14355) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:23 smithi171 bash[25040]: cluster 2024-09-14T03:59:22.239488+0000 mgr.a (mgr.14355) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:23 smithi007 bash[22722]: cluster 2024-09-14T03:59:22.239488+0000 mgr.a (mgr.14355) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:24 smithi131 bash[24745]: cluster 2024-09-14T03:59:24.240270+0000 mgr.a (mgr.14355) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:59:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:24 smithi171 bash[25040]: cluster 2024-09-14T03:59:24.240270+0000 mgr.a (mgr.14355) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:59:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:24 smithi007 bash[22722]: cluster 2024-09-14T03:59:24.240270+0000 mgr.a (mgr.14355) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T03:59:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:25.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:26.316 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:26.316 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:27 smithi007 bash[22722]: audit 2024-09-14T03:59:25.886706+0000 mgr.a (mgr.14355) 14639 : audit [DBG] from='client.317184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:27 smithi007 bash[22722]: cluster 2024-09-14T03:59:26.241623+0000 mgr.a (mgr.14355) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:27 smithi131 bash[24745]: audit 2024-09-14T03:59:25.886706+0000 mgr.a (mgr.14355) 14639 : audit [DBG] from='client.317184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:27 smithi131 bash[24745]: cluster 2024-09-14T03:59:26.241623+0000 mgr.a (mgr.14355) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:27 smithi171 bash[25040]: audit 2024-09-14T03:59:25.886706+0000 mgr.a (mgr.14355) 14639 : audit [DBG] from='client.317184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:27 smithi171 bash[25040]: cluster 2024-09-14T03:59:26.241623+0000 mgr.a (mgr.14355) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:29 smithi007 bash[22722]: cluster 2024-09-14T03:59:28.242375+0000 mgr.a (mgr.14355) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:29 smithi131 bash[24745]: cluster 2024-09-14T03:59:28.242375+0000 mgr.a (mgr.14355) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:29 smithi171 bash[25040]: cluster 2024-09-14T03:59:28.242375+0000 mgr.a (mgr.14355) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:31.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:31.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:31.318 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:31 smithi007 bash[22722]: cluster 2024-09-14T03:59:30.243143+0000 mgr.a (mgr.14355) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:31 smithi131 bash[24745]: cluster 2024-09-14T03:59:30.243143+0000 mgr.a (mgr.14355) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:31 smithi171 bash[25040]: cluster 2024-09-14T03:59:30.243143+0000 mgr.a (mgr.14355) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T03:59:32.081 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:32 smithi007 bash[22722]: audit 2024-09-14T03:59:31.651978+0000 mgr.a (mgr.14355) 14643 : audit [DBG] from='client.317262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:32 smithi131 bash[24745]: audit 2024-09-14T03:59:31.651978+0000 mgr.a (mgr.14355) 14643 : audit [DBG] from='client.317262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:32 smithi171 bash[25040]: audit 2024-09-14T03:59:31.651978+0000 mgr.a (mgr.14355) 14643 : audit [DBG] from='client.317262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:33 smithi007 bash[22722]: cluster 2024-09-14T03:59:32.245935+0000 mgr.a (mgr.14355) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:33 smithi131 bash[24745]: cluster 2024-09-14T03:59:32.245935+0000 mgr.a (mgr.14355) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:33 smithi171 bash[25040]: cluster 2024-09-14T03:59:32.245935+0000 mgr.a (mgr.14355) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:35 smithi007 bash[22722]: cluster 2024-09-14T03:59:34.246764+0000 mgr.a (mgr.14355) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:35 smithi131 bash[24745]: cluster 2024-09-14T03:59:34.246764+0000 mgr.a (mgr.14355) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:35 smithi171 bash[25040]: cluster 2024-09-14T03:59:34.246764+0000 mgr.a (mgr.14355) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:37.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:37.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:37.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:37 smithi007 bash[22722]: cluster 2024-09-14T03:59:36.248744+0000 mgr.a (mgr.14355) 14646 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:37 smithi131 bash[24745]: cluster 2024-09-14T03:59:36.248744+0000 mgr.a (mgr.14355) 14646 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:37 smithi171 bash[25040]: cluster 2024-09-14T03:59:36.248744+0000 mgr.a (mgr.14355) 14646 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:37.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:37.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:37.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:37.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:37.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:38 smithi007 bash[22722]: audit 2024-09-14T03:59:37.415301+0000 mgr.a (mgr.14355) 14647 : audit [DBG] from='client.317337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:38 smithi131 bash[24745]: audit 2024-09-14T03:59:37.415301+0000 mgr.a (mgr.14355) 14647 : audit [DBG] from='client.317337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:38 smithi171 bash[25040]: audit 2024-09-14T03:59:37.415301+0000 mgr.a (mgr.14355) 14647 : audit [DBG] from='client.317337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:39 smithi007 bash[22722]: cluster 2024-09-14T03:59:38.249741+0000 mgr.a (mgr.14355) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:39 smithi131 bash[24745]: cluster 2024-09-14T03:59:38.249741+0000 mgr.a (mgr.14355) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:39 smithi171 bash[25040]: cluster 2024-09-14T03:59:38.249741+0000 mgr.a (mgr.14355) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:41 smithi007 bash[22722]: cluster 2024-09-14T03:59:40.250564+0000 mgr.a (mgr.14355) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:41 smithi131 bash[24745]: cluster 2024-09-14T03:59:40.250564+0000 mgr.a (mgr.14355) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:41 smithi171 bash[25040]: cluster 2024-09-14T03:59:40.250564+0000 mgr.a (mgr.14355) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:42.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:42.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:42.850 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:43.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:43.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:43 smithi007 bash[22722]: cluster 2024-09-14T03:59:42.252778+0000 mgr.a (mgr.14355) 14650 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:43 smithi131 bash[24745]: cluster 2024-09-14T03:59:42.252778+0000 mgr.a (mgr.14355) 14650 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:43 smithi171 bash[25040]: cluster 2024-09-14T03:59:42.252778+0000 mgr.a (mgr.14355) 14650 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:44 smithi007 bash[22722]: audit 2024-09-14T03:59:43.185210+0000 mgr.a (mgr.14355) 14651 : audit [DBG] from='client.317415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:44 smithi131 bash[24745]: audit 2024-09-14T03:59:43.185210+0000 mgr.a (mgr.14355) 14651 : audit [DBG] from='client.317415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:44 smithi171 bash[25040]: audit 2024-09-14T03:59:43.185210+0000 mgr.a (mgr.14355) 14651 : audit [DBG] from='client.317415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:45 smithi007 bash[22722]: cluster 2024-09-14T03:59:44.253755+0000 mgr.a (mgr.14355) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:45 smithi131 bash[24745]: cluster 2024-09-14T03:59:44.253755+0000 mgr.a (mgr.14355) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:45 smithi171 bash[25040]: cluster 2024-09-14T03:59:44.253755+0000 mgr.a (mgr.14355) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:47 smithi007 bash[22722]: cluster 2024-09-14T03:59:46.256052+0000 mgr.a (mgr.14355) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:47 smithi131 bash[24745]: cluster 2024-09-14T03:59:46.256052+0000 mgr.a (mgr.14355) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:47 smithi171 bash[25040]: cluster 2024-09-14T03:59:46.256052+0000 mgr.a (mgr.14355) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:48.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:48.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:49.384 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:49.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:49 smithi007 bash[22722]: cluster 2024-09-14T03:59:48.256873+0000 mgr.a (mgr.14355) 14654 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:49 smithi131 bash[24745]: cluster 2024-09-14T03:59:48.256873+0000 mgr.a (mgr.14355) 14654 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:49 smithi171 bash[25040]: cluster 2024-09-14T03:59:48.256873+0000 mgr.a (mgr.14355) 14654 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:50 smithi007 bash[22722]: audit 2024-09-14T03:59:48.955989+0000 mgr.a (mgr.14355) 14655 : audit [DBG] from='client.317490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:50 smithi131 bash[24745]: audit 2024-09-14T03:59:48.955989+0000 mgr.a (mgr.14355) 14655 : audit [DBG] from='client.317490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:50 smithi171 bash[25040]: audit 2024-09-14T03:59:48.955989+0000 mgr.a (mgr.14355) 14655 : audit [DBG] from='client.317490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:51 smithi007 bash[22722]: cluster 2024-09-14T03:59:50.257885+0000 mgr.a (mgr.14355) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:51 smithi131 bash[24745]: cluster 2024-09-14T03:59:50.257885+0000 mgr.a (mgr.14355) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:51 smithi171 bash[25040]: cluster 2024-09-14T03:59:50.257885+0000 mgr.a (mgr.14355) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:53 smithi007 bash[22722]: cluster 2024-09-14T03:59:52.260114+0000 mgr.a (mgr.14355) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:53 smithi131 bash[24745]: cluster 2024-09-14T03:59:52.260114+0000 mgr.a (mgr.14355) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:53 smithi171 bash[25040]: cluster 2024-09-14T03:59:52.260114+0000 mgr.a (mgr.14355) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T03:59:54.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T03:59:54.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T03:59:55.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T03:59:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T03:59:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T03:59:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T03:59:55.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T03:59:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:55 smithi007 bash[22722]: cluster 2024-09-14T03:59:54.260854+0000 mgr.a (mgr.14355) 14658 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:55.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:55 smithi007 bash[22722]: audit 2024-09-14T03:59:55.274059+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:59:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:55 smithi131 bash[24745]: cluster 2024-09-14T03:59:54.260854+0000 mgr.a (mgr.14355) 14658 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:55 smithi131 bash[24745]: audit 2024-09-14T03:59:55.274059+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:59:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:55 smithi171 bash[25040]: cluster 2024-09-14T03:59:54.260854+0000 mgr.a (mgr.14355) 14658 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:55 smithi171 bash[25040]: audit 2024-09-14T03:59:55.274059+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T03:59:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22722]: audit 2024-09-14T03:59:54.725207+0000 mgr.a (mgr.14355) 14659 : audit [DBG] from='client.317565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22722]: audit 2024-09-14T03:59:56.096331+0000 mon.a (mon.0) 2784 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:59:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22722]: audit 2024-09-14T03:59:56.097922+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:59:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22722]: audit 2024-09-14T03:59:56.106005+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:59:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22722]: audit 2024-09-14T03:59:56.110755+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:56 smithi131 bash[24745]: audit 2024-09-14T03:59:54.725207+0000 mgr.a (mgr.14355) 14659 : audit [DBG] from='client.317565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:56 smithi131 bash[24745]: audit 2024-09-14T03:59:56.096331+0000 mon.a (mon.0) 2784 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:59:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:56 smithi131 bash[24745]: audit 2024-09-14T03:59:56.097922+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:59:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:56 smithi131 bash[24745]: audit 2024-09-14T03:59:56.106005+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:59:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:56 smithi131 bash[24745]: audit 2024-09-14T03:59:56.110755+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:56 smithi171 bash[25040]: audit 2024-09-14T03:59:54.725207+0000 mgr.a (mgr.14355) 14659 : audit [DBG] from='client.317565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T03:59:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:56 smithi171 bash[25040]: audit 2024-09-14T03:59:56.096331+0000 mon.a (mon.0) 2784 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T03:59:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:56 smithi171 bash[25040]: audit 2024-09-14T03:59:56.097922+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T03:59:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:56 smithi171 bash[25040]: audit 2024-09-14T03:59:56.106005+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T03:59:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:56 smithi171 bash[25040]: audit 2024-09-14T03:59:56.110755+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:57.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22972]: debug 2024-09-14T03:59:56.873+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:59:57.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 03:59:56 smithi007 bash[22972]: debug 2024-09-14T03:59:56.873+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:59:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:57 smithi007 bash[22722]: audit 2024-09-14T03:59:56.113343+0000 mgr.a (mgr.14355) 14660 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:57 smithi007 bash[22722]: cluster 2024-09-14T03:59:56.262236+0000 mgr.a (mgr.14355) 14661 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:57 smithi131 bash[24745]: audit 2024-09-14T03:59:56.113343+0000 mgr.a (mgr.14355) 14660 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:57.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:57 smithi131 bash[24745]: cluster 2024-09-14T03:59:56.262236+0000 mgr.a (mgr.14355) 14661 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:57 smithi171 bash[25040]: audit 2024-09-14T03:59:56.113343+0000 mgr.a (mgr.14355) 14660 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T03:59:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:57 smithi171 bash[25040]: cluster 2024-09-14T03:59:56.262236+0000 mgr.a (mgr.14355) 14661 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T03:59:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:58 smithi007 bash[22722]: audit 2024-09-14T03:59:56.874493+0000 mgr.a (mgr.14355) 14662 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:59:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:58 smithi007 bash[22722]: cephadm 2024-09-14T03:59:56.876121+0000 mgr.a (mgr.14355) 14663 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:59:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:58 smithi131 bash[24745]: audit 2024-09-14T03:59:56.874493+0000 mgr.a (mgr.14355) 14662 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:59:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:58 smithi131 bash[24745]: cephadm 2024-09-14T03:59:56.876121+0000 mgr.a (mgr.14355) 14663 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:59:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:58 smithi171 bash[25040]: audit 2024-09-14T03:59:56.874493+0000 mgr.a (mgr.14355) 14662 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T03:59:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:58 smithi171 bash[25040]: cephadm 2024-09-14T03:59:56.876121+0000 mgr.a (mgr.14355) 14663 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T03:59:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 03:59:59 smithi007 bash[22722]: cluster 2024-09-14T03:59:58.263072+0000 mgr.a (mgr.14355) 14664 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 03:59:59 smithi131 bash[24745]: cluster 2024-09-14T03:59:58.263072+0000 mgr.a (mgr.14355) 14664 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T03:59:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 03:59:59 smithi171 bash[25040]: cluster 2024-09-14T03:59:58.263072+0000 mgr.a (mgr.14355) 14664 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:00.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:00 smithi007 bash[22722]: cluster 2024-09-14T04:00:00.000155+0000 mon.a (mon.0) 2788 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:00:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:00 smithi131 bash[24745]: cluster 2024-09-14T04:00:00.000155+0000 mon.a (mon.0) 2788 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:00:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:00 smithi171 bash[25040]: cluster 2024-09-14T04:00:00.000155+0000 mon.a (mon.0) 2788 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:00:00.904 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:00.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:00.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:00.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:00.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:01 smithi007 bash[22722]: cluster 2024-09-14T04:00:00.263623+0000 mgr.a (mgr.14355) 14665 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:01 smithi007 bash[22722]: audit 2024-09-14T04:00:00.488961+0000 mgr.a (mgr.14355) 14666 : audit [DBG] from='client.317748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:01 smithi131 bash[24745]: cluster 2024-09-14T04:00:00.263623+0000 mgr.a (mgr.14355) 14665 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:01 smithi131 bash[24745]: audit 2024-09-14T04:00:00.488961+0000 mgr.a (mgr.14355) 14666 : audit [DBG] from='client.317748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:01 smithi171 bash[25040]: cluster 2024-09-14T04:00:00.263623+0000 mgr.a (mgr.14355) 14665 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:01 smithi171 bash[25040]: audit 2024-09-14T04:00:00.488961+0000 mgr.a (mgr.14355) 14666 : audit [DBG] from='client.317748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:03 smithi007 bash[22722]: cluster 2024-09-14T04:00:02.266332+0000 mgr.a (mgr.14355) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:03 smithi131 bash[24745]: cluster 2024-09-14T04:00:02.266332+0000 mgr.a (mgr.14355) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:03 smithi171 bash[25040]: cluster 2024-09-14T04:00:02.266332+0000 mgr.a (mgr.14355) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:05 smithi007 bash[22722]: cluster 2024-09-14T04:00:04.267139+0000 mgr.a (mgr.14355) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:05 smithi131 bash[24745]: cluster 2024-09-14T04:00:04.267139+0000 mgr.a (mgr.14355) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:05 smithi171 bash[25040]: cluster 2024-09-14T04:00:04.267139+0000 mgr.a (mgr.14355) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:05.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:06.680 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:06.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:07 smithi007 bash[22722]: audit 2024-09-14T04:00:06.242097+0000 mgr.a (mgr.14355) 14669 : audit [DBG] from='client.317826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:07 smithi007 bash[22722]: cluster 2024-09-14T04:00:06.270264+0000 mgr.a (mgr.14355) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:07 smithi131 bash[24745]: audit 2024-09-14T04:00:06.242097+0000 mgr.a (mgr.14355) 14669 : audit [DBG] from='client.317826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:07 smithi131 bash[24745]: cluster 2024-09-14T04:00:06.270264+0000 mgr.a (mgr.14355) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:07 smithi171 bash[25040]: audit 2024-09-14T04:00:06.242097+0000 mgr.a (mgr.14355) 14669 : audit [DBG] from='client.317826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:07 smithi171 bash[25040]: cluster 2024-09-14T04:00:06.270264+0000 mgr.a (mgr.14355) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:09 smithi007 bash[22722]: cluster 2024-09-14T04:00:08.271226+0000 mgr.a (mgr.14355) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:09 smithi131 bash[24745]: cluster 2024-09-14T04:00:08.271226+0000 mgr.a (mgr.14355) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:09 smithi171 bash[25040]: cluster 2024-09-14T04:00:08.271226+0000 mgr.a (mgr.14355) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:11.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:11.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:11.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:11 smithi007 bash[22722]: cluster 2024-09-14T04:00:10.272724+0000 mgr.a (mgr.14355) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:11 smithi131 bash[24745]: cluster 2024-09-14T04:00:10.272724+0000 mgr.a (mgr.14355) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:11 smithi171 bash[25040]: cluster 2024-09-14T04:00:10.272724+0000 mgr.a (mgr.14355) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:00:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:12.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:12.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:12.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:13 smithi007 bash[22722]: audit 2024-09-14T04:00:12.011270+0000 mgr.a (mgr.14355) 14673 : audit [DBG] from='client.317901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:13 smithi007 bash[22722]: cluster 2024-09-14T04:00:12.273883+0000 mgr.a (mgr.14355) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:13 smithi131 bash[24745]: audit 2024-09-14T04:00:12.011270+0000 mgr.a (mgr.14355) 14673 : audit [DBG] from='client.317901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:13 smithi131 bash[24745]: cluster 2024-09-14T04:00:12.273883+0000 mgr.a (mgr.14355) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:13 smithi171 bash[25040]: audit 2024-09-14T04:00:12.011270+0000 mgr.a (mgr.14355) 14673 : audit [DBG] from='client.317901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:13 smithi171 bash[25040]: cluster 2024-09-14T04:00:12.273883+0000 mgr.a (mgr.14355) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:00:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:15 smithi007 bash[22722]: cluster 2024-09-14T04:00:14.274772+0000 mgr.a (mgr.14355) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:15 smithi131 bash[24745]: cluster 2024-09-14T04:00:14.274772+0000 mgr.a (mgr.14355) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:15 smithi171 bash[25040]: cluster 2024-09-14T04:00:14.274772+0000 mgr.a (mgr.14355) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:17.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:17.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:17 smithi007 bash[22722]: cluster 2024-09-14T04:00:16.277076+0000 mgr.a (mgr.14355) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:17 smithi131 bash[24745]: cluster 2024-09-14T04:00:16.277076+0000 mgr.a (mgr.14355) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:17 smithi171 bash[25040]: cluster 2024-09-14T04:00:16.277076+0000 mgr.a (mgr.14355) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:18.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:18.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:18.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:18.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:18.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:19 smithi007 bash[22722]: audit 2024-09-14T04:00:17.749020+0000 mgr.a (mgr.14355) 14677 : audit [DBG] from='client.317976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:19 smithi007 bash[22722]: cluster 2024-09-14T04:00:18.278051+0000 mgr.a (mgr.14355) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:19 smithi131 bash[24745]: audit 2024-09-14T04:00:17.749020+0000 mgr.a (mgr.14355) 14677 : audit [DBG] from='client.317976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:19 smithi131 bash[24745]: cluster 2024-09-14T04:00:18.278051+0000 mgr.a (mgr.14355) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:19 smithi171 bash[25040]: audit 2024-09-14T04:00:17.749020+0000 mgr.a (mgr.14355) 14677 : audit [DBG] from='client.317976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:19 smithi171 bash[25040]: cluster 2024-09-14T04:00:18.278051+0000 mgr.a (mgr.14355) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:21 smithi007 bash[22722]: cluster 2024-09-14T04:00:20.279521+0000 mgr.a (mgr.14355) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:21 smithi131 bash[24745]: cluster 2024-09-14T04:00:20.279521+0000 mgr.a (mgr.14355) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:21 smithi171 bash[25040]: cluster 2024-09-14T04:00:20.279521+0000 mgr.a (mgr.14355) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:23.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:23.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:23.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:23 smithi131 bash[24745]: cluster 2024-09-14T04:00:22.281198+0000 mgr.a (mgr.14355) 14680 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:23 smithi171 bash[25040]: cluster 2024-09-14T04:00:22.281198+0000 mgr.a (mgr.14355) 14680 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:23.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:23 smithi007 bash[22722]: cluster 2024-09-14T04:00:22.281198+0000 mgr.a (mgr.14355) 14680 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:24 smithi131 bash[24745]: audit 2024-09-14T04:00:23.500788+0000 mgr.a (mgr.14355) 14681 : audit [DBG] from='client.318054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:24 smithi171 bash[25040]: audit 2024-09-14T04:00:23.500788+0000 mgr.a (mgr.14355) 14681 : audit [DBG] from='client.318054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:24 smithi007 bash[22722]: audit 2024-09-14T04:00:23.500788+0000 mgr.a (mgr.14355) 14681 : audit [DBG] from='client.318054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:25 smithi131 bash[24745]: cluster 2024-09-14T04:00:24.282149+0000 mgr.a (mgr.14355) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:25 smithi171 bash[25040]: cluster 2024-09-14T04:00:24.282149+0000 mgr.a (mgr.14355) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:25 smithi007 bash[22722]: cluster 2024-09-14T04:00:24.282149+0000 mgr.a (mgr.14355) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:27 smithi131 bash[24745]: cluster 2024-09-14T04:00:26.284393+0000 mgr.a (mgr.14355) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:27 smithi171 bash[25040]: cluster 2024-09-14T04:00:26.284393+0000 mgr.a (mgr.14355) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:27 smithi007 bash[22722]: cluster 2024-09-14T04:00:26.284393+0000 mgr.a (mgr.14355) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:28.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:28.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:28.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:29.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:29.667 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:29.667 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:29 smithi131 bash[24745]: cluster 2024-09-14T04:00:28.285165+0000 mgr.a (mgr.14355) 14684 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:29 smithi171 bash[25040]: cluster 2024-09-14T04:00:28.285165+0000 mgr.a (mgr.14355) 14684 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:29 smithi007 bash[22722]: cluster 2024-09-14T04:00:28.285165+0000 mgr.a (mgr.14355) 14684 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:30 smithi131 bash[24745]: audit 2024-09-14T04:00:29.253288+0000 mgr.a (mgr.14355) 14685 : audit [DBG] from='client.318132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:30 smithi171 bash[25040]: audit 2024-09-14T04:00:29.253288+0000 mgr.a (mgr.14355) 14685 : audit [DBG] from='client.318132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:30 smithi007 bash[22722]: audit 2024-09-14T04:00:29.253288+0000 mgr.a (mgr.14355) 14685 : audit [DBG] from='client.318132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:31 smithi131 bash[24745]: cluster 2024-09-14T04:00:30.286914+0000 mgr.a (mgr.14355) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:31 smithi171 bash[25040]: cluster 2024-09-14T04:00:30.286914+0000 mgr.a (mgr.14355) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:31 smithi007 bash[22722]: cluster 2024-09-14T04:00:30.286914+0000 mgr.a (mgr.14355) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:00:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:33 smithi131 bash[24745]: cluster 2024-09-14T04:00:32.288610+0000 mgr.a (mgr.14355) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:33 smithi171 bash[25040]: cluster 2024-09-14T04:00:32.288610+0000 mgr.a (mgr.14355) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:33 smithi007 bash[22722]: cluster 2024-09-14T04:00:32.288610+0000 mgr.a (mgr.14355) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:34.669 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:34.669 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:35.447 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:35.447 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:35 smithi131 bash[24745]: cluster 2024-09-14T04:00:34.289363+0000 mgr.a (mgr.14355) 14688 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:35 smithi171 bash[25040]: cluster 2024-09-14T04:00:34.289363+0000 mgr.a (mgr.14355) 14688 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:35 smithi007 bash[22722]: cluster 2024-09-14T04:00:34.289363+0000 mgr.a (mgr.14355) 14688 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:36 smithi131 bash[24745]: audit 2024-09-14T04:00:35.004422+0000 mgr.a (mgr.14355) 14689 : audit [DBG] from='client.318207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:36 smithi171 bash[25040]: audit 2024-09-14T04:00:35.004422+0000 mgr.a (mgr.14355) 14689 : audit [DBG] from='client.318207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:36 smithi007 bash[22722]: audit 2024-09-14T04:00:35.004422+0000 mgr.a (mgr.14355) 14689 : audit [DBG] from='client.318207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:37 smithi131 bash[24745]: cluster 2024-09-14T04:00:36.292092+0000 mgr.a (mgr.14355) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:00:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:37 smithi171 bash[25040]: cluster 2024-09-14T04:00:36.292092+0000 mgr.a (mgr.14355) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:00:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:37 smithi007 bash[22722]: cluster 2024-09-14T04:00:36.292092+0000 mgr.a (mgr.14355) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:00:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:39 smithi131 bash[24745]: cluster 2024-09-14T04:00:38.292875+0000 mgr.a (mgr.14355) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:00:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:39 smithi171 bash[25040]: cluster 2024-09-14T04:00:38.292875+0000 mgr.a (mgr.14355) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:00:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:39 smithi007 bash[22722]: cluster 2024-09-14T04:00:38.292875+0000 mgr.a (mgr.14355) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:00:40.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:40.449 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:40.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:41.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:41.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:41.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:41.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:41 smithi131 bash[24745]: cluster 2024-09-14T04:00:40.294423+0000 mgr.a (mgr.14355) 14692 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:00:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:41 smithi171 bash[25040]: cluster 2024-09-14T04:00:40.294423+0000 mgr.a (mgr.14355) 14692 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:00:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:41 smithi007 bash[22722]: cluster 2024-09-14T04:00:40.294423+0000 mgr.a (mgr.14355) 14692 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:00:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:42 smithi131 bash[24745]: audit 2024-09-14T04:00:40.784156+0000 mgr.a (mgr.14355) 14693 : audit [DBG] from='client.318282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:42 smithi171 bash[25040]: audit 2024-09-14T04:00:40.784156+0000 mgr.a (mgr.14355) 14693 : audit [DBG] from='client.318282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:42 smithi007 bash[22722]: audit 2024-09-14T04:00:40.784156+0000 mgr.a (mgr.14355) 14693 : audit [DBG] from='client.318282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:43 smithi171 bash[25040]: cluster 2024-09-14T04:00:42.295985+0000 mgr.a (mgr.14355) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:00:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:43 smithi007 bash[22722]: cluster 2024-09-14T04:00:42.295985+0000 mgr.a (mgr.14355) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:00:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:43 smithi131 bash[24745]: cluster 2024-09-14T04:00:42.295985+0000 mgr.a (mgr.14355) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:00:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:45 smithi171 bash[25040]: cluster 2024-09-14T04:00:44.296771+0000 mgr.a (mgr.14355) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:00:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:45 smithi007 bash[22722]: cluster 2024-09-14T04:00:44.296771+0000 mgr.a (mgr.14355) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:00:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:45 smithi131 bash[24745]: cluster 2024-09-14T04:00:44.296771+0000 mgr.a (mgr.14355) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:00:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:46.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:46.959 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:46.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:46.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:46.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:46.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:47 smithi171 bash[25040]: cluster 2024-09-14T04:00:46.298426+0000 mgr.a (mgr.14355) 14696 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:47 smithi171 bash[25040]: audit 2024-09-14T04:00:46.545780+0000 mgr.a (mgr.14355) 14697 : audit [DBG] from='client.318357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:47 smithi007 bash[22722]: cluster 2024-09-14T04:00:46.298426+0000 mgr.a (mgr.14355) 14696 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:47 smithi007 bash[22722]: audit 2024-09-14T04:00:46.545780+0000 mgr.a (mgr.14355) 14697 : audit [DBG] from='client.318357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:48.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:47 smithi131 bash[24745]: cluster 2024-09-14T04:00:46.298426+0000 mgr.a (mgr.14355) 14696 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:48.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:47 smithi131 bash[24745]: audit 2024-09-14T04:00:46.545780+0000 mgr.a (mgr.14355) 14697 : audit [DBG] from='client.318357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:49 smithi007 bash[22722]: cluster 2024-09-14T04:00:48.299285+0000 mgr.a (mgr.14355) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:00:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:49 smithi131 bash[24745]: cluster 2024-09-14T04:00:48.299285+0000 mgr.a (mgr.14355) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:00:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:49 smithi171 bash[25040]: cluster 2024-09-14T04:00:48.299285+0000 mgr.a (mgr.14355) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:00:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:51 smithi007 bash[22722]: cluster 2024-09-14T04:00:50.301199+0000 mgr.a (mgr.14355) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:51.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:51.962 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:51.962 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:51 smithi131 bash[24745]: cluster 2024-09-14T04:00:50.301199+0000 mgr.a (mgr.14355) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:51 smithi171 bash[25040]: cluster 2024-09-14T04:00:50.301199+0000 mgr.a (mgr.14355) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:52.721 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:52.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:52.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:52.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:52.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:53 smithi007 bash[22722]: audit 2024-09-14T04:00:52.295082+0000 mgr.a (mgr.14355) 14700 : audit [DBG] from='client.318432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:53 smithi007 bash[22722]: cluster 2024-09-14T04:00:52.313378+0000 mgr.a (mgr.14355) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:53 smithi131 bash[24745]: audit 2024-09-14T04:00:52.295082+0000 mgr.a (mgr.14355) 14700 : audit [DBG] from='client.318432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:54.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:53 smithi131 bash[24745]: cluster 2024-09-14T04:00:52.313378+0000 mgr.a (mgr.14355) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:53 smithi171 bash[25040]: audit 2024-09-14T04:00:52.295082+0000 mgr.a (mgr.14355) 14700 : audit [DBG] from='client.318432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:53 smithi171 bash[25040]: cluster 2024-09-14T04:00:52.313378+0000 mgr.a (mgr.14355) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:00:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:55 smithi007 bash[22722]: cluster 2024-09-14T04:00:54.314461+0000 mgr.a (mgr.14355) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:55 smithi131 bash[24745]: cluster 2024-09-14T04:00:54.314461+0000 mgr.a (mgr.14355) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:55 smithi171 bash[25040]: cluster 2024-09-14T04:00:54.314461+0000 mgr.a (mgr.14355) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:00:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:00:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:00:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:57 smithi007 bash[22722]: cluster 2024-09-14T04:00:56.316731+0000 mgr.a (mgr.14355) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:57 smithi007 bash[22722]: audit 2024-09-14T04:00:56.927212+0000 mon.a (mon.0) 2789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:00:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:57 smithi131 bash[24745]: cluster 2024-09-14T04:00:56.316731+0000 mgr.a (mgr.14355) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:57 smithi131 bash[24745]: audit 2024-09-14T04:00:56.927212+0000 mon.a (mon.0) 2789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:00:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:57 smithi171 bash[25040]: cluster 2024-09-14T04:00:56.316731+0000 mgr.a (mgr.14355) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:00:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:57 smithi171 bash[25040]: audit 2024-09-14T04:00:56.927212+0000 mon.a (mon.0) 2789 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:00:58.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:00:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:00:58.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:00:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:00:58.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:00:58.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22972]: debug 2024-09-14T04:00:58.500+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:00:58.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22972]: debug 2024-09-14T04:00:58.512+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:00:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22722]: audit 2024-09-14T04:00:57.761135+0000 mon.a (mon.0) 2790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:00:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22722]: audit 2024-09-14T04:00:57.762233+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:00:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22722]: audit 2024-09-14T04:00:57.769192+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:00:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:58 smithi007 bash[22722]: audit 2024-09-14T04:00:57.771980+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:00:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:58 smithi131 bash[24745]: audit 2024-09-14T04:00:57.761135+0000 mon.a (mon.0) 2790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:00:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:58 smithi131 bash[24745]: audit 2024-09-14T04:00:57.762233+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:00:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:58 smithi131 bash[24745]: audit 2024-09-14T04:00:57.769192+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:00:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:58 smithi131 bash[24745]: audit 2024-09-14T04:00:57.771980+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:00:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:58 smithi171 bash[25040]: audit 2024-09-14T04:00:57.761135+0000 mon.a (mon.0) 2790 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:00:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:58 smithi171 bash[25040]: audit 2024-09-14T04:00:57.762233+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:00:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:58 smithi171 bash[25040]: audit 2024-09-14T04:00:57.769192+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:00:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:58 smithi171 bash[25040]: audit 2024-09-14T04:00:57.771980+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:00:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:59 smithi007 bash[22722]: audit 2024-09-14T04:00:57.773213+0000 mgr.a (mgr.14355) 14704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:00:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:59 smithi007 bash[22722]: audit 2024-09-14T04:00:58.074894+0000 mgr.a (mgr.14355) 14705 : audit [DBG] from='client.318510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:00:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:59 smithi007 bash[22722]: cluster 2024-09-14T04:00:58.317263+0000 mgr.a (mgr.14355) 14706 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:00:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:59 smithi007 bash[22722]: audit 2024-09-14T04:00:58.503746+0000 mgr.a (mgr.14355) 14707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:00:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:00:59 smithi007 bash[22722]: cephadm 2024-09-14T04:00:58.515301+0000 mgr.a (mgr.14355) 14708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:01:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:59 smithi131 bash[24745]: audit 2024-09-14T04:00:57.773213+0000 mgr.a (mgr.14355) 14704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:01:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:59 smithi131 bash[24745]: audit 2024-09-14T04:00:58.074894+0000 mgr.a (mgr.14355) 14705 : audit [DBG] from='client.318510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:59 smithi131 bash[24745]: cluster 2024-09-14T04:00:58.317263+0000 mgr.a (mgr.14355) 14706 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:59 smithi131 bash[24745]: audit 2024-09-14T04:00:58.503746+0000 mgr.a (mgr.14355) 14707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:01:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:00:59 smithi131 bash[24745]: cephadm 2024-09-14T04:00:58.515301+0000 mgr.a (mgr.14355) 14708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:01:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:59 smithi171 bash[25040]: audit 2024-09-14T04:00:57.773213+0000 mgr.a (mgr.14355) 14704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:01:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:59 smithi171 bash[25040]: audit 2024-09-14T04:00:58.074894+0000 mgr.a (mgr.14355) 14705 : audit [DBG] from='client.318510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:59 smithi171 bash[25040]: cluster 2024-09-14T04:00:58.317263+0000 mgr.a (mgr.14355) 14706 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:59 smithi171 bash[25040]: audit 2024-09-14T04:00:58.503746+0000 mgr.a (mgr.14355) 14707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:01:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:00:59 smithi171 bash[25040]: cephadm 2024-09-14T04:00:58.515301+0000 mgr.a (mgr.14355) 14708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:01:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:01 smithi007 bash[22722]: cluster 2024-09-14T04:01:00.319658+0000 mgr.a (mgr.14355) 14709 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:01 smithi131 bash[24745]: cluster 2024-09-14T04:01:00.319658+0000 mgr.a (mgr.14355) 14709 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:01 smithi171 bash[25040]: cluster 2024-09-14T04:01:00.319658+0000 mgr.a (mgr.14355) 14709 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:03.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:03.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:03.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:03 smithi007 bash[22722]: cluster 2024-09-14T04:01:02.320471+0000 mgr.a (mgr.14355) 14710 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:03 smithi131 bash[24745]: cluster 2024-09-14T04:01:02.320471+0000 mgr.a (mgr.14355) 14710 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:03 smithi171 bash[25040]: cluster 2024-09-14T04:01:02.320471+0000 mgr.a (mgr.14355) 14710 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T04:01:04.662 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:04.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:04.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:04.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:04.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:05 smithi007 bash[22722]: audit 2024-09-14T04:01:04.239632+0000 mgr.a (mgr.14355) 14711 : audit [DBG] from='client.318690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:05 smithi007 bash[22722]: cluster 2024-09-14T04:01:04.321039+0000 mgr.a (mgr.14355) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:05 smithi131 bash[24745]: audit 2024-09-14T04:01:04.239632+0000 mgr.a (mgr.14355) 14711 : audit [DBG] from='client.318690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:05 smithi131 bash[24745]: cluster 2024-09-14T04:01:04.321039+0000 mgr.a (mgr.14355) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:05 smithi171 bash[25040]: audit 2024-09-14T04:01:04.239632+0000 mgr.a (mgr.14355) 14711 : audit [DBG] from='client.318690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:05 smithi171 bash[25040]: cluster 2024-09-14T04:01:04.321039+0000 mgr.a (mgr.14355) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:07 smithi007 bash[22722]: cluster 2024-09-14T04:01:06.323393+0000 mgr.a (mgr.14355) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:07 smithi131 bash[24745]: cluster 2024-09-14T04:01:06.323393+0000 mgr.a (mgr.14355) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:07 smithi171 bash[25040]: cluster 2024-09-14T04:01:06.323393+0000 mgr.a (mgr.14355) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:09.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:09.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:09.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:09 smithi007 bash[22722]: cluster 2024-09-14T04:01:08.324145+0000 mgr.a (mgr.14355) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:09 smithi131 bash[24745]: cluster 2024-09-14T04:01:08.324145+0000 mgr.a (mgr.14355) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:09 smithi171 bash[25040]: cluster 2024-09-14T04:01:08.324145+0000 mgr.a (mgr.14355) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:10.442 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:10.442 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:11.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:11 smithi007 bash[22722]: audit 2024-09-14T04:01:09.998038+0000 mgr.a (mgr.14355) 14715 : audit [DBG] from='client.318765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:11.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:11 smithi007 bash[22722]: cluster 2024-09-14T04:01:10.325320+0000 mgr.a (mgr.14355) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:11 smithi131 bash[24745]: audit 2024-09-14T04:01:09.998038+0000 mgr.a (mgr.14355) 14715 : audit [DBG] from='client.318765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:11 smithi131 bash[24745]: cluster 2024-09-14T04:01:10.325320+0000 mgr.a (mgr.14355) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:11 smithi171 bash[25040]: audit 2024-09-14T04:01:09.998038+0000 mgr.a (mgr.14355) 14715 : audit [DBG] from='client.318765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:11 smithi171 bash[25040]: cluster 2024-09-14T04:01:10.325320+0000 mgr.a (mgr.14355) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:01:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:13 smithi007 bash[22722]: cluster 2024-09-14T04:01:12.326371+0000 mgr.a (mgr.14355) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:13 smithi131 bash[24745]: cluster 2024-09-14T04:01:12.326371+0000 mgr.a (mgr.14355) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:13 smithi171 bash[25040]: cluster 2024-09-14T04:01:12.326371+0000 mgr.a (mgr.14355) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:15.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:15.444 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:15 smithi007 bash[22722]: cluster 2024-09-14T04:01:14.327334+0000 mgr.a (mgr.14355) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:15 smithi131 bash[24745]: cluster 2024-09-14T04:01:14.327334+0000 mgr.a (mgr.14355) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:15 smithi171 bash[25040]: cluster 2024-09-14T04:01:14.327334+0000 mgr.a (mgr.14355) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:01:16.220 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:16.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:17 smithi007 bash[22722]: audit 2024-09-14T04:01:15.778753+0000 mgr.a (mgr.14355) 14719 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:17 smithi007 bash[22722]: cluster 2024-09-14T04:01:16.330156+0000 mgr.a (mgr.14355) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:17 smithi131 bash[24745]: audit 2024-09-14T04:01:15.778753+0000 mgr.a (mgr.14355) 14719 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:17 smithi131 bash[24745]: cluster 2024-09-14T04:01:16.330156+0000 mgr.a (mgr.14355) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:17 smithi171 bash[25040]: audit 2024-09-14T04:01:15.778753+0000 mgr.a (mgr.14355) 14719 : audit [DBG] from='client.318840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:17 smithi171 bash[25040]: cluster 2024-09-14T04:01:16.330156+0000 mgr.a (mgr.14355) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:19.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:19 smithi007 bash[22722]: cluster 2024-09-14T04:01:18.330939+0000 mgr.a (mgr.14355) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:19 smithi131 bash[24745]: cluster 2024-09-14T04:01:18.330939+0000 mgr.a (mgr.14355) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:19 smithi171 bash[25040]: cluster 2024-09-14T04:01:18.330939+0000 mgr.a (mgr.14355) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:21.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:21 smithi007 bash[22722]: cluster 2024-09-14T04:01:20.332847+0000 mgr.a (mgr.14355) 14722 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:22.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:22.005 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:21 smithi131 bash[24745]: cluster 2024-09-14T04:01:20.332847+0000 mgr.a (mgr.14355) 14722 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:21 smithi171 bash[25040]: cluster 2024-09-14T04:01:20.332847+0000 mgr.a (mgr.14355) 14722 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:22.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:22 smithi007 bash[22722]: audit 2024-09-14T04:01:21.560880+0000 mgr.a (mgr.14355) 14723 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:22 smithi131 bash[24745]: audit 2024-09-14T04:01:21.560880+0000 mgr.a (mgr.14355) 14723 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:22 smithi171 bash[25040]: audit 2024-09-14T04:01:21.560880+0000 mgr.a (mgr.14355) 14723 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:23 smithi007 bash[22722]: cluster 2024-09-14T04:01:22.333950+0000 mgr.a (mgr.14355) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:23 smithi131 bash[24745]: cluster 2024-09-14T04:01:22.333950+0000 mgr.a (mgr.14355) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:23 smithi171 bash[25040]: cluster 2024-09-14T04:01:22.333950+0000 mgr.a (mgr.14355) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:25 smithi007 bash[22722]: cluster 2024-09-14T04:01:24.334808+0000 mgr.a (mgr.14355) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:25 smithi131 bash[24745]: cluster 2024-09-14T04:01:24.334808+0000 mgr.a (mgr.14355) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:25 smithi171 bash[25040]: cluster 2024-09-14T04:01:24.334808+0000 mgr.a (mgr.14355) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:01:27.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:27.006 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:27.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:27.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:27.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:27 smithi007 bash[22722]: cluster 2024-09-14T04:01:26.337184+0000 mgr.a (mgr.14355) 14726 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:01:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:27 smithi131 bash[24745]: cluster 2024-09-14T04:01:26.337184+0000 mgr.a (mgr.14355) 14726 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:01:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:27 smithi171 bash[25040]: cluster 2024-09-14T04:01:26.337184+0000 mgr.a (mgr.14355) 14726 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:01:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:28 smithi007 bash[22722]: audit 2024-09-14T04:01:27.340147+0000 mgr.a (mgr.14355) 14727 : audit [DBG] from='client.318990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:28 smithi131 bash[24745]: audit 2024-09-14T04:01:27.340147+0000 mgr.a (mgr.14355) 14727 : audit [DBG] from='client.318990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:28 smithi171 bash[25040]: audit 2024-09-14T04:01:27.340147+0000 mgr.a (mgr.14355) 14727 : audit [DBG] from='client.318990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:29 smithi007 bash[22722]: cluster 2024-09-14T04:01:28.338110+0000 mgr.a (mgr.14355) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:29 smithi131 bash[24745]: cluster 2024-09-14T04:01:28.338110+0000 mgr.a (mgr.14355) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:29 smithi171 bash[25040]: cluster 2024-09-14T04:01:28.338110+0000 mgr.a (mgr.14355) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:31 smithi007 bash[22722]: cluster 2024-09-14T04:01:30.340251+0000 mgr.a (mgr.14355) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:31 smithi131 bash[24745]: cluster 2024-09-14T04:01:30.340251+0000 mgr.a (mgr.14355) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:31 smithi171 bash[25040]: cluster 2024-09-14T04:01:30.340251+0000 mgr.a (mgr.14355) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:32.778 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:32.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:33.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:33.535 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:33 smithi007 bash[22722]: cluster 2024-09-14T04:01:32.341013+0000 mgr.a (mgr.14355) 14730 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:33 smithi131 bash[24745]: cluster 2024-09-14T04:01:32.341013+0000 mgr.a (mgr.14355) 14730 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:33 smithi171 bash[25040]: cluster 2024-09-14T04:01:32.341013+0000 mgr.a (mgr.14355) 14730 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:34 smithi007 bash[22722]: audit 2024-09-14T04:01:33.109499+0000 mgr.a (mgr.14355) 14731 : audit [DBG] from='client.319068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:34 smithi131 bash[24745]: audit 2024-09-14T04:01:33.109499+0000 mgr.a (mgr.14355) 14731 : audit [DBG] from='client.319068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:34 smithi171 bash[25040]: audit 2024-09-14T04:01:33.109499+0000 mgr.a (mgr.14355) 14731 : audit [DBG] from='client.319068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:35 smithi007 bash[22722]: cluster 2024-09-14T04:01:34.341883+0000 mgr.a (mgr.14355) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:35 smithi131 bash[24745]: cluster 2024-09-14T04:01:34.341883+0000 mgr.a (mgr.14355) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:35 smithi171 bash[25040]: cluster 2024-09-14T04:01:34.341883+0000 mgr.a (mgr.14355) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:37 smithi007 bash[22722]: cluster 2024-09-14T04:01:36.344145+0000 mgr.a (mgr.14355) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:37 smithi131 bash[24745]: cluster 2024-09-14T04:01:36.344145+0000 mgr.a (mgr.14355) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:37 smithi171 bash[25040]: cluster 2024-09-14T04:01:36.344145+0000 mgr.a (mgr.14355) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:39.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:39 smithi007 bash[22722]: cluster 2024-09-14T04:01:38.344895+0000 mgr.a (mgr.14355) 14734 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:39 smithi131 bash[24745]: cluster 2024-09-14T04:01:38.344895+0000 mgr.a (mgr.14355) 14734 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:39 smithi171 bash[25040]: cluster 2024-09-14T04:01:38.344895+0000 mgr.a (mgr.14355) 14734 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:40 smithi007 bash[22722]: audit 2024-09-14T04:01:38.872439+0000 mgr.a (mgr.14355) 14735 : audit [DBG] from='client.319146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:40 smithi131 bash[24745]: audit 2024-09-14T04:01:38.872439+0000 mgr.a (mgr.14355) 14735 : audit [DBG] from='client.319146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:40 smithi171 bash[25040]: audit 2024-09-14T04:01:38.872439+0000 mgr.a (mgr.14355) 14735 : audit [DBG] from='client.319146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:41 smithi007 bash[22722]: cluster 2024-09-14T04:01:40.347193+0000 mgr.a (mgr.14355) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:41 smithi131 bash[24745]: cluster 2024-09-14T04:01:40.347193+0000 mgr.a (mgr.14355) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:41 smithi171 bash[25040]: cluster 2024-09-14T04:01:40.347193+0000 mgr.a (mgr.14355) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:43 smithi007 bash[22722]: cluster 2024-09-14T04:01:42.347919+0000 mgr.a (mgr.14355) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:43 smithi131 bash[24745]: cluster 2024-09-14T04:01:42.347919+0000 mgr.a (mgr.14355) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:43 smithi171 bash[25040]: cluster 2024-09-14T04:01:42.347919+0000 mgr.a (mgr.14355) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:44.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:44.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:45.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:45.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:45.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:45.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:45.082 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:45 smithi007 bash[22722]: cluster 2024-09-14T04:01:44.348532+0000 mgr.a (mgr.14355) 14738 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:45 smithi007 bash[22722]: audit 2024-09-14T04:01:44.655100+0000 mgr.a (mgr.14355) 14739 : audit [DBG] from='client.319224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:45 smithi131 bash[24745]: cluster 2024-09-14T04:01:44.348532+0000 mgr.a (mgr.14355) 14738 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:45 smithi131 bash[24745]: audit 2024-09-14T04:01:44.655100+0000 mgr.a (mgr.14355) 14739 : audit [DBG] from='client.319224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:45 smithi171 bash[25040]: cluster 2024-09-14T04:01:44.348532+0000 mgr.a (mgr.14355) 14738 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:45 smithi171 bash[25040]: audit 2024-09-14T04:01:44.655100+0000 mgr.a (mgr.14355) 14739 : audit [DBG] from='client.319224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:47 smithi007 bash[22722]: cluster 2024-09-14T04:01:46.350912+0000 mgr.a (mgr.14355) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:47 smithi131 bash[24745]: cluster 2024-09-14T04:01:46.350912+0000 mgr.a (mgr.14355) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:47 smithi171 bash[25040]: cluster 2024-09-14T04:01:46.350912+0000 mgr.a (mgr.14355) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:01:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:49 smithi007 bash[22722]: cluster 2024-09-14T04:01:48.351651+0000 mgr.a (mgr.14355) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:49 smithi131 bash[24745]: cluster 2024-09-14T04:01:48.351651+0000 mgr.a (mgr.14355) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:49 smithi171 bash[25040]: cluster 2024-09-14T04:01:48.351651+0000 mgr.a (mgr.14355) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:50.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:50.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:50.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:50.838 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:51 smithi131 bash[24745]: cluster 2024-09-14T04:01:50.353455+0000 mgr.a (mgr.14355) 14742 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:51 smithi131 bash[24745]: audit 2024-09-14T04:01:50.414688+0000 mgr.a (mgr.14355) 14743 : audit [DBG] from='client.319302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:51 smithi171 bash[25040]: cluster 2024-09-14T04:01:50.353455+0000 mgr.a (mgr.14355) 14742 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:51 smithi171 bash[25040]: audit 2024-09-14T04:01:50.414688+0000 mgr.a (mgr.14355) 14743 : audit [DBG] from='client.319302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:51 smithi007 bash[22722]: cluster 2024-09-14T04:01:50.353455+0000 mgr.a (mgr.14355) 14742 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:51 smithi007 bash[22722]: audit 2024-09-14T04:01:50.414688+0000 mgr.a (mgr.14355) 14743 : audit [DBG] from='client.319302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:53 smithi131 bash[24745]: cluster 2024-09-14T04:01:52.354326+0000 mgr.a (mgr.14355) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:53 smithi171 bash[25040]: cluster 2024-09-14T04:01:52.354326+0000 mgr.a (mgr.14355) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:53 smithi007 bash[22722]: cluster 2024-09-14T04:01:52.354326+0000 mgr.a (mgr.14355) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:01:55.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:01:55.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:01:55.841 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:01:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:55 smithi131 bash[24745]: cluster 2024-09-14T04:01:54.355091+0000 mgr.a (mgr.14355) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:01:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:55 smithi171 bash[25040]: cluster 2024-09-14T04:01:54.355091+0000 mgr.a (mgr.14355) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:01:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:55 smithi007 bash[22722]: cluster 2024-09-14T04:01:54.355091+0000 mgr.a (mgr.14355) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:01:56.598 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:01:56.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:01:56.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:01:56.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:01:56.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:01:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:57 smithi131 bash[24745]: audit 2024-09-14T04:01:56.172426+0000 mgr.a (mgr.14355) 14746 : audit [DBG] from='client.319377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:57 smithi131 bash[24745]: cluster 2024-09-14T04:01:56.356385+0000 mgr.a (mgr.14355) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:57 smithi171 bash[25040]: audit 2024-09-14T04:01:56.172426+0000 mgr.a (mgr.14355) 14746 : audit [DBG] from='client.319377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:57 smithi171 bash[25040]: cluster 2024-09-14T04:01:56.356385+0000 mgr.a (mgr.14355) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:57 smithi007 bash[22722]: audit 2024-09-14T04:01:56.172426+0000 mgr.a (mgr.14355) 14746 : audit [DBG] from='client.319377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:01:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:57 smithi007 bash[22722]: cluster 2024-09-14T04:01:56.356385+0000 mgr.a (mgr.14355) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:01:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:58 smithi131 bash[24745]: audit 2024-09-14T04:01:58.569301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:01:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:58 smithi171 bash[25040]: audit 2024-09-14T04:01:58.569301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:01:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:58 smithi007 bash[22722]: audit 2024-09-14T04:01:58.569301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:02:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:59 smithi131 bash[24745]: cluster 2024-09-14T04:01:58.357388+0000 mgr.a (mgr.14355) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:59 smithi131 bash[24745]: audit 2024-09-14T04:01:59.201213+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:01:59 smithi131 bash[24745]: audit 2024-09-14T04:01:59.208484+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:59 smithi171 bash[25040]: cluster 2024-09-14T04:01:58.357388+0000 mgr.a (mgr.14355) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:59 smithi171 bash[25040]: audit 2024-09-14T04:01:59.201213+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:01:59 smithi171 bash[25040]: audit 2024-09-14T04:01:59.208484+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:59 smithi007 bash[22722]: cluster 2024-09-14T04:01:58.357388+0000 mgr.a (mgr.14355) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:59 smithi007 bash[22722]: audit 2024-09-14T04:01:59.201213+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:01:59 smithi007 bash[22722]: audit 2024-09-14T04:01:59.208484+0000 mon.a (mon.0) 2796 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:00 smithi131 bash[24745]: audit 2024-09-14T04:02:00.001507+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:02:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:00 smithi131 bash[24745]: audit 2024-09-14T04:02:00.002520+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:02:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:00 smithi131 bash[24745]: audit 2024-09-14T04:02:00.008552+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:00 smithi131 bash[24745]: audit 2024-09-14T04:02:00.010903+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:00 smithi171 bash[25040]: audit 2024-09-14T04:02:00.001507+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:02:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:00 smithi171 bash[25040]: audit 2024-09-14T04:02:00.002520+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:02:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:00 smithi171 bash[25040]: audit 2024-09-14T04:02:00.008552+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:00 smithi171 bash[25040]: audit 2024-09-14T04:02:00.010903+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22972]: debug 2024-09-14T04:02:00.743+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22972]: debug 2024-09-14T04:02:00.747+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22722]: audit 2024-09-14T04:02:00.001507+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22722]: audit 2024-09-14T04:02:00.002520+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22722]: audit 2024-09-14T04:02:00.008552+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:02:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:00 smithi007 bash[22722]: audit 2024-09-14T04:02:00.010903+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:01.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:01.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:01 smithi131 bash[24745]: audit 2024-09-14T04:02:00.012267+0000 mgr.a (mgr.14355) 14749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:01 smithi131 bash[24745]: cluster 2024-09-14T04:02:00.358764+0000 mgr.a (mgr.14355) 14750 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:01 smithi171 bash[25040]: audit 2024-09-14T04:02:00.012267+0000 mgr.a (mgr.14355) 14749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:01 smithi171 bash[25040]: cluster 2024-09-14T04:02:00.358764+0000 mgr.a (mgr.14355) 14750 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:01 smithi007 bash[22722]: audit 2024-09-14T04:02:00.012267+0000 mgr.a (mgr.14355) 14749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:02:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:01 smithi007 bash[22722]: cluster 2024-09-14T04:02:00.358764+0000 mgr.a (mgr.14355) 14750 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:02.347 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:02.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:02.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:02.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:02.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:02 smithi131 bash[24745]: audit 2024-09-14T04:02:00.749975+0000 mgr.a (mgr.14355) 14751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:02:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:02 smithi131 bash[24745]: cephadm 2024-09-14T04:02:00.751314+0000 mgr.a (mgr.14355) 14752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:02:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:02 smithi171 bash[25040]: audit 2024-09-14T04:02:00.749975+0000 mgr.a (mgr.14355) 14751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:02:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:02 smithi171 bash[25040]: cephadm 2024-09-14T04:02:00.751314+0000 mgr.a (mgr.14355) 14752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:02:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:02 smithi007 bash[22722]: audit 2024-09-14T04:02:00.749975+0000 mgr.a (mgr.14355) 14751 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:02:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:02 smithi007 bash[22722]: cephadm 2024-09-14T04:02:00.751314+0000 mgr.a (mgr.14355) 14752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:02:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:03 smithi131 bash[24745]: audit 2024-09-14T04:02:01.928705+0000 mgr.a (mgr.14355) 14753 : audit [DBG] from='client.319557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:03 smithi131 bash[24745]: cluster 2024-09-14T04:02:02.359177+0000 mgr.a (mgr.14355) 14754 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:03 smithi171 bash[25040]: audit 2024-09-14T04:02:01.928705+0000 mgr.a (mgr.14355) 14753 : audit [DBG] from='client.319557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:03 smithi171 bash[25040]: cluster 2024-09-14T04:02:02.359177+0000 mgr.a (mgr.14355) 14754 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:03 smithi007 bash[22722]: audit 2024-09-14T04:02:01.928705+0000 mgr.a (mgr.14355) 14753 : audit [DBG] from='client.319557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:03 smithi007 bash[22722]: cluster 2024-09-14T04:02:02.359177+0000 mgr.a (mgr.14355) 14754 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:05 smithi131 bash[24745]: cluster 2024-09-14T04:02:04.359894+0000 mgr.a (mgr.14355) 14755 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:05 smithi171 bash[25040]: cluster 2024-09-14T04:02:04.359894+0000 mgr.a (mgr.14355) 14755 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:05 smithi007 bash[22722]: cluster 2024-09-14T04:02:04.359894+0000 mgr.a (mgr.14355) 14755 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-14T04:02:07.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:07.350 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:07 smithi131 bash[24745]: cluster 2024-09-14T04:02:06.362118+0000 mgr.a (mgr.14355) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:07 smithi171 bash[25040]: cluster 2024-09-14T04:02:06.362118+0000 mgr.a (mgr.14355) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:08.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:08.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:07 smithi007 bash[22722]: cluster 2024-09-14T04:02:06.362118+0000 mgr.a (mgr.14355) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:08 smithi131 bash[24745]: audit 2024-09-14T04:02:07.682747+0000 mgr.a (mgr.14355) 14757 : audit [DBG] from='client.319635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:08 smithi171 bash[25040]: audit 2024-09-14T04:02:07.682747+0000 mgr.a (mgr.14355) 14757 : audit [DBG] from='client.319635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:08 smithi007 bash[22722]: audit 2024-09-14T04:02:07.682747+0000 mgr.a (mgr.14355) 14757 : audit [DBG] from='client.319635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:09 smithi131 bash[24745]: cluster 2024-09-14T04:02:08.362951+0000 mgr.a (mgr.14355) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:02:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:09 smithi171 bash[25040]: cluster 2024-09-14T04:02:08.362951+0000 mgr.a (mgr.14355) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:02:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:09 smithi007 bash[22722]: cluster 2024-09-14T04:02:08.362951+0000 mgr.a (mgr.14355) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:02:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:10 smithi131 bash[24745]: cluster 2024-09-14T04:02:10.365131+0000 mgr.a (mgr.14355) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:10 smithi171 bash[25040]: cluster 2024-09-14T04:02:10.365131+0000 mgr.a (mgr.14355) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:10 smithi007 bash[22722]: cluster 2024-09-14T04:02:10.365131+0000 mgr.a (mgr.14355) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T04:02:13.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:13.116 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:13.116 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:13 smithi007 bash[22722]: cluster 2024-09-14T04:02:12.365876+0000 mgr.a (mgr.14355) 14760 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:13 smithi131 bash[24745]: cluster 2024-09-14T04:02:12.365876+0000 mgr.a (mgr.14355) 14760 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:13 smithi171 bash[25040]: cluster 2024-09-14T04:02:12.365876+0000 mgr.a (mgr.14355) 14760 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:13.865 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:13.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:13.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:14 smithi007 bash[22722]: audit 2024-09-14T04:02:13.439372+0000 mgr.a (mgr.14355) 14761 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:14 smithi131 bash[24745]: audit 2024-09-14T04:02:13.439372+0000 mgr.a (mgr.14355) 14761 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:14 smithi171 bash[25040]: audit 2024-09-14T04:02:13.439372+0000 mgr.a (mgr.14355) 14761 : audit [DBG] from='client.319713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:15 smithi007 bash[22722]: cluster 2024-09-14T04:02:14.366844+0000 mgr.a (mgr.14355) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:15 smithi131 bash[24745]: cluster 2024-09-14T04:02:14.366844+0000 mgr.a (mgr.14355) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:15 smithi171 bash[25040]: cluster 2024-09-14T04:02:14.366844+0000 mgr.a (mgr.14355) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:02:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:17 smithi007 bash[22722]: cluster 2024-09-14T04:02:16.369285+0000 mgr.a (mgr.14355) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-14T04:02:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:17 smithi131 bash[24745]: cluster 2024-09-14T04:02:16.369285+0000 mgr.a (mgr.14355) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-14T04:02:17.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:17 smithi171 bash[25040]: cluster 2024-09-14T04:02:16.369285+0000 mgr.a (mgr.14355) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-14T04:02:18.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:19.702 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:19 smithi007 bash[22722]: cluster 2024-09-14T04:02:18.370083+0000 mgr.a (mgr.14355) 14764 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:19 smithi131 bash[24745]: cluster 2024-09-14T04:02:18.370083+0000 mgr.a (mgr.14355) 14764 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:19 smithi171 bash[25040]: cluster 2024-09-14T04:02:18.370083+0000 mgr.a (mgr.14355) 14764 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:20 smithi007 bash[22722]: audit 2024-09-14T04:02:19.216376+0000 mgr.a (mgr.14355) 14765 : audit [DBG] from='client.319788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:20 smithi131 bash[24745]: audit 2024-09-14T04:02:19.216376+0000 mgr.a (mgr.14355) 14765 : audit [DBG] from='client.319788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:20 smithi171 bash[25040]: audit 2024-09-14T04:02:19.216376+0000 mgr.a (mgr.14355) 14765 : audit [DBG] from='client.319788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:21 smithi007 bash[22722]: cluster 2024-09-14T04:02:20.372457+0000 mgr.a (mgr.14355) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:21 smithi131 bash[24745]: cluster 2024-09-14T04:02:20.372457+0000 mgr.a (mgr.14355) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:21 smithi171 bash[25040]: cluster 2024-09-14T04:02:20.372457+0000 mgr.a (mgr.14355) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:23 smithi131 bash[24745]: cluster 2024-09-14T04:02:22.373180+0000 mgr.a (mgr.14355) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:23 smithi171 bash[25040]: cluster 2024-09-14T04:02:22.373180+0000 mgr.a (mgr.14355) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:23 smithi007 bash[22722]: cluster 2024-09-14T04:02:22.373180+0000 mgr.a (mgr.14355) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:24.703 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:24.704 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:25.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:25.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:25.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:25.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:25.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:25 smithi131 bash[24745]: cluster 2024-09-14T04:02:24.374092+0000 mgr.a (mgr.14355) 14768 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:25 smithi171 bash[25040]: cluster 2024-09-14T04:02:24.374092+0000 mgr.a (mgr.14355) 14768 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:25 smithi007 bash[22722]: cluster 2024-09-14T04:02:24.374092+0000 mgr.a (mgr.14355) 14768 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:26 smithi131 bash[24745]: audit 2024-09-14T04:02:25.038745+0000 mgr.a (mgr.14355) 14769 : audit [DBG] from='client.319866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:26 smithi171 bash[25040]: audit 2024-09-14T04:02:25.038745+0000 mgr.a (mgr.14355) 14769 : audit [DBG] from='client.319866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:26 smithi007 bash[22722]: audit 2024-09-14T04:02:25.038745+0000 mgr.a (mgr.14355) 14769 : audit [DBG] from='client.319866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:27 smithi131 bash[24745]: cluster 2024-09-14T04:02:26.376985+0000 mgr.a (mgr.14355) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:27 smithi171 bash[25040]: cluster 2024-09-14T04:02:26.376985+0000 mgr.a (mgr.14355) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:27 smithi007 bash[22722]: cluster 2024-09-14T04:02:26.376985+0000 mgr.a (mgr.14355) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-09-14T04:02:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:29 smithi131 bash[24745]: cluster 2024-09-14T04:02:28.377933+0000 mgr.a (mgr.14355) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:29 smithi171 bash[25040]: cluster 2024-09-14T04:02:28.377933+0000 mgr.a (mgr.14355) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:29 smithi007 bash[22722]: cluster 2024-09-14T04:02:28.377933+0000 mgr.a (mgr.14355) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:30.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:30.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:30.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:31.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:31 smithi131 bash[24745]: cluster 2024-09-14T04:02:30.379908+0000 mgr.a (mgr.14355) 14772 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:31 smithi171 bash[25040]: cluster 2024-09-14T04:02:30.379908+0000 mgr.a (mgr.14355) 14772 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:31 smithi007 bash[22722]: cluster 2024-09-14T04:02:30.379908+0000 mgr.a (mgr.14355) 14772 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:02:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:32 smithi131 bash[24745]: audit 2024-09-14T04:02:30.804558+0000 mgr.a (mgr.14355) 14773 : audit [DBG] from='client.319944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:32 smithi171 bash[25040]: audit 2024-09-14T04:02:30.804558+0000 mgr.a (mgr.14355) 14773 : audit [DBG] from='client.319944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:32 smithi007 bash[22722]: audit 2024-09-14T04:02:30.804558+0000 mgr.a (mgr.14355) 14773 : audit [DBG] from='client.319944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:33 smithi131 bash[24745]: cluster 2024-09-14T04:02:32.380872+0000 mgr.a (mgr.14355) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:02:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:33 smithi171 bash[25040]: cluster 2024-09-14T04:02:32.380872+0000 mgr.a (mgr.14355) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:02:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:33 smithi007 bash[22722]: cluster 2024-09-14T04:02:32.380872+0000 mgr.a (mgr.14355) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:02:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:35 smithi131 bash[24745]: cluster 2024-09-14T04:02:34.381672+0000 mgr.a (mgr.14355) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:35 smithi171 bash[25040]: cluster 2024-09-14T04:02:34.381672+0000 mgr.a (mgr.14355) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:35 smithi007 bash[22722]: cluster 2024-09-14T04:02:34.381672+0000 mgr.a (mgr.14355) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:02:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:36.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:36.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:36.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:36.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:36.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:36.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:37 smithi131 bash[24745]: cluster 2024-09-14T04:02:36.383854+0000 mgr.a (mgr.14355) 14776 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:37.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:37 smithi131 bash[24745]: audit 2024-09-14T04:02:36.550817+0000 mgr.a (mgr.14355) 14777 : audit [DBG] from='client.320022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:37 smithi171 bash[25040]: cluster 2024-09-14T04:02:36.383854+0000 mgr.a (mgr.14355) 14776 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:37.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:37 smithi171 bash[25040]: audit 2024-09-14T04:02:36.550817+0000 mgr.a (mgr.14355) 14777 : audit [DBG] from='client.320022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:37 smithi007 bash[22722]: cluster 2024-09-14T04:02:36.383854+0000 mgr.a (mgr.14355) 14776 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:37 smithi007 bash[22722]: audit 2024-09-14T04:02:36.550817+0000 mgr.a (mgr.14355) 14777 : audit [DBG] from='client.320022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:39 smithi131 bash[24745]: cluster 2024-09-14T04:02:38.384813+0000 mgr.a (mgr.14355) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:02:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:39 smithi171 bash[25040]: cluster 2024-09-14T04:02:38.384813+0000 mgr.a (mgr.14355) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:02:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:39 smithi007 bash[22722]: cluster 2024-09-14T04:02:38.384813+0000 mgr.a (mgr.14355) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:02:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:41 smithi131 bash[24745]: cluster 2024-09-14T04:02:40.387163+0000 mgr.a (mgr.14355) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:02:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:41 smithi171 bash[25040]: cluster 2024-09-14T04:02:40.387163+0000 mgr.a (mgr.14355) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:02:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:41 smithi007 bash[22722]: cluster 2024-09-14T04:02:40.387163+0000 mgr.a (mgr.14355) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:02:41.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:42.760 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:42.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:43 smithi131 bash[24745]: audit 2024-09-14T04:02:42.310888+0000 mgr.a (mgr.14355) 14780 : audit [DBG] from='client.320094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:43 smithi131 bash[24745]: cluster 2024-09-14T04:02:42.387745+0000 mgr.a (mgr.14355) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:43 smithi171 bash[25040]: audit 2024-09-14T04:02:42.310888+0000 mgr.a (mgr.14355) 14780 : audit [DBG] from='client.320094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:43 smithi171 bash[25040]: cluster 2024-09-14T04:02:42.387745+0000 mgr.a (mgr.14355) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:43 smithi007 bash[22722]: audit 2024-09-14T04:02:42.310888+0000 mgr.a (mgr.14355) 14780 : audit [DBG] from='client.320094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:43 smithi007 bash[22722]: cluster 2024-09-14T04:02:42.387745+0000 mgr.a (mgr.14355) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:45 smithi131 bash[24745]: cluster 2024-09-14T04:02:44.388791+0000 mgr.a (mgr.14355) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:45 smithi171 bash[25040]: cluster 2024-09-14T04:02:44.388791+0000 mgr.a (mgr.14355) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:45 smithi007 bash[22722]: cluster 2024-09-14T04:02:44.388791+0000 mgr.a (mgr.14355) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:47.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:47 smithi131 bash[24745]: cluster 2024-09-14T04:02:46.391234+0000 mgr.a (mgr.14355) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:47 smithi171 bash[25040]: cluster 2024-09-14T04:02:46.391234+0000 mgr.a (mgr.14355) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:47 smithi007 bash[22722]: cluster 2024-09-14T04:02:46.391234+0000 mgr.a (mgr.14355) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:48.540 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:48.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:49 smithi131 bash[24745]: audit 2024-09-14T04:02:48.095220+0000 mgr.a (mgr.14355) 14784 : audit [DBG] from='client.320172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:49 smithi131 bash[24745]: cluster 2024-09-14T04:02:48.391956+0000 mgr.a (mgr.14355) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:49 smithi171 bash[25040]: audit 2024-09-14T04:02:48.095220+0000 mgr.a (mgr.14355) 14784 : audit [DBG] from='client.320172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:49 smithi171 bash[25040]: cluster 2024-09-14T04:02:48.391956+0000 mgr.a (mgr.14355) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:49 smithi007 bash[22722]: audit 2024-09-14T04:02:48.095220+0000 mgr.a (mgr.14355) 14784 : audit [DBG] from='client.320172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:49 smithi007 bash[22722]: cluster 2024-09-14T04:02:48.391956+0000 mgr.a (mgr.14355) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:51 smithi007 bash[22722]: cluster 2024-09-14T04:02:50.394208+0000 mgr.a (mgr.14355) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:51 smithi131 bash[24745]: cluster 2024-09-14T04:02:50.394208+0000 mgr.a (mgr.14355) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:51 smithi171 bash[25040]: cluster 2024-09-14T04:02:50.394208+0000 mgr.a (mgr.14355) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:53.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:53.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:53 smithi007 bash[22722]: cluster 2024-09-14T04:02:52.395155+0000 mgr.a (mgr.14355) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:53 smithi131 bash[24745]: cluster 2024-09-14T04:02:52.395155+0000 mgr.a (mgr.14355) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:53 smithi171 bash[25040]: cluster 2024-09-14T04:02:52.395155+0000 mgr.a (mgr.14355) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:54.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:02:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:02:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:02:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:02:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:02:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:55 smithi007 bash[22722]: audit 2024-09-14T04:02:53.872147+0000 mgr.a (mgr.14355) 14788 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:55 smithi007 bash[22722]: cluster 2024-09-14T04:02:54.396102+0000 mgr.a (mgr.14355) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:56.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:55 smithi131 bash[24745]: audit 2024-09-14T04:02:53.872147+0000 mgr.a (mgr.14355) 14788 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:56.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:55 smithi131 bash[24745]: cluster 2024-09-14T04:02:54.396102+0000 mgr.a (mgr.14355) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:55 smithi171 bash[25040]: audit 2024-09-14T04:02:53.872147+0000 mgr.a (mgr.14355) 14788 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:02:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:55 smithi171 bash[25040]: cluster 2024-09-14T04:02:54.396102+0000 mgr.a (mgr.14355) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:02:57.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:57 smithi007 bash[22722]: cluster 2024-09-14T04:02:56.398417+0000 mgr.a (mgr.14355) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:57 smithi131 bash[24745]: cluster 2024-09-14T04:02:56.398417+0000 mgr.a (mgr.14355) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:57 smithi171 bash[25040]: cluster 2024-09-14T04:02:56.398417+0000 mgr.a (mgr.14355) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:02:59.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:02:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:02:59.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:02:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:02:59 smithi007 bash[22722]: cluster 2024-09-14T04:02:58.399202+0000 mgr.a (mgr.14355) 14791 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:02:59 smithi131 bash[24745]: cluster 2024-09-14T04:02:58.399202+0000 mgr.a (mgr.14355) 14791 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:00.045 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:00.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:02:59 smithi171 bash[25040]: cluster 2024-09-14T04:02:58.399202+0000 mgr.a (mgr.14355) 14791 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:00 smithi007 bash[22722]: audit 2024-09-14T04:02:59.630807+0000 mgr.a (mgr.14355) 14792 : audit [DBG] from='client.320322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:00 smithi131 bash[24745]: audit 2024-09-14T04:02:59.630807+0000 mgr.a (mgr.14355) 14792 : audit [DBG] from='client.320322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:00 smithi171 bash[25040]: audit 2024-09-14T04:02:59.630807+0000 mgr.a (mgr.14355) 14792 : audit [DBG] from='client.320322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: cluster 2024-09-14T04:03:00.401523+0000 mgr.a (mgr.14355) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: audit 2024-09-14T04:03:00.804383+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: audit 2024-09-14T04:03:01.403637+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: audit 2024-09-14T04:03:01.410375+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: audit 2024-09-14T04:03:01.425699+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:01 smithi007 bash[22722]: audit 2024-09-14T04:03:01.430325+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: cluster 2024-09-14T04:03:00.401523+0000 mgr.a (mgr.14355) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: audit 2024-09-14T04:03:00.804383+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:03:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: audit 2024-09-14T04:03:01.403637+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: audit 2024-09-14T04:03:01.410375+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: audit 2024-09-14T04:03:01.425699+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:01 smithi131 bash[24745]: audit 2024-09-14T04:03:01.430325+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: cluster 2024-09-14T04:03:00.401523+0000 mgr.a (mgr.14355) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: audit 2024-09-14T04:03:00.804383+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: audit 2024-09-14T04:03:01.403637+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: audit 2024-09-14T04:03:01.410375+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: audit 2024-09-14T04:03:01.425699+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:01 smithi171 bash[25040]: audit 2024-09-14T04:03:01.430325+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.908 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22722]: audit 2024-09-14T04:03:02.148599+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:03:02.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22722]: audit 2024-09-14T04:03:02.150104+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:03:02.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22722]: audit 2024-09-14T04:03:02.160262+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:02.909 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22722]: audit 2024-09-14T04:03:02.163319+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:02 smithi131 bash[24745]: audit 2024-09-14T04:03:02.148599+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:03:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:02 smithi131 bash[24745]: audit 2024-09-14T04:03:02.150104+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:03:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:02 smithi131 bash[24745]: audit 2024-09-14T04:03:02.160262+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:02 smithi131 bash[24745]: audit 2024-09-14T04:03:02.163319+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:02 smithi171 bash[25040]: audit 2024-09-14T04:03:02.148599+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:03:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:02 smithi171 bash[25040]: audit 2024-09-14T04:03:02.150104+0000 mon.a (mon.0) 2807 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:03:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:02 smithi171 bash[25040]: audit 2024-09-14T04:03:02.160262+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:03:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:02 smithi171 bash[25040]: audit 2024-09-14T04:03:02.163319+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:03.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22972]: debug 2024-09-14T04:03:02.902+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:03:03.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:03:02 smithi007 bash[22972]: debug 2024-09-14T04:03:02.902+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:03:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:03 smithi007 bash[22722]: audit 2024-09-14T04:03:02.164609+0000 mgr.a (mgr.14355) 14794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:03 smithi007 bash[22722]: cluster 2024-09-14T04:03:02.402131+0000 mgr.a (mgr.14355) 14795 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:03 smithi131 bash[24745]: audit 2024-09-14T04:03:02.164609+0000 mgr.a (mgr.14355) 14794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:03 smithi131 bash[24745]: cluster 2024-09-14T04:03:02.402131+0000 mgr.a (mgr.14355) 14795 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:03 smithi171 bash[25040]: audit 2024-09-14T04:03:02.164609+0000 mgr.a (mgr.14355) 14794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:03:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:03 smithi171 bash[25040]: cluster 2024-09-14T04:03:02.402131+0000 mgr.a (mgr.14355) 14795 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:04 smithi007 bash[22722]: audit 2024-09-14T04:03:02.907845+0000 mgr.a (mgr.14355) 14796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:03:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:04 smithi007 bash[22722]: cephadm 2024-09-14T04:03:02.909003+0000 mgr.a (mgr.14355) 14797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:03:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:04 smithi131 bash[24745]: audit 2024-09-14T04:03:02.907845+0000 mgr.a (mgr.14355) 14796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:03:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:04 smithi131 bash[24745]: cephadm 2024-09-14T04:03:02.909003+0000 mgr.a (mgr.14355) 14797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:03:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:04 smithi171 bash[25040]: audit 2024-09-14T04:03:02.907845+0000 mgr.a (mgr.14355) 14796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:03:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:04 smithi171 bash[25040]: cephadm 2024-09-14T04:03:02.909003+0000 mgr.a (mgr.14355) 14797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:03:05.046 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:05.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:05.047 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:05.796 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:05.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:05 smithi007 bash[22722]: cluster 2024-09-14T04:03:04.403003+0000 mgr.a (mgr.14355) 14798 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:05 smithi131 bash[24745]: cluster 2024-09-14T04:03:04.403003+0000 mgr.a (mgr.14355) 14798 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:05 smithi171 bash[25040]: cluster 2024-09-14T04:03:04.403003+0000 mgr.a (mgr.14355) 14798 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:06 smithi007 bash[22722]: audit 2024-09-14T04:03:05.377385+0000 mgr.a (mgr.14355) 14799 : audit [DBG] from='client.320508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:06 smithi131 bash[24745]: audit 2024-09-14T04:03:05.377385+0000 mgr.a (mgr.14355) 14799 : audit [DBG] from='client.320508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:06 smithi171 bash[25040]: audit 2024-09-14T04:03:05.377385+0000 mgr.a (mgr.14355) 14799 : audit [DBG] from='client.320508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:07 smithi007 bash[22722]: cluster 2024-09-14T04:03:06.405946+0000 mgr.a (mgr.14355) 14800 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:07 smithi131 bash[24745]: cluster 2024-09-14T04:03:06.405946+0000 mgr.a (mgr.14355) 14800 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:07 smithi171 bash[25040]: cluster 2024-09-14T04:03:06.405946+0000 mgr.a (mgr.14355) 14800 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:09 smithi007 bash[22722]: cluster 2024-09-14T04:03:08.406772+0000 mgr.a (mgr.14355) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:09 smithi131 bash[24745]: cluster 2024-09-14T04:03:08.406772+0000 mgr.a (mgr.14355) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:09 smithi171 bash[25040]: cluster 2024-09-14T04:03:08.406772+0000 mgr.a (mgr.14355) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:10.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:10.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:11.579 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:11.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:11.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:11.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:11.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:11 smithi007 bash[22722]: cluster 2024-09-14T04:03:10.408702+0000 mgr.a (mgr.14355) 14802 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:11 smithi131 bash[24745]: cluster 2024-09-14T04:03:10.408702+0000 mgr.a (mgr.14355) 14802 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:11 smithi171 bash[25040]: cluster 2024-09-14T04:03:10.408702+0000 mgr.a (mgr.14355) 14802 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:12 smithi007 bash[22722]: audit 2024-09-14T04:03:11.130206+0000 mgr.a (mgr.14355) 14803 : audit [DBG] from='client.320586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:12 smithi131 bash[24745]: audit 2024-09-14T04:03:11.130206+0000 mgr.a (mgr.14355) 14803 : audit [DBG] from='client.320586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:12 smithi171 bash[25040]: audit 2024-09-14T04:03:11.130206+0000 mgr.a (mgr.14355) 14803 : audit [DBG] from='client.320586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:13 smithi007 bash[22722]: cluster 2024-09-14T04:03:12.409676+0000 mgr.a (mgr.14355) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:13 smithi131 bash[24745]: cluster 2024-09-14T04:03:12.409676+0000 mgr.a (mgr.14355) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:13 smithi171 bash[25040]: cluster 2024-09-14T04:03:12.409676+0000 mgr.a (mgr.14355) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:15 smithi007 bash[22722]: cluster 2024-09-14T04:03:14.410531+0000 mgr.a (mgr.14355) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:15 smithi131 bash[24745]: cluster 2024-09-14T04:03:14.410531+0000 mgr.a (mgr.14355) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:15 smithi171 bash[25040]: cluster 2024-09-14T04:03:14.410531+0000 mgr.a (mgr.14355) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:03:16.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:16.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:16.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:17.361 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:17 smithi007 bash[22722]: cluster 2024-09-14T04:03:16.412809+0000 mgr.a (mgr.14355) 14806 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:17 smithi131 bash[24745]: cluster 2024-09-14T04:03:16.412809+0000 mgr.a (mgr.14355) 14806 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:17 smithi171 bash[25040]: cluster 2024-09-14T04:03:16.412809+0000 mgr.a (mgr.14355) 14806 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:03:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:18 smithi131 bash[24745]: audit 2024-09-14T04:03:16.920609+0000 mgr.a (mgr.14355) 14807 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:18 smithi171 bash[25040]: audit 2024-09-14T04:03:16.920609+0000 mgr.a (mgr.14355) 14807 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:18 smithi007 bash[22722]: audit 2024-09-14T04:03:16.920609+0000 mgr.a (mgr.14355) 14807 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:19 smithi131 bash[24745]: cluster 2024-09-14T04:03:18.413778+0000 mgr.a (mgr.14355) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:19 smithi171 bash[25040]: cluster 2024-09-14T04:03:18.413778+0000 mgr.a (mgr.14355) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:19 smithi007 bash[22722]: cluster 2024-09-14T04:03:18.413778+0000 mgr.a (mgr.14355) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:21 smithi131 bash[24745]: cluster 2024-09-14T04:03:20.415948+0000 mgr.a (mgr.14355) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:21 smithi171 bash[25040]: cluster 2024-09-14T04:03:20.415948+0000 mgr.a (mgr.14355) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:21 smithi007 bash[22722]: cluster 2024-09-14T04:03:20.415948+0000 mgr.a (mgr.14355) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:22.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:22.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:23.121 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:23.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:23.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:23.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:23.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:23 smithi131 bash[24745]: cluster 2024-09-14T04:03:22.416701+0000 mgr.a (mgr.14355) 14810 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:23 smithi131 bash[24745]: audit 2024-09-14T04:03:22.694521+0000 mgr.a (mgr.14355) 14811 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:23 smithi171 bash[25040]: cluster 2024-09-14T04:03:22.416701+0000 mgr.a (mgr.14355) 14810 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:23 smithi171 bash[25040]: audit 2024-09-14T04:03:22.694521+0000 mgr.a (mgr.14355) 14811 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:23 smithi007 bash[22722]: cluster 2024-09-14T04:03:22.416701+0000 mgr.a (mgr.14355) 14810 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:23 smithi007 bash[22722]: audit 2024-09-14T04:03:22.694521+0000 mgr.a (mgr.14355) 14811 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:25 smithi131 bash[24745]: cluster 2024-09-14T04:03:24.417614+0000 mgr.a (mgr.14355) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:25 smithi171 bash[25040]: cluster 2024-09-14T04:03:24.417614+0000 mgr.a (mgr.14355) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:25 smithi007 bash[22722]: cluster 2024-09-14T04:03:24.417614+0000 mgr.a (mgr.14355) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:27 smithi131 bash[24745]: cluster 2024-09-14T04:03:26.419888+0000 mgr.a (mgr.14355) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:27 smithi171 bash[25040]: cluster 2024-09-14T04:03:26.419888+0000 mgr.a (mgr.14355) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:28.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:28.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:28.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:27 smithi007 bash[22722]: cluster 2024-09-14T04:03:26.419888+0000 mgr.a (mgr.14355) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:28.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:28.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:29 smithi131 bash[24745]: cluster 2024-09-14T04:03:28.420599+0000 mgr.a (mgr.14355) 14814 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:30.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:29 smithi131 bash[24745]: audit 2024-09-14T04:03:28.450048+0000 mgr.a (mgr.14355) 14815 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:29 smithi171 bash[25040]: cluster 2024-09-14T04:03:28.420599+0000 mgr.a (mgr.14355) 14814 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:29 smithi171 bash[25040]: audit 2024-09-14T04:03:28.450048+0000 mgr.a (mgr.14355) 14815 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:29 smithi007 bash[22722]: cluster 2024-09-14T04:03:28.420599+0000 mgr.a (mgr.14355) 14814 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:29 smithi007 bash[22722]: audit 2024-09-14T04:03:28.450048+0000 mgr.a (mgr.14355) 14815 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:31 smithi131 bash[24745]: cluster 2024-09-14T04:03:30.422854+0000 mgr.a (mgr.14355) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:31 smithi171 bash[25040]: cluster 2024-09-14T04:03:30.422854+0000 mgr.a (mgr.14355) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:31 smithi007 bash[22722]: cluster 2024-09-14T04:03:30.422854+0000 mgr.a (mgr.14355) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:33.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:33.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:33.865 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:33 smithi131 bash[24745]: cluster 2024-09-14T04:03:32.423636+0000 mgr.a (mgr.14355) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:33 smithi171 bash[25040]: cluster 2024-09-14T04:03:32.423636+0000 mgr.a (mgr.14355) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:33 smithi007 bash[22722]: cluster 2024-09-14T04:03:32.423636+0000 mgr.a (mgr.14355) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:34.615 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:34.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:34.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:34.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:34.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:35 smithi131 bash[24745]: audit 2024-09-14T04:03:34.200364+0000 mgr.a (mgr.14355) 14818 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:35 smithi131 bash[24745]: cluster 2024-09-14T04:03:34.424385+0000 mgr.a (mgr.14355) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:35 smithi171 bash[25040]: audit 2024-09-14T04:03:34.200364+0000 mgr.a (mgr.14355) 14818 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:35 smithi171 bash[25040]: cluster 2024-09-14T04:03:34.424385+0000 mgr.a (mgr.14355) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:35 smithi007 bash[22722]: audit 2024-09-14T04:03:34.200364+0000 mgr.a (mgr.14355) 14818 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:35 smithi007 bash[22722]: cluster 2024-09-14T04:03:34.424385+0000 mgr.a (mgr.14355) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:37 smithi131 bash[24745]: cluster 2024-09-14T04:03:36.426729+0000 mgr.a (mgr.14355) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:37 smithi171 bash[25040]: cluster 2024-09-14T04:03:36.426729+0000 mgr.a (mgr.14355) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:37 smithi007 bash[22722]: cluster 2024-09-14T04:03:36.426729+0000 mgr.a (mgr.14355) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:03:39.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:39.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:39.617 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:39 smithi131 bash[24745]: cluster 2024-09-14T04:03:38.427514+0000 mgr.a (mgr.14355) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:39 smithi171 bash[25040]: cluster 2024-09-14T04:03:38.427514+0000 mgr.a (mgr.14355) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:39 smithi007 bash[22722]: cluster 2024-09-14T04:03:38.427514+0000 mgr.a (mgr.14355) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:41 smithi131 bash[24745]: audit 2024-09-14T04:03:39.957029+0000 mgr.a (mgr.14355) 14822 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:42.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:41 smithi131 bash[24745]: cluster 2024-09-14T04:03:40.428722+0000 mgr.a (mgr.14355) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:03:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:41 smithi171 bash[25040]: audit 2024-09-14T04:03:39.957029+0000 mgr.a (mgr.14355) 14822 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:41 smithi171 bash[25040]: cluster 2024-09-14T04:03:40.428722+0000 mgr.a (mgr.14355) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:03:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:41 smithi007 bash[22722]: audit 2024-09-14T04:03:39.957029+0000 mgr.a (mgr.14355) 14822 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:41 smithi007 bash[22722]: cluster 2024-09-14T04:03:40.428722+0000 mgr.a (mgr.14355) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:03:44.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:43 smithi131 bash[24745]: cluster 2024-09-14T04:03:42.429459+0000 mgr.a (mgr.14355) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:43 smithi171 bash[25040]: cluster 2024-09-14T04:03:42.429459+0000 mgr.a (mgr.14355) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:43 smithi007 bash[22722]: cluster 2024-09-14T04:03:42.429459+0000 mgr.a (mgr.14355) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:45 smithi131 bash[24745]: cluster 2024-09-14T04:03:44.430223+0000 mgr.a (mgr.14355) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:45 smithi171 bash[25040]: cluster 2024-09-14T04:03:44.430223+0000 mgr.a (mgr.14355) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:46.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:46.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:46.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:45 smithi007 bash[22722]: cluster 2024-09-14T04:03:44.430223+0000 mgr.a (mgr.14355) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:03:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:46 smithi131 bash[24745]: audit 2024-09-14T04:03:45.740298+0000 mgr.a (mgr.14355) 14826 : audit [DBG] from='client.321042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:46 smithi171 bash[25040]: audit 2024-09-14T04:03:45.740298+0000 mgr.a (mgr.14355) 14826 : audit [DBG] from='client.321042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:46 smithi007 bash[22722]: audit 2024-09-14T04:03:45.740298+0000 mgr.a (mgr.14355) 14826 : audit [DBG] from='client.321042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:47 smithi131 bash[24745]: cluster 2024-09-14T04:03:46.433008+0000 mgr.a (mgr.14355) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:47 smithi171 bash[25040]: cluster 2024-09-14T04:03:46.433008+0000 mgr.a (mgr.14355) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:47 smithi007 bash[22722]: cluster 2024-09-14T04:03:46.433008+0000 mgr.a (mgr.14355) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:49 smithi131 bash[24745]: cluster 2024-09-14T04:03:48.433789+0000 mgr.a (mgr.14355) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:03:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:49 smithi171 bash[25040]: cluster 2024-09-14T04:03:48.433789+0000 mgr.a (mgr.14355) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:03:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:49 smithi007 bash[22722]: cluster 2024-09-14T04:03:48.433789+0000 mgr.a (mgr.14355) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:03:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:50 smithi007 bash[22722]: cluster 2024-09-14T04:03:50.435769+0000 mgr.a (mgr.14355) 14829 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:50 smithi131 bash[24745]: cluster 2024-09-14T04:03:50.435769+0000 mgr.a (mgr.14355) 14829 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:50 smithi171 bash[25040]: cluster 2024-09-14T04:03:50.435769+0000 mgr.a (mgr.14355) 14829 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:51.937 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:51.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:51 smithi007 bash[22722]: audit 2024-09-14T04:03:51.503717+0000 mgr.a (mgr.14355) 14830 : audit [DBG] from='client.321117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:51 smithi131 bash[24745]: audit 2024-09-14T04:03:51.503717+0000 mgr.a (mgr.14355) 14830 : audit [DBG] from='client.321117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:51 smithi171 bash[25040]: audit 2024-09-14T04:03:51.503717+0000 mgr.a (mgr.14355) 14830 : audit [DBG] from='client.321117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:52 smithi007 bash[22722]: cluster 2024-09-14T04:03:52.436774+0000 mgr.a (mgr.14355) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:52 smithi131 bash[24745]: cluster 2024-09-14T04:03:52.436774+0000 mgr.a (mgr.14355) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:52 smithi171 bash[25040]: cluster 2024-09-14T04:03:52.436774+0000 mgr.a (mgr.14355) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:55 smithi131 bash[24745]: cluster 2024-09-14T04:03:54.437559+0000 mgr.a (mgr.14355) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:55 smithi171 bash[25040]: cluster 2024-09-14T04:03:54.437559+0000 mgr.a (mgr.14355) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:55 smithi007 bash[22722]: cluster 2024-09-14T04:03:54.437559+0000 mgr.a (mgr.14355) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:03:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:03:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:03:56.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:03:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:03:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:03:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:03:57.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:03:57.697 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:03:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:57 smithi131 bash[24745]: cluster 2024-09-14T04:03:56.439833+0000 mgr.a (mgr.14355) 14833 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:03:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:57 smithi171 bash[25040]: cluster 2024-09-14T04:03:56.439833+0000 mgr.a (mgr.14355) 14833 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:03:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:57 smithi007 bash[22722]: cluster 2024-09-14T04:03:56.439833+0000 mgr.a (mgr.14355) 14833 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:03:58.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:58 smithi131 bash[24745]: audit 2024-09-14T04:03:57.273488+0000 mgr.a (mgr.14355) 14834 : audit [DBG] from='client.321195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:58 smithi171 bash[25040]: audit 2024-09-14T04:03:57.273488+0000 mgr.a (mgr.14355) 14834 : audit [DBG] from='client.321195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:58 smithi007 bash[22722]: audit 2024-09-14T04:03:57.273488+0000 mgr.a (mgr.14355) 14834 : audit [DBG] from='client.321195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:03:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:03:59 smithi131 bash[24745]: cluster 2024-09-14T04:03:58.440765+0000 mgr.a (mgr.14355) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:03:59 smithi171 bash[25040]: cluster 2024-09-14T04:03:58.440765+0000 mgr.a (mgr.14355) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:03:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:03:59 smithi007 bash[22722]: cluster 2024-09-14T04:03:58.440765+0000 mgr.a (mgr.14355) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:01 smithi131 bash[24745]: cluster 2024-09-14T04:04:00.442966+0000 mgr.a (mgr.14355) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:01 smithi171 bash[25040]: cluster 2024-09-14T04:04:00.442966+0000 mgr.a (mgr.14355) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:01 smithi007 bash[22722]: cluster 2024-09-14T04:04:00.442966+0000 mgr.a (mgr.14355) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:02.698 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:02.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:02.699 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:03.452 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:03.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:03.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:03 smithi131 bash[24745]: cluster 2024-09-14T04:04:02.443736+0000 mgr.a (mgr.14355) 14837 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:03.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:03 smithi131 bash[24745]: audit 2024-09-14T04:04:02.958526+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:04:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:03 smithi171 bash[25040]: cluster 2024-09-14T04:04:02.443736+0000 mgr.a (mgr.14355) 14837 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:03 smithi171 bash[25040]: audit 2024-09-14T04:04:02.958526+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:04:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:03 smithi007 bash[22722]: cluster 2024-09-14T04:04:02.443736+0000 mgr.a (mgr.14355) 14837 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:03 smithi007 bash[22722]: audit 2024-09-14T04:04:02.958526+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:04:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:04 smithi131 bash[24745]: audit 2024-09-14T04:04:03.030286+0000 mgr.a (mgr.14355) 14838 : audit [DBG] from='client.321273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:04 smithi131 bash[24745]: audit 2024-09-14T04:04:03.848220+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:04:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:04 smithi131 bash[24745]: audit 2024-09-14T04:04:03.850173+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:04:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:04 smithi131 bash[24745]: audit 2024-09-14T04:04:03.860873+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:04:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:04 smithi131 bash[24745]: audit 2024-09-14T04:04:03.865726+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:04 smithi171 bash[25040]: audit 2024-09-14T04:04:03.030286+0000 mgr.a (mgr.14355) 14838 : audit [DBG] from='client.321273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:04 smithi171 bash[25040]: audit 2024-09-14T04:04:03.848220+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:04:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:04 smithi171 bash[25040]: audit 2024-09-14T04:04:03.850173+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:04:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:04 smithi171 bash[25040]: audit 2024-09-14T04:04:03.860873+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:04:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:04 smithi171 bash[25040]: audit 2024-09-14T04:04:03.865726+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:04.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22972]: debug 2024-09-14T04:04:04.609+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:04:04.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22972]: debug 2024-09-14T04:04:04.613+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:04:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22722]: audit 2024-09-14T04:04:03.030286+0000 mgr.a (mgr.14355) 14838 : audit [DBG] from='client.321273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22722]: audit 2024-09-14T04:04:03.848220+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:04:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22722]: audit 2024-09-14T04:04:03.850173+0000 mon.a (mon.0) 2812 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:04:04.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22722]: audit 2024-09-14T04:04:03.860873+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:04:04.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:04 smithi007 bash[22722]: audit 2024-09-14T04:04:03.865726+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:05 smithi131 bash[24745]: audit 2024-09-14T04:04:03.868313+0000 mgr.a (mgr.14355) 14839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:05 smithi131 bash[24745]: cluster 2024-09-14T04:04:04.444414+0000 mgr.a (mgr.14355) 14840 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:05 smithi131 bash[24745]: audit 2024-09-14T04:04:04.613322+0000 mgr.a (mgr.14355) 14841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:04:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:05 smithi131 bash[24745]: cephadm 2024-09-14T04:04:04.614679+0000 mgr.a (mgr.14355) 14842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:04:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:05 smithi171 bash[25040]: audit 2024-09-14T04:04:03.868313+0000 mgr.a (mgr.14355) 14839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:05 smithi171 bash[25040]: cluster 2024-09-14T04:04:04.444414+0000 mgr.a (mgr.14355) 14840 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:05 smithi171 bash[25040]: audit 2024-09-14T04:04:04.613322+0000 mgr.a (mgr.14355) 14841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:04:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:05 smithi171 bash[25040]: cephadm 2024-09-14T04:04:04.614679+0000 mgr.a (mgr.14355) 14842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:04:05.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:05 smithi007 bash[22722]: audit 2024-09-14T04:04:03.868313+0000 mgr.a (mgr.14355) 14839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:04:05.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:05 smithi007 bash[22722]: cluster 2024-09-14T04:04:04.444414+0000 mgr.a (mgr.14355) 14840 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:05.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:05 smithi007 bash[22722]: audit 2024-09-14T04:04:04.613322+0000 mgr.a (mgr.14355) 14841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:04:05.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:05 smithi007 bash[22722]: cephadm 2024-09-14T04:04:04.614679+0000 mgr.a (mgr.14355) 14842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:04:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:07 smithi171 bash[25040]: cluster 2024-09-14T04:04:06.446672+0000 mgr.a (mgr.14355) 14843 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:07 smithi007 bash[22722]: cluster 2024-09-14T04:04:06.446672+0000 mgr.a (mgr.14355) 14843 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:07 smithi131 bash[24745]: cluster 2024-09-14T04:04:06.446672+0000 mgr.a (mgr.14355) 14843 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:08.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:08.454 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:09.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:09.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:09.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:09.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:09.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:09 smithi171 bash[25040]: cluster 2024-09-14T04:04:08.447452+0000 mgr.a (mgr.14355) 14844 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:09 smithi007 bash[22722]: cluster 2024-09-14T04:04:08.447452+0000 mgr.a (mgr.14355) 14844 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:09 smithi131 bash[24745]: cluster 2024-09-14T04:04:08.447452+0000 mgr.a (mgr.14355) 14844 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:10 smithi007 bash[22722]: audit 2024-09-14T04:04:08.791201+0000 mgr.a (mgr.14355) 14845 : audit [DBG] from='client.321453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:10 smithi131 bash[24745]: audit 2024-09-14T04:04:08.791201+0000 mgr.a (mgr.14355) 14845 : audit [DBG] from='client.321453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:10 smithi171 bash[25040]: audit 2024-09-14T04:04:08.791201+0000 mgr.a (mgr.14355) 14845 : audit [DBG] from='client.321453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:11 smithi007 bash[22722]: cluster 2024-09-14T04:04:10.449730+0000 mgr.a (mgr.14355) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:11 smithi131 bash[24745]: cluster 2024-09-14T04:04:10.449730+0000 mgr.a (mgr.14355) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:11 smithi171 bash[25040]: cluster 2024-09-14T04:04:10.449730+0000 mgr.a (mgr.14355) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:13 smithi007 bash[22722]: cluster 2024-09-14T04:04:12.450508+0000 mgr.a (mgr.14355) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:13 smithi131 bash[24745]: cluster 2024-09-14T04:04:12.450508+0000 mgr.a (mgr.14355) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:13 smithi171 bash[25040]: cluster 2024-09-14T04:04:12.450508+0000 mgr.a (mgr.14355) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:14.234 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:15.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:15.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:15 smithi007 bash[22722]: cluster 2024-09-14T04:04:14.450950+0000 mgr.a (mgr.14355) 14848 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:15 smithi007 bash[22722]: audit 2024-09-14T04:04:14.570036+0000 mgr.a (mgr.14355) 14849 : audit [DBG] from='client.321525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:15 smithi131 bash[24745]: cluster 2024-09-14T04:04:14.450950+0000 mgr.a (mgr.14355) 14848 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:16.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:15 smithi131 bash[24745]: audit 2024-09-14T04:04:14.570036+0000 mgr.a (mgr.14355) 14849 : audit [DBG] from='client.321525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:15 smithi171 bash[25040]: cluster 2024-09-14T04:04:14.450950+0000 mgr.a (mgr.14355) 14848 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:15 smithi171 bash[25040]: audit 2024-09-14T04:04:14.570036+0000 mgr.a (mgr.14355) 14849 : audit [DBG] from='client.321525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:17.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:17 smithi007 bash[22722]: cluster 2024-09-14T04:04:16.453264+0000 mgr.a (mgr.14355) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:18.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:17 smithi131 bash[24745]: cluster 2024-09-14T04:04:16.453264+0000 mgr.a (mgr.14355) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:17 smithi171 bash[25040]: cluster 2024-09-14T04:04:16.453264+0000 mgr.a (mgr.14355) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:04:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:19 smithi007 bash[22722]: cluster 2024-09-14T04:04:18.454031+0000 mgr.a (mgr.14355) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:20.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:20.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:20.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:19 smithi131 bash[24745]: cluster 2024-09-14T04:04:18.454031+0000 mgr.a (mgr.14355) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:19 smithi171 bash[25040]: cluster 2024-09-14T04:04:18.454031+0000 mgr.a (mgr.14355) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:20.776 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:20.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:20.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:20.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:20.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:21 smithi007 bash[22722]: audit 2024-09-14T04:04:20.355603+0000 mgr.a (mgr.14355) 14852 : audit [DBG] from='client.321603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:21 smithi007 bash[22722]: cluster 2024-09-14T04:04:20.455258+0000 mgr.a (mgr.14355) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:21 smithi131 bash[24745]: audit 2024-09-14T04:04:20.355603+0000 mgr.a (mgr.14355) 14852 : audit [DBG] from='client.321603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:21 smithi131 bash[24745]: cluster 2024-09-14T04:04:20.455258+0000 mgr.a (mgr.14355) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:21 smithi171 bash[25040]: audit 2024-09-14T04:04:20.355603+0000 mgr.a (mgr.14355) 14852 : audit [DBG] from='client.321603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:21 smithi171 bash[25040]: cluster 2024-09-14T04:04:20.455258+0000 mgr.a (mgr.14355) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:23.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:23 smithi007 bash[22722]: cluster 2024-09-14T04:04:22.456095+0000 mgr.a (mgr.14355) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:23 smithi131 bash[24745]: cluster 2024-09-14T04:04:22.456095+0000 mgr.a (mgr.14355) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:23 smithi171 bash[25040]: cluster 2024-09-14T04:04:22.456095+0000 mgr.a (mgr.14355) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:25.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:25.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:25.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:25 smithi007 bash[22722]: cluster 2024-09-14T04:04:24.456867+0000 mgr.a (mgr.14355) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:25 smithi131 bash[24745]: cluster 2024-09-14T04:04:24.456867+0000 mgr.a (mgr.14355) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:25 smithi171 bash[25040]: cluster 2024-09-14T04:04:24.456867+0000 mgr.a (mgr.14355) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:26.558 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:26.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:27 smithi007 bash[22722]: audit 2024-09-14T04:04:26.111948+0000 mgr.a (mgr.14355) 14856 : audit [DBG] from='client.321681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:27 smithi007 bash[22722]: cluster 2024-09-14T04:04:26.458623+0000 mgr.a (mgr.14355) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:27 smithi131 bash[24745]: audit 2024-09-14T04:04:26.111948+0000 mgr.a (mgr.14355) 14856 : audit [DBG] from='client.321681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:28.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:27 smithi131 bash[24745]: cluster 2024-09-14T04:04:26.458623+0000 mgr.a (mgr.14355) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:27 smithi171 bash[25040]: audit 2024-09-14T04:04:26.111948+0000 mgr.a (mgr.14355) 14856 : audit [DBG] from='client.321681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:27 smithi171 bash[25040]: cluster 2024-09-14T04:04:26.458623+0000 mgr.a (mgr.14355) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:29 smithi007 bash[22722]: cluster 2024-09-14T04:04:28.459534+0000 mgr.a (mgr.14355) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:29 smithi131 bash[24745]: cluster 2024-09-14T04:04:28.459534+0000 mgr.a (mgr.14355) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:29 smithi171 bash[25040]: cluster 2024-09-14T04:04:28.459534+0000 mgr.a (mgr.14355) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:04:31.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:31 smithi007 bash[22722]: cluster 2024-09-14T04:04:30.461490+0000 mgr.a (mgr.14355) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:31 smithi131 bash[24745]: cluster 2024-09-14T04:04:30.461490+0000 mgr.a (mgr.14355) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:31 smithi171 bash[25040]: cluster 2024-09-14T04:04:30.461490+0000 mgr.a (mgr.14355) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:32.336 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:32.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:32.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:33 smithi007 bash[22722]: audit 2024-09-14T04:04:31.899320+0000 mgr.a (mgr.14355) 14860 : audit [DBG] from='client.321759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:33 smithi007 bash[22722]: cluster 2024-09-14T04:04:32.462446+0000 mgr.a (mgr.14355) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:33 smithi131 bash[24745]: audit 2024-09-14T04:04:31.899320+0000 mgr.a (mgr.14355) 14860 : audit [DBG] from='client.321759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:33 smithi131 bash[24745]: cluster 2024-09-14T04:04:32.462446+0000 mgr.a (mgr.14355) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:33 smithi171 bash[25040]: audit 2024-09-14T04:04:31.899320+0000 mgr.a (mgr.14355) 14860 : audit [DBG] from='client.321759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:33 smithi171 bash[25040]: cluster 2024-09-14T04:04:32.462446+0000 mgr.a (mgr.14355) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:35 smithi007 bash[22722]: cluster 2024-09-14T04:04:34.463251+0000 mgr.a (mgr.14355) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:35 smithi131 bash[24745]: cluster 2024-09-14T04:04:34.463251+0000 mgr.a (mgr.14355) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:35 smithi171 bash[25040]: cluster 2024-09-14T04:04:34.463251+0000 mgr.a (mgr.14355) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:37.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:37.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:37 smithi007 bash[22722]: cluster 2024-09-14T04:04:36.465483+0000 mgr.a (mgr.14355) 14863 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:37 smithi131 bash[24745]: cluster 2024-09-14T04:04:36.465483+0000 mgr.a (mgr.14355) 14863 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:37 smithi171 bash[25040]: cluster 2024-09-14T04:04:36.465483+0000 mgr.a (mgr.14355) 14863 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:38.083 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:38.083 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:38.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:38 smithi007 bash[22722]: audit 2024-09-14T04:04:37.667750+0000 mgr.a (mgr.14355) 14864 : audit [DBG] from='client.321834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:38 smithi131 bash[24745]: audit 2024-09-14T04:04:37.667750+0000 mgr.a (mgr.14355) 14864 : audit [DBG] from='client.321834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:38 smithi171 bash[25040]: audit 2024-09-14T04:04:37.667750+0000 mgr.a (mgr.14355) 14864 : audit [DBG] from='client.321834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:39 smithi007 bash[22722]: cluster 2024-09-14T04:04:38.466453+0000 mgr.a (mgr.14355) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:39 smithi131 bash[24745]: cluster 2024-09-14T04:04:38.466453+0000 mgr.a (mgr.14355) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:39 smithi171 bash[25040]: cluster 2024-09-14T04:04:38.466453+0000 mgr.a (mgr.14355) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:41 smithi007 bash[22722]: cluster 2024-09-14T04:04:40.468591+0000 mgr.a (mgr.14355) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:41 smithi131 bash[24745]: cluster 2024-09-14T04:04:40.468591+0000 mgr.a (mgr.14355) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:41 smithi171 bash[25040]: cluster 2024-09-14T04:04:40.468591+0000 mgr.a (mgr.14355) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:43.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:43.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:43 smithi007 bash[22722]: cluster 2024-09-14T04:04:42.469321+0000 mgr.a (mgr.14355) 14867 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:43 smithi131 bash[24745]: cluster 2024-09-14T04:04:42.469321+0000 mgr.a (mgr.14355) 14867 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:43 smithi171 bash[25040]: cluster 2024-09-14T04:04:42.469321+0000 mgr.a (mgr.14355) 14867 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:44 smithi007 bash[22722]: audit 2024-09-14T04:04:43.416041+0000 mgr.a (mgr.14355) 14868 : audit [DBG] from='client.321912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:44 smithi131 bash[24745]: audit 2024-09-14T04:04:43.416041+0000 mgr.a (mgr.14355) 14868 : audit [DBG] from='client.321912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:44 smithi171 bash[25040]: audit 2024-09-14T04:04:43.416041+0000 mgr.a (mgr.14355) 14868 : audit [DBG] from='client.321912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:45 smithi007 bash[22722]: cluster 2024-09-14T04:04:44.470216+0000 mgr.a (mgr.14355) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:45 smithi131 bash[24745]: cluster 2024-09-14T04:04:44.470216+0000 mgr.a (mgr.14355) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:45 smithi171 bash[25040]: cluster 2024-09-14T04:04:44.470216+0000 mgr.a (mgr.14355) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:47 smithi007 bash[22722]: cluster 2024-09-14T04:04:46.472523+0000 mgr.a (mgr.14355) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:47 smithi131 bash[24745]: cluster 2024-09-14T04:04:46.472523+0000 mgr.a (mgr.14355) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:47 smithi171 bash[25040]: cluster 2024-09-14T04:04:46.472523+0000 mgr.a (mgr.14355) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:48.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:49.634 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:49.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:49 smithi007 bash[22722]: cluster 2024-09-14T04:04:48.473265+0000 mgr.a (mgr.14355) 14871 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:49 smithi131 bash[24745]: cluster 2024-09-14T04:04:48.473265+0000 mgr.a (mgr.14355) 14871 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:49 smithi171 bash[25040]: cluster 2024-09-14T04:04:48.473265+0000 mgr.a (mgr.14355) 14871 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:50 smithi007 bash[22722]: audit 2024-09-14T04:04:49.193127+0000 mgr.a (mgr.14355) 14872 : audit [DBG] from='client.321990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:50 smithi131 bash[24745]: audit 2024-09-14T04:04:49.193127+0000 mgr.a (mgr.14355) 14872 : audit [DBG] from='client.321990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:50 smithi171 bash[25040]: audit 2024-09-14T04:04:49.193127+0000 mgr.a (mgr.14355) 14872 : audit [DBG] from='client.321990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:51 smithi007 bash[22722]: cluster 2024-09-14T04:04:50.475531+0000 mgr.a (mgr.14355) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:51 smithi131 bash[24745]: cluster 2024-09-14T04:04:50.475531+0000 mgr.a (mgr.14355) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:51 smithi171 bash[25040]: cluster 2024-09-14T04:04:50.475531+0000 mgr.a (mgr.14355) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:04:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:53 smithi007 bash[22722]: cluster 2024-09-14T04:04:52.476290+0000 mgr.a (mgr.14355) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:53 smithi131 bash[24745]: cluster 2024-09-14T04:04:52.476290+0000 mgr.a (mgr.14355) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:53 smithi171 bash[25040]: cluster 2024-09-14T04:04:52.476290+0000 mgr.a (mgr.14355) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:04:54.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:04:54.637 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:04:55.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:04:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:04:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:04:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:04:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:04:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:55 smithi007 bash[22722]: cluster 2024-09-14T04:04:54.477049+0000 mgr.a (mgr.14355) 14875 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:55 smithi131 bash[24745]: cluster 2024-09-14T04:04:54.477049+0000 mgr.a (mgr.14355) 14875 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:55 smithi171 bash[25040]: cluster 2024-09-14T04:04:54.477049+0000 mgr.a (mgr.14355) 14875 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:04:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:56 smithi007 bash[22722]: audit 2024-09-14T04:04:54.975417+0000 mgr.a (mgr.14355) 14876 : audit [DBG] from='client.322065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:56 smithi131 bash[24745]: audit 2024-09-14T04:04:54.975417+0000 mgr.a (mgr.14355) 14876 : audit [DBG] from='client.322065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:56 smithi171 bash[25040]: audit 2024-09-14T04:04:54.975417+0000 mgr.a (mgr.14355) 14876 : audit [DBG] from='client.322065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:04:57.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:57 smithi007 bash[22722]: cluster 2024-09-14T04:04:56.479452+0000 mgr.a (mgr.14355) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:04:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:57 smithi131 bash[24745]: cluster 2024-09-14T04:04:56.479452+0000 mgr.a (mgr.14355) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:04:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:57 smithi171 bash[25040]: cluster 2024-09-14T04:04:56.479452+0000 mgr.a (mgr.14355) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:04:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:04:59 smithi007 bash[22722]: cluster 2024-09-14T04:04:58.480217+0000 mgr.a (mgr.14355) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:05:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:04:59 smithi131 bash[24745]: cluster 2024-09-14T04:04:58.480217+0000 mgr.a (mgr.14355) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:05:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:04:59 smithi171 bash[25040]: cluster 2024-09-14T04:04:58.480217+0000 mgr.a (mgr.14355) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:05:00.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:00.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:00.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:01.198 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:01.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:01.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:01.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:01.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:01 smithi007 bash[22722]: cluster 2024-09-14T04:05:00.481554+0000 mgr.a (mgr.14355) 14879 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:01 smithi007 bash[22722]: audit 2024-09-14T04:05:00.755072+0000 mgr.a (mgr.14355) 14880 : audit [DBG] from='client.322143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:01 smithi131 bash[24745]: cluster 2024-09-14T04:05:00.481554+0000 mgr.a (mgr.14355) 14879 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:02.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:01 smithi131 bash[24745]: audit 2024-09-14T04:05:00.755072+0000 mgr.a (mgr.14355) 14880 : audit [DBG] from='client.322143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:01 smithi171 bash[25040]: cluster 2024-09-14T04:05:00.481554+0000 mgr.a (mgr.14355) 14879 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:01 smithi171 bash[25040]: audit 2024-09-14T04:05:00.755072+0000 mgr.a (mgr.14355) 14880 : audit [DBG] from='client.322143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:03 smithi007 bash[22722]: cluster 2024-09-14T04:05:02.482420+0000 mgr.a (mgr.14355) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:03 smithi131 bash[24745]: cluster 2024-09-14T04:05:02.482420+0000 mgr.a (mgr.14355) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:03 smithi171 bash[25040]: cluster 2024-09-14T04:05:02.482420+0000 mgr.a (mgr.14355) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:04 smithi007 bash[22722]: audit 2024-09-14T04:05:04.666545+0000 mon.a (mon.0) 2815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:05:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:04 smithi131 bash[24745]: audit 2024-09-14T04:05:04.666545+0000 mon.a (mon.0) 2815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:05:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:04 smithi171 bash[25040]: audit 2024-09-14T04:05:04.666545+0000 mon.a (mon.0) 2815 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:05:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:05 smithi007 bash[22722]: cluster 2024-09-14T04:05:04.483173+0000 mgr.a (mgr.14355) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:05 smithi007 bash[22722]: audit 2024-09-14T04:05:05.515308+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:05:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:05 smithi007 bash[22722]: audit 2024-09-14T04:05:05.517057+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:05:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:05 smithi007 bash[22722]: audit 2024-09-14T04:05:05.527594+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:05:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:05 smithi007 bash[22722]: audit 2024-09-14T04:05:05.532461+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:05 smithi131 bash[24745]: cluster 2024-09-14T04:05:04.483173+0000 mgr.a (mgr.14355) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:05 smithi131 bash[24745]: audit 2024-09-14T04:05:05.515308+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:05:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:05 smithi131 bash[24745]: audit 2024-09-14T04:05:05.517057+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:05:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:05 smithi131 bash[24745]: audit 2024-09-14T04:05:05.527594+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:05:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:05 smithi131 bash[24745]: audit 2024-09-14T04:05:05.532461+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:05 smithi171 bash[25040]: cluster 2024-09-14T04:05:04.483173+0000 mgr.a (mgr.14355) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:05 smithi171 bash[25040]: audit 2024-09-14T04:05:05.515308+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:05:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:05 smithi171 bash[25040]: audit 2024-09-14T04:05:05.517057+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:05:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:05 smithi171 bash[25040]: audit 2024-09-14T04:05:05.527594+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:05:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:05 smithi171 bash[25040]: audit 2024-09-14T04:05:05.532461+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:06.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:06.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:06.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:06.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:05:06 smithi007 bash[22972]: debug 2024-09-14T04:05:06.272+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:05:06.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:05:06 smithi007 bash[22972]: debug 2024-09-14T04:05:06.276+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:05:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:06 smithi007 bash[22722]: audit 2024-09-14T04:05:05.534771+0000 mgr.a (mgr.14355) 14883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:06.960 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:06.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:06 smithi131 bash[24745]: audit 2024-09-14T04:05:05.534771+0000 mgr.a (mgr.14355) 14883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:06 smithi171 bash[25040]: audit 2024-09-14T04:05:05.534771+0000 mgr.a (mgr.14355) 14883 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:05:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:07 smithi131 bash[24745]: audit 2024-09-14T04:05:06.277603+0000 mgr.a (mgr.14355) 14884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:05:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:07 smithi131 bash[24745]: cephadm 2024-09-14T04:05:06.278732+0000 mgr.a (mgr.14355) 14885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:05:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:07 smithi131 bash[24745]: cluster 2024-09-14T04:05:06.484755+0000 mgr.a (mgr.14355) 14886 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:07 smithi131 bash[24745]: audit 2024-09-14T04:05:06.536824+0000 mgr.a (mgr.14355) 14887 : audit [DBG] from='client.322323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:07 smithi171 bash[25040]: audit 2024-09-14T04:05:06.277603+0000 mgr.a (mgr.14355) 14884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:05:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:07 smithi171 bash[25040]: cephadm 2024-09-14T04:05:06.278732+0000 mgr.a (mgr.14355) 14885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:05:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:07 smithi171 bash[25040]: cluster 2024-09-14T04:05:06.484755+0000 mgr.a (mgr.14355) 14886 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:07 smithi171 bash[25040]: audit 2024-09-14T04:05:06.536824+0000 mgr.a (mgr.14355) 14887 : audit [DBG] from='client.322323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:07 smithi007 bash[22722]: audit 2024-09-14T04:05:06.277603+0000 mgr.a (mgr.14355) 14884 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:05:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:07 smithi007 bash[22722]: cephadm 2024-09-14T04:05:06.278732+0000 mgr.a (mgr.14355) 14885 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:05:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:07 smithi007 bash[22722]: cluster 2024-09-14T04:05:06.484755+0000 mgr.a (mgr.14355) 14886 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:07 smithi007 bash[22722]: audit 2024-09-14T04:05:06.536824+0000 mgr.a (mgr.14355) 14887 : audit [DBG] from='client.322323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:09 smithi131 bash[24745]: cluster 2024-09-14T04:05:08.485621+0000 mgr.a (mgr.14355) 14888 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:05:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:09 smithi171 bash[25040]: cluster 2024-09-14T04:05:08.485621+0000 mgr.a (mgr.14355) 14888 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:05:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:09 smithi007 bash[22722]: cluster 2024-09-14T04:05:08.485621+0000 mgr.a (mgr.14355) 14888 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:05:11.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:11.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:11 smithi131 bash[24745]: cluster 2024-09-14T04:05:10.487938+0000 mgr.a (mgr.14355) 14889 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:11 smithi171 bash[25040]: cluster 2024-09-14T04:05:10.487938+0000 mgr.a (mgr.14355) 14889 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:11 smithi007 bash[22722]: cluster 2024-09-14T04:05:10.487938+0000 mgr.a (mgr.14355) 14889 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:12.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:13 smithi131 bash[24745]: audit 2024-09-14T04:05:12.294887+0000 mgr.a (mgr.14355) 14890 : audit [DBG] from='client.322398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:13 smithi131 bash[24745]: cluster 2024-09-14T04:05:12.488692+0000 mgr.a (mgr.14355) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:13 smithi171 bash[25040]: audit 2024-09-14T04:05:12.294887+0000 mgr.a (mgr.14355) 14890 : audit [DBG] from='client.322398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:13 smithi171 bash[25040]: cluster 2024-09-14T04:05:12.488692+0000 mgr.a (mgr.14355) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:13 smithi007 bash[22722]: audit 2024-09-14T04:05:12.294887+0000 mgr.a (mgr.14355) 14890 : audit [DBG] from='client.322398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:13 smithi007 bash[22722]: cluster 2024-09-14T04:05:12.488692+0000 mgr.a (mgr.14355) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:15 smithi131 bash[24745]: cluster 2024-09-14T04:05:14.489558+0000 mgr.a (mgr.14355) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:15 smithi171 bash[25040]: cluster 2024-09-14T04:05:14.489558+0000 mgr.a (mgr.14355) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:15 smithi007 bash[22722]: cluster 2024-09-14T04:05:14.489558+0000 mgr.a (mgr.14355) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:17 smithi131 bash[24745]: cluster 2024-09-14T04:05:16.491826+0000 mgr.a (mgr.14355) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:17 smithi171 bash[25040]: cluster 2024-09-14T04:05:16.491826+0000 mgr.a (mgr.14355) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:17 smithi007 bash[22722]: cluster 2024-09-14T04:05:16.491826+0000 mgr.a (mgr.14355) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:18.530 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:19 smithi131 bash[24745]: audit 2024-09-14T04:05:18.086254+0000 mgr.a (mgr.14355) 14894 : audit [DBG] from='client.322476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:20.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:19 smithi131 bash[24745]: cluster 2024-09-14T04:05:18.492361+0000 mgr.a (mgr.14355) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:19 smithi171 bash[25040]: audit 2024-09-14T04:05:18.086254+0000 mgr.a (mgr.14355) 14894 : audit [DBG] from='client.322476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:19 smithi171 bash[25040]: cluster 2024-09-14T04:05:18.492361+0000 mgr.a (mgr.14355) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:19 smithi007 bash[22722]: audit 2024-09-14T04:05:18.086254+0000 mgr.a (mgr.14355) 14894 : audit [DBG] from='client.322476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:19 smithi007 bash[22722]: cluster 2024-09-14T04:05:18.492361+0000 mgr.a (mgr.14355) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:21 smithi131 bash[24745]: cluster 2024-09-14T04:05:20.494500+0000 mgr.a (mgr.14355) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:21 smithi171 bash[25040]: cluster 2024-09-14T04:05:20.494500+0000 mgr.a (mgr.14355) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:21 smithi007 bash[22722]: cluster 2024-09-14T04:05:20.494500+0000 mgr.a (mgr.14355) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:05:23.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:23.532 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:23.533 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:23 smithi131 bash[24745]: cluster 2024-09-14T04:05:22.495238+0000 mgr.a (mgr.14355) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:23 smithi171 bash[25040]: cluster 2024-09-14T04:05:22.495238+0000 mgr.a (mgr.14355) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:23 smithi007 bash[22722]: cluster 2024-09-14T04:05:22.495238+0000 mgr.a (mgr.14355) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:24.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:25 smithi131 bash[24745]: audit 2024-09-14T04:05:23.865063+0000 mgr.a (mgr.14355) 14898 : audit [DBG] from='client.322551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:25 smithi131 bash[24745]: cluster 2024-09-14T04:05:24.496078+0000 mgr.a (mgr.14355) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:25 smithi171 bash[25040]: audit 2024-09-14T04:05:23.865063+0000 mgr.a (mgr.14355) 14898 : audit [DBG] from='client.322551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:25 smithi171 bash[25040]: cluster 2024-09-14T04:05:24.496078+0000 mgr.a (mgr.14355) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:25 smithi007 bash[22722]: audit 2024-09-14T04:05:23.865063+0000 mgr.a (mgr.14355) 14898 : audit [DBG] from='client.322551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:25 smithi007 bash[22722]: cluster 2024-09-14T04:05:24.496078+0000 mgr.a (mgr.14355) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:27 smithi131 bash[24745]: cluster 2024-09-14T04:05:26.498332+0000 mgr.a (mgr.14355) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:27 smithi171 bash[25040]: cluster 2024-09-14T04:05:26.498332+0000 mgr.a (mgr.14355) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:27 smithi007 bash[22722]: cluster 2024-09-14T04:05:26.498332+0000 mgr.a (mgr.14355) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:29.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:29.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:29 smithi131 bash[24745]: cluster 2024-09-14T04:05:28.499029+0000 mgr.a (mgr.14355) 14901 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:29 smithi171 bash[25040]: cluster 2024-09-14T04:05:28.499029+0000 mgr.a (mgr.14355) 14901 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:30.079 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:29 smithi007 bash[22722]: cluster 2024-09-14T04:05:28.499029+0000 mgr.a (mgr.14355) 14901 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:30 smithi131 bash[24745]: audit 2024-09-14T04:05:29.632481+0000 mgr.a (mgr.14355) 14902 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:30 smithi171 bash[25040]: audit 2024-09-14T04:05:29.632481+0000 mgr.a (mgr.14355) 14902 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:30 smithi007 bash[22722]: audit 2024-09-14T04:05:29.632481+0000 mgr.a (mgr.14355) 14902 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:31 smithi131 bash[24745]: cluster 2024-09-14T04:05:30.501413+0000 mgr.a (mgr.14355) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:31 smithi171 bash[25040]: cluster 2024-09-14T04:05:30.501413+0000 mgr.a (mgr.14355) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:31 smithi007 bash[22722]: cluster 2024-09-14T04:05:30.501413+0000 mgr.a (mgr.14355) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:33 smithi131 bash[24745]: cluster 2024-09-14T04:05:32.502185+0000 mgr.a (mgr.14355) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:33 smithi171 bash[25040]: cluster 2024-09-14T04:05:32.502185+0000 mgr.a (mgr.14355) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:33 smithi007 bash[22722]: cluster 2024-09-14T04:05:32.502185+0000 mgr.a (mgr.14355) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:35.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:35.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:35 smithi131 bash[24745]: cluster 2024-09-14T04:05:34.502950+0000 mgr.a (mgr.14355) 14905 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:35 smithi171 bash[25040]: cluster 2024-09-14T04:05:34.502950+0000 mgr.a (mgr.14355) 14905 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:35 smithi007 bash[22722]: cluster 2024-09-14T04:05:34.502950+0000 mgr.a (mgr.14355) 14905 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:36 smithi171 bash[25040]: audit 2024-09-14T04:05:35.419683+0000 mgr.a (mgr.14355) 14906 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:36 smithi007 bash[22722]: audit 2024-09-14T04:05:35.419683+0000 mgr.a (mgr.14355) 14906 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:36 smithi131 bash[24745]: audit 2024-09-14T04:05:35.419683+0000 mgr.a (mgr.14355) 14906 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:37 smithi171 bash[25040]: cluster 2024-09-14T04:05:36.505681+0000 mgr.a (mgr.14355) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:37 smithi007 bash[22722]: cluster 2024-09-14T04:05:36.505681+0000 mgr.a (mgr.14355) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:37 smithi131 bash[24745]: cluster 2024-09-14T04:05:36.505681+0000 mgr.a (mgr.14355) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:39 smithi171 bash[25040]: cluster 2024-09-14T04:05:38.506470+0000 mgr.a (mgr.14355) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:39 smithi007 bash[22722]: cluster 2024-09-14T04:05:38.506470+0000 mgr.a (mgr.14355) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:39 smithi131 bash[24745]: cluster 2024-09-14T04:05:38.506470+0000 mgr.a (mgr.14355) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:40.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:40.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:40 smithi007 bash[22722]: cluster 2024-09-14T04:05:40.508401+0000 mgr.a (mgr.14355) 14909 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:40 smithi131 bash[24745]: cluster 2024-09-14T04:05:40.508401+0000 mgr.a (mgr.14355) 14909 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:40 smithi171 bash[25040]: cluster 2024-09-14T04:05:40.508401+0000 mgr.a (mgr.14355) 14909 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:41.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:41.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:41.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:41.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:41.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:41 smithi007 bash[22722]: audit 2024-09-14T04:05:41.206305+0000 mgr.a (mgr.14355) 14910 : audit [DBG] from='client.322782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:41 smithi131 bash[24745]: audit 2024-09-14T04:05:41.206305+0000 mgr.a (mgr.14355) 14910 : audit [DBG] from='client.322782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:41 smithi171 bash[25040]: audit 2024-09-14T04:05:41.206305+0000 mgr.a (mgr.14355) 14910 : audit [DBG] from='client.322782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:42 smithi007 bash[22722]: cluster 2024-09-14T04:05:42.509222+0000 mgr.a (mgr.14355) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:42 smithi131 bash[24745]: cluster 2024-09-14T04:05:42.509222+0000 mgr.a (mgr.14355) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:42 smithi171 bash[25040]: cluster 2024-09-14T04:05:42.509222+0000 mgr.a (mgr.14355) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:05:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:45 smithi007 bash[22722]: cluster 2024-09-14T04:05:44.509987+0000 mgr.a (mgr.14355) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:45 smithi131 bash[24745]: cluster 2024-09-14T04:05:44.509987+0000 mgr.a (mgr.14355) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:45 smithi171 bash[25040]: cluster 2024-09-14T04:05:44.509987+0000 mgr.a (mgr.14355) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:05:46.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:46.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:46.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:47.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:47.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:47.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:47 smithi007 bash[22722]: cluster 2024-09-14T04:05:46.512222+0000 mgr.a (mgr.14355) 14913 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:47 smithi131 bash[24745]: cluster 2024-09-14T04:05:46.512222+0000 mgr.a (mgr.14355) 14913 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:47 smithi171 bash[25040]: cluster 2024-09-14T04:05:46.512222+0000 mgr.a (mgr.14355) 14913 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:48 smithi007 bash[22722]: audit 2024-09-14T04:05:46.979938+0000 mgr.a (mgr.14355) 14914 : audit [DBG] from='client.322857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:48 smithi131 bash[24745]: audit 2024-09-14T04:05:46.979938+0000 mgr.a (mgr.14355) 14914 : audit [DBG] from='client.322857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:48 smithi171 bash[25040]: audit 2024-09-14T04:05:46.979938+0000 mgr.a (mgr.14355) 14914 : audit [DBG] from='client.322857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:49 smithi007 bash[22722]: cluster 2024-09-14T04:05:48.513171+0000 mgr.a (mgr.14355) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:49 smithi131 bash[24745]: cluster 2024-09-14T04:05:48.513171+0000 mgr.a (mgr.14355) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:49 smithi171 bash[25040]: cluster 2024-09-14T04:05:48.513171+0000 mgr.a (mgr.14355) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:51 smithi007 bash[22722]: cluster 2024-09-14T04:05:50.515346+0000 mgr.a (mgr.14355) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:51 smithi131 bash[24745]: cluster 2024-09-14T04:05:50.515346+0000 mgr.a (mgr.14355) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:51 smithi171 bash[25040]: cluster 2024-09-14T04:05:50.515346+0000 mgr.a (mgr.14355) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:52.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:52.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:53.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:53 smithi007 bash[22722]: cluster 2024-09-14T04:05:52.515805+0000 mgr.a (mgr.14355) 14917 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:53.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:53 smithi007 bash[22722]: audit 2024-09-14T04:05:52.737294+0000 mgr.a (mgr.14355) 14918 : audit [DBG] from='client.322932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:53 smithi131 bash[24745]: cluster 2024-09-14T04:05:52.515805+0000 mgr.a (mgr.14355) 14917 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:53 smithi131 bash[24745]: audit 2024-09-14T04:05:52.737294+0000 mgr.a (mgr.14355) 14918 : audit [DBG] from='client.322932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:53 smithi171 bash[25040]: cluster 2024-09-14T04:05:52.515805+0000 mgr.a (mgr.14355) 14917 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:53 smithi171 bash[25040]: audit 2024-09-14T04:05:52.737294+0000 mgr.a (mgr.14355) 14918 : audit [DBG] from='client.322932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:55 smithi007 bash[22722]: cluster 2024-09-14T04:05:54.516734+0000 mgr.a (mgr.14355) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:55 smithi131 bash[24745]: cluster 2024-09-14T04:05:54.516734+0000 mgr.a (mgr.14355) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:55 smithi171 bash[25040]: cluster 2024-09-14T04:05:54.516734+0000 mgr.a (mgr.14355) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:05:57.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:57 smithi007 bash[22722]: cluster 2024-09-14T04:05:56.519066+0000 mgr.a (mgr.14355) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:57 smithi131 bash[24745]: cluster 2024-09-14T04:05:56.519066+0000 mgr.a (mgr.14355) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:57 smithi171 bash[25040]: cluster 2024-09-14T04:05:56.519066+0000 mgr.a (mgr.14355) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:05:58.166 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:05:58.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:05:58.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:05:58.940 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:05:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:05:58.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:05:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:05:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:05:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:59 smithi007 bash[22722]: audit 2024-09-14T04:05:58.500845+0000 mgr.a (mgr.14355) 14921 : audit [DBG] from='client.323010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:05:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:05:59 smithi007 bash[22722]: cluster 2024-09-14T04:05:58.519938+0000 mgr.a (mgr.14355) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:59 smithi131 bash[24745]: audit 2024-09-14T04:05:58.500845+0000 mgr.a (mgr.14355) 14921 : audit [DBG] from='client.323010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:05:59 smithi131 bash[24745]: cluster 2024-09-14T04:05:58.519938+0000 mgr.a (mgr.14355) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:59 smithi171 bash[25040]: audit 2024-09-14T04:05:58.500845+0000 mgr.a (mgr.14355) 14921 : audit [DBG] from='client.323010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:05:59 smithi171 bash[25040]: cluster 2024-09-14T04:05:58.519938+0000 mgr.a (mgr.14355) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:01 smithi007 bash[22722]: cluster 2024-09-14T04:06:00.522264+0000 mgr.a (mgr.14355) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:01 smithi131 bash[24745]: cluster 2024-09-14T04:06:00.522264+0000 mgr.a (mgr.14355) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:01 smithi171 bash[25040]: cluster 2024-09-14T04:06:00.522264+0000 mgr.a (mgr.14355) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:03.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:03.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:03.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:03 smithi007 bash[22722]: cluster 2024-09-14T04:06:02.523079+0000 mgr.a (mgr.14355) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:03 smithi131 bash[24745]: cluster 2024-09-14T04:06:02.523079+0000 mgr.a (mgr.14355) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:03 smithi171 bash[25040]: cluster 2024-09-14T04:06:02.523079+0000 mgr.a (mgr.14355) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:04.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:04.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:05 smithi007 bash[22722]: audit 2024-09-14T04:06:04.268541+0000 mgr.a (mgr.14355) 14925 : audit [DBG] from='client.323082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:05.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:05 smithi007 bash[22722]: cluster 2024-09-14T04:06:04.523633+0000 mgr.a (mgr.14355) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:05 smithi131 bash[24745]: audit 2024-09-14T04:06:04.268541+0000 mgr.a (mgr.14355) 14925 : audit [DBG] from='client.323082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:05 smithi131 bash[24745]: cluster 2024-09-14T04:06:04.523633+0000 mgr.a (mgr.14355) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:05 smithi171 bash[25040]: audit 2024-09-14T04:06:04.268541+0000 mgr.a (mgr.14355) 14925 : audit [DBG] from='client.323082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:05 smithi171 bash[25040]: cluster 2024-09-14T04:06:04.523633+0000 mgr.a (mgr.14355) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:06 smithi007 bash[22722]: audit 2024-09-14T04:06:06.336787+0000 mon.a (mon.0) 2820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:06:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:06 smithi131 bash[24745]: audit 2024-09-14T04:06:06.336787+0000 mon.a (mon.0) 2820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:06:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:06 smithi171 bash[25040]: audit 2024-09-14T04:06:06.336787+0000 mon.a (mon.0) 2820 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:06:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22722]: cluster 2024-09-14T04:06:06.525045+0000 mgr.a (mgr.14355) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22722]: audit 2024-09-14T04:06:07.188157+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:06:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22722]: audit 2024-09-14T04:06:07.190041+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:06:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22722]: audit 2024-09-14T04:06:07.199642+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:06:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22722]: audit 2024-09-14T04:06:07.204192+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:07 smithi131 bash[24745]: cluster 2024-09-14T04:06:06.525045+0000 mgr.a (mgr.14355) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:07 smithi131 bash[24745]: audit 2024-09-14T04:06:07.188157+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:06:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:07 smithi131 bash[24745]: audit 2024-09-14T04:06:07.190041+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:06:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:07 smithi131 bash[24745]: audit 2024-09-14T04:06:07.199642+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:06:08.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:07 smithi131 bash[24745]: audit 2024-09-14T04:06:07.204192+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:07 smithi171 bash[25040]: cluster 2024-09-14T04:06:06.525045+0000 mgr.a (mgr.14355) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:07 smithi171 bash[25040]: audit 2024-09-14T04:06:07.188157+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:06:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:07 smithi171 bash[25040]: audit 2024-09-14T04:06:07.190041+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:06:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:07 smithi171 bash[25040]: audit 2024-09-14T04:06:07.199642+0000 mon.a (mon.0) 2823 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:06:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:07 smithi171 bash[25040]: audit 2024-09-14T04:06:07.204192+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:08.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22972]: debug 2024-09-14T04:06:07.971+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:06:08.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:06:07 smithi007 bash[22972]: debug 2024-09-14T04:06:07.971+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:06:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:08 smithi007 bash[22722]: audit 2024-09-14T04:06:07.206589+0000 mgr.a (mgr.14355) 14928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:08 smithi131 bash[24745]: audit 2024-09-14T04:06:07.206589+0000 mgr.a (mgr.14355) 14928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:08 smithi171 bash[25040]: audit 2024-09-14T04:06:07.206589+0000 mgr.a (mgr.14355) 14928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:06:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:09.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:09.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:09 smithi007 bash[22722]: audit 2024-09-14T04:06:07.975967+0000 mgr.a (mgr.14355) 14929 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:06:09.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:09 smithi007 bash[22722]: cephadm 2024-09-14T04:06:07.978179+0000 mgr.a (mgr.14355) 14930 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:06:09.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:09 smithi007 bash[22722]: cluster 2024-09-14T04:06:08.525964+0000 mgr.a (mgr.14355) 14931 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:09 smithi131 bash[24745]: audit 2024-09-14T04:06:07.975967+0000 mgr.a (mgr.14355) 14929 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:06:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:09 smithi131 bash[24745]: cephadm 2024-09-14T04:06:07.978179+0000 mgr.a (mgr.14355) 14930 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:06:10.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:09 smithi131 bash[24745]: cluster 2024-09-14T04:06:08.525964+0000 mgr.a (mgr.14355) 14931 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:09 smithi171 bash[25040]: audit 2024-09-14T04:06:07.975967+0000 mgr.a (mgr.14355) 14929 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:06:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:09 smithi171 bash[25040]: cephadm 2024-09-14T04:06:07.978179+0000 mgr.a (mgr.14355) 14930 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:06:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:09 smithi171 bash[25040]: cluster 2024-09-14T04:06:08.525964+0000 mgr.a (mgr.14355) 14931 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:10.463 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:10.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:10.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:10.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:10.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:11.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:11 smithi007 bash[22722]: audit 2024-09-14T04:06:10.024327+0000 mgr.a (mgr.14355) 14932 : audit [DBG] from='client.323259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:11.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:11 smithi007 bash[22722]: cluster 2024-09-14T04:06:10.527769+0000 mgr.a (mgr.14355) 14933 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:11 smithi131 bash[24745]: audit 2024-09-14T04:06:10.024327+0000 mgr.a (mgr.14355) 14932 : audit [DBG] from='client.323259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:11 smithi131 bash[24745]: cluster 2024-09-14T04:06:10.527769+0000 mgr.a (mgr.14355) 14933 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:11 smithi171 bash[25040]: audit 2024-09-14T04:06:10.024327+0000 mgr.a (mgr.14355) 14932 : audit [DBG] from='client.323259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:11 smithi171 bash[25040]: cluster 2024-09-14T04:06:10.527769+0000 mgr.a (mgr.14355) 14933 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:13.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:13 smithi007 bash[22722]: cluster 2024-09-14T04:06:12.528547+0000 mgr.a (mgr.14355) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:13 smithi131 bash[24745]: cluster 2024-09-14T04:06:12.528547+0000 mgr.a (mgr.14355) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:13 smithi171 bash[25040]: cluster 2024-09-14T04:06:12.528547+0000 mgr.a (mgr.14355) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:15.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:15.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:15.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:15 smithi007 bash[22722]: cluster 2024-09-14T04:06:14.529481+0000 mgr.a (mgr.14355) 14935 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:15 smithi131 bash[24745]: cluster 2024-09-14T04:06:14.529481+0000 mgr.a (mgr.14355) 14935 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:16.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:15 smithi171 bash[25040]: cluster 2024-09-14T04:06:14.529481+0000 mgr.a (mgr.14355) 14935 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:16.218 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:16.219 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:16 smithi007 bash[22722]: audit 2024-09-14T04:06:15.794869+0000 mgr.a (mgr.14355) 14936 : audit [DBG] from='client.323337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:16 smithi131 bash[24745]: audit 2024-09-14T04:06:15.794869+0000 mgr.a (mgr.14355) 14936 : audit [DBG] from='client.323337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:16 smithi171 bash[25040]: audit 2024-09-14T04:06:15.794869+0000 mgr.a (mgr.14355) 14936 : audit [DBG] from='client.323337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:17 smithi007 bash[22722]: cluster 2024-09-14T04:06:16.532324+0000 mgr.a (mgr.14355) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:17 smithi131 bash[24745]: cluster 2024-09-14T04:06:16.532324+0000 mgr.a (mgr.14355) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:18.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:17 smithi171 bash[25040]: cluster 2024-09-14T04:06:16.532324+0000 mgr.a (mgr.14355) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:19 smithi007 bash[22722]: cluster 2024-09-14T04:06:18.533135+0000 mgr.a (mgr.14355) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:20.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:19 smithi131 bash[24745]: cluster 2024-09-14T04:06:18.533135+0000 mgr.a (mgr.14355) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:19 smithi171 bash[25040]: cluster 2024-09-14T04:06:18.533135+0000 mgr.a (mgr.14355) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:06:21.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:21.221 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:21.221 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:21 smithi007 bash[22722]: cluster 2024-09-14T04:06:20.535067+0000 mgr.a (mgr.14355) 14939 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:21.988 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:21 smithi131 bash[24745]: cluster 2024-09-14T04:06:20.535067+0000 mgr.a (mgr.14355) 14939 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:21 smithi171 bash[25040]: cluster 2024-09-14T04:06:20.535067+0000 mgr.a (mgr.14355) 14939 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:06:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:22 smithi007 bash[22722]: audit 2024-09-14T04:06:21.554068+0000 mgr.a (mgr.14355) 14940 : audit [DBG] from='client.323409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:22 smithi131 bash[24745]: audit 2024-09-14T04:06:21.554068+0000 mgr.a (mgr.14355) 14940 : audit [DBG] from='client.323409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:22 smithi171 bash[25040]: audit 2024-09-14T04:06:21.554068+0000 mgr.a (mgr.14355) 14940 : audit [DBG] from='client.323409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:23 smithi007 bash[22722]: cluster 2024-09-14T04:06:22.535997+0000 mgr.a (mgr.14355) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:23 smithi131 bash[24745]: cluster 2024-09-14T04:06:22.535997+0000 mgr.a (mgr.14355) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:23 smithi171 bash[25040]: cluster 2024-09-14T04:06:22.535997+0000 mgr.a (mgr.14355) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:25 smithi007 bash[22722]: cluster 2024-09-14T04:06:24.536778+0000 mgr.a (mgr.14355) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:25 smithi131 bash[24745]: cluster 2024-09-14T04:06:24.536778+0000 mgr.a (mgr.14355) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:25 smithi171 bash[25040]: cluster 2024-09-14T04:06:24.536778+0000 mgr.a (mgr.14355) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:06:26.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:26.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:26.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:27.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:27.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:27 smithi007 bash[22722]: cluster 2024-09-14T04:06:26.539082+0000 mgr.a (mgr.14355) 14943 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:06:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:27 smithi131 bash[24745]: cluster 2024-09-14T04:06:26.539082+0000 mgr.a (mgr.14355) 14943 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:06:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:27 smithi171 bash[25040]: cluster 2024-09-14T04:06:26.539082+0000 mgr.a (mgr.14355) 14943 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:06:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:28 smithi007 bash[22722]: audit 2024-09-14T04:06:27.329381+0000 mgr.a (mgr.14355) 14944 : audit [DBG] from='client.323484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:28 smithi131 bash[24745]: audit 2024-09-14T04:06:27.329381+0000 mgr.a (mgr.14355) 14944 : audit [DBG] from='client.323484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:28 smithi171 bash[25040]: audit 2024-09-14T04:06:27.329381+0000 mgr.a (mgr.14355) 14944 : audit [DBG] from='client.323484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:29 smithi007 bash[22722]: cluster 2024-09-14T04:06:28.540018+0000 mgr.a (mgr.14355) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:29 smithi131 bash[24745]: cluster 2024-09-14T04:06:28.540018+0000 mgr.a (mgr.14355) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:29 smithi171 bash[25040]: cluster 2024-09-14T04:06:28.540018+0000 mgr.a (mgr.14355) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:31 smithi007 bash[22722]: cluster 2024-09-14T04:06:30.542211+0000 mgr.a (mgr.14355) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:31 smithi131 bash[24745]: cluster 2024-09-14T04:06:30.542211+0000 mgr.a (mgr.14355) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:31 smithi171 bash[25040]: cluster 2024-09-14T04:06:30.542211+0000 mgr.a (mgr.14355) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:32.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:32.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:33.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:33.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:33.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:33.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:33.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:33 smithi131 bash[24745]: cluster 2024-09-14T04:06:32.542978+0000 mgr.a (mgr.14355) 14947 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:33 smithi171 bash[25040]: cluster 2024-09-14T04:06:32.542978+0000 mgr.a (mgr.14355) 14947 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:33 smithi007 bash[22722]: cluster 2024-09-14T04:06:32.542978+0000 mgr.a (mgr.14355) 14947 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:35.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:34 smithi131 bash[24745]: audit 2024-09-14T04:06:33.101849+0000 mgr.a (mgr.14355) 14948 : audit [DBG] from='client.323559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:34 smithi171 bash[25040]: audit 2024-09-14T04:06:33.101849+0000 mgr.a (mgr.14355) 14948 : audit [DBG] from='client.323559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:34 smithi007 bash[22722]: audit 2024-09-14T04:06:33.101849+0000 mgr.a (mgr.14355) 14948 : audit [DBG] from='client.323559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:35 smithi131 bash[24745]: cluster 2024-09-14T04:06:34.543951+0000 mgr.a (mgr.14355) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:35 smithi171 bash[25040]: cluster 2024-09-14T04:06:34.543951+0000 mgr.a (mgr.14355) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:35 smithi007 bash[22722]: cluster 2024-09-14T04:06:34.543951+0000 mgr.a (mgr.14355) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:37 smithi131 bash[24745]: cluster 2024-09-14T04:06:36.546223+0000 mgr.a (mgr.14355) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:37 smithi171 bash[25040]: cluster 2024-09-14T04:06:36.546223+0000 mgr.a (mgr.14355) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:37 smithi007 bash[22722]: cluster 2024-09-14T04:06:36.546223+0000 mgr.a (mgr.14355) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:38.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:39.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:39.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:39.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:39.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:39.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:39 smithi131 bash[24745]: cluster 2024-09-14T04:06:38.546844+0000 mgr.a (mgr.14355) 14951 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:39 smithi171 bash[25040]: cluster 2024-09-14T04:06:38.546844+0000 mgr.a (mgr.14355) 14951 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:39 smithi007 bash[22722]: cluster 2024-09-14T04:06:38.546844+0000 mgr.a (mgr.14355) 14951 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:40 smithi131 bash[24745]: audit 2024-09-14T04:06:38.864779+0000 mgr.a (mgr.14355) 14952 : audit [DBG] from='client.323637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:40 smithi171 bash[25040]: audit 2024-09-14T04:06:38.864779+0000 mgr.a (mgr.14355) 14952 : audit [DBG] from='client.323637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:40 smithi007 bash[22722]: audit 2024-09-14T04:06:38.864779+0000 mgr.a (mgr.14355) 14952 : audit [DBG] from='client.323637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:41 smithi131 bash[24745]: cluster 2024-09-14T04:06:40.549168+0000 mgr.a (mgr.14355) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:41 smithi171 bash[25040]: cluster 2024-09-14T04:06:40.549168+0000 mgr.a (mgr.14355) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:41 smithi007 bash[22722]: cluster 2024-09-14T04:06:40.549168+0000 mgr.a (mgr.14355) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:43 smithi131 bash[24745]: cluster 2024-09-14T04:06:42.549954+0000 mgr.a (mgr.14355) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:43 smithi171 bash[25040]: cluster 2024-09-14T04:06:42.549954+0000 mgr.a (mgr.14355) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:43 smithi007 bash[22722]: cluster 2024-09-14T04:06:42.549954+0000 mgr.a (mgr.14355) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:44.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:44.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:44.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:45.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:45.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:45.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:45.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:45.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:45 smithi131 bash[24745]: cluster 2024-09-14T04:06:44.550739+0000 mgr.a (mgr.14355) 14955 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:45 smithi131 bash[24745]: audit 2024-09-14T04:06:44.650704+0000 mgr.a (mgr.14355) 14956 : audit [DBG] from='client.323709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:45 smithi171 bash[25040]: cluster 2024-09-14T04:06:44.550739+0000 mgr.a (mgr.14355) 14955 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:45 smithi171 bash[25040]: audit 2024-09-14T04:06:44.650704+0000 mgr.a (mgr.14355) 14956 : audit [DBG] from='client.323709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:45 smithi007 bash[22722]: cluster 2024-09-14T04:06:44.550739+0000 mgr.a (mgr.14355) 14955 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:45 smithi007 bash[22722]: audit 2024-09-14T04:06:44.650704+0000 mgr.a (mgr.14355) 14956 : audit [DBG] from='client.323709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:47 smithi131 bash[24745]: cluster 2024-09-14T04:06:46.553126+0000 mgr.a (mgr.14355) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:47 smithi171 bash[25040]: cluster 2024-09-14T04:06:46.553126+0000 mgr.a (mgr.14355) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:47 smithi007 bash[22722]: cluster 2024-09-14T04:06:46.553126+0000 mgr.a (mgr.14355) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:06:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:49 smithi131 bash[24745]: cluster 2024-09-14T04:06:48.553934+0000 mgr.a (mgr.14355) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:49 smithi171 bash[25040]: cluster 2024-09-14T04:06:48.553934+0000 mgr.a (mgr.14355) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:50.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:50.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:49 smithi007 bash[22722]: cluster 2024-09-14T04:06:48.553934+0000 mgr.a (mgr.14355) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:50.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:51 smithi131 bash[24745]: audit 2024-09-14T04:06:50.427115+0000 mgr.a (mgr.14355) 14959 : audit [DBG] from='client.323784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:52.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:51 smithi131 bash[24745]: cluster 2024-09-14T04:06:50.561226+0000 mgr.a (mgr.14355) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:51 smithi171 bash[25040]: audit 2024-09-14T04:06:50.427115+0000 mgr.a (mgr.14355) 14959 : audit [DBG] from='client.323784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:51 smithi171 bash[25040]: cluster 2024-09-14T04:06:50.561226+0000 mgr.a (mgr.14355) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:51 smithi007 bash[22722]: audit 2024-09-14T04:06:50.427115+0000 mgr.a (mgr.14355) 14959 : audit [DBG] from='client.323784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:51 smithi007 bash[22722]: cluster 2024-09-14T04:06:50.561226+0000 mgr.a (mgr.14355) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:53 smithi131 bash[24745]: cluster 2024-09-14T04:06:52.562116+0000 mgr.a (mgr.14355) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:53 smithi171 bash[25040]: cluster 2024-09-14T04:06:52.562116+0000 mgr.a (mgr.14355) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:53 smithi007 bash[22722]: cluster 2024-09-14T04:06:52.562116+0000 mgr.a (mgr.14355) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:55.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:06:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:06:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:06:56.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:55 smithi131 bash[24745]: cluster 2024-09-14T04:06:54.563062+0000 mgr.a (mgr.14355) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:55 smithi171 bash[25040]: cluster 2024-09-14T04:06:54.563062+0000 mgr.a (mgr.14355) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:55 smithi007 bash[22722]: cluster 2024-09-14T04:06:54.563062+0000 mgr.a (mgr.14355) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:06:56.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:06:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:06:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:06:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:06:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:06:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:57 smithi131 bash[24745]: audit 2024-09-14T04:06:56.190443+0000 mgr.a (mgr.14355) 14963 : audit [DBG] from='client.323859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:58.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:57 smithi131 bash[24745]: cluster 2024-09-14T04:06:56.564414+0000 mgr.a (mgr.14355) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:57 smithi171 bash[25040]: audit 2024-09-14T04:06:56.190443+0000 mgr.a (mgr.14355) 14963 : audit [DBG] from='client.323859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:57 smithi171 bash[25040]: cluster 2024-09-14T04:06:56.564414+0000 mgr.a (mgr.14355) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:06:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:57 smithi007 bash[22722]: audit 2024-09-14T04:06:56.190443+0000 mgr.a (mgr.14355) 14963 : audit [DBG] from='client.323859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:06:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:57 smithi007 bash[22722]: cluster 2024-09-14T04:06:56.564414+0000 mgr.a (mgr.14355) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:06:59 smithi131 bash[24745]: cluster 2024-09-14T04:06:58.565185+0000 mgr.a (mgr.14355) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:06:59 smithi171 bash[25040]: cluster 2024-09-14T04:06:58.565185+0000 mgr.a (mgr.14355) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:06:59 smithi007 bash[22722]: cluster 2024-09-14T04:06:58.565185+0000 mgr.a (mgr.14355) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:01.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:01.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:01.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:01 smithi131 bash[24745]: cluster 2024-09-14T04:07:00.567145+0000 mgr.a (mgr.14355) 14966 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:01 smithi171 bash[25040]: cluster 2024-09-14T04:07:00.567145+0000 mgr.a (mgr.14355) 14966 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:01 smithi007 bash[22722]: cluster 2024-09-14T04:07:00.567145+0000 mgr.a (mgr.14355) 14966 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:02.403 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:02.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:02.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:02.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:02.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:03 smithi171 bash[25040]: audit 2024-09-14T04:07:01.968687+0000 mgr.a (mgr.14355) 14967 : audit [DBG] from='client.323937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:03 smithi171 bash[25040]: cluster 2024-09-14T04:07:02.568075+0000 mgr.a (mgr.14355) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:03 smithi007 bash[22722]: audit 2024-09-14T04:07:01.968687+0000 mgr.a (mgr.14355) 14967 : audit [DBG] from='client.323937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:03 smithi007 bash[22722]: cluster 2024-09-14T04:07:02.568075+0000 mgr.a (mgr.14355) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:03 smithi131 bash[24745]: audit 2024-09-14T04:07:01.968687+0000 mgr.a (mgr.14355) 14967 : audit [DBG] from='client.323937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:03 smithi131 bash[24745]: cluster 2024-09-14T04:07:02.568075+0000 mgr.a (mgr.14355) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:05 smithi171 bash[25040]: cluster 2024-09-14T04:07:04.568899+0000 mgr.a (mgr.14355) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:05 smithi007 bash[22722]: cluster 2024-09-14T04:07:04.568899+0000 mgr.a (mgr.14355) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:06.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:05 smithi131 bash[24745]: cluster 2024-09-14T04:07:04.568899+0000 mgr.a (mgr.14355) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:07.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:07.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:07 smithi171 bash[25040]: cluster 2024-09-14T04:07:06.571192+0000 mgr.a (mgr.14355) 14970 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:08.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:07 smithi007 bash[22722]: cluster 2024-09-14T04:07:06.571192+0000 mgr.a (mgr.14355) 14970 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:07 smithi131 bash[24745]: cluster 2024-09-14T04:07:06.571192+0000 mgr.a (mgr.14355) 14970 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:08 smithi007 bash[22722]: audit 2024-09-14T04:07:07.733154+0000 mgr.a (mgr.14355) 14971 : audit [DBG] from='client.324012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:08 smithi007 bash[22722]: audit 2024-09-14T04:07:08.033736+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:07:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:08 smithi131 bash[24745]: audit 2024-09-14T04:07:07.733154+0000 mgr.a (mgr.14355) 14971 : audit [DBG] from='client.324012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:08 smithi131 bash[24745]: audit 2024-09-14T04:07:08.033736+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:07:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:08 smithi171 bash[25040]: audit 2024-09-14T04:07:07.733154+0000 mgr.a (mgr.14355) 14971 : audit [DBG] from='client.324012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:08 smithi171 bash[25040]: audit 2024-09-14T04:07:08.033736+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:07:09.802 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22972]: debug 2024-09-14T04:07:09.542+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:07:09.803 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22972]: debug 2024-09-14T04:07:09.542+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:07:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22722]: cluster 2024-09-14T04:07:08.572162+0000 mgr.a (mgr.14355) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22722]: audit 2024-09-14T04:07:08.811126+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:07:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22722]: audit 2024-09-14T04:07:08.812929+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:07:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22722]: audit 2024-09-14T04:07:08.822709+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:07:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:09 smithi007 bash[22722]: audit 2024-09-14T04:07:08.824991+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:09 smithi131 bash[24745]: cluster 2024-09-14T04:07:08.572162+0000 mgr.a (mgr.14355) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:09 smithi131 bash[24745]: audit 2024-09-14T04:07:08.811126+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:07:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:09 smithi131 bash[24745]: audit 2024-09-14T04:07:08.812929+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:07:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:09 smithi131 bash[24745]: audit 2024-09-14T04:07:08.822709+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:07:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:09 smithi131 bash[24745]: audit 2024-09-14T04:07:08.824991+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:09 smithi171 bash[25040]: cluster 2024-09-14T04:07:08.572162+0000 mgr.a (mgr.14355) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:09 smithi171 bash[25040]: audit 2024-09-14T04:07:08.811126+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:07:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:09 smithi171 bash[25040]: audit 2024-09-14T04:07:08.812929+0000 mon.a (mon.0) 2827 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:07:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:09 smithi171 bash[25040]: audit 2024-09-14T04:07:08.822709+0000 mon.a (mon.0) 2828 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:07:10.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:09 smithi171 bash[25040]: audit 2024-09-14T04:07:08.824991+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:10 smithi007 bash[22722]: audit 2024-09-14T04:07:08.827707+0000 mgr.a (mgr.14355) 14973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:10 smithi007 bash[22722]: audit 2024-09-14T04:07:09.546741+0000 mgr.a (mgr.14355) 14974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:07:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:10 smithi007 bash[22722]: cephadm 2024-09-14T04:07:09.548053+0000 mgr.a (mgr.14355) 14975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:07:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:10 smithi131 bash[24745]: audit 2024-09-14T04:07:08.827707+0000 mgr.a (mgr.14355) 14973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:10 smithi131 bash[24745]: audit 2024-09-14T04:07:09.546741+0000 mgr.a (mgr.14355) 14974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:07:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:10 smithi131 bash[24745]: cephadm 2024-09-14T04:07:09.548053+0000 mgr.a (mgr.14355) 14975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:07:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:10 smithi171 bash[25040]: audit 2024-09-14T04:07:08.827707+0000 mgr.a (mgr.14355) 14973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:07:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:10 smithi171 bash[25040]: audit 2024-09-14T04:07:09.546741+0000 mgr.a (mgr.14355) 14974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:07:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:10 smithi171 bash[25040]: cephadm 2024-09-14T04:07:09.548053+0000 mgr.a (mgr.14355) 14975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:07:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:11 smithi007 bash[22722]: cluster 2024-09-14T04:07:10.574469+0000 mgr.a (mgr.14355) 14976 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:11 smithi131 bash[24745]: cluster 2024-09-14T04:07:10.574469+0000 mgr.a (mgr.14355) 14976 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:11 smithi171 bash[25040]: cluster 2024-09-14T04:07:10.574469+0000 mgr.a (mgr.14355) 14976 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:13.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:13.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:13.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:13.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:13.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:13.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:13.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:13.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:13 smithi007 bash[22722]: cluster 2024-09-14T04:07:12.575250+0000 mgr.a (mgr.14355) 14977 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:13 smithi131 bash[24745]: cluster 2024-09-14T04:07:12.575250+0000 mgr.a (mgr.14355) 14977 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:13 smithi171 bash[25040]: cluster 2024-09-14T04:07:12.575250+0000 mgr.a (mgr.14355) 14977 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:14 smithi007 bash[22722]: audit 2024-09-14T04:07:13.497863+0000 mgr.a (mgr.14355) 14978 : audit [DBG] from='client.324192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:14 smithi131 bash[24745]: audit 2024-09-14T04:07:13.497863+0000 mgr.a (mgr.14355) 14978 : audit [DBG] from='client.324192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:14 smithi171 bash[25040]: audit 2024-09-14T04:07:13.497863+0000 mgr.a (mgr.14355) 14978 : audit [DBG] from='client.324192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:15 smithi007 bash[22722]: cluster 2024-09-14T04:07:14.576259+0000 mgr.a (mgr.14355) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:15 smithi131 bash[24745]: cluster 2024-09-14T04:07:14.576259+0000 mgr.a (mgr.14355) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:15 smithi171 bash[25040]: cluster 2024-09-14T04:07:14.576259+0000 mgr.a (mgr.14355) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:16 smithi007 bash[22722]: cluster 2024-09-14T04:07:16.578653+0000 mgr.a (mgr.14355) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:16 smithi131 bash[24745]: cluster 2024-09-14T04:07:16.578653+0000 mgr.a (mgr.14355) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:16 smithi171 bash[25040]: cluster 2024-09-14T04:07:16.578653+0000 mgr.a (mgr.14355) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:18.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:18.934 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:18.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:19.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:19.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:19.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:19.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:19.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:19 smithi007 bash[22722]: cluster 2024-09-14T04:07:18.579442+0000 mgr.a (mgr.14355) 14981 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:19 smithi131 bash[24745]: cluster 2024-09-14T04:07:18.579442+0000 mgr.a (mgr.14355) 14981 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:19 smithi171 bash[25040]: cluster 2024-09-14T04:07:18.579442+0000 mgr.a (mgr.14355) 14981 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:20 smithi007 bash[22722]: audit 2024-09-14T04:07:19.267676+0000 mgr.a (mgr.14355) 14982 : audit [DBG] from='client.324270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:20 smithi131 bash[24745]: audit 2024-09-14T04:07:19.267676+0000 mgr.a (mgr.14355) 14982 : audit [DBG] from='client.324270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:20 smithi171 bash[25040]: audit 2024-09-14T04:07:19.267676+0000 mgr.a (mgr.14355) 14982 : audit [DBG] from='client.324270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:21 smithi007 bash[22722]: cluster 2024-09-14T04:07:20.581882+0000 mgr.a (mgr.14355) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:21 smithi131 bash[24745]: cluster 2024-09-14T04:07:20.581882+0000 mgr.a (mgr.14355) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:21 smithi171 bash[25040]: cluster 2024-09-14T04:07:20.581882+0000 mgr.a (mgr.14355) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:07:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:23 smithi007 bash[22722]: cluster 2024-09-14T04:07:22.582884+0000 mgr.a (mgr.14355) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:23 smithi131 bash[24745]: cluster 2024-09-14T04:07:22.582884+0000 mgr.a (mgr.14355) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:23 smithi171 bash[25040]: cluster 2024-09-14T04:07:22.582884+0000 mgr.a (mgr.14355) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:24.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:24.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:24.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:25.489 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:25.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:25 smithi007 bash[22722]: cluster 2024-09-14T04:07:24.583855+0000 mgr.a (mgr.14355) 14985 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:25 smithi131 bash[24745]: cluster 2024-09-14T04:07:24.583855+0000 mgr.a (mgr.14355) 14985 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:25 smithi171 bash[25040]: cluster 2024-09-14T04:07:24.583855+0000 mgr.a (mgr.14355) 14985 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:26 smithi007 bash[22722]: audit 2024-09-14T04:07:25.051671+0000 mgr.a (mgr.14355) 14986 : audit [DBG] from='client.324348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:26 smithi131 bash[24745]: audit 2024-09-14T04:07:25.051671+0000 mgr.a (mgr.14355) 14986 : audit [DBG] from='client.324348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:26 smithi171 bash[25040]: audit 2024-09-14T04:07:25.051671+0000 mgr.a (mgr.14355) 14986 : audit [DBG] from='client.324348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:27 smithi007 bash[22722]: cluster 2024-09-14T04:07:26.586693+0000 mgr.a (mgr.14355) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:27 smithi131 bash[24745]: cluster 2024-09-14T04:07:26.586693+0000 mgr.a (mgr.14355) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:27 smithi171 bash[25040]: cluster 2024-09-14T04:07:26.586693+0000 mgr.a (mgr.14355) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:29 smithi007 bash[22722]: cluster 2024-09-14T04:07:28.587487+0000 mgr.a (mgr.14355) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:29 smithi131 bash[24745]: cluster 2024-09-14T04:07:28.587487+0000 mgr.a (mgr.14355) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:29 smithi171 bash[25040]: cluster 2024-09-14T04:07:28.587487+0000 mgr.a (mgr.14355) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:30.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:30.491 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:31.241 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:31.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:31 smithi007 bash[22722]: cluster 2024-09-14T04:07:30.588660+0000 mgr.a (mgr.14355) 14989 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:31 smithi007 bash[22722]: audit 2024-09-14T04:07:30.820484+0000 mgr.a (mgr.14355) 14990 : audit [DBG] from='client.324426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:31 smithi131 bash[24745]: cluster 2024-09-14T04:07:30.588660+0000 mgr.a (mgr.14355) 14989 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:32.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:31 smithi131 bash[24745]: audit 2024-09-14T04:07:30.820484+0000 mgr.a (mgr.14355) 14990 : audit [DBG] from='client.324426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:31 smithi171 bash[25040]: cluster 2024-09-14T04:07:30.588660+0000 mgr.a (mgr.14355) 14989 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:31 smithi171 bash[25040]: audit 2024-09-14T04:07:30.820484+0000 mgr.a (mgr.14355) 14990 : audit [DBG] from='client.324426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:33 smithi007 bash[22722]: cluster 2024-09-14T04:07:32.589678+0000 mgr.a (mgr.14355) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:33 smithi131 bash[24745]: cluster 2024-09-14T04:07:32.589678+0000 mgr.a (mgr.14355) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:33 smithi171 bash[25040]: cluster 2024-09-14T04:07:32.589678+0000 mgr.a (mgr.14355) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:07:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:35 smithi007 bash[22722]: cluster 2024-09-14T04:07:34.590684+0000 mgr.a (mgr.14355) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:07:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:35 smithi131 bash[24745]: cluster 2024-09-14T04:07:34.590684+0000 mgr.a (mgr.14355) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:07:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:35 smithi171 bash[25040]: cluster 2024-09-14T04:07:34.590684+0000 mgr.a (mgr.14355) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:07:36.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:36.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:36.244 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:37.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:37.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:37.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:37 smithi007 bash[22722]: audit 2024-09-14T04:07:36.586001+0000 mgr.a (mgr.14355) 14993 : audit [DBG] from='client.324504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:37 smithi007 bash[22722]: cluster 2024-09-14T04:07:36.600096+0000 mgr.a (mgr.14355) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:37 smithi131 bash[24745]: audit 2024-09-14T04:07:36.586001+0000 mgr.a (mgr.14355) 14993 : audit [DBG] from='client.324504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:38.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:37 smithi131 bash[24745]: cluster 2024-09-14T04:07:36.600096+0000 mgr.a (mgr.14355) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:37 smithi171 bash[25040]: audit 2024-09-14T04:07:36.586001+0000 mgr.a (mgr.14355) 14993 : audit [DBG] from='client.324504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:37 smithi171 bash[25040]: cluster 2024-09-14T04:07:36.600096+0000 mgr.a (mgr.14355) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:39 smithi007 bash[22722]: cluster 2024-09-14T04:07:38.601118+0000 mgr.a (mgr.14355) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:39 smithi131 bash[24745]: cluster 2024-09-14T04:07:38.601118+0000 mgr.a (mgr.14355) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:39 smithi171 bash[25040]: cluster 2024-09-14T04:07:38.601118+0000 mgr.a (mgr.14355) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:42.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:41 smithi131 bash[24745]: cluster 2024-09-14T04:07:40.603313+0000 mgr.a (mgr.14355) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:41 smithi171 bash[25040]: cluster 2024-09-14T04:07:40.603313+0000 mgr.a (mgr.14355) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:41 smithi007 bash[22722]: cluster 2024-09-14T04:07:40.603313+0000 mgr.a (mgr.14355) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:42.801 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:43 smithi131 bash[24745]: audit 2024-09-14T04:07:42.354484+0000 mgr.a (mgr.14355) 14997 : audit [DBG] from='client.324576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:44.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:43 smithi131 bash[24745]: cluster 2024-09-14T04:07:42.603892+0000 mgr.a (mgr.14355) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:43 smithi171 bash[25040]: audit 2024-09-14T04:07:42.354484+0000 mgr.a (mgr.14355) 14997 : audit [DBG] from='client.324576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:43 smithi171 bash[25040]: cluster 2024-09-14T04:07:42.603892+0000 mgr.a (mgr.14355) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:43 smithi007 bash[22722]: audit 2024-09-14T04:07:42.354484+0000 mgr.a (mgr.14355) 14997 : audit [DBG] from='client.324576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:43 smithi007 bash[22722]: cluster 2024-09-14T04:07:42.603892+0000 mgr.a (mgr.14355) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:45 smithi131 bash[24745]: cluster 2024-09-14T04:07:44.604759+0000 mgr.a (mgr.14355) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:45 smithi171 bash[25040]: cluster 2024-09-14T04:07:44.604759+0000 mgr.a (mgr.14355) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:45 smithi007 bash[22722]: cluster 2024-09-14T04:07:44.604759+0000 mgr.a (mgr.14355) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:47 smithi131 bash[24745]: cluster 2024-09-14T04:07:46.607048+0000 mgr.a (mgr.14355) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:47 smithi171 bash[25040]: cluster 2024-09-14T04:07:46.607048+0000 mgr.a (mgr.14355) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:47 smithi007 bash[22722]: cluster 2024-09-14T04:07:46.607048+0000 mgr.a (mgr.14355) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:48.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:48.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:48.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:48.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:48.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:49 smithi131 bash[24745]: audit 2024-09-14T04:07:48.138778+0000 mgr.a (mgr.14355) 15001 : audit [DBG] from='client.324654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:49 smithi131 bash[24745]: cluster 2024-09-14T04:07:48.607751+0000 mgr.a (mgr.14355) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:49 smithi171 bash[25040]: audit 2024-09-14T04:07:48.138778+0000 mgr.a (mgr.14355) 15001 : audit [DBG] from='client.324654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:49 smithi171 bash[25040]: cluster 2024-09-14T04:07:48.607751+0000 mgr.a (mgr.14355) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:49 smithi007 bash[22722]: audit 2024-09-14T04:07:48.138778+0000 mgr.a (mgr.14355) 15001 : audit [DBG] from='client.324654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:49 smithi007 bash[22722]: cluster 2024-09-14T04:07:48.607751+0000 mgr.a (mgr.14355) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:51 smithi131 bash[24745]: cluster 2024-09-14T04:07:50.609870+0000 mgr.a (mgr.14355) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:51 smithi171 bash[25040]: cluster 2024-09-14T04:07:50.609870+0000 mgr.a (mgr.14355) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:51 smithi007 bash[22722]: cluster 2024-09-14T04:07:50.609870+0000 mgr.a (mgr.14355) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:53.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:53.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:07:54.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:53 smithi131 bash[24745]: cluster 2024-09-14T04:07:52.610794+0000 mgr.a (mgr.14355) 15004 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:53 smithi171 bash[25040]: cluster 2024-09-14T04:07:52.610794+0000 mgr.a (mgr.14355) 15004 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:53 smithi007 bash[22722]: cluster 2024-09-14T04:07:52.610794+0000 mgr.a (mgr.14355) 15004 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:54.310 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:07:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:07:54.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:07:54.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:07:54.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:07:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:55 smithi131 bash[24745]: audit 2024-09-14T04:07:53.890046+0000 mgr.a (mgr.14355) 15005 : audit [DBG] from='client.324732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:56.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:55 smithi131 bash[24745]: cluster 2024-09-14T04:07:54.611691+0000 mgr.a (mgr.14355) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:55 smithi171 bash[25040]: audit 2024-09-14T04:07:53.890046+0000 mgr.a (mgr.14355) 15005 : audit [DBG] from='client.324732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:55 smithi171 bash[25040]: cluster 2024-09-14T04:07:54.611691+0000 mgr.a (mgr.14355) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:55 smithi007 bash[22722]: audit 2024-09-14T04:07:53.890046+0000 mgr.a (mgr.14355) 15005 : audit [DBG] from='client.324732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:07:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:55 smithi007 bash[22722]: cluster 2024-09-14T04:07:54.611691+0000 mgr.a (mgr.14355) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:07:58.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:57 smithi131 bash[24745]: cluster 2024-09-14T04:07:56.613940+0000 mgr.a (mgr.14355) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:58.073 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:57 smithi171 bash[25040]: cluster 2024-09-14T04:07:56.613940+0000 mgr.a (mgr.14355) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:57 smithi007 bash[22722]: cluster 2024-09-14T04:07:56.613940+0000 mgr.a (mgr.14355) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:07:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:07:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:07:59.312 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:07:59 smithi131 bash[24745]: cluster 2024-09-14T04:07:58.614733+0000 mgr.a (mgr.14355) 15008 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:07:59 smithi171 bash[25040]: cluster 2024-09-14T04:07:58.614733+0000 mgr.a (mgr.14355) 15008 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:00.056 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:00.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:07:59 smithi007 bash[22722]: cluster 2024-09-14T04:07:58.614733+0000 mgr.a (mgr.14355) 15008 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:00 smithi131 bash[24745]: audit 2024-09-14T04:07:59.637823+0000 mgr.a (mgr.14355) 15009 : audit [DBG] from='client.324804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:00 smithi171 bash[25040]: audit 2024-09-14T04:07:59.637823+0000 mgr.a (mgr.14355) 15009 : audit [DBG] from='client.324804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:00 smithi007 bash[22722]: audit 2024-09-14T04:07:59.637823+0000 mgr.a (mgr.14355) 15009 : audit [DBG] from='client.324804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:01 smithi131 bash[24745]: cluster 2024-09-14T04:08:00.617071+0000 mgr.a (mgr.14355) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:01 smithi171 bash[25040]: cluster 2024-09-14T04:08:00.617071+0000 mgr.a (mgr.14355) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:01 smithi007 bash[22722]: cluster 2024-09-14T04:08:00.617071+0000 mgr.a (mgr.14355) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:03 smithi131 bash[24745]: cluster 2024-09-14T04:08:02.617818+0000 mgr.a (mgr.14355) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:03 smithi171 bash[25040]: cluster 2024-09-14T04:08:02.617818+0000 mgr.a (mgr.14355) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:03 smithi007 bash[22722]: cluster 2024-09-14T04:08:02.617818+0000 mgr.a (mgr.14355) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:05.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:05.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:05.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:05.833 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:05.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:05.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:05.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:05 smithi131 bash[24745]: cluster 2024-09-14T04:08:04.618623+0000 mgr.a (mgr.14355) 15012 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:05 smithi171 bash[25040]: cluster 2024-09-14T04:08:04.618623+0000 mgr.a (mgr.14355) 15012 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:05 smithi007 bash[22722]: cluster 2024-09-14T04:08:04.618623+0000 mgr.a (mgr.14355) 15012 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:06 smithi131 bash[24745]: audit 2024-09-14T04:08:05.390474+0000 mgr.a (mgr.14355) 15013 : audit [DBG] from='client.324882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:06 smithi171 bash[25040]: audit 2024-09-14T04:08:05.390474+0000 mgr.a (mgr.14355) 15013 : audit [DBG] from='client.324882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:06 smithi007 bash[22722]: audit 2024-09-14T04:08:05.390474+0000 mgr.a (mgr.14355) 15013 : audit [DBG] from='client.324882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:07 smithi131 bash[24745]: cluster 2024-09-14T04:08:06.621415+0000 mgr.a (mgr.14355) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:07 smithi171 bash[25040]: cluster 2024-09-14T04:08:06.621415+0000 mgr.a (mgr.14355) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:07 smithi007 bash[22722]: cluster 2024-09-14T04:08:06.621415+0000 mgr.a (mgr.14355) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:09 smithi131 bash[24745]: cluster 2024-09-14T04:08:08.622184+0000 mgr.a (mgr.14355) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:10.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:09 smithi131 bash[24745]: audit 2024-09-14T04:08:09.597344+0000 mon.a (mon.0) 2830 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:08:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:09 smithi171 bash[25040]: cluster 2024-09-14T04:08:08.622184+0000 mgr.a (mgr.14355) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:09 smithi171 bash[25040]: audit 2024-09-14T04:08:09.597344+0000 mon.a (mon.0) 2830 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:08:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:09 smithi007 bash[22722]: cluster 2024-09-14T04:08:08.622184+0000 mgr.a (mgr.14355) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:09 smithi007 bash[22722]: audit 2024-09-14T04:08:09.597344+0000 mon.a (mon.0) 2830 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:08:10.835 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:10.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:10.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:11.585 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:11.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:11 smithi171 bash[25040]: cluster 2024-09-14T04:08:10.624142+0000 mgr.a (mgr.14355) 15016 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:11 smithi007 bash[22722]: cluster 2024-09-14T04:08:10.624142+0000 mgr.a (mgr.14355) 15016 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:11 smithi131 bash[24745]: cluster 2024-09-14T04:08:10.624142+0000 mgr.a (mgr.14355) 15016 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:12 smithi171 bash[25040]: audit 2024-09-14T04:08:11.171826+0000 mgr.a (mgr.14355) 15017 : audit [DBG] from='client.324960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:12 smithi007 bash[22722]: audit 2024-09-14T04:08:11.171826+0000 mgr.a (mgr.14355) 15017 : audit [DBG] from='client.324960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:12 smithi131 bash[24745]: audit 2024-09-14T04:08:11.171826+0000 mgr.a (mgr.14355) 15017 : audit [DBG] from='client.324960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:13 smithi007 bash[22722]: cluster 2024-09-14T04:08:12.625030+0000 mgr.a (mgr.14355) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:13 smithi131 bash[24745]: cluster 2024-09-14T04:08:12.625030+0000 mgr.a (mgr.14355) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:13 smithi171 bash[25040]: cluster 2024-09-14T04:08:12.625030+0000 mgr.a (mgr.14355) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: cluster 2024-09-14T04:08:14.625806+0000 mgr.a (mgr.14355) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.947758+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.952177+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.963202+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.967110+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.973678+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:14.978381+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:15.691509+0000 mon.a (mon.0) 2837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:15.693563+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:15.704257+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:15 smithi007 bash[22722]: audit 2024-09-14T04:08:15.709207+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: cluster 2024-09-14T04:08:14.625806+0000 mgr.a (mgr.14355) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:08:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.947758+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.952177+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.963202+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.967110+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.973678+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:14.978381+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:15.691509+0000 mon.a (mon.0) 2837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:08:16.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:15.693563+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:08:16.286 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:15.704257+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.286 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:15 smithi131 bash[24745]: audit 2024-09-14T04:08:15.709207+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: cluster 2024-09-14T04:08:14.625806+0000 mgr.a (mgr.14355) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.947758+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.952177+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.963202+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.967110+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.973678+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:14.978381+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:15.691509+0000 mon.a (mon.0) 2837 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:08:16.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:15.693563+0000 mon.a (mon.0) 2838 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:08:16.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:15.704257+0000 mon.a (mon.0) 2839 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:08:16.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:15 smithi171 bash[25040]: audit 2024-09-14T04:08:15.709207+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:16.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:16.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:16.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:16.801 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:08:16 smithi007 bash[22972]: debug 2024-09-14T04:08:16.465+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:08:16.802 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:08:16 smithi007 bash[22972]: debug 2024-09-14T04:08:16.465+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:08:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:16 smithi007 bash[22722]: audit 2024-09-14T04:08:15.710647+0000 mgr.a (mgr.14355) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:16 smithi131 bash[24745]: audit 2024-09-14T04:08:15.710647+0000 mgr.a (mgr.14355) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:16 smithi171 bash[25040]: audit 2024-09-14T04:08:15.710647+0000 mgr.a (mgr.14355) 15020 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:08:17.356 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:17.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:17 smithi007 bash[22722]: audit 2024-09-14T04:08:16.466930+0000 mgr.a (mgr.14355) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:08:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:17 smithi007 bash[22722]: cephadm 2024-09-14T04:08:16.468445+0000 mgr.a (mgr.14355) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:08:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:17 smithi007 bash[22722]: cluster 2024-09-14T04:08:16.627532+0000 mgr.a (mgr.14355) 15023 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:17 smithi131 bash[24745]: audit 2024-09-14T04:08:16.466930+0000 mgr.a (mgr.14355) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:08:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:17 smithi131 bash[24745]: cephadm 2024-09-14T04:08:16.468445+0000 mgr.a (mgr.14355) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:08:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:17 smithi131 bash[24745]: cluster 2024-09-14T04:08:16.627532+0000 mgr.a (mgr.14355) 15023 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:17 smithi171 bash[25040]: audit 2024-09-14T04:08:16.466930+0000 mgr.a (mgr.14355) 15021 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:08:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:17 smithi171 bash[25040]: cephadm 2024-09-14T04:08:16.468445+0000 mgr.a (mgr.14355) 15022 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:08:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:17 smithi171 bash[25040]: cluster 2024-09-14T04:08:16.627532+0000 mgr.a (mgr.14355) 15023 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:18 smithi007 bash[22722]: audit 2024-09-14T04:08:16.921374+0000 mgr.a (mgr.14355) 15024 : audit [DBG] from='client.325137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:18 smithi131 bash[24745]: audit 2024-09-14T04:08:16.921374+0000 mgr.a (mgr.14355) 15024 : audit [DBG] from='client.325137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:18 smithi171 bash[25040]: audit 2024-09-14T04:08:16.921374+0000 mgr.a (mgr.14355) 15024 : audit [DBG] from='client.325137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:19 smithi007 bash[22722]: cluster 2024-09-14T04:08:18.628436+0000 mgr.a (mgr.14355) 15025 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:19 smithi131 bash[24745]: cluster 2024-09-14T04:08:18.628436+0000 mgr.a (mgr.14355) 15025 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:19 smithi171 bash[25040]: cluster 2024-09-14T04:08:18.628436+0000 mgr.a (mgr.14355) 15025 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:21 smithi007 bash[22722]: cluster 2024-09-14T04:08:20.630607+0000 mgr.a (mgr.14355) 15026 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:21 smithi131 bash[24745]: cluster 2024-09-14T04:08:20.630607+0000 mgr.a (mgr.14355) 15026 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:21 smithi171 bash[25040]: cluster 2024-09-14T04:08:20.630607+0000 mgr.a (mgr.14355) 15026 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:22.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:23.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:23.100 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:23.100 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:23 smithi007 bash[22722]: cluster 2024-09-14T04:08:22.631342+0000 mgr.a (mgr.14355) 15027 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:23 smithi007 bash[22722]: audit 2024-09-14T04:08:22.682397+0000 mgr.a (mgr.14355) 15028 : audit [DBG] from='client.325215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:23 smithi131 bash[24745]: cluster 2024-09-14T04:08:22.631342+0000 mgr.a (mgr.14355) 15027 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:23 smithi131 bash[24745]: audit 2024-09-14T04:08:22.682397+0000 mgr.a (mgr.14355) 15028 : audit [DBG] from='client.325215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:23 smithi171 bash[25040]: cluster 2024-09-14T04:08:22.631342+0000 mgr.a (mgr.14355) 15027 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:23 smithi171 bash[25040]: audit 2024-09-14T04:08:22.682397+0000 mgr.a (mgr.14355) 15028 : audit [DBG] from='client.325215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:25 smithi007 bash[22722]: cluster 2024-09-14T04:08:24.632237+0000 mgr.a (mgr.14355) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:25 smithi131 bash[24745]: cluster 2024-09-14T04:08:24.632237+0000 mgr.a (mgr.14355) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:25 smithi171 bash[25040]: cluster 2024-09-14T04:08:24.632237+0000 mgr.a (mgr.14355) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:28.101 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:27 smithi007 bash[22722]: cluster 2024-09-14T04:08:26.634530+0000 mgr.a (mgr.14355) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:27 smithi131 bash[24745]: cluster 2024-09-14T04:08:26.634530+0000 mgr.a (mgr.14355) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:27 smithi171 bash[25040]: cluster 2024-09-14T04:08:26.634530+0000 mgr.a (mgr.14355) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:28.876 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:28.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:28.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:28.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:28.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:29 smithi007 bash[22722]: audit 2024-09-14T04:08:28.437596+0000 mgr.a (mgr.14355) 15031 : audit [DBG] from='client.325293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:29 smithi007 bash[22722]: cluster 2024-09-14T04:08:28.635084+0000 mgr.a (mgr.14355) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:29 smithi131 bash[24745]: audit 2024-09-14T04:08:28.437596+0000 mgr.a (mgr.14355) 15031 : audit [DBG] from='client.325293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:29 smithi131 bash[24745]: cluster 2024-09-14T04:08:28.635084+0000 mgr.a (mgr.14355) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:29 smithi171 bash[25040]: audit 2024-09-14T04:08:28.437596+0000 mgr.a (mgr.14355) 15031 : audit [DBG] from='client.325293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:29 smithi171 bash[25040]: cluster 2024-09-14T04:08:28.635084+0000 mgr.a (mgr.14355) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:31 smithi007 bash[22722]: cluster 2024-09-14T04:08:30.637445+0000 mgr.a (mgr.14355) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:31 smithi131 bash[24745]: cluster 2024-09-14T04:08:30.637445+0000 mgr.a (mgr.14355) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:31 smithi171 bash[25040]: cluster 2024-09-14T04:08:30.637445+0000 mgr.a (mgr.14355) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:08:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:33.878 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:33 smithi007 bash[22722]: cluster 2024-09-14T04:08:32.638420+0000 mgr.a (mgr.14355) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:33 smithi131 bash[24745]: cluster 2024-09-14T04:08:32.638420+0000 mgr.a (mgr.14355) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:33 smithi171 bash[25040]: cluster 2024-09-14T04:08:32.638420+0000 mgr.a (mgr.14355) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:34.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:34 smithi007 bash[22722]: audit 2024-09-14T04:08:34.207168+0000 mgr.a (mgr.14355) 15035 : audit [DBG] from='client.325368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:34 smithi007 bash[22722]: cluster 2024-09-14T04:08:34.638987+0000 mgr.a (mgr.14355) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:34 smithi131 bash[24745]: audit 2024-09-14T04:08:34.207168+0000 mgr.a (mgr.14355) 15035 : audit [DBG] from='client.325368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:34 smithi131 bash[24745]: cluster 2024-09-14T04:08:34.638987+0000 mgr.a (mgr.14355) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:34 smithi171 bash[25040]: audit 2024-09-14T04:08:34.207168+0000 mgr.a (mgr.14355) 15035 : audit [DBG] from='client.325368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:34 smithi171 bash[25040]: cluster 2024-09-14T04:08:34.638987+0000 mgr.a (mgr.14355) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:37 smithi007 bash[22722]: cluster 2024-09-14T04:08:36.641114+0000 mgr.a (mgr.14355) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:37 smithi131 bash[24745]: cluster 2024-09-14T04:08:36.641114+0000 mgr.a (mgr.14355) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:37 smithi171 bash[25040]: cluster 2024-09-14T04:08:36.641114+0000 mgr.a (mgr.14355) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:08:39.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:39.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:39 smithi007 bash[22722]: cluster 2024-09-14T04:08:38.641878+0000 mgr.a (mgr.14355) 15038 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:39 smithi131 bash[24745]: cluster 2024-09-14T04:08:38.641878+0000 mgr.a (mgr.14355) 15038 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:39 smithi171 bash[25040]: cluster 2024-09-14T04:08:38.641878+0000 mgr.a (mgr.14355) 15038 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:41 smithi131 bash[24745]: audit 2024-09-14T04:08:39.968004+0000 mgr.a (mgr.14355) 15039 : audit [DBG] from='client.325443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:42.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:41 smithi131 bash[24745]: cluster 2024-09-14T04:08:40.644680+0000 mgr.a (mgr.14355) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:08:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:41 smithi171 bash[25040]: audit 2024-09-14T04:08:39.968004+0000 mgr.a (mgr.14355) 15039 : audit [DBG] from='client.325443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:41 smithi171 bash[25040]: cluster 2024-09-14T04:08:40.644680+0000 mgr.a (mgr.14355) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:08:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:41 smithi007 bash[22722]: audit 2024-09-14T04:08:39.968004+0000 mgr.a (mgr.14355) 15039 : audit [DBG] from='client.325443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:41 smithi007 bash[22722]: cluster 2024-09-14T04:08:40.644680+0000 mgr.a (mgr.14355) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:08:44.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:43 smithi131 bash[24745]: cluster 2024-09-14T04:08:42.645434+0000 mgr.a (mgr.14355) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:43 smithi171 bash[25040]: cluster 2024-09-14T04:08:42.645434+0000 mgr.a (mgr.14355) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:43 smithi007 bash[22722]: cluster 2024-09-14T04:08:42.645434+0000 mgr.a (mgr.14355) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:45.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:45 smithi131 bash[24745]: cluster 2024-09-14T04:08:44.646253+0000 mgr.a (mgr.14355) 15042 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:45 smithi171 bash[25040]: cluster 2024-09-14T04:08:44.646253+0000 mgr.a (mgr.14355) 15042 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:46.196 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:46.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:46.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:45 smithi007 bash[22722]: cluster 2024-09-14T04:08:44.646253+0000 mgr.a (mgr.14355) 15042 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:08:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:46 smithi131 bash[24745]: audit 2024-09-14T04:08:45.748110+0000 mgr.a (mgr.14355) 15043 : audit [DBG] from='client.325521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:46 smithi171 bash[25040]: audit 2024-09-14T04:08:45.748110+0000 mgr.a (mgr.14355) 15043 : audit [DBG] from='client.325521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:46 smithi007 bash[22722]: audit 2024-09-14T04:08:45.748110+0000 mgr.a (mgr.14355) 15043 : audit [DBG] from='client.325521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:47 smithi131 bash[24745]: cluster 2024-09-14T04:08:46.649035+0000 mgr.a (mgr.14355) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:47 smithi171 bash[25040]: cluster 2024-09-14T04:08:46.649035+0000 mgr.a (mgr.14355) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:47 smithi007 bash[22722]: cluster 2024-09-14T04:08:46.649035+0000 mgr.a (mgr.14355) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:49 smithi131 bash[24745]: cluster 2024-09-14T04:08:48.649849+0000 mgr.a (mgr.14355) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:49 smithi171 bash[25040]: cluster 2024-09-14T04:08:48.649849+0000 mgr.a (mgr.14355) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:49 smithi007 bash[22722]: cluster 2024-09-14T04:08:48.649849+0000 mgr.a (mgr.14355) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:08:51.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:51.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:51.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:51.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:51.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:51 smithi131 bash[24745]: cluster 2024-09-14T04:08:50.651824+0000 mgr.a (mgr.14355) 15046 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:51 smithi171 bash[25040]: cluster 2024-09-14T04:08:50.651824+0000 mgr.a (mgr.14355) 15046 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:51 smithi007 bash[22722]: cluster 2024-09-14T04:08:50.651824+0000 mgr.a (mgr.14355) 15046 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:08:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:52 smithi131 bash[24745]: audit 2024-09-14T04:08:51.525190+0000 mgr.a (mgr.14355) 15047 : audit [DBG] from='client.325590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:52 smithi171 bash[25040]: audit 2024-09-14T04:08:51.525190+0000 mgr.a (mgr.14355) 15047 : audit [DBG] from='client.325590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:52 smithi007 bash[22722]: audit 2024-09-14T04:08:51.525190+0000 mgr.a (mgr.14355) 15047 : audit [DBG] from='client.325590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:53 smithi131 bash[24745]: cluster 2024-09-14T04:08:52.652703+0000 mgr.a (mgr.14355) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:53 smithi171 bash[25040]: cluster 2024-09-14T04:08:52.652703+0000 mgr.a (mgr.14355) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:53 smithi007 bash[22722]: cluster 2024-09-14T04:08:52.652703+0000 mgr.a (mgr.14355) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:55 smithi131 bash[24745]: cluster 2024-09-14T04:08:54.653468+0000 mgr.a (mgr.14355) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:55 smithi171 bash[25040]: cluster 2024-09-14T04:08:54.653468+0000 mgr.a (mgr.14355) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:55 smithi007 bash[22722]: cluster 2024-09-14T04:08:54.653468+0000 mgr.a (mgr.14355) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:08:56.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:08:56.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:08:56.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:08:57.715 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:08:57.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:08:57.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:08:57.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:08:57.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:08:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:57 smithi131 bash[24745]: cluster 2024-09-14T04:08:56.655684+0000 mgr.a (mgr.14355) 15050 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:08:58.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:57 smithi171 bash[25040]: cluster 2024-09-14T04:08:56.655684+0000 mgr.a (mgr.14355) 15050 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:08:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:57 smithi007 bash[22722]: cluster 2024-09-14T04:08:56.655684+0000 mgr.a (mgr.14355) 15050 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:08:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:58 smithi131 bash[24745]: audit 2024-09-14T04:08:57.295035+0000 mgr.a (mgr.14355) 15051 : audit [DBG] from='client.325668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:58 smithi171 bash[25040]: audit 2024-09-14T04:08:57.295035+0000 mgr.a (mgr.14355) 15051 : audit [DBG] from='client.325668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:08:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:58 smithi007 bash[22722]: audit 2024-09-14T04:08:57.295035+0000 mgr.a (mgr.14355) 15051 : audit [DBG] from='client.325668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:00.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:08:59 smithi131 bash[24745]: cluster 2024-09-14T04:08:58.656661+0000 mgr.a (mgr.14355) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:00.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:08:59 smithi171 bash[25040]: cluster 2024-09-14T04:08:58.656661+0000 mgr.a (mgr.14355) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:08:59 smithi007 bash[22722]: cluster 2024-09-14T04:08:58.656661+0000 mgr.a (mgr.14355) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:01 smithi131 bash[24745]: cluster 2024-09-14T04:09:00.659038+0000 mgr.a (mgr.14355) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:01 smithi171 bash[25040]: cluster 2024-09-14T04:09:00.659038+0000 mgr.a (mgr.14355) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:01 smithi007 bash[22722]: cluster 2024-09-14T04:09:00.659038+0000 mgr.a (mgr.14355) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:02.717 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:02.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:02.718 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:03.466 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:03 smithi131 bash[24745]: cluster 2024-09-14T04:09:02.659993+0000 mgr.a (mgr.14355) 15054 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:03 smithi171 bash[25040]: cluster 2024-09-14T04:09:02.659993+0000 mgr.a (mgr.14355) 15054 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:03 smithi007 bash[22722]: cluster 2024-09-14T04:09:02.659993+0000 mgr.a (mgr.14355) 15054 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:04 smithi131 bash[24745]: audit 2024-09-14T04:09:03.047030+0000 mgr.a (mgr.14355) 15055 : audit [DBG] from='client.325746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:04 smithi171 bash[25040]: audit 2024-09-14T04:09:03.047030+0000 mgr.a (mgr.14355) 15055 : audit [DBG] from='client.325746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:04 smithi007 bash[22722]: audit 2024-09-14T04:09:03.047030+0000 mgr.a (mgr.14355) 15055 : audit [DBG] from='client.325746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:05 smithi171 bash[25040]: cluster 2024-09-14T04:09:04.660902+0000 mgr.a (mgr.14355) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:05 smithi007 bash[22722]: cluster 2024-09-14T04:09:04.660902+0000 mgr.a (mgr.14355) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:05 smithi131 bash[24745]: cluster 2024-09-14T04:09:04.660902+0000 mgr.a (mgr.14355) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:08.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:07 smithi171 bash[25040]: cluster 2024-09-14T04:09:06.663207+0000 mgr.a (mgr.14355) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:07 smithi007 bash[22722]: cluster 2024-09-14T04:09:06.663207+0000 mgr.a (mgr.14355) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:07 smithi131 bash[24745]: cluster 2024-09-14T04:09:06.663207+0000 mgr.a (mgr.14355) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:08.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:08.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:08.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:09.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:09.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:09.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:09.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:09.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:09 smithi171 bash[25040]: cluster 2024-09-14T04:09:08.663770+0000 mgr.a (mgr.14355) 15058 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:10.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:09 smithi171 bash[25040]: audit 2024-09-14T04:09:08.803832+0000 mgr.a (mgr.14355) 15059 : audit [DBG] from='client.325824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:09 smithi007 bash[22722]: cluster 2024-09-14T04:09:08.663770+0000 mgr.a (mgr.14355) 15058 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:09 smithi007 bash[22722]: audit 2024-09-14T04:09:08.803832+0000 mgr.a (mgr.14355) 15059 : audit [DBG] from='client.325824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:09 smithi131 bash[24745]: cluster 2024-09-14T04:09:08.663770+0000 mgr.a (mgr.14355) 15058 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:09 smithi131 bash[24745]: audit 2024-09-14T04:09:08.803832+0000 mgr.a (mgr.14355) 15059 : audit [DBG] from='client.325824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:11 smithi007 bash[22722]: cluster 2024-09-14T04:09:10.665984+0000 mgr.a (mgr.14355) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:11 smithi131 bash[24745]: cluster 2024-09-14T04:09:10.665984+0000 mgr.a (mgr.14355) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:11 smithi171 bash[25040]: cluster 2024-09-14T04:09:10.665984+0000 mgr.a (mgr.14355) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:13 smithi007 bash[22722]: cluster 2024-09-14T04:09:12.666764+0000 mgr.a (mgr.14355) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:14.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:14.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:14.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:13 smithi131 bash[24745]: cluster 2024-09-14T04:09:12.666764+0000 mgr.a (mgr.14355) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:13 smithi171 bash[25040]: cluster 2024-09-14T04:09:12.666764+0000 mgr.a (mgr.14355) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:14.998 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:14.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:14.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:14.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:15 smithi007 bash[22722]: audit 2024-09-14T04:09:14.564544+0000 mgr.a (mgr.14355) 15062 : audit [DBG] from='client.325902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:15 smithi007 bash[22722]: cluster 2024-09-14T04:09:14.667283+0000 mgr.a (mgr.14355) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:15 smithi131 bash[24745]: audit 2024-09-14T04:09:14.564544+0000 mgr.a (mgr.14355) 15062 : audit [DBG] from='client.325902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:15 smithi131 bash[24745]: cluster 2024-09-14T04:09:14.667283+0000 mgr.a (mgr.14355) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:15 smithi171 bash[25040]: audit 2024-09-14T04:09:14.564544+0000 mgr.a (mgr.14355) 15062 : audit [DBG] from='client.325902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:15 smithi171 bash[25040]: cluster 2024-09-14T04:09:14.667283+0000 mgr.a (mgr.14355) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:16 smithi007 bash[22722]: audit 2024-09-14T04:09:16.523025+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:09:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:16 smithi131 bash[24745]: audit 2024-09-14T04:09:16.523025+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:09:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:16 smithi171 bash[25040]: audit 2024-09-14T04:09:16.523025+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:09:18.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:17 smithi007 bash[22722]: cluster 2024-09-14T04:09:16.669626+0000 mgr.a (mgr.14355) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:18.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:17 smithi007 bash[22722]: audit 2024-09-14T04:09:17.395238+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:09:18.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:17 smithi007 bash[22722]: audit 2024-09-14T04:09:17.396617+0000 mon.a (mon.0) 2843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:09:18.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:17 smithi007 bash[22722]: audit 2024-09-14T04:09:17.405721+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:09:18.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:17 smithi007 bash[22722]: audit 2024-09-14T04:09:17.411172+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:17 smithi131 bash[24745]: cluster 2024-09-14T04:09:16.669626+0000 mgr.a (mgr.14355) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:17 smithi131 bash[24745]: audit 2024-09-14T04:09:17.395238+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:09:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:17 smithi131 bash[24745]: audit 2024-09-14T04:09:17.396617+0000 mon.a (mon.0) 2843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:09:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:17 smithi131 bash[24745]: audit 2024-09-14T04:09:17.405721+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:09:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:17 smithi131 bash[24745]: audit 2024-09-14T04:09:17.411172+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:17 smithi171 bash[25040]: cluster 2024-09-14T04:09:16.669626+0000 mgr.a (mgr.14355) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:17 smithi171 bash[25040]: audit 2024-09-14T04:09:17.395238+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:09:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:17 smithi171 bash[25040]: audit 2024-09-14T04:09:17.396617+0000 mon.a (mon.0) 2843 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:09:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:17 smithi171 bash[25040]: audit 2024-09-14T04:09:17.405721+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:09:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:17 smithi171 bash[25040]: audit 2024-09-14T04:09:17.411172+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:18.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:09:18 smithi007 bash[22972]: debug 2024-09-14T04:09:18.140+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:09:18.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:09:18 smithi007 bash[22972]: debug 2024-09-14T04:09:18.144+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:09:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:18 smithi007 bash[22722]: audit 2024-09-14T04:09:17.413512+0000 mgr.a (mgr.14355) 15065 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:18 smithi131 bash[24745]: audit 2024-09-14T04:09:17.413512+0000 mgr.a (mgr.14355) 15065 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:18 smithi171 bash[25040]: audit 2024-09-14T04:09:17.413512+0000 mgr.a (mgr.14355) 15065 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:09:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:19 smithi007 bash[22722]: audit 2024-09-14T04:09:18.146094+0000 mgr.a (mgr.14355) 15066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:09:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:19 smithi007 bash[22722]: cephadm 2024-09-14T04:09:18.147315+0000 mgr.a (mgr.14355) 15067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:09:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:19 smithi007 bash[22722]: cluster 2024-09-14T04:09:18.670525+0000 mgr.a (mgr.14355) 15068 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:19 smithi131 bash[24745]: audit 2024-09-14T04:09:18.146094+0000 mgr.a (mgr.14355) 15066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:09:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:19 smithi131 bash[24745]: cephadm 2024-09-14T04:09:18.147315+0000 mgr.a (mgr.14355) 15067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:09:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:19 smithi131 bash[24745]: cluster 2024-09-14T04:09:18.670525+0000 mgr.a (mgr.14355) 15068 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:19 smithi171 bash[25040]: audit 2024-09-14T04:09:18.146094+0000 mgr.a (mgr.14355) 15066 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:09:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:19 smithi171 bash[25040]: cephadm 2024-09-14T04:09:18.147315+0000 mgr.a (mgr.14355) 15067 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:09:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:19 smithi171 bash[25040]: cluster 2024-09-14T04:09:18.670525+0000 mgr.a (mgr.14355) 15068 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:20.792 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:20.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:20.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:20.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:20.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:21 smithi007 bash[22722]: audit 2024-09-14T04:09:20.339323+0000 mgr.a (mgr.14355) 15069 : audit [DBG] from='client.326085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:21 smithi007 bash[22722]: cluster 2024-09-14T04:09:20.671853+0000 mgr.a (mgr.14355) 15070 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:21 smithi131 bash[24745]: audit 2024-09-14T04:09:20.339323+0000 mgr.a (mgr.14355) 15069 : audit [DBG] from='client.326085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:21 smithi131 bash[24745]: cluster 2024-09-14T04:09:20.671853+0000 mgr.a (mgr.14355) 15070 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:21 smithi171 bash[25040]: audit 2024-09-14T04:09:20.339323+0000 mgr.a (mgr.14355) 15069 : audit [DBG] from='client.326085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:21 smithi171 bash[25040]: cluster 2024-09-14T04:09:20.671853+0000 mgr.a (mgr.14355) 15070 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:23 smithi007 bash[22722]: cluster 2024-09-14T04:09:22.672763+0000 mgr.a (mgr.14355) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:23 smithi131 bash[24745]: cluster 2024-09-14T04:09:22.672763+0000 mgr.a (mgr.14355) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:23 smithi171 bash[25040]: cluster 2024-09-14T04:09:22.672763+0000 mgr.a (mgr.14355) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:25 smithi007 bash[22722]: cluster 2024-09-14T04:09:24.673560+0000 mgr.a (mgr.14355) 15072 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:25 smithi131 bash[24745]: cluster 2024-09-14T04:09:24.673560+0000 mgr.a (mgr.14355) 15072 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:25 smithi171 bash[25040]: cluster 2024-09-14T04:09:24.673560+0000 mgr.a (mgr.14355) 15072 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:26.559 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:26.560 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:27 smithi007 bash[22722]: audit 2024-09-14T04:09:26.126825+0000 mgr.a (mgr.14355) 15073 : audit [DBG] from='client.326160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:27 smithi007 bash[22722]: cluster 2024-09-14T04:09:26.676371+0000 mgr.a (mgr.14355) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:27 smithi131 bash[24745]: audit 2024-09-14T04:09:26.126825+0000 mgr.a (mgr.14355) 15073 : audit [DBG] from='client.326160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:27 smithi131 bash[24745]: cluster 2024-09-14T04:09:26.676371+0000 mgr.a (mgr.14355) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:27 smithi171 bash[25040]: audit 2024-09-14T04:09:26.126825+0000 mgr.a (mgr.14355) 15073 : audit [DBG] from='client.326160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:27 smithi171 bash[25040]: cluster 2024-09-14T04:09:26.676371+0000 mgr.a (mgr.14355) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:29 smithi007 bash[22722]: cluster 2024-09-14T04:09:28.677154+0000 mgr.a (mgr.14355) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:29 smithi131 bash[24745]: cluster 2024-09-14T04:09:28.677154+0000 mgr.a (mgr.14355) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:29 smithi171 bash[25040]: cluster 2024-09-14T04:09:28.677154+0000 mgr.a (mgr.14355) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:09:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:31 smithi007 bash[22722]: cluster 2024-09-14T04:09:30.679080+0000 mgr.a (mgr.14355) 15076 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:31 smithi131 bash[24745]: cluster 2024-09-14T04:09:30.679080+0000 mgr.a (mgr.14355) 15076 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:31 smithi171 bash[25040]: cluster 2024-09-14T04:09:30.679080+0000 mgr.a (mgr.14355) 15076 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:09:32.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:32.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:33 smithi007 bash[22722]: audit 2024-09-14T04:09:31.891141+0000 mgr.a (mgr.14355) 15077 : audit [DBG] from='client.326238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:33 smithi007 bash[22722]: cluster 2024-09-14T04:09:32.680018+0000 mgr.a (mgr.14355) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:33 smithi131 bash[24745]: audit 2024-09-14T04:09:31.891141+0000 mgr.a (mgr.14355) 15077 : audit [DBG] from='client.326238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:33 smithi131 bash[24745]: cluster 2024-09-14T04:09:32.680018+0000 mgr.a (mgr.14355) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:33 smithi171 bash[25040]: audit 2024-09-14T04:09:31.891141+0000 mgr.a (mgr.14355) 15077 : audit [DBG] from='client.326238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:33 smithi171 bash[25040]: cluster 2024-09-14T04:09:32.680018+0000 mgr.a (mgr.14355) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:35 smithi007 bash[22722]: cluster 2024-09-14T04:09:34.680818+0000 mgr.a (mgr.14355) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:35 smithi131 bash[24745]: cluster 2024-09-14T04:09:34.680818+0000 mgr.a (mgr.14355) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:35 smithi171 bash[25040]: cluster 2024-09-14T04:09:34.680818+0000 mgr.a (mgr.14355) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:36 smithi007 bash[22722]: cluster 2024-09-14T04:09:36.683052+0000 mgr.a (mgr.14355) 15080 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:36 smithi131 bash[24745]: cluster 2024-09-14T04:09:36.683052+0000 mgr.a (mgr.14355) 15080 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:36 smithi171 bash[25040]: cluster 2024-09-14T04:09:36.683052+0000 mgr.a (mgr.14355) 15080 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:38.077 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:38.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:37 smithi007 bash[22722]: audit 2024-09-14T04:09:37.643385+0000 mgr.a (mgr.14355) 15081 : audit [DBG] from='client.326316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:37 smithi131 bash[24745]: audit 2024-09-14T04:09:37.643385+0000 mgr.a (mgr.14355) 15081 : audit [DBG] from='client.326316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:37 smithi171 bash[25040]: audit 2024-09-14T04:09:37.643385+0000 mgr.a (mgr.14355) 15081 : audit [DBG] from='client.326316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:38 smithi007 bash[22722]: cluster 2024-09-14T04:09:38.684002+0000 mgr.a (mgr.14355) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:38 smithi131 bash[24745]: cluster 2024-09-14T04:09:38.684002+0000 mgr.a (mgr.14355) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:38 smithi171 bash[25040]: cluster 2024-09-14T04:09:38.684002+0000 mgr.a (mgr.14355) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:41 smithi131 bash[24745]: cluster 2024-09-14T04:09:40.686162+0000 mgr.a (mgr.14355) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:41 smithi171 bash[25040]: cluster 2024-09-14T04:09:40.686162+0000 mgr.a (mgr.14355) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:41 smithi007 bash[22722]: cluster 2024-09-14T04:09:40.686162+0000 mgr.a (mgr.14355) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:43.845 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:43.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:43 smithi131 bash[24745]: cluster 2024-09-14T04:09:42.686899+0000 mgr.a (mgr.14355) 15084 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:44.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:43 smithi171 bash[25040]: cluster 2024-09-14T04:09:42.686899+0000 mgr.a (mgr.14355) 15084 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:43 smithi007 bash[22722]: cluster 2024-09-14T04:09:42.686899+0000 mgr.a (mgr.14355) 15084 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:44 smithi131 bash[24745]: audit 2024-09-14T04:09:43.418590+0000 mgr.a (mgr.14355) 15085 : audit [DBG] from='client.326391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:44 smithi171 bash[25040]: audit 2024-09-14T04:09:43.418590+0000 mgr.a (mgr.14355) 15085 : audit [DBG] from='client.326391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:44 smithi007 bash[22722]: audit 2024-09-14T04:09:43.418590+0000 mgr.a (mgr.14355) 15085 : audit [DBG] from='client.326391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:45 smithi131 bash[24745]: cluster 2024-09-14T04:09:44.687836+0000 mgr.a (mgr.14355) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:45 smithi171 bash[25040]: cluster 2024-09-14T04:09:44.687836+0000 mgr.a (mgr.14355) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:45 smithi007 bash[22722]: cluster 2024-09-14T04:09:44.687836+0000 mgr.a (mgr.14355) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:47 smithi131 bash[24745]: cluster 2024-09-14T04:09:46.690126+0000 mgr.a (mgr.14355) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:47 smithi171 bash[25040]: cluster 2024-09-14T04:09:46.690126+0000 mgr.a (mgr.14355) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:47 smithi007 bash[22722]: cluster 2024-09-14T04:09:46.690126+0000 mgr.a (mgr.14355) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:48.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:48.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:48.847 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:49.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:49.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:49.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:49.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:49 smithi131 bash[24745]: cluster 2024-09-14T04:09:48.690909+0000 mgr.a (mgr.14355) 15088 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:49 smithi171 bash[25040]: cluster 2024-09-14T04:09:48.690909+0000 mgr.a (mgr.14355) 15088 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:49 smithi007 bash[22722]: cluster 2024-09-14T04:09:48.690909+0000 mgr.a (mgr.14355) 15088 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:50 smithi131 bash[24745]: audit 2024-09-14T04:09:49.185519+0000 mgr.a (mgr.14355) 15089 : audit [DBG] from='client.326469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:50 smithi171 bash[25040]: audit 2024-09-14T04:09:49.185519+0000 mgr.a (mgr.14355) 15089 : audit [DBG] from='client.326469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:50 smithi007 bash[22722]: audit 2024-09-14T04:09:49.185519+0000 mgr.a (mgr.14355) 15089 : audit [DBG] from='client.326469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:51 smithi131 bash[24745]: cluster 2024-09-14T04:09:50.693259+0000 mgr.a (mgr.14355) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:51 smithi171 bash[25040]: cluster 2024-09-14T04:09:50.693259+0000 mgr.a (mgr.14355) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:51 smithi007 bash[22722]: cluster 2024-09-14T04:09:50.693259+0000 mgr.a (mgr.14355) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:09:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:53 smithi131 bash[24745]: cluster 2024-09-14T04:09:52.694028+0000 mgr.a (mgr.14355) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:54.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:53 smithi171 bash[25040]: cluster 2024-09-14T04:09:52.694028+0000 mgr.a (mgr.14355) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:53 smithi007 bash[22722]: cluster 2024-09-14T04:09:52.694028+0000 mgr.a (mgr.14355) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:54.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:09:54.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:09:54.620 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:09:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:09:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:09:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:09:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:09:55.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:09:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:55 smithi171 bash[25040]: cluster 2024-09-14T04:09:54.694803+0000 mgr.a (mgr.14355) 15092 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:55 smithi007 bash[22722]: cluster 2024-09-14T04:09:54.694803+0000 mgr.a (mgr.14355) 15092 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:55 smithi131 bash[24745]: cluster 2024-09-14T04:09:54.694803+0000 mgr.a (mgr.14355) 15092 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:09:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:56 smithi007 bash[22722]: audit 2024-09-14T04:09:54.957896+0000 mgr.a (mgr.14355) 15093 : audit [DBG] from='client.326544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:56 smithi131 bash[24745]: audit 2024-09-14T04:09:54.957896+0000 mgr.a (mgr.14355) 15093 : audit [DBG] from='client.326544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:56 smithi171 bash[25040]: audit 2024-09-14T04:09:54.957896+0000 mgr.a (mgr.14355) 15093 : audit [DBG] from='client.326544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:09:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:57 smithi007 bash[22722]: cluster 2024-09-14T04:09:56.697759+0000 mgr.a (mgr.14355) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:09:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:57 smithi131 bash[24745]: cluster 2024-09-14T04:09:56.697759+0000 mgr.a (mgr.14355) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:09:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:57 smithi171 bash[25040]: cluster 2024-09-14T04:09:56.697759+0000 mgr.a (mgr.14355) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:10:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:09:59 smithi007 bash[22722]: cluster 2024-09-14T04:09:58.698767+0000 mgr.a (mgr.14355) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:10:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:09:59 smithi131 bash[24745]: cluster 2024-09-14T04:09:58.698767+0000 mgr.a (mgr.14355) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:10:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:09:59 smithi171 bash[25040]: cluster 2024-09-14T04:09:58.698767+0000 mgr.a (mgr.14355) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:10:00.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:00.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:00.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:01.186 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:01.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:01.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:00 smithi007 bash[22722]: cluster 2024-09-14T04:10:00.000138+0000 mon.a (mon.0) 2846 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:10:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:00 smithi131 bash[24745]: cluster 2024-09-14T04:10:00.000138+0000 mon.a (mon.0) 2846 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:10:01.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:00 smithi171 bash[25040]: cluster 2024-09-14T04:10:00.000138+0000 mon.a (mon.0) 2846 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:10:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:01 smithi007 bash[22722]: cluster 2024-09-14T04:10:00.700880+0000 mgr.a (mgr.14355) 15096 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:01 smithi007 bash[22722]: audit 2024-09-14T04:10:00.741089+0000 mgr.a (mgr.14355) 15097 : audit [DBG] from='client.326622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:01 smithi131 bash[24745]: cluster 2024-09-14T04:10:00.700880+0000 mgr.a (mgr.14355) 15096 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:01 smithi131 bash[24745]: audit 2024-09-14T04:10:00.741089+0000 mgr.a (mgr.14355) 15097 : audit [DBG] from='client.326622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:01 smithi171 bash[25040]: cluster 2024-09-14T04:10:00.700880+0000 mgr.a (mgr.14355) 15096 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:01 smithi171 bash[25040]: audit 2024-09-14T04:10:00.741089+0000 mgr.a (mgr.14355) 15097 : audit [DBG] from='client.326622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:03 smithi007 bash[22722]: cluster 2024-09-14T04:10:02.701857+0000 mgr.a (mgr.14355) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:03 smithi131 bash[24745]: cluster 2024-09-14T04:10:02.701857+0000 mgr.a (mgr.14355) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:03 smithi171 bash[25040]: cluster 2024-09-14T04:10:02.701857+0000 mgr.a (mgr.14355) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:06.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:06.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:05 smithi007 bash[22722]: cluster 2024-09-14T04:10:04.702587+0000 mgr.a (mgr.14355) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:05 smithi131 bash[24745]: cluster 2024-09-14T04:10:04.702587+0000 mgr.a (mgr.14355) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:05 smithi171 bash[25040]: cluster 2024-09-14T04:10:04.702587+0000 mgr.a (mgr.14355) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:06.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:06.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:06.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:07 smithi007 bash[22722]: audit 2024-09-14T04:10:06.518802+0000 mgr.a (mgr.14355) 15100 : audit [DBG] from='client.326697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:07 smithi007 bash[22722]: cluster 2024-09-14T04:10:06.704434+0000 mgr.a (mgr.14355) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:07 smithi131 bash[24745]: audit 2024-09-14T04:10:06.518802+0000 mgr.a (mgr.14355) 15100 : audit [DBG] from='client.326697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:07 smithi131 bash[24745]: cluster 2024-09-14T04:10:06.704434+0000 mgr.a (mgr.14355) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:07 smithi171 bash[25040]: audit 2024-09-14T04:10:06.518802+0000 mgr.a (mgr.14355) 15100 : audit [DBG] from='client.326697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:07 smithi171 bash[25040]: cluster 2024-09-14T04:10:06.704434+0000 mgr.a (mgr.14355) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:09 smithi007 bash[22722]: cluster 2024-09-14T04:10:08.705321+0000 mgr.a (mgr.14355) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:10:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:09 smithi131 bash[24745]: cluster 2024-09-14T04:10:08.705321+0000 mgr.a (mgr.14355) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:10:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:09 smithi171 bash[25040]: cluster 2024-09-14T04:10:08.705321+0000 mgr.a (mgr.14355) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:10:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:11.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:11 smithi007 bash[22722]: cluster 2024-09-14T04:10:10.707496+0000 mgr.a (mgr.14355) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:10:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:11 smithi131 bash[24745]: cluster 2024-09-14T04:10:10.707496+0000 mgr.a (mgr.14355) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:10:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:11 smithi171 bash[25040]: cluster 2024-09-14T04:10:10.707496+0000 mgr.a (mgr.14355) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:10:12.695 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:12.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:13 smithi007 bash[22722]: audit 2024-09-14T04:10:12.278429+0000 mgr.a (mgr.14355) 15104 : audit [DBG] from='client.326775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:14.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:13 smithi007 bash[22722]: cluster 2024-09-14T04:10:12.708134+0000 mgr.a (mgr.14355) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:13 smithi131 bash[24745]: audit 2024-09-14T04:10:12.278429+0000 mgr.a (mgr.14355) 15104 : audit [DBG] from='client.326775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:14.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:13 smithi131 bash[24745]: cluster 2024-09-14T04:10:12.708134+0000 mgr.a (mgr.14355) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:13 smithi171 bash[25040]: audit 2024-09-14T04:10:12.278429+0000 mgr.a (mgr.14355) 15104 : audit [DBG] from='client.326775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:13 smithi171 bash[25040]: cluster 2024-09-14T04:10:12.708134+0000 mgr.a (mgr.14355) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:15 smithi007 bash[22722]: cluster 2024-09-14T04:10:14.708854+0000 mgr.a (mgr.14355) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:15 smithi131 bash[24745]: cluster 2024-09-14T04:10:14.708854+0000 mgr.a (mgr.14355) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:15 smithi171 bash[25040]: cluster 2024-09-14T04:10:14.708854+0000 mgr.a (mgr.14355) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:17.697 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:17 smithi007 bash[22722]: cluster 2024-09-14T04:10:16.711107+0000 mgr.a (mgr.14355) 15107 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:17 smithi131 bash[24745]: cluster 2024-09-14T04:10:16.711107+0000 mgr.a (mgr.14355) 15107 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:17 smithi171 bash[25040]: cluster 2024-09-14T04:10:16.711107+0000 mgr.a (mgr.14355) 15107 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:18.481 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:18 smithi007 bash[22722]: audit 2024-09-14T04:10:18.197414+0000 mon.a (mon.0) 2847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:10:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:18 smithi131 bash[24745]: audit 2024-09-14T04:10:18.197414+0000 mon.a (mon.0) 2847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:10:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:18 smithi171 bash[25040]: audit 2024-09-14T04:10:18.197414+0000 mon.a (mon.0) 2847 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:10:20.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22972]: debug 2024-09-14T04:10:19.744+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:10:20.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22972]: debug 2024-09-14T04:10:19.748+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:10:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: audit 2024-09-14T04:10:18.032316+0000 mgr.a (mgr.14355) 15108 : audit [DBG] from='client.326853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: cluster 2024-09-14T04:10:18.712002+0000 mgr.a (mgr.14355) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: audit 2024-09-14T04:10:18.989404+0000 mon.a (mon.0) 2848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:10:20.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: audit 2024-09-14T04:10:18.991412+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:10:20.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: audit 2024-09-14T04:10:19.000371+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:10:20.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:19 smithi007 bash[22722]: audit 2024-09-14T04:10:19.005549+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: audit 2024-09-14T04:10:18.032316+0000 mgr.a (mgr.14355) 15108 : audit [DBG] from='client.326853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: cluster 2024-09-14T04:10:18.712002+0000 mgr.a (mgr.14355) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: audit 2024-09-14T04:10:18.989404+0000 mon.a (mon.0) 2848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:10:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: audit 2024-09-14T04:10:18.991412+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:10:20.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: audit 2024-09-14T04:10:19.000371+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:10:20.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:19 smithi131 bash[24745]: audit 2024-09-14T04:10:19.005549+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: audit 2024-09-14T04:10:18.032316+0000 mgr.a (mgr.14355) 15108 : audit [DBG] from='client.326853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: cluster 2024-09-14T04:10:18.712002+0000 mgr.a (mgr.14355) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: audit 2024-09-14T04:10:18.989404+0000 mon.a (mon.0) 2848 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:10:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: audit 2024-09-14T04:10:18.991412+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:10:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: audit 2024-09-14T04:10:19.000371+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:10:20.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:19 smithi171 bash[25040]: audit 2024-09-14T04:10:19.005549+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:20 smithi007 bash[22722]: audit 2024-09-14T04:10:19.008248+0000 mgr.a (mgr.14355) 15110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:20 smithi007 bash[22722]: audit 2024-09-14T04:10:19.749725+0000 mgr.a (mgr.14355) 15111 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:10:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:20 smithi007 bash[22722]: cephadm 2024-09-14T04:10:19.751732+0000 mgr.a (mgr.14355) 15112 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:10:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:20 smithi131 bash[24745]: audit 2024-09-14T04:10:19.008248+0000 mgr.a (mgr.14355) 15110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:20 smithi131 bash[24745]: audit 2024-09-14T04:10:19.749725+0000 mgr.a (mgr.14355) 15111 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:10:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:20 smithi131 bash[24745]: cephadm 2024-09-14T04:10:19.751732+0000 mgr.a (mgr.14355) 15112 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:10:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:20 smithi171 bash[25040]: audit 2024-09-14T04:10:19.008248+0000 mgr.a (mgr.14355) 15110 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:10:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:20 smithi171 bash[25040]: audit 2024-09-14T04:10:19.749725+0000 mgr.a (mgr.14355) 15111 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:10:21.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:20 smithi171 bash[25040]: cephadm 2024-09-14T04:10:19.751732+0000 mgr.a (mgr.14355) 15112 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:10:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:21 smithi007 bash[22722]: cluster 2024-09-14T04:10:20.714356+0000 mgr.a (mgr.14355) 15113 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:21 smithi131 bash[24745]: cluster 2024-09-14T04:10:20.714356+0000 mgr.a (mgr.14355) 15113 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:21 smithi171 bash[25040]: cluster 2024-09-14T04:10:20.714356+0000 mgr.a (mgr.14355) 15113 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:23.483 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:23.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:23.484 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:23 smithi007 bash[22722]: cluster 2024-09-14T04:10:22.715131+0000 mgr.a (mgr.14355) 15114 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:24.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:24.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:24.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:24.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:24.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:23 smithi131 bash[24745]: cluster 2024-09-14T04:10:22.715131+0000 mgr.a (mgr.14355) 15114 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:23 smithi171 bash[25040]: cluster 2024-09-14T04:10:22.715131+0000 mgr.a (mgr.14355) 15114 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:24 smithi007 bash[22722]: audit 2024-09-14T04:10:23.821944+0000 mgr.a (mgr.14355) 15115 : audit [DBG] from='client.327039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:24 smithi131 bash[24745]: audit 2024-09-14T04:10:23.821944+0000 mgr.a (mgr.14355) 15115 : audit [DBG] from='client.327039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:24 smithi171 bash[25040]: audit 2024-09-14T04:10:23.821944+0000 mgr.a (mgr.14355) 15115 : audit [DBG] from='client.327039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:25 smithi007 bash[22722]: cluster 2024-09-14T04:10:24.716086+0000 mgr.a (mgr.14355) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:25 smithi131 bash[24745]: cluster 2024-09-14T04:10:24.716086+0000 mgr.a (mgr.14355) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:25 smithi171 bash[25040]: cluster 2024-09-14T04:10:24.716086+0000 mgr.a (mgr.14355) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:26 smithi007 bash[22722]: cluster 2024-09-14T04:10:26.718385+0000 mgr.a (mgr.14355) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:26 smithi131 bash[24745]: cluster 2024-09-14T04:10:26.718385+0000 mgr.a (mgr.14355) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:26 smithi171 bash[25040]: cluster 2024-09-14T04:10:26.718385+0000 mgr.a (mgr.14355) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:29.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:29.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:29.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:30.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:30.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:29 smithi131 bash[24745]: cluster 2024-09-14T04:10:28.719169+0000 mgr.a (mgr.14355) 15118 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:29 smithi171 bash[25040]: cluster 2024-09-14T04:10:28.719169+0000 mgr.a (mgr.14355) 15118 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:29 smithi007 bash[22722]: cluster 2024-09-14T04:10:28.719169+0000 mgr.a (mgr.14355) 15118 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:30 smithi131 bash[24745]: audit 2024-09-14T04:10:29.599728+0000 mgr.a (mgr.14355) 15119 : audit [DBG] from='client.327117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:30 smithi171 bash[25040]: audit 2024-09-14T04:10:29.599728+0000 mgr.a (mgr.14355) 15119 : audit [DBG] from='client.327117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:30 smithi007 bash[22722]: audit 2024-09-14T04:10:29.599728+0000 mgr.a (mgr.14355) 15119 : audit [DBG] from='client.327117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:31 smithi171 bash[25040]: cluster 2024-09-14T04:10:30.721471+0000 mgr.a (mgr.14355) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:31 smithi007 bash[22722]: cluster 2024-09-14T04:10:30.721471+0000 mgr.a (mgr.14355) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:31 smithi131 bash[24745]: cluster 2024-09-14T04:10:30.721471+0000 mgr.a (mgr.14355) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:10:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:33 smithi171 bash[25040]: cluster 2024-09-14T04:10:32.722234+0000 mgr.a (mgr.14355) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:33 smithi007 bash[22722]: cluster 2024-09-14T04:10:32.722234+0000 mgr.a (mgr.14355) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:33 smithi131 bash[24745]: cluster 2024-09-14T04:10:32.722234+0000 mgr.a (mgr.14355) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:35.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:35.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:35.778 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:35.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:35.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:35.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:35.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:36.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:35 smithi171 bash[25040]: cluster 2024-09-14T04:10:34.723000+0000 mgr.a (mgr.14355) 15122 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:35 smithi007 bash[22722]: cluster 2024-09-14T04:10:34.723000+0000 mgr.a (mgr.14355) 15122 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:35 smithi131 bash[24745]: cluster 2024-09-14T04:10:34.723000+0000 mgr.a (mgr.14355) 15122 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:36 smithi007 bash[22722]: audit 2024-09-14T04:10:35.363343+0000 mgr.a (mgr.14355) 15123 : audit [DBG] from='client.327195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:36 smithi131 bash[24745]: audit 2024-09-14T04:10:35.363343+0000 mgr.a (mgr.14355) 15123 : audit [DBG] from='client.327195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:36 smithi171 bash[25040]: audit 2024-09-14T04:10:35.363343+0000 mgr.a (mgr.14355) 15123 : audit [DBG] from='client.327195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:37 smithi007 bash[22722]: cluster 2024-09-14T04:10:36.725787+0000 mgr.a (mgr.14355) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:37 smithi131 bash[24745]: cluster 2024-09-14T04:10:36.725787+0000 mgr.a (mgr.14355) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:37 smithi171 bash[25040]: cluster 2024-09-14T04:10:36.725787+0000 mgr.a (mgr.14355) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:39 smithi007 bash[22722]: cluster 2024-09-14T04:10:38.726597+0000 mgr.a (mgr.14355) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:39 smithi131 bash[24745]: cluster 2024-09-14T04:10:38.726597+0000 mgr.a (mgr.14355) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:39 smithi171 bash[25040]: cluster 2024-09-14T04:10:38.726597+0000 mgr.a (mgr.14355) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:40.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:40.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:40.780 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:41.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:41 smithi007 bash[22722]: cluster 2024-09-14T04:10:40.728524+0000 mgr.a (mgr.14355) 15126 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:41 smithi131 bash[24745]: cluster 2024-09-14T04:10:40.728524+0000 mgr.a (mgr.14355) 15126 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:41 smithi171 bash[25040]: cluster 2024-09-14T04:10:40.728524+0000 mgr.a (mgr.14355) 15126 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:42 smithi007 bash[22722]: audit 2024-09-14T04:10:41.113829+0000 mgr.a (mgr.14355) 15127 : audit [DBG] from='client.327273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:42 smithi131 bash[24745]: audit 2024-09-14T04:10:41.113829+0000 mgr.a (mgr.14355) 15127 : audit [DBG] from='client.327273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:42 smithi171 bash[25040]: audit 2024-09-14T04:10:41.113829+0000 mgr.a (mgr.14355) 15127 : audit [DBG] from='client.327273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:43 smithi007 bash[22722]: cluster 2024-09-14T04:10:42.729353+0000 mgr.a (mgr.14355) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:43 smithi131 bash[24745]: cluster 2024-09-14T04:10:42.729353+0000 mgr.a (mgr.14355) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:43 smithi171 bash[25040]: cluster 2024-09-14T04:10:42.729353+0000 mgr.a (mgr.14355) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:10:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:45 smithi007 bash[22722]: cluster 2024-09-14T04:10:44.730139+0000 mgr.a (mgr.14355) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:10:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:45 smithi131 bash[24745]: cluster 2024-09-14T04:10:44.730139+0000 mgr.a (mgr.14355) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:10:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:45 smithi171 bash[25040]: cluster 2024-09-14T04:10:44.730139+0000 mgr.a (mgr.14355) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:10:46.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:46.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:46.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:47.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:47 smithi007 bash[22722]: cluster 2024-09-14T04:10:46.731517+0000 mgr.a (mgr.14355) 15130 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:47 smithi007 bash[22722]: audit 2024-09-14T04:10:46.863889+0000 mgr.a (mgr.14355) 15131 : audit [DBG] from='client.327348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:47 smithi131 bash[24745]: cluster 2024-09-14T04:10:46.731517+0000 mgr.a (mgr.14355) 15130 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:47 smithi131 bash[24745]: audit 2024-09-14T04:10:46.863889+0000 mgr.a (mgr.14355) 15131 : audit [DBG] from='client.327348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:47 smithi171 bash[25040]: cluster 2024-09-14T04:10:46.731517+0000 mgr.a (mgr.14355) 15130 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:47 smithi171 bash[25040]: audit 2024-09-14T04:10:46.863889+0000 mgr.a (mgr.14355) 15131 : audit [DBG] from='client.327348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:49 smithi007 bash[22722]: cluster 2024-09-14T04:10:48.732406+0000 mgr.a (mgr.14355) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:49 smithi131 bash[24745]: cluster 2024-09-14T04:10:48.732406+0000 mgr.a (mgr.14355) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:49 smithi171 bash[25040]: cluster 2024-09-14T04:10:48.732406+0000 mgr.a (mgr.14355) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:51 smithi007 bash[22722]: cluster 2024-09-14T04:10:50.734624+0000 mgr.a (mgr.14355) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:51 smithi131 bash[24745]: cluster 2024-09-14T04:10:50.734624+0000 mgr.a (mgr.14355) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:51 smithi171 bash[25040]: cluster 2024-09-14T04:10:50.734624+0000 mgr.a (mgr.14355) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:52.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:52.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:53.090 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:53.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:53.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:10:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:53 smithi007 bash[22722]: audit 2024-09-14T04:10:52.645106+0000 mgr.a (mgr.14355) 15134 : audit [DBG] from='client.327426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:53 smithi007 bash[22722]: cluster 2024-09-14T04:10:52.735309+0000 mgr.a (mgr.14355) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:53 smithi131 bash[24745]: audit 2024-09-14T04:10:52.645106+0000 mgr.a (mgr.14355) 15134 : audit [DBG] from='client.327426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:53 smithi131 bash[24745]: cluster 2024-09-14T04:10:52.735309+0000 mgr.a (mgr.14355) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:53 smithi171 bash[25040]: audit 2024-09-14T04:10:52.645106+0000 mgr.a (mgr.14355) 15134 : audit [DBG] from='client.327426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:10:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:53 smithi171 bash[25040]: cluster 2024-09-14T04:10:52.735309+0000 mgr.a (mgr.14355) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:55 smithi007 bash[22722]: cluster 2024-09-14T04:10:54.736289+0000 mgr.a (mgr.14355) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:55 smithi131 bash[24745]: cluster 2024-09-14T04:10:54.736289+0000 mgr.a (mgr.14355) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:55 smithi171 bash[25040]: cluster 2024-09-14T04:10:54.736289+0000 mgr.a (mgr.14355) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:10:58.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:10:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:10:58.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:10:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:57 smithi007 bash[22722]: cluster 2024-09-14T04:10:56.738710+0000 mgr.a (mgr.14355) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:57 smithi131 bash[24745]: cluster 2024-09-14T04:10:56.738710+0000 mgr.a (mgr.14355) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:57 smithi171 bash[25040]: cluster 2024-09-14T04:10:56.738710+0000 mgr.a (mgr.14355) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:10:58.837 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:10:58.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:10:58.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:10:58.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:10:58.838 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:59 smithi007 bash[22722]: audit 2024-09-14T04:10:58.425031+0000 mgr.a (mgr.14355) 15138 : audit [DBG] from='client.327501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:10:59 smithi007 bash[22722]: cluster 2024-09-14T04:10:58.740437+0000 mgr.a (mgr.14355) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:59 smithi131 bash[24745]: audit 2024-09-14T04:10:58.425031+0000 mgr.a (mgr.14355) 15138 : audit [DBG] from='client.327501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:10:59 smithi131 bash[24745]: cluster 2024-09-14T04:10:58.740437+0000 mgr.a (mgr.14355) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:59 smithi171 bash[25040]: audit 2024-09-14T04:10:58.425031+0000 mgr.a (mgr.14355) 15138 : audit [DBG] from='client.327501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:10:59 smithi171 bash[25040]: cluster 2024-09-14T04:10:58.740437+0000 mgr.a (mgr.14355) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:01 smithi007 bash[22722]: cluster 2024-09-14T04:11:00.742601+0000 mgr.a (mgr.14355) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:01 smithi131 bash[24745]: cluster 2024-09-14T04:11:00.742601+0000 mgr.a (mgr.14355) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:01 smithi171 bash[25040]: cluster 2024-09-14T04:11:00.742601+0000 mgr.a (mgr.14355) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:03 smithi007 bash[22722]: cluster 2024-09-14T04:11:02.743325+0000 mgr.a (mgr.14355) 15141 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:03 smithi131 bash[24745]: cluster 2024-09-14T04:11:02.743325+0000 mgr.a (mgr.14355) 15141 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:03 smithi171 bash[25040]: cluster 2024-09-14T04:11:02.743325+0000 mgr.a (mgr.14355) 15141 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:04.620 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:05 smithi007 bash[22722]: audit 2024-09-14T04:11:04.171728+0000 mgr.a (mgr.14355) 15142 : audit [DBG] from='client.327576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:05 smithi007 bash[22722]: cluster 2024-09-14T04:11:04.744288+0000 mgr.a (mgr.14355) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:05 smithi131 bash[24745]: audit 2024-09-14T04:11:04.171728+0000 mgr.a (mgr.14355) 15142 : audit [DBG] from='client.327576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:06.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:05 smithi131 bash[24745]: cluster 2024-09-14T04:11:04.744288+0000 mgr.a (mgr.14355) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:05 smithi171 bash[25040]: audit 2024-09-14T04:11:04.171728+0000 mgr.a (mgr.14355) 15142 : audit [DBG] from='client.327576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:05 smithi171 bash[25040]: cluster 2024-09-14T04:11:04.744288+0000 mgr.a (mgr.14355) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:07 smithi007 bash[22722]: cluster 2024-09-14T04:11:06.746570+0000 mgr.a (mgr.14355) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:07 smithi131 bash[24745]: cluster 2024-09-14T04:11:06.746570+0000 mgr.a (mgr.14355) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:07 smithi171 bash[25040]: cluster 2024-09-14T04:11:06.746570+0000 mgr.a (mgr.14355) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:09 smithi007 bash[22722]: cluster 2024-09-14T04:11:08.747302+0000 mgr.a (mgr.14355) 15145 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:09 smithi131 bash[24745]: cluster 2024-09-14T04:11:08.747302+0000 mgr.a (mgr.14355) 15145 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:09 smithi171 bash[25040]: cluster 2024-09-14T04:11:08.747302+0000 mgr.a (mgr.14355) 15145 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:10.396 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:10.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:11 smithi007 bash[22722]: audit 2024-09-14T04:11:09.955380+0000 mgr.a (mgr.14355) 15146 : audit [DBG] from='client.327654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:11 smithi007 bash[22722]: cluster 2024-09-14T04:11:10.750101+0000 mgr.a (mgr.14355) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:11:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:11 smithi131 bash[24745]: audit 2024-09-14T04:11:09.955380+0000 mgr.a (mgr.14355) 15146 : audit [DBG] from='client.327654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:11 smithi131 bash[24745]: cluster 2024-09-14T04:11:10.750101+0000 mgr.a (mgr.14355) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:11:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:11 smithi171 bash[25040]: audit 2024-09-14T04:11:09.955380+0000 mgr.a (mgr.14355) 15146 : audit [DBG] from='client.327654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:11 smithi171 bash[25040]: cluster 2024-09-14T04:11:10.750101+0000 mgr.a (mgr.14355) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:11:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:12 smithi007 bash[22722]: cluster 2024-09-14T04:11:12.750877+0000 mgr.a (mgr.14355) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:12 smithi131 bash[24745]: cluster 2024-09-14T04:11:12.750877+0000 mgr.a (mgr.14355) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:12 smithi171 bash[25040]: cluster 2024-09-14T04:11:12.750877+0000 mgr.a (mgr.14355) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:15.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:15.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:16.144 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:15 smithi007 bash[22722]: cluster 2024-09-14T04:11:14.751780+0000 mgr.a (mgr.14355) 15149 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:15 smithi131 bash[24745]: cluster 2024-09-14T04:11:14.751780+0000 mgr.a (mgr.14355) 15149 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:15 smithi171 bash[25040]: cluster 2024-09-14T04:11:14.751780+0000 mgr.a (mgr.14355) 15149 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:11:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:16 smithi007 bash[22722]: audit 2024-09-14T04:11:15.726638+0000 mgr.a (mgr.14355) 15150 : audit [DBG] from='client.327732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:16 smithi131 bash[24745]: audit 2024-09-14T04:11:15.726638+0000 mgr.a (mgr.14355) 15150 : audit [DBG] from='client.327732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:16 smithi171 bash[25040]: audit 2024-09-14T04:11:15.726638+0000 mgr.a (mgr.14355) 15150 : audit [DBG] from='client.327732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:17 smithi007 bash[22722]: cluster 2024-09-14T04:11:16.754622+0000 mgr.a (mgr.14355) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:17 smithi131 bash[24745]: cluster 2024-09-14T04:11:16.754622+0000 mgr.a (mgr.14355) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:18.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:17 smithi171 bash[25040]: cluster 2024-09-14T04:11:16.754622+0000 mgr.a (mgr.14355) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:19 smithi007 bash[22722]: cluster 2024-09-14T04:11:18.755395+0000 mgr.a (mgr.14355) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:19 smithi007 bash[22722]: audit 2024-09-14T04:11:19.808890+0000 mon.a (mon.0) 2852 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:11:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:19 smithi131 bash[24745]: cluster 2024-09-14T04:11:18.755395+0000 mgr.a (mgr.14355) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:20.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:19 smithi131 bash[24745]: audit 2024-09-14T04:11:19.808890+0000 mon.a (mon.0) 2852 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:11:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:19 smithi171 bash[25040]: cluster 2024-09-14T04:11:18.755395+0000 mgr.a (mgr.14355) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:19 smithi171 bash[25040]: audit 2024-09-14T04:11:19.808890+0000 mon.a (mon.0) 2852 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:11:21.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:21.146 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:20 smithi007 bash[22722]: audit 2024-09-14T04:11:20.636109+0000 mon.a (mon.0) 2853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:11:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:20 smithi007 bash[22722]: audit 2024-09-14T04:11:20.637745+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:11:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:20 smithi007 bash[22722]: audit 2024-09-14T04:11:20.648049+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:11:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:20 smithi007 bash[22722]: audit 2024-09-14T04:11:20.652734+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:20 smithi131 bash[24745]: audit 2024-09-14T04:11:20.636109+0000 mon.a (mon.0) 2853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:11:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:20 smithi131 bash[24745]: audit 2024-09-14T04:11:20.637745+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:11:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:20 smithi131 bash[24745]: audit 2024-09-14T04:11:20.648049+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:11:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:20 smithi131 bash[24745]: audit 2024-09-14T04:11:20.652734+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:20 smithi171 bash[25040]: audit 2024-09-14T04:11:20.636109+0000 mon.a (mon.0) 2853 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:11:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:20 smithi171 bash[25040]: audit 2024-09-14T04:11:20.637745+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:11:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:20 smithi171 bash[25040]: audit 2024-09-14T04:11:20.648049+0000 mon.a (mon.0) 2855 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:11:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:20 smithi171 bash[25040]: audit 2024-09-14T04:11:20.652734+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:21.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:11:21 smithi007 bash[22972]: debug 2024-09-14T04:11:21.415+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:11:21.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:11:21 smithi007 bash[22972]: debug 2024-09-14T04:11:21.415+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:11:21.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:21.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:21.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:21.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:21.884 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:21 smithi007 bash[22722]: audit 2024-09-14T04:11:20.655004+0000 mgr.a (mgr.14355) 15153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:21 smithi007 bash[22722]: cluster 2024-09-14T04:11:20.756670+0000 mgr.a (mgr.14355) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:21 smithi131 bash[24745]: audit 2024-09-14T04:11:20.655004+0000 mgr.a (mgr.14355) 15153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:22.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:21 smithi131 bash[24745]: cluster 2024-09-14T04:11:20.756670+0000 mgr.a (mgr.14355) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:21 smithi171 bash[25040]: audit 2024-09-14T04:11:20.655004+0000 mgr.a (mgr.14355) 15153 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:11:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:21 smithi171 bash[25040]: cluster 2024-09-14T04:11:20.756670+0000 mgr.a (mgr.14355) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:22 smithi007 bash[22722]: audit 2024-09-14T04:11:21.419913+0000 mgr.a (mgr.14355) 15155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:11:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:22 smithi007 bash[22722]: cephadm 2024-09-14T04:11:21.421688+0000 mgr.a (mgr.14355) 15156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:11:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:22 smithi007 bash[22722]: audit 2024-09-14T04:11:21.475331+0000 mgr.a (mgr.14355) 15157 : audit [DBG] from='client.327897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:22 smithi131 bash[24745]: audit 2024-09-14T04:11:21.419913+0000 mgr.a (mgr.14355) 15155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:11:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:22 smithi131 bash[24745]: cephadm 2024-09-14T04:11:21.421688+0000 mgr.a (mgr.14355) 15156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:11:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:22 smithi131 bash[24745]: audit 2024-09-14T04:11:21.475331+0000 mgr.a (mgr.14355) 15157 : audit [DBG] from='client.327897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:22 smithi171 bash[25040]: audit 2024-09-14T04:11:21.419913+0000 mgr.a (mgr.14355) 15155 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:11:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:22 smithi171 bash[25040]: cephadm 2024-09-14T04:11:21.421688+0000 mgr.a (mgr.14355) 15156 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:11:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:22 smithi171 bash[25040]: audit 2024-09-14T04:11:21.475331+0000 mgr.a (mgr.14355) 15157 : audit [DBG] from='client.327897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:23 smithi007 bash[22722]: cluster 2024-09-14T04:11:22.757636+0000 mgr.a (mgr.14355) 15158 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:23 smithi131 bash[24745]: cluster 2024-09-14T04:11:22.757636+0000 mgr.a (mgr.14355) 15158 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:23 smithi171 bash[25040]: cluster 2024-09-14T04:11:22.757636+0000 mgr.a (mgr.14355) 15158 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:25 smithi007 bash[22722]: cluster 2024-09-14T04:11:24.758844+0000 mgr.a (mgr.14355) 15159 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:25 smithi131 bash[24745]: cluster 2024-09-14T04:11:24.758844+0000 mgr.a (mgr.14355) 15159 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:25 smithi171 bash[25040]: cluster 2024-09-14T04:11:24.758844+0000 mgr.a (mgr.14355) 15159 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:11:26.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:26.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:26.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:27.664 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:27.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:27.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:27.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:27.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:27 smithi007 bash[22722]: cluster 2024-09-14T04:11:26.761125+0000 mgr.a (mgr.14355) 15160 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:27 smithi131 bash[24745]: cluster 2024-09-14T04:11:26.761125+0000 mgr.a (mgr.14355) 15160 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:27 smithi171 bash[25040]: cluster 2024-09-14T04:11:26.761125+0000 mgr.a (mgr.14355) 15160 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:28 smithi007 bash[22722]: audit 2024-09-14T04:11:27.215636+0000 mgr.a (mgr.14355) 15161 : audit [DBG] from='client.327993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:28 smithi131 bash[24745]: audit 2024-09-14T04:11:27.215636+0000 mgr.a (mgr.14355) 15161 : audit [DBG] from='client.327993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:28 smithi171 bash[25040]: audit 2024-09-14T04:11:27.215636+0000 mgr.a (mgr.14355) 15161 : audit [DBG] from='client.327993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:29 smithi007 bash[22722]: cluster 2024-09-14T04:11:28.762023+0000 mgr.a (mgr.14355) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:29 smithi131 bash[24745]: cluster 2024-09-14T04:11:28.762023+0000 mgr.a (mgr.14355) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:29 smithi171 bash[25040]: cluster 2024-09-14T04:11:28.762023+0000 mgr.a (mgr.14355) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:31 smithi007 bash[22722]: cluster 2024-09-14T04:11:30.764175+0000 mgr.a (mgr.14355) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:31 smithi131 bash[24745]: cluster 2024-09-14T04:11:30.764175+0000 mgr.a (mgr.14355) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:31 smithi171 bash[25040]: cluster 2024-09-14T04:11:30.764175+0000 mgr.a (mgr.14355) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:32.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:32.667 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:32.667 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:33.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:33.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:33 smithi007 bash[22722]: cluster 2024-09-14T04:11:32.764732+0000 mgr.a (mgr.14355) 15164 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:33 smithi131 bash[24745]: cluster 2024-09-14T04:11:32.764732+0000 mgr.a (mgr.14355) 15164 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:33 smithi171 bash[25040]: cluster 2024-09-14T04:11:32.764732+0000 mgr.a (mgr.14355) 15164 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:34 smithi007 bash[22722]: audit 2024-09-14T04:11:33.011767+0000 mgr.a (mgr.14355) 15165 : audit [DBG] from='client.328068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:34 smithi131 bash[24745]: audit 2024-09-14T04:11:33.011767+0000 mgr.a (mgr.14355) 15165 : audit [DBG] from='client.328068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:34 smithi171 bash[25040]: audit 2024-09-14T04:11:33.011767+0000 mgr.a (mgr.14355) 15165 : audit [DBG] from='client.328068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:35 smithi007 bash[22722]: cluster 2024-09-14T04:11:34.765587+0000 mgr.a (mgr.14355) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:35 smithi131 bash[24745]: cluster 2024-09-14T04:11:34.765587+0000 mgr.a (mgr.14355) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:35 smithi171 bash[25040]: cluster 2024-09-14T04:11:34.765587+0000 mgr.a (mgr.14355) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:37 smithi007 bash[22722]: cluster 2024-09-14T04:11:36.767846+0000 mgr.a (mgr.14355) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:37 smithi131 bash[24745]: cluster 2024-09-14T04:11:36.767846+0000 mgr.a (mgr.14355) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:37 smithi171 bash[25040]: cluster 2024-09-14T04:11:36.767846+0000 mgr.a (mgr.14355) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:11:38.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:38.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:38.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:39.196 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:39.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:40.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:39 smithi007 bash[22722]: audit 2024-09-14T04:11:38.755046+0000 mgr.a (mgr.14355) 15168 : audit [DBG] from='client.328140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:40.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:39 smithi007 bash[22722]: cluster 2024-09-14T04:11:38.769062+0000 mgr.a (mgr.14355) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:39 smithi131 bash[24745]: audit 2024-09-14T04:11:38.755046+0000 mgr.a (mgr.14355) 15168 : audit [DBG] from='client.328140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:39 smithi131 bash[24745]: cluster 2024-09-14T04:11:38.769062+0000 mgr.a (mgr.14355) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:39 smithi171 bash[25040]: audit 2024-09-14T04:11:38.755046+0000 mgr.a (mgr.14355) 15168 : audit [DBG] from='client.328140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:39 smithi171 bash[25040]: cluster 2024-09-14T04:11:38.769062+0000 mgr.a (mgr.14355) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:40 smithi007 bash[22722]: cluster 2024-09-14T04:11:40.771391+0000 mgr.a (mgr.14355) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:40 smithi131 bash[24745]: cluster 2024-09-14T04:11:40.771391+0000 mgr.a (mgr.14355) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:40 smithi171 bash[25040]: cluster 2024-09-14T04:11:40.771391+0000 mgr.a (mgr.14355) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:44.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:44.199 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:44.199 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:43 smithi007 bash[22722]: cluster 2024-09-14T04:11:42.772195+0000 mgr.a (mgr.14355) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:43 smithi131 bash[24745]: cluster 2024-09-14T04:11:42.772195+0000 mgr.a (mgr.14355) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:43 smithi171 bash[25040]: cluster 2024-09-14T04:11:42.772195+0000 mgr.a (mgr.14355) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:44.987 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:45 smithi007 bash[22722]: audit 2024-09-14T04:11:44.532346+0000 mgr.a (mgr.14355) 15172 : audit [DBG] from='client.328215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:45 smithi007 bash[22722]: cluster 2024-09-14T04:11:44.779503+0000 mgr.a (mgr.14355) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:45 smithi131 bash[24745]: audit 2024-09-14T04:11:44.532346+0000 mgr.a (mgr.14355) 15172 : audit [DBG] from='client.328215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:45 smithi131 bash[24745]: cluster 2024-09-14T04:11:44.779503+0000 mgr.a (mgr.14355) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:45 smithi171 bash[25040]: audit 2024-09-14T04:11:44.532346+0000 mgr.a (mgr.14355) 15172 : audit [DBG] from='client.328215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:45 smithi171 bash[25040]: cluster 2024-09-14T04:11:44.779503+0000 mgr.a (mgr.14355) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:47 smithi007 bash[22722]: cluster 2024-09-14T04:11:46.781875+0000 mgr.a (mgr.14355) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:47 smithi131 bash[24745]: cluster 2024-09-14T04:11:46.781875+0000 mgr.a (mgr.14355) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:47 smithi171 bash[25040]: cluster 2024-09-14T04:11:46.781875+0000 mgr.a (mgr.14355) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:11:49.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:49.989 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:49 smithi007 bash[22722]: cluster 2024-09-14T04:11:48.782708+0000 mgr.a (mgr.14355) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:49 smithi131 bash[24745]: cluster 2024-09-14T04:11:48.782708+0000 mgr.a (mgr.14355) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:49 smithi171 bash[25040]: cluster 2024-09-14T04:11:48.782708+0000 mgr.a (mgr.14355) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:50.742 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:50.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:51 smithi007 bash[22722]: audit 2024-09-14T04:11:50.321795+0000 mgr.a (mgr.14355) 15176 : audit [DBG] from='client.328293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:51 smithi007 bash[22722]: cluster 2024-09-14T04:11:50.783979+0000 mgr.a (mgr.14355) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:51 smithi131 bash[24745]: audit 2024-09-14T04:11:50.321795+0000 mgr.a (mgr.14355) 15176 : audit [DBG] from='client.328293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:52.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:51 smithi131 bash[24745]: cluster 2024-09-14T04:11:50.783979+0000 mgr.a (mgr.14355) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:51 smithi171 bash[25040]: audit 2024-09-14T04:11:50.321795+0000 mgr.a (mgr.14355) 15176 : audit [DBG] from='client.328293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:51 smithi171 bash[25040]: cluster 2024-09-14T04:11:50.783979+0000 mgr.a (mgr.14355) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:54.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:53 smithi007 bash[22722]: cluster 2024-09-14T04:11:52.784667+0000 mgr.a (mgr.14355) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:53 smithi131 bash[24745]: cluster 2024-09-14T04:11:52.784667+0000 mgr.a (mgr.14355) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:53 smithi171 bash[25040]: cluster 2024-09-14T04:11:52.784667+0000 mgr.a (mgr.14355) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:11:55.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:11:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:11:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:55 smithi007 bash[22722]: cluster 2024-09-14T04:11:54.785421+0000 mgr.a (mgr.14355) 15179 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:56.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:55 smithi131 bash[24745]: cluster 2024-09-14T04:11:54.785421+0000 mgr.a (mgr.14355) 15179 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:55 smithi171 bash[25040]: cluster 2024-09-14T04:11:54.785421+0000 mgr.a (mgr.14355) 15179 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:11:56.496 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:11:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:11:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:11:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:11:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:11:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:57 smithi007 bash[22722]: audit 2024-09-14T04:11:56.073285+0000 mgr.a (mgr.14355) 15180 : audit [DBG] from='client.328368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:57 smithi007 bash[22722]: cluster 2024-09-14T04:11:56.788151+0000 mgr.a (mgr.14355) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:57 smithi131 bash[24745]: audit 2024-09-14T04:11:56.073285+0000 mgr.a (mgr.14355) 15180 : audit [DBG] from='client.328368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:57 smithi131 bash[24745]: cluster 2024-09-14T04:11:56.788151+0000 mgr.a (mgr.14355) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:11:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:57 smithi171 bash[25040]: audit 2024-09-14T04:11:56.073285+0000 mgr.a (mgr.14355) 15180 : audit [DBG] from='client.328368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:11:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:57 smithi171 bash[25040]: cluster 2024-09-14T04:11:56.788151+0000 mgr.a (mgr.14355) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:11:59 smithi007 bash[22722]: cluster 2024-09-14T04:11:58.788928+0000 mgr.a (mgr.14355) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:12:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:11:59 smithi131 bash[24745]: cluster 2024-09-14T04:11:58.788928+0000 mgr.a (mgr.14355) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:12:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:11:59 smithi171 bash[25040]: cluster 2024-09-14T04:11:58.788928+0000 mgr.a (mgr.14355) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:12:01.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:01 smithi007 bash[22722]: cluster 2024-09-14T04:12:00.790871+0000 mgr.a (mgr.14355) 15183 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:02.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:02.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:01 smithi131 bash[24745]: cluster 2024-09-14T04:12:00.790871+0000 mgr.a (mgr.14355) 15183 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:01 smithi171 bash[25040]: cluster 2024-09-14T04:12:00.790871+0000 mgr.a (mgr.14355) 15183 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:02 smithi007 bash[22722]: audit 2024-09-14T04:12:01.830195+0000 mgr.a (mgr.14355) 15184 : audit [DBG] from='client.328446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:02 smithi131 bash[24745]: audit 2024-09-14T04:12:01.830195+0000 mgr.a (mgr.14355) 15184 : audit [DBG] from='client.328446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:02 smithi171 bash[25040]: audit 2024-09-14T04:12:01.830195+0000 mgr.a (mgr.14355) 15184 : audit [DBG] from='client.328446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:03 smithi007 bash[22722]: cluster 2024-09-14T04:12:02.791796+0000 mgr.a (mgr.14355) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:03 smithi131 bash[24745]: cluster 2024-09-14T04:12:02.791796+0000 mgr.a (mgr.14355) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:03 smithi171 bash[25040]: cluster 2024-09-14T04:12:02.791796+0000 mgr.a (mgr.14355) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:05 smithi131 bash[24745]: cluster 2024-09-14T04:12:04.792875+0000 mgr.a (mgr.14355) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:05 smithi171 bash[25040]: cluster 2024-09-14T04:12:04.792875+0000 mgr.a (mgr.14355) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:05 smithi007 bash[22722]: cluster 2024-09-14T04:12:04.792875+0000 mgr.a (mgr.14355) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:08.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:08.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:07 smithi007 bash[22722]: cluster 2024-09-14T04:12:06.795164+0000 mgr.a (mgr.14355) 15187 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:07 smithi131 bash[24745]: cluster 2024-09-14T04:12:06.795164+0000 mgr.a (mgr.14355) 15187 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:07 smithi171 bash[25040]: cluster 2024-09-14T04:12:06.795164+0000 mgr.a (mgr.14355) 15187 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:08 smithi007 bash[22722]: audit 2024-09-14T04:12:07.603535+0000 mgr.a (mgr.14355) 15188 : audit [DBG] from='client.328518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:08 smithi131 bash[24745]: audit 2024-09-14T04:12:07.603535+0000 mgr.a (mgr.14355) 15188 : audit [DBG] from='client.328518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:08 smithi171 bash[25040]: audit 2024-09-14T04:12:07.603535+0000 mgr.a (mgr.14355) 15188 : audit [DBG] from='client.328518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:09 smithi007 bash[22722]: cluster 2024-09-14T04:12:08.796199+0000 mgr.a (mgr.14355) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:09 smithi131 bash[24745]: cluster 2024-09-14T04:12:08.796199+0000 mgr.a (mgr.14355) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:09 smithi171 bash[25040]: cluster 2024-09-14T04:12:08.796199+0000 mgr.a (mgr.14355) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:12:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:11 smithi007 bash[22722]: cluster 2024-09-14T04:12:10.798507+0000 mgr.a (mgr.14355) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:11 smithi131 bash[24745]: cluster 2024-09-14T04:12:10.798507+0000 mgr.a (mgr.14355) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:11 smithi171 bash[25040]: cluster 2024-09-14T04:12:10.798507+0000 mgr.a (mgr.14355) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:12:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:13.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:13.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:13.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:13.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:13.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:13.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:13 smithi007 bash[22722]: cluster 2024-09-14T04:12:12.799290+0000 mgr.a (mgr.14355) 15191 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:13 smithi131 bash[24745]: cluster 2024-09-14T04:12:12.799290+0000 mgr.a (mgr.14355) 15191 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:13 smithi171 bash[25040]: cluster 2024-09-14T04:12:12.799290+0000 mgr.a (mgr.14355) 15191 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:14 smithi007 bash[22722]: audit 2024-09-14T04:12:13.364820+0000 mgr.a (mgr.14355) 15192 : audit [DBG] from='client.328596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:14 smithi131 bash[24745]: audit 2024-09-14T04:12:13.364820+0000 mgr.a (mgr.14355) 15192 : audit [DBG] from='client.328596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:14 smithi171 bash[25040]: audit 2024-09-14T04:12:13.364820+0000 mgr.a (mgr.14355) 15192 : audit [DBG] from='client.328596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:15 smithi007 bash[22722]: cluster 2024-09-14T04:12:14.800196+0000 mgr.a (mgr.14355) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:15 smithi131 bash[24745]: cluster 2024-09-14T04:12:14.800196+0000 mgr.a (mgr.14355) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:15 smithi171 bash[25040]: cluster 2024-09-14T04:12:14.800196+0000 mgr.a (mgr.14355) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:17 smithi007 bash[22722]: cluster 2024-09-14T04:12:16.802947+0000 mgr.a (mgr.14355) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:17 smithi131 bash[24745]: cluster 2024-09-14T04:12:16.802947+0000 mgr.a (mgr.14355) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:17 smithi171 bash[25040]: cluster 2024-09-14T04:12:16.802947+0000 mgr.a (mgr.14355) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:18.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:19.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:19 smithi007 bash[22722]: cluster 2024-09-14T04:12:18.803735+0000 mgr.a (mgr.14355) 15195 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:19 smithi131 bash[24745]: cluster 2024-09-14T04:12:18.803735+0000 mgr.a (mgr.14355) 15195 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:19 smithi171 bash[25040]: cluster 2024-09-14T04:12:18.803735+0000 mgr.a (mgr.14355) 15195 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:20 smithi007 bash[22722]: audit 2024-09-14T04:12:19.137267+0000 mgr.a (mgr.14355) 15196 : audit [DBG] from='client.328671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:20 smithi131 bash[24745]: audit 2024-09-14T04:12:19.137267+0000 mgr.a (mgr.14355) 15196 : audit [DBG] from='client.328671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:20 smithi171 bash[25040]: audit 2024-09-14T04:12:19.137267+0000 mgr.a (mgr.14355) 15196 : audit [DBG] from='client.328671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:21 smithi007 bash[22722]: cluster 2024-09-14T04:12:20.806033+0000 mgr.a (mgr.14355) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-14T04:12:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:21 smithi007 bash[22722]: audit 2024-09-14T04:12:21.478105+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:12:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:21 smithi131 bash[24745]: cluster 2024-09-14T04:12:20.806033+0000 mgr.a (mgr.14355) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-14T04:12:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:21 smithi131 bash[24745]: audit 2024-09-14T04:12:21.478105+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:12:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:21 smithi171 bash[25040]: cluster 2024-09-14T04:12:20.806033+0000 mgr.a (mgr.14355) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 0 B/s wr, 39 op/s 2024-09-14T04:12:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:21 smithi171 bash[25040]: audit 2024-09-14T04:12:21.478105+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.112408+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.116424+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: cluster 2024-09-14T04:12:22.806798+0000 mgr.a (mgr.14355) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.886242+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.887885+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.896994+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.899477+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22722]: audit 2024-09-14T04:12:22.900640+0000 mgr.a (mgr.14355) 15199 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.112408+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.116424+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: cluster 2024-09-14T04:12:22.806798+0000 mgr.a (mgr.14355) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.886242+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.887885+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.896994+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.899477+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:23 smithi131 bash[24745]: audit 2024-09-14T04:12:22.900640+0000 mgr.a (mgr.14355) 15199 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.112408+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.116424+0000 mon.a (mon.0) 2859 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: cluster 2024-09-14T04:12:22.806798+0000 mgr.a (mgr.14355) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.886242+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:12:23.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.887885+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:12:23.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.896994+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:12:23.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.899477+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:23 smithi171 bash[25040]: audit 2024-09-14T04:12:22.900640+0000 mgr.a (mgr.14355) 15199 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:12:23.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22972]: debug 2024-09-14T04:12:23.630+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:12:23.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:12:23 smithi007 bash[22972]: debug 2024-09-14T04:12:23.634+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:12:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:24 smithi007 bash[22722]: audit 2024-09-14T04:12:23.633578+0000 mgr.a (mgr.14355) 15200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:12:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:24 smithi007 bash[22722]: cephadm 2024-09-14T04:12:23.634995+0000 mgr.a (mgr.14355) 15201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:12:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:24 smithi131 bash[24745]: audit 2024-09-14T04:12:23.633578+0000 mgr.a (mgr.14355) 15200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:12:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:24 smithi131 bash[24745]: cephadm 2024-09-14T04:12:23.634995+0000 mgr.a (mgr.14355) 15201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:12:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:24 smithi171 bash[25040]: audit 2024-09-14T04:12:23.633578+0000 mgr.a (mgr.14355) 15200 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:12:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:24 smithi171 bash[25040]: cephadm 2024-09-14T04:12:23.634995+0000 mgr.a (mgr.14355) 15201 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:12:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:25.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:25.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:25 smithi131 bash[24745]: cluster 2024-09-14T04:12:24.807586+0000 mgr.a (mgr.14355) 15202 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:25 smithi131 bash[24745]: audit 2024-09-14T04:12:24.894661+0000 mgr.a (mgr.14355) 15203 : audit [DBG] from='client.328848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:25 smithi171 bash[25040]: cluster 2024-09-14T04:12:24.807586+0000 mgr.a (mgr.14355) 15202 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:25 smithi171 bash[25040]: audit 2024-09-14T04:12:24.894661+0000 mgr.a (mgr.14355) 15203 : audit [DBG] from='client.328848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:25 smithi007 bash[22722]: cluster 2024-09-14T04:12:24.807586+0000 mgr.a (mgr.14355) 15202 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-09-14T04:12:26.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:25 smithi007 bash[22722]: audit 2024-09-14T04:12:24.894661+0000 mgr.a (mgr.14355) 15203 : audit [DBG] from='client.328848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:27 smithi007 bash[22722]: cluster 2024-09-14T04:12:26.809971+0000 mgr.a (mgr.14355) 15204 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T04:12:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:27 smithi131 bash[24745]: cluster 2024-09-14T04:12:26.809971+0000 mgr.a (mgr.14355) 15204 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T04:12:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:27 smithi171 bash[25040]: cluster 2024-09-14T04:12:26.809971+0000 mgr.a (mgr.14355) 15204 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-09-14T04:12:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:29 smithi007 bash[22722]: cluster 2024-09-14T04:12:28.810759+0000 mgr.a (mgr.14355) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:29 smithi131 bash[24745]: cluster 2024-09-14T04:12:28.810759+0000 mgr.a (mgr.14355) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:29 smithi171 bash[25040]: cluster 2024-09-14T04:12:28.810759+0000 mgr.a (mgr.14355) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:31.080 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:31.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:31.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:31.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:31.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:31 smithi007 bash[22722]: audit 2024-09-14T04:12:30.637771+0000 mgr.a (mgr.14355) 15206 : audit [DBG] from='client.328923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:31 smithi007 bash[22722]: cluster 2024-09-14T04:12:30.812154+0000 mgr.a (mgr.14355) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:31 smithi131 bash[24745]: audit 2024-09-14T04:12:30.637771+0000 mgr.a (mgr.14355) 15206 : audit [DBG] from='client.328923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:32.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:31 smithi131 bash[24745]: cluster 2024-09-14T04:12:30.812154+0000 mgr.a (mgr.14355) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:31 smithi171 bash[25040]: audit 2024-09-14T04:12:30.637771+0000 mgr.a (mgr.14355) 15206 : audit [DBG] from='client.328923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:31 smithi171 bash[25040]: cluster 2024-09-14T04:12:30.812154+0000 mgr.a (mgr.14355) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:12:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:33 smithi007 bash[22722]: cluster 2024-09-14T04:12:32.813085+0000 mgr.a (mgr.14355) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:33 smithi131 bash[24745]: cluster 2024-09-14T04:12:32.813085+0000 mgr.a (mgr.14355) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:33 smithi171 bash[25040]: cluster 2024-09-14T04:12:32.813085+0000 mgr.a (mgr.14355) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:36.082 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:35 smithi007 bash[22722]: cluster 2024-09-14T04:12:34.814060+0000 mgr.a (mgr.14355) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:35 smithi131 bash[24745]: cluster 2024-09-14T04:12:34.814060+0000 mgr.a (mgr.14355) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:35 smithi171 bash[25040]: cluster 2024-09-14T04:12:34.814060+0000 mgr.a (mgr.14355) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 426 B/s wr, 22 op/s 2024-09-14T04:12:36.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:36.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:36.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:36.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:36.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:37 smithi007 bash[22722]: audit 2024-09-14T04:12:36.417815+0000 mgr.a (mgr.14355) 15210 : audit [DBG] from='client.329001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:37 smithi007 bash[22722]: cluster 2024-09-14T04:12:36.815708+0000 mgr.a (mgr.14355) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 426 B/s wr, 23 op/s 2024-09-14T04:12:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:37 smithi131 bash[24745]: audit 2024-09-14T04:12:36.417815+0000 mgr.a (mgr.14355) 15210 : audit [DBG] from='client.329001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:38.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:37 smithi131 bash[24745]: cluster 2024-09-14T04:12:36.815708+0000 mgr.a (mgr.14355) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 426 B/s wr, 23 op/s 2024-09-14T04:12:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:37 smithi171 bash[25040]: audit 2024-09-14T04:12:36.417815+0000 mgr.a (mgr.14355) 15210 : audit [DBG] from='client.329001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:37 smithi171 bash[25040]: cluster 2024-09-14T04:12:36.815708+0000 mgr.a (mgr.14355) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 426 B/s wr, 23 op/s 2024-09-14T04:12:40.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:39 smithi007 bash[22722]: cluster 2024-09-14T04:12:38.816453+0000 mgr.a (mgr.14355) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:12:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:39 smithi131 bash[24745]: cluster 2024-09-14T04:12:38.816453+0000 mgr.a (mgr.14355) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:12:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:39 smithi171 bash[25040]: cluster 2024-09-14T04:12:38.816453+0000 mgr.a (mgr.14355) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:12:41.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:41 smithi007 bash[22722]: cluster 2024-09-14T04:12:40.818432+0000 mgr.a (mgr.14355) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:12:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:41 smithi131 bash[24745]: cluster 2024-09-14T04:12:40.818432+0000 mgr.a (mgr.14355) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:12:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:41 smithi171 bash[25040]: cluster 2024-09-14T04:12:40.818432+0000 mgr.a (mgr.14355) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:12:42.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:43 smithi007 bash[22722]: audit 2024-09-14T04:12:42.191319+0000 mgr.a (mgr.14355) 15214 : audit [DBG] from='client.329076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:43 smithi007 bash[22722]: cluster 2024-09-14T04:12:42.819262+0000 mgr.a (mgr.14355) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:43 smithi131 bash[24745]: audit 2024-09-14T04:12:42.191319+0000 mgr.a (mgr.14355) 15214 : audit [DBG] from='client.329076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:43 smithi131 bash[24745]: cluster 2024-09-14T04:12:42.819262+0000 mgr.a (mgr.14355) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:43 smithi171 bash[25040]: audit 2024-09-14T04:12:42.191319+0000 mgr.a (mgr.14355) 15214 : audit [DBG] from='client.329076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:43 smithi171 bash[25040]: cluster 2024-09-14T04:12:42.819262+0000 mgr.a (mgr.14355) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:45 smithi131 bash[24745]: cluster 2024-09-14T04:12:44.820201+0000 mgr.a (mgr.14355) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:45 smithi171 bash[25040]: cluster 2024-09-14T04:12:44.820201+0000 mgr.a (mgr.14355) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:45 smithi007 bash[22722]: cluster 2024-09-14T04:12:44.820201+0000 mgr.a (mgr.14355) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:47 smithi007 bash[22722]: cluster 2024-09-14T04:12:46.822501+0000 mgr.a (mgr.14355) 15217 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:47 smithi131 bash[24745]: cluster 2024-09-14T04:12:46.822501+0000 mgr.a (mgr.14355) 15217 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:47 smithi171 bash[25040]: cluster 2024-09-14T04:12:46.822501+0000 mgr.a (mgr.14355) 15217 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:48.385 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:48.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:48.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:48.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:48.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:49 smithi007 bash[22722]: audit 2024-09-14T04:12:47.954809+0000 mgr.a (mgr.14355) 15218 : audit [DBG] from='client.329151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:49 smithi007 bash[22722]: cluster 2024-09-14T04:12:48.823376+0000 mgr.a (mgr.14355) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:49 smithi131 bash[24745]: audit 2024-09-14T04:12:47.954809+0000 mgr.a (mgr.14355) 15218 : audit [DBG] from='client.329151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:50.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:49 smithi131 bash[24745]: cluster 2024-09-14T04:12:48.823376+0000 mgr.a (mgr.14355) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:49 smithi171 bash[25040]: audit 2024-09-14T04:12:47.954809+0000 mgr.a (mgr.14355) 15218 : audit [DBG] from='client.329151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:49 smithi171 bash[25040]: cluster 2024-09-14T04:12:48.823376+0000 mgr.a (mgr.14355) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:51 smithi007 bash[22722]: cluster 2024-09-14T04:12:50.825614+0000 mgr.a (mgr.14355) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:51 smithi131 bash[24745]: cluster 2024-09-14T04:12:50.825614+0000 mgr.a (mgr.14355) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:51 smithi171 bash[25040]: cluster 2024-09-14T04:12:50.825614+0000 mgr.a (mgr.14355) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:53.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:53.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:53.388 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:54.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:54.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:54.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:12:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:53 smithi007 bash[22722]: cluster 2024-09-14T04:12:52.826381+0000 mgr.a (mgr.14355) 15221 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:53 smithi131 bash[24745]: cluster 2024-09-14T04:12:52.826381+0000 mgr.a (mgr.14355) 15221 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:53 smithi171 bash[25040]: cluster 2024-09-14T04:12:52.826381+0000 mgr.a (mgr.14355) 15221 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:54 smithi007 bash[22722]: audit 2024-09-14T04:12:53.717148+0000 mgr.a (mgr.14355) 15222 : audit [DBG] from='client.329229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:54 smithi131 bash[24745]: audit 2024-09-14T04:12:53.717148+0000 mgr.a (mgr.14355) 15222 : audit [DBG] from='client.329229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:54 smithi171 bash[25040]: audit 2024-09-14T04:12:53.717148+0000 mgr.a (mgr.14355) 15222 : audit [DBG] from='client.329229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:12:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:55 smithi007 bash[22722]: cluster 2024-09-14T04:12:54.827237+0000 mgr.a (mgr.14355) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:56.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:55 smithi131 bash[24745]: cluster 2024-09-14T04:12:54.827237+0000 mgr.a (mgr.14355) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:55 smithi171 bash[25040]: cluster 2024-09-14T04:12:54.827237+0000 mgr.a (mgr.14355) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:12:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:57 smithi007 bash[22722]: cluster 2024-09-14T04:12:56.829494+0000 mgr.a (mgr.14355) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:57 smithi131 bash[24745]: cluster 2024-09-14T04:12:56.829494+0000 mgr.a (mgr.14355) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:57 smithi171 bash[25040]: cluster 2024-09-14T04:12:56.829494+0000 mgr.a (mgr.14355) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:12:59.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:12:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:12:59.164 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:12:59.910 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:12:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:12:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:12:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:12:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:12:59 smithi007 bash[22722]: cluster 2024-09-14T04:12:58.830255+0000 mgr.a (mgr.14355) 15225 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:12:59 smithi131 bash[24745]: cluster 2024-09-14T04:12:58.830255+0000 mgr.a (mgr.14355) 15225 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:12:59 smithi171 bash[25040]: cluster 2024-09-14T04:12:58.830255+0000 mgr.a (mgr.14355) 15225 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:00 smithi007 bash[22722]: audit 2024-09-14T04:12:59.494927+0000 mgr.a (mgr.14355) 15226 : audit [DBG] from='client.329301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:00 smithi131 bash[24745]: audit 2024-09-14T04:12:59.494927+0000 mgr.a (mgr.14355) 15226 : audit [DBG] from='client.329301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:00 smithi171 bash[25040]: audit 2024-09-14T04:12:59.494927+0000 mgr.a (mgr.14355) 15226 : audit [DBG] from='client.329301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:02.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:01 smithi007 bash[22722]: cluster 2024-09-14T04:13:00.832616+0000 mgr.a (mgr.14355) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:02.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:01 smithi131 bash[24745]: cluster 2024-09-14T04:13:00.832616+0000 mgr.a (mgr.14355) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:02.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:01 smithi171 bash[25040]: cluster 2024-09-14T04:13:00.832616+0000 mgr.a (mgr.14355) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:03 smithi007 bash[22722]: cluster 2024-09-14T04:13:02.833398+0000 mgr.a (mgr.14355) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:03 smithi131 bash[24745]: cluster 2024-09-14T04:13:02.833398+0000 mgr.a (mgr.14355) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:03 smithi171 bash[25040]: cluster 2024-09-14T04:13:02.833398+0000 mgr.a (mgr.14355) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:04.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:04.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:04.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:04 smithi131 bash[24745]: cluster 2024-09-14T04:13:04.834166+0000 mgr.a (mgr.14355) 15229 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:04 smithi171 bash[25040]: cluster 2024-09-14T04:13:04.834166+0000 mgr.a (mgr.14355) 15229 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:04 smithi007 bash[22722]: cluster 2024-09-14T04:13:04.834166+0000 mgr.a (mgr.14355) 15229 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:05.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:05.679 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:05 smithi131 bash[24745]: audit 2024-09-14T04:13:05.247159+0000 mgr.a (mgr.14355) 15230 : audit [DBG] from='client.329376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:05 smithi171 bash[25040]: audit 2024-09-14T04:13:05.247159+0000 mgr.a (mgr.14355) 15230 : audit [DBG] from='client.329376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:05 smithi007 bash[22722]: audit 2024-09-14T04:13:05.247159+0000 mgr.a (mgr.14355) 15230 : audit [DBG] from='client.329376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:06 smithi131 bash[24745]: cluster 2024-09-14T04:13:06.836978+0000 mgr.a (mgr.14355) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:06 smithi171 bash[25040]: cluster 2024-09-14T04:13:06.836978+0000 mgr.a (mgr.14355) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:06 smithi007 bash[22722]: cluster 2024-09-14T04:13:06.836978+0000 mgr.a (mgr.14355) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:09 smithi007 bash[22722]: cluster 2024-09-14T04:13:08.837782+0000 mgr.a (mgr.14355) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:09 smithi131 bash[24745]: cluster 2024-09-14T04:13:08.837782+0000 mgr.a (mgr.14355) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:09 smithi171 bash[25040]: cluster 2024-09-14T04:13:08.837782+0000 mgr.a (mgr.14355) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:10.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:10.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:11.462 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:11.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:11.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:11.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:11.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:11 smithi007 bash[22722]: cluster 2024-09-14T04:13:10.839742+0000 mgr.a (mgr.14355) 15233 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:11 smithi131 bash[24745]: cluster 2024-09-14T04:13:10.839742+0000 mgr.a (mgr.14355) 15233 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:11 smithi171 bash[25040]: cluster 2024-09-14T04:13:10.839742+0000 mgr.a (mgr.14355) 15233 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:12 smithi007 bash[22722]: audit 2024-09-14T04:13:11.016588+0000 mgr.a (mgr.14355) 15234 : audit [DBG] from='client.329454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:12 smithi131 bash[24745]: audit 2024-09-14T04:13:11.016588+0000 mgr.a (mgr.14355) 15234 : audit [DBG] from='client.329454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:12 smithi171 bash[25040]: audit 2024-09-14T04:13:11.016588+0000 mgr.a (mgr.14355) 15234 : audit [DBG] from='client.329454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:13 smithi007 bash[22722]: cluster 2024-09-14T04:13:12.840695+0000 mgr.a (mgr.14355) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:13 smithi131 bash[24745]: cluster 2024-09-14T04:13:12.840695+0000 mgr.a (mgr.14355) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:13 smithi171 bash[25040]: cluster 2024-09-14T04:13:12.840695+0000 mgr.a (mgr.14355) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:15 smithi007 bash[22722]: cluster 2024-09-14T04:13:14.841467+0000 mgr.a (mgr.14355) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:13:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:15 smithi131 bash[24745]: cluster 2024-09-14T04:13:14.841467+0000 mgr.a (mgr.14355) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:13:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:15 smithi171 bash[25040]: cluster 2024-09-14T04:13:14.841467+0000 mgr.a (mgr.14355) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:13:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:16.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:16.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:17.246 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:17.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:17 smithi007 bash[22722]: audit 2024-09-14T04:13:16.797551+0000 mgr.a (mgr.14355) 15237 : audit [DBG] from='client.329532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:17 smithi007 bash[22722]: cluster 2024-09-14T04:13:16.844582+0000 mgr.a (mgr.14355) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:17 smithi131 bash[24745]: audit 2024-09-14T04:13:16.797551+0000 mgr.a (mgr.14355) 15237 : audit [DBG] from='client.329532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:18.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:17 smithi131 bash[24745]: cluster 2024-09-14T04:13:16.844582+0000 mgr.a (mgr.14355) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:17 smithi171 bash[25040]: audit 2024-09-14T04:13:16.797551+0000 mgr.a (mgr.14355) 15237 : audit [DBG] from='client.329532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:17 smithi171 bash[25040]: cluster 2024-09-14T04:13:16.844582+0000 mgr.a (mgr.14355) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:20.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:19 smithi007 bash[22722]: cluster 2024-09-14T04:13:18.845622+0000 mgr.a (mgr.14355) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:19 smithi131 bash[24745]: cluster 2024-09-14T04:13:18.845622+0000 mgr.a (mgr.14355) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:20.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:19 smithi171 bash[25040]: cluster 2024-09-14T04:13:18.845622+0000 mgr.a (mgr.14355) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:20 smithi131 bash[24745]: cluster 2024-09-14T04:13:20.847889+0000 mgr.a (mgr.14355) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:20 smithi171 bash[25040]: cluster 2024-09-14T04:13:20.847889+0000 mgr.a (mgr.14355) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:20 smithi007 bash[22722]: cluster 2024-09-14T04:13:20.847889+0000 mgr.a (mgr.14355) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:13:22.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:22.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:22.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:23.039 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:23.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:23.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:23.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:23.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:23 smithi007 bash[22722]: audit 2024-09-14T04:13:22.589518+0000 mgr.a (mgr.14355) 15241 : audit [DBG] from='client.329610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:23 smithi007 bash[22722]: cluster 2024-09-14T04:13:22.848449+0000 mgr.a (mgr.14355) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:23 smithi007 bash[22722]: audit 2024-09-14T04:13:23.688823+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:13:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:23 smithi131 bash[24745]: audit 2024-09-14T04:13:22.589518+0000 mgr.a (mgr.14355) 15241 : audit [DBG] from='client.329610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:23 smithi131 bash[24745]: cluster 2024-09-14T04:13:22.848449+0000 mgr.a (mgr.14355) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:23 smithi131 bash[24745]: audit 2024-09-14T04:13:23.688823+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:13:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:23 smithi171 bash[25040]: audit 2024-09-14T04:13:22.589518+0000 mgr.a (mgr.14355) 15241 : audit [DBG] from='client.329610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:23 smithi171 bash[25040]: cluster 2024-09-14T04:13:22.848449+0000 mgr.a (mgr.14355) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:23 smithi171 bash[25040]: audit 2024-09-14T04:13:23.688823+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.304971+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.311069+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.317173+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.323509+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: cluster 2024-09-14T04:13:24.849281+0000 mgr.a (mgr.14355) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.973690+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.975313+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.985460+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22722]: audit 2024-09-14T04:13:24.990932+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.304971+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.311069+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.317173+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.323509+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: cluster 2024-09-14T04:13:24.849281+0000 mgr.a (mgr.14355) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.973690+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:13:25.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.975313+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:13:25.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.985460+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:25 smithi131 bash[24745]: audit 2024-09-14T04:13:24.990932+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.304971+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.311069+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.317173+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.323509+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: cluster 2024-09-14T04:13:24.849281+0000 mgr.a (mgr.14355) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.973690+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:13:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.975313+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:13:25.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.985460+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:13:25.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:25 smithi171 bash[25040]: audit 2024-09-14T04:13:24.990932+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:26.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22972]: debug 2024-09-14T04:13:25.741+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:13:26.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:13:25 smithi007 bash[22972]: debug 2024-09-14T04:13:25.741+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:13:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:26 smithi007 bash[22722]: audit 2024-09-14T04:13:24.993419+0000 mgr.a (mgr.14355) 15244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:26 smithi007 bash[22722]: audit 2024-09-14T04:13:25.744320+0000 mgr.a (mgr.14355) 15245 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:13:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:26 smithi007 bash[22722]: cephadm 2024-09-14T04:13:25.746211+0000 mgr.a (mgr.14355) 15246 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:13:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:26 smithi131 bash[24745]: audit 2024-09-14T04:13:24.993419+0000 mgr.a (mgr.14355) 15244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:26 smithi131 bash[24745]: audit 2024-09-14T04:13:25.744320+0000 mgr.a (mgr.14355) 15245 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:13:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:26 smithi131 bash[24745]: cephadm 2024-09-14T04:13:25.746211+0000 mgr.a (mgr.14355) 15246 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:13:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:26 smithi171 bash[25040]: audit 2024-09-14T04:13:24.993419+0000 mgr.a (mgr.14355) 15244 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:13:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:26 smithi171 bash[25040]: audit 2024-09-14T04:13:25.744320+0000 mgr.a (mgr.14355) 15245 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:13:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:26 smithi171 bash[25040]: cephadm 2024-09-14T04:13:25.746211+0000 mgr.a (mgr.14355) 15246 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:13:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:27 smithi007 bash[22722]: cluster 2024-09-14T04:13:26.852142+0000 mgr.a (mgr.14355) 15247 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T04:13:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:27 smithi131 bash[24745]: cluster 2024-09-14T04:13:26.852142+0000 mgr.a (mgr.14355) 15247 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T04:13:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:27 smithi171 bash[25040]: cluster 2024-09-14T04:13:26.852142+0000 mgr.a (mgr.14355) 15247 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-14T04:13:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:28.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:28.825 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:28.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:28.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:28.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:28.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:29 smithi007 bash[22722]: audit 2024-09-14T04:13:28.380791+0000 mgr.a (mgr.14355) 15248 : audit [DBG] from='client.329793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:29 smithi007 bash[22722]: cluster 2024-09-14T04:13:28.852920+0000 mgr.a (mgr.14355) 15249 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:13:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:29 smithi131 bash[24745]: audit 2024-09-14T04:13:28.380791+0000 mgr.a (mgr.14355) 15248 : audit [DBG] from='client.329793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:29 smithi131 bash[24745]: cluster 2024-09-14T04:13:28.852920+0000 mgr.a (mgr.14355) 15249 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:13:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:29 smithi171 bash[25040]: audit 2024-09-14T04:13:28.380791+0000 mgr.a (mgr.14355) 15248 : audit [DBG] from='client.329793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:29 smithi171 bash[25040]: cluster 2024-09-14T04:13:28.852920+0000 mgr.a (mgr.14355) 15249 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:13:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:31 smithi007 bash[22722]: cluster 2024-09-14T04:13:30.855110+0000 mgr.a (mgr.14355) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:31 smithi131 bash[24745]: cluster 2024-09-14T04:13:30.855110+0000 mgr.a (mgr.14355) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:31 smithi171 bash[25040]: cluster 2024-09-14T04:13:30.855110+0000 mgr.a (mgr.14355) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:33.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:33.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:33 smithi007 bash[22722]: cluster 2024-09-14T04:13:32.855884+0000 mgr.a (mgr.14355) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:33 smithi131 bash[24745]: cluster 2024-09-14T04:13:32.855884+0000 mgr.a (mgr.14355) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:33 smithi171 bash[25040]: cluster 2024-09-14T04:13:32.855884+0000 mgr.a (mgr.14355) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:34.585 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:34.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:34.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:34.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:35 smithi007 bash[22722]: audit 2024-09-14T04:13:34.158093+0000 mgr.a (mgr.14355) 15252 : audit [DBG] from='client.329871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:35 smithi007 bash[22722]: cluster 2024-09-14T04:13:34.856801+0000 mgr.a (mgr.14355) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:35 smithi131 bash[24745]: audit 2024-09-14T04:13:34.158093+0000 mgr.a (mgr.14355) 15252 : audit [DBG] from='client.329871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:35 smithi131 bash[24745]: cluster 2024-09-14T04:13:34.856801+0000 mgr.a (mgr.14355) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:35 smithi171 bash[25040]: audit 2024-09-14T04:13:34.158093+0000 mgr.a (mgr.14355) 15252 : audit [DBG] from='client.329871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:35 smithi171 bash[25040]: cluster 2024-09-14T04:13:34.856801+0000 mgr.a (mgr.14355) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:37 smithi007 bash[22722]: cluster 2024-09-14T04:13:36.859084+0000 mgr.a (mgr.14355) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:37 smithi131 bash[24745]: cluster 2024-09-14T04:13:36.859084+0000 mgr.a (mgr.14355) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:37 smithi171 bash[25040]: cluster 2024-09-14T04:13:36.859084+0000 mgr.a (mgr.14355) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:13:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:38 smithi131 bash[24745]: cluster 2024-09-14T04:13:38.859858+0000 mgr.a (mgr.14355) 15255 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:38 smithi171 bash[25040]: cluster 2024-09-14T04:13:38.859858+0000 mgr.a (mgr.14355) 15255 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:38 smithi007 bash[22722]: cluster 2024-09-14T04:13:38.859858+0000 mgr.a (mgr.14355) 15255 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:39.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:39 smithi131 bash[24745]: audit 2024-09-14T04:13:39.920627+0000 mgr.a (mgr.14355) 15256 : audit [DBG] from='client.329949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:39 smithi171 bash[25040]: audit 2024-09-14T04:13:39.920627+0000 mgr.a (mgr.14355) 15256 : audit [DBG] from='client.329949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:40.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:39 smithi007 bash[22722]: audit 2024-09-14T04:13:39.920627+0000 mgr.a (mgr.14355) 15256 : audit [DBG] from='client.329949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:40 smithi131 bash[24745]: cluster 2024-09-14T04:13:40.862422+0000 mgr.a (mgr.14355) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:40 smithi171 bash[25040]: cluster 2024-09-14T04:13:40.862422+0000 mgr.a (mgr.14355) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:40 smithi007 bash[22722]: cluster 2024-09-14T04:13:40.862422+0000 mgr.a (mgr.14355) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:13:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:43 smithi007 bash[22722]: cluster 2024-09-14T04:13:42.863386+0000 mgr.a (mgr.14355) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:43 smithi131 bash[24745]: cluster 2024-09-14T04:13:42.863386+0000 mgr.a (mgr.14355) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:43 smithi171 bash[25040]: cluster 2024-09-14T04:13:42.863386+0000 mgr.a (mgr.14355) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:45.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:45.356 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:46.130 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:45 smithi007 bash[22722]: cluster 2024-09-14T04:13:44.864183+0000 mgr.a (mgr.14355) 15259 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:45 smithi131 bash[24745]: cluster 2024-09-14T04:13:44.864183+0000 mgr.a (mgr.14355) 15259 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:45 smithi171 bash[25040]: cluster 2024-09-14T04:13:44.864183+0000 mgr.a (mgr.14355) 15259 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:13:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:46 smithi007 bash[22722]: audit 2024-09-14T04:13:45.690501+0000 mgr.a (mgr.14355) 15260 : audit [DBG] from='client.330024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:46 smithi131 bash[24745]: audit 2024-09-14T04:13:45.690501+0000 mgr.a (mgr.14355) 15260 : audit [DBG] from='client.330024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:46 smithi171 bash[25040]: audit 2024-09-14T04:13:45.690501+0000 mgr.a (mgr.14355) 15260 : audit [DBG] from='client.330024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:47 smithi007 bash[22722]: cluster 2024-09-14T04:13:46.867029+0000 mgr.a (mgr.14355) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:47 smithi131 bash[24745]: cluster 2024-09-14T04:13:46.867029+0000 mgr.a (mgr.14355) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:47 smithi171 bash[25040]: cluster 2024-09-14T04:13:46.867029+0000 mgr.a (mgr.14355) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:48 smithi131 bash[24745]: cluster 2024-09-14T04:13:48.867820+0000 mgr.a (mgr.14355) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:48 smithi171 bash[25040]: cluster 2024-09-14T04:13:48.867820+0000 mgr.a (mgr.14355) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:48 smithi007 bash[22722]: cluster 2024-09-14T04:13:48.867820+0000 mgr.a (mgr.14355) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:13:51.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:51.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:51.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:51.892 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:51.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:51 smithi007 bash[22722]: cluster 2024-09-14T04:13:50.869758+0000 mgr.a (mgr.14355) 15263 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:51 smithi131 bash[24745]: cluster 2024-09-14T04:13:50.869758+0000 mgr.a (mgr.14355) 15263 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:51 smithi171 bash[25040]: cluster 2024-09-14T04:13:50.869758+0000 mgr.a (mgr.14355) 15263 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:13:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:52 smithi007 bash[22722]: audit 2024-09-14T04:13:51.463345+0000 mgr.a (mgr.14355) 15264 : audit [DBG] from='client.330102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:52 smithi131 bash[24745]: audit 2024-09-14T04:13:51.463345+0000 mgr.a (mgr.14355) 15264 : audit [DBG] from='client.330102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:52 smithi171 bash[25040]: audit 2024-09-14T04:13:51.463345+0000 mgr.a (mgr.14355) 15264 : audit [DBG] from='client.330102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:53 smithi007 bash[22722]: cluster 2024-09-14T04:13:52.870762+0000 mgr.a (mgr.14355) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:53 smithi131 bash[24745]: cluster 2024-09-14T04:13:52.870762+0000 mgr.a (mgr.14355) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:53 smithi171 bash[25040]: cluster 2024-09-14T04:13:52.870762+0000 mgr.a (mgr.14355) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:54 smithi131 bash[24745]: cluster 2024-09-14T04:13:54.871562+0000 mgr.a (mgr.14355) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:54 smithi171 bash[25040]: cluster 2024-09-14T04:13:54.871562+0000 mgr.a (mgr.14355) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:54 smithi007 bash[22722]: cluster 2024-09-14T04:13:54.871562+0000 mgr.a (mgr.14355) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:13:56.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:13:56.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:13:56.895 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:13:57.657 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:13:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:13:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:13:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:13:57.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:13:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:57 smithi007 bash[22722]: cluster 2024-09-14T04:13:56.873788+0000 mgr.a (mgr.14355) 15267 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:13:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:57 smithi131 bash[24745]: cluster 2024-09-14T04:13:56.873788+0000 mgr.a (mgr.14355) 15267 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:13:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:57 smithi171 bash[25040]: cluster 2024-09-14T04:13:56.873788+0000 mgr.a (mgr.14355) 15267 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:13:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:58 smithi007 bash[22722]: audit 2024-09-14T04:13:57.220672+0000 mgr.a (mgr.14355) 15268 : audit [DBG] from='client.330180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:58 smithi131 bash[24745]: audit 2024-09-14T04:13:57.220672+0000 mgr.a (mgr.14355) 15268 : audit [DBG] from='client.330180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:13:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:58 smithi171 bash[25040]: audit 2024-09-14T04:13:57.220672+0000 mgr.a (mgr.14355) 15268 : audit [DBG] from='client.330180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:13:59 smithi007 bash[22722]: cluster 2024-09-14T04:13:58.874742+0000 mgr.a (mgr.14355) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:13:59 smithi131 bash[24745]: cluster 2024-09-14T04:13:58.874742+0000 mgr.a (mgr.14355) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:13:59 smithi171 bash[25040]: cluster 2024-09-14T04:13:58.874742+0000 mgr.a (mgr.14355) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:00 smithi007 bash[22722]: cluster 2024-09-14T04:14:00.876973+0000 mgr.a (mgr.14355) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:00 smithi131 bash[24745]: cluster 2024-09-14T04:14:00.876973+0000 mgr.a (mgr.14355) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:00 smithi171 bash[25040]: cluster 2024-09-14T04:14:00.876973+0000 mgr.a (mgr.14355) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:02.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:03.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:03 smithi007 bash[22722]: cluster 2024-09-14T04:14:02.877717+0000 mgr.a (mgr.14355) 15271 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:03 smithi131 bash[24745]: cluster 2024-09-14T04:14:02.877717+0000 mgr.a (mgr.14355) 15271 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:03 smithi171 bash[25040]: cluster 2024-09-14T04:14:02.877717+0000 mgr.a (mgr.14355) 15271 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:04 smithi007 bash[22722]: audit 2024-09-14T04:14:03.001305+0000 mgr.a (mgr.14355) 15272 : audit [DBG] from='client.330252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:04 smithi131 bash[24745]: audit 2024-09-14T04:14:03.001305+0000 mgr.a (mgr.14355) 15272 : audit [DBG] from='client.330252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:04 smithi171 bash[25040]: audit 2024-09-14T04:14:03.001305+0000 mgr.a (mgr.14355) 15272 : audit [DBG] from='client.330252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:05 smithi007 bash[22722]: cluster 2024-09-14T04:14:04.878651+0000 mgr.a (mgr.14355) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:05 smithi131 bash[24745]: cluster 2024-09-14T04:14:04.878651+0000 mgr.a (mgr.14355) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:05 smithi171 bash[25040]: cluster 2024-09-14T04:14:04.878651+0000 mgr.a (mgr.14355) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:06 smithi007 bash[22722]: cluster 2024-09-14T04:14:06.880941+0000 mgr.a (mgr.14355) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:06 smithi131 bash[24745]: cluster 2024-09-14T04:14:06.880941+0000 mgr.a (mgr.14355) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:06 smithi171 bash[25040]: cluster 2024-09-14T04:14:06.880941+0000 mgr.a (mgr.14355) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:08.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:08.442 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:09.216 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:09 smithi007 bash[22722]: audit 2024-09-14T04:14:08.771273+0000 mgr.a (mgr.14355) 15275 : audit [DBG] from='client.330330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:09 smithi007 bash[22722]: cluster 2024-09-14T04:14:08.881499+0000 mgr.a (mgr.14355) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:09 smithi131 bash[24745]: audit 2024-09-14T04:14:08.771273+0000 mgr.a (mgr.14355) 15275 : audit [DBG] from='client.330330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:10.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:09 smithi131 bash[24745]: cluster 2024-09-14T04:14:08.881499+0000 mgr.a (mgr.14355) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:09 smithi171 bash[25040]: audit 2024-09-14T04:14:08.771273+0000 mgr.a (mgr.14355) 15275 : audit [DBG] from='client.330330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:09 smithi171 bash[25040]: cluster 2024-09-14T04:14:08.881499+0000 mgr.a (mgr.14355) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:11 smithi007 bash[22722]: cluster 2024-09-14T04:14:10.883773+0000 mgr.a (mgr.14355) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:11 smithi131 bash[24745]: cluster 2024-09-14T04:14:10.883773+0000 mgr.a (mgr.14355) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:11 smithi171 bash[25040]: cluster 2024-09-14T04:14:10.883773+0000 mgr.a (mgr.14355) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:12 smithi131 bash[24745]: cluster 2024-09-14T04:14:12.884553+0000 mgr.a (mgr.14355) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:12 smithi171 bash[25040]: cluster 2024-09-14T04:14:12.884553+0000 mgr.a (mgr.14355) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:12 smithi007 bash[22722]: cluster 2024-09-14T04:14:12.884553+0000 mgr.a (mgr.14355) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:14.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:14.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:14.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:14.991 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:14.992 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:14 smithi131 bash[24745]: audit 2024-09-14T04:14:14.549876+0000 mgr.a (mgr.14355) 15279 : audit [DBG] from='client.330402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:14 smithi131 bash[24745]: cluster 2024-09-14T04:14:14.891112+0000 mgr.a (mgr.14355) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:14 smithi171 bash[25040]: audit 2024-09-14T04:14:14.549876+0000 mgr.a (mgr.14355) 15279 : audit [DBG] from='client.330402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:14 smithi171 bash[25040]: cluster 2024-09-14T04:14:14.891112+0000 mgr.a (mgr.14355) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:14 smithi007 bash[22722]: audit 2024-09-14T04:14:14.549876+0000 mgr.a (mgr.14355) 15279 : audit [DBG] from='client.330402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:14 smithi007 bash[22722]: cluster 2024-09-14T04:14:14.891112+0000 mgr.a (mgr.14355) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:16 smithi131 bash[24745]: cluster 2024-09-14T04:14:16.893362+0000 mgr.a (mgr.14355) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:16 smithi171 bash[25040]: cluster 2024-09-14T04:14:16.893362+0000 mgr.a (mgr.14355) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:16 smithi007 bash[22722]: cluster 2024-09-14T04:14:16.893362+0000 mgr.a (mgr.14355) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:18 smithi131 bash[24745]: cluster 2024-09-14T04:14:18.894148+0000 mgr.a (mgr.14355) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:18 smithi171 bash[25040]: cluster 2024-09-14T04:14:18.894148+0000 mgr.a (mgr.14355) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:18 smithi007 bash[22722]: cluster 2024-09-14T04:14:18.894148+0000 mgr.a (mgr.14355) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:19.993 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:20.774 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:20.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:20.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:20.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:20.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:20 smithi131 bash[24745]: audit 2024-09-14T04:14:20.328038+0000 mgr.a (mgr.14355) 15283 : audit [DBG] from='client.330477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:20 smithi131 bash[24745]: cluster 2024-09-14T04:14:20.896937+0000 mgr.a (mgr.14355) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:20 smithi171 bash[25040]: audit 2024-09-14T04:14:20.328038+0000 mgr.a (mgr.14355) 15283 : audit [DBG] from='client.330477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:20 smithi171 bash[25040]: cluster 2024-09-14T04:14:20.896937+0000 mgr.a (mgr.14355) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:20 smithi007 bash[22722]: audit 2024-09-14T04:14:20.328038+0000 mgr.a (mgr.14355) 15283 : audit [DBG] from='client.330477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:20 smithi007 bash[22722]: cluster 2024-09-14T04:14:20.896937+0000 mgr.a (mgr.14355) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:22 smithi131 bash[24745]: cluster 2024-09-14T04:14:22.897732+0000 mgr.a (mgr.14355) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:22 smithi171 bash[25040]: cluster 2024-09-14T04:14:22.897732+0000 mgr.a (mgr.14355) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:22 smithi007 bash[22722]: cluster 2024-09-14T04:14:22.897732+0000 mgr.a (mgr.14355) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:24 smithi131 bash[24745]: cluster 2024-09-14T04:14:24.898537+0000 mgr.a (mgr.14355) 15286 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:24 smithi171 bash[25040]: cluster 2024-09-14T04:14:24.898537+0000 mgr.a (mgr.14355) 15286 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:24 smithi007 bash[22722]: cluster 2024-09-14T04:14:24.898537+0000 mgr.a (mgr.14355) 15286 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:25.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:25.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:25.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:25 smithi131 bash[24745]: audit 2024-09-14T04:14:25.797004+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:14:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:25 smithi171 bash[25040]: audit 2024-09-14T04:14:25.797004+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:14:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:25 smithi007 bash[22722]: audit 2024-09-14T04:14:25.797004+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:14:26.602 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:26.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.151243+0000 mgr.a (mgr.14355) 15287 : audit [DBG] from='client.330552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.626540+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.627453+0000 mon.a (mon.0) 2875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.632610+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.634649+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: audit 2024-09-14T04:14:26.635731+0000 mgr.a (mgr.14355) 15288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:27 smithi131 bash[24745]: cluster 2024-09-14T04:14:26.899856+0000 mgr.a (mgr.14355) 15289 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.151243+0000 mgr.a (mgr.14355) 15287 : audit [DBG] from='client.330552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.626540+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.627453+0000 mon.a (mon.0) 2875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.632610+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.634649+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:26 smithi171 bash[25040]: audit 2024-09-14T04:14:26.635731+0000 mgr.a (mgr.14355) 15288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:27 smithi171 bash[25040]: cluster 2024-09-14T04:14:26.899856+0000 mgr.a (mgr.14355) 15289 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.151243+0000 mgr.a (mgr.14355) 15287 : audit [DBG] from='client.330552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.626540+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.627453+0000 mon.a (mon.0) 2875 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.632610+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.634649+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: audit 2024-09-14T04:14:26.635731+0000 mgr.a (mgr.14355) 15288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:14:27.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:26 smithi007 bash[22722]: cluster 2024-09-14T04:14:26.899856+0000 mgr.a (mgr.14355) 15289 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:27.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:14:27 smithi007 bash[22972]: debug 2024-09-14T04:14:27.352+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:14:27.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:14:27 smithi007 bash[22972]: debug 2024-09-14T04:14:27.352+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:14:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:28 smithi007 bash[22722]: audit 2024-09-14T04:14:27.356126+0000 mgr.a (mgr.14355) 15290 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:14:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:28 smithi007 bash[22722]: cephadm 2024-09-14T04:14:27.357672+0000 mgr.a (mgr.14355) 15291 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:28 smithi131 bash[24745]: audit 2024-09-14T04:14:27.356126+0000 mgr.a (mgr.14355) 15290 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:14:29.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:28 smithi131 bash[24745]: cephadm 2024-09-14T04:14:27.357672+0000 mgr.a (mgr.14355) 15291 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:14:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:28 smithi171 bash[25040]: audit 2024-09-14T04:14:27.356126+0000 mgr.a (mgr.14355) 15290 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:14:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:28 smithi171 bash[25040]: cephadm 2024-09-14T04:14:27.357672+0000 mgr.a (mgr.14355) 15291 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:14:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:29 smithi007 bash[22722]: cluster 2024-09-14T04:14:28.900706+0000 mgr.a (mgr.14355) 15292 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:29 smithi131 bash[24745]: cluster 2024-09-14T04:14:28.900706+0000 mgr.a (mgr.14355) 15292 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:29 smithi171 bash[25040]: cluster 2024-09-14T04:14:28.900706+0000 mgr.a (mgr.14355) 15292 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:14:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:30 smithi131 bash[24745]: cluster 2024-09-14T04:14:30.902881+0000 mgr.a (mgr.14355) 15293 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:30 smithi171 bash[25040]: cluster 2024-09-14T04:14:30.902881+0000 mgr.a (mgr.14355) 15293 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:30 smithi007 bash[22722]: cluster 2024-09-14T04:14:30.902881+0000 mgr.a (mgr.14355) 15293 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:31 smithi131 bash[24745]: audit 2024-09-14T04:14:31.937114+0000 mgr.a (mgr.14355) 15294 : audit [DBG] from='client.330732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:31 smithi171 bash[25040]: audit 2024-09-14T04:14:31.937114+0000 mgr.a (mgr.14355) 15294 : audit [DBG] from='client.330732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:32.363 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:31 smithi007 bash[22722]: audit 2024-09-14T04:14:31.937114+0000 mgr.a (mgr.14355) 15294 : audit [DBG] from='client.330732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:33 smithi131 bash[24745]: cluster 2024-09-14T04:14:32.903852+0000 mgr.a (mgr.14355) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:33 smithi171 bash[25040]: cluster 2024-09-14T04:14:32.903852+0000 mgr.a (mgr.14355) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:33 smithi007 bash[22722]: cluster 2024-09-14T04:14:32.903852+0000 mgr.a (mgr.14355) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:35 smithi131 bash[24745]: cluster 2024-09-14T04:14:34.904643+0000 mgr.a (mgr.14355) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:35 smithi171 bash[25040]: cluster 2024-09-14T04:14:34.904643+0000 mgr.a (mgr.14355) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:35 smithi007 bash[22722]: cluster 2024-09-14T04:14:34.904643+0000 mgr.a (mgr.14355) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:37 smithi131 bash[24745]: cluster 2024-09-14T04:14:36.906866+0000 mgr.a (mgr.14355) 15297 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:37 smithi171 bash[25040]: cluster 2024-09-14T04:14:36.906866+0000 mgr.a (mgr.14355) 15297 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:37.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:37.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:37 smithi007 bash[22722]: cluster 2024-09-14T04:14:36.906866+0000 mgr.a (mgr.14355) 15297 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:38.125 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:38.125 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:38 smithi131 bash[24745]: audit 2024-09-14T04:14:37.700541+0000 mgr.a (mgr.14355) 15298 : audit [DBG] from='client.330807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:38 smithi171 bash[25040]: audit 2024-09-14T04:14:37.700541+0000 mgr.a (mgr.14355) 15298 : audit [DBG] from='client.330807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:38 smithi007 bash[22722]: audit 2024-09-14T04:14:37.700541+0000 mgr.a (mgr.14355) 15298 : audit [DBG] from='client.330807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:39 smithi131 bash[24745]: cluster 2024-09-14T04:14:38.907864+0000 mgr.a (mgr.14355) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:39 smithi171 bash[25040]: cluster 2024-09-14T04:14:38.907864+0000 mgr.a (mgr.14355) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:39 smithi007 bash[22722]: cluster 2024-09-14T04:14:38.907864+0000 mgr.a (mgr.14355) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:41 smithi131 bash[24745]: cluster 2024-09-14T04:14:40.910050+0000 mgr.a (mgr.14355) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:41 smithi171 bash[25040]: cluster 2024-09-14T04:14:40.910050+0000 mgr.a (mgr.14355) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:41 smithi007 bash[22722]: cluster 2024-09-14T04:14:40.910050+0000 mgr.a (mgr.14355) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:14:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:43 smithi131 bash[24745]: cluster 2024-09-14T04:14:42.910831+0000 mgr.a (mgr.14355) 15301 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:43 smithi171 bash[25040]: cluster 2024-09-14T04:14:42.910831+0000 mgr.a (mgr.14355) 15301 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:43 smithi007 bash[22722]: cluster 2024-09-14T04:14:42.910831+0000 mgr.a (mgr.14355) 15301 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:43.906 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:43.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:44 smithi131 bash[24745]: audit 2024-09-14T04:14:43.462782+0000 mgr.a (mgr.14355) 15302 : audit [DBG] from='client.330885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:44 smithi171 bash[25040]: audit 2024-09-14T04:14:43.462782+0000 mgr.a (mgr.14355) 15302 : audit [DBG] from='client.330885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:44 smithi007 bash[22722]: audit 2024-09-14T04:14:43.462782+0000 mgr.a (mgr.14355) 15302 : audit [DBG] from='client.330885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:45 smithi131 bash[24745]: cluster 2024-09-14T04:14:44.911726+0000 mgr.a (mgr.14355) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:45 smithi171 bash[25040]: cluster 2024-09-14T04:14:44.911726+0000 mgr.a (mgr.14355) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:45 smithi007 bash[22722]: cluster 2024-09-14T04:14:44.911726+0000 mgr.a (mgr.14355) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:47 smithi131 bash[24745]: cluster 2024-09-14T04:14:46.913946+0000 mgr.a (mgr.14355) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:47 smithi171 bash[25040]: cluster 2024-09-14T04:14:46.913946+0000 mgr.a (mgr.14355) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:47 smithi007 bash[22722]: cluster 2024-09-14T04:14:46.913946+0000 mgr.a (mgr.14355) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:48.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:48.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:48.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:49 smithi131 bash[24745]: cluster 2024-09-14T04:14:48.914525+0000 mgr.a (mgr.14355) 15305 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:49 smithi171 bash[25040]: cluster 2024-09-14T04:14:48.914525+0000 mgr.a (mgr.14355) 15305 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:49 smithi007 bash[22722]: cluster 2024-09-14T04:14:48.914525+0000 mgr.a (mgr.14355) 15305 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:49.645 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:49.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:49.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:50 smithi171 bash[25040]: audit 2024-09-14T04:14:49.240847+0000 mgr.a (mgr.14355) 15306 : audit [DBG] from='client.330963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:50 smithi007 bash[22722]: audit 2024-09-14T04:14:49.240847+0000 mgr.a (mgr.14355) 15306 : audit [DBG] from='client.330963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:50 smithi131 bash[24745]: audit 2024-09-14T04:14:49.240847+0000 mgr.a (mgr.14355) 15306 : audit [DBG] from='client.330963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:52.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:51 smithi007 bash[22722]: cluster 2024-09-14T04:14:50.916788+0000 mgr.a (mgr.14355) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:51 smithi131 bash[24745]: cluster 2024-09-14T04:14:50.916788+0000 mgr.a (mgr.14355) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:51 smithi171 bash[25040]: cluster 2024-09-14T04:14:50.916788+0000 mgr.a (mgr.14355) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:14:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:53 smithi131 bash[24745]: cluster 2024-09-14T04:14:52.917708+0000 mgr.a (mgr.14355) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:53 smithi171 bash[25040]: cluster 2024-09-14T04:14:52.917708+0000 mgr.a (mgr.14355) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:53 smithi007 bash[22722]: cluster 2024-09-14T04:14:52.917708+0000 mgr.a (mgr.14355) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:14:54.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:14:54.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:14:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:55 smithi131 bash[24745]: cluster 2024-09-14T04:14:54.918474+0000 mgr.a (mgr.14355) 15309 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:55 smithi171 bash[25040]: cluster 2024-09-14T04:14:54.918474+0000 mgr.a (mgr.14355) 15309 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:55.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:14:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:14:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:14:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:14:55.389 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:14:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:55 smithi007 bash[22722]: cluster 2024-09-14T04:14:54.918474+0000 mgr.a (mgr.14355) 15309 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:14:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:56 smithi131 bash[24745]: audit 2024-09-14T04:14:54.975106+0000 mgr.a (mgr.14355) 15310 : audit [DBG] from='client.331041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:56 smithi171 bash[25040]: audit 2024-09-14T04:14:54.975106+0000 mgr.a (mgr.14355) 15310 : audit [DBG] from='client.331041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:56 smithi007 bash[22722]: audit 2024-09-14T04:14:54.975106+0000 mgr.a (mgr.14355) 15310 : audit [DBG] from='client.331041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:14:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:57 smithi131 bash[24745]: cluster 2024-09-14T04:14:56.920870+0000 mgr.a (mgr.14355) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:14:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:57 smithi171 bash[25040]: cluster 2024-09-14T04:14:56.920870+0000 mgr.a (mgr.14355) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:14:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:57 smithi007 bash[22722]: cluster 2024-09-14T04:14:56.920870+0000 mgr.a (mgr.14355) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:14:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:14:59 smithi131 bash[24745]: cluster 2024-09-14T04:14:58.921653+0000 mgr.a (mgr.14355) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:14:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:14:59 smithi171 bash[25040]: cluster 2024-09-14T04:14:58.921653+0000 mgr.a (mgr.14355) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:14:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:14:59 smithi007 bash[22722]: cluster 2024-09-14T04:14:58.921653+0000 mgr.a (mgr.14355) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:15:00.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:00.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:00.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:01.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:01.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:01 smithi131 bash[24745]: audit 2024-09-14T04:15:00.718315+0000 mgr.a (mgr.14355) 15313 : audit [DBG] from='client.331116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:01.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:01 smithi131 bash[24745]: cluster 2024-09-14T04:15:00.923218+0000 mgr.a (mgr.14355) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:01 smithi171 bash[25040]: audit 2024-09-14T04:15:00.718315+0000 mgr.a (mgr.14355) 15313 : audit [DBG] from='client.331116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:01 smithi171 bash[25040]: cluster 2024-09-14T04:15:00.923218+0000 mgr.a (mgr.14355) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:01 smithi007 bash[22722]: audit 2024-09-14T04:15:00.718315+0000 mgr.a (mgr.14355) 15313 : audit [DBG] from='client.331116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:01 smithi007 bash[22722]: cluster 2024-09-14T04:15:00.923218+0000 mgr.a (mgr.14355) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:03 smithi131 bash[24745]: cluster 2024-09-14T04:15:02.924070+0000 mgr.a (mgr.14355) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:03 smithi171 bash[25040]: cluster 2024-09-14T04:15:02.924070+0000 mgr.a (mgr.14355) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:03 smithi007 bash[22722]: cluster 2024-09-14T04:15:02.924070+0000 mgr.a (mgr.14355) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:05 smithi131 bash[24745]: cluster 2024-09-14T04:15:04.924993+0000 mgr.a (mgr.14355) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:05 smithi171 bash[25040]: cluster 2024-09-14T04:15:04.924993+0000 mgr.a (mgr.14355) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:05 smithi007 bash[22722]: cluster 2024-09-14T04:15:04.924993+0000 mgr.a (mgr.14355) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:06.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:06.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:06.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:06.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:07 smithi131 bash[24745]: audit 2024-09-14T04:15:06.464502+0000 mgr.a (mgr.14355) 15317 : audit [DBG] from='client.331194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:07.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:07 smithi131 bash[24745]: cluster 2024-09-14T04:15:06.926414+0000 mgr.a (mgr.14355) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:07 smithi171 bash[25040]: audit 2024-09-14T04:15:06.464502+0000 mgr.a (mgr.14355) 15317 : audit [DBG] from='client.331194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:07 smithi171 bash[25040]: cluster 2024-09-14T04:15:06.926414+0000 mgr.a (mgr.14355) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:07 smithi007 bash[22722]: audit 2024-09-14T04:15:06.464502+0000 mgr.a (mgr.14355) 15317 : audit [DBG] from='client.331194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:07 smithi007 bash[22722]: cluster 2024-09-14T04:15:06.926414+0000 mgr.a (mgr.14355) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:09 smithi131 bash[24745]: cluster 2024-09-14T04:15:08.927149+0000 mgr.a (mgr.14355) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:15:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:09 smithi171 bash[25040]: cluster 2024-09-14T04:15:08.927149+0000 mgr.a (mgr.14355) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:15:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:09 smithi007 bash[22722]: cluster 2024-09-14T04:15:08.927149+0000 mgr.a (mgr.14355) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:15:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:11 smithi131 bash[24745]: cluster 2024-09-14T04:15:10.929117+0000 mgr.a (mgr.14355) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:15:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:11 smithi171 bash[25040]: cluster 2024-09-14T04:15:10.929117+0000 mgr.a (mgr.14355) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:15:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:11 smithi007 bash[22722]: cluster 2024-09-14T04:15:10.929117+0000 mgr.a (mgr.14355) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:15:11.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:12.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:13 smithi131 bash[24745]: audit 2024-09-14T04:15:12.206474+0000 mgr.a (mgr.14355) 15321 : audit [DBG] from='client.331269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:13 smithi131 bash[24745]: cluster 2024-09-14T04:15:12.930071+0000 mgr.a (mgr.14355) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:13 smithi171 bash[25040]: audit 2024-09-14T04:15:12.206474+0000 mgr.a (mgr.14355) 15321 : audit [DBG] from='client.331269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:13 smithi171 bash[25040]: cluster 2024-09-14T04:15:12.930071+0000 mgr.a (mgr.14355) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:13 smithi007 bash[22722]: audit 2024-09-14T04:15:12.206474+0000 mgr.a (mgr.14355) 15321 : audit [DBG] from='client.331269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:13 smithi007 bash[22722]: cluster 2024-09-14T04:15:12.930071+0000 mgr.a (mgr.14355) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:15 smithi131 bash[24745]: cluster 2024-09-14T04:15:14.930891+0000 mgr.a (mgr.14355) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:15 smithi171 bash[25040]: cluster 2024-09-14T04:15:14.930891+0000 mgr.a (mgr.14355) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:15 smithi007 bash[22722]: cluster 2024-09-14T04:15:14.930891+0000 mgr.a (mgr.14355) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:17 smithi131 bash[24745]: cluster 2024-09-14T04:15:16.933131+0000 mgr.a (mgr.14355) 15324 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:17 smithi171 bash[25040]: cluster 2024-09-14T04:15:16.933131+0000 mgr.a (mgr.14355) 15324 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:17 smithi007 bash[22722]: cluster 2024-09-14T04:15:16.933131+0000 mgr.a (mgr.14355) 15324 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:17.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:17.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:17.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:18.411 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:18.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:19 smithi131 bash[24745]: audit 2024-09-14T04:15:17.975743+0000 mgr.a (mgr.14355) 15325 : audit [DBG] from='client.331347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:19.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:19 smithi131 bash[24745]: cluster 2024-09-14T04:15:18.934085+0000 mgr.a (mgr.14355) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:19 smithi171 bash[25040]: audit 2024-09-14T04:15:17.975743+0000 mgr.a (mgr.14355) 15325 : audit [DBG] from='client.331347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:19 smithi171 bash[25040]: cluster 2024-09-14T04:15:18.934085+0000 mgr.a (mgr.14355) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:19 smithi007 bash[22722]: audit 2024-09-14T04:15:17.975743+0000 mgr.a (mgr.14355) 15325 : audit [DBG] from='client.331347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:19 smithi007 bash[22722]: cluster 2024-09-14T04:15:18.934085+0000 mgr.a (mgr.14355) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:21 smithi131 bash[24745]: cluster 2024-09-14T04:15:20.936290+0000 mgr.a (mgr.14355) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:21 smithi171 bash[25040]: cluster 2024-09-14T04:15:20.936290+0000 mgr.a (mgr.14355) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:21 smithi007 bash[22722]: cluster 2024-09-14T04:15:20.936290+0000 mgr.a (mgr.14355) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:23 smithi131 bash[24745]: cluster 2024-09-14T04:15:22.937064+0000 mgr.a (mgr.14355) 15328 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:23 smithi171 bash[25040]: cluster 2024-09-14T04:15:22.937064+0000 mgr.a (mgr.14355) 15328 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:23.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:23.413 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:23 smithi007 bash[22722]: cluster 2024-09-14T04:15:22.937064+0000 mgr.a (mgr.14355) 15328 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:24.184 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:24.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:24 smithi131 bash[24745]: audit 2024-09-14T04:15:23.749674+0000 mgr.a (mgr.14355) 15329 : audit [DBG] from='client.331422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:24 smithi171 bash[25040]: audit 2024-09-14T04:15:23.749674+0000 mgr.a (mgr.14355) 15329 : audit [DBG] from='client.331422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:24 smithi007 bash[22722]: audit 2024-09-14T04:15:23.749674+0000 mgr.a (mgr.14355) 15329 : audit [DBG] from='client.331422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:25 smithi131 bash[24745]: cluster 2024-09-14T04:15:24.937964+0000 mgr.a (mgr.14355) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:25 smithi171 bash[25040]: cluster 2024-09-14T04:15:24.937964+0000 mgr.a (mgr.14355) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:25 smithi007 bash[22722]: cluster 2024-09-14T04:15:24.937964+0000 mgr.a (mgr.14355) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:27 smithi131 bash[24745]: cluster 2024-09-14T04:15:26.940249+0000 mgr.a (mgr.14355) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:27 smithi171 bash[25040]: cluster 2024-09-14T04:15:26.940249+0000 mgr.a (mgr.14355) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:27 smithi007 bash[22722]: cluster 2024-09-14T04:15:26.940249+0000 mgr.a (mgr.14355) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:28 smithi131 bash[24745]: audit 2024-09-14T04:15:27.410791+0000 mon.a (mon.0) 2878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:15:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:28 smithi171 bash[25040]: audit 2024-09-14T04:15:27.410791+0000 mon.a (mon.0) 2878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:15:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:28 smithi007 bash[22722]: audit 2024-09-14T04:15:27.410791+0000 mon.a (mon.0) 2878 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:15:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: audit 2024-09-14T04:15:28.254169+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: audit 2024-09-14T04:15:28.255988+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: audit 2024-09-14T04:15:28.263089+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: audit 2024-09-14T04:15:28.265655+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: audit 2024-09-14T04:15:28.268061+0000 mgr.a (mgr.14355) 15332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:29 smithi131 bash[24745]: cluster 2024-09-14T04:15:28.941000+0000 mgr.a (mgr.14355) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: audit 2024-09-14T04:15:28.254169+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: audit 2024-09-14T04:15:28.255988+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: audit 2024-09-14T04:15:28.263089+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: audit 2024-09-14T04:15:28.265655+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: audit 2024-09-14T04:15:28.268061+0000 mgr.a (mgr.14355) 15332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:29 smithi171 bash[25040]: cluster 2024-09-14T04:15:28.941000+0000 mgr.a (mgr.14355) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:29.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22972]: debug 2024-09-14T04:15:29.015+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:15:29.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22972]: debug 2024-09-14T04:15:29.015+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:15:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: audit 2024-09-14T04:15:28.254169+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:15:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: audit 2024-09-14T04:15:28.255988+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:15:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: audit 2024-09-14T04:15:28.263089+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:15:29.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: audit 2024-09-14T04:15:28.265655+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: audit 2024-09-14T04:15:28.268061+0000 mgr.a (mgr.14355) 15332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:15:29.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:29 smithi007 bash[22722]: cluster 2024-09-14T04:15:28.941000+0000 mgr.a (mgr.14355) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:29.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:29.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:30 smithi007 bash[22722]: audit 2024-09-14T04:15:29.019892+0000 mgr.a (mgr.14355) 15334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:15:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:30 smithi007 bash[22722]: cephadm 2024-09-14T04:15:29.022288+0000 mgr.a (mgr.14355) 15335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:15:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:30 smithi007 bash[22722]: audit 2024-09-14T04:15:29.514409+0000 mgr.a (mgr.14355) 15336 : audit [DBG] from='client.331605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:30 smithi131 bash[24745]: audit 2024-09-14T04:15:29.019892+0000 mgr.a (mgr.14355) 15334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:15:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:30 smithi131 bash[24745]: cephadm 2024-09-14T04:15:29.022288+0000 mgr.a (mgr.14355) 15335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:15:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:30 smithi131 bash[24745]: audit 2024-09-14T04:15:29.514409+0000 mgr.a (mgr.14355) 15336 : audit [DBG] from='client.331605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:30 smithi171 bash[25040]: audit 2024-09-14T04:15:29.019892+0000 mgr.a (mgr.14355) 15334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:15:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:30 smithi171 bash[25040]: cephadm 2024-09-14T04:15:29.022288+0000 mgr.a (mgr.14355) 15335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:15:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:30 smithi171 bash[25040]: audit 2024-09-14T04:15:29.514409+0000 mgr.a (mgr.14355) 15336 : audit [DBG] from='client.331605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:31 smithi007 bash[22722]: cluster 2024-09-14T04:15:30.943371+0000 mgr.a (mgr.14355) 15337 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:31 smithi131 bash[24745]: cluster 2024-09-14T04:15:30.943371+0000 mgr.a (mgr.14355) 15337 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:31 smithi171 bash[25040]: cluster 2024-09-14T04:15:30.943371+0000 mgr.a (mgr.14355) 15337 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:33 smithi131 bash[24745]: cluster 2024-09-14T04:15:32.944224+0000 mgr.a (mgr.14355) 15338 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:33 smithi171 bash[25040]: cluster 2024-09-14T04:15:32.944224+0000 mgr.a (mgr.14355) 15338 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:33 smithi007 bash[22722]: cluster 2024-09-14T04:15:32.944224+0000 mgr.a (mgr.14355) 15338 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:34.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:35 smithi131 bash[24745]: cluster 2024-09-14T04:15:34.944996+0000 mgr.a (mgr.14355) 15339 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:35 smithi171 bash[25040]: cluster 2024-09-14T04:15:34.944996+0000 mgr.a (mgr.14355) 15339 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:35 smithi007 bash[22722]: cluster 2024-09-14T04:15:34.944996+0000 mgr.a (mgr.14355) 15339 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:35.699 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:36 smithi131 bash[24745]: audit 2024-09-14T04:15:35.293664+0000 mgr.a (mgr.14355) 15340 : audit [DBG] from='client.331683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:36 smithi171 bash[25040]: audit 2024-09-14T04:15:35.293664+0000 mgr.a (mgr.14355) 15340 : audit [DBG] from='client.331683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:36 smithi007 bash[22722]: audit 2024-09-14T04:15:35.293664+0000 mgr.a (mgr.14355) 15340 : audit [DBG] from='client.331683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:37 smithi171 bash[25040]: cluster 2024-09-14T04:15:36.947741+0000 mgr.a (mgr.14355) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:37 smithi007 bash[22722]: cluster 2024-09-14T04:15:36.947741+0000 mgr.a (mgr.14355) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:37 smithi131 bash[24745]: cluster 2024-09-14T04:15:36.947741+0000 mgr.a (mgr.14355) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:39 smithi131 bash[24745]: cluster 2024-09-14T04:15:38.948555+0000 mgr.a (mgr.14355) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:15:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:39 smithi171 bash[25040]: cluster 2024-09-14T04:15:38.948555+0000 mgr.a (mgr.14355) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:15:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:39 smithi007 bash[22722]: cluster 2024-09-14T04:15:38.948555+0000 mgr.a (mgr.14355) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:15:40.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:40.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:40.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:41 smithi131 bash[24745]: cluster 2024-09-14T04:15:40.949746+0000 mgr.a (mgr.14355) 15343 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:41 smithi171 bash[25040]: cluster 2024-09-14T04:15:40.949746+0000 mgr.a (mgr.14355) 15343 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:41.451 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:41 smithi007 bash[22722]: cluster 2024-09-14T04:15:40.949746+0000 mgr.a (mgr.14355) 15343 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:15:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:42 smithi131 bash[24745]: audit 2024-09-14T04:15:41.041164+0000 mgr.a (mgr.14355) 15344 : audit [DBG] from='client.331761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:42 smithi171 bash[25040]: audit 2024-09-14T04:15:41.041164+0000 mgr.a (mgr.14355) 15344 : audit [DBG] from='client.331761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:42 smithi007 bash[22722]: audit 2024-09-14T04:15:41.041164+0000 mgr.a (mgr.14355) 15344 : audit [DBG] from='client.331761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:43 smithi131 bash[24745]: cluster 2024-09-14T04:15:42.950747+0000 mgr.a (mgr.14355) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:43 smithi171 bash[25040]: cluster 2024-09-14T04:15:42.950747+0000 mgr.a (mgr.14355) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:43 smithi007 bash[22722]: cluster 2024-09-14T04:15:42.950747+0000 mgr.a (mgr.14355) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:15:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:45 smithi131 bash[24745]: cluster 2024-09-14T04:15:44.951692+0000 mgr.a (mgr.14355) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:45 smithi171 bash[25040]: cluster 2024-09-14T04:15:44.951692+0000 mgr.a (mgr.14355) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:45 smithi007 bash[22722]: cluster 2024-09-14T04:15:44.951692+0000 mgr.a (mgr.14355) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:15:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:46.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:47.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:47.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:47 smithi131 bash[24745]: audit 2024-09-14T04:15:46.790629+0000 mgr.a (mgr.14355) 15347 : audit [DBG] from='client.331839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:47 smithi131 bash[24745]: cluster 2024-09-14T04:15:46.953512+0000 mgr.a (mgr.14355) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:47 smithi171 bash[25040]: audit 2024-09-14T04:15:46.790629+0000 mgr.a (mgr.14355) 15347 : audit [DBG] from='client.331839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:47 smithi171 bash[25040]: cluster 2024-09-14T04:15:46.953512+0000 mgr.a (mgr.14355) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:47 smithi007 bash[22722]: audit 2024-09-14T04:15:46.790629+0000 mgr.a (mgr.14355) 15347 : audit [DBG] from='client.331839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:47 smithi007 bash[22722]: cluster 2024-09-14T04:15:46.953512+0000 mgr.a (mgr.14355) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:49 smithi131 bash[24745]: cluster 2024-09-14T04:15:48.954411+0000 mgr.a (mgr.14355) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:49 smithi171 bash[25040]: cluster 2024-09-14T04:15:48.954411+0000 mgr.a (mgr.14355) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:49 smithi007 bash[22722]: cluster 2024-09-14T04:15:48.954411+0000 mgr.a (mgr.14355) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:51 smithi131 bash[24745]: cluster 2024-09-14T04:15:50.956631+0000 mgr.a (mgr.14355) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:51 smithi171 bash[25040]: cluster 2024-09-14T04:15:50.956631+0000 mgr.a (mgr.14355) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:51 smithi007 bash[22722]: cluster 2024-09-14T04:15:50.956631+0000 mgr.a (mgr.14355) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:52.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:52.982 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:52.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:52.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:52.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:52.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:53 smithi131 bash[24745]: audit 2024-09-14T04:15:52.564747+0000 mgr.a (mgr.14355) 15351 : audit [DBG] from='client.331914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:53 smithi131 bash[24745]: cluster 2024-09-14T04:15:52.957299+0000 mgr.a (mgr.14355) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:53 smithi171 bash[25040]: audit 2024-09-14T04:15:52.564747+0000 mgr.a (mgr.14355) 15351 : audit [DBG] from='client.331914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:53 smithi171 bash[25040]: cluster 2024-09-14T04:15:52.957299+0000 mgr.a (mgr.14355) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:53 smithi007 bash[22722]: audit 2024-09-14T04:15:52.564747+0000 mgr.a (mgr.14355) 15351 : audit [DBG] from='client.331914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:53 smithi007 bash[22722]: cluster 2024-09-14T04:15:52.957299+0000 mgr.a (mgr.14355) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:55 smithi131 bash[24745]: cluster 2024-09-14T04:15:54.958020+0000 mgr.a (mgr.14355) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:55 smithi171 bash[25040]: cluster 2024-09-14T04:15:54.958020+0000 mgr.a (mgr.14355) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:55 smithi007 bash[22722]: cluster 2024-09-14T04:15:54.958020+0000 mgr.a (mgr.14355) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:57 smithi131 bash[24745]: cluster 2024-09-14T04:15:56.960265+0000 mgr.a (mgr.14355) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:57 smithi171 bash[25040]: cluster 2024-09-14T04:15:56.960265+0000 mgr.a (mgr.14355) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:57 smithi007 bash[22722]: cluster 2024-09-14T04:15:56.960265+0000 mgr.a (mgr.14355) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:15:57.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:15:57.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:15:57.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:15:58.763 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:15:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:15:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:15:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:15:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:15:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:59 smithi131 bash[24745]: audit 2024-09-14T04:15:58.322310+0000 mgr.a (mgr.14355) 15355 : audit [DBG] from='client.331992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:59.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:15:59 smithi131 bash[24745]: cluster 2024-09-14T04:15:58.961209+0000 mgr.a (mgr.14355) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:59 smithi171 bash[25040]: audit 2024-09-14T04:15:58.322310+0000 mgr.a (mgr.14355) 15355 : audit [DBG] from='client.331992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:15:59 smithi171 bash[25040]: cluster 2024-09-14T04:15:58.961209+0000 mgr.a (mgr.14355) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:15:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:59 smithi007 bash[22722]: audit 2024-09-14T04:15:58.322310+0000 mgr.a (mgr.14355) 15355 : audit [DBG] from='client.331992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:15:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:15:59 smithi007 bash[22722]: cluster 2024-09-14T04:15:58.961209+0000 mgr.a (mgr.14355) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:01 smithi131 bash[24745]: cluster 2024-09-14T04:16:00.963469+0000 mgr.a (mgr.14355) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:01 smithi171 bash[25040]: cluster 2024-09-14T04:16:00.963469+0000 mgr.a (mgr.14355) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:01 smithi007 bash[22722]: cluster 2024-09-14T04:16:00.963469+0000 mgr.a (mgr.14355) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:03 smithi131 bash[24745]: cluster 2024-09-14T04:16:02.964235+0000 mgr.a (mgr.14355) 15358 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:03 smithi171 bash[25040]: cluster 2024-09-14T04:16:02.964235+0000 mgr.a (mgr.14355) 15358 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:03 smithi007 bash[22722]: cluster 2024-09-14T04:16:02.964235+0000 mgr.a (mgr.14355) 15358 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:03.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:03.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:04.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:05 smithi131 bash[24745]: audit 2024-09-14T04:16:04.103430+0000 mgr.a (mgr.14355) 15359 : audit [DBG] from='client.332070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:05 smithi131 bash[24745]: cluster 2024-09-14T04:16:04.965122+0000 mgr.a (mgr.14355) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:05 smithi171 bash[25040]: audit 2024-09-14T04:16:04.103430+0000 mgr.a (mgr.14355) 15359 : audit [DBG] from='client.332070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:05 smithi171 bash[25040]: cluster 2024-09-14T04:16:04.965122+0000 mgr.a (mgr.14355) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:05 smithi007 bash[22722]: audit 2024-09-14T04:16:04.103430+0000 mgr.a (mgr.14355) 15359 : audit [DBG] from='client.332070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:05 smithi007 bash[22722]: cluster 2024-09-14T04:16:04.965122+0000 mgr.a (mgr.14355) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:07 smithi131 bash[24745]: cluster 2024-09-14T04:16:06.967359+0000 mgr.a (mgr.14355) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:07 smithi171 bash[25040]: cluster 2024-09-14T04:16:06.967359+0000 mgr.a (mgr.14355) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:07 smithi007 bash[22722]: cluster 2024-09-14T04:16:06.967359+0000 mgr.a (mgr.14355) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:09 smithi131 bash[24745]: cluster 2024-09-14T04:16:08.968113+0000 mgr.a (mgr.14355) 15362 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:09 smithi171 bash[25040]: cluster 2024-09-14T04:16:08.968113+0000 mgr.a (mgr.14355) 15362 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:09 smithi007 bash[22722]: cluster 2024-09-14T04:16:08.968113+0000 mgr.a (mgr.14355) 15362 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:09.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:09.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:10 smithi131 bash[24745]: audit 2024-09-14T04:16:09.886957+0000 mgr.a (mgr.14355) 15363 : audit [DBG] from='client.332148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:10 smithi171 bash[25040]: audit 2024-09-14T04:16:09.886957+0000 mgr.a (mgr.14355) 15363 : audit [DBG] from='client.332148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:10.317 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:10 smithi007 bash[22722]: audit 2024-09-14T04:16:09.886957+0000 mgr.a (mgr.14355) 15363 : audit [DBG] from='client.332148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:11 smithi171 bash[25040]: cluster 2024-09-14T04:16:10.970491+0000 mgr.a (mgr.14355) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:11 smithi007 bash[22722]: cluster 2024-09-14T04:16:10.970491+0000 mgr.a (mgr.14355) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:11 smithi131 bash[24745]: cluster 2024-09-14T04:16:10.970491+0000 mgr.a (mgr.14355) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:16:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:13 smithi131 bash[24745]: cluster 2024-09-14T04:16:12.971289+0000 mgr.a (mgr.14355) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:13 smithi171 bash[25040]: cluster 2024-09-14T04:16:12.971289+0000 mgr.a (mgr.14355) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:13 smithi007 bash[22722]: cluster 2024-09-14T04:16:12.971289+0000 mgr.a (mgr.14355) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:15 smithi171 bash[25040]: cluster 2024-09-14T04:16:14.972029+0000 mgr.a (mgr.14355) 15366 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:15.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:15.319 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:15.320 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:15 smithi007 bash[22722]: cluster 2024-09-14T04:16:14.972029+0000 mgr.a (mgr.14355) 15366 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:15 smithi131 bash[24745]: cluster 2024-09-14T04:16:14.972029+0000 mgr.a (mgr.14355) 15366 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:16.074 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:16.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:16 smithi171 bash[25040]: audit 2024-09-14T04:16:15.648843+0000 mgr.a (mgr.14355) 15367 : audit [DBG] from='client.332223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:16 smithi007 bash[22722]: audit 2024-09-14T04:16:15.648843+0000 mgr.a (mgr.14355) 15367 : audit [DBG] from='client.332223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:16 smithi131 bash[24745]: audit 2024-09-14T04:16:15.648843+0000 mgr.a (mgr.14355) 15367 : audit [DBG] from='client.332223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:17 smithi171 bash[25040]: cluster 2024-09-14T04:16:16.974773+0000 mgr.a (mgr.14355) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:17 smithi007 bash[22722]: cluster 2024-09-14T04:16:16.974773+0000 mgr.a (mgr.14355) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:17 smithi131 bash[24745]: cluster 2024-09-14T04:16:16.974773+0000 mgr.a (mgr.14355) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:19 smithi171 bash[25040]: cluster 2024-09-14T04:16:18.975543+0000 mgr.a (mgr.14355) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:19 smithi007 bash[22722]: cluster 2024-09-14T04:16:18.975543+0000 mgr.a (mgr.14355) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:19 smithi131 bash[24745]: cluster 2024-09-14T04:16:18.975543+0000 mgr.a (mgr.14355) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:21.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:21.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:21.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:21.859 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:22 smithi171 bash[25040]: cluster 2024-09-14T04:16:20.977480+0000 mgr.a (mgr.14355) 15370 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:22 smithi171 bash[25040]: audit 2024-09-14T04:16:21.419215+0000 mgr.a (mgr.14355) 15371 : audit [DBG] from='client.332298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:22 smithi007 bash[22722]: cluster 2024-09-14T04:16:20.977480+0000 mgr.a (mgr.14355) 15370 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:22 smithi007 bash[22722]: audit 2024-09-14T04:16:21.419215+0000 mgr.a (mgr.14355) 15371 : audit [DBG] from='client.332298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:22 smithi131 bash[24745]: cluster 2024-09-14T04:16:20.977480+0000 mgr.a (mgr.14355) 15370 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:22.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:22 smithi131 bash[24745]: audit 2024-09-14T04:16:21.419215+0000 mgr.a (mgr.14355) 15371 : audit [DBG] from='client.332298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:24 smithi171 bash[25040]: cluster 2024-09-14T04:16:22.978465+0000 mgr.a (mgr.14355) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:24 smithi007 bash[22722]: cluster 2024-09-14T04:16:22.978465+0000 mgr.a (mgr.14355) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:24 smithi131 bash[24745]: cluster 2024-09-14T04:16:22.978465+0000 mgr.a (mgr.14355) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:26 smithi171 bash[25040]: cluster 2024-09-14T04:16:24.979375+0000 mgr.a (mgr.14355) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:26 smithi007 bash[22722]: cluster 2024-09-14T04:16:24.979375+0000 mgr.a (mgr.14355) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:26 smithi131 bash[24745]: cluster 2024-09-14T04:16:24.979375+0000 mgr.a (mgr.14355) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:26.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:26.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:26.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:27.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:27.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:27.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:27.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:27.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:28 smithi007 bash[22722]: cluster 2024-09-14T04:16:26.981132+0000 mgr.a (mgr.14355) 15374 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:28 smithi007 bash[22722]: audit 2024-09-14T04:16:27.195579+0000 mgr.a (mgr.14355) 15375 : audit [DBG] from='client.332376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:28 smithi131 bash[24745]: cluster 2024-09-14T04:16:26.981132+0000 mgr.a (mgr.14355) 15374 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:28.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:28 smithi131 bash[24745]: audit 2024-09-14T04:16:27.195579+0000 mgr.a (mgr.14355) 15375 : audit [DBG] from='client.332376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:28 smithi171 bash[25040]: cluster 2024-09-14T04:16:26.981132+0000 mgr.a (mgr.14355) 15374 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:28 smithi171 bash[25040]: audit 2024-09-14T04:16:27.195579+0000 mgr.a (mgr.14355) 15375 : audit [DBG] from='client.332376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: cluster 2024-09-14T04:16:28.982032+0000 mgr.a (mgr.14355) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.086600+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.930011+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.931765+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.942273+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.947112+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22722]: audit 2024-09-14T04:16:29.948721+0000 mgr.a (mgr.14355) 15377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: cluster 2024-09-14T04:16:28.982032+0000 mgr.a (mgr.14355) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.086600+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.930011+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.931765+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.942273+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.947112+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:30 smithi131 bash[24745]: audit 2024-09-14T04:16:29.948721+0000 mgr.a (mgr.14355) 15377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: cluster 2024-09-14T04:16:28.982032+0000 mgr.a (mgr.14355) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.086600+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.930011+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.931765+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.942273+0000 mon.a (mon.0) 2886 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:16:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.947112+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:30.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:30 smithi171 bash[25040]: audit 2024-09-14T04:16:29.948721+0000 mgr.a (mgr.14355) 15377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:16:31.061 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22972]: debug 2024-09-14T04:16:30.710+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:16:31.061 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:16:30 smithi007 bash[22972]: debug 2024-09-14T04:16:30.710+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:16:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:31 smithi007 bash[22722]: audit 2024-09-14T04:16:30.712012+0000 mgr.a (mgr.14355) 15378 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:16:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:31 smithi007 bash[22722]: cephadm 2024-09-14T04:16:30.713973+0000 mgr.a (mgr.14355) 15379 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:16:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:31 smithi131 bash[24745]: audit 2024-09-14T04:16:30.712012+0000 mgr.a (mgr.14355) 15378 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:16:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:31 smithi131 bash[24745]: cephadm 2024-09-14T04:16:30.713973+0000 mgr.a (mgr.14355) 15379 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:16:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:31 smithi171 bash[25040]: audit 2024-09-14T04:16:30.712012+0000 mgr.a (mgr.14355) 15378 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:16:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:31 smithi171 bash[25040]: cephadm 2024-09-14T04:16:30.713973+0000 mgr.a (mgr.14355) 15379 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:16:32.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:32 smithi007 bash[22722]: cluster 2024-09-14T04:16:30.984646+0000 mgr.a (mgr.14355) 15380 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:16:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:32 smithi131 bash[24745]: cluster 2024-09-14T04:16:30.984646+0000 mgr.a (mgr.14355) 15380 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:16:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:32 smithi171 bash[25040]: cluster 2024-09-14T04:16:30.984646+0000 mgr.a (mgr.14355) 15380 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:16:32.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:32.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:33.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:33.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:33.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:33 smithi007 bash[22722]: audit 2024-09-14T04:16:32.952142+0000 mgr.a (mgr.14355) 15381 : audit [DBG] from='client.332556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:33 smithi131 bash[24745]: audit 2024-09-14T04:16:32.952142+0000 mgr.a (mgr.14355) 15381 : audit [DBG] from='client.332556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:33 smithi171 bash[25040]: audit 2024-09-14T04:16:32.952142+0000 mgr.a (mgr.14355) 15381 : audit [DBG] from='client.332556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:34.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:34 smithi007 bash[22722]: cluster 2024-09-14T04:16:32.985180+0000 mgr.a (mgr.14355) 15382 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:34 smithi131 bash[24745]: cluster 2024-09-14T04:16:32.985180+0000 mgr.a (mgr.14355) 15382 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:34 smithi171 bash[25040]: cluster 2024-09-14T04:16:32.985180+0000 mgr.a (mgr.14355) 15382 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:36 smithi007 bash[22722]: cluster 2024-09-14T04:16:34.986101+0000 mgr.a (mgr.14355) 15383 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:36 smithi131 bash[24745]: cluster 2024-09-14T04:16:34.986101+0000 mgr.a (mgr.14355) 15383 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:36 smithi171 bash[25040]: cluster 2024-09-14T04:16:34.986101+0000 mgr.a (mgr.14355) 15383 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T04:16:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:38 smithi007 bash[22722]: cluster 2024-09-14T04:16:36.988351+0000 mgr.a (mgr.14355) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:38 smithi131 bash[24745]: cluster 2024-09-14T04:16:36.988351+0000 mgr.a (mgr.14355) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:38 smithi171 bash[25040]: cluster 2024-09-14T04:16:36.988351+0000 mgr.a (mgr.14355) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:39.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:39.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:39.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:39.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:39.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:39 smithi007 bash[22722]: audit 2024-09-14T04:16:38.719022+0000 mgr.a (mgr.14355) 15385 : audit [DBG] from='client.332631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:39 smithi131 bash[24745]: audit 2024-09-14T04:16:38.719022+0000 mgr.a (mgr.14355) 15385 : audit [DBG] from='client.332631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:39 smithi171 bash[25040]: audit 2024-09-14T04:16:38.719022+0000 mgr.a (mgr.14355) 15385 : audit [DBG] from='client.332631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:40 smithi007 bash[22722]: cluster 2024-09-14T04:16:38.988908+0000 mgr.a (mgr.14355) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:40 smithi131 bash[24745]: cluster 2024-09-14T04:16:38.988908+0000 mgr.a (mgr.14355) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:40 smithi171 bash[25040]: cluster 2024-09-14T04:16:38.988908+0000 mgr.a (mgr.14355) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:42 smithi007 bash[22722]: cluster 2024-09-14T04:16:40.991258+0000 mgr.a (mgr.14355) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:42 smithi131 bash[24745]: cluster 2024-09-14T04:16:40.991258+0000 mgr.a (mgr.14355) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:42 smithi171 bash[25040]: cluster 2024-09-14T04:16:40.991258+0000 mgr.a (mgr.14355) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:16:44.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:44.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:44.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:44 smithi007 bash[22722]: cluster 2024-09-14T04:16:42.992012+0000 mgr.a (mgr.14355) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:44 smithi131 bash[24745]: cluster 2024-09-14T04:16:42.992012+0000 mgr.a (mgr.14355) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:44 smithi171 bash[25040]: cluster 2024-09-14T04:16:42.992012+0000 mgr.a (mgr.14355) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:44.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:44.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:45 smithi007 bash[22722]: audit 2024-09-14T04:16:44.484969+0000 mgr.a (mgr.14355) 15389 : audit [DBG] from='client.332700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:45 smithi131 bash[24745]: audit 2024-09-14T04:16:44.484969+0000 mgr.a (mgr.14355) 15389 : audit [DBG] from='client.332700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:45 smithi171 bash[25040]: audit 2024-09-14T04:16:44.484969+0000 mgr.a (mgr.14355) 15389 : audit [DBG] from='client.332700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:46 smithi007 bash[22722]: cluster 2024-09-14T04:16:44.992665+0000 mgr.a (mgr.14355) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:46 smithi131 bash[24745]: cluster 2024-09-14T04:16:44.992665+0000 mgr.a (mgr.14355) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:46 smithi171 bash[25040]: cluster 2024-09-14T04:16:44.992665+0000 mgr.a (mgr.14355) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:48 smithi007 bash[22722]: cluster 2024-09-14T04:16:46.994912+0000 mgr.a (mgr.14355) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:48 smithi131 bash[24745]: cluster 2024-09-14T04:16:46.994912+0000 mgr.a (mgr.14355) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:48 smithi171 bash[25040]: cluster 2024-09-14T04:16:46.994912+0000 mgr.a (mgr.14355) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T04:16:49.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:49.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:49.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:50 smithi007 bash[22722]: cluster 2024-09-14T04:16:48.995715+0000 mgr.a (mgr.14355) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:50 smithi131 bash[24745]: cluster 2024-09-14T04:16:48.995715+0000 mgr.a (mgr.14355) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:50 smithi171 bash[25040]: cluster 2024-09-14T04:16:48.995715+0000 mgr.a (mgr.14355) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:50.664 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:50.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:50.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:50.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:50.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:51 smithi007 bash[22722]: audit 2024-09-14T04:16:50.250913+0000 mgr.a (mgr.14355) 15393 : audit [DBG] from='client.332775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:51 smithi131 bash[24745]: audit 2024-09-14T04:16:50.250913+0000 mgr.a (mgr.14355) 15393 : audit [DBG] from='client.332775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:51 smithi171 bash[25040]: audit 2024-09-14T04:16:50.250913+0000 mgr.a (mgr.14355) 15393 : audit [DBG] from='client.332775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:52 smithi007 bash[22722]: cluster 2024-09-14T04:16:50.998576+0000 mgr.a (mgr.14355) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:52 smithi131 bash[24745]: cluster 2024-09-14T04:16:50.998576+0000 mgr.a (mgr.14355) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:52 smithi171 bash[25040]: cluster 2024-09-14T04:16:50.998576+0000 mgr.a (mgr.14355) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:54 smithi007 bash[22722]: cluster 2024-09-14T04:16:52.999361+0000 mgr.a (mgr.14355) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:54 smithi131 bash[24745]: cluster 2024-09-14T04:16:52.999361+0000 mgr.a (mgr.14355) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:54 smithi171 bash[25040]: cluster 2024-09-14T04:16:52.999361+0000 mgr.a (mgr.14355) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:16:55.666 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:16:55.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:16:55.667 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:16:56.416 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:16:56.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:16:56.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:16:56.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:16:56.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:16:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:56 smithi007 bash[22722]: cluster 2024-09-14T04:16:55.000170+0000 mgr.a (mgr.14355) 15396 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:56 smithi131 bash[24745]: cluster 2024-09-14T04:16:55.000170+0000 mgr.a (mgr.14355) 15396 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:56 smithi171 bash[25040]: cluster 2024-09-14T04:16:55.000170+0000 mgr.a (mgr.14355) 15396 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:16:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:57 smithi007 bash[22722]: audit 2024-09-14T04:16:56.000478+0000 mgr.a (mgr.14355) 15397 : audit [DBG] from='client.332853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:57 smithi131 bash[24745]: audit 2024-09-14T04:16:56.000478+0000 mgr.a (mgr.14355) 15397 : audit [DBG] from='client.332853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:57 smithi171 bash[25040]: audit 2024-09-14T04:16:56.000478+0000 mgr.a (mgr.14355) 15397 : audit [DBG] from='client.332853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:16:58.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:16:58 smithi007 bash[22722]: cluster 2024-09-14T04:16:57.003043+0000 mgr.a (mgr.14355) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:16:58 smithi131 bash[24745]: cluster 2024-09-14T04:16:57.003043+0000 mgr.a (mgr.14355) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:16:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:16:58 smithi171 bash[25040]: cluster 2024-09-14T04:16:57.003043+0000 mgr.a (mgr.14355) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:00 smithi007 bash[22722]: cluster 2024-09-14T04:16:59.003822+0000 mgr.a (mgr.14355) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:17:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:00 smithi131 bash[24745]: cluster 2024-09-14T04:16:59.003822+0000 mgr.a (mgr.14355) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:17:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:00 smithi171 bash[25040]: cluster 2024-09-14T04:16:59.003822+0000 mgr.a (mgr.14355) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:17:01.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:01.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:02.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:02.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:02.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:02.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:02.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:02 smithi007 bash[22722]: cluster 2024-09-14T04:17:01.005825+0000 mgr.a (mgr.14355) 15400 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:02 smithi007 bash[22722]: audit 2024-09-14T04:17:01.747208+0000 mgr.a (mgr.14355) 15401 : audit [DBG] from='client.332928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:02 smithi131 bash[24745]: cluster 2024-09-14T04:17:01.005825+0000 mgr.a (mgr.14355) 15400 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:02 smithi131 bash[24745]: audit 2024-09-14T04:17:01.747208+0000 mgr.a (mgr.14355) 15401 : audit [DBG] from='client.332928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:02 smithi171 bash[25040]: cluster 2024-09-14T04:17:01.005825+0000 mgr.a (mgr.14355) 15400 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:02 smithi171 bash[25040]: audit 2024-09-14T04:17:01.747208+0000 mgr.a (mgr.14355) 15401 : audit [DBG] from='client.332928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:04 smithi007 bash[22722]: cluster 2024-09-14T04:17:03.006818+0000 mgr.a (mgr.14355) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:04.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:04 smithi131 bash[24745]: cluster 2024-09-14T04:17:03.006818+0000 mgr.a (mgr.14355) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:04 smithi171 bash[25040]: cluster 2024-09-14T04:17:03.006818+0000 mgr.a (mgr.14355) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:06.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:06 smithi007 bash[22722]: cluster 2024-09-14T04:17:05.007627+0000 mgr.a (mgr.14355) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:06 smithi131 bash[24745]: cluster 2024-09-14T04:17:05.007627+0000 mgr.a (mgr.14355) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:06 smithi171 bash[25040]: cluster 2024-09-14T04:17:05.007627+0000 mgr.a (mgr.14355) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:07.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:07.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:07.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:07.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:08.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:08 smithi007 bash[22722]: cluster 2024-09-14T04:17:07.009925+0000 mgr.a (mgr.14355) 15404 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:08.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:08 smithi007 bash[22722]: audit 2024-09-14T04:17:07.497877+0000 mgr.a (mgr.14355) 15405 : audit [DBG] from='client.333006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:08 smithi131 bash[24745]: cluster 2024-09-14T04:17:07.009925+0000 mgr.a (mgr.14355) 15404 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:08.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:08 smithi131 bash[24745]: audit 2024-09-14T04:17:07.497877+0000 mgr.a (mgr.14355) 15405 : audit [DBG] from='client.333006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:08 smithi171 bash[25040]: cluster 2024-09-14T04:17:07.009925+0000 mgr.a (mgr.14355) 15404 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:08 smithi171 bash[25040]: audit 2024-09-14T04:17:07.497877+0000 mgr.a (mgr.14355) 15405 : audit [DBG] from='client.333006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:10 smithi007 bash[22722]: cluster 2024-09-14T04:17:09.010961+0000 mgr.a (mgr.14355) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:10 smithi131 bash[24745]: cluster 2024-09-14T04:17:09.010961+0000 mgr.a (mgr.14355) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:10 smithi171 bash[25040]: cluster 2024-09-14T04:17:09.010961+0000 mgr.a (mgr.14355) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:12 smithi007 bash[22722]: cluster 2024-09-14T04:17:11.013169+0000 mgr.a (mgr.14355) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:12 smithi131 bash[24745]: cluster 2024-09-14T04:17:11.013169+0000 mgr.a (mgr.14355) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:12 smithi171 bash[25040]: cluster 2024-09-14T04:17:11.013169+0000 mgr.a (mgr.14355) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:12.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:12.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:13.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:13.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:13.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:13.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:14 smithi007 bash[22722]: cluster 2024-09-14T04:17:13.013947+0000 mgr.a (mgr.14355) 15408 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:14 smithi007 bash[22722]: audit 2024-09-14T04:17:13.260634+0000 mgr.a (mgr.14355) 15409 : audit [DBG] from='client.333084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:14 smithi131 bash[24745]: cluster 2024-09-14T04:17:13.013947+0000 mgr.a (mgr.14355) 15408 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:14 smithi131 bash[24745]: audit 2024-09-14T04:17:13.260634+0000 mgr.a (mgr.14355) 15409 : audit [DBG] from='client.333084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:14 smithi171 bash[25040]: cluster 2024-09-14T04:17:13.013947+0000 mgr.a (mgr.14355) 15408 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:14 smithi171 bash[25040]: audit 2024-09-14T04:17:13.260634+0000 mgr.a (mgr.14355) 15409 : audit [DBG] from='client.333084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:16 smithi007 bash[22722]: cluster 2024-09-14T04:17:15.015108+0000 mgr.a (mgr.14355) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:16 smithi131 bash[24745]: cluster 2024-09-14T04:17:15.015108+0000 mgr.a (mgr.14355) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:16.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:16 smithi171 bash[25040]: cluster 2024-09-14T04:17:15.015108+0000 mgr.a (mgr.14355) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:18.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:18 smithi007 bash[22722]: cluster 2024-09-14T04:17:17.017548+0000 mgr.a (mgr.14355) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:18 smithi131 bash[24745]: cluster 2024-09-14T04:17:17.017548+0000 mgr.a (mgr.14355) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:18 smithi171 bash[25040]: cluster 2024-09-14T04:17:17.017548+0000 mgr.a (mgr.14355) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:18.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:19.443 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:20 smithi007 bash[22722]: audit 2024-09-14T04:17:19.013523+0000 mgr.a (mgr.14355) 15412 : audit [DBG] from='client.333159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:20.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:20 smithi007 bash[22722]: cluster 2024-09-14T04:17:19.032435+0000 mgr.a (mgr.14355) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:20.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:20 smithi131 bash[24745]: audit 2024-09-14T04:17:19.013523+0000 mgr.a (mgr.14355) 15412 : audit [DBG] from='client.333159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:20.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:20 smithi131 bash[24745]: cluster 2024-09-14T04:17:19.032435+0000 mgr.a (mgr.14355) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:20 smithi171 bash[25040]: audit 2024-09-14T04:17:19.013523+0000 mgr.a (mgr.14355) 15412 : audit [DBG] from='client.333159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:20 smithi171 bash[25040]: cluster 2024-09-14T04:17:19.032435+0000 mgr.a (mgr.14355) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:22 smithi007 bash[22722]: cluster 2024-09-14T04:17:21.034990+0000 mgr.a (mgr.14355) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:22 smithi131 bash[24745]: cluster 2024-09-14T04:17:21.034990+0000 mgr.a (mgr.14355) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:22 smithi171 bash[25040]: cluster 2024-09-14T04:17:21.034990+0000 mgr.a (mgr.14355) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:24.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:24.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:24.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:24 smithi007 bash[22722]: cluster 2024-09-14T04:17:23.035783+0000 mgr.a (mgr.14355) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:24 smithi131 bash[24745]: cluster 2024-09-14T04:17:23.035783+0000 mgr.a (mgr.14355) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:24 smithi171 bash[25040]: cluster 2024-09-14T04:17:23.035783+0000 mgr.a (mgr.14355) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:25.184 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:25.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:25 smithi131 bash[24745]: audit 2024-09-14T04:17:24.777446+0000 mgr.a (mgr.14355) 15416 : audit [DBG] from='client.333237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:25 smithi171 bash[25040]: audit 2024-09-14T04:17:24.777446+0000 mgr.a (mgr.14355) 15416 : audit [DBG] from='client.333237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:25 smithi007 bash[22722]: audit 2024-09-14T04:17:24.777446+0000 mgr.a (mgr.14355) 15416 : audit [DBG] from='client.333237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:26 smithi131 bash[24745]: cluster 2024-09-14T04:17:25.036295+0000 mgr.a (mgr.14355) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:26 smithi171 bash[25040]: cluster 2024-09-14T04:17:25.036295+0000 mgr.a (mgr.14355) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:26 smithi007 bash[22722]: cluster 2024-09-14T04:17:25.036295+0000 mgr.a (mgr.14355) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:28 smithi131 bash[24745]: cluster 2024-09-14T04:17:27.038648+0000 mgr.a (mgr.14355) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:28 smithi171 bash[25040]: cluster 2024-09-14T04:17:27.038648+0000 mgr.a (mgr.14355) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:28.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:28 smithi007 bash[22722]: cluster 2024-09-14T04:17:27.038648+0000 mgr.a (mgr.14355) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:30.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:30.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:30.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:30 smithi131 bash[24745]: cluster 2024-09-14T04:17:29.039439+0000 mgr.a (mgr.14355) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:30 smithi171 bash[25040]: cluster 2024-09-14T04:17:29.039439+0000 mgr.a (mgr.14355) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:30 smithi007 bash[22722]: cluster 2024-09-14T04:17:29.039439+0000 mgr.a (mgr.14355) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:30.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:30.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:30.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:30.974 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:30.975 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:31 smithi131 bash[24745]: audit 2024-09-14T04:17:30.522348+0000 mgr.a (mgr.14355) 15420 : audit [DBG] from='client.333315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:31 smithi131 bash[24745]: audit 2024-09-14T04:17:30.768194+0000 mon.a (mon.0) 2888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:17:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:31 smithi171 bash[25040]: audit 2024-09-14T04:17:30.522348+0000 mgr.a (mgr.14355) 15420 : audit [DBG] from='client.333315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:31 smithi171 bash[25040]: audit 2024-09-14T04:17:30.768194+0000 mon.a (mon.0) 2888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:17:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:31 smithi007 bash[22722]: audit 2024-09-14T04:17:30.522348+0000 mgr.a (mgr.14355) 15420 : audit [DBG] from='client.333315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:31 smithi007 bash[22722]: audit 2024-09-14T04:17:30.768194+0000 mon.a (mon.0) 2888 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: cluster 2024-09-14T04:17:31.040691+0000 mgr.a (mgr.14355) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: audit 2024-09-14T04:17:31.563932+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: audit 2024-09-14T04:17:31.565775+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: audit 2024-09-14T04:17:31.574995+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: audit 2024-09-14T04:17:31.580759+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:32 smithi131 bash[24745]: audit 2024-09-14T04:17:31.583261+0000 mgr.a (mgr.14355) 15422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: cluster 2024-09-14T04:17:31.040691+0000 mgr.a (mgr.14355) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: audit 2024-09-14T04:17:31.563932+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:17:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: audit 2024-09-14T04:17:31.565775+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:17:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: audit 2024-09-14T04:17:31.574995+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:17:32.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: audit 2024-09-14T04:17:31.580759+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:32.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:32 smithi171 bash[25040]: audit 2024-09-14T04:17:31.583261+0000 mgr.a (mgr.14355) 15422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:32.708 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22972]: debug 2024-09-14T04:17:32.321+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:17:32.708 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22972]: debug 2024-09-14T04:17:32.321+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: cluster 2024-09-14T04:17:31.040691+0000 mgr.a (mgr.14355) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: audit 2024-09-14T04:17:31.563932+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: audit 2024-09-14T04:17:31.565775+0000 mon.a (mon.0) 2890 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: audit 2024-09-14T04:17:31.574995+0000 mon.a (mon.0) 2891 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: audit 2024-09-14T04:17:31.580759+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:32.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:32 smithi007 bash[22722]: audit 2024-09-14T04:17:31.583261+0000 mgr.a (mgr.14355) 15422 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:17:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:33 smithi131 bash[24745]: audit 2024-09-14T04:17:32.322591+0000 mgr.a (mgr.14355) 15423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:17:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:33 smithi131 bash[24745]: cephadm 2024-09-14T04:17:32.324315+0000 mgr.a (mgr.14355) 15424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:17:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:33 smithi171 bash[25040]: audit 2024-09-14T04:17:32.322591+0000 mgr.a (mgr.14355) 15423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:17:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:33 smithi171 bash[25040]: cephadm 2024-09-14T04:17:32.324315+0000 mgr.a (mgr.14355) 15424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:17:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:33 smithi007 bash[22722]: audit 2024-09-14T04:17:32.322591+0000 mgr.a (mgr.14355) 15423 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:17:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:33 smithi007 bash[22722]: cephadm 2024-09-14T04:17:32.324315+0000 mgr.a (mgr.14355) 15424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:17:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:34 smithi131 bash[24745]: cluster 2024-09-14T04:17:33.041608+0000 mgr.a (mgr.14355) 15425 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:34 smithi171 bash[25040]: cluster 2024-09-14T04:17:33.041608+0000 mgr.a (mgr.14355) 15425 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:34 smithi007 bash[22722]: cluster 2024-09-14T04:17:33.041608+0000 mgr.a (mgr.14355) 15425 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:35.976 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:36 smithi131 bash[24745]: cluster 2024-09-14T04:17:35.042402+0000 mgr.a (mgr.14355) 15426 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:36 smithi171 bash[25040]: cluster 2024-09-14T04:17:35.042402+0000 mgr.a (mgr.14355) 15426 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:36 smithi007 bash[22722]: cluster 2024-09-14T04:17:35.042402+0000 mgr.a (mgr.14355) 15426 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:17:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:36.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:36.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:37 smithi131 bash[24745]: audit 2024-09-14T04:17:36.311996+0000 mgr.a (mgr.14355) 15427 : audit [DBG] from='client.333495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:37 smithi171 bash[25040]: audit 2024-09-14T04:17:36.311996+0000 mgr.a (mgr.14355) 15427 : audit [DBG] from='client.333495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:37 smithi007 bash[22722]: audit 2024-09-14T04:17:36.311996+0000 mgr.a (mgr.14355) 15427 : audit [DBG] from='client.333495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:38 smithi131 bash[24745]: cluster 2024-09-14T04:17:37.045286+0000 mgr.a (mgr.14355) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:38 smithi171 bash[25040]: cluster 2024-09-14T04:17:37.045286+0000 mgr.a (mgr.14355) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:38 smithi007 bash[22722]: cluster 2024-09-14T04:17:37.045286+0000 mgr.a (mgr.14355) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:40 smithi131 bash[24745]: cluster 2024-09-14T04:17:39.046068+0000 mgr.a (mgr.14355) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:17:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:40 smithi171 bash[25040]: cluster 2024-09-14T04:17:39.046068+0000 mgr.a (mgr.14355) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:17:40.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:40 smithi007 bash[22722]: cluster 2024-09-14T04:17:39.046068+0000 mgr.a (mgr.14355) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:17:41.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:41.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:41.767 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:42 smithi131 bash[24745]: cluster 2024-09-14T04:17:41.048053+0000 mgr.a (mgr.14355) 15430 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:42 smithi171 bash[25040]: cluster 2024-09-14T04:17:41.048053+0000 mgr.a (mgr.14355) 15430 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:42.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:42.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:42.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:42.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:42.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:42 smithi007 bash[22722]: cluster 2024-09-14T04:17:41.048053+0000 mgr.a (mgr.14355) 15430 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:43 smithi131 bash[24745]: audit 2024-09-14T04:17:42.101608+0000 mgr.a (mgr.14355) 15431 : audit [DBG] from='client.333573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:43 smithi171 bash[25040]: audit 2024-09-14T04:17:42.101608+0000 mgr.a (mgr.14355) 15431 : audit [DBG] from='client.333573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:43 smithi007 bash[22722]: audit 2024-09-14T04:17:42.101608+0000 mgr.a (mgr.14355) 15431 : audit [DBG] from='client.333573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:44 smithi131 bash[24745]: cluster 2024-09-14T04:17:43.049001+0000 mgr.a (mgr.14355) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:44 smithi171 bash[25040]: cluster 2024-09-14T04:17:43.049001+0000 mgr.a (mgr.14355) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:44 smithi007 bash[22722]: cluster 2024-09-14T04:17:43.049001+0000 mgr.a (mgr.14355) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:46 smithi131 bash[24745]: cluster 2024-09-14T04:17:45.049813+0000 mgr.a (mgr.14355) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:46 smithi171 bash[25040]: cluster 2024-09-14T04:17:45.049813+0000 mgr.a (mgr.14355) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:46 smithi007 bash[22722]: cluster 2024-09-14T04:17:45.049813+0000 mgr.a (mgr.14355) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:48.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:48.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:48.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:48.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:48.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:48 smithi171 bash[25040]: cluster 2024-09-14T04:17:47.052067+0000 mgr.a (mgr.14355) 15434 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:48 smithi171 bash[25040]: audit 2024-09-14T04:17:47.888671+0000 mgr.a (mgr.14355) 15435 : audit [DBG] from='client.333651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:48 smithi007 bash[22722]: cluster 2024-09-14T04:17:47.052067+0000 mgr.a (mgr.14355) 15434 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:48 smithi007 bash[22722]: audit 2024-09-14T04:17:47.888671+0000 mgr.a (mgr.14355) 15435 : audit [DBG] from='client.333651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:48 smithi131 bash[24745]: cluster 2024-09-14T04:17:47.052067+0000 mgr.a (mgr.14355) 15434 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:17:48.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:48 smithi131 bash[24745]: audit 2024-09-14T04:17:47.888671+0000 mgr.a (mgr.14355) 15435 : audit [DBG] from='client.333651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:50 smithi007 bash[22722]: cluster 2024-09-14T04:17:49.053086+0000 mgr.a (mgr.14355) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:50 smithi131 bash[24745]: cluster 2024-09-14T04:17:49.053086+0000 mgr.a (mgr.14355) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:50 smithi171 bash[25040]: cluster 2024-09-14T04:17:49.053086+0000 mgr.a (mgr.14355) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:52 smithi007 bash[22722]: cluster 2024-09-14T04:17:51.055332+0000 mgr.a (mgr.14355) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:52 smithi131 bash[24745]: cluster 2024-09-14T04:17:51.055332+0000 mgr.a (mgr.14355) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:52 smithi171 bash[25040]: cluster 2024-09-14T04:17:51.055332+0000 mgr.a (mgr.14355) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:53.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:53.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:53.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:17:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:54.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:54 smithi007 bash[22722]: cluster 2024-09-14T04:17:53.056134+0000 mgr.a (mgr.14355) 15438 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:54 smithi007 bash[22722]: audit 2024-09-14T04:17:53.674750+0000 mgr.a (mgr.14355) 15439 : audit [DBG] from='client.333726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:54 smithi131 bash[24745]: cluster 2024-09-14T04:17:53.056134+0000 mgr.a (mgr.14355) 15438 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:54 smithi131 bash[24745]: audit 2024-09-14T04:17:53.674750+0000 mgr.a (mgr.14355) 15439 : audit [DBG] from='client.333726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:54 smithi171 bash[25040]: cluster 2024-09-14T04:17:53.056134+0000 mgr.a (mgr.14355) 15438 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:54 smithi171 bash[25040]: audit 2024-09-14T04:17:53.674750+0000 mgr.a (mgr.14355) 15439 : audit [DBG] from='client.333726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:17:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:56 smithi007 bash[22722]: cluster 2024-09-14T04:17:55.057117+0000 mgr.a (mgr.14355) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:57.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:56 smithi131 bash[24745]: cluster 2024-09-14T04:17:55.057117+0000 mgr.a (mgr.14355) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:56 smithi171 bash[25040]: cluster 2024-09-14T04:17:55.057117+0000 mgr.a (mgr.14355) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:17:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:17:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:17:59.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:17:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:17:58 smithi007 bash[22722]: cluster 2024-09-14T04:17:57.059436+0000 mgr.a (mgr.14355) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:17:58 smithi131 bash[24745]: cluster 2024-09-14T04:17:57.059436+0000 mgr.a (mgr.14355) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:17:58 smithi171 bash[25040]: cluster 2024-09-14T04:17:57.059436+0000 mgr.a (mgr.14355) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:17:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:17:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:17:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:17:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:00 smithi007 bash[22722]: cluster 2024-09-14T04:17:59.060219+0000 mgr.a (mgr.14355) 15442 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:00 smithi007 bash[22722]: audit 2024-09-14T04:17:59.471905+0000 mgr.a (mgr.14355) 15443 : audit [DBG] from='client.333804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:00 smithi131 bash[24745]: cluster 2024-09-14T04:17:59.060219+0000 mgr.a (mgr.14355) 15442 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:01.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:00 smithi131 bash[24745]: audit 2024-09-14T04:17:59.471905+0000 mgr.a (mgr.14355) 15443 : audit [DBG] from='client.333804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:00 smithi171 bash[25040]: cluster 2024-09-14T04:17:59.060219+0000 mgr.a (mgr.14355) 15442 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:00 smithi171 bash[25040]: audit 2024-09-14T04:17:59.471905+0000 mgr.a (mgr.14355) 15443 : audit [DBG] from='client.333804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:02 smithi007 bash[22722]: cluster 2024-09-14T04:18:01.062627+0000 mgr.a (mgr.14355) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:02 smithi131 bash[24745]: cluster 2024-09-14T04:18:01.062627+0000 mgr.a (mgr.14355) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:02 smithi171 bash[25040]: cluster 2024-09-14T04:18:01.062627+0000 mgr.a (mgr.14355) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:04.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:04.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:04 smithi007 bash[22722]: cluster 2024-09-14T04:18:03.063414+0000 mgr.a (mgr.14355) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:04 smithi131 bash[24745]: cluster 2024-09-14T04:18:03.063414+0000 mgr.a (mgr.14355) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:04 smithi171 bash[25040]: cluster 2024-09-14T04:18:03.063414+0000 mgr.a (mgr.14355) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:05.710 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:05.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:05.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:05.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:05.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:06 smithi007 bash[22722]: cluster 2024-09-14T04:18:05.063866+0000 mgr.a (mgr.14355) 15446 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:06 smithi007 bash[22722]: audit 2024-09-14T04:18:05.256853+0000 mgr.a (mgr.14355) 15447 : audit [DBG] from='client.333882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:06 smithi131 bash[24745]: cluster 2024-09-14T04:18:05.063866+0000 mgr.a (mgr.14355) 15446 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:07.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:06 smithi131 bash[24745]: audit 2024-09-14T04:18:05.256853+0000 mgr.a (mgr.14355) 15447 : audit [DBG] from='client.333882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:06 smithi171 bash[25040]: cluster 2024-09-14T04:18:05.063866+0000 mgr.a (mgr.14355) 15446 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:06 smithi171 bash[25040]: audit 2024-09-14T04:18:05.256853+0000 mgr.a (mgr.14355) 15447 : audit [DBG] from='client.333882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:08 smithi007 bash[22722]: cluster 2024-09-14T04:18:07.066618+0000 mgr.a (mgr.14355) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:08 smithi131 bash[24745]: cluster 2024-09-14T04:18:07.066618+0000 mgr.a (mgr.14355) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:08 smithi171 bash[25040]: cluster 2024-09-14T04:18:07.066618+0000 mgr.a (mgr.14355) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:10.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:10.713 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:10.713 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:10 smithi007 bash[22722]: cluster 2024-09-14T04:18:09.067572+0000 mgr.a (mgr.14355) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:10 smithi131 bash[24745]: cluster 2024-09-14T04:18:09.067572+0000 mgr.a (mgr.14355) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:10 smithi171 bash[25040]: cluster 2024-09-14T04:18:09.067572+0000 mgr.a (mgr.14355) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:11.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:11.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:12 smithi007 bash[22722]: audit 2024-09-14T04:18:11.048852+0000 mgr.a (mgr.14355) 15450 : audit [DBG] from='client.333960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:12 smithi007 bash[22722]: cluster 2024-09-14T04:18:11.070038+0000 mgr.a (mgr.14355) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:12 smithi131 bash[24745]: audit 2024-09-14T04:18:11.048852+0000 mgr.a (mgr.14355) 15450 : audit [DBG] from='client.333960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:12 smithi131 bash[24745]: cluster 2024-09-14T04:18:11.070038+0000 mgr.a (mgr.14355) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:12 smithi171 bash[25040]: audit 2024-09-14T04:18:11.048852+0000 mgr.a (mgr.14355) 15450 : audit [DBG] from='client.333960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:12 smithi171 bash[25040]: cluster 2024-09-14T04:18:11.070038+0000 mgr.a (mgr.14355) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:14 smithi007 bash[22722]: cluster 2024-09-14T04:18:13.071006+0000 mgr.a (mgr.14355) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:14 smithi131 bash[24745]: cluster 2024-09-14T04:18:13.071006+0000 mgr.a (mgr.14355) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:14 smithi171 bash[25040]: cluster 2024-09-14T04:18:13.071006+0000 mgr.a (mgr.14355) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:16.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:16 smithi007 bash[22722]: cluster 2024-09-14T04:18:15.071780+0000 mgr.a (mgr.14355) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:17.257 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:17.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:16 smithi131 bash[24745]: cluster 2024-09-14T04:18:15.071780+0000 mgr.a (mgr.14355) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:16 smithi171 bash[25040]: cluster 2024-09-14T04:18:15.071780+0000 mgr.a (mgr.14355) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:17 smithi007 bash[22722]: audit 2024-09-14T04:18:16.835392+0000 mgr.a (mgr.14355) 15454 : audit [DBG] from='client.334032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:17 smithi131 bash[24745]: audit 2024-09-14T04:18:16.835392+0000 mgr.a (mgr.14355) 15454 : audit [DBG] from='client.334032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:17 smithi171 bash[25040]: audit 2024-09-14T04:18:16.835392+0000 mgr.a (mgr.14355) 15454 : audit [DBG] from='client.334032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:18 smithi007 bash[22722]: cluster 2024-09-14T04:18:17.073411+0000 mgr.a (mgr.14355) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:18 smithi131 bash[24745]: cluster 2024-09-14T04:18:17.073411+0000 mgr.a (mgr.14355) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:18 smithi171 bash[25040]: cluster 2024-09-14T04:18:17.073411+0000 mgr.a (mgr.14355) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:20 smithi007 bash[22722]: cluster 2024-09-14T04:18:19.074333+0000 mgr.a (mgr.14355) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:20 smithi131 bash[24745]: cluster 2024-09-14T04:18:19.074333+0000 mgr.a (mgr.14355) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:20 smithi171 bash[25040]: cluster 2024-09-14T04:18:19.074333+0000 mgr.a (mgr.14355) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:23.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:23.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:23.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:22 smithi007 bash[22722]: cluster 2024-09-14T04:18:21.076609+0000 mgr.a (mgr.14355) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:22 smithi131 bash[24745]: cluster 2024-09-14T04:18:21.076609+0000 mgr.a (mgr.14355) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:22 smithi171 bash[25040]: cluster 2024-09-14T04:18:21.076609+0000 mgr.a (mgr.14355) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:23 smithi007 bash[22722]: audit 2024-09-14T04:18:22.589301+0000 mgr.a (mgr.14355) 15458 : audit [DBG] from='client.334104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:23 smithi131 bash[24745]: audit 2024-09-14T04:18:22.589301+0000 mgr.a (mgr.14355) 15458 : audit [DBG] from='client.334104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:23 smithi171 bash[25040]: audit 2024-09-14T04:18:22.589301+0000 mgr.a (mgr.14355) 15458 : audit [DBG] from='client.334104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:24 smithi007 bash[22722]: cluster 2024-09-14T04:18:23.077112+0000 mgr.a (mgr.14355) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:24 smithi131 bash[24745]: cluster 2024-09-14T04:18:23.077112+0000 mgr.a (mgr.14355) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:24 smithi171 bash[25040]: cluster 2024-09-14T04:18:23.077112+0000 mgr.a (mgr.14355) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:26 smithi007 bash[22722]: cluster 2024-09-14T04:18:25.077860+0000 mgr.a (mgr.14355) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:26 smithi131 bash[24745]: cluster 2024-09-14T04:18:25.077860+0000 mgr.a (mgr.14355) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:26 smithi171 bash[25040]: cluster 2024-09-14T04:18:25.077860+0000 mgr.a (mgr.14355) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:28.803 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:28.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:28.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:28.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:28.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:28 smithi007 bash[22722]: cluster 2024-09-14T04:18:27.080195+0000 mgr.a (mgr.14355) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:28 smithi131 bash[24745]: cluster 2024-09-14T04:18:27.080195+0000 mgr.a (mgr.14355) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:28 smithi171 bash[25040]: cluster 2024-09-14T04:18:27.080195+0000 mgr.a (mgr.14355) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:29 smithi007 bash[22722]: audit 2024-09-14T04:18:28.366974+0000 mgr.a (mgr.14355) 15462 : audit [DBG] from='client.334182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:29 smithi131 bash[24745]: audit 2024-09-14T04:18:28.366974+0000 mgr.a (mgr.14355) 15462 : audit [DBG] from='client.334182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:29 smithi171 bash[25040]: audit 2024-09-14T04:18:28.366974+0000 mgr.a (mgr.14355) 15462 : audit [DBG] from='client.334182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:30 smithi007 bash[22722]: cluster 2024-09-14T04:18:29.081170+0000 mgr.a (mgr.14355) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:30 smithi131 bash[24745]: cluster 2024-09-14T04:18:29.081170+0000 mgr.a (mgr.14355) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:30 smithi171 bash[25040]: cluster 2024-09-14T04:18:29.081170+0000 mgr.a (mgr.14355) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:33.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:32 smithi007 bash[22722]: cluster 2024-09-14T04:18:31.083532+0000 mgr.a (mgr.14355) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:33.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:32 smithi007 bash[22722]: audit 2024-09-14T04:18:32.379583+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:18:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:32 smithi131 bash[24745]: cluster 2024-09-14T04:18:31.083532+0000 mgr.a (mgr.14355) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:32 smithi131 bash[24745]: audit 2024-09-14T04:18:32.379583+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:18:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:32 smithi171 bash[25040]: cluster 2024-09-14T04:18:31.083532+0000 mgr.a (mgr.14355) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:32 smithi171 bash[25040]: audit 2024-09-14T04:18:32.379583+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:18:33.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:33.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:34.562 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:34.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:34 smithi007 bash[22722]: cluster 2024-09-14T04:18:33.084285+0000 mgr.a (mgr.14355) 15465 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:34 smithi131 bash[24745]: cluster 2024-09-14T04:18:33.084285+0000 mgr.a (mgr.14355) 15465 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:34 smithi171 bash[25040]: cluster 2024-09-14T04:18:33.084285+0000 mgr.a (mgr.14355) 15465 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:35 smithi131 bash[24745]: audit 2024-09-14T04:18:34.139812+0000 mgr.a (mgr.14355) 15466 : audit [DBG] from='client.334260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:35 smithi171 bash[25040]: audit 2024-09-14T04:18:34.139812+0000 mgr.a (mgr.14355) 15466 : audit [DBG] from='client.334260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:35 smithi007 bash[22722]: audit 2024-09-14T04:18:34.139812+0000 mgr.a (mgr.14355) 15466 : audit [DBG] from='client.334260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:36 smithi131 bash[24745]: cluster 2024-09-14T04:18:35.085241+0000 mgr.a (mgr.14355) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:36 smithi171 bash[25040]: cluster 2024-09-14T04:18:35.085241+0000 mgr.a (mgr.14355) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:36 smithi007 bash[22722]: cluster 2024-09-14T04:18:35.085241+0000 mgr.a (mgr.14355) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: cluster 2024-09-14T04:18:37.087575+0000 mgr.a (mgr.14355) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.726440+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.731298+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.748579+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.754060+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.762113+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:37.767370+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:38.473094+0000 mon.a (mon.0) 2900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:18:39.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:38.475081+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:18:39.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:38.485961+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:38 smithi131 bash[24745]: audit 2024-09-14T04:18:38.491192+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: cluster 2024-09-14T04:18:37.087575+0000 mgr.a (mgr.14355) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.726440+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.731298+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.748579+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.754060+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.762113+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:37.767370+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:38.473094+0000 mon.a (mon.0) 2900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:38.475081+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:38.485961+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:38 smithi171 bash[25040]: audit 2024-09-14T04:18:38.491192+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: cluster 2024-09-14T04:18:37.087575+0000 mgr.a (mgr.14355) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.726440+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.731298+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.748579+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.754060+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.762113+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:37.767370+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:38.473094+0000 mon.a (mon.0) 2900 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:18:39.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:38.475081+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:18:39.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:38.485961+0000 mon.a (mon.0) 2902 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:18:39.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:38 smithi007 bash[22722]: audit 2024-09-14T04:18:38.491192+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:39.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:39.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:39.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:18:39 smithi007 bash[22972]: debug 2024-09-14T04:18:39.244+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:18:39.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:18:39 smithi007 bash[22972]: debug 2024-09-14T04:18:39.248+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:18:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:39 smithi131 bash[24745]: audit 2024-09-14T04:18:38.493486+0000 mgr.a (mgr.14355) 15469 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:40.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:39 smithi171 bash[25040]: audit 2024-09-14T04:18:38.493486+0000 mgr.a (mgr.14355) 15469 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:39 smithi007 bash[22722]: audit 2024-09-14T04:18:38.493486+0000 mgr.a (mgr.14355) 15469 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:18:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:40.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:40 smithi131 bash[24745]: cluster 2024-09-14T04:18:39.088075+0000 mgr.a (mgr.14355) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:40 smithi131 bash[24745]: audit 2024-09-14T04:18:39.250274+0000 mgr.a (mgr.14355) 15471 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:18:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:40 smithi131 bash[24745]: cephadm 2024-09-14T04:18:39.251597+0000 mgr.a (mgr.14355) 15472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:18:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:40 smithi131 bash[24745]: audit 2024-09-14T04:18:39.886632+0000 mgr.a (mgr.14355) 15473 : audit [DBG] from='client.334443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:40 smithi171 bash[25040]: cluster 2024-09-14T04:18:39.088075+0000 mgr.a (mgr.14355) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:40 smithi171 bash[25040]: audit 2024-09-14T04:18:39.250274+0000 mgr.a (mgr.14355) 15471 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:18:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:40 smithi171 bash[25040]: cephadm 2024-09-14T04:18:39.251597+0000 mgr.a (mgr.14355) 15472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:18:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:40 smithi171 bash[25040]: audit 2024-09-14T04:18:39.886632+0000 mgr.a (mgr.14355) 15473 : audit [DBG] from='client.334443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:40 smithi007 bash[22722]: cluster 2024-09-14T04:18:39.088075+0000 mgr.a (mgr.14355) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:40 smithi007 bash[22722]: audit 2024-09-14T04:18:39.250274+0000 mgr.a (mgr.14355) 15471 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:18:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:40 smithi007 bash[22722]: cephadm 2024-09-14T04:18:39.251597+0000 mgr.a (mgr.14355) 15472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:18:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:40 smithi007 bash[22722]: audit 2024-09-14T04:18:39.886632+0000 mgr.a (mgr.14355) 15473 : audit [DBG] from='client.334443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:42 smithi131 bash[24745]: cluster 2024-09-14T04:18:41.090428+0000 mgr.a (mgr.14355) 15474 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:42 smithi171 bash[25040]: cluster 2024-09-14T04:18:41.090428+0000 mgr.a (mgr.14355) 15474 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:42 smithi007 bash[22722]: cluster 2024-09-14T04:18:41.090428+0000 mgr.a (mgr.14355) 15474 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:44 smithi131 bash[24745]: cluster 2024-09-14T04:18:43.091214+0000 mgr.a (mgr.14355) 15475 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:44 smithi171 bash[25040]: cluster 2024-09-14T04:18:43.091214+0000 mgr.a (mgr.14355) 15475 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:44 smithi007 bash[22722]: cluster 2024-09-14T04:18:43.091214+0000 mgr.a (mgr.14355) 15475 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:45.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:45.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:45.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:46.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:46.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:46.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:46 smithi131 bash[24745]: cluster 2024-09-14T04:18:45.091981+0000 mgr.a (mgr.14355) 15476 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:47.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:46 smithi131 bash[24745]: audit 2024-09-14T04:18:45.642281+0000 mgr.a (mgr.14355) 15477 : audit [DBG] from='client.334521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:46 smithi171 bash[25040]: cluster 2024-09-14T04:18:45.091981+0000 mgr.a (mgr.14355) 15476 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:46 smithi171 bash[25040]: audit 2024-09-14T04:18:45.642281+0000 mgr.a (mgr.14355) 15477 : audit [DBG] from='client.334521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:46 smithi007 bash[22722]: cluster 2024-09-14T04:18:45.091981+0000 mgr.a (mgr.14355) 15476 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:46 smithi007 bash[22722]: audit 2024-09-14T04:18:45.642281+0000 mgr.a (mgr.14355) 15477 : audit [DBG] from='client.334521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:48 smithi131 bash[24745]: cluster 2024-09-14T04:18:47.094760+0000 mgr.a (mgr.14355) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:48 smithi171 bash[25040]: cluster 2024-09-14T04:18:47.094760+0000 mgr.a (mgr.14355) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:48 smithi007 bash[22722]: cluster 2024-09-14T04:18:47.094760+0000 mgr.a (mgr.14355) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:51.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:51.097 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:50 smithi007 bash[22722]: cluster 2024-09-14T04:18:49.095558+0000 mgr.a (mgr.14355) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:18:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:50 smithi131 bash[24745]: cluster 2024-09-14T04:18:49.095558+0000 mgr.a (mgr.14355) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:18:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:50 smithi171 bash[25040]: cluster 2024-09-14T04:18:49.095558+0000 mgr.a (mgr.14355) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:18:51.846 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:52 smithi007 bash[22722]: cluster 2024-09-14T04:18:51.096868+0000 mgr.a (mgr.14355) 15480 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:52 smithi007 bash[22722]: audit 2024-09-14T04:18:51.427388+0000 mgr.a (mgr.14355) 15481 : audit [DBG] from='client.334596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:52 smithi131 bash[24745]: cluster 2024-09-14T04:18:51.096868+0000 mgr.a (mgr.14355) 15480 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:52 smithi131 bash[24745]: audit 2024-09-14T04:18:51.427388+0000 mgr.a (mgr.14355) 15481 : audit [DBG] from='client.334596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:52 smithi171 bash[25040]: cluster 2024-09-14T04:18:51.096868+0000 mgr.a (mgr.14355) 15480 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:18:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:52 smithi171 bash[25040]: audit 2024-09-14T04:18:51.427388+0000 mgr.a (mgr.14355) 15481 : audit [DBG] from='client.334596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:54 smithi007 bash[22722]: cluster 2024-09-14T04:18:53.097775+0000 mgr.a (mgr.14355) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:54 smithi131 bash[24745]: cluster 2024-09-14T04:18:53.097775+0000 mgr.a (mgr.14355) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:54 smithi171 bash[25040]: cluster 2024-09-14T04:18:53.097775+0000 mgr.a (mgr.14355) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:18:56.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:18:56.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:18:56.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:18:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:56 smithi007 bash[22722]: cluster 2024-09-14T04:18:55.098578+0000 mgr.a (mgr.14355) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:56 smithi131 bash[24745]: cluster 2024-09-14T04:18:55.098578+0000 mgr.a (mgr.14355) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:56 smithi171 bash[25040]: cluster 2024-09-14T04:18:55.098578+0000 mgr.a (mgr.14355) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:18:57.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:18:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:18:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:18:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:18:57.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:18:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:58 smithi007 bash[22722]: cluster 2024-09-14T04:18:57.100847+0000 mgr.a (mgr.14355) 15484 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:18:58 smithi007 bash[22722]: audit 2024-09-14T04:18:57.186213+0000 mgr.a (mgr.14355) 15485 : audit [DBG] from='client.334674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:58 smithi131 bash[24745]: cluster 2024-09-14T04:18:57.100847+0000 mgr.a (mgr.14355) 15484 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:59.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:18:58 smithi131 bash[24745]: audit 2024-09-14T04:18:57.186213+0000 mgr.a (mgr.14355) 15485 : audit [DBG] from='client.334674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:18:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:58 smithi171 bash[25040]: cluster 2024-09-14T04:18:57.100847+0000 mgr.a (mgr.14355) 15484 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:18:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:18:58 smithi171 bash[25040]: audit 2024-09-14T04:18:57.186213+0000 mgr.a (mgr.14355) 15485 : audit [DBG] from='client.334674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:00 smithi007 bash[22722]: cluster 2024-09-14T04:18:59.101782+0000 mgr.a (mgr.14355) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:00 smithi131 bash[24745]: cluster 2024-09-14T04:18:59.101782+0000 mgr.a (mgr.14355) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:00 smithi171 bash[25040]: cluster 2024-09-14T04:18:59.101782+0000 mgr.a (mgr.14355) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:02.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:02.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:02.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:02 smithi007 bash[22722]: cluster 2024-09-14T04:19:01.104078+0000 mgr.a (mgr.14355) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:02 smithi131 bash[24745]: cluster 2024-09-14T04:19:01.104078+0000 mgr.a (mgr.14355) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:02 smithi171 bash[25040]: cluster 2024-09-14T04:19:01.104078+0000 mgr.a (mgr.14355) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:03.418 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:03 smithi007 bash[22722]: audit 2024-09-14T04:19:02.973317+0000 mgr.a (mgr.14355) 15488 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:03 smithi131 bash[24745]: audit 2024-09-14T04:19:02.973317+0000 mgr.a (mgr.14355) 15488 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:03 smithi171 bash[25040]: audit 2024-09-14T04:19:02.973317+0000 mgr.a (mgr.14355) 15488 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:04 smithi007 bash[22722]: cluster 2024-09-14T04:19:03.104668+0000 mgr.a (mgr.14355) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:04 smithi131 bash[24745]: cluster 2024-09-14T04:19:03.104668+0000 mgr.a (mgr.14355) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:04 smithi171 bash[25040]: cluster 2024-09-14T04:19:03.104668+0000 mgr.a (mgr.14355) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:06 smithi007 bash[22722]: cluster 2024-09-14T04:19:05.105561+0000 mgr.a (mgr.14355) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:06 smithi131 bash[24745]: cluster 2024-09-14T04:19:05.105561+0000 mgr.a (mgr.14355) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:06 smithi171 bash[25040]: cluster 2024-09-14T04:19:05.105561+0000 mgr.a (mgr.14355) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:08.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:09.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:08 smithi007 bash[22722]: cluster 2024-09-14T04:19:07.107851+0000 mgr.a (mgr.14355) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:08 smithi131 bash[24745]: cluster 2024-09-14T04:19:07.107851+0000 mgr.a (mgr.14355) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:08 smithi171 bash[25040]: cluster 2024-09-14T04:19:07.107851+0000 mgr.a (mgr.14355) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:09 smithi007 bash[22722]: audit 2024-09-14T04:19:08.755975+0000 mgr.a (mgr.14355) 15492 : audit [DBG] from='client.334827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:09 smithi131 bash[24745]: audit 2024-09-14T04:19:08.755975+0000 mgr.a (mgr.14355) 15492 : audit [DBG] from='client.334827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:09 smithi171 bash[25040]: audit 2024-09-14T04:19:08.755975+0000 mgr.a (mgr.14355) 15492 : audit [DBG] from='client.334827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:10 smithi007 bash[22722]: cluster 2024-09-14T04:19:09.108747+0000 mgr.a (mgr.14355) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:10 smithi131 bash[24745]: cluster 2024-09-14T04:19:09.108747+0000 mgr.a (mgr.14355) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:10 smithi171 bash[25040]: cluster 2024-09-14T04:19:09.108747+0000 mgr.a (mgr.14355) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:12 smithi007 bash[22722]: cluster 2024-09-14T04:19:11.111218+0000 mgr.a (mgr.14355) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:12 smithi131 bash[24745]: cluster 2024-09-14T04:19:11.111218+0000 mgr.a (mgr.14355) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:12 smithi171 bash[25040]: cluster 2024-09-14T04:19:11.111218+0000 mgr.a (mgr.14355) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:14.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:14.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:14.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:14.945 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:14.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:14.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:14.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:14.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:14 smithi007 bash[22722]: cluster 2024-09-14T04:19:13.112009+0000 mgr.a (mgr.14355) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:14 smithi131 bash[24745]: cluster 2024-09-14T04:19:13.112009+0000 mgr.a (mgr.14355) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:14 smithi171 bash[25040]: cluster 2024-09-14T04:19:13.112009+0000 mgr.a (mgr.14355) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:15 smithi007 bash[22722]: audit 2024-09-14T04:19:14.524159+0000 mgr.a (mgr.14355) 15496 : audit [DBG] from='client.334905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:15 smithi131 bash[24745]: audit 2024-09-14T04:19:14.524159+0000 mgr.a (mgr.14355) 15496 : audit [DBG] from='client.334905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:16.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:15 smithi171 bash[25040]: audit 2024-09-14T04:19:14.524159+0000 mgr.a (mgr.14355) 15496 : audit [DBG] from='client.334905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:16 smithi007 bash[22722]: cluster 2024-09-14T04:19:15.113076+0000 mgr.a (mgr.14355) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:16 smithi131 bash[24745]: cluster 2024-09-14T04:19:15.113076+0000 mgr.a (mgr.14355) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:16 smithi171 bash[25040]: cluster 2024-09-14T04:19:15.113076+0000 mgr.a (mgr.14355) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:18 smithi007 bash[22722]: cluster 2024-09-14T04:19:17.115389+0000 mgr.a (mgr.14355) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:18 smithi131 bash[24745]: cluster 2024-09-14T04:19:17.115389+0000 mgr.a (mgr.14355) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:18 smithi171 bash[25040]: cluster 2024-09-14T04:19:17.115389+0000 mgr.a (mgr.14355) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:19.947 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:19.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:19.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:20.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:20.683 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:20 smithi007 bash[22722]: cluster 2024-09-14T04:19:19.116151+0000 mgr.a (mgr.14355) 15499 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:20 smithi131 bash[24745]: cluster 2024-09-14T04:19:19.116151+0000 mgr.a (mgr.14355) 15499 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:20 smithi171 bash[25040]: cluster 2024-09-14T04:19:19.116151+0000 mgr.a (mgr.14355) 15499 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:21 smithi007 bash[22722]: audit 2024-09-14T04:19:20.273958+0000 mgr.a (mgr.14355) 15500 : audit [DBG] from='client.334983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:21 smithi131 bash[24745]: audit 2024-09-14T04:19:20.273958+0000 mgr.a (mgr.14355) 15500 : audit [DBG] from='client.334983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:21 smithi171 bash[25040]: audit 2024-09-14T04:19:20.273958+0000 mgr.a (mgr.14355) 15500 : audit [DBG] from='client.334983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:22 smithi007 bash[22722]: cluster 2024-09-14T04:19:21.118934+0000 mgr.a (mgr.14355) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:22 smithi131 bash[24745]: cluster 2024-09-14T04:19:21.118934+0000 mgr.a (mgr.14355) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:22 smithi171 bash[25040]: cluster 2024-09-14T04:19:21.118934+0000 mgr.a (mgr.14355) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:24 smithi007 bash[22722]: cluster 2024-09-14T04:19:23.119705+0000 mgr.a (mgr.14355) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:24 smithi131 bash[24745]: cluster 2024-09-14T04:19:23.119705+0000 mgr.a (mgr.14355) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:24 smithi171 bash[25040]: cluster 2024-09-14T04:19:23.119705+0000 mgr.a (mgr.14355) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:25.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:26.459 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:26.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:26.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:26.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:26.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:26 smithi007 bash[22722]: cluster 2024-09-14T04:19:25.120486+0000 mgr.a (mgr.14355) 15503 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:19:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:26 smithi007 bash[22722]: audit 2024-09-14T04:19:26.020192+0000 mgr.a (mgr.14355) 15504 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:26 smithi131 bash[24745]: cluster 2024-09-14T04:19:25.120486+0000 mgr.a (mgr.14355) 15503 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:19:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:26 smithi131 bash[24745]: audit 2024-09-14T04:19:26.020192+0000 mgr.a (mgr.14355) 15504 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:26 smithi171 bash[25040]: cluster 2024-09-14T04:19:25.120486+0000 mgr.a (mgr.14355) 15503 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:19:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:26 smithi171 bash[25040]: audit 2024-09-14T04:19:26.020192+0000 mgr.a (mgr.14355) 15504 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:28 smithi007 bash[22722]: cluster 2024-09-14T04:19:27.123213+0000 mgr.a (mgr.14355) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:28 smithi131 bash[24745]: cluster 2024-09-14T04:19:27.123213+0000 mgr.a (mgr.14355) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:28 smithi171 bash[25040]: cluster 2024-09-14T04:19:27.123213+0000 mgr.a (mgr.14355) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:30 smithi131 bash[24745]: cluster 2024-09-14T04:19:29.123996+0000 mgr.a (mgr.14355) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:30 smithi171 bash[25040]: cluster 2024-09-14T04:19:29.123996+0000 mgr.a (mgr.14355) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:30 smithi007 bash[22722]: cluster 2024-09-14T04:19:29.123996+0000 mgr.a (mgr.14355) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:19:31.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:31.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:31.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:32.202 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:32.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:32 smithi131 bash[24745]: cluster 2024-09-14T04:19:31.126175+0000 mgr.a (mgr.14355) 15507 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:32 smithi131 bash[24745]: audit 2024-09-14T04:19:31.787847+0000 mgr.a (mgr.14355) 15508 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:32 smithi171 bash[25040]: cluster 2024-09-14T04:19:31.126175+0000 mgr.a (mgr.14355) 15507 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:32 smithi171 bash[25040]: audit 2024-09-14T04:19:31.787847+0000 mgr.a (mgr.14355) 15508 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:32 smithi007 bash[22722]: cluster 2024-09-14T04:19:31.126175+0000 mgr.a (mgr.14355) 15507 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:32 smithi007 bash[22722]: audit 2024-09-14T04:19:31.787847+0000 mgr.a (mgr.14355) 15508 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:34 smithi131 bash[24745]: cluster 2024-09-14T04:19:33.127237+0000 mgr.a (mgr.14355) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:34 smithi171 bash[25040]: cluster 2024-09-14T04:19:33.127237+0000 mgr.a (mgr.14355) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:34 smithi007 bash[22722]: cluster 2024-09-14T04:19:33.127237+0000 mgr.a (mgr.14355) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:37.204 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:36 smithi131 bash[24745]: cluster 2024-09-14T04:19:35.128060+0000 mgr.a (mgr.14355) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:36 smithi171 bash[25040]: cluster 2024-09-14T04:19:35.128060+0000 mgr.a (mgr.14355) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:36 smithi007 bash[22722]: cluster 2024-09-14T04:19:35.128060+0000 mgr.a (mgr.14355) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:37.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:37.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:37.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:37.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:37.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:38 smithi131 bash[24745]: cluster 2024-09-14T04:19:37.130284+0000 mgr.a (mgr.14355) 15511 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:38 smithi131 bash[24745]: audit 2024-09-14T04:19:37.538977+0000 mgr.a (mgr.14355) 15512 : audit [DBG] from='client.335208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:38 smithi171 bash[25040]: cluster 2024-09-14T04:19:37.130284+0000 mgr.a (mgr.14355) 15511 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:38 smithi171 bash[25040]: audit 2024-09-14T04:19:37.538977+0000 mgr.a (mgr.14355) 15512 : audit [DBG] from='client.335208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:38 smithi007 bash[22722]: cluster 2024-09-14T04:19:37.130284+0000 mgr.a (mgr.14355) 15511 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:19:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:38 smithi007 bash[22722]: audit 2024-09-14T04:19:37.538977+0000 mgr.a (mgr.14355) 15512 : audit [DBG] from='client.335208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:39 smithi131 bash[24745]: audit 2024-09-14T04:19:39.301798+0000 mon.a (mon.0) 2904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:19:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:39 smithi171 bash[25040]: audit 2024-09-14T04:19:39.301798+0000 mon.a (mon.0) 2904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:19:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:39 smithi007 bash[22722]: audit 2024-09-14T04:19:39.301798+0000 mon.a (mon.0) 2904 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:19:41.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22972]: debug 2024-09-14T04:19:40.943+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:19:41.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22972]: debug 2024-09-14T04:19:40.943+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:19:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22722]: cluster 2024-09-14T04:19:39.131230+0000 mgr.a (mgr.14355) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22722]: audit 2024-09-14T04:19:40.158256+0000 mon.a (mon.0) 2905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:19:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22722]: audit 2024-09-14T04:19:40.159924+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:19:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22722]: audit 2024-09-14T04:19:40.168621+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:19:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:40 smithi007 bash[22722]: audit 2024-09-14T04:19:40.171342+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:40 smithi131 bash[24745]: cluster 2024-09-14T04:19:39.131230+0000 mgr.a (mgr.14355) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:40 smithi131 bash[24745]: audit 2024-09-14T04:19:40.158256+0000 mon.a (mon.0) 2905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:19:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:40 smithi131 bash[24745]: audit 2024-09-14T04:19:40.159924+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:19:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:40 smithi131 bash[24745]: audit 2024-09-14T04:19:40.168621+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:19:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:40 smithi131 bash[24745]: audit 2024-09-14T04:19:40.171342+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:40 smithi171 bash[25040]: cluster 2024-09-14T04:19:39.131230+0000 mgr.a (mgr.14355) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:19:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:40 smithi171 bash[25040]: audit 2024-09-14T04:19:40.158256+0000 mon.a (mon.0) 2905 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:19:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:40 smithi171 bash[25040]: audit 2024-09-14T04:19:40.159924+0000 mon.a (mon.0) 2906 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:19:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:40 smithi171 bash[25040]: audit 2024-09-14T04:19:40.168621+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:19:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:40 smithi171 bash[25040]: audit 2024-09-14T04:19:40.171342+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:41 smithi131 bash[24745]: audit 2024-09-14T04:19:40.173818+0000 mgr.a (mgr.14355) 15514 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:41 smithi131 bash[24745]: audit 2024-09-14T04:19:40.946478+0000 mgr.a (mgr.14355) 15515 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:19:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:41 smithi131 bash[24745]: cephadm 2024-09-14T04:19:40.947806+0000 mgr.a (mgr.14355) 15516 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:19:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:41 smithi171 bash[25040]: audit 2024-09-14T04:19:40.173818+0000 mgr.a (mgr.14355) 15514 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:41 smithi171 bash[25040]: audit 2024-09-14T04:19:40.946478+0000 mgr.a (mgr.14355) 15515 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:19:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:41 smithi171 bash[25040]: cephadm 2024-09-14T04:19:40.947806+0000 mgr.a (mgr.14355) 15516 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:19:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:41 smithi007 bash[22722]: audit 2024-09-14T04:19:40.173818+0000 mgr.a (mgr.14355) 15514 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:19:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:41 smithi007 bash[22722]: audit 2024-09-14T04:19:40.946478+0000 mgr.a (mgr.14355) 15515 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:19:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:41 smithi007 bash[22722]: cephadm 2024-09-14T04:19:40.947806+0000 mgr.a (mgr.14355) 15516 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:19:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:42.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:42 smithi131 bash[24745]: cluster 2024-09-14T04:19:41.133946+0000 mgr.a (mgr.14355) 15517 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T04:19:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:42 smithi171 bash[25040]: cluster 2024-09-14T04:19:41.133946+0000 mgr.a (mgr.14355) 15517 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T04:19:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:42 smithi007 bash[22722]: cluster 2024-09-14T04:19:41.133946+0000 mgr.a (mgr.14355) 15517 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T04:19:43.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:43.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:44 smithi131 bash[24745]: cluster 2024-09-14T04:19:43.134719+0000 mgr.a (mgr.14355) 15518 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:45.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:44 smithi131 bash[24745]: audit 2024-09-14T04:19:43.304659+0000 mgr.a (mgr.14355) 15519 : audit [DBG] from='client.335388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:44 smithi171 bash[25040]: cluster 2024-09-14T04:19:43.134719+0000 mgr.a (mgr.14355) 15518 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:44 smithi171 bash[25040]: audit 2024-09-14T04:19:43.304659+0000 mgr.a (mgr.14355) 15519 : audit [DBG] from='client.335388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:44 smithi007 bash[22722]: cluster 2024-09-14T04:19:43.134719+0000 mgr.a (mgr.14355) 15518 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:44 smithi007 bash[22722]: audit 2024-09-14T04:19:43.304659+0000 mgr.a (mgr.14355) 15519 : audit [DBG] from='client.335388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:47 smithi131 bash[24745]: cluster 2024-09-14T04:19:45.135658+0000 mgr.a (mgr.14355) 15520 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:47 smithi171 bash[25040]: cluster 2024-09-14T04:19:45.135658+0000 mgr.a (mgr.14355) 15520 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:47 smithi007 bash[22722]: cluster 2024-09-14T04:19:45.135658+0000 mgr.a (mgr.14355) 15520 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:19:48.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:48.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:48.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:49 smithi131 bash[24745]: cluster 2024-09-14T04:19:47.137919+0000 mgr.a (mgr.14355) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:49 smithi171 bash[25040]: cluster 2024-09-14T04:19:47.137919+0000 mgr.a (mgr.14355) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:49 smithi007 bash[22722]: cluster 2024-09-14T04:19:47.137919+0000 mgr.a (mgr.14355) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:49.505 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:49.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:51 smithi131 bash[24745]: audit 2024-09-14T04:19:49.086506+0000 mgr.a (mgr.14355) 15522 : audit [DBG] from='client.335463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:51.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:51 smithi131 bash[24745]: cluster 2024-09-14T04:19:49.138893+0000 mgr.a (mgr.14355) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:51 smithi171 bash[25040]: audit 2024-09-14T04:19:49.086506+0000 mgr.a (mgr.14355) 15522 : audit [DBG] from='client.335463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:51 smithi171 bash[25040]: cluster 2024-09-14T04:19:49.138893+0000 mgr.a (mgr.14355) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:51 smithi007 bash[22722]: audit 2024-09-14T04:19:49.086506+0000 mgr.a (mgr.14355) 15522 : audit [DBG] from='client.335463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:51 smithi007 bash[22722]: cluster 2024-09-14T04:19:49.138893+0000 mgr.a (mgr.14355) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:53 smithi131 bash[24745]: cluster 2024-09-14T04:19:51.141256+0000 mgr.a (mgr.14355) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:53 smithi171 bash[25040]: cluster 2024-09-14T04:19:51.141256+0000 mgr.a (mgr.14355) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:53 smithi007 bash[22722]: cluster 2024-09-14T04:19:51.141256+0000 mgr.a (mgr.14355) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:54.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:19:54.507 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:19:54.507 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:19:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:19:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:19:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:19:55.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:19:55.254 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:19:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:55 smithi131 bash[24745]: cluster 2024-09-14T04:19:53.142039+0000 mgr.a (mgr.14355) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:55 smithi171 bash[25040]: cluster 2024-09-14T04:19:53.142039+0000 mgr.a (mgr.14355) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:55 smithi007 bash[22722]: cluster 2024-09-14T04:19:53.142039+0000 mgr.a (mgr.14355) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:56 smithi131 bash[24745]: audit 2024-09-14T04:19:54.835003+0000 mgr.a (mgr.14355) 15526 : audit [DBG] from='client.335541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:56 smithi171 bash[25040]: audit 2024-09-14T04:19:54.835003+0000 mgr.a (mgr.14355) 15526 : audit [DBG] from='client.335541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:56 smithi007 bash[22722]: audit 2024-09-14T04:19:54.835003+0000 mgr.a (mgr.14355) 15526 : audit [DBG] from='client.335541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:19:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:57 smithi131 bash[24745]: cluster 2024-09-14T04:19:55.142582+0000 mgr.a (mgr.14355) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:57 smithi171 bash[25040]: cluster 2024-09-14T04:19:55.142582+0000 mgr.a (mgr.14355) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:57 smithi007 bash[22722]: cluster 2024-09-14T04:19:55.142582+0000 mgr.a (mgr.14355) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:19:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:19:59 smithi171 bash[25040]: cluster 2024-09-14T04:19:57.145052+0000 mgr.a (mgr.14355) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:19:59 smithi007 bash[22722]: cluster 2024-09-14T04:19:57.145052+0000 mgr.a (mgr.14355) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:19:59.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:19:59 smithi131 bash[24745]: cluster 2024-09-14T04:19:57.145052+0000 mgr.a (mgr.14355) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:00.257 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:00 smithi171 bash[25040]: cluster 2024-09-14T04:20:00.000148+0000 mon.a (mon.0) 2909 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:20:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:00 smithi007 bash[22722]: cluster 2024-09-14T04:20:00.000148+0000 mon.a (mon.0) 2909 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:20:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:00 smithi131 bash[24745]: cluster 2024-09-14T04:20:00.000148+0000 mon.a (mon.0) 2909 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:20:01.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:01 smithi171 bash[25040]: cluster 2024-09-14T04:19:59.145871+0000 mgr.a (mgr.14355) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:01 smithi007 bash[22722]: cluster 2024-09-14T04:19:59.145871+0000 mgr.a (mgr.14355) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:01 smithi131 bash[24745]: cluster 2024-09-14T04:19:59.145871+0000 mgr.a (mgr.14355) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:02 smithi007 bash[22722]: audit 2024-09-14T04:20:00.589756+0000 mgr.a (mgr.14355) 15530 : audit [DBG] from='client.335619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:02 smithi131 bash[24745]: audit 2024-09-14T04:20:00.589756+0000 mgr.a (mgr.14355) 15530 : audit [DBG] from='client.335619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:02 smithi171 bash[25040]: audit 2024-09-14T04:20:00.589756+0000 mgr.a (mgr.14355) 15530 : audit [DBG] from='client.335619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:03 smithi007 bash[22722]: cluster 2024-09-14T04:20:01.148491+0000 mgr.a (mgr.14355) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:03 smithi131 bash[24745]: cluster 2024-09-14T04:20:01.148491+0000 mgr.a (mgr.14355) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:03 smithi171 bash[25040]: cluster 2024-09-14T04:20:01.148491+0000 mgr.a (mgr.14355) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:04 smithi007 bash[22722]: cluster 2024-09-14T04:20:03.149244+0000 mgr.a (mgr.14355) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:04 smithi131 bash[24745]: cluster 2024-09-14T04:20:03.149244+0000 mgr.a (mgr.14355) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:04.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:04 smithi171 bash[25040]: cluster 2024-09-14T04:20:03.149244+0000 mgr.a (mgr.14355) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:06.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:06.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:06.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:06 smithi131 bash[24745]: cluster 2024-09-14T04:20:05.149985+0000 mgr.a (mgr.14355) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:06 smithi171 bash[25040]: cluster 2024-09-14T04:20:05.149985+0000 mgr.a (mgr.14355) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:06 smithi007 bash[22722]: cluster 2024-09-14T04:20:05.149985+0000 mgr.a (mgr.14355) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:06.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:06.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:07.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:07 smithi131 bash[24745]: audit 2024-09-14T04:20:06.354243+0000 mgr.a (mgr.14355) 15534 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:07 smithi171 bash[25040]: audit 2024-09-14T04:20:06.354243+0000 mgr.a (mgr.14355) 15534 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:07 smithi007 bash[22722]: audit 2024-09-14T04:20:06.354243+0000 mgr.a (mgr.14355) 15534 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:08 smithi131 bash[24745]: cluster 2024-09-14T04:20:07.152747+0000 mgr.a (mgr.14355) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:08.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:08 smithi171 bash[25040]: cluster 2024-09-14T04:20:07.152747+0000 mgr.a (mgr.14355) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:08 smithi007 bash[22722]: cluster 2024-09-14T04:20:07.152747+0000 mgr.a (mgr.14355) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:10 smithi131 bash[24745]: cluster 2024-09-14T04:20:09.153517+0000 mgr.a (mgr.14355) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:10 smithi171 bash[25040]: cluster 2024-09-14T04:20:09.153517+0000 mgr.a (mgr.14355) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:10 smithi007 bash[22722]: cluster 2024-09-14T04:20:09.153517+0000 mgr.a (mgr.14355) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:12.529 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:12.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:12.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:12 smithi131 bash[24745]: cluster 2024-09-14T04:20:11.155503+0000 mgr.a (mgr.14355) 15537 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:12 smithi171 bash[25040]: cluster 2024-09-14T04:20:11.155503+0000 mgr.a (mgr.14355) 15537 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:12 smithi007 bash[22722]: cluster 2024-09-14T04:20:11.155503+0000 mgr.a (mgr.14355) 15537 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:13 smithi131 bash[24745]: audit 2024-09-14T04:20:12.115833+0000 mgr.a (mgr.14355) 15538 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:13 smithi171 bash[25040]: audit 2024-09-14T04:20:12.115833+0000 mgr.a (mgr.14355) 15538 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:13 smithi007 bash[22722]: audit 2024-09-14T04:20:12.115833+0000 mgr.a (mgr.14355) 15538 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:14 smithi131 bash[24745]: cluster 2024-09-14T04:20:13.156405+0000 mgr.a (mgr.14355) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:14.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:14 smithi171 bash[25040]: cluster 2024-09-14T04:20:13.156405+0000 mgr.a (mgr.14355) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:14 smithi007 bash[22722]: cluster 2024-09-14T04:20:13.156405+0000 mgr.a (mgr.14355) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:16 smithi131 bash[24745]: cluster 2024-09-14T04:20:15.157190+0000 mgr.a (mgr.14355) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:16.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:16 smithi171 bash[25040]: cluster 2024-09-14T04:20:15.157190+0000 mgr.a (mgr.14355) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:16 smithi007 bash[22722]: cluster 2024-09-14T04:20:15.157190+0000 mgr.a (mgr.14355) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:17.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:18.281 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:18.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:18.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:18.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:18 smithi131 bash[24745]: cluster 2024-09-14T04:20:17.159445+0000 mgr.a (mgr.14355) 15541 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:18.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:18 smithi131 bash[24745]: audit 2024-09-14T04:20:17.857923+0000 mgr.a (mgr.14355) 15542 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:18 smithi171 bash[25040]: cluster 2024-09-14T04:20:17.159445+0000 mgr.a (mgr.14355) 15541 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:18 smithi171 bash[25040]: audit 2024-09-14T04:20:17.857923+0000 mgr.a (mgr.14355) 15542 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:18 smithi007 bash[22722]: cluster 2024-09-14T04:20:17.159445+0000 mgr.a (mgr.14355) 15541 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:18 smithi007 bash[22722]: audit 2024-09-14T04:20:17.857923+0000 mgr.a (mgr.14355) 15542 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:20 smithi131 bash[24745]: cluster 2024-09-14T04:20:19.160406+0000 mgr.a (mgr.14355) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:20.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:20 smithi171 bash[25040]: cluster 2024-09-14T04:20:19.160406+0000 mgr.a (mgr.14355) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:20 smithi007 bash[22722]: cluster 2024-09-14T04:20:19.160406+0000 mgr.a (mgr.14355) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:22 smithi131 bash[24745]: cluster 2024-09-14T04:20:21.162668+0000 mgr.a (mgr.14355) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:22 smithi171 bash[25040]: cluster 2024-09-14T04:20:21.162668+0000 mgr.a (mgr.14355) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:22 smithi007 bash[22722]: cluster 2024-09-14T04:20:21.162668+0000 mgr.a (mgr.14355) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:23.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:23.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:23.283 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:24.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:24.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:24 smithi131 bash[24745]: cluster 2024-09-14T04:20:23.163464+0000 mgr.a (mgr.14355) 15545 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:24.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:24 smithi131 bash[24745]: audit 2024-09-14T04:20:23.614979+0000 mgr.a (mgr.14355) 15546 : audit [DBG] from='client.335925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:24 smithi171 bash[25040]: cluster 2024-09-14T04:20:23.163464+0000 mgr.a (mgr.14355) 15545 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:24.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:24 smithi171 bash[25040]: audit 2024-09-14T04:20:23.614979+0000 mgr.a (mgr.14355) 15546 : audit [DBG] from='client.335925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:24 smithi007 bash[22722]: cluster 2024-09-14T04:20:23.163464+0000 mgr.a (mgr.14355) 15545 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:24 smithi007 bash[22722]: audit 2024-09-14T04:20:23.614979+0000 mgr.a (mgr.14355) 15546 : audit [DBG] from='client.335925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:26 smithi131 bash[24745]: cluster 2024-09-14T04:20:25.164464+0000 mgr.a (mgr.14355) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:26 smithi171 bash[25040]: cluster 2024-09-14T04:20:25.164464+0000 mgr.a (mgr.14355) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:26 smithi007 bash[22722]: cluster 2024-09-14T04:20:25.164464+0000 mgr.a (mgr.14355) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:28 smithi131 bash[24745]: cluster 2024-09-14T04:20:27.166765+0000 mgr.a (mgr.14355) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:28 smithi171 bash[25040]: cluster 2024-09-14T04:20:27.166765+0000 mgr.a (mgr.14355) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:28.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:28 smithi007 bash[22722]: cluster 2024-09-14T04:20:27.166765+0000 mgr.a (mgr.14355) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:29.031 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:29.032 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:29.810 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:29.811 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:30 smithi131 bash[24745]: cluster 2024-09-14T04:20:29.167372+0000 mgr.a (mgr.14355) 15549 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:30 smithi131 bash[24745]: audit 2024-09-14T04:20:29.364926+0000 mgr.a (mgr.14355) 15550 : audit [DBG] from='client.335997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:30 smithi171 bash[25040]: cluster 2024-09-14T04:20:29.167372+0000 mgr.a (mgr.14355) 15549 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:30 smithi171 bash[25040]: audit 2024-09-14T04:20:29.364926+0000 mgr.a (mgr.14355) 15550 : audit [DBG] from='client.335997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:30.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:30 smithi007 bash[22722]: cluster 2024-09-14T04:20:29.167372+0000 mgr.a (mgr.14355) 15549 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:30.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:30 smithi007 bash[22722]: audit 2024-09-14T04:20:29.364926+0000 mgr.a (mgr.14355) 15550 : audit [DBG] from='client.335997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:32 smithi131 bash[24745]: cluster 2024-09-14T04:20:31.169751+0000 mgr.a (mgr.14355) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:32 smithi171 bash[25040]: cluster 2024-09-14T04:20:31.169751+0000 mgr.a (mgr.14355) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:32.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:32 smithi007 bash[22722]: cluster 2024-09-14T04:20:31.169751+0000 mgr.a (mgr.14355) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:20:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:34 smithi131 bash[24745]: cluster 2024-09-14T04:20:33.170596+0000 mgr.a (mgr.14355) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:34 smithi171 bash[25040]: cluster 2024-09-14T04:20:33.170596+0000 mgr.a (mgr.14355) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:34 smithi007 bash[22722]: cluster 2024-09-14T04:20:33.170596+0000 mgr.a (mgr.14355) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:35.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:35.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:36 smithi171 bash[25040]: audit 2024-09-14T04:20:35.146593+0000 mgr.a (mgr.14355) 15553 : audit [DBG] from='client.336075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:36 smithi171 bash[25040]: cluster 2024-09-14T04:20:35.171702+0000 mgr.a (mgr.14355) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:36.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:36 smithi007 bash[22722]: audit 2024-09-14T04:20:35.146593+0000 mgr.a (mgr.14355) 15553 : audit [DBG] from='client.336075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:36.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:36 smithi007 bash[22722]: cluster 2024-09-14T04:20:35.171702+0000 mgr.a (mgr.14355) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:36 smithi131 bash[24745]: audit 2024-09-14T04:20:35.146593+0000 mgr.a (mgr.14355) 15553 : audit [DBG] from='client.336075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:36 smithi131 bash[24745]: cluster 2024-09-14T04:20:35.171702+0000 mgr.a (mgr.14355) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:38 smithi171 bash[25040]: cluster 2024-09-14T04:20:37.174602+0000 mgr.a (mgr.14355) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:20:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:38 smithi007 bash[22722]: cluster 2024-09-14T04:20:37.174602+0000 mgr.a (mgr.14355) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:20:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:38 smithi131 bash[24745]: cluster 2024-09-14T04:20:37.174602+0000 mgr.a (mgr.14355) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:20:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:40 smithi171 bash[25040]: cluster 2024-09-14T04:20:39.175405+0000 mgr.a (mgr.14355) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:20:40.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:40.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:40 smithi007 bash[22722]: cluster 2024-09-14T04:20:39.175405+0000 mgr.a (mgr.14355) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:20:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:40 smithi131 bash[24745]: cluster 2024-09-14T04:20:39.175405+0000 mgr.a (mgr.14355) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:20:41.347 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:41.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:41.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:41 smithi007 bash[22722]: audit 2024-09-14T04:20:40.908980+0000 mgr.a (mgr.14355) 15557 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:41.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:41 smithi007 bash[22722]: audit 2024-09-14T04:20:40.998036+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:20:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:41 smithi131 bash[24745]: audit 2024-09-14T04:20:40.908980+0000 mgr.a (mgr.14355) 15557 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:41.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:41 smithi131 bash[24745]: audit 2024-09-14T04:20:40.998036+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:20:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:41 smithi171 bash[25040]: audit 2024-09-14T04:20:40.908980+0000 mgr.a (mgr.14355) 15557 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:41 smithi171 bash[25040]: audit 2024-09-14T04:20:40.998036+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:20:42.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: cluster 2024-09-14T04:20:41.176723+0000 mgr.a (mgr.14355) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:42.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: audit 2024-09-14T04:20:41.793552+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:20:42.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: audit 2024-09-14T04:20:41.795483+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:20:42.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: audit 2024-09-14T04:20:41.805838+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:20:42.559 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: audit 2024-09-14T04:20:41.810654+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.559 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22722]: audit 2024-09-14T04:20:41.813098+0000 mgr.a (mgr.14355) 15559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: cluster 2024-09-14T04:20:41.176723+0000 mgr.a (mgr.14355) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: audit 2024-09-14T04:20:41.793552+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: audit 2024-09-14T04:20:41.795483+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: audit 2024-09-14T04:20:41.805838+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: audit 2024-09-14T04:20:41.810654+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:42 smithi131 bash[24745]: audit 2024-09-14T04:20:41.813098+0000 mgr.a (mgr.14355) 15559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: cluster 2024-09-14T04:20:41.176723+0000 mgr.a (mgr.14355) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: audit 2024-09-14T04:20:41.793552+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: audit 2024-09-14T04:20:41.795483+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: audit 2024-09-14T04:20:41.805838+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: audit 2024-09-14T04:20:41.810654+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:42 smithi171 bash[25040]: audit 2024-09-14T04:20:41.813098+0000 mgr.a (mgr.14355) 15559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:20:42.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22972]: debug 2024-09-14T04:20:42.550+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:20:42.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:20:42 smithi007 bash[22972]: debug 2024-09-14T04:20:42.554+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:20:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:43 smithi007 bash[22722]: audit 2024-09-14T04:20:42.557233+0000 mgr.a (mgr.14355) 15560 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:20:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:43 smithi007 bash[22722]: cephadm 2024-09-14T04:20:42.558655+0000 mgr.a (mgr.14355) 15561 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:20:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:43 smithi131 bash[24745]: audit 2024-09-14T04:20:42.557233+0000 mgr.a (mgr.14355) 15560 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:20:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:43 smithi131 bash[24745]: cephadm 2024-09-14T04:20:42.558655+0000 mgr.a (mgr.14355) 15561 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:20:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:43 smithi171 bash[25040]: audit 2024-09-14T04:20:42.557233+0000 mgr.a (mgr.14355) 15560 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:20:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:43 smithi171 bash[25040]: cephadm 2024-09-14T04:20:42.558655+0000 mgr.a (mgr.14355) 15561 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:20:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:44 smithi007 bash[22722]: cluster 2024-09-14T04:20:43.177630+0000 mgr.a (mgr.14355) 15562 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:44 smithi131 bash[24745]: cluster 2024-09-14T04:20:43.177630+0000 mgr.a (mgr.14355) 15562 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:44 smithi171 bash[25040]: cluster 2024-09-14T04:20:43.177630+0000 mgr.a (mgr.14355) 15562 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:20:46.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:46.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:46.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:46 smithi007 bash[22722]: cluster 2024-09-14T04:20:45.178450+0000 mgr.a (mgr.14355) 15563 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:46 smithi131 bash[24745]: cluster 2024-09-14T04:20:45.178450+0000 mgr.a (mgr.14355) 15563 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:46 smithi171 bash[25040]: cluster 2024-09-14T04:20:45.178450+0000 mgr.a (mgr.14355) 15563 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:20:47.119 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:47 smithi007 bash[22722]: audit 2024-09-14T04:20:46.679493+0000 mgr.a (mgr.14355) 15564 : audit [DBG] from='client.336333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:47 smithi131 bash[24745]: audit 2024-09-14T04:20:46.679493+0000 mgr.a (mgr.14355) 15564 : audit [DBG] from='client.336333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:47 smithi171 bash[25040]: audit 2024-09-14T04:20:46.679493+0000 mgr.a (mgr.14355) 15564 : audit [DBG] from='client.336333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:48 smithi007 bash[22722]: cluster 2024-09-14T04:20:47.181209+0000 mgr.a (mgr.14355) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:48 smithi131 bash[24745]: cluster 2024-09-14T04:20:47.181209+0000 mgr.a (mgr.14355) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:48 smithi171 bash[25040]: cluster 2024-09-14T04:20:47.181209+0000 mgr.a (mgr.14355) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:50 smithi007 bash[22722]: cluster 2024-09-14T04:20:49.182027+0000 mgr.a (mgr.14355) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:20:50.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:50 smithi131 bash[24745]: cluster 2024-09-14T04:20:49.182027+0000 mgr.a (mgr.14355) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:20:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:50 smithi171 bash[25040]: cluster 2024-09-14T04:20:49.182027+0000 mgr.a (mgr.14355) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:20:52.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:52.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:52.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:52 smithi007 bash[22722]: cluster 2024-09-14T04:20:51.184043+0000 mgr.a (mgr.14355) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:52 smithi131 bash[24745]: cluster 2024-09-14T04:20:51.184043+0000 mgr.a (mgr.14355) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:52 smithi171 bash[25040]: cluster 2024-09-14T04:20:51.184043+0000 mgr.a (mgr.14355) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:52.877 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:53 smithi007 bash[22722]: audit 2024-09-14T04:20:52.454515+0000 mgr.a (mgr.14355) 15568 : audit [DBG] from='client.336408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:53 smithi131 bash[24745]: audit 2024-09-14T04:20:52.454515+0000 mgr.a (mgr.14355) 15568 : audit [DBG] from='client.336408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:53 smithi171 bash[25040]: audit 2024-09-14T04:20:52.454515+0000 mgr.a (mgr.14355) 15568 : audit [DBG] from='client.336408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:54 smithi007 bash[22722]: cluster 2024-09-14T04:20:53.185043+0000 mgr.a (mgr.14355) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:54 smithi131 bash[24745]: cluster 2024-09-14T04:20:53.185043+0000 mgr.a (mgr.14355) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:54 smithi171 bash[25040]: cluster 2024-09-14T04:20:53.185043+0000 mgr.a (mgr.14355) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:56 smithi007 bash[22722]: cluster 2024-09-14T04:20:55.185975+0000 mgr.a (mgr.14355) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:56 smithi131 bash[24745]: cluster 2024-09-14T04:20:55.185975+0000 mgr.a (mgr.14355) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:56 smithi171 bash[25040]: cluster 2024-09-14T04:20:55.185975+0000 mgr.a (mgr.14355) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:20:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:20:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:20:58.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:20:58.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:20:58.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:20:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:20:58.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:20:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:58 smithi007 bash[22722]: cluster 2024-09-14T04:20:57.188413+0000 mgr.a (mgr.14355) 15571 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:58 smithi131 bash[24745]: cluster 2024-09-14T04:20:57.188413+0000 mgr.a (mgr.14355) 15571 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:58 smithi171 bash[25040]: cluster 2024-09-14T04:20:57.188413+0000 mgr.a (mgr.14355) 15571 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:20:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:20:59 smithi007 bash[22722]: audit 2024-09-14T04:20:58.210003+0000 mgr.a (mgr.14355) 15572 : audit [DBG] from='client.336480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:20:59 smithi131 bash[24745]: audit 2024-09-14T04:20:58.210003+0000 mgr.a (mgr.14355) 15572 : audit [DBG] from='client.336480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:20:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:20:59 smithi171 bash[25040]: audit 2024-09-14T04:20:58.210003+0000 mgr.a (mgr.14355) 15572 : audit [DBG] from='client.336480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:00 smithi007 bash[22722]: cluster 2024-09-14T04:20:59.189413+0000 mgr.a (mgr.14355) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:00 smithi131 bash[24745]: cluster 2024-09-14T04:20:59.189413+0000 mgr.a (mgr.14355) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:00 smithi171 bash[25040]: cluster 2024-09-14T04:20:59.189413+0000 mgr.a (mgr.14355) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:02 smithi007 bash[22722]: cluster 2024-09-14T04:21:01.191658+0000 mgr.a (mgr.14355) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:02 smithi131 bash[24745]: cluster 2024-09-14T04:21:01.191658+0000 mgr.a (mgr.14355) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:02 smithi171 bash[25040]: cluster 2024-09-14T04:21:01.191658+0000 mgr.a (mgr.14355) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:03.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:03.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:03.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:04.419 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:04 smithi007 bash[22722]: cluster 2024-09-14T04:21:03.192415+0000 mgr.a (mgr.14355) 15575 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:04 smithi007 bash[22722]: audit 2024-09-14T04:21:03.964383+0000 mgr.a (mgr.14355) 15576 : audit [DBG] from='client.336558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:04 smithi131 bash[24745]: cluster 2024-09-14T04:21:03.192415+0000 mgr.a (mgr.14355) 15575 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:04 smithi131 bash[24745]: audit 2024-09-14T04:21:03.964383+0000 mgr.a (mgr.14355) 15576 : audit [DBG] from='client.336558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:04 smithi171 bash[25040]: cluster 2024-09-14T04:21:03.192415+0000 mgr.a (mgr.14355) 15575 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:04 smithi171 bash[25040]: audit 2024-09-14T04:21:03.964383+0000 mgr.a (mgr.14355) 15576 : audit [DBG] from='client.336558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:06 smithi007 bash[22722]: cluster 2024-09-14T04:21:05.193549+0000 mgr.a (mgr.14355) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:06 smithi131 bash[24745]: cluster 2024-09-14T04:21:05.193549+0000 mgr.a (mgr.14355) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:06 smithi171 bash[25040]: cluster 2024-09-14T04:21:05.193549+0000 mgr.a (mgr.14355) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:08 smithi007 bash[22722]: cluster 2024-09-14T04:21:07.195998+0000 mgr.a (mgr.14355) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:08 smithi131 bash[24745]: cluster 2024-09-14T04:21:07.195998+0000 mgr.a (mgr.14355) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:08 smithi171 bash[25040]: cluster 2024-09-14T04:21:07.195998+0000 mgr.a (mgr.14355) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:09.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:10.172 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:10.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:10 smithi007 bash[22722]: cluster 2024-09-14T04:21:09.196761+0000 mgr.a (mgr.14355) 15579 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:10 smithi007 bash[22722]: audit 2024-09-14T04:21:09.748754+0000 mgr.a (mgr.14355) 15580 : audit [DBG] from='client.336633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:10 smithi131 bash[24745]: cluster 2024-09-14T04:21:09.196761+0000 mgr.a (mgr.14355) 15579 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:10.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:10 smithi131 bash[24745]: audit 2024-09-14T04:21:09.748754+0000 mgr.a (mgr.14355) 15580 : audit [DBG] from='client.336633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:10 smithi171 bash[25040]: cluster 2024-09-14T04:21:09.196761+0000 mgr.a (mgr.14355) 15579 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:10.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:10 smithi171 bash[25040]: audit 2024-09-14T04:21:09.748754+0000 mgr.a (mgr.14355) 15580 : audit [DBG] from='client.336633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:12 smithi007 bash[22722]: cluster 2024-09-14T04:21:11.199230+0000 mgr.a (mgr.14355) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:12.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:12 smithi131 bash[24745]: cluster 2024-09-14T04:21:11.199230+0000 mgr.a (mgr.14355) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:12.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:12 smithi171 bash[25040]: cluster 2024-09-14T04:21:11.199230+0000 mgr.a (mgr.14355) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:14 smithi007 bash[22722]: cluster 2024-09-14T04:21:13.200022+0000 mgr.a (mgr.14355) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:14 smithi131 bash[24745]: cluster 2024-09-14T04:21:13.200022+0000 mgr.a (mgr.14355) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:14 smithi171 bash[25040]: cluster 2024-09-14T04:21:13.200022+0000 mgr.a (mgr.14355) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:15.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:15.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:15.932 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:16 smithi007 bash[22722]: cluster 2024-09-14T04:21:15.200586+0000 mgr.a (mgr.14355) 15583 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:16 smithi007 bash[22722]: audit 2024-09-14T04:21:15.507480+0000 mgr.a (mgr.14355) 15584 : audit [DBG] from='client.336708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:16 smithi131 bash[24745]: cluster 2024-09-14T04:21:15.200586+0000 mgr.a (mgr.14355) 15583 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:16.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:16 smithi131 bash[24745]: audit 2024-09-14T04:21:15.507480+0000 mgr.a (mgr.14355) 15584 : audit [DBG] from='client.336708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:16 smithi171 bash[25040]: cluster 2024-09-14T04:21:15.200586+0000 mgr.a (mgr.14355) 15583 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:16 smithi171 bash[25040]: audit 2024-09-14T04:21:15.507480+0000 mgr.a (mgr.14355) 15584 : audit [DBG] from='client.336708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:18 smithi007 bash[22722]: cluster 2024-09-14T04:21:17.203430+0000 mgr.a (mgr.14355) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:18 smithi131 bash[24745]: cluster 2024-09-14T04:21:17.203430+0000 mgr.a (mgr.14355) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:18 smithi171 bash[25040]: cluster 2024-09-14T04:21:17.203430+0000 mgr.a (mgr.14355) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:20 smithi007 bash[22722]: cluster 2024-09-14T04:21:19.204244+0000 mgr.a (mgr.14355) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:20 smithi131 bash[24745]: cluster 2024-09-14T04:21:19.204244+0000 mgr.a (mgr.14355) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:20 smithi171 bash[25040]: cluster 2024-09-14T04:21:19.204244+0000 mgr.a (mgr.14355) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:20.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:20.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:21.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:21.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:21.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:21.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:22.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:22 smithi007 bash[22722]: cluster 2024-09-14T04:21:21.206201+0000 mgr.a (mgr.14355) 15587 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:22.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:22 smithi007 bash[22722]: audit 2024-09-14T04:21:21.265904+0000 mgr.a (mgr.14355) 15588 : audit [DBG] from='client.336786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:22.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:22 smithi131 bash[24745]: cluster 2024-09-14T04:21:21.206201+0000 mgr.a (mgr.14355) 15587 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:22.798 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:22 smithi131 bash[24745]: audit 2024-09-14T04:21:21.265904+0000 mgr.a (mgr.14355) 15588 : audit [DBG] from='client.336786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:22.800 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:22 smithi171 bash[25040]: cluster 2024-09-14T04:21:21.206201+0000 mgr.a (mgr.14355) 15587 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:22.801 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:22 smithi171 bash[25040]: audit 2024-09-14T04:21:21.265904+0000 mgr.a (mgr.14355) 15588 : audit [DBG] from='client.336786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:24 smithi007 bash[22722]: cluster 2024-09-14T04:21:23.207103+0000 mgr.a (mgr.14355) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:24 smithi131 bash[24745]: cluster 2024-09-14T04:21:23.207103+0000 mgr.a (mgr.14355) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:24 smithi171 bash[25040]: cluster 2024-09-14T04:21:23.207103+0000 mgr.a (mgr.14355) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:21:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:26.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:26.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:26 smithi007 bash[22722]: cluster 2024-09-14T04:21:25.207881+0000 mgr.a (mgr.14355) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:21:26.786 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:26 smithi131 bash[24745]: cluster 2024-09-14T04:21:25.207881+0000 mgr.a (mgr.14355) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:21:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:26 smithi171 bash[25040]: cluster 2024-09-14T04:21:25.207881+0000 mgr.a (mgr.14355) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:21:27.463 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:27 smithi007 bash[22722]: audit 2024-09-14T04:21:27.021895+0000 mgr.a (mgr.14355) 15591 : audit [DBG] from='client.336864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:27 smithi131 bash[24745]: audit 2024-09-14T04:21:27.021895+0000 mgr.a (mgr.14355) 15591 : audit [DBG] from='client.336864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:27.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:27 smithi171 bash[25040]: audit 2024-09-14T04:21:27.021895+0000 mgr.a (mgr.14355) 15591 : audit [DBG] from='client.336864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:28.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:28 smithi007 bash[22722]: cluster 2024-09-14T04:21:27.209310+0000 mgr.a (mgr.14355) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:28 smithi131 bash[24745]: cluster 2024-09-14T04:21:27.209310+0000 mgr.a (mgr.14355) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:28 smithi171 bash[25040]: cluster 2024-09-14T04:21:27.209310+0000 mgr.a (mgr.14355) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:30 smithi007 bash[22722]: cluster 2024-09-14T04:21:29.210214+0000 mgr.a (mgr.14355) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:30 smithi131 bash[24745]: cluster 2024-09-14T04:21:29.210214+0000 mgr.a (mgr.14355) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:30 smithi171 bash[25040]: cluster 2024-09-14T04:21:29.210214+0000 mgr.a (mgr.14355) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:32.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:32.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:32.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:32 smithi007 bash[22722]: cluster 2024-09-14T04:21:31.212514+0000 mgr.a (mgr.14355) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:32 smithi131 bash[24745]: cluster 2024-09-14T04:21:31.212514+0000 mgr.a (mgr.14355) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:32 smithi171 bash[25040]: cluster 2024-09-14T04:21:31.212514+0000 mgr.a (mgr.14355) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:33.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:33.241 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:33 smithi007 bash[22722]: audit 2024-09-14T04:21:32.801707+0000 mgr.a (mgr.14355) 15595 : audit [DBG] from='client.336942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:33 smithi131 bash[24745]: audit 2024-09-14T04:21:32.801707+0000 mgr.a (mgr.14355) 15595 : audit [DBG] from='client.336942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:33.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:33 smithi171 bash[25040]: audit 2024-09-14T04:21:32.801707+0000 mgr.a (mgr.14355) 15595 : audit [DBG] from='client.336942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:34 smithi007 bash[22722]: cluster 2024-09-14T04:21:33.213217+0000 mgr.a (mgr.14355) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:34 smithi131 bash[24745]: cluster 2024-09-14T04:21:33.213217+0000 mgr.a (mgr.14355) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:34 smithi171 bash[25040]: cluster 2024-09-14T04:21:33.213217+0000 mgr.a (mgr.14355) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:36.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:36 smithi007 bash[22722]: cluster 2024-09-14T04:21:35.214953+0000 mgr.a (mgr.14355) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:36 smithi131 bash[24745]: cluster 2024-09-14T04:21:35.214953+0000 mgr.a (mgr.14355) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:36 smithi171 bash[25040]: cluster 2024-09-14T04:21:35.214953+0000 mgr.a (mgr.14355) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:38.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:38.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:38 smithi131 bash[24745]: cluster 2024-09-14T04:21:37.216223+0000 mgr.a (mgr.14355) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:38 smithi171 bash[25040]: cluster 2024-09-14T04:21:37.216223+0000 mgr.a (mgr.14355) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:38 smithi007 bash[22722]: cluster 2024-09-14T04:21:37.216223+0000 mgr.a (mgr.14355) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:39.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:39.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:39 smithi131 bash[24745]: audit 2024-09-14T04:21:38.576361+0000 mgr.a (mgr.14355) 15599 : audit [DBG] from='client.337014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:39 smithi171 bash[25040]: audit 2024-09-14T04:21:38.576361+0000 mgr.a (mgr.14355) 15599 : audit [DBG] from='client.337014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:39.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:39 smithi007 bash[22722]: audit 2024-09-14T04:21:38.576361+0000 mgr.a (mgr.14355) 15599 : audit [DBG] from='client.337014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:40 smithi131 bash[24745]: cluster 2024-09-14T04:21:39.217157+0000 mgr.a (mgr.14355) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:40 smithi171 bash[25040]: cluster 2024-09-14T04:21:39.217157+0000 mgr.a (mgr.14355) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:40 smithi007 bash[22722]: cluster 2024-09-14T04:21:39.217157+0000 mgr.a (mgr.14355) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:42 smithi131 bash[24745]: cluster 2024-09-14T04:21:41.219435+0000 mgr.a (mgr.14355) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:42 smithi171 bash[25040]: cluster 2024-09-14T04:21:41.219435+0000 mgr.a (mgr.14355) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:42 smithi007 bash[22722]: cluster 2024-09-14T04:21:41.219435+0000 mgr.a (mgr.14355) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:21:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:43 smithi131 bash[24745]: audit 2024-09-14T04:21:42.615521+0000 mon.a (mon.0) 2915 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:21:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:43 smithi131 bash[24745]: audit 2024-09-14T04:21:43.457959+0000 mon.a (mon.0) 2916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:21:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:43 smithi131 bash[24745]: audit 2024-09-14T04:21:43.459380+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:21:43.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:43 smithi131 bash[24745]: audit 2024-09-14T04:21:43.468500+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:21:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:43 smithi171 bash[25040]: audit 2024-09-14T04:21:42.615521+0000 mon.a (mon.0) 2915 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:21:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:43 smithi171 bash[25040]: audit 2024-09-14T04:21:43.457959+0000 mon.a (mon.0) 2916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:21:43.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:43 smithi171 bash[25040]: audit 2024-09-14T04:21:43.459380+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:21:43.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:43 smithi171 bash[25040]: audit 2024-09-14T04:21:43.468500+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:21:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:43 smithi007 bash[22722]: audit 2024-09-14T04:21:42.615521+0000 mon.a (mon.0) 2915 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:21:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:43 smithi007 bash[22722]: audit 2024-09-14T04:21:43.457959+0000 mon.a (mon.0) 2916 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:21:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:43 smithi007 bash[22722]: audit 2024-09-14T04:21:43.459380+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:21:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:43 smithi007 bash[22722]: audit 2024-09-14T04:21:43.468500+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:21:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:44.027 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:44.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:21:44 smithi007 bash[22972]: debug 2024-09-14T04:21:44.197+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:21:44.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:21:44 smithi007 bash[22972]: debug 2024-09-14T04:21:44.197+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:21:44.749 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:44.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:44 smithi131 bash[24745]: cluster 2024-09-14T04:21:43.220147+0000 mgr.a (mgr.14355) 15602 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:44.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:44 smithi131 bash[24745]: audit 2024-09-14T04:21:43.475945+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:44.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:44 smithi131 bash[24745]: audit 2024-09-14T04:21:43.477477+0000 mgr.a (mgr.14355) 15603 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:44 smithi171 bash[25040]: cluster 2024-09-14T04:21:43.220147+0000 mgr.a (mgr.14355) 15602 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:44 smithi171 bash[25040]: audit 2024-09-14T04:21:43.475945+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:44 smithi171 bash[25040]: audit 2024-09-14T04:21:43.477477+0000 mgr.a (mgr.14355) 15603 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:44 smithi007 bash[22722]: cluster 2024-09-14T04:21:43.220147+0000 mgr.a (mgr.14355) 15602 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:21:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:44 smithi007 bash[22722]: audit 2024-09-14T04:21:43.475945+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:44 smithi007 bash[22722]: audit 2024-09-14T04:21:43.477477+0000 mgr.a (mgr.14355) 15603 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:21:45.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:45 smithi131 bash[24745]: audit 2024-09-14T04:21:44.200191+0000 mgr.a (mgr.14355) 15604 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:21:45.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:45 smithi131 bash[24745]: cephadm 2024-09-14T04:21:44.201430+0000 mgr.a (mgr.14355) 15605 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:21:45.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:45 smithi131 bash[24745]: audit 2024-09-14T04:21:44.339317+0000 mgr.a (mgr.14355) 15606 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:45 smithi171 bash[25040]: audit 2024-09-14T04:21:44.200191+0000 mgr.a (mgr.14355) 15604 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:21:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:45 smithi171 bash[25040]: cephadm 2024-09-14T04:21:44.201430+0000 mgr.a (mgr.14355) 15605 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:21:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:45 smithi171 bash[25040]: audit 2024-09-14T04:21:44.339317+0000 mgr.a (mgr.14355) 15606 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:45 smithi007 bash[22722]: audit 2024-09-14T04:21:44.200191+0000 mgr.a (mgr.14355) 15604 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:21:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:45 smithi007 bash[22722]: cephadm 2024-09-14T04:21:44.201430+0000 mgr.a (mgr.14355) 15605 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:21:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:45 smithi007 bash[22722]: audit 2024-09-14T04:21:44.339317+0000 mgr.a (mgr.14355) 15606 : audit [DBG] from='client.337197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:46 smithi131 bash[24745]: cluster 2024-09-14T04:21:45.222137+0000 mgr.a (mgr.14355) 15607 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:46 smithi171 bash[25040]: cluster 2024-09-14T04:21:45.222137+0000 mgr.a (mgr.14355) 15607 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:46 smithi007 bash[22722]: cluster 2024-09-14T04:21:45.222137+0000 mgr.a (mgr.14355) 15607 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:48.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:48 smithi131 bash[24745]: cluster 2024-09-14T04:21:47.223415+0000 mgr.a (mgr.14355) 15608 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:48 smithi171 bash[25040]: cluster 2024-09-14T04:21:47.223415+0000 mgr.a (mgr.14355) 15608 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:48.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:48 smithi007 bash[22722]: cluster 2024-09-14T04:21:47.223415+0000 mgr.a (mgr.14355) 15608 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:49.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:49.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:49.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:50.498 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:50 smithi131 bash[24745]: cluster 2024-09-14T04:21:49.224199+0000 mgr.a (mgr.14355) 15609 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:50.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:50 smithi171 bash[25040]: cluster 2024-09-14T04:21:49.224199+0000 mgr.a (mgr.14355) 15609 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:50 smithi007 bash[22722]: cluster 2024-09-14T04:21:49.224199+0000 mgr.a (mgr.14355) 15609 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:51 smithi131 bash[24745]: audit 2024-09-14T04:21:50.086469+0000 mgr.a (mgr.14355) 15610 : audit [DBG] from='client.337275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:51.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:51 smithi171 bash[25040]: audit 2024-09-14T04:21:50.086469+0000 mgr.a (mgr.14355) 15610 : audit [DBG] from='client.337275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:51.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:51 smithi007 bash[22722]: audit 2024-09-14T04:21:50.086469+0000 mgr.a (mgr.14355) 15610 : audit [DBG] from='client.337275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:52 smithi131 bash[24745]: cluster 2024-09-14T04:21:51.227068+0000 mgr.a (mgr.14355) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:52 smithi171 bash[25040]: cluster 2024-09-14T04:21:51.227068+0000 mgr.a (mgr.14355) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:52 smithi007 bash[22722]: cluster 2024-09-14T04:21:51.227068+0000 mgr.a (mgr.14355) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:54 smithi131 bash[24745]: cluster 2024-09-14T04:21:53.227844+0000 mgr.a (mgr.14355) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:21:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:54 smithi171 bash[25040]: cluster 2024-09-14T04:21:53.227844+0000 mgr.a (mgr.14355) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:21:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:54 smithi007 bash[22722]: cluster 2024-09-14T04:21:53.227844+0000 mgr.a (mgr.14355) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:21:55.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:21:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:21:55.501 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:21:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:21:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:21:56.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:21:56.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:21:56.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:21:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:56 smithi131 bash[24745]: cluster 2024-09-14T04:21:55.229395+0000 mgr.a (mgr.14355) 15613 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:56 smithi131 bash[24745]: audit 2024-09-14T04:21:55.832962+0000 mgr.a (mgr.14355) 15614 : audit [DBG] from='client.337350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:56 smithi171 bash[25040]: cluster 2024-09-14T04:21:55.229395+0000 mgr.a (mgr.14355) 15613 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:56 smithi171 bash[25040]: audit 2024-09-14T04:21:55.832962+0000 mgr.a (mgr.14355) 15614 : audit [DBG] from='client.337350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:56 smithi007 bash[22722]: cluster 2024-09-14T04:21:55.229395+0000 mgr.a (mgr.14355) 15613 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:21:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:56 smithi007 bash[22722]: audit 2024-09-14T04:21:55.832962+0000 mgr.a (mgr.14355) 15614 : audit [DBG] from='client.337350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:21:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:21:58 smithi131 bash[24745]: cluster 2024-09-14T04:21:57.231176+0000 mgr.a (mgr.14355) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:21:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:21:58 smithi171 bash[25040]: cluster 2024-09-14T04:21:57.231176+0000 mgr.a (mgr.14355) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:21:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:21:58 smithi007 bash[22722]: cluster 2024-09-14T04:21:57.231176+0000 mgr.a (mgr.14355) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:22:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:00 smithi171 bash[25040]: cluster 2024-09-14T04:21:59.231971+0000 mgr.a (mgr.14355) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:00 smithi007 bash[22722]: cluster 2024-09-14T04:21:59.231971+0000 mgr.a (mgr.14355) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:00 smithi131 bash[24745]: cluster 2024-09-14T04:21:59.231971+0000 mgr.a (mgr.14355) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:02.067 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:02.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:02.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:02.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:02.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:02 smithi171 bash[25040]: cluster 2024-09-14T04:22:01.234073+0000 mgr.a (mgr.14355) 15617 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:02 smithi171 bash[25040]: audit 2024-09-14T04:22:01.615911+0000 mgr.a (mgr.14355) 15618 : audit [DBG] from='client.337428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:02 smithi007 bash[22722]: cluster 2024-09-14T04:22:01.234073+0000 mgr.a (mgr.14355) 15617 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:02 smithi007 bash[22722]: audit 2024-09-14T04:22:01.615911+0000 mgr.a (mgr.14355) 15618 : audit [DBG] from='client.337428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:02 smithi131 bash[24745]: cluster 2024-09-14T04:22:01.234073+0000 mgr.a (mgr.14355) 15617 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:02 smithi131 bash[24745]: audit 2024-09-14T04:22:01.615911+0000 mgr.a (mgr.14355) 15618 : audit [DBG] from='client.337428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:04 smithi171 bash[25040]: cluster 2024-09-14T04:22:03.234949+0000 mgr.a (mgr.14355) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:04 smithi007 bash[22722]: cluster 2024-09-14T04:22:03.234949+0000 mgr.a (mgr.14355) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:04 smithi131 bash[24745]: cluster 2024-09-14T04:22:03.234949+0000 mgr.a (mgr.14355) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:06 smithi007 bash[22722]: cluster 2024-09-14T04:22:05.236743+0000 mgr.a (mgr.14355) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:06 smithi131 bash[24745]: cluster 2024-09-14T04:22:05.236743+0000 mgr.a (mgr.14355) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:06 smithi171 bash[25040]: cluster 2024-09-14T04:22:05.236743+0000 mgr.a (mgr.14355) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:07.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:07.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:07.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:08 smithi007 bash[22722]: cluster 2024-09-14T04:22:07.237980+0000 mgr.a (mgr.14355) 15621 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:08 smithi007 bash[22722]: audit 2024-09-14T04:22:07.406683+0000 mgr.a (mgr.14355) 15622 : audit [DBG] from='client.337503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:08 smithi131 bash[24745]: cluster 2024-09-14T04:22:07.237980+0000 mgr.a (mgr.14355) 15621 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:09.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:08 smithi131 bash[24745]: audit 2024-09-14T04:22:07.406683+0000 mgr.a (mgr.14355) 15622 : audit [DBG] from='client.337503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:08 smithi171 bash[25040]: cluster 2024-09-14T04:22:07.237980+0000 mgr.a (mgr.14355) 15621 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:08 smithi171 bash[25040]: audit 2024-09-14T04:22:07.406683+0000 mgr.a (mgr.14355) 15622 : audit [DBG] from='client.337503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:10 smithi007 bash[22722]: cluster 2024-09-14T04:22:09.238941+0000 mgr.a (mgr.14355) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:11.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:10 smithi131 bash[24745]: cluster 2024-09-14T04:22:09.238941+0000 mgr.a (mgr.14355) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:11.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:10 smithi171 bash[25040]: cluster 2024-09-14T04:22:09.238941+0000 mgr.a (mgr.14355) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T04:22:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:12 smithi007 bash[22722]: cluster 2024-09-14T04:22:11.241171+0000 mgr.a (mgr.14355) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:12 smithi131 bash[24745]: cluster 2024-09-14T04:22:11.241171+0000 mgr.a (mgr.14355) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:12 smithi171 bash[25040]: cluster 2024-09-14T04:22:11.241171+0000 mgr.a (mgr.14355) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T04:22:13.616 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:13.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:13.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:13.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:13.616 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:14 smithi007 bash[22722]: audit 2024-09-14T04:22:13.175514+0000 mgr.a (mgr.14355) 15625 : audit [DBG] from='client.337581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:14 smithi007 bash[22722]: cluster 2024-09-14T04:22:13.241733+0000 mgr.a (mgr.14355) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:14 smithi131 bash[24745]: audit 2024-09-14T04:22:13.175514+0000 mgr.a (mgr.14355) 15625 : audit [DBG] from='client.337581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:14 smithi131 bash[24745]: cluster 2024-09-14T04:22:13.241733+0000 mgr.a (mgr.14355) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:14 smithi171 bash[25040]: audit 2024-09-14T04:22:13.175514+0000 mgr.a (mgr.14355) 15625 : audit [DBG] from='client.337581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:14 smithi171 bash[25040]: cluster 2024-09-14T04:22:13.241733+0000 mgr.a (mgr.14355) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:16 smithi007 bash[22722]: cluster 2024-09-14T04:22:15.243605+0000 mgr.a (mgr.14355) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:16 smithi131 bash[24745]: cluster 2024-09-14T04:22:15.243605+0000 mgr.a (mgr.14355) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:16 smithi171 bash[25040]: cluster 2024-09-14T04:22:15.243605+0000 mgr.a (mgr.14355) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:18.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:18.618 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:18 smithi007 bash[22722]: cluster 2024-09-14T04:22:17.244919+0000 mgr.a (mgr.14355) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:18 smithi131 bash[24745]: cluster 2024-09-14T04:22:17.244919+0000 mgr.a (mgr.14355) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:18 smithi171 bash[25040]: cluster 2024-09-14T04:22:17.244919+0000 mgr.a (mgr.14355) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:19.380 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:19.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:19.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:19 smithi007 bash[22722]: audit 2024-09-14T04:22:18.950274+0000 mgr.a (mgr.14355) 15629 : audit [DBG] from='client.337656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:19 smithi131 bash[24745]: audit 2024-09-14T04:22:18.950274+0000 mgr.a (mgr.14355) 15629 : audit [DBG] from='client.337656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:19 smithi171 bash[25040]: audit 2024-09-14T04:22:18.950274+0000 mgr.a (mgr.14355) 15629 : audit [DBG] from='client.337656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:20 smithi007 bash[22722]: cluster 2024-09-14T04:22:19.245485+0000 mgr.a (mgr.14355) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:20 smithi131 bash[24745]: cluster 2024-09-14T04:22:19.245485+0000 mgr.a (mgr.14355) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:20 smithi171 bash[25040]: cluster 2024-09-14T04:22:19.245485+0000 mgr.a (mgr.14355) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:22.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:22 smithi007 bash[22722]: cluster 2024-09-14T04:22:21.247895+0000 mgr.a (mgr.14355) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:22 smithi131 bash[24745]: cluster 2024-09-14T04:22:21.247895+0000 mgr.a (mgr.14355) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:22 smithi171 bash[25040]: cluster 2024-09-14T04:22:21.247895+0000 mgr.a (mgr.14355) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:24.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:24.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:24.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:24.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:24 smithi007 bash[22722]: cluster 2024-09-14T04:22:23.248822+0000 mgr.a (mgr.14355) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:24 smithi131 bash[24745]: cluster 2024-09-14T04:22:23.248822+0000 mgr.a (mgr.14355) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:25.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:24 smithi171 bash[25040]: cluster 2024-09-14T04:22:23.248822+0000 mgr.a (mgr.14355) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:25.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:25.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:25.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:25.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:25.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:25 smithi007 bash[22722]: audit 2024-09-14T04:22:24.717023+0000 mgr.a (mgr.14355) 15633 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:25 smithi131 bash[24745]: audit 2024-09-14T04:22:24.717023+0000 mgr.a (mgr.14355) 15633 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:25 smithi171 bash[25040]: audit 2024-09-14T04:22:24.717023+0000 mgr.a (mgr.14355) 15633 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:26 smithi007 bash[22722]: cluster 2024-09-14T04:22:25.250013+0000 mgr.a (mgr.14355) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T04:22:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:26 smithi131 bash[24745]: cluster 2024-09-14T04:22:25.250013+0000 mgr.a (mgr.14355) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T04:22:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:26 smithi171 bash[25040]: cluster 2024-09-14T04:22:25.250013+0000 mgr.a (mgr.14355) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-14T04:22:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:28 smithi007 bash[22722]: cluster 2024-09-14T04:22:27.251315+0000 mgr.a (mgr.14355) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:28 smithi131 bash[24745]: cluster 2024-09-14T04:22:27.251315+0000 mgr.a (mgr.14355) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:28 smithi171 bash[25040]: cluster 2024-09-14T04:22:27.251315+0000 mgr.a (mgr.14355) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:30.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:30.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:30.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:30.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:30.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:30.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:30.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:30 smithi007 bash[22722]: cluster 2024-09-14T04:22:29.252087+0000 mgr.a (mgr.14355) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:30 smithi131 bash[24745]: cluster 2024-09-14T04:22:29.252087+0000 mgr.a (mgr.14355) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:30 smithi171 bash[25040]: cluster 2024-09-14T04:22:29.252087+0000 mgr.a (mgr.14355) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:31 smithi007 bash[22722]: audit 2024-09-14T04:22:30.480113+0000 mgr.a (mgr.14355) 15637 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:31 smithi131 bash[24745]: audit 2024-09-14T04:22:30.480113+0000 mgr.a (mgr.14355) 15637 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:31 smithi171 bash[25040]: audit 2024-09-14T04:22:30.480113+0000 mgr.a (mgr.14355) 15637 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:32 smithi007 bash[22722]: cluster 2024-09-14T04:22:31.255023+0000 mgr.a (mgr.14355) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:32 smithi131 bash[24745]: cluster 2024-09-14T04:22:31.255023+0000 mgr.a (mgr.14355) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:32 smithi171 bash[25040]: cluster 2024-09-14T04:22:31.255023+0000 mgr.a (mgr.14355) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:34 smithi007 bash[22722]: cluster 2024-09-14T04:22:33.255820+0000 mgr.a (mgr.14355) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:22:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:34 smithi131 bash[24745]: cluster 2024-09-14T04:22:33.255820+0000 mgr.a (mgr.14355) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:22:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:34 smithi171 bash[25040]: cluster 2024-09-14T04:22:33.255820+0000 mgr.a (mgr.14355) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:22:35.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:36.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:36.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:36.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:36.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:36.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:36 smithi007 bash[22722]: cluster 2024-09-14T04:22:35.257443+0000 mgr.a (mgr.14355) 15640 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:36 smithi131 bash[24745]: cluster 2024-09-14T04:22:35.257443+0000 mgr.a (mgr.14355) 15640 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:36 smithi171 bash[25040]: cluster 2024-09-14T04:22:35.257443+0000 mgr.a (mgr.14355) 15640 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:22:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:37 smithi007 bash[22722]: audit 2024-09-14T04:22:36.220858+0000 mgr.a (mgr.14355) 15641 : audit [DBG] from='client.337881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:37 smithi131 bash[24745]: audit 2024-09-14T04:22:36.220858+0000 mgr.a (mgr.14355) 15641 : audit [DBG] from='client.337881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:37 smithi171 bash[25040]: audit 2024-09-14T04:22:36.220858+0000 mgr.a (mgr.14355) 15641 : audit [DBG] from='client.337881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:38 smithi007 bash[22722]: cluster 2024-09-14T04:22:37.259205+0000 mgr.a (mgr.14355) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T04:22:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:38 smithi131 bash[24745]: cluster 2024-09-14T04:22:37.259205+0000 mgr.a (mgr.14355) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T04:22:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:38 smithi171 bash[25040]: cluster 2024-09-14T04:22:37.259205+0000 mgr.a (mgr.14355) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T04:22:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:40 smithi007 bash[22722]: cluster 2024-09-14T04:22:39.259970+0000 mgr.a (mgr.14355) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:40 smithi131 bash[24745]: cluster 2024-09-14T04:22:39.259970+0000 mgr.a (mgr.14355) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:41.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:40 smithi171 bash[25040]: cluster 2024-09-14T04:22:39.259970+0000 mgr.a (mgr.14355) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:22:41.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:41.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:41.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:42.418 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:42.419 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:42 smithi007 bash[22722]: cluster 2024-09-14T04:22:41.262055+0000 mgr.a (mgr.14355) 15644 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:42 smithi007 bash[22722]: audit 2024-09-14T04:22:41.983120+0000 mgr.a (mgr.14355) 15645 : audit [DBG] from='client.337956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:42 smithi131 bash[24745]: cluster 2024-09-14T04:22:41.262055+0000 mgr.a (mgr.14355) 15644 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:43.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:42 smithi131 bash[24745]: audit 2024-09-14T04:22:41.983120+0000 mgr.a (mgr.14355) 15645 : audit [DBG] from='client.337956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:42 smithi171 bash[25040]: cluster 2024-09-14T04:22:41.262055+0000 mgr.a (mgr.14355) 15644 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:42 smithi171 bash[25040]: audit 2024-09-14T04:22:41.983120+0000 mgr.a (mgr.14355) 15645 : audit [DBG] from='client.337956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:44 smithi007 bash[22722]: cluster 2024-09-14T04:22:43.262948+0000 mgr.a (mgr.14355) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:44 smithi007 bash[22722]: audit 2024-09-14T04:22:44.250460+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:22:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:44 smithi131 bash[24745]: cluster 2024-09-14T04:22:43.262948+0000 mgr.a (mgr.14355) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:44 smithi131 bash[24745]: audit 2024-09-14T04:22:44.250460+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:22:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:44 smithi171 bash[25040]: cluster 2024-09-14T04:22:43.262948+0000 mgr.a (mgr.14355) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:44 smithi171 bash[25040]: audit 2024-09-14T04:22:44.250460+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:44.882135+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:44.886720+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:45.661301+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:45.662883+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:45.672728+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:45 smithi007 bash[22722]: audit 2024-09-14T04:22:45.677331+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:44.882135+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:44.886720+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:45.661301+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:22:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:45.662883+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:22:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:45.672728+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:45 smithi131 bash[24745]: audit 2024-09-14T04:22:45.677331+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:44.882135+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:44.886720+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:45.661301+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:45.662883+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:45.672728+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:22:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:45 smithi171 bash[25040]: audit 2024-09-14T04:22:45.677331+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:46.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:22:46 smithi007 bash[22972]: debug 2024-09-14T04:22:46.420+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:22:46.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:22:46 smithi007 bash[22972]: debug 2024-09-14T04:22:46.420+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:22:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:46 smithi007 bash[22722]: cluster 2024-09-14T04:22:45.264628+0000 mgr.a (mgr.14355) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:46 smithi007 bash[22722]: audit 2024-09-14T04:22:45.679613+0000 mgr.a (mgr.14355) 15648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:46 smithi131 bash[24745]: cluster 2024-09-14T04:22:45.264628+0000 mgr.a (mgr.14355) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:47.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:46 smithi131 bash[24745]: audit 2024-09-14T04:22:45.679613+0000 mgr.a (mgr.14355) 15648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:46 smithi171 bash[25040]: cluster 2024-09-14T04:22:45.264628+0000 mgr.a (mgr.14355) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:22:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:46 smithi171 bash[25040]: audit 2024-09-14T04:22:45.679613+0000 mgr.a (mgr.14355) 15648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:22:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:48.180 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:47 smithi007 bash[22722]: audit 2024-09-14T04:22:46.423232+0000 mgr.a (mgr.14355) 15649 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:22:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:47 smithi007 bash[22722]: cephadm 2024-09-14T04:22:46.424584+0000 mgr.a (mgr.14355) 15650 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:22:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:47 smithi131 bash[24745]: audit 2024-09-14T04:22:46.423232+0000 mgr.a (mgr.14355) 15649 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:22:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:47 smithi131 bash[24745]: cephadm 2024-09-14T04:22:46.424584+0000 mgr.a (mgr.14355) 15650 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:22:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:47 smithi171 bash[25040]: audit 2024-09-14T04:22:46.423232+0000 mgr.a (mgr.14355) 15649 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:22:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:47 smithi171 bash[25040]: cephadm 2024-09-14T04:22:46.424584+0000 mgr.a (mgr.14355) 15650 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:22:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:48 smithi007 bash[22722]: cluster 2024-09-14T04:22:47.266401+0000 mgr.a (mgr.14355) 15651 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:48 smithi007 bash[22722]: audit 2024-09-14T04:22:47.753274+0000 mgr.a (mgr.14355) 15652 : audit [DBG] from='client.338142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:48 smithi131 bash[24745]: cluster 2024-09-14T04:22:47.266401+0000 mgr.a (mgr.14355) 15651 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:49.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:48 smithi131 bash[24745]: audit 2024-09-14T04:22:47.753274+0000 mgr.a (mgr.14355) 15652 : audit [DBG] from='client.338142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:48 smithi171 bash[25040]: cluster 2024-09-14T04:22:47.266401+0000 mgr.a (mgr.14355) 15651 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:22:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:48 smithi171 bash[25040]: audit 2024-09-14T04:22:47.753274+0000 mgr.a (mgr.14355) 15652 : audit [DBG] from='client.338142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:50 smithi007 bash[22722]: cluster 2024-09-14T04:22:49.267317+0000 mgr.a (mgr.14355) 15653 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:50 smithi131 bash[24745]: cluster 2024-09-14T04:22:49.267317+0000 mgr.a (mgr.14355) 15653 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:50 smithi171 bash[25040]: cluster 2024-09-14T04:22:49.267317+0000 mgr.a (mgr.14355) 15653 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:22:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:52 smithi007 bash[22722]: cluster 2024-09-14T04:22:51.269592+0000 mgr.a (mgr.14355) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:52 smithi131 bash[24745]: cluster 2024-09-14T04:22:51.269592+0000 mgr.a (mgr.14355) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:52 smithi171 bash[25040]: cluster 2024-09-14T04:22:51.269592+0000 mgr.a (mgr.14355) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:53.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:53.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:53.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:53.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:53.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:22:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:54 smithi007 bash[22722]: cluster 2024-09-14T04:22:53.270547+0000 mgr.a (mgr.14355) 15655 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:54 smithi007 bash[22722]: audit 2024-09-14T04:22:53.519709+0000 mgr.a (mgr.14355) 15656 : audit [DBG] from='client.338220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:54 smithi131 bash[24745]: cluster 2024-09-14T04:22:53.270547+0000 mgr.a (mgr.14355) 15655 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:55.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:54 smithi131 bash[24745]: audit 2024-09-14T04:22:53.519709+0000 mgr.a (mgr.14355) 15656 : audit [DBG] from='client.338220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:54 smithi171 bash[25040]: cluster 2024-09-14T04:22:53.270547+0000 mgr.a (mgr.14355) 15655 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:54 smithi171 bash[25040]: audit 2024-09-14T04:22:53.519709+0000 mgr.a (mgr.14355) 15656 : audit [DBG] from='client.338220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:22:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:56 smithi007 bash[22722]: cluster 2024-09-14T04:22:55.272386+0000 mgr.a (mgr.14355) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:56 smithi131 bash[24745]: cluster 2024-09-14T04:22:55.272386+0000 mgr.a (mgr.14355) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:56 smithi171 bash[25040]: cluster 2024-09-14T04:22:55.272386+0000 mgr.a (mgr.14355) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:58.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:22:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:22:58.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:22:59.208 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:22:58 smithi007 bash[22722]: cluster 2024-09-14T04:22:57.273652+0000 mgr.a (mgr.14355) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:22:58 smithi131 bash[24745]: cluster 2024-09-14T04:22:57.273652+0000 mgr.a (mgr.14355) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:22:58 smithi171 bash[25040]: cluster 2024-09-14T04:22:57.273652+0000 mgr.a (mgr.14355) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:22:59.746 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:22:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:22:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:22:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:22:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:00 smithi007 bash[22722]: cluster 2024-09-14T04:22:59.274409+0000 mgr.a (mgr.14355) 15659 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:00 smithi007 bash[22722]: audit 2024-09-14T04:22:59.300307+0000 mgr.a (mgr.14355) 15660 : audit [DBG] from='client.338298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:00 smithi131 bash[24745]: cluster 2024-09-14T04:22:59.274409+0000 mgr.a (mgr.14355) 15659 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:01.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:00 smithi131 bash[24745]: audit 2024-09-14T04:22:59.300307+0000 mgr.a (mgr.14355) 15660 : audit [DBG] from='client.338298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:00 smithi171 bash[25040]: cluster 2024-09-14T04:22:59.274409+0000 mgr.a (mgr.14355) 15659 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:00 smithi171 bash[25040]: audit 2024-09-14T04:22:59.300307+0000 mgr.a (mgr.14355) 15660 : audit [DBG] from='client.338298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:02 smithi007 bash[22722]: cluster 2024-09-14T04:23:01.276791+0000 mgr.a (mgr.14355) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:02 smithi131 bash[24745]: cluster 2024-09-14T04:23:01.276791+0000 mgr.a (mgr.14355) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:02 smithi171 bash[25040]: cluster 2024-09-14T04:23:01.276791+0000 mgr.a (mgr.14355) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:23:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:04.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:04 smithi007 bash[22722]: cluster 2024-09-14T04:23:03.277592+0000 mgr.a (mgr.14355) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:04 smithi131 bash[24745]: cluster 2024-09-14T04:23:03.277592+0000 mgr.a (mgr.14355) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:04 smithi171 bash[25040]: cluster 2024-09-14T04:23:03.277592+0000 mgr.a (mgr.14355) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:05.498 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:05.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:06.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:05 smithi007 bash[22722]: audit 2024-09-14T04:23:05.080593+0000 mgr.a (mgr.14355) 15663 : audit [DBG] from='client.338373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:05 smithi131 bash[24745]: audit 2024-09-14T04:23:05.080593+0000 mgr.a (mgr.14355) 15663 : audit [DBG] from='client.338373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:05 smithi171 bash[25040]: audit 2024-09-14T04:23:05.080593+0000 mgr.a (mgr.14355) 15663 : audit [DBG] from='client.338373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:06 smithi007 bash[22722]: cluster 2024-09-14T04:23:05.278733+0000 mgr.a (mgr.14355) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:06 smithi131 bash[24745]: cluster 2024-09-14T04:23:05.278733+0000 mgr.a (mgr.14355) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:06 smithi171 bash[25040]: cluster 2024-09-14T04:23:05.278733+0000 mgr.a (mgr.14355) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:09.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:08 smithi131 bash[24745]: cluster 2024-09-14T04:23:07.280426+0000 mgr.a (mgr.14355) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:23:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:08 smithi171 bash[25040]: cluster 2024-09-14T04:23:07.280426+0000 mgr.a (mgr.14355) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:23:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:08 smithi007 bash[22722]: cluster 2024-09-14T04:23:07.280426+0000 mgr.a (mgr.14355) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:23:10.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:10.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:11.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:10 smithi131 bash[24745]: cluster 2024-09-14T04:23:09.281394+0000 mgr.a (mgr.14355) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:10 smithi171 bash[25040]: cluster 2024-09-14T04:23:09.281394+0000 mgr.a (mgr.14355) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:10 smithi007 bash[22722]: cluster 2024-09-14T04:23:09.281394+0000 mgr.a (mgr.14355) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:11 smithi131 bash[24745]: audit 2024-09-14T04:23:10.835101+0000 mgr.a (mgr.14355) 15667 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:11 smithi171 bash[25040]: audit 2024-09-14T04:23:10.835101+0000 mgr.a (mgr.14355) 15667 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:11 smithi007 bash[22722]: audit 2024-09-14T04:23:10.835101+0000 mgr.a (mgr.14355) 15667 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:12 smithi131 bash[24745]: cluster 2024-09-14T04:23:11.282850+0000 mgr.a (mgr.14355) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:12 smithi171 bash[25040]: cluster 2024-09-14T04:23:11.282850+0000 mgr.a (mgr.14355) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:12 smithi007 bash[22722]: cluster 2024-09-14T04:23:11.282850+0000 mgr.a (mgr.14355) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:14 smithi131 bash[24745]: cluster 2024-09-14T04:23:13.283580+0000 mgr.a (mgr.14355) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:14 smithi171 bash[25040]: cluster 2024-09-14T04:23:13.283580+0000 mgr.a (mgr.14355) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:14 smithi007 bash[22722]: cluster 2024-09-14T04:23:13.283580+0000 mgr.a (mgr.14355) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:16.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:16.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:17.035 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:17.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:16 smithi131 bash[24745]: cluster 2024-09-14T04:23:15.285110+0000 mgr.a (mgr.14355) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:16 smithi171 bash[25040]: cluster 2024-09-14T04:23:15.285110+0000 mgr.a (mgr.14355) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:16 smithi007 bash[22722]: cluster 2024-09-14T04:23:15.285110+0000 mgr.a (mgr.14355) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:17 smithi131 bash[24745]: audit 2024-09-14T04:23:16.606845+0000 mgr.a (mgr.14355) 15671 : audit [DBG] from='client.338529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:18.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:17 smithi171 bash[25040]: audit 2024-09-14T04:23:16.606845+0000 mgr.a (mgr.14355) 15671 : audit [DBG] from='client.338529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:18.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:17 smithi007 bash[22722]: audit 2024-09-14T04:23:16.606845+0000 mgr.a (mgr.14355) 15671 : audit [DBG] from='client.338529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:18 smithi131 bash[24745]: cluster 2024-09-14T04:23:17.286852+0000 mgr.a (mgr.14355) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:18 smithi171 bash[25040]: cluster 2024-09-14T04:23:17.286852+0000 mgr.a (mgr.14355) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:18 smithi007 bash[22722]: cluster 2024-09-14T04:23:17.286852+0000 mgr.a (mgr.14355) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:20 smithi131 bash[24745]: cluster 2024-09-14T04:23:19.287620+0000 mgr.a (mgr.14355) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:20 smithi171 bash[25040]: cluster 2024-09-14T04:23:19.287620+0000 mgr.a (mgr.14355) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:20 smithi007 bash[22722]: cluster 2024-09-14T04:23:19.287620+0000 mgr.a (mgr.14355) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:22.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:22.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:22.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:22.795 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:22.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:22.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:22.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:22.796 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:23 smithi131 bash[24745]: cluster 2024-09-14T04:23:21.289664+0000 mgr.a (mgr.14355) 15674 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:23 smithi171 bash[25040]: cluster 2024-09-14T04:23:21.289664+0000 mgr.a (mgr.14355) 15674 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:23 smithi007 bash[22722]: cluster 2024-09-14T04:23:21.289664+0000 mgr.a (mgr.14355) 15674 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:24 smithi131 bash[24745]: audit 2024-09-14T04:23:22.370486+0000 mgr.a (mgr.14355) 15675 : audit [DBG] from='client.338607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:24 smithi171 bash[25040]: audit 2024-09-14T04:23:22.370486+0000 mgr.a (mgr.14355) 15675 : audit [DBG] from='client.338607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:24 smithi007 bash[22722]: audit 2024-09-14T04:23:22.370486+0000 mgr.a (mgr.14355) 15675 : audit [DBG] from='client.338607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:25 smithi131 bash[24745]: cluster 2024-09-14T04:23:23.290554+0000 mgr.a (mgr.14355) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:25 smithi171 bash[25040]: cluster 2024-09-14T04:23:23.290554+0000 mgr.a (mgr.14355) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:25 smithi007 bash[22722]: cluster 2024-09-14T04:23:23.290554+0000 mgr.a (mgr.14355) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:27 smithi131 bash[24745]: cluster 2024-09-14T04:23:25.292296+0000 mgr.a (mgr.14355) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:27 smithi171 bash[25040]: cluster 2024-09-14T04:23:25.292296+0000 mgr.a (mgr.14355) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:27 smithi007 bash[22722]: cluster 2024-09-14T04:23:25.292296+0000 mgr.a (mgr.14355) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:27.797 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:27.798 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:28.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:29 smithi131 bash[24745]: cluster 2024-09-14T04:23:27.293521+0000 mgr.a (mgr.14355) 15678 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:29 smithi171 bash[25040]: cluster 2024-09-14T04:23:27.293521+0000 mgr.a (mgr.14355) 15678 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:29.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:29 smithi007 bash[22722]: cluster 2024-09-14T04:23:27.293521+0000 mgr.a (mgr.14355) 15678 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:30 smithi131 bash[24745]: audit 2024-09-14T04:23:28.128097+0000 mgr.a (mgr.14355) 15679 : audit [DBG] from='client.338685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:30 smithi171 bash[25040]: audit 2024-09-14T04:23:28.128097+0000 mgr.a (mgr.14355) 15679 : audit [DBG] from='client.338685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:30 smithi007 bash[22722]: audit 2024-09-14T04:23:28.128097+0000 mgr.a (mgr.14355) 15679 : audit [DBG] from='client.338685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:31 smithi131 bash[24745]: cluster 2024-09-14T04:23:29.294567+0000 mgr.a (mgr.14355) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:31 smithi171 bash[25040]: cluster 2024-09-14T04:23:29.294567+0000 mgr.a (mgr.14355) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:31 smithi007 bash[22722]: cluster 2024-09-14T04:23:29.294567+0000 mgr.a (mgr.14355) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:33 smithi171 bash[25040]: cluster 2024-09-14T04:23:31.296977+0000 mgr.a (mgr.14355) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:33 smithi007 bash[22722]: cluster 2024-09-14T04:23:31.296977+0000 mgr.a (mgr.14355) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:33 smithi131 bash[24745]: cluster 2024-09-14T04:23:31.296977+0000 mgr.a (mgr.14355) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:34.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:34.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:35 smithi171 bash[25040]: cluster 2024-09-14T04:23:33.297901+0000 mgr.a (mgr.14355) 15682 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:35 smithi171 bash[25040]: audit 2024-09-14T04:23:33.882797+0000 mgr.a (mgr.14355) 15683 : audit [DBG] from='client.338760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:35 smithi007 bash[22722]: cluster 2024-09-14T04:23:33.297901+0000 mgr.a (mgr.14355) 15682 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:35 smithi007 bash[22722]: audit 2024-09-14T04:23:33.882797+0000 mgr.a (mgr.14355) 15683 : audit [DBG] from='client.338760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:35 smithi131 bash[24745]: cluster 2024-09-14T04:23:33.297901+0000 mgr.a (mgr.14355) 15682 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:35 smithi131 bash[24745]: audit 2024-09-14T04:23:33.882797+0000 mgr.a (mgr.14355) 15683 : audit [DBG] from='client.338760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:37 smithi171 bash[25040]: cluster 2024-09-14T04:23:35.299747+0000 mgr.a (mgr.14355) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:37 smithi007 bash[22722]: cluster 2024-09-14T04:23:35.299747+0000 mgr.a (mgr.14355) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:37 smithi131 bash[24745]: cluster 2024-09-14T04:23:35.299747+0000 mgr.a (mgr.14355) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:39.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:39.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:39 smithi007 bash[22722]: cluster 2024-09-14T04:23:37.300989+0000 mgr.a (mgr.14355) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:39 smithi131 bash[24745]: cluster 2024-09-14T04:23:37.300989+0000 mgr.a (mgr.14355) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:39 smithi171 bash[25040]: cluster 2024-09-14T04:23:37.300989+0000 mgr.a (mgr.14355) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:23:40.096 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:40.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:40.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:40.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:40.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:41 smithi007 bash[22722]: cluster 2024-09-14T04:23:39.301751+0000 mgr.a (mgr.14355) 15686 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:41 smithi007 bash[22722]: audit 2024-09-14T04:23:39.660327+0000 mgr.a (mgr.14355) 15687 : audit [DBG] from='client.338835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:41 smithi131 bash[24745]: cluster 2024-09-14T04:23:39.301751+0000 mgr.a (mgr.14355) 15686 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:41.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:41 smithi131 bash[24745]: audit 2024-09-14T04:23:39.660327+0000 mgr.a (mgr.14355) 15687 : audit [DBG] from='client.338835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:41 smithi171 bash[25040]: cluster 2024-09-14T04:23:39.301751+0000 mgr.a (mgr.14355) 15686 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:41 smithi171 bash[25040]: audit 2024-09-14T04:23:39.660327+0000 mgr.a (mgr.14355) 15687 : audit [DBG] from='client.338835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:43 smithi007 bash[22722]: cluster 2024-09-14T04:23:41.304111+0000 mgr.a (mgr.14355) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:43 smithi131 bash[24745]: cluster 2024-09-14T04:23:41.304111+0000 mgr.a (mgr.14355) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:43 smithi171 bash[25040]: cluster 2024-09-14T04:23:41.304111+0000 mgr.a (mgr.14355) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:23:45.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:45.098 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:45.098 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:45 smithi007 bash[22722]: cluster 2024-09-14T04:23:43.304891+0000 mgr.a (mgr.14355) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:45 smithi131 bash[24745]: cluster 2024-09-14T04:23:43.304891+0000 mgr.a (mgr.14355) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:45 smithi171 bash[25040]: cluster 2024-09-14T04:23:43.304891+0000 mgr.a (mgr.14355) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:45.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:47 smithi007 bash[22722]: cluster 2024-09-14T04:23:45.305892+0000 mgr.a (mgr.14355) 15690 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:47 smithi007 bash[22722]: audit 2024-09-14T04:23:45.428352+0000 mgr.a (mgr.14355) 15691 : audit [DBG] from='client.338910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:47 smithi007 bash[22722]: audit 2024-09-14T04:23:46.481595+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:23:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:47 smithi131 bash[24745]: cluster 2024-09-14T04:23:45.305892+0000 mgr.a (mgr.14355) 15690 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:47 smithi131 bash[24745]: audit 2024-09-14T04:23:45.428352+0000 mgr.a (mgr.14355) 15691 : audit [DBG] from='client.338910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:47 smithi131 bash[24745]: audit 2024-09-14T04:23:46.481595+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:23:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:47 smithi171 bash[25040]: cluster 2024-09-14T04:23:45.305892+0000 mgr.a (mgr.14355) 15690 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:47 smithi171 bash[25040]: audit 2024-09-14T04:23:45.428352+0000 mgr.a (mgr.14355) 15691 : audit [DBG] from='client.338910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:47 smithi171 bash[25040]: audit 2024-09-14T04:23:46.481595+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:23:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:48 smithi007 bash[22722]: audit 2024-09-14T04:23:47.095627+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:48 smithi007 bash[22722]: audit 2024-09-14T04:23:47.099303+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:48 smithi007 bash[22722]: audit 2024-09-14T04:23:47.102975+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:48 smithi007 bash[22722]: audit 2024-09-14T04:23:47.106622+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:48 smithi131 bash[24745]: audit 2024-09-14T04:23:47.095627+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:48 smithi131 bash[24745]: audit 2024-09-14T04:23:47.099303+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:48 smithi131 bash[24745]: audit 2024-09-14T04:23:47.102975+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:48 smithi131 bash[24745]: audit 2024-09-14T04:23:47.106622+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:48 smithi171 bash[25040]: audit 2024-09-14T04:23:47.095627+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:48 smithi171 bash[25040]: audit 2024-09-14T04:23:47.099303+0000 mon.a (mon.0) 2929 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:48 smithi171 bash[25040]: audit 2024-09-14T04:23:47.102975+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:48 smithi171 bash[25040]: audit 2024-09-14T04:23:47.106622+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:49 smithi007 bash[22722]: cluster 2024-09-14T04:23:47.307585+0000 mgr.a (mgr.14355) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:49 smithi131 bash[24745]: cluster 2024-09-14T04:23:47.307585+0000 mgr.a (mgr.14355) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:49 smithi171 bash[25040]: cluster 2024-09-14T04:23:47.307585+0000 mgr.a (mgr.14355) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:23:50.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:51 smithi007 bash[22722]: cluster 2024-09-14T04:23:49.308380+0000 mgr.a (mgr.14355) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:51 smithi131 bash[24745]: cluster 2024-09-14T04:23:49.308380+0000 mgr.a (mgr.14355) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:51 smithi171 bash[25040]: cluster 2024-09-14T04:23:49.308380+0000 mgr.a (mgr.14355) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:23:51.596 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:52 smithi007 bash[22722]: audit 2024-09-14T04:23:51.173524+0000 mgr.a (mgr.14355) 15694 : audit [DBG] from='client.338988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:52 smithi007 bash[22722]: cluster 2024-09-14T04:23:51.314344+0000 mgr.a (mgr.14355) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:52 smithi131 bash[24745]: audit 2024-09-14T04:23:51.173524+0000 mgr.a (mgr.14355) 15694 : audit [DBG] from='client.338988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:52 smithi131 bash[24745]: cluster 2024-09-14T04:23:51.314344+0000 mgr.a (mgr.14355) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:52 smithi171 bash[25040]: audit 2024-09-14T04:23:51.173524+0000 mgr.a (mgr.14355) 15694 : audit [DBG] from='client.338988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:52 smithi171 bash[25040]: cluster 2024-09-14T04:23:51.314344+0000 mgr.a (mgr.14355) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:54 smithi007 bash[22722]: cluster 2024-09-14T04:23:53.315350+0000 mgr.a (mgr.14355) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:23:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:54 smithi131 bash[24745]: cluster 2024-09-14T04:23:53.315350+0000 mgr.a (mgr.14355) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:23:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:54 smithi171 bash[25040]: cluster 2024-09-14T04:23:53.315350+0000 mgr.a (mgr.14355) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:23:56.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:23:56.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:23:56.598 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:23:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:56 smithi007 bash[22722]: cluster 2024-09-14T04:23:55.316318+0000 mgr.a (mgr.14355) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:56 smithi131 bash[24745]: cluster 2024-09-14T04:23:55.316318+0000 mgr.a (mgr.14355) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:56 smithi171 bash[25040]: cluster 2024-09-14T04:23:55.316318+0000 mgr.a (mgr.14355) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:23:57.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:23:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:23:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:23:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:23:57.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:23:58.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:23:58 smithi007 bash[22972]: debug 2024-09-14T04:23:58.139+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:23:58.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:23:58 smithi007 bash[22972]: debug 2024-09-14T04:23:58.139+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:23:58.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:56.934425+0000 mgr.a (mgr.14355) 15698 : audit [DBG] from='client.339066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.221222+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.226951+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.228096+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.228983+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.235554+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:57 smithi007 bash[22722]: audit 2024-09-14T04:23:57.237981+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:56.934425+0000 mgr.a (mgr.14355) 15698 : audit [DBG] from='client.339066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.221222+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.226951+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.228096+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.228983+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.235554+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:57 smithi131 bash[24745]: audit 2024-09-14T04:23:57.237981+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:56.934425+0000 mgr.a (mgr.14355) 15698 : audit [DBG] from='client.339066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.221222+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.226951+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.228096+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.228983+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:23:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.235554+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:23:58.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:57 smithi171 bash[25040]: audit 2024-09-14T04:23:57.237981+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:58 smithi007 bash[22722]: audit 2024-09-14T04:23:57.239187+0000 mgr.a (mgr.14355) 15699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:58 smithi007 bash[22722]: cluster 2024-09-14T04:23:57.318030+0000 mgr.a (mgr.14355) 15700 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:58 smithi131 bash[24745]: audit 2024-09-14T04:23:57.239187+0000 mgr.a (mgr.14355) 15699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:59.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:58 smithi131 bash[24745]: cluster 2024-09-14T04:23:57.318030+0000 mgr.a (mgr.14355) 15700 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:23:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:58 smithi171 bash[25040]: audit 2024-09-14T04:23:57.239187+0000 mgr.a (mgr.14355) 15699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:23:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:58 smithi171 bash[25040]: cluster 2024-09-14T04:23:57.318030+0000 mgr.a (mgr.14355) 15700 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:59 smithi007 bash[22722]: audit 2024-09-14T04:23:58.143343+0000 mgr.a (mgr.14355) 15701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:24:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:23:59 smithi007 bash[22722]: cephadm 2024-09-14T04:23:58.144895+0000 mgr.a (mgr.14355) 15702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:24:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:59 smithi131 bash[24745]: audit 2024-09-14T04:23:58.143343+0000 mgr.a (mgr.14355) 15701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:24:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:23:59 smithi131 bash[24745]: cephadm 2024-09-14T04:23:58.144895+0000 mgr.a (mgr.14355) 15702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:24:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:59 smithi171 bash[25040]: audit 2024-09-14T04:23:58.143343+0000 mgr.a (mgr.14355) 15701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:24:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:23:59 smithi171 bash[25040]: cephadm 2024-09-14T04:23:58.144895+0000 mgr.a (mgr.14355) 15702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:24:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:00 smithi007 bash[22722]: cluster 2024-09-14T04:23:59.319024+0000 mgr.a (mgr.14355) 15703 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:00 smithi131 bash[24745]: cluster 2024-09-14T04:23:59.319024+0000 mgr.a (mgr.14355) 15703 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:00 smithi171 bash[25040]: cluster 2024-09-14T04:23:59.319024+0000 mgr.a (mgr.14355) 15703 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:02.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:02.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:02.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:03.169 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:03.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:02 smithi007 bash[22722]: cluster 2024-09-14T04:24:01.321301+0000 mgr.a (mgr.14355) 15704 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:02 smithi131 bash[24745]: cluster 2024-09-14T04:24:01.321301+0000 mgr.a (mgr.14355) 15704 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:02 smithi171 bash[25040]: cluster 2024-09-14T04:24:01.321301+0000 mgr.a (mgr.14355) 15704 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:03 smithi007 bash[22722]: audit 2024-09-14T04:24:02.729547+0000 mgr.a (mgr.14355) 15705 : audit [DBG] from='client.339246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:03 smithi131 bash[24745]: audit 2024-09-14T04:24:02.729547+0000 mgr.a (mgr.14355) 15705 : audit [DBG] from='client.339246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:03 smithi171 bash[25040]: audit 2024-09-14T04:24:02.729547+0000 mgr.a (mgr.14355) 15705 : audit [DBG] from='client.339246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:04 smithi131 bash[24745]: cluster 2024-09-14T04:24:03.322251+0000 mgr.a (mgr.14355) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:04 smithi171 bash[25040]: cluster 2024-09-14T04:24:03.322251+0000 mgr.a (mgr.14355) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:04 smithi007 bash[22722]: cluster 2024-09-14T04:24:03.322251+0000 mgr.a (mgr.14355) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:06 smithi131 bash[24745]: cluster 2024-09-14T04:24:05.324037+0000 mgr.a (mgr.14355) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:06 smithi171 bash[25040]: cluster 2024-09-14T04:24:05.324037+0000 mgr.a (mgr.14355) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:06 smithi007 bash[22722]: cluster 2024-09-14T04:24:05.324037+0000 mgr.a (mgr.14355) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:08.943 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:08.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:08 smithi131 bash[24745]: cluster 2024-09-14T04:24:07.325285+0000 mgr.a (mgr.14355) 15708 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:08 smithi171 bash[25040]: cluster 2024-09-14T04:24:07.325285+0000 mgr.a (mgr.14355) 15708 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:08 smithi007 bash[22722]: cluster 2024-09-14T04:24:07.325285+0000 mgr.a (mgr.14355) 15708 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:09 smithi131 bash[24745]: audit 2024-09-14T04:24:08.506495+0000 mgr.a (mgr.14355) 15709 : audit [DBG] from='client.339321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:09 smithi171 bash[25040]: audit 2024-09-14T04:24:08.506495+0000 mgr.a (mgr.14355) 15709 : audit [DBG] from='client.339321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:09 smithi007 bash[22722]: audit 2024-09-14T04:24:08.506495+0000 mgr.a (mgr.14355) 15709 : audit [DBG] from='client.339321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:10 smithi131 bash[24745]: cluster 2024-09-14T04:24:09.326223+0000 mgr.a (mgr.14355) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:10 smithi171 bash[25040]: cluster 2024-09-14T04:24:09.326223+0000 mgr.a (mgr.14355) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:10 smithi007 bash[22722]: cluster 2024-09-14T04:24:09.326223+0000 mgr.a (mgr.14355) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:12 smithi131 bash[24745]: cluster 2024-09-14T04:24:11.328504+0000 mgr.a (mgr.14355) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:12 smithi171 bash[25040]: cluster 2024-09-14T04:24:11.328504+0000 mgr.a (mgr.14355) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:12 smithi007 bash[22722]: cluster 2024-09-14T04:24:11.328504+0000 mgr.a (mgr.14355) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:24:13.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:13.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:13.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:14.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:14.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:14 smithi131 bash[24745]: cluster 2024-09-14T04:24:13.329284+0000 mgr.a (mgr.14355) 15712 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:14 smithi171 bash[25040]: cluster 2024-09-14T04:24:13.329284+0000 mgr.a (mgr.14355) 15712 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:14 smithi007 bash[22722]: cluster 2024-09-14T04:24:13.329284+0000 mgr.a (mgr.14355) 15712 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:15 smithi131 bash[24745]: audit 2024-09-14T04:24:14.274399+0000 mgr.a (mgr.14355) 15713 : audit [DBG] from='client.339399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:15 smithi171 bash[25040]: audit 2024-09-14T04:24:14.274399+0000 mgr.a (mgr.14355) 15713 : audit [DBG] from='client.339399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:15 smithi007 bash[22722]: audit 2024-09-14T04:24:14.274399+0000 mgr.a (mgr.14355) 15713 : audit [DBG] from='client.339399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:16 smithi131 bash[24745]: cluster 2024-09-14T04:24:15.331238+0000 mgr.a (mgr.14355) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:16 smithi171 bash[25040]: cluster 2024-09-14T04:24:15.331238+0000 mgr.a (mgr.14355) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:16 smithi007 bash[22722]: cluster 2024-09-14T04:24:15.331238+0000 mgr.a (mgr.14355) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:19 smithi131 bash[24745]: cluster 2024-09-14T04:24:17.332532+0000 mgr.a (mgr.14355) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:18 smithi171 bash[25040]: cluster 2024-09-14T04:24:17.332532+0000 mgr.a (mgr.14355) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:18 smithi007 bash[22722]: cluster 2024-09-14T04:24:17.332532+0000 mgr.a (mgr.14355) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:20.423 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:20.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:20.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:20.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:21 smithi131 bash[24745]: cluster 2024-09-14T04:24:19.333321+0000 mgr.a (mgr.14355) 15716 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:21.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:21 smithi131 bash[24745]: audit 2024-09-14T04:24:20.015973+0000 mgr.a (mgr.14355) 15717 : audit [DBG] from='client.339474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:21 smithi171 bash[25040]: cluster 2024-09-14T04:24:19.333321+0000 mgr.a (mgr.14355) 15716 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:21 smithi171 bash[25040]: audit 2024-09-14T04:24:20.015973+0000 mgr.a (mgr.14355) 15717 : audit [DBG] from='client.339474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:21 smithi007 bash[22722]: cluster 2024-09-14T04:24:19.333321+0000 mgr.a (mgr.14355) 15716 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:21 smithi007 bash[22722]: audit 2024-09-14T04:24:20.015973+0000 mgr.a (mgr.14355) 15717 : audit [DBG] from='client.339474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:23 smithi131 bash[24745]: cluster 2024-09-14T04:24:21.335874+0000 mgr.a (mgr.14355) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:23 smithi171 bash[25040]: cluster 2024-09-14T04:24:21.335874+0000 mgr.a (mgr.14355) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:23 smithi007 bash[22722]: cluster 2024-09-14T04:24:21.335874+0000 mgr.a (mgr.14355) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:25 smithi131 bash[24745]: cluster 2024-09-14T04:24:23.336646+0000 mgr.a (mgr.14355) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:25 smithi171 bash[25040]: cluster 2024-09-14T04:24:23.336646+0000 mgr.a (mgr.14355) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:25.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:25.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:25 smithi007 bash[22722]: cluster 2024-09-14T04:24:23.336646+0000 mgr.a (mgr.14355) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:26.169 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:26.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:27 smithi131 bash[24745]: cluster 2024-09-14T04:24:25.338164+0000 mgr.a (mgr.14355) 15720 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:27.356 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:27 smithi131 bash[24745]: audit 2024-09-14T04:24:25.750283+0000 mgr.a (mgr.14355) 15721 : audit [DBG] from='client.339549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:27.356 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:27 smithi171 bash[25040]: cluster 2024-09-14T04:24:25.338164+0000 mgr.a (mgr.14355) 15720 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:27.357 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:27 smithi171 bash[25040]: audit 2024-09-14T04:24:25.750283+0000 mgr.a (mgr.14355) 15721 : audit [DBG] from='client.339549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:27 smithi007 bash[22722]: cluster 2024-09-14T04:24:25.338164+0000 mgr.a (mgr.14355) 15720 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:27 smithi007 bash[22722]: audit 2024-09-14T04:24:25.750283+0000 mgr.a (mgr.14355) 15721 : audit [DBG] from='client.339549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:29 smithi131 bash[24745]: cluster 2024-09-14T04:24:27.340090+0000 mgr.a (mgr.14355) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:29 smithi171 bash[25040]: cluster 2024-09-14T04:24:27.340090+0000 mgr.a (mgr.14355) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:29 smithi007 bash[22722]: cluster 2024-09-14T04:24:27.340090+0000 mgr.a (mgr.14355) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:24:31.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:31.171 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:31 smithi131 bash[24745]: cluster 2024-09-14T04:24:29.340884+0000 mgr.a (mgr.14355) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:24:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:31 smithi171 bash[25040]: cluster 2024-09-14T04:24:29.340884+0000 mgr.a (mgr.14355) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:24:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:31 smithi007 bash[22722]: cluster 2024-09-14T04:24:29.340884+0000 mgr.a (mgr.14355) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:24:31.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:31.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:33 smithi131 bash[24745]: cluster 2024-09-14T04:24:31.343005+0000 mgr.a (mgr.14355) 15724 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:33.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:33 smithi131 bash[24745]: audit 2024-09-14T04:24:31.512305+0000 mgr.a (mgr.14355) 15725 : audit [DBG] from='client.339627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:33 smithi171 bash[25040]: cluster 2024-09-14T04:24:31.343005+0000 mgr.a (mgr.14355) 15724 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:33.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:33 smithi171 bash[25040]: audit 2024-09-14T04:24:31.512305+0000 mgr.a (mgr.14355) 15725 : audit [DBG] from='client.339627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:33 smithi007 bash[22722]: cluster 2024-09-14T04:24:31.343005+0000 mgr.a (mgr.14355) 15724 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:33 smithi007 bash[22722]: audit 2024-09-14T04:24:31.512305+0000 mgr.a (mgr.14355) 15725 : audit [DBG] from='client.339627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:35 smithi171 bash[25040]: cluster 2024-09-14T04:24:33.343968+0000 mgr.a (mgr.14355) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:24:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:35 smithi007 bash[22722]: cluster 2024-09-14T04:24:33.343968+0000 mgr.a (mgr.14355) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:24:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:35 smithi131 bash[24745]: cluster 2024-09-14T04:24:33.343968+0000 mgr.a (mgr.14355) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:24:36.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:36.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:36.959 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:37 smithi171 bash[25040]: cluster 2024-09-14T04:24:35.345730+0000 mgr.a (mgr.14355) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:24:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:37 smithi007 bash[22722]: cluster 2024-09-14T04:24:35.345730+0000 mgr.a (mgr.14355) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:24:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:37 smithi131 bash[24745]: cluster 2024-09-14T04:24:35.345730+0000 mgr.a (mgr.14355) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T04:24:37.688 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:37.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:37.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:37.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:37.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:39 smithi171 bash[25040]: audit 2024-09-14T04:24:37.286300+0000 mgr.a (mgr.14355) 15728 : audit [DBG] from='client.339705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:39 smithi171 bash[25040]: cluster 2024-09-14T04:24:37.346723+0000 mgr.a (mgr.14355) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:39 smithi007 bash[22722]: audit 2024-09-14T04:24:37.286300+0000 mgr.a (mgr.14355) 15728 : audit [DBG] from='client.339705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:39 smithi007 bash[22722]: cluster 2024-09-14T04:24:37.346723+0000 mgr.a (mgr.14355) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:39 smithi131 bash[24745]: audit 2024-09-14T04:24:37.286300+0000 mgr.a (mgr.14355) 15728 : audit [DBG] from='client.339705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:39.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:39 smithi131 bash[24745]: cluster 2024-09-14T04:24:37.346723+0000 mgr.a (mgr.14355) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:41 smithi007 bash[22722]: cluster 2024-09-14T04:24:39.347575+0000 mgr.a (mgr.14355) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:41 smithi131 bash[24745]: cluster 2024-09-14T04:24:39.347575+0000 mgr.a (mgr.14355) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:41 smithi171 bash[25040]: cluster 2024-09-14T04:24:39.347575+0000 mgr.a (mgr.14355) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:42.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:42.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:42.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:43.433 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:43.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:43.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:43.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:43 smithi007 bash[22722]: cluster 2024-09-14T04:24:41.349836+0000 mgr.a (mgr.14355) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:43 smithi131 bash[24745]: cluster 2024-09-14T04:24:41.349836+0000 mgr.a (mgr.14355) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:43 smithi171 bash[25040]: cluster 2024-09-14T04:24:41.349836+0000 mgr.a (mgr.14355) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:44 smithi007 bash[22722]: audit 2024-09-14T04:24:43.017231+0000 mgr.a (mgr.14355) 15732 : audit [DBG] from='client.339783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:44 smithi131 bash[24745]: audit 2024-09-14T04:24:43.017231+0000 mgr.a (mgr.14355) 15732 : audit [DBG] from='client.339783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:44 smithi171 bash[25040]: audit 2024-09-14T04:24:43.017231+0000 mgr.a (mgr.14355) 15732 : audit [DBG] from='client.339783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:45 smithi007 bash[22722]: cluster 2024-09-14T04:24:43.350381+0000 mgr.a (mgr.14355) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:45 smithi131 bash[24745]: cluster 2024-09-14T04:24:43.350381+0000 mgr.a (mgr.14355) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:45.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:45 smithi171 bash[25040]: cluster 2024-09-14T04:24:43.350381+0000 mgr.a (mgr.14355) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:47 smithi007 bash[22722]: cluster 2024-09-14T04:24:45.352079+0000 mgr.a (mgr.14355) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:47 smithi131 bash[24745]: cluster 2024-09-14T04:24:45.352079+0000 mgr.a (mgr.14355) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:47 smithi171 bash[25040]: cluster 2024-09-14T04:24:45.352079+0000 mgr.a (mgr.14355) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:48.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:48.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:48.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:49.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:49.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:49 smithi007 bash[22722]: cluster 2024-09-14T04:24:47.353338+0000 mgr.a (mgr.14355) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:49 smithi131 bash[24745]: cluster 2024-09-14T04:24:47.353338+0000 mgr.a (mgr.14355) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:49 smithi171 bash[25040]: cluster 2024-09-14T04:24:47.353338+0000 mgr.a (mgr.14355) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:50 smithi007 bash[22722]: audit 2024-09-14T04:24:48.763091+0000 mgr.a (mgr.14355) 15736 : audit [DBG] from='client.339861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:50 smithi131 bash[24745]: audit 2024-09-14T04:24:48.763091+0000 mgr.a (mgr.14355) 15736 : audit [DBG] from='client.339861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:50 smithi171 bash[25040]: audit 2024-09-14T04:24:48.763091+0000 mgr.a (mgr.14355) 15736 : audit [DBG] from='client.339861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:51 smithi007 bash[22722]: cluster 2024-09-14T04:24:49.354274+0000 mgr.a (mgr.14355) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:51 smithi131 bash[24745]: cluster 2024-09-14T04:24:49.354274+0000 mgr.a (mgr.14355) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:51 smithi171 bash[25040]: cluster 2024-09-14T04:24:49.354274+0000 mgr.a (mgr.14355) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:53 smithi007 bash[22722]: cluster 2024-09-14T04:24:51.356572+0000 mgr.a (mgr.14355) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:53 smithi131 bash[24745]: cluster 2024-09-14T04:24:51.356572+0000 mgr.a (mgr.14355) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:53 smithi171 bash[25040]: cluster 2024-09-14T04:24:51.356572+0000 mgr.a (mgr.14355) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:54.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:54.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:54.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:24:54.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:24:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:24:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:24:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:24:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:24:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:55 smithi007 bash[22722]: cluster 2024-09-14T04:24:53.357513+0000 mgr.a (mgr.14355) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:55 smithi131 bash[24745]: cluster 2024-09-14T04:24:53.357513+0000 mgr.a (mgr.14355) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:55 smithi171 bash[25040]: cluster 2024-09-14T04:24:53.357513+0000 mgr.a (mgr.14355) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:24:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:56 smithi007 bash[22722]: audit 2024-09-14T04:24:54.536781+0000 mgr.a (mgr.14355) 15740 : audit [DBG] from='client.339939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:56 smithi131 bash[24745]: audit 2024-09-14T04:24:54.536781+0000 mgr.a (mgr.14355) 15740 : audit [DBG] from='client.339939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:56 smithi171 bash[25040]: audit 2024-09-14T04:24:54.536781+0000 mgr.a (mgr.14355) 15740 : audit [DBG] from='client.339939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:24:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:57 smithi007 bash[22722]: cluster 2024-09-14T04:24:55.359679+0000 mgr.a (mgr.14355) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:57 smithi131 bash[24745]: cluster 2024-09-14T04:24:55.359679+0000 mgr.a (mgr.14355) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:57 smithi171 bash[25040]: cluster 2024-09-14T04:24:55.359679+0000 mgr.a (mgr.14355) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:24:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:59 smithi007 bash[22722]: cluster 2024-09-14T04:24:57.361009+0000 mgr.a (mgr.14355) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:24:59 smithi007 bash[22722]: audit 2024-09-14T04:24:58.228178+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:24:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:59 smithi131 bash[24745]: cluster 2024-09-14T04:24:57.361009+0000 mgr.a (mgr.14355) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:24:59 smithi131 bash[24745]: audit 2024-09-14T04:24:58.228178+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:24:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:59 smithi171 bash[25040]: cluster 2024-09-14T04:24:57.361009+0000 mgr.a (mgr.14355) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:24:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:24:59 smithi171 bash[25040]: audit 2024-09-14T04:24:58.228178+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:24:59.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:24:59.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:24:59.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:00.767 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:00.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:01 smithi007 bash[22722]: cluster 2024-09-14T04:24:59.361773+0000 mgr.a (mgr.14355) 15743 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:01 smithi131 bash[24745]: cluster 2024-09-14T04:24:59.361773+0000 mgr.a (mgr.14355) 15743 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:01 smithi171 bash[25040]: cluster 2024-09-14T04:24:59.361773+0000 mgr.a (mgr.14355) 15743 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:02 smithi007 bash[22722]: audit 2024-09-14T04:25:00.329139+0000 mgr.a (mgr.14355) 15744 : audit [DBG] from='client.340014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:02 smithi131 bash[24745]: audit 2024-09-14T04:25:00.329139+0000 mgr.a (mgr.14355) 15744 : audit [DBG] from='client.340014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:02 smithi171 bash[25040]: audit 2024-09-14T04:25:00.329139+0000 mgr.a (mgr.14355) 15744 : audit [DBG] from='client.340014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:03 smithi007 bash[22722]: cluster 2024-09-14T04:25:01.364696+0000 mgr.a (mgr.14355) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:03 smithi131 bash[24745]: cluster 2024-09-14T04:25:01.364696+0000 mgr.a (mgr.14355) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:03 smithi171 bash[25040]: cluster 2024-09-14T04:25:01.364696+0000 mgr.a (mgr.14355) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:05 smithi171 bash[25040]: cluster 2024-09-14T04:25:03.365494+0000 mgr.a (mgr.14355) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:05.384 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:05 smithi131 bash[24745]: cluster 2024-09-14T04:25:03.365494+0000 mgr.a (mgr.14355) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:05 smithi007 bash[22722]: cluster 2024-09-14T04:25:03.365494+0000 mgr.a (mgr.14355) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:05.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:06.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:06.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:07 smithi131 bash[24745]: cluster 2024-09-14T04:25:05.367055+0000 mgr.a (mgr.14355) 15747 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:07.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:07 smithi131 bash[24745]: audit 2024-09-14T04:25:06.104062+0000 mgr.a (mgr.14355) 15748 : audit [DBG] from='client.340089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:07 smithi007 bash[22722]: cluster 2024-09-14T04:25:05.367055+0000 mgr.a (mgr.14355) 15747 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:07 smithi007 bash[22722]: audit 2024-09-14T04:25:06.104062+0000 mgr.a (mgr.14355) 15748 : audit [DBG] from='client.340089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:07 smithi171 bash[25040]: cluster 2024-09-14T04:25:05.367055+0000 mgr.a (mgr.14355) 15747 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:07.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:07 smithi171 bash[25040]: audit 2024-09-14T04:25:06.104062+0000 mgr.a (mgr.14355) 15748 : audit [DBG] from='client.340089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: cluster 2024-09-14T04:25:07.368849+0000 mgr.a (mgr.14355) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.420054+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.428484+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.703391+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.711994+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.714680+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:25:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.716963+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:25:09.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.728321+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22722]: audit 2024-09-14T04:25:08.733751+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: cluster 2024-09-14T04:25:07.368849+0000 mgr.a (mgr.14355) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.420054+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.428484+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.703391+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.711994+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.714680+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.716963+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.728321+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:09 smithi131 bash[24745]: audit 2024-09-14T04:25:08.733751+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: cluster 2024-09-14T04:25:07.368849+0000 mgr.a (mgr.14355) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:25:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.420054+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.428484+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.703391+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.711994+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.714680+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:25:09.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.716963+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:25:09.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.728321+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:25:09.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:09 smithi171 bash[25040]: audit 2024-09-14T04:25:08.733751+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:09.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22972]: debug 2024-09-14T04:25:09.502+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:25:09.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:25:09 smithi007 bash[22972]: debug 2024-09-14T04:25:09.502+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:25:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:10 smithi007 bash[22722]: audit 2024-09-14T04:25:08.736315+0000 mgr.a (mgr.14355) 15750 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:10 smithi131 bash[24745]: audit 2024-09-14T04:25:08.736315+0000 mgr.a (mgr.14355) 15750 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:10 smithi171 bash[25040]: audit 2024-09-14T04:25:08.736315+0000 mgr.a (mgr.14355) 15750 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:25:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:11 smithi007 bash[22722]: cluster 2024-09-14T04:25:09.369357+0000 mgr.a (mgr.14355) 15751 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:11 smithi007 bash[22722]: audit 2024-09-14T04:25:09.503074+0000 mgr.a (mgr.14355) 15752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:25:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:11 smithi007 bash[22722]: cephadm 2024-09-14T04:25:09.504379+0000 mgr.a (mgr.14355) 15753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:25:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:11 smithi131 bash[24745]: cluster 2024-09-14T04:25:09.369357+0000 mgr.a (mgr.14355) 15751 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:11 smithi131 bash[24745]: audit 2024-09-14T04:25:09.503074+0000 mgr.a (mgr.14355) 15752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:25:11.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:11 smithi131 bash[24745]: cephadm 2024-09-14T04:25:09.504379+0000 mgr.a (mgr.14355) 15753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:25:11.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:11.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:11.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:11 smithi171 bash[25040]: cluster 2024-09-14T04:25:09.369357+0000 mgr.a (mgr.14355) 15751 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:11 smithi171 bash[25040]: audit 2024-09-14T04:25:09.503074+0000 mgr.a (mgr.14355) 15752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:25:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:11 smithi171 bash[25040]: cephadm 2024-09-14T04:25:09.504379+0000 mgr.a (mgr.14355) 15753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:25:12.322 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:12.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:12.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:12.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:12 smithi007 bash[22722]: cluster 2024-09-14T04:25:11.371617+0000 mgr.a (mgr.14355) 15754 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:12 smithi007 bash[22722]: audit 2024-09-14T04:25:11.879498+0000 mgr.a (mgr.14355) 15755 : audit [DBG] from='client.340272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:12 smithi131 bash[24745]: cluster 2024-09-14T04:25:11.371617+0000 mgr.a (mgr.14355) 15754 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:12 smithi131 bash[24745]: audit 2024-09-14T04:25:11.879498+0000 mgr.a (mgr.14355) 15755 : audit [DBG] from='client.340272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:12 smithi171 bash[25040]: cluster 2024-09-14T04:25:11.371617+0000 mgr.a (mgr.14355) 15754 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:12 smithi171 bash[25040]: audit 2024-09-14T04:25:11.879498+0000 mgr.a (mgr.14355) 15755 : audit [DBG] from='client.340272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:14 smithi007 bash[22722]: cluster 2024-09-14T04:25:13.372716+0000 mgr.a (mgr.14355) 15756 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:14 smithi131 bash[24745]: cluster 2024-09-14T04:25:13.372716+0000 mgr.a (mgr.14355) 15756 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:14 smithi171 bash[25040]: cluster 2024-09-14T04:25:13.372716+0000 mgr.a (mgr.14355) 15756 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 186 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:16 smithi007 bash[22722]: cluster 2024-09-14T04:25:15.374695+0000 mgr.a (mgr.14355) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:16 smithi131 bash[24745]: cluster 2024-09-14T04:25:15.374695+0000 mgr.a (mgr.14355) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:16 smithi171 bash[25040]: cluster 2024-09-14T04:25:15.374695+0000 mgr.a (mgr.14355) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:18.073 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:18 smithi007 bash[22722]: cluster 2024-09-14T04:25:17.375984+0000 mgr.a (mgr.14355) 15758 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:18 smithi007 bash[22722]: audit 2024-09-14T04:25:17.657216+0000 mgr.a (mgr.14355) 15759 : audit [DBG] from='client.340350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:18 smithi131 bash[24745]: cluster 2024-09-14T04:25:17.375984+0000 mgr.a (mgr.14355) 15758 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:18 smithi131 bash[24745]: audit 2024-09-14T04:25:17.657216+0000 mgr.a (mgr.14355) 15759 : audit [DBG] from='client.340350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:18 smithi171 bash[25040]: cluster 2024-09-14T04:25:17.375984+0000 mgr.a (mgr.14355) 15758 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:18 smithi171 bash[25040]: audit 2024-09-14T04:25:17.657216+0000 mgr.a (mgr.14355) 15759 : audit [DBG] from='client.340350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:20 smithi007 bash[22722]: cluster 2024-09-14T04:25:19.376919+0000 mgr.a (mgr.14355) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:20 smithi131 bash[24745]: cluster 2024-09-14T04:25:19.376919+0000 mgr.a (mgr.14355) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:20 smithi171 bash[25040]: cluster 2024-09-14T04:25:19.376919+0000 mgr.a (mgr.14355) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:22 smithi007 bash[22722]: cluster 2024-09-14T04:25:21.379358+0000 mgr.a (mgr.14355) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:22 smithi131 bash[24745]: cluster 2024-09-14T04:25:21.379358+0000 mgr.a (mgr.14355) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:22 smithi171 bash[25040]: cluster 2024-09-14T04:25:21.379358+0000 mgr.a (mgr.14355) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:25:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:23.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:23.826 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:23.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:23.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:24 smithi007 bash[22722]: cluster 2024-09-14T04:25:23.380077+0000 mgr.a (mgr.14355) 15762 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:24 smithi007 bash[22722]: audit 2024-09-14T04:25:23.403619+0000 mgr.a (mgr.14355) 15763 : audit [DBG] from='client.340428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:24 smithi131 bash[24745]: cluster 2024-09-14T04:25:23.380077+0000 mgr.a (mgr.14355) 15762 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:24.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:24 smithi131 bash[24745]: audit 2024-09-14T04:25:23.403619+0000 mgr.a (mgr.14355) 15763 : audit [DBG] from='client.340428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:24 smithi171 bash[25040]: cluster 2024-09-14T04:25:23.380077+0000 mgr.a (mgr.14355) 15762 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:24 smithi171 bash[25040]: audit 2024-09-14T04:25:23.403619+0000 mgr.a (mgr.14355) 15763 : audit [DBG] from='client.340428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:26 smithi131 bash[24745]: cluster 2024-09-14T04:25:25.381953+0000 mgr.a (mgr.14355) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:26 smithi171 bash[25040]: cluster 2024-09-14T04:25:25.381953+0000 mgr.a (mgr.14355) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:26 smithi007 bash[22722]: cluster 2024-09-14T04:25:25.381953+0000 mgr.a (mgr.14355) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:28 smithi131 bash[24745]: cluster 2024-09-14T04:25:27.383218+0000 mgr.a (mgr.14355) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:28 smithi171 bash[25040]: cluster 2024-09-14T04:25:27.383218+0000 mgr.a (mgr.14355) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:28.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:28.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:28.828 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:28 smithi007 bash[22722]: cluster 2024-09-14T04:25:27.383218+0000 mgr.a (mgr.14355) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:29.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:29.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:30 smithi131 bash[24745]: audit 2024-09-14T04:25:29.160926+0000 mgr.a (mgr.14355) 15766 : audit [DBG] from='client.340506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:30 smithi131 bash[24745]: cluster 2024-09-14T04:25:29.383863+0000 mgr.a (mgr.14355) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:30 smithi171 bash[25040]: audit 2024-09-14T04:25:29.160926+0000 mgr.a (mgr.14355) 15766 : audit [DBG] from='client.340506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:30 smithi171 bash[25040]: cluster 2024-09-14T04:25:29.383863+0000 mgr.a (mgr.14355) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:30.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:30 smithi007 bash[22722]: audit 2024-09-14T04:25:29.160926+0000 mgr.a (mgr.14355) 15766 : audit [DBG] from='client.340506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:30.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:30 smithi007 bash[22722]: cluster 2024-09-14T04:25:29.383863+0000 mgr.a (mgr.14355) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:32 smithi131 bash[24745]: cluster 2024-09-14T04:25:31.386239+0000 mgr.a (mgr.14355) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:32 smithi171 bash[25040]: cluster 2024-09-14T04:25:31.386239+0000 mgr.a (mgr.14355) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:32 smithi007 bash[22722]: cluster 2024-09-14T04:25:31.386239+0000 mgr.a (mgr.14355) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:34.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:34 smithi131 bash[24745]: cluster 2024-09-14T04:25:33.387048+0000 mgr.a (mgr.14355) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:34 smithi171 bash[25040]: cluster 2024-09-14T04:25:33.387048+0000 mgr.a (mgr.14355) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:34 smithi007 bash[22722]: cluster 2024-09-14T04:25:33.387048+0000 mgr.a (mgr.14355) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:35.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:35.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:35 smithi131 bash[24745]: audit 2024-09-14T04:25:34.945151+0000 mgr.a (mgr.14355) 15770 : audit [DBG] from='client.340584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:35 smithi171 bash[25040]: audit 2024-09-14T04:25:34.945151+0000 mgr.a (mgr.14355) 15770 : audit [DBG] from='client.340584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:35.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:35 smithi007 bash[22722]: audit 2024-09-14T04:25:34.945151+0000 mgr.a (mgr.14355) 15770 : audit [DBG] from='client.340584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:36 smithi131 bash[24745]: cluster 2024-09-14T04:25:35.388151+0000 mgr.a (mgr.14355) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:25:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:36 smithi171 bash[25040]: cluster 2024-09-14T04:25:35.388151+0000 mgr.a (mgr.14355) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:25:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:36 smithi007 bash[22722]: cluster 2024-09-14T04:25:35.388151+0000 mgr.a (mgr.14355) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:25:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:38 smithi131 bash[24745]: cluster 2024-09-14T04:25:37.389370+0000 mgr.a (mgr.14355) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:38 smithi171 bash[25040]: cluster 2024-09-14T04:25:37.389370+0000 mgr.a (mgr.14355) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:38 smithi007 bash[22722]: cluster 2024-09-14T04:25:37.389370+0000 mgr.a (mgr.14355) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:40.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:40.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:40 smithi131 bash[24745]: cluster 2024-09-14T04:25:39.390151+0000 mgr.a (mgr.14355) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:40 smithi171 bash[25040]: cluster 2024-09-14T04:25:39.390151+0000 mgr.a (mgr.14355) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:40 smithi007 bash[22722]: cluster 2024-09-14T04:25:39.390151+0000 mgr.a (mgr.14355) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:25:41.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:41.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:41.129 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:41 smithi131 bash[24745]: audit 2024-09-14T04:25:40.707301+0000 mgr.a (mgr.14355) 15774 : audit [DBG] from='client.340662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:41 smithi171 bash[25040]: audit 2024-09-14T04:25:40.707301+0000 mgr.a (mgr.14355) 15774 : audit [DBG] from='client.340662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:41.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:41 smithi007 bash[22722]: audit 2024-09-14T04:25:40.707301+0000 mgr.a (mgr.14355) 15774 : audit [DBG] from='client.340662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:42 smithi131 bash[24745]: cluster 2024-09-14T04:25:41.392930+0000 mgr.a (mgr.14355) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:42 smithi171 bash[25040]: cluster 2024-09-14T04:25:41.392930+0000 mgr.a (mgr.14355) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:42 smithi007 bash[22722]: cluster 2024-09-14T04:25:41.392930+0000 mgr.a (mgr.14355) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:44 smithi131 bash[24745]: cluster 2024-09-14T04:25:43.393712+0000 mgr.a (mgr.14355) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:44.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:44 smithi171 bash[25040]: cluster 2024-09-14T04:25:43.393712+0000 mgr.a (mgr.14355) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:44 smithi007 bash[22722]: cluster 2024-09-14T04:25:43.393712+0000 mgr.a (mgr.14355) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:25:46.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:46.131 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:46 smithi131 bash[24745]: cluster 2024-09-14T04:25:45.395305+0000 mgr.a (mgr.14355) 15777 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:46 smithi171 bash[25040]: cluster 2024-09-14T04:25:45.395305+0000 mgr.a (mgr.14355) 15777 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:46.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:46.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:46 smithi007 bash[22722]: cluster 2024-09-14T04:25:45.395305+0000 mgr.a (mgr.14355) 15777 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:47 smithi131 bash[24745]: audit 2024-09-14T04:25:46.460505+0000 mgr.a (mgr.14355) 15778 : audit [DBG] from='client.340734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:47.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:47 smithi171 bash[25040]: audit 2024-09-14T04:25:46.460505+0000 mgr.a (mgr.14355) 15778 : audit [DBG] from='client.340734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:47.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:47 smithi007 bash[22722]: audit 2024-09-14T04:25:46.460505+0000 mgr.a (mgr.14355) 15778 : audit [DBG] from='client.340734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:48 smithi131 bash[24745]: cluster 2024-09-14T04:25:47.397276+0000 mgr.a (mgr.14355) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:48 smithi171 bash[25040]: cluster 2024-09-14T04:25:47.397276+0000 mgr.a (mgr.14355) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:48.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:48 smithi007 bash[22722]: cluster 2024-09-14T04:25:47.397276+0000 mgr.a (mgr.14355) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:25:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:50 smithi131 bash[24745]: cluster 2024-09-14T04:25:49.398122+0000 mgr.a (mgr.14355) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:25:51.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:50 smithi171 bash[25040]: cluster 2024-09-14T04:25:49.398122+0000 mgr.a (mgr.14355) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:25:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:50 smithi007 bash[22722]: cluster 2024-09-14T04:25:49.398122+0000 mgr.a (mgr.14355) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:25:51.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:51.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:52.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:52 smithi131 bash[24745]: cluster 2024-09-14T04:25:51.400230+0000 mgr.a (mgr.14355) 15781 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:25:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:52 smithi171 bash[25040]: cluster 2024-09-14T04:25:51.400230+0000 mgr.a (mgr.14355) 15781 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:25:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:52 smithi007 bash[22722]: cluster 2024-09-14T04:25:51.400230+0000 mgr.a (mgr.14355) 15781 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:25:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:53 smithi131 bash[24745]: audit 2024-09-14T04:25:52.210005+0000 mgr.a (mgr.14355) 15782 : audit [DBG] from='client.340809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:53 smithi171 bash[25040]: audit 2024-09-14T04:25:52.210005+0000 mgr.a (mgr.14355) 15782 : audit [DBG] from='client.340809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:53 smithi007 bash[22722]: audit 2024-09-14T04:25:52.210005+0000 mgr.a (mgr.14355) 15782 : audit [DBG] from='client.340809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:54 smithi131 bash[24745]: cluster 2024-09-14T04:25:53.401099+0000 mgr.a (mgr.14355) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:54 smithi171 bash[25040]: cluster 2024-09-14T04:25:53.401099+0000 mgr.a (mgr.14355) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:54 smithi007 bash[22722]: cluster 2024-09-14T04:25:53.401099+0000 mgr.a (mgr.14355) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:25:57.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:56 smithi131 bash[24745]: cluster 2024-09-14T04:25:55.402892+0000 mgr.a (mgr.14355) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:56 smithi171 bash[25040]: cluster 2024-09-14T04:25:55.402892+0000 mgr.a (mgr.14355) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:56 smithi007 bash[22722]: cluster 2024-09-14T04:25:55.402892+0000 mgr.a (mgr.14355) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:25:57.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:25:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:25:57.627 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:25:58.397 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:25:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:25:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:25:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:25:58.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:25:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:58 smithi131 bash[24745]: cluster 2024-09-14T04:25:57.404339+0000 mgr.a (mgr.14355) 15785 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:59.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:25:58 smithi131 bash[24745]: audit 2024-09-14T04:25:57.961099+0000 mgr.a (mgr.14355) 15786 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:58 smithi171 bash[25040]: cluster 2024-09-14T04:25:57.404339+0000 mgr.a (mgr.14355) 15785 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:25:58 smithi171 bash[25040]: audit 2024-09-14T04:25:57.961099+0000 mgr.a (mgr.14355) 15786 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:25:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:58 smithi007 bash[22722]: cluster 2024-09-14T04:25:57.404339+0000 mgr.a (mgr.14355) 15785 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:25:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:25:58 smithi007 bash[22722]: audit 2024-09-14T04:25:57.961099+0000 mgr.a (mgr.14355) 15786 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:00 smithi131 bash[24745]: cluster 2024-09-14T04:25:59.405447+0000 mgr.a (mgr.14355) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:00 smithi171 bash[25040]: cluster 2024-09-14T04:25:59.405447+0000 mgr.a (mgr.14355) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:00 smithi007 bash[22722]: cluster 2024-09-14T04:25:59.405447+0000 mgr.a (mgr.14355) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:02 smithi131 bash[24745]: cluster 2024-09-14T04:26:01.407907+0000 mgr.a (mgr.14355) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:02 smithi171 bash[25040]: cluster 2024-09-14T04:26:01.407907+0000 mgr.a (mgr.14355) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:03.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:03.399 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:02 smithi007 bash[22722]: cluster 2024-09-14T04:26:01.407907+0000 mgr.a (mgr.14355) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:04.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:04.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:04 smithi131 bash[24745]: cluster 2024-09-14T04:26:03.408508+0000 mgr.a (mgr.14355) 15789 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:05.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:04 smithi131 bash[24745]: audit 2024-09-14T04:26:03.739592+0000 mgr.a (mgr.14355) 15790 : audit [DBG] from='client.340959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:04 smithi171 bash[25040]: cluster 2024-09-14T04:26:03.408508+0000 mgr.a (mgr.14355) 15789 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:04 smithi171 bash[25040]: audit 2024-09-14T04:26:03.739592+0000 mgr.a (mgr.14355) 15790 : audit [DBG] from='client.340959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:04 smithi007 bash[22722]: cluster 2024-09-14T04:26:03.408508+0000 mgr.a (mgr.14355) 15789 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:04 smithi007 bash[22722]: audit 2024-09-14T04:26:03.739592+0000 mgr.a (mgr.14355) 15790 : audit [DBG] from='client.340959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:07 smithi131 bash[24745]: cluster 2024-09-14T04:26:05.410337+0000 mgr.a (mgr.14355) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:07.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:07 smithi171 bash[25040]: cluster 2024-09-14T04:26:05.410337+0000 mgr.a (mgr.14355) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:06 smithi007 bash[22722]: cluster 2024-09-14T04:26:05.410337+0000 mgr.a (mgr.14355) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:09.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:09 smithi131 bash[24745]: cluster 2024-09-14T04:26:07.411601+0000 mgr.a (mgr.14355) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:09.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:09 smithi171 bash[25040]: cluster 2024-09-14T04:26:07.411601+0000 mgr.a (mgr.14355) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:09 smithi007 bash[22722]: cluster 2024-09-14T04:26:07.411601+0000 mgr.a (mgr.14355) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:09.980 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:10.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:10 smithi131 bash[24745]: audit 2024-09-14T04:26:09.563720+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:26:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:10 smithi171 bash[25040]: audit 2024-09-14T04:26:09.563720+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:26:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:10 smithi007 bash[22722]: audit 2024-09-14T04:26:09.563720+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: cluster 2024-09-14T04:26:09.412099+0000 mgr.a (mgr.14355) 15793 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: audit 2024-09-14T04:26:09.525355+0000 mgr.a (mgr.14355) 15794 : audit [DBG] from='client.341037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: audit 2024-09-14T04:26:10.441365+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: audit 2024-09-14T04:26:10.442943+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: audit 2024-09-14T04:26:10.450967+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:26:11.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:11 smithi131 bash[24745]: audit 2024-09-14T04:26:10.453770+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: cluster 2024-09-14T04:26:09.412099+0000 mgr.a (mgr.14355) 15793 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: audit 2024-09-14T04:26:09.525355+0000 mgr.a (mgr.14355) 15794 : audit [DBG] from='client.341037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: audit 2024-09-14T04:26:10.441365+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: audit 2024-09-14T04:26:10.442943+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: audit 2024-09-14T04:26:10.450967+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:26:11.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:11 smithi171 bash[25040]: audit 2024-09-14T04:26:10.453770+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22972]: debug 2024-09-14T04:26:11.189+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22972]: debug 2024-09-14T04:26:11.189+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: cluster 2024-09-14T04:26:09.412099+0000 mgr.a (mgr.14355) 15793 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: audit 2024-09-14T04:26:09.525355+0000 mgr.a (mgr.14355) 15794 : audit [DBG] from='client.341037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: audit 2024-09-14T04:26:10.441365+0000 mon.a (mon.0) 2948 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: audit 2024-09-14T04:26:10.442943+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: audit 2024-09-14T04:26:10.450967+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:26:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:11 smithi007 bash[22722]: audit 2024-09-14T04:26:10.453770+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:12 smithi131 bash[24745]: audit 2024-09-14T04:26:10.456285+0000 mgr.a (mgr.14355) 15795 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:12 smithi171 bash[25040]: audit 2024-09-14T04:26:10.456285+0000 mgr.a (mgr.14355) 15795 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:12.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:12 smithi007 bash[22722]: audit 2024-09-14T04:26:10.456285+0000 mgr.a (mgr.14355) 15795 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:26:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:13 smithi131 bash[24745]: audit 2024-09-14T04:26:11.191128+0000 mgr.a (mgr.14355) 15796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:26:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:13 smithi131 bash[24745]: cephadm 2024-09-14T04:26:11.192517+0000 mgr.a (mgr.14355) 15797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:26:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:13 smithi131 bash[24745]: cluster 2024-09-14T04:26:11.414898+0000 mgr.a (mgr.14355) 15798 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:13 smithi171 bash[25040]: audit 2024-09-14T04:26:11.191128+0000 mgr.a (mgr.14355) 15796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:26:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:13 smithi171 bash[25040]: cephadm 2024-09-14T04:26:11.192517+0000 mgr.a (mgr.14355) 15797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:26:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:13 smithi171 bash[25040]: cluster 2024-09-14T04:26:11.414898+0000 mgr.a (mgr.14355) 15798 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:13 smithi007 bash[22722]: audit 2024-09-14T04:26:11.191128+0000 mgr.a (mgr.14355) 15796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:26:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:13 smithi007 bash[22722]: cephadm 2024-09-14T04:26:11.192517+0000 mgr.a (mgr.14355) 15797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:26:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:13 smithi007 bash[22722]: cluster 2024-09-14T04:26:11.414898+0000 mgr.a (mgr.14355) 15798 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:14.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:15 smithi131 bash[24745]: cluster 2024-09-14T04:26:13.415810+0000 mgr.a (mgr.14355) 15799 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:15.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:15 smithi171 bash[25040]: cluster 2024-09-14T04:26:13.415810+0000 mgr.a (mgr.14355) 15799 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:15 smithi007 bash[22722]: cluster 2024-09-14T04:26:13.415810+0000 mgr.a (mgr.14355) 15799 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:15.738 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:17 smithi171 bash[25040]: audit 2024-09-14T04:26:15.315306+0000 mgr.a (mgr.14355) 15800 : audit [DBG] from='client.341223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:17.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:17 smithi171 bash[25040]: cluster 2024-09-14T04:26:15.416908+0000 mgr.a (mgr.14355) 15801 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:17 smithi007 bash[22722]: audit 2024-09-14T04:26:15.315306+0000 mgr.a (mgr.14355) 15800 : audit [DBG] from='client.341223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:17 smithi007 bash[22722]: cluster 2024-09-14T04:26:15.416908+0000 mgr.a (mgr.14355) 15801 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:17 smithi131 bash[24745]: audit 2024-09-14T04:26:15.315306+0000 mgr.a (mgr.14355) 15800 : audit [DBG] from='client.341223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:17.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:17 smithi131 bash[24745]: cluster 2024-09-14T04:26:15.416908+0000 mgr.a (mgr.14355) 15801 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:19 smithi171 bash[25040]: cluster 2024-09-14T04:26:17.418647+0000 mgr.a (mgr.14355) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:19 smithi007 bash[22722]: cluster 2024-09-14T04:26:17.418647+0000 mgr.a (mgr.14355) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:19 smithi131 bash[24745]: cluster 2024-09-14T04:26:17.418647+0000 mgr.a (mgr.14355) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:20.740 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:20.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:20.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:21 smithi171 bash[25040]: cluster 2024-09-14T04:26:19.419452+0000 mgr.a (mgr.14355) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:21 smithi007 bash[22722]: cluster 2024-09-14T04:26:19.419452+0000 mgr.a (mgr.14355) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:21.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:21.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:21 smithi131 bash[24745]: cluster 2024-09-14T04:26:19.419452+0000 mgr.a (mgr.14355) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:22 smithi007 bash[22722]: audit 2024-09-14T04:26:21.070895+0000 mgr.a (mgr.14355) 15804 : audit [DBG] from='client.341298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:22 smithi131 bash[24745]: audit 2024-09-14T04:26:21.070895+0000 mgr.a (mgr.14355) 15804 : audit [DBG] from='client.341298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:22 smithi171 bash[25040]: audit 2024-09-14T04:26:21.070895+0000 mgr.a (mgr.14355) 15804 : audit [DBG] from='client.341298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:23 smithi007 bash[22722]: cluster 2024-09-14T04:26:21.420774+0000 mgr.a (mgr.14355) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:26:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:23 smithi131 bash[24745]: cluster 2024-09-14T04:26:21.420774+0000 mgr.a (mgr.14355) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:26:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:23 smithi171 bash[25040]: cluster 2024-09-14T04:26:21.420774+0000 mgr.a (mgr.14355) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:26:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:25 smithi007 bash[22722]: cluster 2024-09-14T04:26:23.421517+0000 mgr.a (mgr.14355) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:25 smithi131 bash[24745]: cluster 2024-09-14T04:26:23.421517+0000 mgr.a (mgr.14355) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:25 smithi171 bash[25040]: cluster 2024-09-14T04:26:23.421517+0000 mgr.a (mgr.14355) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:26.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:26.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:27 smithi007 bash[22722]: cluster 2024-09-14T04:26:25.423064+0000 mgr.a (mgr.14355) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:27 smithi131 bash[24745]: cluster 2024-09-14T04:26:25.423064+0000 mgr.a (mgr.14355) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:27 smithi171 bash[25040]: cluster 2024-09-14T04:26:25.423064+0000 mgr.a (mgr.14355) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:26:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:28 smithi007 bash[22722]: audit 2024-09-14T04:26:26.830286+0000 mgr.a (mgr.14355) 15808 : audit [DBG] from='client.341376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:28 smithi131 bash[24745]: audit 2024-09-14T04:26:26.830286+0000 mgr.a (mgr.14355) 15808 : audit [DBG] from='client.341376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:28 smithi171 bash[25040]: audit 2024-09-14T04:26:26.830286+0000 mgr.a (mgr.14355) 15808 : audit [DBG] from='client.341376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:29 smithi007 bash[22722]: cluster 2024-09-14T04:26:27.424974+0000 mgr.a (mgr.14355) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:26:29.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:29 smithi131 bash[24745]: cluster 2024-09-14T04:26:27.424974+0000 mgr.a (mgr.14355) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:26:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:29 smithi171 bash[25040]: cluster 2024-09-14T04:26:27.424974+0000 mgr.a (mgr.14355) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:26:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:31 smithi007 bash[22722]: cluster 2024-09-14T04:26:29.425766+0000 mgr.a (mgr.14355) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:31 smithi131 bash[24745]: cluster 2024-09-14T04:26:29.425766+0000 mgr.a (mgr.14355) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:31 smithi171 bash[25040]: cluster 2024-09-14T04:26:29.425766+0000 mgr.a (mgr.14355) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:32.264 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:32.265 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:33.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:33.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:33.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:33.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:33.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:33 smithi007 bash[22722]: cluster 2024-09-14T04:26:31.427859+0000 mgr.a (mgr.14355) 15811 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:33 smithi131 bash[24745]: cluster 2024-09-14T04:26:31.427859+0000 mgr.a (mgr.14355) 15811 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:33 smithi171 bash[25040]: cluster 2024-09-14T04:26:31.427859+0000 mgr.a (mgr.14355) 15811 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:34.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:34 smithi007 bash[22722]: audit 2024-09-14T04:26:32.601574+0000 mgr.a (mgr.14355) 15812 : audit [DBG] from='client.341448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:34 smithi131 bash[24745]: audit 2024-09-14T04:26:32.601574+0000 mgr.a (mgr.14355) 15812 : audit [DBG] from='client.341448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:34 smithi171 bash[25040]: audit 2024-09-14T04:26:32.601574+0000 mgr.a (mgr.14355) 15812 : audit [DBG] from='client.341448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:35 smithi007 bash[22722]: cluster 2024-09-14T04:26:33.428761+0000 mgr.a (mgr.14355) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:35 smithi131 bash[24745]: cluster 2024-09-14T04:26:33.428761+0000 mgr.a (mgr.14355) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:35 smithi171 bash[25040]: cluster 2024-09-14T04:26:33.428761+0000 mgr.a (mgr.14355) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:37 smithi007 bash[22722]: cluster 2024-09-14T04:26:35.430547+0000 mgr.a (mgr.14355) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:37 smithi131 bash[24745]: cluster 2024-09-14T04:26:35.430547+0000 mgr.a (mgr.14355) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:37 smithi171 bash[25040]: cluster 2024-09-14T04:26:35.430547+0000 mgr.a (mgr.14355) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:38.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:38.822 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:38.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:38.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:38.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:38.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:39 smithi007 bash[22722]: cluster 2024-09-14T04:26:37.431836+0000 mgr.a (mgr.14355) 15815 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:39 smithi131 bash[24745]: cluster 2024-09-14T04:26:37.431836+0000 mgr.a (mgr.14355) 15815 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:39.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:39 smithi171 bash[25040]: cluster 2024-09-14T04:26:37.431836+0000 mgr.a (mgr.14355) 15815 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:40 smithi007 bash[22722]: audit 2024-09-14T04:26:38.376601+0000 mgr.a (mgr.14355) 15816 : audit [DBG] from='client.341526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:40 smithi131 bash[24745]: audit 2024-09-14T04:26:38.376601+0000 mgr.a (mgr.14355) 15816 : audit [DBG] from='client.341526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:40 smithi171 bash[25040]: audit 2024-09-14T04:26:38.376601+0000 mgr.a (mgr.14355) 15816 : audit [DBG] from='client.341526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:41 smithi007 bash[22722]: cluster 2024-09-14T04:26:39.432743+0000 mgr.a (mgr.14355) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:41 smithi131 bash[24745]: cluster 2024-09-14T04:26:39.432743+0000 mgr.a (mgr.14355) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:41.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:41 smithi171 bash[25040]: cluster 2024-09-14T04:26:39.432743+0000 mgr.a (mgr.14355) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:43 smithi007 bash[22722]: cluster 2024-09-14T04:26:41.435064+0000 mgr.a (mgr.14355) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:43 smithi131 bash[24745]: cluster 2024-09-14T04:26:41.435064+0000 mgr.a (mgr.14355) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:43 smithi171 bash[25040]: cluster 2024-09-14T04:26:41.435064+0000 mgr.a (mgr.14355) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:44.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:44.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:45 smithi007 bash[22722]: cluster 2024-09-14T04:26:43.435830+0000 mgr.a (mgr.14355) 15819 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:45 smithi131 bash[24745]: cluster 2024-09-14T04:26:43.435830+0000 mgr.a (mgr.14355) 15819 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:45 smithi171 bash[25040]: cluster 2024-09-14T04:26:43.435830+0000 mgr.a (mgr.14355) 15819 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:46 smithi007 bash[22722]: audit 2024-09-14T04:26:44.159880+0000 mgr.a (mgr.14355) 15820 : audit [DBG] from='client.341604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:46 smithi131 bash[24745]: audit 2024-09-14T04:26:44.159880+0000 mgr.a (mgr.14355) 15820 : audit [DBG] from='client.341604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:46 smithi171 bash[25040]: audit 2024-09-14T04:26:44.159880+0000 mgr.a (mgr.14355) 15820 : audit [DBG] from='client.341604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:47 smithi007 bash[22722]: cluster 2024-09-14T04:26:45.437720+0000 mgr.a (mgr.14355) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:47 smithi131 bash[24745]: cluster 2024-09-14T04:26:45.437720+0000 mgr.a (mgr.14355) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:47 smithi171 bash[25040]: cluster 2024-09-14T04:26:45.437720+0000 mgr.a (mgr.14355) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:26:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:49 smithi007 bash[22722]: cluster 2024-09-14T04:26:47.439017+0000 mgr.a (mgr.14355) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:49 smithi131 bash[24745]: cluster 2024-09-14T04:26:47.439017+0000 mgr.a (mgr.14355) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:49 smithi171 bash[25040]: cluster 2024-09-14T04:26:47.439017+0000 mgr.a (mgr.14355) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:26:49.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:49.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:49.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:50.348 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:51 smithi007 bash[22722]: cluster 2024-09-14T04:26:49.439777+0000 mgr.a (mgr.14355) 15823 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:51 smithi007 bash[22722]: audit 2024-09-14T04:26:49.925861+0000 mgr.a (mgr.14355) 15824 : audit [DBG] from='client.341682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:51 smithi131 bash[24745]: cluster 2024-09-14T04:26:49.439777+0000 mgr.a (mgr.14355) 15823 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:51 smithi131 bash[24745]: audit 2024-09-14T04:26:49.925861+0000 mgr.a (mgr.14355) 15824 : audit [DBG] from='client.341682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:51 smithi171 bash[25040]: cluster 2024-09-14T04:26:49.439777+0000 mgr.a (mgr.14355) 15823 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:51 smithi171 bash[25040]: audit 2024-09-14T04:26:49.925861+0000 mgr.a (mgr.14355) 15824 : audit [DBG] from='client.341682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:53 smithi007 bash[22722]: cluster 2024-09-14T04:26:51.442128+0000 mgr.a (mgr.14355) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:26:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:53 smithi131 bash[24745]: cluster 2024-09-14T04:26:51.442128+0000 mgr.a (mgr.14355) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:26:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:53 smithi171 bash[25040]: cluster 2024-09-14T04:26:51.442128+0000 mgr.a (mgr.14355) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:26:55.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:26:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:26:55.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:26:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:55 smithi007 bash[22722]: cluster 2024-09-14T04:26:53.442896+0000 mgr.a (mgr.14355) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:26:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:55 smithi131 bash[24745]: cluster 2024-09-14T04:26:53.442896+0000 mgr.a (mgr.14355) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:26:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:55 smithi171 bash[25040]: cluster 2024-09-14T04:26:53.442896+0000 mgr.a (mgr.14355) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:26:56.097 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:26:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:26:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:26:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:26:56.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:26:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:57 smithi007 bash[22722]: cluster 2024-09-14T04:26:55.443837+0000 mgr.a (mgr.14355) 15827 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:57 smithi007 bash[22722]: audit 2024-09-14T04:26:55.676567+0000 mgr.a (mgr.14355) 15828 : audit [DBG] from='client.341760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:57 smithi131 bash[24745]: cluster 2024-09-14T04:26:55.443837+0000 mgr.a (mgr.14355) 15827 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:57 smithi131 bash[24745]: audit 2024-09-14T04:26:55.676567+0000 mgr.a (mgr.14355) 15828 : audit [DBG] from='client.341760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:57 smithi171 bash[25040]: cluster 2024-09-14T04:26:55.443837+0000 mgr.a (mgr.14355) 15827 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:26:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:57 smithi171 bash[25040]: audit 2024-09-14T04:26:55.676567+0000 mgr.a (mgr.14355) 15828 : audit [DBG] from='client.341760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:26:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:26:59 smithi007 bash[22722]: cluster 2024-09-14T04:26:57.445509+0000 mgr.a (mgr.14355) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:26:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:26:59 smithi131 bash[24745]: cluster 2024-09-14T04:26:57.445509+0000 mgr.a (mgr.14355) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:26:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:26:59 smithi171 bash[25040]: cluster 2024-09-14T04:26:57.445509+0000 mgr.a (mgr.14355) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:27:01.099 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:01.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:01.100 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:01 smithi007 bash[22722]: cluster 2024-09-14T04:26:59.446352+0000 mgr.a (mgr.14355) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:01 smithi131 bash[24745]: cluster 2024-09-14T04:26:59.446352+0000 mgr.a (mgr.14355) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:01.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:01 smithi171 bash[25040]: cluster 2024-09-14T04:26:59.446352+0000 mgr.a (mgr.14355) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:01.888 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:01.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:01.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:02 smithi007 bash[22722]: audit 2024-09-14T04:27:01.438730+0000 mgr.a (mgr.14355) 15831 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:02 smithi007 bash[22722]: cluster 2024-09-14T04:27:01.460799+0000 mgr.a (mgr.14355) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:02 smithi131 bash[24745]: audit 2024-09-14T04:27:01.438730+0000 mgr.a (mgr.14355) 15831 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:02.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:02 smithi131 bash[24745]: cluster 2024-09-14T04:27:01.460799+0000 mgr.a (mgr.14355) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:02 smithi171 bash[25040]: audit 2024-09-14T04:27:01.438730+0000 mgr.a (mgr.14355) 15831 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:02 smithi171 bash[25040]: cluster 2024-09-14T04:27:01.460799+0000 mgr.a (mgr.14355) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:04 smithi131 bash[24745]: cluster 2024-09-14T04:27:03.461743+0000 mgr.a (mgr.14355) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:27:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:04 smithi171 bash[25040]: cluster 2024-09-14T04:27:03.461743+0000 mgr.a (mgr.14355) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:27:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:04 smithi007 bash[22722]: cluster 2024-09-14T04:27:03.461743+0000 mgr.a (mgr.14355) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:27:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:06 smithi131 bash[24745]: cluster 2024-09-14T04:27:05.463956+0000 mgr.a (mgr.14355) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:27:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:06 smithi171 bash[25040]: cluster 2024-09-14T04:27:05.463956+0000 mgr.a (mgr.14355) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:27:06.889 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:06.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:06.890 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:06 smithi007 bash[22722]: cluster 2024-09-14T04:27:05.463956+0000 mgr.a (mgr.14355) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:27:07.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:08 smithi131 bash[24745]: audit 2024-09-14T04:27:07.223806+0000 mgr.a (mgr.14355) 15835 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:08 smithi131 bash[24745]: cluster 2024-09-14T04:27:07.464506+0000 mgr.a (mgr.14355) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:08 smithi171 bash[25040]: audit 2024-09-14T04:27:07.223806+0000 mgr.a (mgr.14355) 15835 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:08 smithi171 bash[25040]: cluster 2024-09-14T04:27:07.464506+0000 mgr.a (mgr.14355) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:08 smithi007 bash[22722]: audit 2024-09-14T04:27:07.223806+0000 mgr.a (mgr.14355) 15835 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:08 smithi007 bash[22722]: cluster 2024-09-14T04:27:07.464506+0000 mgr.a (mgr.14355) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:10 smithi131 bash[24745]: cluster 2024-09-14T04:27:09.465332+0000 mgr.a (mgr.14355) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:10 smithi171 bash[25040]: cluster 2024-09-14T04:27:09.465332+0000 mgr.a (mgr.14355) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:10 smithi007 bash[22722]: cluster 2024-09-14T04:27:09.465332+0000 mgr.a (mgr.14355) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:11 smithi171 bash[25040]: audit 2024-09-14T04:27:11.244513+0000 mon.a (mon.0) 2952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:27:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:11 smithi007 bash[22722]: audit 2024-09-14T04:27:11.244513+0000 mon.a (mon.0) 2952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:27:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:11 smithi131 bash[24745]: audit 2024-09-14T04:27:11.244513+0000 mon.a (mon.0) 2952 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:27:12.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:12.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:12.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:12.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:12 smithi171 bash[25040]: cluster 2024-09-14T04:27:11.467548+0000 mgr.a (mgr.14355) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:12 smithi007 bash[22722]: cluster 2024-09-14T04:27:11.467548+0000 mgr.a (mgr.14355) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:12 smithi131 bash[24745]: cluster 2024-09-14T04:27:11.467548+0000 mgr.a (mgr.14355) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22972]: debug 2024-09-14T04:27:13.344+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22972]: debug 2024-09-14T04:27:13.356+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.569992+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.575742+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.597884+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.601899+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.607647+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.611359+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.612391+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.613206+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.618335+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.620856+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.622036+0000 mgr.a (mgr.14355) 15839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:13.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:13 smithi007 bash[22722]: audit 2024-09-14T04:27:12.998603+0000 mgr.a (mgr.14355) 15840 : audit [DBG] from='client.342003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:13.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:13.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:13.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:13.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:13.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.569992+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.575742+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.597884+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.601899+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.607647+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.611359+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.612391+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:27:14.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.613206+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:27:14.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.618335+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.620856+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:14.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.622036+0000 mgr.a (mgr.14355) 15839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:14.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:13 smithi131 bash[24745]: audit 2024-09-14T04:27:12.998603+0000 mgr.a (mgr.14355) 15840 : audit [DBG] from='client.342003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.569992+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.575742+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.597884+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.601899+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.607647+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.611359+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.612391+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.613206+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.618335+0000 mon.a (mon.0) 2961 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.620856+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.622036+0000 mgr.a (mgr.14355) 15839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:27:14.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:13 smithi171 bash[25040]: audit 2024-09-14T04:27:12.998603+0000 mgr.a (mgr.14355) 15840 : audit [DBG] from='client.342003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:14 smithi007 bash[22722]: audit 2024-09-14T04:27:13.349311+0000 mgr.a (mgr.14355) 15841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:27:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:14 smithi007 bash[22722]: cephadm 2024-09-14T04:27:13.361066+0000 mgr.a (mgr.14355) 15842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:27:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:14 smithi007 bash[22722]: cluster 2024-09-14T04:27:13.468302+0000 mgr.a (mgr.14355) 15843 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:14 smithi131 bash[24745]: audit 2024-09-14T04:27:13.349311+0000 mgr.a (mgr.14355) 15841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:27:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:14 smithi131 bash[24745]: cephadm 2024-09-14T04:27:13.361066+0000 mgr.a (mgr.14355) 15842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:27:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:14 smithi131 bash[24745]: cluster 2024-09-14T04:27:13.468302+0000 mgr.a (mgr.14355) 15843 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:14 smithi171 bash[25040]: audit 2024-09-14T04:27:13.349311+0000 mgr.a (mgr.14355) 15841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:27:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:14 smithi171 bash[25040]: cephadm 2024-09-14T04:27:13.361066+0000 mgr.a (mgr.14355) 15842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:27:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:14 smithi171 bash[25040]: cluster 2024-09-14T04:27:13.468302+0000 mgr.a (mgr.14355) 15843 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:16 smithi007 bash[22722]: cluster 2024-09-14T04:27:15.470670+0000 mgr.a (mgr.14355) 15844 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:16 smithi131 bash[24745]: cluster 2024-09-14T04:27:15.470670+0000 mgr.a (mgr.14355) 15844 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:16 smithi171 bash[25040]: cluster 2024-09-14T04:27:15.470670+0000 mgr.a (mgr.14355) 15844 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:18.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:18.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:18.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:18 smithi007 bash[22722]: cluster 2024-09-14T04:27:17.471440+0000 mgr.a (mgr.14355) 15845 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:18 smithi131 bash[24745]: cluster 2024-09-14T04:27:17.471440+0000 mgr.a (mgr.14355) 15845 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:18 smithi171 bash[25040]: cluster 2024-09-14T04:27:17.471440+0000 mgr.a (mgr.14355) 15845 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:19.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:19.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:19.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:19 smithi007 bash[22722]: audit 2024-09-14T04:27:19.078778+0000 mgr.a (mgr.14355) 15846 : audit [DBG] from='client.342171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:19 smithi131 bash[24745]: audit 2024-09-14T04:27:19.078778+0000 mgr.a (mgr.14355) 15846 : audit [DBG] from='client.342171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:20.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:19 smithi171 bash[25040]: audit 2024-09-14T04:27:19.078778+0000 mgr.a (mgr.14355) 15846 : audit [DBG] from='client.342171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:20 smithi007 bash[22722]: cluster 2024-09-14T04:27:19.471961+0000 mgr.a (mgr.14355) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:20 smithi131 bash[24745]: cluster 2024-09-14T04:27:19.471961+0000 mgr.a (mgr.14355) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:20 smithi171 bash[25040]: cluster 2024-09-14T04:27:19.471961+0000 mgr.a (mgr.14355) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:22 smithi007 bash[22722]: cluster 2024-09-14T04:27:21.474156+0000 mgr.a (mgr.14355) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:22 smithi131 bash[24745]: cluster 2024-09-14T04:27:21.474156+0000 mgr.a (mgr.14355) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:22 smithi171 bash[25040]: cluster 2024-09-14T04:27:21.474156+0000 mgr.a (mgr.14355) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:24.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:24 smithi007 bash[22722]: cluster 2024-09-14T04:27:23.474913+0000 mgr.a (mgr.14355) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:24 smithi131 bash[24745]: cluster 2024-09-14T04:27:23.474913+0000 mgr.a (mgr.14355) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:24 smithi171 bash[25040]: cluster 2024-09-14T04:27:23.474913+0000 mgr.a (mgr.14355) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:25.268 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:25.268 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:25 smithi007 bash[22722]: audit 2024-09-14T04:27:24.830358+0000 mgr.a (mgr.14355) 15850 : audit [DBG] from='client.342246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:25 smithi131 bash[24745]: audit 2024-09-14T04:27:24.830358+0000 mgr.a (mgr.14355) 15850 : audit [DBG] from='client.342246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:25 smithi171 bash[25040]: audit 2024-09-14T04:27:24.830358+0000 mgr.a (mgr.14355) 15850 : audit [DBG] from='client.342246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:26 smithi007 bash[22722]: cluster 2024-09-14T04:27:25.477133+0000 mgr.a (mgr.14355) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:26 smithi131 bash[24745]: cluster 2024-09-14T04:27:25.477133+0000 mgr.a (mgr.14355) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:26 smithi171 bash[25040]: cluster 2024-09-14T04:27:25.477133+0000 mgr.a (mgr.14355) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:27:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:28 smithi007 bash[22722]: cluster 2024-09-14T04:27:27.477917+0000 mgr.a (mgr.14355) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:28 smithi131 bash[24745]: cluster 2024-09-14T04:27:27.477917+0000 mgr.a (mgr.14355) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:29.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:28 smithi171 bash[25040]: cluster 2024-09-14T04:27:27.477917+0000 mgr.a (mgr.14355) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:30.270 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:30.271 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:30 smithi007 bash[22722]: cluster 2024-09-14T04:27:29.478727+0000 mgr.a (mgr.14355) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:30 smithi131 bash[24745]: cluster 2024-09-14T04:27:29.478727+0000 mgr.a (mgr.14355) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:31.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:31.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:31.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:30 smithi171 bash[25040]: cluster 2024-09-14T04:27:29.478727+0000 mgr.a (mgr.14355) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:31.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:31 smithi007 bash[22722]: audit 2024-09-14T04:27:30.602078+0000 mgr.a (mgr.14355) 15854 : audit [DBG] from='client.342324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:31 smithi131 bash[24745]: audit 2024-09-14T04:27:30.602078+0000 mgr.a (mgr.14355) 15854 : audit [DBG] from='client.342324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:31 smithi171 bash[25040]: audit 2024-09-14T04:27:30.602078+0000 mgr.a (mgr.14355) 15854 : audit [DBG] from='client.342324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:32 smithi007 bash[22722]: cluster 2024-09-14T04:27:31.481468+0000 mgr.a (mgr.14355) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:32 smithi131 bash[24745]: cluster 2024-09-14T04:27:31.481468+0000 mgr.a (mgr.14355) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:32 smithi171 bash[25040]: cluster 2024-09-14T04:27:31.481468+0000 mgr.a (mgr.14355) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:34 smithi007 bash[22722]: cluster 2024-09-14T04:27:33.482318+0000 mgr.a (mgr.14355) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:34 smithi131 bash[24745]: cluster 2024-09-14T04:27:33.482318+0000 mgr.a (mgr.14355) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:35.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:34 smithi171 bash[25040]: cluster 2024-09-14T04:27:33.482318+0000 mgr.a (mgr.14355) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:36.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:36.817 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:36.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:36 smithi007 bash[22722]: cluster 2024-09-14T04:27:35.484300+0000 mgr.a (mgr.14355) 15857 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:36 smithi131 bash[24745]: cluster 2024-09-14T04:27:35.484300+0000 mgr.a (mgr.14355) 15857 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:36 smithi171 bash[25040]: cluster 2024-09-14T04:27:35.484300+0000 mgr.a (mgr.14355) 15857 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:37.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:37 smithi007 bash[22722]: audit 2024-09-14T04:27:36.381308+0000 mgr.a (mgr.14355) 15858 : audit [DBG] from='client.342399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:38.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:37 smithi131 bash[24745]: audit 2024-09-14T04:27:36.381308+0000 mgr.a (mgr.14355) 15858 : audit [DBG] from='client.342399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:37 smithi171 bash[25040]: audit 2024-09-14T04:27:36.381308+0000 mgr.a (mgr.14355) 15858 : audit [DBG] from='client.342399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:38 smithi007 bash[22722]: cluster 2024-09-14T04:27:37.485296+0000 mgr.a (mgr.14355) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:38 smithi131 bash[24745]: cluster 2024-09-14T04:27:37.485296+0000 mgr.a (mgr.14355) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:38 smithi171 bash[25040]: cluster 2024-09-14T04:27:37.485296+0000 mgr.a (mgr.14355) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:27:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:40 smithi007 bash[22722]: cluster 2024-09-14T04:27:39.486090+0000 mgr.a (mgr.14355) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:40 smithi131 bash[24745]: cluster 2024-09-14T04:27:39.486090+0000 mgr.a (mgr.14355) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:40 smithi171 bash[25040]: cluster 2024-09-14T04:27:39.486090+0000 mgr.a (mgr.14355) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:27:41.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:42.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:42 smithi131 bash[24745]: cluster 2024-09-14T04:27:41.488332+0000 mgr.a (mgr.14355) 15861 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:42 smithi131 bash[24745]: audit 2024-09-14T04:27:42.152776+0000 mgr.a (mgr.14355) 15862 : audit [DBG] from='client.342474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:42 smithi171 bash[25040]: cluster 2024-09-14T04:27:41.488332+0000 mgr.a (mgr.14355) 15861 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:42 smithi171 bash[25040]: audit 2024-09-14T04:27:42.152776+0000 mgr.a (mgr.14355) 15862 : audit [DBG] from='client.342474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:42 smithi007 bash[22722]: cluster 2024-09-14T04:27:41.488332+0000 mgr.a (mgr.14355) 15861 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:42 smithi007 bash[22722]: audit 2024-09-14T04:27:42.152776+0000 mgr.a (mgr.14355) 15862 : audit [DBG] from='client.342474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:44 smithi131 bash[24745]: cluster 2024-09-14T04:27:43.489290+0000 mgr.a (mgr.14355) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:44 smithi171 bash[25040]: cluster 2024-09-14T04:27:43.489290+0000 mgr.a (mgr.14355) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:44 smithi007 bash[22722]: cluster 2024-09-14T04:27:43.489290+0000 mgr.a (mgr.14355) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:46 smithi131 bash[24745]: cluster 2024-09-14T04:27:45.491462+0000 mgr.a (mgr.14355) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:46 smithi171 bash[25040]: cluster 2024-09-14T04:27:45.491462+0000 mgr.a (mgr.14355) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:46 smithi007 bash[22722]: cluster 2024-09-14T04:27:45.491462+0000 mgr.a (mgr.14355) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:48.373 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:48 smithi131 bash[24745]: cluster 2024-09-14T04:27:47.492205+0000 mgr.a (mgr.14355) 15865 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:49.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:48 smithi131 bash[24745]: audit 2024-09-14T04:27:47.935763+0000 mgr.a (mgr.14355) 15866 : audit [DBG] from='client.342549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:48 smithi171 bash[25040]: cluster 2024-09-14T04:27:47.492205+0000 mgr.a (mgr.14355) 15865 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:49.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:48 smithi171 bash[25040]: audit 2024-09-14T04:27:47.935763+0000 mgr.a (mgr.14355) 15866 : audit [DBG] from='client.342549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:48 smithi007 bash[22722]: cluster 2024-09-14T04:27:47.492205+0000 mgr.a (mgr.14355) 15865 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:48 smithi007 bash[22722]: audit 2024-09-14T04:27:47.935763+0000 mgr.a (mgr.14355) 15866 : audit [DBG] from='client.342549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:50 smithi131 bash[24745]: cluster 2024-09-14T04:27:49.493178+0000 mgr.a (mgr.14355) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:50 smithi171 bash[25040]: cluster 2024-09-14T04:27:49.493178+0000 mgr.a (mgr.14355) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:50 smithi007 bash[22722]: cluster 2024-09-14T04:27:49.493178+0000 mgr.a (mgr.14355) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:52 smithi131 bash[24745]: cluster 2024-09-14T04:27:51.495443+0000 mgr.a (mgr.14355) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:52 smithi171 bash[25040]: cluster 2024-09-14T04:27:51.495443+0000 mgr.a (mgr.14355) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:52 smithi007 bash[22722]: cluster 2024-09-14T04:27:51.495443+0000 mgr.a (mgr.14355) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:54.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:54.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:27:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:54 smithi131 bash[24745]: cluster 2024-09-14T04:27:53.495892+0000 mgr.a (mgr.14355) 15869 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:54 smithi131 bash[24745]: audit 2024-09-14T04:27:53.704795+0000 mgr.a (mgr.14355) 15870 : audit [DBG] from='client.342624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:54 smithi171 bash[25040]: cluster 2024-09-14T04:27:53.495892+0000 mgr.a (mgr.14355) 15869 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:54 smithi171 bash[25040]: audit 2024-09-14T04:27:53.704795+0000 mgr.a (mgr.14355) 15870 : audit [DBG] from='client.342624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:54 smithi007 bash[22722]: cluster 2024-09-14T04:27:53.495892+0000 mgr.a (mgr.14355) 15869 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:55.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:54 smithi007 bash[22722]: audit 2024-09-14T04:27:53.704795+0000 mgr.a (mgr.14355) 15870 : audit [DBG] from='client.342624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:27:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:56 smithi131 bash[24745]: cluster 2024-09-14T04:27:55.498195+0000 mgr.a (mgr.14355) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:57.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:56 smithi171 bash[25040]: cluster 2024-09-14T04:27:55.498195+0000 mgr.a (mgr.14355) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:56 smithi007 bash[22722]: cluster 2024-09-14T04:27:55.498195+0000 mgr.a (mgr.14355) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:27:59.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:27:58 smithi131 bash[24745]: cluster 2024-09-14T04:27:57.498956+0000 mgr.a (mgr.14355) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:59.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:27:58 smithi171 bash[25040]: cluster 2024-09-14T04:27:57.498956+0000 mgr.a (mgr.14355) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:59.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:27:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:27:59.136 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:27:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:27:58 smithi007 bash[22722]: cluster 2024-09-14T04:27:57.498956+0000 mgr.a (mgr.14355) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:27:59.886 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:27:59.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:27:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:27:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:27:59.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:00 smithi131 bash[24745]: audit 2024-09-14T04:27:59.469681+0000 mgr.a (mgr.14355) 15873 : audit [DBG] from='client.342702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:00 smithi131 bash[24745]: cluster 2024-09-14T04:27:59.499801+0000 mgr.a (mgr.14355) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:00 smithi171 bash[25040]: audit 2024-09-14T04:27:59.469681+0000 mgr.a (mgr.14355) 15873 : audit [DBG] from='client.342702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:01.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:00 smithi171 bash[25040]: cluster 2024-09-14T04:27:59.499801+0000 mgr.a (mgr.14355) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:00 smithi007 bash[22722]: audit 2024-09-14T04:27:59.469681+0000 mgr.a (mgr.14355) 15873 : audit [DBG] from='client.342702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:00 smithi007 bash[22722]: cluster 2024-09-14T04:27:59.499801+0000 mgr.a (mgr.14355) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:02 smithi131 bash[24745]: cluster 2024-09-14T04:28:01.502166+0000 mgr.a (mgr.14355) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:02 smithi171 bash[25040]: cluster 2024-09-14T04:28:01.502166+0000 mgr.a (mgr.14355) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:02 smithi007 bash[22722]: cluster 2024-09-14T04:28:01.502166+0000 mgr.a (mgr.14355) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:04.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:04.889 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:04 smithi131 bash[24745]: cluster 2024-09-14T04:28:03.502940+0000 mgr.a (mgr.14355) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:04 smithi171 bash[25040]: cluster 2024-09-14T04:28:03.502940+0000 mgr.a (mgr.14355) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:04 smithi007 bash[22722]: cluster 2024-09-14T04:28:03.502940+0000 mgr.a (mgr.14355) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:05.668 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:05.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:05.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:05.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:05.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:06 smithi131 bash[24745]: audit 2024-09-14T04:28:05.218416+0000 mgr.a (mgr.14355) 15877 : audit [DBG] from='client.342780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:07.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:06 smithi131 bash[24745]: cluster 2024-09-14T04:28:05.504518+0000 mgr.a (mgr.14355) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:28:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:06 smithi171 bash[25040]: audit 2024-09-14T04:28:05.218416+0000 mgr.a (mgr.14355) 15877 : audit [DBG] from='client.342780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:06 smithi171 bash[25040]: cluster 2024-09-14T04:28:05.504518+0000 mgr.a (mgr.14355) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:28:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:06 smithi007 bash[22722]: audit 2024-09-14T04:28:05.218416+0000 mgr.a (mgr.14355) 15877 : audit [DBG] from='client.342780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:06 smithi007 bash[22722]: cluster 2024-09-14T04:28:05.504518+0000 mgr.a (mgr.14355) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:28:09.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:08 smithi131 bash[24745]: cluster 2024-09-14T04:28:07.505575+0000 mgr.a (mgr.14355) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:08 smithi171 bash[25040]: cluster 2024-09-14T04:28:07.505575+0000 mgr.a (mgr.14355) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:08 smithi007 bash[22722]: cluster 2024-09-14T04:28:07.505575+0000 mgr.a (mgr.14355) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:10.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:10.671 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:10 smithi131 bash[24745]: cluster 2024-09-14T04:28:09.506442+0000 mgr.a (mgr.14355) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:10 smithi171 bash[25040]: cluster 2024-09-14T04:28:09.506442+0000 mgr.a (mgr.14355) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:10 smithi007 bash[22722]: cluster 2024-09-14T04:28:09.506442+0000 mgr.a (mgr.14355) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:28:11.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:11.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:11 smithi131 bash[24745]: audit 2024-09-14T04:28:11.004377+0000 mgr.a (mgr.14355) 15881 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:11 smithi171 bash[25040]: audit 2024-09-14T04:28:11.004377+0000 mgr.a (mgr.14355) 15881 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:11 smithi007 bash[22722]: audit 2024-09-14T04:28:11.004377+0000 mgr.a (mgr.14355) 15881 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:12 smithi131 bash[24745]: cluster 2024-09-14T04:28:11.509211+0000 mgr.a (mgr.14355) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:12 smithi171 bash[25040]: cluster 2024-09-14T04:28:11.509211+0000 mgr.a (mgr.14355) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:12 smithi007 bash[22722]: cluster 2024-09-14T04:28:11.509211+0000 mgr.a (mgr.14355) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:13 smithi171 bash[25040]: audit 2024-09-14T04:28:13.414488+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:28:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:13 smithi007 bash[22722]: audit 2024-09-14T04:28:13.414488+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:28:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:13 smithi131 bash[24745]: audit 2024-09-14T04:28:13.414488+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:28:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:14 smithi171 bash[25040]: cluster 2024-09-14T04:28:13.509765+0000 mgr.a (mgr.14355) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:14 smithi171 bash[25040]: audit 2024-09-14T04:28:14.244946+0000 mon.a (mon.0) 2964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:28:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:14 smithi171 bash[25040]: audit 2024-09-14T04:28:14.246346+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:28:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:14 smithi171 bash[25040]: audit 2024-09-14T04:28:14.254860+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:28:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:14 smithi171 bash[25040]: audit 2024-09-14T04:28:14.259770+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:15.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:28:15 smithi007 bash[22972]: debug 2024-09-14T04:28:15.015+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:28:15.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:28:15 smithi007 bash[22972]: debug 2024-09-14T04:28:15.019+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:28:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:14 smithi007 bash[22722]: cluster 2024-09-14T04:28:13.509765+0000 mgr.a (mgr.14355) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:14 smithi007 bash[22722]: audit 2024-09-14T04:28:14.244946+0000 mon.a (mon.0) 2964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:28:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:14 smithi007 bash[22722]: audit 2024-09-14T04:28:14.246346+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:28:15.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:14 smithi007 bash[22722]: audit 2024-09-14T04:28:14.254860+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:28:15.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:14 smithi007 bash[22722]: audit 2024-09-14T04:28:14.259770+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:14 smithi131 bash[24745]: cluster 2024-09-14T04:28:13.509765+0000 mgr.a (mgr.14355) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:14 smithi131 bash[24745]: audit 2024-09-14T04:28:14.244946+0000 mon.a (mon.0) 2964 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:28:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:14 smithi131 bash[24745]: audit 2024-09-14T04:28:14.246346+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:28:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:14 smithi131 bash[24745]: audit 2024-09-14T04:28:14.254860+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:28:15.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:14 smithi131 bash[24745]: audit 2024-09-14T04:28:14.259770+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:15 smithi007 bash[22722]: audit 2024-09-14T04:28:14.262223+0000 mgr.a (mgr.14355) 15884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:15 smithi007 bash[22722]: audit 2024-09-14T04:28:15.021683+0000 mgr.a (mgr.14355) 15885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:28:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:15 smithi007 bash[22722]: cephadm 2024-09-14T04:28:15.023153+0000 mgr.a (mgr.14355) 15886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:28:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:15 smithi131 bash[24745]: audit 2024-09-14T04:28:14.262223+0000 mgr.a (mgr.14355) 15884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:15 smithi131 bash[24745]: audit 2024-09-14T04:28:15.021683+0000 mgr.a (mgr.14355) 15885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:28:16.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:15 smithi131 bash[24745]: cephadm 2024-09-14T04:28:15.023153+0000 mgr.a (mgr.14355) 15886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:28:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:15 smithi171 bash[25040]: audit 2024-09-14T04:28:14.262223+0000 mgr.a (mgr.14355) 15884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:28:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:15 smithi171 bash[25040]: audit 2024-09-14T04:28:15.021683+0000 mgr.a (mgr.14355) 15885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:28:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:15 smithi171 bash[25040]: cephadm 2024-09-14T04:28:15.023153+0000 mgr.a (mgr.14355) 15886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:28:16.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:16.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:16.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:16 smithi007 bash[22722]: cluster 2024-09-14T04:28:15.512099+0000 mgr.a (mgr.14355) 15887 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:17.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:17.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:16 smithi131 bash[24745]: cluster 2024-09-14T04:28:15.512099+0000 mgr.a (mgr.14355) 15887 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:16 smithi171 bash[25040]: cluster 2024-09-14T04:28:15.512099+0000 mgr.a (mgr.14355) 15887 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:17 smithi007 bash[22722]: audit 2024-09-14T04:28:16.770481+0000 mgr.a (mgr.14355) 15888 : audit [DBG] from='client.343035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:17 smithi131 bash[24745]: audit 2024-09-14T04:28:16.770481+0000 mgr.a (mgr.14355) 15888 : audit [DBG] from='client.343035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:17 smithi171 bash[25040]: audit 2024-09-14T04:28:16.770481+0000 mgr.a (mgr.14355) 15888 : audit [DBG] from='client.343035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:18 smithi007 bash[22722]: cluster 2024-09-14T04:28:17.513045+0000 mgr.a (mgr.14355) 15889 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:18 smithi131 bash[24745]: cluster 2024-09-14T04:28:17.513045+0000 mgr.a (mgr.14355) 15889 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:18 smithi171 bash[25040]: cluster 2024-09-14T04:28:17.513045+0000 mgr.a (mgr.14355) 15889 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:20 smithi007 bash[22722]: cluster 2024-09-14T04:28:19.513838+0000 mgr.a (mgr.14355) 15890 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:20 smithi131 bash[24745]: cluster 2024-09-14T04:28:19.513838+0000 mgr.a (mgr.14355) 15890 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:20 smithi171 bash[25040]: cluster 2024-09-14T04:28:19.513838+0000 mgr.a (mgr.14355) 15890 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:28:22.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:22.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:22.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:22.971 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:22.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:22 smithi007 bash[22722]: cluster 2024-09-14T04:28:21.516084+0000 mgr.a (mgr.14355) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:22 smithi131 bash[24745]: cluster 2024-09-14T04:28:21.516084+0000 mgr.a (mgr.14355) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:22 smithi171 bash[25040]: cluster 2024-09-14T04:28:21.516084+0000 mgr.a (mgr.14355) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:23 smithi007 bash[22722]: audit 2024-09-14T04:28:22.545074+0000 mgr.a (mgr.14355) 15892 : audit [DBG] from='client.343113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:23 smithi131 bash[24745]: audit 2024-09-14T04:28:22.545074+0000 mgr.a (mgr.14355) 15892 : audit [DBG] from='client.343113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:23 smithi171 bash[25040]: audit 2024-09-14T04:28:22.545074+0000 mgr.a (mgr.14355) 15892 : audit [DBG] from='client.343113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:24 smithi007 bash[22722]: cluster 2024-09-14T04:28:23.517225+0000 mgr.a (mgr.14355) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:24 smithi131 bash[24745]: cluster 2024-09-14T04:28:23.517225+0000 mgr.a (mgr.14355) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:24 smithi171 bash[25040]: cluster 2024-09-14T04:28:23.517225+0000 mgr.a (mgr.14355) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:26 smithi007 bash[22722]: cluster 2024-09-14T04:28:25.519648+0000 mgr.a (mgr.14355) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:26 smithi131 bash[24745]: cluster 2024-09-14T04:28:25.519648+0000 mgr.a (mgr.14355) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:26 smithi171 bash[25040]: cluster 2024-09-14T04:28:25.519648+0000 mgr.a (mgr.14355) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:28:27.973 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:27.974 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:28.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:28 smithi007 bash[22722]: cluster 2024-09-14T04:28:27.520584+0000 mgr.a (mgr.14355) 15895 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:28 smithi131 bash[24745]: cluster 2024-09-14T04:28:27.520584+0000 mgr.a (mgr.14355) 15895 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:28 smithi171 bash[25040]: cluster 2024-09-14T04:28:27.520584+0000 mgr.a (mgr.14355) 15895 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:29 smithi007 bash[22722]: audit 2024-09-14T04:28:28.309160+0000 mgr.a (mgr.14355) 15896 : audit [DBG] from='client.343185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:29 smithi131 bash[24745]: audit 2024-09-14T04:28:28.309160+0000 mgr.a (mgr.14355) 15896 : audit [DBG] from='client.343185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:29 smithi171 bash[25040]: audit 2024-09-14T04:28:28.309160+0000 mgr.a (mgr.14355) 15896 : audit [DBG] from='client.343185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:30 smithi007 bash[22722]: cluster 2024-09-14T04:28:29.521581+0000 mgr.a (mgr.14355) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:30 smithi131 bash[24745]: cluster 2024-09-14T04:28:29.521581+0000 mgr.a (mgr.14355) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:30 smithi171 bash[25040]: cluster 2024-09-14T04:28:29.521581+0000 mgr.a (mgr.14355) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:32 smithi007 bash[22722]: cluster 2024-09-14T04:28:31.523997+0000 mgr.a (mgr.14355) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:32 smithi131 bash[24745]: cluster 2024-09-14T04:28:31.523997+0000 mgr.a (mgr.14355) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:33.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:32 smithi171 bash[25040]: cluster 2024-09-14T04:28:31.523997+0000 mgr.a (mgr.14355) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:33.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:33.754 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:34.526 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:34.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:34 smithi007 bash[22722]: cluster 2024-09-14T04:28:33.524958+0000 mgr.a (mgr.14355) 15899 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:34 smithi007 bash[22722]: audit 2024-09-14T04:28:34.093525+0000 mgr.a (mgr.14355) 15900 : audit [DBG] from='client.343257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:34 smithi131 bash[24745]: cluster 2024-09-14T04:28:33.524958+0000 mgr.a (mgr.14355) 15899 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:34 smithi131 bash[24745]: audit 2024-09-14T04:28:34.093525+0000 mgr.a (mgr.14355) 15900 : audit [DBG] from='client.343257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:34 smithi171 bash[25040]: cluster 2024-09-14T04:28:33.524958+0000 mgr.a (mgr.14355) 15899 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:34 smithi171 bash[25040]: audit 2024-09-14T04:28:34.093525+0000 mgr.a (mgr.14355) 15900 : audit [DBG] from='client.343257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:36 smithi007 bash[22722]: cluster 2024-09-14T04:28:35.527350+0000 mgr.a (mgr.14355) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:36 smithi131 bash[24745]: cluster 2024-09-14T04:28:35.527350+0000 mgr.a (mgr.14355) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:36 smithi171 bash[25040]: cluster 2024-09-14T04:28:35.527350+0000 mgr.a (mgr.14355) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:38 smithi007 bash[22722]: cluster 2024-09-14T04:28:37.528146+0000 mgr.a (mgr.14355) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:38 smithi131 bash[24745]: cluster 2024-09-14T04:28:37.528146+0000 mgr.a (mgr.14355) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:38 smithi171 bash[25040]: cluster 2024-09-14T04:28:37.528146+0000 mgr.a (mgr.14355) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:39.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:39.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:39.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:40.274 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:40.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:40 smithi007 bash[22722]: cluster 2024-09-14T04:28:39.528703+0000 mgr.a (mgr.14355) 15903 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:40 smithi007 bash[22722]: audit 2024-09-14T04:28:39.856847+0000 mgr.a (mgr.14355) 15904 : audit [DBG] from='client.343335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:40 smithi131 bash[24745]: cluster 2024-09-14T04:28:39.528703+0000 mgr.a (mgr.14355) 15903 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:40 smithi131 bash[24745]: audit 2024-09-14T04:28:39.856847+0000 mgr.a (mgr.14355) 15904 : audit [DBG] from='client.343335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:40 smithi171 bash[25040]: cluster 2024-09-14T04:28:39.528703+0000 mgr.a (mgr.14355) 15903 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:41.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:40 smithi171 bash[25040]: audit 2024-09-14T04:28:39.856847+0000 mgr.a (mgr.14355) 15904 : audit [DBG] from='client.343335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:43.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:42 smithi007 bash[22722]: cluster 2024-09-14T04:28:41.531016+0000 mgr.a (mgr.14355) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:42 smithi131 bash[24745]: cluster 2024-09-14T04:28:41.531016+0000 mgr.a (mgr.14355) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:42 smithi171 bash[25040]: cluster 2024-09-14T04:28:41.531016+0000 mgr.a (mgr.14355) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:28:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:44 smithi007 bash[22722]: cluster 2024-09-14T04:28:43.531775+0000 mgr.a (mgr.14355) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:44 smithi131 bash[24745]: cluster 2024-09-14T04:28:43.531775+0000 mgr.a (mgr.14355) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:44 smithi171 bash[25040]: cluster 2024-09-14T04:28:43.531775+0000 mgr.a (mgr.14355) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:46.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:46 smithi007 bash[22722]: cluster 2024-09-14T04:28:45.533654+0000 mgr.a (mgr.14355) 15907 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:46 smithi007 bash[22722]: audit 2024-09-14T04:28:45.599900+0000 mgr.a (mgr.14355) 15908 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:46 smithi131 bash[24745]: cluster 2024-09-14T04:28:45.533654+0000 mgr.a (mgr.14355) 15907 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:46 smithi131 bash[24745]: audit 2024-09-14T04:28:45.599900+0000 mgr.a (mgr.14355) 15908 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:46 smithi171 bash[25040]: cluster 2024-09-14T04:28:45.533654+0000 mgr.a (mgr.14355) 15907 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:46 smithi171 bash[25040]: audit 2024-09-14T04:28:45.599900+0000 mgr.a (mgr.14355) 15908 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:48 smithi007 bash[22722]: cluster 2024-09-14T04:28:47.534644+0000 mgr.a (mgr.14355) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:48 smithi131 bash[24745]: cluster 2024-09-14T04:28:47.534644+0000 mgr.a (mgr.14355) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:48 smithi171 bash[25040]: cluster 2024-09-14T04:28:47.534644+0000 mgr.a (mgr.14355) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:28:51.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:50 smithi131 bash[24745]: cluster 2024-09-14T04:28:49.535624+0000 mgr.a (mgr.14355) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:50 smithi171 bash[25040]: cluster 2024-09-14T04:28:49.535624+0000 mgr.a (mgr.14355) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:50 smithi007 bash[22722]: cluster 2024-09-14T04:28:49.535624+0000 mgr.a (mgr.14355) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:51.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:51.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:53 smithi131 bash[24745]: audit 2024-09-14T04:28:51.347233+0000 mgr.a (mgr.14355) 15911 : audit [DBG] from='client.343485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:53 smithi131 bash[24745]: cluster 2024-09-14T04:28:51.537066+0000 mgr.a (mgr.14355) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:53 smithi171 bash[25040]: audit 2024-09-14T04:28:51.347233+0000 mgr.a (mgr.14355) 15911 : audit [DBG] from='client.343485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:53 smithi171 bash[25040]: cluster 2024-09-14T04:28:51.537066+0000 mgr.a (mgr.14355) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:53 smithi007 bash[22722]: audit 2024-09-14T04:28:51.347233+0000 mgr.a (mgr.14355) 15911 : audit [DBG] from='client.343485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:53 smithi007 bash[22722]: cluster 2024-09-14T04:28:51.537066+0000 mgr.a (mgr.14355) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:55 smithi131 bash[24745]: cluster 2024-09-14T04:28:53.537980+0000 mgr.a (mgr.14355) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:55 smithi171 bash[25040]: cluster 2024-09-14T04:28:53.537980+0000 mgr.a (mgr.14355) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:55 smithi007 bash[22722]: cluster 2024-09-14T04:28:53.537980+0000 mgr.a (mgr.14355) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:28:56.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:28:56.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:28:56.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:28:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:57 smithi131 bash[24745]: cluster 2024-09-14T04:28:55.540182+0000 mgr.a (mgr.14355) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:57 smithi171 bash[25040]: cluster 2024-09-14T04:28:55.540182+0000 mgr.a (mgr.14355) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:57 smithi007 bash[22722]: cluster 2024-09-14T04:28:55.540182+0000 mgr.a (mgr.14355) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:28:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:28:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:28:57.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:28:57.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:28:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:58 smithi131 bash[24745]: audit 2024-09-14T04:28:57.110432+0000 mgr.a (mgr.14355) 15915 : audit [DBG] from='client.343557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:58.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:58 smithi171 bash[25040]: audit 2024-09-14T04:28:57.110432+0000 mgr.a (mgr.14355) 15915 : audit [DBG] from='client.343557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:58.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:58 smithi007 bash[22722]: audit 2024-09-14T04:28:57.110432+0000 mgr.a (mgr.14355) 15915 : audit [DBG] from='client.343557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:28:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:28:59 smithi131 bash[24745]: cluster 2024-09-14T04:28:57.540843+0000 mgr.a (mgr.14355) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:28:59 smithi171 bash[25040]: cluster 2024-09-14T04:28:57.540843+0000 mgr.a (mgr.14355) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:28:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:28:59 smithi007 bash[22722]: cluster 2024-09-14T04:28:57.540843+0000 mgr.a (mgr.14355) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:01 smithi131 bash[24745]: cluster 2024-09-14T04:28:59.541578+0000 mgr.a (mgr.14355) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:01 smithi171 bash[25040]: cluster 2024-09-14T04:28:59.541578+0000 mgr.a (mgr.14355) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:01 smithi007 bash[22722]: cluster 2024-09-14T04:28:59.541578+0000 mgr.a (mgr.14355) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:02.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:02.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:02.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:03.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:03.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:03 smithi131 bash[24745]: cluster 2024-09-14T04:29:01.543825+0000 mgr.a (mgr.14355) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:03.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:03 smithi171 bash[25040]: cluster 2024-09-14T04:29:01.543825+0000 mgr.a (mgr.14355) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:03 smithi007 bash[22722]: cluster 2024-09-14T04:29:01.543825+0000 mgr.a (mgr.14355) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:04 smithi131 bash[24745]: audit 2024-09-14T04:29:02.860869+0000 mgr.a (mgr.14355) 15919 : audit [DBG] from='client.343632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:04 smithi171 bash[25040]: audit 2024-09-14T04:29:02.860869+0000 mgr.a (mgr.14355) 15919 : audit [DBG] from='client.343632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:04 smithi007 bash[22722]: audit 2024-09-14T04:29:02.860869+0000 mgr.a (mgr.14355) 15919 : audit [DBG] from='client.343632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:05 smithi171 bash[25040]: cluster 2024-09-14T04:29:03.544781+0000 mgr.a (mgr.14355) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:05 smithi007 bash[22722]: cluster 2024-09-14T04:29:03.544781+0000 mgr.a (mgr.14355) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:05 smithi131 bash[24745]: cluster 2024-09-14T04:29:03.544781+0000 mgr.a (mgr.14355) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:07 smithi007 bash[22722]: cluster 2024-09-14T04:29:05.547030+0000 mgr.a (mgr.14355) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:07 smithi131 bash[24745]: cluster 2024-09-14T04:29:05.547030+0000 mgr.a (mgr.14355) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:07 smithi171 bash[25040]: cluster 2024-09-14T04:29:05.547030+0000 mgr.a (mgr.14355) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:08.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:08.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:08.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:09.055 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:09.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:09.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:09 smithi007 bash[22722]: cluster 2024-09-14T04:29:07.547878+0000 mgr.a (mgr.14355) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:09 smithi131 bash[24745]: cluster 2024-09-14T04:29:07.547878+0000 mgr.a (mgr.14355) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:09 smithi171 bash[25040]: cluster 2024-09-14T04:29:07.547878+0000 mgr.a (mgr.14355) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:10.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:10 smithi007 bash[22722]: audit 2024-09-14T04:29:08.612976+0000 mgr.a (mgr.14355) 15923 : audit [DBG] from='client.343707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:10 smithi131 bash[24745]: audit 2024-09-14T04:29:08.612976+0000 mgr.a (mgr.14355) 15923 : audit [DBG] from='client.343707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:10.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:10 smithi171 bash[25040]: audit 2024-09-14T04:29:08.612976+0000 mgr.a (mgr.14355) 15923 : audit [DBG] from='client.343707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:11 smithi007 bash[22722]: cluster 2024-09-14T04:29:09.549012+0000 mgr.a (mgr.14355) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:11 smithi131 bash[24745]: cluster 2024-09-14T04:29:09.549012+0000 mgr.a (mgr.14355) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:11 smithi171 bash[25040]: cluster 2024-09-14T04:29:09.549012+0000 mgr.a (mgr.14355) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:13 smithi007 bash[22722]: cluster 2024-09-14T04:29:11.551319+0000 mgr.a (mgr.14355) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:13 smithi131 bash[24745]: cluster 2024-09-14T04:29:11.551319+0000 mgr.a (mgr.14355) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:13 smithi171 bash[25040]: cluster 2024-09-14T04:29:11.551319+0000 mgr.a (mgr.14355) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:14.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:14.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:14.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:14.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:15 smithi007 bash[22722]: cluster 2024-09-14T04:29:13.552122+0000 mgr.a (mgr.14355) 15926 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:15 smithi131 bash[24745]: cluster 2024-09-14T04:29:13.552122+0000 mgr.a (mgr.14355) 15926 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:15 smithi171 bash[25040]: cluster 2024-09-14T04:29:13.552122+0000 mgr.a (mgr.14355) 15926 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:16 smithi007 bash[22722]: audit 2024-09-14T04:29:14.391444+0000 mgr.a (mgr.14355) 15927 : audit [DBG] from='client.343782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:16.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:16 smithi007 bash[22722]: audit 2024-09-14T04:29:15.075525+0000 mon.a (mon.0) 2968 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:29:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:16 smithi131 bash[24745]: audit 2024-09-14T04:29:14.391444+0000 mgr.a (mgr.14355) 15927 : audit [DBG] from='client.343782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:16 smithi131 bash[24745]: audit 2024-09-14T04:29:15.075525+0000 mon.a (mon.0) 2968 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:29:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:16 smithi171 bash[25040]: audit 2024-09-14T04:29:14.391444+0000 mgr.a (mgr.14355) 15927 : audit [DBG] from='client.343782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:16.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:16 smithi171 bash[25040]: audit 2024-09-14T04:29:15.075525+0000 mon.a (mon.0) 2968 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:29:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:17 smithi007 bash[22722]: cluster 2024-09-14T04:29:15.554505+0000 mgr.a (mgr.14355) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:17 smithi131 bash[24745]: cluster 2024-09-14T04:29:15.554505+0000 mgr.a (mgr.14355) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:17 smithi171 bash[25040]: cluster 2024-09-14T04:29:15.554505+0000 mgr.a (mgr.14355) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:19 smithi007 bash[22722]: cluster 2024-09-14T04:29:17.555325+0000 mgr.a (mgr.14355) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:19 smithi131 bash[24745]: cluster 2024-09-14T04:29:17.555325+0000 mgr.a (mgr.14355) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:19 smithi171 bash[25040]: cluster 2024-09-14T04:29:17.555325+0000 mgr.a (mgr.14355) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:19.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:19.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:20.602 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:20.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:20.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: cluster 2024-09-14T04:29:19.556137+0000 mgr.a (mgr.14355) 15930 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.147889+0000 mgr.a (mgr.14355) 15931 : audit [DBG] from='client.343857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.414910+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.419594+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.430872+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.435144+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.464886+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22722]: audit 2024-09-14T04:29:20.470588+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: cluster 2024-09-14T04:29:19.556137+0000 mgr.a (mgr.14355) 15930 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.147889+0000 mgr.a (mgr.14355) 15931 : audit [DBG] from='client.343857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.414910+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.419594+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.430872+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.435144+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.464886+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:21 smithi131 bash[24745]: audit 2024-09-14T04:29:20.470588+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: cluster 2024-09-14T04:29:19.556137+0000 mgr.a (mgr.14355) 15930 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.147889+0000 mgr.a (mgr.14355) 15931 : audit [DBG] from='client.343857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.414910+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.419594+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.430872+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.435144+0000 mon.a (mon.0) 2972 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.464886+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:21 smithi171 bash[25040]: audit 2024-09-14T04:29:20.470588+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22972]: debug 2024-09-14T04:29:21.922+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:29:21 smithi007 bash[22972]: debug 2024-09-14T04:29:21.926+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:22 smithi007 bash[22722]: audit 2024-09-14T04:29:21.186185+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:22 smithi007 bash[22722]: audit 2024-09-14T04:29:21.187850+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:22 smithi007 bash[22722]: audit 2024-09-14T04:29:21.194553+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:22 smithi007 bash[22722]: audit 2024-09-14T04:29:21.199476+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:22 smithi131 bash[24745]: audit 2024-09-14T04:29:21.186185+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:29:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:22 smithi131 bash[24745]: audit 2024-09-14T04:29:21.187850+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:29:22.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:22 smithi131 bash[24745]: audit 2024-09-14T04:29:21.194553+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:22.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:22 smithi131 bash[24745]: audit 2024-09-14T04:29:21.199476+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:22 smithi171 bash[25040]: audit 2024-09-14T04:29:21.186185+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:29:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:22 smithi171 bash[25040]: audit 2024-09-14T04:29:21.187850+0000 mon.a (mon.0) 2976 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:29:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:22 smithi171 bash[25040]: audit 2024-09-14T04:29:21.194553+0000 mon.a (mon.0) 2977 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:29:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:22 smithi171 bash[25040]: audit 2024-09-14T04:29:21.199476+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:23 smithi007 bash[22722]: audit 2024-09-14T04:29:21.200714+0000 mgr.a (mgr.14355) 15932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:23 smithi007 bash[22722]: cluster 2024-09-14T04:29:21.557469+0000 mgr.a (mgr.14355) 15933 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:29:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:23 smithi007 bash[22722]: audit 2024-09-14T04:29:21.926150+0000 mgr.a (mgr.14355) 15934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:29:23.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:23 smithi007 bash[22722]: cephadm 2024-09-14T04:29:21.927482+0000 mgr.a (mgr.14355) 15935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:29:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:23 smithi131 bash[24745]: audit 2024-09-14T04:29:21.200714+0000 mgr.a (mgr.14355) 15932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:23 smithi131 bash[24745]: cluster 2024-09-14T04:29:21.557469+0000 mgr.a (mgr.14355) 15933 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:29:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:23 smithi131 bash[24745]: audit 2024-09-14T04:29:21.926150+0000 mgr.a (mgr.14355) 15934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:29:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:23 smithi131 bash[24745]: cephadm 2024-09-14T04:29:21.927482+0000 mgr.a (mgr.14355) 15935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:29:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:23 smithi171 bash[25040]: audit 2024-09-14T04:29:21.200714+0000 mgr.a (mgr.14355) 15932 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:29:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:23 smithi171 bash[25040]: cluster 2024-09-14T04:29:21.557469+0000 mgr.a (mgr.14355) 15933 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:29:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:23 smithi171 bash[25040]: audit 2024-09-14T04:29:21.926150+0000 mgr.a (mgr.14355) 15934 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:29:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:23 smithi171 bash[25040]: cephadm 2024-09-14T04:29:21.927482+0000 mgr.a (mgr.14355) 15935 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:29:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:24 smithi131 bash[24745]: cluster 2024-09-14T04:29:23.558313+0000 mgr.a (mgr.14355) 15936 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:29:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:24 smithi171 bash[25040]: cluster 2024-09-14T04:29:23.558313+0000 mgr.a (mgr.14355) 15936 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:29:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:24 smithi007 bash[22722]: cluster 2024-09-14T04:29:23.558313+0000 mgr.a (mgr.14355) 15936 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:29:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:25.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:25.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:26.367 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:26 smithi007 bash[22722]: cluster 2024-09-14T04:29:25.560430+0000 mgr.a (mgr.14355) 15937 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:26 smithi007 bash[22722]: audit 2024-09-14T04:29:25.939095+0000 mgr.a (mgr.14355) 15938 : audit [DBG] from='client.344043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:26 smithi131 bash[24745]: cluster 2024-09-14T04:29:25.560430+0000 mgr.a (mgr.14355) 15937 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:26 smithi131 bash[24745]: audit 2024-09-14T04:29:25.939095+0000 mgr.a (mgr.14355) 15938 : audit [DBG] from='client.344043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:26 smithi171 bash[25040]: cluster 2024-09-14T04:29:25.560430+0000 mgr.a (mgr.14355) 15937 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:26 smithi171 bash[25040]: audit 2024-09-14T04:29:25.939095+0000 mgr.a (mgr.14355) 15938 : audit [DBG] from='client.344043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:28 smithi007 bash[22722]: cluster 2024-09-14T04:29:27.561465+0000 mgr.a (mgr.14355) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:28 smithi131 bash[24745]: cluster 2024-09-14T04:29:27.561465+0000 mgr.a (mgr.14355) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:28 smithi171 bash[25040]: cluster 2024-09-14T04:29:27.561465+0000 mgr.a (mgr.14355) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:30 smithi007 bash[22722]: cluster 2024-09-14T04:29:29.562469+0000 mgr.a (mgr.14355) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:30 smithi131 bash[24745]: cluster 2024-09-14T04:29:29.562469+0000 mgr.a (mgr.14355) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:30 smithi171 bash[25040]: cluster 2024-09-14T04:29:29.562469+0000 mgr.a (mgr.14355) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:31.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:31.369 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:32.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:32.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:32.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:32.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:32 smithi007 bash[22722]: cluster 2024-09-14T04:29:31.564622+0000 mgr.a (mgr.14355) 15941 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:32 smithi007 bash[22722]: audit 2024-09-14T04:29:31.703845+0000 mgr.a (mgr.14355) 15942 : audit [DBG] from='client.344121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:32 smithi131 bash[24745]: cluster 2024-09-14T04:29:31.564622+0000 mgr.a (mgr.14355) 15941 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:32 smithi131 bash[24745]: audit 2024-09-14T04:29:31.703845+0000 mgr.a (mgr.14355) 15942 : audit [DBG] from='client.344121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:32 smithi171 bash[25040]: cluster 2024-09-14T04:29:31.564622+0000 mgr.a (mgr.14355) 15941 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:32 smithi171 bash[25040]: audit 2024-09-14T04:29:31.703845+0000 mgr.a (mgr.14355) 15942 : audit [DBG] from='client.344121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:34.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:34 smithi007 bash[22722]: cluster 2024-09-14T04:29:33.565691+0000 mgr.a (mgr.14355) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:34 smithi131 bash[24745]: cluster 2024-09-14T04:29:33.565691+0000 mgr.a (mgr.14355) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:34 smithi171 bash[25040]: cluster 2024-09-14T04:29:33.565691+0000 mgr.a (mgr.14355) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:29:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:36 smithi007 bash[22722]: cluster 2024-09-14T04:29:35.567940+0000 mgr.a (mgr.14355) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:36 smithi131 bash[24745]: cluster 2024-09-14T04:29:35.567940+0000 mgr.a (mgr.14355) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:37.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:36 smithi171 bash[25040]: cluster 2024-09-14T04:29:35.567940+0000 mgr.a (mgr.14355) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:29:37.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:37.143 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:37.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:37.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:37.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:38 smithi007 bash[22722]: audit 2024-09-14T04:29:37.476217+0000 mgr.a (mgr.14355) 15945 : audit [DBG] from='client.344199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:38 smithi007 bash[22722]: cluster 2024-09-14T04:29:37.568443+0000 mgr.a (mgr.14355) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:38 smithi131 bash[24745]: audit 2024-09-14T04:29:37.476217+0000 mgr.a (mgr.14355) 15945 : audit [DBG] from='client.344199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:39.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:38 smithi131 bash[24745]: cluster 2024-09-14T04:29:37.568443+0000 mgr.a (mgr.14355) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:38 smithi171 bash[25040]: audit 2024-09-14T04:29:37.476217+0000 mgr.a (mgr.14355) 15945 : audit [DBG] from='client.344199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:39.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:38 smithi171 bash[25040]: cluster 2024-09-14T04:29:37.568443+0000 mgr.a (mgr.14355) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:40.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:40 smithi007 bash[22722]: cluster 2024-09-14T04:29:39.569276+0000 mgr.a (mgr.14355) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:40 smithi131 bash[24745]: cluster 2024-09-14T04:29:39.569276+0000 mgr.a (mgr.14355) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:40 smithi171 bash[25040]: cluster 2024-09-14T04:29:39.569276+0000 mgr.a (mgr.14355) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:42.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:42.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:42.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:42 smithi007 bash[22722]: cluster 2024-09-14T04:29:41.571520+0000 mgr.a (mgr.14355) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:42 smithi131 bash[24745]: cluster 2024-09-14T04:29:41.571520+0000 mgr.a (mgr.14355) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:42 smithi171 bash[25040]: cluster 2024-09-14T04:29:41.571520+0000 mgr.a (mgr.14355) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:43.677 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:43.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:44 smithi007 bash[22722]: audit 2024-09-14T04:29:43.255601+0000 mgr.a (mgr.14355) 15949 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:44 smithi007 bash[22722]: cluster 2024-09-14T04:29:43.578127+0000 mgr.a (mgr.14355) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:44 smithi131 bash[24745]: audit 2024-09-14T04:29:43.255601+0000 mgr.a (mgr.14355) 15949 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:44 smithi131 bash[24745]: cluster 2024-09-14T04:29:43.578127+0000 mgr.a (mgr.14355) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:44 smithi171 bash[25040]: audit 2024-09-14T04:29:43.255601+0000 mgr.a (mgr.14355) 15949 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:44 smithi171 bash[25040]: cluster 2024-09-14T04:29:43.578127+0000 mgr.a (mgr.14355) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:46 smithi007 bash[22722]: cluster 2024-09-14T04:29:45.580302+0000 mgr.a (mgr.14355) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:46 smithi131 bash[24745]: cluster 2024-09-14T04:29:45.580302+0000 mgr.a (mgr.14355) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:46 smithi171 bash[25040]: cluster 2024-09-14T04:29:45.580302+0000 mgr.a (mgr.14355) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:48.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:48.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:48.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:48 smithi007 bash[22722]: cluster 2024-09-14T04:29:47.581048+0000 mgr.a (mgr.14355) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:48 smithi131 bash[24745]: cluster 2024-09-14T04:29:47.581048+0000 mgr.a (mgr.14355) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:48 smithi171 bash[25040]: cluster 2024-09-14T04:29:47.581048+0000 mgr.a (mgr.14355) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:49.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:49 smithi007 bash[22722]: audit 2024-09-14T04:29:49.019606+0000 mgr.a (mgr.14355) 15953 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:49 smithi131 bash[24745]: audit 2024-09-14T04:29:49.019606+0000 mgr.a (mgr.14355) 15953 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:50.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:49 smithi171 bash[25040]: audit 2024-09-14T04:29:49.019606+0000 mgr.a (mgr.14355) 15953 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:50 smithi007 bash[22722]: cluster 2024-09-14T04:29:49.582040+0000 mgr.a (mgr.14355) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:50 smithi131 bash[24745]: cluster 2024-09-14T04:29:49.582040+0000 mgr.a (mgr.14355) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:50 smithi171 bash[25040]: cluster 2024-09-14T04:29:49.582040+0000 mgr.a (mgr.14355) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:52 smithi007 bash[22722]: cluster 2024-09-14T04:29:51.584328+0000 mgr.a (mgr.14355) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:52 smithi131 bash[24745]: cluster 2024-09-14T04:29:51.584328+0000 mgr.a (mgr.14355) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:52 smithi171 bash[25040]: cluster 2024-09-14T04:29:51.584328+0000 mgr.a (mgr.14355) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:54.472 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:29:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:29:54.473 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:29:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:54 smithi007 bash[22722]: cluster 2024-09-14T04:29:53.585102+0000 mgr.a (mgr.14355) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:54 smithi131 bash[24745]: cluster 2024-09-14T04:29:53.585102+0000 mgr.a (mgr.14355) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:54 smithi171 bash[25040]: cluster 2024-09-14T04:29:53.585102+0000 mgr.a (mgr.14355) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:55.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:29:55.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:29:55.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:29:55.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:29:55.228 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:29:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:55 smithi007 bash[22722]: audit 2024-09-14T04:29:54.801866+0000 mgr.a (mgr.14355) 15957 : audit [DBG] from='client.344427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:55 smithi131 bash[24745]: audit 2024-09-14T04:29:54.801866+0000 mgr.a (mgr.14355) 15957 : audit [DBG] from='client.344427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:55 smithi171 bash[25040]: audit 2024-09-14T04:29:54.801866+0000 mgr.a (mgr.14355) 15957 : audit [DBG] from='client.344427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:29:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:56 smithi007 bash[22722]: cluster 2024-09-14T04:29:55.587452+0000 mgr.a (mgr.14355) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:57.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:56 smithi131 bash[24745]: cluster 2024-09-14T04:29:55.587452+0000 mgr.a (mgr.14355) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:56 smithi171 bash[25040]: cluster 2024-09-14T04:29:55.587452+0000 mgr.a (mgr.14355) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:29:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:29:58 smithi007 bash[22722]: cluster 2024-09-14T04:29:57.588230+0000 mgr.a (mgr.14355) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:29:58 smithi131 bash[24745]: cluster 2024-09-14T04:29:57.588230+0000 mgr.a (mgr.14355) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:29:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:29:58 smithi171 bash[25040]: cluster 2024-09-14T04:29:57.588230+0000 mgr.a (mgr.14355) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:00.229 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:00.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:00.230 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:00 smithi007 bash[22722]: cluster 2024-09-14T04:29:59.588970+0000 mgr.a (mgr.14355) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:00 smithi007 bash[22722]: cluster 2024-09-14T04:30:00.000129+0000 mon.a (mon.0) 2979 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:30:00.980 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:00.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:00 smithi131 bash[24745]: cluster 2024-09-14T04:29:59.588970+0000 mgr.a (mgr.14355) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:01.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:00 smithi131 bash[24745]: cluster 2024-09-14T04:30:00.000129+0000 mon.a (mon.0) 2979 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:30:01.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:00 smithi171 bash[25040]: cluster 2024-09-14T04:29:59.588970+0000 mgr.a (mgr.14355) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:01.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:00 smithi171 bash[25040]: cluster 2024-09-14T04:30:00.000129+0000 mon.a (mon.0) 2979 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:30:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:01 smithi131 bash[24745]: audit 2024-09-14T04:30:00.558902+0000 mgr.a (mgr.14355) 15961 : audit [DBG] from='client.344505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:01 smithi171 bash[25040]: audit 2024-09-14T04:30:00.558902+0000 mgr.a (mgr.14355) 15961 : audit [DBG] from='client.344505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:01 smithi007 bash[22722]: audit 2024-09-14T04:30:00.558902+0000 mgr.a (mgr.14355) 15961 : audit [DBG] from='client.344505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:02 smithi131 bash[24745]: cluster 2024-09-14T04:30:01.591713+0000 mgr.a (mgr.14355) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:02 smithi171 bash[25040]: cluster 2024-09-14T04:30:01.591713+0000 mgr.a (mgr.14355) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:03.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:02 smithi007 bash[22722]: cluster 2024-09-14T04:30:01.591713+0000 mgr.a (mgr.14355) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:04 smithi131 bash[24745]: cluster 2024-09-14T04:30:03.592492+0000 mgr.a (mgr.14355) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:05.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:04 smithi171 bash[25040]: cluster 2024-09-14T04:30:03.592492+0000 mgr.a (mgr.14355) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:04 smithi007 bash[22722]: cluster 2024-09-14T04:30:03.592492+0000 mgr.a (mgr.14355) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:05.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:05.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:05.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:06.769 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:06.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:06.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:06.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:06.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:06 smithi131 bash[24745]: cluster 2024-09-14T04:30:05.594449+0000 mgr.a (mgr.14355) 15964 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:06 smithi171 bash[25040]: cluster 2024-09-14T04:30:05.594449+0000 mgr.a (mgr.14355) 15964 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:06 smithi007 bash[22722]: cluster 2024-09-14T04:30:05.594449+0000 mgr.a (mgr.14355) 15964 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:07 smithi131 bash[24745]: audit 2024-09-14T04:30:06.316999+0000 mgr.a (mgr.14355) 15965 : audit [DBG] from='client.344583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:07 smithi171 bash[25040]: audit 2024-09-14T04:30:06.316999+0000 mgr.a (mgr.14355) 15965 : audit [DBG] from='client.344583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:07 smithi007 bash[22722]: audit 2024-09-14T04:30:06.316999+0000 mgr.a (mgr.14355) 15965 : audit [DBG] from='client.344583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:08 smithi131 bash[24745]: cluster 2024-09-14T04:30:07.595303+0000 mgr.a (mgr.14355) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:08 smithi171 bash[25040]: cluster 2024-09-14T04:30:07.595303+0000 mgr.a (mgr.14355) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:08 smithi007 bash[22722]: cluster 2024-09-14T04:30:07.595303+0000 mgr.a (mgr.14355) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:10 smithi131 bash[24745]: cluster 2024-09-14T04:30:09.596084+0000 mgr.a (mgr.14355) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:30:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:10 smithi171 bash[25040]: cluster 2024-09-14T04:30:09.596084+0000 mgr.a (mgr.14355) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:30:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:10 smithi007 bash[22722]: cluster 2024-09-14T04:30:09.596084+0000 mgr.a (mgr.14355) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:30:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:11.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:11.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:12.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:12.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:12 smithi131 bash[24745]: cluster 2024-09-14T04:30:11.598358+0000 mgr.a (mgr.14355) 15968 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:12 smithi131 bash[24745]: audit 2024-09-14T04:30:12.111373+0000 mgr.a (mgr.14355) 15969 : audit [DBG] from='client.344658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:12 smithi171 bash[25040]: cluster 2024-09-14T04:30:11.598358+0000 mgr.a (mgr.14355) 15968 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:12 smithi171 bash[25040]: audit 2024-09-14T04:30:12.111373+0000 mgr.a (mgr.14355) 15969 : audit [DBG] from='client.344658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:12 smithi007 bash[22722]: cluster 2024-09-14T04:30:11.598358+0000 mgr.a (mgr.14355) 15968 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:12 smithi007 bash[22722]: audit 2024-09-14T04:30:12.111373+0000 mgr.a (mgr.14355) 15969 : audit [DBG] from='client.344658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:14 smithi131 bash[24745]: cluster 2024-09-14T04:30:13.599257+0000 mgr.a (mgr.14355) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:14 smithi171 bash[25040]: cluster 2024-09-14T04:30:13.599257+0000 mgr.a (mgr.14355) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:14 smithi007 bash[22722]: cluster 2024-09-14T04:30:13.599257+0000 mgr.a (mgr.14355) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:16 smithi131 bash[24745]: cluster 2024-09-14T04:30:15.601428+0000 mgr.a (mgr.14355) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:16 smithi171 bash[25040]: cluster 2024-09-14T04:30:15.601428+0000 mgr.a (mgr.14355) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:16 smithi007 bash[22722]: cluster 2024-09-14T04:30:15.601428+0000 mgr.a (mgr.14355) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:17.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:17.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:18.302 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:18.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:18 smithi131 bash[24745]: cluster 2024-09-14T04:30:17.602041+0000 mgr.a (mgr.14355) 15972 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:18 smithi131 bash[24745]: audit 2024-09-14T04:30:17.886546+0000 mgr.a (mgr.14355) 15973 : audit [DBG] from='client.344736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:18 smithi171 bash[25040]: cluster 2024-09-14T04:30:17.602041+0000 mgr.a (mgr.14355) 15972 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:18 smithi171 bash[25040]: audit 2024-09-14T04:30:17.886546+0000 mgr.a (mgr.14355) 15973 : audit [DBG] from='client.344736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:18 smithi007 bash[22722]: cluster 2024-09-14T04:30:17.602041+0000 mgr.a (mgr.14355) 15972 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:18 smithi007 bash[22722]: audit 2024-09-14T04:30:17.886546+0000 mgr.a (mgr.14355) 15973 : audit [DBG] from='client.344736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:20 smithi131 bash[24745]: cluster 2024-09-14T04:30:19.602951+0000 mgr.a (mgr.14355) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:20 smithi171 bash[25040]: cluster 2024-09-14T04:30:19.602951+0000 mgr.a (mgr.14355) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:20 smithi007 bash[22722]: cluster 2024-09-14T04:30:19.602951+0000 mgr.a (mgr.14355) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:22 smithi131 bash[24745]: cluster 2024-09-14T04:30:21.605243+0000 mgr.a (mgr.14355) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:22 smithi131 bash[24745]: audit 2024-09-14T04:30:21.977744+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:30:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:22 smithi171 bash[25040]: cluster 2024-09-14T04:30:21.605243+0000 mgr.a (mgr.14355) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:23.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:22 smithi171 bash[25040]: audit 2024-09-14T04:30:21.977744+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:30:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:22 smithi007 bash[22722]: cluster 2024-09-14T04:30:21.605243+0000 mgr.a (mgr.14355) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:22 smithi007 bash[22722]: audit 2024-09-14T04:30:21.977744+0000 mon.a (mon.0) 2980 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:30:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:23.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22972]: debug 2024-09-14T04:30:23.597+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22972]: debug 2024-09-14T04:30:23.597+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22722]: audit 2024-09-14T04:30:22.830515+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22722]: audit 2024-09-14T04:30:22.831661+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22722]: audit 2024-09-14T04:30:22.840420+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22722]: audit 2024-09-14T04:30:22.843071+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:23 smithi007 bash[22722]: audit 2024-09-14T04:30:22.844054+0000 mgr.a (mgr.14355) 15976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:23 smithi131 bash[24745]: audit 2024-09-14T04:30:22.830515+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:30:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:23 smithi131 bash[24745]: audit 2024-09-14T04:30:22.831661+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:30:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:23 smithi131 bash[24745]: audit 2024-09-14T04:30:22.840420+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:30:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:23 smithi131 bash[24745]: audit 2024-09-14T04:30:22.843071+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:24.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:23 smithi131 bash[24745]: audit 2024-09-14T04:30:22.844054+0000 mgr.a (mgr.14355) 15976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:23 smithi171 bash[25040]: audit 2024-09-14T04:30:22.830515+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:30:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:23 smithi171 bash[25040]: audit 2024-09-14T04:30:22.831661+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:30:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:23 smithi171 bash[25040]: audit 2024-09-14T04:30:22.840420+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:30:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:23 smithi171 bash[25040]: audit 2024-09-14T04:30:22.843071+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:24.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:23 smithi171 bash[25040]: audit 2024-09-14T04:30:22.844054+0000 mgr.a (mgr.14355) 15976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:30:24.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:24.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:24 smithi007 bash[22722]: audit 2024-09-14T04:30:23.599946+0000 mgr.a (mgr.14355) 15977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:30:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:24 smithi007 bash[22722]: cephadm 2024-09-14T04:30:23.601116+0000 mgr.a (mgr.14355) 15978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:30:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:24 smithi007 bash[22722]: cluster 2024-09-14T04:30:23.605827+0000 mgr.a (mgr.14355) 15979 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:24 smithi007 bash[22722]: audit 2024-09-14T04:30:23.656590+0000 mgr.a (mgr.14355) 15980 : audit [DBG] from='client.344901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:24 smithi131 bash[24745]: audit 2024-09-14T04:30:23.599946+0000 mgr.a (mgr.14355) 15977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:30:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:24 smithi131 bash[24745]: cephadm 2024-09-14T04:30:23.601116+0000 mgr.a (mgr.14355) 15978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:30:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:24 smithi131 bash[24745]: cluster 2024-09-14T04:30:23.605827+0000 mgr.a (mgr.14355) 15979 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:24 smithi131 bash[24745]: audit 2024-09-14T04:30:23.656590+0000 mgr.a (mgr.14355) 15980 : audit [DBG] from='client.344901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:24 smithi171 bash[25040]: audit 2024-09-14T04:30:23.599946+0000 mgr.a (mgr.14355) 15977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:30:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:24 smithi171 bash[25040]: cephadm 2024-09-14T04:30:23.601116+0000 mgr.a (mgr.14355) 15978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:30:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:24 smithi171 bash[25040]: cluster 2024-09-14T04:30:23.605827+0000 mgr.a (mgr.14355) 15979 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 190 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:24 smithi171 bash[25040]: audit 2024-09-14T04:30:23.656590+0000 mgr.a (mgr.14355) 15980 : audit [DBG] from='client.344901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:26 smithi007 bash[22722]: cluster 2024-09-14T04:30:25.608033+0000 mgr.a (mgr.14355) 15981 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:26 smithi131 bash[24745]: cluster 2024-09-14T04:30:25.608033+0000 mgr.a (mgr.14355) 15981 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:26 smithi171 bash[25040]: cluster 2024-09-14T04:30:25.608033+0000 mgr.a (mgr.14355) 15981 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:28 smithi007 bash[22722]: cluster 2024-09-14T04:30:27.608773+0000 mgr.a (mgr.14355) 15982 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:28 smithi131 bash[24745]: cluster 2024-09-14T04:30:27.608773+0000 mgr.a (mgr.14355) 15982 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:28 smithi171 bash[25040]: cluster 2024-09-14T04:30:27.608773+0000 mgr.a (mgr.14355) 15982 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:29.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:29.835 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:30 smithi007 bash[22722]: audit 2024-09-14T04:30:29.393352+0000 mgr.a (mgr.14355) 15983 : audit [DBG] from='client.344994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:30 smithi007 bash[22722]: cluster 2024-09-14T04:30:29.609280+0000 mgr.a (mgr.14355) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:30 smithi131 bash[24745]: audit 2024-09-14T04:30:29.393352+0000 mgr.a (mgr.14355) 15983 : audit [DBG] from='client.344994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:30 smithi131 bash[24745]: cluster 2024-09-14T04:30:29.609280+0000 mgr.a (mgr.14355) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:30 smithi171 bash[25040]: audit 2024-09-14T04:30:29.393352+0000 mgr.a (mgr.14355) 15983 : audit [DBG] from='client.344994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:30 smithi171 bash[25040]: cluster 2024-09-14T04:30:29.609280+0000 mgr.a (mgr.14355) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:32 smithi007 bash[22722]: cluster 2024-09-14T04:30:31.611602+0000 mgr.a (mgr.14355) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:32 smithi131 bash[24745]: cluster 2024-09-14T04:30:31.611602+0000 mgr.a (mgr.14355) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:32 smithi171 bash[25040]: cluster 2024-09-14T04:30:31.611602+0000 mgr.a (mgr.14355) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:34.836 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:34 smithi007 bash[22722]: cluster 2024-09-14T04:30:33.612379+0000 mgr.a (mgr.14355) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:34 smithi131 bash[24745]: cluster 2024-09-14T04:30:33.612379+0000 mgr.a (mgr.14355) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:34 smithi171 bash[25040]: cluster 2024-09-14T04:30:33.612379+0000 mgr.a (mgr.14355) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:35.583 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:35.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:35.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:35.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:35.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:35 smithi007 bash[22722]: audit 2024-09-14T04:30:35.164628+0000 mgr.a (mgr.14355) 15987 : audit [DBG] from='client.345069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:35 smithi131 bash[24745]: audit 2024-09-14T04:30:35.164628+0000 mgr.a (mgr.14355) 15987 : audit [DBG] from='client.345069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:35 smithi171 bash[25040]: audit 2024-09-14T04:30:35.164628+0000 mgr.a (mgr.14355) 15987 : audit [DBG] from='client.345069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:36 smithi007 bash[22722]: cluster 2024-09-14T04:30:35.613758+0000 mgr.a (mgr.14355) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:36 smithi131 bash[24745]: cluster 2024-09-14T04:30:35.613758+0000 mgr.a (mgr.14355) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:36 smithi171 bash[25040]: cluster 2024-09-14T04:30:35.613758+0000 mgr.a (mgr.14355) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:30:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:38 smithi007 bash[22722]: cluster 2024-09-14T04:30:37.614659+0000 mgr.a (mgr.14355) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:38 smithi131 bash[24745]: cluster 2024-09-14T04:30:37.614659+0000 mgr.a (mgr.14355) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:38 smithi171 bash[25040]: cluster 2024-09-14T04:30:37.614659+0000 mgr.a (mgr.14355) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:40.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:40.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:40 smithi007 bash[22722]: cluster 2024-09-14T04:30:39.615445+0000 mgr.a (mgr.14355) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:40 smithi131 bash[24745]: cluster 2024-09-14T04:30:39.615445+0000 mgr.a (mgr.14355) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:40 smithi171 bash[25040]: cluster 2024-09-14T04:30:39.615445+0000 mgr.a (mgr.14355) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:30:41.360 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:41.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:41.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:41.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:41.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:41 smithi007 bash[22722]: audit 2024-09-14T04:30:40.919262+0000 mgr.a (mgr.14355) 15991 : audit [DBG] from='client.345141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:41 smithi131 bash[24745]: audit 2024-09-14T04:30:40.919262+0000 mgr.a (mgr.14355) 15991 : audit [DBG] from='client.345141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:41 smithi171 bash[25040]: audit 2024-09-14T04:30:40.919262+0000 mgr.a (mgr.14355) 15991 : audit [DBG] from='client.345141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:42 smithi007 bash[22722]: cluster 2024-09-14T04:30:41.618322+0000 mgr.a (mgr.14355) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:42 smithi131 bash[24745]: cluster 2024-09-14T04:30:41.618322+0000 mgr.a (mgr.14355) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:42 smithi171 bash[25040]: cluster 2024-09-14T04:30:41.618322+0000 mgr.a (mgr.14355) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:44 smithi007 bash[22722]: cluster 2024-09-14T04:30:43.619234+0000 mgr.a (mgr.14355) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:44 smithi131 bash[24745]: cluster 2024-09-14T04:30:43.619234+0000 mgr.a (mgr.14355) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:45.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:44 smithi171 bash[25040]: cluster 2024-09-14T04:30:43.619234+0000 mgr.a (mgr.14355) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:30:46.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:46.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:46.363 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:47.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:47.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:46 smithi007 bash[22722]: cluster 2024-09-14T04:30:45.621178+0000 mgr.a (mgr.14355) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:46 smithi131 bash[24745]: cluster 2024-09-14T04:30:45.621178+0000 mgr.a (mgr.14355) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:46 smithi171 bash[25040]: cluster 2024-09-14T04:30:45.621178+0000 mgr.a (mgr.14355) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:47 smithi007 bash[22722]: audit 2024-09-14T04:30:46.692700+0000 mgr.a (mgr.14355) 15995 : audit [DBG] from='client.345210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:47 smithi131 bash[24745]: audit 2024-09-14T04:30:46.692700+0000 mgr.a (mgr.14355) 15995 : audit [DBG] from='client.345210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:47 smithi171 bash[25040]: audit 2024-09-14T04:30:46.692700+0000 mgr.a (mgr.14355) 15995 : audit [DBG] from='client.345210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:48 smithi007 bash[22722]: cluster 2024-09-14T04:30:47.622043+0000 mgr.a (mgr.14355) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:48 smithi131 bash[24745]: cluster 2024-09-14T04:30:47.622043+0000 mgr.a (mgr.14355) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:48 smithi171 bash[25040]: cluster 2024-09-14T04:30:47.622043+0000 mgr.a (mgr.14355) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:51 smithi131 bash[24745]: cluster 2024-09-14T04:30:49.622836+0000 mgr.a (mgr.14355) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:51 smithi171 bash[25040]: cluster 2024-09-14T04:30:49.622836+0000 mgr.a (mgr.14355) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:51 smithi007 bash[22722]: cluster 2024-09-14T04:30:49.622836+0000 mgr.a (mgr.14355) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:30:52.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:52.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:52.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:52.902 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:52.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:52.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:52.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:52.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:53 smithi131 bash[24745]: cluster 2024-09-14T04:30:51.625023+0000 mgr.a (mgr.14355) 15998 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:53 smithi171 bash[25040]: cluster 2024-09-14T04:30:51.625023+0000 mgr.a (mgr.14355) 15998 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:53 smithi007 bash[22722]: cluster 2024-09-14T04:30:51.625023+0000 mgr.a (mgr.14355) 15998 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:54 smithi171 bash[25040]: audit 2024-09-14T04:30:52.456694+0000 mgr.a (mgr.14355) 15999 : audit [DBG] from='client.345288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:54 smithi007 bash[22722]: audit 2024-09-14T04:30:52.456694+0000 mgr.a (mgr.14355) 15999 : audit [DBG] from='client.345288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:54 smithi131 bash[24745]: audit 2024-09-14T04:30:52.456694+0000 mgr.a (mgr.14355) 15999 : audit [DBG] from='client.345288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:30:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:55 smithi171 bash[25040]: cluster 2024-09-14T04:30:53.625919+0000 mgr.a (mgr.14355) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:55 smithi007 bash[22722]: cluster 2024-09-14T04:30:53.625919+0000 mgr.a (mgr.14355) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:55 smithi131 bash[24745]: cluster 2024-09-14T04:30:53.625919+0000 mgr.a (mgr.14355) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:57.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:57 smithi171 bash[25040]: cluster 2024-09-14T04:30:55.628158+0000 mgr.a (mgr.14355) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:57 smithi007 bash[22722]: cluster 2024-09-14T04:30:55.628158+0000 mgr.a (mgr.14355) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:57 smithi131 bash[24745]: cluster 2024-09-14T04:30:55.628158+0000 mgr.a (mgr.14355) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:30:57.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:30:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:30:57.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:30:58.663 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:30:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:30:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:30:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:30:58.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:30:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:30:59 smithi007 bash[22722]: cluster 2024-09-14T04:30:57.628915+0000 mgr.a (mgr.14355) 16002 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:30:59 smithi131 bash[24745]: cluster 2024-09-14T04:30:57.628915+0000 mgr.a (mgr.14355) 16002 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:30:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:30:59 smithi171 bash[25040]: cluster 2024-09-14T04:30:57.628915+0000 mgr.a (mgr.14355) 16002 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:00 smithi007 bash[22722]: audit 2024-09-14T04:30:58.232797+0000 mgr.a (mgr.14355) 16003 : audit [DBG] from='client.345366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:00.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:00 smithi131 bash[24745]: audit 2024-09-14T04:30:58.232797+0000 mgr.a (mgr.14355) 16003 : audit [DBG] from='client.345366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:00 smithi171 bash[25040]: audit 2024-09-14T04:30:58.232797+0000 mgr.a (mgr.14355) 16003 : audit [DBG] from='client.345366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:01 smithi007 bash[22722]: cluster 2024-09-14T04:30:59.629808+0000 mgr.a (mgr.14355) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:01 smithi131 bash[24745]: cluster 2024-09-14T04:30:59.629808+0000 mgr.a (mgr.14355) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:01 smithi171 bash[25040]: cluster 2024-09-14T04:30:59.629808+0000 mgr.a (mgr.14355) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:03 smithi007 bash[22722]: cluster 2024-09-14T04:31:01.632181+0000 mgr.a (mgr.14355) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:03 smithi131 bash[24745]: cluster 2024-09-14T04:31:01.632181+0000 mgr.a (mgr.14355) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:03 smithi171 bash[25040]: cluster 2024-09-14T04:31:01.632181+0000 mgr.a (mgr.14355) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:03.665 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:03.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:03.666 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:04.431 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:05 smithi007 bash[22722]: cluster 2024-09-14T04:31:03.632938+0000 mgr.a (mgr.14355) 16006 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:05 smithi007 bash[22722]: audit 2024-09-14T04:31:03.997357+0000 mgr.a (mgr.14355) 16007 : audit [DBG] from='client.345441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:05 smithi131 bash[24745]: cluster 2024-09-14T04:31:03.632938+0000 mgr.a (mgr.14355) 16006 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:05.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:05 smithi131 bash[24745]: audit 2024-09-14T04:31:03.997357+0000 mgr.a (mgr.14355) 16007 : audit [DBG] from='client.345441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:05 smithi171 bash[25040]: cluster 2024-09-14T04:31:03.632938+0000 mgr.a (mgr.14355) 16006 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:05 smithi171 bash[25040]: audit 2024-09-14T04:31:03.997357+0000 mgr.a (mgr.14355) 16007 : audit [DBG] from='client.345441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:07 smithi007 bash[22722]: cluster 2024-09-14T04:31:05.635290+0000 mgr.a (mgr.14355) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:07 smithi131 bash[24745]: cluster 2024-09-14T04:31:05.635290+0000 mgr.a (mgr.14355) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:07 smithi171 bash[25040]: cluster 2024-09-14T04:31:05.635290+0000 mgr.a (mgr.14355) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:09.433 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:09.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:09 smithi007 bash[22722]: cluster 2024-09-14T04:31:07.636067+0000 mgr.a (mgr.14355) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:09 smithi131 bash[24745]: cluster 2024-09-14T04:31:07.636067+0000 mgr.a (mgr.14355) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:09 smithi171 bash[25040]: cluster 2024-09-14T04:31:07.636067+0000 mgr.a (mgr.14355) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:10.185 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:11 smithi007 bash[22722]: cluster 2024-09-14T04:31:09.636805+0000 mgr.a (mgr.14355) 16010 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:11 smithi007 bash[22722]: audit 2024-09-14T04:31:09.764986+0000 mgr.a (mgr.14355) 16011 : audit [DBG] from='client.345516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:11 smithi131 bash[24745]: cluster 2024-09-14T04:31:09.636805+0000 mgr.a (mgr.14355) 16010 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:11 smithi131 bash[24745]: audit 2024-09-14T04:31:09.764986+0000 mgr.a (mgr.14355) 16011 : audit [DBG] from='client.345516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:11 smithi171 bash[25040]: cluster 2024-09-14T04:31:09.636805+0000 mgr.a (mgr.14355) 16010 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:11 smithi171 bash[25040]: audit 2024-09-14T04:31:09.764986+0000 mgr.a (mgr.14355) 16011 : audit [DBG] from='client.345516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:13 smithi007 bash[22722]: cluster 2024-09-14T04:31:11.639263+0000 mgr.a (mgr.14355) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:13 smithi131 bash[24745]: cluster 2024-09-14T04:31:11.639263+0000 mgr.a (mgr.14355) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:13.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:13 smithi171 bash[25040]: cluster 2024-09-14T04:31:11.639263+0000 mgr.a (mgr.14355) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:15 smithi007 bash[22722]: cluster 2024-09-14T04:31:13.640041+0000 mgr.a (mgr.14355) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:15 smithi131 bash[24745]: cluster 2024-09-14T04:31:13.640041+0000 mgr.a (mgr.14355) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:15 smithi171 bash[25040]: cluster 2024-09-14T04:31:13.640041+0000 mgr.a (mgr.14355) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:15.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:17 smithi007 bash[22722]: audit 2024-09-14T04:31:15.522637+0000 mgr.a (mgr.14355) 16014 : audit [DBG] from='client.345588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:17 smithi007 bash[22722]: cluster 2024-09-14T04:31:15.641455+0000 mgr.a (mgr.14355) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:17 smithi131 bash[24745]: audit 2024-09-14T04:31:15.522637+0000 mgr.a (mgr.14355) 16014 : audit [DBG] from='client.345588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:17 smithi131 bash[24745]: cluster 2024-09-14T04:31:15.641455+0000 mgr.a (mgr.14355) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:17 smithi171 bash[25040]: audit 2024-09-14T04:31:15.522637+0000 mgr.a (mgr.14355) 16014 : audit [DBG] from='client.345588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:17 smithi171 bash[25040]: cluster 2024-09-14T04:31:15.641455+0000 mgr.a (mgr.14355) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:19 smithi007 bash[22722]: cluster 2024-09-14T04:31:17.642415+0000 mgr.a (mgr.14355) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:19 smithi131 bash[24745]: cluster 2024-09-14T04:31:17.642415+0000 mgr.a (mgr.14355) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:19 smithi171 bash[25040]: cluster 2024-09-14T04:31:17.642415+0000 mgr.a (mgr.14355) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:20.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:21 smithi007 bash[22722]: cluster 2024-09-14T04:31:19.643191+0000 mgr.a (mgr.14355) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:21 smithi131 bash[24745]: cluster 2024-09-14T04:31:19.643191+0000 mgr.a (mgr.14355) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:21 smithi171 bash[25040]: cluster 2024-09-14T04:31:19.643191+0000 mgr.a (mgr.14355) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:21.753 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:21.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:23 smithi007 bash[22722]: audit 2024-09-14T04:31:21.311027+0000 mgr.a (mgr.14355) 16018 : audit [DBG] from='client.345666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:23 smithi007 bash[22722]: cluster 2024-09-14T04:31:21.653493+0000 mgr.a (mgr.14355) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:23 smithi131 bash[24745]: audit 2024-09-14T04:31:21.311027+0000 mgr.a (mgr.14355) 16018 : audit [DBG] from='client.345666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:23.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:23 smithi131 bash[24745]: cluster 2024-09-14T04:31:21.653493+0000 mgr.a (mgr.14355) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:23 smithi171 bash[25040]: audit 2024-09-14T04:31:21.311027+0000 mgr.a (mgr.14355) 16018 : audit [DBG] from='client.345666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:23 smithi171 bash[25040]: cluster 2024-09-14T04:31:21.653493+0000 mgr.a (mgr.14355) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:24 smithi007 bash[22722]: audit 2024-09-14T04:31:23.651444+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:31:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:24 smithi131 bash[24745]: audit 2024-09-14T04:31:23.651444+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:31:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:24 smithi171 bash[25040]: audit 2024-09-14T04:31:23.651444+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:31:25.457 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22972]: debug 2024-09-14T04:31:25.236+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22972]: debug 2024-09-14T04:31:25.236+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22722]: cluster 2024-09-14T04:31:23.654201+0000 mgr.a (mgr.14355) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22722]: audit 2024-09-14T04:31:24.492525+0000 mon.a (mon.0) 2986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22722]: audit 2024-09-14T04:31:24.493615+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22722]: audit 2024-09-14T04:31:24.501978+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:31:25.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:25 smithi007 bash[22722]: audit 2024-09-14T04:31:24.504518+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:25 smithi131 bash[24745]: cluster 2024-09-14T04:31:23.654201+0000 mgr.a (mgr.14355) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:31:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:25 smithi131 bash[24745]: audit 2024-09-14T04:31:24.492525+0000 mon.a (mon.0) 2986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:31:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:25 smithi131 bash[24745]: audit 2024-09-14T04:31:24.493615+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:31:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:25 smithi131 bash[24745]: audit 2024-09-14T04:31:24.501978+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:31:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:25 smithi131 bash[24745]: audit 2024-09-14T04:31:24.504518+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:25 smithi171 bash[25040]: cluster 2024-09-14T04:31:23.654201+0000 mgr.a (mgr.14355) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:31:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:25 smithi171 bash[25040]: audit 2024-09-14T04:31:24.492525+0000 mon.a (mon.0) 2986 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:31:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:25 smithi171 bash[25040]: audit 2024-09-14T04:31:24.493615+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:31:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:25 smithi171 bash[25040]: audit 2024-09-14T04:31:24.501978+0000 mon.a (mon.0) 2988 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:31:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:25 smithi171 bash[25040]: audit 2024-09-14T04:31:24.504518+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:26 smithi007 bash[22722]: audit 2024-09-14T04:31:24.506892+0000 mgr.a (mgr.14355) 16021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:26 smithi131 bash[24745]: audit 2024-09-14T04:31:24.506892+0000 mgr.a (mgr.14355) 16021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:26 smithi171 bash[25040]: audit 2024-09-14T04:31:24.506892+0000 mgr.a (mgr.14355) 16021 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:31:26.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:26.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:26.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:27 smithi007 bash[22722]: audit 2024-09-14T04:31:25.239540+0000 mgr.a (mgr.14355) 16022 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:31:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:27 smithi007 bash[22722]: cephadm 2024-09-14T04:31:25.240898+0000 mgr.a (mgr.14355) 16023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:31:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:27 smithi007 bash[22722]: cluster 2024-09-14T04:31:25.656517+0000 mgr.a (mgr.14355) 16024 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:27 smithi131 bash[24745]: audit 2024-09-14T04:31:25.239540+0000 mgr.a (mgr.14355) 16022 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:31:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:27 smithi131 bash[24745]: cephadm 2024-09-14T04:31:25.240898+0000 mgr.a (mgr.14355) 16023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:31:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:27 smithi131 bash[24745]: cluster 2024-09-14T04:31:25.656517+0000 mgr.a (mgr.14355) 16024 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:27.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:27.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:27 smithi171 bash[25040]: audit 2024-09-14T04:31:25.239540+0000 mgr.a (mgr.14355) 16022 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:31:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:27 smithi171 bash[25040]: cephadm 2024-09-14T04:31:25.240898+0000 mgr.a (mgr.14355) 16023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:31:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:27 smithi171 bash[25040]: cluster 2024-09-14T04:31:25.656517+0000 mgr.a (mgr.14355) 16024 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:28 smithi007 bash[22722]: audit 2024-09-14T04:31:27.093973+0000 mgr.a (mgr.14355) 16025 : audit [DBG] from='client.345849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:28 smithi131 bash[24745]: audit 2024-09-14T04:31:27.093973+0000 mgr.a (mgr.14355) 16025 : audit [DBG] from='client.345849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:28 smithi171 bash[25040]: audit 2024-09-14T04:31:27.093973+0000 mgr.a (mgr.14355) 16025 : audit [DBG] from='client.345849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:29 smithi007 bash[22722]: cluster 2024-09-14T04:31:27.657473+0000 mgr.a (mgr.14355) 16026 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:29 smithi131 bash[24745]: cluster 2024-09-14T04:31:27.657473+0000 mgr.a (mgr.14355) 16026 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:29 smithi171 bash[25040]: cluster 2024-09-14T04:31:27.657473+0000 mgr.a (mgr.14355) 16026 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:31 smithi007 bash[22722]: cluster 2024-09-14T04:31:29.658327+0000 mgr.a (mgr.14355) 16027 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:31 smithi131 bash[24745]: cluster 2024-09-14T04:31:29.658327+0000 mgr.a (mgr.14355) 16027 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:31 smithi171 bash[25040]: cluster 2024-09-14T04:31:29.658327+0000 mgr.a (mgr.14355) 16027 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:32.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:33.323 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:33 smithi007 bash[22722]: cluster 2024-09-14T04:31:31.660547+0000 mgr.a (mgr.14355) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:33 smithi131 bash[24745]: cluster 2024-09-14T04:31:31.660547+0000 mgr.a (mgr.14355) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:33 smithi171 bash[25040]: cluster 2024-09-14T04:31:31.660547+0000 mgr.a (mgr.14355) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:34 smithi007 bash[22722]: audit 2024-09-14T04:31:32.878580+0000 mgr.a (mgr.14355) 16029 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:34 smithi131 bash[24745]: audit 2024-09-14T04:31:32.878580+0000 mgr.a (mgr.14355) 16029 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:34 smithi171 bash[25040]: audit 2024-09-14T04:31:32.878580+0000 mgr.a (mgr.14355) 16029 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:35 smithi007 bash[22722]: cluster 2024-09-14T04:31:33.661546+0000 mgr.a (mgr.14355) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:35 smithi131 bash[24745]: cluster 2024-09-14T04:31:33.661546+0000 mgr.a (mgr.14355) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:35 smithi171 bash[25040]: cluster 2024-09-14T04:31:33.661546+0000 mgr.a (mgr.14355) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:37 smithi007 bash[22722]: cluster 2024-09-14T04:31:35.663758+0000 mgr.a (mgr.14355) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:37 smithi131 bash[24745]: cluster 2024-09-14T04:31:35.663758+0000 mgr.a (mgr.14355) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:37 smithi171 bash[25040]: cluster 2024-09-14T04:31:35.663758+0000 mgr.a (mgr.14355) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:31:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:39.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:39.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:39.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:39.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:39.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:39 smithi007 bash[22722]: cluster 2024-09-14T04:31:37.664559+0000 mgr.a (mgr.14355) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:39.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:39 smithi131 bash[24745]: cluster 2024-09-14T04:31:37.664559+0000 mgr.a (mgr.14355) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:39 smithi171 bash[25040]: cluster 2024-09-14T04:31:37.664559+0000 mgr.a (mgr.14355) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:40 smithi007 bash[22722]: audit 2024-09-14T04:31:38.656318+0000 mgr.a (mgr.14355) 16033 : audit [DBG] from='client.346002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:40 smithi131 bash[24745]: audit 2024-09-14T04:31:38.656318+0000 mgr.a (mgr.14355) 16033 : audit [DBG] from='client.346002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:40 smithi171 bash[25040]: audit 2024-09-14T04:31:38.656318+0000 mgr.a (mgr.14355) 16033 : audit [DBG] from='client.346002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:41 smithi007 bash[22722]: cluster 2024-09-14T04:31:39.665529+0000 mgr.a (mgr.14355) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:41 smithi131 bash[24745]: cluster 2024-09-14T04:31:39.665529+0000 mgr.a (mgr.14355) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:41 smithi171 bash[25040]: cluster 2024-09-14T04:31:39.665529+0000 mgr.a (mgr.14355) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:43 smithi007 bash[22722]: cluster 2024-09-14T04:31:41.667815+0000 mgr.a (mgr.14355) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:43 smithi131 bash[24745]: cluster 2024-09-14T04:31:41.667815+0000 mgr.a (mgr.14355) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:43 smithi171 bash[25040]: cluster 2024-09-14T04:31:41.667815+0000 mgr.a (mgr.14355) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:44.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:44.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:44.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:45 smithi007 bash[22722]: cluster 2024-09-14T04:31:43.668580+0000 mgr.a (mgr.14355) 16036 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:45 smithi131 bash[24745]: cluster 2024-09-14T04:31:43.668580+0000 mgr.a (mgr.14355) 16036 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:45 smithi171 bash[25040]: cluster 2024-09-14T04:31:43.668580+0000 mgr.a (mgr.14355) 16036 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:46 smithi007 bash[22722]: audit 2024-09-14T04:31:44.408473+0000 mgr.a (mgr.14355) 16037 : audit [DBG] from='client.346077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:46 smithi131 bash[24745]: audit 2024-09-14T04:31:44.408473+0000 mgr.a (mgr.14355) 16037 : audit [DBG] from='client.346077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:46 smithi171 bash[25040]: audit 2024-09-14T04:31:44.408473+0000 mgr.a (mgr.14355) 16037 : audit [DBG] from='client.346077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:47 smithi007 bash[22722]: cluster 2024-09-14T04:31:45.670929+0000 mgr.a (mgr.14355) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:47 smithi131 bash[24745]: cluster 2024-09-14T04:31:45.670929+0000 mgr.a (mgr.14355) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:47 smithi171 bash[25040]: cluster 2024-09-14T04:31:45.670929+0000 mgr.a (mgr.14355) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:31:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:49 smithi007 bash[22722]: cluster 2024-09-14T04:31:47.671689+0000 mgr.a (mgr.14355) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:49 smithi131 bash[24745]: cluster 2024-09-14T04:31:47.671689+0000 mgr.a (mgr.14355) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:49 smithi171 bash[25040]: cluster 2024-09-14T04:31:47.671689+0000 mgr.a (mgr.14355) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:49.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:50.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:50.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:50.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:50.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:51 smithi007 bash[22722]: cluster 2024-09-14T04:31:49.672467+0000 mgr.a (mgr.14355) 16040 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:51 smithi007 bash[22722]: audit 2024-09-14T04:31:50.167624+0000 mgr.a (mgr.14355) 16041 : audit [DBG] from='client.346155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:51 smithi131 bash[24745]: cluster 2024-09-14T04:31:49.672467+0000 mgr.a (mgr.14355) 16040 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:51 smithi131 bash[24745]: audit 2024-09-14T04:31:50.167624+0000 mgr.a (mgr.14355) 16041 : audit [DBG] from='client.346155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:51 smithi171 bash[25040]: cluster 2024-09-14T04:31:49.672467+0000 mgr.a (mgr.14355) 16040 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:51 smithi171 bash[25040]: audit 2024-09-14T04:31:50.167624+0000 mgr.a (mgr.14355) 16041 : audit [DBG] from='client.346155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:53 smithi131 bash[24745]: cluster 2024-09-14T04:31:51.674987+0000 mgr.a (mgr.14355) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:31:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:53 smithi171 bash[25040]: cluster 2024-09-14T04:31:51.674987+0000 mgr.a (mgr.14355) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:31:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:53 smithi007 bash[22722]: cluster 2024-09-14T04:31:51.674987+0000 mgr.a (mgr.14355) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:31:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:55 smithi131 bash[24745]: cluster 2024-09-14T04:31:53.675783+0000 mgr.a (mgr.14355) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:31:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:55 smithi171 bash[25040]: cluster 2024-09-14T04:31:53.675783+0000 mgr.a (mgr.14355) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:31:55.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:31:55.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:31:55.587 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:31:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:55 smithi007 bash[22722]: cluster 2024-09-14T04:31:53.675783+0000 mgr.a (mgr.14355) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:31:56.359 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:31:56.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:31:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:31:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:31:56.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:31:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:57 smithi131 bash[24745]: cluster 2024-09-14T04:31:55.676722+0000 mgr.a (mgr.14355) 16044 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:57 smithi131 bash[24745]: audit 2024-09-14T04:31:55.921193+0000 mgr.a (mgr.14355) 16045 : audit [DBG] from='client.346227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:57 smithi171 bash[25040]: cluster 2024-09-14T04:31:55.676722+0000 mgr.a (mgr.14355) 16044 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:57 smithi171 bash[25040]: audit 2024-09-14T04:31:55.921193+0000 mgr.a (mgr.14355) 16045 : audit [DBG] from='client.346227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:57 smithi007 bash[22722]: cluster 2024-09-14T04:31:55.676722+0000 mgr.a (mgr.14355) 16044 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:31:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:57 smithi007 bash[22722]: audit 2024-09-14T04:31:55.921193+0000 mgr.a (mgr.14355) 16045 : audit [DBG] from='client.346227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:31:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:31:59 smithi131 bash[24745]: cluster 2024-09-14T04:31:57.677628+0000 mgr.a (mgr.14355) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:31:59 smithi171 bash[25040]: cluster 2024-09-14T04:31:57.677628+0000 mgr.a (mgr.14355) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:31:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:31:59 smithi007 bash[22722]: cluster 2024-09-14T04:31:57.677628+0000 mgr.a (mgr.14355) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:32:01.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:01.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:01.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:01 smithi131 bash[24745]: cluster 2024-09-14T04:31:59.678434+0000 mgr.a (mgr.14355) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:32:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:01 smithi171 bash[25040]: cluster 2024-09-14T04:31:59.678434+0000 mgr.a (mgr.14355) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:32:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:01 smithi007 bash[22722]: cluster 2024-09-14T04:31:59.678434+0000 mgr.a (mgr.14355) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:32:02.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:02.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:02.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:02.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:02.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:03 smithi131 bash[24745]: cluster 2024-09-14T04:32:01.680567+0000 mgr.a (mgr.14355) 16048 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:03 smithi131 bash[24745]: audit 2024-09-14T04:32:01.693575+0000 mgr.a (mgr.14355) 16049 : audit [DBG] from='client.346305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:03 smithi171 bash[25040]: cluster 2024-09-14T04:32:01.680567+0000 mgr.a (mgr.14355) 16048 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:03 smithi171 bash[25040]: audit 2024-09-14T04:32:01.693575+0000 mgr.a (mgr.14355) 16049 : audit [DBG] from='client.346305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:03 smithi007 bash[22722]: cluster 2024-09-14T04:32:01.680567+0000 mgr.a (mgr.14355) 16048 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:03 smithi007 bash[22722]: audit 2024-09-14T04:32:01.693575+0000 mgr.a (mgr.14355) 16049 : audit [DBG] from='client.346305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:04 smithi131 bash[24745]: cluster 2024-09-14T04:32:03.681503+0000 mgr.a (mgr.14355) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:04 smithi171 bash[25040]: cluster 2024-09-14T04:32:03.681503+0000 mgr.a (mgr.14355) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:04 smithi007 bash[22722]: cluster 2024-09-14T04:32:03.681503+0000 mgr.a (mgr.14355) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:06 smithi131 bash[24745]: cluster 2024-09-14T04:32:05.683666+0000 mgr.a (mgr.14355) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:06 smithi171 bash[25040]: cluster 2024-09-14T04:32:05.683666+0000 mgr.a (mgr.14355) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:06 smithi007 bash[22722]: cluster 2024-09-14T04:32:05.683666+0000 mgr.a (mgr.14355) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:07.897 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:07.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:07.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:07.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:07.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:08 smithi131 bash[24745]: audit 2024-09-14T04:32:07.450623+0000 mgr.a (mgr.14355) 16052 : audit [DBG] from='client.346380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:08 smithi131 bash[24745]: cluster 2024-09-14T04:32:07.691198+0000 mgr.a (mgr.14355) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:08 smithi171 bash[25040]: audit 2024-09-14T04:32:07.450623+0000 mgr.a (mgr.14355) 16052 : audit [DBG] from='client.346380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:09.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:08 smithi171 bash[25040]: cluster 2024-09-14T04:32:07.691198+0000 mgr.a (mgr.14355) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:08 smithi007 bash[22722]: audit 2024-09-14T04:32:07.450623+0000 mgr.a (mgr.14355) 16052 : audit [DBG] from='client.346380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:09.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:08 smithi007 bash[22722]: cluster 2024-09-14T04:32:07.691198+0000 mgr.a (mgr.14355) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:10 smithi131 bash[24745]: cluster 2024-09-14T04:32:09.692106+0000 mgr.a (mgr.14355) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:10 smithi171 bash[25040]: cluster 2024-09-14T04:32:09.692106+0000 mgr.a (mgr.14355) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:10 smithi007 bash[22722]: cluster 2024-09-14T04:32:09.692106+0000 mgr.a (mgr.14355) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:32:12.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:12 smithi131 bash[24745]: cluster 2024-09-14T04:32:11.694398+0000 mgr.a (mgr.14355) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:12 smithi171 bash[25040]: cluster 2024-09-14T04:32:11.694398+0000 mgr.a (mgr.14355) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:12 smithi007 bash[22722]: cluster 2024-09-14T04:32:11.694398+0000 mgr.a (mgr.14355) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:32:13.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:13.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:14 smithi131 bash[24745]: audit 2024-09-14T04:32:13.230468+0000 mgr.a (mgr.14355) 16056 : audit [DBG] from='client.346458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:14 smithi131 bash[24745]: cluster 2024-09-14T04:32:13.694882+0000 mgr.a (mgr.14355) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:14 smithi171 bash[25040]: audit 2024-09-14T04:32:13.230468+0000 mgr.a (mgr.14355) 16056 : audit [DBG] from='client.346458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:15.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:14 smithi171 bash[25040]: cluster 2024-09-14T04:32:13.694882+0000 mgr.a (mgr.14355) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:14 smithi007 bash[22722]: audit 2024-09-14T04:32:13.230468+0000 mgr.a (mgr.14355) 16056 : audit [DBG] from='client.346458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:15.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:14 smithi007 bash[22722]: cluster 2024-09-14T04:32:13.694882+0000 mgr.a (mgr.14355) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:17 smithi007 bash[22722]: cluster 2024-09-14T04:32:15.697107+0000 mgr.a (mgr.14355) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:17 smithi131 bash[24745]: cluster 2024-09-14T04:32:15.697107+0000 mgr.a (mgr.14355) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:17 smithi171 bash[25040]: cluster 2024-09-14T04:32:15.697107+0000 mgr.a (mgr.14355) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:18.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:18.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:19.414 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:19 smithi007 bash[22722]: cluster 2024-09-14T04:32:17.697892+0000 mgr.a (mgr.14355) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:19.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:19 smithi131 bash[24745]: cluster 2024-09-14T04:32:17.697892+0000 mgr.a (mgr.14355) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:19 smithi171 bash[25040]: cluster 2024-09-14T04:32:17.697892+0000 mgr.a (mgr.14355) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:20 smithi007 bash[22722]: audit 2024-09-14T04:32:18.996414+0000 mgr.a (mgr.14355) 16060 : audit [DBG] from='client.346527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:20 smithi131 bash[24745]: audit 2024-09-14T04:32:18.996414+0000 mgr.a (mgr.14355) 16060 : audit [DBG] from='client.346527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:20 smithi171 bash[25040]: audit 2024-09-14T04:32:18.996414+0000 mgr.a (mgr.14355) 16060 : audit [DBG] from='client.346527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:21 smithi007 bash[22722]: cluster 2024-09-14T04:32:19.698859+0000 mgr.a (mgr.14355) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:21 smithi131 bash[24745]: cluster 2024-09-14T04:32:19.698859+0000 mgr.a (mgr.14355) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:21 smithi171 bash[25040]: cluster 2024-09-14T04:32:19.698859+0000 mgr.a (mgr.14355) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:23 smithi007 bash[22722]: cluster 2024-09-14T04:32:21.701231+0000 mgr.a (mgr.14355) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:23 smithi131 bash[24745]: cluster 2024-09-14T04:32:21.701231+0000 mgr.a (mgr.14355) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:23 smithi171 bash[25040]: cluster 2024-09-14T04:32:21.701231+0000 mgr.a (mgr.14355) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:24.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:24.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:25.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:25.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:25.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:25.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:25.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:25 smithi007 bash[22722]: cluster 2024-09-14T04:32:23.702028+0000 mgr.a (mgr.14355) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:25 smithi131 bash[24745]: cluster 2024-09-14T04:32:23.702028+0000 mgr.a (mgr.14355) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:25 smithi171 bash[25040]: cluster 2024-09-14T04:32:23.702028+0000 mgr.a (mgr.14355) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:26 smithi007 bash[22722]: audit 2024-09-14T04:32:24.754735+0000 mgr.a (mgr.14355) 16064 : audit [DBG] from='client.346596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:26 smithi007 bash[22722]: audit 2024-09-14T04:32:25.294905+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:32:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:26 smithi131 bash[24745]: audit 2024-09-14T04:32:24.754735+0000 mgr.a (mgr.14355) 16064 : audit [DBG] from='client.346596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:26 smithi131 bash[24745]: audit 2024-09-14T04:32:25.294905+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:32:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:26 smithi171 bash[25040]: audit 2024-09-14T04:32:24.754735+0000 mgr.a (mgr.14355) 16064 : audit [DBG] from='client.346596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:26 smithi171 bash[25040]: audit 2024-09-14T04:32:25.294905+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:32:27.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:32:26 smithi007 bash[22972]: debug 2024-09-14T04:32:26.923+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:32:27.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:32:26 smithi007 bash[22972]: debug 2024-09-14T04:32:26.923+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:32:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: cluster 2024-09-14T04:32:25.703528+0000 mgr.a (mgr.14355) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:32:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: audit 2024-09-14T04:32:26.148809+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:32:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: audit 2024-09-14T04:32:26.150533+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:32:27.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: audit 2024-09-14T04:32:26.159224+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:32:27.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: audit 2024-09-14T04:32:26.161572+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:27.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:27 smithi007 bash[22722]: audit 2024-09-14T04:32:26.164184+0000 mgr.a (mgr.14355) 16066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: cluster 2024-09-14T04:32:25.703528+0000 mgr.a (mgr.14355) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:32:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: audit 2024-09-14T04:32:26.148809+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:32:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: audit 2024-09-14T04:32:26.150533+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:32:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: audit 2024-09-14T04:32:26.159224+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:32:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: audit 2024-09-14T04:32:26.161572+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:27.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:27 smithi131 bash[24745]: audit 2024-09-14T04:32:26.164184+0000 mgr.a (mgr.14355) 16066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: cluster 2024-09-14T04:32:25.703528+0000 mgr.a (mgr.14355) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: audit 2024-09-14T04:32:26.148809+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: audit 2024-09-14T04:32:26.150533+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: audit 2024-09-14T04:32:26.159224+0000 mon.a (mon.0) 2993 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: audit 2024-09-14T04:32:26.161572+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:27 smithi171 bash[25040]: audit 2024-09-14T04:32:26.164184+0000 mgr.a (mgr.14355) 16066 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:32:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:28 smithi007 bash[22722]: audit 2024-09-14T04:32:26.928220+0000 mgr.a (mgr.14355) 16067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:32:28.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:28 smithi007 bash[22722]: cephadm 2024-09-14T04:32:26.929561+0000 mgr.a (mgr.14355) 16068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:32:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:28 smithi131 bash[24745]: audit 2024-09-14T04:32:26.928220+0000 mgr.a (mgr.14355) 16067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:32:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:28 smithi131 bash[24745]: cephadm 2024-09-14T04:32:26.929561+0000 mgr.a (mgr.14355) 16068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:32:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:28 smithi171 bash[25040]: audit 2024-09-14T04:32:26.928220+0000 mgr.a (mgr.14355) 16067 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:32:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:28 smithi171 bash[25040]: cephadm 2024-09-14T04:32:26.929561+0000 mgr.a (mgr.14355) 16068 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:32:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:29 smithi007 bash[22722]: cluster 2024-09-14T04:32:27.704605+0000 mgr.a (mgr.14355) 16069 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:29 smithi131 bash[24745]: cluster 2024-09-14T04:32:27.704605+0000 mgr.a (mgr.14355) 16069 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:29 smithi171 bash[25040]: cluster 2024-09-14T04:32:27.704605+0000 mgr.a (mgr.14355) 16069 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:30.999 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:30.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:31 smithi007 bash[22722]: cluster 2024-09-14T04:32:29.705586+0000 mgr.a (mgr.14355) 16070 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:31 smithi131 bash[24745]: cluster 2024-09-14T04:32:29.705586+0000 mgr.a (mgr.14355) 16070 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:31 smithi171 bash[25040]: cluster 2024-09-14T04:32:29.705586+0000 mgr.a (mgr.14355) 16070 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:32:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:32 smithi007 bash[22722]: audit 2024-09-14T04:32:30.543910+0000 mgr.a (mgr.14355) 16071 : audit [DBG] from='client.346782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:32 smithi131 bash[24745]: audit 2024-09-14T04:32:30.543910+0000 mgr.a (mgr.14355) 16071 : audit [DBG] from='client.346782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:32 smithi171 bash[25040]: audit 2024-09-14T04:32:30.543910+0000 mgr.a (mgr.14355) 16071 : audit [DBG] from='client.346782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:33 smithi007 bash[22722]: cluster 2024-09-14T04:32:31.708449+0000 mgr.a (mgr.14355) 16072 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:33 smithi131 bash[24745]: cluster 2024-09-14T04:32:31.708449+0000 mgr.a (mgr.14355) 16072 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:33 smithi171 bash[25040]: cluster 2024-09-14T04:32:31.708449+0000 mgr.a (mgr.14355) 16072 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:35 smithi007 bash[22722]: cluster 2024-09-14T04:32:33.709278+0000 mgr.a (mgr.14355) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:35 smithi131 bash[24745]: cluster 2024-09-14T04:32:33.709278+0000 mgr.a (mgr.14355) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:35 smithi171 bash[25040]: cluster 2024-09-14T04:32:33.709278+0000 mgr.a (mgr.14355) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:36.001 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:36.002 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:36.784 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:36.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:37 smithi007 bash[22722]: cluster 2024-09-14T04:32:35.711213+0000 mgr.a (mgr.14355) 16074 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:37 smithi131 bash[24745]: cluster 2024-09-14T04:32:35.711213+0000 mgr.a (mgr.14355) 16074 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:37 smithi171 bash[25040]: cluster 2024-09-14T04:32:35.711213+0000 mgr.a (mgr.14355) 16074 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:32:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:38 smithi007 bash[22722]: audit 2024-09-14T04:32:36.337542+0000 mgr.a (mgr.14355) 16075 : audit [DBG] from='client.346857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:38 smithi131 bash[24745]: audit 2024-09-14T04:32:36.337542+0000 mgr.a (mgr.14355) 16075 : audit [DBG] from='client.346857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:38 smithi171 bash[25040]: audit 2024-09-14T04:32:36.337542+0000 mgr.a (mgr.14355) 16075 : audit [DBG] from='client.346857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:39 smithi007 bash[22722]: cluster 2024-09-14T04:32:37.712172+0000 mgr.a (mgr.14355) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:39 smithi131 bash[24745]: cluster 2024-09-14T04:32:37.712172+0000 mgr.a (mgr.14355) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:39 smithi171 bash[25040]: cluster 2024-09-14T04:32:37.712172+0000 mgr.a (mgr.14355) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:41 smithi007 bash[22722]: cluster 2024-09-14T04:32:39.712980+0000 mgr.a (mgr.14355) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:41 smithi131 bash[24745]: cluster 2024-09-14T04:32:39.712980+0000 mgr.a (mgr.14355) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:41 smithi171 bash[25040]: cluster 2024-09-14T04:32:39.712980+0000 mgr.a (mgr.14355) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:41.783 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:42.553 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:42.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:42.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:43 smithi007 bash[22722]: cluster 2024-09-14T04:32:41.715258+0000 mgr.a (mgr.14355) 16078 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:32:43.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:43 smithi007 bash[22722]: audit 2024-09-14T04:32:42.118901+0000 mgr.a (mgr.14355) 16079 : audit [DBG] from='client.346932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:43 smithi131 bash[24745]: cluster 2024-09-14T04:32:41.715258+0000 mgr.a (mgr.14355) 16078 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:32:43.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:43 smithi131 bash[24745]: audit 2024-09-14T04:32:42.118901+0000 mgr.a (mgr.14355) 16079 : audit [DBG] from='client.346932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:43 smithi171 bash[25040]: cluster 2024-09-14T04:32:41.715258+0000 mgr.a (mgr.14355) 16078 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:32:43.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:43 smithi171 bash[25040]: audit 2024-09-14T04:32:42.118901+0000 mgr.a (mgr.14355) 16079 : audit [DBG] from='client.346932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:45 smithi007 bash[22722]: cluster 2024-09-14T04:32:43.716151+0000 mgr.a (mgr.14355) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:45 smithi131 bash[24745]: cluster 2024-09-14T04:32:43.716151+0000 mgr.a (mgr.14355) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:45 smithi171 bash[25040]: cluster 2024-09-14T04:32:43.716151+0000 mgr.a (mgr.14355) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:47 smithi007 bash[22722]: cluster 2024-09-14T04:32:45.718329+0000 mgr.a (mgr.14355) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:47 smithi131 bash[24745]: cluster 2024-09-14T04:32:45.718329+0000 mgr.a (mgr.14355) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:47 smithi171 bash[25040]: cluster 2024-09-14T04:32:45.718329+0000 mgr.a (mgr.14355) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:47.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:47.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:48.327 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:48.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:49 smithi007 bash[22722]: cluster 2024-09-14T04:32:47.719052+0000 mgr.a (mgr.14355) 16082 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:49.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:49 smithi007 bash[22722]: audit 2024-09-14T04:32:47.886801+0000 mgr.a (mgr.14355) 16083 : audit [DBG] from='client.347010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:49 smithi131 bash[24745]: cluster 2024-09-14T04:32:47.719052+0000 mgr.a (mgr.14355) 16082 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:49 smithi131 bash[24745]: audit 2024-09-14T04:32:47.886801+0000 mgr.a (mgr.14355) 16083 : audit [DBG] from='client.347010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:49 smithi171 bash[25040]: cluster 2024-09-14T04:32:47.719052+0000 mgr.a (mgr.14355) 16082 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:49 smithi171 bash[25040]: audit 2024-09-14T04:32:47.886801+0000 mgr.a (mgr.14355) 16083 : audit [DBG] from='client.347010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:51 smithi007 bash[22722]: cluster 2024-09-14T04:32:49.719958+0000 mgr.a (mgr.14355) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:51 smithi131 bash[24745]: cluster 2024-09-14T04:32:49.719958+0000 mgr.a (mgr.14355) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:51 smithi171 bash[25040]: cluster 2024-09-14T04:32:49.719958+0000 mgr.a (mgr.14355) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:53.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:53.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:53.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:53 smithi007 bash[22722]: cluster 2024-09-14T04:32:51.722215+0000 mgr.a (mgr.14355) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:53 smithi131 bash[24745]: cluster 2024-09-14T04:32:51.722215+0000 mgr.a (mgr.14355) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:53 smithi171 bash[25040]: cluster 2024-09-14T04:32:51.722215+0000 mgr.a (mgr.14355) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:54.106 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:54.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:32:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:55 smithi007 bash[22722]: audit 2024-09-14T04:32:53.662523+0000 mgr.a (mgr.14355) 16086 : audit [DBG] from='client.347088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:55.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:55 smithi007 bash[22722]: cluster 2024-09-14T04:32:53.723160+0000 mgr.a (mgr.14355) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:55 smithi131 bash[24745]: audit 2024-09-14T04:32:53.662523+0000 mgr.a (mgr.14355) 16086 : audit [DBG] from='client.347088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:55 smithi131 bash[24745]: cluster 2024-09-14T04:32:53.723160+0000 mgr.a (mgr.14355) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:55 smithi171 bash[25040]: audit 2024-09-14T04:32:53.662523+0000 mgr.a (mgr.14355) 16086 : audit [DBG] from='client.347088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:32:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:55 smithi171 bash[25040]: cluster 2024-09-14T04:32:53.723160+0000 mgr.a (mgr.14355) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:57 smithi007 bash[22722]: cluster 2024-09-14T04:32:55.725438+0000 mgr.a (mgr.14355) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:57 smithi131 bash[24745]: cluster 2024-09-14T04:32:55.725438+0000 mgr.a (mgr.14355) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:57 smithi171 bash[25040]: cluster 2024-09-14T04:32:55.725438+0000 mgr.a (mgr.14355) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:32:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:32:59.108 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:32:59.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:32:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:32:59 smithi007 bash[22722]: cluster 2024-09-14T04:32:57.726226+0000 mgr.a (mgr.14355) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:32:59 smithi131 bash[24745]: cluster 2024-09-14T04:32:57.726226+0000 mgr.a (mgr.14355) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:32:59 smithi171 bash[25040]: cluster 2024-09-14T04:32:57.726226+0000 mgr.a (mgr.14355) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:32:59.857 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:32:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:32:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:32:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:32:59.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:01 smithi007 bash[22722]: audit 2024-09-14T04:32:59.431067+0000 mgr.a (mgr.14355) 16090 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:01 smithi007 bash[22722]: cluster 2024-09-14T04:32:59.726778+0000 mgr.a (mgr.14355) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:01 smithi131 bash[24745]: audit 2024-09-14T04:32:59.431067+0000 mgr.a (mgr.14355) 16090 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:01 smithi131 bash[24745]: cluster 2024-09-14T04:32:59.726778+0000 mgr.a (mgr.14355) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:01 smithi171 bash[25040]: audit 2024-09-14T04:32:59.431067+0000 mgr.a (mgr.14355) 16090 : audit [DBG] from='client.347163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:01 smithi171 bash[25040]: cluster 2024-09-14T04:32:59.726778+0000 mgr.a (mgr.14355) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:03 smithi007 bash[22722]: cluster 2024-09-14T04:33:01.729233+0000 mgr.a (mgr.14355) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:03 smithi131 bash[24745]: cluster 2024-09-14T04:33:01.729233+0000 mgr.a (mgr.14355) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:03 smithi171 bash[25040]: cluster 2024-09-14T04:33:01.729233+0000 mgr.a (mgr.14355) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:04.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:05 smithi007 bash[22722]: cluster 2024-09-14T04:33:03.730177+0000 mgr.a (mgr.14355) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:05 smithi131 bash[24745]: cluster 2024-09-14T04:33:03.730177+0000 mgr.a (mgr.14355) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:05 smithi171 bash[25040]: cluster 2024-09-14T04:33:03.730177+0000 mgr.a (mgr.14355) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:05.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:05.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:05.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:05.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:05.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:06 smithi007 bash[22722]: audit 2024-09-14T04:33:05.193727+0000 mgr.a (mgr.14355) 16094 : audit [DBG] from='client.347241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:06 smithi131 bash[24745]: audit 2024-09-14T04:33:05.193727+0000 mgr.a (mgr.14355) 16094 : audit [DBG] from='client.347241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:06 smithi171 bash[25040]: audit 2024-09-14T04:33:05.193727+0000 mgr.a (mgr.14355) 16094 : audit [DBG] from='client.347241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:07 smithi007 bash[22722]: cluster 2024-09-14T04:33:05.731980+0000 mgr.a (mgr.14355) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:33:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:07 smithi131 bash[24745]: cluster 2024-09-14T04:33:05.731980+0000 mgr.a (mgr.14355) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:33:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:07 smithi171 bash[25040]: cluster 2024-09-14T04:33:05.731980+0000 mgr.a (mgr.14355) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:33:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:09 smithi131 bash[24745]: cluster 2024-09-14T04:33:07.732747+0000 mgr.a (mgr.14355) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:09 smithi171 bash[25040]: cluster 2024-09-14T04:33:07.732747+0000 mgr.a (mgr.14355) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:09 smithi007 bash[22722]: cluster 2024-09-14T04:33:07.732747+0000 mgr.a (mgr.14355) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:11.363 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:11.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:11 smithi131 bash[24745]: cluster 2024-09-14T04:33:09.733491+0000 mgr.a (mgr.14355) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:11 smithi171 bash[25040]: cluster 2024-09-14T04:33:09.733491+0000 mgr.a (mgr.14355) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:11 smithi007 bash[22722]: cluster 2024-09-14T04:33:09.733491+0000 mgr.a (mgr.14355) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:33:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:12 smithi131 bash[24745]: audit 2024-09-14T04:33:10.945627+0000 mgr.a (mgr.14355) 16098 : audit [DBG] from='client.347319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:12 smithi171 bash[25040]: audit 2024-09-14T04:33:10.945627+0000 mgr.a (mgr.14355) 16098 : audit [DBG] from='client.347319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:12 smithi007 bash[22722]: audit 2024-09-14T04:33:10.945627+0000 mgr.a (mgr.14355) 16098 : audit [DBG] from='client.347319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:13 smithi131 bash[24745]: cluster 2024-09-14T04:33:11.736248+0000 mgr.a (mgr.14355) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:13 smithi171 bash[25040]: cluster 2024-09-14T04:33:11.736248+0000 mgr.a (mgr.14355) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:13 smithi007 bash[22722]: cluster 2024-09-14T04:33:11.736248+0000 mgr.a (mgr.14355) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:15 smithi131 bash[24745]: cluster 2024-09-14T04:33:13.737025+0000 mgr.a (mgr.14355) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:15 smithi171 bash[25040]: cluster 2024-09-14T04:33:13.737025+0000 mgr.a (mgr.14355) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:15 smithi007 bash[22722]: cluster 2024-09-14T04:33:13.737025+0000 mgr.a (mgr.14355) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:16.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:16.366 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:17.150 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:17.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:17.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:17.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:17.151 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:17 smithi131 bash[24745]: cluster 2024-09-14T04:33:15.738982+0000 mgr.a (mgr.14355) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:17 smithi171 bash[25040]: cluster 2024-09-14T04:33:15.738982+0000 mgr.a (mgr.14355) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:17 smithi007 bash[22722]: cluster 2024-09-14T04:33:15.738982+0000 mgr.a (mgr.14355) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:18 smithi131 bash[24745]: audit 2024-09-14T04:33:16.703210+0000 mgr.a (mgr.14355) 16102 : audit [DBG] from='client.347397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:18 smithi171 bash[25040]: audit 2024-09-14T04:33:16.703210+0000 mgr.a (mgr.14355) 16102 : audit [DBG] from='client.347397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:18 smithi007 bash[22722]: audit 2024-09-14T04:33:16.703210+0000 mgr.a (mgr.14355) 16102 : audit [DBG] from='client.347397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:19 smithi131 bash[24745]: cluster 2024-09-14T04:33:17.739922+0000 mgr.a (mgr.14355) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:19 smithi171 bash[25040]: cluster 2024-09-14T04:33:17.739922+0000 mgr.a (mgr.14355) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:19 smithi007 bash[22722]: cluster 2024-09-14T04:33:17.739922+0000 mgr.a (mgr.14355) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:21 smithi131 bash[24745]: cluster 2024-09-14T04:33:19.740711+0000 mgr.a (mgr.14355) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:21 smithi171 bash[25040]: cluster 2024-09-14T04:33:19.740711+0000 mgr.a (mgr.14355) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:21 smithi007 bash[22722]: cluster 2024-09-14T04:33:19.740711+0000 mgr.a (mgr.14355) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:33:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:22 smithi131 bash[24745]: cluster 2024-09-14T04:33:21.742972+0000 mgr.a (mgr.14355) 16105 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:22 smithi171 bash[25040]: cluster 2024-09-14T04:33:21.742972+0000 mgr.a (mgr.14355) 16105 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:22 smithi007 bash[22722]: cluster 2024-09-14T04:33:21.742972+0000 mgr.a (mgr.14355) 16105 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:22.909 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:22.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:22.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:22.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:22.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:23 smithi131 bash[24745]: audit 2024-09-14T04:33:22.489610+0000 mgr.a (mgr.14355) 16106 : audit [DBG] from='client.347472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:23 smithi171 bash[25040]: audit 2024-09-14T04:33:22.489610+0000 mgr.a (mgr.14355) 16106 : audit [DBG] from='client.347472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:23 smithi007 bash[22722]: audit 2024-09-14T04:33:22.489610+0000 mgr.a (mgr.14355) 16106 : audit [DBG] from='client.347472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:24 smithi131 bash[24745]: cluster 2024-09-14T04:33:23.743885+0000 mgr.a (mgr.14355) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:24 smithi171 bash[25040]: cluster 2024-09-14T04:33:23.743885+0000 mgr.a (mgr.14355) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:24 smithi007 bash[22722]: cluster 2024-09-14T04:33:23.743885+0000 mgr.a (mgr.14355) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:26 smithi007 bash[22722]: cluster 2024-09-14T04:33:25.746024+0000 mgr.a (mgr.14355) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:26 smithi131 bash[24745]: cluster 2024-09-14T04:33:25.746024+0000 mgr.a (mgr.14355) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:26 smithi171 bash[25040]: cluster 2024-09-14T04:33:25.746024+0000 mgr.a (mgr.14355) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:33:27.910 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:27.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:27.911 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:27 smithi007 bash[22722]: audit 2024-09-14T04:33:26.980951+0000 mon.a (mon.0) 2995 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:33:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:27 smithi007 bash[22722]: audit 2024-09-14T04:33:27.604586+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:27 smithi007 bash[22722]: audit 2024-09-14T04:33:27.607967+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:27 smithi131 bash[24745]: audit 2024-09-14T04:33:26.980951+0000 mon.a (mon.0) 2995 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:33:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:27 smithi131 bash[24745]: audit 2024-09-14T04:33:27.604586+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:27 smithi131 bash[24745]: audit 2024-09-14T04:33:27.607967+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:27 smithi171 bash[25040]: audit 2024-09-14T04:33:26.980951+0000 mon.a (mon.0) 2995 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:33:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:27 smithi171 bash[25040]: audit 2024-09-14T04:33:27.604586+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:27 smithi171 bash[25040]: audit 2024-09-14T04:33:27.607967+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:28.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:28.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:28.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:28.674 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:28.674 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: cluster 2024-09-14T04:33:27.746748+0000 mgr.a (mgr.14355) 16109 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: audit 2024-09-14T04:33:28.237709+0000 mgr.a (mgr.14355) 16110 : audit [DBG] from='client.347550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: audit 2024-09-14T04:33:28.484078+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:33:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: audit 2024-09-14T04:33:28.485497+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:33:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: audit 2024-09-14T04:33:28.491631+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:28 smithi007 bash[22722]: audit 2024-09-14T04:33:28.493838+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: cluster 2024-09-14T04:33:27.746748+0000 mgr.a (mgr.14355) 16109 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: audit 2024-09-14T04:33:28.237709+0000 mgr.a (mgr.14355) 16110 : audit [DBG] from='client.347550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: audit 2024-09-14T04:33:28.484078+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:33:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: audit 2024-09-14T04:33:28.485497+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:33:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: audit 2024-09-14T04:33:28.491631+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:28 smithi131 bash[24745]: audit 2024-09-14T04:33:28.493838+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: cluster 2024-09-14T04:33:27.746748+0000 mgr.a (mgr.14355) 16109 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: audit 2024-09-14T04:33:28.237709+0000 mgr.a (mgr.14355) 16110 : audit [DBG] from='client.347550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: audit 2024-09-14T04:33:28.484078+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:33:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: audit 2024-09-14T04:33:28.485497+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:33:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: audit 2024-09-14T04:33:28.491631+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:33:29.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:28 smithi171 bash[25040]: audit 2024-09-14T04:33:28.493838+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:29.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:33:29 smithi007 bash[22972]: debug 2024-09-14T04:33:29.366+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:33:29.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:33:29 smithi007 bash[22972]: debug 2024-09-14T04:33:29.370+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:33:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:29 smithi007 bash[22722]: audit 2024-09-14T04:33:28.495066+0000 mgr.a (mgr.14355) 16111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:29 smithi131 bash[24745]: audit 2024-09-14T04:33:28.495066+0000 mgr.a (mgr.14355) 16111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:29 smithi171 bash[25040]: audit 2024-09-14T04:33:28.495066+0000 mgr.a (mgr.14355) 16111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:33:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:30 smithi007 bash[22722]: audit 2024-09-14T04:33:29.373768+0000 mgr.a (mgr.14355) 16112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:33:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:30 smithi007 bash[22722]: cephadm 2024-09-14T04:33:29.375414+0000 mgr.a (mgr.14355) 16113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:33:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:30 smithi007 bash[22722]: cluster 2024-09-14T04:33:29.747642+0000 mgr.a (mgr.14355) 16114 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:30 smithi131 bash[24745]: audit 2024-09-14T04:33:29.373768+0000 mgr.a (mgr.14355) 16112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:33:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:30 smithi131 bash[24745]: cephadm 2024-09-14T04:33:29.375414+0000 mgr.a (mgr.14355) 16113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:33:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:30 smithi131 bash[24745]: cluster 2024-09-14T04:33:29.747642+0000 mgr.a (mgr.14355) 16114 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:30 smithi171 bash[25040]: audit 2024-09-14T04:33:29.373768+0000 mgr.a (mgr.14355) 16112 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:33:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:30 smithi171 bash[25040]: cephadm 2024-09-14T04:33:29.375414+0000 mgr.a (mgr.14355) 16113 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:33:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:30 smithi171 bash[25040]: cluster 2024-09-14T04:33:29.747642+0000 mgr.a (mgr.14355) 16114 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:33.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:32 smithi007 bash[22722]: cluster 2024-09-14T04:33:31.749921+0000 mgr.a (mgr.14355) 16115 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:32 smithi131 bash[24745]: cluster 2024-09-14T04:33:31.749921+0000 mgr.a (mgr.14355) 16115 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:32 smithi171 bash[25040]: cluster 2024-09-14T04:33:31.749921+0000 mgr.a (mgr.14355) 16115 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:33.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:33.676 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:34.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:34.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:34 smithi007 bash[22722]: cluster 2024-09-14T04:33:33.750707+0000 mgr.a (mgr.14355) 16116 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:34 smithi007 bash[22722]: audit 2024-09-14T04:33:34.005532+0000 mgr.a (mgr.14355) 16117 : audit [DBG] from='client.347733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:34 smithi131 bash[24745]: cluster 2024-09-14T04:33:33.750707+0000 mgr.a (mgr.14355) 16116 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:34 smithi131 bash[24745]: audit 2024-09-14T04:33:34.005532+0000 mgr.a (mgr.14355) 16117 : audit [DBG] from='client.347733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:34 smithi171 bash[25040]: cluster 2024-09-14T04:33:33.750707+0000 mgr.a (mgr.14355) 16116 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:34 smithi171 bash[25040]: audit 2024-09-14T04:33:34.005532+0000 mgr.a (mgr.14355) 16117 : audit [DBG] from='client.347733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:36 smithi007 bash[22722]: cluster 2024-09-14T04:33:35.752934+0000 mgr.a (mgr.14355) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:36 smithi131 bash[24745]: cluster 2024-09-14T04:33:35.752934+0000 mgr.a (mgr.14355) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:36 smithi171 bash[25040]: cluster 2024-09-14T04:33:35.752934+0000 mgr.a (mgr.14355) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:38 smithi007 bash[22722]: cluster 2024-09-14T04:33:37.753668+0000 mgr.a (mgr.14355) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:38 smithi131 bash[24745]: cluster 2024-09-14T04:33:37.753668+0000 mgr.a (mgr.14355) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:38 smithi171 bash[25040]: cluster 2024-09-14T04:33:37.753668+0000 mgr.a (mgr.14355) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:39.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:40.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:40.200 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:40 smithi007 bash[22722]: audit 2024-09-14T04:33:39.755246+0000 mgr.a (mgr.14355) 16120 : audit [DBG] from='client.347808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:40 smithi007 bash[22722]: cluster 2024-09-14T04:33:39.755837+0000 mgr.a (mgr.14355) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:40 smithi131 bash[24745]: audit 2024-09-14T04:33:39.755246+0000 mgr.a (mgr.14355) 16120 : audit [DBG] from='client.347808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:40 smithi131 bash[24745]: cluster 2024-09-14T04:33:39.755837+0000 mgr.a (mgr.14355) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:40 smithi171 bash[25040]: audit 2024-09-14T04:33:39.755246+0000 mgr.a (mgr.14355) 16120 : audit [DBG] from='client.347808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:40 smithi171 bash[25040]: cluster 2024-09-14T04:33:39.755837+0000 mgr.a (mgr.14355) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:42 smithi007 bash[22722]: cluster 2024-09-14T04:33:41.758129+0000 mgr.a (mgr.14355) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:42 smithi131 bash[24745]: cluster 2024-09-14T04:33:41.758129+0000 mgr.a (mgr.14355) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:42 smithi171 bash[25040]: cluster 2024-09-14T04:33:41.758129+0000 mgr.a (mgr.14355) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:33:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:44 smithi007 bash[22722]: cluster 2024-09-14T04:33:43.758902+0000 mgr.a (mgr.14355) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:44 smithi131 bash[24745]: cluster 2024-09-14T04:33:43.758902+0000 mgr.a (mgr.14355) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:44 smithi171 bash[25040]: cluster 2024-09-14T04:33:43.758902+0000 mgr.a (mgr.14355) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:45.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:45.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:45.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:45.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:45.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:46 smithi007 bash[22722]: audit 2024-09-14T04:33:45.537377+0000 mgr.a (mgr.14355) 16124 : audit [DBG] from='client.347886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:47.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:46 smithi007 bash[22722]: cluster 2024-09-14T04:33:45.760113+0000 mgr.a (mgr.14355) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:46 smithi131 bash[24745]: audit 2024-09-14T04:33:45.537377+0000 mgr.a (mgr.14355) 16124 : audit [DBG] from='client.347886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:46 smithi131 bash[24745]: cluster 2024-09-14T04:33:45.760113+0000 mgr.a (mgr.14355) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:46 smithi171 bash[25040]: audit 2024-09-14T04:33:45.537377+0000 mgr.a (mgr.14355) 16124 : audit [DBG] from='client.347886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:46 smithi171 bash[25040]: cluster 2024-09-14T04:33:45.760113+0000 mgr.a (mgr.14355) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:48 smithi007 bash[22722]: cluster 2024-09-14T04:33:47.760928+0000 mgr.a (mgr.14355) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:48 smithi131 bash[24745]: cluster 2024-09-14T04:33:47.760928+0000 mgr.a (mgr.14355) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:48 smithi171 bash[25040]: cluster 2024-09-14T04:33:47.760928+0000 mgr.a (mgr.14355) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:33:50.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:50.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:50.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:50 smithi007 bash[22722]: cluster 2024-09-14T04:33:49.761692+0000 mgr.a (mgr.14355) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:50 smithi131 bash[24745]: cluster 2024-09-14T04:33:49.761692+0000 mgr.a (mgr.14355) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:50 smithi171 bash[25040]: cluster 2024-09-14T04:33:49.761692+0000 mgr.a (mgr.14355) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:51.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:51.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:52 smithi007 bash[22722]: audit 2024-09-14T04:33:51.300973+0000 mgr.a (mgr.14355) 16128 : audit [DBG] from='client.347964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:52 smithi007 bash[22722]: cluster 2024-09-14T04:33:51.762879+0000 mgr.a (mgr.14355) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:52 smithi131 bash[24745]: audit 2024-09-14T04:33:51.300973+0000 mgr.a (mgr.14355) 16128 : audit [DBG] from='client.347964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:53.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:52 smithi131 bash[24745]: cluster 2024-09-14T04:33:51.762879+0000 mgr.a (mgr.14355) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:52 smithi171 bash[25040]: audit 2024-09-14T04:33:51.300973+0000 mgr.a (mgr.14355) 16128 : audit [DBG] from='client.347964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:52 smithi171 bash[25040]: cluster 2024-09-14T04:33:51.762879+0000 mgr.a (mgr.14355) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:54 smithi007 bash[22722]: cluster 2024-09-14T04:33:53.763628+0000 mgr.a (mgr.14355) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:54 smithi131 bash[24745]: cluster 2024-09-14T04:33:53.763628+0000 mgr.a (mgr.14355) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:54 smithi171 bash[25040]: cluster 2024-09-14T04:33:53.763628+0000 mgr.a (mgr.14355) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:33:56.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:33:56.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:33:56.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:33:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:56 smithi007 bash[22722]: cluster 2024-09-14T04:33:55.765562+0000 mgr.a (mgr.14355) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:56 smithi131 bash[24745]: cluster 2024-09-14T04:33:55.765562+0000 mgr.a (mgr.14355) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:56 smithi171 bash[25040]: cluster 2024-09-14T04:33:55.765562+0000 mgr.a (mgr.14355) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:57.490 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:33:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:33:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:33:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:33:57.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:33:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:57 smithi007 bash[22722]: audit 2024-09-14T04:33:57.058643+0000 mgr.a (mgr.14355) 16132 : audit [DBG] from='client.348039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:57 smithi131 bash[24745]: audit 2024-09-14T04:33:57.058643+0000 mgr.a (mgr.14355) 16132 : audit [DBG] from='client.348039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:57 smithi171 bash[25040]: audit 2024-09-14T04:33:57.058643+0000 mgr.a (mgr.14355) 16132 : audit [DBG] from='client.348039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:33:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:33:58 smithi007 bash[22722]: cluster 2024-09-14T04:33:57.766478+0000 mgr.a (mgr.14355) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:33:58 smithi131 bash[24745]: cluster 2024-09-14T04:33:57.766478+0000 mgr.a (mgr.14355) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:33:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:33:58 smithi171 bash[25040]: cluster 2024-09-14T04:33:57.766478+0000 mgr.a (mgr.14355) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:00 smithi007 bash[22722]: cluster 2024-09-14T04:33:59.767244+0000 mgr.a (mgr.14355) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:00 smithi131 bash[24745]: cluster 2024-09-14T04:33:59.767244+0000 mgr.a (mgr.14355) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:00 smithi171 bash[25040]: cluster 2024-09-14T04:33:59.767244+0000 mgr.a (mgr.14355) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:02.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:02.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:02.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:02 smithi007 bash[22722]: cluster 2024-09-14T04:34:01.769435+0000 mgr.a (mgr.14355) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:03.256 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:03.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:02 smithi131 bash[24745]: cluster 2024-09-14T04:34:01.769435+0000 mgr.a (mgr.14355) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:02 smithi171 bash[25040]: cluster 2024-09-14T04:34:01.769435+0000 mgr.a (mgr.14355) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:03 smithi007 bash[22722]: audit 2024-09-14T04:34:02.825346+0000 mgr.a (mgr.14355) 16136 : audit [DBG] from='client.348117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:03 smithi131 bash[24745]: audit 2024-09-14T04:34:02.825346+0000 mgr.a (mgr.14355) 16136 : audit [DBG] from='client.348117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:03 smithi171 bash[25040]: audit 2024-09-14T04:34:02.825346+0000 mgr.a (mgr.14355) 16136 : audit [DBG] from='client.348117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:04 smithi007 bash[22722]: cluster 2024-09-14T04:34:03.770285+0000 mgr.a (mgr.14355) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:04 smithi131 bash[24745]: cluster 2024-09-14T04:34:03.770285+0000 mgr.a (mgr.14355) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:04 smithi171 bash[25040]: cluster 2024-09-14T04:34:03.770285+0000 mgr.a (mgr.14355) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:06 smithi007 bash[22722]: cluster 2024-09-14T04:34:05.772486+0000 mgr.a (mgr.14355) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:06 smithi131 bash[24745]: cluster 2024-09-14T04:34:05.772486+0000 mgr.a (mgr.14355) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:06 smithi171 bash[25040]: cluster 2024-09-14T04:34:05.772486+0000 mgr.a (mgr.14355) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:08.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:08.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:08.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:09.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:09.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:09.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:09.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:09.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:08 smithi007 bash[22722]: cluster 2024-09-14T04:34:07.773250+0000 mgr.a (mgr.14355) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:08 smithi131 bash[24745]: cluster 2024-09-14T04:34:07.773250+0000 mgr.a (mgr.14355) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:08 smithi171 bash[25040]: cluster 2024-09-14T04:34:07.773250+0000 mgr.a (mgr.14355) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:09 smithi007 bash[22722]: audit 2024-09-14T04:34:08.597653+0000 mgr.a (mgr.14355) 16140 : audit [DBG] from='client.348195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:09 smithi131 bash[24745]: audit 2024-09-14T04:34:08.597653+0000 mgr.a (mgr.14355) 16140 : audit [DBG] from='client.348195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:09 smithi171 bash[25040]: audit 2024-09-14T04:34:08.597653+0000 mgr.a (mgr.14355) 16140 : audit [DBG] from='client.348195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:10 smithi007 bash[22722]: cluster 2024-09-14T04:34:09.774122+0000 mgr.a (mgr.14355) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:10 smithi131 bash[24745]: cluster 2024-09-14T04:34:09.774122+0000 mgr.a (mgr.14355) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:10 smithi171 bash[25040]: cluster 2024-09-14T04:34:09.774122+0000 mgr.a (mgr.14355) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:12 smithi007 bash[22722]: cluster 2024-09-14T04:34:11.776357+0000 mgr.a (mgr.14355) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:12 smithi131 bash[24745]: cluster 2024-09-14T04:34:11.776357+0000 mgr.a (mgr.14355) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:12 smithi171 bash[25040]: cluster 2024-09-14T04:34:11.776357+0000 mgr.a (mgr.14355) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:14.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:14.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:14.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:14.831 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:14 smithi007 bash[22722]: cluster 2024-09-14T04:34:13.777110+0000 mgr.a (mgr.14355) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:14 smithi131 bash[24745]: cluster 2024-09-14T04:34:13.777110+0000 mgr.a (mgr.14355) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:14 smithi171 bash[25040]: cluster 2024-09-14T04:34:13.777110+0000 mgr.a (mgr.14355) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:15 smithi007 bash[22722]: audit 2024-09-14T04:34:14.386905+0000 mgr.a (mgr.14355) 16144 : audit [DBG] from='client.348273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:15 smithi131 bash[24745]: audit 2024-09-14T04:34:14.386905+0000 mgr.a (mgr.14355) 16144 : audit [DBG] from='client.348273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:15 smithi171 bash[25040]: audit 2024-09-14T04:34:14.386905+0000 mgr.a (mgr.14355) 16144 : audit [DBG] from='client.348273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:16 smithi007 bash[22722]: cluster 2024-09-14T04:34:15.779423+0000 mgr.a (mgr.14355) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:16 smithi131 bash[24745]: cluster 2024-09-14T04:34:15.779423+0000 mgr.a (mgr.14355) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:16 smithi171 bash[25040]: cluster 2024-09-14T04:34:15.779423+0000 mgr.a (mgr.14355) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:18 smithi007 bash[22722]: cluster 2024-09-14T04:34:17.780185+0000 mgr.a (mgr.14355) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:18 smithi131 bash[24745]: cluster 2024-09-14T04:34:17.780185+0000 mgr.a (mgr.14355) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:18 smithi171 bash[25040]: cluster 2024-09-14T04:34:17.780185+0000 mgr.a (mgr.14355) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:20.614 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:20.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:20.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:20.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:20.614 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:20 smithi007 bash[22722]: cluster 2024-09-14T04:34:19.780937+0000 mgr.a (mgr.14355) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:20 smithi007 bash[22722]: audit 2024-09-14T04:34:20.167987+0000 mgr.a (mgr.14355) 16148 : audit [DBG] from='client.348351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:20 smithi131 bash[24745]: cluster 2024-09-14T04:34:19.780937+0000 mgr.a (mgr.14355) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:20 smithi131 bash[24745]: audit 2024-09-14T04:34:20.167987+0000 mgr.a (mgr.14355) 16148 : audit [DBG] from='client.348351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:20 smithi171 bash[25040]: cluster 2024-09-14T04:34:19.780937+0000 mgr.a (mgr.14355) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:21.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:20 smithi171 bash[25040]: audit 2024-09-14T04:34:20.167987+0000 mgr.a (mgr.14355) 16148 : audit [DBG] from='client.348351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:22 smithi007 bash[22722]: cluster 2024-09-14T04:34:21.783282+0000 mgr.a (mgr.14355) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:34:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:22 smithi131 bash[24745]: cluster 2024-09-14T04:34:21.783282+0000 mgr.a (mgr.14355) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:34:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:22 smithi171 bash[25040]: cluster 2024-09-14T04:34:21.783282+0000 mgr.a (mgr.14355) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:34:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:24 smithi007 bash[22722]: cluster 2024-09-14T04:34:23.784077+0000 mgr.a (mgr.14355) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:34:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:24 smithi131 bash[24745]: cluster 2024-09-14T04:34:23.784077+0000 mgr.a (mgr.14355) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:34:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:24 smithi171 bash[25040]: cluster 2024-09-14T04:34:23.784077+0000 mgr.a (mgr.14355) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:34:25.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:25.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:25.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:26.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:26.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:26.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:26 smithi131 bash[24745]: cluster 2024-09-14T04:34:25.785394+0000 mgr.a (mgr.14355) 16151 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:26 smithi131 bash[24745]: audit 2024-09-14T04:34:25.948223+0000 mgr.a (mgr.14355) 16152 : audit [DBG] from='client.348426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:26 smithi171 bash[25040]: cluster 2024-09-14T04:34:25.785394+0000 mgr.a (mgr.14355) 16151 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:26 smithi171 bash[25040]: audit 2024-09-14T04:34:25.948223+0000 mgr.a (mgr.14355) 16152 : audit [DBG] from='client.348426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:26 smithi007 bash[22722]: cluster 2024-09-14T04:34:25.785394+0000 mgr.a (mgr.14355) 16151 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:27.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:26 smithi007 bash[22722]: audit 2024-09-14T04:34:25.948223+0000 mgr.a (mgr.14355) 16152 : audit [DBG] from='client.348426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:28 smithi131 bash[24745]: cluster 2024-09-14T04:34:27.786256+0000 mgr.a (mgr.14355) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:28 smithi171 bash[25040]: cluster 2024-09-14T04:34:27.786256+0000 mgr.a (mgr.14355) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:28 smithi007 bash[22722]: cluster 2024-09-14T04:34:27.786256+0000 mgr.a (mgr.14355) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:29 smithi131 bash[24745]: audit 2024-09-14T04:34:29.430004+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:34:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:29 smithi171 bash[25040]: audit 2024-09-14T04:34:29.430004+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:34:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:29 smithi007 bash[22722]: audit 2024-09-14T04:34:29.430004+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:34:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: cluster 2024-09-14T04:34:29.787005+0000 mgr.a (mgr.14355) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.044442+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.049215+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.054492+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.059676+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.810525+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:34:31.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.812234+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:34:31.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.822345+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:31 smithi171 bash[25040]: audit 2024-09-14T04:34:30.825213+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: cluster 2024-09-14T04:34:29.787005+0000 mgr.a (mgr.14355) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.044442+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.049215+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.054492+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.059676+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.810525+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.812234+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.822345+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22722]: audit 2024-09-14T04:34:30.825213+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: cluster 2024-09-14T04:34:29.787005+0000 mgr.a (mgr.14355) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.044442+0000 mon.a (mon.0) 3003 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.049215+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.054492+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.059676+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.810525+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.812234+0000 mon.a (mon.0) 3008 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.822345+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:34:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:31 smithi131 bash[24745]: audit 2024-09-14T04:34:30.825213+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22972]: debug 2024-09-14T04:34:31.561+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:34:31.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:34:31 smithi007 bash[22972]: debug 2024-09-14T04:34:31.565+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:34:32.138 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:32 smithi007 bash[22722]: audit 2024-09-14T04:34:30.826610+0000 mgr.a (mgr.14355) 16155 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:32 smithi131 bash[24745]: audit 2024-09-14T04:34:30.826610+0000 mgr.a (mgr.14355) 16155 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:32 smithi171 bash[25040]: audit 2024-09-14T04:34:30.826610+0000 mgr.a (mgr.14355) 16155 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:34:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:33 smithi007 bash[22722]: audit 2024-09-14T04:34:31.565440+0000 mgr.a (mgr.14355) 16156 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:34:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:33 smithi007 bash[22722]: cephadm 2024-09-14T04:34:31.566666+0000 mgr.a (mgr.14355) 16157 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:34:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:33 smithi007 bash[22722]: audit 2024-09-14T04:34:31.722432+0000 mgr.a (mgr.14355) 16158 : audit [DBG] from='client.348603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:33 smithi007 bash[22722]: cluster 2024-09-14T04:34:31.788264+0000 mgr.a (mgr.14355) 16159 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:33 smithi131 bash[24745]: audit 2024-09-14T04:34:31.565440+0000 mgr.a (mgr.14355) 16156 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:34:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:33 smithi131 bash[24745]: cephadm 2024-09-14T04:34:31.566666+0000 mgr.a (mgr.14355) 16157 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:34:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:33 smithi131 bash[24745]: audit 2024-09-14T04:34:31.722432+0000 mgr.a (mgr.14355) 16158 : audit [DBG] from='client.348603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:33 smithi131 bash[24745]: cluster 2024-09-14T04:34:31.788264+0000 mgr.a (mgr.14355) 16159 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:33 smithi171 bash[25040]: audit 2024-09-14T04:34:31.565440+0000 mgr.a (mgr.14355) 16156 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:34:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:33 smithi171 bash[25040]: cephadm 2024-09-14T04:34:31.566666+0000 mgr.a (mgr.14355) 16157 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:34:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:33 smithi171 bash[25040]: audit 2024-09-14T04:34:31.722432+0000 mgr.a (mgr.14355) 16158 : audit [DBG] from='client.348603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:33 smithi171 bash[25040]: cluster 2024-09-14T04:34:31.788264+0000 mgr.a (mgr.14355) 16159 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:35 smithi007 bash[22722]: cluster 2024-09-14T04:34:33.789121+0000 mgr.a (mgr.14355) 16160 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:34:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:35 smithi131 bash[24745]: cluster 2024-09-14T04:34:33.789121+0000 mgr.a (mgr.14355) 16160 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:34:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:35 smithi171 bash[25040]: cluster 2024-09-14T04:34:33.789121+0000 mgr.a (mgr.14355) 16160 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:34:37.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:37.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:37.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:37 smithi007 bash[22722]: cluster 2024-09-14T04:34:35.791319+0000 mgr.a (mgr.14355) 16161 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:37 smithi131 bash[24745]: cluster 2024-09-14T04:34:35.791319+0000 mgr.a (mgr.14355) 16161 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:37 smithi171 bash[25040]: cluster 2024-09-14T04:34:35.791319+0000 mgr.a (mgr.14355) 16161 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:37.902 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:37.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:39 smithi007 bash[22722]: audit 2024-09-14T04:34:37.469938+0000 mgr.a (mgr.14355) 16162 : audit [DBG] from='client.348678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:39 smithi007 bash[22722]: cluster 2024-09-14T04:34:37.795983+0000 mgr.a (mgr.14355) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:39 smithi131 bash[24745]: audit 2024-09-14T04:34:37.469938+0000 mgr.a (mgr.14355) 16162 : audit [DBG] from='client.348678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:39.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:39 smithi131 bash[24745]: cluster 2024-09-14T04:34:37.795983+0000 mgr.a (mgr.14355) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:39.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:39 smithi171 bash[25040]: audit 2024-09-14T04:34:37.469938+0000 mgr.a (mgr.14355) 16162 : audit [DBG] from='client.348678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:39.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:39 smithi171 bash[25040]: cluster 2024-09-14T04:34:37.795983+0000 mgr.a (mgr.14355) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:41 smithi007 bash[22722]: cluster 2024-09-14T04:34:39.796772+0000 mgr.a (mgr.14355) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:41 smithi131 bash[24745]: cluster 2024-09-14T04:34:39.796772+0000 mgr.a (mgr.14355) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:41 smithi171 bash[25040]: cluster 2024-09-14T04:34:39.796772+0000 mgr.a (mgr.14355) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:43 smithi007 bash[22722]: cluster 2024-09-14T04:34:41.799063+0000 mgr.a (mgr.14355) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:43 smithi131 bash[24745]: cluster 2024-09-14T04:34:41.799063+0000 mgr.a (mgr.14355) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:43 smithi171 bash[25040]: cluster 2024-09-14T04:34:41.799063+0000 mgr.a (mgr.14355) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:43.681 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:43.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:43.682 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:44 smithi007 bash[22722]: audit 2024-09-14T04:34:43.237426+0000 mgr.a (mgr.14355) 16166 : audit [DBG] from='client.348756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:44 smithi131 bash[24745]: audit 2024-09-14T04:34:43.237426+0000 mgr.a (mgr.14355) 16166 : audit [DBG] from='client.348756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:44 smithi171 bash[25040]: audit 2024-09-14T04:34:43.237426+0000 mgr.a (mgr.14355) 16166 : audit [DBG] from='client.348756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:45 smithi007 bash[22722]: cluster 2024-09-14T04:34:43.800056+0000 mgr.a (mgr.14355) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:45 smithi131 bash[24745]: cluster 2024-09-14T04:34:43.800056+0000 mgr.a (mgr.14355) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:45 smithi171 bash[25040]: cluster 2024-09-14T04:34:43.800056+0000 mgr.a (mgr.14355) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:47 smithi007 bash[22722]: cluster 2024-09-14T04:34:45.802265+0000 mgr.a (mgr.14355) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:47.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:47 smithi131 bash[24745]: cluster 2024-09-14T04:34:45.802265+0000 mgr.a (mgr.14355) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:47 smithi171 bash[25040]: cluster 2024-09-14T04:34:45.802265+0000 mgr.a (mgr.14355) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:34:48.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:48.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:48.683 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:49.450 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:49.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:49.451 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:49 smithi007 bash[22722]: cluster 2024-09-14T04:34:47.803216+0000 mgr.a (mgr.14355) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:49.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:49 smithi131 bash[24745]: cluster 2024-09-14T04:34:47.803216+0000 mgr.a (mgr.14355) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:49 smithi171 bash[25040]: cluster 2024-09-14T04:34:47.803216+0000 mgr.a (mgr.14355) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:50 smithi007 bash[22722]: audit 2024-09-14T04:34:49.024716+0000 mgr.a (mgr.14355) 16170 : audit [DBG] from='client.348831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:50 smithi131 bash[24745]: audit 2024-09-14T04:34:49.024716+0000 mgr.a (mgr.14355) 16170 : audit [DBG] from='client.348831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:50 smithi171 bash[25040]: audit 2024-09-14T04:34:49.024716+0000 mgr.a (mgr.14355) 16170 : audit [DBG] from='client.348831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:51 smithi007 bash[22722]: cluster 2024-09-14T04:34:49.804179+0000 mgr.a (mgr.14355) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:51 smithi131 bash[24745]: cluster 2024-09-14T04:34:49.804179+0000 mgr.a (mgr.14355) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:51 smithi171 bash[25040]: cluster 2024-09-14T04:34:49.804179+0000 mgr.a (mgr.14355) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:53 smithi007 bash[22722]: cluster 2024-09-14T04:34:51.806448+0000 mgr.a (mgr.14355) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:53 smithi131 bash[24745]: cluster 2024-09-14T04:34:51.806448+0000 mgr.a (mgr.14355) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:53 smithi171 bash[25040]: cluster 2024-09-14T04:34:51.806448+0000 mgr.a (mgr.14355) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:54.452 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:34:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:34:54.453 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:34:55.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:34:55.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:34:55.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:34:55.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:34:55.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:34:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:55 smithi007 bash[22722]: cluster 2024-09-14T04:34:53.807217+0000 mgr.a (mgr.14355) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:55 smithi131 bash[24745]: cluster 2024-09-14T04:34:53.807217+0000 mgr.a (mgr.14355) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:55 smithi171 bash[25040]: cluster 2024-09-14T04:34:53.807217+0000 mgr.a (mgr.14355) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:56 smithi007 bash[22722]: audit 2024-09-14T04:34:54.788778+0000 mgr.a (mgr.14355) 16174 : audit [DBG] from='client.348909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:56 smithi131 bash[24745]: audit 2024-09-14T04:34:54.788778+0000 mgr.a (mgr.14355) 16174 : audit [DBG] from='client.348909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:56 smithi171 bash[25040]: audit 2024-09-14T04:34:54.788778+0000 mgr.a (mgr.14355) 16174 : audit [DBG] from='client.348909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:34:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:57 smithi007 bash[22722]: cluster 2024-09-14T04:34:55.809534+0000 mgr.a (mgr.14355) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:57 smithi131 bash[24745]: cluster 2024-09-14T04:34:55.809534+0000 mgr.a (mgr.14355) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:57 smithi171 bash[25040]: cluster 2024-09-14T04:34:55.809534+0000 mgr.a (mgr.14355) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:34:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:34:59 smithi007 bash[22722]: cluster 2024-09-14T04:34:57.810370+0000 mgr.a (mgr.14355) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:34:59 smithi131 bash[24745]: cluster 2024-09-14T04:34:57.810370+0000 mgr.a (mgr.14355) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:34:59.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:34:59 smithi171 bash[25040]: cluster 2024-09-14T04:34:57.810370+0000 mgr.a (mgr.14355) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:00.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:00.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:00.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:00.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:01 smithi007 bash[22722]: cluster 2024-09-14T04:34:59.811184+0000 mgr.a (mgr.14355) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:01 smithi131 bash[24745]: cluster 2024-09-14T04:34:59.811184+0000 mgr.a (mgr.14355) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:01 smithi171 bash[25040]: cluster 2024-09-14T04:34:59.811184+0000 mgr.a (mgr.14355) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:02 smithi007 bash[22722]: audit 2024-09-14T04:35:00.561738+0000 mgr.a (mgr.14355) 16178 : audit [DBG] from='client.348987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:02 smithi131 bash[24745]: audit 2024-09-14T04:35:00.561738+0000 mgr.a (mgr.14355) 16178 : audit [DBG] from='client.348987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:02 smithi171 bash[25040]: audit 2024-09-14T04:35:00.561738+0000 mgr.a (mgr.14355) 16178 : audit [DBG] from='client.348987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:03 smithi007 bash[22722]: cluster 2024-09-14T04:35:01.813970+0000 mgr.a (mgr.14355) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:03 smithi131 bash[24745]: cluster 2024-09-14T04:35:01.813970+0000 mgr.a (mgr.14355) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:03.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:03 smithi171 bash[25040]: cluster 2024-09-14T04:35:01.813970+0000 mgr.a (mgr.14355) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:05 smithi007 bash[22722]: cluster 2024-09-14T04:35:03.814759+0000 mgr.a (mgr.14355) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:05 smithi131 bash[24745]: cluster 2024-09-14T04:35:03.814759+0000 mgr.a (mgr.14355) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:05 smithi171 bash[25040]: cluster 2024-09-14T04:35:03.814759+0000 mgr.a (mgr.14355) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:05.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:05.980 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:06.729 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:06.729 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:07 smithi007 bash[22722]: cluster 2024-09-14T04:35:05.816599+0000 mgr.a (mgr.14355) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:07 smithi131 bash[24745]: cluster 2024-09-14T04:35:05.816599+0000 mgr.a (mgr.14355) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:07 smithi171 bash[25040]: cluster 2024-09-14T04:35:05.816599+0000 mgr.a (mgr.14355) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:08.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:08 smithi007 bash[22722]: audit 2024-09-14T04:35:06.310832+0000 mgr.a (mgr.14355) 16182 : audit [DBG] from='client.349065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:08 smithi131 bash[24745]: audit 2024-09-14T04:35:06.310832+0000 mgr.a (mgr.14355) 16182 : audit [DBG] from='client.349065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:08 smithi171 bash[25040]: audit 2024-09-14T04:35:06.310832+0000 mgr.a (mgr.14355) 16182 : audit [DBG] from='client.349065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:09 smithi007 bash[22722]: cluster 2024-09-14T04:35:07.817701+0000 mgr.a (mgr.14355) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:09 smithi131 bash[24745]: cluster 2024-09-14T04:35:07.817701+0000 mgr.a (mgr.14355) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:09 smithi171 bash[25040]: cluster 2024-09-14T04:35:07.817701+0000 mgr.a (mgr.14355) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:35:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:11 smithi007 bash[22722]: cluster 2024-09-14T04:35:09.818688+0000 mgr.a (mgr.14355) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:35:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:11 smithi131 bash[24745]: cluster 2024-09-14T04:35:09.818688+0000 mgr.a (mgr.14355) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:35:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:11 smithi171 bash[25040]: cluster 2024-09-14T04:35:09.818688+0000 mgr.a (mgr.14355) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:35:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:12.505 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:13 smithi007 bash[22722]: cluster 2024-09-14T04:35:11.820211+0000 mgr.a (mgr.14355) 16185 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:13 smithi007 bash[22722]: audit 2024-09-14T04:35:12.066433+0000 mgr.a (mgr.14355) 16186 : audit [DBG] from='client.349143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:13 smithi131 bash[24745]: cluster 2024-09-14T04:35:11.820211+0000 mgr.a (mgr.14355) 16185 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:13 smithi131 bash[24745]: audit 2024-09-14T04:35:12.066433+0000 mgr.a (mgr.14355) 16186 : audit [DBG] from='client.349143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:13 smithi171 bash[25040]: cluster 2024-09-14T04:35:11.820211+0000 mgr.a (mgr.14355) 16185 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:13 smithi171 bash[25040]: audit 2024-09-14T04:35:12.066433+0000 mgr.a (mgr.14355) 16186 : audit [DBG] from='client.349143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:15 smithi007 bash[22722]: cluster 2024-09-14T04:35:13.821135+0000 mgr.a (mgr.14355) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:15 smithi131 bash[24745]: cluster 2024-09-14T04:35:13.821135+0000 mgr.a (mgr.14355) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:15 smithi171 bash[25040]: cluster 2024-09-14T04:35:13.821135+0000 mgr.a (mgr.14355) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:17 smithi007 bash[22722]: cluster 2024-09-14T04:35:15.823314+0000 mgr.a (mgr.14355) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:17.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:17.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:17 smithi131 bash[24745]: cluster 2024-09-14T04:35:15.823314+0000 mgr.a (mgr.14355) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:17 smithi171 bash[25040]: cluster 2024-09-14T04:35:15.823314+0000 mgr.a (mgr.14355) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:18.291 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:18.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:19 smithi007 bash[22722]: cluster 2024-09-14T04:35:17.824164+0000 mgr.a (mgr.14355) 16189 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:19.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:19 smithi007 bash[22722]: audit 2024-09-14T04:35:17.843763+0000 mgr.a (mgr.14355) 16190 : audit [DBG] from='client.349221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:19 smithi131 bash[24745]: cluster 2024-09-14T04:35:17.824164+0000 mgr.a (mgr.14355) 16189 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:19 smithi131 bash[24745]: audit 2024-09-14T04:35:17.843763+0000 mgr.a (mgr.14355) 16190 : audit [DBG] from='client.349221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:19 smithi171 bash[25040]: cluster 2024-09-14T04:35:17.824164+0000 mgr.a (mgr.14355) 16189 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:19.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:19 smithi171 bash[25040]: audit 2024-09-14T04:35:17.843763+0000 mgr.a (mgr.14355) 16190 : audit [DBG] from='client.349221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:21 smithi007 bash[22722]: cluster 2024-09-14T04:35:19.825078+0000 mgr.a (mgr.14355) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:21 smithi131 bash[24745]: cluster 2024-09-14T04:35:19.825078+0000 mgr.a (mgr.14355) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:21 smithi171 bash[25040]: cluster 2024-09-14T04:35:19.825078+0000 mgr.a (mgr.14355) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:23 smithi007 bash[22722]: cluster 2024-09-14T04:35:21.827331+0000 mgr.a (mgr.14355) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:23 smithi131 bash[24745]: cluster 2024-09-14T04:35:21.827331+0000 mgr.a (mgr.14355) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:23 smithi171 bash[25040]: cluster 2024-09-14T04:35:21.827331+0000 mgr.a (mgr.14355) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:24.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:24.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:24.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:24.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:24.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:25 smithi007 bash[22722]: audit 2024-09-14T04:35:23.625271+0000 mgr.a (mgr.14355) 16193 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:25.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:25 smithi007 bash[22722]: cluster 2024-09-14T04:35:23.827879+0000 mgr.a (mgr.14355) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:25 smithi131 bash[24745]: audit 2024-09-14T04:35:23.625271+0000 mgr.a (mgr.14355) 16193 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:25 smithi131 bash[24745]: cluster 2024-09-14T04:35:23.827879+0000 mgr.a (mgr.14355) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:25 smithi171 bash[25040]: audit 2024-09-14T04:35:23.625271+0000 mgr.a (mgr.14355) 16193 : audit [DBG] from='client.349299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:25 smithi171 bash[25040]: cluster 2024-09-14T04:35:23.827879+0000 mgr.a (mgr.14355) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:27 smithi007 bash[22722]: cluster 2024-09-14T04:35:25.830055+0000 mgr.a (mgr.14355) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:27 smithi131 bash[24745]: cluster 2024-09-14T04:35:25.830055+0000 mgr.a (mgr.14355) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:27 smithi171 bash[25040]: cluster 2024-09-14T04:35:25.830055+0000 mgr.a (mgr.14355) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:29 smithi007 bash[22722]: cluster 2024-09-14T04:35:27.830835+0000 mgr.a (mgr.14355) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:29 smithi131 bash[24745]: cluster 2024-09-14T04:35:27.830835+0000 mgr.a (mgr.14355) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:29 smithi171 bash[25040]: cluster 2024-09-14T04:35:27.830835+0000 mgr.a (mgr.14355) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:29.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:29.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:29.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:29.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:29.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:31 smithi131 bash[24745]: audit 2024-09-14T04:35:29.396592+0000 mgr.a (mgr.14355) 16197 : audit [DBG] from='client.349374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:31 smithi131 bash[24745]: cluster 2024-09-14T04:35:29.831336+0000 mgr.a (mgr.14355) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:31 smithi171 bash[25040]: audit 2024-09-14T04:35:29.396592+0000 mgr.a (mgr.14355) 16197 : audit [DBG] from='client.349374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:31 smithi171 bash[25040]: cluster 2024-09-14T04:35:29.831336+0000 mgr.a (mgr.14355) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:31 smithi007 bash[22722]: audit 2024-09-14T04:35:29.396592+0000 mgr.a (mgr.14355) 16197 : audit [DBG] from='client.349374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:31 smithi007 bash[22722]: cluster 2024-09-14T04:35:29.831336+0000 mgr.a (mgr.14355) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:32 smithi131 bash[24745]: audit 2024-09-14T04:35:31.615582+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:35:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:32 smithi171 bash[25040]: audit 2024-09-14T04:35:31.615582+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:35:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:32 smithi007 bash[22722]: audit 2024-09-14T04:35:31.615582+0000 mon.a (mon.0) 3011 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:35:33.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22972]: debug 2024-09-14T04:35:33.192+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22972]: debug 2024-09-14T04:35:33.192+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22722]: cluster 2024-09-14T04:35:31.833596+0000 mgr.a (mgr.14355) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22722]: audit 2024-09-14T04:35:32.442547+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22722]: audit 2024-09-14T04:35:32.444169+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22722]: audit 2024-09-14T04:35:32.452722+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:35:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:33 smithi007 bash[22722]: audit 2024-09-14T04:35:32.457428+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:33 smithi131 bash[24745]: cluster 2024-09-14T04:35:31.833596+0000 mgr.a (mgr.14355) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:33 smithi131 bash[24745]: audit 2024-09-14T04:35:32.442547+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:35:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:33 smithi131 bash[24745]: audit 2024-09-14T04:35:32.444169+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:35:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:33 smithi131 bash[24745]: audit 2024-09-14T04:35:32.452722+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:35:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:33 smithi131 bash[24745]: audit 2024-09-14T04:35:32.457428+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:33 smithi171 bash[25040]: cluster 2024-09-14T04:35:31.833596+0000 mgr.a (mgr.14355) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:33 smithi171 bash[25040]: audit 2024-09-14T04:35:32.442547+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:35:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:33 smithi171 bash[25040]: audit 2024-09-14T04:35:32.444169+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:35:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:33 smithi171 bash[25040]: audit 2024-09-14T04:35:32.452722+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:35:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:33 smithi171 bash[25040]: audit 2024-09-14T04:35:32.457428+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:34 smithi131 bash[24745]: audit 2024-09-14T04:35:32.459684+0000 mgr.a (mgr.14355) 16200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:34 smithi131 bash[24745]: audit 2024-09-14T04:35:33.195137+0000 mgr.a (mgr.14355) 16201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:35:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:34 smithi131 bash[24745]: cephadm 2024-09-14T04:35:33.196407+0000 mgr.a (mgr.14355) 16202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:35:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:34 smithi171 bash[25040]: audit 2024-09-14T04:35:32.459684+0000 mgr.a (mgr.14355) 16200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:34 smithi171 bash[25040]: audit 2024-09-14T04:35:33.195137+0000 mgr.a (mgr.14355) 16201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:35:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:34 smithi171 bash[25040]: cephadm 2024-09-14T04:35:33.196407+0000 mgr.a (mgr.14355) 16202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:35:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:34 smithi007 bash[22722]: audit 2024-09-14T04:35:32.459684+0000 mgr.a (mgr.14355) 16200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:35:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:34 smithi007 bash[22722]: audit 2024-09-14T04:35:33.195137+0000 mgr.a (mgr.14355) 16201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:35:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:34 smithi007 bash[22722]: cephadm 2024-09-14T04:35:33.196407+0000 mgr.a (mgr.14355) 16202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:35:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:34.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:35 smithi131 bash[24745]: cluster 2024-09-14T04:35:33.834591+0000 mgr.a (mgr.14355) 16203 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:35 smithi171 bash[25040]: cluster 2024-09-14T04:35:33.834591+0000 mgr.a (mgr.14355) 16203 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:35.620 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:35.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:35.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:35.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:35.621 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:35 smithi007 bash[22722]: cluster 2024-09-14T04:35:33.834591+0000 mgr.a (mgr.14355) 16203 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:36 smithi131 bash[24745]: audit 2024-09-14T04:35:35.180190+0000 mgr.a (mgr.14355) 16204 : audit [DBG] from='client.349557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:36 smithi171 bash[25040]: audit 2024-09-14T04:35:35.180190+0000 mgr.a (mgr.14355) 16204 : audit [DBG] from='client.349557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:36 smithi007 bash[22722]: audit 2024-09-14T04:35:35.180190+0000 mgr.a (mgr.14355) 16204 : audit [DBG] from='client.349557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:37 smithi131 bash[24745]: cluster 2024-09-14T04:35:35.837103+0000 mgr.a (mgr.14355) 16205 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:37 smithi171 bash[25040]: cluster 2024-09-14T04:35:35.837103+0000 mgr.a (mgr.14355) 16205 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:37 smithi007 bash[22722]: cluster 2024-09-14T04:35:35.837103+0000 mgr.a (mgr.14355) 16205 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:39 smithi131 bash[24745]: cluster 2024-09-14T04:35:37.837884+0000 mgr.a (mgr.14355) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:39 smithi171 bash[25040]: cluster 2024-09-14T04:35:37.837884+0000 mgr.a (mgr.14355) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:39 smithi007 bash[22722]: cluster 2024-09-14T04:35:37.837884+0000 mgr.a (mgr.14355) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:40.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:40.622 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:40.623 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:41.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:41.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:41.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:41.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:41.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:41 smithi131 bash[24745]: cluster 2024-09-14T04:35:39.838675+0000 mgr.a (mgr.14355) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:41 smithi171 bash[25040]: cluster 2024-09-14T04:35:39.838675+0000 mgr.a (mgr.14355) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:41 smithi007 bash[22722]: cluster 2024-09-14T04:35:39.838675+0000 mgr.a (mgr.14355) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:42 smithi131 bash[24745]: audit 2024-09-14T04:35:40.958952+0000 mgr.a (mgr.14355) 16208 : audit [DBG] from='client.349635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:42 smithi171 bash[25040]: audit 2024-09-14T04:35:40.958952+0000 mgr.a (mgr.14355) 16208 : audit [DBG] from='client.349635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:42 smithi007 bash[22722]: audit 2024-09-14T04:35:40.958952+0000 mgr.a (mgr.14355) 16208 : audit [DBG] from='client.349635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:43 smithi131 bash[24745]: cluster 2024-09-14T04:35:41.841414+0000 mgr.a (mgr.14355) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:43 smithi171 bash[25040]: cluster 2024-09-14T04:35:41.841414+0000 mgr.a (mgr.14355) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:43 smithi007 bash[22722]: cluster 2024-09-14T04:35:41.841414+0000 mgr.a (mgr.14355) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:45 smithi131 bash[24745]: cluster 2024-09-14T04:35:43.842364+0000 mgr.a (mgr.14355) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:45 smithi171 bash[25040]: cluster 2024-09-14T04:35:43.842364+0000 mgr.a (mgr.14355) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:45 smithi007 bash[22722]: cluster 2024-09-14T04:35:43.842364+0000 mgr.a (mgr.14355) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:35:46.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:46.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:46.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:47.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:47.145 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:47 smithi131 bash[24745]: cluster 2024-09-14T04:35:45.844487+0000 mgr.a (mgr.14355) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:47 smithi171 bash[25040]: cluster 2024-09-14T04:35:45.844487+0000 mgr.a (mgr.14355) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:47 smithi007 bash[22722]: cluster 2024-09-14T04:35:45.844487+0000 mgr.a (mgr.14355) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:35:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:48 smithi131 bash[24745]: audit 2024-09-14T04:35:46.727209+0000 mgr.a (mgr.14355) 16212 : audit [DBG] from='client.349707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:48 smithi171 bash[25040]: audit 2024-09-14T04:35:46.727209+0000 mgr.a (mgr.14355) 16212 : audit [DBG] from='client.349707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:48 smithi007 bash[22722]: audit 2024-09-14T04:35:46.727209+0000 mgr.a (mgr.14355) 16212 : audit [DBG] from='client.349707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:49 smithi131 bash[24745]: cluster 2024-09-14T04:35:47.845459+0000 mgr.a (mgr.14355) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:49 smithi171 bash[25040]: cluster 2024-09-14T04:35:47.845459+0000 mgr.a (mgr.14355) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:49 smithi007 bash[22722]: cluster 2024-09-14T04:35:47.845459+0000 mgr.a (mgr.14355) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:50 smithi007 bash[22722]: cluster 2024-09-14T04:35:49.846275+0000 mgr.a (mgr.14355) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:50 smithi131 bash[24745]: cluster 2024-09-14T04:35:49.846275+0000 mgr.a (mgr.14355) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:50 smithi171 bash[25040]: cluster 2024-09-14T04:35:49.846275+0000 mgr.a (mgr.14355) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:35:52.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:52.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:52.147 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:52.933 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:52.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:52.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:52.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:52.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:52 smithi007 bash[22722]: cluster 2024-09-14T04:35:51.848439+0000 mgr.a (mgr.14355) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:52 smithi131 bash[24745]: cluster 2024-09-14T04:35:51.848439+0000 mgr.a (mgr.14355) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:52 smithi171 bash[25040]: cluster 2024-09-14T04:35:51.848439+0000 mgr.a (mgr.14355) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:53 smithi007 bash[22722]: audit 2024-09-14T04:35:52.486438+0000 mgr.a (mgr.14355) 16216 : audit [DBG] from='client.349785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:53 smithi131 bash[24745]: audit 2024-09-14T04:35:52.486438+0000 mgr.a (mgr.14355) 16216 : audit [DBG] from='client.349785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:53 smithi171 bash[25040]: audit 2024-09-14T04:35:52.486438+0000 mgr.a (mgr.14355) 16216 : audit [DBG] from='client.349785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:54 smithi007 bash[22722]: cluster 2024-09-14T04:35:53.849403+0000 mgr.a (mgr.14355) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:54 smithi131 bash[24745]: cluster 2024-09-14T04:35:53.849403+0000 mgr.a (mgr.14355) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:54 smithi171 bash[25040]: cluster 2024-09-14T04:35:53.849403+0000 mgr.a (mgr.14355) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:56 smithi007 bash[22722]: cluster 2024-09-14T04:35:55.851580+0000 mgr.a (mgr.14355) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:56 smithi131 bash[24745]: cluster 2024-09-14T04:35:55.851580+0000 mgr.a (mgr.14355) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:56 smithi171 bash[25040]: cluster 2024-09-14T04:35:55.851580+0000 mgr.a (mgr.14355) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:35:57.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:35:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:35:57.935 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:35:58.700 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:35:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:35:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:35:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:35:58.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:35:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:58 smithi007 bash[22722]: cluster 2024-09-14T04:35:57.852373+0000 mgr.a (mgr.14355) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:59.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:35:58 smithi007 bash[22722]: audit 2024-09-14T04:35:58.274059+0000 mgr.a (mgr.14355) 16220 : audit [DBG] from='client.349863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:58 smithi131 bash[24745]: cluster 2024-09-14T04:35:57.852373+0000 mgr.a (mgr.14355) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:35:58 smithi131 bash[24745]: audit 2024-09-14T04:35:58.274059+0000 mgr.a (mgr.14355) 16220 : audit [DBG] from='client.349863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:35:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:58 smithi171 bash[25040]: cluster 2024-09-14T04:35:57.852373+0000 mgr.a (mgr.14355) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:35:59.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:35:58 smithi171 bash[25040]: audit 2024-09-14T04:35:58.274059+0000 mgr.a (mgr.14355) 16220 : audit [DBG] from='client.349863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:00 smithi007 bash[22722]: cluster 2024-09-14T04:35:59.853254+0000 mgr.a (mgr.14355) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:00 smithi131 bash[24745]: cluster 2024-09-14T04:35:59.853254+0000 mgr.a (mgr.14355) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:00 smithi171 bash[25040]: cluster 2024-09-14T04:35:59.853254+0000 mgr.a (mgr.14355) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:02 smithi007 bash[22722]: cluster 2024-09-14T04:36:01.855532+0000 mgr.a (mgr.14355) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:02 smithi131 bash[24745]: cluster 2024-09-14T04:36:01.855532+0000 mgr.a (mgr.14355) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:02 smithi171 bash[25040]: cluster 2024-09-14T04:36:01.855532+0000 mgr.a (mgr.14355) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:04.458 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:04.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:04 smithi007 bash[22722]: cluster 2024-09-14T04:36:03.856105+0000 mgr.a (mgr.14355) 16223 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:04 smithi007 bash[22722]: audit 2024-09-14T04:36:04.033392+0000 mgr.a (mgr.14355) 16224 : audit [DBG] from='client.349938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:04 smithi131 bash[24745]: cluster 2024-09-14T04:36:03.856105+0000 mgr.a (mgr.14355) 16223 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:04 smithi131 bash[24745]: audit 2024-09-14T04:36:04.033392+0000 mgr.a (mgr.14355) 16224 : audit [DBG] from='client.349938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:04 smithi171 bash[25040]: cluster 2024-09-14T04:36:03.856105+0000 mgr.a (mgr.14355) 16223 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:04 smithi171 bash[25040]: audit 2024-09-14T04:36:04.033392+0000 mgr.a (mgr.14355) 16224 : audit [DBG] from='client.349938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:06 smithi007 bash[22722]: cluster 2024-09-14T04:36:05.858340+0000 mgr.a (mgr.14355) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:06 smithi131 bash[24745]: cluster 2024-09-14T04:36:05.858340+0000 mgr.a (mgr.14355) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:06 smithi171 bash[25040]: cluster 2024-09-14T04:36:05.858340+0000 mgr.a (mgr.14355) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:08 smithi007 bash[22722]: cluster 2024-09-14T04:36:07.859091+0000 mgr.a (mgr.14355) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:08 smithi131 bash[24745]: cluster 2024-09-14T04:36:07.859091+0000 mgr.a (mgr.14355) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:08 smithi171 bash[25040]: cluster 2024-09-14T04:36:07.859091+0000 mgr.a (mgr.14355) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:09.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:09.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:09.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:10.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:10.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:10.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:10.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:10.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:10 smithi007 bash[22722]: audit 2024-09-14T04:36:09.790940+0000 mgr.a (mgr.14355) 16227 : audit [DBG] from='client.350010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:10 smithi007 bash[22722]: cluster 2024-09-14T04:36:09.859628+0000 mgr.a (mgr.14355) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:10 smithi131 bash[24745]: audit 2024-09-14T04:36:09.790940+0000 mgr.a (mgr.14355) 16227 : audit [DBG] from='client.350010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:10 smithi131 bash[24745]: cluster 2024-09-14T04:36:09.859628+0000 mgr.a (mgr.14355) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:10 smithi171 bash[25040]: audit 2024-09-14T04:36:09.790940+0000 mgr.a (mgr.14355) 16227 : audit [DBG] from='client.350010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:10 smithi171 bash[25040]: cluster 2024-09-14T04:36:09.859628+0000 mgr.a (mgr.14355) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:12 smithi007 bash[22722]: cluster 2024-09-14T04:36:11.862020+0000 mgr.a (mgr.14355) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:12 smithi131 bash[24745]: cluster 2024-09-14T04:36:11.862020+0000 mgr.a (mgr.14355) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:12 smithi171 bash[25040]: cluster 2024-09-14T04:36:11.862020+0000 mgr.a (mgr.14355) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:15.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:15.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:15.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:14 smithi131 bash[24745]: cluster 2024-09-14T04:36:13.862851+0000 mgr.a (mgr.14355) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:14 smithi171 bash[25040]: cluster 2024-09-14T04:36:13.862851+0000 mgr.a (mgr.14355) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:14 smithi007 bash[22722]: cluster 2024-09-14T04:36:13.862851+0000 mgr.a (mgr.14355) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:16.007 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:16 smithi131 bash[24745]: audit 2024-09-14T04:36:15.552641+0000 mgr.a (mgr.14355) 16231 : audit [DBG] from='client.350085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:16 smithi131 bash[24745]: cluster 2024-09-14T04:36:15.864432+0000 mgr.a (mgr.14355) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:16 smithi171 bash[25040]: audit 2024-09-14T04:36:15.552641+0000 mgr.a (mgr.14355) 16231 : audit [DBG] from='client.350085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:16 smithi171 bash[25040]: cluster 2024-09-14T04:36:15.864432+0000 mgr.a (mgr.14355) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:16 smithi007 bash[22722]: audit 2024-09-14T04:36:15.552641+0000 mgr.a (mgr.14355) 16231 : audit [DBG] from='client.350085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:16 smithi007 bash[22722]: cluster 2024-09-14T04:36:15.864432+0000 mgr.a (mgr.14355) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:18 smithi131 bash[24745]: cluster 2024-09-14T04:36:17.865295+0000 mgr.a (mgr.14355) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:18 smithi171 bash[25040]: cluster 2024-09-14T04:36:17.865295+0000 mgr.a (mgr.14355) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:18 smithi007 bash[22722]: cluster 2024-09-14T04:36:17.865295+0000 mgr.a (mgr.14355) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:21.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:21.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:21.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:20 smithi131 bash[24745]: cluster 2024-09-14T04:36:19.866106+0000 mgr.a (mgr.14355) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:20 smithi171 bash[25040]: cluster 2024-09-14T04:36:19.866106+0000 mgr.a (mgr.14355) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:20 smithi007 bash[22722]: cluster 2024-09-14T04:36:19.866106+0000 mgr.a (mgr.14355) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:21.780 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:21.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:22 smithi131 bash[24745]: audit 2024-09-14T04:36:21.344257+0000 mgr.a (mgr.14355) 16235 : audit [DBG] from='client.350160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:22 smithi131 bash[24745]: cluster 2024-09-14T04:36:21.867396+0000 mgr.a (mgr.14355) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:22 smithi171 bash[25040]: audit 2024-09-14T04:36:21.344257+0000 mgr.a (mgr.14355) 16235 : audit [DBG] from='client.350160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:22 smithi171 bash[25040]: cluster 2024-09-14T04:36:21.867396+0000 mgr.a (mgr.14355) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:22 smithi007 bash[22722]: audit 2024-09-14T04:36:21.344257+0000 mgr.a (mgr.14355) 16235 : audit [DBG] from='client.350160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:22 smithi007 bash[22722]: cluster 2024-09-14T04:36:21.867396+0000 mgr.a (mgr.14355) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:24 smithi131 bash[24745]: cluster 2024-09-14T04:36:23.868135+0000 mgr.a (mgr.14355) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:24 smithi171 bash[25040]: cluster 2024-09-14T04:36:23.868135+0000 mgr.a (mgr.14355) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:24 smithi007 bash[22722]: cluster 2024-09-14T04:36:23.868135+0000 mgr.a (mgr.14355) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:36:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:26.782 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:26 smithi131 bash[24745]: cluster 2024-09-14T04:36:25.870057+0000 mgr.a (mgr.14355) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:26 smithi171 bash[25040]: cluster 2024-09-14T04:36:25.870057+0000 mgr.a (mgr.14355) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:26 smithi007 bash[22722]: cluster 2024-09-14T04:36:25.870057+0000 mgr.a (mgr.14355) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:27.536 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:28 smithi131 bash[24745]: audit 2024-09-14T04:36:27.115312+0000 mgr.a (mgr.14355) 16239 : audit [DBG] from='client.350238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:27 smithi171 bash[25040]: audit 2024-09-14T04:36:27.115312+0000 mgr.a (mgr.14355) 16239 : audit [DBG] from='client.350238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:27 smithi007 bash[22722]: audit 2024-09-14T04:36:27.115312+0000 mgr.a (mgr.14355) 16239 : audit [DBG] from='client.350238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:29 smithi131 bash[24745]: cluster 2024-09-14T04:36:27.871013+0000 mgr.a (mgr.14355) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:29 smithi171 bash[25040]: cluster 2024-09-14T04:36:27.871013+0000 mgr.a (mgr.14355) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:29 smithi007 bash[22722]: cluster 2024-09-14T04:36:27.871013+0000 mgr.a (mgr.14355) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:31 smithi131 bash[24745]: cluster 2024-09-14T04:36:29.871820+0000 mgr.a (mgr.14355) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:31 smithi171 bash[25040]: cluster 2024-09-14T04:36:29.871820+0000 mgr.a (mgr.14355) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:31 smithi007 bash[22722]: cluster 2024-09-14T04:36:29.871820+0000 mgr.a (mgr.14355) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:32.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:32.538 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:32.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:33 smithi131 bash[24745]: cluster 2024-09-14T04:36:31.874181+0000 mgr.a (mgr.14355) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:33 smithi171 bash[25040]: cluster 2024-09-14T04:36:31.874181+0000 mgr.a (mgr.14355) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:33.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:33.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:33 smithi007 bash[22722]: cluster 2024-09-14T04:36:31.874181+0000 mgr.a (mgr.14355) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:36:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:34 smithi131 bash[24745]: audit 2024-09-14T04:36:32.872741+0000 mgr.a (mgr.14355) 16243 : audit [DBG] from='client.350313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:34 smithi131 bash[24745]: audit 2024-09-14T04:36:33.246609+0000 mon.a (mon.0) 3016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:36:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:34 smithi171 bash[25040]: audit 2024-09-14T04:36:32.872741+0000 mgr.a (mgr.14355) 16243 : audit [DBG] from='client.350313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:34 smithi171 bash[25040]: audit 2024-09-14T04:36:33.246609+0000 mon.a (mon.0) 3016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:36:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:34 smithi007 bash[22722]: audit 2024-09-14T04:36:32.872741+0000 mgr.a (mgr.14355) 16243 : audit [DBG] from='client.350313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:34.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:34 smithi007 bash[22722]: audit 2024-09-14T04:36:33.246609+0000 mon.a (mon.0) 3016 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:36:35.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:36:34 smithi007 bash[22972]: debug 2024-09-14T04:36:34.855+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:36:35.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:36:34 smithi007 bash[22972]: debug 2024-09-14T04:36:34.855+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:36:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: cluster 2024-09-14T04:36:33.874809+0000 mgr.a (mgr.14355) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: audit 2024-09-14T04:36:34.077281+0000 mon.a (mon.0) 3017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:36:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: audit 2024-09-14T04:36:34.079104+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:36:35.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: audit 2024-09-14T04:36:34.087264+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:36:35.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: audit 2024-09-14T04:36:34.091938+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:35.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:35 smithi007 bash[22722]: audit 2024-09-14T04:36:34.094706+0000 mgr.a (mgr.14355) 16245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: cluster 2024-09-14T04:36:33.874809+0000 mgr.a (mgr.14355) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: audit 2024-09-14T04:36:34.077281+0000 mon.a (mon.0) 3017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:36:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: audit 2024-09-14T04:36:34.079104+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:36:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: audit 2024-09-14T04:36:34.087264+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:36:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: audit 2024-09-14T04:36:34.091938+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:35.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:35 smithi131 bash[24745]: audit 2024-09-14T04:36:34.094706+0000 mgr.a (mgr.14355) 16245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: cluster 2024-09-14T04:36:33.874809+0000 mgr.a (mgr.14355) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: audit 2024-09-14T04:36:34.077281+0000 mon.a (mon.0) 3017 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: audit 2024-09-14T04:36:34.079104+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: audit 2024-09-14T04:36:34.087264+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: audit 2024-09-14T04:36:34.091938+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:35 smithi171 bash[25040]: audit 2024-09-14T04:36:34.094706+0000 mgr.a (mgr.14355) 16245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:36:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:36 smithi131 bash[24745]: audit 2024-09-14T04:36:34.860520+0000 mgr.a (mgr.14355) 16246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:36:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:36 smithi131 bash[24745]: cephadm 2024-09-14T04:36:34.862025+0000 mgr.a (mgr.14355) 16247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:36:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:36 smithi171 bash[25040]: audit 2024-09-14T04:36:34.860520+0000 mgr.a (mgr.14355) 16246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:36:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:36 smithi171 bash[25040]: cephadm 2024-09-14T04:36:34.862025+0000 mgr.a (mgr.14355) 16247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:36:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:36 smithi007 bash[22722]: audit 2024-09-14T04:36:34.860520+0000 mgr.a (mgr.14355) 16246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:36:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:36 smithi007 bash[22722]: cephadm 2024-09-14T04:36:34.862025+0000 mgr.a (mgr.14355) 16247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:36:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:37 smithi131 bash[24745]: cluster 2024-09-14T04:36:35.877022+0000 mgr.a (mgr.14355) 16248 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:37 smithi171 bash[25040]: cluster 2024-09-14T04:36:35.877022+0000 mgr.a (mgr.14355) 16248 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:37 smithi007 bash[22722]: cluster 2024-09-14T04:36:35.877022+0000 mgr.a (mgr.14355) 16248 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:38.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:39.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:39 smithi171 bash[25040]: cluster 2024-09-14T04:36:37.877785+0000 mgr.a (mgr.14355) 16249 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:39 smithi007 bash[22722]: cluster 2024-09-14T04:36:37.877785+0000 mgr.a (mgr.14355) 16249 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:39 smithi131 bash[24745]: cluster 2024-09-14T04:36:37.877785+0000 mgr.a (mgr.14355) 16249 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:40 smithi171 bash[25040]: audit 2024-09-14T04:36:38.663164+0000 mgr.a (mgr.14355) 16250 : audit [DBG] from='client.350496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:40 smithi007 bash[22722]: audit 2024-09-14T04:36:38.663164+0000 mgr.a (mgr.14355) 16250 : audit [DBG] from='client.350496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:40 smithi131 bash[24745]: audit 2024-09-14T04:36:38.663164+0000 mgr.a (mgr.14355) 16250 : audit [DBG] from='client.350496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:41 smithi007 bash[22722]: cluster 2024-09-14T04:36:39.878701+0000 mgr.a (mgr.14355) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:41 smithi131 bash[24745]: cluster 2024-09-14T04:36:39.878701+0000 mgr.a (mgr.14355) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:41 smithi171 bash[25040]: cluster 2024-09-14T04:36:39.878701+0000 mgr.a (mgr.14355) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:43 smithi007 bash[22722]: cluster 2024-09-14T04:36:41.880949+0000 mgr.a (mgr.14355) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:43 smithi131 bash[24745]: cluster 2024-09-14T04:36:41.880949+0000 mgr.a (mgr.14355) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:43 smithi171 bash[25040]: cluster 2024-09-14T04:36:41.880949+0000 mgr.a (mgr.14355) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:44.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:44.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:44.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:44.857 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:44.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:44.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:44.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:44.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:45.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:45 smithi007 bash[22722]: cluster 2024-09-14T04:36:43.881716+0000 mgr.a (mgr.14355) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:45 smithi131 bash[24745]: cluster 2024-09-14T04:36:43.881716+0000 mgr.a (mgr.14355) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:45 smithi171 bash[25040]: cluster 2024-09-14T04:36:43.881716+0000 mgr.a (mgr.14355) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:46 smithi007 bash[22722]: audit 2024-09-14T04:36:44.434484+0000 mgr.a (mgr.14355) 16254 : audit [DBG] from='client.350574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:46 smithi131 bash[24745]: audit 2024-09-14T04:36:44.434484+0000 mgr.a (mgr.14355) 16254 : audit [DBG] from='client.350574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:46 smithi171 bash[25040]: audit 2024-09-14T04:36:44.434484+0000 mgr.a (mgr.14355) 16254 : audit [DBG] from='client.350574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:47 smithi007 bash[22722]: cluster 2024-09-14T04:36:45.883961+0000 mgr.a (mgr.14355) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:47 smithi131 bash[24745]: cluster 2024-09-14T04:36:45.883961+0000 mgr.a (mgr.14355) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:47 smithi171 bash[25040]: cluster 2024-09-14T04:36:45.883961+0000 mgr.a (mgr.14355) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:36:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:49 smithi007 bash[22722]: cluster 2024-09-14T04:36:47.884900+0000 mgr.a (mgr.14355) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:49 smithi131 bash[24745]: cluster 2024-09-14T04:36:47.884900+0000 mgr.a (mgr.14355) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:49 smithi171 bash[25040]: cluster 2024-09-14T04:36:47.884900+0000 mgr.a (mgr.14355) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:49.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:49.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:50.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:51 smithi007 bash[22722]: cluster 2024-09-14T04:36:49.885702+0000 mgr.a (mgr.14355) 16257 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:51 smithi007 bash[22722]: audit 2024-09-14T04:36:50.191852+0000 mgr.a (mgr.14355) 16258 : audit [DBG] from='client.350652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:51 smithi131 bash[24745]: cluster 2024-09-14T04:36:49.885702+0000 mgr.a (mgr.14355) 16257 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:51 smithi131 bash[24745]: audit 2024-09-14T04:36:50.191852+0000 mgr.a (mgr.14355) 16258 : audit [DBG] from='client.350652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:51 smithi171 bash[25040]: cluster 2024-09-14T04:36:49.885702+0000 mgr.a (mgr.14355) 16257 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:51 smithi171 bash[25040]: audit 2024-09-14T04:36:50.191852+0000 mgr.a (mgr.14355) 16258 : audit [DBG] from='client.350652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:53 smithi007 bash[22722]: cluster 2024-09-14T04:36:51.888440+0000 mgr.a (mgr.14355) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:53 smithi131 bash[24745]: cluster 2024-09-14T04:36:51.888440+0000 mgr.a (mgr.14355) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:53 smithi171 bash[25040]: cluster 2024-09-14T04:36:51.888440+0000 mgr.a (mgr.14355) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:55 smithi007 bash[22722]: cluster 2024-09-14T04:36:53.889250+0000 mgr.a (mgr.14355) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:36:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:55 smithi131 bash[24745]: cluster 2024-09-14T04:36:53.889250+0000 mgr.a (mgr.14355) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:36:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:55 smithi171 bash[25040]: cluster 2024-09-14T04:36:53.889250+0000 mgr.a (mgr.14355) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:36:55.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:36:55.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:36:55.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:36:56.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:36:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:36:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:36:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:36:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:36:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:57 smithi007 bash[22722]: cluster 2024-09-14T04:36:55.890519+0000 mgr.a (mgr.14355) 16261 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:57.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:57 smithi007 bash[22722]: audit 2024-09-14T04:36:55.969611+0000 mgr.a (mgr.14355) 16262 : audit [DBG] from='client.350727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:57 smithi131 bash[24745]: cluster 2024-09-14T04:36:55.890519+0000 mgr.a (mgr.14355) 16261 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:57 smithi131 bash[24745]: audit 2024-09-14T04:36:55.969611+0000 mgr.a (mgr.14355) 16262 : audit [DBG] from='client.350727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:57 smithi171 bash[25040]: cluster 2024-09-14T04:36:55.890519+0000 mgr.a (mgr.14355) 16261 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:36:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:57 smithi171 bash[25040]: audit 2024-09-14T04:36:55.969611+0000 mgr.a (mgr.14355) 16262 : audit [DBG] from='client.350727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:36:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:36:59 smithi007 bash[22722]: cluster 2024-09-14T04:36:57.891438+0000 mgr.a (mgr.14355) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:36:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:36:59 smithi131 bash[24745]: cluster 2024-09-14T04:36:57.891438+0000 mgr.a (mgr.14355) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:36:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:36:59 smithi171 bash[25040]: cluster 2024-09-14T04:36:57.891438+0000 mgr.a (mgr.14355) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:37:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:01 smithi007 bash[22722]: cluster 2024-09-14T04:36:59.892240+0000 mgr.a (mgr.14355) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:37:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:01 smithi131 bash[24745]: cluster 2024-09-14T04:36:59.892240+0000 mgr.a (mgr.14355) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:37:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:01 smithi171 bash[25040]: cluster 2024-09-14T04:36:59.892240+0000 mgr.a (mgr.14355) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:37:02.196 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:02.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:02.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:02.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:02.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:03 smithi007 bash[22722]: audit 2024-09-14T04:37:01.750522+0000 mgr.a (mgr.14355) 16265 : audit [DBG] from='client.350805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:03 smithi007 bash[22722]: cluster 2024-09-14T04:37:01.894838+0000 mgr.a (mgr.14355) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:03 smithi131 bash[24745]: audit 2024-09-14T04:37:01.750522+0000 mgr.a (mgr.14355) 16265 : audit [DBG] from='client.350805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:03 smithi131 bash[24745]: cluster 2024-09-14T04:37:01.894838+0000 mgr.a (mgr.14355) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:03 smithi171 bash[25040]: audit 2024-09-14T04:37:01.750522+0000 mgr.a (mgr.14355) 16265 : audit [DBG] from='client.350805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:03 smithi171 bash[25040]: cluster 2024-09-14T04:37:01.894838+0000 mgr.a (mgr.14355) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:05 smithi007 bash[22722]: cluster 2024-09-14T04:37:03.895700+0000 mgr.a (mgr.14355) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:05 smithi131 bash[24745]: cluster 2024-09-14T04:37:03.895700+0000 mgr.a (mgr.14355) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:05 smithi171 bash[25040]: cluster 2024-09-14T04:37:03.895700+0000 mgr.a (mgr.14355) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:07 smithi007 bash[22722]: cluster 2024-09-14T04:37:05.897859+0000 mgr.a (mgr.14355) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:07 smithi131 bash[24745]: cluster 2024-09-14T04:37:05.897859+0000 mgr.a (mgr.14355) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:07 smithi171 bash[25040]: cluster 2024-09-14T04:37:05.897859+0000 mgr.a (mgr.14355) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:07.981 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:07.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:07.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:07.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:07.981 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:09 smithi007 bash[22722]: audit 2024-09-14T04:37:07.535155+0000 mgr.a (mgr.14355) 16269 : audit [DBG] from='client.350883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:09 smithi007 bash[22722]: cluster 2024-09-14T04:37:07.898449+0000 mgr.a (mgr.14355) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:09 smithi131 bash[24745]: audit 2024-09-14T04:37:07.535155+0000 mgr.a (mgr.14355) 16269 : audit [DBG] from='client.350883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:09 smithi131 bash[24745]: cluster 2024-09-14T04:37:07.898449+0000 mgr.a (mgr.14355) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:09 smithi171 bash[25040]: audit 2024-09-14T04:37:07.535155+0000 mgr.a (mgr.14355) 16269 : audit [DBG] from='client.350883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:09 smithi171 bash[25040]: cluster 2024-09-14T04:37:07.898449+0000 mgr.a (mgr.14355) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:11 smithi007 bash[22722]: cluster 2024-09-14T04:37:09.899339+0000 mgr.a (mgr.14355) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:11 smithi131 bash[24745]: cluster 2024-09-14T04:37:09.899339+0000 mgr.a (mgr.14355) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:11 smithi171 bash[25040]: cluster 2024-09-14T04:37:09.899339+0000 mgr.a (mgr.14355) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:12.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:13 smithi007 bash[22722]: cluster 2024-09-14T04:37:11.901566+0000 mgr.a (mgr.14355) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:13 smithi131 bash[24745]: cluster 2024-09-14T04:37:11.901566+0000 mgr.a (mgr.14355) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:13 smithi171 bash[25040]: cluster 2024-09-14T04:37:11.901566+0000 mgr.a (mgr.14355) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:13.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:13.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:13.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:15.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:15 smithi007 bash[22722]: audit 2024-09-14T04:37:13.322632+0000 mgr.a (mgr.14355) 16273 : audit [DBG] from='client.350961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:15.517 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:15 smithi007 bash[22722]: cluster 2024-09-14T04:37:13.902713+0000 mgr.a (mgr.14355) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:15 smithi131 bash[24745]: audit 2024-09-14T04:37:13.322632+0000 mgr.a (mgr.14355) 16273 : audit [DBG] from='client.350961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:15 smithi131 bash[24745]: cluster 2024-09-14T04:37:13.902713+0000 mgr.a (mgr.14355) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:15 smithi171 bash[25040]: audit 2024-09-14T04:37:13.322632+0000 mgr.a (mgr.14355) 16273 : audit [DBG] from='client.350961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:15 smithi171 bash[25040]: cluster 2024-09-14T04:37:13.902713+0000 mgr.a (mgr.14355) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:17 smithi007 bash[22722]: cluster 2024-09-14T04:37:15.904940+0000 mgr.a (mgr.14355) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:17 smithi131 bash[24745]: cluster 2024-09-14T04:37:15.904940+0000 mgr.a (mgr.14355) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:17 smithi171 bash[25040]: cluster 2024-09-14T04:37:15.904940+0000 mgr.a (mgr.14355) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:18.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:18.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:18.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:19 smithi007 bash[22722]: cluster 2024-09-14T04:37:17.905696+0000 mgr.a (mgr.14355) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:19.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:19.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:19.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:19.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:19.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:19 smithi131 bash[24745]: cluster 2024-09-14T04:37:17.905696+0000 mgr.a (mgr.14355) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:19 smithi171 bash[25040]: cluster 2024-09-14T04:37:17.905696+0000 mgr.a (mgr.14355) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:20 smithi007 bash[22722]: audit 2024-09-14T04:37:19.099204+0000 mgr.a (mgr.14355) 16277 : audit [DBG] from='client.351039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:20 smithi131 bash[24745]: audit 2024-09-14T04:37:19.099204+0000 mgr.a (mgr.14355) 16277 : audit [DBG] from='client.351039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:20 smithi171 bash[25040]: audit 2024-09-14T04:37:19.099204+0000 mgr.a (mgr.14355) 16277 : audit [DBG] from='client.351039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:21.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:21 smithi007 bash[22722]: cluster 2024-09-14T04:37:19.906592+0000 mgr.a (mgr.14355) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:21 smithi131 bash[24745]: cluster 2024-09-14T04:37:19.906592+0000 mgr.a (mgr.14355) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:21 smithi171 bash[25040]: cluster 2024-09-14T04:37:19.906592+0000 mgr.a (mgr.14355) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:23 smithi007 bash[22722]: cluster 2024-09-14T04:37:21.908812+0000 mgr.a (mgr.14355) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:23 smithi131 bash[24745]: cluster 2024-09-14T04:37:21.908812+0000 mgr.a (mgr.14355) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:23 smithi171 bash[25040]: cluster 2024-09-14T04:37:21.908812+0000 mgr.a (mgr.14355) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:24.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:24.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:24.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:25.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:25.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:25.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:25 smithi007 bash[22722]: cluster 2024-09-14T04:37:23.909579+0000 mgr.a (mgr.14355) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:25 smithi131 bash[24745]: cluster 2024-09-14T04:37:23.909579+0000 mgr.a (mgr.14355) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:25 smithi171 bash[25040]: cluster 2024-09-14T04:37:23.909579+0000 mgr.a (mgr.14355) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:26 smithi007 bash[22722]: audit 2024-09-14T04:37:24.852032+0000 mgr.a (mgr.14355) 16281 : audit [DBG] from='client.351117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:26 smithi131 bash[24745]: audit 2024-09-14T04:37:24.852032+0000 mgr.a (mgr.14355) 16281 : audit [DBG] from='client.351117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:26 smithi171 bash[25040]: audit 2024-09-14T04:37:24.852032+0000 mgr.a (mgr.14355) 16281 : audit [DBG] from='client.351117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:27 smithi007 bash[22722]: cluster 2024-09-14T04:37:25.911919+0000 mgr.a (mgr.14355) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:37:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:27 smithi131 bash[24745]: cluster 2024-09-14T04:37:25.911919+0000 mgr.a (mgr.14355) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:37:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:27 smithi171 bash[25040]: cluster 2024-09-14T04:37:25.911919+0000 mgr.a (mgr.14355) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:37:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:29 smithi007 bash[22722]: cluster 2024-09-14T04:37:27.912693+0000 mgr.a (mgr.14355) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:29 smithi131 bash[24745]: cluster 2024-09-14T04:37:27.912693+0000 mgr.a (mgr.14355) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:29 smithi171 bash[25040]: cluster 2024-09-14T04:37:27.912693+0000 mgr.a (mgr.14355) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:30.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:30.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:31.064 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:31 smithi007 bash[22722]: cluster 2024-09-14T04:37:29.913453+0000 mgr.a (mgr.14355) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:31 smithi131 bash[24745]: cluster 2024-09-14T04:37:29.913453+0000 mgr.a (mgr.14355) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:31 smithi171 bash[25040]: cluster 2024-09-14T04:37:29.913453+0000 mgr.a (mgr.14355) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:37:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:32 smithi007 bash[22722]: audit 2024-09-14T04:37:30.618013+0000 mgr.a (mgr.14355) 16285 : audit [DBG] from='client.351195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:32 smithi131 bash[24745]: audit 2024-09-14T04:37:30.618013+0000 mgr.a (mgr.14355) 16285 : audit [DBG] from='client.351195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:32 smithi171 bash[25040]: audit 2024-09-14T04:37:30.618013+0000 mgr.a (mgr.14355) 16285 : audit [DBG] from='client.351195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:33 smithi007 bash[22722]: cluster 2024-09-14T04:37:31.916199+0000 mgr.a (mgr.14355) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:33 smithi131 bash[24745]: cluster 2024-09-14T04:37:31.916199+0000 mgr.a (mgr.14355) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:33 smithi171 bash[25040]: cluster 2024-09-14T04:37:31.916199+0000 mgr.a (mgr.14355) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:35 smithi007 bash[22722]: cluster 2024-09-14T04:37:33.916969+0000 mgr.a (mgr.14355) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:37:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:35 smithi007 bash[22722]: audit 2024-09-14T04:37:34.915567+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:37:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:35 smithi131 bash[24745]: cluster 2024-09-14T04:37:33.916969+0000 mgr.a (mgr.14355) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:37:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:35 smithi131 bash[24745]: audit 2024-09-14T04:37:34.915567+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:37:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:35 smithi171 bash[25040]: cluster 2024-09-14T04:37:33.916969+0000 mgr.a (mgr.14355) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:37:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:35 smithi171 bash[25040]: audit 2024-09-14T04:37:34.915567+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:37:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:36.064 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22722]: audit 2024-09-14T04:37:35.763771+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:37:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22722]: audit 2024-09-14T04:37:35.765610+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:37:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22722]: audit 2024-09-14T04:37:35.772614+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:37:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22722]: audit 2024-09-14T04:37:35.775052+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:36 smithi131 bash[24745]: audit 2024-09-14T04:37:35.763771+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:37:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:36 smithi131 bash[24745]: audit 2024-09-14T04:37:35.765610+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:37:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:36 smithi131 bash[24745]: audit 2024-09-14T04:37:35.772614+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:37:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:36 smithi131 bash[24745]: audit 2024-09-14T04:37:35.775052+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:36 smithi171 bash[25040]: audit 2024-09-14T04:37:35.763771+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:37:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:36 smithi171 bash[25040]: audit 2024-09-14T04:37:35.765610+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:37:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:36 smithi171 bash[25040]: audit 2024-09-14T04:37:35.772614+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:37:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:36 smithi171 bash[25040]: audit 2024-09-14T04:37:35.775052+0000 mon.a (mon.0) 3025 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:36.936 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:36.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:36.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:36.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:36.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22972]: debug 2024-09-14T04:37:36.522+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:37:36.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:37:36 smithi007 bash[22972]: debug 2024-09-14T04:37:36.538+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:37:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:37 smithi007 bash[22722]: audit 2024-09-14T04:37:35.777366+0000 mgr.a (mgr.14355) 16288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:37 smithi007 bash[22722]: cluster 2024-09-14T04:37:35.918772+0000 mgr.a (mgr.14355) 16289 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:37 smithi131 bash[24745]: audit 2024-09-14T04:37:35.777366+0000 mgr.a (mgr.14355) 16288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:37.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:37 smithi131 bash[24745]: cluster 2024-09-14T04:37:35.918772+0000 mgr.a (mgr.14355) 16289 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:37 smithi171 bash[25040]: audit 2024-09-14T04:37:35.777366+0000 mgr.a (mgr.14355) 16288 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:37:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:37 smithi171 bash[25040]: cluster 2024-09-14T04:37:35.918772+0000 mgr.a (mgr.14355) 16289 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:38 smithi007 bash[22722]: audit 2024-09-14T04:37:36.395825+0000 mgr.a (mgr.14355) 16290 : audit [DBG] from='client.351318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:38 smithi007 bash[22722]: audit 2024-09-14T04:37:36.529026+0000 mgr.a (mgr.14355) 16291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:37:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:38 smithi007 bash[22722]: cephadm 2024-09-14T04:37:36.542764+0000 mgr.a (mgr.14355) 16292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:37:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:38 smithi131 bash[24745]: audit 2024-09-14T04:37:36.395825+0000 mgr.a (mgr.14355) 16290 : audit [DBG] from='client.351318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:38 smithi131 bash[24745]: audit 2024-09-14T04:37:36.529026+0000 mgr.a (mgr.14355) 16291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:37:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:38 smithi131 bash[24745]: cephadm 2024-09-14T04:37:36.542764+0000 mgr.a (mgr.14355) 16292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:37:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:38 smithi171 bash[25040]: audit 2024-09-14T04:37:36.395825+0000 mgr.a (mgr.14355) 16290 : audit [DBG] from='client.351318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:38 smithi171 bash[25040]: audit 2024-09-14T04:37:36.529026+0000 mgr.a (mgr.14355) 16291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:37:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:38 smithi171 bash[25040]: cephadm 2024-09-14T04:37:36.542764+0000 mgr.a (mgr.14355) 16292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:37:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:39 smithi007 bash[22722]: cluster 2024-09-14T04:37:37.919623+0000 mgr.a (mgr.14355) 16293 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:39 smithi131 bash[24745]: cluster 2024-09-14T04:37:37.919623+0000 mgr.a (mgr.14355) 16293 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:39 smithi171 bash[25040]: cluster 2024-09-14T04:37:37.919623+0000 mgr.a (mgr.14355) 16293 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:41 smithi131 bash[24745]: cluster 2024-09-14T04:37:39.920542+0000 mgr.a (mgr.14355) 16294 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:41 smithi171 bash[25040]: cluster 2024-09-14T04:37:39.920542+0000 mgr.a (mgr.14355) 16294 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:41 smithi007 bash[22722]: cluster 2024-09-14T04:37:39.920542+0000 mgr.a (mgr.14355) 16294 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:37:41.937 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:41.938 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:42.685 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:42.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:42.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:43 smithi131 bash[24745]: cluster 2024-09-14T04:37:41.922803+0000 mgr.a (mgr.14355) 16295 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:43 smithi131 bash[24745]: audit 2024-09-14T04:37:42.268315+0000 mgr.a (mgr.14355) 16296 : audit [DBG] from='client.351450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:43 smithi171 bash[25040]: cluster 2024-09-14T04:37:41.922803+0000 mgr.a (mgr.14355) 16295 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:43 smithi171 bash[25040]: audit 2024-09-14T04:37:42.268315+0000 mgr.a (mgr.14355) 16296 : audit [DBG] from='client.351450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:43 smithi007 bash[22722]: cluster 2024-09-14T04:37:41.922803+0000 mgr.a (mgr.14355) 16295 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:43 smithi007 bash[22722]: audit 2024-09-14T04:37:42.268315+0000 mgr.a (mgr.14355) 16296 : audit [DBG] from='client.351450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:45 smithi131 bash[24745]: cluster 2024-09-14T04:37:43.923649+0000 mgr.a (mgr.14355) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:45 smithi171 bash[25040]: cluster 2024-09-14T04:37:43.923649+0000 mgr.a (mgr.14355) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:45 smithi007 bash[22722]: cluster 2024-09-14T04:37:43.923649+0000 mgr.a (mgr.14355) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:47 smithi131 bash[24745]: cluster 2024-09-14T04:37:45.925817+0000 mgr.a (mgr.14355) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:47 smithi171 bash[25040]: cluster 2024-09-14T04:37:45.925817+0000 mgr.a (mgr.14355) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:47 smithi007 bash[22722]: cluster 2024-09-14T04:37:45.925817+0000 mgr.a (mgr.14355) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:48.466 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:48.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:49 smithi131 bash[24745]: cluster 2024-09-14T04:37:47.926491+0000 mgr.a (mgr.14355) 16299 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:49 smithi131 bash[24745]: audit 2024-09-14T04:37:48.025978+0000 mgr.a (mgr.14355) 16300 : audit [DBG] from='client.351528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:49 smithi171 bash[25040]: cluster 2024-09-14T04:37:47.926491+0000 mgr.a (mgr.14355) 16299 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:49 smithi171 bash[25040]: audit 2024-09-14T04:37:48.025978+0000 mgr.a (mgr.14355) 16300 : audit [DBG] from='client.351528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:49 smithi007 bash[22722]: cluster 2024-09-14T04:37:47.926491+0000 mgr.a (mgr.14355) 16299 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:49 smithi007 bash[22722]: audit 2024-09-14T04:37:48.025978+0000 mgr.a (mgr.14355) 16300 : audit [DBG] from='client.351528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:51 smithi131 bash[24745]: cluster 2024-09-14T04:37:49.927358+0000 mgr.a (mgr.14355) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:51 smithi171 bash[25040]: cluster 2024-09-14T04:37:49.927358+0000 mgr.a (mgr.14355) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:51 smithi007 bash[22722]: cluster 2024-09-14T04:37:49.927358+0000 mgr.a (mgr.14355) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:53.467 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:53.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:53.468 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:53 smithi131 bash[24745]: cluster 2024-09-14T04:37:51.929585+0000 mgr.a (mgr.14355) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:53 smithi171 bash[25040]: cluster 2024-09-14T04:37:51.929585+0000 mgr.a (mgr.14355) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:53 smithi007 bash[22722]: cluster 2024-09-14T04:37:51.929585+0000 mgr.a (mgr.14355) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:37:54.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:37:54.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:37:54.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:37:54.226 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:37:54.226 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:37:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:55 smithi131 bash[24745]: audit 2024-09-14T04:37:53.798024+0000 mgr.a (mgr.14355) 16303 : audit [DBG] from='client.351603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:55 smithi131 bash[24745]: cluster 2024-09-14T04:37:53.934624+0000 mgr.a (mgr.14355) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:55 smithi171 bash[25040]: audit 2024-09-14T04:37:53.798024+0000 mgr.a (mgr.14355) 16303 : audit [DBG] from='client.351603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:55 smithi171 bash[25040]: cluster 2024-09-14T04:37:53.934624+0000 mgr.a (mgr.14355) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:55.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:55 smithi007 bash[22722]: audit 2024-09-14T04:37:53.798024+0000 mgr.a (mgr.14355) 16303 : audit [DBG] from='client.351603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:37:55.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:55 smithi007 bash[22722]: cluster 2024-09-14T04:37:53.934624+0000 mgr.a (mgr.14355) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:57 smithi131 bash[24745]: cluster 2024-09-14T04:37:55.937029+0000 mgr.a (mgr.14355) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:57 smithi171 bash[25040]: cluster 2024-09-14T04:37:55.937029+0000 mgr.a (mgr.14355) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:57 smithi007 bash[22722]: cluster 2024-09-14T04:37:55.937029+0000 mgr.a (mgr.14355) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:37:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:37:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:37:59.228 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:37:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:37:59 smithi131 bash[24745]: cluster 2024-09-14T04:37:57.937946+0000 mgr.a (mgr.14355) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:37:59 smithi171 bash[25040]: cluster 2024-09-14T04:37:57.937946+0000 mgr.a (mgr.14355) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:37:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:37:59 smithi007 bash[22722]: cluster 2024-09-14T04:37:57.937946+0000 mgr.a (mgr.14355) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:00.008 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:01 smithi131 bash[24745]: audit 2024-09-14T04:37:59.562226+0000 mgr.a (mgr.14355) 16307 : audit [DBG] from='client.351678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:01 smithi131 bash[24745]: cluster 2024-09-14T04:37:59.938593+0000 mgr.a (mgr.14355) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:01 smithi171 bash[25040]: audit 2024-09-14T04:37:59.562226+0000 mgr.a (mgr.14355) 16307 : audit [DBG] from='client.351678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:01 smithi171 bash[25040]: cluster 2024-09-14T04:37:59.938593+0000 mgr.a (mgr.14355) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:01 smithi007 bash[22722]: audit 2024-09-14T04:37:59.562226+0000 mgr.a (mgr.14355) 16307 : audit [DBG] from='client.351678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:01 smithi007 bash[22722]: cluster 2024-09-14T04:37:59.938593+0000 mgr.a (mgr.14355) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:03 smithi131 bash[24745]: cluster 2024-09-14T04:38:01.940783+0000 mgr.a (mgr.14355) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:03 smithi171 bash[25040]: cluster 2024-09-14T04:38:01.940783+0000 mgr.a (mgr.14355) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:03 smithi007 bash[22722]: cluster 2024-09-14T04:38:01.940783+0000 mgr.a (mgr.14355) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:05.009 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:05.010 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:05 smithi131 bash[24745]: cluster 2024-09-14T04:38:03.941538+0000 mgr.a (mgr.14355) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:05 smithi171 bash[25040]: cluster 2024-09-14T04:38:03.941538+0000 mgr.a (mgr.14355) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:05 smithi007 bash[22722]: cluster 2024-09-14T04:38:03.941538+0000 mgr.a (mgr.14355) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:05.766 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:07 smithi131 bash[24745]: audit 2024-09-14T04:38:05.342124+0000 mgr.a (mgr.14355) 16311 : audit [DBG] from='client.351756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:07 smithi131 bash[24745]: cluster 2024-09-14T04:38:05.944199+0000 mgr.a (mgr.14355) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:07 smithi171 bash[25040]: audit 2024-09-14T04:38:05.342124+0000 mgr.a (mgr.14355) 16311 : audit [DBG] from='client.351756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:07 smithi171 bash[25040]: cluster 2024-09-14T04:38:05.944199+0000 mgr.a (mgr.14355) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:07 smithi007 bash[22722]: audit 2024-09-14T04:38:05.342124+0000 mgr.a (mgr.14355) 16311 : audit [DBG] from='client.351756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:07 smithi007 bash[22722]: cluster 2024-09-14T04:38:05.944199+0000 mgr.a (mgr.14355) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:09 smithi131 bash[24745]: cluster 2024-09-14T04:38:07.944990+0000 mgr.a (mgr.14355) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:09 smithi171 bash[25040]: cluster 2024-09-14T04:38:07.944990+0000 mgr.a (mgr.14355) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:09 smithi007 bash[22722]: cluster 2024-09-14T04:38:07.944990+0000 mgr.a (mgr.14355) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:10.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:11.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:11.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:11 smithi131 bash[24745]: cluster 2024-09-14T04:38:09.945768+0000 mgr.a (mgr.14355) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:38:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:11 smithi171 bash[25040]: cluster 2024-09-14T04:38:09.945768+0000 mgr.a (mgr.14355) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:38:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:11 smithi007 bash[22722]: cluster 2024-09-14T04:38:09.945768+0000 mgr.a (mgr.14355) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:38:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:12 smithi131 bash[24745]: audit 2024-09-14T04:38:11.097741+0000 mgr.a (mgr.14355) 16315 : audit [DBG] from='client.351834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:12 smithi171 bash[25040]: audit 2024-09-14T04:38:11.097741+0000 mgr.a (mgr.14355) 16315 : audit [DBG] from='client.351834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:12 smithi007 bash[22722]: audit 2024-09-14T04:38:11.097741+0000 mgr.a (mgr.14355) 16315 : audit [DBG] from='client.351834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:13 smithi131 bash[24745]: cluster 2024-09-14T04:38:11.948428+0000 mgr.a (mgr.14355) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:13 smithi171 bash[25040]: cluster 2024-09-14T04:38:11.948428+0000 mgr.a (mgr.14355) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:13 smithi007 bash[22722]: cluster 2024-09-14T04:38:11.948428+0000 mgr.a (mgr.14355) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:15 smithi171 bash[25040]: cluster 2024-09-14T04:38:13.949266+0000 mgr.a (mgr.14355) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:15 smithi007 bash[22722]: cluster 2024-09-14T04:38:13.949266+0000 mgr.a (mgr.14355) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:15 smithi131 bash[24745]: cluster 2024-09-14T04:38:13.949266+0000 mgr.a (mgr.14355) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:38:16.514 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:16.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:16.515 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:17.298 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:17 smithi171 bash[25040]: cluster 2024-09-14T04:38:15.951283+0000 mgr.a (mgr.14355) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:17 smithi007 bash[22722]: cluster 2024-09-14T04:38:15.951283+0000 mgr.a (mgr.14355) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:17 smithi131 bash[24745]: cluster 2024-09-14T04:38:15.951283+0000 mgr.a (mgr.14355) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:18 smithi171 bash[25040]: audit 2024-09-14T04:38:16.846063+0000 mgr.a (mgr.14355) 16319 : audit [DBG] from='client.351912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:18 smithi007 bash[22722]: audit 2024-09-14T04:38:16.846063+0000 mgr.a (mgr.14355) 16319 : audit [DBG] from='client.351912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:18 smithi131 bash[24745]: audit 2024-09-14T04:38:16.846063+0000 mgr.a (mgr.14355) 16319 : audit [DBG] from='client.351912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:19 smithi007 bash[22722]: cluster 2024-09-14T04:38:17.952208+0000 mgr.a (mgr.14355) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:19 smithi131 bash[24745]: cluster 2024-09-14T04:38:17.952208+0000 mgr.a (mgr.14355) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:19 smithi171 bash[25040]: cluster 2024-09-14T04:38:17.952208+0000 mgr.a (mgr.14355) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:21 smithi007 bash[22722]: cluster 2024-09-14T04:38:19.953003+0000 mgr.a (mgr.14355) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:21 smithi131 bash[24745]: cluster 2024-09-14T04:38:19.953003+0000 mgr.a (mgr.14355) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:21 smithi171 bash[25040]: cluster 2024-09-14T04:38:19.953003+0000 mgr.a (mgr.14355) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:22.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:22.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:23.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:23.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:23 smithi007 bash[22722]: cluster 2024-09-14T04:38:21.955365+0000 mgr.a (mgr.14355) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:23 smithi131 bash[24745]: cluster 2024-09-14T04:38:21.955365+0000 mgr.a (mgr.14355) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:23 smithi171 bash[25040]: cluster 2024-09-14T04:38:21.955365+0000 mgr.a (mgr.14355) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:24 smithi007 bash[22722]: audit 2024-09-14T04:38:22.632472+0000 mgr.a (mgr.14355) 16323 : audit [DBG] from='client.351990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:24 smithi131 bash[24745]: audit 2024-09-14T04:38:22.632472+0000 mgr.a (mgr.14355) 16323 : audit [DBG] from='client.351990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:24 smithi171 bash[25040]: audit 2024-09-14T04:38:22.632472+0000 mgr.a (mgr.14355) 16323 : audit [DBG] from='client.351990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:25 smithi007 bash[22722]: cluster 2024-09-14T04:38:23.956357+0000 mgr.a (mgr.14355) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:25 smithi131 bash[24745]: cluster 2024-09-14T04:38:23.956357+0000 mgr.a (mgr.14355) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:25 smithi171 bash[25040]: cluster 2024-09-14T04:38:23.956357+0000 mgr.a (mgr.14355) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:26 smithi007 bash[22722]: cluster 2024-09-14T04:38:25.958594+0000 mgr.a (mgr.14355) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:26 smithi131 bash[24745]: cluster 2024-09-14T04:38:25.958594+0000 mgr.a (mgr.14355) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:26 smithi171 bash[25040]: cluster 2024-09-14T04:38:25.958594+0000 mgr.a (mgr.14355) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:28.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:28.829 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:28.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:29 smithi131 bash[24745]: cluster 2024-09-14T04:38:27.959369+0000 mgr.a (mgr.14355) 16326 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:29 smithi171 bash[25040]: cluster 2024-09-14T04:38:27.959369+0000 mgr.a (mgr.14355) 16326 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:29 smithi007 bash[22722]: cluster 2024-09-14T04:38:27.959369+0000 mgr.a (mgr.14355) 16326 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:30 smithi131 bash[24745]: audit 2024-09-14T04:38:28.395392+0000 mgr.a (mgr.14355) 16327 : audit [DBG] from='client.352068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:30 smithi171 bash[25040]: audit 2024-09-14T04:38:28.395392+0000 mgr.a (mgr.14355) 16327 : audit [DBG] from='client.352068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:30 smithi007 bash[22722]: audit 2024-09-14T04:38:28.395392+0000 mgr.a (mgr.14355) 16327 : audit [DBG] from='client.352068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:31 smithi131 bash[24745]: cluster 2024-09-14T04:38:29.960332+0000 mgr.a (mgr.14355) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:31 smithi171 bash[25040]: cluster 2024-09-14T04:38:29.960332+0000 mgr.a (mgr.14355) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:31 smithi007 bash[22722]: cluster 2024-09-14T04:38:29.960332+0000 mgr.a (mgr.14355) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:33 smithi131 bash[24745]: cluster 2024-09-14T04:38:31.962606+0000 mgr.a (mgr.14355) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:33 smithi171 bash[25040]: cluster 2024-09-14T04:38:31.962606+0000 mgr.a (mgr.14355) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:33 smithi007 bash[22722]: cluster 2024-09-14T04:38:31.962606+0000 mgr.a (mgr.14355) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:34.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:35 smithi171 bash[25040]: cluster 2024-09-14T04:38:33.963063+0000 mgr.a (mgr.14355) 16330 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:35.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:35 smithi171 bash[25040]: audit 2024-09-14T04:38:34.161187+0000 mgr.a (mgr.14355) 16331 : audit [DBG] from='client.352146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:35 smithi007 bash[22722]: cluster 2024-09-14T04:38:33.963063+0000 mgr.a (mgr.14355) 16330 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:35 smithi007 bash[22722]: audit 2024-09-14T04:38:34.161187+0000 mgr.a (mgr.14355) 16331 : audit [DBG] from='client.352146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:35 smithi131 bash[24745]: cluster 2024-09-14T04:38:33.963063+0000 mgr.a (mgr.14355) 16330 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:35 smithi131 bash[24745]: audit 2024-09-14T04:38:34.161187+0000 mgr.a (mgr.14355) 16331 : audit [DBG] from='client.352146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:37 smithi171 bash[25040]: cluster 2024-09-14T04:38:35.965343+0000 mgr.a (mgr.14355) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:37 smithi171 bash[25040]: audit 2024-09-14T04:38:36.596166+0000 mon.a (mon.0) 3026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:38:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:37 smithi007 bash[22722]: cluster 2024-09-14T04:38:35.965343+0000 mgr.a (mgr.14355) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:37 smithi007 bash[22722]: audit 2024-09-14T04:38:36.596166+0000 mon.a (mon.0) 3026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:38:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:37 smithi131 bash[24745]: cluster 2024-09-14T04:38:35.965343+0000 mgr.a (mgr.14355) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:38:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:37 smithi131 bash[24745]: audit 2024-09-14T04:38:36.596166+0000 mon.a (mon.0) 3026 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:38:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:38 smithi171 bash[25040]: audit 2024-09-14T04:38:37.444007+0000 mon.a (mon.0) 3027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:38:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:38 smithi171 bash[25040]: audit 2024-09-14T04:38:37.445262+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:38:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:38 smithi171 bash[25040]: audit 2024-09-14T04:38:37.451761+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:38:38.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:38 smithi171 bash[25040]: audit 2024-09-14T04:38:37.454901+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:38.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22972]: debug 2024-09-14T04:38:38.193+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:38:38.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22972]: debug 2024-09-14T04:38:38.193+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:38:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22722]: audit 2024-09-14T04:38:37.444007+0000 mon.a (mon.0) 3027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:38:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22722]: audit 2024-09-14T04:38:37.445262+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:38:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22722]: audit 2024-09-14T04:38:37.451761+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:38:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:38 smithi007 bash[22722]: audit 2024-09-14T04:38:37.454901+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:38 smithi131 bash[24745]: audit 2024-09-14T04:38:37.444007+0000 mon.a (mon.0) 3027 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:38:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:38 smithi131 bash[24745]: audit 2024-09-14T04:38:37.445262+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:38:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:38 smithi131 bash[24745]: audit 2024-09-14T04:38:37.451761+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:38:38.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:38 smithi131 bash[24745]: audit 2024-09-14T04:38:37.454901+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:39 smithi171 bash[25040]: audit 2024-09-14T04:38:37.457213+0000 mgr.a (mgr.14355) 16333 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:39 smithi171 bash[25040]: cluster 2024-09-14T04:38:37.971908+0000 mgr.a (mgr.14355) 16334 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:39 smithi171 bash[25040]: audit 2024-09-14T04:38:38.196582+0000 mgr.a (mgr.14355) 16335 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:38:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:39 smithi171 bash[25040]: cephadm 2024-09-14T04:38:38.198079+0000 mgr.a (mgr.14355) 16336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:38:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:39 smithi007 bash[22722]: audit 2024-09-14T04:38:37.457213+0000 mgr.a (mgr.14355) 16333 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:39 smithi007 bash[22722]: cluster 2024-09-14T04:38:37.971908+0000 mgr.a (mgr.14355) 16334 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:39 smithi007 bash[22722]: audit 2024-09-14T04:38:38.196582+0000 mgr.a (mgr.14355) 16335 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:38:39.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:39 smithi007 bash[22722]: cephadm 2024-09-14T04:38:38.198079+0000 mgr.a (mgr.14355) 16336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:38:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:39 smithi131 bash[24745]: audit 2024-09-14T04:38:37.457213+0000 mgr.a (mgr.14355) 16333 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:38:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:39 smithi131 bash[24745]: cluster 2024-09-14T04:38:37.971908+0000 mgr.a (mgr.14355) 16334 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:39 smithi131 bash[24745]: audit 2024-09-14T04:38:38.196582+0000 mgr.a (mgr.14355) 16335 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:38:39.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:39 smithi131 bash[24745]: cephadm 2024-09-14T04:38:38.198079+0000 mgr.a (mgr.14355) 16336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:38:39.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:39.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:39.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:40.356 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:40.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:40.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:40.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:40.356 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:41 smithi007 bash[22722]: audit 2024-09-14T04:38:39.928510+0000 mgr.a (mgr.14355) 16337 : audit [DBG] from='client.352332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:41.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:41 smithi007 bash[22722]: cluster 2024-09-14T04:38:39.972568+0000 mgr.a (mgr.14355) 16338 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:41 smithi131 bash[24745]: audit 2024-09-14T04:38:39.928510+0000 mgr.a (mgr.14355) 16337 : audit [DBG] from='client.352332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:41 smithi131 bash[24745]: cluster 2024-09-14T04:38:39.972568+0000 mgr.a (mgr.14355) 16338 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:41 smithi171 bash[25040]: audit 2024-09-14T04:38:39.928510+0000 mgr.a (mgr.14355) 16337 : audit [DBG] from='client.352332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:41 smithi171 bash[25040]: cluster 2024-09-14T04:38:39.972568+0000 mgr.a (mgr.14355) 16338 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:43 smithi007 bash[22722]: cluster 2024-09-14T04:38:41.975007+0000 mgr.a (mgr.14355) 16339 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:43 smithi131 bash[24745]: cluster 2024-09-14T04:38:41.975007+0000 mgr.a (mgr.14355) 16339 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:43 smithi171 bash[25040]: cluster 2024-09-14T04:38:41.975007+0000 mgr.a (mgr.14355) 16339 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:45.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:45.358 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:45 smithi007 bash[22722]: cluster 2024-09-14T04:38:43.975816+0000 mgr.a (mgr.14355) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:45 smithi131 bash[24745]: cluster 2024-09-14T04:38:43.975816+0000 mgr.a (mgr.14355) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:45 smithi171 bash[25040]: cluster 2024-09-14T04:38:43.975816+0000 mgr.a (mgr.14355) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:46.135 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:46.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:47 smithi007 bash[22722]: audit 2024-09-14T04:38:45.690032+0000 mgr.a (mgr.14355) 16341 : audit [DBG] from='client.352410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:47 smithi007 bash[22722]: cluster 2024-09-14T04:38:45.977175+0000 mgr.a (mgr.14355) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:47 smithi131 bash[24745]: audit 2024-09-14T04:38:45.690032+0000 mgr.a (mgr.14355) 16341 : audit [DBG] from='client.352410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:47 smithi131 bash[24745]: cluster 2024-09-14T04:38:45.977175+0000 mgr.a (mgr.14355) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:47 smithi171 bash[25040]: audit 2024-09-14T04:38:45.690032+0000 mgr.a (mgr.14355) 16341 : audit [DBG] from='client.352410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:47 smithi171 bash[25040]: cluster 2024-09-14T04:38:45.977175+0000 mgr.a (mgr.14355) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:49 smithi007 bash[22722]: cluster 2024-09-14T04:38:47.977980+0000 mgr.a (mgr.14355) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:49 smithi131 bash[24745]: cluster 2024-09-14T04:38:47.977980+0000 mgr.a (mgr.14355) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:49 smithi171 bash[25040]: cluster 2024-09-14T04:38:47.977980+0000 mgr.a (mgr.14355) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:51.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:51.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:51.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:51 smithi007 bash[22722]: cluster 2024-09-14T04:38:49.978771+0000 mgr.a (mgr.14355) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:51 smithi131 bash[24745]: cluster 2024-09-14T04:38:49.978771+0000 mgr.a (mgr.14355) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:51 smithi171 bash[25040]: cluster 2024-09-14T04:38:49.978771+0000 mgr.a (mgr.14355) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:38:51.915 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:51.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:51.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:51.916 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:53 smithi007 bash[22722]: audit 2024-09-14T04:38:51.470519+0000 mgr.a (mgr.14355) 16345 : audit [DBG] from='client.352485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:53 smithi007 bash[22722]: cluster 2024-09-14T04:38:51.980351+0000 mgr.a (mgr.14355) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:53 smithi131 bash[24745]: audit 2024-09-14T04:38:51.470519+0000 mgr.a (mgr.14355) 16345 : audit [DBG] from='client.352485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:53 smithi131 bash[24745]: cluster 2024-09-14T04:38:51.980351+0000 mgr.a (mgr.14355) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:53 smithi171 bash[25040]: audit 2024-09-14T04:38:51.470519+0000 mgr.a (mgr.14355) 16345 : audit [DBG] from='client.352485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:53 smithi171 bash[25040]: cluster 2024-09-14T04:38:51.980351+0000 mgr.a (mgr.14355) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:38:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:55 smithi007 bash[22722]: cluster 2024-09-14T04:38:53.981118+0000 mgr.a (mgr.14355) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:38:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:55 smithi131 bash[24745]: cluster 2024-09-14T04:38:53.981118+0000 mgr.a (mgr.14355) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:38:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:55 smithi171 bash[25040]: cluster 2024-09-14T04:38:53.981118+0000 mgr.a (mgr.14355) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:38:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:38:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:38:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:38:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:57 smithi007 bash[22722]: cluster 2024-09-14T04:38:55.983061+0000 mgr.a (mgr.14355) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:38:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:57 smithi131 bash[24745]: cluster 2024-09-14T04:38:55.983061+0000 mgr.a (mgr.14355) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:38:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:57 smithi171 bash[25040]: cluster 2024-09-14T04:38:55.983061+0000 mgr.a (mgr.14355) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:38:57.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:38:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:38:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:38:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:38:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:38:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:58 smithi007 bash[22722]: audit 2024-09-14T04:38:57.251630+0000 mgr.a (mgr.14355) 16349 : audit [DBG] from='client.352560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:58 smithi131 bash[24745]: audit 2024-09-14T04:38:57.251630+0000 mgr.a (mgr.14355) 16349 : audit [DBG] from='client.352560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:58 smithi171 bash[25040]: audit 2024-09-14T04:38:57.251630+0000 mgr.a (mgr.14355) 16349 : audit [DBG] from='client.352560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:38:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:38:59 smithi007 bash[22722]: cluster 2024-09-14T04:38:57.984025+0000 mgr.a (mgr.14355) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:38:59 smithi131 bash[24745]: cluster 2024-09-14T04:38:57.984025+0000 mgr.a (mgr.14355) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:38:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:38:59 smithi171 bash[25040]: cluster 2024-09-14T04:38:57.984025+0000 mgr.a (mgr.14355) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:01 smithi007 bash[22722]: cluster 2024-09-14T04:38:59.984839+0000 mgr.a (mgr.14355) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:01 smithi131 bash[24745]: cluster 2024-09-14T04:38:59.984839+0000 mgr.a (mgr.14355) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:01 smithi171 bash[25040]: cluster 2024-09-14T04:38:59.984839+0000 mgr.a (mgr.14355) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:03.428 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:03.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:03 smithi007 bash[22722]: cluster 2024-09-14T04:39:01.987070+0000 mgr.a (mgr.14355) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:03 smithi131 bash[24745]: cluster 2024-09-14T04:39:01.987070+0000 mgr.a (mgr.14355) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:03 smithi171 bash[25040]: cluster 2024-09-14T04:39:01.987070+0000 mgr.a (mgr.14355) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:04 smithi007 bash[22722]: audit 2024-09-14T04:39:03.015384+0000 mgr.a (mgr.14355) 16353 : audit [DBG] from='client.352638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:04 smithi131 bash[24745]: audit 2024-09-14T04:39:03.015384+0000 mgr.a (mgr.14355) 16353 : audit [DBG] from='client.352638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:04 smithi171 bash[25040]: audit 2024-09-14T04:39:03.015384+0000 mgr.a (mgr.14355) 16353 : audit [DBG] from='client.352638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:05 smithi007 bash[22722]: cluster 2024-09-14T04:39:03.988148+0000 mgr.a (mgr.14355) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:05 smithi131 bash[24745]: cluster 2024-09-14T04:39:03.988148+0000 mgr.a (mgr.14355) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:05 smithi171 bash[25040]: cluster 2024-09-14T04:39:03.988148+0000 mgr.a (mgr.14355) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:07.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:07 smithi007 bash[22722]: cluster 2024-09-14T04:39:05.990552+0000 mgr.a (mgr.14355) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:07 smithi131 bash[24745]: cluster 2024-09-14T04:39:05.990552+0000 mgr.a (mgr.14355) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:07 smithi171 bash[25040]: cluster 2024-09-14T04:39:05.990552+0000 mgr.a (mgr.14355) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:09.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:09.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:09 smithi007 bash[22722]: cluster 2024-09-14T04:39:07.991482+0000 mgr.a (mgr.14355) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:09 smithi131 bash[24745]: cluster 2024-09-14T04:39:07.991482+0000 mgr.a (mgr.14355) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:09 smithi171 bash[25040]: cluster 2024-09-14T04:39:07.991482+0000 mgr.a (mgr.14355) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:10 smithi007 bash[22722]: audit 2024-09-14T04:39:08.758671+0000 mgr.a (mgr.14355) 16357 : audit [DBG] from='client.352716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:10 smithi131 bash[24745]: audit 2024-09-14T04:39:08.758671+0000 mgr.a (mgr.14355) 16357 : audit [DBG] from='client.352716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:10 smithi171 bash[25040]: audit 2024-09-14T04:39:08.758671+0000 mgr.a (mgr.14355) 16357 : audit [DBG] from='client.352716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:11 smithi131 bash[24745]: cluster 2024-09-14T04:39:09.992475+0000 mgr.a (mgr.14355) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:11 smithi171 bash[25040]: cluster 2024-09-14T04:39:09.992475+0000 mgr.a (mgr.14355) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:11 smithi007 bash[22722]: cluster 2024-09-14T04:39:09.992475+0000 mgr.a (mgr.14355) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:13 smithi131 bash[24745]: cluster 2024-09-14T04:39:11.994727+0000 mgr.a (mgr.14355) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:13 smithi171 bash[25040]: cluster 2024-09-14T04:39:11.994727+0000 mgr.a (mgr.14355) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:13 smithi007 bash[22722]: cluster 2024-09-14T04:39:11.994727+0000 mgr.a (mgr.14355) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:14.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:14.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:14.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:14.956 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:14.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:15 smithi131 bash[24745]: cluster 2024-09-14T04:39:13.995493+0000 mgr.a (mgr.14355) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:15 smithi171 bash[25040]: cluster 2024-09-14T04:39:13.995493+0000 mgr.a (mgr.14355) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:15 smithi007 bash[22722]: cluster 2024-09-14T04:39:13.995493+0000 mgr.a (mgr.14355) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:16 smithi131 bash[24745]: audit 2024-09-14T04:39:14.506244+0000 mgr.a (mgr.14355) 16361 : audit [DBG] from='client.352788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:16 smithi171 bash[25040]: audit 2024-09-14T04:39:14.506244+0000 mgr.a (mgr.14355) 16361 : audit [DBG] from='client.352788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:16 smithi007 bash[22722]: audit 2024-09-14T04:39:14.506244+0000 mgr.a (mgr.14355) 16361 : audit [DBG] from='client.352788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:17 smithi131 bash[24745]: cluster 2024-09-14T04:39:15.997825+0000 mgr.a (mgr.14355) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:17 smithi171 bash[25040]: cluster 2024-09-14T04:39:15.997825+0000 mgr.a (mgr.14355) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:17 smithi007 bash[22722]: cluster 2024-09-14T04:39:15.997825+0000 mgr.a (mgr.14355) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:19 smithi131 bash[24745]: cluster 2024-09-14T04:39:17.998671+0000 mgr.a (mgr.14355) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:19 smithi171 bash[25040]: cluster 2024-09-14T04:39:17.998671+0000 mgr.a (mgr.14355) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:19 smithi007 bash[22722]: cluster 2024-09-14T04:39:17.998671+0000 mgr.a (mgr.14355) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:19.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:20.744 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:20.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:21 smithi131 bash[24745]: cluster 2024-09-14T04:39:19.999445+0000 mgr.a (mgr.14355) 16364 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:21 smithi131 bash[24745]: audit 2024-09-14T04:39:20.300693+0000 mgr.a (mgr.14355) 16365 : audit [DBG] from='client.352866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:21.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:21 smithi171 bash[25040]: cluster 2024-09-14T04:39:19.999445+0000 mgr.a (mgr.14355) 16364 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:21.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:21 smithi171 bash[25040]: audit 2024-09-14T04:39:20.300693+0000 mgr.a (mgr.14355) 16365 : audit [DBG] from='client.352866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:21 smithi007 bash[22722]: cluster 2024-09-14T04:39:19.999445+0000 mgr.a (mgr.14355) 16364 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:21 smithi007 bash[22722]: audit 2024-09-14T04:39:20.300693+0000 mgr.a (mgr.14355) 16365 : audit [DBG] from='client.352866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:23 smithi131 bash[24745]: cluster 2024-09-14T04:39:22.002097+0000 mgr.a (mgr.14355) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:23 smithi171 bash[25040]: cluster 2024-09-14T04:39:22.002097+0000 mgr.a (mgr.14355) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:23.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:23 smithi007 bash[22722]: cluster 2024-09-14T04:39:22.002097+0000 mgr.a (mgr.14355) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:25 smithi131 bash[24745]: cluster 2024-09-14T04:39:24.002889+0000 mgr.a (mgr.14355) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:25 smithi171 bash[25040]: cluster 2024-09-14T04:39:24.002889+0000 mgr.a (mgr.14355) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:25 smithi007 bash[22722]: cluster 2024-09-14T04:39:24.002889+0000 mgr.a (mgr.14355) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:25.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:25.746 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:26.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:27 smithi131 bash[24745]: cluster 2024-09-14T04:39:26.004843+0000 mgr.a (mgr.14355) 16368 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:27 smithi131 bash[24745]: audit 2024-09-14T04:39:26.078175+0000 mgr.a (mgr.14355) 16369 : audit [DBG] from='client.352944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:27 smithi171 bash[25040]: cluster 2024-09-14T04:39:26.004843+0000 mgr.a (mgr.14355) 16368 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:27.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:27 smithi171 bash[25040]: audit 2024-09-14T04:39:26.078175+0000 mgr.a (mgr.14355) 16369 : audit [DBG] from='client.352944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:27 smithi007 bash[22722]: cluster 2024-09-14T04:39:26.004843+0000 mgr.a (mgr.14355) 16368 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:27 smithi007 bash[22722]: audit 2024-09-14T04:39:26.078175+0000 mgr.a (mgr.14355) 16369 : audit [DBG] from='client.352944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:29 smithi131 bash[24745]: cluster 2024-09-14T04:39:28.005764+0000 mgr.a (mgr.14355) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:29 smithi171 bash[25040]: cluster 2024-09-14T04:39:28.005764+0000 mgr.a (mgr.14355) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:29 smithi007 bash[22722]: cluster 2024-09-14T04:39:28.005764+0000 mgr.a (mgr.14355) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:39:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:31 smithi131 bash[24745]: cluster 2024-09-14T04:39:30.006553+0000 mgr.a (mgr.14355) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:39:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:31 smithi171 bash[25040]: cluster 2024-09-14T04:39:30.006553+0000 mgr.a (mgr.14355) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:39:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:31 smithi007 bash[22722]: cluster 2024-09-14T04:39:30.006553+0000 mgr.a (mgr.14355) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:39:32.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:32.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:32.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:32.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:32.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:33 smithi131 bash[24745]: audit 2024-09-14T04:39:31.837182+0000 mgr.a (mgr.14355) 16372 : audit [DBG] from='client.353022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:33.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:33 smithi131 bash[24745]: cluster 2024-09-14T04:39:32.007871+0000 mgr.a (mgr.14355) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:33 smithi171 bash[25040]: audit 2024-09-14T04:39:31.837182+0000 mgr.a (mgr.14355) 16372 : audit [DBG] from='client.353022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:33.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:33 smithi171 bash[25040]: cluster 2024-09-14T04:39:32.007871+0000 mgr.a (mgr.14355) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:33 smithi007 bash[22722]: audit 2024-09-14T04:39:31.837182+0000 mgr.a (mgr.14355) 16372 : audit [DBG] from='client.353022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:33 smithi007 bash[22722]: cluster 2024-09-14T04:39:32.007871+0000 mgr.a (mgr.14355) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:35 smithi131 bash[24745]: cluster 2024-09-14T04:39:34.008722+0000 mgr.a (mgr.14355) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:35 smithi171 bash[25040]: cluster 2024-09-14T04:39:34.008722+0000 mgr.a (mgr.14355) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:35 smithi007 bash[22722]: cluster 2024-09-14T04:39:34.008722+0000 mgr.a (mgr.14355) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:37.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:37.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:37 smithi131 bash[24745]: cluster 2024-09-14T04:39:36.010913+0000 mgr.a (mgr.14355) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:37 smithi171 bash[25040]: cluster 2024-09-14T04:39:36.010913+0000 mgr.a (mgr.14355) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:37 smithi007 bash[22722]: cluster 2024-09-14T04:39:36.010913+0000 mgr.a (mgr.14355) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:38.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:38.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:38.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:38 smithi131 bash[24745]: audit 2024-09-14T04:39:38.257619+0000 mon.a (mon.0) 3031 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:39:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:38 smithi171 bash[25040]: audit 2024-09-14T04:39:38.257619+0000 mon.a (mon.0) 3031 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:39:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:38 smithi007 bash[22722]: audit 2024-09-14T04:39:38.257619+0000 mon.a (mon.0) 3031 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:39:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:39 smithi131 bash[24745]: audit 2024-09-14T04:39:37.611699+0000 mgr.a (mgr.14355) 16376 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:39 smithi131 bash[24745]: cluster 2024-09-14T04:39:38.011382+0000 mgr.a (mgr.14355) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:39 smithi171 bash[25040]: audit 2024-09-14T04:39:37.611699+0000 mgr.a (mgr.14355) 16376 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:39 smithi171 bash[25040]: cluster 2024-09-14T04:39:38.011382+0000 mgr.a (mgr.14355) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:39 smithi007 bash[22722]: audit 2024-09-14T04:39:37.611699+0000 mgr.a (mgr.14355) 16376 : audit [DBG] from='client.353094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:39 smithi007 bash[22722]: cluster 2024-09-14T04:39:38.011382+0000 mgr.a (mgr.14355) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:41 smithi131 bash[24745]: cluster 2024-09-14T04:39:40.012281+0000 mgr.a (mgr.14355) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:41 smithi171 bash[25040]: cluster 2024-09-14T04:39:40.012281+0000 mgr.a (mgr.14355) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:41 smithi007 bash[22722]: cluster 2024-09-14T04:39:40.012281+0000 mgr.a (mgr.14355) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:43.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:43.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:43 smithi171 bash[25040]: cluster 2024-09-14T04:39:42.014581+0000 mgr.a (mgr.14355) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:43 smithi007 bash[22722]: cluster 2024-09-14T04:39:42.014581+0000 mgr.a (mgr.14355) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:43 smithi131 bash[24745]: cluster 2024-09-14T04:39:42.014581+0000 mgr.a (mgr.14355) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:39:43.812 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:43.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:43.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.373344+0000 mgr.a (mgr.14355) 16380 : audit [DBG] from='client.353172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.626652+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.630093+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.633041+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.635842+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.638980+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:43.641866+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: cluster 2024-09-14T04:39:44.015647+0000 mgr.a (mgr.14355) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:44.366047+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:44.367992+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:44.378321+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:44 smithi007 bash[22722]: audit 2024-09-14T04:39:44.382999+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.373344+0000 mgr.a (mgr.14355) 16380 : audit [DBG] from='client.353172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.626652+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.630093+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.633041+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.635842+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.638980+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:43.641866+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: cluster 2024-09-14T04:39:44.015647+0000 mgr.a (mgr.14355) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:44.366047+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:44.367992+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:44.378321+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:44 smithi131 bash[24745]: audit 2024-09-14T04:39:44.382999+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.373344+0000 mgr.a (mgr.14355) 16380 : audit [DBG] from='client.353172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.626652+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.630093+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.633041+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.635842+0000 mon.a (mon.0) 3035 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.638980+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:43.641866+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: cluster 2024-09-14T04:39:44.015647+0000 mgr.a (mgr.14355) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:39:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:44.366047+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:39:45.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:44.367992+0000 mon.a (mon.0) 3039 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:39:45.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:44.378321+0000 mon.a (mon.0) 3040 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:39:45.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:44 smithi171 bash[25040]: audit 2024-09-14T04:39:44.382999+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:45.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:39:45 smithi007 bash[22972]: debug 2024-09-14T04:39:45.120+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:39:45.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:39:45 smithi007 bash[22972]: debug 2024-09-14T04:39:45.124+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:39:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:45 smithi007 bash[22722]: audit 2024-09-14T04:39:44.384448+0000 mgr.a (mgr.14355) 16382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:45 smithi007 bash[22722]: audit 2024-09-14T04:39:45.126225+0000 mgr.a (mgr.14355) 16383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:39:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:45 smithi007 bash[22722]: cephadm 2024-09-14T04:39:45.127439+0000 mgr.a (mgr.14355) 16384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:39:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:45 smithi131 bash[24745]: audit 2024-09-14T04:39:44.384448+0000 mgr.a (mgr.14355) 16382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:45 smithi131 bash[24745]: audit 2024-09-14T04:39:45.126225+0000 mgr.a (mgr.14355) 16383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:39:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:45 smithi131 bash[24745]: cephadm 2024-09-14T04:39:45.127439+0000 mgr.a (mgr.14355) 16384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:39:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:45 smithi171 bash[25040]: audit 2024-09-14T04:39:44.384448+0000 mgr.a (mgr.14355) 16382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:39:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:45 smithi171 bash[25040]: audit 2024-09-14T04:39:45.126225+0000 mgr.a (mgr.14355) 16383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:39:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:45 smithi171 bash[25040]: cephadm 2024-09-14T04:39:45.127439+0000 mgr.a (mgr.14355) 16384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:39:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:46 smithi007 bash[22722]: cluster 2024-09-14T04:39:46.018021+0000 mgr.a (mgr.14355) 16385 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:46 smithi131 bash[24745]: cluster 2024-09-14T04:39:46.018021+0000 mgr.a (mgr.14355) 16385 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:46 smithi171 bash[25040]: cluster 2024-09-14T04:39:46.018021+0000 mgr.a (mgr.14355) 16385 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:48.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:48.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:49 smithi007 bash[22722]: cluster 2024-09-14T04:39:48.018871+0000 mgr.a (mgr.14355) 16386 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:49 smithi131 bash[24745]: cluster 2024-09-14T04:39:48.018871+0000 mgr.a (mgr.14355) 16386 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:49 smithi171 bash[25040]: cluster 2024-09-14T04:39:48.018871+0000 mgr.a (mgr.14355) 16386 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:49.600 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:49.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:49.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:49.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:49.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:50 smithi007 bash[22722]: audit 2024-09-14T04:39:49.150354+0000 mgr.a (mgr.14355) 16387 : audit [DBG] from='client.353355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:50 smithi131 bash[24745]: audit 2024-09-14T04:39:49.150354+0000 mgr.a (mgr.14355) 16387 : audit [DBG] from='client.353355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:50 smithi171 bash[25040]: audit 2024-09-14T04:39:49.150354+0000 mgr.a (mgr.14355) 16387 : audit [DBG] from='client.353355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:51 smithi007 bash[22722]: cluster 2024-09-14T04:39:50.019812+0000 mgr.a (mgr.14355) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:51 smithi131 bash[24745]: cluster 2024-09-14T04:39:50.019812+0000 mgr.a (mgr.14355) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:51 smithi171 bash[25040]: cluster 2024-09-14T04:39:50.019812+0000 mgr.a (mgr.14355) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:53 smithi007 bash[22722]: cluster 2024-09-14T04:39:52.022077+0000 mgr.a (mgr.14355) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:53 smithi131 bash[24745]: cluster 2024-09-14T04:39:52.022077+0000 mgr.a (mgr.14355) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:53 smithi171 bash[25040]: cluster 2024-09-14T04:39:52.022077+0000 mgr.a (mgr.14355) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:54.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:39:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:39:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:39:55.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:39:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:39:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:39:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:39:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:39:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:55 smithi007 bash[22722]: cluster 2024-09-14T04:39:54.022879+0000 mgr.a (mgr.14355) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:55 smithi131 bash[24745]: cluster 2024-09-14T04:39:54.022879+0000 mgr.a (mgr.14355) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:55 smithi171 bash[25040]: cluster 2024-09-14T04:39:54.022879+0000 mgr.a (mgr.14355) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:56 smithi007 bash[22722]: audit 2024-09-14T04:39:54.931364+0000 mgr.a (mgr.14355) 16391 : audit [DBG] from='client.353433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:56 smithi131 bash[24745]: audit 2024-09-14T04:39:54.931364+0000 mgr.a (mgr.14355) 16391 : audit [DBG] from='client.353433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:56 smithi171 bash[25040]: audit 2024-09-14T04:39:54.931364+0000 mgr.a (mgr.14355) 16391 : audit [DBG] from='client.353433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:39:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:57 smithi007 bash[22722]: cluster 2024-09-14T04:39:56.025330+0000 mgr.a (mgr.14355) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:57 smithi131 bash[24745]: cluster 2024-09-14T04:39:56.025330+0000 mgr.a (mgr.14355) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:57 smithi171 bash[25040]: cluster 2024-09-14T04:39:56.025330+0000 mgr.a (mgr.14355) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:39:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:39:59 smithi007 bash[22722]: cluster 2024-09-14T04:39:58.026097+0000 mgr.a (mgr.14355) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:39:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:39:59 smithi131 bash[24745]: cluster 2024-09-14T04:39:58.026097+0000 mgr.a (mgr.14355) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:39:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:39:59 smithi171 bash[25040]: cluster 2024-09-14T04:39:58.026097+0000 mgr.a (mgr.14355) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:40:00.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:00.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:00.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:00 smithi007 bash[22722]: cluster 2024-09-14T04:40:00.000157+0000 mon.a (mon.0) 3042 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:40:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:00 smithi131 bash[24745]: cluster 2024-09-14T04:40:00.000157+0000 mon.a (mon.0) 3042 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:40:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:00 smithi171 bash[25040]: cluster 2024-09-14T04:40:00.000157+0000 mon.a (mon.0) 3042 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:40:01.111 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:01.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:01.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:01.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:01.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:01 smithi007 bash[22722]: cluster 2024-09-14T04:40:00.026882+0000 mgr.a (mgr.14355) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:40:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:01 smithi131 bash[24745]: cluster 2024-09-14T04:40:00.026882+0000 mgr.a (mgr.14355) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:40:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:01 smithi171 bash[25040]: cluster 2024-09-14T04:40:00.026882+0000 mgr.a (mgr.14355) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:40:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:02 smithi131 bash[24745]: audit 2024-09-14T04:40:00.688621+0000 mgr.a (mgr.14355) 16395 : audit [DBG] from='client.353511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:02 smithi171 bash[25040]: audit 2024-09-14T04:40:00.688621+0000 mgr.a (mgr.14355) 16395 : audit [DBG] from='client.353511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:02 smithi007 bash[22722]: audit 2024-09-14T04:40:00.688621+0000 mgr.a (mgr.14355) 16395 : audit [DBG] from='client.353511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:03 smithi131 bash[24745]: cluster 2024-09-14T04:40:02.029574+0000 mgr.a (mgr.14355) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:03 smithi171 bash[25040]: cluster 2024-09-14T04:40:02.029574+0000 mgr.a (mgr.14355) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:03 smithi007 bash[22722]: cluster 2024-09-14T04:40:02.029574+0000 mgr.a (mgr.14355) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:05 smithi131 bash[24745]: cluster 2024-09-14T04:40:04.030514+0000 mgr.a (mgr.14355) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:05 smithi171 bash[25040]: cluster 2024-09-14T04:40:04.030514+0000 mgr.a (mgr.14355) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:05 smithi007 bash[22722]: cluster 2024-09-14T04:40:04.030514+0000 mgr.a (mgr.14355) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:06.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:06.865 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:06.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:07 smithi131 bash[24745]: cluster 2024-09-14T04:40:06.032638+0000 mgr.a (mgr.14355) 16398 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:07 smithi171 bash[25040]: cluster 2024-09-14T04:40:06.032638+0000 mgr.a (mgr.14355) 16398 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:07 smithi007 bash[22722]: cluster 2024-09-14T04:40:06.032638+0000 mgr.a (mgr.14355) 16398 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:08 smithi131 bash[24745]: audit 2024-09-14T04:40:06.442667+0000 mgr.a (mgr.14355) 16399 : audit [DBG] from='client.353589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:08 smithi171 bash[25040]: audit 2024-09-14T04:40:06.442667+0000 mgr.a (mgr.14355) 16399 : audit [DBG] from='client.353589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:08 smithi007 bash[22722]: audit 2024-09-14T04:40:06.442667+0000 mgr.a (mgr.14355) 16399 : audit [DBG] from='client.353589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:09 smithi131 bash[24745]: cluster 2024-09-14T04:40:08.033567+0000 mgr.a (mgr.14355) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:09 smithi171 bash[25040]: cluster 2024-09-14T04:40:08.033567+0000 mgr.a (mgr.14355) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:09 smithi007 bash[22722]: cluster 2024-09-14T04:40:08.033567+0000 mgr.a (mgr.14355) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:11 smithi131 bash[24745]: cluster 2024-09-14T04:40:10.034497+0000 mgr.a (mgr.14355) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:11.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:11 smithi171 bash[25040]: cluster 2024-09-14T04:40:10.034497+0000 mgr.a (mgr.14355) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:11 smithi007 bash[22722]: cluster 2024-09-14T04:40:10.034497+0000 mgr.a (mgr.14355) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:12.634 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:12.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:12.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:13 smithi131 bash[24745]: cluster 2024-09-14T04:40:12.035889+0000 mgr.a (mgr.14355) 16402 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:40:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:13 smithi131 bash[24745]: audit 2024-09-14T04:40:12.199444+0000 mgr.a (mgr.14355) 16403 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:13 smithi171 bash[25040]: cluster 2024-09-14T04:40:12.035889+0000 mgr.a (mgr.14355) 16402 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:40:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:13 smithi171 bash[25040]: audit 2024-09-14T04:40:12.199444+0000 mgr.a (mgr.14355) 16403 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:13 smithi007 bash[22722]: cluster 2024-09-14T04:40:12.035889+0000 mgr.a (mgr.14355) 16402 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:40:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:13 smithi007 bash[22722]: audit 2024-09-14T04:40:12.199444+0000 mgr.a (mgr.14355) 16403 : audit [DBG] from='client.353661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:15 smithi131 bash[24745]: cluster 2024-09-14T04:40:14.036735+0000 mgr.a (mgr.14355) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:15 smithi171 bash[25040]: cluster 2024-09-14T04:40:14.036735+0000 mgr.a (mgr.14355) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:15 smithi007 bash[22722]: cluster 2024-09-14T04:40:14.036735+0000 mgr.a (mgr.14355) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:17 smithi131 bash[24745]: cluster 2024-09-14T04:40:16.038932+0000 mgr.a (mgr.14355) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:17 smithi171 bash[25040]: cluster 2024-09-14T04:40:16.038932+0000 mgr.a (mgr.14355) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:17.635 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:17.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:17.636 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:17 smithi007 bash[22722]: cluster 2024-09-14T04:40:16.038932+0000 mgr.a (mgr.14355) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:18.421 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:19 smithi131 bash[24745]: audit 2024-09-14T04:40:17.969245+0000 mgr.a (mgr.14355) 16406 : audit [DBG] from='client.353739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:19 smithi131 bash[24745]: cluster 2024-09-14T04:40:18.039685+0000 mgr.a (mgr.14355) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:19.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:19 smithi171 bash[25040]: audit 2024-09-14T04:40:17.969245+0000 mgr.a (mgr.14355) 16406 : audit [DBG] from='client.353739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:19.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:19 smithi171 bash[25040]: cluster 2024-09-14T04:40:18.039685+0000 mgr.a (mgr.14355) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:19 smithi007 bash[22722]: audit 2024-09-14T04:40:17.969245+0000 mgr.a (mgr.14355) 16406 : audit [DBG] from='client.353739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:19 smithi007 bash[22722]: cluster 2024-09-14T04:40:18.039685+0000 mgr.a (mgr.14355) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:21 smithi131 bash[24745]: cluster 2024-09-14T04:40:20.040576+0000 mgr.a (mgr.14355) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:21 smithi171 bash[25040]: cluster 2024-09-14T04:40:20.040576+0000 mgr.a (mgr.14355) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:21 smithi007 bash[22722]: cluster 2024-09-14T04:40:20.040576+0000 mgr.a (mgr.14355) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:23.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:23 smithi131 bash[24745]: cluster 2024-09-14T04:40:22.042832+0000 mgr.a (mgr.14355) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:23 smithi171 bash[25040]: cluster 2024-09-14T04:40:22.042832+0000 mgr.a (mgr.14355) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:23 smithi007 bash[22722]: cluster 2024-09-14T04:40:22.042832+0000 mgr.a (mgr.14355) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:24.186 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:24.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:24.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:24.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:24.187 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:25 smithi131 bash[24745]: audit 2024-09-14T04:40:23.754909+0000 mgr.a (mgr.14355) 16410 : audit [DBG] from='client.353814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:25 smithi131 bash[24745]: cluster 2024-09-14T04:40:24.043360+0000 mgr.a (mgr.14355) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:25 smithi171 bash[25040]: audit 2024-09-14T04:40:23.754909+0000 mgr.a (mgr.14355) 16410 : audit [DBG] from='client.353814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:25 smithi171 bash[25040]: cluster 2024-09-14T04:40:24.043360+0000 mgr.a (mgr.14355) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:25 smithi007 bash[22722]: audit 2024-09-14T04:40:23.754909+0000 mgr.a (mgr.14355) 16410 : audit [DBG] from='client.353814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:25 smithi007 bash[22722]: cluster 2024-09-14T04:40:24.043360+0000 mgr.a (mgr.14355) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:27 smithi131 bash[24745]: cluster 2024-09-14T04:40:26.045720+0000 mgr.a (mgr.14355) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:27 smithi171 bash[25040]: cluster 2024-09-14T04:40:26.045720+0000 mgr.a (mgr.14355) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:27 smithi007 bash[22722]: cluster 2024-09-14T04:40:26.045720+0000 mgr.a (mgr.14355) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:29.188 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:29.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:29.189 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:29 smithi131 bash[24745]: cluster 2024-09-14T04:40:28.046700+0000 mgr.a (mgr.14355) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:29 smithi171 bash[25040]: cluster 2024-09-14T04:40:28.046700+0000 mgr.a (mgr.14355) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:29 smithi007 bash[22722]: cluster 2024-09-14T04:40:28.046700+0000 mgr.a (mgr.14355) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:29.958 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:29.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:29.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:29.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:29.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:31 smithi131 bash[24745]: audit 2024-09-14T04:40:29.523103+0000 mgr.a (mgr.14355) 16414 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:31 smithi131 bash[24745]: cluster 2024-09-14T04:40:30.047739+0000 mgr.a (mgr.14355) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:31 smithi171 bash[25040]: audit 2024-09-14T04:40:29.523103+0000 mgr.a (mgr.14355) 16414 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:31 smithi171 bash[25040]: cluster 2024-09-14T04:40:30.047739+0000 mgr.a (mgr.14355) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:31 smithi007 bash[22722]: audit 2024-09-14T04:40:29.523103+0000 mgr.a (mgr.14355) 16414 : audit [DBG] from='client.353889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:31 smithi007 bash[22722]: cluster 2024-09-14T04:40:30.047739+0000 mgr.a (mgr.14355) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:33 smithi171 bash[25040]: cluster 2024-09-14T04:40:32.049999+0000 mgr.a (mgr.14355) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:33.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:33 smithi007 bash[22722]: cluster 2024-09-14T04:40:32.049999+0000 mgr.a (mgr.14355) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:33 smithi131 bash[24745]: cluster 2024-09-14T04:40:32.049999+0000 mgr.a (mgr.14355) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:40:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:35 smithi171 bash[25040]: cluster 2024-09-14T04:40:34.050780+0000 mgr.a (mgr.14355) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:35 smithi007 bash[22722]: cluster 2024-09-14T04:40:34.050780+0000 mgr.a (mgr.14355) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:35.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:35.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:35 smithi131 bash[24745]: cluster 2024-09-14T04:40:34.050780+0000 mgr.a (mgr.14355) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:36 smithi007 bash[22722]: audit 2024-09-14T04:40:35.294344+0000 mgr.a (mgr.14355) 16418 : audit [DBG] from='client.353964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:36 smithi131 bash[24745]: audit 2024-09-14T04:40:35.294344+0000 mgr.a (mgr.14355) 16418 : audit [DBG] from='client.353964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:36 smithi171 bash[25040]: audit 2024-09-14T04:40:35.294344+0000 mgr.a (mgr.14355) 16418 : audit [DBG] from='client.353964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:37 smithi007 bash[22722]: cluster 2024-09-14T04:40:36.053507+0000 mgr.a (mgr.14355) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:37 smithi131 bash[24745]: cluster 2024-09-14T04:40:36.053507+0000 mgr.a (mgr.14355) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:37 smithi171 bash[25040]: cluster 2024-09-14T04:40:36.053507+0000 mgr.a (mgr.14355) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:39 smithi007 bash[22722]: cluster 2024-09-14T04:40:38.054287+0000 mgr.a (mgr.14355) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:39 smithi131 bash[24745]: cluster 2024-09-14T04:40:38.054287+0000 mgr.a (mgr.14355) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:39 smithi171 bash[25040]: cluster 2024-09-14T04:40:38.054287+0000 mgr.a (mgr.14355) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:40.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:41.468 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:41.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:41.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:41.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:41.468 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:41 smithi007 bash[22722]: cluster 2024-09-14T04:40:40.055099+0000 mgr.a (mgr.14355) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:41 smithi131 bash[24745]: cluster 2024-09-14T04:40:40.055099+0000 mgr.a (mgr.14355) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:41 smithi171 bash[25040]: cluster 2024-09-14T04:40:40.055099+0000 mgr.a (mgr.14355) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:42 smithi007 bash[22722]: audit 2024-09-14T04:40:41.059593+0000 mgr.a (mgr.14355) 16422 : audit [DBG] from='client.354042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:42 smithi131 bash[24745]: audit 2024-09-14T04:40:41.059593+0000 mgr.a (mgr.14355) 16422 : audit [DBG] from='client.354042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:42 smithi171 bash[25040]: audit 2024-09-14T04:40:41.059593+0000 mgr.a (mgr.14355) 16422 : audit [DBG] from='client.354042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:43 smithi007 bash[22722]: cluster 2024-09-14T04:40:42.057798+0000 mgr.a (mgr.14355) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:43 smithi131 bash[24745]: cluster 2024-09-14T04:40:42.057798+0000 mgr.a (mgr.14355) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:43 smithi171 bash[25040]: cluster 2024-09-14T04:40:42.057798+0000 mgr.a (mgr.14355) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:45 smithi007 bash[22722]: cluster 2024-09-14T04:40:44.058579+0000 mgr.a (mgr.14355) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:45 smithi007 bash[22722]: audit 2024-09-14T04:40:45.178486+0000 mon.a (mon.0) 3043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:40:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:45 smithi131 bash[24745]: cluster 2024-09-14T04:40:44.058579+0000 mgr.a (mgr.14355) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:45 smithi131 bash[24745]: audit 2024-09-14T04:40:45.178486+0000 mon.a (mon.0) 3043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:40:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:45 smithi171 bash[25040]: cluster 2024-09-14T04:40:44.058579+0000 mgr.a (mgr.14355) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:40:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:45 smithi171 bash[25040]: audit 2024-09-14T04:40:45.178486+0000 mon.a (mon.0) 3043 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:40:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:46.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22722]: audit 2024-09-14T04:40:46.050035+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:40:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22722]: audit 2024-09-14T04:40:46.051411+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:40:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22722]: audit 2024-09-14T04:40:46.059008+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:40:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22722]: audit 2024-09-14T04:40:46.063963+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:46 smithi131 bash[24745]: audit 2024-09-14T04:40:46.050035+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:40:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:46 smithi131 bash[24745]: audit 2024-09-14T04:40:46.051411+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:40:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:46 smithi131 bash[24745]: audit 2024-09-14T04:40:46.059008+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:40:46.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:46 smithi131 bash[24745]: audit 2024-09-14T04:40:46.063963+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:46 smithi171 bash[25040]: audit 2024-09-14T04:40:46.050035+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:40:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:46 smithi171 bash[25040]: audit 2024-09-14T04:40:46.051411+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:40:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:46 smithi171 bash[25040]: audit 2024-09-14T04:40:46.059008+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:40:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:46 smithi171 bash[25040]: audit 2024-09-14T04:40:46.063963+0000 mon.a (mon.0) 3047 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:47.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22972]: debug 2024-09-14T04:40:46.815+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:40:47.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:40:46 smithi007 bash[22972]: debug 2024-09-14T04:40:46.827+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:40:47.220 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:47.220 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:47 smithi007 bash[22722]: cluster 2024-09-14T04:40:46.059633+0000 mgr.a (mgr.14355) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:47 smithi007 bash[22722]: audit 2024-09-14T04:40:46.066172+0000 mgr.a (mgr.14355) 16426 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:47 smithi131 bash[24745]: cluster 2024-09-14T04:40:46.059633+0000 mgr.a (mgr.14355) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:47 smithi131 bash[24745]: audit 2024-09-14T04:40:46.066172+0000 mgr.a (mgr.14355) 16426 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:47 smithi171 bash[25040]: cluster 2024-09-14T04:40:46.059633+0000 mgr.a (mgr.14355) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:47 smithi171 bash[25040]: audit 2024-09-14T04:40:46.066172+0000 mgr.a (mgr.14355) 16426 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:40:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:48 smithi007 bash[22722]: audit 2024-09-14T04:40:46.799418+0000 mgr.a (mgr.14355) 16427 : audit [DBG] from='client.354189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:48 smithi007 bash[22722]: audit 2024-09-14T04:40:46.819836+0000 mgr.a (mgr.14355) 16428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:40:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:48 smithi007 bash[22722]: cephadm 2024-09-14T04:40:46.832264+0000 mgr.a (mgr.14355) 16429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:40:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:48 smithi131 bash[24745]: audit 2024-09-14T04:40:46.799418+0000 mgr.a (mgr.14355) 16427 : audit [DBG] from='client.354189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:48 smithi131 bash[24745]: audit 2024-09-14T04:40:46.819836+0000 mgr.a (mgr.14355) 16428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:40:48.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:48 smithi131 bash[24745]: cephadm 2024-09-14T04:40:46.832264+0000 mgr.a (mgr.14355) 16429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:40:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:48 smithi171 bash[25040]: audit 2024-09-14T04:40:46.799418+0000 mgr.a (mgr.14355) 16427 : audit [DBG] from='client.354189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:48 smithi171 bash[25040]: audit 2024-09-14T04:40:46.819836+0000 mgr.a (mgr.14355) 16428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:40:48.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:48 smithi171 bash[25040]: cephadm 2024-09-14T04:40:46.832264+0000 mgr.a (mgr.14355) 16429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:40:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:49 smithi007 bash[22722]: cluster 2024-09-14T04:40:48.060607+0000 mgr.a (mgr.14355) 16430 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:49.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:49 smithi131 bash[24745]: cluster 2024-09-14T04:40:48.060607+0000 mgr.a (mgr.14355) 16430 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:49 smithi171 bash[25040]: cluster 2024-09-14T04:40:48.060607+0000 mgr.a (mgr.14355) 16430 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:51 smithi007 bash[22722]: cluster 2024-09-14T04:40:50.061562+0000 mgr.a (mgr.14355) 16431 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:51 smithi131 bash[24745]: cluster 2024-09-14T04:40:50.061562+0000 mgr.a (mgr.14355) 16431 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:51 smithi171 bash[25040]: cluster 2024-09-14T04:40:50.061562+0000 mgr.a (mgr.14355) 16431 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:40:52.221 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:52.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:52.222 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:52 smithi007 bash[22722]: cluster 2024-09-14T04:40:52.063953+0000 mgr.a (mgr.14355) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:52 smithi131 bash[24745]: cluster 2024-09-14T04:40:52.063953+0000 mgr.a (mgr.14355) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:52 smithi171 bash[25040]: cluster 2024-09-14T04:40:52.063953+0000 mgr.a (mgr.14355) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:53.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:53.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:53.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:53.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:53.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:53 smithi007 bash[22722]: audit 2024-09-14T04:40:52.558211+0000 mgr.a (mgr.14355) 16433 : audit [DBG] from='client.354300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:53 smithi131 bash[24745]: audit 2024-09-14T04:40:52.558211+0000 mgr.a (mgr.14355) 16433 : audit [DBG] from='client.354300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:53 smithi171 bash[25040]: audit 2024-09-14T04:40:52.558211+0000 mgr.a (mgr.14355) 16433 : audit [DBG] from='client.354300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:54 smithi007 bash[22722]: cluster 2024-09-14T04:40:54.064874+0000 mgr.a (mgr.14355) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:54 smithi131 bash[24745]: cluster 2024-09-14T04:40:54.064874+0000 mgr.a (mgr.14355) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:54 smithi171 bash[25040]: cluster 2024-09-14T04:40:54.064874+0000 mgr.a (mgr.14355) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:57 smithi007 bash[22722]: cluster 2024-09-14T04:40:56.067014+0000 mgr.a (mgr.14355) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:57 smithi131 bash[24745]: cluster 2024-09-14T04:40:56.067014+0000 mgr.a (mgr.14355) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:57 smithi171 bash[25040]: cluster 2024-09-14T04:40:56.067014+0000 mgr.a (mgr.14355) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:58.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:40:58.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:40:58.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:40:58.762 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:40:58.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:40:58.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:40:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:40:58.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:40:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:59 smithi007 bash[22722]: cluster 2024-09-14T04:40:58.067667+0000 mgr.a (mgr.14355) 16436 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:59.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:40:59 smithi007 bash[22722]: audit 2024-09-14T04:40:58.339950+0000 mgr.a (mgr.14355) 16437 : audit [DBG] from='client.354378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:59 smithi131 bash[24745]: cluster 2024-09-14T04:40:58.067667+0000 mgr.a (mgr.14355) 16436 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:40:59 smithi131 bash[24745]: audit 2024-09-14T04:40:58.339950+0000 mgr.a (mgr.14355) 16437 : audit [DBG] from='client.354378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:40:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:59 smithi171 bash[25040]: cluster 2024-09-14T04:40:58.067667+0000 mgr.a (mgr.14355) 16436 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:40:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:40:59 smithi171 bash[25040]: audit 2024-09-14T04:40:58.339950+0000 mgr.a (mgr.14355) 16437 : audit [DBG] from='client.354378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:01 smithi007 bash[22722]: cluster 2024-09-14T04:41:00.068592+0000 mgr.a (mgr.14355) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:01 smithi131 bash[24745]: cluster 2024-09-14T04:41:00.068592+0000 mgr.a (mgr.14355) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:01 smithi171 bash[25040]: cluster 2024-09-14T04:41:00.068592+0000 mgr.a (mgr.14355) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:03.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:03 smithi007 bash[22722]: cluster 2024-09-14T04:41:02.070928+0000 mgr.a (mgr.14355) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:03 smithi131 bash[24745]: cluster 2024-09-14T04:41:02.070928+0000 mgr.a (mgr.14355) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:03 smithi171 bash[25040]: cluster 2024-09-14T04:41:02.070928+0000 mgr.a (mgr.14355) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:03.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:03.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:04.546 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:05 smithi007 bash[22722]: cluster 2024-09-14T04:41:04.071809+0000 mgr.a (mgr.14355) 16440 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:05.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:05 smithi007 bash[22722]: audit 2024-09-14T04:41:04.095308+0000 mgr.a (mgr.14355) 16441 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:05 smithi131 bash[24745]: cluster 2024-09-14T04:41:04.071809+0000 mgr.a (mgr.14355) 16440 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:05.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:05 smithi131 bash[24745]: audit 2024-09-14T04:41:04.095308+0000 mgr.a (mgr.14355) 16441 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:05 smithi171 bash[25040]: cluster 2024-09-14T04:41:04.071809+0000 mgr.a (mgr.14355) 16440 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:05 smithi171 bash[25040]: audit 2024-09-14T04:41:04.095308+0000 mgr.a (mgr.14355) 16441 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:07 smithi007 bash[22722]: cluster 2024-09-14T04:41:06.074097+0000 mgr.a (mgr.14355) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:07 smithi131 bash[24745]: cluster 2024-09-14T04:41:06.074097+0000 mgr.a (mgr.14355) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:07 smithi171 bash[25040]: cluster 2024-09-14T04:41:06.074097+0000 mgr.a (mgr.14355) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:09 smithi007 bash[22722]: cluster 2024-09-14T04:41:08.074835+0000 mgr.a (mgr.14355) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:09 smithi131 bash[24745]: cluster 2024-09-14T04:41:08.074835+0000 mgr.a (mgr.14355) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:09 smithi171 bash[25040]: cluster 2024-09-14T04:41:08.074835+0000 mgr.a (mgr.14355) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:09.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:09.548 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:10.330 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:10.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:10.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:11 smithi007 bash[22722]: audit 2024-09-14T04:41:09.884700+0000 mgr.a (mgr.14355) 16444 : audit [DBG] from='client.354525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:11.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:11 smithi007 bash[22722]: cluster 2024-09-14T04:41:10.075405+0000 mgr.a (mgr.14355) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:11 smithi131 bash[24745]: audit 2024-09-14T04:41:09.884700+0000 mgr.a (mgr.14355) 16444 : audit [DBG] from='client.354525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:11 smithi131 bash[24745]: cluster 2024-09-14T04:41:10.075405+0000 mgr.a (mgr.14355) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:11 smithi171 bash[25040]: audit 2024-09-14T04:41:09.884700+0000 mgr.a (mgr.14355) 16444 : audit [DBG] from='client.354525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:11 smithi171 bash[25040]: cluster 2024-09-14T04:41:10.075405+0000 mgr.a (mgr.14355) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:13 smithi007 bash[22722]: cluster 2024-09-14T04:41:12.077851+0000 mgr.a (mgr.14355) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:41:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:13 smithi131 bash[24745]: cluster 2024-09-14T04:41:12.077851+0000 mgr.a (mgr.14355) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:41:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:13 smithi171 bash[25040]: cluster 2024-09-14T04:41:12.077851+0000 mgr.a (mgr.14355) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:41:15.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:15.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:15 smithi007 bash[22722]: cluster 2024-09-14T04:41:14.078824+0000 mgr.a (mgr.14355) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:41:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:15 smithi131 bash[24745]: cluster 2024-09-14T04:41:14.078824+0000 mgr.a (mgr.14355) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:41:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:15 smithi171 bash[25040]: cluster 2024-09-14T04:41:14.078824+0000 mgr.a (mgr.14355) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:41:16.115 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:16.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:17 smithi007 bash[22722]: audit 2024-09-14T04:41:15.674723+0000 mgr.a (mgr.14355) 16448 : audit [DBG] from='client.354600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:17.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:17 smithi007 bash[22722]: cluster 2024-09-14T04:41:16.080282+0000 mgr.a (mgr.14355) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:17 smithi131 bash[24745]: audit 2024-09-14T04:41:15.674723+0000 mgr.a (mgr.14355) 16448 : audit [DBG] from='client.354600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:17 smithi131 bash[24745]: cluster 2024-09-14T04:41:16.080282+0000 mgr.a (mgr.14355) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:17 smithi171 bash[25040]: audit 2024-09-14T04:41:15.674723+0000 mgr.a (mgr.14355) 16448 : audit [DBG] from='client.354600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:17.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:17 smithi171 bash[25040]: cluster 2024-09-14T04:41:16.080282+0000 mgr.a (mgr.14355) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:19.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:19 smithi007 bash[22722]: cluster 2024-09-14T04:41:18.081140+0000 mgr.a (mgr.14355) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:19 smithi131 bash[24745]: cluster 2024-09-14T04:41:18.081140+0000 mgr.a (mgr.14355) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:19 smithi171 bash[25040]: cluster 2024-09-14T04:41:18.081140+0000 mgr.a (mgr.14355) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:21.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:21.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:21.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:21 smithi007 bash[22722]: cluster 2024-09-14T04:41:20.082073+0000 mgr.a (mgr.14355) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:21 smithi131 bash[24745]: cluster 2024-09-14T04:41:20.082073+0000 mgr.a (mgr.14355) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:21.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:21 smithi171 bash[25040]: cluster 2024-09-14T04:41:20.082073+0000 mgr.a (mgr.14355) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:41:21.903 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:21.904 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:23 smithi007 bash[22722]: audit 2024-09-14T04:41:21.450084+0000 mgr.a (mgr.14355) 16452 : audit [DBG] from='client.354678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:23.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:23 smithi007 bash[22722]: cluster 2024-09-14T04:41:22.084810+0000 mgr.a (mgr.14355) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:23 smithi131 bash[24745]: audit 2024-09-14T04:41:21.450084+0000 mgr.a (mgr.14355) 16452 : audit [DBG] from='client.354678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:23 smithi131 bash[24745]: cluster 2024-09-14T04:41:22.084810+0000 mgr.a (mgr.14355) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:23 smithi171 bash[25040]: audit 2024-09-14T04:41:21.450084+0000 mgr.a (mgr.14355) 16452 : audit [DBG] from='client.354678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:23 smithi171 bash[25040]: cluster 2024-09-14T04:41:22.084810+0000 mgr.a (mgr.14355) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:25 smithi007 bash[22722]: cluster 2024-09-14T04:41:24.085721+0000 mgr.a (mgr.14355) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:41:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:25 smithi131 bash[24745]: cluster 2024-09-14T04:41:24.085721+0000 mgr.a (mgr.14355) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:41:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:25 smithi171 bash[25040]: cluster 2024-09-14T04:41:24.085721+0000 mgr.a (mgr.14355) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:41:26.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:27 smithi007 bash[22722]: cluster 2024-09-14T04:41:26.087698+0000 mgr.a (mgr.14355) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:41:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:27 smithi131 bash[24745]: cluster 2024-09-14T04:41:26.087698+0000 mgr.a (mgr.14355) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:41:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:27 smithi171 bash[25040]: cluster 2024-09-14T04:41:26.087698+0000 mgr.a (mgr.14355) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:41:27.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:27.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:27.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:27.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:27.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:28 smithi007 bash[22722]: audit 2024-09-14T04:41:27.241513+0000 mgr.a (mgr.14355) 16456 : audit [DBG] from='client.354756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:28 smithi131 bash[24745]: audit 2024-09-14T04:41:27.241513+0000 mgr.a (mgr.14355) 16456 : audit [DBG] from='client.354756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:28 smithi171 bash[25040]: audit 2024-09-14T04:41:27.241513+0000 mgr.a (mgr.14355) 16456 : audit [DBG] from='client.354756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:29 smithi007 bash[22722]: cluster 2024-09-14T04:41:28.088563+0000 mgr.a (mgr.14355) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:29 smithi171 bash[25040]: cluster 2024-09-14T04:41:28.088563+0000 mgr.a (mgr.14355) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:29.555 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:29 smithi131 bash[24745]: cluster 2024-09-14T04:41:28.088563+0000 mgr.a (mgr.14355) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:31 smithi007 bash[22722]: cluster 2024-09-14T04:41:30.089506+0000 mgr.a (mgr.14355) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:31 smithi131 bash[24745]: cluster 2024-09-14T04:41:30.089506+0000 mgr.a (mgr.14355) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:31 smithi171 bash[25040]: cluster 2024-09-14T04:41:30.089506+0000 mgr.a (mgr.14355) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:32.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:33.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:33.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:33 smithi131 bash[24745]: cluster 2024-09-14T04:41:32.091881+0000 mgr.a (mgr.14355) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:33 smithi171 bash[25040]: cluster 2024-09-14T04:41:32.091881+0000 mgr.a (mgr.14355) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:33 smithi007 bash[22722]: cluster 2024-09-14T04:41:32.091881+0000 mgr.a (mgr.14355) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:34 smithi131 bash[24745]: audit 2024-09-14T04:41:32.989111+0000 mgr.a (mgr.14355) 16460 : audit [DBG] from='client.354831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:34 smithi171 bash[25040]: audit 2024-09-14T04:41:32.989111+0000 mgr.a (mgr.14355) 16460 : audit [DBG] from='client.354831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:34 smithi007 bash[22722]: audit 2024-09-14T04:41:32.989111+0000 mgr.a (mgr.14355) 16460 : audit [DBG] from='client.354831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:35 smithi131 bash[24745]: cluster 2024-09-14T04:41:34.092792+0000 mgr.a (mgr.14355) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:35 smithi171 bash[25040]: cluster 2024-09-14T04:41:34.092792+0000 mgr.a (mgr.14355) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:35 smithi007 bash[22722]: cluster 2024-09-14T04:41:34.092792+0000 mgr.a (mgr.14355) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:37 smithi131 bash[24745]: cluster 2024-09-14T04:41:36.094999+0000 mgr.a (mgr.14355) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:37 smithi171 bash[25040]: cluster 2024-09-14T04:41:36.094999+0000 mgr.a (mgr.14355) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:37 smithi007 bash[22722]: cluster 2024-09-14T04:41:36.094999+0000 mgr.a (mgr.14355) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:39.180 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:39.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:39 smithi131 bash[24745]: cluster 2024-09-14T04:41:38.095761+0000 mgr.a (mgr.14355) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:39 smithi171 bash[25040]: cluster 2024-09-14T04:41:38.095761+0000 mgr.a (mgr.14355) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:39 smithi007 bash[22722]: cluster 2024-09-14T04:41:38.095761+0000 mgr.a (mgr.14355) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:40 smithi131 bash[24745]: audit 2024-09-14T04:41:38.743353+0000 mgr.a (mgr.14355) 16464 : audit [DBG] from='client.354909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:40 smithi171 bash[25040]: audit 2024-09-14T04:41:38.743353+0000 mgr.a (mgr.14355) 16464 : audit [DBG] from='client.354909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:40.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:40 smithi007 bash[22722]: audit 2024-09-14T04:41:38.743353+0000 mgr.a (mgr.14355) 16464 : audit [DBG] from='client.354909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:41 smithi131 bash[24745]: cluster 2024-09-14T04:41:40.096636+0000 mgr.a (mgr.14355) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:41 smithi171 bash[25040]: cluster 2024-09-14T04:41:40.096636+0000 mgr.a (mgr.14355) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:41 smithi007 bash[22722]: cluster 2024-09-14T04:41:40.096636+0000 mgr.a (mgr.14355) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:43 smithi131 bash[24745]: cluster 2024-09-14T04:41:42.098843+0000 mgr.a (mgr.14355) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:43 smithi171 bash[25040]: cluster 2024-09-14T04:41:42.098843+0000 mgr.a (mgr.14355) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:43 smithi007 bash[22722]: cluster 2024-09-14T04:41:42.098843+0000 mgr.a (mgr.14355) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:44.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:44.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:44.183 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:44.939 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:45 smithi131 bash[24745]: cluster 2024-09-14T04:41:44.099585+0000 mgr.a (mgr.14355) 16467 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:45 smithi171 bash[25040]: cluster 2024-09-14T04:41:44.099585+0000 mgr.a (mgr.14355) 16467 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:45 smithi007 bash[22722]: cluster 2024-09-14T04:41:44.099585+0000 mgr.a (mgr.14355) 16467 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:46 smithi131 bash[24745]: audit 2024-09-14T04:41:44.513388+0000 mgr.a (mgr.14355) 16468 : audit [DBG] from='client.354987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:46 smithi171 bash[25040]: audit 2024-09-14T04:41:44.513388+0000 mgr.a (mgr.14355) 16468 : audit [DBG] from='client.354987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:46 smithi007 bash[22722]: audit 2024-09-14T04:41:44.513388+0000 mgr.a (mgr.14355) 16468 : audit [DBG] from='client.354987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:47 smithi131 bash[24745]: cluster 2024-09-14T04:41:46.101925+0000 mgr.a (mgr.14355) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:47 smithi131 bash[24745]: audit 2024-09-14T04:41:46.890230+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:41:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:47 smithi171 bash[25040]: cluster 2024-09-14T04:41:46.101925+0000 mgr.a (mgr.14355) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:47 smithi171 bash[25040]: audit 2024-09-14T04:41:46.890230+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:41:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:47 smithi007 bash[22722]: cluster 2024-09-14T04:41:46.101925+0000 mgr.a (mgr.14355) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:41:47.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:47 smithi007 bash[22722]: audit 2024-09-14T04:41:46.890230+0000 mon.a (mon.0) 3048 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:41:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:48 smithi131 bash[24745]: audit 2024-09-14T04:41:47.729446+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:41:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:48 smithi131 bash[24745]: audit 2024-09-14T04:41:47.731021+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:41:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:48 smithi131 bash[24745]: audit 2024-09-14T04:41:47.741104+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:41:48.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:48 smithi131 bash[24745]: audit 2024-09-14T04:41:47.745910+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:48 smithi171 bash[25040]: audit 2024-09-14T04:41:47.729446+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:41:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:48 smithi171 bash[25040]: audit 2024-09-14T04:41:47.731021+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:41:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:48 smithi171 bash[25040]: audit 2024-09-14T04:41:47.741104+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:41:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:48 smithi171 bash[25040]: audit 2024-09-14T04:41:47.745910+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22972]: debug 2024-09-14T04:41:48.478+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22972]: debug 2024-09-14T04:41:48.482+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22722]: audit 2024-09-14T04:41:47.729446+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22722]: audit 2024-09-14T04:41:47.731021+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22722]: audit 2024-09-14T04:41:47.741104+0000 mon.a (mon.0) 3051 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:41:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:48 smithi007 bash[22722]: audit 2024-09-14T04:41:47.745910+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:49 smithi131 bash[24745]: audit 2024-09-14T04:41:47.748214+0000 mgr.a (mgr.14355) 16470 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:49 smithi131 bash[24745]: cluster 2024-09-14T04:41:48.102468+0000 mgr.a (mgr.14355) 16471 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:49 smithi171 bash[25040]: audit 2024-09-14T04:41:47.748214+0000 mgr.a (mgr.14355) 16470 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:49.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:49 smithi171 bash[25040]: cluster 2024-09-14T04:41:48.102468+0000 mgr.a (mgr.14355) 16471 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:49 smithi007 bash[22722]: audit 2024-09-14T04:41:47.748214+0000 mgr.a (mgr.14355) 16470 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:41:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:49 smithi007 bash[22722]: cluster 2024-09-14T04:41:48.102468+0000 mgr.a (mgr.14355) 16471 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:49.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:49.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:49.941 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:50 smithi131 bash[24745]: audit 2024-09-14T04:41:48.485844+0000 mgr.a (mgr.14355) 16472 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:41:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:50 smithi131 bash[24745]: cephadm 2024-09-14T04:41:48.487157+0000 mgr.a (mgr.14355) 16473 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:41:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:50 smithi171 bash[25040]: audit 2024-09-14T04:41:48.485844+0000 mgr.a (mgr.14355) 16472 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:41:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:50 smithi171 bash[25040]: cephadm 2024-09-14T04:41:48.487157+0000 mgr.a (mgr.14355) 16473 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:41:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:50 smithi007 bash[22722]: audit 2024-09-14T04:41:48.485844+0000 mgr.a (mgr.14355) 16472 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:41:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:50 smithi007 bash[22722]: cephadm 2024-09-14T04:41:48.487157+0000 mgr.a (mgr.14355) 16473 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:41:50.739 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:50.739 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:51 smithi131 bash[24745]: cluster 2024-09-14T04:41:50.103325+0000 mgr.a (mgr.14355) 16474 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:51 smithi131 bash[24745]: audit 2024-09-14T04:41:50.287489+0000 mgr.a (mgr.14355) 16475 : audit [DBG] from='client.355167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:51 smithi171 bash[25040]: cluster 2024-09-14T04:41:50.103325+0000 mgr.a (mgr.14355) 16474 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:51 smithi171 bash[25040]: audit 2024-09-14T04:41:50.287489+0000 mgr.a (mgr.14355) 16475 : audit [DBG] from='client.355167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:51 smithi007 bash[22722]: cluster 2024-09-14T04:41:50.103325+0000 mgr.a (mgr.14355) 16474 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:41:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:51 smithi007 bash[22722]: audit 2024-09-14T04:41:50.287489+0000 mgr.a (mgr.14355) 16475 : audit [DBG] from='client.355167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:53 smithi131 bash[24745]: cluster 2024-09-14T04:41:52.106028+0000 mgr.a (mgr.14355) 16476 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:53 smithi171 bash[25040]: cluster 2024-09-14T04:41:52.106028+0000 mgr.a (mgr.14355) 16476 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:53 smithi007 bash[22722]: cluster 2024-09-14T04:41:52.106028+0000 mgr.a (mgr.14355) 16476 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:55 smithi131 bash[24745]: cluster 2024-09-14T04:41:54.106858+0000 mgr.a (mgr.14355) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:41:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:55 smithi171 bash[25040]: cluster 2024-09-14T04:41:54.106858+0000 mgr.a (mgr.14355) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:41:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:55 smithi007 bash[22722]: cluster 2024-09-14T04:41:54.106858+0000 mgr.a (mgr.14355) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:41:55.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:41:55.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:41:55.742 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:41:56.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:41:56.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:41:56.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:41:56.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:41:56.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:57 smithi131 bash[24745]: audit 2024-09-14T04:41:56.066634+0000 mgr.a (mgr.14355) 16478 : audit [DBG] from='client.355245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:57 smithi131 bash[24745]: cluster 2024-09-14T04:41:56.108986+0000 mgr.a (mgr.14355) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:57 smithi171 bash[25040]: audit 2024-09-14T04:41:56.066634+0000 mgr.a (mgr.14355) 16478 : audit [DBG] from='client.355245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:57 smithi171 bash[25040]: cluster 2024-09-14T04:41:56.108986+0000 mgr.a (mgr.14355) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:57 smithi007 bash[22722]: audit 2024-09-14T04:41:56.066634+0000 mgr.a (mgr.14355) 16478 : audit [DBG] from='client.355245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:41:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:57 smithi007 bash[22722]: cluster 2024-09-14T04:41:56.108986+0000 mgr.a (mgr.14355) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:41:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:41:59 smithi171 bash[25040]: cluster 2024-09-14T04:41:58.109952+0000 mgr.a (mgr.14355) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:41:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:41:59 smithi007 bash[22722]: cluster 2024-09-14T04:41:58.109952+0000 mgr.a (mgr.14355) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:41:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:41:59 smithi131 bash[24745]: cluster 2024-09-14T04:41:58.109952+0000 mgr.a (mgr.14355) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:42:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:01.500 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:01 smithi171 bash[25040]: cluster 2024-09-14T04:42:00.110791+0000 mgr.a (mgr.14355) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:42:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:01 smithi007 bash[22722]: cluster 2024-09-14T04:42:00.110791+0000 mgr.a (mgr.14355) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:42:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:01 smithi131 bash[24745]: cluster 2024-09-14T04:42:00.110791+0000 mgr.a (mgr.14355) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 161 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:42:02.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:02.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:03 smithi007 bash[22722]: audit 2024-09-14T04:42:01.835639+0000 mgr.a (mgr.14355) 16482 : audit [DBG] from='client.355320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:03 smithi007 bash[22722]: cluster 2024-09-14T04:42:02.112118+0000 mgr.a (mgr.14355) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:42:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:03 smithi131 bash[24745]: audit 2024-09-14T04:42:01.835639+0000 mgr.a (mgr.14355) 16482 : audit [DBG] from='client.355320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:03 smithi131 bash[24745]: cluster 2024-09-14T04:42:02.112118+0000 mgr.a (mgr.14355) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:42:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:03 smithi171 bash[25040]: audit 2024-09-14T04:42:01.835639+0000 mgr.a (mgr.14355) 16482 : audit [DBG] from='client.355320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:03 smithi171 bash[25040]: cluster 2024-09-14T04:42:02.112118+0000 mgr.a (mgr.14355) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T04:42:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:05 smithi007 bash[22722]: cluster 2024-09-14T04:42:04.112999+0000 mgr.a (mgr.14355) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:05 smithi131 bash[24745]: cluster 2024-09-14T04:42:04.112999+0000 mgr.a (mgr.14355) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:05 smithi171 bash[25040]: cluster 2024-09-14T04:42:04.112999+0000 mgr.a (mgr.14355) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:07.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:07.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:07 smithi007 bash[22722]: cluster 2024-09-14T04:42:06.115213+0000 mgr.a (mgr.14355) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:07 smithi131 bash[24745]: cluster 2024-09-14T04:42:06.115213+0000 mgr.a (mgr.14355) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:07 smithi171 bash[25040]: cluster 2024-09-14T04:42:06.115213+0000 mgr.a (mgr.14355) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:08.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:08.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:09 smithi007 bash[22722]: audit 2024-09-14T04:42:07.613252+0000 mgr.a (mgr.14355) 16486 : audit [DBG] from='client.355398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:09 smithi007 bash[22722]: cluster 2024-09-14T04:42:08.115781+0000 mgr.a (mgr.14355) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:09 smithi131 bash[24745]: audit 2024-09-14T04:42:07.613252+0000 mgr.a (mgr.14355) 16486 : audit [DBG] from='client.355398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:09 smithi131 bash[24745]: cluster 2024-09-14T04:42:08.115781+0000 mgr.a (mgr.14355) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:09 smithi171 bash[25040]: audit 2024-09-14T04:42:07.613252+0000 mgr.a (mgr.14355) 16486 : audit [DBG] from='client.355398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:09 smithi171 bash[25040]: cluster 2024-09-14T04:42:08.115781+0000 mgr.a (mgr.14355) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:11 smithi007 bash[22722]: cluster 2024-09-14T04:42:10.116540+0000 mgr.a (mgr.14355) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:11 smithi131 bash[24745]: cluster 2024-09-14T04:42:10.116540+0000 mgr.a (mgr.14355) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:11 smithi171 bash[25040]: cluster 2024-09-14T04:42:10.116540+0000 mgr.a (mgr.14355) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:42:13.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:13.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:13.045 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:13 smithi007 bash[22722]: cluster 2024-09-14T04:42:12.118788+0000 mgr.a (mgr.14355) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:13 smithi131 bash[24745]: cluster 2024-09-14T04:42:12.118788+0000 mgr.a (mgr.14355) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:13 smithi171 bash[25040]: cluster 2024-09-14T04:42:12.118788+0000 mgr.a (mgr.14355) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:42:13.832 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:13.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:15 smithi007 bash[22722]: audit 2024-09-14T04:42:13.377021+0000 mgr.a (mgr.14355) 16490 : audit [DBG] from='client.355473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:15 smithi007 bash[22722]: cluster 2024-09-14T04:42:14.119753+0000 mgr.a (mgr.14355) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:15 smithi131 bash[24745]: audit 2024-09-14T04:42:13.377021+0000 mgr.a (mgr.14355) 16490 : audit [DBG] from='client.355473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:15 smithi131 bash[24745]: cluster 2024-09-14T04:42:14.119753+0000 mgr.a (mgr.14355) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:15 smithi171 bash[25040]: audit 2024-09-14T04:42:13.377021+0000 mgr.a (mgr.14355) 16490 : audit [DBG] from='client.355473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:15 smithi171 bash[25040]: cluster 2024-09-14T04:42:14.119753+0000 mgr.a (mgr.14355) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:17 smithi007 bash[22722]: cluster 2024-09-14T04:42:16.121962+0000 mgr.a (mgr.14355) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:17 smithi131 bash[24745]: cluster 2024-09-14T04:42:16.121962+0000 mgr.a (mgr.14355) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:17 smithi171 bash[25040]: cluster 2024-09-14T04:42:16.121962+0000 mgr.a (mgr.14355) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:19.592 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:19.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:19.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:19 smithi007 bash[22722]: cluster 2024-09-14T04:42:18.122756+0000 mgr.a (mgr.14355) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:19 smithi131 bash[24745]: cluster 2024-09-14T04:42:18.122756+0000 mgr.a (mgr.14355) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:19 smithi171 bash[25040]: cluster 2024-09-14T04:42:18.122756+0000 mgr.a (mgr.14355) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:20 smithi007 bash[22722]: audit 2024-09-14T04:42:19.170999+0000 mgr.a (mgr.14355) 16494 : audit [DBG] from='client.355545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:20 smithi131 bash[24745]: audit 2024-09-14T04:42:19.170999+0000 mgr.a (mgr.14355) 16494 : audit [DBG] from='client.355545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:20 smithi171 bash[25040]: audit 2024-09-14T04:42:19.170999+0000 mgr.a (mgr.14355) 16494 : audit [DBG] from='client.355545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:21 smithi007 bash[22722]: cluster 2024-09-14T04:42:20.123735+0000 mgr.a (mgr.14355) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:21 smithi131 bash[24745]: cluster 2024-09-14T04:42:20.123735+0000 mgr.a (mgr.14355) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:21 smithi171 bash[25040]: cluster 2024-09-14T04:42:20.123735+0000 mgr.a (mgr.14355) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:23 smithi007 bash[22722]: cluster 2024-09-14T04:42:22.126909+0000 mgr.a (mgr.14355) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:23 smithi131 bash[24745]: cluster 2024-09-14T04:42:22.126909+0000 mgr.a (mgr.14355) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:23 smithi171 bash[25040]: cluster 2024-09-14T04:42:22.126909+0000 mgr.a (mgr.14355) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:24.594 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:24.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:25.356 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:25 smithi007 bash[22722]: cluster 2024-09-14T04:42:24.127759+0000 mgr.a (mgr.14355) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:25 smithi131 bash[24745]: cluster 2024-09-14T04:42:24.127759+0000 mgr.a (mgr.14355) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:25 smithi171 bash[25040]: cluster 2024-09-14T04:42:24.127759+0000 mgr.a (mgr.14355) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:26 smithi007 bash[22722]: audit 2024-09-14T04:42:24.929247+0000 mgr.a (mgr.14355) 16498 : audit [DBG] from='client.355623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:26 smithi131 bash[24745]: audit 2024-09-14T04:42:24.929247+0000 mgr.a (mgr.14355) 16498 : audit [DBG] from='client.355623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:26 smithi171 bash[25040]: audit 2024-09-14T04:42:24.929247+0000 mgr.a (mgr.14355) 16498 : audit [DBG] from='client.355623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:27 smithi007 bash[22722]: cluster 2024-09-14T04:42:26.130183+0000 mgr.a (mgr.14355) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:42:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:27 smithi131 bash[24745]: cluster 2024-09-14T04:42:26.130183+0000 mgr.a (mgr.14355) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:42:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:27 smithi171 bash[25040]: cluster 2024-09-14T04:42:26.130183+0000 mgr.a (mgr.14355) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T04:42:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:29 smithi007 bash[22722]: cluster 2024-09-14T04:42:28.130968+0000 mgr.a (mgr.14355) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:29 smithi131 bash[24745]: cluster 2024-09-14T04:42:28.130968+0000 mgr.a (mgr.14355) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:29 smithi171 bash[25040]: cluster 2024-09-14T04:42:28.130968+0000 mgr.a (mgr.14355) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:30.361 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:31.146 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:31.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:31.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:31 smithi007 bash[22722]: cluster 2024-09-14T04:42:30.131726+0000 mgr.a (mgr.14355) 16501 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:31 smithi131 bash[24745]: cluster 2024-09-14T04:42:30.131726+0000 mgr.a (mgr.14355) 16501 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:31 smithi171 bash[25040]: cluster 2024-09-14T04:42:30.131726+0000 mgr.a (mgr.14355) 16501 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:32 smithi007 bash[22722]: audit 2024-09-14T04:42:30.701617+0000 mgr.a (mgr.14355) 16502 : audit [DBG] from='client.355701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:32 smithi131 bash[24745]: audit 2024-09-14T04:42:30.701617+0000 mgr.a (mgr.14355) 16502 : audit [DBG] from='client.355701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:32 smithi171 bash[25040]: audit 2024-09-14T04:42:30.701617+0000 mgr.a (mgr.14355) 16502 : audit [DBG] from='client.355701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:33 smithi007 bash[22722]: cluster 2024-09-14T04:42:32.134549+0000 mgr.a (mgr.14355) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:33 smithi131 bash[24745]: cluster 2024-09-14T04:42:32.134549+0000 mgr.a (mgr.14355) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:33 smithi171 bash[25040]: cluster 2024-09-14T04:42:32.134549+0000 mgr.a (mgr.14355) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:34 smithi007 bash[22722]: cluster 2024-09-14T04:42:34.135408+0000 mgr.a (mgr.14355) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:42:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:34 smithi131 bash[24745]: cluster 2024-09-14T04:42:34.135408+0000 mgr.a (mgr.14355) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:42:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:34 smithi171 bash[25040]: cluster 2024-09-14T04:42:34.135408+0000 mgr.a (mgr.14355) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:42:36.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:36.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:36.916 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:36.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:36.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:36.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:36.917 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:37 smithi007 bash[22722]: cluster 2024-09-14T04:42:36.137367+0000 mgr.a (mgr.14355) 16505 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:37 smithi131 bash[24745]: cluster 2024-09-14T04:42:36.137367+0000 mgr.a (mgr.14355) 16505 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:37 smithi171 bash[25040]: cluster 2024-09-14T04:42:36.137367+0000 mgr.a (mgr.14355) 16505 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:42:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:38 smithi007 bash[22722]: audit 2024-09-14T04:42:36.480780+0000 mgr.a (mgr.14355) 16506 : audit [DBG] from='client.355779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:38 smithi131 bash[24745]: audit 2024-09-14T04:42:36.480780+0000 mgr.a (mgr.14355) 16506 : audit [DBG] from='client.355779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:38.581 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:38 smithi171 bash[25040]: audit 2024-09-14T04:42:36.480780+0000 mgr.a (mgr.14355) 16506 : audit [DBG] from='client.355779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:39 smithi131 bash[24745]: cluster 2024-09-14T04:42:38.138379+0000 mgr.a (mgr.14355) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:39 smithi171 bash[25040]: cluster 2024-09-14T04:42:38.138379+0000 mgr.a (mgr.14355) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:39 smithi007 bash[22722]: cluster 2024-09-14T04:42:38.138379+0000 mgr.a (mgr.14355) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:41 smithi131 bash[24745]: cluster 2024-09-14T04:42:40.139188+0000 mgr.a (mgr.14355) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:41 smithi171 bash[25040]: cluster 2024-09-14T04:42:40.139188+0000 mgr.a (mgr.14355) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:41 smithi007 bash[22722]: cluster 2024-09-14T04:42:40.139188+0000 mgr.a (mgr.14355) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:42:41.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:41.919 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:42.699 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:42.699 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:43 smithi131 bash[24745]: cluster 2024-09-14T04:42:42.141369+0000 mgr.a (mgr.14355) 16509 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:42:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:43 smithi131 bash[24745]: audit 2024-09-14T04:42:42.255497+0000 mgr.a (mgr.14355) 16510 : audit [DBG] from='client.355857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:43 smithi171 bash[25040]: cluster 2024-09-14T04:42:42.141369+0000 mgr.a (mgr.14355) 16509 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:42:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:43 smithi171 bash[25040]: audit 2024-09-14T04:42:42.255497+0000 mgr.a (mgr.14355) 16510 : audit [DBG] from='client.355857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:43 smithi007 bash[22722]: cluster 2024-09-14T04:42:42.141369+0000 mgr.a (mgr.14355) 16509 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:42:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:43 smithi007 bash[22722]: audit 2024-09-14T04:42:42.255497+0000 mgr.a (mgr.14355) 16510 : audit [DBG] from='client.355857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:45 smithi131 bash[24745]: cluster 2024-09-14T04:42:44.142252+0000 mgr.a (mgr.14355) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:45 smithi171 bash[25040]: cluster 2024-09-14T04:42:44.142252+0000 mgr.a (mgr.14355) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:45 smithi007 bash[22722]: cluster 2024-09-14T04:42:44.142252+0000 mgr.a (mgr.14355) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:47 smithi131 bash[24745]: cluster 2024-09-14T04:42:46.144390+0000 mgr.a (mgr.14355) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:47 smithi171 bash[25040]: cluster 2024-09-14T04:42:46.144390+0000 mgr.a (mgr.14355) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:47.701 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:47.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:47 smithi007 bash[22722]: cluster 2024-09-14T04:42:46.144390+0000 mgr.a (mgr.14355) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:42:48.478 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:49 smithi131 bash[24745]: audit 2024-09-14T04:42:48.033962+0000 mgr.a (mgr.14355) 16513 : audit [DBG] from='client.355932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:49 smithi131 bash[24745]: cluster 2024-09-14T04:42:48.145034+0000 mgr.a (mgr.14355) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:49 smithi131 bash[24745]: audit 2024-09-14T04:42:48.537552+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:42:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:49 smithi171 bash[25040]: audit 2024-09-14T04:42:48.033962+0000 mgr.a (mgr.14355) 16513 : audit [DBG] from='client.355932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:49 smithi171 bash[25040]: cluster 2024-09-14T04:42:48.145034+0000 mgr.a (mgr.14355) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:49 smithi171 bash[25040]: audit 2024-09-14T04:42:48.537552+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:42:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:49 smithi007 bash[22722]: audit 2024-09-14T04:42:48.033962+0000 mgr.a (mgr.14355) 16513 : audit [DBG] from='client.355932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:49 smithi007 bash[22722]: cluster 2024-09-14T04:42:48.145034+0000 mgr.a (mgr.14355) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:49 smithi007 bash[22722]: audit 2024-09-14T04:42:48.537552+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:42:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22972]: debug 2024-09-14T04:42:50.129+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:42:50.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22972]: debug 2024-09-14T04:42:50.129+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:42:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22722]: audit 2024-09-14T04:42:49.384547+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:42:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22722]: audit 2024-09-14T04:42:49.386255+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:42:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22722]: audit 2024-09-14T04:42:49.396880+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:42:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:50 smithi007 bash[22722]: audit 2024-09-14T04:42:49.399817+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:50 smithi131 bash[24745]: audit 2024-09-14T04:42:49.384547+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:42:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:50 smithi131 bash[24745]: audit 2024-09-14T04:42:49.386255+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:42:50.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:50 smithi131 bash[24745]: audit 2024-09-14T04:42:49.396880+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:42:50.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:50 smithi131 bash[24745]: audit 2024-09-14T04:42:49.399817+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:50 smithi171 bash[25040]: audit 2024-09-14T04:42:49.384547+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:42:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:50 smithi171 bash[25040]: audit 2024-09-14T04:42:49.386255+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:42:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:50 smithi171 bash[25040]: audit 2024-09-14T04:42:49.396880+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:42:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:50 smithi171 bash[25040]: audit 2024-09-14T04:42:49.399817+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:51 smithi131 bash[24745]: audit 2024-09-14T04:42:49.402349+0000 mgr.a (mgr.14355) 16515 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:51 smithi131 bash[24745]: audit 2024-09-14T04:42:50.132668+0000 mgr.a (mgr.14355) 16516 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:42:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:51 smithi131 bash[24745]: cephadm 2024-09-14T04:42:50.133835+0000 mgr.a (mgr.14355) 16517 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:42:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:51 smithi131 bash[24745]: cluster 2024-09-14T04:42:50.145526+0000 mgr.a (mgr.14355) 16518 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:51 smithi171 bash[25040]: audit 2024-09-14T04:42:49.402349+0000 mgr.a (mgr.14355) 16515 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:51 smithi171 bash[25040]: audit 2024-09-14T04:42:50.132668+0000 mgr.a (mgr.14355) 16516 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:42:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:51 smithi171 bash[25040]: cephadm 2024-09-14T04:42:50.133835+0000 mgr.a (mgr.14355) 16517 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:42:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:51 smithi171 bash[25040]: cluster 2024-09-14T04:42:50.145526+0000 mgr.a (mgr.14355) 16518 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:51 smithi007 bash[22722]: audit 2024-09-14T04:42:49.402349+0000 mgr.a (mgr.14355) 16515 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:42:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:51 smithi007 bash[22722]: audit 2024-09-14T04:42:50.132668+0000 mgr.a (mgr.14355) 16516 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:42:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:51 smithi007 bash[22722]: cephadm 2024-09-14T04:42:50.133835+0000 mgr.a (mgr.14355) 16517 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:42:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:51 smithi007 bash[22722]: cluster 2024-09-14T04:42:50.145526+0000 mgr.a (mgr.14355) 16518 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:42:53.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:53.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:53.480 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:53 smithi131 bash[24745]: cluster 2024-09-14T04:42:52.147764+0000 mgr.a (mgr.14355) 16519 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:53 smithi171 bash[25040]: cluster 2024-09-14T04:42:52.147764+0000 mgr.a (mgr.14355) 16519 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:53 smithi007 bash[22722]: cluster 2024-09-14T04:42:52.147764+0000 mgr.a (mgr.14355) 16519 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:54.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:42:54.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:42:54.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:42:54.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:42:54.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:42:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:55 smithi131 bash[24745]: audit 2024-09-14T04:42:53.810288+0000 mgr.a (mgr.14355) 16520 : audit [DBG] from='client.356118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:55 smithi131 bash[24745]: cluster 2024-09-14T04:42:54.154509+0000 mgr.a (mgr.14355) 16521 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:55 smithi171 bash[25040]: audit 2024-09-14T04:42:53.810288+0000 mgr.a (mgr.14355) 16520 : audit [DBG] from='client.356118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:55.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:55 smithi171 bash[25040]: cluster 2024-09-14T04:42:54.154509+0000 mgr.a (mgr.14355) 16521 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:55 smithi007 bash[22722]: audit 2024-09-14T04:42:53.810288+0000 mgr.a (mgr.14355) 16520 : audit [DBG] from='client.356118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:42:55.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:55 smithi007 bash[22722]: cluster 2024-09-14T04:42:54.154509+0000 mgr.a (mgr.14355) 16521 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:57 smithi131 bash[24745]: cluster 2024-09-14T04:42:56.156672+0000 mgr.a (mgr.14355) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:57 smithi171 bash[25040]: cluster 2024-09-14T04:42:56.156672+0000 mgr.a (mgr.14355) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:57 smithi007 bash[22722]: cluster 2024-09-14T04:42:56.156672+0000 mgr.a (mgr.14355) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:59.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:42:59.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:42:59.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:42:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:42:59 smithi131 bash[24745]: cluster 2024-09-14T04:42:58.157454+0000 mgr.a (mgr.14355) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:42:59 smithi171 bash[25040]: cluster 2024-09-14T04:42:58.157454+0000 mgr.a (mgr.14355) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:42:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:42:59 smithi007 bash[22722]: cluster 2024-09-14T04:42:58.157454+0000 mgr.a (mgr.14355) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:00.050 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:00.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:01 smithi131 bash[24745]: audit 2024-09-14T04:42:59.593922+0000 mgr.a (mgr.14355) 16524 : audit [DBG] from='client.356196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:01 smithi131 bash[24745]: cluster 2024-09-14T04:43:00.158425+0000 mgr.a (mgr.14355) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:01 smithi171 bash[25040]: audit 2024-09-14T04:42:59.593922+0000 mgr.a (mgr.14355) 16524 : audit [DBG] from='client.356196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:01 smithi171 bash[25040]: cluster 2024-09-14T04:43:00.158425+0000 mgr.a (mgr.14355) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:01 smithi007 bash[22722]: audit 2024-09-14T04:42:59.593922+0000 mgr.a (mgr.14355) 16524 : audit [DBG] from='client.356196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:01 smithi007 bash[22722]: cluster 2024-09-14T04:43:00.158425+0000 mgr.a (mgr.14355) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:03 smithi131 bash[24745]: cluster 2024-09-14T04:43:02.160698+0000 mgr.a (mgr.14355) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:03 smithi171 bash[25040]: cluster 2024-09-14T04:43:02.160698+0000 mgr.a (mgr.14355) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:03 smithi007 bash[22722]: cluster 2024-09-14T04:43:02.160698+0000 mgr.a (mgr.14355) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:05.052 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:05 smithi131 bash[24745]: cluster 2024-09-14T04:43:04.161478+0000 mgr.a (mgr.14355) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:05 smithi171 bash[25040]: cluster 2024-09-14T04:43:04.161478+0000 mgr.a (mgr.14355) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:05 smithi007 bash[22722]: cluster 2024-09-14T04:43:04.161478+0000 mgr.a (mgr.14355) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:05.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:05.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:05.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:05.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:05.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:07 smithi131 bash[24745]: audit 2024-09-14T04:43:05.386098+0000 mgr.a (mgr.14355) 16528 : audit [DBG] from='client.356274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:07 smithi131 bash[24745]: cluster 2024-09-14T04:43:06.164272+0000 mgr.a (mgr.14355) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:07 smithi171 bash[25040]: audit 2024-09-14T04:43:05.386098+0000 mgr.a (mgr.14355) 16528 : audit [DBG] from='client.356274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:07 smithi171 bash[25040]: cluster 2024-09-14T04:43:06.164272+0000 mgr.a (mgr.14355) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:07 smithi007 bash[22722]: audit 2024-09-14T04:43:05.386098+0000 mgr.a (mgr.14355) 16528 : audit [DBG] from='client.356274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:07 smithi007 bash[22722]: cluster 2024-09-14T04:43:06.164272+0000 mgr.a (mgr.14355) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:09 smithi131 bash[24745]: cluster 2024-09-14T04:43:08.165053+0000 mgr.a (mgr.14355) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:09.551 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:09 smithi171 bash[25040]: cluster 2024-09-14T04:43:08.165053+0000 mgr.a (mgr.14355) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:09 smithi007 bash[22722]: cluster 2024-09-14T04:43:08.165053+0000 mgr.a (mgr.14355) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:10.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:10.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:11 smithi131 bash[24745]: cluster 2024-09-14T04:43:10.165809+0000 mgr.a (mgr.14355) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:11 smithi171 bash[25040]: cluster 2024-09-14T04:43:10.165809+0000 mgr.a (mgr.14355) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:11.589 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:11.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:11.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:11 smithi007 bash[22722]: cluster 2024-09-14T04:43:10.165809+0000 mgr.a (mgr.14355) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:12 smithi131 bash[24745]: audit 2024-09-14T04:43:11.148945+0000 mgr.a (mgr.14355) 16532 : audit [DBG] from='client.356349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:12 smithi171 bash[25040]: audit 2024-09-14T04:43:11.148945+0000 mgr.a (mgr.14355) 16532 : audit [DBG] from='client.356349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:12 smithi007 bash[22722]: audit 2024-09-14T04:43:11.148945+0000 mgr.a (mgr.14355) 16532 : audit [DBG] from='client.356349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:13 smithi131 bash[24745]: cluster 2024-09-14T04:43:12.168634+0000 mgr.a (mgr.14355) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:13 smithi171 bash[25040]: cluster 2024-09-14T04:43:12.168634+0000 mgr.a (mgr.14355) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:13 smithi007 bash[22722]: cluster 2024-09-14T04:43:12.168634+0000 mgr.a (mgr.14355) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:15 smithi171 bash[25040]: cluster 2024-09-14T04:43:14.169430+0000 mgr.a (mgr.14355) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:15 smithi007 bash[22722]: cluster 2024-09-14T04:43:14.169430+0000 mgr.a (mgr.14355) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:15 smithi131 bash[24745]: cluster 2024-09-14T04:43:14.169430+0000 mgr.a (mgr.14355) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:43:16.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:16.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:17.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:17.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:17.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:17 smithi171 bash[25040]: cluster 2024-09-14T04:43:16.171410+0000 mgr.a (mgr.14355) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:17 smithi007 bash[22722]: cluster 2024-09-14T04:43:16.171410+0000 mgr.a (mgr.14355) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:17 smithi131 bash[24745]: cluster 2024-09-14T04:43:16.171410+0000 mgr.a (mgr.14355) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:18 smithi007 bash[22722]: audit 2024-09-14T04:43:16.920672+0000 mgr.a (mgr.14355) 16536 : audit [DBG] from='client.356424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:18 smithi131 bash[24745]: audit 2024-09-14T04:43:16.920672+0000 mgr.a (mgr.14355) 16536 : audit [DBG] from='client.356424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:18 smithi171 bash[25040]: audit 2024-09-14T04:43:16.920672+0000 mgr.a (mgr.14355) 16536 : audit [DBG] from='client.356424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:19 smithi007 bash[22722]: cluster 2024-09-14T04:43:18.172372+0000 mgr.a (mgr.14355) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:19 smithi131 bash[24745]: cluster 2024-09-14T04:43:18.172372+0000 mgr.a (mgr.14355) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:19 smithi171 bash[25040]: cluster 2024-09-14T04:43:18.172372+0000 mgr.a (mgr.14355) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:21 smithi007 bash[22722]: cluster 2024-09-14T04:43:20.173165+0000 mgr.a (mgr.14355) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:21 smithi131 bash[24745]: cluster 2024-09-14T04:43:20.173165+0000 mgr.a (mgr.14355) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:21 smithi171 bash[25040]: cluster 2024-09-14T04:43:20.173165+0000 mgr.a (mgr.14355) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:22.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:22.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:22.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:23.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:23.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:23 smithi007 bash[22722]: cluster 2024-09-14T04:43:22.175334+0000 mgr.a (mgr.14355) 16539 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:23 smithi131 bash[24745]: cluster 2024-09-14T04:43:22.175334+0000 mgr.a (mgr.14355) 16539 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:23 smithi171 bash[25040]: cluster 2024-09-14T04:43:22.175334+0000 mgr.a (mgr.14355) 16539 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:24 smithi007 bash[22722]: audit 2024-09-14T04:43:22.677033+0000 mgr.a (mgr.14355) 16540 : audit [DBG] from='client.356502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:24 smithi131 bash[24745]: audit 2024-09-14T04:43:22.677033+0000 mgr.a (mgr.14355) 16540 : audit [DBG] from='client.356502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:24 smithi171 bash[25040]: audit 2024-09-14T04:43:22.677033+0000 mgr.a (mgr.14355) 16540 : audit [DBG] from='client.356502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:25 smithi007 bash[22722]: cluster 2024-09-14T04:43:24.176239+0000 mgr.a (mgr.14355) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:25 smithi131 bash[24745]: cluster 2024-09-14T04:43:24.176239+0000 mgr.a (mgr.14355) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:25 smithi171 bash[25040]: cluster 2024-09-14T04:43:24.176239+0000 mgr.a (mgr.14355) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:27 smithi007 bash[22722]: cluster 2024-09-14T04:43:26.178471+0000 mgr.a (mgr.14355) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:27 smithi131 bash[24745]: cluster 2024-09-14T04:43:26.178471+0000 mgr.a (mgr.14355) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:27 smithi171 bash[25040]: cluster 2024-09-14T04:43:26.178471+0000 mgr.a (mgr.14355) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:28.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:28.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:29 smithi007 bash[22722]: cluster 2024-09-14T04:43:28.179185+0000 mgr.a (mgr.14355) 16543 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:29 smithi131 bash[24745]: cluster 2024-09-14T04:43:28.179185+0000 mgr.a (mgr.14355) 16543 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:29 smithi171 bash[25040]: cluster 2024-09-14T04:43:28.179185+0000 mgr.a (mgr.14355) 16543 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:30 smithi007 bash[22722]: audit 2024-09-14T04:43:28.449857+0000 mgr.a (mgr.14355) 16544 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:30 smithi131 bash[24745]: audit 2024-09-14T04:43:28.449857+0000 mgr.a (mgr.14355) 16544 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:30 smithi171 bash[25040]: audit 2024-09-14T04:43:28.449857+0000 mgr.a (mgr.14355) 16544 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:31 smithi007 bash[22722]: cluster 2024-09-14T04:43:30.180129+0000 mgr.a (mgr.14355) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:31 smithi131 bash[24745]: cluster 2024-09-14T04:43:30.180129+0000 mgr.a (mgr.14355) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:31 smithi171 bash[25040]: cluster 2024-09-14T04:43:30.180129+0000 mgr.a (mgr.14355) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:33 smithi007 bash[22722]: cluster 2024-09-14T04:43:32.182397+0000 mgr.a (mgr.14355) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:33 smithi131 bash[24745]: cluster 2024-09-14T04:43:32.182397+0000 mgr.a (mgr.14355) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:33 smithi171 bash[25040]: cluster 2024-09-14T04:43:32.182397+0000 mgr.a (mgr.14355) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:33.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:33.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:34.663 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:34.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:34.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:34.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:34.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:35.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:35 smithi007 bash[22722]: cluster 2024-09-14T04:43:34.183133+0000 mgr.a (mgr.14355) 16547 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:35.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:35 smithi007 bash[22722]: audit 2024-09-14T04:43:34.222284+0000 mgr.a (mgr.14355) 16548 : audit [DBG] from='client.356652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:35 smithi131 bash[24745]: cluster 2024-09-14T04:43:34.183133+0000 mgr.a (mgr.14355) 16547 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:35.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:35 smithi131 bash[24745]: audit 2024-09-14T04:43:34.222284+0000 mgr.a (mgr.14355) 16548 : audit [DBG] from='client.356652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:35 smithi171 bash[25040]: cluster 2024-09-14T04:43:34.183133+0000 mgr.a (mgr.14355) 16547 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:35 smithi171 bash[25040]: audit 2024-09-14T04:43:34.222284+0000 mgr.a (mgr.14355) 16548 : audit [DBG] from='client.356652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:37 smithi007 bash[22722]: cluster 2024-09-14T04:43:36.185443+0000 mgr.a (mgr.14355) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:37 smithi131 bash[24745]: cluster 2024-09-14T04:43:36.185443+0000 mgr.a (mgr.14355) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:37 smithi171 bash[25040]: cluster 2024-09-14T04:43:36.185443+0000 mgr.a (mgr.14355) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:43:39.664 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:39.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:39.665 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:39 smithi007 bash[22722]: cluster 2024-09-14T04:43:38.186262+0000 mgr.a (mgr.14355) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:39 smithi131 bash[24745]: cluster 2024-09-14T04:43:38.186262+0000 mgr.a (mgr.14355) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:39 smithi171 bash[25040]: cluster 2024-09-14T04:43:38.186262+0000 mgr.a (mgr.14355) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:40.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:40.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:40.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:40.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:41 smithi007 bash[22722]: audit 2024-09-14T04:43:39.996166+0000 mgr.a (mgr.14355) 16551 : audit [DBG] from='client.356730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:41.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:41 smithi007 bash[22722]: cluster 2024-09-14T04:43:40.186874+0000 mgr.a (mgr.14355) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:41 smithi131 bash[24745]: audit 2024-09-14T04:43:39.996166+0000 mgr.a (mgr.14355) 16551 : audit [DBG] from='client.356730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:41 smithi131 bash[24745]: cluster 2024-09-14T04:43:40.186874+0000 mgr.a (mgr.14355) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:41 smithi171 bash[25040]: audit 2024-09-14T04:43:39.996166+0000 mgr.a (mgr.14355) 16551 : audit [DBG] from='client.356730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:41.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:41 smithi171 bash[25040]: cluster 2024-09-14T04:43:40.186874+0000 mgr.a (mgr.14355) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:43 smithi007 bash[22722]: cluster 2024-09-14T04:43:42.189236+0000 mgr.a (mgr.14355) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:43:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:43 smithi131 bash[24745]: cluster 2024-09-14T04:43:42.189236+0000 mgr.a (mgr.14355) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:43:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:43 smithi171 bash[25040]: cluster 2024-09-14T04:43:42.189236+0000 mgr.a (mgr.14355) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:43:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:45.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:45 smithi007 bash[22722]: cluster 2024-09-14T04:43:44.190034+0000 mgr.a (mgr.14355) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:43:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:45 smithi131 bash[24745]: cluster 2024-09-14T04:43:44.190034+0000 mgr.a (mgr.14355) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:43:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:45 smithi171 bash[25040]: cluster 2024-09-14T04:43:44.190034+0000 mgr.a (mgr.14355) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:43:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:46.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:46.196 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:47 smithi007 bash[22722]: audit 2024-09-14T04:43:45.747374+0000 mgr.a (mgr.14355) 16555 : audit [DBG] from='client.356802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:47 smithi007 bash[22722]: cluster 2024-09-14T04:43:46.191318+0000 mgr.a (mgr.14355) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:47 smithi131 bash[24745]: audit 2024-09-14T04:43:45.747374+0000 mgr.a (mgr.14355) 16555 : audit [DBG] from='client.356802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:47 smithi131 bash[24745]: cluster 2024-09-14T04:43:46.191318+0000 mgr.a (mgr.14355) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:47 smithi171 bash[25040]: audit 2024-09-14T04:43:45.747374+0000 mgr.a (mgr.14355) 16555 : audit [DBG] from='client.356802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:47 smithi171 bash[25040]: cluster 2024-09-14T04:43:46.191318+0000 mgr.a (mgr.14355) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:49 smithi007 bash[22722]: cluster 2024-09-14T04:43:48.192057+0000 mgr.a (mgr.14355) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:49 smithi131 bash[24745]: cluster 2024-09-14T04:43:48.192057+0000 mgr.a (mgr.14355) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:49 smithi171 bash[25040]: cluster 2024-09-14T04:43:48.192057+0000 mgr.a (mgr.14355) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:50 smithi007 bash[22722]: audit 2024-09-14T04:43:50.189289+0000 mon.a (mon.0) 3058 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:43:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:50 smithi131 bash[24745]: audit 2024-09-14T04:43:50.189289+0000 mon.a (mon.0) 3058 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:43:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:50 smithi171 bash[25040]: audit 2024-09-14T04:43:50.189289+0000 mon.a (mon.0) 3058 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:43:51.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:51.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:51.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:51 smithi007 bash[22722]: cluster 2024-09-14T04:43:50.192943+0000 mgr.a (mgr.14355) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:51 smithi007 bash[22722]: audit 2024-09-14T04:43:50.809875+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:51 smithi007 bash[22722]: audit 2024-09-14T04:43:50.813989+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:51 smithi131 bash[24745]: cluster 2024-09-14T04:43:50.192943+0000 mgr.a (mgr.14355) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:51 smithi131 bash[24745]: audit 2024-09-14T04:43:50.809875+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:51 smithi131 bash[24745]: audit 2024-09-14T04:43:50.813989+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:51 smithi171 bash[25040]: cluster 2024-09-14T04:43:50.192943+0000 mgr.a (mgr.14355) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:43:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:51 smithi171 bash[25040]: audit 2024-09-14T04:43:50.809875+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:51 smithi171 bash[25040]: audit 2024-09-14T04:43:50.813989+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:52.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22972]: debug 2024-09-14T04:43:52.164+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:43:52.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22972]: debug 2024-09-14T04:43:52.176+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:43:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22722]: audit 2024-09-14T04:43:51.420102+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:43:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22722]: audit 2024-09-14T04:43:51.420919+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:43:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22722]: audit 2024-09-14T04:43:51.425837+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:52 smithi007 bash[22722]: audit 2024-09-14T04:43:51.427723+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:52.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:52.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:52.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:52.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:52.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:52 smithi131 bash[24745]: audit 2024-09-14T04:43:51.420102+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:43:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:52 smithi131 bash[24745]: audit 2024-09-14T04:43:51.420919+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:43:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:52 smithi131 bash[24745]: audit 2024-09-14T04:43:51.425837+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:52 smithi131 bash[24745]: audit 2024-09-14T04:43:51.427723+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:52 smithi171 bash[25040]: audit 2024-09-14T04:43:51.420102+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:43:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:52 smithi171 bash[25040]: audit 2024-09-14T04:43:51.420919+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:43:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:52 smithi171 bash[25040]: audit 2024-09-14T04:43:51.425837+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:43:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:52 smithi171 bash[25040]: audit 2024-09-14T04:43:51.427723+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:53 smithi007 bash[22722]: audit 2024-09-14T04:43:51.428601+0000 mgr.a (mgr.14355) 16559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:53 smithi007 bash[22722]: audit 2024-09-14T04:43:51.551187+0000 mgr.a (mgr.14355) 16560 : audit [DBG] from='client.356880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:53 smithi007 bash[22722]: audit 2024-09-14T04:43:52.166920+0000 mgr.a (mgr.14355) 16561 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:43:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:53 smithi007 bash[22722]: cephadm 2024-09-14T04:43:52.178628+0000 mgr.a (mgr.14355) 16562 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:43:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:53 smithi007 bash[22722]: cluster 2024-09-14T04:43:52.194818+0000 mgr.a (mgr.14355) 16563 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:53 smithi131 bash[24745]: audit 2024-09-14T04:43:51.428601+0000 mgr.a (mgr.14355) 16559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:53 smithi131 bash[24745]: audit 2024-09-14T04:43:51.551187+0000 mgr.a (mgr.14355) 16560 : audit [DBG] from='client.356880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:53 smithi131 bash[24745]: audit 2024-09-14T04:43:52.166920+0000 mgr.a (mgr.14355) 16561 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:43:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:53 smithi131 bash[24745]: cephadm 2024-09-14T04:43:52.178628+0000 mgr.a (mgr.14355) 16562 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:43:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:53 smithi131 bash[24745]: cluster 2024-09-14T04:43:52.194818+0000 mgr.a (mgr.14355) 16563 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:53 smithi171 bash[25040]: audit 2024-09-14T04:43:51.428601+0000 mgr.a (mgr.14355) 16559 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:43:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:53 smithi171 bash[25040]: audit 2024-09-14T04:43:51.551187+0000 mgr.a (mgr.14355) 16560 : audit [DBG] from='client.356880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:53 smithi171 bash[25040]: audit 2024-09-14T04:43:52.166920+0000 mgr.a (mgr.14355) 16561 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:43:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:53 smithi171 bash[25040]: cephadm 2024-09-14T04:43:52.178628+0000 mgr.a (mgr.14355) 16562 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:43:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:53 smithi171 bash[25040]: cluster 2024-09-14T04:43:52.194818+0000 mgr.a (mgr.14355) 16563 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:43:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:54 smithi007 bash[22722]: cluster 2024-09-14T04:43:54.195672+0000 mgr.a (mgr.14355) 16564 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:43:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:54 smithi131 bash[24745]: cluster 2024-09-14T04:43:54.195672+0000 mgr.a (mgr.14355) 16564 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:43:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:54 smithi171 bash[25040]: cluster 2024-09-14T04:43:54.195672+0000 mgr.a (mgr.14355) 16564 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:43:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:57 smithi131 bash[24745]: cluster 2024-09-14T04:43:56.197799+0000 mgr.a (mgr.14355) 16565 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:57 smithi171 bash[25040]: cluster 2024-09-14T04:43:56.197799+0000 mgr.a (mgr.14355) 16565 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:57.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:43:57.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:43:57.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:43:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:57 smithi007 bash[22722]: cluster 2024-09-14T04:43:56.197799+0000 mgr.a (mgr.14355) 16565 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:58.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:43:58.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:43:58.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:43:58.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:43:58.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:43:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:59 smithi131 bash[24745]: audit 2024-09-14T04:43:57.914670+0000 mgr.a (mgr.14355) 16566 : audit [DBG] from='client.357066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:43:59 smithi131 bash[24745]: cluster 2024-09-14T04:43:58.198439+0000 mgr.a (mgr.14355) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:59 smithi171 bash[25040]: audit 2024-09-14T04:43:57.914670+0000 mgr.a (mgr.14355) 16566 : audit [DBG] from='client.357066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:43:59 smithi171 bash[25040]: cluster 2024-09-14T04:43:58.198439+0000 mgr.a (mgr.14355) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:43:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:59 smithi007 bash[22722]: audit 2024-09-14T04:43:57.914670+0000 mgr.a (mgr.14355) 16566 : audit [DBG] from='client.357066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:43:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:43:59 smithi007 bash[22722]: cluster 2024-09-14T04:43:58.198439+0000 mgr.a (mgr.14355) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:01 smithi131 bash[24745]: cluster 2024-09-14T04:44:00.199333+0000 mgr.a (mgr.14355) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:01 smithi171 bash[25040]: cluster 2024-09-14T04:44:00.199333+0000 mgr.a (mgr.14355) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:01 smithi007 bash[22722]: cluster 2024-09-14T04:44:00.199333+0000 mgr.a (mgr.14355) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:03.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:03 smithi131 bash[24745]: cluster 2024-09-14T04:44:02.201696+0000 mgr.a (mgr.14355) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:03 smithi171 bash[25040]: cluster 2024-09-14T04:44:02.201696+0000 mgr.a (mgr.14355) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:03 smithi007 bash[22722]: cluster 2024-09-14T04:44:02.201696+0000 mgr.a (mgr.14355) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:04.085 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:04.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:05 smithi131 bash[24745]: audit 2024-09-14T04:44:03.672948+0000 mgr.a (mgr.14355) 16570 : audit [DBG] from='client.357144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:05 smithi131 bash[24745]: cluster 2024-09-14T04:44:04.202694+0000 mgr.a (mgr.14355) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:05 smithi171 bash[25040]: audit 2024-09-14T04:44:03.672948+0000 mgr.a (mgr.14355) 16570 : audit [DBG] from='client.357144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:05.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:05 smithi171 bash[25040]: cluster 2024-09-14T04:44:04.202694+0000 mgr.a (mgr.14355) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:05 smithi007 bash[22722]: audit 2024-09-14T04:44:03.672948+0000 mgr.a (mgr.14355) 16570 : audit [DBG] from='client.357144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:05 smithi007 bash[22722]: cluster 2024-09-14T04:44:04.202694+0000 mgr.a (mgr.14355) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:07 smithi131 bash[24745]: cluster 2024-09-14T04:44:06.204910+0000 mgr.a (mgr.14355) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:07 smithi171 bash[25040]: cluster 2024-09-14T04:44:06.204910+0000 mgr.a (mgr.14355) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:07 smithi007 bash[22722]: cluster 2024-09-14T04:44:06.204910+0000 mgr.a (mgr.14355) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:09.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:09.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:09 smithi131 bash[24745]: cluster 2024-09-14T04:44:08.205684+0000 mgr.a (mgr.14355) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:09 smithi171 bash[25040]: cluster 2024-09-14T04:44:08.205684+0000 mgr.a (mgr.14355) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:09 smithi007 bash[22722]: cluster 2024-09-14T04:44:08.205684+0000 mgr.a (mgr.14355) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:09.850 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:09.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:09.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:11 smithi171 bash[25040]: audit 2024-09-14T04:44:09.419325+0000 mgr.a (mgr.14355) 16574 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:11.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:11 smithi171 bash[25040]: cluster 2024-09-14T04:44:10.206816+0000 mgr.a (mgr.14355) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:11 smithi007 bash[22722]: audit 2024-09-14T04:44:09.419325+0000 mgr.a (mgr.14355) 16574 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:11 smithi007 bash[22722]: cluster 2024-09-14T04:44:10.206816+0000 mgr.a (mgr.14355) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:11 smithi131 bash[24745]: audit 2024-09-14T04:44:09.419325+0000 mgr.a (mgr.14355) 16574 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:11 smithi131 bash[24745]: cluster 2024-09-14T04:44:10.206816+0000 mgr.a (mgr.14355) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:13 smithi171 bash[25040]: cluster 2024-09-14T04:44:12.209104+0000 mgr.a (mgr.14355) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:13 smithi007 bash[22722]: cluster 2024-09-14T04:44:12.209104+0000 mgr.a (mgr.14355) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:13 smithi131 bash[24745]: cluster 2024-09-14T04:44:12.209104+0000 mgr.a (mgr.14355) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:14.852 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:14.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:14.853 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:15.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:15 smithi171 bash[25040]: cluster 2024-09-14T04:44:14.209875+0000 mgr.a (mgr.14355) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:15.593 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:15.593 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:15 smithi007 bash[22722]: cluster 2024-09-14T04:44:14.209875+0000 mgr.a (mgr.14355) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:15 smithi131 bash[24745]: cluster 2024-09-14T04:44:14.209875+0000 mgr.a (mgr.14355) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:16 smithi171 bash[25040]: audit 2024-09-14T04:44:15.179534+0000 mgr.a (mgr.14355) 16578 : audit [DBG] from='client.357294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:16 smithi007 bash[22722]: audit 2024-09-14T04:44:15.179534+0000 mgr.a (mgr.14355) 16578 : audit [DBG] from='client.357294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:16 smithi131 bash[24745]: audit 2024-09-14T04:44:15.179534+0000 mgr.a (mgr.14355) 16578 : audit [DBG] from='client.357294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:17 smithi007 bash[22722]: cluster 2024-09-14T04:44:16.212248+0000 mgr.a (mgr.14355) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:44:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:17 smithi131 bash[24745]: cluster 2024-09-14T04:44:16.212248+0000 mgr.a (mgr.14355) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:44:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:17 smithi171 bash[25040]: cluster 2024-09-14T04:44:16.212248+0000 mgr.a (mgr.14355) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:44:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:19 smithi007 bash[22722]: cluster 2024-09-14T04:44:18.212993+0000 mgr.a (mgr.14355) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:19 smithi131 bash[24745]: cluster 2024-09-14T04:44:18.212993+0000 mgr.a (mgr.14355) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:19 smithi171 bash[25040]: cluster 2024-09-14T04:44:18.212993+0000 mgr.a (mgr.14355) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:20.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:20.595 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:21.384 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:21.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:21.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:21 smithi007 bash[22722]: cluster 2024-09-14T04:44:20.213727+0000 mgr.a (mgr.14355) 16581 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:21 smithi131 bash[24745]: cluster 2024-09-14T04:44:20.213727+0000 mgr.a (mgr.14355) 16581 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:21 smithi171 bash[25040]: cluster 2024-09-14T04:44:20.213727+0000 mgr.a (mgr.14355) 16581 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:44:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:22 smithi007 bash[22722]: audit 2024-09-14T04:44:20.933398+0000 mgr.a (mgr.14355) 16582 : audit [DBG] from='client.357372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:22 smithi131 bash[24745]: audit 2024-09-14T04:44:20.933398+0000 mgr.a (mgr.14355) 16582 : audit [DBG] from='client.357372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:22 smithi171 bash[25040]: audit 2024-09-14T04:44:20.933398+0000 mgr.a (mgr.14355) 16582 : audit [DBG] from='client.357372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:23 smithi007 bash[22722]: cluster 2024-09-14T04:44:22.216397+0000 mgr.a (mgr.14355) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:23 smithi131 bash[24745]: cluster 2024-09-14T04:44:22.216397+0000 mgr.a (mgr.14355) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:23 smithi171 bash[25040]: cluster 2024-09-14T04:44:22.216397+0000 mgr.a (mgr.14355) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:25 smithi007 bash[22722]: cluster 2024-09-14T04:44:24.217194+0000 mgr.a (mgr.14355) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:44:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:25 smithi131 bash[24745]: cluster 2024-09-14T04:44:24.217194+0000 mgr.a (mgr.14355) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:44:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:25 smithi171 bash[25040]: cluster 2024-09-14T04:44:24.217194+0000 mgr.a (mgr.14355) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:44:26.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:26.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:26.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:27.162 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:27 smithi007 bash[22722]: cluster 2024-09-14T04:44:26.219280+0000 mgr.a (mgr.14355) 16585 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:27 smithi131 bash[24745]: cluster 2024-09-14T04:44:26.219280+0000 mgr.a (mgr.14355) 16585 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:27 smithi171 bash[25040]: cluster 2024-09-14T04:44:26.219280+0000 mgr.a (mgr.14355) 16585 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:28 smithi007 bash[22722]: audit 2024-09-14T04:44:26.719986+0000 mgr.a (mgr.14355) 16586 : audit [DBG] from='client.357447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:28 smithi131 bash[24745]: audit 2024-09-14T04:44:26.719986+0000 mgr.a (mgr.14355) 16586 : audit [DBG] from='client.357447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:28 smithi171 bash[25040]: audit 2024-09-14T04:44:26.719986+0000 mgr.a (mgr.14355) 16586 : audit [DBG] from='client.357447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:29 smithi007 bash[22722]: cluster 2024-09-14T04:44:28.220183+0000 mgr.a (mgr.14355) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:29 smithi131 bash[24745]: cluster 2024-09-14T04:44:28.220183+0000 mgr.a (mgr.14355) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:29 smithi171 bash[25040]: cluster 2024-09-14T04:44:28.220183+0000 mgr.a (mgr.14355) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:31 smithi007 bash[22722]: cluster 2024-09-14T04:44:30.221075+0000 mgr.a (mgr.14355) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:31 smithi131 bash[24745]: cluster 2024-09-14T04:44:30.221075+0000 mgr.a (mgr.14355) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:31 smithi171 bash[25040]: cluster 2024-09-14T04:44:30.221075+0000 mgr.a (mgr.14355) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:44:32.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:32.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:32.931 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:32.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:33 smithi007 bash[22722]: cluster 2024-09-14T04:44:32.222572+0000 mgr.a (mgr.14355) 16589 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:44:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:33 smithi131 bash[24745]: cluster 2024-09-14T04:44:32.222572+0000 mgr.a (mgr.14355) 16589 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:44:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:33 smithi171 bash[25040]: cluster 2024-09-14T04:44:32.222572+0000 mgr.a (mgr.14355) 16589 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:44:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:34 smithi007 bash[22722]: audit 2024-09-14T04:44:32.498331+0000 mgr.a (mgr.14355) 16590 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:34 smithi131 bash[24745]: audit 2024-09-14T04:44:32.498331+0000 mgr.a (mgr.14355) 16590 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:34 smithi171 bash[25040]: audit 2024-09-14T04:44:32.498331+0000 mgr.a (mgr.14355) 16590 : audit [DBG] from='client.357522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:35 smithi007 bash[22722]: cluster 2024-09-14T04:44:34.223580+0000 mgr.a (mgr.14355) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:35 smithi131 bash[24745]: cluster 2024-09-14T04:44:34.223580+0000 mgr.a (mgr.14355) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:35 smithi171 bash[25040]: cluster 2024-09-14T04:44:34.223580+0000 mgr.a (mgr.14355) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:37 smithi007 bash[22722]: cluster 2024-09-14T04:44:36.225875+0000 mgr.a (mgr.14355) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:37 smithi131 bash[24745]: cluster 2024-09-14T04:44:36.225875+0000 mgr.a (mgr.14355) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:37 smithi171 bash[25040]: cluster 2024-09-14T04:44:36.225875+0000 mgr.a (mgr.14355) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:37.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:37.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:37.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:38.699 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:38.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:38.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:38.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:38.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:39 smithi007 bash[22722]: cluster 2024-09-14T04:44:38.226812+0000 mgr.a (mgr.14355) 16593 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:39 smithi007 bash[22722]: audit 2024-09-14T04:44:38.271013+0000 mgr.a (mgr.14355) 16594 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:39 smithi131 bash[24745]: cluster 2024-09-14T04:44:38.226812+0000 mgr.a (mgr.14355) 16593 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:39 smithi131 bash[24745]: audit 2024-09-14T04:44:38.271013+0000 mgr.a (mgr.14355) 16594 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:39 smithi171 bash[25040]: cluster 2024-09-14T04:44:38.226812+0000 mgr.a (mgr.14355) 16593 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:39 smithi171 bash[25040]: audit 2024-09-14T04:44:38.271013+0000 mgr.a (mgr.14355) 16594 : audit [DBG] from='client.357600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:41 smithi007 bash[22722]: cluster 2024-09-14T04:44:40.227701+0000 mgr.a (mgr.14355) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:41 smithi131 bash[24745]: cluster 2024-09-14T04:44:40.227701+0000 mgr.a (mgr.14355) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:41 smithi171 bash[25040]: cluster 2024-09-14T04:44:40.227701+0000 mgr.a (mgr.14355) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:43.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:43.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:43.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:43 smithi007 bash[22722]: cluster 2024-09-14T04:44:42.229935+0000 mgr.a (mgr.14355) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:43 smithi131 bash[24745]: cluster 2024-09-14T04:44:42.229935+0000 mgr.a (mgr.14355) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:43 smithi171 bash[25040]: cluster 2024-09-14T04:44:42.229935+0000 mgr.a (mgr.14355) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:44.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:44.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:45 smithi007 bash[22722]: audit 2024-09-14T04:44:44.033958+0000 mgr.a (mgr.14355) 16597 : audit [DBG] from='client.357672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:45.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:45 smithi007 bash[22722]: cluster 2024-09-14T04:44:44.230512+0000 mgr.a (mgr.14355) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:45 smithi131 bash[24745]: audit 2024-09-14T04:44:44.033958+0000 mgr.a (mgr.14355) 16597 : audit [DBG] from='client.357672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:45 smithi131 bash[24745]: cluster 2024-09-14T04:44:44.230512+0000 mgr.a (mgr.14355) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:45 smithi171 bash[25040]: audit 2024-09-14T04:44:44.033958+0000 mgr.a (mgr.14355) 16597 : audit [DBG] from='client.357672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:45.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:45 smithi171 bash[25040]: cluster 2024-09-14T04:44:44.230512+0000 mgr.a (mgr.14355) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:47 smithi007 bash[22722]: cluster 2024-09-14T04:44:46.232783+0000 mgr.a (mgr.14355) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:47 smithi131 bash[24745]: cluster 2024-09-14T04:44:46.232783+0000 mgr.a (mgr.14355) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:47 smithi171 bash[25040]: cluster 2024-09-14T04:44:46.232783+0000 mgr.a (mgr.14355) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:49 smithi007 bash[22722]: cluster 2024-09-14T04:44:48.233541+0000 mgr.a (mgr.14355) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:49 smithi131 bash[24745]: cluster 2024-09-14T04:44:48.233541+0000 mgr.a (mgr.14355) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:49 smithi171 bash[25040]: cluster 2024-09-14T04:44:48.233541+0000 mgr.a (mgr.14355) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:50.222 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:50.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:51 smithi007 bash[22722]: audit 2024-09-14T04:44:49.790913+0000 mgr.a (mgr.14355) 16601 : audit [DBG] from='client.357747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:51 smithi007 bash[22722]: cluster 2024-09-14T04:44:50.234266+0000 mgr.a (mgr.14355) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:51 smithi131 bash[24745]: audit 2024-09-14T04:44:49.790913+0000 mgr.a (mgr.14355) 16601 : audit [DBG] from='client.357747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:51 smithi131 bash[24745]: cluster 2024-09-14T04:44:50.234266+0000 mgr.a (mgr.14355) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:51 smithi171 bash[25040]: audit 2024-09-14T04:44:49.790913+0000 mgr.a (mgr.14355) 16601 : audit [DBG] from='client.357747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:51 smithi171 bash[25040]: cluster 2024-09-14T04:44:50.234266+0000 mgr.a (mgr.14355) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:52 smithi007 bash[22722]: audit 2024-09-14T04:44:52.239087+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:44:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:52 smithi131 bash[24745]: audit 2024-09-14T04:44:52.239087+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:44:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:52 smithi171 bash[25040]: audit 2024-09-14T04:44:52.239087+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:44:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:53 smithi007 bash[22722]: cluster 2024-09-14T04:44:52.236704+0000 mgr.a (mgr.14355) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:53 smithi007 bash[22722]: audit 2024-09-14T04:44:52.864177+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:53 smithi007 bash[22722]: audit 2024-09-14T04:44:52.870267+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:53 smithi007 bash[22722]: audit 2024-09-14T04:44:52.876013+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:53 smithi007 bash[22722]: audit 2024-09-14T04:44:52.881722+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:53 smithi131 bash[24745]: cluster 2024-09-14T04:44:52.236704+0000 mgr.a (mgr.14355) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:53 smithi131 bash[24745]: audit 2024-09-14T04:44:52.864177+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:53 smithi131 bash[24745]: audit 2024-09-14T04:44:52.870267+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:53 smithi131 bash[24745]: audit 2024-09-14T04:44:52.876013+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:53 smithi131 bash[24745]: audit 2024-09-14T04:44:52.881722+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:53 smithi171 bash[25040]: cluster 2024-09-14T04:44:52.236704+0000 mgr.a (mgr.14355) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:53 smithi171 bash[25040]: audit 2024-09-14T04:44:52.864177+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:53 smithi171 bash[25040]: audit 2024-09-14T04:44:52.870267+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:53 smithi171 bash[25040]: audit 2024-09-14T04:44:52.876013+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:53 smithi171 bash[25040]: audit 2024-09-14T04:44:52.881722+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22972]: debug 2024-09-14T04:44:54.471+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22972]: debug 2024-09-14T04:44:54.471+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22722]: audit 2024-09-14T04:44:53.689348+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22722]: audit 2024-09-14T04:44:53.691148+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22722]: audit 2024-09-14T04:44:53.701854+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:54 smithi007 bash[22722]: audit 2024-09-14T04:44:53.705436+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:54 smithi131 bash[24745]: audit 2024-09-14T04:44:53.689348+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:44:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:54 smithi131 bash[24745]: audit 2024-09-14T04:44:53.691148+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:44:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:54 smithi131 bash[24745]: audit 2024-09-14T04:44:53.701854+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:54 smithi131 bash[24745]: audit 2024-09-14T04:44:53.705436+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:54 smithi171 bash[25040]: audit 2024-09-14T04:44:53.689348+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:44:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:54 smithi171 bash[25040]: audit 2024-09-14T04:44:53.691148+0000 mon.a (mon.0) 3071 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:44:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:54 smithi171 bash[25040]: audit 2024-09-14T04:44:53.701854+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:44:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:54 smithi171 bash[25040]: audit 2024-09-14T04:44:53.705436+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:55.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:44:55.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:44:55.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:44:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:55 smithi007 bash[22722]: audit 2024-09-14T04:44:53.707652+0000 mgr.a (mgr.14355) 16604 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:55 smithi007 bash[22722]: cluster 2024-09-14T04:44:54.237541+0000 mgr.a (mgr.14355) 16605 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:55 smithi131 bash[24745]: audit 2024-09-14T04:44:53.707652+0000 mgr.a (mgr.14355) 16604 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:55 smithi131 bash[24745]: cluster 2024-09-14T04:44:54.237541+0000 mgr.a (mgr.14355) 16605 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:55 smithi171 bash[25040]: audit 2024-09-14T04:44:53.707652+0000 mgr.a (mgr.14355) 16604 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:44:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:55 smithi171 bash[25040]: cluster 2024-09-14T04:44:54.237541+0000 mgr.a (mgr.14355) 16605 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:44:55.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:44:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:44:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:44:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:44:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:44:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:56 smithi007 bash[22722]: audit 2024-09-14T04:44:54.474811+0000 mgr.a (mgr.14355) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:44:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:56 smithi007 bash[22722]: cephadm 2024-09-14T04:44:54.476608+0000 mgr.a (mgr.14355) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:44:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:56 smithi131 bash[24745]: audit 2024-09-14T04:44:54.474811+0000 mgr.a (mgr.14355) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:44:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:56 smithi131 bash[24745]: cephadm 2024-09-14T04:44:54.476608+0000 mgr.a (mgr.14355) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:44:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:56 smithi171 bash[25040]: audit 2024-09-14T04:44:54.474811+0000 mgr.a (mgr.14355) 16606 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:44:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:56 smithi171 bash[25040]: cephadm 2024-09-14T04:44:54.476608+0000 mgr.a (mgr.14355) 16607 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:44:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:57 smithi007 bash[22722]: audit 2024-09-14T04:44:55.558548+0000 mgr.a (mgr.14355) 16608 : audit [DBG] from='client.357933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:57 smithi007 bash[22722]: cluster 2024-09-14T04:44:56.240379+0000 mgr.a (mgr.14355) 16609 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:57 smithi131 bash[24745]: audit 2024-09-14T04:44:55.558548+0000 mgr.a (mgr.14355) 16608 : audit [DBG] from='client.357933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:57 smithi131 bash[24745]: cluster 2024-09-14T04:44:56.240379+0000 mgr.a (mgr.14355) 16609 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:57 smithi171 bash[25040]: audit 2024-09-14T04:44:55.558548+0000 mgr.a (mgr.14355) 16608 : audit [DBG] from='client.357933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:44:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:57 smithi171 bash[25040]: cluster 2024-09-14T04:44:56.240379+0000 mgr.a (mgr.14355) 16609 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:44:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:44:58 smithi007 bash[22722]: cluster 2024-09-14T04:44:58.241156+0000 mgr.a (mgr.14355) 16610 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:44:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:44:58 smithi131 bash[24745]: cluster 2024-09-14T04:44:58.241156+0000 mgr.a (mgr.14355) 16610 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:44:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:44:58 smithi171 bash[25040]: cluster 2024-09-14T04:44:58.241156+0000 mgr.a (mgr.14355) 16610 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:00.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:01 smithi007 bash[22722]: cluster 2024-09-14T04:45:00.241964+0000 mgr.a (mgr.14355) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:01.607 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:01 smithi171 bash[25040]: cluster 2024-09-14T04:45:00.241964+0000 mgr.a (mgr.14355) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:01.656 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:01 smithi131 bash[24745]: cluster 2024-09-14T04:45:00.241964+0000 mgr.a (mgr.14355) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:01.733 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:02 smithi007 bash[22722]: audit 2024-09-14T04:45:01.311453+0000 mgr.a (mgr.14355) 16612 : audit [DBG] from='client.358008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:02 smithi131 bash[24745]: audit 2024-09-14T04:45:01.311453+0000 mgr.a (mgr.14355) 16612 : audit [DBG] from='client.358008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:02 smithi171 bash[25040]: audit 2024-09-14T04:45:01.311453+0000 mgr.a (mgr.14355) 16612 : audit [DBG] from='client.358008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:03 smithi007 bash[22722]: cluster 2024-09-14T04:45:02.244722+0000 mgr.a (mgr.14355) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:03 smithi131 bash[24745]: cluster 2024-09-14T04:45:02.244722+0000 mgr.a (mgr.14355) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:03 smithi171 bash[25040]: cluster 2024-09-14T04:45:02.244722+0000 mgr.a (mgr.14355) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:05 smithi007 bash[22722]: cluster 2024-09-14T04:45:04.245492+0000 mgr.a (mgr.14355) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:05 smithi131 bash[24745]: cluster 2024-09-14T04:45:04.245492+0000 mgr.a (mgr.14355) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:05 smithi171 bash[25040]: cluster 2024-09-14T04:45:04.245492+0000 mgr.a (mgr.14355) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:45:06.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:06.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:06.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:07.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:07.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:07 smithi007 bash[22722]: cluster 2024-09-14T04:45:06.247466+0000 mgr.a (mgr.14355) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:07 smithi131 bash[24745]: cluster 2024-09-14T04:45:06.247466+0000 mgr.a (mgr.14355) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:07 smithi171 bash[25040]: cluster 2024-09-14T04:45:06.247466+0000 mgr.a (mgr.14355) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:45:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:08 smithi007 bash[22722]: audit 2024-09-14T04:45:07.067276+0000 mgr.a (mgr.14355) 16616 : audit [DBG] from='client.358086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:08 smithi131 bash[24745]: audit 2024-09-14T04:45:07.067276+0000 mgr.a (mgr.14355) 16616 : audit [DBG] from='client.358086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:08 smithi171 bash[25040]: audit 2024-09-14T04:45:07.067276+0000 mgr.a (mgr.14355) 16616 : audit [DBG] from='client.358086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:09 smithi007 bash[22722]: cluster 2024-09-14T04:45:08.248344+0000 mgr.a (mgr.14355) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:09 smithi131 bash[24745]: cluster 2024-09-14T04:45:08.248344+0000 mgr.a (mgr.14355) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:09 smithi171 bash[25040]: cluster 2024-09-14T04:45:08.248344+0000 mgr.a (mgr.14355) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:11 smithi007 bash[22722]: cluster 2024-09-14T04:45:10.249159+0000 mgr.a (mgr.14355) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:11 smithi131 bash[24745]: cluster 2024-09-14T04:45:10.249159+0000 mgr.a (mgr.14355) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:11 smithi171 bash[25040]: cluster 2024-09-14T04:45:10.249159+0000 mgr.a (mgr.14355) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:12.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:12.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:13.252 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:13.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:13 smithi007 bash[22722]: cluster 2024-09-14T04:45:12.251421+0000 mgr.a (mgr.14355) 16619 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:13 smithi131 bash[24745]: cluster 2024-09-14T04:45:12.251421+0000 mgr.a (mgr.14355) 16619 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:13 smithi171 bash[25040]: cluster 2024-09-14T04:45:12.251421+0000 mgr.a (mgr.14355) 16619 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:14 smithi007 bash[22722]: audit 2024-09-14T04:45:12.833065+0000 mgr.a (mgr.14355) 16620 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:14 smithi131 bash[24745]: audit 2024-09-14T04:45:12.833065+0000 mgr.a (mgr.14355) 16620 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:14 smithi171 bash[25040]: audit 2024-09-14T04:45:12.833065+0000 mgr.a (mgr.14355) 16620 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:15 smithi007 bash[22722]: cluster 2024-09-14T04:45:14.252347+0000 mgr.a (mgr.14355) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:15 smithi131 bash[24745]: cluster 2024-09-14T04:45:14.252347+0000 mgr.a (mgr.14355) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:15 smithi171 bash[25040]: cluster 2024-09-14T04:45:14.252347+0000 mgr.a (mgr.14355) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:17 smithi007 bash[22722]: cluster 2024-09-14T04:45:16.254598+0000 mgr.a (mgr.14355) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:17 smithi131 bash[24745]: cluster 2024-09-14T04:45:16.254598+0000 mgr.a (mgr.14355) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:17 smithi171 bash[25040]: cluster 2024-09-14T04:45:16.254598+0000 mgr.a (mgr.14355) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:18.254 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:18.255 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:19.033 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:19.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:19 smithi007 bash[22722]: cluster 2024-09-14T04:45:18.255227+0000 mgr.a (mgr.14355) 16623 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:19 smithi131 bash[24745]: cluster 2024-09-14T04:45:18.255227+0000 mgr.a (mgr.14355) 16623 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:19 smithi171 bash[25040]: cluster 2024-09-14T04:45:18.255227+0000 mgr.a (mgr.14355) 16623 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:20 smithi007 bash[22722]: audit 2024-09-14T04:45:18.591642+0000 mgr.a (mgr.14355) 16624 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:20 smithi131 bash[24745]: audit 2024-09-14T04:45:18.591642+0000 mgr.a (mgr.14355) 16624 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:20 smithi171 bash[25040]: audit 2024-09-14T04:45:18.591642+0000 mgr.a (mgr.14355) 16624 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:21 smithi007 bash[22722]: cluster 2024-09-14T04:45:20.256095+0000 mgr.a (mgr.14355) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:21 smithi131 bash[24745]: cluster 2024-09-14T04:45:20.256095+0000 mgr.a (mgr.14355) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:21 smithi171 bash[25040]: cluster 2024-09-14T04:45:20.256095+0000 mgr.a (mgr.14355) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:23 smithi007 bash[22722]: cluster 2024-09-14T04:45:22.258484+0000 mgr.a (mgr.14355) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:23 smithi131 bash[24745]: cluster 2024-09-14T04:45:22.258484+0000 mgr.a (mgr.14355) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:23 smithi171 bash[25040]: cluster 2024-09-14T04:45:22.258484+0000 mgr.a (mgr.14355) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:24.034 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:24.035 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:24.035 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:24.788 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:25 smithi007 bash[22722]: cluster 2024-09-14T04:45:24.259400+0000 mgr.a (mgr.14355) 16627 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:25 smithi007 bash[22722]: audit 2024-09-14T04:45:24.362544+0000 mgr.a (mgr.14355) 16628 : audit [DBG] from='client.358314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:25 smithi131 bash[24745]: cluster 2024-09-14T04:45:24.259400+0000 mgr.a (mgr.14355) 16627 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:25 smithi131 bash[24745]: audit 2024-09-14T04:45:24.362544+0000 mgr.a (mgr.14355) 16628 : audit [DBG] from='client.358314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:25 smithi171 bash[25040]: cluster 2024-09-14T04:45:24.259400+0000 mgr.a (mgr.14355) 16627 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:25 smithi171 bash[25040]: audit 2024-09-14T04:45:24.362544+0000 mgr.a (mgr.14355) 16628 : audit [DBG] from='client.358314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:27 smithi007 bash[22722]: cluster 2024-09-14T04:45:26.261800+0000 mgr.a (mgr.14355) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:27 smithi131 bash[24745]: cluster 2024-09-14T04:45:26.261800+0000 mgr.a (mgr.14355) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:27 smithi171 bash[25040]: cluster 2024-09-14T04:45:26.261800+0000 mgr.a (mgr.14355) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:29 smithi007 bash[22722]: cluster 2024-09-14T04:45:28.262645+0000 mgr.a (mgr.14355) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:29 smithi131 bash[24745]: cluster 2024-09-14T04:45:28.262645+0000 mgr.a (mgr.14355) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:29.789 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:29.790 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:29 smithi171 bash[25040]: cluster 2024-09-14T04:45:28.262645+0000 mgr.a (mgr.14355) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:30.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:30.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:30.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:30.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:30.561 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:31 smithi007 bash[22722]: audit 2024-09-14T04:45:30.123387+0000 mgr.a (mgr.14355) 16631 : audit [DBG] from='client.358392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:31.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:31 smithi007 bash[22722]: cluster 2024-09-14T04:45:30.264656+0000 mgr.a (mgr.14355) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:31 smithi131 bash[24745]: audit 2024-09-14T04:45:30.123387+0000 mgr.a (mgr.14355) 16631 : audit [DBG] from='client.358392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:31 smithi131 bash[24745]: cluster 2024-09-14T04:45:30.264656+0000 mgr.a (mgr.14355) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:31 smithi171 bash[25040]: audit 2024-09-14T04:45:30.123387+0000 mgr.a (mgr.14355) 16631 : audit [DBG] from='client.358392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:31 smithi171 bash[25040]: cluster 2024-09-14T04:45:30.264656+0000 mgr.a (mgr.14355) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:33 smithi007 bash[22722]: cluster 2024-09-14T04:45:32.267155+0000 mgr.a (mgr.14355) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:45:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:33 smithi131 bash[24745]: cluster 2024-09-14T04:45:32.267155+0000 mgr.a (mgr.14355) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:45:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:33 smithi171 bash[25040]: cluster 2024-09-14T04:45:32.267155+0000 mgr.a (mgr.14355) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:45:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:35.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:35 smithi007 bash[22722]: cluster 2024-09-14T04:45:34.267995+0000 mgr.a (mgr.14355) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:45:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:35 smithi131 bash[24745]: cluster 2024-09-14T04:45:34.267995+0000 mgr.a (mgr.14355) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:45:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:35 smithi171 bash[25040]: cluster 2024-09-14T04:45:34.267995+0000 mgr.a (mgr.14355) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:45:36.346 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:36.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:37 smithi007 bash[22722]: audit 2024-09-14T04:45:35.897319+0000 mgr.a (mgr.14355) 16635 : audit [DBG] from='client.358470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:37 smithi007 bash[22722]: cluster 2024-09-14T04:45:36.269369+0000 mgr.a (mgr.14355) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:37 smithi131 bash[24745]: audit 2024-09-14T04:45:35.897319+0000 mgr.a (mgr.14355) 16635 : audit [DBG] from='client.358470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:37 smithi131 bash[24745]: cluster 2024-09-14T04:45:36.269369+0000 mgr.a (mgr.14355) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:37 smithi171 bash[25040]: audit 2024-09-14T04:45:35.897319+0000 mgr.a (mgr.14355) 16635 : audit [DBG] from='client.358470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:37 smithi171 bash[25040]: cluster 2024-09-14T04:45:36.269369+0000 mgr.a (mgr.14355) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:39 smithi007 bash[22722]: cluster 2024-09-14T04:45:38.270099+0000 mgr.a (mgr.14355) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:45:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:39 smithi131 bash[24745]: cluster 2024-09-14T04:45:38.270099+0000 mgr.a (mgr.14355) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:45:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:39 smithi171 bash[25040]: cluster 2024-09-14T04:45:38.270099+0000 mgr.a (mgr.14355) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:45:41.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:41.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:41 smithi007 bash[22722]: cluster 2024-09-14T04:45:40.271015+0000 mgr.a (mgr.14355) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:45:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:41 smithi131 bash[24745]: cluster 2024-09-14T04:45:40.271015+0000 mgr.a (mgr.14355) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:45:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:41 smithi171 bash[25040]: cluster 2024-09-14T04:45:40.271015+0000 mgr.a (mgr.14355) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:45:42.128 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:42.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:43 smithi007 bash[22722]: audit 2024-09-14T04:45:41.679738+0000 mgr.a (mgr.14355) 16639 : audit [DBG] from='client.358548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:43 smithi007 bash[22722]: cluster 2024-09-14T04:45:42.273922+0000 mgr.a (mgr.14355) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:43 smithi131 bash[24745]: audit 2024-09-14T04:45:41.679738+0000 mgr.a (mgr.14355) 16639 : audit [DBG] from='client.358548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:43 smithi131 bash[24745]: cluster 2024-09-14T04:45:42.273922+0000 mgr.a (mgr.14355) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:43 smithi171 bash[25040]: audit 2024-09-14T04:45:41.679738+0000 mgr.a (mgr.14355) 16639 : audit [DBG] from='client.358548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:43 smithi171 bash[25040]: cluster 2024-09-14T04:45:42.273922+0000 mgr.a (mgr.14355) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:45 smithi007 bash[22722]: cluster 2024-09-14T04:45:44.274760+0000 mgr.a (mgr.14355) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:45:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:45 smithi131 bash[24745]: cluster 2024-09-14T04:45:44.274760+0000 mgr.a (mgr.14355) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:45:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:45 smithi171 bash[25040]: cluster 2024-09-14T04:45:44.274760+0000 mgr.a (mgr.14355) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:45:47.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:47.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:47 smithi007 bash[22722]: cluster 2024-09-14T04:45:46.276742+0000 mgr.a (mgr.14355) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:45:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:47 smithi131 bash[24745]: cluster 2024-09-14T04:45:46.276742+0000 mgr.a (mgr.14355) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:45:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:47 smithi171 bash[25040]: cluster 2024-09-14T04:45:46.276742+0000 mgr.a (mgr.14355) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:45:47.902 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:49 smithi007 bash[22722]: audit 2024-09-14T04:45:47.460516+0000 mgr.a (mgr.14355) 16643 : audit [DBG] from='client.358626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:49.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:49 smithi007 bash[22722]: cluster 2024-09-14T04:45:48.277678+0000 mgr.a (mgr.14355) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:49 smithi131 bash[24745]: audit 2024-09-14T04:45:47.460516+0000 mgr.a (mgr.14355) 16643 : audit [DBG] from='client.358626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:49 smithi131 bash[24745]: cluster 2024-09-14T04:45:48.277678+0000 mgr.a (mgr.14355) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:49 smithi171 bash[25040]: audit 2024-09-14T04:45:47.460516+0000 mgr.a (mgr.14355) 16643 : audit [DBG] from='client.358626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:49 smithi171 bash[25040]: cluster 2024-09-14T04:45:48.277678+0000 mgr.a (mgr.14355) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:50 smithi007 bash[22722]: cluster 2024-09-14T04:45:50.278514+0000 mgr.a (mgr.14355) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:50 smithi131 bash[24745]: cluster 2024-09-14T04:45:50.278514+0000 mgr.a (mgr.14355) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:50 smithi171 bash[25040]: cluster 2024-09-14T04:45:50.278514+0000 mgr.a (mgr.14355) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:52.903 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:52.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:52.904 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:53.676 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:53.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:53 smithi007 bash[22722]: cluster 2024-09-14T04:45:52.280780+0000 mgr.a (mgr.14355) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:53 smithi131 bash[24745]: cluster 2024-09-14T04:45:52.280780+0000 mgr.a (mgr.14355) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:53 smithi171 bash[25040]: cluster 2024-09-14T04:45:52.280780+0000 mgr.a (mgr.14355) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:45:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:54 smithi007 bash[22722]: audit 2024-09-14T04:45:53.239749+0000 mgr.a (mgr.14355) 16647 : audit [DBG] from='client.358704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:54 smithi131 bash[24745]: audit 2024-09-14T04:45:53.239749+0000 mgr.a (mgr.14355) 16647 : audit [DBG] from='client.358704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:54 smithi171 bash[25040]: audit 2024-09-14T04:45:53.239749+0000 mgr.a (mgr.14355) 16647 : audit [DBG] from='client.358704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:45:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:55 smithi007 bash[22722]: cluster 2024-09-14T04:45:54.281796+0000 mgr.a (mgr.14355) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:55 smithi007 bash[22722]: audit 2024-09-14T04:45:54.533802+0000 mon.a (mon.0) 3074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:45:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:55 smithi131 bash[24745]: cluster 2024-09-14T04:45:54.281796+0000 mgr.a (mgr.14355) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:55 smithi131 bash[24745]: audit 2024-09-14T04:45:54.533802+0000 mon.a (mon.0) 3074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:45:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:55 smithi171 bash[25040]: cluster 2024-09-14T04:45:54.281796+0000 mgr.a (mgr.14355) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:45:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:55 smithi171 bash[25040]: audit 2024-09-14T04:45:54.533802+0000 mon.a (mon.0) 3074 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:45:56.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22972]: debug 2024-09-14T04:45:56.142+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22972]: debug 2024-09-14T04:45:56.142+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22722]: audit 2024-09-14T04:45:55.390672+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22722]: audit 2024-09-14T04:45:55.392463+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22722]: audit 2024-09-14T04:45:55.402818+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22722]: audit 2024-09-14T04:45:55.406135+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:56 smithi007 bash[22722]: audit 2024-09-14T04:45:55.408471+0000 mgr.a (mgr.14355) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:56 smithi131 bash[24745]: audit 2024-09-14T04:45:55.390672+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:45:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:56 smithi131 bash[24745]: audit 2024-09-14T04:45:55.392463+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:45:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:56 smithi131 bash[24745]: audit 2024-09-14T04:45:55.402818+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:45:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:56 smithi131 bash[24745]: audit 2024-09-14T04:45:55.406135+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:56.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:56 smithi131 bash[24745]: audit 2024-09-14T04:45:55.408471+0000 mgr.a (mgr.14355) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:56 smithi171 bash[25040]: audit 2024-09-14T04:45:55.390672+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:45:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:56 smithi171 bash[25040]: audit 2024-09-14T04:45:55.392463+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:45:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:56 smithi171 bash[25040]: audit 2024-09-14T04:45:55.402818+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:45:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:56 smithi171 bash[25040]: audit 2024-09-14T04:45:55.406135+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:56 smithi171 bash[25040]: audit 2024-09-14T04:45:55.408471+0000 mgr.a (mgr.14355) 16649 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:45:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:57 smithi007 bash[22722]: audit 2024-09-14T04:45:56.146787+0000 mgr.a (mgr.14355) 16650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:45:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:57 smithi007 bash[22722]: cephadm 2024-09-14T04:45:56.147992+0000 mgr.a (mgr.14355) 16651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:45:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:57 smithi007 bash[22722]: cluster 2024-09-14T04:45:56.284665+0000 mgr.a (mgr.14355) 16652 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-14T04:45:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:57 smithi131 bash[24745]: audit 2024-09-14T04:45:56.146787+0000 mgr.a (mgr.14355) 16650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:45:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:57 smithi131 bash[24745]: cephadm 2024-09-14T04:45:56.147992+0000 mgr.a (mgr.14355) 16651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:45:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:57 smithi131 bash[24745]: cluster 2024-09-14T04:45:56.284665+0000 mgr.a (mgr.14355) 16652 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-14T04:45:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:57 smithi171 bash[25040]: audit 2024-09-14T04:45:56.146787+0000 mgr.a (mgr.14355) 16650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:45:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:57 smithi171 bash[25040]: cephadm 2024-09-14T04:45:56.147992+0000 mgr.a (mgr.14355) 16651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:45:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:57 smithi171 bash[25040]: cluster 2024-09-14T04:45:56.284665+0000 mgr.a (mgr.14355) 16652 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-09-14T04:45:58.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:45:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:45:58.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:45:59.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:45:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:45:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:45:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:45:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:45:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:45:59 smithi007 bash[22722]: cluster 2024-09-14T04:45:58.285415+0000 mgr.a (mgr.14355) 16653 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:45:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:45:59 smithi131 bash[24745]: cluster 2024-09-14T04:45:58.285415+0000 mgr.a (mgr.14355) 16653 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:45:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:45:59 smithi171 bash[25040]: cluster 2024-09-14T04:45:58.285415+0000 mgr.a (mgr.14355) 16653 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:00 smithi007 bash[22722]: audit 2024-09-14T04:45:59.015109+0000 mgr.a (mgr.14355) 16654 : audit [DBG] from='client.358887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:00 smithi131 bash[24745]: audit 2024-09-14T04:45:59.015109+0000 mgr.a (mgr.14355) 16654 : audit [DBG] from='client.358887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:00 smithi171 bash[25040]: audit 2024-09-14T04:45:59.015109+0000 mgr.a (mgr.14355) 16654 : audit [DBG] from='client.358887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:01 smithi007 bash[22722]: cluster 2024-09-14T04:46:00.286374+0000 mgr.a (mgr.14355) 16655 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:01 smithi131 bash[24745]: cluster 2024-09-14T04:46:00.286374+0000 mgr.a (mgr.14355) 16655 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:01 smithi171 bash[25040]: cluster 2024-09-14T04:46:00.286374+0000 mgr.a (mgr.14355) 16655 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:03 smithi007 bash[22722]: cluster 2024-09-14T04:46:02.288700+0000 mgr.a (mgr.14355) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:03 smithi131 bash[24745]: cluster 2024-09-14T04:46:02.288700+0000 mgr.a (mgr.14355) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:03 smithi171 bash[25040]: cluster 2024-09-14T04:46:02.288700+0000 mgr.a (mgr.14355) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:04.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:04.440 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:04.440 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:04 smithi131 bash[24745]: cluster 2024-09-14T04:46:04.289471+0000 mgr.a (mgr.14355) 16657 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:04 smithi171 bash[25040]: cluster 2024-09-14T04:46:04.289471+0000 mgr.a (mgr.14355) 16657 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:04 smithi007 bash[22722]: cluster 2024-09-14T04:46:04.289471+0000 mgr.a (mgr.14355) 16657 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:05.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:05.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:05 smithi131 bash[24745]: audit 2024-09-14T04:46:04.771862+0000 mgr.a (mgr.14355) 16658 : audit [DBG] from='client.358965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:05 smithi171 bash[25040]: audit 2024-09-14T04:46:04.771862+0000 mgr.a (mgr.14355) 16658 : audit [DBG] from='client.358965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:05 smithi007 bash[22722]: audit 2024-09-14T04:46:04.771862+0000 mgr.a (mgr.14355) 16658 : audit [DBG] from='client.358965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:06 smithi131 bash[24745]: cluster 2024-09-14T04:46:06.291875+0000 mgr.a (mgr.14355) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:06 smithi171 bash[25040]: cluster 2024-09-14T04:46:06.291875+0000 mgr.a (mgr.14355) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:06 smithi007 bash[22722]: cluster 2024-09-14T04:46:06.291875+0000 mgr.a (mgr.14355) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:46:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:09 smithi007 bash[22722]: cluster 2024-09-14T04:46:08.292660+0000 mgr.a (mgr.14355) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:09 smithi131 bash[24745]: cluster 2024-09-14T04:46:08.292660+0000 mgr.a (mgr.14355) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:09 smithi171 bash[25040]: cluster 2024-09-14T04:46:08.292660+0000 mgr.a (mgr.14355) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:10.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:10.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:10.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:10.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:11 smithi007 bash[22722]: cluster 2024-09-14T04:46:10.293358+0000 mgr.a (mgr.14355) 16661 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:11 smithi131 bash[24745]: cluster 2024-09-14T04:46:10.293358+0000 mgr.a (mgr.14355) 16661 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:11 smithi171 bash[25040]: cluster 2024-09-14T04:46:10.293358+0000 mgr.a (mgr.14355) 16661 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:12 smithi007 bash[22722]: audit 2024-09-14T04:46:10.529767+0000 mgr.a (mgr.14355) 16662 : audit [DBG] from='client.359043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:12 smithi131 bash[24745]: audit 2024-09-14T04:46:10.529767+0000 mgr.a (mgr.14355) 16662 : audit [DBG] from='client.359043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:12 smithi171 bash[25040]: audit 2024-09-14T04:46:10.529767+0000 mgr.a (mgr.14355) 16662 : audit [DBG] from='client.359043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:13 smithi007 bash[22722]: cluster 2024-09-14T04:46:12.295694+0000 mgr.a (mgr.14355) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:13 smithi131 bash[24745]: cluster 2024-09-14T04:46:12.295694+0000 mgr.a (mgr.14355) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:13 smithi171 bash[25040]: cluster 2024-09-14T04:46:12.295694+0000 mgr.a (mgr.14355) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:46:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:15 smithi007 bash[22722]: cluster 2024-09-14T04:46:14.296498+0000 mgr.a (mgr.14355) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:15 smithi131 bash[24745]: cluster 2024-09-14T04:46:14.296498+0000 mgr.a (mgr.14355) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:15 smithi171 bash[25040]: cluster 2024-09-14T04:46:14.296498+0000 mgr.a (mgr.14355) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:16.725 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:16.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:17 smithi007 bash[22722]: cluster 2024-09-14T04:46:16.298490+0000 mgr.a (mgr.14355) 16665 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:17 smithi007 bash[22722]: audit 2024-09-14T04:46:16.307995+0000 mgr.a (mgr.14355) 16666 : audit [DBG] from='client.359121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:17 smithi131 bash[24745]: cluster 2024-09-14T04:46:16.298490+0000 mgr.a (mgr.14355) 16665 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:17 smithi131 bash[24745]: audit 2024-09-14T04:46:16.307995+0000 mgr.a (mgr.14355) 16666 : audit [DBG] from='client.359121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:17 smithi171 bash[25040]: cluster 2024-09-14T04:46:16.298490+0000 mgr.a (mgr.14355) 16665 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:17 smithi171 bash[25040]: audit 2024-09-14T04:46:16.307995+0000 mgr.a (mgr.14355) 16666 : audit [DBG] from='client.359121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:19 smithi007 bash[22722]: cluster 2024-09-14T04:46:18.299399+0000 mgr.a (mgr.14355) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:19 smithi131 bash[24745]: cluster 2024-09-14T04:46:18.299399+0000 mgr.a (mgr.14355) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:19 smithi171 bash[25040]: cluster 2024-09-14T04:46:18.299399+0000 mgr.a (mgr.14355) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:21 smithi007 bash[22722]: cluster 2024-09-14T04:46:20.300737+0000 mgr.a (mgr.14355) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:46:21.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:21 smithi131 bash[24745]: cluster 2024-09-14T04:46:20.300737+0000 mgr.a (mgr.14355) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:46:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:21 smithi171 bash[25040]: cluster 2024-09-14T04:46:20.300737+0000 mgr.a (mgr.14355) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T04:46:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:22.500 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:23 smithi007 bash[22722]: audit 2024-09-14T04:46:22.065125+0000 mgr.a (mgr.14355) 16669 : audit [DBG] from='client.359199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:23 smithi007 bash[22722]: cluster 2024-09-14T04:46:22.305321+0000 mgr.a (mgr.14355) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:23 smithi131 bash[24745]: audit 2024-09-14T04:46:22.065125+0000 mgr.a (mgr.14355) 16669 : audit [DBG] from='client.359199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:23 smithi131 bash[24745]: cluster 2024-09-14T04:46:22.305321+0000 mgr.a (mgr.14355) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:23 smithi171 bash[25040]: audit 2024-09-14T04:46:22.065125+0000 mgr.a (mgr.14355) 16669 : audit [DBG] from='client.359199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:23 smithi171 bash[25040]: cluster 2024-09-14T04:46:22.305321+0000 mgr.a (mgr.14355) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:25 smithi007 bash[22722]: cluster 2024-09-14T04:46:24.306247+0000 mgr.a (mgr.14355) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:25 smithi131 bash[24745]: cluster 2024-09-14T04:46:24.306247+0000 mgr.a (mgr.14355) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:25 smithi171 bash[25040]: cluster 2024-09-14T04:46:24.306247+0000 mgr.a (mgr.14355) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:27.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:27.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:27 smithi007 bash[22722]: cluster 2024-09-14T04:46:26.308494+0000 mgr.a (mgr.14355) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:27 smithi131 bash[24745]: cluster 2024-09-14T04:46:26.308494+0000 mgr.a (mgr.14355) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:27 smithi171 bash[25040]: cluster 2024-09-14T04:46:26.308494+0000 mgr.a (mgr.14355) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:28.236 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:29 smithi007 bash[22722]: audit 2024-09-14T04:46:27.829801+0000 mgr.a (mgr.14355) 16673 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:29.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:29 smithi007 bash[22722]: cluster 2024-09-14T04:46:28.309191+0000 mgr.a (mgr.14355) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:29 smithi131 bash[24745]: audit 2024-09-14T04:46:27.829801+0000 mgr.a (mgr.14355) 16673 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:29 smithi131 bash[24745]: cluster 2024-09-14T04:46:28.309191+0000 mgr.a (mgr.14355) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:29 smithi171 bash[25040]: audit 2024-09-14T04:46:27.829801+0000 mgr.a (mgr.14355) 16673 : audit [DBG] from='client.359277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:29 smithi171 bash[25040]: cluster 2024-09-14T04:46:28.309191+0000 mgr.a (mgr.14355) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:31 smithi007 bash[22722]: cluster 2024-09-14T04:46:30.310574+0000 mgr.a (mgr.14355) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:31 smithi131 bash[24745]: cluster 2024-09-14T04:46:30.310574+0000 mgr.a (mgr.14355) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:31 smithi171 bash[25040]: cluster 2024-09-14T04:46:30.310574+0000 mgr.a (mgr.14355) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:33.237 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:33.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:33.238 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:33 smithi007 bash[22722]: cluster 2024-09-14T04:46:32.312217+0000 mgr.a (mgr.14355) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:33 smithi131 bash[24745]: cluster 2024-09-14T04:46:32.312217+0000 mgr.a (mgr.14355) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:33 smithi171 bash[25040]: cluster 2024-09-14T04:46:32.312217+0000 mgr.a (mgr.14355) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:35 smithi007 bash[22722]: audit 2024-09-14T04:46:33.569028+0000 mgr.a (mgr.14355) 16677 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:35 smithi007 bash[22722]: cluster 2024-09-14T04:46:34.313196+0000 mgr.a (mgr.14355) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:35 smithi131 bash[24745]: audit 2024-09-14T04:46:33.569028+0000 mgr.a (mgr.14355) 16677 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:35 smithi131 bash[24745]: cluster 2024-09-14T04:46:34.313196+0000 mgr.a (mgr.14355) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:35 smithi171 bash[25040]: audit 2024-09-14T04:46:33.569028+0000 mgr.a (mgr.14355) 16677 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:35 smithi171 bash[25040]: cluster 2024-09-14T04:46:34.313196+0000 mgr.a (mgr.14355) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:37 smithi007 bash[22722]: cluster 2024-09-14T04:46:36.315435+0000 mgr.a (mgr.14355) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:37 smithi131 bash[24745]: cluster 2024-09-14T04:46:36.315435+0000 mgr.a (mgr.14355) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:37 smithi171 bash[25040]: cluster 2024-09-14T04:46:36.315435+0000 mgr.a (mgr.14355) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:38.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:38.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:38.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:39 smithi007 bash[22722]: cluster 2024-09-14T04:46:38.316209+0000 mgr.a (mgr.14355) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:39.768 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:39.769 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:39 smithi131 bash[24745]: cluster 2024-09-14T04:46:38.316209+0000 mgr.a (mgr.14355) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:39 smithi171 bash[25040]: cluster 2024-09-14T04:46:38.316209+0000 mgr.a (mgr.14355) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:40 smithi007 bash[22722]: audit 2024-09-14T04:46:39.323088+0000 mgr.a (mgr.14355) 16681 : audit [DBG] from='client.359433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:40 smithi131 bash[24745]: audit 2024-09-14T04:46:39.323088+0000 mgr.a (mgr.14355) 16681 : audit [DBG] from='client.359433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:40 smithi171 bash[25040]: audit 2024-09-14T04:46:39.323088+0000 mgr.a (mgr.14355) 16681 : audit [DBG] from='client.359433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:41 smithi007 bash[22722]: cluster 2024-09-14T04:46:40.317777+0000 mgr.a (mgr.14355) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:41 smithi131 bash[24745]: cluster 2024-09-14T04:46:40.317777+0000 mgr.a (mgr.14355) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:41 smithi171 bash[25040]: cluster 2024-09-14T04:46:40.317777+0000 mgr.a (mgr.14355) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T04:46:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:42 smithi131 bash[24745]: cluster 2024-09-14T04:46:42.319448+0000 mgr.a (mgr.14355) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:42 smithi171 bash[25040]: cluster 2024-09-14T04:46:42.319448+0000 mgr.a (mgr.14355) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:42 smithi007 bash[22722]: cluster 2024-09-14T04:46:42.319448+0000 mgr.a (mgr.14355) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:46:44.770 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:44.771 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:45.525 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:45.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:45.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:45.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:45.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:45 smithi007 bash[22722]: cluster 2024-09-14T04:46:44.320228+0000 mgr.a (mgr.14355) 16684 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:45 smithi131 bash[24745]: cluster 2024-09-14T04:46:44.320228+0000 mgr.a (mgr.14355) 16684 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:45 smithi171 bash[25040]: cluster 2024-09-14T04:46:44.320228+0000 mgr.a (mgr.14355) 16684 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:46 smithi007 bash[22722]: audit 2024-09-14T04:46:45.101616+0000 mgr.a (mgr.14355) 16685 : audit [DBG] from='client.359508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:46 smithi131 bash[24745]: audit 2024-09-14T04:46:45.101616+0000 mgr.a (mgr.14355) 16685 : audit [DBG] from='client.359508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:46 smithi171 bash[25040]: audit 2024-09-14T04:46:45.101616+0000 mgr.a (mgr.14355) 16685 : audit [DBG] from='client.359508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:47 smithi007 bash[22722]: cluster 2024-09-14T04:46:46.322729+0000 mgr.a (mgr.14355) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:46:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:47 smithi131 bash[24745]: cluster 2024-09-14T04:46:46.322729+0000 mgr.a (mgr.14355) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:46:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:47 smithi171 bash[25040]: cluster 2024-09-14T04:46:46.322729+0000 mgr.a (mgr.14355) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:46:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:49 smithi007 bash[22722]: cluster 2024-09-14T04:46:48.323494+0000 mgr.a (mgr.14355) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:46:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:49 smithi131 bash[24745]: cluster 2024-09-14T04:46:48.323494+0000 mgr.a (mgr.14355) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:46:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:49 smithi171 bash[25040]: cluster 2024-09-14T04:46:48.323494+0000 mgr.a (mgr.14355) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:46:50.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:50.527 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:51.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:51.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:51.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:51.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:51.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:51 smithi131 bash[24745]: cluster 2024-09-14T04:46:50.325048+0000 mgr.a (mgr.14355) 16688 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:51 smithi171 bash[25040]: cluster 2024-09-14T04:46:50.325048+0000 mgr.a (mgr.14355) 16688 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:51 smithi007 bash[22722]: cluster 2024-09-14T04:46:50.325048+0000 mgr.a (mgr.14355) 16688 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:52 smithi131 bash[24745]: audit 2024-09-14T04:46:50.857541+0000 mgr.a (mgr.14355) 16689 : audit [DBG] from='client.359586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:52 smithi171 bash[25040]: audit 2024-09-14T04:46:50.857541+0000 mgr.a (mgr.14355) 16689 : audit [DBG] from='client.359586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:52 smithi007 bash[22722]: audit 2024-09-14T04:46:50.857541+0000 mgr.a (mgr.14355) 16689 : audit [DBG] from='client.359586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:53 smithi131 bash[24745]: cluster 2024-09-14T04:46:52.326760+0000 mgr.a (mgr.14355) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:46:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:53 smithi171 bash[25040]: cluster 2024-09-14T04:46:52.326760+0000 mgr.a (mgr.14355) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:46:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:53 smithi007 bash[22722]: cluster 2024-09-14T04:46:52.326760+0000 mgr.a (mgr.14355) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:46:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:55 smithi007 bash[22722]: cluster 2024-09-14T04:46:54.327562+0000 mgr.a (mgr.14355) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:55 smithi131 bash[24745]: cluster 2024-09-14T04:46:54.327562+0000 mgr.a (mgr.14355) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:55 smithi171 bash[25040]: cluster 2024-09-14T04:46:54.327562+0000 mgr.a (mgr.14355) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:46:56.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:46:56.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:46:56.266 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:46:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:56 smithi007 bash[22722]: audit 2024-09-14T04:46:56.212487+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:46:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:56 smithi131 bash[24745]: audit 2024-09-14T04:46:56.212487+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:46:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:56 smithi171 bash[25040]: audit 2024-09-14T04:46:56.212487+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:46:57.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:46:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:46:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:46:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:46:57.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:46:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22722]: cluster 2024-09-14T04:46:56.328931+0000 mgr.a (mgr.14355) 16692 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22722]: audit 2024-09-14T04:46:57.065745+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:46:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22722]: audit 2024-09-14T04:46:57.066745+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:46:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22722]: audit 2024-09-14T04:46:57.071822+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:46:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22722]: audit 2024-09-14T04:46:57.073722+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:57 smithi131 bash[24745]: cluster 2024-09-14T04:46:56.328931+0000 mgr.a (mgr.14355) 16692 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:57 smithi131 bash[24745]: audit 2024-09-14T04:46:57.065745+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:46:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:57 smithi131 bash[24745]: audit 2024-09-14T04:46:57.066745+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:46:57.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:57 smithi131 bash[24745]: audit 2024-09-14T04:46:57.071822+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:46:57.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:57 smithi131 bash[24745]: audit 2024-09-14T04:46:57.073722+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:57 smithi171 bash[25040]: cluster 2024-09-14T04:46:56.328931+0000 mgr.a (mgr.14355) 16692 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:57 smithi171 bash[25040]: audit 2024-09-14T04:46:57.065745+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:57 smithi171 bash[25040]: audit 2024-09-14T04:46:57.066745+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:57 smithi171 bash[25040]: audit 2024-09-14T04:46:57.071822+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:46:57.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:57 smithi171 bash[25040]: audit 2024-09-14T04:46:57.073722+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:58.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22972]: debug 2024-09-14T04:46:57.777+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:46:58.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:46:57 smithi007 bash[22972]: debug 2024-09-14T04:46:57.777+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:46:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:58 smithi007 bash[22722]: audit 2024-09-14T04:46:56.604354+0000 mgr.a (mgr.14355) 16693 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:58 smithi007 bash[22722]: audit 2024-09-14T04:46:57.074801+0000 mgr.a (mgr.14355) 16694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:58 smithi131 bash[24745]: audit 2024-09-14T04:46:56.604354+0000 mgr.a (mgr.14355) 16693 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:58 smithi131 bash[24745]: audit 2024-09-14T04:46:57.074801+0000 mgr.a (mgr.14355) 16694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:58 smithi171 bash[25040]: audit 2024-09-14T04:46:56.604354+0000 mgr.a (mgr.14355) 16693 : audit [DBG] from='client.359661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:46:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:58 smithi171 bash[25040]: audit 2024-09-14T04:46:57.074801+0000 mgr.a (mgr.14355) 16694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:46:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:59 smithi007 bash[22722]: audit 2024-09-14T04:46:57.780201+0000 mgr.a (mgr.14355) 16695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:46:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:59 smithi007 bash[22722]: cephadm 2024-09-14T04:46:57.781368+0000 mgr.a (mgr.14355) 16696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:46:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:46:59 smithi007 bash[22722]: cluster 2024-09-14T04:46:58.329843+0000 mgr.a (mgr.14355) 16697 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:46:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:59 smithi131 bash[24745]: audit 2024-09-14T04:46:57.780201+0000 mgr.a (mgr.14355) 16695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:46:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:59 smithi131 bash[24745]: cephadm 2024-09-14T04:46:57.781368+0000 mgr.a (mgr.14355) 16696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:46:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:46:59 smithi131 bash[24745]: cluster 2024-09-14T04:46:58.329843+0000 mgr.a (mgr.14355) 16697 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:46:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:59 smithi171 bash[25040]: audit 2024-09-14T04:46:57.780201+0000 mgr.a (mgr.14355) 16695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:46:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:59 smithi171 bash[25040]: cephadm 2024-09-14T04:46:57.781368+0000 mgr.a (mgr.14355) 16696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:46:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:46:59 smithi171 bash[25040]: cluster 2024-09-14T04:46:58.329843+0000 mgr.a (mgr.14355) 16697 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T04:47:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:01 smithi007 bash[22722]: cluster 2024-09-14T04:47:00.331666+0000 mgr.a (mgr.14355) 16698 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:47:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:01 smithi131 bash[24745]: cluster 2024-09-14T04:47:00.331666+0000 mgr.a (mgr.14355) 16698 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:47:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:01 smithi171 bash[25040]: cluster 2024-09-14T04:47:00.331666+0000 mgr.a (mgr.14355) 16698 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:47:02.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:02.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:02.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:02.836 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:02.836 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:03 smithi007 bash[22722]: cluster 2024-09-14T04:47:02.332852+0000 mgr.a (mgr.14355) 16699 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:03 smithi007 bash[22722]: audit 2024-09-14T04:47:02.402757+0000 mgr.a (mgr.14355) 16700 : audit [DBG] from='client.359847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:03 smithi131 bash[24745]: cluster 2024-09-14T04:47:02.332852+0000 mgr.a (mgr.14355) 16699 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:03 smithi131 bash[24745]: audit 2024-09-14T04:47:02.402757+0000 mgr.a (mgr.14355) 16700 : audit [DBG] from='client.359847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:03 smithi171 bash[25040]: cluster 2024-09-14T04:47:02.332852+0000 mgr.a (mgr.14355) 16699 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:03 smithi171 bash[25040]: audit 2024-09-14T04:47:02.402757+0000 mgr.a (mgr.14355) 16700 : audit [DBG] from='client.359847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:05 smithi007 bash[22722]: cluster 2024-09-14T04:47:04.333753+0000 mgr.a (mgr.14355) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:05 smithi131 bash[24745]: cluster 2024-09-14T04:47:04.333753+0000 mgr.a (mgr.14355) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:05 smithi171 bash[25040]: cluster 2024-09-14T04:47:04.333753+0000 mgr.a (mgr.14355) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:07 smithi007 bash[22722]: cluster 2024-09-14T04:47:06.336006+0000 mgr.a (mgr.14355) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:07 smithi131 bash[24745]: cluster 2024-09-14T04:47:06.336006+0000 mgr.a (mgr.14355) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:07 smithi171 bash[25040]: cluster 2024-09-14T04:47:06.336006+0000 mgr.a (mgr.14355) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:07.837 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:07.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:07.838 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:08.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:09 smithi007 bash[22722]: audit 2024-09-14T04:47:08.173333+0000 mgr.a (mgr.14355) 16703 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:09 smithi007 bash[22722]: cluster 2024-09-14T04:47:08.336569+0000 mgr.a (mgr.14355) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:09 smithi131 bash[24745]: audit 2024-09-14T04:47:08.173333+0000 mgr.a (mgr.14355) 16703 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:09 smithi131 bash[24745]: cluster 2024-09-14T04:47:08.336569+0000 mgr.a (mgr.14355) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:09.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:09 smithi171 bash[25040]: audit 2024-09-14T04:47:08.173333+0000 mgr.a (mgr.14355) 16703 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:09.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:09 smithi171 bash[25040]: cluster 2024-09-14T04:47:08.336569+0000 mgr.a (mgr.14355) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:11 smithi007 bash[22722]: cluster 2024-09-14T04:47:10.338393+0000 mgr.a (mgr.14355) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:11 smithi131 bash[24745]: cluster 2024-09-14T04:47:10.338393+0000 mgr.a (mgr.14355) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:11 smithi171 bash[25040]: cluster 2024-09-14T04:47:10.338393+0000 mgr.a (mgr.14355) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:47:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:12 smithi131 bash[24745]: cluster 2024-09-14T04:47:12.339606+0000 mgr.a (mgr.14355) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:47:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:12 smithi171 bash[25040]: cluster 2024-09-14T04:47:12.339606+0000 mgr.a (mgr.14355) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:47:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:12 smithi007 bash[22722]: cluster 2024-09-14T04:47:12.339606+0000 mgr.a (mgr.14355) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:47:13.606 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:13.607 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:14.348 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:14.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:14.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:14.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:14.349 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:15 smithi007 bash[22722]: audit 2024-09-14T04:47:13.936125+0000 mgr.a (mgr.14355) 16707 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:15 smithi007 bash[22722]: cluster 2024-09-14T04:47:14.340100+0000 mgr.a (mgr.14355) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:15 smithi131 bash[24745]: audit 2024-09-14T04:47:13.936125+0000 mgr.a (mgr.14355) 16707 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:15 smithi131 bash[24745]: cluster 2024-09-14T04:47:14.340100+0000 mgr.a (mgr.14355) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:15 smithi171 bash[25040]: audit 2024-09-14T04:47:13.936125+0000 mgr.a (mgr.14355) 16707 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:15 smithi171 bash[25040]: cluster 2024-09-14T04:47:14.340100+0000 mgr.a (mgr.14355) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:17 smithi007 bash[22722]: cluster 2024-09-14T04:47:16.342275+0000 mgr.a (mgr.14355) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:17 smithi131 bash[24745]: cluster 2024-09-14T04:47:16.342275+0000 mgr.a (mgr.14355) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:17 smithi171 bash[25040]: cluster 2024-09-14T04:47:16.342275+0000 mgr.a (mgr.14355) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:19.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:19.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:19.351 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:19 smithi007 bash[22722]: cluster 2024-09-14T04:47:18.343036+0000 mgr.a (mgr.14355) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:19 smithi131 bash[24745]: cluster 2024-09-14T04:47:18.343036+0000 mgr.a (mgr.14355) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:19 smithi171 bash[25040]: cluster 2024-09-14T04:47:18.343036+0000 mgr.a (mgr.14355) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:20.132 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:21 smithi007 bash[22722]: audit 2024-09-14T04:47:19.684312+0000 mgr.a (mgr.14355) 16711 : audit [DBG] from='client.360072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:21 smithi007 bash[22722]: cluster 2024-09-14T04:47:20.345001+0000 mgr.a (mgr.14355) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:21 smithi131 bash[24745]: audit 2024-09-14T04:47:19.684312+0000 mgr.a (mgr.14355) 16711 : audit [DBG] from='client.360072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:21 smithi131 bash[24745]: cluster 2024-09-14T04:47:20.345001+0000 mgr.a (mgr.14355) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:21 smithi171 bash[25040]: audit 2024-09-14T04:47:19.684312+0000 mgr.a (mgr.14355) 16711 : audit [DBG] from='client.360072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:21 smithi171 bash[25040]: cluster 2024-09-14T04:47:20.345001+0000 mgr.a (mgr.14355) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:23 smithi007 bash[22722]: cluster 2024-09-14T04:47:22.346452+0000 mgr.a (mgr.14355) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:23 smithi131 bash[24745]: cluster 2024-09-14T04:47:22.346452+0000 mgr.a (mgr.14355) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:23 smithi171 bash[25040]: cluster 2024-09-14T04:47:22.346452+0000 mgr.a (mgr.14355) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:25.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:25.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:25.134 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:25 smithi007 bash[22722]: cluster 2024-09-14T04:47:24.347404+0000 mgr.a (mgr.14355) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:25 smithi131 bash[24745]: cluster 2024-09-14T04:47:24.347404+0000 mgr.a (mgr.14355) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:25 smithi171 bash[25040]: cluster 2024-09-14T04:47:24.347404+0000 mgr.a (mgr.14355) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:25.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:25.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:27 smithi007 bash[22722]: audit 2024-09-14T04:47:25.468517+0000 mgr.a (mgr.14355) 16715 : audit [DBG] from='client.360147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:27.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:27 smithi007 bash[22722]: cluster 2024-09-14T04:47:26.350339+0000 mgr.a (mgr.14355) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:27 smithi131 bash[24745]: audit 2024-09-14T04:47:25.468517+0000 mgr.a (mgr.14355) 16715 : audit [DBG] from='client.360147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:27 smithi131 bash[24745]: cluster 2024-09-14T04:47:26.350339+0000 mgr.a (mgr.14355) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:27 smithi171 bash[25040]: audit 2024-09-14T04:47:25.468517+0000 mgr.a (mgr.14355) 16715 : audit [DBG] from='client.360147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:27 smithi171 bash[25040]: cluster 2024-09-14T04:47:26.350339+0000 mgr.a (mgr.14355) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:29 smithi007 bash[22722]: cluster 2024-09-14T04:47:28.351151+0000 mgr.a (mgr.14355) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:29 smithi131 bash[24745]: cluster 2024-09-14T04:47:28.351151+0000 mgr.a (mgr.14355) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:29 smithi171 bash[25040]: cluster 2024-09-14T04:47:28.351151+0000 mgr.a (mgr.14355) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:30.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:30.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:30.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:31.699 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:31.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:31.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:31.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:31.700 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:31 smithi007 bash[22722]: cluster 2024-09-14T04:47:30.352722+0000 mgr.a (mgr.14355) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:47:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:31 smithi131 bash[24745]: cluster 2024-09-14T04:47:30.352722+0000 mgr.a (mgr.14355) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:47:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:31 smithi171 bash[25040]: cluster 2024-09-14T04:47:30.352722+0000 mgr.a (mgr.14355) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:47:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:32 smithi007 bash[22722]: audit 2024-09-14T04:47:31.244892+0000 mgr.a (mgr.14355) 16719 : audit [DBG] from='client.360222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:32 smithi131 bash[24745]: audit 2024-09-14T04:47:31.244892+0000 mgr.a (mgr.14355) 16719 : audit [DBG] from='client.360222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:32 smithi171 bash[25040]: audit 2024-09-14T04:47:31.244892+0000 mgr.a (mgr.14355) 16719 : audit [DBG] from='client.360222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:33 smithi007 bash[22722]: cluster 2024-09-14T04:47:32.354533+0000 mgr.a (mgr.14355) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:47:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:33 smithi131 bash[24745]: cluster 2024-09-14T04:47:32.354533+0000 mgr.a (mgr.14355) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:47:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:33 smithi171 bash[25040]: cluster 2024-09-14T04:47:32.354533+0000 mgr.a (mgr.14355) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:47:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:35 smithi007 bash[22722]: cluster 2024-09-14T04:47:34.355309+0000 mgr.a (mgr.14355) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:35 smithi131 bash[24745]: cluster 2024-09-14T04:47:34.355309+0000 mgr.a (mgr.14355) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:35 smithi171 bash[25040]: cluster 2024-09-14T04:47:34.355309+0000 mgr.a (mgr.14355) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:47:36.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:36.702 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:36 smithi131 bash[24745]: cluster 2024-09-14T04:47:36.357315+0000 mgr.a (mgr.14355) 16722 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:36 smithi171 bash[25040]: cluster 2024-09-14T04:47:36.357315+0000 mgr.a (mgr.14355) 16722 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:36 smithi007 bash[22722]: cluster 2024-09-14T04:47:36.357315+0000 mgr.a (mgr.14355) 16722 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:37.439 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:37.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:37 smithi131 bash[24745]: audit 2024-09-14T04:47:37.032005+0000 mgr.a (mgr.14355) 16723 : audit [DBG] from='client.360300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:37 smithi171 bash[25040]: audit 2024-09-14T04:47:37.032005+0000 mgr.a (mgr.14355) 16723 : audit [DBG] from='client.360300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:37 smithi007 bash[22722]: audit 2024-09-14T04:47:37.032005+0000 mgr.a (mgr.14355) 16723 : audit [DBG] from='client.360300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:38 smithi131 bash[24745]: cluster 2024-09-14T04:47:38.358229+0000 mgr.a (mgr.14355) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:38 smithi171 bash[25040]: cluster 2024-09-14T04:47:38.358229+0000 mgr.a (mgr.14355) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:38 smithi007 bash[22722]: cluster 2024-09-14T04:47:38.358229+0000 mgr.a (mgr.14355) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:41.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:41 smithi007 bash[22722]: cluster 2024-09-14T04:47:40.360020+0000 mgr.a (mgr.14355) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:41 smithi131 bash[24745]: cluster 2024-09-14T04:47:40.360020+0000 mgr.a (mgr.14355) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:41 smithi171 bash[25040]: cluster 2024-09-14T04:47:40.360020+0000 mgr.a (mgr.14355) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:43.207 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:43.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:43.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:43 smithi007 bash[22722]: cluster 2024-09-14T04:47:42.361218+0000 mgr.a (mgr.14355) 16726 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:43 smithi131 bash[24745]: cluster 2024-09-14T04:47:42.361218+0000 mgr.a (mgr.14355) 16726 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:43 smithi171 bash[25040]: cluster 2024-09-14T04:47:42.361218+0000 mgr.a (mgr.14355) 16726 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:44 smithi007 bash[22722]: audit 2024-09-14T04:47:42.772302+0000 mgr.a (mgr.14355) 16727 : audit [DBG] from='client.360378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:44 smithi131 bash[24745]: audit 2024-09-14T04:47:42.772302+0000 mgr.a (mgr.14355) 16727 : audit [DBG] from='client.360378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:44 smithi171 bash[25040]: audit 2024-09-14T04:47:42.772302+0000 mgr.a (mgr.14355) 16727 : audit [DBG] from='client.360378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:45 smithi007 bash[22722]: cluster 2024-09-14T04:47:44.362109+0000 mgr.a (mgr.14355) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:45 smithi131 bash[24745]: cluster 2024-09-14T04:47:44.362109+0000 mgr.a (mgr.14355) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:45 smithi171 bash[25040]: cluster 2024-09-14T04:47:44.362109+0000 mgr.a (mgr.14355) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:47 smithi007 bash[22722]: cluster 2024-09-14T04:47:46.364320+0000 mgr.a (mgr.14355) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:47 smithi131 bash[24745]: cluster 2024-09-14T04:47:46.364320+0000 mgr.a (mgr.14355) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:47 smithi171 bash[25040]: cluster 2024-09-14T04:47:46.364320+0000 mgr.a (mgr.14355) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:48.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:48.209 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:48.961 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:48.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:48.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:48.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:48.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:49 smithi007 bash[22722]: cluster 2024-09-14T04:47:48.364767+0000 mgr.a (mgr.14355) 16730 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:49 smithi131 bash[24745]: cluster 2024-09-14T04:47:48.364767+0000 mgr.a (mgr.14355) 16730 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:49 smithi171 bash[25040]: cluster 2024-09-14T04:47:48.364767+0000 mgr.a (mgr.14355) 16730 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:50 smithi007 bash[22722]: audit 2024-09-14T04:47:48.536589+0000 mgr.a (mgr.14355) 16731 : audit [DBG] from='client.360456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:50 smithi131 bash[24745]: audit 2024-09-14T04:47:48.536589+0000 mgr.a (mgr.14355) 16731 : audit [DBG] from='client.360456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:50 smithi171 bash[25040]: audit 2024-09-14T04:47:48.536589+0000 mgr.a (mgr.14355) 16731 : audit [DBG] from='client.360456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:51 smithi007 bash[22722]: cluster 2024-09-14T04:47:50.366664+0000 mgr.a (mgr.14355) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:51 smithi131 bash[24745]: cluster 2024-09-14T04:47:50.366664+0000 mgr.a (mgr.14355) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:51 smithi171 bash[25040]: cluster 2024-09-14T04:47:50.366664+0000 mgr.a (mgr.14355) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:47:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:52 smithi131 bash[24745]: cluster 2024-09-14T04:47:52.367898+0000 mgr.a (mgr.14355) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:52 smithi171 bash[25040]: cluster 2024-09-14T04:47:52.367898+0000 mgr.a (mgr.14355) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:52 smithi007 bash[22722]: cluster 2024-09-14T04:47:52.367898+0000 mgr.a (mgr.14355) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:47:53.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:53.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:53.964 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:54.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:47:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:47:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:47:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:47:54.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:47:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:55 smithi007 bash[22722]: audit 2024-09-14T04:47:54.294937+0000 mgr.a (mgr.14355) 16734 : audit [DBG] from='client.360531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:55.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:55 smithi007 bash[22722]: cluster 2024-09-14T04:47:54.368595+0000 mgr.a (mgr.14355) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:55 smithi131 bash[24745]: audit 2024-09-14T04:47:54.294937+0000 mgr.a (mgr.14355) 16734 : audit [DBG] from='client.360531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:55 smithi131 bash[24745]: cluster 2024-09-14T04:47:54.368595+0000 mgr.a (mgr.14355) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:55 smithi171 bash[25040]: audit 2024-09-14T04:47:54.294937+0000 mgr.a (mgr.14355) 16734 : audit [DBG] from='client.360531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:47:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:55 smithi171 bash[25040]: cluster 2024-09-14T04:47:54.368595+0000 mgr.a (mgr.14355) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:57 smithi007 bash[22722]: cluster 2024-09-14T04:47:56.371050+0000 mgr.a (mgr.14355) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:57 smithi131 bash[24745]: cluster 2024-09-14T04:47:56.371050+0000 mgr.a (mgr.14355) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:57 smithi171 bash[25040]: cluster 2024-09-14T04:47:56.371050+0000 mgr.a (mgr.14355) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:47:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:58 smithi007 bash[22722]: audit 2024-09-14T04:47:57.836563+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:47:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:58 smithi131 bash[24745]: audit 2024-09-14T04:47:57.836563+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:47:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:58 smithi171 bash[25040]: audit 2024-09-14T04:47:57.836563+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:47:59.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22972]: debug 2024-09-14T04:47:59.452+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22972]: debug 2024-09-14T04:47:59.456+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22722]: cluster 2024-09-14T04:47:58.371810+0000 mgr.a (mgr.14355) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22722]: audit 2024-09-14T04:47:58.692323+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22722]: audit 2024-09-14T04:47:58.693765+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22722]: audit 2024-09-14T04:47:58.700413+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:47:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:47:59 smithi007 bash[22722]: audit 2024-09-14T04:47:58.702824+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:47:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:47:59.750 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:47:59.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:47:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:59 smithi131 bash[24745]: cluster 2024-09-14T04:47:58.371810+0000 mgr.a (mgr.14355) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:59 smithi131 bash[24745]: audit 2024-09-14T04:47:58.692323+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:47:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:59 smithi131 bash[24745]: audit 2024-09-14T04:47:58.693765+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:47:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:59 smithi131 bash[24745]: audit 2024-09-14T04:47:58.700413+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:47:59.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:47:59 smithi131 bash[24745]: audit 2024-09-14T04:47:58.702824+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:47:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:59 smithi171 bash[25040]: cluster 2024-09-14T04:47:58.371810+0000 mgr.a (mgr.14355) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:47:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:59 smithi171 bash[25040]: audit 2024-09-14T04:47:58.692323+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:47:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:59 smithi171 bash[25040]: audit 2024-09-14T04:47:58.693765+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:47:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:59 smithi171 bash[25040]: audit 2024-09-14T04:47:58.700413+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:47:59.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:47:59 smithi171 bash[25040]: audit 2024-09-14T04:47:58.702824+0000 mon.a (mon.0) 3088 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:48:00.494 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:00.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:00.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:00.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:00.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:00 smithi007 bash[22722]: audit 2024-09-14T04:47:58.704167+0000 mgr.a (mgr.14355) 16738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:48:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:00 smithi131 bash[24745]: audit 2024-09-14T04:47:58.704167+0000 mgr.a (mgr.14355) 16738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:48:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:00 smithi171 bash[25040]: audit 2024-09-14T04:47:58.704167+0000 mgr.a (mgr.14355) 16738 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:48:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:01 smithi007 bash[22722]: audit 2024-09-14T04:47:59.456968+0000 mgr.a (mgr.14355) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:48:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:01 smithi007 bash[22722]: cephadm 2024-09-14T04:47:59.458410+0000 mgr.a (mgr.14355) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:48:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:01 smithi007 bash[22722]: audit 2024-09-14T04:48:00.069909+0000 mgr.a (mgr.14355) 16741 : audit [DBG] from='client.360714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:01.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:01 smithi007 bash[22722]: cluster 2024-09-14T04:48:00.372944+0000 mgr.a (mgr.14355) 16742 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:48:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:01 smithi131 bash[24745]: audit 2024-09-14T04:47:59.456968+0000 mgr.a (mgr.14355) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:48:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:01 smithi131 bash[24745]: cephadm 2024-09-14T04:47:59.458410+0000 mgr.a (mgr.14355) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:48:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:01 smithi131 bash[24745]: audit 2024-09-14T04:48:00.069909+0000 mgr.a (mgr.14355) 16741 : audit [DBG] from='client.360714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:01.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:01 smithi131 bash[24745]: cluster 2024-09-14T04:48:00.372944+0000 mgr.a (mgr.14355) 16742 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:48:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:01 smithi171 bash[25040]: audit 2024-09-14T04:47:59.456968+0000 mgr.a (mgr.14355) 16739 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:48:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:01 smithi171 bash[25040]: cephadm 2024-09-14T04:47:59.458410+0000 mgr.a (mgr.14355) 16740 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:48:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:01 smithi171 bash[25040]: audit 2024-09-14T04:48:00.069909+0000 mgr.a (mgr.14355) 16741 : audit [DBG] from='client.360714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:01 smithi171 bash[25040]: cluster 2024-09-14T04:48:00.372944+0000 mgr.a (mgr.14355) 16742 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:48:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:03 smithi007 bash[22722]: cluster 2024-09-14T04:48:02.374439+0000 mgr.a (mgr.14355) 16743 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:03 smithi131 bash[24745]: cluster 2024-09-14T04:48:02.374439+0000 mgr.a (mgr.14355) 16743 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:03 smithi171 bash[25040]: cluster 2024-09-14T04:48:02.374439+0000 mgr.a (mgr.14355) 16743 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:04 smithi131 bash[24745]: cluster 2024-09-14T04:48:04.375171+0000 mgr.a (mgr.14355) 16744 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:04 smithi171 bash[25040]: cluster 2024-09-14T04:48:04.375171+0000 mgr.a (mgr.14355) 16744 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:04 smithi007 bash[22722]: cluster 2024-09-14T04:48:04.375171+0000 mgr.a (mgr.14355) 16744 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:05.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:05.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:05.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:06.264 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:06.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:06.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:06.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:06.265 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:07 smithi007 bash[22722]: audit 2024-09-14T04:48:05.823481+0000 mgr.a (mgr.14355) 16745 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:07 smithi007 bash[22722]: cluster 2024-09-14T04:48:06.377942+0000 mgr.a (mgr.14355) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:07 smithi131 bash[24745]: audit 2024-09-14T04:48:05.823481+0000 mgr.a (mgr.14355) 16745 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:07 smithi131 bash[24745]: cluster 2024-09-14T04:48:06.377942+0000 mgr.a (mgr.14355) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:07 smithi171 bash[25040]: audit 2024-09-14T04:48:05.823481+0000 mgr.a (mgr.14355) 16745 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:07 smithi171 bash[25040]: cluster 2024-09-14T04:48:06.377942+0000 mgr.a (mgr.14355) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:48:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:09 smithi007 bash[22722]: cluster 2024-09-14T04:48:08.378751+0000 mgr.a (mgr.14355) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:09 smithi131 bash[24745]: cluster 2024-09-14T04:48:08.378751+0000 mgr.a (mgr.14355) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:09 smithi171 bash[25040]: cluster 2024-09-14T04:48:08.378751+0000 mgr.a (mgr.14355) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:11.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:11.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:11.267 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:11 smithi007 bash[22722]: cluster 2024-09-14T04:48:10.380304+0000 mgr.a (mgr.14355) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:11 smithi131 bash[24745]: cluster 2024-09-14T04:48:10.380304+0000 mgr.a (mgr.14355) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:11 smithi171 bash[25040]: cluster 2024-09-14T04:48:10.380304+0000 mgr.a (mgr.14355) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:48:12.040 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:12.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:12.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:13 smithi007 bash[22722]: audit 2024-09-14T04:48:11.601900+0000 mgr.a (mgr.14355) 16749 : audit [DBG] from='client.360864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:13 smithi007 bash[22722]: cluster 2024-09-14T04:48:12.382000+0000 mgr.a (mgr.14355) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:48:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:13 smithi131 bash[24745]: audit 2024-09-14T04:48:11.601900+0000 mgr.a (mgr.14355) 16749 : audit [DBG] from='client.360864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:13 smithi131 bash[24745]: cluster 2024-09-14T04:48:12.382000+0000 mgr.a (mgr.14355) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:48:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:13 smithi171 bash[25040]: audit 2024-09-14T04:48:11.601900+0000 mgr.a (mgr.14355) 16749 : audit [DBG] from='client.360864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:13 smithi171 bash[25040]: cluster 2024-09-14T04:48:12.382000+0000 mgr.a (mgr.14355) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:48:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:15 smithi007 bash[22722]: cluster 2024-09-14T04:48:14.382799+0000 mgr.a (mgr.14355) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:15 smithi131 bash[24745]: cluster 2024-09-14T04:48:14.382799+0000 mgr.a (mgr.14355) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:15 smithi171 bash[25040]: cluster 2024-09-14T04:48:14.382799+0000 mgr.a (mgr.14355) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:16 smithi131 bash[24745]: cluster 2024-09-14T04:48:16.384851+0000 mgr.a (mgr.14355) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:16 smithi171 bash[25040]: cluster 2024-09-14T04:48:16.384851+0000 mgr.a (mgr.14355) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:16 smithi007 bash[22722]: cluster 2024-09-14T04:48:16.384851+0000 mgr.a (mgr.14355) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:17.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:17.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:17 smithi131 bash[24745]: audit 2024-09-14T04:48:17.372927+0000 mgr.a (mgr.14355) 16753 : audit [DBG] from='client.360939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:17.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:17 smithi171 bash[25040]: audit 2024-09-14T04:48:17.372927+0000 mgr.a (mgr.14355) 16753 : audit [DBG] from='client.360939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:17 smithi007 bash[22722]: audit 2024-09-14T04:48:17.372927+0000 mgr.a (mgr.14355) 16753 : audit [DBG] from='client.360939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:18 smithi131 bash[24745]: cluster 2024-09-14T04:48:18.385750+0000 mgr.a (mgr.14355) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:18 smithi171 bash[25040]: cluster 2024-09-14T04:48:18.385750+0000 mgr.a (mgr.14355) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:18 smithi007 bash[22722]: cluster 2024-09-14T04:48:18.385750+0000 mgr.a (mgr.14355) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:21 smithi007 bash[22722]: cluster 2024-09-14T04:48:20.387713+0000 mgr.a (mgr.14355) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:21 smithi131 bash[24745]: cluster 2024-09-14T04:48:20.387713+0000 mgr.a (mgr.14355) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:21 smithi171 bash[25040]: cluster 2024-09-14T04:48:20.387713+0000 mgr.a (mgr.14355) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:22.787 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:22.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:22.788 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:23.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:23.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:23.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:23.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:23.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:23 smithi007 bash[22722]: cluster 2024-09-14T04:48:22.388947+0000 mgr.a (mgr.14355) 16756 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:23 smithi131 bash[24745]: cluster 2024-09-14T04:48:22.388947+0000 mgr.a (mgr.14355) 16756 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:23 smithi171 bash[25040]: cluster 2024-09-14T04:48:22.388947+0000 mgr.a (mgr.14355) 16756 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:24 smithi007 bash[22722]: audit 2024-09-14T04:48:23.121696+0000 mgr.a (mgr.14355) 16757 : audit [DBG] from='client.361014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:24 smithi131 bash[24745]: audit 2024-09-14T04:48:23.121696+0000 mgr.a (mgr.14355) 16757 : audit [DBG] from='client.361014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:24 smithi171 bash[25040]: audit 2024-09-14T04:48:23.121696+0000 mgr.a (mgr.14355) 16757 : audit [DBG] from='client.361014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:25 smithi007 bash[22722]: cluster 2024-09-14T04:48:24.389845+0000 mgr.a (mgr.14355) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:25 smithi131 bash[24745]: cluster 2024-09-14T04:48:24.389845+0000 mgr.a (mgr.14355) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:25 smithi171 bash[25040]: cluster 2024-09-14T04:48:24.389845+0000 mgr.a (mgr.14355) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:26 smithi131 bash[24745]: cluster 2024-09-14T04:48:26.392121+0000 mgr.a (mgr.14355) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:26 smithi171 bash[25040]: cluster 2024-09-14T04:48:26.392121+0000 mgr.a (mgr.14355) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:26 smithi007 bash[22722]: cluster 2024-09-14T04:48:26.392121+0000 mgr.a (mgr.14355) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:28.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:28.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:28.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:29.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:29.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:29.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:29.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:29.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:29 smithi007 bash[22722]: cluster 2024-09-14T04:48:28.392852+0000 mgr.a (mgr.14355) 16760 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:29 smithi131 bash[24745]: cluster 2024-09-14T04:48:28.392852+0000 mgr.a (mgr.14355) 16760 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:29 smithi171 bash[25040]: cluster 2024-09-14T04:48:28.392852+0000 mgr.a (mgr.14355) 16760 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:30 smithi131 bash[24745]: audit 2024-09-14T04:48:28.859408+0000 mgr.a (mgr.14355) 16761 : audit [DBG] from='client.361092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:30 smithi171 bash[25040]: audit 2024-09-14T04:48:28.859408+0000 mgr.a (mgr.14355) 16761 : audit [DBG] from='client.361092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:30 smithi007 bash[22722]: audit 2024-09-14T04:48:28.859408+0000 mgr.a (mgr.14355) 16761 : audit [DBG] from='client.361092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:31 smithi131 bash[24745]: cluster 2024-09-14T04:48:30.394862+0000 mgr.a (mgr.14355) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:31 smithi171 bash[25040]: cluster 2024-09-14T04:48:30.394862+0000 mgr.a (mgr.14355) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:31 smithi007 bash[22722]: cluster 2024-09-14T04:48:30.394862+0000 mgr.a (mgr.14355) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:48:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:32 smithi131 bash[24745]: cluster 2024-09-14T04:48:32.396274+0000 mgr.a (mgr.14355) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:32 smithi171 bash[25040]: cluster 2024-09-14T04:48:32.396274+0000 mgr.a (mgr.14355) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:32 smithi007 bash[22722]: cluster 2024-09-14T04:48:32.396274+0000 mgr.a (mgr.14355) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:48:34.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:34.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:34.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:35.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:35 smithi007 bash[22722]: cluster 2024-09-14T04:48:34.396745+0000 mgr.a (mgr.14355) 16764 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:35 smithi131 bash[24745]: cluster 2024-09-14T04:48:34.396745+0000 mgr.a (mgr.14355) 16764 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:35 smithi171 bash[25040]: cluster 2024-09-14T04:48:34.396745+0000 mgr.a (mgr.14355) 16764 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:36 smithi131 bash[24745]: audit 2024-09-14T04:48:34.621206+0000 mgr.a (mgr.14355) 16765 : audit [DBG] from='client.361167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:36 smithi171 bash[25040]: audit 2024-09-14T04:48:34.621206+0000 mgr.a (mgr.14355) 16765 : audit [DBG] from='client.361167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:36 smithi007 bash[22722]: audit 2024-09-14T04:48:34.621206+0000 mgr.a (mgr.14355) 16765 : audit [DBG] from='client.361167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:37 smithi131 bash[24745]: cluster 2024-09-14T04:48:36.399050+0000 mgr.a (mgr.14355) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:37 smithi171 bash[25040]: cluster 2024-09-14T04:48:36.399050+0000 mgr.a (mgr.14355) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:37 smithi007 bash[22722]: cluster 2024-09-14T04:48:36.399050+0000 mgr.a (mgr.14355) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:38 smithi131 bash[24745]: cluster 2024-09-14T04:48:38.399827+0000 mgr.a (mgr.14355) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:38 smithi171 bash[25040]: cluster 2024-09-14T04:48:38.399827+0000 mgr.a (mgr.14355) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:38 smithi007 bash[22722]: cluster 2024-09-14T04:48:38.399827+0000 mgr.a (mgr.14355) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:40.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:40.067 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:40 smithi131 bash[24745]: audit 2024-09-14T04:48:40.401331+0000 mgr.a (mgr.14355) 16768 : audit [DBG] from='client.361245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:40 smithi131 bash[24745]: cluster 2024-09-14T04:48:40.418549+0000 mgr.a (mgr.14355) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:40 smithi171 bash[25040]: audit 2024-09-14T04:48:40.401331+0000 mgr.a (mgr.14355) 16768 : audit [DBG] from='client.361245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:40 smithi171 bash[25040]: cluster 2024-09-14T04:48:40.418549+0000 mgr.a (mgr.14355) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:40.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:40.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:40 smithi007 bash[22722]: audit 2024-09-14T04:48:40.401331+0000 mgr.a (mgr.14355) 16768 : audit [DBG] from='client.361245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:40.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:40 smithi007 bash[22722]: cluster 2024-09-14T04:48:40.418549+0000 mgr.a (mgr.14355) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:42 smithi131 bash[24745]: cluster 2024-09-14T04:48:42.420320+0000 mgr.a (mgr.14355) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:42 smithi171 bash[25040]: cluster 2024-09-14T04:48:42.420320+0000 mgr.a (mgr.14355) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:42 smithi007 bash[22722]: cluster 2024-09-14T04:48:42.420320+0000 mgr.a (mgr.14355) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:48:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:44 smithi131 bash[24745]: cluster 2024-09-14T04:48:44.421076+0000 mgr.a (mgr.14355) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:44 smithi171 bash[25040]: cluster 2024-09-14T04:48:44.421076+0000 mgr.a (mgr.14355) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:44 smithi007 bash[22722]: cluster 2024-09-14T04:48:44.421076+0000 mgr.a (mgr.14355) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:45.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:45.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:46.595 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:46.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:46.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:46.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:46.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:46 smithi131 bash[24745]: audit 2024-09-14T04:48:46.171793+0000 mgr.a (mgr.14355) 16772 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:46 smithi131 bash[24745]: cluster 2024-09-14T04:48:46.422451+0000 mgr.a (mgr.14355) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:46 smithi171 bash[25040]: audit 2024-09-14T04:48:46.171793+0000 mgr.a (mgr.14355) 16772 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:46 smithi171 bash[25040]: cluster 2024-09-14T04:48:46.422451+0000 mgr.a (mgr.14355) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:46 smithi007 bash[22722]: audit 2024-09-14T04:48:46.171793+0000 mgr.a (mgr.14355) 16772 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:46 smithi007 bash[22722]: cluster 2024-09-14T04:48:46.422451+0000 mgr.a (mgr.14355) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:48 smithi131 bash[24745]: cluster 2024-09-14T04:48:48.423286+0000 mgr.a (mgr.14355) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:48 smithi171 bash[25040]: cluster 2024-09-14T04:48:48.423286+0000 mgr.a (mgr.14355) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:48 smithi007 bash[22722]: cluster 2024-09-14T04:48:48.423286+0000 mgr.a (mgr.14355) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T04:48:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:50 smithi131 bash[24745]: cluster 2024-09-14T04:48:50.425197+0000 mgr.a (mgr.14355) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:48:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:50 smithi171 bash[25040]: cluster 2024-09-14T04:48:50.425197+0000 mgr.a (mgr.14355) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:48:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:50 smithi007 bash[22722]: cluster 2024-09-14T04:48:50.425197+0000 mgr.a (mgr.14355) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:48:51.597 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:51.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:52.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:52.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:52.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:52.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:52.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:52 smithi131 bash[24745]: audit 2024-09-14T04:48:51.940280+0000 mgr.a (mgr.14355) 16776 : audit [DBG] from='client.361398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:52 smithi131 bash[24745]: cluster 2024-09-14T04:48:52.426238+0000 mgr.a (mgr.14355) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:52 smithi171 bash[25040]: audit 2024-09-14T04:48:51.940280+0000 mgr.a (mgr.14355) 16776 : audit [DBG] from='client.361398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:52 smithi171 bash[25040]: cluster 2024-09-14T04:48:52.426238+0000 mgr.a (mgr.14355) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:52 smithi007 bash[22722]: audit 2024-09-14T04:48:51.940280+0000 mgr.a (mgr.14355) 16776 : audit [DBG] from='client.361398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:52 smithi007 bash[22722]: cluster 2024-09-14T04:48:52.426238+0000 mgr.a (mgr.14355) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:54 smithi131 bash[24745]: cluster 2024-09-14T04:48:54.427024+0000 mgr.a (mgr.14355) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:54 smithi171 bash[25040]: cluster 2024-09-14T04:48:54.427024+0000 mgr.a (mgr.14355) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:54 smithi007 bash[22722]: cluster 2024-09-14T04:48:54.427024+0000 mgr.a (mgr.14355) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:56 smithi131 bash[24745]: cluster 2024-09-14T04:48:56.429065+0000 mgr.a (mgr.14355) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:56 smithi171 bash[25040]: cluster 2024-09-14T04:48:56.429065+0000 mgr.a (mgr.14355) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:56 smithi007 bash[22722]: cluster 2024-09-14T04:48:56.429065+0000 mgr.a (mgr.14355) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:48:57.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:48:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:48:57.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:48:58.130 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:48:58.130 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:58 smithi131 bash[24745]: audit 2024-09-14T04:48:57.704164+0000 mgr.a (mgr.14355) 16780 : audit [DBG] from='client.361476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:58 smithi131 bash[24745]: cluster 2024-09-14T04:48:58.429950+0000 mgr.a (mgr.14355) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:58 smithi171 bash[25040]: audit 2024-09-14T04:48:57.704164+0000 mgr.a (mgr.14355) 16780 : audit [DBG] from='client.361476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:58 smithi171 bash[25040]: cluster 2024-09-14T04:48:58.429950+0000 mgr.a (mgr.14355) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:58 smithi007 bash[22722]: audit 2024-09-14T04:48:57.704164+0000 mgr.a (mgr.14355) 16780 : audit [DBG] from='client.361476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:48:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:58 smithi007 bash[22722]: cluster 2024-09-14T04:48:58.429950+0000 mgr.a (mgr.14355) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:48:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:48:59 smithi131 bash[24745]: audit 2024-09-14T04:48:59.508472+0000 mon.a (mon.0) 3089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:48:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:48:59 smithi171 bash[25040]: audit 2024-09-14T04:48:59.508472+0000 mon.a (mon.0) 3089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:48:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:48:59 smithi007 bash[22722]: audit 2024-09-14T04:48:59.508472+0000 mon.a (mon.0) 3089 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:49:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: audit 2024-09-14T04:49:00.352927+0000 mon.a (mon.0) 3090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:49:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: audit 2024-09-14T04:49:00.354824+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:49:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: audit 2024-09-14T04:49:00.364036+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:49:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: audit 2024-09-14T04:49:00.366655+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: audit 2024-09-14T04:49:00.368964+0000 mgr.a (mgr.14355) 16782 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:00 smithi131 bash[24745]: cluster 2024-09-14T04:49:00.431561+0000 mgr.a (mgr.14355) 16783 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: audit 2024-09-14T04:49:00.352927+0000 mon.a (mon.0) 3090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:49:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: audit 2024-09-14T04:49:00.354824+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:49:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: audit 2024-09-14T04:49:00.364036+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:49:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: audit 2024-09-14T04:49:00.366655+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: audit 2024-09-14T04:49:00.368964+0000 mgr.a (mgr.14355) 16782 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:00 smithi171 bash[25040]: cluster 2024-09-14T04:49:00.431561+0000 mgr.a (mgr.14355) 16783 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: audit 2024-09-14T04:49:00.352927+0000 mon.a (mon.0) 3090 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:49:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: audit 2024-09-14T04:49:00.354824+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:49:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: audit 2024-09-14T04:49:00.364036+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:49:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: audit 2024-09-14T04:49:00.366655+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: audit 2024-09-14T04:49:00.368964+0000 mgr.a (mgr.14355) 16782 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:49:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:00 smithi007 bash[22722]: cluster 2024-09-14T04:49:00.431561+0000 mgr.a (mgr.14355) 16783 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:01.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:49:01 smithi007 bash[22972]: debug 2024-09-14T04:49:01.116+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:49:01.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:49:01 smithi007 bash[22972]: debug 2024-09-14T04:49:01.116+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:49:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:02 smithi007 bash[22722]: audit 2024-09-14T04:49:01.119349+0000 mgr.a (mgr.14355) 16784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:49:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:02 smithi007 bash[22722]: cephadm 2024-09-14T04:49:01.120994+0000 mgr.a (mgr.14355) 16785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:49:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:02 smithi131 bash[24745]: audit 2024-09-14T04:49:01.119349+0000 mgr.a (mgr.14355) 16784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:49:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:02 smithi131 bash[24745]: cephadm 2024-09-14T04:49:01.120994+0000 mgr.a (mgr.14355) 16785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:49:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:02 smithi171 bash[25040]: audit 2024-09-14T04:49:01.119349+0000 mgr.a (mgr.14355) 16784 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:49:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:02 smithi171 bash[25040]: cephadm 2024-09-14T04:49:01.120994+0000 mgr.a (mgr.14355) 16785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:49:03.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:03.132 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:03.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:03 smithi007 bash[22722]: cluster 2024-09-14T04:49:02.433307+0000 mgr.a (mgr.14355) 16786 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:49:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:03 smithi131 bash[24745]: cluster 2024-09-14T04:49:02.433307+0000 mgr.a (mgr.14355) 16786 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:49:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:03 smithi171 bash[25040]: cluster 2024-09-14T04:49:02.433307+0000 mgr.a (mgr.14355) 16786 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T04:49:03.906 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:03.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:03.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:03.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:03.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:04 smithi131 bash[24745]: audit 2024-09-14T04:49:03.466093+0000 mgr.a (mgr.14355) 16787 : audit [DBG] from='client.361656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:04 smithi131 bash[24745]: cluster 2024-09-14T04:49:04.434240+0000 mgr.a (mgr.14355) 16788 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:04 smithi171 bash[25040]: audit 2024-09-14T04:49:03.466093+0000 mgr.a (mgr.14355) 16787 : audit [DBG] from='client.361656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:04 smithi171 bash[25040]: cluster 2024-09-14T04:49:04.434240+0000 mgr.a (mgr.14355) 16788 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:04 smithi007 bash[22722]: audit 2024-09-14T04:49:03.466093+0000 mgr.a (mgr.14355) 16787 : audit [DBG] from='client.361656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:04 smithi007 bash[22722]: cluster 2024-09-14T04:49:04.434240+0000 mgr.a (mgr.14355) 16788 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:06 smithi131 bash[24745]: cluster 2024-09-14T04:49:06.436505+0000 mgr.a (mgr.14355) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:06 smithi171 bash[25040]: cluster 2024-09-14T04:49:06.436505+0000 mgr.a (mgr.14355) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:06 smithi007 bash[22722]: cluster 2024-09-14T04:49:06.436505+0000 mgr.a (mgr.14355) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:08 smithi131 bash[24745]: cluster 2024-09-14T04:49:08.437282+0000 mgr.a (mgr.14355) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:08 smithi171 bash[25040]: cluster 2024-09-14T04:49:08.437282+0000 mgr.a (mgr.14355) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:08 smithi007 bash[22722]: cluster 2024-09-14T04:49:08.437282+0000 mgr.a (mgr.14355) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:09.682 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:09.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:09 smithi131 bash[24745]: audit 2024-09-14T04:49:09.239375+0000 mgr.a (mgr.14355) 16791 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:09 smithi171 bash[25040]: audit 2024-09-14T04:49:09.239375+0000 mgr.a (mgr.14355) 16791 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:09 smithi007 bash[22722]: audit 2024-09-14T04:49:09.239375+0000 mgr.a (mgr.14355) 16791 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:10 smithi131 bash[24745]: cluster 2024-09-14T04:49:10.439290+0000 mgr.a (mgr.14355) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T04:49:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:10 smithi171 bash[25040]: cluster 2024-09-14T04:49:10.439290+0000 mgr.a (mgr.14355) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T04:49:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:10 smithi007 bash[22722]: cluster 2024-09-14T04:49:10.439290+0000 mgr.a (mgr.14355) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-14T04:49:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:12 smithi131 bash[24745]: cluster 2024-09-14T04:49:12.440509+0000 mgr.a (mgr.14355) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:12 smithi171 bash[25040]: cluster 2024-09-14T04:49:12.440509+0000 mgr.a (mgr.14355) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:12 smithi007 bash[22722]: cluster 2024-09-14T04:49:12.440509+0000 mgr.a (mgr.14355) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:14.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:14.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:14.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:14 smithi131 bash[24745]: cluster 2024-09-14T04:49:14.441293+0000 mgr.a (mgr.14355) 16794 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:14 smithi171 bash[25040]: cluster 2024-09-14T04:49:14.441293+0000 mgr.a (mgr.14355) 16794 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:14 smithi007 bash[22722]: cluster 2024-09-14T04:49:14.441293+0000 mgr.a (mgr.14355) 16794 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:15.438 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:15.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:15 smithi131 bash[24745]: audit 2024-09-14T04:49:15.015523+0000 mgr.a (mgr.14355) 16795 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:15 smithi171 bash[25040]: audit 2024-09-14T04:49:15.015523+0000 mgr.a (mgr.14355) 16795 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:15 smithi007 bash[22722]: audit 2024-09-14T04:49:15.015523+0000 mgr.a (mgr.14355) 16795 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:16 smithi131 bash[24745]: cluster 2024-09-14T04:49:16.443749+0000 mgr.a (mgr.14355) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:16 smithi171 bash[25040]: cluster 2024-09-14T04:49:16.443749+0000 mgr.a (mgr.14355) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:16 smithi007 bash[22722]: cluster 2024-09-14T04:49:16.443749+0000 mgr.a (mgr.14355) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:49:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:18 smithi131 bash[24745]: cluster 2024-09-14T04:49:18.444525+0000 mgr.a (mgr.14355) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:49:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:18 smithi171 bash[25040]: cluster 2024-09-14T04:49:18.444525+0000 mgr.a (mgr.14355) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:49:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:18 smithi007 bash[22722]: cluster 2024-09-14T04:49:18.444525+0000 mgr.a (mgr.14355) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:49:20.440 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:20.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:20 smithi131 bash[24745]: cluster 2024-09-14T04:49:20.445701+0000 mgr.a (mgr.14355) 16798 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:49:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:20 smithi171 bash[25040]: cluster 2024-09-14T04:49:20.445701+0000 mgr.a (mgr.14355) 16798 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:49:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:20 smithi007 bash[22722]: cluster 2024-09-14T04:49:20.445701+0000 mgr.a (mgr.14355) 16798 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:49:21.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:21 smithi131 bash[24745]: audit 2024-09-14T04:49:20.770251+0000 mgr.a (mgr.14355) 16799 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:21 smithi171 bash[25040]: audit 2024-09-14T04:49:20.770251+0000 mgr.a (mgr.14355) 16799 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:21 smithi007 bash[22722]: audit 2024-09-14T04:49:20.770251+0000 mgr.a (mgr.14355) 16799 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:22 smithi131 bash[24745]: cluster 2024-09-14T04:49:22.447444+0000 mgr.a (mgr.14355) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:22 smithi171 bash[25040]: cluster 2024-09-14T04:49:22.447444+0000 mgr.a (mgr.14355) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:22 smithi007 bash[22722]: cluster 2024-09-14T04:49:22.447444+0000 mgr.a (mgr.14355) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:24 smithi131 bash[24745]: cluster 2024-09-14T04:49:24.448226+0000 mgr.a (mgr.14355) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:49:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:24 smithi171 bash[25040]: cluster 2024-09-14T04:49:24.448226+0000 mgr.a (mgr.14355) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:49:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:24 smithi007 bash[22722]: cluster 2024-09-14T04:49:24.448226+0000 mgr.a (mgr.14355) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:49:26.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:26.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:26 smithi131 bash[24745]: cluster 2024-09-14T04:49:26.449996+0000 mgr.a (mgr.14355) 16802 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:26 smithi171 bash[25040]: cluster 2024-09-14T04:49:26.449996+0000 mgr.a (mgr.14355) 16802 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:26 smithi007 bash[22722]: cluster 2024-09-14T04:49:26.449996+0000 mgr.a (mgr.14355) 16802 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:26.962 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:26.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:26.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:26.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:26.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:27 smithi131 bash[24745]: audit 2024-09-14T04:49:26.528330+0000 mgr.a (mgr.14355) 16803 : audit [DBG] from='client.361962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:27 smithi171 bash[25040]: audit 2024-09-14T04:49:26.528330+0000 mgr.a (mgr.14355) 16803 : audit [DBG] from='client.361962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:27 smithi007 bash[22722]: audit 2024-09-14T04:49:26.528330+0000 mgr.a (mgr.14355) 16803 : audit [DBG] from='client.361962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:28 smithi171 bash[25040]: cluster 2024-09-14T04:49:28.450985+0000 mgr.a (mgr.14355) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:28 smithi007 bash[22722]: cluster 2024-09-14T04:49:28.450985+0000 mgr.a (mgr.14355) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:28 smithi131 bash[24745]: cluster 2024-09-14T04:49:28.450985+0000 mgr.a (mgr.14355) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:49:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:30 smithi131 bash[24745]: cluster 2024-09-14T04:49:30.452820+0000 mgr.a (mgr.14355) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:30 smithi171 bash[25040]: cluster 2024-09-14T04:49:30.452820+0000 mgr.a (mgr.14355) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:30 smithi007 bash[22722]: cluster 2024-09-14T04:49:30.452820+0000 mgr.a (mgr.14355) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:31.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:32.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:32.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:32 smithi131 bash[24745]: audit 2024-09-14T04:49:32.296788+0000 mgr.a (mgr.14355) 16806 : audit [DBG] from='client.362040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:32 smithi131 bash[24745]: cluster 2024-09-14T04:49:32.453820+0000 mgr.a (mgr.14355) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:32 smithi171 bash[25040]: audit 2024-09-14T04:49:32.296788+0000 mgr.a (mgr.14355) 16806 : audit [DBG] from='client.362040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:32 smithi171 bash[25040]: cluster 2024-09-14T04:49:32.453820+0000 mgr.a (mgr.14355) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:32 smithi007 bash[22722]: audit 2024-09-14T04:49:32.296788+0000 mgr.a (mgr.14355) 16806 : audit [DBG] from='client.362040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:32 smithi007 bash[22722]: cluster 2024-09-14T04:49:32.453820+0000 mgr.a (mgr.14355) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:34 smithi131 bash[24745]: cluster 2024-09-14T04:49:34.454731+0000 mgr.a (mgr.14355) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:34.871 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:34 smithi171 bash[25040]: cluster 2024-09-14T04:49:34.454731+0000 mgr.a (mgr.14355) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:34 smithi007 bash[22722]: cluster 2024-09-14T04:49:34.454731+0000 mgr.a (mgr.14355) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:36 smithi131 bash[24745]: cluster 2024-09-14T04:49:36.456901+0000 mgr.a (mgr.14355) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:36 smithi171 bash[25040]: cluster 2024-09-14T04:49:36.456901+0000 mgr.a (mgr.14355) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:36 smithi007 bash[22722]: cluster 2024-09-14T04:49:36.456901+0000 mgr.a (mgr.14355) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:37.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:37.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:38.529 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:38.530 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:38 smithi131 bash[24745]: audit 2024-09-14T04:49:38.089615+0000 mgr.a (mgr.14355) 16810 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:38 smithi131 bash[24745]: cluster 2024-09-14T04:49:38.457447+0000 mgr.a (mgr.14355) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:38 smithi171 bash[25040]: audit 2024-09-14T04:49:38.089615+0000 mgr.a (mgr.14355) 16810 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:38 smithi171 bash[25040]: cluster 2024-09-14T04:49:38.457447+0000 mgr.a (mgr.14355) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:38 smithi007 bash[22722]: audit 2024-09-14T04:49:38.089615+0000 mgr.a (mgr.14355) 16810 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:38 smithi007 bash[22722]: cluster 2024-09-14T04:49:38.457447+0000 mgr.a (mgr.14355) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:40 smithi131 bash[24745]: cluster 2024-09-14T04:49:40.459242+0000 mgr.a (mgr.14355) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:40 smithi171 bash[25040]: cluster 2024-09-14T04:49:40.459242+0000 mgr.a (mgr.14355) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:40 smithi007 bash[22722]: cluster 2024-09-14T04:49:40.459242+0000 mgr.a (mgr.14355) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:42 smithi131 bash[24745]: cluster 2024-09-14T04:49:42.460440+0000 mgr.a (mgr.14355) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:42 smithi171 bash[25040]: cluster 2024-09-14T04:49:42.460440+0000 mgr.a (mgr.14355) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:42 smithi007 bash[22722]: cluster 2024-09-14T04:49:42.460440+0000 mgr.a (mgr.14355) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:43.531 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:43.531 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:43.532 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:44.307 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:44.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:44.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:44 smithi131 bash[24745]: audit 2024-09-14T04:49:43.866078+0000 mgr.a (mgr.14355) 16814 : audit [DBG] from='client.362196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:44 smithi131 bash[24745]: cluster 2024-09-14T04:49:44.461407+0000 mgr.a (mgr.14355) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:44 smithi171 bash[25040]: audit 2024-09-14T04:49:43.866078+0000 mgr.a (mgr.14355) 16814 : audit [DBG] from='client.362196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:44 smithi171 bash[25040]: cluster 2024-09-14T04:49:44.461407+0000 mgr.a (mgr.14355) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:44 smithi007 bash[22722]: audit 2024-09-14T04:49:43.866078+0000 mgr.a (mgr.14355) 16814 : audit [DBG] from='client.362196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:44 smithi007 bash[22722]: cluster 2024-09-14T04:49:44.461407+0000 mgr.a (mgr.14355) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:46 smithi131 bash[24745]: cluster 2024-09-14T04:49:46.463649+0000 mgr.a (mgr.14355) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:46 smithi171 bash[25040]: cluster 2024-09-14T04:49:46.463649+0000 mgr.a (mgr.14355) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:46 smithi007 bash[22722]: cluster 2024-09-14T04:49:46.463649+0000 mgr.a (mgr.14355) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:49:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:48 smithi131 bash[24745]: cluster 2024-09-14T04:49:48.464391+0000 mgr.a (mgr.14355) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:48 smithi171 bash[25040]: cluster 2024-09-14T04:49:48.464391+0000 mgr.a (mgr.14355) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:48 smithi007 bash[22722]: cluster 2024-09-14T04:49:48.464391+0000 mgr.a (mgr.14355) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:49.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:49.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:50.055 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:50.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:50 smithi131 bash[24745]: audit 2024-09-14T04:49:49.638695+0000 mgr.a (mgr.14355) 16818 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:50 smithi131 bash[24745]: cluster 2024-09-14T04:49:50.466362+0000 mgr.a (mgr.14355) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:50 smithi171 bash[25040]: audit 2024-09-14T04:49:49.638695+0000 mgr.a (mgr.14355) 16818 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:50 smithi171 bash[25040]: cluster 2024-09-14T04:49:50.466362+0000 mgr.a (mgr.14355) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:50 smithi007 bash[22722]: audit 2024-09-14T04:49:49.638695+0000 mgr.a (mgr.14355) 16818 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:50 smithi007 bash[22722]: cluster 2024-09-14T04:49:50.466362+0000 mgr.a (mgr.14355) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:49:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:52 smithi131 bash[24745]: cluster 2024-09-14T04:49:52.467589+0000 mgr.a (mgr.14355) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:52 smithi171 bash[25040]: cluster 2024-09-14T04:49:52.467589+0000 mgr.a (mgr.14355) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:52 smithi007 bash[22722]: cluster 2024-09-14T04:49:52.467589+0000 mgr.a (mgr.14355) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:49:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:54 smithi131 bash[24745]: cluster 2024-09-14T04:49:54.468363+0000 mgr.a (mgr.14355) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:54 smithi171 bash[25040]: cluster 2024-09-14T04:49:54.468363+0000 mgr.a (mgr.14355) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:54 smithi007 bash[22722]: cluster 2024-09-14T04:49:54.468363+0000 mgr.a (mgr.14355) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:55.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:49:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:49:55.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:49:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:55 smithi131 bash[24745]: audit 2024-09-14T04:49:55.384349+0000 mgr.a (mgr.14355) 16822 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:55 smithi171 bash[25040]: audit 2024-09-14T04:49:55.384349+0000 mgr.a (mgr.14355) 16822 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:55.797 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:49:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:49:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:49:55.797 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:49:55.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:49:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:55 smithi007 bash[22722]: audit 2024-09-14T04:49:55.384349+0000 mgr.a (mgr.14355) 16822 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:49:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:56 smithi171 bash[25040]: cluster 2024-09-14T04:49:56.471185+0000 mgr.a (mgr.14355) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:56 smithi007 bash[22722]: cluster 2024-09-14T04:49:56.471185+0000 mgr.a (mgr.14355) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:56 smithi131 bash[24745]: cluster 2024-09-14T04:49:56.471185+0000 mgr.a (mgr.14355) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:49:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:49:58 smithi171 bash[25040]: cluster 2024-09-14T04:49:58.471946+0000 mgr.a (mgr.14355) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:49:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:49:58 smithi007 bash[22722]: cluster 2024-09-14T04:49:58.471946+0000 mgr.a (mgr.14355) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:49:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:49:58 smithi131 bash[24745]: cluster 2024-09-14T04:49:58.471946+0000 mgr.a (mgr.14355) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:00 smithi007 bash[22722]: cluster 2024-09-14T04:50:00.000149+0000 mon.a (mon.0) 3094 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:50:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:00 smithi131 bash[24745]: cluster 2024-09-14T04:50:00.000149+0000 mon.a (mon.0) 3094 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:50:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:00 smithi171 bash[25040]: cluster 2024-09-14T04:50:00.000149+0000 mon.a (mon.0) 3094 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T04:50:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:00.799 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:00.800 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:01.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:02 smithi007 bash[22722]: cluster 2024-09-14T04:50:00.473551+0000 mgr.a (mgr.14355) 16825 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:02 smithi007 bash[22722]: audit 2024-09-14T04:50:01.132728+0000 mgr.a (mgr.14355) 16826 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:02 smithi007 bash[22722]: audit 2024-09-14T04:50:01.175250+0000 mon.a (mon.0) 3095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:50:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:02 smithi131 bash[24745]: cluster 2024-09-14T04:50:00.473551+0000 mgr.a (mgr.14355) 16825 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:02 smithi131 bash[24745]: audit 2024-09-14T04:50:01.132728+0000 mgr.a (mgr.14355) 16826 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:02 smithi131 bash[24745]: audit 2024-09-14T04:50:01.175250+0000 mon.a (mon.0) 3095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:50:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:02 smithi171 bash[25040]: cluster 2024-09-14T04:50:00.473551+0000 mgr.a (mgr.14355) 16825 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:02 smithi171 bash[25040]: audit 2024-09-14T04:50:01.132728+0000 mgr.a (mgr.14355) 16826 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:02 smithi171 bash[25040]: audit 2024-09-14T04:50:01.175250+0000 mon.a (mon.0) 3095 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:50:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:04 smithi007 bash[22722]: cluster 2024-09-14T04:50:02.475324+0000 mgr.a (mgr.14355) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:04 smithi131 bash[24745]: cluster 2024-09-14T04:50:02.475324+0000 mgr.a (mgr.14355) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:04 smithi171 bash[25040]: cluster 2024-09-14T04:50:02.475324+0000 mgr.a (mgr.14355) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:06 smithi007 bash[22722]: cluster 2024-09-14T04:50:04.476252+0000 mgr.a (mgr.14355) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:06 smithi131 bash[24745]: cluster 2024-09-14T04:50:04.476252+0000 mgr.a (mgr.14355) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:06 smithi171 bash[25040]: cluster 2024-09-14T04:50:04.476252+0000 mgr.a (mgr.14355) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:06.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:06.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:07.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:07.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.462319+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.466562+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.502349+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.505889+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.509206+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:06.515368+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:07.236740+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:50:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:07.237838+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:50:07.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:07.243237+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:07 smithi131 bash[24745]: audit 2024-09-14T04:50:07.245458+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.462319+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.466562+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.502349+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.505889+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.509206+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:06.515368+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:07.236740+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:07.237838+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:50:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:07.243237+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:07 smithi171 bash[25040]: audit 2024-09-14T04:50:07.245458+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.462319+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.466562+0000 mon.a (mon.0) 3097 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.502349+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.505889+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.509206+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:06.515368+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:07.236740+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:07.237838+0000 mon.a (mon.0) 3103 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:07.243237+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:50:07.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:07 smithi007 bash[22722]: audit 2024-09-14T04:50:07.245458+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:08.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:50:08 smithi007 bash[22972]: debug 2024-09-14T04:50:08.058+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:50:08.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:50:08 smithi007 bash[22972]: debug 2024-09-14T04:50:08.062+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:50:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:08 smithi131 bash[24745]: cluster 2024-09-14T04:50:06.477302+0000 mgr.a (mgr.14355) 16829 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:08 smithi131 bash[24745]: audit 2024-09-14T04:50:06.902200+0000 mgr.a (mgr.14355) 16830 : audit [DBG] from='client.362505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:08 smithi131 bash[24745]: audit 2024-09-14T04:50:07.255910+0000 mgr.a (mgr.14355) 16831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:08 smithi171 bash[25040]: cluster 2024-09-14T04:50:06.477302+0000 mgr.a (mgr.14355) 16829 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:08 smithi171 bash[25040]: audit 2024-09-14T04:50:06.902200+0000 mgr.a (mgr.14355) 16830 : audit [DBG] from='client.362505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:08 smithi171 bash[25040]: audit 2024-09-14T04:50:07.255910+0000 mgr.a (mgr.14355) 16831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:08 smithi007 bash[22722]: cluster 2024-09-14T04:50:06.477302+0000 mgr.a (mgr.14355) 16829 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:08 smithi007 bash[22722]: audit 2024-09-14T04:50:06.902200+0000 mgr.a (mgr.14355) 16830 : audit [DBG] from='client.362505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:08.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:08 smithi007 bash[22722]: audit 2024-09-14T04:50:07.255910+0000 mgr.a (mgr.14355) 16831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:50:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:09 smithi131 bash[24745]: audit 2024-09-14T04:50:08.066243+0000 mgr.a (mgr.14355) 16832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:50:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:09 smithi131 bash[24745]: cephadm 2024-09-14T04:50:08.067753+0000 mgr.a (mgr.14355) 16833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:50:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:09 smithi171 bash[25040]: audit 2024-09-14T04:50:08.066243+0000 mgr.a (mgr.14355) 16832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:50:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:09 smithi171 bash[25040]: cephadm 2024-09-14T04:50:08.067753+0000 mgr.a (mgr.14355) 16833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:50:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:09 smithi007 bash[22722]: audit 2024-09-14T04:50:08.066243+0000 mgr.a (mgr.14355) 16832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:50:09.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:09 smithi007 bash[22722]: cephadm 2024-09-14T04:50:08.067753+0000 mgr.a (mgr.14355) 16833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:50:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:10 smithi131 bash[24745]: cluster 2024-09-14T04:50:08.478183+0000 mgr.a (mgr.14355) 16834 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:10 smithi171 bash[25040]: cluster 2024-09-14T04:50:08.478183+0000 mgr.a (mgr.14355) 16834 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:10 smithi007 bash[22722]: cluster 2024-09-14T04:50:08.478183+0000 mgr.a (mgr.14355) 16834 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:11 smithi131 bash[24745]: cluster 2024-09-14T04:50:10.480123+0000 mgr.a (mgr.14355) 16835 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:50:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:11 smithi171 bash[25040]: cluster 2024-09-14T04:50:10.480123+0000 mgr.a (mgr.14355) 16835 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:50:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:11 smithi007 bash[22722]: cluster 2024-09-14T04:50:10.480123+0000 mgr.a (mgr.14355) 16835 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:50:12.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:12.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:12.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:13.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:13.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:13.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:13 smithi131 bash[24745]: cluster 2024-09-14T04:50:12.480852+0000 mgr.a (mgr.14355) 16836 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:13 smithi131 bash[24745]: audit 2024-09-14T04:50:12.690179+0000 mgr.a (mgr.14355) 16837 : audit [DBG] from='client.362685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:13 smithi171 bash[25040]: cluster 2024-09-14T04:50:12.480852+0000 mgr.a (mgr.14355) 16836 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:13 smithi171 bash[25040]: audit 2024-09-14T04:50:12.690179+0000 mgr.a (mgr.14355) 16837 : audit [DBG] from='client.362685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:13 smithi007 bash[22722]: cluster 2024-09-14T04:50:12.480852+0000 mgr.a (mgr.14355) 16836 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:13 smithi007 bash[22722]: audit 2024-09-14T04:50:12.690179+0000 mgr.a (mgr.14355) 16837 : audit [DBG] from='client.362685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:15 smithi131 bash[24745]: cluster 2024-09-14T04:50:14.481730+0000 mgr.a (mgr.14355) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:15 smithi171 bash[25040]: cluster 2024-09-14T04:50:14.481730+0000 mgr.a (mgr.14355) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:15 smithi007 bash[22722]: cluster 2024-09-14T04:50:14.481730+0000 mgr.a (mgr.14355) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:17 smithi131 bash[24745]: cluster 2024-09-14T04:50:16.483960+0000 mgr.a (mgr.14355) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:17 smithi171 bash[25040]: cluster 2024-09-14T04:50:16.483960+0000 mgr.a (mgr.14355) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:17 smithi007 bash[22722]: cluster 2024-09-14T04:50:16.483960+0000 mgr.a (mgr.14355) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:18 smithi131 bash[24745]: audit 2024-09-14T04:50:18.439211+0000 mgr.a (mgr.14355) 16840 : audit [DBG] from='client.362763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:18 smithi171 bash[25040]: audit 2024-09-14T04:50:18.439211+0000 mgr.a (mgr.14355) 16840 : audit [DBG] from='client.362763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:18.864 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:18.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:18 smithi007 bash[22722]: audit 2024-09-14T04:50:18.439211+0000 mgr.a (mgr.14355) 16840 : audit [DBG] from='client.362763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:19 smithi131 bash[24745]: cluster 2024-09-14T04:50:18.484636+0000 mgr.a (mgr.14355) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:19 smithi171 bash[25040]: cluster 2024-09-14T04:50:18.484636+0000 mgr.a (mgr.14355) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:19 smithi007 bash[22722]: cluster 2024-09-14T04:50:18.484636+0000 mgr.a (mgr.14355) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:21 smithi131 bash[24745]: cluster 2024-09-14T04:50:20.486529+0000 mgr.a (mgr.14355) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:21 smithi171 bash[25040]: cluster 2024-09-14T04:50:20.486529+0000 mgr.a (mgr.14355) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:21 smithi007 bash[22722]: cluster 2024-09-14T04:50:20.486529+0000 mgr.a (mgr.14355) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:50:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:23 smithi131 bash[24745]: cluster 2024-09-14T04:50:22.487792+0000 mgr.a (mgr.14355) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:50:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:23 smithi171 bash[25040]: cluster 2024-09-14T04:50:22.487792+0000 mgr.a (mgr.14355) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:50:23.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:23.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:23.867 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:23 smithi007 bash[22722]: cluster 2024-09-14T04:50:22.487792+0000 mgr.a (mgr.14355) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:50:24.650 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:24.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:24 smithi171 bash[25040]: audit 2024-09-14T04:50:24.201066+0000 mgr.a (mgr.14355) 16844 : audit [DBG] from='client.362841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:24 smithi007 bash[22722]: audit 2024-09-14T04:50:24.201066+0000 mgr.a (mgr.14355) 16844 : audit [DBG] from='client.362841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:24 smithi131 bash[24745]: audit 2024-09-14T04:50:24.201066+0000 mgr.a (mgr.14355) 16844 : audit [DBG] from='client.362841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:25 smithi171 bash[25040]: cluster 2024-09-14T04:50:24.488416+0000 mgr.a (mgr.14355) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:25 smithi007 bash[22722]: cluster 2024-09-14T04:50:24.488416+0000 mgr.a (mgr.14355) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:25 smithi131 bash[24745]: cluster 2024-09-14T04:50:24.488416+0000 mgr.a (mgr.14355) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:27 smithi171 bash[25040]: cluster 2024-09-14T04:50:26.490741+0000 mgr.a (mgr.14355) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:27 smithi007 bash[22722]: cluster 2024-09-14T04:50:26.490741+0000 mgr.a (mgr.14355) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:27 smithi131 bash[24745]: cluster 2024-09-14T04:50:26.490741+0000 mgr.a (mgr.14355) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:29.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:29.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:29.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:29 smithi171 bash[25040]: cluster 2024-09-14T04:50:28.491531+0000 mgr.a (mgr.14355) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:29 smithi007 bash[22722]: cluster 2024-09-14T04:50:28.491531+0000 mgr.a (mgr.14355) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:29 smithi131 bash[24745]: cluster 2024-09-14T04:50:28.491531+0000 mgr.a (mgr.14355) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:30.431 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:30.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:30.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:30.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:30.432 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:30 smithi007 bash[22722]: audit 2024-09-14T04:50:29.984809+0000 mgr.a (mgr.14355) 16848 : audit [DBG] from='client.362919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:30 smithi131 bash[24745]: audit 2024-09-14T04:50:29.984809+0000 mgr.a (mgr.14355) 16848 : audit [DBG] from='client.362919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:30 smithi171 bash[25040]: audit 2024-09-14T04:50:29.984809+0000 mgr.a (mgr.14355) 16848 : audit [DBG] from='client.362919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:31 smithi007 bash[22722]: cluster 2024-09-14T04:50:30.493556+0000 mgr.a (mgr.14355) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:50:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:31 smithi131 bash[24745]: cluster 2024-09-14T04:50:30.493556+0000 mgr.a (mgr.14355) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:50:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:31 smithi171 bash[25040]: cluster 2024-09-14T04:50:30.493556+0000 mgr.a (mgr.14355) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:50:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:33 smithi007 bash[22722]: cluster 2024-09-14T04:50:32.494848+0000 mgr.a (mgr.14355) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:33 smithi131 bash[24745]: cluster 2024-09-14T04:50:32.494848+0000 mgr.a (mgr.14355) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:33 smithi171 bash[25040]: cluster 2024-09-14T04:50:32.494848+0000 mgr.a (mgr.14355) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:35 smithi007 bash[22722]: cluster 2024-09-14T04:50:34.495631+0000 mgr.a (mgr.14355) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:35 smithi131 bash[24745]: cluster 2024-09-14T04:50:34.495631+0000 mgr.a (mgr.14355) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:35 smithi171 bash[25040]: cluster 2024-09-14T04:50:34.495631+0000 mgr.a (mgr.14355) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:36.221 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:36.222 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:36 smithi007 bash[22722]: audit 2024-09-14T04:50:35.771029+0000 mgr.a (mgr.14355) 16852 : audit [DBG] from='client.362991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:36 smithi131 bash[24745]: audit 2024-09-14T04:50:35.771029+0000 mgr.a (mgr.14355) 16852 : audit [DBG] from='client.362991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:36 smithi171 bash[25040]: audit 2024-09-14T04:50:35.771029+0000 mgr.a (mgr.14355) 16852 : audit [DBG] from='client.362991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:37 smithi007 bash[22722]: cluster 2024-09-14T04:50:36.498393+0000 mgr.a (mgr.14355) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:37 smithi131 bash[24745]: cluster 2024-09-14T04:50:36.498393+0000 mgr.a (mgr.14355) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:37 smithi171 bash[25040]: cluster 2024-09-14T04:50:36.498393+0000 mgr.a (mgr.14355) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:39 smithi007 bash[22722]: cluster 2024-09-14T04:50:38.499150+0000 mgr.a (mgr.14355) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:39 smithi131 bash[24745]: cluster 2024-09-14T04:50:38.499150+0000 mgr.a (mgr.14355) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:39 smithi171 bash[25040]: cluster 2024-09-14T04:50:38.499150+0000 mgr.a (mgr.14355) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:50:41.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:41.224 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:41 smithi007 bash[22722]: cluster 2024-09-14T04:50:40.500706+0000 mgr.a (mgr.14355) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:41.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:41 smithi131 bash[24745]: cluster 2024-09-14T04:50:40.500706+0000 mgr.a (mgr.14355) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:41 smithi171 bash[25040]: cluster 2024-09-14T04:50:40.500706+0000 mgr.a (mgr.14355) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T04:50:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:42 smithi007 bash[22722]: audit 2024-09-14T04:50:41.552321+0000 mgr.a (mgr.14355) 16856 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:42 smithi131 bash[24745]: audit 2024-09-14T04:50:41.552321+0000 mgr.a (mgr.14355) 16856 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:42 smithi171 bash[25040]: audit 2024-09-14T04:50:41.552321+0000 mgr.a (mgr.14355) 16856 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:43 smithi007 bash[22722]: cluster 2024-09-14T04:50:42.502507+0000 mgr.a (mgr.14355) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:50:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:43 smithi131 bash[24745]: cluster 2024-09-14T04:50:42.502507+0000 mgr.a (mgr.14355) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:50:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:43 smithi171 bash[25040]: cluster 2024-09-14T04:50:42.502507+0000 mgr.a (mgr.14355) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:50:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:45 smithi007 bash[22722]: cluster 2024-09-14T04:50:44.503278+0000 mgr.a (mgr.14355) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:45 smithi131 bash[24745]: cluster 2024-09-14T04:50:44.503278+0000 mgr.a (mgr.14355) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:45 smithi171 bash[25040]: cluster 2024-09-14T04:50:44.503278+0000 mgr.a (mgr.14355) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:50:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:46.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:46.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:47.753 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:47.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:47 smithi007 bash[22722]: cluster 2024-09-14T04:50:46.505344+0000 mgr.a (mgr.14355) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:47 smithi007 bash[22722]: audit 2024-09-14T04:50:47.318786+0000 mgr.a (mgr.14355) 16860 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:47 smithi131 bash[24745]: cluster 2024-09-14T04:50:46.505344+0000 mgr.a (mgr.14355) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:47 smithi131 bash[24745]: audit 2024-09-14T04:50:47.318786+0000 mgr.a (mgr.14355) 16860 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:47 smithi171 bash[25040]: cluster 2024-09-14T04:50:46.505344+0000 mgr.a (mgr.14355) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:47 smithi171 bash[25040]: audit 2024-09-14T04:50:47.318786+0000 mgr.a (mgr.14355) 16860 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:49 smithi007 bash[22722]: cluster 2024-09-14T04:50:48.506335+0000 mgr.a (mgr.14355) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:49 smithi131 bash[24745]: cluster 2024-09-14T04:50:48.506335+0000 mgr.a (mgr.14355) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:49 smithi171 bash[25040]: cluster 2024-09-14T04:50:48.506335+0000 mgr.a (mgr.14355) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:52 smithi007 bash[22722]: cluster 2024-09-14T04:50:50.508359+0000 mgr.a (mgr.14355) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:50:52.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:52.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:52 smithi131 bash[24745]: cluster 2024-09-14T04:50:50.508359+0000 mgr.a (mgr.14355) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:50:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:52 smithi171 bash[25040]: cluster 2024-09-14T04:50:50.508359+0000 mgr.a (mgr.14355) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:50:53.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:50:53.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:53.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:53.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:53.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:54 smithi007 bash[22722]: cluster 2024-09-14T04:50:52.509630+0000 mgr.a (mgr.14355) 16863 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:54 smithi007 bash[22722]: audit 2024-09-14T04:50:53.087705+0000 mgr.a (mgr.14355) 16864 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:54 smithi131 bash[24745]: cluster 2024-09-14T04:50:52.509630+0000 mgr.a (mgr.14355) 16863 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:54 smithi131 bash[24745]: audit 2024-09-14T04:50:53.087705+0000 mgr.a (mgr.14355) 16864 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:54 smithi171 bash[25040]: cluster 2024-09-14T04:50:52.509630+0000 mgr.a (mgr.14355) 16863 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:50:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:54 smithi171 bash[25040]: audit 2024-09-14T04:50:53.087705+0000 mgr.a (mgr.14355) 16864 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:50:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:56 smithi007 bash[22722]: cluster 2024-09-14T04:50:54.510570+0000 mgr.a (mgr.14355) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:56 smithi131 bash[24745]: cluster 2024-09-14T04:50:54.510570+0000 mgr.a (mgr.14355) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:56 smithi171 bash[25040]: cluster 2024-09-14T04:50:54.510570+0000 mgr.a (mgr.14355) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:50:58.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:50:58.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:50:58.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:50:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:50:58 smithi007 bash[22722]: cluster 2024-09-14T04:50:56.512818+0000 mgr.a (mgr.14355) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:50:58 smithi131 bash[24745]: cluster 2024-09-14T04:50:56.512818+0000 mgr.a (mgr.14355) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:50:58 smithi171 bash[25040]: cluster 2024-09-14T04:50:56.512818+0000 mgr.a (mgr.14355) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:50:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:50:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:50:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:50:59.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:50:59.294 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:00 smithi007 bash[22722]: cluster 2024-09-14T04:50:58.513516+0000 mgr.a (mgr.14355) 16867 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:00 smithi007 bash[22722]: audit 2024-09-14T04:50:58.845054+0000 mgr.a (mgr.14355) 16868 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:00 smithi131 bash[24745]: cluster 2024-09-14T04:50:58.513516+0000 mgr.a (mgr.14355) 16867 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:00 smithi131 bash[24745]: audit 2024-09-14T04:50:58.845054+0000 mgr.a (mgr.14355) 16868 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:00 smithi171 bash[25040]: cluster 2024-09-14T04:50:58.513516+0000 mgr.a (mgr.14355) 16867 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:00 smithi171 bash[25040]: audit 2024-09-14T04:50:58.845054+0000 mgr.a (mgr.14355) 16868 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:02 smithi007 bash[22722]: cluster 2024-09-14T04:51:00.515440+0000 mgr.a (mgr.14355) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:02 smithi131 bash[24745]: cluster 2024-09-14T04:51:00.515440+0000 mgr.a (mgr.14355) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:02 smithi171 bash[25040]: cluster 2024-09-14T04:51:00.515440+0000 mgr.a (mgr.14355) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:04.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:04.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:04.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:04 smithi007 bash[22722]: cluster 2024-09-14T04:51:02.516723+0000 mgr.a (mgr.14355) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:04 smithi131 bash[24745]: cluster 2024-09-14T04:51:02.516723+0000 mgr.a (mgr.14355) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:04 smithi171 bash[25040]: cluster 2024-09-14T04:51:02.516723+0000 mgr.a (mgr.14355) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:05.044 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:05.044 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:06 smithi007 bash[22722]: cluster 2024-09-14T04:51:04.517478+0000 mgr.a (mgr.14355) 16871 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:06 smithi007 bash[22722]: audit 2024-09-14T04:51:04.630773+0000 mgr.a (mgr.14355) 16872 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:06 smithi131 bash[24745]: cluster 2024-09-14T04:51:04.517478+0000 mgr.a (mgr.14355) 16871 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:06 smithi131 bash[24745]: audit 2024-09-14T04:51:04.630773+0000 mgr.a (mgr.14355) 16872 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:06 smithi171 bash[25040]: cluster 2024-09-14T04:51:04.517478+0000 mgr.a (mgr.14355) 16871 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:06 smithi171 bash[25040]: audit 2024-09-14T04:51:04.630773+0000 mgr.a (mgr.14355) 16872 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:08 smithi007 bash[22722]: cluster 2024-09-14T04:51:06.519996+0000 mgr.a (mgr.14355) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:08 smithi007 bash[22722]: audit 2024-09-14T04:51:08.123080+0000 mon.a (mon.0) 3106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:51:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:08 smithi131 bash[24745]: cluster 2024-09-14T04:51:06.519996+0000 mgr.a (mgr.14355) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:08 smithi131 bash[24745]: audit 2024-09-14T04:51:08.123080+0000 mon.a (mon.0) 3106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:51:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:08 smithi171 bash[25040]: cluster 2024-09-14T04:51:06.519996+0000 mgr.a (mgr.14355) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:08 smithi171 bash[25040]: audit 2024-09-14T04:51:08.123080+0000 mon.a (mon.0) 3106 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:51:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22722]: audit 2024-09-14T04:51:08.961940+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:51:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22722]: audit 2024-09-14T04:51:08.963412+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:51:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22722]: audit 2024-09-14T04:51:08.973247+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:51:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22722]: audit 2024-09-14T04:51:08.978004+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:09 smithi131 bash[24745]: audit 2024-09-14T04:51:08.961940+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:51:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:09 smithi131 bash[24745]: audit 2024-09-14T04:51:08.963412+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:51:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:09 smithi131 bash[24745]: audit 2024-09-14T04:51:08.973247+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:51:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:09 smithi131 bash[24745]: audit 2024-09-14T04:51:08.978004+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:09 smithi171 bash[25040]: audit 2024-09-14T04:51:08.961940+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:51:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:09 smithi171 bash[25040]: audit 2024-09-14T04:51:08.963412+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:51:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:09 smithi171 bash[25040]: audit 2024-09-14T04:51:08.973247+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:51:09.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:09 smithi171 bash[25040]: audit 2024-09-14T04:51:08.978004+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22972]: debug 2024-09-14T04:51:09.738+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:51:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:51:09 smithi007 bash[22972]: debug 2024-09-14T04:51:09.738+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:51:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:10 smithi007 bash[22722]: cluster 2024-09-14T04:51:08.520777+0000 mgr.a (mgr.14355) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:10 smithi007 bash[22722]: audit 2024-09-14T04:51:08.979010+0000 mgr.a (mgr.14355) 16875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:10.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:10.782 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:10 smithi131 bash[24745]: cluster 2024-09-14T04:51:08.520777+0000 mgr.a (mgr.14355) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:10 smithi131 bash[24745]: audit 2024-09-14T04:51:08.979010+0000 mgr.a (mgr.14355) 16875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:10 smithi171 bash[25040]: cluster 2024-09-14T04:51:08.520777+0000 mgr.a (mgr.14355) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:10 smithi171 bash[25040]: audit 2024-09-14T04:51:08.979010+0000 mgr.a (mgr.14355) 16875 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:51:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:11 smithi007 bash[22722]: audit 2024-09-14T04:51:09.738302+0000 mgr.a (mgr.14355) 16876 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:51:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:11 smithi007 bash[22722]: cephadm 2024-09-14T04:51:09.739787+0000 mgr.a (mgr.14355) 16877 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:51:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:11 smithi007 bash[22722]: audit 2024-09-14T04:51:10.370669+0000 mgr.a (mgr.14355) 16878 : audit [DBG] from='client.363555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:11 smithi131 bash[24745]: audit 2024-09-14T04:51:09.738302+0000 mgr.a (mgr.14355) 16876 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:51:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:11 smithi131 bash[24745]: cephadm 2024-09-14T04:51:09.739787+0000 mgr.a (mgr.14355) 16877 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:51:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:11 smithi131 bash[24745]: audit 2024-09-14T04:51:10.370669+0000 mgr.a (mgr.14355) 16878 : audit [DBG] from='client.363555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:11 smithi171 bash[25040]: audit 2024-09-14T04:51:09.738302+0000 mgr.a (mgr.14355) 16876 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:51:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:11 smithi171 bash[25040]: cephadm 2024-09-14T04:51:09.739787+0000 mgr.a (mgr.14355) 16877 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:51:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:11 smithi171 bash[25040]: audit 2024-09-14T04:51:10.370669+0000 mgr.a (mgr.14355) 16878 : audit [DBG] from='client.363555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:12 smithi007 bash[22722]: cluster 2024-09-14T04:51:10.521964+0000 mgr.a (mgr.14355) 16879 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:51:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:12 smithi131 bash[24745]: cluster 2024-09-14T04:51:10.521964+0000 mgr.a (mgr.14355) 16879 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:51:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:12 smithi171 bash[25040]: cluster 2024-09-14T04:51:10.521964+0000 mgr.a (mgr.14355) 16879 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:51:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:14 smithi007 bash[22722]: cluster 2024-09-14T04:51:12.523668+0000 mgr.a (mgr.14355) 16880 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:14 smithi131 bash[24745]: cluster 2024-09-14T04:51:12.523668+0000 mgr.a (mgr.14355) 16880 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:14 smithi171 bash[25040]: cluster 2024-09-14T04:51:12.523668+0000 mgr.a (mgr.14355) 16880 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:15.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:15.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:16.562 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:16 smithi007 bash[22722]: cluster 2024-09-14T04:51:14.524448+0000 mgr.a (mgr.14355) 16881 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:16 smithi131 bash[24745]: cluster 2024-09-14T04:51:14.524448+0000 mgr.a (mgr.14355) 16881 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:16 smithi171 bash[25040]: cluster 2024-09-14T04:51:14.524448+0000 mgr.a (mgr.14355) 16881 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:17.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:17 smithi007 bash[22722]: audit 2024-09-14T04:51:16.116281+0000 mgr.a (mgr.14355) 16882 : audit [DBG] from='client.363630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:17 smithi131 bash[24745]: audit 2024-09-14T04:51:16.116281+0000 mgr.a (mgr.14355) 16882 : audit [DBG] from='client.363630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:17 smithi171 bash[25040]: audit 2024-09-14T04:51:16.116281+0000 mgr.a (mgr.14355) 16882 : audit [DBG] from='client.363630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:18 smithi007 bash[22722]: cluster 2024-09-14T04:51:16.525816+0000 mgr.a (mgr.14355) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:51:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:18 smithi131 bash[24745]: cluster 2024-09-14T04:51:16.525816+0000 mgr.a (mgr.14355) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:51:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:18 smithi171 bash[25040]: cluster 2024-09-14T04:51:16.525816+0000 mgr.a (mgr.14355) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:51:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:20 smithi007 bash[22722]: cluster 2024-09-14T04:51:18.526538+0000 mgr.a (mgr.14355) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:20 smithi131 bash[24745]: cluster 2024-09-14T04:51:18.526538+0000 mgr.a (mgr.14355) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:20 smithi171 bash[25040]: cluster 2024-09-14T04:51:18.526538+0000 mgr.a (mgr.14355) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:21.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:21.564 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:22.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:22.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:22 smithi007 bash[22722]: cluster 2024-09-14T04:51:20.528186+0000 mgr.a (mgr.14355) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:22 smithi131 bash[24745]: cluster 2024-09-14T04:51:20.528186+0000 mgr.a (mgr.14355) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:22 smithi171 bash[25040]: cluster 2024-09-14T04:51:20.528186+0000 mgr.a (mgr.14355) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:51:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:23 smithi007 bash[22722]: audit 2024-09-14T04:51:21.896254+0000 mgr.a (mgr.14355) 16886 : audit [DBG] from='client.363702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:23 smithi131 bash[24745]: audit 2024-09-14T04:51:21.896254+0000 mgr.a (mgr.14355) 16886 : audit [DBG] from='client.363702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:23 smithi171 bash[25040]: audit 2024-09-14T04:51:21.896254+0000 mgr.a (mgr.14355) 16886 : audit [DBG] from='client.363702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:24 smithi007 bash[22722]: cluster 2024-09-14T04:51:22.529931+0000 mgr.a (mgr.14355) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:51:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:24 smithi131 bash[24745]: cluster 2024-09-14T04:51:22.529931+0000 mgr.a (mgr.14355) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:51:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:24 smithi171 bash[25040]: cluster 2024-09-14T04:51:22.529931+0000 mgr.a (mgr.14355) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:51:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:26 smithi007 bash[22722]: cluster 2024-09-14T04:51:24.530873+0000 mgr.a (mgr.14355) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:26 smithi131 bash[24745]: cluster 2024-09-14T04:51:24.530873+0000 mgr.a (mgr.14355) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:26 smithi171 bash[25040]: cluster 2024-09-14T04:51:24.530873+0000 mgr.a (mgr.14355) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:27.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:28.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:28 smithi007 bash[22722]: cluster 2024-09-14T04:51:26.533103+0000 mgr.a (mgr.14355) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:28 smithi131 bash[24745]: cluster 2024-09-14T04:51:26.533103+0000 mgr.a (mgr.14355) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:28 smithi171 bash[25040]: cluster 2024-09-14T04:51:26.533103+0000 mgr.a (mgr.14355) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:29 smithi007 bash[22722]: audit 2024-09-14T04:51:27.672045+0000 mgr.a (mgr.14355) 16890 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:29 smithi131 bash[24745]: audit 2024-09-14T04:51:27.672045+0000 mgr.a (mgr.14355) 16890 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:29 smithi171 bash[25040]: audit 2024-09-14T04:51:27.672045+0000 mgr.a (mgr.14355) 16890 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:30 smithi007 bash[22722]: cluster 2024-09-14T04:51:28.534088+0000 mgr.a (mgr.14355) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:30 smithi131 bash[24745]: cluster 2024-09-14T04:51:28.534088+0000 mgr.a (mgr.14355) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:30 smithi171 bash[25040]: cluster 2024-09-14T04:51:28.534088+0000 mgr.a (mgr.14355) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:32 smithi007 bash[22722]: cluster 2024-09-14T04:51:30.535962+0000 mgr.a (mgr.14355) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:32 smithi131 bash[24745]: cluster 2024-09-14T04:51:30.535962+0000 mgr.a (mgr.14355) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:32 smithi171 bash[25040]: cluster 2024-09-14T04:51:30.535962+0000 mgr.a (mgr.14355) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T04:51:33.112 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:33.113 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:33.844 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:34 smithi007 bash[22722]: cluster 2024-09-14T04:51:32.537179+0000 mgr.a (mgr.14355) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:34 smithi007 bash[22722]: audit 2024-09-14T04:51:33.436749+0000 mgr.a (mgr.14355) 16894 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:34 smithi131 bash[24745]: cluster 2024-09-14T04:51:32.537179+0000 mgr.a (mgr.14355) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:34 smithi131 bash[24745]: audit 2024-09-14T04:51:33.436749+0000 mgr.a (mgr.14355) 16894 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:34 smithi171 bash[25040]: cluster 2024-09-14T04:51:32.537179+0000 mgr.a (mgr.14355) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:34 smithi171 bash[25040]: audit 2024-09-14T04:51:33.436749+0000 mgr.a (mgr.14355) 16894 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:36 smithi007 bash[22722]: cluster 2024-09-14T04:51:34.538087+0000 mgr.a (mgr.14355) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:36 smithi131 bash[24745]: cluster 2024-09-14T04:51:34.538087+0000 mgr.a (mgr.14355) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:36 smithi171 bash[25040]: cluster 2024-09-14T04:51:34.538087+0000 mgr.a (mgr.14355) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:38 smithi007 bash[22722]: cluster 2024-09-14T04:51:36.540378+0000 mgr.a (mgr.14355) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:38 smithi131 bash[24745]: cluster 2024-09-14T04:51:36.540378+0000 mgr.a (mgr.14355) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:38 smithi171 bash[25040]: cluster 2024-09-14T04:51:36.540378+0000 mgr.a (mgr.14355) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:38.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:38.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:39.588 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:39.589 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:40 smithi131 bash[24745]: cluster 2024-09-14T04:51:38.541191+0000 mgr.a (mgr.14355) 16897 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:40 smithi131 bash[24745]: audit 2024-09-14T04:51:39.175904+0000 mgr.a (mgr.14355) 16898 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:40 smithi171 bash[25040]: cluster 2024-09-14T04:51:38.541191+0000 mgr.a (mgr.14355) 16897 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:40 smithi171 bash[25040]: audit 2024-09-14T04:51:39.175904+0000 mgr.a (mgr.14355) 16898 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:40 smithi007 bash[22722]: cluster 2024-09-14T04:51:38.541191+0000 mgr.a (mgr.14355) 16897 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:40 smithi007 bash[22722]: audit 2024-09-14T04:51:39.175904+0000 mgr.a (mgr.14355) 16898 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:42 smithi131 bash[24745]: cluster 2024-09-14T04:51:40.543601+0000 mgr.a (mgr.14355) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:42 smithi171 bash[25040]: cluster 2024-09-14T04:51:40.543601+0000 mgr.a (mgr.14355) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:42 smithi007 bash[22722]: cluster 2024-09-14T04:51:40.543601+0000 mgr.a (mgr.14355) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:51:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:44.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:44.591 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:44 smithi131 bash[24745]: cluster 2024-09-14T04:51:42.544393+0000 mgr.a (mgr.14355) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:44 smithi171 bash[25040]: cluster 2024-09-14T04:51:42.544393+0000 mgr.a (mgr.14355) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:44 smithi007 bash[22722]: cluster 2024-09-14T04:51:42.544393+0000 mgr.a (mgr.14355) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T04:51:45.359 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:45.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:45.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:45.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:45.360 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:46 smithi131 bash[24745]: cluster 2024-09-14T04:51:44.545360+0000 mgr.a (mgr.14355) 16901 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:46 smithi131 bash[24745]: audit 2024-09-14T04:51:44.920865+0000 mgr.a (mgr.14355) 16902 : audit [DBG] from='client.364008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:46 smithi171 bash[25040]: cluster 2024-09-14T04:51:44.545360+0000 mgr.a (mgr.14355) 16901 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:46 smithi171 bash[25040]: audit 2024-09-14T04:51:44.920865+0000 mgr.a (mgr.14355) 16902 : audit [DBG] from='client.364008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:46 smithi007 bash[22722]: cluster 2024-09-14T04:51:44.545360+0000 mgr.a (mgr.14355) 16901 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:46.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:46 smithi007 bash[22722]: audit 2024-09-14T04:51:44.920865+0000 mgr.a (mgr.14355) 16902 : audit [DBG] from='client.364008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:48 smithi131 bash[24745]: cluster 2024-09-14T04:51:46.548312+0000 mgr.a (mgr.14355) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:51:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:48 smithi171 bash[25040]: cluster 2024-09-14T04:51:46.548312+0000 mgr.a (mgr.14355) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:51:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:48 smithi007 bash[22722]: cluster 2024-09-14T04:51:46.548312+0000 mgr.a (mgr.14355) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T04:51:50.361 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:50 smithi131 bash[24745]: cluster 2024-09-14T04:51:48.549127+0000 mgr.a (mgr.14355) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:51:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:50 smithi171 bash[25040]: cluster 2024-09-14T04:51:48.549127+0000 mgr.a (mgr.14355) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:51:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:50 smithi007 bash[22722]: cluster 2024-09-14T04:51:48.549127+0000 mgr.a (mgr.14355) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T04:51:51.141 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:51.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:51.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:51.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:51.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:52 smithi131 bash[24745]: cluster 2024-09-14T04:51:50.551028+0000 mgr.a (mgr.14355) 16905 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:52 smithi131 bash[24745]: audit 2024-09-14T04:51:50.695214+0000 mgr.a (mgr.14355) 16906 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:52 smithi171 bash[25040]: cluster 2024-09-14T04:51:50.551028+0000 mgr.a (mgr.14355) 16905 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:52 smithi171 bash[25040]: audit 2024-09-14T04:51:50.695214+0000 mgr.a (mgr.14355) 16906 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:52.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:52 smithi007 bash[22722]: cluster 2024-09-14T04:51:50.551028+0000 mgr.a (mgr.14355) 16905 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:52.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:52 smithi007 bash[22722]: audit 2024-09-14T04:51:50.695214+0000 mgr.a (mgr.14355) 16906 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:54 smithi131 bash[24745]: cluster 2024-09-14T04:51:52.551941+0000 mgr.a (mgr.14355) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:51:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:54 smithi171 bash[25040]: cluster 2024-09-14T04:51:52.551941+0000 mgr.a (mgr.14355) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:51:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:54 smithi007 bash[22722]: cluster 2024-09-14T04:51:52.551941+0000 mgr.a (mgr.14355) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:51:56.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:51:56.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:51:56.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:51:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:56 smithi131 bash[24745]: cluster 2024-09-14T04:51:54.552696+0000 mgr.a (mgr.14355) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:51:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:56 smithi171 bash[25040]: cluster 2024-09-14T04:51:54.552696+0000 mgr.a (mgr.14355) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:51:56.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:51:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:51:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:51:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:51:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:51:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:56 smithi007 bash[22722]: cluster 2024-09-14T04:51:54.552696+0000 mgr.a (mgr.14355) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:51:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:57 smithi131 bash[24745]: audit 2024-09-14T04:51:56.472241+0000 mgr.a (mgr.14355) 16909 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:57 smithi171 bash[25040]: audit 2024-09-14T04:51:56.472241+0000 mgr.a (mgr.14355) 16909 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:57 smithi007 bash[22722]: audit 2024-09-14T04:51:56.472241+0000 mgr.a (mgr.14355) 16909 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:51:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:58 smithi131 bash[24745]: cluster 2024-09-14T04:51:56.554177+0000 mgr.a (mgr.14355) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:58 smithi171 bash[25040]: cluster 2024-09-14T04:51:56.554177+0000 mgr.a (mgr.14355) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:58 smithi007 bash[22722]: cluster 2024-09-14T04:51:56.554177+0000 mgr.a (mgr.14355) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:51:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:51:59 smithi131 bash[24745]: cluster 2024-09-14T04:51:58.555058+0000 mgr.a (mgr.14355) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:51:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:51:59 smithi171 bash[25040]: cluster 2024-09-14T04:51:58.555058+0000 mgr.a (mgr.14355) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:51:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:51:59 smithi007 bash[22722]: cluster 2024-09-14T04:51:58.555058+0000 mgr.a (mgr.14355) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T04:52:01.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:01.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:01.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:01 smithi007 bash[22722]: cluster 2024-09-14T04:52:00.557326+0000 mgr.a (mgr.14355) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:01 smithi131 bash[24745]: cluster 2024-09-14T04:52:00.557326+0000 mgr.a (mgr.14355) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:01 smithi171 bash[25040]: cluster 2024-09-14T04:52:00.557326+0000 mgr.a (mgr.14355) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:02.661 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:02.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:02 smithi007 bash[22722]: audit 2024-09-14T04:52:02.236957+0000 mgr.a (mgr.14355) 16913 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:02 smithi131 bash[24745]: audit 2024-09-14T04:52:02.236957+0000 mgr.a (mgr.14355) 16913 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:02 smithi171 bash[25040]: audit 2024-09-14T04:52:02.236957+0000 mgr.a (mgr.14355) 16913 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:03 smithi007 bash[22722]: cluster 2024-09-14T04:52:02.560464+0000 mgr.a (mgr.14355) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:03 smithi131 bash[24745]: cluster 2024-09-14T04:52:02.560464+0000 mgr.a (mgr.14355) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:03 smithi171 bash[25040]: cluster 2024-09-14T04:52:02.560464+0000 mgr.a (mgr.14355) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:05 smithi007 bash[22722]: cluster 2024-09-14T04:52:04.561252+0000 mgr.a (mgr.14355) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:05 smithi131 bash[24745]: cluster 2024-09-14T04:52:04.561252+0000 mgr.a (mgr.14355) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:05 smithi171 bash[25040]: cluster 2024-09-14T04:52:04.561252+0000 mgr.a (mgr.14355) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T04:52:07.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:07.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:07.664 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:07 smithi007 bash[22722]: cluster 2024-09-14T04:52:06.563508+0000 mgr.a (mgr.14355) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:07 smithi131 bash[24745]: cluster 2024-09-14T04:52:06.563508+0000 mgr.a (mgr.14355) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:07 smithi171 bash[25040]: cluster 2024-09-14T04:52:06.563508+0000 mgr.a (mgr.14355) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:08.444 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:08 smithi007 bash[22722]: audit 2024-09-14T04:52:07.997998+0000 mgr.a (mgr.14355) 16917 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:08 smithi131 bash[24745]: audit 2024-09-14T04:52:07.997998+0000 mgr.a (mgr.14355) 16917 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:08 smithi171 bash[25040]: audit 2024-09-14T04:52:07.997998+0000 mgr.a (mgr.14355) 16917 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:09 smithi007 bash[22722]: cluster 2024-09-14T04:52:08.564499+0000 mgr.a (mgr.14355) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:52:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:09 smithi131 bash[24745]: cluster 2024-09-14T04:52:08.564499+0000 mgr.a (mgr.14355) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:52:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:09 smithi171 bash[25040]: cluster 2024-09-14T04:52:08.564499+0000 mgr.a (mgr.14355) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T04:52:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:10 smithi007 bash[22722]: audit 2024-09-14T04:52:09.796055+0000 mon.a (mon.0) 3111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:52:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:10 smithi131 bash[24745]: audit 2024-09-14T04:52:09.796055+0000 mon.a (mon.0) 3111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:52:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:10 smithi171 bash[25040]: audit 2024-09-14T04:52:09.796055+0000 mon.a (mon.0) 3111 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22972]: debug 2024-09-14T04:52:11.421+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22972]: debug 2024-09-14T04:52:11.425+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: cluster 2024-09-14T04:52:10.566708+0000 mgr.a (mgr.14355) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:10.647581+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:10.649300+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:10.660527+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:52:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:10.662834+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:11.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:10.665260+0000 mgr.a (mgr.14355) 16920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:11.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: audit 2024-09-14T04:52:11.425856+0000 mgr.a (mgr.14355) 16921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:52:11.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:11 smithi007 bash[22722]: cephadm 2024-09-14T04:52:11.428024+0000 mgr.a (mgr.14355) 16922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:52:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: cluster 2024-09-14T04:52:10.566708+0000 mgr.a (mgr.14355) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:10.647581+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:10.649300+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:10.660527+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:10.662834+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:10.665260+0000 mgr.a (mgr.14355) 16920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: audit 2024-09-14T04:52:11.425856+0000 mgr.a (mgr.14355) 16921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:52:12.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:11 smithi131 bash[24745]: cephadm 2024-09-14T04:52:11.428024+0000 mgr.a (mgr.14355) 16922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:52:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: cluster 2024-09-14T04:52:10.566708+0000 mgr.a (mgr.14355) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:10.647581+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:10.649300+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:10.660527+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:10.662834+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:10.665260+0000 mgr.a (mgr.14355) 16920 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: audit 2024-09-14T04:52:11.425856+0000 mgr.a (mgr.14355) 16921 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:52:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:11 smithi171 bash[25040]: cephadm 2024-09-14T04:52:11.428024+0000 mgr.a (mgr.14355) 16922 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:52:13.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:13.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:13.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:13 smithi007 bash[22722]: cluster 2024-09-14T04:52:12.567591+0000 mgr.a (mgr.14355) 16923 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:13 smithi131 bash[24745]: cluster 2024-09-14T04:52:12.567591+0000 mgr.a (mgr.14355) 16923 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:13 smithi171 bash[25040]: cluster 2024-09-14T04:52:12.567591+0000 mgr.a (mgr.14355) 16923 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:14.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:14.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:14.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:14.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:14.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:14 smithi007 bash[22722]: audit 2024-09-14T04:52:13.780696+0000 mgr.a (mgr.14355) 16924 : audit [DBG] from='client.364503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:14 smithi131 bash[24745]: audit 2024-09-14T04:52:13.780696+0000 mgr.a (mgr.14355) 16924 : audit [DBG] from='client.364503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:14 smithi171 bash[25040]: audit 2024-09-14T04:52:13.780696+0000 mgr.a (mgr.14355) 16924 : audit [DBG] from='client.364503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:15 smithi007 bash[22722]: cluster 2024-09-14T04:52:14.568467+0000 mgr.a (mgr.14355) 16925 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:15 smithi131 bash[24745]: cluster 2024-09-14T04:52:14.568467+0000 mgr.a (mgr.14355) 16925 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:15 smithi171 bash[25040]: cluster 2024-09-14T04:52:14.568467+0000 mgr.a (mgr.14355) 16925 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-14T04:52:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:17 smithi007 bash[22722]: cluster 2024-09-14T04:52:16.570731+0000 mgr.a (mgr.14355) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T04:52:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:17 smithi131 bash[24745]: cluster 2024-09-14T04:52:16.570731+0000 mgr.a (mgr.14355) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T04:52:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:17 smithi171 bash[25040]: cluster 2024-09-14T04:52:16.570731+0000 mgr.a (mgr.14355) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T04:52:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:19 smithi007 bash[22722]: cluster 2024-09-14T04:52:18.571506+0000 mgr.a (mgr.14355) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:19.980 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:19.980 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:19 smithi131 bash[24745]: cluster 2024-09-14T04:52:18.571506+0000 mgr.a (mgr.14355) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:19 smithi171 bash[25040]: cluster 2024-09-14T04:52:18.571506+0000 mgr.a (mgr.14355) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:20 smithi007 bash[22722]: audit 2024-09-14T04:52:19.536033+0000 mgr.a (mgr.14355) 16928 : audit [DBG] from='client.364578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:20 smithi131 bash[24745]: audit 2024-09-14T04:52:19.536033+0000 mgr.a (mgr.14355) 16928 : audit [DBG] from='client.364578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:20 smithi171 bash[25040]: audit 2024-09-14T04:52:19.536033+0000 mgr.a (mgr.14355) 16928 : audit [DBG] from='client.364578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:21 smithi007 bash[22722]: cluster 2024-09-14T04:52:20.573956+0000 mgr.a (mgr.14355) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:21 smithi131 bash[24745]: cluster 2024-09-14T04:52:20.573956+0000 mgr.a (mgr.14355) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:21 smithi171 bash[25040]: cluster 2024-09-14T04:52:20.573956+0000 mgr.a (mgr.14355) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:23 smithi007 bash[22722]: cluster 2024-09-14T04:52:22.574956+0000 mgr.a (mgr.14355) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:23 smithi131 bash[24745]: cluster 2024-09-14T04:52:22.574956+0000 mgr.a (mgr.14355) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:23 smithi171 bash[25040]: cluster 2024-09-14T04:52:22.574956+0000 mgr.a (mgr.14355) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:24.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:24.982 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:24.983 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:25.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:25.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:25.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:25.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:25.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:25 smithi007 bash[22722]: cluster 2024-09-14T04:52:24.575745+0000 mgr.a (mgr.14355) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:25 smithi007 bash[22722]: audit 2024-09-14T04:52:25.316807+0000 mgr.a (mgr.14355) 16932 : audit [DBG] from='client.364656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:25 smithi131 bash[24745]: cluster 2024-09-14T04:52:24.575745+0000 mgr.a (mgr.14355) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:25 smithi131 bash[24745]: audit 2024-09-14T04:52:25.316807+0000 mgr.a (mgr.14355) 16932 : audit [DBG] from='client.364656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:25 smithi171 bash[25040]: cluster 2024-09-14T04:52:24.575745+0000 mgr.a (mgr.14355) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:52:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:25 smithi171 bash[25040]: audit 2024-09-14T04:52:25.316807+0000 mgr.a (mgr.14355) 16932 : audit [DBG] from='client.364656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:27 smithi007 bash[22722]: cluster 2024-09-14T04:52:26.578557+0000 mgr.a (mgr.14355) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:52:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:27 smithi131 bash[24745]: cluster 2024-09-14T04:52:26.578557+0000 mgr.a (mgr.14355) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:52:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:27 smithi171 bash[25040]: cluster 2024-09-14T04:52:26.578557+0000 mgr.a (mgr.14355) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T04:52:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:29 smithi007 bash[22722]: cluster 2024-09-14T04:52:28.579342+0000 mgr.a (mgr.14355) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:29 smithi131 bash[24745]: cluster 2024-09-14T04:52:28.579342+0000 mgr.a (mgr.14355) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:29 smithi171 bash[25040]: cluster 2024-09-14T04:52:28.579342+0000 mgr.a (mgr.14355) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:30.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:30.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:30.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:31.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:31.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:31.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:31.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:31.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:31 smithi131 bash[24745]: cluster 2024-09-14T04:52:30.581280+0000 mgr.a (mgr.14355) 16935 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:31 smithi131 bash[24745]: audit 2024-09-14T04:52:31.108522+0000 mgr.a (mgr.14355) 16936 : audit [DBG] from='client.364731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:31 smithi171 bash[25040]: cluster 2024-09-14T04:52:30.581280+0000 mgr.a (mgr.14355) 16935 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:31 smithi171 bash[25040]: audit 2024-09-14T04:52:31.108522+0000 mgr.a (mgr.14355) 16936 : audit [DBG] from='client.364731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:31 smithi007 bash[22722]: cluster 2024-09-14T04:52:30.581280+0000 mgr.a (mgr.14355) 16935 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:31 smithi007 bash[22722]: audit 2024-09-14T04:52:31.108522+0000 mgr.a (mgr.14355) 16936 : audit [DBG] from='client.364731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:33 smithi131 bash[24745]: cluster 2024-09-14T04:52:32.582159+0000 mgr.a (mgr.14355) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:33 smithi171 bash[25040]: cluster 2024-09-14T04:52:32.582159+0000 mgr.a (mgr.14355) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:33 smithi007 bash[22722]: cluster 2024-09-14T04:52:32.582159+0000 mgr.a (mgr.14355) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:35 smithi131 bash[24745]: cluster 2024-09-14T04:52:34.582947+0000 mgr.a (mgr.14355) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:35 smithi171 bash[25040]: cluster 2024-09-14T04:52:34.582947+0000 mgr.a (mgr.14355) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:35 smithi007 bash[22722]: cluster 2024-09-14T04:52:34.582947+0000 mgr.a (mgr.14355) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T04:52:36.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:36.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:37.308 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:37.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:38.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:37 smithi131 bash[24745]: cluster 2024-09-14T04:52:36.584395+0000 mgr.a (mgr.14355) 16939 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:38.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:37 smithi131 bash[24745]: audit 2024-09-14T04:52:36.882083+0000 mgr.a (mgr.14355) 16940 : audit [DBG] from='client.364806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:37 smithi171 bash[25040]: cluster 2024-09-14T04:52:36.584395+0000 mgr.a (mgr.14355) 16939 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:37 smithi171 bash[25040]: audit 2024-09-14T04:52:36.882083+0000 mgr.a (mgr.14355) 16940 : audit [DBG] from='client.364806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:37 smithi007 bash[22722]: cluster 2024-09-14T04:52:36.584395+0000 mgr.a (mgr.14355) 16939 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T04:52:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:37 smithi007 bash[22722]: audit 2024-09-14T04:52:36.882083+0000 mgr.a (mgr.14355) 16940 : audit [DBG] from='client.364806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:39 smithi131 bash[24745]: cluster 2024-09-14T04:52:38.585323+0000 mgr.a (mgr.14355) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:39 smithi171 bash[25040]: cluster 2024-09-14T04:52:38.585323+0000 mgr.a (mgr.14355) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:39 smithi007 bash[22722]: cluster 2024-09-14T04:52:38.585323+0000 mgr.a (mgr.14355) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:41 smithi131 bash[24745]: cluster 2024-09-14T04:52:40.587501+0000 mgr.a (mgr.14355) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:41 smithi171 bash[25040]: cluster 2024-09-14T04:52:40.587501+0000 mgr.a (mgr.14355) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:42.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:41 smithi007 bash[22722]: cluster 2024-09-14T04:52:40.587501+0000 mgr.a (mgr.14355) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:42.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:42.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:42.310 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:43.083 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:43 smithi131 bash[24745]: cluster 2024-09-14T04:52:42.588237+0000 mgr.a (mgr.14355) 16943 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:43 smithi131 bash[24745]: audit 2024-09-14T04:52:42.648742+0000 mgr.a (mgr.14355) 16944 : audit [DBG] from='client.364881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:43 smithi171 bash[25040]: cluster 2024-09-14T04:52:42.588237+0000 mgr.a (mgr.14355) 16943 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:43 smithi171 bash[25040]: audit 2024-09-14T04:52:42.648742+0000 mgr.a (mgr.14355) 16944 : audit [DBG] from='client.364881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:43 smithi007 bash[22722]: cluster 2024-09-14T04:52:42.588237+0000 mgr.a (mgr.14355) 16943 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:44.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:43 smithi007 bash[22722]: audit 2024-09-14T04:52:42.648742+0000 mgr.a (mgr.14355) 16944 : audit [DBG] from='client.364881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:45 smithi131 bash[24745]: cluster 2024-09-14T04:52:44.589176+0000 mgr.a (mgr.14355) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:45 smithi171 bash[25040]: cluster 2024-09-14T04:52:44.589176+0000 mgr.a (mgr.14355) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:45 smithi007 bash[22722]: cluster 2024-09-14T04:52:44.589176+0000 mgr.a (mgr.14355) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:47 smithi131 bash[24745]: cluster 2024-09-14T04:52:46.591570+0000 mgr.a (mgr.14355) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:47 smithi171 bash[25040]: cluster 2024-09-14T04:52:46.591570+0000 mgr.a (mgr.14355) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:47 smithi007 bash[22722]: cluster 2024-09-14T04:52:46.591570+0000 mgr.a (mgr.14355) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:48.874 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:48.874 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:48 smithi131 bash[24745]: audit 2024-09-14T04:52:48.415797+0000 mgr.a (mgr.14355) 16947 : audit [DBG] from='client.364956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:48 smithi171 bash[25040]: audit 2024-09-14T04:52:48.415797+0000 mgr.a (mgr.14355) 16947 : audit [DBG] from='client.364956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:48 smithi007 bash[22722]: audit 2024-09-14T04:52:48.415797+0000 mgr.a (mgr.14355) 16947 : audit [DBG] from='client.364956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:49 smithi131 bash[24745]: cluster 2024-09-14T04:52:48.592229+0000 mgr.a (mgr.14355) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:49 smithi171 bash[25040]: cluster 2024-09-14T04:52:48.592229+0000 mgr.a (mgr.14355) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:49 smithi007 bash[22722]: cluster 2024-09-14T04:52:48.592229+0000 mgr.a (mgr.14355) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:51 smithi131 bash[24745]: cluster 2024-09-14T04:52:50.594617+0000 mgr.a (mgr.14355) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:51 smithi171 bash[25040]: cluster 2024-09-14T04:52:50.594617+0000 mgr.a (mgr.14355) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:51 smithi007 bash[22722]: cluster 2024-09-14T04:52:50.594617+0000 mgr.a (mgr.14355) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:53.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:53.876 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:53.877 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:52:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:53 smithi131 bash[24745]: cluster 2024-09-14T04:52:52.595402+0000 mgr.a (mgr.14355) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:53 smithi171 bash[25040]: cluster 2024-09-14T04:52:52.595402+0000 mgr.a (mgr.14355) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:53 smithi007 bash[22722]: cluster 2024-09-14T04:52:52.595402+0000 mgr.a (mgr.14355) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:54.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:52:54.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:52:54.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:52:54.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:52:54.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:52:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:54 smithi131 bash[24745]: audit 2024-09-14T04:52:54.209646+0000 mgr.a (mgr.14355) 16951 : audit [DBG] from='client.365031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:54 smithi171 bash[25040]: audit 2024-09-14T04:52:54.209646+0000 mgr.a (mgr.14355) 16951 : audit [DBG] from='client.365031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:54 smithi007 bash[22722]: audit 2024-09-14T04:52:54.209646+0000 mgr.a (mgr.14355) 16951 : audit [DBG] from='client.365031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:52:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:55 smithi131 bash[24745]: cluster 2024-09-14T04:52:54.596004+0000 mgr.a (mgr.14355) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:55 smithi171 bash[25040]: cluster 2024-09-14T04:52:54.596004+0000 mgr.a (mgr.14355) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:55 smithi007 bash[22722]: cluster 2024-09-14T04:52:54.596004+0000 mgr.a (mgr.14355) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:52:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:57 smithi131 bash[24745]: cluster 2024-09-14T04:52:56.598211+0000 mgr.a (mgr.14355) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:57 smithi171 bash[25040]: cluster 2024-09-14T04:52:56.598211+0000 mgr.a (mgr.14355) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:57 smithi007 bash[22722]: cluster 2024-09-14T04:52:56.598211+0000 mgr.a (mgr.14355) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:52:59.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:52:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:52:59.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:52:59 smithi131 bash[24745]: cluster 2024-09-14T04:52:58.599007+0000 mgr.a (mgr.14355) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:52:59 smithi171 bash[25040]: cluster 2024-09-14T04:52:58.599007+0000 mgr.a (mgr.14355) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:52:59 smithi007 bash[22722]: cluster 2024-09-14T04:52:58.599007+0000 mgr.a (mgr.14355) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:00.386 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:00.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:00.387 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:00 smithi131 bash[24745]: audit 2024-09-14T04:52:59.963907+0000 mgr.a (mgr.14355) 16955 : audit [DBG] from='client.365106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:00 smithi171 bash[25040]: audit 2024-09-14T04:52:59.963907+0000 mgr.a (mgr.14355) 16955 : audit [DBG] from='client.365106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:00 smithi007 bash[22722]: audit 2024-09-14T04:52:59.963907+0000 mgr.a (mgr.14355) 16955 : audit [DBG] from='client.365106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:01 smithi171 bash[25040]: cluster 2024-09-14T04:53:00.601773+0000 mgr.a (mgr.14355) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:53:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:01 smithi007 bash[22722]: cluster 2024-09-14T04:53:00.601773+0000 mgr.a (mgr.14355) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:53:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:01 smithi131 bash[24745]: cluster 2024-09-14T04:53:00.601773+0000 mgr.a (mgr.14355) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T04:53:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:03 smithi007 bash[22722]: cluster 2024-09-14T04:53:02.602724+0000 mgr.a (mgr.14355) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:03 smithi131 bash[24745]: cluster 2024-09-14T04:53:02.602724+0000 mgr.a (mgr.14355) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:03 smithi171 bash[25040]: cluster 2024-09-14T04:53:02.602724+0000 mgr.a (mgr.14355) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:05.389 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:06.133 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:06.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:06.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:05 smithi007 bash[22722]: cluster 2024-09-14T04:53:04.603677+0000 mgr.a (mgr.14355) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:05 smithi131 bash[24745]: cluster 2024-09-14T04:53:04.603677+0000 mgr.a (mgr.14355) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:05 smithi171 bash[25040]: cluster 2024-09-14T04:53:04.603677+0000 mgr.a (mgr.14355) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T04:53:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:06 smithi007 bash[22722]: audit 2024-09-14T04:53:05.719631+0000 mgr.a (mgr.14355) 16959 : audit [DBG] from='client.365178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:06 smithi131 bash[24745]: audit 2024-09-14T04:53:05.719631+0000 mgr.a (mgr.14355) 16959 : audit [DBG] from='client.365178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:06 smithi171 bash[25040]: audit 2024-09-14T04:53:05.719631+0000 mgr.a (mgr.14355) 16959 : audit [DBG] from='client.365178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:07 smithi007 bash[22722]: cluster 2024-09-14T04:53:06.606672+0000 mgr.a (mgr.14355) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:07 smithi131 bash[24745]: cluster 2024-09-14T04:53:06.606672+0000 mgr.a (mgr.14355) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:07 smithi171 bash[25040]: cluster 2024-09-14T04:53:06.606672+0000 mgr.a (mgr.14355) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:10.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:09 smithi007 bash[22722]: cluster 2024-09-14T04:53:08.607509+0000 mgr.a (mgr.14355) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:09 smithi131 bash[24745]: cluster 2024-09-14T04:53:08.607509+0000 mgr.a (mgr.14355) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:10.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:09 smithi171 bash[25040]: cluster 2024-09-14T04:53:08.607509+0000 mgr.a (mgr.14355) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:11.135 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:11.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:11 smithi007 bash[22722]: cluster 2024-09-14T04:53:10.609467+0000 mgr.a (mgr.14355) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:11 smithi007 bash[22722]: audit 2024-09-14T04:53:11.462554+0000 mgr.a (mgr.14355) 16963 : audit [DBG] from='client.365253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:12.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:11 smithi007 bash[22722]: audit 2024-09-14T04:53:11.480893+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:53:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:11 smithi131 bash[24745]: cluster 2024-09-14T04:53:10.609467+0000 mgr.a (mgr.14355) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:11 smithi131 bash[24745]: audit 2024-09-14T04:53:11.462554+0000 mgr.a (mgr.14355) 16963 : audit [DBG] from='client.365253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:12.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:11 smithi131 bash[24745]: audit 2024-09-14T04:53:11.480893+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:53:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:11 smithi171 bash[25040]: cluster 2024-09-14T04:53:10.609467+0000 mgr.a (mgr.14355) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:11 smithi171 bash[25040]: audit 2024-09-14T04:53:11.462554+0000 mgr.a (mgr.14355) 16963 : audit [DBG] from='client.365253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:12.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:11 smithi171 bash[25040]: audit 2024-09-14T04:53:11.480893+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:53:13.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:53:13 smithi007 bash[22972]: debug 2024-09-14T04:53:13.052+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:53:13 smithi007 bash[22972]: debug 2024-09-14T04:53:13.052+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:12 smithi007 bash[22722]: audit 2024-09-14T04:53:12.306106+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:12 smithi007 bash[22722]: audit 2024-09-14T04:53:12.307741+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:12 smithi007 bash[22722]: audit 2024-09-14T04:53:12.316067+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:12 smithi007 bash[22722]: audit 2024-09-14T04:53:12.320667+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:13.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:12 smithi007 bash[22722]: audit 2024-09-14T04:53:12.323363+0000 mgr.a (mgr.14355) 16964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:12 smithi131 bash[24745]: audit 2024-09-14T04:53:12.306106+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:53:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:12 smithi131 bash[24745]: audit 2024-09-14T04:53:12.307741+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:53:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:12 smithi131 bash[24745]: audit 2024-09-14T04:53:12.316067+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:53:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:12 smithi131 bash[24745]: audit 2024-09-14T04:53:12.320667+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:12 smithi131 bash[24745]: audit 2024-09-14T04:53:12.323363+0000 mgr.a (mgr.14355) 16964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:12 smithi171 bash[25040]: audit 2024-09-14T04:53:12.306106+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:53:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:12 smithi171 bash[25040]: audit 2024-09-14T04:53:12.307741+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:53:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:12 smithi171 bash[25040]: audit 2024-09-14T04:53:12.316067+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:53:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:12 smithi171 bash[25040]: audit 2024-09-14T04:53:12.320667+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:13.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:12 smithi171 bash[25040]: audit 2024-09-14T04:53:12.323363+0000 mgr.a (mgr.14355) 16964 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:53:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:14 smithi007 bash[22722]: cluster 2024-09-14T04:53:12.609975+0000 mgr.a (mgr.14355) 16965 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:14 smithi007 bash[22722]: audit 2024-09-14T04:53:13.055972+0000 mgr.a (mgr.14355) 16966 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:53:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:14 smithi007 bash[22722]: cephadm 2024-09-14T04:53:13.057534+0000 mgr.a (mgr.14355) 16967 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:53:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:14 smithi131 bash[24745]: cluster 2024-09-14T04:53:12.609975+0000 mgr.a (mgr.14355) 16965 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:14 smithi131 bash[24745]: audit 2024-09-14T04:53:13.055972+0000 mgr.a (mgr.14355) 16966 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:53:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:14 smithi131 bash[24745]: cephadm 2024-09-14T04:53:13.057534+0000 mgr.a (mgr.14355) 16967 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:53:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:14 smithi171 bash[25040]: cluster 2024-09-14T04:53:12.609975+0000 mgr.a (mgr.14355) 16965 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:14 smithi171 bash[25040]: audit 2024-09-14T04:53:13.055972+0000 mgr.a (mgr.14355) 16966 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:53:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:14 smithi171 bash[25040]: cephadm 2024-09-14T04:53:13.057534+0000 mgr.a (mgr.14355) 16967 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:53:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:16 smithi007 bash[22722]: cluster 2024-09-14T04:53:14.610901+0000 mgr.a (mgr.14355) 16968 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:16 smithi131 bash[24745]: cluster 2024-09-14T04:53:14.610901+0000 mgr.a (mgr.14355) 16968 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:16 smithi171 bash[25040]: cluster 2024-09-14T04:53:14.610901+0000 mgr.a (mgr.14355) 16968 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T04:53:16.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:16.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:16.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:17.640 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:18 smithi007 bash[22722]: cluster 2024-09-14T04:53:16.613165+0000 mgr.a (mgr.14355) 16969 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:18 smithi007 bash[22722]: audit 2024-09-14T04:53:17.222095+0000 mgr.a (mgr.14355) 16970 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:18 smithi131 bash[24745]: cluster 2024-09-14T04:53:16.613165+0000 mgr.a (mgr.14355) 16969 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:18 smithi131 bash[24745]: audit 2024-09-14T04:53:17.222095+0000 mgr.a (mgr.14355) 16970 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:18 smithi171 bash[25040]: cluster 2024-09-14T04:53:16.613165+0000 mgr.a (mgr.14355) 16969 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:18 smithi171 bash[25040]: audit 2024-09-14T04:53:17.222095+0000 mgr.a (mgr.14355) 16970 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:20 smithi007 bash[22722]: cluster 2024-09-14T04:53:18.614177+0000 mgr.a (mgr.14355) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:20 smithi131 bash[24745]: cluster 2024-09-14T04:53:18.614177+0000 mgr.a (mgr.14355) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:20 smithi171 bash[25040]: cluster 2024-09-14T04:53:18.614177+0000 mgr.a (mgr.14355) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:22.641 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:22.642 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:22 smithi007 bash[22722]: cluster 2024-09-14T04:53:20.616497+0000 mgr.a (mgr.14355) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:22 smithi131 bash[24745]: cluster 2024-09-14T04:53:20.616497+0000 mgr.a (mgr.14355) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:22 smithi171 bash[25040]: cluster 2024-09-14T04:53:20.616497+0000 mgr.a (mgr.14355) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:23.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:23.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:23.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:24 smithi007 bash[22722]: cluster 2024-09-14T04:53:22.617313+0000 mgr.a (mgr.14355) 16973 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:24 smithi007 bash[22722]: audit 2024-09-14T04:53:22.972563+0000 mgr.a (mgr.14355) 16974 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:24 smithi131 bash[24745]: cluster 2024-09-14T04:53:22.617313+0000 mgr.a (mgr.14355) 16973 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:24 smithi131 bash[24745]: audit 2024-09-14T04:53:22.972563+0000 mgr.a (mgr.14355) 16974 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:24 smithi171 bash[25040]: cluster 2024-09-14T04:53:22.617313+0000 mgr.a (mgr.14355) 16973 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:24.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:24 smithi171 bash[25040]: audit 2024-09-14T04:53:22.972563+0000 mgr.a (mgr.14355) 16974 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:26 smithi007 bash[22722]: cluster 2024-09-14T04:53:24.618344+0000 mgr.a (mgr.14355) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:26 smithi131 bash[24745]: cluster 2024-09-14T04:53:24.618344+0000 mgr.a (mgr.14355) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:26 smithi171 bash[25040]: cluster 2024-09-14T04:53:24.618344+0000 mgr.a (mgr.14355) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:28 smithi007 bash[22722]: cluster 2024-09-14T04:53:26.620584+0000 mgr.a (mgr.14355) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:28 smithi131 bash[24745]: cluster 2024-09-14T04:53:26.620584+0000 mgr.a (mgr.14355) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:28.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:28 smithi171 bash[25040]: cluster 2024-09-14T04:53:26.620584+0000 mgr.a (mgr.14355) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:53:29.153 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:29.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:29.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:29.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:29.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:30 smithi007 bash[22722]: cluster 2024-09-14T04:53:28.621445+0000 mgr.a (mgr.14355) 16977 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:30.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:30 smithi007 bash[22722]: audit 2024-09-14T04:53:28.723784+0000 mgr.a (mgr.14355) 16978 : audit [DBG] from='client.365589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:30 smithi131 bash[24745]: cluster 2024-09-14T04:53:28.621445+0000 mgr.a (mgr.14355) 16977 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:30 smithi131 bash[24745]: audit 2024-09-14T04:53:28.723784+0000 mgr.a (mgr.14355) 16978 : audit [DBG] from='client.365589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:30 smithi171 bash[25040]: cluster 2024-09-14T04:53:28.621445+0000 mgr.a (mgr.14355) 16977 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:30 smithi171 bash[25040]: audit 2024-09-14T04:53:28.723784+0000 mgr.a (mgr.14355) 16978 : audit [DBG] from='client.365589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:32.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:32 smithi007 bash[22722]: cluster 2024-09-14T04:53:30.623877+0000 mgr.a (mgr.14355) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:32 smithi131 bash[24745]: cluster 2024-09-14T04:53:30.623877+0000 mgr.a (mgr.14355) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:32 smithi171 bash[25040]: cluster 2024-09-14T04:53:30.623877+0000 mgr.a (mgr.14355) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:34.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:34 smithi007 bash[22722]: cluster 2024-09-14T04:53:32.624658+0000 mgr.a (mgr.14355) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:34 smithi131 bash[24745]: cluster 2024-09-14T04:53:32.624658+0000 mgr.a (mgr.14355) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:34 smithi171 bash[25040]: cluster 2024-09-14T04:53:32.624658+0000 mgr.a (mgr.14355) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:34.911 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:34.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:34.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:34.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:34.911 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:35 smithi007 bash[22722]: audit 2024-09-14T04:53:34.485737+0000 mgr.a (mgr.14355) 16981 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:35 smithi131 bash[24745]: audit 2024-09-14T04:53:34.485737+0000 mgr.a (mgr.14355) 16981 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:35 smithi171 bash[25040]: audit 2024-09-14T04:53:34.485737+0000 mgr.a (mgr.14355) 16981 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:36 smithi007 bash[22722]: cluster 2024-09-14T04:53:34.625246+0000 mgr.a (mgr.14355) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:36 smithi131 bash[24745]: cluster 2024-09-14T04:53:34.625246+0000 mgr.a (mgr.14355) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:36 smithi171 bash[25040]: cluster 2024-09-14T04:53:34.625246+0000 mgr.a (mgr.14355) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:38 smithi007 bash[22722]: cluster 2024-09-14T04:53:36.627595+0000 mgr.a (mgr.14355) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:38 smithi131 bash[24745]: cluster 2024-09-14T04:53:36.627595+0000 mgr.a (mgr.14355) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:38 smithi171 bash[25040]: cluster 2024-09-14T04:53:36.627595+0000 mgr.a (mgr.14355) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:39.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:39.913 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:40.662 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:40 smithi007 bash[22722]: cluster 2024-09-14T04:53:38.628419+0000 mgr.a (mgr.14355) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:40 smithi131 bash[24745]: cluster 2024-09-14T04:53:38.628419+0000 mgr.a (mgr.14355) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:40 smithi171 bash[25040]: cluster 2024-09-14T04:53:38.628419+0000 mgr.a (mgr.14355) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:41 smithi007 bash[22722]: audit 2024-09-14T04:53:40.240236+0000 mgr.a (mgr.14355) 16985 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:41 smithi131 bash[24745]: audit 2024-09-14T04:53:40.240236+0000 mgr.a (mgr.14355) 16985 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:41 smithi171 bash[25040]: audit 2024-09-14T04:53:40.240236+0000 mgr.a (mgr.14355) 16985 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:42 smithi007 bash[22722]: cluster 2024-09-14T04:53:40.629919+0000 mgr.a (mgr.14355) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:42 smithi131 bash[24745]: cluster 2024-09-14T04:53:40.629919+0000 mgr.a (mgr.14355) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:42 smithi171 bash[25040]: cluster 2024-09-14T04:53:40.629919+0000 mgr.a (mgr.14355) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:44 smithi007 bash[22722]: cluster 2024-09-14T04:53:42.630667+0000 mgr.a (mgr.14355) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:44 smithi131 bash[24745]: cluster 2024-09-14T04:53:42.630667+0000 mgr.a (mgr.14355) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:44 smithi171 bash[25040]: cluster 2024-09-14T04:53:42.630667+0000 mgr.a (mgr.14355) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:45.663 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:45.664 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:46.417 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:46.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:46 smithi007 bash[22722]: cluster 2024-09-14T04:53:44.631436+0000 mgr.a (mgr.14355) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:46 smithi131 bash[24745]: cluster 2024-09-14T04:53:44.631436+0000 mgr.a (mgr.14355) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:46 smithi171 bash[25040]: cluster 2024-09-14T04:53:44.631436+0000 mgr.a (mgr.14355) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:53:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:47 smithi007 bash[22722]: audit 2024-09-14T04:53:45.990480+0000 mgr.a (mgr.14355) 16989 : audit [DBG] from='client.365823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:47 smithi131 bash[24745]: audit 2024-09-14T04:53:45.990480+0000 mgr.a (mgr.14355) 16989 : audit [DBG] from='client.365823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:47 smithi171 bash[25040]: audit 2024-09-14T04:53:45.990480+0000 mgr.a (mgr.14355) 16989 : audit [DBG] from='client.365823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:48 smithi007 bash[22722]: cluster 2024-09-14T04:53:46.634223+0000 mgr.a (mgr.14355) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:48 smithi131 bash[24745]: cluster 2024-09-14T04:53:46.634223+0000 mgr.a (mgr.14355) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:48 smithi171 bash[25040]: cluster 2024-09-14T04:53:46.634223+0000 mgr.a (mgr.14355) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:50.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:50 smithi007 bash[22722]: cluster 2024-09-14T04:53:48.635007+0000 mgr.a (mgr.14355) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:50 smithi131 bash[24745]: cluster 2024-09-14T04:53:48.635007+0000 mgr.a (mgr.14355) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:50 smithi171 bash[25040]: cluster 2024-09-14T04:53:48.635007+0000 mgr.a (mgr.14355) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:53:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:52.202 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:52.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:52.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:52.202 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:52.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:52.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:52 smithi007 bash[22722]: cluster 2024-09-14T04:53:50.637131+0000 mgr.a (mgr.14355) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:52 smithi131 bash[24745]: cluster 2024-09-14T04:53:50.637131+0000 mgr.a (mgr.14355) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:52 smithi171 bash[25040]: cluster 2024-09-14T04:53:50.637131+0000 mgr.a (mgr.14355) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:53 smithi007 bash[22722]: audit 2024-09-14T04:53:51.757772+0000 mgr.a (mgr.14355) 16993 : audit [DBG] from='client.365901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:53 smithi131 bash[24745]: audit 2024-09-14T04:53:51.757772+0000 mgr.a (mgr.14355) 16993 : audit [DBG] from='client.365901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:53 smithi171 bash[25040]: audit 2024-09-14T04:53:51.757772+0000 mgr.a (mgr.14355) 16993 : audit [DBG] from='client.365901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:54 smithi007 bash[22722]: cluster 2024-09-14T04:53:52.638150+0000 mgr.a (mgr.14355) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:54 smithi131 bash[24745]: cluster 2024-09-14T04:53:52.638150+0000 mgr.a (mgr.14355) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:54 smithi171 bash[25040]: cluster 2024-09-14T04:53:52.638150+0000 mgr.a (mgr.14355) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:56 smithi007 bash[22722]: cluster 2024-09-14T04:53:54.638949+0000 mgr.a (mgr.14355) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:56 smithi131 bash[24745]: cluster 2024-09-14T04:53:54.638949+0000 mgr.a (mgr.14355) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:56 smithi171 bash[25040]: cluster 2024-09-14T04:53:54.638949+0000 mgr.a (mgr.14355) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:53:57.203 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:53:57.204 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:53:57.204 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:53:57.962 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:53:57.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:53:57.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:53:57.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:53:57.963 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:53:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:58 smithi007 bash[22722]: cluster 2024-09-14T04:53:56.641186+0000 mgr.a (mgr.14355) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:58 smithi131 bash[24745]: cluster 2024-09-14T04:53:56.641186+0000 mgr.a (mgr.14355) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:58 smithi171 bash[25040]: cluster 2024-09-14T04:53:56.641186+0000 mgr.a (mgr.14355) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:53:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:53:59 smithi131 bash[24745]: audit 2024-09-14T04:53:57.535188+0000 mgr.a (mgr.14355) 16997 : audit [DBG] from='client.365979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:53:59 smithi171 bash[25040]: audit 2024-09-14T04:53:57.535188+0000 mgr.a (mgr.14355) 16997 : audit [DBG] from='client.365979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:53:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:53:59 smithi007 bash[22722]: audit 2024-09-14T04:53:57.535188+0000 mgr.a (mgr.14355) 16997 : audit [DBG] from='client.365979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:00 smithi131 bash[24745]: cluster 2024-09-14T04:53:58.642163+0000 mgr.a (mgr.14355) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:00 smithi171 bash[25040]: cluster 2024-09-14T04:53:58.642163+0000 mgr.a (mgr.14355) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:00 smithi007 bash[22722]: cluster 2024-09-14T04:53:58.642163+0000 mgr.a (mgr.14355) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:02 smithi131 bash[24745]: cluster 2024-09-14T04:54:00.644593+0000 mgr.a (mgr.14355) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:02 smithi171 bash[25040]: cluster 2024-09-14T04:54:00.644593+0000 mgr.a (mgr.14355) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:02 smithi007 bash[22722]: cluster 2024-09-14T04:54:00.644593+0000 mgr.a (mgr.14355) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:02.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:02.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:02.965 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:03.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:04 smithi131 bash[24745]: cluster 2024-09-14T04:54:02.645567+0000 mgr.a (mgr.14355) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:04 smithi131 bash[24745]: audit 2024-09-14T04:54:03.296402+0000 mgr.a (mgr.14355) 17001 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:04 smithi171 bash[25040]: cluster 2024-09-14T04:54:02.645567+0000 mgr.a (mgr.14355) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:04 smithi171 bash[25040]: audit 2024-09-14T04:54:03.296402+0000 mgr.a (mgr.14355) 17001 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:04 smithi007 bash[22722]: cluster 2024-09-14T04:54:02.645567+0000 mgr.a (mgr.14355) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:04 smithi007 bash[22722]: audit 2024-09-14T04:54:03.296402+0000 mgr.a (mgr.14355) 17001 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:06 smithi131 bash[24745]: cluster 2024-09-14T04:54:04.646589+0000 mgr.a (mgr.14355) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:06 smithi171 bash[25040]: cluster 2024-09-14T04:54:04.646589+0000 mgr.a (mgr.14355) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:06 smithi007 bash[22722]: cluster 2024-09-14T04:54:04.646589+0000 mgr.a (mgr.14355) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:08.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:08.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:08 smithi131 bash[24745]: cluster 2024-09-14T04:54:06.648872+0000 mgr.a (mgr.14355) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:08 smithi171 bash[25040]: cluster 2024-09-14T04:54:06.648872+0000 mgr.a (mgr.14355) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:08 smithi007 bash[22722]: cluster 2024-09-14T04:54:06.648872+0000 mgr.a (mgr.14355) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:09.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:09.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:10 smithi131 bash[24745]: cluster 2024-09-14T04:54:08.649647+0000 mgr.a (mgr.14355) 17004 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:10 smithi131 bash[24745]: audit 2024-09-14T04:54:09.069430+0000 mgr.a (mgr.14355) 17005 : audit [DBG] from='client.366129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:10 smithi171 bash[25040]: cluster 2024-09-14T04:54:08.649647+0000 mgr.a (mgr.14355) 17004 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:10 smithi171 bash[25040]: audit 2024-09-14T04:54:09.069430+0000 mgr.a (mgr.14355) 17005 : audit [DBG] from='client.366129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:10 smithi007 bash[22722]: cluster 2024-09-14T04:54:08.649647+0000 mgr.a (mgr.14355) 17004 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:10 smithi007 bash[22722]: audit 2024-09-14T04:54:09.069430+0000 mgr.a (mgr.14355) 17005 : audit [DBG] from='client.366129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:12 smithi131 bash[24745]: cluster 2024-09-14T04:54:10.652063+0000 mgr.a (mgr.14355) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:12 smithi171 bash[25040]: cluster 2024-09-14T04:54:10.652063+0000 mgr.a (mgr.14355) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:12 smithi007 bash[22722]: cluster 2024-09-14T04:54:10.652063+0000 mgr.a (mgr.14355) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:13 smithi131 bash[24745]: audit 2024-09-14T04:54:13.106284+0000 mon.a (mon.0) 3121 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:54:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:13 smithi171 bash[25040]: audit 2024-09-14T04:54:13.106284+0000 mon.a (mon.0) 3121 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:54:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:13 smithi007 bash[22722]: audit 2024-09-14T04:54:13.106284+0000 mon.a (mon.0) 3121 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:14.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:14.507 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:14 smithi131 bash[24745]: cluster 2024-09-14T04:54:12.652844+0000 mgr.a (mgr.14355) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:14 smithi131 bash[24745]: audit 2024-09-14T04:54:13.734560+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:14 smithi131 bash[24745]: audit 2024-09-14T04:54:13.739525+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:14 smithi171 bash[25040]: cluster 2024-09-14T04:54:12.652844+0000 mgr.a (mgr.14355) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:14 smithi171 bash[25040]: audit 2024-09-14T04:54:13.734560+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:14 smithi171 bash[25040]: audit 2024-09-14T04:54:13.739525+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:14 smithi007 bash[22722]: cluster 2024-09-14T04:54:12.652844+0000 mgr.a (mgr.14355) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:14 smithi007 bash[22722]: audit 2024-09-14T04:54:13.734560+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:14 smithi007 bash[22722]: audit 2024-09-14T04:54:13.739525+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:15.255 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:15.255 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:15.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:15.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:15.256 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:16 smithi131 bash[24745]: cluster 2024-09-14T04:54:14.653389+0000 mgr.a (mgr.14355) 17008 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:16 smithi131 bash[24745]: audit 2024-09-14T04:54:14.839235+0000 mgr.a (mgr.14355) 17009 : audit [DBG] from='client.366207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:16 smithi171 bash[25040]: cluster 2024-09-14T04:54:14.653389+0000 mgr.a (mgr.14355) 17008 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:16 smithi171 bash[25040]: audit 2024-09-14T04:54:14.839235+0000 mgr.a (mgr.14355) 17009 : audit [DBG] from='client.366207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:16 smithi007 bash[22722]: cluster 2024-09-14T04:54:14.653389+0000 mgr.a (mgr.14355) 17008 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:16 smithi007 bash[22722]: audit 2024-09-14T04:54:14.839235+0000 mgr.a (mgr.14355) 17009 : audit [DBG] from='client.366207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:18 smithi131 bash[24745]: cluster 2024-09-14T04:54:16.655776+0000 mgr.a (mgr.14355) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:54:18.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:18 smithi171 bash[25040]: cluster 2024-09-14T04:54:16.655776+0000 mgr.a (mgr.14355) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:54:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:18 smithi007 bash[22722]: cluster 2024-09-14T04:54:16.655776+0000 mgr.a (mgr.14355) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T04:54:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:20.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:20 smithi131 bash[24745]: cluster 2024-09-14T04:54:18.656573+0000 mgr.a (mgr.14355) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:54:20.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:20 smithi007 bash[22722]: cluster 2024-09-14T04:54:18.656573+0000 mgr.a (mgr.14355) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:54:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:20 smithi171 bash[25040]: cluster 2024-09-14T04:54:18.656573+0000 mgr.a (mgr.14355) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T04:54:21.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:21.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:21.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:21.017 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:21.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:22 smithi131 bash[24745]: audit 2024-09-14T04:54:20.589410+0000 mgr.a (mgr.14355) 17012 : audit [DBG] from='client.366285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:22 smithi131 bash[24745]: cluster 2024-09-14T04:54:20.658081+0000 mgr.a (mgr.14355) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:22 smithi171 bash[25040]: audit 2024-09-14T04:54:20.589410+0000 mgr.a (mgr.14355) 17012 : audit [DBG] from='client.366285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:22.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:22 smithi171 bash[25040]: cluster 2024-09-14T04:54:20.658081+0000 mgr.a (mgr.14355) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:22 smithi007 bash[22722]: audit 2024-09-14T04:54:20.589410+0000 mgr.a (mgr.14355) 17012 : audit [DBG] from='client.366285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:22 smithi007 bash[22722]: cluster 2024-09-14T04:54:20.658081+0000 mgr.a (mgr.14355) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:24 smithi131 bash[24745]: cluster 2024-09-14T04:54:22.658609+0000 mgr.a (mgr.14355) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:24 smithi171 bash[25040]: cluster 2024-09-14T04:54:22.658609+0000 mgr.a (mgr.14355) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:24 smithi007 bash[22722]: cluster 2024-09-14T04:54:22.658609+0000 mgr.a (mgr.14355) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22972]: debug 2024-09-14T04:54:25.350+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22972]: debug 2024-09-14T04:54:25.354+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.526658+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.542009+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.544338+0000 mon.a (mon.0) 3126 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.546264+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:54:25.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.557274+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:25 smithi007 bash[22722]: audit 2024-09-14T04:54:24.562658+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.526658+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.542009+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.544338+0000 mon.a (mon.0) 3126 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:54:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.546264+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:54:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.557274+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:25.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:25 smithi171 bash[25040]: audit 2024-09-14T04:54:24.562658+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:26.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:26.019 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.526658+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.542009+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.544338+0000 mon.a (mon.0) 3126 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:54:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.546264+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:54:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.557274+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:54:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:25 smithi131 bash[24745]: audit 2024-09-14T04:54:24.562658+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:26 smithi171 bash[25040]: audit 2024-09-14T04:54:24.564865+0000 mgr.a (mgr.14355) 17015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:26 smithi171 bash[25040]: cluster 2024-09-14T04:54:24.659249+0000 mgr.a (mgr.14355) 17016 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:26 smithi171 bash[25040]: audit 2024-09-14T04:54:25.356975+0000 mgr.a (mgr.14355) 17017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:54:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:26 smithi171 bash[25040]: cephadm 2024-09-14T04:54:25.358820+0000 mgr.a (mgr.14355) 17018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:54:26.808 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:26.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:26 smithi007 bash[22722]: audit 2024-09-14T04:54:24.564865+0000 mgr.a (mgr.14355) 17015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:26 smithi007 bash[22722]: cluster 2024-09-14T04:54:24.659249+0000 mgr.a (mgr.14355) 17016 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:26 smithi007 bash[22722]: audit 2024-09-14T04:54:25.356975+0000 mgr.a (mgr.14355) 17017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:54:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:26 smithi007 bash[22722]: cephadm 2024-09-14T04:54:25.358820+0000 mgr.a (mgr.14355) 17018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:54:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:26 smithi131 bash[24745]: audit 2024-09-14T04:54:24.564865+0000 mgr.a (mgr.14355) 17015 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:54:27.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:26 smithi131 bash[24745]: cluster 2024-09-14T04:54:24.659249+0000 mgr.a (mgr.14355) 17016 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:54:27.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:26 smithi131 bash[24745]: audit 2024-09-14T04:54:25.356975+0000 mgr.a (mgr.14355) 17017 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:54:27.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:26 smithi131 bash[24745]: cephadm 2024-09-14T04:54:25.358820+0000 mgr.a (mgr.14355) 17018 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:54:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:27 smithi171 bash[25040]: audit 2024-09-14T04:54:26.359684+0000 mgr.a (mgr.14355) 17019 : audit [DBG] from='client.366462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:27 smithi007 bash[22722]: audit 2024-09-14T04:54:26.359684+0000 mgr.a (mgr.14355) 17019 : audit [DBG] from='client.366462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:27 smithi131 bash[24745]: audit 2024-09-14T04:54:26.359684+0000 mgr.a (mgr.14355) 17019 : audit [DBG] from='client.366462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:28 smithi007 bash[22722]: cluster 2024-09-14T04:54:26.660677+0000 mgr.a (mgr.14355) 17020 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:54:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:28 smithi131 bash[24745]: cluster 2024-09-14T04:54:26.660677+0000 mgr.a (mgr.14355) 17020 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:54:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:28 smithi171 bash[25040]: cluster 2024-09-14T04:54:26.660677+0000 mgr.a (mgr.14355) 17020 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T04:54:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:29 smithi007 bash[22722]: cluster 2024-09-14T04:54:28.661731+0000 mgr.a (mgr.14355) 17021 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:54:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:29 smithi131 bash[24745]: cluster 2024-09-14T04:54:28.661731+0000 mgr.a (mgr.14355) 17021 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:54:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:29 smithi171 bash[25040]: cluster 2024-09-14T04:54:28.661731+0000 mgr.a (mgr.14355) 17021 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T04:54:31.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:31.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:31.811 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:31 smithi131 bash[24745]: cluster 2024-09-14T04:54:30.664115+0000 mgr.a (mgr.14355) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:31 smithi171 bash[25040]: cluster 2024-09-14T04:54:30.664115+0000 mgr.a (mgr.14355) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:31 smithi007 bash[22722]: cluster 2024-09-14T04:54:30.664115+0000 mgr.a (mgr.14355) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:32.570 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:32.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:32.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:32 smithi131 bash[24745]: audit 2024-09-14T04:54:32.139564+0000 mgr.a (mgr.14355) 17023 : audit [DBG] from='client.366537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:32 smithi171 bash[25040]: audit 2024-09-14T04:54:32.139564+0000 mgr.a (mgr.14355) 17023 : audit [DBG] from='client.366537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:32 smithi007 bash[22722]: audit 2024-09-14T04:54:32.139564+0000 mgr.a (mgr.14355) 17023 : audit [DBG] from='client.366537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:33 smithi131 bash[24745]: cluster 2024-09-14T04:54:32.665106+0000 mgr.a (mgr.14355) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:33 smithi171 bash[25040]: cluster 2024-09-14T04:54:32.665106+0000 mgr.a (mgr.14355) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:33 smithi007 bash[22722]: cluster 2024-09-14T04:54:32.665106+0000 mgr.a (mgr.14355) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:35 smithi131 bash[24745]: cluster 2024-09-14T04:54:34.665905+0000 mgr.a (mgr.14355) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:35 smithi171 bash[25040]: cluster 2024-09-14T04:54:34.665905+0000 mgr.a (mgr.14355) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:35 smithi007 bash[22722]: cluster 2024-09-14T04:54:34.665905+0000 mgr.a (mgr.14355) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:37 smithi131 bash[24745]: cluster 2024-09-14T04:54:36.668139+0000 mgr.a (mgr.14355) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:37 smithi171 bash[25040]: cluster 2024-09-14T04:54:36.668139+0000 mgr.a (mgr.14355) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:38.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:37 smithi007 bash[22722]: cluster 2024-09-14T04:54:36.668139+0000 mgr.a (mgr.14355) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:54:38.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:38.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:38 smithi131 bash[24745]: audit 2024-09-14T04:54:37.902907+0000 mgr.a (mgr.14355) 17027 : audit [DBG] from='client.366615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:38 smithi171 bash[25040]: audit 2024-09-14T04:54:37.902907+0000 mgr.a (mgr.14355) 17027 : audit [DBG] from='client.366615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:38 smithi007 bash[22722]: audit 2024-09-14T04:54:37.902907+0000 mgr.a (mgr.14355) 17027 : audit [DBG] from='client.366615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:39 smithi131 bash[24745]: cluster 2024-09-14T04:54:38.669090+0000 mgr.a (mgr.14355) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:54:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:39 smithi171 bash[25040]: cluster 2024-09-14T04:54:38.669090+0000 mgr.a (mgr.14355) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:54:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:39 smithi007 bash[22722]: cluster 2024-09-14T04:54:38.669090+0000 mgr.a (mgr.14355) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T04:54:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:41 smithi131 bash[24745]: cluster 2024-09-14T04:54:40.671276+0000 mgr.a (mgr.14355) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T04:54:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:41 smithi171 bash[25040]: cluster 2024-09-14T04:54:40.671276+0000 mgr.a (mgr.14355) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T04:54:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:41 smithi007 bash[22722]: cluster 2024-09-14T04:54:40.671276+0000 mgr.a (mgr.14355) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T04:54:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:43.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:43 smithi131 bash[24745]: cluster 2024-09-14T04:54:42.672048+0000 mgr.a (mgr.14355) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:43 smithi171 bash[25040]: cluster 2024-09-14T04:54:42.672048+0000 mgr.a (mgr.14355) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:44.069 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:44.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:44.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:44.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:44.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:43 smithi007 bash[22722]: cluster 2024-09-14T04:54:42.672048+0000 mgr.a (mgr.14355) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:44 smithi131 bash[24745]: audit 2024-09-14T04:54:43.657071+0000 mgr.a (mgr.14355) 17031 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:44 smithi171 bash[25040]: audit 2024-09-14T04:54:43.657071+0000 mgr.a (mgr.14355) 17031 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:44 smithi007 bash[22722]: audit 2024-09-14T04:54:43.657071+0000 mgr.a (mgr.14355) 17031 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:45 smithi131 bash[24745]: cluster 2024-09-14T04:54:44.673006+0000 mgr.a (mgr.14355) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:45 smithi171 bash[25040]: cluster 2024-09-14T04:54:44.673006+0000 mgr.a (mgr.14355) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:45 smithi007 bash[22722]: cluster 2024-09-14T04:54:44.673006+0000 mgr.a (mgr.14355) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:47 smithi131 bash[24745]: cluster 2024-09-14T04:54:46.675311+0000 mgr.a (mgr.14355) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:47 smithi171 bash[25040]: cluster 2024-09-14T04:54:46.675311+0000 mgr.a (mgr.14355) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:47 smithi007 bash[22722]: cluster 2024-09-14T04:54:46.675311+0000 mgr.a (mgr.14355) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:49.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:49.072 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:49.825 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:49.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:49.826 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:49 smithi131 bash[24745]: cluster 2024-09-14T04:54:48.676100+0000 mgr.a (mgr.14355) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:49 smithi131 bash[24745]: audit 2024-09-14T04:54:49.401772+0000 mgr.a (mgr.14355) 17035 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:49 smithi171 bash[25040]: cluster 2024-09-14T04:54:48.676100+0000 mgr.a (mgr.14355) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:49 smithi171 bash[25040]: audit 2024-09-14T04:54:49.401772+0000 mgr.a (mgr.14355) 17035 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:49 smithi007 bash[22722]: cluster 2024-09-14T04:54:48.676100+0000 mgr.a (mgr.14355) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:49 smithi007 bash[22722]: audit 2024-09-14T04:54:49.401772+0000 mgr.a (mgr.14355) 17035 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:52 smithi007 bash[22722]: cluster 2024-09-14T04:54:50.678587+0000 mgr.a (mgr.14355) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:52 smithi131 bash[24745]: cluster 2024-09-14T04:54:50.678587+0000 mgr.a (mgr.14355) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:52 smithi171 bash[25040]: cluster 2024-09-14T04:54:50.678587+0000 mgr.a (mgr.14355) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:54:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:54 smithi007 bash[22722]: cluster 2024-09-14T04:54:52.679541+0000 mgr.a (mgr.14355) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:54 smithi131 bash[24745]: cluster 2024-09-14T04:54:52.679541+0000 mgr.a (mgr.14355) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:54 smithi171 bash[25040]: cluster 2024-09-14T04:54:52.679541+0000 mgr.a (mgr.14355) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:54:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:54:54.827 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:54:55.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:54:55.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:54:55.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:54:55.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:54:55.607 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:56 smithi007 bash[22722]: cluster 2024-09-14T04:54:54.680346+0000 mgr.a (mgr.14355) 17038 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:56 smithi007 bash[22722]: audit 2024-09-14T04:54:55.163947+0000 mgr.a (mgr.14355) 17039 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:56 smithi131 bash[24745]: cluster 2024-09-14T04:54:54.680346+0000 mgr.a (mgr.14355) 17038 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:56 smithi131 bash[24745]: audit 2024-09-14T04:54:55.163947+0000 mgr.a (mgr.14355) 17039 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:56 smithi171 bash[25040]: cluster 2024-09-14T04:54:54.680346+0000 mgr.a (mgr.14355) 17038 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:56 smithi171 bash[25040]: audit 2024-09-14T04:54:55.163947+0000 mgr.a (mgr.14355) 17039 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:54:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:54:58 smithi007 bash[22722]: cluster 2024-09-14T04:54:56.683073+0000 mgr.a (mgr.14355) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:54:58 smithi131 bash[24745]: cluster 2024-09-14T04:54:56.683073+0000 mgr.a (mgr.14355) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:54:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:54:58 smithi171 bash[25040]: cluster 2024-09-14T04:54:56.683073+0000 mgr.a (mgr.14355) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:00 smithi007 bash[22722]: cluster 2024-09-14T04:54:58.683862+0000 mgr.a (mgr.14355) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:00 smithi131 bash[24745]: cluster 2024-09-14T04:54:58.683862+0000 mgr.a (mgr.14355) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:00 smithi171 bash[25040]: cluster 2024-09-14T04:54:58.683862+0000 mgr.a (mgr.14355) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:01.353 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:01.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:02 smithi007 bash[22722]: cluster 2024-09-14T04:55:00.685166+0000 mgr.a (mgr.14355) 17042 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:02 smithi007 bash[22722]: audit 2024-09-14T04:55:00.941637+0000 mgr.a (mgr.14355) 17043 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:02 smithi131 bash[24745]: cluster 2024-09-14T04:55:00.685166+0000 mgr.a (mgr.14355) 17042 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:02 smithi131 bash[24745]: audit 2024-09-14T04:55:00.941637+0000 mgr.a (mgr.14355) 17043 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:02 smithi171 bash[25040]: cluster 2024-09-14T04:55:00.685166+0000 mgr.a (mgr.14355) 17042 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:02 smithi171 bash[25040]: audit 2024-09-14T04:55:00.941637+0000 mgr.a (mgr.14355) 17043 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:04 smithi007 bash[22722]: cluster 2024-09-14T04:55:02.686017+0000 mgr.a (mgr.14355) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:04 smithi131 bash[24745]: cluster 2024-09-14T04:55:02.686017+0000 mgr.a (mgr.14355) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:04.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:04 smithi171 bash[25040]: cluster 2024-09-14T04:55:02.686017+0000 mgr.a (mgr.14355) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:06.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:06.355 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:06 smithi007 bash[22722]: cluster 2024-09-14T04:55:04.686972+0000 mgr.a (mgr.14355) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:55:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:06 smithi131 bash[24745]: cluster 2024-09-14T04:55:04.686972+0000 mgr.a (mgr.14355) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:55:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:06 smithi171 bash[25040]: cluster 2024-09-14T04:55:04.686972+0000 mgr.a (mgr.14355) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:55:07.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:07.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:08 smithi007 bash[22722]: cluster 2024-09-14T04:55:06.689174+0000 mgr.a (mgr.14355) 17046 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:08 smithi007 bash[22722]: audit 2024-09-14T04:55:06.691420+0000 mgr.a (mgr.14355) 17047 : audit [DBG] from='client.366993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:08 smithi131 bash[24745]: cluster 2024-09-14T04:55:06.689174+0000 mgr.a (mgr.14355) 17046 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:08 smithi131 bash[24745]: audit 2024-09-14T04:55:06.691420+0000 mgr.a (mgr.14355) 17047 : audit [DBG] from='client.366993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:08 smithi171 bash[25040]: cluster 2024-09-14T04:55:06.689174+0000 mgr.a (mgr.14355) 17046 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:08 smithi171 bash[25040]: audit 2024-09-14T04:55:06.691420+0000 mgr.a (mgr.14355) 17047 : audit [DBG] from='client.366993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:10 smithi007 bash[22722]: cluster 2024-09-14T04:55:08.690216+0000 mgr.a (mgr.14355) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:10 smithi131 bash[24745]: cluster 2024-09-14T04:55:08.690216+0000 mgr.a (mgr.14355) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:10 smithi171 bash[25040]: cluster 2024-09-14T04:55:08.690216+0000 mgr.a (mgr.14355) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:12.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:12.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:12.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:12 smithi007 bash[22722]: cluster 2024-09-14T04:55:10.692471+0000 mgr.a (mgr.14355) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:12 smithi131 bash[24745]: cluster 2024-09-14T04:55:10.692471+0000 mgr.a (mgr.14355) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:12 smithi171 bash[25040]: cluster 2024-09-14T04:55:10.692471+0000 mgr.a (mgr.14355) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:12.853 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:12.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:13 smithi007 bash[22722]: audit 2024-09-14T04:55:12.435252+0000 mgr.a (mgr.14355) 17050 : audit [DBG] from='client.367065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:13 smithi131 bash[24745]: audit 2024-09-14T04:55:12.435252+0000 mgr.a (mgr.14355) 17050 : audit [DBG] from='client.367065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:13 smithi171 bash[25040]: audit 2024-09-14T04:55:12.435252+0000 mgr.a (mgr.14355) 17050 : audit [DBG] from='client.367065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:14 smithi007 bash[22722]: cluster 2024-09-14T04:55:12.693566+0000 mgr.a (mgr.14355) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:14 smithi131 bash[24745]: cluster 2024-09-14T04:55:12.693566+0000 mgr.a (mgr.14355) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:14 smithi171 bash[25040]: cluster 2024-09-14T04:55:12.693566+0000 mgr.a (mgr.14355) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:16 smithi007 bash[22722]: cluster 2024-09-14T04:55:14.694581+0000 mgr.a (mgr.14355) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:16 smithi131 bash[24745]: cluster 2024-09-14T04:55:14.694581+0000 mgr.a (mgr.14355) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:16 smithi171 bash[25040]: cluster 2024-09-14T04:55:14.694581+0000 mgr.a (mgr.14355) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:18.624 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:18.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:18.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:18 smithi007 bash[22722]: cluster 2024-09-14T04:55:16.696831+0000 mgr.a (mgr.14355) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:18 smithi131 bash[24745]: cluster 2024-09-14T04:55:16.696831+0000 mgr.a (mgr.14355) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:18 smithi171 bash[25040]: cluster 2024-09-14T04:55:16.696831+0000 mgr.a (mgr.14355) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:19 smithi007 bash[22722]: audit 2024-09-14T04:55:18.188478+0000 mgr.a (mgr.14355) 17054 : audit [DBG] from='client.367143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:19 smithi131 bash[24745]: audit 2024-09-14T04:55:18.188478+0000 mgr.a (mgr.14355) 17054 : audit [DBG] from='client.367143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:19 smithi171 bash[25040]: audit 2024-09-14T04:55:18.188478+0000 mgr.a (mgr.14355) 17054 : audit [DBG] from='client.367143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:20 smithi131 bash[24745]: cluster 2024-09-14T04:55:18.697560+0000 mgr.a (mgr.14355) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:20 smithi171 bash[25040]: cluster 2024-09-14T04:55:18.697560+0000 mgr.a (mgr.14355) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:20 smithi007 bash[22722]: cluster 2024-09-14T04:55:18.697560+0000 mgr.a (mgr.14355) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:22 smithi131 bash[24745]: cluster 2024-09-14T04:55:20.699821+0000 mgr.a (mgr.14355) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:22 smithi171 bash[25040]: cluster 2024-09-14T04:55:20.699821+0000 mgr.a (mgr.14355) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:22 smithi007 bash[22722]: cluster 2024-09-14T04:55:20.699821+0000 mgr.a (mgr.14355) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:23.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:23.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:23.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:24.378 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:24 smithi131 bash[24745]: cluster 2024-09-14T04:55:22.700775+0000 mgr.a (mgr.14355) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:24 smithi171 bash[25040]: cluster 2024-09-14T04:55:22.700775+0000 mgr.a (mgr.14355) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:24 smithi007 bash[22722]: cluster 2024-09-14T04:55:22.700775+0000 mgr.a (mgr.14355) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:25 smithi131 bash[24745]: audit 2024-09-14T04:55:23.956879+0000 mgr.a (mgr.14355) 17058 : audit [DBG] from='client.367218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:25 smithi131 bash[24745]: audit 2024-09-14T04:55:25.432833+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:55:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:25 smithi171 bash[25040]: audit 2024-09-14T04:55:23.956879+0000 mgr.a (mgr.14355) 17058 : audit [DBG] from='client.367218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:25 smithi171 bash[25040]: audit 2024-09-14T04:55:25.432833+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:55:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:25 smithi007 bash[22722]: audit 2024-09-14T04:55:23.956879+0000 mgr.a (mgr.14355) 17058 : audit [DBG] from='client.367218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:25 smithi007 bash[22722]: audit 2024-09-14T04:55:25.432833+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:26 smithi131 bash[24745]: cluster 2024-09-14T04:55:24.701629+0000 mgr.a (mgr.14355) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:26 smithi131 bash[24745]: audit 2024-09-14T04:55:26.047670+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:26 smithi131 bash[24745]: audit 2024-09-14T04:55:26.052257+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:26 smithi131 bash[24745]: audit 2024-09-14T04:55:26.059966+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:26 smithi131 bash[24745]: audit 2024-09-14T04:55:26.065231+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:26 smithi171 bash[25040]: cluster 2024-09-14T04:55:24.701629+0000 mgr.a (mgr.14355) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:26 smithi171 bash[25040]: audit 2024-09-14T04:55:26.047670+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:26 smithi171 bash[25040]: audit 2024-09-14T04:55:26.052257+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:26 smithi171 bash[25040]: audit 2024-09-14T04:55:26.059966+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:26 smithi171 bash[25040]: audit 2024-09-14T04:55:26.065231+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:26 smithi007 bash[22722]: cluster 2024-09-14T04:55:24.701629+0000 mgr.a (mgr.14355) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:26 smithi007 bash[22722]: audit 2024-09-14T04:55:26.047670+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:26 smithi007 bash[22722]: audit 2024-09-14T04:55:26.052257+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:26 smithi007 bash[22722]: audit 2024-09-14T04:55:26.059966+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:26 smithi007 bash[22722]: audit 2024-09-14T04:55:26.065231+0000 mon.a (mon.0) 3134 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:28 smithi131 bash[24745]: cluster 2024-09-14T04:55:26.703966+0000 mgr.a (mgr.14355) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:28 smithi171 bash[25040]: cluster 2024-09-14T04:55:26.703966+0000 mgr.a (mgr.14355) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:28.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:28 smithi007 bash[22722]: cluster 2024-09-14T04:55:26.703966+0000 mgr.a (mgr.14355) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:29.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:29.381 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:30.135 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:30.135 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:30 smithi131 bash[24745]: cluster 2024-09-14T04:55:28.704907+0000 mgr.a (mgr.14355) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:30 smithi171 bash[25040]: cluster 2024-09-14T04:55:28.704907+0000 mgr.a (mgr.14355) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:30 smithi007 bash[22722]: cluster 2024-09-14T04:55:28.704907+0000 mgr.a (mgr.14355) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:31 smithi131 bash[24745]: audit 2024-09-14T04:55:29.716942+0000 mgr.a (mgr.14355) 17062 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:31 smithi171 bash[25040]: audit 2024-09-14T04:55:29.716942+0000 mgr.a (mgr.14355) 17062 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:31 smithi007 bash[22722]: audit 2024-09-14T04:55:29.716942+0000 mgr.a (mgr.14355) 17062 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:32 smithi131 bash[24745]: cluster 2024-09-14T04:55:30.707323+0000 mgr.a (mgr.14355) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:32 smithi171 bash[25040]: cluster 2024-09-14T04:55:30.707323+0000 mgr.a (mgr.14355) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:32 smithi007 bash[22722]: cluster 2024-09-14T04:55:30.707323+0000 mgr.a (mgr.14355) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:34 smithi131 bash[24745]: cluster 2024-09-14T04:55:32.708078+0000 mgr.a (mgr.14355) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:34 smithi171 bash[25040]: cluster 2024-09-14T04:55:32.708078+0000 mgr.a (mgr.14355) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:34 smithi007 bash[22722]: cluster 2024-09-14T04:55:32.708078+0000 mgr.a (mgr.14355) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:35.136 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:35.137 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:35.898 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:35.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:35.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:35.898 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:35.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: cluster 2024-09-14T04:55:34.708831+0000 mgr.a (mgr.14355) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:35.475792+0000 mgr.a (mgr.14355) 17066 : audit [DBG] from='client.367368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.295416+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.303952+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.380613+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.389778+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.391955+0000 mon.a (mon.0) 3139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.394021+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.404656+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:36 smithi131 bash[24745]: audit 2024-09-14T04:55:36.409624+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: cluster 2024-09-14T04:55:34.708831+0000 mgr.a (mgr.14355) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:35.475792+0000 mgr.a (mgr.14355) 17066 : audit [DBG] from='client.367368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.295416+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.303952+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.380613+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.389778+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.391955+0000 mon.a (mon.0) 3139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.394021+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.404656+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:36 smithi171 bash[25040]: audit 2024-09-14T04:55:36.409624+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: cluster 2024-09-14T04:55:34.708831+0000 mgr.a (mgr.14355) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:35.475792+0000 mgr.a (mgr.14355) 17066 : audit [DBG] from='client.367368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.295416+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.303952+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.380613+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.389778+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.391955+0000 mon.a (mon.0) 3139 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.394021+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.404656+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:55:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:36 smithi007 bash[22722]: audit 2024-09-14T04:55:36.409624+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:37.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:55:37 smithi007 bash[22972]: debug 2024-09-14T04:55:37.173+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:55:37.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:55:37 smithi007 bash[22972]: debug 2024-09-14T04:55:37.173+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:55:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:37 smithi131 bash[24745]: audit 2024-09-14T04:55:36.412216+0000 mgr.a (mgr.14355) 17067 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:37 smithi171 bash[25040]: audit 2024-09-14T04:55:36.412216+0000 mgr.a (mgr.14355) 17067 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:37 smithi007 bash[22722]: audit 2024-09-14T04:55:36.412216+0000 mgr.a (mgr.14355) 17067 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:55:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:38 smithi131 bash[24745]: cluster 2024-09-14T04:55:36.710228+0000 mgr.a (mgr.14355) 17068 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:38 smithi131 bash[24745]: audit 2024-09-14T04:55:37.174728+0000 mgr.a (mgr.14355) 17069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:55:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:38 smithi131 bash[24745]: cephadm 2024-09-14T04:55:37.176191+0000 mgr.a (mgr.14355) 17070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:55:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:38 smithi171 bash[25040]: cluster 2024-09-14T04:55:36.710228+0000 mgr.a (mgr.14355) 17068 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:38 smithi171 bash[25040]: audit 2024-09-14T04:55:37.174728+0000 mgr.a (mgr.14355) 17069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:55:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:38 smithi171 bash[25040]: cephadm 2024-09-14T04:55:37.176191+0000 mgr.a (mgr.14355) 17070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:55:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:38 smithi007 bash[22722]: cluster 2024-09-14T04:55:36.710228+0000 mgr.a (mgr.14355) 17068 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:38 smithi007 bash[22722]: audit 2024-09-14T04:55:37.174728+0000 mgr.a (mgr.14355) 17069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:55:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:38 smithi007 bash[22722]: cephadm 2024-09-14T04:55:37.176191+0000 mgr.a (mgr.14355) 17070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:55:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:40 smithi131 bash[24745]: cluster 2024-09-14T04:55:38.711060+0000 mgr.a (mgr.14355) 17071 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:40 smithi171 bash[25040]: cluster 2024-09-14T04:55:38.711060+0000 mgr.a (mgr.14355) 17071 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:40.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:40.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:40.900 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:40 smithi007 bash[22722]: cluster 2024-09-14T04:55:38.711060+0000 mgr.a (mgr.14355) 17071 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:55:41.677 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:42 smithi131 bash[24745]: cluster 2024-09-14T04:55:40.713306+0000 mgr.a (mgr.14355) 17072 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:42 smithi131 bash[24745]: audit 2024-09-14T04:55:41.239906+0000 mgr.a (mgr.14355) 17073 : audit [DBG] from='client.367551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:42 smithi171 bash[25040]: cluster 2024-09-14T04:55:40.713306+0000 mgr.a (mgr.14355) 17072 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:42 smithi171 bash[25040]: audit 2024-09-14T04:55:41.239906+0000 mgr.a (mgr.14355) 17073 : audit [DBG] from='client.367551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:42 smithi007 bash[22722]: cluster 2024-09-14T04:55:40.713306+0000 mgr.a (mgr.14355) 17072 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:42 smithi007 bash[22722]: audit 2024-09-14T04:55:41.239906+0000 mgr.a (mgr.14355) 17073 : audit [DBG] from='client.367551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:44 smithi131 bash[24745]: cluster 2024-09-14T04:55:42.714188+0000 mgr.a (mgr.14355) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:44 smithi171 bash[25040]: cluster 2024-09-14T04:55:42.714188+0000 mgr.a (mgr.14355) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:44 smithi007 bash[22722]: cluster 2024-09-14T04:55:42.714188+0000 mgr.a (mgr.14355) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:46.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:46.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:46.680 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:46 smithi131 bash[24745]: cluster 2024-09-14T04:55:44.714945+0000 mgr.a (mgr.14355) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:46 smithi171 bash[25040]: cluster 2024-09-14T04:55:44.714945+0000 mgr.a (mgr.14355) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:46 smithi007 bash[22722]: cluster 2024-09-14T04:55:44.714945+0000 mgr.a (mgr.14355) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:55:47.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:48 smithi171 bash[25040]: cluster 2024-09-14T04:55:46.717159+0000 mgr.a (mgr.14355) 17076 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:48 smithi171 bash[25040]: audit 2024-09-14T04:55:47.017538+0000 mgr.a (mgr.14355) 17077 : audit [DBG] from='client.367626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:48 smithi007 bash[22722]: cluster 2024-09-14T04:55:46.717159+0000 mgr.a (mgr.14355) 17076 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:48.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:48 smithi007 bash[22722]: audit 2024-09-14T04:55:47.017538+0000 mgr.a (mgr.14355) 17077 : audit [DBG] from='client.367626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:48 smithi131 bash[24745]: cluster 2024-09-14T04:55:46.717159+0000 mgr.a (mgr.14355) 17076 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:48 smithi131 bash[24745]: audit 2024-09-14T04:55:47.017538+0000 mgr.a (mgr.14355) 17077 : audit [DBG] from='client.367626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:50 smithi171 bash[25040]: cluster 2024-09-14T04:55:48.718058+0000 mgr.a (mgr.14355) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:50 smithi007 bash[22722]: cluster 2024-09-14T04:55:48.718058+0000 mgr.a (mgr.14355) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:50 smithi131 bash[24745]: cluster 2024-09-14T04:55:48.718058+0000 mgr.a (mgr.14355) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:52.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:52.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:52.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:52 smithi171 bash[25040]: cluster 2024-09-14T04:55:50.720361+0000 mgr.a (mgr.14355) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:52 smithi007 bash[22722]: cluster 2024-09-14T04:55:50.720361+0000 mgr.a (mgr.14355) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:52 smithi131 bash[24745]: cluster 2024-09-14T04:55:50.720361+0000 mgr.a (mgr.14355) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:55:53.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:53.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:53.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:53.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:53.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:54 smithi007 bash[22722]: cluster 2024-09-14T04:55:52.721096+0000 mgr.a (mgr.14355) 17080 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:54 smithi007 bash[22722]: audit 2024-09-14T04:55:52.804437+0000 mgr.a (mgr.14355) 17081 : audit [DBG] from='client.367701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:54 smithi131 bash[24745]: cluster 2024-09-14T04:55:52.721096+0000 mgr.a (mgr.14355) 17080 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:54 smithi131 bash[24745]: audit 2024-09-14T04:55:52.804437+0000 mgr.a (mgr.14355) 17081 : audit [DBG] from='client.367701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:54 smithi171 bash[25040]: cluster 2024-09-14T04:55:52.721096+0000 mgr.a (mgr.14355) 17080 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:54 smithi171 bash[25040]: audit 2024-09-14T04:55:52.804437+0000 mgr.a (mgr.14355) 17081 : audit [DBG] from='client.367701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:56 smithi007 bash[22722]: cluster 2024-09-14T04:55:54.721991+0000 mgr.a (mgr.14355) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:56 smithi131 bash[24745]: cluster 2024-09-14T04:55:54.721991+0000 mgr.a (mgr.14355) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:56 smithi171 bash[25040]: cluster 2024-09-14T04:55:54.721991+0000 mgr.a (mgr.14355) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:55:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:55:58.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:55:58.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:55:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:58 smithi007 bash[22722]: cluster 2024-09-14T04:55:56.724273+0000 mgr.a (mgr.14355) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:58.981 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:55:58.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:55:58.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:55:58.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:55:58.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:55:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:58 smithi131 bash[24745]: cluster 2024-09-14T04:55:56.724273+0000 mgr.a (mgr.14355) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:58 smithi171 bash[25040]: cluster 2024-09-14T04:55:56.724273+0000 mgr.a (mgr.14355) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:55:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:59 smithi007 bash[22722]: audit 2024-09-14T04:55:58.562795+0000 mgr.a (mgr.14355) 17084 : audit [DBG] from='client.367776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:55:59.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:55:59 smithi007 bash[22722]: cluster 2024-09-14T04:55:58.724835+0000 mgr.a (mgr.14355) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:59 smithi131 bash[24745]: audit 2024-09-14T04:55:58.562795+0000 mgr.a (mgr.14355) 17084 : audit [DBG] from='client.367776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:55:59 smithi131 bash[24745]: cluster 2024-09-14T04:55:58.724835+0000 mgr.a (mgr.14355) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:59 smithi171 bash[25040]: audit 2024-09-14T04:55:58.562795+0000 mgr.a (mgr.14355) 17084 : audit [DBG] from='client.367776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:55:59 smithi171 bash[25040]: cluster 2024-09-14T04:55:58.724835+0000 mgr.a (mgr.14355) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:01 smithi171 bash[25040]: cluster 2024-09-14T04:56:00.727168+0000 mgr.a (mgr.14355) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:01 smithi007 bash[22722]: cluster 2024-09-14T04:56:00.727168+0000 mgr.a (mgr.14355) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:01 smithi131 bash[24745]: cluster 2024-09-14T04:56:00.727168+0000 mgr.a (mgr.14355) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:03.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:03.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:03.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:03 smithi171 bash[25040]: cluster 2024-09-14T04:56:02.727945+0000 mgr.a (mgr.14355) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:03 smithi007 bash[22722]: cluster 2024-09-14T04:56:02.727945+0000 mgr.a (mgr.14355) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:03 smithi131 bash[24745]: cluster 2024-09-14T04:56:02.727945+0000 mgr.a (mgr.14355) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:04.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:04.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:04.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:04.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:04.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:04 smithi007 bash[22722]: audit 2024-09-14T04:56:04.314703+0000 mgr.a (mgr.14355) 17088 : audit [DBG] from='client.367854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:04 smithi131 bash[24745]: audit 2024-09-14T04:56:04.314703+0000 mgr.a (mgr.14355) 17088 : audit [DBG] from='client.367854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:04 smithi171 bash[25040]: audit 2024-09-14T04:56:04.314703+0000 mgr.a (mgr.14355) 17088 : audit [DBG] from='client.367854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:05 smithi007 bash[22722]: cluster 2024-09-14T04:56:04.728506+0000 mgr.a (mgr.14355) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:05 smithi131 bash[24745]: cluster 2024-09-14T04:56:04.728506+0000 mgr.a (mgr.14355) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:05 smithi171 bash[25040]: cluster 2024-09-14T04:56:04.728506+0000 mgr.a (mgr.14355) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:07 smithi007 bash[22722]: cluster 2024-09-14T04:56:06.730744+0000 mgr.a (mgr.14355) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:07 smithi131 bash[24745]: cluster 2024-09-14T04:56:06.730744+0000 mgr.a (mgr.14355) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:07 smithi171 bash[25040]: cluster 2024-09-14T04:56:06.730744+0000 mgr.a (mgr.14355) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:09.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:09.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:09 smithi007 bash[22722]: cluster 2024-09-14T04:56:08.731510+0000 mgr.a (mgr.14355) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:09 smithi131 bash[24745]: cluster 2024-09-14T04:56:08.731510+0000 mgr.a (mgr.14355) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:09 smithi171 bash[25040]: cluster 2024-09-14T04:56:08.731510+0000 mgr.a (mgr.14355) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:10.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:10.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:11.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:10 smithi007 bash[22722]: audit 2024-09-14T04:56:10.095159+0000 mgr.a (mgr.14355) 17092 : audit [DBG] from='client.367932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:10 smithi131 bash[24745]: audit 2024-09-14T04:56:10.095159+0000 mgr.a (mgr.14355) 17092 : audit [DBG] from='client.367932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:10 smithi171 bash[25040]: audit 2024-09-14T04:56:10.095159+0000 mgr.a (mgr.14355) 17092 : audit [DBG] from='client.367932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:11 smithi007 bash[22722]: cluster 2024-09-14T04:56:10.734331+0000 mgr.a (mgr.14355) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:11 smithi131 bash[24745]: cluster 2024-09-14T04:56:10.734331+0000 mgr.a (mgr.14355) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:11 smithi171 bash[25040]: cluster 2024-09-14T04:56:10.734331+0000 mgr.a (mgr.14355) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:13 smithi007 bash[22722]: cluster 2024-09-14T04:56:12.735122+0000 mgr.a (mgr.14355) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:13 smithi131 bash[24745]: cluster 2024-09-14T04:56:12.735122+0000 mgr.a (mgr.14355) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:13 smithi171 bash[25040]: cluster 2024-09-14T04:56:12.735122+0000 mgr.a (mgr.14355) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:15.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:15.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:15.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:15 smithi007 bash[22722]: cluster 2024-09-14T04:56:14.735889+0000 mgr.a (mgr.14355) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:56:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:15 smithi131 bash[24745]: cluster 2024-09-14T04:56:14.735889+0000 mgr.a (mgr.14355) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:56:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:15 smithi171 bash[25040]: cluster 2024-09-14T04:56:14.735889+0000 mgr.a (mgr.14355) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:56:16.296 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:16 smithi007 bash[22722]: audit 2024-09-14T04:56:15.871353+0000 mgr.a (mgr.14355) 17096 : audit [DBG] from='client.368010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:16 smithi131 bash[24745]: audit 2024-09-14T04:56:15.871353+0000 mgr.a (mgr.14355) 17096 : audit [DBG] from='client.368010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:16 smithi171 bash[25040]: audit 2024-09-14T04:56:15.871353+0000 mgr.a (mgr.14355) 17096 : audit [DBG] from='client.368010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:17 smithi007 bash[22722]: cluster 2024-09-14T04:56:16.738759+0000 mgr.a (mgr.14355) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:17 smithi131 bash[24745]: cluster 2024-09-14T04:56:16.738759+0000 mgr.a (mgr.14355) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:17 smithi171 bash[25040]: cluster 2024-09-14T04:56:16.738759+0000 mgr.a (mgr.14355) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:19 smithi007 bash[22722]: cluster 2024-09-14T04:56:18.739547+0000 mgr.a (mgr.14355) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:19 smithi131 bash[24745]: cluster 2024-09-14T04:56:18.739547+0000 mgr.a (mgr.14355) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:19 smithi171 bash[25040]: cluster 2024-09-14T04:56:18.739547+0000 mgr.a (mgr.14355) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:22.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:22.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:22.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:22.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:22.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:21 smithi007 bash[22722]: cluster 2024-09-14T04:56:20.741652+0000 mgr.a (mgr.14355) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:21 smithi131 bash[24745]: cluster 2024-09-14T04:56:20.741652+0000 mgr.a (mgr.14355) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:21 smithi171 bash[25040]: cluster 2024-09-14T04:56:20.741652+0000 mgr.a (mgr.14355) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:22 smithi007 bash[22722]: audit 2024-09-14T04:56:21.631667+0000 mgr.a (mgr.14355) 17100 : audit [DBG] from='client.368079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:22 smithi131 bash[24745]: audit 2024-09-14T04:56:21.631667+0000 mgr.a (mgr.14355) 17100 : audit [DBG] from='client.368079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:22 smithi171 bash[25040]: audit 2024-09-14T04:56:21.631667+0000 mgr.a (mgr.14355) 17100 : audit [DBG] from='client.368079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:23 smithi007 bash[22722]: cluster 2024-09-14T04:56:22.742643+0000 mgr.a (mgr.14355) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:23 smithi131 bash[24745]: cluster 2024-09-14T04:56:22.742643+0000 mgr.a (mgr.14355) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:23 smithi171 bash[25040]: cluster 2024-09-14T04:56:22.742643+0000 mgr.a (mgr.14355) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:25 smithi007 bash[22722]: cluster 2024-09-14T04:56:24.743472+0000 mgr.a (mgr.14355) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:25 smithi131 bash[24745]: cluster 2024-09-14T04:56:24.743472+0000 mgr.a (mgr.14355) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:25 smithi171 bash[25040]: cluster 2024-09-14T04:56:24.743472+0000 mgr.a (mgr.14355) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:27.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:27.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:27 smithi007 bash[22722]: cluster 2024-09-14T04:56:26.745883+0000 mgr.a (mgr.14355) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:27 smithi007 bash[22722]: audit 2024-09-14T04:56:27.415422+0000 mgr.a (mgr.14355) 17104 : audit [DBG] from='client.368157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:27 smithi131 bash[24745]: cluster 2024-09-14T04:56:26.745883+0000 mgr.a (mgr.14355) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:27 smithi131 bash[24745]: audit 2024-09-14T04:56:27.415422+0000 mgr.a (mgr.14355) 17104 : audit [DBG] from='client.368157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:27 smithi171 bash[25040]: cluster 2024-09-14T04:56:26.745883+0000 mgr.a (mgr.14355) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:27 smithi171 bash[25040]: audit 2024-09-14T04:56:27.415422+0000 mgr.a (mgr.14355) 17104 : audit [DBG] from='client.368157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:29 smithi007 bash[22722]: cluster 2024-09-14T04:56:28.746887+0000 mgr.a (mgr.14355) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:29 smithi131 bash[24745]: cluster 2024-09-14T04:56:28.746887+0000 mgr.a (mgr.14355) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:29 smithi171 bash[25040]: cluster 2024-09-14T04:56:28.746887+0000 mgr.a (mgr.14355) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:31 smithi007 bash[22722]: cluster 2024-09-14T04:56:30.749136+0000 mgr.a (mgr.14355) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:31 smithi131 bash[24745]: cluster 2024-09-14T04:56:30.749136+0000 mgr.a (mgr.14355) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:31 smithi171 bash[25040]: cluster 2024-09-14T04:56:30.749136+0000 mgr.a (mgr.14355) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:32.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:32.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:32.845 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:33.599 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:33.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:33.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:33.599 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:33.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:33 smithi007 bash[22722]: cluster 2024-09-14T04:56:32.749929+0000 mgr.a (mgr.14355) 17107 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:33 smithi007 bash[22722]: audit 2024-09-14T04:56:33.174733+0000 mgr.a (mgr.14355) 17108 : audit [DBG] from='client.368235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:33 smithi131 bash[24745]: cluster 2024-09-14T04:56:32.749929+0000 mgr.a (mgr.14355) 17107 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:33 smithi131 bash[24745]: audit 2024-09-14T04:56:33.174733+0000 mgr.a (mgr.14355) 17108 : audit [DBG] from='client.368235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:33 smithi171 bash[25040]: cluster 2024-09-14T04:56:32.749929+0000 mgr.a (mgr.14355) 17107 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:33 smithi171 bash[25040]: audit 2024-09-14T04:56:33.174733+0000 mgr.a (mgr.14355) 17108 : audit [DBG] from='client.368235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:35 smithi007 bash[22722]: cluster 2024-09-14T04:56:34.750842+0000 mgr.a (mgr.14355) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:35 smithi131 bash[24745]: cluster 2024-09-14T04:56:34.750842+0000 mgr.a (mgr.14355) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:35 smithi171 bash[25040]: cluster 2024-09-14T04:56:34.750842+0000 mgr.a (mgr.14355) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:37 smithi007 bash[22722]: cluster 2024-09-14T04:56:36.753085+0000 mgr.a (mgr.14355) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:37 smithi007 bash[22722]: audit 2024-09-14T04:56:37.238750+0000 mon.a (mon.0) 3143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:56:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:37 smithi131 bash[24745]: cluster 2024-09-14T04:56:36.753085+0000 mgr.a (mgr.14355) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:37 smithi131 bash[24745]: audit 2024-09-14T04:56:37.238750+0000 mon.a (mon.0) 3143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:56:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:37 smithi171 bash[25040]: cluster 2024-09-14T04:56:36.753085+0000 mgr.a (mgr.14355) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:56:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:37 smithi171 bash[25040]: audit 2024-09-14T04:56:37.238750+0000 mon.a (mon.0) 3143 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:56:38.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:38.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:38.601 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22972]: debug 2024-09-14T04:56:38.840+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:56:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22972]: debug 2024-09-14T04:56:38.840+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:56:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22722]: audit 2024-09-14T04:56:38.084667+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:56:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22722]: audit 2024-09-14T04:56:38.085878+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:56:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22722]: audit 2024-09-14T04:56:38.094620+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:56:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22722]: audit 2024-09-14T04:56:38.099567+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:38 smithi007 bash[22722]: audit 2024-09-14T04:56:38.101933+0000 mgr.a (mgr.14355) 17111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:38 smithi131 bash[24745]: audit 2024-09-14T04:56:38.084667+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:56:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:38 smithi131 bash[24745]: audit 2024-09-14T04:56:38.085878+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:56:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:38 smithi131 bash[24745]: audit 2024-09-14T04:56:38.094620+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:56:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:38 smithi131 bash[24745]: audit 2024-09-14T04:56:38.099567+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:38 smithi131 bash[24745]: audit 2024-09-14T04:56:38.101933+0000 mgr.a (mgr.14355) 17111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:38 smithi171 bash[25040]: audit 2024-09-14T04:56:38.084667+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:56:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:38 smithi171 bash[25040]: audit 2024-09-14T04:56:38.085878+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:56:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:38 smithi171 bash[25040]: audit 2024-09-14T04:56:38.094620+0000 mon.a (mon.0) 3146 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:56:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:38 smithi171 bash[25040]: audit 2024-09-14T04:56:38.099567+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:38 smithi171 bash[25040]: audit 2024-09-14T04:56:38.101933+0000 mgr.a (mgr.14355) 17111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:56:39.317 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:39.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:39.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:39.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:39.317 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:40 smithi007 bash[22722]: cluster 2024-09-14T04:56:38.753586+0000 mgr.a (mgr.14355) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:40 smithi007 bash[22722]: audit 2024-09-14T04:56:38.844355+0000 mgr.a (mgr.14355) 17113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:56:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:40 smithi007 bash[22722]: cephadm 2024-09-14T04:56:38.845583+0000 mgr.a (mgr.14355) 17114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:56:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:40 smithi007 bash[22722]: audit 2024-09-14T04:56:38.917129+0000 mgr.a (mgr.14355) 17115 : audit [DBG] from='client.368397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:40 smithi131 bash[24745]: cluster 2024-09-14T04:56:38.753586+0000 mgr.a (mgr.14355) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:40 smithi131 bash[24745]: audit 2024-09-14T04:56:38.844355+0000 mgr.a (mgr.14355) 17113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:40 smithi131 bash[24745]: cephadm 2024-09-14T04:56:38.845583+0000 mgr.a (mgr.14355) 17114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:56:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:40 smithi131 bash[24745]: audit 2024-09-14T04:56:38.917129+0000 mgr.a (mgr.14355) 17115 : audit [DBG] from='client.368397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:40 smithi171 bash[25040]: cluster 2024-09-14T04:56:38.753586+0000 mgr.a (mgr.14355) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:40 smithi171 bash[25040]: audit 2024-09-14T04:56:38.844355+0000 mgr.a (mgr.14355) 17113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:56:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:40 smithi171 bash[25040]: cephadm 2024-09-14T04:56:38.845583+0000 mgr.a (mgr.14355) 17114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:56:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:40 smithi171 bash[25040]: audit 2024-09-14T04:56:38.917129+0000 mgr.a (mgr.14355) 17115 : audit [DBG] from='client.368397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:42 smithi007 bash[22722]: cluster 2024-09-14T04:56:40.755977+0000 mgr.a (mgr.14355) 17116 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:42 smithi131 bash[24745]: cluster 2024-09-14T04:56:40.755977+0000 mgr.a (mgr.14355) 17116 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:42 smithi171 bash[25040]: cluster 2024-09-14T04:56:40.755977+0000 mgr.a (mgr.14355) 17116 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:44.318 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:44.319 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:44.319 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:44 smithi007 bash[22722]: cluster 2024-09-14T04:56:42.756760+0000 mgr.a (mgr.14355) 17117 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:44 smithi131 bash[24745]: cluster 2024-09-14T04:56:42.756760+0000 mgr.a (mgr.14355) 17117 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:44 smithi171 bash[25040]: cluster 2024-09-14T04:56:42.756760+0000 mgr.a (mgr.14355) 17117 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:45.092 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:45.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:45.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:45.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:45.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:46 smithi007 bash[22722]: audit 2024-09-14T04:56:44.659349+0000 mgr.a (mgr.14355) 17118 : audit [DBG] from='client.368490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:46 smithi007 bash[22722]: cluster 2024-09-14T04:56:44.757261+0000 mgr.a (mgr.14355) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:46 smithi131 bash[24745]: audit 2024-09-14T04:56:44.659349+0000 mgr.a (mgr.14355) 17118 : audit [DBG] from='client.368490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:46 smithi131 bash[24745]: cluster 2024-09-14T04:56:44.757261+0000 mgr.a (mgr.14355) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:46 smithi171 bash[25040]: audit 2024-09-14T04:56:44.659349+0000 mgr.a (mgr.14355) 17118 : audit [DBG] from='client.368490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:46 smithi171 bash[25040]: cluster 2024-09-14T04:56:44.757261+0000 mgr.a (mgr.14355) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:48 smithi007 bash[22722]: cluster 2024-09-14T04:56:46.759550+0000 mgr.a (mgr.14355) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:48 smithi131 bash[24745]: cluster 2024-09-14T04:56:46.759550+0000 mgr.a (mgr.14355) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:48 smithi171 bash[25040]: cluster 2024-09-14T04:56:46.759550+0000 mgr.a (mgr.14355) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:50.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:50.095 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:50 smithi007 bash[22722]: cluster 2024-09-14T04:56:48.760342+0000 mgr.a (mgr.14355) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:50 smithi131 bash[24745]: cluster 2024-09-14T04:56:48.760342+0000 mgr.a (mgr.14355) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:50 smithi171 bash[25040]: cluster 2024-09-14T04:56:48.760342+0000 mgr.a (mgr.14355) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:50.870 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:51 smithi007 bash[22722]: audit 2024-09-14T04:56:50.426081+0000 mgr.a (mgr.14355) 17122 : audit [DBG] from='client.368565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:51 smithi131 bash[24745]: audit 2024-09-14T04:56:50.426081+0000 mgr.a (mgr.14355) 17122 : audit [DBG] from='client.368565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:51 smithi171 bash[25040]: audit 2024-09-14T04:56:50.426081+0000 mgr.a (mgr.14355) 17122 : audit [DBG] from='client.368565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:52 smithi007 bash[22722]: cluster 2024-09-14T04:56:50.771339+0000 mgr.a (mgr.14355) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:52 smithi131 bash[24745]: cluster 2024-09-14T04:56:50.771339+0000 mgr.a (mgr.14355) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:52 smithi171 bash[25040]: cluster 2024-09-14T04:56:50.771339+0000 mgr.a (mgr.14355) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:56:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:54 smithi007 bash[22722]: cluster 2024-09-14T04:56:52.772105+0000 mgr.a (mgr.14355) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:54 smithi131 bash[24745]: cluster 2024-09-14T04:56:52.772105+0000 mgr.a (mgr.14355) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:54 smithi171 bash[25040]: cluster 2024-09-14T04:56:52.772105+0000 mgr.a (mgr.14355) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:56:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:56:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:56:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:56 smithi007 bash[22722]: cluster 2024-09-14T04:56:54.772876+0000 mgr.a (mgr.14355) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:56 smithi131 bash[24745]: cluster 2024-09-14T04:56:54.772876+0000 mgr.a (mgr.14355) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:56 smithi171 bash[25040]: cluster 2024-09-14T04:56:54.772876+0000 mgr.a (mgr.14355) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:56:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:56:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:56:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:56:56.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:56:56.646 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:56:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:57 smithi007 bash[22722]: audit 2024-09-14T04:56:56.205149+0000 mgr.a (mgr.14355) 17126 : audit [DBG] from='client.368643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:57 smithi131 bash[24745]: audit 2024-09-14T04:56:56.205149+0000 mgr.a (mgr.14355) 17126 : audit [DBG] from='client.368643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:57 smithi171 bash[25040]: audit 2024-09-14T04:56:56.205149+0000 mgr.a (mgr.14355) 17126 : audit [DBG] from='client.368643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:56:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:56:58 smithi007 bash[22722]: cluster 2024-09-14T04:56:56.775820+0000 mgr.a (mgr.14355) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:56:58 smithi131 bash[24745]: cluster 2024-09-14T04:56:56.775820+0000 mgr.a (mgr.14355) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:56:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:56:58 smithi171 bash[25040]: cluster 2024-09-14T04:56:56.775820+0000 mgr.a (mgr.14355) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:00 smithi007 bash[22722]: cluster 2024-09-14T04:56:58.776676+0000 mgr.a (mgr.14355) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:00 smithi131 bash[24745]: cluster 2024-09-14T04:56:58.776676+0000 mgr.a (mgr.14355) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:00 smithi171 bash[25040]: cluster 2024-09-14T04:56:58.776676+0000 mgr.a (mgr.14355) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:01.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:02.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:02.437 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:02 smithi007 bash[22722]: cluster 2024-09-14T04:57:00.778686+0000 mgr.a (mgr.14355) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:02 smithi131 bash[24745]: cluster 2024-09-14T04:57:00.778686+0000 mgr.a (mgr.14355) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:02 smithi171 bash[25040]: cluster 2024-09-14T04:57:00.778686+0000 mgr.a (mgr.14355) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:03 smithi007 bash[22722]: audit 2024-09-14T04:57:01.982262+0000 mgr.a (mgr.14355) 17130 : audit [DBG] from='client.368718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:03 smithi131 bash[24745]: audit 2024-09-14T04:57:01.982262+0000 mgr.a (mgr.14355) 17130 : audit [DBG] from='client.368718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:03 smithi171 bash[25040]: audit 2024-09-14T04:57:01.982262+0000 mgr.a (mgr.14355) 17130 : audit [DBG] from='client.368718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:04 smithi007 bash[22722]: cluster 2024-09-14T04:57:02.779668+0000 mgr.a (mgr.14355) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:04 smithi131 bash[24745]: cluster 2024-09-14T04:57:02.779668+0000 mgr.a (mgr.14355) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:04 smithi171 bash[25040]: cluster 2024-09-14T04:57:02.779668+0000 mgr.a (mgr.14355) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:06 smithi007 bash[22722]: cluster 2024-09-14T04:57:04.780610+0000 mgr.a (mgr.14355) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:06 smithi131 bash[24745]: cluster 2024-09-14T04:57:04.780610+0000 mgr.a (mgr.14355) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:06 smithi171 bash[25040]: cluster 2024-09-14T04:57:04.780610+0000 mgr.a (mgr.14355) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:07.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:07.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:07.439 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:08.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:08.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:08 smithi007 bash[22722]: cluster 2024-09-14T04:57:06.783055+0000 mgr.a (mgr.14355) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:08 smithi131 bash[24745]: cluster 2024-09-14T04:57:06.783055+0000 mgr.a (mgr.14355) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:08 smithi171 bash[25040]: cluster 2024-09-14T04:57:06.783055+0000 mgr.a (mgr.14355) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:09 smithi007 bash[22722]: audit 2024-09-14T04:57:07.780406+0000 mgr.a (mgr.14355) 17134 : audit [DBG] from='client.368796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:09 smithi131 bash[24745]: audit 2024-09-14T04:57:07.780406+0000 mgr.a (mgr.14355) 17134 : audit [DBG] from='client.368796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:09 smithi171 bash[25040]: audit 2024-09-14T04:57:07.780406+0000 mgr.a (mgr.14355) 17134 : audit [DBG] from='client.368796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:10 smithi007 bash[22722]: cluster 2024-09-14T04:57:08.784075+0000 mgr.a (mgr.14355) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:10 smithi131 bash[24745]: cluster 2024-09-14T04:57:08.784075+0000 mgr.a (mgr.14355) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:10 smithi171 bash[25040]: cluster 2024-09-14T04:57:08.784075+0000 mgr.a (mgr.14355) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:12 smithi007 bash[22722]: cluster 2024-09-14T04:57:10.786270+0000 mgr.a (mgr.14355) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:12 smithi131 bash[24745]: cluster 2024-09-14T04:57:10.786270+0000 mgr.a (mgr.14355) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:12 smithi171 bash[25040]: cluster 2024-09-14T04:57:10.786270+0000 mgr.a (mgr.14355) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:13.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:13.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:14.000 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:14 smithi007 bash[22722]: cluster 2024-09-14T04:57:12.786985+0000 mgr.a (mgr.14355) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:14 smithi007 bash[22722]: audit 2024-09-14T04:57:13.558208+0000 mgr.a (mgr.14355) 17138 : audit [DBG] from='client.368874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:14 smithi131 bash[24745]: cluster 2024-09-14T04:57:12.786985+0000 mgr.a (mgr.14355) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:14 smithi131 bash[24745]: audit 2024-09-14T04:57:13.558208+0000 mgr.a (mgr.14355) 17138 : audit [DBG] from='client.368874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:14 smithi171 bash[25040]: cluster 2024-09-14T04:57:12.786985+0000 mgr.a (mgr.14355) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:14 smithi171 bash[25040]: audit 2024-09-14T04:57:13.558208+0000 mgr.a (mgr.14355) 17138 : audit [DBG] from='client.368874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:16 smithi007 bash[22722]: cluster 2024-09-14T04:57:14.787909+0000 mgr.a (mgr.14355) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:16 smithi131 bash[24745]: cluster 2024-09-14T04:57:14.787909+0000 mgr.a (mgr.14355) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:16 smithi171 bash[25040]: cluster 2024-09-14T04:57:14.787909+0000 mgr.a (mgr.14355) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:18 smithi007 bash[22722]: cluster 2024-09-14T04:57:16.790200+0000 mgr.a (mgr.14355) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:18 smithi131 bash[24745]: cluster 2024-09-14T04:57:16.790200+0000 mgr.a (mgr.14355) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:18 smithi171 bash[25040]: cluster 2024-09-14T04:57:16.790200+0000 mgr.a (mgr.14355) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:19.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:19.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:19.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:19.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:19.785 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:20 smithi007 bash[22722]: cluster 2024-09-14T04:57:18.790969+0000 mgr.a (mgr.14355) 17141 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:20 smithi007 bash[22722]: audit 2024-09-14T04:57:19.339426+0000 mgr.a (mgr.14355) 17142 : audit [DBG] from='client.368952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:20 smithi131 bash[24745]: cluster 2024-09-14T04:57:18.790969+0000 mgr.a (mgr.14355) 17141 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:20 smithi131 bash[24745]: audit 2024-09-14T04:57:19.339426+0000 mgr.a (mgr.14355) 17142 : audit [DBG] from='client.368952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:20 smithi171 bash[25040]: cluster 2024-09-14T04:57:18.790969+0000 mgr.a (mgr.14355) 17141 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:20 smithi171 bash[25040]: audit 2024-09-14T04:57:19.339426+0000 mgr.a (mgr.14355) 17142 : audit [DBG] from='client.368952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:22 smithi007 bash[22722]: cluster 2024-09-14T04:57:20.793382+0000 mgr.a (mgr.14355) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:22 smithi131 bash[24745]: cluster 2024-09-14T04:57:20.793382+0000 mgr.a (mgr.14355) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:22 smithi171 bash[25040]: cluster 2024-09-14T04:57:20.793382+0000 mgr.a (mgr.14355) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:24 smithi007 bash[22722]: cluster 2024-09-14T04:57:22.794163+0000 mgr.a (mgr.14355) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:24 smithi131 bash[24745]: cluster 2024-09-14T04:57:22.794163+0000 mgr.a (mgr.14355) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:24 smithi171 bash[25040]: cluster 2024-09-14T04:57:22.794163+0000 mgr.a (mgr.14355) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:25.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:25.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:25.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:25.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:25.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:26 smithi007 bash[22722]: cluster 2024-09-14T04:57:24.794791+0000 mgr.a (mgr.14355) 17145 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:26 smithi007 bash[22722]: audit 2024-09-14T04:57:25.125581+0000 mgr.a (mgr.14355) 17146 : audit [DBG] from='client.369024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:26 smithi131 bash[24745]: cluster 2024-09-14T04:57:24.794791+0000 mgr.a (mgr.14355) 17145 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:26 smithi131 bash[24745]: audit 2024-09-14T04:57:25.125581+0000 mgr.a (mgr.14355) 17146 : audit [DBG] from='client.369024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:26 smithi171 bash[25040]: cluster 2024-09-14T04:57:24.794791+0000 mgr.a (mgr.14355) 17145 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:26 smithi171 bash[25040]: audit 2024-09-14T04:57:25.125581+0000 mgr.a (mgr.14355) 17146 : audit [DBG] from='client.369024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:28 smithi007 bash[22722]: cluster 2024-09-14T04:57:26.797659+0000 mgr.a (mgr.14355) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:28 smithi131 bash[24745]: cluster 2024-09-14T04:57:26.797659+0000 mgr.a (mgr.14355) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:28 smithi171 bash[25040]: cluster 2024-09-14T04:57:26.797659+0000 mgr.a (mgr.14355) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:30.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:30.558 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:30.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:30 smithi007 bash[22722]: cluster 2024-09-14T04:57:28.798535+0000 mgr.a (mgr.14355) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:30 smithi131 bash[24745]: cluster 2024-09-14T04:57:28.798535+0000 mgr.a (mgr.14355) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:30 smithi171 bash[25040]: cluster 2024-09-14T04:57:28.798535+0000 mgr.a (mgr.14355) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:31.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:31.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:31.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:31.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:31.319 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:32 smithi007 bash[22722]: cluster 2024-09-14T04:57:30.800442+0000 mgr.a (mgr.14355) 17149 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:32.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:32 smithi007 bash[22722]: audit 2024-09-14T04:57:30.886698+0000 mgr.a (mgr.14355) 17150 : audit [DBG] from='client.369102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:32 smithi131 bash[24745]: cluster 2024-09-14T04:57:30.800442+0000 mgr.a (mgr.14355) 17149 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:32 smithi131 bash[24745]: audit 2024-09-14T04:57:30.886698+0000 mgr.a (mgr.14355) 17150 : audit [DBG] from='client.369102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:32 smithi171 bash[25040]: cluster 2024-09-14T04:57:30.800442+0000 mgr.a (mgr.14355) 17149 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:32 smithi171 bash[25040]: audit 2024-09-14T04:57:30.886698+0000 mgr.a (mgr.14355) 17150 : audit [DBG] from='client.369102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:34 smithi131 bash[24745]: cluster 2024-09-14T04:57:32.801339+0000 mgr.a (mgr.14355) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:34 smithi171 bash[25040]: cluster 2024-09-14T04:57:32.801339+0000 mgr.a (mgr.14355) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:34 smithi007 bash[22722]: cluster 2024-09-14T04:57:32.801339+0000 mgr.a (mgr.14355) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:57:36.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:36.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:36.321 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:36 smithi131 bash[24745]: cluster 2024-09-14T04:57:34.802128+0000 mgr.a (mgr.14355) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:57:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:36 smithi171 bash[25040]: cluster 2024-09-14T04:57:34.802128+0000 mgr.a (mgr.14355) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:57:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:36 smithi007 bash[22722]: cluster 2024-09-14T04:57:34.802128+0000 mgr.a (mgr.14355) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:57:37.101 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:37.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:38 smithi131 bash[24745]: audit 2024-09-14T04:57:36.655846+0000 mgr.a (mgr.14355) 17153 : audit [DBG] from='client.369180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:38.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:38 smithi131 bash[24745]: cluster 2024-09-14T04:57:36.804206+0000 mgr.a (mgr.14355) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:38 smithi171 bash[25040]: audit 2024-09-14T04:57:36.655846+0000 mgr.a (mgr.14355) 17153 : audit [DBG] from='client.369180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:38 smithi171 bash[25040]: cluster 2024-09-14T04:57:36.804206+0000 mgr.a (mgr.14355) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:38 smithi007 bash[22722]: audit 2024-09-14T04:57:36.655846+0000 mgr.a (mgr.14355) 17153 : audit [DBG] from='client.369180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:38 smithi007 bash[22722]: cluster 2024-09-14T04:57:36.804206+0000 mgr.a (mgr.14355) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:39 smithi131 bash[24745]: audit 2024-09-14T04:57:38.895316+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:57:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:39 smithi171 bash[25040]: audit 2024-09-14T04:57:38.895316+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:57:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:39 smithi007 bash[22722]: audit 2024-09-14T04:57:38.895316+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:57:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: cluster 2024-09-14T04:57:38.805151+0000 mgr.a (mgr.14355) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.221026+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.226233+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.250062+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.253719+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.259036+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.264521+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.265861+0000 mon.a (mon.0) 3155 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:57:40.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.267180+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:57:40.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.275737+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:40 smithi131 bash[24745]: audit 2024-09-14T04:57:40.280496+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: cluster 2024-09-14T04:57:38.805151+0000 mgr.a (mgr.14355) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.221026+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.226233+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.250062+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.253719+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.259036+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.264521+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.265861+0000 mon.a (mon.0) 3155 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:57:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.267180+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:57:40.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.275737+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:40 smithi171 bash[25040]: audit 2024-09-14T04:57:40.280496+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: cluster 2024-09-14T04:57:38.805151+0000 mgr.a (mgr.14355) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.221026+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.226233+0000 mon.a (mon.0) 3150 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.250062+0000 mon.a (mon.0) 3151 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.253719+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.259036+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.264521+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.265861+0000 mon.a (mon.0) 3155 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.267180+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.275737+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:57:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:40 smithi007 bash[22722]: audit 2024-09-14T04:57:40.280496+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:41.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:57:41 smithi007 bash[22972]: debug 2024-09-14T04:57:41.019+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:57:41.485 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:57:41 smithi007 bash[22972]: debug 2024-09-14T04:57:41.023+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:57:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:41 smithi131 bash[24745]: audit 2024-09-14T04:57:40.282747+0000 mgr.a (mgr.14355) 17156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:41 smithi171 bash[25040]: audit 2024-09-14T04:57:40.282747+0000 mgr.a (mgr.14355) 17156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:41 smithi007 bash[22722]: audit 2024-09-14T04:57:40.282747+0000 mgr.a (mgr.14355) 17156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:57:42.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:42.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:42 smithi131 bash[24745]: cluster 2024-09-14T04:57:40.806626+0000 mgr.a (mgr.14355) 17157 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:42 smithi131 bash[24745]: audit 2024-09-14T04:57:41.025599+0000 mgr.a (mgr.14355) 17158 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:57:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:42 smithi131 bash[24745]: cephadm 2024-09-14T04:57:41.027045+0000 mgr.a (mgr.14355) 17159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:57:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:42 smithi171 bash[25040]: cluster 2024-09-14T04:57:40.806626+0000 mgr.a (mgr.14355) 17157 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:42 smithi171 bash[25040]: audit 2024-09-14T04:57:41.025599+0000 mgr.a (mgr.14355) 17158 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:57:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:42 smithi171 bash[25040]: cephadm 2024-09-14T04:57:41.027045+0000 mgr.a (mgr.14355) 17159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:57:42.878 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:42 smithi007 bash[22722]: cluster 2024-09-14T04:57:40.806626+0000 mgr.a (mgr.14355) 17157 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:57:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:42 smithi007 bash[22722]: audit 2024-09-14T04:57:41.025599+0000 mgr.a (mgr.14355) 17158 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:57:42.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:42 smithi007 bash[22722]: cephadm 2024-09-14T04:57:41.027045+0000 mgr.a (mgr.14355) 17159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:57:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:43 smithi131 bash[24745]: audit 2024-09-14T04:57:42.436868+0000 mgr.a (mgr.14355) 17160 : audit [DBG] from='client.369363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:43 smithi171 bash[25040]: audit 2024-09-14T04:57:42.436868+0000 mgr.a (mgr.14355) 17160 : audit [DBG] from='client.369363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:43 smithi007 bash[22722]: audit 2024-09-14T04:57:42.436868+0000 mgr.a (mgr.14355) 17160 : audit [DBG] from='client.369363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:44.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:44 smithi131 bash[24745]: cluster 2024-09-14T04:57:42.807254+0000 mgr.a (mgr.14355) 17161 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:44 smithi171 bash[25040]: cluster 2024-09-14T04:57:42.807254+0000 mgr.a (mgr.14355) 17161 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:44 smithi007 bash[22722]: cluster 2024-09-14T04:57:42.807254+0000 mgr.a (mgr.14355) 17161 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:46 smithi131 bash[24745]: cluster 2024-09-14T04:57:44.808007+0000 mgr.a (mgr.14355) 17162 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:46 smithi171 bash[25040]: cluster 2024-09-14T04:57:44.808007+0000 mgr.a (mgr.14355) 17162 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:46 smithi007 bash[22722]: cluster 2024-09-14T04:57:44.808007+0000 mgr.a (mgr.14355) 17162 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:57:47.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:48.621 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:48.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:48.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:48.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:48.622 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:48 smithi131 bash[24745]: cluster 2024-09-14T04:57:46.810309+0000 mgr.a (mgr.14355) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:48 smithi171 bash[25040]: cluster 2024-09-14T04:57:46.810309+0000 mgr.a (mgr.14355) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:48 smithi007 bash[22722]: cluster 2024-09-14T04:57:46.810309+0000 mgr.a (mgr.14355) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:49 smithi131 bash[24745]: audit 2024-09-14T04:57:48.207014+0000 mgr.a (mgr.14355) 17164 : audit [DBG] from='client.369441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:49 smithi171 bash[25040]: audit 2024-09-14T04:57:48.207014+0000 mgr.a (mgr.14355) 17164 : audit [DBG] from='client.369441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:49 smithi007 bash[22722]: audit 2024-09-14T04:57:48.207014+0000 mgr.a (mgr.14355) 17164 : audit [DBG] from='client.369441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:50 smithi131 bash[24745]: cluster 2024-09-14T04:57:48.811197+0000 mgr.a (mgr.14355) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:50 smithi171 bash[25040]: cluster 2024-09-14T04:57:48.811197+0000 mgr.a (mgr.14355) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:50 smithi007 bash[22722]: cluster 2024-09-14T04:57:48.811197+0000 mgr.a (mgr.14355) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:52 smithi131 bash[24745]: cluster 2024-09-14T04:57:50.813494+0000 mgr.a (mgr.14355) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:52 smithi171 bash[25040]: cluster 2024-09-14T04:57:50.813494+0000 mgr.a (mgr.14355) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:52 smithi007 bash[22722]: cluster 2024-09-14T04:57:50.813494+0000 mgr.a (mgr.14355) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:57:54.380 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:57:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:57:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:57:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:57:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:57:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:54 smithi131 bash[24745]: cluster 2024-09-14T04:57:52.814309+0000 mgr.a (mgr.14355) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:54 smithi171 bash[25040]: cluster 2024-09-14T04:57:52.814309+0000 mgr.a (mgr.14355) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:54 smithi007 bash[22722]: cluster 2024-09-14T04:57:52.814309+0000 mgr.a (mgr.14355) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:55 smithi171 bash[25040]: audit 2024-09-14T04:57:53.954702+0000 mgr.a (mgr.14355) 17168 : audit [DBG] from='client.369516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:55 smithi007 bash[22722]: audit 2024-09-14T04:57:53.954702+0000 mgr.a (mgr.14355) 17168 : audit [DBG] from='client.369516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:55 smithi131 bash[24745]: audit 2024-09-14T04:57:53.954702+0000 mgr.a (mgr.14355) 17168 : audit [DBG] from='client.369516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:57:56.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:56 smithi171 bash[25040]: cluster 2024-09-14T04:57:54.815222+0000 mgr.a (mgr.14355) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:56 smithi007 bash[22722]: cluster 2024-09-14T04:57:54.815222+0000 mgr.a (mgr.14355) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:56 smithi131 bash[24745]: cluster 2024-09-14T04:57:54.815222+0000 mgr.a (mgr.14355) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:57:58 smithi171 bash[25040]: cluster 2024-09-14T04:57:56.817499+0000 mgr.a (mgr.14355) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:57:58 smithi007 bash[22722]: cluster 2024-09-14T04:57:56.817499+0000 mgr.a (mgr.14355) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:57:58 smithi131 bash[24745]: cluster 2024-09-14T04:57:56.817499+0000 mgr.a (mgr.14355) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:57:59.381 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:57:59.382 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:57:59.383 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:00.170 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:00.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:00.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:00.170 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:00.171 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:00 smithi007 bash[22722]: cluster 2024-09-14T04:57:58.818247+0000 mgr.a (mgr.14355) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:00 smithi131 bash[24745]: cluster 2024-09-14T04:57:58.818247+0000 mgr.a (mgr.14355) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:00 smithi171 bash[25040]: cluster 2024-09-14T04:57:58.818247+0000 mgr.a (mgr.14355) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:01 smithi007 bash[22722]: audit 2024-09-14T04:57:59.721217+0000 mgr.a (mgr.14355) 17172 : audit [DBG] from='client.369591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:01 smithi131 bash[24745]: audit 2024-09-14T04:57:59.721217+0000 mgr.a (mgr.14355) 17172 : audit [DBG] from='client.369591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:01 smithi171 bash[25040]: audit 2024-09-14T04:57:59.721217+0000 mgr.a (mgr.14355) 17172 : audit [DBG] from='client.369591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:02 smithi007 bash[22722]: cluster 2024-09-14T04:58:00.820680+0000 mgr.a (mgr.14355) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:02 smithi131 bash[24745]: cluster 2024-09-14T04:58:00.820680+0000 mgr.a (mgr.14355) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:02 smithi171 bash[25040]: cluster 2024-09-14T04:58:00.820680+0000 mgr.a (mgr.14355) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:04 smithi007 bash[22722]: cluster 2024-09-14T04:58:02.821442+0000 mgr.a (mgr.14355) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:04 smithi131 bash[24745]: cluster 2024-09-14T04:58:02.821442+0000 mgr.a (mgr.14355) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:04 smithi171 bash[25040]: cluster 2024-09-14T04:58:02.821442+0000 mgr.a (mgr.14355) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:05.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:05.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:05.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:05.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:05.955 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:05.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:06 smithi007 bash[22722]: cluster 2024-09-14T04:58:04.822211+0000 mgr.a (mgr.14355) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:06 smithi007 bash[22722]: audit 2024-09-14T04:58:05.507831+0000 mgr.a (mgr.14355) 17176 : audit [DBG] from='client.369669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:06 smithi131 bash[24745]: cluster 2024-09-14T04:58:04.822211+0000 mgr.a (mgr.14355) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:06 smithi131 bash[24745]: audit 2024-09-14T04:58:05.507831+0000 mgr.a (mgr.14355) 17176 : audit [DBG] from='client.369669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:06 smithi171 bash[25040]: cluster 2024-09-14T04:58:04.822211+0000 mgr.a (mgr.14355) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:06 smithi171 bash[25040]: audit 2024-09-14T04:58:05.507831+0000 mgr.a (mgr.14355) 17176 : audit [DBG] from='client.369669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:08 smithi007 bash[22722]: cluster 2024-09-14T04:58:06.824961+0000 mgr.a (mgr.14355) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:08 smithi131 bash[24745]: cluster 2024-09-14T04:58:06.824961+0000 mgr.a (mgr.14355) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:08 smithi171 bash[25040]: cluster 2024-09-14T04:58:06.824961+0000 mgr.a (mgr.14355) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:10 smithi007 bash[22722]: cluster 2024-09-14T04:58:08.825755+0000 mgr.a (mgr.14355) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:10.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:10.957 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:10.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:10 smithi131 bash[24745]: cluster 2024-09-14T04:58:08.825755+0000 mgr.a (mgr.14355) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:10 smithi171 bash[25040]: cluster 2024-09-14T04:58:08.825755+0000 mgr.a (mgr.14355) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:11.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:11.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:12 smithi007 bash[22722]: cluster 2024-09-14T04:58:10.827807+0000 mgr.a (mgr.14355) 17179 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:12 smithi007 bash[22722]: audit 2024-09-14T04:58:11.293016+0000 mgr.a (mgr.14355) 17180 : audit [DBG] from='client.369741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:12 smithi131 bash[24745]: cluster 2024-09-14T04:58:10.827807+0000 mgr.a (mgr.14355) 17179 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:12 smithi131 bash[24745]: audit 2024-09-14T04:58:11.293016+0000 mgr.a (mgr.14355) 17180 : audit [DBG] from='client.369741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:12 smithi171 bash[25040]: cluster 2024-09-14T04:58:10.827807+0000 mgr.a (mgr.14355) 17179 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:12 smithi171 bash[25040]: audit 2024-09-14T04:58:11.293016+0000 mgr.a (mgr.14355) 17180 : audit [DBG] from='client.369741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:14 smithi007 bash[22722]: cluster 2024-09-14T04:58:12.828660+0000 mgr.a (mgr.14355) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:14 smithi131 bash[24745]: cluster 2024-09-14T04:58:12.828660+0000 mgr.a (mgr.14355) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:14 smithi171 bash[25040]: cluster 2024-09-14T04:58:12.828660+0000 mgr.a (mgr.14355) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:15 smithi007 bash[22722]: cluster 2024-09-14T04:58:14.829625+0000 mgr.a (mgr.14355) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:15 smithi131 bash[24745]: cluster 2024-09-14T04:58:14.829625+0000 mgr.a (mgr.14355) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:15 smithi171 bash[25040]: cluster 2024-09-14T04:58:14.829625+0000 mgr.a (mgr.14355) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:16.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:16.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:17.512 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:17 smithi007 bash[22722]: cluster 2024-09-14T04:58:16.830849+0000 mgr.a (mgr.14355) 17183 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:18.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:17 smithi007 bash[22722]: audit 2024-09-14T04:58:17.070356+0000 mgr.a (mgr.14355) 17184 : audit [DBG] from='client.369816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:17 smithi131 bash[24745]: cluster 2024-09-14T04:58:16.830849+0000 mgr.a (mgr.14355) 17183 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:17 smithi131 bash[24745]: audit 2024-09-14T04:58:17.070356+0000 mgr.a (mgr.14355) 17184 : audit [DBG] from='client.369816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:17 smithi171 bash[25040]: cluster 2024-09-14T04:58:16.830849+0000 mgr.a (mgr.14355) 17183 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:17 smithi171 bash[25040]: audit 2024-09-14T04:58:17.070356+0000 mgr.a (mgr.14355) 17184 : audit [DBG] from='client.369816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:19 smithi007 bash[22722]: cluster 2024-09-14T04:58:18.831844+0000 mgr.a (mgr.14355) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:19 smithi131 bash[24745]: cluster 2024-09-14T04:58:18.831844+0000 mgr.a (mgr.14355) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:19 smithi171 bash[25040]: cluster 2024-09-14T04:58:18.831844+0000 mgr.a (mgr.14355) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:21 smithi007 bash[22722]: cluster 2024-09-14T04:58:20.834096+0000 mgr.a (mgr.14355) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:21 smithi131 bash[24745]: cluster 2024-09-14T04:58:20.834096+0000 mgr.a (mgr.14355) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:21 smithi171 bash[25040]: cluster 2024-09-14T04:58:20.834096+0000 mgr.a (mgr.14355) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:22.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:22.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:23.291 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:23 smithi007 bash[22722]: cluster 2024-09-14T04:58:22.834846+0000 mgr.a (mgr.14355) 17187 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:24.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:23 smithi007 bash[22722]: audit 2024-09-14T04:58:22.852042+0000 mgr.a (mgr.14355) 17188 : audit [DBG] from='client.369894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:23 smithi131 bash[24745]: cluster 2024-09-14T04:58:22.834846+0000 mgr.a (mgr.14355) 17187 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:23 smithi131 bash[24745]: audit 2024-09-14T04:58:22.852042+0000 mgr.a (mgr.14355) 17188 : audit [DBG] from='client.369894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:23 smithi171 bash[25040]: cluster 2024-09-14T04:58:22.834846+0000 mgr.a (mgr.14355) 17187 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:23 smithi171 bash[25040]: audit 2024-09-14T04:58:22.852042+0000 mgr.a (mgr.14355) 17188 : audit [DBG] from='client.369894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:25 smithi007 bash[22722]: cluster 2024-09-14T04:58:24.835698+0000 mgr.a (mgr.14355) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:25 smithi131 bash[24745]: cluster 2024-09-14T04:58:24.835698+0000 mgr.a (mgr.14355) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:25 smithi171 bash[25040]: cluster 2024-09-14T04:58:24.835698+0000 mgr.a (mgr.14355) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:27 smithi007 bash[22722]: cluster 2024-09-14T04:58:26.837996+0000 mgr.a (mgr.14355) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:27 smithi131 bash[24745]: cluster 2024-09-14T04:58:26.837996+0000 mgr.a (mgr.14355) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:28.293 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:27 smithi171 bash[25040]: cluster 2024-09-14T04:58:26.837996+0000 mgr.a (mgr.14355) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:29.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:29.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:29.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:29.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:29 smithi007 bash[22722]: audit 2024-09-14T04:58:28.624463+0000 mgr.a (mgr.14355) 17191 : audit [DBG] from='client.369966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:29 smithi007 bash[22722]: cluster 2024-09-14T04:58:28.838516+0000 mgr.a (mgr.14355) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:29 smithi131 bash[24745]: audit 2024-09-14T04:58:28.624463+0000 mgr.a (mgr.14355) 17191 : audit [DBG] from='client.369966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:29 smithi131 bash[24745]: cluster 2024-09-14T04:58:28.838516+0000 mgr.a (mgr.14355) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:29 smithi171 bash[25040]: audit 2024-09-14T04:58:28.624463+0000 mgr.a (mgr.14355) 17191 : audit [DBG] from='client.369966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:29 smithi171 bash[25040]: cluster 2024-09-14T04:58:28.838516+0000 mgr.a (mgr.14355) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:31 smithi007 bash[22722]: cluster 2024-09-14T04:58:30.840736+0000 mgr.a (mgr.14355) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:31 smithi131 bash[24745]: cluster 2024-09-14T04:58:30.840736+0000 mgr.a (mgr.14355) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:31 smithi171 bash[25040]: cluster 2024-09-14T04:58:30.840736+0000 mgr.a (mgr.14355) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:34.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:34.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:33 smithi007 bash[22722]: cluster 2024-09-14T04:58:32.841478+0000 mgr.a (mgr.14355) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:33 smithi131 bash[24745]: cluster 2024-09-14T04:58:32.841478+0000 mgr.a (mgr.14355) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:33 smithi171 bash[25040]: cluster 2024-09-14T04:58:32.841478+0000 mgr.a (mgr.14355) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:34.812 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:34 smithi007 bash[22722]: audit 2024-09-14T04:58:34.398529+0000 mgr.a (mgr.14355) 17195 : audit [DBG] from='client.370044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:34 smithi131 bash[24745]: audit 2024-09-14T04:58:34.398529+0000 mgr.a (mgr.14355) 17195 : audit [DBG] from='client.370044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:34 smithi171 bash[25040]: audit 2024-09-14T04:58:34.398529+0000 mgr.a (mgr.14355) 17195 : audit [DBG] from='client.370044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:35 smithi007 bash[22722]: cluster 2024-09-14T04:58:34.842199+0000 mgr.a (mgr.14355) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:35 smithi131 bash[24745]: cluster 2024-09-14T04:58:34.842199+0000 mgr.a (mgr.14355) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:35 smithi171 bash[25040]: cluster 2024-09-14T04:58:34.842199+0000 mgr.a (mgr.14355) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:37 smithi007 bash[22722]: cluster 2024-09-14T04:58:36.844413+0000 mgr.a (mgr.14355) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:37 smithi131 bash[24745]: cluster 2024-09-14T04:58:36.844413+0000 mgr.a (mgr.14355) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:37 smithi171 bash[25040]: cluster 2024-09-14T04:58:36.844413+0000 mgr.a (mgr.14355) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:58:39.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:39.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:39.814 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:39 smithi007 bash[22722]: cluster 2024-09-14T04:58:38.845174+0000 mgr.a (mgr.14355) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:39 smithi131 bash[24745]: cluster 2024-09-14T04:58:38.845174+0000 mgr.a (mgr.14355) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:39 smithi171 bash[25040]: cluster 2024-09-14T04:58:38.845174+0000 mgr.a (mgr.14355) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:40.586 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:40.586 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:40.587 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:40 smithi007 bash[22722]: audit 2024-09-14T04:58:40.149704+0000 mgr.a (mgr.14355) 17199 : audit [DBG] from='client.370116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:41.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:40 smithi131 bash[24745]: audit 2024-09-14T04:58:40.149704+0000 mgr.a (mgr.14355) 17199 : audit [DBG] from='client.370116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:40 smithi171 bash[25040]: audit 2024-09-14T04:58:40.149704+0000 mgr.a (mgr.14355) 17199 : audit [DBG] from='client.370116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: cluster 2024-09-14T04:58:40.848033+0000 mgr.a (mgr.14355) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: audit 2024-09-14T04:58:41.087529+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:58:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: audit 2024-09-14T04:58:41.932832+0000 mon.a (mon.0) 3160 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:58:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: audit 2024-09-14T04:58:41.934366+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:58:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: audit 2024-09-14T04:58:41.943155+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:58:42.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:41 smithi131 bash[24745]: audit 2024-09-14T04:58:41.948165+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: cluster 2024-09-14T04:58:40.848033+0000 mgr.a (mgr.14355) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: audit 2024-09-14T04:58:41.087529+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:58:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: audit 2024-09-14T04:58:41.932832+0000 mon.a (mon.0) 3160 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:58:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: audit 2024-09-14T04:58:41.934366+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:58:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: audit 2024-09-14T04:58:41.943155+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:58:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:41 smithi171 bash[25040]: audit 2024-09-14T04:58:41.948165+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: cluster 2024-09-14T04:58:40.848033+0000 mgr.a (mgr.14355) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:58:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: audit 2024-09-14T04:58:41.087529+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:58:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: audit 2024-09-14T04:58:41.932832+0000 mon.a (mon.0) 3160 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:58:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: audit 2024-09-14T04:58:41.934366+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:58:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: audit 2024-09-14T04:58:41.943155+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:58:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:41 smithi007 bash[22722]: audit 2024-09-14T04:58:41.948165+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:42.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:58:42 smithi007 bash[22972]: debug 2024-09-14T04:58:42.687+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:58:42.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:58:42 smithi007 bash[22972]: debug 2024-09-14T04:58:42.691+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:58:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:42 smithi131 bash[24745]: audit 2024-09-14T04:58:41.950867+0000 mgr.a (mgr.14355) 17201 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:43.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:42 smithi171 bash[25040]: audit 2024-09-14T04:58:41.950867+0000 mgr.a (mgr.14355) 17201 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:42 smithi007 bash[22722]: audit 2024-09-14T04:58:41.950867+0000 mgr.a (mgr.14355) 17201 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:58:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:43 smithi131 bash[24745]: audit 2024-09-14T04:58:42.693642+0000 mgr.a (mgr.14355) 17202 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:58:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:43 smithi131 bash[24745]: cephadm 2024-09-14T04:58:42.695584+0000 mgr.a (mgr.14355) 17203 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:58:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:43 smithi131 bash[24745]: cluster 2024-09-14T04:58:42.848935+0000 mgr.a (mgr.14355) 17204 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:43 smithi171 bash[25040]: audit 2024-09-14T04:58:42.693642+0000 mgr.a (mgr.14355) 17202 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:58:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:43 smithi171 bash[25040]: cephadm 2024-09-14T04:58:42.695584+0000 mgr.a (mgr.14355) 17203 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:58:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:43 smithi171 bash[25040]: cluster 2024-09-14T04:58:42.848935+0000 mgr.a (mgr.14355) 17204 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:43 smithi007 bash[22722]: audit 2024-09-14T04:58:42.693642+0000 mgr.a (mgr.14355) 17202 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:58:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:43 smithi007 bash[22722]: cephadm 2024-09-14T04:58:42.695584+0000 mgr.a (mgr.14355) 17203 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:58:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:43 smithi007 bash[22722]: cluster 2024-09-14T04:58:42.848935+0000 mgr.a (mgr.14355) 17204 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:58:45.588 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:45.588 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:45.589 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:45 smithi131 bash[24745]: cluster 2024-09-14T04:58:44.849720+0000 mgr.a (mgr.14355) 17205 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:45 smithi171 bash[25040]: cluster 2024-09-14T04:58:44.849720+0000 mgr.a (mgr.14355) 17205 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:46.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:46.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:46.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:46.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:46.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:46.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:45 smithi007 bash[22722]: cluster 2024-09-14T04:58:44.849720+0000 mgr.a (mgr.14355) 17205 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:58:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:46 smithi131 bash[24745]: audit 2024-09-14T04:58:45.923908+0000 mgr.a (mgr.14355) 17206 : audit [DBG] from='client.370302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:46 smithi171 bash[25040]: audit 2024-09-14T04:58:45.923908+0000 mgr.a (mgr.14355) 17206 : audit [DBG] from='client.370302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:46 smithi007 bash[22722]: audit 2024-09-14T04:58:45.923908+0000 mgr.a (mgr.14355) 17206 : audit [DBG] from='client.370302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:47 smithi131 bash[24745]: cluster 2024-09-14T04:58:46.852504+0000 mgr.a (mgr.14355) 17207 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:47 smithi171 bash[25040]: cluster 2024-09-14T04:58:46.852504+0000 mgr.a (mgr.14355) 17207 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:48.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:47 smithi007 bash[22722]: cluster 2024-09-14T04:58:46.852504+0000 mgr.a (mgr.14355) 17207 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:49 smithi131 bash[24745]: cluster 2024-09-14T04:58:48.853294+0000 mgr.a (mgr.14355) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:58:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:49 smithi171 bash[25040]: cluster 2024-09-14T04:58:48.853294+0000 mgr.a (mgr.14355) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:58:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:49 smithi007 bash[22722]: cluster 2024-09-14T04:58:48.853294+0000 mgr.a (mgr.14355) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:58:51.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:51.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:51.365 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:52.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:52.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:52.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:52.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:52.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:52 smithi007 bash[22722]: cluster 2024-09-14T04:58:50.855365+0000 mgr.a (mgr.14355) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:52 smithi131 bash[24745]: cluster 2024-09-14T04:58:50.855365+0000 mgr.a (mgr.14355) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:52 smithi171 bash[25040]: cluster 2024-09-14T04:58:50.855365+0000 mgr.a (mgr.14355) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:53 smithi007 bash[22722]: audit 2024-09-14T04:58:51.698990+0000 mgr.a (mgr.14355) 17210 : audit [DBG] from='client.370380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:53 smithi131 bash[24745]: audit 2024-09-14T04:58:51.698990+0000 mgr.a (mgr.14355) 17210 : audit [DBG] from='client.370380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:53 smithi171 bash[25040]: audit 2024-09-14T04:58:51.698990+0000 mgr.a (mgr.14355) 17210 : audit [DBG] from='client.370380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:54 smithi007 bash[22722]: cluster 2024-09-14T04:58:52.856265+0000 mgr.a (mgr.14355) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:54 smithi131 bash[24745]: cluster 2024-09-14T04:58:52.856265+0000 mgr.a (mgr.14355) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:54 smithi171 bash[25040]: cluster 2024-09-14T04:58:52.856265+0000 mgr.a (mgr.14355) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:56 smithi131 bash[24745]: cluster 2024-09-14T04:58:54.857060+0000 mgr.a (mgr.14355) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:56 smithi171 bash[25040]: cluster 2024-09-14T04:58:54.857060+0000 mgr.a (mgr.14355) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:56 smithi007 bash[22722]: cluster 2024-09-14T04:58:54.857060+0000 mgr.a (mgr.14355) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:57.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:58:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:58:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:58:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:58:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:58:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:58:57.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:58:57.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:58:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:58 smithi131 bash[24745]: cluster 2024-09-14T04:58:56.859317+0000 mgr.a (mgr.14355) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:58:58 smithi131 bash[24745]: audit 2024-09-14T04:58:57.474910+0000 mgr.a (mgr.14355) 17214 : audit [DBG] from='client.370455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:58 smithi171 bash[25040]: cluster 2024-09-14T04:58:56.859317+0000 mgr.a (mgr.14355) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:58:58 smithi171 bash[25040]: audit 2024-09-14T04:58:57.474910+0000 mgr.a (mgr.14355) 17214 : audit [DBG] from='client.370455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:58:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:58 smithi007 bash[22722]: cluster 2024-09-14T04:58:56.859317+0000 mgr.a (mgr.14355) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:58:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:58:58 smithi007 bash[22722]: audit 2024-09-14T04:58:57.474910+0000 mgr.a (mgr.14355) 17214 : audit [DBG] from='client.370455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:00 smithi131 bash[24745]: cluster 2024-09-14T04:58:58.860189+0000 mgr.a (mgr.14355) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:00 smithi171 bash[25040]: cluster 2024-09-14T04:58:58.860189+0000 mgr.a (mgr.14355) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:00 smithi007 bash[22722]: cluster 2024-09-14T04:58:58.860189+0000 mgr.a (mgr.14355) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:02 smithi131 bash[24745]: cluster 2024-09-14T04:59:00.862612+0000 mgr.a (mgr.14355) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:02 smithi171 bash[25040]: cluster 2024-09-14T04:59:00.862612+0000 mgr.a (mgr.14355) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:02.909 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:02.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:02.910 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:02 smithi007 bash[22722]: cluster 2024-09-14T04:59:00.862612+0000 mgr.a (mgr.14355) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:03.675 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:04 smithi131 bash[24745]: cluster 2024-09-14T04:59:02.863424+0000 mgr.a (mgr.14355) 17217 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:04.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:04 smithi131 bash[24745]: audit 2024-09-14T04:59:03.244363+0000 mgr.a (mgr.14355) 17218 : audit [DBG] from='client.370533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:04 smithi171 bash[25040]: cluster 2024-09-14T04:59:02.863424+0000 mgr.a (mgr.14355) 17217 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:04 smithi171 bash[25040]: audit 2024-09-14T04:59:03.244363+0000 mgr.a (mgr.14355) 17218 : audit [DBG] from='client.370533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:04 smithi007 bash[22722]: cluster 2024-09-14T04:59:02.863424+0000 mgr.a (mgr.14355) 17217 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:04 smithi007 bash[22722]: audit 2024-09-14T04:59:03.244363+0000 mgr.a (mgr.14355) 17218 : audit [DBG] from='client.370533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:06 smithi131 bash[24745]: cluster 2024-09-14T04:59:04.864329+0000 mgr.a (mgr.14355) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:06 smithi171 bash[25040]: cluster 2024-09-14T04:59:04.864329+0000 mgr.a (mgr.14355) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:06 smithi007 bash[22722]: cluster 2024-09-14T04:59:04.864329+0000 mgr.a (mgr.14355) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:08.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:08.678 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:08 smithi131 bash[24745]: cluster 2024-09-14T04:59:06.866744+0000 mgr.a (mgr.14355) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:08 smithi171 bash[25040]: cluster 2024-09-14T04:59:06.866744+0000 mgr.a (mgr.14355) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:08 smithi007 bash[22722]: cluster 2024-09-14T04:59:06.866744+0000 mgr.a (mgr.14355) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:09.423 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:10 smithi131 bash[24745]: cluster 2024-09-14T04:59:08.867525+0000 mgr.a (mgr.14355) 17221 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:10 smithi131 bash[24745]: audit 2024-09-14T04:59:09.007167+0000 mgr.a (mgr.14355) 17222 : audit [DBG] from='client.370611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:10 smithi171 bash[25040]: cluster 2024-09-14T04:59:08.867525+0000 mgr.a (mgr.14355) 17221 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:10 smithi171 bash[25040]: audit 2024-09-14T04:59:09.007167+0000 mgr.a (mgr.14355) 17222 : audit [DBG] from='client.370611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:10 smithi007 bash[22722]: cluster 2024-09-14T04:59:08.867525+0000 mgr.a (mgr.14355) 17221 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:10.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:10 smithi007 bash[22722]: audit 2024-09-14T04:59:09.007167+0000 mgr.a (mgr.14355) 17222 : audit [DBG] from='client.370611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:12 smithi131 bash[24745]: cluster 2024-09-14T04:59:10.869881+0000 mgr.a (mgr.14355) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:12 smithi171 bash[25040]: cluster 2024-09-14T04:59:10.869881+0000 mgr.a (mgr.14355) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:12 smithi007 bash[22722]: cluster 2024-09-14T04:59:10.869881+0000 mgr.a (mgr.14355) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:14 smithi131 bash[24745]: cluster 2024-09-14T04:59:12.870667+0000 mgr.a (mgr.14355) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:14 smithi171 bash[25040]: cluster 2024-09-14T04:59:12.870667+0000 mgr.a (mgr.14355) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:14 smithi007 bash[22722]: cluster 2024-09-14T04:59:12.870667+0000 mgr.a (mgr.14355) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:15.212 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:15.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:15.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:15.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:15.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:16 smithi131 bash[24745]: audit 2024-09-14T04:59:14.763138+0000 mgr.a (mgr.14355) 17225 : audit [DBG] from='client.370689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:16 smithi131 bash[24745]: cluster 2024-09-14T04:59:14.871155+0000 mgr.a (mgr.14355) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:16 smithi171 bash[25040]: audit 2024-09-14T04:59:14.763138+0000 mgr.a (mgr.14355) 17225 : audit [DBG] from='client.370689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:16 smithi171 bash[25040]: cluster 2024-09-14T04:59:14.871155+0000 mgr.a (mgr.14355) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:16 smithi007 bash[22722]: audit 2024-09-14T04:59:14.763138+0000 mgr.a (mgr.14355) 17225 : audit [DBG] from='client.370689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:16 smithi007 bash[22722]: cluster 2024-09-14T04:59:14.871155+0000 mgr.a (mgr.14355) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:18 smithi131 bash[24745]: cluster 2024-09-14T04:59:16.873478+0000 mgr.a (mgr.14355) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:18 smithi171 bash[25040]: cluster 2024-09-14T04:59:16.873478+0000 mgr.a (mgr.14355) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:18 smithi007 bash[22722]: cluster 2024-09-14T04:59:16.873478+0000 mgr.a (mgr.14355) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:20.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:20.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:20.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:20 smithi131 bash[24745]: cluster 2024-09-14T04:59:18.874411+0000 mgr.a (mgr.14355) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:20 smithi171 bash[25040]: cluster 2024-09-14T04:59:18.874411+0000 mgr.a (mgr.14355) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:20 smithi007 bash[22722]: cluster 2024-09-14T04:59:18.874411+0000 mgr.a (mgr.14355) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:21.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:21.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:21.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:21.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:21.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:21 smithi131 bash[24745]: audit 2024-09-14T04:59:20.557646+0000 mgr.a (mgr.14355) 17229 : audit [DBG] from='client.370767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:21 smithi171 bash[25040]: audit 2024-09-14T04:59:20.557646+0000 mgr.a (mgr.14355) 17229 : audit [DBG] from='client.370767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:21 smithi007 bash[22722]: audit 2024-09-14T04:59:20.557646+0000 mgr.a (mgr.14355) 17229 : audit [DBG] from='client.370767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:22 smithi131 bash[24745]: cluster 2024-09-14T04:59:20.875735+0000 mgr.a (mgr.14355) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:22 smithi171 bash[25040]: cluster 2024-09-14T04:59:20.875735+0000 mgr.a (mgr.14355) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:22 smithi007 bash[22722]: cluster 2024-09-14T04:59:20.875735+0000 mgr.a (mgr.14355) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:24 smithi131 bash[24745]: cluster 2024-09-14T04:59:22.876586+0000 mgr.a (mgr.14355) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:24 smithi171 bash[25040]: cluster 2024-09-14T04:59:22.876586+0000 mgr.a (mgr.14355) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:24 smithi007 bash[22722]: cluster 2024-09-14T04:59:22.876586+0000 mgr.a (mgr.14355) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:26.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:26.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:26.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:26.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:26.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:26 smithi131 bash[24745]: cluster 2024-09-14T04:59:24.877355+0000 mgr.a (mgr.14355) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:26 smithi171 bash[25040]: cluster 2024-09-14T04:59:24.877355+0000 mgr.a (mgr.14355) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:26 smithi007 bash[22722]: cluster 2024-09-14T04:59:24.877355+0000 mgr.a (mgr.14355) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T04:59:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:27 smithi171 bash[25040]: audit 2024-09-14T04:59:26.338552+0000 mgr.a (mgr.14355) 17233 : audit [DBG] from='client.370842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:27 smithi007 bash[22722]: audit 2024-09-14T04:59:26.338552+0000 mgr.a (mgr.14355) 17233 : audit [DBG] from='client.370842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:27 smithi131 bash[24745]: audit 2024-09-14T04:59:26.338552+0000 mgr.a (mgr.14355) 17233 : audit [DBG] from='client.370842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:28 smithi171 bash[25040]: cluster 2024-09-14T04:59:26.880015+0000 mgr.a (mgr.14355) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:28 smithi007 bash[22722]: cluster 2024-09-14T04:59:26.880015+0000 mgr.a (mgr.14355) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:28 smithi131 bash[24745]: cluster 2024-09-14T04:59:26.880015+0000 mgr.a (mgr.14355) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:30 smithi171 bash[25040]: cluster 2024-09-14T04:59:28.880792+0000 mgr.a (mgr.14355) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:59:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:30 smithi007 bash[22722]: cluster 2024-09-14T04:59:28.880792+0000 mgr.a (mgr.14355) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:59:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:30 smithi131 bash[24745]: cluster 2024-09-14T04:59:28.880792+0000 mgr.a (mgr.14355) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T04:59:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:32.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:32 smithi007 bash[22722]: cluster 2024-09-14T04:59:30.882806+0000 mgr.a (mgr.14355) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:32 smithi131 bash[24745]: cluster 2024-09-14T04:59:30.882806+0000 mgr.a (mgr.14355) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:32 smithi171 bash[25040]: cluster 2024-09-14T04:59:30.882806+0000 mgr.a (mgr.14355) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:33 smithi007 bash[22722]: audit 2024-09-14T04:59:32.102479+0000 mgr.a (mgr.14355) 17237 : audit [DBG] from='client.370920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:33 smithi131 bash[24745]: audit 2024-09-14T04:59:32.102479+0000 mgr.a (mgr.14355) 17237 : audit [DBG] from='client.370920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:33 smithi171 bash[25040]: audit 2024-09-14T04:59:32.102479+0000 mgr.a (mgr.14355) 17237 : audit [DBG] from='client.370920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:34 smithi007 bash[22722]: cluster 2024-09-14T04:59:32.883634+0000 mgr.a (mgr.14355) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:34 smithi131 bash[24745]: cluster 2024-09-14T04:59:32.883634+0000 mgr.a (mgr.14355) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:34 smithi171 bash[25040]: cluster 2024-09-14T04:59:32.883634+0000 mgr.a (mgr.14355) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:36 smithi007 bash[22722]: cluster 2024-09-14T04:59:34.884539+0000 mgr.a (mgr.14355) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:36 smithi131 bash[24745]: cluster 2024-09-14T04:59:34.884539+0000 mgr.a (mgr.14355) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:36 smithi171 bash[25040]: cluster 2024-09-14T04:59:34.884539+0000 mgr.a (mgr.14355) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:37.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:37.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:38.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:38.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:38.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:38.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:38 smithi007 bash[22722]: cluster 2024-09-14T04:59:36.886971+0000 mgr.a (mgr.14355) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:38 smithi131 bash[24745]: cluster 2024-09-14T04:59:36.886971+0000 mgr.a (mgr.14355) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:38 smithi171 bash[25040]: cluster 2024-09-14T04:59:36.886971+0000 mgr.a (mgr.14355) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:39 smithi007 bash[22722]: audit 2024-09-14T04:59:37.861755+0000 mgr.a (mgr.14355) 17241 : audit [DBG] from='client.370998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:39 smithi131 bash[24745]: audit 2024-09-14T04:59:37.861755+0000 mgr.a (mgr.14355) 17241 : audit [DBG] from='client.370998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:39 smithi171 bash[25040]: audit 2024-09-14T04:59:37.861755+0000 mgr.a (mgr.14355) 17241 : audit [DBG] from='client.370998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:40 smithi007 bash[22722]: cluster 2024-09-14T04:59:38.887899+0000 mgr.a (mgr.14355) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:40 smithi131 bash[24745]: cluster 2024-09-14T04:59:38.887899+0000 mgr.a (mgr.14355) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:40 smithi171 bash[25040]: cluster 2024-09-14T04:59:38.887899+0000 mgr.a (mgr.14355) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:42 smithi007 bash[22722]: cluster 2024-09-14T04:59:40.890133+0000 mgr.a (mgr.14355) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:42 smithi131 bash[24745]: cluster 2024-09-14T04:59:40.890133+0000 mgr.a (mgr.14355) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:42 smithi171 bash[25040]: cluster 2024-09-14T04:59:40.890133+0000 mgr.a (mgr.14355) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T04:59:43.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:43.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:43.301 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:43 smithi007 bash[22722]: audit 2024-09-14T04:59:42.748201+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:59:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:43 smithi131 bash[24745]: audit 2024-09-14T04:59:42.748201+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:59:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:43 smithi171 bash[25040]: audit 2024-09-14T04:59:42.748201+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T04:59:44.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22972]: debug 2024-09-14T04:59:44.354+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:59:44.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22972]: debug 2024-09-14T04:59:44.366+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:59:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22722]: cluster 2024-09-14T04:59:42.890888+0000 mgr.a (mgr.14355) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22722]: audit 2024-09-14T04:59:43.593918+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:59:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22722]: audit 2024-09-14T04:59:43.595553+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:59:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22722]: audit 2024-09-14T04:59:43.604706+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:59:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:44 smithi007 bash[22722]: audit 2024-09-14T04:59:43.607668+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:44.762 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:44 smithi131 bash[24745]: cluster 2024-09-14T04:59:42.890888+0000 mgr.a (mgr.14355) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:44 smithi131 bash[24745]: audit 2024-09-14T04:59:43.593918+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:59:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:44 smithi131 bash[24745]: audit 2024-09-14T04:59:43.595553+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:59:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:44 smithi131 bash[24745]: audit 2024-09-14T04:59:43.604706+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:59:45.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:44 smithi131 bash[24745]: audit 2024-09-14T04:59:43.607668+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:44 smithi171 bash[25040]: cluster 2024-09-14T04:59:42.890888+0000 mgr.a (mgr.14355) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:44 smithi171 bash[25040]: audit 2024-09-14T04:59:43.593918+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T04:59:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:44 smithi171 bash[25040]: audit 2024-09-14T04:59:43.595553+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T04:59:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:44 smithi171 bash[25040]: audit 2024-09-14T04:59:43.604706+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T04:59:45.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:44 smithi171 bash[25040]: audit 2024-09-14T04:59:43.607668+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:45 smithi007 bash[22722]: audit 2024-09-14T04:59:43.609828+0000 mgr.a (mgr.14355) 17245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:45 smithi007 bash[22722]: audit 2024-09-14T04:59:43.630119+0000 mgr.a (mgr.14355) 17246 : audit [DBG] from='client.371073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:45 smithi007 bash[22722]: audit 2024-09-14T04:59:44.354981+0000 mgr.a (mgr.14355) 17247 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:59:45.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:45 smithi007 bash[22722]: cephadm 2024-09-14T04:59:44.367529+0000 mgr.a (mgr.14355) 17248 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:59:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:45 smithi131 bash[24745]: audit 2024-09-14T04:59:43.609828+0000 mgr.a (mgr.14355) 17245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:45 smithi131 bash[24745]: audit 2024-09-14T04:59:43.630119+0000 mgr.a (mgr.14355) 17246 : audit [DBG] from='client.371073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:45 smithi131 bash[24745]: audit 2024-09-14T04:59:44.354981+0000 mgr.a (mgr.14355) 17247 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:59:46.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:45 smithi131 bash[24745]: cephadm 2024-09-14T04:59:44.367529+0000 mgr.a (mgr.14355) 17248 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:59:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:45 smithi171 bash[25040]: audit 2024-09-14T04:59:43.609828+0000 mgr.a (mgr.14355) 17245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T04:59:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:45 smithi171 bash[25040]: audit 2024-09-14T04:59:43.630119+0000 mgr.a (mgr.14355) 17246 : audit [DBG] from='client.371073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:45 smithi171 bash[25040]: audit 2024-09-14T04:59:44.354981+0000 mgr.a (mgr.14355) 17247 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T04:59:46.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:45 smithi171 bash[25040]: cephadm 2024-09-14T04:59:44.367529+0000 mgr.a (mgr.14355) 17248 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T04:59:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:46 smithi007 bash[22722]: cluster 2024-09-14T04:59:44.891711+0000 mgr.a (mgr.14355) 17249 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:46 smithi131 bash[24745]: cluster 2024-09-14T04:59:44.891711+0000 mgr.a (mgr.14355) 17249 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:46 smithi171 bash[25040]: cluster 2024-09-14T04:59:44.891711+0000 mgr.a (mgr.14355) 17249 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T04:59:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:47 smithi007 bash[22722]: cluster 2024-09-14T04:59:46.893912+0000 mgr.a (mgr.14355) 17250 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:47 smithi131 bash[24745]: cluster 2024-09-14T04:59:46.893912+0000 mgr.a (mgr.14355) 17250 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:47 smithi171 bash[25040]: cluster 2024-09-14T04:59:46.893912+0000 mgr.a (mgr.14355) 17250 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:49.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:49.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:49.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:49 smithi007 bash[22722]: cluster 2024-09-14T04:59:48.894687+0000 mgr.a (mgr.14355) 17251 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:49 smithi131 bash[24745]: cluster 2024-09-14T04:59:48.894687+0000 mgr.a (mgr.14355) 17251 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:49 smithi171 bash[25040]: cluster 2024-09-14T04:59:48.894687+0000 mgr.a (mgr.14355) 17251 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:50 smithi131 bash[24745]: audit 2024-09-14T04:59:50.097189+0000 mgr.a (mgr.14355) 17252 : audit [DBG] from='client.371259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:50 smithi171 bash[25040]: audit 2024-09-14T04:59:50.097189+0000 mgr.a (mgr.14355) 17252 : audit [DBG] from='client.371259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:50 smithi007 bash[22722]: audit 2024-09-14T04:59:50.097189+0000 mgr.a (mgr.14355) 17252 : audit [DBG] from='client.371259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:51 smithi131 bash[24745]: cluster 2024-09-14T04:59:50.897527+0000 mgr.a (mgr.14355) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:51 smithi171 bash[25040]: cluster 2024-09-14T04:59:50.897527+0000 mgr.a (mgr.14355) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:51 smithi007 bash[22722]: cluster 2024-09-14T04:59:50.897527+0000 mgr.a (mgr.14355) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:53 smithi131 bash[24745]: cluster 2024-09-14T04:59:52.898365+0000 mgr.a (mgr.14355) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:53 smithi171 bash[25040]: cluster 2024-09-14T04:59:52.898365+0000 mgr.a (mgr.14355) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:53 smithi007 bash[22722]: cluster 2024-09-14T04:59:52.898365+0000 mgr.a (mgr.14355) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T04:59:55.541 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T04:59:55.542 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T04:59:56.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:55 smithi131 bash[24745]: cluster 2024-09-14T04:59:54.899193+0000 mgr.a (mgr.14355) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:55 smithi171 bash[25040]: cluster 2024-09-14T04:59:54.899193+0000 mgr.a (mgr.14355) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:56.306 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T04:59:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T04:59:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T04:59:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T04:59:56.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T04:59:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:55 smithi007 bash[22722]: cluster 2024-09-14T04:59:54.899193+0000 mgr.a (mgr.14355) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T04:59:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:56 smithi131 bash[24745]: audit 2024-09-14T04:59:55.873941+0000 mgr.a (mgr.14355) 17256 : audit [DBG] from='client.371334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:56 smithi171 bash[25040]: audit 2024-09-14T04:59:55.873941+0000 mgr.a (mgr.14355) 17256 : audit [DBG] from='client.371334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:56 smithi007 bash[22722]: audit 2024-09-14T04:59:55.873941+0000 mgr.a (mgr.14355) 17256 : audit [DBG] from='client.371334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T04:59:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:57 smithi131 bash[24745]: cluster 2024-09-14T04:59:56.902103+0000 mgr.a (mgr.14355) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:57 smithi171 bash[25040]: cluster 2024-09-14T04:59:56.902103+0000 mgr.a (mgr.14355) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T04:59:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:57 smithi007 bash[22722]: cluster 2024-09-14T04:59:56.902103+0000 mgr.a (mgr.14355) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:00:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 04:59:59 smithi131 bash[24745]: cluster 2024-09-14T04:59:58.903080+0000 mgr.a (mgr.14355) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 04:59:59 smithi171 bash[25040]: cluster 2024-09-14T04:59:58.903080+0000 mgr.a (mgr.14355) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 04:59:59 smithi007 bash[22722]: cluster 2024-09-14T04:59:58.903080+0000 mgr.a (mgr.14355) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:00 smithi131 bash[24745]: cluster 2024-09-14T05:00:00.000186+0000 mon.a (mon.0) 3169 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:00:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:00 smithi171 bash[25040]: cluster 2024-09-14T05:00:00.000186+0000 mon.a (mon.0) 3169 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:00:01.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:01.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:01.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:00 smithi007 bash[22722]: cluster 2024-09-14T05:00:00.000186+0000 mon.a (mon.0) 3169 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:00:02.063 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:02.063 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:01 smithi131 bash[24745]: cluster 2024-09-14T05:00:00.905174+0000 mgr.a (mgr.14355) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:01 smithi171 bash[25040]: cluster 2024-09-14T05:00:00.905174+0000 mgr.a (mgr.14355) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:01 smithi007 bash[22722]: cluster 2024-09-14T05:00:00.905174+0000 mgr.a (mgr.14355) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:03 smithi131 bash[24745]: audit 2024-09-14T05:00:01.641283+0000 mgr.a (mgr.14355) 17260 : audit [DBG] from='client.371409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:03 smithi171 bash[25040]: audit 2024-09-14T05:00:01.641283+0000 mgr.a (mgr.14355) 17260 : audit [DBG] from='client.371409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:03.457 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:03 smithi007 bash[22722]: audit 2024-09-14T05:00:01.641283+0000 mgr.a (mgr.14355) 17260 : audit [DBG] from='client.371409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:04 smithi131 bash[24745]: cluster 2024-09-14T05:00:02.906176+0000 mgr.a (mgr.14355) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:04 smithi171 bash[25040]: cluster 2024-09-14T05:00:02.906176+0000 mgr.a (mgr.14355) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:04 smithi007 bash[22722]: cluster 2024-09-14T05:00:02.906176+0000 mgr.a (mgr.14355) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:06 smithi131 bash[24745]: cluster 2024-09-14T05:00:04.906924+0000 mgr.a (mgr.14355) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:06 smithi171 bash[25040]: cluster 2024-09-14T05:00:04.906924+0000 mgr.a (mgr.14355) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:06 smithi007 bash[22722]: cluster 2024-09-14T05:00:04.906924+0000 mgr.a (mgr.14355) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:07.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:07.847 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:07.847 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:08 smithi131 bash[24745]: cluster 2024-09-14T05:00:06.909551+0000 mgr.a (mgr.14355) 17263 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:08 smithi131 bash[24745]: audit 2024-09-14T05:00:07.399011+0000 mgr.a (mgr.14355) 17264 : audit [DBG] from='client.371487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:08 smithi171 bash[25040]: cluster 2024-09-14T05:00:06.909551+0000 mgr.a (mgr.14355) 17263 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:08 smithi171 bash[25040]: audit 2024-09-14T05:00:07.399011+0000 mgr.a (mgr.14355) 17264 : audit [DBG] from='client.371487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:08 smithi007 bash[22722]: cluster 2024-09-14T05:00:06.909551+0000 mgr.a (mgr.14355) 17263 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:08.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:08 smithi007 bash[22722]: audit 2024-09-14T05:00:07.399011+0000 mgr.a (mgr.14355) 17264 : audit [DBG] from='client.371487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:10 smithi131 bash[24745]: cluster 2024-09-14T05:00:08.910747+0000 mgr.a (mgr.14355) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:10 smithi171 bash[25040]: cluster 2024-09-14T05:00:08.910747+0000 mgr.a (mgr.14355) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:10 smithi007 bash[22722]: cluster 2024-09-14T05:00:08.910747+0000 mgr.a (mgr.14355) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:12 smithi131 bash[24745]: cluster 2024-09-14T05:00:10.913017+0000 mgr.a (mgr.14355) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:12 smithi171 bash[25040]: cluster 2024-09-14T05:00:10.913017+0000 mgr.a (mgr.14355) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:12 smithi007 bash[22722]: cluster 2024-09-14T05:00:10.913017+0000 mgr.a (mgr.14355) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:13.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:13.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:14 smithi131 bash[24745]: cluster 2024-09-14T05:00:12.913928+0000 mgr.a (mgr.14355) 17267 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:14 smithi131 bash[24745]: audit 2024-09-14T05:00:13.187709+0000 mgr.a (mgr.14355) 17268 : audit [DBG] from='client.371565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:14 smithi171 bash[25040]: cluster 2024-09-14T05:00:12.913928+0000 mgr.a (mgr.14355) 17267 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:14 smithi171 bash[25040]: audit 2024-09-14T05:00:13.187709+0000 mgr.a (mgr.14355) 17268 : audit [DBG] from='client.371565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:14 smithi007 bash[22722]: cluster 2024-09-14T05:00:12.913928+0000 mgr.a (mgr.14355) 17267 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:14 smithi007 bash[22722]: audit 2024-09-14T05:00:13.187709+0000 mgr.a (mgr.14355) 17268 : audit [DBG] from='client.371565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:16 smithi131 bash[24745]: cluster 2024-09-14T05:00:14.914895+0000 mgr.a (mgr.14355) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:16 smithi171 bash[25040]: cluster 2024-09-14T05:00:14.914895+0000 mgr.a (mgr.14355) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:16 smithi007 bash[22722]: cluster 2024-09-14T05:00:14.914895+0000 mgr.a (mgr.14355) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:18.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:18.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:18.604 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:18 smithi131 bash[24745]: cluster 2024-09-14T05:00:16.917195+0000 mgr.a (mgr.14355) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:18 smithi171 bash[25040]: cluster 2024-09-14T05:00:16.917195+0000 mgr.a (mgr.14355) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:18 smithi007 bash[22722]: cluster 2024-09-14T05:00:16.917195+0000 mgr.a (mgr.14355) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:19.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:19.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:20 smithi131 bash[24745]: cluster 2024-09-14T05:00:18.918140+0000 mgr.a (mgr.14355) 17271 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:20 smithi131 bash[24745]: audit 2024-09-14T05:00:18.944368+0000 mgr.a (mgr.14355) 17272 : audit [DBG] from='client.371643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:20 smithi171 bash[25040]: cluster 2024-09-14T05:00:18.918140+0000 mgr.a (mgr.14355) 17271 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:20 smithi171 bash[25040]: audit 2024-09-14T05:00:18.944368+0000 mgr.a (mgr.14355) 17272 : audit [DBG] from='client.371643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:20 smithi007 bash[22722]: cluster 2024-09-14T05:00:18.918140+0000 mgr.a (mgr.14355) 17271 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:20 smithi007 bash[22722]: audit 2024-09-14T05:00:18.944368+0000 mgr.a (mgr.14355) 17272 : audit [DBG] from='client.371643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:22 smithi131 bash[24745]: cluster 2024-09-14T05:00:20.920576+0000 mgr.a (mgr.14355) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:22 smithi171 bash[25040]: cluster 2024-09-14T05:00:20.920576+0000 mgr.a (mgr.14355) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:22 smithi007 bash[22722]: cluster 2024-09-14T05:00:20.920576+0000 mgr.a (mgr.14355) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:24.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:24.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:24.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:24 smithi131 bash[24745]: cluster 2024-09-14T05:00:22.921348+0000 mgr.a (mgr.14355) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:24 smithi171 bash[25040]: cluster 2024-09-14T05:00:22.921348+0000 mgr.a (mgr.14355) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:24 smithi007 bash[22722]: cluster 2024-09-14T05:00:22.921348+0000 mgr.a (mgr.14355) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:25.137 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:25.137 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:26 smithi131 bash[24745]: audit 2024-09-14T05:00:24.718173+0000 mgr.a (mgr.14355) 17275 : audit [DBG] from='client.371718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:26 smithi131 bash[24745]: cluster 2024-09-14T05:00:24.921867+0000 mgr.a (mgr.14355) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:26 smithi171 bash[25040]: audit 2024-09-14T05:00:24.718173+0000 mgr.a (mgr.14355) 17275 : audit [DBG] from='client.371718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:26 smithi171 bash[25040]: cluster 2024-09-14T05:00:24.921867+0000 mgr.a (mgr.14355) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:26 smithi007 bash[22722]: audit 2024-09-14T05:00:24.718173+0000 mgr.a (mgr.14355) 17275 : audit [DBG] from='client.371718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:26 smithi007 bash[22722]: cluster 2024-09-14T05:00:24.921867+0000 mgr.a (mgr.14355) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:28 smithi131 bash[24745]: cluster 2024-09-14T05:00:26.924282+0000 mgr.a (mgr.14355) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:28 smithi171 bash[25040]: cluster 2024-09-14T05:00:26.924282+0000 mgr.a (mgr.14355) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:28 smithi007 bash[22722]: cluster 2024-09-14T05:00:26.924282+0000 mgr.a (mgr.14355) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:30.139 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:30.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:30 smithi131 bash[24745]: cluster 2024-09-14T05:00:28.925249+0000 mgr.a (mgr.14355) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:30 smithi171 bash[25040]: cluster 2024-09-14T05:00:28.925249+0000 mgr.a (mgr.14355) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:30.921 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:30.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:30 smithi007 bash[22722]: cluster 2024-09-14T05:00:28.925249+0000 mgr.a (mgr.14355) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:31 smithi131 bash[24745]: audit 2024-09-14T05:00:30.476707+0000 mgr.a (mgr.14355) 17279 : audit [DBG] from='client.371796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:31 smithi171 bash[25040]: audit 2024-09-14T05:00:30.476707+0000 mgr.a (mgr.14355) 17279 : audit [DBG] from='client.371796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:31 smithi007 bash[22722]: audit 2024-09-14T05:00:30.476707+0000 mgr.a (mgr.14355) 17279 : audit [DBG] from='client.371796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:32 smithi131 bash[24745]: cluster 2024-09-14T05:00:30.926578+0000 mgr.a (mgr.14355) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:32 smithi171 bash[25040]: cluster 2024-09-14T05:00:30.926578+0000 mgr.a (mgr.14355) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:32 smithi007 bash[22722]: cluster 2024-09-14T05:00:30.926578+0000 mgr.a (mgr.14355) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:34 smithi131 bash[24745]: cluster 2024-09-14T05:00:32.927308+0000 mgr.a (mgr.14355) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:34 smithi171 bash[25040]: cluster 2024-09-14T05:00:32.927308+0000 mgr.a (mgr.14355) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:34 smithi007 bash[22722]: cluster 2024-09-14T05:00:32.927308+0000 mgr.a (mgr.14355) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:35.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:35.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:35.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:36.714 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:36 smithi131 bash[24745]: cluster 2024-09-14T05:00:34.928041+0000 mgr.a (mgr.14355) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:36 smithi171 bash[25040]: cluster 2024-09-14T05:00:34.928041+0000 mgr.a (mgr.14355) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:36 smithi007 bash[22722]: cluster 2024-09-14T05:00:34.928041+0000 mgr.a (mgr.14355) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:00:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:37 smithi131 bash[24745]: audit 2024-09-14T05:00:36.264424+0000 mgr.a (mgr.14355) 17283 : audit [DBG] from='client.371871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:37 smithi171 bash[25040]: audit 2024-09-14T05:00:36.264424+0000 mgr.a (mgr.14355) 17283 : audit [DBG] from='client.371871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:37 smithi007 bash[22722]: audit 2024-09-14T05:00:36.264424+0000 mgr.a (mgr.14355) 17283 : audit [DBG] from='client.371871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:38 smithi131 bash[24745]: cluster 2024-09-14T05:00:36.930954+0000 mgr.a (mgr.14355) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:38 smithi171 bash[25040]: cluster 2024-09-14T05:00:36.930954+0000 mgr.a (mgr.14355) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:38 smithi007 bash[22722]: cluster 2024-09-14T05:00:36.930954+0000 mgr.a (mgr.14355) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:40 smithi131 bash[24745]: cluster 2024-09-14T05:00:38.931743+0000 mgr.a (mgr.14355) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:40 smithi171 bash[25040]: cluster 2024-09-14T05:00:38.931743+0000 mgr.a (mgr.14355) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:40 smithi007 bash[22722]: cluster 2024-09-14T05:00:38.931743+0000 mgr.a (mgr.14355) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:00:41.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:41.716 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:42.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:42 smithi131 bash[24745]: cluster 2024-09-14T05:00:40.933765+0000 mgr.a (mgr.14355) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:42 smithi171 bash[25040]: cluster 2024-09-14T05:00:40.933765+0000 mgr.a (mgr.14355) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:42 smithi007 bash[22722]: cluster 2024-09-14T05:00:40.933765+0000 mgr.a (mgr.14355) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:43 smithi171 bash[25040]: audit 2024-09-14T05:00:42.047011+0000 mgr.a (mgr.14355) 17287 : audit [DBG] from='client.371946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:43 smithi007 bash[22722]: audit 2024-09-14T05:00:42.047011+0000 mgr.a (mgr.14355) 17287 : audit [DBG] from='client.371946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:43 smithi131 bash[24745]: audit 2024-09-14T05:00:42.047011+0000 mgr.a (mgr.14355) 17287 : audit [DBG] from='client.371946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:44 smithi171 bash[25040]: cluster 2024-09-14T05:00:42.934747+0000 mgr.a (mgr.14355) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:44 smithi171 bash[25040]: audit 2024-09-14T05:00:44.423724+0000 mon.a (mon.0) 3170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:00:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:44 smithi007 bash[22722]: cluster 2024-09-14T05:00:42.934747+0000 mgr.a (mgr.14355) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:44 smithi007 bash[22722]: audit 2024-09-14T05:00:44.423724+0000 mon.a (mon.0) 3170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:00:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:44 smithi131 bash[24745]: cluster 2024-09-14T05:00:42.934747+0000 mgr.a (mgr.14355) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:44 smithi131 bash[24745]: audit 2024-09-14T05:00:44.423724+0000 mon.a (mon.0) 3170 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:00:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:46 smithi007 bash[22722]: cluster 2024-09-14T05:00:44.935491+0000 mgr.a (mgr.14355) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:46 smithi131 bash[24745]: cluster 2024-09-14T05:00:44.935491+0000 mgr.a (mgr.14355) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:46 smithi171 bash[25040]: cluster 2024-09-14T05:00:44.935491+0000 mgr.a (mgr.14355) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:47.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:48.246 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:48.247 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:48.247 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:48 smithi007 bash[22722]: cluster 2024-09-14T05:00:46.937749+0000 mgr.a (mgr.14355) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:48 smithi131 bash[24745]: cluster 2024-09-14T05:00:46.937749+0000 mgr.a (mgr.14355) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:48 smithi171 bash[25040]: cluster 2024-09-14T05:00:46.937749+0000 mgr.a (mgr.14355) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:49.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:49 smithi007 bash[22722]: audit 2024-09-14T05:00:47.805466+0000 mgr.a (mgr.14355) 17291 : audit [DBG] from='client.372021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:49 smithi131 bash[24745]: audit 2024-09-14T05:00:47.805466+0000 mgr.a (mgr.14355) 17291 : audit [DBG] from='client.372021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:49 smithi171 bash[25040]: audit 2024-09-14T05:00:47.805466+0000 mgr.a (mgr.14355) 17291 : audit [DBG] from='client.372021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: cluster 2024-09-14T05:00:48.938761+0000 mgr.a (mgr.14355) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.786583+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.789631+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.794157+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.798724+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.810207+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:50 smithi007 bash[22722]: audit 2024-09-14T05:00:49.815162+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: cluster 2024-09-14T05:00:48.938761+0000 mgr.a (mgr.14355) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.786583+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.789631+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.794157+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.798724+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.810207+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:50 smithi131 bash[24745]: audit 2024-09-14T05:00:49.815162+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: cluster 2024-09-14T05:00:48.938761+0000 mgr.a (mgr.14355) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.786583+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.789631+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.794157+0000 mon.a (mon.0) 3173 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.798724+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.810207+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:50 smithi171 bash[25040]: audit 2024-09-14T05:00:49.815162+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22972]: debug 2024-09-14T05:00:51.329+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:00:51.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22972]: debug 2024-09-14T05:00:51.333+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:00:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22722]: audit 2024-09-14T05:00:50.557190+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:00:51.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22722]: audit 2024-09-14T05:00:50.564884+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:00:51.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22722]: audit 2024-09-14T05:00:50.574283+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:51.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22722]: audit 2024-09-14T05:00:50.579143+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:51.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:51 smithi007 bash[22722]: audit 2024-09-14T05:00:50.581496+0000 mgr.a (mgr.14355) 17293 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:51 smithi131 bash[24745]: audit 2024-09-14T05:00:50.557190+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:51 smithi131 bash[24745]: audit 2024-09-14T05:00:50.564884+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:51 smithi131 bash[24745]: audit 2024-09-14T05:00:50.574283+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:51 smithi131 bash[24745]: audit 2024-09-14T05:00:50.579143+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:52.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:51 smithi131 bash[24745]: audit 2024-09-14T05:00:50.581496+0000 mgr.a (mgr.14355) 17293 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:51 smithi171 bash[25040]: audit 2024-09-14T05:00:50.557190+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:00:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:51 smithi171 bash[25040]: audit 2024-09-14T05:00:50.564884+0000 mon.a (mon.0) 3178 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:00:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:51 smithi171 bash[25040]: audit 2024-09-14T05:00:50.574283+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:00:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:51 smithi171 bash[25040]: audit 2024-09-14T05:00:50.579143+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:52.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:51 smithi171 bash[25040]: audit 2024-09-14T05:00:50.581496+0000 mgr.a (mgr.14355) 17293 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:00:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:52 smithi007 bash[22722]: cluster 2024-09-14T05:00:50.940113+0000 mgr.a (mgr.14355) 17294 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:52 smithi007 bash[22722]: audit 2024-09-14T05:00:51.333869+0000 mgr.a (mgr.14355) 17295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:00:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:52 smithi007 bash[22722]: cephadm 2024-09-14T05:00:51.335540+0000 mgr.a (mgr.14355) 17296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:00:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:52 smithi131 bash[24745]: cluster 2024-09-14T05:00:50.940113+0000 mgr.a (mgr.14355) 17294 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:52 smithi131 bash[24745]: audit 2024-09-14T05:00:51.333869+0000 mgr.a (mgr.14355) 17295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:00:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:52 smithi131 bash[24745]: cephadm 2024-09-14T05:00:51.335540+0000 mgr.a (mgr.14355) 17296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:00:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:52 smithi171 bash[25040]: cluster 2024-09-14T05:00:50.940113+0000 mgr.a (mgr.14355) 17294 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:00:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:52 smithi171 bash[25040]: audit 2024-09-14T05:00:51.333869+0000 mgr.a (mgr.14355) 17295 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:00:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:52 smithi171 bash[25040]: cephadm 2024-09-14T05:00:51.335540+0000 mgr.a (mgr.14355) 17296 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:00:53.248 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:53.249 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:54.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:54.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:54.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:54.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:54.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:00:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:54 smithi007 bash[22722]: cluster 2024-09-14T05:00:52.941148+0000 mgr.a (mgr.14355) 17297 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:54 smithi007 bash[22722]: audit 2024-09-14T05:00:53.579140+0000 mgr.a (mgr.14355) 17298 : audit [DBG] from='client.372207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:54 smithi131 bash[24745]: cluster 2024-09-14T05:00:52.941148+0000 mgr.a (mgr.14355) 17297 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:54 smithi131 bash[24745]: audit 2024-09-14T05:00:53.579140+0000 mgr.a (mgr.14355) 17298 : audit [DBG] from='client.372207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:54 smithi171 bash[25040]: cluster 2024-09-14T05:00:52.941148+0000 mgr.a (mgr.14355) 17297 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:54 smithi171 bash[25040]: audit 2024-09-14T05:00:53.579140+0000 mgr.a (mgr.14355) 17298 : audit [DBG] from='client.372207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:00:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:56 smithi007 bash[22722]: cluster 2024-09-14T05:00:54.942139+0000 mgr.a (mgr.14355) 17299 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:56 smithi131 bash[24745]: cluster 2024-09-14T05:00:54.942139+0000 mgr.a (mgr.14355) 17299 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:56 smithi171 bash[25040]: cluster 2024-09-14T05:00:54.942139+0000 mgr.a (mgr.14355) 17299 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:00:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:00:58 smithi007 bash[22722]: cluster 2024-09-14T05:00:56.944389+0000 mgr.a (mgr.14355) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:00:59.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:00:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:00:59.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:00:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:00:58 smithi131 bash[24745]: cluster 2024-09-14T05:00:56.944389+0000 mgr.a (mgr.14355) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:00:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:00:58 smithi171 bash[25040]: cluster 2024-09-14T05:00:56.944389+0000 mgr.a (mgr.14355) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:00:59.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:00:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:00:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:00:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:00:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:00 smithi007 bash[22722]: cluster 2024-09-14T05:00:58.945176+0000 mgr.a (mgr.14355) 17301 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:00 smithi007 bash[22722]: audit 2024-09-14T05:00:59.340857+0000 mgr.a (mgr.14355) 17302 : audit [DBG] from='client.372285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:00 smithi131 bash[24745]: cluster 2024-09-14T05:00:58.945176+0000 mgr.a (mgr.14355) 17301 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:00 smithi131 bash[24745]: audit 2024-09-14T05:00:59.340857+0000 mgr.a (mgr.14355) 17302 : audit [DBG] from='client.372285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:00 smithi171 bash[25040]: cluster 2024-09-14T05:00:58.945176+0000 mgr.a (mgr.14355) 17301 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:00 smithi171 bash[25040]: audit 2024-09-14T05:00:59.340857+0000 mgr.a (mgr.14355) 17302 : audit [DBG] from='client.372285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:02 smithi007 bash[22722]: cluster 2024-09-14T05:01:00.947575+0000 mgr.a (mgr.14355) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:02 smithi131 bash[24745]: cluster 2024-09-14T05:01:00.947575+0000 mgr.a (mgr.14355) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:02 smithi171 bash[25040]: cluster 2024-09-14T05:01:00.947575+0000 mgr.a (mgr.14355) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:04.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:04.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:04 smithi007 bash[22722]: cluster 2024-09-14T05:01:02.948503+0000 mgr.a (mgr.14355) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:04 smithi131 bash[24745]: cluster 2024-09-14T05:01:02.948503+0000 mgr.a (mgr.14355) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:04 smithi171 bash[25040]: cluster 2024-09-14T05:01:02.948503+0000 mgr.a (mgr.14355) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:05.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:05.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:06 smithi007 bash[22722]: cluster 2024-09-14T05:01:04.949051+0000 mgr.a (mgr.14355) 17305 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:06 smithi007 bash[22722]: audit 2024-09-14T05:01:05.123444+0000 mgr.a (mgr.14355) 17306 : audit [DBG] from='client.372363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:06 smithi131 bash[24745]: cluster 2024-09-14T05:01:04.949051+0000 mgr.a (mgr.14355) 17305 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:06 smithi131 bash[24745]: audit 2024-09-14T05:01:05.123444+0000 mgr.a (mgr.14355) 17306 : audit [DBG] from='client.372363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:06 smithi171 bash[25040]: cluster 2024-09-14T05:01:04.949051+0000 mgr.a (mgr.14355) 17305 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:06 smithi171 bash[25040]: audit 2024-09-14T05:01:05.123444+0000 mgr.a (mgr.14355) 17306 : audit [DBG] from='client.372363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:08 smithi007 bash[22722]: cluster 2024-09-14T05:01:06.951789+0000 mgr.a (mgr.14355) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:08 smithi131 bash[24745]: cluster 2024-09-14T05:01:06.951789+0000 mgr.a (mgr.14355) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:08 smithi171 bash[25040]: cluster 2024-09-14T05:01:06.951789+0000 mgr.a (mgr.14355) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:10.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:10.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:10.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:10 smithi007 bash[22722]: cluster 2024-09-14T05:01:08.952520+0000 mgr.a (mgr.14355) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:10 smithi131 bash[24745]: cluster 2024-09-14T05:01:08.952520+0000 mgr.a (mgr.14355) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:10 smithi171 bash[25040]: cluster 2024-09-14T05:01:08.952520+0000 mgr.a (mgr.14355) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:11.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:11.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:12 smithi007 bash[22722]: audit 2024-09-14T05:01:10.885768+0000 mgr.a (mgr.14355) 17309 : audit [DBG] from='client.372441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:12 smithi007 bash[22722]: cluster 2024-09-14T05:01:10.953829+0000 mgr.a (mgr.14355) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:12 smithi131 bash[24745]: audit 2024-09-14T05:01:10.885768+0000 mgr.a (mgr.14355) 17309 : audit [DBG] from='client.372441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:12 smithi131 bash[24745]: cluster 2024-09-14T05:01:10.953829+0000 mgr.a (mgr.14355) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:12 smithi171 bash[25040]: audit 2024-09-14T05:01:10.885768+0000 mgr.a (mgr.14355) 17309 : audit [DBG] from='client.372441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:12 smithi171 bash[25040]: cluster 2024-09-14T05:01:10.953829+0000 mgr.a (mgr.14355) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:14 smithi007 bash[22722]: cluster 2024-09-14T05:01:12.954805+0000 mgr.a (mgr.14355) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:14 smithi131 bash[24745]: cluster 2024-09-14T05:01:12.954805+0000 mgr.a (mgr.14355) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:14 smithi171 bash[25040]: cluster 2024-09-14T05:01:12.954805+0000 mgr.a (mgr.14355) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:16.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:16.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:16.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:16 smithi007 bash[22722]: cluster 2024-09-14T05:01:14.955582+0000 mgr.a (mgr.14355) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:16 smithi131 bash[24745]: cluster 2024-09-14T05:01:14.955582+0000 mgr.a (mgr.14355) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:16 smithi171 bash[25040]: cluster 2024-09-14T05:01:14.955582+0000 mgr.a (mgr.14355) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:17.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:17.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:17.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:17.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:17.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:18 smithi007 bash[22722]: audit 2024-09-14T05:01:16.642739+0000 mgr.a (mgr.14355) 17313 : audit [DBG] from='client.372519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:18.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:18 smithi007 bash[22722]: cluster 2024-09-14T05:01:16.957238+0000 mgr.a (mgr.14355) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:18 smithi131 bash[24745]: audit 2024-09-14T05:01:16.642739+0000 mgr.a (mgr.14355) 17313 : audit [DBG] from='client.372519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:18 smithi131 bash[24745]: cluster 2024-09-14T05:01:16.957238+0000 mgr.a (mgr.14355) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:18 smithi171 bash[25040]: audit 2024-09-14T05:01:16.642739+0000 mgr.a (mgr.14355) 17313 : audit [DBG] from='client.372519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:18 smithi171 bash[25040]: cluster 2024-09-14T05:01:16.957238+0000 mgr.a (mgr.14355) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:19 smithi007 bash[22722]: cluster 2024-09-14T05:01:18.958108+0000 mgr.a (mgr.14355) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:19 smithi131 bash[24745]: cluster 2024-09-14T05:01:18.958108+0000 mgr.a (mgr.14355) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:19 smithi171 bash[25040]: cluster 2024-09-14T05:01:18.958108+0000 mgr.a (mgr.14355) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:22 smithi131 bash[24745]: cluster 2024-09-14T05:01:20.960270+0000 mgr.a (mgr.14355) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:22 smithi171 bash[25040]: cluster 2024-09-14T05:01:20.960270+0000 mgr.a (mgr.14355) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:22 smithi007 bash[22722]: cluster 2024-09-14T05:01:20.960270+0000 mgr.a (mgr.14355) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:22.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:22.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:22.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:23 smithi171 bash[25040]: audit 2024-09-14T05:01:22.407528+0000 mgr.a (mgr.14355) 17317 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:23 smithi007 bash[22722]: audit 2024-09-14T05:01:22.407528+0000 mgr.a (mgr.14355) 17317 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:23 smithi131 bash[24745]: audit 2024-09-14T05:01:22.407528+0000 mgr.a (mgr.14355) 17317 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:24 smithi171 bash[25040]: cluster 2024-09-14T05:01:22.961217+0000 mgr.a (mgr.14355) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:24 smithi007 bash[22722]: cluster 2024-09-14T05:01:22.961217+0000 mgr.a (mgr.14355) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:24 smithi131 bash[24745]: cluster 2024-09-14T05:01:22.961217+0000 mgr.a (mgr.14355) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:26 smithi171 bash[25040]: cluster 2024-09-14T05:01:24.962053+0000 mgr.a (mgr.14355) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:26 smithi007 bash[22722]: cluster 2024-09-14T05:01:24.962053+0000 mgr.a (mgr.14355) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:26 smithi131 bash[24745]: cluster 2024-09-14T05:01:24.962053+0000 mgr.a (mgr.14355) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:27.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:28 smithi007 bash[22722]: cluster 2024-09-14T05:01:26.964354+0000 mgr.a (mgr.14355) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:28 smithi131 bash[24745]: cluster 2024-09-14T05:01:26.964354+0000 mgr.a (mgr.14355) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:28 smithi171 bash[25040]: cluster 2024-09-14T05:01:26.964354+0000 mgr.a (mgr.14355) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:28.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:28.643 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:28.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:29.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:29 smithi007 bash[22722]: audit 2024-09-14T05:01:28.197932+0000 mgr.a (mgr.14355) 17321 : audit [DBG] from='client.372666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:29 smithi131 bash[24745]: audit 2024-09-14T05:01:28.197932+0000 mgr.a (mgr.14355) 17321 : audit [DBG] from='client.372666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:29 smithi171 bash[25040]: audit 2024-09-14T05:01:28.197932+0000 mgr.a (mgr.14355) 17321 : audit [DBG] from='client.372666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:30 smithi007 bash[22722]: cluster 2024-09-14T05:01:28.965547+0000 mgr.a (mgr.14355) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:30 smithi131 bash[24745]: cluster 2024-09-14T05:01:28.965547+0000 mgr.a (mgr.14355) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:30 smithi171 bash[25040]: cluster 2024-09-14T05:01:28.965547+0000 mgr.a (mgr.14355) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:32 smithi007 bash[22722]: cluster 2024-09-14T05:01:30.967852+0000 mgr.a (mgr.14355) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:32 smithi131 bash[24745]: cluster 2024-09-14T05:01:30.967852+0000 mgr.a (mgr.14355) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:32 smithi171 bash[25040]: cluster 2024-09-14T05:01:30.967852+0000 mgr.a (mgr.14355) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:33.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:33.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:33.645 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:34.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:34 smithi007 bash[22722]: cluster 2024-09-14T05:01:32.968622+0000 mgr.a (mgr.14355) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:34 smithi131 bash[24745]: cluster 2024-09-14T05:01:32.968622+0000 mgr.a (mgr.14355) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:34 smithi171 bash[25040]: cluster 2024-09-14T05:01:32.968622+0000 mgr.a (mgr.14355) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:35 smithi007 bash[22722]: audit 2024-09-14T05:01:33.978943+0000 mgr.a (mgr.14355) 17325 : audit [DBG] from='client.372744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:35 smithi131 bash[24745]: audit 2024-09-14T05:01:33.978943+0000 mgr.a (mgr.14355) 17325 : audit [DBG] from='client.372744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:35 smithi171 bash[25040]: audit 2024-09-14T05:01:33.978943+0000 mgr.a (mgr.14355) 17325 : audit [DBG] from='client.372744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:36 smithi007 bash[22722]: cluster 2024-09-14T05:01:34.969615+0000 mgr.a (mgr.14355) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:36 smithi131 bash[24745]: cluster 2024-09-14T05:01:34.969615+0000 mgr.a (mgr.14355) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:36 smithi171 bash[25040]: cluster 2024-09-14T05:01:34.969615+0000 mgr.a (mgr.14355) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:38 smithi007 bash[22722]: cluster 2024-09-14T05:01:36.971938+0000 mgr.a (mgr.14355) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:38 smithi131 bash[24745]: cluster 2024-09-14T05:01:36.971938+0000 mgr.a (mgr.14355) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:38 smithi171 bash[25040]: cluster 2024-09-14T05:01:36.971938+0000 mgr.a (mgr.14355) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:40.209 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:40 smithi007 bash[22722]: cluster 2024-09-14T05:01:38.972694+0000 mgr.a (mgr.14355) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:40 smithi131 bash[24745]: cluster 2024-09-14T05:01:38.972694+0000 mgr.a (mgr.14355) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:40 smithi171 bash[25040]: cluster 2024-09-14T05:01:38.972694+0000 mgr.a (mgr.14355) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:41 smithi007 bash[22722]: audit 2024-09-14T05:01:39.768033+0000 mgr.a (mgr.14355) 17329 : audit [DBG] from='client.372819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:41 smithi131 bash[24745]: audit 2024-09-14T05:01:39.768033+0000 mgr.a (mgr.14355) 17329 : audit [DBG] from='client.372819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:41 smithi171 bash[25040]: audit 2024-09-14T05:01:39.768033+0000 mgr.a (mgr.14355) 17329 : audit [DBG] from='client.372819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:42 smithi007 bash[22722]: cluster 2024-09-14T05:01:40.975235+0000 mgr.a (mgr.14355) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:42 smithi131 bash[24745]: cluster 2024-09-14T05:01:40.975235+0000 mgr.a (mgr.14355) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:42 smithi171 bash[25040]: cluster 2024-09-14T05:01:40.975235+0000 mgr.a (mgr.14355) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:01:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:44 smithi007 bash[22722]: cluster 2024-09-14T05:01:42.976019+0000 mgr.a (mgr.14355) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:44 smithi131 bash[24745]: cluster 2024-09-14T05:01:42.976019+0000 mgr.a (mgr.14355) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:44 smithi171 bash[25040]: cluster 2024-09-14T05:01:42.976019+0000 mgr.a (mgr.14355) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:45.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:45.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:45.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:45.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:45.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:46 smithi007 bash[22722]: cluster 2024-09-14T05:01:44.976771+0000 mgr.a (mgr.14355) 17332 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:46 smithi007 bash[22722]: audit 2024-09-14T05:01:45.541006+0000 mgr.a (mgr.14355) 17333 : audit [DBG] from='client.372897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:46 smithi131 bash[24745]: cluster 2024-09-14T05:01:44.976771+0000 mgr.a (mgr.14355) 17332 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:46 smithi131 bash[24745]: audit 2024-09-14T05:01:45.541006+0000 mgr.a (mgr.14355) 17333 : audit [DBG] from='client.372897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:46 smithi171 bash[25040]: cluster 2024-09-14T05:01:44.976771+0000 mgr.a (mgr.14355) 17332 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:46 smithi171 bash[25040]: audit 2024-09-14T05:01:45.541006+0000 mgr.a (mgr.14355) 17333 : audit [DBG] from='client.372897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:48 smithi007 bash[22722]: cluster 2024-09-14T05:01:46.979550+0000 mgr.a (mgr.14355) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:48 smithi131 bash[24745]: cluster 2024-09-14T05:01:46.979550+0000 mgr.a (mgr.14355) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:48 smithi171 bash[25040]: cluster 2024-09-14T05:01:46.979550+0000 mgr.a (mgr.14355) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:50 smithi007 bash[22722]: cluster 2024-09-14T05:01:48.980488+0000 mgr.a (mgr.14355) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:50 smithi131 bash[24745]: cluster 2024-09-14T05:01:48.980488+0000 mgr.a (mgr.14355) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:50 smithi171 bash[25040]: cluster 2024-09-14T05:01:48.980488+0000 mgr.a (mgr.14355) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:51.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:51.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:51 smithi131 bash[24745]: audit 2024-09-14T05:01:51.389572+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:01:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:51 smithi171 bash[25040]: audit 2024-09-14T05:01:51.389572+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:01:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:51 smithi007 bash[22722]: audit 2024-09-14T05:01:51.389572+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:01:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: cluster 2024-09-14T05:01:50.982583+0000 mgr.a (mgr.14355) 17336 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: audit 2024-09-14T05:01:51.299621+0000 mgr.a (mgr.14355) 17337 : audit [DBG] from='client.372975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: audit 2024-09-14T05:01:52.184332+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:01:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: audit 2024-09-14T05:01:52.186050+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:01:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: audit 2024-09-14T05:01:52.193612+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:01:52.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:52 smithi131 bash[24745]: audit 2024-09-14T05:01:52.198259+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: cluster 2024-09-14T05:01:50.982583+0000 mgr.a (mgr.14355) 17336 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: audit 2024-09-14T05:01:51.299621+0000 mgr.a (mgr.14355) 17337 : audit [DBG] from='client.372975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: audit 2024-09-14T05:01:52.184332+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:01:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: audit 2024-09-14T05:01:52.186050+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:01:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: audit 2024-09-14T05:01:52.193612+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:01:52.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:52 smithi171 bash[25040]: audit 2024-09-14T05:01:52.198259+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: cluster 2024-09-14T05:01:50.982583+0000 mgr.a (mgr.14355) 17336 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:01:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: audit 2024-09-14T05:01:51.299621+0000 mgr.a (mgr.14355) 17337 : audit [DBG] from='client.372975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: audit 2024-09-14T05:01:52.184332+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:01:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: audit 2024-09-14T05:01:52.186050+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:01:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: audit 2024-09-14T05:01:52.193612+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:01:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22722]: audit 2024-09-14T05:01:52.198259+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:53.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22972]: debug 2024-09-14T05:01:52.956+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:01:53.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:01:52 smithi007 bash[22972]: debug 2024-09-14T05:01:52.956+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:01:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:53 smithi131 bash[24745]: audit 2024-09-14T05:01:52.199459+0000 mgr.a (mgr.14355) 17338 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:53 smithi171 bash[25040]: audit 2024-09-14T05:01:52.199459+0000 mgr.a (mgr.14355) 17338 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:53 smithi007 bash[22722]: audit 2024-09-14T05:01:52.199459+0000 mgr.a (mgr.14355) 17338 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:01:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:54 smithi131 bash[24745]: audit 2024-09-14T05:01:52.959793+0000 mgr.a (mgr.14355) 17339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:01:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:54 smithi131 bash[24745]: cephadm 2024-09-14T05:01:52.961247+0000 mgr.a (mgr.14355) 17340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:01:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:54 smithi131 bash[24745]: cluster 2024-09-14T05:01:52.983122+0000 mgr.a (mgr.14355) 17341 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:54 smithi171 bash[25040]: audit 2024-09-14T05:01:52.959793+0000 mgr.a (mgr.14355) 17339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:01:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:54 smithi171 bash[25040]: cephadm 2024-09-14T05:01:52.961247+0000 mgr.a (mgr.14355) 17340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:01:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:54 smithi171 bash[25040]: cluster 2024-09-14T05:01:52.983122+0000 mgr.a (mgr.14355) 17341 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:54 smithi007 bash[22722]: audit 2024-09-14T05:01:52.959793+0000 mgr.a (mgr.14355) 17339 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:01:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:54 smithi007 bash[22722]: cephadm 2024-09-14T05:01:52.961247+0000 mgr.a (mgr.14355) 17340 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:01:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:54 smithi007 bash[22722]: cluster 2024-09-14T05:01:52.983122+0000 mgr.a (mgr.14355) 17341 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:01:56.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:01:56.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:01:56.728 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:01:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:56 smithi131 bash[24745]: cluster 2024-09-14T05:01:54.983831+0000 mgr.a (mgr.14355) 17342 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:56 smithi171 bash[25040]: cluster 2024-09-14T05:01:54.983831+0000 mgr.a (mgr.14355) 17342 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:56 smithi007 bash[22722]: cluster 2024-09-14T05:01:54.983831+0000 mgr.a (mgr.14355) 17342 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:01:57.514 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:01:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:01:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:01:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:01:57.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:01:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:58 smithi131 bash[24745]: cluster 2024-09-14T05:01:56.985185+0000 mgr.a (mgr.14355) 17343 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:01:58 smithi131 bash[24745]: audit 2024-09-14T05:01:57.066396+0000 mgr.a (mgr.14355) 17344 : audit [DBG] from='client.373158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:58 smithi171 bash[25040]: cluster 2024-09-14T05:01:56.985185+0000 mgr.a (mgr.14355) 17343 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:01:58 smithi171 bash[25040]: audit 2024-09-14T05:01:57.066396+0000 mgr.a (mgr.14355) 17344 : audit [DBG] from='client.373158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:01:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:58 smithi007 bash[22722]: cluster 2024-09-14T05:01:56.985185+0000 mgr.a (mgr.14355) 17343 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:01:58.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:01:58 smithi007 bash[22722]: audit 2024-09-14T05:01:57.066396+0000 mgr.a (mgr.14355) 17344 : audit [DBG] from='client.373158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:00 smithi131 bash[24745]: cluster 2024-09-14T05:01:58.986082+0000 mgr.a (mgr.14355) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:02:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:00 smithi171 bash[25040]: cluster 2024-09-14T05:01:58.986082+0000 mgr.a (mgr.14355) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:02:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:00 smithi007 bash[22722]: cluster 2024-09-14T05:01:58.986082+0000 mgr.a (mgr.14355) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:02:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:02.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:02.517 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:02 smithi131 bash[24745]: cluster 2024-09-14T05:02:00.989117+0000 mgr.a (mgr.14355) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T05:02:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:02 smithi171 bash[25040]: cluster 2024-09-14T05:02:00.989117+0000 mgr.a (mgr.14355) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T05:02:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:02 smithi007 bash[22722]: cluster 2024-09-14T05:02:00.989117+0000 mgr.a (mgr.14355) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-14T05:02:03.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:03.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:04 smithi131 bash[24745]: audit 2024-09-14T05:02:02.857338+0000 mgr.a (mgr.14355) 17347 : audit [DBG] from='client.373233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:04 smithi131 bash[24745]: cluster 2024-09-14T05:02:02.994483+0000 mgr.a (mgr.14355) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:04 smithi171 bash[25040]: audit 2024-09-14T05:02:02.857338+0000 mgr.a (mgr.14355) 17347 : audit [DBG] from='client.373233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:04 smithi171 bash[25040]: cluster 2024-09-14T05:02:02.994483+0000 mgr.a (mgr.14355) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:04 smithi007 bash[22722]: audit 2024-09-14T05:02:02.857338+0000 mgr.a (mgr.14355) 17347 : audit [DBG] from='client.373233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:04 smithi007 bash[22722]: cluster 2024-09-14T05:02:02.994483+0000 mgr.a (mgr.14355) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:06 smithi131 bash[24745]: cluster 2024-09-14T05:02:04.995368+0000 mgr.a (mgr.14355) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:06 smithi171 bash[25040]: cluster 2024-09-14T05:02:04.995368+0000 mgr.a (mgr.14355) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:06 smithi007 bash[22722]: cluster 2024-09-14T05:02:04.995368+0000 mgr.a (mgr.14355) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-14T05:02:08.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:08.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:08.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:08 smithi171 bash[25040]: cluster 2024-09-14T05:02:06.997642+0000 mgr.a (mgr.14355) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:02:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:08 smithi007 bash[22722]: cluster 2024-09-14T05:02:06.997642+0000 mgr.a (mgr.14355) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:02:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:08 smithi131 bash[24745]: cluster 2024-09-14T05:02:06.997642+0000 mgr.a (mgr.14355) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:02:09.072 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:09.073 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:09 smithi007 bash[22722]: audit 2024-09-14T05:02:08.636619+0000 mgr.a (mgr.14355) 17351 : audit [DBG] from='client.373308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:09 smithi131 bash[24745]: audit 2024-09-14T05:02:08.636619+0000 mgr.a (mgr.14355) 17351 : audit [DBG] from='client.373308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:09 smithi171 bash[25040]: audit 2024-09-14T05:02:08.636619+0000 mgr.a (mgr.14355) 17351 : audit [DBG] from='client.373308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:10 smithi007 bash[22722]: cluster 2024-09-14T05:02:08.998244+0000 mgr.a (mgr.14355) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:02:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:10 smithi131 bash[24745]: cluster 2024-09-14T05:02:08.998244+0000 mgr.a (mgr.14355) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:02:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:10 smithi171 bash[25040]: cluster 2024-09-14T05:02:08.998244+0000 mgr.a (mgr.14355) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:02:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:12 smithi007 bash[22722]: cluster 2024-09-14T05:02:11.000410+0000 mgr.a (mgr.14355) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:02:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:12 smithi131 bash[24745]: cluster 2024-09-14T05:02:11.000410+0000 mgr.a (mgr.14355) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:02:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:12 smithi171 bash[25040]: cluster 2024-09-14T05:02:11.000410+0000 mgr.a (mgr.14355) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:02:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:14.074 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:14.075 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:14.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:14.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:14.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:14.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:14.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:14 smithi007 bash[22722]: cluster 2024-09-14T05:02:13.001199+0000 mgr.a (mgr.14355) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:14 smithi131 bash[24745]: cluster 2024-09-14T05:02:13.001199+0000 mgr.a (mgr.14355) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:14 smithi171 bash[25040]: cluster 2024-09-14T05:02:13.001199+0000 mgr.a (mgr.14355) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:15 smithi007 bash[22722]: audit 2024-09-14T05:02:14.409385+0000 mgr.a (mgr.14355) 17355 : audit [DBG] from='client.373383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:15 smithi131 bash[24745]: audit 2024-09-14T05:02:14.409385+0000 mgr.a (mgr.14355) 17355 : audit [DBG] from='client.373383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:15 smithi171 bash[25040]: audit 2024-09-14T05:02:14.409385+0000 mgr.a (mgr.14355) 17355 : audit [DBG] from='client.373383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:16 smithi007 bash[22722]: cluster 2024-09-14T05:02:15.002205+0000 mgr.a (mgr.14355) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:16 smithi131 bash[24745]: cluster 2024-09-14T05:02:15.002205+0000 mgr.a (mgr.14355) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:16 smithi171 bash[25040]: cluster 2024-09-14T05:02:15.002205+0000 mgr.a (mgr.14355) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-14T05:02:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:18 smithi007 bash[22722]: cluster 2024-09-14T05:02:17.004542+0000 mgr.a (mgr.14355) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-14T05:02:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:18 smithi131 bash[24745]: cluster 2024-09-14T05:02:17.004542+0000 mgr.a (mgr.14355) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-14T05:02:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:18 smithi171 bash[25040]: cluster 2024-09-14T05:02:17.004542+0000 mgr.a (mgr.14355) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-14T05:02:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:20.607 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:20.607 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:20 smithi007 bash[22722]: cluster 2024-09-14T05:02:19.005362+0000 mgr.a (mgr.14355) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:20 smithi131 bash[24745]: cluster 2024-09-14T05:02:19.005362+0000 mgr.a (mgr.14355) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:20 smithi171 bash[25040]: cluster 2024-09-14T05:02:19.005362+0000 mgr.a (mgr.14355) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:21 smithi007 bash[22722]: audit 2024-09-14T05:02:20.184814+0000 mgr.a (mgr.14355) 17359 : audit [DBG] from='client.373458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:21 smithi131 bash[24745]: audit 2024-09-14T05:02:20.184814+0000 mgr.a (mgr.14355) 17359 : audit [DBG] from='client.373458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:21 smithi171 bash[25040]: audit 2024-09-14T05:02:20.184814+0000 mgr.a (mgr.14355) 17359 : audit [DBG] from='client.373458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:22 smithi007 bash[22722]: cluster 2024-09-14T05:02:21.008240+0000 mgr.a (mgr.14355) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:22 smithi131 bash[24745]: cluster 2024-09-14T05:02:21.008240+0000 mgr.a (mgr.14355) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:22 smithi171 bash[25040]: cluster 2024-09-14T05:02:21.008240+0000 mgr.a (mgr.14355) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:24 smithi007 bash[22722]: cluster 2024-09-14T05:02:23.009039+0000 mgr.a (mgr.14355) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:24 smithi131 bash[24745]: cluster 2024-09-14T05:02:23.009039+0000 mgr.a (mgr.14355) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:24 smithi171 bash[25040]: cluster 2024-09-14T05:02:23.009039+0000 mgr.a (mgr.14355) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:25.608 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:25.609 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:26.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:26.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:26 smithi007 bash[22722]: cluster 2024-09-14T05:02:25.009834+0000 mgr.a (mgr.14355) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:26 smithi131 bash[24745]: cluster 2024-09-14T05:02:25.009834+0000 mgr.a (mgr.14355) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:26 smithi171 bash[25040]: cluster 2024-09-14T05:02:25.009834+0000 mgr.a (mgr.14355) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 217 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:02:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:27 smithi007 bash[22722]: audit 2024-09-14T05:02:25.951264+0000 mgr.a (mgr.14355) 17363 : audit [DBG] from='client.373536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:27 smithi131 bash[24745]: audit 2024-09-14T05:02:25.951264+0000 mgr.a (mgr.14355) 17363 : audit [DBG] from='client.373536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:27 smithi171 bash[25040]: audit 2024-09-14T05:02:25.951264+0000 mgr.a (mgr.14355) 17363 : audit [DBG] from='client.373536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:28 smithi007 bash[22722]: cluster 2024-09-14T05:02:27.012656+0000 mgr.a (mgr.14355) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:28 smithi131 bash[24745]: cluster 2024-09-14T05:02:27.012656+0000 mgr.a (mgr.14355) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:28 smithi171 bash[25040]: cluster 2024-09-14T05:02:27.012656+0000 mgr.a (mgr.14355) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:30 smithi007 bash[22722]: cluster 2024-09-14T05:02:29.013464+0000 mgr.a (mgr.14355) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T05:02:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:30 smithi131 bash[24745]: cluster 2024-09-14T05:02:29.013464+0000 mgr.a (mgr.14355) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T05:02:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:30 smithi171 bash[25040]: cluster 2024-09-14T05:02:29.013464+0000 mgr.a (mgr.14355) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-14T05:02:31.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:31.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:31.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:32.176 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:32 smithi007 bash[22722]: cluster 2024-09-14T05:02:31.015500+0000 mgr.a (mgr.14355) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:32 smithi131 bash[24745]: cluster 2024-09-14T05:02:31.015500+0000 mgr.a (mgr.14355) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:32 smithi171 bash[25040]: cluster 2024-09-14T05:02:31.015500+0000 mgr.a (mgr.14355) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:33 smithi007 bash[22722]: audit 2024-09-14T05:02:31.730459+0000 mgr.a (mgr.14355) 17367 : audit [DBG] from='client.373611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:33 smithi131 bash[24745]: audit 2024-09-14T05:02:31.730459+0000 mgr.a (mgr.14355) 17367 : audit [DBG] from='client.373611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:33 smithi171 bash[25040]: audit 2024-09-14T05:02:31.730459+0000 mgr.a (mgr.14355) 17367 : audit [DBG] from='client.373611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:34 smithi007 bash[22722]: cluster 2024-09-14T05:02:33.016354+0000 mgr.a (mgr.14355) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:34 smithi131 bash[24745]: cluster 2024-09-14T05:02:33.016354+0000 mgr.a (mgr.14355) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:34 smithi171 bash[25040]: cluster 2024-09-14T05:02:33.016354+0000 mgr.a (mgr.14355) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:36 smithi007 bash[22722]: cluster 2024-09-14T05:02:35.017313+0000 mgr.a (mgr.14355) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:36 smithi131 bash[24745]: cluster 2024-09-14T05:02:35.017313+0000 mgr.a (mgr.14355) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:36 smithi171 bash[25040]: cluster 2024-09-14T05:02:35.017313+0000 mgr.a (mgr.14355) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:02:37.177 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:37.178 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:37.937 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:37.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:37.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:37.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:37.938 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:38 smithi007 bash[22722]: cluster 2024-09-14T05:02:37.019611+0000 mgr.a (mgr.14355) 17370 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:02:38.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:38 smithi007 bash[22722]: audit 2024-09-14T05:02:37.509581+0000 mgr.a (mgr.14355) 17371 : audit [DBG] from='client.373689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:38 smithi131 bash[24745]: cluster 2024-09-14T05:02:37.019611+0000 mgr.a (mgr.14355) 17370 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:02:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:38 smithi131 bash[24745]: audit 2024-09-14T05:02:37.509581+0000 mgr.a (mgr.14355) 17371 : audit [DBG] from='client.373689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:38 smithi171 bash[25040]: cluster 2024-09-14T05:02:37.019611+0000 mgr.a (mgr.14355) 17370 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:02:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:38 smithi171 bash[25040]: audit 2024-09-14T05:02:37.509581+0000 mgr.a (mgr.14355) 17371 : audit [DBG] from='client.373689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:40 smithi007 bash[22722]: cluster 2024-09-14T05:02:39.020534+0000 mgr.a (mgr.14355) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:40 smithi131 bash[24745]: cluster 2024-09-14T05:02:39.020534+0000 mgr.a (mgr.14355) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:40 smithi171 bash[25040]: cluster 2024-09-14T05:02:39.020534+0000 mgr.a (mgr.14355) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:42.939 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:42.940 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:42 smithi007 bash[22722]: cluster 2024-09-14T05:02:41.022821+0000 mgr.a (mgr.14355) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:42 smithi131 bash[24745]: cluster 2024-09-14T05:02:41.022821+0000 mgr.a (mgr.14355) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:42 smithi171 bash[25040]: cluster 2024-09-14T05:02:41.022821+0000 mgr.a (mgr.14355) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:43.723 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:43.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:44 smithi007 bash[22722]: cluster 2024-09-14T05:02:43.023510+0000 mgr.a (mgr.14355) 17374 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:44 smithi007 bash[22722]: audit 2024-09-14T05:02:43.276365+0000 mgr.a (mgr.14355) 17375 : audit [DBG] from='client.373764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:44 smithi131 bash[24745]: cluster 2024-09-14T05:02:43.023510+0000 mgr.a (mgr.14355) 17374 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:45.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:44 smithi131 bash[24745]: audit 2024-09-14T05:02:43.276365+0000 mgr.a (mgr.14355) 17375 : audit [DBG] from='client.373764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:44 smithi171 bash[25040]: cluster 2024-09-14T05:02:43.023510+0000 mgr.a (mgr.14355) 17374 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:44 smithi171 bash[25040]: audit 2024-09-14T05:02:43.276365+0000 mgr.a (mgr.14355) 17375 : audit [DBG] from='client.373764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:46 smithi007 bash[22722]: cluster 2024-09-14T05:02:45.024381+0000 mgr.a (mgr.14355) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:46 smithi131 bash[24745]: cluster 2024-09-14T05:02:45.024381+0000 mgr.a (mgr.14355) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:46 smithi171 bash[25040]: cluster 2024-09-14T05:02:45.024381+0000 mgr.a (mgr.14355) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:48.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:48 smithi007 bash[22722]: cluster 2024-09-14T05:02:47.026664+0000 mgr.a (mgr.14355) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:48 smithi131 bash[24745]: cluster 2024-09-14T05:02:47.026664+0000 mgr.a (mgr.14355) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:48 smithi171 bash[25040]: cluster 2024-09-14T05:02:47.026664+0000 mgr.a (mgr.14355) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:49.477 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:49.477 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:49.478 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:50 smithi007 bash[22722]: cluster 2024-09-14T05:02:49.027403+0000 mgr.a (mgr.14355) 17378 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:50 smithi007 bash[22722]: audit 2024-09-14T05:02:49.061944+0000 mgr.a (mgr.14355) 17379 : audit [DBG] from='client.373842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:50 smithi131 bash[24745]: cluster 2024-09-14T05:02:49.027403+0000 mgr.a (mgr.14355) 17378 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:50 smithi131 bash[24745]: audit 2024-09-14T05:02:49.061944+0000 mgr.a (mgr.14355) 17379 : audit [DBG] from='client.373842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:50 smithi171 bash[25040]: cluster 2024-09-14T05:02:49.027403+0000 mgr.a (mgr.14355) 17378 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:50 smithi171 bash[25040]: audit 2024-09-14T05:02:49.061944+0000 mgr.a (mgr.14355) 17379 : audit [DBG] from='client.373842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:52 smithi007 bash[22722]: cluster 2024-09-14T05:02:51.029767+0000 mgr.a (mgr.14355) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:52 smithi131 bash[24745]: cluster 2024-09-14T05:02:51.029767+0000 mgr.a (mgr.14355) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:52 smithi171 bash[25040]: cluster 2024-09-14T05:02:51.029767+0000 mgr.a (mgr.14355) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:02:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:53 smithi007 bash[22722]: audit 2024-09-14T05:02:53.014847+0000 mon.a (mon.0) 3186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:02:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:53 smithi131 bash[24745]: audit 2024-09-14T05:02:53.014847+0000 mon.a (mon.0) 3186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:02:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:53 smithi171 bash[25040]: audit 2024-09-14T05:02:53.014847+0000 mon.a (mon.0) 3186 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:02:54.479 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:02:54.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:02:54.479 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:02:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22972]: debug 2024-09-14T05:02:54.635+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:02:54.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22972]: debug 2024-09-14T05:02:54.635+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: cluster 2024-09-14T05:02:53.030535+0000 mgr.a (mgr.14355) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:53.856606+0000 mon.a (mon.0) 3187 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:53.858394+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:53.869168+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:53.874017+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:53.876339+0000 mgr.a (mgr.14355) 17382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: audit 2024-09-14T05:02:54.639514+0000 mgr.a (mgr.14355) 17383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:02:54.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:54 smithi007 bash[22722]: cephadm 2024-09-14T05:02:54.640716+0000 mgr.a (mgr.14355) 17384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:02:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: cluster 2024-09-14T05:02:53.030535+0000 mgr.a (mgr.14355) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:53.856606+0000 mon.a (mon.0) 3187 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:53.858394+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:53.869168+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:53.874017+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:53.876339+0000 mgr.a (mgr.14355) 17382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: audit 2024-09-14T05:02:54.639514+0000 mgr.a (mgr.14355) 17383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:02:55.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:54 smithi131 bash[24745]: cephadm 2024-09-14T05:02:54.640716+0000 mgr.a (mgr.14355) 17384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:02:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: cluster 2024-09-14T05:02:53.030535+0000 mgr.a (mgr.14355) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:53.856606+0000 mon.a (mon.0) 3187 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:02:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:53.858394+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:02:55.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:53.869168+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:02:55.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:53.874017+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:55.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:53.876339+0000 mgr.a (mgr.14355) 17382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:02:55.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: audit 2024-09-14T05:02:54.639514+0000 mgr.a (mgr.14355) 17383 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:02:55.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:54 smithi171 bash[25040]: cephadm 2024-09-14T05:02:54.640716+0000 mgr.a (mgr.14355) 17384 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:02:55.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:02:55.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:02:55.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:02:55.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:02:55.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:02:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:55 smithi007 bash[22722]: audit 2024-09-14T05:02:54.803385+0000 mgr.a (mgr.14355) 17385 : audit [DBG] from='client.374025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:55.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:55 smithi007 bash[22722]: cluster 2024-09-14T05:02:55.034596+0000 mgr.a (mgr.14355) 17386 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:55 smithi131 bash[24745]: audit 2024-09-14T05:02:54.803385+0000 mgr.a (mgr.14355) 17385 : audit [DBG] from='client.374025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:55 smithi131 bash[24745]: cluster 2024-09-14T05:02:55.034596+0000 mgr.a (mgr.14355) 17386 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:55 smithi171 bash[25040]: audit 2024-09-14T05:02:54.803385+0000 mgr.a (mgr.14355) 17385 : audit [DBG] from='client.374025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:02:56.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:55 smithi171 bash[25040]: cluster 2024-09-14T05:02:55.034596+0000 mgr.a (mgr.14355) 17386 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:02:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:02:58 smithi007 bash[22722]: cluster 2024-09-14T05:02:57.036898+0000 mgr.a (mgr.14355) 17387 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:02:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:02:58 smithi131 bash[24745]: cluster 2024-09-14T05:02:57.036898+0000 mgr.a (mgr.14355) 17387 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:02:58.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:02:58 smithi171 bash[25040]: cluster 2024-09-14T05:02:57.036898+0000 mgr.a (mgr.14355) 17387 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:00.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:00.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:00 smithi007 bash[22722]: cluster 2024-09-14T05:02:59.037731+0000 mgr.a (mgr.14355) 17388 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:00 smithi131 bash[24745]: cluster 2024-09-14T05:02:59.037731+0000 mgr.a (mgr.14355) 17388 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:00 smithi171 bash[25040]: cluster 2024-09-14T05:02:59.037731+0000 mgr.a (mgr.14355) 17388 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:00.986 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:00.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:01 smithi007 bash[22722]: audit 2024-09-14T05:03:00.558081+0000 mgr.a (mgr.14355) 17389 : audit [DBG] from='client.374103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:01 smithi131 bash[24745]: audit 2024-09-14T05:03:00.558081+0000 mgr.a (mgr.14355) 17389 : audit [DBG] from='client.374103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:01 smithi171 bash[25040]: audit 2024-09-14T05:03:00.558081+0000 mgr.a (mgr.14355) 17389 : audit [DBG] from='client.374103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:02 smithi007 bash[22722]: cluster 2024-09-14T05:03:01.039280+0000 mgr.a (mgr.14355) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:02 smithi131 bash[24745]: cluster 2024-09-14T05:03:01.039280+0000 mgr.a (mgr.14355) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:02 smithi171 bash[25040]: cluster 2024-09-14T05:03:01.039280+0000 mgr.a (mgr.14355) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:04 smithi007 bash[22722]: cluster 2024-09-14T05:03:03.040036+0000 mgr.a (mgr.14355) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:04 smithi131 bash[24745]: cluster 2024-09-14T05:03:03.040036+0000 mgr.a (mgr.14355) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:04 smithi171 bash[25040]: cluster 2024-09-14T05:03:03.040036+0000 mgr.a (mgr.14355) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:05.987 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:05.988 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:06 smithi007 bash[22722]: cluster 2024-09-14T05:03:05.040844+0000 mgr.a (mgr.14355) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:06 smithi131 bash[24745]: cluster 2024-09-14T05:03:05.040844+0000 mgr.a (mgr.14355) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:06 smithi171 bash[25040]: cluster 2024-09-14T05:03:05.040844+0000 mgr.a (mgr.14355) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:03:06.753 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:06.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:06.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:06.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:06.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:07 smithi007 bash[22722]: audit 2024-09-14T05:03:06.320497+0000 mgr.a (mgr.14355) 17393 : audit [DBG] from='client.374181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:07 smithi131 bash[24745]: audit 2024-09-14T05:03:06.320497+0000 mgr.a (mgr.14355) 17393 : audit [DBG] from='client.374181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:07 smithi171 bash[25040]: audit 2024-09-14T05:03:06.320497+0000 mgr.a (mgr.14355) 17393 : audit [DBG] from='client.374181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:08 smithi007 bash[22722]: cluster 2024-09-14T05:03:07.043755+0000 mgr.a (mgr.14355) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:08 smithi131 bash[24745]: cluster 2024-09-14T05:03:07.043755+0000 mgr.a (mgr.14355) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:08 smithi171 bash[25040]: cluster 2024-09-14T05:03:07.043755+0000 mgr.a (mgr.14355) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:03:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:10 smithi007 bash[22722]: cluster 2024-09-14T05:03:09.044582+0000 mgr.a (mgr.14355) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:10.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:10 smithi131 bash[24745]: cluster 2024-09-14T05:03:09.044582+0000 mgr.a (mgr.14355) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:10 smithi171 bash[25040]: cluster 2024-09-14T05:03:09.044582+0000 mgr.a (mgr.14355) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:11.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:11.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:12 smithi007 bash[22722]: cluster 2024-09-14T05:03:11.046582+0000 mgr.a (mgr.14355) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:12.528 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:12.528 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:12 smithi131 bash[24745]: cluster 2024-09-14T05:03:11.046582+0000 mgr.a (mgr.14355) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:12 smithi171 bash[25040]: cluster 2024-09-14T05:03:11.046582+0000 mgr.a (mgr.14355) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:13 smithi007 bash[22722]: audit 2024-09-14T05:03:12.089725+0000 mgr.a (mgr.14355) 17397 : audit [DBG] from='client.374250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:13 smithi131 bash[24745]: audit 2024-09-14T05:03:12.089725+0000 mgr.a (mgr.14355) 17397 : audit [DBG] from='client.374250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:13 smithi171 bash[25040]: audit 2024-09-14T05:03:12.089725+0000 mgr.a (mgr.14355) 17397 : audit [DBG] from='client.374250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:14 smithi007 bash[22722]: cluster 2024-09-14T05:03:13.047486+0000 mgr.a (mgr.14355) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:14 smithi131 bash[24745]: cluster 2024-09-14T05:03:13.047486+0000 mgr.a (mgr.14355) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:14 smithi171 bash[25040]: cluster 2024-09-14T05:03:13.047486+0000 mgr.a (mgr.14355) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:16 smithi007 bash[22722]: cluster 2024-09-14T05:03:15.048444+0000 mgr.a (mgr.14355) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:16 smithi131 bash[24745]: cluster 2024-09-14T05:03:15.048444+0000 mgr.a (mgr.14355) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:16 smithi171 bash[25040]: cluster 2024-09-14T05:03:15.048444+0000 mgr.a (mgr.14355) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:17.529 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:17.530 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:18.307 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:18.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:18 smithi007 bash[22722]: cluster 2024-09-14T05:03:17.050864+0000 mgr.a (mgr.14355) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:18 smithi131 bash[24745]: cluster 2024-09-14T05:03:17.050864+0000 mgr.a (mgr.14355) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:18 smithi171 bash[25040]: cluster 2024-09-14T05:03:17.050864+0000 mgr.a (mgr.14355) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:19 smithi007 bash[22722]: audit 2024-09-14T05:03:17.863421+0000 mgr.a (mgr.14355) 17401 : audit [DBG] from='client.374325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:19 smithi131 bash[24745]: audit 2024-09-14T05:03:17.863421+0000 mgr.a (mgr.14355) 17401 : audit [DBG] from='client.374325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:19 smithi171 bash[25040]: audit 2024-09-14T05:03:17.863421+0000 mgr.a (mgr.14355) 17401 : audit [DBG] from='client.374325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:20 smithi007 bash[22722]: cluster 2024-09-14T05:03:19.051796+0000 mgr.a (mgr.14355) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:20 smithi131 bash[24745]: cluster 2024-09-14T05:03:19.051796+0000 mgr.a (mgr.14355) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:20 smithi171 bash[25040]: cluster 2024-09-14T05:03:19.051796+0000 mgr.a (mgr.14355) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:22 smithi007 bash[22722]: cluster 2024-09-14T05:03:21.054076+0000 mgr.a (mgr.14355) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:22 smithi131 bash[24745]: cluster 2024-09-14T05:03:21.054076+0000 mgr.a (mgr.14355) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:22 smithi171 bash[25040]: cluster 2024-09-14T05:03:21.054076+0000 mgr.a (mgr.14355) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:23.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:23.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:24.053 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:24.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:24 smithi007 bash[22722]: cluster 2024-09-14T05:03:23.054858+0000 mgr.a (mgr.14355) 17404 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:24 smithi007 bash[22722]: audit 2024-09-14T05:03:23.637202+0000 mgr.a (mgr.14355) 17405 : audit [DBG] from='client.374403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:24 smithi131 bash[24745]: cluster 2024-09-14T05:03:23.054858+0000 mgr.a (mgr.14355) 17404 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:24 smithi131 bash[24745]: audit 2024-09-14T05:03:23.637202+0000 mgr.a (mgr.14355) 17405 : audit [DBG] from='client.374403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:24 smithi171 bash[25040]: cluster 2024-09-14T05:03:23.054858+0000 mgr.a (mgr.14355) 17404 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:24 smithi171 bash[25040]: audit 2024-09-14T05:03:23.637202+0000 mgr.a (mgr.14355) 17405 : audit [DBG] from='client.374403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:26 smithi007 bash[22722]: cluster 2024-09-14T05:03:25.055736+0000 mgr.a (mgr.14355) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:26 smithi131 bash[24745]: cluster 2024-09-14T05:03:25.055736+0000 mgr.a (mgr.14355) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:26 smithi171 bash[25040]: cluster 2024-09-14T05:03:25.055736+0000 mgr.a (mgr.14355) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:28 smithi007 bash[22722]: cluster 2024-09-14T05:03:27.058020+0000 mgr.a (mgr.14355) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:28 smithi131 bash[24745]: cluster 2024-09-14T05:03:27.058020+0000 mgr.a (mgr.14355) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:28 smithi171 bash[25040]: cluster 2024-09-14T05:03:27.058020+0000 mgr.a (mgr.14355) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:29.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:29.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:29.816 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:29.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:30 smithi007 bash[22722]: cluster 2024-09-14T05:03:29.058816+0000 mgr.a (mgr.14355) 17408 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:30 smithi007 bash[22722]: audit 2024-09-14T05:03:29.393026+0000 mgr.a (mgr.14355) 17409 : audit [DBG] from='client.374481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:30 smithi131 bash[24745]: cluster 2024-09-14T05:03:29.058816+0000 mgr.a (mgr.14355) 17408 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:30 smithi131 bash[24745]: audit 2024-09-14T05:03:29.393026+0000 mgr.a (mgr.14355) 17409 : audit [DBG] from='client.374481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:30 smithi171 bash[25040]: cluster 2024-09-14T05:03:29.058816+0000 mgr.a (mgr.14355) 17408 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:30 smithi171 bash[25040]: audit 2024-09-14T05:03:29.393026+0000 mgr.a (mgr.14355) 17409 : audit [DBG] from='client.374481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:32 smithi007 bash[22722]: cluster 2024-09-14T05:03:31.061241+0000 mgr.a (mgr.14355) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:32 smithi131 bash[24745]: cluster 2024-09-14T05:03:31.061241+0000 mgr.a (mgr.14355) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:32 smithi171 bash[25040]: cluster 2024-09-14T05:03:31.061241+0000 mgr.a (mgr.14355) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:34 smithi007 bash[22722]: cluster 2024-09-14T05:03:33.062012+0000 mgr.a (mgr.14355) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:34 smithi131 bash[24745]: cluster 2024-09-14T05:03:33.062012+0000 mgr.a (mgr.14355) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:34 smithi171 bash[25040]: cluster 2024-09-14T05:03:33.062012+0000 mgr.a (mgr.14355) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:35.593 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:35.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:35.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:35.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:35.594 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:36 smithi007 bash[22722]: cluster 2024-09-14T05:03:35.062571+0000 mgr.a (mgr.14355) 17412 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:36.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:36 smithi007 bash[22722]: audit 2024-09-14T05:03:35.150799+0000 mgr.a (mgr.14355) 17413 : audit [DBG] from='client.374559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:36 smithi131 bash[24745]: cluster 2024-09-14T05:03:35.062571+0000 mgr.a (mgr.14355) 17412 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:36 smithi131 bash[24745]: audit 2024-09-14T05:03:35.150799+0000 mgr.a (mgr.14355) 17413 : audit [DBG] from='client.374559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:36 smithi171 bash[25040]: cluster 2024-09-14T05:03:35.062571+0000 mgr.a (mgr.14355) 17412 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:36 smithi171 bash[25040]: audit 2024-09-14T05:03:35.150799+0000 mgr.a (mgr.14355) 17413 : audit [DBG] from='client.374559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:38 smithi131 bash[24745]: cluster 2024-09-14T05:03:37.065329+0000 mgr.a (mgr.14355) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:38 smithi171 bash[25040]: cluster 2024-09-14T05:03:37.065329+0000 mgr.a (mgr.14355) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:38 smithi007 bash[22722]: cluster 2024-09-14T05:03:37.065329+0000 mgr.a (mgr.14355) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:40 smithi131 bash[24745]: cluster 2024-09-14T05:03:39.066106+0000 mgr.a (mgr.14355) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:40 smithi171 bash[25040]: cluster 2024-09-14T05:03:39.066106+0000 mgr.a (mgr.14355) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:40 smithi007 bash[22722]: cluster 2024-09-14T05:03:39.066106+0000 mgr.a (mgr.14355) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:41.345 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:41.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:42 smithi131 bash[24745]: audit 2024-09-14T05:03:40.926881+0000 mgr.a (mgr.14355) 17416 : audit [DBG] from='client.374637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:42 smithi131 bash[24745]: cluster 2024-09-14T05:03:41.067418+0000 mgr.a (mgr.14355) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:42 smithi171 bash[25040]: audit 2024-09-14T05:03:40.926881+0000 mgr.a (mgr.14355) 17416 : audit [DBG] from='client.374637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:42 smithi171 bash[25040]: cluster 2024-09-14T05:03:41.067418+0000 mgr.a (mgr.14355) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:42 smithi007 bash[22722]: audit 2024-09-14T05:03:40.926881+0000 mgr.a (mgr.14355) 17416 : audit [DBG] from='client.374637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:42 smithi007 bash[22722]: cluster 2024-09-14T05:03:41.067418+0000 mgr.a (mgr.14355) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:44 smithi131 bash[24745]: cluster 2024-09-14T05:03:43.068349+0000 mgr.a (mgr.14355) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:44 smithi171 bash[25040]: cluster 2024-09-14T05:03:43.068349+0000 mgr.a (mgr.14355) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:44 smithi007 bash[22722]: cluster 2024-09-14T05:03:43.068349+0000 mgr.a (mgr.14355) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:03:46.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:46.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:46.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:46 smithi131 bash[24745]: cluster 2024-09-14T05:03:45.069130+0000 mgr.a (mgr.14355) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:03:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:46 smithi171 bash[25040]: cluster 2024-09-14T05:03:45.069130+0000 mgr.a (mgr.14355) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:03:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:46 smithi007 bash[22722]: cluster 2024-09-14T05:03:45.069130+0000 mgr.a (mgr.14355) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:03:47.103 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:48 smithi131 bash[24745]: audit 2024-09-14T05:03:46.679913+0000 mgr.a (mgr.14355) 17420 : audit [DBG] from='client.374712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:48 smithi131 bash[24745]: cluster 2024-09-14T05:03:47.070704+0000 mgr.a (mgr.14355) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:48 smithi171 bash[25040]: audit 2024-09-14T05:03:46.679913+0000 mgr.a (mgr.14355) 17420 : audit [DBG] from='client.374712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:48 smithi171 bash[25040]: cluster 2024-09-14T05:03:47.070704+0000 mgr.a (mgr.14355) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:48 smithi007 bash[22722]: audit 2024-09-14T05:03:46.679913+0000 mgr.a (mgr.14355) 17420 : audit [DBG] from='client.374712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:48.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:48 smithi007 bash[22722]: cluster 2024-09-14T05:03:47.070704+0000 mgr.a (mgr.14355) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:50 smithi131 bash[24745]: cluster 2024-09-14T05:03:49.071461+0000 mgr.a (mgr.14355) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:50 smithi171 bash[25040]: cluster 2024-09-14T05:03:49.071461+0000 mgr.a (mgr.14355) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:50 smithi007 bash[22722]: cluster 2024-09-14T05:03:49.071461+0000 mgr.a (mgr.14355) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:52.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:52.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:52 smithi131 bash[24745]: cluster 2024-09-14T05:03:51.073429+0000 mgr.a (mgr.14355) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:52 smithi171 bash[25040]: cluster 2024-09-14T05:03:51.073429+0000 mgr.a (mgr.14355) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:52 smithi007 bash[22722]: cluster 2024-09-14T05:03:51.073429+0000 mgr.a (mgr.14355) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:52.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:52.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:52.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:52.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:52.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:53 smithi131 bash[24745]: audit 2024-09-14T05:03:52.442459+0000 mgr.a (mgr.14355) 17424 : audit [DBG] from='client.374787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:53 smithi171 bash[25040]: audit 2024-09-14T05:03:52.442459+0000 mgr.a (mgr.14355) 17424 : audit [DBG] from='client.374787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:53 smithi007 bash[22722]: audit 2024-09-14T05:03:52.442459+0000 mgr.a (mgr.14355) 17424 : audit [DBG] from='client.374787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:54 smithi131 bash[24745]: cluster 2024-09-14T05:03:53.074413+0000 mgr.a (mgr.14355) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:54 smithi171 bash[25040]: cluster 2024-09-14T05:03:53.074413+0000 mgr.a (mgr.14355) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:54 smithi007 bash[22722]: cluster 2024-09-14T05:03:53.074413+0000 mgr.a (mgr.14355) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:55 smithi131 bash[24745]: audit 2024-09-14T05:03:54.690502+0000 mon.a (mon.0) 3191 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:03:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:55 smithi171 bash[25040]: audit 2024-09-14T05:03:54.690502+0000 mon.a (mon.0) 3191 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:03:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:55 smithi007 bash[22722]: audit 2024-09-14T05:03:54.690502+0000 mon.a (mon.0) 3191 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:03:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: cluster 2024-09-14T05:03:55.075012+0000 mgr.a (mgr.14355) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: audit 2024-09-14T05:03:55.541695+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:03:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: audit 2024-09-14T05:03:55.543589+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:03:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: audit 2024-09-14T05:03:55.554464+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:03:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: audit 2024-09-14T05:03:55.557288+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:56.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:56 smithi131 bash[24745]: audit 2024-09-14T05:03:55.559649+0000 mgr.a (mgr.14355) 17427 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: cluster 2024-09-14T05:03:55.075012+0000 mgr.a (mgr.14355) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: audit 2024-09-14T05:03:55.541695+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:03:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: audit 2024-09-14T05:03:55.543589+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:03:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: audit 2024-09-14T05:03:55.554464+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:03:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: audit 2024-09-14T05:03:55.557288+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:56 smithi171 bash[25040]: audit 2024-09-14T05:03:55.559649+0000 mgr.a (mgr.14355) 17427 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:56.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22972]: debug 2024-09-14T05:03:56.294+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22972]: debug 2024-09-14T05:03:56.298+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: cluster 2024-09-14T05:03:55.075012+0000 mgr.a (mgr.14355) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: audit 2024-09-14T05:03:55.541695+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: audit 2024-09-14T05:03:55.543589+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: audit 2024-09-14T05:03:55.554464+0000 mon.a (mon.0) 3194 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: audit 2024-09-14T05:03:55.557288+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:56 smithi007 bash[22722]: audit 2024-09-14T05:03:55.559649+0000 mgr.a (mgr.14355) 17427 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:03:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:57 smithi131 bash[24745]: audit 2024-09-14T05:03:56.296711+0000 mgr.a (mgr.14355) 17428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:03:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:57 smithi131 bash[24745]: cephadm 2024-09-14T05:03:56.298341+0000 mgr.a (mgr.14355) 17429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:03:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:57 smithi171 bash[25040]: audit 2024-09-14T05:03:56.296711+0000 mgr.a (mgr.14355) 17428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:03:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:57 smithi171 bash[25040]: cephadm 2024-09-14T05:03:56.298341+0000 mgr.a (mgr.14355) 17429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:03:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:57 smithi007 bash[22722]: audit 2024-09-14T05:03:56.296711+0000 mgr.a (mgr.14355) 17428 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:03:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:57 smithi007 bash[22722]: cephadm 2024-09-14T05:03:56.298341+0000 mgr.a (mgr.14355) 17429 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:03:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:03:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:03:57.896 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:03:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:58 smithi131 bash[24745]: cluster 2024-09-14T05:03:57.077792+0000 mgr.a (mgr.14355) 17430 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:58 smithi171 bash[25040]: cluster 2024-09-14T05:03:57.077792+0000 mgr.a (mgr.14355) 17430 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:58.679 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:03:58.679 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:03:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:03:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:03:58.680 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:03:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:58 smithi007 bash[22722]: cluster 2024-09-14T05:03:57.077792+0000 mgr.a (mgr.14355) 17430 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:03:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:03:59 smithi131 bash[24745]: audit 2024-09-14T05:03:58.234426+0000 mgr.a (mgr.14355) 17431 : audit [DBG] from='client.374973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:03:59 smithi171 bash[25040]: audit 2024-09-14T05:03:58.234426+0000 mgr.a (mgr.14355) 17431 : audit [DBG] from='client.374973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:03:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:03:59 smithi007 bash[22722]: audit 2024-09-14T05:03:58.234426+0000 mgr.a (mgr.14355) 17431 : audit [DBG] from='client.374973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:00 smithi131 bash[24745]: cluster 2024-09-14T05:03:59.078980+0000 mgr.a (mgr.14355) 17432 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:00 smithi171 bash[25040]: cluster 2024-09-14T05:03:59.078980+0000 mgr.a (mgr.14355) 17432 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:00 smithi007 bash[22722]: cluster 2024-09-14T05:03:59.078980+0000 mgr.a (mgr.14355) 17432 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:02 smithi131 bash[24745]: cluster 2024-09-14T05:04:01.081384+0000 mgr.a (mgr.14355) 17433 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:02 smithi171 bash[25040]: cluster 2024-09-14T05:04:01.081384+0000 mgr.a (mgr.14355) 17433 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:02 smithi007 bash[22722]: cluster 2024-09-14T05:04:01.081384+0000 mgr.a (mgr.14355) 17433 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:03.682 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:04 smithi171 bash[25040]: cluster 2024-09-14T05:04:03.082350+0000 mgr.a (mgr.14355) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:04 smithi007 bash[22722]: cluster 2024-09-14T05:04:03.082350+0000 mgr.a (mgr.14355) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:04 smithi131 bash[24745]: cluster 2024-09-14T05:04:03.082350+0000 mgr.a (mgr.14355) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:05 smithi171 bash[25040]: audit 2024-09-14T05:04:04.014830+0000 mgr.a (mgr.14355) 17435 : audit [DBG] from='client.375045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:05 smithi007 bash[22722]: audit 2024-09-14T05:04:04.014830+0000 mgr.a (mgr.14355) 17435 : audit [DBG] from='client.375045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:05 smithi131 bash[24745]: audit 2024-09-14T05:04:04.014830+0000 mgr.a (mgr.14355) 17435 : audit [DBG] from='client.375045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:06 smithi007 bash[22722]: cluster 2024-09-14T05:04:05.083356+0000 mgr.a (mgr.14355) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:06 smithi131 bash[24745]: cluster 2024-09-14T05:04:05.083356+0000 mgr.a (mgr.14355) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:06 smithi171 bash[25040]: cluster 2024-09-14T05:04:05.083356+0000 mgr.a (mgr.14355) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:08 smithi007 bash[22722]: cluster 2024-09-14T05:04:07.085722+0000 mgr.a (mgr.14355) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:08 smithi131 bash[24745]: cluster 2024-09-14T05:04:07.085722+0000 mgr.a (mgr.14355) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:08 smithi171 bash[25040]: cluster 2024-09-14T05:04:07.085722+0000 mgr.a (mgr.14355) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:09.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:09.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:09.466 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:10.232 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:10.233 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:10 smithi007 bash[22722]: cluster 2024-09-14T05:04:09.086526+0000 mgr.a (mgr.14355) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:10 smithi131 bash[24745]: cluster 2024-09-14T05:04:09.086526+0000 mgr.a (mgr.14355) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:10.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:10 smithi171 bash[25040]: cluster 2024-09-14T05:04:09.086526+0000 mgr.a (mgr.14355) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:11 smithi007 bash[22722]: audit 2024-09-14T05:04:09.801941+0000 mgr.a (mgr.14355) 17439 : audit [DBG] from='client.375120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:11 smithi131 bash[24745]: audit 2024-09-14T05:04:09.801941+0000 mgr.a (mgr.14355) 17439 : audit [DBG] from='client.375120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:11 smithi171 bash[25040]: audit 2024-09-14T05:04:09.801941+0000 mgr.a (mgr.14355) 17439 : audit [DBG] from='client.375120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:12 smithi007 bash[22722]: cluster 2024-09-14T05:04:11.088929+0000 mgr.a (mgr.14355) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:12 smithi131 bash[24745]: cluster 2024-09-14T05:04:11.088929+0000 mgr.a (mgr.14355) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:12 smithi171 bash[25040]: cluster 2024-09-14T05:04:11.088929+0000 mgr.a (mgr.14355) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:04:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:14 smithi007 bash[22722]: cluster 2024-09-14T05:04:13.089750+0000 mgr.a (mgr.14355) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:14 smithi131 bash[24745]: cluster 2024-09-14T05:04:13.089750+0000 mgr.a (mgr.14355) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:14 smithi171 bash[25040]: cluster 2024-09-14T05:04:13.089750+0000 mgr.a (mgr.14355) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:15.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:15.235 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:15.997 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:15.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:15.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:15.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:15.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:16 smithi007 bash[22722]: cluster 2024-09-14T05:04:15.090555+0000 mgr.a (mgr.14355) 17442 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:16 smithi007 bash[22722]: audit 2024-09-14T05:04:15.571384+0000 mgr.a (mgr.14355) 17443 : audit [DBG] from='client.375198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:16 smithi131 bash[24745]: cluster 2024-09-14T05:04:15.090555+0000 mgr.a (mgr.14355) 17442 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:16 smithi131 bash[24745]: audit 2024-09-14T05:04:15.571384+0000 mgr.a (mgr.14355) 17443 : audit [DBG] from='client.375198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:16 smithi171 bash[25040]: cluster 2024-09-14T05:04:15.090555+0000 mgr.a (mgr.14355) 17442 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:16 smithi171 bash[25040]: audit 2024-09-14T05:04:15.571384+0000 mgr.a (mgr.14355) 17443 : audit [DBG] from='client.375198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:18 smithi007 bash[22722]: cluster 2024-09-14T05:04:17.093534+0000 mgr.a (mgr.14355) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:18 smithi131 bash[24745]: cluster 2024-09-14T05:04:17.093534+0000 mgr.a (mgr.14355) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:18 smithi171 bash[25040]: cluster 2024-09-14T05:04:17.093534+0000 mgr.a (mgr.14355) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:20 smithi007 bash[22722]: cluster 2024-09-14T05:04:19.094523+0000 mgr.a (mgr.14355) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:20 smithi131 bash[24745]: cluster 2024-09-14T05:04:19.094523+0000 mgr.a (mgr.14355) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:20 smithi171 bash[25040]: cluster 2024-09-14T05:04:19.094523+0000 mgr.a (mgr.14355) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:20.999 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:21.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:21.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:21.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:21.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:21.785 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:22 smithi007 bash[22722]: cluster 2024-09-14T05:04:21.095568+0000 mgr.a (mgr.14355) 17446 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:22.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:22 smithi007 bash[22722]: audit 2024-09-14T05:04:21.334683+0000 mgr.a (mgr.14355) 17447 : audit [DBG] from='client.375276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:22 smithi131 bash[24745]: cluster 2024-09-14T05:04:21.095568+0000 mgr.a (mgr.14355) 17446 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:22 smithi131 bash[24745]: audit 2024-09-14T05:04:21.334683+0000 mgr.a (mgr.14355) 17447 : audit [DBG] from='client.375276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:22 smithi171 bash[25040]: cluster 2024-09-14T05:04:21.095568+0000 mgr.a (mgr.14355) 17446 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:22 smithi171 bash[25040]: audit 2024-09-14T05:04:21.334683+0000 mgr.a (mgr.14355) 17447 : audit [DBG] from='client.375276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:24 smithi007 bash[22722]: cluster 2024-09-14T05:04:23.096660+0000 mgr.a (mgr.14355) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:24 smithi131 bash[24745]: cluster 2024-09-14T05:04:23.096660+0000 mgr.a (mgr.14355) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:24 smithi171 bash[25040]: cluster 2024-09-14T05:04:23.096660+0000 mgr.a (mgr.14355) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:26 smithi007 bash[22722]: cluster 2024-09-14T05:04:25.097609+0000 mgr.a (mgr.14355) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:04:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:26 smithi131 bash[24745]: cluster 2024-09-14T05:04:25.097609+0000 mgr.a (mgr.14355) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:04:26.786 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:26.787 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:26 smithi171 bash[25040]: cluster 2024-09-14T05:04:25.097609+0000 mgr.a (mgr.14355) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:04:27.547 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:27.547 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:28 smithi007 bash[22722]: cluster 2024-09-14T05:04:27.099911+0000 mgr.a (mgr.14355) 17450 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:28.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:28 smithi007 bash[22722]: audit 2024-09-14T05:04:27.117382+0000 mgr.a (mgr.14355) 17451 : audit [DBG] from='client.375354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:28 smithi131 bash[24745]: cluster 2024-09-14T05:04:27.099911+0000 mgr.a (mgr.14355) 17450 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:28 smithi131 bash[24745]: audit 2024-09-14T05:04:27.117382+0000 mgr.a (mgr.14355) 17451 : audit [DBG] from='client.375354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:28 smithi171 bash[25040]: cluster 2024-09-14T05:04:27.099911+0000 mgr.a (mgr.14355) 17450 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:28 smithi171 bash[25040]: audit 2024-09-14T05:04:27.117382+0000 mgr.a (mgr.14355) 17451 : audit [DBG] from='client.375354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:30 smithi007 bash[22722]: cluster 2024-09-14T05:04:29.100864+0000 mgr.a (mgr.14355) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:30 smithi131 bash[24745]: cluster 2024-09-14T05:04:29.100864+0000 mgr.a (mgr.14355) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:30 smithi171 bash[25040]: cluster 2024-09-14T05:04:29.100864+0000 mgr.a (mgr.14355) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:32 smithi007 bash[22722]: cluster 2024-09-14T05:04:31.103104+0000 mgr.a (mgr.14355) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:32 smithi131 bash[24745]: cluster 2024-09-14T05:04:31.103104+0000 mgr.a (mgr.14355) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:32 smithi171 bash[25040]: cluster 2024-09-14T05:04:31.103104+0000 mgr.a (mgr.14355) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:33.299 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:33.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:33.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:33.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:33.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:34 smithi007 bash[22722]: audit 2024-09-14T05:04:32.876568+0000 mgr.a (mgr.14355) 17454 : audit [DBG] from='client.375432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:34 smithi007 bash[22722]: cluster 2024-09-14T05:04:33.110308+0000 mgr.a (mgr.14355) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:34 smithi131 bash[24745]: audit 2024-09-14T05:04:32.876568+0000 mgr.a (mgr.14355) 17454 : audit [DBG] from='client.375432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:34 smithi131 bash[24745]: cluster 2024-09-14T05:04:33.110308+0000 mgr.a (mgr.14355) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:34 smithi171 bash[25040]: audit 2024-09-14T05:04:32.876568+0000 mgr.a (mgr.14355) 17454 : audit [DBG] from='client.375432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:34 smithi171 bash[25040]: cluster 2024-09-14T05:04:33.110308+0000 mgr.a (mgr.14355) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:36 smithi007 bash[22722]: cluster 2024-09-14T05:04:35.111265+0000 mgr.a (mgr.14355) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:36 smithi131 bash[24745]: cluster 2024-09-14T05:04:35.111265+0000 mgr.a (mgr.14355) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:36 smithi171 bash[25040]: cluster 2024-09-14T05:04:35.111265+0000 mgr.a (mgr.14355) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:38.301 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:38.302 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:38 smithi007 bash[22722]: cluster 2024-09-14T05:04:37.113514+0000 mgr.a (mgr.14355) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:38 smithi131 bash[24745]: cluster 2024-09-14T05:04:37.113514+0000 mgr.a (mgr.14355) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:38 smithi171 bash[25040]: cluster 2024-09-14T05:04:37.113514+0000 mgr.a (mgr.14355) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:39.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:39.066 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:39 smithi007 bash[22722]: audit 2024-09-14T05:04:38.635608+0000 mgr.a (mgr.14355) 17458 : audit [DBG] from='client.375507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:39 smithi131 bash[24745]: audit 2024-09-14T05:04:38.635608+0000 mgr.a (mgr.14355) 17458 : audit [DBG] from='client.375507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:39 smithi171 bash[25040]: audit 2024-09-14T05:04:38.635608+0000 mgr.a (mgr.14355) 17458 : audit [DBG] from='client.375507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:40 smithi007 bash[22722]: cluster 2024-09-14T05:04:39.114097+0000 mgr.a (mgr.14355) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:40 smithi131 bash[24745]: cluster 2024-09-14T05:04:39.114097+0000 mgr.a (mgr.14355) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:40 smithi171 bash[25040]: cluster 2024-09-14T05:04:39.114097+0000 mgr.a (mgr.14355) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:42 smithi007 bash[22722]: cluster 2024-09-14T05:04:41.116301+0000 mgr.a (mgr.14355) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:42 smithi131 bash[24745]: cluster 2024-09-14T05:04:41.116301+0000 mgr.a (mgr.14355) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:42 smithi171 bash[25040]: cluster 2024-09-14T05:04:41.116301+0000 mgr.a (mgr.14355) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:44 smithi007 bash[22722]: cluster 2024-09-14T05:04:43.117062+0000 mgr.a (mgr.14355) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:44 smithi131 bash[24745]: cluster 2024-09-14T05:04:43.117062+0000 mgr.a (mgr.14355) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:44 smithi171 bash[25040]: cluster 2024-09-14T05:04:43.117062+0000 mgr.a (mgr.14355) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:44.832 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:44.832 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:44.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:44.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:44.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:45 smithi007 bash[22722]: audit 2024-09-14T05:04:44.400717+0000 mgr.a (mgr.14355) 17462 : audit [DBG] from='client.375585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:45 smithi131 bash[24745]: audit 2024-09-14T05:04:44.400717+0000 mgr.a (mgr.14355) 17462 : audit [DBG] from='client.375585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:45 smithi171 bash[25040]: audit 2024-09-14T05:04:44.400717+0000 mgr.a (mgr.14355) 17462 : audit [DBG] from='client.375585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:46 smithi007 bash[22722]: cluster 2024-09-14T05:04:45.118009+0000 mgr.a (mgr.14355) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:46 smithi131 bash[24745]: cluster 2024-09-14T05:04:45.118009+0000 mgr.a (mgr.14355) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:46 smithi171 bash[25040]: cluster 2024-09-14T05:04:45.118009+0000 mgr.a (mgr.14355) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:48 smithi007 bash[22722]: cluster 2024-09-14T05:04:47.120345+0000 mgr.a (mgr.14355) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:48 smithi131 bash[24745]: cluster 2024-09-14T05:04:47.120345+0000 mgr.a (mgr.14355) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:48 smithi171 bash[25040]: cluster 2024-09-14T05:04:47.120345+0000 mgr.a (mgr.14355) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:04:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:49.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:50.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:50.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:50.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:50.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:50 smithi007 bash[22722]: cluster 2024-09-14T05:04:49.121117+0000 mgr.a (mgr.14355) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:50 smithi131 bash[24745]: cluster 2024-09-14T05:04:49.121117+0000 mgr.a (mgr.14355) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:50 smithi171 bash[25040]: cluster 2024-09-14T05:04:49.121117+0000 mgr.a (mgr.14355) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:51 smithi007 bash[22722]: audit 2024-09-14T05:04:50.170007+0000 mgr.a (mgr.14355) 17466 : audit [DBG] from='client.375660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:51 smithi131 bash[24745]: audit 2024-09-14T05:04:50.170007+0000 mgr.a (mgr.14355) 17466 : audit [DBG] from='client.375660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:51 smithi171 bash[25040]: audit 2024-09-14T05:04:50.170007+0000 mgr.a (mgr.14355) 17466 : audit [DBG] from='client.375660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:52 smithi007 bash[22722]: cluster 2024-09-14T05:04:51.124015+0000 mgr.a (mgr.14355) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:52 smithi131 bash[24745]: cluster 2024-09-14T05:04:51.124015+0000 mgr.a (mgr.14355) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:52 smithi171 bash[25040]: cluster 2024-09-14T05:04:51.124015+0000 mgr.a (mgr.14355) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:54 smithi007 bash[22722]: cluster 2024-09-14T05:04:53.124976+0000 mgr.a (mgr.14355) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:54 smithi131 bash[24745]: cluster 2024-09-14T05:04:53.124976+0000 mgr.a (mgr.14355) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:54 smithi171 bash[25040]: cluster 2024-09-14T05:04:53.124976+0000 mgr.a (mgr.14355) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:55.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:04:55.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:04:55.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:04:56.347 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:04:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:04:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:04:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:04:56.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:04:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:56 smithi007 bash[22722]: cluster 2024-09-14T05:04:55.125770+0000 mgr.a (mgr.14355) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:56 smithi007 bash[22722]: audit 2024-09-14T05:04:56.348900+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:04:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:56 smithi131 bash[24745]: cluster 2024-09-14T05:04:55.125770+0000 mgr.a (mgr.14355) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:56 smithi131 bash[24745]: audit 2024-09-14T05:04:56.348900+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:04:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:56 smithi171 bash[25040]: cluster 2024-09-14T05:04:55.125770+0000 mgr.a (mgr.14355) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:04:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:56 smithi171 bash[25040]: audit 2024-09-14T05:04:56.348900+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:04:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:57 smithi007 bash[22722]: audit 2024-09-14T05:04:55.933797+0000 mgr.a (mgr.14355) 17470 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:57 smithi007 bash[22722]: audit 2024-09-14T05:04:56.881113+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:57 smithi007 bash[22722]: audit 2024-09-14T05:04:56.886338+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:57 smithi131 bash[24745]: audit 2024-09-14T05:04:55.933797+0000 mgr.a (mgr.14355) 17470 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:57 smithi131 bash[24745]: audit 2024-09-14T05:04:56.881113+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:57.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:57 smithi131 bash[24745]: audit 2024-09-14T05:04:56.886338+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:57.799 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:57 smithi171 bash[25040]: audit 2024-09-14T05:04:55.933797+0000 mgr.a (mgr.14355) 17470 : audit [DBG] from='client.375738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:04:57.800 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:57 smithi171 bash[25040]: audit 2024-09-14T05:04:56.881113+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:57.800 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:57 smithi171 bash[25040]: audit 2024-09-14T05:04:56.886338+0000 mon.a (mon.0) 3198 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:58.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22972]: debug 2024-09-14T05:04:58.269+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22972]: debug 2024-09-14T05:04:58.273+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: cluster 2024-09-14T05:04:57.128531+0000 mgr.a (mgr.14355) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: audit 2024-09-14T05:04:57.503221+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: audit 2024-09-14T05:04:57.504160+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: audit 2024-09-14T05:04:57.510567+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: audit 2024-09-14T05:04:57.513181+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:58 smithi007 bash[22722]: audit 2024-09-14T05:04:57.515739+0000 mgr.a (mgr.14355) 17472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: cluster 2024-09-14T05:04:57.128531+0000 mgr.a (mgr.14355) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: audit 2024-09-14T05:04:57.503221+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: audit 2024-09-14T05:04:57.504160+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: audit 2024-09-14T05:04:57.510567+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: audit 2024-09-14T05:04:57.513181+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:58.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:58 smithi131 bash[24745]: audit 2024-09-14T05:04:57.515739+0000 mgr.a (mgr.14355) 17472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: cluster 2024-09-14T05:04:57.128531+0000 mgr.a (mgr.14355) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:04:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: audit 2024-09-14T05:04:57.503221+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:04:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: audit 2024-09-14T05:04:57.504160+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:04:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: audit 2024-09-14T05:04:57.510567+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:04:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: audit 2024-09-14T05:04:57.513181+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:58.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:58 smithi171 bash[25040]: audit 2024-09-14T05:04:57.515739+0000 mgr.a (mgr.14355) 17472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:04:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:59 smithi007 bash[22722]: audit 2024-09-14T05:04:58.272732+0000 mgr.a (mgr.14355) 17473 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:04:59.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:04:59 smithi007 bash[22722]: cephadm 2024-09-14T05:04:58.274359+0000 mgr.a (mgr.14355) 17474 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:04:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:59 smithi131 bash[24745]: audit 2024-09-14T05:04:58.272732+0000 mgr.a (mgr.14355) 17473 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:04:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:04:59 smithi131 bash[24745]: cephadm 2024-09-14T05:04:58.274359+0000 mgr.a (mgr.14355) 17474 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:04:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:59 smithi171 bash[25040]: audit 2024-09-14T05:04:58.272732+0000 mgr.a (mgr.14355) 17473 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:04:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:04:59 smithi171 bash[25040]: cephadm 2024-09-14T05:04:58.274359+0000 mgr.a (mgr.14355) 17474 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:05:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:00 smithi131 bash[24745]: cluster 2024-09-14T05:04:59.129560+0000 mgr.a (mgr.14355) 17475 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:00 smithi171 bash[25040]: cluster 2024-09-14T05:04:59.129560+0000 mgr.a (mgr.14355) 17475 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:00 smithi007 bash[22722]: cluster 2024-09-14T05:04:59.129560+0000 mgr.a (mgr.14355) 17475 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:01.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:01.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:02.127 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:02 smithi131 bash[24745]: cluster 2024-09-14T05:05:01.131329+0000 mgr.a (mgr.14355) 17476 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:02 smithi131 bash[24745]: audit 2024-09-14T05:05:01.686334+0000 mgr.a (mgr.14355) 17477 : audit [DBG] from='client.375912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:02 smithi171 bash[25040]: cluster 2024-09-14T05:05:01.131329+0000 mgr.a (mgr.14355) 17476 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:02 smithi171 bash[25040]: audit 2024-09-14T05:05:01.686334+0000 mgr.a (mgr.14355) 17477 : audit [DBG] from='client.375912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:02 smithi007 bash[22722]: cluster 2024-09-14T05:05:01.131329+0000 mgr.a (mgr.14355) 17476 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:02 smithi007 bash[22722]: audit 2024-09-14T05:05:01.686334+0000 mgr.a (mgr.14355) 17477 : audit [DBG] from='client.375912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:04 smithi131 bash[24745]: cluster 2024-09-14T05:05:03.132207+0000 mgr.a (mgr.14355) 17478 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:04 smithi171 bash[25040]: cluster 2024-09-14T05:05:03.132207+0000 mgr.a (mgr.14355) 17478 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:04 smithi007 bash[22722]: cluster 2024-09-14T05:05:03.132207+0000 mgr.a (mgr.14355) 17478 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:06 smithi131 bash[24745]: cluster 2024-09-14T05:05:05.133031+0000 mgr.a (mgr.14355) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:06 smithi171 bash[25040]: cluster 2024-09-14T05:05:05.133031+0000 mgr.a (mgr.14355) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:06 smithi007 bash[22722]: cluster 2024-09-14T05:05:05.133031+0000 mgr.a (mgr.14355) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:07.129 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:07.130 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:07.867 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:07.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:07.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:07.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:07.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:08 smithi131 bash[24745]: cluster 2024-09-14T05:05:07.134457+0000 mgr.a (mgr.14355) 17480 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:08 smithi131 bash[24745]: audit 2024-09-14T05:05:07.455678+0000 mgr.a (mgr.14355) 17481 : audit [DBG] from='client.375984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:08 smithi171 bash[25040]: cluster 2024-09-14T05:05:07.134457+0000 mgr.a (mgr.14355) 17480 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:08 smithi171 bash[25040]: audit 2024-09-14T05:05:07.455678+0000 mgr.a (mgr.14355) 17481 : audit [DBG] from='client.375984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:08 smithi007 bash[22722]: cluster 2024-09-14T05:05:07.134457+0000 mgr.a (mgr.14355) 17480 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:08 smithi007 bash[22722]: audit 2024-09-14T05:05:07.455678+0000 mgr.a (mgr.14355) 17481 : audit [DBG] from='client.375984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:10 smithi131 bash[24745]: cluster 2024-09-14T05:05:09.135373+0000 mgr.a (mgr.14355) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:10 smithi171 bash[25040]: cluster 2024-09-14T05:05:09.135373+0000 mgr.a (mgr.14355) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:10 smithi007 bash[22722]: cluster 2024-09-14T05:05:09.135373+0000 mgr.a (mgr.14355) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:12 smithi131 bash[24745]: cluster 2024-09-14T05:05:11.137612+0000 mgr.a (mgr.14355) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:12 smithi171 bash[25040]: cluster 2024-09-14T05:05:11.137612+0000 mgr.a (mgr.14355) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:12.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:12.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:12 smithi007 bash[22722]: cluster 2024-09-14T05:05:11.137612+0000 mgr.a (mgr.14355) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:05:13.619 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:13.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:13.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:14 smithi131 bash[24745]: cluster 2024-09-14T05:05:13.138335+0000 mgr.a (mgr.14355) 17484 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:14 smithi131 bash[24745]: audit 2024-09-14T05:05:13.200237+0000 mgr.a (mgr.14355) 17485 : audit [DBG] from='client.376059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:14 smithi171 bash[25040]: cluster 2024-09-14T05:05:13.138335+0000 mgr.a (mgr.14355) 17484 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:14 smithi171 bash[25040]: audit 2024-09-14T05:05:13.200237+0000 mgr.a (mgr.14355) 17485 : audit [DBG] from='client.376059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:14 smithi007 bash[22722]: cluster 2024-09-14T05:05:13.138335+0000 mgr.a (mgr.14355) 17484 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:14 smithi007 bash[22722]: audit 2024-09-14T05:05:13.200237+0000 mgr.a (mgr.14355) 17485 : audit [DBG] from='client.376059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:16.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:16 smithi131 bash[24745]: cluster 2024-09-14T05:05:15.139217+0000 mgr.a (mgr.14355) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:16 smithi171 bash[25040]: cluster 2024-09-14T05:05:15.139217+0000 mgr.a (mgr.14355) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:16 smithi007 bash[22722]: cluster 2024-09-14T05:05:15.139217+0000 mgr.a (mgr.14355) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:18.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:18.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:18.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:18 smithi131 bash[24745]: cluster 2024-09-14T05:05:17.141485+0000 mgr.a (mgr.14355) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:18 smithi171 bash[25040]: cluster 2024-09-14T05:05:17.141485+0000 mgr.a (mgr.14355) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:18 smithi007 bash[22722]: cluster 2024-09-14T05:05:17.141485+0000 mgr.a (mgr.14355) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:19.392 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:19.392 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:19.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:20 smithi131 bash[24745]: audit 2024-09-14T05:05:18.959643+0000 mgr.a (mgr.14355) 17488 : audit [DBG] from='client.376137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:20 smithi131 bash[24745]: cluster 2024-09-14T05:05:19.142014+0000 mgr.a (mgr.14355) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:20 smithi171 bash[25040]: audit 2024-09-14T05:05:18.959643+0000 mgr.a (mgr.14355) 17488 : audit [DBG] from='client.376137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:20 smithi171 bash[25040]: cluster 2024-09-14T05:05:19.142014+0000 mgr.a (mgr.14355) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:20 smithi007 bash[22722]: audit 2024-09-14T05:05:18.959643+0000 mgr.a (mgr.14355) 17488 : audit [DBG] from='client.376137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:20 smithi007 bash[22722]: cluster 2024-09-14T05:05:19.142014+0000 mgr.a (mgr.14355) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:22 smithi131 bash[24745]: cluster 2024-09-14T05:05:21.144313+0000 mgr.a (mgr.14355) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:22 smithi171 bash[25040]: cluster 2024-09-14T05:05:21.144313+0000 mgr.a (mgr.14355) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:22 smithi007 bash[22722]: cluster 2024-09-14T05:05:21.144313+0000 mgr.a (mgr.14355) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:24.394 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:24 smithi131 bash[24745]: cluster 2024-09-14T05:05:23.145073+0000 mgr.a (mgr.14355) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:24 smithi171 bash[25040]: cluster 2024-09-14T05:05:23.145073+0000 mgr.a (mgr.14355) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:24 smithi007 bash[22722]: cluster 2024-09-14T05:05:23.145073+0000 mgr.a (mgr.14355) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:25.165 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:25.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:26 smithi131 bash[24745]: audit 2024-09-14T05:05:24.727742+0000 mgr.a (mgr.14355) 17492 : audit [DBG] from='client.376215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:26.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:26 smithi131 bash[24745]: cluster 2024-09-14T05:05:25.145677+0000 mgr.a (mgr.14355) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:26 smithi171 bash[25040]: audit 2024-09-14T05:05:24.727742+0000 mgr.a (mgr.14355) 17492 : audit [DBG] from='client.376215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:26 smithi171 bash[25040]: cluster 2024-09-14T05:05:25.145677+0000 mgr.a (mgr.14355) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:26 smithi007 bash[22722]: audit 2024-09-14T05:05:24.727742+0000 mgr.a (mgr.14355) 17492 : audit [DBG] from='client.376215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:26 smithi007 bash[22722]: cluster 2024-09-14T05:05:25.145677+0000 mgr.a (mgr.14355) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:28 smithi131 bash[24745]: cluster 2024-09-14T05:05:27.148061+0000 mgr.a (mgr.14355) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:28 smithi171 bash[25040]: cluster 2024-09-14T05:05:27.148061+0000 mgr.a (mgr.14355) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:28 smithi007 bash[22722]: cluster 2024-09-14T05:05:27.148061+0000 mgr.a (mgr.14355) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:30.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:30.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:30.167 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:30 smithi131 bash[24745]: cluster 2024-09-14T05:05:29.148845+0000 mgr.a (mgr.14355) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:30 smithi171 bash[25040]: cluster 2024-09-14T05:05:29.148845+0000 mgr.a (mgr.14355) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:30.940 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:30.940 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:30.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:30.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:30.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:30 smithi007 bash[22722]: cluster 2024-09-14T05:05:29.148845+0000 mgr.a (mgr.14355) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:31 smithi131 bash[24745]: audit 2024-09-14T05:05:30.501521+0000 mgr.a (mgr.14355) 17496 : audit [DBG] from='client.376293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:31 smithi171 bash[25040]: audit 2024-09-14T05:05:30.501521+0000 mgr.a (mgr.14355) 17496 : audit [DBG] from='client.376293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:31 smithi007 bash[22722]: audit 2024-09-14T05:05:30.501521+0000 mgr.a (mgr.14355) 17496 : audit [DBG] from='client.376293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:32 smithi131 bash[24745]: cluster 2024-09-14T05:05:31.151724+0000 mgr.a (mgr.14355) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:32 smithi171 bash[25040]: cluster 2024-09-14T05:05:31.151724+0000 mgr.a (mgr.14355) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:32 smithi007 bash[22722]: cluster 2024-09-14T05:05:31.151724+0000 mgr.a (mgr.14355) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:34 smithi171 bash[25040]: cluster 2024-09-14T05:05:33.152532+0000 mgr.a (mgr.14355) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:34 smithi007 bash[22722]: cluster 2024-09-14T05:05:33.152532+0000 mgr.a (mgr.14355) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:34 smithi131 bash[24745]: cluster 2024-09-14T05:05:33.152532+0000 mgr.a (mgr.14355) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:35.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:35.943 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:36.720 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:36.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:36.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:36.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:36.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:36 smithi171 bash[25040]: cluster 2024-09-14T05:05:35.153311+0000 mgr.a (mgr.14355) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:05:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:36 smithi007 bash[22722]: cluster 2024-09-14T05:05:35.153311+0000 mgr.a (mgr.14355) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:05:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:36 smithi131 bash[24745]: cluster 2024-09-14T05:05:35.153311+0000 mgr.a (mgr.14355) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:05:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:37 smithi007 bash[22722]: audit 2024-09-14T05:05:36.277337+0000 mgr.a (mgr.14355) 17500 : audit [DBG] from='client.376368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:37 smithi131 bash[24745]: audit 2024-09-14T05:05:36.277337+0000 mgr.a (mgr.14355) 17500 : audit [DBG] from='client.376368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:38.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:37 smithi171 bash[25040]: audit 2024-09-14T05:05:36.277337+0000 mgr.a (mgr.14355) 17500 : audit [DBG] from='client.376368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:38 smithi007 bash[22722]: cluster 2024-09-14T05:05:37.156135+0000 mgr.a (mgr.14355) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:38 smithi131 bash[24745]: cluster 2024-09-14T05:05:37.156135+0000 mgr.a (mgr.14355) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:38 smithi171 bash[25040]: cluster 2024-09-14T05:05:37.156135+0000 mgr.a (mgr.14355) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:40 smithi007 bash[22722]: cluster 2024-09-14T05:05:39.156938+0000 mgr.a (mgr.14355) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:40 smithi131 bash[24745]: cluster 2024-09-14T05:05:39.156938+0000 mgr.a (mgr.14355) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:40 smithi171 bash[25040]: cluster 2024-09-14T05:05:39.156938+0000 mgr.a (mgr.14355) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:05:41.721 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:42.495 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:42.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:42.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:42.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:42.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:42 smithi007 bash[22722]: cluster 2024-09-14T05:05:41.158991+0000 mgr.a (mgr.14355) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:42 smithi131 bash[24745]: cluster 2024-09-14T05:05:41.158991+0000 mgr.a (mgr.14355) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:42 smithi171 bash[25040]: cluster 2024-09-14T05:05:41.158991+0000 mgr.a (mgr.14355) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:43 smithi007 bash[22722]: audit 2024-09-14T05:05:42.052441+0000 mgr.a (mgr.14355) 17504 : audit [DBG] from='client.376443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:43 smithi131 bash[24745]: audit 2024-09-14T05:05:42.052441+0000 mgr.a (mgr.14355) 17504 : audit [DBG] from='client.376443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:43 smithi171 bash[25040]: audit 2024-09-14T05:05:42.052441+0000 mgr.a (mgr.14355) 17504 : audit [DBG] from='client.376443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:44 smithi007 bash[22722]: cluster 2024-09-14T05:05:43.159910+0000 mgr.a (mgr.14355) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:44 smithi131 bash[24745]: cluster 2024-09-14T05:05:43.159910+0000 mgr.a (mgr.14355) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:44 smithi171 bash[25040]: cluster 2024-09-14T05:05:43.159910+0000 mgr.a (mgr.14355) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:46 smithi007 bash[22722]: cluster 2024-09-14T05:05:45.160715+0000 mgr.a (mgr.14355) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:46 smithi131 bash[24745]: cluster 2024-09-14T05:05:45.160715+0000 mgr.a (mgr.14355) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:46 smithi171 bash[25040]: cluster 2024-09-14T05:05:45.160715+0000 mgr.a (mgr.14355) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:47.497 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:48.251 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:48.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:48 smithi007 bash[22722]: cluster 2024-09-14T05:05:47.162999+0000 mgr.a (mgr.14355) 17507 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:48 smithi131 bash[24745]: cluster 2024-09-14T05:05:47.162999+0000 mgr.a (mgr.14355) 17507 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:48 smithi171 bash[25040]: cluster 2024-09-14T05:05:47.162999+0000 mgr.a (mgr.14355) 17507 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:49 smithi007 bash[22722]: audit 2024-09-14T05:05:47.830279+0000 mgr.a (mgr.14355) 17508 : audit [DBG] from='client.376521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:49 smithi131 bash[24745]: audit 2024-09-14T05:05:47.830279+0000 mgr.a (mgr.14355) 17508 : audit [DBG] from='client.376521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:49 smithi171 bash[25040]: audit 2024-09-14T05:05:47.830279+0000 mgr.a (mgr.14355) 17508 : audit [DBG] from='client.376521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:50 smithi007 bash[22722]: cluster 2024-09-14T05:05:49.163905+0000 mgr.a (mgr.14355) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:50 smithi131 bash[24745]: cluster 2024-09-14T05:05:49.163905+0000 mgr.a (mgr.14355) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:50 smithi171 bash[25040]: cluster 2024-09-14T05:05:49.163905+0000 mgr.a (mgr.14355) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:52 smithi007 bash[22722]: cluster 2024-09-14T05:05:51.166156+0000 mgr.a (mgr.14355) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:52 smithi131 bash[24745]: cluster 2024-09-14T05:05:51.166156+0000 mgr.a (mgr.14355) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:52 smithi171 bash[25040]: cluster 2024-09-14T05:05:51.166156+0000 mgr.a (mgr.14355) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:53.253 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:53.254 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:05:54.036 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:54 smithi007 bash[22722]: cluster 2024-09-14T05:05:53.166945+0000 mgr.a (mgr.14355) 17511 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:54 smithi007 bash[22722]: audit 2024-09-14T05:05:53.586013+0000 mgr.a (mgr.14355) 17512 : audit [DBG] from='client.376596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:54 smithi131 bash[24745]: cluster 2024-09-14T05:05:53.166945+0000 mgr.a (mgr.14355) 17511 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:54 smithi131 bash[24745]: audit 2024-09-14T05:05:53.586013+0000 mgr.a (mgr.14355) 17512 : audit [DBG] from='client.376596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:54 smithi171 bash[25040]: cluster 2024-09-14T05:05:53.166945+0000 mgr.a (mgr.14355) 17511 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:54 smithi171 bash[25040]: audit 2024-09-14T05:05:53.586013+0000 mgr.a (mgr.14355) 17512 : audit [DBG] from='client.376596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:05:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:56 smithi007 bash[22722]: cluster 2024-09-14T05:05:55.167846+0000 mgr.a (mgr.14355) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:56 smithi131 bash[24745]: cluster 2024-09-14T05:05:55.167846+0000 mgr.a (mgr.14355) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:56 smithi171 bash[25040]: cluster 2024-09-14T05:05:55.167846+0000 mgr.a (mgr.14355) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:58 smithi007 bash[22722]: cluster 2024-09-14T05:05:57.170116+0000 mgr.a (mgr.14355) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:58 smithi007 bash[22722]: audit 2024-09-14T05:05:58.328757+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:05:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:58 smithi131 bash[24745]: cluster 2024-09-14T05:05:57.170116+0000 mgr.a (mgr.14355) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:58 smithi131 bash[24745]: audit 2024-09-14T05:05:58.328757+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:05:59.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:05:59.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:05:59.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:05:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:58 smithi171 bash[25040]: cluster 2024-09-14T05:05:57.170116+0000 mgr.a (mgr.14355) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:05:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:58 smithi171 bash[25040]: audit 2024-09-14T05:05:58.328757+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:05:59.775 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:05:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:05:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:05:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:05:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:58.934803+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:58.938784+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:58.947260+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:58.951251+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: cluster 2024-09-14T05:05:59.170732+0000 mgr.a (mgr.14355) 17515 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.355930+0000 mgr.a (mgr.14355) 17516 : audit [DBG] from='client.376671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.657305+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.658411+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.663843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.665914+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:05:59 smithi007 bash[22722]: audit 2024-09-14T05:05:59.675214+0000 mgr.a (mgr.14355) 17517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:58.934803+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:58.938784+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:58.947260+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:58.951251+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: cluster 2024-09-14T05:05:59.170732+0000 mgr.a (mgr.14355) 17515 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.355930+0000 mgr.a (mgr.14355) 17516 : audit [DBG] from='client.376671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.657305+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.658411+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.663843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.665914+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:05:59 smithi131 bash[24745]: audit 2024-09-14T05:05:59.675214+0000 mgr.a (mgr.14355) 17517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:58.934803+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:58.938784+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:58.947260+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:58.951251+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: cluster 2024-09-14T05:05:59.170732+0000 mgr.a (mgr.14355) 17515 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.355930+0000 mgr.a (mgr.14355) 17516 : audit [DBG] from='client.376671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.657305+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.658411+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.663843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.665914+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:05:59 smithi171 bash[25040]: audit 2024-09-14T05:05:59.675214+0000 mgr.a (mgr.14355) 17517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:06:00.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:06:00 smithi007 bash[22972]: debug 2024-09-14T05:06:00.480+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:06:00.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:06:00 smithi007 bash[22972]: debug 2024-09-14T05:06:00.484+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:06:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:00 smithi131 bash[24745]: audit 2024-09-14T05:06:00.486145+0000 mgr.a (mgr.14355) 17518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:06:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:00 smithi131 bash[24745]: cephadm 2024-09-14T05:06:00.487793+0000 mgr.a (mgr.14355) 17519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:06:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:00 smithi171 bash[25040]: audit 2024-09-14T05:06:00.486145+0000 mgr.a (mgr.14355) 17518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:06:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:00 smithi171 bash[25040]: cephadm 2024-09-14T05:06:00.487793+0000 mgr.a (mgr.14355) 17519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:06:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:00 smithi007 bash[22722]: audit 2024-09-14T05:06:00.486145+0000 mgr.a (mgr.14355) 17518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:06:01.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:00 smithi007 bash[22722]: cephadm 2024-09-14T05:06:00.487793+0000 mgr.a (mgr.14355) 17519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:06:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:01 smithi131 bash[24745]: cluster 2024-09-14T05:06:01.173059+0000 mgr.a (mgr.14355) 17520 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:06:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:01 smithi171 bash[25040]: cluster 2024-09-14T05:06:01.173059+0000 mgr.a (mgr.14355) 17520 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:06:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:01 smithi007 bash[22722]: cluster 2024-09-14T05:06:01.173059+0000 mgr.a (mgr.14355) 17520 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:06:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:04 smithi131 bash[24745]: cluster 2024-09-14T05:06:03.173808+0000 mgr.a (mgr.14355) 17521 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:04 smithi171 bash[25040]: cluster 2024-09-14T05:06:03.173808+0000 mgr.a (mgr.14355) 17521 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:04 smithi007 bash[22722]: cluster 2024-09-14T05:06:03.173808+0000 mgr.a (mgr.14355) 17521 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:04.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:04.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:05.541 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:05.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:05.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:05.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:05.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:06 smithi131 bash[24745]: audit 2024-09-14T05:06:05.109646+0000 mgr.a (mgr.14355) 17522 : audit [DBG] from='client.376848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:06 smithi131 bash[24745]: cluster 2024-09-14T05:06:05.174330+0000 mgr.a (mgr.14355) 17523 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:06 smithi171 bash[25040]: audit 2024-09-14T05:06:05.109646+0000 mgr.a (mgr.14355) 17522 : audit [DBG] from='client.376848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:06 smithi171 bash[25040]: cluster 2024-09-14T05:06:05.174330+0000 mgr.a (mgr.14355) 17523 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:06 smithi007 bash[22722]: audit 2024-09-14T05:06:05.109646+0000 mgr.a (mgr.14355) 17522 : audit [DBG] from='client.376848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:06 smithi007 bash[22722]: cluster 2024-09-14T05:06:05.174330+0000 mgr.a (mgr.14355) 17523 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:06:08.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:08 smithi131 bash[24745]: cluster 2024-09-14T05:06:07.177002+0000 mgr.a (mgr.14355) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:08 smithi171 bash[25040]: cluster 2024-09-14T05:06:07.177002+0000 mgr.a (mgr.14355) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:08 smithi007 bash[22722]: cluster 2024-09-14T05:06:07.177002+0000 mgr.a (mgr.14355) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:10 smithi131 bash[24745]: cluster 2024-09-14T05:06:09.177786+0000 mgr.a (mgr.14355) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:06:10.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:10 smithi171 bash[25040]: cluster 2024-09-14T05:06:09.177786+0000 mgr.a (mgr.14355) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:06:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:10 smithi007 bash[22722]: cluster 2024-09-14T05:06:09.177786+0000 mgr.a (mgr.14355) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:06:11.307 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:11.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:12 smithi131 bash[24745]: audit 2024-09-14T05:06:10.872441+0000 mgr.a (mgr.14355) 17526 : audit [DBG] from='client.376926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:12 smithi131 bash[24745]: cluster 2024-09-14T05:06:11.179333+0000 mgr.a (mgr.14355) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:12 smithi171 bash[25040]: audit 2024-09-14T05:06:10.872441+0000 mgr.a (mgr.14355) 17526 : audit [DBG] from='client.376926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:12 smithi171 bash[25040]: cluster 2024-09-14T05:06:11.179333+0000 mgr.a (mgr.14355) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:12 smithi007 bash[22722]: audit 2024-09-14T05:06:10.872441+0000 mgr.a (mgr.14355) 17526 : audit [DBG] from='client.376926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:12 smithi007 bash[22722]: cluster 2024-09-14T05:06:11.179333+0000 mgr.a (mgr.14355) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:06:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:14 smithi131 bash[24745]: cluster 2024-09-14T05:06:13.180191+0000 mgr.a (mgr.14355) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:14 smithi171 bash[25040]: cluster 2024-09-14T05:06:13.180191+0000 mgr.a (mgr.14355) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:14 smithi007 bash[22722]: cluster 2024-09-14T05:06:13.180191+0000 mgr.a (mgr.14355) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:16 smithi131 bash[24745]: cluster 2024-09-14T05:06:15.180962+0000 mgr.a (mgr.14355) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:16 smithi171 bash[25040]: cluster 2024-09-14T05:06:15.180962+0000 mgr.a (mgr.14355) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:16 smithi007 bash[22722]: cluster 2024-09-14T05:06:15.180962+0000 mgr.a (mgr.14355) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:06:17.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:17.060 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:17 smithi131 bash[24745]: audit 2024-09-14T05:06:16.641514+0000 mgr.a (mgr.14355) 17530 : audit [DBG] from='client.376998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:17.549 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:17 smithi171 bash[25040]: audit 2024-09-14T05:06:16.641514+0000 mgr.a (mgr.14355) 17530 : audit [DBG] from='client.376998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:17 smithi007 bash[22722]: audit 2024-09-14T05:06:16.641514+0000 mgr.a (mgr.14355) 17530 : audit [DBG] from='client.376998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:18 smithi131 bash[24745]: cluster 2024-09-14T05:06:17.183757+0000 mgr.a (mgr.14355) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:06:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:18 smithi171 bash[25040]: cluster 2024-09-14T05:06:17.183757+0000 mgr.a (mgr.14355) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:06:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:18 smithi007 bash[22722]: cluster 2024-09-14T05:06:17.183757+0000 mgr.a (mgr.14355) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:06:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:20 smithi131 bash[24745]: cluster 2024-09-14T05:06:19.184547+0000 mgr.a (mgr.14355) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:06:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:20 smithi171 bash[25040]: cluster 2024-09-14T05:06:19.184547+0000 mgr.a (mgr.14355) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:06:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:20 smithi007 bash[22722]: cluster 2024-09-14T05:06:19.184547+0000 mgr.a (mgr.14355) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:06:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:22 smithi131 bash[24745]: cluster 2024-09-14T05:06:21.186552+0000 mgr.a (mgr.14355) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:06:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:22 smithi171 bash[25040]: cluster 2024-09-14T05:06:21.186552+0000 mgr.a (mgr.14355) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:06:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:22 smithi007 bash[22722]: cluster 2024-09-14T05:06:21.186552+0000 mgr.a (mgr.14355) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:06:22.830 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:23.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:23 smithi171 bash[25040]: audit 2024-09-14T05:06:22.397620+0000 mgr.a (mgr.14355) 17534 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:23 smithi007 bash[22722]: audit 2024-09-14T05:06:22.397620+0000 mgr.a (mgr.14355) 17534 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:23 smithi131 bash[24745]: audit 2024-09-14T05:06:22.397620+0000 mgr.a (mgr.14355) 17534 : audit [DBG] from='client.377073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:24 smithi171 bash[25040]: cluster 2024-09-14T05:06:23.187422+0000 mgr.a (mgr.14355) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:24 smithi007 bash[22722]: cluster 2024-09-14T05:06:23.187422+0000 mgr.a (mgr.14355) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:24.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:24 smithi131 bash[24745]: cluster 2024-09-14T05:06:23.187422+0000 mgr.a (mgr.14355) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:26 smithi171 bash[25040]: cluster 2024-09-14T05:06:25.188207+0000 mgr.a (mgr.14355) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:26 smithi007 bash[22722]: cluster 2024-09-14T05:06:25.188207+0000 mgr.a (mgr.14355) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:26 smithi131 bash[24745]: cluster 2024-09-14T05:06:25.188207+0000 mgr.a (mgr.14355) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:27.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:28 smithi171 bash[25040]: cluster 2024-09-14T05:06:27.190457+0000 mgr.a (mgr.14355) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:28.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:28.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:28 smithi007 bash[22722]: cluster 2024-09-14T05:06:27.190457+0000 mgr.a (mgr.14355) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:28 smithi131 bash[24745]: cluster 2024-09-14T05:06:27.190457+0000 mgr.a (mgr.14355) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:29.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:29 smithi171 bash[25040]: audit 2024-09-14T05:06:28.155670+0000 mgr.a (mgr.14355) 17538 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:29.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:29 smithi007 bash[22722]: audit 2024-09-14T05:06:28.155670+0000 mgr.a (mgr.14355) 17538 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:29 smithi131 bash[24745]: audit 2024-09-14T05:06:28.155670+0000 mgr.a (mgr.14355) 17538 : audit [DBG] from='client.377151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:30 smithi007 bash[22722]: cluster 2024-09-14T05:06:29.191367+0000 mgr.a (mgr.14355) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:30 smithi131 bash[24745]: cluster 2024-09-14T05:06:29.191367+0000 mgr.a (mgr.14355) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:30 smithi171 bash[25040]: cluster 2024-09-14T05:06:29.191367+0000 mgr.a (mgr.14355) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:32 smithi007 bash[22722]: cluster 2024-09-14T05:06:31.193580+0000 mgr.a (mgr.14355) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:32 smithi131 bash[24745]: cluster 2024-09-14T05:06:31.193580+0000 mgr.a (mgr.14355) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:32 smithi171 bash[25040]: cluster 2024-09-14T05:06:31.193580+0000 mgr.a (mgr.14355) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:34.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:34.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:34.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:34.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:34.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:34 smithi007 bash[22722]: cluster 2024-09-14T05:06:33.194366+0000 mgr.a (mgr.14355) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:34 smithi131 bash[24745]: cluster 2024-09-14T05:06:33.194366+0000 mgr.a (mgr.14355) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:34 smithi171 bash[25040]: cluster 2024-09-14T05:06:33.194366+0000 mgr.a (mgr.14355) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:35 smithi007 bash[22722]: audit 2024-09-14T05:06:33.907529+0000 mgr.a (mgr.14355) 17542 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:35 smithi131 bash[24745]: audit 2024-09-14T05:06:33.907529+0000 mgr.a (mgr.14355) 17542 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:35.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:35 smithi171 bash[25040]: audit 2024-09-14T05:06:33.907529+0000 mgr.a (mgr.14355) 17542 : audit [DBG] from='client.377229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:36 smithi007 bash[22722]: cluster 2024-09-14T05:06:35.196649+0000 mgr.a (mgr.14355) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:36 smithi131 bash[24745]: cluster 2024-09-14T05:06:35.196649+0000 mgr.a (mgr.14355) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:36 smithi171 bash[25040]: cluster 2024-09-14T05:06:35.196649+0000 mgr.a (mgr.14355) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:38 smithi007 bash[22722]: cluster 2024-09-14T05:06:37.197614+0000 mgr.a (mgr.14355) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:38 smithi131 bash[24745]: cluster 2024-09-14T05:06:37.197614+0000 mgr.a (mgr.14355) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:38 smithi171 bash[25040]: cluster 2024-09-14T05:06:37.197614+0000 mgr.a (mgr.14355) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:39.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:39.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:40.130 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:40.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:40.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:40.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:40.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:40 smithi007 bash[22722]: cluster 2024-09-14T05:06:39.198558+0000 mgr.a (mgr.14355) 17545 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:40 smithi007 bash[22722]: audit 2024-09-14T05:06:39.679736+0000 mgr.a (mgr.14355) 17546 : audit [DBG] from='client.377304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:40 smithi131 bash[24745]: cluster 2024-09-14T05:06:39.198558+0000 mgr.a (mgr.14355) 17545 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:40 smithi131 bash[24745]: audit 2024-09-14T05:06:39.679736+0000 mgr.a (mgr.14355) 17546 : audit [DBG] from='client.377304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:40 smithi171 bash[25040]: cluster 2024-09-14T05:06:39.198558+0000 mgr.a (mgr.14355) 17545 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:40 smithi171 bash[25040]: audit 2024-09-14T05:06:39.679736+0000 mgr.a (mgr.14355) 17546 : audit [DBG] from='client.377304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:42 smithi007 bash[22722]: cluster 2024-09-14T05:06:41.201073+0000 mgr.a (mgr.14355) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:42 smithi131 bash[24745]: cluster 2024-09-14T05:06:41.201073+0000 mgr.a (mgr.14355) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:42 smithi171 bash[25040]: cluster 2024-09-14T05:06:41.201073+0000 mgr.a (mgr.14355) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:06:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:44 smithi007 bash[22722]: cluster 2024-09-14T05:06:43.202033+0000 mgr.a (mgr.14355) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:44 smithi131 bash[24745]: cluster 2024-09-14T05:06:43.202033+0000 mgr.a (mgr.14355) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:44 smithi171 bash[25040]: cluster 2024-09-14T05:06:43.202033+0000 mgr.a (mgr.14355) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:45.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:45.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:45.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:45.918 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:45.918 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:46 smithi007 bash[22722]: cluster 2024-09-14T05:06:45.204040+0000 mgr.a (mgr.14355) 17549 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:46 smithi007 bash[22722]: audit 2024-09-14T05:06:45.465673+0000 mgr.a (mgr.14355) 17550 : audit [DBG] from='client.377379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:46 smithi131 bash[24745]: cluster 2024-09-14T05:06:45.204040+0000 mgr.a (mgr.14355) 17549 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:46 smithi131 bash[24745]: audit 2024-09-14T05:06:45.465673+0000 mgr.a (mgr.14355) 17550 : audit [DBG] from='client.377379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:46 smithi171 bash[25040]: cluster 2024-09-14T05:06:45.204040+0000 mgr.a (mgr.14355) 17549 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:46.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:46 smithi171 bash[25040]: audit 2024-09-14T05:06:45.465673+0000 mgr.a (mgr.14355) 17550 : audit [DBG] from='client.377379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:48 smithi007 bash[22722]: cluster 2024-09-14T05:06:47.205102+0000 mgr.a (mgr.14355) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:48 smithi131 bash[24745]: cluster 2024-09-14T05:06:47.205102+0000 mgr.a (mgr.14355) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:48 smithi171 bash[25040]: cluster 2024-09-14T05:06:47.205102+0000 mgr.a (mgr.14355) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:50 smithi007 bash[22722]: cluster 2024-09-14T05:06:49.206069+0000 mgr.a (mgr.14355) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:06:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:50 smithi131 bash[24745]: cluster 2024-09-14T05:06:49.206069+0000 mgr.a (mgr.14355) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:06:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:50 smithi171 bash[25040]: cluster 2024-09-14T05:06:49.206069+0000 mgr.a (mgr.14355) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:06:50.919 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:50.920 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:51.693 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:52 smithi007 bash[22722]: cluster 2024-09-14T05:06:51.207402+0000 mgr.a (mgr.14355) 17553 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:52.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:52 smithi007 bash[22722]: audit 2024-09-14T05:06:51.254668+0000 mgr.a (mgr.14355) 17554 : audit [DBG] from='client.377454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:52 smithi131 bash[24745]: cluster 2024-09-14T05:06:51.207402+0000 mgr.a (mgr.14355) 17553 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:52 smithi131 bash[24745]: audit 2024-09-14T05:06:51.254668+0000 mgr.a (mgr.14355) 17554 : audit [DBG] from='client.377454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:52 smithi171 bash[25040]: cluster 2024-09-14T05:06:51.207402+0000 mgr.a (mgr.14355) 17553 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:52 smithi171 bash[25040]: audit 2024-09-14T05:06:51.254668+0000 mgr.a (mgr.14355) 17554 : audit [DBG] from='client.377454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:54 smithi007 bash[22722]: cluster 2024-09-14T05:06:53.208257+0000 mgr.a (mgr.14355) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:54 smithi131 bash[24745]: cluster 2024-09-14T05:06:53.208257+0000 mgr.a (mgr.14355) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:54 smithi171 bash[25040]: cluster 2024-09-14T05:06:53.208257+0000 mgr.a (mgr.14355) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:06:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:06:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:06:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:06:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:56 smithi007 bash[22722]: cluster 2024-09-14T05:06:55.210437+0000 mgr.a (mgr.14355) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:56 smithi131 bash[24745]: cluster 2024-09-14T05:06:55.210437+0000 mgr.a (mgr.14355) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:56 smithi171 bash[25040]: cluster 2024-09-14T05:06:55.210437+0000 mgr.a (mgr.14355) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:57.445 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:06:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:06:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:06:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:06:57.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:06:58.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:58 smithi007 bash[22722]: audit 2024-09-14T05:06:57.028250+0000 mgr.a (mgr.14355) 17557 : audit [DBG] from='client.377523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:58.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:06:58 smithi007 bash[22722]: cluster 2024-09-14T05:06:57.210952+0000 mgr.a (mgr.14355) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:58 smithi131 bash[24745]: audit 2024-09-14T05:06:57.028250+0000 mgr.a (mgr.14355) 17557 : audit [DBG] from='client.377523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:06:58 smithi131 bash[24745]: cluster 2024-09-14T05:06:57.210952+0000 mgr.a (mgr.14355) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:06:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:58 smithi171 bash[25040]: audit 2024-09-14T05:06:57.028250+0000 mgr.a (mgr.14355) 17557 : audit [DBG] from='client.377523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:06:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:06:58 smithi171 bash[25040]: cluster 2024-09-14T05:06:57.210952+0000 mgr.a (mgr.14355) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:00 smithi007 bash[22722]: cluster 2024-09-14T05:06:59.211789+0000 mgr.a (mgr.14355) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:00 smithi007 bash[22722]: audit 2024-09-14T05:07:00.539995+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:07:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:00 smithi131 bash[24745]: cluster 2024-09-14T05:06:59.211789+0000 mgr.a (mgr.14355) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:00 smithi131 bash[24745]: audit 2024-09-14T05:07:00.539995+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:07:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:00 smithi171 bash[25040]: cluster 2024-09-14T05:06:59.211789+0000 mgr.a (mgr.14355) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:00 smithi171 bash[25040]: audit 2024-09-14T05:07:00.539995+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:07:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:01 smithi007 bash[22722]: audit 2024-09-14T05:07:01.368538+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:07:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:01 smithi007 bash[22722]: audit 2024-09-14T05:07:01.370023+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:07:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:01 smithi007 bash[22722]: audit 2024-09-14T05:07:01.378846+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:07:01.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:01 smithi007 bash[22722]: audit 2024-09-14T05:07:01.381493+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:01 smithi131 bash[24745]: audit 2024-09-14T05:07:01.368538+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:07:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:01 smithi131 bash[24745]: audit 2024-09-14T05:07:01.370023+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:07:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:01 smithi131 bash[24745]: audit 2024-09-14T05:07:01.378846+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:07:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:01 smithi131 bash[24745]: audit 2024-09-14T05:07:01.381493+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:01 smithi171 bash[25040]: audit 2024-09-14T05:07:01.368538+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:07:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:01 smithi171 bash[25040]: audit 2024-09-14T05:07:01.370023+0000 mon.a (mon.0) 3214 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:07:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:01 smithi171 bash[25040]: audit 2024-09-14T05:07:01.378846+0000 mon.a (mon.0) 3215 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:07:02.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:01 smithi171 bash[25040]: audit 2024-09-14T05:07:01.381493+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:02.446 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:02.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:02.447 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:02.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:07:02 smithi007 bash[22972]: debug 2024-09-14T05:07:02.135+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:07:02.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:07:02 smithi007 bash[22972]: debug 2024-09-14T05:07:02.139+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:07:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:02 smithi007 bash[22722]: cluster 2024-09-14T05:07:01.212860+0000 mgr.a (mgr.14355) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:02 smithi007 bash[22722]: audit 2024-09-14T05:07:01.382784+0000 mgr.a (mgr.14355) 17561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:02 smithi131 bash[24745]: cluster 2024-09-14T05:07:01.212860+0000 mgr.a (mgr.14355) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:02 smithi131 bash[24745]: audit 2024-09-14T05:07:01.382784+0000 mgr.a (mgr.14355) 17561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:02 smithi171 bash[25040]: cluster 2024-09-14T05:07:01.212860+0000 mgr.a (mgr.14355) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:02 smithi171 bash[25040]: audit 2024-09-14T05:07:01.382784+0000 mgr.a (mgr.14355) 17561 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:07:03.208 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:03.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:03.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:03.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:03.209 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:03 smithi007 bash[22722]: audit 2024-09-14T05:07:02.142037+0000 mgr.a (mgr.14355) 17562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:07:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:03 smithi007 bash[22722]: cephadm 2024-09-14T05:07:02.143359+0000 mgr.a (mgr.14355) 17563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:07:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:03 smithi131 bash[24745]: audit 2024-09-14T05:07:02.142037+0000 mgr.a (mgr.14355) 17562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:07:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:03 smithi131 bash[24745]: cephadm 2024-09-14T05:07:02.143359+0000 mgr.a (mgr.14355) 17563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:07:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:03 smithi171 bash[25040]: audit 2024-09-14T05:07:02.142037+0000 mgr.a (mgr.14355) 17562 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:07:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:03 smithi171 bash[25040]: cephadm 2024-09-14T05:07:02.143359+0000 mgr.a (mgr.14355) 17563 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:07:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:04 smithi007 bash[22722]: audit 2024-09-14T05:07:02.777319+0000 mgr.a (mgr.14355) 17564 : audit [DBG] from='client.377703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:04 smithi007 bash[22722]: cluster 2024-09-14T05:07:03.213508+0000 mgr.a (mgr.14355) 17565 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:04 smithi131 bash[24745]: audit 2024-09-14T05:07:02.777319+0000 mgr.a (mgr.14355) 17564 : audit [DBG] from='client.377703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:04 smithi131 bash[24745]: cluster 2024-09-14T05:07:03.213508+0000 mgr.a (mgr.14355) 17565 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:04 smithi171 bash[25040]: audit 2024-09-14T05:07:02.777319+0000 mgr.a (mgr.14355) 17564 : audit [DBG] from='client.377703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:04 smithi171 bash[25040]: cluster 2024-09-14T05:07:03.213508+0000 mgr.a (mgr.14355) 17565 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:06 smithi007 bash[22722]: cluster 2024-09-14T05:07:05.215644+0000 mgr.a (mgr.14355) 17566 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:06 smithi131 bash[24745]: cluster 2024-09-14T05:07:05.215644+0000 mgr.a (mgr.14355) 17566 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:06 smithi171 bash[25040]: cluster 2024-09-14T05:07:05.215644+0000 mgr.a (mgr.14355) 17566 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:08.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:08 smithi007 bash[22722]: cluster 2024-09-14T05:07:07.216407+0000 mgr.a (mgr.14355) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:08.982 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:08.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:08 smithi131 bash[24745]: cluster 2024-09-14T05:07:07.216407+0000 mgr.a (mgr.14355) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:08 smithi171 bash[25040]: cluster 2024-09-14T05:07:07.216407+0000 mgr.a (mgr.14355) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:09 smithi007 bash[22722]: audit 2024-09-14T05:07:08.544426+0000 mgr.a (mgr.14355) 17568 : audit [DBG] from='client.377778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:09 smithi131 bash[24745]: audit 2024-09-14T05:07:08.544426+0000 mgr.a (mgr.14355) 17568 : audit [DBG] from='client.377778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:09 smithi171 bash[25040]: audit 2024-09-14T05:07:08.544426+0000 mgr.a (mgr.14355) 17568 : audit [DBG] from='client.377778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:10 smithi007 bash[22722]: cluster 2024-09-14T05:07:09.217493+0000 mgr.a (mgr.14355) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:10 smithi131 bash[24745]: cluster 2024-09-14T05:07:09.217493+0000 mgr.a (mgr.14355) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:10 smithi171 bash[25040]: cluster 2024-09-14T05:07:09.217493+0000 mgr.a (mgr.14355) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:12 smithi007 bash[22722]: cluster 2024-09-14T05:07:11.219939+0000 mgr.a (mgr.14355) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:12 smithi131 bash[24745]: cluster 2024-09-14T05:07:11.219939+0000 mgr.a (mgr.14355) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:12 smithi171 bash[25040]: cluster 2024-09-14T05:07:11.219939+0000 mgr.a (mgr.14355) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:13.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:13.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:13.984 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:14.745 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:14.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:14.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:14.745 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:14.746 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:14 smithi007 bash[22722]: cluster 2024-09-14T05:07:13.220771+0000 mgr.a (mgr.14355) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:14 smithi131 bash[24745]: cluster 2024-09-14T05:07:13.220771+0000 mgr.a (mgr.14355) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:14 smithi171 bash[25040]: cluster 2024-09-14T05:07:13.220771+0000 mgr.a (mgr.14355) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:15 smithi007 bash[22722]: audit 2024-09-14T05:07:14.311394+0000 mgr.a (mgr.14355) 17572 : audit [DBG] from='client.377853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:15 smithi131 bash[24745]: audit 2024-09-14T05:07:14.311394+0000 mgr.a (mgr.14355) 17572 : audit [DBG] from='client.377853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:15 smithi171 bash[25040]: audit 2024-09-14T05:07:14.311394+0000 mgr.a (mgr.14355) 17572 : audit [DBG] from='client.377853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:16 smithi007 bash[22722]: cluster 2024-09-14T05:07:15.223118+0000 mgr.a (mgr.14355) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:16 smithi131 bash[24745]: cluster 2024-09-14T05:07:15.223118+0000 mgr.a (mgr.14355) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:16 smithi171 bash[25040]: cluster 2024-09-14T05:07:15.223118+0000 mgr.a (mgr.14355) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:07:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:18 smithi007 bash[22722]: cluster 2024-09-14T05:07:17.223961+0000 mgr.a (mgr.14355) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:18 smithi131 bash[24745]: cluster 2024-09-14T05:07:17.223961+0000 mgr.a (mgr.14355) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:18 smithi171 bash[25040]: cluster 2024-09-14T05:07:17.223961+0000 mgr.a (mgr.14355) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:19.747 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:19.748 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:20.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:20.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:20.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:20.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:20 smithi007 bash[22722]: cluster 2024-09-14T05:07:19.224748+0000 mgr.a (mgr.14355) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:20 smithi131 bash[24745]: cluster 2024-09-14T05:07:19.224748+0000 mgr.a (mgr.14355) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:20 smithi171 bash[25040]: cluster 2024-09-14T05:07:19.224748+0000 mgr.a (mgr.14355) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:21 smithi007 bash[22722]: audit 2024-09-14T05:07:20.082438+0000 mgr.a (mgr.14355) 17576 : audit [DBG] from='client.377931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:21 smithi131 bash[24745]: audit 2024-09-14T05:07:20.082438+0000 mgr.a (mgr.14355) 17576 : audit [DBG] from='client.377931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:21 smithi171 bash[25040]: audit 2024-09-14T05:07:20.082438+0000 mgr.a (mgr.14355) 17576 : audit [DBG] from='client.377931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:22 smithi007 bash[22722]: cluster 2024-09-14T05:07:21.227566+0000 mgr.a (mgr.14355) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:22 smithi131 bash[24745]: cluster 2024-09-14T05:07:21.227566+0000 mgr.a (mgr.14355) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:22 smithi171 bash[25040]: cluster 2024-09-14T05:07:21.227566+0000 mgr.a (mgr.14355) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:24 smithi007 bash[22722]: cluster 2024-09-14T05:07:23.228336+0000 mgr.a (mgr.14355) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:24 smithi131 bash[24745]: cluster 2024-09-14T05:07:23.228336+0000 mgr.a (mgr.14355) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:24 smithi171 bash[25040]: cluster 2024-09-14T05:07:23.228336+0000 mgr.a (mgr.14355) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:25.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:25.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:26.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:26 smithi007 bash[22722]: cluster 2024-09-14T05:07:25.230260+0000 mgr.a (mgr.14355) 17579 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:26 smithi131 bash[24745]: cluster 2024-09-14T05:07:25.230260+0000 mgr.a (mgr.14355) 17579 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:26 smithi171 bash[25040]: cluster 2024-09-14T05:07:25.230260+0000 mgr.a (mgr.14355) 17579 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:27 smithi007 bash[22722]: audit 2024-09-14T05:07:25.859376+0000 mgr.a (mgr.14355) 17580 : audit [DBG] from='client.378006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:27 smithi131 bash[24745]: audit 2024-09-14T05:07:25.859376+0000 mgr.a (mgr.14355) 17580 : audit [DBG] from='client.378006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:27 smithi171 bash[25040]: audit 2024-09-14T05:07:25.859376+0000 mgr.a (mgr.14355) 17580 : audit [DBG] from='client.378006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:28 smithi007 bash[22722]: cluster 2024-09-14T05:07:27.231277+0000 mgr.a (mgr.14355) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:28 smithi131 bash[24745]: cluster 2024-09-14T05:07:27.231277+0000 mgr.a (mgr.14355) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:28 smithi171 bash[25040]: cluster 2024-09-14T05:07:27.231277+0000 mgr.a (mgr.14355) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:07:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:30 smithi007 bash[22722]: cluster 2024-09-14T05:07:29.232084+0000 mgr.a (mgr.14355) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:07:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:30 smithi131 bash[24745]: cluster 2024-09-14T05:07:29.232084+0000 mgr.a (mgr.14355) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:07:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:30 smithi171 bash[25040]: cluster 2024-09-14T05:07:29.232084+0000 mgr.a (mgr.14355) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:07:31.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:31.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:31.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:32.087 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:32 smithi007 bash[22722]: cluster 2024-09-14T05:07:31.234362+0000 mgr.a (mgr.14355) 17583 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:32 smithi007 bash[22722]: audit 2024-09-14T05:07:31.641435+0000 mgr.a (mgr.14355) 17584 : audit [DBG] from='client.378081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:32 smithi131 bash[24745]: cluster 2024-09-14T05:07:31.234362+0000 mgr.a (mgr.14355) 17583 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:32 smithi131 bash[24745]: audit 2024-09-14T05:07:31.641435+0000 mgr.a (mgr.14355) 17584 : audit [DBG] from='client.378081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:32 smithi171 bash[25040]: cluster 2024-09-14T05:07:31.234362+0000 mgr.a (mgr.14355) 17583 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:32 smithi171 bash[25040]: audit 2024-09-14T05:07:31.641435+0000 mgr.a (mgr.14355) 17584 : audit [DBG] from='client.378081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:34 smithi007 bash[22722]: cluster 2024-09-14T05:07:33.235326+0000 mgr.a (mgr.14355) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:34 smithi131 bash[24745]: cluster 2024-09-14T05:07:33.235326+0000 mgr.a (mgr.14355) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:34 smithi171 bash[25040]: cluster 2024-09-14T05:07:33.235326+0000 mgr.a (mgr.14355) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:36 smithi007 bash[22722]: cluster 2024-09-14T05:07:35.237616+0000 mgr.a (mgr.14355) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:36 smithi131 bash[24745]: cluster 2024-09-14T05:07:35.237616+0000 mgr.a (mgr.14355) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:36 smithi171 bash[25040]: cluster 2024-09-14T05:07:35.237616+0000 mgr.a (mgr.14355) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:37.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:37.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:37.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:37.867 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:37.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:38 smithi007 bash[22722]: cluster 2024-09-14T05:07:37.238315+0000 mgr.a (mgr.14355) 17587 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:38 smithi007 bash[22722]: audit 2024-09-14T05:07:37.421703+0000 mgr.a (mgr.14355) 17588 : audit [DBG] from='client.378153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:38 smithi131 bash[24745]: cluster 2024-09-14T05:07:37.238315+0000 mgr.a (mgr.14355) 17587 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:38 smithi131 bash[24745]: audit 2024-09-14T05:07:37.421703+0000 mgr.a (mgr.14355) 17588 : audit [DBG] from='client.378153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:38 smithi171 bash[25040]: cluster 2024-09-14T05:07:37.238315+0000 mgr.a (mgr.14355) 17587 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:38 smithi171 bash[25040]: audit 2024-09-14T05:07:37.421703+0000 mgr.a (mgr.14355) 17588 : audit [DBG] from='client.378153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:40 smithi007 bash[22722]: cluster 2024-09-14T05:07:39.239246+0000 mgr.a (mgr.14355) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:40 smithi131 bash[24745]: cluster 2024-09-14T05:07:39.239246+0000 mgr.a (mgr.14355) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:40 smithi171 bash[25040]: cluster 2024-09-14T05:07:39.239246+0000 mgr.a (mgr.14355) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:42.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:42.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:42.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:42 smithi131 bash[24745]: cluster 2024-09-14T05:07:41.241500+0000 mgr.a (mgr.14355) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:42 smithi171 bash[25040]: cluster 2024-09-14T05:07:41.241500+0000 mgr.a (mgr.14355) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:42 smithi007 bash[22722]: cluster 2024-09-14T05:07:41.241500+0000 mgr.a (mgr.14355) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:43.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:43.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:44 smithi131 bash[24745]: audit 2024-09-14T05:07:43.204800+0000 mgr.a (mgr.14355) 17591 : audit [DBG] from='client.378231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:44 smithi131 bash[24745]: cluster 2024-09-14T05:07:43.242439+0000 mgr.a (mgr.14355) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:44 smithi171 bash[25040]: audit 2024-09-14T05:07:43.204800+0000 mgr.a (mgr.14355) 17591 : audit [DBG] from='client.378231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:44 smithi171 bash[25040]: cluster 2024-09-14T05:07:43.242439+0000 mgr.a (mgr.14355) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:44 smithi007 bash[22722]: audit 2024-09-14T05:07:43.204800+0000 mgr.a (mgr.14355) 17591 : audit [DBG] from='client.378231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:45.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:44 smithi007 bash[22722]: cluster 2024-09-14T05:07:43.242439+0000 mgr.a (mgr.14355) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:46 smithi131 bash[24745]: cluster 2024-09-14T05:07:45.244710+0000 mgr.a (mgr.14355) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:46 smithi171 bash[25040]: cluster 2024-09-14T05:07:45.244710+0000 mgr.a (mgr.14355) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:46 smithi007 bash[22722]: cluster 2024-09-14T05:07:45.244710+0000 mgr.a (mgr.14355) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:48.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:48 smithi131 bash[24745]: cluster 2024-09-14T05:07:47.245503+0000 mgr.a (mgr.14355) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:48 smithi171 bash[25040]: cluster 2024-09-14T05:07:47.245503+0000 mgr.a (mgr.14355) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:48 smithi007 bash[22722]: cluster 2024-09-14T05:07:47.245503+0000 mgr.a (mgr.14355) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:49.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:50 smithi131 bash[24745]: audit 2024-09-14T05:07:48.984323+0000 mgr.a (mgr.14355) 17595 : audit [DBG] from='client.378306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:50 smithi131 bash[24745]: cluster 2024-09-14T05:07:49.246145+0000 mgr.a (mgr.14355) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:50 smithi171 bash[25040]: audit 2024-09-14T05:07:48.984323+0000 mgr.a (mgr.14355) 17595 : audit [DBG] from='client.378306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:50 smithi171 bash[25040]: cluster 2024-09-14T05:07:49.246145+0000 mgr.a (mgr.14355) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:50 smithi007 bash[22722]: audit 2024-09-14T05:07:48.984323+0000 mgr.a (mgr.14355) 17595 : audit [DBG] from='client.378306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:51.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:50 smithi007 bash[22722]: cluster 2024-09-14T05:07:49.246145+0000 mgr.a (mgr.14355) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:52 smithi131 bash[24745]: cluster 2024-09-14T05:07:51.248581+0000 mgr.a (mgr.14355) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:52 smithi171 bash[25040]: cluster 2024-09-14T05:07:51.248581+0000 mgr.a (mgr.14355) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:52 smithi007 bash[22722]: cluster 2024-09-14T05:07:51.248581+0000 mgr.a (mgr.14355) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:54.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:07:54.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:07:54.424 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:07:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:54 smithi131 bash[24745]: cluster 2024-09-14T05:07:53.249350+0000 mgr.a (mgr.14355) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:54 smithi171 bash[25040]: cluster 2024-09-14T05:07:53.249350+0000 mgr.a (mgr.14355) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:07:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:07:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:07:55.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:07:55.192 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:07:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:54 smithi007 bash[22722]: cluster 2024-09-14T05:07:53.249350+0000 mgr.a (mgr.14355) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:56 smithi131 bash[24745]: audit 2024-09-14T05:07:54.760587+0000 mgr.a (mgr.14355) 17599 : audit [DBG] from='client.378384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:56 smithi131 bash[24745]: cluster 2024-09-14T05:07:55.250632+0000 mgr.a (mgr.14355) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:56 smithi171 bash[25040]: audit 2024-09-14T05:07:54.760587+0000 mgr.a (mgr.14355) 17599 : audit [DBG] from='client.378384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:56 smithi171 bash[25040]: cluster 2024-09-14T05:07:55.250632+0000 mgr.a (mgr.14355) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:56 smithi007 bash[22722]: audit 2024-09-14T05:07:54.760587+0000 mgr.a (mgr.14355) 17599 : audit [DBG] from='client.378384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:07:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:56 smithi007 bash[22722]: cluster 2024-09-14T05:07:55.250632+0000 mgr.a (mgr.14355) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:07:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:07:57 smithi171 bash[25040]: cluster 2024-09-14T05:07:57.251366+0000 mgr.a (mgr.14355) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:07:57 smithi007 bash[22722]: cluster 2024-09-14T05:07:57.251366+0000 mgr.a (mgr.14355) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:07:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:07:57 smithi131 bash[24745]: cluster 2024-09-14T05:07:57.251366+0000 mgr.a (mgr.14355) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:00.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:00.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:00 smithi007 bash[22722]: cluster 2024-09-14T05:07:59.252134+0000 mgr.a (mgr.14355) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:00 smithi131 bash[24745]: cluster 2024-09-14T05:07:59.252134+0000 mgr.a (mgr.14355) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:00 smithi171 bash[25040]: cluster 2024-09-14T05:07:59.252134+0000 mgr.a (mgr.14355) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:00.966 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:00.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:00.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:01 smithi007 bash[22722]: audit 2024-09-14T05:08:00.527597+0000 mgr.a (mgr.14355) 17603 : audit [DBG] from='client.378459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:01 smithi131 bash[24745]: audit 2024-09-14T05:08:00.527597+0000 mgr.a (mgr.14355) 17603 : audit [DBG] from='client.378459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:01 smithi171 bash[25040]: audit 2024-09-14T05:08:00.527597+0000 mgr.a (mgr.14355) 17603 : audit [DBG] from='client.378459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:02 smithi007 bash[22722]: cluster 2024-09-14T05:08:01.254930+0000 mgr.a (mgr.14355) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:02.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:02 smithi007 bash[22722]: audit 2024-09-14T05:08:02.194428+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:08:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:02 smithi131 bash[24745]: cluster 2024-09-14T05:08:01.254930+0000 mgr.a (mgr.14355) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:02 smithi131 bash[24745]: audit 2024-09-14T05:08:02.194428+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:08:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:02 smithi171 bash[25040]: cluster 2024-09-14T05:08:01.254930+0000 mgr.a (mgr.14355) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:02 smithi171 bash[25040]: audit 2024-09-14T05:08:02.194428+0000 mon.a (mon.0) 3217 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:08:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22722]: audit 2024-09-14T05:08:03.041774+0000 mon.a (mon.0) 3218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:08:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22722]: audit 2024-09-14T05:08:03.042955+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:08:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22722]: audit 2024-09-14T05:08:03.051785+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:08:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22722]: audit 2024-09-14T05:08:03.056306+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:03 smithi131 bash[24745]: audit 2024-09-14T05:08:03.041774+0000 mon.a (mon.0) 3218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:08:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:03 smithi131 bash[24745]: audit 2024-09-14T05:08:03.042955+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:08:03.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:03 smithi131 bash[24745]: audit 2024-09-14T05:08:03.051785+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:08:03.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:03 smithi131 bash[24745]: audit 2024-09-14T05:08:03.056306+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:03 smithi171 bash[25040]: audit 2024-09-14T05:08:03.041774+0000 mon.a (mon.0) 3218 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:08:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:03 smithi171 bash[25040]: audit 2024-09-14T05:08:03.042955+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:08:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:03 smithi171 bash[25040]: audit 2024-09-14T05:08:03.051785+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:08:03.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:03 smithi171 bash[25040]: audit 2024-09-14T05:08:03.056306+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:04.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22972]: debug 2024-09-14T05:08:03.802+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:08:04.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:08:03 smithi007 bash[22972]: debug 2024-09-14T05:08:03.802+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:08:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:04 smithi007 bash[22722]: audit 2024-09-14T05:08:03.058653+0000 mgr.a (mgr.14355) 17605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:04 smithi007 bash[22722]: cluster 2024-09-14T05:08:03.255525+0000 mgr.a (mgr.14355) 17606 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:08:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:04 smithi131 bash[24745]: audit 2024-09-14T05:08:03.058653+0000 mgr.a (mgr.14355) 17605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:04 smithi131 bash[24745]: cluster 2024-09-14T05:08:03.255525+0000 mgr.a (mgr.14355) 17606 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:08:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:04 smithi171 bash[25040]: audit 2024-09-14T05:08:03.058653+0000 mgr.a (mgr.14355) 17605 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:08:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:04 smithi171 bash[25040]: cluster 2024-09-14T05:08:03.255525+0000 mgr.a (mgr.14355) 17606 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:08:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:05 smithi007 bash[22722]: audit 2024-09-14T05:08:03.807459+0000 mgr.a (mgr.14355) 17607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:08:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:05 smithi007 bash[22722]: cephadm 2024-09-14T05:08:03.808691+0000 mgr.a (mgr.14355) 17608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:08:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:05 smithi131 bash[24745]: audit 2024-09-14T05:08:03.807459+0000 mgr.a (mgr.14355) 17607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:08:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:05 smithi131 bash[24745]: cephadm 2024-09-14T05:08:03.808691+0000 mgr.a (mgr.14355) 17608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:08:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:05 smithi171 bash[25040]: audit 2024-09-14T05:08:03.807459+0000 mgr.a (mgr.14355) 17607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:08:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:05 smithi171 bash[25040]: cephadm 2024-09-14T05:08:03.808691+0000 mgr.a (mgr.14355) 17608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:08:05.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:05.969 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:06 smithi007 bash[22722]: cluster 2024-09-14T05:08:05.257739+0000 mgr.a (mgr.14355) 17609 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:06.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:06.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:06.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:06 smithi131 bash[24745]: cluster 2024-09-14T05:08:05.257739+0000 mgr.a (mgr.14355) 17609 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:06 smithi171 bash[25040]: cluster 2024-09-14T05:08:05.257739+0000 mgr.a (mgr.14355) 17609 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:07 smithi007 bash[22722]: audit 2024-09-14T05:08:06.307329+0000 mgr.a (mgr.14355) 17610 : audit [DBG] from='client.378642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:07 smithi131 bash[24745]: audit 2024-09-14T05:08:06.307329+0000 mgr.a (mgr.14355) 17610 : audit [DBG] from='client.378642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:07 smithi171 bash[25040]: audit 2024-09-14T05:08:06.307329+0000 mgr.a (mgr.14355) 17610 : audit [DBG] from='client.378642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:08 smithi007 bash[22722]: cluster 2024-09-14T05:08:07.258721+0000 mgr.a (mgr.14355) 17611 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:08 smithi131 bash[24745]: cluster 2024-09-14T05:08:07.258721+0000 mgr.a (mgr.14355) 17611 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:08 smithi171 bash[25040]: cluster 2024-09-14T05:08:07.258721+0000 mgr.a (mgr.14355) 17611 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:10 smithi007 bash[22722]: cluster 2024-09-14T05:08:09.259509+0000 mgr.a (mgr.14355) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:10 smithi131 bash[24745]: cluster 2024-09-14T05:08:09.259509+0000 mgr.a (mgr.14355) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:10 smithi171 bash[25040]: cluster 2024-09-14T05:08:09.259509+0000 mgr.a (mgr.14355) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:08:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:11.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:12.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:12.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:12.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:12.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:12 smithi007 bash[22722]: cluster 2024-09-14T05:08:11.261745+0000 mgr.a (mgr.14355) 17613 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:12.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:12 smithi131 bash[24745]: cluster 2024-09-14T05:08:11.261745+0000 mgr.a (mgr.14355) 17613 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:12 smithi171 bash[25040]: cluster 2024-09-14T05:08:11.261745+0000 mgr.a (mgr.14355) 17613 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:13 smithi007 bash[22722]: audit 2024-09-14T05:08:12.088608+0000 mgr.a (mgr.14355) 17614 : audit [DBG] from='client.378714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:13 smithi131 bash[24745]: audit 2024-09-14T05:08:12.088608+0000 mgr.a (mgr.14355) 17614 : audit [DBG] from='client.378714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:13 smithi171 bash[25040]: audit 2024-09-14T05:08:12.088608+0000 mgr.a (mgr.14355) 17614 : audit [DBG] from='client.378714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:14 smithi007 bash[22722]: cluster 2024-09-14T05:08:13.262743+0000 mgr.a (mgr.14355) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:14 smithi131 bash[24745]: cluster 2024-09-14T05:08:13.262743+0000 mgr.a (mgr.14355) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:14 smithi171 bash[25040]: cluster 2024-09-14T05:08:13.262743+0000 mgr.a (mgr.14355) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:16.708 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:16 smithi007 bash[22722]: cluster 2024-09-14T05:08:15.264918+0000 mgr.a (mgr.14355) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:16.789 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:16 smithi131 bash[24745]: cluster 2024-09-14T05:08:15.264918+0000 mgr.a (mgr.14355) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:16 smithi171 bash[25040]: cluster 2024-09-14T05:08:15.264918+0000 mgr.a (mgr.14355) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:08:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:17.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:17.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:18.305 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:18.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:18 smithi007 bash[22722]: cluster 2024-09-14T05:08:17.265686+0000 mgr.a (mgr.14355) 17617 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:18 smithi131 bash[24745]: cluster 2024-09-14T05:08:17.265686+0000 mgr.a (mgr.14355) 17617 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:18 smithi171 bash[25040]: cluster 2024-09-14T05:08:17.265686+0000 mgr.a (mgr.14355) 17617 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:19 smithi007 bash[22722]: audit 2024-09-14T05:08:17.859274+0000 mgr.a (mgr.14355) 17618 : audit [DBG] from='client.378792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:19 smithi131 bash[24745]: audit 2024-09-14T05:08:17.859274+0000 mgr.a (mgr.14355) 17618 : audit [DBG] from='client.378792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:19 smithi171 bash[25040]: audit 2024-09-14T05:08:17.859274+0000 mgr.a (mgr.14355) 17618 : audit [DBG] from='client.378792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:20 smithi007 bash[22722]: cluster 2024-09-14T05:08:19.266666+0000 mgr.a (mgr.14355) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:20 smithi131 bash[24745]: cluster 2024-09-14T05:08:19.266666+0000 mgr.a (mgr.14355) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:20 smithi171 bash[25040]: cluster 2024-09-14T05:08:19.266666+0000 mgr.a (mgr.14355) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:22 smithi007 bash[22722]: cluster 2024-09-14T05:08:21.268896+0000 mgr.a (mgr.14355) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:22 smithi131 bash[24745]: cluster 2024-09-14T05:08:21.268896+0000 mgr.a (mgr.14355) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:22 smithi171 bash[25040]: cluster 2024-09-14T05:08:21.268896+0000 mgr.a (mgr.14355) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:23.307 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:23.308 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:24.055 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:24.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:24.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:24.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:24.056 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:24 smithi007 bash[22722]: cluster 2024-09-14T05:08:23.269668+0000 mgr.a (mgr.14355) 17621 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:24 smithi007 bash[22722]: audit 2024-09-14T05:08:23.639649+0000 mgr.a (mgr.14355) 17622 : audit [DBG] from='client.378867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:24 smithi131 bash[24745]: cluster 2024-09-14T05:08:23.269668+0000 mgr.a (mgr.14355) 17621 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:24 smithi131 bash[24745]: audit 2024-09-14T05:08:23.639649+0000 mgr.a (mgr.14355) 17622 : audit [DBG] from='client.378867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:24 smithi171 bash[25040]: cluster 2024-09-14T05:08:23.269668+0000 mgr.a (mgr.14355) 17621 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:24 smithi171 bash[25040]: audit 2024-09-14T05:08:23.639649+0000 mgr.a (mgr.14355) 17622 : audit [DBG] from='client.378867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:26 smithi007 bash[22722]: cluster 2024-09-14T05:08:25.271945+0000 mgr.a (mgr.14355) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:26 smithi131 bash[24745]: cluster 2024-09-14T05:08:25.271945+0000 mgr.a (mgr.14355) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:26 smithi171 bash[25040]: cluster 2024-09-14T05:08:25.271945+0000 mgr.a (mgr.14355) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:28 smithi007 bash[22722]: cluster 2024-09-14T05:08:27.272699+0000 mgr.a (mgr.14355) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:28 smithi131 bash[24745]: cluster 2024-09-14T05:08:27.272699+0000 mgr.a (mgr.14355) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:28 smithi171 bash[25040]: cluster 2024-09-14T05:08:27.272699+0000 mgr.a (mgr.14355) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:29.843 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:29.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:29.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:29.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:29.844 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:30 smithi007 bash[22722]: cluster 2024-09-14T05:08:29.273430+0000 mgr.a (mgr.14355) 17625 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:30.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:30 smithi007 bash[22722]: audit 2024-09-14T05:08:29.395208+0000 mgr.a (mgr.14355) 17626 : audit [DBG] from='client.378945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:30 smithi131 bash[24745]: cluster 2024-09-14T05:08:29.273430+0000 mgr.a (mgr.14355) 17625 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:30 smithi131 bash[24745]: audit 2024-09-14T05:08:29.395208+0000 mgr.a (mgr.14355) 17626 : audit [DBG] from='client.378945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:30 smithi171 bash[25040]: cluster 2024-09-14T05:08:29.273430+0000 mgr.a (mgr.14355) 17625 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:30 smithi171 bash[25040]: audit 2024-09-14T05:08:29.395208+0000 mgr.a (mgr.14355) 17626 : audit [DBG] from='client.378945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:32 smithi007 bash[22722]: cluster 2024-09-14T05:08:31.275790+0000 mgr.a (mgr.14355) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:32 smithi131 bash[24745]: cluster 2024-09-14T05:08:31.275790+0000 mgr.a (mgr.14355) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:32 smithi171 bash[25040]: cluster 2024-09-14T05:08:31.275790+0000 mgr.a (mgr.14355) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:34 smithi007 bash[22722]: cluster 2024-09-14T05:08:33.276566+0000 mgr.a (mgr.14355) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:34 smithi131 bash[24745]: cluster 2024-09-14T05:08:33.276566+0000 mgr.a (mgr.14355) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:34 smithi171 bash[25040]: cluster 2024-09-14T05:08:33.276566+0000 mgr.a (mgr.14355) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:34.845 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:34.846 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:35.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:35.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:35.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:35.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:35.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:36 smithi007 bash[22722]: audit 2024-09-14T05:08:35.184962+0000 mgr.a (mgr.14355) 17629 : audit [DBG] from='client.379023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:36.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:36 smithi007 bash[22722]: cluster 2024-09-14T05:08:35.277856+0000 mgr.a (mgr.14355) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:36 smithi131 bash[24745]: audit 2024-09-14T05:08:35.184962+0000 mgr.a (mgr.14355) 17629 : audit [DBG] from='client.379023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:36 smithi131 bash[24745]: cluster 2024-09-14T05:08:35.277856+0000 mgr.a (mgr.14355) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:36 smithi171 bash[25040]: audit 2024-09-14T05:08:35.184962+0000 mgr.a (mgr.14355) 17629 : audit [DBG] from='client.379023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:36 smithi171 bash[25040]: cluster 2024-09-14T05:08:35.277856+0000 mgr.a (mgr.14355) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:38 smithi007 bash[22722]: cluster 2024-09-14T05:08:37.278885+0000 mgr.a (mgr.14355) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:38 smithi131 bash[24745]: cluster 2024-09-14T05:08:37.278885+0000 mgr.a (mgr.14355) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:38 smithi171 bash[25040]: cluster 2024-09-14T05:08:37.278885+0000 mgr.a (mgr.14355) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:40.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:40.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:40 smithi007 bash[22722]: cluster 2024-09-14T05:08:39.279941+0000 mgr.a (mgr.14355) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:40 smithi131 bash[24745]: cluster 2024-09-14T05:08:39.279941+0000 mgr.a (mgr.14355) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:40 smithi171 bash[25040]: cluster 2024-09-14T05:08:39.279941+0000 mgr.a (mgr.14355) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:41.403 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:41.403 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:42 smithi007 bash[22722]: audit 2024-09-14T05:08:40.966423+0000 mgr.a (mgr.14355) 17633 : audit [DBG] from='client.379098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:42 smithi007 bash[22722]: cluster 2024-09-14T05:08:41.281372+0000 mgr.a (mgr.14355) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:42 smithi131 bash[24745]: audit 2024-09-14T05:08:40.966423+0000 mgr.a (mgr.14355) 17633 : audit [DBG] from='client.379098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:42 smithi131 bash[24745]: cluster 2024-09-14T05:08:41.281372+0000 mgr.a (mgr.14355) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:42 smithi171 bash[25040]: audit 2024-09-14T05:08:40.966423+0000 mgr.a (mgr.14355) 17633 : audit [DBG] from='client.379098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:42 smithi171 bash[25040]: cluster 2024-09-14T05:08:41.281372+0000 mgr.a (mgr.14355) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:44 smithi007 bash[22722]: cluster 2024-09-14T05:08:43.282205+0000 mgr.a (mgr.14355) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:44 smithi131 bash[24745]: cluster 2024-09-14T05:08:43.282205+0000 mgr.a (mgr.14355) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:44 smithi171 bash[25040]: cluster 2024-09-14T05:08:43.282205+0000 mgr.a (mgr.14355) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:08:46.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:46.405 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:46 smithi007 bash[22722]: cluster 2024-09-14T05:08:45.284358+0000 mgr.a (mgr.14355) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:46 smithi131 bash[24745]: cluster 2024-09-14T05:08:45.284358+0000 mgr.a (mgr.14355) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:46 smithi171 bash[25040]: cluster 2024-09-14T05:08:45.284358+0000 mgr.a (mgr.14355) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:47.184 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:47.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:47 smithi007 bash[22722]: audit 2024-09-14T05:08:46.737162+0000 mgr.a (mgr.14355) 17637 : audit [DBG] from='client.379170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:47 smithi131 bash[24745]: audit 2024-09-14T05:08:46.737162+0000 mgr.a (mgr.14355) 17637 : audit [DBG] from='client.379170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:47 smithi171 bash[25040]: audit 2024-09-14T05:08:46.737162+0000 mgr.a (mgr.14355) 17637 : audit [DBG] from='client.379170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:48 smithi007 bash[22722]: cluster 2024-09-14T05:08:47.285303+0000 mgr.a (mgr.14355) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:48 smithi131 bash[24745]: cluster 2024-09-14T05:08:47.285303+0000 mgr.a (mgr.14355) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:48 smithi171 bash[25040]: cluster 2024-09-14T05:08:47.285303+0000 mgr.a (mgr.14355) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:50 smithi007 bash[22722]: cluster 2024-09-14T05:08:49.286132+0000 mgr.a (mgr.14355) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:50 smithi131 bash[24745]: cluster 2024-09-14T05:08:49.286132+0000 mgr.a (mgr.14355) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:50 smithi171 bash[25040]: cluster 2024-09-14T05:08:49.286132+0000 mgr.a (mgr.14355) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:52.185 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:52.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:52.186 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:52.941 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:52.941 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:52 smithi007 bash[22722]: cluster 2024-09-14T05:08:51.288372+0000 mgr.a (mgr.14355) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:52 smithi131 bash[24745]: cluster 2024-09-14T05:08:51.288372+0000 mgr.a (mgr.14355) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:52 smithi171 bash[25040]: cluster 2024-09-14T05:08:51.288372+0000 mgr.a (mgr.14355) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:53 smithi007 bash[22722]: audit 2024-09-14T05:08:52.512464+0000 mgr.a (mgr.14355) 17641 : audit [DBG] from='client.379245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:53 smithi131 bash[24745]: audit 2024-09-14T05:08:52.512464+0000 mgr.a (mgr.14355) 17641 : audit [DBG] from='client.379245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:53 smithi171 bash[25040]: audit 2024-09-14T05:08:52.512464+0000 mgr.a (mgr.14355) 17641 : audit [DBG] from='client.379245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:08:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:54 smithi007 bash[22722]: cluster 2024-09-14T05:08:53.289285+0000 mgr.a (mgr.14355) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:54 smithi131 bash[24745]: cluster 2024-09-14T05:08:53.289285+0000 mgr.a (mgr.14355) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:54 smithi171 bash[25040]: cluster 2024-09-14T05:08:53.289285+0000 mgr.a (mgr.14355) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:56 smithi007 bash[22722]: cluster 2024-09-14T05:08:55.291464+0000 mgr.a (mgr.14355) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:56 smithi131 bash[24745]: cluster 2024-09-14T05:08:55.291464+0000 mgr.a (mgr.14355) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:56 smithi171 bash[25040]: cluster 2024-09-14T05:08:55.291464+0000 mgr.a (mgr.14355) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:08:57.942 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:08:58.720 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:08:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:08:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:08:58.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:08:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:08:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:58 smithi007 bash[22722]: cluster 2024-09-14T05:08:57.292240+0000 mgr.a (mgr.14355) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:58 smithi131 bash[24745]: cluster 2024-09-14T05:08:57.292240+0000 mgr.a (mgr.14355) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:58 smithi171 bash[25040]: cluster 2024-09-14T05:08:57.292240+0000 mgr.a (mgr.14355) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:08:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:08:59 smithi007 bash[22722]: audit 2024-09-14T05:08:58.272773+0000 mgr.a (mgr.14355) 17645 : audit [DBG] from='client.379323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:08:59 smithi131 bash[24745]: audit 2024-09-14T05:08:58.272773+0000 mgr.a (mgr.14355) 17645 : audit [DBG] from='client.379323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:08:59 smithi171 bash[25040]: audit 2024-09-14T05:08:58.272773+0000 mgr.a (mgr.14355) 17645 : audit [DBG] from='client.379323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:00 smithi007 bash[22722]: cluster 2024-09-14T05:08:59.293370+0000 mgr.a (mgr.14355) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:00 smithi131 bash[24745]: cluster 2024-09-14T05:08:59.293370+0000 mgr.a (mgr.14355) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:00 smithi171 bash[25040]: cluster 2024-09-14T05:08:59.293370+0000 mgr.a (mgr.14355) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:02 smithi007 bash[22722]: cluster 2024-09-14T05:09:01.295710+0000 mgr.a (mgr.14355) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:02 smithi131 bash[24745]: cluster 2024-09-14T05:09:01.295710+0000 mgr.a (mgr.14355) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:02 smithi171 bash[25040]: cluster 2024-09-14T05:09:01.295710+0000 mgr.a (mgr.14355) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:03.722 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:03.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:03.723 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:04.518 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:04 smithi007 bash[22722]: cluster 2024-09-14T05:09:03.296492+0000 mgr.a (mgr.14355) 17648 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:04 smithi007 bash[22722]: audit 2024-09-14T05:09:03.862611+0000 mon.a (mon.0) 3222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:09:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:04 smithi131 bash[24745]: cluster 2024-09-14T05:09:03.296492+0000 mgr.a (mgr.14355) 17648 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:04 smithi131 bash[24745]: audit 2024-09-14T05:09:03.862611+0000 mon.a (mon.0) 3222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:09:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:04 smithi171 bash[25040]: cluster 2024-09-14T05:09:03.296492+0000 mgr.a (mgr.14355) 17648 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:04 smithi171 bash[25040]: audit 2024-09-14T05:09:03.862611+0000 mon.a (mon.0) 3222 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22972]: debug 2024-09-14T05:09:05.417+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22972]: debug 2024-09-14T05:09:05.421+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.059955+0000 mgr.a (mgr.14355) 17649 : audit [DBG] from='client.379395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.669788+0000 mon.a (mon.0) 3223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.671684+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.680013+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:09:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.682225+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:05.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:05 smithi007 bash[22722]: audit 2024-09-14T05:09:04.684698+0000 mgr.a (mgr.14355) 17650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.059955+0000 mgr.a (mgr.14355) 17649 : audit [DBG] from='client.379395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.669788+0000 mon.a (mon.0) 3223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:09:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.671684+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:09:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.680013+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:09:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.682225+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:05 smithi131 bash[24745]: audit 2024-09-14T05:09:04.684698+0000 mgr.a (mgr.14355) 17650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.059955+0000 mgr.a (mgr.14355) 17649 : audit [DBG] from='client.379395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.669788+0000 mon.a (mon.0) 3223 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:09:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.671684+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:09:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.680013+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:09:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.682225+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:06.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:05 smithi171 bash[25040]: audit 2024-09-14T05:09:04.684698+0000 mgr.a (mgr.14355) 17650 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:09:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:06 smithi007 bash[22722]: cluster 2024-09-14T05:09:05.297558+0000 mgr.a (mgr.14355) 17651 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:06 smithi007 bash[22722]: audit 2024-09-14T05:09:05.422069+0000 mgr.a (mgr.14355) 17652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:09:06.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:06 smithi007 bash[22722]: cephadm 2024-09-14T05:09:05.423553+0000 mgr.a (mgr.14355) 17653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:09:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:06 smithi131 bash[24745]: cluster 2024-09-14T05:09:05.297558+0000 mgr.a (mgr.14355) 17651 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:06 smithi131 bash[24745]: audit 2024-09-14T05:09:05.422069+0000 mgr.a (mgr.14355) 17652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:09:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:06 smithi131 bash[24745]: cephadm 2024-09-14T05:09:05.423553+0000 mgr.a (mgr.14355) 17653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:09:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:06 smithi171 bash[25040]: cluster 2024-09-14T05:09:05.297558+0000 mgr.a (mgr.14355) 17651 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:06 smithi171 bash[25040]: audit 2024-09-14T05:09:05.422069+0000 mgr.a (mgr.14355) 17652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:09:07.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:06 smithi171 bash[25040]: cephadm 2024-09-14T05:09:05.423553+0000 mgr.a (mgr.14355) 17653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:09:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:08 smithi007 bash[22722]: cluster 2024-09-14T05:09:07.298290+0000 mgr.a (mgr.14355) 17654 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:08 smithi131 bash[24745]: cluster 2024-09-14T05:09:07.298290+0000 mgr.a (mgr.14355) 17654 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:08 smithi171 bash[25040]: cluster 2024-09-14T05:09:07.298290+0000 mgr.a (mgr.14355) 17654 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:10.304 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:10 smithi007 bash[22722]: cluster 2024-09-14T05:09:09.299247+0000 mgr.a (mgr.14355) 17655 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:10 smithi131 bash[24745]: cluster 2024-09-14T05:09:09.299247+0000 mgr.a (mgr.14355) 17655 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:10 smithi171 bash[25040]: cluster 2024-09-14T05:09:09.299247+0000 mgr.a (mgr.14355) 17655 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:09:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:11 smithi007 bash[22722]: audit 2024-09-14T05:09:09.858772+0000 mgr.a (mgr.14355) 17656 : audit [DBG] from='client.379575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:11 smithi131 bash[24745]: audit 2024-09-14T05:09:09.858772+0000 mgr.a (mgr.14355) 17656 : audit [DBG] from='client.379575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:11 smithi171 bash[25040]: audit 2024-09-14T05:09:09.858772+0000 mgr.a (mgr.14355) 17656 : audit [DBG] from='client.379575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:12 smithi007 bash[22722]: cluster 2024-09-14T05:09:11.301677+0000 mgr.a (mgr.14355) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:12 smithi131 bash[24745]: cluster 2024-09-14T05:09:11.301677+0000 mgr.a (mgr.14355) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:12 smithi171 bash[25040]: cluster 2024-09-14T05:09:11.301677+0000 mgr.a (mgr.14355) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:14 smithi131 bash[24745]: cluster 2024-09-14T05:09:13.302486+0000 mgr.a (mgr.14355) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:09:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:14 smithi171 bash[25040]: cluster 2024-09-14T05:09:13.302486+0000 mgr.a (mgr.14355) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:09:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:14 smithi007 bash[22722]: cluster 2024-09-14T05:09:13.302486+0000 mgr.a (mgr.14355) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:09:15.306 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:15.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:15.306 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:16.081 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:16.081 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:16 smithi131 bash[24745]: cluster 2024-09-14T05:09:15.304425+0000 mgr.a (mgr.14355) 17659 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:16 smithi131 bash[24745]: audit 2024-09-14T05:09:15.638330+0000 mgr.a (mgr.14355) 17660 : audit [DBG] from='client.379650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:16 smithi171 bash[25040]: cluster 2024-09-14T05:09:15.304425+0000 mgr.a (mgr.14355) 17659 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:16 smithi171 bash[25040]: audit 2024-09-14T05:09:15.638330+0000 mgr.a (mgr.14355) 17660 : audit [DBG] from='client.379650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:16 smithi007 bash[22722]: cluster 2024-09-14T05:09:15.304425+0000 mgr.a (mgr.14355) 17659 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:09:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:16 smithi007 bash[22722]: audit 2024-09-14T05:09:15.638330+0000 mgr.a (mgr.14355) 17660 : audit [DBG] from='client.379650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:18 smithi131 bash[24745]: cluster 2024-09-14T05:09:17.305453+0000 mgr.a (mgr.14355) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:18 smithi171 bash[25040]: cluster 2024-09-14T05:09:17.305453+0000 mgr.a (mgr.14355) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:18 smithi007 bash[22722]: cluster 2024-09-14T05:09:17.305453+0000 mgr.a (mgr.14355) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:20 smithi131 bash[24745]: cluster 2024-09-14T05:09:19.306473+0000 mgr.a (mgr.14355) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:20 smithi171 bash[25040]: cluster 2024-09-14T05:09:19.306473+0000 mgr.a (mgr.14355) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:21.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:21.083 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:21.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:20 smithi007 bash[22722]: cluster 2024-09-14T05:09:19.306473+0000 mgr.a (mgr.14355) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-14T05:09:21.830 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:21.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:21.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:21.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:21.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:22 smithi131 bash[24745]: cluster 2024-09-14T05:09:21.308661+0000 mgr.a (mgr.14355) 17663 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:09:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:22 smithi131 bash[24745]: audit 2024-09-14T05:09:21.409590+0000 mgr.a (mgr.14355) 17664 : audit [DBG] from='client.379728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:22 smithi171 bash[25040]: cluster 2024-09-14T05:09:21.308661+0000 mgr.a (mgr.14355) 17663 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:09:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:22 smithi171 bash[25040]: audit 2024-09-14T05:09:21.409590+0000 mgr.a (mgr.14355) 17664 : audit [DBG] from='client.379728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:22 smithi007 bash[22722]: cluster 2024-09-14T05:09:21.308661+0000 mgr.a (mgr.14355) 17663 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:09:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:22 smithi007 bash[22722]: audit 2024-09-14T05:09:21.409590+0000 mgr.a (mgr.14355) 17664 : audit [DBG] from='client.379728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:24 smithi131 bash[24745]: cluster 2024-09-14T05:09:23.309552+0000 mgr.a (mgr.14355) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:09:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:24 smithi171 bash[25040]: cluster 2024-09-14T05:09:23.309552+0000 mgr.a (mgr.14355) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:09:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:24 smithi007 bash[22722]: cluster 2024-09-14T05:09:23.309552+0000 mgr.a (mgr.14355) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:09:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:26 smithi131 bash[24745]: cluster 2024-09-14T05:09:25.311710+0000 mgr.a (mgr.14355) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:09:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:26 smithi171 bash[25040]: cluster 2024-09-14T05:09:25.311710+0000 mgr.a (mgr.14355) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:09:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:26 smithi007 bash[22722]: cluster 2024-09-14T05:09:25.311710+0000 mgr.a (mgr.14355) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:09:27.582 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:27.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:28 smithi131 bash[24745]: audit 2024-09-14T05:09:27.160555+0000 mgr.a (mgr.14355) 17667 : audit [DBG] from='client.379806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:28 smithi131 bash[24745]: cluster 2024-09-14T05:09:27.312459+0000 mgr.a (mgr.14355) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:28 smithi171 bash[25040]: audit 2024-09-14T05:09:27.160555+0000 mgr.a (mgr.14355) 17667 : audit [DBG] from='client.379806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:28 smithi171 bash[25040]: cluster 2024-09-14T05:09:27.312459+0000 mgr.a (mgr.14355) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:28 smithi007 bash[22722]: audit 2024-09-14T05:09:27.160555+0000 mgr.a (mgr.14355) 17667 : audit [DBG] from='client.379806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:28 smithi007 bash[22722]: cluster 2024-09-14T05:09:27.312459+0000 mgr.a (mgr.14355) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:30 smithi131 bash[24745]: cluster 2024-09-14T05:09:29.313324+0000 mgr.a (mgr.14355) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:30 smithi171 bash[25040]: cluster 2024-09-14T05:09:29.313324+0000 mgr.a (mgr.14355) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:30 smithi007 bash[22722]: cluster 2024-09-14T05:09:29.313324+0000 mgr.a (mgr.14355) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:32.584 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:32.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:32 smithi131 bash[24745]: cluster 2024-09-14T05:09:31.315596+0000 mgr.a (mgr.14355) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:32 smithi171 bash[25040]: cluster 2024-09-14T05:09:31.315596+0000 mgr.a (mgr.14355) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:32 smithi007 bash[22722]: cluster 2024-09-14T05:09:31.315596+0000 mgr.a (mgr.14355) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:33.374 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:33.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:33.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:34 smithi131 bash[24745]: audit 2024-09-14T05:09:32.916919+0000 mgr.a (mgr.14355) 17671 : audit [DBG] from='client.379884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:34 smithi131 bash[24745]: cluster 2024-09-14T05:09:33.316169+0000 mgr.a (mgr.14355) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:34 smithi171 bash[25040]: audit 2024-09-14T05:09:32.916919+0000 mgr.a (mgr.14355) 17671 : audit [DBG] from='client.379884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:34 smithi171 bash[25040]: cluster 2024-09-14T05:09:33.316169+0000 mgr.a (mgr.14355) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:34 smithi007 bash[22722]: audit 2024-09-14T05:09:32.916919+0000 mgr.a (mgr.14355) 17671 : audit [DBG] from='client.379884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:34 smithi007 bash[22722]: cluster 2024-09-14T05:09:33.316169+0000 mgr.a (mgr.14355) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:36 smithi131 bash[24745]: cluster 2024-09-14T05:09:35.318274+0000 mgr.a (mgr.14355) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:36 smithi171 bash[25040]: cluster 2024-09-14T05:09:35.318274+0000 mgr.a (mgr.14355) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:36 smithi007 bash[22722]: cluster 2024-09-14T05:09:35.318274+0000 mgr.a (mgr.14355) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:38 smithi131 bash[24745]: cluster 2024-09-14T05:09:37.319060+0000 mgr.a (mgr.14355) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:38 smithi171 bash[25040]: cluster 2024-09-14T05:09:37.319060+0000 mgr.a (mgr.14355) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:39.162 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:39.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:39.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:38 smithi007 bash[22722]: cluster 2024-09-14T05:09:37.319060+0000 mgr.a (mgr.14355) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:39 smithi131 bash[24745]: audit 2024-09-14T05:09:38.717730+0000 mgr.a (mgr.14355) 17675 : audit [DBG] from='client.379962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:39 smithi171 bash[25040]: audit 2024-09-14T05:09:38.717730+0000 mgr.a (mgr.14355) 17675 : audit [DBG] from='client.379962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:39 smithi007 bash[22722]: audit 2024-09-14T05:09:38.717730+0000 mgr.a (mgr.14355) 17675 : audit [DBG] from='client.379962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:40 smithi131 bash[24745]: cluster 2024-09-14T05:09:39.320173+0000 mgr.a (mgr.14355) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:40 smithi171 bash[25040]: cluster 2024-09-14T05:09:39.320173+0000 mgr.a (mgr.14355) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:40 smithi007 bash[22722]: cluster 2024-09-14T05:09:39.320173+0000 mgr.a (mgr.14355) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:42 smithi131 bash[24745]: cluster 2024-09-14T05:09:41.322639+0000 mgr.a (mgr.14355) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:42 smithi171 bash[25040]: cluster 2024-09-14T05:09:41.322639+0000 mgr.a (mgr.14355) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:42 smithi007 bash[22722]: cluster 2024-09-14T05:09:41.322639+0000 mgr.a (mgr.14355) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:43 smithi131 bash[24745]: cluster 2024-09-14T05:09:43.323598+0000 mgr.a (mgr.14355) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:43 smithi171 bash[25040]: cluster 2024-09-14T05:09:43.323598+0000 mgr.a (mgr.14355) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:44.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:44.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:43 smithi007 bash[22722]: cluster 2024-09-14T05:09:43.323598+0000 mgr.a (mgr.14355) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:44.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:44.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:44.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:44.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:44.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:44 smithi131 bash[24745]: audit 2024-09-14T05:09:44.505374+0000 mgr.a (mgr.14355) 17679 : audit [DBG] from='client.380037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:44 smithi171 bash[25040]: audit 2024-09-14T05:09:44.505374+0000 mgr.a (mgr.14355) 17679 : audit [DBG] from='client.380037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:44 smithi007 bash[22722]: audit 2024-09-14T05:09:44.505374+0000 mgr.a (mgr.14355) 17679 : audit [DBG] from='client.380037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:45 smithi131 bash[24745]: cluster 2024-09-14T05:09:45.325874+0000 mgr.a (mgr.14355) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:45 smithi171 bash[25040]: cluster 2024-09-14T05:09:45.325874+0000 mgr.a (mgr.14355) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:45 smithi007 bash[22722]: cluster 2024-09-14T05:09:45.325874+0000 mgr.a (mgr.14355) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:09:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:48 smithi007 bash[22722]: cluster 2024-09-14T05:09:47.326671+0000 mgr.a (mgr.14355) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:48 smithi131 bash[24745]: cluster 2024-09-14T05:09:47.326671+0000 mgr.a (mgr.14355) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:48 smithi171 bash[25040]: cluster 2024-09-14T05:09:47.326671+0000 mgr.a (mgr.14355) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:49.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:49.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:50 smithi007 bash[22722]: cluster 2024-09-14T05:09:49.327432+0000 mgr.a (mgr.14355) 17682 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:50.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:50.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:50.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:50.713 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:50 smithi131 bash[24745]: cluster 2024-09-14T05:09:49.327432+0000 mgr.a (mgr.14355) 17682 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:50 smithi171 bash[25040]: cluster 2024-09-14T05:09:49.327432+0000 mgr.a (mgr.14355) 17682 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:51 smithi007 bash[22722]: audit 2024-09-14T05:09:50.283856+0000 mgr.a (mgr.14355) 17683 : audit [DBG] from='client.380115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:51 smithi131 bash[24745]: audit 2024-09-14T05:09:50.283856+0000 mgr.a (mgr.14355) 17683 : audit [DBG] from='client.380115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:51 smithi171 bash[25040]: audit 2024-09-14T05:09:50.283856+0000 mgr.a (mgr.14355) 17683 : audit [DBG] from='client.380115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:52 smithi007 bash[22722]: cluster 2024-09-14T05:09:51.330145+0000 mgr.a (mgr.14355) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:52 smithi131 bash[24745]: cluster 2024-09-14T05:09:51.330145+0000 mgr.a (mgr.14355) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:52 smithi171 bash[25040]: cluster 2024-09-14T05:09:51.330145+0000 mgr.a (mgr.14355) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:54 smithi007 bash[22722]: cluster 2024-09-14T05:09:53.330920+0000 mgr.a (mgr.14355) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:09:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:54 smithi131 bash[24745]: cluster 2024-09-14T05:09:53.330920+0000 mgr.a (mgr.14355) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:09:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:54 smithi171 bash[25040]: cluster 2024-09-14T05:09:53.330920+0000 mgr.a (mgr.14355) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:09:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:09:55.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:09:55.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:09:56.490 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:09:56.490 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:09:56.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:09:56.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:09:56.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:09:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:56 smithi007 bash[22722]: cluster 2024-09-14T05:09:55.332821+0000 mgr.a (mgr.14355) 17686 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:56 smithi131 bash[24745]: cluster 2024-09-14T05:09:55.332821+0000 mgr.a (mgr.14355) 17686 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:56 smithi171 bash[25040]: cluster 2024-09-14T05:09:55.332821+0000 mgr.a (mgr.14355) 17686 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:09:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:57 smithi007 bash[22722]: audit 2024-09-14T05:09:56.051225+0000 mgr.a (mgr.14355) 17687 : audit [DBG] from='client.380190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:57 smithi131 bash[24745]: audit 2024-09-14T05:09:56.051225+0000 mgr.a (mgr.14355) 17687 : audit [DBG] from='client.380190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:57 smithi171 bash[25040]: audit 2024-09-14T05:09:56.051225+0000 mgr.a (mgr.14355) 17687 : audit [DBG] from='client.380190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:09:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:09:58 smithi007 bash[22722]: cluster 2024-09-14T05:09:57.333685+0000 mgr.a (mgr.14355) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:09:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:09:58 smithi131 bash[24745]: cluster 2024-09-14T05:09:57.333685+0000 mgr.a (mgr.14355) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:09:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:09:58 smithi171 bash[25040]: cluster 2024-09-14T05:09:57.333685+0000 mgr.a (mgr.14355) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:10:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:00 smithi007 bash[22722]: cluster 2024-09-14T05:09:59.334501+0000 mgr.a (mgr.14355) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:10:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:00 smithi007 bash[22722]: cluster 2024-09-14T05:10:00.000146+0000 mon.a (mon.0) 3227 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:10:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:00 smithi131 bash[24745]: cluster 2024-09-14T05:09:59.334501+0000 mgr.a (mgr.14355) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:10:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:00 smithi131 bash[24745]: cluster 2024-09-14T05:10:00.000146+0000 mon.a (mon.0) 3227 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:10:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:00 smithi171 bash[25040]: cluster 2024-09-14T05:09:59.334501+0000 mgr.a (mgr.14355) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:10:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:00 smithi171 bash[25040]: cluster 2024-09-14T05:10:00.000146+0000 mon.a (mon.0) 3227 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:10:01.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:01.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:01.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:02.258 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:02 smithi007 bash[22722]: cluster 2024-09-14T05:10:01.336733+0000 mgr.a (mgr.14355) 17690 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:02 smithi131 bash[24745]: cluster 2024-09-14T05:10:01.336733+0000 mgr.a (mgr.14355) 17690 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:02 smithi171 bash[25040]: cluster 2024-09-14T05:10:01.336733+0000 mgr.a (mgr.14355) 17690 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:03 smithi007 bash[22722]: audit 2024-09-14T05:10:01.823967+0000 mgr.a (mgr.14355) 17691 : audit [DBG] from='client.380268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:03 smithi131 bash[24745]: audit 2024-09-14T05:10:01.823967+0000 mgr.a (mgr.14355) 17691 : audit [DBG] from='client.380268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:03 smithi171 bash[25040]: audit 2024-09-14T05:10:01.823967+0000 mgr.a (mgr.14355) 17691 : audit [DBG] from='client.380268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:04 smithi007 bash[22722]: cluster 2024-09-14T05:10:03.337637+0000 mgr.a (mgr.14355) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:04 smithi131 bash[24745]: cluster 2024-09-14T05:10:03.337637+0000 mgr.a (mgr.14355) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:04 smithi171 bash[25040]: cluster 2024-09-14T05:10:03.337637+0000 mgr.a (mgr.14355) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: cluster 2024-09-14T05:10:05.339807+0000 mgr.a (mgr.14355) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: audit 2024-09-14T05:10:05.476878+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:10:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: audit 2024-09-14T05:10:06.317803+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:10:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: audit 2024-09-14T05:10:06.319115+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:10:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: audit 2024-09-14T05:10:06.328641+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:10:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:06 smithi007 bash[22722]: audit 2024-09-14T05:10:06.333501+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: cluster 2024-09-14T05:10:05.339807+0000 mgr.a (mgr.14355) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: audit 2024-09-14T05:10:05.476878+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:10:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: audit 2024-09-14T05:10:06.317803+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:10:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: audit 2024-09-14T05:10:06.319115+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:10:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: audit 2024-09-14T05:10:06.328641+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:10:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:06 smithi131 bash[24745]: audit 2024-09-14T05:10:06.333501+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: cluster 2024-09-14T05:10:05.339807+0000 mgr.a (mgr.14355) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: audit 2024-09-14T05:10:05.476878+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:10:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: audit 2024-09-14T05:10:06.317803+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:10:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: audit 2024-09-14T05:10:06.319115+0000 mon.a (mon.0) 3230 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:10:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: audit 2024-09-14T05:10:06.328641+0000 mon.a (mon.0) 3231 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:10:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:06 smithi171 bash[25040]: audit 2024-09-14T05:10:06.333501+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:07.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:07.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:07.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:07.450 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:10:07 smithi007 bash[22972]: debug 2024-09-14T05:10:07.088+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:10:07.450 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:10:07 smithi007 bash[22972]: debug 2024-09-14T05:10:07.092+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:10:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:07 smithi007 bash[22722]: audit 2024-09-14T05:10:06.335776+0000 mgr.a (mgr.14355) 17694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:07 smithi131 bash[24745]: audit 2024-09-14T05:10:06.335776+0000 mgr.a (mgr.14355) 17694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:07 smithi171 bash[25040]: audit 2024-09-14T05:10:06.335776+0000 mgr.a (mgr.14355) 17694 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:10:08.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:08.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:08 smithi007 bash[22722]: audit 2024-09-14T05:10:07.093973+0000 mgr.a (mgr.14355) 17695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:10:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:08 smithi007 bash[22722]: cephadm 2024-09-14T05:10:07.095501+0000 mgr.a (mgr.14355) 17696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:10:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:08 smithi007 bash[22722]: cluster 2024-09-14T05:10:07.340295+0000 mgr.a (mgr.14355) 17697 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:08.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:08 smithi007 bash[22722]: audit 2024-09-14T05:10:07.595729+0000 mgr.a (mgr.14355) 17698 : audit [DBG] from='client.380442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:08 smithi131 bash[24745]: audit 2024-09-14T05:10:07.093973+0000 mgr.a (mgr.14355) 17695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:10:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:08 smithi131 bash[24745]: cephadm 2024-09-14T05:10:07.095501+0000 mgr.a (mgr.14355) 17696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:10:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:08 smithi131 bash[24745]: cluster 2024-09-14T05:10:07.340295+0000 mgr.a (mgr.14355) 17697 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:08 smithi131 bash[24745]: audit 2024-09-14T05:10:07.595729+0000 mgr.a (mgr.14355) 17698 : audit [DBG] from='client.380442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:08 smithi171 bash[25040]: audit 2024-09-14T05:10:07.093973+0000 mgr.a (mgr.14355) 17695 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:10:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:08 smithi171 bash[25040]: cephadm 2024-09-14T05:10:07.095501+0000 mgr.a (mgr.14355) 17696 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:10:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:08 smithi171 bash[25040]: cluster 2024-09-14T05:10:07.340295+0000 mgr.a (mgr.14355) 17697 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:08 smithi171 bash[25040]: audit 2024-09-14T05:10:07.595729+0000 mgr.a (mgr.14355) 17698 : audit [DBG] from='client.380442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:10 smithi131 bash[24745]: cluster 2024-09-14T05:10:09.341221+0000 mgr.a (mgr.14355) 17699 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:10 smithi171 bash[25040]: cluster 2024-09-14T05:10:09.341221+0000 mgr.a (mgr.14355) 17699 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:10 smithi007 bash[22722]: cluster 2024-09-14T05:10:09.341221+0000 mgr.a (mgr.14355) 17699 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:12 smithi131 bash[24745]: cluster 2024-09-14T05:10:11.343474+0000 mgr.a (mgr.14355) 17700 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:12 smithi171 bash[25040]: cluster 2024-09-14T05:10:11.343474+0000 mgr.a (mgr.14355) 17700 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:12 smithi007 bash[22722]: cluster 2024-09-14T05:10:11.343474+0000 mgr.a (mgr.14355) 17700 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:13.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:13.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:13.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:13.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:13.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:13.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:13.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:14 smithi131 bash[24745]: cluster 2024-09-14T05:10:13.344213+0000 mgr.a (mgr.14355) 17701 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:14 smithi131 bash[24745]: audit 2024-09-14T05:10:13.356271+0000 mgr.a (mgr.14355) 17702 : audit [DBG] from='client.380520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:14 smithi171 bash[25040]: cluster 2024-09-14T05:10:13.344213+0000 mgr.a (mgr.14355) 17701 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:14 smithi171 bash[25040]: audit 2024-09-14T05:10:13.356271+0000 mgr.a (mgr.14355) 17702 : audit [DBG] from='client.380520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:14 smithi007 bash[22722]: cluster 2024-09-14T05:10:13.344213+0000 mgr.a (mgr.14355) 17701 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:14 smithi007 bash[22722]: audit 2024-09-14T05:10:13.356271+0000 mgr.a (mgr.14355) 17702 : audit [DBG] from='client.380520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:16 smithi131 bash[24745]: cluster 2024-09-14T05:10:15.346509+0000 mgr.a (mgr.14355) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:16 smithi171 bash[25040]: cluster 2024-09-14T05:10:15.346509+0000 mgr.a (mgr.14355) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:16 smithi007 bash[22722]: cluster 2024-09-14T05:10:15.346509+0000 mgr.a (mgr.14355) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:18 smithi131 bash[24745]: cluster 2024-09-14T05:10:17.347282+0000 mgr.a (mgr.14355) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:18 smithi171 bash[25040]: cluster 2024-09-14T05:10:17.347282+0000 mgr.a (mgr.14355) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:18.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:18 smithi007 bash[22722]: cluster 2024-09-14T05:10:17.347282+0000 mgr.a (mgr.14355) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:19.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:19.556 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:19.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:20 smithi131 bash[24745]: audit 2024-09-14T05:10:19.138851+0000 mgr.a (mgr.14355) 17705 : audit [DBG] from='client.380595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:20 smithi131 bash[24745]: cluster 2024-09-14T05:10:19.347780+0000 mgr.a (mgr.14355) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:20 smithi171 bash[25040]: audit 2024-09-14T05:10:19.138851+0000 mgr.a (mgr.14355) 17705 : audit [DBG] from='client.380595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:20 smithi171 bash[25040]: cluster 2024-09-14T05:10:19.347780+0000 mgr.a (mgr.14355) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:20 smithi007 bash[22722]: audit 2024-09-14T05:10:19.138851+0000 mgr.a (mgr.14355) 17705 : audit [DBG] from='client.380595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:20 smithi007 bash[22722]: cluster 2024-09-14T05:10:19.347780+0000 mgr.a (mgr.14355) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:22 smithi131 bash[24745]: cluster 2024-09-14T05:10:21.350236+0000 mgr.a (mgr.14355) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:22 smithi171 bash[25040]: cluster 2024-09-14T05:10:21.350236+0000 mgr.a (mgr.14355) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:22.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:22 smithi007 bash[22722]: cluster 2024-09-14T05:10:21.350236+0000 mgr.a (mgr.14355) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:10:24.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:24 smithi131 bash[24745]: cluster 2024-09-14T05:10:23.351062+0000 mgr.a (mgr.14355) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:24 smithi171 bash[25040]: cluster 2024-09-14T05:10:23.351062+0000 mgr.a (mgr.14355) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:24 smithi007 bash[22722]: cluster 2024-09-14T05:10:23.351062+0000 mgr.a (mgr.14355) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:25.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:25.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:25.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:25.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:25.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:26 smithi131 bash[24745]: audit 2024-09-14T05:10:24.898590+0000 mgr.a (mgr.14355) 17709 : audit [DBG] from='client.380670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:26 smithi131 bash[24745]: cluster 2024-09-14T05:10:25.352175+0000 mgr.a (mgr.14355) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:10:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:26 smithi171 bash[25040]: audit 2024-09-14T05:10:24.898590+0000 mgr.a (mgr.14355) 17709 : audit [DBG] from='client.380670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:26 smithi171 bash[25040]: cluster 2024-09-14T05:10:25.352175+0000 mgr.a (mgr.14355) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:10:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:26 smithi007 bash[22722]: audit 2024-09-14T05:10:24.898590+0000 mgr.a (mgr.14355) 17709 : audit [DBG] from='client.380670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:26.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:26 smithi007 bash[22722]: cluster 2024-09-14T05:10:25.352175+0000 mgr.a (mgr.14355) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:10:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:28 smithi131 bash[24745]: cluster 2024-09-14T05:10:27.352894+0000 mgr.a (mgr.14355) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:28 smithi171 bash[25040]: cluster 2024-09-14T05:10:27.352894+0000 mgr.a (mgr.14355) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:28 smithi007 bash[22722]: cluster 2024-09-14T05:10:27.352894+0000 mgr.a (mgr.14355) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:30.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:30 smithi131 bash[24745]: cluster 2024-09-14T05:10:29.353663+0000 mgr.a (mgr.14355) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:30 smithi171 bash[25040]: cluster 2024-09-14T05:10:29.353663+0000 mgr.a (mgr.14355) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:30 smithi007 bash[22722]: cluster 2024-09-14T05:10:29.353663+0000 mgr.a (mgr.14355) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:10:31.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:31.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:31 smithi131 bash[24745]: audit 2024-09-14T05:10:30.671121+0000 mgr.a (mgr.14355) 17713 : audit [DBG] from='client.380748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:31 smithi171 bash[25040]: audit 2024-09-14T05:10:30.671121+0000 mgr.a (mgr.14355) 17713 : audit [DBG] from='client.380748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:31 smithi007 bash[22722]: audit 2024-09-14T05:10:30.671121+0000 mgr.a (mgr.14355) 17713 : audit [DBG] from='client.380748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:32 smithi131 bash[24745]: cluster 2024-09-14T05:10:31.356430+0000 mgr.a (mgr.14355) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:32 smithi171 bash[25040]: cluster 2024-09-14T05:10:31.356430+0000 mgr.a (mgr.14355) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:32 smithi007 bash[22722]: cluster 2024-09-14T05:10:31.356430+0000 mgr.a (mgr.14355) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:34 smithi131 bash[24745]: cluster 2024-09-14T05:10:33.357388+0000 mgr.a (mgr.14355) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:10:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:34 smithi171 bash[25040]: cluster 2024-09-14T05:10:33.357388+0000 mgr.a (mgr.14355) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:10:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:34 smithi007 bash[22722]: cluster 2024-09-14T05:10:33.357388+0000 mgr.a (mgr.14355) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:10:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:36.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:36 smithi131 bash[24745]: cluster 2024-09-14T05:10:35.359343+0000 mgr.a (mgr.14355) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:36 smithi171 bash[25040]: cluster 2024-09-14T05:10:35.359343+0000 mgr.a (mgr.14355) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:36.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:36.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:36.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:36.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:36.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:36 smithi007 bash[22722]: cluster 2024-09-14T05:10:35.359343+0000 mgr.a (mgr.14355) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:37 smithi131 bash[24745]: audit 2024-09-14T05:10:36.416130+0000 mgr.a (mgr.14355) 17717 : audit [DBG] from='client.380820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:37 smithi171 bash[25040]: audit 2024-09-14T05:10:36.416130+0000 mgr.a (mgr.14355) 17717 : audit [DBG] from='client.380820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:37 smithi007 bash[22722]: audit 2024-09-14T05:10:36.416130+0000 mgr.a (mgr.14355) 17717 : audit [DBG] from='client.380820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:38 smithi131 bash[24745]: cluster 2024-09-14T05:10:37.360281+0000 mgr.a (mgr.14355) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:38 smithi171 bash[25040]: cluster 2024-09-14T05:10:37.360281+0000 mgr.a (mgr.14355) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:38 smithi007 bash[22722]: cluster 2024-09-14T05:10:37.360281+0000 mgr.a (mgr.14355) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:40 smithi131 bash[24745]: cluster 2024-09-14T05:10:39.361067+0000 mgr.a (mgr.14355) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:40 smithi171 bash[25040]: cluster 2024-09-14T05:10:39.361067+0000 mgr.a (mgr.14355) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:40 smithi007 bash[22722]: cluster 2024-09-14T05:10:39.361067+0000 mgr.a (mgr.14355) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:10:41.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:41.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:42.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:42 smithi171 bash[25040]: cluster 2024-09-14T05:10:41.363338+0000 mgr.a (mgr.14355) 17720 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:10:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:42 smithi007 bash[22722]: cluster 2024-09-14T05:10:41.363338+0000 mgr.a (mgr.14355) 17720 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:10:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:42 smithi131 bash[24745]: cluster 2024-09-14T05:10:41.363338+0000 mgr.a (mgr.14355) 17720 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:10:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:43 smithi171 bash[25040]: audit 2024-09-14T05:10:42.186130+0000 mgr.a (mgr.14355) 17721 : audit [DBG] from='client.380898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:43 smithi007 bash[22722]: audit 2024-09-14T05:10:42.186130+0000 mgr.a (mgr.14355) 17721 : audit [DBG] from='client.380898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:43 smithi131 bash[24745]: audit 2024-09-14T05:10:42.186130+0000 mgr.a (mgr.14355) 17721 : audit [DBG] from='client.380898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:44 smithi007 bash[22722]: cluster 2024-09-14T05:10:43.364447+0000 mgr.a (mgr.14355) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:44 smithi131 bash[24745]: cluster 2024-09-14T05:10:43.364447+0000 mgr.a (mgr.14355) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:44 smithi171 bash[25040]: cluster 2024-09-14T05:10:43.364447+0000 mgr.a (mgr.14355) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:46 smithi007 bash[22722]: cluster 2024-09-14T05:10:45.366686+0000 mgr.a (mgr.14355) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:46 smithi131 bash[24745]: cluster 2024-09-14T05:10:45.366686+0000 mgr.a (mgr.14355) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:46 smithi171 bash[25040]: cluster 2024-09-14T05:10:45.366686+0000 mgr.a (mgr.14355) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:47.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:48.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:48.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:48 smithi007 bash[22722]: cluster 2024-09-14T05:10:47.367428+0000 mgr.a (mgr.14355) 17724 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:48 smithi131 bash[24745]: cluster 2024-09-14T05:10:47.367428+0000 mgr.a (mgr.14355) 17724 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:48 smithi171 bash[25040]: cluster 2024-09-14T05:10:47.367428+0000 mgr.a (mgr.14355) 17724 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:49 smithi007 bash[22722]: audit 2024-09-14T05:10:47.966017+0000 mgr.a (mgr.14355) 17725 : audit [DBG] from='client.380973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:49 smithi131 bash[24745]: audit 2024-09-14T05:10:47.966017+0000 mgr.a (mgr.14355) 17725 : audit [DBG] from='client.380973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:49 smithi171 bash[25040]: audit 2024-09-14T05:10:47.966017+0000 mgr.a (mgr.14355) 17725 : audit [DBG] from='client.380973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:50 smithi007 bash[22722]: cluster 2024-09-14T05:10:49.368391+0000 mgr.a (mgr.14355) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:50 smithi131 bash[24745]: cluster 2024-09-14T05:10:49.368391+0000 mgr.a (mgr.14355) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:50 smithi171 bash[25040]: cluster 2024-09-14T05:10:49.368391+0000 mgr.a (mgr.14355) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:52 smithi007 bash[22722]: cluster 2024-09-14T05:10:51.370698+0000 mgr.a (mgr.14355) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:52 smithi131 bash[24745]: cluster 2024-09-14T05:10:51.370698+0000 mgr.a (mgr.14355) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:52 smithi171 bash[25040]: cluster 2024-09-14T05:10:51.370698+0000 mgr.a (mgr.14355) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:53.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:53.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:53.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:54.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:54.182 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:54.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:10:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:54 smithi007 bash[22722]: cluster 2024-09-14T05:10:53.371478+0000 mgr.a (mgr.14355) 17728 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:54 smithi007 bash[22722]: audit 2024-09-14T05:10:53.744858+0000 mgr.a (mgr.14355) 17729 : audit [DBG] from='client.381051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:54 smithi131 bash[24745]: cluster 2024-09-14T05:10:53.371478+0000 mgr.a (mgr.14355) 17728 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:54 smithi131 bash[24745]: audit 2024-09-14T05:10:53.744858+0000 mgr.a (mgr.14355) 17729 : audit [DBG] from='client.381051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:54 smithi171 bash[25040]: cluster 2024-09-14T05:10:53.371478+0000 mgr.a (mgr.14355) 17728 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:54 smithi171 bash[25040]: audit 2024-09-14T05:10:53.744858+0000 mgr.a (mgr.14355) 17729 : audit [DBG] from='client.381051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:10:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:56 smithi007 bash[22722]: cluster 2024-09-14T05:10:55.373773+0000 mgr.a (mgr.14355) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:56 smithi131 bash[24745]: cluster 2024-09-14T05:10:55.373773+0000 mgr.a (mgr.14355) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:56 smithi171 bash[25040]: cluster 2024-09-14T05:10:55.373773+0000 mgr.a (mgr.14355) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:10:58.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:10:58 smithi007 bash[22722]: cluster 2024-09-14T05:10:57.374596+0000 mgr.a (mgr.14355) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:10:58 smithi131 bash[24745]: cluster 2024-09-14T05:10:57.374596+0000 mgr.a (mgr.14355) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:10:58 smithi171 bash[25040]: cluster 2024-09-14T05:10:57.374596+0000 mgr.a (mgr.14355) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:10:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:10:59.184 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:10:59.185 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:10:59.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:10:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:10:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:10:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:10:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:00 smithi007 bash[22722]: cluster 2024-09-14T05:10:59.375335+0000 mgr.a (mgr.14355) 17732 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:00 smithi007 bash[22722]: audit 2024-09-14T05:10:59.520038+0000 mgr.a (mgr.14355) 17733 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:00 smithi131 bash[24745]: cluster 2024-09-14T05:10:59.375335+0000 mgr.a (mgr.14355) 17732 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:00 smithi131 bash[24745]: audit 2024-09-14T05:10:59.520038+0000 mgr.a (mgr.14355) 17733 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:00 smithi171 bash[25040]: cluster 2024-09-14T05:10:59.375335+0000 mgr.a (mgr.14355) 17732 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:00 smithi171 bash[25040]: audit 2024-09-14T05:10:59.520038+0000 mgr.a (mgr.14355) 17733 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:02 smithi007 bash[22722]: cluster 2024-09-14T05:11:01.377754+0000 mgr.a (mgr.14355) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:02 smithi131 bash[24745]: cluster 2024-09-14T05:11:01.377754+0000 mgr.a (mgr.14355) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:02 smithi171 bash[25040]: cluster 2024-09-14T05:11:01.377754+0000 mgr.a (mgr.14355) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:04 smithi007 bash[22722]: cluster 2024-09-14T05:11:03.378584+0000 mgr.a (mgr.14355) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:04.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:04.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:04.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:04 smithi131 bash[24745]: cluster 2024-09-14T05:11:03.378584+0000 mgr.a (mgr.14355) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:04 smithi171 bash[25040]: cluster 2024-09-14T05:11:03.378584+0000 mgr.a (mgr.14355) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:05.742 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:05.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:05.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:06 smithi007 bash[22722]: audit 2024-09-14T05:11:05.309357+0000 mgr.a (mgr.14355) 17736 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:06 smithi007 bash[22722]: cluster 2024-09-14T05:11:05.379920+0000 mgr.a (mgr.14355) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:06 smithi131 bash[24745]: audit 2024-09-14T05:11:05.309357+0000 mgr.a (mgr.14355) 17736 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:06 smithi131 bash[24745]: cluster 2024-09-14T05:11:05.379920+0000 mgr.a (mgr.14355) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:06 smithi171 bash[25040]: audit 2024-09-14T05:11:05.309357+0000 mgr.a (mgr.14355) 17736 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:06 smithi171 bash[25040]: cluster 2024-09-14T05:11:05.379920+0000 mgr.a (mgr.14355) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:07 smithi007 bash[22722]: audit 2024-09-14T05:11:07.152967+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:11:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:07 smithi131 bash[24745]: audit 2024-09-14T05:11:07.152967+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:11:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:07 smithi171 bash[25040]: audit 2024-09-14T05:11:07.152967+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:11:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:08 smithi007 bash[22722]: cluster 2024-09-14T05:11:07.380758+0000 mgr.a (mgr.14355) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:08 smithi131 bash[24745]: cluster 2024-09-14T05:11:07.380758+0000 mgr.a (mgr.14355) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:08 smithi171 bash[25040]: cluster 2024-09-14T05:11:07.380758+0000 mgr.a (mgr.14355) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:10.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:10 smithi007 bash[22722]: cluster 2024-09-14T05:11:09.381542+0000 mgr.a (mgr.14355) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:10 smithi131 bash[24745]: cluster 2024-09-14T05:11:09.381542+0000 mgr.a (mgr.14355) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:10 smithi171 bash[25040]: cluster 2024-09-14T05:11:09.381542+0000 mgr.a (mgr.14355) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:11.487 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:11.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:11.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:11.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:11.488 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:11.069350+0000 mgr.a (mgr.14355) 17740 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: cluster 2024-09-14T05:11:11.390758+0000 mgr.a (mgr.14355) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.500369+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.502927+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.508335+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.513667+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.543195+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:12.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:12 smithi007 bash[22722]: audit 2024-09-14T05:11:12.550483+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:11.069350+0000 mgr.a (mgr.14355) 17740 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: cluster 2024-09-14T05:11:11.390758+0000 mgr.a (mgr.14355) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.500369+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.502927+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.508335+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.513667+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.543195+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:12 smithi131 bash[24745]: audit 2024-09-14T05:11:12.550483+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:11.069350+0000 mgr.a (mgr.14355) 17740 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: cluster 2024-09-14T05:11:11.390758+0000 mgr.a (mgr.14355) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.500369+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.502927+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.508335+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.513667+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.543195+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:12 smithi171 bash[25040]: audit 2024-09-14T05:11:12.550483+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:13 smithi007 bash[22722]: audit 2024-09-14T05:11:13.260429+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:13 smithi007 bash[22722]: audit 2024-09-14T05:11:13.262339+0000 mon.a (mon.0) 3241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:13 smithi007 bash[22722]: audit 2024-09-14T05:11:13.272937+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:13 smithi007 bash[22722]: audit 2024-09-14T05:11:13.277684+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:13 smithi131 bash[24745]: audit 2024-09-14T05:11:13.260429+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:11:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:13 smithi131 bash[24745]: audit 2024-09-14T05:11:13.262339+0000 mon.a (mon.0) 3241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:11:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:13 smithi131 bash[24745]: audit 2024-09-14T05:11:13.272937+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:13 smithi131 bash[24745]: audit 2024-09-14T05:11:13.277684+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:13 smithi171 bash[25040]: audit 2024-09-14T05:11:13.260429+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:13 smithi171 bash[25040]: audit 2024-09-14T05:11:13.262339+0000 mon.a (mon.0) 3241 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:13 smithi171 bash[25040]: audit 2024-09-14T05:11:13.272937+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:13 smithi171 bash[25040]: audit 2024-09-14T05:11:13.277684+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:14.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:11:14 smithi007 bash[22972]: debug 2024-09-14T05:11:14.031+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:11:14.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:11:14 smithi007 bash[22972]: debug 2024-09-14T05:11:14.035+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:11:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:14 smithi007 bash[22722]: audit 2024-09-14T05:11:13.280087+0000 mgr.a (mgr.14355) 17742 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:14.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:14 smithi007 bash[22722]: cluster 2024-09-14T05:11:13.391389+0000 mgr.a (mgr.14355) 17743 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:14 smithi131 bash[24745]: audit 2024-09-14T05:11:13.280087+0000 mgr.a (mgr.14355) 17742 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:14 smithi131 bash[24745]: cluster 2024-09-14T05:11:13.391389+0000 mgr.a (mgr.14355) 17743 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:14 smithi171 bash[25040]: audit 2024-09-14T05:11:13.280087+0000 mgr.a (mgr.14355) 17742 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:11:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:14 smithi171 bash[25040]: cluster 2024-09-14T05:11:13.391389+0000 mgr.a (mgr.14355) 17743 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:15 smithi007 bash[22722]: audit 2024-09-14T05:11:14.037471+0000 mgr.a (mgr.14355) 17744 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:11:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:15 smithi007 bash[22722]: cephadm 2024-09-14T05:11:14.039367+0000 mgr.a (mgr.14355) 17745 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:11:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:15 smithi131 bash[24745]: audit 2024-09-14T05:11:14.037471+0000 mgr.a (mgr.14355) 17744 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:11:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:15 smithi131 bash[24745]: cephadm 2024-09-14T05:11:14.039367+0000 mgr.a (mgr.14355) 17745 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:11:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:15 smithi171 bash[25040]: audit 2024-09-14T05:11:14.037471+0000 mgr.a (mgr.14355) 17744 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:11:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:15 smithi171 bash[25040]: cephadm 2024-09-14T05:11:14.039367+0000 mgr.a (mgr.14355) 17745 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:11:16.489 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:16.490 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:16 smithi007 bash[22722]: cluster 2024-09-14T05:11:15.393686+0000 mgr.a (mgr.14355) 17746 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:16 smithi131 bash[24745]: cluster 2024-09-14T05:11:15.393686+0000 mgr.a (mgr.14355) 17746 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:16 smithi171 bash[25040]: cluster 2024-09-14T05:11:15.393686+0000 mgr.a (mgr.14355) 17746 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:17.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:17.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:18 smithi007 bash[22722]: audit 2024-09-14T05:11:16.823785+0000 mgr.a (mgr.14355) 17747 : audit [DBG] from='client.381465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:18 smithi007 bash[22722]: cluster 2024-09-14T05:11:17.394764+0000 mgr.a (mgr.14355) 17748 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:18 smithi131 bash[24745]: audit 2024-09-14T05:11:16.823785+0000 mgr.a (mgr.14355) 17747 : audit [DBG] from='client.381465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:18 smithi131 bash[24745]: cluster 2024-09-14T05:11:17.394764+0000 mgr.a (mgr.14355) 17748 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:18 smithi171 bash[25040]: audit 2024-09-14T05:11:16.823785+0000 mgr.a (mgr.14355) 17747 : audit [DBG] from='client.381465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:18 smithi171 bash[25040]: cluster 2024-09-14T05:11:17.394764+0000 mgr.a (mgr.14355) 17748 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:20 smithi007 bash[22722]: cluster 2024-09-14T05:11:19.395691+0000 mgr.a (mgr.14355) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:20 smithi131 bash[24745]: cluster 2024-09-14T05:11:19.395691+0000 mgr.a (mgr.14355) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:20 smithi171 bash[25040]: cluster 2024-09-14T05:11:19.395691+0000 mgr.a (mgr.14355) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:22.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:22 smithi007 bash[22722]: cluster 2024-09-14T05:11:21.397928+0000 mgr.a (mgr.14355) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:22 smithi131 bash[24745]: cluster 2024-09-14T05:11:21.397928+0000 mgr.a (mgr.14355) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:23.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:22 smithi171 bash[25040]: cluster 2024-09-14T05:11:21.397928+0000 mgr.a (mgr.14355) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:23 smithi007 bash[22722]: audit 2024-09-14T05:11:22.594336+0000 mgr.a (mgr.14355) 17751 : audit [DBG] from='client.381543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:23 smithi131 bash[24745]: audit 2024-09-14T05:11:22.594336+0000 mgr.a (mgr.14355) 17751 : audit [DBG] from='client.381543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:23 smithi171 bash[25040]: audit 2024-09-14T05:11:22.594336+0000 mgr.a (mgr.14355) 17751 : audit [DBG] from='client.381543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:24 smithi131 bash[24745]: cluster 2024-09-14T05:11:23.398912+0000 mgr.a (mgr.14355) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:24 smithi171 bash[25040]: cluster 2024-09-14T05:11:23.398912+0000 mgr.a (mgr.14355) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:24 smithi007 bash[22722]: cluster 2024-09-14T05:11:23.398912+0000 mgr.a (mgr.14355) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:26 smithi131 bash[24745]: cluster 2024-09-14T05:11:25.401050+0000 mgr.a (mgr.14355) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:26 smithi171 bash[25040]: cluster 2024-09-14T05:11:25.401050+0000 mgr.a (mgr.14355) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:26 smithi007 bash[22722]: cluster 2024-09-14T05:11:25.401050+0000 mgr.a (mgr.14355) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:11:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:28.821 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:28.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:28 smithi131 bash[24745]: cluster 2024-09-14T05:11:27.401831+0000 mgr.a (mgr.14355) 17754 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:28 smithi171 bash[25040]: cluster 2024-09-14T05:11:27.401831+0000 mgr.a (mgr.14355) 17754 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:28 smithi007 bash[22722]: cluster 2024-09-14T05:11:27.401831+0000 mgr.a (mgr.14355) 17754 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:29 smithi131 bash[24745]: audit 2024-09-14T05:11:28.382011+0000 mgr.a (mgr.14355) 17755 : audit [DBG] from='client.381618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:29 smithi171 bash[25040]: audit 2024-09-14T05:11:28.382011+0000 mgr.a (mgr.14355) 17755 : audit [DBG] from='client.381618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:29 smithi007 bash[22722]: audit 2024-09-14T05:11:28.382011+0000 mgr.a (mgr.14355) 17755 : audit [DBG] from='client.381618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:30 smithi131 bash[24745]: cluster 2024-09-14T05:11:29.402826+0000 mgr.a (mgr.14355) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:30 smithi171 bash[25040]: cluster 2024-09-14T05:11:29.402826+0000 mgr.a (mgr.14355) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:30 smithi007 bash[22722]: cluster 2024-09-14T05:11:29.402826+0000 mgr.a (mgr.14355) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:32 smithi131 bash[24745]: cluster 2024-09-14T05:11:31.405259+0000 mgr.a (mgr.14355) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:32 smithi171 bash[25040]: cluster 2024-09-14T05:11:31.405259+0000 mgr.a (mgr.14355) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:32 smithi007 bash[22722]: cluster 2024-09-14T05:11:31.405259+0000 mgr.a (mgr.14355) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:33.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:33.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:34.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:34.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:34 smithi131 bash[24745]: cluster 2024-09-14T05:11:33.406187+0000 mgr.a (mgr.14355) 17758 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:34 smithi171 bash[25040]: cluster 2024-09-14T05:11:33.406187+0000 mgr.a (mgr.14355) 17758 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:34 smithi007 bash[22722]: cluster 2024-09-14T05:11:33.406187+0000 mgr.a (mgr.14355) 17758 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:35 smithi131 bash[24745]: audit 2024-09-14T05:11:34.153594+0000 mgr.a (mgr.14355) 17759 : audit [DBG] from='client.381696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:35 smithi171 bash[25040]: audit 2024-09-14T05:11:34.153594+0000 mgr.a (mgr.14355) 17759 : audit [DBG] from='client.381696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:35 smithi007 bash[22722]: audit 2024-09-14T05:11:34.153594+0000 mgr.a (mgr.14355) 17759 : audit [DBG] from='client.381696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:37.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:36 smithi131 bash[24745]: cluster 2024-09-14T05:11:35.408556+0000 mgr.a (mgr.14355) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:36 smithi171 bash[25040]: cluster 2024-09-14T05:11:35.408556+0000 mgr.a (mgr.14355) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:36 smithi007 bash[22722]: cluster 2024-09-14T05:11:35.408556+0000 mgr.a (mgr.14355) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:11:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:38 smithi131 bash[24745]: cluster 2024-09-14T05:11:37.409323+0000 mgr.a (mgr.14355) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:38 smithi171 bash[25040]: cluster 2024-09-14T05:11:37.409323+0000 mgr.a (mgr.14355) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:38 smithi007 bash[22722]: cluster 2024-09-14T05:11:37.409323+0000 mgr.a (mgr.14355) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:39.574 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:39.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:40.352 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:40.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:40 smithi131 bash[24745]: cluster 2024-09-14T05:11:39.410090+0000 mgr.a (mgr.14355) 17762 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:40 smithi171 bash[25040]: cluster 2024-09-14T05:11:39.410090+0000 mgr.a (mgr.14355) 17762 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:40 smithi007 bash[22722]: cluster 2024-09-14T05:11:39.410090+0000 mgr.a (mgr.14355) 17762 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:41 smithi131 bash[24745]: audit 2024-09-14T05:11:39.912178+0000 mgr.a (mgr.14355) 17763 : audit [DBG] from='client.381771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:41 smithi171 bash[25040]: audit 2024-09-14T05:11:39.912178+0000 mgr.a (mgr.14355) 17763 : audit [DBG] from='client.381771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:41 smithi007 bash[22722]: audit 2024-09-14T05:11:39.912178+0000 mgr.a (mgr.14355) 17763 : audit [DBG] from='client.381771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:42 smithi131 bash[24745]: cluster 2024-09-14T05:11:41.412513+0000 mgr.a (mgr.14355) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:11:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:42 smithi171 bash[25040]: cluster 2024-09-14T05:11:41.412513+0000 mgr.a (mgr.14355) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:11:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:42 smithi007 bash[22722]: cluster 2024-09-14T05:11:41.412513+0000 mgr.a (mgr.14355) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:11:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:44 smithi131 bash[24745]: cluster 2024-09-14T05:11:43.413294+0000 mgr.a (mgr.14355) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:11:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:44 smithi171 bash[25040]: cluster 2024-09-14T05:11:43.413294+0000 mgr.a (mgr.14355) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:11:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:44 smithi007 bash[22722]: cluster 2024-09-14T05:11:43.413294+0000 mgr.a (mgr.14355) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:11:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:45.354 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:46.107 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:46.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:46 smithi131 bash[24745]: cluster 2024-09-14T05:11:45.415285+0000 mgr.a (mgr.14355) 17766 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:46 smithi131 bash[24745]: audit 2024-09-14T05:11:45.686282+0000 mgr.a (mgr.14355) 17767 : audit [DBG] from='client.381849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:46 smithi171 bash[25040]: cluster 2024-09-14T05:11:45.415285+0000 mgr.a (mgr.14355) 17766 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:46 smithi171 bash[25040]: audit 2024-09-14T05:11:45.686282+0000 mgr.a (mgr.14355) 17767 : audit [DBG] from='client.381849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:46 smithi007 bash[22722]: cluster 2024-09-14T05:11:45.415285+0000 mgr.a (mgr.14355) 17766 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:46 smithi007 bash[22722]: audit 2024-09-14T05:11:45.686282+0000 mgr.a (mgr.14355) 17767 : audit [DBG] from='client.381849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:48 smithi131 bash[24745]: cluster 2024-09-14T05:11:47.416211+0000 mgr.a (mgr.14355) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:48 smithi171 bash[25040]: cluster 2024-09-14T05:11:47.416211+0000 mgr.a (mgr.14355) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:48 smithi007 bash[22722]: cluster 2024-09-14T05:11:47.416211+0000 mgr.a (mgr.14355) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:11:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:50 smithi171 bash[25040]: cluster 2024-09-14T05:11:49.417010+0000 mgr.a (mgr.14355) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:51.109 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:51.109 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:51.110 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:50 smithi007 bash[22722]: cluster 2024-09-14T05:11:49.417010+0000 mgr.a (mgr.14355) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:50 smithi131 bash[24745]: cluster 2024-09-14T05:11:49.417010+0000 mgr.a (mgr.14355) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:11:51.858 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:51.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:52 smithi171 bash[25040]: cluster 2024-09-14T05:11:51.419132+0000 mgr.a (mgr.14355) 17770 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:52 smithi171 bash[25040]: audit 2024-09-14T05:11:51.440376+0000 mgr.a (mgr.14355) 17771 : audit [DBG] from='client.381927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:52 smithi007 bash[22722]: cluster 2024-09-14T05:11:51.419132+0000 mgr.a (mgr.14355) 17770 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:52 smithi007 bash[22722]: audit 2024-09-14T05:11:51.440376+0000 mgr.a (mgr.14355) 17771 : audit [DBG] from='client.381927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:52 smithi131 bash[24745]: cluster 2024-09-14T05:11:51.419132+0000 mgr.a (mgr.14355) 17770 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:52 smithi131 bash[24745]: audit 2024-09-14T05:11:51.440376+0000 mgr.a (mgr.14355) 17771 : audit [DBG] from='client.381927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:53 smithi007 bash[22722]: cluster 2024-09-14T05:11:53.420196+0000 mgr.a (mgr.14355) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:11:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:53 smithi131 bash[24745]: cluster 2024-09-14T05:11:53.420196+0000 mgr.a (mgr.14355) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:11:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:53 smithi171 bash[25040]: cluster 2024-09-14T05:11:53.420196+0000 mgr.a (mgr.14355) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:11:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:56 smithi131 bash[24745]: cluster 2024-09-14T05:11:55.422431+0000 mgr.a (mgr.14355) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:11:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:56 smithi171 bash[25040]: cluster 2024-09-14T05:11:55.422431+0000 mgr.a (mgr.14355) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:11:56.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:11:56.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:11:56.860 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:11:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:56 smithi007 bash[22722]: cluster 2024-09-14T05:11:55.422431+0000 mgr.a (mgr.14355) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:11:57.619 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:11:57.619 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:11:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:58 smithi131 bash[24745]: audit 2024-09-14T05:11:57.196704+0000 mgr.a (mgr.14355) 17774 : audit [DBG] from='client.382005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:11:58 smithi131 bash[24745]: cluster 2024-09-14T05:11:57.424967+0000 mgr.a (mgr.14355) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:58 smithi171 bash[25040]: audit 2024-09-14T05:11:57.196704+0000 mgr.a (mgr.14355) 17774 : audit [DBG] from='client.382005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:11:58 smithi171 bash[25040]: cluster 2024-09-14T05:11:57.424967+0000 mgr.a (mgr.14355) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:11:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:58 smithi007 bash[22722]: audit 2024-09-14T05:11:57.196704+0000 mgr.a (mgr.14355) 17774 : audit [DBG] from='client.382005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:11:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:11:58 smithi007 bash[22722]: cluster 2024-09-14T05:11:57.424967+0000 mgr.a (mgr.14355) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:00 smithi131 bash[24745]: cluster 2024-09-14T05:11:59.425881+0000 mgr.a (mgr.14355) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:00 smithi171 bash[25040]: cluster 2024-09-14T05:11:59.425881+0000 mgr.a (mgr.14355) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:00 smithi007 bash[22722]: cluster 2024-09-14T05:11:59.425881+0000 mgr.a (mgr.14355) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:02.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:02 smithi131 bash[24745]: cluster 2024-09-14T05:12:01.428155+0000 mgr.a (mgr.14355) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:02.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:02 smithi171 bash[25040]: cluster 2024-09-14T05:12:01.428155+0000 mgr.a (mgr.14355) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:02.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:02 smithi007 bash[22722]: cluster 2024-09-14T05:12:01.428155+0000 mgr.a (mgr.14355) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:03.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:03.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:04 smithi131 bash[24745]: audit 2024-09-14T05:12:02.955412+0000 mgr.a (mgr.14355) 17778 : audit [DBG] from='client.382080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:04 smithi131 bash[24745]: cluster 2024-09-14T05:12:03.428891+0000 mgr.a (mgr.14355) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:04 smithi171 bash[25040]: audit 2024-09-14T05:12:02.955412+0000 mgr.a (mgr.14355) 17778 : audit [DBG] from='client.382080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:04 smithi171 bash[25040]: cluster 2024-09-14T05:12:03.428891+0000 mgr.a (mgr.14355) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:04 smithi007 bash[22722]: audit 2024-09-14T05:12:02.955412+0000 mgr.a (mgr.14355) 17778 : audit [DBG] from='client.382080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:04.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:04 smithi007 bash[22722]: cluster 2024-09-14T05:12:03.428891+0000 mgr.a (mgr.14355) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:06 smithi131 bash[24745]: cluster 2024-09-14T05:12:05.431155+0000 mgr.a (mgr.14355) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:06 smithi171 bash[25040]: cluster 2024-09-14T05:12:05.431155+0000 mgr.a (mgr.14355) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:06 smithi007 bash[22722]: cluster 2024-09-14T05:12:05.431155+0000 mgr.a (mgr.14355) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:08 smithi131 bash[24745]: cluster 2024-09-14T05:12:07.431972+0000 mgr.a (mgr.14355) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:08 smithi171 bash[25040]: cluster 2024-09-14T05:12:07.431972+0000 mgr.a (mgr.14355) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:08 smithi007 bash[22722]: cluster 2024-09-14T05:12:07.431972+0000 mgr.a (mgr.14355) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:09.117 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:09 smithi131 bash[24745]: audit 2024-09-14T05:12:08.699109+0000 mgr.a (mgr.14355) 17782 : audit [DBG] from='client.382158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:09 smithi171 bash[25040]: audit 2024-09-14T05:12:08.699109+0000 mgr.a (mgr.14355) 17782 : audit [DBG] from='client.382158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:09 smithi007 bash[22722]: audit 2024-09-14T05:12:08.699109+0000 mgr.a (mgr.14355) 17782 : audit [DBG] from='client.382158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:10 smithi131 bash[24745]: cluster 2024-09-14T05:12:09.432892+0000 mgr.a (mgr.14355) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:10 smithi171 bash[25040]: cluster 2024-09-14T05:12:09.432892+0000 mgr.a (mgr.14355) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:10 smithi007 bash[22722]: cluster 2024-09-14T05:12:09.432892+0000 mgr.a (mgr.14355) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:12 smithi131 bash[24745]: cluster 2024-09-14T05:12:11.435171+0000 mgr.a (mgr.14355) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:12 smithi171 bash[25040]: cluster 2024-09-14T05:12:11.435171+0000 mgr.a (mgr.14355) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:12 smithi007 bash[22722]: cluster 2024-09-14T05:12:11.435171+0000 mgr.a (mgr.14355) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:12:14.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:14.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:14.119 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:14 smithi131 bash[24745]: cluster 2024-09-14T05:12:13.435956+0000 mgr.a (mgr.14355) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:14 smithi131 bash[24745]: audit 2024-09-14T05:12:14.092710+0000 mon.a (mon.0) 3244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:12:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:14 smithi171 bash[25040]: cluster 2024-09-14T05:12:13.435956+0000 mgr.a (mgr.14355) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:14 smithi171 bash[25040]: audit 2024-09-14T05:12:14.092710+0000 mon.a (mon.0) 3244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:12:14.923 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:14.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:14.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:14.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:14.924 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:14 smithi007 bash[22722]: cluster 2024-09-14T05:12:13.435956+0000 mgr.a (mgr.14355) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:12:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:14 smithi007 bash[22722]: audit 2024-09-14T05:12:14.092710+0000 mon.a (mon.0) 3244 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:15 smithi131 bash[24745]: audit 2024-09-14T05:12:14.461060+0000 mgr.a (mgr.14355) 17786 : audit [DBG] from='client.382236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:15 smithi131 bash[24745]: audit 2024-09-14T05:12:14.948332+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:15 smithi131 bash[24745]: audit 2024-09-14T05:12:14.949148+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:12:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:15 smithi131 bash[24745]: audit 2024-09-14T05:12:14.954447+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:12:15.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:15 smithi131 bash[24745]: audit 2024-09-14T05:12:14.956635+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:15 smithi171 bash[25040]: audit 2024-09-14T05:12:14.461060+0000 mgr.a (mgr.14355) 17786 : audit [DBG] from='client.382236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:15 smithi171 bash[25040]: audit 2024-09-14T05:12:14.948332+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:12:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:15 smithi171 bash[25040]: audit 2024-09-14T05:12:14.949148+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:12:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:15 smithi171 bash[25040]: audit 2024-09-14T05:12:14.954447+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:12:15.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:15 smithi171 bash[25040]: audit 2024-09-14T05:12:14.956635+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:15.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22972]: debug 2024-09-14T05:12:15.658+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22972]: debug 2024-09-14T05:12:15.658+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22722]: audit 2024-09-14T05:12:14.461060+0000 mgr.a (mgr.14355) 17786 : audit [DBG] from='client.382236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22722]: audit 2024-09-14T05:12:14.948332+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22722]: audit 2024-09-14T05:12:14.949148+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22722]: audit 2024-09-14T05:12:14.954447+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:12:15.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:15 smithi007 bash[22722]: audit 2024-09-14T05:12:14.956635+0000 mon.a (mon.0) 3248 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:16 smithi171 bash[25040]: audit 2024-09-14T05:12:14.957688+0000 mgr.a (mgr.14355) 17787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:16 smithi171 bash[25040]: cluster 2024-09-14T05:12:15.446360+0000 mgr.a (mgr.14355) 17788 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-14T05:12:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:16 smithi171 bash[25040]: audit 2024-09-14T05:12:15.664912+0000 mgr.a (mgr.14355) 17789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:12:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:16 smithi171 bash[25040]: cephadm 2024-09-14T05:12:15.666179+0000 mgr.a (mgr.14355) 17790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:12:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:16 smithi007 bash[22722]: audit 2024-09-14T05:12:14.957688+0000 mgr.a (mgr.14355) 17787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:16 smithi007 bash[22722]: cluster 2024-09-14T05:12:15.446360+0000 mgr.a (mgr.14355) 17788 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-14T05:12:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:16 smithi007 bash[22722]: audit 2024-09-14T05:12:15.664912+0000 mgr.a (mgr.14355) 17789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:12:16.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:16 smithi007 bash[22722]: cephadm 2024-09-14T05:12:15.666179+0000 mgr.a (mgr.14355) 17790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:12:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:16 smithi131 bash[24745]: audit 2024-09-14T05:12:14.957688+0000 mgr.a (mgr.14355) 17787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:12:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:16 smithi131 bash[24745]: cluster 2024-09-14T05:12:15.446360+0000 mgr.a (mgr.14355) 17788 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-14T05:12:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:16 smithi131 bash[24745]: audit 2024-09-14T05:12:15.664912+0000 mgr.a (mgr.14355) 17789 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:12:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:16 smithi131 bash[24745]: cephadm 2024-09-14T05:12:15.666179+0000 mgr.a (mgr.14355) 17790 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:12:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:18 smithi171 bash[25040]: cluster 2024-09-14T05:12:17.447343+0000 mgr.a (mgr.14355) 17791 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:18 smithi007 bash[22722]: cluster 2024-09-14T05:12:17.447343+0000 mgr.a (mgr.14355) 17791 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:18 smithi131 bash[24745]: cluster 2024-09-14T05:12:17.447343+0000 mgr.a (mgr.14355) 17791 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:19.925 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:19.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:19.926 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:20.687 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:20 smithi171 bash[25040]: cluster 2024-09-14T05:12:19.448289+0000 mgr.a (mgr.14355) 17792 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:20 smithi007 bash[22722]: cluster 2024-09-14T05:12:19.448289+0000 mgr.a (mgr.14355) 17792 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:20 smithi131 bash[24745]: cluster 2024-09-14T05:12:19.448289+0000 mgr.a (mgr.14355) 17792 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:12:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:21 smithi007 bash[22722]: audit 2024-09-14T05:12:20.257248+0000 mgr.a (mgr.14355) 17793 : audit [DBG] from='client.382422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:21 smithi131 bash[24745]: audit 2024-09-14T05:12:20.257248+0000 mgr.a (mgr.14355) 17793 : audit [DBG] from='client.382422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:21 smithi171 bash[25040]: audit 2024-09-14T05:12:20.257248+0000 mgr.a (mgr.14355) 17793 : audit [DBG] from='client.382422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:22 smithi007 bash[22722]: cluster 2024-09-14T05:12:21.451211+0000 mgr.a (mgr.14355) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:12:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:22 smithi131 bash[24745]: cluster 2024-09-14T05:12:21.451211+0000 mgr.a (mgr.14355) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:12:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:22 smithi171 bash[25040]: cluster 2024-09-14T05:12:21.451211+0000 mgr.a (mgr.14355) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:12:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:24 smithi007 bash[22722]: cluster 2024-09-14T05:12:23.452020+0000 mgr.a (mgr.14355) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:12:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:24 smithi131 bash[24745]: cluster 2024-09-14T05:12:23.452020+0000 mgr.a (mgr.14355) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:12:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:24 smithi171 bash[25040]: cluster 2024-09-14T05:12:23.452020+0000 mgr.a (mgr.14355) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:26.463 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:26.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:26.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:26.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:26.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:26 smithi007 bash[22722]: cluster 2024-09-14T05:12:25.453963+0000 mgr.a (mgr.14355) 17796 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T05:12:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:26 smithi131 bash[24745]: cluster 2024-09-14T05:12:25.453963+0000 mgr.a (mgr.14355) 17796 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T05:12:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:26 smithi171 bash[25040]: cluster 2024-09-14T05:12:25.453963+0000 mgr.a (mgr.14355) 17796 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-09-14T05:12:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:27 smithi007 bash[22722]: audit 2024-09-14T05:12:26.020804+0000 mgr.a (mgr.14355) 17797 : audit [DBG] from='client.382494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:27 smithi131 bash[24745]: audit 2024-09-14T05:12:26.020804+0000 mgr.a (mgr.14355) 17797 : audit [DBG] from='client.382494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:27 smithi171 bash[25040]: audit 2024-09-14T05:12:26.020804+0000 mgr.a (mgr.14355) 17797 : audit [DBG] from='client.382494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:28 smithi007 bash[22722]: cluster 2024-09-14T05:12:27.455029+0000 mgr.a (mgr.14355) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:28 smithi131 bash[24745]: cluster 2024-09-14T05:12:27.455029+0000 mgr.a (mgr.14355) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:28 smithi171 bash[25040]: cluster 2024-09-14T05:12:27.455029+0000 mgr.a (mgr.14355) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:30 smithi007 bash[22722]: cluster 2024-09-14T05:12:29.456031+0000 mgr.a (mgr.14355) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:30 smithi131 bash[24745]: cluster 2024-09-14T05:12:29.456031+0000 mgr.a (mgr.14355) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:30 smithi171 bash[25040]: cluster 2024-09-14T05:12:29.456031+0000 mgr.a (mgr.14355) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 170 B/s wr, 57 op/s 2024-09-14T05:12:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:32.216 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:32.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:32.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:32.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:32.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:32 smithi007 bash[22722]: cluster 2024-09-14T05:12:31.458462+0000 mgr.a (mgr.14355) 17800 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 170 B/s wr, 58 op/s 2024-09-14T05:12:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:32 smithi131 bash[24745]: cluster 2024-09-14T05:12:31.458462+0000 mgr.a (mgr.14355) 17800 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 170 B/s wr, 58 op/s 2024-09-14T05:12:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:32 smithi171 bash[25040]: cluster 2024-09-14T05:12:31.458462+0000 mgr.a (mgr.14355) 17800 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 170 B/s wr, 58 op/s 2024-09-14T05:12:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:33 smithi007 bash[22722]: audit 2024-09-14T05:12:31.795417+0000 mgr.a (mgr.14355) 17801 : audit [DBG] from='client.382569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:34.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:33 smithi131 bash[24745]: audit 2024-09-14T05:12:31.795417+0000 mgr.a (mgr.14355) 17801 : audit [DBG] from='client.382569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:34.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:33 smithi171 bash[25040]: audit 2024-09-14T05:12:31.795417+0000 mgr.a (mgr.14355) 17801 : audit [DBG] from='client.382569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:34 smithi007 bash[22722]: cluster 2024-09-14T05:12:33.459558+0000 mgr.a (mgr.14355) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:12:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:34 smithi131 bash[24745]: cluster 2024-09-14T05:12:33.459558+0000 mgr.a (mgr.14355) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:12:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:34 smithi171 bash[25040]: cluster 2024-09-14T05:12:33.459558+0000 mgr.a (mgr.14355) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:12:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:36 smithi007 bash[22722]: cluster 2024-09-14T05:12:35.461910+0000 mgr.a (mgr.14355) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:12:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:36 smithi131 bash[24745]: cluster 2024-09-14T05:12:35.461910+0000 mgr.a (mgr.14355) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:12:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:36 smithi171 bash[25040]: cluster 2024-09-14T05:12:35.461910+0000 mgr.a (mgr.14355) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:12:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:37.218 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:37.997 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:37.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:37.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:37.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:37.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:38 smithi007 bash[22722]: cluster 2024-09-14T05:12:37.462708+0000 mgr.a (mgr.14355) 17804 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:38 smithi007 bash[22722]: audit 2024-09-14T05:12:37.555454+0000 mgr.a (mgr.14355) 17805 : audit [DBG] from='client.382647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:38 smithi131 bash[24745]: cluster 2024-09-14T05:12:37.462708+0000 mgr.a (mgr.14355) 17804 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:38 smithi131 bash[24745]: audit 2024-09-14T05:12:37.555454+0000 mgr.a (mgr.14355) 17805 : audit [DBG] from='client.382647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:38 smithi171 bash[25040]: cluster 2024-09-14T05:12:37.462708+0000 mgr.a (mgr.14355) 17804 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:38 smithi171 bash[25040]: audit 2024-09-14T05:12:37.555454+0000 mgr.a (mgr.14355) 17805 : audit [DBG] from='client.382647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:40 smithi007 bash[22722]: cluster 2024-09-14T05:12:39.463602+0000 mgr.a (mgr.14355) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:40 smithi131 bash[24745]: cluster 2024-09-14T05:12:39.463602+0000 mgr.a (mgr.14355) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:40 smithi171 bash[25040]: cluster 2024-09-14T05:12:39.463602+0000 mgr.a (mgr.14355) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:42 smithi007 bash[22722]: cluster 2024-09-14T05:12:41.465826+0000 mgr.a (mgr.14355) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:42.998 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:42.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:42.999 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:42 smithi131 bash[24745]: cluster 2024-09-14T05:12:41.465826+0000 mgr.a (mgr.14355) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:42 smithi171 bash[25040]: cluster 2024-09-14T05:12:41.465826+0000 mgr.a (mgr.14355) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:43.798 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:43.798 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:43.799 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:44 smithi007 bash[22722]: audit 2024-09-14T05:12:43.334876+0000 mgr.a (mgr.14355) 17808 : audit [DBG] from='client.382722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:44.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:44 smithi007 bash[22722]: cluster 2024-09-14T05:12:43.466367+0000 mgr.a (mgr.14355) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:44 smithi131 bash[24745]: audit 2024-09-14T05:12:43.334876+0000 mgr.a (mgr.14355) 17808 : audit [DBG] from='client.382722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:44 smithi131 bash[24745]: cluster 2024-09-14T05:12:43.466367+0000 mgr.a (mgr.14355) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:44 smithi171 bash[25040]: audit 2024-09-14T05:12:43.334876+0000 mgr.a (mgr.14355) 17808 : audit [DBG] from='client.382722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:44 smithi171 bash[25040]: cluster 2024-09-14T05:12:43.466367+0000 mgr.a (mgr.14355) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:46 smithi007 bash[22722]: cluster 2024-09-14T05:12:45.468561+0000 mgr.a (mgr.14355) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:46 smithi131 bash[24745]: cluster 2024-09-14T05:12:45.468561+0000 mgr.a (mgr.14355) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:46 smithi171 bash[25040]: cluster 2024-09-14T05:12:45.468561+0000 mgr.a (mgr.14355) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:48.800 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:48.801 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:48 smithi007 bash[22722]: cluster 2024-09-14T05:12:47.469321+0000 mgr.a (mgr.14355) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:48 smithi131 bash[24745]: cluster 2024-09-14T05:12:47.469321+0000 mgr.a (mgr.14355) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:48 smithi171 bash[25040]: cluster 2024-09-14T05:12:47.469321+0000 mgr.a (mgr.14355) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:49.552 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:49.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:49.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:49.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:49.553 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:50 smithi007 bash[22722]: audit 2024-09-14T05:12:49.132501+0000 mgr.a (mgr.14355) 17812 : audit [DBG] from='client.382794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:50.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:50 smithi007 bash[22722]: cluster 2024-09-14T05:12:49.469867+0000 mgr.a (mgr.14355) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:51.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:50 smithi131 bash[24745]: audit 2024-09-14T05:12:49.132501+0000 mgr.a (mgr.14355) 17812 : audit [DBG] from='client.382794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:51.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:50 smithi131 bash[24745]: cluster 2024-09-14T05:12:49.469867+0000 mgr.a (mgr.14355) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:50 smithi171 bash[25040]: audit 2024-09-14T05:12:49.132501+0000 mgr.a (mgr.14355) 17812 : audit [DBG] from='client.382794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:50 smithi171 bash[25040]: cluster 2024-09-14T05:12:49.469867+0000 mgr.a (mgr.14355) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:52 smithi007 bash[22722]: cluster 2024-09-14T05:12:51.472114+0000 mgr.a (mgr.14355) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:52 smithi131 bash[24745]: cluster 2024-09-14T05:12:51.472114+0000 mgr.a (mgr.14355) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:52 smithi171 bash[25040]: cluster 2024-09-14T05:12:51.472114+0000 mgr.a (mgr.14355) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:12:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:12:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:12:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:12:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:54 smithi007 bash[22722]: cluster 2024-09-14T05:12:53.472890+0000 mgr.a (mgr.14355) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:54 smithi131 bash[24745]: cluster 2024-09-14T05:12:53.472890+0000 mgr.a (mgr.14355) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:54 smithi171 bash[25040]: cluster 2024-09-14T05:12:53.472890+0000 mgr.a (mgr.14355) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:12:55.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:12:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:12:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:12:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:12:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:12:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:56 smithi007 bash[22722]: audit 2024-09-14T05:12:54.895680+0000 mgr.a (mgr.14355) 17816 : audit [DBG] from='client.382869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:56.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:56 smithi007 bash[22722]: cluster 2024-09-14T05:12:55.475304+0000 mgr.a (mgr.14355) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:12:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:56 smithi131 bash[24745]: audit 2024-09-14T05:12:54.895680+0000 mgr.a (mgr.14355) 17816 : audit [DBG] from='client.382869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:56 smithi131 bash[24745]: cluster 2024-09-14T05:12:55.475304+0000 mgr.a (mgr.14355) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:12:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:56 smithi171 bash[25040]: audit 2024-09-14T05:12:54.895680+0000 mgr.a (mgr.14355) 17816 : audit [DBG] from='client.382869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:12:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:56 smithi171 bash[25040]: cluster 2024-09-14T05:12:55.475304+0000 mgr.a (mgr.14355) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:12:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:12:58 smithi007 bash[22722]: cluster 2024-09-14T05:12:57.476060+0000 mgr.a (mgr.14355) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:12:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:12:58 smithi131 bash[24745]: cluster 2024-09-14T05:12:57.476060+0000 mgr.a (mgr.14355) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:12:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:12:58 smithi171 bash[25040]: cluster 2024-09-14T05:12:57.476060+0000 mgr.a (mgr.14355) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:13:00.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:00.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:00.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:00 smithi007 bash[22722]: cluster 2024-09-14T05:12:59.476816+0000 mgr.a (mgr.14355) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:13:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:00 smithi131 bash[24745]: cluster 2024-09-14T05:12:59.476816+0000 mgr.a (mgr.14355) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:13:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:00 smithi171 bash[25040]: cluster 2024-09-14T05:12:59.476816+0000 mgr.a (mgr.14355) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:13:01.076 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:01.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:01.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:01 smithi007 bash[22722]: audit 2024-09-14T05:13:00.664656+0000 mgr.a (mgr.14355) 17820 : audit [DBG] from='client.382941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:01 smithi131 bash[24745]: audit 2024-09-14T05:13:00.664656+0000 mgr.a (mgr.14355) 17820 : audit [DBG] from='client.382941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:01 smithi171 bash[25040]: audit 2024-09-14T05:13:00.664656+0000 mgr.a (mgr.14355) 17820 : audit [DBG] from='client.382941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:02 smithi007 bash[22722]: cluster 2024-09-14T05:13:01.479605+0000 mgr.a (mgr.14355) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:02 smithi131 bash[24745]: cluster 2024-09-14T05:13:01.479605+0000 mgr.a (mgr.14355) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:02 smithi171 bash[25040]: cluster 2024-09-14T05:13:01.479605+0000 mgr.a (mgr.14355) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:04 smithi007 bash[22722]: cluster 2024-09-14T05:13:03.480394+0000 mgr.a (mgr.14355) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:04 smithi131 bash[24745]: cluster 2024-09-14T05:13:03.480394+0000 mgr.a (mgr.14355) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:04 smithi171 bash[25040]: cluster 2024-09-14T05:13:03.480394+0000 mgr.a (mgr.14355) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:06.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:06.079 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:06.828 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:06.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:06.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:06.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:06.828 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:06 smithi007 bash[22722]: cluster 2024-09-14T05:13:05.482334+0000 mgr.a (mgr.14355) 17823 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:06 smithi131 bash[24745]: cluster 2024-09-14T05:13:05.482334+0000 mgr.a (mgr.14355) 17823 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:06 smithi171 bash[25040]: cluster 2024-09-14T05:13:05.482334+0000 mgr.a (mgr.14355) 17823 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:07 smithi007 bash[22722]: audit 2024-09-14T05:13:06.411785+0000 mgr.a (mgr.14355) 17824 : audit [DBG] from='client.383016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:07 smithi131 bash[24745]: audit 2024-09-14T05:13:06.411785+0000 mgr.a (mgr.14355) 17824 : audit [DBG] from='client.383016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:07 smithi171 bash[25040]: audit 2024-09-14T05:13:06.411785+0000 mgr.a (mgr.14355) 17824 : audit [DBG] from='client.383016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:08 smithi007 bash[22722]: cluster 2024-09-14T05:13:07.483222+0000 mgr.a (mgr.14355) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:08 smithi131 bash[24745]: cluster 2024-09-14T05:13:07.483222+0000 mgr.a (mgr.14355) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:08 smithi171 bash[25040]: cluster 2024-09-14T05:13:07.483222+0000 mgr.a (mgr.14355) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:10 smithi007 bash[22722]: cluster 2024-09-14T05:13:09.483983+0000 mgr.a (mgr.14355) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:10 smithi131 bash[24745]: cluster 2024-09-14T05:13:09.483983+0000 mgr.a (mgr.14355) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:10 smithi171 bash[25040]: cluster 2024-09-14T05:13:09.483983+0000 mgr.a (mgr.14355) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:13:11.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:11.830 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:12.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:12.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:12 smithi131 bash[24745]: cluster 2024-09-14T05:13:11.486208+0000 mgr.a (mgr.14355) 17827 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:13:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:12 smithi171 bash[25040]: cluster 2024-09-14T05:13:11.486208+0000 mgr.a (mgr.14355) 17827 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:13:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:12 smithi007 bash[22722]: cluster 2024-09-14T05:13:11.486208+0000 mgr.a (mgr.14355) 17827 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:13:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:13 smithi131 bash[24745]: audit 2024-09-14T05:13:12.159566+0000 mgr.a (mgr.14355) 17828 : audit [DBG] from='client.383088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:13 smithi171 bash[25040]: audit 2024-09-14T05:13:12.159566+0000 mgr.a (mgr.14355) 17828 : audit [DBG] from='client.383088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:13 smithi007 bash[22722]: audit 2024-09-14T05:13:12.159566+0000 mgr.a (mgr.14355) 17828 : audit [DBG] from='client.383088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:15.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:14 smithi131 bash[24745]: cluster 2024-09-14T05:13:13.487121+0000 mgr.a (mgr.14355) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:15.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:14 smithi171 bash[25040]: cluster 2024-09-14T05:13:13.487121+0000 mgr.a (mgr.14355) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:15.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:14 smithi007 bash[22722]: cluster 2024-09-14T05:13:13.487121+0000 mgr.a (mgr.14355) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:15 smithi131 bash[24745]: audit 2024-09-14T05:13:15.717446+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:13:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:15 smithi171 bash[25040]: audit 2024-09-14T05:13:15.717446+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:13:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:15 smithi007 bash[22722]: audit 2024-09-14T05:13:15.717446+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:13:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:16 smithi131 bash[24745]: cluster 2024-09-14T05:13:15.489260+0000 mgr.a (mgr.14355) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:16 smithi131 bash[24745]: audit 2024-09-14T05:13:16.568825+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:13:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:16 smithi131 bash[24745]: audit 2024-09-14T05:13:16.570711+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:13:17.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:16 smithi131 bash[24745]: audit 2024-09-14T05:13:16.581362+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:13:17.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:16 smithi131 bash[24745]: audit 2024-09-14T05:13:16.586232+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:16 smithi171 bash[25040]: cluster 2024-09-14T05:13:15.489260+0000 mgr.a (mgr.14355) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:16 smithi171 bash[25040]: audit 2024-09-14T05:13:16.568825+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:13:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:16 smithi171 bash[25040]: audit 2024-09-14T05:13:16.570711+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:13:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:16 smithi171 bash[25040]: audit 2024-09-14T05:13:16.581362+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:13:17.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:16 smithi171 bash[25040]: audit 2024-09-14T05:13:16.586232+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:16 smithi007 bash[22722]: cluster 2024-09-14T05:13:15.489260+0000 mgr.a (mgr.14355) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:16 smithi007 bash[22722]: audit 2024-09-14T05:13:16.568825+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:13:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:16 smithi007 bash[22722]: audit 2024-09-14T05:13:16.570711+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:13:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:16 smithi007 bash[22722]: audit 2024-09-14T05:13:16.581362+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:13:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:16 smithi007 bash[22722]: audit 2024-09-14T05:13:16.586232+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:17.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:17.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:13:17 smithi007 bash[22972]: debug 2024-09-14T05:13:17.357+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:13:17.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:13:17 smithi007 bash[22972]: debug 2024-09-14T05:13:17.357+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:13:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:17 smithi131 bash[24745]: audit 2024-09-14T05:13:16.588547+0000 mgr.a (mgr.14355) 17831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:17 smithi171 bash[25040]: audit 2024-09-14T05:13:16.588547+0000 mgr.a (mgr.14355) 17831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:17 smithi007 bash[22722]: audit 2024-09-14T05:13:16.588547+0000 mgr.a (mgr.14355) 17831 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:13:18.338 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:18.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:18.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:18.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:18.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:18 smithi171 bash[25040]: audit 2024-09-14T05:13:17.359800+0000 mgr.a (mgr.14355) 17832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:13:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:18 smithi171 bash[25040]: cephadm 2024-09-14T05:13:17.361232+0000 mgr.a (mgr.14355) 17833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:13:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:18 smithi171 bash[25040]: cluster 2024-09-14T05:13:17.490196+0000 mgr.a (mgr.14355) 17834 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:18 smithi007 bash[22722]: audit 2024-09-14T05:13:17.359800+0000 mgr.a (mgr.14355) 17832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:13:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:18 smithi007 bash[22722]: cephadm 2024-09-14T05:13:17.361232+0000 mgr.a (mgr.14355) 17833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:13:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:18 smithi007 bash[22722]: cluster 2024-09-14T05:13:17.490196+0000 mgr.a (mgr.14355) 17834 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:18 smithi131 bash[24745]: audit 2024-09-14T05:13:17.359800+0000 mgr.a (mgr.14355) 17832 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:13:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:18 smithi131 bash[24745]: cephadm 2024-09-14T05:13:17.361232+0000 mgr.a (mgr.14355) 17833 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:13:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:18 smithi131 bash[24745]: cluster 2024-09-14T05:13:17.490196+0000 mgr.a (mgr.14355) 17834 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:19 smithi171 bash[25040]: audit 2024-09-14T05:13:17.907501+0000 mgr.a (mgr.14355) 17835 : audit [DBG] from='client.383268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:19 smithi007 bash[22722]: audit 2024-09-14T05:13:17.907501+0000 mgr.a (mgr.14355) 17835 : audit [DBG] from='client.383268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:19 smithi131 bash[24745]: audit 2024-09-14T05:13:17.907501+0000 mgr.a (mgr.14355) 17835 : audit [DBG] from='client.383268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:20 smithi171 bash[25040]: cluster 2024-09-14T05:13:19.491161+0000 mgr.a (mgr.14355) 17836 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:20 smithi007 bash[22722]: cluster 2024-09-14T05:13:19.491161+0000 mgr.a (mgr.14355) 17836 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:20 smithi131 bash[24745]: cluster 2024-09-14T05:13:19.491161+0000 mgr.a (mgr.14355) 17836 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:22 smithi007 bash[22722]: cluster 2024-09-14T05:13:21.493414+0000 mgr.a (mgr.14355) 17837 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:22 smithi131 bash[24745]: cluster 2024-09-14T05:13:21.493414+0000 mgr.a (mgr.14355) 17837 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:22 smithi171 bash[25040]: cluster 2024-09-14T05:13:21.493414+0000 mgr.a (mgr.14355) 17837 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:23.340 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:23.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:23.341 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:24.112 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:24.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:24 smithi007 bash[22722]: cluster 2024-09-14T05:13:23.494168+0000 mgr.a (mgr.14355) 17838 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:24 smithi007 bash[22722]: audit 2024-09-14T05:13:23.673935+0000 mgr.a (mgr.14355) 17839 : audit [DBG] from='client.383346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:24 smithi131 bash[24745]: cluster 2024-09-14T05:13:23.494168+0000 mgr.a (mgr.14355) 17838 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:24 smithi131 bash[24745]: audit 2024-09-14T05:13:23.673935+0000 mgr.a (mgr.14355) 17839 : audit [DBG] from='client.383346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:24 smithi171 bash[25040]: cluster 2024-09-14T05:13:23.494168+0000 mgr.a (mgr.14355) 17838 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:24 smithi171 bash[25040]: audit 2024-09-14T05:13:23.673935+0000 mgr.a (mgr.14355) 17839 : audit [DBG] from='client.383346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:26 smithi007 bash[22722]: cluster 2024-09-14T05:13:25.496408+0000 mgr.a (mgr.14355) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:26 smithi131 bash[24745]: cluster 2024-09-14T05:13:25.496408+0000 mgr.a (mgr.14355) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:26 smithi171 bash[25040]: cluster 2024-09-14T05:13:25.496408+0000 mgr.a (mgr.14355) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:29.114 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:29.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:28 smithi007 bash[22722]: cluster 2024-09-14T05:13:27.497172+0000 mgr.a (mgr.14355) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:28 smithi131 bash[24745]: cluster 2024-09-14T05:13:27.497172+0000 mgr.a (mgr.14355) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:28 smithi171 bash[25040]: cluster 2024-09-14T05:13:27.497172+0000 mgr.a (mgr.14355) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:29.860 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:29.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:29.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:29.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:29.861 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:29 smithi007 bash[22722]: audit 2024-09-14T05:13:29.444078+0000 mgr.a (mgr.14355) 17842 : audit [DBG] from='client.383424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:29 smithi007 bash[22722]: cluster 2024-09-14T05:13:29.498071+0000 mgr.a (mgr.14355) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:29 smithi131 bash[24745]: audit 2024-09-14T05:13:29.444078+0000 mgr.a (mgr.14355) 17842 : audit [DBG] from='client.383424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:29 smithi131 bash[24745]: cluster 2024-09-14T05:13:29.498071+0000 mgr.a (mgr.14355) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:29 smithi171 bash[25040]: audit 2024-09-14T05:13:29.444078+0000 mgr.a (mgr.14355) 17842 : audit [DBG] from='client.383424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:29 smithi171 bash[25040]: cluster 2024-09-14T05:13:29.498071+0000 mgr.a (mgr.14355) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:32 smithi007 bash[22722]: cluster 2024-09-14T05:13:31.500460+0000 mgr.a (mgr.14355) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:32 smithi131 bash[24745]: cluster 2024-09-14T05:13:31.500460+0000 mgr.a (mgr.14355) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:32 smithi171 bash[25040]: cluster 2024-09-14T05:13:31.500460+0000 mgr.a (mgr.14355) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:13:34.862 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:34.863 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:34 smithi007 bash[22722]: cluster 2024-09-14T05:13:33.501213+0000 mgr.a (mgr.14355) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:34 smithi131 bash[24745]: cluster 2024-09-14T05:13:33.501213+0000 mgr.a (mgr.14355) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:34 smithi171 bash[25040]: cluster 2024-09-14T05:13:33.501213+0000 mgr.a (mgr.14355) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:35.599 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:35.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:35.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:35.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:35.600 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:36 smithi007 bash[22722]: audit 2024-09-14T05:13:35.190130+0000 mgr.a (mgr.14355) 17846 : audit [DBG] from='client.383502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:36.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:36 smithi007 bash[22722]: cluster 2024-09-14T05:13:35.503324+0000 mgr.a (mgr.14355) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:36 smithi131 bash[24745]: audit 2024-09-14T05:13:35.190130+0000 mgr.a (mgr.14355) 17846 : audit [DBG] from='client.383502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:36 smithi131 bash[24745]: cluster 2024-09-14T05:13:35.503324+0000 mgr.a (mgr.14355) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:36 smithi171 bash[25040]: audit 2024-09-14T05:13:35.190130+0000 mgr.a (mgr.14355) 17846 : audit [DBG] from='client.383502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:36 smithi171 bash[25040]: cluster 2024-09-14T05:13:35.503324+0000 mgr.a (mgr.14355) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:38 smithi007 bash[22722]: cluster 2024-09-14T05:13:37.504075+0000 mgr.a (mgr.14355) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:38 smithi131 bash[24745]: cluster 2024-09-14T05:13:37.504075+0000 mgr.a (mgr.14355) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:38 smithi171 bash[25040]: cluster 2024-09-14T05:13:37.504075+0000 mgr.a (mgr.14355) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:40.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:40 smithi007 bash[22722]: cluster 2024-09-14T05:13:39.504834+0000 mgr.a (mgr.14355) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:13:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:40 smithi131 bash[24745]: cluster 2024-09-14T05:13:39.504834+0000 mgr.a (mgr.14355) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:13:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:40 smithi171 bash[25040]: cluster 2024-09-14T05:13:39.504834+0000 mgr.a (mgr.14355) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:13:41.357 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:41.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:42 smithi007 bash[22722]: audit 2024-09-14T05:13:40.936576+0000 mgr.a (mgr.14355) 17850 : audit [DBG] from='client.383577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:42.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:42 smithi007 bash[22722]: cluster 2024-09-14T05:13:41.507662+0000 mgr.a (mgr.14355) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:42 smithi131 bash[24745]: audit 2024-09-14T05:13:40.936576+0000 mgr.a (mgr.14355) 17850 : audit [DBG] from='client.383577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:42 smithi131 bash[24745]: cluster 2024-09-14T05:13:41.507662+0000 mgr.a (mgr.14355) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:42 smithi171 bash[25040]: audit 2024-09-14T05:13:40.936576+0000 mgr.a (mgr.14355) 17850 : audit [DBG] from='client.383577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:42 smithi171 bash[25040]: cluster 2024-09-14T05:13:41.507662+0000 mgr.a (mgr.14355) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:44 smithi007 bash[22722]: cluster 2024-09-14T05:13:43.508595+0000 mgr.a (mgr.14355) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:44 smithi131 bash[24745]: cluster 2024-09-14T05:13:43.508595+0000 mgr.a (mgr.14355) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:44 smithi171 bash[25040]: cluster 2024-09-14T05:13:43.508595+0000 mgr.a (mgr.14355) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:13:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:46 smithi007 bash[22722]: cluster 2024-09-14T05:13:45.510558+0000 mgr.a (mgr.14355) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:46 smithi131 bash[24745]: cluster 2024-09-14T05:13:45.510558+0000 mgr.a (mgr.14355) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:46 smithi171 bash[25040]: cluster 2024-09-14T05:13:45.510558+0000 mgr.a (mgr.14355) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:47.138 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:47.138 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:47 smithi007 bash[22722]: audit 2024-09-14T05:13:46.695165+0000 mgr.a (mgr.14355) 17854 : audit [DBG] from='client.383652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:47 smithi131 bash[24745]: audit 2024-09-14T05:13:46.695165+0000 mgr.a (mgr.14355) 17854 : audit [DBG] from='client.383652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:47 smithi171 bash[25040]: audit 2024-09-14T05:13:46.695165+0000 mgr.a (mgr.14355) 17854 : audit [DBG] from='client.383652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:48 smithi007 bash[22722]: cluster 2024-09-14T05:13:47.511468+0000 mgr.a (mgr.14355) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:48 smithi131 bash[24745]: cluster 2024-09-14T05:13:47.511468+0000 mgr.a (mgr.14355) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:48 smithi171 bash[25040]: cluster 2024-09-14T05:13:47.511468+0000 mgr.a (mgr.14355) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:50 smithi007 bash[22722]: cluster 2024-09-14T05:13:49.512274+0000 mgr.a (mgr.14355) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:50 smithi131 bash[24745]: cluster 2024-09-14T05:13:49.512274+0000 mgr.a (mgr.14355) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:50 smithi171 bash[25040]: cluster 2024-09-14T05:13:49.512274+0000 mgr.a (mgr.14355) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:52.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:52.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:52.140 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:52.934 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:52.934 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:52.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:52 smithi007 bash[22722]: cluster 2024-09-14T05:13:51.514518+0000 mgr.a (mgr.14355) 17857 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:52 smithi131 bash[24745]: cluster 2024-09-14T05:13:51.514518+0000 mgr.a (mgr.14355) 17857 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:52 smithi171 bash[25040]: cluster 2024-09-14T05:13:51.514518+0000 mgr.a (mgr.14355) 17857 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:53 smithi007 bash[22722]: audit 2024-09-14T05:13:52.482065+0000 mgr.a (mgr.14355) 17858 : audit [DBG] from='client.383724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:53 smithi131 bash[24745]: audit 2024-09-14T05:13:52.482065+0000 mgr.a (mgr.14355) 17858 : audit [DBG] from='client.383724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:53 smithi171 bash[25040]: audit 2024-09-14T05:13:52.482065+0000 mgr.a (mgr.14355) 17858 : audit [DBG] from='client.383724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:13:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:54 smithi007 bash[22722]: cluster 2024-09-14T05:13:53.515385+0000 mgr.a (mgr.14355) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:54 smithi131 bash[24745]: cluster 2024-09-14T05:13:53.515385+0000 mgr.a (mgr.14355) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:54 smithi171 bash[25040]: cluster 2024-09-14T05:13:53.515385+0000 mgr.a (mgr.14355) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:56 smithi007 bash[22722]: cluster 2024-09-14T05:13:55.517523+0000 mgr.a (mgr.14355) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:56 smithi131 bash[24745]: cluster 2024-09-14T05:13:55.517523+0000 mgr.a (mgr.14355) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:56 smithi171 bash[25040]: cluster 2024-09-14T05:13:55.517523+0000 mgr.a (mgr.14355) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:13:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:13:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:13:57.936 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:13:58.706 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:13:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:13:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:13:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:13:58.707 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:13:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:58 smithi007 bash[22722]: cluster 2024-09-14T05:13:57.518443+0000 mgr.a (mgr.14355) 17861 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:58 smithi131 bash[24745]: cluster 2024-09-14T05:13:57.518443+0000 mgr.a (mgr.14355) 17861 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:58 smithi171 bash[25040]: cluster 2024-09-14T05:13:57.518443+0000 mgr.a (mgr.14355) 17861 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:13:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:13:59 smithi007 bash[22722]: audit 2024-09-14T05:13:58.268579+0000 mgr.a (mgr.14355) 17862 : audit [DBG] from='client.383802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:13:59 smithi131 bash[24745]: audit 2024-09-14T05:13:58.268579+0000 mgr.a (mgr.14355) 17862 : audit [DBG] from='client.383802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:13:59 smithi171 bash[25040]: audit 2024-09-14T05:13:58.268579+0000 mgr.a (mgr.14355) 17862 : audit [DBG] from='client.383802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:00 smithi007 bash[22722]: cluster 2024-09-14T05:13:59.519361+0000 mgr.a (mgr.14355) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:00 smithi131 bash[24745]: cluster 2024-09-14T05:13:59.519361+0000 mgr.a (mgr.14355) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:00 smithi171 bash[25040]: cluster 2024-09-14T05:13:59.519361+0000 mgr.a (mgr.14355) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:02 smithi007 bash[22722]: cluster 2024-09-14T05:14:01.521603+0000 mgr.a (mgr.14355) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:02 smithi131 bash[24745]: cluster 2024-09-14T05:14:01.521603+0000 mgr.a (mgr.14355) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:02 smithi171 bash[25040]: cluster 2024-09-14T05:14:01.521603+0000 mgr.a (mgr.14355) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:04.472 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:04 smithi007 bash[22722]: cluster 2024-09-14T05:14:03.522384+0000 mgr.a (mgr.14355) 17865 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:04 smithi131 bash[24745]: cluster 2024-09-14T05:14:03.522384+0000 mgr.a (mgr.14355) 17865 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:04 smithi171 bash[25040]: cluster 2024-09-14T05:14:03.522384+0000 mgr.a (mgr.14355) 17865 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:05 smithi007 bash[22722]: audit 2024-09-14T05:14:04.043564+0000 mgr.a (mgr.14355) 17866 : audit [DBG] from='client.383880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:06.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:05 smithi131 bash[24745]: audit 2024-09-14T05:14:04.043564+0000 mgr.a (mgr.14355) 17866 : audit [DBG] from='client.383880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:05 smithi171 bash[25040]: audit 2024-09-14T05:14:04.043564+0000 mgr.a (mgr.14355) 17866 : audit [DBG] from='client.383880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:06 smithi131 bash[24745]: cluster 2024-09-14T05:14:05.524561+0000 mgr.a (mgr.14355) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:06 smithi171 bash[25040]: cluster 2024-09-14T05:14:05.524561+0000 mgr.a (mgr.14355) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:06 smithi007 bash[22722]: cluster 2024-09-14T05:14:05.524561+0000 mgr.a (mgr.14355) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:08 smithi131 bash[24745]: cluster 2024-09-14T05:14:07.525311+0000 mgr.a (mgr.14355) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:08 smithi171 bash[25040]: cluster 2024-09-14T05:14:07.525311+0000 mgr.a (mgr.14355) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:08 smithi007 bash[22722]: cluster 2024-09-14T05:14:07.525311+0000 mgr.a (mgr.14355) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:09.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:09.475 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:09.475 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:10.227 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:10.227 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:10 smithi131 bash[24745]: cluster 2024-09-14T05:14:09.525867+0000 mgr.a (mgr.14355) 17869 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:10 smithi131 bash[24745]: audit 2024-09-14T05:14:09.805181+0000 mgr.a (mgr.14355) 17870 : audit [DBG] from='client.383955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:10 smithi171 bash[25040]: cluster 2024-09-14T05:14:09.525867+0000 mgr.a (mgr.14355) 17869 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:10 smithi171 bash[25040]: audit 2024-09-14T05:14:09.805181+0000 mgr.a (mgr.14355) 17870 : audit [DBG] from='client.383955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:10 smithi007 bash[22722]: cluster 2024-09-14T05:14:09.525867+0000 mgr.a (mgr.14355) 17869 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:10 smithi007 bash[22722]: audit 2024-09-14T05:14:09.805181+0000 mgr.a (mgr.14355) 17870 : audit [DBG] from='client.383955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:12 smithi131 bash[24745]: cluster 2024-09-14T05:14:11.528947+0000 mgr.a (mgr.14355) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:12 smithi171 bash[25040]: cluster 2024-09-14T05:14:11.528947+0000 mgr.a (mgr.14355) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:12 smithi007 bash[22722]: cluster 2024-09-14T05:14:11.528947+0000 mgr.a (mgr.14355) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:14 smithi131 bash[24745]: cluster 2024-09-14T05:14:13.529734+0000 mgr.a (mgr.14355) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:14 smithi171 bash[25040]: cluster 2024-09-14T05:14:13.529734+0000 mgr.a (mgr.14355) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:14 smithi007 bash[22722]: cluster 2024-09-14T05:14:13.529734+0000 mgr.a (mgr.14355) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:15.228 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:15.229 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:16.006 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:16.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:16 smithi131 bash[24745]: cluster 2024-09-14T05:14:15.531750+0000 mgr.a (mgr.14355) 17873 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:16 smithi131 bash[24745]: audit 2024-09-14T05:14:15.564598+0000 mgr.a (mgr.14355) 17874 : audit [DBG] from='client.384024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:16 smithi171 bash[25040]: cluster 2024-09-14T05:14:15.531750+0000 mgr.a (mgr.14355) 17873 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:16 smithi171 bash[25040]: audit 2024-09-14T05:14:15.564598+0000 mgr.a (mgr.14355) 17874 : audit [DBG] from='client.384024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:16 smithi007 bash[22722]: cluster 2024-09-14T05:14:15.531750+0000 mgr.a (mgr.14355) 17873 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:16 smithi007 bash[22722]: audit 2024-09-14T05:14:15.564598+0000 mgr.a (mgr.14355) 17874 : audit [DBG] from='client.384024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:17 smithi131 bash[24745]: audit 2024-09-14T05:14:17.421664+0000 mon.a (mon.0) 3254 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:14:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:17 smithi171 bash[25040]: audit 2024-09-14T05:14:17.421664+0000 mon.a (mon.0) 3254 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:14:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:17 smithi007 bash[22722]: audit 2024-09-14T05:14:17.421664+0000 mon.a (mon.0) 3254 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:14:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:18 smithi131 bash[24745]: cluster 2024-09-14T05:14:17.532678+0000 mgr.a (mgr.14355) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:18 smithi131 bash[24745]: audit 2024-09-14T05:14:18.267729+0000 mon.a (mon.0) 3255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:14:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:18 smithi131 bash[24745]: audit 2024-09-14T05:14:18.269167+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:14:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:18 smithi131 bash[24745]: audit 2024-09-14T05:14:18.279647+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:14:19.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:18 smithi131 bash[24745]: audit 2024-09-14T05:14:18.284264+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:19.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:18 smithi007 bash[22722]: cluster 2024-09-14T05:14:17.532678+0000 mgr.a (mgr.14355) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:19.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:18 smithi007 bash[22722]: audit 2024-09-14T05:14:18.267729+0000 mon.a (mon.0) 3255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:14:19.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:18 smithi007 bash[22722]: audit 2024-09-14T05:14:18.269167+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:14:19.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:18 smithi007 bash[22722]: audit 2024-09-14T05:14:18.279647+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:14:19.035 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:18 smithi007 bash[22722]: audit 2024-09-14T05:14:18.284264+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:18 smithi171 bash[25040]: cluster 2024-09-14T05:14:17.532678+0000 mgr.a (mgr.14355) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:18 smithi171 bash[25040]: audit 2024-09-14T05:14:18.267729+0000 mon.a (mon.0) 3255 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:14:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:18 smithi171 bash[25040]: audit 2024-09-14T05:14:18.269167+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:14:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:18 smithi171 bash[25040]: audit 2024-09-14T05:14:18.279647+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:14:19.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:18 smithi171 bash[25040]: audit 2024-09-14T05:14:18.284264+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:19.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:14:19 smithi007 bash[22972]: debug 2024-09-14T05:14:19.032+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:14:19.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:14:19 smithi007 bash[22972]: debug 2024-09-14T05:14:19.032+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:14:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:19 smithi131 bash[24745]: audit 2024-09-14T05:14:18.286702+0000 mgr.a (mgr.14355) 17876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:19 smithi171 bash[25040]: audit 2024-09-14T05:14:18.286702+0000 mgr.a (mgr.14355) 17876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:19 smithi007 bash[22722]: audit 2024-09-14T05:14:18.286702+0000 mgr.a (mgr.14355) 17876 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:14:21.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:21.008 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:21.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:20 smithi131 bash[24745]: audit 2024-09-14T05:14:19.034859+0000 mgr.a (mgr.14355) 17877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:14:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:20 smithi131 bash[24745]: cephadm 2024-09-14T05:14:19.036241+0000 mgr.a (mgr.14355) 17878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:14:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:20 smithi131 bash[24745]: cluster 2024-09-14T05:14:19.533641+0000 mgr.a (mgr.14355) 17879 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:14:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:20 smithi171 bash[25040]: audit 2024-09-14T05:14:19.034859+0000 mgr.a (mgr.14355) 17877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:14:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:20 smithi171 bash[25040]: cephadm 2024-09-14T05:14:19.036241+0000 mgr.a (mgr.14355) 17878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:14:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:20 smithi171 bash[25040]: cluster 2024-09-14T05:14:19.533641+0000 mgr.a (mgr.14355) 17879 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:14:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:20 smithi007 bash[22722]: audit 2024-09-14T05:14:19.034859+0000 mgr.a (mgr.14355) 17877 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:14:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:20 smithi007 bash[22722]: cephadm 2024-09-14T05:14:19.036241+0000 mgr.a (mgr.14355) 17878 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:14:21.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:20 smithi007 bash[22722]: cluster 2024-09-14T05:14:19.533641+0000 mgr.a (mgr.14355) 17879 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:14:21.790 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:22 smithi131 bash[24745]: audit 2024-09-14T05:14:21.341380+0000 mgr.a (mgr.14355) 17880 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:22 smithi131 bash[24745]: cluster 2024-09-14T05:14:21.535590+0000 mgr.a (mgr.14355) 17881 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:22 smithi171 bash[25040]: audit 2024-09-14T05:14:21.341380+0000 mgr.a (mgr.14355) 17880 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:22 smithi171 bash[25040]: cluster 2024-09-14T05:14:21.535590+0000 mgr.a (mgr.14355) 17881 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:22 smithi007 bash[22722]: audit 2024-09-14T05:14:21.341380+0000 mgr.a (mgr.14355) 17880 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:22 smithi007 bash[22722]: cluster 2024-09-14T05:14:21.535590+0000 mgr.a (mgr.14355) 17881 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:24 smithi131 bash[24745]: cluster 2024-09-14T05:14:23.536538+0000 mgr.a (mgr.14355) 17882 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:14:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:24 smithi171 bash[25040]: cluster 2024-09-14T05:14:23.536538+0000 mgr.a (mgr.14355) 17882 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:14:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:24 smithi007 bash[22722]: cluster 2024-09-14T05:14:23.536538+0000 mgr.a (mgr.14355) 17882 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:14:26.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:26 smithi131 bash[24745]: cluster 2024-09-14T05:14:25.538732+0000 mgr.a (mgr.14355) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:26 smithi171 bash[25040]: cluster 2024-09-14T05:14:25.538732+0000 mgr.a (mgr.14355) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:26 smithi007 bash[22722]: cluster 2024-09-14T05:14:25.538732+0000 mgr.a (mgr.14355) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:27.556 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:27.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:27.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:27.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:27.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:28 smithi131 bash[24745]: audit 2024-09-14T05:14:27.126655+0000 mgr.a (mgr.14355) 17884 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:28 smithi131 bash[24745]: cluster 2024-09-14T05:14:27.539214+0000 mgr.a (mgr.14355) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:28 smithi171 bash[25040]: audit 2024-09-14T05:14:27.126655+0000 mgr.a (mgr.14355) 17884 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:28 smithi171 bash[25040]: cluster 2024-09-14T05:14:27.539214+0000 mgr.a (mgr.14355) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:28 smithi007 bash[22722]: audit 2024-09-14T05:14:27.126655+0000 mgr.a (mgr.14355) 17884 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:28 smithi007 bash[22722]: cluster 2024-09-14T05:14:27.539214+0000 mgr.a (mgr.14355) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:30 smithi131 bash[24745]: cluster 2024-09-14T05:14:29.539996+0000 mgr.a (mgr.14355) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:30 smithi171 bash[25040]: cluster 2024-09-14T05:14:29.539996+0000 mgr.a (mgr.14355) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:30 smithi007 bash[22722]: cluster 2024-09-14T05:14:29.539996+0000 mgr.a (mgr.14355) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:32.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:32.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:32.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:32 smithi131 bash[24745]: cluster 2024-09-14T05:14:31.542224+0000 mgr.a (mgr.14355) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:32 smithi171 bash[25040]: cluster 2024-09-14T05:14:31.542224+0000 mgr.a (mgr.14355) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:32 smithi007 bash[22722]: cluster 2024-09-14T05:14:31.542224+0000 mgr.a (mgr.14355) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:14:33.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:33.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:34 smithi131 bash[24745]: audit 2024-09-14T05:14:32.894195+0000 mgr.a (mgr.14355) 17888 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:34 smithi131 bash[24745]: cluster 2024-09-14T05:14:33.543176+0000 mgr.a (mgr.14355) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:34 smithi171 bash[25040]: audit 2024-09-14T05:14:32.894195+0000 mgr.a (mgr.14355) 17888 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:34 smithi171 bash[25040]: cluster 2024-09-14T05:14:33.543176+0000 mgr.a (mgr.14355) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:34 smithi007 bash[22722]: audit 2024-09-14T05:14:32.894195+0000 mgr.a (mgr.14355) 17888 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:34 smithi007 bash[22722]: cluster 2024-09-14T05:14:33.543176+0000 mgr.a (mgr.14355) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:36 smithi131 bash[24745]: cluster 2024-09-14T05:14:35.545358+0000 mgr.a (mgr.14355) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:36 smithi171 bash[25040]: cluster 2024-09-14T05:14:35.545358+0000 mgr.a (mgr.14355) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:36 smithi007 bash[22722]: cluster 2024-09-14T05:14:35.545358+0000 mgr.a (mgr.14355) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:38.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:38 smithi171 bash[25040]: cluster 2024-09-14T05:14:37.546119+0000 mgr.a (mgr.14355) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:39.118 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:38 smithi007 bash[22722]: cluster 2024-09-14T05:14:37.546119+0000 mgr.a (mgr.14355) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:38 smithi131 bash[24745]: cluster 2024-09-14T05:14:37.546119+0000 mgr.a (mgr.14355) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:39 smithi171 bash[25040]: audit 2024-09-14T05:14:38.669896+0000 mgr.a (mgr.14355) 17892 : audit [DBG] from='client.384435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:39 smithi007 bash[22722]: audit 2024-09-14T05:14:38.669896+0000 mgr.a (mgr.14355) 17892 : audit [DBG] from='client.384435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:39 smithi131 bash[24745]: audit 2024-09-14T05:14:38.669896+0000 mgr.a (mgr.14355) 17892 : audit [DBG] from='client.384435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:40 smithi007 bash[22722]: cluster 2024-09-14T05:14:39.547113+0000 mgr.a (mgr.14355) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:40 smithi131 bash[24745]: cluster 2024-09-14T05:14:39.547113+0000 mgr.a (mgr.14355) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:40 smithi171 bash[25040]: cluster 2024-09-14T05:14:39.547113+0000 mgr.a (mgr.14355) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:42 smithi007 bash[22722]: cluster 2024-09-14T05:14:41.549383+0000 mgr.a (mgr.14355) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:42 smithi131 bash[24745]: cluster 2024-09-14T05:14:41.549383+0000 mgr.a (mgr.14355) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:43.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:42 smithi171 bash[25040]: cluster 2024-09-14T05:14:41.549383+0000 mgr.a (mgr.14355) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:44.120 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:44.121 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:44.122 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:44.884 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:44.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:44 smithi007 bash[22722]: cluster 2024-09-14T05:14:43.550135+0000 mgr.a (mgr.14355) 17895 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:44 smithi131 bash[24745]: cluster 2024-09-14T05:14:43.550135+0000 mgr.a (mgr.14355) 17895 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:44 smithi171 bash[25040]: cluster 2024-09-14T05:14:43.550135+0000 mgr.a (mgr.14355) 17895 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:45 smithi007 bash[22722]: audit 2024-09-14T05:14:44.453938+0000 mgr.a (mgr.14355) 17896 : audit [DBG] from='client.384513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:45 smithi131 bash[24745]: audit 2024-09-14T05:14:44.453938+0000 mgr.a (mgr.14355) 17896 : audit [DBG] from='client.384513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:45 smithi171 bash[25040]: audit 2024-09-14T05:14:44.453938+0000 mgr.a (mgr.14355) 17896 : audit [DBG] from='client.384513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:46 smithi007 bash[22722]: cluster 2024-09-14T05:14:45.552461+0000 mgr.a (mgr.14355) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:46 smithi131 bash[24745]: cluster 2024-09-14T05:14:45.552461+0000 mgr.a (mgr.14355) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:46 smithi171 bash[25040]: cluster 2024-09-14T05:14:45.552461+0000 mgr.a (mgr.14355) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:14:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:48 smithi007 bash[22722]: cluster 2024-09-14T05:14:47.553245+0000 mgr.a (mgr.14355) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:48 smithi131 bash[24745]: cluster 2024-09-14T05:14:47.553245+0000 mgr.a (mgr.14355) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:48 smithi171 bash[25040]: cluster 2024-09-14T05:14:47.553245+0000 mgr.a (mgr.14355) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:50.667 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:50.668 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:50 smithi007 bash[22722]: cluster 2024-09-14T05:14:49.554068+0000 mgr.a (mgr.14355) 17899 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:50 smithi131 bash[24745]: cluster 2024-09-14T05:14:49.554068+0000 mgr.a (mgr.14355) 17899 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:50 smithi171 bash[25040]: cluster 2024-09-14T05:14:49.554068+0000 mgr.a (mgr.14355) 17899 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:51 smithi007 bash[22722]: audit 2024-09-14T05:14:50.223213+0000 mgr.a (mgr.14355) 17900 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:51 smithi131 bash[24745]: audit 2024-09-14T05:14:50.223213+0000 mgr.a (mgr.14355) 17900 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:51 smithi171 bash[25040]: audit 2024-09-14T05:14:50.223213+0000 mgr.a (mgr.14355) 17900 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:52 smithi007 bash[22722]: cluster 2024-09-14T05:14:51.556948+0000 mgr.a (mgr.14355) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:52 smithi131 bash[24745]: cluster 2024-09-14T05:14:51.556948+0000 mgr.a (mgr.14355) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:52 smithi171 bash[25040]: cluster 2024-09-14T05:14:51.556948+0000 mgr.a (mgr.14355) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:53 smithi007 bash[22722]: cluster 2024-09-14T05:14:53.557723+0000 mgr.a (mgr.14355) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:53 smithi131 bash[24745]: cluster 2024-09-14T05:14:53.557723+0000 mgr.a (mgr.14355) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:53 smithi171 bash[25040]: cluster 2024-09-14T05:14:53.557723+0000 mgr.a (mgr.14355) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:55.669 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:14:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:14:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:14:56.409 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:14:56.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:14:56.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:14:56.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:14:56.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:14:56.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:56 smithi007 bash[22722]: cluster 2024-09-14T05:14:55.559651+0000 mgr.a (mgr.14355) 17903 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:56 smithi131 bash[24745]: cluster 2024-09-14T05:14:55.559651+0000 mgr.a (mgr.14355) 17903 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:56 smithi171 bash[25040]: cluster 2024-09-14T05:14:55.559651+0000 mgr.a (mgr.14355) 17903 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:14:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:57 smithi007 bash[22722]: audit 2024-09-14T05:14:55.995338+0000 mgr.a (mgr.14355) 17904 : audit [DBG] from='client.384666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:57 smithi131 bash[24745]: audit 2024-09-14T05:14:55.995338+0000 mgr.a (mgr.14355) 17904 : audit [DBG] from='client.384666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:57 smithi171 bash[25040]: audit 2024-09-14T05:14:55.995338+0000 mgr.a (mgr.14355) 17904 : audit [DBG] from='client.384666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:14:58.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:14:58 smithi007 bash[22722]: cluster 2024-09-14T05:14:57.560607+0000 mgr.a (mgr.14355) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:14:58 smithi131 bash[24745]: cluster 2024-09-14T05:14:57.560607+0000 mgr.a (mgr.14355) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:14:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:14:58 smithi171 bash[25040]: cluster 2024-09-14T05:14:57.560607+0000 mgr.a (mgr.14355) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:15:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:00 smithi007 bash[22722]: cluster 2024-09-14T05:14:59.561411+0000 mgr.a (mgr.14355) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:00 smithi131 bash[24745]: cluster 2024-09-14T05:14:59.561411+0000 mgr.a (mgr.14355) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:00 smithi171 bash[25040]: cluster 2024-09-14T05:14:59.561411+0000 mgr.a (mgr.14355) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:01.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:01.409 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:02.191 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:02.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:02.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:02.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:02.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:02.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:02 smithi007 bash[22722]: cluster 2024-09-14T05:15:01.562892+0000 mgr.a (mgr.14355) 17907 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:02.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:02 smithi007 bash[22722]: audit 2024-09-14T05:15:01.746901+0000 mgr.a (mgr.14355) 17908 : audit [DBG] from='client.384744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:02 smithi131 bash[24745]: cluster 2024-09-14T05:15:01.562892+0000 mgr.a (mgr.14355) 17907 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:02 smithi131 bash[24745]: audit 2024-09-14T05:15:01.746901+0000 mgr.a (mgr.14355) 17908 : audit [DBG] from='client.384744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:02 smithi171 bash[25040]: cluster 2024-09-14T05:15:01.562892+0000 mgr.a (mgr.14355) 17907 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:03.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:02 smithi171 bash[25040]: audit 2024-09-14T05:15:01.746901+0000 mgr.a (mgr.14355) 17908 : audit [DBG] from='client.384744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:04 smithi007 bash[22722]: cluster 2024-09-14T05:15:03.563822+0000 mgr.a (mgr.14355) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:04 smithi131 bash[24745]: cluster 2024-09-14T05:15:03.563822+0000 mgr.a (mgr.14355) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:04 smithi171 bash[25040]: cluster 2024-09-14T05:15:03.563822+0000 mgr.a (mgr.14355) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:06 smithi007 bash[22722]: cluster 2024-09-14T05:15:05.565992+0000 mgr.a (mgr.14355) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:06 smithi131 bash[24745]: cluster 2024-09-14T05:15:05.565992+0000 mgr.a (mgr.14355) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:06 smithi171 bash[25040]: cluster 2024-09-14T05:15:05.565992+0000 mgr.a (mgr.14355) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:07.192 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:07.983 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:07.983 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:08 smithi007 bash[22722]: audit 2024-09-14T05:15:07.530842+0000 mgr.a (mgr.14355) 17911 : audit [DBG] from='client.384822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:08 smithi007 bash[22722]: cluster 2024-09-14T05:15:07.566797+0000 mgr.a (mgr.14355) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:08 smithi131 bash[24745]: audit 2024-09-14T05:15:07.530842+0000 mgr.a (mgr.14355) 17911 : audit [DBG] from='client.384822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:08 smithi131 bash[24745]: cluster 2024-09-14T05:15:07.566797+0000 mgr.a (mgr.14355) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:08 smithi171 bash[25040]: audit 2024-09-14T05:15:07.530842+0000 mgr.a (mgr.14355) 17911 : audit [DBG] from='client.384822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:08 smithi171 bash[25040]: cluster 2024-09-14T05:15:07.566797+0000 mgr.a (mgr.14355) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:10 smithi007 bash[22722]: cluster 2024-09-14T05:15:09.567712+0000 mgr.a (mgr.14355) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:11.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:10 smithi131 bash[24745]: cluster 2024-09-14T05:15:09.567712+0000 mgr.a (mgr.14355) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:10 smithi171 bash[25040]: cluster 2024-09-14T05:15:09.567712+0000 mgr.a (mgr.14355) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:12 smithi007 bash[22722]: cluster 2024-09-14T05:15:11.569973+0000 mgr.a (mgr.14355) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:12.985 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:12.986 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:13.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:12 smithi131 bash[24745]: cluster 2024-09-14T05:15:11.569973+0000 mgr.a (mgr.14355) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:13.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:12 smithi171 bash[25040]: cluster 2024-09-14T05:15:11.569973+0000 mgr.a (mgr.14355) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:13.737 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:14 smithi007 bash[22722]: audit 2024-09-14T05:15:13.320419+0000 mgr.a (mgr.14355) 17915 : audit [DBG] from='client.384897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:14 smithi007 bash[22722]: cluster 2024-09-14T05:15:13.570650+0000 mgr.a (mgr.14355) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:14 smithi131 bash[24745]: audit 2024-09-14T05:15:13.320419+0000 mgr.a (mgr.14355) 17915 : audit [DBG] from='client.384897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:15.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:14 smithi131 bash[24745]: cluster 2024-09-14T05:15:13.570650+0000 mgr.a (mgr.14355) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:14 smithi171 bash[25040]: audit 2024-09-14T05:15:13.320419+0000 mgr.a (mgr.14355) 17915 : audit [DBG] from='client.384897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:15.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:14 smithi171 bash[25040]: cluster 2024-09-14T05:15:13.570650+0000 mgr.a (mgr.14355) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:16.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:16 smithi007 bash[22722]: cluster 2024-09-14T05:15:15.572907+0000 mgr.a (mgr.14355) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:17.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:16 smithi131 bash[24745]: cluster 2024-09-14T05:15:15.572907+0000 mgr.a (mgr.14355) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:17.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:16 smithi171 bash[25040]: cluster 2024-09-14T05:15:15.572907+0000 mgr.a (mgr.14355) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:18.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:18.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:18.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:18 smithi007 bash[22722]: cluster 2024-09-14T05:15:17.573694+0000 mgr.a (mgr.14355) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:18 smithi131 bash[24745]: cluster 2024-09-14T05:15:17.573694+0000 mgr.a (mgr.14355) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:18 smithi171 bash[25040]: cluster 2024-09-14T05:15:17.573694+0000 mgr.a (mgr.14355) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:19.537 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:19.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:19.537 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:19.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:19.538 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:19 smithi007 bash[22722]: audit 2024-09-14T05:15:19.090030+0000 mon.a (mon.0) 3259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:15:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:19 smithi131 bash[24745]: audit 2024-09-14T05:15:19.090030+0000 mon.a (mon.0) 3259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:15:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:19 smithi171 bash[25040]: audit 2024-09-14T05:15:19.090030+0000 mon.a (mon.0) 3259 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:19.077033+0000 mgr.a (mgr.14355) 17919 : audit [DBG] from='client.384975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: cluster 2024-09-14T05:15:19.574550+0000 mgr.a (mgr.14355) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:19.838566+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:19.845205+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:20.493341+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:15:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:20.494960+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:15:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:20.504613+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:20 smithi007 bash[22722]: audit 2024-09-14T05:15:20.509453+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:19.077033+0000 mgr.a (mgr.14355) 17919 : audit [DBG] from='client.384975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: cluster 2024-09-14T05:15:19.574550+0000 mgr.a (mgr.14355) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:19.838566+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:19.845205+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:20.493341+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:20.494960+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:20.504613+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:20 smithi131 bash[24745]: audit 2024-09-14T05:15:20.509453+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:19.077033+0000 mgr.a (mgr.14355) 17919 : audit [DBG] from='client.384975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: cluster 2024-09-14T05:15:19.574550+0000 mgr.a (mgr.14355) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:19.838566+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:19.845205+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:20.493341+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:20.494960+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:20.504613+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:15:21.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:20 smithi171 bash[25040]: audit 2024-09-14T05:15:20.509453+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:21.679 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:15:21 smithi007 bash[22972]: debug 2024-09-14T05:15:21.259+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:15:21.679 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:15:21 smithi007 bash[22972]: debug 2024-09-14T05:15:21.259+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:15:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:21 smithi007 bash[22722]: audit 2024-09-14T05:15:20.511196+0000 mgr.a (mgr.14355) 17921 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:21 smithi131 bash[24745]: audit 2024-09-14T05:15:20.511196+0000 mgr.a (mgr.14355) 17921 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:21 smithi171 bash[25040]: audit 2024-09-14T05:15:20.511196+0000 mgr.a (mgr.14355) 17921 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:15:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:22 smithi007 bash[22722]: audit 2024-09-14T05:15:21.262448+0000 mgr.a (mgr.14355) 17922 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:15:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:22 smithi007 bash[22722]: cephadm 2024-09-14T05:15:21.263864+0000 mgr.a (mgr.14355) 17923 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:15:22.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:22 smithi007 bash[22722]: cluster 2024-09-14T05:15:21.577232+0000 mgr.a (mgr.14355) 17924 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:22 smithi131 bash[24745]: audit 2024-09-14T05:15:21.262448+0000 mgr.a (mgr.14355) 17922 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:15:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:22 smithi131 bash[24745]: cephadm 2024-09-14T05:15:21.263864+0000 mgr.a (mgr.14355) 17923 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:15:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:22 smithi131 bash[24745]: cluster 2024-09-14T05:15:21.577232+0000 mgr.a (mgr.14355) 17924 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:22 smithi171 bash[25040]: audit 2024-09-14T05:15:21.262448+0000 mgr.a (mgr.14355) 17922 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:15:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:22 smithi171 bash[25040]: cephadm 2024-09-14T05:15:21.263864+0000 mgr.a (mgr.14355) 17923 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:15:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:22 smithi171 bash[25040]: cluster 2024-09-14T05:15:21.577232+0000 mgr.a (mgr.14355) 17924 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:24.539 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:24.539 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:24.540 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:24 smithi007 bash[22722]: cluster 2024-09-14T05:15:23.578000+0000 mgr.a (mgr.14355) 17925 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:24 smithi131 bash[24745]: cluster 2024-09-14T05:15:23.578000+0000 mgr.a (mgr.14355) 17925 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:24 smithi171 bash[25040]: cluster 2024-09-14T05:15:23.578000+0000 mgr.a (mgr.14355) 17925 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:25.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:25.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:25.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:26 smithi007 bash[22722]: audit 2024-09-14T05:15:24.872958+0000 mgr.a (mgr.14355) 17926 : audit [DBG] from='client.385158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:26 smithi007 bash[22722]: cluster 2024-09-14T05:15:25.580308+0000 mgr.a (mgr.14355) 17927 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:26 smithi131 bash[24745]: audit 2024-09-14T05:15:24.872958+0000 mgr.a (mgr.14355) 17926 : audit [DBG] from='client.385158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:26 smithi131 bash[24745]: cluster 2024-09-14T05:15:25.580308+0000 mgr.a (mgr.14355) 17927 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:26 smithi171 bash[25040]: audit 2024-09-14T05:15:24.872958+0000 mgr.a (mgr.14355) 17926 : audit [DBG] from='client.385158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:26 smithi171 bash[25040]: cluster 2024-09-14T05:15:25.580308+0000 mgr.a (mgr.14355) 17927 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:28 smithi007 bash[22722]: cluster 2024-09-14T05:15:27.581102+0000 mgr.a (mgr.14355) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:28 smithi131 bash[24745]: cluster 2024-09-14T05:15:27.581102+0000 mgr.a (mgr.14355) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:28 smithi171 bash[25040]: cluster 2024-09-14T05:15:27.581102+0000 mgr.a (mgr.14355) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:30.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:30 smithi131 bash[24745]: cluster 2024-09-14T05:15:29.581894+0000 mgr.a (mgr.14355) 17929 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:31.034 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:31.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:30 smithi171 bash[25040]: cluster 2024-09-14T05:15:29.581894+0000 mgr.a (mgr.14355) 17929 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:30 smithi007 bash[22722]: cluster 2024-09-14T05:15:29.581894+0000 mgr.a (mgr.14355) 17929 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:31 smithi131 bash[24745]: audit 2024-09-14T05:15:30.619481+0000 mgr.a (mgr.14355) 17930 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:31 smithi171 bash[25040]: audit 2024-09-14T05:15:30.619481+0000 mgr.a (mgr.14355) 17930 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:31 smithi007 bash[22722]: audit 2024-09-14T05:15:30.619481+0000 mgr.a (mgr.14355) 17930 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:32 smithi131 bash[24745]: cluster 2024-09-14T05:15:31.584778+0000 mgr.a (mgr.14355) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:32 smithi171 bash[25040]: cluster 2024-09-14T05:15:31.584778+0000 mgr.a (mgr.14355) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:32 smithi007 bash[22722]: cluster 2024-09-14T05:15:31.584778+0000 mgr.a (mgr.14355) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:34 smithi131 bash[24745]: cluster 2024-09-14T05:15:33.585607+0000 mgr.a (mgr.14355) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:15:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:34 smithi171 bash[25040]: cluster 2024-09-14T05:15:33.585607+0000 mgr.a (mgr.14355) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:15:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:34 smithi007 bash[22722]: cluster 2024-09-14T05:15:33.585607+0000 mgr.a (mgr.14355) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:15:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:36.038 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:36.791 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:36 smithi131 bash[24745]: cluster 2024-09-14T05:15:35.587563+0000 mgr.a (mgr.14355) 17933 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:36 smithi171 bash[25040]: cluster 2024-09-14T05:15:35.587563+0000 mgr.a (mgr.14355) 17933 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:36 smithi007 bash[22722]: cluster 2024-09-14T05:15:35.587563+0000 mgr.a (mgr.14355) 17933 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:15:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:37 smithi131 bash[24745]: audit 2024-09-14T05:15:36.367311+0000 mgr.a (mgr.14355) 17934 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:37 smithi171 bash[25040]: audit 2024-09-14T05:15:36.367311+0000 mgr.a (mgr.14355) 17934 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:37 smithi007 bash[22722]: audit 2024-09-14T05:15:36.367311+0000 mgr.a (mgr.14355) 17934 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:38 smithi131 bash[24745]: cluster 2024-09-14T05:15:37.588503+0000 mgr.a (mgr.14355) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:15:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:38 smithi171 bash[25040]: cluster 2024-09-14T05:15:37.588503+0000 mgr.a (mgr.14355) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:15:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:38 smithi007 bash[22722]: cluster 2024-09-14T05:15:37.588503+0000 mgr.a (mgr.14355) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:15:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:40 smithi131 bash[24745]: cluster 2024-09-14T05:15:39.589304+0000 mgr.a (mgr.14355) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:40 smithi171 bash[25040]: cluster 2024-09-14T05:15:39.589304+0000 mgr.a (mgr.14355) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:40 smithi007 bash[22722]: cluster 2024-09-14T05:15:39.589304+0000 mgr.a (mgr.14355) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:15:41.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:41.793 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:41.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:42.534 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:42.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:42.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:42 smithi131 bash[24745]: cluster 2024-09-14T05:15:41.591573+0000 mgr.a (mgr.14355) 17937 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:42 smithi171 bash[25040]: cluster 2024-09-14T05:15:41.591573+0000 mgr.a (mgr.14355) 17937 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:42 smithi007 bash[22722]: cluster 2024-09-14T05:15:41.591573+0000 mgr.a (mgr.14355) 17937 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:43 smithi131 bash[24745]: audit 2024-09-14T05:15:42.121292+0000 mgr.a (mgr.14355) 17938 : audit [DBG] from='client.385383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:43 smithi171 bash[25040]: audit 2024-09-14T05:15:42.121292+0000 mgr.a (mgr.14355) 17938 : audit [DBG] from='client.385383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:43 smithi007 bash[22722]: audit 2024-09-14T05:15:42.121292+0000 mgr.a (mgr.14355) 17938 : audit [DBG] from='client.385383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:44 smithi131 bash[24745]: cluster 2024-09-14T05:15:43.592425+0000 mgr.a (mgr.14355) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:44 smithi171 bash[25040]: cluster 2024-09-14T05:15:43.592425+0000 mgr.a (mgr.14355) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:44 smithi007 bash[22722]: cluster 2024-09-14T05:15:43.592425+0000 mgr.a (mgr.14355) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:46 smithi131 bash[24745]: cluster 2024-09-14T05:15:45.594633+0000 mgr.a (mgr.14355) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:46 smithi171 bash[25040]: cluster 2024-09-14T05:15:45.594633+0000 mgr.a (mgr.14355) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:46 smithi007 bash[22722]: cluster 2024-09-14T05:15:45.594633+0000 mgr.a (mgr.14355) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:48.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:48.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:48.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:48 smithi131 bash[24745]: cluster 2024-09-14T05:15:47.595393+0000 mgr.a (mgr.14355) 17941 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:48 smithi171 bash[25040]: cluster 2024-09-14T05:15:47.595393+0000 mgr.a (mgr.14355) 17941 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:48 smithi007 bash[22722]: cluster 2024-09-14T05:15:47.595393+0000 mgr.a (mgr.14355) 17941 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:49 smithi131 bash[24745]: audit 2024-09-14T05:15:47.874997+0000 mgr.a (mgr.14355) 17942 : audit [DBG] from='client.385461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:49 smithi171 bash[25040]: audit 2024-09-14T05:15:47.874997+0000 mgr.a (mgr.14355) 17942 : audit [DBG] from='client.385461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:49 smithi007 bash[22722]: audit 2024-09-14T05:15:47.874997+0000 mgr.a (mgr.14355) 17942 : audit [DBG] from='client.385461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:50 smithi171 bash[25040]: cluster 2024-09-14T05:15:49.596292+0000 mgr.a (mgr.14355) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:50 smithi007 bash[22722]: cluster 2024-09-14T05:15:49.596292+0000 mgr.a (mgr.14355) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:50 smithi131 bash[24745]: cluster 2024-09-14T05:15:49.596292+0000 mgr.a (mgr.14355) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:52 smithi171 bash[25040]: cluster 2024-09-14T05:15:51.598591+0000 mgr.a (mgr.14355) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:52 smithi007 bash[22722]: cluster 2024-09-14T05:15:51.598591+0000 mgr.a (mgr.14355) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:52 smithi131 bash[24745]: cluster 2024-09-14T05:15:51.598591+0000 mgr.a (mgr.14355) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:53.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:53.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:53.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:54.060 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:15:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:54.061 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:54 smithi171 bash[25040]: cluster 2024-09-14T05:15:53.599311+0000 mgr.a (mgr.14355) 17945 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:55.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:54 smithi171 bash[25040]: audit 2024-09-14T05:15:53.651741+0000 mgr.a (mgr.14355) 17946 : audit [DBG] from='client.385539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:54 smithi007 bash[22722]: cluster 2024-09-14T05:15:53.599311+0000 mgr.a (mgr.14355) 17945 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:54 smithi007 bash[22722]: audit 2024-09-14T05:15:53.651741+0000 mgr.a (mgr.14355) 17946 : audit [DBG] from='client.385539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:54 smithi131 bash[24745]: cluster 2024-09-14T05:15:53.599311+0000 mgr.a (mgr.14355) 17945 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:54 smithi131 bash[24745]: audit 2024-09-14T05:15:53.651741+0000 mgr.a (mgr.14355) 17946 : audit [DBG] from='client.385539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:15:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:56 smithi007 bash[22722]: cluster 2024-09-14T05:15:55.601572+0000 mgr.a (mgr.14355) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:56 smithi131 bash[24745]: cluster 2024-09-14T05:15:55.601572+0000 mgr.a (mgr.14355) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:56 smithi171 bash[25040]: cluster 2024-09-14T05:15:55.601572+0000 mgr.a (mgr.14355) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:15:59.062 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:15:59.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:15:59.063 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:15:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:15:58 smithi007 bash[22722]: cluster 2024-09-14T05:15:57.602363+0000 mgr.a (mgr.14355) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:15:58 smithi131 bash[24745]: cluster 2024-09-14T05:15:57.602363+0000 mgr.a (mgr.14355) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:15:58 smithi171 bash[25040]: cluster 2024-09-14T05:15:57.602363+0000 mgr.a (mgr.14355) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:15:59.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:15:59.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:15:59.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:15:59.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:15:59.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:00 smithi007 bash[22722]: audit 2024-09-14T05:15:59.403054+0000 mgr.a (mgr.14355) 17949 : audit [DBG] from='client.385617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:00 smithi007 bash[22722]: cluster 2024-09-14T05:15:59.602906+0000 mgr.a (mgr.14355) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:00 smithi131 bash[24745]: audit 2024-09-14T05:15:59.403054+0000 mgr.a (mgr.14355) 17949 : audit [DBG] from='client.385617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:00 smithi131 bash[24745]: cluster 2024-09-14T05:15:59.602906+0000 mgr.a (mgr.14355) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:00 smithi171 bash[25040]: audit 2024-09-14T05:15:59.403054+0000 mgr.a (mgr.14355) 17949 : audit [DBG] from='client.385617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:00 smithi171 bash[25040]: cluster 2024-09-14T05:15:59.602906+0000 mgr.a (mgr.14355) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:02 smithi007 bash[22722]: cluster 2024-09-14T05:16:01.605241+0000 mgr.a (mgr.14355) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:02 smithi131 bash[24745]: cluster 2024-09-14T05:16:01.605241+0000 mgr.a (mgr.14355) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:02 smithi171 bash[25040]: cluster 2024-09-14T05:16:01.605241+0000 mgr.a (mgr.14355) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:04.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:04.858 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:04.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:04 smithi007 bash[22722]: cluster 2024-09-14T05:16:03.606019+0000 mgr.a (mgr.14355) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:04 smithi131 bash[24745]: cluster 2024-09-14T05:16:03.606019+0000 mgr.a (mgr.14355) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:04 smithi171 bash[25040]: cluster 2024-09-14T05:16:03.606019+0000 mgr.a (mgr.14355) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:05.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:05.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:05.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:06 smithi007 bash[22722]: audit 2024-09-14T05:16:05.194504+0000 mgr.a (mgr.14355) 17953 : audit [DBG] from='client.385695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:07.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:06 smithi007 bash[22722]: cluster 2024-09-14T05:16:05.607303+0000 mgr.a (mgr.14355) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:06 smithi131 bash[24745]: audit 2024-09-14T05:16:05.194504+0000 mgr.a (mgr.14355) 17953 : audit [DBG] from='client.385695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:06 smithi131 bash[24745]: cluster 2024-09-14T05:16:05.607303+0000 mgr.a (mgr.14355) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:06 smithi171 bash[25040]: audit 2024-09-14T05:16:05.194504+0000 mgr.a (mgr.14355) 17953 : audit [DBG] from='client.385695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:06 smithi171 bash[25040]: cluster 2024-09-14T05:16:05.607303+0000 mgr.a (mgr.14355) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:08 smithi007 bash[22722]: cluster 2024-09-14T05:16:07.608207+0000 mgr.a (mgr.14355) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:08 smithi131 bash[24745]: cluster 2024-09-14T05:16:07.608207+0000 mgr.a (mgr.14355) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:08 smithi171 bash[25040]: cluster 2024-09-14T05:16:07.608207+0000 mgr.a (mgr.14355) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:10.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:10.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:10.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:10 smithi007 bash[22722]: cluster 2024-09-14T05:16:09.609151+0000 mgr.a (mgr.14355) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:10 smithi131 bash[24745]: cluster 2024-09-14T05:16:09.609151+0000 mgr.a (mgr.14355) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:10 smithi171 bash[25040]: cluster 2024-09-14T05:16:09.609151+0000 mgr.a (mgr.14355) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:11.413 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:12 smithi007 bash[22722]: audit 2024-09-14T05:16:10.971517+0000 mgr.a (mgr.14355) 17957 : audit [DBG] from='client.385773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:12 smithi007 bash[22722]: cluster 2024-09-14T05:16:11.612061+0000 mgr.a (mgr.14355) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:12 smithi131 bash[24745]: audit 2024-09-14T05:16:10.971517+0000 mgr.a (mgr.14355) 17957 : audit [DBG] from='client.385773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:12 smithi131 bash[24745]: cluster 2024-09-14T05:16:11.612061+0000 mgr.a (mgr.14355) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:12 smithi171 bash[25040]: audit 2024-09-14T05:16:10.971517+0000 mgr.a (mgr.14355) 17957 : audit [DBG] from='client.385773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:12 smithi171 bash[25040]: cluster 2024-09-14T05:16:11.612061+0000 mgr.a (mgr.14355) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:14 smithi007 bash[22722]: cluster 2024-09-14T05:16:13.612858+0000 mgr.a (mgr.14355) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:14 smithi131 bash[24745]: cluster 2024-09-14T05:16:13.612858+0000 mgr.a (mgr.14355) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:14 smithi171 bash[25040]: cluster 2024-09-14T05:16:13.612858+0000 mgr.a (mgr.14355) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:16.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:16.415 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:17.190 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:17.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:17.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:17.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:17.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:16 smithi007 bash[22722]: cluster 2024-09-14T05:16:15.614965+0000 mgr.a (mgr.14355) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:16 smithi131 bash[24745]: cluster 2024-09-14T05:16:15.614965+0000 mgr.a (mgr.14355) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:16 smithi171 bash[25040]: cluster 2024-09-14T05:16:15.614965+0000 mgr.a (mgr.14355) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:17 smithi007 bash[22722]: audit 2024-09-14T05:16:16.751363+0000 mgr.a (mgr.14355) 17961 : audit [DBG] from='client.385851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:17 smithi131 bash[24745]: audit 2024-09-14T05:16:16.751363+0000 mgr.a (mgr.14355) 17961 : audit [DBG] from='client.385851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:17 smithi171 bash[25040]: audit 2024-09-14T05:16:16.751363+0000 mgr.a (mgr.14355) 17961 : audit [DBG] from='client.385851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:18 smithi007 bash[22722]: cluster 2024-09-14T05:16:17.615940+0000 mgr.a (mgr.14355) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:18 smithi131 bash[24745]: cluster 2024-09-14T05:16:17.615940+0000 mgr.a (mgr.14355) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:18 smithi171 bash[25040]: cluster 2024-09-14T05:16:17.615940+0000 mgr.a (mgr.14355) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:20 smithi007 bash[22722]: cluster 2024-09-14T05:16:19.616750+0000 mgr.a (mgr.14355) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:20 smithi131 bash[24745]: cluster 2024-09-14T05:16:19.616750+0000 mgr.a (mgr.14355) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:20 smithi171 bash[25040]: cluster 2024-09-14T05:16:19.616750+0000 mgr.a (mgr.14355) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:21 smithi007 bash[22722]: audit 2024-09-14T05:16:21.322162+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:16:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:21 smithi131 bash[24745]: audit 2024-09-14T05:16:21.322162+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:16:22.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:21 smithi171 bash[25040]: audit 2024-09-14T05:16:21.322162+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:16:22.960 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:22.960 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:22.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: cluster 2024-09-14T05:16:21.618940+0000 mgr.a (mgr.14355) 17964 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:21.929393+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:21.936733+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:21.943584+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:21.953567+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.521501+0000 mgr.a (mgr.14355) 17965 : audit [DBG] from='client.385926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.748224+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.749291+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.755638+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.757863+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:22 smithi007 bash[22722]: audit 2024-09-14T05:16:22.759017+0000 mgr.a (mgr.14355) 17966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: cluster 2024-09-14T05:16:21.618940+0000 mgr.a (mgr.14355) 17964 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:21.929393+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:21.936733+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:21.943584+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:21.953567+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.521501+0000 mgr.a (mgr.14355) 17965 : audit [DBG] from='client.385926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.748224+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.749291+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.755638+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.757863+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:22 smithi131 bash[24745]: audit 2024-09-14T05:16:22.759017+0000 mgr.a (mgr.14355) 17966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: cluster 2024-09-14T05:16:21.618940+0000 mgr.a (mgr.14355) 17964 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:21.929393+0000 mon.a (mon.0) 3267 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:21.936733+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:21.943584+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:21.953567+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.521501+0000 mgr.a (mgr.14355) 17965 : audit [DBG] from='client.385926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.748224+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.749291+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.755638+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.757863+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:22 smithi171 bash[25040]: audit 2024-09-14T05:16:22.759017+0000 mgr.a (mgr.14355) 17966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:16:23.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:16:23 smithi007 bash[22972]: debug 2024-09-14T05:16:23.642+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:16:23.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:16:23 smithi007 bash[22972]: debug 2024-09-14T05:16:23.642+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:16:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:23 smithi007 bash[22722]: cluster 2024-09-14T05:16:23.619420+0000 mgr.a (mgr.14355) 17967 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:23 smithi007 bash[22722]: audit 2024-09-14T05:16:23.648551+0000 mgr.a (mgr.14355) 17968 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:16:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:23 smithi007 bash[22722]: cephadm 2024-09-14T05:16:23.649841+0000 mgr.a (mgr.14355) 17969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:16:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:23 smithi131 bash[24745]: cluster 2024-09-14T05:16:23.619420+0000 mgr.a (mgr.14355) 17967 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:23 smithi131 bash[24745]: audit 2024-09-14T05:16:23.648551+0000 mgr.a (mgr.14355) 17968 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:16:24.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:23 smithi131 bash[24745]: cephadm 2024-09-14T05:16:23.649841+0000 mgr.a (mgr.14355) 17969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:16:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:23 smithi171 bash[25040]: cluster 2024-09-14T05:16:23.619420+0000 mgr.a (mgr.14355) 17967 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:23 smithi171 bash[25040]: audit 2024-09-14T05:16:23.648551+0000 mgr.a (mgr.14355) 17968 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:16:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:23 smithi171 bash[25040]: cephadm 2024-09-14T05:16:23.649841+0000 mgr.a (mgr.14355) 17969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:16:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:26 smithi007 bash[22722]: cluster 2024-09-14T05:16:25.621517+0000 mgr.a (mgr.14355) 17970 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:26 smithi131 bash[24745]: cluster 2024-09-14T05:16:25.621517+0000 mgr.a (mgr.14355) 17970 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:26 smithi171 bash[25040]: cluster 2024-09-14T05:16:25.621517+0000 mgr.a (mgr.14355) 17970 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:28.750 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:28.750 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:28 smithi007 bash[22722]: cluster 2024-09-14T05:16:27.622287+0000 mgr.a (mgr.14355) 17971 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:28 smithi131 bash[24745]: cluster 2024-09-14T05:16:27.622287+0000 mgr.a (mgr.14355) 17971 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:28 smithi171 bash[25040]: cluster 2024-09-14T05:16:27.622287+0000 mgr.a (mgr.14355) 17971 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:29 smithi007 bash[22722]: audit 2024-09-14T05:16:28.300836+0000 mgr.a (mgr.14355) 17972 : audit [DBG] from='client.386112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:30.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:29 smithi131 bash[24745]: audit 2024-09-14T05:16:28.300836+0000 mgr.a (mgr.14355) 17972 : audit [DBG] from='client.386112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:29 smithi171 bash[25040]: audit 2024-09-14T05:16:28.300836+0000 mgr.a (mgr.14355) 17972 : audit [DBG] from='client.386112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:30 smithi007 bash[22722]: cluster 2024-09-14T05:16:29.623313+0000 mgr.a (mgr.14355) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:30 smithi131 bash[24745]: cluster 2024-09-14T05:16:29.623313+0000 mgr.a (mgr.14355) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:30 smithi171 bash[25040]: cluster 2024-09-14T05:16:29.623313+0000 mgr.a (mgr.14355) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:32 smithi007 bash[22722]: cluster 2024-09-14T05:16:31.625618+0000 mgr.a (mgr.14355) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:32 smithi131 bash[24745]: cluster 2024-09-14T05:16:31.625618+0000 mgr.a (mgr.14355) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:32 smithi171 bash[25040]: cluster 2024-09-14T05:16:31.625618+0000 mgr.a (mgr.14355) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:33.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:33.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:33.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:34.515 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:34 smithi007 bash[22722]: cluster 2024-09-14T05:16:33.626445+0000 mgr.a (mgr.14355) 17975 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:34 smithi131 bash[24745]: cluster 2024-09-14T05:16:33.626445+0000 mgr.a (mgr.14355) 17975 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:34 smithi171 bash[25040]: cluster 2024-09-14T05:16:33.626445+0000 mgr.a (mgr.14355) 17975 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:35 smithi131 bash[24745]: audit 2024-09-14T05:16:34.083806+0000 mgr.a (mgr.14355) 17976 : audit [DBG] from='client.386187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:35 smithi171 bash[25040]: audit 2024-09-14T05:16:34.083806+0000 mgr.a (mgr.14355) 17976 : audit [DBG] from='client.386187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:35 smithi007 bash[22722]: audit 2024-09-14T05:16:34.083806+0000 mgr.a (mgr.14355) 17976 : audit [DBG] from='client.386187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:36 smithi131 bash[24745]: cluster 2024-09-14T05:16:35.628732+0000 mgr.a (mgr.14355) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:36 smithi171 bash[25040]: cluster 2024-09-14T05:16:35.628732+0000 mgr.a (mgr.14355) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:36 smithi007 bash[22722]: cluster 2024-09-14T05:16:35.628732+0000 mgr.a (mgr.14355) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:16:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:38 smithi131 bash[24745]: cluster 2024-09-14T05:16:37.629504+0000 mgr.a (mgr.14355) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:38 smithi171 bash[25040]: cluster 2024-09-14T05:16:37.629504+0000 mgr.a (mgr.14355) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:38 smithi007 bash[22722]: cluster 2024-09-14T05:16:37.629504+0000 mgr.a (mgr.14355) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:40.260 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:40.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:40.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:40.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:40.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:40 smithi131 bash[24745]: cluster 2024-09-14T05:16:39.629959+0000 mgr.a (mgr.14355) 17979 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:40 smithi131 bash[24745]: audit 2024-09-14T05:16:39.847152+0000 mgr.a (mgr.14355) 17980 : audit [DBG] from='client.386256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:40 smithi171 bash[25040]: cluster 2024-09-14T05:16:39.629959+0000 mgr.a (mgr.14355) 17979 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:40 smithi171 bash[25040]: audit 2024-09-14T05:16:39.847152+0000 mgr.a (mgr.14355) 17980 : audit [DBG] from='client.386256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:40 smithi007 bash[22722]: cluster 2024-09-14T05:16:39.629959+0000 mgr.a (mgr.14355) 17979 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:41.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:40 smithi007 bash[22722]: audit 2024-09-14T05:16:39.847152+0000 mgr.a (mgr.14355) 17980 : audit [DBG] from='client.386256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:42 smithi131 bash[24745]: cluster 2024-09-14T05:16:41.632278+0000 mgr.a (mgr.14355) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:42 smithi171 bash[25040]: cluster 2024-09-14T05:16:41.632278+0000 mgr.a (mgr.14355) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:42 smithi007 bash[22722]: cluster 2024-09-14T05:16:41.632278+0000 mgr.a (mgr.14355) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:16:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:44 smithi131 bash[24745]: cluster 2024-09-14T05:16:43.633016+0000 mgr.a (mgr.14355) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:44 smithi171 bash[25040]: cluster 2024-09-14T05:16:43.633016+0000 mgr.a (mgr.14355) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:44 smithi007 bash[22722]: cluster 2024-09-14T05:16:43.633016+0000 mgr.a (mgr.14355) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:45.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:45.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:46.019 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:46.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:46.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:46 smithi131 bash[24745]: audit 2024-09-14T05:16:45.592053+0000 mgr.a (mgr.14355) 17983 : audit [DBG] from='client.386328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:46 smithi131 bash[24745]: cluster 2024-09-14T05:16:45.635033+0000 mgr.a (mgr.14355) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:46 smithi171 bash[25040]: audit 2024-09-14T05:16:45.592053+0000 mgr.a (mgr.14355) 17983 : audit [DBG] from='client.386328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:47.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:46 smithi171 bash[25040]: cluster 2024-09-14T05:16:45.635033+0000 mgr.a (mgr.14355) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:46 smithi007 bash[22722]: audit 2024-09-14T05:16:45.592053+0000 mgr.a (mgr.14355) 17983 : audit [DBG] from='client.386328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:46 smithi007 bash[22722]: cluster 2024-09-14T05:16:45.635033+0000 mgr.a (mgr.14355) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:48 smithi131 bash[24745]: cluster 2024-09-14T05:16:47.635913+0000 mgr.a (mgr.14355) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:48 smithi171 bash[25040]: cluster 2024-09-14T05:16:47.635913+0000 mgr.a (mgr.14355) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:48 smithi007 bash[22722]: cluster 2024-09-14T05:16:47.635913+0000 mgr.a (mgr.14355) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:16:51.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:51.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:51.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:50 smithi131 bash[24745]: cluster 2024-09-14T05:16:49.636690+0000 mgr.a (mgr.14355) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:50 smithi171 bash[25040]: cluster 2024-09-14T05:16:49.636690+0000 mgr.a (mgr.14355) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:50 smithi007 bash[22722]: cluster 2024-09-14T05:16:49.636690+0000 mgr.a (mgr.14355) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:51.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:52 smithi131 bash[24745]: audit 2024-09-14T05:16:51.347251+0000 mgr.a (mgr.14355) 17987 : audit [DBG] from='client.386406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:52 smithi131 bash[24745]: cluster 2024-09-14T05:16:51.638091+0000 mgr.a (mgr.14355) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:52 smithi171 bash[25040]: audit 2024-09-14T05:16:51.347251+0000 mgr.a (mgr.14355) 17987 : audit [DBG] from='client.386406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:53.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:52 smithi171 bash[25040]: cluster 2024-09-14T05:16:51.638091+0000 mgr.a (mgr.14355) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:52 smithi007 bash[22722]: audit 2024-09-14T05:16:51.347251+0000 mgr.a (mgr.14355) 17987 : audit [DBG] from='client.386406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:53.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:52 smithi007 bash[22722]: cluster 2024-09-14T05:16:51.638091+0000 mgr.a (mgr.14355) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:54 smithi131 bash[24745]: cluster 2024-09-14T05:16:53.638932+0000 mgr.a (mgr.14355) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:54 smithi171 bash[25040]: cluster 2024-09-14T05:16:53.638932+0000 mgr.a (mgr.14355) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:54 smithi007 bash[22722]: cluster 2024-09-14T05:16:53.638932+0000 mgr.a (mgr.14355) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:16:56.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:16:56.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:16:56.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:16:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:56 smithi131 bash[24745]: cluster 2024-09-14T05:16:55.641081+0000 mgr.a (mgr.14355) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:56 smithi171 bash[25040]: cluster 2024-09-14T05:16:55.641081+0000 mgr.a (mgr.14355) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:57.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:56 smithi007 bash[22722]: cluster 2024-09-14T05:16:55.641081+0000 mgr.a (mgr.14355) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:57.579 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:16:57.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:16:57.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:16:57.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:16:57.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:16:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:58 smithi131 bash[24745]: audit 2024-09-14T05:16:57.122515+0000 mgr.a (mgr.14355) 17991 : audit [DBG] from='client.143008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:16:58 smithi131 bash[24745]: cluster 2024-09-14T05:16:57.641860+0000 mgr.a (mgr.14355) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:58 smithi171 bash[25040]: audit 2024-09-14T05:16:57.122515+0000 mgr.a (mgr.14355) 17991 : audit [DBG] from='client.143008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:16:58 smithi171 bash[25040]: cluster 2024-09-14T05:16:57.641860+0000 mgr.a (mgr.14355) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:16:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:58 smithi007 bash[22722]: audit 2024-09-14T05:16:57.122515+0000 mgr.a (mgr.14355) 17991 : audit [DBG] from='client.143008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:16:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:16:58 smithi007 bash[22722]: cluster 2024-09-14T05:16:57.641860+0000 mgr.a (mgr.14355) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:00 smithi131 bash[24745]: cluster 2024-09-14T05:16:59.642665+0000 mgr.a (mgr.14355) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:00 smithi171 bash[25040]: cluster 2024-09-14T05:16:59.642665+0000 mgr.a (mgr.14355) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:01.117 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:00 smithi007 bash[22722]: cluster 2024-09-14T05:16:59.642665+0000 mgr.a (mgr.14355) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:02.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:02 smithi131 bash[24745]: cluster 2024-09-14T05:17:01.644886+0000 mgr.a (mgr.14355) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:02 smithi171 bash[25040]: cluster 2024-09-14T05:17:01.644886+0000 mgr.a (mgr.14355) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:02 smithi007 bash[22722]: cluster 2024-09-14T05:17:01.644886+0000 mgr.a (mgr.14355) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:03.340 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:03.341 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:03.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:04 smithi131 bash[24745]: audit 2024-09-14T05:17:02.914275+0000 mgr.a (mgr.14355) 17995 : audit [DBG] from='client.386559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:04 smithi131 bash[24745]: cluster 2024-09-14T05:17:03.645759+0000 mgr.a (mgr.14355) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:04 smithi171 bash[25040]: audit 2024-09-14T05:17:02.914275+0000 mgr.a (mgr.14355) 17995 : audit [DBG] from='client.386559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:04 smithi171 bash[25040]: cluster 2024-09-14T05:17:03.645759+0000 mgr.a (mgr.14355) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:04 smithi007 bash[22722]: audit 2024-09-14T05:17:02.914275+0000 mgr.a (mgr.14355) 17995 : audit [DBG] from='client.386559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:04 smithi007 bash[22722]: cluster 2024-09-14T05:17:03.645759+0000 mgr.a (mgr.14355) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:06 smithi131 bash[24745]: cluster 2024-09-14T05:17:05.647957+0000 mgr.a (mgr.14355) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:06 smithi171 bash[25040]: cluster 2024-09-14T05:17:05.647957+0000 mgr.a (mgr.14355) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:06 smithi007 bash[22722]: cluster 2024-09-14T05:17:05.647957+0000 mgr.a (mgr.14355) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:08.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:08.343 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:08.344 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:09.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:08 smithi131 bash[24745]: cluster 2024-09-14T05:17:07.648710+0000 mgr.a (mgr.14355) 17998 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:09.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:08 smithi171 bash[25040]: cluster 2024-09-14T05:17:07.648710+0000 mgr.a (mgr.14355) 17998 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:09.094 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:09.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:08 smithi007 bash[22722]: cluster 2024-09-14T05:17:07.648710+0000 mgr.a (mgr.14355) 17998 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:09 smithi131 bash[24745]: audit 2024-09-14T05:17:08.670998+0000 mgr.a (mgr.14355) 17999 : audit [DBG] from='client.386637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:09 smithi171 bash[25040]: audit 2024-09-14T05:17:08.670998+0000 mgr.a (mgr.14355) 17999 : audit [DBG] from='client.386637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:09 smithi007 bash[22722]: audit 2024-09-14T05:17:08.670998+0000 mgr.a (mgr.14355) 17999 : audit [DBG] from='client.386637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:10 smithi171 bash[25040]: cluster 2024-09-14T05:17:09.649723+0000 mgr.a (mgr.14355) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:10 smithi007 bash[22722]: cluster 2024-09-14T05:17:09.649723+0000 mgr.a (mgr.14355) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:10 smithi131 bash[24745]: cluster 2024-09-14T05:17:09.649723+0000 mgr.a (mgr.14355) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:12 smithi007 bash[22722]: cluster 2024-09-14T05:17:11.652008+0000 mgr.a (mgr.14355) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:12 smithi131 bash[24745]: cluster 2024-09-14T05:17:11.652008+0000 mgr.a (mgr.14355) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:12 smithi171 bash[25040]: cluster 2024-09-14T05:17:11.652008+0000 mgr.a (mgr.14355) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:14.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:14 smithi007 bash[22722]: cluster 2024-09-14T05:17:13.652783+0000 mgr.a (mgr.14355) 18002 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:14 smithi131 bash[24745]: cluster 2024-09-14T05:17:13.652783+0000 mgr.a (mgr.14355) 18002 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:14 smithi171 bash[25040]: cluster 2024-09-14T05:17:13.652783+0000 mgr.a (mgr.14355) 18002 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:15 smithi007 bash[22722]: audit 2024-09-14T05:17:14.431320+0000 mgr.a (mgr.14355) 18003 : audit [DBG] from='client.386715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:15 smithi131 bash[24745]: audit 2024-09-14T05:17:14.431320+0000 mgr.a (mgr.14355) 18003 : audit [DBG] from='client.386715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:15 smithi171 bash[25040]: audit 2024-09-14T05:17:14.431320+0000 mgr.a (mgr.14355) 18003 : audit [DBG] from='client.386715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:16 smithi007 bash[22722]: cluster 2024-09-14T05:17:15.655164+0000 mgr.a (mgr.14355) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:16 smithi131 bash[24745]: cluster 2024-09-14T05:17:15.655164+0000 mgr.a (mgr.14355) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:16 smithi171 bash[25040]: cluster 2024-09-14T05:17:15.655164+0000 mgr.a (mgr.14355) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:19.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:18 smithi007 bash[22722]: cluster 2024-09-14T05:17:17.655905+0000 mgr.a (mgr.14355) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:18 smithi131 bash[24745]: cluster 2024-09-14T05:17:17.655905+0000 mgr.a (mgr.14355) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:18 smithi171 bash[25040]: cluster 2024-09-14T05:17:17.655905+0000 mgr.a (mgr.14355) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:20.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:20.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:20.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:20.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:20 smithi007 bash[22722]: cluster 2024-09-14T05:17:19.656674+0000 mgr.a (mgr.14355) 18006 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:20 smithi131 bash[24745]: cluster 2024-09-14T05:17:19.656674+0000 mgr.a (mgr.14355) 18006 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:20 smithi171 bash[25040]: cluster 2024-09-14T05:17:19.656674+0000 mgr.a (mgr.14355) 18006 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:21 smithi007 bash[22722]: audit 2024-09-14T05:17:20.218524+0000 mgr.a (mgr.14355) 18007 : audit [DBG] from='client.386793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:21 smithi131 bash[24745]: audit 2024-09-14T05:17:20.218524+0000 mgr.a (mgr.14355) 18007 : audit [DBG] from='client.386793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:21 smithi171 bash[25040]: audit 2024-09-14T05:17:20.218524+0000 mgr.a (mgr.14355) 18007 : audit [DBG] from='client.386793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:22 smithi007 bash[22722]: cluster 2024-09-14T05:17:21.659464+0000 mgr.a (mgr.14355) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:22 smithi131 bash[24745]: cluster 2024-09-14T05:17:21.659464+0000 mgr.a (mgr.14355) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:22 smithi171 bash[25040]: cluster 2024-09-14T05:17:21.659464+0000 mgr.a (mgr.14355) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:23 smithi007 bash[22722]: audit 2024-09-14T05:17:23.701943+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:17:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:23 smithi131 bash[24745]: audit 2024-09-14T05:17:23.701943+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:17:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:23 smithi171 bash[25040]: audit 2024-09-14T05:17:23.701943+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:17:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:24 smithi007 bash[22722]: cluster 2024-09-14T05:17:23.660207+0000 mgr.a (mgr.14355) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:17:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:24 smithi007 bash[22722]: audit 2024-09-14T05:17:24.563060+0000 mon.a (mon.0) 3276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:17:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:24 smithi007 bash[22722]: audit 2024-09-14T05:17:24.564222+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:17:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:24 smithi007 bash[22722]: audit 2024-09-14T05:17:24.572583+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:17:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:24 smithi007 bash[22722]: audit 2024-09-14T05:17:24.577192+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:24 smithi131 bash[24745]: cluster 2024-09-14T05:17:23.660207+0000 mgr.a (mgr.14355) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:17:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:24 smithi131 bash[24745]: audit 2024-09-14T05:17:24.563060+0000 mon.a (mon.0) 3276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:17:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:24 smithi131 bash[24745]: audit 2024-09-14T05:17:24.564222+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:17:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:24 smithi131 bash[24745]: audit 2024-09-14T05:17:24.572583+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:17:25.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:24 smithi131 bash[24745]: audit 2024-09-14T05:17:24.577192+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:24 smithi171 bash[25040]: cluster 2024-09-14T05:17:23.660207+0000 mgr.a (mgr.14355) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:17:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:24 smithi171 bash[25040]: audit 2024-09-14T05:17:24.563060+0000 mon.a (mon.0) 3276 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:17:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:24 smithi171 bash[25040]: audit 2024-09-14T05:17:24.564222+0000 mon.a (mon.0) 3277 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:17:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:24 smithi171 bash[25040]: audit 2024-09-14T05:17:24.572583+0000 mon.a (mon.0) 3278 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:17:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:24 smithi171 bash[25040]: audit 2024-09-14T05:17:24.577192+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:25.659 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:25.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:17:25 smithi007 bash[22972]: debug 2024-09-14T05:17:25.317+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:17:25.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:17:25 smithi007 bash[22972]: debug 2024-09-14T05:17:25.321+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:17:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:25 smithi007 bash[22722]: audit 2024-09-14T05:17:24.578507+0000 mgr.a (mgr.14355) 18010 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:25 smithi131 bash[24745]: audit 2024-09-14T05:17:24.578507+0000 mgr.a (mgr.14355) 18010 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:25 smithi171 bash[25040]: audit 2024-09-14T05:17:24.578507+0000 mgr.a (mgr.14355) 18010 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:17:26.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:26.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:26.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:26 smithi007 bash[22722]: audit 2024-09-14T05:17:25.321764+0000 mgr.a (mgr.14355) 18011 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:17:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:26 smithi007 bash[22722]: cephadm 2024-09-14T05:17:25.323053+0000 mgr.a (mgr.14355) 18012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:17:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:26 smithi007 bash[22722]: cluster 2024-09-14T05:17:25.661565+0000 mgr.a (mgr.14355) 18013 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:26 smithi131 bash[24745]: audit 2024-09-14T05:17:25.321764+0000 mgr.a (mgr.14355) 18011 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:17:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:26 smithi131 bash[24745]: cephadm 2024-09-14T05:17:25.323053+0000 mgr.a (mgr.14355) 18012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:17:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:26 smithi131 bash[24745]: cluster 2024-09-14T05:17:25.661565+0000 mgr.a (mgr.14355) 18013 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:26 smithi171 bash[25040]: audit 2024-09-14T05:17:25.321764+0000 mgr.a (mgr.14355) 18011 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:17:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:26 smithi171 bash[25040]: cephadm 2024-09-14T05:17:25.323053+0000 mgr.a (mgr.14355) 18012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:17:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:26 smithi171 bash[25040]: cluster 2024-09-14T05:17:25.661565+0000 mgr.a (mgr.14355) 18013 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:27 smithi007 bash[22722]: audit 2024-09-14T05:17:25.980786+0000 mgr.a (mgr.14355) 18014 : audit [DBG] from='client.386973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:27 smithi131 bash[24745]: audit 2024-09-14T05:17:25.980786+0000 mgr.a (mgr.14355) 18014 : audit [DBG] from='client.386973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:27 smithi171 bash[25040]: audit 2024-09-14T05:17:25.980786+0000 mgr.a (mgr.14355) 18014 : audit [DBG] from='client.386973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:28 smithi007 bash[22722]: cluster 2024-09-14T05:17:27.662440+0000 mgr.a (mgr.14355) 18015 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:28 smithi131 bash[24745]: cluster 2024-09-14T05:17:27.662440+0000 mgr.a (mgr.14355) 18015 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:28 smithi171 bash[25040]: cluster 2024-09-14T05:17:27.662440+0000 mgr.a (mgr.14355) 18015 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:30 smithi007 bash[22722]: cluster 2024-09-14T05:17:29.663218+0000 mgr.a (mgr.14355) 18016 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:30 smithi131 bash[24745]: cluster 2024-09-14T05:17:29.663218+0000 mgr.a (mgr.14355) 18016 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:30 smithi171 bash[25040]: cluster 2024-09-14T05:17:29.663218+0000 mgr.a (mgr.14355) 18016 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:17:31.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:31.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:31.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:32.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:32.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:32.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:32.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:32.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:32 smithi007 bash[22722]: cluster 2024-09-14T05:17:31.665382+0000 mgr.a (mgr.14355) 18017 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:32 smithi007 bash[22722]: audit 2024-09-14T05:17:31.746837+0000 mgr.a (mgr.14355) 18018 : audit [DBG] from='client.387048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:32 smithi131 bash[24745]: cluster 2024-09-14T05:17:31.665382+0000 mgr.a (mgr.14355) 18017 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:32 smithi131 bash[24745]: audit 2024-09-14T05:17:31.746837+0000 mgr.a (mgr.14355) 18018 : audit [DBG] from='client.387048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:32 smithi171 bash[25040]: cluster 2024-09-14T05:17:31.665382+0000 mgr.a (mgr.14355) 18017 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:32 smithi171 bash[25040]: audit 2024-09-14T05:17:31.746837+0000 mgr.a (mgr.14355) 18018 : audit [DBG] from='client.387048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:35.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:34 smithi007 bash[22722]: cluster 2024-09-14T05:17:33.666450+0000 mgr.a (mgr.14355) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:35.296 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:34 smithi131 bash[24745]: cluster 2024-09-14T05:17:33.666450+0000 mgr.a (mgr.14355) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:35.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:34 smithi171 bash[25040]: cluster 2024-09-14T05:17:33.666450+0000 mgr.a (mgr.14355) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:35 smithi007 bash[22722]: cluster 2024-09-14T05:17:35.668648+0000 mgr.a (mgr.14355) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:35 smithi131 bash[24745]: cluster 2024-09-14T05:17:35.668648+0000 mgr.a (mgr.14355) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:35 smithi171 bash[25040]: cluster 2024-09-14T05:17:35.668648+0000 mgr.a (mgr.14355) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:17:37.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:37.195 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:37.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:37.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:37.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:37.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:37.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:38 smithi131 bash[24745]: audit 2024-09-14T05:17:37.528088+0000 mgr.a (mgr.14355) 18021 : audit [DBG] from='client.387126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:38 smithi131 bash[24745]: cluster 2024-09-14T05:17:37.669389+0000 mgr.a (mgr.14355) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:38 smithi171 bash[25040]: audit 2024-09-14T05:17:37.528088+0000 mgr.a (mgr.14355) 18021 : audit [DBG] from='client.387126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:38 smithi171 bash[25040]: cluster 2024-09-14T05:17:37.669389+0000 mgr.a (mgr.14355) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:38 smithi007 bash[22722]: audit 2024-09-14T05:17:37.528088+0000 mgr.a (mgr.14355) 18021 : audit [DBG] from='client.387126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:38 smithi007 bash[22722]: cluster 2024-09-14T05:17:37.669389+0000 mgr.a (mgr.14355) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:40 smithi131 bash[24745]: cluster 2024-09-14T05:17:39.670256+0000 mgr.a (mgr.14355) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:40 smithi171 bash[25040]: cluster 2024-09-14T05:17:39.670256+0000 mgr.a (mgr.14355) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:40 smithi007 bash[22722]: cluster 2024-09-14T05:17:39.670256+0000 mgr.a (mgr.14355) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:42 smithi131 bash[24745]: cluster 2024-09-14T05:17:41.672517+0000 mgr.a (mgr.14355) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:42 smithi171 bash[25040]: cluster 2024-09-14T05:17:41.672517+0000 mgr.a (mgr.14355) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:42 smithi007 bash[22722]: cluster 2024-09-14T05:17:41.672517+0000 mgr.a (mgr.14355) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:43.733 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:43.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:44 smithi131 bash[24745]: audit 2024-09-14T05:17:43.284444+0000 mgr.a (mgr.14355) 18025 : audit [DBG] from='client.387204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:44 smithi131 bash[24745]: cluster 2024-09-14T05:17:43.673019+0000 mgr.a (mgr.14355) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:44 smithi171 bash[25040]: audit 2024-09-14T05:17:43.284444+0000 mgr.a (mgr.14355) 18025 : audit [DBG] from='client.387204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:44 smithi171 bash[25040]: cluster 2024-09-14T05:17:43.673019+0000 mgr.a (mgr.14355) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:44 smithi007 bash[22722]: audit 2024-09-14T05:17:43.284444+0000 mgr.a (mgr.14355) 18025 : audit [DBG] from='client.387204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:44 smithi007 bash[22722]: cluster 2024-09-14T05:17:43.673019+0000 mgr.a (mgr.14355) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:46 smithi131 bash[24745]: cluster 2024-09-14T05:17:45.675163+0000 mgr.a (mgr.14355) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:46 smithi171 bash[25040]: cluster 2024-09-14T05:17:45.675163+0000 mgr.a (mgr.14355) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:46 smithi007 bash[22722]: cluster 2024-09-14T05:17:45.675163+0000 mgr.a (mgr.14355) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:48.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:48.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:48.735 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:48 smithi131 bash[24745]: cluster 2024-09-14T05:17:47.675973+0000 mgr.a (mgr.14355) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:48 smithi171 bash[25040]: cluster 2024-09-14T05:17:47.675973+0000 mgr.a (mgr.14355) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:48 smithi007 bash[22722]: cluster 2024-09-14T05:17:47.675973+0000 mgr.a (mgr.14355) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:50 smithi131 bash[24745]: audit 2024-09-14T05:17:49.070553+0000 mgr.a (mgr.14355) 18029 : audit [DBG] from='client.387282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:50 smithi131 bash[24745]: cluster 2024-09-14T05:17:49.677063+0000 mgr.a (mgr.14355) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:50 smithi171 bash[25040]: audit 2024-09-14T05:17:49.070553+0000 mgr.a (mgr.14355) 18029 : audit [DBG] from='client.387282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:51.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:50 smithi171 bash[25040]: cluster 2024-09-14T05:17:49.677063+0000 mgr.a (mgr.14355) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:50 smithi007 bash[22722]: audit 2024-09-14T05:17:49.070553+0000 mgr.a (mgr.14355) 18029 : audit [DBG] from='client.387282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:50 smithi007 bash[22722]: cluster 2024-09-14T05:17:49.677063+0000 mgr.a (mgr.14355) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:52 smithi131 bash[24745]: cluster 2024-09-14T05:17:51.679474+0000 mgr.a (mgr.14355) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:52 smithi171 bash[25040]: cluster 2024-09-14T05:17:51.679474+0000 mgr.a (mgr.14355) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:52 smithi007 bash[22722]: cluster 2024-09-14T05:17:51.679474+0000 mgr.a (mgr.14355) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:54.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:17:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:17:54.493 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:17:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:54 smithi131 bash[24745]: cluster 2024-09-14T05:17:53.680439+0000 mgr.a (mgr.14355) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:54 smithi171 bash[25040]: cluster 2024-09-14T05:17:53.680439+0000 mgr.a (mgr.14355) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:54 smithi007 bash[22722]: cluster 2024-09-14T05:17:53.680439+0000 mgr.a (mgr.14355) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:17:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:17:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:17:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:17:55.270 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:17:56.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:55 smithi131 bash[24745]: audit 2024-09-14T05:17:54.827212+0000 mgr.a (mgr.14355) 18033 : audit [DBG] from='client.387360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:55 smithi171 bash[25040]: audit 2024-09-14T05:17:54.827212+0000 mgr.a (mgr.14355) 18033 : audit [DBG] from='client.387360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:55 smithi007 bash[22722]: audit 2024-09-14T05:17:54.827212+0000 mgr.a (mgr.14355) 18033 : audit [DBG] from='client.387360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:17:57.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:56 smithi131 bash[24745]: cluster 2024-09-14T05:17:55.682808+0000 mgr.a (mgr.14355) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:57.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:56 smithi171 bash[25040]: cluster 2024-09-14T05:17:55.682808+0000 mgr.a (mgr.14355) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:56 smithi007 bash[22722]: cluster 2024-09-14T05:17:55.682808+0000 mgr.a (mgr.14355) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:17:59.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:17:58 smithi131 bash[24745]: cluster 2024-09-14T05:17:57.683581+0000 mgr.a (mgr.14355) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:17:58 smithi171 bash[25040]: cluster 2024-09-14T05:17:57.683581+0000 mgr.a (mgr.14355) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:17:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:17:58 smithi007 bash[22722]: cluster 2024-09-14T05:17:57.683581+0000 mgr.a (mgr.14355) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:00.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:00.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:00.272 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:01.029 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:01.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:01.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:01.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:01.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:00 smithi131 bash[24745]: cluster 2024-09-14T05:17:59.684492+0000 mgr.a (mgr.14355) 18036 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:00 smithi171 bash[25040]: cluster 2024-09-14T05:17:59.684492+0000 mgr.a (mgr.14355) 18036 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:00 smithi007 bash[22722]: cluster 2024-09-14T05:17:59.684492+0000 mgr.a (mgr.14355) 18036 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:01 smithi131 bash[24745]: audit 2024-09-14T05:18:00.601873+0000 mgr.a (mgr.14355) 18037 : audit [DBG] from='client.387438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:01 smithi171 bash[25040]: audit 2024-09-14T05:18:00.601873+0000 mgr.a (mgr.14355) 18037 : audit [DBG] from='client.387438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:01 smithi007 bash[22722]: audit 2024-09-14T05:18:00.601873+0000 mgr.a (mgr.14355) 18037 : audit [DBG] from='client.387438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:03.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:02 smithi171 bash[25040]: cluster 2024-09-14T05:18:01.687414+0000 mgr.a (mgr.14355) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:02 smithi007 bash[22722]: cluster 2024-09-14T05:18:01.687414+0000 mgr.a (mgr.14355) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:02 smithi131 bash[24745]: cluster 2024-09-14T05:18:01.687414+0000 mgr.a (mgr.14355) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:04 smithi171 bash[25040]: cluster 2024-09-14T05:18:03.688211+0000 mgr.a (mgr.14355) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:04 smithi007 bash[22722]: cluster 2024-09-14T05:18:03.688211+0000 mgr.a (mgr.14355) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:04 smithi131 bash[24745]: cluster 2024-09-14T05:18:03.688211+0000 mgr.a (mgr.14355) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:06.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:06.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:06.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:06 smithi007 bash[22722]: cluster 2024-09-14T05:18:05.690156+0000 mgr.a (mgr.14355) 18040 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:06 smithi131 bash[24745]: cluster 2024-09-14T05:18:05.690156+0000 mgr.a (mgr.14355) 18040 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:06 smithi171 bash[25040]: cluster 2024-09-14T05:18:05.690156+0000 mgr.a (mgr.14355) 18040 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:07 smithi007 bash[22722]: audit 2024-09-14T05:18:06.361937+0000 mgr.a (mgr.14355) 18041 : audit [DBG] from='client.387513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:07 smithi131 bash[24745]: audit 2024-09-14T05:18:06.361937+0000 mgr.a (mgr.14355) 18041 : audit [DBG] from='client.387513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:07 smithi171 bash[25040]: audit 2024-09-14T05:18:06.361937+0000 mgr.a (mgr.14355) 18041 : audit [DBG] from='client.387513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:08 smithi007 bash[22722]: cluster 2024-09-14T05:18:07.691268+0000 mgr.a (mgr.14355) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:08 smithi131 bash[24745]: cluster 2024-09-14T05:18:07.691268+0000 mgr.a (mgr.14355) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:08 smithi171 bash[25040]: cluster 2024-09-14T05:18:07.691268+0000 mgr.a (mgr.14355) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:10 smithi007 bash[22722]: cluster 2024-09-14T05:18:09.692083+0000 mgr.a (mgr.14355) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:18:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:10 smithi131 bash[24745]: cluster 2024-09-14T05:18:09.692083+0000 mgr.a (mgr.14355) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:18:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:10 smithi171 bash[25040]: cluster 2024-09-14T05:18:09.692083+0000 mgr.a (mgr.14355) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:18:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:11.786 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:12.572 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:12.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:12.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:12.572 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:12.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:12 smithi007 bash[22722]: cluster 2024-09-14T05:18:11.694475+0000 mgr.a (mgr.14355) 18044 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:12 smithi131 bash[24745]: cluster 2024-09-14T05:18:11.694475+0000 mgr.a (mgr.14355) 18044 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:12 smithi171 bash[25040]: cluster 2024-09-14T05:18:11.694475+0000 mgr.a (mgr.14355) 18044 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:13 smithi007 bash[22722]: audit 2024-09-14T05:18:12.123201+0000 mgr.a (mgr.14355) 18045 : audit [DBG] from='client.387588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:13 smithi131 bash[24745]: audit 2024-09-14T05:18:12.123201+0000 mgr.a (mgr.14355) 18045 : audit [DBG] from='client.387588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:13 smithi171 bash[25040]: audit 2024-09-14T05:18:12.123201+0000 mgr.a (mgr.14355) 18045 : audit [DBG] from='client.387588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:14 smithi007 bash[22722]: cluster 2024-09-14T05:18:13.695445+0000 mgr.a (mgr.14355) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:14 smithi131 bash[24745]: cluster 2024-09-14T05:18:13.695445+0000 mgr.a (mgr.14355) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:14 smithi171 bash[25040]: cluster 2024-09-14T05:18:13.695445+0000 mgr.a (mgr.14355) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:16 smithi007 bash[22722]: cluster 2024-09-14T05:18:15.697618+0000 mgr.a (mgr.14355) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:16 smithi131 bash[24745]: cluster 2024-09-14T05:18:15.697618+0000 mgr.a (mgr.14355) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:16 smithi171 bash[25040]: cluster 2024-09-14T05:18:15.697618+0000 mgr.a (mgr.14355) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:18.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:18.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:18.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:18.347 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:18 smithi007 bash[22722]: cluster 2024-09-14T05:18:17.698072+0000 mgr.a (mgr.14355) 18048 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:18 smithi131 bash[24745]: cluster 2024-09-14T05:18:17.698072+0000 mgr.a (mgr.14355) 18048 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:18 smithi171 bash[25040]: cluster 2024-09-14T05:18:17.698072+0000 mgr.a (mgr.14355) 18048 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:19 smithi007 bash[22722]: audit 2024-09-14T05:18:17.908246+0000 mgr.a (mgr.14355) 18049 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:19 smithi131 bash[24745]: audit 2024-09-14T05:18:17.908246+0000 mgr.a (mgr.14355) 18049 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:19 smithi171 bash[25040]: audit 2024-09-14T05:18:17.908246+0000 mgr.a (mgr.14355) 18049 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:20 smithi007 bash[22722]: cluster 2024-09-14T05:18:19.698995+0000 mgr.a (mgr.14355) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:20 smithi131 bash[24745]: cluster 2024-09-14T05:18:19.698995+0000 mgr.a (mgr.14355) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:20 smithi171 bash[25040]: cluster 2024-09-14T05:18:19.698995+0000 mgr.a (mgr.14355) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:22 smithi007 bash[22722]: cluster 2024-09-14T05:18:21.701267+0000 mgr.a (mgr.14355) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:22 smithi131 bash[24745]: cluster 2024-09-14T05:18:21.701267+0000 mgr.a (mgr.14355) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:22 smithi171 bash[25040]: cluster 2024-09-14T05:18:21.701267+0000 mgr.a (mgr.14355) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:23.348 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:23.349 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:24 smithi007 bash[22722]: audit 2024-09-14T05:18:23.682714+0000 mgr.a (mgr.14355) 18052 : audit [DBG] from='client.387741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:24 smithi007 bash[22722]: cluster 2024-09-14T05:18:23.702727+0000 mgr.a (mgr.14355) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:24 smithi131 bash[24745]: audit 2024-09-14T05:18:23.682714+0000 mgr.a (mgr.14355) 18052 : audit [DBG] from='client.387741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:24 smithi131 bash[24745]: cluster 2024-09-14T05:18:23.702727+0000 mgr.a (mgr.14355) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:24 smithi171 bash[25040]: audit 2024-09-14T05:18:23.682714+0000 mgr.a (mgr.14355) 18052 : audit [DBG] from='client.387741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:24 smithi171 bash[25040]: cluster 2024-09-14T05:18:23.702727+0000 mgr.a (mgr.14355) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:25 smithi007 bash[22722]: audit 2024-09-14T05:18:25.373703+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:18:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:25 smithi131 bash[24745]: audit 2024-09-14T05:18:25.373703+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:18:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:25 smithi171 bash[25040]: audit 2024-09-14T05:18:25.373703+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:18:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22972]: debug 2024-09-14T05:18:26.956+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:18:27.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22972]: debug 2024-09-14T05:18:26.956+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22722]: cluster 2024-09-14T05:18:25.704248+0000 mgr.a (mgr.14355) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22722]: audit 2024-09-14T05:18:26.198371+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22722]: audit 2024-09-14T05:18:26.199448+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22722]: audit 2024-09-14T05:18:26.207525+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:18:27.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:26 smithi007 bash[22722]: audit 2024-09-14T05:18:26.212613+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:26 smithi131 bash[24745]: cluster 2024-09-14T05:18:25.704248+0000 mgr.a (mgr.14355) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:26 smithi131 bash[24745]: audit 2024-09-14T05:18:26.198371+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:18:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:26 smithi131 bash[24745]: audit 2024-09-14T05:18:26.199448+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:18:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:26 smithi131 bash[24745]: audit 2024-09-14T05:18:26.207525+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:18:27.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:26 smithi131 bash[24745]: audit 2024-09-14T05:18:26.212613+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:26 smithi171 bash[25040]: cluster 2024-09-14T05:18:25.704248+0000 mgr.a (mgr.14355) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:26 smithi171 bash[25040]: audit 2024-09-14T05:18:26.198371+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:18:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:26 smithi171 bash[25040]: audit 2024-09-14T05:18:26.199448+0000 mon.a (mon.0) 3282 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:18:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:26 smithi171 bash[25040]: audit 2024-09-14T05:18:26.207525+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:18:27.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:26 smithi171 bash[25040]: audit 2024-09-14T05:18:26.212613+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:27 smithi007 bash[22722]: audit 2024-09-14T05:18:26.214874+0000 mgr.a (mgr.14355) 18055 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:27 smithi131 bash[24745]: audit 2024-09-14T05:18:26.214874+0000 mgr.a (mgr.14355) 18055 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:27 smithi171 bash[25040]: audit 2024-09-14T05:18:26.214874+0000 mgr.a (mgr.14355) 18055 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:18:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:28 smithi007 bash[22722]: audit 2024-09-14T05:18:26.959194+0000 mgr.a (mgr.14355) 18056 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:18:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:28 smithi007 bash[22722]: cephadm 2024-09-14T05:18:26.961027+0000 mgr.a (mgr.14355) 18057 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:18:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:28 smithi007 bash[22722]: cluster 2024-09-14T05:18:27.705174+0000 mgr.a (mgr.14355) 18058 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:28 smithi131 bash[24745]: audit 2024-09-14T05:18:26.959194+0000 mgr.a (mgr.14355) 18056 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:18:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:28 smithi131 bash[24745]: cephadm 2024-09-14T05:18:26.961027+0000 mgr.a (mgr.14355) 18057 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:18:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:28 smithi131 bash[24745]: cluster 2024-09-14T05:18:27.705174+0000 mgr.a (mgr.14355) 18058 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:28 smithi171 bash[25040]: audit 2024-09-14T05:18:26.959194+0000 mgr.a (mgr.14355) 18056 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:18:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:28 smithi171 bash[25040]: cephadm 2024-09-14T05:18:26.961027+0000 mgr.a (mgr.14355) 18057 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:18:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:28 smithi171 bash[25040]: cluster 2024-09-14T05:18:27.705174+0000 mgr.a (mgr.14355) 18058 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:29.881 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:29.881 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:30 smithi007 bash[22722]: audit 2024-09-14T05:18:29.462215+0000 mgr.a (mgr.14355) 18059 : audit [DBG] from='client.387924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:30 smithi007 bash[22722]: cluster 2024-09-14T05:18:29.705725+0000 mgr.a (mgr.14355) 18060 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:30 smithi131 bash[24745]: audit 2024-09-14T05:18:29.462215+0000 mgr.a (mgr.14355) 18059 : audit [DBG] from='client.387924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:30 smithi131 bash[24745]: cluster 2024-09-14T05:18:29.705725+0000 mgr.a (mgr.14355) 18060 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:30 smithi171 bash[25040]: audit 2024-09-14T05:18:29.462215+0000 mgr.a (mgr.14355) 18059 : audit [DBG] from='client.387924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:30 smithi171 bash[25040]: cluster 2024-09-14T05:18:29.705725+0000 mgr.a (mgr.14355) 18060 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:32 smithi007 bash[22722]: cluster 2024-09-14T05:18:31.708214+0000 mgr.a (mgr.14355) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:32 smithi131 bash[24745]: cluster 2024-09-14T05:18:31.708214+0000 mgr.a (mgr.14355) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:32 smithi171 bash[25040]: cluster 2024-09-14T05:18:31.708214+0000 mgr.a (mgr.14355) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:34.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:34 smithi007 bash[22722]: cluster 2024-09-14T05:18:33.709026+0000 mgr.a (mgr.14355) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:34 smithi131 bash[24745]: cluster 2024-09-14T05:18:33.709026+0000 mgr.a (mgr.14355) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:34 smithi171 bash[25040]: cluster 2024-09-14T05:18:33.709026+0000 mgr.a (mgr.14355) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:35.660 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:35 smithi007 bash[22722]: audit 2024-09-14T05:18:35.219682+0000 mgr.a (mgr.14355) 18063 : audit [DBG] from='client.387999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:35 smithi007 bash[22722]: cluster 2024-09-14T05:18:35.710347+0000 mgr.a (mgr.14355) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:35 smithi131 bash[24745]: audit 2024-09-14T05:18:35.219682+0000 mgr.a (mgr.14355) 18063 : audit [DBG] from='client.387999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:35 smithi131 bash[24745]: cluster 2024-09-14T05:18:35.710347+0000 mgr.a (mgr.14355) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:35 smithi171 bash[25040]: audit 2024-09-14T05:18:35.219682+0000 mgr.a (mgr.14355) 18063 : audit [DBG] from='client.387999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:35 smithi171 bash[25040]: cluster 2024-09-14T05:18:35.710347+0000 mgr.a (mgr.14355) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:39.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:38 smithi131 bash[24745]: cluster 2024-09-14T05:18:37.711099+0000 mgr.a (mgr.14355) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:39.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:38 smithi171 bash[25040]: cluster 2024-09-14T05:18:37.711099+0000 mgr.a (mgr.14355) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:38 smithi007 bash[22722]: cluster 2024-09-14T05:18:37.711099+0000 mgr.a (mgr.14355) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:40.662 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:40.663 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:40 smithi131 bash[24745]: cluster 2024-09-14T05:18:39.711885+0000 mgr.a (mgr.14355) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:40 smithi171 bash[25040]: cluster 2024-09-14T05:18:39.711885+0000 mgr.a (mgr.14355) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:40 smithi007 bash[22722]: cluster 2024-09-14T05:18:39.711885+0000 mgr.a (mgr.14355) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:18:41.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:41.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:41.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:42 smithi131 bash[24745]: audit 2024-09-14T05:18:40.992794+0000 mgr.a (mgr.14355) 18067 : audit [DBG] from='client.388074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:43.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:42 smithi131 bash[24745]: cluster 2024-09-14T05:18:41.714718+0000 mgr.a (mgr.14355) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:42 smithi171 bash[25040]: audit 2024-09-14T05:18:40.992794+0000 mgr.a (mgr.14355) 18067 : audit [DBG] from='client.388074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:42 smithi171 bash[25040]: cluster 2024-09-14T05:18:41.714718+0000 mgr.a (mgr.14355) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:42 smithi007 bash[22722]: audit 2024-09-14T05:18:40.992794+0000 mgr.a (mgr.14355) 18067 : audit [DBG] from='client.388074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:42 smithi007 bash[22722]: cluster 2024-09-14T05:18:41.714718+0000 mgr.a (mgr.14355) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:18:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:44 smithi131 bash[24745]: cluster 2024-09-14T05:18:43.715493+0000 mgr.a (mgr.14355) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:45.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:44 smithi171 bash[25040]: cluster 2024-09-14T05:18:43.715493+0000 mgr.a (mgr.14355) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:44 smithi007 bash[22722]: cluster 2024-09-14T05:18:43.715493+0000 mgr.a (mgr.14355) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:18:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:46.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:46 smithi171 bash[25040]: cluster 2024-09-14T05:18:45.717417+0000 mgr.a (mgr.14355) 18070 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:47.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:47.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:47.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:47.162 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:46 smithi007 bash[22722]: cluster 2024-09-14T05:18:45.717417+0000 mgr.a (mgr.14355) 18070 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:46 smithi131 bash[24745]: cluster 2024-09-14T05:18:45.717417+0000 mgr.a (mgr.14355) 18070 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:47 smithi171 bash[25040]: audit 2024-09-14T05:18:46.740433+0000 mgr.a (mgr.14355) 18071 : audit [DBG] from='client.388152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:47 smithi007 bash[22722]: audit 2024-09-14T05:18:46.740433+0000 mgr.a (mgr.14355) 18071 : audit [DBG] from='client.388152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:47 smithi131 bash[24745]: audit 2024-09-14T05:18:46.740433+0000 mgr.a (mgr.14355) 18071 : audit [DBG] from='client.388152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:49.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:48 smithi007 bash[22722]: cluster 2024-09-14T05:18:47.718390+0000 mgr.a (mgr.14355) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:48 smithi131 bash[24745]: cluster 2024-09-14T05:18:47.718390+0000 mgr.a (mgr.14355) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:48 smithi171 bash[25040]: cluster 2024-09-14T05:18:47.718390+0000 mgr.a (mgr.14355) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:50 smithi007 bash[22722]: cluster 2024-09-14T05:18:49.719212+0000 mgr.a (mgr.14355) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:50 smithi131 bash[24745]: cluster 2024-09-14T05:18:49.719212+0000 mgr.a (mgr.14355) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:50 smithi171 bash[25040]: cluster 2024-09-14T05:18:49.719212+0000 mgr.a (mgr.14355) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:52.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:52.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:52.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:52.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:52.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:52.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:52 smithi007 bash[22722]: cluster 2024-09-14T05:18:51.721644+0000 mgr.a (mgr.14355) 18074 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:52 smithi131 bash[24745]: cluster 2024-09-14T05:18:51.721644+0000 mgr.a (mgr.14355) 18074 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:52 smithi171 bash[25040]: cluster 2024-09-14T05:18:51.721644+0000 mgr.a (mgr.14355) 18074 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:53 smithi007 bash[22722]: audit 2024-09-14T05:18:52.495345+0000 mgr.a (mgr.14355) 18075 : audit [DBG] from='client.388230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:53 smithi131 bash[24745]: audit 2024-09-14T05:18:52.495345+0000 mgr.a (mgr.14355) 18075 : audit [DBG] from='client.388230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:53 smithi171 bash[25040]: audit 2024-09-14T05:18:52.495345+0000 mgr.a (mgr.14355) 18075 : audit [DBG] from='client.388230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:18:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:54 smithi007 bash[22722]: cluster 2024-09-14T05:18:53.722623+0000 mgr.a (mgr.14355) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:54 smithi131 bash[24745]: cluster 2024-09-14T05:18:53.722623+0000 mgr.a (mgr.14355) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:54 smithi171 bash[25040]: cluster 2024-09-14T05:18:53.722623+0000 mgr.a (mgr.14355) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:56 smithi007 bash[22722]: cluster 2024-09-14T05:18:55.724853+0000 mgr.a (mgr.14355) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:56 smithi131 bash[24745]: cluster 2024-09-14T05:18:55.724853+0000 mgr.a (mgr.14355) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:56 smithi171 bash[25040]: cluster 2024-09-14T05:18:55.724853+0000 mgr.a (mgr.14355) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:18:57.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:18:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:18:57.948 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:18:58.731 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:18:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:18:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:18:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:18:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:18:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:58 smithi007 bash[22722]: cluster 2024-09-14T05:18:57.725653+0000 mgr.a (mgr.14355) 18078 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:58 smithi131 bash[24745]: cluster 2024-09-14T05:18:57.725653+0000 mgr.a (mgr.14355) 18078 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:18:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:58 smithi171 bash[25040]: cluster 2024-09-14T05:18:57.725653+0000 mgr.a (mgr.14355) 18078 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:18:59 smithi007 bash[22722]: audit 2024-09-14T05:18:58.286648+0000 mgr.a (mgr.14355) 18079 : audit [DBG] from='client.388305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:18:59 smithi131 bash[24745]: audit 2024-09-14T05:18:58.286648+0000 mgr.a (mgr.14355) 18079 : audit [DBG] from='client.388305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:18:59 smithi171 bash[25040]: audit 2024-09-14T05:18:58.286648+0000 mgr.a (mgr.14355) 18079 : audit [DBG] from='client.388305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:00 smithi007 bash[22722]: cluster 2024-09-14T05:18:59.726651+0000 mgr.a (mgr.14355) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:00 smithi131 bash[24745]: cluster 2024-09-14T05:18:59.726651+0000 mgr.a (mgr.14355) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:00 smithi171 bash[25040]: cluster 2024-09-14T05:18:59.726651+0000 mgr.a (mgr.14355) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:02 smithi007 bash[22722]: cluster 2024-09-14T05:19:01.728933+0000 mgr.a (mgr.14355) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:02 smithi131 bash[24745]: cluster 2024-09-14T05:19:01.728933+0000 mgr.a (mgr.14355) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:02 smithi171 bash[25040]: cluster 2024-09-14T05:19:01.728933+0000 mgr.a (mgr.14355) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:03.733 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:03.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:03.733 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:04.484 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:04.485 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:04 smithi007 bash[22722]: cluster 2024-09-14T05:19:03.729706+0000 mgr.a (mgr.14355) 18082 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:04 smithi131 bash[24745]: cluster 2024-09-14T05:19:03.729706+0000 mgr.a (mgr.14355) 18082 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:04 smithi171 bash[25040]: cluster 2024-09-14T05:19:03.729706+0000 mgr.a (mgr.14355) 18082 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:05 smithi007 bash[22722]: audit 2024-09-14T05:19:04.064686+0000 mgr.a (mgr.14355) 18083 : audit [DBG] from='client.388383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:05 smithi131 bash[24745]: audit 2024-09-14T05:19:04.064686+0000 mgr.a (mgr.14355) 18083 : audit [DBG] from='client.388383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:05 smithi171 bash[25040]: audit 2024-09-14T05:19:04.064686+0000 mgr.a (mgr.14355) 18083 : audit [DBG] from='client.388383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:06 smithi007 bash[22722]: cluster 2024-09-14T05:19:05.731971+0000 mgr.a (mgr.14355) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:06 smithi131 bash[24745]: cluster 2024-09-14T05:19:05.731971+0000 mgr.a (mgr.14355) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:06 smithi171 bash[25040]: cluster 2024-09-14T05:19:05.731971+0000 mgr.a (mgr.14355) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:08 smithi007 bash[22722]: cluster 2024-09-14T05:19:07.732758+0000 mgr.a (mgr.14355) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:08 smithi131 bash[24745]: cluster 2024-09-14T05:19:07.732758+0000 mgr.a (mgr.14355) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:08 smithi171 bash[25040]: cluster 2024-09-14T05:19:07.732758+0000 mgr.a (mgr.14355) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:10.276 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:10.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:10 smithi007 bash[22722]: cluster 2024-09-14T05:19:09.733243+0000 mgr.a (mgr.14355) 18086 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:10 smithi007 bash[22722]: audit 2024-09-14T05:19:09.821534+0000 mgr.a (mgr.14355) 18087 : audit [DBG] from='client.388458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:11.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:10 smithi131 bash[24745]: cluster 2024-09-14T05:19:09.733243+0000 mgr.a (mgr.14355) 18086 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:11.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:10 smithi131 bash[24745]: audit 2024-09-14T05:19:09.821534+0000 mgr.a (mgr.14355) 18087 : audit [DBG] from='client.388458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:10 smithi171 bash[25040]: cluster 2024-09-14T05:19:09.733243+0000 mgr.a (mgr.14355) 18086 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:10 smithi171 bash[25040]: audit 2024-09-14T05:19:09.821534+0000 mgr.a (mgr.14355) 18087 : audit [DBG] from='client.388458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:12 smithi007 bash[22722]: cluster 2024-09-14T05:19:11.735564+0000 mgr.a (mgr.14355) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:12 smithi131 bash[24745]: cluster 2024-09-14T05:19:11.735564+0000 mgr.a (mgr.14355) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:12 smithi171 bash[25040]: cluster 2024-09-14T05:19:11.735564+0000 mgr.a (mgr.14355) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:14 smithi007 bash[22722]: cluster 2024-09-14T05:19:13.736349+0000 mgr.a (mgr.14355) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:14 smithi131 bash[24745]: cluster 2024-09-14T05:19:13.736349+0000 mgr.a (mgr.14355) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:14 smithi171 bash[25040]: cluster 2024-09-14T05:19:13.736349+0000 mgr.a (mgr.14355) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:16.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:16 smithi007 bash[22722]: audit 2024-09-14T05:19:15.609926+0000 mgr.a (mgr.14355) 18090 : audit [DBG] from='client.388536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:16 smithi007 bash[22722]: cluster 2024-09-14T05:19:15.746700+0000 mgr.a (mgr.14355) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:16 smithi131 bash[24745]: audit 2024-09-14T05:19:15.609926+0000 mgr.a (mgr.14355) 18090 : audit [DBG] from='client.388536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:16 smithi131 bash[24745]: cluster 2024-09-14T05:19:15.746700+0000 mgr.a (mgr.14355) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:16 smithi171 bash[25040]: audit 2024-09-14T05:19:15.609926+0000 mgr.a (mgr.14355) 18090 : audit [DBG] from='client.388536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:16 smithi171 bash[25040]: cluster 2024-09-14T05:19:15.746700+0000 mgr.a (mgr.14355) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:18 smithi007 bash[22722]: cluster 2024-09-14T05:19:17.747572+0000 mgr.a (mgr.14355) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:18 smithi131 bash[24745]: cluster 2024-09-14T05:19:17.747572+0000 mgr.a (mgr.14355) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:18 smithi171 bash[25040]: cluster 2024-09-14T05:19:17.747572+0000 mgr.a (mgr.14355) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:21.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:20 smithi007 bash[22722]: cluster 2024-09-14T05:19:19.748376+0000 mgr.a (mgr.14355) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:20 smithi131 bash[24745]: cluster 2024-09-14T05:19:19.748376+0000 mgr.a (mgr.14355) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:20 smithi171 bash[25040]: cluster 2024-09-14T05:19:19.748376+0000 mgr.a (mgr.14355) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:21.806 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:21.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:21.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:21.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:21.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:22 smithi007 bash[22722]: audit 2024-09-14T05:19:21.377829+0000 mgr.a (mgr.14355) 18094 : audit [DBG] from='client.388614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:22 smithi007 bash[22722]: cluster 2024-09-14T05:19:21.749932+0000 mgr.a (mgr.14355) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:22 smithi131 bash[24745]: audit 2024-09-14T05:19:21.377829+0000 mgr.a (mgr.14355) 18094 : audit [DBG] from='client.388614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:22 smithi131 bash[24745]: cluster 2024-09-14T05:19:21.749932+0000 mgr.a (mgr.14355) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:22 smithi171 bash[25040]: audit 2024-09-14T05:19:21.377829+0000 mgr.a (mgr.14355) 18094 : audit [DBG] from='client.388614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:22 smithi171 bash[25040]: cluster 2024-09-14T05:19:21.749932+0000 mgr.a (mgr.14355) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:24 smithi007 bash[22722]: cluster 2024-09-14T05:19:23.750695+0000 mgr.a (mgr.14355) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:24 smithi131 bash[24745]: cluster 2024-09-14T05:19:23.750695+0000 mgr.a (mgr.14355) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:24 smithi171 bash[25040]: cluster 2024-09-14T05:19:23.750695+0000 mgr.a (mgr.14355) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:26.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:26.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:26 smithi007 bash[22722]: cluster 2024-09-14T05:19:25.752598+0000 mgr.a (mgr.14355) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:26 smithi131 bash[24745]: cluster 2024-09-14T05:19:25.752598+0000 mgr.a (mgr.14355) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:26 smithi171 bash[25040]: cluster 2024-09-14T05:19:25.752598+0000 mgr.a (mgr.14355) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:27.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:27.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:27 smithi007 bash[22722]: audit 2024-09-14T05:19:27.019182+0000 mon.a (mon.0) 3285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:19:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:27 smithi007 bash[22722]: audit 2024-09-14T05:19:27.847772+0000 mon.a (mon.0) 3286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:19:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:27 smithi007 bash[22722]: audit 2024-09-14T05:19:27.849719+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:19:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:27 smithi007 bash[22722]: audit 2024-09-14T05:19:27.860120+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:19:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:27 smithi007 bash[22722]: audit 2024-09-14T05:19:27.862971+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:27 smithi131 bash[24745]: audit 2024-09-14T05:19:27.019182+0000 mon.a (mon.0) 3285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:19:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:27 smithi131 bash[24745]: audit 2024-09-14T05:19:27.847772+0000 mon.a (mon.0) 3286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:19:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:27 smithi131 bash[24745]: audit 2024-09-14T05:19:27.849719+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:19:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:27 smithi131 bash[24745]: audit 2024-09-14T05:19:27.860120+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:19:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:27 smithi131 bash[24745]: audit 2024-09-14T05:19:27.862971+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:27 smithi171 bash[25040]: audit 2024-09-14T05:19:27.019182+0000 mon.a (mon.0) 3285 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:19:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:27 smithi171 bash[25040]: audit 2024-09-14T05:19:27.847772+0000 mon.a (mon.0) 3286 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:19:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:27 smithi171 bash[25040]: audit 2024-09-14T05:19:27.849719+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:19:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:27 smithi171 bash[25040]: audit 2024-09-14T05:19:27.860120+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:19:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:27 smithi171 bash[25040]: audit 2024-09-14T05:19:27.862971+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:28.907 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22972]: debug 2024-09-14T05:19:28.619+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:19:28.908 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22972]: debug 2024-09-14T05:19:28.623+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:19:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22722]: audit 2024-09-14T05:19:27.148904+0000 mgr.a (mgr.14355) 18098 : audit [DBG] from='client.388692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22722]: cluster 2024-09-14T05:19:27.753098+0000 mgr.a (mgr.14355) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22722]: audit 2024-09-14T05:19:27.864447+0000 mgr.a (mgr.14355) 18100 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22722]: audit 2024-09-14T05:19:28.625956+0000 mgr.a (mgr.14355) 18101 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:19:29.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:28 smithi007 bash[22722]: cephadm 2024-09-14T05:19:28.628026+0000 mgr.a (mgr.14355) 18102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:19:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:28 smithi131 bash[24745]: audit 2024-09-14T05:19:27.148904+0000 mgr.a (mgr.14355) 18098 : audit [DBG] from='client.388692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:28 smithi131 bash[24745]: cluster 2024-09-14T05:19:27.753098+0000 mgr.a (mgr.14355) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:28 smithi131 bash[24745]: audit 2024-09-14T05:19:27.864447+0000 mgr.a (mgr.14355) 18100 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:28 smithi131 bash[24745]: audit 2024-09-14T05:19:28.625956+0000 mgr.a (mgr.14355) 18101 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:19:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:28 smithi131 bash[24745]: cephadm 2024-09-14T05:19:28.628026+0000 mgr.a (mgr.14355) 18102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:28 smithi171 bash[25040]: audit 2024-09-14T05:19:27.148904+0000 mgr.a (mgr.14355) 18098 : audit [DBG] from='client.388692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:28 smithi171 bash[25040]: cluster 2024-09-14T05:19:27.753098+0000 mgr.a (mgr.14355) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:28 smithi171 bash[25040]: audit 2024-09-14T05:19:27.864447+0000 mgr.a (mgr.14355) 18100 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:28 smithi171 bash[25040]: audit 2024-09-14T05:19:28.625956+0000 mgr.a (mgr.14355) 18101 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:19:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:28 smithi171 bash[25040]: cephadm 2024-09-14T05:19:28.628026+0000 mgr.a (mgr.14355) 18102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:19:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:29 smithi007 bash[22722]: cluster 2024-09-14T05:19:29.754114+0000 mgr.a (mgr.14355) 18103 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:29 smithi131 bash[24745]: cluster 2024-09-14T05:19:29.754114+0000 mgr.a (mgr.14355) 18103 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:29 smithi171 bash[25040]: cluster 2024-09-14T05:19:29.754114+0000 mgr.a (mgr.14355) 18103 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:32.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:32.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:32.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:32 smithi007 bash[22722]: cluster 2024-09-14T05:19:31.756507+0000 mgr.a (mgr.14355) 18104 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:32 smithi131 bash[24745]: cluster 2024-09-14T05:19:31.756507+0000 mgr.a (mgr.14355) 18104 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:32 smithi171 bash[25040]: cluster 2024-09-14T05:19:31.756507+0000 mgr.a (mgr.14355) 18104 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:33.330 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:33.330 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:34 smithi007 bash[22722]: audit 2024-09-14T05:19:32.921188+0000 mgr.a (mgr.14355) 18105 : audit [DBG] from='client.388875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:34 smithi007 bash[22722]: cluster 2024-09-14T05:19:33.757516+0000 mgr.a (mgr.14355) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:34 smithi131 bash[24745]: audit 2024-09-14T05:19:32.921188+0000 mgr.a (mgr.14355) 18105 : audit [DBG] from='client.388875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:34 smithi131 bash[24745]: cluster 2024-09-14T05:19:33.757516+0000 mgr.a (mgr.14355) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:34 smithi171 bash[25040]: audit 2024-09-14T05:19:32.921188+0000 mgr.a (mgr.14355) 18105 : audit [DBG] from='client.388875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:34 smithi171 bash[25040]: cluster 2024-09-14T05:19:33.757516+0000 mgr.a (mgr.14355) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:36 smithi007 bash[22722]: cluster 2024-09-14T05:19:35.759724+0000 mgr.a (mgr.14355) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:36 smithi131 bash[24745]: cluster 2024-09-14T05:19:35.759724+0000 mgr.a (mgr.14355) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:36 smithi171 bash[25040]: cluster 2024-09-14T05:19:35.759724+0000 mgr.a (mgr.14355) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:38.332 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:38.333 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:39.082 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:39.082 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:38 smithi007 bash[22722]: cluster 2024-09-14T05:19:37.760527+0000 mgr.a (mgr.14355) 18108 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:38 smithi131 bash[24745]: cluster 2024-09-14T05:19:37.760527+0000 mgr.a (mgr.14355) 18108 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:38 smithi171 bash[25040]: cluster 2024-09-14T05:19:37.760527+0000 mgr.a (mgr.14355) 18108 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:39 smithi007 bash[22722]: audit 2024-09-14T05:19:38.664450+0000 mgr.a (mgr.14355) 18109 : audit [DBG] from='client.388953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:39 smithi131 bash[24745]: audit 2024-09-14T05:19:38.664450+0000 mgr.a (mgr.14355) 18109 : audit [DBG] from='client.388953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:39 smithi171 bash[25040]: audit 2024-09-14T05:19:38.664450+0000 mgr.a (mgr.14355) 18109 : audit [DBG] from='client.388953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:40 smithi007 bash[22722]: cluster 2024-09-14T05:19:39.761525+0000 mgr.a (mgr.14355) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:41.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:40 smithi131 bash[24745]: cluster 2024-09-14T05:19:39.761525+0000 mgr.a (mgr.14355) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:41.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:40 smithi171 bash[25040]: cluster 2024-09-14T05:19:39.761525+0000 mgr.a (mgr.14355) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:42 smithi007 bash[22722]: cluster 2024-09-14T05:19:41.763831+0000 mgr.a (mgr.14355) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:42 smithi131 bash[24745]: cluster 2024-09-14T05:19:41.763831+0000 mgr.a (mgr.14355) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:43.298 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:42 smithi171 bash[25040]: cluster 2024-09-14T05:19:41.763831+0000 mgr.a (mgr.14355) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:19:44.084 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:44.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:44.084 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:44.852 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:44.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:44.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:44.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:44.853 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:44 smithi007 bash[22722]: cluster 2024-09-14T05:19:43.764584+0000 mgr.a (mgr.14355) 18112 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:44 smithi131 bash[24745]: cluster 2024-09-14T05:19:43.764584+0000 mgr.a (mgr.14355) 18112 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:44 smithi171 bash[25040]: cluster 2024-09-14T05:19:43.764584+0000 mgr.a (mgr.14355) 18112 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:45 smithi007 bash[22722]: audit 2024-09-14T05:19:44.422843+0000 mgr.a (mgr.14355) 18113 : audit [DBG] from='client.389031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:45 smithi131 bash[24745]: audit 2024-09-14T05:19:44.422843+0000 mgr.a (mgr.14355) 18113 : audit [DBG] from='client.389031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:45 smithi171 bash[25040]: audit 2024-09-14T05:19:44.422843+0000 mgr.a (mgr.14355) 18113 : audit [DBG] from='client.389031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:46 smithi007 bash[22722]: cluster 2024-09-14T05:19:45.767328+0000 mgr.a (mgr.14355) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:46 smithi131 bash[24745]: cluster 2024-09-14T05:19:45.767328+0000 mgr.a (mgr.14355) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:46 smithi171 bash[25040]: cluster 2024-09-14T05:19:45.767328+0000 mgr.a (mgr.14355) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:19:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:48 smithi007 bash[22722]: cluster 2024-09-14T05:19:47.768150+0000 mgr.a (mgr.14355) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:48 smithi131 bash[24745]: cluster 2024-09-14T05:19:47.768150+0000 mgr.a (mgr.14355) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:48 smithi171 bash[25040]: cluster 2024-09-14T05:19:47.768150+0000 mgr.a (mgr.14355) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:49.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:50.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:50.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:50.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:50.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:50 smithi007 bash[22722]: cluster 2024-09-14T05:19:49.768909+0000 mgr.a (mgr.14355) 18116 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:50 smithi131 bash[24745]: cluster 2024-09-14T05:19:49.768909+0000 mgr.a (mgr.14355) 18116 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:50 smithi171 bash[25040]: cluster 2024-09-14T05:19:49.768909+0000 mgr.a (mgr.14355) 18116 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:51 smithi007 bash[22722]: audit 2024-09-14T05:19:50.191589+0000 mgr.a (mgr.14355) 18117 : audit [DBG] from='client.389103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:51 smithi131 bash[24745]: audit 2024-09-14T05:19:50.191589+0000 mgr.a (mgr.14355) 18117 : audit [DBG] from='client.389103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:51 smithi171 bash[25040]: audit 2024-09-14T05:19:50.191589+0000 mgr.a (mgr.14355) 18117 : audit [DBG] from='client.389103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:52 smithi007 bash[22722]: cluster 2024-09-14T05:19:51.771690+0000 mgr.a (mgr.14355) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:52 smithi131 bash[24745]: cluster 2024-09-14T05:19:51.771690+0000 mgr.a (mgr.14355) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:52 smithi171 bash[25040]: cluster 2024-09-14T05:19:51.771690+0000 mgr.a (mgr.14355) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:54 smithi007 bash[22722]: cluster 2024-09-14T05:19:53.772470+0000 mgr.a (mgr.14355) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:54 smithi131 bash[24745]: cluster 2024-09-14T05:19:53.772470+0000 mgr.a (mgr.14355) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:55.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:54 smithi171 bash[25040]: cluster 2024-09-14T05:19:53.772470+0000 mgr.a (mgr.14355) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:55.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:19:55.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:19:55.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:19:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:19:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:19:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:19:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:19:56.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:19:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:56 smithi007 bash[22722]: cluster 2024-09-14T05:19:55.773992+0000 mgr.a (mgr.14355) 18120 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:56 smithi131 bash[24745]: cluster 2024-09-14T05:19:55.773992+0000 mgr.a (mgr.14355) 18120 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:56 smithi171 bash[25040]: cluster 2024-09-14T05:19:55.773992+0000 mgr.a (mgr.14355) 18120 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:19:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:57 smithi007 bash[22722]: audit 2024-09-14T05:19:55.960973+0000 mgr.a (mgr.14355) 18121 : audit [DBG] from='client.389178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:57 smithi131 bash[24745]: audit 2024-09-14T05:19:55.960973+0000 mgr.a (mgr.14355) 18121 : audit [DBG] from='client.389178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:57 smithi171 bash[25040]: audit 2024-09-14T05:19:55.960973+0000 mgr.a (mgr.14355) 18121 : audit [DBG] from='client.389178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:19:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:19:58 smithi007 bash[22722]: cluster 2024-09-14T05:19:57.774898+0000 mgr.a (mgr.14355) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:19:58 smithi131 bash[24745]: cluster 2024-09-14T05:19:57.774898+0000 mgr.a (mgr.14355) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:19:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:19:58 smithi171 bash[25040]: cluster 2024-09-14T05:19:57.774898+0000 mgr.a (mgr.14355) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:20:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:00 smithi007 bash[22722]: cluster 2024-09-14T05:19:59.775684+0000 mgr.a (mgr.14355) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:20:01.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:00 smithi007 bash[22722]: cluster 2024-09-14T05:20:00.000148+0000 mon.a (mon.0) 3290 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:20:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:00 smithi131 bash[24745]: cluster 2024-09-14T05:19:59.775684+0000 mgr.a (mgr.14355) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:20:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:00 smithi131 bash[24745]: cluster 2024-09-14T05:20:00.000148+0000 mon.a (mon.0) 3290 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:20:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:00 smithi171 bash[25040]: cluster 2024-09-14T05:19:59.775684+0000 mgr.a (mgr.14355) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:20:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:00 smithi171 bash[25040]: cluster 2024-09-14T05:20:00.000148+0000 mon.a (mon.0) 3290 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:20:01.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:01.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:01.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:02.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:02.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:02.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:02.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:02.190 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:02 smithi007 bash[22722]: audit 2024-09-14T05:20:01.748358+0000 mgr.a (mgr.14355) 18124 : audit [DBG] from='client.389253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:02 smithi007 bash[22722]: cluster 2024-09-14T05:20:01.778818+0000 mgr.a (mgr.14355) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:02 smithi131 bash[24745]: audit 2024-09-14T05:20:01.748358+0000 mgr.a (mgr.14355) 18124 : audit [DBG] from='client.389253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:02 smithi131 bash[24745]: cluster 2024-09-14T05:20:01.778818+0000 mgr.a (mgr.14355) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:02 smithi171 bash[25040]: audit 2024-09-14T05:20:01.748358+0000 mgr.a (mgr.14355) 18124 : audit [DBG] from='client.389253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:02 smithi171 bash[25040]: cluster 2024-09-14T05:20:01.778818+0000 mgr.a (mgr.14355) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:04 smithi007 bash[22722]: cluster 2024-09-14T05:20:03.779744+0000 mgr.a (mgr.14355) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:04 smithi131 bash[24745]: cluster 2024-09-14T05:20:03.779744+0000 mgr.a (mgr.14355) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:05.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:04 smithi171 bash[25040]: cluster 2024-09-14T05:20:03.779744+0000 mgr.a (mgr.14355) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:06 smithi007 bash[22722]: cluster 2024-09-14T05:20:05.781926+0000 mgr.a (mgr.14355) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:07.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:06 smithi131 bash[24745]: cluster 2024-09-14T05:20:05.781926+0000 mgr.a (mgr.14355) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:06 smithi171 bash[25040]: cluster 2024-09-14T05:20:05.781926+0000 mgr.a (mgr.14355) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:07.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:07.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:07 smithi007 bash[22722]: audit 2024-09-14T05:20:07.523681+0000 mgr.a (mgr.14355) 18128 : audit [DBG] from='client.389328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:07 smithi007 bash[22722]: cluster 2024-09-14T05:20:07.782600+0000 mgr.a (mgr.14355) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:07 smithi131 bash[24745]: audit 2024-09-14T05:20:07.523681+0000 mgr.a (mgr.14355) 18128 : audit [DBG] from='client.389328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:07 smithi131 bash[24745]: cluster 2024-09-14T05:20:07.782600+0000 mgr.a (mgr.14355) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:07 smithi171 bash[25040]: audit 2024-09-14T05:20:07.523681+0000 mgr.a (mgr.14355) 18128 : audit [DBG] from='client.389328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:07 smithi171 bash[25040]: cluster 2024-09-14T05:20:07.782600+0000 mgr.a (mgr.14355) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:10 smithi007 bash[22722]: cluster 2024-09-14T05:20:09.783580+0000 mgr.a (mgr.14355) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:10 smithi131 bash[24745]: cluster 2024-09-14T05:20:09.783580+0000 mgr.a (mgr.14355) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:10 smithi171 bash[25040]: cluster 2024-09-14T05:20:09.783580+0000 mgr.a (mgr.14355) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:12 smithi007 bash[22722]: cluster 2024-09-14T05:20:11.785979+0000 mgr.a (mgr.14355) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:12 smithi131 bash[24745]: cluster 2024-09-14T05:20:11.785979+0000 mgr.a (mgr.14355) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:12 smithi171 bash[25040]: cluster 2024-09-14T05:20:11.785979+0000 mgr.a (mgr.14355) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:13.719 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:13.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:14 smithi007 bash[22722]: audit 2024-09-14T05:20:13.303644+0000 mgr.a (mgr.14355) 18132 : audit [DBG] from='client.389406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:14 smithi007 bash[22722]: cluster 2024-09-14T05:20:13.787138+0000 mgr.a (mgr.14355) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:14 smithi131 bash[24745]: audit 2024-09-14T05:20:13.303644+0000 mgr.a (mgr.14355) 18132 : audit [DBG] from='client.389406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:14 smithi131 bash[24745]: cluster 2024-09-14T05:20:13.787138+0000 mgr.a (mgr.14355) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:14 smithi171 bash[25040]: audit 2024-09-14T05:20:13.303644+0000 mgr.a (mgr.14355) 18132 : audit [DBG] from='client.389406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:14 smithi171 bash[25040]: cluster 2024-09-14T05:20:13.787138+0000 mgr.a (mgr.14355) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:16 smithi007 bash[22722]: cluster 2024-09-14T05:20:15.789491+0000 mgr.a (mgr.14355) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:16 smithi131 bash[24745]: cluster 2024-09-14T05:20:15.789491+0000 mgr.a (mgr.14355) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:16 smithi171 bash[25040]: cluster 2024-09-14T05:20:15.789491+0000 mgr.a (mgr.14355) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:18.720 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:18.721 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:18.721 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:18 smithi007 bash[22722]: cluster 2024-09-14T05:20:17.790482+0000 mgr.a (mgr.14355) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:18 smithi131 bash[24745]: cluster 2024-09-14T05:20:17.790482+0000 mgr.a (mgr.14355) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:18 smithi171 bash[25040]: cluster 2024-09-14T05:20:17.790482+0000 mgr.a (mgr.14355) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:19.496 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:19.496 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:20 smithi007 bash[22722]: audit 2024-09-14T05:20:19.056829+0000 mgr.a (mgr.14355) 18136 : audit [DBG] from='client.389484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:20 smithi007 bash[22722]: cluster 2024-09-14T05:20:19.791506+0000 mgr.a (mgr.14355) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:20 smithi131 bash[24745]: audit 2024-09-14T05:20:19.056829+0000 mgr.a (mgr.14355) 18136 : audit [DBG] from='client.389484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:20 smithi131 bash[24745]: cluster 2024-09-14T05:20:19.791506+0000 mgr.a (mgr.14355) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:20 smithi171 bash[25040]: audit 2024-09-14T05:20:19.056829+0000 mgr.a (mgr.14355) 18136 : audit [DBG] from='client.389484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:20 smithi171 bash[25040]: cluster 2024-09-14T05:20:19.791506+0000 mgr.a (mgr.14355) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:22 smithi007 bash[22722]: cluster 2024-09-14T05:20:21.793800+0000 mgr.a (mgr.14355) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:22 smithi131 bash[24745]: cluster 2024-09-14T05:20:21.793800+0000 mgr.a (mgr.14355) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:22 smithi171 bash[25040]: cluster 2024-09-14T05:20:21.793800+0000 mgr.a (mgr.14355) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:24 smithi007 bash[22722]: cluster 2024-09-14T05:20:23.794715+0000 mgr.a (mgr.14355) 18139 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:25.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:25.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:24 smithi131 bash[24745]: cluster 2024-09-14T05:20:23.794715+0000 mgr.a (mgr.14355) 18139 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:24 smithi171 bash[25040]: cluster 2024-09-14T05:20:23.794715+0000 mgr.a (mgr.14355) 18139 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:25 smithi007 bash[22722]: audit 2024-09-14T05:20:24.834014+0000 mgr.a (mgr.14355) 18140 : audit [DBG] from='client.389562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:25 smithi131 bash[24745]: audit 2024-09-14T05:20:24.834014+0000 mgr.a (mgr.14355) 18140 : audit [DBG] from='client.389562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:25 smithi171 bash[25040]: audit 2024-09-14T05:20:24.834014+0000 mgr.a (mgr.14355) 18140 : audit [DBG] from='client.389562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:26 smithi007 bash[22722]: cluster 2024-09-14T05:20:25.797031+0000 mgr.a (mgr.14355) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:26 smithi131 bash[24745]: cluster 2024-09-14T05:20:25.797031+0000 mgr.a (mgr.14355) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:26 smithi171 bash[25040]: cluster 2024-09-14T05:20:25.797031+0000 mgr.a (mgr.14355) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:28 smithi007 bash[22722]: cluster 2024-09-14T05:20:27.797808+0000 mgr.a (mgr.14355) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:28 smithi007 bash[22722]: audit 2024-09-14T05:20:28.686053+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:20:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:28 smithi131 bash[24745]: cluster 2024-09-14T05:20:27.797808+0000 mgr.a (mgr.14355) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:28 smithi131 bash[24745]: audit 2024-09-14T05:20:28.686053+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:20:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:28 smithi171 bash[25040]: cluster 2024-09-14T05:20:27.797808+0000 mgr.a (mgr.14355) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:28 smithi171 bash[25040]: audit 2024-09-14T05:20:28.686053+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:20:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:29 smithi007 bash[22722]: audit 2024-09-14T05:20:29.525895+0000 mon.a (mon.0) 3292 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:20:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:29 smithi007 bash[22722]: audit 2024-09-14T05:20:29.527412+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:20:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:29 smithi007 bash[22722]: audit 2024-09-14T05:20:29.536691+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:20:30.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:29 smithi007 bash[22722]: audit 2024-09-14T05:20:29.541653+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:30.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:29 smithi131 bash[24745]: audit 2024-09-14T05:20:29.525895+0000 mon.a (mon.0) 3292 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:20:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:29 smithi131 bash[24745]: audit 2024-09-14T05:20:29.527412+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:20:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:29 smithi131 bash[24745]: audit 2024-09-14T05:20:29.536691+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:20:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:29 smithi131 bash[24745]: audit 2024-09-14T05:20:29.541653+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:29 smithi171 bash[25040]: audit 2024-09-14T05:20:29.525895+0000 mon.a (mon.0) 3292 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:20:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:29 smithi171 bash[25040]: audit 2024-09-14T05:20:29.527412+0000 mon.a (mon.0) 3293 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:20:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:29 smithi171 bash[25040]: audit 2024-09-14T05:20:29.536691+0000 mon.a (mon.0) 3294 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:20:30.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:29 smithi171 bash[25040]: audit 2024-09-14T05:20:29.541653+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:30.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:20:30 smithi007 bash[22972]: debug 2024-09-14T05:20:30.286+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:20:30.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:20:30 smithi007 bash[22972]: debug 2024-09-14T05:20:30.286+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:20:31.051 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:31.051 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:31.052 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:30 smithi007 bash[22722]: audit 2024-09-14T05:20:29.543955+0000 mgr.a (mgr.14355) 18143 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:30 smithi007 bash[22722]: cluster 2024-09-14T05:20:29.798405+0000 mgr.a (mgr.14355) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:30 smithi131 bash[24745]: audit 2024-09-14T05:20:29.543955+0000 mgr.a (mgr.14355) 18143 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:31.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:30 smithi131 bash[24745]: cluster 2024-09-14T05:20:29.798405+0000 mgr.a (mgr.14355) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:30 smithi171 bash[25040]: audit 2024-09-14T05:20:29.543955+0000 mgr.a (mgr.14355) 18143 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:20:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:30 smithi171 bash[25040]: cluster 2024-09-14T05:20:29.798405+0000 mgr.a (mgr.14355) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:31 smithi007 bash[22722]: audit 2024-09-14T05:20:30.290321+0000 mgr.a (mgr.14355) 18145 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:20:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:31 smithi007 bash[22722]: cephadm 2024-09-14T05:20:30.291525+0000 mgr.a (mgr.14355) 18146 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:20:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:31 smithi007 bash[22722]: audit 2024-09-14T05:20:30.617448+0000 mgr.a (mgr.14355) 18147 : audit [DBG] from='client.389745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:31 smithi131 bash[24745]: audit 2024-09-14T05:20:30.290321+0000 mgr.a (mgr.14355) 18145 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:20:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:31 smithi131 bash[24745]: cephadm 2024-09-14T05:20:30.291525+0000 mgr.a (mgr.14355) 18146 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:20:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:31 smithi131 bash[24745]: audit 2024-09-14T05:20:30.617448+0000 mgr.a (mgr.14355) 18147 : audit [DBG] from='client.389745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:31 smithi171 bash[25040]: audit 2024-09-14T05:20:30.290321+0000 mgr.a (mgr.14355) 18145 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:20:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:31 smithi171 bash[25040]: cephadm 2024-09-14T05:20:30.291525+0000 mgr.a (mgr.14355) 18146 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:20:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:31 smithi171 bash[25040]: audit 2024-09-14T05:20:30.617448+0000 mgr.a (mgr.14355) 18147 : audit [DBG] from='client.389745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:32 smithi007 bash[22722]: cluster 2024-09-14T05:20:31.801281+0000 mgr.a (mgr.14355) 18148 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:32 smithi131 bash[24745]: cluster 2024-09-14T05:20:31.801281+0000 mgr.a (mgr.14355) 18148 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:32 smithi171 bash[25040]: cluster 2024-09-14T05:20:31.801281+0000 mgr.a (mgr.14355) 18148 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:34 smithi007 bash[22722]: cluster 2024-09-14T05:20:33.802224+0000 mgr.a (mgr.14355) 18149 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:34 smithi131 bash[24745]: cluster 2024-09-14T05:20:33.802224+0000 mgr.a (mgr.14355) 18149 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:34 smithi171 bash[25040]: cluster 2024-09-14T05:20:33.802224+0000 mgr.a (mgr.14355) 18149 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:36.053 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:36.053 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:36.054 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:36.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:36.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:36 smithi007 bash[22722]: cluster 2024-09-14T05:20:35.804307+0000 mgr.a (mgr.14355) 18150 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:36 smithi131 bash[24745]: cluster 2024-09-14T05:20:35.804307+0000 mgr.a (mgr.14355) 18150 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:36 smithi171 bash[25040]: cluster 2024-09-14T05:20:35.804307+0000 mgr.a (mgr.14355) 18150 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:37 smithi007 bash[22722]: audit 2024-09-14T05:20:36.393251+0000 mgr.a (mgr.14355) 18151 : audit [DBG] from='client.389820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:37 smithi131 bash[24745]: audit 2024-09-14T05:20:36.393251+0000 mgr.a (mgr.14355) 18151 : audit [DBG] from='client.389820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:37 smithi171 bash[25040]: audit 2024-09-14T05:20:36.393251+0000 mgr.a (mgr.14355) 18151 : audit [DBG] from='client.389820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:38 smithi007 bash[22722]: cluster 2024-09-14T05:20:37.805215+0000 mgr.a (mgr.14355) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:38 smithi131 bash[24745]: cluster 2024-09-14T05:20:37.805215+0000 mgr.a (mgr.14355) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:38 smithi171 bash[25040]: cluster 2024-09-14T05:20:37.805215+0000 mgr.a (mgr.14355) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:39 smithi007 bash[22722]: cluster 2024-09-14T05:20:39.805998+0000 mgr.a (mgr.14355) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:39 smithi131 bash[24745]: cluster 2024-09-14T05:20:39.805998+0000 mgr.a (mgr.14355) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:39 smithi171 bash[25040]: cluster 2024-09-14T05:20:39.805998+0000 mgr.a (mgr.14355) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:20:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:41.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:42.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:42 smithi007 bash[22722]: cluster 2024-09-14T05:20:41.808211+0000 mgr.a (mgr.14355) 18154 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:42 smithi131 bash[24745]: cluster 2024-09-14T05:20:41.808211+0000 mgr.a (mgr.14355) 18154 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:42 smithi171 bash[25040]: cluster 2024-09-14T05:20:41.808211+0000 mgr.a (mgr.14355) 18154 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:20:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:43 smithi007 bash[22722]: audit 2024-09-14T05:20:42.178859+0000 mgr.a (mgr.14355) 18155 : audit [DBG] from='client.389895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:43 smithi131 bash[24745]: audit 2024-09-14T05:20:42.178859+0000 mgr.a (mgr.14355) 18155 : audit [DBG] from='client.389895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:43 smithi171 bash[25040]: audit 2024-09-14T05:20:42.178859+0000 mgr.a (mgr.14355) 18155 : audit [DBG] from='client.389895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:44 smithi007 bash[22722]: cluster 2024-09-14T05:20:43.809048+0000 mgr.a (mgr.14355) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:44 smithi131 bash[24745]: cluster 2024-09-14T05:20:43.809048+0000 mgr.a (mgr.14355) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:44 smithi171 bash[25040]: cluster 2024-09-14T05:20:43.809048+0000 mgr.a (mgr.14355) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:46 smithi007 bash[22722]: cluster 2024-09-14T05:20:45.811236+0000 mgr.a (mgr.14355) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:46 smithi131 bash[24745]: cluster 2024-09-14T05:20:45.811236+0000 mgr.a (mgr.14355) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:46 smithi171 bash[25040]: cluster 2024-09-14T05:20:45.811236+0000 mgr.a (mgr.14355) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:47.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:47.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:48.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:48.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:48.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:48.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:48.372 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:49.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:48 smithi007 bash[22722]: cluster 2024-09-14T05:20:47.811950+0000 mgr.a (mgr.14355) 18158 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:48 smithi131 bash[24745]: cluster 2024-09-14T05:20:47.811950+0000 mgr.a (mgr.14355) 18158 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:48 smithi171 bash[25040]: cluster 2024-09-14T05:20:47.811950+0000 mgr.a (mgr.14355) 18158 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:49 smithi007 bash[22722]: audit 2024-09-14T05:20:47.948193+0000 mgr.a (mgr.14355) 18159 : audit [DBG] from='client.389973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:49 smithi131 bash[24745]: audit 2024-09-14T05:20:47.948193+0000 mgr.a (mgr.14355) 18159 : audit [DBG] from='client.389973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:49 smithi171 bash[25040]: audit 2024-09-14T05:20:47.948193+0000 mgr.a (mgr.14355) 18159 : audit [DBG] from='client.389973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:50 smithi007 bash[22722]: cluster 2024-09-14T05:20:49.812829+0000 mgr.a (mgr.14355) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:50 smithi131 bash[24745]: cluster 2024-09-14T05:20:49.812829+0000 mgr.a (mgr.14355) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:51.315 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:50 smithi171 bash[25040]: cluster 2024-09-14T05:20:49.812829+0000 mgr.a (mgr.14355) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:52 smithi007 bash[22722]: cluster 2024-09-14T05:20:51.815142+0000 mgr.a (mgr.14355) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:52 smithi131 bash[24745]: cluster 2024-09-14T05:20:51.815142+0000 mgr.a (mgr.14355) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:52 smithi171 bash[25040]: cluster 2024-09-14T05:20:51.815142+0000 mgr.a (mgr.14355) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:54.113 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:54.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:54.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:54.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:54.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:20:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:54 smithi007 bash[22722]: audit 2024-09-14T05:20:53.703829+0000 mgr.a (mgr.14355) 18162 : audit [DBG] from='client.390048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:54 smithi007 bash[22722]: cluster 2024-09-14T05:20:53.815744+0000 mgr.a (mgr.14355) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:54 smithi131 bash[24745]: audit 2024-09-14T05:20:53.703829+0000 mgr.a (mgr.14355) 18162 : audit [DBG] from='client.390048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:54 smithi131 bash[24745]: cluster 2024-09-14T05:20:53.815744+0000 mgr.a (mgr.14355) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:54 smithi171 bash[25040]: audit 2024-09-14T05:20:53.703829+0000 mgr.a (mgr.14355) 18162 : audit [DBG] from='client.390048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:20:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:54 smithi171 bash[25040]: cluster 2024-09-14T05:20:53.815744+0000 mgr.a (mgr.14355) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:56 smithi007 bash[22722]: cluster 2024-09-14T05:20:55.818094+0000 mgr.a (mgr.14355) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:56 smithi131 bash[24745]: cluster 2024-09-14T05:20:55.818094+0000 mgr.a (mgr.14355) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:56 smithi171 bash[25040]: cluster 2024-09-14T05:20:55.818094+0000 mgr.a (mgr.14355) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:20:59.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:20:59.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:20:59.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:20:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:20:58 smithi007 bash[22722]: cluster 2024-09-14T05:20:57.818885+0000 mgr.a (mgr.14355) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:20:58 smithi131 bash[24745]: cluster 2024-09-14T05:20:57.818885+0000 mgr.a (mgr.14355) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:20:58 smithi171 bash[25040]: cluster 2024-09-14T05:20:57.818885+0000 mgr.a (mgr.14355) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:20:59.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:20:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:20:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:20:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:20:59.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:00 smithi007 bash[22722]: audit 2024-09-14T05:20:59.445684+0000 mgr.a (mgr.14355) 18166 : audit [DBG] from='client.390126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:00 smithi007 bash[22722]: cluster 2024-09-14T05:20:59.819580+0000 mgr.a (mgr.14355) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:00 smithi131 bash[24745]: audit 2024-09-14T05:20:59.445684+0000 mgr.a (mgr.14355) 18166 : audit [DBG] from='client.390126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:00 smithi131 bash[24745]: cluster 2024-09-14T05:20:59.819580+0000 mgr.a (mgr.14355) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:00 smithi171 bash[25040]: audit 2024-09-14T05:20:59.445684+0000 mgr.a (mgr.14355) 18166 : audit [DBG] from='client.390126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:00 smithi171 bash[25040]: cluster 2024-09-14T05:20:59.819580+0000 mgr.a (mgr.14355) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:02 smithi007 bash[22722]: cluster 2024-09-14T05:21:01.821939+0000 mgr.a (mgr.14355) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:02 smithi131 bash[24745]: cluster 2024-09-14T05:21:01.821939+0000 mgr.a (mgr.14355) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:02 smithi171 bash[25040]: cluster 2024-09-14T05:21:01.821939+0000 mgr.a (mgr.14355) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:04.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:04.903 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:04 smithi007 bash[22722]: cluster 2024-09-14T05:21:03.822901+0000 mgr.a (mgr.14355) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:04 smithi131 bash[24745]: cluster 2024-09-14T05:21:03.822901+0000 mgr.a (mgr.14355) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:04 smithi171 bash[25040]: cluster 2024-09-14T05:21:03.822901+0000 mgr.a (mgr.14355) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:05.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:05.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:05.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:06 smithi007 bash[22722]: audit 2024-09-14T05:21:05.237784+0000 mgr.a (mgr.14355) 18170 : audit [DBG] from='client.390204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:07.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:06 smithi007 bash[22722]: cluster 2024-09-14T05:21:05.825621+0000 mgr.a (mgr.14355) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:06 smithi131 bash[24745]: audit 2024-09-14T05:21:05.237784+0000 mgr.a (mgr.14355) 18170 : audit [DBG] from='client.390204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:06 smithi131 bash[24745]: cluster 2024-09-14T05:21:05.825621+0000 mgr.a (mgr.14355) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:06 smithi171 bash[25040]: audit 2024-09-14T05:21:05.237784+0000 mgr.a (mgr.14355) 18170 : audit [DBG] from='client.390204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:06 smithi171 bash[25040]: cluster 2024-09-14T05:21:05.825621+0000 mgr.a (mgr.14355) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:08 smithi007 bash[22722]: cluster 2024-09-14T05:21:07.826411+0000 mgr.a (mgr.14355) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:08 smithi131 bash[24745]: cluster 2024-09-14T05:21:07.826411+0000 mgr.a (mgr.14355) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:08 smithi171 bash[25040]: cluster 2024-09-14T05:21:07.826411+0000 mgr.a (mgr.14355) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:10 smithi007 bash[22722]: cluster 2024-09-14T05:21:09.827143+0000 mgr.a (mgr.14355) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:21:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:10 smithi131 bash[24745]: cluster 2024-09-14T05:21:09.827143+0000 mgr.a (mgr.14355) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:21:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:10 smithi171 bash[25040]: cluster 2024-09-14T05:21:09.827143+0000 mgr.a (mgr.14355) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:21:11.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:11.415 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:12 smithi007 bash[22722]: audit 2024-09-14T05:21:10.990400+0000 mgr.a (mgr.14355) 18174 : audit [DBG] from='client.390282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:12 smithi007 bash[22722]: cluster 2024-09-14T05:21:11.829796+0000 mgr.a (mgr.14355) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:12 smithi131 bash[24745]: audit 2024-09-14T05:21:10.990400+0000 mgr.a (mgr.14355) 18174 : audit [DBG] from='client.390282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:12 smithi131 bash[24745]: cluster 2024-09-14T05:21:11.829796+0000 mgr.a (mgr.14355) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:12 smithi171 bash[25040]: audit 2024-09-14T05:21:10.990400+0000 mgr.a (mgr.14355) 18174 : audit [DBG] from='client.390282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:12 smithi171 bash[25040]: cluster 2024-09-14T05:21:11.829796+0000 mgr.a (mgr.14355) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:15.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:14 smithi007 bash[22722]: cluster 2024-09-14T05:21:13.830589+0000 mgr.a (mgr.14355) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:14 smithi131 bash[24745]: cluster 2024-09-14T05:21:13.830589+0000 mgr.a (mgr.14355) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:14 smithi171 bash[25040]: cluster 2024-09-14T05:21:13.830589+0000 mgr.a (mgr.14355) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:21:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:16.417 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:17.174 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:17.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:17.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:17.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:17.175 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:17.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:16 smithi007 bash[22722]: cluster 2024-09-14T05:21:15.832501+0000 mgr.a (mgr.14355) 18177 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:17.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:16 smithi131 bash[24745]: cluster 2024-09-14T05:21:15.832501+0000 mgr.a (mgr.14355) 18177 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:17.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:16 smithi171 bash[25040]: cluster 2024-09-14T05:21:15.832501+0000 mgr.a (mgr.14355) 18177 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:17 smithi007 bash[22722]: audit 2024-09-14T05:21:16.749030+0000 mgr.a (mgr.14355) 18178 : audit [DBG] from='client.390360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:17 smithi131 bash[24745]: audit 2024-09-14T05:21:16.749030+0000 mgr.a (mgr.14355) 18178 : audit [DBG] from='client.390360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:17 smithi171 bash[25040]: audit 2024-09-14T05:21:16.749030+0000 mgr.a (mgr.14355) 18178 : audit [DBG] from='client.390360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:18 smithi007 bash[22722]: cluster 2024-09-14T05:21:17.833400+0000 mgr.a (mgr.14355) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:18 smithi131 bash[24745]: cluster 2024-09-14T05:21:17.833400+0000 mgr.a (mgr.14355) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:18 smithi171 bash[25040]: cluster 2024-09-14T05:21:17.833400+0000 mgr.a (mgr.14355) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:21.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:20 smithi007 bash[22722]: cluster 2024-09-14T05:21:19.834214+0000 mgr.a (mgr.14355) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:21.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:20 smithi131 bash[24745]: cluster 2024-09-14T05:21:19.834214+0000 mgr.a (mgr.14355) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:21.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:20 smithi171 bash[25040]: cluster 2024-09-14T05:21:19.834214+0000 mgr.a (mgr.14355) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:22.176 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:22.177 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:21 smithi007 bash[22722]: cluster 2024-09-14T05:21:21.836808+0000 mgr.a (mgr.14355) 18181 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:21 smithi131 bash[24745]: cluster 2024-09-14T05:21:21.836808+0000 mgr.a (mgr.14355) 18181 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:21 smithi171 bash[25040]: cluster 2024-09-14T05:21:21.836808+0000 mgr.a (mgr.14355) 18181 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:22.957 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:22.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:22.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:22.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:22.958 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:22 smithi007 bash[22722]: audit 2024-09-14T05:21:22.515006+0000 mgr.a (mgr.14355) 18182 : audit [DBG] from='client.390435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:22 smithi131 bash[24745]: audit 2024-09-14T05:21:22.515006+0000 mgr.a (mgr.14355) 18182 : audit [DBG] from='client.390435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:22 smithi171 bash[25040]: audit 2024-09-14T05:21:22.515006+0000 mgr.a (mgr.14355) 18182 : audit [DBG] from='client.390435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:23 smithi007 bash[22722]: cluster 2024-09-14T05:21:23.837714+0000 mgr.a (mgr.14355) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:23 smithi131 bash[24745]: cluster 2024-09-14T05:21:23.837714+0000 mgr.a (mgr.14355) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:23 smithi171 bash[25040]: cluster 2024-09-14T05:21:23.837714+0000 mgr.a (mgr.14355) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:26 smithi007 bash[22722]: cluster 2024-09-14T05:21:25.839929+0000 mgr.a (mgr.14355) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:26 smithi131 bash[24745]: cluster 2024-09-14T05:21:25.839929+0000 mgr.a (mgr.14355) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:26 smithi171 bash[25040]: cluster 2024-09-14T05:21:25.839929+0000 mgr.a (mgr.14355) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:27.959 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:27.960 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:28.735 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:28.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:28.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:28.736 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:28.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:28 smithi007 bash[22722]: cluster 2024-09-14T05:21:27.840707+0000 mgr.a (mgr.14355) 18185 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:28 smithi131 bash[24745]: cluster 2024-09-14T05:21:27.840707+0000 mgr.a (mgr.14355) 18185 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:28 smithi171 bash[25040]: cluster 2024-09-14T05:21:27.840707+0000 mgr.a (mgr.14355) 18185 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:29 smithi007 bash[22722]: audit 2024-09-14T05:21:28.291490+0000 mgr.a (mgr.14355) 18186 : audit [DBG] from='client.390513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:29 smithi131 bash[24745]: audit 2024-09-14T05:21:28.291490+0000 mgr.a (mgr.14355) 18186 : audit [DBG] from='client.390513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:29 smithi171 bash[25040]: audit 2024-09-14T05:21:28.291490+0000 mgr.a (mgr.14355) 18186 : audit [DBG] from='client.390513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:30 smithi007 bash[22722]: cluster 2024-09-14T05:21:29.841673+0000 mgr.a (mgr.14355) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:30 smithi007 bash[22722]: audit 2024-09-14T05:21:30.353977+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:21:31.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:30 smithi131 bash[24745]: cluster 2024-09-14T05:21:29.841673+0000 mgr.a (mgr.14355) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:31.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:30 smithi131 bash[24745]: audit 2024-09-14T05:21:30.353977+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:21:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:30 smithi171 bash[25040]: cluster 2024-09-14T05:21:29.841673+0000 mgr.a (mgr.14355) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:30 smithi171 bash[25040]: audit 2024-09-14T05:21:30.353977+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:21:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:32 smithi007 bash[22722]: cluster 2024-09-14T05:21:31.844136+0000 mgr.a (mgr.14355) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:32 smithi131 bash[24745]: cluster 2024-09-14T05:21:31.844136+0000 mgr.a (mgr.14355) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:32 smithi171 bash[25040]: cluster 2024-09-14T05:21:31.844136+0000 mgr.a (mgr.14355) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:33.741 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:34.515 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:34.515 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:34.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:34 smithi007 bash[22722]: cluster 2024-09-14T05:21:33.844660+0000 mgr.a (mgr.14355) 18189 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:35.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:34 smithi131 bash[24745]: cluster 2024-09-14T05:21:33.844660+0000 mgr.a (mgr.14355) 18189 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:35.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:34 smithi171 bash[25040]: cluster 2024-09-14T05:21:33.844660+0000 mgr.a (mgr.14355) 18189 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:34.074946+0000 mgr.a (mgr.14355) 18190 : audit [DBG] from='client.390591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.688242+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.692796+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.727343+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.735147+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.740871+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:35 smithi007 bash[22722]: audit 2024-09-14T05:21:35.748037+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:34.074946+0000 mgr.a (mgr.14355) 18190 : audit [DBG] from='client.390591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.688242+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.692796+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.727343+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.735147+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.740871+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:35 smithi131 bash[24745]: audit 2024-09-14T05:21:35.748037+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:34.074946+0000 mgr.a (mgr.14355) 18190 : audit [DBG] from='client.390591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.688242+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.692796+0000 mon.a (mon.0) 3298 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.727343+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.735147+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.740871+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:35 smithi171 bash[25040]: audit 2024-09-14T05:21:35.748037+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:37.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:36 smithi007 bash[22722]: cluster 2024-09-14T05:21:35.846879+0000 mgr.a (mgr.14355) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:36 smithi007 bash[22722]: audit 2024-09-14T05:21:36.461451+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:21:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:36 smithi007 bash[22722]: audit 2024-09-14T05:21:36.462978+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:21:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:36 smithi007 bash[22722]: audit 2024-09-14T05:21:36.471722+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:37.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:36 smithi007 bash[22722]: audit 2024-09-14T05:21:36.474938+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:36 smithi131 bash[24745]: cluster 2024-09-14T05:21:35.846879+0000 mgr.a (mgr.14355) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:36 smithi131 bash[24745]: audit 2024-09-14T05:21:36.461451+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:21:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:36 smithi131 bash[24745]: audit 2024-09-14T05:21:36.462978+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:21:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:36 smithi131 bash[24745]: audit 2024-09-14T05:21:36.471722+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:37.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:36 smithi131 bash[24745]: audit 2024-09-14T05:21:36.474938+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:36 smithi171 bash[25040]: cluster 2024-09-14T05:21:35.846879+0000 mgr.a (mgr.14355) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:21:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:36 smithi171 bash[25040]: audit 2024-09-14T05:21:36.461451+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:21:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:36 smithi171 bash[25040]: audit 2024-09-14T05:21:36.462978+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:21:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:36 smithi171 bash[25040]: audit 2024-09-14T05:21:36.471722+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:21:37.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:36 smithi171 bash[25040]: audit 2024-09-14T05:21:36.474938+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:21:37 smithi007 bash[22972]: debug 2024-09-14T05:21:37.237+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:21:37.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:21:37 smithi007 bash[22972]: debug 2024-09-14T05:21:37.237+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:21:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:37 smithi007 bash[22722]: audit 2024-09-14T05:21:36.477147+0000 mgr.a (mgr.14355) 18192 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:37 smithi131 bash[24745]: audit 2024-09-14T05:21:36.477147+0000 mgr.a (mgr.14355) 18192 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:37 smithi171 bash[25040]: audit 2024-09-14T05:21:36.477147+0000 mgr.a (mgr.14355) 18192 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:21:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:38 smithi007 bash[22722]: audit 2024-09-14T05:21:37.238810+0000 mgr.a (mgr.14355) 18193 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:21:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:38 smithi007 bash[22722]: cephadm 2024-09-14T05:21:37.239962+0000 mgr.a (mgr.14355) 18194 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:21:39.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:38 smithi007 bash[22722]: cluster 2024-09-14T05:21:37.847837+0000 mgr.a (mgr.14355) 18195 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:38 smithi131 bash[24745]: audit 2024-09-14T05:21:37.238810+0000 mgr.a (mgr.14355) 18193 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:21:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:38 smithi131 bash[24745]: cephadm 2024-09-14T05:21:37.239962+0000 mgr.a (mgr.14355) 18194 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:21:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:38 smithi131 bash[24745]: cluster 2024-09-14T05:21:37.847837+0000 mgr.a (mgr.14355) 18195 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:38 smithi171 bash[25040]: audit 2024-09-14T05:21:37.238810+0000 mgr.a (mgr.14355) 18193 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:21:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:38 smithi171 bash[25040]: cephadm 2024-09-14T05:21:37.239962+0000 mgr.a (mgr.14355) 18194 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:21:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:38 smithi171 bash[25040]: cluster 2024-09-14T05:21:37.847837+0000 mgr.a (mgr.14355) 18195 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:39.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:39.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:39 smithi007 bash[22722]: audit 2024-09-14T05:21:39.846887+0000 mgr.a (mgr.14355) 18196 : audit [DBG] from='client.390768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:39 smithi007 bash[22722]: cluster 2024-09-14T05:21:39.864721+0000 mgr.a (mgr.14355) 18197 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:39 smithi131 bash[24745]: audit 2024-09-14T05:21:39.846887+0000 mgr.a (mgr.14355) 18196 : audit [DBG] from='client.390768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:39 smithi131 bash[24745]: cluster 2024-09-14T05:21:39.864721+0000 mgr.a (mgr.14355) 18197 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:40.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:40.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:39 smithi171 bash[25040]: audit 2024-09-14T05:21:39.846887+0000 mgr.a (mgr.14355) 18196 : audit [DBG] from='client.390768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:39 smithi171 bash[25040]: cluster 2024-09-14T05:21:39.864721+0000 mgr.a (mgr.14355) 18197 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:42 smithi007 bash[22722]: cluster 2024-09-14T05:21:41.867338+0000 mgr.a (mgr.14355) 18198 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:42 smithi131 bash[24745]: cluster 2024-09-14T05:21:41.867338+0000 mgr.a (mgr.14355) 18198 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:42 smithi171 bash[25040]: cluster 2024-09-14T05:21:41.867338+0000 mgr.a (mgr.14355) 18198 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:44 smithi007 bash[22722]: cluster 2024-09-14T05:21:43.868261+0000 mgr.a (mgr.14355) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:44 smithi131 bash[24745]: cluster 2024-09-14T05:21:43.868261+0000 mgr.a (mgr.14355) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:45.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:45.286 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:45.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:44 smithi171 bash[25040]: cluster 2024-09-14T05:21:43.868261+0000 mgr.a (mgr.14355) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:46.064 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:46.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:46 smithi007 bash[22722]: audit 2024-09-14T05:21:45.616933+0000 mgr.a (mgr.14355) 18200 : audit [DBG] from='client.390846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:46 smithi007 bash[22722]: cluster 2024-09-14T05:21:45.869695+0000 mgr.a (mgr.14355) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:46 smithi131 bash[24745]: audit 2024-09-14T05:21:45.616933+0000 mgr.a (mgr.14355) 18200 : audit [DBG] from='client.390846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:46 smithi131 bash[24745]: cluster 2024-09-14T05:21:45.869695+0000 mgr.a (mgr.14355) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:46 smithi171 bash[25040]: audit 2024-09-14T05:21:45.616933+0000 mgr.a (mgr.14355) 18200 : audit [DBG] from='client.390846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:47.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:46 smithi171 bash[25040]: cluster 2024-09-14T05:21:45.869695+0000 mgr.a (mgr.14355) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:21:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:47 smithi131 bash[24745]: cluster 2024-09-14T05:21:47.870784+0000 mgr.a (mgr.14355) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:47 smithi171 bash[25040]: cluster 2024-09-14T05:21:47.870784+0000 mgr.a (mgr.14355) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:47 smithi007 bash[22722]: cluster 2024-09-14T05:21:47.870784+0000 mgr.a (mgr.14355) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:50 smithi007 bash[22722]: cluster 2024-09-14T05:21:49.871594+0000 mgr.a (mgr.14355) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:51.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:50 smithi131 bash[24745]: cluster 2024-09-14T05:21:49.871594+0000 mgr.a (mgr.14355) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:50 smithi171 bash[25040]: cluster 2024-09-14T05:21:49.871594+0000 mgr.a (mgr.14355) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:21:51.846 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:52 smithi007 bash[22722]: audit 2024-09-14T05:21:51.395034+0000 mgr.a (mgr.14355) 18204 : audit [DBG] from='client.390924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:52 smithi007 bash[22722]: cluster 2024-09-14T05:21:51.872972+0000 mgr.a (mgr.14355) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:21:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:52 smithi131 bash[24745]: audit 2024-09-14T05:21:51.395034+0000 mgr.a (mgr.14355) 18204 : audit [DBG] from='client.390924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:52 smithi131 bash[24745]: cluster 2024-09-14T05:21:51.872972+0000 mgr.a (mgr.14355) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:21:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:52 smithi171 bash[25040]: audit 2024-09-14T05:21:51.395034+0000 mgr.a (mgr.14355) 18204 : audit [DBG] from='client.390924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:52 smithi171 bash[25040]: cluster 2024-09-14T05:21:51.872972+0000 mgr.a (mgr.14355) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:21:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:53 smithi131 bash[24745]: cluster 2024-09-14T05:21:53.873720+0000 mgr.a (mgr.14355) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:21:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:53 smithi171 bash[25040]: cluster 2024-09-14T05:21:53.873720+0000 mgr.a (mgr.14355) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:21:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:53 smithi007 bash[22722]: cluster 2024-09-14T05:21:53.873720+0000 mgr.a (mgr.14355) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:21:56.848 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:21:56.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:21:56.849 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:21:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:56 smithi007 bash[22722]: cluster 2024-09-14T05:21:55.875676+0000 mgr.a (mgr.14355) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:21:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:56 smithi131 bash[24745]: cluster 2024-09-14T05:21:55.875676+0000 mgr.a (mgr.14355) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:21:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:56 smithi171 bash[25040]: cluster 2024-09-14T05:21:55.875676+0000 mgr.a (mgr.14355) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:21:57.638 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:21:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:21:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:21:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:21:57.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:21:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:57 smithi131 bash[24745]: audit 2024-09-14T05:21:57.191488+0000 mgr.a (mgr.14355) 18208 : audit [DBG] from='client.391002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:21:57 smithi131 bash[24745]: cluster 2024-09-14T05:21:57.876267+0000 mgr.a (mgr.14355) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:57 smithi171 bash[25040]: audit 2024-09-14T05:21:57.191488+0000 mgr.a (mgr.14355) 18208 : audit [DBG] from='client.391002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:21:57 smithi171 bash[25040]: cluster 2024-09-14T05:21:57.876267+0000 mgr.a (mgr.14355) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:21:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:57 smithi007 bash[22722]: audit 2024-09-14T05:21:57.191488+0000 mgr.a (mgr.14355) 18208 : audit [DBG] from='client.391002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:21:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:21:57 smithi007 bash[22722]: cluster 2024-09-14T05:21:57.876267+0000 mgr.a (mgr.14355) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:00 smithi007 bash[22722]: cluster 2024-09-14T05:21:59.877009+0000 mgr.a (mgr.14355) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:00 smithi131 bash[24745]: cluster 2024-09-14T05:21:59.877009+0000 mgr.a (mgr.14355) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:00 smithi171 bash[25040]: cluster 2024-09-14T05:21:59.877009+0000 mgr.a (mgr.14355) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:01 smithi131 bash[24745]: cluster 2024-09-14T05:22:01.879320+0000 mgr.a (mgr.14355) 18211 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-14T05:22:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:01 smithi171 bash[25040]: cluster 2024-09-14T05:22:01.879320+0000 mgr.a (mgr.14355) 18211 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-14T05:22:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:01 smithi007 bash[22722]: cluster 2024-09-14T05:22:01.879320+0000 mgr.a (mgr.14355) 18211 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-14T05:22:02.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:02.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:02.640 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:03.421 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:03.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:04 smithi007 bash[22722]: audit 2024-09-14T05:22:02.973178+0000 mgr.a (mgr.14355) 18212 : audit [DBG] from='client.391080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:04 smithi007 bash[22722]: cluster 2024-09-14T05:22:03.880339+0000 mgr.a (mgr.14355) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-14T05:22:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:04 smithi131 bash[24745]: audit 2024-09-14T05:22:02.973178+0000 mgr.a (mgr.14355) 18212 : audit [DBG] from='client.391080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:04 smithi131 bash[24745]: cluster 2024-09-14T05:22:03.880339+0000 mgr.a (mgr.14355) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-14T05:22:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:04 smithi171 bash[25040]: audit 2024-09-14T05:22:02.973178+0000 mgr.a (mgr.14355) 18212 : audit [DBG] from='client.391080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:04 smithi171 bash[25040]: cluster 2024-09-14T05:22:03.880339+0000 mgr.a (mgr.14355) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-09-14T05:22:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:05 smithi007 bash[22722]: cluster 2024-09-14T05:22:05.882614+0000 mgr.a (mgr.14355) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:05 smithi131 bash[24745]: cluster 2024-09-14T05:22:05.882614+0000 mgr.a (mgr.14355) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:05 smithi171 bash[25040]: cluster 2024-09-14T05:22:05.882614+0000 mgr.a (mgr.14355) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:07 smithi131 bash[24745]: cluster 2024-09-14T05:22:07.883395+0000 mgr.a (mgr.14355) 18215 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:07 smithi171 bash[25040]: cluster 2024-09-14T05:22:07.883395+0000 mgr.a (mgr.14355) 18215 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:08.421 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:08.422 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:07 smithi007 bash[22722]: cluster 2024-09-14T05:22:07.883395+0000 mgr.a (mgr.14355) 18215 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:09.178 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:09.178 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:08 smithi131 bash[24745]: audit 2024-09-14T05:22:08.756288+0000 mgr.a (mgr.14355) 18216 : audit [DBG] from='client.391158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:08 smithi171 bash[25040]: audit 2024-09-14T05:22:08.756288+0000 mgr.a (mgr.14355) 18216 : audit [DBG] from='client.391158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:09.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:08 smithi007 bash[22722]: audit 2024-09-14T05:22:08.756288+0000 mgr.a (mgr.14355) 18216 : audit [DBG] from='client.391158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:09 smithi131 bash[24745]: cluster 2024-09-14T05:22:09.884366+0000 mgr.a (mgr.14355) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:09 smithi171 bash[25040]: cluster 2024-09-14T05:22:09.884366+0000 mgr.a (mgr.14355) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:09 smithi007 bash[22722]: cluster 2024-09-14T05:22:09.884366+0000 mgr.a (mgr.14355) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:11 smithi131 bash[24745]: cluster 2024-09-14T05:22:11.886683+0000 mgr.a (mgr.14355) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:11 smithi171 bash[25040]: cluster 2024-09-14T05:22:11.886683+0000 mgr.a (mgr.14355) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:11 smithi007 bash[22722]: cluster 2024-09-14T05:22:11.886683+0000 mgr.a (mgr.14355) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-14T05:22:14.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:13 smithi131 bash[24745]: cluster 2024-09-14T05:22:13.887464+0000 mgr.a (mgr.14355) 18219 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:22:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:13 smithi171 bash[25040]: cluster 2024-09-14T05:22:13.887464+0000 mgr.a (mgr.14355) 18219 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:22:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:13 smithi007 bash[22722]: cluster 2024-09-14T05:22:13.887464+0000 mgr.a (mgr.14355) 18219 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:22:14.964 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:14.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:14 smithi131 bash[24745]: audit 2024-09-14T05:22:14.513389+0000 mgr.a (mgr.14355) 18220 : audit [DBG] from='client.391236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:14 smithi171 bash[25040]: audit 2024-09-14T05:22:14.513389+0000 mgr.a (mgr.14355) 18220 : audit [DBG] from='client.391236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:14 smithi007 bash[22722]: audit 2024-09-14T05:22:14.513389+0000 mgr.a (mgr.14355) 18220 : audit [DBG] from='client.391236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:16 smithi131 bash[24745]: cluster 2024-09-14T05:22:15.889823+0000 mgr.a (mgr.14355) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:22:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:16 smithi171 bash[25040]: cluster 2024-09-14T05:22:15.889823+0000 mgr.a (mgr.14355) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:22:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:16 smithi007 bash[22722]: cluster 2024-09-14T05:22:15.889823+0000 mgr.a (mgr.14355) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:22:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:17 smithi131 bash[24745]: cluster 2024-09-14T05:22:17.890620+0000 mgr.a (mgr.14355) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:17 smithi171 bash[25040]: cluster 2024-09-14T05:22:17.890620+0000 mgr.a (mgr.14355) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:17 smithi007 bash[22722]: cluster 2024-09-14T05:22:17.890620+0000 mgr.a (mgr.14355) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:19.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:19.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:19 smithi131 bash[24745]: cluster 2024-09-14T05:22:19.891387+0000 mgr.a (mgr.14355) 18223 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:19 smithi171 bash[25040]: cluster 2024-09-14T05:22:19.891387+0000 mgr.a (mgr.14355) 18223 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:19 smithi007 bash[22722]: cluster 2024-09-14T05:22:19.891387+0000 mgr.a (mgr.14355) 18223 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:20.727 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:20.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:21 smithi007 bash[22722]: audit 2024-09-14T05:22:20.301836+0000 mgr.a (mgr.14355) 18224 : audit [DBG] from='client.391311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:21 smithi131 bash[24745]: audit 2024-09-14T05:22:20.301836+0000 mgr.a (mgr.14355) 18224 : audit [DBG] from='client.391311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:21 smithi171 bash[25040]: audit 2024-09-14T05:22:20.301836+0000 mgr.a (mgr.14355) 18224 : audit [DBG] from='client.391311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:22 smithi007 bash[22722]: cluster 2024-09-14T05:22:21.894278+0000 mgr.a (mgr.14355) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:22 smithi131 bash[24745]: cluster 2024-09-14T05:22:21.894278+0000 mgr.a (mgr.14355) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:22 smithi171 bash[25040]: cluster 2024-09-14T05:22:21.894278+0000 mgr.a (mgr.14355) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:23 smithi131 bash[24745]: cluster 2024-09-14T05:22:23.895128+0000 mgr.a (mgr.14355) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:22:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:23 smithi171 bash[25040]: cluster 2024-09-14T05:22:23.895128+0000 mgr.a (mgr.14355) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:22:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:23 smithi007 bash[22722]: cluster 2024-09-14T05:22:23.895128+0000 mgr.a (mgr.14355) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:22:25.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:25.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:25 smithi131 bash[24745]: cluster 2024-09-14T05:22:25.897205+0000 mgr.a (mgr.14355) 18227 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-14T05:22:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:25 smithi171 bash[25040]: cluster 2024-09-14T05:22:25.897205+0000 mgr.a (mgr.14355) 18227 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-14T05:22:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:25 smithi007 bash[22722]: cluster 2024-09-14T05:22:25.897205+0000 mgr.a (mgr.14355) 18227 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-14T05:22:26.503 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:26.503 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:26.504 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:26 smithi131 bash[24745]: audit 2024-09-14T05:22:26.063701+0000 mgr.a (mgr.14355) 18228 : audit [DBG] from='client.391386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:26 smithi171 bash[25040]: audit 2024-09-14T05:22:26.063701+0000 mgr.a (mgr.14355) 18228 : audit [DBG] from='client.391386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:26 smithi007 bash[22722]: audit 2024-09-14T05:22:26.063701+0000 mgr.a (mgr.14355) 18228 : audit [DBG] from='client.391386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:28 smithi131 bash[24745]: cluster 2024-09-14T05:22:27.898124+0000 mgr.a (mgr.14355) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:28 smithi171 bash[25040]: cluster 2024-09-14T05:22:27.898124+0000 mgr.a (mgr.14355) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:28 smithi007 bash[22722]: cluster 2024-09-14T05:22:27.898124+0000 mgr.a (mgr.14355) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:29 smithi131 bash[24745]: cluster 2024-09-14T05:22:29.898932+0000 mgr.a (mgr.14355) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:29 smithi171 bash[25040]: cluster 2024-09-14T05:22:29.898932+0000 mgr.a (mgr.14355) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:29 smithi007 bash[22722]: cluster 2024-09-14T05:22:29.898932+0000 mgr.a (mgr.14355) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-14T05:22:31.505 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:31.506 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:31 smithi131 bash[24745]: audit 2024-09-14T05:22:31.844089+0000 mgr.a (mgr.14355) 18231 : audit [DBG] from='client.391464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:31 smithi131 bash[24745]: cluster 2024-09-14T05:22:31.901909+0000 mgr.a (mgr.14355) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:32.285 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:31 smithi171 bash[25040]: audit 2024-09-14T05:22:31.844089+0000 mgr.a (mgr.14355) 18231 : audit [DBG] from='client.391464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:31 smithi171 bash[25040]: cluster 2024-09-14T05:22:31.901909+0000 mgr.a (mgr.14355) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:31 smithi007 bash[22722]: audit 2024-09-14T05:22:31.844089+0000 mgr.a (mgr.14355) 18231 : audit [DBG] from='client.391464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:31 smithi007 bash[22722]: cluster 2024-09-14T05:22:31.901909+0000 mgr.a (mgr.14355) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:33 smithi131 bash[24745]: cluster 2024-09-14T05:22:33.902847+0000 mgr.a (mgr.14355) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:33 smithi171 bash[25040]: cluster 2024-09-14T05:22:33.902847+0000 mgr.a (mgr.14355) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:33 smithi007 bash[22722]: cluster 2024-09-14T05:22:33.902847+0000 mgr.a (mgr.14355) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:22:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:35 smithi131 bash[24745]: cluster 2024-09-14T05:22:35.905132+0000 mgr.a (mgr.14355) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:22:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:35 smithi171 bash[25040]: cluster 2024-09-14T05:22:35.905132+0000 mgr.a (mgr.14355) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:22:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:35 smithi007 bash[22722]: cluster 2024-09-14T05:22:35.905132+0000 mgr.a (mgr.14355) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:22:37.287 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:37.288 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:37 smithi007 bash[22722]: audit 2024-09-14T05:22:37.289626+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:22:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:37 smithi131 bash[24745]: audit 2024-09-14T05:22:37.289626+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:22:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:37 smithi171 bash[25040]: audit 2024-09-14T05:22:37.289626+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:22:38.115 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:38.115 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: audit 2024-09-14T05:22:37.640403+0000 mgr.a (mgr.14355) 18235 : audit [DBG] from='client.391539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: cluster 2024-09-14T05:22:37.905761+0000 mgr.a (mgr.14355) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: audit 2024-09-14T05:22:38.139342+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: audit 2024-09-14T05:22:38.140187+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: audit 2024-09-14T05:22:38.145458+0000 mon.a (mon.0) 3310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:22:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22722]: audit 2024-09-14T05:22:38.147424+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: audit 2024-09-14T05:22:37.640403+0000 mgr.a (mgr.14355) 18235 : audit [DBG] from='client.391539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: cluster 2024-09-14T05:22:37.905761+0000 mgr.a (mgr.14355) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: audit 2024-09-14T05:22:38.139342+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:22:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: audit 2024-09-14T05:22:38.140187+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:22:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: audit 2024-09-14T05:22:38.145458+0000 mon.a (mon.0) 3310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:22:38.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:38 smithi131 bash[24745]: audit 2024-09-14T05:22:38.147424+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: audit 2024-09-14T05:22:37.640403+0000 mgr.a (mgr.14355) 18235 : audit [DBG] from='client.391539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: cluster 2024-09-14T05:22:37.905761+0000 mgr.a (mgr.14355) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: audit 2024-09-14T05:22:38.139342+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: audit 2024-09-14T05:22:38.140187+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: audit 2024-09-14T05:22:38.145458+0000 mon.a (mon.0) 3310 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:22:38.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:38 smithi171 bash[25040]: audit 2024-09-14T05:22:38.147424+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22972]: debug 2024-09-14T05:22:38.872+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:22:39.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:22:38 smithi007 bash[22972]: debug 2024-09-14T05:22:38.872+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:22:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:39 smithi007 bash[22722]: audit 2024-09-14T05:22:38.148463+0000 mgr.a (mgr.14355) 18237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:39 smithi007 bash[22722]: audit 2024-09-14T05:22:38.874455+0000 mgr.a (mgr.14355) 18238 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:22:39.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:39 smithi007 bash[22722]: cephadm 2024-09-14T05:22:38.875842+0000 mgr.a (mgr.14355) 18239 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:39 smithi131 bash[24745]: audit 2024-09-14T05:22:38.148463+0000 mgr.a (mgr.14355) 18237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:39 smithi131 bash[24745]: audit 2024-09-14T05:22:38.874455+0000 mgr.a (mgr.14355) 18238 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:22:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:39 smithi131 bash[24745]: cephadm 2024-09-14T05:22:38.875842+0000 mgr.a (mgr.14355) 18239 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:22:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:39 smithi171 bash[25040]: audit 2024-09-14T05:22:38.148463+0000 mgr.a (mgr.14355) 18237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:22:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:39 smithi171 bash[25040]: audit 2024-09-14T05:22:38.874455+0000 mgr.a (mgr.14355) 18238 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:22:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:39 smithi171 bash[25040]: cephadm 2024-09-14T05:22:38.875842+0000 mgr.a (mgr.14355) 18239 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:22:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:40 smithi007 bash[22722]: cluster 2024-09-14T05:22:39.906736+0000 mgr.a (mgr.14355) 18240 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:40 smithi131 bash[24745]: cluster 2024-09-14T05:22:39.906736+0000 mgr.a (mgr.14355) 18240 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:40 smithi171 bash[25040]: cluster 2024-09-14T05:22:39.906736+0000 mgr.a (mgr.14355) 18240 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-14T05:22:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:41 smithi131 bash[24745]: cluster 2024-09-14T05:22:41.909004+0000 mgr.a (mgr.14355) 18241 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T05:22:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:41 smithi171 bash[25040]: cluster 2024-09-14T05:22:41.909004+0000 mgr.a (mgr.14355) 18241 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T05:22:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:41 smithi007 bash[22722]: cluster 2024-09-14T05:22:41.909004+0000 mgr.a (mgr.14355) 18241 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-09-14T05:22:43.116 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:43.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:43.117 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:43.856 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:43.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:43 smithi131 bash[24745]: audit 2024-09-14T05:22:43.442943+0000 mgr.a (mgr.14355) 18242 : audit [DBG] from='client.391713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:43 smithi131 bash[24745]: cluster 2024-09-14T05:22:43.909748+0000 mgr.a (mgr.14355) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:43 smithi171 bash[25040]: audit 2024-09-14T05:22:43.442943+0000 mgr.a (mgr.14355) 18242 : audit [DBG] from='client.391713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:43 smithi171 bash[25040]: cluster 2024-09-14T05:22:43.909748+0000 mgr.a (mgr.14355) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:43 smithi007 bash[22722]: audit 2024-09-14T05:22:43.442943+0000 mgr.a (mgr.14355) 18242 : audit [DBG] from='client.391713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:43 smithi007 bash[22722]: cluster 2024-09-14T05:22:43.909748+0000 mgr.a (mgr.14355) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:46.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:45 smithi131 bash[24745]: cluster 2024-09-14T05:22:45.911495+0000 mgr.a (mgr.14355) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:45 smithi171 bash[25040]: cluster 2024-09-14T05:22:45.911495+0000 mgr.a (mgr.14355) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:45 smithi007 bash[22722]: cluster 2024-09-14T05:22:45.911495+0000 mgr.a (mgr.14355) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:47 smithi131 bash[24745]: cluster 2024-09-14T05:22:47.912240+0000 mgr.a (mgr.14355) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:47 smithi171 bash[25040]: cluster 2024-09-14T05:22:47.912240+0000 mgr.a (mgr.14355) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:47 smithi007 bash[22722]: cluster 2024-09-14T05:22:47.912240+0000 mgr.a (mgr.14355) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:48.858 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:48.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:48.859 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:49.603 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:49.603 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:49.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:49.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:49 smithi131 bash[24745]: audit 2024-09-14T05:22:49.184013+0000 mgr.a (mgr.14355) 18246 : audit [DBG] from='client.391788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:49 smithi131 bash[24745]: cluster 2024-09-14T05:22:49.913216+0000 mgr.a (mgr.14355) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:49 smithi171 bash[25040]: audit 2024-09-14T05:22:49.184013+0000 mgr.a (mgr.14355) 18246 : audit [DBG] from='client.391788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:49 smithi171 bash[25040]: cluster 2024-09-14T05:22:49.913216+0000 mgr.a (mgr.14355) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:49 smithi007 bash[22722]: audit 2024-09-14T05:22:49.184013+0000 mgr.a (mgr.14355) 18246 : audit [DBG] from='client.391788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:50.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:49 smithi007 bash[22722]: cluster 2024-09-14T05:22:49.913216+0000 mgr.a (mgr.14355) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:51 smithi131 bash[24745]: cluster 2024-09-14T05:22:51.915508+0000 mgr.a (mgr.14355) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:51 smithi171 bash[25040]: cluster 2024-09-14T05:22:51.915508+0000 mgr.a (mgr.14355) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:51 smithi007 bash[22722]: cluster 2024-09-14T05:22:51.915508+0000 mgr.a (mgr.14355) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:22:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:53 smithi131 bash[24745]: cluster 2024-09-14T05:22:53.916252+0000 mgr.a (mgr.14355) 18249 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:53 smithi171 bash[25040]: cluster 2024-09-14T05:22:53.916252+0000 mgr.a (mgr.14355) 18249 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:53 smithi007 bash[22722]: cluster 2024-09-14T05:22:53.916252+0000 mgr.a (mgr.14355) 18249 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:22:54.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:22:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:22:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:22:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:54 smithi131 bash[24745]: audit 2024-09-14T05:22:54.943172+0000 mgr.a (mgr.14355) 18250 : audit [DBG] from='client.391863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:54 smithi171 bash[25040]: audit 2024-09-14T05:22:54.943172+0000 mgr.a (mgr.14355) 18250 : audit [DBG] from='client.391863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:55.382 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:22:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:22:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:22:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:22:55.382 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:22:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:54 smithi007 bash[22722]: audit 2024-09-14T05:22:54.943172+0000 mgr.a (mgr.14355) 18250 : audit [DBG] from='client.391863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:22:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:56 smithi131 bash[24745]: cluster 2024-09-14T05:22:55.918741+0000 mgr.a (mgr.14355) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:22:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:56 smithi171 bash[25040]: cluster 2024-09-14T05:22:55.918741+0000 mgr.a (mgr.14355) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:22:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:56 smithi007 bash[22722]: cluster 2024-09-14T05:22:55.918741+0000 mgr.a (mgr.14355) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:22:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:22:58 smithi131 bash[24745]: cluster 2024-09-14T05:22:57.919521+0000 mgr.a (mgr.14355) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:22:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:22:58 smithi171 bash[25040]: cluster 2024-09-14T05:22:57.919521+0000 mgr.a (mgr.14355) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:22:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:22:58 smithi007 bash[22722]: cluster 2024-09-14T05:22:57.919521+0000 mgr.a (mgr.14355) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:23:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:00 smithi131 bash[24745]: cluster 2024-09-14T05:22:59.920263+0000 mgr.a (mgr.14355) 18253 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:23:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:00 smithi171 bash[25040]: cluster 2024-09-14T05:22:59.920263+0000 mgr.a (mgr.14355) 18253 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:23:00.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:00.384 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:00.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:00 smithi007 bash[22722]: cluster 2024-09-14T05:22:59.920263+0000 mgr.a (mgr.14355) 18253 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:23:01.160 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:01 smithi131 bash[24745]: audit 2024-09-14T05:23:00.718741+0000 mgr.a (mgr.14355) 18254 : audit [DBG] from='client.391938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:01.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:01 smithi171 bash[25040]: audit 2024-09-14T05:23:00.718741+0000 mgr.a (mgr.14355) 18254 : audit [DBG] from='client.391938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:01 smithi007 bash[22722]: audit 2024-09-14T05:23:00.718741+0000 mgr.a (mgr.14355) 18254 : audit [DBG] from='client.391938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:02 smithi171 bash[25040]: cluster 2024-09-14T05:23:01.923163+0000 mgr.a (mgr.14355) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:02 smithi007 bash[22722]: cluster 2024-09-14T05:23:01.923163+0000 mgr.a (mgr.14355) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:02 smithi131 bash[24745]: cluster 2024-09-14T05:23:01.923163+0000 mgr.a (mgr.14355) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:04 smithi131 bash[24745]: cluster 2024-09-14T05:23:03.923949+0000 mgr.a (mgr.14355) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:04 smithi171 bash[25040]: cluster 2024-09-14T05:23:03.923949+0000 mgr.a (mgr.14355) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:04 smithi007 bash[22722]: cluster 2024-09-14T05:23:03.923949+0000 mgr.a (mgr.14355) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:06.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:06.162 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:06 smithi131 bash[24745]: cluster 2024-09-14T05:23:05.925867+0000 mgr.a (mgr.14355) 18257 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:06 smithi171 bash[25040]: cluster 2024-09-14T05:23:05.925867+0000 mgr.a (mgr.14355) 18257 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:06 smithi007 bash[22722]: cluster 2024-09-14T05:23:05.925867+0000 mgr.a (mgr.14355) 18257 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:06.913 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:07 smithi131 bash[24745]: audit 2024-09-14T05:23:06.490398+0000 mgr.a (mgr.14355) 18258 : audit [DBG] from='client.392016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:07 smithi171 bash[25040]: audit 2024-09-14T05:23:06.490398+0000 mgr.a (mgr.14355) 18258 : audit [DBG] from='client.392016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:07 smithi007 bash[22722]: audit 2024-09-14T05:23:06.490398+0000 mgr.a (mgr.14355) 18258 : audit [DBG] from='client.392016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:08 smithi131 bash[24745]: cluster 2024-09-14T05:23:07.926826+0000 mgr.a (mgr.14355) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:08 smithi171 bash[25040]: cluster 2024-09-14T05:23:07.926826+0000 mgr.a (mgr.14355) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:08 smithi007 bash[22722]: cluster 2024-09-14T05:23:07.926826+0000 mgr.a (mgr.14355) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:10 smithi131 bash[24745]: cluster 2024-09-14T05:23:09.927603+0000 mgr.a (mgr.14355) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:10 smithi171 bash[25040]: cluster 2024-09-14T05:23:09.927603+0000 mgr.a (mgr.14355) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:10 smithi007 bash[22722]: cluster 2024-09-14T05:23:09.927603+0000 mgr.a (mgr.14355) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:23:11.915 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:11.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:11.916 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:12 smithi131 bash[24745]: cluster 2024-09-14T05:23:11.928982+0000 mgr.a (mgr.14355) 18261 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:23:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:12 smithi171 bash[25040]: cluster 2024-09-14T05:23:11.928982+0000 mgr.a (mgr.14355) 18261 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:23:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:12 smithi007 bash[22722]: cluster 2024-09-14T05:23:11.928982+0000 mgr.a (mgr.14355) 18261 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:23:12.689 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:12.689 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:12.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:12.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:12.690 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:13 smithi131 bash[24745]: audit 2024-09-14T05:23:12.253273+0000 mgr.a (mgr.14355) 18262 : audit [DBG] from='client.392091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:13 smithi171 bash[25040]: audit 2024-09-14T05:23:12.253273+0000 mgr.a (mgr.14355) 18262 : audit [DBG] from='client.392091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:13 smithi007 bash[22722]: audit 2024-09-14T05:23:12.253273+0000 mgr.a (mgr.14355) 18262 : audit [DBG] from='client.392091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:14 smithi131 bash[24745]: cluster 2024-09-14T05:23:13.929866+0000 mgr.a (mgr.14355) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:14 smithi171 bash[25040]: cluster 2024-09-14T05:23:13.929866+0000 mgr.a (mgr.14355) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:14 smithi007 bash[22722]: cluster 2024-09-14T05:23:13.929866+0000 mgr.a (mgr.14355) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:16 smithi131 bash[24745]: cluster 2024-09-14T05:23:15.932064+0000 mgr.a (mgr.14355) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:16 smithi171 bash[25040]: cluster 2024-09-14T05:23:15.932064+0000 mgr.a (mgr.14355) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:16 smithi007 bash[22722]: cluster 2024-09-14T05:23:15.932064+0000 mgr.a (mgr.14355) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:17.691 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:17.692 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:18 smithi131 bash[24745]: cluster 2024-09-14T05:23:17.932597+0000 mgr.a (mgr.14355) 18265 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:18 smithi171 bash[25040]: cluster 2024-09-14T05:23:17.932597+0000 mgr.a (mgr.14355) 18265 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:18 smithi007 bash[22722]: cluster 2024-09-14T05:23:17.932597+0000 mgr.a (mgr.14355) 18265 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:18.470 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:18.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:19 smithi131 bash[24745]: audit 2024-09-14T05:23:18.025438+0000 mgr.a (mgr.14355) 18266 : audit [DBG] from='client.392169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:19 smithi171 bash[25040]: audit 2024-09-14T05:23:18.025438+0000 mgr.a (mgr.14355) 18266 : audit [DBG] from='client.392169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:19 smithi007 bash[22722]: audit 2024-09-14T05:23:18.025438+0000 mgr.a (mgr.14355) 18266 : audit [DBG] from='client.392169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:20 smithi131 bash[24745]: cluster 2024-09-14T05:23:19.933460+0000 mgr.a (mgr.14355) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:20.571 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:20 smithi007 bash[22722]: cluster 2024-09-14T05:23:19.933460+0000 mgr.a (mgr.14355) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:20.571 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:20 smithi171 bash[25040]: cluster 2024-09-14T05:23:19.933460+0000 mgr.a (mgr.14355) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:22 smithi131 bash[24745]: cluster 2024-09-14T05:23:21.935755+0000 mgr.a (mgr.14355) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:22 smithi171 bash[25040]: cluster 2024-09-14T05:23:21.935755+0000 mgr.a (mgr.14355) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:22 smithi007 bash[22722]: cluster 2024-09-14T05:23:21.935755+0000 mgr.a (mgr.14355) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:23.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:23.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:24.266 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:24 smithi131 bash[24745]: audit 2024-09-14T05:23:23.809401+0000 mgr.a (mgr.14355) 18269 : audit [DBG] from='client.392247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:24 smithi131 bash[24745]: cluster 2024-09-14T05:23:23.936337+0000 mgr.a (mgr.14355) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:24 smithi171 bash[25040]: audit 2024-09-14T05:23:23.809401+0000 mgr.a (mgr.14355) 18269 : audit [DBG] from='client.392247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:24 smithi171 bash[25040]: cluster 2024-09-14T05:23:23.936337+0000 mgr.a (mgr.14355) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:24 smithi007 bash[22722]: audit 2024-09-14T05:23:23.809401+0000 mgr.a (mgr.14355) 18269 : audit [DBG] from='client.392247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:24 smithi007 bash[22722]: cluster 2024-09-14T05:23:23.936337+0000 mgr.a (mgr.14355) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:26 smithi131 bash[24745]: cluster 2024-09-14T05:23:25.938645+0000 mgr.a (mgr.14355) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:26 smithi171 bash[25040]: cluster 2024-09-14T05:23:25.938645+0000 mgr.a (mgr.14355) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:26 smithi007 bash[22722]: cluster 2024-09-14T05:23:25.938645+0000 mgr.a (mgr.14355) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:28 smithi131 bash[24745]: cluster 2024-09-14T05:23:27.939415+0000 mgr.a (mgr.14355) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:28 smithi171 bash[25040]: cluster 2024-09-14T05:23:27.939415+0000 mgr.a (mgr.14355) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:28 smithi007 bash[22722]: cluster 2024-09-14T05:23:27.939415+0000 mgr.a (mgr.14355) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:29.267 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:29.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:29.268 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:30.026 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:30.026 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:30.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:30.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:30.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:30 smithi131 bash[24745]: audit 2024-09-14T05:23:29.593359+0000 mgr.a (mgr.14355) 18273 : audit [DBG] from='client.392322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:30 smithi131 bash[24745]: cluster 2024-09-14T05:23:29.940064+0000 mgr.a (mgr.14355) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:30 smithi171 bash[25040]: audit 2024-09-14T05:23:29.593359+0000 mgr.a (mgr.14355) 18273 : audit [DBG] from='client.392322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:30 smithi171 bash[25040]: cluster 2024-09-14T05:23:29.940064+0000 mgr.a (mgr.14355) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:30 smithi007 bash[22722]: audit 2024-09-14T05:23:29.593359+0000 mgr.a (mgr.14355) 18273 : audit [DBG] from='client.392322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:30 smithi007 bash[22722]: cluster 2024-09-14T05:23:29.940064+0000 mgr.a (mgr.14355) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:32 smithi131 bash[24745]: cluster 2024-09-14T05:23:31.942267+0000 mgr.a (mgr.14355) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:32 smithi171 bash[25040]: cluster 2024-09-14T05:23:31.942267+0000 mgr.a (mgr.14355) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:32 smithi007 bash[22722]: cluster 2024-09-14T05:23:31.942267+0000 mgr.a (mgr.14355) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:23:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:34 smithi131 bash[24745]: cluster 2024-09-14T05:23:33.943037+0000 mgr.a (mgr.14355) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:34 smithi171 bash[25040]: cluster 2024-09-14T05:23:33.943037+0000 mgr.a (mgr.14355) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:34 smithi007 bash[22722]: cluster 2024-09-14T05:23:33.943037+0000 mgr.a (mgr.14355) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:35.802 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:35.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:35.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:36.287 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:36 smithi131 bash[24745]: audit 2024-09-14T05:23:35.362383+0000 mgr.a (mgr.14355) 18277 : audit [DBG] from='client.392400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:36.288 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:36 smithi131 bash[24745]: cluster 2024-09-14T05:23:35.945799+0000 mgr.a (mgr.14355) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:36 smithi007 bash[22722]: audit 2024-09-14T05:23:35.362383+0000 mgr.a (mgr.14355) 18277 : audit [DBG] from='client.392400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:36 smithi007 bash[22722]: cluster 2024-09-14T05:23:35.945799+0000 mgr.a (mgr.14355) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:36.501 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:36 smithi171 bash[25040]: audit 2024-09-14T05:23:35.362383+0000 mgr.a (mgr.14355) 18277 : audit [DBG] from='client.392400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:36.501 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:36 smithi171 bash[25040]: cluster 2024-09-14T05:23:35.945799+0000 mgr.a (mgr.14355) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:38 smithi131 bash[24745]: cluster 2024-09-14T05:23:37.946588+0000 mgr.a (mgr.14355) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:38 smithi171 bash[25040]: cluster 2024-09-14T05:23:37.946588+0000 mgr.a (mgr.14355) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:38 smithi007 bash[22722]: cluster 2024-09-14T05:23:37.946588+0000 mgr.a (mgr.14355) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:23:39.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:39 smithi131 bash[24745]: audit 2024-09-14T05:23:38.929148+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:23:39.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:39 smithi171 bash[25040]: audit 2024-09-14T05:23:38.929148+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:23:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:39 smithi007 bash[22722]: audit 2024-09-14T05:23:38.929148+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:23:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: audit 2024-09-14T05:23:39.773956+0000 mon.a (mon.0) 3313 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:23:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: audit 2024-09-14T05:23:39.775204+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:23:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: audit 2024-09-14T05:23:39.784034+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:23:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: audit 2024-09-14T05:23:39.786397+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: audit 2024-09-14T05:23:39.788747+0000 mgr.a (mgr.14355) 18280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:40 smithi131 bash[24745]: cluster 2024-09-14T05:23:39.947558+0000 mgr.a (mgr.14355) 18281 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: audit 2024-09-14T05:23:39.773956+0000 mon.a (mon.0) 3313 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: audit 2024-09-14T05:23:39.775204+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: audit 2024-09-14T05:23:39.784034+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: audit 2024-09-14T05:23:39.786397+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: audit 2024-09-14T05:23:39.788747+0000 mgr.a (mgr.14355) 18280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:40 smithi171 bash[25040]: cluster 2024-09-14T05:23:39.947558+0000 mgr.a (mgr.14355) 18281 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:23:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: audit 2024-09-14T05:23:39.773956+0000 mon.a (mon.0) 3313 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:23:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: audit 2024-09-14T05:23:39.775204+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:23:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: audit 2024-09-14T05:23:39.784034+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:23:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: audit 2024-09-14T05:23:39.786397+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: audit 2024-09-14T05:23:39.788747+0000 mgr.a (mgr.14355) 18280 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:23:40.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22722]: cluster 2024-09-14T05:23:39.947558+0000 mgr.a (mgr.14355) 18281 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:23:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:40.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:40.805 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22972]: debug 2024-09-14T05:23:40.527+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:23:40.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:23:40 smithi007 bash[22972]: debug 2024-09-14T05:23:40.527+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:23:41.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:41 smithi171 bash[25040]: audit 2024-09-14T05:23:40.532006+0000 mgr.a (mgr.14355) 18282 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:23:42.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:41 smithi171 bash[25040]: cephadm 2024-09-14T05:23:40.533584+0000 mgr.a (mgr.14355) 18283 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:23:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:41 smithi007 bash[22722]: audit 2024-09-14T05:23:40.532006+0000 mgr.a (mgr.14355) 18282 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:23:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:41 smithi007 bash[22722]: cephadm 2024-09-14T05:23:40.533584+0000 mgr.a (mgr.14355) 18283 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:23:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:41 smithi131 bash[24745]: audit 2024-09-14T05:23:40.532006+0000 mgr.a (mgr.14355) 18282 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:23:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:41 smithi131 bash[24745]: cephadm 2024-09-14T05:23:40.533584+0000 mgr.a (mgr.14355) 18283 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:23:43.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:42 smithi171 bash[25040]: audit 2024-09-14T05:23:41.127230+0000 mgr.a (mgr.14355) 18284 : audit [DBG] from='client.392583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:43.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:42 smithi171 bash[25040]: cluster 2024-09-14T05:23:41.950433+0000 mgr.a (mgr.14355) 18285 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:23:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:42 smithi007 bash[22722]: audit 2024-09-14T05:23:41.127230+0000 mgr.a (mgr.14355) 18284 : audit [DBG] from='client.392583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:42 smithi007 bash[22722]: cluster 2024-09-14T05:23:41.950433+0000 mgr.a (mgr.14355) 18285 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:23:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:42 smithi131 bash[24745]: audit 2024-09-14T05:23:41.127230+0000 mgr.a (mgr.14355) 18284 : audit [DBG] from='client.392583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:42 smithi131 bash[24745]: cluster 2024-09-14T05:23:41.950433+0000 mgr.a (mgr.14355) 18285 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:23:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:44 smithi131 bash[24745]: cluster 2024-09-14T05:23:43.951204+0000 mgr.a (mgr.14355) 18286 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:23:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:44 smithi171 bash[25040]: cluster 2024-09-14T05:23:43.951204+0000 mgr.a (mgr.14355) 18286 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:23:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:44 smithi007 bash[22722]: cluster 2024-09-14T05:23:43.951204+0000 mgr.a (mgr.14355) 18286 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:23:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:46 smithi131 bash[24745]: cluster 2024-09-14T05:23:45.953149+0000 mgr.a (mgr.14355) 18287 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:46 smithi171 bash[25040]: cluster 2024-09-14T05:23:45.953149+0000 mgr.a (mgr.14355) 18287 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:46 smithi007 bash[22722]: cluster 2024-09-14T05:23:45.953149+0000 mgr.a (mgr.14355) 18287 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:46.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:46.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:46.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:47 smithi131 bash[24745]: audit 2024-09-14T05:23:46.887558+0000 mgr.a (mgr.14355) 18288 : audit [DBG] from='client.392661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:47 smithi171 bash[25040]: audit 2024-09-14T05:23:46.887558+0000 mgr.a (mgr.14355) 18288 : audit [DBG] from='client.392661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:47.342 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:47 smithi007 bash[22722]: audit 2024-09-14T05:23:46.887558+0000 mgr.a (mgr.14355) 18288 : audit [DBG] from='client.392661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:48 smithi171 bash[25040]: cluster 2024-09-14T05:23:47.954051+0000 mgr.a (mgr.14355) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:48 smithi007 bash[22722]: cluster 2024-09-14T05:23:47.954051+0000 mgr.a (mgr.14355) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:48 smithi131 bash[24745]: cluster 2024-09-14T05:23:47.954051+0000 mgr.a (mgr.14355) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:50 smithi131 bash[24745]: cluster 2024-09-14T05:23:49.954889+0000 mgr.a (mgr.14355) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:50 smithi171 bash[25040]: cluster 2024-09-14T05:23:49.954889+0000 mgr.a (mgr.14355) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:50 smithi007 bash[22722]: cluster 2024-09-14T05:23:49.954889+0000 mgr.a (mgr.14355) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:52 smithi131 bash[24745]: cluster 2024-09-14T05:23:51.957185+0000 mgr.a (mgr.14355) 18291 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:52 smithi171 bash[25040]: cluster 2024-09-14T05:23:51.957185+0000 mgr.a (mgr.14355) 18291 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:52.344 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:52.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:52.345 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:52 smithi007 bash[22722]: cluster 2024-09-14T05:23:51.957185+0000 mgr.a (mgr.14355) 18291 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:23:53.122 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:53.122 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:53.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:53 smithi131 bash[24745]: audit 2024-09-14T05:23:52.675796+0000 mgr.a (mgr.14355) 18292 : audit [DBG] from='client.392736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:53 smithi171 bash[25040]: audit 2024-09-14T05:23:52.675796+0000 mgr.a (mgr.14355) 18292 : audit [DBG] from='client.392736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:53 smithi007 bash[22722]: audit 2024-09-14T05:23:52.675796+0000 mgr.a (mgr.14355) 18292 : audit [DBG] from='client.392736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:54 smithi171 bash[25040]: cluster 2024-09-14T05:23:53.958089+0000 mgr.a (mgr.14355) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:23:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:54 smithi007 bash[22722]: cluster 2024-09-14T05:23:53.958089+0000 mgr.a (mgr.14355) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:23:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:54 smithi131 bash[24745]: cluster 2024-09-14T05:23:53.958089+0000 mgr.a (mgr.14355) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:23:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:56 smithi131 bash[24745]: cluster 2024-09-14T05:23:55.960317+0000 mgr.a (mgr.14355) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:23:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:56 smithi171 bash[25040]: cluster 2024-09-14T05:23:55.960317+0000 mgr.a (mgr.14355) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:23:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:56 smithi007 bash[22722]: cluster 2024-09-14T05:23:55.960317+0000 mgr.a (mgr.14355) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:23:58.123 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:23:58.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:23:58.124 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:23:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:58 smithi131 bash[24745]: cluster 2024-09-14T05:23:57.961062+0000 mgr.a (mgr.14355) 18295 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:58 smithi171 bash[25040]: cluster 2024-09-14T05:23:57.961062+0000 mgr.a (mgr.14355) 18295 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:58 smithi007 bash[22722]: cluster 2024-09-14T05:23:57.961062+0000 mgr.a (mgr.14355) 18295 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:23:58.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:23:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:23:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:23:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:23:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:23:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:23:59 smithi131 bash[24745]: audit 2024-09-14T05:23:58.455312+0000 mgr.a (mgr.14355) 18296 : audit [DBG] from='client.392811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:23:59 smithi171 bash[25040]: audit 2024-09-14T05:23:58.455312+0000 mgr.a (mgr.14355) 18296 : audit [DBG] from='client.392811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:23:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:23:59 smithi007 bash[22722]: audit 2024-09-14T05:23:58.455312+0000 mgr.a (mgr.14355) 18296 : audit [DBG] from='client.392811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:00 smithi171 bash[25040]: cluster 2024-09-14T05:23:59.961937+0000 mgr.a (mgr.14355) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:00.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:00 smithi007 bash[22722]: cluster 2024-09-14T05:23:59.961937+0000 mgr.a (mgr.14355) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:00 smithi131 bash[24745]: cluster 2024-09-14T05:23:59.961937+0000 mgr.a (mgr.14355) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:02 smithi131 bash[24745]: cluster 2024-09-14T05:24:01.964267+0000 mgr.a (mgr.14355) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:02.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:02 smithi171 bash[25040]: cluster 2024-09-14T05:24:01.964267+0000 mgr.a (mgr.14355) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:02 smithi007 bash[22722]: cluster 2024-09-14T05:24:01.964267+0000 mgr.a (mgr.14355) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:03.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:03.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:03.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:04 smithi131 bash[24745]: cluster 2024-09-14T05:24:03.964910+0000 mgr.a (mgr.14355) 18299 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:04 smithi171 bash[25040]: cluster 2024-09-14T05:24:03.964910+0000 mgr.a (mgr.14355) 18299 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:04 smithi007 bash[22722]: cluster 2024-09-14T05:24:03.964910+0000 mgr.a (mgr.14355) 18299 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:04.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:04.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:04.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:04.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:04.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:05.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:05 smithi131 bash[24745]: audit 2024-09-14T05:24:04.206048+0000 mgr.a (mgr.14355) 18300 : audit [DBG] from='client.392889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:05.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:05 smithi171 bash[25040]: audit 2024-09-14T05:24:04.206048+0000 mgr.a (mgr.14355) 18300 : audit [DBG] from='client.392889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:05 smithi007 bash[22722]: audit 2024-09-14T05:24:04.206048+0000 mgr.a (mgr.14355) 18300 : audit [DBG] from='client.392889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:06 smithi171 bash[25040]: cluster 2024-09-14T05:24:05.967277+0000 mgr.a (mgr.14355) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:06 smithi007 bash[22722]: cluster 2024-09-14T05:24:05.967277+0000 mgr.a (mgr.14355) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:06 smithi131 bash[24745]: cluster 2024-09-14T05:24:05.967277+0000 mgr.a (mgr.14355) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:08 smithi131 bash[24745]: cluster 2024-09-14T05:24:07.968033+0000 mgr.a (mgr.14355) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:08 smithi171 bash[25040]: cluster 2024-09-14T05:24:07.968033+0000 mgr.a (mgr.14355) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:08 smithi007 bash[22722]: cluster 2024-09-14T05:24:07.968033+0000 mgr.a (mgr.14355) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:09.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:09.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:09.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:10 smithi131 bash[24745]: cluster 2024-09-14T05:24:09.968533+0000 mgr.a (mgr.14355) 18303 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:10 smithi171 bash[25040]: cluster 2024-09-14T05:24:09.968533+0000 mgr.a (mgr.14355) 18303 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:10.401 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:10.401 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:10 smithi007 bash[22722]: cluster 2024-09-14T05:24:09.968533+0000 mgr.a (mgr.14355) 18303 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:11.286 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:11 smithi131 bash[24745]: audit 2024-09-14T05:24:09.979435+0000 mgr.a (mgr.14355) 18304 : audit [DBG] from='client.392967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:11.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:11 smithi171 bash[25040]: audit 2024-09-14T05:24:09.979435+0000 mgr.a (mgr.14355) 18304 : audit [DBG] from='client.392967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:11 smithi007 bash[22722]: audit 2024-09-14T05:24:09.979435+0000 mgr.a (mgr.14355) 18304 : audit [DBG] from='client.392967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:12 smithi171 bash[25040]: cluster 2024-09-14T05:24:11.971084+0000 mgr.a (mgr.14355) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:24:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:12 smithi007 bash[22722]: cluster 2024-09-14T05:24:11.971084+0000 mgr.a (mgr.14355) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:24:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:12 smithi131 bash[24745]: cluster 2024-09-14T05:24:11.971084+0000 mgr.a (mgr.14355) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:24:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:14 smithi171 bash[25040]: cluster 2024-09-14T05:24:13.971895+0000 mgr.a (mgr.14355) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:24:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:14 smithi007 bash[22722]: cluster 2024-09-14T05:24:13.971895+0000 mgr.a (mgr.14355) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:24:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:14 smithi131 bash[24745]: cluster 2024-09-14T05:24:13.971895+0000 mgr.a (mgr.14355) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:24:15.402 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:15.403 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:16.142 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:16 smithi171 bash[25040]: audit 2024-09-14T05:24:15.729642+0000 mgr.a (mgr.14355) 18307 : audit [DBG] from='client.393045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:16 smithi171 bash[25040]: cluster 2024-09-14T05:24:15.974385+0000 mgr.a (mgr.14355) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:16 smithi007 bash[22722]: audit 2024-09-14T05:24:15.729642+0000 mgr.a (mgr.14355) 18307 : audit [DBG] from='client.393045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:16 smithi007 bash[22722]: cluster 2024-09-14T05:24:15.974385+0000 mgr.a (mgr.14355) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:16 smithi131 bash[24745]: audit 2024-09-14T05:24:15.729642+0000 mgr.a (mgr.14355) 18307 : audit [DBG] from='client.393045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:16 smithi131 bash[24745]: cluster 2024-09-14T05:24:15.974385+0000 mgr.a (mgr.14355) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:18 smithi171 bash[25040]: cluster 2024-09-14T05:24:17.975308+0000 mgr.a (mgr.14355) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:24:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:18 smithi007 bash[22722]: cluster 2024-09-14T05:24:17.975308+0000 mgr.a (mgr.14355) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:24:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:18 smithi131 bash[24745]: cluster 2024-09-14T05:24:17.975308+0000 mgr.a (mgr.14355) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:24:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:20 smithi171 bash[25040]: cluster 2024-09-14T05:24:19.976093+0000 mgr.a (mgr.14355) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:24:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:20 smithi007 bash[22722]: cluster 2024-09-14T05:24:19.976093+0000 mgr.a (mgr.14355) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:24:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:20 smithi131 bash[24745]: cluster 2024-09-14T05:24:19.976093+0000 mgr.a (mgr.14355) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:24:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:21.144 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:21.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:21.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:21.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:21.905 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:21.905 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:22 smithi131 bash[24745]: audit 2024-09-14T05:24:21.475641+0000 mgr.a (mgr.14355) 18311 : audit [DBG] from='client.393120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:22 smithi171 bash[25040]: audit 2024-09-14T05:24:21.475641+0000 mgr.a (mgr.14355) 18311 : audit [DBG] from='client.393120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:22 smithi007 bash[22722]: audit 2024-09-14T05:24:21.475641+0000 mgr.a (mgr.14355) 18311 : audit [DBG] from='client.393120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:23 smithi171 bash[25040]: cluster 2024-09-14T05:24:21.978975+0000 mgr.a (mgr.14355) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:23 smithi007 bash[22722]: cluster 2024-09-14T05:24:21.978975+0000 mgr.a (mgr.14355) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:23 smithi131 bash[24745]: cluster 2024-09-14T05:24:21.978975+0000 mgr.a (mgr.14355) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:25 smithi007 bash[22722]: cluster 2024-09-14T05:24:23.979727+0000 mgr.a (mgr.14355) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:24:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:25 smithi131 bash[24745]: cluster 2024-09-14T05:24:23.979727+0000 mgr.a (mgr.14355) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:24:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:25 smithi171 bash[25040]: cluster 2024-09-14T05:24:23.979727+0000 mgr.a (mgr.14355) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:24:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:26.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:26.907 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:27 smithi007 bash[22722]: cluster 2024-09-14T05:24:25.981716+0000 mgr.a (mgr.14355) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:24:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:27 smithi131 bash[24745]: cluster 2024-09-14T05:24:25.981716+0000 mgr.a (mgr.14355) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:24:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:27 smithi171 bash[25040]: cluster 2024-09-14T05:24:25.981716+0000 mgr.a (mgr.14355) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:24:27.648 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:27.649 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:28 smithi007 bash[22722]: audit 2024-09-14T05:24:27.240517+0000 mgr.a (mgr.14355) 18315 : audit [DBG] from='client.393195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:28 smithi131 bash[24745]: audit 2024-09-14T05:24:27.240517+0000 mgr.a (mgr.14355) 18315 : audit [DBG] from='client.393195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:28 smithi171 bash[25040]: audit 2024-09-14T05:24:27.240517+0000 mgr.a (mgr.14355) 18315 : audit [DBG] from='client.393195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:29.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:29 smithi007 bash[22722]: cluster 2024-09-14T05:24:27.982747+0000 mgr.a (mgr.14355) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:29 smithi131 bash[24745]: cluster 2024-09-14T05:24:27.982747+0000 mgr.a (mgr.14355) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:29 smithi171 bash[25040]: cluster 2024-09-14T05:24:27.982747+0000 mgr.a (mgr.14355) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:31 smithi007 bash[22722]: cluster 2024-09-14T05:24:29.983695+0000 mgr.a (mgr.14355) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:31 smithi131 bash[24745]: cluster 2024-09-14T05:24:29.983695+0000 mgr.a (mgr.14355) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:31 smithi171 bash[25040]: cluster 2024-09-14T05:24:29.983695+0000 mgr.a (mgr.14355) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:32.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:33.408 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:33.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:33.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:33.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:33.409 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:33 smithi007 bash[22722]: cluster 2024-09-14T05:24:31.986084+0000 mgr.a (mgr.14355) 18318 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:33 smithi007 bash[22722]: audit 2024-09-14T05:24:32.980447+0000 mgr.a (mgr.14355) 18319 : audit [DBG] from='client.393270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:33 smithi131 bash[24745]: cluster 2024-09-14T05:24:31.986084+0000 mgr.a (mgr.14355) 18318 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:33 smithi131 bash[24745]: audit 2024-09-14T05:24:32.980447+0000 mgr.a (mgr.14355) 18319 : audit [DBG] from='client.393270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:33 smithi171 bash[25040]: cluster 2024-09-14T05:24:31.986084+0000 mgr.a (mgr.14355) 18318 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:33 smithi171 bash[25040]: audit 2024-09-14T05:24:32.980447+0000 mgr.a (mgr.14355) 18319 : audit [DBG] from='client.393270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:35 smithi007 bash[22722]: cluster 2024-09-14T05:24:33.987014+0000 mgr.a (mgr.14355) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:35 smithi131 bash[24745]: cluster 2024-09-14T05:24:33.987014+0000 mgr.a (mgr.14355) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:35 smithi171 bash[25040]: cluster 2024-09-14T05:24:33.987014+0000 mgr.a (mgr.14355) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:37 smithi007 bash[22722]: cluster 2024-09-14T05:24:35.989206+0000 mgr.a (mgr.14355) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:37 smithi131 bash[24745]: cluster 2024-09-14T05:24:35.989206+0000 mgr.a (mgr.14355) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:37 smithi171 bash[25040]: cluster 2024-09-14T05:24:35.989206+0000 mgr.a (mgr.14355) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:39.171 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:39.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:39.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:39.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:39.172 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:39 smithi007 bash[22722]: cluster 2024-09-14T05:24:37.989978+0000 mgr.a (mgr.14355) 18322 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:39 smithi007 bash[22722]: audit 2024-09-14T05:24:38.746825+0000 mgr.a (mgr.14355) 18323 : audit [DBG] from='client.393348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:39 smithi131 bash[24745]: cluster 2024-09-14T05:24:37.989978+0000 mgr.a (mgr.14355) 18322 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:39 smithi131 bash[24745]: audit 2024-09-14T05:24:38.746825+0000 mgr.a (mgr.14355) 18323 : audit [DBG] from='client.393348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:39 smithi171 bash[25040]: cluster 2024-09-14T05:24:37.989978+0000 mgr.a (mgr.14355) 18322 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:39 smithi171 bash[25040]: audit 2024-09-14T05:24:38.746825+0000 mgr.a (mgr.14355) 18323 : audit [DBG] from='client.393348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:41 smithi007 bash[22722]: cluster 2024-09-14T05:24:39.990869+0000 mgr.a (mgr.14355) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:41.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:41 smithi007 bash[22722]: audit 2024-09-14T05:24:40.586605+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:24:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:41 smithi131 bash[24745]: cluster 2024-09-14T05:24:39.990869+0000 mgr.a (mgr.14355) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:41 smithi131 bash[24745]: audit 2024-09-14T05:24:40.586605+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:24:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:41 smithi171 bash[25040]: cluster 2024-09-14T05:24:39.990869+0000 mgr.a (mgr.14355) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:41 smithi171 bash[25040]: audit 2024-09-14T05:24:40.586605+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:24:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:43 smithi007 bash[22722]: cluster 2024-09-14T05:24:41.992147+0000 mgr.a (mgr.14355) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:43 smithi131 bash[24745]: cluster 2024-09-14T05:24:41.992147+0000 mgr.a (mgr.14355) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:43 smithi171 bash[25040]: cluster 2024-09-14T05:24:41.992147+0000 mgr.a (mgr.14355) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:44.173 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:44.912 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:44.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:44.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:44.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:44.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:45 smithi007 bash[22722]: cluster 2024-09-14T05:24:43.992857+0000 mgr.a (mgr.14355) 18326 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:45 smithi007 bash[22722]: audit 2024-09-14T05:24:44.504484+0000 mgr.a (mgr.14355) 18327 : audit [DBG] from='client.393423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:45 smithi131 bash[24745]: cluster 2024-09-14T05:24:43.992857+0000 mgr.a (mgr.14355) 18326 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:45 smithi131 bash[24745]: audit 2024-09-14T05:24:44.504484+0000 mgr.a (mgr.14355) 18327 : audit [DBG] from='client.393423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:45 smithi171 bash[25040]: cluster 2024-09-14T05:24:43.992857+0000 mgr.a (mgr.14355) 18326 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:45 smithi171 bash[25040]: audit 2024-09-14T05:24:44.504484+0000 mgr.a (mgr.14355) 18327 : audit [DBG] from='client.393423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:47 smithi007 bash[22722]: cluster 2024-09-14T05:24:45.995239+0000 mgr.a (mgr.14355) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:47 smithi131 bash[24745]: cluster 2024-09-14T05:24:45.995239+0000 mgr.a (mgr.14355) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:47 smithi171 bash[25040]: cluster 2024-09-14T05:24:45.995239+0000 mgr.a (mgr.14355) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:24:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:49 smithi007 bash[22722]: cluster 2024-09-14T05:24:47.996015+0000 mgr.a (mgr.14355) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:49 smithi131 bash[24745]: cluster 2024-09-14T05:24:47.996015+0000 mgr.a (mgr.14355) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:49 smithi171 bash[25040]: cluster 2024-09-14T05:24:47.996015+0000 mgr.a (mgr.14355) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:49.914 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:49.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:49.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:51 smithi007 bash[22722]: cluster 2024-09-14T05:24:49.996428+0000 mgr.a (mgr.14355) 18330 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:51 smithi007 bash[22722]: audit 2024-09-14T05:24:50.227538+0000 mgr.a (mgr.14355) 18331 : audit [DBG] from='client.393501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:51 smithi131 bash[24745]: cluster 2024-09-14T05:24:49.996428+0000 mgr.a (mgr.14355) 18330 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:51 smithi131 bash[24745]: audit 2024-09-14T05:24:50.227538+0000 mgr.a (mgr.14355) 18331 : audit [DBG] from='client.393501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:51 smithi171 bash[25040]: cluster 2024-09-14T05:24:49.996428+0000 mgr.a (mgr.14355) 18330 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:24:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:51 smithi171 bash[25040]: audit 2024-09-14T05:24:50.227538+0000 mgr.a (mgr.14355) 18331 : audit [DBG] from='client.393501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:52.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22972]: debug 2024-09-14T05:24:52.038+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22972]: debug 2024-09-14T05:24:52.038+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.264930+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.272517+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.275736+0000 mon.a (mon.0) 3320 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.277757+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.288062+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.293797+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:52.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:52 smithi007 bash[22722]: audit 2024-09-14T05:24:51.296746+0000 mgr.a (mgr.14355) 18332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.264930+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.272517+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.275736+0000 mon.a (mon.0) 3320 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.277757+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.288062+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.293797+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:52 smithi131 bash[24745]: audit 2024-09-14T05:24:51.296746+0000 mgr.a (mgr.14355) 18332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.264930+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.272517+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.275736+0000 mon.a (mon.0) 3320 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:24:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.277757+0000 mon.a (mon.0) 3321 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:24:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.288062+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:24:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.293797+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:52 smithi171 bash[25040]: audit 2024-09-14T05:24:51.296746+0000 mgr.a (mgr.14355) 18332 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:24:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:53 smithi171 bash[25040]: cluster 2024-09-14T05:24:51.997726+0000 mgr.a (mgr.14355) 18333 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:24:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:53 smithi171 bash[25040]: audit 2024-09-14T05:24:52.042992+0000 mgr.a (mgr.14355) 18334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:24:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:53 smithi171 bash[25040]: cephadm 2024-09-14T05:24:52.044483+0000 mgr.a (mgr.14355) 18335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:24:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:53 smithi007 bash[22722]: cluster 2024-09-14T05:24:51.997726+0000 mgr.a (mgr.14355) 18333 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:24:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:53 smithi007 bash[22722]: audit 2024-09-14T05:24:52.042992+0000 mgr.a (mgr.14355) 18334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:24:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:53 smithi007 bash[22722]: cephadm 2024-09-14T05:24:52.044483+0000 mgr.a (mgr.14355) 18335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:24:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:53 smithi131 bash[24745]: cluster 2024-09-14T05:24:51.997726+0000 mgr.a (mgr.14355) 18333 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:24:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:53 smithi131 bash[24745]: audit 2024-09-14T05:24:52.042992+0000 mgr.a (mgr.14355) 18334 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:24:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:53 smithi131 bash[24745]: cephadm 2024-09-14T05:24:52.044483+0000 mgr.a (mgr.14355) 18335 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:24:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:55 smithi171 bash[25040]: cluster 2024-09-14T05:24:53.998493+0000 mgr.a (mgr.14355) 18336 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:24:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:24:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:24:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:24:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:55 smithi007 bash[22722]: cluster 2024-09-14T05:24:53.998493+0000 mgr.a (mgr.14355) 18336 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:24:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:55 smithi131 bash[24745]: cluster 2024-09-14T05:24:53.998493+0000 mgr.a (mgr.14355) 18336 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 245 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:24:56.437 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:24:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:24:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:24:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:24:56.438 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:24:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:57 smithi007 bash[22722]: audit 2024-09-14T05:24:55.990711+0000 mgr.a (mgr.14355) 18337 : audit [DBG] from='client.393687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:57 smithi007 bash[22722]: cluster 2024-09-14T05:24:56.012856+0000 mgr.a (mgr.14355) 18338 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:24:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:57 smithi131 bash[24745]: audit 2024-09-14T05:24:55.990711+0000 mgr.a (mgr.14355) 18337 : audit [DBG] from='client.393687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:57.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:57 smithi131 bash[24745]: cluster 2024-09-14T05:24:56.012856+0000 mgr.a (mgr.14355) 18338 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:24:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:57 smithi171 bash[25040]: audit 2024-09-14T05:24:55.990711+0000 mgr.a (mgr.14355) 18337 : audit [DBG] from='client.393687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:24:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:57 smithi171 bash[25040]: cluster 2024-09-14T05:24:56.012856+0000 mgr.a (mgr.14355) 18338 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:24:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:24:59 smithi007 bash[22722]: cluster 2024-09-14T05:24:58.013839+0000 mgr.a (mgr.14355) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:24:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:24:59 smithi131 bash[24745]: cluster 2024-09-14T05:24:58.013839+0000 mgr.a (mgr.14355) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:24:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:24:59 smithi171 bash[25040]: cluster 2024-09-14T05:24:58.013839+0000 mgr.a (mgr.14355) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:25:01.439 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:01.440 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:01.441 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:01 smithi007 bash[22722]: cluster 2024-09-14T05:25:00.014645+0000 mgr.a (mgr.14355) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:25:01.655 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:01 smithi171 bash[25040]: cluster 2024-09-14T05:25:00.014645+0000 mgr.a (mgr.14355) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:25:01.704 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:01 smithi131 bash[24745]: cluster 2024-09-14T05:25:00.014645+0000 mgr.a (mgr.14355) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:25:02.206 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:02.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:02.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:02.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:02.207 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:02 smithi007 bash[22722]: audit 2024-09-14T05:25:01.774162+0000 mgr.a (mgr.14355) 18341 : audit [DBG] from='client.393765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:02 smithi131 bash[24745]: audit 2024-09-14T05:25:01.774162+0000 mgr.a (mgr.14355) 18341 : audit [DBG] from='client.393765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:02 smithi171 bash[25040]: audit 2024-09-14T05:25:01.774162+0000 mgr.a (mgr.14355) 18341 : audit [DBG] from='client.393765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:03 smithi007 bash[22722]: cluster 2024-09-14T05:25:02.017805+0000 mgr.a (mgr.14355) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:03 smithi131 bash[24745]: cluster 2024-09-14T05:25:02.017805+0000 mgr.a (mgr.14355) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:03 smithi171 bash[25040]: cluster 2024-09-14T05:25:02.017805+0000 mgr.a (mgr.14355) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:05 smithi007 bash[22722]: cluster 2024-09-14T05:25:04.018801+0000 mgr.a (mgr.14355) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:25:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:05 smithi131 bash[24745]: cluster 2024-09-14T05:25:04.018801+0000 mgr.a (mgr.14355) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:25:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:05 smithi171 bash[25040]: cluster 2024-09-14T05:25:04.018801+0000 mgr.a (mgr.14355) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-14T05:25:07.208 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:07.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:07.208 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:07 smithi007 bash[22722]: cluster 2024-09-14T05:25:06.021088+0000 mgr.a (mgr.14355) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:07 smithi131 bash[24745]: cluster 2024-09-14T05:25:06.021088+0000 mgr.a (mgr.14355) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:07 smithi171 bash[25040]: cluster 2024-09-14T05:25:06.021088+0000 mgr.a (mgr.14355) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-14T05:25:07.951 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:07.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:08 smithi007 bash[22722]: audit 2024-09-14T05:25:07.534030+0000 mgr.a (mgr.14355) 18345 : audit [DBG] from='client.393843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:08 smithi131 bash[24745]: audit 2024-09-14T05:25:07.534030+0000 mgr.a (mgr.14355) 18345 : audit [DBG] from='client.393843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:08 smithi171 bash[25040]: audit 2024-09-14T05:25:07.534030+0000 mgr.a (mgr.14355) 18345 : audit [DBG] from='client.393843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:09 smithi007 bash[22722]: cluster 2024-09-14T05:25:08.022022+0000 mgr.a (mgr.14355) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:09 smithi131 bash[24745]: cluster 2024-09-14T05:25:08.022022+0000 mgr.a (mgr.14355) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:09 smithi171 bash[25040]: cluster 2024-09-14T05:25:08.022022+0000 mgr.a (mgr.14355) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:11 smithi007 bash[22722]: cluster 2024-09-14T05:25:10.022859+0000 mgr.a (mgr.14355) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:11 smithi131 bash[24745]: cluster 2024-09-14T05:25:10.022859+0000 mgr.a (mgr.14355) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:11 smithi171 bash[25040]: cluster 2024-09-14T05:25:10.022859+0000 mgr.a (mgr.14355) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:13 smithi007 bash[22722]: cluster 2024-09-14T05:25:12.025100+0000 mgr.a (mgr.14355) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:13.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:13.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:13.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:13.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:13.710 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:13 smithi131 bash[24745]: cluster 2024-09-14T05:25:12.025100+0000 mgr.a (mgr.14355) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:13 smithi171 bash[25040]: cluster 2024-09-14T05:25:12.025100+0000 mgr.a (mgr.14355) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:14 smithi007 bash[22722]: audit 2024-09-14T05:25:13.280166+0000 mgr.a (mgr.14355) 18349 : audit [DBG] from='client.393918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:14 smithi131 bash[24745]: audit 2024-09-14T05:25:13.280166+0000 mgr.a (mgr.14355) 18349 : audit [DBG] from='client.393918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:14 smithi171 bash[25040]: audit 2024-09-14T05:25:13.280166+0000 mgr.a (mgr.14355) 18349 : audit [DBG] from='client.393918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:15 smithi007 bash[22722]: cluster 2024-09-14T05:25:14.026045+0000 mgr.a (mgr.14355) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:15.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:15 smithi131 bash[24745]: cluster 2024-09-14T05:25:14.026045+0000 mgr.a (mgr.14355) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:15 smithi171 bash[25040]: cluster 2024-09-14T05:25:14.026045+0000 mgr.a (mgr.14355) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:17 smithi007 bash[22722]: cluster 2024-09-14T05:25:16.028329+0000 mgr.a (mgr.14355) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:17 smithi131 bash[24745]: cluster 2024-09-14T05:25:16.028329+0000 mgr.a (mgr.14355) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:17 smithi171 bash[25040]: cluster 2024-09-14T05:25:16.028329+0000 mgr.a (mgr.14355) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:18.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:18.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:18.713 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:19.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:19 smithi007 bash[22722]: cluster 2024-09-14T05:25:18.029124+0000 mgr.a (mgr.14355) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:19 smithi131 bash[24745]: cluster 2024-09-14T05:25:18.029124+0000 mgr.a (mgr.14355) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:19 smithi171 bash[25040]: cluster 2024-09-14T05:25:18.029124+0000 mgr.a (mgr.14355) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:20 smithi007 bash[22722]: audit 2024-09-14T05:25:19.041545+0000 mgr.a (mgr.14355) 18353 : audit [DBG] from='client.393996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:20 smithi131 bash[24745]: audit 2024-09-14T05:25:19.041545+0000 mgr.a (mgr.14355) 18353 : audit [DBG] from='client.393996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:20 smithi171 bash[25040]: audit 2024-09-14T05:25:19.041545+0000 mgr.a (mgr.14355) 18353 : audit [DBG] from='client.393996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:21 smithi007 bash[22722]: cluster 2024-09-14T05:25:20.030095+0000 mgr.a (mgr.14355) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:21 smithi131 bash[24745]: cluster 2024-09-14T05:25:20.030095+0000 mgr.a (mgr.14355) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:21 smithi171 bash[25040]: cluster 2024-09-14T05:25:20.030095+0000 mgr.a (mgr.14355) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:23 smithi007 bash[22722]: cluster 2024-09-14T05:25:22.032365+0000 mgr.a (mgr.14355) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:23 smithi131 bash[24745]: cluster 2024-09-14T05:25:22.032365+0000 mgr.a (mgr.14355) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:23 smithi171 bash[25040]: cluster 2024-09-14T05:25:22.032365+0000 mgr.a (mgr.14355) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:24.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:24.459 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:25.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:25.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:25.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:25.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:25.243 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:25 smithi007 bash[22722]: cluster 2024-09-14T05:25:24.033146+0000 mgr.a (mgr.14355) 18356 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:25 smithi007 bash[22722]: audit 2024-09-14T05:25:24.795929+0000 mgr.a (mgr.14355) 18357 : audit [DBG] from='client.394071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:25 smithi131 bash[24745]: cluster 2024-09-14T05:25:24.033146+0000 mgr.a (mgr.14355) 18356 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:25 smithi131 bash[24745]: audit 2024-09-14T05:25:24.795929+0000 mgr.a (mgr.14355) 18357 : audit [DBG] from='client.394071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:25 smithi171 bash[25040]: cluster 2024-09-14T05:25:24.033146+0000 mgr.a (mgr.14355) 18356 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:25 smithi171 bash[25040]: audit 2024-09-14T05:25:24.795929+0000 mgr.a (mgr.14355) 18357 : audit [DBG] from='client.394071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:27 smithi007 bash[22722]: cluster 2024-09-14T05:25:26.035618+0000 mgr.a (mgr.14355) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:27 smithi131 bash[24745]: cluster 2024-09-14T05:25:26.035618+0000 mgr.a (mgr.14355) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:27 smithi171 bash[25040]: cluster 2024-09-14T05:25:26.035618+0000 mgr.a (mgr.14355) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:29 smithi007 bash[22722]: cluster 2024-09-14T05:25:28.036377+0000 mgr.a (mgr.14355) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:29 smithi131 bash[24745]: cluster 2024-09-14T05:25:28.036377+0000 mgr.a (mgr.14355) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:29 smithi171 bash[25040]: cluster 2024-09-14T05:25:28.036377+0000 mgr.a (mgr.14355) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:30.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:30.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:30.245 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:30.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:30.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:31 smithi007 bash[22722]: cluster 2024-09-14T05:25:30.037165+0000 mgr.a (mgr.14355) 18360 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:31 smithi007 bash[22722]: audit 2024-09-14T05:25:30.574597+0000 mgr.a (mgr.14355) 18361 : audit [DBG] from='client.394146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:31 smithi131 bash[24745]: cluster 2024-09-14T05:25:30.037165+0000 mgr.a (mgr.14355) 18360 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:31 smithi131 bash[24745]: audit 2024-09-14T05:25:30.574597+0000 mgr.a (mgr.14355) 18361 : audit [DBG] from='client.394146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:31 smithi171 bash[25040]: cluster 2024-09-14T05:25:30.037165+0000 mgr.a (mgr.14355) 18360 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:31 smithi171 bash[25040]: audit 2024-09-14T05:25:30.574597+0000 mgr.a (mgr.14355) 18361 : audit [DBG] from='client.394146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:33 smithi007 bash[22722]: cluster 2024-09-14T05:25:32.039995+0000 mgr.a (mgr.14355) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:33 smithi131 bash[24745]: cluster 2024-09-14T05:25:32.039995+0000 mgr.a (mgr.14355) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:33 smithi171 bash[25040]: cluster 2024-09-14T05:25:32.039995+0000 mgr.a (mgr.14355) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:35 smithi007 bash[22722]: cluster 2024-09-14T05:25:34.040785+0000 mgr.a (mgr.14355) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:35 smithi131 bash[24745]: cluster 2024-09-14T05:25:34.040785+0000 mgr.a (mgr.14355) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:35 smithi171 bash[25040]: cluster 2024-09-14T05:25:34.040785+0000 mgr.a (mgr.14355) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:35.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:35.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:36.764 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:36.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:37 smithi007 bash[22722]: cluster 2024-09-14T05:25:36.042129+0000 mgr.a (mgr.14355) 18364 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:37 smithi007 bash[22722]: audit 2024-09-14T05:25:36.323533+0000 mgr.a (mgr.14355) 18365 : audit [DBG] from='client.394224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:37 smithi131 bash[24745]: cluster 2024-09-14T05:25:36.042129+0000 mgr.a (mgr.14355) 18364 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:37 smithi131 bash[24745]: audit 2024-09-14T05:25:36.323533+0000 mgr.a (mgr.14355) 18365 : audit [DBG] from='client.394224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:37 smithi171 bash[25040]: cluster 2024-09-14T05:25:36.042129+0000 mgr.a (mgr.14355) 18364 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:37 smithi171 bash[25040]: audit 2024-09-14T05:25:36.323533+0000 mgr.a (mgr.14355) 18365 : audit [DBG] from='client.394224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:39 smithi007 bash[22722]: cluster 2024-09-14T05:25:38.043074+0000 mgr.a (mgr.14355) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:39 smithi131 bash[24745]: cluster 2024-09-14T05:25:38.043074+0000 mgr.a (mgr.14355) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:39 smithi171 bash[25040]: cluster 2024-09-14T05:25:38.043074+0000 mgr.a (mgr.14355) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:25:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:41 smithi007 bash[22722]: cluster 2024-09-14T05:25:40.043874+0000 mgr.a (mgr.14355) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:25:41.765 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:41.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:41.766 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:41 smithi131 bash[24745]: cluster 2024-09-14T05:25:40.043874+0000 mgr.a (mgr.14355) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:25:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:41 smithi171 bash[25040]: cluster 2024-09-14T05:25:40.043874+0000 mgr.a (mgr.14355) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:25:42.511 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:42.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:42.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:42.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:42.512 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:43 smithi007 bash[22722]: cluster 2024-09-14T05:25:42.045969+0000 mgr.a (mgr.14355) 18368 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:43 smithi007 bash[22722]: audit 2024-09-14T05:25:42.094541+0000 mgr.a (mgr.14355) 18369 : audit [DBG] from='client.394299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:43 smithi131 bash[24745]: cluster 2024-09-14T05:25:42.045969+0000 mgr.a (mgr.14355) 18368 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:43 smithi131 bash[24745]: audit 2024-09-14T05:25:42.094541+0000 mgr.a (mgr.14355) 18369 : audit [DBG] from='client.394299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:43 smithi171 bash[25040]: cluster 2024-09-14T05:25:42.045969+0000 mgr.a (mgr.14355) 18368 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:43 smithi171 bash[25040]: audit 2024-09-14T05:25:42.094541+0000 mgr.a (mgr.14355) 18369 : audit [DBG] from='client.394299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:45 smithi007 bash[22722]: cluster 2024-09-14T05:25:44.046852+0000 mgr.a (mgr.14355) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:45 smithi131 bash[24745]: cluster 2024-09-14T05:25:44.046852+0000 mgr.a (mgr.14355) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:45 smithi171 bash[25040]: cluster 2024-09-14T05:25:44.046852+0000 mgr.a (mgr.14355) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:47 smithi007 bash[22722]: cluster 2024-09-14T05:25:46.049040+0000 mgr.a (mgr.14355) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:47 smithi131 bash[24745]: cluster 2024-09-14T05:25:46.049040+0000 mgr.a (mgr.14355) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:47 smithi171 bash[25040]: cluster 2024-09-14T05:25:46.049040+0000 mgr.a (mgr.14355) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:48.280 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:48.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:48.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:48.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:48.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:48 smithi007 bash[22722]: audit 2024-09-14T05:25:47.842854+0000 mgr.a (mgr.14355) 18372 : audit [DBG] from='client.394377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:48 smithi131 bash[24745]: audit 2024-09-14T05:25:47.842854+0000 mgr.a (mgr.14355) 18372 : audit [DBG] from='client.394377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:48 smithi171 bash[25040]: audit 2024-09-14T05:25:47.842854+0000 mgr.a (mgr.14355) 18372 : audit [DBG] from='client.394377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:49 smithi007 bash[22722]: cluster 2024-09-14T05:25:48.049584+0000 mgr.a (mgr.14355) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:49.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:49 smithi131 bash[24745]: cluster 2024-09-14T05:25:48.049584+0000 mgr.a (mgr.14355) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:49 smithi171 bash[25040]: cluster 2024-09-14T05:25:48.049584+0000 mgr.a (mgr.14355) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:51 smithi007 bash[22722]: cluster 2024-09-14T05:25:50.050664+0000 mgr.a (mgr.14355) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:51 smithi131 bash[24745]: cluster 2024-09-14T05:25:50.050664+0000 mgr.a (mgr.14355) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:51 smithi171 bash[25040]: cluster 2024-09-14T05:25:50.050664+0000 mgr.a (mgr.14355) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:52 smithi007 bash[22722]: audit 2024-09-14T05:25:52.110725+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:25:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:52 smithi131 bash[24745]: audit 2024-09-14T05:25:52.110725+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:25:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:52 smithi171 bash[25040]: audit 2024-09-14T05:25:52.110725+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:25:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:53.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:53 smithi131 bash[24745]: cluster 2024-09-14T05:25:52.052889+0000 mgr.a (mgr.14355) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:53 smithi131 bash[24745]: audit 2024-09-14T05:25:52.737654+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:53 smithi131 bash[24745]: audit 2024-09-14T05:25:52.742152+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:54.035 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:54.035 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:54.036 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:25:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:53 smithi171 bash[25040]: cluster 2024-09-14T05:25:52.052889+0000 mgr.a (mgr.14355) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:53 smithi171 bash[25040]: audit 2024-09-14T05:25:52.737654+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:53 smithi171 bash[25040]: audit 2024-09-14T05:25:52.742152+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:53 smithi007 bash[22722]: cluster 2024-09-14T05:25:52.052889+0000 mgr.a (mgr.14355) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:53 smithi007 bash[22722]: audit 2024-09-14T05:25:52.737654+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:53 smithi007 bash[22722]: audit 2024-09-14T05:25:52.742152+0000 mon.a (mon.0) 3326 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:25:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:54 smithi131 bash[24745]: audit 2024-09-14T05:25:53.604194+0000 mgr.a (mgr.14355) 18376 : audit [DBG] from='client.394452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:54 smithi171 bash[25040]: audit 2024-09-14T05:25:53.604194+0000 mgr.a (mgr.14355) 18376 : audit [DBG] from='client.394452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:55.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:54 smithi007 bash[22722]: audit 2024-09-14T05:25:53.604194+0000 mgr.a (mgr.14355) 18376 : audit [DBG] from='client.394452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:25:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:55 smithi131 bash[24745]: cluster 2024-09-14T05:25:54.053447+0000 mgr.a (mgr.14355) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:55 smithi171 bash[25040]: cluster 2024-09-14T05:25:54.053447+0000 mgr.a (mgr.14355) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:55 smithi007 bash[22722]: cluster 2024-09-14T05:25:54.053447+0000 mgr.a (mgr.14355) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:25:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:57 smithi131 bash[24745]: cluster 2024-09-14T05:25:56.055893+0000 mgr.a (mgr.14355) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:57 smithi171 bash[25040]: cluster 2024-09-14T05:25:56.055893+0000 mgr.a (mgr.14355) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:57 smithi007 bash[22722]: cluster 2024-09-14T05:25:56.055893+0000 mgr.a (mgr.14355) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:25:59.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:25:59.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:25:59.037 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:25:59.801 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:25:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:25:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:25:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:25:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:25:59 smithi131 bash[24745]: cluster 2024-09-14T05:25:58.056853+0000 mgr.a (mgr.14355) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:25:59 smithi171 bash[25040]: cluster 2024-09-14T05:25:58.056853+0000 mgr.a (mgr.14355) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:25:59 smithi007 bash[22722]: cluster 2024-09-14T05:25:58.056853+0000 mgr.a (mgr.14355) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:00 smithi131 bash[24745]: audit 2024-09-14T05:25:59.371616+0000 mgr.a (mgr.14355) 18380 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:00 smithi171 bash[25040]: audit 2024-09-14T05:25:59.371616+0000 mgr.a (mgr.14355) 18380 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:00 smithi007 bash[22722]: audit 2024-09-14T05:25:59.371616+0000 mgr.a (mgr.14355) 18380 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:01 smithi131 bash[24745]: cluster 2024-09-14T05:26:00.057777+0000 mgr.a (mgr.14355) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:01 smithi171 bash[25040]: cluster 2024-09-14T05:26:00.057777+0000 mgr.a (mgr.14355) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:01 smithi007 bash[22722]: cluster 2024-09-14T05:26:00.057777+0000 mgr.a (mgr.14355) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:03.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22972]: debug 2024-09-14T05:26:03.605+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22972]: debug 2024-09-14T05:26:03.605+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: cluster 2024-09-14T05:26:02.060223+0000 mgr.a (mgr.14355) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.647521+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.656467+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.772758+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.785495+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:03.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.788074+0000 mon.a (mon.0) 3331 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:26:03.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.790311+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:26:03.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.800907+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:03.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.806161+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:03.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:03 smithi007 bash[22722]: audit 2024-09-14T05:26:02.808505+0000 mgr.a (mgr.14355) 18383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: cluster 2024-09-14T05:26:02.060223+0000 mgr.a (mgr.14355) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.647521+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.656467+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.772758+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.785495+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.788074+0000 mon.a (mon.0) 3331 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.790311+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.800907+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.806161+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:04.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:03 smithi131 bash[24745]: audit 2024-09-14T05:26:02.808505+0000 mgr.a (mgr.14355) 18383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: cluster 2024-09-14T05:26:02.060223+0000 mgr.a (mgr.14355) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.647521+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.656467+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.772758+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.785495+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.788074+0000 mon.a (mon.0) 3331 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.790311+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.800907+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.806161+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:04.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:03 smithi171 bash[25040]: audit 2024-09-14T05:26:02.808505+0000 mgr.a (mgr.14355) 18383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:26:04.803 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:04.803 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:04.804 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:04 smithi007 bash[22722]: audit 2024-09-14T05:26:03.606595+0000 mgr.a (mgr.14355) 18384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:26:04.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:04 smithi007 bash[22722]: cephadm 2024-09-14T05:26:03.608631+0000 mgr.a (mgr.14355) 18385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:26:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:04 smithi131 bash[24745]: audit 2024-09-14T05:26:03.606595+0000 mgr.a (mgr.14355) 18384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:26:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:04 smithi131 bash[24745]: cephadm 2024-09-14T05:26:03.608631+0000 mgr.a (mgr.14355) 18385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:26:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:04 smithi171 bash[25040]: audit 2024-09-14T05:26:03.606595+0000 mgr.a (mgr.14355) 18384 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:26:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:04 smithi171 bash[25040]: cephadm 2024-09-14T05:26:03.608631+0000 mgr.a (mgr.14355) 18385 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:26:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:05.583 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:05.584 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:05 smithi007 bash[22722]: cluster 2024-09-14T05:26:04.061189+0000 mgr.a (mgr.14355) 18386 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:05 smithi131 bash[24745]: cluster 2024-09-14T05:26:04.061189+0000 mgr.a (mgr.14355) 18386 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:05 smithi171 bash[25040]: cluster 2024-09-14T05:26:04.061189+0000 mgr.a (mgr.14355) 18386 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:06 smithi007 bash[22722]: audit 2024-09-14T05:26:05.142186+0000 mgr.a (mgr.14355) 18387 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:06 smithi131 bash[24745]: audit 2024-09-14T05:26:05.142186+0000 mgr.a (mgr.14355) 18387 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:06 smithi171 bash[25040]: audit 2024-09-14T05:26:05.142186+0000 mgr.a (mgr.14355) 18387 : audit [DBG] from='client.394713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:07 smithi007 bash[22722]: cluster 2024-09-14T05:26:06.064097+0000 mgr.a (mgr.14355) 18388 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:07 smithi131 bash[24745]: cluster 2024-09-14T05:26:06.064097+0000 mgr.a (mgr.14355) 18388 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:07 smithi171 bash[25040]: cluster 2024-09-14T05:26:06.064097+0000 mgr.a (mgr.14355) 18388 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:09 smithi007 bash[22722]: cluster 2024-09-14T05:26:08.064879+0000 mgr.a (mgr.14355) 18389 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:09 smithi131 bash[24745]: cluster 2024-09-14T05:26:08.064879+0000 mgr.a (mgr.14355) 18389 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:09 smithi171 bash[25040]: cluster 2024-09-14T05:26:08.064879+0000 mgr.a (mgr.14355) 18389 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:10.585 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:11.333 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:11.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:11 smithi007 bash[22722]: cluster 2024-09-14T05:26:10.065676+0000 mgr.a (mgr.14355) 18390 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:11 smithi007 bash[22722]: audit 2024-09-14T05:26:10.919270+0000 mgr.a (mgr.14355) 18391 : audit [DBG] from='client.394788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:11 smithi131 bash[24745]: cluster 2024-09-14T05:26:10.065676+0000 mgr.a (mgr.14355) 18390 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:11 smithi131 bash[24745]: audit 2024-09-14T05:26:10.919270+0000 mgr.a (mgr.14355) 18391 : audit [DBG] from='client.394788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:11 smithi171 bash[25040]: cluster 2024-09-14T05:26:10.065676+0000 mgr.a (mgr.14355) 18390 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:11 smithi171 bash[25040]: audit 2024-09-14T05:26:10.919270+0000 mgr.a (mgr.14355) 18391 : audit [DBG] from='client.394788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:13 smithi007 bash[22722]: cluster 2024-09-14T05:26:12.068675+0000 mgr.a (mgr.14355) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:13 smithi131 bash[24745]: cluster 2024-09-14T05:26:12.068675+0000 mgr.a (mgr.14355) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:13 smithi171 bash[25040]: cluster 2024-09-14T05:26:12.068675+0000 mgr.a (mgr.14355) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:15 smithi007 bash[22722]: cluster 2024-09-14T05:26:14.069530+0000 mgr.a (mgr.14355) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:15 smithi131 bash[24745]: cluster 2024-09-14T05:26:14.069530+0000 mgr.a (mgr.14355) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:15 smithi171 bash[25040]: cluster 2024-09-14T05:26:14.069530+0000 mgr.a (mgr.14355) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:26:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:16.335 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:16.336 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:17.102 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:17 smithi007 bash[22722]: cluster 2024-09-14T05:26:16.071584+0000 mgr.a (mgr.14355) 18394 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:17 smithi007 bash[22722]: audit 2024-09-14T05:26:16.673972+0000 mgr.a (mgr.14355) 18395 : audit [DBG] from='client.394866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:17 smithi131 bash[24745]: cluster 2024-09-14T05:26:16.071584+0000 mgr.a (mgr.14355) 18394 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:17 smithi131 bash[24745]: audit 2024-09-14T05:26:16.673972+0000 mgr.a (mgr.14355) 18395 : audit [DBG] from='client.394866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:17 smithi171 bash[25040]: cluster 2024-09-14T05:26:16.071584+0000 mgr.a (mgr.14355) 18394 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:26:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:17 smithi171 bash[25040]: audit 2024-09-14T05:26:16.673972+0000 mgr.a (mgr.14355) 18395 : audit [DBG] from='client.394866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:19 smithi007 bash[22722]: cluster 2024-09-14T05:26:18.072570+0000 mgr.a (mgr.14355) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:19 smithi131 bash[24745]: cluster 2024-09-14T05:26:18.072570+0000 mgr.a (mgr.14355) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:19 smithi171 bash[25040]: cluster 2024-09-14T05:26:18.072570+0000 mgr.a (mgr.14355) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:21 smithi007 bash[22722]: cluster 2024-09-14T05:26:20.073370+0000 mgr.a (mgr.14355) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:21 smithi131 bash[24745]: cluster 2024-09-14T05:26:20.073370+0000 mgr.a (mgr.14355) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:21 smithi171 bash[25040]: cluster 2024-09-14T05:26:20.073370+0000 mgr.a (mgr.14355) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:26:22.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:22.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:22.105 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:22.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:22.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:22.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:22.877 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:22.878 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:23 smithi007 bash[22722]: cluster 2024-09-14T05:26:22.075648+0000 mgr.a (mgr.14355) 18398 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:26:23.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:23 smithi007 bash[22722]: audit 2024-09-14T05:26:22.440424+0000 mgr.a (mgr.14355) 18399 : audit [DBG] from='client.394941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:23 smithi131 bash[24745]: cluster 2024-09-14T05:26:22.075648+0000 mgr.a (mgr.14355) 18398 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:26:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:23 smithi131 bash[24745]: audit 2024-09-14T05:26:22.440424+0000 mgr.a (mgr.14355) 18399 : audit [DBG] from='client.394941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:23 smithi171 bash[25040]: cluster 2024-09-14T05:26:22.075648+0000 mgr.a (mgr.14355) 18398 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:26:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:23 smithi171 bash[25040]: audit 2024-09-14T05:26:22.440424+0000 mgr.a (mgr.14355) 18399 : audit [DBG] from='client.394941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:25 smithi131 bash[24745]: cluster 2024-09-14T05:26:24.076567+0000 mgr.a (mgr.14355) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:25 smithi171 bash[25040]: cluster 2024-09-14T05:26:24.076567+0000 mgr.a (mgr.14355) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:25 smithi007 bash[22722]: cluster 2024-09-14T05:26:24.076567+0000 mgr.a (mgr.14355) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:27.879 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:27.879 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:27.879 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:27 smithi131 bash[24745]: cluster 2024-09-14T05:26:26.078846+0000 mgr.a (mgr.14355) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:27 smithi171 bash[25040]: cluster 2024-09-14T05:26:26.078846+0000 mgr.a (mgr.14355) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:27 smithi007 bash[22722]: cluster 2024-09-14T05:26:26.078846+0000 mgr.a (mgr.14355) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:28.631 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:28.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:28.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:28.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:28.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:29 smithi131 bash[24745]: cluster 2024-09-14T05:26:28.079552+0000 mgr.a (mgr.14355) 18402 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:29 smithi131 bash[24745]: audit 2024-09-14T05:26:28.209229+0000 mgr.a (mgr.14355) 18403 : audit [DBG] from='client.395019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:29 smithi171 bash[25040]: cluster 2024-09-14T05:26:28.079552+0000 mgr.a (mgr.14355) 18402 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:30.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:29 smithi171 bash[25040]: audit 2024-09-14T05:26:28.209229+0000 mgr.a (mgr.14355) 18403 : audit [DBG] from='client.395019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:29 smithi007 bash[22722]: cluster 2024-09-14T05:26:28.079552+0000 mgr.a (mgr.14355) 18402 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:29 smithi007 bash[22722]: audit 2024-09-14T05:26:28.209229+0000 mgr.a (mgr.14355) 18403 : audit [DBG] from='client.395019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:31 smithi131 bash[24745]: cluster 2024-09-14T05:26:30.080477+0000 mgr.a (mgr.14355) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:31 smithi171 bash[25040]: cluster 2024-09-14T05:26:30.080477+0000 mgr.a (mgr.14355) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:31 smithi007 bash[22722]: cluster 2024-09-14T05:26:30.080477+0000 mgr.a (mgr.14355) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:33.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:33.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:33.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:33 smithi131 bash[24745]: cluster 2024-09-14T05:26:32.082889+0000 mgr.a (mgr.14355) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:33 smithi171 bash[25040]: cluster 2024-09-14T05:26:32.082889+0000 mgr.a (mgr.14355) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:33 smithi007 bash[22722]: cluster 2024-09-14T05:26:32.082889+0000 mgr.a (mgr.14355) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:34.393 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:34.393 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:35.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:34 smithi131 bash[24745]: audit 2024-09-14T05:26:33.962836+0000 mgr.a (mgr.14355) 18406 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:35.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:34 smithi171 bash[25040]: audit 2024-09-14T05:26:33.962836+0000 mgr.a (mgr.14355) 18406 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:35.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:34 smithi007 bash[22722]: audit 2024-09-14T05:26:33.962836+0000 mgr.a (mgr.14355) 18406 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:35 smithi131 bash[24745]: cluster 2024-09-14T05:26:34.083432+0000 mgr.a (mgr.14355) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:35 smithi171 bash[25040]: cluster 2024-09-14T05:26:34.083432+0000 mgr.a (mgr.14355) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:35 smithi007 bash[22722]: cluster 2024-09-14T05:26:34.083432+0000 mgr.a (mgr.14355) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:37 smithi131 bash[24745]: cluster 2024-09-14T05:26:36.085733+0000 mgr.a (mgr.14355) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:37 smithi171 bash[25040]: cluster 2024-09-14T05:26:36.085733+0000 mgr.a (mgr.14355) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:37 smithi007 bash[22722]: cluster 2024-09-14T05:26:36.085733+0000 mgr.a (mgr.14355) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:39 smithi131 bash[24745]: cluster 2024-09-14T05:26:38.086576+0000 mgr.a (mgr.14355) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:39 smithi171 bash[25040]: cluster 2024-09-14T05:26:38.086576+0000 mgr.a (mgr.14355) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:40.179 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:39 smithi007 bash[22722]: cluster 2024-09-14T05:26:38.086576+0000 mgr.a (mgr.14355) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:41.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:40 smithi131 bash[24745]: audit 2024-09-14T05:26:39.727736+0000 mgr.a (mgr.14355) 18410 : audit [DBG] from='client.395175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:41.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:40 smithi171 bash[25040]: audit 2024-09-14T05:26:39.727736+0000 mgr.a (mgr.14355) 18410 : audit [DBG] from='client.395175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:40 smithi007 bash[22722]: audit 2024-09-14T05:26:39.727736+0000 mgr.a (mgr.14355) 18410 : audit [DBG] from='client.395175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:41 smithi131 bash[24745]: cluster 2024-09-14T05:26:40.087133+0000 mgr.a (mgr.14355) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:41 smithi171 bash[25040]: cluster 2024-09-14T05:26:40.087133+0000 mgr.a (mgr.14355) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:41 smithi007 bash[22722]: cluster 2024-09-14T05:26:40.087133+0000 mgr.a (mgr.14355) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:43 smithi131 bash[24745]: cluster 2024-09-14T05:26:42.089392+0000 mgr.a (mgr.14355) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:43 smithi171 bash[25040]: cluster 2024-09-14T05:26:42.089392+0000 mgr.a (mgr.14355) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:43 smithi007 bash[22722]: cluster 2024-09-14T05:26:42.089392+0000 mgr.a (mgr.14355) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:26:45.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:45.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:45.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:45.955 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:45.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:45.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:45.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:45.956 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:45 smithi131 bash[24745]: cluster 2024-09-14T05:26:44.090125+0000 mgr.a (mgr.14355) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:45 smithi171 bash[25040]: cluster 2024-09-14T05:26:44.090125+0000 mgr.a (mgr.14355) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:45 smithi007 bash[22722]: cluster 2024-09-14T05:26:44.090125+0000 mgr.a (mgr.14355) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:46 smithi131 bash[24745]: audit 2024-09-14T05:26:45.518656+0000 mgr.a (mgr.14355) 18414 : audit [DBG] from='client.395253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:46 smithi171 bash[25040]: audit 2024-09-14T05:26:45.518656+0000 mgr.a (mgr.14355) 18414 : audit [DBG] from='client.395253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:46 smithi007 bash[22722]: audit 2024-09-14T05:26:45.518656+0000 mgr.a (mgr.14355) 18414 : audit [DBG] from='client.395253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:47 smithi131 bash[24745]: cluster 2024-09-14T05:26:46.092950+0000 mgr.a (mgr.14355) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:47 smithi171 bash[25040]: cluster 2024-09-14T05:26:46.092950+0000 mgr.a (mgr.14355) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:47 smithi007 bash[22722]: cluster 2024-09-14T05:26:46.092950+0000 mgr.a (mgr.14355) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:49 smithi171 bash[25040]: cluster 2024-09-14T05:26:48.093715+0000 mgr.a (mgr.14355) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:49 smithi007 bash[22722]: cluster 2024-09-14T05:26:48.093715+0000 mgr.a (mgr.14355) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:49 smithi131 bash[24745]: cluster 2024-09-14T05:26:48.093715+0000 mgr.a (mgr.14355) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:50.957 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:50.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:50.958 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:51.736 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:51.737 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:51 smithi007 bash[22722]: cluster 2024-09-14T05:26:50.094379+0000 mgr.a (mgr.14355) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:26:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:51 smithi131 bash[24745]: cluster 2024-09-14T05:26:50.094379+0000 mgr.a (mgr.14355) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:26:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:51 smithi171 bash[25040]: cluster 2024-09-14T05:26:50.094379+0000 mgr.a (mgr.14355) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:26:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:52 smithi007 bash[22722]: audit 2024-09-14T05:26:51.294242+0000 mgr.a (mgr.14355) 18418 : audit [DBG] from='client.395328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:52 smithi131 bash[24745]: audit 2024-09-14T05:26:51.294242+0000 mgr.a (mgr.14355) 18418 : audit [DBG] from='client.395328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:52 smithi171 bash[25040]: audit 2024-09-14T05:26:51.294242+0000 mgr.a (mgr.14355) 18418 : audit [DBG] from='client.395328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:53 smithi007 bash[22722]: cluster 2024-09-14T05:26:52.097118+0000 mgr.a (mgr.14355) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:53 smithi131 bash[24745]: cluster 2024-09-14T05:26:52.097118+0000 mgr.a (mgr.14355) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:53 smithi171 bash[25040]: cluster 2024-09-14T05:26:52.097118+0000 mgr.a (mgr.14355) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:55 smithi007 bash[22722]: cluster 2024-09-14T05:26:54.097896+0000 mgr.a (mgr.14355) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:55 smithi131 bash[24745]: cluster 2024-09-14T05:26:54.097896+0000 mgr.a (mgr.14355) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:55 smithi171 bash[25040]: cluster 2024-09-14T05:26:54.097896+0000 mgr.a (mgr.14355) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:26:56.738 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:26:56.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:26:56.739 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:26:57.518 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:26:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:26:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:26:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:26:57.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:26:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:57 smithi007 bash[22722]: cluster 2024-09-14T05:26:56.099918+0000 mgr.a (mgr.14355) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:57 smithi131 bash[24745]: cluster 2024-09-14T05:26:56.099918+0000 mgr.a (mgr.14355) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:57 smithi171 bash[25040]: cluster 2024-09-14T05:26:56.099918+0000 mgr.a (mgr.14355) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:26:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:58 smithi007 bash[22722]: audit 2024-09-14T05:26:57.075318+0000 mgr.a (mgr.14355) 18422 : audit [DBG] from='client.395403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:58 smithi131 bash[24745]: audit 2024-09-14T05:26:57.075318+0000 mgr.a (mgr.14355) 18422 : audit [DBG] from='client.395403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:26:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:58 smithi171 bash[25040]: audit 2024-09-14T05:26:57.075318+0000 mgr.a (mgr.14355) 18422 : audit [DBG] from='client.395403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:26:59 smithi007 bash[22722]: cluster 2024-09-14T05:26:58.100882+0000 mgr.a (mgr.14355) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:26:59 smithi131 bash[24745]: cluster 2024-09-14T05:26:58.100882+0000 mgr.a (mgr.14355) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:26:59 smithi171 bash[25040]: cluster 2024-09-14T05:26:58.100882+0000 mgr.a (mgr.14355) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:01 smithi007 bash[22722]: cluster 2024-09-14T05:27:00.101689+0000 mgr.a (mgr.14355) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:01 smithi131 bash[24745]: cluster 2024-09-14T05:27:00.101689+0000 mgr.a (mgr.14355) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:01 smithi171 bash[25040]: cluster 2024-09-14T05:27:00.101689+0000 mgr.a (mgr.14355) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:02.520 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:02.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:02.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:03.271 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:03.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:03.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:03.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:03.271 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:03 smithi007 bash[22722]: cluster 2024-09-14T05:27:02.103927+0000 mgr.a (mgr.14355) 18425 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:03 smithi007 bash[22722]: audit 2024-09-14T05:27:02.852561+0000 mgr.a (mgr.14355) 18426 : audit [DBG] from='client.395478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:03 smithi007 bash[22722]: audit 2024-09-14T05:27:03.701640+0000 mon.a (mon.0) 3335 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:27:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:03 smithi131 bash[24745]: cluster 2024-09-14T05:27:02.103927+0000 mgr.a (mgr.14355) 18425 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:03 smithi131 bash[24745]: audit 2024-09-14T05:27:02.852561+0000 mgr.a (mgr.14355) 18426 : audit [DBG] from='client.395478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:03 smithi131 bash[24745]: audit 2024-09-14T05:27:03.701640+0000 mon.a (mon.0) 3335 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:27:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:03 smithi171 bash[25040]: cluster 2024-09-14T05:27:02.103927+0000 mgr.a (mgr.14355) 18425 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:03 smithi171 bash[25040]: audit 2024-09-14T05:27:02.852561+0000 mgr.a (mgr.14355) 18426 : audit [DBG] from='client.395478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:03 smithi171 bash[25040]: audit 2024-09-14T05:27:03.701640+0000 mon.a (mon.0) 3335 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: cluster 2024-09-14T05:27:04.104773+0000 mgr.a (mgr.14355) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:04.318285+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:04.325574+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:04.333453+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:04.340912+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:05.066540+0000 mon.a (mon.0) 3340 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:27:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:05.068283+0000 mon.a (mon.0) 3341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:27:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:05.079801+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22722]: audit 2024-09-14T05:27:05.082482+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: cluster 2024-09-14T05:27:04.104773+0000 mgr.a (mgr.14355) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:04.318285+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:04.325574+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:04.333453+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:04.340912+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:05.066540+0000 mon.a (mon.0) 3340 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:05.068283+0000 mon.a (mon.0) 3341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:05.079801+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:05 smithi131 bash[24745]: audit 2024-09-14T05:27:05.082482+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: cluster 2024-09-14T05:27:04.104773+0000 mgr.a (mgr.14355) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:04.318285+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:04.325574+0000 mon.a (mon.0) 3337 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:04.333453+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:04.340912+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:05.066540+0000 mon.a (mon.0) 3340 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:27:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:05.068283+0000 mon.a (mon.0) 3341 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:27:05.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:05.079801+0000 mon.a (mon.0) 3342 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:27:05.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:05 smithi171 bash[25040]: audit 2024-09-14T05:27:05.082482+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22972]: debug 2024-09-14T05:27:05.864+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:27:06.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:27:05 smithi007 bash[22972]: debug 2024-09-14T05:27:05.864+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:27:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:06 smithi007 bash[22722]: audit 2024-09-14T05:27:05.084903+0000 mgr.a (mgr.14355) 18428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:06 smithi007 bash[22722]: audit 2024-09-14T05:27:05.866984+0000 mgr.a (mgr.14355) 18429 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:27:06.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:06 smithi007 bash[22722]: cephadm 2024-09-14T05:27:05.869004+0000 mgr.a (mgr.14355) 18430 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:27:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:06 smithi131 bash[24745]: audit 2024-09-14T05:27:05.084903+0000 mgr.a (mgr.14355) 18428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:06 smithi131 bash[24745]: audit 2024-09-14T05:27:05.866984+0000 mgr.a (mgr.14355) 18429 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:27:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:06 smithi131 bash[24745]: cephadm 2024-09-14T05:27:05.869004+0000 mgr.a (mgr.14355) 18430 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:27:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:06 smithi171 bash[25040]: audit 2024-09-14T05:27:05.084903+0000 mgr.a (mgr.14355) 18428 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:27:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:06 smithi171 bash[25040]: audit 2024-09-14T05:27:05.866984+0000 mgr.a (mgr.14355) 18429 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:27:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:06 smithi171 bash[25040]: cephadm 2024-09-14T05:27:05.869004+0000 mgr.a (mgr.14355) 18430 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:27:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:07 smithi007 bash[22722]: cluster 2024-09-14T05:27:06.107659+0000 mgr.a (mgr.14355) 18431 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:27:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:07 smithi131 bash[24745]: cluster 2024-09-14T05:27:06.107659+0000 mgr.a (mgr.14355) 18431 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:27:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:07 smithi171 bash[25040]: cluster 2024-09-14T05:27:06.107659+0000 mgr.a (mgr.14355) 18431 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:27:08.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:09.028 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:09 smithi007 bash[22722]: cluster 2024-09-14T05:27:08.108429+0000 mgr.a (mgr.14355) 18432 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:09 smithi007 bash[22722]: audit 2024-09-14T05:27:08.603488+0000 mgr.a (mgr.14355) 18433 : audit [DBG] from='client.395661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:09 smithi131 bash[24745]: cluster 2024-09-14T05:27:08.108429+0000 mgr.a (mgr.14355) 18432 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:09 smithi131 bash[24745]: audit 2024-09-14T05:27:08.603488+0000 mgr.a (mgr.14355) 18433 : audit [DBG] from='client.395661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:09 smithi171 bash[25040]: cluster 2024-09-14T05:27:08.108429+0000 mgr.a (mgr.14355) 18432 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:09 smithi171 bash[25040]: audit 2024-09-14T05:27:08.603488+0000 mgr.a (mgr.14355) 18433 : audit [DBG] from='client.395661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:11 smithi007 bash[22722]: cluster 2024-09-14T05:27:10.109326+0000 mgr.a (mgr.14355) 18434 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:11 smithi131 bash[24745]: cluster 2024-09-14T05:27:10.109326+0000 mgr.a (mgr.14355) 18434 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:11 smithi171 bash[25040]: cluster 2024-09-14T05:27:10.109326+0000 mgr.a (mgr.14355) 18434 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:27:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:13 smithi007 bash[22722]: cluster 2024-09-14T05:27:12.111613+0000 mgr.a (mgr.14355) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:13 smithi131 bash[24745]: cluster 2024-09-14T05:27:12.111613+0000 mgr.a (mgr.14355) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:13 smithi171 bash[25040]: cluster 2024-09-14T05:27:12.111613+0000 mgr.a (mgr.14355) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:14.030 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:14.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:15 smithi007 bash[22722]: cluster 2024-09-14T05:27:14.112511+0000 mgr.a (mgr.14355) 18436 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:15.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:15 smithi007 bash[22722]: audit 2024-09-14T05:27:14.365568+0000 mgr.a (mgr.14355) 18437 : audit [DBG] from='client.395739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:15 smithi131 bash[24745]: cluster 2024-09-14T05:27:14.112511+0000 mgr.a (mgr.14355) 18436 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:15.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:15 smithi131 bash[24745]: audit 2024-09-14T05:27:14.365568+0000 mgr.a (mgr.14355) 18437 : audit [DBG] from='client.395739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:15 smithi171 bash[25040]: cluster 2024-09-14T05:27:14.112511+0000 mgr.a (mgr.14355) 18436 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:15 smithi171 bash[25040]: audit 2024-09-14T05:27:14.365568+0000 mgr.a (mgr.14355) 18437 : audit [DBG] from='client.395739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:17 smithi007 bash[22722]: cluster 2024-09-14T05:27:16.114931+0000 mgr.a (mgr.14355) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:17 smithi131 bash[24745]: cluster 2024-09-14T05:27:16.114931+0000 mgr.a (mgr.14355) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:17 smithi171 bash[25040]: cluster 2024-09-14T05:27:16.114931+0000 mgr.a (mgr.14355) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:27:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:19 smithi007 bash[22722]: cluster 2024-09-14T05:27:18.115684+0000 mgr.a (mgr.14355) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:19 smithi131 bash[24745]: cluster 2024-09-14T05:27:18.115684+0000 mgr.a (mgr.14355) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:19 smithi171 bash[25040]: cluster 2024-09-14T05:27:18.115684+0000 mgr.a (mgr.14355) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:19.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:19.808 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:20.578 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:20.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:20.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:20.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:20.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:21 smithi007 bash[22722]: cluster 2024-09-14T05:27:20.116416+0000 mgr.a (mgr.14355) 18440 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:21.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:21 smithi007 bash[22722]: audit 2024-09-14T05:27:20.142064+0000 mgr.a (mgr.14355) 18441 : audit [DBG] from='client.395814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:21 smithi131 bash[24745]: cluster 2024-09-14T05:27:20.116416+0000 mgr.a (mgr.14355) 18440 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:21 smithi131 bash[24745]: audit 2024-09-14T05:27:20.142064+0000 mgr.a (mgr.14355) 18441 : audit [DBG] from='client.395814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:21 smithi171 bash[25040]: cluster 2024-09-14T05:27:20.116416+0000 mgr.a (mgr.14355) 18440 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:21 smithi171 bash[25040]: audit 2024-09-14T05:27:20.142064+0000 mgr.a (mgr.14355) 18441 : audit [DBG] from='client.395814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:23 smithi007 bash[22722]: cluster 2024-09-14T05:27:22.118848+0000 mgr.a (mgr.14355) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:23 smithi131 bash[24745]: cluster 2024-09-14T05:27:22.118848+0000 mgr.a (mgr.14355) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:23 smithi171 bash[25040]: cluster 2024-09-14T05:27:22.118848+0000 mgr.a (mgr.14355) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:27:25.580 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:25.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:25.580 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:25 smithi007 bash[22722]: cluster 2024-09-14T05:27:24.119618+0000 mgr.a (mgr.14355) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:27:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:25 smithi131 bash[24745]: cluster 2024-09-14T05:27:24.119618+0000 mgr.a (mgr.14355) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:27:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:25 smithi171 bash[25040]: cluster 2024-09-14T05:27:24.119618+0000 mgr.a (mgr.14355) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:27:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:26.358 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:26.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:26 smithi007 bash[22722]: audit 2024-09-14T05:27:25.912806+0000 mgr.a (mgr.14355) 18444 : audit [DBG] from='client.395892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:26 smithi131 bash[24745]: audit 2024-09-14T05:27:25.912806+0000 mgr.a (mgr.14355) 18444 : audit [DBG] from='client.395892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:26.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:26 smithi171 bash[25040]: audit 2024-09-14T05:27:25.912806+0000 mgr.a (mgr.14355) 18444 : audit [DBG] from='client.395892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:27 smithi007 bash[22722]: cluster 2024-09-14T05:27:26.121042+0000 mgr.a (mgr.14355) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:27 smithi131 bash[24745]: cluster 2024-09-14T05:27:26.121042+0000 mgr.a (mgr.14355) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:27 smithi171 bash[25040]: cluster 2024-09-14T05:27:26.121042+0000 mgr.a (mgr.14355) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:29 smithi007 bash[22722]: cluster 2024-09-14T05:27:28.121894+0000 mgr.a (mgr.14355) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:29 smithi131 bash[24745]: cluster 2024-09-14T05:27:28.121894+0000 mgr.a (mgr.14355) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:29 smithi171 bash[25040]: cluster 2024-09-14T05:27:28.121894+0000 mgr.a (mgr.14355) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:31.359 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:31.360 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:31 smithi007 bash[22722]: cluster 2024-09-14T05:27:30.122697+0000 mgr.a (mgr.14355) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:31 smithi131 bash[24745]: cluster 2024-09-14T05:27:30.122697+0000 mgr.a (mgr.14355) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:31 smithi171 bash[25040]: cluster 2024-09-14T05:27:30.122697+0000 mgr.a (mgr.14355) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:27:32.147 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:32.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:32.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:32.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:32.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:32 smithi007 bash[22722]: audit 2024-09-14T05:27:31.698487+0000 mgr.a (mgr.14355) 18448 : audit [DBG] from='client.395964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:32 smithi131 bash[24745]: audit 2024-09-14T05:27:31.698487+0000 mgr.a (mgr.14355) 18448 : audit [DBG] from='client.395964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:32 smithi171 bash[25040]: audit 2024-09-14T05:27:31.698487+0000 mgr.a (mgr.14355) 18448 : audit [DBG] from='client.395964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:33 smithi007 bash[22722]: cluster 2024-09-14T05:27:32.124107+0000 mgr.a (mgr.14355) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:33 smithi131 bash[24745]: cluster 2024-09-14T05:27:32.124107+0000 mgr.a (mgr.14355) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:33 smithi171 bash[25040]: cluster 2024-09-14T05:27:32.124107+0000 mgr.a (mgr.14355) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:35 smithi007 bash[22722]: cluster 2024-09-14T05:27:34.124860+0000 mgr.a (mgr.14355) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:27:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:35 smithi131 bash[24745]: cluster 2024-09-14T05:27:34.124860+0000 mgr.a (mgr.14355) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:27:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:35 smithi171 bash[25040]: cluster 2024-09-14T05:27:34.124860+0000 mgr.a (mgr.14355) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:27:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:37.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:37 smithi007 bash[22722]: cluster 2024-09-14T05:27:36.126879+0000 mgr.a (mgr.14355) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:27:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:37 smithi131 bash[24745]: cluster 2024-09-14T05:27:36.126879+0000 mgr.a (mgr.14355) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:27:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:37 smithi171 bash[25040]: cluster 2024-09-14T05:27:36.126879+0000 mgr.a (mgr.14355) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:27:37.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:37.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:38 smithi007 bash[22722]: audit 2024-09-14T05:27:37.482089+0000 mgr.a (mgr.14355) 18452 : audit [DBG] from='client.396042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:38 smithi131 bash[24745]: audit 2024-09-14T05:27:37.482089+0000 mgr.a (mgr.14355) 18452 : audit [DBG] from='client.396042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:38 smithi171 bash[25040]: audit 2024-09-14T05:27:37.482089+0000 mgr.a (mgr.14355) 18452 : audit [DBG] from='client.396042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:39 smithi007 bash[22722]: cluster 2024-09-14T05:27:38.127865+0000 mgr.a (mgr.14355) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:39 smithi131 bash[24745]: cluster 2024-09-14T05:27:38.127865+0000 mgr.a (mgr.14355) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:39 smithi171 bash[25040]: cluster 2024-09-14T05:27:38.127865+0000 mgr.a (mgr.14355) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:41 smithi007 bash[22722]: cluster 2024-09-14T05:27:40.128650+0000 mgr.a (mgr.14355) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:41 smithi131 bash[24745]: cluster 2024-09-14T05:27:40.128650+0000 mgr.a (mgr.14355) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:41 smithi171 bash[25040]: cluster 2024-09-14T05:27:40.128650+0000 mgr.a (mgr.14355) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:42.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:42.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:42.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:43.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:43.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:43.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:43.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:43.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:43 smithi007 bash[22722]: cluster 2024-09-14T05:27:42.130892+0000 mgr.a (mgr.14355) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:43 smithi131 bash[24745]: cluster 2024-09-14T05:27:42.130892+0000 mgr.a (mgr.14355) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:43 smithi171 bash[25040]: cluster 2024-09-14T05:27:42.130892+0000 mgr.a (mgr.14355) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:44 smithi007 bash[22722]: audit 2024-09-14T05:27:43.257850+0000 mgr.a (mgr.14355) 18456 : audit [DBG] from='client.396117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:44 smithi131 bash[24745]: audit 2024-09-14T05:27:43.257850+0000 mgr.a (mgr.14355) 18456 : audit [DBG] from='client.396117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:44 smithi171 bash[25040]: audit 2024-09-14T05:27:43.257850+0000 mgr.a (mgr.14355) 18456 : audit [DBG] from='client.396117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:45 smithi007 bash[22722]: cluster 2024-09-14T05:27:44.131720+0000 mgr.a (mgr.14355) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:45 smithi131 bash[24745]: cluster 2024-09-14T05:27:44.131720+0000 mgr.a (mgr.14355) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:45 smithi171 bash[25040]: cluster 2024-09-14T05:27:44.131720+0000 mgr.a (mgr.14355) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:47 smithi007 bash[22722]: cluster 2024-09-14T05:27:46.134008+0000 mgr.a (mgr.14355) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:47 smithi131 bash[24745]: cluster 2024-09-14T05:27:46.134008+0000 mgr.a (mgr.14355) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:47 smithi171 bash[25040]: cluster 2024-09-14T05:27:46.134008+0000 mgr.a (mgr.14355) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:48.686 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:49.444 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:49 smithi007 bash[22722]: cluster 2024-09-14T05:27:48.134815+0000 mgr.a (mgr.14355) 18459 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:49 smithi007 bash[22722]: audit 2024-09-14T05:27:49.017746+0000 mgr.a (mgr.14355) 18460 : audit [DBG] from='client.396189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:49 smithi131 bash[24745]: cluster 2024-09-14T05:27:48.134815+0000 mgr.a (mgr.14355) 18459 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:49 smithi131 bash[24745]: audit 2024-09-14T05:27:49.017746+0000 mgr.a (mgr.14355) 18460 : audit [DBG] from='client.396189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:49 smithi171 bash[25040]: cluster 2024-09-14T05:27:48.134815+0000 mgr.a (mgr.14355) 18459 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:49 smithi171 bash[25040]: audit 2024-09-14T05:27:49.017746+0000 mgr.a (mgr.14355) 18460 : audit [DBG] from='client.396189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:51 smithi007 bash[22722]: cluster 2024-09-14T05:27:50.135682+0000 mgr.a (mgr.14355) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:51 smithi131 bash[24745]: cluster 2024-09-14T05:27:50.135682+0000 mgr.a (mgr.14355) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:51 smithi171 bash[25040]: cluster 2024-09-14T05:27:50.135682+0000 mgr.a (mgr.14355) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:53 smithi007 bash[22722]: cluster 2024-09-14T05:27:52.137927+0000 mgr.a (mgr.14355) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:53 smithi131 bash[24745]: cluster 2024-09-14T05:27:52.137927+0000 mgr.a (mgr.14355) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:53 smithi171 bash[25040]: cluster 2024-09-14T05:27:52.137927+0000 mgr.a (mgr.14355) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:54.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:27:54.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:27:54.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:27:55.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:27:55.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:27:55.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:27:55.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:27:55.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:27:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:55 smithi007 bash[22722]: cluster 2024-09-14T05:27:54.138720+0000 mgr.a (mgr.14355) 18463 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:56.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:55 smithi007 bash[22722]: audit 2024-09-14T05:27:54.786490+0000 mgr.a (mgr.14355) 18464 : audit [DBG] from='client.396267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:55 smithi131 bash[24745]: cluster 2024-09-14T05:27:54.138720+0000 mgr.a (mgr.14355) 18463 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:55 smithi131 bash[24745]: audit 2024-09-14T05:27:54.786490+0000 mgr.a (mgr.14355) 18464 : audit [DBG] from='client.396267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:55 smithi171 bash[25040]: cluster 2024-09-14T05:27:54.138720+0000 mgr.a (mgr.14355) 18463 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:27:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:55 smithi171 bash[25040]: audit 2024-09-14T05:27:54.786490+0000 mgr.a (mgr.14355) 18464 : audit [DBG] from='client.396267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:27:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:57 smithi007 bash[22722]: cluster 2024-09-14T05:27:56.141116+0000 mgr.a (mgr.14355) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:57 smithi131 bash[24745]: cluster 2024-09-14T05:27:56.141116+0000 mgr.a (mgr.14355) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:27:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:57 smithi171 bash[25040]: cluster 2024-09-14T05:27:56.141116+0000 mgr.a (mgr.14355) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:27:59 smithi007 bash[22722]: cluster 2024-09-14T05:27:58.141898+0000 mgr.a (mgr.14355) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:00.242 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:00.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:00.243 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:27:59 smithi131 bash[24745]: cluster 2024-09-14T05:27:58.141898+0000 mgr.a (mgr.14355) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:27:59 smithi171 bash[25040]: cluster 2024-09-14T05:27:58.141898+0000 mgr.a (mgr.14355) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:01.007 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:01.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:01.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:01.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:01.007 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:01 smithi007 bash[22722]: cluster 2024-09-14T05:28:00.142655+0000 mgr.a (mgr.14355) 18467 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:01 smithi007 bash[22722]: audit 2024-09-14T05:28:00.577053+0000 mgr.a (mgr.14355) 18468 : audit [DBG] from='client.396342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:01 smithi131 bash[24745]: cluster 2024-09-14T05:28:00.142655+0000 mgr.a (mgr.14355) 18467 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:01 smithi131 bash[24745]: audit 2024-09-14T05:28:00.577053+0000 mgr.a (mgr.14355) 18468 : audit [DBG] from='client.396342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:01 smithi171 bash[25040]: cluster 2024-09-14T05:28:00.142655+0000 mgr.a (mgr.14355) 18467 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:01 smithi171 bash[25040]: audit 2024-09-14T05:28:00.577053+0000 mgr.a (mgr.14355) 18468 : audit [DBG] from='client.396342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:03 smithi007 bash[22722]: cluster 2024-09-14T05:28:02.145351+0000 mgr.a (mgr.14355) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:03 smithi131 bash[24745]: cluster 2024-09-14T05:28:02.145351+0000 mgr.a (mgr.14355) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:03 smithi171 bash[25040]: cluster 2024-09-14T05:28:02.145351+0000 mgr.a (mgr.14355) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:06.008 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:06.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:06.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:05 smithi007 bash[22722]: cluster 2024-09-14T05:28:04.146146+0000 mgr.a (mgr.14355) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:05 smithi007 bash[22722]: audit 2024-09-14T05:28:05.923230+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:28:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:05 smithi131 bash[24745]: cluster 2024-09-14T05:28:04.146146+0000 mgr.a (mgr.14355) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:05 smithi131 bash[24745]: audit 2024-09-14T05:28:05.923230+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:28:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:05 smithi171 bash[25040]: cluster 2024-09-14T05:28:04.146146+0000 mgr.a (mgr.14355) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:05 smithi171 bash[25040]: audit 2024-09-14T05:28:05.923230+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:28:06.774 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:06.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:28:08 smithi007 bash[22972]: debug 2024-09-14T05:28:08.055+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:28:08 smithi007 bash[22972]: debug 2024-09-14T05:28:08.055+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: cluster 2024-09-14T05:28:06.147444+0000 mgr.a (mgr.14355) 18471 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:06.342571+0000 mgr.a (mgr.14355) 18472 : audit [DBG] from='client.396420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.262169+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.267482+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.272899+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.278605+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.302273+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.309976+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.311887+0000 mon.a (mon.0) 3351 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.313721+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.323384+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:07 smithi007 bash[22722]: audit 2024-09-14T05:28:07.328599+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: cluster 2024-09-14T05:28:06.147444+0000 mgr.a (mgr.14355) 18471 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:06.342571+0000 mgr.a (mgr.14355) 18472 : audit [DBG] from='client.396420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.262169+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.267482+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.272899+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.278605+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.302273+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.309976+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.311887+0000 mon.a (mon.0) 3351 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.313721+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.323384+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:07 smithi131 bash[24745]: audit 2024-09-14T05:28:07.328599+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: cluster 2024-09-14T05:28:06.147444+0000 mgr.a (mgr.14355) 18471 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:06.342571+0000 mgr.a (mgr.14355) 18472 : audit [DBG] from='client.396420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.262169+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.267482+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.272899+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.278605+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.302273+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.309976+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.311887+0000 mon.a (mon.0) 3351 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.313721+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.323384+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:28:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:07 smithi171 bash[25040]: audit 2024-09-14T05:28:07.328599+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:09.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:08 smithi007 bash[22722]: audit 2024-09-14T05:28:07.331296+0000 mgr.a (mgr.14355) 18473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:08 smithi131 bash[24745]: audit 2024-09-14T05:28:07.331296+0000 mgr.a (mgr.14355) 18473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:08 smithi171 bash[25040]: audit 2024-09-14T05:28:07.331296+0000 mgr.a (mgr.14355) 18473 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:28:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:09 smithi007 bash[22722]: audit 2024-09-14T05:28:08.060611+0000 mgr.a (mgr.14355) 18474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:28:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:09 smithi007 bash[22722]: cephadm 2024-09-14T05:28:08.062082+0000 mgr.a (mgr.14355) 18475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:28:10.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:09 smithi007 bash[22722]: cluster 2024-09-14T05:28:08.148286+0000 mgr.a (mgr.14355) 18476 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:09 smithi131 bash[24745]: audit 2024-09-14T05:28:08.060611+0000 mgr.a (mgr.14355) 18474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:28:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:09 smithi131 bash[24745]: cephadm 2024-09-14T05:28:08.062082+0000 mgr.a (mgr.14355) 18475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:28:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:09 smithi131 bash[24745]: cluster 2024-09-14T05:28:08.148286+0000 mgr.a (mgr.14355) 18476 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:09 smithi171 bash[25040]: audit 2024-09-14T05:28:08.060611+0000 mgr.a (mgr.14355) 18474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:28:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:09 smithi171 bash[25040]: cephadm 2024-09-14T05:28:08.062082+0000 mgr.a (mgr.14355) 18475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:28:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:09 smithi171 bash[25040]: cluster 2024-09-14T05:28:08.148286+0000 mgr.a (mgr.14355) 18476 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:11 smithi007 bash[22722]: cluster 2024-09-14T05:28:10.149040+0000 mgr.a (mgr.14355) 18477 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:28:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:11 smithi131 bash[24745]: cluster 2024-09-14T05:28:10.149040+0000 mgr.a (mgr.14355) 18477 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:28:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:11 smithi171 bash[25040]: cluster 2024-09-14T05:28:10.149040+0000 mgr.a (mgr.14355) 18477 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:28:12.557 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:12.558 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:13 smithi007 bash[22722]: audit 2024-09-14T05:28:12.111669+0000 mgr.a (mgr.14355) 18478 : audit [DBG] from='client.396603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:14.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:13 smithi007 bash[22722]: cluster 2024-09-14T05:28:12.151315+0000 mgr.a (mgr.14355) 18479 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:13 smithi131 bash[24745]: audit 2024-09-14T05:28:12.111669+0000 mgr.a (mgr.14355) 18478 : audit [DBG] from='client.396603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:13 smithi131 bash[24745]: cluster 2024-09-14T05:28:12.151315+0000 mgr.a (mgr.14355) 18479 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:13 smithi171 bash[25040]: audit 2024-09-14T05:28:12.111669+0000 mgr.a (mgr.14355) 18478 : audit [DBG] from='client.396603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:13 smithi171 bash[25040]: cluster 2024-09-14T05:28:12.151315+0000 mgr.a (mgr.14355) 18479 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:15 smithi131 bash[24745]: cluster 2024-09-14T05:28:14.152231+0000 mgr.a (mgr.14355) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:15 smithi171 bash[25040]: cluster 2024-09-14T05:28:14.152231+0000 mgr.a (mgr.14355) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:15 smithi007 bash[22722]: cluster 2024-09-14T05:28:14.152231+0000 mgr.a (mgr.14355) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:17.559 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:17.560 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:17 smithi131 bash[24745]: cluster 2024-09-14T05:28:16.154631+0000 mgr.a (mgr.14355) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:17 smithi171 bash[25040]: cluster 2024-09-14T05:28:16.154631+0000 mgr.a (mgr.14355) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:18.309 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:18.309 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:17 smithi007 bash[22722]: cluster 2024-09-14T05:28:16.154631+0000 mgr.a (mgr.14355) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:18 smithi131 bash[24745]: audit 2024-09-14T05:28:17.892475+0000 mgr.a (mgr.14355) 18482 : audit [DBG] from='client.396681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:18 smithi171 bash[25040]: audit 2024-09-14T05:28:17.892475+0000 mgr.a (mgr.14355) 18482 : audit [DBG] from='client.396681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:18 smithi007 bash[22722]: audit 2024-09-14T05:28:17.892475+0000 mgr.a (mgr.14355) 18482 : audit [DBG] from='client.396681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:19 smithi131 bash[24745]: cluster 2024-09-14T05:28:18.155195+0000 mgr.a (mgr.14355) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:19 smithi171 bash[25040]: cluster 2024-09-14T05:28:18.155195+0000 mgr.a (mgr.14355) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:19 smithi007 bash[22722]: cluster 2024-09-14T05:28:18.155195+0000 mgr.a (mgr.14355) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:21 smithi131 bash[24745]: cluster 2024-09-14T05:28:20.156060+0000 mgr.a (mgr.14355) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:21 smithi171 bash[25040]: cluster 2024-09-14T05:28:20.156060+0000 mgr.a (mgr.14355) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:21 smithi007 bash[22722]: cluster 2024-09-14T05:28:20.156060+0000 mgr.a (mgr.14355) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:23.310 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:24.088 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:24.088 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:23 smithi131 bash[24745]: cluster 2024-09-14T05:28:22.158346+0000 mgr.a (mgr.14355) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:23 smithi171 bash[25040]: cluster 2024-09-14T05:28:22.158346+0000 mgr.a (mgr.14355) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:23 smithi007 bash[22722]: cluster 2024-09-14T05:28:22.158346+0000 mgr.a (mgr.14355) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:28:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:24 smithi131 bash[24745]: audit 2024-09-14T05:28:23.645101+0000 mgr.a (mgr.14355) 18486 : audit [DBG] from='client.396759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:24 smithi171 bash[25040]: audit 2024-09-14T05:28:23.645101+0000 mgr.a (mgr.14355) 18486 : audit [DBG] from='client.396759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:24 smithi007 bash[22722]: audit 2024-09-14T05:28:23.645101+0000 mgr.a (mgr.14355) 18486 : audit [DBG] from='client.396759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:25 smithi131 bash[24745]: cluster 2024-09-14T05:28:24.159088+0000 mgr.a (mgr.14355) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:25 smithi171 bash[25040]: cluster 2024-09-14T05:28:24.159088+0000 mgr.a (mgr.14355) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:25 smithi007 bash[22722]: cluster 2024-09-14T05:28:24.159088+0000 mgr.a (mgr.14355) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:27 smithi131 bash[24745]: cluster 2024-09-14T05:28:26.161292+0000 mgr.a (mgr.14355) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:27 smithi171 bash[25040]: cluster 2024-09-14T05:28:26.161292+0000 mgr.a (mgr.14355) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:27 smithi007 bash[22722]: cluster 2024-09-14T05:28:26.161292+0000 mgr.a (mgr.14355) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:29.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:29.090 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:29.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:29.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:29.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:29.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:29.869 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:29 smithi131 bash[24745]: cluster 2024-09-14T05:28:28.162189+0000 mgr.a (mgr.14355) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:29 smithi171 bash[25040]: cluster 2024-09-14T05:28:28.162189+0000 mgr.a (mgr.14355) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:29 smithi007 bash[22722]: cluster 2024-09-14T05:28:28.162189+0000 mgr.a (mgr.14355) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:31 smithi131 bash[24745]: audit 2024-09-14T05:28:29.423552+0000 mgr.a (mgr.14355) 18490 : audit [DBG] from='client.396837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:31 smithi171 bash[25040]: audit 2024-09-14T05:28:29.423552+0000 mgr.a (mgr.14355) 18490 : audit [DBG] from='client.396837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:31.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:31 smithi007 bash[22722]: audit 2024-09-14T05:28:29.423552+0000 mgr.a (mgr.14355) 18490 : audit [DBG] from='client.396837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:32 smithi131 bash[24745]: cluster 2024-09-14T05:28:30.163160+0000 mgr.a (mgr.14355) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:32 smithi171 bash[25040]: cluster 2024-09-14T05:28:30.163160+0000 mgr.a (mgr.14355) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:32 smithi007 bash[22722]: cluster 2024-09-14T05:28:30.163160+0000 mgr.a (mgr.14355) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:34 smithi131 bash[24745]: cluster 2024-09-14T05:28:32.165535+0000 mgr.a (mgr.14355) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:34 smithi171 bash[25040]: cluster 2024-09-14T05:28:32.165535+0000 mgr.a (mgr.14355) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:34 smithi007 bash[22722]: cluster 2024-09-14T05:28:32.165535+0000 mgr.a (mgr.14355) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:34.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:34.871 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:35.645 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:35.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:35.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:35.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:35.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:36 smithi131 bash[24745]: cluster 2024-09-14T05:28:34.166361+0000 mgr.a (mgr.14355) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:36 smithi171 bash[25040]: cluster 2024-09-14T05:28:34.166361+0000 mgr.a (mgr.14355) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:36 smithi007 bash[22722]: cluster 2024-09-14T05:28:34.166361+0000 mgr.a (mgr.14355) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:37 smithi131 bash[24745]: audit 2024-09-14T05:28:35.208376+0000 mgr.a (mgr.14355) 18494 : audit [DBG] from='client.396912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:37 smithi171 bash[25040]: audit 2024-09-14T05:28:35.208376+0000 mgr.a (mgr.14355) 18494 : audit [DBG] from='client.396912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:37 smithi007 bash[22722]: audit 2024-09-14T05:28:35.208376+0000 mgr.a (mgr.14355) 18494 : audit [DBG] from='client.396912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:38 smithi131 bash[24745]: cluster 2024-09-14T05:28:36.169154+0000 mgr.a (mgr.14355) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:28:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:38 smithi171 bash[25040]: cluster 2024-09-14T05:28:36.169154+0000 mgr.a (mgr.14355) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:28:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:38 smithi007 bash[22722]: cluster 2024-09-14T05:28:36.169154+0000 mgr.a (mgr.14355) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:28:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:40 smithi131 bash[24745]: cluster 2024-09-14T05:28:38.169989+0000 mgr.a (mgr.14355) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:40 smithi171 bash[25040]: cluster 2024-09-14T05:28:38.169989+0000 mgr.a (mgr.14355) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:40 smithi007 bash[22722]: cluster 2024-09-14T05:28:38.169989+0000 mgr.a (mgr.14355) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:40.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:40.647 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:41.406 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:41.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:41.407 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:42 smithi171 bash[25040]: cluster 2024-09-14T05:28:40.170784+0000 mgr.a (mgr.14355) 18497 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:42 smithi171 bash[25040]: audit 2024-09-14T05:28:40.975679+0000 mgr.a (mgr.14355) 18498 : audit [DBG] from='client.396987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:42 smithi007 bash[22722]: cluster 2024-09-14T05:28:40.170784+0000 mgr.a (mgr.14355) 18497 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:42 smithi007 bash[22722]: audit 2024-09-14T05:28:40.975679+0000 mgr.a (mgr.14355) 18498 : audit [DBG] from='client.396987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:42 smithi131 bash[24745]: cluster 2024-09-14T05:28:40.170784+0000 mgr.a (mgr.14355) 18497 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:28:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:42 smithi131 bash[24745]: audit 2024-09-14T05:28:40.975679+0000 mgr.a (mgr.14355) 18498 : audit [DBG] from='client.396987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:44 smithi171 bash[25040]: cluster 2024-09-14T05:28:42.173660+0000 mgr.a (mgr.14355) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:44 smithi007 bash[22722]: cluster 2024-09-14T05:28:42.173660+0000 mgr.a (mgr.14355) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:44 smithi131 bash[24745]: cluster 2024-09-14T05:28:42.173660+0000 mgr.a (mgr.14355) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:46.408 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:46.409 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:46 smithi007 bash[22722]: cluster 2024-09-14T05:28:44.174445+0000 mgr.a (mgr.14355) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:46 smithi131 bash[24745]: cluster 2024-09-14T05:28:44.174445+0000 mgr.a (mgr.14355) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:46 smithi171 bash[25040]: cluster 2024-09-14T05:28:44.174445+0000 mgr.a (mgr.14355) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:28:47.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:47.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:47 smithi007 bash[22722]: cluster 2024-09-14T05:28:46.176500+0000 mgr.a (mgr.14355) 18501 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:47 smithi007 bash[22722]: audit 2024-09-14T05:28:46.736073+0000 mgr.a (mgr.14355) 18502 : audit [DBG] from='client.397065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:47 smithi131 bash[24745]: cluster 2024-09-14T05:28:46.176500+0000 mgr.a (mgr.14355) 18501 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:47 smithi131 bash[24745]: audit 2024-09-14T05:28:46.736073+0000 mgr.a (mgr.14355) 18502 : audit [DBG] from='client.397065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:47 smithi171 bash[25040]: cluster 2024-09-14T05:28:46.176500+0000 mgr.a (mgr.14355) 18501 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:47 smithi171 bash[25040]: audit 2024-09-14T05:28:46.736073+0000 mgr.a (mgr.14355) 18502 : audit [DBG] from='client.397065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:49 smithi131 bash[24745]: cluster 2024-09-14T05:28:48.177515+0000 mgr.a (mgr.14355) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:49 smithi171 bash[25040]: cluster 2024-09-14T05:28:48.177515+0000 mgr.a (mgr.14355) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:49 smithi007 bash[22722]: cluster 2024-09-14T05:28:48.177515+0000 mgr.a (mgr.14355) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:51 smithi131 bash[24745]: cluster 2024-09-14T05:28:50.178337+0000 mgr.a (mgr.14355) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:51 smithi171 bash[25040]: cluster 2024-09-14T05:28:50.178337+0000 mgr.a (mgr.14355) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:51 smithi007 bash[22722]: cluster 2024-09-14T05:28:50.178337+0000 mgr.a (mgr.14355) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:28:52.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:52.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:52.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:52.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:52.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:52.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:52.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:52.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:53 smithi131 bash[24745]: cluster 2024-09-14T05:28:52.179704+0000 mgr.a (mgr.14355) 18505 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:28:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:53 smithi131 bash[24745]: audit 2024-09-14T05:28:52.488217+0000 mgr.a (mgr.14355) 18506 : audit [DBG] from='client.397143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:53 smithi171 bash[25040]: cluster 2024-09-14T05:28:52.179704+0000 mgr.a (mgr.14355) 18505 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:28:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:53 smithi171 bash[25040]: audit 2024-09-14T05:28:52.488217+0000 mgr.a (mgr.14355) 18506 : audit [DBG] from='client.397143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:53 smithi007 bash[22722]: cluster 2024-09-14T05:28:52.179704+0000 mgr.a (mgr.14355) 18505 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:28:53.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:53 smithi007 bash[22722]: audit 2024-09-14T05:28:52.488217+0000 mgr.a (mgr.14355) 18506 : audit [DBG] from='client.397143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:55 smithi131 bash[24745]: cluster 2024-09-14T05:28:54.180658+0000 mgr.a (mgr.14355) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:55 smithi171 bash[25040]: cluster 2024-09-14T05:28:54.180658+0000 mgr.a (mgr.14355) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:55 smithi007 bash[22722]: cluster 2024-09-14T05:28:54.180658+0000 mgr.a (mgr.14355) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:57 smithi131 bash[24745]: cluster 2024-09-14T05:28:56.182950+0000 mgr.a (mgr.14355) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:57 smithi171 bash[25040]: cluster 2024-09-14T05:28:56.182950+0000 mgr.a (mgr.14355) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:57 smithi007 bash[22722]: cluster 2024-09-14T05:28:56.182950+0000 mgr.a (mgr.14355) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:28:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:28:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:28:57.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:28:58.683 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:28:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:28:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:28:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:28:58.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:28:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:59 smithi131 bash[24745]: cluster 2024-09-14T05:28:58.183717+0000 mgr.a (mgr.14355) 18509 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:59.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:28:59 smithi131 bash[24745]: audit 2024-09-14T05:28:58.237597+0000 mgr.a (mgr.14355) 18510 : audit [DBG] from='client.397221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:59 smithi171 bash[25040]: cluster 2024-09-14T05:28:58.183717+0000 mgr.a (mgr.14355) 18509 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:28:59 smithi171 bash[25040]: audit 2024-09-14T05:28:58.237597+0000 mgr.a (mgr.14355) 18510 : audit [DBG] from='client.397221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:28:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:59 smithi007 bash[22722]: cluster 2024-09-14T05:28:58.183717+0000 mgr.a (mgr.14355) 18509 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:28:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:28:59 smithi007 bash[22722]: audit 2024-09-14T05:28:58.237597+0000 mgr.a (mgr.14355) 18510 : audit [DBG] from='client.397221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:01 smithi131 bash[24745]: cluster 2024-09-14T05:29:00.184666+0000 mgr.a (mgr.14355) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:01 smithi171 bash[25040]: cluster 2024-09-14T05:29:00.184666+0000 mgr.a (mgr.14355) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:01 smithi007 bash[22722]: cluster 2024-09-14T05:29:00.184666+0000 mgr.a (mgr.14355) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:03 smithi131 bash[24745]: cluster 2024-09-14T05:29:02.186978+0000 mgr.a (mgr.14355) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:03 smithi171 bash[25040]: cluster 2024-09-14T05:29:02.186978+0000 mgr.a (mgr.14355) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:03.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:03.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:03.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:03 smithi007 bash[22722]: cluster 2024-09-14T05:29:02.186978+0000 mgr.a (mgr.14355) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:04.454 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:04.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:04 smithi131 bash[24745]: audit 2024-09-14T05:29:04.020629+0000 mgr.a (mgr.14355) 18513 : audit [DBG] from='client.397299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:04 smithi171 bash[25040]: audit 2024-09-14T05:29:04.020629+0000 mgr.a (mgr.14355) 18513 : audit [DBG] from='client.397299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:04 smithi007 bash[22722]: audit 2024-09-14T05:29:04.020629+0000 mgr.a (mgr.14355) 18513 : audit [DBG] from='client.397299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:05 smithi131 bash[24745]: cluster 2024-09-14T05:29:04.187940+0000 mgr.a (mgr.14355) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:05 smithi171 bash[25040]: cluster 2024-09-14T05:29:04.187940+0000 mgr.a (mgr.14355) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:05 smithi007 bash[22722]: cluster 2024-09-14T05:29:04.187940+0000 mgr.a (mgr.14355) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:07 smithi131 bash[24745]: cluster 2024-09-14T05:29:06.190234+0000 mgr.a (mgr.14355) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:07 smithi171 bash[25040]: cluster 2024-09-14T05:29:06.190234+0000 mgr.a (mgr.14355) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:07 smithi007 bash[22722]: cluster 2024-09-14T05:29:06.190234+0000 mgr.a (mgr.14355) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:08 smithi171 bash[25040]: audit 2024-09-14T05:29:08.125320+0000 mon.a (mon.0) 3355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:29:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:08 smithi007 bash[22722]: audit 2024-09-14T05:29:08.125320+0000 mon.a (mon.0) 3355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:29:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:08 smithi131 bash[24745]: audit 2024-09-14T05:29:08.125320+0000 mon.a (mon.0) 3355 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:29:09.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:09.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:09.456 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: cluster 2024-09-14T05:29:08.191000+0000 mgr.a (mgr.14355) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: audit 2024-09-14T05:29:08.970571+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: audit 2024-09-14T05:29:08.971726+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: audit 2024-09-14T05:29:08.978691+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: audit 2024-09-14T05:29:08.981014+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:09.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:09 smithi171 bash[25040]: audit 2024-09-14T05:29:08.983322+0000 mgr.a (mgr.14355) 18517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: cluster 2024-09-14T05:29:08.191000+0000 mgr.a (mgr.14355) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: audit 2024-09-14T05:29:08.970571+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:29:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: audit 2024-09-14T05:29:08.971726+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:29:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: audit 2024-09-14T05:29:08.978691+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:29:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: audit 2024-09-14T05:29:08.981014+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:09.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22722]: audit 2024-09-14T05:29:08.983322+0000 mgr.a (mgr.14355) 18517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: cluster 2024-09-14T05:29:08.191000+0000 mgr.a (mgr.14355) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: audit 2024-09-14T05:29:08.970571+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:29:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: audit 2024-09-14T05:29:08.971726+0000 mon.a (mon.0) 3357 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:29:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: audit 2024-09-14T05:29:08.978691+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:29:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: audit 2024-09-14T05:29:08.981014+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:09.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:09 smithi131 bash[24745]: audit 2024-09-14T05:29:08.983322+0000 mgr.a (mgr.14355) 18517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:29:10.198 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:10.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:10.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:10.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:10.198 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22972]: debug 2024-09-14T05:29:09.722+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:29:10.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:29:09 smithi007 bash[22972]: debug 2024-09-14T05:29:09.722+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:29:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:10 smithi007 bash[22722]: audit 2024-09-14T05:29:09.728864+0000 mgr.a (mgr.14355) 18518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:29:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:10 smithi007 bash[22722]: cephadm 2024-09-14T05:29:09.730065+0000 mgr.a (mgr.14355) 18519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:29:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:10 smithi007 bash[22722]: audit 2024-09-14T05:29:09.789503+0000 mgr.a (mgr.14355) 18520 : audit [DBG] from='client.397464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:10 smithi131 bash[24745]: audit 2024-09-14T05:29:09.728864+0000 mgr.a (mgr.14355) 18518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:29:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:10 smithi131 bash[24745]: cephadm 2024-09-14T05:29:09.730065+0000 mgr.a (mgr.14355) 18519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:29:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:10 smithi131 bash[24745]: audit 2024-09-14T05:29:09.789503+0000 mgr.a (mgr.14355) 18520 : audit [DBG] from='client.397464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:10 smithi171 bash[25040]: audit 2024-09-14T05:29:09.728864+0000 mgr.a (mgr.14355) 18518 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:29:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:10 smithi171 bash[25040]: cephadm 2024-09-14T05:29:09.730065+0000 mgr.a (mgr.14355) 18519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:29:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:10 smithi171 bash[25040]: audit 2024-09-14T05:29:09.789503+0000 mgr.a (mgr.14355) 18520 : audit [DBG] from='client.397464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:11 smithi007 bash[22722]: cluster 2024-09-14T05:29:10.191479+0000 mgr.a (mgr.14355) 18521 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:11 smithi131 bash[24745]: cluster 2024-09-14T05:29:10.191479+0000 mgr.a (mgr.14355) 18521 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:11 smithi171 bash[25040]: cluster 2024-09-14T05:29:10.191479+0000 mgr.a (mgr.14355) 18521 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:13 smithi007 bash[22722]: cluster 2024-09-14T05:29:12.193671+0000 mgr.a (mgr.14355) 18522 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:13 smithi131 bash[24745]: cluster 2024-09-14T05:29:12.193671+0000 mgr.a (mgr.14355) 18522 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:13 smithi171 bash[25040]: cluster 2024-09-14T05:29:12.193671+0000 mgr.a (mgr.14355) 18522 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:15.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:15.200 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:15 smithi007 bash[22722]: cluster 2024-09-14T05:29:14.194510+0000 mgr.a (mgr.14355) 18523 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:15 smithi131 bash[24745]: cluster 2024-09-14T05:29:14.194510+0000 mgr.a (mgr.14355) 18523 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:15 smithi171 bash[25040]: cluster 2024-09-14T05:29:14.194510+0000 mgr.a (mgr.14355) 18523 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:15.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:15.977 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:16 smithi007 bash[22722]: audit 2024-09-14T05:29:15.538796+0000 mgr.a (mgr.14355) 18524 : audit [DBG] from='client.397557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:16 smithi131 bash[24745]: audit 2024-09-14T05:29:15.538796+0000 mgr.a (mgr.14355) 18524 : audit [DBG] from='client.397557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:16 smithi171 bash[25040]: audit 2024-09-14T05:29:15.538796+0000 mgr.a (mgr.14355) 18524 : audit [DBG] from='client.397557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:17 smithi007 bash[22722]: cluster 2024-09-14T05:29:16.197480+0000 mgr.a (mgr.14355) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:17 smithi131 bash[24745]: cluster 2024-09-14T05:29:16.197480+0000 mgr.a (mgr.14355) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:17 smithi171 bash[25040]: cluster 2024-09-14T05:29:16.197480+0000 mgr.a (mgr.14355) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:19 smithi007 bash[22722]: cluster 2024-09-14T05:29:18.198342+0000 mgr.a (mgr.14355) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:19 smithi131 bash[24745]: cluster 2024-09-14T05:29:18.198342+0000 mgr.a (mgr.14355) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:19 smithi171 bash[25040]: cluster 2024-09-14T05:29:18.198342+0000 mgr.a (mgr.14355) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:20.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:21 smithi007 bash[22722]: cluster 2024-09-14T05:29:20.199132+0000 mgr.a (mgr.14355) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:21.726 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:21.727 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:21 smithi131 bash[24745]: cluster 2024-09-14T05:29:20.199132+0000 mgr.a (mgr.14355) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:21 smithi171 bash[25040]: cluster 2024-09-14T05:29:20.199132+0000 mgr.a (mgr.14355) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:29:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:22 smithi007 bash[22722]: audit 2024-09-14T05:29:21.312126+0000 mgr.a (mgr.14355) 18528 : audit [DBG] from='client.397632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:22 smithi131 bash[24745]: audit 2024-09-14T05:29:21.312126+0000 mgr.a (mgr.14355) 18528 : audit [DBG] from='client.397632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:22 smithi171 bash[25040]: audit 2024-09-14T05:29:21.312126+0000 mgr.a (mgr.14355) 18528 : audit [DBG] from='client.397632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:23 smithi007 bash[22722]: cluster 2024-09-14T05:29:22.202012+0000 mgr.a (mgr.14355) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:23 smithi131 bash[24745]: cluster 2024-09-14T05:29:22.202012+0000 mgr.a (mgr.14355) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:23 smithi171 bash[25040]: cluster 2024-09-14T05:29:22.202012+0000 mgr.a (mgr.14355) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:29:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:25 smithi007 bash[22722]: cluster 2024-09-14T05:29:24.202812+0000 mgr.a (mgr.14355) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:29:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:25 smithi131 bash[24745]: cluster 2024-09-14T05:29:24.202812+0000 mgr.a (mgr.14355) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:29:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:25 smithi171 bash[25040]: cluster 2024-09-14T05:29:24.202812+0000 mgr.a (mgr.14355) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:29:26.728 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:26.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:26.729 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:27.517 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:27.517 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:27.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:27 smithi007 bash[22722]: cluster 2024-09-14T05:29:26.204795+0000 mgr.a (mgr.14355) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:27 smithi131 bash[24745]: cluster 2024-09-14T05:29:26.204795+0000 mgr.a (mgr.14355) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:27 smithi171 bash[25040]: cluster 2024-09-14T05:29:26.204795+0000 mgr.a (mgr.14355) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:28 smithi007 bash[22722]: audit 2024-09-14T05:29:27.067186+0000 mgr.a (mgr.14355) 18532 : audit [DBG] from='client.397710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:28 smithi131 bash[24745]: audit 2024-09-14T05:29:27.067186+0000 mgr.a (mgr.14355) 18532 : audit [DBG] from='client.397710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:28 smithi171 bash[25040]: audit 2024-09-14T05:29:27.067186+0000 mgr.a (mgr.14355) 18532 : audit [DBG] from='client.397710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:29 smithi007 bash[22722]: cluster 2024-09-14T05:29:28.205765+0000 mgr.a (mgr.14355) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:29 smithi131 bash[24745]: cluster 2024-09-14T05:29:28.205765+0000 mgr.a (mgr.14355) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:29 smithi171 bash[25040]: cluster 2024-09-14T05:29:28.205765+0000 mgr.a (mgr.14355) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:31 smithi007 bash[22722]: cluster 2024-09-14T05:29:30.206571+0000 mgr.a (mgr.14355) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:31 smithi131 bash[24745]: cluster 2024-09-14T05:29:30.206571+0000 mgr.a (mgr.14355) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:31 smithi171 bash[25040]: cluster 2024-09-14T05:29:30.206571+0000 mgr.a (mgr.14355) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:33.273 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:33.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:33.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:33.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:33.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:33 smithi007 bash[22722]: cluster 2024-09-14T05:29:32.208842+0000 mgr.a (mgr.14355) 18535 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:33 smithi007 bash[22722]: audit 2024-09-14T05:29:32.849303+0000 mgr.a (mgr.14355) 18536 : audit [DBG] from='client.397788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:33 smithi131 bash[24745]: cluster 2024-09-14T05:29:32.208842+0000 mgr.a (mgr.14355) 18535 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:33 smithi131 bash[24745]: audit 2024-09-14T05:29:32.849303+0000 mgr.a (mgr.14355) 18536 : audit [DBG] from='client.397788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:33 smithi171 bash[25040]: cluster 2024-09-14T05:29:32.208842+0000 mgr.a (mgr.14355) 18535 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:33 smithi171 bash[25040]: audit 2024-09-14T05:29:32.849303+0000 mgr.a (mgr.14355) 18536 : audit [DBG] from='client.397788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:35 smithi007 bash[22722]: cluster 2024-09-14T05:29:34.209834+0000 mgr.a (mgr.14355) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:35 smithi131 bash[24745]: cluster 2024-09-14T05:29:34.209834+0000 mgr.a (mgr.14355) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:35 smithi171 bash[25040]: cluster 2024-09-14T05:29:34.209834+0000 mgr.a (mgr.14355) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:37 smithi007 bash[22722]: cluster 2024-09-14T05:29:36.212056+0000 mgr.a (mgr.14355) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:37 smithi131 bash[24745]: cluster 2024-09-14T05:29:36.212056+0000 mgr.a (mgr.14355) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:37 smithi171 bash[25040]: cluster 2024-09-14T05:29:36.212056+0000 mgr.a (mgr.14355) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:38.274 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:38.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:38.275 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:39.054 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:39.054 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:39 smithi007 bash[22722]: cluster 2024-09-14T05:29:38.212812+0000 mgr.a (mgr.14355) 18539 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:39 smithi007 bash[22722]: audit 2024-09-14T05:29:38.609581+0000 mgr.a (mgr.14355) 18540 : audit [DBG] from='client.397863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:39 smithi131 bash[24745]: cluster 2024-09-14T05:29:38.212812+0000 mgr.a (mgr.14355) 18539 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:39 smithi131 bash[24745]: audit 2024-09-14T05:29:38.609581+0000 mgr.a (mgr.14355) 18540 : audit [DBG] from='client.397863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:39 smithi171 bash[25040]: cluster 2024-09-14T05:29:38.212812+0000 mgr.a (mgr.14355) 18539 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:39 smithi171 bash[25040]: audit 2024-09-14T05:29:38.609581+0000 mgr.a (mgr.14355) 18540 : audit [DBG] from='client.397863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:41 smithi007 bash[22722]: cluster 2024-09-14T05:29:40.213769+0000 mgr.a (mgr.14355) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:41 smithi131 bash[24745]: cluster 2024-09-14T05:29:40.213769+0000 mgr.a (mgr.14355) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:41 smithi171 bash[25040]: cluster 2024-09-14T05:29:40.213769+0000 mgr.a (mgr.14355) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:43 smithi007 bash[22722]: cluster 2024-09-14T05:29:42.216057+0000 mgr.a (mgr.14355) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:43 smithi131 bash[24745]: cluster 2024-09-14T05:29:42.216057+0000 mgr.a (mgr.14355) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:43 smithi171 bash[25040]: cluster 2024-09-14T05:29:42.216057+0000 mgr.a (mgr.14355) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:44.056 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:44.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:44.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:44.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:45 smithi007 bash[22722]: cluster 2024-09-14T05:29:44.216968+0000 mgr.a (mgr.14355) 18543 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:45 smithi007 bash[22722]: audit 2024-09-14T05:29:44.392023+0000 mgr.a (mgr.14355) 18544 : audit [DBG] from='client.397941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:45 smithi131 bash[24745]: cluster 2024-09-14T05:29:44.216968+0000 mgr.a (mgr.14355) 18543 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:45 smithi131 bash[24745]: audit 2024-09-14T05:29:44.392023+0000 mgr.a (mgr.14355) 18544 : audit [DBG] from='client.397941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:45 smithi171 bash[25040]: cluster 2024-09-14T05:29:44.216968+0000 mgr.a (mgr.14355) 18543 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:45 smithi171 bash[25040]: audit 2024-09-14T05:29:44.392023+0000 mgr.a (mgr.14355) 18544 : audit [DBG] from='client.397941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:47 smithi007 bash[22722]: cluster 2024-09-14T05:29:46.219354+0000 mgr.a (mgr.14355) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:47 smithi131 bash[24745]: cluster 2024-09-14T05:29:46.219354+0000 mgr.a (mgr.14355) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:47 smithi171 bash[25040]: cluster 2024-09-14T05:29:46.219354+0000 mgr.a (mgr.14355) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:29:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:49 smithi007 bash[22722]: cluster 2024-09-14T05:29:48.220277+0000 mgr.a (mgr.14355) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:49 smithi131 bash[24745]: cluster 2024-09-14T05:29:48.220277+0000 mgr.a (mgr.14355) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:49 smithi171 bash[25040]: cluster 2024-09-14T05:29:48.220277+0000 mgr.a (mgr.14355) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:49.815 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:49.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:49.816 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:50.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:51 smithi007 bash[22722]: audit 2024-09-14T05:29:50.146995+0000 mgr.a (mgr.14355) 18547 : audit [DBG] from='client.398019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:51 smithi007 bash[22722]: cluster 2024-09-14T05:29:50.220876+0000 mgr.a (mgr.14355) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:51 smithi131 bash[24745]: audit 2024-09-14T05:29:50.146995+0000 mgr.a (mgr.14355) 18547 : audit [DBG] from='client.398019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:51 smithi131 bash[24745]: cluster 2024-09-14T05:29:50.220876+0000 mgr.a (mgr.14355) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:51 smithi171 bash[25040]: audit 2024-09-14T05:29:50.146995+0000 mgr.a (mgr.14355) 18547 : audit [DBG] from='client.398019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:51 smithi171 bash[25040]: cluster 2024-09-14T05:29:50.220876+0000 mgr.a (mgr.14355) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:53 smithi007 bash[22722]: cluster 2024-09-14T05:29:52.223290+0000 mgr.a (mgr.14355) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:29:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:53 smithi131 bash[24745]: cluster 2024-09-14T05:29:52.223290+0000 mgr.a (mgr.14355) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:29:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:53 smithi171 bash[25040]: cluster 2024-09-14T05:29:52.223290+0000 mgr.a (mgr.14355) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:29:55.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:29:55.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:29:55.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:29:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:55 smithi007 bash[22722]: cluster 2024-09-14T05:29:54.224094+0000 mgr.a (mgr.14355) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:29:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:55 smithi131 bash[24745]: cluster 2024-09-14T05:29:54.224094+0000 mgr.a (mgr.14355) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:29:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:55 smithi171 bash[25040]: cluster 2024-09-14T05:29:54.224094+0000 mgr.a (mgr.14355) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:29:56.326 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:29:56.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:29:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:29:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:29:56.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:29:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:56 smithi007 bash[22722]: audit 2024-09-14T05:29:55.902896+0000 mgr.a (mgr.14355) 18551 : audit [DBG] from='client.398097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:56 smithi131 bash[24745]: audit 2024-09-14T05:29:55.902896+0000 mgr.a (mgr.14355) 18551 : audit [DBG] from='client.398097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:56 smithi171 bash[25040]: audit 2024-09-14T05:29:55.902896+0000 mgr.a (mgr.14355) 18551 : audit [DBG] from='client.398097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:29:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:57 smithi007 bash[22722]: cluster 2024-09-14T05:29:56.229385+0000 mgr.a (mgr.14355) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:57 smithi131 bash[24745]: cluster 2024-09-14T05:29:56.229385+0000 mgr.a (mgr.14355) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:57 smithi171 bash[25040]: cluster 2024-09-14T05:29:56.229385+0000 mgr.a (mgr.14355) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:29:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:29:59 smithi007 bash[22722]: cluster 2024-09-14T05:29:58.230190+0000 mgr.a (mgr.14355) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:29:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:29:59 smithi131 bash[24745]: cluster 2024-09-14T05:29:58.230190+0000 mgr.a (mgr.14355) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:29:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:29:59 smithi171 bash[25040]: cluster 2024-09-14T05:29:58.230190+0000 mgr.a (mgr.14355) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:00 smithi007 bash[22722]: cluster 2024-09-14T05:30:00.000144+0000 mon.a (mon.0) 3360 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:30:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:00 smithi131 bash[24745]: cluster 2024-09-14T05:30:00.000144+0000 mon.a (mon.0) 3360 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:30:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:00 smithi171 bash[25040]: cluster 2024-09-14T05:30:00.000144+0000 mon.a (mon.0) 3360 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:30:01.328 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:01.329 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:01 smithi007 bash[22722]: cluster 2024-09-14T05:30:00.231105+0000 mgr.a (mgr.14355) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:01 smithi131 bash[24745]: cluster 2024-09-14T05:30:00.231105+0000 mgr.a (mgr.14355) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:01 smithi171 bash[25040]: cluster 2024-09-14T05:30:00.231105+0000 mgr.a (mgr.14355) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:02.065 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:02 smithi007 bash[22722]: audit 2024-09-14T05:30:01.659450+0000 mgr.a (mgr.14355) 18555 : audit [DBG] from='client.398169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:02 smithi131 bash[24745]: audit 2024-09-14T05:30:01.659450+0000 mgr.a (mgr.14355) 18555 : audit [DBG] from='client.398169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:02 smithi171 bash[25040]: audit 2024-09-14T05:30:01.659450+0000 mgr.a (mgr.14355) 18555 : audit [DBG] from='client.398169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:03.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:03 smithi007 bash[22722]: cluster 2024-09-14T05:30:02.233879+0000 mgr.a (mgr.14355) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:03 smithi131 bash[24745]: cluster 2024-09-14T05:30:02.233879+0000 mgr.a (mgr.14355) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:03 smithi171 bash[25040]: cluster 2024-09-14T05:30:02.233879+0000 mgr.a (mgr.14355) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:05 smithi007 bash[22722]: cluster 2024-09-14T05:30:04.234682+0000 mgr.a (mgr.14355) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:30:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:05 smithi131 bash[24745]: cluster 2024-09-14T05:30:04.234682+0000 mgr.a (mgr.14355) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:30:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:05 smithi171 bash[25040]: cluster 2024-09-14T05:30:04.234682+0000 mgr.a (mgr.14355) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:30:07.065 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:07.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:07.066 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:07 smithi131 bash[24745]: cluster 2024-09-14T05:30:06.236612+0000 mgr.a (mgr.14355) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:30:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:07 smithi171 bash[25040]: cluster 2024-09-14T05:30:06.236612+0000 mgr.a (mgr.14355) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:30:07.840 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:07.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:07.841 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:07 smithi007 bash[22722]: cluster 2024-09-14T05:30:06.236612+0000 mgr.a (mgr.14355) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:30:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:08 smithi131 bash[24745]: audit 2024-09-14T05:30:07.395110+0000 mgr.a (mgr.14355) 18559 : audit [DBG] from='client.398247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:08 smithi171 bash[25040]: audit 2024-09-14T05:30:07.395110+0000 mgr.a (mgr.14355) 18559 : audit [DBG] from='client.398247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:08.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:08 smithi007 bash[22722]: audit 2024-09-14T05:30:07.395110+0000 mgr.a (mgr.14355) 18559 : audit [DBG] from='client.398247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:09 smithi131 bash[24745]: cluster 2024-09-14T05:30:08.237569+0000 mgr.a (mgr.14355) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:09 smithi171 bash[25040]: cluster 2024-09-14T05:30:08.237569+0000 mgr.a (mgr.14355) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:09 smithi007 bash[22722]: cluster 2024-09-14T05:30:08.237569+0000 mgr.a (mgr.14355) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:10 smithi131 bash[24745]: audit 2024-09-14T05:30:09.780919+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:30:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:10 smithi171 bash[25040]: audit 2024-09-14T05:30:09.780919+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:30:10.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:10 smithi007 bash[22722]: audit 2024-09-14T05:30:09.780919+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:30:11.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22972]: debug 2024-09-14T05:30:11.385+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:30:11.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22972]: debug 2024-09-14T05:30:11.389+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: cluster 2024-09-14T05:30:10.238328+0000 mgr.a (mgr.14355) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: audit 2024-09-14T05:30:10.612320+0000 mon.a (mon.0) 3362 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: audit 2024-09-14T05:30:10.613767+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: audit 2024-09-14T05:30:10.623846+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: audit 2024-09-14T05:30:10.628613+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:11.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:11 smithi007 bash[22722]: audit 2024-09-14T05:30:10.630921+0000 mgr.a (mgr.14355) 18562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: cluster 2024-09-14T05:30:10.238328+0000 mgr.a (mgr.14355) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: audit 2024-09-14T05:30:10.612320+0000 mon.a (mon.0) 3362 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:30:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: audit 2024-09-14T05:30:10.613767+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:30:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: audit 2024-09-14T05:30:10.623846+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:30:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: audit 2024-09-14T05:30:10.628613+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:11 smithi131 bash[24745]: audit 2024-09-14T05:30:10.630921+0000 mgr.a (mgr.14355) 18562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: cluster 2024-09-14T05:30:10.238328+0000 mgr.a (mgr.14355) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: audit 2024-09-14T05:30:10.612320+0000 mon.a (mon.0) 3362 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: audit 2024-09-14T05:30:10.613767+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: audit 2024-09-14T05:30:10.623846+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: audit 2024-09-14T05:30:10.628613+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:11.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:11 smithi171 bash[25040]: audit 2024-09-14T05:30:10.630921+0000 mgr.a (mgr.14355) 18562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:30:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:12 smithi131 bash[24745]: audit 2024-09-14T05:30:11.389251+0000 mgr.a (mgr.14355) 18563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:30:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:12 smithi131 bash[24745]: cephadm 2024-09-14T05:30:11.390438+0000 mgr.a (mgr.14355) 18564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:30:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:12 smithi171 bash[25040]: audit 2024-09-14T05:30:11.389251+0000 mgr.a (mgr.14355) 18563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:30:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:12 smithi171 bash[25040]: cephadm 2024-09-14T05:30:11.390438+0000 mgr.a (mgr.14355) 18564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:30:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:12 smithi007 bash[22722]: audit 2024-09-14T05:30:11.389251+0000 mgr.a (mgr.14355) 18563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:30:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:12 smithi007 bash[22722]: cephadm 2024-09-14T05:30:11.390438+0000 mgr.a (mgr.14355) 18564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:30:13.630 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:13 smithi131 bash[24745]: cluster 2024-09-14T05:30:12.241092+0000 mgr.a (mgr.14355) 18565 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:13 smithi171 bash[25040]: cluster 2024-09-14T05:30:12.241092+0000 mgr.a (mgr.14355) 18565 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:13 smithi007 bash[22722]: cluster 2024-09-14T05:30:12.241092+0000 mgr.a (mgr.14355) 18565 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:14 smithi131 bash[24745]: audit 2024-09-14T05:30:13.182823+0000 mgr.a (mgr.14355) 18566 : audit [DBG] from='client.398430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:14.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:14 smithi171 bash[25040]: audit 2024-09-14T05:30:13.182823+0000 mgr.a (mgr.14355) 18566 : audit [DBG] from='client.398430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:14 smithi007 bash[22722]: audit 2024-09-14T05:30:13.182823+0000 mgr.a (mgr.14355) 18566 : audit [DBG] from='client.398430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:15 smithi131 bash[24745]: cluster 2024-09-14T05:30:14.242097+0000 mgr.a (mgr.14355) 18567 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:15 smithi171 bash[25040]: cluster 2024-09-14T05:30:14.242097+0000 mgr.a (mgr.14355) 18567 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:15 smithi007 bash[22722]: cluster 2024-09-14T05:30:14.242097+0000 mgr.a (mgr.14355) 18567 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:17 smithi131 bash[24745]: cluster 2024-09-14T05:30:16.244318+0000 mgr.a (mgr.14355) 18568 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:17 smithi171 bash[25040]: cluster 2024-09-14T05:30:16.244318+0000 mgr.a (mgr.14355) 18568 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:17 smithi007 bash[22722]: cluster 2024-09-14T05:30:16.244318+0000 mgr.a (mgr.14355) 18568 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:18.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:18.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:19.411 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:19.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:19.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:19 smithi131 bash[24745]: cluster 2024-09-14T05:30:18.245086+0000 mgr.a (mgr.14355) 18569 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:19 smithi131 bash[24745]: audit 2024-09-14T05:30:18.964487+0000 mgr.a (mgr.14355) 18570 : audit [DBG] from='client.398508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:19 smithi171 bash[25040]: cluster 2024-09-14T05:30:18.245086+0000 mgr.a (mgr.14355) 18569 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:19 smithi171 bash[25040]: audit 2024-09-14T05:30:18.964487+0000 mgr.a (mgr.14355) 18570 : audit [DBG] from='client.398508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:19 smithi007 bash[22722]: cluster 2024-09-14T05:30:18.245086+0000 mgr.a (mgr.14355) 18569 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:19 smithi007 bash[22722]: audit 2024-09-14T05:30:18.964487+0000 mgr.a (mgr.14355) 18570 : audit [DBG] from='client.398508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:21 smithi131 bash[24745]: cluster 2024-09-14T05:30:20.246041+0000 mgr.a (mgr.14355) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:21 smithi171 bash[25040]: cluster 2024-09-14T05:30:20.246041+0000 mgr.a (mgr.14355) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:21 smithi007 bash[22722]: cluster 2024-09-14T05:30:20.246041+0000 mgr.a (mgr.14355) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:23 smithi131 bash[24745]: cluster 2024-09-14T05:30:22.248387+0000 mgr.a (mgr.14355) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:23 smithi171 bash[25040]: cluster 2024-09-14T05:30:22.248387+0000 mgr.a (mgr.14355) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:23 smithi007 bash[22722]: cluster 2024-09-14T05:30:22.248387+0000 mgr.a (mgr.14355) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:24.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:24.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:24.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:25.168 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:25.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:25 smithi131 bash[24745]: cluster 2024-09-14T05:30:24.249170+0000 mgr.a (mgr.14355) 18573 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:25 smithi131 bash[24745]: audit 2024-09-14T05:30:24.744334+0000 mgr.a (mgr.14355) 18574 : audit [DBG] from='client.398580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:25 smithi171 bash[25040]: cluster 2024-09-14T05:30:24.249170+0000 mgr.a (mgr.14355) 18573 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:25 smithi171 bash[25040]: audit 2024-09-14T05:30:24.744334+0000 mgr.a (mgr.14355) 18574 : audit [DBG] from='client.398580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:25 smithi007 bash[22722]: cluster 2024-09-14T05:30:24.249170+0000 mgr.a (mgr.14355) 18573 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:25 smithi007 bash[22722]: audit 2024-09-14T05:30:24.744334+0000 mgr.a (mgr.14355) 18574 : audit [DBG] from='client.398580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:27 smithi131 bash[24745]: cluster 2024-09-14T05:30:26.251576+0000 mgr.a (mgr.14355) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:27 smithi171 bash[25040]: cluster 2024-09-14T05:30:26.251576+0000 mgr.a (mgr.14355) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:27 smithi007 bash[22722]: cluster 2024-09-14T05:30:26.251576+0000 mgr.a (mgr.14355) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:30:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:29 smithi171 bash[25040]: cluster 2024-09-14T05:30:28.252390+0000 mgr.a (mgr.14355) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:29 smithi007 bash[22722]: cluster 2024-09-14T05:30:28.252390+0000 mgr.a (mgr.14355) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:29 smithi131 bash[24745]: cluster 2024-09-14T05:30:28.252390+0000 mgr.a (mgr.14355) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:30.169 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:30.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:30.170 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:30.919 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:30.920 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:31 smithi171 bash[25040]: cluster 2024-09-14T05:30:30.253172+0000 mgr.a (mgr.14355) 18577 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:31.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:31 smithi171 bash[25040]: audit 2024-09-14T05:30:30.497099+0000 mgr.a (mgr.14355) 18578 : audit [DBG] from='client.398655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:31 smithi007 bash[22722]: cluster 2024-09-14T05:30:30.253172+0000 mgr.a (mgr.14355) 18577 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:31 smithi007 bash[22722]: audit 2024-09-14T05:30:30.497099+0000 mgr.a (mgr.14355) 18578 : audit [DBG] from='client.398655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:31 smithi131 bash[24745]: cluster 2024-09-14T05:30:30.253172+0000 mgr.a (mgr.14355) 18577 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:31 smithi131 bash[24745]: audit 2024-09-14T05:30:30.497099+0000 mgr.a (mgr.14355) 18578 : audit [DBG] from='client.398655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:33 smithi171 bash[25040]: cluster 2024-09-14T05:30:32.255961+0000 mgr.a (mgr.14355) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:33 smithi007 bash[22722]: cluster 2024-09-14T05:30:32.255961+0000 mgr.a (mgr.14355) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:33 smithi131 bash[24745]: cluster 2024-09-14T05:30:32.255961+0000 mgr.a (mgr.14355) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:35.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:35.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:35.922 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:35 smithi007 bash[22722]: cluster 2024-09-14T05:30:34.256742+0000 mgr.a (mgr.14355) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:35 smithi131 bash[24745]: cluster 2024-09-14T05:30:34.256742+0000 mgr.a (mgr.14355) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:35 smithi171 bash[25040]: cluster 2024-09-14T05:30:34.256742+0000 mgr.a (mgr.14355) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:36.675 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:36.675 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:36.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:37 smithi007 bash[22722]: audit 2024-09-14T05:30:36.251005+0000 mgr.a (mgr.14355) 18581 : audit [DBG] from='client.398733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:37 smithi007 bash[22722]: cluster 2024-09-14T05:30:36.271508+0000 mgr.a (mgr.14355) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:37 smithi131 bash[24745]: audit 2024-09-14T05:30:36.251005+0000 mgr.a (mgr.14355) 18581 : audit [DBG] from='client.398733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:37 smithi131 bash[24745]: cluster 2024-09-14T05:30:36.271508+0000 mgr.a (mgr.14355) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:37 smithi171 bash[25040]: audit 2024-09-14T05:30:36.251005+0000 mgr.a (mgr.14355) 18581 : audit [DBG] from='client.398733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:37 smithi171 bash[25040]: cluster 2024-09-14T05:30:36.271508+0000 mgr.a (mgr.14355) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:39 smithi007 bash[22722]: cluster 2024-09-14T05:30:38.272662+0000 mgr.a (mgr.14355) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T05:30:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:39 smithi131 bash[24745]: cluster 2024-09-14T05:30:38.272662+0000 mgr.a (mgr.14355) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T05:30:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:39 smithi171 bash[25040]: cluster 2024-09-14T05:30:38.272662+0000 mgr.a (mgr.14355) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-14T05:30:41.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:41.677 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:41 smithi007 bash[22722]: cluster 2024-09-14T05:30:40.273475+0000 mgr.a (mgr.14355) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:41 smithi131 bash[24745]: cluster 2024-09-14T05:30:40.273475+0000 mgr.a (mgr.14355) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:41 smithi171 bash[25040]: cluster 2024-09-14T05:30:40.273475+0000 mgr.a (mgr.14355) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:30:42.425 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:42.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:42.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:42.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:42.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:43.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:42 smithi007 bash[22722]: audit 2024-09-14T05:30:42.007630+0000 mgr.a (mgr.14355) 18585 : audit [DBG] from='client.398811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:42 smithi131 bash[24745]: audit 2024-09-14T05:30:42.007630+0000 mgr.a (mgr.14355) 18585 : audit [DBG] from='client.398811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:42 smithi171 bash[25040]: audit 2024-09-14T05:30:42.007630+0000 mgr.a (mgr.14355) 18585 : audit [DBG] from='client.398811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:43 smithi007 bash[22722]: cluster 2024-09-14T05:30:42.274756+0000 mgr.a (mgr.14355) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:43 smithi131 bash[24745]: cluster 2024-09-14T05:30:42.274756+0000 mgr.a (mgr.14355) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:43 smithi171 bash[25040]: cluster 2024-09-14T05:30:42.274756+0000 mgr.a (mgr.14355) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:45 smithi007 bash[22722]: cluster 2024-09-14T05:30:44.275582+0000 mgr.a (mgr.14355) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:45 smithi131 bash[24745]: cluster 2024-09-14T05:30:44.275582+0000 mgr.a (mgr.14355) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:45 smithi171 bash[25040]: cluster 2024-09-14T05:30:44.275582+0000 mgr.a (mgr.14355) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:47.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:47.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:47 smithi007 bash[22722]: cluster 2024-09-14T05:30:46.277851+0000 mgr.a (mgr.14355) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:48.210 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:48.210 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:47 smithi131 bash[24745]: cluster 2024-09-14T05:30:46.277851+0000 mgr.a (mgr.14355) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:47 smithi171 bash[25040]: cluster 2024-09-14T05:30:46.277851+0000 mgr.a (mgr.14355) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:49.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:48 smithi131 bash[24745]: audit 2024-09-14T05:30:47.765268+0000 mgr.a (mgr.14355) 18589 : audit [DBG] from='client.398889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:49.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:48 smithi171 bash[25040]: audit 2024-09-14T05:30:47.765268+0000 mgr.a (mgr.14355) 18589 : audit [DBG] from='client.398889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:48 smithi007 bash[22722]: audit 2024-09-14T05:30:47.765268+0000 mgr.a (mgr.14355) 18589 : audit [DBG] from='client.398889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:49 smithi131 bash[24745]: cluster 2024-09-14T05:30:48.278824+0000 mgr.a (mgr.14355) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:49 smithi171 bash[25040]: cluster 2024-09-14T05:30:48.278824+0000 mgr.a (mgr.14355) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:49 smithi007 bash[22722]: cluster 2024-09-14T05:30:48.278824+0000 mgr.a (mgr.14355) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:51 smithi131 bash[24745]: cluster 2024-09-14T05:30:50.279609+0000 mgr.a (mgr.14355) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:51 smithi171 bash[25040]: cluster 2024-09-14T05:30:50.279609+0000 mgr.a (mgr.14355) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:51 smithi007 bash[22722]: cluster 2024-09-14T05:30:50.279609+0000 mgr.a (mgr.14355) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:53.211 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:53.212 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:53.213 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:54.003 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:54.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:54.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:54.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:54.003 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:30:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:53 smithi131 bash[24745]: cluster 2024-09-14T05:30:52.282046+0000 mgr.a (mgr.14355) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:53 smithi171 bash[25040]: cluster 2024-09-14T05:30:52.282046+0000 mgr.a (mgr.14355) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:53 smithi007 bash[22722]: cluster 2024-09-14T05:30:52.282046+0000 mgr.a (mgr.14355) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:55.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:54 smithi131 bash[24745]: audit 2024-09-14T05:30:53.552487+0000 mgr.a (mgr.14355) 18593 : audit [DBG] from='client.398967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:55.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:54 smithi171 bash[25040]: audit 2024-09-14T05:30:53.552487+0000 mgr.a (mgr.14355) 18593 : audit [DBG] from='client.398967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:54 smithi007 bash[22722]: audit 2024-09-14T05:30:53.552487+0000 mgr.a (mgr.14355) 18593 : audit [DBG] from='client.398967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:30:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:55 smithi131 bash[24745]: cluster 2024-09-14T05:30:54.283257+0000 mgr.a (mgr.14355) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:55 smithi171 bash[25040]: cluster 2024-09-14T05:30:54.283257+0000 mgr.a (mgr.14355) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:55 smithi007 bash[22722]: cluster 2024-09-14T05:30:54.283257+0000 mgr.a (mgr.14355) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:30:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:57 smithi131 bash[24745]: cluster 2024-09-14T05:30:56.285559+0000 mgr.a (mgr.14355) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:57 smithi171 bash[25040]: cluster 2024-09-14T05:30:56.285559+0000 mgr.a (mgr.14355) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:57 smithi007 bash[22722]: cluster 2024-09-14T05:30:56.285559+0000 mgr.a (mgr.14355) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:30:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:30:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:30:59.009 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:30:59.777 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:30:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:30:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:30:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:30:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:30:59 smithi131 bash[24745]: cluster 2024-09-14T05:30:58.286470+0000 mgr.a (mgr.14355) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:30:59 smithi171 bash[25040]: cluster 2024-09-14T05:30:58.286470+0000 mgr.a (mgr.14355) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:30:59 smithi007 bash[22722]: cluster 2024-09-14T05:30:58.286470+0000 mgr.a (mgr.14355) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:01 smithi131 bash[24745]: audit 2024-09-14T05:30:59.341604+0000 mgr.a (mgr.14355) 18597 : audit [DBG] from='client.399045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:01 smithi171 bash[25040]: audit 2024-09-14T05:30:59.341604+0000 mgr.a (mgr.14355) 18597 : audit [DBG] from='client.399045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:01 smithi007 bash[22722]: audit 2024-09-14T05:30:59.341604+0000 mgr.a (mgr.14355) 18597 : audit [DBG] from='client.399045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:02 smithi131 bash[24745]: cluster 2024-09-14T05:31:00.287398+0000 mgr.a (mgr.14355) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:02 smithi171 bash[25040]: cluster 2024-09-14T05:31:00.287398+0000 mgr.a (mgr.14355) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:02 smithi007 bash[22722]: cluster 2024-09-14T05:31:00.287398+0000 mgr.a (mgr.14355) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:04 smithi131 bash[24745]: cluster 2024-09-14T05:31:02.289684+0000 mgr.a (mgr.14355) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:04 smithi171 bash[25040]: cluster 2024-09-14T05:31:02.289684+0000 mgr.a (mgr.14355) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:04 smithi007 bash[22722]: cluster 2024-09-14T05:31:02.289684+0000 mgr.a (mgr.14355) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:04.778 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:04.779 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:05.532 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:05.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:05.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:05.533 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:06 smithi131 bash[24745]: cluster 2024-09-14T05:31:04.290491+0000 mgr.a (mgr.14355) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:06 smithi171 bash[25040]: cluster 2024-09-14T05:31:04.290491+0000 mgr.a (mgr.14355) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:06 smithi007 bash[22722]: cluster 2024-09-14T05:31:04.290491+0000 mgr.a (mgr.14355) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:07.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:07 smithi131 bash[24745]: audit 2024-09-14T05:31:05.109898+0000 mgr.a (mgr.14355) 18601 : audit [DBG] from='client.399123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:07.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:07 smithi171 bash[25040]: audit 2024-09-14T05:31:05.109898+0000 mgr.a (mgr.14355) 18601 : audit [DBG] from='client.399123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:07 smithi007 bash[22722]: audit 2024-09-14T05:31:05.109898+0000 mgr.a (mgr.14355) 18601 : audit [DBG] from='client.399123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:08 smithi131 bash[24745]: cluster 2024-09-14T05:31:06.292937+0000 mgr.a (mgr.14355) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:31:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:08 smithi171 bash[25040]: cluster 2024-09-14T05:31:06.292937+0000 mgr.a (mgr.14355) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:31:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:08 smithi007 bash[22722]: cluster 2024-09-14T05:31:06.292937+0000 mgr.a (mgr.14355) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:31:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:10 smithi131 bash[24745]: cluster 2024-09-14T05:31:08.293737+0000 mgr.a (mgr.14355) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:10 smithi171 bash[25040]: cluster 2024-09-14T05:31:08.293737+0000 mgr.a (mgr.14355) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:10 smithi007 bash[22722]: cluster 2024-09-14T05:31:08.293737+0000 mgr.a (mgr.14355) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:10.534 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:10.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:10.534 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:11.291 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:11.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:11.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:11.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:11.291 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:12 smithi131 bash[24745]: cluster 2024-09-14T05:31:10.294502+0000 mgr.a (mgr.14355) 18604 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:12 smithi131 bash[24745]: audit 2024-09-14T05:31:10.864649+0000 mgr.a (mgr.14355) 18605 : audit [DBG] from='client.399198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:12 smithi131 bash[24745]: audit 2024-09-14T05:31:11.445949+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:12 smithi171 bash[25040]: cluster 2024-09-14T05:31:10.294502+0000 mgr.a (mgr.14355) 18604 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:12 smithi171 bash[25040]: audit 2024-09-14T05:31:10.864649+0000 mgr.a (mgr.14355) 18605 : audit [DBG] from='client.399198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:12 smithi171 bash[25040]: audit 2024-09-14T05:31:11.445949+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:31:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:12 smithi007 bash[22722]: cluster 2024-09-14T05:31:10.294502+0000 mgr.a (mgr.14355) 18604 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:31:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:12 smithi007 bash[22722]: audit 2024-09-14T05:31:10.864649+0000 mgr.a (mgr.14355) 18605 : audit [DBG] from='client.399198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:12 smithi007 bash[22722]: audit 2024-09-14T05:31:11.445949+0000 mon.a (mon.0) 3366 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:31:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:13 smithi131 bash[24745]: audit 2024-09-14T05:31:12.264985+0000 mon.a (mon.0) 3367 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:31:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:13 smithi131 bash[24745]: audit 2024-09-14T05:31:12.266680+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:31:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:13 smithi131 bash[24745]: audit 2024-09-14T05:31:12.277048+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:31:13.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:13 smithi131 bash[24745]: audit 2024-09-14T05:31:12.282480+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:13 smithi171 bash[25040]: audit 2024-09-14T05:31:12.264985+0000 mon.a (mon.0) 3367 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:13 smithi171 bash[25040]: audit 2024-09-14T05:31:12.266680+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:13 smithi171 bash[25040]: audit 2024-09-14T05:31:12.277048+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:31:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:13 smithi171 bash[25040]: audit 2024-09-14T05:31:12.282480+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:13.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22972]: debug 2024-09-14T05:31:13.036+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:31:13.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22972]: debug 2024-09-14T05:31:13.036+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:31:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22722]: audit 2024-09-14T05:31:12.264985+0000 mon.a (mon.0) 3367 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:31:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22722]: audit 2024-09-14T05:31:12.266680+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:31:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22722]: audit 2024-09-14T05:31:12.277048+0000 mon.a (mon.0) 3369 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:31:13.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:13 smithi007 bash[22722]: audit 2024-09-14T05:31:12.282480+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:14 smithi171 bash[25040]: audit 2024-09-14T05:31:12.284982+0000 mgr.a (mgr.14355) 18606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:14 smithi171 bash[25040]: cluster 2024-09-14T05:31:12.305404+0000 mgr.a (mgr.14355) 18607 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:14 smithi171 bash[25040]: audit 2024-09-14T05:31:13.038443+0000 mgr.a (mgr.14355) 18608 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:31:14.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:14 smithi171 bash[25040]: cephadm 2024-09-14T05:31:13.040482+0000 mgr.a (mgr.14355) 18609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:31:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:14 smithi007 bash[22722]: audit 2024-09-14T05:31:12.284982+0000 mgr.a (mgr.14355) 18606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:14 smithi007 bash[22722]: cluster 2024-09-14T05:31:12.305404+0000 mgr.a (mgr.14355) 18607 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:14 smithi007 bash[22722]: audit 2024-09-14T05:31:13.038443+0000 mgr.a (mgr.14355) 18608 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:31:14.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:14 smithi007 bash[22722]: cephadm 2024-09-14T05:31:13.040482+0000 mgr.a (mgr.14355) 18609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:31:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:14 smithi131 bash[24745]: audit 2024-09-14T05:31:12.284982+0000 mgr.a (mgr.14355) 18606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:31:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:14 smithi131 bash[24745]: cluster 2024-09-14T05:31:12.305404+0000 mgr.a (mgr.14355) 18607 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:14 smithi131 bash[24745]: audit 2024-09-14T05:31:13.038443+0000 mgr.a (mgr.14355) 18608 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:31:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:14 smithi131 bash[24745]: cephadm 2024-09-14T05:31:13.040482+0000 mgr.a (mgr.14355) 18609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:31:16.292 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:16.293 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:16 smithi171 bash[25040]: cluster 2024-09-14T05:31:14.306444+0000 mgr.a (mgr.14355) 18610 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:16 smithi007 bash[22722]: cluster 2024-09-14T05:31:14.306444+0000 mgr.a (mgr.14355) 18610 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:16 smithi131 bash[24745]: cluster 2024-09-14T05:31:14.306444+0000 mgr.a (mgr.14355) 18610 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:17.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:17.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:17.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:17.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:18 smithi171 bash[25040]: cluster 2024-09-14T05:31:16.308498+0000 mgr.a (mgr.14355) 18611 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:18 smithi171 bash[25040]: audit 2024-09-14T05:31:16.626917+0000 mgr.a (mgr.14355) 18612 : audit [DBG] from='client.399381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:18 smithi007 bash[22722]: cluster 2024-09-14T05:31:16.308498+0000 mgr.a (mgr.14355) 18611 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:18 smithi007 bash[22722]: audit 2024-09-14T05:31:16.626917+0000 mgr.a (mgr.14355) 18612 : audit [DBG] from='client.399381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:18 smithi131 bash[24745]: cluster 2024-09-14T05:31:16.308498+0000 mgr.a (mgr.14355) 18611 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:18 smithi131 bash[24745]: audit 2024-09-14T05:31:16.626917+0000 mgr.a (mgr.14355) 18612 : audit [DBG] from='client.399381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:20 smithi007 bash[22722]: cluster 2024-09-14T05:31:18.309562+0000 mgr.a (mgr.14355) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:20 smithi131 bash[24745]: cluster 2024-09-14T05:31:18.309562+0000 mgr.a (mgr.14355) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:20 smithi171 bash[25040]: cluster 2024-09-14T05:31:18.309562+0000 mgr.a (mgr.14355) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:22.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:22.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:22.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:22 smithi007 bash[22722]: cluster 2024-09-14T05:31:20.311156+0000 mgr.a (mgr.14355) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:22 smithi131 bash[24745]: cluster 2024-09-14T05:31:20.311156+0000 mgr.a (mgr.14355) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:22 smithi171 bash[25040]: cluster 2024-09-14T05:31:20.311156+0000 mgr.a (mgr.14355) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:31:22.859 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:24 smithi007 bash[22722]: cluster 2024-09-14T05:31:22.312932+0000 mgr.a (mgr.14355) 18615 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:24 smithi007 bash[22722]: audit 2024-09-14T05:31:22.413005+0000 mgr.a (mgr.14355) 18616 : audit [DBG] from='client.399459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:24 smithi131 bash[24745]: cluster 2024-09-14T05:31:22.312932+0000 mgr.a (mgr.14355) 18615 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:24 smithi131 bash[24745]: audit 2024-09-14T05:31:22.413005+0000 mgr.a (mgr.14355) 18616 : audit [DBG] from='client.399459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:24 smithi171 bash[25040]: cluster 2024-09-14T05:31:22.312932+0000 mgr.a (mgr.14355) 18615 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:24 smithi171 bash[25040]: audit 2024-09-14T05:31:22.413005+0000 mgr.a (mgr.14355) 18616 : audit [DBG] from='client.399459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:26 smithi007 bash[22722]: cluster 2024-09-14T05:31:24.313866+0000 mgr.a (mgr.14355) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:26 smithi131 bash[24745]: cluster 2024-09-14T05:31:24.313866+0000 mgr.a (mgr.14355) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:26 smithi171 bash[25040]: cluster 2024-09-14T05:31:24.313866+0000 mgr.a (mgr.14355) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:27.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:27.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:28 smithi007 bash[22722]: cluster 2024-09-14T05:31:26.316268+0000 mgr.a (mgr.14355) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:28 smithi131 bash[24745]: cluster 2024-09-14T05:31:26.316268+0000 mgr.a (mgr.14355) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:28 smithi171 bash[25040]: cluster 2024-09-14T05:31:26.316268+0000 mgr.a (mgr.14355) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:31:28.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:28.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:28.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:28.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:28.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:30 smithi007 bash[22722]: audit 2024-09-14T05:31:28.195352+0000 mgr.a (mgr.14355) 18619 : audit [DBG] from='client.399537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:30.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:30 smithi007 bash[22722]: cluster 2024-09-14T05:31:28.316929+0000 mgr.a (mgr.14355) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:30 smithi131 bash[24745]: audit 2024-09-14T05:31:28.195352+0000 mgr.a (mgr.14355) 18619 : audit [DBG] from='client.399537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:30 smithi131 bash[24745]: cluster 2024-09-14T05:31:28.316929+0000 mgr.a (mgr.14355) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:30 smithi171 bash[25040]: audit 2024-09-14T05:31:28.195352+0000 mgr.a (mgr.14355) 18619 : audit [DBG] from='client.399537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:30.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:30 smithi171 bash[25040]: cluster 2024-09-14T05:31:28.316929+0000 mgr.a (mgr.14355) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:32 smithi007 bash[22722]: cluster 2024-09-14T05:31:30.318481+0000 mgr.a (mgr.14355) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:32 smithi131 bash[24745]: cluster 2024-09-14T05:31:30.318481+0000 mgr.a (mgr.14355) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:32 smithi171 bash[25040]: cluster 2024-09-14T05:31:30.318481+0000 mgr.a (mgr.14355) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:33.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:33.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:33.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:34.424 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:34.424 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:34 smithi007 bash[22722]: cluster 2024-09-14T05:31:32.320141+0000 mgr.a (mgr.14355) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:34 smithi131 bash[24745]: cluster 2024-09-14T05:31:32.320141+0000 mgr.a (mgr.14355) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:34 smithi171 bash[25040]: cluster 2024-09-14T05:31:32.320141+0000 mgr.a (mgr.14355) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:35 smithi007 bash[22722]: audit 2024-09-14T05:31:33.976192+0000 mgr.a (mgr.14355) 18623 : audit [DBG] from='client.399615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:35 smithi131 bash[24745]: audit 2024-09-14T05:31:33.976192+0000 mgr.a (mgr.14355) 18623 : audit [DBG] from='client.399615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:35 smithi171 bash[25040]: audit 2024-09-14T05:31:33.976192+0000 mgr.a (mgr.14355) 18623 : audit [DBG] from='client.399615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:36 smithi007 bash[22722]: cluster 2024-09-14T05:31:34.321075+0000 mgr.a (mgr.14355) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:36 smithi131 bash[24745]: cluster 2024-09-14T05:31:34.321075+0000 mgr.a (mgr.14355) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:36 smithi171 bash[25040]: cluster 2024-09-14T05:31:34.321075+0000 mgr.a (mgr.14355) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:37 smithi007 bash[22722]: cluster 2024-09-14T05:31:36.323417+0000 mgr.a (mgr.14355) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:37 smithi131 bash[24745]: cluster 2024-09-14T05:31:36.323417+0000 mgr.a (mgr.14355) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:37 smithi171 bash[25040]: cluster 2024-09-14T05:31:36.323417+0000 mgr.a (mgr.14355) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:39.426 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:39.426 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:39 smithi007 bash[22722]: cluster 2024-09-14T05:31:38.324159+0000 mgr.a (mgr.14355) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:39 smithi131 bash[24745]: cluster 2024-09-14T05:31:38.324159+0000 mgr.a (mgr.14355) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:39 smithi171 bash[25040]: cluster 2024-09-14T05:31:38.324159+0000 mgr.a (mgr.14355) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:40.199 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:40.199 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:40 smithi007 bash[22722]: audit 2024-09-14T05:31:39.763765+0000 mgr.a (mgr.14355) 18627 : audit [DBG] from='client.399690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:40 smithi131 bash[24745]: audit 2024-09-14T05:31:39.763765+0000 mgr.a (mgr.14355) 18627 : audit [DBG] from='client.399690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:40 smithi171 bash[25040]: audit 2024-09-14T05:31:39.763765+0000 mgr.a (mgr.14355) 18627 : audit [DBG] from='client.399690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:41 smithi007 bash[22722]: cluster 2024-09-14T05:31:40.325716+0000 mgr.a (mgr.14355) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:41 smithi131 bash[24745]: cluster 2024-09-14T05:31:40.325716+0000 mgr.a (mgr.14355) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:41 smithi171 bash[25040]: cluster 2024-09-14T05:31:40.325716+0000 mgr.a (mgr.14355) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-14T05:31:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:43 smithi007 bash[22722]: cluster 2024-09-14T05:31:42.327438+0000 mgr.a (mgr.14355) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:43 smithi131 bash[24745]: cluster 2024-09-14T05:31:42.327438+0000 mgr.a (mgr.14355) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:43 smithi171 bash[25040]: cluster 2024-09-14T05:31:42.327438+0000 mgr.a (mgr.14355) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:31:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:45.201 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:45 smithi007 bash[22722]: cluster 2024-09-14T05:31:44.328192+0000 mgr.a (mgr.14355) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:45 smithi131 bash[24745]: cluster 2024-09-14T05:31:44.328192+0000 mgr.a (mgr.14355) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:45 smithi171 bash[25040]: cluster 2024-09-14T05:31:44.328192+0000 mgr.a (mgr.14355) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:45.976 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:46 smithi007 bash[22722]: audit 2024-09-14T05:31:45.535457+0000 mgr.a (mgr.14355) 18631 : audit [DBG] from='client.399768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:46 smithi131 bash[24745]: audit 2024-09-14T05:31:45.535457+0000 mgr.a (mgr.14355) 18631 : audit [DBG] from='client.399768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:46 smithi171 bash[25040]: audit 2024-09-14T05:31:45.535457+0000 mgr.a (mgr.14355) 18631 : audit [DBG] from='client.399768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:47 smithi007 bash[22722]: cluster 2024-09-14T05:31:46.330984+0000 mgr.a (mgr.14355) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:47 smithi131 bash[24745]: cluster 2024-09-14T05:31:46.330984+0000 mgr.a (mgr.14355) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:47 smithi171 bash[25040]: cluster 2024-09-14T05:31:46.330984+0000 mgr.a (mgr.14355) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:49 smithi007 bash[22722]: cluster 2024-09-14T05:31:48.331735+0000 mgr.a (mgr.14355) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:49 smithi131 bash[24745]: cluster 2024-09-14T05:31:48.331735+0000 mgr.a (mgr.14355) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:49 smithi171 bash[25040]: cluster 2024-09-14T05:31:48.331735+0000 mgr.a (mgr.14355) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:51 smithi007 bash[22722]: cluster 2024-09-14T05:31:50.332961+0000 mgr.a (mgr.14355) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:31:51.723 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:51.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:51.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:51.723 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:51.724 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:51 smithi131 bash[24745]: cluster 2024-09-14T05:31:50.332961+0000 mgr.a (mgr.14355) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:31:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:51 smithi171 bash[25040]: cluster 2024-09-14T05:31:50.332961+0000 mgr.a (mgr.14355) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-14T05:31:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:52 smithi007 bash[22722]: audit 2024-09-14T05:31:51.311638+0000 mgr.a (mgr.14355) 18635 : audit [DBG] from='client.399843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:52 smithi131 bash[24745]: audit 2024-09-14T05:31:51.311638+0000 mgr.a (mgr.14355) 18635 : audit [DBG] from='client.399843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:52 smithi171 bash[25040]: audit 2024-09-14T05:31:51.311638+0000 mgr.a (mgr.14355) 18635 : audit [DBG] from='client.399843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:53 smithi007 bash[22722]: cluster 2024-09-14T05:31:52.335226+0000 mgr.a (mgr.14355) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:31:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:53 smithi131 bash[24745]: cluster 2024-09-14T05:31:52.335226+0000 mgr.a (mgr.14355) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:31:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:53 smithi171 bash[25040]: cluster 2024-09-14T05:31:52.335226+0000 mgr.a (mgr.14355) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:31:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:55 smithi007 bash[22722]: cluster 2024-09-14T05:31:54.336001+0000 mgr.a (mgr.14355) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:55 smithi131 bash[24745]: cluster 2024-09-14T05:31:54.336001+0000 mgr.a (mgr.14355) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:55 smithi171 bash[25040]: cluster 2024-09-14T05:31:54.336001+0000 mgr.a (mgr.14355) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:31:56.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:31:56.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:31:56.725 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:31:57.500 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:31:57.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:31:57.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:31:57.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:31:57.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:31:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:57 smithi007 bash[22722]: cluster 2024-09-14T05:31:56.338002+0000 mgr.a (mgr.14355) 18638 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:57 smithi007 bash[22722]: audit 2024-09-14T05:31:57.062175+0000 mgr.a (mgr.14355) 18639 : audit [DBG] from='client.399921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:57 smithi131 bash[24745]: cluster 2024-09-14T05:31:56.338002+0000 mgr.a (mgr.14355) 18638 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:57 smithi131 bash[24745]: audit 2024-09-14T05:31:57.062175+0000 mgr.a (mgr.14355) 18639 : audit [DBG] from='client.399921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:57 smithi171 bash[25040]: cluster 2024-09-14T05:31:56.338002+0000 mgr.a (mgr.14355) 18638 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:57 smithi171 bash[25040]: audit 2024-09-14T05:31:57.062175+0000 mgr.a (mgr.14355) 18639 : audit [DBG] from='client.399921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:31:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:31:59 smithi007 bash[22722]: cluster 2024-09-14T05:31:58.338910+0000 mgr.a (mgr.14355) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:31:59 smithi131 bash[24745]: cluster 2024-09-14T05:31:58.338910+0000 mgr.a (mgr.14355) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:31:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:31:59 smithi171 bash[25040]: cluster 2024-09-14T05:31:58.338910+0000 mgr.a (mgr.14355) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:01 smithi007 bash[22722]: cluster 2024-09-14T05:32:00.340656+0000 mgr.a (mgr.14355) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:01 smithi131 bash[24745]: cluster 2024-09-14T05:32:00.340656+0000 mgr.a (mgr.14355) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:01.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:01 smithi171 bash[25040]: cluster 2024-09-14T05:32:00.340656+0000 mgr.a (mgr.14355) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:02.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:02.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:02.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:03.259 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:03.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:03.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:03.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:03.260 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:03 smithi007 bash[22722]: cluster 2024-09-14T05:32:02.341896+0000 mgr.a (mgr.14355) 18642 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:03 smithi007 bash[22722]: audit 2024-09-14T05:32:02.832196+0000 mgr.a (mgr.14355) 18643 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:03 smithi131 bash[24745]: cluster 2024-09-14T05:32:02.341896+0000 mgr.a (mgr.14355) 18642 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:03 smithi131 bash[24745]: audit 2024-09-14T05:32:02.832196+0000 mgr.a (mgr.14355) 18643 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:03 smithi171 bash[25040]: cluster 2024-09-14T05:32:02.341896+0000 mgr.a (mgr.14355) 18642 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:03 smithi171 bash[25040]: audit 2024-09-14T05:32:02.832196+0000 mgr.a (mgr.14355) 18643 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:05 smithi131 bash[24745]: cluster 2024-09-14T05:32:04.342799+0000 mgr.a (mgr.14355) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:05 smithi171 bash[25040]: cluster 2024-09-14T05:32:04.342799+0000 mgr.a (mgr.14355) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:05 smithi007 bash[22722]: cluster 2024-09-14T05:32:04.342799+0000 mgr.a (mgr.14355) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:07 smithi131 bash[24745]: cluster 2024-09-14T05:32:06.345028+0000 mgr.a (mgr.14355) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:07 smithi171 bash[25040]: cluster 2024-09-14T05:32:06.345028+0000 mgr.a (mgr.14355) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:07 smithi007 bash[22722]: cluster 2024-09-14T05:32:06.345028+0000 mgr.a (mgr.14355) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:08.261 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:08.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:08.262 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:09.046 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:09.047 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:09 smithi131 bash[24745]: cluster 2024-09-14T05:32:08.345672+0000 mgr.a (mgr.14355) 18646 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:09 smithi131 bash[24745]: audit 2024-09-14T05:32:08.597890+0000 mgr.a (mgr.14355) 18647 : audit [DBG] from='client.400074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:09 smithi171 bash[25040]: cluster 2024-09-14T05:32:08.345672+0000 mgr.a (mgr.14355) 18646 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:09 smithi171 bash[25040]: audit 2024-09-14T05:32:08.597890+0000 mgr.a (mgr.14355) 18647 : audit [DBG] from='client.400074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:09 smithi007 bash[22722]: cluster 2024-09-14T05:32:08.345672+0000 mgr.a (mgr.14355) 18646 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:09 smithi007 bash[22722]: audit 2024-09-14T05:32:08.597890+0000 mgr.a (mgr.14355) 18647 : audit [DBG] from='client.400074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:11 smithi131 bash[24745]: cluster 2024-09-14T05:32:10.347560+0000 mgr.a (mgr.14355) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:11 smithi171 bash[25040]: cluster 2024-09-14T05:32:10.347560+0000 mgr.a (mgr.14355) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:11 smithi007 bash[22722]: cluster 2024-09-14T05:32:10.347560+0000 mgr.a (mgr.14355) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:13 smithi131 bash[24745]: cluster 2024-09-14T05:32:12.348849+0000 mgr.a (mgr.14355) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:13 smithi131 bash[24745]: audit 2024-09-14T05:32:13.098625+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:32:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:13 smithi171 bash[25040]: cluster 2024-09-14T05:32:12.348849+0000 mgr.a (mgr.14355) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:13 smithi171 bash[25040]: audit 2024-09-14T05:32:13.098625+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:32:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:13 smithi007 bash[22722]: cluster 2024-09-14T05:32:12.348849+0000 mgr.a (mgr.14355) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:13 smithi007 bash[22722]: audit 2024-09-14T05:32:13.098625+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:32:14.048 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:14.049 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:14.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:14.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:14.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:14.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:14.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:15 smithi131 bash[24745]: cluster 2024-09-14T05:32:14.349546+0000 mgr.a (mgr.14355) 18650 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:15 smithi131 bash[24745]: audit 2024-09-14T05:32:14.381747+0000 mgr.a (mgr.14355) 18651 : audit [DBG] from='client.400152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:15 smithi171 bash[25040]: cluster 2024-09-14T05:32:14.349546+0000 mgr.a (mgr.14355) 18650 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:15 smithi171 bash[25040]: audit 2024-09-14T05:32:14.381747+0000 mgr.a (mgr.14355) 18651 : audit [DBG] from='client.400152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:15 smithi007 bash[22722]: cluster 2024-09-14T05:32:14.349546+0000 mgr.a (mgr.14355) 18650 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:32:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:15 smithi007 bash[22722]: audit 2024-09-14T05:32:14.381747+0000 mgr.a (mgr.14355) 18651 : audit [DBG] from='client.400152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:17 smithi131 bash[24745]: cluster 2024-09-14T05:32:16.351936+0000 mgr.a (mgr.14355) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:17 smithi171 bash[25040]: cluster 2024-09-14T05:32:16.351936+0000 mgr.a (mgr.14355) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:17 smithi007 bash[22722]: cluster 2024-09-14T05:32:16.351936+0000 mgr.a (mgr.14355) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:32:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: cluster 2024-09-14T05:32:18.352388+0000 mgr.a (mgr.14355) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.453204+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.459256+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.475472+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.478676+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.483488+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:18.488622+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:19.221996+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:19.223417+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:19.233468+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22722]: audit 2024-09-14T05:32:19.238094+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: cluster 2024-09-14T05:32:18.352388+0000 mgr.a (mgr.14355) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.453204+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.459256+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.475472+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.478676+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.483488+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:18.488622+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:19.221996+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:19.223417+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:19.233468+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:19 smithi131 bash[24745]: audit 2024-09-14T05:32:19.238094+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:19.794 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: cluster 2024-09-14T05:32:18.352388+0000 mgr.a (mgr.14355) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.453204+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.459256+0000 mon.a (mon.0) 3373 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.475472+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.478676+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.483488+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:18.488622+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:19.221996+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:19.223417+0000 mon.a (mon.0) 3379 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:32:19.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:19.233468+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:32:19.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:19 smithi171 bash[25040]: audit 2024-09-14T05:32:19.238094+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:20.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22972]: debug 2024-09-14T05:32:19.987+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:32:20.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:32:19 smithi007 bash[22972]: debug 2024-09-14T05:32:19.987+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:32:20.524 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:20.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:20.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:20.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:20.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:20 smithi131 bash[24745]: audit 2024-09-14T05:32:19.239260+0000 mgr.a (mgr.14355) 18654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:20.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:20 smithi131 bash[24745]: audit 2024-09-14T05:32:19.992080+0000 mgr.a (mgr.14355) 18655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:32:20.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:20 smithi131 bash[24745]: cephadm 2024-09-14T05:32:19.993757+0000 mgr.a (mgr.14355) 18656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:32:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:20 smithi171 bash[25040]: audit 2024-09-14T05:32:19.239260+0000 mgr.a (mgr.14355) 18654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:20 smithi171 bash[25040]: audit 2024-09-14T05:32:19.992080+0000 mgr.a (mgr.14355) 18655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:32:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:20 smithi171 bash[25040]: cephadm 2024-09-14T05:32:19.993757+0000 mgr.a (mgr.14355) 18656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:32:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:20 smithi007 bash[22722]: audit 2024-09-14T05:32:19.239260+0000 mgr.a (mgr.14355) 18654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:32:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:20 smithi007 bash[22722]: audit 2024-09-14T05:32:19.992080+0000 mgr.a (mgr.14355) 18655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:32:20.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:20 smithi007 bash[22722]: cephadm 2024-09-14T05:32:19.993757+0000 mgr.a (mgr.14355) 18656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:32:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:21 smithi131 bash[24745]: audit 2024-09-14T05:32:20.110377+0000 mgr.a (mgr.14355) 18657 : audit [DBG] from='client.400338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:21 smithi131 bash[24745]: cluster 2024-09-14T05:32:20.353374+0000 mgr.a (mgr.14355) 18658 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:32:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:21 smithi171 bash[25040]: audit 2024-09-14T05:32:20.110377+0000 mgr.a (mgr.14355) 18657 : audit [DBG] from='client.400338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:21 smithi171 bash[25040]: cluster 2024-09-14T05:32:20.353374+0000 mgr.a (mgr.14355) 18658 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:21 smithi007 bash[22722]: audit 2024-09-14T05:32:20.110377+0000 mgr.a (mgr.14355) 18657 : audit [DBG] from='client.400338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:21 smithi007 bash[22722]: cluster 2024-09-14T05:32:20.353374+0000 mgr.a (mgr.14355) 18658 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-14T05:32:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:23 smithi131 bash[24745]: cluster 2024-09-14T05:32:22.355000+0000 mgr.a (mgr.14355) 18659 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:23 smithi171 bash[25040]: cluster 2024-09-14T05:32:22.355000+0000 mgr.a (mgr.14355) 18659 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:23 smithi007 bash[22722]: cluster 2024-09-14T05:32:22.355000+0000 mgr.a (mgr.14355) 18659 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:25 smithi131 bash[24745]: cluster 2024-09-14T05:32:24.355802+0000 mgr.a (mgr.14355) 18660 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:25 smithi171 bash[25040]: cluster 2024-09-14T05:32:24.355802+0000 mgr.a (mgr.14355) 18660 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:25 smithi007 bash[22722]: cluster 2024-09-14T05:32:24.355802+0000 mgr.a (mgr.14355) 18660 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:26.350 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:26.350 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:26.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:26.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:26.351 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:26 smithi131 bash[24745]: audit 2024-09-14T05:32:25.875662+0000 mgr.a (mgr.14355) 18661 : audit [DBG] from='client.400416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:26 smithi171 bash[25040]: audit 2024-09-14T05:32:25.875662+0000 mgr.a (mgr.14355) 18661 : audit [DBG] from='client.400416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:26 smithi007 bash[22722]: audit 2024-09-14T05:32:25.875662+0000 mgr.a (mgr.14355) 18661 : audit [DBG] from='client.400416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:27 smithi131 bash[24745]: cluster 2024-09-14T05:32:26.357074+0000 mgr.a (mgr.14355) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:27 smithi171 bash[25040]: cluster 2024-09-14T05:32:26.357074+0000 mgr.a (mgr.14355) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:27 smithi007 bash[22722]: cluster 2024-09-14T05:32:26.357074+0000 mgr.a (mgr.14355) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:32:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:29 smithi131 bash[24745]: cluster 2024-09-14T05:32:28.357806+0000 mgr.a (mgr.14355) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:29 smithi171 bash[25040]: cluster 2024-09-14T05:32:28.357806+0000 mgr.a (mgr.14355) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:29 smithi007 bash[22722]: cluster 2024-09-14T05:32:28.357806+0000 mgr.a (mgr.14355) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:32:31.352 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:31.353 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:31.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:31 smithi131 bash[24745]: cluster 2024-09-14T05:32:30.359403+0000 mgr.a (mgr.14355) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 43 op/s 2024-09-14T05:32:31.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:31 smithi171 bash[25040]: cluster 2024-09-14T05:32:30.359403+0000 mgr.a (mgr.14355) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 43 op/s 2024-09-14T05:32:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:31 smithi007 bash[22722]: cluster 2024-09-14T05:32:30.359403+0000 mgr.a (mgr.14355) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 43 op/s 2024-09-14T05:32:32.145 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:32.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:32.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:32.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:32.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:32 smithi131 bash[24745]: audit 2024-09-14T05:32:31.691651+0000 mgr.a (mgr.14355) 18665 : audit [DBG] from='client.400491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:32 smithi171 bash[25040]: audit 2024-09-14T05:32:31.691651+0000 mgr.a (mgr.14355) 18665 : audit [DBG] from='client.400491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:32 smithi007 bash[22722]: audit 2024-09-14T05:32:31.691651+0000 mgr.a (mgr.14355) 18665 : audit [DBG] from='client.400491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:33 smithi131 bash[24745]: cluster 2024-09-14T05:32:32.361260+0000 mgr.a (mgr.14355) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 170 B/s wr, 61 op/s 2024-09-14T05:32:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:33 smithi171 bash[25040]: cluster 2024-09-14T05:32:32.361260+0000 mgr.a (mgr.14355) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 170 B/s wr, 61 op/s 2024-09-14T05:32:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:33 smithi007 bash[22722]: cluster 2024-09-14T05:32:32.361260+0000 mgr.a (mgr.14355) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 170 B/s wr, 61 op/s 2024-09-14T05:32:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:35 smithi131 bash[24745]: cluster 2024-09-14T05:32:34.362055+0000 mgr.a (mgr.14355) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T05:32:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:35 smithi171 bash[25040]: cluster 2024-09-14T05:32:34.362055+0000 mgr.a (mgr.14355) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T05:32:35.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:35 smithi007 bash[22722]: cluster 2024-09-14T05:32:34.362055+0000 mgr.a (mgr.14355) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 59 op/s 2024-09-14T05:32:37.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:37.148 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:37 smithi131 bash[24745]: cluster 2024-09-14T05:32:36.364085+0000 mgr.a (mgr.14355) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:37 smithi171 bash[25040]: cluster 2024-09-14T05:32:36.364085+0000 mgr.a (mgr.14355) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:37.927 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:37.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:37.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:37.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:37.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:37 smithi007 bash[22722]: cluster 2024-09-14T05:32:36.364085+0000 mgr.a (mgr.14355) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:38 smithi131 bash[24745]: audit 2024-09-14T05:32:37.480472+0000 mgr.a (mgr.14355) 18669 : audit [DBG] from='client.400566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:38 smithi171 bash[25040]: audit 2024-09-14T05:32:37.480472+0000 mgr.a (mgr.14355) 18669 : audit [DBG] from='client.400566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:38 smithi007 bash[22722]: audit 2024-09-14T05:32:37.480472+0000 mgr.a (mgr.14355) 18669 : audit [DBG] from='client.400566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:39 smithi131 bash[24745]: cluster 2024-09-14T05:32:38.365070+0000 mgr.a (mgr.14355) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:39 smithi171 bash[25040]: cluster 2024-09-14T05:32:38.365070+0000 mgr.a (mgr.14355) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:39 smithi007 bash[22722]: cluster 2024-09-14T05:32:38.365070+0000 mgr.a (mgr.14355) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:41 smithi131 bash[24745]: cluster 2024-09-14T05:32:40.366893+0000 mgr.a (mgr.14355) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:41 smithi171 bash[25040]: cluster 2024-09-14T05:32:40.366893+0000 mgr.a (mgr.14355) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:41 smithi007 bash[22722]: cluster 2024-09-14T05:32:40.366893+0000 mgr.a (mgr.14355) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-14T05:32:42.929 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:42.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:42.930 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:43.717 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:43.718 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:43 smithi131 bash[24745]: cluster 2024-09-14T05:32:42.368188+0000 mgr.a (mgr.14355) 18672 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T05:32:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:43 smithi171 bash[25040]: cluster 2024-09-14T05:32:42.368188+0000 mgr.a (mgr.14355) 18672 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T05:32:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:43 smithi007 bash[22722]: cluster 2024-09-14T05:32:42.368188+0000 mgr.a (mgr.14355) 18672 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-14T05:32:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:44 smithi171 bash[25040]: audit 2024-09-14T05:32:43.266968+0000 mgr.a (mgr.14355) 18673 : audit [DBG] from='client.400644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:44.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:44 smithi007 bash[22722]: audit 2024-09-14T05:32:43.266968+0000 mgr.a (mgr.14355) 18673 : audit [DBG] from='client.400644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:45.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:44 smithi131 bash[24745]: audit 2024-09-14T05:32:43.266968+0000 mgr.a (mgr.14355) 18673 : audit [DBG] from='client.400644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:45 smithi171 bash[25040]: cluster 2024-09-14T05:32:44.369102+0000 mgr.a (mgr.14355) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:45 smithi007 bash[22722]: cluster 2024-09-14T05:32:44.369102+0000 mgr.a (mgr.14355) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:45 smithi131 bash[24745]: cluster 2024-09-14T05:32:44.369102+0000 mgr.a (mgr.14355) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:47 smithi007 bash[22722]: cluster 2024-09-14T05:32:46.371335+0000 mgr.a (mgr.14355) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:47 smithi131 bash[24745]: cluster 2024-09-14T05:32:46.371335+0000 mgr.a (mgr.14355) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:47 smithi171 bash[25040]: cluster 2024-09-14T05:32:46.371335+0000 mgr.a (mgr.14355) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:49.501 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:49 smithi007 bash[22722]: cluster 2024-09-14T05:32:48.372101+0000 mgr.a (mgr.14355) 18676 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:49 smithi007 bash[22722]: audit 2024-09-14T05:32:49.049828+0000 mgr.a (mgr.14355) 18677 : audit [DBG] from='client.400722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:49 smithi131 bash[24745]: cluster 2024-09-14T05:32:48.372101+0000 mgr.a (mgr.14355) 18676 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:49 smithi131 bash[24745]: audit 2024-09-14T05:32:49.049828+0000 mgr.a (mgr.14355) 18677 : audit [DBG] from='client.400722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:49 smithi171 bash[25040]: cluster 2024-09-14T05:32:48.372101+0000 mgr.a (mgr.14355) 18676 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:49 smithi171 bash[25040]: audit 2024-09-14T05:32:49.049828+0000 mgr.a (mgr.14355) 18677 : audit [DBG] from='client.400722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:51 smithi007 bash[22722]: cluster 2024-09-14T05:32:50.374048+0000 mgr.a (mgr.14355) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:51 smithi131 bash[24745]: cluster 2024-09-14T05:32:50.374048+0000 mgr.a (mgr.14355) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:51 smithi171 bash[25040]: cluster 2024-09-14T05:32:50.374048+0000 mgr.a (mgr.14355) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:32:53.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:53 smithi007 bash[22722]: cluster 2024-09-14T05:32:52.375352+0000 mgr.a (mgr.14355) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:32:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:53 smithi131 bash[24745]: cluster 2024-09-14T05:32:52.375352+0000 mgr.a (mgr.14355) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:32:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:53 smithi171 bash[25040]: cluster 2024-09-14T05:32:52.375352+0000 mgr.a (mgr.14355) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:32:54.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:32:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:32:54.503 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:32:55.250 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:32:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:32:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:32:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:32:55.251 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:32:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:55 smithi007 bash[22722]: cluster 2024-09-14T05:32:54.376108+0000 mgr.a (mgr.14355) 18680 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:55 smithi007 bash[22722]: audit 2024-09-14T05:32:54.832850+0000 mgr.a (mgr.14355) 18681 : audit [DBG] from='client.400797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:55 smithi131 bash[24745]: cluster 2024-09-14T05:32:54.376108+0000 mgr.a (mgr.14355) 18680 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:55 smithi131 bash[24745]: audit 2024-09-14T05:32:54.832850+0000 mgr.a (mgr.14355) 18681 : audit [DBG] from='client.400797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:55 smithi171 bash[25040]: cluster 2024-09-14T05:32:54.376108+0000 mgr.a (mgr.14355) 18680 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:32:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:55 smithi171 bash[25040]: audit 2024-09-14T05:32:54.832850+0000 mgr.a (mgr.14355) 18681 : audit [DBG] from='client.400797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:32:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:57 smithi007 bash[22722]: cluster 2024-09-14T05:32:56.378569+0000 mgr.a (mgr.14355) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:57 smithi131 bash[24745]: cluster 2024-09-14T05:32:56.378569+0000 mgr.a (mgr.14355) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:57 smithi171 bash[25040]: cluster 2024-09-14T05:32:56.378569+0000 mgr.a (mgr.14355) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:32:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:32:59 smithi007 bash[22722]: cluster 2024-09-14T05:32:58.379351+0000 mgr.a (mgr.14355) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:32:59 smithi131 bash[24745]: cluster 2024-09-14T05:32:58.379351+0000 mgr.a (mgr.14355) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:32:59 smithi171 bash[25040]: cluster 2024-09-14T05:32:58.379351+0000 mgr.a (mgr.14355) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:00.252 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:01.020 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:01.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:01 smithi007 bash[22722]: cluster 2024-09-14T05:33:00.380182+0000 mgr.a (mgr.14355) 18684 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:01 smithi007 bash[22722]: audit 2024-09-14T05:33:00.587031+0000 mgr.a (mgr.14355) 18685 : audit [DBG] from='client.400875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:01 smithi131 bash[24745]: cluster 2024-09-14T05:33:00.380182+0000 mgr.a (mgr.14355) 18684 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:01 smithi131 bash[24745]: audit 2024-09-14T05:33:00.587031+0000 mgr.a (mgr.14355) 18685 : audit [DBG] from='client.400875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:01 smithi171 bash[25040]: cluster 2024-09-14T05:33:00.380182+0000 mgr.a (mgr.14355) 18684 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:01 smithi171 bash[25040]: audit 2024-09-14T05:33:00.587031+0000 mgr.a (mgr.14355) 18685 : audit [DBG] from='client.400875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:03 smithi007 bash[22722]: cluster 2024-09-14T05:33:02.381952+0000 mgr.a (mgr.14355) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:03 smithi131 bash[24745]: cluster 2024-09-14T05:33:02.381952+0000 mgr.a (mgr.14355) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:03 smithi171 bash[25040]: cluster 2024-09-14T05:33:02.381952+0000 mgr.a (mgr.14355) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:05 smithi007 bash[22722]: cluster 2024-09-14T05:33:04.382727+0000 mgr.a (mgr.14355) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:33:06.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:06.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:06.023 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:05 smithi131 bash[24745]: cluster 2024-09-14T05:33:04.382727+0000 mgr.a (mgr.14355) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:33:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:05 smithi171 bash[25040]: cluster 2024-09-14T05:33:04.382727+0000 mgr.a (mgr.14355) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:33:06.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:06.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:06.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:07 smithi007 bash[22722]: audit 2024-09-14T05:33:06.351974+0000 mgr.a (mgr.14355) 18688 : audit [DBG] from='client.400953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:07 smithi007 bash[22722]: cluster 2024-09-14T05:33:06.385752+0000 mgr.a (mgr.14355) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:07 smithi131 bash[24745]: audit 2024-09-14T05:33:06.351974+0000 mgr.a (mgr.14355) 18688 : audit [DBG] from='client.400953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:07 smithi131 bash[24745]: cluster 2024-09-14T05:33:06.385752+0000 mgr.a (mgr.14355) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:07 smithi171 bash[25040]: audit 2024-09-14T05:33:06.351974+0000 mgr.a (mgr.14355) 18688 : audit [DBG] from='client.400953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:07 smithi171 bash[25040]: cluster 2024-09-14T05:33:06.385752+0000 mgr.a (mgr.14355) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:09 smithi007 bash[22722]: cluster 2024-09-14T05:33:08.386660+0000 mgr.a (mgr.14355) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:09 smithi131 bash[24745]: cluster 2024-09-14T05:33:08.386660+0000 mgr.a (mgr.14355) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:09 smithi171 bash[25040]: cluster 2024-09-14T05:33:08.386660+0000 mgr.a (mgr.14355) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:11.774 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:11.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:11.775 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:11 smithi007 bash[22722]: cluster 2024-09-14T05:33:10.388389+0000 mgr.a (mgr.14355) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:33:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:11 smithi131 bash[24745]: cluster 2024-09-14T05:33:10.388389+0000 mgr.a (mgr.14355) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:33:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:11 smithi171 bash[25040]: cluster 2024-09-14T05:33:10.388389+0000 mgr.a (mgr.14355) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:33:12.561 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:13 smithi007 bash[22722]: audit 2024-09-14T05:33:12.113363+0000 mgr.a (mgr.14355) 18692 : audit [DBG] from='client.401031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:13 smithi007 bash[22722]: cluster 2024-09-14T05:33:12.389411+0000 mgr.a (mgr.14355) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:13 smithi131 bash[24745]: audit 2024-09-14T05:33:12.113363+0000 mgr.a (mgr.14355) 18692 : audit [DBG] from='client.401031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:13 smithi131 bash[24745]: cluster 2024-09-14T05:33:12.389411+0000 mgr.a (mgr.14355) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:13 smithi171 bash[25040]: audit 2024-09-14T05:33:12.113363+0000 mgr.a (mgr.14355) 18692 : audit [DBG] from='client.401031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:13 smithi171 bash[25040]: cluster 2024-09-14T05:33:12.389411+0000 mgr.a (mgr.14355) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:15 smithi007 bash[22722]: cluster 2024-09-14T05:33:14.390337+0000 mgr.a (mgr.14355) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:15 smithi131 bash[24745]: cluster 2024-09-14T05:33:14.390337+0000 mgr.a (mgr.14355) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:15 smithi171 bash[25040]: cluster 2024-09-14T05:33:14.390337+0000 mgr.a (mgr.14355) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:17.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:17 smithi007 bash[22722]: cluster 2024-09-14T05:33:16.392556+0000 mgr.a (mgr.14355) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:17 smithi131 bash[24745]: cluster 2024-09-14T05:33:16.392556+0000 mgr.a (mgr.14355) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:17 smithi171 bash[25040]: cluster 2024-09-14T05:33:16.392556+0000 mgr.a (mgr.14355) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:18.325 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:18.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:18 smithi007 bash[22722]: audit 2024-09-14T05:33:17.900942+0000 mgr.a (mgr.14355) 18696 : audit [DBG] from='client.401106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:18 smithi131 bash[24745]: audit 2024-09-14T05:33:17.900942+0000 mgr.a (mgr.14355) 18696 : audit [DBG] from='client.401106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:19.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:18 smithi171 bash[25040]: audit 2024-09-14T05:33:17.900942+0000 mgr.a (mgr.14355) 18696 : audit [DBG] from='client.401106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:19 smithi007 bash[22722]: cluster 2024-09-14T05:33:18.393599+0000 mgr.a (mgr.14355) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:19 smithi131 bash[24745]: cluster 2024-09-14T05:33:18.393599+0000 mgr.a (mgr.14355) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:19 smithi171 bash[25040]: cluster 2024-09-14T05:33:18.393599+0000 mgr.a (mgr.14355) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:20 smithi007 bash[22722]: audit 2024-09-14T05:33:20.050693+0000 mon.a (mon.0) 3382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:33:21.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:20 smithi131 bash[24745]: audit 2024-09-14T05:33:20.050693+0000 mon.a (mon.0) 3382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:33:21.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:20 smithi171 bash[25040]: audit 2024-09-14T05:33:20.050693+0000 mon.a (mon.0) 3382 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22972]: debug 2024-09-14T05:33:21.646+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22972]: debug 2024-09-14T05:33:21.650+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: cluster 2024-09-14T05:33:20.395439+0000 mgr.a (mgr.14355) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: audit 2024-09-14T05:33:20.880068+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: audit 2024-09-14T05:33:20.881222+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:33:21.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: audit 2024-09-14T05:33:20.889888+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:33:21.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: audit 2024-09-14T05:33:20.895039+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:21.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:21 smithi007 bash[22722]: audit 2024-09-14T05:33:20.897431+0000 mgr.a (mgr.14355) 18699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: cluster 2024-09-14T05:33:20.395439+0000 mgr.a (mgr.14355) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:33:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: audit 2024-09-14T05:33:20.880068+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:33:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: audit 2024-09-14T05:33:20.881222+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:33:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: audit 2024-09-14T05:33:20.889888+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:33:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: audit 2024-09-14T05:33:20.895039+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:21 smithi131 bash[24745]: audit 2024-09-14T05:33:20.897431+0000 mgr.a (mgr.14355) 18699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: cluster 2024-09-14T05:33:20.395439+0000 mgr.a (mgr.14355) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:33:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: audit 2024-09-14T05:33:20.880068+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:33:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: audit 2024-09-14T05:33:20.881222+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:33:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: audit 2024-09-14T05:33:20.889888+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:33:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: audit 2024-09-14T05:33:20.895039+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:22.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:21 smithi171 bash[25040]: audit 2024-09-14T05:33:20.897431+0000 mgr.a (mgr.14355) 18699 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:33:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:22 smithi007 bash[22722]: audit 2024-09-14T05:33:21.653831+0000 mgr.a (mgr.14355) 18700 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:33:22.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:22 smithi007 bash[22722]: cephadm 2024-09-14T05:33:21.655095+0000 mgr.a (mgr.14355) 18701 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:33:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:22 smithi131 bash[24745]: audit 2024-09-14T05:33:21.653831+0000 mgr.a (mgr.14355) 18700 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:33:23.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:22 smithi131 bash[24745]: cephadm 2024-09-14T05:33:21.655095+0000 mgr.a (mgr.14355) 18701 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:33:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:22 smithi171 bash[25040]: audit 2024-09-14T05:33:21.653831+0000 mgr.a (mgr.14355) 18700 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:33:23.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:22 smithi171 bash[25040]: cephadm 2024-09-14T05:33:21.655095+0000 mgr.a (mgr.14355) 18701 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:33:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:23.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:23 smithi007 bash[22722]: cluster 2024-09-14T05:33:22.397322+0000 mgr.a (mgr.14355) 18702 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:33:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:23 smithi131 bash[24745]: cluster 2024-09-14T05:33:22.397322+0000 mgr.a (mgr.14355) 18702 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:33:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:23 smithi171 bash[25040]: cluster 2024-09-14T05:33:22.397322+0000 mgr.a (mgr.14355) 18702 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:33:24.105 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:24.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:24 smithi007 bash[22722]: audit 2024-09-14T05:33:23.660170+0000 mgr.a (mgr.14355) 18703 : audit [DBG] from='client.401292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:24 smithi131 bash[24745]: audit 2024-09-14T05:33:23.660170+0000 mgr.a (mgr.14355) 18703 : audit [DBG] from='client.401292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:25.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:24 smithi171 bash[25040]: audit 2024-09-14T05:33:23.660170+0000 mgr.a (mgr.14355) 18703 : audit [DBG] from='client.401292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:25 smithi007 bash[22722]: cluster 2024-09-14T05:33:24.398276+0000 mgr.a (mgr.14355) 18704 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:25 smithi131 bash[24745]: cluster 2024-09-14T05:33:24.398276+0000 mgr.a (mgr.14355) 18704 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:25 smithi171 bash[25040]: cluster 2024-09-14T05:33:24.398276+0000 mgr.a (mgr.14355) 18704 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:27 smithi007 bash[22722]: cluster 2024-09-14T05:33:26.400688+0000 mgr.a (mgr.14355) 18705 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:27 smithi131 bash[24745]: cluster 2024-09-14T05:33:26.400688+0000 mgr.a (mgr.14355) 18705 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:27 smithi171 bash[25040]: cluster 2024-09-14T05:33:26.400688+0000 mgr.a (mgr.14355) 18705 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:29.107 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:29.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:29.107 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:29.882 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:29.882 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:29.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:29 smithi007 bash[22722]: cluster 2024-09-14T05:33:28.401496+0000 mgr.a (mgr.14355) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:29 smithi131 bash[24745]: cluster 2024-09-14T05:33:28.401496+0000 mgr.a (mgr.14355) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:29 smithi171 bash[25040]: cluster 2024-09-14T05:33:28.401496+0000 mgr.a (mgr.14355) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:30.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:30 smithi007 bash[22722]: audit 2024-09-14T05:33:29.440864+0000 mgr.a (mgr.14355) 18707 : audit [DBG] from='client.401370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:30 smithi131 bash[24745]: audit 2024-09-14T05:33:29.440864+0000 mgr.a (mgr.14355) 18707 : audit [DBG] from='client.401370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:31.047 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:30 smithi171 bash[25040]: audit 2024-09-14T05:33:29.440864+0000 mgr.a (mgr.14355) 18707 : audit [DBG] from='client.401370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:31 smithi007 bash[22722]: cluster 2024-09-14T05:33:30.403540+0000 mgr.a (mgr.14355) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:31 smithi131 bash[24745]: cluster 2024-09-14T05:33:30.403540+0000 mgr.a (mgr.14355) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:31 smithi171 bash[25040]: cluster 2024-09-14T05:33:30.403540+0000 mgr.a (mgr.14355) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:33 smithi007 bash[22722]: cluster 2024-09-14T05:33:32.404819+0000 mgr.a (mgr.14355) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:33 smithi131 bash[24745]: cluster 2024-09-14T05:33:32.404819+0000 mgr.a (mgr.14355) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:33 smithi171 bash[25040]: cluster 2024-09-14T05:33:32.404819+0000 mgr.a (mgr.14355) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:34.884 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:34.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:35.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:35.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:35.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:35 smithi007 bash[22722]: cluster 2024-09-14T05:33:34.405614+0000 mgr.a (mgr.14355) 18710 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:35 smithi131 bash[24745]: cluster 2024-09-14T05:33:34.405614+0000 mgr.a (mgr.14355) 18710 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:35 smithi171 bash[25040]: cluster 2024-09-14T05:33:34.405614+0000 mgr.a (mgr.14355) 18710 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:36.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:36 smithi007 bash[22722]: audit 2024-09-14T05:33:35.216832+0000 mgr.a (mgr.14355) 18711 : audit [DBG] from='client.401445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:37.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:36 smithi131 bash[24745]: audit 2024-09-14T05:33:35.216832+0000 mgr.a (mgr.14355) 18711 : audit [DBG] from='client.401445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:37.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:36 smithi171 bash[25040]: audit 2024-09-14T05:33:35.216832+0000 mgr.a (mgr.14355) 18711 : audit [DBG] from='client.401445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:37 smithi007 bash[22722]: cluster 2024-09-14T05:33:36.408168+0000 mgr.a (mgr.14355) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:37 smithi131 bash[24745]: cluster 2024-09-14T05:33:36.408168+0000 mgr.a (mgr.14355) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:37 smithi171 bash[25040]: cluster 2024-09-14T05:33:36.408168+0000 mgr.a (mgr.14355) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:33:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:39 smithi007 bash[22722]: cluster 2024-09-14T05:33:38.408955+0000 mgr.a (mgr.14355) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:33:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:39 smithi131 bash[24745]: cluster 2024-09-14T05:33:38.408955+0000 mgr.a (mgr.14355) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:33:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:39 smithi171 bash[25040]: cluster 2024-09-14T05:33:38.408955+0000 mgr.a (mgr.14355) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:33:40.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:40.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:41.416 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:41.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:41 smithi131 bash[24745]: cluster 2024-09-14T05:33:40.410526+0000 mgr.a (mgr.14355) 18714 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:33:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:41 smithi131 bash[24745]: audit 2024-09-14T05:33:40.982135+0000 mgr.a (mgr.14355) 18715 : audit [DBG] from='client.401517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:41 smithi171 bash[25040]: cluster 2024-09-14T05:33:40.410526+0000 mgr.a (mgr.14355) 18714 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:33:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:41 smithi171 bash[25040]: audit 2024-09-14T05:33:40.982135+0000 mgr.a (mgr.14355) 18715 : audit [DBG] from='client.401517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:41 smithi007 bash[22722]: cluster 2024-09-14T05:33:40.410526+0000 mgr.a (mgr.14355) 18714 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:33:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:41 smithi007 bash[22722]: audit 2024-09-14T05:33:40.982135+0000 mgr.a (mgr.14355) 18715 : audit [DBG] from='client.401517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:43 smithi131 bash[24745]: cluster 2024-09-14T05:33:42.412311+0000 mgr.a (mgr.14355) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:43 smithi171 bash[25040]: cluster 2024-09-14T05:33:42.412311+0000 mgr.a (mgr.14355) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:43 smithi007 bash[22722]: cluster 2024-09-14T05:33:42.412311+0000 mgr.a (mgr.14355) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:33:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:45 smithi131 bash[24745]: cluster 2024-09-14T05:33:44.413073+0000 mgr.a (mgr.14355) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:45 smithi171 bash[25040]: cluster 2024-09-14T05:33:44.413073+0000 mgr.a (mgr.14355) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:45 smithi007 bash[22722]: cluster 2024-09-14T05:33:44.413073+0000 mgr.a (mgr.14355) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:33:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:46.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:46.419 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:47.179 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:47.179 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:47.180 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:47 smithi131 bash[24745]: cluster 2024-09-14T05:33:46.415121+0000 mgr.a (mgr.14355) 18718 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:47 smithi131 bash[24745]: audit 2024-09-14T05:33:46.756008+0000 mgr.a (mgr.14355) 18719 : audit [DBG] from='client.401595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:47 smithi171 bash[25040]: cluster 2024-09-14T05:33:46.415121+0000 mgr.a (mgr.14355) 18718 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:47 smithi171 bash[25040]: audit 2024-09-14T05:33:46.756008+0000 mgr.a (mgr.14355) 18719 : audit [DBG] from='client.401595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:47 smithi007 bash[22722]: cluster 2024-09-14T05:33:46.415121+0000 mgr.a (mgr.14355) 18718 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:47 smithi007 bash[22722]: audit 2024-09-14T05:33:46.756008+0000 mgr.a (mgr.14355) 18719 : audit [DBG] from='client.401595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:49 smithi131 bash[24745]: cluster 2024-09-14T05:33:48.416019+0000 mgr.a (mgr.14355) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:33:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:49 smithi171 bash[25040]: cluster 2024-09-14T05:33:48.416019+0000 mgr.a (mgr.14355) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:33:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:49 smithi007 bash[22722]: cluster 2024-09-14T05:33:48.416019+0000 mgr.a (mgr.14355) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:33:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:51 smithi131 bash[24745]: cluster 2024-09-14T05:33:50.417806+0000 mgr.a (mgr.14355) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:33:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:51 smithi171 bash[25040]: cluster 2024-09-14T05:33:50.417806+0000 mgr.a (mgr.14355) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:33:52.181 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:52.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:52.181 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:51 smithi007 bash[22722]: cluster 2024-09-14T05:33:50.417806+0000 mgr.a (mgr.14355) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:33:52.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:52.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:52.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:52.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:33:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:53 smithi131 bash[24745]: cluster 2024-09-14T05:33:52.419053+0000 mgr.a (mgr.14355) 18722 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:33:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:53 smithi131 bash[24745]: audit 2024-09-14T05:33:52.515327+0000 mgr.a (mgr.14355) 18723 : audit [DBG] from='client.401670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:54.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:53 smithi171 bash[25040]: cluster 2024-09-14T05:33:52.419053+0000 mgr.a (mgr.14355) 18722 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:33:54.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:53 smithi171 bash[25040]: audit 2024-09-14T05:33:52.515327+0000 mgr.a (mgr.14355) 18723 : audit [DBG] from='client.401670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:53 smithi007 bash[22722]: cluster 2024-09-14T05:33:52.419053+0000 mgr.a (mgr.14355) 18722 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:33:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:53 smithi007 bash[22722]: audit 2024-09-14T05:33:52.515327+0000 mgr.a (mgr.14355) 18723 : audit [DBG] from='client.401670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:33:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:55 smithi131 bash[24745]: cluster 2024-09-14T05:33:54.419932+0000 mgr.a (mgr.14355) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:55 smithi171 bash[25040]: cluster 2024-09-14T05:33:54.419932+0000 mgr.a (mgr.14355) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:55 smithi007 bash[22722]: cluster 2024-09-14T05:33:54.419932+0000 mgr.a (mgr.14355) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:33:57.970 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:33:57.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:33:57.971 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:33:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:57 smithi131 bash[24745]: cluster 2024-09-14T05:33:56.422206+0000 mgr.a (mgr.14355) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:57 smithi171 bash[25040]: cluster 2024-09-14T05:33:56.422206+0000 mgr.a (mgr.14355) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:57 smithi007 bash[22722]: cluster 2024-09-14T05:33:56.422206+0000 mgr.a (mgr.14355) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:33:58.751 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:33:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:33:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:33:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:33:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:59 smithi131 bash[24745]: audit 2024-09-14T05:33:58.309714+0000 mgr.a (mgr.14355) 18726 : audit [DBG] from='client.401742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:33:59 smithi131 bash[24745]: cluster 2024-09-14T05:33:58.422729+0000 mgr.a (mgr.14355) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:59 smithi171 bash[25040]: audit 2024-09-14T05:33:58.309714+0000 mgr.a (mgr.14355) 18726 : audit [DBG] from='client.401742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:33:59 smithi171 bash[25040]: cluster 2024-09-14T05:33:58.422729+0000 mgr.a (mgr.14355) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:59 smithi007 bash[22722]: audit 2024-09-14T05:33:58.309714+0000 mgr.a (mgr.14355) 18726 : audit [DBG] from='client.401742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:33:59 smithi007 bash[22722]: cluster 2024-09-14T05:33:58.422729+0000 mgr.a (mgr.14355) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:01 smithi131 bash[24745]: cluster 2024-09-14T05:34:00.424573+0000 mgr.a (mgr.14355) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:01 smithi171 bash[25040]: cluster 2024-09-14T05:34:00.424573+0000 mgr.a (mgr.14355) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:01 smithi007 bash[22722]: cluster 2024-09-14T05:34:00.424573+0000 mgr.a (mgr.14355) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:03 smithi131 bash[24745]: cluster 2024-09-14T05:34:02.425874+0000 mgr.a (mgr.14355) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:03 smithi171 bash[25040]: cluster 2024-09-14T05:34:02.425874+0000 mgr.a (mgr.14355) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:03 smithi007 bash[22722]: cluster 2024-09-14T05:34:02.425874+0000 mgr.a (mgr.14355) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:04.541 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:04.541 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:05.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:04 smithi131 bash[24745]: audit 2024-09-14T05:34:04.089320+0000 mgr.a (mgr.14355) 18730 : audit [DBG] from='client.401820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:05.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:04 smithi171 bash[25040]: audit 2024-09-14T05:34:04.089320+0000 mgr.a (mgr.14355) 18730 : audit [DBG] from='client.401820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:05.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:04 smithi007 bash[22722]: audit 2024-09-14T05:34:04.089320+0000 mgr.a (mgr.14355) 18730 : audit [DBG] from='client.401820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:05 smithi131 bash[24745]: cluster 2024-09-14T05:34:04.426417+0000 mgr.a (mgr.14355) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:05 smithi171 bash[25040]: cluster 2024-09-14T05:34:04.426417+0000 mgr.a (mgr.14355) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:05 smithi007 bash[22722]: cluster 2024-09-14T05:34:04.426417+0000 mgr.a (mgr.14355) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:07 smithi131 bash[24745]: cluster 2024-09-14T05:34:06.428781+0000 mgr.a (mgr.14355) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:07 smithi171 bash[25040]: cluster 2024-09-14T05:34:06.428781+0000 mgr.a (mgr.14355) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:07 smithi007 bash[22722]: cluster 2024-09-14T05:34:06.428781+0000 mgr.a (mgr.14355) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:09.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:09.543 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:09 smithi131 bash[24745]: cluster 2024-09-14T05:34:08.429540+0000 mgr.a (mgr.14355) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:09 smithi171 bash[25040]: cluster 2024-09-14T05:34:08.429540+0000 mgr.a (mgr.14355) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:09 smithi007 bash[22722]: cluster 2024-09-14T05:34:08.429540+0000 mgr.a (mgr.14355) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:10.295 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:10.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:10.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:10.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:10.296 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:11.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:10 smithi171 bash[25040]: audit 2024-09-14T05:34:09.876031+0000 mgr.a (mgr.14355) 18734 : audit [DBG] from='client.401895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:11.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:10 smithi007 bash[22722]: audit 2024-09-14T05:34:09.876031+0000 mgr.a (mgr.14355) 18734 : audit [DBG] from='client.401895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:11.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:10 smithi131 bash[24745]: audit 2024-09-14T05:34:09.876031+0000 mgr.a (mgr.14355) 18734 : audit [DBG] from='client.401895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:12.048 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:11 smithi171 bash[25040]: cluster 2024-09-14T05:34:10.431428+0000 mgr.a (mgr.14355) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:11 smithi007 bash[22722]: cluster 2024-09-14T05:34:10.431428+0000 mgr.a (mgr.14355) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:11 smithi131 bash[24745]: cluster 2024-09-14T05:34:10.431428+0000 mgr.a (mgr.14355) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:14.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:13 smithi171 bash[25040]: cluster 2024-09-14T05:34:12.432697+0000 mgr.a (mgr.14355) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:13 smithi007 bash[22722]: cluster 2024-09-14T05:34:12.432697+0000 mgr.a (mgr.14355) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:13 smithi131 bash[24745]: cluster 2024-09-14T05:34:12.432697+0000 mgr.a (mgr.14355) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:15.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:15.297 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:15.298 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:15 smithi171 bash[25040]: cluster 2024-09-14T05:34:14.433452+0000 mgr.a (mgr.14355) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:16.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:16.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:16.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:15 smithi007 bash[22722]: cluster 2024-09-14T05:34:14.433452+0000 mgr.a (mgr.14355) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:15 smithi131 bash[24745]: cluster 2024-09-14T05:34:14.433452+0000 mgr.a (mgr.14355) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:17.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:16 smithi007 bash[22722]: audit 2024-09-14T05:34:15.636215+0000 mgr.a (mgr.14355) 18738 : audit [DBG] from='client.401970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:17.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:16 smithi131 bash[24745]: audit 2024-09-14T05:34:15.636215+0000 mgr.a (mgr.14355) 18738 : audit [DBG] from='client.401970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:17.297 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:16 smithi171 bash[25040]: audit 2024-09-14T05:34:15.636215+0000 mgr.a (mgr.14355) 18738 : audit [DBG] from='client.401970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:17 smithi007 bash[22722]: cluster 2024-09-14T05:34:16.436276+0000 mgr.a (mgr.14355) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:17 smithi131 bash[24745]: cluster 2024-09-14T05:34:16.436276+0000 mgr.a (mgr.14355) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:17 smithi171 bash[25040]: cluster 2024-09-14T05:34:16.436276+0000 mgr.a (mgr.14355) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:19 smithi007 bash[22722]: cluster 2024-09-14T05:34:18.437043+0000 mgr.a (mgr.14355) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:34:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:19 smithi131 bash[24745]: cluster 2024-09-14T05:34:18.437043+0000 mgr.a (mgr.14355) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:34:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:19 smithi171 bash[25040]: cluster 2024-09-14T05:34:18.437043+0000 mgr.a (mgr.14355) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:34:21.080 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:21.875 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:21.875 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:21 smithi007 bash[22722]: cluster 2024-09-14T05:34:20.438615+0000 mgr.a (mgr.14355) 18741 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:34:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:21 smithi007 bash[22722]: audit 2024-09-14T05:34:21.709726+0000 mon.a (mon.0) 3387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:34:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:21 smithi131 bash[24745]: cluster 2024-09-14T05:34:20.438615+0000 mgr.a (mgr.14355) 18741 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:34:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:21 smithi131 bash[24745]: audit 2024-09-14T05:34:21.709726+0000 mon.a (mon.0) 3387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:34:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:21 smithi171 bash[25040]: cluster 2024-09-14T05:34:20.438615+0000 mgr.a (mgr.14355) 18741 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:34:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:21 smithi171 bash[25040]: audit 2024-09-14T05:34:21.709726+0000 mon.a (mon.0) 3387 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:34:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:22 smithi007 bash[22722]: audit 2024-09-14T05:34:21.417429+0000 mgr.a (mgr.14355) 18742 : audit [DBG] from='client.402048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:22 smithi007 bash[22722]: audit 2024-09-14T05:34:22.523330+0000 mon.a (mon.0) 3388 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:34:23.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:22 smithi007 bash[22722]: audit 2024-09-14T05:34:22.525396+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:34:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:22 smithi007 bash[22722]: audit 2024-09-14T05:34:22.534433+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:34:23.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:22 smithi007 bash[22722]: audit 2024-09-14T05:34:22.539168+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:23.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:22 smithi131 bash[24745]: audit 2024-09-14T05:34:21.417429+0000 mgr.a (mgr.14355) 18742 : audit [DBG] from='client.402048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:22 smithi131 bash[24745]: audit 2024-09-14T05:34:22.523330+0000 mon.a (mon.0) 3388 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:34:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:22 smithi131 bash[24745]: audit 2024-09-14T05:34:22.525396+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:34:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:22 smithi131 bash[24745]: audit 2024-09-14T05:34:22.534433+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:34:23.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:22 smithi131 bash[24745]: audit 2024-09-14T05:34:22.539168+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:23.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:22 smithi171 bash[25040]: audit 2024-09-14T05:34:21.417429+0000 mgr.a (mgr.14355) 18742 : audit [DBG] from='client.402048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:22 smithi171 bash[25040]: audit 2024-09-14T05:34:22.523330+0000 mon.a (mon.0) 3388 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:34:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:22 smithi171 bash[25040]: audit 2024-09-14T05:34:22.525396+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:34:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:22 smithi171 bash[25040]: audit 2024-09-14T05:34:22.534433+0000 mon.a (mon.0) 3390 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:34:23.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:22 smithi171 bash[25040]: audit 2024-09-14T05:34:22.539168+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:34:23 smithi007 bash[22972]: debug 2024-09-14T05:34:23.285+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:34:23.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:34:23 smithi007 bash[22972]: debug 2024-09-14T05:34:23.285+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:34:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:23 smithi007 bash[22722]: cluster 2024-09-14T05:34:22.439680+0000 mgr.a (mgr.14355) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:34:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:23 smithi007 bash[22722]: audit 2024-09-14T05:34:22.541826+0000 mgr.a (mgr.14355) 18744 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:23 smithi131 bash[24745]: cluster 2024-09-14T05:34:22.439680+0000 mgr.a (mgr.14355) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:34:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:23 smithi131 bash[24745]: audit 2024-09-14T05:34:22.541826+0000 mgr.a (mgr.14355) 18744 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:23 smithi171 bash[25040]: cluster 2024-09-14T05:34:22.439680+0000 mgr.a (mgr.14355) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:34:24.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:23 smithi171 bash[25040]: audit 2024-09-14T05:34:22.541826+0000 mgr.a (mgr.14355) 18744 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:34:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:24 smithi007 bash[22722]: audit 2024-09-14T05:34:23.287891+0000 mgr.a (mgr.14355) 18745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:34:25.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:24 smithi007 bash[22722]: cephadm 2024-09-14T05:34:23.289870+0000 mgr.a (mgr.14355) 18746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:34:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:24 smithi131 bash[24745]: audit 2024-09-14T05:34:23.287891+0000 mgr.a (mgr.14355) 18745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:34:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:24 smithi131 bash[24745]: cephadm 2024-09-14T05:34:23.289870+0000 mgr.a (mgr.14355) 18746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:34:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:24 smithi171 bash[25040]: audit 2024-09-14T05:34:23.287891+0000 mgr.a (mgr.14355) 18745 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:34:25.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:24 smithi171 bash[25040]: cephadm 2024-09-14T05:34:23.289870+0000 mgr.a (mgr.14355) 18746 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:34:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:25 smithi007 bash[22722]: cluster 2024-09-14T05:34:24.440579+0000 mgr.a (mgr.14355) 18747 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:34:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:25 smithi131 bash[24745]: cluster 2024-09-14T05:34:24.440579+0000 mgr.a (mgr.14355) 18747 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:34:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:25 smithi171 bash[25040]: cluster 2024-09-14T05:34:24.440579+0000 mgr.a (mgr.14355) 18747 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:34:26.876 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:26.877 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:26.877 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:27.649 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:27.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:27.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:27.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:27.650 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:27 smithi007 bash[22722]: cluster 2024-09-14T05:34:26.442847+0000 mgr.a (mgr.14355) 18748 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:27 smithi131 bash[24745]: cluster 2024-09-14T05:34:26.442847+0000 mgr.a (mgr.14355) 18748 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:27 smithi171 bash[25040]: cluster 2024-09-14T05:34:26.442847+0000 mgr.a (mgr.14355) 18748 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:28 smithi007 bash[22722]: audit 2024-09-14T05:34:27.216218+0000 mgr.a (mgr.14355) 18749 : audit [DBG] from='client.402231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:28 smithi131 bash[24745]: audit 2024-09-14T05:34:27.216218+0000 mgr.a (mgr.14355) 18749 : audit [DBG] from='client.402231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:28 smithi171 bash[25040]: audit 2024-09-14T05:34:27.216218+0000 mgr.a (mgr.14355) 18749 : audit [DBG] from='client.402231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:29 smithi007 bash[22722]: cluster 2024-09-14T05:34:28.443747+0000 mgr.a (mgr.14355) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:29 smithi131 bash[24745]: cluster 2024-09-14T05:34:28.443747+0000 mgr.a (mgr.14355) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:29 smithi171 bash[25040]: cluster 2024-09-14T05:34:28.443747+0000 mgr.a (mgr.14355) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:31 smithi007 bash[22722]: cluster 2024-09-14T05:34:30.445531+0000 mgr.a (mgr.14355) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:31 smithi131 bash[24745]: cluster 2024-09-14T05:34:30.445531+0000 mgr.a (mgr.14355) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:31 smithi171 bash[25040]: cluster 2024-09-14T05:34:30.445531+0000 mgr.a (mgr.14355) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:32.651 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:32.652 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:33.404 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:33.404 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:33.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:33 smithi007 bash[22722]: cluster 2024-09-14T05:34:32.446828+0000 mgr.a (mgr.14355) 18752 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:33 smithi007 bash[22722]: audit 2024-09-14T05:34:32.982829+0000 mgr.a (mgr.14355) 18753 : audit [DBG] from='client.402309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:33 smithi131 bash[24745]: cluster 2024-09-14T05:34:32.446828+0000 mgr.a (mgr.14355) 18752 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:33 smithi131 bash[24745]: audit 2024-09-14T05:34:32.982829+0000 mgr.a (mgr.14355) 18753 : audit [DBG] from='client.402309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:33 smithi171 bash[25040]: cluster 2024-09-14T05:34:32.446828+0000 mgr.a (mgr.14355) 18752 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:33 smithi171 bash[25040]: audit 2024-09-14T05:34:32.982829+0000 mgr.a (mgr.14355) 18753 : audit [DBG] from='client.402309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:35 smithi007 bash[22722]: cluster 2024-09-14T05:34:34.447727+0000 mgr.a (mgr.14355) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:35 smithi131 bash[24745]: cluster 2024-09-14T05:34:34.447727+0000 mgr.a (mgr.14355) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:35 smithi171 bash[25040]: cluster 2024-09-14T05:34:34.447727+0000 mgr.a (mgr.14355) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:37 smithi131 bash[24745]: cluster 2024-09-14T05:34:36.450071+0000 mgr.a (mgr.14355) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:37 smithi171 bash[25040]: cluster 2024-09-14T05:34:36.450071+0000 mgr.a (mgr.14355) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:38.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:37 smithi007 bash[22722]: cluster 2024-09-14T05:34:36.450071+0000 mgr.a (mgr.14355) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:34:39.194 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:39 smithi131 bash[24745]: cluster 2024-09-14T05:34:38.450836+0000 mgr.a (mgr.14355) 18756 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:39 smithi131 bash[24745]: audit 2024-09-14T05:34:38.745272+0000 mgr.a (mgr.14355) 18757 : audit [DBG] from='client.402381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:39 smithi171 bash[25040]: cluster 2024-09-14T05:34:38.450836+0000 mgr.a (mgr.14355) 18756 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:39 smithi171 bash[25040]: audit 2024-09-14T05:34:38.745272+0000 mgr.a (mgr.14355) 18757 : audit [DBG] from='client.402381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:39 smithi007 bash[22722]: cluster 2024-09-14T05:34:38.450836+0000 mgr.a (mgr.14355) 18756 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:39 smithi007 bash[22722]: audit 2024-09-14T05:34:38.745272+0000 mgr.a (mgr.14355) 18757 : audit [DBG] from='client.402381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:42 smithi131 bash[24745]: cluster 2024-09-14T05:34:40.452687+0000 mgr.a (mgr.14355) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:42 smithi171 bash[25040]: cluster 2024-09-14T05:34:40.452687+0000 mgr.a (mgr.14355) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:42 smithi007 bash[22722]: cluster 2024-09-14T05:34:40.452687+0000 mgr.a (mgr.14355) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:34:44.195 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:44.196 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:44 smithi131 bash[24745]: cluster 2024-09-14T05:34:42.453883+0000 mgr.a (mgr.14355) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:44 smithi171 bash[25040]: cluster 2024-09-14T05:34:42.453883+0000 mgr.a (mgr.14355) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:44 smithi007 bash[22722]: cluster 2024-09-14T05:34:42.453883+0000 mgr.a (mgr.14355) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:34:44.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:46 smithi131 bash[24745]: cluster 2024-09-14T05:34:44.454710+0000 mgr.a (mgr.14355) 18760 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:46 smithi131 bash[24745]: audit 2024-09-14T05:34:44.535741+0000 mgr.a (mgr.14355) 18761 : audit [DBG] from='client.402456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:46 smithi171 bash[25040]: cluster 2024-09-14T05:34:44.454710+0000 mgr.a (mgr.14355) 18760 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:46 smithi171 bash[25040]: audit 2024-09-14T05:34:44.535741+0000 mgr.a (mgr.14355) 18761 : audit [DBG] from='client.402456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:46 smithi007 bash[22722]: cluster 2024-09-14T05:34:44.454710+0000 mgr.a (mgr.14355) 18760 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:46 smithi007 bash[22722]: audit 2024-09-14T05:34:44.535741+0000 mgr.a (mgr.14355) 18761 : audit [DBG] from='client.402456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:48 smithi131 bash[24745]: cluster 2024-09-14T05:34:46.457018+0000 mgr.a (mgr.14355) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:48 smithi171 bash[25040]: cluster 2024-09-14T05:34:46.457018+0000 mgr.a (mgr.14355) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:48 smithi007 bash[22722]: cluster 2024-09-14T05:34:46.457018+0000 mgr.a (mgr.14355) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:34:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:50 smithi131 bash[24745]: cluster 2024-09-14T05:34:48.457811+0000 mgr.a (mgr.14355) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:50 smithi171 bash[25040]: cluster 2024-09-14T05:34:48.457811+0000 mgr.a (mgr.14355) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:50 smithi007 bash[22722]: cluster 2024-09-14T05:34:48.457811+0000 mgr.a (mgr.14355) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:50.772 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:52 smithi131 bash[24745]: audit 2024-09-14T05:34:50.323803+0000 mgr.a (mgr.14355) 18764 : audit [DBG] from='client.402531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:52 smithi131 bash[24745]: cluster 2024-09-14T05:34:50.468901+0000 mgr.a (mgr.14355) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:52 smithi171 bash[25040]: audit 2024-09-14T05:34:50.323803+0000 mgr.a (mgr.14355) 18764 : audit [DBG] from='client.402531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:52 smithi171 bash[25040]: cluster 2024-09-14T05:34:50.468901+0000 mgr.a (mgr.14355) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:52 smithi007 bash[22722]: audit 2024-09-14T05:34:50.323803+0000 mgr.a (mgr.14355) 18764 : audit [DBG] from='client.402531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:52 smithi007 bash[22722]: cluster 2024-09-14T05:34:50.468901+0000 mgr.a (mgr.14355) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:54 smithi131 bash[24745]: cluster 2024-09-14T05:34:52.470652+0000 mgr.a (mgr.14355) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:34:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:54 smithi171 bash[25040]: cluster 2024-09-14T05:34:52.470652+0000 mgr.a (mgr.14355) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:34:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:54 smithi007 bash[22722]: cluster 2024-09-14T05:34:52.470652+0000 mgr.a (mgr.14355) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:34:55.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:34:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:34:55.774 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:34:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:56 smithi131 bash[24745]: cluster 2024-09-14T05:34:54.471404+0000 mgr.a (mgr.14355) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:34:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:56 smithi171 bash[25040]: cluster 2024-09-14T05:34:54.471404+0000 mgr.a (mgr.14355) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:34:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:56 smithi007 bash[22722]: cluster 2024-09-14T05:34:54.471404+0000 mgr.a (mgr.14355) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:34:56.523 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:34:56.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:34:56.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:34:56.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:34:56.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:34:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:57 smithi171 bash[25040]: audit 2024-09-14T05:34:56.105532+0000 mgr.a (mgr.14355) 18768 : audit [DBG] from='client.402609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:57 smithi007 bash[22722]: audit 2024-09-14T05:34:56.105532+0000 mgr.a (mgr.14355) 18768 : audit [DBG] from='client.402609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:57 smithi131 bash[24745]: audit 2024-09-14T05:34:56.105532+0000 mgr.a (mgr.14355) 18768 : audit [DBG] from='client.402609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:34:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:34:58 smithi171 bash[25040]: cluster 2024-09-14T05:34:56.472706+0000 mgr.a (mgr.14355) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:34:58 smithi007 bash[22722]: cluster 2024-09-14T05:34:56.472706+0000 mgr.a (mgr.14355) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:34:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:34:58 smithi131 bash[24745]: cluster 2024-09-14T05:34:56.472706+0000 mgr.a (mgr.14355) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:00 smithi007 bash[22722]: cluster 2024-09-14T05:34:58.473449+0000 mgr.a (mgr.14355) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:00 smithi131 bash[24745]: cluster 2024-09-14T05:34:58.473449+0000 mgr.a (mgr.14355) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:00 smithi171 bash[25040]: cluster 2024-09-14T05:34:58.473449+0000 mgr.a (mgr.14355) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:01.525 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:01.526 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:02.277 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:02.278 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:02.278 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:02 smithi007 bash[22722]: cluster 2024-09-14T05:35:00.475049+0000 mgr.a (mgr.14355) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:02 smithi131 bash[24745]: cluster 2024-09-14T05:35:00.475049+0000 mgr.a (mgr.14355) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:02 smithi171 bash[25040]: cluster 2024-09-14T05:35:00.475049+0000 mgr.a (mgr.14355) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:03.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:03 smithi007 bash[22722]: audit 2024-09-14T05:35:01.849624+0000 mgr.a (mgr.14355) 18772 : audit [DBG] from='client.402684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:03 smithi131 bash[24745]: audit 2024-09-14T05:35:01.849624+0000 mgr.a (mgr.14355) 18772 : audit [DBG] from='client.402684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:03 smithi171 bash[25040]: audit 2024-09-14T05:35:01.849624+0000 mgr.a (mgr.14355) 18772 : audit [DBG] from='client.402684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:04 smithi007 bash[22722]: cluster 2024-09-14T05:35:02.476812+0000 mgr.a (mgr.14355) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:04 smithi131 bash[24745]: cluster 2024-09-14T05:35:02.476812+0000 mgr.a (mgr.14355) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:04 smithi171 bash[25040]: cluster 2024-09-14T05:35:02.476812+0000 mgr.a (mgr.14355) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:06 smithi007 bash[22722]: cluster 2024-09-14T05:35:04.477564+0000 mgr.a (mgr.14355) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:35:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:06 smithi131 bash[24745]: cluster 2024-09-14T05:35:04.477564+0000 mgr.a (mgr.14355) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:35:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:06 smithi171 bash[25040]: cluster 2024-09-14T05:35:04.477564+0000 mgr.a (mgr.14355) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:35:07.279 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:07.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:07.280 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:08.032 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:08 smithi007 bash[22722]: cluster 2024-09-14T05:35:06.479668+0000 mgr.a (mgr.14355) 18775 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:35:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:08 smithi131 bash[24745]: cluster 2024-09-14T05:35:06.479668+0000 mgr.a (mgr.14355) 18775 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:35:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:08 smithi171 bash[25040]: cluster 2024-09-14T05:35:06.479668+0000 mgr.a (mgr.14355) 18775 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-14T05:35:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:09 smithi007 bash[22722]: audit 2024-09-14T05:35:07.607635+0000 mgr.a (mgr.14355) 18776 : audit [DBG] from='client.402762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:09 smithi131 bash[24745]: audit 2024-09-14T05:35:07.607635+0000 mgr.a (mgr.14355) 18776 : audit [DBG] from='client.402762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:09 smithi171 bash[25040]: audit 2024-09-14T05:35:07.607635+0000 mgr.a (mgr.14355) 18776 : audit [DBG] from='client.402762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:10 smithi007 bash[22722]: cluster 2024-09-14T05:35:08.480541+0000 mgr.a (mgr.14355) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:10 smithi131 bash[24745]: cluster 2024-09-14T05:35:08.480541+0000 mgr.a (mgr.14355) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:10 smithi171 bash[25040]: cluster 2024-09-14T05:35:08.480541+0000 mgr.a (mgr.14355) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:12 smithi007 bash[22722]: cluster 2024-09-14T05:35:10.482344+0000 mgr.a (mgr.14355) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:12 smithi131 bash[24745]: cluster 2024-09-14T05:35:10.482344+0000 mgr.a (mgr.14355) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:12 smithi171 bash[25040]: cluster 2024-09-14T05:35:10.482344+0000 mgr.a (mgr.14355) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:13.033 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:13.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:13.034 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:13.805 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:13.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:13.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:13.805 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:13.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:14 smithi007 bash[22722]: cluster 2024-09-14T05:35:12.483547+0000 mgr.a (mgr.14355) 18779 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:14 smithi131 bash[24745]: cluster 2024-09-14T05:35:12.483547+0000 mgr.a (mgr.14355) 18779 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:14 smithi171 bash[25040]: cluster 2024-09-14T05:35:12.483547+0000 mgr.a (mgr.14355) 18779 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:15 smithi007 bash[22722]: audit 2024-09-14T05:35:13.364666+0000 mgr.a (mgr.14355) 18780 : audit [DBG] from='client.402834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:15 smithi131 bash[24745]: audit 2024-09-14T05:35:13.364666+0000 mgr.a (mgr.14355) 18780 : audit [DBG] from='client.402834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:15.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:15 smithi171 bash[25040]: audit 2024-09-14T05:35:13.364666+0000 mgr.a (mgr.14355) 18780 : audit [DBG] from='client.402834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:16 smithi007 bash[22722]: cluster 2024-09-14T05:35:14.484439+0000 mgr.a (mgr.14355) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:16 smithi131 bash[24745]: cluster 2024-09-14T05:35:14.484439+0000 mgr.a (mgr.14355) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:16 smithi171 bash[25040]: cluster 2024-09-14T05:35:14.484439+0000 mgr.a (mgr.14355) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:18 smithi007 bash[22722]: cluster 2024-09-14T05:35:16.486722+0000 mgr.a (mgr.14355) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:18 smithi131 bash[24745]: cluster 2024-09-14T05:35:16.486722+0000 mgr.a (mgr.14355) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:18 smithi171 bash[25040]: cluster 2024-09-14T05:35:16.486722+0000 mgr.a (mgr.14355) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:19.595 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:19.595 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:20 smithi007 bash[22722]: cluster 2024-09-14T05:35:18.487460+0000 mgr.a (mgr.14355) 18783 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:20 smithi131 bash[24745]: cluster 2024-09-14T05:35:18.487460+0000 mgr.a (mgr.14355) 18783 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:20 smithi171 bash[25040]: cluster 2024-09-14T05:35:18.487460+0000 mgr.a (mgr.14355) 18783 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:21 smithi007 bash[22722]: audit 2024-09-14T05:35:19.149186+0000 mgr.a (mgr.14355) 18784 : audit [DBG] from='client.402912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:21 smithi131 bash[24745]: audit 2024-09-14T05:35:19.149186+0000 mgr.a (mgr.14355) 18784 : audit [DBG] from='client.402912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:21 smithi171 bash[25040]: audit 2024-09-14T05:35:19.149186+0000 mgr.a (mgr.14355) 18784 : audit [DBG] from='client.402912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:22 smithi007 bash[22722]: cluster 2024-09-14T05:35:20.489331+0000 mgr.a (mgr.14355) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:22 smithi131 bash[24745]: cluster 2024-09-14T05:35:20.489331+0000 mgr.a (mgr.14355) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:22 smithi171 bash[25040]: cluster 2024-09-14T05:35:20.489331+0000 mgr.a (mgr.14355) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:24 smithi007 bash[22722]: cluster 2024-09-14T05:35:22.490633+0000 mgr.a (mgr.14355) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:24 smithi007 bash[22722]: audit 2024-09-14T05:35:23.347684+0000 mon.a (mon.0) 3392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:35:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:24 smithi131 bash[24745]: cluster 2024-09-14T05:35:22.490633+0000 mgr.a (mgr.14355) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:24 smithi131 bash[24745]: audit 2024-09-14T05:35:23.347684+0000 mon.a (mon.0) 3392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:35:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:24 smithi171 bash[25040]: cluster 2024-09-14T05:35:22.490633+0000 mgr.a (mgr.14355) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:24 smithi171 bash[25040]: audit 2024-09-14T05:35:23.347684+0000 mon.a (mon.0) 3392 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:35:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:24.596 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:24.597 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:25.373 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:25.374 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:25.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:35:24 smithi007 bash[22972]: debug 2024-09-14T05:35:24.961+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:35:25.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:35:24 smithi007 bash[22972]: debug 2024-09-14T05:35:24.973+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:35:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:25 smithi007 bash[22722]: audit 2024-09-14T05:35:24.183405+0000 mon.a (mon.0) 3393 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:35:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:25 smithi007 bash[22722]: audit 2024-09-14T05:35:24.184681+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:35:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:25 smithi007 bash[22722]: audit 2024-09-14T05:35:24.191558+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:35:25.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:25 smithi007 bash[22722]: audit 2024-09-14T05:35:24.196270+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:25 smithi131 bash[24745]: audit 2024-09-14T05:35:24.183405+0000 mon.a (mon.0) 3393 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:35:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:25 smithi131 bash[24745]: audit 2024-09-14T05:35:24.184681+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:35:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:25 smithi131 bash[24745]: audit 2024-09-14T05:35:24.191558+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:35:25.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:25 smithi131 bash[24745]: audit 2024-09-14T05:35:24.196270+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:25 smithi171 bash[25040]: audit 2024-09-14T05:35:24.183405+0000 mon.a (mon.0) 3393 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:35:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:25 smithi171 bash[25040]: audit 2024-09-14T05:35:24.184681+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:35:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:25 smithi171 bash[25040]: audit 2024-09-14T05:35:24.191558+0000 mon.a (mon.0) 3395 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:35:25.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:25 smithi171 bash[25040]: audit 2024-09-14T05:35:24.196270+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:26 smithi007 bash[22722]: audit 2024-09-14T05:35:24.198549+0000 mgr.a (mgr.14355) 18787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:26 smithi007 bash[22722]: cluster 2024-09-14T05:35:24.491262+0000 mgr.a (mgr.14355) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:26 smithi007 bash[22722]: audit 2024-09-14T05:35:24.924630+0000 mgr.a (mgr.14355) 18789 : audit [DBG] from='client.403059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:26 smithi007 bash[22722]: audit 2024-09-14T05:35:24.963307+0000 mgr.a (mgr.14355) 18790 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:35:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:26 smithi007 bash[22722]: cephadm 2024-09-14T05:35:24.977952+0000 mgr.a (mgr.14355) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:35:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:26 smithi131 bash[24745]: audit 2024-09-14T05:35:24.198549+0000 mgr.a (mgr.14355) 18787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:26 smithi131 bash[24745]: cluster 2024-09-14T05:35:24.491262+0000 mgr.a (mgr.14355) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:26 smithi131 bash[24745]: audit 2024-09-14T05:35:24.924630+0000 mgr.a (mgr.14355) 18789 : audit [DBG] from='client.403059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:26 smithi131 bash[24745]: audit 2024-09-14T05:35:24.963307+0000 mgr.a (mgr.14355) 18790 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:35:26.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:26 smithi131 bash[24745]: cephadm 2024-09-14T05:35:24.977952+0000 mgr.a (mgr.14355) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:35:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:26 smithi171 bash[25040]: audit 2024-09-14T05:35:24.198549+0000 mgr.a (mgr.14355) 18787 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:35:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:26 smithi171 bash[25040]: cluster 2024-09-14T05:35:24.491262+0000 mgr.a (mgr.14355) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:26 smithi171 bash[25040]: audit 2024-09-14T05:35:24.924630+0000 mgr.a (mgr.14355) 18789 : audit [DBG] from='client.403059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:26 smithi171 bash[25040]: audit 2024-09-14T05:35:24.963307+0000 mgr.a (mgr.14355) 18790 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:35:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:26 smithi171 bash[25040]: cephadm 2024-09-14T05:35:24.977952+0000 mgr.a (mgr.14355) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:35:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:27 smithi007 bash[22722]: cluster 2024-09-14T05:35:26.493605+0000 mgr.a (mgr.14355) 18792 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:27 smithi131 bash[24745]: cluster 2024-09-14T05:35:26.493605+0000 mgr.a (mgr.14355) 18792 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:27 smithi171 bash[25040]: cluster 2024-09-14T05:35:26.493605+0000 mgr.a (mgr.14355) 18792 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:29 smithi007 bash[22722]: cluster 2024-09-14T05:35:28.494482+0000 mgr.a (mgr.14355) 18793 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:29 smithi131 bash[24745]: cluster 2024-09-14T05:35:28.494482+0000 mgr.a (mgr.14355) 18793 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:29 smithi171 bash[25040]: cluster 2024-09-14T05:35:28.494482+0000 mgr.a (mgr.14355) 18793 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:31.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:31.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:31 smithi007 bash[22722]: cluster 2024-09-14T05:35:30.495586+0000 mgr.a (mgr.14355) 18794 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:31.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:31 smithi007 bash[22722]: audit 2024-09-14T05:35:30.713864+0000 mgr.a (mgr.14355) 18795 : audit [DBG] from='client.403170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:31 smithi131 bash[24745]: cluster 2024-09-14T05:35:30.495586+0000 mgr.a (mgr.14355) 18794 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:31 smithi131 bash[24745]: audit 2024-09-14T05:35:30.713864+0000 mgr.a (mgr.14355) 18795 : audit [DBG] from='client.403170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:31 smithi171 bash[25040]: cluster 2024-09-14T05:35:30.495586+0000 mgr.a (mgr.14355) 18794 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:31 smithi171 bash[25040]: audit 2024-09-14T05:35:30.713864+0000 mgr.a (mgr.14355) 18795 : audit [DBG] from='client.403170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:33 smithi007 bash[22722]: cluster 2024-09-14T05:35:32.497284+0000 mgr.a (mgr.14355) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:33 smithi131 bash[24745]: cluster 2024-09-14T05:35:32.497284+0000 mgr.a (mgr.14355) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:33 smithi171 bash[25040]: cluster 2024-09-14T05:35:32.497284+0000 mgr.a (mgr.14355) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:35 smithi007 bash[22722]: cluster 2024-09-14T05:35:34.498050+0000 mgr.a (mgr.14355) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:35 smithi131 bash[24745]: cluster 2024-09-14T05:35:34.498050+0000 mgr.a (mgr.14355) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:35 smithi171 bash[25040]: cluster 2024-09-14T05:35:34.498050+0000 mgr.a (mgr.14355) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:35:36.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:36.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:36.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:36.944 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:36.944 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:37 smithi007 bash[22722]: audit 2024-09-14T05:35:36.496236+0000 mgr.a (mgr.14355) 18798 : audit [DBG] from='client.403245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:37 smithi007 bash[22722]: cluster 2024-09-14T05:35:36.511033+0000 mgr.a (mgr.14355) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:37 smithi131 bash[24745]: audit 2024-09-14T05:35:36.496236+0000 mgr.a (mgr.14355) 18798 : audit [DBG] from='client.403245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:37 smithi131 bash[24745]: cluster 2024-09-14T05:35:36.511033+0000 mgr.a (mgr.14355) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:37 smithi171 bash[25040]: audit 2024-09-14T05:35:36.496236+0000 mgr.a (mgr.14355) 18798 : audit [DBG] from='client.403245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:37 smithi171 bash[25040]: cluster 2024-09-14T05:35:36.511033+0000 mgr.a (mgr.14355) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:35:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:39 smithi007 bash[22722]: cluster 2024-09-14T05:35:38.512033+0000 mgr.a (mgr.14355) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:39 smithi131 bash[24745]: cluster 2024-09-14T05:35:38.512033+0000 mgr.a (mgr.14355) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:39 smithi171 bash[25040]: cluster 2024-09-14T05:35:38.512033+0000 mgr.a (mgr.14355) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:35:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:41.946 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:41 smithi007 bash[22722]: cluster 2024-09-14T05:35:40.513794+0000 mgr.a (mgr.14355) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:41 smithi131 bash[24745]: cluster 2024-09-14T05:35:40.513794+0000 mgr.a (mgr.14355) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:41 smithi171 bash[25040]: cluster 2024-09-14T05:35:40.513794+0000 mgr.a (mgr.14355) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:35:42.708 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:43 smithi007 bash[22722]: audit 2024-09-14T05:35:42.283985+0000 mgr.a (mgr.14355) 18802 : audit [DBG] from='client.403317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:43.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:43 smithi007 bash[22722]: cluster 2024-09-14T05:35:42.514783+0000 mgr.a (mgr.14355) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:43 smithi131 bash[24745]: audit 2024-09-14T05:35:42.283985+0000 mgr.a (mgr.14355) 18802 : audit [DBG] from='client.403317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:43 smithi131 bash[24745]: cluster 2024-09-14T05:35:42.514783+0000 mgr.a (mgr.14355) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:43 smithi171 bash[25040]: audit 2024-09-14T05:35:42.283985+0000 mgr.a (mgr.14355) 18802 : audit [DBG] from='client.403317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:43 smithi171 bash[25040]: cluster 2024-09-14T05:35:42.514783+0000 mgr.a (mgr.14355) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:45 smithi007 bash[22722]: cluster 2024-09-14T05:35:44.515628+0000 mgr.a (mgr.14355) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:45 smithi131 bash[24745]: cluster 2024-09-14T05:35:44.515628+0000 mgr.a (mgr.14355) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:45 smithi171 bash[25040]: cluster 2024-09-14T05:35:44.515628+0000 mgr.a (mgr.14355) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:47.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:47.710 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:47 smithi007 bash[22722]: cluster 2024-09-14T05:35:46.517868+0000 mgr.a (mgr.14355) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:47 smithi131 bash[24745]: cluster 2024-09-14T05:35:46.517868+0000 mgr.a (mgr.14355) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:48.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:47 smithi171 bash[25040]: cluster 2024-09-14T05:35:46.517868+0000 mgr.a (mgr.14355) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:48.458 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:48.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:48 smithi007 bash[22722]: audit 2024-09-14T05:35:48.037909+0000 mgr.a (mgr.14355) 18806 : audit [DBG] from='client.403395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:49.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:48 smithi131 bash[24745]: audit 2024-09-14T05:35:48.037909+0000 mgr.a (mgr.14355) 18806 : audit [DBG] from='client.403395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:49.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:48 smithi171 bash[25040]: audit 2024-09-14T05:35:48.037909+0000 mgr.a (mgr.14355) 18806 : audit [DBG] from='client.403395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:49 smithi007 bash[22722]: cluster 2024-09-14T05:35:48.518460+0000 mgr.a (mgr.14355) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:49 smithi131 bash[24745]: cluster 2024-09-14T05:35:48.518460+0000 mgr.a (mgr.14355) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:49 smithi171 bash[25040]: cluster 2024-09-14T05:35:48.518460+0000 mgr.a (mgr.14355) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:51 smithi007 bash[22722]: cluster 2024-09-14T05:35:50.520284+0000 mgr.a (mgr.14355) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:51 smithi131 bash[24745]: cluster 2024-09-14T05:35:50.520284+0000 mgr.a (mgr.14355) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:51 smithi171 bash[25040]: cluster 2024-09-14T05:35:50.520284+0000 mgr.a (mgr.14355) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:35:53.459 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:53.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:53.460 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:53 smithi007 bash[22722]: cluster 2024-09-14T05:35:52.521717+0000 mgr.a (mgr.14355) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:53 smithi131 bash[24745]: cluster 2024-09-14T05:35:52.521717+0000 mgr.a (mgr.14355) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:53 smithi171 bash[25040]: cluster 2024-09-14T05:35:52.521717+0000 mgr.a (mgr.14355) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:35:54.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:35:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:35:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:35:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:35:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:35:54.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:54 smithi007 bash[22722]: audit 2024-09-14T05:35:53.798286+0000 mgr.a (mgr.14355) 18810 : audit [DBG] from='client.403473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:55.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:54 smithi131 bash[24745]: audit 2024-09-14T05:35:53.798286+0000 mgr.a (mgr.14355) 18810 : audit [DBG] from='client.403473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:55.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:54 smithi171 bash[25040]: audit 2024-09-14T05:35:53.798286+0000 mgr.a (mgr.14355) 18810 : audit [DBG] from='client.403473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:35:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:55 smithi007 bash[22722]: cluster 2024-09-14T05:35:54.522750+0000 mgr.a (mgr.14355) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:55 smithi131 bash[24745]: cluster 2024-09-14T05:35:54.522750+0000 mgr.a (mgr.14355) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:55 smithi171 bash[25040]: cluster 2024-09-14T05:35:54.522750+0000 mgr.a (mgr.14355) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:35:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:57 smithi007 bash[22722]: cluster 2024-09-14T05:35:56.525017+0000 mgr.a (mgr.14355) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:58.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:57 smithi131 bash[24745]: cluster 2024-09-14T05:35:56.525017+0000 mgr.a (mgr.14355) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:57 smithi171 bash[25040]: cluster 2024-09-14T05:35:56.525017+0000 mgr.a (mgr.14355) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:35:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:35:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:35:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:35:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:35:59 smithi007 bash[22722]: cluster 2024-09-14T05:35:58.525795+0000 mgr.a (mgr.14355) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:00.004 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:00.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:35:59 smithi131 bash[24745]: cluster 2024-09-14T05:35:58.525795+0000 mgr.a (mgr.14355) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:00.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:35:59 smithi171 bash[25040]: cluster 2024-09-14T05:35:58.525795+0000 mgr.a (mgr.14355) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:00 smithi007 bash[22722]: audit 2024-09-14T05:35:59.574805+0000 mgr.a (mgr.14355) 18814 : audit [DBG] from='client.403548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:01.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:00 smithi131 bash[24745]: audit 2024-09-14T05:35:59.574805+0000 mgr.a (mgr.14355) 18814 : audit [DBG] from='client.403548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:01.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:00 smithi171 bash[25040]: audit 2024-09-14T05:35:59.574805+0000 mgr.a (mgr.14355) 18814 : audit [DBG] from='client.403548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:01 smithi007 bash[22722]: cluster 2024-09-14T05:36:00.527765+0000 mgr.a (mgr.14355) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:36:02.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:01 smithi131 bash[24745]: cluster 2024-09-14T05:36:00.527765+0000 mgr.a (mgr.14355) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:36:02.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:01 smithi171 bash[25040]: cluster 2024-09-14T05:36:00.527765+0000 mgr.a (mgr.14355) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-14T05:36:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:03 smithi007 bash[22722]: cluster 2024-09-14T05:36:02.529034+0000 mgr.a (mgr.14355) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:36:04.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:03 smithi131 bash[24745]: cluster 2024-09-14T05:36:02.529034+0000 mgr.a (mgr.14355) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:36:04.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:03 smithi171 bash[25040]: cluster 2024-09-14T05:36:02.529034+0000 mgr.a (mgr.14355) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:36:05.006 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:05.007 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:05.794 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:05 smithi007 bash[22722]: cluster 2024-09-14T05:36:04.529768+0000 mgr.a (mgr.14355) 18817 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:06.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:05 smithi131 bash[24745]: cluster 2024-09-14T05:36:04.529768+0000 mgr.a (mgr.14355) 18817 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:06.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:05 smithi171 bash[25040]: cluster 2024-09-14T05:36:04.529768+0000 mgr.a (mgr.14355) 18817 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:06 smithi007 bash[22722]: audit 2024-09-14T05:36:05.341143+0000 mgr.a (mgr.14355) 18818 : audit [DBG] from='client.403620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:07.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:06 smithi131 bash[24745]: audit 2024-09-14T05:36:05.341143+0000 mgr.a (mgr.14355) 18818 : audit [DBG] from='client.403620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:07.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:06 smithi171 bash[25040]: audit 2024-09-14T05:36:05.341143+0000 mgr.a (mgr.14355) 18818 : audit [DBG] from='client.403620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:07 smithi007 bash[22722]: cluster 2024-09-14T05:36:06.532557+0000 mgr.a (mgr.14355) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:36:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:07 smithi131 bash[24745]: cluster 2024-09-14T05:36:06.532557+0000 mgr.a (mgr.14355) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:36:08.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:07 smithi171 bash[25040]: cluster 2024-09-14T05:36:06.532557+0000 mgr.a (mgr.14355) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:36:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:09 smithi007 bash[22722]: cluster 2024-09-14T05:36:08.533315+0000 mgr.a (mgr.14355) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:36:10.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:09 smithi131 bash[24745]: cluster 2024-09-14T05:36:08.533315+0000 mgr.a (mgr.14355) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:36:10.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:09 smithi171 bash[25040]: cluster 2024-09-14T05:36:08.533315+0000 mgr.a (mgr.14355) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:36:10.795 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:10.796 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:11.561 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:11.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:11.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:11.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:11.561 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:11 smithi007 bash[22722]: cluster 2024-09-14T05:36:10.534914+0000 mgr.a (mgr.14355) 18821 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:36:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:11 smithi007 bash[22722]: audit 2024-09-14T05:36:11.130174+0000 mgr.a (mgr.14355) 18822 : audit [DBG] from='client.403695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:11 smithi131 bash[24745]: cluster 2024-09-14T05:36:10.534914+0000 mgr.a (mgr.14355) 18821 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:36:12.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:11 smithi131 bash[24745]: audit 2024-09-14T05:36:11.130174+0000 mgr.a (mgr.14355) 18822 : audit [DBG] from='client.403695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:12.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:11 smithi171 bash[25040]: cluster 2024-09-14T05:36:10.534914+0000 mgr.a (mgr.14355) 18821 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:36:12.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:11 smithi171 bash[25040]: audit 2024-09-14T05:36:11.130174+0000 mgr.a (mgr.14355) 18822 : audit [DBG] from='client.403695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:13 smithi007 bash[22722]: cluster 2024-09-14T05:36:12.536726+0000 mgr.a (mgr.14355) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:36:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:13 smithi131 bash[24745]: cluster 2024-09-14T05:36:12.536726+0000 mgr.a (mgr.14355) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:36:14.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:13 smithi171 bash[25040]: cluster 2024-09-14T05:36:12.536726+0000 mgr.a (mgr.14355) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:36:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:15 smithi007 bash[22722]: cluster 2024-09-14T05:36:14.537526+0000 mgr.a (mgr.14355) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:15 smithi131 bash[24745]: cluster 2024-09-14T05:36:14.537526+0000 mgr.a (mgr.14355) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:16.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:15 smithi171 bash[25040]: cluster 2024-09-14T05:36:14.537526+0000 mgr.a (mgr.14355) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:17.334 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:17.335 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:17 smithi007 bash[22722]: cluster 2024-09-14T05:36:16.539570+0000 mgr.a (mgr.14355) 18825 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:17 smithi007 bash[22722]: audit 2024-09-14T05:36:16.895934+0000 mgr.a (mgr.14355) 18826 : audit [DBG] from='client.403773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:17 smithi131 bash[24745]: cluster 2024-09-14T05:36:16.539570+0000 mgr.a (mgr.14355) 18825 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:18.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:17 smithi131 bash[24745]: audit 2024-09-14T05:36:16.895934+0000 mgr.a (mgr.14355) 18826 : audit [DBG] from='client.403773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:17 smithi171 bash[25040]: cluster 2024-09-14T05:36:16.539570+0000 mgr.a (mgr.14355) 18825 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:18.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:17 smithi171 bash[25040]: audit 2024-09-14T05:36:16.895934+0000 mgr.a (mgr.14355) 18826 : audit [DBG] from='client.403773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:19 smithi007 bash[22722]: cluster 2024-09-14T05:36:18.540524+0000 mgr.a (mgr.14355) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:36:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:19 smithi131 bash[24745]: cluster 2024-09-14T05:36:18.540524+0000 mgr.a (mgr.14355) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:36:20.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:19 smithi171 bash[25040]: cluster 2024-09-14T05:36:18.540524+0000 mgr.a (mgr.14355) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-14T05:36:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:21 smithi007 bash[22722]: cluster 2024-09-14T05:36:20.542310+0000 mgr.a (mgr.14355) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:36:22.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:21 smithi131 bash[24745]: cluster 2024-09-14T05:36:20.542310+0000 mgr.a (mgr.14355) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:36:22.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:21 smithi171 bash[25040]: cluster 2024-09-14T05:36:20.542310+0000 mgr.a (mgr.14355) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:36:22.336 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:22.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:22.337 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:23.093 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:23.094 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:23 smithi007 bash[22722]: cluster 2024-09-14T05:36:22.543315+0000 mgr.a (mgr.14355) 18829 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:36:23.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:23 smithi007 bash[22722]: audit 2024-09-14T05:36:22.671162+0000 mgr.a (mgr.14355) 18830 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:23 smithi131 bash[24745]: cluster 2024-09-14T05:36:22.543315+0000 mgr.a (mgr.14355) 18829 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:36:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:23 smithi131 bash[24745]: audit 2024-09-14T05:36:22.671162+0000 mgr.a (mgr.14355) 18830 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:23 smithi171 bash[25040]: cluster 2024-09-14T05:36:22.543315+0000 mgr.a (mgr.14355) 18829 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:36:24.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:23 smithi171 bash[25040]: audit 2024-09-14T05:36:22.671162+0000 mgr.a (mgr.14355) 18830 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:25 smithi007 bash[22722]: cluster 2024-09-14T05:36:24.544297+0000 mgr.a (mgr.14355) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:25 smithi007 bash[22722]: audit 2024-09-14T05:36:25.042635+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:36:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:25 smithi007 bash[22722]: audit 2024-09-14T05:36:25.654542+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:25.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:25 smithi007 bash[22722]: audit 2024-09-14T05:36:25.658337+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:25 smithi131 bash[24745]: cluster 2024-09-14T05:36:24.544297+0000 mgr.a (mgr.14355) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:25 smithi131 bash[24745]: audit 2024-09-14T05:36:25.042635+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:36:26.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:25 smithi131 bash[24745]: audit 2024-09-14T05:36:25.654542+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:25 smithi131 bash[24745]: audit 2024-09-14T05:36:25.658337+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:25 smithi171 bash[25040]: cluster 2024-09-14T05:36:24.544297+0000 mgr.a (mgr.14355) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:25 smithi171 bash[25040]: audit 2024-09-14T05:36:25.042635+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:36:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:25 smithi171 bash[25040]: audit 2024-09-14T05:36:25.654542+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:25 smithi171 bash[25040]: audit 2024-09-14T05:36:25.658337+0000 mon.a (mon.0) 3399 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:26 smithi007 bash[22722]: audit 2024-09-14T05:36:26.295592+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:36:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:26 smithi007 bash[22722]: audit 2024-09-14T05:36:26.297117+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:36:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:26 smithi007 bash[22722]: audit 2024-09-14T05:36:26.306760+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:26 smithi007 bash[22722]: audit 2024-09-14T05:36:26.311329+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:26 smithi131 bash[24745]: audit 2024-09-14T05:36:26.295592+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:36:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:26 smithi131 bash[24745]: audit 2024-09-14T05:36:26.297117+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:36:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:26 smithi131 bash[24745]: audit 2024-09-14T05:36:26.306760+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:27.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:26 smithi131 bash[24745]: audit 2024-09-14T05:36:26.311329+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:27.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:26 smithi171 bash[25040]: audit 2024-09-14T05:36:26.295592+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:36:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:26 smithi171 bash[25040]: audit 2024-09-14T05:36:26.297117+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:36:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:26 smithi171 bash[25040]: audit 2024-09-14T05:36:26.306760+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:36:27.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:26 smithi171 bash[25040]: audit 2024-09-14T05:36:26.311329+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:27.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22972]: debug 2024-09-14T05:36:27.080+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:36:27.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22972]: debug 2024-09-14T05:36:27.080+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:36:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22722]: audit 2024-09-14T05:36:26.312325+0000 mgr.a (mgr.14355) 18832 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22722]: cluster 2024-09-14T05:36:26.545685+0000 mgr.a (mgr.14355) 18833 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22722]: audit 2024-09-14T05:36:27.083397+0000 mgr.a (mgr.14355) 18834 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:36:27.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:27 smithi007 bash[22722]: cephadm 2024-09-14T05:36:27.085111+0000 mgr.a (mgr.14355) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:36:28.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:27 smithi131 bash[24745]: audit 2024-09-14T05:36:26.312325+0000 mgr.a (mgr.14355) 18832 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:28.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:27 smithi131 bash[24745]: cluster 2024-09-14T05:36:26.545685+0000 mgr.a (mgr.14355) 18833 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:28.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:27 smithi131 bash[24745]: audit 2024-09-14T05:36:27.083397+0000 mgr.a (mgr.14355) 18834 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:36:28.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:27 smithi131 bash[24745]: cephadm 2024-09-14T05:36:27.085111+0000 mgr.a (mgr.14355) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:36:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:27 smithi171 bash[25040]: audit 2024-09-14T05:36:26.312325+0000 mgr.a (mgr.14355) 18832 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:36:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:27 smithi171 bash[25040]: cluster 2024-09-14T05:36:26.545685+0000 mgr.a (mgr.14355) 18833 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:27 smithi171 bash[25040]: audit 2024-09-14T05:36:27.083397+0000 mgr.a (mgr.14355) 18834 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:36:28.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:27 smithi171 bash[25040]: cephadm 2024-09-14T05:36:27.085111+0000 mgr.a (mgr.14355) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:36:28.095 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:28.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:28.096 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:28.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:28.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:29 smithi007 bash[22722]: audit 2024-09-14T05:36:28.429606+0000 mgr.a (mgr.14355) 18836 : audit [DBG] from='client.404025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:29.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:29 smithi007 bash[22722]: cluster 2024-09-14T05:36:28.546143+0000 mgr.a (mgr.14355) 18837 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:29 smithi131 bash[24745]: audit 2024-09-14T05:36:28.429606+0000 mgr.a (mgr.14355) 18836 : audit [DBG] from='client.404025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:29 smithi131 bash[24745]: cluster 2024-09-14T05:36:28.546143+0000 mgr.a (mgr.14355) 18837 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:29 smithi171 bash[25040]: audit 2024-09-14T05:36:28.429606+0000 mgr.a (mgr.14355) 18836 : audit [DBG] from='client.404025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:29 smithi171 bash[25040]: cluster 2024-09-14T05:36:28.546143+0000 mgr.a (mgr.14355) 18837 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:31 smithi131 bash[24745]: cluster 2024-09-14T05:36:30.547966+0000 mgr.a (mgr.14355) 18838 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:36:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:31 smithi171 bash[25040]: cluster 2024-09-14T05:36:30.547966+0000 mgr.a (mgr.14355) 18838 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:36:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:31 smithi007 bash[22722]: cluster 2024-09-14T05:36:30.547966+0000 mgr.a (mgr.14355) 18838 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-14T05:36:33.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:33.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:33.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:33 smithi131 bash[24745]: cluster 2024-09-14T05:36:32.549256+0000 mgr.a (mgr.14355) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:33 smithi171 bash[25040]: cluster 2024-09-14T05:36:32.549256+0000 mgr.a (mgr.14355) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:33 smithi007 bash[22722]: cluster 2024-09-14T05:36:32.549256+0000 mgr.a (mgr.14355) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:34.653 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:34.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:35 smithi131 bash[24745]: audit 2024-09-14T05:36:34.206364+0000 mgr.a (mgr.14355) 18840 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:36.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:35 smithi131 bash[24745]: cluster 2024-09-14T05:36:34.550688+0000 mgr.a (mgr.14355) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:35 smithi171 bash[25040]: audit 2024-09-14T05:36:34.206364+0000 mgr.a (mgr.14355) 18840 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:36.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:35 smithi171 bash[25040]: cluster 2024-09-14T05:36:34.550688+0000 mgr.a (mgr.14355) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:35 smithi007 bash[22722]: audit 2024-09-14T05:36:34.206364+0000 mgr.a (mgr.14355) 18840 : audit [DBG] from='client.404100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:35 smithi007 bash[22722]: cluster 2024-09-14T05:36:34.550688+0000 mgr.a (mgr.14355) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:38.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:37 smithi131 bash[24745]: cluster 2024-09-14T05:36:36.552879+0000 mgr.a (mgr.14355) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:38.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:37 smithi171 bash[25040]: cluster 2024-09-14T05:36:36.552879+0000 mgr.a (mgr.14355) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:37 smithi007 bash[22722]: cluster 2024-09-14T05:36:36.552879+0000 mgr.a (mgr.14355) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:39.656 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:40.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:39 smithi131 bash[24745]: cluster 2024-09-14T05:36:38.553658+0000 mgr.a (mgr.14355) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:40.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:39 smithi171 bash[25040]: cluster 2024-09-14T05:36:38.553658+0000 mgr.a (mgr.14355) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:39 smithi007 bash[22722]: cluster 2024-09-14T05:36:38.553658+0000 mgr.a (mgr.14355) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:40.412 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:41.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:40 smithi131 bash[24745]: audit 2024-09-14T05:36:39.989597+0000 mgr.a (mgr.14355) 18844 : audit [DBG] from='client.404175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:41.085 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:40 smithi171 bash[25040]: audit 2024-09-14T05:36:39.989597+0000 mgr.a (mgr.14355) 18844 : audit [DBG] from='client.404175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:41.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:40 smithi007 bash[22722]: audit 2024-09-14T05:36:39.989597+0000 mgr.a (mgr.14355) 18844 : audit [DBG] from='client.404175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:42.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:41 smithi131 bash[24745]: cluster 2024-09-14T05:36:40.556585+0000 mgr.a (mgr.14355) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:42.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:41 smithi171 bash[25040]: cluster 2024-09-14T05:36:40.556585+0000 mgr.a (mgr.14355) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:41 smithi007 bash[22722]: cluster 2024-09-14T05:36:40.556585+0000 mgr.a (mgr.14355) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:36:44.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:43 smithi131 bash[24745]: cluster 2024-09-14T05:36:42.557437+0000 mgr.a (mgr.14355) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:36:44.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:43 smithi171 bash[25040]: cluster 2024-09-14T05:36:42.557437+0000 mgr.a (mgr.14355) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:36:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:43 smithi007 bash[22722]: cluster 2024-09-14T05:36:42.557437+0000 mgr.a (mgr.14355) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-14T05:36:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:45.414 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:46.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:45 smithi131 bash[24745]: cluster 2024-09-14T05:36:44.558379+0000 mgr.a (mgr.14355) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:46.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:45 smithi171 bash[25040]: cluster 2024-09-14T05:36:44.558379+0000 mgr.a (mgr.14355) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:46.157 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:46.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:45 smithi007 bash[22722]: cluster 2024-09-14T05:36:44.558379+0000 mgr.a (mgr.14355) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:47.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:46 smithi131 bash[24745]: audit 2024-09-14T05:36:45.742669+0000 mgr.a (mgr.14355) 18848 : audit [DBG] from='client.404250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:47.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:46 smithi171 bash[25040]: audit 2024-09-14T05:36:45.742669+0000 mgr.a (mgr.14355) 18848 : audit [DBG] from='client.404250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:47.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:46 smithi007 bash[22722]: audit 2024-09-14T05:36:45.742669+0000 mgr.a (mgr.14355) 18848 : audit [DBG] from='client.404250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:48.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:47 smithi131 bash[24745]: cluster 2024-09-14T05:36:46.561195+0000 mgr.a (mgr.14355) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:48.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:47 smithi171 bash[25040]: cluster 2024-09-14T05:36:46.561195+0000 mgr.a (mgr.14355) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:47 smithi007 bash[22722]: cluster 2024-09-14T05:36:46.561195+0000 mgr.a (mgr.14355) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:49 smithi131 bash[24745]: cluster 2024-09-14T05:36:48.561987+0000 mgr.a (mgr.14355) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:50.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:49 smithi171 bash[25040]: cluster 2024-09-14T05:36:48.561987+0000 mgr.a (mgr.14355) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:49 smithi007 bash[22722]: cluster 2024-09-14T05:36:48.561987+0000 mgr.a (mgr.14355) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:36:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:51.930 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:51.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:51.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:51.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:51.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:52.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:51 smithi131 bash[24745]: cluster 2024-09-14T05:36:50.563979+0000 mgr.a (mgr.14355) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:52.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:51 smithi171 bash[25040]: cluster 2024-09-14T05:36:50.563979+0000 mgr.a (mgr.14355) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:51 smithi007 bash[22722]: cluster 2024-09-14T05:36:50.563979+0000 mgr.a (mgr.14355) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:53.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:52 smithi131 bash[24745]: audit 2024-09-14T05:36:51.495108+0000 mgr.a (mgr.14355) 18852 : audit [DBG] from='client.404328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:53.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:52 smithi171 bash[25040]: audit 2024-09-14T05:36:51.495108+0000 mgr.a (mgr.14355) 18852 : audit [DBG] from='client.404328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:52 smithi007 bash[22722]: audit 2024-09-14T05:36:51.495108+0000 mgr.a (mgr.14355) 18852 : audit [DBG] from='client.404328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:54.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:53 smithi131 bash[24745]: cluster 2024-09-14T05:36:52.564970+0000 mgr.a (mgr.14355) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:54.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:53 smithi171 bash[25040]: cluster 2024-09-14T05:36:52.564970+0000 mgr.a (mgr.14355) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:53 smithi007 bash[22722]: cluster 2024-09-14T05:36:52.564970+0000 mgr.a (mgr.14355) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:56.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:55 smithi131 bash[24745]: cluster 2024-09-14T05:36:54.565784+0000 mgr.a (mgr.14355) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:56.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:55 smithi171 bash[25040]: cluster 2024-09-14T05:36:54.565784+0000 mgr.a (mgr.14355) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:55 smithi007 bash[22722]: cluster 2024-09-14T05:36:54.565784+0000 mgr.a (mgr.14355) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:36:56.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:36:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:36:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:36:57.686 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:36:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:36:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:36:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:36:57.686 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:36:58.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:57 smithi171 bash[25040]: cluster 2024-09-14T05:36:56.568158+0000 mgr.a (mgr.14355) 18855 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:57 smithi007 bash[22722]: cluster 2024-09-14T05:36:56.568158+0000 mgr.a (mgr.14355) 18855 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:57 smithi131 bash[24745]: cluster 2024-09-14T05:36:56.568158+0000 mgr.a (mgr.14355) 18855 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:36:59.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:58 smithi171 bash[25040]: audit 2024-09-14T05:36:57.258857+0000 mgr.a (mgr.14355) 18856 : audit [DBG] from='client.404406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:59.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:58 smithi007 bash[22722]: audit 2024-09-14T05:36:57.258857+0000 mgr.a (mgr.14355) 18856 : audit [DBG] from='client.404406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:36:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:58 smithi131 bash[24745]: audit 2024-09-14T05:36:57.258857+0000 mgr.a (mgr.14355) 18856 : audit [DBG] from='client.404406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:36:59 smithi007 bash[22722]: cluster 2024-09-14T05:36:58.569183+0000 mgr.a (mgr.14355) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:36:59 smithi131 bash[24745]: cluster 2024-09-14T05:36:58.569183+0000 mgr.a (mgr.14355) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:36:59 smithi171 bash[25040]: cluster 2024-09-14T05:36:58.569183+0000 mgr.a (mgr.14355) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:01 smithi007 bash[22722]: cluster 2024-09-14T05:37:00.571378+0000 mgr.a (mgr.14355) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:01 smithi131 bash[24745]: cluster 2024-09-14T05:37:00.571378+0000 mgr.a (mgr.14355) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:01 smithi171 bash[25040]: cluster 2024-09-14T05:37:00.571378+0000 mgr.a (mgr.14355) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:03.465 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:03 smithi007 bash[22722]: cluster 2024-09-14T05:37:02.572156+0000 mgr.a (mgr.14355) 18859 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:03 smithi007 bash[22722]: audit 2024-09-14T05:37:03.026361+0000 mgr.a (mgr.14355) 18860 : audit [DBG] from='client.404481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:03 smithi131 bash[24745]: cluster 2024-09-14T05:37:02.572156+0000 mgr.a (mgr.14355) 18859 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:03 smithi131 bash[24745]: audit 2024-09-14T05:37:03.026361+0000 mgr.a (mgr.14355) 18860 : audit [DBG] from='client.404481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:03 smithi171 bash[25040]: cluster 2024-09-14T05:37:02.572156+0000 mgr.a (mgr.14355) 18859 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:03 smithi171 bash[25040]: audit 2024-09-14T05:37:03.026361+0000 mgr.a (mgr.14355) 18860 : audit [DBG] from='client.404481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:05 smithi007 bash[22722]: cluster 2024-09-14T05:37:04.573182+0000 mgr.a (mgr.14355) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:05 smithi131 bash[24745]: cluster 2024-09-14T05:37:04.573182+0000 mgr.a (mgr.14355) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:05 smithi171 bash[25040]: cluster 2024-09-14T05:37:04.573182+0000 mgr.a (mgr.14355) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:07 smithi007 bash[22722]: cluster 2024-09-14T05:37:06.575513+0000 mgr.a (mgr.14355) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:07 smithi131 bash[24745]: cluster 2024-09-14T05:37:06.575513+0000 mgr.a (mgr.14355) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:07 smithi171 bash[25040]: cluster 2024-09-14T05:37:06.575513+0000 mgr.a (mgr.14355) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:08.466 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:08.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:08.467 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:09.222 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:09 smithi007 bash[22722]: cluster 2024-09-14T05:37:08.576069+0000 mgr.a (mgr.14355) 18863 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:09 smithi007 bash[22722]: audit 2024-09-14T05:37:08.795378+0000 mgr.a (mgr.14355) 18864 : audit [DBG] from='client.404553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:09 smithi131 bash[24745]: cluster 2024-09-14T05:37:08.576069+0000 mgr.a (mgr.14355) 18863 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:09 smithi131 bash[24745]: audit 2024-09-14T05:37:08.795378+0000 mgr.a (mgr.14355) 18864 : audit [DBG] from='client.404553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:09 smithi171 bash[25040]: cluster 2024-09-14T05:37:08.576069+0000 mgr.a (mgr.14355) 18863 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:09 smithi171 bash[25040]: audit 2024-09-14T05:37:08.795378+0000 mgr.a (mgr.14355) 18864 : audit [DBG] from='client.404553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:11 smithi007 bash[22722]: cluster 2024-09-14T05:37:10.578332+0000 mgr.a (mgr.14355) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:11 smithi131 bash[24745]: cluster 2024-09-14T05:37:10.578332+0000 mgr.a (mgr.14355) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:11 smithi171 bash[25040]: cluster 2024-09-14T05:37:10.578332+0000 mgr.a (mgr.14355) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:13 smithi007 bash[22722]: cluster 2024-09-14T05:37:12.579119+0000 mgr.a (mgr.14355) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:14.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:14.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:14.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:13 smithi131 bash[24745]: cluster 2024-09-14T05:37:12.579119+0000 mgr.a (mgr.14355) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:13 smithi171 bash[25040]: cluster 2024-09-14T05:37:12.579119+0000 mgr.a (mgr.14355) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:14.960 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:14.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:14.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:14.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:14.961 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:15 smithi007 bash[22722]: audit 2024-09-14T05:37:14.554126+0000 mgr.a (mgr.14355) 18867 : audit [DBG] from='client.404631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:16.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:15 smithi007 bash[22722]: cluster 2024-09-14T05:37:14.580151+0000 mgr.a (mgr.14355) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:15 smithi131 bash[24745]: audit 2024-09-14T05:37:14.554126+0000 mgr.a (mgr.14355) 18867 : audit [DBG] from='client.404631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:15 smithi131 bash[24745]: cluster 2024-09-14T05:37:14.580151+0000 mgr.a (mgr.14355) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:15 smithi171 bash[25040]: audit 2024-09-14T05:37:14.554126+0000 mgr.a (mgr.14355) 18867 : audit [DBG] from='client.404631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:16.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:15 smithi171 bash[25040]: cluster 2024-09-14T05:37:14.580151+0000 mgr.a (mgr.14355) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:17 smithi007 bash[22722]: cluster 2024-09-14T05:37:16.582575+0000 mgr.a (mgr.14355) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:17 smithi131 bash[24745]: cluster 2024-09-14T05:37:16.582575+0000 mgr.a (mgr.14355) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:17 smithi171 bash[25040]: cluster 2024-09-14T05:37:16.582575+0000 mgr.a (mgr.14355) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:19.962 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:19 smithi007 bash[22722]: cluster 2024-09-14T05:37:18.583362+0000 mgr.a (mgr.14355) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:19 smithi131 bash[24745]: cluster 2024-09-14T05:37:18.583362+0000 mgr.a (mgr.14355) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:19 smithi171 bash[25040]: cluster 2024-09-14T05:37:18.583362+0000 mgr.a (mgr.14355) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:20.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:20.709 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:21 smithi007 bash[22722]: audit 2024-09-14T05:37:20.284854+0000 mgr.a (mgr.14355) 18871 : audit [DBG] from='client.404703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:22.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:21 smithi007 bash[22722]: cluster 2024-09-14T05:37:20.584862+0000 mgr.a (mgr.14355) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:22.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:21 smithi131 bash[24745]: audit 2024-09-14T05:37:20.284854+0000 mgr.a (mgr.14355) 18871 : audit [DBG] from='client.404703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:22.285 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:21 smithi131 bash[24745]: cluster 2024-09-14T05:37:20.584862+0000 mgr.a (mgr.14355) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:21 smithi171 bash[25040]: audit 2024-09-14T05:37:20.284854+0000 mgr.a (mgr.14355) 18871 : audit [DBG] from='client.404703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:21 smithi171 bash[25040]: cluster 2024-09-14T05:37:20.584862+0000 mgr.a (mgr.14355) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:23 smithi007 bash[22722]: cluster 2024-09-14T05:37:22.585881+0000 mgr.a (mgr.14355) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:23 smithi131 bash[24745]: cluster 2024-09-14T05:37:22.585881+0000 mgr.a (mgr.14355) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:23 smithi171 bash[25040]: cluster 2024-09-14T05:37:22.585881+0000 mgr.a (mgr.14355) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:25.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:25.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:25 smithi007 bash[22722]: cluster 2024-09-14T05:37:24.586871+0000 mgr.a (mgr.14355) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:37:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:25 smithi131 bash[24745]: cluster 2024-09-14T05:37:24.586871+0000 mgr.a (mgr.14355) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:37:26.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:25 smithi171 bash[25040]: cluster 2024-09-14T05:37:24.586871+0000 mgr.a (mgr.14355) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:37:26.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:26.473 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:26.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:26.474 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:27.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:26 smithi007 bash[22722]: audit 2024-09-14T05:37:26.045736+0000 mgr.a (mgr.14355) 18875 : audit [DBG] from='client.404781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:27.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:26 smithi131 bash[24745]: audit 2024-09-14T05:37:26.045736+0000 mgr.a (mgr.14355) 18875 : audit [DBG] from='client.404781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:27.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:26 smithi171 bash[25040]: audit 2024-09-14T05:37:26.045736+0000 mgr.a (mgr.14355) 18875 : audit [DBG] from='client.404781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: cluster 2024-09-14T05:37:26.589670+0000 mgr.a (mgr.14355) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: audit 2024-09-14T05:37:27.138777+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:37:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: audit 2024-09-14T05:37:27.750617+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: audit 2024-09-14T05:37:27.754843+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: audit 2024-09-14T05:37:27.758261+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:27 smithi007 bash[22722]: audit 2024-09-14T05:37:27.761434+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: cluster 2024-09-14T05:37:26.589670+0000 mgr.a (mgr.14355) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: audit 2024-09-14T05:37:27.138777+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:37:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: audit 2024-09-14T05:37:27.750617+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: audit 2024-09-14T05:37:27.754843+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: audit 2024-09-14T05:37:27.758261+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:27 smithi131 bash[24745]: audit 2024-09-14T05:37:27.761434+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: cluster 2024-09-14T05:37:26.589670+0000 mgr.a (mgr.14355) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: audit 2024-09-14T05:37:27.138777+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:37:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: audit 2024-09-14T05:37:27.750617+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: audit 2024-09-14T05:37:27.754843+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: audit 2024-09-14T05:37:27.758261+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:28.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:27 smithi171 bash[25040]: audit 2024-09-14T05:37:27.761434+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:28 smithi007 bash[22722]: audit 2024-09-14T05:37:28.546772+0000 mon.a (mon.0) 3409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:37:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:28 smithi007 bash[22722]: audit 2024-09-14T05:37:28.548239+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:37:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:28 smithi007 bash[22722]: audit 2024-09-14T05:37:28.556271+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:29.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:28 smithi007 bash[22722]: audit 2024-09-14T05:37:28.558937+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:28 smithi131 bash[24745]: audit 2024-09-14T05:37:28.546772+0000 mon.a (mon.0) 3409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:37:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:28 smithi131 bash[24745]: audit 2024-09-14T05:37:28.548239+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:37:29.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:28 smithi131 bash[24745]: audit 2024-09-14T05:37:28.556271+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:29.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:28 smithi131 bash[24745]: audit 2024-09-14T05:37:28.558937+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:29.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:28 smithi171 bash[25040]: audit 2024-09-14T05:37:28.546772+0000 mon.a (mon.0) 3409 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:37:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:28 smithi171 bash[25040]: audit 2024-09-14T05:37:28.548239+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:37:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:28 smithi171 bash[25040]: audit 2024-09-14T05:37:28.556271+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:37:29.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:28 smithi171 bash[25040]: audit 2024-09-14T05:37:28.558937+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:29.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:37:29 smithi007 bash[22972]: debug 2024-09-14T05:37:29.299+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:37:29.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:37:29 smithi007 bash[22972]: debug 2024-09-14T05:37:29.299+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:37:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:29 smithi007 bash[22722]: audit 2024-09-14T05:37:28.561228+0000 mgr.a (mgr.14355) 18877 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:29 smithi007 bash[22722]: cluster 2024-09-14T05:37:28.590509+0000 mgr.a (mgr.14355) 18878 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:29 smithi131 bash[24745]: audit 2024-09-14T05:37:28.561228+0000 mgr.a (mgr.14355) 18877 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:30.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:29 smithi131 bash[24745]: cluster 2024-09-14T05:37:28.590509+0000 mgr.a (mgr.14355) 18878 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:29 smithi171 bash[25040]: audit 2024-09-14T05:37:28.561228+0000 mgr.a (mgr.14355) 18877 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:37:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:29 smithi171 bash[25040]: cluster 2024-09-14T05:37:28.590509+0000 mgr.a (mgr.14355) 18878 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:37:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:30 smithi007 bash[22722]: audit 2024-09-14T05:37:29.303924+0000 mgr.a (mgr.14355) 18879 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:37:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:30 smithi007 bash[22722]: cephadm 2024-09-14T05:37:29.305063+0000 mgr.a (mgr.14355) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:37:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:30 smithi131 bash[24745]: audit 2024-09-14T05:37:29.303924+0000 mgr.a (mgr.14355) 18879 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:37:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:30 smithi131 bash[24745]: cephadm 2024-09-14T05:37:29.305063+0000 mgr.a (mgr.14355) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:37:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:30 smithi171 bash[25040]: audit 2024-09-14T05:37:29.303924+0000 mgr.a (mgr.14355) 18879 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:37:31.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:30 smithi171 bash[25040]: cephadm 2024-09-14T05:37:29.305063+0000 mgr.a (mgr.14355) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:37:31.474 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:31.475 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:31 smithi007 bash[22722]: cluster 2024-09-14T05:37:30.592808+0000 mgr.a (mgr.14355) 18881 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:32.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:32.300 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:32.301 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:31 smithi171 bash[25040]: cluster 2024-09-14T05:37:30.592808+0000 mgr.a (mgr.14355) 18881 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:32.301 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:31 smithi131 bash[24745]: cluster 2024-09-14T05:37:30.592808+0000 mgr.a (mgr.14355) 18881 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:33.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:32 smithi007 bash[22722]: audit 2024-09-14T05:37:31.809181+0000 mgr.a (mgr.14355) 18882 : audit [DBG] from='client.404967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:32 smithi131 bash[24745]: audit 2024-09-14T05:37:31.809181+0000 mgr.a (mgr.14355) 18882 : audit [DBG] from='client.404967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:32 smithi171 bash[25040]: audit 2024-09-14T05:37:31.809181+0000 mgr.a (mgr.14355) 18882 : audit [DBG] from='client.404967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:33 smithi007 bash[22722]: cluster 2024-09-14T05:37:32.593760+0000 mgr.a (mgr.14355) 18883 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:33 smithi131 bash[24745]: cluster 2024-09-14T05:37:32.593760+0000 mgr.a (mgr.14355) 18883 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:33 smithi171 bash[25040]: cluster 2024-09-14T05:37:32.593760+0000 mgr.a (mgr.14355) 18883 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:35 smithi007 bash[22722]: cluster 2024-09-14T05:37:34.594581+0000 mgr.a (mgr.14355) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:35 smithi131 bash[24745]: cluster 2024-09-14T05:37:34.594581+0000 mgr.a (mgr.14355) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:35 smithi171 bash[25040]: cluster 2024-09-14T05:37:34.594581+0000 mgr.a (mgr.14355) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:37.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:37.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:37.250 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:37.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:37.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:37 smithi007 bash[22722]: cluster 2024-09-14T05:37:36.596882+0000 mgr.a (mgr.14355) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:37 smithi131 bash[24745]: cluster 2024-09-14T05:37:36.596882+0000 mgr.a (mgr.14355) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:37 smithi171 bash[25040]: cluster 2024-09-14T05:37:36.596882+0000 mgr.a (mgr.14355) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:39.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:38 smithi007 bash[22722]: audit 2024-09-14T05:37:37.580199+0000 mgr.a (mgr.14355) 18886 : audit [DBG] from='client.405045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:39.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:38 smithi131 bash[24745]: audit 2024-09-14T05:37:37.580199+0000 mgr.a (mgr.14355) 18886 : audit [DBG] from='client.405045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:39.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:38 smithi171 bash[25040]: audit 2024-09-14T05:37:37.580199+0000 mgr.a (mgr.14355) 18886 : audit [DBG] from='client.405045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:39 smithi007 bash[22722]: cluster 2024-09-14T05:37:38.597870+0000 mgr.a (mgr.14355) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:39 smithi131 bash[24745]: cluster 2024-09-14T05:37:38.597870+0000 mgr.a (mgr.14355) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:39 smithi171 bash[25040]: cluster 2024-09-14T05:37:38.597870+0000 mgr.a (mgr.14355) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:41 smithi007 bash[22722]: cluster 2024-09-14T05:37:40.600084+0000 mgr.a (mgr.14355) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:41 smithi131 bash[24745]: cluster 2024-09-14T05:37:40.600084+0000 mgr.a (mgr.14355) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:41 smithi171 bash[25040]: cluster 2024-09-14T05:37:40.600084+0000 mgr.a (mgr.14355) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:37:42.991 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:42.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:42.992 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:43.766 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:43.767 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:43.767 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:43 smithi007 bash[22722]: cluster 2024-09-14T05:37:42.600834+0000 mgr.a (mgr.14355) 18889 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:43 smithi131 bash[24745]: cluster 2024-09-14T05:37:42.600834+0000 mgr.a (mgr.14355) 18889 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:43 smithi171 bash[25040]: cluster 2024-09-14T05:37:42.600834+0000 mgr.a (mgr.14355) 18889 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:45.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:44 smithi007 bash[22722]: audit 2024-09-14T05:37:43.328915+0000 mgr.a (mgr.14355) 18890 : audit [DBG] from='client.405120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:44 smithi131 bash[24745]: audit 2024-09-14T05:37:43.328915+0000 mgr.a (mgr.14355) 18890 : audit [DBG] from='client.405120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:44 smithi171 bash[25040]: audit 2024-09-14T05:37:43.328915+0000 mgr.a (mgr.14355) 18890 : audit [DBG] from='client.405120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:45 smithi007 bash[22722]: cluster 2024-09-14T05:37:44.601763+0000 mgr.a (mgr.14355) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:45 smithi131 bash[24745]: cluster 2024-09-14T05:37:44.601763+0000 mgr.a (mgr.14355) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:45 smithi171 bash[25040]: cluster 2024-09-14T05:37:44.601763+0000 mgr.a (mgr.14355) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:47 smithi007 bash[22722]: cluster 2024-09-14T05:37:46.604081+0000 mgr.a (mgr.14355) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:47 smithi131 bash[24745]: cluster 2024-09-14T05:37:46.604081+0000 mgr.a (mgr.14355) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:47 smithi171 bash[25040]: cluster 2024-09-14T05:37:46.604081+0000 mgr.a (mgr.14355) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:49.545 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:49.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:49.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:49.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:49.545 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:49 smithi007 bash[22722]: cluster 2024-09-14T05:37:48.604819+0000 mgr.a (mgr.14355) 18893 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:50.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:49 smithi007 bash[22722]: audit 2024-09-14T05:37:49.103139+0000 mgr.a (mgr.14355) 18894 : audit [DBG] from='client.405198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:49 smithi131 bash[24745]: cluster 2024-09-14T05:37:48.604819+0000 mgr.a (mgr.14355) 18893 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:50.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:49 smithi131 bash[24745]: audit 2024-09-14T05:37:49.103139+0000 mgr.a (mgr.14355) 18894 : audit [DBG] from='client.405198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:49 smithi171 bash[25040]: cluster 2024-09-14T05:37:48.604819+0000 mgr.a (mgr.14355) 18893 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:50.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:49 smithi171 bash[25040]: audit 2024-09-14T05:37:49.103139+0000 mgr.a (mgr.14355) 18894 : audit [DBG] from='client.405198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:51 smithi007 bash[22722]: cluster 2024-09-14T05:37:50.607128+0000 mgr.a (mgr.14355) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:51 smithi131 bash[24745]: cluster 2024-09-14T05:37:50.607128+0000 mgr.a (mgr.14355) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:51 smithi171 bash[25040]: cluster 2024-09-14T05:37:50.607128+0000 mgr.a (mgr.14355) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:37:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:53 smithi007 bash[22722]: cluster 2024-09-14T05:37:52.607903+0000 mgr.a (mgr.14355) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:53 smithi131 bash[24745]: cluster 2024-09-14T05:37:52.607903+0000 mgr.a (mgr.14355) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:53 smithi171 bash[25040]: cluster 2024-09-14T05:37:52.607903+0000 mgr.a (mgr.14355) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:54.546 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:37:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:37:54.547 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:37:55.319 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:37:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:37:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:37:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:37:55.320 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:37:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:55 smithi007 bash[22722]: cluster 2024-09-14T05:37:54.608683+0000 mgr.a (mgr.14355) 18897 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:55 smithi007 bash[22722]: audit 2024-09-14T05:37:54.882818+0000 mgr.a (mgr.14355) 18898 : audit [DBG] from='client.405273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:55 smithi131 bash[24745]: cluster 2024-09-14T05:37:54.608683+0000 mgr.a (mgr.14355) 18897 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:55 smithi131 bash[24745]: audit 2024-09-14T05:37:54.882818+0000 mgr.a (mgr.14355) 18898 : audit [DBG] from='client.405273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:55 smithi171 bash[25040]: cluster 2024-09-14T05:37:54.608683+0000 mgr.a (mgr.14355) 18897 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:37:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:55 smithi171 bash[25040]: audit 2024-09-14T05:37:54.882818+0000 mgr.a (mgr.14355) 18898 : audit [DBG] from='client.405273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:37:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:57 smithi131 bash[24745]: cluster 2024-09-14T05:37:56.611141+0000 mgr.a (mgr.14355) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:37:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:57 smithi171 bash[25040]: cluster 2024-09-14T05:37:56.611141+0000 mgr.a (mgr.14355) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:37:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:57 smithi007 bash[22722]: cluster 2024-09-14T05:37:56.611141+0000 mgr.a (mgr.14355) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:38:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:37:59 smithi131 bash[24745]: cluster 2024-09-14T05:37:58.611932+0000 mgr.a (mgr.14355) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:38:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:37:59 smithi171 bash[25040]: cluster 2024-09-14T05:37:58.611932+0000 mgr.a (mgr.14355) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:38:00.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:00.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:37:59 smithi007 bash[22722]: cluster 2024-09-14T05:37:58.611932+0000 mgr.a (mgr.14355) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:38:01.103 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:01.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:01.104 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:01 smithi131 bash[24745]: cluster 2024-09-14T05:38:00.613923+0000 mgr.a (mgr.14355) 18901 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:01 smithi131 bash[24745]: audit 2024-09-14T05:38:00.654957+0000 mgr.a (mgr.14355) 18902 : audit [DBG] from='client.405351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:01 smithi171 bash[25040]: cluster 2024-09-14T05:38:00.613923+0000 mgr.a (mgr.14355) 18901 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:01 smithi171 bash[25040]: audit 2024-09-14T05:38:00.654957+0000 mgr.a (mgr.14355) 18902 : audit [DBG] from='client.405351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:01 smithi007 bash[22722]: cluster 2024-09-14T05:38:00.613923+0000 mgr.a (mgr.14355) 18901 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:01 smithi007 bash[22722]: audit 2024-09-14T05:38:00.654957+0000 mgr.a (mgr.14355) 18902 : audit [DBG] from='client.405351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:03 smithi131 bash[24745]: cluster 2024-09-14T05:38:02.614835+0000 mgr.a (mgr.14355) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:38:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:03 smithi171 bash[25040]: cluster 2024-09-14T05:38:02.614835+0000 mgr.a (mgr.14355) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:38:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:03 smithi007 bash[22722]: cluster 2024-09-14T05:38:02.614835+0000 mgr.a (mgr.14355) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:38:06.105 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:06.105 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:06.106 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:05 smithi131 bash[24745]: cluster 2024-09-14T05:38:04.615623+0000 mgr.a (mgr.14355) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:38:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:05 smithi171 bash[25040]: cluster 2024-09-14T05:38:04.615623+0000 mgr.a (mgr.14355) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:38:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:05 smithi007 bash[22722]: cluster 2024-09-14T05:38:04.615623+0000 mgr.a (mgr.14355) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:38:06.883 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:06.883 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:06.884 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:07 smithi131 bash[24745]: audit 2024-09-14T05:38:06.437020+0000 mgr.a (mgr.14355) 18905 : audit [DBG] from='client.405429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:07 smithi131 bash[24745]: cluster 2024-09-14T05:38:06.617011+0000 mgr.a (mgr.14355) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:07 smithi171 bash[25040]: audit 2024-09-14T05:38:06.437020+0000 mgr.a (mgr.14355) 18905 : audit [DBG] from='client.405429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:07 smithi171 bash[25040]: cluster 2024-09-14T05:38:06.617011+0000 mgr.a (mgr.14355) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:07 smithi007 bash[22722]: audit 2024-09-14T05:38:06.437020+0000 mgr.a (mgr.14355) 18905 : audit [DBG] from='client.405429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:08.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:07 smithi007 bash[22722]: cluster 2024-09-14T05:38:06.617011+0000 mgr.a (mgr.14355) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:09 smithi131 bash[24745]: cluster 2024-09-14T05:38:08.617884+0000 mgr.a (mgr.14355) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:38:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:09 smithi171 bash[25040]: cluster 2024-09-14T05:38:08.617884+0000 mgr.a (mgr.14355) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:38:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:09 smithi007 bash[22722]: cluster 2024-09-14T05:38:08.617884+0000 mgr.a (mgr.14355) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:38:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:11.885 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:11 smithi131 bash[24745]: cluster 2024-09-14T05:38:10.620086+0000 mgr.a (mgr.14355) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:38:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:11 smithi171 bash[25040]: cluster 2024-09-14T05:38:10.620086+0000 mgr.a (mgr.14355) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:38:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:11 smithi007 bash[22722]: cluster 2024-09-14T05:38:10.620086+0000 mgr.a (mgr.14355) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:38:12.636 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:12.636 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:12.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:13 smithi131 bash[24745]: audit 2024-09-14T05:38:12.213523+0000 mgr.a (mgr.14355) 18909 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:14.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:13 smithi131 bash[24745]: cluster 2024-09-14T05:38:12.620640+0000 mgr.a (mgr.14355) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:13 smithi171 bash[25040]: audit 2024-09-14T05:38:12.213523+0000 mgr.a (mgr.14355) 18909 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:13 smithi171 bash[25040]: cluster 2024-09-14T05:38:12.620640+0000 mgr.a (mgr.14355) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:13 smithi007 bash[22722]: audit 2024-09-14T05:38:12.213523+0000 mgr.a (mgr.14355) 18909 : audit [DBG] from='client.405507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:13 smithi007 bash[22722]: cluster 2024-09-14T05:38:12.620640+0000 mgr.a (mgr.14355) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:16 smithi131 bash[24745]: cluster 2024-09-14T05:38:14.621397+0000 mgr.a (mgr.14355) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:16 smithi171 bash[25040]: cluster 2024-09-14T05:38:14.621397+0000 mgr.a (mgr.14355) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:16 smithi007 bash[22722]: cluster 2024-09-14T05:38:14.621397+0000 mgr.a (mgr.14355) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:17.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:17.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:17.638 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:18 smithi131 bash[24745]: cluster 2024-09-14T05:38:16.623669+0000 mgr.a (mgr.14355) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:18 smithi171 bash[25040]: cluster 2024-09-14T05:38:16.623669+0000 mgr.a (mgr.14355) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:18.422 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:18.422 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:18 smithi007 bash[22722]: cluster 2024-09-14T05:38:16.623669+0000 mgr.a (mgr.14355) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:19 smithi131 bash[24745]: audit 2024-09-14T05:38:17.970706+0000 mgr.a (mgr.14355) 18913 : audit [DBG] from='client.405582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:19.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:19 smithi171 bash[25040]: audit 2024-09-14T05:38:17.970706+0000 mgr.a (mgr.14355) 18913 : audit [DBG] from='client.405582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:19.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:19 smithi007 bash[22722]: audit 2024-09-14T05:38:17.970706+0000 mgr.a (mgr.14355) 18913 : audit [DBG] from='client.405582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:20 smithi131 bash[24745]: cluster 2024-09-14T05:38:18.624621+0000 mgr.a (mgr.14355) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:20 smithi171 bash[25040]: cluster 2024-09-14T05:38:18.624621+0000 mgr.a (mgr.14355) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:20 smithi007 bash[22722]: cluster 2024-09-14T05:38:18.624621+0000 mgr.a (mgr.14355) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:22 smithi131 bash[24745]: cluster 2024-09-14T05:38:20.626834+0000 mgr.a (mgr.14355) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:22 smithi171 bash[25040]: cluster 2024-09-14T05:38:20.626834+0000 mgr.a (mgr.14355) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:22 smithi007 bash[22722]: cluster 2024-09-14T05:38:20.626834+0000 mgr.a (mgr.14355) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:23.423 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:23.469 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:23.470 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:24.163 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:24.163 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:24.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:24.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:24.164 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:24 smithi131 bash[24745]: cluster 2024-09-14T05:38:22.627577+0000 mgr.a (mgr.14355) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:24 smithi171 bash[25040]: cluster 2024-09-14T05:38:22.627577+0000 mgr.a (mgr.14355) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:24 smithi007 bash[22722]: cluster 2024-09-14T05:38:22.627577+0000 mgr.a (mgr.14355) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:25 smithi131 bash[24745]: audit 2024-09-14T05:38:23.753892+0000 mgr.a (mgr.14355) 18917 : audit [DBG] from='client.405654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:25 smithi171 bash[25040]: audit 2024-09-14T05:38:23.753892+0000 mgr.a (mgr.14355) 18917 : audit [DBG] from='client.405654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:25.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:25 smithi007 bash[22722]: audit 2024-09-14T05:38:23.753892+0000 mgr.a (mgr.14355) 18917 : audit [DBG] from='client.405654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:26 smithi171 bash[25040]: cluster 2024-09-14T05:38:24.628512+0000 mgr.a (mgr.14355) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:26 smithi007 bash[22722]: cluster 2024-09-14T05:38:24.628512+0000 mgr.a (mgr.14355) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:26 smithi131 bash[24745]: cluster 2024-09-14T05:38:24.628512+0000 mgr.a (mgr.14355) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:28 smithi171 bash[25040]: cluster 2024-09-14T05:38:26.630763+0000 mgr.a (mgr.14355) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:28 smithi007 bash[22722]: cluster 2024-09-14T05:38:26.630763+0000 mgr.a (mgr.14355) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:28 smithi131 bash[24745]: cluster 2024-09-14T05:38:26.630763+0000 mgr.a (mgr.14355) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:29.165 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:29.165 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:29.166 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:29.920 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:30 smithi171 bash[25040]: cluster 2024-09-14T05:38:28.631510+0000 mgr.a (mgr.14355) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:30 smithi171 bash[25040]: audit 2024-09-14T05:38:29.356699+0000 mon.a (mon.0) 3413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:30 smithi007 bash[22722]: cluster 2024-09-14T05:38:28.631510+0000 mgr.a (mgr.14355) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:30 smithi007 bash[22722]: audit 2024-09-14T05:38:29.356699+0000 mon.a (mon.0) 3413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:30 smithi131 bash[24745]: cluster 2024-09-14T05:38:28.631510+0000 mgr.a (mgr.14355) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:30 smithi131 bash[24745]: audit 2024-09-14T05:38:29.356699+0000 mon.a (mon.0) 3413 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:38:31.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:38:30 smithi007 bash[22972]: debug 2024-09-14T05:38:30.942+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:38:30 smithi007 bash[22972]: debug 2024-09-14T05:38:30.946+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:31 smithi007 bash[22722]: audit 2024-09-14T05:38:29.498539+0000 mgr.a (mgr.14355) 18921 : audit [DBG] from='client.405732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:31 smithi007 bash[22722]: audit 2024-09-14T05:38:30.177564+0000 mon.a (mon.0) 3414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:31 smithi007 bash[22722]: audit 2024-09-14T05:38:30.179236+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:31 smithi007 bash[22722]: audit 2024-09-14T05:38:30.189016+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:38:31.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:31 smithi007 bash[22722]: audit 2024-09-14T05:38:30.194031+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:31 smithi131 bash[24745]: audit 2024-09-14T05:38:29.498539+0000 mgr.a (mgr.14355) 18921 : audit [DBG] from='client.405732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:31 smithi131 bash[24745]: audit 2024-09-14T05:38:30.177564+0000 mon.a (mon.0) 3414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:38:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:31 smithi131 bash[24745]: audit 2024-09-14T05:38:30.179236+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:38:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:31 smithi131 bash[24745]: audit 2024-09-14T05:38:30.189016+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:38:31.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:31 smithi131 bash[24745]: audit 2024-09-14T05:38:30.194031+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:31 smithi171 bash[25040]: audit 2024-09-14T05:38:29.498539+0000 mgr.a (mgr.14355) 18921 : audit [DBG] from='client.405732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:31 smithi171 bash[25040]: audit 2024-09-14T05:38:30.177564+0000 mon.a (mon.0) 3414 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:38:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:31 smithi171 bash[25040]: audit 2024-09-14T05:38:30.179236+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:38:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:31 smithi171 bash[25040]: audit 2024-09-14T05:38:30.189016+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:38:31.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:31 smithi171 bash[25040]: audit 2024-09-14T05:38:30.194031+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:32 smithi007 bash[22722]: audit 2024-09-14T05:38:30.196415+0000 mgr.a (mgr.14355) 18922 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:32.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:32 smithi007 bash[22722]: cluster 2024-09-14T05:38:30.632830+0000 mgr.a (mgr.14355) 18923 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:32.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:32 smithi007 bash[22722]: audit 2024-09-14T05:38:30.945427+0000 mgr.a (mgr.14355) 18924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:38:32.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:32 smithi007 bash[22722]: cephadm 2024-09-14T05:38:30.947344+0000 mgr.a (mgr.14355) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:38:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:32 smithi131 bash[24745]: audit 2024-09-14T05:38:30.196415+0000 mgr.a (mgr.14355) 18922 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:32 smithi131 bash[24745]: cluster 2024-09-14T05:38:30.632830+0000 mgr.a (mgr.14355) 18923 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:32 smithi131 bash[24745]: audit 2024-09-14T05:38:30.945427+0000 mgr.a (mgr.14355) 18924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:38:32.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:32 smithi131 bash[24745]: cephadm 2024-09-14T05:38:30.947344+0000 mgr.a (mgr.14355) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:38:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:32 smithi171 bash[25040]: audit 2024-09-14T05:38:30.196415+0000 mgr.a (mgr.14355) 18922 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:38:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:32 smithi171 bash[25040]: cluster 2024-09-14T05:38:30.632830+0000 mgr.a (mgr.14355) 18923 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:32 smithi171 bash[25040]: audit 2024-09-14T05:38:30.945427+0000 mgr.a (mgr.14355) 18924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:38:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:32 smithi171 bash[25040]: cephadm 2024-09-14T05:38:30.947344+0000 mgr.a (mgr.14355) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:38:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:34 smithi007 bash[22722]: cluster 2024-09-14T05:38:32.633831+0000 mgr.a (mgr.14355) 18926 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:34 smithi131 bash[24745]: cluster 2024-09-14T05:38:32.633831+0000 mgr.a (mgr.14355) 18926 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:34 smithi171 bash[25040]: cluster 2024-09-14T05:38:32.633831+0000 mgr.a (mgr.14355) 18926 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:34.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:34.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:34.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:35.670 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:36 smithi007 bash[22722]: cluster 2024-09-14T05:38:34.634796+0000 mgr.a (mgr.14355) 18927 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:36 smithi131 bash[24745]: cluster 2024-09-14T05:38:34.634796+0000 mgr.a (mgr.14355) 18927 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:36 smithi171 bash[25040]: cluster 2024-09-14T05:38:34.634796+0000 mgr.a (mgr.14355) 18927 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:37 smithi007 bash[22722]: audit 2024-09-14T05:38:35.255769+0000 mgr.a (mgr.14355) 18928 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:37 smithi131 bash[24745]: audit 2024-09-14T05:38:35.255769+0000 mgr.a (mgr.14355) 18928 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:37 smithi171 bash[25040]: audit 2024-09-14T05:38:35.255769+0000 mgr.a (mgr.14355) 18928 : audit [DBG] from='client.405915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:38.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:38 smithi007 bash[22722]: cluster 2024-09-14T05:38:36.637631+0000 mgr.a (mgr.14355) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:38 smithi131 bash[24745]: cluster 2024-09-14T05:38:36.637631+0000 mgr.a (mgr.14355) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:38 smithi171 bash[25040]: cluster 2024-09-14T05:38:36.637631+0000 mgr.a (mgr.14355) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:40 smithi007 bash[22722]: cluster 2024-09-14T05:38:38.638433+0000 mgr.a (mgr.14355) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:40 smithi131 bash[24745]: cluster 2024-09-14T05:38:38.638433+0000 mgr.a (mgr.14355) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:40 smithi171 bash[25040]: cluster 2024-09-14T05:38:38.638433+0000 mgr.a (mgr.14355) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:40.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:41.429 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:41.429 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:41.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:41.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:41.430 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:42 smithi007 bash[22722]: cluster 2024-09-14T05:38:40.640394+0000 mgr.a (mgr.14355) 18931 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:42 smithi007 bash[22722]: audit 2024-09-14T05:38:41.009714+0000 mgr.a (mgr.14355) 18932 : audit [DBG] from='client.405990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:42 smithi131 bash[24745]: cluster 2024-09-14T05:38:40.640394+0000 mgr.a (mgr.14355) 18931 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:42 smithi131 bash[24745]: audit 2024-09-14T05:38:41.009714+0000 mgr.a (mgr.14355) 18932 : audit [DBG] from='client.405990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:42 smithi171 bash[25040]: cluster 2024-09-14T05:38:40.640394+0000 mgr.a (mgr.14355) 18931 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:42 smithi171 bash[25040]: audit 2024-09-14T05:38:41.009714+0000 mgr.a (mgr.14355) 18932 : audit [DBG] from='client.405990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:44 smithi007 bash[22722]: cluster 2024-09-14T05:38:42.641283+0000 mgr.a (mgr.14355) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:44 smithi131 bash[24745]: cluster 2024-09-14T05:38:42.641283+0000 mgr.a (mgr.14355) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:44 smithi171 bash[25040]: cluster 2024-09-14T05:38:42.641283+0000 mgr.a (mgr.14355) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:46.431 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:46.431 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:46.432 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:46 smithi007 bash[22722]: cluster 2024-09-14T05:38:44.642060+0000 mgr.a (mgr.14355) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:46 smithi131 bash[24745]: cluster 2024-09-14T05:38:44.642060+0000 mgr.a (mgr.14355) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:46 smithi171 bash[25040]: cluster 2024-09-14T05:38:44.642060+0000 mgr.a (mgr.14355) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:38:47.189 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:47.189 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:48 smithi007 bash[22722]: cluster 2024-09-14T05:38:46.644230+0000 mgr.a (mgr.14355) 18935 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:48 smithi007 bash[22722]: audit 2024-09-14T05:38:46.763577+0000 mgr.a (mgr.14355) 18936 : audit [DBG] from='client.406065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:48 smithi131 bash[24745]: cluster 2024-09-14T05:38:46.644230+0000 mgr.a (mgr.14355) 18935 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:48 smithi131 bash[24745]: audit 2024-09-14T05:38:46.763577+0000 mgr.a (mgr.14355) 18936 : audit [DBG] from='client.406065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:48 smithi171 bash[25040]: cluster 2024-09-14T05:38:46.644230+0000 mgr.a (mgr.14355) 18935 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:38:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:48 smithi171 bash[25040]: audit 2024-09-14T05:38:46.763577+0000 mgr.a (mgr.14355) 18936 : audit [DBG] from='client.406065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:50 smithi007 bash[22722]: cluster 2024-09-14T05:38:48.645111+0000 mgr.a (mgr.14355) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:50 smithi131 bash[24745]: cluster 2024-09-14T05:38:48.645111+0000 mgr.a (mgr.14355) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:50 smithi171 bash[25040]: cluster 2024-09-14T05:38:48.645111+0000 mgr.a (mgr.14355) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:52.193 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:52.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:52.193 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:52 smithi007 bash[22722]: cluster 2024-09-14T05:38:50.647283+0000 mgr.a (mgr.14355) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:52 smithi131 bash[24745]: cluster 2024-09-14T05:38:50.647283+0000 mgr.a (mgr.14355) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:52 smithi171 bash[25040]: cluster 2024-09-14T05:38:50.647283+0000 mgr.a (mgr.14355) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:52.964 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:52.964 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:52.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:38:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:54 smithi007 bash[22722]: audit 2024-09-14T05:38:52.524433+0000 mgr.a (mgr.14355) 18939 : audit [DBG] from='client.406140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:54.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:54 smithi007 bash[22722]: cluster 2024-09-14T05:38:52.647795+0000 mgr.a (mgr.14355) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:54 smithi131 bash[24745]: audit 2024-09-14T05:38:52.524433+0000 mgr.a (mgr.14355) 18939 : audit [DBG] from='client.406140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:54 smithi131 bash[24745]: cluster 2024-09-14T05:38:52.647795+0000 mgr.a (mgr.14355) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:54 smithi171 bash[25040]: audit 2024-09-14T05:38:52.524433+0000 mgr.a (mgr.14355) 18939 : audit [DBG] from='client.406140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:38:54.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:54 smithi171 bash[25040]: cluster 2024-09-14T05:38:52.647795+0000 mgr.a (mgr.14355) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:56.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:56 smithi007 bash[22722]: cluster 2024-09-14T05:38:54.648624+0000 mgr.a (mgr.14355) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:56 smithi131 bash[24745]: cluster 2024-09-14T05:38:54.648624+0000 mgr.a (mgr.14355) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:56 smithi171 bash[25040]: cluster 2024-09-14T05:38:54.648624+0000 mgr.a (mgr.14355) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:38:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:38:57.966 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:38:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:38:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:38:58 smithi007 bash[22722]: cluster 2024-09-14T05:38:56.650886+0000 mgr.a (mgr.14355) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:38:58 smithi131 bash[24745]: cluster 2024-09-14T05:38:56.650886+0000 mgr.a (mgr.14355) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:38:58 smithi171 bash[25040]: cluster 2024-09-14T05:38:56.650886+0000 mgr.a (mgr.14355) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:38:58.724 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:38:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:38:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:38:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:38:58.725 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:00 smithi007 bash[22722]: audit 2024-09-14T05:38:58.296709+0000 mgr.a (mgr.14355) 18943 : audit [DBG] from='client.406215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:00.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:00 smithi007 bash[22722]: cluster 2024-09-14T05:38:58.651564+0000 mgr.a (mgr.14355) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:00 smithi131 bash[24745]: audit 2024-09-14T05:38:58.296709+0000 mgr.a (mgr.14355) 18943 : audit [DBG] from='client.406215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:00 smithi131 bash[24745]: cluster 2024-09-14T05:38:58.651564+0000 mgr.a (mgr.14355) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:00 smithi171 bash[25040]: audit 2024-09-14T05:38:58.296709+0000 mgr.a (mgr.14355) 18943 : audit [DBG] from='client.406215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:00 smithi171 bash[25040]: cluster 2024-09-14T05:38:58.651564+0000 mgr.a (mgr.14355) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:02 smithi007 bash[22722]: cluster 2024-09-14T05:39:00.653713+0000 mgr.a (mgr.14355) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:02 smithi131 bash[24745]: cluster 2024-09-14T05:39:00.653713+0000 mgr.a (mgr.14355) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:02 smithi171 bash[25040]: cluster 2024-09-14T05:39:00.653713+0000 mgr.a (mgr.14355) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:03.726 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:03.727 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:04 smithi007 bash[22722]: cluster 2024-09-14T05:39:02.654540+0000 mgr.a (mgr.14355) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:04.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:04 smithi131 bash[24745]: cluster 2024-09-14T05:39:02.654540+0000 mgr.a (mgr.14355) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:04 smithi171 bash[25040]: cluster 2024-09-14T05:39:02.654540+0000 mgr.a (mgr.14355) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:05 smithi007 bash[22722]: audit 2024-09-14T05:39:04.054702+0000 mgr.a (mgr.14355) 18947 : audit [DBG] from='client.406290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:05 smithi131 bash[24745]: audit 2024-09-14T05:39:04.054702+0000 mgr.a (mgr.14355) 18947 : audit [DBG] from='client.406290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:05 smithi171 bash[25040]: audit 2024-09-14T05:39:04.054702+0000 mgr.a (mgr.14355) 18947 : audit [DBG] from='client.406290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:06 smithi007 bash[22722]: cluster 2024-09-14T05:39:04.655438+0000 mgr.a (mgr.14355) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:06 smithi131 bash[24745]: cluster 2024-09-14T05:39:04.655438+0000 mgr.a (mgr.14355) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:06 smithi171 bash[25040]: cluster 2024-09-14T05:39:04.655438+0000 mgr.a (mgr.14355) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:08 smithi007 bash[22722]: cluster 2024-09-14T05:39:06.657681+0000 mgr.a (mgr.14355) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:08 smithi131 bash[24745]: cluster 2024-09-14T05:39:06.657681+0000 mgr.a (mgr.14355) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:08 smithi171 bash[25040]: cluster 2024-09-14T05:39:06.657681+0000 mgr.a (mgr.14355) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:09.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:09.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:10.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:10 smithi007 bash[22722]: cluster 2024-09-14T05:39:08.658481+0000 mgr.a (mgr.14355) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:10 smithi131 bash[24745]: cluster 2024-09-14T05:39:08.658481+0000 mgr.a (mgr.14355) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:10 smithi171 bash[25040]: cluster 2024-09-14T05:39:08.658481+0000 mgr.a (mgr.14355) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:11 smithi007 bash[22722]: audit 2024-09-14T05:39:09.797661+0000 mgr.a (mgr.14355) 18951 : audit [DBG] from='client.406368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:11 smithi131 bash[24745]: audit 2024-09-14T05:39:09.797661+0000 mgr.a (mgr.14355) 18951 : audit [DBG] from='client.406368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:11 smithi171 bash[25040]: audit 2024-09-14T05:39:09.797661+0000 mgr.a (mgr.14355) 18951 : audit [DBG] from='client.406368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:12 smithi007 bash[22722]: cluster 2024-09-14T05:39:10.660801+0000 mgr.a (mgr.14355) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:12.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:12 smithi131 bash[24745]: cluster 2024-09-14T05:39:10.660801+0000 mgr.a (mgr.14355) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:12 smithi171 bash[25040]: cluster 2024-09-14T05:39:10.660801+0000 mgr.a (mgr.14355) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:14 smithi007 bash[22722]: cluster 2024-09-14T05:39:12.661583+0000 mgr.a (mgr.14355) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:14 smithi131 bash[24745]: cluster 2024-09-14T05:39:12.661583+0000 mgr.a (mgr.14355) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:14 smithi171 bash[25040]: cluster 2024-09-14T05:39:12.661583+0000 mgr.a (mgr.14355) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:15.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:16.010 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:16.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:16.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:16.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:16.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:16 smithi007 bash[22722]: cluster 2024-09-14T05:39:14.662386+0000 mgr.a (mgr.14355) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:16 smithi131 bash[24745]: cluster 2024-09-14T05:39:14.662386+0000 mgr.a (mgr.14355) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:16.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:16 smithi171 bash[25040]: cluster 2024-09-14T05:39:14.662386+0000 mgr.a (mgr.14355) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:17 smithi007 bash[22722]: audit 2024-09-14T05:39:15.563995+0000 mgr.a (mgr.14355) 18955 : audit [DBG] from='client.406446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:17 smithi131 bash[24745]: audit 2024-09-14T05:39:15.563995+0000 mgr.a (mgr.14355) 18955 : audit [DBG] from='client.406446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:17 smithi171 bash[25040]: audit 2024-09-14T05:39:15.563995+0000 mgr.a (mgr.14355) 18955 : audit [DBG] from='client.406446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:18 smithi007 bash[22722]: cluster 2024-09-14T05:39:16.665037+0000 mgr.a (mgr.14355) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:18 smithi131 bash[24745]: cluster 2024-09-14T05:39:16.665037+0000 mgr.a (mgr.14355) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:18 smithi171 bash[25040]: cluster 2024-09-14T05:39:16.665037+0000 mgr.a (mgr.14355) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:20 smithi007 bash[22722]: cluster 2024-09-14T05:39:18.665830+0000 mgr.a (mgr.14355) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:20 smithi131 bash[24745]: cluster 2024-09-14T05:39:18.665830+0000 mgr.a (mgr.14355) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:20 smithi171 bash[25040]: cluster 2024-09-14T05:39:18.665830+0000 mgr.a (mgr.14355) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:21.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:21.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:21.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:21.789 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:21.790 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:22 smithi007 bash[22722]: cluster 2024-09-14T05:39:20.667799+0000 mgr.a (mgr.14355) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:22 smithi131 bash[24745]: cluster 2024-09-14T05:39:20.667799+0000 mgr.a (mgr.14355) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:22 smithi171 bash[25040]: cluster 2024-09-14T05:39:20.667799+0000 mgr.a (mgr.14355) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:23.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:23 smithi007 bash[22722]: audit 2024-09-14T05:39:21.355877+0000 mgr.a (mgr.14355) 18959 : audit [DBG] from='client.406521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:23.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:23 smithi131 bash[24745]: audit 2024-09-14T05:39:21.355877+0000 mgr.a (mgr.14355) 18959 : audit [DBG] from='client.406521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:23.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:23 smithi171 bash[25040]: audit 2024-09-14T05:39:21.355877+0000 mgr.a (mgr.14355) 18959 : audit [DBG] from='client.406521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:24 smithi007 bash[22722]: cluster 2024-09-14T05:39:22.668677+0000 mgr.a (mgr.14355) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:24 smithi131 bash[24745]: cluster 2024-09-14T05:39:22.668677+0000 mgr.a (mgr.14355) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:24 smithi171 bash[25040]: cluster 2024-09-14T05:39:22.668677+0000 mgr.a (mgr.14355) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:25 smithi131 bash[24745]: cluster 2024-09-14T05:39:24.669469+0000 mgr.a (mgr.14355) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:25 smithi171 bash[25040]: cluster 2024-09-14T05:39:24.669469+0000 mgr.a (mgr.14355) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:25 smithi007 bash[22722]: cluster 2024-09-14T05:39:24.669469+0000 mgr.a (mgr.14355) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:26.791 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:26.792 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:27.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:27.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:27 smithi131 bash[24745]: cluster 2024-09-14T05:39:26.671699+0000 mgr.a (mgr.14355) 18962 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:28.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:27 smithi131 bash[24745]: audit 2024-09-14T05:39:27.119772+0000 mgr.a (mgr.14355) 18963 : audit [DBG] from='client.406593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:27 smithi171 bash[25040]: cluster 2024-09-14T05:39:26.671699+0000 mgr.a (mgr.14355) 18962 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:28.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:27 smithi171 bash[25040]: audit 2024-09-14T05:39:27.119772+0000 mgr.a (mgr.14355) 18963 : audit [DBG] from='client.406593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:27 smithi007 bash[22722]: cluster 2024-09-14T05:39:26.671699+0000 mgr.a (mgr.14355) 18962 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:27 smithi007 bash[22722]: audit 2024-09-14T05:39:27.119772+0000 mgr.a (mgr.14355) 18963 : audit [DBG] from='client.406593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:29 smithi131 bash[24745]: cluster 2024-09-14T05:39:28.672657+0000 mgr.a (mgr.14355) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:29 smithi171 bash[25040]: cluster 2024-09-14T05:39:28.672657+0000 mgr.a (mgr.14355) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:29 smithi007 bash[22722]: cluster 2024-09-14T05:39:28.672657+0000 mgr.a (mgr.14355) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:31 smithi131 bash[24745]: cluster 2024-09-14T05:39:30.674855+0000 mgr.a (mgr.14355) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:31 smithi131 bash[24745]: audit 2024-09-14T05:39:31.004206+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:39:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:31 smithi171 bash[25040]: cluster 2024-09-14T05:39:30.674855+0000 mgr.a (mgr.14355) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:31 smithi171 bash[25040]: audit 2024-09-14T05:39:31.004206+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:39:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:31 smithi007 bash[22722]: cluster 2024-09-14T05:39:30.674855+0000 mgr.a (mgr.14355) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:39:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:31 smithi007 bash[22722]: audit 2024-09-14T05:39:31.004206+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:39:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:32.549 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:32.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22972]: debug 2024-09-14T05:39:32.629+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:39:32.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22972]: debug 2024-09-14T05:39:32.629+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:39:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22722]: audit 2024-09-14T05:39:31.855228+0000 mon.a (mon.0) 3419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:39:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22722]: audit 2024-09-14T05:39:31.857039+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:39:32.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22722]: audit 2024-09-14T05:39:31.867635+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:39:32.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22722]: audit 2024-09-14T05:39:31.873002+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:32.956 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:32 smithi007 bash[22722]: audit 2024-09-14T05:39:31.875368+0000 mgr.a (mgr.14355) 18966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:32 smithi131 bash[24745]: audit 2024-09-14T05:39:31.855228+0000 mon.a (mon.0) 3419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:39:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:32 smithi131 bash[24745]: audit 2024-09-14T05:39:31.857039+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:39:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:32 smithi131 bash[24745]: audit 2024-09-14T05:39:31.867635+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:39:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:32 smithi131 bash[24745]: audit 2024-09-14T05:39:31.873002+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:33.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:32 smithi131 bash[24745]: audit 2024-09-14T05:39:31.875368+0000 mgr.a (mgr.14355) 18966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:32 smithi171 bash[25040]: audit 2024-09-14T05:39:31.855228+0000 mon.a (mon.0) 3419 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:39:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:32 smithi171 bash[25040]: audit 2024-09-14T05:39:31.857039+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:39:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:32 smithi171 bash[25040]: audit 2024-09-14T05:39:31.867635+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:39:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:32 smithi171 bash[25040]: audit 2024-09-14T05:39:31.873002+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:33.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:32 smithi171 bash[25040]: audit 2024-09-14T05:39:31.875368+0000 mgr.a (mgr.14355) 18966 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:39:33.323 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:33.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:34.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:33 smithi007 bash[22722]: audit 2024-09-14T05:39:32.631271+0000 mgr.a (mgr.14355) 18967 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:39:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:33 smithi007 bash[22722]: cephadm 2024-09-14T05:39:32.632550+0000 mgr.a (mgr.14355) 18968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:39:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:33 smithi007 bash[22722]: cluster 2024-09-14T05:39:32.675462+0000 mgr.a (mgr.14355) 18969 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:34.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:33 smithi007 bash[22722]: audit 2024-09-14T05:39:32.886210+0000 mgr.a (mgr.14355) 18970 : audit [DBG] from='client.406776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:33 smithi131 bash[24745]: audit 2024-09-14T05:39:32.631271+0000 mgr.a (mgr.14355) 18967 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:39:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:33 smithi131 bash[24745]: cephadm 2024-09-14T05:39:32.632550+0000 mgr.a (mgr.14355) 18968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:39:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:33 smithi131 bash[24745]: cluster 2024-09-14T05:39:32.675462+0000 mgr.a (mgr.14355) 18969 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:34.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:33 smithi131 bash[24745]: audit 2024-09-14T05:39:32.886210+0000 mgr.a (mgr.14355) 18970 : audit [DBG] from='client.406776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:33 smithi171 bash[25040]: audit 2024-09-14T05:39:32.631271+0000 mgr.a (mgr.14355) 18967 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:39:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:33 smithi171 bash[25040]: cephadm 2024-09-14T05:39:32.632550+0000 mgr.a (mgr.14355) 18968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:39:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:33 smithi171 bash[25040]: cluster 2024-09-14T05:39:32.675462+0000 mgr.a (mgr.14355) 18969 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:33 smithi171 bash[25040]: audit 2024-09-14T05:39:32.886210+0000 mgr.a (mgr.14355) 18970 : audit [DBG] from='client.406776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:36.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:35 smithi007 bash[22722]: cluster 2024-09-14T05:39:34.676541+0000 mgr.a (mgr.14355) 18971 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:35 smithi131 bash[24745]: cluster 2024-09-14T05:39:34.676541+0000 mgr.a (mgr.14355) 18971 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:35 smithi171 bash[25040]: cluster 2024-09-14T05:39:34.676541+0000 mgr.a (mgr.14355) 18971 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:38.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:37 smithi007 bash[22722]: cluster 2024-09-14T05:39:36.679010+0000 mgr.a (mgr.14355) 18972 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:37 smithi131 bash[24745]: cluster 2024-09-14T05:39:36.679010+0000 mgr.a (mgr.14355) 18972 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:37 smithi171 bash[25040]: cluster 2024-09-14T05:39:36.679010+0000 mgr.a (mgr.14355) 18972 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:38.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:39.109 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:39 smithi007 bash[22722]: audit 2024-09-14T05:39:38.662364+0000 mgr.a (mgr.14355) 18973 : audit [DBG] from='client.406854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:40.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:39 smithi007 bash[22722]: cluster 2024-09-14T05:39:38.680312+0000 mgr.a (mgr.14355) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:39 smithi131 bash[24745]: audit 2024-09-14T05:39:38.662364+0000 mgr.a (mgr.14355) 18973 : audit [DBG] from='client.406854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:39 smithi131 bash[24745]: cluster 2024-09-14T05:39:38.680312+0000 mgr.a (mgr.14355) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:39 smithi171 bash[25040]: audit 2024-09-14T05:39:38.662364+0000 mgr.a (mgr.14355) 18973 : audit [DBG] from='client.406854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:40.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:39 smithi171 bash[25040]: cluster 2024-09-14T05:39:38.680312+0000 mgr.a (mgr.14355) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:42.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:41 smithi007 bash[22722]: cluster 2024-09-14T05:39:40.682750+0000 mgr.a (mgr.14355) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:41 smithi131 bash[24745]: cluster 2024-09-14T05:39:40.682750+0000 mgr.a (mgr.14355) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:41 smithi171 bash[25040]: cluster 2024-09-14T05:39:40.682750+0000 mgr.a (mgr.14355) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:44.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:44.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:44.111 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:44.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:43 smithi007 bash[22722]: cluster 2024-09-14T05:39:42.683540+0000 mgr.a (mgr.14355) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:43 smithi131 bash[24745]: cluster 2024-09-14T05:39:42.683540+0000 mgr.a (mgr.14355) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:43 smithi171 bash[25040]: cluster 2024-09-14T05:39:42.683540+0000 mgr.a (mgr.14355) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:44.859 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:44.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:44.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:44.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:44.859 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:45 smithi007 bash[22722]: audit 2024-09-14T05:39:44.442771+0000 mgr.a (mgr.14355) 18977 : audit [DBG] from='client.406923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:46.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:45 smithi007 bash[22722]: cluster 2024-09-14T05:39:44.684200+0000 mgr.a (mgr.14355) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:45 smithi131 bash[24745]: audit 2024-09-14T05:39:44.442771+0000 mgr.a (mgr.14355) 18977 : audit [DBG] from='client.406923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:45 smithi131 bash[24745]: cluster 2024-09-14T05:39:44.684200+0000 mgr.a (mgr.14355) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:45 smithi171 bash[25040]: audit 2024-09-14T05:39:44.442771+0000 mgr.a (mgr.14355) 18977 : audit [DBG] from='client.406923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:45 smithi171 bash[25040]: cluster 2024-09-14T05:39:44.684200+0000 mgr.a (mgr.14355) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:48.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:47 smithi007 bash[22722]: cluster 2024-09-14T05:39:46.687018+0000 mgr.a (mgr.14355) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:47 smithi131 bash[24745]: cluster 2024-09-14T05:39:46.687018+0000 mgr.a (mgr.14355) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:47 smithi171 bash[25040]: cluster 2024-09-14T05:39:46.687018+0000 mgr.a (mgr.14355) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:39:49.860 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:49.861 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:49 smithi007 bash[22722]: cluster 2024-09-14T05:39:48.687784+0000 mgr.a (mgr.14355) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:49 smithi131 bash[24745]: cluster 2024-09-14T05:39:48.687784+0000 mgr.a (mgr.14355) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:49 smithi171 bash[25040]: cluster 2024-09-14T05:39:48.687784+0000 mgr.a (mgr.14355) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:50.637 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:50.638 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:51.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:50 smithi007 bash[22722]: audit 2024-09-14T05:39:50.195522+0000 mgr.a (mgr.14355) 18981 : audit [DBG] from='client.406995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:51.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:50 smithi131 bash[24745]: audit 2024-09-14T05:39:50.195522+0000 mgr.a (mgr.14355) 18981 : audit [DBG] from='client.406995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:51.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:50 smithi171 bash[25040]: audit 2024-09-14T05:39:50.195522+0000 mgr.a (mgr.14355) 18981 : audit [DBG] from='client.406995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:51 smithi007 bash[22722]: cluster 2024-09-14T05:39:50.689274+0000 mgr.a (mgr.14355) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:51 smithi131 bash[24745]: cluster 2024-09-14T05:39:50.689274+0000 mgr.a (mgr.14355) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:52.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:51 smithi171 bash[25040]: cluster 2024-09-14T05:39:50.689274+0000 mgr.a (mgr.14355) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:53 smithi007 bash[22722]: cluster 2024-09-14T05:39:52.690018+0000 mgr.a (mgr.14355) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:53 smithi131 bash[24745]: cluster 2024-09-14T05:39:52.690018+0000 mgr.a (mgr.14355) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:53 smithi171 bash[25040]: cluster 2024-09-14T05:39:52.690018+0000 mgr.a (mgr.14355) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:39:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:39:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:39:55.639 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:39:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:55 smithi007 bash[22722]: cluster 2024-09-14T05:39:54.690763+0000 mgr.a (mgr.14355) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:55 smithi131 bash[24745]: cluster 2024-09-14T05:39:54.690763+0000 mgr.a (mgr.14355) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:55 smithi171 bash[25040]: cluster 2024-09-14T05:39:54.690763+0000 mgr.a (mgr.14355) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:39:56.410 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:39:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:39:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:39:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:39:56.410 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:39:57.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:56 smithi007 bash[22722]: audit 2024-09-14T05:39:55.974275+0000 mgr.a (mgr.14355) 18985 : audit [DBG] from='client.407070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:57.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:56 smithi131 bash[24745]: audit 2024-09-14T05:39:55.974275+0000 mgr.a (mgr.14355) 18985 : audit [DBG] from='client.407070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:57.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:56 smithi171 bash[25040]: audit 2024-09-14T05:39:55.974275+0000 mgr.a (mgr.14355) 18985 : audit [DBG] from='client.407070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:39:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:57 smithi007 bash[22722]: cluster 2024-09-14T05:39:56.693494+0000 mgr.a (mgr.14355) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:57 smithi131 bash[24745]: cluster 2024-09-14T05:39:56.693494+0000 mgr.a (mgr.14355) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:39:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:57 smithi171 bash[25040]: cluster 2024-09-14T05:39:56.693494+0000 mgr.a (mgr.14355) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:39:59 smithi007 bash[22722]: cluster 2024-09-14T05:39:58.694316+0000 mgr.a (mgr.14355) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:40:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:39:59 smithi131 bash[24745]: cluster 2024-09-14T05:39:58.694316+0000 mgr.a (mgr.14355) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:40:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:39:59 smithi171 bash[25040]: cluster 2024-09-14T05:39:58.694316+0000 mgr.a (mgr.14355) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:40:01.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:00 smithi007 bash[22722]: cluster 2024-09-14T05:40:00.000138+0000 mon.a (mon.0) 3423 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:40:01.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:00 smithi131 bash[24745]: cluster 2024-09-14T05:40:00.000138+0000 mon.a (mon.0) 3423 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:40:01.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:00 smithi171 bash[25040]: cluster 2024-09-14T05:40:00.000138+0000 mon.a (mon.0) 3423 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:40:01.411 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:01.412 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:02.193 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:02.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:02.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:02.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:02.194 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:01 smithi007 bash[22722]: cluster 2024-09-14T05:40:00.696224+0000 mgr.a (mgr.14355) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:01 smithi131 bash[24745]: cluster 2024-09-14T05:40:00.696224+0000 mgr.a (mgr.14355) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:01 smithi171 bash[25040]: cluster 2024-09-14T05:40:00.696224+0000 mgr.a (mgr.14355) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:03.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:02 smithi007 bash[22722]: audit 2024-09-14T05:40:01.748245+0000 mgr.a (mgr.14355) 18989 : audit [DBG] from='client.407148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:03.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:02 smithi131 bash[24745]: audit 2024-09-14T05:40:01.748245+0000 mgr.a (mgr.14355) 18989 : audit [DBG] from='client.407148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:03.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:02 smithi171 bash[25040]: audit 2024-09-14T05:40:01.748245+0000 mgr.a (mgr.14355) 18989 : audit [DBG] from='client.407148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:04.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:03 smithi131 bash[24745]: cluster 2024-09-14T05:40:02.697111+0000 mgr.a (mgr.14355) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:04.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:03 smithi171 bash[25040]: cluster 2024-09-14T05:40:02.697111+0000 mgr.a (mgr.14355) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:03 smithi007 bash[22722]: cluster 2024-09-14T05:40:02.697111+0000 mgr.a (mgr.14355) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:05 smithi131 bash[24745]: cluster 2024-09-14T05:40:04.697913+0000 mgr.a (mgr.14355) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:06.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:05 smithi171 bash[25040]: cluster 2024-09-14T05:40:04.697913+0000 mgr.a (mgr.14355) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:05 smithi007 bash[22722]: cluster 2024-09-14T05:40:04.697913+0000 mgr.a (mgr.14355) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:07.965 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:07.965 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:07 smithi131 bash[24745]: cluster 2024-09-14T05:40:06.700116+0000 mgr.a (mgr.14355) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:08.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:07 smithi171 bash[25040]: cluster 2024-09-14T05:40:06.700116+0000 mgr.a (mgr.14355) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:07 smithi007 bash[22722]: cluster 2024-09-14T05:40:06.700116+0000 mgr.a (mgr.14355) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:09.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:08 smithi131 bash[24745]: audit 2024-09-14T05:40:07.526784+0000 mgr.a (mgr.14355) 18993 : audit [DBG] from='client.407223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:09.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:08 smithi171 bash[25040]: audit 2024-09-14T05:40:07.526784+0000 mgr.a (mgr.14355) 18993 : audit [DBG] from='client.407223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:09.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:08 smithi007 bash[22722]: audit 2024-09-14T05:40:07.526784+0000 mgr.a (mgr.14355) 18993 : audit [DBG] from='client.407223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:09 smithi131 bash[24745]: cluster 2024-09-14T05:40:08.701105+0000 mgr.a (mgr.14355) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:09 smithi171 bash[25040]: cluster 2024-09-14T05:40:08.701105+0000 mgr.a (mgr.14355) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:09 smithi007 bash[22722]: cluster 2024-09-14T05:40:08.701105+0000 mgr.a (mgr.14355) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:11 smithi131 bash[24745]: cluster 2024-09-14T05:40:10.703310+0000 mgr.a (mgr.14355) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:11 smithi171 bash[25040]: cluster 2024-09-14T05:40:10.703310+0000 mgr.a (mgr.14355) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:11 smithi007 bash[22722]: cluster 2024-09-14T05:40:10.703310+0000 mgr.a (mgr.14355) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:12.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:12.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:12.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:13.742 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:13 smithi131 bash[24745]: cluster 2024-09-14T05:40:12.704080+0000 mgr.a (mgr.14355) 18996 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:13 smithi171 bash[25040]: cluster 2024-09-14T05:40:12.704080+0000 mgr.a (mgr.14355) 18996 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:13 smithi007 bash[22722]: cluster 2024-09-14T05:40:12.704080+0000 mgr.a (mgr.14355) 18996 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:15.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:14 smithi131 bash[24745]: audit 2024-09-14T05:40:13.307974+0000 mgr.a (mgr.14355) 18997 : audit [DBG] from='client.407301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:15.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:14 smithi171 bash[25040]: audit 2024-09-14T05:40:13.307974+0000 mgr.a (mgr.14355) 18997 : audit [DBG] from='client.407301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:15.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:14 smithi007 bash[22722]: audit 2024-09-14T05:40:13.307974+0000 mgr.a (mgr.14355) 18997 : audit [DBG] from='client.407301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:15 smithi131 bash[24745]: cluster 2024-09-14T05:40:14.705054+0000 mgr.a (mgr.14355) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:15 smithi171 bash[25040]: cluster 2024-09-14T05:40:14.705054+0000 mgr.a (mgr.14355) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:15 smithi007 bash[22722]: cluster 2024-09-14T05:40:14.705054+0000 mgr.a (mgr.14355) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:18 smithi131 bash[24745]: cluster 2024-09-14T05:40:16.707337+0000 mgr.a (mgr.14355) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:18 smithi171 bash[25040]: cluster 2024-09-14T05:40:16.707337+0000 mgr.a (mgr.14355) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:18 smithi007 bash[22722]: cluster 2024-09-14T05:40:16.707337+0000 mgr.a (mgr.14355) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:18.743 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:18.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:18.744 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:19.522 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:19.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:19.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:19.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:20 smithi131 bash[24745]: cluster 2024-09-14T05:40:18.708116+0000 mgr.a (mgr.14355) 19000 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:20.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:20 smithi131 bash[24745]: audit 2024-09-14T05:40:19.081921+0000 mgr.a (mgr.14355) 19001 : audit [DBG] from='client.407379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:20 smithi171 bash[25040]: cluster 2024-09-14T05:40:18.708116+0000 mgr.a (mgr.14355) 19000 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:20 smithi171 bash[25040]: audit 2024-09-14T05:40:19.081921+0000 mgr.a (mgr.14355) 19001 : audit [DBG] from='client.407379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:20 smithi007 bash[22722]: cluster 2024-09-14T05:40:18.708116+0000 mgr.a (mgr.14355) 19000 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:20 smithi007 bash[22722]: audit 2024-09-14T05:40:19.081921+0000 mgr.a (mgr.14355) 19001 : audit [DBG] from='client.407379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:22 smithi131 bash[24745]: cluster 2024-09-14T05:40:20.710484+0000 mgr.a (mgr.14355) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:22 smithi171 bash[25040]: cluster 2024-09-14T05:40:20.710484+0000 mgr.a (mgr.14355) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:22 smithi007 bash[22722]: cluster 2024-09-14T05:40:20.710484+0000 mgr.a (mgr.14355) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:24 smithi131 bash[24745]: cluster 2024-09-14T05:40:22.711256+0000 mgr.a (mgr.14355) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:24 smithi171 bash[25040]: cluster 2024-09-14T05:40:22.711256+0000 mgr.a (mgr.14355) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:24 smithi007 bash[22722]: cluster 2024-09-14T05:40:22.711256+0000 mgr.a (mgr.14355) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:24.524 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:24.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:24.524 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:25.282 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:25.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:25.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:25.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:25.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:26 smithi131 bash[24745]: cluster 2024-09-14T05:40:24.711812+0000 mgr.a (mgr.14355) 19004 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:26.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:26 smithi131 bash[24745]: audit 2024-09-14T05:40:24.855593+0000 mgr.a (mgr.14355) 19005 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:26 smithi171 bash[25040]: cluster 2024-09-14T05:40:24.711812+0000 mgr.a (mgr.14355) 19004 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:26 smithi171 bash[25040]: audit 2024-09-14T05:40:24.855593+0000 mgr.a (mgr.14355) 19005 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:26 smithi007 bash[22722]: cluster 2024-09-14T05:40:24.711812+0000 mgr.a (mgr.14355) 19004 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:26.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:26 smithi007 bash[22722]: audit 2024-09-14T05:40:24.855593+0000 mgr.a (mgr.14355) 19005 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:28 smithi131 bash[24745]: cluster 2024-09-14T05:40:26.714136+0000 mgr.a (mgr.14355) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:40:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:28 smithi171 bash[25040]: cluster 2024-09-14T05:40:26.714136+0000 mgr.a (mgr.14355) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:40:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:28 smithi007 bash[22722]: cluster 2024-09-14T05:40:26.714136+0000 mgr.a (mgr.14355) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:40:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:30 smithi131 bash[24745]: cluster 2024-09-14T05:40:28.714922+0000 mgr.a (mgr.14355) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:40:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:30.284 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:30.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:30 smithi171 bash[25040]: cluster 2024-09-14T05:40:28.714922+0000 mgr.a (mgr.14355) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:40:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:30 smithi007 bash[22722]: cluster 2024-09-14T05:40:28.714922+0000 mgr.a (mgr.14355) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:40:31.037 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:31.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:31.037 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:31.038 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:32 smithi131 bash[24745]: audit 2024-09-14T05:40:30.613079+0000 mgr.a (mgr.14355) 19008 : audit [DBG] from='client.407532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:32.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:32 smithi131 bash[24745]: cluster 2024-09-14T05:40:30.716114+0000 mgr.a (mgr.14355) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:32 smithi171 bash[25040]: audit 2024-09-14T05:40:30.613079+0000 mgr.a (mgr.14355) 19008 : audit [DBG] from='client.407532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:32.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:32 smithi171 bash[25040]: cluster 2024-09-14T05:40:30.716114+0000 mgr.a (mgr.14355) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:32 smithi007 bash[22722]: audit 2024-09-14T05:40:30.613079+0000 mgr.a (mgr.14355) 19008 : audit [DBG] from='client.407532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:32 smithi007 bash[22722]: cluster 2024-09-14T05:40:30.716114+0000 mgr.a (mgr.14355) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:33.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:33 smithi131 bash[24745]: audit 2024-09-14T05:40:32.687789+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:40:33.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:33 smithi171 bash[25040]: audit 2024-09-14T05:40:32.687789+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:40:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:33 smithi007 bash[22722]: audit 2024-09-14T05:40:32.687789+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:40:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:34 smithi171 bash[25040]: cluster 2024-09-14T05:40:32.716955+0000 mgr.a (mgr.14355) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:34 smithi171 bash[25040]: audit 2024-09-14T05:40:33.539054+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:40:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:34 smithi171 bash[25040]: audit 2024-09-14T05:40:33.540635+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:40:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:34 smithi171 bash[25040]: audit 2024-09-14T05:40:33.550950+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:40:34.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:34 smithi171 bash[25040]: audit 2024-09-14T05:40:33.556243+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:34.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22722]: cluster 2024-09-14T05:40:32.716955+0000 mgr.a (mgr.14355) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:34.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22722]: audit 2024-09-14T05:40:33.539054+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:40:34.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22722]: audit 2024-09-14T05:40:33.540635+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:40:34.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22722]: audit 2024-09-14T05:40:33.550950+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:40:34.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22722]: audit 2024-09-14T05:40:33.556243+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:34 smithi131 bash[24745]: cluster 2024-09-14T05:40:32.716955+0000 mgr.a (mgr.14355) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:34 smithi131 bash[24745]: audit 2024-09-14T05:40:33.539054+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:40:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:34 smithi131 bash[24745]: audit 2024-09-14T05:40:33.540635+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:40:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:34 smithi131 bash[24745]: audit 2024-09-14T05:40:33.550950+0000 mon.a (mon.0) 3427 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:40:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:34 smithi131 bash[24745]: audit 2024-09-14T05:40:33.556243+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:34.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22972]: debug 2024-09-14T05:40:34.312+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:40:34.705 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:40:34 smithi007 bash[22972]: debug 2024-09-14T05:40:34.316+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:40:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:35 smithi007 bash[22722]: audit 2024-09-14T05:40:33.558695+0000 mgr.a (mgr.14355) 19011 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:35 smithi131 bash[24745]: audit 2024-09-14T05:40:33.558695+0000 mgr.a (mgr.14355) 19011 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:35 smithi171 bash[25040]: audit 2024-09-14T05:40:33.558695+0000 mgr.a (mgr.14355) 19011 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:40:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:36 smithi007 bash[22722]: audit 2024-09-14T05:40:34.318125+0000 mgr.a (mgr.14355) 19012 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:40:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:36 smithi007 bash[22722]: cephadm 2024-09-14T05:40:34.319660+0000 mgr.a (mgr.14355) 19013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:40:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:36 smithi007 bash[22722]: cluster 2024-09-14T05:40:34.717904+0000 mgr.a (mgr.14355) 19014 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:36 smithi131 bash[24745]: audit 2024-09-14T05:40:34.318125+0000 mgr.a (mgr.14355) 19012 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:40:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:36 smithi131 bash[24745]: cephadm 2024-09-14T05:40:34.319660+0000 mgr.a (mgr.14355) 19013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:40:36.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:36 smithi131 bash[24745]: cluster 2024-09-14T05:40:34.717904+0000 mgr.a (mgr.14355) 19014 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:36 smithi171 bash[25040]: audit 2024-09-14T05:40:34.318125+0000 mgr.a (mgr.14355) 19012 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:40:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:36 smithi171 bash[25040]: cephadm 2024-09-14T05:40:34.319660+0000 mgr.a (mgr.14355) 19013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:40:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:36 smithi171 bash[25040]: cluster 2024-09-14T05:40:34.717904+0000 mgr.a (mgr.14355) 19014 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:40:36.818 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:36.819 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:38 smithi007 bash[22722]: audit 2024-09-14T05:40:36.369284+0000 mgr.a (mgr.14355) 19015 : audit [DBG] from='client.407712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:38 smithi007 bash[22722]: cluster 2024-09-14T05:40:36.719553+0000 mgr.a (mgr.14355) 19016 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:38 smithi131 bash[24745]: audit 2024-09-14T05:40:36.369284+0000 mgr.a (mgr.14355) 19015 : audit [DBG] from='client.407712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:38 smithi131 bash[24745]: cluster 2024-09-14T05:40:36.719553+0000 mgr.a (mgr.14355) 19016 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:38 smithi171 bash[25040]: audit 2024-09-14T05:40:36.369284+0000 mgr.a (mgr.14355) 19015 : audit [DBG] from='client.407712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:38 smithi171 bash[25040]: cluster 2024-09-14T05:40:36.719553+0000 mgr.a (mgr.14355) 19016 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:40 smithi007 bash[22722]: cluster 2024-09-14T05:40:38.720348+0000 mgr.a (mgr.14355) 19017 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:40:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:40 smithi131 bash[24745]: cluster 2024-09-14T05:40:38.720348+0000 mgr.a (mgr.14355) 19017 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:40:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:40 smithi171 bash[25040]: cluster 2024-09-14T05:40:38.720348+0000 mgr.a (mgr.14355) 19017 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:40:41.820 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:41.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:41.821 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:42 smithi007 bash[22722]: cluster 2024-09-14T05:40:40.722272+0000 mgr.a (mgr.14355) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:42 smithi131 bash[24745]: cluster 2024-09-14T05:40:40.722272+0000 mgr.a (mgr.14355) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:42 smithi171 bash[25040]: cluster 2024-09-14T05:40:40.722272+0000 mgr.a (mgr.14355) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:42.601 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:42.601 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:43 smithi007 bash[22722]: audit 2024-09-14T05:40:42.153587+0000 mgr.a (mgr.14355) 19019 : audit [DBG] from='client.407790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:43 smithi131 bash[24745]: audit 2024-09-14T05:40:42.153587+0000 mgr.a (mgr.14355) 19019 : audit [DBG] from='client.407790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:43 smithi171 bash[25040]: audit 2024-09-14T05:40:42.153587+0000 mgr.a (mgr.14355) 19019 : audit [DBG] from='client.407790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:44 smithi007 bash[22722]: cluster 2024-09-14T05:40:42.723260+0000 mgr.a (mgr.14355) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:44 smithi131 bash[24745]: cluster 2024-09-14T05:40:42.723260+0000 mgr.a (mgr.14355) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:44 smithi171 bash[25040]: cluster 2024-09-14T05:40:42.723260+0000 mgr.a (mgr.14355) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:46 smithi007 bash[22722]: cluster 2024-09-14T05:40:44.724020+0000 mgr.a (mgr.14355) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:46 smithi131 bash[24745]: cluster 2024-09-14T05:40:44.724020+0000 mgr.a (mgr.14355) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:46 smithi171 bash[25040]: cluster 2024-09-14T05:40:44.724020+0000 mgr.a (mgr.14355) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:47.602 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:47.603 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:48.383 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:48.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:48.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:48.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:48.383 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:48 smithi007 bash[22722]: cluster 2024-09-14T05:40:46.726236+0000 mgr.a (mgr.14355) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:48 smithi131 bash[24745]: cluster 2024-09-14T05:40:46.726236+0000 mgr.a (mgr.14355) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:48 smithi171 bash[25040]: cluster 2024-09-14T05:40:46.726236+0000 mgr.a (mgr.14355) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:40:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:49 smithi007 bash[22722]: audit 2024-09-14T05:40:47.935220+0000 mgr.a (mgr.14355) 19023 : audit [DBG] from='client.407865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:49 smithi131 bash[24745]: audit 2024-09-14T05:40:47.935220+0000 mgr.a (mgr.14355) 19023 : audit [DBG] from='client.407865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:49 smithi171 bash[25040]: audit 2024-09-14T05:40:47.935220+0000 mgr.a (mgr.14355) 19023 : audit [DBG] from='client.407865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:50 smithi007 bash[22722]: cluster 2024-09-14T05:40:48.727214+0000 mgr.a (mgr.14355) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:50 smithi131 bash[24745]: cluster 2024-09-14T05:40:48.727214+0000 mgr.a (mgr.14355) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:50 smithi171 bash[25040]: cluster 2024-09-14T05:40:48.727214+0000 mgr.a (mgr.14355) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:52 smithi007 bash[22722]: cluster 2024-09-14T05:40:50.729412+0000 mgr.a (mgr.14355) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:52 smithi131 bash[24745]: cluster 2024-09-14T05:40:50.729412+0000 mgr.a (mgr.14355) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:52 smithi171 bash[25040]: cluster 2024-09-14T05:40:50.729412+0000 mgr.a (mgr.14355) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:53.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:53.385 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:54.156 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:54.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:40:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:54 smithi007 bash[22722]: cluster 2024-09-14T05:40:52.730189+0000 mgr.a (mgr.14355) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:54 smithi131 bash[24745]: cluster 2024-09-14T05:40:52.730189+0000 mgr.a (mgr.14355) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:54 smithi171 bash[25040]: cluster 2024-09-14T05:40:52.730189+0000 mgr.a (mgr.14355) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:55 smithi007 bash[22722]: audit 2024-09-14T05:40:53.716404+0000 mgr.a (mgr.14355) 19027 : audit [DBG] from='client.407943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:55 smithi131 bash[24745]: audit 2024-09-14T05:40:53.716404+0000 mgr.a (mgr.14355) 19027 : audit [DBG] from='client.407943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:55 smithi171 bash[25040]: audit 2024-09-14T05:40:53.716404+0000 mgr.a (mgr.14355) 19027 : audit [DBG] from='client.407943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:40:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:56 smithi007 bash[22722]: cluster 2024-09-14T05:40:54.731125+0000 mgr.a (mgr.14355) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:56 smithi131 bash[24745]: cluster 2024-09-14T05:40:54.731125+0000 mgr.a (mgr.14355) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:56 smithi171 bash[25040]: cluster 2024-09-14T05:40:54.731125+0000 mgr.a (mgr.14355) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:40:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:40:58 smithi007 bash[22722]: cluster 2024-09-14T05:40:56.733418+0000 mgr.a (mgr.14355) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:40:58 smithi131 bash[24745]: cluster 2024-09-14T05:40:56.733418+0000 mgr.a (mgr.14355) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:40:58 smithi171 bash[25040]: cluster 2024-09-14T05:40:56.733418+0000 mgr.a (mgr.14355) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:40:59.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:40:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:40:59.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:40:59.926 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:40:59.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:40:59.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:40:59.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:40:59.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:00 smithi007 bash[22722]: cluster 2024-09-14T05:40:58.734180+0000 mgr.a (mgr.14355) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:00 smithi131 bash[24745]: cluster 2024-09-14T05:40:58.734180+0000 mgr.a (mgr.14355) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:00 smithi171 bash[25040]: cluster 2024-09-14T05:40:58.734180+0000 mgr.a (mgr.14355) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:01 smithi007 bash[22722]: audit 2024-09-14T05:40:59.489470+0000 mgr.a (mgr.14355) 19031 : audit [DBG] from='client.408018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:01 smithi131 bash[24745]: audit 2024-09-14T05:40:59.489470+0000 mgr.a (mgr.14355) 19031 : audit [DBG] from='client.408018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:01 smithi171 bash[25040]: audit 2024-09-14T05:40:59.489470+0000 mgr.a (mgr.14355) 19031 : audit [DBG] from='client.408018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:02 smithi007 bash[22722]: cluster 2024-09-14T05:41:00.736666+0000 mgr.a (mgr.14355) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:02 smithi131 bash[24745]: cluster 2024-09-14T05:41:00.736666+0000 mgr.a (mgr.14355) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:02 smithi171 bash[25040]: cluster 2024-09-14T05:41:00.736666+0000 mgr.a (mgr.14355) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:04 smithi007 bash[22722]: cluster 2024-09-14T05:41:02.737477+0000 mgr.a (mgr.14355) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:04 smithi131 bash[24745]: cluster 2024-09-14T05:41:02.737477+0000 mgr.a (mgr.14355) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:04 smithi171 bash[25040]: cluster 2024-09-14T05:41:02.737477+0000 mgr.a (mgr.14355) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:04.928 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:04.929 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:05.701 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:05.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:05.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:05.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:05.701 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:06 smithi007 bash[22722]: cluster 2024-09-14T05:41:04.738395+0000 mgr.a (mgr.14355) 19034 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:06 smithi131 bash[24745]: cluster 2024-09-14T05:41:04.738395+0000 mgr.a (mgr.14355) 19034 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:06 smithi171 bash[25040]: cluster 2024-09-14T05:41:04.738395+0000 mgr.a (mgr.14355) 19034 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:07 smithi007 bash[22722]: audit 2024-09-14T05:41:05.266531+0000 mgr.a (mgr.14355) 19035 : audit [DBG] from='client.408093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:07 smithi131 bash[24745]: audit 2024-09-14T05:41:05.266531+0000 mgr.a (mgr.14355) 19035 : audit [DBG] from='client.408093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:07 smithi171 bash[25040]: audit 2024-09-14T05:41:05.266531+0000 mgr.a (mgr.14355) 19035 : audit [DBG] from='client.408093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:08 smithi007 bash[22722]: cluster 2024-09-14T05:41:06.741159+0000 mgr.a (mgr.14355) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:08 smithi131 bash[24745]: cluster 2024-09-14T05:41:06.741159+0000 mgr.a (mgr.14355) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:08 smithi171 bash[25040]: cluster 2024-09-14T05:41:06.741159+0000 mgr.a (mgr.14355) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:10 smithi007 bash[22722]: cluster 2024-09-14T05:41:08.741968+0000 mgr.a (mgr.14355) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:10 smithi131 bash[24745]: cluster 2024-09-14T05:41:08.741968+0000 mgr.a (mgr.14355) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:10 smithi171 bash[25040]: cluster 2024-09-14T05:41:08.741968+0000 mgr.a (mgr.14355) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:10.702 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:10.703 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:11.447 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:11.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:12 smithi007 bash[22722]: cluster 2024-09-14T05:41:10.743444+0000 mgr.a (mgr.14355) 19038 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:12 smithi007 bash[22722]: audit 2024-09-14T05:41:11.034471+0000 mgr.a (mgr.14355) 19039 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:12 smithi131 bash[24745]: cluster 2024-09-14T05:41:10.743444+0000 mgr.a (mgr.14355) 19038 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:12 smithi131 bash[24745]: audit 2024-09-14T05:41:11.034471+0000 mgr.a (mgr.14355) 19039 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:12 smithi171 bash[25040]: cluster 2024-09-14T05:41:10.743444+0000 mgr.a (mgr.14355) 19038 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:12 smithi171 bash[25040]: audit 2024-09-14T05:41:11.034471+0000 mgr.a (mgr.14355) 19039 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:14 smithi007 bash[22722]: cluster 2024-09-14T05:41:12.744323+0000 mgr.a (mgr.14355) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:14 smithi131 bash[24745]: cluster 2024-09-14T05:41:12.744323+0000 mgr.a (mgr.14355) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:14 smithi171 bash[25040]: cluster 2024-09-14T05:41:12.744323+0000 mgr.a (mgr.14355) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:41:16.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:16.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:16 smithi007 bash[22722]: cluster 2024-09-14T05:41:14.745138+0000 mgr.a (mgr.14355) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:41:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:16 smithi131 bash[24745]: cluster 2024-09-14T05:41:14.745138+0000 mgr.a (mgr.14355) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:41:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:16 smithi171 bash[25040]: cluster 2024-09-14T05:41:14.745138+0000 mgr.a (mgr.14355) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:41:17.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:17.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:17.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:17.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:17.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:18 smithi007 bash[22722]: cluster 2024-09-14T05:41:16.747353+0000 mgr.a (mgr.14355) 19042 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:18.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:18 smithi007 bash[22722]: audit 2024-09-14T05:41:16.787501+0000 mgr.a (mgr.14355) 19043 : audit [DBG] from='client.408243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:18 smithi131 bash[24745]: cluster 2024-09-14T05:41:16.747353+0000 mgr.a (mgr.14355) 19042 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:18 smithi131 bash[24745]: audit 2024-09-14T05:41:16.787501+0000 mgr.a (mgr.14355) 19043 : audit [DBG] from='client.408243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:18 smithi171 bash[25040]: cluster 2024-09-14T05:41:16.747353+0000 mgr.a (mgr.14355) 19042 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:18 smithi171 bash[25040]: audit 2024-09-14T05:41:16.787501+0000 mgr.a (mgr.14355) 19043 : audit [DBG] from='client.408243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:20 smithi007 bash[22722]: cluster 2024-09-14T05:41:18.748277+0000 mgr.a (mgr.14355) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:20 smithi131 bash[24745]: cluster 2024-09-14T05:41:18.748277+0000 mgr.a (mgr.14355) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:20 smithi171 bash[25040]: cluster 2024-09-14T05:41:18.748277+0000 mgr.a (mgr.14355) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:22.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:22.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:22 smithi007 bash[22722]: cluster 2024-09-14T05:41:20.750549+0000 mgr.a (mgr.14355) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:22 smithi131 bash[24745]: cluster 2024-09-14T05:41:20.750549+0000 mgr.a (mgr.14355) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:22 smithi171 bash[25040]: cluster 2024-09-14T05:41:20.750549+0000 mgr.a (mgr.14355) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:23.009 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:23.010 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:24 smithi007 bash[22722]: audit 2024-09-14T05:41:22.569083+0000 mgr.a (mgr.14355) 19046 : audit [DBG] from='client.408321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:24 smithi007 bash[22722]: cluster 2024-09-14T05:41:22.751080+0000 mgr.a (mgr.14355) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:24 smithi131 bash[24745]: audit 2024-09-14T05:41:22.569083+0000 mgr.a (mgr.14355) 19046 : audit [DBG] from='client.408321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:24 smithi131 bash[24745]: cluster 2024-09-14T05:41:22.751080+0000 mgr.a (mgr.14355) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:24 smithi171 bash[25040]: audit 2024-09-14T05:41:22.569083+0000 mgr.a (mgr.14355) 19046 : audit [DBG] from='client.408321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:24 smithi171 bash[25040]: cluster 2024-09-14T05:41:22.751080+0000 mgr.a (mgr.14355) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:26 smithi007 bash[22722]: cluster 2024-09-14T05:41:24.751940+0000 mgr.a (mgr.14355) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:26 smithi131 bash[24745]: cluster 2024-09-14T05:41:24.751940+0000 mgr.a (mgr.14355) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:26 smithi171 bash[25040]: cluster 2024-09-14T05:41:24.751940+0000 mgr.a (mgr.14355) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:28.011 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:28.012 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:28 smithi007 bash[22722]: cluster 2024-09-14T05:41:26.754225+0000 mgr.a (mgr.14355) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:28 smithi131 bash[24745]: cluster 2024-09-14T05:41:26.754225+0000 mgr.a (mgr.14355) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:28 smithi171 bash[25040]: cluster 2024-09-14T05:41:26.754225+0000 mgr.a (mgr.14355) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:28.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:28.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:28.762 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:28.763 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:30 smithi131 bash[24745]: audit 2024-09-14T05:41:28.339537+0000 mgr.a (mgr.14355) 19050 : audit [DBG] from='client.408399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:30.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:30 smithi131 bash[24745]: cluster 2024-09-14T05:41:28.754804+0000 mgr.a (mgr.14355) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:30 smithi171 bash[25040]: audit 2024-09-14T05:41:28.339537+0000 mgr.a (mgr.14355) 19050 : audit [DBG] from='client.408399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:30 smithi171 bash[25040]: cluster 2024-09-14T05:41:28.754804+0000 mgr.a (mgr.14355) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:30 smithi007 bash[22722]: audit 2024-09-14T05:41:28.339537+0000 mgr.a (mgr.14355) 19050 : audit [DBG] from='client.408399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:30 smithi007 bash[22722]: cluster 2024-09-14T05:41:28.754804+0000 mgr.a (mgr.14355) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:32 smithi131 bash[24745]: cluster 2024-09-14T05:41:30.757105+0000 mgr.a (mgr.14355) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:32 smithi171 bash[25040]: cluster 2024-09-14T05:41:30.757105+0000 mgr.a (mgr.14355) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:32 smithi007 bash[22722]: cluster 2024-09-14T05:41:30.757105+0000 mgr.a (mgr.14355) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:33.765 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:34 smithi131 bash[24745]: cluster 2024-09-14T05:41:32.757904+0000 mgr.a (mgr.14355) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:34 smithi171 bash[25040]: cluster 2024-09-14T05:41:32.757904+0000 mgr.a (mgr.14355) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:34.554 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:34 smithi007 bash[22722]: cluster 2024-09-14T05:41:32.757904+0000 mgr.a (mgr.14355) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:34.094361+0000 mgr.a (mgr.14355) 19054 : audit [DBG] from='client.408477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:34.371141+0000 mon.a (mon.0) 3429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:41:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:35.161266+0000 mon.a (mon.0) 3430 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:41:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:35.162835+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:41:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:35.170694+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:41:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:35 smithi131 bash[24745]: audit 2024-09-14T05:41:35.175430+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:34.094361+0000 mgr.a (mgr.14355) 19054 : audit [DBG] from='client.408477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:34.371141+0000 mon.a (mon.0) 3429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:41:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:35.161266+0000 mon.a (mon.0) 3430 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:41:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:35.162835+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:41:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:35.170694+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:41:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:35 smithi171 bash[25040]: audit 2024-09-14T05:41:35.175430+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:34.094361+0000 mgr.a (mgr.14355) 19054 : audit [DBG] from='client.408477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:34.371141+0000 mon.a (mon.0) 3429 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:41:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:35.161266+0000 mon.a (mon.0) 3430 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:41:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:35.162835+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:41:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:35.170694+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:41:35.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22722]: audit 2024-09-14T05:41:35.175430+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:36.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22972]: debug 2024-09-14T05:41:35.919+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:41:36.311 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:41:35 smithi007 bash[22972]: debug 2024-09-14T05:41:35.919+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:41:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:36 smithi131 bash[24745]: cluster 2024-09-14T05:41:34.758966+0000 mgr.a (mgr.14355) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:36 smithi131 bash[24745]: audit 2024-09-14T05:41:35.178052+0000 mgr.a (mgr.14355) 19056 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:36 smithi171 bash[25040]: cluster 2024-09-14T05:41:34.758966+0000 mgr.a (mgr.14355) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:36 smithi171 bash[25040]: audit 2024-09-14T05:41:35.178052+0000 mgr.a (mgr.14355) 19056 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:36 smithi007 bash[22722]: cluster 2024-09-14T05:41:34.758966+0000 mgr.a (mgr.14355) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:36 smithi007 bash[22722]: audit 2024-09-14T05:41:35.178052+0000 mgr.a (mgr.14355) 19056 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:41:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:37 smithi131 bash[24745]: audit 2024-09-14T05:41:35.923470+0000 mgr.a (mgr.14355) 19057 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:41:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:37 smithi131 bash[24745]: cephadm 2024-09-14T05:41:35.925725+0000 mgr.a (mgr.14355) 19058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:41:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:37 smithi171 bash[25040]: audit 2024-09-14T05:41:35.923470+0000 mgr.a (mgr.14355) 19057 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:41:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:37 smithi171 bash[25040]: cephadm 2024-09-14T05:41:35.925725+0000 mgr.a (mgr.14355) 19058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:41:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:37 smithi007 bash[22722]: audit 2024-09-14T05:41:35.923470+0000 mgr.a (mgr.14355) 19057 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:41:37.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:37 smithi007 bash[22722]: cephadm 2024-09-14T05:41:35.925725+0000 mgr.a (mgr.14355) 19058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:41:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:38 smithi131 bash[24745]: cluster 2024-09-14T05:41:36.761723+0000 mgr.a (mgr.14355) 19059 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:38 smithi171 bash[25040]: cluster 2024-09-14T05:41:36.761723+0000 mgr.a (mgr.14355) 19059 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:38 smithi007 bash[22722]: cluster 2024-09-14T05:41:36.761723+0000 mgr.a (mgr.14355) 19059 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:41:39.555 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:39.556 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:39.557 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:40.311 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:40.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:40.311 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:40 smithi131 bash[24745]: cluster 2024-09-14T05:41:38.762543+0000 mgr.a (mgr.14355) 19060 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:40 smithi171 bash[25040]: cluster 2024-09-14T05:41:38.762543+0000 mgr.a (mgr.14355) 19060 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:40 smithi007 bash[22722]: cluster 2024-09-14T05:41:38.762543+0000 mgr.a (mgr.14355) 19060 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:41:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:41 smithi131 bash[24745]: audit 2024-09-14T05:41:39.885746+0000 mgr.a (mgr.14355) 19061 : audit [DBG] from='client.408657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:41 smithi171 bash[25040]: audit 2024-09-14T05:41:39.885746+0000 mgr.a (mgr.14355) 19061 : audit [DBG] from='client.408657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:41 smithi007 bash[22722]: audit 2024-09-14T05:41:39.885746+0000 mgr.a (mgr.14355) 19061 : audit [DBG] from='client.408657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:42 smithi131 bash[24745]: cluster 2024-09-14T05:41:40.764942+0000 mgr.a (mgr.14355) 19062 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:42 smithi171 bash[25040]: cluster 2024-09-14T05:41:40.764942+0000 mgr.a (mgr.14355) 19062 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:42 smithi007 bash[22722]: cluster 2024-09-14T05:41:40.764942+0000 mgr.a (mgr.14355) 19062 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:44 smithi131 bash[24745]: cluster 2024-09-14T05:41:42.765700+0000 mgr.a (mgr.14355) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:44 smithi171 bash[25040]: cluster 2024-09-14T05:41:42.765700+0000 mgr.a (mgr.14355) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:44 smithi007 bash[22722]: cluster 2024-09-14T05:41:42.765700+0000 mgr.a (mgr.14355) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:45.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:45 smithi131 bash[24745]: cluster 2024-09-14T05:41:44.766494+0000 mgr.a (mgr.14355) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:45 smithi171 bash[25040]: cluster 2024-09-14T05:41:44.766494+0000 mgr.a (mgr.14355) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:45 smithi007 bash[22722]: cluster 2024-09-14T05:41:44.766494+0000 mgr.a (mgr.14355) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:46.066 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:46.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:46 smithi131 bash[24745]: audit 2024-09-14T05:41:45.642716+0000 mgr.a (mgr.14355) 19065 : audit [DBG] from='client.408732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:46.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:46 smithi171 bash[25040]: audit 2024-09-14T05:41:45.642716+0000 mgr.a (mgr.14355) 19065 : audit [DBG] from='client.408732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:46.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:46 smithi007 bash[22722]: audit 2024-09-14T05:41:45.642716+0000 mgr.a (mgr.14355) 19065 : audit [DBG] from='client.408732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:47 smithi131 bash[24745]: cluster 2024-09-14T05:41:46.769254+0000 mgr.a (mgr.14355) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:47 smithi171 bash[25040]: cluster 2024-09-14T05:41:46.769254+0000 mgr.a (mgr.14355) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:47 smithi007 bash[22722]: cluster 2024-09-14T05:41:46.769254+0000 mgr.a (mgr.14355) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:50.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:49 smithi007 bash[22722]: cluster 2024-09-14T05:41:48.770076+0000 mgr.a (mgr.14355) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:49 smithi131 bash[24745]: cluster 2024-09-14T05:41:48.770076+0000 mgr.a (mgr.14355) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:49 smithi171 bash[25040]: cluster 2024-09-14T05:41:48.770076+0000 mgr.a (mgr.14355) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:41:51.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:51.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:51.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:51.813 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:51.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:52.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:51 smithi007 bash[22722]: cluster 2024-09-14T05:41:50.772043+0000 mgr.a (mgr.14355) 19068 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:51 smithi131 bash[24745]: cluster 2024-09-14T05:41:50.772043+0000 mgr.a (mgr.14355) 19068 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:51 smithi171 bash[25040]: cluster 2024-09-14T05:41:50.772043+0000 mgr.a (mgr.14355) 19068 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:41:53.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:52 smithi007 bash[22722]: audit 2024-09-14T05:41:51.396823+0000 mgr.a (mgr.14355) 19069 : audit [DBG] from='client.408810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:53.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:52 smithi131 bash[24745]: audit 2024-09-14T05:41:51.396823+0000 mgr.a (mgr.14355) 19069 : audit [DBG] from='client.408810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:53.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:52 smithi171 bash[25040]: audit 2024-09-14T05:41:51.396823+0000 mgr.a (mgr.14355) 19069 : audit [DBG] from='client.408810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:54.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:53 smithi007 bash[22722]: cluster 2024-09-14T05:41:52.772967+0000 mgr.a (mgr.14355) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:53 smithi131 bash[24745]: cluster 2024-09-14T05:41:52.772967+0000 mgr.a (mgr.14355) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:53 smithi171 bash[25040]: cluster 2024-09-14T05:41:52.772967+0000 mgr.a (mgr.14355) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:56.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:55 smithi007 bash[22722]: cluster 2024-09-14T05:41:54.773726+0000 mgr.a (mgr.14355) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:55 smithi131 bash[24745]: cluster 2024-09-14T05:41:54.773726+0000 mgr.a (mgr.14355) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:56.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:55 smithi171 bash[25040]: cluster 2024-09-14T05:41:54.773726+0000 mgr.a (mgr.14355) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:41:56.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:41:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:41:56.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:41:57.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:41:57.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:41:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:41:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:41:57.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:41:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:57 smithi007 bash[22722]: cluster 2024-09-14T05:41:56.775950+0000 mgr.a (mgr.14355) 19072 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:41:58.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:57 smithi007 bash[22722]: audit 2024-09-14T05:41:57.150858+0000 mgr.a (mgr.14355) 19073 : audit [DBG] from='client.408888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:57 smithi131 bash[24745]: cluster 2024-09-14T05:41:56.775950+0000 mgr.a (mgr.14355) 19072 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:41:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:57 smithi131 bash[24745]: audit 2024-09-14T05:41:57.150858+0000 mgr.a (mgr.14355) 19073 : audit [DBG] from='client.408888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:41:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:57 smithi171 bash[25040]: cluster 2024-09-14T05:41:56.775950+0000 mgr.a (mgr.14355) 19072 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:41:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:57 smithi171 bash[25040]: audit 2024-09-14T05:41:57.150858+0000 mgr.a (mgr.14355) 19073 : audit [DBG] from='client.408888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:00.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:41:59 smithi007 bash[22722]: cluster 2024-09-14T05:41:58.776821+0000 mgr.a (mgr.14355) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:41:59 smithi131 bash[24745]: cluster 2024-09-14T05:41:58.776821+0000 mgr.a (mgr.14355) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:41:59 smithi171 bash[25040]: cluster 2024-09-14T05:41:58.776821+0000 mgr.a (mgr.14355) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:02.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:01 smithi007 bash[22722]: cluster 2024-09-14T05:42:00.779250+0000 mgr.a (mgr.14355) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:42:02.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:01 smithi131 bash[24745]: cluster 2024-09-14T05:42:00.779250+0000 mgr.a (mgr.14355) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:42:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:01 smithi171 bash[25040]: cluster 2024-09-14T05:42:00.779250+0000 mgr.a (mgr.14355) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:42:02.592 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:03.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:03.337 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:03.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:04.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:03 smithi007 bash[22722]: cluster 2024-09-14T05:42:02.780017+0000 mgr.a (mgr.14355) 19076 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:04.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:03 smithi007 bash[22722]: audit 2024-09-14T05:42:02.922842+0000 mgr.a (mgr.14355) 19077 : audit [DBG] from='client.408963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:03 smithi131 bash[24745]: cluster 2024-09-14T05:42:02.780017+0000 mgr.a (mgr.14355) 19076 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:04.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:03 smithi131 bash[24745]: audit 2024-09-14T05:42:02.922842+0000 mgr.a (mgr.14355) 19077 : audit [DBG] from='client.408963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:03 smithi171 bash[25040]: cluster 2024-09-14T05:42:02.780017+0000 mgr.a (mgr.14355) 19076 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:04.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:03 smithi171 bash[25040]: audit 2024-09-14T05:42:02.922842+0000 mgr.a (mgr.14355) 19077 : audit [DBG] from='client.408963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:06.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:05 smithi007 bash[22722]: cluster 2024-09-14T05:42:04.781044+0000 mgr.a (mgr.14355) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:06.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:05 smithi131 bash[24745]: cluster 2024-09-14T05:42:04.781044+0000 mgr.a (mgr.14355) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:06.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:05 smithi171 bash[25040]: cluster 2024-09-14T05:42:04.781044+0000 mgr.a (mgr.14355) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:08.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:07 smithi007 bash[22722]: cluster 2024-09-14T05:42:06.783474+0000 mgr.a (mgr.14355) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:08.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:07 smithi131 bash[24745]: cluster 2024-09-14T05:42:06.783474+0000 mgr.a (mgr.14355) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:08.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:07 smithi171 bash[25040]: cluster 2024-09-14T05:42:06.783474+0000 mgr.a (mgr.14355) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:08.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:08.339 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:08.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:09.112 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:09 smithi007 bash[22722]: audit 2024-09-14T05:42:08.675384+0000 mgr.a (mgr.14355) 19080 : audit [DBG] from='client.409038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:10.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:09 smithi007 bash[22722]: cluster 2024-09-14T05:42:08.784006+0000 mgr.a (mgr.14355) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:09 smithi131 bash[24745]: audit 2024-09-14T05:42:08.675384+0000 mgr.a (mgr.14355) 19080 : audit [DBG] from='client.409038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:10.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:09 smithi131 bash[24745]: cluster 2024-09-14T05:42:08.784006+0000 mgr.a (mgr.14355) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:09 smithi171 bash[25040]: audit 2024-09-14T05:42:08.675384+0000 mgr.a (mgr.14355) 19080 : audit [DBG] from='client.409038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:10.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:09 smithi171 bash[25040]: cluster 2024-09-14T05:42:08.784006+0000 mgr.a (mgr.14355) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:12 smithi007 bash[22722]: cluster 2024-09-14T05:42:10.786237+0000 mgr.a (mgr.14355) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:12 smithi131 bash[24745]: cluster 2024-09-14T05:42:10.786237+0000 mgr.a (mgr.14355) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:12 smithi171 bash[25040]: cluster 2024-09-14T05:42:10.786237+0000 mgr.a (mgr.14355) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:14 smithi007 bash[22722]: cluster 2024-09-14T05:42:12.786964+0000 mgr.a (mgr.14355) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:14 smithi131 bash[24745]: cluster 2024-09-14T05:42:12.786964+0000 mgr.a (mgr.14355) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:14 smithi171 bash[25040]: cluster 2024-09-14T05:42:12.786964+0000 mgr.a (mgr.14355) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:14.866 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:16 smithi007 bash[22722]: audit 2024-09-14T05:42:14.444945+0000 mgr.a (mgr.14355) 19084 : audit [DBG] from='client.409116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:16 smithi007 bash[22722]: cluster 2024-09-14T05:42:14.787502+0000 mgr.a (mgr.14355) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:16.536 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:16 smithi131 bash[24745]: audit 2024-09-14T05:42:14.444945+0000 mgr.a (mgr.14355) 19084 : audit [DBG] from='client.409116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:16.537 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:16 smithi131 bash[24745]: cluster 2024-09-14T05:42:14.787502+0000 mgr.a (mgr.14355) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:16 smithi171 bash[25040]: audit 2024-09-14T05:42:14.444945+0000 mgr.a (mgr.14355) 19084 : audit [DBG] from='client.409116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:16 smithi171 bash[25040]: cluster 2024-09-14T05:42:14.787502+0000 mgr.a (mgr.14355) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:42:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:18 smithi007 bash[22722]: cluster 2024-09-14T05:42:16.789691+0000 mgr.a (mgr.14355) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:18 smithi131 bash[24745]: cluster 2024-09-14T05:42:16.789691+0000 mgr.a (mgr.14355) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:18 smithi171 bash[25040]: cluster 2024-09-14T05:42:16.789691+0000 mgr.a (mgr.14355) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:42:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:20 smithi007 bash[22722]: cluster 2024-09-14T05:42:18.790498+0000 mgr.a (mgr.14355) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:20 smithi131 bash[24745]: cluster 2024-09-14T05:42:18.790498+0000 mgr.a (mgr.14355) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:20 smithi171 bash[25040]: cluster 2024-09-14T05:42:18.790498+0000 mgr.a (mgr.14355) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:20.645 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:20.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:21.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:21 smithi007 bash[22722]: audit 2024-09-14T05:42:20.203410+0000 mgr.a (mgr.14355) 19088 : audit [DBG] from='client.409194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:21 smithi131 bash[24745]: audit 2024-09-14T05:42:20.203410+0000 mgr.a (mgr.14355) 19088 : audit [DBG] from='client.409194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:21 smithi171 bash[25040]: audit 2024-09-14T05:42:20.203410+0000 mgr.a (mgr.14355) 19088 : audit [DBG] from='client.409194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:22 smithi007 bash[22722]: cluster 2024-09-14T05:42:20.793296+0000 mgr.a (mgr.14355) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:22 smithi131 bash[24745]: cluster 2024-09-14T05:42:20.793296+0000 mgr.a (mgr.14355) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:22 smithi171 bash[25040]: cluster 2024-09-14T05:42:20.793296+0000 mgr.a (mgr.14355) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:24 smithi007 bash[22722]: cluster 2024-09-14T05:42:22.794084+0000 mgr.a (mgr.14355) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:24 smithi131 bash[24745]: cluster 2024-09-14T05:42:22.794084+0000 mgr.a (mgr.14355) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:24 smithi171 bash[25040]: cluster 2024-09-14T05:42:22.794084+0000 mgr.a (mgr.14355) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:25.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:25.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:25.648 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:26.395 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:26.396 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:26 smithi007 bash[22722]: cluster 2024-09-14T05:42:24.794856+0000 mgr.a (mgr.14355) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:42:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:26 smithi131 bash[24745]: cluster 2024-09-14T05:42:24.794856+0000 mgr.a (mgr.14355) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:42:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:26 smithi171 bash[25040]: cluster 2024-09-14T05:42:24.794856+0000 mgr.a (mgr.14355) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:42:27.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:27 smithi007 bash[22722]: audit 2024-09-14T05:42:25.977578+0000 mgr.a (mgr.14355) 19092 : audit [DBG] from='client.409269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:27 smithi131 bash[24745]: audit 2024-09-14T05:42:25.977578+0000 mgr.a (mgr.14355) 19092 : audit [DBG] from='client.409269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:27 smithi171 bash[25040]: audit 2024-09-14T05:42:25.977578+0000 mgr.a (mgr.14355) 19092 : audit [DBG] from='client.409269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:28 smithi007 bash[22722]: cluster 2024-09-14T05:42:26.797850+0000 mgr.a (mgr.14355) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:28 smithi131 bash[24745]: cluster 2024-09-14T05:42:26.797850+0000 mgr.a (mgr.14355) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:28 smithi171 bash[25040]: cluster 2024-09-14T05:42:26.797850+0000 mgr.a (mgr.14355) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:30 smithi007 bash[22722]: cluster 2024-09-14T05:42:28.798842+0000 mgr.a (mgr.14355) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:30 smithi131 bash[24745]: cluster 2024-09-14T05:42:28.798842+0000 mgr.a (mgr.14355) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:30 smithi171 bash[25040]: cluster 2024-09-14T05:42:28.798842+0000 mgr.a (mgr.14355) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:42:31.397 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:31.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:31.398 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:32.149 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:32.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:32 smithi007 bash[22722]: cluster 2024-09-14T05:42:30.800926+0000 mgr.a (mgr.14355) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:32 smithi131 bash[24745]: cluster 2024-09-14T05:42:30.800926+0000 mgr.a (mgr.14355) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:32 smithi171 bash[25040]: cluster 2024-09-14T05:42:30.800926+0000 mgr.a (mgr.14355) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:33 smithi007 bash[22722]: audit 2024-09-14T05:42:31.729686+0000 mgr.a (mgr.14355) 19096 : audit [DBG] from='client.409347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:33.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:33 smithi131 bash[24745]: audit 2024-09-14T05:42:31.729686+0000 mgr.a (mgr.14355) 19096 : audit [DBG] from='client.409347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:33 smithi171 bash[25040]: audit 2024-09-14T05:42:31.729686+0000 mgr.a (mgr.14355) 19096 : audit [DBG] from='client.409347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:34 smithi007 bash[22722]: cluster 2024-09-14T05:42:32.801850+0000 mgr.a (mgr.14355) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:34 smithi131 bash[24745]: cluster 2024-09-14T05:42:32.801850+0000 mgr.a (mgr.14355) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:34 smithi171 bash[25040]: cluster 2024-09-14T05:42:32.801850+0000 mgr.a (mgr.14355) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:36 smithi007 bash[22722]: cluster 2024-09-14T05:42:34.802682+0000 mgr.a (mgr.14355) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:36 smithi007 bash[22722]: audit 2024-09-14T05:42:35.981582+0000 mon.a (mon.0) 3434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:42:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:36 smithi131 bash[24745]: cluster 2024-09-14T05:42:34.802682+0000 mgr.a (mgr.14355) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:36 smithi131 bash[24745]: audit 2024-09-14T05:42:35.981582+0000 mon.a (mon.0) 3434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:42:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:36 smithi171 bash[25040]: cluster 2024-09-14T05:42:34.802682+0000 mgr.a (mgr.14355) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:36 smithi171 bash[25040]: audit 2024-09-14T05:42:35.981582+0000 mon.a (mon.0) 3434 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:42:37.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:37.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:37.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:37.894 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:37.894 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:38 smithi007 bash[22722]: cluster 2024-09-14T05:42:36.804823+0000 mgr.a (mgr.14355) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:38 smithi131 bash[24745]: cluster 2024-09-14T05:42:36.804823+0000 mgr.a (mgr.14355) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:38 smithi171 bash[25040]: cluster 2024-09-14T05:42:36.804823+0000 mgr.a (mgr.14355) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:39 smithi007 bash[22722]: audit 2024-09-14T05:42:37.479774+0000 mgr.a (mgr.14355) 19100 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:39 smithi131 bash[24745]: audit 2024-09-14T05:42:37.479774+0000 mgr.a (mgr.14355) 19100 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:39 smithi171 bash[25040]: audit 2024-09-14T05:42:37.479774+0000 mgr.a (mgr.14355) 19100 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:40 smithi007 bash[22722]: cluster 2024-09-14T05:42:38.805863+0000 mgr.a (mgr.14355) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:40 smithi131 bash[24745]: cluster 2024-09-14T05:42:38.805863+0000 mgr.a (mgr.14355) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:40 smithi171 bash[25040]: cluster 2024-09-14T05:42:38.805863+0000 mgr.a (mgr.14355) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:42:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: cluster 2024-09-14T05:42:40.808154+0000 mgr.a (mgr.14355) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.325260+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.330210+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.345079+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.351561+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.358875+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:41.365580+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:42.100045+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:42.101955+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:42.111645+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22722]: audit 2024-09-14T05:42:42.116655+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: cluster 2024-09-14T05:42:40.808154+0000 mgr.a (mgr.14355) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.325260+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.330210+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.345079+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.351561+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.358875+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:41.365580+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:42.100045+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:42:42.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:42.101955+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:42:42.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:42.111645+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:42 smithi131 bash[24745]: audit 2024-09-14T05:42:42.116655+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: cluster 2024-09-14T05:42:40.808154+0000 mgr.a (mgr.14355) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.325260+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.330210+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.345079+0000 mon.a (mon.0) 3437 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.351561+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.358875+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:41.365580+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:42.100045+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:42.101955+0000 mon.a (mon.0) 3442 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:42:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:42.111645+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:42:42.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:42 smithi171 bash[25040]: audit 2024-09-14T05:42:42.116655+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:42.895 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:43.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22972]: debug 2024-09-14T05:42:42.866+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:42:43.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:42:42 smithi007 bash[22972]: debug 2024-09-14T05:42:42.866+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:42:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:43 smithi131 bash[24745]: audit 2024-09-14T05:42:42.118884+0000 mgr.a (mgr.14355) 19103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:43 smithi171 bash[25040]: audit 2024-09-14T05:42:42.118884+0000 mgr.a (mgr.14355) 19103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:43.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:43.623 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:43.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:43 smithi007 bash[22722]: audit 2024-09-14T05:42:42.118884+0000 mgr.a (mgr.14355) 19103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:42:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:44 smithi131 bash[24745]: cluster 2024-09-14T05:42:42.808981+0000 mgr.a (mgr.14355) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:44.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:44 smithi131 bash[24745]: audit 2024-09-14T05:42:42.867153+0000 mgr.a (mgr.14355) 19105 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:42:44.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:44 smithi131 bash[24745]: cephadm 2024-09-14T05:42:42.868315+0000 mgr.a (mgr.14355) 19106 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:42:44.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:44 smithi131 bash[24745]: audit 2024-09-14T05:42:43.211686+0000 mgr.a (mgr.14355) 19107 : audit [DBG] from='client.409602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:44 smithi171 bash[25040]: cluster 2024-09-14T05:42:42.808981+0000 mgr.a (mgr.14355) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:44 smithi171 bash[25040]: audit 2024-09-14T05:42:42.867153+0000 mgr.a (mgr.14355) 19105 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:42:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:44 smithi171 bash[25040]: cephadm 2024-09-14T05:42:42.868315+0000 mgr.a (mgr.14355) 19106 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:42:44.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:44 smithi171 bash[25040]: audit 2024-09-14T05:42:43.211686+0000 mgr.a (mgr.14355) 19107 : audit [DBG] from='client.409602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:44 smithi007 bash[22722]: cluster 2024-09-14T05:42:42.808981+0000 mgr.a (mgr.14355) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:44 smithi007 bash[22722]: audit 2024-09-14T05:42:42.867153+0000 mgr.a (mgr.14355) 19105 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:42:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:44 smithi007 bash[22722]: cephadm 2024-09-14T05:42:42.868315+0000 mgr.a (mgr.14355) 19106 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:42:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:44 smithi007 bash[22722]: audit 2024-09-14T05:42:43.211686+0000 mgr.a (mgr.14355) 19107 : audit [DBG] from='client.409602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:46 smithi131 bash[24745]: cluster 2024-09-14T05:42:44.810024+0000 mgr.a (mgr.14355) 19108 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:46 smithi171 bash[25040]: cluster 2024-09-14T05:42:44.810024+0000 mgr.a (mgr.14355) 19108 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:46 smithi007 bash[22722]: cluster 2024-09-14T05:42:44.810024+0000 mgr.a (mgr.14355) 19108 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:42:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:48 smithi131 bash[24745]: cluster 2024-09-14T05:42:46.812400+0000 mgr.a (mgr.14355) 19109 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:48 smithi171 bash[25040]: cluster 2024-09-14T05:42:46.812400+0000 mgr.a (mgr.14355) 19109 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:48.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:48.625 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:48.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:48 smithi007 bash[22722]: cluster 2024-09-14T05:42:46.812400+0000 mgr.a (mgr.14355) 19109 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:49.384 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:49.384 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:49.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:50 smithi131 bash[24745]: cluster 2024-09-14T05:42:48.813194+0000 mgr.a (mgr.14355) 19110 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:50 smithi131 bash[24745]: audit 2024-09-14T05:42:48.957560+0000 mgr.a (mgr.14355) 19111 : audit [DBG] from='client.409680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:50 smithi171 bash[25040]: cluster 2024-09-14T05:42:48.813194+0000 mgr.a (mgr.14355) 19110 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:50 smithi171 bash[25040]: audit 2024-09-14T05:42:48.957560+0000 mgr.a (mgr.14355) 19111 : audit [DBG] from='client.409680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:50 smithi007 bash[22722]: cluster 2024-09-14T05:42:48.813194+0000 mgr.a (mgr.14355) 19110 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:50 smithi007 bash[22722]: audit 2024-09-14T05:42:48.957560+0000 mgr.a (mgr.14355) 19111 : audit [DBG] from='client.409680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:52 smithi131 bash[24745]: cluster 2024-09-14T05:42:50.815484+0000 mgr.a (mgr.14355) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:52 smithi171 bash[25040]: cluster 2024-09-14T05:42:50.815484+0000 mgr.a (mgr.14355) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:52 smithi007 bash[22722]: cluster 2024-09-14T05:42:50.815484+0000 mgr.a (mgr.14355) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:54.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:42:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:42:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:42:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:54 smithi131 bash[24745]: cluster 2024-09-14T05:42:52.816259+0000 mgr.a (mgr.14355) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:54 smithi171 bash[25040]: cluster 2024-09-14T05:42:52.816259+0000 mgr.a (mgr.14355) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:54 smithi007 bash[22722]: cluster 2024-09-14T05:42:52.816259+0000 mgr.a (mgr.14355) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:55.155 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:42:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:42:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:42:55.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:42:55.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:42:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:56 smithi131 bash[24745]: audit 2024-09-14T05:42:54.721711+0000 mgr.a (mgr.14355) 19114 : audit [DBG] from='client.409758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:56 smithi131 bash[24745]: cluster 2024-09-14T05:42:54.816731+0000 mgr.a (mgr.14355) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:56 smithi171 bash[25040]: audit 2024-09-14T05:42:54.721711+0000 mgr.a (mgr.14355) 19114 : audit [DBG] from='client.409758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:56 smithi171 bash[25040]: cluster 2024-09-14T05:42:54.816731+0000 mgr.a (mgr.14355) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:56 smithi007 bash[22722]: audit 2024-09-14T05:42:54.721711+0000 mgr.a (mgr.14355) 19114 : audit [DBG] from='client.409758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:42:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:56 smithi007 bash[22722]: cluster 2024-09-14T05:42:54.816731+0000 mgr.a (mgr.14355) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:42:58 smithi131 bash[24745]: cluster 2024-09-14T05:42:56.819069+0000 mgr.a (mgr.14355) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:42:58 smithi171 bash[25040]: cluster 2024-09-14T05:42:56.819069+0000 mgr.a (mgr.14355) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:42:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:42:58 smithi007 bash[22722]: cluster 2024-09-14T05:42:56.819069+0000 mgr.a (mgr.14355) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:00.157 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:00.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:00.158 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:00 smithi131 bash[24745]: cluster 2024-09-14T05:42:58.819814+0000 mgr.a (mgr.14355) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:00 smithi171 bash[25040]: cluster 2024-09-14T05:42:58.819814+0000 mgr.a (mgr.14355) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:00 smithi007 bash[22722]: cluster 2024-09-14T05:42:58.819814+0000 mgr.a (mgr.14355) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:00.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:00.899 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:00.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:00.900 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:00.900 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:02 smithi131 bash[24745]: audit 2024-09-14T05:43:00.487174+0000 mgr.a (mgr.14355) 19118 : audit [DBG] from='client.409836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:02 smithi131 bash[24745]: cluster 2024-09-14T05:43:00.821404+0000 mgr.a (mgr.14355) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:02 smithi171 bash[25040]: audit 2024-09-14T05:43:00.487174+0000 mgr.a (mgr.14355) 19118 : audit [DBG] from='client.409836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:02 smithi171 bash[25040]: cluster 2024-09-14T05:43:00.821404+0000 mgr.a (mgr.14355) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:02 smithi007 bash[22722]: audit 2024-09-14T05:43:00.487174+0000 mgr.a (mgr.14355) 19118 : audit [DBG] from='client.409836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:02 smithi007 bash[22722]: cluster 2024-09-14T05:43:00.821404+0000 mgr.a (mgr.14355) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:04 smithi131 bash[24745]: cluster 2024-09-14T05:43:02.822143+0000 mgr.a (mgr.14355) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:04 smithi171 bash[25040]: cluster 2024-09-14T05:43:02.822143+0000 mgr.a (mgr.14355) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:04 smithi007 bash[22722]: cluster 2024-09-14T05:43:02.822143+0000 mgr.a (mgr.14355) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:05.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:05.902 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:06 smithi131 bash[24745]: cluster 2024-09-14T05:43:04.822922+0000 mgr.a (mgr.14355) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:06 smithi171 bash[25040]: cluster 2024-09-14T05:43:04.822922+0000 mgr.a (mgr.14355) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:06.676 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:06.677 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:06.677 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:06 smithi007 bash[22722]: cluster 2024-09-14T05:43:04.822922+0000 mgr.a (mgr.14355) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:07 smithi131 bash[24745]: audit 2024-09-14T05:43:06.237504+0000 mgr.a (mgr.14355) 19122 : audit [DBG] from='client.409911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:07 smithi171 bash[25040]: audit 2024-09-14T05:43:06.237504+0000 mgr.a (mgr.14355) 19122 : audit [DBG] from='client.409911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:07 smithi007 bash[22722]: audit 2024-09-14T05:43:06.237504+0000 mgr.a (mgr.14355) 19122 : audit [DBG] from='client.409911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:08 smithi131 bash[24745]: cluster 2024-09-14T05:43:06.825789+0000 mgr.a (mgr.14355) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:08 smithi171 bash[25040]: cluster 2024-09-14T05:43:06.825789+0000 mgr.a (mgr.14355) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:08 smithi007 bash[22722]: cluster 2024-09-14T05:43:06.825789+0000 mgr.a (mgr.14355) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:09 smithi131 bash[24745]: cluster 2024-09-14T05:43:08.826671+0000 mgr.a (mgr.14355) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:09 smithi171 bash[25040]: cluster 2024-09-14T05:43:08.826671+0000 mgr.a (mgr.14355) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:09 smithi007 bash[22722]: cluster 2024-09-14T05:43:08.826671+0000 mgr.a (mgr.14355) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:11.678 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:12.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:11 smithi007 bash[22722]: cluster 2024-09-14T05:43:10.828604+0000 mgr.a (mgr.14355) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:12.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:11 smithi131 bash[24745]: cluster 2024-09-14T05:43:10.828604+0000 mgr.a (mgr.14355) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:12.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:11 smithi171 bash[25040]: cluster 2024-09-14T05:43:10.828604+0000 mgr.a (mgr.14355) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:12.459 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:12.460 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:13.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:12 smithi007 bash[22722]: audit 2024-09-14T05:43:12.015200+0000 mgr.a (mgr.14355) 19126 : audit [DBG] from='client.409989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:13.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:12 smithi131 bash[24745]: audit 2024-09-14T05:43:12.015200+0000 mgr.a (mgr.14355) 19126 : audit [DBG] from='client.409989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:13.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:12 smithi171 bash[25040]: audit 2024-09-14T05:43:12.015200+0000 mgr.a (mgr.14355) 19126 : audit [DBG] from='client.409989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:14.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:13 smithi007 bash[22722]: cluster 2024-09-14T05:43:12.829601+0000 mgr.a (mgr.14355) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:14.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:13 smithi131 bash[24745]: cluster 2024-09-14T05:43:12.829601+0000 mgr.a (mgr.14355) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:14.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:13 smithi171 bash[25040]: cluster 2024-09-14T05:43:12.829601+0000 mgr.a (mgr.14355) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:16.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:15 smithi007 bash[22722]: cluster 2024-09-14T05:43:14.830581+0000 mgr.a (mgr.14355) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:16.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:15 smithi131 bash[24745]: cluster 2024-09-14T05:43:14.830581+0000 mgr.a (mgr.14355) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:16.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:15 smithi171 bash[25040]: cluster 2024-09-14T05:43:14.830581+0000 mgr.a (mgr.14355) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:17.462 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:18.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:17 smithi007 bash[22722]: cluster 2024-09-14T05:43:16.832845+0000 mgr.a (mgr.14355) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:18.214 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:18.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:17 smithi131 bash[24745]: cluster 2024-09-14T05:43:16.832845+0000 mgr.a (mgr.14355) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:18.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:17 smithi171 bash[25040]: cluster 2024-09-14T05:43:16.832845+0000 mgr.a (mgr.14355) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:19.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:18 smithi007 bash[22722]: audit 2024-09-14T05:43:17.793093+0000 mgr.a (mgr.14355) 19130 : audit [DBG] from='client.410064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:19.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:18 smithi131 bash[24745]: audit 2024-09-14T05:43:17.793093+0000 mgr.a (mgr.14355) 19130 : audit [DBG] from='client.410064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:19.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:18 smithi171 bash[25040]: audit 2024-09-14T05:43:17.793093+0000 mgr.a (mgr.14355) 19130 : audit [DBG] from='client.410064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:20.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:19 smithi007 bash[22722]: cluster 2024-09-14T05:43:18.833781+0000 mgr.a (mgr.14355) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:20.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:19 smithi171 bash[25040]: cluster 2024-09-14T05:43:18.833781+0000 mgr.a (mgr.14355) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:20.298 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:19 smithi131 bash[24745]: cluster 2024-09-14T05:43:18.833781+0000 mgr.a (mgr.14355) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:22.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:21 smithi007 bash[22722]: cluster 2024-09-14T05:43:20.835963+0000 mgr.a (mgr.14355) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:22.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:21 smithi131 bash[24745]: cluster 2024-09-14T05:43:20.835963+0000 mgr.a (mgr.14355) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:22.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:21 smithi171 bash[25040]: cluster 2024-09-14T05:43:20.835963+0000 mgr.a (mgr.14355) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:23.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:23.966 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:23.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:23.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:23.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:23.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:24.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:23 smithi007 bash[22722]: cluster 2024-09-14T05:43:22.836721+0000 mgr.a (mgr.14355) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:24.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:23 smithi131 bash[24745]: cluster 2024-09-14T05:43:22.836721+0000 mgr.a (mgr.14355) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:24.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:23 smithi171 bash[25040]: cluster 2024-09-14T05:43:22.836721+0000 mgr.a (mgr.14355) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:25.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:24 smithi007 bash[22722]: audit 2024-09-14T05:43:23.549668+0000 mgr.a (mgr.14355) 19134 : audit [DBG] from='client.410142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:25.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:24 smithi131 bash[24745]: audit 2024-09-14T05:43:23.549668+0000 mgr.a (mgr.14355) 19134 : audit [DBG] from='client.410142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:25.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:24 smithi171 bash[25040]: audit 2024-09-14T05:43:23.549668+0000 mgr.a (mgr.14355) 19134 : audit [DBG] from='client.410142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:26.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:25 smithi007 bash[22722]: cluster 2024-09-14T05:43:24.837855+0000 mgr.a (mgr.14355) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:26.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:25 smithi131 bash[24745]: cluster 2024-09-14T05:43:24.837855+0000 mgr.a (mgr.14355) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:26.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:25 smithi171 bash[25040]: cluster 2024-09-14T05:43:24.837855+0000 mgr.a (mgr.14355) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:28.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:27 smithi007 bash[22722]: cluster 2024-09-14T05:43:26.840190+0000 mgr.a (mgr.14355) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:28.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:27 smithi131 bash[24745]: cluster 2024-09-14T05:43:26.840190+0000 mgr.a (mgr.14355) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:28.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:27 smithi171 bash[25040]: cluster 2024-09-14T05:43:26.840190+0000 mgr.a (mgr.14355) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:28.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:28.967 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:28.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:29.712 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:29.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:29.713 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:30.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:29 smithi007 bash[22722]: cluster 2024-09-14T05:43:28.840993+0000 mgr.a (mgr.14355) 19137 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:30.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:29 smithi131 bash[24745]: cluster 2024-09-14T05:43:28.840993+0000 mgr.a (mgr.14355) 19137 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:30.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:29 smithi171 bash[25040]: cluster 2024-09-14T05:43:28.840993+0000 mgr.a (mgr.14355) 19137 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:30 smithi007 bash[22722]: audit 2024-09-14T05:43:29.297084+0000 mgr.a (mgr.14355) 19138 : audit [DBG] from='client.410220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:31.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:30 smithi131 bash[24745]: audit 2024-09-14T05:43:29.297084+0000 mgr.a (mgr.14355) 19138 : audit [DBG] from='client.410220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:31.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:30 smithi171 bash[25040]: audit 2024-09-14T05:43:29.297084+0000 mgr.a (mgr.14355) 19138 : audit [DBG] from='client.410220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:32.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:31 smithi131 bash[24745]: cluster 2024-09-14T05:43:30.843373+0000 mgr.a (mgr.14355) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:32.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:31 smithi171 bash[25040]: cluster 2024-09-14T05:43:30.843373+0000 mgr.a (mgr.14355) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:31 smithi007 bash[22722]: cluster 2024-09-14T05:43:30.843373+0000 mgr.a (mgr.14355) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:43:34.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:33 smithi131 bash[24745]: cluster 2024-09-14T05:43:32.844171+0000 mgr.a (mgr.14355) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:34.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:33 smithi171 bash[25040]: cluster 2024-09-14T05:43:32.844171+0000 mgr.a (mgr.14355) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:33 smithi007 bash[22722]: cluster 2024-09-14T05:43:32.844171+0000 mgr.a (mgr.14355) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:34.714 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:34.715 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:35.492 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:35 smithi131 bash[24745]: cluster 2024-09-14T05:43:34.844660+0000 mgr.a (mgr.14355) 19141 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:35 smithi131 bash[24745]: audit 2024-09-14T05:43:35.054615+0000 mgr.a (mgr.14355) 19142 : audit [DBG] from='client.410295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:35 smithi171 bash[25040]: cluster 2024-09-14T05:43:34.844660+0000 mgr.a (mgr.14355) 19141 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:36.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:35 smithi171 bash[25040]: audit 2024-09-14T05:43:35.054615+0000 mgr.a (mgr.14355) 19142 : audit [DBG] from='client.410295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:35 smithi007 bash[22722]: cluster 2024-09-14T05:43:34.844660+0000 mgr.a (mgr.14355) 19141 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:35 smithi007 bash[22722]: audit 2024-09-14T05:43:35.054615+0000 mgr.a (mgr.14355) 19142 : audit [DBG] from='client.410295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:37 smithi131 bash[24745]: cluster 2024-09-14T05:43:36.847625+0000 mgr.a (mgr.14355) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:43:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:37 smithi171 bash[25040]: cluster 2024-09-14T05:43:36.847625+0000 mgr.a (mgr.14355) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:43:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:37 smithi007 bash[22722]: cluster 2024-09-14T05:43:36.847625+0000 mgr.a (mgr.14355) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-14T05:43:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:39 smithi131 bash[24745]: cluster 2024-09-14T05:43:38.848619+0000 mgr.a (mgr.14355) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:43:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:39 smithi171 bash[25040]: cluster 2024-09-14T05:43:38.848619+0000 mgr.a (mgr.14355) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:43:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:39 smithi007 bash[22722]: cluster 2024-09-14T05:43:38.848619+0000 mgr.a (mgr.14355) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-14T05:43:40.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:40.494 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:41.243 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:41.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:41.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:41.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:41.244 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:41 smithi131 bash[24745]: audit 2024-09-14T05:43:40.820785+0000 mgr.a (mgr.14355) 19145 : audit [DBG] from='client.410373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:41 smithi131 bash[24745]: cluster 2024-09-14T05:43:40.850798+0000 mgr.a (mgr.14355) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:41 smithi171 bash[25040]: audit 2024-09-14T05:43:40.820785+0000 mgr.a (mgr.14355) 19145 : audit [DBG] from='client.410373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:42.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:41 smithi171 bash[25040]: cluster 2024-09-14T05:43:40.850798+0000 mgr.a (mgr.14355) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:41 smithi007 bash[22722]: audit 2024-09-14T05:43:40.820785+0000 mgr.a (mgr.14355) 19145 : audit [DBG] from='client.410373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:41 smithi007 bash[22722]: cluster 2024-09-14T05:43:40.850798+0000 mgr.a (mgr.14355) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:43:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:42 smithi131 bash[24745]: audit 2024-09-14T05:43:42.918984+0000 mon.a (mon.0) 3445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:43:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:42 smithi171 bash[25040]: audit 2024-09-14T05:43:42.918984+0000 mon.a (mon.0) 3445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:43:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:42 smithi007 bash[22722]: audit 2024-09-14T05:43:42.918984+0000 mon.a (mon.0) 3445 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:43:44.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:43 smithi131 bash[24745]: cluster 2024-09-14T05:43:42.851699+0000 mgr.a (mgr.14355) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:43 smithi131 bash[24745]: audit 2024-09-14T05:43:43.763124+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:43:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:43 smithi131 bash[24745]: audit 2024-09-14T05:43:43.764691+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:43:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:43 smithi131 bash[24745]: audit 2024-09-14T05:43:43.774422+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:43:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:43 smithi131 bash[24745]: audit 2024-09-14T05:43:43.779272+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:43 smithi171 bash[25040]: cluster 2024-09-14T05:43:42.851699+0000 mgr.a (mgr.14355) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:43 smithi171 bash[25040]: audit 2024-09-14T05:43:43.763124+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:43:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:43 smithi171 bash[25040]: audit 2024-09-14T05:43:43.764691+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:43:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:43 smithi171 bash[25040]: audit 2024-09-14T05:43:43.774422+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:43:44.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:43 smithi171 bash[25040]: audit 2024-09-14T05:43:43.779272+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:43 smithi007 bash[22722]: cluster 2024-09-14T05:43:42.851699+0000 mgr.a (mgr.14355) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:43:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:43 smithi007 bash[22722]: audit 2024-09-14T05:43:43.763124+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:43:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:43 smithi007 bash[22722]: audit 2024-09-14T05:43:43.764691+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:43:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:43 smithi007 bash[22722]: audit 2024-09-14T05:43:43.774422+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:43:44.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:43 smithi007 bash[22722]: audit 2024-09-14T05:43:43.779272+0000 mon.a (mon.0) 3449 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:44.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:43:44 smithi007 bash[22972]: debug 2024-09-14T05:43:44.517+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:43:44.955 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:43:44 smithi007 bash[22972]: debug 2024-09-14T05:43:44.521+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:43:45.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:44 smithi131 bash[24745]: audit 2024-09-14T05:43:43.781626+0000 mgr.a (mgr.14355) 19148 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:45.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:44 smithi171 bash[25040]: audit 2024-09-14T05:43:43.781626+0000 mgr.a (mgr.14355) 19148 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:44 smithi007 bash[22722]: audit 2024-09-14T05:43:43.781626+0000 mgr.a (mgr.14355) 19148 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:43:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:45 smithi131 bash[24745]: audit 2024-09-14T05:43:44.520869+0000 mgr.a (mgr.14355) 19149 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:43:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:45 smithi131 bash[24745]: cephadm 2024-09-14T05:43:44.522486+0000 mgr.a (mgr.14355) 19150 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:43:46.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:45 smithi131 bash[24745]: cluster 2024-09-14T05:43:44.852625+0000 mgr.a (mgr.14355) 19151 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:45 smithi171 bash[25040]: audit 2024-09-14T05:43:44.520869+0000 mgr.a (mgr.14355) 19149 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:43:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:45 smithi171 bash[25040]: cephadm 2024-09-14T05:43:44.522486+0000 mgr.a (mgr.14355) 19150 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:43:46.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:45 smithi171 bash[25040]: cluster 2024-09-14T05:43:44.852625+0000 mgr.a (mgr.14355) 19151 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:45 smithi007 bash[22722]: audit 2024-09-14T05:43:44.520869+0000 mgr.a (mgr.14355) 19149 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:43:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:45 smithi007 bash[22722]: cephadm 2024-09-14T05:43:44.522486+0000 mgr.a (mgr.14355) 19150 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:43:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:45 smithi007 bash[22722]: cluster 2024-09-14T05:43:44.852625+0000 mgr.a (mgr.14355) 19151 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:43:47.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:47.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:47.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:47.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:47.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:48 smithi131 bash[24745]: audit 2024-09-14T05:43:46.579005+0000 mgr.a (mgr.14355) 19152 : audit [DBG] from='client.410556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:48 smithi131 bash[24745]: cluster 2024-09-14T05:43:46.853983+0000 mgr.a (mgr.14355) 19153 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:48 smithi171 bash[25040]: audit 2024-09-14T05:43:46.579005+0000 mgr.a (mgr.14355) 19152 : audit [DBG] from='client.410556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:48.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:48 smithi171 bash[25040]: cluster 2024-09-14T05:43:46.853983+0000 mgr.a (mgr.14355) 19153 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:47 smithi007 bash[22722]: audit 2024-09-14T05:43:46.579005+0000 mgr.a (mgr.14355) 19152 : audit [DBG] from='client.410556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:47 smithi007 bash[22722]: cluster 2024-09-14T05:43:46.853983+0000 mgr.a (mgr.14355) 19153 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:50.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:50 smithi131 bash[24745]: cluster 2024-09-14T05:43:48.854852+0000 mgr.a (mgr.14355) 19154 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:43:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:50 smithi171 bash[25040]: cluster 2024-09-14T05:43:48.854852+0000 mgr.a (mgr.14355) 19154 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:43:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:50 smithi007 bash[22722]: cluster 2024-09-14T05:43:48.854852+0000 mgr.a (mgr.14355) 19154 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:43:52.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:52.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:52.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:52 smithi131 bash[24745]: cluster 2024-09-14T05:43:50.857006+0000 mgr.a (mgr.14355) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:52.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:52 smithi171 bash[25040]: cluster 2024-09-14T05:43:50.857006+0000 mgr.a (mgr.14355) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:52 smithi007 bash[22722]: cluster 2024-09-14T05:43:50.857006+0000 mgr.a (mgr.14355) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:52.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:52.754 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:54 smithi131 bash[24745]: audit 2024-09-14T05:43:52.346092+0000 mgr.a (mgr.14355) 19156 : audit [DBG] from='client.410634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:54.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:54 smithi131 bash[24745]: cluster 2024-09-14T05:43:52.857991+0000 mgr.a (mgr.14355) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:54.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:54 smithi171 bash[25040]: audit 2024-09-14T05:43:52.346092+0000 mgr.a (mgr.14355) 19156 : audit [DBG] from='client.410634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:54.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:54 smithi171 bash[25040]: cluster 2024-09-14T05:43:52.857991+0000 mgr.a (mgr.14355) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:54 smithi007 bash[22722]: audit 2024-09-14T05:43:52.346092+0000 mgr.a (mgr.14355) 19156 : audit [DBG] from='client.410634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:54 smithi007 bash[22722]: cluster 2024-09-14T05:43:52.857991+0000 mgr.a (mgr.14355) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:56.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:56 smithi131 bash[24745]: cluster 2024-09-14T05:43:54.858802+0000 mgr.a (mgr.14355) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:56.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:56 smithi171 bash[25040]: cluster 2024-09-14T05:43:54.858802+0000 mgr.a (mgr.14355) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:56 smithi007 bash[22722]: cluster 2024-09-14T05:43:54.858802+0000 mgr.a (mgr.14355) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:57.755 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:43:57.756 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:43:57.757 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:43:58.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:58 smithi131 bash[24745]: cluster 2024-09-14T05:43:56.861047+0000 mgr.a (mgr.14355) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:58.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:58 smithi171 bash[25040]: cluster 2024-09-14T05:43:56.861047+0000 mgr.a (mgr.14355) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:58 smithi007 bash[22722]: cluster 2024-09-14T05:43:56.861047+0000 mgr.a (mgr.14355) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:43:58.516 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:43:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:43:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:43:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:43:58.516 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:43:59.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:43:59 smithi131 bash[24745]: audit 2024-09-14T05:43:58.092830+0000 mgr.a (mgr.14355) 19160 : audit [DBG] from='client.410709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:59.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:43:59 smithi171 bash[25040]: audit 2024-09-14T05:43:58.092830+0000 mgr.a (mgr.14355) 19160 : audit [DBG] from='client.410709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:43:59.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:43:59 smithi007 bash[22722]: audit 2024-09-14T05:43:58.092830+0000 mgr.a (mgr.14355) 19160 : audit [DBG] from='client.410709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:00.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:00 smithi131 bash[24745]: cluster 2024-09-14T05:43:58.862014+0000 mgr.a (mgr.14355) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:00.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:00 smithi171 bash[25040]: cluster 2024-09-14T05:43:58.862014+0000 mgr.a (mgr.14355) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:00 smithi007 bash[22722]: cluster 2024-09-14T05:43:58.862014+0000 mgr.a (mgr.14355) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:02.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:02 smithi171 bash[25040]: cluster 2024-09-14T05:44:00.864172+0000 mgr.a (mgr.14355) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:02 smithi007 bash[22722]: cluster 2024-09-14T05:44:00.864172+0000 mgr.a (mgr.14355) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:02 smithi131 bash[24745]: cluster 2024-09-14T05:44:00.864172+0000 mgr.a (mgr.14355) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:03.518 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:04.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:04 smithi171 bash[25040]: cluster 2024-09-14T05:44:02.864959+0000 mgr.a (mgr.14355) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:04.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:04 smithi007 bash[22722]: cluster 2024-09-14T05:44:02.864959+0000 mgr.a (mgr.14355) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:04 smithi131 bash[24745]: cluster 2024-09-14T05:44:02.864959+0000 mgr.a (mgr.14355) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:05.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:05 smithi007 bash[22722]: audit 2024-09-14T05:44:03.853017+0000 mgr.a (mgr.14355) 19164 : audit [DBG] from='client.410787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:05.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:05 smithi131 bash[24745]: audit 2024-09-14T05:44:03.853017+0000 mgr.a (mgr.14355) 19164 : audit [DBG] from='client.410787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:05.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:05 smithi171 bash[25040]: audit 2024-09-14T05:44:03.853017+0000 mgr.a (mgr.14355) 19164 : audit [DBG] from='client.410787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:06 smithi007 bash[22722]: cluster 2024-09-14T05:44:04.865906+0000 mgr.a (mgr.14355) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:06 smithi131 bash[24745]: cluster 2024-09-14T05:44:04.865906+0000 mgr.a (mgr.14355) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:06 smithi171 bash[25040]: cluster 2024-09-14T05:44:04.865906+0000 mgr.a (mgr.14355) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:08 smithi007 bash[22722]: cluster 2024-09-14T05:44:06.868212+0000 mgr.a (mgr.14355) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:08 smithi131 bash[24745]: cluster 2024-09-14T05:44:06.868212+0000 mgr.a (mgr.14355) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:08 smithi171 bash[25040]: cluster 2024-09-14T05:44:06.868212+0000 mgr.a (mgr.14355) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:10.067 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:10.067 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:10 smithi007 bash[22722]: cluster 2024-09-14T05:44:08.868989+0000 mgr.a (mgr.14355) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:10 smithi131 bash[24745]: cluster 2024-09-14T05:44:08.868989+0000 mgr.a (mgr.14355) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:10 smithi171 bash[25040]: cluster 2024-09-14T05:44:08.868989+0000 mgr.a (mgr.14355) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:11 smithi007 bash[22722]: audit 2024-09-14T05:44:09.628702+0000 mgr.a (mgr.14355) 19168 : audit [DBG] from='client.410865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:11 smithi131 bash[24745]: audit 2024-09-14T05:44:09.628702+0000 mgr.a (mgr.14355) 19168 : audit [DBG] from='client.410865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:11 smithi171 bash[25040]: audit 2024-09-14T05:44:09.628702+0000 mgr.a (mgr.14355) 19168 : audit [DBG] from='client.410865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:12 smithi007 bash[22722]: cluster 2024-09-14T05:44:10.871410+0000 mgr.a (mgr.14355) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:12 smithi131 bash[24745]: cluster 2024-09-14T05:44:10.871410+0000 mgr.a (mgr.14355) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:12 smithi171 bash[25040]: cluster 2024-09-14T05:44:10.871410+0000 mgr.a (mgr.14355) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:14 smithi007 bash[22722]: cluster 2024-09-14T05:44:12.872205+0000 mgr.a (mgr.14355) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:14 smithi131 bash[24745]: cluster 2024-09-14T05:44:12.872205+0000 mgr.a (mgr.14355) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:14 smithi171 bash[25040]: cluster 2024-09-14T05:44:12.872205+0000 mgr.a (mgr.14355) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:15.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:15.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:15.069 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:15.841 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:15.842 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:15.842 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:16 smithi007 bash[22722]: cluster 2024-09-14T05:44:14.872979+0000 mgr.a (mgr.14355) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:16 smithi131 bash[24745]: cluster 2024-09-14T05:44:14.872979+0000 mgr.a (mgr.14355) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:16 smithi171 bash[25040]: cluster 2024-09-14T05:44:14.872979+0000 mgr.a (mgr.14355) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:17 smithi007 bash[22722]: audit 2024-09-14T05:44:15.405281+0000 mgr.a (mgr.14355) 19172 : audit [DBG] from='client.410943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:17 smithi131 bash[24745]: audit 2024-09-14T05:44:15.405281+0000 mgr.a (mgr.14355) 19172 : audit [DBG] from='client.410943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:17 smithi171 bash[25040]: audit 2024-09-14T05:44:15.405281+0000 mgr.a (mgr.14355) 19172 : audit [DBG] from='client.410943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:18 smithi007 bash[22722]: cluster 2024-09-14T05:44:16.875875+0000 mgr.a (mgr.14355) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:18 smithi131 bash[24745]: cluster 2024-09-14T05:44:16.875875+0000 mgr.a (mgr.14355) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:18.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:18 smithi171 bash[25040]: cluster 2024-09-14T05:44:16.875875+0000 mgr.a (mgr.14355) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:20 smithi007 bash[22722]: cluster 2024-09-14T05:44:18.876676+0000 mgr.a (mgr.14355) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:20 smithi131 bash[24745]: cluster 2024-09-14T05:44:18.876676+0000 mgr.a (mgr.14355) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:20 smithi171 bash[25040]: cluster 2024-09-14T05:44:18.876676+0000 mgr.a (mgr.14355) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:20.843 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:21.632 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:21.633 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:22 smithi007 bash[22722]: cluster 2024-09-14T05:44:20.878177+0000 mgr.a (mgr.14355) 19175 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:22.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:22 smithi007 bash[22722]: audit 2024-09-14T05:44:21.182185+0000 mgr.a (mgr.14355) 19176 : audit [DBG] from='client.411018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:22 smithi131 bash[24745]: cluster 2024-09-14T05:44:20.878177+0000 mgr.a (mgr.14355) 19175 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:22 smithi131 bash[24745]: audit 2024-09-14T05:44:21.182185+0000 mgr.a (mgr.14355) 19176 : audit [DBG] from='client.411018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:22 smithi171 bash[25040]: cluster 2024-09-14T05:44:20.878177+0000 mgr.a (mgr.14355) 19175 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:22 smithi171 bash[25040]: audit 2024-09-14T05:44:21.182185+0000 mgr.a (mgr.14355) 19176 : audit [DBG] from='client.411018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:24.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:24 smithi007 bash[22722]: cluster 2024-09-14T05:44:22.879113+0000 mgr.a (mgr.14355) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:24 smithi131 bash[24745]: cluster 2024-09-14T05:44:22.879113+0000 mgr.a (mgr.14355) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:24 smithi171 bash[25040]: cluster 2024-09-14T05:44:22.879113+0000 mgr.a (mgr.14355) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:44:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:26 smithi007 bash[22722]: cluster 2024-09-14T05:44:24.879895+0000 mgr.a (mgr.14355) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:44:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:26 smithi131 bash[24745]: cluster 2024-09-14T05:44:24.879895+0000 mgr.a (mgr.14355) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:44:26.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:26 smithi171 bash[25040]: cluster 2024-09-14T05:44:24.879895+0000 mgr.a (mgr.14355) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:44:26.634 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:26.634 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:26.635 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:27.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:27.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:27.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:27.413 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:27.413 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:28 smithi007 bash[22722]: cluster 2024-09-14T05:44:26.882043+0000 mgr.a (mgr.14355) 19179 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:28 smithi007 bash[22722]: audit 2024-09-14T05:44:26.972613+0000 mgr.a (mgr.14355) 19180 : audit [DBG] from='client.411096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:28 smithi131 bash[24745]: cluster 2024-09-14T05:44:26.882043+0000 mgr.a (mgr.14355) 19179 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:28 smithi131 bash[24745]: audit 2024-09-14T05:44:26.972613+0000 mgr.a (mgr.14355) 19180 : audit [DBG] from='client.411096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:28 smithi171 bash[25040]: cluster 2024-09-14T05:44:26.882043+0000 mgr.a (mgr.14355) 19179 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:28.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:28 smithi171 bash[25040]: audit 2024-09-14T05:44:26.972613+0000 mgr.a (mgr.14355) 19180 : audit [DBG] from='client.411096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:30 smithi007 bash[22722]: cluster 2024-09-14T05:44:28.883040+0000 mgr.a (mgr.14355) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:30 smithi131 bash[24745]: cluster 2024-09-14T05:44:28.883040+0000 mgr.a (mgr.14355) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:30 smithi171 bash[25040]: cluster 2024-09-14T05:44:28.883040+0000 mgr.a (mgr.14355) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:32.414 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:32 smithi007 bash[22722]: cluster 2024-09-14T05:44:30.885207+0000 mgr.a (mgr.14355) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:32 smithi131 bash[24745]: cluster 2024-09-14T05:44:30.885207+0000 mgr.a (mgr.14355) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:32 smithi171 bash[25040]: cluster 2024-09-14T05:44:30.885207+0000 mgr.a (mgr.14355) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:33.154 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:33.155 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:34 smithi007 bash[22722]: audit 2024-09-14T05:44:32.743470+0000 mgr.a (mgr.14355) 19183 : audit [DBG] from='client.411174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:34 smithi007 bash[22722]: cluster 2024-09-14T05:44:32.885893+0000 mgr.a (mgr.14355) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:34.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:34 smithi131 bash[24745]: audit 2024-09-14T05:44:32.743470+0000 mgr.a (mgr.14355) 19183 : audit [DBG] from='client.411174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:34.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:34 smithi131 bash[24745]: cluster 2024-09-14T05:44:32.885893+0000 mgr.a (mgr.14355) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:34 smithi171 bash[25040]: audit 2024-09-14T05:44:32.743470+0000 mgr.a (mgr.14355) 19183 : audit [DBG] from='client.411174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:34 smithi171 bash[25040]: cluster 2024-09-14T05:44:32.885893+0000 mgr.a (mgr.14355) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:36 smithi007 bash[22722]: cluster 2024-09-14T05:44:34.886807+0000 mgr.a (mgr.14355) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:36 smithi131 bash[24745]: cluster 2024-09-14T05:44:34.886807+0000 mgr.a (mgr.14355) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:36 smithi171 bash[25040]: cluster 2024-09-14T05:44:34.886807+0000 mgr.a (mgr.14355) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:38.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:38.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:38.157 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:38 smithi007 bash[22722]: cluster 2024-09-14T05:44:36.889043+0000 mgr.a (mgr.14355) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:38 smithi131 bash[24745]: cluster 2024-09-14T05:44:36.889043+0000 mgr.a (mgr.14355) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:38 smithi171 bash[25040]: cluster 2024-09-14T05:44:36.889043+0000 mgr.a (mgr.14355) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:38.921 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:38.922 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:40 smithi007 bash[22722]: audit 2024-09-14T05:44:38.489122+0000 mgr.a (mgr.14355) 19187 : audit [DBG] from='client.411249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:40 smithi007 bash[22722]: cluster 2024-09-14T05:44:38.889594+0000 mgr.a (mgr.14355) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:40 smithi131 bash[24745]: audit 2024-09-14T05:44:38.489122+0000 mgr.a (mgr.14355) 19187 : audit [DBG] from='client.411249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:40 smithi131 bash[24745]: cluster 2024-09-14T05:44:38.889594+0000 mgr.a (mgr.14355) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:40 smithi171 bash[25040]: audit 2024-09-14T05:44:38.489122+0000 mgr.a (mgr.14355) 19187 : audit [DBG] from='client.411249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:40 smithi171 bash[25040]: cluster 2024-09-14T05:44:38.889594+0000 mgr.a (mgr.14355) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:44:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:42 smithi007 bash[22722]: cluster 2024-09-14T05:44:40.891736+0000 mgr.a (mgr.14355) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:42 smithi131 bash[24745]: cluster 2024-09-14T05:44:40.891736+0000 mgr.a (mgr.14355) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:42 smithi171 bash[25040]: cluster 2024-09-14T05:44:40.891736+0000 mgr.a (mgr.14355) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-14T05:44:43.923 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:43.923 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:43.924 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:44 smithi007 bash[22722]: cluster 2024-09-14T05:44:42.892504+0000 mgr.a (mgr.14355) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:44 smithi131 bash[24745]: cluster 2024-09-14T05:44:42.892504+0000 mgr.a (mgr.14355) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:44 smithi171 bash[25040]: cluster 2024-09-14T05:44:42.892504+0000 mgr.a (mgr.14355) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:44.715 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:45 smithi007 bash[22722]: audit 2024-09-14T05:44:44.253968+0000 mgr.a (mgr.14355) 19191 : audit [DBG] from='client.411324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:45 smithi007 bash[22722]: audit 2024-09-14T05:44:44.572657+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:44:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:45 smithi131 bash[24745]: audit 2024-09-14T05:44:44.253968+0000 mgr.a (mgr.14355) 19191 : audit [DBG] from='client.411324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:45 smithi131 bash[24745]: audit 2024-09-14T05:44:44.572657+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:44:45.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:45 smithi171 bash[25040]: audit 2024-09-14T05:44:44.253968+0000 mgr.a (mgr.14355) 19191 : audit [DBG] from='client.411324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:45.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:45 smithi171 bash[25040]: audit 2024-09-14T05:44:44.572657+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:44:46.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22972]: debug 2024-09-14T05:44:46.140+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22972]: debug 2024-09-14T05:44:46.140+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22722]: cluster 2024-09-14T05:44:44.893123+0000 mgr.a (mgr.14355) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22722]: audit 2024-09-14T05:44:45.381003+0000 mon.a (mon.0) 3451 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22722]: audit 2024-09-14T05:44:45.382954+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22722]: audit 2024-09-14T05:44:45.393648+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:44:46.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:46 smithi007 bash[22722]: audit 2024-09-14T05:44:45.398637+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:46 smithi131 bash[24745]: cluster 2024-09-14T05:44:44.893123+0000 mgr.a (mgr.14355) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:46 smithi131 bash[24745]: audit 2024-09-14T05:44:45.381003+0000 mon.a (mon.0) 3451 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:44:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:46 smithi131 bash[24745]: audit 2024-09-14T05:44:45.382954+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:44:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:46 smithi131 bash[24745]: audit 2024-09-14T05:44:45.393648+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:44:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:46 smithi131 bash[24745]: audit 2024-09-14T05:44:45.398637+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:46 smithi171 bash[25040]: cluster 2024-09-14T05:44:44.893123+0000 mgr.a (mgr.14355) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:46 smithi171 bash[25040]: audit 2024-09-14T05:44:45.381003+0000 mon.a (mon.0) 3451 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:44:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:46 smithi171 bash[25040]: audit 2024-09-14T05:44:45.382954+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:44:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:46 smithi171 bash[25040]: audit 2024-09-14T05:44:45.393648+0000 mon.a (mon.0) 3453 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:44:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:46 smithi171 bash[25040]: audit 2024-09-14T05:44:45.398637+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:47 smithi007 bash[22722]: audit 2024-09-14T05:44:45.399976+0000 mgr.a (mgr.14355) 19193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:47 smithi007 bash[22722]: audit 2024-09-14T05:44:46.143047+0000 mgr.a (mgr.14355) 19194 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:44:47.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:47 smithi007 bash[22722]: cephadm 2024-09-14T05:44:46.144343+0000 mgr.a (mgr.14355) 19195 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:44:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:47 smithi131 bash[24745]: audit 2024-09-14T05:44:45.399976+0000 mgr.a (mgr.14355) 19193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:47 smithi131 bash[24745]: audit 2024-09-14T05:44:46.143047+0000 mgr.a (mgr.14355) 19194 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:44:47.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:47 smithi131 bash[24745]: cephadm 2024-09-14T05:44:46.144343+0000 mgr.a (mgr.14355) 19195 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:44:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:47 smithi171 bash[25040]: audit 2024-09-14T05:44:45.399976+0000 mgr.a (mgr.14355) 19193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:44:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:47 smithi171 bash[25040]: audit 2024-09-14T05:44:46.143047+0000 mgr.a (mgr.14355) 19194 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:44:47.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:47 smithi171 bash[25040]: cephadm 2024-09-14T05:44:46.144343+0000 mgr.a (mgr.14355) 19195 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:44:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:48 smithi007 bash[22722]: cluster 2024-09-14T05:44:46.896066+0000 mgr.a (mgr.14355) 19196 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:48 smithi131 bash[24745]: cluster 2024-09-14T05:44:46.896066+0000 mgr.a (mgr.14355) 19196 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:48 smithi171 bash[25040]: cluster 2024-09-14T05:44:46.896066+0000 mgr.a (mgr.14355) 19196 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:44:49.716 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:49.717 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:50 smithi007 bash[22722]: cluster 2024-09-14T05:44:48.896890+0000 mgr.a (mgr.14355) 19197 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:50.462 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:50.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:50.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:50.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:50.462 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:50 smithi131 bash[24745]: cluster 2024-09-14T05:44:48.896890+0000 mgr.a (mgr.14355) 19197 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:50.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:50 smithi171 bash[25040]: cluster 2024-09-14T05:44:48.896890+0000 mgr.a (mgr.14355) 19197 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:44:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:51 smithi007 bash[22722]: audit 2024-09-14T05:44:50.044913+0000 mgr.a (mgr.14355) 19198 : audit [DBG] from='client.411510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:51 smithi131 bash[24745]: audit 2024-09-14T05:44:50.044913+0000 mgr.a (mgr.14355) 19198 : audit [DBG] from='client.411510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:51 smithi171 bash[25040]: audit 2024-09-14T05:44:50.044913+0000 mgr.a (mgr.14355) 19198 : audit [DBG] from='client.411510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:52 smithi007 bash[22722]: cluster 2024-09-14T05:44:50.899736+0000 mgr.a (mgr.14355) 19199 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:44:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:52 smithi131 bash[24745]: cluster 2024-09-14T05:44:50.899736+0000 mgr.a (mgr.14355) 19199 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:44:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:52 smithi171 bash[25040]: cluster 2024-09-14T05:44:50.899736+0000 mgr.a (mgr.14355) 19199 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:44:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:54 smithi007 bash[22722]: cluster 2024-09-14T05:44:52.900545+0000 mgr.a (mgr.14355) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:54 smithi131 bash[24745]: cluster 2024-09-14T05:44:52.900545+0000 mgr.a (mgr.14355) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:54 smithi171 bash[25040]: cluster 2024-09-14T05:44:52.900545+0000 mgr.a (mgr.14355) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:44:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:44:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:44:56.230 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:44:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:44:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:44:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:44:56.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:44:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:56 smithi007 bash[22722]: cluster 2024-09-14T05:44:54.901318+0000 mgr.a (mgr.14355) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:56 smithi131 bash[24745]: cluster 2024-09-14T05:44:54.901318+0000 mgr.a (mgr.14355) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:56 smithi171 bash[25040]: cluster 2024-09-14T05:44:54.901318+0000 mgr.a (mgr.14355) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:44:57.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:57 smithi007 bash[22722]: audit 2024-09-14T05:44:55.794963+0000 mgr.a (mgr.14355) 19202 : audit [DBG] from='client.411588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:57 smithi131 bash[24745]: audit 2024-09-14T05:44:55.794963+0000 mgr.a (mgr.14355) 19202 : audit [DBG] from='client.411588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:57 smithi171 bash[25040]: audit 2024-09-14T05:44:55.794963+0000 mgr.a (mgr.14355) 19202 : audit [DBG] from='client.411588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:44:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:44:58 smithi131 bash[24745]: cluster 2024-09-14T05:44:56.904198+0000 mgr.a (mgr.14355) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:44:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:44:58 smithi171 bash[25040]: cluster 2024-09-14T05:44:56.904198+0000 mgr.a (mgr.14355) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:44:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:44:58 smithi007 bash[22722]: cluster 2024-09-14T05:44:56.904198+0000 mgr.a (mgr.14355) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:00 smithi131 bash[24745]: cluster 2024-09-14T05:44:58.905120+0000 mgr.a (mgr.14355) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:45:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:00 smithi171 bash[25040]: cluster 2024-09-14T05:44:58.905120+0000 mgr.a (mgr.14355) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:45:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:00 smithi007 bash[22722]: cluster 2024-09-14T05:44:58.905120+0000 mgr.a (mgr.14355) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:45:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:01.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:02.021 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:02.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:02 smithi131 bash[24745]: cluster 2024-09-14T05:45:00.907083+0000 mgr.a (mgr.14355) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:02 smithi171 bash[25040]: cluster 2024-09-14T05:45:00.907083+0000 mgr.a (mgr.14355) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:02 smithi007 bash[22722]: cluster 2024-09-14T05:45:00.907083+0000 mgr.a (mgr.14355) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:03.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:03 smithi131 bash[24745]: audit 2024-09-14T05:45:01.563506+0000 mgr.a (mgr.14355) 19206 : audit [DBG] from='client.411666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:03 smithi171 bash[25040]: audit 2024-09-14T05:45:01.563506+0000 mgr.a (mgr.14355) 19206 : audit [DBG] from='client.411666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:03 smithi007 bash[22722]: audit 2024-09-14T05:45:01.563506+0000 mgr.a (mgr.14355) 19206 : audit [DBG] from='client.411666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:04 smithi131 bash[24745]: cluster 2024-09-14T05:45:02.907967+0000 mgr.a (mgr.14355) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:04 smithi171 bash[25040]: cluster 2024-09-14T05:45:02.907967+0000 mgr.a (mgr.14355) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:04 smithi007 bash[22722]: cluster 2024-09-14T05:45:02.907967+0000 mgr.a (mgr.14355) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:06 smithi131 bash[24745]: cluster 2024-09-14T05:45:04.908745+0000 mgr.a (mgr.14355) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:06 smithi171 bash[25040]: cluster 2024-09-14T05:45:04.908745+0000 mgr.a (mgr.14355) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:06 smithi007 bash[22722]: cluster 2024-09-14T05:45:04.908745+0000 mgr.a (mgr.14355) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:45:07.022 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:07.781 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:07.781 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:07.782 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:08 smithi131 bash[24745]: cluster 2024-09-14T05:45:06.911001+0000 mgr.a (mgr.14355) 19209 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:45:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:08 smithi171 bash[25040]: cluster 2024-09-14T05:45:06.911001+0000 mgr.a (mgr.14355) 19209 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:45:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:08 smithi007 bash[22722]: cluster 2024-09-14T05:45:06.911001+0000 mgr.a (mgr.14355) 19209 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:45:09.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:09 smithi131 bash[24745]: audit 2024-09-14T05:45:07.357904+0000 mgr.a (mgr.14355) 19210 : audit [DBG] from='client.411744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:09.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:09 smithi171 bash[25040]: audit 2024-09-14T05:45:07.357904+0000 mgr.a (mgr.14355) 19210 : audit [DBG] from='client.411744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:09 smithi007 bash[22722]: audit 2024-09-14T05:45:07.357904+0000 mgr.a (mgr.14355) 19210 : audit [DBG] from='client.411744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:10 smithi131 bash[24745]: cluster 2024-09-14T05:45:08.911910+0000 mgr.a (mgr.14355) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:10 smithi171 bash[25040]: cluster 2024-09-14T05:45:08.911910+0000 mgr.a (mgr.14355) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:10 smithi007 bash[22722]: cluster 2024-09-14T05:45:08.911910+0000 mgr.a (mgr.14355) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:12 smithi131 bash[24745]: cluster 2024-09-14T05:45:10.914070+0000 mgr.a (mgr.14355) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:12 smithi171 bash[25040]: cluster 2024-09-14T05:45:10.914070+0000 mgr.a (mgr.14355) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:12 smithi007 bash[22722]: cluster 2024-09-14T05:45:10.914070+0000 mgr.a (mgr.14355) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:12.783 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:12.784 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:13.542 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:13.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:13.542 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:13.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:13.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:14 smithi131 bash[24745]: cluster 2024-09-14T05:45:12.914548+0000 mgr.a (mgr.14355) 19213 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:14.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:14 smithi131 bash[24745]: audit 2024-09-14T05:45:13.116114+0000 mgr.a (mgr.14355) 19214 : audit [DBG] from='client.411819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:14 smithi171 bash[25040]: cluster 2024-09-14T05:45:12.914548+0000 mgr.a (mgr.14355) 19213 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:14 smithi171 bash[25040]: audit 2024-09-14T05:45:13.116114+0000 mgr.a (mgr.14355) 19214 : audit [DBG] from='client.411819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:14 smithi007 bash[22722]: cluster 2024-09-14T05:45:12.914548+0000 mgr.a (mgr.14355) 19213 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:14.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:14 smithi007 bash[22722]: audit 2024-09-14T05:45:13.116114+0000 mgr.a (mgr.14355) 19214 : audit [DBG] from='client.411819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:16 smithi131 bash[24745]: cluster 2024-09-14T05:45:14.915400+0000 mgr.a (mgr.14355) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:16 smithi171 bash[25040]: cluster 2024-09-14T05:45:14.915400+0000 mgr.a (mgr.14355) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:16 smithi007 bash[22722]: cluster 2024-09-14T05:45:14.915400+0000 mgr.a (mgr.14355) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:18 smithi131 bash[24745]: cluster 2024-09-14T05:45:16.917650+0000 mgr.a (mgr.14355) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:18.543 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:18.544 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:18.544 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:18 smithi171 bash[25040]: cluster 2024-09-14T05:45:16.917650+0000 mgr.a (mgr.14355) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:18 smithi007 bash[22722]: cluster 2024-09-14T05:45:16.917650+0000 mgr.a (mgr.14355) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:19.297 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:20 smithi131 bash[24745]: audit 2024-09-14T05:45:18.869771+0000 mgr.a (mgr.14355) 19217 : audit [DBG] from='client.411897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:20 smithi131 bash[24745]: cluster 2024-09-14T05:45:18.918479+0000 mgr.a (mgr.14355) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:20 smithi171 bash[25040]: audit 2024-09-14T05:45:18.869771+0000 mgr.a (mgr.14355) 19217 : audit [DBG] from='client.411897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:20 smithi171 bash[25040]: cluster 2024-09-14T05:45:18.918479+0000 mgr.a (mgr.14355) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:20 smithi007 bash[22722]: audit 2024-09-14T05:45:18.869771+0000 mgr.a (mgr.14355) 19217 : audit [DBG] from='client.411897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:20 smithi007 bash[22722]: cluster 2024-09-14T05:45:18.918479+0000 mgr.a (mgr.14355) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:22 smithi131 bash[24745]: cluster 2024-09-14T05:45:20.920737+0000 mgr.a (mgr.14355) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:22 smithi171 bash[25040]: cluster 2024-09-14T05:45:20.920737+0000 mgr.a (mgr.14355) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:22 smithi007 bash[22722]: cluster 2024-09-14T05:45:20.920737+0000 mgr.a (mgr.14355) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:24.298 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:24.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:24.299 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:24 smithi131 bash[24745]: cluster 2024-09-14T05:45:22.921519+0000 mgr.a (mgr.14355) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:24 smithi171 bash[25040]: cluster 2024-09-14T05:45:22.921519+0000 mgr.a (mgr.14355) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:24 smithi007 bash[22722]: cluster 2024-09-14T05:45:22.921519+0000 mgr.a (mgr.14355) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:25.076 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:26 smithi131 bash[24745]: audit 2024-09-14T05:45:24.634914+0000 mgr.a (mgr.14355) 19221 : audit [DBG] from='client.411975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:26 smithi131 bash[24745]: cluster 2024-09-14T05:45:24.922064+0000 mgr.a (mgr.14355) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:26 smithi171 bash[25040]: audit 2024-09-14T05:45:24.634914+0000 mgr.a (mgr.14355) 19221 : audit [DBG] from='client.411975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:26 smithi171 bash[25040]: cluster 2024-09-14T05:45:24.922064+0000 mgr.a (mgr.14355) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:26 smithi007 bash[22722]: audit 2024-09-14T05:45:24.634914+0000 mgr.a (mgr.14355) 19221 : audit [DBG] from='client.411975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:26 smithi007 bash[22722]: cluster 2024-09-14T05:45:24.922064+0000 mgr.a (mgr.14355) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:28.535 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:28 smithi131 bash[24745]: cluster 2024-09-14T05:45:26.924412+0000 mgr.a (mgr.14355) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:28 smithi171 bash[25040]: cluster 2024-09-14T05:45:26.924412+0000 mgr.a (mgr.14355) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:28 smithi007 bash[22722]: cluster 2024-09-14T05:45:26.924412+0000 mgr.a (mgr.14355) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:30 smithi171 bash[25040]: cluster 2024-09-14T05:45:28.925172+0000 mgr.a (mgr.14355) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:30 smithi007 bash[22722]: cluster 2024-09-14T05:45:28.925172+0000 mgr.a (mgr.14355) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:30.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:30 smithi131 bash[24745]: cluster 2024-09-14T05:45:28.925172+0000 mgr.a (mgr.14355) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:30.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:30.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:30.850 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:32 smithi171 bash[25040]: audit 2024-09-14T05:45:30.411767+0000 mgr.a (mgr.14355) 19225 : audit [DBG] from='client.412050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:32.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:32 smithi171 bash[25040]: cluster 2024-09-14T05:45:30.926688+0000 mgr.a (mgr.14355) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:32 smithi007 bash[22722]: audit 2024-09-14T05:45:30.411767+0000 mgr.a (mgr.14355) 19225 : audit [DBG] from='client.412050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:32 smithi007 bash[22722]: cluster 2024-09-14T05:45:30.926688+0000 mgr.a (mgr.14355) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:32 smithi131 bash[24745]: audit 2024-09-14T05:45:30.411767+0000 mgr.a (mgr.14355) 19225 : audit [DBG] from='client.412050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:32 smithi131 bash[24745]: cluster 2024-09-14T05:45:30.926688+0000 mgr.a (mgr.14355) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:33 smithi007 bash[22722]: cluster 2024-09-14T05:45:32.927411+0000 mgr.a (mgr.14355) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:33 smithi131 bash[24745]: cluster 2024-09-14T05:45:32.927411+0000 mgr.a (mgr.14355) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:33 smithi171 bash[25040]: cluster 2024-09-14T05:45:32.927411+0000 mgr.a (mgr.14355) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:35.851 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:35.852 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:36.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:35 smithi131 bash[24745]: cluster 2024-09-14T05:45:34.928149+0000 mgr.a (mgr.14355) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:36.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:35 smithi171 bash[25040]: cluster 2024-09-14T05:45:34.928149+0000 mgr.a (mgr.14355) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:35 smithi007 bash[22722]: cluster 2024-09-14T05:45:34.928149+0000 mgr.a (mgr.14355) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:45:36.631 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:37.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:36 smithi131 bash[24745]: audit 2024-09-14T05:45:36.192450+0000 mgr.a (mgr.14355) 19229 : audit [DBG] from='client.412122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:37.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:36 smithi171 bash[25040]: audit 2024-09-14T05:45:36.192450+0000 mgr.a (mgr.14355) 19229 : audit [DBG] from='client.412122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:36 smithi007 bash[22722]: audit 2024-09-14T05:45:36.192450+0000 mgr.a (mgr.14355) 19229 : audit [DBG] from='client.412122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:38.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:37 smithi131 bash[24745]: cluster 2024-09-14T05:45:36.930940+0000 mgr.a (mgr.14355) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:38.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:37 smithi171 bash[25040]: cluster 2024-09-14T05:45:36.930940+0000 mgr.a (mgr.14355) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:38.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:37 smithi007 bash[22722]: cluster 2024-09-14T05:45:36.930940+0000 mgr.a (mgr.14355) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:40.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:40 smithi131 bash[24745]: cluster 2024-09-14T05:45:38.931740+0000 mgr.a (mgr.14355) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:45:40.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:40 smithi171 bash[25040]: cluster 2024-09-14T05:45:38.931740+0000 mgr.a (mgr.14355) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:45:40.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:39 smithi007 bash[22722]: cluster 2024-09-14T05:45:38.931740+0000 mgr.a (mgr.14355) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:45:41.632 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:41.633 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:42.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:42 smithi131 bash[24745]: cluster 2024-09-14T05:45:40.933679+0000 mgr.a (mgr.14355) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:42.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:42 smithi171 bash[25040]: cluster 2024-09-14T05:45:40.933679+0000 mgr.a (mgr.14355) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:42.389 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:42.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:42 smithi007 bash[22722]: cluster 2024-09-14T05:45:40.933679+0000 mgr.a (mgr.14355) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:43.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:43 smithi131 bash[24745]: audit 2024-09-14T05:45:41.962879+0000 mgr.a (mgr.14355) 19233 : audit [DBG] from='client.412194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:43.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:43 smithi171 bash[25040]: audit 2024-09-14T05:45:41.962879+0000 mgr.a (mgr.14355) 19233 : audit [DBG] from='client.412194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:43 smithi007 bash[22722]: audit 2024-09-14T05:45:41.962879+0000 mgr.a (mgr.14355) 19233 : audit [DBG] from='client.412194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:44.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:44 smithi131 bash[24745]: cluster 2024-09-14T05:45:42.934585+0000 mgr.a (mgr.14355) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:44.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:44 smithi171 bash[25040]: cluster 2024-09-14T05:45:42.934585+0000 mgr.a (mgr.14355) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:44.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:44 smithi007 bash[22722]: cluster 2024-09-14T05:45:42.934585+0000 mgr.a (mgr.14355) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:46.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:46 smithi131 bash[24745]: cluster 2024-09-14T05:45:44.935339+0000 mgr.a (mgr.14355) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:46.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:46 smithi171 bash[25040]: cluster 2024-09-14T05:45:44.935339+0000 mgr.a (mgr.14355) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:46.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:46 smithi007 bash[22722]: cluster 2024-09-14T05:45:44.935339+0000 mgr.a (mgr.14355) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:47.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:47 smithi131 bash[24745]: audit 2024-09-14T05:45:46.207155+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:45:47.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:47 smithi171 bash[25040]: audit 2024-09-14T05:45:46.207155+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:45:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:47.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:47 smithi007 bash[22722]: audit 2024-09-14T05:45:46.207155+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:45:48.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:45:47 smithi007 bash[22972]: debug 2024-09-14T05:45:47.839+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:45:48.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:45:47 smithi007 bash[22972]: debug 2024-09-14T05:45:47.851+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: cluster 2024-09-14T05:45:46.937543+0000 mgr.a (mgr.14355) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: audit 2024-09-14T05:45:47.078682+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: audit 2024-09-14T05:45:47.080717+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: audit 2024-09-14T05:45:47.090045+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: audit 2024-09-14T05:45:47.094867+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:48.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:48 smithi007 bash[22722]: audit 2024-09-14T05:45:47.097155+0000 mgr.a (mgr.14355) 19237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:48.248 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:48.249 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: cluster 2024-09-14T05:45:46.937543+0000 mgr.a (mgr.14355) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:48.283 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: audit 2024-09-14T05:45:47.078682+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:45:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: audit 2024-09-14T05:45:47.080717+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:45:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: audit 2024-09-14T05:45:47.090045+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:45:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: audit 2024-09-14T05:45:47.094867+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:48.284 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:48 smithi131 bash[24745]: audit 2024-09-14T05:45:47.097155+0000 mgr.a (mgr.14355) 19237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: cluster 2024-09-14T05:45:46.937543+0000 mgr.a (mgr.14355) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: audit 2024-09-14T05:45:47.078682+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: audit 2024-09-14T05:45:47.080717+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: audit 2024-09-14T05:45:47.090045+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: audit 2024-09-14T05:45:47.094867+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:48.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:48 smithi171 bash[25040]: audit 2024-09-14T05:45:47.097155+0000 mgr.a (mgr.14355) 19237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:45:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:49 smithi171 bash[25040]: audit 2024-09-14T05:45:47.725956+0000 mgr.a (mgr.14355) 19238 : audit [DBG] from='client.412326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:49 smithi171 bash[25040]: audit 2024-09-14T05:45:47.844613+0000 mgr.a (mgr.14355) 19239 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:45:49.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:49 smithi171 bash[25040]: cephadm 2024-09-14T05:45:47.856410+0000 mgr.a (mgr.14355) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:45:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:49 smithi007 bash[22722]: audit 2024-09-14T05:45:47.725956+0000 mgr.a (mgr.14355) 19238 : audit [DBG] from='client.412326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:49 smithi007 bash[22722]: audit 2024-09-14T05:45:47.844613+0000 mgr.a (mgr.14355) 19239 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:45:49.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:49 smithi007 bash[22722]: cephadm 2024-09-14T05:45:47.856410+0000 mgr.a (mgr.14355) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:45:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:49 smithi131 bash[24745]: audit 2024-09-14T05:45:47.725956+0000 mgr.a (mgr.14355) 19238 : audit [DBG] from='client.412326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:49 smithi131 bash[24745]: audit 2024-09-14T05:45:47.844613+0000 mgr.a (mgr.14355) 19239 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:45:49.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:49 smithi131 bash[24745]: cephadm 2024-09-14T05:45:47.856410+0000 mgr.a (mgr.14355) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:45:50.295 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:50 smithi171 bash[25040]: cluster 2024-09-14T05:45:48.938446+0000 mgr.a (mgr.14355) 19241 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:50 smithi007 bash[22722]: cluster 2024-09-14T05:45:48.938446+0000 mgr.a (mgr.14355) 19241 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:50 smithi131 bash[24745]: cluster 2024-09-14T05:45:48.938446+0000 mgr.a (mgr.14355) 19241 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:45:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:52 smithi007 bash[22722]: cluster 2024-09-14T05:45:50.940578+0000 mgr.a (mgr.14355) 19242 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:52 smithi131 bash[24745]: cluster 2024-09-14T05:45:50.940578+0000 mgr.a (mgr.14355) 19242 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:52 smithi171 bash[25040]: cluster 2024-09-14T05:45:50.940578+0000 mgr.a (mgr.14355) 19242 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:53.250 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:53.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:53.251 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:53.989 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:53.989 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:45:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:54 smithi007 bash[22722]: cluster 2024-09-14T05:45:52.941330+0000 mgr.a (mgr.14355) 19243 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:54 smithi131 bash[24745]: cluster 2024-09-14T05:45:52.941330+0000 mgr.a (mgr.14355) 19243 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:54 smithi171 bash[25040]: cluster 2024-09-14T05:45:52.941330+0000 mgr.a (mgr.14355) 19243 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:55.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:55 smithi007 bash[22722]: audit 2024-09-14T05:45:53.577714+0000 mgr.a (mgr.14355) 19244 : audit [DBG] from='client.412452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:55 smithi131 bash[24745]: audit 2024-09-14T05:45:53.577714+0000 mgr.a (mgr.14355) 19244 : audit [DBG] from='client.412452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:55 smithi171 bash[25040]: audit 2024-09-14T05:45:53.577714+0000 mgr.a (mgr.14355) 19244 : audit [DBG] from='client.412452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:45:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:56 smithi007 bash[22722]: cluster 2024-09-14T05:45:54.942233+0000 mgr.a (mgr.14355) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:56 smithi131 bash[24745]: cluster 2024-09-14T05:45:54.942233+0000 mgr.a (mgr.14355) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:56 smithi171 bash[25040]: cluster 2024-09-14T05:45:54.942233+0000 mgr.a (mgr.14355) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:45:58 smithi007 bash[22722]: cluster 2024-09-14T05:45:56.944520+0000 mgr.a (mgr.14355) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:45:58 smithi131 bash[24745]: cluster 2024-09-14T05:45:56.944520+0000 mgr.a (mgr.14355) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:45:58 smithi171 bash[25040]: cluster 2024-09-14T05:45:56.944520+0000 mgr.a (mgr.14355) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:45:58.990 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:45:58.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:45:58.991 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:45:59.779 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:45:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:45:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:45:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:45:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:00 smithi007 bash[22722]: cluster 2024-09-14T05:45:58.945299+0000 mgr.a (mgr.14355) 19247 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:00 smithi131 bash[24745]: cluster 2024-09-14T05:45:58.945299+0000 mgr.a (mgr.14355) 19247 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:00 smithi171 bash[25040]: cluster 2024-09-14T05:45:58.945299+0000 mgr.a (mgr.14355) 19247 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:01.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:01 smithi007 bash[22722]: audit 2024-09-14T05:45:59.329802+0000 mgr.a (mgr.14355) 19248 : audit [DBG] from='client.412524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:01.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:01 smithi131 bash[24745]: audit 2024-09-14T05:45:59.329802+0000 mgr.a (mgr.14355) 19248 : audit [DBG] from='client.412524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:01.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:01 smithi171 bash[25040]: audit 2024-09-14T05:45:59.329802+0000 mgr.a (mgr.14355) 19248 : audit [DBG] from='client.412524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:02 smithi007 bash[22722]: cluster 2024-09-14T05:46:00.947594+0000 mgr.a (mgr.14355) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:02 smithi131 bash[24745]: cluster 2024-09-14T05:46:00.947594+0000 mgr.a (mgr.14355) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:02 smithi171 bash[25040]: cluster 2024-09-14T05:46:00.947594+0000 mgr.a (mgr.14355) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:04 smithi007 bash[22722]: cluster 2024-09-14T05:46:02.948355+0000 mgr.a (mgr.14355) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:04 smithi131 bash[24745]: cluster 2024-09-14T05:46:02.948355+0000 mgr.a (mgr.14355) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:04 smithi171 bash[25040]: cluster 2024-09-14T05:46:02.948355+0000 mgr.a (mgr.14355) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:04.780 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:04.781 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:05.549 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:05.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:05.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:05.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:06 smithi131 bash[24745]: cluster 2024-09-14T05:46:04.949096+0000 mgr.a (mgr.14355) 19251 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:06 smithi131 bash[24745]: audit 2024-09-14T05:46:05.111641+0000 mgr.a (mgr.14355) 19252 : audit [DBG] from='client.412599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:06 smithi171 bash[25040]: cluster 2024-09-14T05:46:04.949096+0000 mgr.a (mgr.14355) 19251 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:06 smithi171 bash[25040]: audit 2024-09-14T05:46:05.111641+0000 mgr.a (mgr.14355) 19252 : audit [DBG] from='client.412599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:06 smithi007 bash[22722]: cluster 2024-09-14T05:46:04.949096+0000 mgr.a (mgr.14355) 19251 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:06 smithi007 bash[22722]: audit 2024-09-14T05:46:05.111641+0000 mgr.a (mgr.14355) 19252 : audit [DBG] from='client.412599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:08 smithi131 bash[24745]: cluster 2024-09-14T05:46:06.951839+0000 mgr.a (mgr.14355) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:08 smithi171 bash[25040]: cluster 2024-09-14T05:46:06.951839+0000 mgr.a (mgr.14355) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:08 smithi007 bash[22722]: cluster 2024-09-14T05:46:06.951839+0000 mgr.a (mgr.14355) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:10 smithi131 bash[24745]: cluster 2024-09-14T05:46:08.952620+0000 mgr.a (mgr.14355) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:10 smithi171 bash[25040]: cluster 2024-09-14T05:46:08.952620+0000 mgr.a (mgr.14355) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:10.550 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:10.551 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:10.552 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:10 smithi007 bash[22722]: cluster 2024-09-14T05:46:08.952620+0000 mgr.a (mgr.14355) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:11.303 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:11.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:11.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:11.303 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:11.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:12 smithi131 bash[24745]: audit 2024-09-14T05:46:10.878484+0000 mgr.a (mgr.14355) 19255 : audit [DBG] from='client.412677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:12 smithi131 bash[24745]: cluster 2024-09-14T05:46:10.953956+0000 mgr.a (mgr.14355) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:12 smithi171 bash[25040]: audit 2024-09-14T05:46:10.878484+0000 mgr.a (mgr.14355) 19255 : audit [DBG] from='client.412677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:12.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:12 smithi171 bash[25040]: cluster 2024-09-14T05:46:10.953956+0000 mgr.a (mgr.14355) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:12 smithi007 bash[22722]: audit 2024-09-14T05:46:10.878484+0000 mgr.a (mgr.14355) 19255 : audit [DBG] from='client.412677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:12 smithi007 bash[22722]: cluster 2024-09-14T05:46:10.953956+0000 mgr.a (mgr.14355) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:14 smithi131 bash[24745]: cluster 2024-09-14T05:46:12.954992+0000 mgr.a (mgr.14355) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:14 smithi171 bash[25040]: cluster 2024-09-14T05:46:12.954992+0000 mgr.a (mgr.14355) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:14 smithi007 bash[22722]: cluster 2024-09-14T05:46:12.954992+0000 mgr.a (mgr.14355) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:16 smithi131 bash[24745]: cluster 2024-09-14T05:46:14.955800+0000 mgr.a (mgr.14355) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:46:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:16 smithi171 bash[25040]: cluster 2024-09-14T05:46:14.955800+0000 mgr.a (mgr.14355) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:46:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:16 smithi007 bash[22722]: cluster 2024-09-14T05:46:14.955800+0000 mgr.a (mgr.14355) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:46:17.084 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:17.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:17.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:17.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:17.085 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:18 smithi131 bash[24745]: audit 2024-09-14T05:46:16.636058+0000 mgr.a (mgr.14355) 19259 : audit [DBG] from='client.412755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:18 smithi131 bash[24745]: cluster 2024-09-14T05:46:16.957049+0000 mgr.a (mgr.14355) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:18 smithi171 bash[25040]: audit 2024-09-14T05:46:16.636058+0000 mgr.a (mgr.14355) 19259 : audit [DBG] from='client.412755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:18 smithi171 bash[25040]: cluster 2024-09-14T05:46:16.957049+0000 mgr.a (mgr.14355) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:18 smithi007 bash[22722]: audit 2024-09-14T05:46:16.636058+0000 mgr.a (mgr.14355) 19259 : audit [DBG] from='client.412755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:18 smithi007 bash[22722]: cluster 2024-09-14T05:46:16.957049+0000 mgr.a (mgr.14355) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:20 smithi131 bash[24745]: cluster 2024-09-14T05:46:18.957907+0000 mgr.a (mgr.14355) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:20 smithi171 bash[25040]: cluster 2024-09-14T05:46:18.957907+0000 mgr.a (mgr.14355) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:20 smithi007 bash[22722]: cluster 2024-09-14T05:46:18.957907+0000 mgr.a (mgr.14355) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:22.086 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:22.086 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:22.087 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:22 smithi131 bash[24745]: cluster 2024-09-14T05:46:20.960082+0000 mgr.a (mgr.14355) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:22 smithi171 bash[25040]: cluster 2024-09-14T05:46:20.960082+0000 mgr.a (mgr.14355) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:22 smithi007 bash[22722]: cluster 2024-09-14T05:46:20.960082+0000 mgr.a (mgr.14355) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:22.824 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:22.824 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:24 smithi131 bash[24745]: audit 2024-09-14T05:46:22.414122+0000 mgr.a (mgr.14355) 19263 : audit [DBG] from='client.412833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:24 smithi131 bash[24745]: cluster 2024-09-14T05:46:22.960924+0000 mgr.a (mgr.14355) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:24 smithi171 bash[25040]: audit 2024-09-14T05:46:22.414122+0000 mgr.a (mgr.14355) 19263 : audit [DBG] from='client.412833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:24 smithi171 bash[25040]: cluster 2024-09-14T05:46:22.960924+0000 mgr.a (mgr.14355) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:24 smithi007 bash[22722]: audit 2024-09-14T05:46:22.414122+0000 mgr.a (mgr.14355) 19263 : audit [DBG] from='client.412833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:24.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:24 smithi007 bash[22722]: cluster 2024-09-14T05:46:22.960924+0000 mgr.a (mgr.14355) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:26 smithi131 bash[24745]: cluster 2024-09-14T05:46:24.961676+0000 mgr.a (mgr.14355) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:26 smithi171 bash[25040]: cluster 2024-09-14T05:46:24.961676+0000 mgr.a (mgr.14355) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:26 smithi007 bash[22722]: cluster 2024-09-14T05:46:24.961676+0000 mgr.a (mgr.14355) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:27.825 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:27.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:27.826 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:28 smithi131 bash[24745]: cluster 2024-09-14T05:46:26.963884+0000 mgr.a (mgr.14355) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:28 smithi171 bash[25040]: cluster 2024-09-14T05:46:26.963884+0000 mgr.a (mgr.14355) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:28.590 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:28.590 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:28 smithi007 bash[22722]: cluster 2024-09-14T05:46:26.963884+0000 mgr.a (mgr.14355) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:29.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:29 smithi131 bash[24745]: audit 2024-09-14T05:46:28.158934+0000 mgr.a (mgr.14355) 19267 : audit [DBG] from='client.412908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:29.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:29 smithi171 bash[25040]: audit 2024-09-14T05:46:28.158934+0000 mgr.a (mgr.14355) 19267 : audit [DBG] from='client.412908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:29 smithi007 bash[22722]: audit 2024-09-14T05:46:28.158934+0000 mgr.a (mgr.14355) 19267 : audit [DBG] from='client.412908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:30 smithi131 bash[24745]: cluster 2024-09-14T05:46:28.964758+0000 mgr.a (mgr.14355) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:30 smithi171 bash[25040]: cluster 2024-09-14T05:46:28.964758+0000 mgr.a (mgr.14355) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:30 smithi007 bash[22722]: cluster 2024-09-14T05:46:28.964758+0000 mgr.a (mgr.14355) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:32 smithi131 bash[24745]: cluster 2024-09-14T05:46:30.966940+0000 mgr.a (mgr.14355) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:32 smithi171 bash[25040]: cluster 2024-09-14T05:46:30.966940+0000 mgr.a (mgr.14355) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:32 smithi007 bash[22722]: cluster 2024-09-14T05:46:30.966940+0000 mgr.a (mgr.14355) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:33.591 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:33.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:33.592 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:34.344 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:34 smithi131 bash[24745]: cluster 2024-09-14T05:46:32.967668+0000 mgr.a (mgr.14355) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:34 smithi171 bash[25040]: cluster 2024-09-14T05:46:32.967668+0000 mgr.a (mgr.14355) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:34 smithi007 bash[22722]: cluster 2024-09-14T05:46:32.967668+0000 mgr.a (mgr.14355) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:35.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:35 smithi131 bash[24745]: audit 2024-09-14T05:46:33.921773+0000 mgr.a (mgr.14355) 19271 : audit [DBG] from='client.412980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:35 smithi171 bash[25040]: audit 2024-09-14T05:46:33.921773+0000 mgr.a (mgr.14355) 19271 : audit [DBG] from='client.412980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:35 smithi007 bash[22722]: audit 2024-09-14T05:46:33.921773+0000 mgr.a (mgr.14355) 19271 : audit [DBG] from='client.412980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:36 smithi131 bash[24745]: cluster 2024-09-14T05:46:34.968556+0000 mgr.a (mgr.14355) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:36 smithi171 bash[25040]: cluster 2024-09-14T05:46:34.968556+0000 mgr.a (mgr.14355) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:36 smithi007 bash[22722]: cluster 2024-09-14T05:46:34.968556+0000 mgr.a (mgr.14355) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:38 smithi171 bash[25040]: cluster 2024-09-14T05:46:36.970780+0000 mgr.a (mgr.14355) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:38 smithi007 bash[22722]: cluster 2024-09-14T05:46:36.970780+0000 mgr.a (mgr.14355) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:38 smithi131 bash[24745]: cluster 2024-09-14T05:46:36.970780+0000 mgr.a (mgr.14355) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:39.346 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:39.347 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:40.102 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:40 smithi171 bash[25040]: cluster 2024-09-14T05:46:38.971527+0000 mgr.a (mgr.14355) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:40 smithi007 bash[22722]: cluster 2024-09-14T05:46:38.971527+0000 mgr.a (mgr.14355) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:40 smithi131 bash[24745]: cluster 2024-09-14T05:46:38.971527+0000 mgr.a (mgr.14355) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:41 smithi007 bash[22722]: audit 2024-09-14T05:46:39.676422+0000 mgr.a (mgr.14355) 19275 : audit [DBG] from='client.413058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:41 smithi131 bash[24745]: audit 2024-09-14T05:46:39.676422+0000 mgr.a (mgr.14355) 19275 : audit [DBG] from='client.413058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:41 smithi171 bash[25040]: audit 2024-09-14T05:46:39.676422+0000 mgr.a (mgr.14355) 19275 : audit [DBG] from='client.413058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:42 smithi007 bash[22722]: cluster 2024-09-14T05:46:40.973910+0000 mgr.a (mgr.14355) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:42 smithi131 bash[24745]: cluster 2024-09-14T05:46:40.973910+0000 mgr.a (mgr.14355) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:42 smithi171 bash[25040]: cluster 2024-09-14T05:46:40.973910+0000 mgr.a (mgr.14355) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:46:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:44 smithi007 bash[22722]: cluster 2024-09-14T05:46:42.974739+0000 mgr.a (mgr.14355) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:44 smithi131 bash[24745]: cluster 2024-09-14T05:46:42.974739+0000 mgr.a (mgr.14355) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:44 smithi171 bash[25040]: cluster 2024-09-14T05:46:42.974739+0000 mgr.a (mgr.14355) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:45.103 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:45.848 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:45.849 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:46 smithi007 bash[22722]: cluster 2024-09-14T05:46:44.975540+0000 mgr.a (mgr.14355) 19278 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:46 smithi131 bash[24745]: cluster 2024-09-14T05:46:44.975540+0000 mgr.a (mgr.14355) 19278 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:46 smithi171 bash[25040]: cluster 2024-09-14T05:46:44.975540+0000 mgr.a (mgr.14355) 19278 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:47 smithi007 bash[22722]: audit 2024-09-14T05:46:45.434137+0000 mgr.a (mgr.14355) 19279 : audit [DBG] from='client.413133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:47 smithi131 bash[24745]: audit 2024-09-14T05:46:45.434137+0000 mgr.a (mgr.14355) 19279 : audit [DBG] from='client.413133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:47 smithi171 bash[25040]: audit 2024-09-14T05:46:45.434137+0000 mgr.a (mgr.14355) 19279 : audit [DBG] from='client.413133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:48 smithi007 bash[22722]: cluster 2024-09-14T05:46:46.978436+0000 mgr.a (mgr.14355) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:48 smithi007 bash[22722]: audit 2024-09-14T05:46:47.910051+0000 mon.a (mon.0) 3460 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:46:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:48 smithi131 bash[24745]: cluster 2024-09-14T05:46:46.978436+0000 mgr.a (mgr.14355) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:48 smithi131 bash[24745]: audit 2024-09-14T05:46:47.910051+0000 mon.a (mon.0) 3460 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:46:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:48 smithi171 bash[25040]: cluster 2024-09-14T05:46:46.978436+0000 mgr.a (mgr.14355) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:46:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:48 smithi171 bash[25040]: audit 2024-09-14T05:46:47.910051+0000 mon.a (mon.0) 3460 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:48.543006+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:48.547137+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: cluster 2024-09-14T05:46:48.979155+0000 mgr.a (mgr.14355) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:49.327944+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:49.329639+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:49.340046+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:49 smithi171 bash[25040]: audit 2024-09-14T05:46:49.344842+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:48.543006+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:48.547137+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: cluster 2024-09-14T05:46:48.979155+0000 mgr.a (mgr.14355) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:49.327944+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:49.329639+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:46:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:49.340046+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:49.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:49 smithi007 bash[22722]: audit 2024-09-14T05:46:49.344842+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:50.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:48.543006+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:48.547137+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: cluster 2024-09-14T05:46:48.979155+0000 mgr.a (mgr.14355) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:49.327944+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:49.329639+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:49.340046+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:46:50.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:49 smithi131 bash[24745]: audit 2024-09-14T05:46:49.344842+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:46:50 smithi007 bash[22972]: debug 2024-09-14T05:46:50.106+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:46:50.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:46:50 smithi007 bash[22972]: debug 2024-09-14T05:46:50.110+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:46:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:50.851 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:50 smithi007 bash[22722]: audit 2024-09-14T05:46:49.347186+0000 mgr.a (mgr.14355) 19282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:50 smithi007 bash[22722]: audit 2024-09-14T05:46:50.113740+0000 mgr.a (mgr.14355) 19283 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:46:50.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:50 smithi007 bash[22722]: cephadm 2024-09-14T05:46:50.114905+0000 mgr.a (mgr.14355) 19284 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:46:51.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:50 smithi131 bash[24745]: audit 2024-09-14T05:46:49.347186+0000 mgr.a (mgr.14355) 19282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:50 smithi131 bash[24745]: audit 2024-09-14T05:46:50.113740+0000 mgr.a (mgr.14355) 19283 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:46:51.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:50 smithi131 bash[24745]: cephadm 2024-09-14T05:46:50.114905+0000 mgr.a (mgr.14355) 19284 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:46:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:50 smithi171 bash[25040]: audit 2024-09-14T05:46:49.347186+0000 mgr.a (mgr.14355) 19282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:46:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:50 smithi171 bash[25040]: audit 2024-09-14T05:46:50.113740+0000 mgr.a (mgr.14355) 19283 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:46:51.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:50 smithi171 bash[25040]: cephadm 2024-09-14T05:46:50.114905+0000 mgr.a (mgr.14355) 19284 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:46:51.629 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:51.630 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:52 smithi007 bash[22722]: cluster 2024-09-14T05:46:50.980548+0000 mgr.a (mgr.14355) 19285 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:52.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:52 smithi007 bash[22722]: audit 2024-09-14T05:46:51.186770+0000 mgr.a (mgr.14355) 19286 : audit [DBG] from='client.413313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:52 smithi131 bash[24745]: cluster 2024-09-14T05:46:50.980548+0000 mgr.a (mgr.14355) 19285 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:52 smithi131 bash[24745]: audit 2024-09-14T05:46:51.186770+0000 mgr.a (mgr.14355) 19286 : audit [DBG] from='client.413313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:52 smithi171 bash[25040]: cluster 2024-09-14T05:46:50.980548+0000 mgr.a (mgr.14355) 19285 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:52 smithi171 bash[25040]: audit 2024-09-14T05:46:51.186770+0000 mgr.a (mgr.14355) 19286 : audit [DBG] from='client.413313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:54 smithi007 bash[22722]: cluster 2024-09-14T05:46:52.981490+0000 mgr.a (mgr.14355) 19287 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:54 smithi131 bash[24745]: cluster 2024-09-14T05:46:52.981490+0000 mgr.a (mgr.14355) 19287 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:54 smithi171 bash[25040]: cluster 2024-09-14T05:46:52.981490+0000 mgr.a (mgr.14355) 19287 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:56 smithi007 bash[22722]: cluster 2024-09-14T05:46:54.982317+0000 mgr.a (mgr.14355) 19288 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:56 smithi131 bash[24745]: cluster 2024-09-14T05:46:54.982317+0000 mgr.a (mgr.14355) 19288 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:56 smithi171 bash[25040]: cluster 2024-09-14T05:46:54.982317+0000 mgr.a (mgr.14355) 19288 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:46:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:46:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:46:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:46:57.390 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:46:57.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:46:57.390 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:46:57.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:46:57.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:46:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:58 smithi007 bash[22722]: audit 2024-09-14T05:46:56.960553+0000 mgr.a (mgr.14355) 19289 : audit [DBG] from='client.413391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:46:58 smithi007 bash[22722]: cluster 2024-09-14T05:46:56.985361+0000 mgr.a (mgr.14355) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:58 smithi131 bash[24745]: audit 2024-09-14T05:46:56.960553+0000 mgr.a (mgr.14355) 19289 : audit [DBG] from='client.413391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:46:58 smithi131 bash[24745]: cluster 2024-09-14T05:46:56.985361+0000 mgr.a (mgr.14355) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:46:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:58 smithi171 bash[25040]: audit 2024-09-14T05:46:56.960553+0000 mgr.a (mgr.14355) 19289 : audit [DBG] from='client.413391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:46:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:46:58 smithi171 bash[25040]: cluster 2024-09-14T05:46:56.985361+0000 mgr.a (mgr.14355) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:00 smithi007 bash[22722]: cluster 2024-09-14T05:46:58.986366+0000 mgr.a (mgr.14355) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:00 smithi131 bash[24745]: cluster 2024-09-14T05:46:58.986366+0000 mgr.a (mgr.14355) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:00 smithi171 bash[25040]: cluster 2024-09-14T05:46:58.986366+0000 mgr.a (mgr.14355) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:02.391 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:02.392 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:02.393 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:02 smithi007 bash[22722]: cluster 2024-09-14T05:47:00.988522+0000 mgr.a (mgr.14355) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:02 smithi131 bash[24745]: cluster 2024-09-14T05:47:00.988522+0000 mgr.a (mgr.14355) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:02 smithi171 bash[25040]: cluster 2024-09-14T05:47:00.988522+0000 mgr.a (mgr.14355) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:03.152 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:03.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:03.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:03.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:03.153 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:04 smithi007 bash[22722]: audit 2024-09-14T05:47:02.716787+0000 mgr.a (mgr.14355) 19293 : audit [DBG] from='client.413469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:04.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:04 smithi007 bash[22722]: cluster 2024-09-14T05:47:02.989216+0000 mgr.a (mgr.14355) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:04 smithi131 bash[24745]: audit 2024-09-14T05:47:02.716787+0000 mgr.a (mgr.14355) 19293 : audit [DBG] from='client.413469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:04 smithi131 bash[24745]: cluster 2024-09-14T05:47:02.989216+0000 mgr.a (mgr.14355) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:04 smithi171 bash[25040]: audit 2024-09-14T05:47:02.716787+0000 mgr.a (mgr.14355) 19293 : audit [DBG] from='client.413469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:04 smithi171 bash[25040]: cluster 2024-09-14T05:47:02.989216+0000 mgr.a (mgr.14355) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:06 smithi131 bash[24745]: cluster 2024-09-14T05:47:04.990122+0000 mgr.a (mgr.14355) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:06 smithi171 bash[25040]: cluster 2024-09-14T05:47:04.990122+0000 mgr.a (mgr.14355) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:06 smithi007 bash[22722]: cluster 2024-09-14T05:47:04.990122+0000 mgr.a (mgr.14355) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:08.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:08 smithi131 bash[24745]: cluster 2024-09-14T05:47:06.992401+0000 mgr.a (mgr.14355) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:08 smithi171 bash[25040]: cluster 2024-09-14T05:47:06.992401+0000 mgr.a (mgr.14355) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:08 smithi007 bash[22722]: cluster 2024-09-14T05:47:06.992401+0000 mgr.a (mgr.14355) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:08.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:10 smithi131 bash[24745]: audit 2024-09-14T05:47:08.486551+0000 mgr.a (mgr.14355) 19297 : audit [DBG] from='client.413544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:10.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:10 smithi131 bash[24745]: cluster 2024-09-14T05:47:08.993372+0000 mgr.a (mgr.14355) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:10 smithi171 bash[25040]: audit 2024-09-14T05:47:08.486551+0000 mgr.a (mgr.14355) 19297 : audit [DBG] from='client.413544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:10 smithi171 bash[25040]: cluster 2024-09-14T05:47:08.993372+0000 mgr.a (mgr.14355) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:10 smithi007 bash[22722]: audit 2024-09-14T05:47:08.486551+0000 mgr.a (mgr.14355) 19297 : audit [DBG] from='client.413544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:10.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:10 smithi007 bash[22722]: cluster 2024-09-14T05:47:08.993372+0000 mgr.a (mgr.14355) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:12 smithi131 bash[24745]: cluster 2024-09-14T05:47:10.995564+0000 mgr.a (mgr.14355) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:12 smithi171 bash[25040]: cluster 2024-09-14T05:47:10.995564+0000 mgr.a (mgr.14355) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:12 smithi007 bash[22722]: cluster 2024-09-14T05:47:10.995564+0000 mgr.a (mgr.14355) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:13.912 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:13.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:13.912 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:14 smithi131 bash[24745]: cluster 2024-09-14T05:47:12.996308+0000 mgr.a (mgr.14355) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:14 smithi171 bash[25040]: cluster 2024-09-14T05:47:12.996308+0000 mgr.a (mgr.14355) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:14.669 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:14.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:14.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:14.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:14.670 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:14 smithi007 bash[22722]: cluster 2024-09-14T05:47:12.996308+0000 mgr.a (mgr.14355) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:15.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:15 smithi131 bash[24745]: audit 2024-09-14T05:47:14.237693+0000 mgr.a (mgr.14355) 19301 : audit [DBG] from='client.413622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:15.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:15 smithi171 bash[25040]: audit 2024-09-14T05:47:14.237693+0000 mgr.a (mgr.14355) 19301 : audit [DBG] from='client.413622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:15 smithi007 bash[22722]: audit 2024-09-14T05:47:14.237693+0000 mgr.a (mgr.14355) 19301 : audit [DBG] from='client.413622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:16 smithi131 bash[24745]: cluster 2024-09-14T05:47:14.997258+0000 mgr.a (mgr.14355) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:16 smithi171 bash[25040]: cluster 2024-09-14T05:47:14.997258+0000 mgr.a (mgr.14355) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:16 smithi007 bash[22722]: cluster 2024-09-14T05:47:14.997258+0000 mgr.a (mgr.14355) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:18 smithi131 bash[24745]: cluster 2024-09-14T05:47:16.999523+0000 mgr.a (mgr.14355) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:18 smithi171 bash[25040]: cluster 2024-09-14T05:47:16.999523+0000 mgr.a (mgr.14355) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:18 smithi007 bash[22722]: cluster 2024-09-14T05:47:16.999523+0000 mgr.a (mgr.14355) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:19.671 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:19.672 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:20.453 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:20.453 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:20 smithi131 bash[24745]: cluster 2024-09-14T05:47:19.000287+0000 mgr.a (mgr.14355) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:20 smithi171 bash[25040]: cluster 2024-09-14T05:47:19.000287+0000 mgr.a (mgr.14355) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:20 smithi007 bash[22722]: cluster 2024-09-14T05:47:19.000287+0000 mgr.a (mgr.14355) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:21.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:21 smithi131 bash[24745]: audit 2024-09-14T05:47:20.003351+0000 mgr.a (mgr.14355) 19305 : audit [DBG] from='client.413700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:21.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:21 smithi171 bash[25040]: audit 2024-09-14T05:47:20.003351+0000 mgr.a (mgr.14355) 19305 : audit [DBG] from='client.413700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:21 smithi007 bash[22722]: audit 2024-09-14T05:47:20.003351+0000 mgr.a (mgr.14355) 19305 : audit [DBG] from='client.413700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:22 smithi131 bash[24745]: cluster 2024-09-14T05:47:21.002840+0000 mgr.a (mgr.14355) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:47:22.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:22 smithi171 bash[25040]: cluster 2024-09-14T05:47:21.002840+0000 mgr.a (mgr.14355) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:47:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:22 smithi007 bash[22722]: cluster 2024-09-14T05:47:21.002840+0000 mgr.a (mgr.14355) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:47:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:24 smithi131 bash[24745]: cluster 2024-09-14T05:47:23.003613+0000 mgr.a (mgr.14355) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:24 smithi171 bash[25040]: cluster 2024-09-14T05:47:23.003613+0000 mgr.a (mgr.14355) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:24 smithi007 bash[22722]: cluster 2024-09-14T05:47:23.003613+0000 mgr.a (mgr.14355) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:25.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:25.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:25.455 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:26.234 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:26.235 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:26.235 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:26 smithi131 bash[24745]: cluster 2024-09-14T05:47:25.004357+0000 mgr.a (mgr.14355) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:26.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:26 smithi171 bash[25040]: cluster 2024-09-14T05:47:25.004357+0000 mgr.a (mgr.14355) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:26 smithi007 bash[22722]: cluster 2024-09-14T05:47:25.004357+0000 mgr.a (mgr.14355) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:47:27.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:27 smithi131 bash[24745]: audit 2024-09-14T05:47:25.793086+0000 mgr.a (mgr.14355) 19309 : audit [DBG] from='client.413778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:27.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:27 smithi171 bash[25040]: audit 2024-09-14T05:47:25.793086+0000 mgr.a (mgr.14355) 19309 : audit [DBG] from='client.413778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:27 smithi007 bash[22722]: audit 2024-09-14T05:47:25.793086+0000 mgr.a (mgr.14355) 19309 : audit [DBG] from='client.413778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:28 smithi131 bash[24745]: cluster 2024-09-14T05:47:27.007201+0000 mgr.a (mgr.14355) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:28 smithi171 bash[25040]: cluster 2024-09-14T05:47:27.007201+0000 mgr.a (mgr.14355) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:28 smithi007 bash[22722]: cluster 2024-09-14T05:47:27.007201+0000 mgr.a (mgr.14355) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:30 smithi131 bash[24745]: cluster 2024-09-14T05:47:29.007970+0000 mgr.a (mgr.14355) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:47:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:30 smithi171 bash[25040]: cluster 2024-09-14T05:47:29.007970+0000 mgr.a (mgr.14355) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:47:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:30 smithi007 bash[22722]: cluster 2024-09-14T05:47:29.007970+0000 mgr.a (mgr.14355) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:47:31.236 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:31.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:31.237 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:31.984 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:31.985 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:32 smithi171 bash[25040]: cluster 2024-09-14T05:47:31.009918+0000 mgr.a (mgr.14355) 19312 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:32 smithi007 bash[22722]: cluster 2024-09-14T05:47:31.009918+0000 mgr.a (mgr.14355) 19312 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:32 smithi131 bash[24745]: cluster 2024-09-14T05:47:31.009918+0000 mgr.a (mgr.14355) 19312 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:33.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:33 smithi171 bash[25040]: audit 2024-09-14T05:47:31.569774+0000 mgr.a (mgr.14355) 19313 : audit [DBG] from='client.413856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:33 smithi007 bash[22722]: audit 2024-09-14T05:47:31.569774+0000 mgr.a (mgr.14355) 19313 : audit [DBG] from='client.413856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:33 smithi131 bash[24745]: audit 2024-09-14T05:47:31.569774+0000 mgr.a (mgr.14355) 19313 : audit [DBG] from='client.413856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:34 smithi171 bash[25040]: cluster 2024-09-14T05:47:33.010870+0000 mgr.a (mgr.14355) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:34 smithi007 bash[22722]: cluster 2024-09-14T05:47:33.010870+0000 mgr.a (mgr.14355) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:34 smithi131 bash[24745]: cluster 2024-09-14T05:47:33.010870+0000 mgr.a (mgr.14355) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:36 smithi007 bash[22722]: cluster 2024-09-14T05:47:35.011645+0000 mgr.a (mgr.14355) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:36 smithi131 bash[24745]: cluster 2024-09-14T05:47:35.011645+0000 mgr.a (mgr.14355) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:36 smithi171 bash[25040]: cluster 2024-09-14T05:47:35.011645+0000 mgr.a (mgr.14355) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:47:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:37.772 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:38 smithi007 bash[22722]: cluster 2024-09-14T05:47:37.013808+0000 mgr.a (mgr.14355) 19316 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:47:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:38 smithi131 bash[24745]: cluster 2024-09-14T05:47:37.013808+0000 mgr.a (mgr.14355) 19316 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:47:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:38 smithi171 bash[25040]: cluster 2024-09-14T05:47:37.013808+0000 mgr.a (mgr.14355) 19316 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:47:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:39 smithi007 bash[22722]: audit 2024-09-14T05:47:37.327813+0000 mgr.a (mgr.14355) 19317 : audit [DBG] from='client.413931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:39 smithi131 bash[24745]: audit 2024-09-14T05:47:37.327813+0000 mgr.a (mgr.14355) 19317 : audit [DBG] from='client.413931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:39 smithi171 bash[25040]: audit 2024-09-14T05:47:37.327813+0000 mgr.a (mgr.14355) 19317 : audit [DBG] from='client.413931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:40 smithi007 bash[22722]: cluster 2024-09-14T05:47:39.014864+0000 mgr.a (mgr.14355) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:40 smithi131 bash[24745]: cluster 2024-09-14T05:47:39.014864+0000 mgr.a (mgr.14355) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:40 smithi171 bash[25040]: cluster 2024-09-14T05:47:39.014864+0000 mgr.a (mgr.14355) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:42 smithi007 bash[22722]: cluster 2024-09-14T05:47:41.017059+0000 mgr.a (mgr.14355) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:42.773 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:42 smithi131 bash[24745]: cluster 2024-09-14T05:47:41.017059+0000 mgr.a (mgr.14355) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:42 smithi171 bash[25040]: cluster 2024-09-14T05:47:41.017059+0000 mgr.a (mgr.14355) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:43.550 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:44 smithi007 bash[22722]: cluster 2024-09-14T05:47:43.017807+0000 mgr.a (mgr.14355) 19320 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:44 smithi007 bash[22722]: audit 2024-09-14T05:47:43.105637+0000 mgr.a (mgr.14355) 19321 : audit [DBG] from='client.414006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:44 smithi131 bash[24745]: cluster 2024-09-14T05:47:43.017807+0000 mgr.a (mgr.14355) 19320 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:44 smithi131 bash[24745]: audit 2024-09-14T05:47:43.105637+0000 mgr.a (mgr.14355) 19321 : audit [DBG] from='client.414006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:44 smithi171 bash[25040]: cluster 2024-09-14T05:47:43.017807+0000 mgr.a (mgr.14355) 19320 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:44 smithi171 bash[25040]: audit 2024-09-14T05:47:43.105637+0000 mgr.a (mgr.14355) 19321 : audit [DBG] from='client.414006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:45 smithi007 bash[22722]: cluster 2024-09-14T05:47:45.018698+0000 mgr.a (mgr.14355) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:45 smithi131 bash[24745]: cluster 2024-09-14T05:47:45.018698+0000 mgr.a (mgr.14355) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:45 smithi171 bash[25040]: cluster 2024-09-14T05:47:45.018698+0000 mgr.a (mgr.14355) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:48.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:48 smithi007 bash[22722]: cluster 2024-09-14T05:47:47.021012+0000 mgr.a (mgr.14355) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:48 smithi131 bash[24745]: cluster 2024-09-14T05:47:47.021012+0000 mgr.a (mgr.14355) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:48 smithi171 bash[25040]: cluster 2024-09-14T05:47:47.021012+0000 mgr.a (mgr.14355) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:48.552 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:48.553 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:49.332 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:49.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:49.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:49.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:49.332 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:50 smithi007 bash[22722]: audit 2024-09-14T05:47:48.895407+0000 mgr.a (mgr.14355) 19324 : audit [DBG] from='client.414081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:50.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:50 smithi007 bash[22722]: cluster 2024-09-14T05:47:49.021609+0000 mgr.a (mgr.14355) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:50 smithi131 bash[24745]: audit 2024-09-14T05:47:48.895407+0000 mgr.a (mgr.14355) 19324 : audit [DBG] from='client.414081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:50 smithi131 bash[24745]: cluster 2024-09-14T05:47:49.021609+0000 mgr.a (mgr.14355) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:50 smithi171 bash[25040]: audit 2024-09-14T05:47:48.895407+0000 mgr.a (mgr.14355) 19324 : audit [DBG] from='client.414081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:50 smithi171 bash[25040]: cluster 2024-09-14T05:47:49.021609+0000 mgr.a (mgr.14355) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:51 smithi007 bash[22722]: audit 2024-09-14T05:47:50.166567+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:47:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:51 smithi007 bash[22722]: audit 2024-09-14T05:47:50.776605+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:51 smithi007 bash[22722]: audit 2024-09-14T05:47:50.787000+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:51 smithi007 bash[22722]: audit 2024-09-14T05:47:50.793511+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:51 smithi007 bash[22722]: audit 2024-09-14T05:47:50.800488+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:51 smithi131 bash[24745]: audit 2024-09-14T05:47:50.166567+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:47:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:51 smithi131 bash[24745]: audit 2024-09-14T05:47:50.776605+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:51 smithi131 bash[24745]: audit 2024-09-14T05:47:50.787000+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:51 smithi131 bash[24745]: audit 2024-09-14T05:47:50.793511+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:51 smithi131 bash[24745]: audit 2024-09-14T05:47:50.800488+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:51 smithi171 bash[25040]: audit 2024-09-14T05:47:50.166567+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:47:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:51 smithi171 bash[25040]: audit 2024-09-14T05:47:50.776605+0000 mon.a (mon.0) 3468 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:51 smithi171 bash[25040]: audit 2024-09-14T05:47:50.787000+0000 mon.a (mon.0) 3469 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:51 smithi171 bash[25040]: audit 2024-09-14T05:47:50.793511+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:51.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:51 smithi171 bash[25040]: audit 2024-09-14T05:47:50.800488+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:52.454 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22972]: debug 2024-09-14T05:47:52.269+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22972]: debug 2024-09-14T05:47:52.273+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22722]: cluster 2024-09-14T05:47:51.023923+0000 mgr.a (mgr.14355) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22722]: audit 2024-09-14T05:47:51.515404+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22722]: audit 2024-09-14T05:47:51.516730+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22722]: audit 2024-09-14T05:47:51.525448+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:52.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:52 smithi007 bash[22722]: audit 2024-09-14T05:47:51.528385+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:52 smithi131 bash[24745]: cluster 2024-09-14T05:47:51.023923+0000 mgr.a (mgr.14355) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:52 smithi131 bash[24745]: audit 2024-09-14T05:47:51.515404+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:47:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:52 smithi131 bash[24745]: audit 2024-09-14T05:47:51.516730+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:47:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:52 smithi131 bash[24745]: audit 2024-09-14T05:47:51.525448+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:52 smithi131 bash[24745]: audit 2024-09-14T05:47:51.528385+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:52 smithi171 bash[25040]: cluster 2024-09-14T05:47:51.023923+0000 mgr.a (mgr.14355) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:47:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:52 smithi171 bash[25040]: audit 2024-09-14T05:47:51.515404+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:47:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:52 smithi171 bash[25040]: audit 2024-09-14T05:47:51.516730+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:47:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:52 smithi171 bash[25040]: audit 2024-09-14T05:47:51.525448+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:47:52.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:52 smithi171 bash[25040]: audit 2024-09-14T05:47:51.528385+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:53.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:53 smithi007 bash[22722]: audit 2024-09-14T05:47:51.530654+0000 mgr.a (mgr.14355) 19327 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:53 smithi007 bash[22722]: audit 2024-09-14T05:47:52.274239+0000 mgr.a (mgr.14355) 19328 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:47:53.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:53 smithi007 bash[22722]: cephadm 2024-09-14T05:47:52.275392+0000 mgr.a (mgr.14355) 19329 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:47:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:53 smithi131 bash[24745]: audit 2024-09-14T05:47:51.530654+0000 mgr.a (mgr.14355) 19327 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:53.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:53 smithi131 bash[24745]: audit 2024-09-14T05:47:52.274239+0000 mgr.a (mgr.14355) 19328 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:47:53.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:53 smithi131 bash[24745]: cephadm 2024-09-14T05:47:52.275392+0000 mgr.a (mgr.14355) 19329 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:47:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:53 smithi171 bash[25040]: audit 2024-09-14T05:47:51.530654+0000 mgr.a (mgr.14355) 19327 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:47:53.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:53 smithi171 bash[25040]: audit 2024-09-14T05:47:52.274239+0000 mgr.a (mgr.14355) 19328 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:47:53.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:53 smithi171 bash[25040]: cephadm 2024-09-14T05:47:52.275392+0000 mgr.a (mgr.14355) 19329 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:47:54.333 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:47:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:47:54.334 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:47:54.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:54 smithi007 bash[22722]: cluster 2024-09-14T05:47:53.024873+0000 mgr.a (mgr.14355) 19330 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:54 smithi131 bash[24745]: cluster 2024-09-14T05:47:53.024873+0000 mgr.a (mgr.14355) 19330 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:54 smithi171 bash[25040]: cluster 2024-09-14T05:47:53.024873+0000 mgr.a (mgr.14355) 19330 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:55.096 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:47:55.096 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:47:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:47:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:47:55.097 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:47:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:56 smithi007 bash[22722]: audit 2024-09-14T05:47:54.664559+0000 mgr.a (mgr.14355) 19331 : audit [DBG] from='client.414267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:56.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:56 smithi007 bash[22722]: cluster 2024-09-14T05:47:55.025449+0000 mgr.a (mgr.14355) 19332 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:56 smithi131 bash[24745]: audit 2024-09-14T05:47:54.664559+0000 mgr.a (mgr.14355) 19331 : audit [DBG] from='client.414267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:56 smithi131 bash[24745]: cluster 2024-09-14T05:47:55.025449+0000 mgr.a (mgr.14355) 19332 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:56 smithi171 bash[25040]: audit 2024-09-14T05:47:54.664559+0000 mgr.a (mgr.14355) 19331 : audit [DBG] from='client.414267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:47:56.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:56 smithi171 bash[25040]: cluster 2024-09-14T05:47:55.025449+0000 mgr.a (mgr.14355) 19332 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:47:58.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:47:58 smithi007 bash[22722]: cluster 2024-09-14T05:47:57.027895+0000 mgr.a (mgr.14355) 19333 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:47:58 smithi131 bash[24745]: cluster 2024-09-14T05:47:57.027895+0000 mgr.a (mgr.14355) 19333 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:47:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:47:58 smithi171 bash[25040]: cluster 2024-09-14T05:47:57.027895+0000 mgr.a (mgr.14355) 19333 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:00.098 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:00.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:00.099 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:00.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:00 smithi007 bash[22722]: cluster 2024-09-14T05:47:59.028877+0000 mgr.a (mgr.14355) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:00 smithi131 bash[24745]: cluster 2024-09-14T05:47:59.028877+0000 mgr.a (mgr.14355) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:00 smithi171 bash[25040]: cluster 2024-09-14T05:47:59.028877+0000 mgr.a (mgr.14355) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:00.885 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:00.885 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:00.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:00.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:00.886 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:02.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:02 smithi007 bash[22722]: audit 2024-09-14T05:48:00.437472+0000 mgr.a (mgr.14355) 19335 : audit [DBG] from='client.414345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:02.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:02 smithi007 bash[22722]: cluster 2024-09-14T05:48:01.031876+0000 mgr.a (mgr.14355) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:02 smithi131 bash[24745]: audit 2024-09-14T05:48:00.437472+0000 mgr.a (mgr.14355) 19335 : audit [DBG] from='client.414345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:02 smithi131 bash[24745]: cluster 2024-09-14T05:48:01.031876+0000 mgr.a (mgr.14355) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:02 smithi171 bash[25040]: audit 2024-09-14T05:48:00.437472+0000 mgr.a (mgr.14355) 19335 : audit [DBG] from='client.414345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:02.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:02 smithi171 bash[25040]: cluster 2024-09-14T05:48:01.031876+0000 mgr.a (mgr.14355) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:04.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:04 smithi007 bash[22722]: cluster 2024-09-14T05:48:03.032704+0000 mgr.a (mgr.14355) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:04.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:04 smithi131 bash[24745]: cluster 2024-09-14T05:48:03.032704+0000 mgr.a (mgr.14355) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:04 smithi171 bash[25040]: cluster 2024-09-14T05:48:03.032704+0000 mgr.a (mgr.14355) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:05.887 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:05.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:05.888 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:06.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:06 smithi007 bash[22722]: cluster 2024-09-14T05:48:05.033479+0000 mgr.a (mgr.14355) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:06.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:06 smithi131 bash[24745]: cluster 2024-09-14T05:48:05.033479+0000 mgr.a (mgr.14355) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:06 smithi171 bash[25040]: cluster 2024-09-14T05:48:05.033479+0000 mgr.a (mgr.14355) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:48:06.658 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:06.658 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:06.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:06.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:06.659 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:07.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:07 smithi007 bash[22722]: audit 2024-09-14T05:48:06.223175+0000 mgr.a (mgr.14355) 19339 : audit [DBG] from='client.414423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:07.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:07 smithi131 bash[24745]: audit 2024-09-14T05:48:06.223175+0000 mgr.a (mgr.14355) 19339 : audit [DBG] from='client.414423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:07.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:07 smithi171 bash[25040]: audit 2024-09-14T05:48:06.223175+0000 mgr.a (mgr.14355) 19339 : audit [DBG] from='client.414423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:08 smithi007 bash[22722]: cluster 2024-09-14T05:48:07.036372+0000 mgr.a (mgr.14355) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:08 smithi131 bash[24745]: cluster 2024-09-14T05:48:07.036372+0000 mgr.a (mgr.14355) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:08 smithi171 bash[25040]: cluster 2024-09-14T05:48:07.036372+0000 mgr.a (mgr.14355) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:10 smithi007 bash[22722]: cluster 2024-09-14T05:48:09.037167+0000 mgr.a (mgr.14355) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:10 smithi131 bash[24745]: cluster 2024-09-14T05:48:09.037167+0000 mgr.a (mgr.14355) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:10 smithi171 bash[25040]: cluster 2024-09-14T05:48:09.037167+0000 mgr.a (mgr.14355) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:12.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:12.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:12.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:12.444 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:12.444 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:12 smithi007 bash[22722]: cluster 2024-09-14T05:48:11.039277+0000 mgr.a (mgr.14355) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:12 smithi131 bash[24745]: cluster 2024-09-14T05:48:11.039277+0000 mgr.a (mgr.14355) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:12 smithi171 bash[25040]: cluster 2024-09-14T05:48:11.039277+0000 mgr.a (mgr.14355) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:13.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:13 smithi007 bash[22722]: audit 2024-09-14T05:48:11.994608+0000 mgr.a (mgr.14355) 19343 : audit [DBG] from='client.414501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:13.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:13 smithi131 bash[24745]: audit 2024-09-14T05:48:11.994608+0000 mgr.a (mgr.14355) 19343 : audit [DBG] from='client.414501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:13.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:13 smithi171 bash[25040]: audit 2024-09-14T05:48:11.994608+0000 mgr.a (mgr.14355) 19343 : audit [DBG] from='client.414501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:14 smithi007 bash[22722]: cluster 2024-09-14T05:48:13.040288+0000 mgr.a (mgr.14355) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:14 smithi131 bash[24745]: cluster 2024-09-14T05:48:13.040288+0000 mgr.a (mgr.14355) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:14 smithi171 bash[25040]: cluster 2024-09-14T05:48:13.040288+0000 mgr.a (mgr.14355) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:16 smithi007 bash[22722]: cluster 2024-09-14T05:48:15.041102+0000 mgr.a (mgr.14355) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:16 smithi131 bash[24745]: cluster 2024-09-14T05:48:15.041102+0000 mgr.a (mgr.14355) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:16 smithi171 bash[25040]: cluster 2024-09-14T05:48:15.041102+0000 mgr.a (mgr.14355) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:17.445 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:17.446 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:18.229 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:18.230 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:18 smithi131 bash[24745]: cluster 2024-09-14T05:48:17.043392+0000 mgr.a (mgr.14355) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:18 smithi171 bash[25040]: cluster 2024-09-14T05:48:17.043392+0000 mgr.a (mgr.14355) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:18 smithi007 bash[22722]: cluster 2024-09-14T05:48:17.043392+0000 mgr.a (mgr.14355) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:19.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:19 smithi131 bash[24745]: audit 2024-09-14T05:48:17.780912+0000 mgr.a (mgr.14355) 19347 : audit [DBG] from='client.414579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:19 smithi171 bash[25040]: audit 2024-09-14T05:48:17.780912+0000 mgr.a (mgr.14355) 19347 : audit [DBG] from='client.414579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:19 smithi007 bash[22722]: audit 2024-09-14T05:48:17.780912+0000 mgr.a (mgr.14355) 19347 : audit [DBG] from='client.414579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:20 smithi131 bash[24745]: cluster 2024-09-14T05:48:19.044378+0000 mgr.a (mgr.14355) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:20 smithi171 bash[25040]: cluster 2024-09-14T05:48:19.044378+0000 mgr.a (mgr.14355) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:20 smithi007 bash[22722]: cluster 2024-09-14T05:48:19.044378+0000 mgr.a (mgr.14355) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:22 smithi131 bash[24745]: cluster 2024-09-14T05:48:21.046588+0000 mgr.a (mgr.14355) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:22 smithi171 bash[25040]: cluster 2024-09-14T05:48:21.046588+0000 mgr.a (mgr.14355) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:22 smithi007 bash[22722]: cluster 2024-09-14T05:48:21.046588+0000 mgr.a (mgr.14355) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:23.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:23.232 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:24.014 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:24 smithi131 bash[24745]: cluster 2024-09-14T05:48:23.047496+0000 mgr.a (mgr.14355) 19350 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:24 smithi171 bash[25040]: cluster 2024-09-14T05:48:23.047496+0000 mgr.a (mgr.14355) 19350 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:24 smithi007 bash[22722]: cluster 2024-09-14T05:48:23.047496+0000 mgr.a (mgr.14355) 19350 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:25.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:25 smithi131 bash[24745]: audit 2024-09-14T05:48:23.562738+0000 mgr.a (mgr.14355) 19351 : audit [DBG] from='client.414657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:25.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:25 smithi171 bash[25040]: audit 2024-09-14T05:48:23.562738+0000 mgr.a (mgr.14355) 19351 : audit [DBG] from='client.414657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:25.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:25 smithi007 bash[22722]: audit 2024-09-14T05:48:23.562738+0000 mgr.a (mgr.14355) 19351 : audit [DBG] from='client.414657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:26 smithi131 bash[24745]: cluster 2024-09-14T05:48:25.048433+0000 mgr.a (mgr.14355) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:26.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:26 smithi171 bash[25040]: cluster 2024-09-14T05:48:25.048433+0000 mgr.a (mgr.14355) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:26 smithi007 bash[22722]: cluster 2024-09-14T05:48:25.048433+0000 mgr.a (mgr.14355) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:28 smithi131 bash[24745]: cluster 2024-09-14T05:48:27.050743+0000 mgr.a (mgr.14355) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:28 smithi171 bash[25040]: cluster 2024-09-14T05:48:27.050743+0000 mgr.a (mgr.14355) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:28 smithi007 bash[22722]: cluster 2024-09-14T05:48:27.050743+0000 mgr.a (mgr.14355) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:29.015 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:29.016 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:29.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:29.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:29.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:29.775 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:29.775 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:30 smithi131 bash[24745]: cluster 2024-09-14T05:48:29.051491+0000 mgr.a (mgr.14355) 19354 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:30 smithi171 bash[25040]: cluster 2024-09-14T05:48:29.051491+0000 mgr.a (mgr.14355) 19354 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:30 smithi007 bash[22722]: cluster 2024-09-14T05:48:29.051491+0000 mgr.a (mgr.14355) 19354 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:31.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:31 smithi131 bash[24745]: audit 2024-09-14T05:48:29.347161+0000 mgr.a (mgr.14355) 19355 : audit [DBG] from='client.414735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:31.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:31 smithi171 bash[25040]: audit 2024-09-14T05:48:29.347161+0000 mgr.a (mgr.14355) 19355 : audit [DBG] from='client.414735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:31.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:31 smithi007 bash[22722]: audit 2024-09-14T05:48:29.347161+0000 mgr.a (mgr.14355) 19355 : audit [DBG] from='client.414735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:32 smithi131 bash[24745]: cluster 2024-09-14T05:48:31.053784+0000 mgr.a (mgr.14355) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:32 smithi171 bash[25040]: cluster 2024-09-14T05:48:31.053784+0000 mgr.a (mgr.14355) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:32 smithi007 bash[22722]: cluster 2024-09-14T05:48:31.053784+0000 mgr.a (mgr.14355) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:48:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:34 smithi131 bash[24745]: cluster 2024-09-14T05:48:33.054565+0000 mgr.a (mgr.14355) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:34 smithi171 bash[25040]: cluster 2024-09-14T05:48:33.054565+0000 mgr.a (mgr.14355) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:34 smithi007 bash[22722]: cluster 2024-09-14T05:48:33.054565+0000 mgr.a (mgr.14355) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:35.525 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:35.526 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:36 smithi131 bash[24745]: cluster 2024-09-14T05:48:35.055274+0000 mgr.a (mgr.14355) 19358 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:36 smithi131 bash[24745]: audit 2024-09-14T05:48:35.108763+0000 mgr.a (mgr.14355) 19359 : audit [DBG] from='client.414813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:36 smithi171 bash[25040]: cluster 2024-09-14T05:48:35.055274+0000 mgr.a (mgr.14355) 19358 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:36.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:36 smithi171 bash[25040]: audit 2024-09-14T05:48:35.108763+0000 mgr.a (mgr.14355) 19359 : audit [DBG] from='client.414813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:36 smithi007 bash[22722]: cluster 2024-09-14T05:48:35.055274+0000 mgr.a (mgr.14355) 19358 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:36.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:36 smithi007 bash[22722]: audit 2024-09-14T05:48:35.108763+0000 mgr.a (mgr.14355) 19359 : audit [DBG] from='client.414813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:38 smithi131 bash[24745]: cluster 2024-09-14T05:48:37.057992+0000 mgr.a (mgr.14355) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:48:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:38 smithi171 bash[25040]: cluster 2024-09-14T05:48:37.057992+0000 mgr.a (mgr.14355) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:48:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:38 smithi007 bash[22722]: cluster 2024-09-14T05:48:37.057992+0000 mgr.a (mgr.14355) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:48:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:40 smithi131 bash[24745]: cluster 2024-09-14T05:48:39.058808+0000 mgr.a (mgr.14355) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:48:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:40 smithi171 bash[25040]: cluster 2024-09-14T05:48:39.058808+0000 mgr.a (mgr.14355) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:48:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:40 smithi007 bash[22722]: cluster 2024-09-14T05:48:39.058808+0000 mgr.a (mgr.14355) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:48:41.293 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:41.294 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:42 smithi131 bash[24745]: audit 2024-09-14T05:48:40.859776+0000 mgr.a (mgr.14355) 19362 : audit [DBG] from='client.414888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:42 smithi131 bash[24745]: cluster 2024-09-14T05:48:41.060199+0000 mgr.a (mgr.14355) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:42 smithi171 bash[25040]: audit 2024-09-14T05:48:40.859776+0000 mgr.a (mgr.14355) 19362 : audit [DBG] from='client.414888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:42.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:42 smithi171 bash[25040]: cluster 2024-09-14T05:48:41.060199+0000 mgr.a (mgr.14355) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:42 smithi007 bash[22722]: audit 2024-09-14T05:48:40.859776+0000 mgr.a (mgr.14355) 19362 : audit [DBG] from='client.414888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:42.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:42 smithi007 bash[22722]: cluster 2024-09-14T05:48:41.060199+0000 mgr.a (mgr.14355) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:44 smithi171 bash[25040]: cluster 2024-09-14T05:48:43.061065+0000 mgr.a (mgr.14355) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:44 smithi007 bash[22722]: cluster 2024-09-14T05:48:43.061065+0000 mgr.a (mgr.14355) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:44 smithi131 bash[24745]: cluster 2024-09-14T05:48:43.061065+0000 mgr.a (mgr.14355) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:48:46.295 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:46.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:46.296 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:46 smithi171 bash[25040]: cluster 2024-09-14T05:48:45.061793+0000 mgr.a (mgr.14355) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:48:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:46 smithi007 bash[22722]: cluster 2024-09-14T05:48:45.061793+0000 mgr.a (mgr.14355) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:48:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:46 smithi131 bash[24745]: cluster 2024-09-14T05:48:45.061793+0000 mgr.a (mgr.14355) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:48:47.067 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:47.068 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:48 smithi171 bash[25040]: audit 2024-09-14T05:48:46.628968+0000 mgr.a (mgr.14355) 19366 : audit [DBG] from='client.414966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:48.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:48 smithi171 bash[25040]: cluster 2024-09-14T05:48:47.063023+0000 mgr.a (mgr.14355) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:48 smithi007 bash[22722]: audit 2024-09-14T05:48:46.628968+0000 mgr.a (mgr.14355) 19366 : audit [DBG] from='client.414966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:48 smithi007 bash[22722]: cluster 2024-09-14T05:48:47.063023+0000 mgr.a (mgr.14355) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:48 smithi131 bash[24745]: audit 2024-09-14T05:48:46.628968+0000 mgr.a (mgr.14355) 19366 : audit [DBG] from='client.414966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:48 smithi131 bash[24745]: cluster 2024-09-14T05:48:47.063023+0000 mgr.a (mgr.14355) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:50 smithi007 bash[22722]: cluster 2024-09-14T05:48:49.063742+0000 mgr.a (mgr.14355) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:48:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:50 smithi131 bash[24745]: cluster 2024-09-14T05:48:49.063742+0000 mgr.a (mgr.14355) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:48:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:50 smithi171 bash[25040]: cluster 2024-09-14T05:48:49.063742+0000 mgr.a (mgr.14355) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-14T05:48:52.069 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:52.070 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:52 smithi007 bash[22722]: cluster 2024-09-14T05:48:51.065701+0000 mgr.a (mgr.14355) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:48:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:52 smithi131 bash[24745]: cluster 2024-09-14T05:48:51.065701+0000 mgr.a (mgr.14355) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:48:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:52 smithi171 bash[25040]: cluster 2024-09-14T05:48:51.065701+0000 mgr.a (mgr.14355) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-14T05:48:52.831 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:52.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22722]: audit 2024-09-14T05:48:52.325931+0000 mon.a (mon.0) 3476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22722]: audit 2024-09-14T05:48:53.176284+0000 mon.a (mon.0) 3477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22722]: audit 2024-09-14T05:48:53.178528+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22722]: audit 2024-09-14T05:48:53.187537+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:48:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22722]: audit 2024-09-14T05:48:53.192346+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:53 smithi131 bash[24745]: audit 2024-09-14T05:48:52.325931+0000 mon.a (mon.0) 3476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:48:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:53 smithi131 bash[24745]: audit 2024-09-14T05:48:53.176284+0000 mon.a (mon.0) 3477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:48:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:53 smithi131 bash[24745]: audit 2024-09-14T05:48:53.178528+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:48:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:53 smithi131 bash[24745]: audit 2024-09-14T05:48:53.187537+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:48:53.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:53 smithi131 bash[24745]: audit 2024-09-14T05:48:53.192346+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:53 smithi171 bash[25040]: audit 2024-09-14T05:48:52.325931+0000 mon.a (mon.0) 3476 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:48:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:53 smithi171 bash[25040]: audit 2024-09-14T05:48:53.176284+0000 mon.a (mon.0) 3477 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:48:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:53 smithi171 bash[25040]: audit 2024-09-14T05:48:53.178528+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:48:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:53 smithi171 bash[25040]: audit 2024-09-14T05:48:53.187537+0000 mon.a (mon.0) 3479 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:48:53.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:53 smithi171 bash[25040]: audit 2024-09-14T05:48:53.192346+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:54.310 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22972]: debug 2024-09-14T05:48:53.952+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:48:54.311 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:48:53 smithi007 bash[22972]: debug 2024-09-14T05:48:53.956+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:48:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:54 smithi007 bash[22722]: audit 2024-09-14T05:48:52.400559+0000 mgr.a (mgr.14355) 19370 : audit [DBG] from='client.415041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:54 smithi007 bash[22722]: cluster 2024-09-14T05:48:53.066607+0000 mgr.a (mgr.14355) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:54 smithi007 bash[22722]: audit 2024-09-14T05:48:53.195086+0000 mgr.a (mgr.14355) 19372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:54 smithi131 bash[24745]: audit 2024-09-14T05:48:52.400559+0000 mgr.a (mgr.14355) 19370 : audit [DBG] from='client.415041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:54 smithi131 bash[24745]: cluster 2024-09-14T05:48:53.066607+0000 mgr.a (mgr.14355) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:54.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:54 smithi131 bash[24745]: audit 2024-09-14T05:48:53.195086+0000 mgr.a (mgr.14355) 19372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:54 smithi171 bash[25040]: audit 2024-09-14T05:48:52.400559+0000 mgr.a (mgr.14355) 19370 : audit [DBG] from='client.415041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:54 smithi171 bash[25040]: cluster 2024-09-14T05:48:53.066607+0000 mgr.a (mgr.14355) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:54.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:54 smithi171 bash[25040]: audit 2024-09-14T05:48:53.195086+0000 mgr.a (mgr.14355) 19372 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:48:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:55 smithi007 bash[22722]: audit 2024-09-14T05:48:53.956950+0000 mgr.a (mgr.14355) 19373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:48:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:55 smithi007 bash[22722]: cephadm 2024-09-14T05:48:53.959115+0000 mgr.a (mgr.14355) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:48:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:55 smithi131 bash[24745]: audit 2024-09-14T05:48:53.956950+0000 mgr.a (mgr.14355) 19373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:48:55.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:55 smithi131 bash[24745]: cephadm 2024-09-14T05:48:53.959115+0000 mgr.a (mgr.14355) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:48:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:55 smithi171 bash[25040]: audit 2024-09-14T05:48:53.956950+0000 mgr.a (mgr.14355) 19373 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:48:55.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:55 smithi171 bash[25040]: cephadm 2024-09-14T05:48:53.959115+0000 mgr.a (mgr.14355) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:48:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:56 smithi007 bash[22722]: cluster 2024-09-14T05:48:55.067493+0000 mgr.a (mgr.14355) 19375 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:56 smithi131 bash[24745]: cluster 2024-09-14T05:48:55.067493+0000 mgr.a (mgr.14355) 19375 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:56 smithi171 bash[25040]: cluster 2024-09-14T05:48:55.067493+0000 mgr.a (mgr.14355) 19375 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:48:57.833 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:48:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:48:57.834 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:48:58.580 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:48:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:48:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:48:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:48:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:48:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:58 smithi007 bash[22722]: cluster 2024-09-14T05:48:57.069747+0000 mgr.a (mgr.14355) 19376 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:58 smithi131 bash[24745]: cluster 2024-09-14T05:48:57.069747+0000 mgr.a (mgr.14355) 19376 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:58 smithi171 bash[25040]: cluster 2024-09-14T05:48:57.069747+0000 mgr.a (mgr.14355) 19376 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:48:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:48:59 smithi007 bash[22722]: audit 2024-09-14T05:48:58.159121+0000 mgr.a (mgr.14355) 19377 : audit [DBG] from='client.415224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:48:59 smithi131 bash[24745]: audit 2024-09-14T05:48:58.159121+0000 mgr.a (mgr.14355) 19377 : audit [DBG] from='client.415224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:48:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:48:59 smithi171 bash[25040]: audit 2024-09-14T05:48:58.159121+0000 mgr.a (mgr.14355) 19377 : audit [DBG] from='client.415224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:00 smithi007 bash[22722]: cluster 2024-09-14T05:48:59.070735+0000 mgr.a (mgr.14355) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:00 smithi131 bash[24745]: cluster 2024-09-14T05:48:59.070735+0000 mgr.a (mgr.14355) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:00 smithi171 bash[25040]: cluster 2024-09-14T05:48:59.070735+0000 mgr.a (mgr.14355) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:02 smithi007 bash[22722]: cluster 2024-09-14T05:49:01.073104+0000 mgr.a (mgr.14355) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:02 smithi131 bash[24745]: cluster 2024-09-14T05:49:01.073104+0000 mgr.a (mgr.14355) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:02 smithi171 bash[25040]: cluster 2024-09-14T05:49:01.073104+0000 mgr.a (mgr.14355) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:03 smithi007 bash[22722]: cluster 2024-09-14T05:49:03.073876+0000 mgr.a (mgr.14355) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:03 smithi131 bash[24745]: cluster 2024-09-14T05:49:03.073876+0000 mgr.a (mgr.14355) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:03 smithi171 bash[25040]: cluster 2024-09-14T05:49:03.073876+0000 mgr.a (mgr.14355) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:04.369 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:04 smithi007 bash[22722]: audit 2024-09-14T05:49:03.914625+0000 mgr.a (mgr.14355) 19381 : audit [DBG] from='client.415299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:04 smithi131 bash[24745]: audit 2024-09-14T05:49:03.914625+0000 mgr.a (mgr.14355) 19381 : audit [DBG] from='client.415299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:04 smithi171 bash[25040]: audit 2024-09-14T05:49:03.914625+0000 mgr.a (mgr.14355) 19381 : audit [DBG] from='client.415299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:05 smithi007 bash[22722]: cluster 2024-09-14T05:49:05.074818+0000 mgr.a (mgr.14355) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:05 smithi131 bash[24745]: cluster 2024-09-14T05:49:05.074818+0000 mgr.a (mgr.14355) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:05 smithi171 bash[25040]: cluster 2024-09-14T05:49:05.074818+0000 mgr.a (mgr.14355) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:08.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:08 smithi007 bash[22722]: cluster 2024-09-14T05:49:07.077496+0000 mgr.a (mgr.14355) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:08.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:08 smithi131 bash[24745]: cluster 2024-09-14T05:49:07.077496+0000 mgr.a (mgr.14355) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:08 smithi171 bash[25040]: cluster 2024-09-14T05:49:07.077496+0000 mgr.a (mgr.14355) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:49:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:10.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:10.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:10.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:10.154 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:10.154 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:10.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:10 smithi007 bash[22722]: cluster 2024-09-14T05:49:09.078318+0000 mgr.a (mgr.14355) 19384 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:10.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:10 smithi131 bash[24745]: cluster 2024-09-14T05:49:09.078318+0000 mgr.a (mgr.14355) 19384 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:10.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:10 smithi171 bash[25040]: cluster 2024-09-14T05:49:09.078318+0000 mgr.a (mgr.14355) 19384 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:11.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:11 smithi007 bash[22722]: audit 2024-09-14T05:49:09.709143+0000 mgr.a (mgr.14355) 19385 : audit [DBG] from='client.415374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:11.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:11 smithi131 bash[24745]: audit 2024-09-14T05:49:09.709143+0000 mgr.a (mgr.14355) 19385 : audit [DBG] from='client.415374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:11.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:11 smithi171 bash[25040]: audit 2024-09-14T05:49:09.709143+0000 mgr.a (mgr.14355) 19385 : audit [DBG] from='client.415374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:12.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:12 smithi007 bash[22722]: cluster 2024-09-14T05:49:11.080559+0000 mgr.a (mgr.14355) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:12.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:12 smithi131 bash[24745]: cluster 2024-09-14T05:49:11.080559+0000 mgr.a (mgr.14355) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:12.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:12 smithi171 bash[25040]: cluster 2024-09-14T05:49:11.080559+0000 mgr.a (mgr.14355) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:14.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:14 smithi007 bash[22722]: cluster 2024-09-14T05:49:13.081327+0000 mgr.a (mgr.14355) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:14.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:14 smithi131 bash[24745]: cluster 2024-09-14T05:49:13.081327+0000 mgr.a (mgr.14355) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:14.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:14 smithi171 bash[25040]: cluster 2024-09-14T05:49:13.081327+0000 mgr.a (mgr.14355) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:15.156 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:15.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:15.156 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:15.912 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:16.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:16 smithi007 bash[22722]: cluster 2024-09-14T05:49:15.082061+0000 mgr.a (mgr.14355) 19388 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:16.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:16 smithi131 bash[24745]: cluster 2024-09-14T05:49:15.082061+0000 mgr.a (mgr.14355) 19388 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:16.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:16 smithi171 bash[25040]: cluster 2024-09-14T05:49:15.082061+0000 mgr.a (mgr.14355) 19388 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:17.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:17 smithi007 bash[22722]: audit 2024-09-14T05:49:15.489824+0000 mgr.a (mgr.14355) 19389 : audit [DBG] from='client.415449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:17.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:17 smithi131 bash[24745]: audit 2024-09-14T05:49:15.489824+0000 mgr.a (mgr.14355) 19389 : audit [DBG] from='client.415449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:17.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:17 smithi171 bash[25040]: audit 2024-09-14T05:49:15.489824+0000 mgr.a (mgr.14355) 19389 : audit [DBG] from='client.415449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:18.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:18 smithi007 bash[22722]: cluster 2024-09-14T05:49:17.084816+0000 mgr.a (mgr.14355) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:18.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:18 smithi131 bash[24745]: cluster 2024-09-14T05:49:17.084816+0000 mgr.a (mgr.14355) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:18.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:18 smithi171 bash[25040]: cluster 2024-09-14T05:49:17.084816+0000 mgr.a (mgr.14355) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:20.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:20 smithi007 bash[22722]: cluster 2024-09-14T05:49:19.085598+0000 mgr.a (mgr.14355) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:20.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:20 smithi131 bash[24745]: cluster 2024-09-14T05:49:19.085598+0000 mgr.a (mgr.14355) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:20 smithi171 bash[25040]: cluster 2024-09-14T05:49:19.085598+0000 mgr.a (mgr.14355) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:20.914 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:20.915 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:21.683 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:21.683 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:22 smithi007 bash[22722]: cluster 2024-09-14T05:49:21.087795+0000 mgr.a (mgr.14355) 19392 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:22.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:22 smithi007 bash[22722]: audit 2024-09-14T05:49:21.250082+0000 mgr.a (mgr.14355) 19393 : audit [DBG] from='client.415527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:22 smithi131 bash[24745]: cluster 2024-09-14T05:49:21.087795+0000 mgr.a (mgr.14355) 19392 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:22.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:22 smithi131 bash[24745]: audit 2024-09-14T05:49:21.250082+0000 mgr.a (mgr.14355) 19393 : audit [DBG] from='client.415527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:22 smithi171 bash[25040]: cluster 2024-09-14T05:49:21.087795+0000 mgr.a (mgr.14355) 19392 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:22.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:22 smithi171 bash[25040]: audit 2024-09-14T05:49:21.250082+0000 mgr.a (mgr.14355) 19393 : audit [DBG] from='client.415527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:24.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:24 smithi007 bash[22722]: cluster 2024-09-14T05:49:23.088654+0000 mgr.a (mgr.14355) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:24.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:24 smithi131 bash[24745]: cluster 2024-09-14T05:49:23.088654+0000 mgr.a (mgr.14355) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:24.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:24 smithi171 bash[25040]: cluster 2024-09-14T05:49:23.088654+0000 mgr.a (mgr.14355) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:49:26.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:26 smithi007 bash[22722]: cluster 2024-09-14T05:49:25.089488+0000 mgr.a (mgr.14355) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:49:26.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:26 smithi131 bash[24745]: cluster 2024-09-14T05:49:25.089488+0000 mgr.a (mgr.14355) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:49:26.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:26 smithi171 bash[25040]: cluster 2024-09-14T05:49:25.089488+0000 mgr.a (mgr.14355) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:49:26.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:26.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:27.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:28 smithi007 bash[22722]: audit 2024-09-14T05:49:27.014896+0000 mgr.a (mgr.14355) 19396 : audit [DBG] from='client.415602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:28.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:28 smithi007 bash[22722]: cluster 2024-09-14T05:49:27.091422+0000 mgr.a (mgr.14355) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:28 smithi131 bash[24745]: audit 2024-09-14T05:49:27.014896+0000 mgr.a (mgr.14355) 19396 : audit [DBG] from='client.415602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:28.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:28 smithi131 bash[24745]: cluster 2024-09-14T05:49:27.091422+0000 mgr.a (mgr.14355) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:28 smithi171 bash[25040]: audit 2024-09-14T05:49:27.014896+0000 mgr.a (mgr.14355) 19396 : audit [DBG] from='client.415602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:28.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:28 smithi171 bash[25040]: cluster 2024-09-14T05:49:27.091422+0000 mgr.a (mgr.14355) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:30.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:30 smithi007 bash[22722]: cluster 2024-09-14T05:49:29.092262+0000 mgr.a (mgr.14355) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:30.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:30 smithi131 bash[24745]: cluster 2024-09-14T05:49:29.092262+0000 mgr.a (mgr.14355) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:30.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:30 smithi171 bash[25040]: cluster 2024-09-14T05:49:29.092262+0000 mgr.a (mgr.14355) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:32.450 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:32.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:32.451 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:32.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:32 smithi007 bash[22722]: cluster 2024-09-14T05:49:31.094489+0000 mgr.a (mgr.14355) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:32.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:32 smithi131 bash[24745]: cluster 2024-09-14T05:49:31.094489+0000 mgr.a (mgr.14355) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:32.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:32 smithi171 bash[25040]: cluster 2024-09-14T05:49:31.094489+0000 mgr.a (mgr.14355) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:33.231 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:33.231 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:34 smithi007 bash[22722]: audit 2024-09-14T05:49:32.784756+0000 mgr.a (mgr.14355) 19400 : audit [DBG] from='client.415680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:34.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:34 smithi007 bash[22722]: cluster 2024-09-14T05:49:33.095071+0000 mgr.a (mgr.14355) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:34 smithi131 bash[24745]: audit 2024-09-14T05:49:32.784756+0000 mgr.a (mgr.14355) 19400 : audit [DBG] from='client.415680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:34.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:34 smithi131 bash[24745]: cluster 2024-09-14T05:49:33.095071+0000 mgr.a (mgr.14355) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:34.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:34 smithi171 bash[25040]: audit 2024-09-14T05:49:32.784756+0000 mgr.a (mgr.14355) 19400 : audit [DBG] from='client.415680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:34.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:34 smithi171 bash[25040]: cluster 2024-09-14T05:49:33.095071+0000 mgr.a (mgr.14355) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:36 smithi131 bash[24745]: cluster 2024-09-14T05:49:35.095896+0000 mgr.a (mgr.14355) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:36 smithi171 bash[25040]: cluster 2024-09-14T05:49:35.095896+0000 mgr.a (mgr.14355) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:36 smithi007 bash[22722]: cluster 2024-09-14T05:49:35.095896+0000 mgr.a (mgr.14355) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:38.232 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:38.233 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:38.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:38 smithi131 bash[24745]: cluster 2024-09-14T05:49:37.098139+0000 mgr.a (mgr.14355) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:38.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:38 smithi171 bash[25040]: cluster 2024-09-14T05:49:37.098139+0000 mgr.a (mgr.14355) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:38 smithi007 bash[22722]: cluster 2024-09-14T05:49:37.098139+0000 mgr.a (mgr.14355) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:39.018 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:39.018 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:39.019 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:40 smithi131 bash[24745]: audit 2024-09-14T05:49:38.567508+0000 mgr.a (mgr.14355) 19404 : audit [DBG] from='client.415758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:40.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:40 smithi131 bash[24745]: cluster 2024-09-14T05:49:39.099116+0000 mgr.a (mgr.14355) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:40 smithi171 bash[25040]: audit 2024-09-14T05:49:38.567508+0000 mgr.a (mgr.14355) 19404 : audit [DBG] from='client.415758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:40.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:40 smithi171 bash[25040]: cluster 2024-09-14T05:49:39.099116+0000 mgr.a (mgr.14355) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:40 smithi007 bash[22722]: audit 2024-09-14T05:49:38.567508+0000 mgr.a (mgr.14355) 19404 : audit [DBG] from='client.415758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:40 smithi007 bash[22722]: cluster 2024-09-14T05:49:39.099116+0000 mgr.a (mgr.14355) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:42 smithi131 bash[24745]: cluster 2024-09-14T05:49:41.101334+0000 mgr.a (mgr.14355) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:42 smithi171 bash[25040]: cluster 2024-09-14T05:49:41.101334+0000 mgr.a (mgr.14355) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:42 smithi007 bash[22722]: cluster 2024-09-14T05:49:41.101334+0000 mgr.a (mgr.14355) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:44.020 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:44.021 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:44 smithi131 bash[24745]: cluster 2024-09-14T05:49:43.102099+0000 mgr.a (mgr.14355) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:44 smithi171 bash[25040]: cluster 2024-09-14T05:49:43.102099+0000 mgr.a (mgr.14355) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:44 smithi007 bash[22722]: cluster 2024-09-14T05:49:43.102099+0000 mgr.a (mgr.14355) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:44.793 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:46 smithi131 bash[24745]: audit 2024-09-14T05:49:44.356364+0000 mgr.a (mgr.14355) 19408 : audit [DBG] from='client.415830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:46 smithi131 bash[24745]: cluster 2024-09-14T05:49:45.102980+0000 mgr.a (mgr.14355) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:46 smithi171 bash[25040]: audit 2024-09-14T05:49:44.356364+0000 mgr.a (mgr.14355) 19408 : audit [DBG] from='client.415830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:46.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:46 smithi171 bash[25040]: cluster 2024-09-14T05:49:45.102980+0000 mgr.a (mgr.14355) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:46 smithi007 bash[22722]: audit 2024-09-14T05:49:44.356364+0000 mgr.a (mgr.14355) 19408 : audit [DBG] from='client.415830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:46 smithi007 bash[22722]: cluster 2024-09-14T05:49:45.102980+0000 mgr.a (mgr.14355) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:48 smithi131 bash[24745]: cluster 2024-09-14T05:49:47.105220+0000 mgr.a (mgr.14355) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:48 smithi171 bash[25040]: cluster 2024-09-14T05:49:47.105220+0000 mgr.a (mgr.14355) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:48 smithi007 bash[22722]: cluster 2024-09-14T05:49:47.105220+0000 mgr.a (mgr.14355) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:49:49.794 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:50 smithi131 bash[24745]: cluster 2024-09-14T05:49:49.105952+0000 mgr.a (mgr.14355) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:50 smithi171 bash[25040]: cluster 2024-09-14T05:49:49.105952+0000 mgr.a (mgr.14355) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:50.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:50.548 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:50.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:50.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:50 smithi007 bash[22722]: cluster 2024-09-14T05:49:49.105952+0000 mgr.a (mgr.14355) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:49:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:51 smithi131 bash[24745]: audit 2024-09-14T05:49:50.133470+0000 mgr.a (mgr.14355) 19412 : audit [DBG] from='client.415908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:51 smithi171 bash[25040]: audit 2024-09-14T05:49:50.133470+0000 mgr.a (mgr.14355) 19412 : audit [DBG] from='client.415908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:51 smithi007 bash[22722]: audit 2024-09-14T05:49:50.133470+0000 mgr.a (mgr.14355) 19412 : audit [DBG] from='client.415908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:52 smithi131 bash[24745]: cluster 2024-09-14T05:49:51.108678+0000 mgr.a (mgr.14355) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:49:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:52 smithi171 bash[25040]: cluster 2024-09-14T05:49:51.108678+0000 mgr.a (mgr.14355) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:49:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:52 smithi007 bash[22722]: cluster 2024-09-14T05:49:51.108678+0000 mgr.a (mgr.14355) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-14T05:49:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:54 smithi131 bash[24745]: cluster 2024-09-14T05:49:53.109470+0000 mgr.a (mgr.14355) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:54 smithi131 bash[24745]: audit 2024-09-14T05:49:54.014956+0000 mon.a (mon.0) 3481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:49:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:54 smithi171 bash[25040]: cluster 2024-09-14T05:49:53.109470+0000 mgr.a (mgr.14355) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:54 smithi171 bash[25040]: audit 2024-09-14T05:49:54.014956+0000 mon.a (mon.0) 3481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:49:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:54 smithi007 bash[22722]: cluster 2024-09-14T05:49:53.109470+0000 mgr.a (mgr.14355) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:54 smithi007 bash[22722]: audit 2024-09-14T05:49:54.014956+0000 mon.a (mon.0) 3481 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:49:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:55 smithi131 bash[24745]: audit 2024-09-14T05:49:54.856050+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:49:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:55 smithi131 bash[24745]: audit 2024-09-14T05:49:54.857458+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:49:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:55 smithi131 bash[24745]: audit 2024-09-14T05:49:54.865985+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:49:55.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:55 smithi131 bash[24745]: audit 2024-09-14T05:49:54.868427+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:55 smithi171 bash[25040]: audit 2024-09-14T05:49:54.856050+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:49:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:55 smithi171 bash[25040]: audit 2024-09-14T05:49:54.857458+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:49:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:55 smithi171 bash[25040]: audit 2024-09-14T05:49:54.865985+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:49:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:55 smithi171 bash[25040]: audit 2024-09-14T05:49:54.868427+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:55.549 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:49:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:49:55.550 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:49:55.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22722]: audit 2024-09-14T05:49:54.856050+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:49:55.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22722]: audit 2024-09-14T05:49:54.857458+0000 mon.a (mon.0) 3483 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:49:55.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22722]: audit 2024-09-14T05:49:54.865985+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:49:55.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22722]: audit 2024-09-14T05:49:54.868427+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:55.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22972]: debug 2024-09-14T05:49:55.619+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:49:55.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:49:55 smithi007 bash[22972]: debug 2024-09-14T05:49:55.619+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:49:56.282 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:49:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:49:56.282 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:49:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:49:56.283 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:49:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:56 smithi131 bash[24745]: audit 2024-09-14T05:49:54.870802+0000 mgr.a (mgr.14355) 19415 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:56 smithi131 bash[24745]: cluster 2024-09-14T05:49:55.110058+0000 mgr.a (mgr.14355) 19416 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:56 smithi171 bash[25040]: audit 2024-09-14T05:49:54.870802+0000 mgr.a (mgr.14355) 19415 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:56 smithi171 bash[25040]: cluster 2024-09-14T05:49:55.110058+0000 mgr.a (mgr.14355) 19416 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:56 smithi007 bash[22722]: audit 2024-09-14T05:49:54.870802+0000 mgr.a (mgr.14355) 19415 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:49:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:56 smithi007 bash[22722]: cluster 2024-09-14T05:49:55.110058+0000 mgr.a (mgr.14355) 19416 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:49:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:57 smithi131 bash[24745]: audit 2024-09-14T05:49:55.624051+0000 mgr.a (mgr.14355) 19417 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:49:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:57 smithi131 bash[24745]: cephadm 2024-09-14T05:49:55.625497+0000 mgr.a (mgr.14355) 19418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:49:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:57 smithi131 bash[24745]: audit 2024-09-14T05:49:55.868296+0000 mgr.a (mgr.14355) 19419 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:57 smithi171 bash[25040]: audit 2024-09-14T05:49:55.624051+0000 mgr.a (mgr.14355) 19417 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:49:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:57 smithi171 bash[25040]: cephadm 2024-09-14T05:49:55.625497+0000 mgr.a (mgr.14355) 19418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:49:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:57 smithi171 bash[25040]: audit 2024-09-14T05:49:55.868296+0000 mgr.a (mgr.14355) 19419 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:57 smithi007 bash[22722]: audit 2024-09-14T05:49:55.624051+0000 mgr.a (mgr.14355) 19417 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:49:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:57 smithi007 bash[22722]: cephadm 2024-09-14T05:49:55.625497+0000 mgr.a (mgr.14355) 19418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:49:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:57 smithi007 bash[22722]: audit 2024-09-14T05:49:55.868296+0000 mgr.a (mgr.14355) 19419 : audit [DBG] from='client.416094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:49:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:49:58 smithi131 bash[24745]: cluster 2024-09-14T05:49:57.112774+0000 mgr.a (mgr.14355) 19420 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:49:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:49:58 smithi171 bash[25040]: cluster 2024-09-14T05:49:57.112774+0000 mgr.a (mgr.14355) 19420 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:49:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:49:58 smithi007 bash[22722]: cluster 2024-09-14T05:49:57.112774+0000 mgr.a (mgr.14355) 19420 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:50:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:00 smithi131 bash[24745]: cluster 2024-09-14T05:49:59.113545+0000 mgr.a (mgr.14355) 19421 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:50:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:00 smithi131 bash[24745]: cluster 2024-09-14T05:50:00.000151+0000 mon.a (mon.0) 3486 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:50:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:00 smithi171 bash[25040]: cluster 2024-09-14T05:49:59.113545+0000 mgr.a (mgr.14355) 19421 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:50:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:00 smithi171 bash[25040]: cluster 2024-09-14T05:50:00.000151+0000 mon.a (mon.0) 3486 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:50:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:00 smithi007 bash[22722]: cluster 2024-09-14T05:49:59.113545+0000 mgr.a (mgr.14355) 19421 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:50:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:00 smithi007 bash[22722]: cluster 2024-09-14T05:50:00.000151+0000 mon.a (mon.0) 3486 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-14T05:50:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:02.074 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:02.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:02.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:02.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:02.074 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:02 smithi131 bash[24745]: cluster 2024-09-14T05:50:01.115505+0000 mgr.a (mgr.14355) 19422 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:02 smithi171 bash[25040]: cluster 2024-09-14T05:50:01.115505+0000 mgr.a (mgr.14355) 19422 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:02 smithi007 bash[22722]: cluster 2024-09-14T05:50:01.115505+0000 mgr.a (mgr.14355) 19422 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:03.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:03 smithi171 bash[25040]: audit 2024-09-14T05:50:01.618013+0000 mgr.a (mgr.14355) 19423 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:03 smithi007 bash[22722]: audit 2024-09-14T05:50:01.618013+0000 mgr.a (mgr.14355) 19423 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:03 smithi131 bash[24745]: audit 2024-09-14T05:50:01.618013+0000 mgr.a (mgr.14355) 19423 : audit [DBG] from='client.416169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:04 smithi171 bash[25040]: cluster 2024-09-14T05:50:03.116563+0000 mgr.a (mgr.14355) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:04 smithi007 bash[22722]: cluster 2024-09-14T05:50:03.116563+0000 mgr.a (mgr.14355) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:04 smithi131 bash[24745]: cluster 2024-09-14T05:50:03.116563+0000 mgr.a (mgr.14355) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:06 smithi171 bash[25040]: cluster 2024-09-14T05:50:05.117376+0000 mgr.a (mgr.14355) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:06 smithi007 bash[22722]: cluster 2024-09-14T05:50:05.117376+0000 mgr.a (mgr.14355) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:06 smithi131 bash[24745]: cluster 2024-09-14T05:50:05.117376+0000 mgr.a (mgr.14355) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:50:07.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:07.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:07.076 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:07.821 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:07.821 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:08 smithi007 bash[22722]: cluster 2024-09-14T05:50:07.119261+0000 mgr.a (mgr.14355) 19426 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:08.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:08 smithi131 bash[24745]: cluster 2024-09-14T05:50:07.119261+0000 mgr.a (mgr.14355) 19426 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:08.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:08 smithi171 bash[25040]: cluster 2024-09-14T05:50:07.119261+0000 mgr.a (mgr.14355) 19426 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:50:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:09 smithi007 bash[22722]: audit 2024-09-14T05:50:07.406605+0000 mgr.a (mgr.14355) 19427 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:09 smithi131 bash[24745]: audit 2024-09-14T05:50:07.406605+0000 mgr.a (mgr.14355) 19427 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:09 smithi171 bash[25040]: audit 2024-09-14T05:50:07.406605+0000 mgr.a (mgr.14355) 19427 : audit [DBG] from='client.416247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:10 smithi007 bash[22722]: cluster 2024-09-14T05:50:09.120262+0000 mgr.a (mgr.14355) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:50:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:10 smithi131 bash[24745]: cluster 2024-09-14T05:50:09.120262+0000 mgr.a (mgr.14355) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:50:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:10 smithi171 bash[25040]: cluster 2024-09-14T05:50:09.120262+0000 mgr.a (mgr.14355) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:50:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:12 smithi007 bash[22722]: cluster 2024-09-14T05:50:11.122705+0000 mgr.a (mgr.14355) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:50:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:12 smithi131 bash[24745]: cluster 2024-09-14T05:50:11.122705+0000 mgr.a (mgr.14355) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:50:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:12 smithi171 bash[25040]: cluster 2024-09-14T05:50:11.122705+0000 mgr.a (mgr.14355) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:50:12.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:12.823 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:13.576 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:13.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:13.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:13.576 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:14 smithi007 bash[22722]: cluster 2024-09-14T05:50:13.123204+0000 mgr.a (mgr.14355) 19430 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:14 smithi007 bash[22722]: audit 2024-09-14T05:50:13.157153+0000 mgr.a (mgr.14355) 19431 : audit [DBG] from='client.416325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:14 smithi131 bash[24745]: cluster 2024-09-14T05:50:13.123204+0000 mgr.a (mgr.14355) 19430 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:14 smithi131 bash[24745]: audit 2024-09-14T05:50:13.157153+0000 mgr.a (mgr.14355) 19431 : audit [DBG] from='client.416325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:14 smithi171 bash[25040]: cluster 2024-09-14T05:50:13.123204+0000 mgr.a (mgr.14355) 19430 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:14 smithi171 bash[25040]: audit 2024-09-14T05:50:13.157153+0000 mgr.a (mgr.14355) 19431 : audit [DBG] from='client.416325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:16 smithi007 bash[22722]: cluster 2024-09-14T05:50:15.124059+0000 mgr.a (mgr.14355) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:16 smithi131 bash[24745]: cluster 2024-09-14T05:50:15.124059+0000 mgr.a (mgr.14355) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:16 smithi171 bash[25040]: cluster 2024-09-14T05:50:15.124059+0000 mgr.a (mgr.14355) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:18.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:18.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:18.578 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:18 smithi007 bash[22722]: cluster 2024-09-14T05:50:17.126323+0000 mgr.a (mgr.14355) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:18 smithi131 bash[24745]: cluster 2024-09-14T05:50:17.126323+0000 mgr.a (mgr.14355) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:18 smithi171 bash[25040]: cluster 2024-09-14T05:50:17.126323+0000 mgr.a (mgr.14355) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:19.324 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:19.324 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:19.325 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:20 smithi007 bash[22722]: audit 2024-09-14T05:50:18.907706+0000 mgr.a (mgr.14355) 19434 : audit [DBG] from='client.416403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:20 smithi007 bash[22722]: cluster 2024-09-14T05:50:19.134289+0000 mgr.a (mgr.14355) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:20 smithi131 bash[24745]: audit 2024-09-14T05:50:18.907706+0000 mgr.a (mgr.14355) 19434 : audit [DBG] from='client.416403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:20 smithi131 bash[24745]: cluster 2024-09-14T05:50:19.134289+0000 mgr.a (mgr.14355) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:20 smithi171 bash[25040]: audit 2024-09-14T05:50:18.907706+0000 mgr.a (mgr.14355) 19434 : audit [DBG] from='client.416403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:20 smithi171 bash[25040]: cluster 2024-09-14T05:50:19.134289+0000 mgr.a (mgr.14355) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:22 smithi007 bash[22722]: cluster 2024-09-14T05:50:21.136651+0000 mgr.a (mgr.14355) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:22 smithi131 bash[24745]: cluster 2024-09-14T05:50:21.136651+0000 mgr.a (mgr.14355) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:22 smithi171 bash[25040]: cluster 2024-09-14T05:50:21.136651+0000 mgr.a (mgr.14355) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:24 smithi007 bash[22722]: cluster 2024-09-14T05:50:23.137433+0000 mgr.a (mgr.14355) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:24 smithi131 bash[24745]: cluster 2024-09-14T05:50:23.137433+0000 mgr.a (mgr.14355) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:24 smithi171 bash[25040]: cluster 2024-09-14T05:50:23.137433+0000 mgr.a (mgr.14355) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:25.077 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:25.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:25.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:25.078 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:26 smithi007 bash[22722]: audit 2024-09-14T05:50:24.655101+0000 mgr.a (mgr.14355) 19438 : audit [DBG] from='client.416475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:26 smithi007 bash[22722]: cluster 2024-09-14T05:50:25.138403+0000 mgr.a (mgr.14355) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:26 smithi131 bash[24745]: audit 2024-09-14T05:50:24.655101+0000 mgr.a (mgr.14355) 19438 : audit [DBG] from='client.416475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:26 smithi131 bash[24745]: cluster 2024-09-14T05:50:25.138403+0000 mgr.a (mgr.14355) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:26 smithi171 bash[25040]: audit 2024-09-14T05:50:24.655101+0000 mgr.a (mgr.14355) 19438 : audit [DBG] from='client.416475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:26 smithi171 bash[25040]: cluster 2024-09-14T05:50:25.138403+0000 mgr.a (mgr.14355) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:28 smithi007 bash[22722]: cluster 2024-09-14T05:50:27.140654+0000 mgr.a (mgr.14355) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:28 smithi131 bash[24745]: cluster 2024-09-14T05:50:27.140654+0000 mgr.a (mgr.14355) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:28 smithi171 bash[25040]: cluster 2024-09-14T05:50:27.140654+0000 mgr.a (mgr.14355) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:30.079 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:30 smithi007 bash[22722]: cluster 2024-09-14T05:50:29.141615+0000 mgr.a (mgr.14355) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:30 smithi131 bash[24745]: cluster 2024-09-14T05:50:29.141615+0000 mgr.a (mgr.14355) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:30 smithi171 bash[25040]: cluster 2024-09-14T05:50:29.141615+0000 mgr.a (mgr.14355) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:30.822 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:30.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:30.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:30.822 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:30.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:32 smithi007 bash[22722]: audit 2024-09-14T05:50:30.407011+0000 mgr.a (mgr.14355) 19442 : audit [DBG] from='client.416550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:32 smithi007 bash[22722]: cluster 2024-09-14T05:50:31.144474+0000 mgr.a (mgr.14355) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:32 smithi131 bash[24745]: audit 2024-09-14T05:50:30.407011+0000 mgr.a (mgr.14355) 19442 : audit [DBG] from='client.416550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:32 smithi131 bash[24745]: cluster 2024-09-14T05:50:31.144474+0000 mgr.a (mgr.14355) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:32 smithi171 bash[25040]: audit 2024-09-14T05:50:30.407011+0000 mgr.a (mgr.14355) 19442 : audit [DBG] from='client.416550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:32 smithi171 bash[25040]: cluster 2024-09-14T05:50:31.144474+0000 mgr.a (mgr.14355) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:34 smithi007 bash[22722]: cluster 2024-09-14T05:50:33.145245+0000 mgr.a (mgr.14355) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:34 smithi131 bash[24745]: cluster 2024-09-14T05:50:33.145245+0000 mgr.a (mgr.14355) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:34 smithi171 bash[25040]: cluster 2024-09-14T05:50:33.145245+0000 mgr.a (mgr.14355) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:35.823 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:35.824 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:36.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:36.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:36.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:36.604 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:36.604 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:36 smithi007 bash[22722]: cluster 2024-09-14T05:50:35.146012+0000 mgr.a (mgr.14355) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:36 smithi131 bash[24745]: cluster 2024-09-14T05:50:35.146012+0000 mgr.a (mgr.14355) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:36 smithi171 bash[25040]: cluster 2024-09-14T05:50:35.146012+0000 mgr.a (mgr.14355) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:37.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:37 smithi007 bash[22722]: audit 2024-09-14T05:50:36.160058+0000 mgr.a (mgr.14355) 19446 : audit [DBG] from='client.416625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:37 smithi131 bash[24745]: audit 2024-09-14T05:50:36.160058+0000 mgr.a (mgr.14355) 19446 : audit [DBG] from='client.416625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:37 smithi171 bash[25040]: audit 2024-09-14T05:50:36.160058+0000 mgr.a (mgr.14355) 19446 : audit [DBG] from='client.416625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:38 smithi007 bash[22722]: cluster 2024-09-14T05:50:37.148948+0000 mgr.a (mgr.14355) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:38 smithi131 bash[24745]: cluster 2024-09-14T05:50:37.148948+0000 mgr.a (mgr.14355) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:38 smithi171 bash[25040]: cluster 2024-09-14T05:50:37.148948+0000 mgr.a (mgr.14355) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:39 smithi007 bash[22722]: cluster 2024-09-14T05:50:39.149807+0000 mgr.a (mgr.14355) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:39 smithi131 bash[24745]: cluster 2024-09-14T05:50:39.149807+0000 mgr.a (mgr.14355) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:39 smithi171 bash[25040]: cluster 2024-09-14T05:50:39.149807+0000 mgr.a (mgr.14355) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:50:41.605 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:41.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:41.606 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:42.367 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:42 smithi131 bash[24745]: cluster 2024-09-14T05:50:41.151750+0000 mgr.a (mgr.14355) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:42 smithi171 bash[25040]: cluster 2024-09-14T05:50:41.151750+0000 mgr.a (mgr.14355) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:42 smithi007 bash[22722]: cluster 2024-09-14T05:50:41.151750+0000 mgr.a (mgr.14355) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:43 smithi131 bash[24745]: audit 2024-09-14T05:50:41.940019+0000 mgr.a (mgr.14355) 19450 : audit [DBG] from='client.416700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:43 smithi171 bash[25040]: audit 2024-09-14T05:50:41.940019+0000 mgr.a (mgr.14355) 19450 : audit [DBG] from='client.416700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:43 smithi007 bash[22722]: audit 2024-09-14T05:50:41.940019+0000 mgr.a (mgr.14355) 19450 : audit [DBG] from='client.416700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:44.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:44 smithi131 bash[24745]: cluster 2024-09-14T05:50:43.152709+0000 mgr.a (mgr.14355) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:44.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:44 smithi171 bash[25040]: cluster 2024-09-14T05:50:43.152709+0000 mgr.a (mgr.14355) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:44 smithi007 bash[22722]: cluster 2024-09-14T05:50:43.152709+0000 mgr.a (mgr.14355) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:46 smithi131 bash[24745]: cluster 2024-09-14T05:50:45.153492+0000 mgr.a (mgr.14355) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:46.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:46 smithi171 bash[25040]: cluster 2024-09-14T05:50:45.153492+0000 mgr.a (mgr.14355) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:46 smithi007 bash[22722]: cluster 2024-09-14T05:50:45.153492+0000 mgr.a (mgr.14355) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:47.369 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:47.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:47.370 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:48.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:48 smithi131 bash[24745]: cluster 2024-09-14T05:50:47.155729+0000 mgr.a (mgr.14355) 19453 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:48 smithi171 bash[25040]: cluster 2024-09-14T05:50:47.155729+0000 mgr.a (mgr.14355) 19453 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:48 smithi007 bash[22722]: cluster 2024-09-14T05:50:47.155729+0000 mgr.a (mgr.14355) 19453 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:49 smithi131 bash[24745]: audit 2024-09-14T05:50:47.703299+0000 mgr.a (mgr.14355) 19454 : audit [DBG] from='client.416775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:49 smithi171 bash[25040]: audit 2024-09-14T05:50:47.703299+0000 mgr.a (mgr.14355) 19454 : audit [DBG] from='client.416775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:49 smithi007 bash[22722]: audit 2024-09-14T05:50:47.703299+0000 mgr.a (mgr.14355) 19454 : audit [DBG] from='client.416775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:50 smithi131 bash[24745]: cluster 2024-09-14T05:50:49.156805+0000 mgr.a (mgr.14355) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:50 smithi171 bash[25040]: cluster 2024-09-14T05:50:49.156805+0000 mgr.a (mgr.14355) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:50 smithi007 bash[22722]: cluster 2024-09-14T05:50:49.156805+0000 mgr.a (mgr.14355) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:52 smithi131 bash[24745]: cluster 2024-09-14T05:50:51.159195+0000 mgr.a (mgr.14355) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:52 smithi171 bash[25040]: cluster 2024-09-14T05:50:51.159195+0000 mgr.a (mgr.14355) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:52 smithi007 bash[22722]: cluster 2024-09-14T05:50:51.159195+0000 mgr.a (mgr.14355) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:53.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:53.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:53.150 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:53.891 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:50:53.891 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:53.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:53.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:53.892 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:54 smithi131 bash[24745]: cluster 2024-09-14T05:50:53.159882+0000 mgr.a (mgr.14355) 19457 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:54 smithi171 bash[25040]: cluster 2024-09-14T05:50:53.159882+0000 mgr.a (mgr.14355) 19457 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:54 smithi007 bash[22722]: cluster 2024-09-14T05:50:53.159882+0000 mgr.a (mgr.14355) 19457 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:55.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:55 smithi131 bash[24745]: audit 2024-09-14T05:50:53.475375+0000 mgr.a (mgr.14355) 19458 : audit [DBG] from='client.416853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:55.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:55 smithi171 bash[25040]: audit 2024-09-14T05:50:53.475375+0000 mgr.a (mgr.14355) 19458 : audit [DBG] from='client.416853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:55 smithi007 bash[22722]: audit 2024-09-14T05:50:53.475375+0000 mgr.a (mgr.14355) 19458 : audit [DBG] from='client.416853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:50:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:56 smithi131 bash[24745]: cluster 2024-09-14T05:50:55.160874+0000 mgr.a (mgr.14355) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:56 smithi131 bash[24745]: audit 2024-09-14T05:50:55.676950+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:50:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:56 smithi171 bash[25040]: cluster 2024-09-14T05:50:55.160874+0000 mgr.a (mgr.14355) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:56 smithi171 bash[25040]: audit 2024-09-14T05:50:55.676950+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:50:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:56 smithi007 bash[22722]: cluster 2024-09-14T05:50:55.160874+0000 mgr.a (mgr.14355) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:50:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:56 smithi007 bash[22722]: audit 2024-09-14T05:50:55.676950+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:50:57.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:57 smithi131 bash[24745]: audit 2024-09-14T05:50:56.515832+0000 mon.a (mon.0) 3488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:50:57.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:57 smithi131 bash[24745]: audit 2024-09-14T05:50:56.517745+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:50:57.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:57 smithi131 bash[24745]: audit 2024-09-14T05:50:56.527158+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:50:57.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:57 smithi131 bash[24745]: audit 2024-09-14T05:50:56.532574+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:57 smithi171 bash[25040]: audit 2024-09-14T05:50:56.515832+0000 mon.a (mon.0) 3488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:50:57.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:57 smithi171 bash[25040]: audit 2024-09-14T05:50:56.517745+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:50:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:57 smithi171 bash[25040]: audit 2024-09-14T05:50:56.527158+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:50:57.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:57 smithi171 bash[25040]: audit 2024-09-14T05:50:56.532574+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:57.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22972]: debug 2024-09-14T05:50:57.286+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:50:57.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22972]: debug 2024-09-14T05:50:57.286+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:50:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22722]: audit 2024-09-14T05:50:56.515832+0000 mon.a (mon.0) 3488 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:50:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22722]: audit 2024-09-14T05:50:56.517745+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:50:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22722]: audit 2024-09-14T05:50:56.527158+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:50:57.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:57 smithi007 bash[22722]: audit 2024-09-14T05:50:56.532574+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:58.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:58 smithi131 bash[24745]: audit 2024-09-14T05:50:56.534198+0000 mgr.a (mgr.14355) 19460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:58 smithi131 bash[24745]: cluster 2024-09-14T05:50:57.162330+0000 mgr.a (mgr.14355) 19461 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:58 smithi131 bash[24745]: audit 2024-09-14T05:50:57.292299+0000 mgr.a (mgr.14355) 19462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:50:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:50:58 smithi131 bash[24745]: cephadm 2024-09-14T05:50:57.293514+0000 mgr.a (mgr.14355) 19463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:50:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:58 smithi171 bash[25040]: audit 2024-09-14T05:50:56.534198+0000 mgr.a (mgr.14355) 19460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:58.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:58 smithi171 bash[25040]: cluster 2024-09-14T05:50:57.162330+0000 mgr.a (mgr.14355) 19461 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:58 smithi171 bash[25040]: audit 2024-09-14T05:50:57.292299+0000 mgr.a (mgr.14355) 19462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:50:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:50:58 smithi171 bash[25040]: cephadm 2024-09-14T05:50:57.293514+0000 mgr.a (mgr.14355) 19463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:50:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:58 smithi007 bash[22722]: audit 2024-09-14T05:50:56.534198+0000 mgr.a (mgr.14355) 19460 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:50:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:58 smithi007 bash[22722]: cluster 2024-09-14T05:50:57.162330+0000 mgr.a (mgr.14355) 19461 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:50:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:58 smithi007 bash[22722]: audit 2024-09-14T05:50:57.292299+0000 mgr.a (mgr.14355) 19462 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:50:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:50:58 smithi007 bash[22722]: cephadm 2024-09-14T05:50:57.293514+0000 mgr.a (mgr.14355) 19463 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:50:58.893 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:50:58.893 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:50:58.894 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:50:59.646 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:50:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:50:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:50:59.647 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:50:59.647 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:00 smithi131 bash[24745]: cluster 2024-09-14T05:50:59.162803+0000 mgr.a (mgr.14355) 19464 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:00.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:00 smithi131 bash[24745]: audit 2024-09-14T05:50:59.224444+0000 mgr.a (mgr.14355) 19465 : audit [DBG] from='client.417036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:00 smithi171 bash[25040]: cluster 2024-09-14T05:50:59.162803+0000 mgr.a (mgr.14355) 19464 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:00.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:00 smithi171 bash[25040]: audit 2024-09-14T05:50:59.224444+0000 mgr.a (mgr.14355) 19465 : audit [DBG] from='client.417036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:00 smithi007 bash[22722]: cluster 2024-09-14T05:50:59.162803+0000 mgr.a (mgr.14355) 19464 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:00 smithi007 bash[22722]: audit 2024-09-14T05:50:59.224444+0000 mgr.a (mgr.14355) 19465 : audit [DBG] from='client.417036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:02.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:02 smithi131 bash[24745]: cluster 2024-09-14T05:51:01.165100+0000 mgr.a (mgr.14355) 19466 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:02 smithi171 bash[25040]: cluster 2024-09-14T05:51:01.165100+0000 mgr.a (mgr.14355) 19466 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:02 smithi007 bash[22722]: cluster 2024-09-14T05:51:01.165100+0000 mgr.a (mgr.14355) 19466 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:04.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:04 smithi171 bash[25040]: cluster 2024-09-14T05:51:03.165869+0000 mgr.a (mgr.14355) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:04.648 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:04.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:04.649 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:04 smithi007 bash[22722]: cluster 2024-09-14T05:51:03.165869+0000 mgr.a (mgr.14355) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:04 smithi131 bash[24745]: cluster 2024-09-14T05:51:03.165869+0000 mgr.a (mgr.14355) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:05.434 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:06.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:06 smithi171 bash[25040]: audit 2024-09-14T05:51:04.987902+0000 mgr.a (mgr.14355) 19468 : audit [DBG] from='client.417111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:06.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:06 smithi171 bash[25040]: cluster 2024-09-14T05:51:05.166604+0000 mgr.a (mgr.14355) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:06 smithi007 bash[22722]: audit 2024-09-14T05:51:04.987902+0000 mgr.a (mgr.14355) 19468 : audit [DBG] from='client.417111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:06 smithi007 bash[22722]: cluster 2024-09-14T05:51:05.166604+0000 mgr.a (mgr.14355) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:06 smithi131 bash[24745]: audit 2024-09-14T05:51:04.987902+0000 mgr.a (mgr.14355) 19468 : audit [DBG] from='client.417111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:06 smithi131 bash[24745]: cluster 2024-09-14T05:51:05.166604+0000 mgr.a (mgr.14355) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:08 smithi171 bash[25040]: cluster 2024-09-14T05:51:07.168993+0000 mgr.a (mgr.14355) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:08 smithi007 bash[22722]: cluster 2024-09-14T05:51:07.168993+0000 mgr.a (mgr.14355) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:08 smithi131 bash[24745]: cluster 2024-09-14T05:51:07.168993+0000 mgr.a (mgr.14355) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:10.435 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:10.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:10.436 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:10 smithi007 bash[22722]: cluster 2024-09-14T05:51:09.169714+0000 mgr.a (mgr.14355) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:51:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:10 smithi131 bash[24745]: cluster 2024-09-14T05:51:09.169714+0000 mgr.a (mgr.14355) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:51:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:10 smithi171 bash[25040]: cluster 2024-09-14T05:51:09.169714+0000 mgr.a (mgr.14355) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:51:11.213 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:11.213 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:11.214 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:12 smithi007 bash[22722]: audit 2024-09-14T05:51:10.771441+0000 mgr.a (mgr.14355) 19472 : audit [DBG] from='client.417189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:12.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:12 smithi007 bash[22722]: cluster 2024-09-14T05:51:11.171102+0000 mgr.a (mgr.14355) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:12 smithi131 bash[24745]: audit 2024-09-14T05:51:10.771441+0000 mgr.a (mgr.14355) 19472 : audit [DBG] from='client.417189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:12 smithi131 bash[24745]: cluster 2024-09-14T05:51:11.171102+0000 mgr.a (mgr.14355) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:12 smithi171 bash[25040]: audit 2024-09-14T05:51:10.771441+0000 mgr.a (mgr.14355) 19472 : audit [DBG] from='client.417189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:12 smithi171 bash[25040]: cluster 2024-09-14T05:51:11.171102+0000 mgr.a (mgr.14355) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:51:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:14 smithi007 bash[22722]: cluster 2024-09-14T05:51:13.171958+0000 mgr.a (mgr.14355) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:14 smithi131 bash[24745]: cluster 2024-09-14T05:51:13.171958+0000 mgr.a (mgr.14355) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:14.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:14 smithi171 bash[25040]: cluster 2024-09-14T05:51:13.171958+0000 mgr.a (mgr.14355) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:16.215 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:16.216 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:16 smithi007 bash[22722]: cluster 2024-09-14T05:51:15.172928+0000 mgr.a (mgr.14355) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:16 smithi131 bash[24745]: cluster 2024-09-14T05:51:15.172928+0000 mgr.a (mgr.14355) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:16 smithi171 bash[25040]: cluster 2024-09-14T05:51:15.172928+0000 mgr.a (mgr.14355) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:16.966 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:16.966 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:18 smithi007 bash[22722]: audit 2024-09-14T05:51:16.547900+0000 mgr.a (mgr.14355) 19476 : audit [DBG] from='client.417267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:18 smithi007 bash[22722]: cluster 2024-09-14T05:51:17.175778+0000 mgr.a (mgr.14355) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:18 smithi131 bash[24745]: audit 2024-09-14T05:51:16.547900+0000 mgr.a (mgr.14355) 19476 : audit [DBG] from='client.417267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:18 smithi131 bash[24745]: cluster 2024-09-14T05:51:17.175778+0000 mgr.a (mgr.14355) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:18 smithi171 bash[25040]: audit 2024-09-14T05:51:16.547900+0000 mgr.a (mgr.14355) 19476 : audit [DBG] from='client.417267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:18 smithi171 bash[25040]: cluster 2024-09-14T05:51:17.175778+0000 mgr.a (mgr.14355) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:20 smithi007 bash[22722]: cluster 2024-09-14T05:51:19.176734+0000 mgr.a (mgr.14355) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:51:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:20 smithi131 bash[24745]: cluster 2024-09-14T05:51:19.176734+0000 mgr.a (mgr.14355) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:51:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:20 smithi171 bash[25040]: cluster 2024-09-14T05:51:19.176734+0000 mgr.a (mgr.14355) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:51:21.967 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:21.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:21.968 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:22 smithi007 bash[22722]: cluster 2024-09-14T05:51:21.178895+0000 mgr.a (mgr.14355) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:51:22.741 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:22 smithi131 bash[24745]: cluster 2024-09-14T05:51:21.178895+0000 mgr.a (mgr.14355) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:51:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:22 smithi171 bash[25040]: cluster 2024-09-14T05:51:21.178895+0000 mgr.a (mgr.14355) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:51:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:23 smithi007 bash[22722]: audit 2024-09-14T05:51:22.301723+0000 mgr.a (mgr.14355) 19480 : audit [DBG] from='client.417345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:23 smithi131 bash[24745]: audit 2024-09-14T05:51:22.301723+0000 mgr.a (mgr.14355) 19480 : audit [DBG] from='client.417345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:23 smithi171 bash[25040]: audit 2024-09-14T05:51:22.301723+0000 mgr.a (mgr.14355) 19480 : audit [DBG] from='client.417345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:24 smithi007 bash[22722]: cluster 2024-09-14T05:51:23.179898+0000 mgr.a (mgr.14355) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:24 smithi131 bash[24745]: cluster 2024-09-14T05:51:23.179898+0000 mgr.a (mgr.14355) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:24 smithi171 bash[25040]: cluster 2024-09-14T05:51:23.179898+0000 mgr.a (mgr.14355) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:26 smithi007 bash[22722]: cluster 2024-09-14T05:51:25.180666+0000 mgr.a (mgr.14355) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:26 smithi131 bash[24745]: cluster 2024-09-14T05:51:25.180666+0000 mgr.a (mgr.14355) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:26 smithi171 bash[25040]: cluster 2024-09-14T05:51:25.180666+0000 mgr.a (mgr.14355) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:27.742 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:27.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:27.743 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:28.506 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:28.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:28.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:28.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:28.506 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:28 smithi007 bash[22722]: cluster 2024-09-14T05:51:27.182899+0000 mgr.a (mgr.14355) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:28 smithi131 bash[24745]: cluster 2024-09-14T05:51:27.182899+0000 mgr.a (mgr.14355) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:28 smithi171 bash[25040]: cluster 2024-09-14T05:51:27.182899+0000 mgr.a (mgr.14355) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:29.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:29 smithi007 bash[22722]: audit 2024-09-14T05:51:28.077150+0000 mgr.a (mgr.14355) 19484 : audit [DBG] from='client.417423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:29 smithi131 bash[24745]: audit 2024-09-14T05:51:28.077150+0000 mgr.a (mgr.14355) 19484 : audit [DBG] from='client.417423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:29 smithi171 bash[25040]: audit 2024-09-14T05:51:28.077150+0000 mgr.a (mgr.14355) 19484 : audit [DBG] from='client.417423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:30 smithi007 bash[22722]: cluster 2024-09-14T05:51:29.183882+0000 mgr.a (mgr.14355) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:30 smithi131 bash[24745]: cluster 2024-09-14T05:51:29.183882+0000 mgr.a (mgr.14355) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:30 smithi171 bash[25040]: cluster 2024-09-14T05:51:29.183882+0000 mgr.a (mgr.14355) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:32 smithi007 bash[22722]: cluster 2024-09-14T05:51:31.186100+0000 mgr.a (mgr.14355) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:32 smithi131 bash[24745]: cluster 2024-09-14T05:51:31.186100+0000 mgr.a (mgr.14355) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:32 smithi171 bash[25040]: cluster 2024-09-14T05:51:31.186100+0000 mgr.a (mgr.14355) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:33.507 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:34.257 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:34.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:34 smithi007 bash[22722]: cluster 2024-09-14T05:51:33.186876+0000 mgr.a (mgr.14355) 19487 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:34 smithi131 bash[24745]: cluster 2024-09-14T05:51:33.186876+0000 mgr.a (mgr.14355) 19487 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:34 smithi171 bash[25040]: cluster 2024-09-14T05:51:33.186876+0000 mgr.a (mgr.14355) 19487 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:35 smithi007 bash[22722]: audit 2024-09-14T05:51:33.837816+0000 mgr.a (mgr.14355) 19488 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:35 smithi131 bash[24745]: audit 2024-09-14T05:51:33.837816+0000 mgr.a (mgr.14355) 19488 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:35 smithi171 bash[25040]: audit 2024-09-14T05:51:33.837816+0000 mgr.a (mgr.14355) 19488 : audit [DBG] from='client.417501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:36 smithi007 bash[22722]: cluster 2024-09-14T05:51:35.188757+0000 mgr.a (mgr.14355) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:51:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:36 smithi131 bash[24745]: cluster 2024-09-14T05:51:35.188757+0000 mgr.a (mgr.14355) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:51:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:36 smithi171 bash[25040]: cluster 2024-09-14T05:51:35.188757+0000 mgr.a (mgr.14355) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-14T05:51:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:38 smithi007 bash[22722]: cluster 2024-09-14T05:51:37.189988+0000 mgr.a (mgr.14355) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:38 smithi131 bash[24745]: cluster 2024-09-14T05:51:37.189988+0000 mgr.a (mgr.14355) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:38 smithi171 bash[25040]: cluster 2024-09-14T05:51:37.189988+0000 mgr.a (mgr.14355) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:39.259 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:39.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:39.260 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:40.001 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:40.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:40.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:40.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:40.001 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:40 smithi007 bash[22722]: cluster 2024-09-14T05:51:39.190787+0000 mgr.a (mgr.14355) 19491 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:40 smithi131 bash[24745]: cluster 2024-09-14T05:51:39.190787+0000 mgr.a (mgr.14355) 19491 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:40 smithi171 bash[25040]: cluster 2024-09-14T05:51:39.190787+0000 mgr.a (mgr.14355) 19491 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:41.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:41 smithi007 bash[22722]: audit 2024-09-14T05:51:39.587172+0000 mgr.a (mgr.14355) 19492 : audit [DBG] from='client.417579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:41 smithi131 bash[24745]: audit 2024-09-14T05:51:39.587172+0000 mgr.a (mgr.14355) 19492 : audit [DBG] from='client.417579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:41 smithi171 bash[25040]: audit 2024-09-14T05:51:39.587172+0000 mgr.a (mgr.14355) 19492 : audit [DBG] from='client.417579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:42 smithi007 bash[22722]: cluster 2024-09-14T05:51:41.193172+0000 mgr.a (mgr.14355) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:42 smithi131 bash[24745]: cluster 2024-09-14T05:51:41.193172+0000 mgr.a (mgr.14355) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:42 smithi171 bash[25040]: cluster 2024-09-14T05:51:41.193172+0000 mgr.a (mgr.14355) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:51:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:43 smithi007 bash[22722]: cluster 2024-09-14T05:51:43.193930+0000 mgr.a (mgr.14355) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:43 smithi131 bash[24745]: cluster 2024-09-14T05:51:43.193930+0000 mgr.a (mgr.14355) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:43 smithi171 bash[25040]: cluster 2024-09-14T05:51:43.193930+0000 mgr.a (mgr.14355) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:45.002 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:45.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:45.003 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:45.753 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:45.753 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:46.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:46 smithi131 bash[24745]: cluster 2024-09-14T05:51:45.195421+0000 mgr.a (mgr.14355) 19495 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:46.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:46 smithi131 bash[24745]: audit 2024-09-14T05:51:45.338559+0000 mgr.a (mgr.14355) 19496 : audit [DBG] from='client.417651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:46.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:46 smithi171 bash[25040]: cluster 2024-09-14T05:51:45.195421+0000 mgr.a (mgr.14355) 19495 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:46.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:46 smithi171 bash[25040]: audit 2024-09-14T05:51:45.338559+0000 mgr.a (mgr.14355) 19496 : audit [DBG] from='client.417651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:46 smithi007 bash[22722]: cluster 2024-09-14T05:51:45.195421+0000 mgr.a (mgr.14355) 19495 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:46 smithi007 bash[22722]: audit 2024-09-14T05:51:45.338559+0000 mgr.a (mgr.14355) 19496 : audit [DBG] from='client.417651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:48 smithi131 bash[24745]: cluster 2024-09-14T05:51:47.197098+0000 mgr.a (mgr.14355) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:51:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:48 smithi171 bash[25040]: cluster 2024-09-14T05:51:47.197098+0000 mgr.a (mgr.14355) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:51:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:48 smithi007 bash[22722]: cluster 2024-09-14T05:51:47.197098+0000 mgr.a (mgr.14355) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-14T05:51:50.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:50 smithi131 bash[24745]: cluster 2024-09-14T05:51:49.197897+0000 mgr.a (mgr.14355) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:50.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:50 smithi171 bash[25040]: cluster 2024-09-14T05:51:49.197897+0000 mgr.a (mgr.14355) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:50 smithi007 bash[22722]: cluster 2024-09-14T05:51:49.197897+0000 mgr.a (mgr.14355) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:50.754 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:50.755 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:51.493 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:51.493 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:51.494 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:52.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:52 smithi131 bash[24745]: audit 2024-09-14T05:51:51.082705+0000 mgr.a (mgr.14355) 19499 : audit [DBG] from='client.417729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:52.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:52 smithi131 bash[24745]: cluster 2024-09-14T05:51:51.199154+0000 mgr.a (mgr.14355) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:52 smithi171 bash[25040]: audit 2024-09-14T05:51:51.082705+0000 mgr.a (mgr.14355) 19499 : audit [DBG] from='client.417729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:52.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:52 smithi171 bash[25040]: cluster 2024-09-14T05:51:51.199154+0000 mgr.a (mgr.14355) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:52 smithi007 bash[22722]: audit 2024-09-14T05:51:51.082705+0000 mgr.a (mgr.14355) 19499 : audit [DBG] from='client.417729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:52 smithi007 bash[22722]: cluster 2024-09-14T05:51:51.199154+0000 mgr.a (mgr.14355) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:54.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:54 smithi131 bash[24745]: cluster 2024-09-14T05:51:53.199948+0000 mgr.a (mgr.14355) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:54.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:54 smithi171 bash[25040]: cluster 2024-09-14T05:51:53.199948+0000 mgr.a (mgr.14355) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:54 smithi007 bash[22722]: cluster 2024-09-14T05:51:53.199948+0000 mgr.a (mgr.14355) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:51:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:51:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:51:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:51:56.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:56 smithi131 bash[24745]: cluster 2024-09-14T05:51:55.202193+0000 mgr.a (mgr.14355) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:51:56.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:56 smithi171 bash[25040]: cluster 2024-09-14T05:51:55.202193+0000 mgr.a (mgr.14355) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:51:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:56 smithi007 bash[22722]: cluster 2024-09-14T05:51:55.202193+0000 mgr.a (mgr.14355) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-14T05:51:57.240 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:51:57.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:51:57.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:51:57.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:51:57.240 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:56.825086+0000 mgr.a (mgr.14355) 19503 : audit [DBG] from='client.417801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: cluster 2024-09-14T05:51:57.203265+0000 mgr.a (mgr.14355) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:57.352756+0000 mon.a (mon.0) 3492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:58.189974+0000 mon.a (mon.0) 3493 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:58.191704+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:58.201663+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:51:58.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:58 smithi131 bash[24745]: audit 2024-09-14T05:51:58.206460+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:56.825086+0000 mgr.a (mgr.14355) 19503 : audit [DBG] from='client.417801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: cluster 2024-09-14T05:51:57.203265+0000 mgr.a (mgr.14355) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:57.352756+0000 mon.a (mon.0) 3492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:58.189974+0000 mon.a (mon.0) 3493 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:58.191704+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:58.201663+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:51:58.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:58 smithi171 bash[25040]: audit 2024-09-14T05:51:58.206460+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:51:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:56.825086+0000 mgr.a (mgr.14355) 19503 : audit [DBG] from='client.417801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:51:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: cluster 2024-09-14T05:51:57.203265+0000 mgr.a (mgr.14355) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:51:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:57.352756+0000 mon.a (mon.0) 3492 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:51:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:58.189974+0000 mon.a (mon.0) 3493 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:51:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:58.191704+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:51:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:58.201663+0000 mon.a (mon.0) 3495 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:51:58.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22722]: audit 2024-09-14T05:51:58.206460+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:51:59.287 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22972]: debug 2024-09-14T05:51:58.969+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:51:59.288 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:51:58 smithi007 bash[22972]: debug 2024-09-14T05:51:58.973+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:51:59.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:51:59 smithi171 bash[25040]: audit 2024-09-14T05:51:58.208875+0000 mgr.a (mgr.14355) 19505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:51:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:51:59 smithi007 bash[22722]: audit 2024-09-14T05:51:58.208875+0000 mgr.a (mgr.14355) 19505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:51:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:51:59 smithi131 bash[24745]: audit 2024-09-14T05:51:58.208875+0000 mgr.a (mgr.14355) 19505 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:52:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:00 smithi171 bash[25040]: audit 2024-09-14T05:51:58.973083+0000 mgr.a (mgr.14355) 19506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:52:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:00 smithi171 bash[25040]: cephadm 2024-09-14T05:51:58.974820+0000 mgr.a (mgr.14355) 19507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:52:00.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:00 smithi171 bash[25040]: cluster 2024-09-14T05:51:59.204196+0000 mgr.a (mgr.14355) 19508 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:00 smithi007 bash[22722]: audit 2024-09-14T05:51:58.973083+0000 mgr.a (mgr.14355) 19506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:52:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:00 smithi007 bash[22722]: cephadm 2024-09-14T05:51:58.974820+0000 mgr.a (mgr.14355) 19507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:52:00.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:00 smithi007 bash[22722]: cluster 2024-09-14T05:51:59.204196+0000 mgr.a (mgr.14355) 19508 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:00 smithi131 bash[24745]: audit 2024-09-14T05:51:58.973083+0000 mgr.a (mgr.14355) 19506 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:52:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:00 smithi131 bash[24745]: cephadm 2024-09-14T05:51:58.974820+0000 mgr.a (mgr.14355) 19507 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:52:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:00 smithi131 bash[24745]: cluster 2024-09-14T05:51:59.204196+0000 mgr.a (mgr.14355) 19508 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:02.241 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:02.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:02.242 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:02.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:02 smithi171 bash[25040]: cluster 2024-09-14T05:52:01.206541+0000 mgr.a (mgr.14355) 19509 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:02 smithi007 bash[22722]: cluster 2024-09-14T05:52:01.206541+0000 mgr.a (mgr.14355) 19509 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:02 smithi131 bash[24745]: cluster 2024-09-14T05:52:01.206541+0000 mgr.a (mgr.14355) 19509 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:03.027 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:04 smithi007 bash[22722]: audit 2024-09-14T05:52:02.577282+0000 mgr.a (mgr.14355) 19510 : audit [DBG] from='client.417984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:04.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:04 smithi007 bash[22722]: cluster 2024-09-14T05:52:03.207554+0000 mgr.a (mgr.14355) 19511 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:04 smithi131 bash[24745]: audit 2024-09-14T05:52:02.577282+0000 mgr.a (mgr.14355) 19510 : audit [DBG] from='client.417984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:04 smithi131 bash[24745]: cluster 2024-09-14T05:52:03.207554+0000 mgr.a (mgr.14355) 19511 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:04 smithi171 bash[25040]: audit 2024-09-14T05:52:02.577282+0000 mgr.a (mgr.14355) 19510 : audit [DBG] from='client.417984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:04 smithi171 bash[25040]: cluster 2024-09-14T05:52:03.207554+0000 mgr.a (mgr.14355) 19511 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:52:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:06 smithi007 bash[22722]: cluster 2024-09-14T05:52:05.209754+0000 mgr.a (mgr.14355) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:06 smithi131 bash[24745]: cluster 2024-09-14T05:52:05.209754+0000 mgr.a (mgr.14355) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:06 smithi171 bash[25040]: cluster 2024-09-14T05:52:05.209754+0000 mgr.a (mgr.14355) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:08.028 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:08.029 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:08 smithi007 bash[22722]: cluster 2024-09-14T05:52:07.210565+0000 mgr.a (mgr.14355) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:08 smithi131 bash[24745]: cluster 2024-09-14T05:52:07.210565+0000 mgr.a (mgr.14355) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:08 smithi171 bash[25040]: cluster 2024-09-14T05:52:07.210565+0000 mgr.a (mgr.14355) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:08.812 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:08.812 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:08.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:08.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:08.813 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:09 smithi007 bash[22722]: audit 2024-09-14T05:52:08.367369+0000 mgr.a (mgr.14355) 19514 : audit [DBG] from='client.418059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:09 smithi131 bash[24745]: audit 2024-09-14T05:52:08.367369+0000 mgr.a (mgr.14355) 19514 : audit [DBG] from='client.418059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:09 smithi171 bash[25040]: audit 2024-09-14T05:52:08.367369+0000 mgr.a (mgr.14355) 19514 : audit [DBG] from='client.418059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:10 smithi007 bash[22722]: cluster 2024-09-14T05:52:09.211611+0000 mgr.a (mgr.14355) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T05:52:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:10 smithi131 bash[24745]: cluster 2024-09-14T05:52:09.211611+0000 mgr.a (mgr.14355) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T05:52:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:10 smithi171 bash[25040]: cluster 2024-09-14T05:52:09.211611+0000 mgr.a (mgr.14355) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-14T05:52:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:12 smithi007 bash[22722]: cluster 2024-09-14T05:52:11.213931+0000 mgr.a (mgr.14355) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:12 smithi131 bash[24745]: cluster 2024-09-14T05:52:11.213931+0000 mgr.a (mgr.14355) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:12 smithi171 bash[25040]: cluster 2024-09-14T05:52:11.213931+0000 mgr.a (mgr.14355) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-14T05:52:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:14.577 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:14.577 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:14.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:14.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:14.578 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:14 smithi007 bash[22722]: cluster 2024-09-14T05:52:13.214758+0000 mgr.a (mgr.14355) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:52:14.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:14 smithi131 bash[24745]: cluster 2024-09-14T05:52:13.214758+0000 mgr.a (mgr.14355) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:52:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:14 smithi171 bash[25040]: cluster 2024-09-14T05:52:13.214758+0000 mgr.a (mgr.14355) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-14T05:52:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:15 smithi007 bash[22722]: audit 2024-09-14T05:52:14.144506+0000 mgr.a (mgr.14355) 19518 : audit [DBG] from='client.418137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:15 smithi131 bash[24745]: audit 2024-09-14T05:52:14.144506+0000 mgr.a (mgr.14355) 19518 : audit [DBG] from='client.418137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:15 smithi171 bash[25040]: audit 2024-09-14T05:52:14.144506+0000 mgr.a (mgr.14355) 19518 : audit [DBG] from='client.418137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:16 smithi007 bash[22722]: cluster 2024-09-14T05:52:15.217108+0000 mgr.a (mgr.14355) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:52:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:16 smithi131 bash[24745]: cluster 2024-09-14T05:52:15.217108+0000 mgr.a (mgr.14355) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:52:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:16 smithi171 bash[25040]: cluster 2024-09-14T05:52:15.217108+0000 mgr.a (mgr.14355) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-14T05:52:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:18 smithi007 bash[22722]: cluster 2024-09-14T05:52:17.217903+0000 mgr.a (mgr.14355) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:18 smithi131 bash[24745]: cluster 2024-09-14T05:52:17.217903+0000 mgr.a (mgr.14355) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:18 smithi171 bash[25040]: cluster 2024-09-14T05:52:17.217903+0000 mgr.a (mgr.14355) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:19.579 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:20.320 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:20.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:20.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:20.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:20.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:20 smithi007 bash[22722]: cluster 2024-09-14T05:52:19.218695+0000 mgr.a (mgr.14355) 19521 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:20 smithi131 bash[24745]: cluster 2024-09-14T05:52:19.218695+0000 mgr.a (mgr.14355) 19521 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:20 smithi171 bash[25040]: cluster 2024-09-14T05:52:19.218695+0000 mgr.a (mgr.14355) 19521 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:21 smithi007 bash[22722]: audit 2024-09-14T05:52:19.909895+0000 mgr.a (mgr.14355) 19522 : audit [DBG] from='client.418209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:21 smithi131 bash[24745]: audit 2024-09-14T05:52:19.909895+0000 mgr.a (mgr.14355) 19522 : audit [DBG] from='client.418209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:21.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:21 smithi171 bash[25040]: audit 2024-09-14T05:52:19.909895+0000 mgr.a (mgr.14355) 19522 : audit [DBG] from='client.418209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:22 smithi007 bash[22722]: cluster 2024-09-14T05:52:21.221411+0000 mgr.a (mgr.14355) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:52:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:22 smithi131 bash[24745]: cluster 2024-09-14T05:52:21.221411+0000 mgr.a (mgr.14355) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:52:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:22 smithi171 bash[25040]: cluster 2024-09-14T05:52:21.221411+0000 mgr.a (mgr.14355) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:52:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:24 smithi007 bash[22722]: cluster 2024-09-14T05:52:23.222215+0000 mgr.a (mgr.14355) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:52:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:24 smithi131 bash[24745]: cluster 2024-09-14T05:52:23.222215+0000 mgr.a (mgr.14355) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:52:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:24 smithi171 bash[25040]: cluster 2024-09-14T05:52:23.222215+0000 mgr.a (mgr.14355) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:52:25.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:25.322 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:25.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:26.075 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:26.075 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:26.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:26 smithi007 bash[22722]: cluster 2024-09-14T05:52:25.224090+0000 mgr.a (mgr.14355) 19525 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:26 smithi131 bash[24745]: cluster 2024-09-14T05:52:25.224090+0000 mgr.a (mgr.14355) 19525 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:26 smithi171 bash[25040]: cluster 2024-09-14T05:52:25.224090+0000 mgr.a (mgr.14355) 19525 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:27.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:27 smithi007 bash[22722]: audit 2024-09-14T05:52:25.653765+0000 mgr.a (mgr.14355) 19526 : audit [DBG] from='client.418287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:27 smithi131 bash[24745]: audit 2024-09-14T05:52:25.653765+0000 mgr.a (mgr.14355) 19526 : audit [DBG] from='client.418287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:27 smithi171 bash[25040]: audit 2024-09-14T05:52:25.653765+0000 mgr.a (mgr.14355) 19526 : audit [DBG] from='client.418287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:28 smithi007 bash[22722]: cluster 2024-09-14T05:52:27.224947+0000 mgr.a (mgr.14355) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:52:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:28 smithi131 bash[24745]: cluster 2024-09-14T05:52:27.224947+0000 mgr.a (mgr.14355) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:52:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:28 smithi171 bash[25040]: cluster 2024-09-14T05:52:27.224947+0000 mgr.a (mgr.14355) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:52:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:30 smithi007 bash[22722]: cluster 2024-09-14T05:52:29.225728+0000 mgr.a (mgr.14355) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:52:30.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:30 smithi131 bash[24745]: cluster 2024-09-14T05:52:29.225728+0000 mgr.a (mgr.14355) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:52:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:30 smithi171 bash[25040]: cluster 2024-09-14T05:52:29.225728+0000 mgr.a (mgr.14355) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:52:31.076 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:31.077 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:31.863 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:31.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:31.863 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:31.864 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:32 smithi007 bash[22722]: cluster 2024-09-14T05:52:31.227182+0000 mgr.a (mgr.14355) 19529 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:32 smithi131 bash[24745]: cluster 2024-09-14T05:52:31.227182+0000 mgr.a (mgr.14355) 19529 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:32 smithi171 bash[25040]: cluster 2024-09-14T05:52:31.227182+0000 mgr.a (mgr.14355) 19529 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:33 smithi007 bash[22722]: audit 2024-09-14T05:52:31.412917+0000 mgr.a (mgr.14355) 19530 : audit [DBG] from='client.418362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:33 smithi131 bash[24745]: audit 2024-09-14T05:52:31.412917+0000 mgr.a (mgr.14355) 19530 : audit [DBG] from='client.418362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:33 smithi171 bash[25040]: audit 2024-09-14T05:52:31.412917+0000 mgr.a (mgr.14355) 19530 : audit [DBG] from='client.418362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:34 smithi007 bash[22722]: cluster 2024-09-14T05:52:33.228082+0000 mgr.a (mgr.14355) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:34 smithi131 bash[24745]: cluster 2024-09-14T05:52:33.228082+0000 mgr.a (mgr.14355) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:34 smithi171 bash[25040]: cluster 2024-09-14T05:52:33.228082+0000 mgr.a (mgr.14355) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:35.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:35 smithi007 bash[22722]: cluster 2024-09-14T05:52:35.230335+0000 mgr.a (mgr.14355) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:35 smithi131 bash[24745]: cluster 2024-09-14T05:52:35.230335+0000 mgr.a (mgr.14355) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:35 smithi171 bash[25040]: cluster 2024-09-14T05:52:35.230335+0000 mgr.a (mgr.14355) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:37.654 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:37.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:37.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:37.655 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:37.655 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:38 smithi171 bash[25040]: audit 2024-09-14T05:52:37.202125+0000 mgr.a (mgr.14355) 19533 : audit [DBG] from='client.418440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:38.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:38 smithi171 bash[25040]: cluster 2024-09-14T05:52:37.231437+0000 mgr.a (mgr.14355) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:38 smithi007 bash[22722]: audit 2024-09-14T05:52:37.202125+0000 mgr.a (mgr.14355) 19533 : audit [DBG] from='client.418440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:38 smithi007 bash[22722]: cluster 2024-09-14T05:52:37.231437+0000 mgr.a (mgr.14355) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:38 smithi131 bash[24745]: audit 2024-09-14T05:52:37.202125+0000 mgr.a (mgr.14355) 19533 : audit [DBG] from='client.418440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:38 smithi131 bash[24745]: cluster 2024-09-14T05:52:37.231437+0000 mgr.a (mgr.14355) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:40.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:40 smithi171 bash[25040]: cluster 2024-09-14T05:52:39.232356+0000 mgr.a (mgr.14355) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:40 smithi007 bash[22722]: cluster 2024-09-14T05:52:39.232356+0000 mgr.a (mgr.14355) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:40 smithi131 bash[24745]: cluster 2024-09-14T05:52:39.232356+0000 mgr.a (mgr.14355) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-14T05:52:42.656 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:42.657 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:42 smithi007 bash[22722]: cluster 2024-09-14T05:52:41.234650+0000 mgr.a (mgr.14355) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:52:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:42 smithi131 bash[24745]: cluster 2024-09-14T05:52:41.234650+0000 mgr.a (mgr.14355) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:52:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:42 smithi171 bash[25040]: cluster 2024-09-14T05:52:41.234650+0000 mgr.a (mgr.14355) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-14T05:52:43.415 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:43.416 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:44 smithi007 bash[22722]: audit 2024-09-14T05:52:42.989786+0000 mgr.a (mgr.14355) 19537 : audit [DBG] from='client.418518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:44.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:44 smithi007 bash[22722]: cluster 2024-09-14T05:52:43.235167+0000 mgr.a (mgr.14355) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:44 smithi131 bash[24745]: audit 2024-09-14T05:52:42.989786+0000 mgr.a (mgr.14355) 19537 : audit [DBG] from='client.418518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:44 smithi131 bash[24745]: cluster 2024-09-14T05:52:43.235167+0000 mgr.a (mgr.14355) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:44 smithi171 bash[25040]: audit 2024-09-14T05:52:42.989786+0000 mgr.a (mgr.14355) 19537 : audit [DBG] from='client.418518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:44 smithi171 bash[25040]: cluster 2024-09-14T05:52:43.235167+0000 mgr.a (mgr.14355) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:46 smithi007 bash[22722]: cluster 2024-09-14T05:52:45.237360+0000 mgr.a (mgr.14355) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:46 smithi131 bash[24745]: cluster 2024-09-14T05:52:45.237360+0000 mgr.a (mgr.14355) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:46 smithi171 bash[25040]: cluster 2024-09-14T05:52:45.237360+0000 mgr.a (mgr.14355) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:48 smithi007 bash[22722]: cluster 2024-09-14T05:52:47.238103+0000 mgr.a (mgr.14355) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:48 smithi131 bash[24745]: cluster 2024-09-14T05:52:47.238103+0000 mgr.a (mgr.14355) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:48 smithi171 bash[25040]: cluster 2024-09-14T05:52:47.238103+0000 mgr.a (mgr.14355) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:49.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:50 smithi007 bash[22722]: audit 2024-09-14T05:52:48.748627+0000 mgr.a (mgr.14355) 19541 : audit [DBG] from='client.418593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:50 smithi007 bash[22722]: cluster 2024-09-14T05:52:49.238872+0000 mgr.a (mgr.14355) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:50 smithi131 bash[24745]: audit 2024-09-14T05:52:48.748627+0000 mgr.a (mgr.14355) 19541 : audit [DBG] from='client.418593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:50 smithi131 bash[24745]: cluster 2024-09-14T05:52:49.238872+0000 mgr.a (mgr.14355) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:50 smithi171 bash[25040]: audit 2024-09-14T05:52:48.748627+0000 mgr.a (mgr.14355) 19541 : audit [DBG] from='client.418593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:50 smithi171 bash[25040]: cluster 2024-09-14T05:52:49.238872+0000 mgr.a (mgr.14355) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:52 smithi007 bash[22722]: cluster 2024-09-14T05:52:51.241150+0000 mgr.a (mgr.14355) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:52 smithi131 bash[24745]: cluster 2024-09-14T05:52:51.241150+0000 mgr.a (mgr.14355) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:52 smithi171 bash[25040]: cluster 2024-09-14T05:52:51.241150+0000 mgr.a (mgr.14355) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:54.174 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:54.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:54.175 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:52:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:54 smithi007 bash[22722]: cluster 2024-09-14T05:52:53.241889+0000 mgr.a (mgr.14355) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:54 smithi131 bash[24745]: cluster 2024-09-14T05:52:53.241889+0000 mgr.a (mgr.14355) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:54 smithi171 bash[25040]: cluster 2024-09-14T05:52:53.241889+0000 mgr.a (mgr.14355) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:54.948 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:52:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:52:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:52:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:52:54.949 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:52:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:56 smithi007 bash[22722]: audit 2024-09-14T05:52:54.512883+0000 mgr.a (mgr.14355) 19545 : audit [DBG] from='client.418671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:56.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:56 smithi007 bash[22722]: cluster 2024-09-14T05:52:55.244354+0000 mgr.a (mgr.14355) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:56.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:56 smithi131 bash[24745]: audit 2024-09-14T05:52:54.512883+0000 mgr.a (mgr.14355) 19545 : audit [DBG] from='client.418671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:56.785 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:56 smithi131 bash[24745]: cluster 2024-09-14T05:52:55.244354+0000 mgr.a (mgr.14355) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:56 smithi171 bash[25040]: audit 2024-09-14T05:52:54.512883+0000 mgr.a (mgr.14355) 19545 : audit [DBG] from='client.418671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:52:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:56 smithi171 bash[25040]: cluster 2024-09-14T05:52:55.244354+0000 mgr.a (mgr.14355) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:52:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:58 smithi007 bash[22722]: cluster 2024-09-14T05:52:57.245162+0000 mgr.a (mgr.14355) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:58 smithi131 bash[24745]: cluster 2024-09-14T05:52:57.245162+0000 mgr.a (mgr.14355) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:58 smithi171 bash[25040]: cluster 2024-09-14T05:52:57.245162+0000 mgr.a (mgr.14355) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:52:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:52:59 smithi007 bash[22722]: audit 2024-09-14T05:52:59.028111+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:52:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:52:59 smithi131 bash[24745]: audit 2024-09-14T05:52:59.028111+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:52:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:52:59 smithi171 bash[25040]: audit 2024-09-14T05:52:59.028111+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:52:59.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:52:59.950 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:52:59.951 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:00.684 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:00.684 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:00 smithi007 bash[22722]: cluster 2024-09-14T05:52:59.246038+0000 mgr.a (mgr.14355) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:00 smithi131 bash[24745]: cluster 2024-09-14T05:52:59.246038+0000 mgr.a (mgr.14355) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:00 smithi171 bash[25040]: cluster 2024-09-14T05:52:59.246038+0000 mgr.a (mgr.14355) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:01 smithi007 bash[22722]: audit 2024-09-14T05:53:00.273039+0000 mgr.a (mgr.14355) 19549 : audit [DBG] from='client.418749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:01 smithi131 bash[24745]: audit 2024-09-14T05:53:00.273039+0000 mgr.a (mgr.14355) 19549 : audit [DBG] from='client.418749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:01 smithi171 bash[25040]: audit 2024-09-14T05:53:00.273039+0000 mgr.a (mgr.14355) 19549 : audit [DBG] from='client.418749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:02 smithi007 bash[22722]: cluster 2024-09-14T05:53:01.248768+0000 mgr.a (mgr.14355) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:02 smithi131 bash[24745]: cluster 2024-09-14T05:53:01.248768+0000 mgr.a (mgr.14355) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:02 smithi171 bash[25040]: cluster 2024-09-14T05:53:01.248768+0000 mgr.a (mgr.14355) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:04 smithi007 bash[22722]: cluster 2024-09-14T05:53:03.249555+0000 mgr.a (mgr.14355) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:04 smithi131 bash[24745]: cluster 2024-09-14T05:53:03.249555+0000 mgr.a (mgr.14355) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:04.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:04 smithi171 bash[25040]: cluster 2024-09-14T05:53:03.249555+0000 mgr.a (mgr.14355) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:05.685 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.376209+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.380366+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.394053+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.397592+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.400465+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:04.404789+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:05.118651+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:53:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:05.120474+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:53:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:05.131028+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22722]: audit 2024-09-14T05:53:05.136161+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.376209+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.380366+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.394053+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.397592+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.400465+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:04.404789+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:05.118651+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:05.120474+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:05.131028+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:05 smithi131 bash[24745]: audit 2024-09-14T05:53:05.136161+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.376209+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.380366+0000 mon.a (mon.0) 3499 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.394053+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.397592+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.400465+0000 mon.a (mon.0) 3502 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:04.404789+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:05.118651+0000 mon.a (mon.0) 3504 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:05.120474+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:05.131028+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:53:05.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:05 smithi171 bash[25040]: audit 2024-09-14T05:53:05.136161+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:06.205 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22972]: debug 2024-09-14T05:53:05.868+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:53:06.206 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:53:05 smithi007 bash[22972]: debug 2024-09-14T05:53:05.868+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:53:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:06.448 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:06 smithi007 bash[22722]: audit 2024-09-14T05:53:05.138471+0000 mgr.a (mgr.14355) 19552 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:06 smithi007 bash[22722]: cluster 2024-09-14T05:53:05.250685+0000 mgr.a (mgr.14355) 19553 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:06 smithi131 bash[24745]: audit 2024-09-14T05:53:05.138471+0000 mgr.a (mgr.14355) 19552 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:06 smithi131 bash[24745]: cluster 2024-09-14T05:53:05.250685+0000 mgr.a (mgr.14355) 19553 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:06 smithi171 bash[25040]: audit 2024-09-14T05:53:05.138471+0000 mgr.a (mgr.14355) 19552 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:53:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:06 smithi171 bash[25040]: cluster 2024-09-14T05:53:05.250685+0000 mgr.a (mgr.14355) 19553 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:07 smithi007 bash[22722]: audit 2024-09-14T05:53:05.872081+0000 mgr.a (mgr.14355) 19554 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:53:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:07 smithi007 bash[22722]: cephadm 2024-09-14T05:53:05.873380+0000 mgr.a (mgr.14355) 19555 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:53:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:07 smithi007 bash[22722]: audit 2024-09-14T05:53:06.013436+0000 mgr.a (mgr.14355) 19556 : audit [DBG] from='client.418932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:07 smithi131 bash[24745]: audit 2024-09-14T05:53:05.872081+0000 mgr.a (mgr.14355) 19554 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:53:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:07 smithi131 bash[24745]: cephadm 2024-09-14T05:53:05.873380+0000 mgr.a (mgr.14355) 19555 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:53:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:07 smithi131 bash[24745]: audit 2024-09-14T05:53:06.013436+0000 mgr.a (mgr.14355) 19556 : audit [DBG] from='client.418932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:07 smithi171 bash[25040]: audit 2024-09-14T05:53:05.872081+0000 mgr.a (mgr.14355) 19554 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:53:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:07 smithi171 bash[25040]: cephadm 2024-09-14T05:53:05.873380+0000 mgr.a (mgr.14355) 19555 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:53:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:07 smithi171 bash[25040]: audit 2024-09-14T05:53:06.013436+0000 mgr.a (mgr.14355) 19556 : audit [DBG] from='client.418932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:08 smithi007 bash[22722]: cluster 2024-09-14T05:53:07.251527+0000 mgr.a (mgr.14355) 19557 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:08 smithi131 bash[24745]: cluster 2024-09-14T05:53:07.251527+0000 mgr.a (mgr.14355) 19557 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:08 smithi171 bash[25040]: cluster 2024-09-14T05:53:07.251527+0000 mgr.a (mgr.14355) 19557 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:10 smithi007 bash[22722]: cluster 2024-09-14T05:53:09.252296+0000 mgr.a (mgr.14355) 19558 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:53:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:10 smithi131 bash[24745]: cluster 2024-09-14T05:53:09.252296+0000 mgr.a (mgr.14355) 19558 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:53:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:10 smithi171 bash[25040]: cluster 2024-09-14T05:53:09.252296+0000 mgr.a (mgr.14355) 19558 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:53:11.449 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:11.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:11.450 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:12.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:12.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:12 smithi007 bash[22722]: cluster 2024-09-14T05:53:11.254587+0000 mgr.a (mgr.14355) 19559 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:12 smithi131 bash[24745]: cluster 2024-09-14T05:53:11.254587+0000 mgr.a (mgr.14355) 19559 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:12 smithi171 bash[25040]: cluster 2024-09-14T05:53:11.254587+0000 mgr.a (mgr.14355) 19559 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:13 smithi007 bash[22722]: audit 2024-09-14T05:53:11.786755+0000 mgr.a (mgr.14355) 19560 : audit [DBG] from='client.419007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:13 smithi131 bash[24745]: audit 2024-09-14T05:53:11.786755+0000 mgr.a (mgr.14355) 19560 : audit [DBG] from='client.419007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:13.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:13 smithi171 bash[25040]: audit 2024-09-14T05:53:11.786755+0000 mgr.a (mgr.14355) 19560 : audit [DBG] from='client.419007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:14 smithi007 bash[22722]: cluster 2024-09-14T05:53:13.255489+0000 mgr.a (mgr.14355) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:14 smithi131 bash[24745]: cluster 2024-09-14T05:53:13.255489+0000 mgr.a (mgr.14355) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:14 smithi171 bash[25040]: cluster 2024-09-14T05:53:13.255489+0000 mgr.a (mgr.14355) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:15 smithi007 bash[22722]: cluster 2024-09-14T05:53:15.257664+0000 mgr.a (mgr.14355) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:15 smithi131 bash[24745]: cluster 2024-09-14T05:53:15.257664+0000 mgr.a (mgr.14355) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:15 smithi171 bash[25040]: cluster 2024-09-14T05:53:15.257664+0000 mgr.a (mgr.14355) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:17.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:17.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:17.225 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:17.995 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:17.996 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:18 smithi007 bash[22722]: cluster 2024-09-14T05:53:17.258486+0000 mgr.a (mgr.14355) 19563 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:18 smithi131 bash[24745]: cluster 2024-09-14T05:53:17.258486+0000 mgr.a (mgr.14355) 19563 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:18 smithi171 bash[25040]: cluster 2024-09-14T05:53:17.258486+0000 mgr.a (mgr.14355) 19563 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:19 smithi007 bash[22722]: audit 2024-09-14T05:53:17.557635+0000 mgr.a (mgr.14355) 19564 : audit [DBG] from='client.419085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:19 smithi131 bash[24745]: audit 2024-09-14T05:53:17.557635+0000 mgr.a (mgr.14355) 19564 : audit [DBG] from='client.419085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:19 smithi171 bash[25040]: audit 2024-09-14T05:53:17.557635+0000 mgr.a (mgr.14355) 19564 : audit [DBG] from='client.419085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:20 smithi007 bash[22722]: cluster 2024-09-14T05:53:19.259328+0000 mgr.a (mgr.14355) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:20 smithi131 bash[24745]: cluster 2024-09-14T05:53:19.259328+0000 mgr.a (mgr.14355) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:20 smithi171 bash[25040]: cluster 2024-09-14T05:53:19.259328+0000 mgr.a (mgr.14355) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:22.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:22 smithi007 bash[22722]: cluster 2024-09-14T05:53:21.261602+0000 mgr.a (mgr.14355) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:22.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:22 smithi131 bash[24745]: cluster 2024-09-14T05:53:21.261602+0000 mgr.a (mgr.14355) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:22 smithi171 bash[25040]: cluster 2024-09-14T05:53:21.261602+0000 mgr.a (mgr.14355) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:53:22.997 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:22.998 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:23.748 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:23.748 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:24 smithi007 bash[22722]: cluster 2024-09-14T05:53:23.262348+0000 mgr.a (mgr.14355) 19567 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:24 smithi007 bash[22722]: audit 2024-09-14T05:53:23.328782+0000 mgr.a (mgr.14355) 19568 : audit [DBG] from='client.419160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:24 smithi131 bash[24745]: cluster 2024-09-14T05:53:23.262348+0000 mgr.a (mgr.14355) 19567 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:24 smithi131 bash[24745]: audit 2024-09-14T05:53:23.328782+0000 mgr.a (mgr.14355) 19568 : audit [DBG] from='client.419160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:24 smithi171 bash[25040]: cluster 2024-09-14T05:53:23.262348+0000 mgr.a (mgr.14355) 19567 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:24 smithi171 bash[25040]: audit 2024-09-14T05:53:23.328782+0000 mgr.a (mgr.14355) 19568 : audit [DBG] from='client.419160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:26 smithi007 bash[22722]: cluster 2024-09-14T05:53:25.264575+0000 mgr.a (mgr.14355) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:26 smithi131 bash[24745]: cluster 2024-09-14T05:53:25.264575+0000 mgr.a (mgr.14355) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:26 smithi171 bash[25040]: cluster 2024-09-14T05:53:25.264575+0000 mgr.a (mgr.14355) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:28 smithi007 bash[22722]: cluster 2024-09-14T05:53:27.265353+0000 mgr.a (mgr.14355) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:28.749 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:28.751 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:28.752 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:28 smithi131 bash[24745]: cluster 2024-09-14T05:53:27.265353+0000 mgr.a (mgr.14355) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:28 smithi171 bash[25040]: cluster 2024-09-14T05:53:27.265353+0000 mgr.a (mgr.14355) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:29.521 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:29.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:29.521 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:29.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:29.522 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:30 smithi007 bash[22722]: audit 2024-09-14T05:53:29.082065+0000 mgr.a (mgr.14355) 19571 : audit [DBG] from='client.419238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:30 smithi007 bash[22722]: cluster 2024-09-14T05:53:29.265941+0000 mgr.a (mgr.14355) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:30 smithi131 bash[24745]: audit 2024-09-14T05:53:29.082065+0000 mgr.a (mgr.14355) 19571 : audit [DBG] from='client.419238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:30 smithi131 bash[24745]: cluster 2024-09-14T05:53:29.265941+0000 mgr.a (mgr.14355) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:30 smithi171 bash[25040]: audit 2024-09-14T05:53:29.082065+0000 mgr.a (mgr.14355) 19571 : audit [DBG] from='client.419238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:30.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:30 smithi171 bash[25040]: cluster 2024-09-14T05:53:29.265941+0000 mgr.a (mgr.14355) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:32 smithi007 bash[22722]: cluster 2024-09-14T05:53:31.268282+0000 mgr.a (mgr.14355) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:32 smithi131 bash[24745]: cluster 2024-09-14T05:53:31.268282+0000 mgr.a (mgr.14355) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:32 smithi171 bash[25040]: cluster 2024-09-14T05:53:31.268282+0000 mgr.a (mgr.14355) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:34.523 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:34.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:34.523 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:34 smithi007 bash[22722]: cluster 2024-09-14T05:53:33.269039+0000 mgr.a (mgr.14355) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:34 smithi131 bash[24745]: cluster 2024-09-14T05:53:33.269039+0000 mgr.a (mgr.14355) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:34 smithi171 bash[25040]: cluster 2024-09-14T05:53:33.269039+0000 mgr.a (mgr.14355) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:35.312 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:36 smithi007 bash[22722]: audit 2024-09-14T05:53:34.858991+0000 mgr.a (mgr.14355) 19575 : audit [DBG] from='client.419313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:36 smithi007 bash[22722]: cluster 2024-09-14T05:53:35.270270+0000 mgr.a (mgr.14355) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:53:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:36 smithi131 bash[24745]: audit 2024-09-14T05:53:34.858991+0000 mgr.a (mgr.14355) 19575 : audit [DBG] from='client.419313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:36 smithi131 bash[24745]: cluster 2024-09-14T05:53:35.270270+0000 mgr.a (mgr.14355) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:53:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:36 smithi171 bash[25040]: audit 2024-09-14T05:53:34.858991+0000 mgr.a (mgr.14355) 19575 : audit [DBG] from='client.419313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:36.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:36 smithi171 bash[25040]: cluster 2024-09-14T05:53:35.270270+0000 mgr.a (mgr.14355) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:53:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:38 smithi007 bash[22722]: cluster 2024-09-14T05:53:37.271033+0000 mgr.a (mgr.14355) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:38 smithi131 bash[24745]: cluster 2024-09-14T05:53:37.271033+0000 mgr.a (mgr.14355) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:38 smithi171 bash[25040]: cluster 2024-09-14T05:53:37.271033+0000 mgr.a (mgr.14355) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:40 smithi007 bash[22722]: cluster 2024-09-14T05:53:39.271811+0000 mgr.a (mgr.14355) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:40 smithi131 bash[24745]: cluster 2024-09-14T05:53:39.271811+0000 mgr.a (mgr.14355) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:40.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:40 smithi171 bash[25040]: cluster 2024-09-14T05:53:39.271811+0000 mgr.a (mgr.14355) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:53:41.089 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:42 smithi007 bash[22722]: audit 2024-09-14T05:53:40.648943+0000 mgr.a (mgr.14355) 19579 : audit [DBG] from='client.419388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:42 smithi007 bash[22722]: cluster 2024-09-14T05:53:41.274489+0000 mgr.a (mgr.14355) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:42 smithi131 bash[24745]: audit 2024-09-14T05:53:40.648943+0000 mgr.a (mgr.14355) 19579 : audit [DBG] from='client.419388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:42 smithi131 bash[24745]: cluster 2024-09-14T05:53:41.274489+0000 mgr.a (mgr.14355) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:42 smithi171 bash[25040]: audit 2024-09-14T05:53:40.648943+0000 mgr.a (mgr.14355) 19579 : audit [DBG] from='client.419388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:42.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:42 smithi171 bash[25040]: cluster 2024-09-14T05:53:41.274489+0000 mgr.a (mgr.14355) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:44 smithi007 bash[22722]: cluster 2024-09-14T05:53:43.275394+0000 mgr.a (mgr.14355) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:44 smithi131 bash[24745]: cluster 2024-09-14T05:53:43.275394+0000 mgr.a (mgr.14355) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:44 smithi171 bash[25040]: cluster 2024-09-14T05:53:43.275394+0000 mgr.a (mgr.14355) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:53:46.091 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:46.092 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:46 smithi007 bash[22722]: cluster 2024-09-14T05:53:45.277310+0000 mgr.a (mgr.14355) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:46 smithi131 bash[24745]: cluster 2024-09-14T05:53:45.277310+0000 mgr.a (mgr.14355) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:46 smithi171 bash[25040]: cluster 2024-09-14T05:53:45.277310+0000 mgr.a (mgr.14355) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:46.868 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:46.868 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:48 smithi007 bash[22722]: audit 2024-09-14T05:53:46.428092+0000 mgr.a (mgr.14355) 19583 : audit [DBG] from='client.419466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:48 smithi007 bash[22722]: cluster 2024-09-14T05:53:47.278169+0000 mgr.a (mgr.14355) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:48 smithi131 bash[24745]: audit 2024-09-14T05:53:46.428092+0000 mgr.a (mgr.14355) 19583 : audit [DBG] from='client.419466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:48 smithi131 bash[24745]: cluster 2024-09-14T05:53:47.278169+0000 mgr.a (mgr.14355) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:48 smithi171 bash[25040]: audit 2024-09-14T05:53:46.428092+0000 mgr.a (mgr.14355) 19583 : audit [DBG] from='client.419466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:48 smithi171 bash[25040]: cluster 2024-09-14T05:53:47.278169+0000 mgr.a (mgr.14355) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:50 smithi007 bash[22722]: cluster 2024-09-14T05:53:49.278909+0000 mgr.a (mgr.14355) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:50 smithi131 bash[24745]: cluster 2024-09-14T05:53:49.278909+0000 mgr.a (mgr.14355) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:50 smithi171 bash[25040]: cluster 2024-09-14T05:53:49.278909+0000 mgr.a (mgr.14355) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:53:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:52.627 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:52.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:52.628 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:52 smithi007 bash[22722]: cluster 2024-09-14T05:53:51.281146+0000 mgr.a (mgr.14355) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:53:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:52 smithi131 bash[24745]: cluster 2024-09-14T05:53:51.281146+0000 mgr.a (mgr.14355) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:53:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:52 smithi171 bash[25040]: cluster 2024-09-14T05:53:51.281146+0000 mgr.a (mgr.14355) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:53:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:53 smithi007 bash[22722]: audit 2024-09-14T05:53:52.199737+0000 mgr.a (mgr.14355) 19587 : audit [DBG] from='client.419544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:53 smithi131 bash[24745]: audit 2024-09-14T05:53:52.199737+0000 mgr.a (mgr.14355) 19587 : audit [DBG] from='client.419544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:53 smithi171 bash[25040]: audit 2024-09-14T05:53:52.199737+0000 mgr.a (mgr.14355) 19587 : audit [DBG] from='client.419544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:54 smithi007 bash[22722]: cluster 2024-09-14T05:53:53.282134+0000 mgr.a (mgr.14355) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:54 smithi131 bash[24745]: cluster 2024-09-14T05:53:53.282134+0000 mgr.a (mgr.14355) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:54 smithi171 bash[25040]: cluster 2024-09-14T05:53:53.282134+0000 mgr.a (mgr.14355) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:55 smithi131 bash[24745]: cluster 2024-09-14T05:53:55.284331+0000 mgr.a (mgr.14355) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:55 smithi171 bash[25040]: cluster 2024-09-14T05:53:55.284331+0000 mgr.a (mgr.14355) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:55 smithi007 bash[22722]: cluster 2024-09-14T05:53:55.284331+0000 mgr.a (mgr.14355) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:53:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:53:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:53:57.629 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:53:58.405 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:53:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:53:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:53:58.405 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:53:58.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:53:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:58 smithi007 bash[22722]: cluster 2024-09-14T05:53:57.285106+0000 mgr.a (mgr.14355) 19590 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:58 smithi131 bash[24745]: cluster 2024-09-14T05:53:57.285106+0000 mgr.a (mgr.14355) 19590 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:58 smithi171 bash[25040]: cluster 2024-09-14T05:53:57.285106+0000 mgr.a (mgr.14355) 19590 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:53:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:53:59 smithi007 bash[22722]: audit 2024-09-14T05:53:57.959779+0000 mgr.a (mgr.14355) 19591 : audit [DBG] from='client.419622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:53:59 smithi131 bash[24745]: audit 2024-09-14T05:53:57.959779+0000 mgr.a (mgr.14355) 19591 : audit [DBG] from='client.419622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:53:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:53:59 smithi171 bash[25040]: audit 2024-09-14T05:53:57.959779+0000 mgr.a (mgr.14355) 19591 : audit [DBG] from='client.419622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:00 smithi007 bash[22722]: cluster 2024-09-14T05:53:59.286234+0000 mgr.a (mgr.14355) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:00 smithi131 bash[24745]: cluster 2024-09-14T05:53:59.286234+0000 mgr.a (mgr.14355) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:00 smithi171 bash[25040]: cluster 2024-09-14T05:53:59.286234+0000 mgr.a (mgr.14355) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:02 smithi007 bash[22722]: cluster 2024-09-14T05:54:01.288696+0000 mgr.a (mgr.14355) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:02 smithi131 bash[24745]: cluster 2024-09-14T05:54:01.288696+0000 mgr.a (mgr.14355) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:02 smithi171 bash[25040]: cluster 2024-09-14T05:54:01.288696+0000 mgr.a (mgr.14355) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:03.406 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:03.407 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:04.182 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:04.183 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:04 smithi007 bash[22722]: cluster 2024-09-14T05:54:03.289668+0000 mgr.a (mgr.14355) 19594 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:04 smithi131 bash[24745]: cluster 2024-09-14T05:54:03.289668+0000 mgr.a (mgr.14355) 19594 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:04 smithi171 bash[25040]: cluster 2024-09-14T05:54:03.289668+0000 mgr.a (mgr.14355) 19594 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:05 smithi007 bash[22722]: audit 2024-09-14T05:54:03.742572+0000 mgr.a (mgr.14355) 19595 : audit [DBG] from='client.419700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:05 smithi131 bash[24745]: audit 2024-09-14T05:54:03.742572+0000 mgr.a (mgr.14355) 19595 : audit [DBG] from='client.419700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:05 smithi171 bash[25040]: audit 2024-09-14T05:54:03.742572+0000 mgr.a (mgr.14355) 19595 : audit [DBG] from='client.419700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:06 smithi007 bash[22722]: cluster 2024-09-14T05:54:05.292071+0000 mgr.a (mgr.14355) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:06 smithi007 bash[22722]: audit 2024-09-14T05:54:05.921558+0000 mon.a (mon.0) 3508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:54:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:06 smithi131 bash[24745]: cluster 2024-09-14T05:54:05.292071+0000 mgr.a (mgr.14355) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:06.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:06 smithi131 bash[24745]: audit 2024-09-14T05:54:05.921558+0000 mon.a (mon.0) 3508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:54:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:06 smithi171 bash[25040]: cluster 2024-09-14T05:54:05.292071+0000 mgr.a (mgr.14355) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:06 smithi171 bash[25040]: audit 2024-09-14T05:54:05.921558+0000 mon.a (mon.0) 3508 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:54:07.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22972]: debug 2024-09-14T05:54:07.555+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:54:07.704 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22972]: debug 2024-09-14T05:54:07.555+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:54:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22722]: audit 2024-09-14T05:54:06.772194+0000 mon.a (mon.0) 3509 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:54:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22722]: audit 2024-09-14T05:54:06.774076+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:54:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22722]: audit 2024-09-14T05:54:06.784935+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:54:07.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:07 smithi007 bash[22722]: audit 2024-09-14T05:54:06.787973+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:07 smithi131 bash[24745]: audit 2024-09-14T05:54:06.772194+0000 mon.a (mon.0) 3509 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:54:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:07 smithi131 bash[24745]: audit 2024-09-14T05:54:06.774076+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:54:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:07 smithi131 bash[24745]: audit 2024-09-14T05:54:06.784935+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:54:07.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:07 smithi131 bash[24745]: audit 2024-09-14T05:54:06.787973+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:07 smithi171 bash[25040]: audit 2024-09-14T05:54:06.772194+0000 mon.a (mon.0) 3509 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:54:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:07 smithi171 bash[25040]: audit 2024-09-14T05:54:06.774076+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:54:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:07 smithi171 bash[25040]: audit 2024-09-14T05:54:06.784935+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:54:07.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:07 smithi171 bash[25040]: audit 2024-09-14T05:54:06.787973+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:08 smithi007 bash[22722]: audit 2024-09-14T05:54:06.790418+0000 mgr.a (mgr.14355) 19597 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:08 smithi007 bash[22722]: cluster 2024-09-14T05:54:07.293540+0000 mgr.a (mgr.14355) 19598 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:08 smithi131 bash[24745]: audit 2024-09-14T05:54:06.790418+0000 mgr.a (mgr.14355) 19597 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:08 smithi131 bash[24745]: cluster 2024-09-14T05:54:07.293540+0000 mgr.a (mgr.14355) 19598 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:08 smithi171 bash[25040]: audit 2024-09-14T05:54:06.790418+0000 mgr.a (mgr.14355) 19597 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:54:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:08 smithi171 bash[25040]: cluster 2024-09-14T05:54:07.293540+0000 mgr.a (mgr.14355) 19598 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:09.185 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:09 smithi007 bash[22722]: audit 2024-09-14T05:54:07.559583+0000 mgr.a (mgr.14355) 19599 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:54:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:09 smithi007 bash[22722]: cephadm 2024-09-14T05:54:07.561280+0000 mgr.a (mgr.14355) 19600 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:54:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:09 smithi131 bash[24745]: audit 2024-09-14T05:54:07.559583+0000 mgr.a (mgr.14355) 19599 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:54:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:09 smithi131 bash[24745]: cephadm 2024-09-14T05:54:07.561280+0000 mgr.a (mgr.14355) 19600 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:54:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:09 smithi171 bash[25040]: audit 2024-09-14T05:54:07.559583+0000 mgr.a (mgr.14355) 19599 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:54:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:09 smithi171 bash[25040]: cephadm 2024-09-14T05:54:07.561280+0000 mgr.a (mgr.14355) 19600 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:54:09.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:09.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:10 smithi007 bash[22722]: cluster 2024-09-14T05:54:09.294045+0000 mgr.a (mgr.14355) 19601 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:10 smithi131 bash[24745]: cluster 2024-09-14T05:54:09.294045+0000 mgr.a (mgr.14355) 19601 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:10 smithi171 bash[25040]: cluster 2024-09-14T05:54:09.294045+0000 mgr.a (mgr.14355) 19601 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:11 smithi007 bash[22722]: audit 2024-09-14T05:54:09.515657+0000 mgr.a (mgr.14355) 19602 : audit [DBG] from='client.419886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:11 smithi131 bash[24745]: audit 2024-09-14T05:54:09.515657+0000 mgr.a (mgr.14355) 19602 : audit [DBG] from='client.419886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:11 smithi171 bash[25040]: audit 2024-09-14T05:54:09.515657+0000 mgr.a (mgr.14355) 19602 : audit [DBG] from='client.419886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:12 smithi007 bash[22722]: cluster 2024-09-14T05:54:11.296547+0000 mgr.a (mgr.14355) 19603 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:12 smithi131 bash[24745]: cluster 2024-09-14T05:54:11.296547+0000 mgr.a (mgr.14355) 19603 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:12 smithi171 bash[25040]: cluster 2024-09-14T05:54:11.296547+0000 mgr.a (mgr.14355) 19603 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:14.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:14 smithi007 bash[22722]: cluster 2024-09-14T05:54:13.297375+0000 mgr.a (mgr.14355) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:14 smithi131 bash[24745]: cluster 2024-09-14T05:54:13.297375+0000 mgr.a (mgr.14355) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:14 smithi171 bash[25040]: cluster 2024-09-14T05:54:13.297375+0000 mgr.a (mgr.14355) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:14.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:14.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:14.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:15.734 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:16 smithi007 bash[22722]: audit 2024-09-14T05:54:15.290847+0000 mgr.a (mgr.14355) 19605 : audit [DBG] from='client.419961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:16 smithi007 bash[22722]: cluster 2024-09-14T05:54:15.305743+0000 mgr.a (mgr.14355) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:16 smithi131 bash[24745]: audit 2024-09-14T05:54:15.290847+0000 mgr.a (mgr.14355) 19605 : audit [DBG] from='client.419961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:16 smithi131 bash[24745]: cluster 2024-09-14T05:54:15.305743+0000 mgr.a (mgr.14355) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:16 smithi171 bash[25040]: audit 2024-09-14T05:54:15.290847+0000 mgr.a (mgr.14355) 19605 : audit [DBG] from='client.419961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:16.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:16 smithi171 bash[25040]: cluster 2024-09-14T05:54:15.305743+0000 mgr.a (mgr.14355) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:18 smithi007 bash[22722]: cluster 2024-09-14T05:54:17.306795+0000 mgr.a (mgr.14355) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:18 smithi131 bash[24745]: cluster 2024-09-14T05:54:17.306795+0000 mgr.a (mgr.14355) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:18 smithi171 bash[25040]: cluster 2024-09-14T05:54:17.306795+0000 mgr.a (mgr.14355) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:20 smithi007 bash[22722]: cluster 2024-09-14T05:54:19.307575+0000 mgr.a (mgr.14355) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:20.735 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:20.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:20.736 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:20 smithi131 bash[24745]: cluster 2024-09-14T05:54:19.307575+0000 mgr.a (mgr.14355) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:20 smithi171 bash[25040]: cluster 2024-09-14T05:54:19.307575+0000 mgr.a (mgr.14355) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:54:21.497 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:21.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:21.497 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:21.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:21.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:21 smithi007 bash[22722]: audit 2024-09-14T05:54:21.067866+0000 mgr.a (mgr.14355) 19609 : audit [DBG] from='client.420036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:21 smithi007 bash[22722]: cluster 2024-09-14T05:54:21.309086+0000 mgr.a (mgr.14355) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:21 smithi131 bash[24745]: audit 2024-09-14T05:54:21.067866+0000 mgr.a (mgr.14355) 19609 : audit [DBG] from='client.420036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:21 smithi131 bash[24745]: cluster 2024-09-14T05:54:21.309086+0000 mgr.a (mgr.14355) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:21 smithi171 bash[25040]: audit 2024-09-14T05:54:21.067866+0000 mgr.a (mgr.14355) 19609 : audit [DBG] from='client.420036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:21 smithi171 bash[25040]: cluster 2024-09-14T05:54:21.309086+0000 mgr.a (mgr.14355) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:54:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:24 smithi007 bash[22722]: cluster 2024-09-14T05:54:23.309936+0000 mgr.a (mgr.14355) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:54:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:24 smithi131 bash[24745]: cluster 2024-09-14T05:54:23.309936+0000 mgr.a (mgr.14355) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:54:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:24 smithi171 bash[25040]: cluster 2024-09-14T05:54:23.309936+0000 mgr.a (mgr.14355) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:54:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:26 smithi007 bash[22722]: cluster 2024-09-14T05:54:25.312106+0000 mgr.a (mgr.14355) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:26 smithi131 bash[24745]: cluster 2024-09-14T05:54:25.312106+0000 mgr.a (mgr.14355) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:26 smithi171 bash[25040]: cluster 2024-09-14T05:54:25.312106+0000 mgr.a (mgr.14355) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:27.284 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:27.285 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:28 smithi007 bash[22722]: audit 2024-09-14T05:54:26.836419+0000 mgr.a (mgr.14355) 19613 : audit [DBG] from='client.420105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:28 smithi007 bash[22722]: cluster 2024-09-14T05:54:27.312828+0000 mgr.a (mgr.14355) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:28 smithi131 bash[24745]: audit 2024-09-14T05:54:26.836419+0000 mgr.a (mgr.14355) 19613 : audit [DBG] from='client.420105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:28 smithi131 bash[24745]: cluster 2024-09-14T05:54:27.312828+0000 mgr.a (mgr.14355) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:28 smithi171 bash[25040]: audit 2024-09-14T05:54:26.836419+0000 mgr.a (mgr.14355) 19613 : audit [DBG] from='client.420105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:28 smithi171 bash[25040]: cluster 2024-09-14T05:54:27.312828+0000 mgr.a (mgr.14355) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:30 smithi007 bash[22722]: cluster 2024-09-14T05:54:29.313583+0000 mgr.a (mgr.14355) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:30 smithi131 bash[24745]: cluster 2024-09-14T05:54:29.313583+0000 mgr.a (mgr.14355) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:30 smithi171 bash[25040]: cluster 2024-09-14T05:54:29.313583+0000 mgr.a (mgr.14355) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:32.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:32.287 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:32 smithi007 bash[22722]: cluster 2024-09-14T05:54:31.315905+0000 mgr.a (mgr.14355) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:32 smithi131 bash[24745]: cluster 2024-09-14T05:54:31.315905+0000 mgr.a (mgr.14355) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:32 smithi171 bash[25040]: cluster 2024-09-14T05:54:31.315905+0000 mgr.a (mgr.14355) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:33.042 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:33.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:33.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:33.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:33.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:34 smithi007 bash[22722]: audit 2024-09-14T05:54:32.620448+0000 mgr.a (mgr.14355) 19617 : audit [DBG] from='client.420183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:34 smithi007 bash[22722]: cluster 2024-09-14T05:54:33.316836+0000 mgr.a (mgr.14355) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:34 smithi131 bash[24745]: audit 2024-09-14T05:54:32.620448+0000 mgr.a (mgr.14355) 19617 : audit [DBG] from='client.420183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:34 smithi131 bash[24745]: cluster 2024-09-14T05:54:33.316836+0000 mgr.a (mgr.14355) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:34 smithi171 bash[25040]: audit 2024-09-14T05:54:32.620448+0000 mgr.a (mgr.14355) 19617 : audit [DBG] from='client.420183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:34 smithi171 bash[25040]: cluster 2024-09-14T05:54:33.316836+0000 mgr.a (mgr.14355) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:36.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:36 smithi007 bash[22722]: cluster 2024-09-14T05:54:35.319071+0000 mgr.a (mgr.14355) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:36.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:36 smithi131 bash[24745]: cluster 2024-09-14T05:54:35.319071+0000 mgr.a (mgr.14355) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:36.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:36 smithi171 bash[25040]: cluster 2024-09-14T05:54:35.319071+0000 mgr.a (mgr.14355) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:38.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:38.044 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:38 smithi007 bash[22722]: cluster 2024-09-14T05:54:37.319832+0000 mgr.a (mgr.14355) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:38 smithi131 bash[24745]: cluster 2024-09-14T05:54:37.319832+0000 mgr.a (mgr.14355) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:38 smithi171 bash[25040]: cluster 2024-09-14T05:54:37.319832+0000 mgr.a (mgr.14355) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:38.816 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:39.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:39 smithi007 bash[22722]: audit 2024-09-14T05:54:38.376191+0000 mgr.a (mgr.14355) 19621 : audit [DBG] from='client.420261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:39 smithi131 bash[24745]: audit 2024-09-14T05:54:38.376191+0000 mgr.a (mgr.14355) 19621 : audit [DBG] from='client.420261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:39.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:39 smithi171 bash[25040]: audit 2024-09-14T05:54:38.376191+0000 mgr.a (mgr.14355) 19621 : audit [DBG] from='client.420261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:40 smithi007 bash[22722]: cluster 2024-09-14T05:54:39.320818+0000 mgr.a (mgr.14355) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:40 smithi131 bash[24745]: cluster 2024-09-14T05:54:39.320818+0000 mgr.a (mgr.14355) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:40 smithi171 bash[25040]: cluster 2024-09-14T05:54:39.320818+0000 mgr.a (mgr.14355) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:42 smithi007 bash[22722]: cluster 2024-09-14T05:54:41.323105+0000 mgr.a (mgr.14355) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:42 smithi131 bash[24745]: cluster 2024-09-14T05:54:41.323105+0000 mgr.a (mgr.14355) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:42 smithi171 bash[25040]: cluster 2024-09-14T05:54:41.323105+0000 mgr.a (mgr.14355) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:43.817 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:43.818 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:43.819 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:44.573 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:44 smithi007 bash[22722]: cluster 2024-09-14T05:54:43.323889+0000 mgr.a (mgr.14355) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:44 smithi131 bash[24745]: cluster 2024-09-14T05:54:43.323889+0000 mgr.a (mgr.14355) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:44 smithi171 bash[25040]: cluster 2024-09-14T05:54:43.323889+0000 mgr.a (mgr.14355) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:45.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:45 smithi007 bash[22722]: audit 2024-09-14T05:54:44.151517+0000 mgr.a (mgr.14355) 19625 : audit [DBG] from='client.420339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:45 smithi131 bash[24745]: audit 2024-09-14T05:54:44.151517+0000 mgr.a (mgr.14355) 19625 : audit [DBG] from='client.420339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:45 smithi171 bash[25040]: audit 2024-09-14T05:54:44.151517+0000 mgr.a (mgr.14355) 19625 : audit [DBG] from='client.420339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:46.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:46 smithi007 bash[22722]: cluster 2024-09-14T05:54:45.326363+0000 mgr.a (mgr.14355) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:46 smithi131 bash[24745]: cluster 2024-09-14T05:54:45.326363+0000 mgr.a (mgr.14355) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:46 smithi171 bash[25040]: cluster 2024-09-14T05:54:45.326363+0000 mgr.a (mgr.14355) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:54:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:47 smithi007 bash[22722]: cluster 2024-09-14T05:54:47.327174+0000 mgr.a (mgr.14355) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:47 smithi131 bash[24745]: cluster 2024-09-14T05:54:47.327174+0000 mgr.a (mgr.14355) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:47 smithi171 bash[25040]: cluster 2024-09-14T05:54:47.327174+0000 mgr.a (mgr.14355) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:49.575 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:49.576 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:50.362 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:50.362 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:50 smithi007 bash[22722]: cluster 2024-09-14T05:54:49.327928+0000 mgr.a (mgr.14355) 19628 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:50 smithi131 bash[24745]: cluster 2024-09-14T05:54:49.327928+0000 mgr.a (mgr.14355) 19628 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:50 smithi171 bash[25040]: cluster 2024-09-14T05:54:49.327928+0000 mgr.a (mgr.14355) 19628 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:51 smithi007 bash[22722]: audit 2024-09-14T05:54:49.911478+0000 mgr.a (mgr.14355) 19629 : audit [DBG] from='client.420417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:51 smithi131 bash[24745]: audit 2024-09-14T05:54:49.911478+0000 mgr.a (mgr.14355) 19629 : audit [DBG] from='client.420417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:51 smithi171 bash[25040]: audit 2024-09-14T05:54:49.911478+0000 mgr.a (mgr.14355) 19629 : audit [DBG] from='client.420417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:52 smithi007 bash[22722]: cluster 2024-09-14T05:54:51.330789+0000 mgr.a (mgr.14355) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:54:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:52 smithi131 bash[24745]: cluster 2024-09-14T05:54:51.330789+0000 mgr.a (mgr.14355) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:54:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:52 smithi171 bash[25040]: cluster 2024-09-14T05:54:51.330789+0000 mgr.a (mgr.14355) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-14T05:54:54.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:54 smithi007 bash[22722]: cluster 2024-09-14T05:54:53.331590+0000 mgr.a (mgr.14355) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:54:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:54 smithi131 bash[24745]: cluster 2024-09-14T05:54:53.331590+0000 mgr.a (mgr.14355) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:54:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:54 smithi171 bash[25040]: cluster 2024-09-14T05:54:53.331590+0000 mgr.a (mgr.14355) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-14T05:54:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:54:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:54:55.364 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:54:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:54:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:54:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:54:56.140 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:54:56.141 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:54:56.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:56 smithi007 bash[22722]: cluster 2024-09-14T05:54:55.333529+0000 mgr.a (mgr.14355) 19632 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:56.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:56 smithi131 bash[24745]: cluster 2024-09-14T05:54:55.333529+0000 mgr.a (mgr.14355) 19632 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:56.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:56 smithi171 bash[25040]: cluster 2024-09-14T05:54:55.333529+0000 mgr.a (mgr.14355) 19632 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:54:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:57 smithi007 bash[22722]: audit 2024-09-14T05:54:55.700604+0000 mgr.a (mgr.14355) 19633 : audit [DBG] from='client.420492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:57 smithi131 bash[24745]: audit 2024-09-14T05:54:55.700604+0000 mgr.a (mgr.14355) 19633 : audit [DBG] from='client.420492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:57 smithi171 bash[25040]: audit 2024-09-14T05:54:55.700604+0000 mgr.a (mgr.14355) 19633 : audit [DBG] from='client.420492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:54:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:54:58 smithi007 bash[22722]: cluster 2024-09-14T05:54:57.334532+0000 mgr.a (mgr.14355) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:54:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:54:58 smithi131 bash[24745]: cluster 2024-09-14T05:54:57.334532+0000 mgr.a (mgr.14355) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:54:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:54:58 smithi171 bash[25040]: cluster 2024-09-14T05:54:57.334532+0000 mgr.a (mgr.14355) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:55:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:00 smithi007 bash[22722]: cluster 2024-09-14T05:54:59.335339+0000 mgr.a (mgr.14355) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:55:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:00 smithi131 bash[24745]: cluster 2024-09-14T05:54:59.335339+0000 mgr.a (mgr.14355) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:55:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:00 smithi171 bash[25040]: cluster 2024-09-14T05:54:59.335339+0000 mgr.a (mgr.14355) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:55:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:01.142 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:01.143 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:01.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:01.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:01.906 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:01.907 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:01.907 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:02.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:02 smithi007 bash[22722]: cluster 2024-09-14T05:55:01.336693+0000 mgr.a (mgr.14355) 19636 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:02.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:02 smithi131 bash[24745]: cluster 2024-09-14T05:55:01.336693+0000 mgr.a (mgr.14355) 19636 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:02.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:02 smithi171 bash[25040]: cluster 2024-09-14T05:55:01.336693+0000 mgr.a (mgr.14355) 19636 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:03 smithi007 bash[22722]: audit 2024-09-14T05:55:01.478504+0000 mgr.a (mgr.14355) 19637 : audit [DBG] from='client.420567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:03 smithi131 bash[24745]: audit 2024-09-14T05:55:01.478504+0000 mgr.a (mgr.14355) 19637 : audit [DBG] from='client.420567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:03 smithi171 bash[25040]: audit 2024-09-14T05:55:01.478504+0000 mgr.a (mgr.14355) 19637 : audit [DBG] from='client.420567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:04 smithi007 bash[22722]: cluster 2024-09-14T05:55:03.337558+0000 mgr.a (mgr.14355) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:04 smithi131 bash[24745]: cluster 2024-09-14T05:55:03.337558+0000 mgr.a (mgr.14355) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:04 smithi171 bash[25040]: cluster 2024-09-14T05:55:03.337558+0000 mgr.a (mgr.14355) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:05 smithi007 bash[22722]: cluster 2024-09-14T05:55:05.339740+0000 mgr.a (mgr.14355) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:05 smithi131 bash[24745]: cluster 2024-09-14T05:55:05.339740+0000 mgr.a (mgr.14355) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:05 smithi171 bash[25040]: cluster 2024-09-14T05:55:05.339740+0000 mgr.a (mgr.14355) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:07.643 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:07.644 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:08 smithi007 bash[22722]: audit 2024-09-14T05:55:07.229066+0000 mgr.a (mgr.14355) 19640 : audit [DBG] from='client.420645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:08 smithi007 bash[22722]: cluster 2024-09-14T05:55:07.340305+0000 mgr.a (mgr.14355) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:08.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:08 smithi007 bash[22722]: audit 2024-09-14T05:55:07.625747+0000 mon.a (mon.0) 3513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:55:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:08 smithi131 bash[24745]: audit 2024-09-14T05:55:07.229066+0000 mgr.a (mgr.14355) 19640 : audit [DBG] from='client.420645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:08 smithi131 bash[24745]: cluster 2024-09-14T05:55:07.340305+0000 mgr.a (mgr.14355) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:08.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:08 smithi131 bash[24745]: audit 2024-09-14T05:55:07.625747+0000 mon.a (mon.0) 3513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:08 smithi171 bash[25040]: audit 2024-09-14T05:55:07.229066+0000 mgr.a (mgr.14355) 19640 : audit [DBG] from='client.420645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:08 smithi171 bash[25040]: cluster 2024-09-14T05:55:07.340305+0000 mgr.a (mgr.14355) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:08.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:08 smithi171 bash[25040]: audit 2024-09-14T05:55:07.625747+0000 mon.a (mon.0) 3513 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:55:10.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:10 smithi007 bash[22722]: cluster 2024-09-14T05:55:09.341326+0000 mgr.a (mgr.14355) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:10.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:10 smithi131 bash[24745]: cluster 2024-09-14T05:55:09.341326+0000 mgr.a (mgr.14355) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:10.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:10 smithi171 bash[25040]: cluster 2024-09-14T05:55:09.341326+0000 mgr.a (mgr.14355) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:12.645 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:12.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:12.646 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:12.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:12 smithi007 bash[22722]: cluster 2024-09-14T05:55:11.343668+0000 mgr.a (mgr.14355) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:12 smithi131 bash[24745]: cluster 2024-09-14T05:55:11.343668+0000 mgr.a (mgr.14355) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:12 smithi171 bash[25040]: cluster 2024-09-14T05:55:11.343668+0000 mgr.a (mgr.14355) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:13.426 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:13.427 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:14.659 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:14 smithi007 bash[22722]: audit 2024-09-14T05:55:12.981181+0000 mgr.a (mgr.14355) 19644 : audit [DBG] from='client.420720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:14.660 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:14 smithi007 bash[22722]: cluster 2024-09-14T05:55:13.344217+0000 mgr.a (mgr.14355) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:14 smithi131 bash[24745]: audit 2024-09-14T05:55:12.981181+0000 mgr.a (mgr.14355) 19644 : audit [DBG] from='client.420720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:14 smithi131 bash[24745]: cluster 2024-09-14T05:55:13.344217+0000 mgr.a (mgr.14355) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:14 smithi171 bash[25040]: audit 2024-09-14T05:55:12.981181+0000 mgr.a (mgr.14355) 19644 : audit [DBG] from='client.420720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:14 smithi171 bash[25040]: cluster 2024-09-14T05:55:13.344217+0000 mgr.a (mgr.14355) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:16.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:16 smithi007 bash[22722]: cluster 2024-09-14T05:55:15.346393+0000 mgr.a (mgr.14355) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:16.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:16 smithi131 bash[24745]: cluster 2024-09-14T05:55:15.346393+0000 mgr.a (mgr.14355) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:16.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:16 smithi171 bash[25040]: cluster 2024-09-14T05:55:15.346393+0000 mgr.a (mgr.14355) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:18.428 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:18.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:18.428 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: cluster 2024-09-14T05:55:17.346949+0000 mgr.a (mgr.14355) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.276584+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.295077+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.297561+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:55:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.299713+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:55:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.312243+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:18 smithi007 bash[22722]: audit 2024-09-14T05:55:18.317742+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:18.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: cluster 2024-09-14T05:55:17.346949+0000 mgr.a (mgr.14355) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.276584+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.295077+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.297561+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.299713+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.312243+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:18 smithi131 bash[24745]: audit 2024-09-14T05:55:18.317742+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: cluster 2024-09-14T05:55:17.346949+0000 mgr.a (mgr.14355) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.276584+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.295077+0000 mon.a (mon.0) 3515 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.297561+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.299713+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.312243+0000 mon.a (mon.0) 3518 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:55:18.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:18 smithi171 bash[25040]: audit 2024-09-14T05:55:18.317742+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:19.416 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:55:19 smithi007 bash[22972]: debug 2024-09-14T05:55:19.134+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:55:19.416 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:55:19 smithi007 bash[22972]: debug 2024-09-14T05:55:19.150+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:55:19.570 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:19.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:19 smithi007 bash[22722]: audit 2024-09-14T05:55:18.320226+0000 mgr.a (mgr.14355) 19648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:19 smithi131 bash[24745]: audit 2024-09-14T05:55:18.320226+0000 mgr.a (mgr.14355) 19648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:19 smithi171 bash[25040]: audit 2024-09-14T05:55:18.320226+0000 mgr.a (mgr.14355) 19648 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:55:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:20 smithi007 bash[22722]: audit 2024-09-14T05:55:18.777377+0000 mgr.a (mgr.14355) 19649 : audit [DBG] from='client.420819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:20 smithi007 bash[22722]: audit 2024-09-14T05:55:19.139440+0000 mgr.a (mgr.14355) 19650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:55:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:20 smithi007 bash[22722]: cephadm 2024-09-14T05:55:19.154923+0000 mgr.a (mgr.14355) 19651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:55:20.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:20 smithi007 bash[22722]: cluster 2024-09-14T05:55:19.347491+0000 mgr.a (mgr.14355) 19652 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:20 smithi131 bash[24745]: audit 2024-09-14T05:55:18.777377+0000 mgr.a (mgr.14355) 19649 : audit [DBG] from='client.420819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:20 smithi131 bash[24745]: audit 2024-09-14T05:55:19.139440+0000 mgr.a (mgr.14355) 19650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:55:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:20 smithi131 bash[24745]: cephadm 2024-09-14T05:55:19.154923+0000 mgr.a (mgr.14355) 19651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:55:20.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:20 smithi131 bash[24745]: cluster 2024-09-14T05:55:19.347491+0000 mgr.a (mgr.14355) 19652 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:20 smithi171 bash[25040]: audit 2024-09-14T05:55:18.777377+0000 mgr.a (mgr.14355) 19649 : audit [DBG] from='client.420819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:20 smithi171 bash[25040]: audit 2024-09-14T05:55:19.139440+0000 mgr.a (mgr.14355) 19650 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:55:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:20 smithi171 bash[25040]: cephadm 2024-09-14T05:55:19.154923+0000 mgr.a (mgr.14355) 19651 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:55:20.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:20 smithi171 bash[25040]: cluster 2024-09-14T05:55:19.347491+0000 mgr.a (mgr.14355) 19652 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:21 smithi007 bash[22722]: cluster 2024-09-14T05:55:21.349800+0000 mgr.a (mgr.14355) 19653 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:21 smithi131 bash[24745]: cluster 2024-09-14T05:55:21.349800+0000 mgr.a (mgr.14355) 19653 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:21 smithi171 bash[25040]: cluster 2024-09-14T05:55:21.349800+0000 mgr.a (mgr.14355) 19653 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:24.571 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:24.572 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:24.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:24 smithi007 bash[22722]: cluster 2024-09-14T05:55:23.350603+0000 mgr.a (mgr.14355) 19654 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:24.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:24 smithi131 bash[24745]: cluster 2024-09-14T05:55:23.350603+0000 mgr.a (mgr.14355) 19654 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:24 smithi171 bash[25040]: cluster 2024-09-14T05:55:23.350603+0000 mgr.a (mgr.14355) 19654 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:25.337 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:25.338 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:26 smithi007 bash[22722]: audit 2024-09-14T05:55:24.902637+0000 mgr.a (mgr.14355) 19655 : audit [DBG] from='client.420984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:26.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:26 smithi007 bash[22722]: cluster 2024-09-14T05:55:25.351703+0000 mgr.a (mgr.14355) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:26 smithi131 bash[24745]: audit 2024-09-14T05:55:24.902637+0000 mgr.a (mgr.14355) 19655 : audit [DBG] from='client.420984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:26 smithi131 bash[24745]: cluster 2024-09-14T05:55:25.351703+0000 mgr.a (mgr.14355) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:26 smithi171 bash[25040]: audit 2024-09-14T05:55:24.902637+0000 mgr.a (mgr.14355) 19655 : audit [DBG] from='client.420984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:26 smithi171 bash[25040]: cluster 2024-09-14T05:55:25.351703+0000 mgr.a (mgr.14355) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:28.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:28 smithi007 bash[22722]: cluster 2024-09-14T05:55:27.352421+0000 mgr.a (mgr.14355) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:28 smithi131 bash[24745]: cluster 2024-09-14T05:55:27.352421+0000 mgr.a (mgr.14355) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:28 smithi171 bash[25040]: cluster 2024-09-14T05:55:27.352421+0000 mgr.a (mgr.14355) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:30.339 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:30.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:30.340 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:30 smithi007 bash[22722]: cluster 2024-09-14T05:55:29.353231+0000 mgr.a (mgr.14355) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:30.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:30 smithi131 bash[24745]: cluster 2024-09-14T05:55:29.353231+0000 mgr.a (mgr.14355) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:30.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:30 smithi171 bash[25040]: cluster 2024-09-14T05:55:29.353231+0000 mgr.a (mgr.14355) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:55:31.110 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:31.110 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:32 smithi007 bash[22722]: audit 2024-09-14T05:55:30.672537+0000 mgr.a (mgr.14355) 19659 : audit [DBG] from='client.421056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:32 smithi007 bash[22722]: cluster 2024-09-14T05:55:31.356042+0000 mgr.a (mgr.14355) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:32 smithi131 bash[24745]: audit 2024-09-14T05:55:30.672537+0000 mgr.a (mgr.14355) 19659 : audit [DBG] from='client.421056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:32.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:32 smithi131 bash[24745]: cluster 2024-09-14T05:55:31.356042+0000 mgr.a (mgr.14355) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:32 smithi171 bash[25040]: audit 2024-09-14T05:55:30.672537+0000 mgr.a (mgr.14355) 19659 : audit [DBG] from='client.421056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:32 smithi171 bash[25040]: cluster 2024-09-14T05:55:31.356042+0000 mgr.a (mgr.14355) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:55:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:34 smithi007 bash[22722]: cluster 2024-09-14T05:55:33.356836+0000 mgr.a (mgr.14355) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:55:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:34 smithi131 bash[24745]: cluster 2024-09-14T05:55:33.356836+0000 mgr.a (mgr.14355) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:55:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:34 smithi171 bash[25040]: cluster 2024-09-14T05:55:33.356836+0000 mgr.a (mgr.14355) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:55:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:35 smithi131 bash[24745]: cluster 2024-09-14T05:55:35.358785+0000 mgr.a (mgr.14355) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:35 smithi171 bash[25040]: cluster 2024-09-14T05:55:35.358785+0000 mgr.a (mgr.14355) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:35 smithi007 bash[22722]: cluster 2024-09-14T05:55:35.358785+0000 mgr.a (mgr.14355) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:36.111 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:36.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:36.112 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:36.855 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:36.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:36.856 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:38.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:38 smithi007 bash[22722]: audit 2024-09-14T05:55:36.443272+0000 mgr.a (mgr.14355) 19663 : audit [DBG] from='client.421134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:38.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:38 smithi007 bash[22722]: cluster 2024-09-14T05:55:37.359784+0000 mgr.a (mgr.14355) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:38 smithi131 bash[24745]: audit 2024-09-14T05:55:36.443272+0000 mgr.a (mgr.14355) 19663 : audit [DBG] from='client.421134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:38 smithi131 bash[24745]: cluster 2024-09-14T05:55:37.359784+0000 mgr.a (mgr.14355) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:38 smithi171 bash[25040]: audit 2024-09-14T05:55:36.443272+0000 mgr.a (mgr.14355) 19663 : audit [DBG] from='client.421134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:38 smithi171 bash[25040]: cluster 2024-09-14T05:55:37.359784+0000 mgr.a (mgr.14355) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:40.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:40 smithi007 bash[22722]: cluster 2024-09-14T05:55:39.360610+0000 mgr.a (mgr.14355) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:40 smithi131 bash[24745]: cluster 2024-09-14T05:55:39.360610+0000 mgr.a (mgr.14355) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:40 smithi171 bash[25040]: cluster 2024-09-14T05:55:39.360610+0000 mgr.a (mgr.14355) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-14T05:55:41.857 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:42.623 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:42.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:42 smithi007 bash[22722]: cluster 2024-09-14T05:55:41.362897+0000 mgr.a (mgr.14355) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:42.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:42 smithi131 bash[24745]: cluster 2024-09-14T05:55:41.362897+0000 mgr.a (mgr.14355) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:42.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:42 smithi171 bash[25040]: cluster 2024-09-14T05:55:41.362897+0000 mgr.a (mgr.14355) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-14T05:55:43.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:43 smithi007 bash[22722]: audit 2024-09-14T05:55:42.188468+0000 mgr.a (mgr.14355) 19667 : audit [DBG] from='client.421206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:43 smithi131 bash[24745]: audit 2024-09-14T05:55:42.188468+0000 mgr.a (mgr.14355) 19667 : audit [DBG] from='client.421206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:43 smithi171 bash[25040]: audit 2024-09-14T05:55:42.188468+0000 mgr.a (mgr.14355) 19667 : audit [DBG] from='client.421206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:44.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:44 smithi007 bash[22722]: cluster 2024-09-14T05:55:43.363877+0000 mgr.a (mgr.14355) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:44.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:44 smithi131 bash[24745]: cluster 2024-09-14T05:55:43.363877+0000 mgr.a (mgr.14355) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:44.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:44 smithi171 bash[25040]: cluster 2024-09-14T05:55:43.363877+0000 mgr.a (mgr.14355) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:45 smithi131 bash[24745]: cluster 2024-09-14T05:55:45.366054+0000 mgr.a (mgr.14355) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:45 smithi171 bash[25040]: cluster 2024-09-14T05:55:45.366054+0000 mgr.a (mgr.14355) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:45 smithi007 bash[22722]: cluster 2024-09-14T05:55:45.366054+0000 mgr.a (mgr.14355) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:48.372 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:48.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:48.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:48 smithi007 bash[22722]: cluster 2024-09-14T05:55:47.366838+0000 mgr.a (mgr.14355) 19670 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:48.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:48 smithi131 bash[24745]: cluster 2024-09-14T05:55:47.366838+0000 mgr.a (mgr.14355) 19670 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:48.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:48 smithi171 bash[25040]: cluster 2024-09-14T05:55:47.366838+0000 mgr.a (mgr.14355) 19670 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:49 smithi007 bash[22722]: audit 2024-09-14T05:55:47.951518+0000 mgr.a (mgr.14355) 19671 : audit [DBG] from='client.421281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:49 smithi131 bash[24745]: audit 2024-09-14T05:55:47.951518+0000 mgr.a (mgr.14355) 19671 : audit [DBG] from='client.421281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:49 smithi171 bash[25040]: audit 2024-09-14T05:55:47.951518+0000 mgr.a (mgr.14355) 19671 : audit [DBG] from='client.421281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:50.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:50 smithi007 bash[22722]: cluster 2024-09-14T05:55:49.367701+0000 mgr.a (mgr.14355) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:50.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:50 smithi131 bash[24745]: cluster 2024-09-14T05:55:49.367701+0000 mgr.a (mgr.14355) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:50.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:50 smithi171 bash[25040]: cluster 2024-09-14T05:55:49.367701+0000 mgr.a (mgr.14355) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:52 smithi007 bash[22722]: cluster 2024-09-14T05:55:51.369960+0000 mgr.a (mgr.14355) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:52 smithi131 bash[24745]: cluster 2024-09-14T05:55:51.369960+0000 mgr.a (mgr.14355) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:52 smithi171 bash[25040]: cluster 2024-09-14T05:55:51.369960+0000 mgr.a (mgr.14355) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:53 smithi007 bash[22722]: cluster 2024-09-14T05:55:53.370747+0000 mgr.a (mgr.14355) 19674 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:53 smithi131 bash[24745]: cluster 2024-09-14T05:55:53.370747+0000 mgr.a (mgr.14355) 19674 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:53 smithi171 bash[25040]: cluster 2024-09-14T05:55:53.370747+0000 mgr.a (mgr.14355) 19674 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:54.146 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:54.146 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:54 smithi007 bash[22722]: audit 2024-09-14T05:55:53.709292+0000 mgr.a (mgr.14355) 19675 : audit [DBG] from='client.421359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:54 smithi131 bash[24745]: audit 2024-09-14T05:55:53.709292+0000 mgr.a (mgr.14355) 19675 : audit [DBG] from='client.421359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:54 smithi171 bash[25040]: audit 2024-09-14T05:55:53.709292+0000 mgr.a (mgr.14355) 19675 : audit [DBG] from='client.421359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:55:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:55 smithi007 bash[22722]: cluster 2024-09-14T05:55:55.372981+0000 mgr.a (mgr.14355) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:55 smithi131 bash[24745]: cluster 2024-09-14T05:55:55.372981+0000 mgr.a (mgr.14355) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:55 smithi171 bash[25040]: cluster 2024-09-14T05:55:55.372981+0000 mgr.a (mgr.14355) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:55:58.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:58 smithi007 bash[22722]: cluster 2024-09-14T05:55:57.373759+0000 mgr.a (mgr.14355) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:58.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:58 smithi131 bash[24745]: cluster 2024-09-14T05:55:57.373759+0000 mgr.a (mgr.14355) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:58.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:58 smithi171 bash[25040]: cluster 2024-09-14T05:55:57.373759+0000 mgr.a (mgr.14355) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:55:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:55:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:55:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:55:59 smithi131 bash[24745]: cluster 2024-09-14T05:55:59.374510+0000 mgr.a (mgr.14355) 19678 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:55:59 smithi171 bash[25040]: cluster 2024-09-14T05:55:59.374510+0000 mgr.a (mgr.14355) 19678 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:55:59.925 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:55:59.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:55:59.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:55:59.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:55:59.926 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:55:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:55:59 smithi007 bash[22722]: cluster 2024-09-14T05:55:59.374510+0000 mgr.a (mgr.14355) 19678 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:00 smithi131 bash[24745]: audit 2024-09-14T05:55:59.486577+0000 mgr.a (mgr.14355) 19679 : audit [DBG] from='client.421431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:00 smithi171 bash[25040]: audit 2024-09-14T05:55:59.486577+0000 mgr.a (mgr.14355) 19679 : audit [DBG] from='client.421431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:00.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:00 smithi007 bash[22722]: audit 2024-09-14T05:55:59.486577+0000 mgr.a (mgr.14355) 19679 : audit [DBG] from='client.421431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:01 smithi131 bash[24745]: cluster 2024-09-14T05:56:01.376877+0000 mgr.a (mgr.14355) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:01 smithi171 bash[25040]: cluster 2024-09-14T05:56:01.376877+0000 mgr.a (mgr.14355) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:01 smithi007 bash[22722]: cluster 2024-09-14T05:56:01.376877+0000 mgr.a (mgr.14355) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:04.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:04 smithi007 bash[22722]: cluster 2024-09-14T05:56:03.377655+0000 mgr.a (mgr.14355) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:04.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:04 smithi131 bash[24745]: cluster 2024-09-14T05:56:03.377655+0000 mgr.a (mgr.14355) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:04.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:04 smithi171 bash[25040]: cluster 2024-09-14T05:56:03.377655+0000 mgr.a (mgr.14355) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:04.927 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:04.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:04.928 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:05.692 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:05.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:05.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:05.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:05.692 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:05 smithi007 bash[22722]: audit 2024-09-14T05:56:05.264827+0000 mgr.a (mgr.14355) 19682 : audit [DBG] from='client.421509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:05 smithi007 bash[22722]: cluster 2024-09-14T05:56:05.379033+0000 mgr.a (mgr.14355) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:05 smithi131 bash[24745]: audit 2024-09-14T05:56:05.264827+0000 mgr.a (mgr.14355) 19682 : audit [DBG] from='client.421509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:05 smithi131 bash[24745]: cluster 2024-09-14T05:56:05.379033+0000 mgr.a (mgr.14355) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:05 smithi171 bash[25040]: audit 2024-09-14T05:56:05.264827+0000 mgr.a (mgr.14355) 19682 : audit [DBG] from='client.421509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:05 smithi171 bash[25040]: cluster 2024-09-14T05:56:05.379033+0000 mgr.a (mgr.14355) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:07 smithi131 bash[24745]: cluster 2024-09-14T05:56:07.380044+0000 mgr.a (mgr.14355) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:07 smithi171 bash[25040]: cluster 2024-09-14T05:56:07.380044+0000 mgr.a (mgr.14355) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:07 smithi007 bash[22722]: cluster 2024-09-14T05:56:07.380044+0000 mgr.a (mgr.14355) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:09 smithi131 bash[24745]: cluster 2024-09-14T05:56:09.381009+0000 mgr.a (mgr.14355) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:09 smithi171 bash[25040]: cluster 2024-09-14T05:56:09.381009+0000 mgr.a (mgr.14355) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:09 smithi007 bash[22722]: cluster 2024-09-14T05:56:09.381009+0000 mgr.a (mgr.14355) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:10.693 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:10.694 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:11 smithi131 bash[24745]: audit 2024-09-14T05:56:11.026659+0000 mgr.a (mgr.14355) 19686 : audit [DBG] from='client.421584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:11 smithi131 bash[24745]: cluster 2024-09-14T05:56:11.382616+0000 mgr.a (mgr.14355) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:11 smithi171 bash[25040]: audit 2024-09-14T05:56:11.026659+0000 mgr.a (mgr.14355) 19686 : audit [DBG] from='client.421584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:11 smithi171 bash[25040]: cluster 2024-09-14T05:56:11.382616+0000 mgr.a (mgr.14355) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:11 smithi007 bash[22722]: audit 2024-09-14T05:56:11.026659+0000 mgr.a (mgr.14355) 19686 : audit [DBG] from='client.421584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:11 smithi007 bash[22722]: cluster 2024-09-14T05:56:11.382616+0000 mgr.a (mgr.14355) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:13 smithi131 bash[24745]: cluster 2024-09-14T05:56:13.383480+0000 mgr.a (mgr.14355) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:13 smithi171 bash[25040]: cluster 2024-09-14T05:56:13.383480+0000 mgr.a (mgr.14355) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:13 smithi007 bash[22722]: cluster 2024-09-14T05:56:13.383480+0000 mgr.a (mgr.14355) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:15 smithi131 bash[24745]: cluster 2024-09-14T05:56:15.385433+0000 mgr.a (mgr.14355) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:15 smithi171 bash[25040]: cluster 2024-09-14T05:56:15.385433+0000 mgr.a (mgr.14355) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:15 smithi007 bash[22722]: cluster 2024-09-14T05:56:15.385433+0000 mgr.a (mgr.14355) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:16.456 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:16.457 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:17.217 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:17.217 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:17 smithi131 bash[24745]: audit 2024-09-14T05:56:16.789043+0000 mgr.a (mgr.14355) 19690 : audit [DBG] from='client.421659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:17 smithi131 bash[24745]: cluster 2024-09-14T05:56:17.386390+0000 mgr.a (mgr.14355) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:17 smithi171 bash[25040]: audit 2024-09-14T05:56:16.789043+0000 mgr.a (mgr.14355) 19690 : audit [DBG] from='client.421659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:17 smithi171 bash[25040]: cluster 2024-09-14T05:56:17.386390+0000 mgr.a (mgr.14355) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:17 smithi007 bash[22722]: audit 2024-09-14T05:56:16.789043+0000 mgr.a (mgr.14355) 19690 : audit [DBG] from='client.421659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:17 smithi007 bash[22722]: cluster 2024-09-14T05:56:17.386390+0000 mgr.a (mgr.14355) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:19.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:19 smithi171 bash[25040]: audit 2024-09-14T05:56:19.229151+0000 mon.a (mon.0) 3520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:56:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:19 smithi007 bash[22722]: audit 2024-09-14T05:56:19.229151+0000 mon.a (mon.0) 3520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:56:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:19 smithi131 bash[24745]: audit 2024-09-14T05:56:19.229151+0000 mon.a (mon.0) 3520 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:56:20.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:20 smithi171 bash[25040]: cluster 2024-09-14T05:56:19.386964+0000 mgr.a (mgr.14355) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:20.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:20 smithi007 bash[22722]: cluster 2024-09-14T05:56:19.386964+0000 mgr.a (mgr.14355) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:20 smithi131 bash[24745]: cluster 2024-09-14T05:56:19.386964+0000 mgr.a (mgr.14355) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:21 smithi131 bash[24745]: cluster 2024-09-14T05:56:21.389148+0000 mgr.a (mgr.14355) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:21 smithi171 bash[25040]: cluster 2024-09-14T05:56:21.389148+0000 mgr.a (mgr.14355) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:21 smithi007 bash[22722]: cluster 2024-09-14T05:56:21.389148+0000 mgr.a (mgr.14355) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:22.218 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:22.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:22.219 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:22.968 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:22.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:22.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:22.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:22.968 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:23 smithi131 bash[24745]: audit 2024-09-14T05:56:22.552078+0000 mgr.a (mgr.14355) 19694 : audit [DBG] from='client.421728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:23 smithi131 bash[24745]: cluster 2024-09-14T05:56:23.390284+0000 mgr.a (mgr.14355) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:23 smithi171 bash[25040]: audit 2024-09-14T05:56:22.552078+0000 mgr.a (mgr.14355) 19694 : audit [DBG] from='client.421728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:23 smithi171 bash[25040]: cluster 2024-09-14T05:56:23.390284+0000 mgr.a (mgr.14355) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:23 smithi007 bash[22722]: audit 2024-09-14T05:56:22.552078+0000 mgr.a (mgr.14355) 19694 : audit [DBG] from='client.421728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:23 smithi007 bash[22722]: cluster 2024-09-14T05:56:23.390284+0000 mgr.a (mgr.14355) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:25 smithi131 bash[24745]: cluster 2024-09-14T05:56:25.392679+0000 mgr.a (mgr.14355) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:25 smithi171 bash[25040]: cluster 2024-09-14T05:56:25.392679+0000 mgr.a (mgr.14355) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:25 smithi007 bash[22722]: cluster 2024-09-14T05:56:25.392679+0000 mgr.a (mgr.14355) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:56:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:27 smithi131 bash[24745]: cluster 2024-09-14T05:56:27.393622+0000 mgr.a (mgr.14355) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:27 smithi171 bash[25040]: cluster 2024-09-14T05:56:27.393622+0000 mgr.a (mgr.14355) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:27 smithi007 bash[22722]: cluster 2024-09-14T05:56:27.393622+0000 mgr.a (mgr.14355) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:27.969 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:27.970 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:28.710 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:28.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:28.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:28 smithi131 bash[24745]: audit 2024-09-14T05:56:28.299289+0000 mgr.a (mgr.14355) 19698 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:28.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:28 smithi171 bash[25040]: audit 2024-09-14T05:56:28.299289+0000 mgr.a (mgr.14355) 19698 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:28 smithi007 bash[22722]: audit 2024-09-14T05:56:28.299289+0000 mgr.a (mgr.14355) 19698 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:29 smithi131 bash[24745]: cluster 2024-09-14T05:56:29.394563+0000 mgr.a (mgr.14355) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:29.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:29 smithi171 bash[25040]: cluster 2024-09-14T05:56:29.394563+0000 mgr.a (mgr.14355) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:29 smithi007 bash[22722]: cluster 2024-09-14T05:56:29.394563+0000 mgr.a (mgr.14355) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22972]: debug 2024-09-14T05:56:30.597+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:56:30.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22972]: debug 2024-09-14T05:56:30.601+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.718717+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.726690+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.808493+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.816723+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.818836+0000 mon.a (mon.0) 3525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.820950+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.831484+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.836649+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:30.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:30 smithi007 bash[22722]: audit 2024-09-14T05:56:29.839260+0000 mgr.a (mgr.14355) 19700 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.718717+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.726690+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.808493+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.816723+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.818836+0000 mon.a (mon.0) 3525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.820950+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.831484+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.836649+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:31.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:30 smithi131 bash[24745]: audit 2024-09-14T05:56:29.839260+0000 mgr.a (mgr.14355) 19700 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.718717+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.726690+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.808493+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.816723+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.818836+0000 mon.a (mon.0) 3525 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.820950+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.831484+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.836649+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:31.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:30 smithi171 bash[25040]: audit 2024-09-14T05:56:29.839260+0000 mgr.a (mgr.14355) 19700 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:56:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:31 smithi131 bash[24745]: audit 2024-09-14T05:56:30.600331+0000 mgr.a (mgr.14355) 19701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:56:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:31 smithi131 bash[24745]: cephadm 2024-09-14T05:56:30.602368+0000 mgr.a (mgr.14355) 19702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:56:32.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:31 smithi131 bash[24745]: cluster 2024-09-14T05:56:31.397310+0000 mgr.a (mgr.14355) 19703 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:56:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:31 smithi171 bash[25040]: audit 2024-09-14T05:56:30.600331+0000 mgr.a (mgr.14355) 19701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:56:32.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:31 smithi171 bash[25040]: cephadm 2024-09-14T05:56:30.602368+0000 mgr.a (mgr.14355) 19702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:56:32.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:31 smithi171 bash[25040]: cluster 2024-09-14T05:56:31.397310+0000 mgr.a (mgr.14355) 19703 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:56:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:31 smithi007 bash[22722]: audit 2024-09-14T05:56:30.600331+0000 mgr.a (mgr.14355) 19701 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:56:32.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:31 smithi007 bash[22722]: cephadm 2024-09-14T05:56:30.602368+0000 mgr.a (mgr.14355) 19702 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:56:32.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:31 smithi007 bash[22722]: cluster 2024-09-14T05:56:31.397310+0000 mgr.a (mgr.14355) 19703 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-14T05:56:33.712 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:33.713 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:33 smithi131 bash[24745]: cluster 2024-09-14T05:56:33.398119+0000 mgr.a (mgr.14355) 19704 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:56:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:33 smithi171 bash[25040]: cluster 2024-09-14T05:56:33.398119+0000 mgr.a (mgr.14355) 19704 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:56:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:33 smithi007 bash[22722]: cluster 2024-09-14T05:56:33.398119+0000 mgr.a (mgr.14355) 19704 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:56:34.500 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:34.500 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:34.501 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:34 smithi131 bash[24745]: audit 2024-09-14T05:56:34.048332+0000 mgr.a (mgr.14355) 19705 : audit [DBG] from='client.421989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:34 smithi171 bash[25040]: audit 2024-09-14T05:56:34.048332+0000 mgr.a (mgr.14355) 19705 : audit [DBG] from='client.421989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:34.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:34 smithi007 bash[22722]: audit 2024-09-14T05:56:34.048332+0000 mgr.a (mgr.14355) 19705 : audit [DBG] from='client.421989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:35 smithi131 bash[24745]: cluster 2024-09-14T05:56:35.400420+0000 mgr.a (mgr.14355) 19706 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:35 smithi171 bash[25040]: cluster 2024-09-14T05:56:35.400420+0000 mgr.a (mgr.14355) 19706 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:35 smithi007 bash[22722]: cluster 2024-09-14T05:56:35.400420+0000 mgr.a (mgr.14355) 19706 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:37 smithi131 bash[24745]: cluster 2024-09-14T05:56:37.401171+0000 mgr.a (mgr.14355) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:37 smithi171 bash[25040]: cluster 2024-09-14T05:56:37.401171+0000 mgr.a (mgr.14355) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:37 smithi007 bash[22722]: cluster 2024-09-14T05:56:37.401171+0000 mgr.a (mgr.14355) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:39.502 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:39.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:39.502 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:39 smithi131 bash[24745]: cluster 2024-09-14T05:56:39.401959+0000 mgr.a (mgr.14355) 19708 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:39 smithi171 bash[25040]: cluster 2024-09-14T05:56:39.401959+0000 mgr.a (mgr.14355) 19708 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:39 smithi007 bash[22722]: cluster 2024-09-14T05:56:39.401959+0000 mgr.a (mgr.14355) 19708 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:40.272 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:40.272 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:40.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:40 smithi131 bash[24745]: audit 2024-09-14T05:56:39.835640+0000 mgr.a (mgr.14355) 19709 : audit [DBG] from='client.422061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:40.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:40 smithi171 bash[25040]: audit 2024-09-14T05:56:39.835640+0000 mgr.a (mgr.14355) 19709 : audit [DBG] from='client.422061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:40.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:40 smithi007 bash[22722]: audit 2024-09-14T05:56:39.835640+0000 mgr.a (mgr.14355) 19709 : audit [DBG] from='client.422061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:41 smithi131 bash[24745]: cluster 2024-09-14T05:56:41.404480+0000 mgr.a (mgr.14355) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:41 smithi171 bash[25040]: cluster 2024-09-14T05:56:41.404480+0000 mgr.a (mgr.14355) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:41 smithi007 bash[22722]: cluster 2024-09-14T05:56:41.404480+0000 mgr.a (mgr.14355) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:56:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:43 smithi131 bash[24745]: cluster 2024-09-14T05:56:43.405281+0000 mgr.a (mgr.14355) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:43 smithi171 bash[25040]: cluster 2024-09-14T05:56:43.405281+0000 mgr.a (mgr.14355) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:43 smithi007 bash[22722]: cluster 2024-09-14T05:56:43.405281+0000 mgr.a (mgr.14355) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:45 smithi131 bash[24745]: cluster 2024-09-14T05:56:45.406692+0000 mgr.a (mgr.14355) 19712 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:45 smithi171 bash[25040]: cluster 2024-09-14T05:56:45.406692+0000 mgr.a (mgr.14355) 19712 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:45 smithi007 bash[22722]: cluster 2024-09-14T05:56:45.406692+0000 mgr.a (mgr.14355) 19712 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:46.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:46 smithi131 bash[24745]: audit 2024-09-14T05:56:45.601174+0000 mgr.a (mgr.14355) 19713 : audit [DBG] from='client.422136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:46.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:46 smithi171 bash[25040]: audit 2024-09-14T05:56:45.601174+0000 mgr.a (mgr.14355) 19713 : audit [DBG] from='client.422136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:46.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:46 smithi007 bash[22722]: audit 2024-09-14T05:56:45.601174+0000 mgr.a (mgr.14355) 19713 : audit [DBG] from='client.422136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:47 smithi131 bash[24745]: cluster 2024-09-14T05:56:47.407559+0000 mgr.a (mgr.14355) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:47 smithi171 bash[25040]: cluster 2024-09-14T05:56:47.407559+0000 mgr.a (mgr.14355) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:47 smithi007 bash[22722]: cluster 2024-09-14T05:56:47.407559+0000 mgr.a (mgr.14355) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:49 smithi131 bash[24745]: cluster 2024-09-14T05:56:49.408319+0000 mgr.a (mgr.14355) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:49 smithi171 bash[25040]: cluster 2024-09-14T05:56:49.408319+0000 mgr.a (mgr.14355) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:49 smithi007 bash[22722]: cluster 2024-09-14T05:56:49.408319+0000 mgr.a (mgr.14355) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:56:51.025 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:51.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:51.025 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:51.807 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:51.808 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:52 smithi007 bash[22722]: audit 2024-09-14T05:56:51.361033+0000 mgr.a (mgr.14355) 19716 : audit [DBG] from='client.422214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:52.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:52 smithi007 bash[22722]: cluster 2024-09-14T05:56:51.411170+0000 mgr.a (mgr.14355) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:52 smithi131 bash[24745]: audit 2024-09-14T05:56:51.361033+0000 mgr.a (mgr.14355) 19716 : audit [DBG] from='client.422214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:52.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:52 smithi131 bash[24745]: cluster 2024-09-14T05:56:51.411170+0000 mgr.a (mgr.14355) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:52 smithi171 bash[25040]: audit 2024-09-14T05:56:51.361033+0000 mgr.a (mgr.14355) 19716 : audit [DBG] from='client.422214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:52.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:52 smithi171 bash[25040]: cluster 2024-09-14T05:56:51.411170+0000 mgr.a (mgr.14355) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:53 smithi131 bash[24745]: cluster 2024-09-14T05:56:53.412083+0000 mgr.a (mgr.14355) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:53 smithi171 bash[25040]: cluster 2024-09-14T05:56:53.412083+0000 mgr.a (mgr.14355) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:53 smithi007 bash[22722]: cluster 2024-09-14T05:56:53.412083+0000 mgr.a (mgr.14355) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:56:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:55 smithi131 bash[24745]: cluster 2024-09-14T05:56:55.414420+0000 mgr.a (mgr.14355) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:55 smithi171 bash[25040]: cluster 2024-09-14T05:56:55.414420+0000 mgr.a (mgr.14355) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:55 smithi007 bash[22722]: cluster 2024-09-14T05:56:55.414420+0000 mgr.a (mgr.14355) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:56:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:56:56.810 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:56:57.568 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:56:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:56:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:56:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:56:57.569 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:56:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:57 smithi131 bash[24745]: audit 2024-09-14T05:56:57.144803+0000 mgr.a (mgr.14355) 19720 : audit [DBG] from='client.422292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:57 smithi131 bash[24745]: cluster 2024-09-14T05:56:57.414960+0000 mgr.a (mgr.14355) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:57 smithi171 bash[25040]: audit 2024-09-14T05:56:57.144803+0000 mgr.a (mgr.14355) 19720 : audit [DBG] from='client.422292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:57 smithi171 bash[25040]: cluster 2024-09-14T05:56:57.414960+0000 mgr.a (mgr.14355) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:57 smithi007 bash[22722]: audit 2024-09-14T05:56:57.144803+0000 mgr.a (mgr.14355) 19720 : audit [DBG] from='client.422292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:56:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:57 smithi007 bash[22722]: cluster 2024-09-14T05:56:57.414960+0000 mgr.a (mgr.14355) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:56:59 smithi131 bash[24745]: cluster 2024-09-14T05:56:59.415815+0000 mgr.a (mgr.14355) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:56:59 smithi171 bash[25040]: cluster 2024-09-14T05:56:59.415815+0000 mgr.a (mgr.14355) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:56:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:56:59 smithi007 bash[22722]: cluster 2024-09-14T05:56:59.415815+0000 mgr.a (mgr.14355) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:01 smithi131 bash[24745]: cluster 2024-09-14T05:57:01.418074+0000 mgr.a (mgr.14355) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:01 smithi171 bash[25040]: cluster 2024-09-14T05:57:01.418074+0000 mgr.a (mgr.14355) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:01 smithi007 bash[22722]: cluster 2024-09-14T05:57:01.418074+0000 mgr.a (mgr.14355) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:02.570 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:02.571 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:03.321 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:03.321 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:03.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:03.322 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:03 smithi131 bash[24745]: audit 2024-09-14T05:57:02.897835+0000 mgr.a (mgr.14355) 19724 : audit [DBG] from='client.422370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:03 smithi131 bash[24745]: cluster 2024-09-14T05:57:03.419031+0000 mgr.a (mgr.14355) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:03 smithi171 bash[25040]: audit 2024-09-14T05:57:02.897835+0000 mgr.a (mgr.14355) 19724 : audit [DBG] from='client.422370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:03 smithi171 bash[25040]: cluster 2024-09-14T05:57:03.419031+0000 mgr.a (mgr.14355) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:03 smithi007 bash[22722]: audit 2024-09-14T05:57:02.897835+0000 mgr.a (mgr.14355) 19724 : audit [DBG] from='client.422370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:03 smithi007 bash[22722]: cluster 2024-09-14T05:57:03.419031+0000 mgr.a (mgr.14355) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:05 smithi131 bash[24745]: cluster 2024-09-14T05:57:05.421168+0000 mgr.a (mgr.14355) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:05 smithi171 bash[25040]: cluster 2024-09-14T05:57:05.421168+0000 mgr.a (mgr.14355) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:05 smithi007 bash[22722]: cluster 2024-09-14T05:57:05.421168+0000 mgr.a (mgr.14355) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:07 smithi131 bash[24745]: cluster 2024-09-14T05:57:07.421907+0000 mgr.a (mgr.14355) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:07 smithi171 bash[25040]: cluster 2024-09-14T05:57:07.421907+0000 mgr.a (mgr.14355) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:07 smithi007 bash[22722]: cluster 2024-09-14T05:57:07.421907+0000 mgr.a (mgr.14355) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:09 smithi131 bash[24745]: audit 2024-09-14T05:57:08.657174+0000 mgr.a (mgr.14355) 19728 : audit [DBG] from='client.422448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:09 smithi131 bash[24745]: cluster 2024-09-14T05:57:09.422746+0000 mgr.a (mgr.14355) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:09 smithi171 bash[25040]: audit 2024-09-14T05:57:08.657174+0000 mgr.a (mgr.14355) 19728 : audit [DBG] from='client.422448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:09 smithi171 bash[25040]: cluster 2024-09-14T05:57:09.422746+0000 mgr.a (mgr.14355) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:09 smithi007 bash[22722]: audit 2024-09-14T05:57:08.657174+0000 mgr.a (mgr.14355) 19728 : audit [DBG] from='client.422448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:09 smithi007 bash[22722]: cluster 2024-09-14T05:57:09.422746+0000 mgr.a (mgr.14355) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:11 smithi131 bash[24745]: cluster 2024-09-14T05:57:11.424926+0000 mgr.a (mgr.14355) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:11 smithi171 bash[25040]: cluster 2024-09-14T05:57:11.424926+0000 mgr.a (mgr.14355) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:11 smithi007 bash[22722]: cluster 2024-09-14T05:57:11.424926+0000 mgr.a (mgr.14355) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:13.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:13 smithi131 bash[24745]: cluster 2024-09-14T05:57:13.425676+0000 mgr.a (mgr.14355) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:13 smithi171 bash[25040]: cluster 2024-09-14T05:57:13.425676+0000 mgr.a (mgr.14355) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:13 smithi007 bash[22722]: cluster 2024-09-14T05:57:13.425676+0000 mgr.a (mgr.14355) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:14.094 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:14.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:14 smithi131 bash[24745]: audit 2024-09-14T05:57:14.424973+0000 mgr.a (mgr.14355) 19732 : audit [DBG] from='client.422523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:14.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:14 smithi171 bash[25040]: audit 2024-09-14T05:57:14.424973+0000 mgr.a (mgr.14355) 19732 : audit [DBG] from='client.422523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:14.872 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:14.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:14 smithi007 bash[22722]: audit 2024-09-14T05:57:14.424973+0000 mgr.a (mgr.14355) 19732 : audit [DBG] from='client.422523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:15 smithi131 bash[24745]: cluster 2024-09-14T05:57:15.428125+0000 mgr.a (mgr.14355) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:15 smithi171 bash[25040]: cluster 2024-09-14T05:57:15.428125+0000 mgr.a (mgr.14355) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:15 smithi007 bash[22722]: cluster 2024-09-14T05:57:15.428125+0000 mgr.a (mgr.14355) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:17 smithi131 bash[24745]: cluster 2024-09-14T05:57:17.428938+0000 mgr.a (mgr.14355) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:17 smithi171 bash[25040]: cluster 2024-09-14T05:57:17.428938+0000 mgr.a (mgr.14355) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:17 smithi007 bash[22722]: cluster 2024-09-14T05:57:17.428938+0000 mgr.a (mgr.14355) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:19 smithi131 bash[24745]: cluster 2024-09-14T05:57:19.429671+0000 mgr.a (mgr.14355) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:19 smithi171 bash[25040]: cluster 2024-09-14T05:57:19.429671+0000 mgr.a (mgr.14355) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:19 smithi007 bash[22722]: cluster 2024-09-14T05:57:19.429671+0000 mgr.a (mgr.14355) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:20.625 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:20.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:20.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:20.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:20.626 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:20.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:20 smithi131 bash[24745]: audit 2024-09-14T05:57:20.206485+0000 mgr.a (mgr.14355) 19736 : audit [DBG] from='client.422598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:20.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:20 smithi171 bash[25040]: audit 2024-09-14T05:57:20.206485+0000 mgr.a (mgr.14355) 19736 : audit [DBG] from='client.422598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:20.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:20 smithi007 bash[22722]: audit 2024-09-14T05:57:20.206485+0000 mgr.a (mgr.14355) 19736 : audit [DBG] from='client.422598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:21 smithi131 bash[24745]: cluster 2024-09-14T05:57:21.432459+0000 mgr.a (mgr.14355) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:21 smithi171 bash[25040]: cluster 2024-09-14T05:57:21.432459+0000 mgr.a (mgr.14355) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:21 smithi007 bash[22722]: cluster 2024-09-14T05:57:21.432459+0000 mgr.a (mgr.14355) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:23 smithi131 bash[24745]: cluster 2024-09-14T05:57:23.433233+0000 mgr.a (mgr.14355) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:23.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:23 smithi171 bash[25040]: cluster 2024-09-14T05:57:23.433233+0000 mgr.a (mgr.14355) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:23 smithi007 bash[22722]: cluster 2024-09-14T05:57:23.433233+0000 mgr.a (mgr.14355) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:25.627 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:25.628 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:25 smithi131 bash[24745]: cluster 2024-09-14T05:57:25.435176+0000 mgr.a (mgr.14355) 19739 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:25 smithi171 bash[25040]: cluster 2024-09-14T05:57:25.435176+0000 mgr.a (mgr.14355) 19739 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:25 smithi007 bash[22722]: cluster 2024-09-14T05:57:25.435176+0000 mgr.a (mgr.14355) 19739 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:26.385 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:26.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:26 smithi131 bash[24745]: audit 2024-09-14T05:57:25.964692+0000 mgr.a (mgr.14355) 19740 : audit [DBG] from='client.422676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:26 smithi171 bash[25040]: audit 2024-09-14T05:57:25.964692+0000 mgr.a (mgr.14355) 19740 : audit [DBG] from='client.422676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:26 smithi007 bash[22722]: audit 2024-09-14T05:57:25.964692+0000 mgr.a (mgr.14355) 19740 : audit [DBG] from='client.422676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:27 smithi131 bash[24745]: cluster 2024-09-14T05:57:27.436064+0000 mgr.a (mgr.14355) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:27 smithi171 bash[25040]: cluster 2024-09-14T05:57:27.436064+0000 mgr.a (mgr.14355) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:27 smithi007 bash[22722]: cluster 2024-09-14T05:57:27.436064+0000 mgr.a (mgr.14355) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:57:29.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:29 smithi131 bash[24745]: cluster 2024-09-14T05:57:29.436827+0000 mgr.a (mgr.14355) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:57:29.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:29 smithi171 bash[25040]: cluster 2024-09-14T05:57:29.436827+0000 mgr.a (mgr.14355) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:57:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:29 smithi007 bash[22722]: cluster 2024-09-14T05:57:29.436827+0000 mgr.a (mgr.14355) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:57:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:30 smithi131 bash[24745]: audit 2024-09-14T05:57:30.691345+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:57:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:30 smithi171 bash[25040]: audit 2024-09-14T05:57:30.691345+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:57:31.204 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:30 smithi007 bash[22722]: audit 2024-09-14T05:57:30.691345+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:57:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:31.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:31.387 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:32.166 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:32.167 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:31.323367+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:31.327193+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: cluster 2024-09-14T05:57:31.438194+0000 mgr.a (mgr.14355) 19743 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:32.147606+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:32.148460+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:57:32.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:32.153566+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22722]: audit 2024-09-14T05:57:32.155766+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:31.323367+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:31.327193+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: cluster 2024-09-14T05:57:31.438194+0000 mgr.a (mgr.14355) 19743 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:32.147606+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:32.148460+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:32.153566+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:32 smithi131 bash[24745]: audit 2024-09-14T05:57:32.155766+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:32.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:31.323367+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:31.327193+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: cluster 2024-09-14T05:57:31.438194+0000 mgr.a (mgr.14355) 19743 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:32.147606+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:32.148460+0000 mon.a (mon.0) 3533 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:32.153566+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:57:32.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:32 smithi171 bash[25040]: audit 2024-09-14T05:57:32.155766+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:33.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22972]: debug 2024-09-14T05:57:32.860+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:57:33.204 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:57:32 smithi007 bash[22972]: debug 2024-09-14T05:57:32.860+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:57:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:33 smithi007 bash[22722]: audit 2024-09-14T05:57:31.712771+0000 mgr.a (mgr.14355) 19744 : audit [DBG] from='client.422754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:33.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:33 smithi007 bash[22722]: audit 2024-09-14T05:57:32.156888+0000 mgr.a (mgr.14355) 19745 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:33 smithi131 bash[24745]: audit 2024-09-14T05:57:31.712771+0000 mgr.a (mgr.14355) 19744 : audit [DBG] from='client.422754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:33.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:33 smithi131 bash[24745]: audit 2024-09-14T05:57:32.156888+0000 mgr.a (mgr.14355) 19745 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:33 smithi171 bash[25040]: audit 2024-09-14T05:57:31.712771+0000 mgr.a (mgr.14355) 19744 : audit [DBG] from='client.422754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:33.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:33 smithi171 bash[25040]: audit 2024-09-14T05:57:32.156888+0000 mgr.a (mgr.14355) 19745 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:57:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:34 smithi007 bash[22722]: audit 2024-09-14T05:57:32.864003+0000 mgr.a (mgr.14355) 19746 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:57:34.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:34 smithi007 bash[22722]: cephadm 2024-09-14T05:57:32.865426+0000 mgr.a (mgr.14355) 19747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:57:34.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:34 smithi007 bash[22722]: cluster 2024-09-14T05:57:33.439295+0000 mgr.a (mgr.14355) 19748 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:34 smithi131 bash[24745]: audit 2024-09-14T05:57:32.864003+0000 mgr.a (mgr.14355) 19746 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:57:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:34 smithi131 bash[24745]: cephadm 2024-09-14T05:57:32.865426+0000 mgr.a (mgr.14355) 19747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:57:34.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:34 smithi131 bash[24745]: cluster 2024-09-14T05:57:33.439295+0000 mgr.a (mgr.14355) 19748 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:34.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:34 smithi171 bash[25040]: audit 2024-09-14T05:57:32.864003+0000 mgr.a (mgr.14355) 19746 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:57:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:34 smithi171 bash[25040]: cephadm 2024-09-14T05:57:32.865426+0000 mgr.a (mgr.14355) 19747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:57:34.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:34 smithi171 bash[25040]: cluster 2024-09-14T05:57:33.439295+0000 mgr.a (mgr.14355) 19748 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:35.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:35 smithi131 bash[24745]: cluster 2024-09-14T05:57:35.441503+0000 mgr.a (mgr.14355) 19749 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:35.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:35 smithi171 bash[25040]: cluster 2024-09-14T05:57:35.441503+0000 mgr.a (mgr.14355) 19749 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:35.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:35 smithi007 bash[22722]: cluster 2024-09-14T05:57:35.441503+0000 mgr.a (mgr.14355) 19749 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:37.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:37 smithi131 bash[24745]: cluster 2024-09-14T05:57:37.442249+0000 mgr.a (mgr.14355) 19750 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:37.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:37 smithi171 bash[25040]: cluster 2024-09-14T05:57:37.442249+0000 mgr.a (mgr.14355) 19750 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:37.950 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:37.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:37.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:37.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:37.950 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:37.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:37 smithi007 bash[22722]: cluster 2024-09-14T05:57:37.442249+0000 mgr.a (mgr.14355) 19750 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:38.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:38 smithi131 bash[24745]: audit 2024-09-14T05:57:37.506659+0000 mgr.a (mgr.14355) 19751 : audit [DBG] from='client.422940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:38.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:38 smithi171 bash[25040]: audit 2024-09-14T05:57:37.506659+0000 mgr.a (mgr.14355) 19751 : audit [DBG] from='client.422940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:38.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:38 smithi007 bash[22722]: audit 2024-09-14T05:57:37.506659+0000 mgr.a (mgr.14355) 19751 : audit [DBG] from='client.422940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:39.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:39 smithi131 bash[24745]: cluster 2024-09-14T05:57:39.443242+0000 mgr.a (mgr.14355) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:39.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:39 smithi171 bash[25040]: cluster 2024-09-14T05:57:39.443242+0000 mgr.a (mgr.14355) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:39.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:39 smithi007 bash[22722]: cluster 2024-09-14T05:57:39.443242+0000 mgr.a (mgr.14355) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:41.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:41 smithi131 bash[24745]: cluster 2024-09-14T05:57:41.445522+0000 mgr.a (mgr.14355) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:41.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:41 smithi171 bash[25040]: cluster 2024-09-14T05:57:41.445522+0000 mgr.a (mgr.14355) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:41.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:41 smithi007 bash[22722]: cluster 2024-09-14T05:57:41.445522+0000 mgr.a (mgr.14355) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:43.705 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:43.705 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:43 smithi131 bash[24745]: audit 2024-09-14T05:57:43.283383+0000 mgr.a (mgr.14355) 19754 : audit [DBG] from='client.423018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:43.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:43 smithi131 bash[24745]: cluster 2024-09-14T05:57:43.446096+0000 mgr.a (mgr.14355) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:43 smithi171 bash[25040]: audit 2024-09-14T05:57:43.283383+0000 mgr.a (mgr.14355) 19754 : audit [DBG] from='client.423018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:43.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:43 smithi171 bash[25040]: cluster 2024-09-14T05:57:43.446096+0000 mgr.a (mgr.14355) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:43 smithi007 bash[22722]: audit 2024-09-14T05:57:43.283383+0000 mgr.a (mgr.14355) 19754 : audit [DBG] from='client.423018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:43.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:43 smithi007 bash[22722]: cluster 2024-09-14T05:57:43.446096+0000 mgr.a (mgr.14355) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:45.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:45 smithi131 bash[24745]: cluster 2024-09-14T05:57:45.448423+0000 mgr.a (mgr.14355) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:45.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:45 smithi171 bash[25040]: cluster 2024-09-14T05:57:45.448423+0000 mgr.a (mgr.14355) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:45.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:45 smithi007 bash[22722]: cluster 2024-09-14T05:57:45.448423+0000 mgr.a (mgr.14355) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:57:47.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:47 smithi131 bash[24745]: cluster 2024-09-14T05:57:47.449218+0000 mgr.a (mgr.14355) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:47.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:47 smithi171 bash[25040]: cluster 2024-09-14T05:57:47.449218+0000 mgr.a (mgr.14355) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:47.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:47 smithi007 bash[22722]: cluster 2024-09-14T05:57:47.449218+0000 mgr.a (mgr.14355) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:48.706 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:48.707 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:48.707 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:49.486 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:49 smithi131 bash[24745]: audit 2024-09-14T05:57:49.043746+0000 mgr.a (mgr.14355) 19758 : audit [DBG] from='client.423096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:49.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:49 smithi131 bash[24745]: cluster 2024-09-14T05:57:49.449759+0000 mgr.a (mgr.14355) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:49 smithi171 bash[25040]: audit 2024-09-14T05:57:49.043746+0000 mgr.a (mgr.14355) 19758 : audit [DBG] from='client.423096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:49.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:49 smithi171 bash[25040]: cluster 2024-09-14T05:57:49.449759+0000 mgr.a (mgr.14355) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:49 smithi007 bash[22722]: audit 2024-09-14T05:57:49.043746+0000 mgr.a (mgr.14355) 19758 : audit [DBG] from='client.423096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:49.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:49 smithi007 bash[22722]: cluster 2024-09-14T05:57:49.449759+0000 mgr.a (mgr.14355) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:51.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:51 smithi131 bash[24745]: cluster 2024-09-14T05:57:51.451944+0000 mgr.a (mgr.14355) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:51.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:51 smithi171 bash[25040]: cluster 2024-09-14T05:57:51.451944+0000 mgr.a (mgr.14355) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:51.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:51 smithi007 bash[22722]: cluster 2024-09-14T05:57:51.451944+0000 mgr.a (mgr.14355) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:53 smithi131 bash[24745]: cluster 2024-09-14T05:57:53.452720+0000 mgr.a (mgr.14355) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:53 smithi171 bash[25040]: cluster 2024-09-14T05:57:53.452720+0000 mgr.a (mgr.14355) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:53.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:53 smithi007 bash[22722]: cluster 2024-09-14T05:57:53.452720+0000 mgr.a (mgr.14355) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:54.487 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:57:54.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:57:54.489 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:57:55.257 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:57:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:57:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:57:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:57:55.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:57:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:55 smithi131 bash[24745]: audit 2024-09-14T05:57:54.824242+0000 mgr.a (mgr.14355) 19762 : audit [DBG] from='client.423174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:55 smithi131 bash[24745]: cluster 2024-09-14T05:57:55.455026+0000 mgr.a (mgr.14355) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:55 smithi171 bash[25040]: audit 2024-09-14T05:57:54.824242+0000 mgr.a (mgr.14355) 19762 : audit [DBG] from='client.423174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:55 smithi171 bash[25040]: cluster 2024-09-14T05:57:55.455026+0000 mgr.a (mgr.14355) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:55 smithi007 bash[22722]: audit 2024-09-14T05:57:54.824242+0000 mgr.a (mgr.14355) 19762 : audit [DBG] from='client.423174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:57:55.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:55 smithi007 bash[22722]: cluster 2024-09-14T05:57:55.455026+0000 mgr.a (mgr.14355) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:57:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:57 smithi131 bash[24745]: cluster 2024-09-14T05:57:57.455800+0000 mgr.a (mgr.14355) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:57 smithi171 bash[25040]: cluster 2024-09-14T05:57:57.455800+0000 mgr.a (mgr.14355) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:57.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:57 smithi007 bash[22722]: cluster 2024-09-14T05:57:57.455800+0000 mgr.a (mgr.14355) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:57:59 smithi131 bash[24745]: cluster 2024-09-14T05:57:59.456576+0000 mgr.a (mgr.14355) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:57:59 smithi171 bash[25040]: cluster 2024-09-14T05:57:59.456576+0000 mgr.a (mgr.14355) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:57:59.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:57:59 smithi007 bash[22722]: cluster 2024-09-14T05:57:59.456576+0000 mgr.a (mgr.14355) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:01.011 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:01.012 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:01 smithi131 bash[24745]: audit 2024-09-14T05:58:00.588684+0000 mgr.a (mgr.14355) 19766 : audit [DBG] from='client.423249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:01 smithi131 bash[24745]: cluster 2024-09-14T05:58:01.459533+0000 mgr.a (mgr.14355) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:01 smithi171 bash[25040]: audit 2024-09-14T05:58:00.588684+0000 mgr.a (mgr.14355) 19766 : audit [DBG] from='client.423249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:01 smithi171 bash[25040]: cluster 2024-09-14T05:58:01.459533+0000 mgr.a (mgr.14355) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:01 smithi007 bash[22722]: audit 2024-09-14T05:58:00.588684+0000 mgr.a (mgr.14355) 19766 : audit [DBG] from='client.423249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:01.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:01 smithi007 bash[22722]: cluster 2024-09-14T05:58:01.459533+0000 mgr.a (mgr.14355) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:03 smithi131 bash[24745]: cluster 2024-09-14T05:58:03.460381+0000 mgr.a (mgr.14355) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:03 smithi171 bash[25040]: cluster 2024-09-14T05:58:03.460381+0000 mgr.a (mgr.14355) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:03.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:03 smithi007 bash[22722]: cluster 2024-09-14T05:58:03.460381+0000 mgr.a (mgr.14355) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:05 smithi131 bash[24745]: cluster 2024-09-14T05:58:05.462342+0000 mgr.a (mgr.14355) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:05 smithi171 bash[25040]: cluster 2024-09-14T05:58:05.462342+0000 mgr.a (mgr.14355) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:05.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:05 smithi007 bash[22722]: cluster 2024-09-14T05:58:05.462342+0000 mgr.a (mgr.14355) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:06.013 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:06.014 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:06.014 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:06.760 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:06.760 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:06 smithi131 bash[24745]: audit 2024-09-14T05:58:06.346440+0000 mgr.a (mgr.14355) 19770 : audit [DBG] from='client.423327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:06 smithi171 bash[25040]: audit 2024-09-14T05:58:06.346440+0000 mgr.a (mgr.14355) 19770 : audit [DBG] from='client.423327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:06.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:06 smithi007 bash[22722]: audit 2024-09-14T05:58:06.346440+0000 mgr.a (mgr.14355) 19770 : audit [DBG] from='client.423327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:07 smithi171 bash[25040]: cluster 2024-09-14T05:58:07.463291+0000 mgr.a (mgr.14355) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:07.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:07 smithi007 bash[22722]: cluster 2024-09-14T05:58:07.463291+0000 mgr.a (mgr.14355) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:08.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:07 smithi131 bash[24745]: cluster 2024-09-14T05:58:07.463291+0000 mgr.a (mgr.14355) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:58:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:09 smithi131 bash[24745]: cluster 2024-09-14T05:58:09.464087+0000 mgr.a (mgr.14355) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:58:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:09 smithi171 bash[25040]: cluster 2024-09-14T05:58:09.464087+0000 mgr.a (mgr.14355) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:58:09.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:09 smithi007 bash[22722]: cluster 2024-09-14T05:58:09.464087+0000 mgr.a (mgr.14355) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:58:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:11.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:11 smithi131 bash[24745]: cluster 2024-09-14T05:58:11.466270+0000 mgr.a (mgr.14355) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:11 smithi171 bash[25040]: cluster 2024-09-14T05:58:11.466270+0000 mgr.a (mgr.14355) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:11.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:11 smithi007 bash[22722]: cluster 2024-09-14T05:58:11.466270+0000 mgr.a (mgr.14355) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:12.509 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:12.510 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:12.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:12 smithi131 bash[24745]: audit 2024-09-14T05:58:12.091604+0000 mgr.a (mgr.14355) 19774 : audit [DBG] from='client.423399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:12.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:12 smithi171 bash[25040]: audit 2024-09-14T05:58:12.091604+0000 mgr.a (mgr.14355) 19774 : audit [DBG] from='client.423399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:12.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:12 smithi007 bash[22722]: audit 2024-09-14T05:58:12.091604+0000 mgr.a (mgr.14355) 19774 : audit [DBG] from='client.423399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:13 smithi171 bash[25040]: cluster 2024-09-14T05:58:13.467225+0000 mgr.a (mgr.14355) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:13.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:13 smithi007 bash[22722]: cluster 2024-09-14T05:58:13.467225+0000 mgr.a (mgr.14355) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:14.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:13 smithi131 bash[24745]: cluster 2024-09-14T05:58:13.467225+0000 mgr.a (mgr.14355) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:15 smithi171 bash[25040]: cluster 2024-09-14T05:58:15.469395+0000 mgr.a (mgr.14355) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:15.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:15 smithi007 bash[22722]: cluster 2024-09-14T05:58:15.469395+0000 mgr.a (mgr.14355) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:16.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:15 smithi131 bash[24745]: cluster 2024-09-14T05:58:15.469395+0000 mgr.a (mgr.14355) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:17.511 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:17.512 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:17 smithi131 bash[24745]: cluster 2024-09-14T05:58:17.470171+0000 mgr.a (mgr.14355) 19777 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:17 smithi171 bash[25040]: cluster 2024-09-14T05:58:17.470171+0000 mgr.a (mgr.14355) 19777 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:17.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:17 smithi007 bash[22722]: cluster 2024-09-14T05:58:17.470171+0000 mgr.a (mgr.14355) 19777 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:18.279 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:18.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:18 smithi171 bash[25040]: audit 2024-09-14T05:58:17.843509+0000 mgr.a (mgr.14355) 19778 : audit [DBG] from='client.423474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:18.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:18 smithi007 bash[22722]: audit 2024-09-14T05:58:17.843509+0000 mgr.a (mgr.14355) 19778 : audit [DBG] from='client.423474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:19.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:18 smithi131 bash[24745]: audit 2024-09-14T05:58:17.843509+0000 mgr.a (mgr.14355) 19778 : audit [DBG] from='client.423474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:19 smithi171 bash[25040]: cluster 2024-09-14T05:58:19.471139+0000 mgr.a (mgr.14355) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:19.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:19 smithi007 bash[22722]: cluster 2024-09-14T05:58:19.471139+0000 mgr.a (mgr.14355) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:20.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:19 smithi131 bash[24745]: cluster 2024-09-14T05:58:19.471139+0000 mgr.a (mgr.14355) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:21 smithi171 bash[25040]: cluster 2024-09-14T05:58:21.473378+0000 mgr.a (mgr.14355) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:21.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:21 smithi007 bash[22722]: cluster 2024-09-14T05:58:21.473378+0000 mgr.a (mgr.14355) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:22.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:21 smithi131 bash[24745]: cluster 2024-09-14T05:58:21.473378+0000 mgr.a (mgr.14355) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:23.281 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:23.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:23.282 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:23 smithi171 bash[25040]: cluster 2024-09-14T05:58:23.474119+0000 mgr.a (mgr.14355) 19781 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:23.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:23 smithi007 bash[22722]: cluster 2024-09-14T05:58:23.474119+0000 mgr.a (mgr.14355) 19781 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:24.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:23 smithi131 bash[24745]: cluster 2024-09-14T05:58:23.474119+0000 mgr.a (mgr.14355) 19781 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:24.070 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:24.070 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:24.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:24 smithi171 bash[25040]: audit 2024-09-14T05:58:23.620524+0000 mgr.a (mgr.14355) 19782 : audit [DBG] from='client.423546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:24.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:24 smithi007 bash[22722]: audit 2024-09-14T05:58:23.620524+0000 mgr.a (mgr.14355) 19782 : audit [DBG] from='client.423546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:25.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:24 smithi131 bash[24745]: audit 2024-09-14T05:58:23.620524+0000 mgr.a (mgr.14355) 19782 : audit [DBG] from='client.423546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:26.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:26 smithi171 bash[25040]: cluster 2024-09-14T05:58:25.476477+0000 mgr.a (mgr.14355) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:26.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:26 smithi007 bash[22722]: cluster 2024-09-14T05:58:25.476477+0000 mgr.a (mgr.14355) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:27.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:26 smithi131 bash[24745]: cluster 2024-09-14T05:58:25.476477+0000 mgr.a (mgr.14355) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:28.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:28 smithi007 bash[22722]: cluster 2024-09-14T05:58:27.477374+0000 mgr.a (mgr.14355) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:29.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:28 smithi131 bash[24745]: cluster 2024-09-14T05:58:27.477374+0000 mgr.a (mgr.14355) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:29.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:28 smithi171 bash[25040]: cluster 2024-09-14T05:58:27.477374+0000 mgr.a (mgr.14355) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:29.071 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:29.072 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:29.072 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:29.854 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:29.854 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:29.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:29 smithi007 bash[22722]: audit 2024-09-14T05:58:29.407541+0000 mgr.a (mgr.14355) 19785 : audit [DBG] from='client.423624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:30.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:29 smithi131 bash[24745]: audit 2024-09-14T05:58:29.407541+0000 mgr.a (mgr.14355) 19785 : audit [DBG] from='client.423624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:30.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:29 smithi171 bash[25040]: audit 2024-09-14T05:58:29.407541+0000 mgr.a (mgr.14355) 19785 : audit [DBG] from='client.423624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:30.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:30 smithi007 bash[22722]: cluster 2024-09-14T05:58:29.477995+0000 mgr.a (mgr.14355) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:31.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:30 smithi131 bash[24745]: cluster 2024-09-14T05:58:29.477995+0000 mgr.a (mgr.14355) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:31.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:30 smithi171 bash[25040]: cluster 2024-09-14T05:58:29.477995+0000 mgr.a (mgr.14355) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:32 smithi007 bash[22722]: cluster 2024-09-14T05:58:31.480331+0000 mgr.a (mgr.14355) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:33.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:32 smithi131 bash[24745]: cluster 2024-09-14T05:58:31.480331+0000 mgr.a (mgr.14355) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:33.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:32 smithi171 bash[25040]: cluster 2024-09-14T05:58:31.480331+0000 mgr.a (mgr.14355) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:33 smithi007 bash[22722]: audit 2024-09-14T05:58:32.914263+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:58:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:33 smithi007 bash[22722]: audit 2024-09-14T05:58:33.531166+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:33 smithi007 bash[22722]: audit 2024-09-14T05:58:33.534485+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:33.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:33 smithi007 bash[22722]: audit 2024-09-14T05:58:33.537891+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:33.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:33 smithi007 bash[22722]: audit 2024-09-14T05:58:33.541929+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:33 smithi131 bash[24745]: audit 2024-09-14T05:58:32.914263+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:58:34.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:33 smithi131 bash[24745]: audit 2024-09-14T05:58:33.531166+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:33 smithi131 bash[24745]: audit 2024-09-14T05:58:33.534485+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:33 smithi131 bash[24745]: audit 2024-09-14T05:58:33.537891+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:33 smithi131 bash[24745]: audit 2024-09-14T05:58:33.541929+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:33 smithi171 bash[25040]: audit 2024-09-14T05:58:32.914263+0000 mon.a (mon.0) 3536 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-14T05:58:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:33 smithi171 bash[25040]: audit 2024-09-14T05:58:33.531166+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.045 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:33 smithi171 bash[25040]: audit 2024-09-14T05:58:33.534485+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:33 smithi171 bash[25040]: audit 2024-09-14T05:58:33.537891+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.046 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:33 smithi171 bash[25040]: audit 2024-09-14T05:58:33.541929+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:34.855 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:34.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:34.856 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: cluster 2024-09-14T05:58:33.481059+0000 mgr.a (mgr.14355) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.161965+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.168480+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.821236+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.829642+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.850094+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.858112+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.860207+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.861866+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.869996+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22722]: audit 2024-09-14T05:58:34.873207+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: cluster 2024-09-14T05:58:33.481059+0000 mgr.a (mgr.14355) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.161965+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.168480+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.821236+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.829642+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.850094+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.858112+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.860207+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.861866+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.869996+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.534 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:35 smithi131 bash[24745]: audit 2024-09-14T05:58:34.873207+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:35.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: cluster 2024-09-14T05:58:33.481059+0000 mgr.a (mgr.14355) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.161965+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.168480+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.821236+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.829642+0000 mon.a (mon.0) 3544 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.850094+0000 mon.a (mon.0) 3545 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.858112+0000 mon.a (mon.0) 3546 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.860207+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.861866+0000 mon.a (mon.0) 3548 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.869996+0000 mon.a (mon.0) 3549 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' 2024-09-14T05:58:35.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:35 smithi171 bash[25040]: audit 2024-09-14T05:58:34.873207+0000 mon.a (mon.0) 3550 : audit [INF] from='mgr.14355 172.21.15.7:0/2452550636' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:35.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22972]: debug 2024-09-14T05:58:35.627+0000 7f405dc4f640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:58:35.954 INFO:journalctl@ceph.mgr.a.smithi007.stdout:Sep 14 05:58:35 smithi007 bash[22972]: debug 2024-09-14T05:58:35.639+0000 7f4076580640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:58:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:36.041 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:36 smithi007 bash[22722]: audit 2024-09-14T05:58:34.875503+0000 mgr.a (mgr.14355) 19789 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:36.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:36 smithi007 bash[22722]: audit 2024-09-14T05:58:35.211336+0000 mgr.a (mgr.14355) 19790 : audit [DBG] from='client.423705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:36 smithi131 bash[24745]: audit 2024-09-14T05:58:34.875503+0000 mgr.a (mgr.14355) 19789 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:36.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:36 smithi131 bash[24745]: audit 2024-09-14T05:58:35.211336+0000 mgr.a (mgr.14355) 19790 : audit [DBG] from='client.423705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:36 smithi171 bash[25040]: audit 2024-09-14T05:58:34.875503+0000 mgr.a (mgr.14355) 19789 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: dispatch 2024-09-14T05:58:36.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:36 smithi171 bash[25040]: audit 2024-09-14T05:58:35.211336+0000 mgr.a (mgr.14355) 19790 : audit [DBG] from='client.423705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:37 smithi007 bash[22722]: cluster 2024-09-14T05:58:35.482423+0000 mgr.a (mgr.14355) 19791 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:58:37.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:37 smithi007 bash[22722]: audit 2024-09-14T05:58:35.632673+0000 mgr.a (mgr.14355) 19792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:58:37.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:37 smithi007 bash[22722]: cephadm 2024-09-14T05:58:35.643566+0000 mgr.a (mgr.14355) 19793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:58:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:37 smithi131 bash[24745]: cluster 2024-09-14T05:58:35.482423+0000 mgr.a (mgr.14355) 19791 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:58:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:37 smithi131 bash[24745]: audit 2024-09-14T05:58:35.632673+0000 mgr.a (mgr.14355) 19792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:58:37.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:37 smithi131 bash[24745]: cephadm 2024-09-14T05:58:35.643566+0000 mgr.a (mgr.14355) 19793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:58:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:37 smithi171 bash[25040]: cluster 2024-09-14T05:58:35.482423+0000 mgr.a (mgr.14355) 19791 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-14T05:58:37.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:37 smithi171 bash[25040]: audit 2024-09-14T05:58:35.632673+0000 mgr.a (mgr.14355) 19792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjAxOTcxOTJhLWE1MzEtNDg4MC05MWUxLTcwNzBjNzc3YTc5ZiIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiR1VHVTlaODVTS0Q3SkxJQjZEWlEiLAogICAgInNlY3JldCI6ICJDVTBnaWpaem9qMlRvY2tONHNDTDB1ZG1UUk5YYWpiTnN0bklVSWRZIgp9", "zone_endpoints": ["http://smithi131:5500", "http://smithi171:5500"]}]: access denied 2024-09-14T05:58:37.546 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:37 smithi171 bash[25040]: cephadm 2024-09-14T05:58:35.643566+0000 mgr.a (mgr.14355) 19793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-14T05:58:39.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:39 smithi007 bash[22722]: cluster 2024-09-14T05:58:37.483291+0000 mgr.a (mgr.14355) 19794 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:39.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:39 smithi131 bash[24745]: cluster 2024-09-14T05:58:37.483291+0000 mgr.a (mgr.14355) 19794 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:39.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:39 smithi171 bash[25040]: cluster 2024-09-14T05:58:37.483291+0000 mgr.a (mgr.14355) 19794 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:41.042 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:41.042 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:41.043 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:41.456 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:41 smithi007 bash[22722]: cluster 2024-09-14T05:58:39.484094+0000 mgr.a (mgr.14355) 19795 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:41.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:41 smithi131 bash[24745]: cluster 2024-09-14T05:58:39.484094+0000 mgr.a (mgr.14355) 19795 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:41.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:41 smithi171 bash[25040]: cluster 2024-09-14T05:58:39.484094+0000 mgr.a (mgr.14355) 19795 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-14T05:58:41.829 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:41.829 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:41.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:42.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:42 smithi007 bash[22722]: audit 2024-09-14T05:58:41.381472+0000 mgr.a (mgr.14355) 19796 : audit [DBG] from='client.423888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:42.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:42 smithi131 bash[24745]: audit 2024-09-14T05:58:41.381472+0000 mgr.a (mgr.14355) 19796 : audit [DBG] from='client.423888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:42.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:42 smithi171 bash[25040]: audit 2024-09-14T05:58:41.381472+0000 mgr.a (mgr.14355) 19796 : audit [DBG] from='client.423888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:43.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:43 smithi007 bash[22722]: cluster 2024-09-14T05:58:41.485389+0000 mgr.a (mgr.14355) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:43.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:43 smithi131 bash[24745]: cluster 2024-09-14T05:58:41.485389+0000 mgr.a (mgr.14355) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:43.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:43 smithi171 bash[25040]: cluster 2024-09-14T05:58:41.485389+0000 mgr.a (mgr.14355) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:45.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:45 smithi007 bash[22722]: cluster 2024-09-14T05:58:43.486436+0000 mgr.a (mgr.14355) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:58:45.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:45 smithi131 bash[24745]: cluster 2024-09-14T05:58:43.486436+0000 mgr.a (mgr.14355) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:58:45.548 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:45 smithi171 bash[25040]: cluster 2024-09-14T05:58:43.486436+0000 mgr.a (mgr.14355) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-14T05:58:46.830 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:46.831 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:47.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:47 smithi131 bash[24745]: cluster 2024-09-14T05:58:45.488624+0000 mgr.a (mgr.14355) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:47.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:47 smithi171 bash[25040]: cluster 2024-09-14T05:58:45.488624+0000 mgr.a (mgr.14355) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:47.617 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:47.617 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:47.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:47 smithi007 bash[22722]: cluster 2024-09-14T05:58:45.488624+0000 mgr.a (mgr.14355) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-14T05:58:48.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:48 smithi131 bash[24745]: audit 2024-09-14T05:58:47.171389+0000 mgr.a (mgr.14355) 19800 : audit [DBG] from='client.423966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:48.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:48 smithi171 bash[25040]: audit 2024-09-14T05:58:47.171389+0000 mgr.a (mgr.14355) 19800 : audit [DBG] from='client.423966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:48.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:48 smithi007 bash[22722]: audit 2024-09-14T05:58:47.171389+0000 mgr.a (mgr.14355) 19800 : audit [DBG] from='client.423966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:49.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:49 smithi131 bash[24745]: cluster 2024-09-14T05:58:47.489154+0000 mgr.a (mgr.14355) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:49.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:49 smithi171 bash[25040]: cluster 2024-09-14T05:58:47.489154+0000 mgr.a (mgr.14355) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:49.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:49 smithi007 bash[22722]: cluster 2024-09-14T05:58:47.489154+0000 mgr.a (mgr.14355) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:51.533 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:51 smithi131 bash[24745]: cluster 2024-09-14T05:58:49.490028+0000 mgr.a (mgr.14355) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:51.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:51 smithi171 bash[25040]: cluster 2024-09-14T05:58:49.490028+0000 mgr.a (mgr.14355) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:51.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:51 smithi007 bash[22722]: cluster 2024-09-14T05:58:49.490028+0000 mgr.a (mgr.14355) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-14T05:58:52.618 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:52.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:52.619 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:53.398 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:53.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:53 smithi007 bash[22722]: cluster 2024-09-14T05:58:51.492209+0000 mgr.a (mgr.14355) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:58:53.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:53 smithi131 bash[24745]: cluster 2024-09-14T05:58:51.492209+0000 mgr.a (mgr.14355) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:58:53.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:53 smithi171 bash[25040]: cluster 2024-09-14T05:58:51.492209+0000 mgr.a (mgr.14355) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-14T05:58:54.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:54 smithi007 bash[22722]: audit 2024-09-14T05:58:52.958224+0000 mgr.a (mgr.14355) 19804 : audit [DBG] from='client.424038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:54.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:54 smithi131 bash[24745]: audit 2024-09-14T05:58:52.958224+0000 mgr.a (mgr.14355) 19804 : audit [DBG] from='client.424038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:54.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:54 smithi171 bash[25040]: audit 2024-09-14T05:58:52.958224+0000 mgr.a (mgr.14355) 19804 : audit [DBG] from='client.424038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:58:55.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:55 smithi007 bash[22722]: cluster 2024-09-14T05:58:53.493116+0000 mgr.a (mgr.14355) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:55.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:55 smithi131 bash[24745]: cluster 2024-09-14T05:58:53.493116+0000 mgr.a (mgr.14355) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:55.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:55 smithi171 bash[25040]: cluster 2024-09-14T05:58:53.493116+0000 mgr.a (mgr.14355) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:57.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:57 smithi007 bash[22722]: cluster 2024-09-14T05:58:55.495337+0000 mgr.a (mgr.14355) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:57.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:57 smithi131 bash[24745]: cluster 2024-09-14T05:58:55.495337+0000 mgr.a (mgr.14355) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:57.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:57 smithi171 bash[25040]: cluster 2024-09-14T05:58:55.495337+0000 mgr.a (mgr.14355) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:58:58.399 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:58:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:58:58.400 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:58:59.148 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:58:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:58:59.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:58:59 smithi007 bash[22722]: cluster 2024-09-14T05:58:57.496135+0000 mgr.a (mgr.14355) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:59.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:58:59 smithi131 bash[24745]: cluster 2024-09-14T05:58:57.496135+0000 mgr.a (mgr.14355) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:58:59.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:58:59 smithi171 bash[25040]: cluster 2024-09-14T05:58:57.496135+0000 mgr.a (mgr.14355) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:00.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:00 smithi007 bash[22722]: audit 2024-09-14T05:58:58.731651+0000 mgr.a (mgr.14355) 19808 : audit [DBG] from='client.424116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:00.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:00 smithi131 bash[24745]: audit 2024-09-14T05:58:58.731651+0000 mgr.a (mgr.14355) 19808 : audit [DBG] from='client.424116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:00.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:00 smithi171 bash[25040]: audit 2024-09-14T05:58:58.731651+0000 mgr.a (mgr.14355) 19808 : audit [DBG] from='client.424116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:01.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:01 smithi007 bash[22722]: cluster 2024-09-14T05:58:59.497090+0000 mgr.a (mgr.14355) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:01.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:01 smithi131 bash[24745]: cluster 2024-09-14T05:58:59.497090+0000 mgr.a (mgr.14355) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:01.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:01 smithi171 bash[25040]: cluster 2024-09-14T05:58:59.497090+0000 mgr.a (mgr.14355) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:03.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:03 smithi007 bash[22722]: cluster 2024-09-14T05:59:01.499376+0000 mgr.a (mgr.14355) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:03.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:03 smithi131 bash[24745]: cluster 2024-09-14T05:59:01.499376+0000 mgr.a (mgr.14355) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:03.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:03 smithi171 bash[25040]: cluster 2024-09-14T05:59:01.499376+0000 mgr.a (mgr.14355) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:59:04.931 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:59:04.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:59:04.931 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:59:04.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:59:04.932 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:59:05.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:05 smithi007 bash[22722]: cluster 2024-09-14T05:59:03.500153+0000 mgr.a (mgr.14355) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:05.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:05 smithi131 bash[24745]: cluster 2024-09-14T05:59:03.500153+0000 mgr.a (mgr.14355) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:05.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:05 smithi171 bash[25040]: cluster 2024-09-14T05:59:03.500153+0000 mgr.a (mgr.14355) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:06.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:06 smithi007 bash[22722]: audit 2024-09-14T05:59:04.486639+0000 mgr.a (mgr.14355) 19812 : audit [DBG] from='client.424194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:06.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:06 smithi131 bash[24745]: audit 2024-09-14T05:59:04.486639+0000 mgr.a (mgr.14355) 19812 : audit [DBG] from='client.424194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:06 smithi171 bash[25040]: audit 2024-09-14T05:59:04.486639+0000 mgr.a (mgr.14355) 19812 : audit [DBG] from='client.424194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:07.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:07 smithi007 bash[22722]: cluster 2024-09-14T05:59:05.502589+0000 mgr.a (mgr.14355) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:07.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:07 smithi131 bash[24745]: cluster 2024-09-14T05:59:05.502589+0000 mgr.a (mgr.14355) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:07.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:07 smithi171 bash[25040]: cluster 2024-09-14T05:59:05.502589+0000 mgr.a (mgr.14355) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:09.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:09 smithi007 bash[22722]: cluster 2024-09-14T05:59:07.503358+0000 mgr.a (mgr.14355) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:09.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:09 smithi131 bash[24745]: cluster 2024-09-14T05:59:07.503358+0000 mgr.a (mgr.14355) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:09.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:09 smithi171 bash[25040]: cluster 2024-09-14T05:59:07.503358+0000 mgr.a (mgr.14355) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:59:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:59:09.933 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:59:10.709 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:59:10.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:59:10.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:59:10.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:59:10.710 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:59:11.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:11 smithi007 bash[22722]: cluster 2024-09-14T05:59:09.504145+0000 mgr.a (mgr.14355) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:11.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:11 smithi007 bash[22722]: audit 2024-09-14T05:59:10.267201+0000 mgr.a (mgr.14355) 19816 : audit [DBG] from='client.424272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:11 smithi131 bash[24745]: cluster 2024-09-14T05:59:09.504145+0000 mgr.a (mgr.14355) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:11.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:11 smithi131 bash[24745]: audit 2024-09-14T05:59:10.267201+0000 mgr.a (mgr.14355) 19816 : audit [DBG] from='client.424272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:11 smithi171 bash[25040]: cluster 2024-09-14T05:59:09.504145+0000 mgr.a (mgr.14355) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:11.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:11 smithi171 bash[25040]: audit 2024-09-14T05:59:10.267201+0000 mgr.a (mgr.14355) 19816 : audit [DBG] from='client.424272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:13 smithi007 bash[22722]: cluster 2024-09-14T05:59:11.507045+0000 mgr.a (mgr.14355) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:13.784 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:13 smithi131 bash[24745]: cluster 2024-09-14T05:59:11.507045+0000 mgr.a (mgr.14355) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:13.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:13 smithi171 bash[25040]: cluster 2024-09-14T05:59:11.507045+0000 mgr.a (mgr.14355) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:15.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:15 smithi007 bash[22722]: cluster 2024-09-14T05:59:13.507845+0000 mgr.a (mgr.14355) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:15.711 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:59:15.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:59:15.712 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:59:15.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:15 smithi131 bash[24745]: cluster 2024-09-14T05:59:13.507845+0000 mgr.a (mgr.14355) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:15.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:15 smithi171 bash[25040]: cluster 2024-09-14T05:59:13.507845+0000 mgr.a (mgr.14355) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:16.469 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:59:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:59:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:59:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:59:16.470 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:59:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:17 smithi007 bash[22722]: cluster 2024-09-14T05:59:15.509800+0000 mgr.a (mgr.14355) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:17.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:17 smithi007 bash[22722]: audit 2024-09-14T05:59:16.044021+0000 mgr.a (mgr.14355) 19820 : audit [DBG] from='client.424347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:17 smithi131 bash[24745]: cluster 2024-09-14T05:59:15.509800+0000 mgr.a (mgr.14355) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:17.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:17 smithi131 bash[24745]: audit 2024-09-14T05:59:16.044021+0000 mgr.a (mgr.14355) 19820 : audit [DBG] from='client.424347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:17 smithi171 bash[25040]: cluster 2024-09-14T05:59:15.509800+0000 mgr.a (mgr.14355) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:17.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:17 smithi171 bash[25040]: audit 2024-09-14T05:59:16.044021+0000 mgr.a (mgr.14355) 19820 : audit [DBG] from='client.424347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:19.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:19 smithi007 bash[22722]: cluster 2024-09-14T05:59:17.510702+0000 mgr.a (mgr.14355) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:19.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:19 smithi131 bash[24745]: cluster 2024-09-14T05:59:17.510702+0000 mgr.a (mgr.14355) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:19.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:19 smithi171 bash[25040]: cluster 2024-09-14T05:59:17.510702+0000 mgr.a (mgr.14355) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:59:21.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:21 smithi007 bash[22722]: cluster 2024-09-14T05:59:19.511497+0000 mgr.a (mgr.14355) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:59:21.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:21 smithi131 bash[24745]: cluster 2024-09-14T05:59:19.511497+0000 mgr.a (mgr.14355) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:59:21.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:21 smithi171 bash[25040]: cluster 2024-09-14T05:59:19.511497+0000 mgr.a (mgr.14355) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-14T05:59:22.223 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:59:22.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:59:22.223 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:59:22.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:59:22.224 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:59:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:23 smithi007 bash[22722]: cluster 2024-09-14T05:59:21.513719+0000 mgr.a (mgr.14355) 19823 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:23.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:23 smithi007 bash[22722]: audit 2024-09-14T05:59:21.801122+0000 mgr.a (mgr.14355) 19824 : audit [DBG] from='client.424425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:23 smithi131 bash[24745]: cluster 2024-09-14T05:59:21.513719+0000 mgr.a (mgr.14355) 19823 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:23.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:23 smithi131 bash[24745]: audit 2024-09-14T05:59:21.801122+0000 mgr.a (mgr.14355) 19824 : audit [DBG] from='client.424425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:23 smithi171 bash[25040]: cluster 2024-09-14T05:59:21.513719+0000 mgr.a (mgr.14355) 19823 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:23.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:23 smithi171 bash[25040]: audit 2024-09-14T05:59:21.801122+0000 mgr.a (mgr.14355) 19824 : audit [DBG] from='client.424425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-14T05:59:25.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:25 smithi131 bash[24745]: cluster 2024-09-14T05:59:23.514628+0000 mgr.a (mgr.14355) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:25.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:25 smithi171 bash[25040]: cluster 2024-09-14T05:59:23.514628+0000 mgr.a (mgr.14355) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:25.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:25 smithi007 bash[22722]: cluster 2024-09-14T05:59:23.514628+0000 mgr.a (mgr.14355) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-14T05:59:27.225 INFO:teuthology.orchestra.run.smithi007.stderr:+ true 2024-09-14T05:59:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ ceph rgw realm tokens 2024-09-14T05:59:27.226 INFO:teuthology.orchestra.run.smithi007.stderr:++ jq -r '.[0].token' 2024-09-14T05:59:27.783 INFO:journalctl@ceph.mon.b.smithi131.stdout:Sep 14 05:59:27 smithi131 bash[24745]: cluster 2024-09-14T05:59:25.516816+0000 mgr.a (mgr.14355) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:27.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:Sep 14 05:59:27 smithi171 bash[25040]: cluster 2024-09-14T05:59:25.516816+0000 mgr.a (mgr.14355) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:27.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 14 05:59:27 smithi007 bash[22722]: cluster 2024-09-14T05:59:25.516816+0000 mgr.a (mgr.14355) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-14T05:59:27.994 INFO:teuthology.orchestra.run.smithi007.stdout:master zone has no endpoint 2024-09-14T05:59:27.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ TOKEN='master zone has no endpoint' 2024-09-14T05:59:27.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ echo master zone has no endpoint 2024-09-14T05:59:27.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-14T05:59:27.994 INFO:teuthology.orchestra.run.smithi007.stderr:+ sleep 5 2024-09-14T05:59:29.456 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-09-14T05:59:29.456 DEBUG:teuthology.task.console_log:Killing console logger for smithi007 2024-09-14T05:59:29.457 DEBUG:teuthology.task.console_log:Killing console logger for smithi131 2024-09-14T05:59:29.458 DEBUG:teuthology.task.console_log:Killing console logger for smithi171 2024-09-14T05:59:29.458 DEBUG:teuthology.exit:Finished running handlers